Wednesday, 2018-01-17

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293600:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174356300:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)00:10
openstackLaunchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)00:10
*** waleedm has quit IRC00:12
EmilienMsshnaidm|off: hey, when you're back, can you help me to figure why we don't have undercloud logs on https://review.openstack.org/#/c/528761/ ? see http://logs.openstack.org/61/528761/24/check/tripleo-ci-centos-7-3nodes-multinode/d01d3b1/00:22
EmilienMsshnaidm|off: looks like a timeout issue again00:22
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: DEBUG ansible inventory creation  https://review.openstack.org/53331300:25
*** tzumainn has quit IRC00:27
openstackgerritzenghui.shi proposed openstack/tripleo-heat-templates master: Add PTP composable service  https://review.openstack.org/49131700:27
zshiEmilienM, thanks for the reminding, just rebased the ptp patch : https://review.openstack.org/#/c/491317/00:31
*** ecerquei has joined #tripleo00:32
EmilienMzshi: ack00:32
*** etingof has quit IRC00:33
*** rhallisey has quit IRC00:37
*** pchavva has quit IRC00:39
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Prepare Queens milestone 3  https://review.openstack.org/53454000:43
*** etingof has joined #tripleo00:50
*** tosky has quit IRC00:54
tonybIn my undercloud.conf I'm setting ipxe_enabled = false but ironic-inspector still seems to be configuring ipxe.  Any pointers on how to debug?00:57
*** ecerquei has quit IRC01:02
openstackgerritMerged openstack-infra/tripleo-ci master: Export env variables required for statistics  https://review.openstack.org/53378801:04
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293601:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174356301:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)01:10
openstackgerritMerged openstack/tripleo-quickstart master: Activate config-download for ovb-ha  https://review.openstack.org/52533101:12
*** mdnadeem has joined #tripleo01:13
*** etingof has quit IRC01:21
*** ukalifon has quit IRC01:22
*** etingof has joined #tripleo01:22
*** ukalifon has joined #tripleo01:22
openstackgerritMerged openstack/tripleo-quickstart-extras master: Align overcloud upgrade repo conf to new policy on promotion.  https://review.openstack.org/53437801:24
openstackgerritMerged openstack-infra/tripleo-ci master: Re-enable voting on scenario002-container  https://review.openstack.org/53255301:24
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support  https://review.openstack.org/53349001:33
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2  https://review.openstack.org/52363801:38
*** rbrady has quit IRC01:47
*** rbrady has joined #tripleo01:59
*** rbrady has quit IRC02:00
*** rbrady has joined #tripleo02:00
*** dsneddon has quit IRC02:01
*** bfournie has joined #tripleo02:02
*** agopi has joined #tripleo02:08
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293602:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174356302:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)02:10
openstackLaunchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)02:10
openstackgerritMerged openstack/tripleo-heat-templates master: Enable *_use_fqdn in ceph-ansible when EnableInternalTLS  https://review.openstack.org/53436602:10
openstackgerritMerged openstack/tripleo-quickstart master: Document the featuresets which have config-download  https://review.openstack.org/53446002:10
openstackgerritlvxianguo proposed openstack/tripleo-heat-templates master: modify assignment spelling  https://review.openstack.org/53458702:21
*** rlandy has quit IRC02:27
*** ramishra has joined #tripleo02:37
*** jlabarre has quit IRC02:43
*** fzdarsky_ has joined #tripleo02:45
*** fzdarsky|afk has quit IRC02:50
*** moshele has joined #tripleo02:59
*** yamahata has quit IRC02:59
*** dpawar has joined #tripleo03:05
openstackgerritMerged openstack/tripleo-common master: Move more prepare logic into kolla_builder  https://review.openstack.org/52657903:05
openstackgerritMerged openstack/tripleo-common master: Use push_destination as the registry host in env file  https://review.openstack.org/52861603:05
*** dpawar has quit IRC03:06
*** dpawar has joined #tripleo03:06
*** ramishra has quit IRC03:08
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293603:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174356303:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)03:10
openstackLaunchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)03:10
openstackgerritSteve Baker proposed openstack/tripleo-docs master: Call "openstack overcloud container image" only once  https://review.openstack.org/52862703:12
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Run "overcloud container image prepare" only once  https://review.openstack.org/52862103:13
*** ramishra has joined #tripleo03:15
openstackgerritSteve Baker proposed openstack/tripleo-common master: Discover every tag on prepare  https://review.openstack.org/52921503:15
openstackgerritSteve Baker proposed openstack/tripleo-common master: Skip unnecessary image uploads  https://review.openstack.org/53127403:15
openstackgerritSteve Baker proposed openstack/tripleo-common master: Prepare action: extra arguments  https://review.openstack.org/52658003:15
*** moshele has quit IRC03:19
*** itlinux has joined #tripleo03:25
openstackgerritTony Breeds proposed openstack/instack-undercloud master: Ensure Boolen Strings from the enviornment are treated correctly  https://review.openstack.org/53460403:28
*** ramishra has quit IRC03:34
tonyb^^^ that fixes my issue trying to disable ipxe boots03:38
*** ramishra has joined #tripleo03:38
*** yamahata has joined #tripleo03:42
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VNX Cinder Backend  https://review.openstack.org/53461203:42
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VNX Cinder Backend  https://review.openstack.org/53461203:44
*** fragatina has quit IRC03:44
*** ykarel has joined #tripleo03:45
*** shreshtha has joined #tripleo03:46
*** shreshtha has quit IRC03:46
*** shreshtha has joined #tripleo03:47
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Add support for Dell EMC VNX Cinder Backend  https://review.openstack.org/53381503:48
*** daidv has joined #tripleo03:50
*** skramaja has joined #tripleo03:52
*** udesale has joined #tripleo04:00
*** anilvenkata has joined #tripleo04:07
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293604:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174356304:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)04:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)04:10
*** dsneddon has joined #tripleo04:22
*** dsneddon has quit IRC04:23
*** jbadiapa_ has quit IRC04:25
*** psachin has joined #tripleo04:30
*** moshele has joined #tripleo04:31
*** psachin has quit IRC04:31
*** psachin has joined #tripleo04:32
*** skramaja has quit IRC04:45
*** skramaja has joined #tripleo04:47
*** links has joined #tripleo04:49
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers  https://review.openstack.org/53363804:49
*** skramaja_ has joined #tripleo04:55
*** skramaja has quit IRC04:55
openstackgerritMerged openstack-infra/tripleo-ci master: Use sample environments for OVB configuration  https://review.openstack.org/49464305:01
openstackgerritwes hayutin proposed openstack/tripleo-docs master: add reproducer-quickstart.sh documentation  https://review.openstack.org/53462105:03
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers  https://review.openstack.org/53363805:03
openstackgerritwes hayutin proposed openstack/tripleo-docs master: add reproducer-quickstart.sh documentation  https://review.openstack.org/53462105:07
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Adding support for odl hw offloading in containers  https://review.openstack.org/53462205:07
*** noslzzp_ has joined #tripleo05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293605:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174356305:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)05:10
openstackLaunchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)05:10
*** noslzzp has quit IRC05:12
*** dpawar_ has joined #tripleo05:13
* tonyb thinks he probably just messed up his dev box to the point it needs a fres install :(05:13
tonybperhaps it's time to go AFK05:14
*** sonali85 has joined #tripleo05:14
*** aputtur_ has quit IRC05:15
*** dpawar has quit IRC05:16
*** pradk has quit IRC05:17
*** dpawar_ has quit IRC05:18
*** ratailor has joined #tripleo05:18
*** ratailor has quit IRC05:19
*** trozet has quit IRC05:19
*** ratailor has joined #tripleo05:20
*** nyechiel_ has joined #tripleo05:31
*** trozet has joined #tripleo05:37
*** shreshtha has quit IRC05:37
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: DEBUG ansible inventory creation  https://review.openstack.org/53331305:40
*** pradk has joined #tripleo05:41
jaosoriorbandini: let me know when you're online05:46
*** skramaja has joined #tripleo06:00
*** skramaja_ has quit IRC06:01
*** skramaja_ has joined #tripleo06:05
*** dpawar has joined #tripleo06:06
*** absubram has joined #tripleo06:06
*** skramaja has quit IRC06:06
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293606:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)06:10
*** ooolpbot has quit IRC06:10
bandinijaosorior: yo06:13
*** pmannidi has quit IRC06:16
*** jbadiapa has joined #tripleo06:18
*** janki has joined #tripleo06:20
*** skramaja_ is now known as skramaja06:22
*** waleedm has joined #tripleo06:33
*** pmannidi has joined #tripleo06:33
*** pmannidi has quit IRC06:38
*** pgadiya has joined #tripleo06:39
*** marios has joined #tripleo06:39
*** suuuper has joined #tripleo06:48
jankimoshele, hey06:48
moshelejanki: hey :)06:48
jankimoshele, did that work?06:49
moshelejanki: yes the latest patch I uploaded did work, we are doing some more testing one it06:49
*** pmannidi has joined #tripleo06:50
moshelejanki: thanks for the support,  we also want to push the odl hw offload with containers https://review.openstack.org/#/c/534622/06:53
jankiHi. Can I get few reviews for https://review.openstack.org/#/c/529496/06:53
jankimoshele, I commented on the env file. JUst try it out. NOthing major and has no side effetcs. just to avoid duplication06:54
moshelejanki: yes I think it will work but let us test it first06:54
*** ramishra has quit IRC06:54
moshelejanki: regarding odl we may need you help to understand how to build odl in container. I will talk to you when it relevant06:55
jankimoshele, sure06:58
*** ramishra has joined #tripleo07:07
openstackgerritMerged openstack/tripleo-ipsec master: Force restart IPSEC after config tasks  https://review.openstack.org/53432107:07
openstackgerritMerged openstack/tripleo-ipsec master: Ignore errors in whack listen  https://review.openstack.org/53432207:09
*** absubram has quit IRC07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293607:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)07:10
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Upgrade/Update ODL  https://review.openstack.org/48920107:10
*** jfrancoa has joined #tripleo07:16
*** agopi has quit IRC07:16
*** threestrands_ has quit IRC07:20
*** dsariel has joined #tripleo07:21
*** dparkes has joined #tripleo07:26
*** aufi has joined #tripleo07:27
*** jkilpatr has quit IRC07:28
*** dparkes has quit IRC07:32
*** ykarel has quit IRC07:36
*** ykarel has joined #tripleo07:38
*** jkilpatr has joined #tripleo07:39
*** dparkes has joined #tripleo07:40
*** ykarel has quit IRC07:43
*** ykarel has joined #tripleo07:43
*** pcaruana has joined #tripleo07:48
jankican I get some reviews on https://review.openstack.org/#/c/529496/ marios mandre jaosorior skramaja07:48
*** honza has quit IRC07:53
*** yprokule has joined #tripleo07:54
*** dciabrin has joined #tripleo07:55
jaosoriorpanda|ruck, adarazs: are deployments to RDO cloud with devmode currently working?07:55
*** pcaruana has quit IRC07:55
*** pcaruana has joined #tripleo07:55
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260707:58
*** bogdando has joined #tripleo07:59
*** bogdando has quit IRC07:59
*** bogdando has joined #tripleo08:00
*** dparkes has quit IRC08:04
*** athomas has joined #tripleo08:05
*** florianf has joined #tripleo08:06
*** ccamacho has quit IRC08:06
openstackgerritNoam Angel proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers  https://review.openstack.org/53363808:07
*** ebarrera has joined #tripleo08:09
mariosjanki: sure will check it i just had a look at your other one08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293608:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)08:10
mhenkel_good morning jaosorior and shardy08:11
mhenkel_would you have time today to spend some cycles on the composable haproxy setup?08:12
*** shardy has joined #tripleo08:14
*** amoralej|off is now known as amoralej08:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: Add fast-forward upgrade outputs to RoleConfig  https://review.openstack.org/49922108:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: tripleo-packages repo management  https://review.openstack.org/51542908:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: Allow FASTFORWARDUPGRADE as a StackUpdateType  https://review.openstack.org/52254708:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: Add fast-forward-upgrade env  https://review.openstack.org/52220308:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Keystone fast-forward upgrade tasks  https://review.openstack.org/51462108:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Neutron fast-forward upgrade tasks  https://review.openstack.org/52154308:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Glance fast-forward upgrade tasks  https://review.openstack.org/52154408:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Cinder fast-forward upgrade tasks  https://review.openstack.org/52154508:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Nova fast-forward upgrade tasks  https://review.openstack.org/52292108:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Pacemaker fast-forward upgrade tasks  https://review.openstack.org/52339908:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP Add missing become to upgrade_steps_playbook  https://review.openstack.org/52292208:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP Add missing become to Host prep steps play  https://review.openstack.org/52292308:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: DNM ffu: ignore_errors during upgrade_tasks  https://review.openstack.org/52340008:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: DNM ffu: Workaround missing repo control when moving to Queens  https://review.openstack.org/51871908:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Swift fast-forward upgrade tasks  https://review.openstack.org/52664208:17
openstackgerritMartin AndrĂ© proposed openstack/tripleo-quickstart-extras master: Restrict resolvers to IPv4 addresses  https://review.openstack.org/53432608:18
jankimoshele, which one?08:20
jaosoriormhenkel_: what's up?08:20
*** gkadam has joined #tripleo08:21
mhenkel_hey jaosorior: I still have the issue that this server_names: "%{hiera('contrail_config_node_names')}" is interpreted as a string instead of an array in the endpoint.pp08:21
jaosoriorright, seems the fix didn't work08:22
mhenkel_any2array doesn't help because it just puts the string "["server_name"]08:22
*** ccamacho has joined #tripleo08:22
mhenkel_any2array doesn't help because it just puts the string "["server_name"]" into an array08:22
mhenkel_and not server_name itself08:23
jaosorioruhm08:23
jaosoriormhenkel_: if the endpoint name matches the service name, I could default that value08:23
mhenkel_I think this is because of a nested hiera call. The first one happens in https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp#L3308:23
shardysounds like the input to any2array is already quoted?08:24
mhenkel_shardy: exactly08:24
*** cylopez has joined #tripleo08:24
mhenkel_I also tried a parsejson in endpoint.pp08:24
shardybrb08:25
*** shardy is now known as shardy_afk08:25
jaosoriormhenkel_: what's the patch you're trying out?08:25
mhenkel_I was testing just to correctly output the array:08:25
mhenkel_  $test_names = parsejson($server_names)08:26
mhenkel_  notify{ "${name}":08:26
mhenkel_    message => $test_names,08:26
mhenkel_  }08:26
mhenkel_I also tested $test_names = any2array($server_names)08:26
jaosorioruhm, no08:26
jaosoriorthe endpoint definition08:26
jaosoriorin yaml08:26
mhenkel_this is the generated hieradata: http://paste.openstack.org/show/646325/08:27
mhenkel_the thing is: endpoints which do NOT got through service_endpoints.pp correctly interpret the array:08:28
mhenkel_like this one:08:28
mhenkel_Notice: /Stage[main]/Tripleo::Haproxy/Tripleo::Haproxy::Endpoint[heat_cfn]/Notify[heat_cfn]/message: defined 'message' as 'overcloud-controller-0.internalapi.localdomain'08:28
*** cshastri has joined #tripleo08:29
mhenkel_it outputs overcloud-controller-0.internalapi.localdomain correctly08:29
*** tesseract has joined #tripleo08:29
mhenkel_now when the endoint creation goes through service_endpoints.pp:08:29
mhenkel_Notice: /Stage[main]/Tripleo::Haproxy/Tripleo::Haproxy::Service_endpoints[contrail_config]/Tripleo::Haproxy::Endpoint[contrail_config_api]/Notify[contrail_config_api]/message: defined 'message' as '["overcloud-contrailcontroller-0.internalapi.localdomain"]'08:29
mhenkel_you see that the array is a string08:30
mhenkel_basically ["overcloud-contrailcontroller-0.internalapi.localdomain"] vs overcloud-controller-0.internalapi.localdomain08:30
*** dsariel has quit IRC08:30
jaosoriorunderstood08:30
mhenkel_and my suspicion is the nested hiera call. service_endpoints.pp calls hiera, which contains a hash with another hiera call08:31
mhenkel_$dots_endpoints = hiera("tripleo.${underscore_name}.haproxy_endpoints", {}) - 1st hiera call and tripleo.${underscore_name}.haproxy_endpoints itself contains "server_names": "%{hiera('contrail_config_node_names')}",08:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Haproxy endpoint resource: set defaults for server_names and IPs  https://review.openstack.org/53137808:33
jaosoriormhenkel_: trying this out instead https://review.openstack.org/#/c/531378/08:33
jaosoriormhenkel_: that would rely on the endpoint having the same name as the service08:33
mhenkel_I think this is a true assumption08:33
mhenkel_let me test08:33
jaosoriorso, if that works, you shouldn't need to specify that value in the yaml file08:34
jaosorioronly let the defaults do their thing08:34
*** ykarel has quit IRC08:36
*** numans has joined #tripleo08:39
mhenkel_that works08:39
mhenkel_I remove the ip_addresses and server_names from the yaml08:39
mhenkel_haproxy config is correctly generated08:39
jaosoriorwow, so you tried it out already?08:40
mhenkel_yes08:41
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers  https://review.openstack.org/53363808:41
*** pmannidi has quit IRC08:41
*** numans has quit IRC08:41
mhenkel_I am directly testing inside the haproxy container, where I can change the puppet modules and the yaml directly and just call the puppet module08:42
jaosoriorah cool08:42
jaosoriormhenkel_: alright, well, if it works for you, a +1 is appreciated :D08:42
*** mandre is now known as mandre_afk08:44
*** dparkes has joined #tripleo08:45
*** rcernin has quit IRC08:45
jaosoriordciabrin, bandini: Hey, you mentioned you wanted to talk about TLS for Redis08:50
dciabrinjaosorior, heya o/ yes i'm trying to fix my reviews upstream, I'd like to send you a recap later today. e.g. how it's working, what's left to do etc08:51
jaosoriorawesome!08:51
*** shardy_afk is now known as shardy08:52
jaosoriorshardy: what do you think of this as a solution for the problem mhenkel_ reported https://review.openstack.org/#/c/531378/08:53
*** psachin` has joined #tripleo08:53
*** psachin has quit IRC08:54
shardyjaosorior: lgtm, just need a bug reference in the commit message I think08:54
shardyjaosorior: thanks for looking into it08:54
jaosoriormhenkel_: did you file a bug?08:55
mhenkel_can there be situations where the endpoint name differs from the service name?08:55
mhenkel_jaosorior: yes, I copied you on the email;)08:55
jaosoriormhenkel_: everything is possible :D08:55
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Haproxy endpoint resource: set defaults for server_names and IPs  https://review.openstack.org/53137808:56
mhenkel_https://bugs.launchpad.net/tripleo/+bug/174362608:56
openstackLaunchpad bug 1743626 in tripleo "composable haproxy configuration fails" [Undecided,New]08:56
jaosoriorawesome08:56
jaosorioralright, added bug to the review08:56
mhenkel_jaosorior: thanks for looking into it!08:57
jaosoriornp08:57
*** jpena|off is now known as jpena08:57
shardyhttps://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp#L3308:58
shardyIsn't the endpoint name in puppet derived from the service_name, not the EndpointMap08:58
*** hasanq has joined #tripleo08:58
shardyin that case it will always match the t-h-t generated service_name_node_ips etc08:58
*** jpich has joined #tripleo08:58
shardyprovided I'm right about that I think the assumption around $name is fine08:59
shardyhttps://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp#L2708:59
jaosoriorshardy: right, but tripleo::haproxy::endpoint is not only used by the dynamic endpoints. It's how almost every endpoint in manifests/haproxy.pp is defined, and some don't match. Anyway, in those cases they do pass the server_names and ip_addresses explicitly08:59
shardyhrm we do some regsubst mangling which should not be needed if we use service_name consistently09:00
shardyjaosorior: Ok, I guess we can go with this and just ensure any special cases are commented09:00
*** daidv has quit IRC09:01
shardyits a bit confusing because the EndpointMap data isn't automatically generated, or even strictly related to the service templates09:01
*** daidv has joined #tripleo09:01
* shardy has been meaning to work out how to fix that for a while 09:01
shardyit's kind of a chicken/egg problem though ;)09:02
*** shreshtha has joined #tripleo09:02
*** StevenK has quit IRC09:02
*** shreshtha has quit IRC09:03
jaosoriorshardy: yep :/09:03
*** shreshtha has joined #tripleo09:04
*** ykarel has joined #tripleo09:04
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Dont insist on IKEv2  https://review.openstack.org/53469409:04
*** oidgar has joined #tripleo09:06
Tengushardy: hello! "small" question: I'd like to duplicate my current undercloud vm and make it a "lab". Is there an easy way to kind of reconfigure it with some other subnet/networks, and drop the heat stack, or must I recreate an undercloud from 0 (meaning different package versions)?09:06
*** fzdarsky_ is now known as fzdarsky09:07
shardyTengu: Hi, no I don't think that will work well because we have a validation that prevents changing the provisioning subnet - the reason is changing it breaks the swift rings and possibly some other stuff09:08
Tenguhmm.09:08
shardyTengu: I'd probably create a new VM, enable the same repos, then install rpm -qa from the existing node09:08
shardyTengu: then your lab can run the normal undercloud install but it should be faster without the package download09:08
TenguI think the repository for trunk won't be available -.-'09:09
shardyOr mirror the packages locally and just do the normal install process09:09
shardyTengu: Yes the repo is a delorean hash09:09
*** holser__ has joined #tripleo09:09
*** psachin` has quit IRC09:09
shardyTengu: check /etc/yum.repos.d/delorean*09:09
Tenguanyway, I'll check that. Kind of annoying I had to wait over three months for the lab infra :(09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293609:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)09:10
*** ooolpbot has quit IRC09:10
jbadiapashardy, would you mind reviewing https://review.openstack.org/#/c/530780/?09:10
shardyTengu: the idea of the delorean builds is they are repeatable, so you should be able to use the same repo setup09:10
shardyjbadiapa: ack will do09:10
Tengushardy: thanks for your advices :). Hopefully I'll be able to get something working in order to validate the updates. And get an up-to-date Pike deploy :).09:11
shardyTengu: note that tripleo-quickstart already kind of does this - it downloads an image but I'm not completely sure where that's hosted now09:11
Tengushardy: I actually have my own ansible thingy for that. I'll just update it and ensure I get a clone.09:12
*** psachin has joined #tripleo09:13
*** StevenK has joined #tripleo09:17
ramishrashardy: Hey! Any idea why I'm getting this error, when running the config download playbooks on an existing containerized overcloud? http://paste.openstack.org/show/646385/09:18
ramishraIs the inventory incorrect?09:18
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: logging: use service_config_settings for fluentd  https://review.openstack.org/50145809:23
shardyramishra: Hi, what command did you use to generate inventory.yaml?09:24
shardyramishra: I'd suggest trying with the dynamic inventory e.g -i /usr/bin/tripleo-ansible-inventory09:24
shardyramishra: the old ini format inventory is deprecated and may not work, there's a new --static-yaml-inventory option though09:25
ramishrano it's yaml09:25
*** mcornea has joined #tripleo09:25
ramishrawith --static-inventory-yaml I think09:26
ramishrasorry the flag you mentioned, new to all thse:)09:27
shardyramishra: hrm Ok sec let me try to reproduce - was there anything special about the overcloud configuration?09:28
ramishraI did not use config-download-environment.yaml when deploying the overcloud09:29
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Upgrade prettier  https://review.openstack.org/53430509:29
ramishrathat should be fine right?09:29
ramishrashardy: the update_steps_playbook.yaml also fails with http://paste.openstack.org/show/646399/09:31
ramishraI assume that's something to with the user used (heat-admin)?09:32
*** udesale_ has joined #tripleo09:33
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DNM] Testing ocata->pike upgrade.  https://review.openstack.org/53279109:34
*** udesale has quit IRC09:34
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568609:36
ramishrashardy: I was following  https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ansible_config_download.html09:36
shardy ramishra for the second error try running with -b09:36
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment.  https://review.openstack.org/53436009:38
*** dsariel has joined #tripleo09:38
ramishrashardy: Ah! yep, ansible newbie;)09:38
shardyramishra: probably we should add a become: true like in https://review.openstack.org/#/c/533757/09:38
*** stendulker has joined #tripleo09:39
shardywe've got that in various places but there are inconsistencies09:39
*** derekh has joined #tripleo09:39
ramishrashardy: yeah09:39
shardyramishra: those docs need updating, they still reference --static-inventory09:40
*** rcernin has joined #tripleo09:40
shardyramishra: can you re-test with -i /usr/bin/tripleo-ansible-inventory please?09:40
shardyI'll push a docs patch now09:41
ramishrashardy: same error09:42
*** arxcruz|off is now known as arxcruz|rover09:42
skramajashardy: added a comment on https://review.openstack.org/#/c/532465/2/puppet/role.role.j2.yaml@214, could you check if it is worth merging RoleParametersDefault?09:43
shardyramishra: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/cinder-api.yaml#L20709:46
*** fpan has joined #tripleo09:46
shardythe error seems to be here, it's not running the task that registers cinder_api_enabled for step 209:46
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Use telemetry-tempest-plugin for Telemetry projects  https://review.openstack.org/53470609:46
shardyramishra: what tags are you including when running ansible-playbook?09:46
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment.  https://review.openstack.org/53436009:47
*** gfidente has joined #tripleo09:47
*** gfidente has quit IRC09:47
*** gfidente has joined #tripleo09:47
*** fpan_ has quit IRC09:47
shardymarios, chem: ^^ are there updated docs to cover the most recent ansible driven upgrade?09:47
shardyramishra: I think this error is specific to upgrade and not any problem with the inventory or config-download09:47
ramishrashardy:  ansible-playbook   -i inventory.yaml --private-key ~/.ssh/id_rsa config-download/tripleo-bZ2OCy-config/upgrade_steps_playbook.yaml09:48
mariosshardy: not yet afaik we have a task for it but noone picked it up yet09:48
openstackgerritMerged openstack/tripleo-ipsec master: Dont insist on IKEv2  https://review.openstack.org/53469409:48
shardymarios: ack, is ther perhaps anything in CI ramishra can refer to instead?09:49
ramishranot any tags, do I've to? Would not it just run when there is nothing to upgrade?09:49
mariosshardy: ah i see i missed the earlier chat... not yet but sec we have this https://review.openstack.org/52600609:49
ramishrashardy: my questions may be little dumb, so bear with me:)09:50
shardyramishra, marios: Oh I think I see the problem09:53
shardymarios: your patch switching from tags to when landed, but we still have tags in docker/services/*09:53
*** sshnaidm|off is now known as sshnaidm09:54
mariosshardy: yeah i only 'migrated' the steps... things like "common" tags for example are todo (common i guess we just remove the conditional alltogether it happens every time, for example)09:54
*** udesale_ has quit IRC09:55
*** udesale has joined #tripleo09:55
shardymarios: well by the sounds of it that doesn't work09:55
shardywas this tested before it landed?  I'm not sure on the current status of upgrade CI09:56
mariosshardy: well there is no P.. Q upgrade ci yet09:56
mariosshardy: so it shouldn't break anything09:56
mariosshardy: it was confined to upgrade_tasks09:56
shardy:(09:56
shardymarios: Ok well FWIW ramishra found this http://paste.openstack.org/show/646385/09:56
mariosshardy: looking09:57
shardyI think it's because we've now got a mix of tags and when09:57
shardyso we don't register the var anymore for the steps09:57
shardyI assume the same problem exists in various places so may be a easy sed fix09:57
mariosshardy: ok cool thanks ramishra i expect we will see this and more once we get that job running if you like file a launchpad for tracking it?09:58
ramishramarios: sure will do09:58
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Add extra options for undercloud deploy command  https://review.openstack.org/53470809:58
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validations for FFU.  https://review.openstack.org/53470909:59
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validations for FFU.  https://review.openstack.org/53470910:06
bogdandofolks, need some help please with https://pastebin.com/LszGtsdN :(10:07
bogdandoI want to deploy UC containerized all-in-one with a Manila CephFS Native driver backend10:08
jaosoriorbogdando: are there any other errors? Seems like the database setup might not have ran10:08
jaosoriorthe db_sync10:08
bogdandoso, I redeploy on a dirty env, usually worked for me just fine, never tried pcmk deploys tho, and  my quickstart inventory and tht env are:10:09
bogdandoI'm*10:09
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/ocata: Set restrictive file permissions on Ceph keyrings for non-containerized deployment  https://review.openstack.org/52801510:09
bogdandohttps://github.com/bogdando/oooq-warp/blob/master/tht/environments/all-in-one-pcmk.yaml and alter the hardocoded service templates like this https://github.com/bogdando/oooq-warp/blob/6777d94e984f94d4c0bfa78ac589aaa301f22261/vars/undercloud-only-pcmk-traas.yaml#L2310:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293610:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)10:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add flag to configure VIPs  https://review.openstack.org/53432310:10
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/newton: Set restrictive file permissions on Ceph keyrings for non-containerized deployment  https://review.openstack.org/52859910:11
bogdandojaosorior: will take a look into logs... thanks10:11
*** ramishra has quit IRC10:12
bogdandojaosorior: hm, I see no traces of db sync attempts10:13
*** skramaja has quit IRC10:13
*** ramishra has joined #tripleo10:13
bogdandono containers , nothing in undercloud_install logs10:14
bogdandoprolly pacemaker service included assumes MySQL will be managed by pcmk as well? and I want it only for Manila share?10:14
*** paramite has joined #tripleo10:15
bogdandoand there is a mess with steps for docker puppet ordering?..10:15
bogdandosigh10:15
shardybogdando: did pacemaker bring up the DB?10:15
bogdandoI do not manage it with pcmk...10:15
*** salmankhan has joined #tripleo10:15
bogdandoI have mariadb running as a local docker managed container tho10:15
bogdandofor my case, the failure happened even before pcs installed10:16
shardybogdando: what do you mean by local docker managed container?  Did TripleO start it?10:16
jaosoriorbogdando: well, pacemaker does assume that mysql is managedb y it, yes10:16
bogdandoI only have puppet-pacemaker installed10:17
bogdandoshardy: yes10:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validations for FFU.  https://review.openstack.org/53470910:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Correct erroneous upgrade tasks.  https://review.openstack.org/53471410:17
shardyI don't really get the use-case for this tbh, nobody ever tested all-in-one undercloud with pacemaker, just deploy a single node overcloud with all pacemaker stuff enabled?10:17
*** adrianreza has joined #tripleo10:17
bogdandoshardy: I mean that I deploy mariadb service out of pcmk control plane10:17
bogdandoattempted to* :)10:17
shardybogdando: Ok, FWIW I'd probably start with something that's tested in CI and go from there10:17
jaosoriorbogdando: I think that is the issue though. pacemaker assumes it'll handle mysql10:17
shardythis mix is not tested anywhere AFAIK10:17
bogdandoshardy: that's my case :) tricky and off road, as always10:18
shardybogdando: yeah :)  I'm just trying to understand why ;)10:18
bogdandoI need all in one UC with Manila, to deploy external ansible openshift as overcloud10:18
bogdandoand I basically need this for dev envs of shift-on-stack provider :)10:18
shardybogdando: so the deployed openshift will interact with Manila on the undercloud?10:18
bogdandoyupp10:19
*** salmankhan has quit IRC10:19
shardyOk other than for dev usage I'm not sure we'd ever support that, it's a single point of failure10:19
bogdandoI'll add octavia later, and anything else I do not want to struggle with if used devstack10:19
shardyI'd deploy a pcmk enabled overcloud w/ironic then deploy openshift on that10:19
shardyinteresting to try though I guess10:19
bogdandoindeed, so do I :)10:20
bogdandowe have a CI job that deploy overcloud as openshift10:20
shardyYes but you'd never want runtime dependencies on undercloud services10:20
bogdandoflaper87:  wrote it, see https://review.openstack.org/#/c/494418/ shardy10:21
shardybogdando: yes, that's just using TripleO as a provisioning tool10:21
bogdandoand I'm struggling to adapt it for OCP 3.7, and using shift-on-stack provider10:21
shardybogdando: I think you'd want to deploy openshift alongside openstack, then make the two things depend on each other, with openstack deploying manila etc all HA10:21
bogdandoshardy: well, sure. I just want to explore a simple alternative for devstack as a host cloud10:21
bogdandoand undercloud fits well, no need for overcloud basically10:22
shardybogdando: understood, just saying it's possibly not something to burn a ton of time on :)10:22
bogdandoyeah10:22
bogdandoright10:22
bogdandoI won't , just a little of time :D10:22
*** dbecker has joined #tripleo10:23
shardyIf I was testing this I'd probably deploy two custom roles, one all-in-one openshift and one all-in-one openstack10:23
shardythen you deploty the whole setup on three VMs including the undercloud10:23
*** tosky has joined #tripleo10:23
bogdandoshardy: bingo, I've already tested all-in-one openshift! :)10:24
shardybogdando: ack, so you add one more VM and you're done ;)10:24
bogdandothat makes sense, I'll try to deploy overcloud then use it just as a host cloud10:25
bogdandoTho I wanted to expolore CI option to plug shift-on-stack provider into external deployments10:26
*** hasanq has quit IRC10:28
shardybogdando: you could test the same setup in CI, we do similar in the multinode 3-nodes job10:30
*** mandre_afk is now known as mandre10:33
*** timeu has joined #tripleo10:34
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Disable services in undercloud.yaml and add docker-uc.yaml  https://review.openstack.org/52608810:36
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry  https://review.openstack.org/52464410:36
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Merge undercloud service env files into undercloud env files  https://review.openstack.org/52672310:36
mfedosinmandre: hey :) may I ask you for a favor?10:38
mfedosinI proposed a patch to puppet-mistral https://review.openstack.org/#/c/534715/10:38
mfedosinit allows to disable cron trigger support10:38
mfedosinthis is my first puppet and probably we can improve something there10:39
*** sri_ has joined #tripleo10:39
mfedosinreview it please :)10:39
timeuHi everyone. I have a question regarding running "openstack overcloud deploy" from an ansible playbook. What is the best practice to wait/poll until the heat stack is finished?  I am asking because the "openstack overcloud deploy" command exits immediately with a non zero exit code but I need to wait and check the result in order to run the next ansible tasks ?10:40
timeuI checked the tripleo-quickstart playbooks (https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/tasks/main.yml) and there it seems that there is no special polling involved as if the "openstack overcloud deploy" command is synchronous/blocking10:41
mandremfedosin: yo! I'll do my best reviewing your patch - I'm no puppet expert :)10:43
shardytimeu: Unless there's an error it should block printing event messages until the deploy is completed10:43
shardysounds like there was an error in this case?10:43
mfedosinmandre: thank you very much!10:43
timeu@shardy: hmm ok interesting. then I must have missed something. Will look into this again. Thanks !10:43
*** shreshtha has quit IRC10:44
*** shreshtha has joined #tripleo10:45
*** etingof has quit IRC10:45
jistrbogdando: i rebased the undercloud resource registry refactoring chain, still keep WIP on root patch until dprince & Slower ack10:47
jistrs/keep/kept/10:47
*** salmankhan has joined #tripleo10:51
*** dtantsur|afk is now known as dtantsur10:57
*** dpawar_ has joined #tripleo10:59
*** dpawar_ has quit IRC11:01
*** dpawar_ has joined #tripleo11:02
*** dpawar has quit IRC11:03
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart master: [WIP] Don't install Ironic in default overclouds  https://review.openstack.org/50982911:04
openstackgerritDerek Higgins proposed openstack/tripleo-quickstart-extras master: WIP: Setup Ironic in Overcloud  https://review.openstack.org/50972811:04
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: WIP: Add ironic config to scenario 004  https://review.openstack.org/48526111:05
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293611:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)11:10
*** rfolco has joined #tripleo11:11
tbarronbogdando: just read the backlog and would like to get a better understanding of your manila / openshift use case - I pm-ed you.11:11
*** janki has quit IRC11:13
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks  https://review.openstack.org/52824111:14
*** fzdarsky has quit IRC11:15
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Split IPSEC deployment in two  https://review.openstack.org/53472911:18
*** dpawar_ has quit IRC11:28
openstackgerritMerged openstack/tripleo-ipsec master: Add flag to configure VIPs  https://review.openstack.org/53432311:32
*** hasanq has joined #tripleo11:32
*** udesale has quit IRC11:36
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: WIP: wire up queens upgrade workflow  https://review.openstack.org/52600611:36
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: Activate ipsec for ovb-ha  https://review.openstack.org/53473111:39
*** etingof has joined #tripleo11:40
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: [DNM] Major upgrade P->Q test.  https://review.openstack.org/53473211:41
sonali85Hi All.11:41
sonali85i wanted to know the manual process to confugure zookeper in cluster ?11:41
sonali85having 3 controller and all the controller zookeeper is installed11:41
sonali85how what will be the proceedure to to from zookeeper cluster11:42
sonali85?11:42
*** absubram has joined #tripleo11:46
*** mdnadeem has quit IRC11:46
*** hewbrocca_afk is now known as hewbrocca11:47
*** ratailor has quit IRC11:47
*** holser__ has quit IRC11:49
*** rhallisey has joined #tripleo11:53
*** dpawar has joined #tripleo12:01
chemmatbu marios: social jfrancoa holser ccamacho first time with a successful o->p upgrade!!! -> https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-containers-multinode-upgrades-pike/832/console12:05
jfrancoachem: finally! I think I'm going to cry...which patches did you use to run the job?12:07
*** jkilpatr has quit IRC12:07
chemjfrancoa: no patch -> https://review.openstack.org/#/c/532791/ :)12:07
ccamacho\o/12:08
ccamachochem++12:08
*** pkovar has joined #tripleo12:09
*** jkilpatr has joined #tripleo12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293612:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375312:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375412:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)12:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)12:10
*** sshnaidm is now known as sshnaidm|afk12:11
mariosfantastic chem12:11
*** salmankhan has quit IRC12:12
chemmarios: if I didn't have ffu to move forward I would gladly turn my attention to master upgrade12:12
*** shardy is now known as shardy_lunch12:12
*** pgadiya has quit IRC12:12
chemmarios: I need to review all your patches about that sooner than later anyway.12:13
*** salmankhan has joined #tripleo12:14
*** rcernin has quit IRC12:14
matbuchem: \o/ woot12:15
*** pgadiya has joined #tripleo12:15
*** sshnaidm|afk has quit IRC12:16
marioschem: ack really i need the featureset landed first so we can land the job definition12:17
marioschem: right now we can't even run it12:17
marioschem: to see how broken it is :)12:17
*** akrivoka has joined #tripleo12:17
openstackgerritRabi Mishra proposed openstack/tripleo-heat-templates master: Include common_deploy_steps_tasks.yaml  https://review.openstack.org/53474012:18
marioschem: no worries i mean the workflow patches (client) still in review and base tht just landed so... now is the earliest we can have the job12:18
marioswell once the client patches land too12:18
chemmarios: now that I don't have to run the ocata->pike jobs I will make a test env on traas12:18
*** pgadiya has quit IRC12:21
marioschem: ++ thanks, i've been running it on rdo cloud ... having issues redeploying my second env there with exactly same params tho (keep getting not enough hosts available :/)12:24
jaosoriormarios: I had the same issue. They seem to be running over capacity :/12:26
mariosjaosorior: thanks good to know12:29
*** pgadiya has joined #tripleo12:33
*** dprince has joined #tripleo12:40
openstackgerritMoshe Levi proposed openstack/tripleo-heat-templates master: Adding support for odl hw offloading in containers  https://review.openstack.org/53462212:43
*** rbrady has quit IRC12:45
*** abishop has joined #tripleo12:45
*** rbrady has joined #tripleo12:45
*** rbrady has joined #tripleo12:45
*** jlabarre has joined #tripleo12:45
*** jpena is now known as jpena|lunch12:45
openstackgerritMerged openstack/tripleo-heat-templates master: Configure ODL Logging mechanism  https://review.openstack.org/52949612:48
*** shreshtha has quit IRC12:48
*** shreshtha has joined #tripleo12:48
*** rbowen has joined #tripleo12:48
openstackgerritMerged openstack/puppet-tripleo master: Fluentd: Transform path by service  https://review.openstack.org/53078012:51
*** verdurin_ is now known as verdurin12:51
EmilienMhi12:54
*** janki has joined #tripleo12:54
*** sshnaidm|afk has joined #tripleo12:55
*** sshnaidm|afk is now known as sshnaidm12:55
oidgarEmilienM: hi, I have many timeout failures for some zuul gates in tripleo-heat-templates and tripleo-common. is there something we can do to improve this?12:56
oidgarEmilienM: maybe reduce the number of gates running concurrently? (unless I'm the only one...)12:56
*** ykarel has quit IRC12:57
oidgarEmilienM: ok it looks like I'm not the only one, I see it in other patches. if there's something I can help with I'll be glad to take part12:58
chemmarios: so one thing I don't understand is why https://review.openstack.org/#/c/527454/ is name featureset_containerized_upgrade.yml instead of the usual featureset0XX ?12:59
*** ykarel has joined #tripleo13:00
jaosoriordo we always deploy the redis VIP ?13:01
sonali85Hi all,  i wanted to know the manual process to confugure zookeper in cluster ?13:02
sonali85having 3 controller and all the controller zookeeper is installed ?13:02
sonali85 how what will be the proceedure to to from zookeeper cluster ?13:02
jaosoriorsonali85: you might want to check the zookeeper documentation. We currently don't deploy zookeeper in TripleO.13:03
sonali85yes you have told me this before . cant we try using manual steps ?13:04
*** pmannidi has joined #tripleo13:04
EmilienMoidgar: logs?13:04
jaosoriorsonali85: sure, you could try13:04
sonali85<jaosorior> actaully i have installed zookkeper on all the controller but after restarting zookeper service facing some issues13:06
oidgarEmilienM: http://logs.openstack.org/95/508195/28/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/5206125/job-output.txt.gz#_2018-01-17_11_52_14_66679613:06
sonali852018-01-17 13:06:00,753 [myid:1] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1037] - Closed socket connection for client /192.168.24.11:34600 (no session established for client)13:06
sonali852018-01-17 13:06:02,269 [myid:1] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /192.168.24.11:3579813:06
sonali852018-01-17 13:06:02,269 [myid:1] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@365] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not runn13:06
oidgarEmilienM: this is the job that fails most of the times13:06
sonali85 <jaosorior> i have followed following link to config zookeeper cluster https://www.thegeekstuff.com/2016/10/zookeeper-cluster-install/13:07
jaosoriorsonali85: I don't use zookeeper; unfortunately I can't help you with that13:07
oidgarEmilienM: I've noticed that when exit code is 143, it fails on timeout (http://logs.openstack.org/95/508195/28/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/5206125/job-output.txt.gz#_2018-01-17_11_43_06_736329) correct me if I'm wrong13:07
sonali85oh ok no problem :)13:07
*** adarazs is now known as adarazs_lunch13:08
*** amoralej is now known as amoralej|lunch13:08
sonali85is there any one who can help ?13:08
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293613:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375313:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375413:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)13:10
openstackLaunchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)13:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)13:10
EmilienMoidgar: I'm in meeting the next 3h, I won't be helpful tbh13:11
oidgarEmilienM: ok, I'll try in openstack-infra.13:11
arxcruz|roverpradk: hi, around? the telemetry job started to fail again http://logs.openstack.org/07/472607/187/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/76f3db3/logs/tempest.html.gz13:12
EmilienMoidgar: they won't help13:12
arxcruz|roverpradk: and it has the alarm_granularity set to 6013:12
EmilienMI mean, it's probably some tripleo thing13:12
*** absubram has quit IRC13:12
*** trown|outtypewww is now known as trown13:12
oidgarEmilienM: any other guy I can talk with to fix it? I don't want to disturb you13:13
*** pchavva has joined #tripleo13:13
EmilienMthe timeout on https://review.openstack.org/#/c/472607/ is unlucky13:13
EmilienMhttp://tripleo.org/cistatus.html13:13
*** tcw has joined #tripleo13:13
EmilienMa lot of green13:13
EmilienMthere is no gate issue atm, so we're good13:13
oidgarEmilienM: ok thanks13:14
EmilienMsshnaidm: can you help me to figure why https://review.openstack.org/#/c/528761/ has tripleo-ci-centos-7-3nodes-multinode which timeouts in log collection?13:14
marioschem: sure we can change that np i just wanted to distinguish its purpose but yeah lets keep convention add comment please?13:16
*** shardy_lunch is now known as shardy13:16
pradkarxcruz|rover, hmm ok, I'll take a look after this call13:16
*** agopi has joined #tripleo13:17
trownsshnaidm: I think https://review.openstack.org/533795 is good to go, modulo my comments on PS613:18
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo stable/pike: Enable automatic restart of memcached, apache and mongodb  https://review.openstack.org/53439413:19
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo stable/ocata: Enable automatic restart of memcached, apache and mongodb  https://review.openstack.org/53475513:21
oidgarjaosorior: hi, I wonder if you can assist or give me some advice about frequently timeouts in zuul gate (https://review.openstack.org/#/c/508195/ tripleo-ci-centos-7-ovb-ha-oooq)13:21
sshnaidmEmilienM, seems like we calculated a timeout very close to one of zuul: http://logs.openstack.org/61/528761/24/check/tripleo-ci-centos-7-3nodes-multinode/f11e7bd/job-output.txt.gz#_2018-01-17_01_15_39_77883613:22
EmilienMsshnaidm: the error is persistent, I did recheck a bunch of times to see if it was random13:22
openstackgerritBogdan Dobrelya proposed openstack/tripleo-common master: Add more UndercloudCinder services to auto eval  https://review.openstack.org/53475613:23
sshnaidmEmilienM, the other option - ansible is not stopped by timeout command13:23
sshnaidmEmilienM, ok, I'll look into it, will try to understand what's wrong with timeout calculation13:23
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Containerize featureset032 (multinode-3nodes)  https://review.openstack.org/53262413:25
EmilienMsshnaidm: thanks13:25
pradkarxcruz|rover, meanwhile did you see if this is due to the same voluptuous issue we had yesterday? any errors you could spot so far?13:25
arxcruz|roverpradk: it's taking 10 minutes the test, and it should take only 2, the settings are correct, I'm trying to bring an environment up to collect more data13:26
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download  https://review.openstack.org/52876113:26
EmilienMchem++ nice work on upgrade job13:30
*** rlandy has joined #tripleo13:30
chemEmilienM: well, not just me, all the team really, jfrancoa in particular13:30
*** sonali85 has quit IRC13:30
chemEmilienM: didn't though it would take that much time though :)13:31
sshnaidmtrown, thanks, replied to comments there13:32
EmilienMchem: nice13:34
jaosoriorEmilienM: are we testing swift at all in CI?13:35
*** moshele has quit IRC13:36
EmilienMjaosorior: yes13:36
EmilienMjaosorior: tempest on scenario00213:37
jaosoriorawesome13:37
openstackgerritMerged openstack-infra/tripleo-ci master: Support deploying extra nodes in te-broker  https://review.openstack.org/51289913:37
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Upgrade prettier  https://review.openstack.org/53430513:37
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Update dependencies  https://review.openstack.org/53475913:37
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix tests and compilation after dependencies update  https://review.openstack.org/53476013:37
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix non urgent bugs caused by dependencies update  https://review.openstack.org/53476113:37
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Introduce tests for yaql structures  https://review.openstack.org/53476213:37
therveshardy, Interested in your feedback on  ^^ if you have some time13:40
*** holser__ has joined #tripleo13:41
thervejaosorior, Why looking at experimental? :)13:41
weshaychem, did you see my comment on https://review.openstack.org/#/c/525686/13:41
jaosoriortherve: cause that's used by the TLS everywhere job :D13:41
trownsshnaidm: I think my last comment there is correct... wrt sum of all tasks or max task, I think either works, so what you have is fine13:41
therveWell13:41
thervejaosorior, The idea is to be able to make changes there with more confidence, but sure :)13:42
chemweshay: nope, looking13:42
chemweshay: didn't like that file, but ok, I'll put it back13:43
EmilienMjaosorior: have you seen my questions from yesterday about the 2 blueprints status?13:44
EmilienMsocial: could you please read https://review.openstack.org/#/c/532516/ comments?13:45
EmilienMjaosorior: asking status on https://blueprints.launchpad.net/tripleo/+spec/logging-stdout-rsyslog and https://blueprints.launchpad.net/tripleo/+spec/ipsec13:46
shardytherve: I like it, but does it assume yaql is always in an OS::Heat::Value resource?13:46
jaosoriorEmilienM: I didn't13:46
*** pmannidi has quit IRC13:46
*** liverpooler has joined #tripleo13:46
shardytherve: I assumed that was a workaround because heat didn't (doesn't?) validate outputs properly, and didn't store outputs until we switched to convergence13:46
therveshardy, No it shouldn't be able to test anything13:47
*** dpawar has quit IRC13:47
jaosoriorEmilienM: I won't be able to finish up what's left of logging-stdout-rsyslog for this milestone unfortunately13:47
*** anilvenkata has quit IRC13:47
shardytherve: Ok, I think most of the yaql stuff is referenced via value resources for performance reasons anyway but wanted to check13:47
EmilienMjaosorior: can you please close it and create another blueprint for Rocky, and describe what's left to do?13:48
jaosoriorEmilienM: ipsec I will be able to finish. Missing to fix a bug (Redis not having a tunnel); and then I proposed this https://review.openstack.org/#/c/534731/ to test it upstream.13:48
*** jpena|lunch is now known as jpena13:48
EmilienMjaosorior: ack for ipsec13:48
therveshardy, It might be a bit weird when we get to j2 stuff, but it should work if there is nothing inside the yaql itself13:48
jaosoriorEmilienM: will do13:48
shardytherve: ack, I think it's straight yaql in most places so +113:48
shardytherve: making it generic and test any intrinsic function (or combination thereof) would be cool ;)13:49
therveshardy, Good point. It might not be very hard, do you have issues with other functions?13:49
EmilienMjaosorior: send me the link when done, i'll make triage for Rocky13:50
shardytherve: I was thinking of this one in particular https://github.com/openstack/tripleo-heat-templates/blob/master/network/ports/net_ip_list_map.j2.yaml#L80..L9713:51
shardyprobably fairly well tested via functional CI tho13:51
therveAh yeah the map itself13:51
EmilienMshardy: hey, I keep debugging the tripleo inventory issue I have when enabling config-download on 3nodes - I added some debug on the vars, but so far no problem on the vars yet, it looks like it happens when getting the host with _hosts function13:51
EmilienMshardy: I'll keep you in touch, the logs timeouts now, sshnaidm is helping13:51
shardyEmilienM: ah, is this using --static-yaml-inventory or the dynamic tripleo-ansible-inventory?13:52
shardyEmilienM: I recall a warning re _hosts because (for some unknown reason) ansible expects two different yaml formats for static/yaml inventories13:53
* shardy grumbles about that stupid inconsistency13:53
EmilienMshardy: dynamic I believe13:53
EmilienMshardy: let me show the debug in a sec13:53
shardyEmilienM: Ok, that should work, but happy to look at logs when you have them and/or try to reproduce13:54
*** jmelvin has joined #tripleo13:54
*** shreshtha has quit IRC13:55
*** aputtur_ has joined #tripleo13:55
*** Goneri has joined #tripleo13:56
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568613:56
*** pgadiya has quit IRC13:58
openstackgerritMerged openstack/puppet-pacemaker master: Remove pinned versions from test-requirements.txt  https://review.openstack.org/53410113:59
*** tzumainn has joined #tripleo14:00
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: ffu: Add fast-forward-upgrade env  https://review.openstack.org/52220314:03
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293614:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375314:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375414:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)14:10
openstackLaunchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)14:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)14:10
trozetCan I get another core reviewer on https://review.openstack.org/#/c/530967/ please?14:10
EmilienMtrozet: probably ask on #puppet-openstack14:11
shardyCould I get another reviewer on https://review.openstack.org/#/c/533185/ please as I'm going to have to rebase that series again14:12
shardymandre or dprince ^^ container related, perhaps you could check it out?14:12
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing.  https://review.openstack.org/52600014:13
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing.  https://review.openstack.org/52600014:13
mandreshardy: ouch nice bug14:14
*** almondjoy has joined #tripleo14:15
shardymandre: yea, I didn't find it until I tried passing a roles-data to undercloud deploy disabling nearly all the services14:16
shardyand they all kept running ;)14:16
shardyhttps://review.openstack.org/#/c/534402/ is the related tripleoclient patch btw14:16
*** liverpooler has quit IRC14:17
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: WIP: FFU Developer docs  https://review.openstack.org/52665614:19
*** liverpooler has joined #tripleo14:19
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Append docker-ha.yaml conditionally.  https://review.openstack.org/53477014:23
*** dciabrin_ has joined #tripleo14:26
mandreshardy: the ansible in heat templates is really hard to read14:26
*** fzdarsky has joined #tripleo14:26
*** dciabrin has quit IRC14:26
*** amoralej|lunch is now known as amoralej14:28
shardymandre: yeah I know, see the next patch in the series, it moves it to deploy-steps-playbook which removes all the ugly j2 quoting14:29
shardyhttps://review.openstack.org/#/c/525260/12/common/deploy-steps-tasks.yaml14:29
shardye.g line 41, much better I think?14:30
shardymandre: that was blocked on converting undercloud deploy to the dynamic inventory but that's now done so should land soon, I hope14:30
mandreshardy: absolutely, you read my mind... much better14:32
shardy:)14:32
dprinceshardy: does that patch change our validations any? tools/yaml-validate.py?14:35
dprinceshardy: I guess not. its just how it is executed14:35
shardydprince: I don't think that validates the ansible playbook other than to prove it's parseable14:37
shardyso no change I think14:37
jaosoriorshardy: the --config-download flag no longer uses the /usr/bin/tripleo-ansible-inventory right?14:38
shardydprince, mandre: after https://review.openstack.org/#/c/525260/ the only remaining thing in the heat template is writing docker-puppet.py, would you be OK if we moved that to tripleo-common?14:38
jaosoriorshardy: but it should get a very similar inventory from tripleo-common I guess14:38
shardyit's a bit less hackable, but for development deploy artifacts could still be used14:39
shardyjaosorior: I think it does, the script now calls TripleoInventory in tripleo-common though14:39
shardyjaosorior: and the ini format --static-inventory is deprecated, replaced with the --static-yaml-inventory14:40
mandreshardy: right, and I think docker-puppet doesn't need to change too much these days anyway14:40
shardyini format is a pain for list/map data14:40
shardymandre: yeah, it'd be a nice final cleanup to that heat template14:40
dprinceshardy: one other question. Does this cost us extra wall time? and if so how much14:40
jaosoriorshardy: what about the groups we used to have? where we could access nodes in the inventory via service groups. So, I could get the nodes that have pacemaker deployed with groups.pacemaker14:41
shardydprince: https://review.openstack.org/#/c/533185/ will take some extra time on update, as we'll actually stop the removed containers14:41
jaosoriorshardy: that doesn't seem to be available anymore14:41
dprinceshardy: what does moving docker-puppet.py into tripleo-common buy us?14:41
shardydprince: otherwise no change, e.g deploy for the same roles_data shouldn't take any longer14:41
dprinceshardy: ack on the wall time. seems good to me I think14:42
shardydprince: it means we can move to the --config-download workflow by default, as currently it's only written via heat (or the group_vars shim that uses heat-config)14:42
shardydprince: it's a cleanup, as pretty soon we'll want to remove all the heat driving ansible stuff from t-h-t14:42
shardynot urgent if we need it tho14:42
*** jcoufal has joined #tripleo14:42
*** dpawar has joined #tripleo14:43
*** dhill_ has joined #tripleo14:43
shardydprince: also it could be easier for debugging end-users, e.g we have a version vs an arbitrary possibly hacked up version of the script14:43
shardyhttps://review.openstack.org/#/c/525260/12/common/deploy-steps.j214:44
shardydprince: if you see that, writing docker_puppet.py is all we do via heat (host_prep_tasks are already included directly in the config download generated playbooks)14:44
EmilienMcould I have some review on https://review.openstack.org/532624 and https://review.openstack.org/53262314:44
dprinceshardy: it really is a matter of maintaining the interface. I supposed I still consider it a new thing at this point14:45
dprinceshardy: changing the interface is much easier if it lives in heat14:45
shardyjaosorior: those groups should still be available, what command are you looking at?14:45
dprinceshardy: t-h-t rather14:45
*** adarazs_lunch is now known as adarazs14:45
*** sshnaidm is now known as sshnaidm|mtg14:46
jaosoriorshardy: so I tried the IPSEC deployment in CI (which I'm testing at the moment with /usr/bin/tripleo-ansible-inventory)  and I get an issue regarding the group http://logs.openstack.org/31/534731/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/3f3f6c3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-01-17_13_57_4014:46
shardydprince: Ok, it's not a huge issue but it's one of the barriers to getting to a pure ansible solution14:46
shardyjaosorior: Ok does the inventory --list look wrong locally?14:47
jaosoriorshardy: locally I have no issues14:47
*** moshele has joined #tripleo14:48
jaosoriorshardy: I'm deploying (and it's working), and --static-inventory gives the right values.14:48
dprinceshardy: sure, we'll also need to move the script that executes os-net-config14:48
shardyjaosorior: yeah but that will break since we now add roles_data* to the inventory, you have to use --static-yaml-inventory14:48
shardyor the dynamic one14:48
shardyjaosorior: so if there's an issue here we'll have to figure it out14:48
jaosoriorlet me try using the yaml one14:48
jaosoriorlets see14:48
shardydprince: yeah that's another one on the list14:48
*** fragatina has joined #tripleo14:49
jaosoriorshardy: funky, the ipsec group is there14:49
shardyYeah I have a group per service locally too14:50
*** fragatina has quit IRC14:52
*** fragatina has joined #tripleo14:52
jaosoriorshardy: is the --config-download flag doing something different?   I'm pretty sure "'dict object' has no attribute 'ipsec'"  is because of the missing group :/14:55
jaosoriorit's this task, https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/ipsec.yaml#L85   and this is the only occurence when It ry to fetch a key called 'ipsec' https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/ipsec.yaml#L9314:56
shardyjaosorior: there is some inconsistency in tripleo-common, some things used the --static-inventory flag, so I changed them to --static-yaml-inventory14:56
shardyother things use the dynamic inventory, I've not traced the --config-download workflow through tho14:57
shardyI normally download then run manually with the dynamic inventory14:57
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/openshift-master.yaml#L6914:58
jaosoriorshardy: yeah, that's what I do as well14:58
shardyjaosorior: yeah it looks the same14:59
jaosoriorfunky :/14:59
jaosoriorgotta go for an hour15:00
jaosoriorbrb15:00
*** jaosorior has quit IRC15:00
*** ansiwen has quit IRC15:03
*** hasanq has quit IRC15:04
*** ecerquei has joined #tripleo15:04
*** ykarel is now known as ykarel|away15:04
*** janki has left #tripleo15:06
*** janki has joined #tripleo15:06
*** ansiwen has joined #tripleo15:06
*** ecerquei has quit IRC15:07
*** itlinux has quit IRC15:07
*** ecerquei has joined #tripleo15:08
*** dpeacock has quit IRC15:09
*** pi1 has joined #tripleo15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293615:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375315:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375415:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)15:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)15:10
*** gfidente has quit IRC15:10
*** links has quit IRC15:11
*** pi1 has quit IRC15:11
*** dpeacock has joined #tripleo15:12
weshaysshnaidm++15:12
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Update dependencies  https://review.openstack.org/53475915:12
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix tests and compilation after dependencies update  https://review.openstack.org/53476015:12
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix non urgent bugs caused by dependencies update  https://review.openstack.org/53476115:12
*** dciabrin has joined #tripleo15:15
*** gfidente has joined #tripleo15:16
*** gfidente has quit IRC15:16
*** gfidente has joined #tripleo15:16
*** dciabrin_ has quit IRC15:16
*** ykarel|away has quit IRC15:17
*** absubram has joined #tripleo15:19
dpeacock"/bar toggle nicklist15:20
panda|ruckanyone from mistral ? what does the deploy_step_playbook.yml exactly do ? how can it be used for debugging ? talking about the all the output after http://logs.openstack.org/97/534297/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/b1b9f26/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-01-17_11_07_2415:20
weshaytoure, apetrich can I get some eyes on https://bugs.launchpad.net/tripleo/+bug/1742465 please15:22
openstackLaunchpad bug 1742465 in tripleo "periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-ocata is failing with Resource could not be found on mistral" [High,Triaged]15:22
apetrichweshay, looking15:23
*** suuuper has quit IRC15:25
*** aditya_r has joined #tripleo15:25
*** kirankt has quit IRC15:28
*** waleedm has quit IRC15:33
*** ramishra has quit IRC15:33
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment.  https://review.openstack.org/53436015:37
toureweshay sure15:46
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: DNM: iscsid.socket workaround for traas  https://review.openstack.org/53481415:46
dpeacockEmilienM: Is this merged successfully?  I see workflow is -1, but there's a comment from zuul stating it's merged.  I'm confused.15:46
dpeacockhttps://review.openstack.org/#/c/532981/ < EmilienM15:46
weshaytoure, sync w/ apetrich as well.. he is looking too15:46
weshaythanks!15:46
apetrichtoure, looks like heat got stuck.15:47
dpeacockEmilienM: sorry, I meant code review -115:47
toureapetrich yeah that is the first thing that jumped out15:47
apetrichtoure, the error is the usual stack.get that fails but after that there's a stack.create that never gets finished and the logs finish15:47
*** dhill_ has quit IRC15:48
*** oidgar has quit IRC15:49
*** jaosorior has joined #tripleo15:50
*** chem has quit IRC15:51
*** chem has joined #tripleo15:51
*** dhill_ has joined #tripleo15:52
jaosoriorshardy: do we log the ansible inventory somewhere in CI?15:52
toureweshay is this host still up??15:53
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Enable IPSEC tunnels for Redis VIP  https://review.openstack.org/53481615:53
thrashweshay: that's not an issue.15:53
weshaytoure, no15:53
thrashThose are "expected" errors.15:53
*** dsariel has quit IRC15:53
thrashweshay: If there was a problem, you'd see a failed workflow in the engine log.15:53
*** moshele has quit IRC15:54
EmilienMdpeacock: Change has been successfully merged by Zuul15:54
EmilienMdpeacock: read last comment15:54
EmilienMdpeacock: the -1 is from marios15:54
thrashweshay: those errors are "probes", to check to see if things exist.15:54
EmilienMbut the code merged15:54
shardyjaosorior: weshay had a patch which adds it, sec15:54
toureweshay the reason I ask is I have seen this problem when a host doesn't have enough resources15:55
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Set permissions for openstack keyring on CephPools  https://review.openstack.org/53278515:55
dpeacockEmilienM: I was confused - I guess my actual confusion is that I thought things needed two +2s15:55
*** timeu has quit IRC15:56
apetrichtoure, thrash weshay the problem is that the mistral logs stop abruptly just after the stack.create reaches heat15:57
apetrichno idea why15:57
*** itlinux has joined #tripleo15:58
thrashweshay: I will try with the reproducer script.16:00
gfidenteslagle https://review.openstack.org/#/c/533599/ ? :D16:01
rbradyapetrich: were logs from any other services noticably blank around the same time?16:01
openstackgerritAvishay Machluf proposed openstack/tripleo-upgrade master: Update readme to include InfraRed installation command  https://review.openstack.org/53482016:03
apetrichrbrady, nope they continue. last mistral log entry is at 2018-01-10 04:59:44.312 heat keeps going until 2018-01-10 07:40:21.77616:03
slaglegfidente: https://review.openstack.org/#/c/533319/ :)16:03
*** itlinux_ has joined #tripleo16:04
gfidenteslagle I thought that merged already16:04
gfidentesprry16:04
thrashapetrich: weshay toure rbrady https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-ocata-upload/cf06cc1/undercloud/var/log/extra/errors.txt.gz#_2018-01-10_05_00_41_32316:05
shardydprince, mandre: are you Ok to approve https://review.openstack.org/#/c/533185/ or is further discussion required?16:05
thrashdoesn't that seem to be a bigger problem?16:05
gfidenteslagle ah indeed this is a different one, about hostnames16:05
shardyI'm trying to avoid rebasing it again since CI is green16:05
apetrichthrash, brilliant16:05
toure thrash yeah i saw that16:05
thrashLike I said before, the mistral errors are expected.16:06
tourethrash I would agree16:06
apetrichthrash, thanks. I've added that to the comments16:06
*** itlinux has quit IRC16:06
weshaythrash, my attempts with rdo-cloud in my personal tenant the last two days have been terrible.. unable to provision a stack :(16:06
thrashweshay: ouch16:07
weshaythrash, I may be able get you one in the ci-tentant16:07
thrashweshay: I'm trying it now.16:07
*** atoth has joined #tripleo16:08
thrashweshay: It created my stack...16:08
weshayhuh16:08
weshaylucky16:08
thrashquestion is whether the provisioned hosts become available.16:08
thrash*reachable16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293616:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375316:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)16:10
openstackLaunchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)16:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)16:10
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Fix the nova config file location  https://review.openstack.org/53482616:11
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo stable/pike: Enable automatic restart of memcached, apache and mongodb  https://review.openstack.org/53439416:11
*** janki has quit IRC16:12
EmilienMpanda|ruck, weshay : please see my comment on https://bugs.launchpad.net/tripleo/+bug/1743753/comments/116:13
openstackLaunchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)16:13
*** paramite has quit IRC16:13
thrashweshay: spoke too soon. It's just sitting at waiting for provisioned host. :/16:15
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Fix the haproxy config file location  https://review.openstack.org/53482816:15
weshayEmilienM, in16:16
EmilienMpanda|ruck, sshnaidm|mtg: see my comment on https://bugs.launchpad.net/tripleo/+bug/1743754/comments/116:16
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)16:16
sshnaidm|mtgEmilienM, replied16:19
*** sshnaidm|mtg is now known as sshnaidm16:19
chemslagle: hey, sorry to interrupt, but we had some pretty good success on using traas for testing ci upgrade.  We have a forked quite a bit to get all the needed functionality.  We're planning on doing a proper pull request tomorrow.  Would it be oki to make a big "clean" one or would you prefer multiple small one ?16:20
chemslagle: by the way, thanks for the tool :)16:20
*** absubram has quit IRC16:21
EmilienMpanda|ruck: thx16:21
slaglechem: it depends on how big16:21
EmilienMpanda|ruck: https://bugs.launchpad.net/tripleo/+bug/1743753 updated (duplicate)16:21
openstackLaunchpad bug 1742936 in tripleo "duplicate for #1743753 TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)16:21
slaglechem: the one PR right now, is like 50 commits, that's way too big16:21
slaglechem: i tried to review it, but couldn't digest it all16:21
sshnaidmtrown, now when i think about it, sum looks better than max, I think I can fix it in following up patch16:21
slaglechem: there were some reverts in there too16:22
slaglechem: so i'd say, clean that up, and try to group related things as much as possible16:22
slaglechem: but it doesn't have to be 1 PR per commit or anything.16:22
chemslagle: ack, make sense.  I'll refactor the commit tomorrow and send you digest pull request :)16:23
trownsshnaidm: cool do you understand the other thing I was trying to explain?16:23
trownsshnaidm: ie how we will never have any list elements left in DATA in the second loop?16:23
*** shardy has quit IRC16:23
*** shardy has joined #tripleo16:25
sshnaidmtrown, yeah, got it now16:28
sshnaidmtrown, didn't mention .get there, also need to be fixed16:28
dprinceshardy: yes, approve it. I assumed you would send it once CI passed16:28
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: Add fast_forward_upgrade_tasks for ceilometer services  https://review.openstack.org/53372916:29
shardydprince: ack thanks, just wanted to confirm16:30
*** moshele has joined #tripleo16:32
Slowerjistr: which patch is that?16:34
*** marios has quit IRC16:40
*** dparkes has quit IRC16:42
jistrSlower: these 3 patches https://review.openstack.org/526088  and these 2  https://review.openstack.org/52633716:42
jistrall 5 should go somewhat together ideally16:42
jistrcc dprince ^16:43
jistrthe question is whether we should unblock those now or wait a bit more still16:43
*** ukalifon has quit IRC16:44
*** pcaruana has quit IRC16:46
Slowerjistr: ok cool, will look them over16:47
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/pike: Add condition to create container images download script.  https://review.openstack.org/53483816:47
*** aufi has quit IRC16:48
trozethey guys I just noticed in the docker service files there are a bunch of systemctl commands for the container upgrades.  Are those just placeholders?  I thought the containers we use dont support systemd16:51
shardytrozet: I think they just stop and disable the service on baremetal?16:52
*** absubram has joined #tripleo16:52
trozetshardy: but then why are they in the docker service files they should just be in the regular puppet ones right?16:52
shardytrozet: because on upgrade from baremetal to containers, those templates are enabled16:52
shardyso we disable the baremetal services then start the containers16:53
trozetshardy: ah16:53
trozetshardy: thanks16:53
shardytrozet: it's a subset of the logic in the puppet/* templates16:53
*** Goneri has quit IRC16:53
trozetshardy: yeah i didnt think about that scenario goign from bm -> docker16:53
shardytrozet: yeah, they should just do nothing in the case where the env is already running containers16:54
jistrSlower: thanks. Just let me know then if you want me to remove the WIP flag on the bottom tht patch, all others depend on it.16:55
*** rfolco is now known as rfolco_doctor16:56
*** stendulker has quit IRC16:56
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Collect and send statistics to InfluxDB  https://review.openstack.org/53379516:57
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: Enable interfaces required for automatic migration pxe_ipmitool -> ipmi  https://review.openstack.org/53484216:57
*** timeu has joined #tripleo16:58
*** anilvenkata has joined #tripleo17:00
timeuHi everyone, we tried to delete an overcloud stack, but the state of the operation is "DELETE_FAILED". This is due to network connectivity issues with one compute node. Is there any way to force the deletion of the stack or what is the best way to recover from this situation ?17:00
shardytimeu: if you fix the problem you can just run the delete command again17:02
*** fragatina has quit IRC17:03
timeufirst we stopped the problematic baremetal node and then we cleared the uuid and set it to manage and back to available. When we try to delete the stack again it fails again.17:04
*** salmankhan has quit IRC17:04
timeuhttp://paste.openstack.org/show/646531/17:05
timeuthis is the error from the heat-engine.log17:05
*** salmankhan has joined #tripleo17:05
*** chlong has quit IRC17:06
shardytimeu: are you sure that's the error and not just the result of a timeout after the delete waited for a long time for the disabled compute node?17:08
shardytimeu: do you have rhel registration enabled?17:08
timeuyes17:08
timeuwe do17:08
shardytimeu: There is a config that runs on delete to unregister the nodes, that's probably hanging until timeout if the node has been disabled out of band17:08
timeuhmm makes sense17:09
timeuthis is the resource_list that failed: | Compute                   | f0b980d0-4d54-412b-8a0b-ede17a0fa293         | OS::Heat::ResourceGroup                          | DELETE_FAILED   | 2018-01-17T14:35:09Z |17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293617:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375417:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)17:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)17:10
timeuso as a workaround can we manually unregister the node in the RH portal ?17:10
timeuand then try delete agian ?17:10
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/pre_deploy/rhel-registration/rhel-registration.yaml#L6217:10
shardytimeu: looks like there's a boolean, do you have that parameter set anywhere?17:11
*** honza has joined #tripleo17:11
shardyHmm, actually that was only recently added, what version are you using?17:11
jpichIs there a way to get a longer stacktrace output for errors when running "openstack overcloud upgrade"? I get an error due to a command that works fine when I run it manually, hoping a stack trace would provide additional hints ( http://paste.openstack.org/show/646530/ ). Not having much luck grepping through logs17:13
timeuWe deployed OSP11 and i looked but our yml file doesn't have the boolean flag at all17:13
timeudoes it try to unregister by default in the older versions ?17:14
shardytimeu: ack, so you may need to manually signal the RhelUnregistrationDeployment that's hanging, assuming that's the problem17:14
shardytimeu: yes17:14
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Remove EOL for the step_config which break the inventory  https://review.openstack.org/53484417:14
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/stable/newton/extraconfig/pre_deploy/rhel-registration/rhel-registration.yaml#L13917:14
*** rfolco_doctor is now known as rfolco17:15
shardytimeu: there's a heat CLI you can use heat resource-signal <nested stack id> RhelUnregistrationDeployment17:16
shardyyou'll need to find the nested stack ID containing the resource17:16
shardytimeu: you can do that via e.g heat resource-list f0b980d0-4d54-412b-8a0b-ede17a0fa293 (ID of the resource group above)17:17
shardythen resource-list for the individual group member that's stuck17:17
*** dtantsur is now known as dtantsur|afk17:18
timeuyes that was a good suggestion. | RHELUnregistrationDeployment     | e87bc21b-f079-4d4f-a6d3-2bc66ff66899                                                           | OS::Heat::SoftwareDeployment                 | DELETE_FAILED   | 2018-01-17T13:17:15Z | overcloud-Compute-zth3ahchctyg-0-lw2jwmg6cry4-NodeExtraConfig-t5vc7dkkhabj   |17:19
timeuit seems that RHELUnregistrationDeployment failed17:19
*** tesseract has quit IRC17:21
shardytimeu: ack, I'd guess it waited a long time then eventually timed out?17:23
*** oidgar has joined #tripleo17:25
timeuyes it always times out, but as a result the deletion also ends up in DELETE_FAILED17:26
timeuthe problem now is how to signal the resource17:26
shardytimeu: see my comment above re heat resource-signal17:26
timeuheat resource-signal ac3bde6f-cf81-4d0f-b9dd-5bfef80815fe RhelUnregistrationDeployment17:26
timeubut it complains that Stack or resource not found: ac3bde6f-cf81-4d0f-b9dd-5bfef80815fe RhelUnregistrationDeployment17:27
shardytimeu: I'd double check you have the right ID via heat resource-list ac3bde6f-cf81-4d0f-b9dd-5bfef80815fe17:29
timeuIf id o this I get:17:30
timeuhttp://paste.openstack.org/show/646534/17:30
*** mounds has joined #tripleo17:31
shardytimeu: IIRC you have to signal it while it's in-progress, have you restarted the delete?17:31
timeuI used the physical_stack_id and ran heat resource-signal e87bc21b-f079-4d4f-a6d3-2bc66ff66899 RhelUnregistrationDeployment17:31
timeuno17:31
timeuok17:31
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Reduce race condition with timeout for ansible run  https://review.openstack.org/53484617:31
sshnaidmEmilienM, ^^17:32
timeuok will try17:32
*** moshele has quit IRC17:32
EmilienMsshnaidm: thanks17:32
shardyafk bbaib17:32
sshnaidmEmilienM, please depend on this patch, should solve logs problem17:32
*** shardy is now known as shardy_afk17:32
*** jfrancoa has quit IRC17:32
*** almondjoy has quit IRC17:34
*** jpich has quit IRC17:34
EmilienMsshnaidm: but it's for OVB only right?17:34
*** oidgar has quit IRC17:34
EmilienMah no17:35
EmilienMsorry I misread17:35
sshnaidmEmilienM, for multinode17:35
*** jpich has joined #tripleo17:35
EmilienMyeah17:35
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download  https://review.openstack.org/52876117:35
*** beagles is now known as beagles_afk17:35
EmilienMdone17:35
panda|ruckEmilienM: not been able to doo too much bisect on https://bugs.launchpad.net/tripleo/+bug/1742936, first occurrance is from 10th17:36
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)17:36
panda|rucknext step would be to make a diff, not sure if I'll have time today.17:37
*** gkadam has quit IRC17:37
*** florianf has quit IRC17:37
*** jpich has quit IRC17:40
EmilienMpanda|ruck: ok, I can take over. Maybe wrap up some notes in the bug report, i'll look later today17:40
EmilienMpanda|ruck: but I want to see what changed in OpenStack after January 10th17:40
*** gvrangan has joined #tripleo17:44
*** ebarrera has quit IRC17:51
*** fragatina has joined #tripleo17:52
*** aditya_ra has joined #tripleo17:52
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo stable/ocata: Enable automatic restart of memcached, apache and mongodb  https://review.openstack.org/53475517:53
*** fragatin_ has joined #tripleo17:53
*** fragatina has quit IRC17:54
*** aditya_ra has quit IRC17:54
*** aditya_ra has joined #tripleo17:54
jtomasekhonza: hi, I have split the prettier update patch into 2 - 1 for just the dep update and one for code update17:55
*** aditya_r has quit IRC17:55
jtomasekhonza: I am wanted to send it once the original prettier patch passes17:55
jtomasekhonza: are you ok with that?17:55
*** derekh has quit IRC18:00
*** dpawar has quit IRC18:01
*** dbecker has quit IRC18:02
*** holser__ has quit IRC18:03
*** Goneri has joined #tripleo18:04
*** trown has quit IRC18:06
*** yprokule has quit IRC18:08
itlinux_hello all..18:09
*** itlinux_ has quit IRC18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293618:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375418:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)18:10
*** shardy_afk has quit IRC18:10
*** itlinux has joined #tripleo18:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)18:10
*** moshele has joined #tripleo18:10
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/pike: [pike] Handle utf-8 when running python commands  https://review.openstack.org/53486818:11
EmilienMtherve: can you please review ^ ?18:11
EmilienMthrash: context is https://bugzilla.redhat.com/show_bug.cgi?id=153539918:13
openstackbugzilla.redhat.com bug 1535399 in instack-undercloud "openstack undercloud upgrade fails when using a wrong locale (UnicodeEncodeError: 'ascii' codec can't encode character ...)" [High,On_dev] - Assigned to emacchi18:13
EmilienMtamn18:13
EmilienMtherve: ^ sorry thrash18:13
*** mcornea has quit IRC18:13
*** bogdando has quit IRC18:13
*** dsneddon has joined #tripleo18:13
thrashEmilienM: :D18:14
*** gfidente has quit IRC18:14
EmilienMthrash: please change your nickname for me18:14
itlinuxhello all I wonder if there is a plan to add the fwaas puppet, yaml option to be pushed. I opened a ticket and mwhahaha helped on that aspect.18:14
EmilienMthrash: like ___thrash - I'm sure I won't do the mistake again18:14
EmilienMitlinux: which ticket?18:14
itlinuxlet me bring it up18:15
itlinuxhttps://bugzilla.redhat.com/show_bug.cgi?id=151117418:16
openstackbugzilla.redhat.com bug 1511174 in openstack-tripleo-heat-templates "[RFE] Option to enable FWaaS in TripleO" [Unspecified,New] - Assigned to emacchi18:16
itlinuxthanks EmilienM:18:17
*** jpena is now known as jpena|off18:17
itlinuxlooks like it's assigned to you :)18:17
*** hewbrocca is now known as hewbrocca_afk18:18
EmilienMitlinux: because I'm the default assignee for this progrect18:19
EmilienMI would ask beagles_afk on this one18:19
EmilienMcoz I dunno18:19
itlinuxahh ok thanks..18:19
*** timeu has quit IRC18:19
itlinuxsuper.. thanks18:19
itlinuxhello beagles_afk: are you around?18:19
*** chem has quit IRC18:19
*** dsariel has joined #tripleo18:19
*** timeu has joined #tripleo18:20
timeuwe managed to fix out issue using this solution: https://access.redhat.com/solutions/226056118:21
timeuthanks for the pointers and help18:21
*** timeu has quit IRC18:21
*** moshele has quit IRC18:22
*** aditya_ra has quit IRC18:28
*** yamahata has quit IRC18:29
openstackgerritMerged openstack/tripleo-ipsec master: Enable IPSEC tunnels for Redis VIP  https://review.openstack.org/53481618:37
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Passes NodeDataLookup to ceph-ansible workflow  https://review.openstack.org/52875718:39
openstackgerritMerged openstack/puppet-tripleo master: Prepare Queens milestone 3  https://review.openstack.org/53454018:39
openstackgerritMerged openstack-infra/tripleo-ci master: Use ara generation from collect-logs role  https://review.openstack.org/47854918:39
openstackgerritMerged openstack/python-tripleoclient master: Add -r/--roles-file option to undercloud deploy  https://review.openstack.org/53440218:39
openstackgerritMerged openstack/tripleo-heat-templates master: Correct erroneous upgrade tasks.  https://review.openstack.org/53471418:39
openstackgerritMerged openstack/tripleo-upgrade master: Append docker-ha.yaml conditionally.  https://review.openstack.org/53477018:39
*** openstackstatus has quit IRC18:40
*** openstackstatus has joined #tripleo18:43
*** ChanServ sets mode: +v openstackstatus18:43
*** karthiks has quit IRC18:46
*** dsariel has quit IRC18:49
thrashpoor EmilienM... Has to type 3 letters then tab.18:50
EmilienM:P18:50
eggmasterthrash: those keystrokes add up, man18:50
thrasheggmaster: :D18:51
*** psachin has quit IRC18:52
*** mounds is now known as almondjoy18:52
*** cylopez has quit IRC18:53
*** anilvenkata has quit IRC18:58
openstackgerritMerged openstack/tripleo-heat-templates master: Include common_deploy_steps_tasks.yaml  https://review.openstack.org/53474019:04
openstackgerritMerged openstack/tripleo-heat-templates master: Also pass blacklisted hostnames  https://review.openstack.org/53331919:04
openstackgerritMerged openstack/tripleo-heat-templates master: Default empty map for docker_config steps  https://review.openstack.org/53318519:04
*** yamahata has joined #tripleo19:06
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293619:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375419:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)19:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)19:10
*** karthiks has joined #tripleo19:10
*** atoth has quit IRC19:12
*** absubram has quit IRC19:18
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix tests and compilation after dependencies update  https://review.openstack.org/53476019:25
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Fix non urgent bugs caused by dependencies update  https://review.openstack.org/53476119:25
openstackgerritIan Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers  https://review.openstack.org/51744419:26
*** gvrangan has quit IRC19:33
*** dhill_ has quit IRC19:37
*** trown has joined #tripleo19:38
*** dhill_ has joined #tripleo19:39
*** dhill_ has quit IRC19:39
*** etingof has quit IRC19:42
*** ykarel|away has joined #tripleo19:42
openstackgerritMerged openstack/tripleo-quickstart-extras master: Replace validate-ipmi by enabling tripleo-validations role  https://review.openstack.org/53372019:43
*** nyechiel_ has quit IRC19:43
*** amoralej is now known as amoralej|off19:46
openstackgerritTom Barron proposed openstack/puppet-tripleo master: Resolve redefinition issue for ganesha VIP  https://review.openstack.org/53489219:46
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: DNM: test influxdb sending  https://review.openstack.org/53421819:49
*** athomas has quit IRC19:52
*** holser__ has joined #tripleo19:57
*** ykarel|away has quit IRC19:58
EmilienMstevebaker: good morning :)20:01
openstackgerritMerged openstack/tripleo-docs master: Call "openstack overcloud container image" only once  https://review.openstack.org/52862720:01
stevebakerEmilienM: morning!20:04
*** moshele has joined #tripleo20:04
*** dhill_ has joined #tripleo20:05
*** nyechiel_ has joined #tripleo20:06
*** cshastri has quit IRC20:06
*** moshele has quit IRC20:08
*** gkadam has joined #tripleo20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293620:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375420:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)20:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)20:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Update HostnameFormatDefault for multinode-3nodes  https://review.openstack.org/53489520:10
*** paramite has joined #tripleo20:11
*** nyechiel_ has quit IRC20:11
honzajtomasek: basically, everything is a lie and fake news20:11
jtomasekhonza: :D20:12
honzajtomasek: upstream ci has been refactored quite a bit (split into three projects, now uses ansible), and now things are all different20:12
honza:(20:12
honzai'm staring at the logs, and what i see shouldn't happen20:13
honzaso yeah20:13
*** salmankhan has quit IRC20:13
honzajtomasek: it's running on ubuntu (ie no rpms), it runs npm install, but fails on thath cheerio bug...20:16
jtomasekhonza: so waiting for ui-deps 8-4 won't help anything20:17
honzajtomasek: it appears so; you used to be able to go into the logs, and see all openstack rpms being installed... not anymore20:18
jtomasekhonza: so it seems like we're running wrong CI job isn't it so?20:18
openstackgerritTim Rozet proposed openstack/puppet-tripleo master: Adds TLS support for OpenDaylight  https://review.openstack.org/53100320:18
*** rmascena has joined #tripleo20:19
honzajtomasek: it seems that during the rewrite to ansible, the javascript jobs must have been simplified and made more general20:19
honzabasically just npm install && npm run test20:20
*** raildo has quit IRC20:21
jtomasekhonza: yeah, and it fails when it tries to compile the code with webpack20:25
jtomasekhonza: it would be good to explore node_modules on that machine20:26
honzajtomasek: i am doing some git archeology in project-config to see what happened20:26
jtomasekhonza: how did we manage to resolve that cheerio problem originally?20:28
honzajtomasek: that appeared to be caused by an upgrade of npm to 5 in rdo ci so we reverted back to 3.1020:29
*** fragatin_ has quit IRC20:29
jtomasekhonza: yeah, that's why we haven't been hitting that in CI, and now we do20:29
jtomasekfor some reason20:29
jtomasek(for some different reason)20:30
*** fragatina has joined #tripleo20:30
*** fragatina has quit IRC20:31
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/53395820:31
*** fragatina has joined #tripleo20:31
*** dprince has quit IRC20:31
*** fragatin_ has joined #tripleo20:34
openstackgerritOpenStack Proposal Bot proposed openstack/instack master: Updated from global requirements  https://review.openstack.org/53493020:34
openstackgerritOpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements  https://review.openstack.org/53396220:35
*** fragatina has quit IRC20:35
*** pkovar has quit IRC20:36
*** fragatina has joined #tripleo20:36
*** fragatina has quit IRC20:37
*** fragatin_ has quit IRC20:37
-openstackstatus- NOTICE: Zuul will be offline for a few minutes; existing changes will be re-enqueued; approvals during the downtime will need to be re-added.20:40
*** dsariel has joined #tripleo20:41
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Adds SSL/TLS everywhere for OpenDaylight  https://review.openstack.org/53102620:41
EmilienMweshay: wow I just discovered http://logs.openstack.org/44/534844/1/check/tripleo-ci-centos-7-containers-multinode/d909497/logs/undercloud/var/log/extra/dstat.html.gz20:41
*** fragatina has joined #tripleo20:42
EmilienMweshay: but we don't have it on the overcloud :( http://logs.openstack.org/44/534844/1/check/tripleo-ci-centos-7-containers-multinode/d909497/logs/subnode-2/var/log/extra/20:42
EmilienMbecause it's part of validate-tempest/tasks/stackviz.yml in tqe probably20:43
EmilienMarxcruz|rover, sshnaidm : it would be awesome to have dstat out of stackviz tasks20:43
EmilienMso we could run it on the overcloud during collect-logs maybe20:43
sshnaidmEmilienM, during collect-logs? why?20:44
EmilienMsshnaidm: or before20:44
EmilienMsshnaidm: but having it for the overcloud would be great imho20:44
bnemecEmilienM: Doesn't dstat have to to be running the entire time?20:44
EmilienMbnemec: on the undercloud AFIK20:44
sshnaidmEmilienM, if it runs a few mins it doesn't have too value20:45
bnemecEmilienM: But if you want stats on the overcloud you'd have to start it after the nodes come up so it can collect data.20:45
sshnaidmEmilienM, it would be great to have it running from the start of deployment20:45
bnemecA dstat overcloud service might be useful.20:45
EmilienMyeah20:45
EmilienM++20:45
*** fragatina has quit IRC20:47
*** ffiore has joined #tripleo20:50
*** rmascena has quit IRC20:51
*** dhill_ has quit IRC21:01
*** dhill_ has joined #tripleo21:02
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo stable/newton: Enable automatic restart of memcached, apache and mongodb  https://review.openstack.org/53495121:05
arxcruz|roverEmilienM: it runs before stackviz task, stackviz only checks if there's the data, if so, it adds on the report, otherwise, it skips21:06
honzajtomasek: the jobs that use RPMs went away during v2=>v3 upgrade, cf https://review.openstack.org/#/c/526430/1221:09
*** rfolco has quit IRC21:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293621:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375421:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)21:10
openstackgerritBen Nemec proposed openstack/puppet-tripleo master: Add support for Designate  https://review.openstack.org/51898321:19
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Designate Integration  https://review.openstack.org/51899821:20
*** rfolco has joined #tripleo21:22
*** apevec has joined #tripleo21:25
apevecEmilienM, panda|ruck - is https://bugs.launchpad.net/tripleo/+bug/1743754 Pike only and what does it mean we can21:25
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)21:25
apevec't fetch logs from OC ?21:25
honzajtomasek: npm is such a pile of garbage https://github.com/npm/npm/issues/1693821:25
apevecother jobs do have OC logs don't they21:26
jtomasekhonza: ah, saw that happen today too21:27
honzaand now i'm getting that less build error again, ugh21:27
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [DNM] CI Test  https://review.openstack.org/53495421:27
jtomasekhonza: ^ I've created this to see if removing favicon plugin solves the problem21:28
honza:D21:28
honzaok21:28
*** salmankhan has joined #tripleo21:28
honzajtomasek: let's see if rm -rf fixes things :)21:28
jtomasekhonza: less build problem is fine (if you get it with my dependencies patch)21:29
honzajtomasek: no, my prettier patch21:29
jtomasekhonza: that means that patternfly has been updated to newer version21:29
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Upgrade prettier  https://review.openstack.org/53430521:30
honzayep21:30
jtomasekhonza: new ci jobs seem to support yarn:)21:32
honzajtomasek: i'm reverting your sha update because afaict earlier patchsets passed ci21:32
honzajtomasek: is yarn really that much better?21:33
honzajtomasek: i am 100% on board if we can avoid the above nonsense21:33
honzabut something tells me that's just wishful thinking21:33
*** salmankhan has quit IRC21:33
jtomasekhonza: dunno, but I suspect that the issue we're hitting is deffinitely caused by npm21:33
honzajtomasek: just to confirm: are you using node 8.9.4 and npm 5.6.0 on your computer?21:34
honza(that's what ci has)21:34
honza"as of npm5, the npm cache self-heals..." BA HA HA HA21:35
jtomasekhonza: yes21:36
apevechonza, jtomasek - don't tell me nodejs/npm we just pushed is not good21:40
*** pchavva has quit IRC21:40
apevecI've rechecked https://review.openstack.org/532550 to test it21:40
jtomasekapevec: no, we are finding out that CI jobs we run in tripleo-ui does not use tripleo-ui-deps package at all21:41
apevecouch21:41
apevechttps://trunk.rdoproject.org/centos7-master/deps/el7/x86_64/openstack-tripleo-ui-deps-8-4.el7.x86_64.rpm what I pushed was build with npm 5.x21:41
*** paramite has quit IRC21:43
jtomasekapevec: apparently at the beginning of the cycle during ci refactoring the old jobs were replaced by generic jobs which currently run on ubuntu21:43
*** threestrands_ has joined #tripleo21:44
*** threestrands_ has quit IRC21:45
*** threestrands_ has joined #tripleo21:45
*** dsneddon has quit IRC21:54
*** holser__ has quit IRC21:55
apevecjtomasek, zuul v3 migration or something else?21:55
jtomasekapevec: yes, that21:55
EmilienMapevec: I don't know21:56
*** dparkes has joined #tripleo21:57
apevecEmilienM, and I know less than that :)21:58
apevecweshay, ^ looks like we're past tipping point, accumulating new untriaged issue faster than resolving old ones :(21:59
*** rbowen has quit IRC21:59
apevecpanda|ruck, "cliff subcommand returns error" - why is that relevant?21:59
weshayapevec, BAHHHHH... having trouble getting my recreate to reproduce the same error in ci atm21:59
apeveccliff is just CLI toolkit...21:59
weshaymy overcloud keeps failing to deploy22:00
apevecfun...not22:00
apevecweshay, maybe https://bugs.launchpad.net/tripleo/+bug/1743754 ?22:00
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)22:00
apevecweshay, btw in that one, EmilienM asked for OC logs, why we don't have them?22:01
weshayapevec, I don't think so I should be using the exact hash used in the promtion job22:01
*** trown is now known as trown|outtypewww22:01
apevecweshay, that would mean it fixed itself in later hash?22:01
weshayapevec, I've noticed some jobs lately don't have the overcloud logs or undercloud.. when I look at the collect logs .. log  the nodes are unreachable at that moment22:01
apeveca-ha that's what Sagi said22:02
*** rcernin has joined #tripleo22:02
*** mounds has joined #tripleo22:04
weshayapevec, I think I have a bug on that issue22:05
* weshay looks22:05
weshayseveral jobs for that fs have the issue22:06
weshayhttps://bugs.launchpad.net/tripleo/+bug/174252822:06
openstackLaunchpad bug 1742528 in tripleo "ovb jobs in rdo-cloud are not logging the overcloud nodes" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)22:06
*** almondjoy has quit IRC22:06
weshayipv4 vs ipv6 issue22:06
*** nalmond has joined #tripleo22:07
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VNX Cinder Backend  https://review.openstack.org/53461222:07
weshayalthough.. that is not the case for this job22:07
*** nalmond is now known as almondjoy22:08
*** mounds has quit IRC22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293622:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375422:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)22:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged]22:10
EmilienMapevec, weshay : we need to bisect22:16
EmilienMit's not fun but I don't see much other solution now22:16
*** itlinux has quit IRC22:17
apevecI agree, just how will do it? CI team will drown, we need some rotational help from the larger team22:22
apevecweshay, I'm cleaning up redhat-openstack, I assume https://github.com/redhat-openstack/tripleo-quickstart can be removed, it has not activity since it moved to openstack/22:22
apevecbut what is https://github.com/redhat-openstack/tripleo-quickstart-utils ??22:23
*** fragatina has joined #tripleo22:23
weshayy22:23
weshaythanks22:23
apevecok, I see from recent commits it's rasca's thing for internal, I'll check w/ him tomorrow22:24
apevechmm, forked from openstack/tripleo-quickstart-extras22:24
*** abishop has quit IRC22:25
openstackgerritOliver Walsh proposed openstack/tripleo-quickstart-extras master: WIP: Add support for creating sub-CAs in FreeIPA role  https://review.openstack.org/53496022:25
apevecweshay, what about redhat-openstack/khaleesi - archive it as R/O ?22:25
EmilienMapevec: yeah afik he maintains this repo for things related to HA & fencing, iirc22:26
apevecEmilienM, that's fine but why forking instead of separate add-on role22:28
*** gkadam has quit IRC22:29
EmilienMapevec: yeah I'm not sure22:30
*** liverpooler has quit IRC22:30
apevecnm, I'll grill rasca tomorrow :)22:32
*** apevec has quit IRC22:32
*** dsneddon has joined #tripleo22:33
Tenguhmm, I like the "very green" :). greener than usual green then? :)22:34
*** ffiore has quit IRC22:44
weshayEmilienM, I'm working towards moving the HA work to be properly gated by tq/tqe and hopefully in the promotion pipeline22:51
weshayat the tripleo layer22:51
EmilienMweshay: hugh22:52
EmilienMhug!22:52
*** ffiore has joined #tripleo22:53
*** ffiore has quit IRC22:54
*** jkilpatr has quit IRC22:54
*** jmelvin has quit IRC22:56
honzajtomasek: i am now convinced that it has nothing to do with zuulv2=>v323:05
honzajtomasek: the old legacy jobs also didn't use RPMs23:05
honzajtomasek: We still need to care about RPMs though because of the undercloud jobs that jpich has been working on.23:05
jtomasekhonza: it means that we could rebuild ui-deps after we update everything rather do it several times23:08
jtomasekhonza: what do you think?23:08
honzajtomasek: if we can figure out these mysterious errors...23:08
jtomasekhonza: btw. my patch which removes favicon plugin (and thus cheerio) passes23:09
*** dsneddon has quit IRC23:09
honzajtomasek: i saw that :(23:10
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174293623:10
openstackLaunchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174375423:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged]23:10
honzajtomasek: that project looks abandoned23:10
*** dparkes has quit IRC23:10
jtomasekhonza: to move things forward, you could update your prettier patch with that change and we could resolve/re-add that as bug later23:10
honzaha23:11
jtomasekhonza: alternatively I thought of doing another test with adding yarn.lock (to see if that would help)23:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support  https://review.openstack.org/53349023:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Don't fstrim vfat partitions  https://review.openstack.org/53496923:11
jtomasekhonza: there must be something specific about that CI machine/setup which causes it to fail since we are not able to reproduce the error locally23:13
honzajtomasek: i'll create a bug that says that the webpack plugin needs to be replaced with something else, create a patch that removes it, and then rebase stuff on top of that23:13
honzajtomasek: i just had an idea: maybe it's ubuntu: i'll try to run the build in a container :)23:13
jtomasekhonza: ok, sounds like a plan23:14
* honza giggles hypstericaly23:14
* jtomasek -> off to bed (00:14 here)23:14
honzajtomasek: you're insane23:15
*** Goneri has quit IRC23:16
*** etingof has joined #tripleo23:24
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Resolve CI issues  https://review.openstack.org/53495423:28
*** etingof has quit IRC23:35
honzajtomasek: you're not gonna believe this: i can reproduce the ci error on ubuntu (the same thing works fine on fedora)23:40
*** rlandy has quit IRC23:40
*** moshele has joined #tripleo23:41
*** dhill_ has quit IRC23:43
*** almondjoy has quit IRC23:50
*** pmannidi has joined #tripleo23:52
*** etingof has joined #tripleo23:54
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!