*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743563 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 00:10 |
openstack | Launchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 00:10 |
*** waleedm has quit IRC | 00:12 | |
EmilienM | sshnaidm|off: hey, when you're back, can you help me to figure why we don't have undercloud logs on https://review.openstack.org/#/c/528761/ ? see http://logs.openstack.org/61/528761/24/check/tripleo-ci-centos-7-3nodes-multinode/d01d3b1/ | 00:22 |
EmilienM | sshnaidm|off: looks like a timeout issue again | 00:22 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: DEBUG ansible inventory creation https://review.openstack.org/533313 | 00:25 |
*** tzumainn has quit IRC | 00:27 | |
openstackgerrit | zenghui.shi proposed openstack/tripleo-heat-templates master: Add PTP composable service https://review.openstack.org/491317 | 00:27 |
zshi | EmilienM, thanks for the reminding, just rebased the ptp patch : https://review.openstack.org/#/c/491317/ | 00:31 |
*** ecerquei has joined #tripleo | 00:32 | |
EmilienM | zshi: ack | 00:32 |
*** etingof has quit IRC | 00:33 | |
*** rhallisey has quit IRC | 00:37 | |
*** pchavva has quit IRC | 00:39 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Prepare Queens milestone 3 https://review.openstack.org/534540 | 00:43 |
*** etingof has joined #tripleo | 00:50 | |
*** tosky has quit IRC | 00:54 | |
tonyb | In my undercloud.conf I'm setting ipxe_enabled = false but ironic-inspector still seems to be configuring ipxe. Any pointers on how to debug? | 00:57 |
*** ecerquei has quit IRC | 01:02 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Export env variables required for statistics https://review.openstack.org/533788 | 01:04 |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 01:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743563 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 01:10 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Activate config-download for ovb-ha https://review.openstack.org/525331 | 01:12 |
*** mdnadeem has joined #tripleo | 01:13 | |
*** etingof has quit IRC | 01:21 | |
*** ukalifon has quit IRC | 01:22 | |
*** etingof has joined #tripleo | 01:22 | |
*** ukalifon has joined #tripleo | 01:22 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Align overcloud upgrade repo conf to new policy on promotion. https://review.openstack.org/534378 | 01:24 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Re-enable voting on scenario002-container https://review.openstack.org/532553 | 01:24 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support https://review.openstack.org/533490 | 01:33 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2 https://review.openstack.org/523638 | 01:38 |
*** rbrady has quit IRC | 01:47 | |
*** rbrady has joined #tripleo | 01:59 | |
*** rbrady has quit IRC | 02:00 | |
*** rbrady has joined #tripleo | 02:00 | |
*** dsneddon has quit IRC | 02:01 | |
*** bfournie has joined #tripleo | 02:02 | |
*** agopi has joined #tripleo | 02:08 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743563 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 02:10 |
openstack | Launchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 02:10 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable *_use_fqdn in ceph-ansible when EnableInternalTLS https://review.openstack.org/534366 | 02:10 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Document the featuresets which have config-download https://review.openstack.org/534460 | 02:10 |
openstackgerrit | lvxianguo proposed openstack/tripleo-heat-templates master: modify assignment spelling https://review.openstack.org/534587 | 02:21 |
*** rlandy has quit IRC | 02:27 | |
*** ramishra has joined #tripleo | 02:37 | |
*** jlabarre has quit IRC | 02:43 | |
*** fzdarsky_ has joined #tripleo | 02:45 | |
*** fzdarsky|afk has quit IRC | 02:50 | |
*** moshele has joined #tripleo | 02:59 | |
*** yamahata has quit IRC | 02:59 | |
*** dpawar has joined #tripleo | 03:05 | |
openstackgerrit | Merged openstack/tripleo-common master: Move more prepare logic into kolla_builder https://review.openstack.org/526579 | 03:05 |
openstackgerrit | Merged openstack/tripleo-common master: Use push_destination as the registry host in env file https://review.openstack.org/528616 | 03:05 |
*** dpawar has quit IRC | 03:06 | |
*** dpawar has joined #tripleo | 03:06 | |
*** ramishra has quit IRC | 03:08 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743563 | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 03:10 |
openstack | Launchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 03:10 |
openstackgerrit | Steve Baker proposed openstack/tripleo-docs master: Call "openstack overcloud container image" only once https://review.openstack.org/528627 | 03:12 |
openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Run "overcloud container image prepare" only once https://review.openstack.org/528621 | 03:13 |
*** ramishra has joined #tripleo | 03:15 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Discover every tag on prepare https://review.openstack.org/529215 | 03:15 |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Skip unnecessary image uploads https://review.openstack.org/531274 | 03:15 |
openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Prepare action: extra arguments https://review.openstack.org/526580 | 03:15 |
*** moshele has quit IRC | 03:19 | |
*** itlinux has joined #tripleo | 03:25 | |
openstackgerrit | Tony Breeds proposed openstack/instack-undercloud master: Ensure Boolen Strings from the enviornment are treated correctly https://review.openstack.org/534604 | 03:28 |
*** ramishra has quit IRC | 03:34 | |
tonyb | ^^^ that fixes my issue trying to disable ipxe boots | 03:38 |
*** ramishra has joined #tripleo | 03:38 | |
*** yamahata has joined #tripleo | 03:42 | |
openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VNX Cinder Backend https://review.openstack.org/534612 | 03:42 |
openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VNX Cinder Backend https://review.openstack.org/534612 | 03:44 |
*** fragatina has quit IRC | 03:44 | |
*** ykarel has joined #tripleo | 03:45 | |
*** shreshtha has joined #tripleo | 03:46 | |
*** shreshtha has quit IRC | 03:46 | |
*** shreshtha has joined #tripleo | 03:47 | |
openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo master: Add support for Dell EMC VNX Cinder Backend https://review.openstack.org/533815 | 03:48 |
*** daidv has joined #tripleo | 03:50 | |
*** skramaja has joined #tripleo | 03:52 | |
*** udesale has joined #tripleo | 04:00 | |
*** anilvenkata has joined #tripleo | 04:07 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743563 | 04:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 04:10 |
*** dsneddon has joined #tripleo | 04:22 | |
*** dsneddon has quit IRC | 04:23 | |
*** jbadiapa_ has quit IRC | 04:25 | |
*** psachin has joined #tripleo | 04:30 | |
*** moshele has joined #tripleo | 04:31 | |
*** psachin has quit IRC | 04:31 | |
*** psachin has joined #tripleo | 04:32 | |
*** skramaja has quit IRC | 04:45 | |
*** skramaja has joined #tripleo | 04:47 | |
*** links has joined #tripleo | 04:49 | |
openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers https://review.openstack.org/533638 | 04:49 |
*** skramaja_ has joined #tripleo | 04:55 | |
*** skramaja has quit IRC | 04:55 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Use sample environments for OVB configuration https://review.openstack.org/494643 | 05:01 |
openstackgerrit | wes hayutin proposed openstack/tripleo-docs master: add reproducer-quickstart.sh documentation https://review.openstack.org/534621 | 05:03 |
openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers https://review.openstack.org/533638 | 05:03 |
openstackgerrit | wes hayutin proposed openstack/tripleo-docs master: add reproducer-quickstart.sh documentation https://review.openstack.org/534621 | 05:07 |
openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adding support for odl hw offloading in containers https://review.openstack.org/534622 | 05:07 |
*** noslzzp_ has joined #tripleo | 05:09 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743563 | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 05:10 |
openstack | Launchpad bug 1743563 in tripleo "ceilometer-upgrade --skip-metering-database fails during undercloud install in master" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi) | 05:10 |
*** noslzzp has quit IRC | 05:12 | |
*** dpawar_ has joined #tripleo | 05:13 | |
* tonyb thinks he probably just messed up his dev box to the point it needs a fres install :( | 05:13 | |
tonyb | perhaps it's time to go AFK | 05:14 |
*** sonali85 has joined #tripleo | 05:14 | |
*** aputtur_ has quit IRC | 05:15 | |
*** dpawar has quit IRC | 05:16 | |
*** pradk has quit IRC | 05:17 | |
*** dpawar_ has quit IRC | 05:18 | |
*** ratailor has joined #tripleo | 05:18 | |
*** ratailor has quit IRC | 05:19 | |
*** trozet has quit IRC | 05:19 | |
*** ratailor has joined #tripleo | 05:20 | |
*** nyechiel_ has joined #tripleo | 05:31 | |
*** trozet has joined #tripleo | 05:37 | |
*** shreshtha has quit IRC | 05:37 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: DEBUG ansible inventory creation https://review.openstack.org/533313 | 05:40 |
*** pradk has joined #tripleo | 05:41 | |
jaosorior | bandini: let me know when you're online | 05:46 |
*** skramaja has joined #tripleo | 06:00 | |
*** skramaja_ has quit IRC | 06:01 | |
*** skramaja_ has joined #tripleo | 06:05 | |
*** dpawar has joined #tripleo | 06:06 | |
*** absubram has joined #tripleo | 06:06 | |
*** skramaja has quit IRC | 06:06 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 06:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
bandini | jaosorior: yo | 06:13 |
*** pmannidi has quit IRC | 06:16 | |
*** jbadiapa has joined #tripleo | 06:18 | |
*** janki has joined #tripleo | 06:20 | |
*** skramaja_ is now known as skramaja | 06:22 | |
*** waleedm has joined #tripleo | 06:33 | |
*** pmannidi has joined #tripleo | 06:33 | |
*** pmannidi has quit IRC | 06:38 | |
*** pgadiya has joined #tripleo | 06:39 | |
*** marios has joined #tripleo | 06:39 | |
*** suuuper has joined #tripleo | 06:48 | |
janki | moshele, hey | 06:48 |
moshele | janki: hey :) | 06:48 |
janki | moshele, did that work? | 06:49 |
moshele | janki: yes the latest patch I uploaded did work, we are doing some more testing one it | 06:49 |
*** pmannidi has joined #tripleo | 06:50 | |
moshele | janki: thanks for the support, we also want to push the odl hw offload with containers https://review.openstack.org/#/c/534622/ | 06:53 |
janki | Hi. Can I get few reviews for https://review.openstack.org/#/c/529496/ | 06:53 |
janki | moshele, I commented on the env file. JUst try it out. NOthing major and has no side effetcs. just to avoid duplication | 06:54 |
moshele | janki: yes I think it will work but let us test it first | 06:54 |
*** ramishra has quit IRC | 06:54 | |
moshele | janki: regarding odl we may need you help to understand how to build odl in container. I will talk to you when it relevant | 06:55 |
janki | moshele, sure | 06:58 |
*** ramishra has joined #tripleo | 07:07 | |
openstackgerrit | Merged openstack/tripleo-ipsec master: Force restart IPSEC after config tasks https://review.openstack.org/534321 | 07:07 |
openstackgerrit | Merged openstack/tripleo-ipsec master: Ignore errors in whack listen https://review.openstack.org/534322 | 07:09 |
*** absubram has quit IRC | 07:10 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 07:10 |
openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Upgrade/Update ODL https://review.openstack.org/489201 | 07:10 |
*** jfrancoa has joined #tripleo | 07:16 | |
*** agopi has quit IRC | 07:16 | |
*** threestrands_ has quit IRC | 07:20 | |
*** dsariel has joined #tripleo | 07:21 | |
*** dparkes has joined #tripleo | 07:26 | |
*** aufi has joined #tripleo | 07:27 | |
*** jkilpatr has quit IRC | 07:28 | |
*** dparkes has quit IRC | 07:32 | |
*** ykarel has quit IRC | 07:36 | |
*** ykarel has joined #tripleo | 07:38 | |
*** jkilpatr has joined #tripleo | 07:39 | |
*** dparkes has joined #tripleo | 07:40 | |
*** ykarel has quit IRC | 07:43 | |
*** ykarel has joined #tripleo | 07:43 | |
*** pcaruana has joined #tripleo | 07:48 | |
janki | can I get some reviews on https://review.openstack.org/#/c/529496/ marios mandre jaosorior skramaja | 07:48 |
*** honza has quit IRC | 07:53 | |
*** yprokule has joined #tripleo | 07:54 | |
*** dciabrin has joined #tripleo | 07:55 | |
jaosorior | panda|ruck, adarazs: are deployments to RDO cloud with devmode currently working? | 07:55 |
*** pcaruana has quit IRC | 07:55 | |
*** pcaruana has joined #tripleo | 07:55 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 07:58 |
*** bogdando has joined #tripleo | 07:59 | |
*** bogdando has quit IRC | 07:59 | |
*** bogdando has joined #tripleo | 08:00 | |
*** dparkes has quit IRC | 08:04 | |
*** athomas has joined #tripleo | 08:05 | |
*** florianf has joined #tripleo | 08:06 | |
*** ccamacho has quit IRC | 08:06 | |
openstackgerrit | Noam Angel proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers https://review.openstack.org/533638 | 08:07 |
*** ebarrera has joined #tripleo | 08:09 | |
marios | janki: sure will check it i just had a look at your other one | 08:10 |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 08:10 |
mhenkel_ | good morning jaosorior and shardy | 08:11 |
mhenkel_ | would you have time today to spend some cycles on the composable haproxy setup? | 08:12 |
*** shardy has joined #tripleo | 08:14 | |
*** amoralej|off is now known as amoralej | 08:17 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: Add fast-forward upgrade outputs to RoleConfig https://review.openstack.org/499221 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: tripleo-packages repo management https://review.openstack.org/515429 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: Allow FASTFORWARDUPGRADE as a StackUpdateType https://review.openstack.org/522547 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: ffu: Add fast-forward-upgrade env https://review.openstack.org/522203 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Keystone fast-forward upgrade tasks https://review.openstack.org/514621 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Neutron fast-forward upgrade tasks https://review.openstack.org/521543 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Glance fast-forward upgrade tasks https://review.openstack.org/521544 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Cinder fast-forward upgrade tasks https://review.openstack.org/521545 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Nova fast-forward upgrade tasks https://review.openstack.org/522921 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Pacemaker fast-forward upgrade tasks https://review.openstack.org/523399 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP Add missing become to upgrade_steps_playbook https://review.openstack.org/522922 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP Add missing become to Host prep steps play https://review.openstack.org/522923 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: DNM ffu: ignore_errors during upgrade_tasks https://review.openstack.org/523400 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: DNM ffu: Workaround missing repo control when moving to Queens https://review.openstack.org/518719 | 08:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Swift fast-forward upgrade tasks https://review.openstack.org/526642 | 08:17 |
openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Restrict resolvers to IPv4 addresses https://review.openstack.org/534326 | 08:18 |
janki | moshele, which one? | 08:20 |
jaosorior | mhenkel_: what's up? | 08:20 |
*** gkadam has joined #tripleo | 08:21 | |
mhenkel_ | hey jaosorior: I still have the issue that this server_names: "%{hiera('contrail_config_node_names')}" is interpreted as a string instead of an array in the endpoint.pp | 08:21 |
jaosorior | right, seems the fix didn't work | 08:22 |
mhenkel_ | any2array doesn't help because it just puts the string "["server_name"] | 08:22 |
*** ccamacho has joined #tripleo | 08:22 | |
mhenkel_ | any2array doesn't help because it just puts the string "["server_name"]" into an array | 08:22 |
mhenkel_ | and not server_name itself | 08:23 |
jaosorior | uhm | 08:23 |
jaosorior | mhenkel_: if the endpoint name matches the service name, I could default that value | 08:23 |
mhenkel_ | I think this is because of a nested hiera call. The first one happens in https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp#L33 | 08:23 |
shardy | sounds like the input to any2array is already quoted? | 08:24 |
mhenkel_ | shardy: exactly | 08:24 |
*** cylopez has joined #tripleo | 08:24 | |
mhenkel_ | I also tried a parsejson in endpoint.pp | 08:24 |
shardy | brb | 08:25 |
*** shardy is now known as shardy_afk | 08:25 | |
jaosorior | mhenkel_: what's the patch you're trying out? | 08:25 |
mhenkel_ | I was testing just to correctly output the array: | 08:25 |
mhenkel_ | $test_names = parsejson($server_names) | 08:26 |
mhenkel_ | notify{ "${name}": | 08:26 |
mhenkel_ | message => $test_names, | 08:26 |
mhenkel_ | } | 08:26 |
mhenkel_ | I also tested $test_names = any2array($server_names) | 08:26 |
jaosorior | uhm, no | 08:26 |
jaosorior | the endpoint definition | 08:26 |
jaosorior | in yaml | 08:26 |
mhenkel_ | this is the generated hieradata: http://paste.openstack.org/show/646325/ | 08:27 |
mhenkel_ | the thing is: endpoints which do NOT got through service_endpoints.pp correctly interpret the array: | 08:28 |
mhenkel_ | like this one: | 08:28 |
mhenkel_ | Notice: /Stage[main]/Tripleo::Haproxy/Tripleo::Haproxy::Endpoint[heat_cfn]/Notify[heat_cfn]/message: defined 'message' as 'overcloud-controller-0.internalapi.localdomain' | 08:28 |
*** cshastri has joined #tripleo | 08:29 | |
mhenkel_ | it outputs overcloud-controller-0.internalapi.localdomain correctly | 08:29 |
*** tesseract has joined #tripleo | 08:29 | |
mhenkel_ | now when the endoint creation goes through service_endpoints.pp: | 08:29 |
mhenkel_ | Notice: /Stage[main]/Tripleo::Haproxy/Tripleo::Haproxy::Service_endpoints[contrail_config]/Tripleo::Haproxy::Endpoint[contrail_config_api]/Notify[contrail_config_api]/message: defined 'message' as '["overcloud-contrailcontroller-0.internalapi.localdomain"]' | 08:29 |
mhenkel_ | you see that the array is a string | 08:30 |
mhenkel_ | basically ["overcloud-contrailcontroller-0.internalapi.localdomain"] vs overcloud-controller-0.internalapi.localdomain | 08:30 |
*** dsariel has quit IRC | 08:30 | |
jaosorior | understood | 08:30 |
mhenkel_ | and my suspicion is the nested hiera call. service_endpoints.pp calls hiera, which contains a hash with another hiera call | 08:31 |
mhenkel_ | $dots_endpoints = hiera("tripleo.${underscore_name}.haproxy_endpoints", {}) - 1st hiera call and tripleo.${underscore_name}.haproxy_endpoints itself contains "server_names": "%{hiera('contrail_config_node_names')}", | 08:32 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Haproxy endpoint resource: set defaults for server_names and IPs https://review.openstack.org/531378 | 08:33 |
jaosorior | mhenkel_: trying this out instead https://review.openstack.org/#/c/531378/ | 08:33 |
jaosorior | mhenkel_: that would rely on the endpoint having the same name as the service | 08:33 |
mhenkel_ | I think this is a true assumption | 08:33 |
mhenkel_ | let me test | 08:33 |
jaosorior | so, if that works, you shouldn't need to specify that value in the yaml file | 08:34 |
jaosorior | only let the defaults do their thing | 08:34 |
*** ykarel has quit IRC | 08:36 | |
*** numans has joined #tripleo | 08:39 | |
mhenkel_ | that works | 08:39 |
mhenkel_ | I remove the ip_addresses and server_names from the yaml | 08:39 |
mhenkel_ | haproxy config is correctly generated | 08:39 |
jaosorior | wow, so you tried it out already? | 08:40 |
mhenkel_ | yes | 08:41 |
openstackgerrit | waleed mousa proposed openstack/tripleo-heat-templates master: Adding support for ovs hw offloading in containers https://review.openstack.org/533638 | 08:41 |
*** pmannidi has quit IRC | 08:41 | |
*** numans has quit IRC | 08:41 | |
mhenkel_ | I am directly testing inside the haproxy container, where I can change the puppet modules and the yaml directly and just call the puppet module | 08:42 |
jaosorior | ah cool | 08:42 |
jaosorior | mhenkel_: alright, well, if it works for you, a +1 is appreciated :D | 08:42 |
*** mandre is now known as mandre_afk | 08:44 | |
*** dparkes has joined #tripleo | 08:45 | |
*** rcernin has quit IRC | 08:45 | |
jaosorior | dciabrin, bandini: Hey, you mentioned you wanted to talk about TLS for Redis | 08:50 |
dciabrin | jaosorior, heya o/ yes i'm trying to fix my reviews upstream, I'd like to send you a recap later today. e.g. how it's working, what's left to do etc | 08:51 |
jaosorior | awesome! | 08:51 |
*** shardy_afk is now known as shardy | 08:52 | |
jaosorior | shardy: what do you think of this as a solution for the problem mhenkel_ reported https://review.openstack.org/#/c/531378/ | 08:53 |
*** psachin` has joined #tripleo | 08:53 | |
*** psachin has quit IRC | 08:54 | |
shardy | jaosorior: lgtm, just need a bug reference in the commit message I think | 08:54 |
shardy | jaosorior: thanks for looking into it | 08:54 |
jaosorior | mhenkel_: did you file a bug? | 08:55 |
mhenkel_ | can there be situations where the endpoint name differs from the service name? | 08:55 |
mhenkel_ | jaosorior: yes, I copied you on the email;) | 08:55 |
jaosorior | mhenkel_: everything is possible :D | 08:55 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Haproxy endpoint resource: set defaults for server_names and IPs https://review.openstack.org/531378 | 08:56 |
mhenkel_ | https://bugs.launchpad.net/tripleo/+bug/1743626 | 08:56 |
openstack | Launchpad bug 1743626 in tripleo "composable haproxy configuration fails" [Undecided,New] | 08:56 |
jaosorior | awesome | 08:56 |
jaosorior | alright, added bug to the review | 08:56 |
mhenkel_ | jaosorior: thanks for looking into it! | 08:57 |
jaosorior | np | 08:57 |
*** jpena|off is now known as jpena | 08:57 | |
shardy | https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp#L33 | 08:58 |
shardy | Isn't the endpoint name in puppet derived from the service_name, not the EndpointMap | 08:58 |
*** hasanq has joined #tripleo | 08:58 | |
shardy | in that case it will always match the t-h-t generated service_name_node_ips etc | 08:58 |
*** jpich has joined #tripleo | 08:58 | |
shardy | provided I'm right about that I think the assumption around $name is fine | 08:59 |
shardy | https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp#L27 | 08:59 |
jaosorior | shardy: right, but tripleo::haproxy::endpoint is not only used by the dynamic endpoints. It's how almost every endpoint in manifests/haproxy.pp is defined, and some don't match. Anyway, in those cases they do pass the server_names and ip_addresses explicitly | 08:59 |
shardy | hrm we do some regsubst mangling which should not be needed if we use service_name consistently | 09:00 |
shardy | jaosorior: Ok, I guess we can go with this and just ensure any special cases are commented | 09:00 |
*** daidv has quit IRC | 09:01 | |
shardy | its a bit confusing because the EndpointMap data isn't automatically generated, or even strictly related to the service templates | 09:01 |
*** daidv has joined #tripleo | 09:01 | |
* shardy has been meaning to work out how to fix that for a while | 09:01 | |
shardy | it's kind of a chicken/egg problem though ;) | 09:02 |
*** shreshtha has joined #tripleo | 09:02 | |
*** StevenK has quit IRC | 09:02 | |
*** shreshtha has quit IRC | 09:03 | |
jaosorior | shardy: yep :/ | 09:03 |
*** shreshtha has joined #tripleo | 09:04 | |
*** ykarel has joined #tripleo | 09:04 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Dont insist on IKEv2 https://review.openstack.org/534694 | 09:04 |
*** oidgar has joined #tripleo | 09:06 | |
Tengu | shardy: hello! "small" question: I'd like to duplicate my current undercloud vm and make it a "lab". Is there an easy way to kind of reconfigure it with some other subnet/networks, and drop the heat stack, or must I recreate an undercloud from 0 (meaning different package versions)? | 09:06 |
*** fzdarsky_ is now known as fzdarsky | 09:07 | |
shardy | Tengu: Hi, no I don't think that will work well because we have a validation that prevents changing the provisioning subnet - the reason is changing it breaks the swift rings and possibly some other stuff | 09:08 |
Tengu | hmm. | 09:08 |
shardy | Tengu: I'd probably create a new VM, enable the same repos, then install rpm -qa from the existing node | 09:08 |
shardy | Tengu: then your lab can run the normal undercloud install but it should be faster without the package download | 09:08 |
Tengu | I think the repository for trunk won't be available -.-' | 09:09 |
shardy | Or mirror the packages locally and just do the normal install process | 09:09 |
shardy | Tengu: Yes the repo is a delorean hash | 09:09 |
*** holser__ has joined #tripleo | 09:09 | |
*** psachin` has quit IRC | 09:09 | |
shardy | Tengu: check /etc/yum.repos.d/delorean* | 09:09 |
Tengu | anyway, I'll check that. Kind of annoying I had to wait over three months for the lab infra :( | 09:09 |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 09:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
jbadiapa | shardy, would you mind reviewing https://review.openstack.org/#/c/530780/? | 09:10 |
shardy | Tengu: the idea of the delorean builds is they are repeatable, so you should be able to use the same repo setup | 09:10 |
shardy | jbadiapa: ack will do | 09:10 |
Tengu | shardy: thanks for your advices :). Hopefully I'll be able to get something working in order to validate the updates. And get an up-to-date Pike deploy :). | 09:11 |
shardy | Tengu: note that tripleo-quickstart already kind of does this - it downloads an image but I'm not completely sure where that's hosted now | 09:11 |
Tengu | shardy: I actually have my own ansible thingy for that. I'll just update it and ensure I get a clone. | 09:12 |
*** psachin has joined #tripleo | 09:13 | |
*** StevenK has joined #tripleo | 09:17 | |
ramishra | shardy: Hey! Any idea why I'm getting this error, when running the config download playbooks on an existing containerized overcloud? http://paste.openstack.org/show/646385/ | 09:18 |
ramishra | Is the inventory incorrect? | 09:18 |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: logging: use service_config_settings for fluentd https://review.openstack.org/501458 | 09:23 |
shardy | ramishra: Hi, what command did you use to generate inventory.yaml? | 09:24 |
shardy | ramishra: I'd suggest trying with the dynamic inventory e.g -i /usr/bin/tripleo-ansible-inventory | 09:24 |
shardy | ramishra: the old ini format inventory is deprecated and may not work, there's a new --static-yaml-inventory option though | 09:25 |
ramishra | no it's yaml | 09:25 |
*** mcornea has joined #tripleo | 09:25 | |
ramishra | with --static-inventory-yaml I think | 09:26 |
ramishra | sorry the flag you mentioned, new to all thse:) | 09:27 |
shardy | ramishra: hrm Ok sec let me try to reproduce - was there anything special about the overcloud configuration? | 09:28 |
ramishra | I did not use config-download-environment.yaml when deploying the overcloud | 09:29 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Upgrade prettier https://review.openstack.org/534305 | 09:29 |
ramishra | that should be fine right? | 09:29 |
ramishra | shardy: the update_steps_playbook.yaml also fails with http://paste.openstack.org/show/646399/ | 09:31 |
ramishra | I assume that's something to with the user used (heat-admin)? | 09:32 |
*** udesale_ has joined #tripleo | 09:33 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DNM] Testing ocata->pike upgrade. https://review.openstack.org/532791 | 09:34 |
*** udesale has quit IRC | 09:34 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing. https://review.openstack.org/525686 | 09:36 |
ramishra | shardy: I was following https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ansible_config_download.html | 09:36 |
shardy | ramishra for the second error try running with -b | 09:36 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment. https://review.openstack.org/534360 | 09:38 |
*** dsariel has joined #tripleo | 09:38 | |
ramishra | shardy: Ah! yep, ansible newbie;) | 09:38 |
shardy | ramishra: probably we should add a become: true like in https://review.openstack.org/#/c/533757/ | 09:38 |
*** stendulker has joined #tripleo | 09:39 | |
shardy | we've got that in various places but there are inconsistencies | 09:39 |
*** derekh has joined #tripleo | 09:39 | |
ramishra | shardy: yeah | 09:39 |
shardy | ramishra: those docs need updating, they still reference --static-inventory | 09:40 |
*** rcernin has joined #tripleo | 09:40 | |
shardy | ramishra: can you re-test with -i /usr/bin/tripleo-ansible-inventory please? | 09:40 |
shardy | I'll push a docs patch now | 09:41 |
ramishra | shardy: same error | 09:42 |
*** arxcruz|off is now known as arxcruz|rover | 09:42 | |
skramaja | shardy: added a comment on https://review.openstack.org/#/c/532465/2/puppet/role.role.j2.yaml@214, could you check if it is worth merging RoleParametersDefault? | 09:43 |
shardy | ramishra: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/cinder-api.yaml#L207 | 09:46 |
*** fpan has joined #tripleo | 09:46 | |
shardy | the error seems to be here, it's not running the task that registers cinder_api_enabled for step 2 | 09:46 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Use telemetry-tempest-plugin for Telemetry projects https://review.openstack.org/534706 | 09:46 |
shardy | ramishra: what tags are you including when running ansible-playbook? | 09:46 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment. https://review.openstack.org/534360 | 09:47 |
*** gfidente has joined #tripleo | 09:47 | |
*** gfidente has quit IRC | 09:47 | |
*** gfidente has joined #tripleo | 09:47 | |
*** fpan_ has quit IRC | 09:47 | |
shardy | marios, chem: ^^ are there updated docs to cover the most recent ansible driven upgrade? | 09:47 |
shardy | ramishra: I think this error is specific to upgrade and not any problem with the inventory or config-download | 09:47 |
ramishra | shardy: ansible-playbook -i inventory.yaml --private-key ~/.ssh/id_rsa config-download/tripleo-bZ2OCy-config/upgrade_steps_playbook.yaml | 09:48 |
marios | shardy: not yet afaik we have a task for it but noone picked it up yet | 09:48 |
openstackgerrit | Merged openstack/tripleo-ipsec master: Dont insist on IKEv2 https://review.openstack.org/534694 | 09:48 |
shardy | marios: ack, is ther perhaps anything in CI ramishra can refer to instead? | 09:49 |
ramishra | not any tags, do I've to? Would not it just run when there is nothing to upgrade? | 09:49 |
marios | shardy: ah i see i missed the earlier chat... not yet but sec we have this https://review.openstack.org/526006 | 09:49 |
ramishra | shardy: my questions may be little dumb, so bear with me:) | 09:50 |
shardy | ramishra, marios: Oh I think I see the problem | 09:53 |
shardy | marios: your patch switching from tags to when landed, but we still have tags in docker/services/* | 09:53 |
*** sshnaidm|off is now known as sshnaidm | 09:54 | |
marios | shardy: yeah i only 'migrated' the steps... things like "common" tags for example are todo (common i guess we just remove the conditional alltogether it happens every time, for example) | 09:54 |
*** udesale_ has quit IRC | 09:55 | |
*** udesale has joined #tripleo | 09:55 | |
shardy | marios: well by the sounds of it that doesn't work | 09:55 |
shardy | was this tested before it landed? I'm not sure on the current status of upgrade CI | 09:56 |
marios | shardy: well there is no P.. Q upgrade ci yet | 09:56 |
marios | shardy: so it shouldn't break anything | 09:56 |
marios | shardy: it was confined to upgrade_tasks | 09:56 |
shardy | :( | 09:56 |
shardy | marios: Ok well FWIW ramishra found this http://paste.openstack.org/show/646385/ | 09:56 |
marios | shardy: looking | 09:57 |
shardy | I think it's because we've now got a mix of tags and when | 09:57 |
shardy | so we don't register the var anymore for the steps | 09:57 |
shardy | I assume the same problem exists in various places so may be a easy sed fix | 09:57 |
marios | shardy: ok cool thanks ramishra i expect we will see this and more once we get that job running if you like file a launchpad for tracking it? | 09:58 |
ramishra | marios: sure will do | 09:58 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Add extra options for undercloud deploy command https://review.openstack.org/534708 | 09:58 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validations for FFU. https://review.openstack.org/534709 | 09:59 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validations for FFU. https://review.openstack.org/534709 | 10:06 |
bogdando | folks, need some help please with https://pastebin.com/LszGtsdN :( | 10:07 |
bogdando | I want to deploy UC containerized all-in-one with a Manila CephFS Native driver backend | 10:08 |
jaosorior | bogdando: are there any other errors? Seems like the database setup might not have ran | 10:08 |
jaosorior | the db_sync | 10:08 |
bogdando | so, I redeploy on a dirty env, usually worked for me just fine, never tried pcmk deploys tho, and my quickstart inventory and tht env are: | 10:09 |
bogdando | I'm* | 10:09 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/ocata: Set restrictive file permissions on Ceph keyrings for non-containerized deployment https://review.openstack.org/528015 | 10:09 |
bogdando | https://github.com/bogdando/oooq-warp/blob/master/tht/environments/all-in-one-pcmk.yaml and alter the hardocoded service templates like this https://github.com/bogdando/oooq-warp/blob/6777d94e984f94d4c0bfa78ac589aaa301f22261/vars/undercloud-only-pcmk-traas.yaml#L23 | 10:09 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 10:10 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Add flag to configure VIPs https://review.openstack.org/534323 | 10:10 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/newton: Set restrictive file permissions on Ceph keyrings for non-containerized deployment https://review.openstack.org/528599 | 10:11 |
bogdando | jaosorior: will take a look into logs... thanks | 10:11 |
*** ramishra has quit IRC | 10:12 | |
bogdando | jaosorior: hm, I see no traces of db sync attempts | 10:13 |
*** skramaja has quit IRC | 10:13 | |
*** ramishra has joined #tripleo | 10:13 | |
bogdando | no containers , nothing in undercloud_install logs | 10:14 |
bogdando | prolly pacemaker service included assumes MySQL will be managed by pcmk as well? and I want it only for Manila share? | 10:14 |
*** paramite has joined #tripleo | 10:15 | |
bogdando | and there is a mess with steps for docker puppet ordering?.. | 10:15 |
bogdando | sigh | 10:15 |
shardy | bogdando: did pacemaker bring up the DB? | 10:15 |
bogdando | I do not manage it with pcmk... | 10:15 |
*** salmankhan has joined #tripleo | 10:15 | |
bogdando | I have mariadb running as a local docker managed container tho | 10:15 |
bogdando | for my case, the failure happened even before pcs installed | 10:16 |
shardy | bogdando: what do you mean by local docker managed container? Did TripleO start it? | 10:16 |
jaosorior | bogdando: well, pacemaker does assume that mysql is managedb y it, yes | 10:16 |
bogdando | I only have puppet-pacemaker installed | 10:17 |
bogdando | shardy: yes | 10:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add yaml validations for FFU. https://review.openstack.org/534709 | 10:17 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Correct erroneous upgrade tasks. https://review.openstack.org/534714 | 10:17 |
shardy | I don't really get the use-case for this tbh, nobody ever tested all-in-one undercloud with pacemaker, just deploy a single node overcloud with all pacemaker stuff enabled? | 10:17 |
*** adrianreza has joined #tripleo | 10:17 | |
bogdando | shardy: I mean that I deploy mariadb service out of pcmk control plane | 10:17 |
bogdando | attempted to* :) | 10:17 |
shardy | bogdando: Ok, FWIW I'd probably start with something that's tested in CI and go from there | 10:17 |
jaosorior | bogdando: I think that is the issue though. pacemaker assumes it'll handle mysql | 10:17 |
shardy | this mix is not tested anywhere AFAIK | 10:17 |
bogdando | shardy: that's my case :) tricky and off road, as always | 10:18 |
shardy | bogdando: yeah :) I'm just trying to understand why ;) | 10:18 |
bogdando | I need all in one UC with Manila, to deploy external ansible openshift as overcloud | 10:18 |
bogdando | and I basically need this for dev envs of shift-on-stack provider :) | 10:18 |
shardy | bogdando: so the deployed openshift will interact with Manila on the undercloud? | 10:18 |
bogdando | yupp | 10:19 |
*** salmankhan has quit IRC | 10:19 | |
shardy | Ok other than for dev usage I'm not sure we'd ever support that, it's a single point of failure | 10:19 |
bogdando | I'll add octavia later, and anything else I do not want to struggle with if used devstack | 10:19 |
shardy | I'd deploy a pcmk enabled overcloud w/ironic then deploy openshift on that | 10:19 |
shardy | interesting to try though I guess | 10:19 |
bogdando | indeed, so do I :) | 10:20 |
bogdando | we have a CI job that deploy overcloud as openshift | 10:20 |
shardy | Yes but you'd never want runtime dependencies on undercloud services | 10:20 |
bogdando | flaper87: wrote it, see https://review.openstack.org/#/c/494418/ shardy | 10:21 |
shardy | bogdando: yes, that's just using TripleO as a provisioning tool | 10:21 |
bogdando | and I'm struggling to adapt it for OCP 3.7, and using shift-on-stack provider | 10:21 |
shardy | bogdando: I think you'd want to deploy openshift alongside openstack, then make the two things depend on each other, with openstack deploying manila etc all HA | 10:21 |
bogdando | shardy: well, sure. I just want to explore a simple alternative for devstack as a host cloud | 10:21 |
bogdando | and undercloud fits well, no need for overcloud basically | 10:22 |
shardy | bogdando: understood, just saying it's possibly not something to burn a ton of time on :) | 10:22 |
bogdando | yeah | 10:22 |
bogdando | right | 10:22 |
bogdando | I won't , just a little of time :D | 10:22 |
*** dbecker has joined #tripleo | 10:23 | |
shardy | If I was testing this I'd probably deploy two custom roles, one all-in-one openshift and one all-in-one openstack | 10:23 |
shardy | then you deploty the whole setup on three VMs including the undercloud | 10:23 |
*** tosky has joined #tripleo | 10:23 | |
bogdando | shardy: bingo, I've already tested all-in-one openshift! :) | 10:24 |
shardy | bogdando: ack, so you add one more VM and you're done ;) | 10:24 |
bogdando | that makes sense, I'll try to deploy overcloud then use it just as a host cloud | 10:25 |
bogdando | Tho I wanted to expolore CI option to plug shift-on-stack provider into external deployments | 10:26 |
*** hasanq has quit IRC | 10:28 | |
shardy | bogdando: you could test the same setup in CI, we do similar in the multinode 3-nodes job | 10:30 |
*** mandre_afk is now known as mandre | 10:33 | |
*** timeu has joined #tripleo | 10:34 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Disable services in undercloud.yaml and add docker-uc.yaml https://review.openstack.org/526088 | 10:36 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry https://review.openstack.org/524644 | 10:36 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Merge undercloud service env files into undercloud env files https://review.openstack.org/526723 | 10:36 |
mfedosin | mandre: hey :) may I ask you for a favor? | 10:38 |
mfedosin | I proposed a patch to puppet-mistral https://review.openstack.org/#/c/534715/ | 10:38 |
mfedosin | it allows to disable cron trigger support | 10:38 |
mfedosin | this is my first puppet and probably we can improve something there | 10:39 |
*** sri_ has joined #tripleo | 10:39 | |
mfedosin | review it please :) | 10:39 |
timeu | Hi everyone. I have a question regarding running "openstack overcloud deploy" from an ansible playbook. What is the best practice to wait/poll until the heat stack is finished? I am asking because the "openstack overcloud deploy" command exits immediately with a non zero exit code but I need to wait and check the result in order to run the next ansible tasks ? | 10:40 |
timeu | I checked the tripleo-quickstart playbooks (https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/tasks/main.yml) and there it seems that there is no special polling involved as if the "openstack overcloud deploy" command is synchronous/blocking | 10:41 |
mandre | mfedosin: yo! I'll do my best reviewing your patch - I'm no puppet expert :) | 10:43 |
shardy | timeu: Unless there's an error it should block printing event messages until the deploy is completed | 10:43 |
shardy | sounds like there was an error in this case? | 10:43 |
mfedosin | mandre: thank you very much! | 10:43 |
timeu | @shardy: hmm ok interesting. then I must have missed something. Will look into this again. Thanks ! | 10:43 |
*** shreshtha has quit IRC | 10:44 | |
*** shreshtha has joined #tripleo | 10:45 | |
*** etingof has quit IRC | 10:45 | |
jistr | bogdando: i rebased the undercloud resource registry refactoring chain, still keep WIP on root patch until dprince & Slower ack | 10:47 |
jistr | s/keep/kept/ | 10:47 |
*** salmankhan has joined #tripleo | 10:51 | |
*** dtantsur|afk is now known as dtantsur | 10:57 | |
*** dpawar_ has joined #tripleo | 10:59 | |
*** dpawar_ has quit IRC | 11:01 | |
*** dpawar_ has joined #tripleo | 11:02 | |
*** dpawar has quit IRC | 11:03 | |
openstackgerrit | Derek Higgins proposed openstack/tripleo-quickstart master: [WIP] Don't install Ironic in default overclouds https://review.openstack.org/509829 | 11:04 |
openstackgerrit | Derek Higgins proposed openstack/tripleo-quickstart-extras master: WIP: Setup Ironic in Overcloud https://review.openstack.org/509728 | 11:04 |
openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: WIP: Add ironic config to scenario 004 https://review.openstack.org/485261 | 11:05 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 11:10 |
*** rfolco has joined #tripleo | 11:11 | |
tbarron | bogdando: just read the backlog and would like to get a better understanding of your manila / openshift use case - I pm-ed you. | 11:11 |
*** janki has quit IRC | 11:13 | |
openstackgerrit | Marius Cornea proposed openstack/tripleo-upgrade master: WIP ffu: Introduce ffu upgrade tasks https://review.openstack.org/528241 | 11:14 |
*** fzdarsky has quit IRC | 11:15 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Split IPSEC deployment in two https://review.openstack.org/534729 | 11:18 |
*** dpawar_ has quit IRC | 11:28 | |
openstackgerrit | Merged openstack/tripleo-ipsec master: Add flag to configure VIPs https://review.openstack.org/534323 | 11:32 |
*** hasanq has joined #tripleo | 11:32 | |
*** udesale has quit IRC | 11:36 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: WIP: wire up queens upgrade workflow https://review.openstack.org/526006 | 11:36 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart master: Activate ipsec for ovb-ha https://review.openstack.org/534731 | 11:39 |
*** etingof has joined #tripleo | 11:40 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: [DNM] Major upgrade P->Q test. https://review.openstack.org/534732 | 11:41 |
sonali85 | Hi All. | 11:41 |
sonali85 | i wanted to know the manual process to confugure zookeper in cluster ? | 11:41 |
sonali85 | having 3 controller and all the controller zookeeper is installed | 11:41 |
sonali85 | how what will be the proceedure to to from zookeeper cluster | 11:42 |
sonali85 | ? | 11:42 |
*** absubram has joined #tripleo | 11:46 | |
*** mdnadeem has quit IRC | 11:46 | |
*** hewbrocca_afk is now known as hewbrocca | 11:47 | |
*** ratailor has quit IRC | 11:47 | |
*** holser__ has quit IRC | 11:49 | |
*** rhallisey has joined #tripleo | 11:53 | |
*** dpawar has joined #tripleo | 12:01 | |
chem | matbu marios: social jfrancoa holser ccamacho first time with a successful o->p upgrade!!! -> https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-containers-multinode-upgrades-pike/832/console | 12:05 |
jfrancoa | chem: finally! I think I'm going to cry...which patches did you use to run the job? | 12:07 |
*** jkilpatr has quit IRC | 12:07 | |
chem | jfrancoa: no patch -> https://review.openstack.org/#/c/532791/ :) | 12:07 |
ccamacho | \o/ | 12:08 |
ccamacho | chem++ | 12:08 |
*** pkovar has joined #tripleo | 12:09 | |
*** jkilpatr has joined #tripleo | 12:09 | |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 12:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743753 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
*** sshnaidm is now known as sshnaidm|afk | 12:11 | |
marios | fantastic chem | 12:11 |
*** salmankhan has quit IRC | 12:12 | |
chem | marios: if I didn't have ffu to move forward I would gladly turn my attention to master upgrade | 12:12 |
*** shardy is now known as shardy_lunch | 12:12 | |
*** pgadiya has quit IRC | 12:12 | |
chem | marios: I need to review all your patches about that sooner than later anyway. | 12:13 |
*** salmankhan has joined #tripleo | 12:14 | |
*** rcernin has quit IRC | 12:14 | |
matbu | chem: \o/ woot | 12:15 |
*** pgadiya has joined #tripleo | 12:15 | |
*** sshnaidm|afk has quit IRC | 12:16 | |
marios | chem: ack really i need the featureset landed first so we can land the job definition | 12:17 |
marios | chem: right now we can't even run it | 12:17 |
marios | chem: to see how broken it is :) | 12:17 |
*** akrivoka has joined #tripleo | 12:17 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Include common_deploy_steps_tasks.yaml https://review.openstack.org/534740 | 12:18 |
marios | chem: no worries i mean the workflow patches (client) still in review and base tht just landed so... now is the earliest we can have the job | 12:18 |
marios | well once the client patches land too | 12:18 |
chem | marios: now that I don't have to run the ocata->pike jobs I will make a test env on traas | 12:18 |
*** pgadiya has quit IRC | 12:21 | |
marios | chem: ++ thanks, i've been running it on rdo cloud ... having issues redeploying my second env there with exactly same params tho (keep getting not enough hosts available :/) | 12:24 |
jaosorior | marios: I had the same issue. They seem to be running over capacity :/ | 12:26 |
marios | jaosorior: thanks good to know | 12:29 |
*** pgadiya has joined #tripleo | 12:33 | |
*** dprince has joined #tripleo | 12:40 | |
openstackgerrit | Moshe Levi proposed openstack/tripleo-heat-templates master: Adding support for odl hw offloading in containers https://review.openstack.org/534622 | 12:43 |
*** rbrady has quit IRC | 12:45 | |
*** abishop has joined #tripleo | 12:45 | |
*** rbrady has joined #tripleo | 12:45 | |
*** rbrady has joined #tripleo | 12:45 | |
*** jlabarre has joined #tripleo | 12:45 | |
*** jpena is now known as jpena|lunch | 12:45 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Configure ODL Logging mechanism https://review.openstack.org/529496 | 12:48 |
*** shreshtha has quit IRC | 12:48 | |
*** shreshtha has joined #tripleo | 12:48 | |
*** rbowen has joined #tripleo | 12:48 | |
openstackgerrit | Merged openstack/puppet-tripleo master: Fluentd: Transform path by service https://review.openstack.org/530780 | 12:51 |
*** verdurin_ is now known as verdurin | 12:51 | |
EmilienM | hi | 12:54 |
*** janki has joined #tripleo | 12:54 | |
*** sshnaidm|afk has joined #tripleo | 12:55 | |
*** sshnaidm|afk is now known as sshnaidm | 12:55 | |
oidgar | EmilienM: hi, I have many timeout failures for some zuul gates in tripleo-heat-templates and tripleo-common. is there something we can do to improve this? | 12:56 |
oidgar | EmilienM: maybe reduce the number of gates running concurrently? (unless I'm the only one...) | 12:56 |
*** ykarel has quit IRC | 12:57 | |
oidgar | EmilienM: ok it looks like I'm not the only one, I see it in other patches. if there's something I can help with I'll be glad to take part | 12:58 |
chem | marios: so one thing I don't understand is why https://review.openstack.org/#/c/527454/ is name featureset_containerized_upgrade.yml instead of the usual featureset0XX ? | 12:59 |
*** ykarel has joined #tripleo | 13:00 | |
jaosorior | do we always deploy the redis VIP ? | 13:01 |
sonali85 | Hi all, i wanted to know the manual process to confugure zookeper in cluster ? | 13:02 |
sonali85 | having 3 controller and all the controller zookeeper is installed ? | 13:02 |
sonali85 | how what will be the proceedure to to from zookeeper cluster ? | 13:02 |
jaosorior | sonali85: you might want to check the zookeeper documentation. We currently don't deploy zookeeper in TripleO. | 13:03 |
sonali85 | yes you have told me this before . cant we try using manual steps ? | 13:04 |
*** pmannidi has joined #tripleo | 13:04 | |
EmilienM | oidgar: logs? | 13:04 |
jaosorior | sonali85: sure, you could try | 13:04 |
sonali85 | <jaosorior> actaully i have installed zookkeper on all the controller but after restarting zookeper service facing some issues | 13:06 |
oidgar | EmilienM: http://logs.openstack.org/95/508195/28/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/5206125/job-output.txt.gz#_2018-01-17_11_52_14_666796 | 13:06 |
sonali85 | 2018-01-17 13:06:00,753 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1037] - Closed socket connection for client /192.168.24.11:34600 (no session established for client) | 13:06 |
sonali85 | 2018-01-17 13:06:02,269 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /192.168.24.11:35798 | 13:06 |
sonali85 | 2018-01-17 13:06:02,269 [myid:1] - WARN [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@365] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not runn | 13:06 |
oidgar | EmilienM: this is the job that fails most of the times | 13:06 |
sonali85 | <jaosorior> i have followed following link to config zookeeper cluster https://www.thegeekstuff.com/2016/10/zookeeper-cluster-install/ | 13:07 |
jaosorior | sonali85: I don't use zookeeper; unfortunately I can't help you with that | 13:07 |
oidgar | EmilienM: I've noticed that when exit code is 143, it fails on timeout (http://logs.openstack.org/95/508195/28/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/5206125/job-output.txt.gz#_2018-01-17_11_43_06_736329) correct me if I'm wrong | 13:07 |
sonali85 | oh ok no problem :) | 13:07 |
*** adarazs is now known as adarazs_lunch | 13:08 | |
*** amoralej is now known as amoralej|lunch | 13:08 | |
sonali85 | is there any one who can help ? | 13:08 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743753 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 13:10 |
openstack | Launchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
EmilienM | oidgar: I'm in meeting the next 3h, I won't be helpful tbh | 13:11 |
oidgar | EmilienM: ok, I'll try in openstack-infra. | 13:11 |
arxcruz|rover | pradk: hi, around? the telemetry job started to fail again http://logs.openstack.org/07/472607/187/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/76f3db3/logs/tempest.html.gz | 13:12 |
EmilienM | oidgar: they won't help | 13:12 |
arxcruz|rover | pradk: and it has the alarm_granularity set to 60 | 13:12 |
EmilienM | I mean, it's probably some tripleo thing | 13:12 |
*** absubram has quit IRC | 13:12 | |
*** trown|outtypewww is now known as trown | 13:12 | |
oidgar | EmilienM: any other guy I can talk with to fix it? I don't want to disturb you | 13:13 |
*** pchavva has joined #tripleo | 13:13 | |
EmilienM | the timeout on https://review.openstack.org/#/c/472607/ is unlucky | 13:13 |
EmilienM | http://tripleo.org/cistatus.html | 13:13 |
*** tcw has joined #tripleo | 13:13 | |
EmilienM | a lot of green | 13:13 |
EmilienM | there is no gate issue atm, so we're good | 13:13 |
oidgar | EmilienM: ok thanks | 13:14 |
EmilienM | sshnaidm: can you help me to figure why https://review.openstack.org/#/c/528761/ has tripleo-ci-centos-7-3nodes-multinode which timeouts in log collection? | 13:14 |
marios | chem: sure we can change that np i just wanted to distinguish its purpose but yeah lets keep convention add comment please? | 13:16 |
*** shardy_lunch is now known as shardy | 13:16 | |
pradk | arxcruz|rover, hmm ok, I'll take a look after this call | 13:16 |
*** agopi has joined #tripleo | 13:17 | |
trown | sshnaidm: I think https://review.openstack.org/533795 is good to go, modulo my comments on PS6 | 13:18 |
openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo stable/pike: Enable automatic restart of memcached, apache and mongodb https://review.openstack.org/534394 | 13:19 |
openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo stable/ocata: Enable automatic restart of memcached, apache and mongodb https://review.openstack.org/534755 | 13:21 |
oidgar | jaosorior: hi, I wonder if you can assist or give me some advice about frequently timeouts in zuul gate (https://review.openstack.org/#/c/508195/ tripleo-ci-centos-7-ovb-ha-oooq) | 13:21 |
sshnaidm | EmilienM, seems like we calculated a timeout very close to one of zuul: http://logs.openstack.org/61/528761/24/check/tripleo-ci-centos-7-3nodes-multinode/f11e7bd/job-output.txt.gz#_2018-01-17_01_15_39_778836 | 13:22 |
EmilienM | sshnaidm: the error is persistent, I did recheck a bunch of times to see if it was random | 13:22 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-common master: Add more UndercloudCinder services to auto eval https://review.openstack.org/534756 | 13:23 |
sshnaidm | EmilienM, the other option - ansible is not stopped by timeout command | 13:23 |
sshnaidm | EmilienM, ok, I'll look into it, will try to understand what's wrong with timeout calculation | 13:23 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Containerize featureset032 (multinode-3nodes) https://review.openstack.org/532624 | 13:25 |
EmilienM | sshnaidm: thanks | 13:25 |
pradk | arxcruz|rover, meanwhile did you see if this is due to the same voluptuous issue we had yesterday? any errors you could spot so far? | 13:25 |
arxcruz|rover | pradk: it's taking 10 minutes the test, and it should take only 2, the settings are correct, I'm trying to bring an environment up to collect more data | 13:26 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download https://review.openstack.org/528761 | 13:26 |
EmilienM | chem++ nice work on upgrade job | 13:30 |
*** rlandy has joined #tripleo | 13:30 | |
chem | EmilienM: well, not just me, all the team really, jfrancoa in particular | 13:30 |
*** sonali85 has quit IRC | 13:30 | |
chem | EmilienM: didn't though it would take that much time though :) | 13:31 |
sshnaidm | trown, thanks, replied to comments there | 13:32 |
EmilienM | chem: nice | 13:34 |
jaosorior | EmilienM: are we testing swift at all in CI? | 13:35 |
*** moshele has quit IRC | 13:36 | |
EmilienM | jaosorior: yes | 13:36 |
EmilienM | jaosorior: tempest on scenario002 | 13:37 |
jaosorior | awesome | 13:37 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Support deploying extra nodes in te-broker https://review.openstack.org/512899 | 13:37 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Upgrade prettier https://review.openstack.org/534305 | 13:37 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update dependencies https://review.openstack.org/534759 | 13:37 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix tests and compilation after dependencies update https://review.openstack.org/534760 | 13:37 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix non urgent bugs caused by dependencies update https://review.openstack.org/534761 | 13:37 |
openstackgerrit | Thomas Herve proposed openstack/tripleo-heat-templates master: Introduce tests for yaql structures https://review.openstack.org/534762 | 13:37 |
therve | shardy, Interested in your feedback on ^^ if you have some time | 13:40 |
*** holser__ has joined #tripleo | 13:41 | |
therve | jaosorior, Why looking at experimental? :) | 13:41 |
weshay | chem, did you see my comment on https://review.openstack.org/#/c/525686/ | 13:41 |
jaosorior | therve: cause that's used by the TLS everywhere job :D | 13:41 |
trown | sshnaidm: I think my last comment there is correct... wrt sum of all tasks or max task, I think either works, so what you have is fine | 13:41 |
therve | Well | 13:41 |
therve | jaosorior, The idea is to be able to make changes there with more confidence, but sure :) | 13:42 |
chem | weshay: nope, looking | 13:42 |
chem | weshay: didn't like that file, but ok, I'll put it back | 13:43 |
EmilienM | jaosorior: have you seen my questions from yesterday about the 2 blueprints status? | 13:44 |
EmilienM | social: could you please read https://review.openstack.org/#/c/532516/ comments? | 13:45 |
EmilienM | jaosorior: asking status on https://blueprints.launchpad.net/tripleo/+spec/logging-stdout-rsyslog and https://blueprints.launchpad.net/tripleo/+spec/ipsec | 13:46 |
shardy | therve: I like it, but does it assume yaql is always in an OS::Heat::Value resource? | 13:46 |
jaosorior | EmilienM: I didn't | 13:46 |
*** pmannidi has quit IRC | 13:46 | |
*** liverpooler has joined #tripleo | 13:46 | |
shardy | therve: I assumed that was a workaround because heat didn't (doesn't?) validate outputs properly, and didn't store outputs until we switched to convergence | 13:46 |
therve | shardy, No it shouldn't be able to test anything | 13:47 |
*** dpawar has quit IRC | 13:47 | |
jaosorior | EmilienM: I won't be able to finish up what's left of logging-stdout-rsyslog for this milestone unfortunately | 13:47 |
*** anilvenkata has quit IRC | 13:47 | |
shardy | therve: Ok, I think most of the yaql stuff is referenced via value resources for performance reasons anyway but wanted to check | 13:47 |
EmilienM | jaosorior: can you please close it and create another blueprint for Rocky, and describe what's left to do? | 13:48 |
jaosorior | EmilienM: ipsec I will be able to finish. Missing to fix a bug (Redis not having a tunnel); and then I proposed this https://review.openstack.org/#/c/534731/ to test it upstream. | 13:48 |
*** jpena|lunch is now known as jpena | 13:48 | |
EmilienM | jaosorior: ack for ipsec | 13:48 |
therve | shardy, It might be a bit weird when we get to j2 stuff, but it should work if there is nothing inside the yaql itself | 13:48 |
jaosorior | EmilienM: will do | 13:48 |
shardy | therve: ack, I think it's straight yaql in most places so +1 | 13:48 |
shardy | therve: making it generic and test any intrinsic function (or combination thereof) would be cool ;) | 13:49 |
therve | shardy, Good point. It might not be very hard, do you have issues with other functions? | 13:49 |
EmilienM | jaosorior: send me the link when done, i'll make triage for Rocky | 13:50 |
shardy | therve: I was thinking of this one in particular https://github.com/openstack/tripleo-heat-templates/blob/master/network/ports/net_ip_list_map.j2.yaml#L80..L97 | 13:51 |
shardy | probably fairly well tested via functional CI tho | 13:51 |
therve | Ah yeah the map itself | 13:51 |
EmilienM | shardy: hey, I keep debugging the tripleo inventory issue I have when enabling config-download on 3nodes - I added some debug on the vars, but so far no problem on the vars yet, it looks like it happens when getting the host with _hosts function | 13:51 |
EmilienM | shardy: I'll keep you in touch, the logs timeouts now, sshnaidm is helping | 13:51 |
shardy | EmilienM: ah, is this using --static-yaml-inventory or the dynamic tripleo-ansible-inventory? | 13:52 |
shardy | EmilienM: I recall a warning re _hosts because (for some unknown reason) ansible expects two different yaml formats for static/yaml inventories | 13:53 |
* shardy grumbles about that stupid inconsistency | 13:53 | |
EmilienM | shardy: dynamic I believe | 13:53 |
EmilienM | shardy: let me show the debug in a sec | 13:53 |
shardy | EmilienM: Ok, that should work, but happy to look at logs when you have them and/or try to reproduce | 13:54 |
*** jmelvin has joined #tripleo | 13:54 | |
*** shreshtha has quit IRC | 13:55 | |
*** aputtur_ has joined #tripleo | 13:55 | |
*** Goneri has joined #tripleo | 13:56 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing. https://review.openstack.org/525686 | 13:56 |
*** pgadiya has quit IRC | 13:58 | |
openstackgerrit | Merged openstack/puppet-pacemaker master: Remove pinned versions from test-requirements.txt https://review.openstack.org/534101 | 13:59 |
*** tzumainn has joined #tripleo | 14:00 | |
openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: ffu: Add fast-forward-upgrade env https://review.openstack.org/522203 | 14:03 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743753 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 14:10 |
openstack | Launchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
trozet | Can I get another core reviewer on https://review.openstack.org/#/c/530967/ please? | 14:10 |
EmilienM | trozet: probably ask on #puppet-openstack | 14:11 |
shardy | Could I get another reviewer on https://review.openstack.org/#/c/533185/ please as I'm going to have to rebase that series again | 14:12 |
shardy | mandre or dprince ^^ container related, perhaps you could check it out? | 14:12 |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing. https://review.openstack.org/526000 | 14:13 |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Add support function for fast forward upgrade testing. https://review.openstack.org/526000 | 14:13 |
mandre | shardy: ouch nice bug | 14:14 |
*** almondjoy has joined #tripleo | 14:15 | |
shardy | mandre: yea, I didn't find it until I tried passing a roles-data to undercloud deploy disabling nearly all the services | 14:16 |
shardy | and they all kept running ;) | 14:16 |
shardy | https://review.openstack.org/#/c/534402/ is the related tripleoclient patch btw | 14:16 |
*** liverpooler has quit IRC | 14:17 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-docs master: WIP: FFU Developer docs https://review.openstack.org/526656 | 14:19 |
*** liverpooler has joined #tripleo | 14:19 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Append docker-ha.yaml conditionally. https://review.openstack.org/534770 | 14:23 |
*** dciabrin_ has joined #tripleo | 14:26 | |
mandre | shardy: the ansible in heat templates is really hard to read | 14:26 |
*** fzdarsky has joined #tripleo | 14:26 | |
*** dciabrin has quit IRC | 14:26 | |
*** amoralej|lunch is now known as amoralej | 14:28 | |
shardy | mandre: yeah I know, see the next patch in the series, it moves it to deploy-steps-playbook which removes all the ugly j2 quoting | 14:29 |
shardy | https://review.openstack.org/#/c/525260/12/common/deploy-steps-tasks.yaml | 14:29 |
shardy | e.g line 41, much better I think? | 14:30 |
shardy | mandre: that was blocked on converting undercloud deploy to the dynamic inventory but that's now done so should land soon, I hope | 14:30 |
mandre | shardy: absolutely, you read my mind... much better | 14:32 |
shardy | :) | 14:32 |
dprince | shardy: does that patch change our validations any? tools/yaml-validate.py? | 14:35 |
dprince | shardy: I guess not. its just how it is executed | 14:35 |
shardy | dprince: I don't think that validates the ansible playbook other than to prove it's parseable | 14:37 |
shardy | so no change I think | 14:37 |
jaosorior | shardy: the --config-download flag no longer uses the /usr/bin/tripleo-ansible-inventory right? | 14:38 |
shardy | dprince, mandre: after https://review.openstack.org/#/c/525260/ the only remaining thing in the heat template is writing docker-puppet.py, would you be OK if we moved that to tripleo-common? | 14:38 |
jaosorior | shardy: but it should get a very similar inventory from tripleo-common I guess | 14:38 |
shardy | it's a bit less hackable, but for development deploy artifacts could still be used | 14:39 |
shardy | jaosorior: I think it does, the script now calls TripleoInventory in tripleo-common though | 14:39 |
shardy | jaosorior: and the ini format --static-inventory is deprecated, replaced with the --static-yaml-inventory | 14:40 |
mandre | shardy: right, and I think docker-puppet doesn't need to change too much these days anyway | 14:40 |
shardy | ini format is a pain for list/map data | 14:40 |
shardy | mandre: yeah, it'd be a nice final cleanup to that heat template | 14:40 |
dprince | shardy: one other question. Does this cost us extra wall time? and if so how much | 14:40 |
jaosorior | shardy: what about the groups we used to have? where we could access nodes in the inventory via service groups. So, I could get the nodes that have pacemaker deployed with groups.pacemaker | 14:41 |
shardy | dprince: https://review.openstack.org/#/c/533185/ will take some extra time on update, as we'll actually stop the removed containers | 14:41 |
jaosorior | shardy: that doesn't seem to be available anymore | 14:41 |
dprince | shardy: what does moving docker-puppet.py into tripleo-common buy us? | 14:41 |
shardy | dprince: otherwise no change, e.g deploy for the same roles_data shouldn't take any longer | 14:41 |
dprince | shardy: ack on the wall time. seems good to me I think | 14:42 |
shardy | dprince: it means we can move to the --config-download workflow by default, as currently it's only written via heat (or the group_vars shim that uses heat-config) | 14:42 |
shardy | dprince: it's a cleanup, as pretty soon we'll want to remove all the heat driving ansible stuff from t-h-t | 14:42 |
shardy | not urgent if we need it tho | 14:42 |
*** jcoufal has joined #tripleo | 14:42 | |
*** dpawar has joined #tripleo | 14:43 | |
*** dhill_ has joined #tripleo | 14:43 | |
shardy | dprince: also it could be easier for debugging end-users, e.g we have a version vs an arbitrary possibly hacked up version of the script | 14:43 |
shardy | https://review.openstack.org/#/c/525260/12/common/deploy-steps.j2 | 14:44 |
shardy | dprince: if you see that, writing docker_puppet.py is all we do via heat (host_prep_tasks are already included directly in the config download generated playbooks) | 14:44 |
EmilienM | could I have some review on https://review.openstack.org/532624 and https://review.openstack.org/532623 | 14:44 |
dprince | shardy: it really is a matter of maintaining the interface. I supposed I still consider it a new thing at this point | 14:45 |
dprince | shardy: changing the interface is much easier if it lives in heat | 14:45 |
shardy | jaosorior: those groups should still be available, what command are you looking at? | 14:45 |
dprince | shardy: t-h-t rather | 14:45 |
*** adarazs_lunch is now known as adarazs | 14:45 | |
*** sshnaidm is now known as sshnaidm|mtg | 14:46 | |
jaosorior | shardy: so I tried the IPSEC deployment in CI (which I'm testing at the moment with /usr/bin/tripleo-ansible-inventory) and I get an issue regarding the group http://logs.openstack.org/31/534731/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/3f3f6c3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-01-17_13_57_40 | 14:46 |
shardy | dprince: Ok, it's not a huge issue but it's one of the barriers to getting to a pure ansible solution | 14:46 |
shardy | jaosorior: Ok does the inventory --list look wrong locally? | 14:47 |
jaosorior | shardy: locally I have no issues | 14:47 |
*** moshele has joined #tripleo | 14:48 | |
jaosorior | shardy: I'm deploying (and it's working), and --static-inventory gives the right values. | 14:48 |
dprince | shardy: sure, we'll also need to move the script that executes os-net-config | 14:48 |
shardy | jaosorior: yeah but that will break since we now add roles_data* to the inventory, you have to use --static-yaml-inventory | 14:48 |
shardy | or the dynamic one | 14:48 |
shardy | jaosorior: so if there's an issue here we'll have to figure it out | 14:48 |
jaosorior | let me try using the yaml one | 14:48 |
jaosorior | lets see | 14:48 |
shardy | dprince: yeah that's another one on the list | 14:48 |
*** fragatina has joined #tripleo | 14:49 | |
jaosorior | shardy: funky, the ipsec group is there | 14:49 |
shardy | Yeah I have a group per service locally too | 14:50 |
*** fragatina has quit IRC | 14:52 | |
*** fragatina has joined #tripleo | 14:52 | |
jaosorior | shardy: is the --config-download flag doing something different? I'm pretty sure "'dict object' has no attribute 'ipsec'" is because of the missing group :/ | 14:55 |
jaosorior | it's this task, https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/ipsec.yaml#L85 and this is the only occurence when It ry to fetch a key called 'ipsec' https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/ipsec.yaml#L93 | 14:56 |
shardy | jaosorior: there is some inconsistency in tripleo-common, some things used the --static-inventory flag, so I changed them to --static-yaml-inventory | 14:56 |
shardy | other things use the dynamic inventory, I've not traced the --config-download workflow through tho | 14:57 |
shardy | I normally download then run manually with the dynamic inventory | 14:57 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/openshift-master.yaml#L69 | 14:58 |
jaosorior | shardy: yeah, that's what I do as well | 14:58 |
shardy | jaosorior: yeah it looks the same | 14:59 |
jaosorior | funky :/ | 14:59 |
jaosorior | gotta go for an hour | 15:00 |
jaosorior | brb | 15:00 |
*** jaosorior has quit IRC | 15:00 | |
*** ansiwen has quit IRC | 15:03 | |
*** hasanq has quit IRC | 15:04 | |
*** ecerquei has joined #tripleo | 15:04 | |
*** ykarel is now known as ykarel|away | 15:04 | |
*** janki has left #tripleo | 15:06 | |
*** janki has joined #tripleo | 15:06 | |
*** ansiwen has joined #tripleo | 15:06 | |
*** ecerquei has quit IRC | 15:07 | |
*** itlinux has quit IRC | 15:07 | |
*** ecerquei has joined #tripleo | 15:08 | |
*** dpeacock has quit IRC | 15:09 | |
*** pi1 has joined #tripleo | 15:09 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 15:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743753 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
*** gfidente has quit IRC | 15:10 | |
*** links has quit IRC | 15:11 | |
*** pi1 has quit IRC | 15:11 | |
*** dpeacock has joined #tripleo | 15:12 | |
weshay | sshnaidm++ | 15:12 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Update dependencies https://review.openstack.org/534759 | 15:12 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix tests and compilation after dependencies update https://review.openstack.org/534760 | 15:12 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix non urgent bugs caused by dependencies update https://review.openstack.org/534761 | 15:12 |
*** dciabrin has joined #tripleo | 15:15 | |
*** gfidente has joined #tripleo | 15:16 | |
*** gfidente has quit IRC | 15:16 | |
*** gfidente has joined #tripleo | 15:16 | |
*** dciabrin_ has quit IRC | 15:16 | |
*** ykarel|away has quit IRC | 15:17 | |
*** absubram has joined #tripleo | 15:19 | |
dpeacock | "/bar toggle nicklist | 15:20 |
panda|ruck | anyone from mistral ? what does the deploy_step_playbook.yml exactly do ? how can it be used for debugging ? talking about the all the output after http://logs.openstack.org/97/534297/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/b1b9f26/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-01-17_11_07_24 | 15:20 |
weshay | toure, apetrich can I get some eyes on https://bugs.launchpad.net/tripleo/+bug/1742465 please | 15:22 |
openstack | Launchpad bug 1742465 in tripleo "periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-ocata is failing with Resource could not be found on mistral" [High,Triaged] | 15:22 |
apetrich | weshay, looking | 15:23 |
*** suuuper has quit IRC | 15:25 | |
*** aditya_r has joined #tripleo | 15:25 | |
*** kirankt has quit IRC | 15:28 | |
*** waleedm has quit IRC | 15:33 | |
*** ramishra has quit IRC | 15:33 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: Make sure we clean up yum metadata at the right moment. https://review.openstack.org/534360 | 15:37 |
toure | weshay sure | 15:46 |
openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates master: DNM: iscsid.socket workaround for traas https://review.openstack.org/534814 | 15:46 |
dpeacock | EmilienM: Is this merged successfully? I see workflow is -1, but there's a comment from zuul stating it's merged. I'm confused. | 15:46 |
dpeacock | https://review.openstack.org/#/c/532981/ < EmilienM | 15:46 |
weshay | toure, sync w/ apetrich as well.. he is looking too | 15:46 |
weshay | thanks! | 15:46 |
apetrich | toure, looks like heat got stuck. | 15:47 |
dpeacock | EmilienM: sorry, I meant code review -1 | 15:47 |
toure | apetrich yeah that is the first thing that jumped out | 15:47 |
apetrich | toure, the error is the usual stack.get that fails but after that there's a stack.create that never gets finished and the logs finish | 15:47 |
*** dhill_ has quit IRC | 15:48 | |
*** oidgar has quit IRC | 15:49 | |
*** jaosorior has joined #tripleo | 15:50 | |
*** chem has quit IRC | 15:51 | |
*** chem has joined #tripleo | 15:51 | |
*** dhill_ has joined #tripleo | 15:52 | |
jaosorior | shardy: do we log the ansible inventory somewhere in CI? | 15:52 |
toure | weshay is this host still up?? | 15:53 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Enable IPSEC tunnels for Redis VIP https://review.openstack.org/534816 | 15:53 |
thrash | weshay: that's not an issue. | 15:53 |
weshay | toure, no | 15:53 |
thrash | Those are "expected" errors. | 15:53 |
*** dsariel has quit IRC | 15:53 | |
thrash | weshay: If there was a problem, you'd see a failed workflow in the engine log. | 15:53 |
*** moshele has quit IRC | 15:54 | |
EmilienM | dpeacock: Change has been successfully merged by Zuul | 15:54 |
EmilienM | dpeacock: read last comment | 15:54 |
EmilienM | dpeacock: the -1 is from marios | 15:54 |
thrash | weshay: those errors are "probes", to check to see if things exist. | 15:54 |
EmilienM | but the code merged | 15:54 |
shardy | jaosorior: weshay had a patch which adds it, sec | 15:54 |
toure | weshay the reason I ask is I have seen this problem when a host doesn't have enough resources | 15:55 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Set permissions for openstack keyring on CephPools https://review.openstack.org/532785 | 15:55 |
dpeacock | EmilienM: I was confused - I guess my actual confusion is that I thought things needed two +2s | 15:55 |
*** timeu has quit IRC | 15:56 | |
apetrich | toure, thrash weshay the problem is that the mistral logs stop abruptly just after the stack.create reaches heat | 15:57 |
apetrich | no idea why | 15:57 |
*** itlinux has joined #tripleo | 15:58 | |
thrash | weshay: I will try with the reproducer script. | 16:00 |
gfidente | slagle https://review.openstack.org/#/c/533599/ ? :D | 16:01 |
rbrady | apetrich: were logs from any other services noticably blank around the same time? | 16:01 |
openstackgerrit | Avishay Machluf proposed openstack/tripleo-upgrade master: Update readme to include InfraRed installation command https://review.openstack.org/534820 | 16:03 |
apetrich | rbrady, nope they continue. last mistral log entry is at 2018-01-10 04:59:44.312 heat keeps going until 2018-01-10 07:40:21.776 | 16:03 |
slagle | gfidente: https://review.openstack.org/#/c/533319/ :) | 16:03 |
*** itlinux_ has joined #tripleo | 16:04 | |
gfidente | slagle I thought that merged already | 16:04 |
gfidente | sprry | 16:04 |
thrash | apetrich: weshay toure rbrady https://logs.rdoproject.org/openstack-periodic-24hr/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset002-ocata-upload/cf06cc1/undercloud/var/log/extra/errors.txt.gz#_2018-01-10_05_00_41_323 | 16:05 |
shardy | dprince, mandre: are you Ok to approve https://review.openstack.org/#/c/533185/ or is further discussion required? | 16:05 |
thrash | doesn't that seem to be a bigger problem? | 16:05 |
gfidente | slagle ah indeed this is a different one, about hostnames | 16:05 |
shardy | I'm trying to avoid rebasing it again since CI is green | 16:05 |
apetrich | thrash, brilliant | 16:05 |
toure | thrash yeah i saw that | 16:05 |
thrash | Like I said before, the mistral errors are expected. | 16:06 |
toure | thrash I would agree | 16:06 |
apetrich | thrash, thanks. I've added that to the comments | 16:06 |
*** itlinux has quit IRC | 16:06 | |
weshay | thrash, my attempts with rdo-cloud in my personal tenant the last two days have been terrible.. unable to provision a stack :( | 16:06 |
thrash | weshay: ouch | 16:07 |
weshay | thrash, I may be able get you one in the ci-tentant | 16:07 |
thrash | weshay: I'm trying it now. | 16:07 |
*** atoth has joined #tripleo | 16:08 | |
thrash | weshay: It created my stack... | 16:08 |
weshay | huh | 16:08 |
weshay | lucky | 16:08 |
thrash | question is whether the provisioned hosts become available. | 16:08 |
thrash | *reachable | 16:09 |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743753 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 16:10 |
openstack | Launchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Fix the nova config file location https://review.openstack.org/534826 | 16:11 |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/pike: Enable automatic restart of memcached, apache and mongodb https://review.openstack.org/534394 | 16:11 |
*** janki has quit IRC | 16:12 | |
EmilienM | panda|ruck, weshay : please see my comment on https://bugs.launchpad.net/tripleo/+bug/1743753/comments/1 | 16:13 |
openstack | Launchpad bug 1743753 in tripleo "Featureset016 fails tempest validation in both master and pike , no ssh connection with instance" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:13 |
*** paramite has quit IRC | 16:13 | |
thrash | weshay: spoke too soon. It's just sitting at waiting for provisioned host. :/ | 16:15 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Fix the haproxy config file location https://review.openstack.org/534828 | 16:15 |
weshay | EmilienM, in | 16:16 |
EmilienM | panda|ruck, sshnaidm|mtg: see my comment on https://bugs.launchpad.net/tripleo/+bug/1743754/comments/1 | 16:16 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:16 |
sshnaidm|mtg | EmilienM, replied | 16:19 |
*** sshnaidm|mtg is now known as sshnaidm | 16:19 | |
chem | slagle: hey, sorry to interrupt, but we had some pretty good success on using traas for testing ci upgrade. We have a forked quite a bit to get all the needed functionality. We're planning on doing a proper pull request tomorrow. Would it be oki to make a big "clean" one or would you prefer multiple small one ? | 16:20 |
chem | slagle: by the way, thanks for the tool :) | 16:20 |
*** absubram has quit IRC | 16:21 | |
EmilienM | panda|ruck: thx | 16:21 |
slagle | chem: it depends on how big | 16:21 |
EmilienM | panda|ruck: https://bugs.launchpad.net/tripleo/+bug/1743753 updated (duplicate) | 16:21 |
openstack | Launchpad bug 1742936 in tripleo "duplicate for #1743753 TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 16:21 |
slagle | chem: the one PR right now, is like 50 commits, that's way too big | 16:21 |
slagle | chem: i tried to review it, but couldn't digest it all | 16:21 |
sshnaidm | trown, now when i think about it, sum looks better than max, I think I can fix it in following up patch | 16:21 |
slagle | chem: there were some reverts in there too | 16:22 |
slagle | chem: so i'd say, clean that up, and try to group related things as much as possible | 16:22 |
slagle | chem: but it doesn't have to be 1 PR per commit or anything. | 16:22 |
chem | slagle: ack, make sense. I'll refactor the commit tomorrow and send you digest pull request :) | 16:23 |
trown | sshnaidm: cool do you understand the other thing I was trying to explain? | 16:23 |
trown | sshnaidm: ie how we will never have any list elements left in DATA in the second loop? | 16:23 |
*** shardy has quit IRC | 16:23 | |
*** shardy has joined #tripleo | 16:25 | |
sshnaidm | trown, yeah, got it now | 16:28 |
sshnaidm | trown, didn't mention .get there, also need to be fixed | 16:28 |
dprince | shardy: yes, approve it. I assumed you would send it once CI passed | 16:28 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: Add fast_forward_upgrade_tasks for ceilometer services https://review.openstack.org/533729 | 16:29 |
shardy | dprince: ack thanks, just wanted to confirm | 16:30 |
*** moshele has joined #tripleo | 16:32 | |
Slower | jistr: which patch is that? | 16:34 |
*** marios has quit IRC | 16:40 | |
*** dparkes has quit IRC | 16:42 | |
jistr | Slower: these 3 patches https://review.openstack.org/526088 and these 2 https://review.openstack.org/526337 | 16:42 |
jistr | all 5 should go somewhat together ideally | 16:42 |
jistr | cc dprince ^ | 16:43 |
jistr | the question is whether we should unblock those now or wait a bit more still | 16:43 |
*** ukalifon has quit IRC | 16:44 | |
*** pcaruana has quit IRC | 16:46 | |
Slower | jistr: ok cool, will look them over | 16:47 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/pike: Add condition to create container images download script. https://review.openstack.org/534838 | 16:47 |
*** aufi has quit IRC | 16:48 | |
trozet | hey guys I just noticed in the docker service files there are a bunch of systemctl commands for the container upgrades. Are those just placeholders? I thought the containers we use dont support systemd | 16:51 |
shardy | trozet: I think they just stop and disable the service on baremetal? | 16:52 |
*** absubram has joined #tripleo | 16:52 | |
trozet | shardy: but then why are they in the docker service files they should just be in the regular puppet ones right? | 16:52 |
shardy | trozet: because on upgrade from baremetal to containers, those templates are enabled | 16:52 |
shardy | so we disable the baremetal services then start the containers | 16:53 |
trozet | shardy: ah | 16:53 |
trozet | shardy: thanks | 16:53 |
shardy | trozet: it's a subset of the logic in the puppet/* templates | 16:53 |
*** Goneri has quit IRC | 16:53 | |
trozet | shardy: yeah i didnt think about that scenario goign from bm -> docker | 16:53 |
shardy | trozet: yeah, they should just do nothing in the case where the env is already running containers | 16:54 |
jistr | Slower: thanks. Just let me know then if you want me to remove the WIP flag on the bottom tht patch, all others depend on it. | 16:55 |
*** rfolco is now known as rfolco_doctor | 16:56 | |
*** stendulker has quit IRC | 16:56 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Collect and send statistics to InfluxDB https://review.openstack.org/533795 | 16:57 |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Enable interfaces required for automatic migration pxe_ipmitool -> ipmi https://review.openstack.org/534842 | 16:57 |
*** timeu has joined #tripleo | 16:58 | |
*** anilvenkata has joined #tripleo | 17:00 | |
timeu | Hi everyone, we tried to delete an overcloud stack, but the state of the operation is "DELETE_FAILED". This is due to network connectivity issues with one compute node. Is there any way to force the deletion of the stack or what is the best way to recover from this situation ? | 17:00 |
shardy | timeu: if you fix the problem you can just run the delete command again | 17:02 |
*** fragatina has quit IRC | 17:03 | |
timeu | first we stopped the problematic baremetal node and then we cleared the uuid and set it to manage and back to available. When we try to delete the stack again it fails again. | 17:04 |
*** salmankhan has quit IRC | 17:04 | |
timeu | http://paste.openstack.org/show/646531/ | 17:05 |
timeu | this is the error from the heat-engine.log | 17:05 |
*** salmankhan has joined #tripleo | 17:05 | |
*** chlong has quit IRC | 17:06 | |
shardy | timeu: are you sure that's the error and not just the result of a timeout after the delete waited for a long time for the disabled compute node? | 17:08 |
shardy | timeu: do you have rhel registration enabled? | 17:08 |
timeu | yes | 17:08 |
timeu | we do | 17:08 |
shardy | timeu: There is a config that runs on delete to unregister the nodes, that's probably hanging until timeout if the node has been disabled out of band | 17:08 |
timeu | hmm makes sense | 17:09 |
timeu | this is the resource_list that failed: | Compute | f0b980d0-4d54-412b-8a0b-ede17a0fa293 | OS::Heat::ResourceGroup | DELETE_FAILED | 2018-01-17T14:35:09Z | | 17:10 |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 17:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
timeu | so as a workaround can we manually unregister the node in the RH portal ? | 17:10 |
timeu | and then try delete agian ? | 17:10 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/pre_deploy/rhel-registration/rhel-registration.yaml#L62 | 17:10 |
shardy | timeu: looks like there's a boolean, do you have that parameter set anywhere? | 17:11 |
*** honza has joined #tripleo | 17:11 | |
shardy | Hmm, actually that was only recently added, what version are you using? | 17:11 |
jpich | Is there a way to get a longer stacktrace output for errors when running "openstack overcloud upgrade"? I get an error due to a command that works fine when I run it manually, hoping a stack trace would provide additional hints ( http://paste.openstack.org/show/646530/ ). Not having much luck grepping through logs | 17:13 |
timeu | We deployed OSP11 and i looked but our yml file doesn't have the boolean flag at all | 17:13 |
timeu | does it try to unregister by default in the older versions ? | 17:14 |
shardy | timeu: ack, so you may need to manually signal the RhelUnregistrationDeployment that's hanging, assuming that's the problem | 17:14 |
shardy | timeu: yes | 17:14 |
openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Remove EOL for the step_config which break the inventory https://review.openstack.org/534844 | 17:14 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/stable/newton/extraconfig/pre_deploy/rhel-registration/rhel-registration.yaml#L139 | 17:14 |
*** rfolco_doctor is now known as rfolco | 17:15 | |
shardy | timeu: there's a heat CLI you can use heat resource-signal <nested stack id> RhelUnregistrationDeployment | 17:16 |
shardy | you'll need to find the nested stack ID containing the resource | 17:16 |
shardy | timeu: you can do that via e.g heat resource-list f0b980d0-4d54-412b-8a0b-ede17a0fa293 (ID of the resource group above) | 17:17 |
shardy | then resource-list for the individual group member that's stuck | 17:17 |
*** dtantsur is now known as dtantsur|afk | 17:18 | |
timeu | yes that was a good suggestion. | RHELUnregistrationDeployment | e87bc21b-f079-4d4f-a6d3-2bc66ff66899 | OS::Heat::SoftwareDeployment | DELETE_FAILED | 2018-01-17T13:17:15Z | overcloud-Compute-zth3ahchctyg-0-lw2jwmg6cry4-NodeExtraConfig-t5vc7dkkhabj | | 17:19 |
timeu | it seems that RHELUnregistrationDeployment failed | 17:19 |
*** tesseract has quit IRC | 17:21 | |
shardy | timeu: ack, I'd guess it waited a long time then eventually timed out? | 17:23 |
*** oidgar has joined #tripleo | 17:25 | |
timeu | yes it always times out, but as a result the deletion also ends up in DELETE_FAILED | 17:26 |
timeu | the problem now is how to signal the resource | 17:26 |
shardy | timeu: see my comment above re heat resource-signal | 17:26 |
timeu | heat resource-signal ac3bde6f-cf81-4d0f-b9dd-5bfef80815fe RhelUnregistrationDeployment | 17:26 |
timeu | but it complains that Stack or resource not found: ac3bde6f-cf81-4d0f-b9dd-5bfef80815fe RhelUnregistrationDeployment | 17:27 |
shardy | timeu: I'd double check you have the right ID via heat resource-list ac3bde6f-cf81-4d0f-b9dd-5bfef80815fe | 17:29 |
timeu | If id o this I get: | 17:30 |
timeu | http://paste.openstack.org/show/646534/ | 17:30 |
*** mounds has joined #tripleo | 17:31 | |
shardy | timeu: IIRC you have to signal it while it's in-progress, have you restarted the delete? | 17:31 |
timeu | I used the physical_stack_id and ran heat resource-signal e87bc21b-f079-4d4f-a6d3-2bc66ff66899 RhelUnregistrationDeployment | 17:31 |
timeu | no | 17:31 |
timeu | ok | 17:31 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Reduce race condition with timeout for ansible run https://review.openstack.org/534846 | 17:31 |
sshnaidm | EmilienM, ^^ | 17:32 |
timeu | ok will try | 17:32 |
*** moshele has quit IRC | 17:32 | |
EmilienM | sshnaidm: thanks | 17:32 |
shardy | afk bbaib | 17:32 |
sshnaidm | EmilienM, please depend on this patch, should solve logs problem | 17:32 |
*** shardy is now known as shardy_afk | 17:32 | |
*** jfrancoa has quit IRC | 17:32 | |
*** almondjoy has quit IRC | 17:34 | |
*** jpich has quit IRC | 17:34 | |
EmilienM | sshnaidm: but it's for OVB only right? | 17:34 |
*** oidgar has quit IRC | 17:34 | |
EmilienM | ah no | 17:35 |
EmilienM | sorry I misread | 17:35 |
sshnaidm | EmilienM, for multinode | 17:35 |
*** jpich has joined #tripleo | 17:35 | |
EmilienM | yeah | 17:35 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs032: activate config-download https://review.openstack.org/528761 | 17:35 |
*** beagles is now known as beagles_afk | 17:35 | |
EmilienM | done | 17:35 |
panda|ruck | EmilienM: not been able to doo too much bisect on https://bugs.launchpad.net/tripleo/+bug/1742936, first occurrance is from 10th | 17:36 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 17:36 |
panda|ruck | next step would be to make a diff, not sure if I'll have time today. | 17:37 |
*** gkadam has quit IRC | 17:37 | |
*** florianf has quit IRC | 17:37 | |
*** jpich has quit IRC | 17:40 | |
EmilienM | panda|ruck: ok, I can take over. Maybe wrap up some notes in the bug report, i'll look later today | 17:40 |
EmilienM | panda|ruck: but I want to see what changed in OpenStack after January 10th | 17:40 |
*** gvrangan has joined #tripleo | 17:44 | |
*** ebarrera has quit IRC | 17:51 | |
*** fragatina has joined #tripleo | 17:52 | |
*** aditya_ra has joined #tripleo | 17:52 | |
openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo stable/ocata: Enable automatic restart of memcached, apache and mongodb https://review.openstack.org/534755 | 17:53 |
*** fragatin_ has joined #tripleo | 17:53 | |
*** fragatina has quit IRC | 17:54 | |
*** aditya_ra has quit IRC | 17:54 | |
*** aditya_ra has joined #tripleo | 17:54 | |
jtomasek | honza: hi, I have split the prettier update patch into 2 - 1 for just the dep update and one for code update | 17:55 |
*** aditya_r has quit IRC | 17:55 | |
jtomasek | honza: I am wanted to send it once the original prettier patch passes | 17:55 |
jtomasek | honza: are you ok with that? | 17:55 |
*** derekh has quit IRC | 18:00 | |
*** dpawar has quit IRC | 18:01 | |
*** dbecker has quit IRC | 18:02 | |
*** holser__ has quit IRC | 18:03 | |
*** Goneri has joined #tripleo | 18:04 | |
*** trown has quit IRC | 18:06 | |
*** yprokule has quit IRC | 18:08 | |
itlinux_ | hello all.. | 18:09 |
*** itlinux_ has quit IRC | 18:10 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 18:10 |
*** shardy_afk has quit IRC | 18:10 | |
*** itlinux has joined #tripleo | 18:10 | |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
*** moshele has joined #tripleo | 18:10 | |
openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud stable/pike: [pike] Handle utf-8 when running python commands https://review.openstack.org/534868 | 18:11 |
EmilienM | therve: can you please review ^ ? | 18:11 |
EmilienM | thrash: context is https://bugzilla.redhat.com/show_bug.cgi?id=1535399 | 18:13 |
openstack | bugzilla.redhat.com bug 1535399 in instack-undercloud "openstack undercloud upgrade fails when using a wrong locale (UnicodeEncodeError: 'ascii' codec can't encode character ...)" [High,On_dev] - Assigned to emacchi | 18:13 |
EmilienM | tamn | 18:13 |
EmilienM | therve: ^ sorry thrash | 18:13 |
*** mcornea has quit IRC | 18:13 | |
*** bogdando has quit IRC | 18:13 | |
*** dsneddon has joined #tripleo | 18:13 | |
thrash | EmilienM: :D | 18:14 |
*** gfidente has quit IRC | 18:14 | |
EmilienM | thrash: please change your nickname for me | 18:14 |
itlinux | hello all I wonder if there is a plan to add the fwaas puppet, yaml option to be pushed. I opened a ticket and mwhahaha helped on that aspect. | 18:14 |
EmilienM | thrash: like ___thrash - I'm sure I won't do the mistake again | 18:14 |
EmilienM | itlinux: which ticket? | 18:14 |
itlinux | let me bring it up | 18:15 |
itlinux | https://bugzilla.redhat.com/show_bug.cgi?id=1511174 | 18:16 |
openstack | bugzilla.redhat.com bug 1511174 in openstack-tripleo-heat-templates "[RFE] Option to enable FWaaS in TripleO" [Unspecified,New] - Assigned to emacchi | 18:16 |
itlinux | thanks EmilienM: | 18:17 |
*** jpena is now known as jpena|off | 18:17 | |
itlinux | looks like it's assigned to you :) | 18:17 |
*** hewbrocca is now known as hewbrocca_afk | 18:18 | |
EmilienM | itlinux: because I'm the default assignee for this progrect | 18:19 |
EmilienM | I would ask beagles_afk on this one | 18:19 |
EmilienM | coz I dunno | 18:19 |
itlinux | ahh ok thanks.. | 18:19 |
*** timeu has quit IRC | 18:19 | |
itlinux | super.. thanks | 18:19 |
itlinux | hello beagles_afk: are you around? | 18:19 |
*** chem has quit IRC | 18:19 | |
*** dsariel has joined #tripleo | 18:19 | |
*** timeu has joined #tripleo | 18:20 | |
timeu | we managed to fix out issue using this solution: https://access.redhat.com/solutions/2260561 | 18:21 |
timeu | thanks for the pointers and help | 18:21 |
*** timeu has quit IRC | 18:21 | |
*** moshele has quit IRC | 18:22 | |
*** aditya_ra has quit IRC | 18:28 | |
*** yamahata has quit IRC | 18:29 | |
openstackgerrit | Merged openstack/tripleo-ipsec master: Enable IPSEC tunnels for Redis VIP https://review.openstack.org/534816 | 18:37 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Passes NodeDataLookup to ceph-ansible workflow https://review.openstack.org/528757 | 18:39 |
openstackgerrit | Merged openstack/puppet-tripleo master: Prepare Queens milestone 3 https://review.openstack.org/534540 | 18:39 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Use ara generation from collect-logs role https://review.openstack.org/478549 | 18:39 |
openstackgerrit | Merged openstack/python-tripleoclient master: Add -r/--roles-file option to undercloud deploy https://review.openstack.org/534402 | 18:39 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Correct erroneous upgrade tasks. https://review.openstack.org/534714 | 18:39 |
openstackgerrit | Merged openstack/tripleo-upgrade master: Append docker-ha.yaml conditionally. https://review.openstack.org/534770 | 18:39 |
*** openstackstatus has quit IRC | 18:40 | |
*** openstackstatus has joined #tripleo | 18:43 | |
*** ChanServ sets mode: +v openstackstatus | 18:43 | |
*** karthiks has quit IRC | 18:46 | |
*** dsariel has quit IRC | 18:49 | |
thrash | poor EmilienM... Has to type 3 letters then tab. | 18:50 |
EmilienM | :P | 18:50 |
eggmaster | thrash: those keystrokes add up, man | 18:50 |
thrash | eggmaster: :D | 18:51 |
*** psachin has quit IRC | 18:52 | |
*** mounds is now known as almondjoy | 18:52 | |
*** cylopez has quit IRC | 18:53 | |
*** anilvenkata has quit IRC | 18:58 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Include common_deploy_steps_tasks.yaml https://review.openstack.org/534740 | 19:04 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Also pass blacklisted hostnames https://review.openstack.org/533319 | 19:04 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Default empty map for docker_config steps https://review.openstack.org/533185 | 19:04 |
*** yamahata has joined #tripleo | 19:06 | |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 19:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
*** karthiks has joined #tripleo | 19:10 | |
*** atoth has quit IRC | 19:12 | |
*** absubram has quit IRC | 19:18 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix tests and compilation after dependencies update https://review.openstack.org/534760 | 19:25 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix non urgent bugs caused by dependencies update https://review.openstack.org/534761 | 19:25 |
openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 19:26 |
*** gvrangan has quit IRC | 19:33 | |
*** dhill_ has quit IRC | 19:37 | |
*** trown has joined #tripleo | 19:38 | |
*** dhill_ has joined #tripleo | 19:39 | |
*** dhill_ has quit IRC | 19:39 | |
*** etingof has quit IRC | 19:42 | |
*** ykarel|away has joined #tripleo | 19:42 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Replace validate-ipmi by enabling tripleo-validations role https://review.openstack.org/533720 | 19:43 |
*** nyechiel_ has quit IRC | 19:43 | |
*** amoralej is now known as amoralej|off | 19:46 | |
openstackgerrit | Tom Barron proposed openstack/puppet-tripleo master: Resolve redefinition issue for ganesha VIP https://review.openstack.org/534892 | 19:46 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: DNM: test influxdb sending https://review.openstack.org/534218 | 19:49 |
*** athomas has quit IRC | 19:52 | |
*** holser__ has joined #tripleo | 19:57 | |
*** ykarel|away has quit IRC | 19:58 | |
EmilienM | stevebaker: good morning :) | 20:01 |
openstackgerrit | Merged openstack/tripleo-docs master: Call "openstack overcloud container image" only once https://review.openstack.org/528627 | 20:01 |
stevebaker | EmilienM: morning! | 20:04 |
*** moshele has joined #tripleo | 20:04 | |
*** dhill_ has joined #tripleo | 20:05 | |
*** nyechiel_ has joined #tripleo | 20:06 | |
*** cshastri has quit IRC | 20:06 | |
*** moshele has quit IRC | 20:08 | |
*** gkadam has joined #tripleo | 20:10 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 20:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Update HostnameFormatDefault for multinode-3nodes https://review.openstack.org/534895 | 20:10 |
*** paramite has joined #tripleo | 20:11 | |
*** nyechiel_ has quit IRC | 20:11 | |
honza | jtomasek: basically, everything is a lie and fake news | 20:11 |
jtomasek | honza: :D | 20:12 |
honza | jtomasek: upstream ci has been refactored quite a bit (split into three projects, now uses ansible), and now things are all different | 20:12 |
honza | :( | 20:12 |
honza | i'm staring at the logs, and what i see shouldn't happen | 20:13 |
honza | so yeah | 20:13 |
*** salmankhan has quit IRC | 20:13 | |
honza | jtomasek: it's running on ubuntu (ie no rpms), it runs npm install, but fails on thath cheerio bug... | 20:16 |
jtomasek | honza: so waiting for ui-deps 8-4 won't help anything | 20:17 |
honza | jtomasek: it appears so; you used to be able to go into the logs, and see all openstack rpms being installed... not anymore | 20:18 |
jtomasek | honza: so it seems like we're running wrong CI job isn't it so? | 20:18 |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo master: Adds TLS support for OpenDaylight https://review.openstack.org/531003 | 20:18 |
*** rmascena has joined #tripleo | 20:19 | |
honza | jtomasek: it seems that during the rewrite to ansible, the javascript jobs must have been simplified and made more general | 20:19 |
honza | basically just npm install && npm run test | 20:20 |
*** raildo has quit IRC | 20:21 | |
jtomasek | honza: yeah, and it fails when it tries to compile the code with webpack | 20:25 |
jtomasek | honza: it would be good to explore node_modules on that machine | 20:26 |
honza | jtomasek: i am doing some git archeology in project-config to see what happened | 20:26 |
jtomasek | honza: how did we manage to resolve that cheerio problem originally? | 20:28 |
honza | jtomasek: that appeared to be caused by an upgrade of npm to 5 in rdo ci so we reverted back to 3.10 | 20:29 |
*** fragatin_ has quit IRC | 20:29 | |
jtomasek | honza: yeah, that's why we haven't been hitting that in CI, and now we do | 20:29 |
jtomasek | for some reason | 20:29 |
jtomasek | (for some different reason) | 20:30 |
*** fragatina has joined #tripleo | 20:30 | |
*** fragatina has quit IRC | 20:31 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/533958 | 20:31 |
*** fragatina has joined #tripleo | 20:31 | |
*** dprince has quit IRC | 20:31 | |
*** fragatin_ has joined #tripleo | 20:34 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/instack master: Updated from global requirements https://review.openstack.org/534930 | 20:34 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/533962 | 20:35 |
*** fragatina has quit IRC | 20:35 | |
*** pkovar has quit IRC | 20:36 | |
*** fragatina has joined #tripleo | 20:36 | |
*** fragatina has quit IRC | 20:37 | |
*** fragatin_ has quit IRC | 20:37 | |
-openstackstatus- NOTICE: Zuul will be offline for a few minutes; existing changes will be re-enqueued; approvals during the downtime will need to be re-added. | 20:40 | |
*** dsariel has joined #tripleo | 20:41 | |
openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Adds SSL/TLS everywhere for OpenDaylight https://review.openstack.org/531026 | 20:41 |
EmilienM | weshay: wow I just discovered http://logs.openstack.org/44/534844/1/check/tripleo-ci-centos-7-containers-multinode/d909497/logs/undercloud/var/log/extra/dstat.html.gz | 20:41 |
*** fragatina has joined #tripleo | 20:42 | |
EmilienM | weshay: but we don't have it on the overcloud :( http://logs.openstack.org/44/534844/1/check/tripleo-ci-centos-7-containers-multinode/d909497/logs/subnode-2/var/log/extra/ | 20:42 |
EmilienM | because it's part of validate-tempest/tasks/stackviz.yml in tqe probably | 20:43 |
EmilienM | arxcruz|rover, sshnaidm : it would be awesome to have dstat out of stackviz tasks | 20:43 |
EmilienM | so we could run it on the overcloud during collect-logs maybe | 20:43 |
sshnaidm | EmilienM, during collect-logs? why? | 20:44 |
EmilienM | sshnaidm: or before | 20:44 |
EmilienM | sshnaidm: but having it for the overcloud would be great imho | 20:44 |
bnemec | EmilienM: Doesn't dstat have to to be running the entire time? | 20:44 |
EmilienM | bnemec: on the undercloud AFIK | 20:44 |
sshnaidm | EmilienM, if it runs a few mins it doesn't have too value | 20:45 |
bnemec | EmilienM: But if you want stats on the overcloud you'd have to start it after the nodes come up so it can collect data. | 20:45 |
sshnaidm | EmilienM, it would be great to have it running from the start of deployment | 20:45 |
bnemec | A dstat overcloud service might be useful. | 20:45 |
EmilienM | yeah | 20:45 |
EmilienM | ++ | 20:45 |
*** fragatina has quit IRC | 20:47 | |
*** ffiore has joined #tripleo | 20:50 | |
*** rmascena has quit IRC | 20:51 | |
*** dhill_ has quit IRC | 21:01 | |
*** dhill_ has joined #tripleo | 21:02 | |
openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo stable/newton: Enable automatic restart of memcached, apache and mongodb https://review.openstack.org/534951 | 21:05 |
arxcruz|rover | EmilienM: it runs before stackviz task, stackviz only checks if there's the data, if so, it adds on the report, otherwise, it skips | 21:06 |
honza | jtomasek: the jobs that use RPMs went away during v2=>v3 upgrade, cf https://review.openstack.org/#/c/526430/12 | 21:09 |
*** rfolco has quit IRC | 21:09 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 21:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 21:10 |
openstackgerrit | Ben Nemec proposed openstack/puppet-tripleo master: Add support for Designate https://review.openstack.org/518983 | 21:19 |
openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Designate Integration https://review.openstack.org/518998 | 21:20 |
*** rfolco has joined #tripleo | 21:22 | |
*** apevec has joined #tripleo | 21:25 | |
apevec | EmilienM, panda|ruck - is https://bugs.launchpad.net/tripleo/+bug/1743754 Pike only and what does it mean we can | 21:25 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 21:25 |
apevec | 't fetch logs from OC ? | 21:25 |
honza | jtomasek: npm is such a pile of garbage https://github.com/npm/npm/issues/16938 | 21:25 |
apevec | other jobs do have OC logs don't they | 21:26 |
jtomasek | honza: ah, saw that happen today too | 21:27 |
honza | and now i'm getting that less build error again, ugh | 21:27 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: [DNM] CI Test https://review.openstack.org/534954 | 21:27 |
jtomasek | honza: ^ I've created this to see if removing favicon plugin solves the problem | 21:28 |
honza | :D | 21:28 |
honza | ok | 21:28 |
*** salmankhan has joined #tripleo | 21:28 | |
honza | jtomasek: let's see if rm -rf fixes things :) | 21:28 |
jtomasek | honza: less build problem is fine (if you get it with my dependencies patch) | 21:29 |
honza | jtomasek: no, my prettier patch | 21:29 |
jtomasek | honza: that means that patternfly has been updated to newer version | 21:29 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Upgrade prettier https://review.openstack.org/534305 | 21:30 |
honza | yep | 21:30 |
jtomasek | honza: new ci jobs seem to support yarn:) | 21:32 |
honza | jtomasek: i'm reverting your sha update because afaict earlier patchsets passed ci | 21:32 |
honza | jtomasek: is yarn really that much better? | 21:33 |
honza | jtomasek: i am 100% on board if we can avoid the above nonsense | 21:33 |
honza | but something tells me that's just wishful thinking | 21:33 |
*** salmankhan has quit IRC | 21:33 | |
jtomasek | honza: dunno, but I suspect that the issue we're hitting is deffinitely caused by npm | 21:33 |
honza | jtomasek: just to confirm: are you using node 8.9.4 and npm 5.6.0 on your computer? | 21:34 |
honza | (that's what ci has) | 21:34 |
honza | "as of npm5, the npm cache self-heals..." BA HA HA HA | 21:35 |
jtomasek | honza: yes | 21:36 |
apevec | honza, jtomasek - don't tell me nodejs/npm we just pushed is not good | 21:40 |
*** pchavva has quit IRC | 21:40 | |
apevec | I've rechecked https://review.openstack.org/532550 to test it | 21:40 |
jtomasek | apevec: no, we are finding out that CI jobs we run in tripleo-ui does not use tripleo-ui-deps package at all | 21:41 |
apevec | ouch | 21:41 |
apevec | https://trunk.rdoproject.org/centos7-master/deps/el7/x86_64/openstack-tripleo-ui-deps-8-4.el7.x86_64.rpm what I pushed was build with npm 5.x | 21:41 |
*** paramite has quit IRC | 21:43 | |
jtomasek | apevec: apparently at the beginning of the cycle during ci refactoring the old jobs were replaced by generic jobs which currently run on ubuntu | 21:43 |
*** threestrands_ has joined #tripleo | 21:44 | |
*** threestrands_ has quit IRC | 21:45 | |
*** threestrands_ has joined #tripleo | 21:45 | |
*** dsneddon has quit IRC | 21:54 | |
*** holser__ has quit IRC | 21:55 | |
apevec | jtomasek, zuul v3 migration or something else? | 21:55 |
jtomasek | apevec: yes, that | 21:55 |
EmilienM | apevec: I don't know | 21:56 |
*** dparkes has joined #tripleo | 21:57 | |
apevec | EmilienM, and I know less than that :) | 21:58 |
apevec | weshay, ^ looks like we're past tipping point, accumulating new untriaged issue faster than resolving old ones :( | 21:59 |
*** rbowen has quit IRC | 21:59 | |
apevec | panda|ruck, "cliff subcommand returns error" - why is that relevant? | 21:59 |
weshay | apevec, BAHHHHH... having trouble getting my recreate to reproduce the same error in ci atm | 21:59 |
apevec | cliff is just CLI toolkit... | 21:59 |
weshay | my overcloud keeps failing to deploy | 22:00 |
apevec | fun...not | 22:00 |
apevec | weshay, maybe https://bugs.launchpad.net/tripleo/+bug/1743754 ? | 22:00 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 22:00 |
apevec | weshay, btw in that one, EmilienM asked for OC logs, why we don't have them? | 22:01 |
weshay | apevec, I don't think so I should be using the exact hash used in the promtion job | 22:01 |
*** trown is now known as trown|outtypewww | 22:01 | |
apevec | weshay, that would mean it fixed itself in later hash? | 22:01 |
weshay | apevec, I've noticed some jobs lately don't have the overcloud logs or undercloud.. when I look at the collect logs .. log the nodes are unreachable at that moment | 22:01 |
apevec | a-ha that's what Sagi said | 22:02 |
*** rcernin has joined #tripleo | 22:02 | |
*** mounds has joined #tripleo | 22:04 | |
weshay | apevec, I think I have a bug on that issue | 22:05 |
* weshay looks | 22:05 | |
weshay | several jobs for that fs have the issue | 22:06 |
weshay | https://bugs.launchpad.net/tripleo/+bug/1742528 | 22:06 |
openstack | Launchpad bug 1742528 in tripleo "ovb jobs in rdo-cloud are not logging the overcloud nodes" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 22:06 |
*** almondjoy has quit IRC | 22:06 | |
weshay | ipv4 vs ipv6 issue | 22:06 |
*** nalmond has joined #tripleo | 22:07 | |
openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VNX Cinder Backend https://review.openstack.org/534612 | 22:07 |
weshay | although.. that is not the case for this job | 22:07 |
*** nalmond is now known as almondjoy | 22:08 | |
*** mounds has quit IRC | 22:09 | |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 22:10 |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 22:10 |
EmilienM | apevec, weshay : we need to bisect | 22:16 |
EmilienM | it's not fun but I don't see much other solution now | 22:16 |
*** itlinux has quit IRC | 22:17 | |
apevec | I agree, just how will do it? CI team will drown, we need some rotational help from the larger team | 22:22 |
apevec | weshay, I'm cleaning up redhat-openstack, I assume https://github.com/redhat-openstack/tripleo-quickstart can be removed, it has not activity since it moved to openstack/ | 22:22 |
apevec | but what is https://github.com/redhat-openstack/tripleo-quickstart-utils ?? | 22:23 |
*** fragatina has joined #tripleo | 22:23 | |
weshay | y | 22:23 |
weshay | thanks | 22:23 |
apevec | ok, I see from recent commits it's rasca's thing for internal, I'll check w/ him tomorrow | 22:24 |
apevec | hmm, forked from openstack/tripleo-quickstart-extras | 22:24 |
*** abishop has quit IRC | 22:25 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-quickstart-extras master: WIP: Add support for creating sub-CAs in FreeIPA role https://review.openstack.org/534960 | 22:25 |
apevec | weshay, what about redhat-openstack/khaleesi - archive it as R/O ? | 22:25 |
EmilienM | apevec: yeah afik he maintains this repo for things related to HA & fencing, iirc | 22:26 |
apevec | EmilienM, that's fine but why forking instead of separate add-on role | 22:28 |
*** gkadam has quit IRC | 22:29 | |
EmilienM | apevec: yeah I'm not sure | 22:30 |
*** liverpooler has quit IRC | 22:30 | |
apevec | nm, I'll grill rasca tomorrow :) | 22:32 |
*** apevec has quit IRC | 22:32 | |
*** dsneddon has joined #tripleo | 22:33 | |
Tengu | hmm, I like the "very green" :). greener than usual green then? :) | 22:34 |
*** ffiore has quit IRC | 22:44 | |
weshay | EmilienM, I'm working towards moving the HA work to be properly gated by tq/tqe and hopefully in the promotion pipeline | 22:51 |
weshay | at the tripleo layer | 22:51 |
EmilienM | weshay: hugh | 22:52 |
EmilienM | hug! | 22:52 |
*** ffiore has joined #tripleo | 22:53 | |
*** ffiore has quit IRC | 22:54 | |
*** jkilpatr has quit IRC | 22:54 | |
*** jmelvin has quit IRC | 22:56 | |
honza | jtomasek: i am now convinced that it has nothing to do with zuulv2=>v3 | 23:05 |
honza | jtomasek: the old legacy jobs also didn't use RPMs | 23:05 |
honza | jtomasek: We still need to care about RPMs though because of the undercloud jobs that jpich has been working on. | 23:05 |
jtomasek | honza: it means that we could rebuild ui-deps after we update everything rather do it several times | 23:08 |
jtomasek | honza: what do you think? | 23:08 |
honza | jtomasek: if we can figure out these mysterious errors... | 23:08 |
jtomasek | honza: btw. my patch which removes favicon plugin (and thus cheerio) passes | 23:09 |
*** dsneddon has quit IRC | 23:09 | |
honza | jtomasek: i saw that :( | 23:10 |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1742936 | 23:10 |
openstack | Launchpad bug 1742936 in tripleo "TestBootVolumePattern is failing in multinode jobs" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz) | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1743754 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1743754 in tripleo "Featureset022 fails to deploy on pike during .AllNodesDeploySteps.ControllerDeployment_Step1" [Critical,Triaged] | 23:10 |
honza | jtomasek: that project looks abandoned | 23:10 |
*** dparkes has quit IRC | 23:10 | |
jtomasek | honza: to move things forward, you could update your prettier patch with that change and we could resolve/re-add that as bug later | 23:10 |
honza | ha | 23:11 |
jtomasek | honza: alternatively I thought of doing another test with adding yarn.lock (to see if that would help) | 23:11 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] GPT partitioning support https://review.openstack.org/533490 | 23:11 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't fstrim vfat partitions https://review.openstack.org/534969 | 23:11 |
jtomasek | honza: there must be something specific about that CI machine/setup which causes it to fail since we are not able to reproduce the error locally | 23:13 |
honza | jtomasek: i'll create a bug that says that the webpack plugin needs to be replaced with something else, create a patch that removes it, and then rebase stuff on top of that | 23:13 |
honza | jtomasek: i just had an idea: maybe it's ubuntu: i'll try to run the build in a container :) | 23:13 |
jtomasek | honza: ok, sounds like a plan | 23:14 |
* honza giggles hypstericaly | 23:14 | |
* jtomasek -> off to bed (00:14 here) | 23:14 | |
honza | jtomasek: you're insane | 23:15 |
*** Goneri has quit IRC | 23:16 | |
*** etingof has joined #tripleo | 23:24 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Resolve CI issues https://review.openstack.org/534954 | 23:28 |
*** etingof has quit IRC | 23:35 | |
honza | jtomasek: you're not gonna believe this: i can reproduce the ci error on ubuntu (the same thing works fine on fedora) | 23:40 |
*** rlandy has quit IRC | 23:40 | |
*** moshele has joined #tripleo | 23:41 | |
*** dhill_ has quit IRC | 23:43 | |
*** almondjoy has quit IRC | 23:50 | |
*** pmannidi has joined #tripleo | 23:52 | |
*** etingof has joined #tripleo | 23:54 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!