| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add logs for config-download https://review.openstack.org/510709 | 00:04 |
|---|---|---|
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart-extras master: overcloud-deploy: add config-download + ansible run feature https://review.openstack.org/508306 | 00:06 |
| *** yamahata has quit IRC | 00:07 | |
| *** achadha_ has joined #tripleo | 00:08 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 00:10 |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| *** achadha has quit IRC | 00:12 | |
| *** achadha_ has quit IRC | 00:12 | |
| *** psahoo has joined #tripleo | 00:48 | |
| *** stendulker has joined #tripleo | 00:56 | |
| *** stendulker has quit IRC | 00:57 | |
| *** jkilpatr has quit IRC | 00:59 | |
| *** dmacpher has joined #tripleo | 01:04 | |
| *** thrash is now known as thrash|g0ne | 01:04 | |
| *** catintheroof has quit IRC | 01:09 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 01:10 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Take wwn_with_extension into account, when configuring a boot device https://review.openstack.org/510583 | 01:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Special treatment for os-net-config upgrade. https://review.openstack.org/510577 | 01:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: List all unhealthy containers https://review.openstack.org/510554 | 01:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Create mysql user for non-ha deployments https://review.openstack.org/510550 | 01:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Fix cold/live migration network config https://review.openstack.org/510536 | 01:12 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Allow to override HAProxy global options. https://review.openstack.org/510283 | 01:13 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Make containerized galera use mysql_network everywhere https://review.openstack.org/510303 | 01:13 |
| EmilienM | slagle: ok | 01:25 |
| *** psachin has joined #tripleo | 01:26 | |
| *** dbecker has joined #tripleo | 01:31 | |
| EmilienM | slagle: testing it right now | 01:34 |
| *** dbecker has quit IRC | 01:38 | |
| *** ecerquei__ has joined #tripleo | 01:40 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/pike: Add logging to capabilities filter https://review.openstack.org/510662 | 01:52 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/pike: Bring the keystone utils up-to-date with Mistral https://review.openstack.org/510527 | 01:52 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add IronicPxe to the default controller https://review.openstack.org/507981 | 01:53 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Add IronicPxe to the default controller https://review.openstack.org/507981 | 01:54 |
| *** achadha has joined #tripleo | 02:03 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/ocata: Repair immediate VF configuration for PCI SR-IOV https://review.openstack.org/498200 | 02:08 |
| *** achadha has quit IRC | 02:08 | |
| EmilienM | slagle: oooq / oooq-extras checkout works fine | 02:09 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 02:10 |
| *** achadha has joined #tripleo | 02:12 | |
| *** achadha has quit IRC | 02:12 | |
| *** achadha has joined #tripleo | 02:12 | |
| *** ecerquei__ has quit IRC | 02:17 | |
| *** tzumainn has quit IRC | 02:22 | |
| *** achadha_ has joined #tripleo | 02:23 | |
| *** tongl has joined #tripleo | 02:24 | |
| *** fpan has quit IRC | 02:25 | |
| *** achadha has quit IRC | 02:26 | |
| *** achadha_ has quit IRC | 02:28 | |
| *** achadha has joined #tripleo | 02:34 | |
| EmilienM | slagle: zuul_changes work perfectly fine :) | 02:36 |
| EmilienM | slagle: nice!!! | 02:36 |
| *** achadha_ has joined #tripleo | 02:39 | |
| *** Shatadru|Gone is now known as Shatadru|coffee| | 02:39 | |
| *** rwsu has quit IRC | 02:40 | |
| *** achadha_ has quit IRC | 02:40 | |
| *** achadha_ has joined #tripleo | 02:41 | |
| *** achadha has quit IRC | 02:42 | |
| *** links has joined #tripleo | 02:44 | |
| *** pkovar has quit IRC | 02:50 | |
| *** noslzzp has quit IRC | 02:54 | |
| *** catintheroof has joined #tripleo | 02:57 | |
| *** catintheroof has quit IRC | 03:06 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 03:10 |
| *** bobh has joined #tripleo | 03:10 | |
| *** fpan has joined #tripleo | 03:11 | |
| *** bobh has quit IRC | 03:20 | |
| *** fzdarsky has quit IRC | 03:24 | |
| *** gbarros has joined #tripleo | 03:26 | |
| *** Shatadru|coffee| is now known as Shatadru | 03:29 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Fix cold/live migration network config https://review.openstack.org/510543 | 03:36 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: manila: set "host" to "hostgroup" https://review.openstack.org/508117 | 03:36 |
| *** Shatadru is now known as Shatadru|afk | 03:37 | |
| *** Shatadru|afk is now known as Shatadru | 03:38 | |
| *** Shatadru is now known as Shatadru|mtg | 03:38 | |
| *** Shatadru|mtg is now known as Shatadru | 03:38 | |
| *** mdnadeem has joined #tripleo | 03:41 | |
| *** gbarros_ has joined #tripleo | 03:47 | |
| *** gbarros has quit IRC | 03:48 | |
| *** pdeore has joined #tripleo | 03:51 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Default Ceph pg_num and pgp_num to 128 https://review.openstack.org/507779 | 03:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Decouple Swift ringbuilding logic https://review.openstack.org/503818 | 03:52 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Allow removing of options from tempest conf https://review.openstack.org/477079 | 03:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 03:53 |
| *** gbarros_ has quit IRC | 03:54 | |
| *** gbarros has joined #tripleo | 03:55 | |
| *** jaosorior has joined #tripleo | 04:00 | |
| *** ykarel has joined #tripleo | 04:00 | |
| *** etingof has quit IRC | 04:00 | |
| *** gkadam has joined #tripleo | 04:01 | |
| *** etingof has joined #tripleo | 04:08 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 04:10 |
| *** daidv has joined #tripleo | 04:21 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Bump fs.inotify.max_user_instances for scale https://review.openstack.org/509514 | 04:21 |
| *** Shatadru is now known as Shatadru|afk | 04:21 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Fix cold/live migration network config https://review.openstack.org/510539 | 04:22 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add unit tests for fluentd profile https://review.openstack.org/505124 | 04:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Use conditional to set heat workers https://review.openstack.org/481232 | 04:27 |
| *** gbarros has quit IRC | 04:30 | |
| *** pcaruana has joined #tripleo | 04:32 | |
| jaosorior | stevebaker: still around? | 04:33 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Remove extra keystone admin haproxy listen and allow TLS https://review.openstack.org/494947 | 04:38 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Adds pacemaker update_tasks for Pike minor update workflow https://review.openstack.org/510408 | 04:38 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Fix Tenant network declaration https://review.openstack.org/506404 | 04:38 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Remove package if service stopped and disabled https://review.openstack.org/510545 | 04:38 |
| *** ratailor has joined #tripleo | 04:46 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/newton: Remove extra keystone admin haproxy listen and allow TLS https://review.openstack.org/510738 | 04:51 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Use sub_nodes_private instead of node_private https://review.openstack.org/509704 | 04:56 |
| *** ratailor_ has joined #tripleo | 04:57 | |
| *** udesale has joined #tripleo | 04:57 | |
| *** pcaruana has quit IRC | 04:58 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/pike: Release 7.4.2 https://review.openstack.org/510740 | 04:59 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/ocata: Release 6.5.3 https://review.openstack.org/510741 | 05:00 |
| *** ratailor has quit IRC | 05:00 | |
| *** rwsu has joined #tripleo | 05:00 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/newton: Release 5.6.4 https://review.openstack.org/510742 | 05:00 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/newton: Remove extra keystone admin haproxy listen and allow TLS https://review.openstack.org/510738 | 05:01 |
| *** Shatadru|afk is now known as Shatadru | 05:02 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ui stable/pike: Release 7.4.2 https://review.openstack.org/510743 | 05:02 |
| *** ratailor__ has joined #tripleo | 05:02 | |
| *** marios has joined #tripleo | 05:03 | |
| *** jtomasek has joined #tripleo | 05:04 | |
| EmilienM | jaosorior: thx for the unit tests | 05:05 |
| *** ratailor_ has quit IRC | 05:05 | |
| EmilienM | marios: is https://review.openstack.org/#/c/496223/ ready for review? | 05:06 |
| Tengu | EmilienM: thanks for the push of the reviews :) | 05:06 |
| EmilienM | cool | 05:06 |
| EmilienM | alright, see you tomorrow | 05:07 |
| Tengu | see you :) | 05:07 |
| jaosorior | EmilienM: have a good one | 05:07 |
| Tengu | jaosorior: hello :) | 05:07 |
| jaosorior | Tengu: sup, how's it going? | 05:07 |
| Tengu | I'm fine, but the deploy hits some weird issue right now. like, I'm getting "unknown reasons" for an error, that's just cool :) | 05:08 |
| jaosorior | Tengu: are you getting that from heat? | 05:08 |
| *** pmannidi has quit IRC | 05:08 | |
| Tengu | mistral, at least. I could grep the message in its logs. | 05:08 |
| Tengu | in ./mistral/executor.log and ./mistral/engine.log | 05:09 |
| jaosorior | and it says unkown error? | 05:09 |
| Tengu | I'm trying to find what returns that | 05:09 |
| jaosorior | Tengu: the best person to ask about mistral issues would be d0ugal | 05:09 |
| Tengu | it says: [overcloud-CephStorage-asca7lbd2o4s-1-zvo46o6aqz5e]: UPDATE_FAILED ResourceInError: resources.CephStorage: Went to status ERROR due to "Message: Unknown, Code: Unknown" | 05:09 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 05:10 |
| Tengu | right after that I get a message saying "Message: No valid host was found. There are not enough hosts available." | 05:10 |
| *** janki has joined #tripleo | 05:10 | |
| jaosorior | Tengu: that looks like a heat issue though | 05:10 |
| jaosorior | Tengu: check the heat engine logs | 05:10 |
| Tengu | possible. I really don't know, I just ran a grep on the logs. | 05:10 |
| Tengu | but right now I have to run, I have a direct on the radio -.-' | 05:10 |
| Tengu | I'll take that back either later this morning (7:11am here) or this afternoon | 05:11 |
| Tengu | I'll check the heat logs. | 05:11 |
| Tengu | see you! | 05:11 |
| *** ykarel is now known as ykarel|afk | 05:11 | |
| *** sayani0_0 has joined #tripleo | 05:11 | |
| *** sayani0_0 is now known as saayani | 05:12 | |
| *** saayani is now known as sayani0_0 | 05:12 | |
| *** sayani0_0 is now known as sayani | 05:12 | |
| *** sayani is now known as saaayani | 05:12 | |
| *** saaayani is now known as _sayani | 05:13 | |
| *** _sayani is now known as Saayani | 05:13 | |
| *** achadha has joined #tripleo | 05:14 | |
| *** Saayani is now known as sayani_0 | 05:14 | |
| *** mdnadeem has quit IRC | 05:14 | |
| *** skramaja has joined #tripleo | 05:15 | |
| *** sayani_0 is now known as sb0_0 | 05:15 | |
| *** sb0_0 is now known as sayani_b | 05:15 | |
| *** sayani_b is now known as sayani-b | 05:15 | |
| *** aditya_r has joined #tripleo | 05:17 | |
| *** achadha_ has quit IRC | 05:18 | |
| *** achadha has quit IRC | 05:18 | |
| *** yamahata has joined #tripleo | 05:19 | |
| marios | EmilienM: o/ checking | 05:21 |
| marios | EmilienM: yeah it should be i updated it yesterday for merge conflict | 05:21 |
| *** pmannidi has joined #tripleo | 05:25 | |
| *** jaosorior has quit IRC | 05:27 | |
| *** Shatadru is now known as Shatadru|Bomgar | 05:30 | |
| *** mdnadeem has joined #tripleo | 05:31 | |
| *** shreshtha has joined #tripleo | 05:32 | |
| *** shreshtha is now known as shreshtha|wfh | 05:34 | |
| *** cshastri has joined #tripleo | 05:35 | |
| *** salmankhan has joined #tripleo | 05:35 | |
| *** fzdarsky has joined #tripleo | 05:36 | |
| *** fzdarsky has quit IRC | 05:37 | |
| *** fzdarsky has joined #tripleo | 05:37 | |
| *** salmankhan has quit IRC | 05:40 | |
| *** nyechiel_ has joined #tripleo | 05:43 | |
| *** etingof has quit IRC | 05:43 | |
| *** dparkes has joined #tripleo | 05:47 | |
| *** jfrancoa has joined #tripleo | 05:49 | |
| *** pdeore_ has joined #tripleo | 05:49 | |
| *** pdeore has quit IRC | 05:49 | |
| *** pmannidi has quit IRC | 05:52 | |
| *** udesale__ has joined #tripleo | 05:55 | |
| *** udesale__ has quit IRC | 05:57 | |
| *** udesale__ has joined #tripleo | 05:57 | |
| *** udesale has quit IRC | 05:57 | |
| openstackgerrit | Numan Siddique proposed openstack/puppet-tripleo stable/pike: ovn HA: Enable ip_nonlocal_bind sysctl flag https://review.openstack.org/510754 | 05:58 |
| *** nmathew has joined #tripleo | 05:59 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 06:00 |
| *** jaosorior has joined #tripleo | 06:03 | |
| *** jrist has quit IRC | 06:03 | |
| *** yprokule has joined #tripleo | 06:04 | |
| *** mdnadeem has quit IRC | 06:05 | |
| *** pmannidi has joined #tripleo | 06:09 | |
| *** etingof has joined #tripleo | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 06:10 |
| *** Shatadru|Bomgar is now known as Shatadru | 06:12 | |
| *** jrist has joined #tripleo | 06:16 | |
| *** rlandy|bbl is now known as rlandy | 06:16 | |
| *** rlandy has quit IRC | 06:16 | |
| *** mdnadeem has joined #tripleo | 06:17 | |
| *** aditya_r has quit IRC | 06:18 | |
| *** aditya_r has joined #tripleo | 06:18 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-docs master: WIP: Add documentation for TripleO/RDO Pipelines https://review.openstack.org/510657 | 06:21 |
| *** spectr has joined #tripleo | 06:22 | |
| *** sshnaidm|off is now known as sshnaidm | 06:22 | |
| openstackgerrit | zenghui.shi proposed openstack/tripleo-heat-templates master: Add PTP composable service https://review.openstack.org/491317 | 06:24 |
| *** cylopez has joined #tripleo | 06:27 | |
| *** dmacpher has quit IRC | 06:27 | |
| *** sayani-b has quit IRC | 06:29 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-specs master: Add blueprint for Logging to stdout and rsyslog https://review.openstack.org/510001 | 06:30 |
| lvdombrkr | hello folks | 06:35 |
| *** cylopez has quit IRC | 06:35 | |
| lvdombrkr | who can help with dvr configuration? | 06:36 |
| *** sayani-b has joined #tripleo | 06:36 | |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Fix invalid /etc/hosts edit https://review.openstack.org/510664 | 06:37 |
| *** ykarel|afk is now known as ykarel | 06:38 | |
| lvdombrkr | beagles: hi | 06:41 |
| jaosorior | lvdombrkr: beagles is located in the US. So you'll need to wait some hours | 06:42 |
| jaosorior | sshnaidm: you around? | 06:42 |
| sshnaidm | jaosorior, yep | 06:43 |
| *** tongl has quit IRC | 06:43 | |
| lvdombrkr | jaosorior: thanks, i remember he was dvr expert ) | 06:43 |
| jaosorior | sshnaidm: how are logs collected currently? I see there's a collect-logs role in quickstart but I don't see where we would specify a list of stuff to collect. For instance, how is is the stuff in /var/log/containers collected? | 06:44 |
| jaosorior | lvdombrkr: yep, he's the best person to ask about it. | 06:44 |
| *** jprovazn has joined #tripleo | 06:45 | |
| *** nyechiel_ has quit IRC | 06:45 | |
| sshnaidm | jaosorior, we use separate logs configuration for tripleo-ci: https://github.com/openstack-infra/tripleo-ci/blob/437a1059ee65d009a9c7535cbfbc8c147865055a/toci-quickstart/config/collect-logs.yml | 06:46 |
| sshnaidm | jaosorior, but containers logs are handled in the role itself: https://github.com/openstack/tripleo-quickstart-extras/blob/300b892bb9d0ab1fc92da9bac5a335808282db9d/roles/collect-logs/tasks/collect.yml#L151 | 06:46 |
| jaosorior | sshnaidm: thanks | 06:48 |
| jaosorior | sshnaidm: do you happen to have a running environment? | 06:48 |
| *** ebarrera has joined #tripleo | 06:48 | |
| sshnaidm | jaosorior, yeah, but not containerized | 06:48 |
| jaosorior | ok | 06:49 |
| *** ebarrera has quit IRC | 06:49 | |
| *** ebarrera has joined #tripleo | 06:50 | |
| *** jlinkes has joined #tripleo | 06:50 | |
| *** aditya_r has quit IRC | 06:52 | |
| *** aditya_r has joined #tripleo | 06:53 | |
| *** rcernin has joined #tripleo | 06:58 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Update services in the process count validation https://review.openstack.org/502036 | 07:00 |
| *** jprovazn has quit IRC | 07:00 | |
| *** pcaruana has joined #tripleo | 07:04 | |
| *** jaosorior has quit IRC | 07:04 | |
| *** fragatina has joined #tripleo | 07:04 | |
| *** masco has joined #tripleo | 07:05 | |
| *** ykarel has quit IRC | 07:05 | |
| *** fzdarsky has quit IRC | 07:06 | |
| *** nmathew has quit IRC | 07:07 | |
| *** nmathew has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 07:10 |
| *** ykarel has joined #tripleo | 07:12 | |
| *** sid1 has joined #tripleo | 07:16 | |
| *** yamahata has quit IRC | 07:18 | |
| *** fragatina has quit IRC | 07:23 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP] logging: merge fluentd-client and fluentd-base https://review.openstack.org/501457 | 07:25 |
| openstackgerrit | Wojciech Dec proposed openstack/puppet-tripleo master: Adding manifest for Cisco VTS ML2 mechanism driver configuration https://review.openstack.org/510645 | 07:26 |
| *** jaganathan has joined #tripleo | 07:27 | |
| *** tesseract has joined #tripleo | 07:27 | |
| openstackgerrit | Merged openstack/tripleo-common master: Fix missed HEALTHCHECK directive in template override https://review.openstack.org/507572 | 07:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: rabbitmq: set cluster_partition_handling to 'ignore' https://review.openstack.org/510097 | 07:29 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Ensure Debug is a boolean https://review.openstack.org/507935 | 07:29 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Allow Sensu to connect to RabbitMQ cluster https://review.openstack.org/495149 | 07:29 |
| *** jprovazn has joined #tripleo | 07:31 | |
| openstackgerrit | Rajesh Tailor proposed openstack/puppet-tripleo master: Add TLS for ec2api service https://review.openstack.org/509392 | 07:32 |
| *** ffiore has joined #tripleo | 07:32 | |
| *** milan has joined #tripleo | 07:32 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: snmp: add SnmpdBindHost parameter https://review.openstack.org/510215 | 07:33 |
| *** jaosorior has joined #tripleo | 07:33 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix TripleO CI jobs https://review.openstack.org/508660 | 07:33 |
| jaosorior | marios: hey, could you check this out https://review.openstack.org/#/c/510738/ ? | 07:34 |
| *** jpich has joined #tripleo | 07:35 | |
| *** shardy has joined #tripleo | 07:35 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-quickstart master: Increase default size of extra disks to 3G https://review.openstack.org/505122 | 07:36 |
| *** egonzalez has joined #tripleo | 07:39 | |
| *** cylopez has joined #tripleo | 07:40 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use icmpv6 instead of ipv6-icmp https://review.openstack.org/509086 | 07:40 |
| *** chem has joined #tripleo | 07:40 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-quickstart master: Increase default size of extra disks to 8G https://review.openstack.org/505122 | 07:41 |
| *** jpena|off is now known as jpena | 07:41 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Allow to configure snmpd_config https://review.openstack.org/510216 | 07:43 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Set memcache_servers in /etc/swift/object-expirer.conf https://review.openstack.org/487749 | 07:43 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Repair immediate VF configuration for PCI SR-IOV https://review.openstack.org/498200 | 07:43 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Add logging to capabilities filter https://review.openstack.org/510662 | 07:43 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Release 7.4.2 https://review.openstack.org/510740 | 07:44 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Release 5.6.4 https://review.openstack.org/510742 | 07:44 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Release 6.5.3 https://review.openstack.org/510741 | 07:44 |
| marios | jaosorior: ack | 07:44 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-docs master: Update documentation for O to P upgrade and update https://review.openstack.org/496223 | 07:45 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-docs master: Unify undercloud upgrade steps https://review.openstack.org/508475 | 07:45 |
| *** florianf has joined #tripleo | 07:46 | |
| jaosorior | marios: thanks | 07:47 |
| *** gfidente has joined #tripleo | 07:47 | |
| *** gfidente has quit IRC | 07:47 | |
| *** gfidente has joined #tripleo | 07:47 | |
| marios | jaosorior: can you check this when you next get some time please "Config download support for standalone deployments" https://review.openstack.org/#/c/505827/12 Ic2af634403b1ab2924c383035f770453f39a2cd5 " tripleo-heat-templates | 07:48 |
| marios | jaosorior: sorry wrong one :) | 07:48 |
| marios | jaosorior: this one https://review.openstack.org/#/c/510101/ | 07:49 |
| jaosorior | ok | 07:49 |
| marios | jaosorior: thanks | 07:49 |
| *** amoralej|off is now known as amoralej | 07:49 | |
| jaosorior | marios: something that's not clear to me about the upgrade tasks is the steps | 07:50 |
| jaosorior | marios: if you don't specify a step, does an action run on every step? | 07:50 |
| *** aufi has joined #tripleo | 07:50 | |
| marios | jaosorior: no, let me get you a pointer (the only tag which is runon all steps is 'common' we use it when we want to register a variable for subsequent steps for example | 07:51 |
| *** mcornea has joined #tripleo | 07:52 | |
| jaosorior | marios: why not run "Check if heat_api_cloudwatch is deployed" only on step1 ? | 07:52 |
| marios | jaosorior: https://github.com/openstack/tripleo-heat-templates/blob/94a26837e29db54bf4f5c8567ab181128785c83b/puppet/upgrade_config.yaml#L33-L50 here... we pass in 'common' and 'stepX' for each ansible run | 07:53 |
| *** pmannidi has quit IRC | 07:54 | |
| jaosorior | marios: thanks for the link; that's the bit I was missing | 07:54 |
| marios | jaosorior: because we are registering a variable there and we usually use common so it is available across steps. for the current example you are right we could probably run it on same step as there is nothing else there | 07:54 |
| marios | jaosorior: add a comment and I can fixit on next pass? | 07:54 |
| Tengu | back. | 07:55 |
| jaosorior | marios: it's no biggie, we could also merge it as-is. Just wanted to know if there's a reason why it was done in common and not in step1 as the actual stopping of the service. | 07:55 |
| Tengu | jaosorior: I've grep'ed -i "error" in heat-engine, and indeed : ResourceFailure: resources.CephStorage: resources[1]: ResourceInError: resources.CephStorage: Went to status ERROR due to "Message: Unknown, Code: Unknown" | 07:55 |
| marios | jaosorior: no just used to doing that for the tasks that register some var | 07:55 |
| marios | jaosorior: thanks for checking it out | 07:56 |
| Tengu | funny. I have a nice python stack trace. sooo. | 07:57 |
| Tengu | who's gonna open a new issue? :Þ | 07:57 |
| jaosorior | Tengu: what's the stack trace? | 07:57 |
| jaosorior | oh well, I guess it'll be part of the bug report | 07:58 |
| Tengu | jaosorior: indeed :) | 07:58 |
| *** threestrands has quit IRC | 07:59 | |
| jaosorior | marios: I don't have a strong opinion about changing the tag though. So if you want to change it, go ahead; else, I can also +2 the patch. | 07:59 |
| *** karthiks has quit IRC | 08:01 | |
| marios | jaosorior: ack thanks lets wait for more reviews and I'll ping you if i need a revote or if I update it for other reasons and include that too | 08:01 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/newton: Remove osd_pool_default_min_size to allow Ceph cluster to do the right thing by default https://review.openstack.org/508823 | 08:02 |
| jaosorior | marios: ack | 08:03 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common master: Process undercloud_deploy_tasks https://review.openstack.org/510781 | 08:04 |
| *** stendulker has joined #tripleo | 08:06 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Ceilometer] https://review.openstack.org/507796 | 08:06 |
| *** aufi_ has joined #tripleo | 08:07 | |
| Tengu | jaosorior: https://bugs.launchpad.net/tripleo/+bug/1722470 the full bug with "paste" links. | 08:07 |
| openstack | Launchpad bug 1722470 in tripleo "ResourceFailure: in heat returns "unknown" error" [Undecided,New] | 08:07 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Add global deployment tasks executed on undercloud https://review.openstack.org/510122 | 08:07 |
| jaosorior | shardy: any idea what could be causing Tengu's bug? https://bugs.launchpad.net/tripleo/+bug/1722470 | 08:08 |
| openstack | Launchpad bug 1722470 in tripleo "ResourceFailure: in heat returns "unknown" error" [Undecided,New] | 08:08 |
| *** aufi has quit IRC | 08:08 | |
| Tengu | I think all elements are present in order to help, but if anything is needed, I can provide more logs/ifo | 08:09 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 08:10 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-2] https://review.openstack.org/505586 | 08:12 |
| Tengu | why am I always saying "spike" instead of "pike" ?? pffff | 08:12 |
| shardy | jaosorior, Tengu: Hmm, no it's not very clear from the logs - what state are the nova servers in? | 08:12 |
| Tengu | shardy: like, "nova service-list" on the undercloud? | 08:12 |
| shardy | I wonder if it's a nova 500 or something which caused the CephStorage[1] nested stack to fail, but clearly we should have a better error in the heat logs | 08:13 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP] logging: merge fluentd-client and fluentd-base https://review.openstack.org/501457 | 08:13 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP] logging: use service_config_settings for fluentd https://review.openstack.org/501458 | 08:13 |
| Tengu | shardy: if it's a nova service-list in udercloud, all are enabled and only nova-cert is down | 08:13 |
| Tengu | shardy: want me to check the nova-scheduler? | 08:14 |
| shardy | Tengu: try nova list, then look at the status of the overcloud-cephstorage*, it may be nova show overcloud-cephstorage-1 will have some clues and/or the nova logs | 08:14 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Swift] https://review.openstack.org/502042 | 08:14 |
| shardy | Tengu: yes it'd be good to check the nova logs | 08:14 |
| Tengu | shardy: no error in nova-scheduler so far. | 08:15 |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-quickstart master: Increase default size of extra disks to 8G https://review.openstack.org/505122 | 08:16 |
| Tengu | ah, nova-conductor has something, wait, I paste it | 08:16 |
| *** karthiks has joined #tripleo | 08:18 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Nova] https://review.openstack.org/499108 | 08:18 |
| jaosorior | bandini: are we still running cinder-volume non-containerized? | 08:18 |
| Tengu | shardy: nova-conductor reports http://paste.openstack.org/show/623186/ | 08:19 |
| Tengu | (added to my initial issue) | 08:19 |
| *** stendulker has quit IRC | 08:19 | |
| *** stendulker has joined #tripleo | 08:20 | |
| jaosorior | Tengu: anything in the compute log? | 08:20 |
| Tengu | duh | 08:21 |
| Tengu | ConnectTimeout: Request to http://10.27.100.1:9090/v1/ timed out | 08:21 |
| Tengu | hmmmmm | 08:21 |
| jaosorior | novajoin issue huh | 08:21 |
| Tengu | o_O | 08:21 |
| jaosorior | Tengu: is novajoin running? | 08:21 |
| Tengu | did I re-activate that?! | 08:21 |
| jaosorior | also, you might want to up the timeouts | 08:21 |
| Tengu | jaosorior: Active: active (running) since Mon 2017-10-09 18:03:34 CEST; 16h ago | 08:22 |
| bandini | jaosorior: well depends if upstream or downstream (I believe we do so downstream) | 08:22 |
| jaosorior | Tengu: by default it's 5 seconds, you could bring that number up so nova is more tolerant on it. | 08:22 |
| Tengu | jaosorior: I didn't add the IPA registration | 08:22 |
| jaosorior | funky, novajoin should have ignored it | 08:23 |
| Tengu | indeed. | 08:23 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh] https://review.openstack.org/491411 | 08:23 |
| jaosorior | let me check | 08:23 |
| Tengu | thank you | 08:23 |
| Tengu | jaosorior: do you want the hash corresponding to the current packages I have on my undercloud? | 08:24 |
| jaosorior | Tengu: well, novajoin will do a request to nova and another one to glance to check if you requested enrollment. might be that it just takes too long doing so :/ | 08:24 |
| jaosorior | Tengu: anything in the novajoin logs? | 08:24 |
| *** lucas-afk is now known as lucasagomes | 08:25 | |
| Tengu | hmmm I have something in novajoin-notify for yesterday. | 08:26 |
| jaosorior | shuld be ni the server, not the notify. | 08:26 |
| jaosorior | *should be in | 08:26 |
| jaosorior | the server is what would cause a timeout | 08:26 |
| Tengu | jaosorior: http://paste.openstack.org/show/623188/ | 08:27 |
| Tengu | this one can serve you for later debugging. | 08:27 |
| jaosorior | Tengu: thanks | 08:27 |
| jaosorior | although I don't think it's related to your current issue | 08:28 |
| Tengu | but no error in server, at least not yet | 08:28 |
| jaosorior | Tengu: are you using hieradata-overrides in the underclod? | 08:28 |
| Tengu | jaosorior: yep | 08:28 |
| jaosorior | you could add: | 08:29 |
| *** athomas has joined #tripleo | 08:29 | |
| jaosorior | http://paste.openstack.org/show/623189/ | 08:29 |
| Tengu | jaosorior: adding anything in there will require an undercloud update/deploy right? | 08:30 |
| jaosorior | yeah :/ | 08:30 |
| jaosorior | you could also modify nova.conf though | 08:30 |
| jaosorior | and restart the nova services | 08:30 |
| Tengu | ah, yep, better for the current test. | 08:31 |
| jaosorior | look for vendordata_dynamic_connect_timeout and vendordata_dynamic_read_timeout | 08:31 |
| Tengu | yup | 08:31 |
| Tengu | same name you have in the paste :). 2s | 08:32 |
| Tengu | jaosorior: only nova service to restart? | 08:32 |
| *** hewbrocca_afk is now known as hewbrocca | 08:32 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-specs master: Add blueprint for Logging to stdout and rsyslog https://review.openstack.org/510001 | 08:32 |
| Tengu | ok, systemctl restart openstack-nova-* and hop. | 08:33 |
| jaosorior | Tengu: restart httpd also | 08:33 |
| Tengu | ok | 08:33 |
| Tengu | on its way. | 08:33 |
| *** dbecker has joined #tripleo | 08:33 | |
| Tengu | just cleaning the old FAILED servers in `openstack server list' | 08:35 |
| Tengu | jaosorior: I guess I cn try a new deploy, right? | 08:35 |
| *** sayani-b has quit IRC | 08:35 | |
| jaosorior | yep | 08:35 |
| Tengu | on its way. | 08:35 |
| Tengu | want some coffee in the meantime? ;) | 08:36 |
| *** derekh has joined #tripleo | 08:36 | |
| jaosorior | coffee is always a good idea | 08:37 |
| jaosorior | Tengu: by the way, where are you located? not many people log in before me haha :D | 08:38 |
| Tengu | Switzerland ;) | 08:38 |
| Tengu | guess you're in Spain? | 08:38 |
| jaosorior | Tengu: Finland actually | 08:38 |
| Tengu | oh. Was mislead with your name ;) | 08:38 |
| jaosorior | but I'm mexican, hence the name. | 08:38 |
| Tengu | ok | 08:38 |
| Tengu | so yep, we're in the same TZ | 08:39 |
| jaosorior | it's 11:39am here | 08:39 |
| Tengu | ah, 10:39 | 08:39 |
| jaosorior | so, damn! you log in early dude | 08:39 |
| Tengu | maybe the infamous saving time? ;) | 08:39 |
| Tengu | yep, I start working around 6:45 | 08:39 |
| Tengu | but I leave early :). | 08:40 |
| jaosorior | I usually log in around 7 or 8, so yeah, that makes sense. | 08:40 |
| jaosorior | oooh right | 08:40 |
| jaosorior | Tengu: but yeah, there is one hour usually. Finland is in a different timezone | 08:40 |
| jaosorior | I'm actually going to Zurich this Friday, for the weekend | 08:40 |
| Tengu | jaosorior: ah, small question regarding logging in openstack: there's a nice python library that can format stacktraces into JSON, a really nice formatfor ELK and other logging systems. Any way to add that kind of feature in... oslo I guess? | 08:41 |
| Tengu | jaosorior: ah, I'm near Lausanne | 08:41 |
| jaosorior | Tengu: that would be in oslo | 08:41 |
| jaosorior | Tengu: and if you do add that, please let me know, we need that :D | 08:41 |
| jaosorior | Tengu: I guess it would go here https://github.com/openstack/oslo.log | 08:42 |
| Tengu | jaosorior: care to point me the oslo repository on github? my "log master" colleague" wants to check something | 08:42 |
| Tengu | ah | 08:42 |
| Tengu | perfect :) | 08:43 |
| jaosorior | Tengu: most openstack services use it (except swift) | 08:43 |
| Tengu | that's why I thought it would fit in that lib. | 08:43 |
| jaosorior | definitely | 08:43 |
| Tengu | as it's a central part now. | 08:43 |
| Tengu | I just sent the link to my colleaug, he'll check if it would be an easy addition. | 08:43 |
| Tengu | and I think I'll provide the patch. Unless he already has some accesses on gerrit and so. | 08:44 |
| Tengu | that would indeed be a nice addition ;) | 08:44 |
| jaosorior | Tengu: would probably be a good excersice for him to set up gerrit and such | 08:44 |
| Tengu | yup, but I think he won't take the time for that ;). | 08:45 |
| Tengu | anyway. we'll work on that one way or the other. | 08:45 |
| jaosorior | awesome | 08:45 |
| Tengu | I'll open an issue for that as soon as he points the lib name and location for addition, so that we can work on that. | 08:45 |
| Tengu | and maybe (probably) merge it in pike after master :) | 08:45 |
| Tengu | ssooo. back to deploy: not yet reached the "failing" part, but not far away. | 08:46 |
| jaosorior | Tengu: did you talk to mwhahaha about backporting the resource for dynamic endpoints in haproxy ? | 08:46 |
| openstackgerrit | Merged openstack/tripleo-ui stable/pike: Release 7.4.2 https://review.openstack.org/510743 | 08:46 |
| Tengu | jaosorior: not yet, but is it building in the CI? | 08:46 |
| Tengu | hmm. | 08:47 |
| Tengu | the CI still seems to has hickup. | 08:47 |
| jaosorior | Tengu: well, jenkins has a +1 https://review.openstack.org/#/c/474109/ zuul is the one that's giving a -1, but that's for every tripleo patch it seems | 08:47 |
| *** tosky has joined #tripleo | 08:48 | |
| jaosorior | Tengu: the +1 in jenkins is what counts until we fix the zuul bits | 08:48 |
| Tengu | oook. | 08:48 |
| *** ykarel is now known as ykarel|lunch | 08:48 | |
| jaosorior | Tengu: just waiting for your input, if you get a chance to try it out. | 08:48 |
| Tengu | so basically, if we get the not from cores, we can merge that into master? | 08:48 |
| jaosorior | the not from cores? | 08:48 |
| Tengu | *notes | 08:48 |
| jaosorior | oh yeah, merging it into master should be fine | 08:49 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/ocata: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510791 | 08:49 |
| Tengu | regarding local tests: I think I'll need to update the puppet files on the undercloud AND overcloud nodes, right? | 08:49 |
| jaosorior | Tengu: depends | 08:49 |
| jaosorior | Tengu: if you want to dynamically add a service to the undercloud, then you add it to the undercloud. | 08:49 |
| Tengu | well, it will affect our controllers | 08:49 |
| jaosorior | Tengu: if you will only use it in your overcloud deployment (your controllers for instance) then there's no need to add it to the undercloud. | 08:50 |
| Tengu | but it could also affect the undercloud if I want to make some proxies for custodia | 08:50 |
| jaosorior | ok, then yeah | 08:50 |
| jaosorior | need to update both | 08:50 |
| Tengu | jaosorior: small fact though: we'll need to add a new feature with that, in order to add support for BASIC AUTH | 08:50 |
| Tengu | as it's supported in haproxy | 08:50 |
| Tengu | that would allow us to protect a bit both custodia and our prometheus | 08:51 |
| jaosorior | Tengu: you could add another commit on top of the one I did. no bigie. | 08:51 |
| Tengu | deploy: so far, so good. | 08:51 |
| *** fragatina has joined #tripleo | 08:51 | |
| Tengu | jaosorior: yup, I'll probably make a dedicated issue for that also. | 08:51 |
| *** ratailor_ has joined #tripleo | 08:52 | |
| Tengu | darn | 08:52 |
| Tengu | jaosorior: 2017-10-10 08:51:48Z [overcloud-CephStorage-asca7lbd2o4s-1-zvo46o6aqz5e.CephStorage]: CREATE_FAILED ResourceInError: resources.CephStorage: Went to status ERROR due to "Message: Unknown, Code: Unknown" | 08:52 |
| Tengu | (time is GMT) | 08:52 |
| jaosorior | Tengu: anything in the novajoin logs? | 08:52 |
| lvdombrkr | folks, it is possible to deploy overcloud with pacamaker and dvr same time? there is no any issues? | 08:52 |
| jaosorior | Tengu: and the nova compute logs? | 08:52 |
| Tengu | o_O | 08:53 |
| Tengu | InstanceDeployFailure: Failed to provision instance eb588ba3-3882-4b5a-89a9-7011aa8d1a32: Failed to deploy. Error: Disk volume where '/var/lib/ironic/master_images/tmpe | 08:53 |
| Tengu | fhKGC' is located doesn't have enough disk space. Required 5211 MiB, only 4472 MiB available space present. | 08:53 |
| Tengu | hmmmmmm | 08:53 |
| Tengu | wondering if THAT'S not due to my flavor. | 08:53 |
| jaosorior | Tengu: now that looks like a legit issue. | 08:54 |
| Tengu | although it's weird. | 08:54 |
| Tengu | does it say "storage on the server isn't enough", or "storage set inthe flavor isn't enough" ? | 08:54 |
| jaosorior | bandini: any idea about lvdombrkr question? if you can deploy both pacemaker and dvr? | 08:54 |
| Tengu | we have about 1To on the node for sda... | 08:54 |
| jaosorior | Tengu: might be the flavor | 08:55 |
| *** aditya_r has quit IRC | 08:55 | |
| Tengu | my c2c_baremetal provides 10G | 08:55 |
| *** ratailor__ has quit IRC | 08:55 | |
| Tengu | and 4096G for RAM | 08:55 |
| Tengu | it went well on the computes and controllers, but that was about a month ago. The undercloud was updated in the meanwile. | 08:55 |
| *** salmankhan has joined #tripleo | 08:55 | |
| jaosorior | wtf | 08:55 |
| Tengu | indeed. | 08:56 |
| jaosorior | Tengu: maybe it's an issue with the ramdisk. You sure you set 4096G and not Mb ? | 08:56 |
| Tengu | heu sorry, nope, M | 08:56 |
| Tengu | ahh | 08:56 |
| Tengu | ramdisk. | 08:56 |
| Tengu | ok. | 08:56 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud master: Make sure selinux permissions are correct on ~/.ssh. https://review.openstack.org/495157 | 08:57 |
| Tengu | basically I should put something like 12G of RAM in the flavor? | 08:57 |
| Tengu | so that we're on the safe side if the ramdisk becomes bigger over time | 08:57 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/instack-undercloud master: Make sure selinux permissions are correct on ~/.ssh. https://review.openstack.org/495157 | 08:57 |
| jaosorior | maybe? haha might want to ask some folks that know ironic better | 08:57 |
| Tengu | checking the values for the default baremetal. | 08:58 |
| Tengu | same ram, but not same disk (40G for default baremetal) | 08:58 |
| Tengu | will try with the default. Just in case. | 08:58 |
| Tengu | still, I get the "Message: Unknown, Code: Unknown" | 08:59 |
| Tengu | waiting for the fail to be effective and the deploy to be terminated. | 08:59 |
| Tengu | then new cleanup, and re-run with the default baremetal flavor - I updated it in order to set the GPT disk_labels and BIOS boot_mode. | 09:00 |
| *** salmankhan has quit IRC | 09:00 | |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/ocata: Disable SSH login for nova_migration user when migration over ssh is disabled. https://review.openstack.org/510793 | 09:00 |
| Tengu | re-started with default baremetal flavor. | 09:01 |
| jaosorior | sounds good | 09:01 |
| Tengu | step by step... | 09:02 |
| Tengu | although I'm a bit annoyed with all those issues. | 09:02 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/ocata: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510791 | 09:02 |
| Tengu | I was like "cool we have our ceph, let's add them and work on openstack tomorrow". well, that was yesterday :'( | 09:02 |
| openstackgerrit | zenghui.shi proposed openstack/tripleo-heat-templates master: Add PTP composable service https://review.openstack.org/491317 | 09:05 |
| *** karts has joined #tripleo | 09:06 | |
| *** karthiks has quit IRC | 09:06 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Implement minor update workflow with config download https://review.openstack.org/487488 | 09:08 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/newton: Disable SSH login for nova_migration user when migration over ssh is disabled. https://review.openstack.org/510798 | 09:09 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/newton: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510799 | 09:09 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common stable/pike: Add module_path as option for ansible-playbook action https://review.openstack.org/510800 | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 09:10 |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| *** aufi_ has quit IRC | 09:14 | |
| Tengu | hmm | 09:16 |
| Tengu | jaosorior: ok, it's the local disk space on the undercloud in fact. | 09:16 |
| Tengu | yoolololololo | 09:17 |
| *** fandrieu has quit IRC | 09:17 | |
| jaosorior | lol crap | 09:18 |
| Tengu | jaosorior: yum clean all and Voilà . | 09:18 |
| Tengu | but it's good to know it requires more than 40G for /..... | 09:18 |
| Tengu | with code, services and logs, it's just huge. | 09:19 |
| Tengu | anyway, I could free some space, it should be far, far better. | 09:19 |
| Tengu | the issue is probably when ironic wants to serve tht boot image - it's located in glance, but it needs to have it in some local storage for TFTP. | 09:19 |
| Tengu | anyway, the deploy just failed apparently. | 09:20 |
| Tengu | I'll need to ensure we don't store any useless image. | 09:20 |
| Tengu | duh. there's a lot of overcloud-full stuff. will check if I can drop the old ones. | 09:21 |
| Tengu | in the meanwhile, I'll update the issue | 09:21 |
| Tengu | we'd need some pre-flight check regarding local disk space on the undercloud. | 09:23 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/newton: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510799 | 09:24 |
| *** ffiore has quit IRC | 09:26 | |
| *** aufi_ has joined #tripleo | 09:26 | |
| *** SlickNik has quit IRC | 09:27 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-specs master: Add blueprint for Logging to stdout and rsyslog https://review.openstack.org/510001 | 09:28 |
| jaosorior | mandre: hey! thanks for the comments, answered them. And fixed the typo. | 09:28 |
| *** spectr has quit IRC | 09:29 | |
| *** spectr has joined #tripleo | 09:29 | |
| Tengu | soooo. now the deploy should go better. | 09:29 |
| jaosorior | hopefully | 09:29 |
| Tengu | jaosorior: re: format stac traces in json: the lib is python-json-logger - but apparently there's already a json formatter in the oslo.log. | 09:30 |
| jaosorior | oh | 09:31 |
| *** spectr has quit IRC | 09:32 | |
| Tengu | question would be: how can we triggerit? | 09:32 |
| jaosorior | Tengu: gotta configure oslo.log for very service. | 09:33 |
| Tengu | apparently %(stack_info) would be cool for kibana. | 09:33 |
| *** salmankhan has joined #tripleo | 09:34 | |
| *** ffiore has joined #tripleo | 09:34 | |
| *** spectr has joined #tripleo | 09:34 | |
| *** psahoo has quit IRC | 09:37 | |
| *** SlickNik has joined #tripleo | 09:38 | |
| Tengu | jaosorior: I can open some issue regarding that on the project. | 09:40 |
| Tengu | guess it's the best. | 09:40 |
| *** nmathew- has joined #tripleo | 09:41 | |
| Tengu | jaosorior: re: deploy. apparently, freeing some disk space did the trick. *apparently*. Waiting for the next failure ,). | 09:43 |
| Tengu | but seeing "deploying" in the openstack baremetal node list is pretty nice. | 09:44 |
| *** nmathew has quit IRC | 09:44 | |
| Tengu | \o/ | 09:46 |
| *** dpawar has joined #tripleo | 09:46 | |
| Tengu | uh ?! | 09:46 |
| Tengu | ..... a host aws just "lost". | 09:46 |
| Tengu | ah. InstanceDeployFailure: Failed to provision instance 95f23358-1dcf-4ec7-92b6-26a9455d2641: Timeout reached while waiting for callback for node 057db8f1-bdc2-4b1d-a29a-21aa39ba4bb3 | 09:47 |
| Tengu | ok so that's ironic calls to IPMI. | 09:47 |
| Tengu | not a big deal, and that I can debug """easily""". | 09:48 |
| mandre | bandini: http://rhos-release.virt.bos.redhat.com:3030/rhosp | 09:48 |
| *** dpawar has quit IRC | 09:49 | |
| jaosorior | bandini, mandre: Any reason why we're not deploying cinder with containers upstream? would be cool to have that :D | 09:51 |
| jaosorior | jistr: ^^ | 09:52 |
| *** dtantsur|afk is now known as dtantsur | 09:53 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Remove Heat Cloudwatch API during upgrade and disable by default https://review.openstack.org/510101 | 09:53 |
| bandini | jaosorior: not entirely sure tbh | 09:57 |
| openstackgerrit | Thomas Herve proposed openstack/instack-undercloud master: Handle relative hieradata_override https://review.openstack.org/510813 | 09:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable Cinder on containers https://review.openstack.org/510814 | 10:00 |
| jaosorior | bandini: well, lets see how it goes ^^ | 10:00 |
| bandini | ack | 10:01 |
| *** nmathew- has quit IRC | 10:01 | |
| *** ykarel|lunch is now known as ykarel | 10:02 | |
| Tengu | is there a way to act on a node in "wait call-back" state? like, "you won't get any call-back, drop that task" ? | 10:03 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common stable/ocata: Take wwn_with_extension into account, when configuring a boot device https://review.openstack.org/510817 | 10:04 |
| Tengu | I tried to `abort' it, but it's not authorized when in call-back state | 10:04 |
| openstackgerrit | Wojciech Dec proposed openstack/puppet-tripleo master: Adding manifest for Cisco VTS ML2 mechanism driver configuration https://review.openstack.org/510645 | 10:04 |
| *** tbarron|PTO is now known as tbarron | 10:04 | |
| Tengu | ah, we can set the maintenance mode. | 10:05 |
| Tengu | ook. | 10:05 |
| *** fandrieu has joined #tripleo | 10:09 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 10:10 |
| *** achadha has joined #tripleo | 10:15 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Mirror images from RDO server https://review.openstack.org/510362 | 10:16 |
| *** achadha has quit IRC | 10:19 | |
| *** dpawar has joined #tripleo | 10:21 | |
| Tengu | ok, the "unknown" error can also raise in this case: VirtualInterfacePlugException: Cannot attach VIF ef5323ca-f3b7-4685-a2b2-5021be6b3a37 to the node 832e1e57-0532-4029-9f04-37ae3326a4b7 due to error: Unable to attach VIF ef5323ca-f3b7-4685-a2b2-5021be6b3a37, not enough free physical ports. (HTTP 400) | 10:22 |
| Tengu | this happens when a deploy fails and some cleanups aren't properly done. | 10:23 |
| Tengu | so I think I can either drop the hardware nodes and re-import them in ironic/overcloud, or try to clean them by hand. The first one is longer but the result is prtty good. | 10:23 |
| *** shreshtha|wfh has quit IRC | 10:23 | |
| *** shreshtha has joined #tripleo | 10:24 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove unnecessary scripts from tripleo-ci https://review.openstack.org/510828 | 10:24 |
| sshnaidm | adarazs, panda trown|outtypewww ^^ | 10:24 |
| *** masco has quit IRC | 10:30 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Add validation task in docker services [cinder] https://review.openstack.org/489940 | 10:35 |
| *** shreshtha has quit IRC | 10:35 | |
| *** shreshtha has joined #tripleo | 10:35 | |
| *** panda is now known as panda|relo | 10:36 | |
| *** morazi has quit IRC | 10:37 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-specs master: Queens - all nodes ansible-playbook upgrade workflow https://review.openstack.org/507620 | 10:39 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Enhance completion message when upgrading non controller nodes https://review.openstack.org/482868 | 10:40 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-specs master: Queens - all nodes ansible-playbook upgrade workflow https://review.openstack.org/507620 | 10:40 |
| *** pblaho has joined #tripleo | 10:43 | |
| jistr | jaosorior: it should be added soon: https://review.openstack.org/#/c/479001/ | 10:43 |
| *** stendulker_ has joined #tripleo | 10:48 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Correct template names from ocata to pike. https://review.openstack.org/500465 | 10:48 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Change template names to queens https://review.openstack.org/500451 | 10:48 |
| *** stendulker has quit IRC | 10:50 | |
| *** mrch has joined #tripleo | 10:52 | |
| *** ratailor__ has joined #tripleo | 10:52 | |
| *** stendulker_ has quit IRC | 10:53 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-quickstart master: Allow customizing the hard-drive Serial and/or WWN https://review.openstack.org/404156 | 10:55 |
| *** ratailor_ has quit IRC | 10:55 | |
| *** pdeore has joined #tripleo | 10:56 | |
| *** pdeore_ has quit IRC | 10:58 | |
| *** aputtur has quit IRC | 10:59 | |
| *** ansmith has quit IRC | 11:01 | |
| *** pdeore_ has joined #tripleo | 11:01 | |
| *** jkilpatr has joined #tripleo | 11:03 | |
| *** pdeore has quit IRC | 11:04 | |
| *** dtantsur has quit IRC | 11:04 | |
| *** pdeore has joined #tripleo | 11:04 | |
| *** ykarel_ has joined #tripleo | 11:06 | |
| *** pdeore_ has quit IRC | 11:06 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common master: Allow processing undercloud_deploy_steps_tasks https://review.openstack.org/510781 | 11:08 |
| *** ykarel has quit IRC | 11:08 | |
| *** dtantsur has joined #tripleo | 11:08 | |
| *** salmankhan has quit IRC | 11:08 | |
| *** dtantsur has joined #tripleo | 11:09 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Stop using the cached cirros image https://review.openstack.org/510839 | 11:09 |
| sshnaidm | EmilienM, mwhahaha adarazs ^^ | 11:09 |
| * adarazs looks | 11:09 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 11:10 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Add global deployment tasks executed on undercloud https://review.openstack.org/510122 | 11:10 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 11:10 |
| *** dpawar has quit IRC | 11:11 | |
| *** dtantsur has joined #tripleo | 11:13 | |
| *** salmankhan has joined #tripleo | 11:13 | |
| *** SlickNik has quit IRC | 11:14 | |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo master: Add support for cephfs+ganesha backend in manila https://review.openstack.org/471247 | 11:14 |
| *** lucasagomes is now known as lucas-hungry | 11:15 | |
| jistr | flaper87: here are the patches for running things on undercloud as part of the deployment process https://review.openstack.org/#/c/510781 https://review.openstack.org/#/c/510122 | 11:16 |
| jistr | they aren't done yet in terms of code structure and unit tests, but they work | 11:16 |
| flaper87 | jistr: thanks, will look in a bit :D | 11:17 |
| jistr | i tried to adhere as close as possible to the way we approach upgrade_tasks and update_tasks | 11:17 |
| *** SlickNik has joined #tripleo | 11:19 | |
| *** dr_gogeta86 has quit IRC | 11:20 | |
| *** jpena is now known as jpena|lunch | 11:23 | |
| *** ykarel_ is now known as ykarel | 11:24 | |
| *** pdeore has quit IRC | 11:24 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui stable/pike: Add IDs and classes to Nodes page https://review.openstack.org/510842 | 11:28 |
| *** rhallisey has joined #tripleo | 11:29 | |
| *** aditya_r has joined #tripleo | 11:36 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-specs master: Queens - all nodes ansible-playbook upgrade workflow https://review.openstack.org/507620 | 11:37 |
| *** ratailor_ has joined #tripleo | 11:37 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo stable/newton: Remove extra keystone admin haproxy listen and allow TLS https://review.openstack.org/510738 | 11:39 |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates stable/pike: Providing required priviledges to the mounted NFS volume https://review.openstack.org/510846 | 11:39 |
| *** Xinerama has joined #tripleo | 11:40 | |
| *** pkovar has joined #tripleo | 11:41 | |
| openstackgerrit | Rajesh Tailor proposed openstack/puppet-tripleo master: Add TLS for ec2api service https://review.openstack.org/509392 | 11:41 |
| *** ratailor__ has quit IRC | 11:41 | |
| Xinerama | Is this the best place to ask questions about installation? | 11:42 |
| jaosorior | Xinerama: depends on the question, and installation of what :) | 11:43 |
| *** aditya_r has quit IRC | 11:43 | |
| Xinerama | I'm trying to install oooq on Fedora 26 with a Ryzen cpu | 11:43 |
| jistr | flaper87: btw the way i tested so far is this: http://paste.openstack.org/show/623214/ Next up i'll try to convert the kubespray installation to run that way. (service_workflow_tasks aren't compatible with the config-download Ansible deploy.) | 11:43 |
| Xinerama | Having some difficulties | 11:44 |
| jaosorior | mandre: you had installed oooq on Fedora 26, no? ^^ | 11:44 |
| jaosorior | jistr: are you working on installing k8s with tripleo? | 11:44 |
| jistr | jaosorior: yea | 11:45 |
| jaosorior | jistr: nice! | 11:45 |
| jaosorior | jistr: planning on doing openshift? would sure be useful :D | 11:45 |
| jistr | yea flaper87 posted PoC for both | 11:45 |
| jaosorior | I would like to make use/integrate with the openshift logging stack | 11:45 |
| Xinerama | I haven't had success yet. It keeps throwing errors about pools. Specifically: "virsh", "pool-undefine", "oooq_pool" | 11:45 |
| jistr | they won't work when we implement the ansible-config-download blueprint | 11:46 |
| jistr | hence we need the work i've described above | 11:46 |
| jaosorior | Xinerama: I've been installing it on CentOS. Not sure how to make it work with Fedora :/ | 11:46 |
| jaosorior | jistr: what do you mean? | 11:46 |
| shardy | yeah I tried with a Fedora host a while back but recently been using CentOS as its the only thing we test in CI | 11:46 |
| jaosorior | Xinerama: you could try to ask in #oooq as well | 11:47 |
| Xinerama | @jaosorior Unfortunately I haven't been able to get CentOS installed on my motherboard. Crazy | 11:47 |
| shardy | Xinerama: is using a centos host an option? That is a much better tested path at this point | 11:47 |
| shardy | aha | 11:47 |
| *** jprovazn has quit IRC | 11:47 | |
| jistr | jaosorior: what was discussed in http://lists.openstack.org/pipermail/openstack-dev/2017-September/thread.html#122234 | 11:47 |
| jaosorior | oooh that | 11:48 |
| jistr | jaosorior: essentially we want an option to deploy OC with a single playbook | 11:48 |
| jistr | and not create ansible->mistral->ansible loop | 11:48 |
| *** thrash|g0ne is now known as thrash | 11:48 | |
| Xinerama | Thank you | 11:48 |
| jaosorior | jistr: that would sure be nice | 11:49 |
| *** Xinerama has left #tripleo | 11:49 | |
| *** ffiore has quit IRC | 11:49 | |
| lvdombrkr | folks, it is possible to deploy overcloud with pacamaker and dvr same time? there is no any issues? | 11:49 |
| shardy | Xinerama: FWIW I did run TripleO fine on a Fedora host, but not when I tried it via quickstart, so I suspect there are issues we've not solved with the quickstart VM setup on Fedora | 11:49 |
| *** aditya_r has joined #tripleo | 11:50 | |
| shardy | sorry I don't have solutions at this point but if you provided details the oooq experts may be able to help | 11:50 |
| *** jprovazn has joined #tripleo | 11:50 | |
| *** morazi has joined #tripleo | 11:51 | |
| *** Xinerama has joined #tripleo | 11:53 | |
| flaper87 | jistr: I was about to ask how you tested this thing | 11:54 |
| flaper87 | I'm looking at the patches now but I'm also about to jump on a call | 11:55 |
| *** trown|outtypewww is now known as trown | 11:55 | |
| *** panda|relo is now known as panda | 11:56 | |
| *** tzumainn has joined #tripleo | 11:56 | |
| *** abishop has joined #tripleo | 11:57 | |
| *** dpawar has joined #tripleo | 11:58 | |
| *** ratailor__ has joined #tripleo | 11:59 | |
| *** pradk has joined #tripleo | 12:02 | |
| *** ratailor_ has quit IRC | 12:02 | |
| *** jfrancoa is now known as jfrancoa|lunch | 12:04 | |
| *** ffiore has joined #tripleo | 12:04 | |
| *** pkovar has quit IRC | 12:06 | |
| *** zzzeek has quit IRC | 12:07 | |
| *** zzzeek has joined #tripleo | 12:10 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1721045 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1721045 in tripleo "get_watch_server_url in HeatClientPlugin returns incorrect url in IPv6" [Critical,In progress] | 12:10 |
| *** eck` is now known as eck`gone | 12:11 | |
| *** karts is now known as karthiks | 12:15 | |
| *** raildo has joined #tripleo | 12:16 | |
| *** ffiore has quit IRC | 12:17 | |
| *** ffiore has joined #tripleo | 12:21 | |
| *** ratailor_ has joined #tripleo | 12:21 | |
| *** pkovar has joined #tripleo | 12:23 | |
| *** ratailor__ has quit IRC | 12:24 | |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates master: Enable TLS for ec2api service https://review.openstack.org/509393 | 12:25 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Remove rsync from xinetd when upgrading to containerized deployment https://review.openstack.org/505606 | 12:25 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/510309 | 12:26 |
| *** lucas-hungry is now known as lucasagomes | 12:27 | |
| *** aputtur has joined #tripleo | 12:28 | |
| openstackgerrit | Thomas Herve proposed openstack/instack-undercloud master: Handle relative hieradata_override https://review.openstack.org/510813 | 12:28 |
| *** dprince has joined #tripleo | 12:28 | |
| weshay | EmilienM, mwhahaha and all just a reminder if you want to join.. tripleo-ci-squad mtg at 1pm UTC | 12:30 |
| * mwhahaha cannot join | 12:30 | |
| weshay | office hours for ci at 4pm UTC | 12:30 |
| mwhahaha | kids -> scrhool | 12:30 |
| weshay | aye | 12:30 |
| *** pchavva has joined #tripleo | 12:31 | |
| *** rlandy has joined #tripleo | 12:32 | |
| *** ratailor_ has quit IRC | 12:35 | |
| *** ansmith has joined #tripleo | 12:35 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui stable/pike: Listen for messages from internal introspect workflow https://review.openstack.org/510862 | 12:36 |
| *** jpena|lunch is now known as jpena | 12:40 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-docs master: Add missing subnets key to DeloyedServerPortMap https://review.openstack.org/510865 | 12:41 |
| lvdombrkr | beagles: hi | 12:43 |
| beagles | lvdombrkr, hi | 12:43 |
| *** udesale__ has quit IRC | 12:44 | |
| *** gkadam has quit IRC | 12:44 | |
| lvdombrkr | beagles: are you have some minutes about dvr? | 12:45 |
| *** liverpooler has joined #tripleo | 12:45 | |
| beagles | lvdombrkr, yes | 12:45 |
| *** liverpooler has quit IRC | 12:46 | |
| *** liverpooler has joined #tripleo | 12:46 | |
| lvdombrkr | beagles: so, can dvr and pacemaker work in same time? or it can cause issues? | 12:47 |
| *** mdnadeem has quit IRC | 12:48 | |
| beagles | lvdombrkr, a couple of things about that - at the moment, the l3 agent is not managed by pacemaker; also the dvr model as implemented by tripleo places L3 agents on the compute nodes where pacemaker is not run either. | 12:50 |
| beagles | lvdombrkr, so I'm wondering if you are planning a deployment that deviates greatly from how services are run | 12:50 |
| *** lblanchard has joined #tripleo | 12:50 | |
| beagles | lvdombrkr, if not, then there shouldn't be an issue | 12:50 |
| aputtur | mwhahaha, this fix https://bugs.launchpad.net/tripleo/+bug/1643808 is not in ocata and pike, I don't see them in master too. | 12:51 |
| openstack | Launchpad bug 1643808 in tripleo "The openstack-endpoints validation can't read overcloudrc" [High,Fix released] - Assigned to Tomas Sedovic (tsedovic) | 12:51 |
| *** ecerquei__ has joined #tripleo | 12:52 | |
| *** spectr has quit IRC | 12:53 | |
| aputtur | mwhahaha, running eatureset007.yml on pike and ocata is failing with same error as reported in bug 1643808 | 12:53 |
| openstack | bug 1643808 in tripleo "The openstack-endpoints validation can't read overcloudrc" [High,Fix released] https://launchpad.net/bugs/1643808 - Assigned to Tomas Sedovic (tsedovic) | 12:53 |
| mwhahaha | aputtur: might be a question for the validation folks, it might have been reverted | 12:53 |
| mwhahaha | aputtur: the logic was moved | 12:54 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: Rework documentation for ironic in the overcloud https://review.openstack.org/510867 | 12:55 |
| mwhahaha | aputtur: https://github.com/openstack/tripleo-validations/commit/9461adfa244793cba91f87fcee25a6887a9b7368#diff-ec9889a6e36ec4559743b212895c4768 | 12:55 |
| *** spectr has joined #tripleo | 12:55 | |
| mwhahaha | aputtur: might want to ask florianf | 12:55 |
| *** leitan has joined #tripleo | 12:56 | |
| *** leitan has quit IRC | 12:56 | |
| aputtur | mwhahaha, okay | 12:56 |
| *** leitan has joined #tripleo | 12:56 | |
| *** jmelvin has joined #tripleo | 12:57 | |
| *** aditya_r has quit IRC | 12:57 | |
| aputtur | mwhahaha, thanks | 12:57 |
| *** aditya_r has joined #tripleo | 12:57 | |
| lvdombrkr | beagles: i have some issues with pacamaker after i added dvr to my deployment | 12:58 |
| beagles | lvdombrkr, which version of tripleo were you using? | 12:58 |
| lvdombrkr | beagles: ocata, without containers | 12:58 |
| beagles | lvdombrkr, what sort of issues were you having? | 12:59 |
| *** shardy has quit IRC | 13:00 | |
| lvdombrkr | beagles: morning i tested controller HA, there was no issues, after added dvr and restarted all controllers after sudo pcs status i get : http://paste.openstack.org/raw/623223/ | 13:01 |
| *** ykarel has quit IRC | 13:01 | |
| *** ykarel has joined #tripleo | 13:02 | |
| lvdombrkr | beagles: two mysql failed, so no HA | 13:02 |
| arxcruz | ALL: TripleO CI meeting in https://bluejeans.com/u/whayutin/ | 13:02 |
| lvdombrkr | i belive that its caused by dvr , maybe im wrong | 13:03 |
| beagles | lvdombrkr, that's strange - when you say "added dvr" what do you mean? | 13:03 |
| florianf | aputtur: I can find the commit in the master/pike/ocata branches. What's the error you | 13:03 |
| florianf | are seeing? | 13:03 |
| lvdombrkr | i updated my overcloud added dvr tempaltes | 13:04 |
| *** Xinerama has quit IRC | 13:04 | |
| beagles | lvdombrkr, you mean the neutron-ovs-dvr.yaml file in tripleo-heat-templates/environments? | 13:05 |
| *** pkovar has quit IRC | 13:05 | |
| aputtur | florianf, I was running quickstart with -R pike for featureset007 | 13:05 |
| beagles | lvdombrkr, I'm not sure how that could interfere with galera - it seems more likely an issue with the overcloud updating itself | 13:05 |
| aputtur | florianf, The error i got is The `HorizonPublic` endpoint is not defined in the `EndpointMap` | 13:06 |
| *** pkovar has joined #tripleo | 13:06 | |
| *** shreshtha has quit IRC | 13:07 | |
| aputtur | florianf, since the logic is changed post newton, so I was going through documentation for those changes | 13:07 |
| lvdombrkr | beagles: excatly, | 13:10 |
| *** skramaja has quit IRC | 13:10 | |
| *** aditya_r has quit IRC | 13:11 | |
| *** jistr is now known as jistr|mtg | 13:11 | |
| *** aditya_r has joined #tripleo | 13:11 | |
| *** shardy has joined #tripleo | 13:11 | |
| *** ykarel_ has joined #tripleo | 13:11 | |
| beagles | lvdombrkr, basically that changes some neutron configs and deploys the l3 and metadata agents to the compute nodes (neither of which even access the database directly) so probably we need to get a HA/upgrade expert involved | 13:12 |
| *** ykarel has quit IRC | 13:12 | |
| *** ykarel_ is now known as ykarel | 13:12 | |
| *** toure_biab is now known as toure | 13:13 | |
| *** oanson has quit IRC | 13:14 | |
| *** oanson has joined #tripleo | 13:15 | |
| *** Shatadru is now known as Shatadru|Gone | 13:15 | |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo stable/pike: Disables port status for all ODL deployments https://review.openstack.org/510878 | 13:16 |
| trozet | shardy: hey can you help me with this please? https://review.openstack.org/#/c/509789/ | 13:16 |
| *** eck`gone is now known as eck` | 13:16 | |
| shardy | trozet: ack, looking | 13:18 |
| *** cdearborn has joined #tripleo | 13:18 | |
| *** jistr|mtg is now known as jistr | 13:19 | |
| lvdombrkr | beagles: mhmmm... i will try investigate deeply | 13:19 |
| EmilienM | hello | 13:19 |
| florianf | aputtur: The endpoint is still defined in current tripleo-heat-templates, and I can look it up just fine after a deployment. Have you had the same problem with different featuresets? | 13:20 |
| *** agurenko has joined #tripleo | 13:21 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/newton: Allow to configure snmpd_config https://review.openstack.org/510218 | 13:21 |
| trozet | shardy: ty! | 13:22 |
| aputtur | florianf, I haven't tried with different featuresets. I will do that next. I just pulled the latest and running it again. | 13:23 |
| hrybacki | EmilienM: the last of the OpenStack puppet module from Friday have landed. Please let me know if someone notices one that slipped under the radar | 13:24 |
| florianf | aputtur: that would be good. I can't try reproduce it right now. So it would be good if you could file a bug. gchamoul might also know more, since he has added validation runs to the featuresets IIRC. | 13:26 |
| aputtur | florianf, ok | 13:26 |
| aputtur | florianf, this is what I am running ./quickstart.sh -X -n -T all -t all -b -v -R pike -c config/general_config/featureset007.yml $VIRTHOST | 13:27 |
| *** gbarros has joined #tripleo | 13:27 | |
| gfidente | jistr https://review.openstack.org/#/c/509001/ ? :D | 13:28 |
| *** shardy has quit IRC | 13:29 | |
| *** links has quit IRC | 13:29 | |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-common master: WIP: Add Ansible playbook/workflow to deploy Swift rings https://review.openstack.org/510884 | 13:30 |
| *** ccamacho has quit IRC | 13:30 | |
| gfidente | jaosorior you want to add anything in the integration squad pad for ipa before the meeting? https://etherpad.openstack.org/p/tripleo-integration-squad-status | 13:30 |
| *** fragatina has quit IRC | 13:30 | |
| *** bfournie has quit IRC | 13:30 | |
| *** fragatina has joined #tripleo | 13:31 | |
| *** bfournie has joined #tripleo | 13:31 | |
| EmilienM | hrybacki: cool, thanks for the work | 13:31 |
| *** bobh has joined #tripleo | 13:33 | |
| *** jaganathan has quit IRC | 13:33 | |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Add networking-sfc support https://review.openstack.org/489749 | 13:33 |
| *** zaneb has quit IRC | 13:33 | |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/newton: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510799 | 13:34 |
| jaosorior | gfidente: nothing I can think of for now | 13:35 |
| jistr | gfidente: +2'd but the variable naming could be more consistent ;) | 13:35 |
| *** bfournie has quit IRC | 13:35 | |
| gchamoul | aputtur: gonna try to reproduce it | 13:37 |
| *** shardy has joined #tripleo | 13:38 | |
| gchamoul | aputtur: did the overcloud deployment fail? | 13:38 |
| florianf | aputtur: can you paste a little more of the output you get when running in that error somewhere? | 13:38 |
| *** jprovazn has quit IRC | 13:39 | |
| aputtur | gchamoul, yes | 13:39 |
| gfidente | jistr so I know you have real work to do but | 13:39 |
| *** jprovazn has joined #tripleo | 13:40 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-docs master: Unify undercloud upgrade steps https://review.openstack.org/508475 | 13:40 |
| aputtur | florianf, Sure, I am running it now. as soon I get any error I will. Thanks | 13:40 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/newton: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510799 | 13:40 |
| gfidente | jistr I realized in my previous patchsets that it was running the _via_nova task when it shouldn't because it's multinode | 13:40 |
| gfidente | jistr any clue why I had errors from the _via_nova task in the jobs? | 13:40 |
| rook | shardy zaneb - Convergence test completed this time | 13:41 |
| *** ramishra has quit IRC | 13:41 | |
| gchamoul | aputtur: running a test | 13:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Provide DPDK nic configs and add multiqueue config https://review.openstack.org/474533 | 13:42 |
| jistr | gfidente: it runs in multionod / deployedserver envs too, but the server list is empty, so it doesn't do anything | 13:42 |
| *** noslzzp has joined #tripleo | 13:42 | |
| *** aditya_r has quit IRC | 13:42 | |
| jistr | gfidente: the via_ssh variant is only used when appropriate inputs are passed in earlier in a CI script | 13:42 |
| rook | shardy so, w/ convergence enabled, deployment for 32 nodes took an additional ~4 minutes | 13:42 |
| * rook pulls system util | 13:43 | |
| jistr | gfidente: so essentially first we run via_ssh in CI, and then during stack deploy we also run via_nova, but it doesn't find any servers to run on, so it's effectively a no-op. If there's a parameter problem though, it will be caught. | 13:43 |
| *** zaneb has joined #tripleo | 13:45 | |
| *** chlong_ has joined #tripleo | 13:47 | |
| jaosorior | jistr: any opinion on this https://review.openstack.org/#/c/510814/ ? | 13:47 |
| *** itlinux has joined #tripleo | 13:47 | |
| *** chlong has joined #tripleo | 13:47 | |
| *** sid1 has quit IRC | 13:49 | |
| jistr | jaosorior: https://review.openstack.org/#/c/479001 :) i linked it earlier today when you asked about containerized Cinder, you might have missed it | 13:49 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Ensure ssh key is active before returning from create_admin_via_nova https://review.openstack.org/509001 | 13:50 |
| jaosorior | jistr: I did miss it | 13:50 |
| *** zaneb has quit IRC | 13:50 | |
| *** sc has quit IRC | 13:51 | |
| jaosorior | jistr: great! +2ed | 13:51 |
| jistr | jaosorior: thanks :) | 13:52 |
| gfidente | jistr ah runs multiple times, thanks | 13:52 |
| shardy | rook: ack, thanks for the feedback, how was the memory usage? | 13:53 |
| *** sc has joined #tripleo | 13:53 | |
| *** sc is now known as Guest85006 | 13:53 | |
| *** Camacho|phone has joined #tripleo | 13:54 | |
| *** abregman|afk is now known as abregman|pto | 13:55 | |
| aputtur | florianf, gchamoul .. here is the error link https://gist.github.com/aneeshkp/5e2fab67eaa6f44fa704cddc35f9ff76 | 13:56 |
| mwhahaha | reminder, meeting in here in ~3 mins. https://etherpad.openstack.org/p/tripleo-meeting-items | 13:57 |
| gchamoul | aputtur: can you run this command please on your undercloud? $ /usr/bin/tripleo-ansible-inventory --static-inventory $HOME/mystatic-env | 13:57 |
| gchamoul | aputtur: and paste it? | 13:58 |
| aputtur | gchamoul, /usr/bin/tripleo-ansible-inventory: No such file or directory | 13:58 |
| *** d0ugal has quit IRC | 14:00 | |
| *** d0ugal has joined #tripleo | 14:00 | |
| *** d0ugal has quit IRC | 14:00 | |
| mwhahaha | #startmeeting tripleo | 14:00 |
| mwhahaha | #topic agenda | 14:00 |
| mwhahaha | * Review past action items | 14:00 |
| mwhahaha | * One off agenda items | 14:00 |
| mwhahaha | * Squad status | 14:00 |
| mwhahaha | * Bugs & Blueprints | 14:00 |
| openstack | Meeting started Tue Oct 10 14:00:47 2017 UTC and is due to finish in 60 minutes. The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| mwhahaha | * Projects releases or stable backports | 14:00 |
| mwhahaha | * Specs | 14:00 |
| mwhahaha | * open discussion | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| mwhahaha | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:00 |
| mwhahaha | Hi everyone! who is around today? | 14:00 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:00 | |
| lvdombrkr | folks, where i can see pacemaker detailed logs, for example reason why node not become as master etc | 14:00 |
| openstack | The meeting name has been set to 'tripleo' | 14:00 |
| *** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:00 | |
| beagles | o/ | 14:00 |
| dprince | hi | 14:00 |
| *** d0ugal has joined #tripleo | 14:00 | |
| jtomasek | o/ | 14:00 |
| Camacho|phone | Hola! | 14:01 |
| abishop | o/ | 14:01 |
| jaosorior | o/ | 14:01 |
| marios | o/ | 14:01 |
| cdearborn | 0/ | 14:01 |
| jfrancoa|lunch | o/ | 14:01 |
| d0ugal | Hey | 14:01 |
| gfidente | o/ | 14:01 |
| jistr | hi | 14:01 |
| *** jfrancoa|lunch is now known as jfrancoa | 14:01 | |
| thrash | o/ | 14:01 |
| fultonj | o/ | 14:01 |
| chem | o/ | 14:01 |
| EmilienM | o/ | 14:01 |
| *** sid1 has joined #tripleo | 14:01 | |
| larsks | o/ | 14:01 |
| *** d0ugal has quit IRC | 14:01 | |
| *** d0ugal has joined #tripleo | 14:02 | |
| *** d0ugal has quit IRC | 14:02 | |
| *** d0ugal has joined #tripleo | 14:02 | |
| jrist | o/ | 14:02 |
| mwhahaha | hey everyone, let's go | 14:02 |
| mwhahaha | #topic review past action items | 14:02 |
| mwhahaha | mwhahaha to follow up with shardy about services and ovb jobs | 14:02 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:02 | |
| *** archit has joined #tripleo | 14:03 | |
| mwhahaha | so I think shardy piped in last week after i made this item, not sure we have much to do on this at the moment | 14:03 |
| mwhahaha | i think there's also efforts to move ovb to rdo cloud so it's probably not the best time to make changes. so we can circle back around to this later in the cycle | 14:03 |
| mwhahaha | the next item was ceph-upgrade ci | 14:04 |
| mwhahaha | fultonj, gfidente: any update on ceph-upgrade ci? | 14:04 |
| fultonj | that's in the integration squad pad | 14:04 |
| mwhahaha | k we'll get to that later | 14:04 |
| fultonj | ack | 14:04 |
| mwhahaha | mwhahaha to move bugs <= medium to queens-2 and review > medium for validity - DONE | 14:04 |
| mwhahaha | that's in ont he past action items from last week | 14:04 |
| trown | o/ sort of ci squad is also having retro | 14:05 |
| *** pblaho has quit IRC | 14:05 | |
| mwhahaha | #topic one off agenda items | 14:05 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:05 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:05 | |
| EmilienM | trown: now? | 14:05 |
| trown | EmilienM: ya | 14:05 |
| EmilienM | trown: ouch, bad timeing :/ | 14:05 |
| mwhahaha | (mwhahaha) Newton EOL & CI review | 14:05 |
| mwhahaha | fyi, i've asked for a stay of EOL for tripleo projects | 14:05 |
| mwhahaha | http://lists.openstack.org/pipermail/openstack-dev/2017-October/123221.html | 14:05 |
| mwhahaha | but it's been asked to review with the stable team what that means | 14:06 |
| EmilienM | have we got feedback on that? | 14:06 |
| mwhahaha | so i'm looking for some volunteers to help with that effort | 14:06 |
| *** oanson has quit IRC | 14:06 | |
| mwhahaha | yea tonyb want's to chat about the impact | 14:06 |
| EmilienM | mwhahaha: count me in | 14:06 |
| mwhahaha | he said it was probably ok but wants to understand what that means | 14:06 |
| EmilienM | well, see if we can keep branches and stable jobs | 14:06 |
| mwhahaha | #action EmilienM to sync with tonyb about stable/newton retirement CI | 14:07 |
| EmilienM | we're still doing backports now | 14:07 |
| rook | shardy: tagged you in a doc | 14:07 |
| mwhahaha | so please also take some time to review the email thread around that and chime in if you have input | 14:07 |
| EmilienM | we can expect things going down in future for newton but for now we still have backports | 14:07 |
| *** oanson has joined #tripleo | 14:07 | |
| EmilienM | ok I will | 14:07 |
| mwhahaha | moving on | 14:07 |
| mwhahaha | (jaosoroir) Blueprint: Add option for containers to log to stdout | 14:07 |
| * mwhahaha pokes jaosorior | 14:07 | |
| jaosorior | hey! | 14:08 |
| jaosorior | So, just giving a heads up to people about that blueprint | 14:08 |
| jaosorior | Here's the link to the spec https://review.openstack.org/#/c/510001/ | 14:08 |
| *** jobewan has joined #tripleo | 14:08 | |
| *** yog_ has joined #tripleo | 14:09 | |
| jaosorior | But in a nutshell, the plan is to get all of the containers to log to stdout (as one would usually expect with containers) | 14:09 |
| jaosorior | and let the docker logging driver handle the logs | 14:09 |
| jaosorior | getting some extra metadata with that | 14:09 |
| fultonj | jaosorior: so would you not log to /var/log/containers on the container host? | 14:09 |
| shardy | jaosorior: can we do that and still log to file on the host? | 14:10 |
| jaosorior | larsks: ^^ | 14:10 |
| larsks | shardy: sure, we can double-log if somebody wants that. | 14:10 |
| *** Camacho|phone has quit IRC | 14:10 | |
| larsks | But the two big advantages here are: | 14:10 |
| jaosorior | fultonj, shardy: though, the plan right now is to make it pluggable. So we would still log to /var/log/containers by default | 14:10 |
| larsks | (a) lots of useful metadata, including k8s metadata about the pod in which a container is running, and | 14:10 |
| larsks | (b) we support most services automatically, rather than requiring some sort of per-service log configuration. | 14:11 |
| *** florianf is now known as florianf_brb | 14:11 | |
| mwhahaha | sounds like some good coversation for the spec review :D | 14:11 |
| jistr | with k8s logging to /var/log local bindmount essentially becomes an antipattern | 14:11 |
| larsks | jistr: agreed! | 14:11 |
| *** atoth has joined #tripleo | 14:11 | |
| shardy | larsks: ack, and this will just work with the existing fluentd integration? | 14:11 |
| mwhahaha | #action team to review logging to std spec https://review.openstack.org/#/c/510001/ | 14:11 |
| jistr | (but until then it's fine/useful imo :) ) | 14:12 |
| gfidente | jaosorior fwiw, this is what the ceph containers currently do | 14:12 |
| larsks | shardy: I think it would be an "instead of" rather than "works with". | 14:12 |
| fultonj | https://bugs.launchpad.net/tripleo/+bug/1721841 | 14:12 |
| openstack | Launchpad bug 1721841 in tripleo "ceph docker containers do not log to /var/log/containers" [High,Triaged] - Assigned to John Fulton (jfulton-org) | 14:12 |
| jaosorior | shardy: unfortunately it won't "just work", either we rework the fluentd configuration to take input for journald, or we introduce another forwarder (was planning to use rsyslog) | 14:12 |
| shardy | larsks: ack | 14:12 |
| gfidente | jaosorior jistr they log to stdout and rely on the dockerd journal socket | 14:12 |
| jaosorior | gfidente: actually, we took the approach based on input from folks working on Common Logging, and Ceph :D | 14:13 |
| gfidente | (d was in the wrong place) | 14:13 |
| shardy | jaosorior: Ok, well we'll need to figure out the operator impact of that | 14:13 |
| shardy | I think the local file logging will be needed at least for this pre-k8s iteration of TripleO + containers | 14:13 |
| jaosorior | shardy: well, if they deploy the default, everything will stay the same | 14:13 |
| fultonj | diff directions but coming together (whereever it is) is good | 14:13 |
| jaosorior | shardy: one would need to manually choose to deploy to stdout (with an env file) | 14:13 |
| shardy | jaosorior: ++ sounds good then | 14:13 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: ovn: Remove setting of DockerNeutronApiImage param https://review.openstack.org/510900 | 14:14 |
| *** yog_ has quit IRC | 14:14 | |
| mwhahaha | jaosorior thanks, any other things you want to bring up around this? | 14:14 |
| jaosorior | so, folks, please check out the spec, and the reviews https://review.openstack.org/#/q/(topic:+bp/logging-stdout-rsyslog+OR+topic:tripleo-logging)+status:open | 14:15 |
| jaosorior | that was all :D thanks everyone | 14:15 |
| mwhahaha | cool thanks | 14:15 |
| mwhahaha | (d0ugal/fultonj) Improve user experience for when ansible fails | 14:15 |
| * mwhahaha pokes fultonj and d0ugal | 14:15 | |
| fultonj | ack | 14:15 |
| fultonj | there are two examples in the pad showing what the tripleo ansible errors look like | 14:16 |
| d0ugal | ack also | 14:16 |
| fultonj | e.g. http://paste.openstack.org/show/623232 | 14:16 |
| fultonj | .e.g users may not know to ssh in and find the playbook and run it | 14:16 |
| fultonj | same for the heat > mistral > ansible cycle example | 14:17 |
| fultonj | we can document | 14:17 |
| fultonj | but.... | 14:17 |
| *** yog_ has joined #tripleo | 14:17 | |
| fultonj | if we can drop them into an ansible shell with an inventory so they can do ad hoc commands, that would be nice IMO | 14:17 |
| fultonj | do we solve w/ http://lists.openstack.org/pipermail/openstack-dev/2017-September/122234.html | 14:17 |
| shardy | yeah or at least print a message showing how to re-run the step via config download & ansible-playbook | 14:17 |
| jistr | i think situation with cryptic failures in Ansible will get better w/ config-download | 14:18 |
| jistr | yea +1 | 14:18 |
| mwhahaha | there's also just the terrible error messages we generate | 14:18 |
| mwhahaha | or even lack there of sometimes | 14:18 |
| d0ugal | Can ansible output anything other than it's own formatted text? | 14:18 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/newton: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510799 | 14:18 |
| d0ugal | or, in other words, can we get json or something we can make sense of? | 14:18 |
| larsks | d0ugal: well, you can write out data in whatever format you want... | 14:18 |
| jtomasek | d0ugal: I believe that shadower did some formating for ansible output for tripleo-validations | 14:19 |
| larsks | Or have a plugin collect execution info and dump that for you. | 14:19 |
| d0ugal | jtomasek: ah, I thought that looked much neater, I'll need to take a look | 14:19 |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo stable/newton: Handle duplicate/invalid entries in migration SSH inbound addresses https://review.openstack.org/510799 | 14:19 |
| d0ugal | larsks: right, that would be useful. | 14:19 |
| mwhahaha | sdoran do you know if ansible can output better error messages or there's a way we can improve that? | 14:19 |
| fultonj | even without nicer ansible output the user needs to get to it | 14:19 |
| rook | oh logging in Pike, how i loath thee | 14:19 |
| sdoran | That's a fun topic. | 14:19 |
| fultonj | at the moment they have the examples in the pad | 14:19 |
| shadower | d0ugal: there may be a json formatter already in ansible that you should just enable (but I've forgotten and never really tried it and may in fact be hallucinating) | 14:19 |
| shardy | it would probably help if we output the stack failures list with --long by default when a deploy fails | 14:20 |
| sdoran | Do you mean output to standard out? | 14:20 |
| d0ugal | shadower: :) I did a quick google before, I'll look around again | 14:20 |
| sdoran | Usually -vvvv gives you the best debugging output. | 14:20 |
| mwhahaha | sdoran: i think currently we only output the stderr | 14:20 |
| rook | I did have some cool dashboard with kibana built with the rsyslog -> elastic work we have in browbeat... | 14:20 |
| *** pblaho has joined #tripleo | 14:20 | |
| sdoran | But the preferred method today is to enable logging. | 14:20 |
| shadower | d0ugal: if there isn't, this is what tripleo-validations does: https://github.com/openstack/tripleo-validations/blob/master/validations/callback_plugins/validation_output.py | 14:20 |
| sdoran | The log file gets a lot of good info if you enable it. | 14:20 |
| shadower | d0ugal: as larsks said, you can make it output anything you want | 14:21 |
| mwhahaha | d0ugal, shardy: so can we enable the logging and capture that as part of the execution workflow? | 14:21 |
| shadower | d0ugal: I actually planned to do a json output and have the tripleo UI consume that, but got called away before I got the chance | 14:21 |
| shardy | mwhahaha: yes we could, or perhaps modify the heat-config-ansible hook to capture and send back better data | 14:21 |
| mwhahaha | allowing for additional debugging with some id? ie go download the log | 14:21 |
| shardy | mwhahaha: this will obviously get easier if/when we move to driving ansible via mistral outside of heat | 14:22 |
| *** radeks has joined #tripleo | 14:22 | |
| d0ugal | We need to make sure we can display -vvvv to the user in a sensible way, since the output could be huge. | 14:22 |
| fultonj | "_send back_" is the important part IMO | 14:22 |
| mwhahaha | ok so it sounds like we have some possibilities but probably need to PoC and investigate our logging options for the ansible execution | 14:22 |
| d0ugal | yup, sounds good | 14:22 |
| mwhahaha | who can spend some time investigating? | 14:23 |
| * mwhahaha prepares the action item | 14:23 | |
| shardy | fultonj: yeah, well we do have a transport for that already, it's just perhaps not capturing/filtering all the right data | 14:23 |
| d0ugal | mwhahaha: I'll take a look | 14:23 |
| sdoran | I would say the best way to do logging for later analysis would be to enable logging and ship it to an analysis tool like an elastic stack. | 14:23 |
| gfidente | mwhahaha shardy I think execution could be going away in queens | 14:23 |
| gfidente | jistr ^ | 14:23 |
| sdoran | You could have it just forward the log. | 14:23 |
| mwhahaha | #action d0ugal investigate ansible logging options around execution to hopefully improve debugging/UX | 14:23 |
| jtomasek | shardy: in case we plan to let user re-run certain step manually, it would be very good to provide that functionality via API too | 14:23 |
| rook | fultonj Ben England recommends using ANSIBLE_STDOUT_CALLBACK=debug for ansible logging additional to -vvv | 14:23 |
| *** zaneb has joined #tripleo | 14:24 | |
| shardy | jtomasek: ack, yes it should be possible via a similar workflow to that being implemented for minor updates | 14:24 |
| mwhahaha | gfidente: that's fine but we could also have a wrapper around the raw playbook execution that includes log capture | 14:24 |
| shardy | e.g config download then run ansible via mistral | 14:24 |
| sdoran | You could also use a callback plugin to capture job data, but I think you'd get more bang for your buck by just grabbing the log file. | 14:24 |
| sdoran | export ANSIBLE_LOG_PATH=~/ansible.log | 14:24 |
| sdoran | export ANSIBLE_DEBUG=True | 14:24 |
| matbu | d0ugal: mwhahaha shardy i was distract by the RH openstack meeting | 14:24 |
| fultonj | rook: you can -v all you want today | 14:24 |
| fultonj | call back has a wip | 14:24 |
| rook | sure fultonj | 14:24 |
| *** jprovazn has quit IRC | 14:24 | |
| jtomasek | shardy: sounds good | 14:24 |
| matbu | d0ugal: mwhahaha shardy but in the upgrade dfg we are currently facing the ansible output issue | 14:24 |
| fultonj | rook: i mean it's in the THT already if you want it | 14:24 |
| jistr | gfidente, shardy: right re execution going away possibly. We want to rewrite service_workflow_tasks into ansible essentially | 14:24 |
| *** aditya_r has joined #tripleo | 14:25 | |
| rook | fultonj the additional env var. | 14:25 |
| jistr | (following the earlier disussion on ML) | 14:25 |
| matbu | so we are thinking on improving it quickly | 14:25 |
| shardy | gfidente: yeah this gets easier if we do simplify the layers driving ansible | 14:25 |
| gfidente | mwhahaha shardy so it's in the mistral ansible action that we'd need to parse output, not from execution anymore | 14:25 |
| fultonj | rook: i'll show you after | 14:25 |
| jistr | shardy: FYI WIP is here https://review.openstack.org/#/c/510122 https://review.openstack.org/#/c/510781/ | 14:25 |
| jistr | shardy: already PoC tested with bogus tasks, now we need to try and rewrite the useful tasks for k8s, ceph-ansible etc. | 14:26 |
| mwhahaha | matbu: facing how so? figuring out failures or do you need to parse output | 14:26 |
| matbu | mwhahaha: facing failure | 14:26 |
| fultonj | with slagle's work and ansible driving more do we get this there? but pike has the issue? | 14:26 |
| shardy | jistr: ack thanks will check those out | 14:26 |
| marios | jistr: i saw the tripleo-common one this morning and meant to ask you if we already have those defined somewhere (the undercloud_deploy_tasks) | 14:26 |
| mwhahaha | matbu: ok d0ugal is going to investigate some options so maybe you can work with him | 14:26 |
| matbu | mwhahaha: yep we have some ideas too | 14:27 |
| marios | jistr: but i see your comment above not yet | 14:27 |
| matbu | so sound good | 14:27 |
| *** ffiore has quit IRC | 14:27 | |
| mwhahaha | ok yea work with him and provide some ideas | 14:27 |
| jistr | marios: yea not yet, all is to come. I hope to play with Kubespray first, and we could hopefully use some patterns out of there for the rest. | 14:27 |
| *** janki has quit IRC | 14:27 | |
| mwhahaha | ok any other important comments on the ansible logging or can we move on? | 14:27 |
| marios | jistr: thanks | 14:27 |
| shardy | fultonj: yeah there's probably a short term and (different) long term answer but there's probably a common piece around filtering the ansible output to surface the error | 14:28 |
| mwhahaha | fultonj, d0ugal thanks for bringing this up. sounds like we have a bunch of folks running into the same problems | 14:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Add IronicPxe to the default controller https://review.openstack.org/507981 | 14:28 |
| fultonj | rook: https://github.com/openstack/tripleo-common/blob/master/workbooks/ceph-ansible.yaml#L10 | 14:28 |
| mwhahaha | ok moving on to squad status | 14:29 |
| mwhahaha | #topic Squad status | 14:29 |
| *** openstack changes topic to "Squad status (Meeting topic: tripleo)" | 14:29 | |
| mwhahaha | ci | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-ci-squad-scrum | 14:29 |
| mwhahaha | upgrade | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status | 14:29 |
| mwhahaha | containers | 14:29 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-containers-squad-status | 14:29 |
| mwhahaha | dprince, mandre -^ missing today's status | 14:29 |
| *** tongl has joined #tripleo | 14:30 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: EARLY WIP: Convert tags to when statements for Q major upgrade workflow https://review.openstack.org/510902 | 14:30 |
| mwhahaha | integration | 14:30 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-integration-squad-status | 14:30 |
| jtomasek | #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status | 14:30 |
| mwhahaha | jtomasek: thanks! i'll add it in for next week | 14:30 |
| jtomasek | @mwhahaha: thanks | 14:31 |
| *** tongl has quit IRC | 14:31 | |
| *** aditya_r has quit IRC | 14:31 | |
| mwhahaha | validations is still missing a status etherpad | 14:31 |
| mwhahaha | networking is also missing a status etherpad | 14:31 |
| beagles | mwhahaha, I sent an email out this morning "[tripleo][networking] Organizing the networking squad " | 14:31 |
| * mwhahaha hasn't gotten to his email | 14:31 | |
| mwhahaha | sounds good | 14:32 |
| mwhahaha | i'll keep an eye on it | 14:32 |
| beagles | mwhahaha, basically the networking squad "wasn't" but with everything that's been going on, I think it's time to get it together | 14:32 |
| beagles | (or past time really ... ) | 14:32 |
| mwhahaha | #link http://lists.openstack.org/pipermail/openstack-dev/2017-October/123356.html - networking squad | 14:32 |
| mwhahaha | beagles: yea sounds good, thanks for starting the effort | 14:32 |
| gfidente | beagles now how can the networking squad not be together | 14:32 |
| gfidente | am I the only one seeing the irony? | 14:32 |
| beagles | :) | 14:33 |
| EmilienM | nice summaries, I found it very useful to have async status | 14:33 |
| mwhahaha | d0ugal/thrash: do you guys have a status update for workflows? | 14:33 |
| * gfidente yes you were | 14:33 | |
| thrash | mwhahaha: making good progress on bp's to support ui. | 14:33 |
| mwhahaha | thrash: thanks, let us know if you need anything specific. Also make sure to keep the bps up to date | 14:34 |
| thrash | mwhahaha: should have most with patches at least posted by M1 | 14:34 |
| * mwhahaha will be mentioning bps next | 14:34 | |
| mwhahaha | there's also a python3 squd listed but i'm not sure anyone is actually doing any python3 specific things | 14:34 |
| mwhahaha | s/squd/squad | 14:34 |
| mwhahaha | so that's all on the status, thanks everyone for providing them | 14:35 |
| EmilienM | no we can probably remove that one | 14:35 |
| *** aditya_r has joined #tripleo | 14:35 | |
| *** ebarrera has quit IRC | 14:35 | |
| mwhahaha | ok | 14:35 |
| *** chlong has quit IRC | 14:36 | |
| *** chlong_ has quit IRC | 14:36 | |
| mwhahaha | #action mwhahaha to remove python3 squad from the list | 14:36 |
| mwhahaha | #topic bugs & blueprints | 14:36 |
| mwhahaha | #link https://launchpad.net/tripleo/+milestone/queens-1 | 14:36 |
| mwhahaha | For Queens we currently have 69 (+7) blueprints and about 444 (-32) open bugs. 193 queens-1, 254 queens-2 and 3 queens-3. Please take some time to review your blueprint status and make sure it is properly up to date. queens-1 is next week! | 14:36 |
| *** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)" | 14:36 | |
| *** chlong has joined #tripleo | 14:36 | |
| mwhahaha | So yea queens-1 next week. please update bugs/blueprints if they won't merge | 14:36 |
| marios | mwhahaha: for this one https://blueprints.launchpad.net/tripleo/+spec/major-upgrade-workflow i repurposed it this morning after chat with matbu, so we can track upgrades for Q... i'll retarget to Q3 | 14:37 |
| mwhahaha | marios: ok thanks i was going to ask about that one | 14:37 |
| EmilienM | q3 | 14:37 |
| marios | thanks | 14:37 |
| EmilienM | I thought the workflow would be for m2 | 14:37 |
| EmilienM | so m3 we spend time on stabilization | 14:37 |
| mwhahaha | marios: yea m3 might be a bit late, anyway to get that in m2? | 14:37 |
| marios | mwhahaha: ack | 14:37 |
| EmilienM | marios: do you think it's realistic to have it for m2? like the basic workflow? | 14:38 |
| marios | EmilienM: we can try it *might* be possible... the workflow in theory isn't radically different to what we have in some parts already | 14:38 |
| *** ffiore has joined #tripleo | 14:38 | |
| marios | (ansible etc) | 14:38 |
| EmilienM | yeah | 14:38 |
| marios | EmilienM: but T&C apply :) | 14:38 |
| *** pblaho has quit IRC | 14:38 | |
| *** sid1 has quit IRC | 14:39 | |
| marios | EmilienM: but today we are still landing things for P so... | 14:39 |
| EmilienM | indeed | 14:39 |
| mwhahaha | yea we have to catch up or it'll keep slipping | 14:39 |
| *** ebarrera has joined #tripleo | 14:39 | |
| mwhahaha | marios: if you have things that others can assist with it would be good to publicise some of the plans | 14:40 |
| mwhahaha | maybe we can get additional assitance to land either pike or queens efforts | 14:40 |
| marios | mwhahaha: ack we have a spec already (for example) linked in the upgrades squad status for interested folks | 14:41 |
| marios | mwhahaha: as starter at least | 14:41 |
| *** pblaho has joined #tripleo | 14:41 | |
| EmilienM | marios: is there work on the CI space we need to prioritize to help you in the testing? or all is already under control? | 14:41 |
| *** pblaho has quit IRC | 14:41 | |
| matbu | EmilienM: marios (in a mtg) but Yes its realistic | 14:41 |
| *** pblaho has joined #tripleo | 14:41 | |
| marios | EmilienM: it is on our radar that we have a basic keystone only job in place for m2 | 14:41 |
| marios | EmilienM: and yeah we will reach out to ci squad | 14:42 |
| mwhahaha | sounds like there's some movement on it, so let's revisit it in ~2 weeks or so | 14:42 |
| EmilienM | marios: cool | 14:42 |
| *** aditya_r has quit IRC | 14:42 | |
| *** ccamacho_ has joined #tripleo | 14:42 | |
| mwhahaha | #action marios and matbuto provide an upgrade workflow status in 2 weeks (reminder) | 14:43 |
| *** aditya_r has joined #tripleo | 14:43 | |
| mwhahaha | so the other blueprint i wanted to ask about was https://blueprints.launchpad.net/tripleo/+spec/ovs-container-support | 14:43 |
| trozet | EmilienM: who can I talk to about the oooqs experimental gate job? I would like to know where tempest runs from and how that external vxlan tunnel is being used | 14:43 |
| mwhahaha | dprince, Slower, beagles: do we have any additional info on the ovs containerization? | 14:43 |
| EmilienM | trozet: we can talk about that after the meeting if you don't mind | 14:44 |
| matbu | marios: EmilienM actually we have an *almost* noop workflow in reviews | 14:44 |
| beagles | mwhahaha, I don't have any at the moment - its the next thing I'm working on after finishing off some octavia related stuff | 14:44 |
| trozet | EmilienM: ok thanks | 14:44 |
| beagles | mwhahaha, others might have some updates though... | 14:44 |
| mwhahaha | beagles: ok so we need to get that figured out asap | 14:45 |
| marios | matbu: cool add it to the squad status etherpad? | 14:45 |
| beagles | mwhahaha, yep | 14:45 |
| mwhahaha | i'll keep bringing it up as a reminder | 14:45 |
| mwhahaha | moving on | 14:45 |
| mwhahaha | #topic projects releases or stable backports | 14:45 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:45 | |
| matbu | marios: yep i'll | 14:46 |
| mwhahaha | EmilienM: did the newton/ocata/pike releases go out? | 14:46 |
| EmilienM | this week | 14:46 |
| mwhahaha | k | 14:46 |
| EmilienM | i'm still on it | 14:46 |
| EmilienM | probably today | 14:46 |
| mwhahaha | any stable backports folks want attention on? | 14:46 |
| mwhahaha | i've also asked to switch the scenario upgrade jobs to non-voting for ocata | 14:46 |
| mwhahaha | to free up stable/ocata reviews | 14:46 |
| *** pblaho has quit IRC | 14:46 | |
| jaosorior | well, this one is merging in stable/newton https://review.openstack.org/#/c/510738/ hope the release includes it :D | 14:46 |
| mwhahaha | #link https://review.openstack.org/#/q/status:open+topic:tripleo-upgrade-jobs-nv | 14:47 |
| EmilienM | jaosorior: we release every 2 weeks btw | 14:47 |
| mwhahaha | or at least will try to :D | 14:48 |
| mwhahaha | gates willing | 14:48 |
| itlinux | hello all. does anyone have a multi-region config with OOO? | 14:48 |
| itlinux | thanks | 14:48 |
| mwhahaha | moving on to specs | 14:48 |
| mwhahaha | #topic specs | 14:48 |
| mwhahaha | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:48 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:48 | |
| mwhahaha | reminder queens-1 next week, so we should be merging specs | 14:48 |
| mwhahaha | please take some time to review the open specs | 14:48 |
| *** rcernin has quit IRC | 14:49 | |
| mwhahaha | anyone have a spec (other than the already mentioned logging one) that they'd like to bring attention to? | 14:49 |
| EmilienM | what happens in queens-2? do we postpone specs to rocky? | 14:49 |
| mwhahaha | yes i think so | 14:49 |
| EmilienM | we might want make this information more visible then | 14:49 |
| shardy | we've never managed to do that before due to lack of velocity in the specs repo | 14:49 |
| shardy | but worth a try I guess, particularly given the stabilization theme this cycle | 14:50 |
| EmilienM | given that we had many CI issues during queens-1 and have lost some time, we could defer the deadline to November 3 | 14:50 |
| mwhahaha | I'll send a note to the ML about it | 14:50 |
| mwhahaha | and we can discuss it | 14:50 |
| EmilienM | so we have 3 weeks | 14:50 |
| EmilienM | after that, no more specs approved for queens | 14:51 |
| EmilienM | how does it sound? | 14:51 |
| *** artom has joined #tripleo | 14:51 | |
| *** links has joined #tripleo | 14:51 | |
| gfidente | EmilienM +1 | 14:51 |
| mwhahaha | well i wasn't going to move the specs until the end of queens-2 | 14:51 |
| mwhahaha | to at least give some time for review | 14:51 |
| mwhahaha | but if you want to do it earlier that works for me | 14:51 |
| *** ccamacho_ has quit IRC | 14:51 | |
| EmilienM | I think we wanted us to be a bit more conservative for queens | 14:52 |
| EmilienM | freezing queens specs earlier is imho part of this effort | 14:52 |
| mwhahaha | k let's look at the schedule and i'll send an ML note | 14:52 |
| EmilienM | during Pike, folks sent Pike specs after m3 :D | 14:52 |
| mwhahaha | https://releases.openstack.org/queens/schedule.html | 14:52 |
| EmilienM | we might want to fix that at least | 14:52 |
| *** artom_ has joined #tripleo | 14:52 | |
| *** aditya_r has quit IRC | 14:53 | |
| mwhahaha | so i think queens-2 is a decent spot to freeze the specs | 14:53 |
| mwhahaha | it's not like we've been super hard on requiring specs as well | 14:54 |
| EmilienM | if we respect it, it's already a good progress comparing to newton & pike cycles | 14:54 |
| mwhahaha | k i'll send an ML note | 14:54 |
| mwhahaha | #action mwhahaha to send a note about spec reviews and spec freeze at queens-2 | 14:54 |
| mwhahaha | busy meeting today, so let's allow for some open discussion | 14:55 |
| mwhahaha | #topic open discussion | 14:55 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:55 | |
| *** florianf_brb is now known as florianf | 14:55 | |
| mwhahaha | anyone have anything else they want to talk about? | 14:55 |
| *** artom has quit IRC | 14:55 | |
| mwhahaha | i'll take that as a no | 14:56 |
| mwhahaha | thanks everyone | 14:57 |
| mwhahaha | #endmeeting | 14:57 |
| *** openstack changes topic to "CI Status: GREENish (see alerts) | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 14:57 | |
| openstack | Meeting ended Tue Oct 10 14:57:03 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:57 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-10-14.00.html | 14:57 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-10-14.00.txt | 14:57 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-10-10-14.00.log.html | 14:57 |
| *** ykarel is now known as ykarel|afk | 14:57 | |
| EmilienM | trozet: can you describe your problem please? | 14:57 |
| *** ecerquei has joined #tripleo | 15:01 | |
| *** pblaho has joined #tripleo | 15:02 | |
| openstackgerrit | Luigi Toscano proposed openstack/tripleo-quickstart master: Fix/enable the Tempest tests for Sahara and Manila https://review.openstack.org/509554 | 15:02 |
| *** ecerquei__ has quit IRC | 15:03 | |
| trozet | EmilienM: the ODL ci gate job failed: http://logs.openstack.org/05/486905/26/experimental/gate-tripleo-ci-centos-7-scenario008-multinode-oooq-nv/b95e113/logs/tempest.html.gz | 15:04 |
| *** aditya_r has joined #tripleo | 15:04 | |
| trozet | EmilienM: looking at the tempest log I can see the nova console log down to the 2nd sending discover | 15:04 |
| trozet | EmilienM: i dont see the rest of the nova console log, so i dont know if it got an IP from dhcp or not | 15:05 |
| *** itlinux has quit IRC | 15:05 | |
| trozet | EmilienM: after that it checks if there is connectivity via the FIP, which fails | 15:05 |
| *** bfournie has joined #tripleo | 15:06 | |
| trozet | EmilienM: so first question I guess is what kind of setup is this. Is the undercloud a VM and is subnode-2 (all in one) a VM on a single host? | 15:06 |
| *** spectr has quit IRC | 15:07 | |
| EmilienM | trozet: everything is a vm, running with nodepool - 2 nodes: undercloud + 1-node overcloud | 15:07 |
| *** artom_ is now known as artom | 15:08 | |
| trozet | EmilienM: ok and where does tempest execute from? | 15:08 |
| *** aditya_r has quit IRC | 15:09 | |
| lvdombrkr | folks, where i can see pacemaker detailed logs, for example reason why node not become as master etc | 15:09 |
| *** yprokule has quit IRC | 15:10 | |
| EmilienM | trozet: undercloud | 15:10 |
| trozet | EmilienM: ok and looking at the ovs output: http://logs.openstack.org/05/486905/26/experimental/gate-tripleo-ci-centos-7-scenario008-multinode-oooq-nv/b95e113/logs/subnode-2/var/log/extra/odl/odl_info.txt.gz | 15:12 |
| trozet | EmilienM: there is a vxlan tunnel on br-ex. Is that being used to tunnel the external network through the ctlplane port to the undercloud | 15:12 |
| EmilienM | trozet: yes I think, otherwise floating ips couldn't be pinged right? | 15:13 |
| *** cshastri has quit IRC | 15:13 | |
| trozet | EmilienM: yeah | 15:14 |
| trozet | EmilienM: i'm going to have to reproduce this setup, because the OVS outputs are captured after things are deleted | 15:14 |
| *** shreshtha has joined #tripleo | 15:14 | |
| trozet | EmilienM: so just wanted to make sure my understanding was correct. All the config looks good to me | 15:15 |
| openstackgerrit | Michele Baldessari proposed openstack/instack-undercloud master: WIP Disabled libvirtd on the undercloud https://review.openstack.org/510911 | 15:15 |
| openstackgerrit | Michele Baldessari proposed openstack/instack-undercloud master: WIP Disable libvirtd on the undercloud https://review.openstack.org/510911 | 15:16 |
| *** ccamacho has joined #tripleo | 15:17 | |
| *** psachin has quit IRC | 15:18 | |
| *** spectr has joined #tripleo | 15:19 | |
| *** dpawar has quit IRC | 15:20 | |
| *** links has quit IRC | 15:20 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 15:20 |
| EmilienM | sshnaidm: do we have CI jobs recent results with zuul v3 | 15:20 |
| EmilienM | ? | 15:20 |
| sshnaidm | EmilienM, what I saw was failing on tempest image (patch is in the gate) | 15:20 |
| lvdombrkr | folks, where i can see pacemaker detailed logs, for example reason why node not become as master etc | 15:21 |
| bandini | lvdombrkr: /var/log/cluster/corosync.log is usually the log to start from | 15:22 |
| *** gbarros has quit IRC | 15:23 | |
| *** dparkes has quit IRC | 15:23 | |
| *** cylopez has quit IRC | 15:24 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Stop services before upgrade only before Pike https://review.openstack.org/510914 | 15:25 |
| lvdombrkr | bandini: thanks... other question if deploy overcloud with dvr, can i somehow add not distributed router to my environment? | 15:25 |
| bandini | lvdombrkr: dvr and pacemaker are completely unrelated (unless this is a pre-newton env) | 15:27 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Stop services before upgrade only before Pike https://review.openstack.org/510914 | 15:27 |
| lvdombrkr | bandini: yes i know | 15:27 |
| *** jprovazn has joined #tripleo | 15:29 | |
| *** udesale__ has joined #tripleo | 15:31 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart-extras master: Stop services before upgrade only before Pike https://review.openstack.org/510914 | 15:31 |
| *** shardy_ has joined #tripleo | 15:32 | |
| *** dmarlin has joined #tripleo | 15:32 | |
| EmilienM | slagle: this time it fails for a real reason: http://logs.openstack.org/07/508307/11/check/gate-tripleo-ci-centos-7-containers-multinode/4ee9f90/logs/undercloud/home/jenkins/ansible_steps.log.txt.gz#_2017-10-10_01_33_37 | 15:32 |
| EmilienM | slagle: the db thing, that we saw in pair programming with dprince & Slower 2 weeks ago | 15:32 |
| slagle | EmilienM: yea, i saw that. not sure what's causing it this time | 15:33 |
| *** udesale__ has quit IRC | 15:33 | |
| slagle | EmilienM: i have a local env up. about to be at that point and will debug it if it fails | 15:33 |
| EmilienM | slagle: last time, we fixed it with https://review.openstack.org/#/c/508618/ right? | 15:33 |
| *** mrch has quit IRC | 15:34 | |
| slagle | EmilienM: no. that was something different. it should be fixed in the latest tripleo-common and t-h-t patches | 15:34 |
| slagle | EmilienM: it was the issue where deploy_server_id did not equal bootstrap_server_id | 15:35 |
| slagle | but, i fixed that. so might be something different | 15:35 |
| slagle | EmilienM: did you see I added the inventory and tripleo-config-download dir to the ci collected logs? | 15:36 |
| EmilienM | slagle: yeah I just +2'ed it | 15:36 |
| slagle | EmilienM: that should be nice...we should be able to just download those and try and reproduce as long as you have a subnode setup | 15:36 |
| slagle | but you wouldnt need an undercloud or anything | 15:36 |
| EmilienM | yeah | 15:37 |
| *** ccamacho has quit IRC | 15:37 | |
| EmilienM | awesome :D | 15:37 |
| *** gbarros has joined #tripleo | 15:37 | |
| *** ebarrera has quit IRC | 15:38 | |
| EmilienM | slagle: i'm also re-deploying with latest traas & patchsets in the reviews | 15:38 |
| owalsh | EmilienM: hi, do we need to support puppet 3.x in puppet-tripleo for ocata? | 15:40 |
| *** salmankhan has quit IRC | 15:40 | |
| *** shardy_ has quit IRC | 15:40 | |
| mwhahaha | owalsh: not for ocata | 15:40 |
| *** salmankhan has joined #tripleo | 15:40 | |
| mwhahaha | i think | 15:41 |
| * mwhahaha double checks packages | 15:41 | |
| owalsh | mwhahaha: it's passing in CI, but we still have a legacy syntax job for puppet 3 | 15:41 |
| mwhahaha | techincally i think ocata is 4 | 15:41 |
| mwhahaha | cause we switched out the rdo package | 15:42 |
| mwhahaha | but puppet openstack it wasn't official till pike | 15:42 |
| owalsh | mwhahaha: has to use a custom function for newton, maybe safer to use this in ocata too? | 15:43 |
| mwhahaha | yea | 15:43 |
| *** aufi_ has quit IRC | 15:43 | |
| owalsh | mwhahaha: ack, thanks | 15:43 |
| *** yamahata has joined #tripleo | 15:44 | |
| EmilienM | mwhahaha, owalsh: ocata is 4, I confirm | 15:44 |
| owalsh | EmilienM: cool, thanks | 15:45 |
| shardy | matbu: Hi, can you point me to what environment files we use to disable PostDeploySteps when running the --init-minor-update stack update please? | 15:46 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates stable/newton: Correctly set DEFAULT/dhcp_domain to empty string. https://review.openstack.org/506688 | 15:47 |
| matbu | shardy: we update it directly in the package_update mistral action | 15:50 |
| *** tongl has joined #tripleo | 15:50 | |
| matbu | shardy: we generate a noop dictionary | 15:50 |
| shardy | matbu: aha, OK thanks, I was expecting a file in t-h-t so the same steps could be run manually | 15:51 |
| shardy | matbu: we're trying to test minor updates directly via ansible-playbook at a hackfest | 15:51 |
| matbu | shardy: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/package_update.py#L61 | 15:51 |
| matbu | shardy: ha k, so you just make the --init stuff and then play with ansible | 15:52 |
| matbu | you can* | 15:52 |
| mwhahaha | interesting containers upgrade failure on new dep for os-net-config or something http://logs.openstack.org/54/510754/1/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/1231fde/logs/undercloud/home/jenkins/overcloud_upgrade_console.log.txt.gz#_2017-10-10_07_28_26 | 15:52 |
| florianf | akrivoka, gchamoul: Would you mind checking if you have anything to add to the validations squad status: https://etherpad.openstack.org/p/tripleo-validations-squad-status | 15:53 |
| beagles | anyone see something like this: "docker pull failed: error parsing HTTP 404 response body: json: cannot unmarshal number" when running container image upload? | 15:54 |
| shardy | matbu: ack thanks - I wasn't sure if we added anything more than the PostDeploySteps mapping to OS::Heat::None | 15:54 |
| shardy | matbu: will give it a try, thanks for the info! | 15:54 |
| florianf | akrivoka, gchamoul: I missed mentioning it earlier during the weekly, but would like to send it to the ML later... :-) | 15:54 |
| akrivoka | florianf: is that the list of things we're currently working on? | 15:55 |
| *** jprovazn has quit IRC | 15:55 | |
| matbu | shardy: no pb | 15:56 |
| matbu | shardy: you are in a hackfest, about tripleo ? | 15:56 |
| florianf | akrivoka: It's the fresh and new weekly status update. :-) So just an overview of what's going on I guess. I marked things that were completed last week as [DONE], but still mentioned ongoing work. | 15:57 |
| *** egonzalez has quit IRC | 15:57 | |
| florianf | akrivoka: No strong opinions on the format though... :-) | 15:57 |
| *** ykarel|afk has quit IRC | 15:58 | |
| openstackgerrit | Numan Siddique proposed openstack/puppet-tripleo stable/pike: ovn HA: Enable ip_nonlocal_bind sysctl flag https://review.openstack.org/510754 | 16:00 |
| akrivoka | florianf: thanks! I added a thing, feel free to re-format as necessary :) | 16:00 |
| *** yamahata has quit IRC | 16:00 | |
| florianf | akrivoka: thank you! | 16:01 |
| *** ffiore has quit IRC | 16:06 | |
| *** pcaruana has quit IRC | 16:07 | |
| *** lucasagomes is now known as lucas-afk | 16:08 | |
| *** yog_ has quit IRC | 16:11 | |
| *** cylopez has joined #tripleo | 16:11 | |
| *** marios has quit IRC | 16:13 | |
| *** yog_ has joined #tripleo | 16:28 | |
| *** salmankhan has quit IRC | 16:32 | |
| *** Guest66098 is now known as mgagne | 16:34 | |
| *** mgagne has quit IRC | 16:34 | |
| *** mgagne has joined #tripleo | 16:34 | |
| *** salmankhan has joined #tripleo | 16:34 | |
| *** ecerquei_ has joined #tripleo | 16:35 | |
| *** hewbrocca is now known as hewbrocca_afk | 16:35 | |
| *** ecerquei has quit IRC | 16:36 | |
| trozet | mwhahaha: can you please review https://review.openstack.org/#/c/489749/ when you have a moment | 16:38 |
| *** aditya_r has joined #tripleo | 16:39 | |
| *** salmankhan has quit IRC | 16:39 | |
| *** jpich has quit IRC | 16:39 | |
| *** hjensas has quit IRC | 16:43 | |
| *** jlinkes has quit IRC | 16:43 | |
| *** jlinkes has joined #tripleo | 16:44 | |
| *** shardy has quit IRC | 16:46 | |
| *** dparkes has joined #tripleo | 16:46 | |
| *** yog_ has quit IRC | 16:53 | |
| *** tesseract has quit IRC | 16:53 | |
| *** derekh has quit IRC | 16:53 | |
| *** artom has quit IRC | 16:59 | |
| *** sid1 has joined #tripleo | 17:00 | |
| *** yog_ has joined #tripleo | 17:01 | |
| mwhahaha | weshay: https://bugs.launchpad.net/tripleo/+bug/1722558 looks like it failled pulling down the undercloud.qcow | 17:03 |
| openstack | Launchpad bug 1722558 in tripleo "Promoter: identify a way to store privately the secrets used by the promotion server, so they can be used in all the promotion-setup runs" [Medium,Triaged] | 17:03 |
| mwhahaha | err wrong bug | 17:03 |
| *** athomas has quit IRC | 17:03 | |
| mwhahaha | weshay: https://bugs.launchpad.net/tripleo/+bug/1722596 | 17:03 |
| openstack | Launchpad bug 1722596 in tripleo "baremetal bond-with-vlans in pike is failing" [High,Triaged] - Assigned to wes hayutin (weshayutin) | 17:03 |
| *** lifeless has quit IRC | 17:03 | |
| *** aditya_r has quit IRC | 17:03 | |
| *** dbecker has quit IRC | 17:04 | |
| *** etingof has quit IRC | 17:04 | |
| weshay | mwhahaha, I'm just getting that job tracked for another review | 17:04 |
| weshay | I'll be digging into that job, it's been failing since august | 17:04 |
| mwhahaha | weshay: k i pasted it as a comment in the bug | 17:05 |
| *** trown is now known as trown|lunch | 17:05 | |
| *** jpena is now known as jpena|off | 17:05 | |
| *** mcornea has quit IRC | 17:06 | |
| *** yog_ has quit IRC | 17:06 | |
| *** panda is now known as panda|off | 17:08 | |
| *** gbarros has quit IRC | 17:11 | |
| *** etingof has joined #tripleo | 17:12 | |
| openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo master: Allow 'cinder' as a backend for Glance https://review.openstack.org/510953 | 17:12 |
| *** jkilpatr_ has joined #tripleo | 17:13 | |
| *** thrash is now known as thrash|biab | 17:14 | |
| *** jkilpatr has quit IRC | 17:14 | |
| *** rwsu has quit IRC | 17:16 | |
| *** yog_ has joined #tripleo | 17:19 | |
| *** Goneri has joined #tripleo | 17:20 | |
| *** lifeless has joined #tripleo | 17:20 | |
| *** bfournie has quit IRC | 17:20 | |
| *** shreshtha has quit IRC | 17:23 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Remove oslosphinx https://review.openstack.org/508588 | 17:25 |
| *** rwsu has joined #tripleo | 17:27 | |
| *** rwsu has quit IRC | 17:32 | |
| *** agurenko has quit IRC | 17:34 | |
| *** dsneddon is now known as dsneddon_afk | 17:37 | |
| *** dtantsur is now known as dtantsur|afk | 17:38 | |
| sshnaidm | trown|lunch, do you know why it fails on pep8? weird: https://review.openstack.org/#/c/476708/ | 17:41 |
| *** hewbrocca_afk is now known as hewbrocca | 17:42 | |
| *** tosky has quit IRC | 17:43 | |
| bnemec | sshnaidm: The tool needs to be updated to use the consistent descriptions. I'll take care of that. | 17:44 |
| rook | zaneb shardy - so the only thing I am noticing with convergence enabled is when trying to scale up, it is failing with : 2017-10-10 16:37:05Z [overcloud-CephStorage-hq5zn7biltkn.8]: CREATE_FAILED ClientException: resources[8].resources.CephStorage: Unexpected API Error. Please report this at http: //bugs.laun | 17:45 |
| rook | ^ bad copy, but you get the gist... | 17:45 |
| rook | I wasn't getting these prior to convergence. | 17:45 |
| *** achadha has joined #tripleo | 17:45 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add unit tests for fluentd profile https://review.openstack.org/505124 | 17:46 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Bring the keystone utils up-to-date with Mistral https://review.openstack.org/510527 | 17:46 |
| *** bfournie has joined #tripleo | 17:50 | |
| *** sshnaidm is now known as sshnaidm|off | 17:52 | |
| *** jcoufal has joined #tripleo | 17:53 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common stable/pike: Ensure ssh key is active before returning from create_admin_via_nova https://review.openstack.org/510970 | 17:57 |
| *** fandrieu_ has joined #tripleo | 18:02 | |
| *** fandrieu_ has quit IRC | 18:02 | |
| *** ecerquei_ has quit IRC | 18:02 | |
| *** fandrieu has quit IRC | 18:04 | |
| *** tosky has joined #tripleo | 18:04 | |
| *** trown|lunch is now known as trown | 18:05 | |
| *** sid2 has joined #tripleo | 18:07 | |
| *** sid1 has quit IRC | 18:07 | |
| bnemec | sshnaidm|off: trown: The tool has been updated to use the consistent descriptions: https://github.com/cybertron/tripleo-scripts/commit/66d2a0e5e8c79dec073ad3b35af66a905813980e | 18:08 |
| bnemec | You can either re-generate the templates or just fix them by hand and it should be fine. | 18:09 |
| bnemec | Although beware if you try to use sed. There are two instances of the storage mgmt network in the templates and one needs to be "storage mgmt" and the other "storage_mgmt" | 18:09 |
| bnemec | Because consistency! | 18:09 |
| *** jtomasek has quit IRC | 18:09 | |
| *** fragatina has quit IRC | 18:11 | |
| *** dsneddon_afk has quit IRC | 18:13 | |
| *** amoralej is now known as amoralej|off | 18:13 | |
| *** radeks has quit IRC | 18:14 | |
| *** pkovar has quit IRC | 18:15 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-docs master: Add documentation for TripleO/RDO/OSP Pipelines https://review.openstack.org/510657 | 18:19 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Point ceph-ansible to the stable-3.0 version of the docker image https://review.openstack.org/510984 | 18:20 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-docs master: Add documentation for TripleO/RDO/OSP Pipelines https://review.openstack.org/510657 | 18:21 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Default the Ceph docker image to the stable version https://review.openstack.org/510986 | 18:24 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Do not override the docker image for scenario001 https://review.openstack.org/510984 | 18:27 |
| weshay | toure, ping is this a mistral issue? https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/28b28c1/undercloud/home/jenkins/overcloud_prep_images.log.txt.gz | 18:29 |
| *** sid2 has quit IRC | 18:31 | |
| *** sid1 has joined #tripleo | 18:32 | |
| weshay | hrybacki, ping.. keystone question re: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/28b28c1/undercloud/var/log/keystone/keystone.log.txt.gz | 18:36 |
| * toure looks | 18:37 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Config download support for all deployments https://review.openstack.org/508189 | 18:37 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible https://review.openstack.org/508307 | 18:38 |
| toure | weshay not a mistral problem, just crappy error output, I am currently working on fixing that output | 18:39 |
| weshay | toure, thanks | 18:40 |
| weshay | toure, so nova or keystone you think? | 18:40 |
| weshay | toure, check out this log.. https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/28b28c1/undercloud/var/log/keystone/keystone.log.txt.gz | 18:41 |
| toure | Nova hypervisor list command failed | 18:41 |
| weshay | https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/28b28c1/undercloud/var/log/keystone/keystone.log.txt.gz#_2017-10-10_18_13_39_896 | 18:42 |
| *** gbarros has joined #tripleo | 18:42 | |
| weshay | toure, ah.. here's the trace https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/28b28c1/undercloud/var/log/nova/nova-compute.log.txt.gz#_2017-10-10_16_36_09_231 | 18:42 |
| toure | weshay that looks like a lot of keystone api traffic | 18:42 |
| *** thrash|biab is now known as thrash | 18:43 | |
| *** mcornea has joined #tripleo | 18:43 | |
| toure | weshay is this node still available ? | 18:43 |
| weshay | nope | 18:44 |
| *** jprovazn has joined #tripleo | 18:45 | |
| hrybacki | weshay o/ in mtg atm, what's up? | 18:47 |
| weshay | hrybacki, latest errors on master | 18:47 |
| weshay | I think are related to keystone, not sure though | 18:47 |
| hrybacki | weshay: I'm seeing a lot of warnings in the logs but no error | 18:49 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-docs master: Add documentation for TripleO/RDO/OSP Pipelines https://review.openstack.org/510657 | 18:51 |
| EmilienM | weshay: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/28b28c1/undercloud/var/log/nova/nova-compute.log.txt.gz#_2017-10-10_18_07_36_272 | 18:51 |
| EmilienM | bouh | 18:51 |
| EmilienM | something still using v2 api | 18:51 |
| weshay | ya | 18:51 |
| weshay | is that booo or boo yah? | 18:51 |
| weshay | EmilienM, trown is bringing up an env now | 18:51 |
| hrybacki | keystone mtg stil going on, I'll mention this | 18:51 |
| toure | EmilienM you beat me to it | 18:51 |
| toure | :) | 18:51 |
| weshay | EmilienM, I'll write the inital bug | 18:52 |
| weshay | I already linked that log :P | 18:52 |
| EmilienM | yeah found it | 18:52 |
| EmilienM | weshay: ^ | 18:52 |
| EmilienM | [ironic] in nova.conf miss domain params | 18:52 |
| EmilienM | so v2 is used | 18:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/510309 | 18:53 |
| EmilienM | it's something to fix in puppet-nova | 18:53 |
| hrybacki | EmilienM: did I miss this? | 18:54 |
| *** fandrieu has joined #tripleo | 18:54 | |
| EmilienM | hrybacki: we missed to add domain params | 18:54 |
| EmilienM | I'm sending a patch | 18:54 |
| hrybacki | ack | 18:54 |
| trown | ah indeed https://github.com/openstack/puppet-nova/blob/master/manifests/ironic/common.pp | 18:55 |
| weshay | EmilienM, https://bugs.launchpad.net/tripleo/+bug/1722621 | 18:57 |
| openstack | Launchpad bug 1722621 in tripleo "ERROR nova.virt.ironic.driver NotFound: (http://192.168.24.3:35357/v2.0/tokens):" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 18:57 |
| *** radeks has joined #tripleo | 18:59 | |
| EmilienM | weshay, trown, hrybacki : https://review.openstack.org/510992 | 18:59 |
| *** gfidente is now known as gfidente|afk | 18:59 | |
| mnaser | mwhahaha https://review.openstack.org/#/c/510417/ zuulv3 failed here in legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet fyi | 18:59 |
| EmilienM | mnaser: thx | 19:00 |
| mwhahaha | known issue | 19:00 |
| *** rwsu has joined #tripleo | 19:00 | |
| trown | EmilienM: and "Default" works as a default? or we need to update instack-undercloud too? | 19:01 |
| mwhahaha | the cirros image on disk location changed between v2/v3 | 19:01 |
| mwhahaha | mnaser: there's a patch for that in the gate so we should see that green tonight | 19:01 |
| mnaser | ok cool | 19:01 |
| mwhahaha | mnaser: https://review.openstack.org/#/c/510839/ | 19:01 |
| EmilienM | http://logs.openstack.org/17/510417/2/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/bac4ac3/job-output.txt.gz#_2017-10-10_18_31_49_613794 | 19:01 |
| EmilienM | trown: no need to update instack-undercloud immediatly | 19:02 |
| EmilienM | trown: we could but this patch will set Default | 19:02 |
| EmilienM | mwhahaha: are you sure it's same problem? | 19:02 |
| mnaser | EmilienM mwhahaha cool thank you, i'll ping if i see any other failures show up | 19:02 |
| mwhahaha | EmilienM: yes | 19:02 |
| EmilienM | mwhahaha: ok good then | 19:02 |
| *** ecerquei has joined #tripleo | 19:03 | |
| mwhahaha | ERROR tempest IOError: [Errno 2] No such file or directory: '/opt/stack/cache/files/cirros-0.3.5-x86_64-disk.img | 19:03 |
| * mwhahaha checked :D | 19:03 | |
| mwhahaha | http://logs.openstack.org/17/510417/2/check/legacy-tripleo-ci-centos-7-scenario002-multinode-oooq-puppet/bac4ac3/job-output.txt.gz#_2017-10-10_18_26_30_911965 | 19:03 |
| EmilienM | mwhahaha: ok perfect, sorry i didn't find this log | 19:03 |
| mwhahaha | giant logs | 19:03 |
| *** milan has quit IRC | 19:04 | |
| EmilienM | mwhahaha: ocata / pike released and pushed to RDO as well | 19:06 |
| mwhahaha | k | 19:06 |
| EmilienM | mwhahaha: newton ongoing (waiting for one backport) | 19:06 |
| *** gbarros has quit IRC | 19:08 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/510309 | 19:09 |
| *** jkilpatr_ has quit IRC | 19:12 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Use sub_nodes_private instead of node_private https://review.openstack.org/509704 | 19:15 |
| *** mcornea has quit IRC | 19:15 | |
| *** rcernin has joined #tripleo | 19:16 | |
| *** jkilpatr has joined #tripleo | 19:27 | |
| *** cylopez has left #tripleo | 19:38 | |
| *** jfrancoa has quit IRC | 19:38 | |
| *** gfidente|afk has quit IRC | 19:39 | |
| *** radeks has quit IRC | 19:39 | |
| *** pkovar has joined #tripleo | 19:41 | |
| *** aputtur has quit IRC | 19:41 | |
| *** archit has quit IRC | 19:47 | |
| *** gbarros has joined #tripleo | 19:53 | |
| *** jprovazn has quit IRC | 19:55 | |
| *** pkovar has quit IRC | 19:55 | |
| EmilienM | mwhahaha: afik https://review.openstack.org/#/c/510992/ is our last blocker for rdo promotion - maybe I missed something else | 19:56 |
| EmilienM | trown: do we have anything else? | 19:56 |
| mwhahaha | a likely story | 19:56 |
| *** mcornea has joined #tripleo | 19:58 | |
| trown | EmilienM: how do we know? | 19:58 |
| trown | EmilienM: if we dont even get to deploy | 19:58 |
| trown | EmilienM: but I hope so | 19:58 |
| EmilienM | trown: I mean, it's our last known blocker | 19:58 |
| weshay | EmilienM, you just jinxed it dude | 19:58 |
| EmilienM | :P | 19:59 |
| weshay | the first rule of CI | 19:59 |
| EmilienM | trown: I'm just asking if we have more stuff ongoing | 19:59 |
| weshay | this is what you call digging out of 30+ days w/o a promotion | 19:59 |
| weshay | lots of hiding issues | 19:59 |
| trown | EmilienM: AFAIK you are correct that is the last KNOWN bug | 19:59 |
| weshay | we'll go full circle and hit another tempest blocker :) | 19:59 |
| mwhahaha | already running into that one | 20:00 |
| mwhahaha | thanks tempest | 20:00 |
| * mwhahaha cries | 20:00 | |
| weshay | lol | 20:00 |
| *** hewbrocca is now known as hewbrocca_afk | 20:00 | |
| *** CaptTofu has joined #tripleo | 20:01 | |
| EmilienM | trown: ok thx | 20:01 |
| *** yog_ has quit IRC | 20:02 | |
| *** jlinkes has quit IRC | 20:03 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722640 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1722640 in tripleo "pike promotion errors, overcloud images and containers were not promoted properly" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 20:10 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add feature sets for containerized overcloud and network isolation https://review.openstack.org/503812 | 20:14 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates stable/pike: Fixes dynamic networks falling back to ctlplane https://review.openstack.org/511005 | 20:14 |
| *** yog_ has joined #tripleo | 20:16 | |
| *** sid1 has quit IRC | 20:16 | |
| *** sid1 has joined #tripleo | 20:17 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Set empty default for network_isolation_args https://review.openstack.org/497543 | 20:19 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 20:20 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/510309 | 20:21 |
| *** rmascena has joined #tripleo | 20:26 | |
| *** raildo has quit IRC | 20:29 | |
| *** fandrieu_ has joined #tripleo | 20:32 | |
| *** openstackgerrit has quit IRC | 20:33 | |
| *** fandrieu has quit IRC | 20:34 | |
| *** fandrieu_ is now known as fandrieu | 20:34 | |
| *** openstackgerrit has joined #tripleo | 20:34 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move settings to tripleo-quickstart to be included in common vars https://review.openstack.org/495405 | 20:34 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Create default settings for environment types https://review.openstack.org/495407 | 20:36 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 20:37 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 20:40 |
| *** dprince has quit IRC | 20:42 | |
| *** trown is now known as trown|outtypewww | 20:48 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/510309 | 20:49 |
| *** catintheroof has joined #tripleo | 20:50 | |
| *** ansmith has quit IRC | 20:53 | |
| *** jlabarre has quit IRC | 21:02 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/510309 | 21:05 |
| *** yog_ has quit IRC | 21:05 | |
| *** dsneddon_afk has joined #tripleo | 21:07 | |
| *** ansmith has joined #tripleo | 21:09 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722640 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1722640 in tripleo "pike promotion errors, overcloud images and containers were not promoted properly" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 21:10 |
| *** jcoufal has quit IRC | 21:10 | |
| *** ecerquei has quit IRC | 21:10 | |
| *** morazi has quit IRC | 21:13 | |
| slagle | EmilienM: BOOM | 21:13 |
| *** mcornea has quit IRC | 21:13 | |
| slagle | http://logs.openstack.org/07/508307/12/check/gate-tripleo-ci-centos-7-containers-multinode/d930fa9/logs/undercloud/home/jenkins/ansible_steps.log.txt.gz | 21:13 |
| *** sid1 has quit IRC | 21:13 | |
| openstackgerrit | Jon Schlueter proposed openstack/tripleo-common master: overcloud_containers.yaml.j2: remove unused *-base entry https://review.openstack.org/511039 | 21:13 |
| *** rcernin has quit IRC | 21:19 | |
| *** yog_ has joined #tripleo | 21:22 | |
| *** abishop has quit IRC | 21:23 | |
| *** fragatina has joined #tripleo | 21:24 | |
| *** yamahata has joined #tripleo | 21:26 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/510309 | 21:27 |
| *** rmascena has quit IRC | 21:36 | |
| *** gbarros_ has joined #tripleo | 21:38 | |
| *** gbarros has quit IRC | 21:39 | |
| *** pchavva has quit IRC | 21:46 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Make UI accessable by default on OVB https://review.openstack.org/507969 | 21:49 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Sudo fix overcloud-custom-tht-script.sh.j2 https://review.openstack.org/499018 | 21:49 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Use os_keypair for key upload https://review.openstack.org/445224 | 21:49 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Allow OVB to attach undercloud to existing floating IP https://review.openstack.org/506397 | 21:50 |
| *** ecerquei has joined #tripleo | 21:50 | |
| *** leitan has quit IRC | 21:55 | |
| *** threestrands has joined #tripleo | 21:58 | |
| *** catintheroof has quit IRC | 21:58 | |
| *** catintheroof has joined #tripleo | 21:59 | |
| *** catintheroof has quit IRC | 21:59 | |
| *** ecerquei has quit IRC | 22:01 | |
| *** ansmith has quit IRC | 22:03 | |
| openstackgerrit | Lokesh Jain proposed openstack/tripleo-heat-templates master: Make Horizon parameters: vhost_extra_params and customization_module configurable https://review.openstack.org/511060 | 22:03 |
| *** dsneddon_afk has quit IRC | 22:04 | |
| *** jmelvin has quit IRC | 22:08 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722640 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1722640 in tripleo "pike promotion errors, overcloud images and containers were not promoted properly" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 22:10 |
| *** bobh has quit IRC | 22:11 | |
| openstackgerrit | Lokesh Jain proposed openstack/tripleo-heat-templates master: Addition of Nuage bridge MTU parameter https://review.openstack.org/509284 | 22:12 |
| *** dsneddon_afk has joined #tripleo | 22:12 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Config download support for standalone deployments https://review.openstack.org/505827 | 22:15 |
| *** gvrangan_ has joined #tripleo | 22:22 | |
| *** gvrangan_ has quit IRC | 22:23 | |
| *** gvrangan_ has joined #tripleo | 22:23 | |
| *** lblanchard has quit IRC | 22:25 | |
| *** gvrangan_ has quit IRC | 22:28 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 22:29 |
| *** florianf has quit IRC | 22:29 | |
| *** florianf has joined #tripleo | 22:30 | |
| *** chlong has quit IRC | 22:30 | |
| *** cdearborn has quit IRC | 22:32 | |
| *** nyechiel_ has joined #tripleo | 22:37 | |
| *** fragatina has quit IRC | 22:38 | |
| *** florianf has quit IRC | 22:38 | |
| *** dmarlin has quit IRC | 22:48 | |
| *** achadha_ has joined #tripleo | 22:53 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fixes dynamic networks falling back to ctlplane https://review.openstack.org/509789 | 22:54 |
| *** achadha__ has joined #tripleo | 22:55 | |
| *** achadha_ has quit IRC | 22:57 | |
| *** achadha has quit IRC | 22:57 | |
| *** achadha__ has quit IRC | 23:00 | |
| *** rhallisey has quit IRC | 23:02 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1722640 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1722640 in tripleo "pike promotion errors, overcloud images and containers were not promoted properly" [Critical,Triaged] - Assigned to John Trowbridge (trown) | 23:10 |
| *** ebarrera has joined #tripleo | 23:14 | |
| *** ansmith has joined #tripleo | 23:14 | |
| *** nyechiel_ has quit IRC | 23:18 | |
| *** jobewan has quit IRC | 23:23 | |
| *** achadha has joined #tripleo | 23:26 | |
| *** axisys has joined #tripleo | 23:28 | |
| *** salmankhan has joined #tripleo | 23:30 | |
| *** achadha has quit IRC | 23:31 | |
| *** axisys has left #tripleo | 23:33 | |
| *** tosky has quit IRC | 23:35 | |
| *** salmankhan has quit IRC | 23:35 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Stop using the cached cirros image https://review.openstack.org/510839 | 23:35 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Add module_path as option for ansible-playbook action https://review.openstack.org/510800 | 23:36 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Remove extra keystone admin haproxy listen and allow TLS https://review.openstack.org/510738 | 23:36 |
| *** rlandy has quit IRC | 23:45 | |
| *** tongl has quit IRC | 23:46 | |
| *** gbarros_ has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!