| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 00:00 |
|---|---|---|
| *** sid1 has joined #tripleo | 00:05 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 00:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 00:10 |
| *** jkilpatr has quit IRC | 00:12 | |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Don't capture quickstart.tar.gz https://review.openstack.org/474815 | 00:29 |
| *** agopi has quit IRC | 00:31 | |
| *** ecerquei_ has joined #tripleo | 00:39 | |
| *** limao has joined #tripleo | 00:48 | |
| *** sid2 has joined #tripleo | 00:50 | |
| *** sid1 has quit IRC | 00:52 | |
| *** dmacpher_ has quit IRC | 00:54 | |
| *** sid2 has quit IRC | 00:56 | |
| *** gvrangan has joined #tripleo | 01:00 | |
| *** Goneri has quit IRC | 01:00 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 01:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 01:10 |
| stevebaker | bnemec: hey, still about? | 01:12 |
| *** ecerquei__ has joined #tripleo | 01:19 | |
| *** gvrangan has quit IRC | 01:19 | |
| *** fzdarsky_ has joined #tripleo | 01:19 | |
| *** ecerquei_ has quit IRC | 01:21 | |
| *** fzdarsky|afk has quit IRC | 01:23 | |
| *** dmacpher has joined #tripleo | 01:59 | |
| *** nyechiel has joined #tripleo | 02:09 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 02:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 02:10 |
| *** ramishra has joined #tripleo | 02:14 | |
| *** lblanchard has quit IRC | 02:17 | |
| *** lblanchard has joined #tripleo | 02:17 | |
| *** lblanchard has quit IRC | 02:18 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Add ignore_projects to filter gnocchi events https://review.openstack.org/474725 | 02:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Input enabled_services in all-nodes-config as comma_delimited_list https://review.openstack.org/474489 | 02:30 |
| *** nyechiel has quit IRC | 02:35 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 02:41 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 02:41 |
| *** ecerquei__ has quit IRC | 02:42 | |
| *** agopi has joined #tripleo | 02:44 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove reference too puppet/services/ironic-pxe.yaml https://review.openstack.org/474177 | 02:58 |
| *** jaganathan has joined #tripleo | 02:59 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 02:59 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 02:59 |
| *** yamahata_ has quit IRC | 03:02 | |
| *** ykarel has joined #tripleo | 03:03 | |
| *** jaganathan has quit IRC | 03:09 | |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Use undeprecated heat commands in get_host_info.sh https://review.openstack.org/474834 | 03:09 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 03:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 03:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 03:10 |
| *** ratailor has joined #tripleo | 03:10 | |
| *** chlong has quit IRC | 03:12 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-docs master: Update the OVS-DPDK document in line with the role-specific parameters https://review.openstack.org/474836 | 03:14 |
| stevebaker | EmilienM: if you're still conscious could you share your thoughts on this? https://bugs.launchpad.net/tripleo/+bug/1698172 | 03:16 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 03:16 |
| EmilienM | I'm still conscious and alive | 03:18 |
| EmilienM | I can't figure how after my evening though | 03:18 |
| EmilienM | but I'm here | 03:18 |
| * EmilienM clicks | 03:18 | |
| *** dbecker has quit IRC | 03:20 | |
| EmilienM | stevebaker: https://review.openstack.org/#/c/474815/1 makes sense to me, +2 | 03:20 |
| *** gbarros has quit IRC | 03:20 | |
| EmilienM | stevebaker: --nested-depth 2 means less debug, right? | 03:21 |
| stevebaker | oh crap, that was supposed to replace line | 03:22 |
| stevebaker | heat event-list overcloud | 03:22 |
| stevebaker | EmilienM: it is the "heat stack-show" which is insanely large and unreadable | 03:22 |
| EmilienM | yeah | 03:22 |
| stevebaker | EmilienM: is bnemec referring to the logstash storage of these jobs? if so it would be the uncompressed size, which would be o_O | 03:23 |
| EmilienM | stevebaker: he's refering to the logs.openstack.org volumes | 03:24 |
| EmilienM | AFIK the logs are stored on huuuge cinder volume | 03:24 |
| *** sasha2 has quit IRC | 03:25 | |
| openstackgerrit | Steve Baker proposed openstack-infra/tripleo-ci master: Use undeprecated heat commands in get_host_info.sh https://review.openstack.org/474834 | 03:25 |
| stevebaker | EmilienM: I'm struggling to mirror the contents of a logs dir locally without automatically decompressing .xz files, which is confounding my effort to find out what is large even when compressed | 03:26 |
| EmilienM | stevebaker: AFIK we are dupplicating the etc directories | 03:28 |
| EmilienM | let me show | 03:28 |
| EmilienM | actually I don't see it because jobs are now failing | 03:28 |
| EmilienM | stevebaker: sorry but it's a bit late here... I need to go | 03:29 |
| stevebaker | EmilienM: no prob, thanks | 03:29 |
| EmilienM | stevebaker: maybe you can ping panda in your end of afternoon | 03:29 |
| EmilienM | stevebaker: or adarazs | 03:29 |
| EmilienM | they'll help for sure | 03:29 |
| stevebaker | EmilienM: ok | 03:29 |
| EmilienM | have a great day /me off | 03:30 |
| *** limao has quit IRC | 03:34 | |
| *** limao has joined #tripleo | 03:35 | |
| *** dbecker has joined #tripleo | 03:35 | |
| *** limao has quit IRC | 03:39 | |
| *** jaganathan has joined #tripleo | 03:41 | |
| *** ramishra has quit IRC | 03:41 | |
| *** psahoo has joined #tripleo | 03:41 | |
| *** ramishra has joined #tripleo | 03:42 | |
| *** yamahata_ has joined #tripleo | 03:44 | |
| *** agopi has quit IRC | 03:51 | |
| *** yamahata_ has quit IRC | 03:51 | |
| *** yamahata_ has joined #tripleo | 03:51 | |
| *** akuznetsov has joined #tripleo | 03:53 | |
| *** jaosorior_away is now known as jaosorior | 03:53 | |
| *** gkadam has joined #tripleo | 03:55 | |
| *** ykarel has quit IRC | 03:58 | |
| *** akuznetsov has quit IRC | 04:04 | |
| *** prateek has joined #tripleo | 04:09 | |
| *** atheurer has quit IRC | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 04:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 04:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 04:10 |
| *** jaganathan has quit IRC | 04:14 | |
| *** jaganathan has joined #tripleo | 04:14 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable nova-api to run over httpd again https://review.openstack.org/474135 | 04:15 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 04:16 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 04:16 |
| *** prateek has quit IRC | 04:22 | |
| *** prateek has joined #tripleo | 04:23 | |
| *** udesale has joined #tripleo | 04:32 | |
| *** hamzy has joined #tripleo | 04:36 | |
| *** itlinux_ has joined #tripleo | 04:40 | |
| *** gkadam is now known as gkadam-brb | 04:46 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 05:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 05:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 05:10 |
| *** limao has joined #tripleo | 05:12 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 05:17 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 05:17 |
| *** jbadiapa has quit IRC | 05:18 | |
| *** iranzo has joined #tripleo | 05:19 | |
| *** gkadam-brb is now known as gkadam | 05:20 | |
| *** itlinux_ has quit IRC | 05:21 | |
| *** itlinux_ has joined #tripleo | 05:25 | |
| *** ykarel has joined #tripleo | 05:31 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/python-tripleoclient master: Invoke the workflows specified in plan environment file. https://review.openstack.org/469596 | 05:35 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/474614 | 05:35 |
| *** janki has joined #tripleo | 05:41 | |
| *** pgadiya has joined #tripleo | 05:41 | |
| *** lmiccini has joined #tripleo | 05:44 | |
| *** prateek has quit IRC | 05:56 | |
| *** prateek has joined #tripleo | 05:56 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] testing individual log files https://review.openstack.org/474831 | 06:02 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add timestamp output filter https://review.openstack.org/474830 | 06:02 |
| *** dmacpher has quit IRC | 06:04 | |
| *** dmacpher has joined #tripleo | 06:06 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 06:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 06:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 06:10 |
| *** milan has joined #tripleo | 06:11 | |
| *** yprokule has joined #tripleo | 06:15 | |
| *** nyechiel has joined #tripleo | 06:19 | |
| *** rcernin has joined #tripleo | 06:19 | |
| *** jaganathan has quit IRC | 06:22 | |
| *** jaganathan has joined #tripleo | 06:23 | |
| *** rcernin has quit IRC | 06:24 | |
| *** nyechiel has quit IRC | 06:28 | |
| *** jprovazn has joined #tripleo | 06:29 | |
| *** itlinux_ has quit IRC | 06:30 | |
| *** bogdando has joined #tripleo | 06:31 | |
| *** sid1 has joined #tripleo | 06:31 | |
| *** sid1 has quit IRC | 06:34 | |
| *** jbadiapa has joined #tripleo | 06:34 | |
| *** rcernin has joined #tripleo | 06:40 | |
| *** ebarrera has joined #tripleo | 06:41 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable nova-api to run over httpd again https://review.openstack.org/474135 | 06:41 |
| *** pcaruana has joined #tripleo | 06:43 | |
| *** florianf has joined #tripleo | 06:46 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Only pass distinct services to enabled_services list https://review.openstack.org/474862 | 06:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure keystone haproxy endpoints through dynamic resource https://review.openstack.org/474107 | 06:49 |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 06:49 |
| *** ebarrera has quit IRC | 06:50 | |
| *** ebarrera has joined #tripleo | 06:51 | |
| *** nyechiel has joined #tripleo | 06:55 | |
| *** anshulbehl has joined #tripleo | 06:57 | |
| *** suuuper has joined #tripleo | 06:57 | |
| *** mcornea has joined #tripleo | 07:00 | |
| *** amoralej|off is now known as amoralej | 07:01 | |
| hjensas | I have a problem with jinja rendering. I add a new property to all roles in roles_data.yaml, then in puppet/role.role.j2.yaml I add key: {{role.newproperty}}. When it renders the value is blank. Do I need to update the code doing the rendering to be aware of the property, or what? | 07:05 |
| *** skramaja has joined #tripleo | 07:06 | |
| *** jlinkes has joined #tripleo | 07:06 | |
| *** tesseract has joined #tripleo | 07:09 | |
| *** jtomasek has joined #tripleo | 07:10 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 07:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 07:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 07:10 |
| *** nyechiel has quit IRC | 07:10 | |
| *** ccamacho has quit IRC | 07:14 | |
| *** fragatina has joined #tripleo | 07:20 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Make fernet max active keys configurable https://review.openstack.org/474532 | 07:26 |
| jaosorior | marios: could you check this out? ^^ It was green but I fixed a typo in the release note. | 07:26 |
| *** brault has joined #tripleo | 07:27 | |
| *** shardy has joined #tripleo | 07:32 | |
| *** limao has quit IRC | 07:33 | |
| *** limao_ has joined #tripleo | 07:33 | |
| openstackgerrit | Merged openstack/tripleo-validations master: Adds pre-upgrade/update to the overcloud endpoint validation https://review.openstack.org/474187 | 07:33 |
| *** stendulker has joined #tripleo | 07:35 | |
| marios | ack jaosorior | 07:38 |
| jaosorior | thanks marios | 07:38 |
| *** karimb has joined #tripleo | 07:43 | |
| *** dmacpher has quit IRC | 07:46 | |
| *** egonzalez has joined #tripleo | 07:48 | |
| *** dtantsur|afk is now known as dtantsur | 07:49 | |
| *** jpich has joined #tripleo | 07:50 | |
| *** jaganathan has quit IRC | 07:52 | |
| *** paramite has joined #tripleo | 07:55 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #tripleo | 08:02 | |
| *** jbadiapa has quit IRC | 08:03 | |
| shardy | dciabrin: Hey, did you manage to get your environment up yesterday? | 08:05 |
| dciabrin | shardy, so fun fact, rasca did all the magic for setting it up, it seems baremetal works for us, but not vm | 08:06 |
| *** jaganathan has joined #tripleo | 08:06 | |
| shardy | dciabrin: Ok, I rebuilt my VM based environment and it still works well for initial deploy | 08:06 |
| *** cylopez has joined #tripleo | 08:06 | |
| shardy | dciabrin: but if you re-run the deploy command again, with no changes, there are errors, I think related to haproxy config | 08:06 |
| shardy | I just wondered if you'd seen that before I start investigating | 08:07 |
| *** fzdarsky_ is now known as fzdarsky | 08:09 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 08:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,Triaged] | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 08:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 08:10 |
| *** ccamacho has joined #tripleo | 08:17 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Make a copy of files touched by puppet in container https://review.openstack.org/474891 | 08:18 |
| *** jbadiapa has joined #tripleo | 08:19 | |
| *** milan is now known as milan|bbl | 08:19 | |
| *** milan|bbl has quit IRC | 08:20 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/python-tripleoclient master: Invoke the workflows specified in plan environment file. https://review.openstack.org/469596 | 08:20 |
| *** rcernin has quit IRC | 08:21 | |
| *** rcernin has joined #tripleo | 08:22 | |
| *** dsariel has joined #tripleo | 08:24 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Limit collection of config-data to puppet-generated files https://review.openstack.org/474896 | 08:26 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Improve logs from ansible, puppet, docker-puppet.py https://review.openstack.org/474269 | 08:27 |
| bogdando | folks, I checked that locally, https://review.openstack.org/#/c/474269/, it seems look better than it is now | 08:28 |
| bogdando | shardy, jistr, mandre: ^^ PTAL | 08:28 |
| *** jbadiapa has quit IRC | 08:29 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/python-tripleoclient master: Invoke the workflows specified in plan environment file. https://review.openstack.org/469596 | 08:30 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Improve logs from ansible, puppet, docker-puppet.py https://review.openstack.org/474269 | 08:31 |
| *** social has joined #tripleo | 08:33 | |
| shardy | bogdando: thanks, I'll pull it and give it a try | 08:34 |
| *** florianf has quit IRC | 08:34 | |
| *** zoli|gone is now known as zoliXXL | 08:35 | |
| *** lucas-afk is now known as lucasagomes | 08:39 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Make a copy of files touched by puppet in container https://review.openstack.org/474891 | 08:39 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Limit collection of config-data to puppet-generated files https://review.openstack.org/474896 | 08:39 |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-quickstart master: [WIP] Test Ironic in Overcloud https://review.openstack.org/472755 | 08:39 |
| shardy | dciabrin: FYI the problem seems to be that we get device or resource busy errors despite the move to rsync: | 08:41 |
| shardy | http://paste.openstack.org/show/612826/ | 08:41 |
| shardy | I think we may have to move to creating a unique directory for every docker-puppet run | 08:41 |
| *** japestinho has joined #tripleo | 08:42 | |
| *** jbadiapa has joined #tripleo | 08:44 | |
| dciabrin | shardy, sorry I'm lacking context here :) what's the pb? | 08:45 |
| shardy | dciabrin: any stack updates fail | 08:46 |
| dciabrin | shardy, oh ok saw you last comment only now... | 08:46 |
| shardy | dciabrin: I didn't see this previously in my single node testing, but it seems we'll need to rework the docker-puppet workflow to create a new directory every run | 08:46 |
| dciabrin | shardy, oh ok, maybe that's because we're bind mounting /var/lib/config-data/haproxy/etc directly, rather than letting kolla copy the files here | 08:46 |
| dciabrin | shardy, checking | 08:46 |
| shardy | dciabrin: ack, happy to hear any other ideas, the unique directory thing is doable but will take some work | 08:47 |
| shardy | I was hoping we could mount the config-data read only then just rsync each docker-puppet run | 08:47 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Don't capture quickstart.tar.gz https://review.openstack.org/474815 | 08:49 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Reconfigure interfaces before updating openvswitch https://review.openstack.org/471381 | 08:49 |
| *** florianf has joined #tripleo | 08:51 | |
| *** iranzo has quit IRC | 08:53 | |
| *** tvignaud has quit IRC | 08:55 | |
| shardy | dciabrin: I raised https://bugs.launchpad.net/tripleo/+bug/1698323 to track discussion on the fix | 08:55 |
| openstack | Launchpad bug 1698323 in tripleo "Stack updates fail during docker-puppet rsync for haproxy" [High,Triaged] | 08:55 |
| dciabrin | shardy ok thx | 08:55 |
| *** athomas has quit IRC | 08:56 | |
| *** tosky has joined #tripleo | 08:57 | |
| *** iranzo has joined #tripleo | 09:00 | |
| *** iranzo has joined #tripleo | 09:00 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Conditional LVM storage setup for cinder-volume https://review.openstack.org/473775 | 09:07 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Ignore case for bootstrap node checks https://review.openstack.org/474762 | 09:07 |
| *** tvignaud has joined #tripleo | 09:08 | |
| *** athomas has joined #tripleo | 09:09 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Fall back to non-containerized cinder-volume to unblock CI https://review.openstack.org/474915 | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 09:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 09:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 09:10 |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-docs master: Updates image location https://review.openstack.org/473785 | 09:11 |
| bogdando | folks, my custom UC deploy is hit by "CREATE_FAILED StackValidationFailed: resources[9]: Property error: resources.KeystoneBase.properties: Property KeystoneFernetKeys not assigned", but looks like continues anyway. I did yum update from the current-tripleo, shall I fallback to the "current" or is it something non critical? | 09:15 |
| bogdando | jaosorior: ^^ by a chance? :) | 09:16 |
| jistr | bogdando: could it be that you updated t-h-t but missed tripleo-common or tripleoclient? | 09:17 |
| shardy | bogdando: did you re-run openstack undercloud install or just update the packages? | 09:17 |
| bogdando | shardy, jistr: re-running after yum update | 09:18 |
| shardy | bogdando: it sounds like you need https://github.com/openstack/tripleo-common/commit/2fb512160cdb8d3806196732036a5b7bb8a13623 | 09:18 |
| shardy | that will require restarting the mistral services at least | 09:19 |
| bogdando | hm, yum log doesn't mention updates installed for those two | 09:19 |
| bogdando | perhaps I need current dlrn | 09:19 |
| *** akrivoka has joined #tripleo | 09:20 | |
| amoralej | ping sshnaidm|off, question about current-tripleo promotion | 09:21 |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-docs master: Updates image location https://review.openstack.org/473785 | 09:22 |
| *** limao_ has quit IRC | 09:24 | |
| *** akrivoka has quit IRC | 09:24 | |
| *** limao has joined #tripleo | 09:25 | |
| *** akrivoka has joined #tripleo | 09:26 | |
| *** limao has quit IRC | 09:29 | |
| marios | matbu: is there something waiting for https://review.openstack.org/#/c/470445/ ? | 09:33 |
| marios | matbu: or shall we land it? | 09:33 |
| *** sudipto has joined #tripleo | 09:33 | |
| *** sudipto_ has joined #tripleo | 09:34 | |
| *** snecklifter_ has joined #tripleo | 09:35 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/474926 | 09:35 |
| shardy | does anyone know if it's possible to inspect all container bind mounted directories from the host? | 09:39 |
| shardy | neither mount nor findmnt seem to contain the data | 09:39 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Updated from global requirements https://review.openstack.org/470555 | 09:41 |
| *** ebarrera has quit IRC | 09:42 | |
| *** ebarrera has joined #tripleo | 09:43 | |
| *** yamahata_ has quit IRC | 09:47 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Use undeprecated heat commands in get_host_info.sh https://review.openstack.org/474834 | 09:47 |
| jaosorior | bogdando: you need to update your tripleo-common | 09:47 |
| *** dmacpher has joined #tripleo | 09:47 | |
| bogdando | jaosorior: yupp, thanks. Already did that from the current dlrn | 09:47 |
| jaosorior | shardy: got a chance to check this out https://review.openstack.org/#/c/474862/ ? | 09:48 |
| *** zoliXXL is now known as zoli|lunch | 09:48 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure keystone haproxy endpoints through dynamic resource https://review.openstack.org/474107 | 09:49 |
| *** limao has joined #tripleo | 09:50 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable nova-api to run over httpd again https://review.openstack.org/474135 | 09:51 |
| *** limao_ has joined #tripleo | 09:53 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: For http service endpoints always redirect to https https://review.openstack.org/474108 | 09:54 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add resource to create haproxy endpoints dynamically https://review.openstack.org/474109 | 09:54 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Rely on dynamic haproxy endpoints to configure keystone https://review.openstack.org/474110 | 09:54 |
| jpich | honza: You might have an idea about what is causing this, when you're around? https://bugs.launchpad.net/tripleo/+bug/1698194 | 09:55 |
| openstack | Launchpad bug 1698194 in tripleo "tripleo_ui language settings not displayed correctly" [Medium,Triaged] | 09:55 |
| *** limao has quit IRC | 09:55 | |
| *** limao_ has quit IRC | 10:01 | |
| *** limao has joined #tripleo | 10:02 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Create the vhost root folder before creating the virtual host https://review.openstack.org/474526 | 10:06 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 10:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 10:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 10:10 |
| jistr | shardy: `docker inspect $CONTAINER` | 10:11 |
| jistr | shardy: if i understood the question right | 10:11 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: CI: Enable OVN services for scenario 3 https://review.openstack.org/412831 | 10:11 |
| shardy | jistr: yeah, I was hoping to get the host mount information, as I'm not sure docker inspect will give the info I need if the bind mount is a symlink | 10:12 |
| shardy | jistr: to avoid the foo in user errors I mentioned earlier, I think we need docker-puppet to create a new directory every run | 10:12 |
| shardy | then switch a symlink and update the docker environment with the readlink information about the target | 10:12 |
| shardy | but the question then is how to decide which old dirs can be cleaned up | 10:13 |
| *** limao has quit IRC | 10:13 | |
| snecklifter_ | Morning #tripleo, would it be possible to get https://review.openstack.org/#/c/473785/ merged please? | 10:13 |
| shardy | I was hoping we could inspect the host mount/lsof information but it doesn't seem possible | 10:13 |
| snecklifter_ | dtantsur: thanks for your comments on the above | 10:13 |
| *** limao has joined #tripleo | 10:13 | |
| *** ratailor has quit IRC | 10:13 | |
| snecklifter_ | I never thought getting a URL updated on a doc would be quite so involved but I think we have got there :) | 10:13 |
| *** nenad has joined #tripleo | 10:14 | |
| dtantsur | np :) yeah, this happens quite often with documentation changes | 10:14 |
| shardy | jistr: maybe we'll have to read the environment of all running containers via docker inspect, and always have the new and n-1'th config-data | 10:14 |
| shardy | snecklifter_: done | 10:15 |
| snecklifter_ | shardy: many thanks | 10:16 |
| shardy | thanks for the fix | 10:16 |
| openstackgerrit | Merged openstack/tripleo-docs master: Updates image location https://review.openstack.org/473785 | 10:18 |
| *** dsariel has quit IRC | 10:19 | |
| *** ratailor has joined #tripleo | 10:21 | |
| jistr | dciabrin: re your comment at https://bugs.launchpad.net/tripleo/+bug/1698323 -- we do the direct /etc mounts in other containers too, rather than having Kolla copy files. So this may not be specific to HAProxy i think... | 10:22 |
| openstack | Launchpad bug 1698323 in tripleo "Stack updates fail during docker-puppet rsync for haproxy" [High,Triaged] | 10:22 |
| *** limao has quit IRC | 10:24 | |
| dciabrin | jistr, oh damned :( I have the patches ready anyway, so I'll push reviews so hopefully shardy can check whether it makes a difference or not :/ | 10:24 |
| shardy | yeah I think we'll have to decide if we can avoid holding files open in /var/lib/config-data - if not we'll have to create a unique directory each docker-puppet run, and find a way to compare the new directory with the existing one | 10:26 |
| jistr | dciabrin: right, well it may make a difference. We do the direct mount everywhere, but it may actually cause real problem only for HAProxy perhaps... | 10:27 |
| *** panda|ko is now known as panda | 10:28 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Updated from global requirements https://review.openstack.org/474641 | 10:29 |
| openstackgerrit | Merged openstack/instack-undercloud master: Add numa-topology colector to the list of default collectors https://review.openstack.org/474120 | 10:29 |
| *** jprovazn has quit IRC | 10:29 | |
| jistr | but the generic issue "lurks" over all containers then. It only depends on the service's particular behavior. | 10:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Pacemaker HA suport for OVN DB servers https://review.openstack.org/436767 | 10:30 |
| *** rhallisey has joined #tripleo | 10:32 | |
| *** fpan_ has joined #tripleo | 10:38 | |
| *** fpan has quit IRC | 10:38 | |
| *** mrchao has joined #tripleo | 10:39 | |
| *** gkadam has quit IRC | 10:40 | |
| jistr | shardy, dciabrin: interesting, on my system i can't find anything holding those files (not sure if i'm doing it right). lsof and lslocks doesn't mention anything re haproxy | 10:41 |
| dciabrin | jistr, hmm | 10:41 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Improve logs from ansible, puppet, docker-puppet.py https://review.openstack.org/474269 | 10:42 |
| jistr | the reason i tried this is that i wanted to guess for how many services this could be an issue | 10:42 |
| jistr | i think puppet does a md5 check before it attempts to change a file, so i thought it could be possible that many more services actually have this problem but we'd only hit it if the config actually changes during the update | 10:43 |
| jistr | but not sure how to check for the other services though, as i'm not able to see this problem with HAProxy either (via lsof/lslocks) | 10:44 |
| *** stendulker has quit IRC | 10:45 | |
| bogdando | jaosorior: and folks, oh, I have mysql init tasks error back again :) | 10:46 |
| bogdando | Just "Error: Failed to apply catalog: Execution of '/usr/bin/mysql --defaults-extra-file=/root/.my.cnf -NBe SELECT CONCAT(User, '@',Host) AS User FROM mysql.user' returned 1: ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)" | 10:47 |
| *** sid1 has joined #tripleo | 10:47 | |
| bogdando | I have rebased on top of the jistr's patch fixing container races | 10:48 |
| bogdando | but ... sigh | 10:48 |
| jaosorior | bogdando: shouldn't it be the case that we can't log in using localhost? | 10:48 |
| jaosorior | you should be using the IP or network-bound hostname for the node instead | 10:48 |
| bogdando | jaosorior: it can't login cuz of the file is not in place, I can't track down why. Puppet logs reported it was bucketed | 10:48 |
| bogdando | .my.cnf | 10:49 |
| jaosorior | ah | 10:49 |
| jaosorior | funky | 10:49 |
| bogdando | indeed | 10:49 |
| *** sid2 has joined #tripleo | 10:49 | |
| *** katkapilatova has joined #tripleo | 10:50 | |
| *** sid1 has quit IRC | 10:51 | |
| *** pgadiya has quit IRC | 10:51 | |
| *** nyechiel has joined #tripleo | 10:54 | |
| bogdando | so is it a bug? https://pastebin.com/N60zbB0p | 10:55 |
| bogdando | why it runs w/o mounting the .my.cnf? | 10:55 |
| bogdando | I wondering why it works for CI w/o issues... | 10:55 |
| *** dmanchad has quit IRC | 10:56 | |
| *** dmanchad has joined #tripleo | 10:56 | |
| bogdando | it's hard to say how to repro it, but looks like a bug in tht | 10:57 |
| bogdando | shall we always mount .my.cnf for mysql init steps? | 10:57 |
| bogdando | jistr, shardy, mandre: ^^ thoughts please? | 10:58 |
| bogdando | if I bind-mount it, all works | 10:59 |
| *** jkilpatr has joined #tripleo | 10:59 | |
| *** zoli|lunch is now known as zoliXXL | 11:00 | |
| EmilienM | hellow | 11:00 |
| bogdando | https://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/database/mysql.yaml#n146 do not always provides .my.cnf! :D | 11:01 |
| bogdando | EmilienM: o/ | 11:01 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: Use HAproxy config files copied by Kolla bootstrap https://review.openstack.org/474943 | 11:02 |
| *** bfournie has quit IRC | 11:02 | |
| *** bfournie has joined #tripleo | 11:03 | |
| *** bfournie has quit IRC | 11:04 | |
| *** morazi has quit IRC | 11:05 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-common master: Add OVN container images https://review.openstack.org/474944 | 11:06 |
| bogdando | https://bugs.launchpad.net/tripleo/+bug/1698349 | 11:07 |
| openstack | Launchpad bug 1698349 in tripleo "mysql_init_tasks does not always provide .my.cnf" [Medium,Triaged] | 11:07 |
| *** agopi has joined #tripleo | 11:07 | |
| *** salmankhan has joined #tripleo | 11:07 | |
| *** nyechiel has quit IRC | 11:08 | |
| *** fultonj has quit IRC | 11:09 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Make sure .my.cnf bind-mounted https://review.openstack.org/474945 | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 11:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 11:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 11:10 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 11:11 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Make neutron's dns_domain parameter configurable https://review.openstack.org/474946 | 11:14 |
| sshnaidm|off | panda, can you respond please on https://review.openstack.org/#/c/474504 ? we need to fix it asap | 11:14 |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: Use HAproxy config files copied by Kolla bootstrap https://review.openstack.org/474947 | 11:16 |
| * jistr lunch, biag | 11:17 | |
| jistr | *biab | 11:17 |
| openstackgerrit | Merged openstack/tripleo-common master: Define default Image and Volume API versions in overcloudrc https://review.openstack.org/473540 | 11:18 |
| *** bfournie has joined #tripleo | 11:21 | |
| *** lucasagomes is now known as lucas-hungry | 11:22 | |
| dciabrin | shardy https://review.openstack.org/#/c/474943 and https://review.openstack.org/#/c/474947 <-- for the issue with haproxy container during stack update. | 11:22 |
| dciabrin | jistr, ^^ | 11:22 |
| *** sudipto_ has quit IRC | 11:24 | |
| *** sudipto has quit IRC | 11:24 | |
| EmilienM | jaosorior: hey, could you please have a look at https://review.rdoproject.org/r/#/c/7098/ when you have some time, maybe today | 11:26 |
| jaosorior | EmilienM: oh man, that's tricky | 11:28 |
| jpich | jaosorior: Sorry for the basic question - basically the fernet patches are necessary because it's not possible to distribute the keys over all the controllers at the moment, do I understand correctly? I was scratching my head a bit as to why we seem to be recreating the keystone-manage command | 11:28 |
| EmilienM | nevermind, just approve it | 11:28 |
| EmilienM | :D | 11:28 |
| jaosorior | EmilienM: I don't have +2 rights there :/ | 11:28 |
| EmilienM | jaosorior: I was joking. | 11:28 |
| EmilienM | jaosorior: your -1 / +1 is enough | 11:28 |
| EmilienM | jaosorior: I can re-explain the problem that I'm trying to solve if oyu need | 11:28 |
| EmilienM | but the commit message explains quite well I think | 11:29 |
| jaosorior | jpich: you are correct. It recreates the keystone-manage command, which can't be ran in a cluster :/ | 11:29 |
| jaosorior | EmilienM: right, I read the commit message. With my limited understanding of the issue it looks good (not sure what carrying the policy file in code actually entails) | 11:29 |
| jaosorior | EmilienM: I'm actually asking the same questions for barbican though; since the same is being proposed over there. | 11:29 |
| EmilienM | jaosorior: where? | 11:30 |
| jaosorior | let me try to dig out the patch. | 11:30 |
| jaosorior | but yeah, all I know is that it's what projects are aiming for nowadays | 11:30 |
| jaosorior | EmilienM: https://review.openstack.org/#/c/431524/ | 11:31 |
| EmilienM | jaosorior: yes, there is a community goal, which is imho awesome | 11:31 |
| *** japestinho has quit IRC | 11:32 | |
| EmilienM | jaosorior: https://review.openstack.org/#/c/469954/ | 11:32 |
| jaosorior | EmilienM: I have my doubts about it to be honest. A lot of operators tend to modify the default policy... having the policy in one file makes it easier for deployers to have an overall view of it. | 11:32 |
| jaosorior | getting it embedded in the code makes that harder... | 11:32 |
| jaosorior | aaand doing further modifications of such a policy will be harder too | 11:32 |
| cschwede | mandre: Hi! I stumbled upon this commit: https://github.com/openstack/tripleo-validations/commit/2e1a198c and was wondering about this - do you remember this issue? was there a bug or something? | 11:33 |
| EmilienM | jaosorior: that's why we provide the option to manage it via the file, in tripleo | 11:33 |
| EmilienM | jaosorior: tripleo.org/advanced_deployment/api_policies.html | 11:33 |
| *** jprovazn has joined #tripleo | 11:33 | |
| jaosorior | EmilienM: which I think it's a great option | 11:33 |
| EmilienM | brb 20 minb | 11:33 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud master: Make neutron's dns_domain parameter configurable https://review.openstack.org/474946 | 11:37 |
| *** tbonds has quit IRC | 11:38 | |
| *** ansmith has quit IRC | 11:38 | |
| jpich | jaosorior: Ok, thank you! Do we expect the keys to be updated on stack update, then? I'm not familiar with when/how hiera data gets updated | 11:39 |
| jaosorior | jpich: so, right now the only way to do it (once this work merges) is via a stack update. But, the next step is to create a workflow that actually does the rotation and persists it to the nodes hosting keystone on demand. | 11:40 |
| jaosorior | jpich: the way it's gonna work is via ansible. And now that the ansible actions in tripleo-common merged, it's possible | 11:40 |
| *** tbonds has joined #tripleo | 11:40 | |
| jaosorior | so that's the next step :) | 11:40 |
| jpich | jaosorior: Great, thank you for the explanations, I appreciate it!! | 11:41 |
| jaosorior | jpich: no biggie, thanks a lot for checking it out | 11:43 |
| *** salmankhan has quit IRC | 11:47 | |
| *** tbonds has quit IRC | 11:49 | |
| *** agopi has quit IRC | 11:50 | |
| *** tbonds has joined #tripleo | 11:51 | |
| *** pkovar has joined #tripleo | 11:51 | |
| *** udesale has quit IRC | 11:51 | |
| *** abishop has joined #tripleo | 11:52 | |
| *** morazi has joined #tripleo | 11:58 | |
| *** ykarel has quit IRC | 11:58 | |
| *** ykarel has joined #tripleo | 11:58 | |
| jaosorior | can someone take a look at this t-h-t patch https://review.openstack.org/#/c/474862/ ? | 11:59 |
| *** sbrzozow has joined #tripleo | 12:00 | |
| *** sid2 has quit IRC | 12:02 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Fix the port for Panko API https://review.openstack.org/471577 | 12:05 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Replace assertRaisesRegexp with assertRaisesRegex https://review.openstack.org/474470 | 12:05 |
| openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/474926 | 12:05 |
| jaosorior | mwhahaha, EmilienM: If I need to get another hiera value that returns a list from hieradata set in t-h-t. How would I do it? I tried this: server_names: "%{hiera('keystone_admin_api_node_names')}" in here https://review.openstack.org/#/c/474107/6/puppet/services/keystone.yaml and it seems to be failing cause it interprets it as a string instead of a list: parsing | 12:05 |
| jaosorior | [/etc/haproxy/haproxy.cfg20170616-13165-mo2g94:141] : character '[' is not permitted in server name '["overcloud-controller-0.internalapi.localdomain",'. | 12:05 |
| *** dpivonka has quit IRC | 12:07 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates stable/ocata: Add support for Cinder "NAS secure" driver params https://review.openstack.org/474955 | 12:08 |
| jaosorior | shardy: what could be causing os-collect-config to run again? | 12:09 |
| *** fultonj has joined #tripleo | 12:09 | |
| jaosorior | shardy: I triggered an undercloud deployment and it seems that os-collect-config starts running again and again | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 12:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 12:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 12:10 |
| jaosorior | shardy: keeps running puppet and refreshing services for some reason :/ | 12:11 |
| jaosorior | shardy: http://paste.openstack.org/show/612844/ :/ | 12:12 |
| *** adarazs is now known as adarazs_brb | 12:14 | |
| *** dprince has joined #tripleo | 12:20 | |
| shardy | jaosorior: it's enabled on my undercloud too, which might be a mistake, but it shouldn't re-run anything unless the metadata changed | 12:20 |
| *** sid1 has joined #tripleo | 12:21 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/474697 | 12:24 |
| *** dpivonka has joined #tripleo | 12:24 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/474614 | 12:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements https://review.openstack.org/472929 | 12:24 |
| EmilienM | jaosorior: let me look | 12:26 |
| EmilienM | jaosorior: it reminds me an old issue | 12:27 |
| EmilienM | jaosorior: we we have to backslash something | 12:27 |
| EmilienM | jaosorior: gimme some time | 12:29 |
| *** pkovar has quit IRC | 12:29 | |
| *** arxcruz is now known as arxcruz|off | 12:32 | |
| *** sid1 has quit IRC | 12:33 | |
| *** sid1 has joined #tripleo | 12:33 | |
| *** adarazs_brb is now known as adarazs | 12:34 | |
| *** pkovar has joined #tripleo | 12:34 | |
| shardy | jistr, dciabrin: So, I'm trying to figure out the next steps re bug #1698323 - do you think the kolla bootstrap approach could be used everywhere, or should I go ahead and prototype the versioned directories solution? | 12:36 |
| openstack | bug 1698323 in tripleo "Stack updates fail during docker-puppet rsync for haproxy" [High,In progress] https://launchpad.net/bugs/1698323 | 12:36 |
| shardy | dprince: ^^ If you're around interested in your views on this also | 12:36 |
| *** ratailor has quit IRC | 12:36 | |
| *** trown|outtypewww is now known as trown | 12:37 | |
| dciabrin | shardy, have you got a chance to test the reviews for haproxy? | 12:38 |
| *** morazi has quit IRC | 12:38 | |
| *** sid1 has quit IRC | 12:38 | |
| dprince | shardy: looking... | 12:39 |
| *** rlandy has joined #tripleo | 12:40 | |
| *** morazi has joined #tripleo | 12:40 | |
| dprince | shardy: commented, if we revert f600d459f051288042ce531bab029953563a11b3 would it fix it? | 12:41 |
| dprince | shardy: while I like the cleanup aspects of stevebaker's rsync patch it was a cleanup. No net new functionality there that would cause a regression if we reverted it | 12:42 |
| shardy | dprince: No, because previously the rm -fr failed | 12:42 |
| *** prateek has quit IRC | 12:42 | |
| shardy | dprince: it's the same issue, I previously assumed the rsync would fix it because we're no longer removing the directory | 12:42 |
| shardy | dprince: so I think we have two options - make the containers take a copy instead of bind mounting and holding files open on the host | 12:43 |
| shardy | or version the /var/lib/config-data directories, e.g append a timestamp every time docker-puppet runs or something | 12:43 |
| shardy | the tricky part of that will be working out when we can clean them up | 12:43 |
| shardy | but we can probably add logic to docker-puppet to introspect all the containers via docker inspect and ensure there's data about the absolute path that's in use contained there (e.g in the kolla environment like we do for the hash atm) | 12:44 |
| *** lucas-hungry is now known as lucasagomes | 12:44 | |
| shardy | if we could just copy the data, it'd be much simpler | 12:44 |
| dprince | shardy: the timestamp complexity makes debugging a bit more painful too | 12:44 |
| shardy | yeah | 12:44 |
| shardy | we'd need to regenerate the config, diff with the old one, and switch a symlink if the new config differs | 12:45 |
| dprince | shardy: more painful debugging is sort of a feature of using containers I think ;) | 12:45 |
| shardy | then restart containers, and later remove the old config dir | 12:45 |
| shardy | hehe, true | 12:45 |
| shardy | dprince: if we do https://review.openstack.org/#/c/474943/1/docker/services/pacemaker/haproxy.yaml everywhere, would that fix this? | 12:46 |
| shardy | dciabrin: sorry no not yet - I'm about to try it now | 12:47 |
| jistr | is updating configs broken for everything, or just for haproxy? | 12:47 |
| dprince | shardy: perhaps | 12:47 |
| dprince | shardy: that interface is super verbose though | 12:47 |
| shardy | jistr: it'll be broken for anything where a file is held open and we try to update it | 12:47 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Add missing Swift object reconstructor for containerized deployments https://review.openstack.org/445891 | 12:47 |
| dprince | shardy: like for all the Apache API's it ends up being like 4-6 files per service in some cases | 12:47 |
| shardy | urgh | 12:48 |
| dprince | shardy: we moved away from using 'kolla_config' as it duplicates logic in our config tooling | 12:48 |
| dprince | shardy: we can do it though | 12:48 |
| *** ratailor has joined #tripleo | 12:48 | |
| jistr | shardy: yea... just wondering how many services it causes an actual breakage | 12:48 |
| shardy | dprince: ack, understood | 12:48 |
| jistr | i'd expect most services just read their /etc and close it | 12:48 |
| shardy | jistr: yeah I can test and find out, but it seems like a fragile pattern | 12:48 |
| jistr | yea it is... | 12:49 |
| dprince | other than duplicating the files that are actually used kolla_config is totally valid | 12:49 |
| dprince | shardy: use it just for this service? | 12:49 |
| jistr | though the solutions to make it less fragile aren't very appealing | 12:49 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Add missing Swift containersync service for containerized deployments https://review.openstack.org/474964 | 12:49 |
| dprince | jistr: I think the various policy.json files are immediately effective too | 12:49 |
| shardy | dprince: yeah, I think there are others though, e.g mysql was failing the rm -fr so I assume it'll fail in the same way | 12:50 |
| dprince | jistr: most files are read at startup, but some could be read periodically, or each time they are changed | 12:50 |
| shardy | yeah that could mean this is racy | 12:50 |
| jistr | hm ack :/ | 12:50 |
| * shardy sighs | 12:50 | |
| dprince | shardy: if kolla_config fixes this we can do it | 12:50 |
| shardy | dprince: Ok let me test the patch from dciabrin and see where we get to | 12:51 |
| shardy | thanks for the feedback | 12:51 |
| dprince | shardy: I think the question is, do we want to keep the /var/lib/config-data tree more easy to understand on the host | 12:51 |
| dprince | shardy: or do we use timestamps | 12:51 |
| *** liverpooler has joined #tripleo | 12:51 | |
| shardy | dprince: if possible, I would prefer not to have the timestamp and lifecycle/cleanup complexity on the host | 12:51 |
| *** limao has joined #tripleo | 12:51 | |
| shardy | it'd be logically simpler if the containers just took a snapshot on boot | 12:52 |
| shardy | IMHO | 12:52 |
| dprince | shardy: right, I think given the timing we shouldn't introduce a new complexity | 12:52 |
| dprince | shardy: kolla_config already exists. We've used it before | 12:52 |
| *** psahoo has quit IRC | 12:52 | |
| dprince | shardy: if it solves this, lets just go back and use it where needed, or everywhere for that matter | 12:52 |
| dprince | jistr: agree? | 12:52 |
| shardy | ack, well perhaps its only a few places, I'll test and find out | 12:53 |
| jistr | dprince, shardy: yes. Copying sounds much simpler/safer than the symlink moving + old dirs cleanup. | 12:53 |
| *** milan has joined #tripleo | 12:54 | |
| dprince | shardy: the timestamp thing to me sounds like what some people were asking for around logging (unique directories for each service). I consider that a new feature of sorts | 12:54 |
| shardy | dprince: yeah, it could be done, but it's adding a bunch more complexity to docker-puppet.py | 12:54 |
| dprince | shardy: which we could do, but this isn't the time in the release to do it | 12:55 |
| shardy | ++ | 12:55 |
| dprince | shardy: unless we absolutely have to of course | 12:55 |
| *** akuznetsov has joined #tripleo | 12:55 | |
| dprince | shardy: we could even blueprint it if it is of interest for Queens, lets see where we end up after this and get a feel for it | 12:56 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] toci_gate_test: handle tripleo-ci specific feature configuration https://review.openstack.org/474966 | 12:56 |
| *** jaganathan has quit IRC | 12:56 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 12:56 |
| dprince | mandre: hey, bit of backlog ^^^ you might be interested in there. | 12:56 |
| dprince | mandre: who knew 'kolla_config' would save the day! | 12:57 |
| mandre | dprince: where do I start reading? | 12:57 |
| *** akuznetsov has quit IRC | 12:57 | |
| *** ecerquei__ has joined #tripleo | 12:57 | |
| *** limao has quit IRC | 12:58 | |
| dprince | mandre: about 30 minutes ago | 12:58 |
| *** limao has joined #tripleo | 13:00 | |
| *** sasha2 has joined #tripleo | 13:00 | |
| *** limao has quit IRC | 13:02 | |
| *** limao_ has joined #tripleo | 13:02 | |
| jistr | dprince, shardy: FWIW it supports copying directories too, so we can just copy full /etc/<service>, we don't have to go file by file. | 13:02 |
| jistr | https://github.com/openstack/kolla/blob/7b27262216d0bef65dc4c6ed24b96285bbba11db/docker/base/set_configs.py#L138-L141 | 13:02 |
| *** jcoufal has joined #tripleo | 13:03 | |
| shardy | aha, that sounds much easier | 13:03 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] toci_gate_test: handle tripleo-ci specific feature configuration https://review.openstack.org/474966 | 13:04 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-common master: Use tempdir instead of files for ansible-action https://review.openstack.org/473586 | 13:05 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-common master: Change cwd and set HOME for ansible actions https://review.openstack.org/473587 | 13:06 |
| dprince | jistr: yes, that would help | 13:07 |
| mdbooth | Afternoon. Trying to install OSP8, compute node is idle with this in the logs: | 13:08 |
| mdbooth | Jun 16 09:07:39 overcloud-compute-0.localdomain os-collect-config[2532]: 2017-06-16 09:07:39.524 2532 WARNING os_collect_config.cfn [-] 403 Client Error: AccessDenied | 13:08 |
| mdbooth | Lots of this in the logs | 13:08 |
| *** limao has joined #tripleo | 13:08 | |
| *** cdearborn has joined #tripleo | 13:09 | |
| mdbooth | Slightly more: http://paste.openstack.org/show/612855/ | 13:09 |
| mdbooth | Any idea what is being denied? | 13:09 |
| *** fpan_ has quit IRC | 13:10 | |
| shardy | mdbooth: it's failing trying to reach heat-api-cfn on the undercloud | 13:10 |
| shardy | I'd check it's running and any log clues there | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 13:10 |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 13:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 13:10 |
| *** limao_ has quit IRC | 13:10 | |
| shardy | mdbooth: also, check /etc/os-collect-config.conf - there will be a URL there which you can test by curling it (quote the URL to avoid the & backgrounding the curl) | 13:11 |
| shardy | that will hopefully reproduce the error and you can work back from there | 13:11 |
| mdbooth | shardy: Thanks | 13:11 |
| bogdando | shardy: "if we could just copy the data, it'd be much simpler" +1, so we're back to using kolla's kolla_config it seems | 13:12 |
| *** gbarros has joined #tripleo | 13:12 | |
| mdbooth | Jun 16 09:12:48 undercloud.redhat.local heat-api-cfn[20881]: 2017-06-16 09:12:48.373 20881 INFO heat.api.aws.ec2token [-] AWS authentication failure. | 13:13 |
| *** f13o has joined #tripleo | 13:13 | |
| mandre | dprince: ok, let's give kolla_config another try, this time maybe a little less verbose thanks to the new copy dir feature | 13:13 |
| bogdando | dprince: "more painful debugging is sort of a feature of using containers" haha, indeed! and I'm trying to ease pain here https://review.openstack.org/#/c/474269/, a little bit | 13:13 |
| *** zoliXXL is now known as zoli|brb | 13:13 | |
| *** dpivonka has quit IRC | 13:13 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: [WIP] Implement scenario005 with Ironic in overcloud https://review.openstack.org/474802 | 13:13 |
| shardy | mdbooth: Ok so next stop is keystone logs - the cfn api uses the keystone ec2tokens extension to validate the signature | 13:13 |
| *** ratailor has quit IRC | 13:14 | |
| *** jmelvin has joined #tripleo | 13:14 | |
| bogdando | shardy, dprince: what if store config files with self expire attribute, versioned, under etcd keys? :) | 13:15 |
| bogdando | let's start leveraging etcd right now, eh? :) | 13:15 |
| shardy | bogdando: that sounds like something to consider for a future release perhaps? | 13:15 |
| bogdando | we could store foo's configs versioned under some /foo/v<sha>, in base64'ed tarball | 13:16 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add Telemetry services to scenario002 https://review.openstack.org/474969 | 13:16 |
| bogdando | future releases should be using a nice looking configs view | 13:16 |
| bogdando | with tools from olso.config for etcd | 13:16 |
| bogdando | but for now we could think of that shortcut, but then we need to deploy etcd early | 13:17 |
| *** sid1 has joined #tripleo | 13:17 | |
| mdbooth | shardy: Do you happen to know much about keystone? | 13:17 |
| mdbooth | Logs look like a bit of a failboat | 13:17 |
| bogdando | but maybe just using kolla_config would work for now | 13:17 |
| *** jcoufal_ has joined #tripleo | 13:17 | |
| shardy | mdbooth: not really tbh, other than having fixed a few bugs over the years | 13:18 |
| bogdando | but then all configs will be ephemeral for container run-time hm | 13:18 |
| honza | rlandy: unfortunately, the DNS server patch doesn't fix things for me --- should i open a new bug with details? | 13:18 |
| rlandy | honza: when did you try it? | 13:18 |
| *** atoth has quit IRC | 13:18 | |
| bogdando | um, given a specific version though | 13:18 |
| honza | rlandy: about 16h ago | 13:18 |
| *** limao has quit IRC | 13:18 | |
| dprince | bogdando: ack, will give your review to improve logging a try | 13:18 |
| mdbooth | http://paste.openstack.org/show/612856/ | 13:19 |
| rlandy | honza: the caching server was shut down due to security concerns | 13:19 |
| mandre | dprince: the cinder-scheduler container is failing on a permission issue, http://logs.openstack.org/15/474915/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq-nv/5f98a83/logs/oooq/overcloud-controller-0/var/log/containers/cinder/cinder-scheduler.log.txt.gz#_2017-06-16_11_20_32_004 | 13:19 |
| *** pkovar has quit IRC | 13:19 | |
| *** atoth has joined #tripleo | 13:19 | |
| mdbooth | Anything stand out in there as obvious misconfigured? | 13:19 |
| bogdando | jistr, makes sense, let's just copy dirs with kolla config and remove host-path dances | 13:19 |
| rlandy | honza: I am uploading a new patch that defaults to opendns for the moment | 13:19 |
| rlandy | I will ping you to try again | 13:19 |
| honza | rlandy: excellent! | 13:19 |
| *** limao has joined #tripleo | 13:19 | |
| mdbooth | This is pretty much a stock OSP8 install with no customisations | 13:19 |
| mandre | dprince: do you know if /var/lib/cinder/conversion needs to be bind-mounted or just the ownership adjusted? | 13:19 |
| *** jcoufal has quit IRC | 13:19 | |
| rlandy | honza: apologies for the run around - this is a developing issue for us. | 13:20 |
| honza | rlandy: no worries at al | 13:20 |
| honza | al | 13:20 |
| honza | all | 13:20 |
| bogdando | not sure how to mitigate configs versioning then | 13:20 |
| honza | ugh | 13:20 |
| mdbooth | Was ooo supposed to configure certificates? | 13:20 |
| dprince | mandre: I think conversion is a directory for ephemeral things. So maybe the permissions, but we should confirm w/ Cinder | 13:20 |
| *** limao has quit IRC | 13:20 | |
| shardy | "There is either no auth token in the request or the certificate issuer is not trusted" | 13:20 |
| shardy | mdbooth: sounds suspicious | 13:21 |
| shardy | jaosorior: ^^ any ideas? | 13:21 |
| jistr | btw here is first passing multinode-containers job after 2 days... I was hoping for OVB too but there's something more to be done apparently... | 13:21 |
| jistr | https://review.openstack.org/#/c/474915/ | 13:21 |
| shardy | jistr: \o/ | 13:21 |
| *** fragatin_ has joined #tripleo | 13:21 | |
| *** fragatina has quit IRC | 13:21 | |
| jistr | essentially just a revert though... | 13:21 |
| dprince | mandre: I would just fix it, and then we can copy them on the fix | 13:22 |
| jaosorior | shardy: where did you see that? | 13:22 |
| dprince | mandre: jbernard, eharney, and gorka | 13:22 |
| mandre | jistr: just commented on the ovb job, it's a permission issue in cinder-scheduler | 13:22 |
| shardy | jaosorior: in the logs mdbooth just pasted - http://paste.openstack.org/show/612856/ | 13:22 |
| mdbooth | Hmm, ooo is rebuilding the computes | 13:22 |
| *** limao has joined #tripleo | 13:23 | |
| jaosorior | mdbooth: logs from where? or what was the action that triggered that? | 13:23 |
| mandre | jistr: it's a lot easier to debug with logs :) thanks for the fix | 13:23 |
| mdbooth | jaosorior: Action was installation (OSP8) | 13:23 |
| jistr | mandre: LOL yes | 13:23 |
| mdbooth | jaosorior: Logs are from keystone on the undercloud | 13:23 |
| jaosorior | wow | 13:24 |
| jaosorior | well, that's pretty strange | 13:24 |
| shardy | jaosorior: os-collect-config failed to poll the heat-api-cfn, which failed because keystone nacked the ec2tokens signature | 13:24 |
| shardy | which may just mean keystone is broken vs there actually being a bad signature | 13:24 |
| jaosorior | mdbooth: is heat running over httpd? | 13:24 |
| jistr | mandre: are you going after the cinder-scheduler issue with a patch or should i try? i'm hoping it would be an additional chown | 13:25 |
| mdbooth | jaosorior: pass :) Heat is dark magic to me. | 13:25 |
| jaosorior | mdbooth: do you know what endpoint was used for keystone? was it the public one? and if it is, is it using tls? | 13:25 |
| *** pchavva has joined #tripleo | 13:25 | |
| *** dtantsur is now known as dtantsur|brb | 13:25 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Fix ownership issue for cinder-scheduler https://review.openstack.org/474971 | 13:25 |
| mdbooth | [cfn] | 13:26 |
| mdbooth | metadata_url = http://172.16.0.1:8000/v1/ | 13:26 |
| mdbooth | stack_name = overcloud-Compute-br7vyhiy5nha-0-6auwgm72rokw | 13:26 |
| mdbooth | secret_access_key = 9b3bae445a884f0095fdfb2bab423a74 | 13:26 |
| mdbooth | access_key_id = 46664c2f508e4bd68739d3663d10f235 | 13:26 |
| mdbooth | path = NovaCompute.Metadata | 13:26 |
| jaosorior | shardy: there were similar issues when we first migrated heat to run over httpd. It required an extra setting in the apache configuration. But that shouldn't be the case in osp8 | 13:26 |
| jistr | mandre: actually maybe not, the permission issue is not within a volume mount. Strange... | 13:26 |
| mdbooth | That's on a compute | 13:26 |
| *** dpivonka has joined #tripleo | 13:26 | |
| mdbooth | Wait... it's heat on the undercloud hitting keystone | 13:27 |
| mandre | jistr: yeah, that's local to the container | 13:27 |
| mdbooth | Sec.. | 13:27 |
| *** swright has joined #tripleo | 13:27 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Change default DNS name server https://review.openstack.org/474334 | 13:27 |
| jaosorior | mdbooth: are openstack-heat-cfn and openstack-heat-api running? | 13:29 |
| mdbooth | This is what heat is doing: http://paste.openstack.org/show/612858/ | 13:29 |
| mdbooth | that's heat-cfn | 13:30 |
| *** amoralej is now known as amoralej|lunch | 13:30 | |
| *** ffiore has joined #tripleo | 13:30 | |
| mdbooth | They're both running | 13:30 |
| *** akuznetsov has joined #tripleo | 13:30 | |
| jaosorior | mdbooth: right, just wanted to verify if they're running over httpd or not. | 13:31 |
| jaosorior | mdbooth: was there anything after 2017-06-16 09:17:45.137 21121 DEBUG keystone.middleware.core [req-46781308-5323-484c-abc3-386828c0c733 - - - - -] There is either no auth token in the request or the certificate issuer is not trusted. No auth co: ?? | 13:32 |
| jaosorior | that seemed truncated | 13:32 |
| mdbooth | jaosorior: More of the same | 13:32 |
| *** limao_ has joined #tripleo | 13:32 | |
| *** swright has quit IRC | 13:32 | |
| *** pkovar has joined #tripleo | 13:33 | |
| *** b00tcat has quit IRC | 13:33 | |
| jistr | mandre: maybe i see it... i think the error is actually coming from cinder-volume service, and the problem is that we have containerized cinder-backup, which chowns /var/lib/cinder as the kolla's cinder user. I'll no-op cinder-backup too. | 13:33 |
| mandre | jistr: oh, it cinder-scheduler fails to create the /var/lib/cinder/conversion directory... that's odd, because the permission in the image seems right, http://paste.openstack.org/show/612860/ | 13:33 |
| *** b00tcat has joined #tripleo | 13:33 | |
| mandre | jistr: that would make more sense | 13:34 |
| jistr | mandre: i'll try another patchset then. Or do you think we should merge this one as-is first? | 13:35 |
| *** limao has quit IRC | 13:35 | |
| jaosorior | mdbooth: so there's nothing after the "No auth co:" bit? | 13:37 |
| mandre | jistr: we can merge your first one already as it makes the containers-multinode CI happy again | 13:37 |
| jistr | mandre: ok so i'll post a follow up patch right on top of the current one | 13:38 |
| mandre | jistr: or maybe disable all of the conterinerized services and we'll fix everything in another patch series | 13:38 |
| mdbooth | jaosorior: Yeah, there's more logs lines exactly like that | 13:38 |
| *** zoli|brb is now known as zoliXXL | 13:38 | |
| jistr | mandre: you mean all cinder related? | 13:38 |
| * jistr checks scheduler and api manifests | 13:39 | |
| mdbooth | jaosorior: I can send you the whole log if you like | 13:39 |
| jaosorior | mdbooth: sure | 13:39 |
| mdbooth | I really don't know what I'm looking at | 13:39 |
| mdbooth | jaosorior: What's your email? | 13:40 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-common master: Set perms to 0600 for the ssh key file https://review.openstack.org/474976 | 13:40 |
| *** limao has joined #tripleo | 13:41 | |
| *** limao_ has quit IRC | 13:41 | |
| jistr | mandre: i think api/scheduler look ok... i'm hoping they wouldn't go touch /var/lib/cinder directly... | 13:41 |
| mandre | jistr: these 2 should be fine I think | 13:42 |
| mandre | jistr: we have multipathd that also bind mounts /var/lib/cinder rw :-/ | 13:43 |
| mandre | so much for the hybrid model | 13:44 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 13:47 |
| *** ffiore has quit IRC | 13:47 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Fall back to non-containerized cinder-backup to unblock OVB CI https://review.openstack.org/474978 | 13:47 |
| jaosorior | mdbooth: I'm not sure what the issue is, sorry :/ | 13:48 |
| jaosorior | shardy ^^ | 13:48 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Fall back to non-containerized cinder-backup to unblock OVB CI https://review.openstack.org/474978 | 13:48 |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-docs master: Remove K, L & M release docs https://review.openstack.org/474979 | 13:49 |
| *** limao has quit IRC | 13:49 | |
| shardy | jistr, dciabrin: so it seems https://review.openstack.org/#/c/474943/1/docker/services/pacemaker/haproxy.yaml doesn't work becuse resolv.conf is open, I wonder if we need to remove the bind mount and only use kolla_config? | 13:49 |
| *** limao has joined #tripleo | 13:49 | |
| *** agopi has joined #tripleo | 13:49 | |
| *** shardy is now known as shardy_afk | 13:51 | |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Add missing Swift containersync service for containerized deployments https://review.openstack.org/474964 | 13:51 |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-quickstart master: Don't fail if VM extradisks are already attached https://review.openstack.org/474981 | 13:51 |
| jistr | mandre: so the mystery why multinode was fixed while OVB wasn't is explained i think, see latest comment at https://review.openstack.org/#/c/474915 | 13:52 |
| jistr | dprince, shardy_afk: ^ i think that patch is good to land, to get multinode CI going again. Hopefully the follow-up would fix OVB too. | 13:52 |
| jaosorior | d0ugal: could you check this out https://review.openstack.org/#/c/474573/ ? | 13:53 |
| d0ugal | jaosorior: sure | 13:54 |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-docs master: Remove K, L & M release docs https://review.openstack.org/474979 | 13:54 |
| mdbooth | jaosorior: Thanks for looking | 13:54 |
| dprince | jistr: +2, +A | 13:54 |
| jistr | dprince: thanks | 13:55 |
| jistr | jaosorior: thanks | 13:55 |
| d0ugal | jaosorior: LGTM | 13:55 |
| dciabrin | shardy oh.... | 13:57 |
| jaosorior | d0ugal: thanks :D | 13:58 |
| *** akrivoka has quit IRC | 13:59 | |
| mandre | jistr: we don't deploy multipathd either it seems, we should be safe on that side | 13:59 |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-quickstart master: Add ability to control the size of VM extradisks https://review.openstack.org/474985 | 14:00 |
| *** limao_ has joined #tripleo | 14:00 | |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-docs master: Remove K, L & M release docs https://review.openstack.org/474979 | 14:00 |
| dciabrin | shardy so only haproxy has this behaviour? or the other services as well? | 14:00 |
| jistr | mandre: yea i'm just looking at that... also i *think* it doesn't run as cinder user, so it should be oblivious to what UID in particular is /var/lib/cinder owned by, as either way it shouldn't be the same UID as multipathd runs as... unless i missed the user setting somewhere | 14:00 |
| *** dtantsur|brb is now known as dtantsur | 14:01 | |
| mandre | jistr: if it's not specified in the template or in kolla, then it defaults as root | 14:01 |
| jistr | mandre: yea i couldn't spot anything, so it probably does run as root | 14:02 |
| honza | rlandy: still getting "instackenv.json did not validate" errors with the latest patchset | 14:02 |
| jaosorior | pradk: dammit. Seems that even with that patch, the issue is not entirely fixed :/ Seems we are gonna need that retry after all | 14:02 |
| *** limao has quit IRC | 14:02 | |
| *** limao has joined #tripleo | 14:03 | |
| pradk | jaosorior, is swift not up by then? | 14:03 |
| pradk | jaosorior, the dependency should have ensured that? | 14:04 |
| jaosorior | pradk: that's what I thought O_o | 14:04 |
| jaosorior | it's very strange | 14:04 |
| pradk | jaosorior, what error do you see? may be its different | 14:04 |
| jaosorior | it's the same BadStatusLine stack trace | 14:04 |
| jaosorior | I don't get it | 14:04 |
| pradk | hmm | 14:04 |
| *** limao_ has quit IRC | 14:05 | |
| pradk | jaosorior, do you have the logs i can look? want to check the timestamps | 14:06 |
| rlandy | honza: my run is working so far ... how did you apply the patchset? | 14:06 |
| jaosorior | pradk: I don't; just whiped out that directory | 14:06 |
| *** anshulbehl has quit IRC | 14:06 | |
| honza | rlandy: git review -d <patch number> | 14:06 |
| rlandy | honza: can you paste your https://github.com/openstack/tripleo-quickstart/blob/master/quickstart-extras-requirements.txt | 14:07 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: Use HAproxy config files copied by Kolla bootstrap https://review.openstack.org/474943 | 14:07 |
| honza | rlandy: a single line that reads "file:///home/hpokorny/code/tripleo-quickstart-extras/#egg=tripleo-quickstart-extras" | 14:07 |
| honza | rlandy: happy to try anything to help debug | 14:08 |
| pradk | jaosorior, may be the issue is with swift coming up properly? are swift services reachable | 14:08 |
| *** shardy_afk is now known as shardy | 14:09 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Make a copy of files touched by puppet in container https://review.openstack.org/474891 | 14:09 |
| jaosorior | pradk: right | 14:09 |
| jaosorior | that could be | 14:09 |
| rlandy | honza: that looks right - each time before you run, do you delete your working dir? (default ~/.quickstart)? | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698136 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1698136 in tripleo "Containers deployment CI broken, logs missing" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 14:10 |
| shardy | dciabrin: I suspect it's several services, but we hit haproxy first because it's in step1 | 14:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 14:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 14:10 |
| honza | rlandy: I use --working-dir . | 14:10 |
| rlandy | honza: ok - do you delete and recreate it each time? | 14:10 |
| honza | rlandy: the latest run was actually from a clean checkout (and no ~/.quickstart) | 14:11 |
| honza | rlandy: yes; bash devmode.sh --ovb --no-gate --delete-all-stacks --working-dir . | 14:11 |
| *** pchavva has quit IRC | 14:12 | |
| *** limao has quit IRC | 14:12 | |
| *** limao has joined #tripleo | 14:13 | |
| rlandy | honza: ok - no matter - as long as you are not reusing the working dir, you delete that dir and recreate it each time | 14:13 |
| *** chlong has joined #tripleo | 14:14 | |
| openstackgerrit | Christopher Brown proposed openstack/tripleo-docs master: Remove K, L & M release docs https://review.openstack.org/474979 | 14:14 |
| *** yamahata_ has joined #tripleo | 14:16 | |
| *** jlinkes has quit IRC | 14:16 | |
| rlandy | honza: in the working dir, you should see a file named <some prefix>env.yaml. pls paste the contents of that file. you can remove your password | 14:17 |
| jaosorior | Could I get a review for this t-h-t patch https://review.openstack.org/#/c/474532/ ? :D | 14:18 |
| honza | rlandy: here http://paste.openstack.org/show/612868/ | 14:18 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ui master: Change tripleo-ui login images https://review.openstack.org/474710 | 14:20 |
| jaosorior | thanks pradk | 14:20 |
| *** katkapilatova has left #tripleo | 14:24 | |
| *** limao_ has joined #tripleo | 14:24 | |
| rlandy | honza: hmm .. you have the correct setting: dns_nameservers ... | 14:24 |
| *** amoralej|lunch is now known as amoralej | 14:26 | |
| mandre | cschwede: sorry, I don't have more info about https://github.com/openstack/tripleo-validations/commit/2e1a198c other than what's in the commit message | 14:26 |
| *** limao__ has joined #tripleo | 14:27 | |
| mandre | cschwede: I've looked at the clapper repo from where this validation originated, and there is no further info, https://github.com/rthallisey/clapper/pull/20 | 14:27 |
| pradk | sure | 14:27 |
| *** limao has quit IRC | 14:27 | |
| honza | rlandy: here is the error for completeness http://paste.openstack.org/show/612873/ | 14:27 |
| *** limao_ has quit IRC | 14:28 | |
| jaosorior | mwhahaha, EmilienM: Could you check this out https://review.openstack.org/#/c/474946/ | 14:28 |
| cschwede | mandre: ok, thx! I'll ask Tomas then, maybe he knows more about that | 14:28 |
| rlandy | honza: it looks like you are doing things right - the only thing that troubles me is putting your working dir within tripleo-quickstart | 14:29 |
| EmilienM | jaosorior: sure | 14:29 |
| rlandy | because to rerun, you need to clean out that entire dir | 14:30 |
| rlandy | and there is room for confusion | 14:30 |
| honza | rlandy: ok, i'll try again without overriding that | 14:30 |
| rlandy | honza: please remove everything in tripleo-quickstart, relcone, edit quickstart-extras-requirements.txt before you rerun | 14:31 |
| *** limao__ has quit IRC | 14:31 | |
| *** limao has joined #tripleo | 14:31 | |
| honza | rlandy: yep, on it | 14:31 |
| rlandy | honza: to be clear - there is no issue overriding --working dir - I just would place it in a dir that you can delete and recreate | 14:32 |
| jaosorior | Have a good weekend everyone! | 14:34 |
| EmilienM | jaosorior: no wait | 14:34 |
| jaosorior | aaaaah' | 14:34 |
| EmilienM | you can't leave like that I mean | 14:34 |
| shardy | you too jaosorior | 14:34 |
| EmilienM | jaosorior: enjoy :D | 14:35 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ui master: Change tripleo-ui login images https://review.openstack.org/474710 | 14:35 |
| openstackgerrit | Merged openstack/tripleo-common stable/ocata: Ensure Swift Rings backup container and URLs https://review.openstack.org/473319 | 14:36 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: can_promote function: fix case for oooq when ZUUL_CHANGES is not defined https://review.openstack.org/474504 | 14:36 |
| jaosorior | EmilienM: haha will do. you too | 14:37 |
| *** cylopez has quit IRC | 14:37 | |
| *** jaosorior has quit IRC | 14:37 | |
| *** janki has quit IRC | 14:38 | |
| *** jprovazn has quit IRC | 14:40 | |
| *** jcoufal has joined #tripleo | 14:40 | |
| dciabrin | shardy, https://review.openstack.org/#/c/474943/ updated btw | 14:41 |
| *** jcoufal_ has quit IRC | 14:41 | |
| *** limao_ has joined #tripleo | 14:41 | |
| shardy | dciabrin: thanks, testing now | 14:41 |
| *** limao has quit IRC | 14:42 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Only pass distinct services to enabled_services list https://review.openstack.org/474862 | 14:44 |
| *** sid1 has quit IRC | 14:48 | |
| *** funzo has quit IRC | 14:50 | |
| *** limao has joined #tripleo | 14:50 | |
| *** agopi has quit IRC | 14:51 | |
| abishop | https://review.openstack.org/474955 (final "NAS secure" patch for ocata) is ready for review | 14:53 |
| *** cdearborn__ has joined #tripleo | 14:53 | |
| *** hjensas has quit IRC | 14:54 | |
| *** limao_ has quit IRC | 14:54 | |
| *** hjensas has joined #tripleo | 14:54 | |
| *** salmankhan has joined #tripleo | 14:57 | |
| bogdando | https://bugs.launchpad.net/tripleo/+bug/1698349/comments/3 sigh... | 14:59 |
| openstack | Launchpad bug 1698349 in tripleo "mysql_init_tasks does not always provide .my.cnf" [Medium,Invalid] - Assigned to Bogdan Dobrelya (bogdando) | 14:59 |
| *** akuznetsov has quit IRC | 15:00 | |
| *** limao has quit IRC | 15:01 | |
| ansiwen | when deploying overcloud: "Property KeystoneFernetKeys not assigned" | 15:01 |
| ansiwen | someone saw that before? | 15:01 |
| *** limao has joined #tripleo | 15:02 | |
| *** mrchao has quit IRC | 15:03 | |
| *** agopi has joined #tripleo | 15:04 | |
| *** mcornea has quit IRC | 15:05 | |
| atoth | EmilienM, beagles, shardy, if I come across a deprecated attribute in a file I'm updated and it calls out that is was deprecated in a past release (newton in the case I'm looking at), should we remove that attribute or keep it for backwards compatibility? | 15:05 |
| rlandy | honza: any luck? | 15:06 |
| beagles | atoth, depends :) usually yes | 15:06 |
| atoth | beagles, yes to remove it? | 15:06 |
| beagles | atoth, which one are you looking at? | 15:06 |
| beagles | atoth: neutron::lbaas::service_plugins or whatever? | 15:07 |
| atoth | beagles, puppet-neutron/manifests/services/lbaas.pp $package_ensure | 15:07 |
| *** cdearborn has quit IRC | 15:08 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fall back to non-containerized cinder-volume to unblock CI https://review.openstack.org/474915 | 15:08 |
| beagles | atoth, yeah I think it's safe to submit a patch to remove that | 15:09 |
| atoth | beagles, that's just one of the deprecated references to package_ensure throughout the lbaas files I've run into | 15:09 |
| *** ebarrera_ has joined #tripleo | 15:10 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 15:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 15:10 |
| *** egonzalez has quit IRC | 15:10 | |
| *** ebarrera_ has quit IRC | 15:10 | |
| atoth | beagles, should that change (to that and other files) be a single patch or can it be part of a larger change (for the enablement of the lbaas integration) | 15:11 |
| beagles | atoth, if you have specific questions about deprecation in puppet modules, #openstack-puppet is the place to ask | 15:11 |
| openstackgerrit | Steve Linabery proposed openstack/tripleo-puppet-elements master: scsi-target-utils is not used in RHEL7+ https://review.openstack.org/475001 | 15:11 |
| beagles | atoth, I'd put the removal of deprecated params in its own patch | 15:11 |
| dciabrin | dprince, shardy when you have some time, could you help me make https://review.openstack.org/#/c/474183/1 a bit cleaner? | 15:11 |
| atoth | beagles, ok, good thing I have changed to much in that repo yet ;-) | 15:13 |
| atoth | beagles, haven't | 15:13 |
| *** limao_ has joined #tripleo | 15:13 | |
| atoth | friday typing skillz | 15:13 |
| beagles | :) for you maybe... for me that's everyday | 15:14 |
| atoth | :-) | 15:14 |
| *** rcernin has quit IRC | 15:15 | |
| *** fzdarsky is now known as fzdarsky|afk | 15:16 | |
| *** jaganathan has joined #tripleo | 15:16 | |
| *** limao has quit IRC | 15:17 | |
| *** dciabrin has quit IRC | 15:17 | |
| *** jcoufal has quit IRC | 15:17 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Blacklist support for ExtraConfig https://review.openstack.org/475003 | 15:17 |
| *** jcoufal has joined #tripleo | 15:18 | |
| ansiwen | is there a way to use a custom tripleo-common for my overcloud deployment without redeploying the undercloud? | 15:19 |
| *** salmankhan has quit IRC | 15:19 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources https://review.openstack.org/473817 | 15:19 |
| *** salmankhan has joined #tripleo | 15:20 | |
| *** pcaruana has quit IRC | 15:20 | |
| abishop | ansiwen: just tried a fresh deployment, and got that same failure | 15:23 |
| *** limao_ has quit IRC | 15:24 | |
| *** limao has joined #tripleo | 15:24 | |
| openstackgerrit | Marios Andreou proposed openstack/instack-undercloud master: WIP Adds execution of validations on undercloud upgrade https://review.openstack.org/474578 | 15:27 |
| *** jbadiapa has quit IRC | 15:28 | |
| * EmilienM running massive Launchpad bug triage | 15:28 | |
| *** salmankhan has quit IRC | 15:31 | |
| *** dciabrin has joined #tripleo | 15:32 | |
| *** itlinux_ has joined #tripleo | 15:34 | |
| *** limao_ has joined #tripleo | 15:35 | |
| *** itlinux_ has quit IRC | 15:36 | |
| *** limao has quit IRC | 15:38 | |
| *** pchavva has joined #tripleo | 15:39 | |
| *** Goneri has joined #tripleo | 15:40 | |
| *** sid1 has joined #tripleo | 15:40 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - policy.json change test in container CI https://review.openstack.org/474360 | 15:41 |
| *** lmiccini has quit IRC | 15:41 | |
| *** lmiccini has joined #tripleo | 15:41 | |
| *** itlinux has joined #tripleo | 15:44 | |
| dtantsur | folks, is there a way to set --compute-flavor etc via environment files? | 15:46 |
| *** salmankhan has joined #tripleo | 15:47 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use templated network-environment file for OVB https://review.openstack.org/474781 | 15:47 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add templates to configure Ironic inspector https://review.openstack.org/436159 | 15:48 |
| mwhahaha | dtantsur: Overcloud<role>Flavor i think | 15:49 |
| mwhahaha | dtantsur: ie OvercloudComputeFlavor | 15:49 |
| dtantsur | mwhahaha: I thought so too, does not work | 15:49 |
| mwhahaha | dtantsur: sounds like a bug then, https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/compute-role.yaml#L13 | 15:50 |
| paramite | does anybody know what I have to do, to avoid 2017-06-16 15:47:20Z [overcloud]: CREATE_FAILED Resource CREATE failed: resources[47]: resources.ControllerServiceChain.resources.PuppetServices.resources.ServiceChain.Property error: resources.KeystoneBase.properties: Property KeystoneFernetKeys not assigned | 15:50 |
| mwhahaha | dtantsur: but don't we use it in CI? | 15:50 |
| paramite | during overcloud deploy? | 15:50 |
| *** ebarrera has quit IRC | 15:50 | |
| dtantsur | hmm, maybe it did, I need t olook in depth | 15:50 |
| dtantsur | paramite: I got it recently because of mistmatch between tripleo-common and tripleo-heat-templates versions.. | 15:50 |
| mwhahaha | paramite: sounds like a you might have an outdated client? we recently added that in and it's supposed to be generated on deploy | 15:50 |
| *** funzo has joined #tripleo | 15:51 | |
| paramite | dtantsur, I've updated to latest common and templates and didn't help | 15:51 |
| paramite | client sounds promising | 15:51 |
| paramite | gonna update | 15:51 |
| mwhahaha | paramite: well it's a mistral action | 15:51 |
| dtantsur | yeah, maybe it was client, I did not look in depth | 15:51 |
| mwhahaha | paramite: so make sure you update the mistral workbooks when you updated common | 15:51 |
| paramite | mwhahaha, so just update openstackclient? | 15:51 |
| paramite | oooh | 15:52 |
| mwhahaha | paramite: no it would be tripleoclient but it just calls a mistral action to generate the passwords | 15:52 |
| paramite | mistral workbooks ... how to update them? :) | 15:52 |
| * mwhahaha goes looking for docs | 15:52 | |
| *** snecklifter_ has quit IRC | 15:52 | |
| mwhahaha | i know we have code to do it in the updates | 15:53 |
| mwhahaha | basiclaly it's removing all the tripleo actions and reimporting them | 15:53 |
| mwhahaha | paramite: https://github.com/openstack/instack-undercloud/blob/c984ea9b356b7e89748119122a97cfc54e532c47/elements/undercloud-install/os-refresh-config/post-configure.d/98-undercloud-setup#L93-L102 | 15:54 |
| paramite | mwhahaha, thx | 15:54 |
| itlinux | hello and good day everyone.. | 15:54 |
| paramite | is python-tripleoclient-7.1.1-0.20170613152038.127c35e.el7.centos.noarch.rpm new enough? | 15:54 |
| itlinux | does anyone know where to get the latest images for the overcloud? | 15:54 |
| itlinux | TY | 15:55 |
| *** funzo has quit IRC | 15:56 | |
| *** ykarel has quit IRC | 15:56 | |
| mwhahaha | paramite: no you need fome after the 14th | 15:56 |
| paramite | doh ok | 15:56 |
| paramite | thanks | 15:56 |
| mwhahaha | paramite: you need https://review.openstack.org/#/c/473387/ | 15:56 |
| *** salmankhan has quit IRC | 15:56 | |
| paramite | ack | 15:57 |
| paramite | mwhahaha, dtantsur: thanks a lot! | 15:57 |
| *** sid1 has quit IRC | 15:57 | |
| *** nenad has quit IRC | 15:58 | |
| bnemec | mwhahaha: We don't deploy with roles in ci right now. That is a hole we should fill at some point though. | 16:00 |
| bnemec | It might be addressed by the scale testing job, if we're okay with a periodic test instead of an every patch one. | 16:00 |
| mwhahaha | bnemec: of course not, why would we cover that | 16:00 |
| bnemec | I think we're going to use roles there to keep the resource requirements as minimal as possible. | 16:00 |
| bnemec | mwhahaha: It's not a widely used feature, right? ;-) | 16:01 |
| *** bnemec is now known as beekneemech | 16:01 | |
| *** sid1 has joined #tripleo | 16:01 | |
| * beekneemech wishes #tripleo a happy Friday | 16:01 | |
| *** sid1 has quit IRC | 16:01 | |
| *** jpich has quit IRC | 16:01 | |
| mwhahaha | friday bitterness :D | 16:01 |
| *** sid1 has joined #tripleo | 16:02 | |
| mwhahaha | itlinux: in CI we use http://66.187.229.139/builds/current-tripleo/ evidently | 16:02 |
| mwhahaha | no idea why we don't actually configure some sort of dns for that host | 16:02 |
| itlinux | thank you! mwhahaha: | 16:02 |
| *** dtantsur is now known as dtantsur|afk | 16:03 | |
| mwhahaha | probably the same reason we don't use roles in ci | 16:03 |
| openstackgerrit | Lokesh Jain proposed openstack/tripleo-heat-templates master: Addition of Nuage as mechanism driver for ML2 https://review.openstack.org/474788 | 16:03 |
| *** atheurer has joined #tripleo | 16:03 | |
| mwhahaha | itlinux: fyi i pulled that from our tripleo-quickstart config https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml | 16:03 |
| itlinux | thanks again.. | 16:04 |
| *** atheurer has quit IRC | 16:04 | |
| shardy | we do test custom roles in CI, just not the new roles_data generation stuff | 16:04 |
| shardy | the undercloud job uses it, as does the upgrade job | 16:04 |
| mwhahaha | shardy: do we test Overcloud<node>Flavor? | 16:05 |
| itlinux | @mwhahaha: do you have any tips on how to install the UI? TY | 16:05 |
| *** ccamacho has quit IRC | 16:05 | |
| *** sid1 has quit IRC | 16:05 | |
| beekneemech | itlinux: jtomasek and dtrainor are good people to ask about the UI. | 16:07 |
| shardy | mwhahaha: not sure tbh - I thought the quickstart jobs used the quickstart generated flavors by default, but I could be mistaken | 16:07 |
| dtrainor | Howdy. ui is enabled by default. | 16:08 |
| *** ramishra has quit IRC | 16:08 | |
| shardy | it's entirely possible we don't have an intesection between *Flavor overrides and custom roles coverage though | 16:08 |
| dtrainor | itlinux, do you have any specific questions I can help with? | 16:08 |
| shardy | intersection even | 16:08 |
| itlinux | I will check the quickstart but I did not see the images.. | 16:08 |
| mwhahaha | shardy: yea but the question was about the compute flavor so just wondering if we have that in oooq or if we're using --control-flavor still (i have not checked) | 16:08 |
| shardy | mwhahaha: yeah not certain tbh, would have to check logs | 16:09 |
| mwhahaha | itlinux: quickstart sill has some work pending around the ui and setting up tunneling, https://review.openstack.org/#/c/407733/33 | 16:09 |
| *** yprokule has quit IRC | 16:09 | |
| *** limao_ has quit IRC | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 16:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 16:10 |
| itlinux | thank you @mwhahaha: | 16:10 |
| *** sid1 has joined #tripleo | 16:12 | |
| *** trown is now known as trown|lunch | 16:13 | |
| mwhahaha | shardy: yea it looks like we're still using --*-flavor in oooq-extras | 16:13 |
| mwhahaha | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/defaults/main.yml#L56 | 16:13 |
| jtomasek | itlinux what is your setup? UI is installed with undercloud and available at <undercloudip>:3000 you just need to make sure that undercloud ip and public endpoints are publicly accessible (from your browser) | 16:13 |
| *** artom has joined #tripleo | 16:14 | |
| *** zoliXXL is now known as zoli|gone | 16:14 | |
| *** suuuper has quit IRC | 16:17 | |
| *** bogdando has quit IRC | 16:18 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/python-tripleoclient master: Invoke the workflows specified in plan environment file. https://review.openstack.org/469596 | 16:19 |
| *** sid1 has quit IRC | 16:20 | |
| *** sid1 has joined #tripleo | 16:20 | |
| itlinux | @mwhahaha so this site is not good I guess :) https://docs.openstack.org/developer/tripleo-docs/installation/installation.html | 16:21 |
| mwhahaha | itlinux: it is. i use those directions to do installs | 16:22 |
| *** sid1 has quit IRC | 16:22 | |
| mwhahaha | itlinux: depends on what you're planning on doing, since you asked for current images i thought you were looking for development images (what i posted). if you're looking for stable versions just follow the instractions | 16:23 |
| *** yamahata_ has quit IRC | 16:24 | |
| itlinux | i need to deploy ocata.. TY | 16:25 |
| *** sid1 has joined #tripleo | 16:27 | |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Fix mkfs failure when loop device is not ready https://review.openstack.org/475022 | 16:30 |
| *** agopi has quit IRC | 16:31 | |
| *** noslzzp has joined #tripleo | 16:31 | |
| honza | rlandy: same error as before :( | 16:32 |
| *** jaganathan has quit IRC | 16:32 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Dell SC: Add exclude_domain_ip option https://review.openstack.org/474613 | 16:33 |
| honza | rlandy: do you want to see the env.yaml again? | 16:33 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Make fernet max active keys configurable https://review.openstack.org/474532 | 16:34 |
| openstackgerrit | Merged openstack/tripleo-common master: Add fernet keys purging based no t-h-t parameter https://review.openstack.org/474573 | 16:35 |
| rlandy | honza: no - I trust you are doing things right. Are you running from within the RH network? I am trying to determine what difference there is | 16:35 |
| *** lmiccini has quit IRC | 16:35 | |
| rlandy | jaosorior reported a successful deploy yesterday | 16:36 |
| Slower | shardy: playing around with docker healthchecks.. it looks like it waits a minute before it checks the state.. | 16:36 |
| honza | rlandy: not sure what you mean by that exactly | 16:36 |
| honza | rlandy: vpn? | 16:36 |
| Slower | shardy: is that going to be too long? | 16:36 |
| Slower | shardy: the other idea would be to do a docker exec.. | 16:37 |
| shardy | Slower: is there any way to make that faster, at least for the initial few checks? | 16:37 |
| rlandy | honza: I am remote and running with vpn. | 16:37 |
| honza | rlandy: me, too | 16:37 |
| Slower | shardy: ya I'll look into it | 16:37 |
| shardy | Slower: yes IMO it's too long if we want to interleave health checks with each deployment step | 16:37 |
| Slower | yeah agreed | 16:37 |
| shardy | probably OK for ongoing polling tho | 16:37 |
| Slower | yeah I think for the main purpose of system health it's good | 16:38 |
| rlandy | honza: when you ssh to your undercloud - what do you see in resolv.conf? | 16:38 |
| shardy | Slower: yeah, just need some iburst style initial period while the service comes up | 16:38 |
| rlandy | I am guessing you have the right nameserver but maybe it's blocked as well | 16:38 |
| shardy | or maybe manually check status in a loop in the ansible playbook | 16:38 |
| *** cdearborn_ has joined #tripleo | 16:39 | |
| Slower | shardy: ah ya, --health-interval | 16:39 |
| rlandy | honza: can you also check the private network created - you can do that from horizon - you should see the nameserver assigned | 16:39 |
| Slower | but that would affect it forever.. | 16:39 |
| Slower | I presume | 16:39 |
| honza | rlandy: http://paste.openstack.org/show/612880/ | 16:40 |
| honza | rlandy: the network:dhcp device under ports? | 16:43 |
| honza | rlandy: not sure where to find the right info | 16:43 |
| *** shardy has quit IRC | 16:44 | |
| *** florianf has quit IRC | 16:46 | |
| rlandy | honza: under your project (following the menu on the left hand side), Network -> Networks -> <prefix>-private -> Subnets -> <prefix>private ... you should see DNS Name Servers | 16:47 |
| rlandy | last thing I'll ask you to check :) | 16:47 |
| honza | rlandy: ah, yes, 208.67.222.222 | 16:48 |
| *** milan has quit IRC | 16:48 | |
| *** atheurer has joined #tripleo | 16:48 | |
| honza | rlandy: you're doing me a favor, not the other way around :) | 16:48 |
| *** milan has joined #tripleo | 16:50 | |
| *** athomas has quit IRC | 16:51 | |
| *** panda is now known as panda|bbl | 16:51 | |
| rlandy | honza: you have all the settings right ... will have to look into why this does not resolve for you | 16:51 |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Fix mkfs failure when loop device is not ready https://review.openstack.org/475022 | 16:52 |
| honza | rlandy: the onboarding doc has a section on networking --- i completed it --- would that be a problem? | 16:53 |
| honza | rlandy: is there anything else apart from the oooq setup itself that i need to do? | 16:53 |
| *** cdearborn__ has quit IRC | 16:54 | |
| rlandy | honza: networking? | 16:55 |
| * rlandy checks networking section | 16:56 | |
| *** agopi has joined #tripleo | 16:56 | |
| *** lucasagomes is now known as lucas-afk | 16:56 | |
| rlandy | hinza: oh - I see ... reading | 16:57 |
| *** sudipto has joined #tripleo | 16:57 | |
| *** sudipto_ has joined #tripleo | 16:57 | |
| *** fultonj has quit IRC | 16:58 | |
| rlandy | honza: ^^ ... ok - to run ovb, you don't need the networking section ... just the steps from "Create an OVB TripleO deployment for development and test." | 16:58 |
| *** salmankhan has joined #tripleo | 16:59 | |
| honza | rlandy: ok, great | 16:59 |
| rlandy | honza: we run ovb with this heat template - it creates all the networks etc. you need ... | 16:59 |
| rlandy | https://github.com/cybertron/openstack-virtual-baremetal/blob/master/templates/quintupleo.yaml | 16:59 |
| honza | rlandy: right, i did think it was strange to have two private networks | 16:59 |
| *** yamahata_ has joined #tripleo | 17:00 | |
| rlandy | honza; so you could have a pretty much blank tenant (access to - get the V2 rc file (include the password) run | 17:01 |
| rlandy | you don't need the section afterwards "OVB Details" - we take care of that for you within devmode | 17:01 |
| honza | cool | 17:03 |
| rlandy | honza: so when you look at the networks tab, you should see just the <prefix>* networks the OVB stack created and 38.145.32.0/22 | 17:03 |
| honza | rlandy: correct | 17:03 |
| rlandy | ok then | 17:03 |
| rlandy | you can recognize all resources created by OVB - they are all prefix'ed | 17:04 |
| *** artom has quit IRC | 17:04 | |
| rlandy | honza: ok- anything else we can look at to see differences? | 17:05 |
| honza | rlandy: i'm out of ideas | 17:05 |
| *** tosky has quit IRC | 17:07 | |
| rlandy | honza: have you added additional security groups or routers? | 17:08 |
| rlandy | you'll have a default security group | 17:08 |
| rlandy | and one created by the stack | 17:08 |
| rlandy | and one router created by the stack | 17:09 |
| honza | rlandy: only what is in the networking section --- i just deleted all of that and am retrying | 17:09 |
| rlandy | honza: ok - great - if that fails, you can create a set of temporary credentials, and I can try working from you tenant | 17:09 |
| rlandy | sort of last resort | 17:09 |
| honza | rlandy: awesome | 17:10 |
| honza | rlandy: thank you | 17:10 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 17:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 17:10 |
| rlandy | honza: thank you for sticking with this | 17:10 |
| *** gvrangan has joined #tripleo | 17:13 | |
| *** jtomasek has quit IRC | 17:14 | |
| EmilienM | can I get review on this doc patch please? https://review.openstack.org/#/c/474207/ | 17:15 |
| *** milan has quit IRC | 17:18 | |
| mdbooth | Random question: why can't undercloud release N install an overcloud release N-M for any value of M? Why only M=1? | 17:18 |
| itlinux | dum question what's the best way to create the undercloud.json file to use with instackenv.json ? | 17:18 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-common master: Switch to RDO packages for HA support in Kolla images https://review.openstack.org/475035 | 17:18 |
| *** dprince has quit IRC | 17:18 | |
| mdbooth | itlinux: There's a sample included in one of the packages. You can copy that and customise it. | 17:19 |
| mdbooth | /usr/share/instack-undercloud/undercloud.conf.sample | 17:20 |
| itlinux | mdbooth ok let me check TY | 17:20 |
| mdbooth | instackenv.json is kinda orthogonal to that iiuc, because it describes the ironic nodes available to the undercloud, i.e. it's used by an installed undercloud. undercloud.conf is for installing the undercloud in the first place. | 17:21 |
| itlinux | dum question that's a config in the doc I read it calls is undercloud.json .. | 17:21 |
| *** sasha2 has quit IRC | 17:21 | |
| mdbooth | Ah... undercloud.json. | 17:22 |
| mdbooth | I don't know what that is, sorry. | 17:22 |
| itlinux | yes I see the undercould.conf got created.. | 17:22 |
| itlinux | https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/baremetal_overcloud.html?highlight=overcloud%20deployment | 17:22 |
| itlinux | that' s where I found it.. | 17:22 |
| itlinux | If you already have an instackenv.json file with all nodes prepared, .... | 17:22 |
| *** funzo has joined #tripleo | 17:23 | |
| *** gvrangan has quit IRC | 17:25 | |
| *** gvrangan has joined #tripleo | 17:25 | |
| *** sasha2 has joined #tripleo | 17:27 | |
| honza | rlandy: another fail, same error | 17:27 |
| *** dciabrin has quit IRC | 17:29 | |
| honza | rlandy: shall i email you the credentials? | 17:29 |
| *** pkovar has quit IRC | 17:29 | |
| openstackgerrit | Merged openstack/os-collect-config master: Updated from global requirements https://review.openstack.org/474675 | 17:29 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Add Telemetry services to scenario002 https://review.openstack.org/474969 | 17:32 |
| openstackgerrit | Michael Henkel proposed openstack/puppet-tripleo stable/ocata: This patch moves Contrail roles to OpenStack API communication from the public external to the internal_api network. It also adds the missing configuration option for dpdk. https://review.openstack.org/475039 | 17:32 |
| *** jcoufal_ has joined #tripleo | 17:34 | |
| *** jcoufal has quit IRC | 17:36 | |
| rlandy | honza: yes - pls create switch to some temp creds and pm me - I'll look at your tenant | 17:36 |
| *** tosky has joined #tripleo | 17:36 | |
| *** jcoufal has joined #tripleo | 17:36 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Create the vhost root folder before creating the virtual host https://review.openstack.org/474526 | 17:38 |
| *** jcoufal_ has quit IRC | 17:39 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Create the vhost root folder before creating the virtual host https://review.openstack.org/474526 | 17:40 |
| *** salmankhan has quit IRC | 17:40 | |
| *** salmankhan has joined #tripleo | 17:41 | |
| *** snecklifter has left #tripleo | 17:41 | |
| *** jcoufal_ has joined #tripleo | 17:48 | |
| *** jcoufal has quit IRC | 17:51 | |
| openstackgerrit | Michael Henkel proposed openstack/puppet-tripleo master: This patch will move the Contrail roles communication towards OpenStack APIs from the public/external network to the internal_api network. I will also add the option to enable dpdk for Contrail. https://review.openstack.org/475045 | 17:51 |
| *** bfournie has quit IRC | 17:53 | |
| *** itlinux has quit IRC | 17:53 | |
| *** itlinux_ has joined #tripleo | 17:55 | |
| *** trown|lunch is now known as trown | 17:55 | |
| *** salmankhan has quit IRC | 17:57 | |
| *** dprince has joined #tripleo | 18:01 | |
| *** ipsecguy has joined #tripleo | 18:02 | |
| *** salmankhan has joined #tripleo | 18:02 | |
| *** ipsecguy_ has quit IRC | 18:03 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ui master: Change tripleo-ui login images https://review.openstack.org/474710 | 18:03 |
| *** pcaruana has joined #tripleo | 18:04 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 18:04 |
| *** jcoufal has joined #tripleo | 18:04 | |
| openstackgerrit | Michael Henkel proposed openstack/tripleo-heat-templates master: This patch moves Contrail roles communication from public/external to internal_api network for OpenStack API. It also adds the option to enable dpdk https://review.openstack.org/475048 | 18:04 |
| *** sudipto has quit IRC | 18:04 | |
| *** sudipto_ has quit IRC | 18:04 | |
| *** jcoufal_ has quit IRC | 18:06 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 18:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 18:10 |
| *** fragatin_ has quit IRC | 18:11 | |
| *** salmankhan has quit IRC | 18:17 | |
| *** salmankhan has joined #tripleo | 18:17 | |
| sshnaidm|off | cores, please approve https://review.openstack.org/#/c/474891/ | 18:22 |
| *** pchavva has quit IRC | 18:22 | |
| *** jaganathan has joined #tripleo | 18:22 | |
| *** cdearborn_ has quit IRC | 18:22 | |
| *** salmankhan has quit IRC | 18:24 | |
| *** salmankhan has joined #tripleo | 18:26 | |
| openstackgerrit | Clark Boylan proposed openstack/diskimage-builder master: On suse the python2 dev package is python-devel https://review.openstack.org/475051 | 18:27 |
| *** sid1 has quit IRC | 18:27 | |
| itlinux_ | does anyone know what DELL and super micro boxes support for the pm_type ? TY | 18:29 |
| *** artom has joined #tripleo | 18:30 | |
| *** salmankhan has quit IRC | 18:35 | |
| *** artom has quit IRC | 18:40 | |
| *** pcaruana has quit IRC | 18:41 | |
| *** salmankhan has joined #tripleo | 18:43 | |
| *** salmankhan has quit IRC | 18:50 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing featurset of containers https://review.openstack.org/473082 | 18:52 |
| sshnaidm|off | EmilienM, can you approve please? https://review.openstack.org/#/c/474891/ | 18:53 |
| EmilienM | sshnaidm|off: looking | 18:53 |
| sshnaidm|off | EmilienM, it's solution to containers logs | 18:53 |
| *** gvrangan has quit IRC | 18:53 | |
| EmilienM | sshnaidm|off: yeah | 18:56 |
| *** jtomasek has joined #tripleo | 19:10 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 19:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 19:10 |
| *** jaganathan has quit IRC | 19:12 | |
| *** jtomasek has quit IRC | 19:16 | |
| *** pkovar has joined #tripleo | 19:20 | |
| *** pkovar has quit IRC | 19:20 | |
| *** amoralej is now known as amoralej|off | 19:25 | |
| *** sasha2 has quit IRC | 19:28 | |
| *** noslzzp has quit IRC | 19:30 | |
| *** ecerquei__ has quit IRC | 19:31 | |
| *** dciabrin has joined #tripleo | 19:46 | |
| *** tesseract has quit IRC | 19:53 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Fix redis when hostname has capital letters https://review.openstack.org/474737 | 19:54 |
| *** dpivonka has quit IRC | 19:56 | |
| *** rhallisey has quit IRC | 19:57 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add Ec2Api to container based deployment https://review.openstack.org/469200 | 19:58 |
| *** jcoufal has quit IRC | 19:58 | |
| *** rhallisey has joined #tripleo | 20:00 | |
| *** jmelvin has quit IRC | 20:04 | |
| *** zzzeek has quit IRC | 20:07 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 20:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 20:10 |
| itlinux_ | does anyone have any tips on creating it's own overcloud images to inject into the undercloud? | 20:11 |
| *** f13o has quit IRC | 20:11 | |
| *** owalsh has quit IRC | 20:12 | |
| *** sbrzozow has quit IRC | 20:12 | |
| *** ecerquei__ has joined #tripleo | 20:15 | |
| *** itlinux_ has quit IRC | 20:18 | |
| *** agopi has quit IRC | 20:20 | |
| *** jtomasek has joined #tripleo | 20:22 | |
| openstackgerrit | Guil Barros proposed openstack/tripleo-heat-templates master: This patch moves Contrail roles communication from public/external to internal_api network for OpenStack API. It also adds the option to enable dpdk https://review.openstack.org/475048 | 20:26 |
| *** f13o has joined #tripleo | 20:26 | |
| *** owalsh has joined #tripleo | 20:30 | |
| *** zzzeek has joined #tripleo | 20:31 | |
| *** morazi has quit IRC | 20:32 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Add support for autofencing to Pacemaker Remote. https://review.openstack.org/473735 | 20:36 |
| openstackgerrit | Guil Barros proposed openstack/tripleo-heat-templates master: Contrail: Fix controlplane/dataplane network asignments & enable optional dpdk https://review.openstack.org/475048 | 20:37 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Only set the stonith property on the pacemaker_master node https://review.openstack.org/471630 | 20:39 |
| gbarros | EmilienM does that fix the commit? Sorry it's my first attempt at a commit msg ;) | 20:41 |
| EmilienM | gbarros: much better :D | 20:42 |
| EmilienM | thanks | 20:42 |
| gbarros | cool, thx | 20:42 |
| gbarros | EmilienM i wasnt sure if i should set the heat_template_version to pike or ocata. I went with pike as that is current master. | 20:43 |
| * mwhahaha looks at the install script and runs away | 20:44 | |
| gbarros | though that same template should still work in ocata | 20:44 |
| EmilienM | if [[ `echo $role |awk -F"-" '{print $2}'` == "contrailcontroller" || `echo $role |awk -F"-" '{print $2}'` == "contrailanalytics" || `echo $role |awk -F"-" '{print $2}'` == "contrailanalyticsdatabase" ]]; then | 20:47 |
| EmilienM | I mean | 20:47 |
| EmilienM | super easy folks | 20:47 |
| * tosky flinks at the repeated code | 20:47 | |
| EmilienM | echo "net.ipv4.tcp_keepalive_time = 5" >> /etc/sysctl.conf | 20:48 |
| EmilienM | gbarros: all of this can be done via puppet | 20:48 |
| EmilienM | we already have the interface, etc | 20:48 |
| gbarros | ack. I'll poke michael about it. | 20:49 |
| gbarros | mhenkel ^^ | 20:49 |
| EmilienM | gbarros: -2 for now, I'm not happy with this patch | 20:50 |
| gbarros | yup. | 20:50 |
| gbarros | i reached out to mhenkel, we'll sort it out. thanks EmilienM | 20:52 |
| *** bfournie has joined #tripleo | 20:53 | |
| EmilienM | cool | 20:53 |
| gbarros | im just fixing lint :) | 20:54 |
| *** jmelvin has joined #tripleo | 20:54 | |
| *** bfournie has quit IRC | 20:54 | |
| *** abishop has quit IRC | 20:54 | |
| *** karimb has quit IRC | 20:57 | |
| *** owalsh has quit IRC | 21:05 | |
| openstackgerrit | Guil Barros proposed openstack/puppet-tripleo master: Contrail: Fix controlplane/dataplane network asignments & enable optional dpdk https://review.openstack.org/475045 | 21:06 |
| *** owalsh has joined #tripleo | 21:07 | |
| *** dprince has quit IRC | 21:08 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 21:10 |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 21:10 |
| *** ecerquei__ has quit IRC | 21:13 | |
| *** mhenkel_ has joined #tripleo | 21:13 | |
| *** skramaja has quit IRC | 21:15 | |
| *** skramaja has joined #tripleo | 21:15 | |
| gbarros | EmilienM, got any ideas how else to do this? mhenkel indicates that the nasty bash configuration has to run before puppet runs on the node or os-net-config will bork. | 21:17 |
| *** paramite has quit IRC | 21:18 | |
| *** itlinux_ has joined #tripleo | 21:20 | |
| *** iranzo has quit IRC | 21:27 | |
| *** chlong has quit IRC | 21:30 | |
| *** jtomasek has quit IRC | 21:31 | |
| *** jkilpatr has quit IRC | 21:31 | |
| *** fragatina has joined #tripleo | 21:35 | |
| *** itlinux_ has quit IRC | 21:38 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Add ignore_projects to filter gnocchi events https://review.openstack.org/469202 | 21:41 |
| openstackgerrit | Merged openstack/puppet-tripleo master: For http service endpoints always redirect to https https://review.openstack.org/474108 | 21:43 |
| * beekneemech looks at the check-tripleo queue | 21:46 | |
| * beekneemech wonders if he has anything that needs a recheck | 21:46 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 22:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 22:10 |
| *** fragatina has quit IRC | 22:10 | |
| *** rlandy has quit IRC | 22:16 | |
| *** itlinux_ has joined #tripleo | 22:20 | |
| *** ansmith has joined #tripleo | 22:27 | |
| *** itlinux_ has quit IRC | 22:28 | |
| *** itlinux_ has joined #tripleo | 22:31 | |
| *** itlinux_ has quit IRC | 22:31 | |
| *** panda|bbl is now known as panda|off | 22:42 | |
| *** tosky has quit IRC | 22:44 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 22:47 |
| *** apetrich has quit IRC | 22:48 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix repositories for promotion jobs https://review.openstack.org/475084 | 22:49 |
| sshnaidm|off | panda|off, ^^ | 22:49 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-specs master: Clean up spec index https://review.openstack.org/475085 | 22:50 |
| *** mmethot has quit IRC | 22:51 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Replace plan list table with a card view https://review.openstack.org/462230 | 22:52 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix repositories for promotion jobs https://review.openstack.org/475084 | 22:56 |
| openstackgerrit | Merged openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/474697 | 22:57 |
| sshnaidm|off | cores, take a look for promotion blocker: https://review.openstack.org/475084 | 22:57 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fix mkfs failure when loop device is not ready https://review.openstack.org/475022 | 23:00 |
| EmilienM | sshnaidm|off: +2 | 23:03 |
| EmilienM | sshnaidm|off: I can ninja approve if it proves to pass CI | 23:03 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698172 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698175 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1698474 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1698172 in tripleo "ovb-containers job logs excessive amounts of data" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 23:10 |
| openstack | Launchpad bug 1698175 in tripleo "ovb-containers job is stuck in non-voting limbo" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1698474 in tripleo "CI: promotion oooq jobs use current repos instead of consistent" [Critical,In progress] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 23:10 |
| *** trozet has joined #tripleo | 23:11 | |
| *** brault_ has joined #tripleo | 23:17 | |
| *** spredzy_ has joined #tripleo | 23:18 | |
| *** george_goh|afk has joined #tripleo | 23:20 | |
| *** trown|brb has joined #tripleo | 23:20 | |
| *** liverpoo1er has joined #tripleo | 23:22 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Don't mangle code when building for production https://review.openstack.org/475089 | 23:23 |
| *** therve_ has joined #tripleo | 23:24 | |
| *** kbyrne_ has joined #tripleo | 23:25 | |
| *** jmelvin has quit IRC | 23:25 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Add support for autofencing to Pacemaker Remote. https://review.openstack.org/473736 | 23:25 |
| *** mjblack- has joined #tripleo | 23:25 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Ensure hiera step value is an integer https://review.openstack.org/466556 | 23:25 |
| *** trozet has quit IRC | 23:26 | |
| *** liverpooler has quit IRC | 23:26 | |
| *** brault has quit IRC | 23:26 | |
| *** hamzy has quit IRC | 23:26 | |
| *** rwsu has quit IRC | 23:26 | |
| *** therve has quit IRC | 23:26 | |
| *** kbyrne has quit IRC | 23:26 | |
| *** spredzy has quit IRC | 23:26 | |
| *** cschwede has quit IRC | 23:26 | |
| *** sshnaidm|off has quit IRC | 23:26 | |
| *** jpena|off has quit IRC | 23:26 | |
| *** weshay has quit IRC | 23:26 | |
| *** trown has quit IRC | 23:26 | |
| *** mjblack has quit IRC | 23:26 | |
| *** mnaser has quit IRC | 23:26 | |
| *** george_goh has quit IRC | 23:26 | |
| *** kbyrne_ is now known as kbyrne | 23:26 | |
| *** spredzy_ is now known as spredzy | 23:26 | |
| *** mjblack- is now known as mjblack | 23:26 | |
| *** jpena|off has joined #tripleo | 23:26 | |
| *** rwsu has joined #tripleo | 23:27 | |
| *** hamzy has joined #tripleo | 23:27 | |
| *** sshnaidm|off has joined #tripleo | 23:28 | |
| *** weshay has joined #tripleo | 23:31 | |
| *** trozet has joined #tripleo | 23:31 | |
| *** cschwede has joined #tripleo | 23:31 | |
| *** cschwede has quit IRC | 23:31 | |
| *** cschwede has joined #tripleo | 23:31 | |
| *** weshay has quit IRC | 23:31 | |
| *** weshay has joined #tripleo | 23:31 | |
| *** trozet has quit IRC | 23:32 | |
| *** trozet has joined #tripleo | 23:32 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fall back to non-containerized cinder-backup to unblock OVB CI https://review.openstack.org/474978 | 23:33 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Make a copy of files touched by puppet in container https://review.openstack.org/474891 | 23:33 |
| *** mnaser has joined #tripleo | 23:34 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Limit collection of config-data to puppet-generated files https://review.openstack.org/474896 | 23:36 |
| *** sid1 has joined #tripleo | 23:36 | |
| *** trozet has quit IRC | 23:45 | |
| *** mhenkel__ has joined #tripleo | 23:47 | |
| *** mhenkel_ has quit IRC | 23:50 | |
| *** mhenkel__ has quit IRC | 23:51 | |
| *** sid1 has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!