| openstackgerrit | Merged openstack/tripleo-common master: Use nova-api image for configuration as well https://review.openstack.org/490385 | 00:05 |
|---|---|---|
| *** morazi has quit IRC | 00:06 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 00:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 00:10 |
| *** trozet has quit IRC | 00:10 | |
| *** atheurer has joined #tripleo | 00:13 | |
| *** itlinux has joined #tripleo | 00:20 | |
| *** chem has quit IRC | 00:26 | |
| *** psahoo has joined #tripleo | 00:26 | |
| *** tzumainn has joined #tripleo | 00:31 | |
| *** atheurer has quit IRC | 00:32 | |
| *** atheurer has joined #tripleo | 00:32 | |
| *** rbrady has joined #tripleo | 00:34 | |
| *** rbrady has joined #tripleo | 00:34 | |
| *** mdnadeem has joined #tripleo | 00:46 | |
| *** tzumainn has quit IRC | 00:47 | |
| *** bfournie has joined #tripleo | 00:50 | |
| *** bfournie has quit IRC | 00:51 | |
| *** limao has joined #tripleo | 00:55 | |
| pabelanger | mwhahaha: EmilienM: patch merge to fix buildlogs, we should see a large improvement now. | 00:56 |
| *** atheurer has quit IRC | 00:57 | |
| *** psahoo has quit IRC | 01:00 | |
| mwhahaha | pabelanger: which one? | 01:02 |
| pabelanger | mwhahaha: https://review.openstack.org/492256 | 01:02 |
| *** rhallisey has quit IRC | 01:02 | |
| mwhahaha | ah cool | 01:02 |
| pabelanger | I'll rework it in the morning to remove the 302 redirect and directly access buildlogs.cdn.centos.org | 01:03 |
| pabelanger | have a puppet-openstack-integration patch testing now | 01:03 |
| pabelanger | if that passes, we'll be good | 01:03 |
| *** jkilpatr has quit IRC | 01:04 | |
| *** limao_ has joined #tripleo | 01:08 | |
| *** limao has quit IRC | 01:09 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 01:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 01:10 |
| *** psahoo has joined #tripleo | 01:13 | |
| *** rwsu_ has quit IRC | 01:13 | |
| *** gbarros has joined #tripleo | 01:14 | |
| *** myoung|remote has joined #tripleo | 01:18 | |
| *** myoung|remote has quit IRC | 01:23 | |
| *** dtrainor has quit IRC | 01:23 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci master: Stop trying to build networking-bagpipe with DLRN https://review.openstack.org/492339 | 01:24 |
| pabelanger | mwhahaha: EmilienM: bnemec: ^ is also needed to stop DLRn from building networking-bagpipe RPM. Still breaking the gate queue and reseting it | 01:25 |
| pabelanger | that affects gate-tripleo-ci-centos-7-undercloud-containers | 01:26 |
| mwhahaha | Ah yes got to love that we do things twice | 01:26 |
| pabelanger | Yup, 'love' | 01:26 |
| *** dtrainor has joined #tripleo | 01:30 | |
| *** dparkes has quit IRC | 01:36 | |
| *** ramishra has quit IRC | 01:39 | |
| *** dtrainor has quit IRC | 01:39 | |
| *** rbrady has quit IRC | 01:39 | |
| *** dtrainor has joined #tripleo | 01:39 | |
| *** rwsu has joined #tripleo | 01:41 | |
| *** bkopilov has quit IRC | 01:43 | |
| *** trozet has joined #tripleo | 01:55 | |
| *** cshastri has joined #tripleo | 01:58 | |
| *** dpawar has joined #tripleo | 01:59 | |
| *** dmacpher has quit IRC | 02:05 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 02:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 02:10 |
| itlinux | hello all I thought this bug was removed.. http://paste.openstack.org/show/618000/ | 02:10 |
| itlinux | or fixed.. | 02:10 |
| pabelanger | weshay: see this before: http://logs.openstack.org/57/475457/4/gate/gate-tripleo-ci-centos-7-containers-multinode/54b3deb/logs/undercloud/home/jenkins/hostname.sh.log.txt.gz | 02:13 |
| pabelanger | hostnamectl was empty | 02:14 |
| weshay | jebus | 02:14 |
| weshay | no | 02:14 |
| pabelanger | Hmm | 02:14 |
| pabelanger | vexxhost | 02:14 |
| pabelanger | we just added that cloud | 02:14 |
| weshay | so the undercloud needs a proper hostname | 02:15 |
| weshay | that will be a problem | 02:15 |
| weshay | http://logs.openstack.org/57/475457/4/gate/gate-tripleo-ci-centos-7-containers-multinode/54b3deb/logs/undercloud/home/jenkins/hostname.sh.txt.gz | 02:15 |
| pabelanger | weshay: yup, thanks. its our issue for sure | 02:16 |
| *** kbyrne has quit IRC | 02:20 | |
| *** dmacpher has joined #tripleo | 02:22 | |
| *** kbyrne has joined #tripleo | 02:23 | |
| *** shreshtha__ has joined #tripleo | 02:24 | |
| *** yamahata has quit IRC | 02:25 | |
| *** shreshtha_ has quit IRC | 02:27 | |
| *** ramishra has joined #tripleo | 02:30 | |
| itlinux | has anyone seen this error /usr/lib/python2.7/site-packages/requests/packages/urllib3/connection.py:303: SubjectAltNameWarning: Certificate for horizon.evidc.wavemarket.com has no `subjectAltName` | 02:38 |
| *** dmacpher has quit IRC | 02:53 | |
| *** yamahata has joined #tripleo | 02:54 | |
| *** shreshtha__ has quit IRC | 02:56 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Disable existing repositories in tripleo-ci https://review.openstack.org/492289 | 02:59 |
| *** bkopilov has joined #tripleo | 03:04 | |
| *** dmacpher has joined #tripleo | 03:07 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 03:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 03:10 |
| EmilienM | pabelanger: very cool | 03:12 |
| EmilienM | weshay: I understood your joke, lol | 03:13 |
| *** itlinux has quit IRC | 03:20 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Disable existing repositories in tripleo-ci https://review.openstack.org/492289 | 03:21 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Disable existing repositories in tripleo-ci https://review.openstack.org/492289 | 03:25 |
| *** ramishra has quit IRC | 03:28 | |
| *** ramishra has joined #tripleo | 03:29 | |
| *** cshastri has quit IRC | 03:32 | |
| *** dpawar has quit IRC | 03:33 | |
| *** gbarros has quit IRC | 03:37 | |
| *** atheurer has joined #tripleo | 03:39 | |
| *** udesale has joined #tripleo | 03:40 | |
| *** gkadam has joined #tripleo | 03:41 | |
| *** ramishra has quit IRC | 03:42 | |
| *** cshastri has joined #tripleo | 03:45 | |
| *** atheurer has quit IRC | 03:45 | |
| *** ramishra has joined #tripleo | 03:50 | |
| openstackgerrit | Merged openstack/tripleo-ui master: EnvironmentConfiguration changes https://review.openstack.org/483896 | 03:50 |
| *** ipsecguy has joined #tripleo | 03:55 | |
| *** ipsecguy_ has quit IRC | 03:58 | |
| *** cshastri has quit IRC | 04:03 | |
| *** shreshtha has joined #tripleo | 04:10 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 04:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 04:10 |
| *** ykarel|away has joined #tripleo | 04:18 | |
| *** gvrangan has joined #tripleo | 04:22 | |
| *** skramaja has joined #tripleo | 04:25 | |
| *** dpawar has joined #tripleo | 04:25 | |
| *** cshastri has joined #tripleo | 04:28 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Docker/TLS everywhere: Add telemetry and neutron services to environment https://review.openstack.org/491782 | 04:32 |
| *** ratailor has joined #tripleo | 04:43 | |
| *** shreshtha has quit IRC | 04:43 | |
| *** gvrangan has quit IRC | 04:45 | |
| *** cshastri has quit IRC | 04:46 | |
| *** rwsu has quit IRC | 04:58 | |
| *** jfrancoa has joined #tripleo | 05:05 | |
| *** pdeore has joined #tripleo | 05:05 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 05:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 05:10 |
| *** marios has joined #tripleo | 05:10 | |
| *** garyk has joined #tripleo | 05:23 | |
| *** janki has joined #tripleo | 05:29 | |
| *** gvrangan has joined #tripleo | 05:33 | |
| *** zshi_laptop has joined #tripleo | 05:35 | |
| *** nyechiel_ has joined #tripleo | 05:36 | |
| *** sshnaidm|off has quit IRC | 05:37 | |
| *** nyechiel_ has quit IRC | 05:42 | |
| *** ccamacho has quit IRC | 05:47 | |
| *** dpawar has quit IRC | 05:49 | |
| *** jprovazn has joined #tripleo | 05:52 | |
| *** psachin has joined #tripleo | 05:52 | |
| *** ykarel_ has joined #tripleo | 05:54 | |
| *** ykarel|away has quit IRC | 05:57 | |
| *** dpawar has joined #tripleo | 05:57 | |
| *** rcernin has joined #tripleo | 06:05 | |
| *** yprokule has joined #tripleo | 06:05 | |
| *** rwsu has joined #tripleo | 06:07 | |
| *** pgadiya has joined #tripleo | 06:07 | |
| *** masco has joined #tripleo | 06:07 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 06:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 06:10 |
| *** cshastri has joined #tripleo | 06:13 | |
| gcerami|Zz | jistr: can you tak a look at why this failed ? https://logs.rdoproject.org/47/475747/98/openstack-experimental/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/Z895c70bb17fc445588dc456be0f8e3ca/undercloud/home/jenkins/failed_deployments.log.txt.gz | 06:14 |
| gcerami|Zz | jistr: mainly my goal is to understand if the job is using container images taken from rdo registry, with tag tripleo-ci-testing, and this is legit failure or not | 06:14 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-common master: Add hypen to the prefix/suffix of container name if not provided https://review.openstack.org/492385 | 06:17 |
| openstackgerrit | Itzik Brown proposed openstack/tripleo-heat-templates master: Adding a Missing configuration to support QoS in ODL Closes-Bug: 1708131 https://review.openstack.org/492027 | 06:18 |
| openstack | bug 1708131 in tripleo "AttributeError: 'NoneType' object has no attribute 'get_policies'" [High,In progress] https://launchpad.net/bugs/1708131 - Assigned to Itzik Brown (itzikb1) | 06:18 |
| skramaja | stevebaker: https://review.openstack.org/#/c/492385/ - ptal | 06:18 |
| *** shreshtha has joined #tripleo | 06:22 | |
| *** jaganathan has joined #tripleo | 06:27 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Create separate resource for HAProxy horizon endpoint https://review.openstack.org/491437 | 06:31 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for horizon https://review.openstack.org/489593 | 06:31 |
| *** agurenko has joined #tripleo | 06:35 | |
| *** hewbrocca_afk is now known as hewbrocca | 06:37 | |
| *** itlinux has joined #tripleo | 06:38 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [DNM] lvm testing of spanned vg https://review.openstack.org/491986 | 06:39 |
| *** anshul has joined #tripleo | 06:42 | |
| *** iranzo has joined #tripleo | 06:46 | |
| *** iranzo has joined #tripleo | 06:46 | |
| *** ykarel_ is now known as ykarel | 06:48 | |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates master: Mount NFS volume to docker container. https://review.openstack.org/490839 | 06:51 |
| *** itlinux has quit IRC | 06:54 | |
| *** ffiore has joined #tripleo | 06:54 | |
| *** ccamacho has joined #tripleo | 06:57 | |
| *** bogdando has joined #tripleo | 07:00 | |
| *** psahoo has quit IRC | 07:02 | |
| *** shardy has joined #tripleo | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 07:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 07:10 |
| *** psachin has quit IRC | 07:12 | |
| *** tesseract has joined #tripleo | 07:13 | |
| *** dmacpher has quit IRC | 07:13 | |
| *** psahoo has joined #tripleo | 07:16 | |
| *** pdeore has quit IRC | 07:18 | |
| *** ebarrera has joined #tripleo | 07:18 | |
| *** markmc has quit IRC | 07:21 | |
| *** amoralej|off is now known as amoralej | 07:23 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: Support deploying OVN as container services https://review.openstack.org/468860 | 07:24 |
| *** hewbrocca has quit IRC | 07:25 | |
| *** pdeore has joined #tripleo | 07:26 | |
| *** iranzo has quit IRC | 07:28 | |
| *** cylopez has joined #tripleo | 07:29 | |
| dpawar | amoralej: sorry to repeat this question again do i need to create branch stable/pike for https://github.com/vtas-hyperscale-ci/puppet-veritas_hyperscale before https://review.rdoproject.org/r/#/c/8155/ gets merged ? | 07:29 |
| *** ffiore has quit IRC | 07:30 | |
| *** oidgar has joined #tripleo | 07:31 | |
| dpawar | amoralej: asking this because, review still needs workflow. | 07:32 |
| amoralej | dpawar, no, we will create the branch | 07:33 |
| amoralej | but waiting to get others also, we usually branch puppet at the end | 07:33 |
| amoralej | dpawar, but what we'd need is to have a tag 1.0.0 in https://github.com/vtas-hyperscale-ci/puppet-veritas_hyperscale/ | 07:34 |
| amoralej | to match the version in metadata.json | 07:34 |
| dpawar | amoralej: do you mean master of https://github.com/vtas-hyperscale-ci/puppet-veritas_hyperscale/ should be tagged 1.0.0 ? | 07:36 |
| garyk | shardy: i think that i have found the issue (actaully the work around). for some reason the keystone service was not seen by haproxy. i set selinux as off and things are working. this at least helps me progress to where i can at least start to work. should i open a bug? | 07:38 |
| *** cshastri has quit IRC | 07:41 | |
| *** mdnadeem has quit IRC | 07:42 | |
| dpawar | amoralej: got it. you mean add tag to repository itself. | 07:44 |
| *** oidgar has quit IRC | 07:44 | |
| *** oidgar has joined #tripleo | 07:45 | |
| *** ffiore has joined #tripleo | 07:45 | |
| *** anshul has quit IRC | 07:47 | |
| *** jlinkes has joined #tripleo | 07:51 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive https://review.openstack.org/492178 | 07:52 |
| *** gfidente has joined #tripleo | 07:53 | |
| *** psahoo has quit IRC | 07:54 | |
| amoralej | dpawar, yes | 07:58 |
| *** anshul has joined #tripleo | 07:59 | |
| *** cshastri has joined #tripleo | 08:00 | |
| *** mdnadeem has joined #tripleo | 08:01 | |
| *** mdnadeem has quit IRC | 08:03 | |
| *** mdnadeem has joined #tripleo | 08:03 | |
| *** mcornea has joined #tripleo | 08:05 | |
| *** psahoo has joined #tripleo | 08:07 | |
| *** radez has quit IRC | 08:09 | |
| *** eck`gone has quit IRC | 08:09 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 08:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 08:10 |
| *** jpena|off has quit IRC | 08:12 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Revert "Run gnocchi upgrade with sacks in docker template" https://review.openstack.org/492315 | 08:16 |
| openstackgerrit | Merged openstack/instack-undercloud master: Remove nova cell leftover of undercloud upgrade from N->O. https://review.openstack.org/479213 | 08:17 |
| flaper87 | jistr: adding Docker didn't help much :/ http://logs.openstack.org/59/471759/58/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/6a42fa2/logs/undercloud/var/log/mistral/executor.log.txt.gz | 08:17 |
| *** chem has joined #tripleo | 08:19 | |
| *** dsariel has joined #tripleo | 08:20 | |
| flaper87 | jistr: I think I'll spend some time replicating the CI environment to test this locally | 08:21 |
| gfidente | is the Docker service actually starting the step | 08:24 |
| gfidente | before the workflow? | 08:24 |
| flaper87 | gfidente: what do you mean? | 08:25 |
| *** pdeore is now known as pdeore|lunch | 08:25 | |
| flaper87 | gfidente: it's a tht service | 08:25 |
| *** lucas-afk is now known as lucasagomes | 08:25 | |
| gfidente | flaper87 jistr the puppet manifest is starting docker at step1 | 08:25 |
| *** derekh has joined #tripleo | 08:25 | |
| gfidente | but if you have a workflow at step1 | 08:25 |
| openstackgerrit | Bogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive https://review.openstack.org/492178 | 08:25 |
| gfidente | that runs *before* puppet | 08:25 |
| gfidente | $hit? :D | 08:26 |
| flaper87 | ah, crap | 08:26 |
| flaper87 | mmh | 08:26 |
| gfidente | do we really need | 08:26 |
| gfidente | the workflow at step1? | 08:26 |
| flaper87 | that said, from the journal logs, it looks like docker is indeed running | 08:26 |
| flaper87 | no, we don't | 08:26 |
| flaper87 | I'll move it | 08:26 |
| gfidente | ack | 08:26 |
| gfidente | I think that'll do | 08:26 |
| flaper87 | lessseeeeeeee | 08:27 |
| gfidente | flaper87 we could change the order | 08:27 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 08:27 |
| gfidente | flaper87++ it'll do ! | 08:27 |
| gfidente | why not | 08:28 |
| *** psachin has joined #tripleo | 08:29 | |
| *** paramite has joined #tripleo | 08:31 | |
| *** jtomasek has joined #tripleo | 08:35 | |
| jaosorior | /exit/exit | 08:37 |
| *** jaosorior has quit IRC | 08:37 | |
| *** milan has joined #tripleo | 08:37 | |
| *** jtomasek has quit IRC | 08:39 | |
| *** jaosorior has joined #tripleo | 08:41 | |
| *** ykarel is now known as ykarel|lunch | 08:46 | |
| *** jtomasek has joined #tripleo | 08:47 | |
| rcernin | shardy: do you have any idea why the o-c-c stucks so often? | 08:48 |
| *** jaosorior has quit IRC | 08:54 | |
| *** ffiore_ has joined #tripleo | 08:56 | |
| *** ffiore has quit IRC | 08:56 | |
| *** limao_ has quit IRC | 08:56 | |
| *** pgadiya has quit IRC | 08:58 | |
| *** garyk1 has joined #tripleo | 09:01 | |
| *** snecklifter_ has joined #tripleo | 09:02 | |
| *** snecklifter has quit IRC | 09:03 | |
| *** snecklifter_ is now known as snecklifter | 09:03 | |
| *** snecklifter_ has joined #tripleo | 09:03 | |
| *** garyk has quit IRC | 09:04 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/492441 | 09:05 |
| *** ansmith has quit IRC | 09:08 | |
| shardy | garyk1: Hi, good to hear you found a solution - if it's an upstream TripleO build we don't support selinux enforcing because it's not tested in CI, but you could still raise a bug and/or post a patch | 09:09 |
| shardy | garyk1: if it's a downstream build please do raise a bz | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 09:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 09:10 |
| shardy | rcernin: most likely reason is networking or that swift/heat aren't running on the undercloud - I'd check network connectivity from overcloud to undercloud nodes initially | 09:10 |
| *** pgadiya has joined #tripleo | 09:12 | |
| *** salmankhan has joined #tripleo | 09:12 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: TEST: We may not need to default every network to None now that they are rendered https://review.openstack.org/492443 | 09:12 |
| jistr | gfidente, flaper87: +1 we could probably reverse the order of puppet vs. mistral | 09:12 |
| gfidente | jistr yeah if necessary we can do that too I think | 09:13 |
| jistr | heh so it was both the issues :) yday i dismissed the step1/step2 hypothesis when we said docker was running, but didn't get back to it when i realized that we were looking at UC instead of OC re docker status | 09:14 |
| flaper87 | right | 09:14 |
| * flaper87 shrugs | 09:14 | |
| *** ebarrera has quit IRC | 09:15 | |
| *** ebarrera has joined #tripleo | 09:15 | |
| *** iranzo has joined #tripleo | 09:16 | |
| *** iranzo has joined #tripleo | 09:16 | |
| jistr | gcerami|Zz: the failure is broken gnocchi-upgrade code | 09:16 |
| * jistr pulls out magnifying glass and looks closer | 09:17 | |
| shardy | With https://review.openstack.org/#/c/483293/ reversing the steps will mean the workflow runs after both puppet and the container/paunch stuff happens | 09:17 |
| shardy | I guess that's OK as we still have the steps to control ordering | 09:17 |
| shardy | but something to bear in mind | 09:17 |
| *** ramishra has quit IRC | 09:18 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat] https://review.openstack.org/491399 | 09:19 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh] https://review.openstack.org/491411 | 09:19 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi] https://review.openstack.org/491433 | 09:19 |
| *** ramishra has joined #tripleo | 09:20 | |
| *** ansmith has joined #tripleo | 09:22 | |
| jistr | gcerami|Zz: fyi https://bugs.launchpad.net/tripleo/+bug/1709630 | 09:24 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 09:24 |
| gfidente | jistr yeah that | 09:24 |
| *** psahoo has quit IRC | 09:29 | |
| garyk1 | shardy: its upstream. i saw that the permissive was set but that did not work. had to hack into instance and set it as off. i have yet to try downstream. | 09:30 |
| *** marios has quit IRC | 09:34 | |
| *** marios has joined #tripleo | 09:34 | |
| *** ykarel|lunch is now known as ykarel | 09:34 | |
| *** garyk1 has quit IRC | 09:35 | |
| openstackgerrit | Sanjay Upadhyay proposed openstack/tripleo-quickstart master: For stock centos/rhel images add repo and stack user https://review.openstack.org/492453 | 09:35 |
| *** garyk has joined #tripleo | 09:36 | |
| openstackgerrit | Sanjay Upadhyay proposed openstack/tripleo-quickstart master: For stock centos/rhel images add repo and stack user https://review.openstack.org/492453 | 09:37 |
| *** hewbrocca has joined #tripleo | 09:38 | |
| *** garyk has quit IRC | 09:38 | |
| shardy | garyk: ack, well please do raise a bug so we can keep track of it - it's strange though as IIRC all our CI tests use permissive | 09:39 |
| *** garyk has joined #tripleo | 09:39 | |
| shardy | garyk: ack, well please do raise a bug so we can keep track of it - it's strange though as IIRC all our CI tests use permissive | 09:39 |
| *** hewbrocca has quit IRC | 09:42 | |
| *** hewbrocca has joined #tripleo | 09:45 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Add --tag parameter to image prepare command https://review.openstack.org/492456 | 09:46 |
| jistr | folks can we merge this? https://review.openstack.org/#/c/491463 it should fix the upgrade job (and remove one of the periodic alerts here). I addressed stevebaker's review in a follow up patch. | 09:49 |
| *** garyk has quit IRC | 09:50 | |
| *** jaosorior has joined #tripleo | 09:54 | |
| *** hewbrocca has quit IRC | 09:58 | |
| *** pdeore|lunch is now known as pdeore | 09:59 | |
| *** iranzo has quit IRC | 10:00 | |
| *** eck`gone has joined #tripleo | 10:00 | |
| *** hewbrocca has joined #tripleo | 10:02 | |
| shardy | jistr: done | 10:03 |
| jistr | gfidente, shardy: thanks! | 10:03 |
| *** hewbrocca has quit IRC | 10:05 | |
| *** hewbrocca has joined #tripleo | 10:05 | |
| *** shardy has quit IRC | 10:08 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 10:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 10:10 |
| *** shardy has joined #tripleo | 10:11 | |
| *** hewbrocca has left #tripleo | 10:11 | |
| *** hewbrocca has joined #tripleo | 10:12 | |
| openstackgerrit | Merged openstack/tripleo-common master: Parameterize Ansible skip_tags https://review.openstack.org/491261 | 10:14 |
| *** cshastri has quit IRC | 10:14 | |
| *** mdnadeem has quit IRC | 10:16 | |
| *** katkapilatova has joined #tripleo | 10:17 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 10:18 |
| *** bkopilov has quit IRC | 10:19 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 10:20 |
| openstackgerrit | Sanjay Upadhyay proposed openstack/tripleo-quickstart master: For stock centos/rhel images add repo and stack user https://review.openstack.org/492453 | 10:21 |
| *** katkapilatova has quit IRC | 10:22 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 10:23 |
| *** mdnadeem has joined #tripleo | 10:30 | |
| *** cshastri has joined #tripleo | 10:32 | |
| *** dtantsur|afk is now known as dtantsur | 10:35 | |
| *** katkapilatova has joined #tripleo | 10:35 | |
| *** udesale has quit IRC | 10:36 | |
| dpawar | amoralej: say tag t1 points to commit c1 , now will the branching be done on the basis of tag t1 ? or branching will be done on the basis of commit c1 ? | 10:36 |
| *** cshastri has quit IRC | 10:37 | |
| amoralej | dpawar, you control that repo, so as you prefer :) | 10:37 |
| amoralej | i mean | 10:37 |
| amoralej | the package will be done for the tag | 10:38 |
| dpawar | amoralej: ok. that means if the tag t1 in future points to commit c6 then package will have code upto commit c6 right? | 10:39 |
| dpawar | :) | 10:39 |
| amoralej | dpawar, yes | 10:40 |
| amoralej | we get the tarball from the tag from github | 10:40 |
| amoralej | dpawar, if needed we can point to a specific commit | 10:40 |
| *** pdeore has quit IRC | 10:41 | |
| amoralej | but we prefer to use tags, if possible | 10:41 |
| *** ykarel_ has joined #tripleo | 10:41 | |
| *** ykarel__ has joined #tripleo | 10:42 | |
| *** ykarel_ has quit IRC | 10:43 | |
| *** ykarel has quit IRC | 10:43 | |
| *** bogdando has quit IRC | 10:45 | |
| *** yamahata has quit IRC | 10:48 | |
| *** cshastri has joined #tripleo | 10:49 | |
| gcerami|Zz | jistr: so it's a legit failure ? | 10:52 |
| *** gcerami|Zz is now known as gcerami | 10:52 | |
| dpawar | amoralej: that helps! thanks! | 10:52 |
| *** rwsu has quit IRC | 10:53 | |
| gcerami | jistr: and we are using containers build on the latest delorean hash ? | 10:53 |
| gfidente | flaper87 not sure if you're familiar with that code | 10:54 |
| gfidente | but is the playbook.yaml built by the ansible action | 10:54 |
| gfidente | supposed to create a simple text file | 10:55 |
| gfidente | with a list of playbooks ro tun? | 10:55 |
| *** ansmith has quit IRC | 10:55 | |
| gfidente | or should it be copying the contents? | 10:56 |
| *** akrivoka has joined #tripleo | 10:56 | |
| gfidente | d0ugal ^^ I think this is a problem where the path to the playbook is misinterpreted as a string to build the playbook from instead of copying its contensts | 10:57 |
| gfidente | playbook.yaml | 10:57 |
| *** ykarel__ is now known as ykarel | 10:58 | |
| *** hewbrocca_ has joined #tripleo | 10:58 | |
| *** jkilpatr has joined #tripleo | 10:59 | |
| *** bogdando has joined #tripleo | 11:00 | |
| *** hewbrocca has quit IRC | 11:01 | |
| *** psachin has quit IRC | 11:03 | |
| *** mdnadeem has quit IRC | 11:06 | |
| *** katkapilatova has quit IRC | 11:07 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable TLS for containeried haproxy https://review.openstack.org/489900 | 11:07 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 11:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 11:10 |
| *** mdnadeem has joined #tripleo | 11:12 | |
| jistr | gcerami: yes it's a legit failure. Currently we're using 9 days old containers. | 11:15 |
| jaosorior | jistr: how are the container images updated? is there an automated process or is that something manual? | 11:15 |
| *** bogdando has quit IRC | 11:16 | |
| gcerami | jistr: currently you mean in this job ? | 11:16 |
| jistr | jaosorior: you ping dprince or mandre and from there it's automagic :) (it's manual ATM) | 11:16 |
| jaosorior | jistr: ok. gotta ping dprince then. REALLY need new nova images :D | 11:17 |
| gcerami | jistr: because that job is supposed to test freshly baked container images | 11:17 |
| gcerami | jistr: with ginger and vanilla | 11:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Make containerized nova-api run with httpd https://review.openstack.org/475366 | 11:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable TLS for nova api and placement containers https://review.openstack.org/489885 | 11:17 |
| gcerami | jaosorior: time for manual container image creation is almost over .. | 11:18 |
| jistr | gcerami: whohoo :) | 11:18 |
| jaosorior | gcerami: yay! :ED | 11:18 |
| gcerami | jistr: wait! I want to be sure that's what is happening ? | 11:18 |
| jaosorior | :D | 11:18 |
| jistr | gcerami: hm test freshly baked images... what job is it? | 11:18 |
| *** mdnadeem has quit IRC | 11:19 | |
| gcerami | jistr: this builds cloud and container images https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-images-build/59/console | 11:19 |
| gfidente | gcerami are you saying you automated a daily ping to mandre_mtg and dprince? | 11:19 |
| gcerami | jistr: this tests them https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/ | 11:19 |
| jistr | gcerami: ah ok, so that one really builds fresh images it looks | 11:20 |
| gcerami | gfidente: damn, I told you to not tell anyone! | 11:20 |
| gcerami | jistr: yes, and the second job is supposed to use them | 11:20 |
| gcerami | jistr: I'm pretty sure it sused them, I instructed to download them from rdo registry with tag tripleo-ci-testing | 11:20 |
| gcerami | jistr: but I wanted someone else to confirm it | 11:21 |
| *** ykarel_ has joined #tripleo | 11:21 | |
| jistr | gcerami: do we only have console output, or do we have collected logs too? | 11:22 |
| *** ffiore_ has quit IRC | 11:23 | |
| *** snecklifter has quit IRC | 11:23 | |
| flaper87 | gfidente: the playbook created by the action is a regular playbook | 11:23 |
| gfidente | flaper87 yeah we found the issue I think | 11:24 |
| flaper87 | if you need to refer other playbooks, you can use the include explression | 11:24 |
| flaper87 | cool | 11:24 |
| gfidente | the check on the path failed because of permissions | 11:24 |
| gfidente | so it dumped the path to the playbook instead of the contents | 11:24 |
| jistr | gcerami: e.g. overcloud-prep-containers.sh and overcloud_prep_containers.log would be helpful in figuring out what images it used | 11:24 |
| *** pkovar has joined #tripleo | 11:24 | |
| gcerami | jistr: you just had to ask : https://logs.rdoproject.org/47/475747/98/openstack-experimental/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/Z895c70bb17fc445588dc456be0f8e3ca | 11:24 |
| gfidente | as if the path were the contents | 11:24 |
| *** ykarel has quit IRC | 11:25 | |
| gcerami | jistr: it's at the end of the console log if you need it in the future | 11:25 |
| flaper87 | gfidente: yeah, we can improve that in the action | 11:25 |
| gfidente | flaper87 maybe check if the string looks like a path | 11:25 |
| gfidente | not sure | 11:25 |
| jistr | gcerami: ah perfect, i didn't know that | 11:26 |
| flaper87 | gfidente: it does that already | 11:26 |
| flaper87 | gfidente: it checks if the file exists | 11:26 |
| flaper87 | gfidente: but if it fails because of permissions then it's doing what it did | 11:27 |
| gfidente | yeah but problem was, file did exist but wasn't readable | 11:27 |
| flaper87 | we can be even smarter about it and use stat | 11:27 |
| flaper87 | or something | 11:27 |
| flaper87 | gfidente: well, there's little you can do if you can't read the file | 11:27 |
| gfidente | I guess it would be nice if it could fail when recognizing a path but unable to read its contents | 11:27 |
| flaper87 | and the user we use to check this path is the same that is going to run the playbook | 11:27 |
| flaper87 | so that path *has* to be readable by mistral if you want to move forward | 11:28 |
| flaper87 | we can def improve this | 11:28 |
| jistr | gcerami: looks good i think https://logs.rdoproject.org/47/475747/98/openstack-experimental/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016/Z895c70bb17fc445588dc456be0f8e3ca/undercloud/home/jenkins/overcloud_prep_containers.log.txt.gz | 11:28 |
| gfidente | sure yeah | 11:28 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Remove duplicate Iscsid service in resource registry https://review.openstack.org/492480 | 11:30 |
| gcerami | jistr: thanks. Now excuse me while I'm going to dance the macarena off the streets under the heavy rain. | 11:31 |
| jistr | :D | 11:32 |
| *** hewbrocca__ has joined #tripleo | 11:34 | |
| *** sshnaidm|off has joined #tripleo | 11:34 | |
| *** rbrady has joined #tripleo | 11:35 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: Remove package if service stopped and disabled https://review.openstack.org/479886 | 11:37 |
| *** ebarrera has quit IRC | 11:37 | |
| *** hewbrocca_ has quit IRC | 11:37 | |
| *** ebarrera has joined #tripleo | 11:37 | |
| *** sshnaidm|off has quit IRC | 11:39 | |
| *** sshnaidm|off has joined #tripleo | 11:39 | |
| *** rhallisey has joined #tripleo | 11:42 | |
| *** lucasagomes is now known as lucas-hungry | 11:42 | |
| *** dougbtv has joined #tripleo | 11:43 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Corrected the task name in deploy-steps-playbook https://review.openstack.org/492486 | 11:47 |
| *** hewbrocca__ is now known as hewbrocca | 11:48 | |
| jaosorior | dciabrin: ping | 11:51 |
| *** rhallisey has quit IRC | 11:52 | |
| *** gkadam has quit IRC | 11:52 | |
| *** shreshtha has quit IRC | 11:57 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 11:57 |
| *** trozet has quit IRC | 11:58 | |
| *** masco has quit IRC | 11:59 | |
| *** abishop has joined #tripleo | 11:59 | |
| *** ykarel__ has joined #tripleo | 11:59 | |
| *** ykarel_ has quit IRC | 12:00 | |
| *** ykarel__ is now known as ykarel | 12:00 | |
| *** morazi has joined #tripleo | 12:01 | |
| jaosorior | jistr: hey dude. I need to bind mount a directory. However, It seems problematic since the uid doesn't match. Any recommendations? | 12:02 |
| openstackgerrit | Honza Pokorny proposed openstack/instack-undercloud master: Add an hourly cron trigger for tripleo-ui logging https://review.openstack.org/469608 | 12:02 |
| openstackgerrit | Michael Henkel proposed openstack/os-net-config master: This patch adds initial support for the Contrai vRouter interface https://review.openstack.org/492492 | 12:03 |
| jistr | jaosorior: hi, we have init containers taking care of setting correct UIDs for bind mounted dirs. /me looks for an example | 12:04 |
| *** rlandy has joined #tripleo | 12:04 | |
| *** jtomasek has quit IRC | 12:05 | |
| *** bfournie has joined #tripleo | 12:05 | |
| jistr | jaosorior: e.g. mariadb data https://github.com/openstack/tripleo-heat-templates/blob/e32150bd45d9957b459028812abd9ba7faaf43c7/docker/services/pacemaker/database/mysql.yaml#L108-L117 | 12:05 |
| dciabrin | jaosorior, oh hey I didn't see you ping | 12:06 |
| jaosorior | jistr: oh, that's nice! do I have to do a separate task for another directory then? | 12:06 |
| *** milan is now known as milan|fflgc | 12:06 | |
| *** sbrzozow has joined #tripleo | 12:07 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable TLS for containerized haproxy https://review.openstack.org/489900 | 12:08 |
| jaosorior | jistr: basically it would be the two directories I'm bind mounting in that commit ^^ | 12:08 |
| *** zshi_laptop has quit IRC | 12:08 | |
| *** dtrainor has quit IRC | 12:09 | |
| *** bfournie has quit IRC | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 12:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 12:10 |
| *** dtrainor has joined #tripleo | 12:10 | |
| *** jpena has joined #tripleo | 12:10 | |
| *** trozet has joined #tripleo | 12:10 | |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-heat-templates stable/ocata: Use conditional to set heat workers https://review.openstack.org/481232 | 12:12 |
| *** ykarel_ has joined #tripleo | 12:15 | |
| *** trown|outtypewww is now known as trown | 12:16 | |
| *** Goneri has joined #tripleo | 12:17 | |
| *** ykarel has quit IRC | 12:18 | |
| *** eck`gone is now known as eck` | 12:18 | |
| *** rwsu has joined #tripleo | 12:19 | |
| *** sshnaidm|off is now known as sshnaidm | 12:19 | |
| jistr | jaosorior: yea i think there should be a separate task to take care of this in haproxy.yaml. So another `detach: false` container there, and you might also order them all using start_order. | 12:20 |
| *** MVenesio has joined #tripleo | 12:20 | |
| *** cshastri has quit IRC | 12:22 | |
| *** rwsu has quit IRC | 12:23 | |
| *** shardy has quit IRC | 12:23 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable TLS for containerized haproxy https://review.openstack.org/489900 | 12:24 |
| jaosorior | jistr: what about this? ^^ | 12:24 |
| *** shardy has joined #tripleo | 12:25 | |
| *** pgadiya has quit IRC | 12:25 | |
| jistr | jaosorior: lgtm | 12:26 |
| jaosorior | ok, let me try it out | 12:27 |
| *** cshastri has joined #tripleo | 12:27 | |
| *** bogdando has joined #tripleo | 12:29 | |
| *** rbrady has quit IRC | 12:29 | |
| *** ffiore_ has joined #tripleo | 12:31 | |
| *** skramaja_ has joined #tripleo | 12:32 | |
| *** lucas-hungry is now known as lucasagomes | 12:32 | |
| *** skramaja has quit IRC | 12:32 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API https://review.openstack.org/481451 | 12:33 |
| *** ansmith has joined #tripleo | 12:34 | |
| *** pgadiya has joined #tripleo | 12:34 | |
| *** karthiks has quit IRC | 12:37 | |
| *** bfournie has joined #tripleo | 12:37 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:38 | |
| *** ratailor has quit IRC | 12:41 | |
| *** jlabarre has joined #tripleo | 12:41 | |
| *** gbarros has joined #tripleo | 12:42 | |
| *** catintheroof has joined #tripleo | 12:45 | |
| EmilienM | hi there | 12:47 |
| EmilienM | chem: please look comment on https://bugs.launchpad.net/tripleo/+bug/1708427 | 12:47 |
| openstack | Launchpad bug 1708427 in tripleo "pcs output changed and upgrade to newton is broken." [High,New] | 12:47 |
| EmilienM | mandre_mtg, dprince: https://review.openstack.org/#/c/492385/ | 12:48 |
| * mwhahaha throws things at networking-bagpipe | 12:51 | |
| mwhahaha | our queue is going to be hosed today | 12:51 |
| mwhahaha | at this point it's probably faster to fixup the packaging problems then try and exclude it from our building | 12:51 |
| EmilienM | mwhahaha: I'm about to be afk for a while but just FYI, if you need a patch to be #1 in the gate: take all patches running in gate - Abandon / Restore them would kill them from the gate pipeline | 12:52 |
| mwhahaha | EmilienM: i'm planning on that later today | 12:53 |
| mwhahaha | EmilienM: cause we can't merge anything | 12:53 |
| * mwhahaha cries | 12:53 | |
| EmilienM | mwhahaha: we need https://review.openstack.org/#/c/491878/ I guess? | 12:53 |
| mwhahaha | and 492339 | 12:53 |
| mwhahaha | which is the problem | 12:53 |
| EmilienM | mwhahaha: IMHO we should block everything from now | 12:53 |
| mwhahaha | they both keep failing for the different jobs | 12:53 |
| EmilienM | mwhahaha: both together? | 12:53 |
| mwhahaha | they both need to be infront of any networking-bagpipe changes | 12:54 |
| EmilienM | https://review.openstack.org/#/c/492339/ is in gate though | 12:54 |
| mwhahaha | i'm just going to take over https://review.rdoproject.org/r/#/c/5839/ | 12:54 |
| mwhahaha | EmilienM: but it's behind networking-bagpipe changes so the oooq jobs will fail | 12:54 |
| mwhahaha | because we don't have the other patch | 12:54 |
| *** markmc has joined #tripleo | 12:55 | |
| EmilienM | mwhahaha: feel free to "Abandon" all patches in the gate & "Restore" once they quit the gate | 12:55 |
| EmilienM | mwhahaha: so we have the 2 patch on very top | 12:55 |
| EmilienM | mwhahaha: if things are going bad, plan B might be to disable jobs or voting just the time to land these 2 things | 12:56 |
| mwhahaha | we can probably fixup the packaging faster | 12:57 |
| EmilienM | we need to stop pushing patches for today and fix this thing | 12:57 |
| mwhahaha | but we'll get it today | 12:57 |
| EmilienM | maybe communicate on that ^ today | 12:57 |
| mwhahaha | i'll send an email | 12:57 |
| *** mdnadeem has joined #tripleo | 12:57 | |
| *** EmilienM sets mode: +o mwhahaha | 12:57 | |
| EmilienM | mwhahaha: ^ if you wanna change topic as well | 12:57 |
| EmilienM | jaosorior, jistr, gfidente : FYI as well, you guys seem online ^ | 12:57 |
| *** jrist has joined #tripleo | 12:58 | |
| EmilienM | mwhahaha: what is the packaging issue? | 12:58 |
| EmilienM | jrist: good morning | 12:58 |
| mwhahaha | it's missing the new service | 12:58 |
| mwhahaha | https://review.rdoproject.org/r/#/c/5839/ | 12:58 |
| mwhahaha | is needed | 12:58 |
| *** jpena is now known as jpena|mtg | 12:59 | |
| EmilienM | mwhahaha: can't we pin? | 12:59 |
| mwhahaha | from months ago | 12:59 |
| mwhahaha | we dont' need it | 12:59 |
| mwhahaha | the problem isn't that we actually need the package | 12:59 |
| mwhahaha | the problem is the ZUUL_CHANGES | 12:59 |
| *** ecerquei has joined #tripleo | 12:59 | |
| EmilienM | ok | 12:59 |
| EmilienM | I need to leave keyboard, i'll be back soon | 12:59 |
| * EmilienM afk | 12:59 | |
| *** hewbrocca_afk has joined #tripleo | 12:59 | |
| *** hewbrocca has quit IRC | 13:00 | |
| honza | i'm looking for reviewers for tripleo-common, gui logging, urgent, FFE is in place https://review.openstack.org/#/c/469196/ | 13:00 |
| *** hewbrocca_afk is now known as hewbrocca | 13:00 | |
| *** pchavva has joined #tripleo | 13:01 | |
| *** jmelvin has joined #tripleo | 13:01 | |
| shardy | honza: I'll review but we probably can't land it yet as the gate is broken as discussed above | 13:01 |
| *** Goneri has quit IRC | 13:04 | |
| *** mwhahaha changes topic to "CI Status: RED - the gates hosed, we're working on it | "you can't land a Cessna with workarounds, so don't try in Quickstart" - TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC here." | 13:04 | |
| honza | shardy: thank you! | 13:04 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 13:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 13:10 |
| *** cdearborn has joined #tripleo | 13:11 | |
| *** bkopilov has joined #tripleo | 13:12 | |
| *** ansmith_ has joined #tripleo | 13:14 | |
| *** ramishra has quit IRC | 13:16 | |
| *** jcoufal has joined #tripleo | 13:17 | |
| *** ramishra has joined #tripleo | 13:18 | |
| *** rhallisey has joined #tripleo | 13:19 | |
| *** toure|gone is now known as toure | 13:22 | |
| *** dpawar has quit IRC | 13:22 | |
| *** gvrangan has quit IRC | 13:28 | |
| shardy | bandini: Hey I've been looking at https://review.openstack.org/#/c/474486/ and the stuff dsneddon landed which enables j2 rendering network templates for either ipv4 or ipv6 | 13:29 |
| shardy | bandini: I'm wondering if we can get rid of the special _v6.yaml templates and make the templates generic and handle either version | 13:30 |
| *** mdnadeem has quit IRC | 13:30 | |
| *** lblanchard has joined #tripleo | 13:30 | |
| shardy | I think dsneddon started looking at that, but just wanted to ensure it doesn't overlap with anything you'd looked into | 13:30 |
| *** amoralej is now known as amoralej|lunch | 13:31 | |
| *** skramaja_ has quit IRC | 13:31 | |
| *** lblanchard has quit IRC | 13:31 | |
| *** lblanchard has joined #tripleo | 13:31 | |
| shardy | e.g can we just look for either ":" in the {{network.name}}NetCidr to derive if it's v4/v6 | 13:34 |
| *** agopi|away has joined #tripleo | 13:36 | |
| *** shreshtha has joined #tripleo | 13:37 | |
| *** rwsu has joined #tripleo | 13:39 | |
| chandankumar | arxcruz: when ci will pass for this review https://review.openstack.org/#/c/491170/ | 13:41 |
| chandankumar | so many rechecks | 13:41 |
| shardy | chandankumar: see $topic ;) | 13:43 |
| *** milan|fflgc is now known as milan | 13:48 | |
| *** jaganathan has quit IRC | 13:48 | |
| *** rwsu has quit IRC | 13:52 | |
| *** hewbrocca has quit IRC | 13:53 | |
| *** hewbrocca_afk has joined #tripleo | 13:53 | |
| *** hewbrocca_afk is now known as hewbrocca | 13:53 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Disable existing repositories in tripleo-ci https://review.openstack.org/492289 | 13:53 |
| fultonj | jistr: fyi, i seem to be hitting https://bugs.launchpad.net/tripleo/+bug/1709689 consistently | 13:54 |
| openstack | Launchpad bug 1709689 in tripleo "kolla rabbitmq container setup should not try to delete /etc/hosts" [Medium,Triaged] - Assigned to Jiří Stránský (jistr) | 13:54 |
| *** atoth has joined #tripleo | 13:55 | |
| *** rwsu has joined #tripleo | 13:55 | |
| *** oidgar has quit IRC | 13:55 | |
| jistr | fultonj: i haven't managed to reproduce it yet. I'm finishing up patch for multiple insecure registries, will test deployment with it and see if i hit the issue | 13:56 |
| fultonj | jistr: ok, if you want to use my machine, then just let me know. thanks | 13:57 |
| jistr | fultonj: for context, what all environment files do you pass to the deploy command? | 13:57 |
| fultonj | jistr: i am updated the bug w/ that info | 14:01 |
| jistr | thanks | 14:01 |
| flaper87 | jistr: passed the ssh and docker issue | 14:02 |
| jistr | flaper87: whohoo \o/ | 14:02 |
| flaper87 | now we have another problem. The version of jinja2 we're using in the gate is old | 14:02 |
| flaper87 | T_T | 14:02 |
| flaper87 | we need >=2.8 | 14:02 |
| jistr | oohowh /o\ | 14:03 |
| flaper87 | will try to figure out after this call | 14:03 |
| fultonj | glad you got past that flaper87 | 14:03 |
| flaper87 | fultonj: YEAH!!! *parties hard* | 14:03 |
| *** ffiore has joined #tripleo | 14:04 | |
| *** mrch has joined #tripleo | 14:04 | |
| *** ffiore_ has quit IRC | 14:04 | |
| *** Goneri has joined #tripleo | 14:04 | |
| *** rwsu has quit IRC | 14:07 | |
| *** garyk has joined #tripleo | 14:09 | |
| *** rlandy has quit IRC | 14:09 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 14:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 14:10 |
| gfidente | flaper87 see | 14:10 |
| *** ramishra has quit IRC | 14:11 | |
| gfidente | it did it | 14:11 |
| flaper87 | gfidente++ | 14:11 |
| flaper87 | you deserve karma | 14:11 |
| gfidente | it's the mindset | 14:11 |
| flaper87 | thanks a bunch | 14:11 |
| gfidente | not the actual thing the fix | 14:11 |
| *** ramishra has joined #tripleo | 14:12 | |
| *** jpena|mtg is now known as jpena|off | 14:14 | |
| *** jkilpatr has quit IRC | 14:20 | |
| *** jkilpatr has joined #tripleo | 14:20 | |
| *** amoralej|lunch is now known as amoralej | 14:24 | |
| *** radez has joined #tripleo | 14:25 | |
| trown | weshay: sshnaidm|afk gcerami EmilienM : we are having CI squad meeting in 5 minutes? | 14:26 |
| trown | 3ish really | 14:27 |
| gcerami | trown: I'm available | 14:28 |
| weshay | trown, yes.. we need to given the state of upstream | 14:28 |
| weshay | gcerami, what happened in that latest build? | 14:28 |
| gcerami | weshay: registry problem, push failed | 14:28 |
| weshay | k.. thought so | 14:29 |
| weshay | and DANNNNNG IT | 14:29 |
| *** ffiore has quit IRC | 14:34 | |
| gcerami | trown: your video is black | 14:37 |
| *** ffiore has joined #tripleo | 14:40 | |
| trown | gcerami: ya my usb on my laptop just died completely... just opened it up for now :P | 14:40 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Convert network templates to be rendered via j2 https://review.openstack.org/492218 | 14:40 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Remove ipv6 specific network templates https://review.openstack.org/492550 | 14:40 |
| jistr | fultonj: does /var/lib/config-data/puppet-generated/rabbitmq/etc/hosts exist on the overcloud node that hit this problem? | 14:41 |
| * fultonj checks | 14:42 | |
| *** snecklifter_ has quit IRC | 14:42 | |
| fultonj | No such file or directory | 14:42 |
| *** snecklifter has joined #tripleo | 14:42 | |
| fultonj | jistr: ls: cannot access /var/lib/config-data: No such file or directory | 14:43 |
| fultonj | wtf | 14:43 |
| jistr | fultonj: running that as root? on overcloud? | 14:44 |
| fultonj | root on undercloud | 14:44 |
| jistr | fultonj: ack we need to check it on overcloud controller (the one where rabbit failed) | 14:45 |
| *** akrivoka has quit IRC | 14:45 | |
| *** yamahata has joined #tripleo | 14:46 | |
| fultonj | jistr: it exists on controller ; 57 lines | 14:46 |
| fultonj | jistr: http://paste.openstack.org/show/618058 | 14:47 |
| jistr | fultonj: does it differ from the actual /etc/hosts on the same machine? | 14:48 |
| fultonj | Files /var/lib/config-data/puppet-generated/rabbitmq/etc/hosts and /etc/hosts are identical | 14:49 |
| fultonj | as per diff -s | 14:49 |
| jistr | hm... i wonder how it's possible that it got under puppet-generated | 14:50 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Add deploy_composable_scenario variable into featureset011 https://review.openstack.org/492559 | 14:51 |
| jistr | fultonj: any unmerged patches in your deploy? | 14:51 |
| fultonj | Files rabbitmq/etc/hosts and puppet-generated/rabbitmq/etc/hosts are identical | 14:51 |
| fultonj | yes, in tht | 14:52 |
| fultonj | https://review.openstack.org/#/c/492082 | 14:52 |
| fultonj | i got this before that patch though | 14:52 |
| *** cshastri has quit IRC | 14:52 | |
| *** oidgar has joined #tripleo | 14:53 | |
| jistr | fultonj: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-puppet.py#L230-L232 | 14:53 |
| jistr | it must have been caught by `-newer /tmp/the_origin_of_time` | 14:53 |
| jistr | but i don't have any idea why ATM | 14:53 |
| fultonj | i bet i can reproduce with one controller + one compute and /usr/share/openstack-tripleo-heat-templates | 14:55 |
| oidgar | hi guys | 14:57 |
| oidgar | I've installed new undercloud and when I deploy overcloud I get the following: | 14:57 |
| oidgar | Error rendering template network/network.network.yaml : 'network' is undefined | 14:57 |
| oidgar | Exception updating plan: Error rendering template network/network.network.yaml : 'network' is undefined | 14:57 |
| jistr | fultonj: is there any mention of `/etc/hosts` in `journalctl` on that machine? Particularly in something that looks like puppet logs. | 14:57 |
| oidgar | this is a brand new server. did some of you encountered this issue? | 14:58 |
| jistr | oidgar: i think bogdando hit it a while ago. I think the reason was outdated tripleo-common IIRC. You may need to get the latest one and restart all mistral services. | 14:59 |
| *** akrivoka has joined #tripleo | 14:59 | |
| bogdando | jistr, oidgar: yes, but I didn't manage to fix that | 14:59 |
| oidgar | bogdando, so how do you test tripleo? | 14:59 |
| bogdando | oidgar: I'm deploying it mostly UC containers only | 15:00 |
| oidgar | UC? | 15:00 |
| bogdando | oidgar: undercloud with containers | 15:00 |
| bogdando | there is an experimental CLI undercloud deploy command | 15:00 |
| bogdando | and the quickstart role for it | 15:00 |
| oidgar | oh I understand | 15:01 |
| bogdando | for overcloud, I've been struggling to deploy it pre-provisioned (deployed server), hosted on openstack VMs. Didn't make it yet. | 15:01 |
| bogdando | but that's ok, I'm relatively new to tripleo :) | 15:02 |
| *** ecerquei has quit IRC | 15:02 | |
| gregwork | has anyone tried deploying ceph on tripleo with bluestore ? | 15:02 |
| oidgar | bogdando, let me know if you found some solution. I'll try to find some fix meanwhile | 15:02 |
| *** morazi has quit IRC | 15:04 | |
| chem | mwhahaha: argh I just recheck a review, should I adandon the stuff ? | 15:04 |
| *** ebarrera has quit IRC | 15:06 | |
| mwhahaha | chem: no it's ok | 15:06 |
| *** derekh has quit IRC | 15:06 | |
| chem | mwhahaha: oki, so I can restore as well ? | 15:08 |
| mwhahaha | chem: i'll be restoring shortly | 15:08 |
| chem | mwhahaha: ack | 15:08 |
| mwhahaha | if you abandoned anything, please restore | 15:08 |
| mwhahaha | i'll be restoring what i abandoned in a bit | 15:08 |
| chem | mwhahaha: thanks | 15:08 |
| jistr | oidgar: do you have this in your env? https://github.com/openstack/tripleo-common/commit/e48a73cb4ef2d40cfdd322e7cc19f615aa4ad1c7 | 15:10 |
| jistr | oidgar: under /usr/lib/python2.7/site-packages/tripleo_common/ | 15:10 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 15:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 15:10 |
| *** sdoran has joined #tripleo | 15:10 | |
| oidgar | jistr, checking | 15:11 |
| *** pgadiya has quit IRC | 15:11 | |
| *** sdoran has quit IRC | 15:12 | |
| *** samdoran is now known as sdoran | 15:12 | |
| *** bogdando has quit IRC | 15:12 | |
| oidgar | jistr, I don't think so. I'm updating manually tripleo-common because I have new actions, workflows and playbooks | 15:12 |
| *** dparkes has joined #tripleo | 15:12 | |
| oidgar | jistr, yesterday I pulled the latest version from github | 15:13 |
| oidgar | jistr, but now I see that after pulling master, I have this commit | 15:14 |
| jistr | oidgar: so you use tripleo-common from a source checkout? | 15:14 |
| fultonj | jistr: journalctl didn't return any puppet output /etc/hosts but i can run docker-puppet.py w/ debug as that has shown me puppet errors before | 15:14 |
| *** dalvarez has joined #tripleo | 15:14 | |
| dalvarez | hi all, i'm trying to deploy the overcloud and it fails with: http://paste.openstack.org/show/618062/ how can I debug further? | 15:15 |
| jistr | fultonj: ack that could help us see if puppet touched /etc/hosts and perhaps where that came from | 15:15 |
| oidgar | jistr, yes | 15:16 |
| *** ramishra has quit IRC | 15:16 | |
| chem | marios: sorry to disturbe could we just push https://review.openstack.org/#/c/487313/ in the pool ? | 15:16 |
| jistr | oidgar: ok so i'd try doing this to refresh it, that might help https://github.com/openstack/tripleo-common#action-development | 15:17 |
| oidgar | jistr, that what I did exactly :) | 15:17 |
| oidgar | jistr, in order to load my new action | 15:18 |
| oidgar | jistr, I'll try it again now with the commit you've mentioned included | 15:18 |
| marios | chem: looking | 15:18 |
| *** dougbtv has quit IRC | 15:18 | |
| *** itlinux has joined #tripleo | 15:18 | |
| *** janki has quit IRC | 15:19 | |
| *** dougbtv has joined #tripleo | 15:20 | |
| marios | chem: sure, revoted if that's what you meant? | 15:20 |
| marios | chem: there was email from mwhahaha about holding on merges for a while | 15:21 |
| *** rlandy has joined #tripleo | 15:22 | |
| chem | marios: yeah, it seems it has passed | 15:22 |
| mwhahaha | yea hold off +A anything for a bit | 15:22 |
| marios | chem: ack yeah is from july 27 though , ok so lets hold... mwhahaha we are talking about https://review.openstack.org/#/c/487313/2 | 15:22 |
| *** yprokule has quit IRC | 15:22 | |
| jistr | dalvarez: looks like failure from os-net-config. There should be some more info on overcloud nodes if you run `sudo journalctl -u os-collect-config` and look for os-net-config there. Most likely there's an issue with the networking templates you used (maybe not matching the HW environment). | 15:23 |
| dalvarez | jistr, thanks for taking a look: ago 10 14:26:04 overcloud-controller-1 os-collect-config[1188]: /var/lib/heat-config/heat-config-script/607f57cd-ab4d-4ff7-9822-cb303340436f: line 102: os-net-config: command not found | 15:25 |
| dalvarez | jistr, looks like so! | 15:25 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Enable TLS configuration for containerized RabbitMQ https://review.openstack.org/491600 | 15:26 |
| jistr | ouch :D | 15:27 |
| *** sdake_ is now known as sdake | 15:27 | |
| jistr | dalvarez: never seen that before.. are you deploying on preexisting servers, or from scratch with Nova+Ironic? | 15:28 |
| *** nyechiel has joined #tripleo | 15:28 | |
| pabelanger | mwhahaha: EmilienM: bnemec: fixing buildlogs.cdn.centos.org redirects seems to be helping. We still need to land the DLRN patches still, going to be working on that | 15:29 |
| mwhahaha | pabelanger: yea i'm trying to get those patches merged, of course we ended up with two bagpipe changes in the gate today | 15:29 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows https://review.openstack.org/487450 | 15:30 |
| pabelanger | mwhahaha: I could force merge them, but trying to avoid that. Going to talk with infra this morning and see the risk | 15:30 |
| dalvarez | jistr, from scratch but the oc image i built it myself so that might be it... os-net-config not present? :S | 15:34 |
| *** nyechiel has quit IRC | 15:34 | |
| jistr | dalvarez: yea that's probably the cause | 15:35 |
| dalvarez | jistr, looks like, thanks a lot! will try to install it now | 15:35 |
| jistr | dalvarez: there might be more missing though... I'm not expert on how we build images in particular, but there are basic docs at http://tripleo.org/install/post_deployment/build_single_image.html and the definitions come from https://github.com/openstack/tripleo-common/tree/master/image-yaml | 15:37 |
| dalvarez | jistr, appreciated i'll take a look | 15:38 |
| amoralej | EmilienM, is there any plan to add multinode scenarios to periodic pipeline for pike? | 15:39 |
| *** Kildurin has joined #tripleo | 15:40 | |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo master: Do not include manila ceph key resource twice https://review.openstack.org/492589 | 15:41 |
| Kildurin | Has anyone seen issues with adding hosts beyond 25 nodes? Even adding 5 at time we hit failures above 25 and it is taking 5 or more hours to fail. | 15:42 |
| *** ecerquei has joined #tripleo | 15:43 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-heat-templates master: Let mds create manila key and fs https://review.openstack.org/482496 | 15:43 |
| *** agopi|away has quit IRC | 15:44 | |
| oidgar | jistr, it worked! | 15:44 |
| oidgar | jistr, thanks a lot :) | 15:44 |
| jistr | oidgar: great! np :) | 15:44 |
| trown | just noticed the topic | 15:44 |
| trown | I bet you could land a Cessna with workarounds | 15:45 |
| *** gbarros has quit IRC | 15:45 | |
| jistr | +1 that's the spirit | 15:45 |
| slagle | who needs an engine | 15:46 |
| slagle | it's got wings doesn't it? | 15:46 |
| trown | I mean if you needed to | 15:46 |
| openstackgerrit | Jan Provaznik proposed openstack/puppet-tripleo master: Do not create fs and server side key from manila https://review.openstack.org/482501 | 15:47 |
| *** morazi has joined #tripleo | 15:48 | |
| *** jpena|off is now known as jpena | 15:50 | |
| fultonj | jistr: the follow up run of docker-puppet.py produced no errors http://paste.openstack.org/show/618068 | 15:53 |
| fultonj | if i could pass a param that makes it run in debug during first deploy (when it seems to fail) that would be cool | 15:54 |
| *** agurenko has quit IRC | 16:00 | |
| jistr | fultonj: this one https://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-steps.j2#L41 | 16:03 |
| fultonj | jistr: thank you | 16:03 |
| *** fandrieu_ has joined #tripleo | 16:03 | |
| jistr | fultonj: btw i wondered if it could be a race between running docker-puppet.py and writing hosts entries, but it seems that it's ordered correctly in the templates. HostsDeployment -> {{role.name}}AllNodesDeployment -> AllNodesDeploySteps | 16:04 |
| *** fandrieu has quit IRC | 16:05 | |
| fultonj | jistr: i see | 16:05 |
| *** fandrieu_ is now known as fandrieu | 16:08 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 16:10 |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 16:10 |
| *** gvrangan has joined #tripleo | 16:11 | |
| *** jfrancoa has quit IRC | 16:18 | |
| *** fandrieu has quit IRC | 16:18 | |
| *** fandrieu has joined #tripleo | 16:19 | |
| openstackgerrit | Jiri Stransky proposed openstack/puppet-tripleo master: Allow configuring multiple insecure registries https://review.openstack.org/492612 | 16:19 |
| *** anshul has quit IRC | 16:20 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Set all nodes resource class to "baremetal" on undercloud install https://review.openstack.org/490851 | 16:20 |
| mwhahaha | pabelanger: https://review.openstack.org/#/c/492339/ failed in gate on ord rax mirrors issues :/ | 16:20 |
| gcerami | jistr: do you know if we have and who has credentials to access dockerhub for container images ? | 16:21 |
| pabelanger | mwhahaha: ya, and I know why | 16:22 |
| pabelanger | mwhahaha: htcacheclean had multiple processes and was affecting IO | 16:22 |
| *** ccamacho has quit IRC | 16:22 | |
| pabelanger | mwhahaha: so, checking all mirrors now and going to requeue that change | 16:22 |
| mwhahaha | pabelanger: thanks | 16:23 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Accept multiple registries in DockerInsecureRegistryAddress https://review.openstack.org/492613 | 16:23 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Neutron SR-IOV agent container https://review.openstack.org/469066 | 16:23 |
| jistr | gcerami: several folks have access, including me. The image building has been traditionally done by dprince and mandre_mtg though. | 16:24 |
| *** nyechiel has joined #tripleo | 16:25 | |
| jistr | gcerami: what's the issue? | 16:25 |
| *** pcaruana has quit IRC | 16:25 | |
| *** marios has quit IRC | 16:26 | |
| pabelanger | mwhahaha: networking-bagpipe patches in gate got rebased, and were removed. That should help land our 2 DLRN fixes | 16:26 |
| mwhahaha | hopefully | 16:26 |
| *** itlinux has quit IRC | 16:27 | |
| *** psachin has joined #tripleo | 16:27 | |
| jistr | gcerami: in case of need i could build them too but i'm in mild disagreement with the way we do it, so i try to avoid doing it :) e.g. i'd prefer we had a :previous-latest tag, so that if we discover that the newly pushed :latest tag broke the world, we can revert to the :previous-latest. Of course this wouldn't be necessary when we switch to images verified by CI. | 16:28 |
| jistr | (provided that the CI coverage is good enough) | 16:28 |
| *** ffiore has quit IRC | 16:30 | |
| *** chem has quit IRC | 16:31 | |
| *** chem has joined #tripleo | 16:31 | |
| *** lucasagomes is now known as lucas-afk | 16:32 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 16:33 |
| *** rcernin has quit IRC | 16:33 | |
| *** snecklifter has quit IRC | 16:38 | |
| *** ykarel_ has quit IRC | 16:41 | |
| *** nyechiel has quit IRC | 16:42 | |
| *** leitan has joined #tripleo | 16:42 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 16:46 |
| *** jlabarre has quit IRC | 16:49 | |
| *** jlabarre has joined #tripleo | 16:49 | |
| pabelanger | mwhahaha: did you have a patch up to disable centos-openstack-ocata RPM? | 16:50 |
| *** agopi|away has joined #tripleo | 16:50 | |
| mwhahaha | pabelanger: yea | 16:51 |
| mwhahaha | We already so it for jobs that use tripleo.sh | 16:52 |
| mwhahaha | So it's just the oooq jobs that needed it | 16:52 |
| pabelanger | Yup | 16:52 |
| pabelanger | http://logs.openstack.org/49/492049/1/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/b4d544d/console.html | 16:52 |
| pabelanger | just hit it I think | 16:52 |
| mwhahaha | https://review.openstack.org/#/c/492289/ | 16:53 |
| mwhahaha | Brb | 16:53 |
| pabelanger | Cool, lets see about landing that today too | 16:53 |
| *** jlabarre has quit IRC | 16:56 | |
| *** yamahata has quit IRC | 16:57 | |
| *** hewbrocca is now known as hewbrocca_afk | 16:58 | |
| *** jlabarre has joined #tripleo | 16:58 | |
| *** ecerquei_ has joined #tripleo | 16:59 | |
| *** ecerquei has quit IRC | 16:59 | |
| *** dtantsur is now known as dtantsur|afk | 17:00 | |
| *** pkovar has quit IRC | 17:00 | |
| *** dpawar has joined #tripleo | 17:00 | |
| *** dpawar has quit IRC | 17:02 | |
| *** masco has joined #tripleo | 17:05 | |
| *** fandrieu has quit IRC | 17:07 | |
| *** salmankhan has quit IRC | 17:07 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 17:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 17:10 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 17:10 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 17:13 |
| *** jprovazn has quit IRC | 17:15 | |
| *** jprovazn has joined #tripleo | 17:16 | |
| *** jmelvin has quit IRC | 17:16 | |
| *** itlinux has joined #tripleo | 17:17 | |
| *** dpawar has joined #tripleo | 17:20 | |
| *** pkovar has joined #tripleo | 17:21 | |
| *** nyechiel has joined #tripleo | 17:22 | |
| *** ansmith has quit IRC | 17:23 | |
| *** ansmith_ has quit IRC | 17:23 | |
| *** jpena is now known as jpena|mtg | 17:30 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/492627 | 17:30 |
| *** nyechiel has quit IRC | 17:31 | |
| *** yamahata has joined #tripleo | 17:31 | |
| *** jlabarre has quit IRC | 17:37 | |
| *** jlabarre has joined #tripleo | 17:38 | |
| *** shardy has quit IRC | 17:38 | |
| *** ansmith has joined #tripleo | 17:39 | |
| *** ansmith_ has joined #tripleo | 17:39 | |
| *** amoralej is now known as amoralej|off | 17:41 | |
| *** agopi|away has quit IRC | 17:45 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Fix Heat condition for RHEL registration yum update https://review.openstack.org/492632 | 17:46 |
| *** gfidente is now known as gfidente|afk | 17:47 | |
| * mwhahaha wishes these mistral changes would get out of the gate already | 17:47 | |
| *** ebarrera has joined #tripleo | 17:53 | |
| *** sbrzozow has quit IRC | 17:53 | |
| *** pkovar has quit IRC | 17:55 | |
| *** garyk has quit IRC | 17:56 | |
| *** jlabarre has quit IRC | 18:00 | |
| *** jlabarre has joined #tripleo | 18:00 | |
| *** trown is now known as trown|lunch | 18:01 | |
| *** agopi|away has joined #tripleo | 18:02 | |
| *** masco has quit IRC | 18:05 | |
| sshnaidm|afk | mwhahaha, do you need +W on https://review.openstack.org/#/c/492289/ ? | 18:09 |
| mwhahaha | sshnaidm|afk: yes plz | 18:09 |
| sshnaidm|afk | done | 18:09 |
| mwhahaha | thanks | 18:09 |
| *** dpawar has quit IRC | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 18:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 18:10 |
| *** apetrich has quit IRC | 18:10 | |
| *** apetrich has joined #tripleo | 18:13 | |
| d0ugal | mwhahaha: which mistral changes? | 18:16 |
| mwhahaha | The ones stuck in the gate that keep getting reset | 18:16 |
| mwhahaha | They should merge in the next few hours hopefully | 18:16 |
| *** sbrzozow has joined #tripleo | 18:17 | |
| d0ugal | ah | 18:18 |
| mwhahaha | They aren't the problem, just a side effect of this gate sruff | 18:19 |
| *** jmelvin has joined #tripleo | 18:21 | |
| *** atheurer has joined #tripleo | 18:22 | |
| *** liverpooler has joined #tripleo | 18:23 | |
| *** liverpooler has quit IRC | 18:29 | |
| *** ansmith has quit IRC | 18:30 | |
| *** ansmith_ has quit IRC | 18:31 | |
| *** rcernin has joined #tripleo | 18:36 | |
| *** milan has quit IRC | 18:37 | |
| *** vkhanna has joined #tripleo | 18:40 | |
| *** gbarros has joined #tripleo | 18:41 | |
| *** vkhanna has quit IRC | 18:42 | |
| *** vkhanna has joined #tripleo | 18:43 | |
| *** ansmith has joined #tripleo | 18:43 | |
| *** ansmith_ has joined #tripleo | 18:43 | |
| *** vkhanna has quit IRC | 18:46 | |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: Enable TLS configuration for containerized Galera https://review.openstack.org/489963 | 18:48 |
| *** psachin has quit IRC | 18:52 | |
| *** jlinkes has quit IRC | 18:53 | |
| *** dparkes has quit IRC | 18:56 | |
| *** rcernin has quit IRC | 18:59 | |
| *** vkhanna has joined #tripleo | 18:59 | |
| openstackgerrit | Victoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share for HA https://review.openstack.org/482680 | 19:00 |
| *** vkhanna has quit IRC | 19:00 | |
| * mwhahaha sighs | 19:02 | |
| *** portdirect is now known as eteppete | 19:02 | |
| *** openstackgerrit has quit IRC | 19:03 | |
| *** eteppete is now known as portdirect | 19:03 | |
| *** jlabarre has quit IRC | 19:07 | |
| *** jlabarre has joined #tripleo | 19:10 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 19:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 19:10 |
| *** trown|lunch is now known as trown | 19:10 | |
| mwhahaha | so did we ever figure out why the containers job occasionally fails with: Error: /Stage[main]/Tripleo::Profile::Base::Tuned/Exec[tuned-adm]: Could not evaluate: Could not find command 'tuned-adm' | 19:12 |
| pabelanger | I was just about to ask that | 19:12 |
| mwhahaha | is it a bad caching of containers somewhere maybe? | 19:13 |
| mwhahaha | cause the check gate passed just fine | 19:13 |
| mwhahaha | which makes this all the more rage inducing | 19:13 |
| pabelanger | Not sure related, but it isn't using our docker register | 19:14 |
| pabelanger | http://logs.openstack.org/22/491522/3/gate/gate-tripleo-ci-centos-7-undercloud-containers/fb67f2c/logs/etc/docker/daemon.json.txt.gz | 19:14 |
| pabelanger | and I'm not sure how the containers job works, but need to figure out where tuned-adm lives | 19:14 |
| * mwhahaha is this close || to disabling all the jobs | 19:15 | |
| mwhahaha | i know what patch that was, we could revert it | 19:15 |
| mwhahaha | https://review.openstack.org/#/c/454123/ | 19:15 |
| mwhahaha | it was merged weeks ago | 19:16 |
| mwhahaha | so something else is going on | 19:16 |
| pabelanger | http://logs.openstack.org/22/491522/3/gate/gate-tripleo-ci-centos-7-undercloud-containers/fb67f2c/logs/etc/yum.repos.d/delorean-deps.repo.txt.gz | 19:16 |
| pabelanger | it is also hitting buildlogs directly | 19:16 |
| *** salmankhan has joined #tripleo | 19:16 | |
| mwhahaha | yea but it's failing in the docker iamge configuration bits | 19:16 |
| *** athomas has joined #tripleo | 19:16 | |
| mwhahaha | so the docker image doesn't have tuned-adm installed | 19:16 |
| pabelanger | that is possible | 19:16 |
| pabelanger | let me check logstash | 19:17 |
| *** portdirect has quit IRC | 19:17 | |
| *** portdirect has joined #tripleo | 19:17 | |
| pabelanger | ya, don't see it in logstash. likely not getting indexes for that job | 19:20 |
| pabelanger | it needs to create: logs/undercloud/var/log/extra/logstash.txt | 19:20 |
| pabelanger | and we'll pick it up | 19:20 |
| pabelanger | mwhahaha: is there somebody specific supporting that job? | 19:21 |
| mwhahaha | not that i'm aware of | 19:21 |
| *** gbarros has quit IRC | 19:23 | |
| pabelanger | mwhahaha: ya, might be worth a revert of 454123 until it is figured out how tuned is managed. I don't believe you use puppet to install packages any more for containers | 19:24 |
| mwhahaha | we never were | 19:25 |
| mwhahaha | well not completely true | 19:25 |
| mwhahaha | we only half were and only in ci | 19:25 |
| pabelanger | we should have 2 merges in the next 2 mins | 19:26 |
| * mwhahaha crosses fingers | 19:26 | |
| mwhahaha | i guess we could pull the tuned stuff from the undercloud | 19:27 |
| mwhahaha | that might be the fix for it | 19:27 |
| pabelanger | I'd +1 that | 19:29 |
| mwhahaha | let me dig further | 19:29 |
| mwhahaha | the problem is that we've moved where packages used to be installed (tripleo-puppet-elements) to somewhere else for containers | 19:29 |
| mwhahaha | and i'm not 100% sure where that somewhere else is at the moment :D | 19:30 |
| mwhahaha | not sure the point of running tuned in a container tho | 19:32 |
| mwhahaha | so let me start by pulling it from the overcloud role | 19:32 |
| mwhahaha | er undercloud | 19:32 |
| mwhahaha | oh wait that's not the cause | 19:34 |
| mwhahaha | that's just ignored | 19:34 |
| mwhahaha | (also wtf) | 19:35 |
| mwhahaha | it failed because keystone wasn't running | 19:35 |
| mwhahaha | http://logs.openstack.org/22/491522/3/gate/gate-tripleo-ci-centos-7-undercloud-containers/fb67f2c/logs/var/log/undercloud_install.txt.gz#_2017-08-10_18_53_59_000 | 19:35 |
| *** openstackgerrit has joined #tripleo | 19:35 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add required variables for pike in validate-tempest https://review.openstack.org/492016 | 19:35 |
| mwhahaha | but of course there are no useful logs so who knows why | 19:37 |
| pabelanger | Ya, I've noticed that too. Almost no logs on the container jobs | 19:37 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Create parameters for haproxy TLS certs and keys https://review.openstack.org/491390 | 19:37 |
| pabelanger | 2 merges, cool | 19:38 |
| mwhahaha | like watching grass grow | 19:38 |
| pabelanger | should be another too | 19:38 |
| *** lblanchard has quit IRC | 19:38 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix cidr get_attr in custom networks https://review.openstack.org/491886 | 19:41 |
| pabelanger | that's 3 | 19:42 |
| pabelanger | so, yum downloads appear more stable | 19:43 |
| mwhahaha | now it's time to cheer on mistral | 19:43 |
| mwhahaha | you can dooo eeeet | 19:43 |
| pabelanger | next 90mins will be the test | 19:44 |
| *** ecerquei__ has joined #tripleo | 19:47 | |
| *** ecerquei_ has quit IRC | 19:47 | |
| *** jrist has quit IRC | 19:48 | |
| *** rlandy has quit IRC | 19:48 | |
| *** apetrich has quit IRC | 19:54 | |
| *** apetrich has joined #tripleo | 19:55 | |
| *** pchavva has quit IRC | 19:57 | |
| *** paramite has quit IRC | 20:01 | |
| pabelanger | remote: https://review.openstack.org/492666 Revert "Remove NPM mirror settings" | 20:01 |
| pabelanger | that will be helpful to tripleo-ui project | 20:01 |
| mwhahaha | indeed | 20:02 |
| *** jlabarre has quit IRC | 20:02 | |
| *** agopi|away has quit IRC | 20:03 | |
| *** jlabarre has joined #tripleo | 20:03 | |
| *** cylopez has quit IRC | 20:03 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 20:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 20:10 |
| *** jkilpatr has quit IRC | 20:11 | |
| Slower | bnemec: around? | 20:12 |
| *** funzo has quit IRC | 20:14 | |
| *** jprovazn has quit IRC | 20:15 | |
| *** sbrzozow has quit IRC | 20:18 | |
| *** ebarrera has quit IRC | 20:21 | |
| *** jlabarre has quit IRC | 20:23 | |
| *** jlabarre has joined #tripleo | 20:23 | |
| *** hamzy has quit IRC | 20:24 | |
| *** ansmith_ has quit IRC | 20:29 | |
| *** ansmith has quit IRC | 20:29 | |
| *** jcoufal has quit IRC | 20:29 | |
| *** sdake is now known as k2so | 20:37 | |
| pabelanger | on track for 4 more merges | 20:45 |
| *** mcornea has quit IRC | 20:45 | |
| mwhahaha | sssssh don't jinx it :D | 20:46 |
| fultonj | is it ok to run a recheck now? | 20:46 |
| mwhahaha | please don't | 20:46 |
| fultonj | ok | 20:46 |
| mwhahaha | hopefully it'll only be another 45 mins or so | 20:48 |
| * mwhahaha crosses fingers | 20:48 | |
| fultonj | mwhahaha: apologies, i had issued a recheck on one patch (https://review.openstack.org/#/c/492082), because i saw the restore and elastic recheck pionted to a timeout. no others though | 20:48 |
| mwhahaha | k i'll just keep it out of the gate and add it to the list of stuff to approve afterwards | 20:49 |
| fultonj | ok, sorry for that | 20:49 |
| fultonj | thansk | 20:49 |
| Kildurin | Has anyone seen issues when installing Openstack with Tripleo > 30 nodes? | 20:52 |
| pabelanger | ya, 45mins we should know more | 20:53 |
| Kildurin | We usually install 3 Controllers + 1 compute and then add 5 computes. After about 30, we can't get any more compute nodes to add/ | 20:54 |
| mwhahaha | Kildurin: there might be some tweaks needed on the undercloud, what failures are you seeing? | 20:54 |
| Kildurin | Can't find any failures. Just times out. | 20:56 |
| bnemec | Slower: Here | 20:57 |
| *** salmankhan has quit IRC | 20:57 | |
| mwhahaha | Kildurin: you may want to try upping the rcp_response_timeout on the undercloud, also adjust keyustone worker counts up | 20:58 |
| Kildurin | Where are those on Newton? | 20:59 |
| mwhahaha | the first is a heat.conf option | 20:59 |
| pabelanger | cool 4 merged incoming | 21:00 |
| *** jkilpatr has joined #tripleo | 21:00 | |
| mwhahaha | and the second is in keystone.conf unless it's runninger under httpd then it would be in the http config | 21:00 |
| *** gcerami is now known as gcerami|Zz | 21:00 | |
| mwhahaha | Kildurin: the doc i have says ~8 for keystone admin and ~4 for main (YMMV) | 21:00 |
| Kildurin | Yeah, I think it is under http | 21:01 |
| *** ecerquei__ has quit IRC | 21:01 | |
| Kildurin | Yeah, this is our first time with systems up to around 70-120 nodes | 21:02 |
| mwhahaha | also you may want to try bumping keystone token expieration time | 21:02 |
| Kildurin | Thanks I will try those settings | 21:02 |
| *** trown is now known as trown|outtypewww | 21:02 | |
| *** jpena|mtg is now known as jpena|off | 21:02 | |
| mwhahaha | there's some other ironic tweaks to be done as well but the doc recommends max of adding 32 nodes at a time | 21:02 |
| Kildurin | Only adding 5 at a time | 21:03 |
| Kildurin | But once we are over 30 nodes in the stack, we believe it is timing out | 21:03 |
| *** rhallisey has quit IRC | 21:04 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: pin the ovb git repo to a working version https://review.openstack.org/492686 | 21:05 |
| mwhahaha | Kildurin: what's the specs of your undercloud? | 21:08 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 21:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1710013 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 21:10 |
| openstack | Launchpad bug 1710013 in tripleo "KeyError: 'bmc_prefix' ovb version in oooq is no longer working" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 21:10 |
| *** Goneri has quit IRC | 21:13 | |
| *** funzo has joined #tripleo | 21:15 | |
| *** nyechiel has joined #tripleo | 21:17 | |
| *** shreshtha_ has joined #tripleo | 21:18 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: tripleo-ci: transform delorean URL to use AFS mirrors when possible https://review.openstack.org/491522 | 21:18 |
| mwhahaha | that's one | 21:19 |
| mwhahaha | only took 2 days | 21:19 |
| *** funzo has quit IRC | 21:20 | |
| weshay | Slower, what hash did you use for ovb? https://review.openstack.org/#/c/492686/ | 21:20 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Replace references to deprecated controllerExtraConfig https://review.openstack.org/480395 | 21:20 |
| weshay | mwhahaha++ | 21:21 |
| weshay | nice | 21:21 |
| *** shreshtha has quit IRC | 21:21 | |
| * mwhahaha cheers on the queue | 21:21 | |
| Slower | weshay: answered on #oooq | 21:23 |
| weshay | thanks | 21:25 |
| *** nyechiel has quit IRC | 21:25 | |
| mwhahaha | oh here comes the networking-bagpipe changes | 21:26 |
| * mwhahaha hopes the exclusion patches land | 21:27 | |
| *** athomas has quit IRC | 21:32 | |
| *** gfidente|afk is now known as gfidente | 21:34 | |
| *** abishop has quit IRC | 21:39 | |
| *** jtomasek has joined #tripleo | 21:43 | |
| *** rbrady has joined #tripleo | 21:43 | |
| *** morazi has quit IRC | 21:46 | |
| *** jtomasek has quit IRC | 21:47 | |
| *** gbarros has joined #tripleo | 21:48 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Noop controller pre and post config resources. https://review.openstack.org/487313 | 21:49 |
| openstackgerrit | Merged openstack/instack-undercloud master: Validate local_interface exists https://review.openstack.org/491601 | 21:50 |
| *** salmankhan has joined #tripleo | 21:53 | |
| pabelanger | 491878 doesn't look good. Still bootstraping devstack-gate, after 2.5 hours | 21:55 |
| pabelanger | both nodes in citycloud-lon1 | 21:55 |
| *** gfidente has quit IRC | 21:56 | |
| pabelanger | if that failure, I think we can force merge it | 21:56 |
| pabelanger | everything else behind it is passing | 21:56 |
| *** bfournie has quit IRC | 21:59 | |
| *** jmelvin has quit IRC | 21:59 | |
| *** salmankhan has quit IRC | 22:00 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 22:00 |
| *** tesseract has quit IRC | 22:02 | |
| * mwhahaha cries | 22:03 | |
| mwhahaha | we need that one too | 22:05 |
| mwhahaha | specificlaly because of the bagpipe changes in queue | 22:05 |
| mwhahaha | :/ | 22:05 |
| *** cdearborn has quit IRC | 22:08 | |
| *** akrivoka has quit IRC | 22:08 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1710013 | 22:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 22:10 |
| openstack | Launchpad bug 1710013 in tripleo "KeyError: 'bmc_prefix' ovb version in oooq is no longer working" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 22:10 |
| *** openstackgerrit has quit IRC | 22:18 | |
| *** jlabarre has quit IRC | 22:28 | |
| *** jlabarre has joined #tripleo | 22:29 | |
| *** ansmith has joined #tripleo | 22:30 | |
| *** ansmith_ has joined #tripleo | 22:31 | |
| pabelanger | mwhahaha: I enqueued 491878 into gate agin | 22:32 |
| pabelanger | so anything behind it should pass | 22:32 |
| *** |ance|ott has joined #tripleo | 22:34 | |
| *** dparkes has joined #tripleo | 22:37 | |
| mwhahaha | k | 22:38 |
| *** leitan has quit IRC | 22:44 | |
| *** catintheroof has quit IRC | 22:45 | |
| *** catintheroof has joined #tripleo | 22:45 | |
| pabelanger | I'm happy we haven't see any new [Errno 256] No more mirrors to try today | 22:49 |
| *** catintheroof has quit IRC | 22:49 | |
| mwhahaha | yay for small victories :D | 22:49 |
| mwhahaha | of course it helps telling everyone to stop rechecking | 22:50 |
| mwhahaha | the check gate is down from like 300+ from earlier today | 22:50 |
| pabelanger | Ya, we added 100 nodes in rax today, so that helps | 22:50 |
| pabelanger | and decreased infracloud 50% so not as many jobs hitting it today | 22:50 |
| *** MVenesio has quit IRC | 22:54 | |
| mwhahaha | pabelanger: http://logs.openstack.org/63/491463/5/gate/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/5055004/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-08-10_22_52_21 | 23:03 |
| * mwhahaha sighs | 23:03 | |
| mwhahaha | not as critical | 23:04 |
| mwhahaha | still a problem tho | 23:04 |
| mwhahaha | we can just recheck that patch | 23:04 |
| pabelanger | Wow, dns died | 23:05 |
| *** |ance|ott has quit IRC | 23:05 | |
| pabelanger | http://logs.openstack.org/63/491463/5/gate/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/5055004/logs/undercloud/etc/resolv.conf.txt.gz | 23:07 |
| pabelanger | that is wrong | 23:07 |
| pabelanger | it should be nameserver 127.0.0.1 | 23:07 |
| pabelanger | let me see what caused that | 23:07 |
| mwhahaha | we probably set that | 23:07 |
| mwhahaha | in oooq | 23:07 |
| pabelanger | Ya, we should check that and stop if soo | 23:08 |
| pabelanger | we want to use local unbound service for dns caching | 23:08 |
| pabelanger | Hmm | 23:08 |
| pabelanger | http://logs.openstack.org/63/491463/5/gate/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/5055004/console.html#_2017-08-10_22_32_58_269544 | 23:08 |
| mwhahaha | this is just a giant expedition to find all the things we shouldn't be doing and fixing them | 23:08 |
| pabelanger | that isn't right | 23:08 |
| pabelanger | let me check running node in infracloud-vanilla | 23:09 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709066 | 23:10 |
| openstack | Launchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709327 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1709630 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1710013 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,In progress] - Assigned to Giulio Fidente (gfidente) | 23:10 |
| openstack | Launchpad bug 1710013 in tripleo "KeyError: 'bmc_prefix' ovb version in oooq is no longer working" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 23:10 |
| pabelanger | Hmm, I wonder if /etc/rc.local is not getting executed on centos | 23:11 |
| *** funzo has joined #tripleo | 23:17 | |
| mwhahaha | is systemd starting rc-local? | 23:20 |
| mwhahaha | of course i don't see any systemctl status in the logs | 23:20 |
| mwhahaha | oh it ran | 23:20 |
| mwhahaha | well /etc/rc.d/rc.local ran | 23:20 |
| *** funzo has quit IRC | 23:21 | |
| pabelanger | Ya, so glean runs after rc.local, so that is the issue | 23:22 |
| pabelanger | will need to fix that tomorrow | 23:22 |
| pabelanger | http://logs.openstack.org/85/492385/1/gate/gate-tripleo-ci-centos-7-undercloud-containers/4893008/console.html | 23:37 |
| pabelanger | that is still hitting buildlogs.centos.org directly | 23:37 |
| pabelanger | container jobs | 23:37 |
| mwhahaha | i saw that | 23:38 |
| mwhahaha | http://logs.openstack.org/85/492385/1/gate/gate-tripleo-ci-centos-7-undercloud-containers/4893008/console.html#_2017-08-10_23_12_45_156393 | 23:38 |
| mwhahaha | i'll have to find where we're doing that in tripleo-ci | 23:38 |
| mwhahaha | i thought we fixed that one already | 23:39 |
| mwhahaha | might be another case of oooq vs tripleo-ci | 23:39 |
| mwhahaha | for now i need to go deal with back to school night for the kids | 23:39 |
| * mwhahaha wanders off and hopes everything else merges | 23:39 | |
| *** pabelanger has quit IRC | 23:47 | |
| *** pabelanger has joined #tripleo | 23:47 | |
| *** kbyrne has quit IRC | 23:48 | |
| pabelanger | mwhahaha: okay, DNS fixed in infracloud. Just set --no-dns-nameservers on our subnet | 23:48 |
| pabelanger | centos will default to 127.0.0.1 now | 23:48 |
| *** openstackgerrit has joined #tripleo | 23:51 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device https://review.openstack.org/472065 | 23:51 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!