| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Create NIC templates for Neutron Networker composable role https://review.openstack.org/400390 | 00:00 |
|---|---|---|
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Fix descriptions on bonding templates https://review.openstack.org/428672 | 00:09 |
| *** limao has quit IRC | 00:17 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: WIP: enable container periodic job https://review.openstack.org/475743 | 00:32 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 00:32 |
| *** mdnadeem has joined #tripleo | 00:39 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Convert role templates to consume roles_data map https://review.openstack.org/469853 | 00:59 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Convert role templates to consume roles_data map https://review.openstack.org/469853 | 00:59 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Convert role templates to consume roles_data map https://review.openstack.org/469853 | 01:04 |
| *** achadha has quit IRC | 01:12 | |
| *** fzdarsky_ has joined #tripleo | 01:13 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Convert role templates to consume roles_data map https://review.openstack.org/469853 | 01:14 |
| *** achadha has joined #tripleo | 01:16 | |
| *** achadha has quit IRC | 01:17 | |
| *** fzdarsky has quit IRC | 01:17 | |
| openstackgerrit | Jamie Lennox proposed openstack/diskimage-builder master: Use the dib python to do cleanup https://review.openstack.org/476302 | 01:20 |
| *** rbrady has quit IRC | 01:30 | |
| *** rbrady has joined #tripleo | 01:32 | |
| *** limao has joined #tripleo | 01:35 | |
| *** chlong has joined #tripleo | 01:43 | |
| *** dmacpher has quit IRC | 01:47 | |
| *** pliu has quit IRC | 01:47 | |
| *** myoung has quit IRC | 01:47 | |
| *** dmacpher has joined #tripleo | 01:47 | |
| *** cschwede has quit IRC | 01:47 | |
| *** jschlueter has quit IRC | 01:47 | |
| *** lhinds has quit IRC | 01:47 | |
| *** rnoriega has quit IRC | 01:47 | |
| *** adarazs has quit IRC | 01:48 | |
| *** faceman has quit IRC | 01:49 | |
| *** marios has quit IRC | 01:49 | |
| *** MrRoot has quit IRC | 01:50 | |
| *** achadha has joined #tripleo | 01:52 | |
| *** limao has quit IRC | 01:52 | |
| *** limao has joined #tripleo | 01:54 | |
| *** achadha has quit IRC | 01:56 | |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Add list options to overcloud container image build https://review.openstack.org/471157 | 01:58 |
| *** ansmith has quit IRC | 01:59 | |
| *** yamahata_ has quit IRC | 02:01 | |
| *** gbarros has joined #tripleo | 02:02 | |
| *** limao has quit IRC | 02:03 | |
| *** limao has joined #tripleo | 02:04 | |
| *** chlong has quit IRC | 02:04 | |
| *** apetrich has quit IRC | 02:06 | |
| *** MrRoot has joined #tripleo | 02:07 | |
| *** apetrich has joined #tripleo | 02:11 | |
| *** eck` is now known as eck`gone | 02:12 | |
| *** gbarros has quit IRC | 02:19 | |
| *** chlong has joined #tripleo | 02:36 | |
| *** gbarros has joined #tripleo | 02:38 | |
| *** limao has quit IRC | 03:02 | |
| *** limao has joined #tripleo | 03:02 | |
| *** rlandy|bbl is now known as rlandy | 03:04 | |
| *** rlandy has quit IRC | 03:04 | |
| *** psahoo has joined #tripleo | 03:12 | |
| *** limao has quit IRC | 03:23 | |
| *** limao has joined #tripleo | 03:23 | |
| *** udesale has joined #tripleo | 03:33 | |
| *** limao has quit IRC | 03:44 | |
| *** limao has joined #tripleo | 03:44 | |
| *** rwsu has joined #tripleo | 03:49 | |
| *** atheurer has quit IRC | 03:54 | |
| *** yamahata_ has joined #tripleo | 03:59 | |
| *** chlong has quit IRC | 04:02 | |
| *** rhallisey has quit IRC | 04:06 | |
| *** axisys has quit IRC | 04:07 | |
| *** gkadam has joined #tripleo | 04:09 | |
| *** limao has quit IRC | 04:11 | |
| *** gbarros has quit IRC | 04:15 | |
| *** chlong has joined #tripleo | 04:15 | |
| *** achadha has joined #tripleo | 04:17 | |
| *** links has joined #tripleo | 04:21 | |
| *** achadha has quit IRC | 04:22 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Additional mount order unit test https://review.openstack.org/476340 | 04:28 |
| *** MrRoot has quit IRC | 04:37 | |
| *** ykarel has joined #tripleo | 04:39 | |
| *** ykarel_ has joined #tripleo | 04:44 | |
| *** ykarel has quit IRC | 04:46 | |
| *** janki has joined #tripleo | 04:50 | |
| *** ykarel_ has quit IRC | 04:56 | |
| *** ykarel_ has joined #tripleo | 04:57 | |
| *** limao has joined #tripleo | 05:09 | |
| *** limao has quit IRC | 05:09 | |
| *** limao has joined #tripleo | 05:09 | |
| *** jaganathan has quit IRC | 05:10 | |
| *** jaganathan has joined #tripleo | 05:10 | |
| *** agurenko has joined #tripleo | 05:14 | |
| *** skramaja has joined #tripleo | 05:15 | |
| *** rwsu has quit IRC | 05:19 | |
| *** jbadiapa_ has quit IRC | 05:19 | |
| *** jaganathan has quit IRC | 05:21 | |
| *** axisys has joined #tripleo | 05:24 | |
| *** marios has joined #tripleo | 05:26 | |
| *** jprovazn has joined #tripleo | 05:28 | |
| *** ykarel_ has quit IRC | 05:34 | |
| *** ykarel_ has joined #tripleo | 05:35 | |
| *** prateek has joined #tripleo | 05:36 | |
| *** achadha has joined #tripleo | 05:36 | |
| *** limao_ has joined #tripleo | 05:37 | |
| *** limao has quit IRC | 05:37 | |
| *** dmacpher has quit IRC | 05:38 | |
| *** achadha has quit IRC | 05:40 | |
| *** pgadiya has joined #tripleo | 05:43 | |
| *** masco has joined #tripleo | 05:47 | |
| *** dsariel has quit IRC | 05:49 | |
| *** limao_ has quit IRC | 05:49 | |
| *** limao has joined #tripleo | 05:49 | |
| *** dmacpher has joined #tripleo | 05:51 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Always start httpd at the same time https://review.openstack.org/476119 | 05:53 |
| *** ccamacho has quit IRC | 05:56 | |
| *** achadha has joined #tripleo | 05:57 | |
| *** achadha has quit IRC | 06:00 | |
| *** achadha has joined #tripleo | 06:00 | |
| *** yprokule has joined #tripleo | 06:01 | |
| *** dpawar has joined #tripleo | 06:01 | |
| *** fzdarsky_ has quit IRC | 06:03 | |
| *** limao has quit IRC | 06:06 | |
| *** dmacpher has quit IRC | 06:06 | |
| *** dmacpher has joined #tripleo | 06:07 | |
| *** limao has joined #tripleo | 06:07 | |
| *** limao_ has joined #tripleo | 06:14 | |
| *** limao has quit IRC | 06:15 | |
| *** limao_ has quit IRC | 06:20 | |
| *** limao has joined #tripleo | 06:21 | |
| *** limao_ has joined #tripleo | 06:22 | |
| *** achadha has quit IRC | 06:22 | |
| *** prateek_ has joined #tripleo | 06:23 | |
| *** limao has quit IRC | 06:25 | |
| *** prateek has quit IRC | 06:25 | |
| *** rcernin has joined #tripleo | 06:30 | |
| *** artom has joined #tripleo | 06:30 | |
| *** mrunge_ is now known as mrunge | 06:34 | |
| *** limao has joined #tripleo | 06:35 | |
| *** limao_ has quit IRC | 06:35 | |
| *** dsariel has joined #tripleo | 06:36 | |
| *** rcernin has quit IRC | 06:37 | |
| *** pliu has joined #tripleo | 06:40 | |
| *** marios has quit IRC | 06:42 | |
| *** marios has joined #tripleo | 06:42 | |
| *** marios has quit IRC | 06:43 | |
| *** marios has joined #tripleo | 06:44 | |
| *** prateek__ has joined #tripleo | 06:44 | |
| *** jaganathan has joined #tripleo | 06:46 | |
| *** ffiore has joined #tripleo | 06:46 | |
| *** prateek_ has quit IRC | 06:46 | |
| *** mcornea has joined #tripleo | 06:48 | |
| *** dbecker has joined #tripleo | 06:51 | |
| *** rcernin has joined #tripleo | 06:51 | |
| *** jbadiapa_ has joined #tripleo | 06:56 | |
| *** brault has joined #tripleo | 06:56 | |
| *** jaganathan has quit IRC | 06:57 | |
| *** jaganathan has joined #tripleo | 06:57 | |
| *** dbecker has quit IRC | 07:00 | |
| *** limao has quit IRC | 07:02 | |
| *** tesseract has joined #tripleo | 07:02 | |
| *** limao has joined #tripleo | 07:02 | |
| *** limao has quit IRC | 07:04 | |
| *** limao has joined #tripleo | 07:04 | |
| openstackgerrit | Dnyaneshwar proposed openstack/puppet-tripleo master: Add new profile for the Veritas HyperScale's cinder backend. https://review.openstack.org/475762 | 07:05 |
| *** pcaruana has joined #tripleo | 07:06 | |
| *** bogdando has joined #tripleo | 07:07 | |
| *** gkadam is now known as gkadam-afk | 07:08 | |
| openstackgerrit | Xinliang Liu proposed openstack/diskimage-builder master: Fix mkfs use wrong label option for vfat https://review.openstack.org/476382 | 07:10 |
| *** jlinkes has joined #tripleo | 07:12 | |
| openstackgerrit | Dnyaneshwar proposed openstack/puppet-tripleo master: Add new profile for the Veritas HyperScale's cinder backend. https://review.openstack.org/475762 | 07:12 |
| *** f13o has joined #tripleo | 07:14 | |
| *** yprokule_ has joined #tripleo | 07:18 | |
| *** sid1 has joined #tripleo | 07:19 | |
| openstackgerrit | Dnyaneshwar proposed openstack/puppet-tripleo master: Add new profile for the Veritas HyperScale's cinder backend. https://review.openstack.org/475762 | 07:19 |
| *** yprokule has quit IRC | 07:21 | |
| *** yprokule_ is now known as yprokule | 07:21 | |
| *** sid1 has quit IRC | 07:21 | |
| *** jpich has joined #tripleo | 07:22 | |
| *** aufi has joined #tripleo | 07:25 | |
| *** ebarrera has joined #tripleo | 07:27 | |
| *** ccamacho has joined #tripleo | 07:28 | |
| *** gfidente has joined #tripleo | 07:31 | |
| *** gfidente has quit IRC | 07:31 | |
| *** gfidente has joined #tripleo | 07:31 | |
| *** mrchao has joined #tripleo | 07:33 | |
| *** dparkes has joined #tripleo | 07:33 | |
| *** dtantsur|afk is now known as dtantsur | 07:35 | |
| *** egonzalez has joined #tripleo | 07:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Generate ARA statistics https://review.openstack.org/476392 | 07:38 |
| *** apetrich has quit IRC | 07:39 | |
| *** amoralej|off is now known as amoralej | 07:40 | |
| *** jpena|off is now known as jpena | 07:42 | |
| *** prateek__ is now known as prateek | 07:45 | |
| *** oidgar has joined #tripleo | 07:46 | |
| *** anshul has joined #tripleo | 07:48 | |
| *** sid1 has joined #tripleo | 07:48 | |
| bogdando | sshnaidm: wrt | 07:51 |
| bogdando | > ovb-ha-oooq job running both in gates and periodic jobs | 07:51 |
| bogdando | do we have similar for containers? | 07:51 |
| sshnaidm | bogdando, no, containers run only on patches | 07:51 |
| sshnaidm | bogdando, no problem to make periodic, but no much sense too.. | 07:52 |
| *** bnemec has quit IRC | 07:52 | |
| sshnaidm | bogdando, usually gate jobs are not shown in health | 07:52 |
| bogdando | sshnaidm: not sure. Devs wouldn't like to monitor gates, but periodic - could be. The latter is like ALARM ring for all | 07:52 |
| bogdando | so would be nice to have a guard ringing it (rss feeds for all) | 07:53 |
| sshnaidm | bogdando, if devs don't monitor broken gates, they definitely will ignore periodic too :) | 07:53 |
| bogdando | there is also cryptic scenario1-4 jobs | 07:53 |
| bogdando | sshnaidm: not really, the periodic checks the master or stable. While gates just make noise for non related patches, right? | 07:54 |
| sshnaidm | bogdando, some gate jobs are shown in health though, we try to check with mtreinish why it happens and why there are no ovb gate jobs | 07:54 |
| bogdando | who is interested in listening that noise? I bet - no one | 07:54 |
| sshnaidm | bogdando, periodic jobs checks not master but consistent repo and promote it | 07:55 |
| bogdando | but this not alwaus true for periodic jobs | 07:55 |
| bogdando | sshnaidm: well, do we need to have periodic jobs for master then? | 07:55 |
| sshnaidm | bogdando, no, we have gates for this | 07:55 |
| bogdando | um | 07:55 |
| sshnaidm | bogdando, gate jobs check master every minute | 07:56 |
| bogdando | isn't check / gate run against *patches* ?? | 07:56 |
| sshnaidm | bogdando, yep | 07:56 |
| bogdando | sshnaidm: oh, I didn't know that! | 07:56 |
| sshnaidm | bogdando, in the patches I mean | 07:56 |
| bogdando | sshnaidm: that's not exactly that contributors would like to see I suppose | 07:57 |
| bogdando | anyone who wants to help would first start monitor that merged and fails periodic jobs, like regressions introduced | 07:57 |
| bogdando | IMO\ | 07:57 |
| sshnaidm | bogdando, anybody who is looking at http://status-tripleoci.rhcloud.com/ and see all containers job fail forever could suspect that something is wrong with it | 07:57 |
| bogdando | actually, not really. that may be 99% failure of some random patch not passing | 07:58 |
| bogdando | for 99% cases. And it is very opaque to distinguish it vs regressions in master | 07:58 |
| sshnaidm | bogdando, all patches in all repos not passing? not realistic | 07:58 |
| sshnaidm | bogdando, what is the problem you try to solve? | 07:59 |
| bogdando | just shared my feedback. If there were rss feeds for periodic ovb/multinode containers jobs, I'd subscribe to that and inspect failures. But much less likely - for random patches failing | 07:59 |
| *** zzzeek has quit IRC | 08:00 | |
| bogdando | the problem to solve is to attract contributors to guarding master against regressions | 08:00 |
| bogdando | for* | 08:00 |
| *** nyechiel_ has joined #tripleo | 08:00 | |
| bogdando | as a new comer, I can see there are many jobs in many repos, making noise. Nothing is clear | 08:00 |
| *** zzzeek has joined #tripleo | 08:00 | |
| bogdando | regressions can't be seen easily | 08:00 |
| bogdando | EmilienM: what do you think on that topic?.. | 08:01 |
| sshnaidm | bogdando, ok, so we have lp bug crying here in channel every our about failing gate, we have escalations and trello cards and mails.. next step will be visit homes of devs with leaving post there.. | 08:01 |
| *** suuuper has joined #tripleo | 08:01 | |
| bogdando | sshnaidm: the latter is rss :) | 08:02 |
| bogdando | if only one could simply subscribe to things | 08:02 |
| sshnaidm | I think there are really a lot of communication channels where people can know about failure and adding another one is not really critical | 08:02 |
| *** fzdarsky_ has joined #tripleo | 08:02 | |
| bogdando | not doing manual inspection of "alll read" reports | 08:02 |
| bogdando | "all red" | 08:02 |
| sshnaidm | the fact that regressions are not solved doesn't mean people don't know about them | 08:03 |
| bogdando | sshnaidm: the use case - containers job is non voting now, so it's easy to miss a bad thing get into the master. | 08:03 |
| bogdando | alarms , escalations, trello boards contain only 99% of noise wrt that use case specifically | 08:04 |
| bogdando | and everyone who cares, will have to go through that noise and numerous red jobs (completely unrelated) each time | 08:04 |
| bogdando | what's a pain | 08:04 |
| sshnaidm | bogdando, no, escalations are done for critical problems only, no any noise there | 08:04 |
| bogdando | okay, so my case is seems non critical | 08:05 |
| bogdando | non voting, after all =) | 08:05 |
| bogdando | but still may be an area of interest of a team | 08:05 |
| sshnaidm | bogdando, containers job is escalated and cared by mandre, jistr | 08:05 |
| bogdando | yeah, and I'm trying to make things easier to detect and alarm everyone who is interested, via rss | 08:05 |
| bogdando | say, some periodic job is failing, this simple | 08:06 |
| bogdando | not the gate | 08:06 |
| sshnaidm | bogdando, ok, but I don't think the problem is with alarming, from my experience I can say that nobody cares about periodic jobs | 08:06 |
| hjensas | On topic of CI, I would like to see more jobs moved out of non-voting. Just this week I have bug/1699026, and c/437544/ full of issues. 1st is a regression, 2nd is probably du to a change in requirments merged monday. | 08:07 |
| bogdando | sshnaidm: Well sometimes "no one cares" == "no one understands and gives up" | 08:07 |
| sshnaidm | bogdando, not in this case | 08:07 |
| sshnaidm | bogdando, again, when gate job is broken it's alarmed in a lot of communication channels | 08:07 |
| bogdando | the lack of info or than there is too much of the noice unrelated | 08:07 |
| bogdando | then* | 08:07 |
| sshnaidm | bogdando, sorry, I don't understand what we are arguing about, if people want to check job they check, if not - no any rss,mail, etc will force them to do it | 08:08 |
| bogdando | I think I failed to explain the case. Sorry for that. Perhaps someone else could do that better | 08:08 |
| *** bnemec has joined #tripleo | 08:08 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Add docs around updating undercloud ssh key https://review.openstack.org/476275 | 08:08 |
| bogdando | sshnaidm: I wanted to check why my deployment fails. It was cuz of containers images outdated | 08:09 |
| sshnaidm | hjensas, which jobs exactly? | 08:09 |
| bogdando | if there were a periodic job checkin, I'd subscribe and get the root cause much earlier | 08:09 |
| hjensas | gate-instack-undercloud-docs-ubuntu-xenialFAILURE in 43s | 08:09 |
| hjensas | gate-instack-undercloud-pep8-ubuntu-xenialFAILURE in 29s | 08:09 |
| hjensas | gate-instack-undercloud-python27-ubuntu-xenialFAILURE in 1m 50s | 08:09 |
| hjensas | gate-instack-undercloud-python35FAILURE in 41s | 08:09 |
| hjensas | sshnaidm: so for c/437544 - or instack-undercloud master, the tox stuff is broke. | 08:10 |
| sshnaidm | bogdando, if you present on this channel or subscribed to lp bugs or any internal maillist - you would know about this immediately | 08:10 |
| bogdando | so the case is "people want to check, but there is too much of unrelated things, or missing check points at all" | 08:10 |
| bogdando | sshnaidm: the last two cases with outdated containers I've discovered on my own | 08:11 |
| sshnaidm | hjensas, hmm.. not sure I understand, these jobs actually vote, aren't they? | 08:11 |
| bogdando | there were no alarms | 08:11 |
| bogdando | I'm not sure why | 08:11 |
| hjensas | sshnaidm: yes, these jobs vote. The other regression is the gate-tripleo-ci-centos-7-3nodes-multinode-nv job. | 08:11 |
| bogdando | I believe we're not arguing, but I'm failing to explain my case :) | 08:12 |
| sshnaidm | bogdando, https://bugs.launchpad.net/tripleo/+bug/1699062 | 08:12 |
| openstack | Launchpad bug 1699062 in tripleo "Containers CI broken by out of date images" [Critical,Fix released] | 08:12 |
| bogdando | and that we really need periodic jobs for ovb-ha/multinode for containers ran against master | 08:12 |
| hjensas | sshnaidm: so Issue 1. the regression would have been caught earlier if 3nodes-multinode was voting. :) | 08:12 |
| bogdando | sshnaidm: that was a two days after I was hit by the issue | 08:13 |
| *** yprokule_ has joined #tripleo | 08:13 | |
| sshnaidm | hjensas, what does it mean? gate-tripleo-ci-centos-7-3nodes-multinode-nv was broken because of code change? | 08:14 |
| hjensas | sshnaidm: no composable roles in tripleo was broken. | 08:14 |
| bogdando | weshay: could you share your thoughts on that topic please? | 08:14 |
| sshnaidm | bogdando, if people don't fill bugs, that's another issue.. how rss would help here? | 08:14 |
| bogdando | weshay: "we really need periodic jobs for ovb-ha/multinode for containers ran against master" ? | 08:14 |
| sshnaidm | hjensas, and it was checked only in gate-tripleo-ci-centos-7-3nodes-multinode-nv? | 08:14 |
| bogdando | sshnaidm: rss would notify everyone subscribed, there is a regression. New one. | 08:15 |
| bogdando | see, a job now started failing | 08:15 |
| hjensas | sshnaidm: I think soo. (I am not very familiar with exactly what is tested in what jobs) | 08:15 |
| bogdando | and not the one that is kept being red for weeks by now =) | 08:15 |
| bogdando | the idea is to detect and notify the periodc job state changes | 08:16 |
| bogdando | not keep ringing days after | 08:16 |
| *** yprokule has quit IRC | 08:16 | |
| *** yprokule_ is now known as yprokule | 08:16 | |
| mcornea | therve: jistr hi, good morning! I have a reproducing environment with a timed out upgrade. Do you still need it? | 08:17 |
| hjensas | sshnaidm: the other issue. Voting jobs start failing for instack-undercloud with no code change. I belive this is because of commit 053d3eaf771d29372497c186dac672edde03e328 in requirements. (A periodic job on master would have detected this?) | 08:17 |
| *** snecklifter has joined #tripleo | 08:17 | |
| therve | mcornea, Yes please! | 08:17 |
| bogdando | sshnaidm: basically, an alarm is good only when it starts, a minute after that it's being shut down or silenced or ignored | 08:18 |
| sshnaidm | hjensas, yeah, it happens, and periodic can't do nothing with it, it could be broken also by any other involved project - nova,ironic,neutron, etc | 08:19 |
| bogdando | and I hoped to get a tool for early notification, via rss, and periodic jobs | 08:20 |
| hjensas | sshnaidm: yes any involved project could break it. But we don't detect it before someone tries to push a change. | 08:20 |
| bogdando | with a particular scope only | 08:20 |
| bogdando | like those "ovb-ha/multinode for containers ran against master" | 08:20 |
| sshnaidm | bogdando, when I want to see why my job fails and if it's known issue, I firstly look at status page and if there are long list of failing jobs with the same error - most likely it's the same bug, then it's better to look in lp if it's opened already, in channel - if there are alarms, and if not - you won the opportunity to fill the bug first. | 08:21 |
| bogdando | sshnaidm: yeah, that's clear. Just a long list and many actions | 08:21 |
| bogdando | I hoped to bring shortcuts by subject areas | 08:22 |
| sshnaidm | hjensas, we work on this now, we have a few projects that run our jobs and now encourage people from related fields to watch them, like networking folks to watch tripleo jobs on neutron etc | 08:22 |
| bogdando | scoped jobs and notifications, individual, for subscribers | 08:22 |
| bogdando | and focused on regressions, not patches | 08:22 |
| bogdando | there are too much of status pages and cryptic jobs... https://status-tripleoci.rhcloud.com/ and http://tripleo.org/cistatus.html and http://status.openstack.org/openstack-health/#/g/project/openstack-infra~2Ftripleo-ci | 08:24 |
| sshnaidm | bogdando, I personally think that problem with long time failing jobs is not related to their visibility, but I can be wrong of course | 08:24 |
| bogdando | sshnaidm: long time failing jobs is another story | 08:24 |
| sshnaidm | bogdando, it's not too much, it's only 3 :) | 08:24 |
| bogdando | I'm tryin to improve the very first failure vuz of a newly discovered regression case | 08:25 |
| bogdando | sshnaidm: and each has tons of jobs :) | 08:25 |
| bogdando | to be inspected cross repos for potential long running regressions | 08:25 |
| sshnaidm | bogdando, now you try to solve some other problem | 08:26 |
| bogdando | that's the same one, just trying to explain better :D | 08:26 |
| *** limao has quit IRC | 08:27 | |
| bogdando | establishing early and scoped alarms via subscriptions to scoped jobs, that's the case | 08:27 |
| *** limao has joined #tripleo | 08:27 | |
| bogdando | scoped periodic jobs for master or stable branches | 08:27 |
| bogdando | once again please, not jobs checking patches | 08:27 |
| bogdando | > that problem with long time failing jobs is not related to their visibility | 08:29 |
| bogdando | right. But visibility issue makes them becoming long time failing! | 08:29 |
| bogdando | and scoped by deployment cases periodic jobs would help to address that visibility issue, that's my point | 08:30 |
| *** sid1 has quit IRC | 08:30 | |
| *** sid1 has joined #tripleo | 08:31 | |
| bogdando | so there are only ovb-ha, and nonha-multinode-scenario1-4 jobs. That seems not enough to cover all cases, at least for containers sshnaidm | 08:31 |
| bogdando | I meant periodic ones | 08:31 |
| sshnaidm | bogdando, current periodic jobs are for promotion mostly | 08:31 |
| bogdando | sshnaidm: that's also an issue, the scope of those jobs is not transparent for contributors | 08:32 |
| bogdando | I know there is a matrix but... | 08:32 |
| sshnaidm | bogdando, what do you mean? | 08:32 |
| bogdando | let's make it complete for non promotion cases as well | 08:32 |
| bogdando | HA, containers, upgrades | 08:32 |
| bogdando | needs to be issues on periodic basis against masters | 08:33 |
| *** lucas-afk is now known as lucasagomes | 08:33 | |
| bogdando | issued | 08:33 |
| bogdando | and put into the test matrix | 08:33 |
| sshnaidm | bogdando, to make periodic master jobs for voting doesn't make any sense | 08:33 |
| bogdando | so folks from teams could subscribe with rss or the like | 08:33 |
| bogdando | sshnaidm: for ealry alarming only | 08:33 |
| bogdando | the state green to red changes | 08:34 |
| *** b00tcat has joined #tripleo | 08:34 | |
| sshnaidm | bogdando, still no any sense, broken gates are alerted immediately | 08:34 |
| *** yamahata_ has quit IRC | 08:34 | |
| bogdando | if all is green, and one starts red, it's the way simple to inspect and fix than later, with other reds overlapping | 08:34 |
| *** b00tcat_ has quit IRC | 08:34 | |
| sshnaidm | bogdando, you can see in status page when exactly job started failing, it's much more helpful than "yesterday" | 08:35 |
| bogdando | sshnaidm: gates alerts come for patches | 08:35 |
| bogdando | and contain unrelated noise | 08:35 |
| *** fzdarsky_ has quit IRC | 08:35 | |
| sshnaidm | bogdando, I don't understand which noise you are talking | 08:35 |
| *** ckyriakidou has joined #tripleo | 08:35 | |
| sshnaidm | bogdando, if gate job is broken, no any patch could be submitted, people start to complain immediately | 08:36 |
| bogdando | sshnaidm: right, I think I understood your point now | 08:36 |
| bogdando | so then we should sed the history with s/periodic/gate/g :) | 08:37 |
| bogdando | sshnaidm: could you point me please containers gate jobs, ovb-ha/multinode to subscribe? | 08:37 |
| bogdando | couldn't locate them on openstack-health page, for setting rss | 08:38 |
| *** derekh has joined #tripleo | 08:38 | |
| sshnaidm | bogdando, only *periodic* jobs are in health page | 08:39 |
| sshnaidm | <sshnaidm> bogdando, some gate jobs are shown in health though, we try to check with mtreinish why it happens and why there are no ovb gate jobs | 08:39 |
| *** dmk0202 has joined #tripleo | 08:40 | |
| bogdando | sshnaidm: ok, thanks | 08:40 |
| *** gkadam-afk is now known as gkadam | 08:40 | |
| *** tosky has joined #tripleo | 08:40 | |
| *** fzdarsky has joined #tripleo | 08:43 | |
| *** zoli|gone is now known as zoli|wfh | 08:44 | |
| sshnaidm | mandre, ping | 08:44 |
| *** marios has quit IRC | 08:44 | |
| *** marios has joined #tripleo | 08:45 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Enable the HA deployment by default https://review.openstack.org/359060 | 08:47 |
| *** f13o has quit IRC | 08:47 | |
| mandre | sshnaidm: hey | 08:50 |
| sshnaidm | mandre, hi, just curious if you can share your solution to last containers problem - how to build/update them and what was required to fix | 08:51 |
| sshnaidm | mandre, I hardly understand the process of updating containers | 08:52 |
| *** milan has joined #tripleo | 08:52 | |
| mandre | sshnaidm: are you talking about the out of sync container images issue? | 08:54 |
| sshnaidm | mandre, I think so, the last problem of containers job | 08:55 |
| *** cmyster has quit IRC | 08:55 | |
| *** cmyster has joined #tripleo | 08:56 | |
| *** adarazs has joined #tripleo | 08:56 | |
| mandre | sshnaidm: yeah, so if we're talking about the same thing, that was caused by the containers images used in CI being slightly too old, and the cinder container was at a different DB migration than the cinder running on the host | 08:57 |
| mandre | sshnaidm: the solution here was to update the containers in the tripleoupstream dockerhub registry so new images are picked up in CI | 08:58 |
| *** ckyriakidou has quit IRC | 08:59 | |
| mandre | sshnaidm: right now, we're still building/pushing images manually, either dprince or myself usually | 08:59 |
| mandre | but we're talking about using the images built in the RDO pipeline | 09:00 |
| sshnaidm | mandre, so you build them with kolla and push them manually to dockerhub? | 09:00 |
| mandre | sshnaidm: that's right, until now, but it's about to change | 09:00 |
| *** limao_ has joined #tripleo | 09:00 | |
| *** limao has quit IRC | 09:02 | |
| *** f13o has joined #tripleo | 09:02 | |
| sshnaidm | mandre, and how often will it built on rdo? | 09:03 |
| mandre | sshnaidm: rdo builds them in the promotion pipeline, https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-master-current-tripleo/ | 09:06 |
| mandre | sshnaidm: and as of now, they're uploaded with https://ci.centos.org/job/rdo-tripleo-containers-promote/ | 09:06 |
| mandre | sshnaidm: but I think the promotion is going to change a little bit, CC dmsimard panda | 09:07 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-docs master: Add multi-virtual undercloud guide https://review.openstack.org/474225 | 09:08 |
| *** limao has joined #tripleo | 09:08 | |
| *** athomas has joined #tripleo | 09:10 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: prepare subunit fail https://review.openstack.org/476427 | 09:10 |
| *** limao_ has quit IRC | 09:11 | |
| *** dbecker has joined #tripleo | 09:11 | |
| *** ckyriakidou has joined #tripleo | 09:13 | |
| *** salmankhan has joined #tripleo | 09:13 | |
| *** b00tcat has quit IRC | 09:17 | |
| *** b00tcat has joined #tripleo | 09:17 | |
| *** limao has quit IRC | 09:19 | |
| *** limao_ has joined #tripleo | 09:19 | |
| *** ckyriakidou has quit IRC | 09:24 | |
| *** dtantsur is now known as dtantsur|bbl | 09:25 | |
| *** athomas has quit IRC | 09:25 | |
| *** limao has joined #tripleo | 09:26 | |
| *** akrivoka has joined #tripleo | 09:26 | |
| *** limao_ has quit IRC | 09:27 | |
| *** dbecker has quit IRC | 09:29 | |
| *** apetrich has joined #tripleo | 09:29 | |
| *** limao has quit IRC | 09:29 | |
| *** cylopez has joined #tripleo | 09:40 | |
| *** dmk0202 has quit IRC | 09:40 | |
| *** mdnadeem has quit IRC | 09:45 | |
| openstackgerrit | Abhishek Kane proposed openstack/tripleo-heat-templates master: Add composable service for the Veritas HyperScale's cinder backend. https://review.openstack.org/475765 | 09:51 |
| *** karim has joined #tripleo | 09:54 | |
| *** karim is now known as Guest46148 | 09:55 | |
| *** Guest46148 is now known as karimb | 09:55 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Generate ARA statistics https://review.openstack.org/476392 | 09:57 |
| *** r2bit__ is now known as r2bit | 09:57 | |
| *** dbecker has joined #tripleo | 10:01 | |
| *** jlinkes has quit IRC | 10:02 | |
| *** SlickNik has quit IRC | 10:03 | |
| panda | sshnaidm: a periodic job will build containers, test the deployment with them, then upload to rdo registry. For the gate part, which requires an update on all containers involved, we'll build a container with a mirror of the delorean hash, then launch a script that updates all the containers using the mirror. | 10:03 |
| *** rhallisey has joined #tripleo | 10:04 | |
| *** rhallisey has quit IRC | 10:04 | |
| *** milan has quit IRC | 10:04 | |
| *** SlickNik has joined #tripleo | 10:04 | |
| *** rhallisey has joined #tripleo | 10:05 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-quickstart-extras master: Enable the HA deployment by default https://review.openstack.org/476448 | 10:06 |
| *** mdnadeem has joined #tripleo | 10:06 | |
| sshnaidm | panda, can't you update containers just with existing dlrn repo? why to create a special container with mirror? | 10:07 |
| *** jlinkes has joined #tripleo | 10:09 | |
| *** f13o has quit IRC | 10:13 | |
| panda | sshnaidm: During the build all the container will have to access the repo to install the packages, for the gate, in some cases we may need to update 30 containers. All of them will have to yum update the packages from the repo. The mirror container will probably be already in the undercloud image, will have to update only once, at start, then everything else will use it. We hope it will be faster to get them | 10:15 |
| panda | locally | 10:15 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 10:15 |
| *** flepied has joined #tripleo | 10:16 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 10:17 |
| *** chem has quit IRC | 10:17 | |
| *** sai has quit IRC | 10:18 | |
| *** rook has quit IRC | 10:18 | |
| *** sid1 has quit IRC | 10:18 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-quickstart-extras master: Enable the HA deployment by default https://review.openstack.org/476448 | 10:21 |
| *** sid1 has joined #tripleo | 10:22 | |
| *** sai has joined #tripleo | 10:23 | |
| *** chem has joined #tripleo | 10:24 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove trailing whitespace https://review.openstack.org/474420 | 10:24 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-quickstart-extras master: Enable the HA deployment by default https://review.openstack.org/476448 | 10:25 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-quickstart-extras master: Enable the HA deployment by default https://review.openstack.org/476448 | 10:25 |
| oidgar | hi, after deploying overcloud with 1xCompute and 1xController (each with only eth0), br-ex does not exist on the compute node. any idea how to create it? | 10:26 |
| *** rook has joined #tripleo | 10:27 | |
| *** rook is now known as Guest250 | 10:28 | |
| *** f13o has joined #tripleo | 10:28 | |
| panda | oidgar: IIRC br-ex should be only on the network node, which in this case is the controller | 10:29 |
| sshnaidm | panda, adarazs, other cores, can you please review adding multinode to promotion? https://review.openstack.org/#/c/475197/ https://review.openstack.org/475200 | 10:30 |
| *** mdnadeem has quit IRC | 10:33 | |
| *** dtantsur|bbl is now known as dtantsur | 10:34 | |
| oidgar | panda: wierd, I'm getting this message at the compute node from neutron-openvswitch-agent.log | 10:35 |
| oidgar | panda: 2017-06-22 10:18:37.876 7866 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-05680b79-0e6d-4fdd-be4a-eacf199158a3 - - - - -] Bridge br-ex for physical network datacentre does not exist. Agent terminated! | 10:35 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Enable the HA deployment by default https://review.openstack.org/359060 | 10:35 |
| sshnaidm | adarazs, EmilienM, panda this is for logstash, please re-review https://review.openstack.org/#/c/473095/ | 10:38 |
| dtantsur | hi folks! looking for a +W on https://review.openstack.org/#/c/473456/ and https://review.openstack.org/#/c/473457/, both have 2x +2 | 10:38 |
| dtantsur | this should preferrably land early to account for potential (though unlikely) regressions | 10:39 |
| sshnaidm | oidgar, with containers? | 10:39 |
| *** limao has joined #tripleo | 10:41 | |
| panda | sshnaidm: why are you grepping on ^20 ? what's that ? a timestamp ? | 10:41 |
| sshnaidm | panda, yes | 10:41 |
| sshnaidm | will work until 2099 | 10:42 |
| panda | we want only logs from the 2000 and not 3000 or we are indexing only timestamped lines ? why ? | 10:43 |
| sshnaidm | panda, logstash doesn't eat lines without timestamps | 10:43 |
| adarazs | sshnaidm: probably we should have something more than ^20, there could be lines starting with twenty and not being timestamps :) | 10:43 |
| panda | gourmand logstash | 10:44 |
| sshnaidm | adarazs, my perfectionism stops here :) | 10:44 |
| oidgar | sshnaidm: yes | 10:45 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-common master: Derive Params (part 2): Get services and feature list https://review.openstack.org/456471 | 10:45 |
| sshnaidm | oidgar, I think it's known issue. With network isolation? | 10:46 |
| oidgar | sshnaidm: I think so | 10:46 |
| *** cylopez has quit IRC | 10:46 | |
| sshnaidm | oidgar, https://bugs.launchpad.net/tripleo/+bug/1689556 | 10:47 |
| openstack | Launchpad bug 1689556 in tripleo "CI: containers overcloud can't start vm when deployed with multinic network isolation" [High,Triaged] | 10:47 |
| *** flepied has quit IRC | 10:48 | |
| *** milan has joined #tripleo | 10:49 | |
| hjensas | bnemec: around? In instack-undercloud, tox fails with "upper-constraints.txt Could not satisfy constraints for 'instack-undercloud': installation from path or url cannot be constrained to a version". I guess this started after instack-undercloud was added to global-requirements.txt? I can't figure out how to fix it. | 10:50 |
| adarazs | sshnaidm: added another comment to https://review.openstack.org/473095 | 10:50 |
| therve | mcornea, I haven't found the heat issue, but the update failed a little bit after retrying | 10:50 |
| therve | mcornea, " Cannot connect to the Docker daemon. Is the docker daemon running on this host?" | 10:50 |
| mcornea | therve: hm, that's ok but first time it failed after 4h | 10:51 |
| sshnaidm | adarazs, this file is for logstash server, not for people | 10:52 |
| sshnaidm | adarazs, nobody is supposed to look there and understand :) | 10:53 |
| *** jlinkes has quit IRC | 10:53 | |
| therve | mcornea, Yeah I know. I'm not finding the cause yet | 10:53 |
| adarazs | sshnaidm: hmm, I think logstash can be more useful if we can see which files have errors... though I admittedly don't know much about logstash... I understand you can analyze trends and errors with it, so I thought the filename could be useful. | 10:54 |
| mcornea | therve: would it help if I try to bring it the first update so we can see the timeout in action? | 10:54 |
| sshnaidm | adarazs, and when you find a string in kibana, you can't know which file is this from anyway | 10:54 |
| sshnaidm | adarazs, you won't see filename | 10:54 |
| adarazs | sshnaidm: okay /o\ :) | 10:55 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-quickstart-extras master: Enable the HA deployment by default https://review.openstack.org/476448 | 10:56 |
| *** katkapilatova has joined #tripleo | 10:57 | |
| sshnaidm | adarazs, just try it: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=build_name:%20gate-tripleo-ci-centos-7-ovb-ha-oooq%20AND%20build_status:%20FAILURE%20AND%20message:%20%5C%22Already%20timed%20out%5C%22 | 10:57 |
| sshnaidm | adarazs, set period in upper right cornet to "last 30 days" | 10:57 |
| sshnaidm | adarazs, you will see the message itself and file that message appear in it - in our case it will be "logstash.txt" or "console.html" | 10:58 |
| adarazs | yeah, I had to click in the "filename" field. yeah. so... we can't upload it separately, or have a field for the real filename? I guess it's not really important indeed if you only use it to generate graphs to see if some error message reoccurs. | 11:00 |
| *** cylopez has joined #tripleo | 11:01 | |
| sshnaidm | adarazs, maybe it's possible to insert filename to each line of this file, then you will see the whole line and filename will appear there.. | 11:01 |
| adarazs | yeah, okay, I guess it's not necessary, or we can do it later... | 11:01 |
| sshnaidm | adarazs, but it seems to be a little different solution, yeah | 11:01 |
| sshnaidm | adarazs, fill the card for it, maybe we'll get back to it once | 11:01 |
| sshnaidm | adarazs, wrt regex, I think we can live with it, considering that all mentioned scripts now are timestamped.. | 11:04 |
| *** jkilpatr has joined #tripleo | 11:04 | |
| sshnaidm | it's for safety only, not the main feature | 11:05 |
| adarazs | all right. | 11:05 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-common master: WIP: DPDK Derive parameters workflow https://review.openstack.org/468989 | 11:07 |
| sshnaidm | panda, sorry, I didn't understand you comment: https://review.openstack.org/#/c/475197/2/scripts/mirror-server/multinode_status.py | 11:07 |
| sshnaidm | panda, what does mean " check if the metadata is already updated"? | 11:08 |
| sshnaidm | panda, if I parsed logs once, I don't parse them again ever | 11:09 |
| *** lucasagomes is now known as lucas-hungry | 11:10 | |
| *** limao has quit IRC | 11:11 | |
| *** flepied has joined #tripleo | 11:11 | |
| akrivoka | I'm getting the "Max retries exceeded" error very often when trying mistral CLI commands in my tripleo dev environment | 11:16 |
| therve | mcornea, Yeah, but it be good to add some debug first | 11:16 |
| akrivoka | restarting mistral-engine or mistral-executor doesn't help | 11:16 |
| akrivoka | is there a better workaround for this than rebooting the undercloud vm? | 11:16 |
| *** adarazs has quit IRC | 11:17 | |
| mcornea | therve: ok, let me get it to the state before upgrade and I'll ping you | 11:18 |
| therve | mcornea, Thanks! | 11:18 |
| *** dbecker has quit IRC | 11:18 | |
| *** limao has joined #tripleo | 11:19 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: WIP: DPDK Derive parameters workflow https://review.openstack.org/468989 | 11:21 |
| *** chem has quit IRC | 11:29 | |
| *** ffiore has quit IRC | 11:29 | |
| *** chem has joined #tripleo | 11:31 | |
| fultonj | anyone want to review https://review.openstack.org/#/c/475952 ? thanks | 11:34 |
| fultonj | bogdando: ^ ? | 11:35 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: Keep floating ip reachability during pacemaker migration. https://review.openstack.org/474967 | 11:35 |
| gfidente | fultonj morning there | 11:35 |
| fultonj | hi gfidente | 11:36 |
| gfidente | fultonj /me looking into how to corretly set the subnets for the ceph cluster | 11:37 |
| gfidente | then moving on with clients | 11:37 |
| fultonj | gfidente: sounds goode | 11:37 |
| gfidente | I think those are the two things still missing to test this in CIO | 11:37 |
| gfidente | *CI :D | 11:37 |
| fultonj | gfidente: fyi: colonwq's OSD list was empty yesterday (but the mon list was good) | 11:38 |
| *** salmankhan has quit IRC | 11:38 | |
| fultonj | gfidente: yes, clients (containerized and non-containerized) + other params | 11:38 |
| *** abishop has joined #tripleo | 11:40 | |
| colonwq | fultonj, I need to add 467682 to my uc and revert the manual edit. I'll see if that helps the list issue. | 11:41 |
| fultonj | colonwq: ack | 11:41 |
| gfidente | colonwq if you git checkout https://review.openstack.org/465066 it'll pull in the two submissions it needs as well | 11:41 |
| gfidente | (instead of chetty-ick) | 11:42 |
| colonwq | gfidente, ack. Thanks. | 11:42 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/puppet-tripleo master: Split docker options and insecure registry https://review.openstack.org/476476 | 11:43 |
| dtantsur | hjensas: oh that's fun to fix | 11:43 |
| dtantsur | lemme find you a link | 11:43 |
| bogdando | folks, do you remember the strange issue with insecure registry config change applied, but docker service restart unscheduled by puppet due to augeas error (nothing to change)? so that's to address it ^^ | 11:44 |
| bogdando | so there are only ovb-ha, and nonha-multinode-scenario1-4 jobs. That seems not enough to cover all cases, at least for containers sshnaidm | 11:44 |
| bogdando | um bad paste, sorry | 11:44 |
| *** salmankhan has joined #tripleo | 11:44 | |
| bogdando | https://review.openstack.org/476476 this | 11:44 |
| dtantsur | hjensas: you'll have to cargo-cult something like this https://review.openstack.org/#/c/463679/ | 11:44 |
| hjensas | dtantsur: thanks, I saw something about that on mailing list but did'nt think it was the way to do it from the discussion. :) I'll give it a go. | 11:46 |
| *** amoralej is now known as amoralej|lunch | 11:47 | |
| *** pradk has joined #tripleo | 11:49 | |
| *** rwsu has joined #tripleo | 11:50 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set jobs subunit file as fail until it's overwritten https://review.openstack.org/476427 | 11:51 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Use component objects when comparing for type https://review.openstack.org/475089 | 11:51 |
| *** udesale has quit IRC | 11:52 | |
| *** masco has quit IRC | 11:54 | |
| *** dsariel has quit IRC | 11:58 | |
| openstackgerrit | Merged openstack/diskimage-builder master: On suse the python2 dev package is python-devel https://review.openstack.org/475051 | 12:01 |
| *** ramishra has quit IRC | 12:03 | |
| *** adarazs has joined #tripleo | 12:03 | |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-pacemaker master: HA: update bundle creation to be compatible with newest pcs https://review.openstack.org/476486 | 12:04 |
| *** thrash|g0ne is now known as thrash | 12:04 | |
| *** ramishra has joined #tripleo | 12:05 | |
| *** zoli|wfh is now known as zoli|lunch | 12:05 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Enable the HA deployment by default https://review.openstack.org/359060 | 12:07 |
| *** rbrady has quit IRC | 12:08 | |
| *** pkovar has joined #tripleo | 12:09 | |
| *** dprince has joined #tripleo | 12:12 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: WIP: enable container periodic job https://review.openstack.org/475743 | 12:13 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 12:13 |
| *** trown|outtypewww is now known as trown | 12:13 | |
| *** lucas-hungry is now known as lucasagomes | 12:16 | |
| EmilienM | bogdando: what topic exactly? can I have tl;dr? | 12:17 |
| bogdando | EmilienM: Thoughts on improving visibility of failed gate jobs with rss subscription available from openstack-health web page. Like this example http://health.openstack.org/runs/key/build_name/periodic-tripleo-ci-centos-7-scenario002-multinode-oooq/recent/rss | 12:19 |
| bogdando | EmilienM: and making those gate jobs more scoped, like containers vs non containers | 12:20 |
| *** sbrzozow has joined #tripleo | 12:20 | |
| EmilienM | bogdando: jobnames already do that, you can know which jobs are container or not | 12:20 |
| bogdando | EmilienM: I tried to find multinode and ovb-ha gate jobs (or periodic) for containers to subscribe as rss, and failed miserably | 12:20 |
| EmilienM | yeah I know | 12:21 |
| EmilienM | I found that yesterday too | 12:21 |
| EmilienM | and I haven't found why yet | 12:21 |
| *** limao has quit IRC | 12:22 | |
| *** chem has quit IRC | 12:22 | |
| bogdando | EmilienM, sshnaidm: mentioned that gate jobs can't be accessed for health, or there are subtle caveats | 12:22 |
| bogdando | from the o-health* | 12:22 |
| EmilienM | bogdando: I confirm gate jobs are in gate | 12:22 |
| EmilienM | let me show you | 12:22 |
| EmilienM | bogdando: http://status.openstack.org/openstack-health/#/job/gate-nova-python35 | 12:23 |
| EmilienM | gate-nova-python35 is a gate job in Nova, not periodic | 12:23 |
| bogdando | EmilienM: some of them, right. Not all, not for containers AFAICT | 12:23 |
| EmilienM | yeah something is weird | 12:24 |
| bogdando | EmilienM: to shrink it very tl;dr all I wanted is some help with "find multinode and ovb-ha gate jobs (or periodic) for containers to subscribe as rss" | 12:25 |
| bogdando | to bring a shortcut for that flow "when I want to see why my job fails and if it's known issue, I firstly look at status page and if there are long list of failing jobs with the same error - most likely it's the same bug, then it's better to look in lp if it's opened already, in channel - if there are alarms, and if not - you won the opportunity to fill the bug first." | 12:25 |
| bogdando | sshnaidm: ^^ | 12:26 |
| *** chlong has quit IRC | 12:26 | |
| bogdando | and once I get a solution, perhaps making it publicly available for other contributors | 12:26 |
| bogdando | as rss feeds for a job of a day | 12:27 |
| bogdando | gate/periodic only. to catch regressions via scoped subject area channels | 12:27 |
| sshnaidm | bogdando, if will be possible to subscribe to rss of container gate jobs - go for it, I don't see any problems with it | 12:27 |
| bogdando | sshnaidm: I couldn't find how | 12:27 |
| *** agopi has joined #tripleo | 12:28 | |
| sshnaidm | bogdando, how - to subscribe to rss? | 12:28 |
| skramaja | could someone review https://review.openstack.org/#/c/468390/, which provides an option to overide plan-environment file? | 12:28 |
| bogdando | sshnaidm: to get the link for that job =) | 12:28 |
| bogdando | from openstack health page or other places | 12:29 |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Properly support upper-constraints https://review.openstack.org/476495 | 12:29 |
| *** jpena is now known as jpena|lunch | 12:29 | |
| sshnaidm | bogdando, I think I've already replied to that :) | 12:30 |
| jtomasek | honza: I wonder why isn't this being verified by CI, do I miss something? https://review.openstack.org/#/c/462230/11 | 12:31 |
| jtomasek | honza: I don't see it queued in zuul | 12:31 |
| honza | jtomasek: I was wondering the same thing | 12:31 |
| EmilienM | sshnaidm, bogdando: yeah I don't find container job either | 12:32 |
| EmilienM | http://status.openstack.org/openstack-health/#/?groupKey=build_name&resolutionKey=day&searchProject=container | 12:32 |
| *** rlandy has joined #tripleo | 12:32 | |
| sshnaidm | EmilienM, as ovb-ha-ooq too | 12:33 |
| *** pgadiya has quit IRC | 12:34 | |
| *** myoung has joined #tripleo | 12:34 | |
| *** flepied has quit IRC | 12:36 | |
| *** cylopez has quit IRC | 12:37 | |
| jtomasek | honza: do you mind if I update the PlanCard slightly (in subsequent patch) to look something like this? http://storage6.static.itmages.com/i/17/0622/h_1498135141_7063804_1596d189f5.png | 12:40 |
| honza | jtomasek: nope :) | 12:40 |
| jtomasek | honza: ok | 12:41 |
| honza | jtomasek: lol if you think i have design skills :) | 12:41 |
| jtomasek | :) | 12:41 |
| mcornea | therve: ok, I'm ready to trigger the upgrade attempt. I set debug to true in heat.conf. Anything else I should prepare before? | 12:41 |
| therve | mcornea, Let me think a little bit. We need a good amount of debug logs | 12:42 |
| *** dsariel has joined #tripleo | 12:44 | |
| *** limao has joined #tripleo | 12:45 | |
| *** rbowen has joined #tripleo | 12:45 | |
| *** jayg|g0n3 is now known as jayg | 12:45 | |
| *** ffiore has joined #tripleo | 12:45 | |
| *** morazi has joined #tripleo | 12:46 | |
| *** ramishra has quit IRC | 12:46 | |
| *** ramishra has joined #tripleo | 12:48 | |
| EmilienM | mandre, jistr, dprince : I see container jobs (both multinode + ovb) are passing today - should we make them voting now? | 12:51 |
| therve | mcornea, OK! I think we should be good to go | 12:53 |
| mcornea | therve: alright, I'm starting it | 12:53 |
| EmilienM | sshnaidm: hey, how do you get graphs on https://status-tripleoci.rhcloud.com/ ? i don't see them now | 12:54 |
| yolanda | hi, i tried to cancel a heat update, using heat-cancel-update command. but now it seems to be forever in rollback_in_process status. How can i recover? | 12:54 |
| *** gkadam has quit IRC | 12:55 | |
| sshnaidm | EmilienM, try to reload, I see them | 12:55 |
| *** tzumainn has joined #tripleo | 12:56 | |
| *** tzumainn has quit IRC | 12:57 | |
| *** jmelvin has joined #tripleo | 12:57 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: configure the undercloud to use nameservers from virthost https://review.openstack.org/475878 | 12:57 |
| *** tzumainn has joined #tripleo | 12:57 | |
| EmilienM | sshnaidm: I had to click on "Load unsafe scripts" in Chrome ! | 12:58 |
| *** limao has quit IRC | 12:58 | |
| sshnaidm | EmilienM, wow.. google consider its own framework as unsafe | 12:59 |
| EmilienM | sshnaidm: :D | 12:59 |
| *** limao has joined #tripleo | 13:00 | |
| EmilienM | jistr: also do you know the status of gate-tripleo-ci-centos-7-scenario00X-multinode-oooq-container jobs recently? | 13:00 |
| *** pradk has quit IRC | 13:02 | |
| *** sid1 has quit IRC | 13:03 | |
| *** rbrady has joined #tripleo | 13:03 | |
| *** rbrady has quit IRC | 13:03 | |
| *** rbrady has joined #tripleo | 13:03 | |
| therve | mcornea, OK got the error | 13:03 |
| *** f13o has quit IRC | 13:04 | |
| mcornea | therve: cool, what was it? | 13:04 |
| therve | mcornea, Invalid condition "server_not_blacklisted" | 13:04 |
| *** Guest250 is now known as rook | 13:06 | |
| therve | I think I got it | 13:08 |
| *** abhishek has joined #tripleo | 13:08 | |
| *** sid1 has joined #tripleo | 13:09 | |
| *** psahoo has quit IRC | 13:10 | |
| EmilienM | mandre, jistr, dprince: https://review.openstack.org/476510 please review | 13:10 |
| *** athomas has joined #tripleo | 13:13 | |
| EmilienM | sshnaidm, bogdando: I tried to ping mtreinish who did openstack-health about the issue we have (yesterday) but got no response so far | 13:13 |
| EmilienM | I'll try again today | 13:13 |
| EmilienM | I'm not sure why this data is not collected | 13:14 |
| sshnaidm | yeah, data is collected very selectively | 13:14 |
| *** bfournie has joined #tripleo | 13:15 | |
| *** ffiore_ has joined #tripleo | 13:16 | |
| *** ffiore has quit IRC | 13:16 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Update constraints support https://review.openstack.org/476211 | 13:17 |
| *** f13o has joined #tripleo | 13:18 | |
| *** pradk has joined #tripleo | 13:22 | |
| EmilienM | sshnaidm, bogdando: I think I found it | 13:23 |
| EmilienM | sshnaidm, bogdando: I think OpenStack Health doesn't collect logs from -nv & also third party ci jobs | 13:24 |
| EmilienM | only gate + periodic | 13:24 |
| sshnaidm | EmilienM, you know.. I think it collects only gate, but not *check* jobs | 13:24 |
| *** sasha2 has joined #tripleo | 13:24 | |
| EmilienM | yes it makes sense now | 13:25 |
| sshnaidm | EmilienM, we don't have ovb jobs in gates | 13:25 |
| EmilienM | I remember what Matt told me a few months (years?) ago | 13:25 |
| EmilienM | right | 13:25 |
| *** sasha2 has left #tripleo | 13:25 | |
| EmilienM | so for containers, we just need to move it in gate ,like I'm doing in https://review.openstack.org/472536 | 13:25 |
| EmilienM | but for OVB, we might need to patch openstack-health | 13:25 |
| EmilienM | and maybe collect check-tripleo | 13:26 |
| sshnaidm | EmilienM, it should be in "gate" pipeline | 13:26 |
| *** zoli|lunch is now known as zoli|wfh | 13:26 | |
| EmilienM | sshnaidm: what should be in gate pipeline? | 13:27 |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 13:27 |
| EmilienM | I don't think it's possible | 13:27 |
| sshnaidm | EmilienM, any job for o.health | 13:27 |
| EmilienM | (to hav ovb in gate) | 13:27 |
| sshnaidm | EmilienM, exactly | 13:27 |
| sshnaidm | I was asking a month ago about jobs monitoring on infra, there is some graphite server which collects statistics, but I didn't find how to get status and link to logs from there | 13:29 |
| sshnaidm | there is also gerrit even streamer, not sure if it's helpful too | 13:29 |
| EmilienM | sshnaidm: not having ovb in health is not critical imho | 13:29 |
| EmilienM | sshnaidm: at least for promotion pipeline | 13:29 |
| sshnaidm | EmilienM, just weird that we don't have such interface.. | 13:29 |
| EmilienM | for rss it would have been useful | 13:30 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: CI test - never merge https://review.openstack.org/461000 | 13:30 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: CI test - never merge https://review.openstack.org/461000 | 13:30 |
| therve | mcornea, So the source is probably https://review.openstack.org/#/c/475003/ | 13:31 |
| therve | Because of a heat bug I suspect, but that doesn't work | 13:31 |
| therve | EmilienM, ^^^ source of upgrade breakage | 13:32 |
| *** Goneri has joined #tripleo | 13:32 | |
| *** jpena|lunch is now known as jpena | 13:32 | |
| mwhahaha | therve: shall we revert in the mean time then? | 13:33 |
| therve | mwhahaha, That's probably the quickest path yeah. | 13:33 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add a validation that checks for available update https://review.openstack.org/476517 | 13:33 |
| mwhahaha | therve: is there an existing bug we can reference? | 13:33 |
| therve | If there is a heat fix it still needs to be promoted and all | 13:33 |
| therve | mwhahaha, No https://bugs.launchpad.net/tripleo/+bug/1699463 is our source for now | 13:34 |
| openstack | Launchpad bug 1699463 in tripleo "6 upgrade jobs (cont. and non-cont.) stuck on UpgradeInitDeployment, SoftwareDeployment resources signals get response code 400" [Critical,Triaged] | 13:34 |
| *** karthiks has quit IRC | 13:34 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Revert "Blacklist support for ExtraConfig" https://review.openstack.org/476519 | 13:35 |
| mwhahaha | therve: -^ | 13:35 |
| hjensas | therve: would that condition bug hit this as well? https://review.openstack.org/#/c/473817/15/network/ports/ctlplane_vip.yaml | 13:35 |
| therve | OK thanks | 13:35 |
| *** jlinkes has joined #tripleo | 13:35 | |
| therve | hjensas, Possibly, do you hit that in updates? | 13:36 |
| *** amoralej|lunch is now known as amoralej | 13:36 | |
| dciabrin | mandre, shardy ping, if you have some time for looking at https://review.openstack.org/#/c/476486, that would be awesome :) | 13:36 |
| hjensas | therve: gate-tripleo-ci-centos-7-ovb-updates job passed for that change. | 13:36 |
| therve | hjensas, I think it's upgrade? not sure | 13:36 |
| *** dsariel has quit IRC | 13:36 | |
| *** chem has joined #tripleo | 13:36 | |
| *** liverpooler has joined #tripleo | 13:37 | |
| *** chlong has joined #tripleo | 13:38 | |
| hjensas | therve: ok, gate-tripleo-ci-centos-7-multinode-upgrades-nv failed. But not sure if it is the same issue. what do I look for to verify? | 13:39 |
| therve | hjensas, Hold. All upgrades are broken :) | 13:39 |
| therve | So right now, you wait for master to be fixed and then retry | 13:39 |
| hjensas | therve: :) ok. | 13:39 |
| EmilienM | therve: in a call, brb | 13:40 |
| *** limao has quit IRC | 13:45 | |
| weshay | jrist, ping.. re: the undercloud install error | 13:47 |
| weshay | jrist, did you get through it? | 13:48 |
| *** rbrady is now known as rbrady-brb | 13:48 | |
| *** mrchao has quit IRC | 13:48 | |
| *** gbarros has joined #tripleo | 13:50 | |
| *** karthiks has joined #tripleo | 13:50 | |
| jpich | honza: Would it be possible to use a separate queue dedicated to logging, or doesn't really fit? | 13:50 |
| honza | jpich: yes, i think that's a good idea | 13:50 |
| honza | jpich: i have been trying to avoid it because it'll require additional configuration but yeah it seems to make sense given today's developments | 13:51 |
| adarazs | EmilienM, trown, sshnaidm, weshay, hrybacki, panda, rlandy, arxcruz jistr: CI Squad meeting in ~37 minutes, I see a bunch of agenda items already, but add more if you have something: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting -- see you there :) | 13:53 |
| jpich | honza: Oh, what kind of configuration? I know the CLI uses a bunch of different queues for messages so I thought it'd be lightweight | 13:53 |
| jpich | honza: also thanks for the tips on how to test code as "prod" :) | 13:53 |
| *** karimb has quit IRC | 13:53 | |
| honza | jpich: tripleo_ui_config.js + puppet-tripleo, and everything else can probably be done with defaults (mistral workflows) | 13:54 |
| jpich | honza: aaah I see, of course | 13:54 |
| honza | jpich: I should probably add that to our "developer" docs | 13:54 |
| jpich | honza: Great idea! | 13:55 |
| *** jokke__ is now known as jokke_ | 13:55 | |
| jrist | weshay: nope | 13:56 |
| jrist | weshay: fired it up again with just --master | 13:56 |
| jrist | no dice | 13:56 |
| jrist | weshay: that said, I can get to the undercloud machine | 13:56 |
| jrist | but nothing is running and it's not sueful | 13:56 |
| *** limao has joined #tripleo | 13:56 | |
| jrist | useful | 13:56 |
| weshay | jrist, can you chunk.io the undercloud_install.log | 13:57 |
| weshay | jrist, I suspect you are hitting dns issues | 13:57 |
| jrist | weshay: from the vm? | 13:57 |
| *** jcoufal has joined #tripleo | 13:58 | |
| jrist | hmm I think you're right | 13:58 |
| jrist | 2017-06-21 18:53:00 | 2017-06-21 18:53:00,936 INFO: 14: curl#7 - "Failed to connect to 2604:1580:fe02:2::10: Network is unreachable" | 13:58 |
| *** lblanchard has joined #tripleo | 13:58 | |
| *** fzdarsky has quit IRC | 13:59 | |
| weshay | jrist, what is your quickstart.sh command? | 13:59 |
| weshay | may need to add a dns server you know to work w/ -e undercloud_undercloud_nameservers=<dns_server_ip> | 14:00 |
| jrist | [toor@galena ~]$ ./tripleo-quickstart/quickstart.sh --release master --no-clone --clean 127.0.0.2 --ansible-debug or [toor@galena ~]$ ./tripleo-quickstart/quickstart.sh --release master-ci --no-clone --clean 127.0.0.2 --ansible-debug | 14:00 |
| weshay | jrist, google is ratelimiting 8.8.8.8 and 8.8.4.4. | 14:00 |
| *** fzdarsky has joined #tripleo | 14:00 | |
| jrist | sadface | 14:00 |
| *** jbadiapa_ has quit IRC | 14:01 | |
| *** rhallisey has quit IRC | 14:04 | |
| *** rhallisey has joined #tripleo | 14:05 | |
| *** rbrady-brb is now known as rbrady | 14:07 | |
| *** dciabrin has quit IRC | 14:08 | |
| *** sid1 has quit IRC | 14:08 | |
| *** atheurer has joined #tripleo | 14:08 | |
| jrist | weshay: will try that | 14:10 |
| *** athomas has quit IRC | 14:10 | |
| *** aufi has quit IRC | 14:11 | |
| jrist | weshay: can that be comma separated? | 14:11 |
| jrist | -e undercloud_undercloud_nameservers=209.244.0.3,209.244.0.4 | 14:12 |
| *** myoung has quit IRC | 14:12 | |
| *** sid1 has joined #tripleo | 14:13 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Create a file for indexing it in logstash https://review.openstack.org/473095 | 14:15 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Deploy ironic-api with WSGI https://review.openstack.org/473456 | 14:15 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add option to copy ready cirros images from directory https://review.openstack.org/475479 | 14:15 |
| *** jbadiapa_ has joined #tripleo | 14:16 | |
| *** karthiks has quit IRC | 14:16 | |
| sshnaidm | EmilienM, fyi: https://review.openstack.org/#/c/476524/ | 14:17 |
| bnemec | hjensas: Not sure if you saw this, but https://review.openstack.org/#/c/476211/ should fix the instack-undercloud test failures. | 14:17 |
| *** jbadiapa_ has quit IRC | 14:18 | |
| *** skramaja has quit IRC | 14:18 | |
| *** jbadiapa_ has joined #tripleo | 14:18 | |
| hjensas | bnemec: I saw it. Works for me. :) | 14:20 |
| EmilienM | sshnaidm: looking | 14:20 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates stable/newton: WIP: ensure nova migration package is installed during minor update https://review.openstack.org/476534 | 14:22 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Deploy ironic-api with WSGI https://review.openstack.org/473457 | 14:22 |
| *** dsariel has joined #tripleo | 14:22 | |
| weshay | jrist, yes it should and we have a fix on the way https://review.openstack.org/#/q/topic:virthost-nameserver | 14:22 |
| b00tcat | Hi all, I realized that I can't boot UEFI-enabled hosts with the default files in /tftpboot - is there special EFI file that I have to download in order to boot the baremetal servers? | 14:22 |
| *** dciabrin has joined #tripleo | 14:23 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP: change devmode to deploy containerized services by default https://review.openstack.org/472412 | 14:23 |
| *** mburned has quit IRC | 14:25 | |
| *** mburned has joined #tripleo | 14:25 | |
| *** aufi has joined #tripleo | 14:29 | |
| jprovazn | dsneddon, hi, ping when you are around | 14:30 |
| jrist | weshay: nice, thanks | 14:32 |
| *** ykarel_ has quit IRC | 14:32 | |
| adarazs | EmilienM, hrybacki, jistr: CI squad meeting starting | 14:32 |
| *** sid2 has joined #tripleo | 14:33 | |
| EmilienM | adarazs: on my way | 14:34 |
| *** ffiore_ has quit IRC | 14:34 | |
| *** sid1 has quit IRC | 14:35 | |
| jrist | weshay: trying with that DNS command. thanks! | 14:37 |
| trozet | mwhahaha: hey, do you have a minute to talk about that odl patch to lock the step? | 14:39 |
| mwhahaha | trozet: what's up? | 14:39 |
| trozet | mwhahaha: did you have a chance to see my response in https://review.openstack.org/#/c/475819/ | 14:39 |
| mwhahaha | trozet: yea, i did. so the problem i would have is that what happens with updates | 14:40 |
| mwhahaha | trozet: as that would still suffer from the same problem | 14:40 |
| trozet | mwhahaha: ODL doesnt support update right now :/ | 14:40 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Document how to test a production build https://review.openstack.org/476537 | 14:40 |
| mwhahaha | trozet: right that's a problem | 14:40 |
| trozet | mwhahaha: but im also looking here for your perspective | 14:40 |
| trozet | mwhahaha: like another option is, I could always return the password, so we assume it is always set correctly and modifying the password isnt supported (but that seems like an even worse behavior) | 14:41 |
| *** janki has quit IRC | 14:41 | |
| trozet | mwhahaha: but it would make the whole operation idempotent | 14:41 |
| mwhahaha | trozet: let me poke at the odl code, is there a way to do a connectivity check with the user/password we could do? | 14:42 |
| *** dprince has quit IRC | 14:43 | |
| trozet | mwhahaha: there is. Take a look at the discussion in the ODL bug. One option is to curl the ODL REST interface, but that assumes ODL is up, and we have to know the port info. I suggested in the bug that we just interact with the DB tool directly | 14:44 |
| mwhahaha | trozet: at a minimum of being able to do a user check and we just document/prevent password changes would be best | 14:44 |
| trozet | mwhahaha: yeah we do the user check today | 14:44 |
| mwhahaha | trozet: so if we had that today, it shouldn't cause problems | 14:44 |
| trozet | mwhahaha: ok so until we have a way to check the password, you think the better option is to just prevent password change | 14:44 |
| *** dhill_ has joined #tripleo | 14:44 | |
| mwhahaha | trozet: yea | 14:44 |
| trozet | mwhahaha: ok, I can push that fix to puppet-opendaylight and abandon this one | 14:45 |
| trozet | mwhahaha: thanks for the input! | 14:45 |
| *** jpena is now known as jpena|brb | 14:45 | |
| *** links has quit IRC | 14:45 | |
| mwhahaha | trozet: fyi here's how we do the passwor dcheck bit for keystone, https://github.com/openstack/puppet-keystone/blob/master/lib/puppet/provider/keystone_user/openstack.rb#L105 | 14:46 |
| *** ffiore_ has joined #tripleo | 14:47 | |
| trozet | mwhahaha: thanks I will look att his | 14:47 |
| *** katkapilatova has left #tripleo | 14:47 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-specs master: WIP: A unified tool for upgrading TripleO based deploments https://review.openstack.org/476539 | 14:48 |
| *** fragatina has joined #tripleo | 14:49 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-specs master: WIP: A unified tool for upgrading TripleO based deploments https://review.openstack.org/476539 | 14:49 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Change default DNS name server https://review.openstack.org/474334 | 14:50 |
| *** fragatina has quit IRC | 14:50 | |
| dpawar | mwhahaha: Hi, we have follwoing reviews https://review.openstack.org/#/c/475765/ , https://review.openstack.org/#/c/475762/7, https://review.openstack.org/#/c/475758 | 14:52 |
| mwhahaha | dpawar: if they are ready for review, please lift the -1 wip | 14:53 |
| fultonj | d0ugal: do you have a few cycles to review https://review.openstack.org/#/c/475952/ ? | 14:53 |
| dpawar | mwhahaha: i was trying to call these using method mentioned at https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/cinder_netapp.html | 14:54 |
| dpawar | it did not work | 14:54 |
| mwhahaha | dpawar: ok i'll take a look in a bit (in meeting) | 14:54 |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-specs master: WIP: A unified tool for upgrading TripleO based deploments https://review.openstack.org/476539 | 14:54 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates stable/newton: Install openstack-nova-migration on computes during M->N upgrade https://review.openstack.org/476542 | 14:55 |
| *** marios has quit IRC | 14:56 | |
| dpawar | mwhahaha: thanks | 14:56 |
| openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: adding --config-dir parameters to neutron containers https://review.openstack.org/476544 | 15:02 |
| jrist | weshay: http://paste.openstack.org/show/613406/ - that -e didn't work | 15:02 |
| *** MrRoot has joined #tripleo | 15:02 | |
| *** jbadiapa_ has quit IRC | 15:02 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 15:04 |
| *** dciabrin has quit IRC | 15:04 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Bind GlanceApiNetwork on internal_api network https://review.openstack.org/476548 | 15:05 |
| EmilienM | trozet: ^ fyi | 15:05 |
| EmilienM | trozet: oops I missed your patch | 15:06 |
| trozet | EmilienM: yeah | 15:06 |
| EmilienM | trozet: it wasn't in launchpad | 15:06 |
| trozet | EmilienM: hmm weird | 15:06 |
| mwhahaha | dpawar: do you have a specific error that you're encountering? Since you listed a bunch of other deps, you may want to look at http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html as ways to get your other puppet module changes in place for testing | 15:07 |
| trozet | EmilienM: weird thing is our tempest tests in OPNFV caught this, but only when we switched to using V3 creds. I'm not sure why. I'm not sure which endpoint keystone public auth uri will map to for glance api | 15:07 |
| *** ebarrera has quit IRC | 15:07 | |
| trozet | EmilienM: or how it is different from V2 creds...i need to figure that out | 15:08 |
| sai | bnemec: hey, when im scaling up compute nodes, do u know if the nova-compute process on pre-existing computes is bounced? | 15:08 |
| dtantsur | can someone knowing about containers please jump on the discussion at https://review.openstack.org/#/c/457822/8/docker/services/ironic-inspector.yaml@74 ? | 15:08 |
| dtantsur | I don't quite understand what I should do there.. | 15:08 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Make collectd log to file https://review.openstack.org/475808 | 15:09 |
| *** rcernin has quit IRC | 15:09 | |
| EmilienM | trozet: not sure | 15:09 |
| *** yamahata has joined #tripleo | 15:10 | |
| *** karimb has joined #tripleo | 15:10 | |
| *** pblaho has quit IRC | 15:10 | |
| *** yprokule has quit IRC | 15:10 | |
| *** yprokule_ has joined #tripleo | 15:11 | |
| *** yprokule_ has quit IRC | 15:11 | |
| *** yprokule_ has joined #tripleo | 15:11 | |
| *** yprokule_ is now known as yprokule | 15:12 | |
| EmilienM | mcornea: nice catch on https://bugs.launchpad.net/tripleo/+bug/1699443 | 15:12 |
| openstack | Launchpad bug 1699443 in tripleo "Ocata -> Pike overcloud upgrade: heat-api services are running both under systemd and docker containers" [High,Triaged] | 15:12 |
| EmilienM | mcornea: we need some ansible playbook to stop the services during the upgrade process | 15:12 |
| EmilienM | mcornea: in THT | 15:12 |
| *** aufi has quit IRC | 15:12 | |
| *** pchavva has joined #tripleo | 15:13 | |
| *** rbowen has quit IRC | 15:13 | |
| pradk | can i please get some feedback on https://review.openstack.org/#/c/467713/ | 15:16 |
| EmilienM | bnemec: if you can add https://review.openstack.org/#/c/469474 do your review list, please | 15:16 |
| *** dciabrin has joined #tripleo | 15:17 | |
| *** jbadiapa_ has joined #tripleo | 15:17 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 15:19 |
| *** f13o has quit IRC | 15:19 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 15:20 |
| d0ugal | fultonj: sure, looking now | 15:20 |
| fultonj | d0ugal: thanks | 15:20 |
| jrist | dtrainor: any thoughts on this dns thing? | 15:21 |
| jrist | [toor@galena ~]$ ./tripleo-quickstart/quickstart.sh --release master-tripleo-ci --no-clone --clean 127.0.0.2 -e undercloud_undercloud_nameservers=209.244.0.3 | 15:21 |
| jrist | that fails ^ | 15:21 |
| jrist | eventually it complains cp: cannot stat '/usr/lib64/python2.7/site-packages/_selinux.so': No such file or directory | 15:21 |
| *** adarazs_ has joined #tripleo | 15:21 | |
| jrist | Usage: ./tripleo-quickstart/quickstart.sh --install-deps | 15:21 |
| jrist | and then just lists out the help | 15:21 |
| dtrainor | i have not encountered that one, let me check something | 15:21 |
| weshay | jrist, try w/ just one dns server | 15:22 |
| weshay | jrist, question.. tripleo-ui is moving to a container ya? | 15:22 |
| jrist | I did | 15:22 |
| weshay | hrm | 15:22 |
| jrist | weshay: no | 15:22 |
| weshay | jrist, can you paste the error you are getting | 15:22 |
| jrist | I did | 15:22 |
| jrist | <jrist> weshay: http://paste.openstack.org/show/613406/ - that -e didn't work | 15:22 |
| dtrainor | can you try specifying the virthost as the last argument? | 15:23 |
| weshay | jrist, postition matters.. -e must come before the virthost 127.0.0.2 | 15:23 |
| jrist | ah | 15:23 |
| jrist | take 3 action | 15:23 |
| *** dciabrin has quit IRC | 15:23 | |
| *** oidgar has quit IRC | 15:23 | |
| weshay | this time w/ more LOVE | 15:23 |
| jrist | sheesh | 15:24 |
| jrist | 100% love here | 15:24 |
| weshay | give me EMOTION MAN | 15:24 |
| jrist | can't give it any more! | 15:24 |
| weshay | bah.. SCENE! perfect | 15:24 |
| jrist | lol | 15:24 |
| jrist | ok imma let that run while I go get my teeth drilled on | 15:24 |
| jrist | thanks weshay | 15:24 |
| dtrainor | jrist, can you paste the output of: rpm -qi --queryformat '%{NAME}-%{VERSION}' libselinux-python | 15:25 |
| dtrainor | sorry, guess i'm oldschool... rpm -qa | grep libselinux-python | 15:25 |
| jrist | haha | 15:25 |
| jrist | old school | 15:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Test Horizon by default in multinode jobs https://review.openstack.org/474742 | 15:25 |
| jrist | libselinux-python-2.5-6.el7.x86_64 | 15:26 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove add_listen: false from Horizon hieradata https://review.openstack.org/472756 | 15:26 |
| dtrainor | there's an update out there | 15:26 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: TEST DO NOT MERGE https://review.openstack.org/476600 | 15:26 |
| jrist | orly | 15:26 |
| dtrainor | i'm at libselinux-python-2.6-6.fc26.x86_64 | 15:26 |
| dtrainor | prob not related but, maybe probably idk. not familiar enough with oooq yet | 15:26 |
| jrist | k | 15:27 |
| jrist | it's making it further right now | 15:27 |
| jrist | so | 15:27 |
| jrist | I'll let you guys know when I get back! | 15:27 |
| *** jbadiapa_ has quit IRC | 15:27 | |
| *** sid1 has joined #tripleo | 15:29 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 15:29 |
| dpawar | mwhahaha: i did not get any error. but do not see veritas hyperscale attributes set in cinder.conf | 15:29 |
| *** jlinkes has quit IRC | 15:30 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add network/cidr mapping into ServiceNetMap https://review.openstack.org/476602 | 15:30 |
| *** akane has joined #tripleo | 15:31 | |
| trozet | dprince: can you please review https://review.openstack.org/#/c/466920/ ? | 15:31 |
| *** sid2 has quit IRC | 15:31 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: Add Ironic services to containerized deployment https://review.openstack.org/476603 | 15:32 |
| mwhahaha | dpawar: can you provide the logs for the deployment? | 15:32 |
| EmilienM | bogdando: can you help me to figure out why sahara is not containerized in http://logs.openstack.org/00/461000/24/experimental/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container/db5a3e6/logs/subnode-2/var/log/containers/ ? | 15:32 |
| *** ccamacho has quit IRC | 15:33 | |
| EmilienM | bogdando: it sounds like it's deployed on the host outside a container: http://logs.openstack.org/00/461000/24/experimental/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container/db5a3e6/logs/subnode-2/var/log/sahara/ | 15:33 |
| EmilienM | bogdando: see http://logs.openstack.org/00/461000/24/experimental/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container/db5a3e6/logs/subnode-2/var/log/host_info.txt.gz | 15:33 |
| EmilienM | bogdando: i'm wondering if the environment used is correct | 15:34 |
| therve | mwhahaha, So we have identified the issue, need some time to have a test and fix it | 15:34 |
| EmilienM | jistr: any idea? | 15:34 |
| bnemec | EmilienM: Reviewed. That won't actually work, but at least we're getting closer to being able to do the thing that will. | 15:34 |
| mwhahaha | therve: ok | 15:34 |
| therve | mwhahaha, It affects conditions usage in properties during upgrades, FWIW | 15:35 |
| bogdando | EmilienM: indeed, its configured non-docker https://review.openstack.org/#/c/461000/24/ci/environments/scenario003-multinode.yaml@5 | 15:35 |
| bogdando | IIUC | 15:36 |
| dtantsur | (that's me again) mind also checking https://review.openstack.org/#/c/473896/ ? this (and an ocata backport to follow) make sure users don't need to log into controllers and run commands there to run ironic | 15:36 |
| dtantsur | especially someone knowing about nova ^^^ | 15:36 |
| bogdando | EmilienM: so those from lines 4 to 13 will run on host mode | 15:37 |
| *** cylopez has joined #tripleo | 15:37 | |
| EmilienM | bogdando: ah! | 15:37 |
| EmilienM | bogdando: so I need to change that I guess | 15:37 |
| bogdando | aye | 15:37 |
| *** jprovazn has quit IRC | 15:38 | |
| EmilienM | bogdando: is there someone working on the multinode scenarios containers? | 15:38 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Bump Ansible to version 2.3 https://review.openstack.org/476604 | 15:39 |
| dpawar | mwhahaha: i lost the logs. re-runnig the test. will be able to provide in 20 mins. | 15:39 |
| bogdando | weshay, ^^ ? do you know the answer by a chance? | 15:39 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Fix Ansible 2.3 bump breaking virt task https://review.openstack.org/470312 | 15:39 |
| mwhahaha | dpawar: ok i'm looking for the logs from the node that this runs on to see if the puppet actually gets executed | 15:40 |
| trown | adarazs: there is another patch besides hrybacki's? https://review.openstack.org/#/q/topic:ansible2.3 | 15:40 |
| *** dtantsur is now known as dtantsur|afk | 15:40 | |
| weshay | EmilienM, as in fixing them? | 15:40 |
| adarazs | trown: I think so, let me find it. | 15:41 |
| EmilienM | weshay: making them working first, and then moving them to the gate. They are in experimental pipeline now | 15:41 |
| EmilienM | weshay: and I don't see progress on making them working | 15:41 |
| EmilienM | weshay: they are critical | 15:41 |
| weshay | EmilienM, aye agree | 15:41 |
| dpawar | mwhahaha: any perticular log file ? or console logs ? | 15:42 |
| *** pcaruana has quit IRC | 15:42 | |
| mwhahaha | dpawar: the os-collect-config logs should have the details (ie journalctl -u os-collect-config > file.log) | 15:43 |
| adarazs | trown: this: https://review.openstack.org/#/c/458193/5/roles/libvirt/setup/undercloud/tasks/main.yml | 15:43 |
| adarazs | trown: one is for the undercloud, the other for the supplemental. | 15:43 |
| hrybacki | thanks for reminding me about that trown :P | 15:43 |
| trown | adarazs: ah I see, I should have just reverted the revert, it was part of the original patch | 15:43 |
| trown | I will do that instead | 15:44 |
| adarazs | trown: yup. and so there were some problems with "when" conditions not evaluating properly with 2.3 I think, but a full-ci-check should bring those out I think. | 15:44 |
| *** adarazs has quit IRC | 15:45 | |
| *** adarazs_ is now known as adarazs | 15:45 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Revert "Revert "Bump Ansible to 2.3"" https://review.openstack.org/476607 | 15:46 |
| panda | I don't want to change everyone's backlog, point me at those errors and I'll fix them | 15:46 |
| panda | it is mainly blocking for me | 15:46 |
| trown | panda: ya I am not commiting to fixing things :P | 15:46 |
| trown | just putting back up the patch | 15:46 |
| *** rbowen has joined #tripleo | 15:46 | |
| adarazs | I'll try to find what was really wrong. | 15:46 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Fix Ansible 2.3 bump breaking virt task https://review.openstack.org/470312 | 15:47 |
| panda | also there was no time to discuss it, but what's our position in pulling external roles to quickstart-extras ? | 15:47 |
| *** pliu has quit IRC | 15:47 | |
| *** yprokule has quit IRC | 15:48 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix fallback logic in run-os-net-config.sh https://review.openstack.org/476280 | 15:48 |
| trown | panda: k, https://review.openstack.org/#/c/470312/ will have results just base fixes on top of that :) | 15:48 |
| *** pliu has joined #tripleo | 15:48 | |
| trown | panda: wdym? | 15:48 |
| *** yprokule has joined #tripleo | 15:48 | |
| panda | one of the source of problems is ansible-role-kolla-build. I need it for the container periodic and it needs 2.3 to work properly | 15:48 |
| trown | ie what are external roles? | 15:48 |
| trown | ah | 15:48 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK Derive parameters workflow https://review.openstack.org/468989 | 15:49 |
| panda | also 2.2 doesn't output at all image building errors, and I'm killing myself in reproducing the upstream ci error in building right now | 15:49 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: [WIP] Deploy Ceph using ceph-ansible via external workflow https://review.openstack.org/465066 | 15:49 |
| panda | "image build failed" that's all in 2.2 | 15:49 |
| trown | I dont see why we couldnt import the kolla build role to extras... assuming dmsimard is ok with taht | 15:50 |
| trown | or is the question different | 15:50 |
| panda | trown: no, this is the question | 15:50 |
| dmsimard | I need to double check if it does need 2.3 | 15:50 |
| *** bogdando has quit IRC | 15:51 | |
| panda | dmsimard: I need 2.3 for other reasons too, like the image build output | 15:51 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: scenario003: containerize services for CI https://review.openstack.org/476609 | 15:52 |
| dmsimard | trown, panda: I don't have a strong opinion on where the role lives -- I do think it's something that is generic and can and is used independently of tripleo/tripleo-quickstart however | 15:52 |
| adarazs | trown: I think actually the only other problem was that "ansible_user" that was not populated for localhost in the OVB devmode case. so if you have time please run a devmode.sh --ovb --no-gate --delete-all-stacks with the change too. but I think we fixed that. | 15:52 |
| dmsimard | need to brb, picking up kid at school | 15:52 |
| yolanda | hi, suddenly i cannot deploy OSP8 any more: Error: Invalid parameter transport on Class[Nova::Migration::Libvirt] at /var/lib/heat-config/heat-config-puppet/e3e75ce9-42cb-4706-b12f-72af33debe56.pp:127 on node overcloud-compute-0.localdomain | 15:52 |
| yolanda | is there some known problem? | 15:52 |
| EmilienM | jistr: when you're around, can you maybe quickly look https://review.openstack.org/#/c/476609/ please? | 15:52 |
| adarazs | dmsimard, panda: btw, did you think about making at least a few container builds parallel? it might speed things up (or crash the VM/host. :) | 15:54 |
| adarazs | ansible should be able to do that. | 15:54 |
| *** jaganathan has quit IRC | 15:54 | |
| *** dprince has joined #tripleo | 15:54 | |
| dmsimard | adarazs: see my comment in https://review.rdoproject.org/r/7175 | 15:54 |
| dmsimard | I even blogged about it :) https://dmsimard.com/2017/05/10/limiting-the-amount-of-concurrent-asynchronous-tasks-in-ansible/ | 15:55 |
| adarazs | dmsimard: cool stuff! you're one step ahead. and it seems it was far from trivial, heh :) | 15:57 |
| adarazs | dmsimard: congrats for figuring it out. | 15:57 |
| *** rbowen has quit IRC | 15:58 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 16:00 |
| *** jpena|brb is now known as jpena | 16:01 | |
| *** egonzalez has quit IRC | 16:03 | |
| *** gbarros has quit IRC | 16:03 | |
| *** nyechiel_ has quit IRC | 16:08 | |
| *** jpich has quit IRC | 16:08 | |
| dpawar | mwhahaha: http://paste.openstack.org/show/613411/ | 16:08 |
| *** jschlueter has joined #tripleo | 16:08 | |
| dpawar | mwhahaha: "grep -i veritas /var/lib/heat-config/heat-config-puppet/* " do not show anything | 16:09 |
| jschlueter | question in openstack overcloud deploy is there a way to specify if it should be enforcing or permissive mode for selinux? | 16:09 |
| *** karimb has quit IRC | 16:10 | |
| mwhahaha | dpawar: what was the deploy command line? | 16:10 |
| *** dparkes has quit IRC | 16:10 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: [WIP] Copy only generated puppet files into the container https://review.openstack.org/476153 | 16:11 |
| *** jschluet has joined #tripleo | 16:12 | |
| *** ffiore_ has quit IRC | 16:12 | |
| mwhahaha | dpawar: that log also seemed to have been truncated, so not sure. it seems to point something not being properly configured in the deploy but i'm not seeing anything at the moment. I have to run but i'll look at the reviews later to see if i can spot anything | 16:12 |
| *** agurenko has quit IRC | 16:13 | |
| dpawar | mwhahaha: http://paste.openstack.org/show/613412/ | 16:13 |
| *** ramishra has quit IRC | 16:14 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Ensure the tripleo-ui-config.js file exits prior to modifying https://review.openstack.org/476613 | 16:15 |
| mwhahaha | dpawar: ok i'll take a look when i get back. i don't see anything specific at the moment. i'll let you know | 16:15 |
| *** oidgar has joined #tripleo | 16:19 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: TEST DO NOT MERGE https://review.openstack.org/476600 | 16:20 |
| dpawar | mwhahaha: thanks! i am located in India so would be going offline now. could you please comment on https://review.openstack.org/#/c/475762/7 ? | 16:22 |
| *** thrash is now known as thrash|biab | 16:22 | |
| *** gbarros has joined #tripleo | 16:22 | |
| weshay | EmilienM, ping.. where are the puppet jobs executed from toci? | 16:27 |
| weshay | ya.. nvrmind | 16:28 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fixes incorrect glance api network https://review.openstack.org/476185 | 16:29 |
| *** snecklifter has quit IRC | 16:30 | |
| *** dprince has quit IRC | 16:31 | |
| *** yprokule has quit IRC | 16:31 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add network/cidr mapping into ServiceNetMap https://review.openstack.org/476602 | 16:31 |
| *** social has quit IRC | 16:32 | |
| *** jschlueter has quit IRC | 16:34 | |
| *** jschluet is now known as jschlueter | 16:34 | |
| *** social has joined #tripleo | 16:35 | |
| *** dpawar has quit IRC | 16:38 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: update toci to use --environment and --nodes options in quickstart https://review.openstack.org/475930 | 16:39 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 16:39 |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: Implement scenario006 with Ironic in overcloud https://review.openstack.org/474802 | 16:41 |
| *** akane has quit IRC | 16:43 | |
| *** fultonj has quit IRC | 16:45 | |
| *** pkovar has quit IRC | 16:47 | |
| *** lucasagomes is now known as lucas-afk | 16:49 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Implement Zaqar logger adapter https://review.openstack.org/459294 | 16:50 |
| *** myoung has joined #tripleo | 16:51 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Copy only generated puppet files into the container https://review.openstack.org/476153 | 16:52 |
| openstackgerrit | Assaf Muller proposed openstack/tripleo-quickstart master: Add libselinux-python to bindep requirements https://review.openstack.org/476626 | 16:52 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add network/cidr mapping into ServiceNetMap https://review.openstack.org/476602 | 16:52 |
| *** fultonj has joined #tripleo | 16:53 | |
| *** yamahata has quit IRC | 17:00 | |
| *** derekh has quit IRC | 17:05 | |
| *** ggillies_ has quit IRC | 17:05 | |
| *** trown is now known as trown|lunch | 17:06 | |
| *** ggillies has joined #tripleo | 17:07 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: TEST DO NOT MERGE https://review.openstack.org/476600 | 17:07 |
| *** cylopez has quit IRC | 17:08 | |
| *** agopi has quit IRC | 17:08 | |
| *** dparkes has joined #tripleo | 17:08 | |
| *** akrivoka has quit IRC | 17:11 | |
| *** oidgar has quit IRC | 17:12 | |
| openstackgerrit | Luigi Toscano proposed openstack/tripleo-heat-templates master: Fix Sahara to use containers in a container scenario https://review.openstack.org/476634 | 17:12 |
| *** milan has quit IRC | 17:13 | |
| *** tosky has quit IRC | 17:13 | |
| *** pkovar has joined #tripleo | 17:15 | |
| *** jpena is now known as jpena|off | 17:17 | |
| *** sid1 has quit IRC | 17:17 | |
| *** agopi has joined #tripleo | 17:21 | |
| *** mcornea has quit IRC | 17:22 | |
| *** jlinkes has joined #tripleo | 17:24 | |
| *** jlinkes has quit IRC | 17:24 | |
| *** jaganathan has joined #tripleo | 17:25 | |
| *** jbadiapa_ has joined #tripleo | 17:26 | |
| *** pchavva has quit IRC | 17:28 | |
| *** fzdarsky is now known as fzdarsky|afk | 17:29 | |
| *** thrash|biab is now known as thrash | 17:29 | |
| *** anshul has quit IRC | 17:30 | |
| openstackgerrit | Merged openstack/tripleo-common master: Add tags and skip-tags options to Mistral Ansible actions https://review.openstack.org/475952 | 17:31 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add featureset for containerized undercloud https://review.openstack.org/476242 | 17:31 |
| sshnaidm | trown|lunch, can you review please in your time https://review.openstack.org/#/c/475197/ | 17:33 |
| *** tosky has joined #tripleo | 17:33 | |
| Slower | uh oh | 17:33 |
| Slower | detach: false isn't working.. | 17:33 |
| *** gbarros has quit IRC | 17:34 | |
| openstackgerrit | Ian Main proposed openstack/paunch master: Fix "detach: false" https://review.openstack.org/476641 | 17:37 |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK and Host derive parameters workflows https://review.openstack.org/468989 | 17:41 |
| *** yamahata has joined #tripleo | 17:41 | |
| *** pchavva has joined #tripleo | 17:44 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 17:45 |
| *** salmankhan has quit IRC | 17:45 | |
| sai | ping #tripleo how do i exit from the deeploy command if i know the scale up is going to fail (i ctrl+ced from the deploy command and restarted heat-engine). The stack is still stuck in UPDATE_IN_PROGRESS. How do I make it go into ERROR so I can retry the scale up? | 17:47 |
| *** jaganathan has quit IRC | 17:49 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Add libselinux-python to bindep requirements https://review.openstack.org/476626 | 17:50 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-common master: Add GUI logging workflows https://review.openstack.org/469196 | 17:52 |
| *** ykarel has joined #tripleo | 17:53 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Add Mistral workbook to call ceph-ansible to install Ceph https://review.openstack.org/469644 | 17:55 |
| *** dprince has joined #tripleo | 17:59 | |
| *** tesseract has quit IRC | 17:59 | |
| *** iranzo has quit IRC | 17:59 | |
| *** pkovar has quit IRC | 18:01 | |
| *** ykarel has quit IRC | 18:02 | |
| bnemec | sai: Sorry, missed your ping earlier. I think nova-compute should only be restarted if there is a configuration change that requires it. | 18:09 |
| *** gbarros has joined #tripleo | 18:10 | |
| *** gbarros has quit IRC | 18:10 | |
| bnemec | sai: Also, I thought restarting heat-engine was supposed to kick a stack into error status, so I'm not sure what else you could try. :-/ | 18:10 |
| sai | bnemec: np, thank u! | 18:10 |
| sai | bnemec: zaneb advised to heat-manage reset_stack_status | 18:11 |
| bnemec | Cool | 18:12 |
| Slower | stevebaker: ping | 18:13 |
| Slower | dprince: this could make for a lot of troubles.. : https://review.openstack.org/476641 | 18:14 |
| *** zoli|wfh is now known as zoli|gone | 18:14 | |
| *** limao_ has joined #tripleo | 18:15 | |
| *** limao has quit IRC | 18:15 | |
| *** limao_ has quit IRC | 18:17 | |
| *** limao has joined #tripleo | 18:17 | |
| EmilienM | weshay: did you find the answer? | 18:17 |
| weshay | EmilienM, the answer is 7 | 18:19 |
| fultonj | can https://review.openstack.org/#/c/475728 get restored? | 18:19 |
| fultonj | d0ugal: flaper87 ^ ? | 18:19 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: update toci to use --environment and --nodes options in quickstart https://review.openstack.org/475930 | 18:21 |
| weshay | EmilienM, ya.. I found it.. thanks | 18:22 |
| *** vpickard is now known as vpickard_ | 18:22 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use templated network-environment file for OVB https://review.openstack.org/474781 | 18:22 |
| *** sshnaidm is now known as sshnaidm|off | 18:24 | |
| *** fzdarsky|afk is now known as fzdarsky | 18:25 | |
| openstackgerrit | Ian Main proposed openstack/paunch master: WIP: Add debug tools to paunch https://review.openstack.org/476654 | 18:30 |
| *** paramite has quit IRC | 18:31 | |
| *** ckyriakidou has joined #tripleo | 18:35 | |
| *** fzdarsky is now known as fzdarsky|afk | 18:38 | |
| *** jprovazn has joined #tripleo | 18:42 | |
| *** jmelvin has quit IRC | 18:42 | |
| jrist | dtrainor: so | 18:42 |
| jrist | undercloud install still failed | 18:42 |
| dtrainor | ok - can you ssh to the undercloud and get /home/stack/undercloud_install.log for info? | 18:43 |
| dtrainor | jrist, #oooq ? | 18:43 |
| jrist | um | 18:43 |
| jrist | aren't we moving away from that? :) | 18:43 |
| dtrainor | oooquickstart | 18:44 |
| jrist | I'm trying to figure out a quick/easy way to upload this undercloud_install.log | 18:44 |
| jrist | dtrainor: it is oooq, but aren't we moving away from the #oooq channel? | 18:44 |
| dtrainor | you can prob just tail the last 1000 lines or so | 18:44 |
| dtrainor | oh, i do not know | 18:44 |
| dtrainor | maybe i got it wrong, sorry | 18:44 |
| dtrainor | https://docs.openstack.org/developer/tripleo-quickstart/accessing-undercloud.html#access-via-the-cli | 18:44 |
| *** trown|lunch is now known as trown | 18:45 | |
| jrist | might still be the DNS issue | 18:46 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add network/cidr mapping into ServiceNetMap https://review.openstack.org/476602 | 18:46 |
| jrist | dtrainor: http://paste.openstack.org/show/613430/ | 18:46 |
| jrist | I am having no luck today | 18:46 |
| dtrainor | hmm you sure those nameserver variables stuck? | 18:47 |
| dtrainor | and, the values correct? | 18:47 |
| dtrainor | that might be an internal url that doesn't resolve on a normal nameserver idk | 18:47 |
| jrist | no I'm not and no I'm not sure :) | 18:48 |
| jrist | that's my nameservers for my house | 18:49 |
| jrist | so I know they work | 18:49 |
| jrist | and I only used one | 18:49 |
| jrist | since the comma wasn't working | 18:49 |
| *** limao has quit IRC | 18:49 | |
| dtrainor | i just curl'd the url from my undercloud which uses 8.8.8.8 and it resolves, and gives me data, so the url seems to be valid | 18:49 |
| jrist | ya | 18:51 |
| jrist | I'm thinking the one time it failed with the comma | 18:51 |
| jrist | it was the virthost not being at the end | 18:51 |
| jrist | so I'll try one more time with comma | 18:51 |
| jrist | so it has two DNS servers | 18:51 |
| dtrainor | give me the nameservers again? what are they? | 18:52 |
| jrist | 209.244.0.3, 209.244.0.4 | 18:52 |
| dtrainor | it's possible that your isp nameservers aren't recursive for clients not on your isp's network | 18:53 |
| jrist | h | 18:53 |
| jrist | nah | 18:53 |
| jrist | that's the nameserver on the router | 18:53 |
| jrist | everything picks those up | 18:53 |
| dtrainor | theory debunked, just tested | 18:53 |
| dtrainor | right, your router is on your isp's network and by proxy everything behind it also is | 18:54 |
| dtrainor | are you on the undercloud right now? | 18:57 |
| *** pkovar has joined #tripleo | 18:57 | |
| jrist | no it is installing | 18:58 |
| *** pkovar has quit IRC | 18:58 | |
| *** suuuper has quit IRC | 18:59 | |
| *** artom has quit IRC | 19:02 | |
| dtrainor | cool | 19:02 |
| dtrainor | maybe try curl'ing that url once you get an install and get more info from there | 19:03 |
| jrist | on the install task now | 19:03 |
| *** amoralej is now known as amoralej|off | 19:04 | |
| *** artom has joined #tripleo | 19:10 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add a support check for the openstack version https://review.openstack.org/453954 | 19:14 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 19:15 |
| openstackgerrit | Sandhya Dasu proposed openstack/tripleo-heat-templates master: cisco nexus: keep OVS on the Compute https://review.openstack.org/476238 | 19:16 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: remove outdated playbook, tripleo-roles.yml https://review.openstack.org/469864 | 19:16 |
| EmilienM | dprince: hey, do you know anything about tripleo CI / containers / scenarios status? I did https://review.openstack.org/#/c/476609/ to enable Sahara & Mistral in container jobs, it works, but it doesn't pass Upgrade jobs (the one in containers) - can we go ahead and merge it? | 19:18 |
| EmilienM | dprince: I want to make container jobs in scenarios voting ASAP | 19:18 |
| jrist | :( | 19:18 |
| tosky | EmilienM: uh, sorry, I didn't check and created a (partial) duplicate in https://review.openstack.org/#/c/476634/ | 19:19 |
| dprince | EmilienM: looking... | 19:19 |
| tosky | I guess I can abandon it | 19:19 |
| EmilienM | tosky: thanks, yeah please abandon, I'll do all scenarios, in one | 19:20 |
| tosky | ack | 19:20 |
| tosky | I was not sure about the status of the other services | 19:20 |
| dprince | EmilienM: commented, you might try enabling them independently to get more info about why it fails | 19:21 |
| openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates stable/ocata: Fixes incorrect glance api network https://review.openstack.org/476665 | 19:21 |
| tosky | uh, should I restore the patch? | 19:21 |
| tosky | :) | 19:21 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-quickstart master: DNM: TESTING TELEMETRY IN OVB HA https://review.openstack.org/476666 | 19:22 |
| *** dpivonka has joined #tripleo | 19:22 | |
| dprince | EmilienM: havent' looked at them specifically, but I'd be more familiar with the Mistral side of things | 19:22 |
| EmilienM | dprince: what is failing? | 19:22 |
| EmilienM | dprince: the patch works, see gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container | 19:23 |
| dprince | EmilienM: sorry, I thought you said the upgrade parts were failing? | 19:23 |
| EmilienM | dprince: it does, but it's because the upgrade process is broken at this stage | 19:23 |
| EmilienM | dprince: Bogdan has sent a lot of bugs in Launchpad about it | 19:23 |
| EmilienM | the biggest problem is that services are not stopped during the upgrade to containers | 19:23 |
| EmilienM | but I would like to make progress and at least have gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container green now | 19:24 |
| EmilienM | and iterate on upgrades later | 19:24 |
| dprince | EmilienM: those should be easy fixes, likely just slipped through the cracks | 19:24 |
| dprince | as the upgrades architecture came after some of these I think | 19:24 |
| EmilienM | cool | 19:24 |
| EmilienM | dprince: if you +2, we can make progress on the CI, thanks | 19:25 |
| dprince | EmilienM: +2, your patch looks fine w/ me | 19:25 |
| *** dprince has left #tripleo | 19:25 | |
| *** dprince has quit IRC | 19:25 | |
| EmilienM | thanks | 19:25 |
| *** dprince has joined #tripleo | 19:26 | |
| *** florianf has quit IRC | 19:27 | |
| *** trown is now known as trown|brb | 19:28 | |
| *** MrRoot has quit IRC | 19:30 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 19:34 |
| *** trown|brb is now known as trown | 19:35 | |
| jrist | dtrainor: gone yet? | 19:37 |
| jrist | dtrainor: cat /etc/resolv.conf | 19:37 |
| jrist | [stack@undercloud ~]$ cat /etc/resolv.conf | 19:37 |
| jrist | ; generated by /usr/sbin/dhclient-script | 19:37 |
| jrist | nameserver 192.168.23.1 | 19:37 |
| *** jprovazn has quit IRC | 19:38 | |
| *** bswartz has quit IRC | 19:38 | |
| dtrainor | hmm that's the undercloud's ip | 19:39 |
| jrist | isn't that dns? | 19:41 |
| dtrainor | yeah but now i'm wondering what happened to the nameservers you actually specified | 19:41 |
| dtrainor | where is this being deployed to? what is your virthost? | 19:42 |
| *** pchavva has quit IRC | 19:43 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: ensure template_check.stat exists https://review.openstack.org/476674 | 19:44 |
| jrist | dtrainor: what do you mean | 19:44 |
| jrist | the virt host is a vm on the box? | 19:44 |
| dtrainor | on which box | 19:44 |
| *** trozet has quit IRC | 19:44 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Revert "Revert "Bump Ansible to 2.3"" https://review.openstack.org/476607 | 19:45 |
| *** prateek has quit IRC | 19:48 | |
| jrist | dtrainor: just a machine in my office | 19:49 |
| dtrainor | that's the ip address that the undercloud takes for itself on the ctrlplane network | 19:51 |
| dtrainor | i don't know where the dns servers you specified are being applied | 19:51 |
| jrist | dtrainor: that's where DNS server information is needed right? | 19:51 |
| jrist | I could try putting the DNS servers in there | 19:51 |
| jrist | yeah the nameservers in my /etc/resolv.conf are the ones I need for RH and home | 19:52 |
| *** jcoufal has quit IRC | 19:53 | |
| *** artom has quit IRC | 19:55 | |
| *** agopi has quit IRC | 19:58 | |
| dtrainor | jrist, to be honest at this point i don't have much experience with non-rdocloud oooq | 19:58 |
| jrist | :( | 19:58 |
| jrist | weshay: is that the right command to pass for DNS servers? | 19:58 |
| *** lblanchard has quit IRC | 19:59 | |
| jrist | weshay: the -e undercloud_undercloud_nameservers=209.244.0.3,209.244.0.4 | 19:59 |
| weshay | ya.. pass it directly after quickstart.sh | 19:59 |
| weshay | but not sure if a list works | 19:59 |
| weshay | so just try w/ one for now | 20:00 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: scenario002: containerize services for CI https://review.openstack.org/476680 | 20:00 |
| *** trozet has joined #tripleo | 20:00 | |
| weshay | jrist, if all else fails.. tmate me in | 20:00 |
| *** jmelvin has joined #tripleo | 20:00 | |
| jrist | weshay: I tried 1 | 20:00 |
| jrist | weshay: tried 2 | 20:00 |
| jrist | weshay: it doesn't seem to be effecting /etc/resolv.conf | 20:01 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-common master: Pass all network data into network/port templates when rendering https://review.openstack.org/476682 | 20:01 |
| weshay | jrist, you need a gui | 20:01 |
| weshay | :) | 20:01 |
| weshay | jrist, let me ssh in | 20:01 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 20:01 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render isolated network templates using jinja2 https://review.openstack.org/475612 | 20:02 |
| jrist | weshay: :) | 20:03 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: baseos-undercloud release configuration for all supported releases. https://review.openstack.org/464033 | 20:03 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render isolated network templates using jinja2 https://review.openstack.org/475612 | 20:04 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-common master: Pass all network data to render network/port templates https://review.openstack.org/476682 | 20:05 |
| *** dprince has quit IRC | 20:07 | |
| *** jrist has quit IRC | 20:09 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 20:10 |
| *** ckyriakidou has quit IRC | 20:11 | |
| *** abhishek has quit IRC | 20:11 | |
| EmilienM | fultonj: where are docker/ceph services in THT? | 20:12 |
| EmilienM | fultonj: we don't add them because of tripleo-ceph-ansible ? | 20:12 |
| fultonj | EmilienM: gfidente has a patch in review | 20:12 |
| fultonj | yes | 20:13 |
| fultonj | so ceph-ansible configures them | 20:13 |
| fultonj | we have the image provided by ceph in our registry | 20:13 |
| EmilienM | fultonj: my question is more: don't we have docker/ceph-*.yaml files? | 20:14 |
| EmilienM | like other services? | 20:14 |
| EmilienM | it means ceph can only be containerized with ceph-ansible? | 20:14 |
| *** liverpooler has quit IRC | 20:14 | |
| fultonj | yes | 20:14 |
| fultonj | that was how we were going to containerize ceph | 20:14 |
| *** itlinux_ has joined #tripleo | 20:15 | |
| *** rhallisey has quit IRC | 20:15 | |
| itlinux_ | hello what's the best to clean the instack.json from the undercloud? | 20:15 |
| fultonj | https://review.openstack.org/#/q/topic:bp/tripleo-ceph-ansible | 20:15 |
| itlinux_ | TY | 20:15 |
| EmilienM | fultonj: k | 20:15 |
| fultonj | ok | 20:15 |
| gfidente | EmilienM currently this is the experimental tht change https://review.openstack.org/#/c/465066/ | 20:16 |
| gfidente | there are three below it | 20:16 |
| EmilienM | k | 20:16 |
| *** jrist has joined #tripleo | 20:16 | |
| jrist | weshay: pm'd you | 20:18 |
| jrist | weshay: did you get any of it? heh | 20:18 |
| weshay | jrist, ya.. then you quit :( | 20:18 |
| EmilienM | gfidente, fultonj: we'll test ceph-ansible on scenario001-containers FYI | 20:18 |
| EmilienM | don't create a new scenario for that | 20:18 |
| weshay | jrist, last message was "poke" | 20:18 |
| EmilienM | ceph was deployed in scenario001, we'll test your stuff in scenario001-containers | 20:18 |
| gfidente | EmilienM yeah ideally the existing jobs using ceph | 20:19 |
| gfidente | can be migrated to ceph-ansible | 20:19 |
| EmilienM | gfidente: do you have plans on testing? | 20:19 |
| EmilienM | or do we wait to finish and merge the code? | 20:19 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Specify file url when deploy-artifacts fails https://review.openstack.org/476074 | 20:19 |
| jrist | weshay: lol it was probably the poke | 20:19 |
| jrist | weshay: works now | 20:19 |
| gfidente | EmilienM as soon as we get it working, I think I can try a change in CI with the appropriate depends_on | 20:19 |
| EmilienM | cool | 20:20 |
| EmilienM | thx for the update :) | 20:20 |
| *** jkilpatr has quit IRC | 20:20 | |
| gfidente | EmilienM yeah sorry have been out for the last three weeks | 20:20 |
| *** sbrzozow has quit IRC | 20:22 | |
| openstackgerrit | Ian Main proposed openstack/paunch master: Fix "detach: false" https://review.openstack.org/476641 | 20:23 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Rename CongressApi to Congress (docker) https://review.openstack.org/476692 | 20:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: scenario001: containerize services for CI https://review.openstack.org/476693 | 20:25 |
| *** thrash is now known as thrash|bbl | 20:26 | |
| EmilienM | gfidente: no worries at all | 20:27 |
| openstackgerrit | Ian Main proposed openstack/paunch master: WIP: Add debug tools to paunch https://review.openstack.org/476654 | 20:27 |
| itlinux_ | hello what's the best to clean the instack.json from the undercloud? | 20:27 |
| *** rwsu has quit IRC | 20:28 | |
| *** paramite has joined #tripleo | 20:33 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 20:34 |
| *** jkilpatr has joined #tripleo | 20:40 | |
| EmilienM | vkmc: hey, do we have any patch WIP to containerize manila share and ManilaBackendCephFs ? | 20:40 |
| EmilienM | ah found it https://review.openstack.org/#/c/471527/ | 20:40 |
| vkmc | EmilienM, ' | 20:41 |
| vkmc | ^ | 20:41 |
| vkmc | I'm currently setting up a tripleo env to see what's missing for that | 20:41 |
| EmilienM | ok | 20:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: scenario004: containerize services for CI https://review.openstack.org/476698 | 20:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: CI: Enable OVN services for scenario 3 https://review.openstack.org/412831 | 20:43 |
| tbarron | hey is it expected that old-fashioned un-containerized overcloud deploy will still work on master-ci ? | 20:45 |
| tbarron | attempting an overcloud-deploy w/o referencing any env file to pull in the docker stuff (just as a first step) I get this failure with deploy commands that used to work: | 20:47 |
| itlinux_ | hello I get a time out on this any suggestions ? Started Mistral Workflow tripleo.baremetal.v1.register_or_update. Execution ID: b1f074d3-53b7-4966-a418-909bad40af89 | 20:48 |
| itlinux_ | Waiting for messages on queue 'a0a4c020-b743-44f0-836c-2c0192e1a57c' with no timeout. | 20:48 |
| tbarron | (undercloud) [stack@undercloud ~]$ cat failed_deployment_list.log | 20:48 |
| tbarron | overcloud.AllNodesDeploySteps.ControllerDeployment_Step2.0: | 20:48 |
| tbarron | resource_type: OS::Heat::StructuredDeployment | 20:48 |
| tbarron | physical_resource_id: ca10ba1a-c987-431c-862c-17a3ef4fda4c | 20:48 |
| tbarron | status: CREATE_FAILED | 20:48 |
| tbarron | status_reason: | | 20:48 |
| tbarron | Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1 | 20:48 |
| tbarron | deploy_stdout: | | 20:48 |
| tbarron | Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend | 20:48 |
| tbarron | Notice: Scope(Class[Tripleo::Firewall::Post]): At this stage, all network traffic is blocked. | 20:48 |
| tbarron | Notice: Compiled catalog for overcloud-controller-0.localdomain in environment production in 7.06 seconds | 20:48 |
| tbarron | deploy_stderr: | | 20:48 |
| tbarron | exception: connect failed | 20:48 |
| tbarron | Warning: Unknown variable: 'haproxy_stats_bind_certificate'. at /etc/puppet/modules/tripleo/manifests/haproxy.pp:810:6 | 20:48 |
| tbarron | Warning: ModuleLoader: module 'haproxy' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:48 |
| tbarron | (file & line not available) | 20:48 |
| tbarron | Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::String. There is further documentation for validate_legacy function in the README. at ["/etc/puppet/modules/haproxy/manifests/init.pp", 131]:["/var/lib/heat-config/heat-config-puppet/9aebed13-7351-401f-a9ed-59eaec731d94.pp", 71] | 20:48 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:48 |
| tbarron | Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Bool. There is further documentation for validate_legacy function in the README. at ["/etc/puppet/modules/haproxy/manifests/init.pp", 132]:["/var/lib/heat-config/heat-config-puppet/9aebed13-7351-401f-a9ed-59eaec731d94.pp", 71] | 20:48 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:48 |
| tbarron | Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Hash. There is further documentation for validate_legacy function in the README. at ["/etc/puppet/modules/haproxy/manifests/init.pp", 135]:["/var/lib/heat-config/heat-config-puppet/9aebed13-7351-401f-a9ed-59eaec731d94.pp", 71] | 20:48 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:48 |
| tbarron | Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Absolute_Path. There is further documentation for validate_legacy function in the README. at ["/etc/puppet/modules/haproxy/manifests/init.pp", 136]:["/var/lib/heat-config/heat-config-puppet/9aebed13-7351-401f-a9ed-59eaec731d94.pp", 71] | 20:48 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:48 |
| tbarron | Warning: Undefined variable 'ipaddress_eth0'; | 20:48 |
| tbarron | (file & line not available) | 20:48 |
| tbarron | Warning: Undefined variable 'netmask_eth0'; | 20:49 |
| tbarron | (file & line not available) | 20:49 |
| tbarron | Warning: Undefined variable 'ipaddress_ovs_system'; | 20:49 |
| tbarron | (file & line not available) | 20:49 |
| tbarron | Warning: Undefined variable 'netmask_ovs_system'; | 20:49 |
| tbarron | (file & line not available) | 20:49 |
| tbarron | Warning: notify is a metaparam; this value will inherit to all contained resources in the keepalived::instance definition | 20:49 |
| tbarron | Warning: This method is deprecated, please use match expressions with Stdlib::Compat::Ipv6 instead. They are described at https://docs.puppet.com/puppet/latest/reference/lang_data_type.html#match-expressions. at ["/etc/puppet/modules/tripleo/manifests/keepalived.pp", 129]:["/var/lib/heat-config/heat-config-puppet/9aebed13-7351-401f-a9ed-59eaec731d94.pp", 86] | 20:49 |
| itlinux_ | tbarron: for a log message like that use pastebin! | 20:49 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:49 |
| tbarron | Warning: This method is deprecated, please use match expressions with Stdlib::Compat::String instead. They are described at https://docs.puppet.com/puppet/latest/reference/lang_data_type.html#match-expressions. at ["/etc/puppet/modules/memcached/manifests/init.pp", 45]:["/etc/puppet/modules/tripleo/manifests/profile/base/memcached.pp", 30] | 20:49 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:49 |
| tbarron | Warning: ModuleLoader: module 'mysql' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:49 |
| tbarron | (file & line not available) | 20:49 |
| tbarron | Warning: Unknown variable: '::nova::db::mysql_api::setup_cell0'. at /etc/puppet/modules/nova/manifests/db/mysql.pp:53:28 | 20:49 |
| tbarron | Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Array. There is further documentation for validate_legacy function in the README. at ["/etc/puppet/modules/tripleo/manifests/profile/base/nova.pp", 132]:["/etc/puppet/modules/tripleo/manifests/profile/base/nova/api.pp", 68] | 20:49 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:49 |
| tbarron | Warning: This method is deprecated, please use the stdlib validate_legacy function, with Pattern[]. There is further documentation for validate_legacy function in the README. at ["/etc/puppet/modules/ntp/manifests/init.pp", 68]:["/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp", 29] | 20:49 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:49 |
| tbarron | Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Numeric. There is further documentation for validate_legacy function in the README. at ["/etc/puppet/modules/ntp/manifests/init.pp", 76]:["/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp", 29] | 20:49 |
| tbarron | (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation') | 20:49 |
| tbarron | Warning: ModuleLoader: module 'rabbitmq' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:49 |
| tbarron | (file & line not available) | 20:50 |
| tbarron | Warning: ModuleLoader: module 'redis' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:50 |
| tbarron | (file & line not available) | 20:50 |
| tbarron | Warning: ModuleLoader: module 'ssh' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:50 |
| tbarron | (file & line not available) | 20:50 |
| tbarron | Warning: ModuleLoader: module 'swift' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:50 |
| tbarron | (file & line not available) | 20:50 |
| tbarron | Warning: ModuleLoader: module 'openstacklib' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:50 |
| tbarron | (file & line not available) | 20:50 |
| tbarron | Warning: ModuleLoader: module 'timezone' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules | 20:50 |
| tbarron | (file & line not available) | 20:50 |
| tbarron | Warning: Unknown variable: 'listen_options_real'. at /etc/puppet/modules/tripleo/manifests/haproxy/endpoint.pp:152:25 | 20:50 |
| tbarron | Warning: Scope(Haproxy::Config[haproxy]): haproxy: The $merge_options parameter will default to true in the next major release. Please review the documentation regarding the implications. | 20:50 |
| tbarron | Warning: Could not find resource 'Exec[wait-for-settle]' in parameter 'require' | 20:50 |
| tbarron | (at /etc/puppet/modules/pacemaker/manifests/property.pp:86) | 20:50 |
| tbarron | Error: Could not find dependency Exec[wait-for-settle] for Pcmk_property[property-overcloud-controller-0-manila-share-role] at /etc/puppet/modules/pacemaker/manifests/property.pp:78 | 20:50 |
| tbarron | sorry, wrong paste buffer | 20:50 |
| * tbarron is bad | 20:50 | |
| tbarron | it was supposed to be: https://paste.fedoraproject.org/paste/dUWCqJ~K9MDLuBZ8iVwdOA | 20:50 |
| * tbarron hides | 20:50 | |
| tbarron | itlinux_: please see my apology above | 20:50 |
| tbarron | itlinux_: i thought I had the pastebin url available from my mouse click but I didn't | 20:50 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: WIP: Test the example nic configs we actually ship https://review.openstack.org/476704 | 20:52 |
| trozet | can some OOO cores please review https://review.openstack.org/#/c/419648/ ? | 20:53 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Support composable roles for deploying overcloud https://review.openstack.org/455719 | 20:53 |
| *** dhill_ has quit IRC | 20:54 | |
| *** prateek has joined #tripleo | 20:55 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Copy nic configs from tripleo-ci repo https://review.openstack.org/476708 | 20:59 |
| *** eck`gone is now known as eck` | 21:00 | |
| rcrit | owalsh, but the service (the nova part of -p nova/{$::fqdn} would need to be a variable | 21:02 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Test the example nic configs we actually ship https://review.openstack.org/476704 | 21:02 |
| *** fpan has quit IRC | 21:03 | |
| *** fpan has joined #tripleo | 21:04 | |
| *** gbarros has joined #tripleo | 21:05 | |
| *** abishop has quit IRC | 21:09 | |
| openstackgerrit | Ian Main proposed openstack/paunch master: WIP: Add debug tools to paunch https://review.openstack.org/476654 | 21:10 |
| *** prateek has quit IRC | 21:13 | |
| *** fragatina has joined #tripleo | 21:20 | |
| *** trozet has quit IRC | 21:20 | |
| *** trown is now known as trown|outtypewww | 21:21 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: scenario003: containerize services for CI https://review.openstack.org/476609 | 21:21 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Revert "Blacklist support for ExtraConfig" https://review.openstack.org/476519 | 21:22 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: ensure template_check.stat exists https://review.openstack.org/476674 | 21:23 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: WIP: change devmode to deploy containerized services by default https://review.openstack.org/472412 | 21:24 |
| itlinux_ | am I missing something or the quickstart has some missing steps..but failed on me.. does anyone have a blog with the steps to double check them?TY | 21:25 |
| stevebaker | morning | 21:25 |
| *** cdearborn has joined #tripleo | 21:29 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render isolated network templates using jinja2 https://review.openstack.org/475612 | 21:29 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: allow for nondefault ssh port on virthost https://review.openstack.org/476713 | 21:31 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 21:32 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Make config options required https://review.openstack.org/475831 | 21:32 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: allow for nondefault ssh port on virthost https://review.openstack.org/476713 | 21:34 |
| *** morazi has quit IRC | 21:42 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: allow for nondefault ssh port on virthost https://review.openstack.org/476713 | 21:45 |
| *** fragatina has quit IRC | 21:47 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 21:52 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Collect workflow lists and execution lists in host_info https://review.openstack.org/465065 | 21:52 |
| *** fragatina has joined #tripleo | 21:52 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render isolated network templates using jinja2 https://review.openstack.org/475612 | 21:53 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-common master: Pass all network data to render network/port templates https://review.openstack.org/476682 | 21:53 |
| *** gbarros has quit IRC | 21:53 | |
| *** chlong has quit IRC | 21:57 | |
| *** gbarros has joined #tripleo | 21:57 | |
| *** eck` is now known as eck`gone | 21:58 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: allow for nondefault ssh port on virthost https://review.openstack.org/476713 | 22:00 |
| *** dmacpher has quit IRC | 22:08 | |
| *** cdearborn has quit IRC | 22:08 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add network/cidr mapping into ServiceNetMap https://review.openstack.org/476602 | 22:09 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: [WIP] Deploy Ceph using ceph-ansible via external workflow https://review.openstack.org/465066 | 22:10 |
| *** gfidente has quit IRC | 22:11 | |
| *** fragatina has quit IRC | 22:19 | |
| *** jcoufal has joined #tripleo | 22:20 | |
| *** dmacpher has joined #tripleo | 22:21 | |
| itlinux_ | does anyone have steps on overcloud for a virtualmachine? TY | 22:22 |
| *** abhishek has joined #tripleo | 22:24 | |
| *** myoung|remote has joined #tripleo | 22:24 | |
| *** myoung|remote has quit IRC | 22:24 | |
| *** hewbrocca_afk has quit IRC | 22:26 | |
| tbarron | itlinux_: i am following https://docs.openstack.org/developer/tripleo-quickstart/readme.html#tripleo-quickstart | 22:27 |
| itlinux_ | were you successul ? tbarron: | 22:28 |
| tbarron | itlinux_: with ocata and no changes to anything, yes | 22:28 |
| tbarron | itlinux_: on CentOS 7.3 | 22:28 |
| *** weshay has quit IRC | 22:29 | |
| itlinux_ | tbarron: I did PM you | 22:30 |
| *** markmc has quit IRC | 22:31 | |
| tbarron | itlinux_: and I did answer :) | 22:31 |
| *** jpena|off has quit IRC | 22:32 | |
| *** rasca has quit IRC | 22:32 | |
| itlinux_ | :) thanks tbarron! | 22:32 |
| itlinux_ | tbarron: do you use virtual machines or BM? | 22:32 |
| *** weshay has joined #tripleo | 22:33 | |
| tbarron | itlinux_: that is on a 64GB centos7.3 baremetal | 22:33 |
| itlinux_ | for the UC how about the OC? | 22:33 |
| tbarron | itlinux_: but the undercloud and all the overcloud machines are VMs | 22:33 |
| itlinux_ | so you are using virsh! KVM? | 22:33 |
| itlinux_ | back to PM tbarron: TY | 22:34 |
| tbarron | itlinux_: the quickstart setup in the link above sets that stuff up for you; it is explained there. | 22:34 |
| *** markmc has joined #tripleo | 22:35 | |
| *** gbarros has quit IRC | 22:36 | |
| *** rasca has joined #tripleo | 22:36 | |
| *** hewbrocca_afk has joined #tripleo | 22:36 | |
| *** jpena|off has joined #tripleo | 22:37 | |
| *** amoralej|off has quit IRC | 22:37 | |
| *** weshay has quit IRC | 22:39 | |
| *** dmanchad has quit IRC | 22:39 | |
| *** weshay has joined #tripleo | 22:42 | |
| *** dmanchad has joined #tripleo | 22:43 | |
| *** jcoufal has quit IRC | 22:46 | |
| *** dmanchad has quit IRC | 22:50 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Create new arg for composable services https://review.openstack.org/469286 | 22:50 |
| *** jpena|off has quit IRC | 22:50 | |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 22:51 |
| *** weshay has quit IRC | 22:51 | |
| *** dmanchad has joined #tripleo | 22:52 | |
| *** jpena|off has joined #tripleo | 22:52 | |
| *** weshay has joined #tripleo | 22:52 | |
| *** markmc has quit IRC | 22:53 | |
| *** amoralej has joined #tripleo | 22:54 | |
| itlinux_ | anyone bout this error ./quickstart.sh: line 479 no /home/user1/ansible_ssh_env.sh: No such file or directory | 22:57 |
| *** hewbrocca_afk has quit IRC | 22:57 | |
| *** dmanchad has quit IRC | 22:59 | |
| itlinux_ | found the way.. need to clone the repo down the quickstart doc does not state that.. | 22:59 |
| *** weshay has quit IRC | 23:00 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 23:02 |
| *** weshay has joined #tripleo | 23:03 | |
| *** rlandy has quit IRC | 23:03 | |
| *** dmanchad has joined #tripleo | 23:08 | |
| *** chlong has joined #tripleo | 23:10 | |
| *** dmacpher has quit IRC | 23:10 | |
| *** sid1 has joined #tripleo | 23:11 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Move UI package install to base manifest https://review.openstack.org/475352 | 23:13 |
| *** abhishek has quit IRC | 23:18 | |
| *** dmanchad has quit IRC | 23:19 | |
| *** paramite has quit IRC | 23:20 | |
| *** dmacpher has joined #tripleo | 23:22 | |
| *** sid1 has quit IRC | 23:23 | |
| *** sid1 has joined #tripleo | 23:26 | |
| *** dmanchad has joined #tripleo | 23:29 | |
| *** itlinux_ has quit IRC | 23:29 | |
| *** tosky has quit IRC | 23:33 | |
| *** amoralej has quit IRC | 23:33 | |
| *** paramite has joined #tripleo | 23:33 | |
| *** dmanchad has quit IRC | 23:34 | |
| *** gbarros has joined #tripleo | 23:35 | |
| *** paramite_ has joined #tripleo | 23:37 | |
| *** jpena|off has quit IRC | 23:37 | |
| *** paramite has quit IRC | 23:40 | |
| *** dmanchad has joined #tripleo | 23:40 | |
| *** jpena|off has joined #tripleo | 23:41 | |
| *** dmacpher has quit IRC | 23:42 | |
| *** jpena|off has quit IRC | 23:50 | |
| *** amoralej has joined #tripleo | 23:50 | |
| *** jpena|off has joined #tripleo | 23:51 | |
| dsneddon | emilienM: Heads-up, I did a workflow +1 on this change, when I probably should have only give it a +2, since it's part of a multi-patch BP. Hope that is OK. | 23:52 |
| dsneddon | https://review.openstack.org/#/c/467682 | 23:52 |
| dsneddon | It didn't have any Depends-on | 23:53 |
| *** amoralej has quit IRC | 23:55 | |
| *** jpena|off has quit IRC | 23:55 | |
| *** dmacpher has joined #tripleo | 23:56 | |
| *** jpena|off has joined #tripleo | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
