Friday, 2018-12-07

*** rlandy has quit IRC00:11
*** tosky has quit IRC00:40
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario009-multinode-oooq, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053,  (1 more message)01:58
*** ykarel|away has joined #oooq03:52
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message)03:58
*** saneax has joined #oooq04:42
*** ykarel|away has quit IRC04:46
*** ykarel|away has joined #oooq05:04
*** ratailor has joined #oooq05:57
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message)05:58
*** skramaja has joined #oooq07:26
*** jfrancoa has joined #oooq07:26
*** jtomasek has joined #oooq07:28
*** ykarel|away is now known as ykarel07:35
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci- (1 more message)07:58
*** ykarel is now known as ykarel|lunch08:02
*** kopecmartin|pto is now known as kopecmartin08:08
*** holser_ has joined #oooq08:21
*** ratailor has quit IRC08:56
*** ratailor has joined #oooq08:58
*** ykarel|lunch is now known as ykarel09:00
*** ccamacho has joined #oooq09:09
*** ccamacho has quit IRC09:09
ssbarnea|rovermarios: morning!09:14
marios_|rucksshnaidm|afk: o/09:15
marios_|ruckoops ssbarnea|rover09:15
marios_|rucksorry sshnaidm|afk09:15
*** ccamacho has joined #oooq09:15
ssbarnea|rovermarios_|ruck: what can we do about the gate?09:23
mariosssbarnea|rover: well, apparently not much right?09:23
marios_|ruckssbarnea|rover: i mean we've asked for a reset09:24
marios_|ruckssbarnea|rover: theres not a huge amount failing on the jobs09:24
marios_|ruck5fails/24 hours09:24
ssbarnea|roveri am mostly talking about reducing its size09:25
marios_|ruckssbarnea|rover: right. likeone thing we could just do ourselves is go in and abandon/restore all the things09:25
marios_|ruckbut...09:25
marios_|ruckwill not make us popular and we've already asked for the reset so...09:25
marios_|rucki summoned the council and everything09:25
marios./freenode/#oooq.log-98762-16:07 < weshay_mtg> marios_|ruck, that's a discussion I have w/ Juan, Alex, or Emilien09:26
marios./freenode/#oooq.log-98763-16:07 < weshay_mtg> usually they make the call and do the reset09:26
marios./freenode/#oooq.log:98766:16:07 < marios_|ruck> weshay_mtg: ok then i summon a meeting of the council09:27
marios./freenode/#oooq.log-98767-16:07 < marios_|ruck> please09:27
mariosssbarnea|rover: do we know about this one i don't see a bug for it post failure going to file it now http://logs.openstack.org/45/560445/206/check/tripleo-ci-centos-7-containers-multinode/156ed88/job-output.txt.gz#_2018-12-07_03_07_12_08872009:29
ssbarnea|roverssbarnea|rover: this kind of issue is usually caused by concurrency.09:33
ssbarnea|roverit is a virtualenv related bug most likely will not reproduce on 2nd run.09:33
ssbarnea|roverbut let me query first09:34
ssbarnea|roveri am trying to find a way to add a context menu to firefox to search on logstash for current selection. anyone know an extension that would allow me to do that?09:36
marios_|ruckssbarnea|rover: so maybe i'll prep the text but not file it, just make a note in the etherpad09:37
ssbarnea|roversure!09:37
ssbarnea|rovermarios_|ruck: isn't this duplicate of https://bugs.launchpad.net/tripleo/+bug/1792375 ?09:44
openstackLaunchpad bug 1792375 in tripleo "[master] multinode noop job failure giving IOError: [Errno 26] Text file busy: '/home/zuul/workspace/.quickstart/bin/python'" [Critical,Fix released] - Assigned to Sorin Sbarnea (ssbarnea)09:44
ssbarnea|roverlooks almost identical09:45
marios_|ruckssbarnea|rover: sounds like looking09:45
marios_|ruckssbarnea|rover: hm logs gone but trace looks same09:45
marios_|ruckhttp://logs.openstack.org/45/560445/139/check/tripleo-ci-centos-7-containers-multinode/dfc441e/job-output.txt.gz#_2018-09-13_10_20_18_84734809:45
ssbarnea|roverchandan_kumar: ^^ can you give us some insights on it?09:45
chandan_kumarssbarnea|rover: we have fixed this long time ago09:51
chandan_kumarssbarnea|rover: it only happens when the same venv is used by some other process and leads to race condition then it gives this message09:52
ssbarnea|roverchandan_kumar: check report from today on https://review.rdoproject.org/etherpad/p/ruckrover-sprint23#37 -- is happens again in similar way, thus asking you as you know it better.09:52
ssbarnea|roverchandan_kumar: it happened to me with jenkins multiple workers but that not the case here.09:52
ssbarnea|roverdoes this mean we have a process that got stuck in an earlier task? or from a previous job?09:53
ssbarnea|roverlostash reports multiple similar errors, not too many but ~10/week is enough to ask for investigation09:54
chandan_kumarssbarnea|rover: there was a single venv that venv was used by somebody else and at the same time other process try to resource it and run the process then it happened09:56
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci- (1 more message)09:58
chandan_kumarssbarnea|rover: please have a look at this patch https://review.openstack.org/#/c/622865/6/roles/generate-tempestconf-file-cloud/tasks/main.yaml@409:59
chandan_kumarssbarnea|rover: I need python3 there09:59
chandan_kumarssbarnea|rover: without using ansible pythoninterpreter10:00
ssbarnea|roverchandan_kumar: is py3 a new requirement of tempest for all versions?10:09
chandan_kumarssbarnea|rover: currently tempestconf is tested using python2 only in gates10:09
chandan_kumarssbarnea|rover: I am working on a job to test stuff on py310:09
ssbarnea|roverahh, i get it: if python3 is present prefer it instead of python2.10:09
ssbarnea|roverregardless what is the platform10:09
ssbarnea|roverit worries me a little bit but if this is only about configuring tempest and not about running it, it should be ok.10:10
ssbarnea|roveris essential to run tests using the same version of python as the one we are deploying with, for obvious reasons. but generating tempest config, is more relax.10:11
chandan_kumarssbarnea|rover: updated patch to use py3 let see how it gors10:12
chandan_kumarssbarnea|rover: thanks :-)10:13
ssbarnea|roverchandan_kumar: back to our venv concurrency issue, can we do somethign to prevent it? AFAIK nobody else that current procress should use the quickstart venv. maybe we can test for this and fail fast or even kill all processes as a preventive measure.10:14
ssbarnea|roveror we do run stuff in background?10:15
chandan_kumarssbarnea|rover: running stuff in background no idea, but we can take preventive action like to check whether venv is used by some process that time or not if not then resuse the same10:17
*** ccamacho has quit IRC10:31
*** agopi is now known as agopi-pto10:38
*** ccamacho has joined #oooq10:41
*** agopi-pto has quit IRC10:44
*** vinaykns has joined #oooq10:49
*** dtrainor has quit IRC11:09
*** holser_ is now known as holser|lunch11:30
*** sshnaidm|afk is now known as sshnaidm|off11:33
*** tosky has joined #oooq11:52
*** dtantsur|afk is now known as dtantsur\11:54
*** dtantsur\ is now known as dtantsur11:54
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci- (1 more message)11:58
marios_|ruckrfolco: panda check it when you have time please scenario1 https://review.openstack.org/619508 job is green waiting for zuul run now tidied it up commit message etc12:26
pandamarios_|ruck: why did you cahnge the branches for multinode jobs ?12:29
pandamarios_|ruck: tripleo-ci-centos-7-scenario001-multinode-oooq change doesn't look right, that is the non-containerized job12:31
marios_|ruckpanda: the idea is we no longer run scenario1 on master when we land the new job12:31
marios_|ruckpanda: see https://review.openstack.org/#/c/618761/13/zuul.d/multinode-jobs.yaml12:32
marios_|ruckpanda: dicussion here ^12:32
marios_|ruckpanda: so rfolco posted followup https://review.openstack.org/#/c/62326012:33
*** dtrainor has joined #oooq12:33
marios_|ruckpanda: and quiquell includes his in https://review.openstack.org/#/c/618709/24/zuul.d/multinode-jobs.yaml12:34
marios_|ruckpanda: so i have the same. except for scenario 001 there is still both containerized/non there. in any case they will both go aaway in due course12:34
pandamarios_|ruck: ok, what about the non containerized branch change ?12:35
marios_|ruckpanda: ack12:35
marios_|ruckpanda: will change that one sec12:35
*** dtrainor_ has joined #oooq12:40
*** holser|lunch is now known as holser_12:40
*** vinaykns has quit IRC12:42
*** dtrainor has quit IRC12:42
rfolcomarios_|ruck, non-containerized jobs are being removed/deprecated in a separate effort, https://review.openstack.org/#/q/status:open+topic:cleanup-old-branches12:44
rfolcopanda, ^12:44
mariosrfolco: thanks12:44
pandakthxbye12:50
rfolcopanda, bye? nooooo stay !12:51
rfolcomarios, regarding https://review.openstack.org/#/c/619520/14/zuul.d/standalone-jobs.yaml, my first thought would be tempest_extras, the same as felix did on scen212:52
rfolcoDetails: No "ResellerAdmin" role found12:53
chandan_kumarrfolco: do you have the logs?12:54
rfolcochandan_kumar, http://logs.openstack.org/20/619520/13/check/tripleo-ci-centos-7-scenario004-standalone/358067d/logs/undercloud/home/zuul/tempest/tempest.html.gz12:54
*** saneax has quit IRC12:55
mariosrfolco: can you add a comment there? but do you mean tempest_extra_config@ https://review.openstack.org/#/c/618709/24/zuul.d/standalone-jobs.yaml ?12:57
chandan_kumarrfolco: earlier this role was created when swift was configired12:57
chandan_kumarmarios: rfolco https://github.com/openstack/tripleo-heat-templates/search?q=ResellerAdmin&unscoped_q=ResellerAdmin12:58
chandan_kumarmarios: rfolco if these are used then we donot need to pass anything12:59
rfolcomarios, chandan_kumar this was a random thought... yeah... so maybe chandan_kumar has a more accurate idea13:00
ssbarnea|rovermarios_|ruck: have you seen standalone failure with /bin/yum -d 0 -e 0 -y install net-snmp' returned 1: Error:  Multilib version problems found. This often means that the root" ?13:00
chandan_kumarmarios: i think we need to enable swift proxy there13:00
mariosssbarnea|rover: not seen this new?13:00
ssbarnea|rovermarios: http://logs.openstack.org/02/623202/2/check/tripleo-ci-centos-7-standalone/20cbd65/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz13:00
chandan_kumarrfolco: https://review.openstack.org/#/c/623217/2/ci/environments/scenario004-standalone.yaml@8 all swift is none here13:01
chandan_kumarit means swift is not configured13:01
mariosssbarnea|rover: ack. you filed a bug or should i go ahead? have any more examples?13:01
chandan_kumarlet me check previous scenario 4 job13:01
marioschandan_kumar: rfolco ack thanks folks please add comment on the review if i should change something there13:02
ssbarnea|rovermarios: new and enough reports on http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Multilib%20version%20problems%20found.%20This%20often%20means%20that%20the%20root%5C%2213:02
ssbarnea|roverwondering if that is not the centos 7.613:03
mariosssbarnea|rover: and you can see it started atoday in fact?13:04
mariosssbarnea|rover: logstash is da bomb13:04
chandan_kumarmarios: one question scenario 004 resembles ot fs19 na?13:04
chandan_kumarto13:04
ssbarnea|roveri know, i want to make it easier to query it, this is why i was asking about browser extension to right-click on selection and search for it. is doable.13:04
marioschandan_kumar: not intentionally. it is using fs52 same as the others only thing we change is services with tht @ https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario004-standalone.yaml13:05
mariosssbarnea|rover: so should i file the bug?13:05
ssbarnea|roverdoing it now13:05
mariosssbarnea|rover: thank you13:05
ssbarnea|rovermarios: 2 years old but looks very similar https://bugs.launchpad.net/tripleo/+bug/153478513:06
openstackLaunchpad bug 1534785 in tripleo "net-snmp-libs multilib errors during compute node update" [Undecided,Fix released] - Assigned to James Slagle (james-slagle)13:06
ssbarnea|roverit looks like a regression to me, same bug happening again13:07
ssbarnea|roverprobably someone decided to use excludes to speed things up13:08
chandan_kumarmarios: sorry, little more change related to tempest13:11
chandan_kumarcommented13:11
* chandan_kumar is logging out, see ya on monday13:12
marioschandan_kumar: thanks for your review will have a look13:12
chandan_kumarhappy weekend guys :-)13:12
mariosyou too chandan_kumar13:12
*** chandan_kumar is now known as chkumar|off13:12
ykarelssbarnea|rover, marios re. net-snmp issue: https://review.rdoproject.org/r/#/c/16911/ caused the issue and https://review.rdoproject.org/r/#/c/17707/ might fix the issue13:14
ykarelso if issue any issue .rdo2 mariadb version as well then report it to #rdo13:14
mariosthanks ykarel ssbarnea|rover maybe add to the bug if you didn't hit return yet ^ or we can add comment13:14
ykareldescription in bug can also be updated :)13:15
*** ratailor has quit IRC13:22
ssbarnea|rovermarios: ykarel : please check https://review.openstack.org/#/c/623199/13:27
ssbarnea|roveri am trying to identify where this ansible task originates from "Run async deployment NetworkDeployment"... out of luck so far.13:31
ssbarnea|roverfound... my mistake again using codesearch with quotes13:32
ykarelssbarnea|rover, ack13:35
ssbarnea|roverykarel: my hopeless attempt to make the output more human friendly13:36
*** sshnaidm|off has quit IRC13:37
ykarelssbarnea|rover, so no luck with the patch13:37
ykarelssbarnea|rover, exactly which part of log u are trying fix?13:38
ssbarnea|roverykarel: if you check the execution log it does do a good job, I do see the STDOUT/STDERR clearly displayed.13:40
ssbarnea|roverthe problem is that it fixed only one level. there is still the heat-config output which is still pure JSON (with messy value like deploy_stderr )13:41
ssbarnea|roverso is a partial fix.13:41
ssbarnea|roverthe other one looks harder to deal with, i am still trying to understand what happens there.13:41
ssbarnea|rovermainly two different issues13:42
*** rlandy has joined #oooq13:44
ykarelssbarnea|rover, ack13:46
ssbarnea|roverykarel: but i have good news, I found the place and writing a patch for heat-config too.13:47
ykarelssbarnea|rover, cool13:47
rlandypanda: hello13:48
rlandypanda: re f28 pipeline - any more info? you said you had a better solution?13:48
rlandypanda: if no objection. I will start putting in some preliminary reviews covering what we discussed yesterday13:49
rfolcopanda, marios rlandy reviews welcome to the fs058 https://review.openstack.org/#/c/623039/ standalone-update13:51
rfolcochem, ^13:52
marios_|ruckrfolco: ack folco added to my reviews list13:52
rfolcoalthough we don't have a passing job, perhaps this will be hold until we get the new workflow done....13:53
rfolcothx13:53
chemrfolco: ditto13:55
*** skramaja has quit IRC13:56
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci- (1 more message)13:58
pandarlandy: hey, I have the idea, want to chat ? We can then proceed in parallel, I can change the promoter script logic14:15
pandarlandy: and you can add the job configuration14:15
pandaor vice versa14:15
rlandypanda: sure - let's get started on this14:16
rlandypanda: your bj?14:16
pandajrist: let me check something with jpena first14:29
rlandypanda: ping me when you are ready to talk14:30
jristpanda: ok thanks14:48
jristI tried it last night and it says no rhos-release file14:49
*** ratailor has joined #oooq14:49
jrist/home/stack/repo_setup.sh: line 39: rhos-release: command not found14:49
*** sshnaidm has joined #oooq14:52
jristso obviously no dice14:57
*** ccamacho has quit IRC15:00
*** sshnaidm has quit IRC15:03
*** ykarel is now known as ykarel|away15:11
*** ykarel|away has quit IRC15:18
*** ccamacho has joined #oooq15:18
*** sshnaidm has joined #oooq15:29
*** ykarel|away has joined #oooq15:33
*** sshnaidm is now known as sshnaidm|off15:42
*** ratailor has quit IRC15:57
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci- (1 more message)15:58
*** tosky has quit IRC16:14
pandarlandy: whoa, it was a long discussion, but i'm ready16:17
*** dtrainor_ is now known as dtrainor16:17
pandarlandy: you abvailable to chat ?16:20
rlandypanda: in a bit - chatting to zuul people16:20
pandarlandy: ok16:20
*** chem has quit IRC16:31
* marios_|ruck out folks have a good one16:32
*** jfrancoa has quit IRC16:33
rlandypanda: k - let's talk16:36
pandarlandy: ok, my bj ?16:36
rlandysur16:36
rlandysure16:37
*** dtantsur is now known as dtantsur|afk17:22
*** rlandy is now known as rlandy|brb17:23
*** kopecmartin is now known as kopecmartin|off17:26
*** holser_ has quit IRC17:36
*** rlandy|brb is now known as rlandy17:41
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci- (1 more message)17:58
*** ykarel|away has quit IRC18:17
*** udesale has joined #oooq18:26
*** udesale has quit IRC18:27
*** ccamacho has quit IRC18:40
*** dsneddon has quit IRC19:31
*** dsneddon has joined #oooq19:56
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-quickstart- (2 more messages)19:58
rlandypanda: still around?19:59
pandarlandy: kinda20:09
*** weshay_mtg_afk is now known as weshay20:10
rlandypanda: nvm - will pick it up on monday20:10
rlandyjust wanted to chat about how we know what hash we are picking up20:11
pandarlandy: for the periodic it's always tripleo-ci-testing. Eith fedora we need two, but theother is current-tripleo20:18
weshaypanda, rlandy anything you guys need to chat about?20:31
*** brault has quit IRC21:06
*** jtomasek has quit IRC21:08
rlandyweshay: not really - welcome back21:08
*** rlandy has quit IRC21:08
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-quickstart- (2 more messages)21:58
*** holser_ has joined #oooq22:10
*** dmellado has quit IRC22:22
*** hubbot1 has quit IRC22:22
*** gouthamr has quit IRC22:23
*** holser_ has quit IRC22:58
*** gouthamr has joined #oooq23:06
*** dmellado has joined #oooq23:11
*** hubbot1 has joined #oooq23:28
*** apetrich has quit IRC23:47
hubbot1FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-quickstart- (2 more messages)23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!