Thursday, 2017-04-27

*** d0ugal has quit IRC00:04
*** ramishra has quit IRC00:09
*** jmelvin has quit IRC00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025900:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645500:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]00:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]00:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)00:10
*** ramishra has joined #tripleo00:11
*** salmankhan has joined #tripleo00:17
*** salmankhan has quit IRC00:21
*** ramishra has quit IRC00:25
*** ramishra has joined #tripleo00:27
*** ramishra has quit IRC00:35
*** limao has joined #tripleo00:38
*** ramishra has joined #tripleo00:40
*** ramishra has quit IRC00:45
*** ramishra has joined #tripleo00:57
*** dixiaoli has joined #tripleo01:01
*** gbarros has joined #tripleo01:02
*** ramishra has quit IRC01:04
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025901:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645501:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]01:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]01:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)01:10
*** ramishra has joined #tripleo01:12
*** Goneri has joined #tripleo01:13
*** ramishra has quit IRC01:17
*** ramishra has joined #tripleo01:18
*** Goneri has quit IRC01:19
*** prateek has quit IRC01:26
*** yamahata_ has quit IRC01:33
*** ramishra has quit IRC01:35
*** ramishra has joined #tripleo01:42
*** ramishra has quit IRC01:49
*** dparkes has joined #tripleo01:49
*** ramishra has joined #tripleo01:50
*** ramishra has quit IRC02:00
*** ramishra has joined #tripleo02:01
*** prateek has joined #tripleo02:04
*** limao has quit IRC02:08
*** limao has joined #tripleo02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025902:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645502:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]02:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]02:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)02:10
*** prateek has quit IRC02:11
*** ramishra has quit IRC02:11
*** salmankhan has joined #tripleo02:17
*** dparkes has quit IRC02:18
*** ramishra has joined #tripleo02:19
*** salmankhan has quit IRC02:22
*** ramishra has quit IRC02:23
*** gbarros has quit IRC02:30
*** ramishra has joined #tripleo02:30
*** ramishra has quit IRC02:42
*** ramishra has joined #tripleo02:44
*** chlong has joined #tripleo02:47
*** fragatin_ has joined #tripleo02:48
*** liverpooler has quit IRC02:50
*** ramishra has quit IRC02:50
*** fragatina has quit IRC02:52
*** ramishra has joined #tripleo02:52
*** fragatin_ has quit IRC02:53
*** ramishra has quit IRC02:56
*** ramishra has joined #tripleo02:59
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: CI test - never merge  https://review.openstack.org/46022303:03
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025903:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645503:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]03:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]03:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)03:10
*** psahoo has joined #tripleo03:34
*** morazi has joined #tripleo03:37
*** ratailor has joined #tripleo03:39
*** ratailor_ has joined #tripleo03:41
*** ratailor_ has quit IRC03:42
*** tzumainn has quit IRC03:43
*** ratailor has quit IRC03:45
*** garyk has joined #tripleo03:49
*** garyk has quit IRC03:49
*** garyk has joined #tripleo03:51
*** ramishra has quit IRC03:51
*** ramishra has joined #tripleo03:54
*** yolanda has quit IRC03:56
*** ykarel has joined #tripleo03:57
openstackgerritMerged openstack/tripleo-quickstart master: Purge CentOS OpenStack repos if they exist  https://review.openstack.org/46033904:03
*** dsariel has joined #tripleo04:04
*** yolanda has joined #tripleo04:04
openstackgerritMerged openstack-infra/tripleo-ci master: Remove centos-release-ceph-* package provided by nodepool  https://review.openstack.org/46027704:05
*** ramishra has quit IRC04:07
*** ramishra has joined #tripleo04:08
*** yolanda has quit IRC04:10
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025904:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645504:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]04:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]04:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)04:10
*** gkadam has joined #tripleo04:12
*** fragatina has joined #tripleo04:13
*** jaganathan has joined #tripleo04:13
*** nmathew has joined #tripleo04:15
*** ramishra has quit IRC04:16
*** ramishra has joined #tripleo04:16
*** fragatina has quit IRC04:21
*** udesale has joined #tripleo04:21
*** fragatina has joined #tripleo04:21
*** ratailor has joined #tripleo04:24
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: testing oooq  https://review.openstack.org/45976604:27
*** agurenko has joined #tripleo04:33
*** ramishra has quit IRC04:40
*** ramishra has joined #tripleo04:42
*** yamahata_ has joined #tripleo04:45
*** ramishra has quit IRC04:48
*** skramaja has joined #tripleo04:49
*** pgadiya has joined #tripleo04:58
*** ramishra has joined #tripleo05:00
*** Erming_ has quit IRC05:02
*** Erming_ has joined #tripleo05:02
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025905:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645505:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]05:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]05:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)05:10
*** ramishra has quit IRC05:12
*** yprokule has joined #tripleo05:12
*** pmannidi has quit IRC05:13
*** ramishra has joined #tripleo05:14
*** masco has joined #tripleo05:14
*** ratailor_ has joined #tripleo05:14
*** ratailor has quit IRC05:18
*** ratailor_ has quit IRC05:31
*** janki has joined #tripleo05:31
*** ratailor has joined #tripleo05:31
*** jaganathan has quit IRC05:39
*** iranzo has joined #tripleo05:41
*** mdnadeem has joined #tripleo05:41
*** mdnadeem has quit IRC05:42
*** mdnadeem has joined #tripleo05:42
*** mdnadeem has quit IRC05:42
*** mdnadeem has joined #tripleo05:42
*** pmannidi has joined #tripleo05:46
*** janki has quit IRC05:51
*** bkopilov has quit IRC05:52
*** bkopilov has joined #tripleo05:52
*** janki has joined #tripleo05:56
*** michapma_dsk has joined #tripleo05:56
*** janki has quit IRC05:56
*** janki has joined #tripleo05:57
jankiHey, will today's deep dive session recorded?05:58
*** prateek has joined #tripleo05:59
*** lmiccini has joined #tripleo06:02
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025906:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427206:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645506:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]06:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]06:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)06:10
*** dparkes has joined #tripleo06:11
*** ckyriakidou has joined #tripleo06:14
*** atheurer has quit IRC06:14
*** mdnadeem has quit IRC06:14
*** mdnadeem has joined #tripleo06:15
*** ccamacho has quit IRC06:19
*** idlemind has quit IRC06:24
*** idlemind has joined #tripleo06:25
*** bogdando has joined #tripleo06:26
*** janki has quit IRC06:27
*** artom has quit IRC06:30
*** artom has joined #tripleo06:30
*** janki has joined #tripleo06:31
*** cylopez has joined #tripleo06:31
*** jaganathan has joined #tripleo06:32
*** artom has quit IRC06:32
*** artom has joined #tripleo06:32
*** dparkes has quit IRC06:32
*** rwsu has quit IRC06:33
*** rwsu has joined #tripleo06:34
*** dciabrin has joined #tripleo06:38
*** jprovazn has joined #tripleo06:40
*** zoli|gone is now known as zoli06:41
*** skramaja has quit IRC06:43
*** skramaja_ has joined #tripleo06:43
*** florianf has joined #tripleo06:43
*** jlinkes has joined #tripleo06:44
*** nyechiel has joined #tripleo06:44
*** pcaruana has joined #tripleo06:44
*** d0ugal has joined #tripleo06:44
*** ratailor has quit IRC06:45
*** rwsu has quit IRC06:45
*** rwsu has joined #tripleo06:46
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Internal TLS: use common CA file parameter for libvirt CA cert  https://review.openstack.org/46002506:47
*** shardy has joined #tripleo06:50
*** shardy has quit IRC06:50
*** shardy has joined #tripleo06:51
*** jaosorior_away is now known as jaosorior06:51
jaosoriorshardy: hey, do you know where we include the base apache puppet module?06:52
shardyjaosorior: grep only shows the ui.pp profile include it directly, so I assume each of the ::service::wsgi::apache modules include it as a dependency?06:55
jaosorioryou're right, just checked the puppet-openstacklib module (that all our modules use)06:56
jaosoriorand it gets included there06:56
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/ocata: upgrades: deploy mod_ssl when upgrading apache  https://review.openstack.org/46030906:56
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Include base apache module in tls_proxy resource  https://review.openstack.org/46042306:57
jaosoriorshardy: had do this ^^06:57
*** dparkes has joined #tripleo06:59
*** dtrainor has quit IRC07:03
*** ckyriakidou has quit IRC07:07
*** Nakato has quit IRC07:08
*** Nakato has joined #tripleo07:08
*** tesseract has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025907:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645507:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]07:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)07:10
*** ramishra has quit IRC07:11
*** flepied has quit IRC07:12
*** ramishra has joined #tripleo07:12
bogdandomandre: https://review.openstack.org/#/c/460088 please take a look, the same fix as I did for rabbitmq init logs07:12
bogdando /etc can't be RO if using docker-puppet.py07:13
mandrebogdando: +207:14
bogdandofolks PTAL https://review.openstack.org/#/c/459768/ quickstart libvirt things07:14
mandrebogdando: this should go somewhere in the doc, I'll take care of it07:14
bogdandomandre: here are some docs I proposed in https://review.openstack.org/#/c/450792/ wrt undercloud deploy07:14
bogdandoor what did you mean?07:15
*** b00tcat has joined #tripleo07:16
shardychem, marios: Hey are you around?07:16
chemshardy: o/07:16
shardyHey chem, wanted to sync up quickly about the plan for minor updates for Pike07:17
shardyI was about to send a mail to openstack-dev, but wanted to check you guys are OK with my general direction first07:17
chemshardy: yeap, I've seen the mail late yesterday, put it on my todo list ... didn't get to it yet07:17
shardychem: so, with the introduction of containers, neither the yum_update or upgrade_tasks interfaces really do what we need07:17
mandrebogdando: I mean, clearly write in docs that we need to mount /etc rw for the docker_puppet_tasks, and eventually enforce this with a yaml-validate check07:17
*** aufi has joined #tripleo07:18
mariosshardy: o/ hey07:18
bogdandoah, yeah, indeed07:18
shardychem: so I've started refactoring to enable putting an ansible playbook on the host07:18
mariosshardy: we were discussing some new bzs07:18
mariosshardy: sounds good re syncup07:18
*** anshulbehl has joined #tripleo07:18
*** anshulbehl has quit IRC07:18
shardyit'll then be possible to run that playbook through all the steps during the normal yum_update workflow (which I guess we'll rename)07:18
*** anshulbehl has joined #tripleo07:18
shardymarios: o/07:18
bogdandojistr: and all, PTAL https://review.openstack.org/#/c/460042/07:18
bogdandoI really think we want this asap07:19
bogdandodebugging faily docker-puppet has a very poor UX07:19
mariosshardy: i need to go and check mail  did you send one already?07:19
*** beagles has quit IRC07:19
shardymarios: No, not yet, I just wanted to give you guys a heads up, and check you didn't think the direction I've been describing sounds like a terrible idea :)07:19
bogdandothen, we could do some multiprocessing sync exercises jistr :)07:19
shardymarios: if you're cool with it, I'll send a mail to openstack-dev and we can get into details there07:20
mariosshardy: ack ok was confused by something chem said ack ok07:20
shardyI've also been chatting with stevebaker who has some ideas about how the container replacement workflow should work07:20
mariosi mean  perhaps it is easier if we discuss there rather than you trying to explain to individuals on irc07:20
chemmarios: shardy I'm quite sure I've seen a discussion rolling somewhere, but maybe it was in my dreams O_o ?07:21
*** b3nt_pin has joined #tripleo07:21
mariosshardy: so you want to put the playbook on the host to be executed later07:21
shardychem: there's been some discussion, but not yet on the upstream list07:21
shardymarios: basically yes07:21
shardyso during the minor update we can re-run it to pull any new containers07:21
shardyon each host one at a time07:21
shardyinitially we'll use heat to do it, so all the breakpoint stuff still works (which the overcloud update CLI requires07:22
bogdandoshardy: do we have to discuss if ansible vs mistral?07:22
mariosshardy: right. so is it gathering docker/service ansible tasks still?07:22
bogdandowhat are alternatives?07:22
bogdandoI mean all as we07:22
mariosshardy: i mean how are we going to generate the playbook is the question, perhaps static for first iteration?07:23
bogdandomarios: did you mean inventory?07:23
*** yprokule_ has joined #tripleo07:23
shardymarios: On overcloud deploy we'd rewrite the playbook, but on overcloud update I think we'd just re-run it07:23
shardywhich is OK as I don't think we allow changing the deployed services during overcloud update anyway07:23
shardynone of the -e options work IIRC07:23
*** hjensas has joined #tripleo07:23
*** hjensas has quit IRC07:23
*** hjensas has joined #tripleo07:23
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Fix wrong notify in swift proxy profile  https://review.openstack.org/46042607:24
shardybogdando: IMO it's not really a question of mistral vs ansible, they are complimentary and we can't use mistral for this use-case07:24
shardywhich is basically running some commands on each host locally07:24
bogdandoshardy: well, update is a workflow...07:24
bogdandowe could be using Mistral for any a workflow07:24
shardybogdando: we could perhaps in future, but it'll break the current CI workflow for updates07:25
bogdandoshardy: I see07:25
shardykeeping the workflow driven via heat for this first pass is going to be simpler I think07:25
shardybogdando: but yes, in future perhaps we could have mistral drive it instead07:25
*** yprokule has quit IRC07:25
*** yprokule_ is now known as yprokule07:25
bogdandoI'm asking cuz I know there are some things Mistral does, so just thinking why not07:26
mariosshardy: ack yeah makes sense indeed we don't allow service changes in minor update ... so the playbook is generated from some service specific tasks - are you defining new update tasks?07:26
shardyin that case we'd have mistral run ansible I think, as mistral still doesn't provide a good replacement for the configuration aspects07:26
bogdandooh I didn't know that07:26
shardymarios: atm no update_tasks, as I'm hoping we can just replace the containers07:27
mariosshardy: cool :D07:27
shardymarios: but yeah if we needed specific extra tasks that run on update we could wire them in07:27
mariosshardy: maybe some kind of 'stop'/'kill task or does docker do all that for us07:27
d0ugalshardy: btw, I think the tripleo.deployment.v1.deploy_on_servers action allows running commands on each host.07:28
shardymarios: stevebaker has a library (derived from the heat docker-cmd hook) which does some of that for us07:28
shardyhttps://github.com/steveb/paunch07:28
mariosshardy: i see thanks07:29
shardymarios: it's planned to be included as a tripleo project, so we can probably just use that07:29
shardyd0ugal: sure, it's more the other features of ansible like looking, j2 templating and conditionals07:29
*** ffiore has joined #tripleo07:29
shardyd0ugal: I think running ansible via mistral could be great, but I'm not so keen on a clean-sheet mistral only implementation07:30
d0ugalshardy: indeed :) my goal is to make the two work together as well as possible anyway07:30
*** Nakato has quit IRC07:30
shardyI think a major complaint from operators is familiarity, so I think it's a generally good thing to move towards some ansible pieces that can be run manually for debugging etc07:30
d0ugalmakes sense.07:30
shardyd0ugal: ack, sounds good07:30
mariosshardy: so in this case what goes in the ansible playbook? i mean if we are replacing? is it the config for the new container?07:31
*** Nakato has joined #tripleo07:31
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Skipping build image for periodic tempest jobs  https://review.openstack.org/45998107:32
shardymarios: you can see the WIP playbook here https://review.openstack.org/#/c/460285/1/docker/docker-steps.j207:32
shardymarios: basically yes we write some json configuration files defining the containers to run and their config07:33
mariosshardy: thanks looking07:33
shardymarios: then we run paunch which starts the containers07:33
shardymarios: I also moved running puppet on the host to the same playbook, so you can run all tripleo configuration end-to-end via one playbook07:33
mariosshardy: ack makes sense07:34
shardymarios: actually there are two playbooks in there atm, one runs only on the boostrap node07:34
shardybut I'm iterating towards one mega-playbook we write everywhere ;)07:34
*** pmannidi has quit IRC07:35
shardybogdando: this also makes the dependencies much clearer I think - it's just the order of tasks, and the steps07:35
shardyI rememmber we discussed that last week, and hopefully this shows what I was talking about :)07:36
*** jpich has joined #tripleo07:36
*** mcornea has joined #tripleo07:36
*** brault has joined #tripleo07:37
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Skipping build image for periodic tempest jobs  https://review.openstack.org/45998107:37
*** amoralej|off is now known as amoralej07:39
mariosthanks for the info shardy and since you asked this sounds like a sane thing to do - going to have to spend at least some of today on BZs but we have been trying to break free and get more involved here for a while - as I keep saying :/07:39
chemshardy: yeah, thanks07:40
shardymarios, chem: Ok cool, yeah sorry for the big dump of information, I just wanted to give visibility of the work so far, as I know you've been super busy with bugs etc07:40
bogdandoshardy: "moved running puppet on the host to the same playbook" I new that at some point we'll start running puppet from ansible playbooks!07:41
shardyI'll start the openstack-dev thread and we can continue discusing there, and perhaps have a call next week if needed07:41
shardyin the meantime I'll work with stevebaker to hopefully get this initial prototype functional07:41
*** karthiks has joined #tripleo07:41
*** ramishra has quit IRC07:41
bogdandoshardy: "one mega-playbook" I believe true powers of ansible in small playbooks, driven by custom data settings07:42
bogdandoand dynamic inventories ofc07:42
shardybogdando: haha, yeah - it's really for backwards compatibility tho, if/when we get everything in containers we could deprecate the puppet configuration of the host07:42
shardybogdando: yeah I know, but given our current architecture, this is a stepping stone to a more typical ansible usage07:42
shardybogdando: e.g we now have a list of tasks instead of like 30 different SoftwareDeployments with hard to understand depends_on07:43
*** ramishra has joined #tripleo07:43
shardyI think that's an improvement, and we can do it without breaking any interfaces07:43
bogdandowould be glad to join discussions , testing, pair programming what ever, shardy, thanks for doing this !07:43
bogdandowill be *07:43
bogdandoI really love ansible, so do I puppet07:44
shardybogdando: it's true to say we might have a future iteration which makes better use of ansible roles etc, but that's not my target in this iteration07:44
*** flepied has joined #tripleo07:44
*** dtantsur|afk is now known as dtantsur07:44
skramaja_can someone take a look at - https://review.openstack.org/#/c/459168/ - already has a +207:46
*** skramaja_ is now known as skramaja07:46
bandinimarios: when you get a sec can you recheck https://review.openstack.org/#/c/459998/ I added a comment07:48
bandinis/recheck/review/07:49
*** dbecker has joined #tripleo07:49
mariosthanks bandini07:50
*** jpena|off is now known as jpena07:50
mariosbandini: you just need to pimp https://review.openstack.org/#/c/459994/ a bit this morning and should be gtg :D07:52
bandinimarios: sweet07:53
bandinishardy: could you take a peek at https://review.openstack.org/#/c/459994/ if you have a sec?07:53
bandinijistr: ^07:53
mariosskramaja: dome07:54
mariosdone even sorry07:54
skramajathanks marios and jaosorior07:55
shardybandini: ack will do07:57
bandinishardy: thanks!07:57
*** jchhatbar has joined #tripleo07:58
*** zoli is now known as zoli|doc-appt07:58
*** zzzeek has quit IRC08:00
*** zzzeek has joined #tripleo08:00
*** janki has quit IRC08:00
*** janki has joined #tripleo08:04
*** jchhatbar has quit IRC08:05
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS-everywhere: Add missing profiles to docker compute services  https://review.openstack.org/46043508:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025908:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645508:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]08:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]08:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)08:10
*** lucas-afk is now known as lucasagomes08:17
bogdandofolks, do you know something about containerized ironic pxe httpd port 80 in use conflict? I saw something discussed on that topic, can't find the patch...08:18
bogdandoit seems I have it on my dev undercloud env08:18
bogdandothe issue08:18
*** nyechiel has quit IRC08:20
*** nyechiel has joined #tripleo08:21
*** yprokule_ has joined #tripleo08:23
*** bkopilov has quit IRC08:23
*** trozet has joined #tripleo08:24
*** yprokule has quit IRC08:25
*** yprokule_ is now known as yprokule08:25
*** pgadiya has quit IRC08:26
*** nyechiel has quit IRC08:26
*** shardy has quit IRC08:27
bogdandomandre: it seems like https://review.openstack.org/#/c/449040/ https://review.openstack.org/#/c/450731/ to be done for ironic_pxe_http as well...08:27
mandrebogdando: unless I'm misunderstanding your question it's already the case, https://review.openstack.org/#/c/450731/1/docker/ironic/ironic-pxe/Dockerfile.j208:29
bogdandomandre: indeed. Then I have something sepcific to my env08:30
bogdandomandre: I have httpd running undercloud host, thus ironic pxe can't be started08:31
bogdandoin container08:31
*** garyk has quit IRC08:33
mandrebogdando: which port is apache in your ironic pxe container trying to bind?08:33
bogdandomandre: 8008:34
jaosorioradarazs: if you have time could you check these out https://review.openstack.org/#/c/451523/ https://review.openstack.org/#/c/453223/ https://review.openstack.org/#/c/436198/ ?08:34
bogdandoI deploy with this file as undercloud role data https://github.com/bogdando/tripleo-heat-templates/blob/dev/environments/mini.yaml08:34
adarazsjaosorior: I'll find some time for it a bit later, have to wrap some other stuff up before.08:34
*** dtantsur is now known as dtantsur|lunch08:34
bogdandomandre: I disabled apache service, not sure why it's running at host08:35
bogdandomandre: wait, I got it! I use https://github.com/bogdando/tripleo-heat-templates/commit/89db6d58b7cb760b9ebfdfad58b8272a8a045b2f env. Which runs heat-api on host08:36
bogdandoso this seems installing httpd on host as well, and conflicts to ironix pxe http in container08:36
bogdandoa hybrid envs inconsequences...08:36
mandrebogdando: yeah, but I'm still confused why your container binds port 80, I though ironic-pxe was using a different port08:37
*** enrraja has joined #tripleo08:38
bogdandoI deploy with https://github.com/bogdando/oooq-warp/blob/master/custom.yaml_example#L74-L77 and my custom patch https://review.openstack.org/#/c/450792/ . Basically testing hostpath mounted logs. Well, FWIW logs are OK to go08:38
bogdandomandre: a bug?08:38
bogdandowell, not ironic pxe itself, it's running WSGI apache08:38
bogdandoand that one binds host:8008:38
*** jbadiapa has quit IRC08:39
bogdandomay be I have an old version of openstack-kolla08:39
bogdandomandre: oh, wait, I'm using upstream kolla images, not building any08:39
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: TripleO CI mixed release master UC / ocata OC  https://review.openstack.org/45978908:40
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Add featureset011 - upgrade from BM to containerized  https://review.openstack.org/45029508:40
bogdandoit should be there with your patch included08:40
bogdando(not really sure if tripleoupstream/centos-binary-ironic-pxe:latest is upstream and has it though)08:40
mandrebogdando: you should check the apache configuration for ironic-pxe that puppet generated08:41
bogdandomandre: strange, but there is no Listen: 80 in the /etc/httpd dir configs of the container08:43
*** jbadiapa has joined #tripleo08:45
bogdandomandre: got it: /var/lib/config-data/ironic/etc/httpd/conf/ports.conf:Listen 192.168.23.48:8008:45
*** d0ugal has quit IRC08:45
bogdandoso I'll file a "hybrid case" bug then08:45
mandrebogdando: yep, seems like it08:46
mandrehmm, but what's taking port 80 on the host?08:46
enrrajaHi, I need some help08:47
*** ccamacho has joined #tripleo08:47
*** janki has quit IRC08:48
*** janki has joined #tripleo08:50
enrrajaI trying to create ovs patch port with VLAN tag08:51
enrrajaand code is here https://paste.fedoraproject.org/paste/v2T5rSTzykbg2MniLmoHK15M1UNdIGYhyRLivL9gydE=08:51
*** garyk has joined #tripleo08:51
bogdandomandre: heat api running under WSGI08:52
*** bkopilov has joined #tripleo08:52
mandrebogdando: I'm pretty sure heat-api normally runs on a different port08:53
mandrebogdando: port 800408:54
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373108:54
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357608:54
bogdandomandre: that's that I have https://pastebin.com/hFQfrsEW08:54
bogdandomandre: um, sorry, missed the full ss output, it is: [root@undercloud log]# ss -untap | grep :8008:55
bogdandotcp    LISTEN     0      128    192.168.23.48:80                    *:*                   users:(("httpd",pid=2526,fd=5),("httpd",pid=2525,fd=5),("httpd",pid=2524,fd=5),("httpd",pid=2523,fd=5),("httpd",pid=2522,fd=5),("httpd",pid=2521,fd=5),("httpd",pid=2520,fd=5),("httpd",pid=2519,fd=5),("httpd",pid=1249,fd=5))08:55
bogdandoand the latter is the host OS httpd main process's pid08:55
mandrebogdando: right, this doesn't mean it's heat-api that's binding port 8008:56
bogdandoright08:56
mandrebogdando: you should check apache configuration08:56
bogdandomandre: grep -Er '\s\b80' /etc/httpd/08:57
bogdando/etc/httpd/conf/httpd.conf:#Listen 8008:57
bogdandostrange things08:57
*** hewbrocca_afk is now known as hewbrocca08:58
*** derekh has joined #tripleo08:59
*** ffiore has quit IRC09:00
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: test do not review  https://review.openstack.org/46045709:00
*** salmankhan has joined #tripleo09:03
*** d0ugal has joined #tripleo09:04
*** d0ugal has quit IRC09:04
*** d0ugal has joined #tripleo09:04
bogdandomandre: updated the bug descr09:05
*** flepied1 has joined #tripleo09:07
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Upgrade to containerized overcloud  https://review.openstack.org/44857609:07
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025909:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427209:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645509:10
*** ooolpbot has quit IRC09:10
*** ffiore has joined #tripleo09:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]09:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)09:10
*** flepied has quit IRC09:10
*** ramishra has quit IRC09:12
*** ratailor has joined #tripleo09:18
bogdandomandre: so, the fresh undercloud node prepared by quickstart libvirt role has httpd config with Listen 80. But it is disabled/not running. Then we deploy any of the httpd-wsgi openstack services at host, it gets started by puppet and voila09:19
*** ramishra has joined #tripleo09:21
*** ratailor has quit IRC09:22
*** ratailor has joined #tripleo09:22
bogdandoso the fix is perhaps to puppet-tripleo to remove Listen 80 from httpd config09:24
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade  https://review.openstack.org/46006109:24
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI  https://review.openstack.org/45078409:24
*** limao has quit IRC09:24
mandrebogdando: aha!09:25
mandrebogdando: I believe puppet already prunes the apache config09:25
mandreor is supposed to09:25
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade  https://review.openstack.org/46006109:26
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI  https://review.openstack.org/45078409:26
bogdandomandre: actually, there is no pxe profile09:27
bogdandoall it has is manifests/profile/base/ironic/conductor.pp:          include ::ironic::pxe09:28
*** salmankhan1 has joined #tripleo09:28
*** salmankhan has quit IRC09:32
*** salmankhan1 is now known as salmankhan09:32
openstackgerritDougal Matthews proposed openstack/instack-undercloud master: Gate test  https://review.openstack.org/45964109:38
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: [WIP] Try fixing redis container  https://review.openstack.org/46046909:39
*** ebarrera has joined #tripleo09:39
openstackgerritJulie Pichon proposed openstack/python-tripleoclient master: Use Swift to store Plan environment  https://review.openstack.org/45384109:40
*** thrash|g0ne is now known as thrash09:42
*** garyk has quit IRC09:56
*** dixiaoli has quit IRC09:57
jaosoriorjistr, marios: Do you guys know if anything is using the default vhost from apache?09:58
jaosoriorthis 15-default.conf ?09:58
jistrhm no i'm not very familiar with this area09:59
mariosjaosorior: don't know either jaosorior10:00
jistrif there was something using it i'd expect it to be horizon most probably... dunno though10:00
mariosjaosorior: well we are creating it10:00
mariosjaosorior: and yeah i would also have guess the ui10:01
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: collect-logs: add README for log files  https://review.openstack.org/45631710:01
*** tosky has joined #tripleo10:01
mariosjaosorior: oh not us is managed by puppet10:01
*** d0ugal has quit IRC10:01
mariosjaosorior: well 'us' but it is the module default i expect? unless it is the UI but i'd expect more in there10:01
mariosjaosorior: jistr don't think its ui since we already have a 10-horizon-vhost bth10:03
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: test do not review  https://review.openstack.org/46045710:04
jaosoriormarios, jistr: Then I guess nothing is using it. Lets remove it :D10:08
*** d0ugal has joined #tripleo10:08
jaosoriorbogdando: ^^10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025910:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427210:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645510:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]10:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]10:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)10:10
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: test do not review  https://review.openstack.org/46045710:13
*** zoli|doc-appt is now known as zoli10:13
bogdandojaosorior: ack10:14
*** shardy has joined #tripleo10:17
*** zoli is now known as zoli|lunch10:18
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Disable default vhost for apache  https://review.openstack.org/46048810:19
jaosoriorbogdando: awesome, thanks!10:20
*** cylopez has quit IRC10:20
*** flepied1 has quit IRC10:21
*** d0ugal has quit IRC10:21
*** salmankhan has quit IRC10:22
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Disable default vhost for apache undercloud  https://review.openstack.org/46049110:25
*** cylopez has joined #tripleo10:25
bogdandojaosorior: one more10:26
*** d0ugal has joined #tripleo10:27
jaosoriorbogdando: is the one for quickstart-extras needed? If we land the t-h-t change it would apply there as well AFAIK10:27
*** atoth has joined #tripleo10:27
*** paramite has joined #tripleo10:30
*** nmathew has quit IRC10:30
*** nyechiel has joined #tripleo10:32
*** flepied has joined #tripleo10:35
*** jkilpatr has quit IRC10:38
*** salmankhan has joined #tripleo10:39
*** adarazs is now known as adarazs_lunch10:40
*** fragatina has quit IRC10:40
*** fragatina has joined #tripleo10:41
*** morazi has quit IRC10:44
*** d0ugal has quit IRC10:45
*** cylopez has quit IRC10:47
*** dtantsur|lunch is now known as dtantsur10:47
dr_gogeta86good morning all10:48
*** tvignaud_ has joined #tripleo10:49
*** tvignaud has quit IRC10:50
*** enrraja_ has joined #tripleo10:54
*** enrraja has quit IRC10:54
EmilienMGood morning folks10:58
*** jpena is now known as jpena|lunch10:59
*** garyk has joined #tripleo11:01
*** gfidente has joined #tripleo11:01
*** d0ugal has joined #tripleo11:06
*** udesale has quit IRC11:06
*** jkilpatr has joined #tripleo11:08
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025911:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427211:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645511:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]11:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]11:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)11:10
openstackgerritMerged openstack/tripleo-heat-templates master: Fix etcd_init_task volume  https://review.openstack.org/46008811:13
EmilienMshardy: quick question about https://review.openstack.org/#/c/460292/ - do you think we should also move the "httpd restart" task from wsgi services into apache.yaml?11:16
EmilienMshardy: it would make upgrades faster I think because we would only restart apache one time11:16
EmilienMinstead of X number of WSGI services running on a node11:16
EmilienMchem, marios: ^ also11:17
*** ansmith has quit IRC11:18
*** ebarrera has quit IRC11:19
*** enrraja has joined #tripleo11:19
chemEmilienM: are we sure about that (ie the run only stuff), I mean we're creating a upgrade task wich will have it in all services11:19
chemEmilienM: I mean the rendered ansible tasks will look the same11:20
mariosEmilienM: so duplicates should be removed by the yaql but checking the review more closely to see what exactly you mean11:20
chemEmilienM: but it will remove duplicate in the code, so that's good11:20
EmilienMmarios, chem: ah nevermind11:21
mariosEmilienM: which is the restart i mean i see the addition of mod_ssl install11:21
EmilienMwe don't restart httpd11:21
EmilienMwe stop it only11:21
EmilienMerr nevermind. I just woke up11:21
mariosEmilienM: ack11:21
chemEmilienM: enjoy your coffee :)11:22
EmilienMyeah...11:22
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/ocata: undercloud/upgrade: change ownership for ironic-dbsync.log  https://review.openstack.org/46050811:23
openstackgerritMerged openstack/tripleo-heat-templates master: Upgrade failure when service parameter is changed for PankoApi  https://review.openstack.org/45916811:24
openstackgerritMerged openstack/puppet-tripleo master: Add a flag to rabbitmq so that we can deploy with ha-mode: all again  https://review.openstack.org/45999411:24
EmilienMbnemec, mwhahaha: we have all Mitaka jobs green now: https://review.openstack.org/#/c/460223/11:25
*** jaganathan has quit IRC11:25
EmilienMwith ceph-0.94.9-0.el7.x86_64 (hammer) again11:26
EmilienMbnemec, mwhahaha : so now, i'm engaging EOL for tripleo mitaka11:26
shardyEmilienM: yeah we could, but I think it'd still run the same number of times?11:26
shardyEmilienM: e.g there would still be duplicate tasks in the list, unless we somehow filtered them?11:26
shardyEmilienM: also note we don't restart httpd, we just stop it11:26
shardyso most of the duplicate tasks are probably pretty fast11:27
*** lucasagomes is now known as lucas-hungry11:27
*** rhallisey has joined #tripleo11:27
shardyEmilienM: hey can you pls check https://review.openstack.org/#/c/458250/, it's waiting on PTL vote11:28
*** shardy is now known as shardy_lunch11:28
*** adarazs_lunch is now known as adarazs11:28
adarazssshnaidm|afk: let me know if you're around, I wanted to ask you about how the OVB behaved in the last week or so with the new config.11:29
EmilienMshardy_lunch: ok good to know11:30
*** prateek has quit IRC11:30
EmilienMshardy_lunch: +1 done11:30
paramitehey guys, can we get this backport merged? https://review.openstack.org/#/c/460102/11:31
bogdandojaosorior: it seems we don't11:32
EmilienMparamite: a documentation thing?11:32
paramiteEmilienM, yup11:32
EmilienMmhh11:32
EmilienMI mean, I love doc, etc11:32
paramitebut? :)11:33
EmilienMparamite: have you read OpenStack backport policies?11:33
paramiteEmilienM, long time ago, what's wrong with the backport?11:33
EmilienMhttps://docs.openstack.org/project-team-guide/stable-branches.html#appropriate-fixes11:33
* paramite checking11:34
*** hjensas has quit IRC11:34
EmilienMparamite: i've +211:34
*** hjensas has joined #tripleo11:35
dtantsurFYI we chatted with the stable team, and they told us that doc backports are fine11:36
dtantsurso we've been doing them for some time11:36
dtantsurwe = ironic ofc11:36
dtantsurwe backported our whole install-guide from ocata to newton some time ago :D11:36
paramiteEmilienM, ok thanks, but still: The risk of regression: none; The user visible benefit: it's a documentation ...; How self-contained the fix is: enough I would say; Whether the fix is already on master and all consequent stable branches: done ... so I'm curious what's wrong ... or you just hate me :)11:37
*** pkovar has joined #tripleo11:38
EmilienMdtantsur: good to know11:38
EmilienMparamite: I'll approve it then11:38
paramiteEmilienM, thanks :)11:39
EmilienMtherve: I can abandon this one I guess11:39
EmilienMhttps://review.openstack.org/#/c/460273/3/manifests/profile/base/zaqar.pp11:39
jtomasekhonza, florianf: can we get https://review.openstack.org/#/c/460142/ merged, please?11:39
therveEmilienM, If you want. We'd need to remember it if we ever want to enable swift in the overcloud.11:39
florianfjtomasek: It's on its way...11:41
*** prateek has joined #tripleo11:41
jistrsshnaidm|afk: thanks again for the reviews! I amended the patches, and the container upgrade job finished successfully again at https://review.openstack.org/#/c/450784/ please take a look when you have a moment :)11:41
jtomasekflorianf: thanks!11:41
EmilienMtherve: and if we don't remember, CI will fail :)11:41
*** zoli|lunch is now known as zoli11:42
*** abishop has joined #tripleo11:45
bogdandojaosorior: https://review.openstack.org/460488 worked for me11:45
therveEmilienM, Well, one completely unrelated CI fails at some point, yes :p11:45
jaosoriorbogdando: brilliant!11:46
jaosoriorbogdando: you already have my +2 there :)11:46
bogdandoright :)11:46
bogdandofolks, PTAL as well!11:46
jistr+2'd too11:47
jaosoriorjistr: if you have some time could you check this out https://review.openstack.org/#/c/460435/ ?11:48
*** prateek_ has joined #tripleo11:48
jistrsure11:48
jistrjaosorior: makes sense. We don't have that CI'd anywhere yet, right? So check experimental is not needed i presume.11:49
*** jayg|g0n3 is now known as jayg11:49
jaosoriorjistr: correct11:50
*** prateek has quit IRC11:51
jkilpatranyone else seeing failures on ovb-manage-stack instackenv generation? It worked for this job yesterday morning, failed yesterday night and continues to fail.11:53
jistrmandre, jaosorior: if/when you have some bandwidth, could you please take another peek at https://review.openstack.org/#/c/460435/ ? I addressed sshnaidm|afk 's reviews.11:54
jistrmandre, jaosorior: i mean that and the 2 depends-on11:55
jaosoriorjistr: sure11:55
*** dprince has joined #tripleo11:55
jaosoriorjistr: I think you passed the wrong link11:56
*** jcoufal has joined #tripleo11:56
jistrjaosorior, mandre: sorry, this one and deps https://review.openstack.org/#/c/450784/11:56
* bogdando has an achievement unlocked: a first working (kind of) undercloud by quickstart11:57
dr_gogeta86hi11:57
dr_gogeta86bogdando, just a simple question11:57
bogdandoat least openstack CLI now says something to me11:57
dr_gogeta86how to setup Ironic::Drivers::Ilo/Ironic_config[ilo/default_boot_mode] into a yaml11:58
dr_gogeta86?11:58
bogdandodr_gogeta86: I can't answer that, sorry11:58
dr_gogeta86tnx you11:59
*** morazi has joined #tripleo11:59
*** milan has joined #tripleo12:00
jistrdr_gogeta86: IIUC you want to change the value of that param via a Heat environment file when deploying with tripleo?12:01
jistrdr_gogeta86: see http://tripleo.org/advanced_deployment/node_config.html12:01
*** dsariel has quit IRC12:01
dr_gogeta86i'm talking about undercloud sorry :-)12:01
jistrah ok, right it makes sense for ironic :) i'm just too used to dealing with overcloud haha12:02
jistrhmm not sure off the top of my head but i bet we have something for that too12:02
dr_gogeta86next step ... i dunno why my undercloud wen wreck after too many deploy12:03
shardy_lunchdr_gogeta86: You can set a hieradata_override file in undercloud.conf12:04
*** shardy_lunch is now known as shardy12:04
*** ffiore has quit IRC12:04
dr_gogeta86did it already12:05
jistryea just found it. It's mentioned here (in another context) https://docs.openstack.org/developer/tripleo-docs/advanced_deployment/deployed_server.html#undercloud12:05
dr_gogeta86but how to configure things wheren't into default topic12:05
dr_gogeta86like that12:05
*** ratailor_ has joined #tripleo12:06
*** pradk has joined #tripleo12:06
jistrthanks jaosorior12:07
*** jpena|lunch is now known as jpena12:08
*** ratailor has quit IRC12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025912:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427212:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168645512:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]12:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]12:10
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)12:10
jistrdr_gogeta86: not sure if i understand the last question. but if you want to configure the ilo default boot mode, the hiera key for that is ironic::drivers::ilo::default_boot_mode12:12
jistrhttps://github.com/openstack/puppet-ironic/blob/master/manifests/drivers/ilo.pp#L4512:12
dr_gogeta86so  ironic::drivers::ilo::default_boot_mode: uefi ... and I'm done ?12:13
mandrepradk: I was wrong when I said the redis container couldn't impact CI in https://review.openstack.org/#/c/442151/ :-/12:13
jistrdr_gogeta86: yea that and point the hieradata_override in undercloud.conf to the file where this is, and you're done12:14
pradkmandre, question is why is the .puppet file not getting copied12:14
pradkmandre, i see it in the logs12:15
pradkmandre, using .puppet file directly seems incorrect12:15
mandrepradk: I responded in https://review.openstack.org/#/c/460469/, that's because we disabled the 'exec' puppet tag12:15
pradkmandre, ah ok12:16
panda|bblEmilienM: who has the power of recording, for the deep dive bluejeans channel ?12:22
*** enrraja_ has quit IRC12:23
*** enrraja has quit IRC12:23
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Use EnpointMap port to create firewall rules.  https://review.openstack.org/46052612:25
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Use EnpointMap port to create firewall rules.  https://review.openstack.org/46052612:25
*** garyk has quit IRC12:29
*** gbarros has joined #tripleo12:30
*** ratailor_ has quit IRC12:30
*** ramishra_ has joined #tripleo12:31
*** rlandy has joined #tripleo12:31
EmilienMpanda|bbl: owner of the BJ12:31
jaosoriorEmilienM: the deep dive is in half an hour, right?12:32
jaosoriorpanda|bbl: ^^12:32
EmilienMyeah? i thought it was in 1h3012:33
adarazsEmilienM, jaosorior: not at 14:30 UTC when we normally have the CI Squad meeting?12:33
adarazsthat's ~2 hours from now.12:34
jaosoriorouh12:34
jaosoriorok12:34
*** gvrangan_ has quit IRC12:35
adarazsthough I'm not super sure about that, but that's what I gathered.12:35
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DONT REVIEW: testing ooq timeout  https://review.openstack.org/46052912:37
*** salmankhan has quit IRC12:38
*** liverpooler has joined #tripleo12:38
*** dsariel has joined #tripleo12:39
panda|bblyes, 1400 UTC12:40
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Fix for the resource ControllerPostPuppetMaintenanceModeDeployment  https://review.openstack.org/46045712:40
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Fix redis container picking wrong config file  https://review.openstack.org/46046912:41
*** gkadam has quit IRC12:41
*** ramishra_ has quit IRC12:41
ccamachohey shardy morning! Im checking https://bugs.launchpad.net/tripleo/+bug/1686619, think I got the issue12:42
openstackLaunchpad bug 1686619 in tripleo "upgrades CI error ControllerPostPuppetMaintenanceModeDeployment" [High,In progress] - Assigned to Carlos Camacho (ccamacho)12:42
*** jmelvin has joined #tripleo12:45
*** ansmith has joined #tripleo12:45
weshaypabelanger, have an infra review for arxcruz if you have a minute https://review.openstack.org/#/c/458054/12:47
arxcruzweshay: thanks, I ping pabelanger on #o-infra but I guess was too earlier for him :)12:47
dr_gogeta86jistr, doesn't work ... I alwauy found bios :-(12:50
bogdandoif I re-run undercloud deploy, why there is so much of CREATE_COMPLETE  state changed ?12:53
bogdandoI supposed the vast majority to be omitted due to idempotency et al12:53
*** lucas-hungry is now known as lucasagomes12:53
bogdandoWell, I know the answer for passwords/secrets, but what stands for changing VIPs?12:53
bogdandoand networks12:53
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921512:54
bogdandoServiceChain/PuppetServices... basically everything reports changed12:54
bogdandoshardy: ^^ could you help please? Do I missing something important for Heat under the hood?12:54
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Simplify Node Ports fetching  https://review.openstack.org/45962812:55
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Update to latest Patternfly  https://review.openstack.org/46053412:55
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Remove Nodes NavTabs  https://review.openstack.org/46053512:55
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] NodesListView and ListView components  https://review.openstack.org/46053612:55
jistrdr_gogeta86: hmm then i don't know :( the default setting is here https://github.com/openstack/instack-undercloud/blob/master/elements/puppet-stack-config/puppet-stack-config.yaml.template#L57012:56
shardybogdando: for undercloud deploy the stack is newly created every time, nothing is persisted AFAIK12:56
jistrdr_gogeta86: but the override file you crafted should take priority over that12:56
bogdandoand my 2nd naive question,  why heat stack-list is empty undercloud?..12:56
shardybogdando: but the underlying configuration should be idempotent12:56
dr_gogeta86i'm trying to fix the undercloud through yaml12:56
bogdandohow do you normally see/debug that's was createD?12:56
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Fix redis container picking wrong config file  https://review.openstack.org/46046912:56
shardybogdando: because you just deployed a new heat, with nothing in the DB12:57
dr_gogeta86intestead using a script12:57
bogdandocould I hack in the sqlite db of heat-config somehow?12:57
bogdandoshardy:12:57
dmsimardsshnaidm|afk: let me know when you're around, need to check something with the periodic tripleo-ci jobs12:57
*** sshnaidm|afk is now known as sshnaidm12:58
shardybogdando: I normally look at the log output from undercloud deploy, it shows all the configuration steps that occur on the node12:58
sshnaidmdmsimard, yep12:58
*** vkhanna has joined #tripleo12:58
shardybogdando: not sure tbh, I thought all data was transient, but dprince may know more12:58
adarazssshnaidm: can you also update https://etherpad.openstack.org/p/tripleo-ci-squad-meeting on line 35 with a short summary about the state of the almost-transitioned-OVB jobs?12:58
dmsimardsshnaidm: It seems the periodic jobs used for promotion are using trunk.rdoproject.org/current/ instead of trunk.rdoproject.org/consistent/12:58
bogdandoshardy: thanks12:58
*** vkhanna has quit IRC12:58
sshnaidmadarazs, will do12:59
dmsimardsshnaidm: /current/ should not be used for promotions, the repository currently promoted is not consistent, can we fix that ?12:59
*** vkhanna has joined #tripleo12:59
bogdandobut this really looks strange that undercloud deploy idempotent run takes soooo loong12:59
sshnaidmdmsimard, hmm.. checking12:59
*** adarazs is now known as adarazs_brb12:59
bogdandoeven if it changes nothing, it still aplies all it seems12:59
bogdandoa great area to improve12:59
dmsimardsshnaidm: I found this in an ocata periodic job logs COMMAND=/bin/curl -Lvo /etc/yum.repos.d//delorean.repo https://trunk.rdoproject.org/centos7-ocata/current//delorean.repo13:00
dmsimardsshnaidm: I'm not sure where that's in the actual job13:00
*** japestinho has quit IRC13:00
dmsimardor code13:00
*** dparkes has quit IRC13:00
jtomasekflorianf: there are 2 small patches pending on review https://review.openstack.org/#/c/454169/ https://review.openstack.org/45319413:00
*** ffiore has joined #tripleo13:00
jtomasekflorianf: I'd like to rebase my patchsets once those get merged in13:00
EmilienMsshnaidm: I agree with dmsimard, we should use consistent for promotion13:01
shardybogdando: I think there's a bug where we always restart the containers, even when the images are the same13:01
shardybogdando: but it's expected that we run all the configuration steps again13:01
sshnaidmEmilienM, of course we should, checking if it's really wrong configured..13:01
EmilienMok13:01
bogdandoshardy: that's clear, puppet must reconfigure if anything changed13:01
EmilienMmwhahaha: can we stop alert on https://bugs.launchpad.net/tripleo/+bug/1686455 ?13:01
openstackLaunchpad bug 1686455 in tripleo "Mitaka and Newton jobs broken on splay error" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)13:01
florianfjtomasek: thanks, will have a look13:01
EmilienMmwhahaha: nevermind, you replied13:01
mwhahahaEmilienM: bogdando removed alert i believe13:01
bogdandomwhahaha: yes13:02
shardybogdando: yup, but I think we shouldn't restart containers when the image is the same - AFAICS we docker rm all of them every time13:02
mwhahahaEmilienM: i'm checking the status of it today to close it13:02
shardywhich probably wastes some time13:02
EmilienMmwhahaha: ok, thx13:02
jtomasekflorianf: thanks13:02
*** d0ugal has quit IRC13:04
EmilienMzaneb, bnemec: re: https://bugs.launchpad.net/tripleo/+bug/1684272 - even with the revert in Heat (https://review.openstack.org/#/c/458813/) we still have ovb-updates that timeouts, though we saved ~200 seconds on ControllerServiceChain (from 547 to 339 now)13:04
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]13:04
*** trown|outtypewww is now known as trown13:04
*** prateek_ has quit IRC13:06
sshnaidmEmilienM, dmsimard from what I see, we use both consistent and "current" repos in promotion jobs. We can promote consistent only, but we can use some packages in the job from current repo: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha/a7dadfd/console.html#_2017-04-27_06_09_52_64046813:07
sshnaidmEmilienM, dmsimard and this is not good, I gonna fix it..13:07
dmsimardsshnaidm: I think that gate jobs use /current/13:08
sshnaidmdmsimard, yes13:08
sshnaidmdmsimard, and this leaked into promotion jobs too13:08
dmsimardThe reason I was given is "we need the absolute latest" which I don't particularly agree with but whatever13:09
sshnaidmdmsimard, but I suspect it was always the situation13:09
trowndmsimard: for tripleo gates we need the absolute latest of tripleo packages13:09
trowndmsimard: otherwise depends-on is broken13:09
*** masco has quit IRC13:09
trowndmsimard: since zuul knows nothing about consistent/dlrn13:09
dmsimardAnd it knows about current ?13:09
trowndmsimard: ya... because current is everything that has merged13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025913:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427213:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]13:10
trownso once it merges a patch it is available13:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]13:10
dmsimardtrown: admittedly there can still be some lag before things lands in current but ok13:10
trownif consistent!=current then when we merge a patch with depends-on the gates would be broken because the patch is not actually available13:10
trownya some lag is not days though13:11
dmsimardBut I thought doing depends-on rebuilt the package inside the job thougb13:11
dmsimardthough*13:11
trownright... so the job would pass13:11
trownthen all following jobs would fail13:11
dmsimardOh, I see now13:11
trownbecause it passed using a package that is not in consistent13:11
*** prateek has joined #tripleo13:12
trowni agree we need to fix promotion jobs as sshnaidm mentioned above, but the gate repo setup is the way it is for a good reason13:13
dmsimardall good, I guess I never got to the bottom of why gate jobs used current13:14
*** janki is now known as janki|afk13:16
*** bswartz has joined #tripleo13:19
*** tzumainn has joined #tripleo13:20
*** d0ugal has joined #tripleo13:21
*** ffiore has quit IRC13:22
dprincebogdando: hi, per your comments here https://bugs.launchpad.net/tripleo/+bug/168671613:24
openstackLaunchpad bug 1686716 in tripleo "Undercloud deploy is not idempotent and takes a hard way to re-apply" [Medium,Triaged]13:24
dprincebogdando: the new t-h-t undercloud stack was designed to be ephemeral. That isn't a bug...13:24
dprincebogdando: we could change that, sure. But the whole point was to keep as little state as possible between runs13:24
bogdandodprince: I see. Then I'll leave only the passwords and containers concerns13:25
dprincebogdando: ack, I think steve address the passwords already in his patch13:25
dprincebogdando: and the containers restarts should be doable as well13:25
dprincebogdando: while I don't think it is a bug... we could certainly entertain keeping an undercloud heat stack around. But that is just more state... and the point of this was to eliminate as much state as possible13:26
*** chandankumar is now known as chkumar|off13:26
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224913:26
dprincebogdando: it wouldn't be hard to adapt the approach to maintain the state of the heat stack if we wanted too. And maybe someone would find value in that. To me... it was just another upgrade problem to deal with13:27
*** ffiore has joined #tripleo13:28
bogdandodprince: yes, I agree, if undercloud works as well w/o state and deploys overclouds unchanged and omits idempotent things instead of re-applying them (for overclouds), than it should stay as is13:28
bogdandothen13:28
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Add a flag to rabbitmq so that we can deploy with ha-mode: all again  https://review.openstack.org/46020413:28
sshnaidmdmsimard, trown are "current" and "consistent" repos in stable branches different? Because i see they have the same delorean hash13:29
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Add role specific information to the service template  https://review.openstack.org/43795613:29
dmsimardsshnaidm: sometimes they are the same, sometimes they are different13:30
*** lblanchard has joined #tripleo13:30
dmsimardsshnaidm: /current/ has all the new builds, regardless of status13:30
*** pkovar has quit IRC13:30
dmsimardwhile /consistent/ only has the last given set of packages with no known failure to build from source13:30
dmsimardsay, we can't build nova because of a new dep that was added13:30
*** lblanchard has quit IRC13:31
dmsimardnew packages (oslo, neutron, whatever) will keep landing in /current/ -- but the consistent symlink will only get updated once the nova failure to build has been fixed13:31
dmsimardyou know, once everything is "consistent"13:31
dmsimardOtherwise you're testing with something that technically hasn't been tested upstream (testing oslo with an "outdated" version of nova)13:31
dmsimardthere's some level of explanation in the docs http://dlrn.readthedocs.io/en/latest/repositories.html#dlrn-repository-current but that's the gist of it13:32
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates stable/newton: Touch /etc/httpd/conf.d/ssl.conf  https://review.openstack.org/46055513:32
*** lblanchard has joined #tripleo13:33
sshnaidmdmsimard, ok13:33
*** dsariel has quit IRC13:33
skramajajtomasek: did you had a chance to validate flatten output - https://review.openstack.org/#/c/450021/?13:34
jtomasekskramaja: not yet, I have it on the list, I'll try to check it tomorrow13:34
*** psahoo has quit IRC13:34
skramajathanks jtomasek13:34
jtomasekskramaja: sorry that it takes long :/13:35
*** shardy has quit IRC13:36
*** cylopez has joined #tripleo13:36
*** nyechiel has quit IRC13:36
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix repos for promotion jobs  https://review.openstack.org/46055813:38
sshnaidmdmsimard, EmilienM trown ^^13:38
jkilpatrrlandy, seeing failures on this step TASK [ovb-manage-stack : Build nodes.json file to be used as instackenv.json]  we made it past that on the first build but not since.13:40
*** adarazs_brb is now known as adarazs13:41
dmsimardsshnaidm: thanks13:43
openstackgerritLukas Bezdicka proposed openstack/puppet-tripleo stable/newton: Ensure we configure ssl.conf  https://review.openstack.org/46056013:44
rlandyjkilpatr: I just updated the commit - you need python-glanceclient in the requirements.txt due to a change in OVB yesterday13:45
*** shardy has joined #tripleo13:45
jkilpatrrlandy, should that be included in the cherrypick now or do I need it in my personal commit?13:45
*** janki|afk is now known as janki13:46
rlandyjkilpatr: if you are working from a job and not from devmode, edit the piece that modifies requirements.txt and add python-glanceclient13:46
*** salmankhan has joined #tripleo13:46
rlandyif you are working with devmode, I already updated that13:46
rlandyI am updating the jjb for the gates13:46
rlandybut your poc will not be impacted13:46
skramajajtomasek: np at all, your feedback is important.13:46
EmilienMsshnaidm: thx13:48
EmilienMsshnaidm: wait but how tripleo will get 'current' packages for tripleo projects?13:49
*** ubijtsa is now known as assassin13:49
sshnaidmEmilienM, it will, but only if gate job (CACHEUPLOAD != 1)13:50
*** limao has joined #tripleo13:51
*** ffiore has quit IRC13:51
*** anshulbehl has quit IRC13:53
panda|bblshardy: EmilienM: who's the owner of deep dive channel ?13:54
sshnaidmand what is right bluejeans link to it?13:56
shardypanda|bbl: I think whoever was talking just linked their bluejeans to https://etherpad.openstack.org/p/tripleo-deep-dive-topics13:57
bandinimeh the deep dive is today and I am stuck in another call :/13:58
EmilienMhttps://bluejeans.com/u/gcerami/13:59
shardybandini: I guess we can record it :)13:59
*** dtrainor has joined #tripleo14:00
EmilienMbandini: no worries, it's recorded14:00
panda|bbldeepd dive was moved to https://bluejeans.com/u/gcerami/14:00
*** ramishra has quit IRC14:00
*** limao_ has joined #tripleo14:01
bandinishardy, EmilienM: I forget that technology can be helpful sometimes :)14:01
EmilienMlol14:01
bandiniit'd be great if we can record it14:01
*** limao has quit IRC14:01
*** ramishra has joined #tripleo14:01
*** skramaja has quit IRC14:03
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921514:04
EmilienMsshnaidm: indeed, thx14:05
*** karthiks has quit IRC14:07
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Unset the UpgradeInitCommand on converge  https://review.openstack.org/46057114:08
*** ffiore has joined #tripleo14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025914:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427214:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]14:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]14:10
*** ratailor has joined #tripleo14:11
*** pkovar has joined #tripleo14:11
*** limao_ has quit IRC14:12
shardypradk: Hey, are you aware of any issues re ceilometer and gnocchi in the container architecture atm?14:12
shardypradk: I rebased and ceilometer-upgrade --debug --skip-metering-database is failing, I think it's because it can't reach gnocchi14:13
pradkshardy, ceilometer conatiner work hasnt merged yet14:13
pradkshardy, still under review14:13
pradkshardy, there was a bug we fixed recently14:13
shardyhttp://paste.openstack.org/show/608207/14:14
shardypradk: yeah I still have ceilometer on the host, but I'm wondering if it could be related to the recently merged redis patch?14:14
pradkshardy, no this says it cant reach the api14:15
pradkshardy, redis is only used for coordination14:15
pradkshardy, any errors in apache logs14:15
shardypradk: Ok, I see tripleoupstream/centos-binary-gnocchi-api:latest running in the container OK14:15
shardyI see two gnocchi services and 41 (!) httpd processes running in the container14:17
*** dsariel has joined #tripleo14:17
shardy[core:error] [pid 57] [client 192.168.24.19:58500] Script timed out before returning headers: app14:17
shardypradk: hmm, maybe that's related from the gnocchi_wsgi_error.log14:18
shardy ERROR gnocchi.utils [-] Unable to start coordinator: Error while reading from socket: ('Connection closed by server.',)14:18
shardypradk: in /var/log/gnocchi/app.log14:19
shardyso I guess something is broken14:19
jaosoriorcould I get a review for this https://review.openstack.org/#/c/460435/ ?14:19
*** limao has joined #tripleo14:19
pradkshardy, yea app.log is the gnocchi api log from apache.. so gnocchi api isnt up14:19
pradkshardy, how old are these conatiners? we fixed a few bugs recently14:19
shardypradk: that's a good point, I've not rebuilt them in over a week14:20
*** skramaja has joined #tripleo14:20
pradkshardy, http://logs.openstack.org/88/459388/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/a9b834e/logs/controller-0-tripleo-ci-a-foo/var/log/gnocchi/app.txt.gz14:20
pradklooking on in ovb jobs14:20
pradkok*14:20
pradkhttp://logs.openstack.org/88/459388/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/a9b834e/logs/controller-0-tripleo-ci-a-foo/var/log/ceilometer/ceilometer-upgrade.txt.gz14:21
shardypradk: ack, I guess I need to pull updated images, thanks and sorry for the noise! :)14:21
pradkshardy, np, lemme know if you still see issues14:21
*** limao has quit IRC14:23
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Fix redis container  https://review.openstack.org/46046914:23
*** limao has joined #tripleo14:24
mandrepradk: this should get us a functional redis container https://review.openstack.org/#/c/460469/14:25
*** karthiks has joined #tripleo14:25
*** prateek has quit IRC14:26
pradkmandre, cool, will test this today .. so you dint use .puppet directly14:26
pradkused exec instead, so it copies orig.. cool14:26
mandreshardy: we may be chasing the same issue, redis container was failing to start14:27
*** d0ugal has quit IRC14:28
*** ratailor has quit IRC14:29
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add 'become: true' to haproxy validation  https://review.openstack.org/46061014:32
*** d0ugal has joined #tripleo14:33
*** enrraja has joined #tripleo14:33
*** enrraja_ has joined #tripleo14:33
*** agurenko has quit IRC14:34
shardymandre: ack thanks - I'm just rebuilding the container images then will re-test with your patch14:34
*** gfidente has quit IRC14:34
*** jchhatbar has joined #tripleo14:35
*** limao has quit IRC14:35
*** gfidente has joined #tripleo14:35
*** gfidente has quit IRC14:35
*** gfidente has joined #tripleo14:35
*** janki has quit IRC14:36
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/newton: Prepare 5.6.0 release (newton)  https://review.openstack.org/46061214:38
*** d0ugal has quit IRC14:39
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/ocata: Prepare 6.4.0 release (ocata)  https://review.openstack.org/46061414:39
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat  https://review.openstack.org/46018914:41
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat  https://review.openstack.org/46018814:41
*** aufi has quit IRC14:41
*** limao has joined #tripleo14:42
skramajashardy: if you remember, we have discussed about populating hiera data before PreNetworkConfig so that DPDK can be enabled in it, there was some issue because of cyclic dependecy in the earlier version of the change, now i have spiltted the hiera data config as 2 steps. i am not sure if this is a right apporach - can you provide your views on this - https://review.openstack.org/#/c/430215/14:43
jaosoriorshardy: thanls14:43
jaosorior*thanks14:43
*** lblanchard has quit IRC14:44
*** lblanchard has joined #tripleo14:44
bnemecEmilienM: So https://review.openstack.org/#/c/460189/2 got us down to ControllerServiceChain 169.014:44
*** lblanchard has quit IRC14:44
*** cylopez has quit IRC14:44
bnemecI'm continuing to bisect heat in ci to see if I can figure out the last good commit.14:44
*** lblanchard has joined #tripleo14:45
shardyskramaja: I'm not sure that will work, won't the additional hiera erase the previous deployment?14:45
*** limao has quit IRC14:45
shardyskramaja: can you clarify what the circular dependency was?14:46
shardyAFAICS NetIpMap depends on the node existing, but not NetworkDeployment?14:46
*** limao has joined #tripleo14:47
openstackgerritJulie Pichon proposed openstack/python-tripleoclient master: Use Swift to store Plan environment  https://review.openstack.org/45384114:47
EmilienMbnemec: interesting14:47
skramajashardy: i have tested it, it is updaing the new hiera files and not earsing the previous and the hierarcy is also in tact..14:48
*** d0ugal has joined #tripleo14:48
*** cylopez has joined #tripleo14:48
skramajashardy: There is a circular dependency between ControllerDeployment, NetworkDeployment and UpdateDeployment with recent changes of https://review.openstack.org/#/c/439504/. While it is not possible to break this to move hiera population before NetworkDeployment.14:48
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Increase documentation about parameters  https://review.openstack.org/46010214:50
openstackgerritMerged openstack/tripleo-ui master: Import PropTypes separately from React  https://review.openstack.org/46014214:51
openstackgerritMerged openstack/puppet-tripleo master: Include base apache module in tls_proxy resource  https://review.openstack.org/46042314:52
shardyskramaja: I think we can remove tripleo::packages::enable_upgrade and break that dependency14:52
shardyskramaja: packages are never upgraded via puppet in our current architecture14:52
shardyonly via upgrade_tasks14:52
*** d0ugal has quit IRC14:56
*** limao has quit IRC14:57
bogdandoshardy, dprince: trying to inspect ephemeral stacks with heat CLI, when engine was switched to the temporary sqlite db. stack list/show works, but 'failures list' throws Remote error: InvalidToken: ... I'm wondering why :/14:57
*** limao has joined #tripleo14:57
bogdandothe stackrc is default one from quickstar...14:58
bogdandoand it seems keystone uses fernet now by default14:58
openstackgerritJulie Pichon proposed openstack/tripleo-common master: Use Swift to store Plan environment  https://review.openstack.org/45229114:58
bogdandoalso I've tried https://github.com/larsks/dotstack but it throws same error14:59
*** hjensas has quit IRC14:59
shardybogdando: the ephemeral heat stack is backed by a dummy keystone, are you using the password for the actual undercloud, not the installer in tripleoclient?14:59
bogdandoshardy: oh, yes, I'm using real keystone15:00
hamzythrash, for https://review.openstack.org/#/c/459704/ I tried to install it locally and am seeing a timeout and "Can not evaluate YAQL expression"  http://paste.openstack.org/show/608211/15:00
bogdandobut connection string sustitution works for heat15:00
jaosoriorbandini: how did one restart haproxy when it's ran with pacemaker?15:00
thrashhamzy: thanks.. I'll take a look at it..15:00
*** tvignaud_ has quit IRC15:00
bandinijaosorior: what's the context?15:01
openstackgerritEmilien Macchi proposed openstack/tripleo-ui stable/newton: Prepare 1.2.0 release (newton)  https://review.openstack.org/46062115:01
*** tvignaud_ has joined #tripleo15:01
EmilienMhonza, florianf, jtomasek ^ please15:01
shardybogdando: Ok I'm confused, are you talking about the undercloud deploy command?15:01
shardythat's backed by https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/fake_keystone.py15:01
shardye.g stubbed keystone so it's really noauth15:01
openstackgerritGael Chamoulaud proposed openstack/tripleo-common master: Make validation inputs configurable via Mistral  https://review.openstack.org/38376315:01
bogdandoshardy: yes. Then I did https://pastebin.com/aJH5rJQu15:02
jaosoriorbandini: the certificate was changed from haproxy, so need to restart it15:02
bandinijaosorior: if a reload is enough then systemctl is okay. otherwise pcs resource restart haproxy-clone15:03
florianfEmilienM: done15:03
bogdandoshardy: It seems I need another stackrc15:03
EmilienMflorianf: thx15:03
*** pkovar has quit IRC15:03
bogdandofor dummy keystone?15:03
shardybogdando: so you're pointing the undercloud heat at the sqlite db from the install?15:03
bogdandoshardy: yupp15:03
jaosoriorbandini: thanks15:04
shardybogdando: wouldn't it be easier to specify --keep-running then connect to the running heat-all process inside undercloud_deploy?15:05
shardyhttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/undercloud_deploy.py#L38515:05
*** trown is now known as trown|brb15:05
*** pcaruana has quit IRC15:05
trown|brbnice work panda|bbl thanks!15:05
shardybogdando: there's an auth encryption key in heat.conf, perhaps that's what is failing but it's hard to see from the error15:06
bogdandoshardy: thanks, I'll try that opt. How could I then explore stacks?15:06
bogdandoshardy: yes, engine logs mention encryption issues15:06
shardybogdando: there should be the temporary heat listenting on port 800615:06
shardyhttps://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/undercloud_deploy.py#L34215:06
*** gbarros has quit IRC15:06
shardybogdando: I've not tried, but I assume you can query it until the process gets killed15:06
*** limao has quit IRC15:08
*** limao has joined #tripleo15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025915:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427215:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]15:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]15:10
*** tellesnobrega has quit IRC15:10
*** vkhanna has left #tripleo15:10
bogdandoshardy: thank you, keep running should help15:13
*** jaosorior is now known as jaosorior_away15:13
*** limao has quit IRC15:13
*** limao has joined #tripleo15:14
EmilienMpanda|bbl: thanks for the deep dive!15:15
jistrweshay, matbu: FWIW i think the contianer upgrade CI vs. the N->O upgrade patches wouldn't conflict at all in the end. Or at least the container upgrade CI wouldn't break the N->O, and i'm hoping that holds vice versa too but i'm a bit less sure there.15:15
panda|bblEmilienM: hope it was helpful15:16
*** ebarrera has joined #tripleo15:16
adarazsEmilienM, trown, sshnaidm, weshay, hrybacki, panda|bbl, rlandy, bkero, arxcruz: CI Squad meeting in 15 minutes (this is an exception, usually it's 1 hour earlier): https://etherpad.openstack.org/p/tripleo-ci-squad-meeting15:16
*** zigo has quit IRC15:17
weshayjistr, was just looking for your patches :) you read my mind15:17
arxcruzadarazs: <o/15:17
jistrhehe15:17
panda|bblarxcruz: is that the dab move ?15:18
*** Goneri has joined #tripleo15:18
*** trown|brb is now known as trown15:18
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Fix for the resource ControllerPostPuppetMaintenanceModeDeployment  https://review.openstack.org/46045715:19
dprincebogdando: use the fake keystone like this: https://etherpad.openstack.org/p/tripleo-composable-undercloud (line 110 at the bottom)15:19
dprincebogdando: in other words the keystone on port 35358 (local only)15:19
*** vkhanna has joined #tripleo15:20
weshayjistr, added your reviews https://etherpad.openstack.org/p/tripleo-ci-squad-meeting15:21
arxcruzpanda|bbl: is the yes sir! move15:21
weshaymtg in 9 min15:21
dprincebogdando: also worth noting that this installer still supports baremetal too (what that etherpad was driving for with the initial implementation)15:21
*** d0ugal has joined #tripleo15:21
shardydprince: Hey, do you know the cleanest way to purge all the images from the local docker registry?15:22
EmilienMpanda|bbl: it was15:22
*** gbarros has joined #tripleo15:22
shardyI've run out of disk space so I need to delete everything before I can rebuild/push new images15:22
dprinceshardy: docker images -q | xargs docker rmi -f15:22
dprinceshardy: I run that ^^^15:22
shardydprince: perfect, thanks!15:22
bogdandodprince: thanks a lot!15:22
dprinceshardy: you may need to run it twice fwiw15:22
amoraleji'd appreciate reviews on https://review.openstack.org/#/c/460064/ it blocks some tests in rdo-ci15:23
bogdandoshardy: docker 1.13 / 2017 has a nice cleanup CLI AFAIK15:23
dprinceshardy: actually, to clarify that won't purge images in docker-distribution. Only those known about by docker daemon's images15:24
trownamoralej: done. thanks!15:25
dprinceshardy: to cleanup docker-distribution I stop the daemon, and remove /var/lib/registry/*15:25
amoralejthanks trown!15:25
shardydprince: ah, OK I may need to do that15:25
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: Add templates to configure Ironic inspector  https://review.openstack.org/43615915:25
*** limao has quit IRC15:26
shardyAlso a 2 node deployment is using 22G on /var/lib/docker/devicemapper/devicemapper :(15:26
skramajashardy: yes that will remove the ciruclar dependency. do you mean invoking of "tripleo::packages" can be removed? i haven't gone throught it, i will check and test it.15:26
dprinceshardy: try overlay?15:26
*** limao has joined #tripleo15:26
shardydprince: ack, I'll give it a go15:26
jistrweshay: thanks :)15:26
shardyskramaja: yes I think it can be removed, as we never use puppet to update packages AFAIK15:27
shardyso it should be safe to default it to false15:27
shardyIf it's ever needed in future we can find another way to set it IMO15:27
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic-inspector  https://review.openstack.org/46063915:28
skramajashardy: ok. i will proceed in that direction. thanks a lot.15:28
*** enrraja has quit IRC15:28
*** enrraja_ has quit IRC15:29
*** skramaja has quit IRC15:29
bogdandodotstack seems don't like fake keystone ;(15:30
adarazsEmilienM: are you joining the ci squad meeting?15:30
*** pkovar has joined #tripleo15:33
EmilienMadarazs: on my way15:33
*** ebarrera has quit IRC15:34
*** limao has quit IRC15:37
*** karthiks has quit IRC15:37
*** limao has joined #tripleo15:37
*** vkhanna has quit IRC15:38
*** yprokule has quit IRC15:39
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: Add advanced features to ironic-inspector templates  https://review.openstack.org/46064815:40
bogdandodprince, shardy: at least 'openstack stack failures list undercloud' works now, thanks!15:41
bogdandonot the dotstack although15:41
*** vkhanna has joined #tripleo15:41
dprincedprince: nice15:41
*** dprince has quit IRC15:41
*** ccamacho has quit IRC15:41
openstackgerritJames Slagle proposed openstack/tripleo-docs master: Additional docs for using deployed servers  https://review.openstack.org/46065215:43
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Stop/disable/mask rpcbind on undercloud vm  https://review.openstack.org/46065315:43
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Collect the last 4 hours from the journal in text form  https://review.openstack.org/44709915:45
*** ramishra has quit IRC15:45
*** limao has quit IRC15:48
*** limao has joined #tripleo15:48
*** yamahata_ has quit IRC15:48
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: WIP: Containerize Horizon  https://review.openstack.org/45030315:51
openstackgerritRadomir Dopieralski proposed openstack/tripleo-heat-templates master: WIP: Containerize Horizon  https://review.openstack.org/45030315:51
*** pradk has quit IRC15:52
*** jchhatbar has quit IRC15:53
*** atoth has quit IRC15:55
*** hewbrocca is now known as hewbrocca_afk15:56
*** lmiccini has quit IRC15:59
*** limao has quit IRC15:59
openstackgerritMerged openstack/puppet-tripleo master: Add linuxbridge agent profile  https://review.openstack.org/45793615:59
*** limao has joined #tripleo15:59
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Don't set profile value to Role title  https://review.openstack.org/45484016:00
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Remove NodesAssignment view/functionality  https://review.openstack.org/45473616:00
*** ipsecguy_ has joined #tripleo16:01
openstackgerritMerged openstack/tripleo-heat-templates master: [ironic] expose default boot_option in configuration and change it to local  https://review.openstack.org/44696116:01
*** ipsecguy has quit IRC16:02
openstackgerritMerged openstack-infra/tripleo-ci master: Add undercloud-containers job to cistatus  https://review.openstack.org/44695716:05
openstackgerritMerged openstack/tripleo-ui master: Add spacing between icon and text - refresh nodes  https://review.openstack.org/45416916:05
openstackgerritMerged openstack/tripleo-ui master: Correctly mark number values in translation  https://review.openstack.org/45319416:05
*** chlong_ has joined #tripleo16:08
*** ykarel has quit IRC16:09
*** yolanda has joined #tripleo16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025916:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427216:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]16:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]16:10
*** limao has quit IRC16:11
*** atoth has joined #tripleo16:11
openstackgerritEmilien Macchi proposed openstack/tripleo-ui stable/ocata: Bump to 3.2.0 (ocata)  https://review.openstack.org/46066416:13
EmilienMflorianf, honza, jtomasek ^ last request for today16:14
*** mdnadeem has quit IRC16:14
*** chlong_ has quit IRC16:14
bogdandoPTAL https://review.openstack.org/#/c/459768/ (oooq / libvirt)16:15
bogdandoand please merge https://review.openstack.org/#/c/460488/16:15
openstackgerritMerged openstack/tripleo-heat-templates master: Pass httpd service_name to Zaqar  https://review.openstack.org/45961916:16
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Mount hostpath logs on /var/log  https://review.openstack.org/44260316:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: Prepare 6.1.0 (ocata)  https://review.openstack.org/46066516:18
*** b00tcat has quit IRC16:18
openstackgerritEmilien Macchi proposed openstack/tripleo-image-elements stable/ocata: Prepare 6.1.0 (ocata)  https://review.openstack.org/46066616:19
openstackgerritEmilien Macchi proposed openstack/tripleo-puppet-elements stable/ocata: Prepare 6.1.0 (ocata)  https://review.openstack.org/46066816:20
*** bogdando has quit IRC16:22
openstackgerritMerged openstack/tripleo-heat-templates master: TLS-everywhere: Add missing profiles to docker compute services  https://review.openstack.org/46043516:23
*** ramishra has joined #tripleo16:23
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Remove Nodes NavTabs  https://review.openstack.org/46053516:24
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Update to latest Patternfly  https://review.openstack.org/46053416:24
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Simplify Node Ports fetching  https://review.openstack.org/45962816:24
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] NodesListView and ListView components  https://review.openstack.org/46053616:24
*** trozet has quit IRC16:25
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Prepare 6.4.0 release (ocata)  https://review.openstack.org/46061416:26
openstackgerritMerged openstack/puppet-tripleo stable/newton: Prepare 5.6.0 release (newton)  https://review.openstack.org/46061216:26
*** mcornea has quit IRC16:28
*** ykarel has joined #tripleo16:28
*** dprince has joined #tripleo16:28
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Use ansible to write the docker json configs  https://review.openstack.org/45481616:29
*** jpich has quit IRC16:30
*** lucasagomes is now known as lucas-afk16:31
*** atheurer has joined #tripleo16:33
*** zoli is now known as zoli|gone16:34
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224916:39
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart master: Add support for external network bridges  https://review.openstack.org/40642116:41
*** ebarrera has joined #tripleo16:43
*** ffiore has quit IRC16:45
*** atheurer has quit IRC16:46
*** jcoufal has quit IRC16:48
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Update React to 15.5  https://review.openstack.org/46014316:51
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Use prop-types lib to import PropTypes  https://review.openstack.org/46014416:51
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Use react-test-renderer  https://review.openstack.org/46014516:51
*** jcoufal has joined #tripleo16:52
*** flepied has quit IRC16:52
*** derekh has quit IRC16:52
EmilienMchem: https://review.openstack.org/#/c/460309/ is ready when you are16:56
jristjtomasek: did you figure out quick/easy way to use quickstart for our needs?16:56
jristjtomasek: pull down master and then use Wes' patch?16:56
jristHonza/Wes' patch https://review.openstack.org/#/c/407733/16:57
*** dtantsur is now known as dtantsur|afk16:57
openstackgerritJames Slagle proposed openstack/tripleo-docs master: Additional docs for using deployed servers  https://review.openstack.org/46065216:57
jristoh nice that's almost merged16:58
jtomasekjrist: I think so. in that case you probably need to use --no-clone option16:58
*** ramishra has quit IRC16:58
jristok16:58
jrist./devmode.sh ?16:58
jtomasekjrist: not needed IIUC16:58
jtomasekjrist: IIUC running a plain quickstart.sh (with that pach applied) should give you usable undercloud for GUI dev16:59
*** salmankhan has quit IRC16:59
jtomasekjrist: --release master-tripleo-ci (probably)17:00
jristk17:00
jristquickstart --no-clone --release master-tripleo-ci17:00
*** jprovazn has quit IRC17:01
*** atheurer has joined #tripleo17:02
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add $STACK_NAME input var  https://review.openstack.org/46068117:03
*** trown is now known as trown|lunch17:03
jtomasekhonza: how do I get this passing? https://review.openstack.org/#/c/460534/ /me confused again17:05
honzajtomasek: looking17:07
honzajtomasek: 1) The dependency upgrade should be in its own patch. 2) We have to get RDO to review and build the package.  Then it will pass/merge.17:08
honzaRDO approves, we merge.  Then we update openstack-tripleo-ui-deps.spec, and then RDO builds a new version, and then it can pass.17:08
honzajtomasek: https://github.com/openstack/tripleo-ui/blob/master/docs/packaging.rst#what-to-do-when-dependencies-change17:09
*** tosky has quit IRC17:09
jtomasekhonza: the changes are minimum changes required for that update to not to break build17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025917:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427217:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]17:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]17:10
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES  https://review.openstack.org/43743417:11
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys  https://review.openstack.org/43774217:11
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private  https://review.openstack.org/43743317:11
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally  https://review.openstack.org/43743117:11
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job  https://review.openstack.org/43874517:11
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE  https://review.openstack.org/44083817:11
slaglelet's add 60 more jobs to the ovb queue17:12
bnemecMeh, the check queue's actually pretty short today.17:13
bnemecIt'll be even better once mitaka is EOL'd.17:13
slaglei know, it was only an hour wait when I checked :)17:13
jtomasekhonza: so now we need to wait for RDO to build a new version which includes the change from the patch?17:13
honzajtomasek: That's how it works.17:14
jtomasekhonza: ok thanks, I was confused on this step17:15
honzajtomasek: They have to approve each dependency change, and rebuild.  We can batch updates so they only have to rebuild once for a few changes.17:15
*** tellesnobrega has joined #tripleo17:15
jtomasekhonza: so technically after it is rebuilt (without ui patch being merged), approving and merging the UI patch is jsut formal since that new dependency is already built, right?17:17
honzajtomasek: Yes, all you should need is a recheck.17:19
honzajtomasek: The patch should only contain the package.json/npm-shrinkwrap.json code.  Your actual code should be in a dependent patch.17:20
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Fix for the resource ControllerPostPuppetMaintenanceModeDeployment  https://review.openstack.org/46045717:25
*** sshnaidm is now known as sshnaidm|afk17:27
jtomasekhonza: ok, I can split it, my concern is that quite oposite to React update patch or any other new dependency addition, this Patternfly update patch without additional code changes breaks npm build17:27
*** jpena is now known as jpena|off17:28
jtomasekhonza: the code just won't compile without those changes. I am not sure how much of a problem it is17:28
honzajtomasek: Yeah, I don't have a good answer for you there.17:28
jtomasekhonza: the tests will fail so the patch won't be able to merge17:28
*** michapma_dsk has quit IRC17:29
honzajtomasek: I guess in that case it'll have to be bundled with the dependency update.17:29
jtomasekhonza: +117:29
honzajtomasek: Just make a note of the exception in the commit message so RDO doesn't get confused :)17:29
jtomasekhonza: ack17:30
openstackgerritMerged openstack/puppet-tripleo master: Fix wrong notify in swift proxy profile  https://review.openstack.org/46042617:33
*** ansmith has quit IRC17:34
*** pkovar has quit IRC17:34
*** milan has quit IRC17:36
*** ffiore has joined #tripleo17:38
shardyAnyone seeing errors like this running container deployments?17:38
shardydefault_file=/etc/my.cnf.d/tripleo.cnf&read_default_group=tripleo" does not match "^(sqlite|mysql(\\+pymysql)?|postgresql)17:38
shardyIt's when running docker-puppet17:38
*** ebarrera has quit IRC17:38
*** fragatina has quit IRC17:40
*** ffiore has quit IRC17:41
*** fragatina has joined #tripleo17:41
EmilienMshardy: probably because the database url doesn't contain a valid value, with the url of mysql database17:45
*** gfidente is now known as gfidente|afk17:45
*** vpickard has quit IRC17:45
*** vpickard has joined #tripleo17:45
shardyEmilienM: ah, that's a good clue, thanks17:46
shardywill check it out17:46
EmilienMshardy: we run some sort of validation in the puppet-* modules, and this errors looks familiar to me17:47
EmilienMshardy: https://github.com/openstack/puppet-oslo/blob/master/manifests/db.pp#L13617:47
*** ansmith has joined #tripleo17:49
*** tellesnobrega has quit IRC17:49
*** deadnull has joined #tripleo17:54
shardyEmilienM: thanks, you were right - I have a problem with writing the data that provides that config17:56
*** ffiore has joined #tripleo17:56
EmilienMcool17:57
*** tosky has joined #tripleo17:59
*** tellesnobrega has joined #tripleo17:59
*** shardy has quit IRC18:00
*** sshnaidm|afk has quit IRC18:03
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add VipMap output  https://review.openstack.org/46013818:04
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add split-stack environments  https://review.openstack.org/45990018:04
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add DeploymentSwiftDataMap parameter  https://review.openstack.org/45944018:04
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Add support for ipv6_addrlabel with IPaddr2 RA  https://review.openstack.org/46023218:05
*** ffiore has quit IRC18:08
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025918:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427218:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]18:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]18:10
*** amoralej is now known as amoralej|off18:16
*** trown|lunch is now known as trown18:16
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP IPv6 VIP addresses need to be /128  https://review.openstack.org/46002818:17
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Remove Nodes NavTabs  https://review.openstack.org/46053518:22
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Update to latest Patternfly  https://review.openstack.org/46053418:22
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] NodesListView and ListView components  https://review.openstack.org/46053618:22
*** gbarros has quit IRC18:25
*** gbarros has joined #tripleo18:26
*** flepied has joined #tripleo18:29
*** gbarros has quit IRC18:29
*** Goneri has quit IRC18:30
*** ansmith has quit IRC18:31
*** Goneri has joined #tripleo18:34
*** gbarros has joined #tripleo18:38
*** atoth has quit IRC18:38
*** atoth has joined #tripleo18:39
EmilienMweshay: can you triage https://bugs.launchpad.net/tripleo/+bug/1686353 please?18:40
openstackLaunchpad bug 1686353 in tripleo "Proxy Options for TripleO QuickStart" [High,Triaged]18:40
EmilienMor trown ^18:40
*** anshulbehl has joined #tripleo18:42
*** iranzo has quit IRC18:43
*** deadnull has quit IRC18:43
*** ansmith has joined #tripleo18:47
trownEmilienM: looking18:47
*** openstackgerrit has quit IRC18:48
*** openstackgerrit has joined #tripleo18:48
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Automatically enable all available languages  https://review.openstack.org/45664618:48
*** fragatina has quit IRC18:50
*** iranzo has joined #tripleo18:52
*** iranzo has joined #tripleo18:52
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add language switcher to login page  https://review.openstack.org/44143518:53
jristhonza: is https://review.openstack.org/#/c/441435/10 just a rebase?18:56
honzajrist: yes18:56
*** tellesnobrega has quit IRC18:57
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Add pre-selected Control Plane IP support.  https://review.openstack.org/41327818:57
jristbecause there were no file changes18:57
jristaccording to gerrit18:57
*** salmankhan has joined #tripleo18:58
honzajrist: gerrit is pretty dumb when it comes to rebase diffs18:58
*** pkovar has joined #tripleo18:58
hamzyEmilienM,  I responded to https://bugs.launchpad.net/tripleo/+bug/1686201/comments/6 Given that I have yet to be able to fully install the undercloud and overcloud, I am wondering what differences exist between your CI and my clean install of a CentOS bare metal machine.19:02
openstackLaunchpad bug 1686201 in tripleo "Execution of '/bin/openstack token issue --format value' returned 1: Unable to establish connection to https://192.168.24.2:13000/v3/auth/tokens" [Undecided,Triaged]19:02
EmilienMhamzy: our multinode jobs don't use images19:02
EmilienMbut use repos from rdo directly19:02
*** salmankhan has quit IRC19:02
EmilienMcan you list packages that you deployed and compare with what is deployed in upstream CI?19:02
EmilienMif you go on http://tripleo.org/cistatus.html you can pick a recent job on master (or the version that you deploy) and compare the rpm-qa files19:03
hamzyEmilienM, should tripleo be installable by someone from the public?19:03
EmilienMhamzy: of course, yes19:03
EmilienMand if not there is a problem19:03
hamzywell I have yet to be able to fully install the undercloud and overcloud on master or newton and I have been trying for weeks now19:05
hamzyI will try and see if I can compare the packages...19:05
EmilienMcan you share the way you're deploying please?19:06
hamzyEmilienM, http://paste.openstack.org/show/608231/19:07
*** iranzo has quit IRC19:08
hamzyhopefully that is not a crazy way of doing it :)19:08
EmilienMhamzy: ok so you're trying with a patch that fails in CI: https://review.openstack.org/#/c/456225/19:10
EmilienMhamzy: have you tried a deployment without it?19:10
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025919:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427219:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]19:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]19:10
hamzyyes and ran into issues which the patch was designed to get around19:11
EmilienMI'm not sure if trown's patch is ready to be tested, I see red CI jobs19:13
*** florianf has quit IRC19:16
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Handle failed actions  https://review.openstack.org/46072019:17
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Align hyperconverged-ceph.yaml environment and adds some validation  https://review.openstack.org/43957919:19
openstackgerritMerged openstack/tripleo-heat-templates master: Change the default for rabbitmq back to ha-mode: all  https://review.openstack.org/45999819:20
openstackgerritMerged openstack/tripleo-quickstart master: Disable gpgcheck for openstack-ocata stable repo  https://review.openstack.org/46006419:20
*** lblanchard has quit IRC19:22
flaper87fultonj: is this the template you guys are using to deploy ceph? https://github.com/fultonj/tripleo-ceph-ansible/blob/f6e195142edcb3100e2133ac6a64e84dd2e8bf9c/tht/ceph-ansible-workflow.j2.yaml19:22
flaper87mmh, shouldn't it also have an output ?19:22
flaper87oh, nvm19:22
fultonjflaper87: yes, that passes the params to the custom heat resource19:23
fultonjthen this https://github.com/fultonj/tripleo-ceph-ansible/blob/f6e195142edcb3100e2133ac6a64e84dd2e8bf9c/mistral-ceph-ansible.yaml19:23
fultonj(the mistral workflow) gets those params and passes them to ceph-ansible19:24
flaper87yeah, I was looking at the heat side of things19:25
flaper87fultonj: but, IIUC, the resource changed name in gfidente|afk latest patch19:25
fultonjflaper87: yes19:25
*** tellesnobrega has joined #tripleo19:26
flaper87fultonj: will that ceph-ansible-workflow change too?19:26
fultonjflaper87: yes19:26
fultonjflaper87: but i'm keeping it updated19:26
fultonjin that repo19:27
fultonjwhen the heat change merges it will start to make sense to mv it into tripleo common19:27
fultonjflaper87: i thought i had updated the heat in that repo to use the new resource...19:27
fultonji can get it for you19:27
flaper87fultonj: please :)19:28
flaper87fultonj: and the template :D19:28
*** anshulbehl has quit IRC19:29
fultonjhttps://review.openstack.org/#/c/458058/2/extraconfig/tasks/ceph-ansible-workflow.j2.yaml19:31
*** florianf has joined #tripleo19:31
fultonjflaper87: i glue it all together after installing quickstart with https://github.com/fultonj/tripleo-ceph-ansible/blob/master/init.sh19:31
fultonjflaper87: it's a hack to pretend i am in the future19:31
fultonjflaper87: the on you linked to from my repo should be deleted19:32
fultonjflaper87: i directly use what is in https://review.openstack.org/458058 instead19:32
*** pradk has joined #tripleo19:34
rdopieraI'm trying the devmode.sh from tripleo-quickstart for the first time, using all defaults except for the change id and the commit id, and then it fails with "fatal: repository 'review.openstack.org/openstack/tripleo-heat-templates' does not exist" -- what am I doing wrong?19:36
*** cylopez has left #tripleo19:39
thrashrdopiera: I prefer using ZUUL_HOST and ZUUL_CHANGES instead19:39
thrashjust set ZUUL_HOST to review.openstack.org and you can get the ZUUL_CHANGES from any job on your patch. look in _zuul_ansible/vars.yaml19:40
thrashrdopiera: for instance...19:41
thrashexport ZUUL_HOST=review.openstack.org19:41
thrashexport ZUUL_CHANGES='openstack/tripleo-common:master:refs/changes/04/459704/1'19:41
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add VipMap output  https://review.openstack.org/46013819:41
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add split-stack environments  https://review.openstack.org/45990019:41
rdopierathrash: certainly, but shouldn't both work?19:42
thrashrdopiera: sure... But I don't use the other. :D19:42
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP Initial VIP ipv6 minor update code  https://review.openstack.org/46072419:45
rdopierathrash: that seems to have worked, thanks19:45
thrashrdopiera: :D19:45
thrashrdopiera: I just had better luck with it, so I've stuck with it.19:46
rdopieraI wish that non-working options were removed...19:46
thrashrdopiera: I'm sure it works, I just don't know how to fix it.19:46
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Remove deprecated minor update pcs code  https://review.openstack.org/46072619:49
rdopierahow about this?19:52
rdopieraERROR! the file_name '/root/.quickstart/config/general_config/root/.quickstart/config/general_config/containers_minimal.yml.yml' does not exist, or is not readable19:52
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Add ssh tunneling for TripleO-UI  https://review.openstack.org/40773319:53
* rdopiera tries to specify the config without the .yml19:53
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add steps to enable tripleo_ui  https://review.openstack.org/45906119:53
*** milan has joined #tripleo19:57
*** dbecker has quit IRC19:58
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025920:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427220:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]20:10
pabelangerEmilienM: FYI, centos-7 nodes coming online, no longer running puppet to provision them. So, might be a few bumps20:12
*** jayg is now known as jayg|g0n320:18
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Cinder-api upgrade: use httpd instead of apachectl  https://review.openstack.org/46030320:20
openstackgerritMerged openstack/tripleo-ui stable/newton: Prepare 1.2.0 release (newton)  https://review.openstack.org/46062120:20
openstackgerritMerged openstack/tripleo-quickstart-extras master: Upgrade to containerized overcloud  https://review.openstack.org/44857620:20
openstackgerritMerged openstack/tripleo-quickstart master: Add featureset011 - upgrade from BM to containerized  https://review.openstack.org/45029520:20
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Prepare 6.1.0 (ocata)  https://review.openstack.org/46066520:20
openstackgerritMerged openstack/tripleo-image-elements stable/ocata: Prepare 6.1.0 (ocata)  https://review.openstack.org/46066620:21
openstackgerritMerged openstack/tripleo-puppet-elements stable/ocata: Prepare 6.1.0 (ocata)  https://review.openstack.org/46066820:21
openstackgerritMerged openstack/tripleo-heat-templates master: upgrades: deploy mod_ssl when upgrading apache  https://review.openstack.org/46029220:21
openstackgerritMerged openstack/tripleo-ui stable/ocata: Bump to 3.2.0 (ocata)  https://review.openstack.org/46066420:21
openstackgerritMerged openstack/tripleo-heat-templates master: Disable default vhost for apache  https://review.openstack.org/46048820:21
openstackgerritMerged openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI  https://review.openstack.org/45078420:21
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add steps to enable tripleo_ui  https://review.openstack.org/45906120:26
*** liverpooler has quit IRC20:26
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Add ssh tunneling for TripleO-UI  https://review.openstack.org/40773320:27
*** jkilpatr has quit IRC20:29
EmilienMpabelanger: ok, what does it means?20:29
EmilienMwhat is diff with before for us?20:29
*** jcoufal has quit IRC20:29
pabelangerEmilienM: so far I noticed https://review.openstack.org/#/c/460731/20:32
pabelangerwhich is a multi node job20:32
*** ansmith has quit IRC20:35
dr_gogeta86anyone knows how to configure pcs stonith via yaml file ?20:35
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat  https://review.openstack.org/46018920:40
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: TEST: Bisect heat  https://review.openstack.org/46018820:40
*** trown is now known as trown|outtypewww20:43
*** jkilpatr has joined #tripleo20:43
*** fragatina has joined #tripleo20:45
*** fragatina has quit IRC20:45
*** fragatina has joined #tripleo20:46
openstackgerritMerged openstack/tripleo-heat-templates master: aodh-base.yaml uses a hard coded keystone region name  https://review.openstack.org/45737320:51
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing tag to nova-placement docker image  https://review.openstack.org/45806420:51
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Re-enable bmc caching for ci  https://review.openstack.org/46074720:56
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Use port-security version of OVB templates  https://review.openstack.org/46074820:56
*** jlinkes has quit IRC20:56
*** jkilpatr has quit IRC20:57
*** trozet has joined #tripleo20:59
*** rhallisey has quit IRC21:00
*** dougbtv_ has joined #tripleo21:02
mwhahahaEmilienM: pabelanger: yea multinode is broken because of the hostkey verification21:04
mwhahahahttp://logs.openstack.org/75/460175/2/gate/gate-tripleo-ci-centos-7-nonha-multinode-oooq/bb1e587/console.html#_2017-04-27_20_59_21_65426221:04
*** flepied has quit IRC21:04
pabelangerya, once we get a +3 we're going to promote21:04
*** dougbtv has quit IRC21:05
*** dougbtv__ has joined #tripleo21:05
*** gfidente|afk has quit IRC21:05
EmilienMgood time to drop off21:07
*** dougbtv_ has quit IRC21:08
*** tellesnobrega has quit IRC21:09
*** jcoufal has joined #tripleo21:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025921:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427221:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]21:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]21:10
*** dprince has quit IRC21:12
*** thrash is now known as thrash|g0ne21:25
*** abishop has quit IRC21:26
*** milan has quit IRC21:29
*** zigo has joined #tripleo21:32
*** pradk has quit IRC21:35
*** yamahata_ has joined #tripleo21:36
*** pkovar has quit IRC21:39
*** morazi has quit IRC21:39
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE  https://review.openstack.org/46075921:42
*** kbyrne has quit IRC21:50
*** Nakato has quit IRC21:52
*** Nakato has joined #tripleo21:53
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add VipMap output  https://review.openstack.org/46013821:53
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add split-stack environments  https://review.openstack.org/45990021:53
*** kbyrne has joined #tripleo21:54
*** tellesnobrega has joined #tripleo21:55
*** dsariel has quit IRC22:04
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE  https://review.openstack.org/46075922:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025922:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427222:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]22:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]22:10
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Add log capturing support workflows  https://review.openstack.org/40500222:11
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Add overcloud support report command  https://review.openstack.org/40500122:11
*** ianw has quit IRC22:13
*** croelandt has quit IRC22:13
*** croelandt has joined #tripleo22:14
*** mjblack- has joined #tripleo22:14
*** mjblack has quit IRC22:14
*** rnoriega has quit IRC22:14
*** shadower has quit IRC22:14
*** rlandy has quit IRC22:14
*** mjblack- is now known as mjblack22:15
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Move OVB settings to tripleo-quickstart-extras  https://review.openstack.org/44880522:15
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Move OVB settings to tripleo-quickstart-extras  https://review.openstack.org/44880522:15
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Parameterize OVB stack flavors  https://review.openstack.org/44516322:15
openstackgerritAlex Schultz proposed openstack-infra/tripleo-ci master: Use support report command to collect node logs  https://review.openstack.org/41856222:15
*** rnoriega has joined #tripleo22:15
*** mnaser has quit IRC22:16
*** ianw has joined #tripleo22:18
*** mgkwill has quit IRC22:18
*** rlandy has joined #tripleo22:18
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224922:20
*** mgkwill has joined #tripleo22:21
*** mnaser has joined #tripleo22:24
*** ansmith has joined #tripleo22:25
*** florianf has quit IRC22:30
*** jcoufal has quit IRC22:31
*** pmannidi has joined #tripleo22:35
*** sanagikoki has joined #tripleo22:41
*** vkhanna has left #tripleo22:43
*** liverpooler has joined #tripleo22:44
*** sanagikoki has quit IRC22:46
*** rlandy is now known as rlandy|bbl22:53
*** jkilpatr has joined #tripleo22:53
*** jkilpatr has quit IRC22:53
*** jkilpatr has joined #tripleo22:54
*** pmannidi has quit IRC22:55
*** pmannidi has joined #tripleo22:56
*** hamzy has quit IRC22:59
*** trozet has quit IRC23:08
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168025923:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/168427223:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1680259 in tripleo "Upgrades jobs timing out regularly" [Critical,In progress]23:10
openstackLaunchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress]23:10
*** gbarros has quit IRC23:15
pabelangerEmilienM: mwhahaha: devstack-gate patch merged23:15
*** tesseract has quit IRC23:20
EmilienMcool23:21
EmilienMI'm out23:22
*** pmannidi has quit IRC23:28
pabelangerSent a ML post too23:39
*** tosky has quit IRC23:46
*** ykarel has quit IRC23:47

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!