Friday, 2016-09-09

*** nyechiel_ has quit IRC00:11
openstackgerritMerged openstack/tripleo-heat-templates: Convert SwiftDevicesAndProxyConfig to composable format  https://review.openstack.org/36474800:13
*** saneax is now known as saneax-_-|AFK00:34
*** dtrainor has joined #tripleo00:44
*** dtrainor has quit IRC00:52
*** dtrainor has joined #tripleo00:53
*** rajinir has quit IRC00:55
*** mlupton has joined #tripleo01:01
*** mlupton has quit IRC01:03
*** mlupton has joined #tripleo01:04
*** bana_k has quit IRC01:23
*** egafford has quit IRC01:31
*** mlupton has quit IRC01:31
*** yamahata has joined #tripleo01:38
*** mlupton has joined #tripleo01:49
*** mlupton has quit IRC01:54
*** thrash is now known as thrash|g0ne01:57
*** akshai has joined #tripleo02:04
*** yamahata has quit IRC02:07
*** chlong has joined #tripleo02:26
*** mlupton has joined #tripleo02:32
*** tzumainn has quit IRC02:44
*** kjw3 has joined #tripleo02:47
*** cwolferh has quit IRC02:49
*** mlupton has quit IRC02:57
*** fragatina has quit IRC03:03
*** myoung is now known as myoung|afk03:05
*** skramaja has joined #tripleo03:34
*** rhallisey has joined #tripleo03:54
*** absubram has joined #tripleo04:16
*** absubram_ has joined #tripleo04:16
*** rhallisey has quit IRC04:18
*** absubram has quit IRC04:20
*** absubram_ is now known as absubram04:20
*** fragatina has joined #tripleo04:26
*** fragatina has quit IRC04:30
*** akshai has quit IRC04:32
*** karthiks has joined #tripleo04:42
*** coolsvap has joined #tripleo04:43
openstackgerritIan Wienand proposed openstack/diskimage-builder: Move elements & lib relative to diskimage_builder package  https://review.openstack.org/34401704:49
*** pgadiya has joined #tripleo04:52
*** karthiks has quit IRC05:16
*** jaosorior has joined #tripleo05:21
*** chlong_ has joined #tripleo05:31
*** karthiks has joined #tripleo05:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fix value of ctlplane fqdn fact  https://review.openstack.org/36775405:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Generate VIP info for ctlplane VIP, not management  https://review.openstack.org/36736205:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fix value of ctlplane fqdn fact  https://review.openstack.org/36775405:53
bandinimatbu: morning ;) Am attempting a bisect again today, hopefully we can narrow the upgrade list_join thing down05:56
jaosoriorbandini: what evil plans are you devising?05:58
*** aufi has joined #tripleo05:59
*** saneax-_-|AFK is now known as saneax06:00
matbubandini: hello :)06:00
bandinijaosorior: ahah lol morning sir. trying to get to the bottom of https://bugs.launchpad.net/tripleo/+bug/162069606:00
openstackLaunchpad bug 1620696 in tripleo "M/N upgrades UPDATE_FAILED .enabled_services.list_join: Incorrect arguments to "list_join" should be: "list_join" : [ " ", [ "str1", "str2"]]" [Undecided,Confirmed]06:00
matbubandini: yeah, i tired yesterday something but it hanged my deployment for the night06:01
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review  https://review.openstack.org/36485906:04
*** aufi has quit IRC06:05
*** aufi has joined #tripleo06:05
saneaxEmilienM, shardy: today we complete all the patches for sriov blueprint https://blueprints.launchpad.net/tripleo/+spec/tripleo-sriov (FYI)06:05
*** yamahata has joined #tripleo06:09
*** ccamacho has joined #tripleo06:13
ccamachoGood morning!06:14
jaosoriorccamacho: hey dude! how was the vacation?06:18
jaosoriorbandini: got a system that's available with the same issue? I could try to help dig it out06:19
ccamachojaosorior hey man, really good actually 10 days without technology near to me..06:20
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: ModalPanel component  https://review.openstack.org/36661506:20
bandinijaosorior: that'd be awesome yes. I will ping you in 30 mins or so as I am re-reproducing06:22
jaosoriorbandini: sure06:22
*** pcaruana has joined #tripleo06:23
jaosoriorbandini: ok, I'll do some coffee meanwhile :P06:27
jaosoriorjtomasek: around yet?06:27
jtomasekjaosorior: yep06:27
jaosoriorjtomasek: you're working in the UI, right?06:27
bandinijaosorior: excellent idea ;)06:27
jaosoriorjtomasek: I saw a mail the other day about SSL support for the UI, any idea how that work is going?06:28
*** jprovazn has joined #tripleo06:29
jtomasekdtrainor is working on it, I think he did some progress06:29
jaosoriorjtomasek: does he have any CRs up?06:30
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Roles Listing using Mistral Action  https://review.openstack.org/36056906:31
jtomasekjaosorior:  CRs?06:32
jaosoriorjtomasek: patches (CR = Change Request)06:33
* jtomasek is slow in the morning06:33
jtomasekjaosorior: I am not sure, this is the blueprint to track it https://blueprints.launchpad.net/tripleo-ui/+spec/ssl-tls06:34
jaosoriorjtomasek: he's in the US right? Gotta poke him about it later I guess06:35
*** fzdarsky has joined #tripleo06:35
jtomasekjaosorior: yeah, that would be best06:35
jaosoriorshadower, marios: if you guys have time can you check this commit? https://review.openstack.org/#/c/367176/106:36
mariosack in a bit jaosorior06:38
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: ModalPanel component  https://review.openstack.org/36661506:38
openstackgerritMerged openstack/tripleo-heat-templates: Add Ceph cluster health validation on upgrade  https://review.openstack.org/35941006:39
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Update Nodes listing  https://review.openstack.org/36558006:43
*** bana_k has joined #tripleo06:47
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: DO NOT MERGE - TESTING BARBICAN  https://review.openstack.org/35326206:51
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add Barbican to the overcloud - WIP  https://review.openstack.org/35245806:51
*** zoli_gone-proxy is now known as zoliXXL06:58
*** zoliXXL is now known as zoli|wfh06:58
*** florianf has joined #tripleo07:00
*** social has joined #tripleo07:06
*** tesseract- has joined #tripleo07:07
*** flepied has quit IRC07:07
*** zoli|wfh is now known as zoli_gone-proxy07:11
*** mcornea has joined #tripleo07:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart: DO NOT MERGE: Testing workers  https://review.openstack.org/36611907:15
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Make undercloud service workers configurable  https://review.openstack.org/36611607:15
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review  https://review.openstack.org/36485907:17
*** zoli_gone-proxy is now known as zoliXXL07:17
*** jpena|off is now known as jpena07:18
jaosoriorshadower: Hey man07:18
jaosoriorshadower: it's not entirely clear to me what's up here https://review.openstack.org/#/c/367422/307:18
jaosoriorshadower: seems to me that it'll be quite prone to confusion if the fact that the environments from mistral client have 'ssh_keys' tells whether validations are enabled or not07:19
*** chlong has quit IRC07:19
jaosoriorshadower: isn't there another way to tell?07:19
jaosoriorshadower: else I think it would be better to add a comment to avoid confusion07:19
*** chlong_ has quit IRC07:19
*** jlinkes has joined #tripleo07:22
*** ebarrera has joined #tripleo07:24
*** jpich has joined #tripleo07:29
*** hjensas has quit IRC07:32
*** bvandenh has joined #tripleo07:32
shadowerjaosorior: yeah that's a little weird. Afaik the only other way to do it is to shell out to hiera, which I'm not fond of.07:33
shadowerjaosorior: but yeah adding a comment makes sense07:33
*** limao has joined #tripleo07:34
jaosoriorshadower: well... I don't think shelling out hiera is that bad to be honest.07:34
jaosoriorshadower: if it's more explicit.07:34
*** limao_ has joined #tripleo07:37
shadowerjaosorior: maybe. I fear it might be less robust and this is the first time a mistral action needs that. If there's more than sure07:37
shadowerthough in that case, we'd probably just load hiera into a mistral env07:37
shadowerlike, all of it07:37
d0ugalCan we write mistral and not mc? :P07:39
*** limao has quit IRC07:39
shadowerd0ugal: fine by me -- I was trying to be consistent with the existing code in that file07:40
d0ugalah07:40
d0ugalfair enough07:40
jaosoriorshadower: I'll comment on the patch07:40
d0ugalI try hard not to nit pick... but one or two letter variable names are a weak point of mine07:40
*** bana_k has quit IRC07:40
shadower-)07:41
d0ugalshadower: What creates the ssh_keys env?07:41
*** chem|off is now known as chem07:42
*** flepied has joined #tripleo07:42
*** nyechiel_ has joined #tripleo07:43
shadowerd0ugal: this does? https://review.openstack.org/#/c/322893/07:45
shadower(that was supposed to be a period)07:45
d0ugallol, I was confused :)07:46
d0ugalshadower: thanks07:46
openstackgerritMerged openstack/tripleo-heat-templates: Add service networks to hieradata  https://review.openstack.org/36547507:46
shadowerd0ugal: it's not merged yet, but since my patch won' t break without it, I didn't use a depends-on07:46
d0ugalSure07:46
d0ugalI probably would anyway for context, but it's fine.07:46
*** b00tcat has joined #tripleo07:47
*** ohamada has joined #tripleo07:47
mandred0ugal: it's the copy_ssh_key workflow that generates ssh key pair and store it in the ssh_keys mistral environment07:47
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Make HAProxy terminate OpenStack internal/admin endpoints  https://review.openstack.org/36036607:48
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Always deploy HAProxy  https://review.openstack.org/36036807:48
d0ugalmandre: Thanks07:48
mandreso if you have a ssh_keys mistral environment you can safely assume you have enabled validations in your undercloud07:49
jaosoriorbandini: no environment yet? :O07:51
*** mbound has joined #tripleo07:54
*** hjensas has joined #tripleo07:57
*** mbound has quit IRC07:59
bandinijaosorior: meh one deployment failed08:01
jaosorior:(08:02
*** derekh has joined #tripleo08:05
mariosalert... a gfidente has been spotted in the wild rechecking things https://review.openstack.org/#/c/336542/508:05
jaosoriorlol08:05
*** dsneddon has quit IRC08:06
*** athomas has joined #tripleo08:06
*** lmiccini_ has joined #tripleo08:09
*** mhenkel has joined #tripleo08:09
bandiniahahahah08:09
*** lmiccini has quit IRC08:10
*** snecklifter has joined #tripleo08:19
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375008:21
*** lmiccini_ is now known as lmiccini08:23
*** nyechiel_ has quit IRC08:25
jaosoriormarios: yeah... those failures in the patch you reviewed seem pretty random. The change has nothing to do with instack-undercloud. So it just seems to me that CI is flaky08:28
jaosoriormarios: a change that depends on that patch is all green though https://review.openstack.org/#/c/367208/108:29
*** yolanda has quit IRC08:31
*** yolanda has joined #tripleo08:37
*** mhenkel has quit IRC08:38
openstackgerritMerged openstack/tripleo-validations: Validate the open-files-limit value in mysql  https://review.openstack.org/35396108:39
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375008:39
*** jaosorior is now known as jaosorior_lunch08:40
openstackgerritMerged openstack/tripleo-validations: Validate ntp is running and synchronised  https://review.openstack.org/35396708:40
openstackgerritMerged openstack/tripleo-validations: Validate pacemaker status  https://review.openstack.org/35396908:40
openstackgerritMerged openstack/tripleo-validations: Validate rabbitmq limits  https://review.openstack.org/35397008:40
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Migrate to using osc-lib  https://review.openstack.org/33546008:42
*** mhenkel has joined #tripleo08:42
openstackgerritDougal Matthews proposed openstack/tripleo-common: Remove "type: direct" from workflows as it is the default  https://review.openstack.org/34161708:43
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Update the Mistral action names  https://review.openstack.org/36651908:43
openstackgerritMerged openstack-infra/tripleo-ci: scenario002: deploy Swift  https://review.openstack.org/36740108:43
*** jschlueter has quit IRC08:45
*** myoung|afk has quit IRC08:45
*** mhenkel has quit IRC08:49
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Use a released version of tripleo-common  https://review.openstack.org/36442508:52
openstackgerritDougal Matthews proposed openstack/tripleo-common: Remove the unused service_host arg from node registration  https://review.openstack.org/32603608:52
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Add an optional timeout when waiting for websocket messages  https://review.openstack.org/36425208:52
openstackgerritDougal Matthews proposed openstack/tripleo-common: Remove the old, deprecated Mistral action names.  https://review.openstack.org/36652908:52
bandinimarios, jistr: if you have a minute to check out the last comments on https://review.openstack.org/#/c/358626 that would be awesome ;)08:54
*** tosky has joined #tripleo08:55
*** akrivoka has joined #tripleo08:57
*** cwolferh has joined #tripleo08:58
*** kbyrne has quit IRC09:04
*** abehl has joined #tripleo09:04
openstackgerritWaldemar Znoinski proposed openstack/diskimage-builder: don't configure 'lo' for dhcp  https://review.openstack.org/36752709:04
*** nijaba has quit IRC09:05
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375009:06
*** nijaba has joined #tripleo09:06
*** nijaba has quit IRC09:06
*** nijaba has joined #tripleo09:06
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: WIP - Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375009:07
*** zoliXXL is now known as zoli|wfh09:09
*** kbyrne has joined #tripleo09:10
*** shardy has joined #tripleo09:11
*** limao_ has quit IRC09:12
*** limao has joined #tripleo09:12
mariosbandini: will do09:12
mariosbandini: i missed that thanks for pointing at it09:13
d0ugalovb gates are down?09:14
*** mbound has joined #tripleo09:14
bandinimarios: merci!09:15
jistrbandini, marios: added option C), curious what you'd think about it09:19
*** bvandenh_ has joined #tripleo09:20
openstackgerritMerged openstack/tripleo-heat-templates: Add global_config_settings to services' output  https://review.openstack.org/33654209:20
*** limao has quit IRC09:20
mariosjistr: i was thinking 'why not also start at the end of the update but then got thinking about the controlled way we do restart after converge09:20
mariosjistr: i mean after i posted the reply09:20
*** bvandenh__ has joined #tripleo09:23
shardyhttps://review.openstack.org/#/c/348905 https://review.openstack.org/#/c/346799 needs reviews please09:23
shardycontrail integration, looks ready to land09:23
jistrmarios: i'm not sure i follow your 'ahem' :D -- what are you saying?09:24
*** bvandenh has quit IRC09:24
mariosjistr: i mean we have the common functions that can handle sthing like 'restart_service' and the functions check if bootstrap & pcmk and does the restart, and if systemd it happens on all controllers09:24
*** bvandenh_ has quit IRC09:25
bandinimarios: yes but they don't do "systemctl start openstack-foo" on *all* controllers right? We'd have to create another step for that no?09:26
bandinibut in any case agreed, the sooner we land your function rework the better09:27
mariosbandini: for example the restart_service either calls manage_systemd_service or manage_pacemaker_service. For systemd it runs on all controllers, for pacemaker only if it is bootstrap09:29
*** bvandenh has joined #tripleo09:30
ccamachohey shardy, Im coming back from PTO, checking again the contrail submissions09:30
mariosbandini: so yes, depending also on where (if from a bootstrap only clause in another script for example it changes things) if you call restart_service openstack-foo it will "systemctl $action $service" on all controllers09:31
jistrmarios, bandini: we shouldn't need another step. _2.sh runs on all controllers too, and all controllers have there a wait check until the pcs cluster is up and running AFAIK, so we can put the systemd starts after that and they will run on all controllers09:31
*** bvandenh__ has quit IRC09:31
bandinimarios, jsutr: ah righto, somehow I forgot that _[1,2].sh *are* run on all controllers. So we will just need to add a bit of logic to implement C)09:32
mariosjistr: right that would work fine we could do restart_service foo and it will be systemd on all or pcmkd on bootstrap09:32
mariosjistr: i mean with the rework on those common scripts09:32
jistrmarios: i think it should be systemd on all09:32
jistrmarios: they'd already be removed from pcmk at that point09:32
bandiniyep09:33
mariosjistr: yeah sorry forgot these were the services we're migrating09:33
*** r-mibu has quit IRC09:33
*** r-mibu has joined #tripleo09:33
bandinimarios: so we're just missing CI for your rework, yes?09:34
shardyccamacho: thanks, I got confirmation from mhenkel that they've been tested and they look OK to me09:34
shardyccamacho: if you feel like pulling them and testing too, that would be good09:34
mariosjistr: bandini well ok, then we'd be able to use function manage_systemd_service { in https://review.openstack.org/#/c/321027/23/extraconfig/tasks/pacemaker_common_functions.sh :D in the very least09:34
shardyccamacho: I think we can probably go ahead and land them now though, as first revision09:35
ccamachoyeahp Im merging my last changes to redeploy all just to double check it.09:35
bandinimarios: yes if we can land your review, I will then depend-on it with mine and implement C) as suggested by jistr09:35
mariosbandini: yeah. ideally i'd want to include them in a run to sanity check again it has been a while. but interupts. speaking of which i have to go deal with something now09:35
*** nyechiel_ has joined #tripleo09:38
mariosjistr: you forgot to capture the discussion though :) https://review.openstack.org/#/c/358626/09:41
mariosjistr: oh, nm i thought you forgot to copy/paste (I was thinking of added the chat to explain the 'ahem' since it wasn't clear)09:41
jistrmarios: i though i summarized it :D but feel free to add anything more, or link or copy/paste the irc09:45
*** nyechiel_ has quit IRC09:46
*** oshvartz has quit IRC09:48
openstackgerritTomas Sedovic proposed openstack/tripleo-common: Run copy_ssh_keys after overcloud finishes  https://review.openstack.org/36742209:49
*** nyechiel_ has joined #tripleo09:53
*** akrivoka has quit IRC09:54
*** skramaja has quit IRC09:55
*** akrivoka has joined #tripleo09:56
openstackgerritSteven Hardy proposed openstack/tripleo-common: Wire in jinja templating for custom roles  https://review.openstack.org/36246509:58
*** yamahata has quit IRC09:59
*** nyechiel has joined #tripleo10:04
*** nyechiel_ has quit IRC10:07
*** jprovazn has quit IRC10:11
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert UpdateWorkflow to support composable roles  https://review.openstack.org/36728210:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move AllNodesValidationDeployments into jinja template loop  https://review.openstack.org/33758710:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert overcloud.yaml to support jinja2 templating  https://review.openstack.org/31567910:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert allNodesConfig properties to composable jinja2  https://review.openstack.org/36579410:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move AllNodesDeployments into jinja template loop  https://review.openstack.org/33726710:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move role ResourceGroups inside the jinja2 loop  https://review.openstack.org/36579310:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move role deployment steps into puppet/post.yaml  https://review.openstack.org/36576310:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Remove *ExtraConfig parameters from overcloud.yaml  https://review.openstack.org/36579210:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Move per-role NetIpListMap's into jinja template loop  https://review.openstack.org/36474910:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert deploy steps to jinja2 loop  https://review.openstack.org/36579610:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Convert AllNodesExtraConfig to support composable roles  https://review.openstack.org/36729510:16
dtantsurwow, that's a dump :)10:17
shardyThat BP has been > 60 patches, hopefully those are the final remaining ones10:19
shardyI'm on PTO today so dropping offline for a while, reviews appreciated, will be around again this evening :)10:20
* derekh install rh3 to deal with shardy's latest dump of patches10:20
shardylol :)10:20
shardysorry10:20
openstackgerritDougal Matthews proposed openstack/tripleo-common: Add an action and workflow to update a plan  https://review.openstack.org/36792110:20
*** shardy has quit IRC10:21
openstackgerritDougal Matthews proposed openstack/tripleo-common: Add an action and workflow to update a plan  https://review.openstack.org/36792110:22
*** mhenkel has joined #tripleo10:22
*** karthiks has quit IRC10:26
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/36150110:26
*** sshnaidm|afk is now known as sshnaidm|pto10:28
akrivokajtomasek: ping regarding https://review.openstack.org/#/c/367562/10:28
openstackgerritMerged openstack/tripleo-docs: Documentation for installing and using Ironic in overcloud  https://review.openstack.org/35401610:29
akrivokajtomasek: you said I should rebase on top of https://review.openstack.org/#/c/365580/ but I don't see any relation between these two patches?10:29
jtomasekakrivoka: pong10:29
akrivokajtomasek: am I missing something or did you mean to link to a different review?10:30
dtantsurhttps://blueprints.launchpad.net/tripleo/+spec/ironic-integration marked done :)10:30
* jtomasek checks10:30
akrivokajtomasek: perhaps https://review.openstack.org/#/c/360569/ ?10:30
*** thrash|g0ne is now known as thrash10:30
openstackgerritMerged openstack/tripleo-common: Ironic Client: Bump the max_retries and retry_interval  https://review.openstack.org/36569410:30
*** ramishra has quit IRC10:32
jtomasekakrivoka: ah, yes, that is the one. Nodes listing patch is dependent on that too. I thought I changed nodes selectors in Nodes listing patch too but I see it happened before and now is merged in master10:32
jtomasekakrivoka: so rebase it on top of Roles listing10:32
akrivokajtomasek: ok10:32
akrivokajtomasek: and another question10:33
akrivokajtomasek: I found a bug in my patch, line 94 here https://review.openstack.org/#/c/367562/1/src/js/components/deployment_plan/NodesAssignment.js10:33
*** ramishra has joined #tripleo10:33
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Update plan files when re-deploying  https://review.openstack.org/36654110:33
akrivokajtomasek: the count I'm getting from getAssignedNodes is the count before the update, but what I need is count after the update10:34
akrivokajtomasek: so e.g. if there are 2 nodes assigned, then I unassign them both, I will get 2 as count and not 010:35
jtomasekakrivoka: hmm, that is probably because updateNode action did not finish by then. Which makes sense as it is async10:35
akrivokajtomasek: how can I make sure it gets called after the nodes counts are updated?10:36
*** Guest90983 is now known as rook10:36
*** nyechiel has quit IRC10:38
jtomasekakrivoka: it is slightly complicated (because we're working around the actual workflow)... so10:38
*** rhallisey has joined #tripleo10:39
jtomasekakrivoka: you'd need to create new action which would get called in updateNodeSuccess action10:41
*** jaosorior_lunch is now known as jaosorior10:41
*** leanderthal|afk is now known as leanderthal10:41
jtomasekakrivoka: to make it possible you'd need to turn that action into thunk action and at the same time as updateNode is too generic for this logic, you'd need to create completely new chain of actions to handle this workflow10:41
jtomasekakrivoka: I think in this case a better approach is to update honza's mistral workflow with additional task which will call the udpate_parameters action10:42
jtomasekakrivoka: what do you think?10:43
jtomasekakrivoka: compared to what it turns out we'd have to do in GUI to achieve the same seems like much better option to me10:43
akrivokajtomasek: yeah probably10:43
jaosorioranyone got time to review this t-h-t patch? https://review.openstack.org/#/c/367208/110:44
akrivokajtomasek: I'll look into that10:44
akrivokashould have probably done that from the start...10:44
akrivokajtomasek: thanks for your input!10:44
jtomasekakrivoka: thanks! I feel bad for these twists :/10:44
akrivokajtomasek: heh, not your fault :)10:44
*** mhenkel has quit IRC10:45
akrivokahonza: mind if I update https://review.openstack.org/#/c/332132/ to add the necessary parameters setting?10:48
jaosoriord0ugal: hey dude, did you figure out if the ovb gates are working?10:51
d0ugaljaosorior: it seems not :)10:52
d0ugaljaosorior: I can't tell why10:52
jaosoriord0ugal: sure seems flaky though10:52
openstackgerritDougal Matthews proposed openstack/tripleo-common: Add an action and workflow to update a plan  https://review.openstack.org/36792110:54
*** athomas has quit IRC10:56
*** CaptTofu_ is now known as CaptTofu10:58
derekhd0ugal: it appears to be packets getting lost, which ia a particular problem for DNS and there is now retry, I've just now added some failback dns servers to the CI instances, so it should help things10:59
derekhd0ugal: pretty much all of the problems I've seen today are yum install fails, which I think are failing on dns lookup11:00
d0ugalderekh: cool, thanks11:00
jaosoriorthrash: hey dude, could you check out this commit? https://review.openstack.org/#/c/367362/11:00
d0ugalderekh: I'll let you know if I see anything different :)11:00
thrashjaosorior: sure11:01
derekhd0ugal: btw the changes I added will only take effect on jobs started from now, already running jobs have no backup11:01
thrashjaosorior: ctlplane is on undercloud, no?11:02
derekhbnemec: sshnaidm|pto ^11:02
*** athomas has joined #tripleo11:02
thrashjaosorior: the overcloud shouldn't really "know" about the ctlplane network.11:03
jaosoriorthrash: how come? we have the keystone admin endpoint listening on that VIP11:03
tbarronmarios: when you get a chance I updated https://review.openstack.org/#/c/366760/ with a remark - no joy yet, but hopefully I'm doing something silly and easy to correct11:03
thrashjaosorior: hmmm11:04
tbarronmarios: i see the patch getting downloaded and cached etc. in the overcloud image build but it's still not there in the overcloud image itself11:04
*** pkovar has joined #tripleo11:04
jaosoriorthrash: yeah dude, we have a VIP dedicated to the control plane, keystone admin endpoint listening on it too :/11:05
*** matbu is now known as matbu|lunch11:05
thrashjaosorior: basically, I'm agreeing with bnemec11:05
thrashit should be in addition, not a replace.11:05
*** dsariel has joined #tripleo11:05
jaosoriorthrash: but we don't have a VIP for the management network11:05
jaosoriorthrash: so it didn't make sense in the first place to add a name for that vip... since there is no vip for that11:06
jaosoriorthrash: that was actually my mess up11:06
thrashjaosorior: I see... You're trying to hide your mistakes. :P11:06
jaosoriorthrash: it's not used by anything at the moment (but the stuff that sets /etc/hosts which I'm changing in that patch. So it's still a good time to replace it.11:06
jaosoriorthrash: haha s/hide/correct11:07
jaosoriorI did raise a bug on it11:07
thrashlol11:07
*** egafford has joined #tripleo11:07
thrashjaosorior: I'm kidding of course.11:07
jaosoriorthrash: but yeah, there is no management vip, so that name doesn't make sense there. It should be for the ctlplane11:08
thrashjaosorior: it seems to me that there should be a mgmt vip tho...11:09
*** pkovar has quit IRC11:09
thrashwhy wouldn't there be?11:09
jaosoriorthrash: if it exists I missed it11:09
*** akshai has joined #tripleo11:11
thrashjaosorior: I'm not saying that it already exists... I'm saying it either should be added, or we leave in place things that facilitate adding.11:11
thrashjaosorior: although, thinking about it more, a management network is likely to be managed externally from ooo11:12
jaosoriorthrash: isn't the management network supposed to be just interfaces to access the overcloud nodes and that's it? I thought that was the reason for it not to have a vIP assigned to it11:12
*** aqkhan__ has quit IRC11:12
thrashjaosorior: I'm coming to the light11:13
*** egafford has quit IRC11:13
jaosoriorthrash: yeah, and I had initially confused the management network to do the same thing as the control plane one11:14
jaosoriorthrash: which is what I'm trying to correct there11:14
thrashjaosorior: gotcha11:14
jaosoriorthrash: this commit goes in the same premise https://review.openstack.org/#/c/367754/11:15
*** ohamada has quit IRC11:15
*** ohamada has joined #tripleo11:15
*** pkovar has joined #tripleo11:15
marioswas afk tbarron sorry ack will do in few11:16
*** absubram has quit IRC11:16
*** ebarrera has quit IRC11:16
tbarronmarios: np, and thanks11:17
*** ebarrera has joined #tripleo11:17
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Update plan files when re-deploying  https://review.openstack.org/36654111:24
openstackgerritDougal Matthews proposed openstack/tripleo-common: Add an action and workflow to update a plan  https://review.openstack.org/36792111:24
jaosoriorthrash: so what do you think dude?11:25
*** fultonj has joined #tripleo11:27
openstackgerritMerged openstack/tripleo-heat-templates: Add keystone networks for the different endpoints  https://review.openstack.org/36717611:28
*** mburned_out is now known as mburned11:31
*** zoli|wfh is now known as zoli|lunch11:32
snecklifterhello, can a red hat person sanity check this when they have a moment please11:33
snecklifterhttps://review.openstack.org/#/c/367628/11:33
sneckliftertrying to understand is proxy parameter has been missed off on purpose...11:33
snecklifterit has passed CI11:34
*** jprovazn has joined #tripleo11:36
slaglesnecklifter: there was another patch for that already that I commented on: https://review.openstack.org/#/c/367554/11:37
*** nyechiel has joined #tripleo11:38
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Add Zaqar to scenario002  https://review.openstack.org/36502611:39
snecklifterslagle: ah, thanks, missed that, will abandon mine as that one includes user/pass11:41
snecklifterslagle: would be nice to see it backported though11:41
sneckliftercurrently I'm just adding in the script/rhel-registration11:41
*** bvandenh_ has joined #tripleo11:45
EmilienMhello11:46
*** abregman has joined #tripleo11:47
*** bvandenh has quit IRC11:48
*** bvandenh_ has quit IRC11:50
*** jprovazn has quit IRC11:50
*** pkovar has quit IRC11:51
jaosoriorEmilienM: hey dude. If you have time, can you check this out? https://review.openstack.org/#/c/327029/37/manifests/certmonger/httpd.pp It's actually a puppet-related question11:53
EmilienMjaosorior: on my list11:53
*** lblanchard has joined #tripleo11:53
*** lucasagomes is now known as lucas-hungry11:55
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168211:55
*** nyechiel has quit IRC11:55
*** pkovar has joined #tripleo11:56
*** jprovazn has joined #tripleo11:57
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Terminate Zaqar websocket endpoint in HAProxy  https://review.openstack.org/36032911:57
jaosoriorthrash: by the way... I think we're running into issues related to the zaqar websocket endpoint11:57
jaosoriorthrash: so... nonha is not being deployed with network isolation11:58
EmilienMjaosorior: Alex is right in his review11:58
EmilienMjaosorior: the spaceship is the solution11:58
jaosoriorthrash: which means that the ssl stuff will overwrite the non-ssl11:58
jaosoriorEmilienM: ok, no problem. I just wanted to know if that was fine... since there will be two steps (step 1 and 2) where the apache service won't appear at all in the service catalog11:59
jaosoriorso I was thinking it would break that notify11:59
thrashjaosorior: hmmm11:59
jaosoriorthrash: wait a minute12:01
jaosoriorno12:01
jaosoriorit should be fine12:01
thrashjaosorior: it shouldn't matter. all things should be port 9000. :)12:01
jaosoriorthrash: I got confused for a bit12:01
*** trown|outtypewww is now known as trown12:01
jaosoriorthrash: yeah, this is how it looks like in the config12:01
jaosoriorlisten zaqar_ws12:01
jaosorior  bind 192.0.2.2:9000 transparent ssl crt /etc/pki/tls/certs/undercloud-192.0.2.2.pem12:01
thrashjaosorior: that happens to me a lot12:01
jaosorior  bind 192.0.2.3:9000 transparent12:01
jaosorior  mode http12:01
jaosorior  server 192.0.2.1 192.0.2.1:9000 check fall 5 inter 2000 rise 212:01
thrashjaosorior: that looks fine to me.12:02
jaosoriorthrash: well... it's still failing in CI somehow :(12:02
jaosoriorwhich is strange, we saw that work yesterday12:03
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375012:04
thrashjaosorior: where are you seeing it fail?12:05
*** jayg|g0n3 is now known as jayg12:08
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: scenarios: set Debug to True  https://review.openstack.org/36689612:08
jaosoriorthrash: in the node registration part12:09
jaosoriorthrash: https://review.openstack.org/#/c/360350/12:10
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: scenario001: deploy Ceph  https://review.openstack.org/36681012:10
thrashjaosorior: ahh yes12:10
*** jpena is now known as jpena|lunch12:12
*** hjensas has quit IRC12:13
jaosoriordtrainor: you around?12:14
*** kjw3 has quit IRC12:15
*** matbu|lunch is now known as matbu12:15
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci: Implement overcloud upgrade job - Mitaka -> Newton  https://review.openstack.org/32375012:25
honzaakrivoka: no at all!  do you want me to rebase it first?12:27
akrivokahonza: no need, I've got it :)12:27
*** pradk has joined #tripleo12:28
*** skramaja has joined #tripleo12:33
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add config parameter to collect-logs ci-script  https://review.openstack.org/36439412:33
*** tobias-fiberdata has joined #tripleo12:36
*** zoli|lunch is now known as zoli|wfh12:36
*** tobias_fiberdata has quit IRC12:39
jaosoriorthrash: hey dude, could you check this one out too? https://review.openstack.org/#/c/367754/2 the values from those facts come from the values we set in the templates, like here: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller.yaml#L41212:42
thrashjaosorior: sure12:44
thrashjaosorior: I don't +2 puppet. :)12:44
thrashI know... not really puppet. :)12:45
jaosoriorI see12:45
jaosoriorthrash: a +1 would do :D12:45
mariostbarron: sorry i keep getting interrupts, but will update momentarily, trying to come up with something to help... but agree you are not picking up the puppet-tripleo changes from what i can see12:46
mariostbarron: long story short, i think we can just use virt-customize to upload the puppet manifest to the overcloud.yaml image so you can get passed this pain with trying to pull the review12:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Convert UpdateWorkflow to support composable roles  https://review.openstack.org/36728212:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Convert allNodesConfig properties to composable jinja2  https://review.openstack.org/36579412:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Move role ResourceGroups inside the jinja2 loop  https://review.openstack.org/36579312:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Convert AllNodesExtraConfig to support composable roles  https://review.openstack.org/36729512:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Convert deploy steps to jinja2 loop  https://review.openstack.org/36579612:48
*** lucas-hungry is now known as lucasagomes12:51
jaosoriorthrash: thanks dude12:51
*** jaosorior has quit IRC12:52
*** jaosorior has joined #tripleo12:53
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Use relative paths in ci-scripts for quickstart.sh  https://review.openstack.org/36064912:53
*** rlandy has joined #tripleo12:54
*** Goneri has joined #tripleo12:54
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Document Third Party CI and developer usage  https://review.openstack.org/36000712:55
jtomasekhonza: I've updated shrinkwrap but jenkins still fail on some dependency https://review.openstack.org/#/c/366615/12:56
* honza looking12:56
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Add Role Detail  https://review.openstack.org/36799312:57
*** tobias-fiberdata has quit IRC12:58
*** b00tcat has quit IRC12:58
*** tzumainn has joined #tripleo12:58
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Make undercloud service workers configurable  https://review.openstack.org/36611612:58
*** jcoufal has joined #tripleo12:59
honzajtomasek: works fine for me locally, investigating further12:59
jtomasekhonza: yeah:/13:00
honzajtomasek: i feel like we've had this issue before --- something about phantom13:01
*** pgadiya has quit IRC13:01
jtomasekhonza: it was colision of phantomjs and phantomjs-prebuilt afaik. there is no more phantomjs npm package, so it must be something different13:01
honzajtomasek: sounds about right, good memory13:02
*** tobias_fiberdata has joined #tripleo13:02
tbarronmarios: sure, the old virt tools vs dib thing :)13:02
openstackgerritMerged openstack/tripleo-common: Preserve the shell environment for run-validation  https://review.openstack.org/36598313:03
tbarronmarios: though if I'm not executing wrong and dib (as used by tripleo-ci) isn't getting review changes that could be an issue for others than me i'd think13:04
honzajtomasek: seems like a lot of people are having installation issues with phantomjs-prebuilt https://github.com/Medium/phantomjs/issues13:05
jtomasekhonza: yep13:06
honzajtomasek: let's try upgrading to the latest version first?13:06
jtomasekhonza: that was my thought, I am going to update that patch13:07
*** cdearborn has joined #tripleo13:08
honzajtomasek: finally found an issue that matches our output https://github.com/Medium/phantomjs/issues/51913:09
*** jprovazn has quit IRC13:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: ModalPanel component  https://review.openstack.org/36661513:12
jtomasekhonza: ^ update to latest phantomjs-prebuilt, hope it helps13:12
jtomasekhonza: if not then IIUC we need to clean the npm cache on the jenkins machine?13:13
*** nyechiel has joined #tripleo13:14
*** dsariel has quit IRC13:14
jtomasekjrist: can you try mistral action-exectution-list and see what execution is failing?13:15
mariostbarron: indeed, might be worth following up with a bug to report what you did so someone can cycle back. i updated the review https://review.openstack.org/#/c/366760/4 with a comment and added notes for virt-customize to https://etherpad.openstack.org/p/manila-overcloud-deploy-with-netapp-notes13:15
EmilienMthe ovb jobs are still unreliable, I see some transient issues on centos repositories13:15
EmilienMnext week is RC1 we need to merge patches13:15
jristjtomasek: hmm13:15
jrist[stack@instack tripleo-common]$ mistral action-execution-list13:15
jristERROR (app) Entity '<class 'mistral.db.v2.sqlalchemy.models.ActionExecution'>' has no property 'type'13:15
EmilienMjistr: ^ I want to land the composable roles patches13:16
tbarronmarios: excellent, i'll read the comment and notes and move forwards13:16
jtomasekjrist: something is broken hah13:17
jristjtomasek: yeah13:17
jristjtomasek: I'll just nuke13:18
jrist:(13:18
jrist...again13:18
jrist:)13:18
jistrEmilienM: you mean to ignore the ovb jobs? hmm :/ i don't know what are the exact differences between that and multinode but e.g. the multinode jobs don't test HA at all, right?13:20
openstackgerritJeff Peeler proposed openstack/tripleo-common: Set Deployment Parameters  https://review.openstack.org/36562513:21
EmilienMjistr: no we can't do that13:21
EmilienMjistr: the multinode deploy pacemaker but it's a all in one node, we merge controller and compute13:21
jistrah ok13:22
EmilienMpabelanger is pushing for a centos repo mirror13:22
*** jprovazn has joined #tripleo13:22
jistrcool13:22
EmilienMso we can kill this problem with package not found13:22
EmilienMand i'm investigating if there are other problems13:22
jaosoriorEmilienM, jistr: Feed me reviews13:22
jaosoriorI have time to check out the composable roles remaining stuff13:23
EmilienMjaosorior: it's not a matter of review13:23
jistrjaosorior: you can just start here and go up the dependency chain on top right :) https://review.openstack.org/#/c/36576313:23
EmilienMbut a  matter of CI passing or not13:23
EmilienMjaosorior: though you can review, for sure :)13:23
EmilienMjaosorior: we're having network troubles, see on #rdo13:23
*** jpena|lunch is now known as jpena13:24
larsksEmilienM: it looks like verification on 353506 failed for reasons not related to the patch itself...13:25
EmilienMlarsks: this is true13:25
larsksWhat do we do?13:25
EmilienMlarsks: on #rdo, we're chatting and trying to find solutions13:25
EmilienMwe're having networking issues in CI13:25
larsksOkay.  I will follow along.13:25
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart: Add documentation for add-on roles  https://review.openstack.org/34673313:26
pabelangerderekh: re: DNS issues, did you see my comments yesterday about using tripleo-centos-7 nodes for DNS?  We hace DNS caching setup already for google and should be straightforward to use them as servers for ovb nodes13:28
pabelangerneed to test, but should be able to open firewall on tripleo-centos-7 to accept udp/5313:28
derekhpabelanger: its worth a try but I don't think the DNS server we're using is the problem, we're just loosing packets somewhere, give me a few mintes to confirm13:30
pabelangerderekh: yes, that is possible too. We've had this issue in the past I believe13:31
jaosoriorEmilienM: ah, crap :/13:31
EmilienMlarsks: I know your stuff is urgent and I got reminders every day to merge it. We'll merge it when our CI will be working13:31
*** pradk has quit IRC13:32
*** pradk has joined #tripleo13:32
larsksEmilienM: No worries.  I just noticed the -1 this morning and wanted to check in!13:32
openstackgerritMerged openstack/tripleo-quickstart: inventory role no longer needed for the usbkey  https://review.openstack.org/36504813:33
EmilienMjistr: I'm going to land https://review.openstack.org/#/c/365763/ it passes less than 48h ago and we didn't modify the code, just rebased13:34
EmilienMlarsks: I'm rebasing your patch13:35
openstackgerritMerged openstack/tripleo-quickstart: Add objectstorage flavor and extra blockdevices option  https://review.openstack.org/35963013:36
jistrEmilienM: the rebase looks like it's in a different spot than the patch itself https://review.openstack.org/#/c/365763/13..14/overcloud.yaml so i'm fine with merging it13:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add fluentd client service  https://review.openstack.org/35350613:37
EmilienMjistr: ack13:37
EmilienMjistr: I'm currently exploring all we can to merge stuffs13:38
*** jschluet has joined #tripleo13:38
jistrEmilienM: i think this is the same case https://review.openstack.org/#/c/365792/ so once the parent merges we can merge this one too13:39
jistralso passed on previous patchset, clean rebase it seems13:39
EmilienMjistr: please look https://review.openstack.org/#/c/365735/13:39
EmilienMjistr: I just approved it, parent will merge, no need to wait13:39
EmilienMwhen 365735 is merged, we can continue the rest of THT13:40
* rcrit hasn't had a successful tripleo install in days :-(13:40
jistryea it has a depends-on too though, which didn't pass CI... i'll review them both13:41
rcritseeing a bunch of Error: Command exceeded timeout13:41
openstackgerritMerged openstack/tripleo-quickstart: Add back socket for ci-scripts - OVB and baremetal  https://review.openstack.org/36754513:41
*** jschluet is now known as jschlueter|afk13:41
*** jschlueter|afk is now known as jschlueter13:41
openstackgerritLucas Alvares Gomes proposed openstack/tripleo-quickstart: Force the use of python/pip version 2  https://review.openstack.org/36801313:42
*** rhallisey has quit IRC13:43
EmilienMjistr: https://review.openstack.org/#/c/362465/ can me merged13:43
EmilienMjistr: because https://review.openstack.org/#/c/365735/ is full green13:44
*** rhallisey has joined #tripleo13:44
EmilienMslagle: no need to recheck imho13:48
EmilienMslagle: CI was full green on https://review.openstack.org/#/c/365735/13:48
EmilienMslagle: which depends-on the patch you just rechecked13:48
EmilienMjistr, slagle: though this one I have a doubt: https://review.openstack.org/#/c/315679/ I did recheck to make sure we don't break anything13:54
*** [1]cdearborn has joined #tripleo13:54
jristugh another phantomjs-prebuilt issue?13:58
jtomasekhonza: weird thing is that it is failing only on that single patch (and its dependent patches)13:59
*** fragatina has joined #tripleo14:01
derekhpabelanger: hmmm, maybe it is the named server, on the bastion (where named is running) I can see udp requests with no reponse14:03
derekhpabelanger: line 9 (http://paste.openstack.org/show/570204/)14:03
dtrainorjaosorior, ping14:03
*** pkovar has quit IRC14:03
derekhpabelanger: bnemec I'd imagine this would be relevant14:04
derekhSep  9 10:03:25 host01-rack01 kernel: nf_conntrack: table full, dropping packet.14:04
pabelangerderekh: where is that from?14:05
derekhpabelanger: bastion14:05
*** nyechiel has quit IRC14:05
*** fragatina has quit IRC14:06
*** skramaja has quit IRC14:06
pabelanger:(14:06
jaosoriordtrainor: hey dude, you mentioned that you were gonna work on the UI SSL parts. Got any patches up already? Need any help?14:06
pabelangerderekh: what is preventing us from removing the bastion server?14:07
dtrainorI appreciate you reaching out, thanks.  I got SSL working fine on the Undercloud, but I found what I believe to be a bug in UI that misconfigures the websocket url when the UI discovers that the Undercloud uses SSL/TLS14:07
*** akshai_ has joined #tripleo14:08
jaosoriordtrainor: what's the bug?14:08
jaosoriordtrainor: did you take a look at the generate_service_certificate part?14:08
dtrainorI need to run through the Undercloud SSL setup again a few more times.... I want to better understand how subaltname is used or referenced14:08
dtrainorI did not because at the moment I'm tasked with some UI on OSP9 bits :)14:09
*** cdearborn has quit IRC14:09
derekhpabelanger: dunno, the rack was setup for all public traffic to come in via the bastion, I don't know how hard that would be to change14:09
derekhpabelanger: looking into the connecting tracking limits now14:09
*** myoung has joined #tripleo14:09
jaosoriordtrainor: the websocket endpoint at the moment is not done by instack-undercloud, but that's coming.14:10
jaosoriorbut then again, that's newton14:10
dtrainorUnderstood.  It's the UI that incorrectly generates the wss url14:10
dtrainorgive me a second here, let me go through some other notes, someone took a look at this overnight14:11
*** akshai has quit IRC14:11
pabelangerderekh: Ya, obviously we cannot remove it today. But we should maybe start the discussions around removing it. Not a fan of routing all tripleo-test-cloud-rh1 traffic thought it14:11
derekhpabelanger: ok14:11
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Use relative paths in ci-scripts for quickstart.sh  https://review.openstack.org/36064914:11
pabelangerderekh: I'll start a thread on the ML about it, see if I can collect more information about it14:12
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Document Third Party CI and developer usage  https://review.openstack.org/36000714:12
derekhpabelanger: ack14:12
*** myoung is now known as myoung|bbl14:12
jaosoriorbnemec: are you around yet?14:13
jaosoriordtrainor: well, zaqar-websocket is not yet supported by haproxy14:14
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: DNM: try to break tripleo-update job  https://review.openstack.org/36802514:14
jaosoriordtrainor: got a patch that will hopefully do the trick, but that's not there yet14:14
*** skramaja has joined #tripleo14:14
*** tobias-fiberdata has joined #tripleo14:14
jaosoriordtrainor: actually thrash and me were looking at that haproxy part14:14
jaosoriordtrainor: but I do think you want to get the UI terminated by haproxy also14:14
*** mhenkel has joined #tripleo14:16
*** tobias_fiberdata has quit IRC14:17
EmilienMslagle: can you approve https://review.openstack.org/#/c/366896/ please?14:18
EmilienMpradk: AFIK scenario001 is red because of telemetry stuff (without ceph) - i'm looking into it14:22
EmilienMhttp://logs.openstack.org/96/366896/4/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/97ed4b4/console.html#_2016-09-09_13_05_29_29731414:22
*** pkovar has joined #tripleo14:22
EmilienMpradk: see this aodh error: http://logs.openstack.org/96/366896/4/check/gate-tripleo-ci-centos-7-scenario001-multinode-nv/97ed4b4/logs/subnode-2/var/log/aodh/app.txt.gz#_2016-09-09_13_05_24_95614:23
EmilienMok I switch on telemetry channel14:24
*** jprovazn has quit IRC14:24
*** mhenkel has quit IRC14:25
EmilienMok so FTR about telemetry problem, they fixed it today, we need a promotion then14:28
dtrainorjaosorior, yes i understand :)14:28
dtrainorgive me a few minutes here14:28
EmilienMhttps://review.openstack.org/#/c/366638/ fixed it14:29
*** mburned is now known as mburned_out14:30
bnemecjaosorior: I am now.14:32
dtrainorjaosorior, i understand that a lot of ssl related bits have changed between mitaka to newton and i'm totally ok with that.  they're all great changes that help implement ssl much better.  unfortunately i'm tasked with something that revolves around mitaka/osp9 right now, that's why i was working with those particular pieces of software.14:37
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart: Add documentation for add-on roles  https://review.openstack.org/34673314:37
jaosoriorbnemec: hey dude, so, actually based on your comment it turned out that I had really confused what the management network means :/ so I fixed up the patch to fix what had occured because of that, and to do what I really needed: https://review.openstack.org/#/c/367362/ what do you think?14:37
ccamachohey shardy, I finished to merge the first part of my changes for https://review.openstack.org/#/c/346799 can you check my last comment there? Now im hitting some un-related issues "Could not find class ::keystone::cors" but my env its kind of old, I'm going up update all and re launch the deployment.14:37
*** rajinir has joined #tripleo14:37
jaosoriordtrainor: oooh I see14:38
dtrainorjaosorior, really looking forward to this one task of mine going away so i can immerse myself in all the osp10 ssl goodness14:44
bnemecjaosorior: +2a14:44
slagleEmilienM: hey, for the undercloud upgrades in tripleo.sh, i'm not sure we should be rm'ing all the delorean repo files, b/c delorean-current.repo is removed, which could actually be newer than what you're trying to upgrade to (rdo-trunk-master-tested)14:44
openstackgerritDougal Matthews proposed openstack/tripleo-common: Add an action and workflow to update a plan  https://review.openstack.org/36792114:45
EmilienMslagle: indeed14:45
slagleEmilienM: why can't we just rerun repo_setup, and try an upgrade?14:45
pradkEmilienM, sorry was afk.. cool you got it resolved14:45
EmilienMslagle: I can't remember details of why I did that, but sure, let's try it !14:45
*** mcornea has quit IRC14:46
EmilienMpradk: well, not really but see #rdo14:46
jaosoriorbnemec: can you check this one out too? https://review.openstack.org/#/c/367754/ it's along the same theme14:46
slagleEmilienM: ok, i'll work on something14:46
bnemecslagle: EmilienM: I think at one point our docs recommended that.14:46
EmilienMslagle: merci14:46
pradkEmilienM, yea new promotion needed for h fix14:46
bnemecWhy are we "upgrading" to an older repo anyway?14:46
slaglebnemec: rerunning --repo-setup?. i think so14:46
EmilienMpradk: promotion in upstream requirements14:46
bnemecslagle: No, deleting the existing repo files.14:47
EmilienMpradk: not in RDO, because RDO is waiting for upstream req update which requires FFE14:47
bnemecOr maybe I just made that up when I did my undercloud upgrade. :-)14:47
slaglebnemec: i guess it depends on what we're trying to test with this14:48
slaglebnemec: i think it ought to be: not installed, --repo-setup, install. then: delorean-current for all packages, upgrade14:49
openstackgerritMartin André proposed openstack/tripleo-heat-templates: Have docker start script honor configuration  https://review.openstack.org/36613814:49
openstackgerritMartin André proposed openstack/tripleo-heat-templates: Add steps to containerized compute deployment  https://review.openstack.org/34692714:49
openstackgerritMartin André proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles  https://review.openstack.org/33065914:49
openstackgerritMartin André proposed openstack/tripleo-heat-templates: Bind mount files to run DiD in latest atomic host  https://review.openstack.org/34721814:49
openstackgerritMartin André proposed openstack/tripleo-heat-templates: Be more inclusive in insecure registry regex  https://review.openstack.org/36611114:49
slaglebnemec: that would test that we can upgrade from our currently promoted repo to delorean-current14:49
*** mhenkel has joined #tripleo14:50
bnemecslagle: How would delorean-current be older than the pinned tripleo repo?14:50
slagleit won't be14:51
*** dtrainor has quit IRC14:51
*** dtrainor has joined #tripleo14:51
bnemecslagle: FWIW, that step came from http://docs.openstack.org/developer/tripleo-docs/installation/installation.html#updating-undercloud-components14:52
bnemecI don't have a problem removing it as long as we're sure we won't end up with old repo files lying around.14:52
*** jcoufal has quit IRC14:53
slaglebnemec: ok, i think the issue is that what's done in undercloud_uprade doesnt match those docs14:53
slaglein that it doesn't put back a delorean-current.repo and it uses rdo-trunk-master-tested instead of rdo-trunk-master-tripleo14:54
slagle(not that i could even tell you the difference between those 2 fwiw)14:54
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: WIP - Add puppet-lint 2.0.0 to check puppet-tripleo manifests  https://review.openstack.org/35284714:55
bnemecslagle: Yeah, the undercloud upgrade process is still pretty fscked, and I wish we weren't implementing it in tripleo.sh.14:55
*** myoung|bbl is now known as myoung14:56
*** jcoufal has joined #tripleo14:56
slaglebnemec: we're not permanently. there is a note to clean it up, and EmilienM started a discussion about it on the ML14:56
slaglei'd like to see it all in instack-undercloud14:57
bnemecslagle: Yeah, but we're cutting Newton soon.  What are the odds it gets moved to tripleoclient/instack-undercloud in time?14:57
*** pkovar has quit IRC14:58
slaglebnemec: i think that it is documentation until it is properly implemented, which doesnt have to be for Newton14:58
slagleand that is what tripleo.sh is capturing14:58
slaglesame as always14:58
bnemecI guess I'm not in a position to criticize since I completely fell of the undercloud upgrade wagon lately, but I feel like there are a lot of things that went into tripleo.sh "temporarily" and are still there a year+ later.14:58
bnemecAnyway, I'll take a look at the ML thread.14:59
bnemecNeed to catch up on that anyway.14:59
slaglebnemec: i think tripleo.sh matches the docs pretty closely tbh15:00
slaglewith the exception of this piece, which was just added15:00
*** jobewan has joined #tripleo15:00
*** abehl has quit IRC15:01
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Update plan files when re-deploying  https://review.openstack.org/36654115:02
openstackgerritDougal Matthews proposed openstack/tripleo-common: Add an action and workflow to update a plan  https://review.openstack.org/36792115:02
*** pkovar has joined #tripleo15:02
openstackgerritLucas Alvares Gomes proposed openstack/tripleo-quickstart: Force the use of python/pip version 2  https://review.openstack.org/36801315:02
*** jaosorior has quit IRC15:07
*** pcaruana has quit IRC15:08
*** mburned_out is now known as mburned15:09
*** abregman has quit IRC15:10
*** ebarrera has quit IRC15:11
*** egafford has joined #tripleo15:17
bnemecderekh: I see no recent nf_conntrack messages on the bastion.  Is that fixed?15:19
*** mhenkel has quit IRC15:20
derekhbnemec: http://paste.openstack.org/show/570228/15:20
derekhbnemec: I've doubled the table size and reduced some of the timeouts, monitoring it at the moment to see how big the table grows15:21
*** egafford has quit IRC15:21
bnemecderekh: Cool.15:21
bnemecderekh: How do you have root on the bastion?  Do you have the password or did someone give your user sudo?15:22
*** mbound has quit IRC15:22
*** jcoufal has quit IRC15:22
*** egafford has joined #tripleo15:22
derekhbnemec: this would almost definitely have been causing all kinds of random stuff to go on15:22
bnemecderekh: Yeah, now that you point out the conntrack messages I'm pretty sure I saw the same behavior when I was exhausting conntrack on my router at home.15:23
bnemecAt first I thought it was just bad package mirrors, but at some point I realized I was the only one having trouble with them.15:23
bnemecSo weird that we ran for a month, at times with a heavier workload than now, and never ran into this before.15:24
*** nyechiel has joined #tripleo15:24
derekhbnemec: I only got root recently, after we did the RAM upgrade and realized too few people have root (only wfoster and kambiz had it I think)15:24
derekhbnemec: ya, something must have changed to all of a sudden start more connections15:25
bnemecderekh: Dropping the timeouts seems to have helped.  It's down to 60000.15:27
derekhbnemec: ya, i'd love to know which one did the trick, is there a way to see what the connections the kernel was tracking I wonder15:28
openstackgerritDougal Matthews proposed openstack/tripleo-common: Check the result of the parent action when subclassing  https://review.openstack.org/36808115:29
bnemecderekh: conntrack -L seems to do that.15:33
*** leanderthal is now known as leanderthal|afk15:35
*** jistr is now known as jistr|biab15:35
mariosbandini: i'll have a more 'proper' look https://review.openstack.org/#/c/358626 monday sorry didn't get to cycle back yet15:37
*** jcoufal has joined #tripleo15:37
bandinimarios: ah no worries at all, I will try to implement option C) as suggested by Jiri15:38
bandinimarios: it'd be great if we could land your rework asap15:39
mariosbandini: yes i know i wanted today but looks like monday it has to be15:39
bandinimarios: aye! you have a nice weekend ;)15:39
mariosyou too bandini15:39
*** nyechiel has quit IRC15:40
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Pin setuptools to <27.1.1  https://review.openstack.org/36809015:45
openstackgerritMerged openstack/puppet-tripleo: Add Ceph RGW profile  https://review.openstack.org/33408115:46
derekhbnemec: /tmp/conntrack.list15:48
trownadarazs: mind giving a quick look to https://review.openstack.org/#/c/368090/ before you take off, all our jobs will start failing without that15:48
derekhbnemec: its almost all connections for DNS15:48
*** openstackgerrit has quit IRC15:49
*** tesseract- has quit IRC15:49
*** openstackgerrit has joined #tripleo15:49
derekhbnemec: every dns request must open a udp stream that stays open until it timesout15:49
*** jlinkes has quit IRC15:49
trownah yep linter jobs failed on the same thing, though not sure how we fix those15:50
trownhmm yep #openstack-infra has seen the same15:51
bnemecderekh: Yeah, we must have done something that is resulting in more DNS lookups recently.15:51
*** aufi has quit IRC15:52
-openstackstatus- NOTICE: New setuptools release appears to have a circular import which is breaking many jobs - check for ImportError: cannot import name monkey.15:56
*** ChanServ changes topic to "New setuptools release appears to have a circular import which is breaking many jobs - check for ImportError: cannot import name monkey."15:56
*** jcoufal has quit IRC15:56
trownhmm seems odd to change the topic of every channel15:56
*** jcoufal has joined #tripleo15:56
*** dtantsur is now known as dtantsur|afk15:59
openstackgerritMerged openstack/tripleo-heat-templates: Move role deployment steps into puppet/post.yaml  https://review.openstack.org/36576316:00
lucasagomestrown, have you seem this running ooo-quickstart: http://paste.openstack.org/show/570247/ ?16:00
bkerolucasagomes: means python-tripleoclient isn't installed IIRC16:00
trownlucasagomes: that would probably mean you are using an undercloud image that does not have python-tripleoclient installed16:00
openstackgerritMerged openstack/tripleo-heat-templates: Remove *ExtraConfig parameters from overcloud.yaml  https://review.openstack.org/36579216:00
openstackgerritMerged openstack/tripleo-common: Wire in jinja templating for custom roles  https://review.openstack.org/36246516:00
lucasagomesbkero, trown right, just wondering if you seem it cause I'm just using the normal devmode thingy16:01
lucasagomesit should get the images from ooo-ci right?16:01
trownlucasagomes: ya, unfortunately devmode is in a bit of a rough state, it was constructed around having an instack.qcow2 from ooo-ci, but that is no longer being produced and quite out of day16:02
trowndate16:02
lucasagomestrown, right16:02
trownI am working on making it consume the overcloud-full.qcow2 as an undercloud image now16:02
lucasagomesack, I will look into it16:02
trownit is a bit tricky, but I have had some success today16:02
zoli|wfhhave a good weekend16:04
*** zoli|wfh is now known as zoli|gone16:04
*** yamahata has joined #tripleo16:06
*** limao has joined #tripleo16:08
*** skramaja has quit IRC16:09
*** akshai_ has quit IRC16:12
*** limao has quit IRC16:12
openstackgerritJames Slagle proposed openstack/tripleo-docs: Update docs for undercloud upgrade  https://review.openstack.org/36813816:16
*** lmiccini has quit IRC16:21
*** florianf has quit IRC16:21
*** zoli|gone is now known as zoli_gone-proxy16:21
*** jcoufal has quit IRC16:22
*** mbound has joined #tripleo16:22
*** jcoufal has joined #tripleo16:24
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Use current-tripleo for undercloud upgrades  https://review.openstack.org/36814216:24
EmilienMnice ^16:24
*** bana_k has joined #tripleo16:25
*** akshai has joined #tripleo16:25
*** jistr|biab is now known as jistr16:25
openstackgerritJulie Pichon proposed openstack/tripleo-common: Mistral workflow for creating a deployment plan from JSON input  https://review.openstack.org/34783016:26
*** mbound has quit IRC16:28
*** jbadiapa has quit IRC16:30
*** fragatina has joined #tripleo16:32
*** snecklifter has quit IRC16:33
*** athomas has quit IRC16:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: DNM: try to break tripleo-update job  https://review.openstack.org/36802516:35
*** dsneddon has joined #tripleo16:38
*** akrivoka has quit IRC16:44
*** lucasagomes is now known as lucas-afk16:44
*** lmiccini has joined #tripleo16:47
openstackgerritJulie Pichon proposed openstack/tripleo-common: Remove the old, deprecated Mistral action names.  https://review.openstack.org/36652916:48
*** akrivoka has joined #tripleo16:52
*** tosky has quit IRC16:52
*** jpich has quit IRC16:52
*** derekh has quit IRC16:54
*** trown is now known as trown|lunch16:56
openstackgerritRyan Brady proposed openstack/tripleo-common: [WIP] Port password generation from tripleoclient to tripleo-common  https://review.openstack.org/36815016:56
*** ohamada has quit IRC16:58
*** ChanServ changes topic to "TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt"16:59
-openstackstatus- NOTICE: setuptools 27.1.2 addresses the circular import16:59
*** rodrigods has quit IRC17:03
*** rodrigods has joined #tripleo17:03
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Increase severity of all checks to error  https://review.openstack.org/36815217:03
*** yamahata has quit IRC17:06
*** bana_k has quit IRC17:08
*** chem has quit IRC17:10
*** jpena is now known as jpena|off17:11
bnemecEmilienM: Just a heads up, the ovb jobs look good now that we've resolved the conntrack issues on the bastion.17:17
EmilienMoh what a good news17:17
*** pkovar has quit IRC17:19
slagleEmilienM: instead of rechecking all the custom roles patches, maybe we can just recheck every 3rd or 4th one17:21
slagleEmilienM: e.g., i rechecked https://review.openstack.org/#/c/364749/, if that passes, we can merge that and the 3 prior17:21
EmilienMyes, this is a good idea17:21
bnemecslagle: EmilienM: Note that a bunch of those failed the multinode job the same way they did the ovb jobs.  e.g. https://review.openstack.org/#/c/315679/3717:22
bnemecThey seem to be hanging at overcloud deploy time.17:22
*** bana_k has joined #tripleo17:22
EmilienMnot great, though we haven't change it recently17:22
slaglebnemec: oh, is that something on our side?17:24
slaglei guess it might be17:25
slaglelet me try a local test17:27
bnemecslagle: I don't know, but the fact that it's happening consistently in both ovb and multinode makes me think it's not an infrastructure problem.17:27
bnemecMaybe we have an infinite jinja loop.17:28
* bnemec trademarks that as his future band name17:28
*** bnemec is now known as beekneemech17:28
slaglei totally rave to that17:29
*** jcoufal has quit IRC17:30
*** flepied has quit IRC17:30
EmilienMand https://review.openstack.org/#/c/365735/17:32
EmilienMmhh17:33
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Increase severity of all checks to error  https://review.openstack.org/36815217:35
EmilienMI'm trying to find what we could have broken17:37
EmilienMhttps://review.openstack.org/#/c/362465/ was full green17:38
*** fragatina has quit IRC17:39
*** fragatina has joined #tripleo17:43
*** yamahata has joined #tripleo17:44
slagleyes, but that's not actually used until https://review.openstack.org/#/c/315679/ is tested17:47
slagleand the depends-on tripleoclient patch17:47
*** fragatina has quit IRC17:48
EmilienMI ran recheck on https://review.openstack.org/#/c/365735/ to see if it was transient17:48
slaglek. i'm trying it locally as well17:49
slaglehad to rebuild new oc images though, so it will be a few17:49
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Remove unused import  https://review.openstack.org/36816717:53
openstackgerritHonza Pokorny proposed openstack/tripleo-ui: Increase severity of all checks to error  https://review.openstack.org/36815217:55
*** trown|lunch is now known as trown17:55
*** akshai has quit IRC18:05
*** akshai has joined #tripleo18:12
slagleEmilienM: ok, so testing the tht and tripleoclient patch together, it does just hang for me18:27
slagleat "Creating plan from template files in: tripleo-root/tripleo-heat-templates/"18:27
slagleaccording to mistral, the error is Failure caused by error in tasks: notify_zaqar18:27
EmilienMdamn18:28
EmilienMslagle: have you this one too ? https://review.openstack.org/#/c/362465/18:28
slagleyes18:28
EmilienMin http://tripleo.org/cistatus.html I don't see much red18:29
EmilienMI'm wondering if it's transient or not18:29
EmilienMrbrady: do you have any idea of what we could miss here?18:30
EmilienMslagle: see https://review.openstack.org/#/c/366541/8 also18:30
*** flepied has joined #tripleo18:30
EmilienMare you redeploying?18:30
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/162093218:30
openstackLaunchpad bug 1620932 in tripleo "openstack overcloud deploy will use the old plan and wont update on a second deploy" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal)18:30
EmilienMit also depends on https://review.openstack.org/#/c/367921/18:31
slagle ZaqarAction.queue_post failed: <class 'zaqarclient.transport.errors.MalformedRequest'>: Error response from Zaqar. Code: 400. Title: Invalid API request. Description: Message collection size is too large. Max size 524288.18:31
slagle] (execution_id=e36ebe4e-cce7-4ea6-be79-4ac64156fb62)18:31
EmilienMoh I saw that already18:31
slaglei'm not updating, i'm starting clean each time18:31
EmilienMwe increased it recently18:31
slagleis there a fix?18:31
slaglei updated my undercloud, maybe i didnt get it18:32
EmilienMlet me find it again18:32
EmilienMhttps://review.openstack.org/#/c/344537/18:33
EmilienMdprince did that 7 weeks ago18:33
slagleEmilienM: look at the error i posted though :(18:33
slaglewe're exceeding it again18:33
EmilienMsounds like 524288 is too small18:34
*** fragatina has joined #tripleo18:34
*** jcoufal has joined #tripleo18:34
*** fragatina has quit IRC18:34
EmilienMcan we have thoughts from d0ugal, jrist, rbrady on this thing? ^18:34
EmilienMdo we need to increase it?18:34
*** fragatina has joined #tripleo18:34
*** noslzzp has quit IRC18:36
slagledunno enough right now to know if it's reasonable to increase it or not18:37
EmilienMslagle: do have the size of the message by any chance?18:37
EmilienMmaybe in mistral or zaqar's logs18:37
EmilienMthrash: any idea?18:37
slagleEmilienM: no. zaqar doesnt even seem to be fully configured to log to it's logfile18:38
slagleand in the journal output all it shows is it returning 400's for bad request18:39
thrashEmilienM: slagle sounds to me like we are trying to pass too much around in zaqar...18:39
slagleflaper87: any thoughts about max zaqar message size? how big can we safely make it?18:40
EmilienMvkmc: ^ too :)18:41
slaglethis is random ping friday18:41
thrashlol18:41
EmilienMat this stage of cycle, I have no shame to ping people18:41
EmilienMand find solutions18:42
EmilienM:)18:42
EmilienMslagle: can you just for fun increase the size in zaqar.conf and retry?18:42
slaglesure, let me clean up first18:43
slaglejust need to delete 10 different things18:43
slagleusing 15 different api's18:44
EmilienMI guess the size is in bytes?18:44
* EmilienM looks in zaqar code18:44
EmilienMin doc they set 262144 by default18:46
EmilienMthe default in code is 262144 too18:47
slagleand we doubled that18:47
slaglei'll try doubling again18:47
EmilienMI'm not sure if I'm true, but iirc the most templates we have, more message is big18:48
EmilienMand I guess bigger is mistral plan, bigger is zaqar message18:48
slagleok, it's deploying now, but I got an error on the cli18:48
slagleObject GET failed: https://192.0.2.2:13808/v1/AUTH_870ac3192305413ea9758ce9419350b9/overcloud/overcloud-without-mergepy.yaml 404 Not Found  [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.<18:48
slagleit's still going though, so that must not be fatal18:49
EmilienMit's only 524,588 kb18:50
EmilienMmaybe the plan is bigger18:50
beekneemechWait, we completely removed without-mergepy.  Why is the shiny brand new api looking for it at all?18:50
beekneemechEmilienM: You mean bytes?18:51
EmilienMyes18:51
slaglebeekneemech: tripleoclient still prefers that name18:51
EmilienMslagle: also, your comment, have you seen this error? http://logs.openstack.org/79/315679/37/check/gate-tripleo-ci-centos-7-nonha-multinode/4233b5f/console.html#_2016-09-09_14_28_59_66656618:51
openstackgerritMerged openstack/tripleo-common: Run copy_ssh_keys after overcloud finishes  https://review.openstack.org/36742218:52
openstackgerritMerged openstack-infra/tripleo-ci: scenarios: set Debug to True  https://review.openstack.org/36689618:52
slagleEmilienM: it means the image build failed, and that did not fail the CI job for some reason18:52
slagleEmilienM: or possibly the image failed to upload to glance18:53
beekneemechThat's a multi-node job, there aren't supposed to be images.18:53
openstackgerritMerged openstack/tripleo-heat-templates: Generate VIP info for ctlplane VIP, not management  https://review.openstack.org/36736218:53
slagleoh, it was a trick question18:53
beekneemech:-)18:53
EmilienMyes18:53
slagleyea, you can ignore that18:53
slagleEmilienM: that job is timing out because of the same zaqar message size18:53
openstackgerritMerged openstack/tripleo-common: Remove "type: direct" from workflows as it is the default  https://review.openstack.org/34161718:54
EmilienMthis is sad we don't have logs18:54
slagleyou can see it hung at the same place18:54
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart: Add documentation for add-on roles  https://review.openstack.org/34673319:17
*** isq has quit IRC19:17
bandinimatbu: ok so I narrowed down the commit that broke it, but I am quite unsure if it is a heat issue or a tht one19:21
*** lmiccini has quit IRC19:22
EmilienMtherve: tl;dr: we are seeing errors in tripleo because zaqar messages reached the size limit19:26
EmilienMwe already doubled the default size on the undercloud19:26
EmilienMand were wondering if it would be safe to increase it19:26
therveSure I don't see why not, especially in the undercloud19:26
EmilienMcurrent size is 52428819:26
EmilienMok19:26
EmilienMwe're seeing transient issues with this thing19:26
therveThat sounds like not too small for config transport, if you're using it for that19:27
EmilienMtherve: we use it for plans19:27
EmilienMso yes, config transport I guess19:28
slaglewhy does the whole plan have to go through the zaqar notification though?19:28
therveWe had that issue in the CFN transport IIRC, and it was 1M19:28
therveI don't know what a tripleo plan is :/19:29
slagleyea it was mostly a rhetorical question :)19:31
slaglenobody knows19:31
*** tzumainn has quit IRC19:32
therveThe config transport still seems to be POLL_SERVER_CFN in tht19:34
therveEmilienM, Have you managed to raise it?19:35
EmilienMtherve: raise the bug you mean?19:35
slaglei raised it to 1M in my environment, and it seemed to work fine19:35
EmilienMor raise the size?19:35
therveThe size19:35
EmilienMslagle: good19:35
slaglei'll submit a patch19:35
slagleand add a depends-on19:35
*** isq has joined #tripleo19:35
EmilienMthanks, I think we can go for it. Worst case we have bad feedback from Mistral folks19:36
EmilienMtherve: thx for your help also19:36
*** kjw3 has joined #tripleo19:36
therveNp19:36
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Add contrail services to the resource registry defaulted to OS::Heat::None  https://review.openstack.org/36819619:39
*** fultonj has quit IRC19:39
openstackgerritJames Slagle proposed openstack/instack-undercloud: Raise zaqar max message size  https://review.openstack.org/36819719:41
*** fultonj has joined #tripleo19:41
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert overcloud.yaml to support jinja2 templating  https://review.openstack.org/31567919:42
ayoungrcrit, I wonder if other people working on tripleo have seen the database failures you had here https://paste.fedoraproject.org/424979/14734499/19:43
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert overcloud.yaml to support jinja2 templating  https://review.openstack.org/31567919:43
ayoungrcrit, alee said he saw it too, but in a different place.  I wonder if there is a problem with alembic19:44
*** rbrady has quit IRC19:44
rcritthis is a new place for me too previous was in lbaas_something or other19:45
openstackgerritJames Slagle proposed openstack/python-tripleoclient: Get template contents from plan, not local path  https://review.openstack.org/36573519:45
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert overcloud.yaml to support jinja2 templating  https://review.openstack.org/31567919:46
*** ccamacho has quit IRC19:49
ayoungrcrit, asking the quickstart folks, although I doubt this is a quickstart issue. That error comes during the undercloud deploy19:50
rcritwhere do they live?19:51
openstackgerritMerged openstack/tripleo-quickstart: Fix all ci-scripts to use $LOCATION  https://review.openstack.org/36730019:53
*** saneax is now known as saneax-_-|AFK19:54
ayoungrcrit, #oooq19:55
rcritwow19:55
trownthis channel is fine for quickstart too19:58
openstackgerritMerged openstack/puppet-tripleo: Added Contrail Composable Services  https://review.openstack.org/34890520:10
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Limit Heat engine workers to 4 in rh1  https://review.openstack.org/36065020:13
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Limit heat, neutron, and nova workers  https://review.openstack.org/36822020:13
*** jayg is now known as jayg|g0n320:18
*** mbound has joined #tripleo20:20
jristEmilienM: I'm not sure we're effected too much, but bigger is ok with us too I bet20:23
jrist2^20!20:23
jrist2^21!20:23
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert UpdateWorkflow to support composable roles  https://review.openstack.org/36728220:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Move AllNodesValidationDeployments into jinja template loop  https://review.openstack.org/33758720:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert overcloud.yaml to support jinja2 templating  https://review.openstack.org/31567920:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert allNodesConfig properties to composable jinja2  https://review.openstack.org/36579420:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Move AllNodesDeployments into jinja template loop  https://review.openstack.org/33726720:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Move role ResourceGroups inside the jinja2 loop  https://review.openstack.org/36579320:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Move per-role NetIpListMap's into jinja template loop  https://review.openstack.org/36474920:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert AllNodesExtraConfig to support composable roles  https://review.openstack.org/36729520:24
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Convert deploy steps to jinja2 loop  https://review.openstack.org/36579620:24
*** dciabrin has quit IRC20:26
*** pabelanger is now known as pall20:29
*** lblanchard has quit IRC20:32
*** lmiccini has joined #tripleo20:39
d0ugalhttps://review.openstack.org/#/c/367921/ and https://review.openstack.org/#/c/366541/ are green and ready for reviews if anyone wants to look at two critical bugs :)20:39
openstackgerritDougal Matthews proposed openstack/tripleo-common: Set Deployment Parameters  https://review.openstack.org/36562520:40
openstackgerritDougal Matthews proposed openstack/tripleo-common: Check the result of the parent action when subclassing  https://review.openstack.org/36808120:40
*** dciabrin has joined #tripleo20:40
*** jcoufal has quit IRC20:43
slagled0ugal: +A'd.20:44
*** mnaser has joined #tripleo20:44
slagled0ugal: now if you have time you can review https://review.openstack.org/#/c/365735/ and https://review.openstack.org/#/c/368197/20:44
slagle:-)20:44
mnaserhow crazy of an idea is it to migrate an existing deployment to tripleo?  (if we have the services running already)20:45
mnaseri'm thinking moving the control plane to tripleo could be as (probably not) simple as moving dbs over, restarting services, repointing compute/agents to new control plane20:45
thrashd0ugal: slagle by all means https://review.openstack.org/#/c/339048/20:46
thrash:)20:46
thrashlol20:46
thrasha bug that's been sitting there a while.20:46
slaglemnaser: if you're planning on redeploying the control plane on new hardware, it might be possible, but would not be very straightforward20:48
thrashslagle: I went ahead and +2+A on 368197 since that's holding up CI20:49
slaglethrash: yea, good idea20:49
d0ugalslagle: +2ed the first, thrash beat me to the second20:51
d0ugalthrash: LGTM20:52
d0ugalthrash: Any idea why Juan didn't +2?20:52
d0ugalOKay, I need to go now anyway, kinda late here :)20:53
* d0ugal leaves for the weekend20:53
openstackgerritMerged openstack/tripleo-specs: Update bug tag policy to match actual tag names  https://review.openstack.org/36347720:55
*** openstackstatus has quit IRC20:57
*** pall is now known as pabelanger21:00
*** openstackstatus has joined #tripleo21:00
*** ChanServ sets mode: +v openstackstatus21:00
*** akrivoka has quit IRC21:06
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Adjust MTU to compensate for VLAN tag issue  https://review.openstack.org/36823321:16
*** jeckersb_gone is now known as jeckersb21:16
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Adjust MTU to compensate for VLAN tag issue  https://review.openstack.org/36823321:16
*** mbound has quit IRC21:19
*** trown is now known as trown|outtypewww21:21
*** mburned is now known as mburned_out21:29
*** mwhahaha has quit IRC21:32
*** akshai has quit IRC21:32
*** abregman has joined #tripleo21:34
*** mwhahaha has joined #tripleo21:52
*** [1]cdearborn has quit IRC22:15
*** yamahata has quit IRC22:22
*** ipsecguy has quit IRC22:24
*** ipsecguy has joined #tripleo22:25
*** abregman has quit IRC22:28
*** ipsecguy has quit IRC22:31
*** ipsecguy has joined #tripleo22:31
*** rlandy has quit IRC22:33
*** yamahata has joined #tripleo22:37
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/36150122:54
*** jobewan has quit IRC23:11
*** Ryjedo has quit IRC23:16
openstackgerritMerged openstack/tripleo-heat-templates: add composable services for Contrail  https://review.openstack.org/34679923:19
*** limao has joined #tripleo23:20
*** limao has quit IRC23:24
*** pradk has quit IRC23:27
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add fluentd client service  https://review.openstack.org/35350623:37
*** mnaser has left #tripleo23:38
*** bana_k has quit IRC23:43

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!