Monday, 2016-07-18

*** limao has joined #tripleo00:48
*** limao_ has joined #tripleo01:05
*** limao has quit IRC01:08
*** akshai has joined #tripleo01:33
*** akshai_ has joined #tripleo01:35
*** akshai_ has quit IRC01:37
*** akshai has quit IRC01:38
*** akshai has joined #tripleo01:42
*** jrist has joined #tripleo01:52
*** coolsvap_ has joined #tripleo01:55
*** julim has quit IRC02:09
*** akshai has quit IRC02:11
*** derekjhyang has joined #tripleo02:17
*** pgadiya has joined #tripleo02:30
*** julim has joined #tripleo02:44
*** ebalduf has quit IRC03:01
*** jcoufal has quit IRC03:03
*** julim has quit IRC03:11
*** david-lyle has quit IRC03:11
*** jcoufal has joined #tripleo03:14
*** ramishra has joined #tripleo03:18
*** radek__ has joined #tripleo03:18
*** jcoufal has quit IRC03:23
*** jcoufal has joined #tripleo03:35
*** jcoufal has quit IRC03:53
*** jcoufal has joined #tripleo03:55
*** links has joined #tripleo04:11
*** jcoufal has quit IRC04:18
*** jcoufal has joined #tripleo04:34
*** radek2 has joined #tripleo04:35
*** jcoufal has quit IRC04:53
*** jcoufal has joined #tripleo04:55
*** jcoufal has quit IRC04:56
*** oshvartz has quit IRC05:00
*** dtantsur|afk has quit IRC05:03
*** pino|work has quit IRC05:03
*** pino|work_ has joined #tripleo05:03
*** jstir____ has quit IRC05:03
*** jstir____ has joined #tripleo05:03
*** dtrainor has joined #tripleo05:04
*** jaosorior has joined #tripleo05:08
*** dtantsur has joined #tripleo05:08
*** yamahata has joined #tripleo05:16
*** masco has joined #tripleo05:34
*** ramishra has quit IRC05:36
*** skramaja has joined #tripleo05:41
*** radek2 has quit IRC05:41
*** aufi has joined #tripleo05:54
openstackgerritIan Wienand proposed openstack/diskimage-builder: Move element-info a standard entry-point  https://review.openstack.org/33089305:55
*** numans has joined #tripleo05:56
*** rcernin has joined #tripleo05:57
*** pgadiya has joined #tripleo05:57
*** jprovazn has joined #tripleo06:01
*** david-lyle has joined #tripleo06:02
*** ianw has quit IRC06:03
*** rcernin has quit IRC06:04
*** anshul has joined #tripleo06:04
*** marios_ has joined #tripleo06:04
marios_o/ any1 else having vpn issues today? (rh)06:04
jaosoriornot me06:05
marios_jaosorior: yah i think i just got in now thanks06:05
*** marios_ has quit IRC06:06
openstackgerritIan Wienand proposed openstack/diskimage-builder: Move element-info a standard entry-point  https://review.openstack.org/33089306:07
jaosoriormarios: Hey dude, saw you were testing the manila patch. Don't you need a Depends-On here? https://review.openstack.org/#/c/342961/06:07
mariosjaosorior: it is the parent review (poked a bit from my phone on saturday, i think the logs had manila-* services will look in a bit thanks)06:09
*** dsariel has joined #tripleo06:09
mariosjaosorior: https://review.openstack.org/gitweb?p=openstack/tripleo-heat-templates.git;a=shortlog;h=b8d94a27334bfe9777870d981ca7a621add6726506:09
*** florianf has joined #tripleo06:09
jaosorioraaaah dude06:09
jaosoriorI messed up06:09
jaosoriorfor some reason I thought you were testing it in the tripleo-ci repo06:10
mariosjaosorior: heh np man. its monday morning :/06:10
jaosoriorhahaha indeed06:11
flaper87is it monday? already? Why does Monday keep happening ?06:11
jaosoriorcheckingI don't see any mistral lgs though :/06:12
jaosoriorI mean06:12
jaosoriormanila06:12
jaosoriorgod damn06:12
jaosoriorI need coffee06:12
jaosoriorI'll stop reviewing until I get coffee06:12
jaosoriorthis review is going terribly for me06:12
marioshaha06:12
jaosoriorflaper87: I make myself that question every week06:12
*** sshnaidm has quit IRC06:13
mariosjaosorior: e.g. http://logs.openstack.org/61/342961/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/f2084a3/logs/overcloud-controller-0/var/log/manila/06:14
flaper87jaosorior: I believe there's a bug in my calendar06:14
flaper87:P06:14
jaosoriorlol06:14
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Stop using deprecated network range  https://review.openstack.org/34344306:14
jaosoriormarios: Yep, I found it after writing that I didn't find it. That's how I got to the conclusion that my caffeine levels are low :O06:15
mariosjaosorior: maybe you and flaper87 can get a solid reproducer on the monday bug and sort it out06:15
* marios coffee06:15
*** ramishra has joined #tripleo06:16
flaper87coffee saves the monday06:16
*** sshnaidm has joined #tripleo06:17
*** rcernin has joined #tripleo06:17
mariosflaper87: yeah but is just a workaround wish we could fix the root cause06:17
jaosoriormarios: well, the manila patch seems arlight. It might have problems with SSL. But I can submit a patch for that06:18
mariosjaosorior: sound good thanks ... yeah basically just want to land basic support there. next thing is to move that extraconfig into the service06:18
mariosjaosorior: i mean, it has been in review for too long and keeps getting passed to different people to babysit. i think if we land it then the bar to contributing/fixing/adding/manila stuff is lower06:19
mariosjaosorior: so people interested there can do it06:19
mariosjaosorior: even if new here06:19
jaosoriormarios: +2ed06:20
jaosorioryeah, I don't think it needs to be the complete service configuration there. And it's even better since it's not enabled by default06:21
mariosjaosorior: right is optional service. thanks jaosorior. i think shardy was also almost ready to +206:21
mariosjaosorior: (actually he was waiting for that test review too afaik)06:22
jaosoriormarios: Hey dude, can you check this one out from EmilienM? https://review.openstack.org/#/c/341616 I think it's finally ready06:24
mariosjaosorior: ack will do haven't seen that one yet i think06:24
*** saneax_AFK is now known as saneax06:27
saneaxGM folks06:28
*** oshvartz has joined #tripleo06:28
*** pcaruana has joined #tripleo06:29
jaosoriorGM06:30
*** david-lyle has quit IRC06:32
*** bootsha has joined #tripleo06:32
*** coolsvap_ has joined #tripleo06:33
*** jprovazn has quit IRC06:34
*** ianw has joined #tripleo06:34
*** ramishra_ has joined #tripleo06:36
*** yolanda has joined #tripleo06:36
*** jtomasek has joined #tripleo06:37
*** ramishra has quit IRC06:39
*** ramishra_ has quit IRC06:41
*** ramishra has joined #tripleo06:42
*** coolsvap_ has quit IRC06:42
*** tesseract- has joined #tripleo06:45
*** dtantsur has quit IRC06:47
*** jstir____ has quit IRC06:48
*** rcernin has quit IRC06:48
*** jstir____ has joined #tripleo06:48
*** pino|work has joined #tripleo06:48
*** pcaruana has quit IRC06:48
*** pino|work_ has quit IRC06:48
*** mcornea has joined #tripleo06:53
*** tremble has joined #tripleo06:53
*** bandini has joined #tripleo06:54
*** dtantsur has joined #tripleo06:54
*** myoung has quit IRC06:55
*** pblaho has joined #tripleo06:56
*** devvesa has joined #tripleo06:57
*** anshul has quit IRC06:58
*** leanderthal|afk is now known as leanderthal06:58
*** anshul has joined #tripleo06:59
*** pcaruana has joined #tripleo07:02
*** rcernin has joined #tripleo07:03
*** ifarkas has joined #tripleo07:03
*** ohamada has joined #tripleo07:06
*** liverpooler has joined #tripleo07:07
*** ohamada has quit IRC07:08
*** ohamada has joined #tripleo07:10
*** jprovazn has joined #tripleo07:11
*** shivrao_ has joined #tripleo07:12
*** ccamacho has joined #tripleo07:13
*** ebarrera has joined #tripleo07:14
*** paramite has joined #tripleo07:15
*** shivrao has quit IRC07:15
*** shivrao_ is now known as shivrao07:15
*** anshul has quit IRC07:19
*** anshul has joined #tripleo07:19
*** zoli_gone-proxy is now known as zoliXXL07:21
zoliXXLgood morning07:23
*** akuznetsov has joined #tripleo07:30
*** dtrainor has quit IRC07:31
ccamachomorning!07:39
*** fzdarsky has joined #tripleo07:41
*** maxbab has joined #tripleo07:46
*** jpich has joined #tripleo07:51
*** hjensas has joined #tripleo07:57
*** ohamada has quit IRC07:58
*** bootsha has quit IRC07:59
*** akuznetsov has quit IRC08:00
*** bootsha has joined #tripleo08:05
*** dmsimard has quit IRC08:05
*** dbecker has joined #tripleo08:06
*** dbecker has quit IRC08:07
*** shivrao has quit IRC08:07
*** dbecker has joined #tripleo08:08
ccamachojaosorior, around? quick question, Im tryint to have a consistent state for the composable Mistral submission, but sometimes works fine and other times gives errors in the sync_db step.. This only happens in the ha (3+1) deployment. Do you know something I can check in the submission?08:12
*** tosc_fiberdata has joined #tripleo08:13
ccamachoI think might be related to the way the 3 controllers are deployed maybe is because the deployment is not synchronized, or just a nit....08:13
*** jtomasek has quit IRC08:13
*** jtomasek has joined #tripleo08:13
*** ohamada has joined #tripleo08:14
*** tosc_fiberdata has quit IRC08:22
*** ohamada has quit IRC08:23
*** ohamada has joined #tripleo08:24
*** shardy has joined #tripleo08:25
*** leanderthal is now known as leanderthal|afk08:25
bandiniccamacho: I worked quite a bit with sync_db issues here https://review.openstack.org/338387 , what are you hitting?08:28
*** athomas has joined #tripleo08:30
*** gfidente has joined #tripleo08:32
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add an optional extra parameter for upgrades  https://review.openstack.org/34033608:37
*** hewbrocca-afk is now known as hewbrocca08:37
ccamachohey bandini! morning, was getting the logs, for example this one appeared yesterday http://paste.openstack.org/show/536076/08:38
ccamachobut if I relaunch the deployment might work.08:39
ccamachobandini, I will try to align the mistral submission with https://review.openstack.org/33838708:42
*** Goneri has joined #tripleo08:44
bandiniccamacho: can you point me to the mistral submission?08:45
ccamachobandini sure thing, https://review.openstack.org/#/c/323436/08:45
bandinithanks ;)08:45
ccamachobandini, also errors from yesterday's logs http://paste.openstack.org/show/536079/08:48
bandiniccamacho: ok so the issue is that when you include include ::tripleo::profile::base::mistral::engine, sync_db is default to true no? which means that it will be true on *all* nodes so it is racy. sync_db needs to be true only on the bootstrap node08:49
bandiniunless I am seeing things, in which case I will swiftly blame it on lack of coffee ;)08:49
*** tosky has joined #tripleo08:49
jaosoriorccamacho: No idea dude :/08:51
*** akuznetsov has joined #tripleo08:52
jaosoriormarios: AFAIK we do have some coverage, but it runs in experimental in tripleo-ci08:52
jaosoriorfor SSL08:52
ccamachobandini seems you are right with that race condition. let me check it :) and Ill align the submission with the one you posted before :)08:53
ccamachobandini thanks for the hint08:53
mariosjaosorior: ack thx, (hence the check experimental there)08:53
*** dmsimard has joined #tripleo08:54
jaosoriormarios: the experimental check that is running on all the patches is not working yet. slagle was working on it08:54
jaosoriorso at the moment the only way to test SSL is to do a depends-on patch on tripleo-ci and do a check experimental there, like this https://review.openstack.org/#/c/342669/08:55
bandiniccamacho: any time ;)08:55
bandinimarios: looking at your failure today, sorry am a bit behind on things08:55
*** jaosorior has quit IRC08:56
*** ccamacho is now known as ccamacho|afk08:56
mariosbandini: hey man o/ i wanted to catch up with you too at some point - i saw some reviews fly by on friday ... found it is this related? https://review.openstack.org/#/c/342725/08:56
*** jaosorior has joined #tripleo08:57
bandinimarios: my plan was to verify from your sosreport if that one was related indeed ;) it could be only if on your setup for some reason galera decided to do a promote action (i.e. shuffle things around)08:58
bandiniin that case it would match your symptoms08:59
mariosbandini: ack lets talk later in the afternoon, or even at scrum?09:01
bandinimarios: ack. I should have gone through all the sosreports by then09:01
*** osp has joined #tripleo09:01
*** tosc_fiberdata has joined #tripleo09:02
mariosbandini: cool thanks man, sorry about that :(09:02
tosc_fiberdataYo, my neutron-server on my tripleO-server is not starting up after reboot, it fails. though it seems to be starting if i do it manually? anyone could give me some quick tip to look into that might give me a hint?09:03
*** Goneri has quit IRC09:07
jaosoriortosc_fiberdata: No idea dude... I'm actually having different issues with neutron at the moment09:07
tosc_fiberdatajaosorior, alright...09:08
tosc_fiberdatait's okey, atleast it's working after manually restarting09:08
*** Goneri has joined #tripleo09:21
hewbroccashardy: good morning! I have a question about predictable control plane IPs09:22
shardyhewbrocca: Hi!  sure09:23
hewbroccaWhich is: I'm curious why we can't just set them with an IP-mac address mapping in the DHCP server09:23
hewbroccaI'm sure I'm just displaying my ignorance here but it seems like it ought to be easy09:24
shardyhewbrocca: possibly we can, but I've not yet looked at how we might hack the ironic dnsmasq config to do that09:24
shardydtantsur: ^^ is that possible?09:24
shardythere's also some complexity around neutron port assigments there I think09:24
hewbroccahmm right... this is one of these areas where the abstraction is getting in our way09:24
*** akrivoka has joined #tripleo09:26
openstackgerritWeiwei Gu proposed openstack-infra/tripleo-ci: Remove white space between print and ()  https://review.openstack.org/34148209:29
*** bootsha has quit IRC09:31
*** karthiks has quit IRC09:31
*** karthiks has joined #tripleo09:32
*** abehl has joined #tripleo09:36
*** athomas has quit IRC09:37
*** anshul has quit IRC09:38
jaosoriorgfidente: Can you give this CR a quick read? https://review.openstack.org/#/c/341616/ I think we have the same issue you -1ed for in the mistral submission here https://review.openstack.org/#/c/341616/9/puppet/services/nova-base.yaml09:38
*** athomas has joined #tripleo09:42
hewbroccadtantsur: thoughts on this control-plane-IP thing ^^^09:48
hewbroccaor lucasagomes09:49
* dtantsur reads the scrollback09:49
dtantsurshardy, ironic does not have dnsmasq config, it defers to neutron for any actual dhcp management09:50
dtantsurshardy, so as soon as you create a port instead of letting nova do it - you're fine09:50
dtantsurthen you set up everything you want on this port09:51
* dtantsur is in the process of trying to understand neutron, started reading a book over the weekend :)09:51
hewbroccaThe Neutron Book of Lies?09:51
hewbrocca:D09:51
dtantsurLOL09:52
hewbroccadtantsur: so if we had a way to assign IP addresses to ports for the undercloud we would be good09:52
dtantsurwhat's the context of requiring it?09:52
hewbroccaEh, users09:53
hewbroccathey keep asking09:53
hewbroccapredictable IPs on the control plane, etc.09:53
dtantsuryeah, one more non-cloudy thing in our fancy cloud ^_^09:53
hewbroccaSigh09:54
dtantsurI think pre-creating neutron ports is the way to go09:54
dtantsurHeat should be able to manage that09:54
openstackgerritMartin Mágr proposed openstack/puppet-tripleo: New composable service: Sensu  https://review.openstack.org/32330310:05
openstackgerritMartin Mágr proposed openstack/puppet-tripleo: New composable service: FluentD  https://review.openstack.org/34354610:05
openstackgerritMartin Mágr proposed openstack/puppet-tripleo: New composable service: FluentD  https://review.openstack.org/34354610:08
openstackgerritMartin Mágr proposed openstack/puppet-tripleo: New composable service: Sensu  https://review.openstack.org/32330310:08
shardydtantsur: Thanks for clarifying, yeah we can do that via the templates I think10:15
shardyIIRC gfidente had a WIP patch aiming to do that, will see if I can find it later10:16
bandinimmh is the CI job gate-tripleo-ci-centos-7-ovb-ha broken for everyone else too?10:16
*** limao_ has quit IRC10:20
shardybandini: http://tripleo.org/cistatus.html shows some jobs passing but there are quite a few failures10:21
shardyon friday I was seeing a lot of failures related to gnocchi DB sync errors10:21
shardyA lot of the errors seem to be timeouts tho10:22
bandinishardy: thanks. Was wondering if doing rechecks made sense or not ;) I think I will hold off for a bit first10:22
bandiniyeah I noticed some timeouts on rdo stuff in some jobs10:22
*** bootsha has joined #tripleo10:30
*** jubapa has quit IRC10:32
*** jubapa has joined #tripleo10:33
*** ccamacho|afk is now known as ccamacho10:33
tosc_fiberdatathese youtubevideo are very appreciated! https://www.youtube.com/watch?v=gX5AKSqRCiU10:36
ccamachotosc_fiberdata nice!10:37
tosc_fiberdatai very much appreciate it as we are in the progress to deploy a new openstack-environment and have used the foreman installer earlier on!10:38
tosc_fiberdatai think that it explains alot of the questions people have and cannot find on how to be able setup an environment based on the exclusive environment10:39
*** mgould|afk is now known as mgould10:39
*** yamahata has quit IRC10:39
sshnaidmbandini, there is an issue about rdo timeout: https://bugs.launchpad.net/tripleo/+bug/160380510:40
openstackLaunchpad bug 1603805 in tripleo "Ci: git clone sometimes fails from http://review.rdoproject.org" [High,Triaged]10:40
sshnaidmbandini, I think you can recheck, the jobs fail, but for various reasons, I don't see a common pattern right now10:40
sshnaidmbandini, can you send me a link to patch with failed job?10:41
*** paramite is now known as paramite|afk10:41
shardytosc_fiberdata: Good to hear they are helpful10:41
shardytosc_fiberdata: Note that you can request topics for future coverage here https://etherpad.openstack.org/p/tripleo-deep-dive-topics10:42
tosc_fiberdataah great!10:42
tosc_fiberdatawill check it out10:42
shardyand also attend the calls live if you'd like to join us and ask questions10:42
tosc_fiberdatai guess the problem is the timezone there :P depending on who hosts it? :p10:42
tosc_fiberdatabut i'll check it out for sure10:43
shardytosc_fiberdata: Yeah it's tricky to find a tz that works for everyone, but the current time has good overlap for europe and the US10:43
tosc_fiberdataaye10:43
shardytosc_fiberdata: you may also find https://www.youtube.com/watch?v=-khoXlRAE1w useful, it's a more overview level talk I gave in devconf recently10:44
bandinisshnaidm: thanks. One was indeed about rdo timeout. the other one was this one http://logs.openstack.org/25/342725/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/22cdc4d/console.html.gz10:44
tosc_fiberdatashardy, ah great! will check it out10:44
sshnaidmbandini, yeah, it's fail in delorean run, I saw it a few times already, need to check it..10:47
tosc_fiberdatai will attend to openstack nordic this autumn, is there anyone else that will do that aswell?10:48
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Add pacemaker mistral profile  https://review.openstack.org/34334610:49
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Mistral services  https://review.openstack.org/32343610:49
bandinisshnaidm: thanks a lot !10:50
*** rodrigods has quit IRC10:53
*** rodrigods has joined #tripleo10:53
*** pkovar has joined #tripleo11:01
*** onovy has quit IRC11:04
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from CentOS Storage SIG repos  https://review.openstack.org/34050411:04
shardyjokke_: ^^ FYI I tested that locally and it is pulling in the correct ceph versions I think?11:04
shardyjokke_: you need to ensure the repo is configured on the undercloud before running tripleo.sh --overcloud-images11:04
shardye.g I did tripleo.sh --repo-setup11:05
shardythen ran yum install ceph to see what repo it tried to use (exiting before actually installing anything)11:05
shardythat used the right repo, and so did the image build AFAICS11:05
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Resize undercloud image(call virt-resize)-fails  https://review.openstack.org/33687511:06
*** onovy has joined #tripleo11:10
*** paramite|afk is now known as paramite11:10
*** julim has joined #tripleo11:15
openstackgerritMerged openstack/tripleo-quickstart: Add an optional extra parameter for upgrades  https://review.openstack.org/34033611:19
gfidenteshardy, ack thanks for updating that11:19
*** jprovazn has quit IRC11:19
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart: Stop using deprecated network range  https://review.openstack.org/34344311:19
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Add pacemaker mistral profile  https://review.openstack.org/34334611:25
*** tosc_fiberdata has quit IRC11:25
*** zoliXXL is now known as zoli11:26
*** zoli is now known as zoliXXL11:26
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Add pacemaker mistral profile  https://review.openstack.org/34334611:27
*** ccamacho is now known as ccamacho|lunch11:29
jaosoriorgfidente: ping11:30
*** jcoufal has joined #tripleo11:32
*** jcoufal has quit IRC11:32
*** shardy is now known as shardy_lunch11:32
*** numans has quit IRC11:33
openstackgerritKarthik S proposed openstack/tripleo-specs: tripleo-ovs-dpdk  https://review.openstack.org/31387111:36
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Stop validation  https://review.openstack.org/33656111:36
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Triggering validations and messaging  https://review.openstack.org/33656011:36
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Webpack  https://review.openstack.org/34359211:37
*** sshnaidm is now known as sshnaidm|afk11:48
*** jprovazn has joined #tripleo11:52
*** egafford has quit IRC11:57
*** jayg|g0n3 is now known as jayg11:58
gfidentejaosorior, pong12:01
*** lucasagomes is now known as lucas-hungry12:02
jaosoriorgfidente: Hey dude, by the way, I hadn't heard of the MysqlNoBracketsInternal endpoint12:02
jaosoriorwhere is that endpoint set?12:03
jaosoriorSeems it was added rather recently12:03
jaosorioron the other hand, it will fail anyway, since it's not being used neither by CI, nor in the enable-tls.yaml. But I'll submit a fix for that12:03
gfidenteyeah it's the usual [no]brackets story for ipv6 addresses12:03
hewbroccagfidente: !12:03
hewbroccayou're back!12:03
gfidentehewbrocca, thanks :)12:03
jaosoriorgfidente: Yeah, but I actually don't see it being set any differently than the MysqlInternal endpoint12:04
jaosoriorseems to be exactly the same12:04
gfidentejaosorior it's fed via net_ip_map instead of net_ip_uri_map so it never gets the brackets12:06
jaosoriorI see12:06
jaosoriorI missed that12:06
jaosorioralright cool12:06
jaosoriornow I get it12:06
jaosoriorthanks dude12:07
jaosoriorlet me fix then what's missing from it12:07
gfidenteit's that endpoint initially always had brackets because endpoints need it indeed12:07
gfidentebut then we started using for other stuff too12:07
gfidenteI was tempted to put some logic in build_endpoint to filter out the brackets on a different output12:08
gfidentenot sure :(12:08
jaosoriorlets not do that12:09
jaosoriorbut I think that will have issues with what shardy's trying to do here12:09
*** skramaja has quit IRC12:09
gfidentewhere?12:09
jaosoriorhttps://review.openstack.org/#/c/342900/12:09
gfidenteI might have missed bits from last week12:09
jaosoriorwell, he hasn't finished that yet12:10
jaosoriorbut basically it hardcodes the endpoint map to always use the net_ip_uri_map12:10
jaosoriorwhich would be bad for the mysqlnobrackets endpoint12:11
dtantsurmeh, so that's why I was against "temporary" disabling introspection in gate: it was easy to push it out, and now so hard to get back in >_<12:11
*** karthiks has quit IRC12:11
hewbroccaHey folks, we really need to land https://review.openstack.org/#/c/342147/12:11
hewbroccapassed CI, +2 from Emilien, and it is blocking RDO CI12:11
jaosoriorhewbrocca: dione12:12
jaosorior*done12:12
hewbroccaand yes then we need to re-enable introspection12:12
hewbroccajaosorior: #winning thank you12:12
gfidentejaosorior, right so I am not sure how to get both the version with and without brackets from there12:12
gfidentewell12:12
gfidentewe could pass net_ip and net_ip_uri to build and always emit a NoBrackets output12:13
hewbroccapff now it "needs verified," what does that mean?12:13
gfidentefrom net_ip12:13
gfidentehewbrocca, it's waiting for jenkins to +1 lint/syntax jobs12:13
hewbroccagfidente: oh, I got it12:14
gfidentewhich is triggered by w+112:14
hewbroccathen does it merge, or does it still need a +A?12:14
gfidenteit should only take minutes12:14
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add MysqlNoBracketsInternal to enable-tls.yaml  https://review.openstack.org/34360712:14
gfidenteif jenkins is happy it merges12:14
hewbroccaexcellent12:14
dtantsurI hope this patch actually works, CI does not cover introspection right now...12:15
jaosoriorgfidente: https://review.openstack.org/343607 this is needed for the MysqlNoBracketsInternal endpoint12:15
hewbroccaWell, only one way to find out I guess then12:15
*** ifarkas_ has joined #tripleo12:15
dtantsurtrue :)12:15
*** dprince has joined #tripleo12:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add MysqlNoBracketsInternal to enable-tls.yaml  https://review.openstack.org/34360712:17
openstackgerritMerged openstack/instack-undercloud: Always configure inspector to use the same HTTP port as Ironic  https://review.openstack.org/34214712:17
*** weshay has joined #tripleo12:17
hewbroccawho can tell me which centos image is used in the TripleO CI gate12:17
jaosoriorhewbrocca: Merged ^^12:17
jaosoriorgfidente: Fixed ^^12:17
hewbroccajaosorior: thank you sir12:17
dtantsurfolks, do we have a human-readable description of what happens in what deployment step?12:20
dtantsuraka how the hell is step 3 different from step 4? :)12:20
dtantsur(and optionally where steps 1, 2 and later are)12:20
*** sshnaidm|afk is now known as sshnaidm12:21
dtantsurI'm trying to figure out how to make ironic dbsync to work only on one controller...12:21
hewbroccaApparently you're not the only one having these kinds of problems12:22
hewbroccagfidente: ^^^12:22
dtantsurI got some valuable comments on https://review.openstack.org/#/c/319297/6/manifests/profile/base/ironic.pp but now I12:22
dtantsurI'd like to make sure I have some idea why I do that12:22
jaosoriordprince: Hey dude, can you check this one out? https://review.openstack.org/#/c/342945/ Mistral needed the bind_host to work with SSL and now it's there.12:23
*** milan has joined #tripleo12:23
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add MysqlNoBracketsInternal to enable-tls  https://review.openstack.org/34361112:23
jaosoriorgfidente: this commit in tripleo-ci was also needed ^^12:23
gfidentedtantsur, so it isn't trivial because in the puppet modules usually you have a class which creates the database and another which runs the db sync12:23
*** skramaja has joined #tripleo12:23
*** karthiks has joined #tripleo12:24
dprincejaosorior: nice catch. +212:24
*** bootsha has quit IRC12:25
jaosoriordprince: Thanks dude. Did you figure out what's up with zaqar's websocket endpoint? If we'll proxy it via HAProxy for SSL?12:25
dtantsurgfidente, hmm, yeah, right12:26
*** pradk has joined #tripleo12:26
dprincejaosorior: I'd say lets just try it out12:26
dprincejaosorior: I didn't find any specifics yet though...12:26
gfidentedtantsur, some sort of written description is here https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/README.rst12:26
dprincejaosorior: if you can work on it great. If not I can try12:27
jaosoriordprince: Well, I have to do SSL everywhere anyway12:27
gfidentedtantsur, but basically the other services run ::mysql and ::sync in step 3 if the node is bootstrap_nodeid12:27
jaosoriorso I'll check it out12:27
dtantsurgfidente, thanks! I'll try to figure out...12:28
gfidentedtantsur, looking at https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/ironic.pp I think it's perfectly fine12:29
dtantsurgfidente, yeah, so now I guess I need to write a proper /profile/pacemaker/ironic stuff, right?12:29
jaosoriordtantsur: ironic was added already to the endpoint's in t-h-t, right?12:30
gfidenteonly for the service which needs to be managed by ironic, if any12:30
dtantsurjaosorior, correct12:30
gfidente*by pacemaker12:30
dtantsuryeah, meaning ironic-api12:30
*** rhallisey has joined #tripleo12:30
gfidenteoh api needs pacemaker?12:30
dtantsurooops, maybe not12:30
dtantsurcinder-api seems to use it though: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/pacemaker/cinder/api.pp12:31
dtantsurditto heat-api: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/pacemaker/heat/api.pp12:31
gfidenteright that's because we migrated services which *were* managed by pcmk12:31
*** derekjhyang has quit IRC12:32
gfidentebut we don't need to write pcmk support for services which don't need migration12:32
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add Ironic endpoints to the enable-tls environment file  https://review.openstack.org/34361412:32
dtantsurmmmm, right12:32
jaosoriordtantsur ^^ that was needed for CI (hopefully we can get to test TLS in CI constantly again at some point)12:32
dtantsurso we're probably completely fine than12:32
*** rlandy has joined #tripleo12:33
gfidentedtantsur, indeed I think it's fine12:33
dtantsurjaosorior, thanks12:33
gfidentenot sure if we want/can enable deployment of ironic in the ci jobs12:33
*** jcoufal has joined #tripleo12:33
dtantsurwelll... eventually?12:33
jaosoriorgfidente: can you +2 this? https://review.openstack.org/#/c/343611 it's the same as the one before, but in the tripleo-ci... unfortunately we have to maintain two files12:33
gfidentebut you can test this with a WIP where you add the ironic roles12:33
dtantsurin some specific jobs, I guess12:34
dtantsurgfidente, I do have such WIP: https://review.openstack.org/#/c/329872/12:34
dtantsurnow I'm trying to figure out why it fails >_<12:34
EmilienMhello12:34
*** akuznetsov has quit IRC12:34
dtantsurhi EmilienM12:34
jaosoriorEmilienM: sup dude12:34
gfidentedtantsur, I think it fails because we were setting sync_db always to true12:35
gfidentehttps://review.openstack.org/#/c/338387/12/manifests/profile/base/ironic.pp12:35
dtantsurwow, I haven't seen this patch12:35
dtantsurit's exactly what I was trying to implement right now, I'm so glad somebody did it for me :D12:36
gfidentedtantsur, right we used to do that in the pcmk manifests but it has to happen in non-pcmk manifests as well12:36
dtantsurcorrect, ironic does not need pacemaker at all12:36
gfidenteyeah which closes the loop12:36
*** mbound has joined #tripleo12:37
*** bootsha has joined #tripleo12:37
dtantsurI wonder if 2 Depends-On on the same repo will work >_<12:38
EmilienMno12:38
EmilienMyou need to rebase12:38
dtantsuroh damn..12:38
dtantsuror we can assume I didn't screw up these 5 lines of actual code: https://review.openstack.org/#/c/341420/ :)12:39
EmilienMdepends-on works only inter-projects; for same projects, just use rebase12:39
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Enable introspection in nonha jobs  https://review.openstack.org/34361712:39
dtantsurhmm, no, I have a patch to THT which requires 2 independent patches in puppet-tripleo12:39
*** jpeeler has quit IRC12:39
EmilienMright so rebase the puppet-tripleo together12:40
*** shardy_lunch is now known as shardy12:40
EmilienMand use depends-on on the top patch12:40
EmilienMit will checkout the 2 p-t patches in your THT Ci run12:40
EmilienMshardy: can we get https://review.openstack.org/#/c/340448/ please?12:40
EmilienMor gfidente ^12:40
dtantsurwell, these patches are not inter-dependent, that's the problem12:40
EmilienMdtantsur: ok... show me the patches;12:41
dtantsurso I'll make my patch artificially depend on another patch12:41
dtantsurEmilienM, https://review.openstack.org/#/c/341420/ and https://review.openstack.org/#/c/338387/12:41
jaosoriorgfidente: for this https://review.openstack.org/#/c/341616/9/puppet/services/nova-base.yaml12:42
jaosoriordo all of the instances of MysqlVirtual have to be MysqlNoBracketsInternal?12:42
EmilienMdtantsur: and the tht patch?12:42
dtantsurEmilienM, https://review.openstack.org/#/c/341433/ and https://review.openstack.org/#/c/329872/12:44
* dtantsur would love puppet-tripleo and THT to be one repo...12:44
* dtantsur vaguely remembers it was the case some time ago12:44
gfidentejaosorior, yeah I don't think there is any MysqlVirtual object at all12:45
EmilienMdtantsur: and what do you want to test exactly?12:45
gfidenteit's MysqlInternal or MysqlNoBracketsInternal12:45
jaosoriorthere isn't12:45
jaosoriorI'm changing those12:45
dtantsurEmilienM, largely that the whole thing works :) I suspect that the second puppet-tripleo patch might fix the ha gate for me12:45
jaosoriorbut I just wanted to know if I need to use MysqlInternal anywhere12:45
jaosorioror do I change all of those to MysqlNoBracketsInternal12:46
dtantsurpreviously I used the nonha job to verify, but it seems to be demoted to experimental..12:46
jaosoriorgfidente ^^12:46
gfidenteso I think that was pointing to hiera('mysql_bind_host') before12:46
EmilienMdtantsur: the best way to test everything is to rebase the patches on the same projects and use depends on when inter project testing12:46
*** myoung has joined #tripleo12:46
jaosoriorgfidente: It was, and then we started having issues with hiera, since heat removes the outer quotes, and it started crashing12:47
openstackgerritDan Prince proposed openstack/os-collect-config: Add support for Zaqar websockets  https://review.openstack.org/34248612:47
*** trown|outtypewww is now known as trown12:47
* dtantsur sigh12:48
sshnaidmbandini, FYI, all tht patches were failing in CI because of dlrn and rdo issues, now it should be OK, running recheck12:49
shardyEmilienM: Hey, done12:49
EmilienMshardy: thx12:50
bandinisshnaidm: brilliant, thanks12:51
jaosoriorgfidente: It seems that from the beginning it was using brackets12:51
*** jdob has joined #tripleo12:52
gfidentejaosorior, the opposite I think it's using net_ip_map12:52
*** bootsha has quit IRC12:52
gfidentejaosorior, check mysql_network12:52
gfidentein controller.yaml12:52
hewbroccaEvery time we have another debate about how to parse IPV612:52
jaosoriorI see12:52
hewbroccathe planet warms another tenth of a degree12:52
jaosoriordamn that parameter is confusing12:52
sshnaidmdtantsur, I don't see a nonha job running there..12:53
openstackgerritMerged openstack/tripleo-heat-templates: Move MySQL Galera within composable services  https://review.openstack.org/34044812:53
*** bootsha has joined #tripleo12:53
jaosoriorgfidente: And it seems that the other ones (allowed_hosts) were using this "%{hiera('mysql_bind_host')}"12:54
jaosoriorwhich also comes from net_ip_map12:54
jaosoriorso it was the same data coming from a different name12:55
gfidenteno it's not same data12:55
jaosoriorit isn't?12:55
jaosoriormysql_network: {get_attr: [NetIpMap, net_ip_map, {get_param: [ServiceNetMap, MysqlNetwork]}]}12:55
gfidentebut the other comes from VipMap12:56
gfidenteone points to the local ip address, without brackets12:56
gfidentethe other points to the internal vip for mysql, without brackets12:56
gfidenteand finally, database_connection points to the internal vip for mysql, with brackets12:56
jaosoriorI see12:56
gfidentebtw I think the allowed hosts is probably unneded complication given we have % above that?12:57
gfidenteor we should build it based on the list of the overcloud nodes instead12:57
jaosoriorgfidente: That's what I was wondering the other day, but for the purposes of this patch I didn't touch it12:58
jaosoriorseems like it's a no-op, as the % allows everything anyway12:58
gfidenteexactly12:58
jaosoriorI'm gonna leave it like that for now and we'll fix it later12:58
gfidenteso if it's complicating things maybe we can open a bug to restrict access but remove the uneffective stuff anyway12:58
jaosoriorwell12:59
jaosoriorthat's actually a good idea12:59
*** radek2 has joined #tripleo13:00
*** akuznetsov has joined #tripleo13:01
dtantsursshnaidm, there used to be some time ago13:03
sshnaidmdtantsur, Introspection completed. \o/13:04
dtantsur\o/13:04
hewbroccawoop woop!13:04
hewbroccathat means we have a non-ha job again?13:04
*** rook-rocketship is now known as rookl13:05
*** ccamacho|lunch is now known as ccamacho13:05
*** rookl is now known as rook-rocketship13:05
sshnaidmhewbrocca, again with introspection :)13:06
*** anshul_ has joined #tripleo13:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable keystone to use the SSL middleware  https://review.openstack.org/34135413:07
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Enable glance to use the SSL middleware  https://review.openstack.org/34136713:07
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Migrate Puppet Hieradata to composable services  https://review.openstack.org/34161613:07
jaosoriorgfidente: better ^13:07
jaosorior?13:07
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Mistral services  https://review.openstack.org/32343613:07
openstackgerritDmitry Tantsur proposed openstack/puppet-tripleo: Add base nova-ironic profile  https://review.openstack.org/34142013:07
dtantsurrebased ^^^13:07
*** abehl has quit IRC13:08
*** lucas-hungry is now known as lucasagomes13:09
gfidentejaosorior, ack +2 thanks!13:09
gfidentejaosorior++ ;)13:09
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Add pacemaker mistral profile  https://review.openstack.org/34334613:12
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates: DO NOT MERGE: testing ironic  https://review.openstack.org/32987213:13
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates: Add composable service for configuring Nova compute with Ironic  https://review.openstack.org/34143313:13
*** bootsha has quit IRC13:13
*** oshvartz has quit IRC13:13
*** dmsimard has quit IRC13:16
*** dmsimard has joined #tripleo13:18
jtomasekmandre: with this version, I still see the workflow execution success even if validation failed https://review.openstack.org/#/c/313632/28/workbooks/validations.yaml13:19
*** julim has quit IRC13:19
jtomasekmandre: set_status_failed task has been run though13:19
*** skramaja has quit IRC13:20
jtomasekmandre: so the execution output has status: FAILED but the state of the execution is SUCCESS13:21
jtomasekmandre: is that expected?13:21
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: overcloud_compute.pp: remove nova_config params  https://review.openstack.org/34363613:21
*** egafford has joined #tripleo13:21
*** tosky has quit IRC13:21
*** noslzzp has quit IRC13:22
mandrejtomasek: clearly not expected13:23
*** akshai has joined #tripleo13:23
*** noslzzp has joined #tripleo13:23
mandrejtomasek: I can test in ~45 min (I had to destroy my environment)13:23
jtomasekmandre: sure, no rush, just let me know13:24
*** anshul_ has quit IRC13:25
*** lblanchard has joined #tripleo13:31
*** skramaja has joined #tripleo13:32
mariosbandini: promising results running the keystone migration with https://review.openstack.org/#/c/342725/ as well as https://review.openstack.org/#/c/338879/ fyi... am really hoping it isn't a fluke but it went update complete and no services down13:32
jokke_shardy: thanks ... just building OC images and will run OC deploy as soon as this finishes. I might have had just a brainfart, cloning the master, _not_ cherrypicking the change in UC before building the images :)13:35
*** links has quit IRC13:35
shardyjokke_: ack, well hopefully that will allow you to proceed testing the puppet stuff13:35
*** jeckersb_gone is now known as jeckersb13:36
jokke_shardy: it definitely should13:36
*** pgadiya has quit IRC13:37
*** anshul_ has joined #tripleo13:38
*** saneax is now known as saneax_AFK13:39
jtomasekmandre: added more info in the review13:39
bandinimarios: cool. still going through the logs13:40
bandiniseems one httpd on controller-013:40
*** jrist_ has joined #tripleo13:41
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add third party gating to quickstart  https://review.openstack.org/33222313:42
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add third party gating to quickstart  https://review.openstack.org/33222313:42
*** egafford has quit IRC13:42
*** oshvartz has joined #tripleo13:42
*** julim has joined #tripleo13:43
*** egafford has joined #tripleo13:43
*** ayoung has joined #tripleo13:45
*** jrist_ has quit IRC13:45
*** saneax_AFK is now known as saneax13:46
*** ifarkas_ has quit IRC13:54
*** limao has joined #tripleo13:55
*** fzdarsky is now known as fzdarsky|afk13:56
*** limao_ has joined #tripleo13:56
*** ifarkas_ has joined #tripleo13:56
*** limao has quit IRC13:59
openstackgerritMerged openstack/instack-undercloud: Enable SSL for Mistral  https://review.openstack.org/34294514:00
jaosorioryay14:00
*** dsariel has quit IRC14:01
ccamachohey bandini, after the changes in the sync_db call, seems to be stable, I have launched the OC like 8 times... And 0 errors until now.. :)14:02
ccamachoWaiting for CI :)14:02
jaosoriorccamacho: Which change?14:03
bandiniccamacho: woohoo14:03
jaosoriordprince: By the way, will we have zaqar in the overcloud?14:03
*** ifarkas_ has quit IRC14:04
EmilienMjaosorior: it's WIP afik14:05
EmilienMjaosorior: https://review.openstack.org/#/c/331682/14:05
jaosoriorEmilienM, dprince: I see that has support for the zaqar API endpoint. Will the websocket endpoint be supported as well? It will be in a different port, right?14:06
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Stop validation  https://review.openstack.org/33656114:07
*** ifarkas_ has joined #tripleo14:07
*** fultonj has joined #tripleo14:09
yolandatrown, or any other users, have you ever tried tripleo-quickstart with osp8?14:10
ccamachojaosorior https://review.openstack.org/#/c/323436/14:10
yolandai'm facing a problem with nova computes not having memory configured14:10
dprincejaosorior: yes, we will have it in the overcloud14:11
trownyolanda: what do you mean about memory configured?14:11
dprincejaosorior: I'm going to push patches to use the 'messaging-websocket' endpoint today14:11
jaosoriordprince: And it's a different port, right?14:12
yolandatrown, on the process of undercloud deploy, the compute node created has 0mb as memory14:12
dprincejaosorior: I had hoped to have this in place sooner https://review.openstack.org/#/c/342404/ but getting the websocket code into python-zaqarclient was a bit trickier :/14:12
dprincejaosorior: yes, port 9000 is the stock port14:12
dprincejaosorior: ws://<ipaddress>:9000 specifically14:12
*** karthiks has quit IRC14:13
jaosoriordprince: excellent. just figuring out how to place it in HAProxy14:13
trownyolanda: hmm... that is pretty odd, not sure I see how that would be different in quickstart... maybe some weird RHEL only issue?14:13
yolandatrown, ironic introspection seems to be good , detecting memory and cpu. But then on nova database, the cpu is blank, and the memory is set to 014:13
yolandai'm using osp8 packages + tripleo-quickstart pointing to liberty14:14
*** saneax is now known as saneax_AFK14:15
*** mcornea has quit IRC14:15
trownyolanda: hmm, how exactly are you doing that? I am kind of confused14:15
*** liverpooler has quit IRC14:15
jokke_shardy: happy days, got the correct bits into the cephstorage node now (deployment blows 'though, but that's different issue)14:16
*** limao has joined #tripleo14:17
gfidentejokke_, so you see the correct version installed in the overcloud node?14:18
jokke_yes!14:18
*** akuznetsov has quit IRC14:19
jokke_[heat-admin@overcloud-cephstorage-0 ~]$ ceph -v14:19
jokke_ceph version 10.2.2 (45107e21c568dd033c2f0a3107dec8f0b0e58374)14:19
jokke_as before that was IIRC 0.80.714:19
*** limao_ has quit IRC14:19
EmilienMpradk: i'm rebasing aodh14:19
pradkEmilienM, sure14:19
jokke_output of the blowing deployment can be found from https://vhbin.net/9804a1t6hv12/14:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355614:20
gfidentejokke_, I think it's too long or something because I don't see any error in there14:20
mandrejtomasek: so, I had a look at your comment14:20
mandrejtomasek: idk if we should set the workflow status to ERROR when the run_validation action failed14:21
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Remove app.conf to use a JS-based config file  https://review.openstack.org/34365814:21
*** skramaja has quit IRC14:21
mandrejtomasek: because the workflow actually runs to completion... it's successful14:22
mandrejtomasek: if you check the mistral action-execution-list otoh you'll see that the state for run_validation action is set to ERROR as you would expect14:23
mandrejtomasek: does it make sense?14:23
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: nova/api: purge archive_deleted_rows via cron  https://review.openstack.org/34366014:24
*** karthiks has joined #tripleo14:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove ::nova::cron::archive_deleted_rows  https://review.openstack.org/34366114:26
jokke_gfidente: yup looks like our max size on termbin did not get updated14:28
*** fzdarsky|afk is now known as fzdarsky14:29
*** ebalduf has joined #tripleo14:29
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove ::nova::cron::archive_deleted_rows  https://review.openstack.org/34366114:29
EmilienMmarios, bandini: could you tell me what constraints we could delete from https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/manifests/overcloud_controller_pacemaker.pp#L124-L263 ?14:31
EmilienMmarios, bandini: I'm trying to remove last puppet bits from THT14:31
sshnaidmcores, can you please merge the patch enabling introspection in nonha jobs? https://review.openstack.org/#/c/34214614:32
jtomasekmandre: I agree, so to determine whether validation failed or not, we'll use status in the output and message, ok?14:32
jtomasekmandre: and status is RUNNING/SUCCESS/FAILED14:32
*** jprovazn has quit IRC14:32
*** jprovazn has joined #tripleo14:33
bandiniEmilienM: well we're removing all of them via https://review.openstack.org/#/c/314208/14:33
mandrejtomasek: that's the idea, yeah14:33
EmilienMbandini: ack, thanks14:33
openstackgerritGiulio Fidente proposed openstack/tripleo-puppet-elements: Revert "bump puppet-ceph to stable/hammer"  https://review.openstack.org/34366714:34
gfidentejokke_, ^^14:34
jtomasekmandre: ok, great. I'll update the GUI patch14:34
mandrejtomasek: either you read the status from the messages on zaqar or you check the status of the run_validation action and not the one of the entire workflow14:35
*** pblaho has quit IRC14:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Don't collect gnocchi-service tag in THT  https://review.openstack.org/34366914:35
*** tosky has joined #tripleo14:36
EmilienMbandini: wow, your patches are really big, do you plan to split it ?14:37
jtomasekmandre: the workflow execution has it in the oputput.status. So to determine validation result, I either use execution.output.status or message.payload.status. This covers the usecases14:37
dtantsurfolks, please somebody approve https://review.openstack.org/#/c/342146/ it's passed the nonha gate and is pretty urgent14:37
hewbroccaBut grandmother, what big PATCHES you have!14:37
*** ifarkas has quit IRC14:37
*** pblaho has joined #tripleo14:37
*** ifarkas_ has quit IRC14:37
dtantsurthis gets introspection back into gate14:37
mandrejtomasek: right, that works14:37
openstackgerritMerged openstack-infra/tripleo-ci: Properly configure introspection HTTP port and reenable it in gate  https://review.openstack.org/34214614:38
mandrejtomasek: that being said, idk if there is some sort of convention regarding workflow status in the mistral world. If there is then we should probably stick to it14:38
*** ifarkas has joined #tripleo14:38
bandiniEmilienM: I wasn't planning to as they are rather simple conceptually, but am happy to hear otherwise14:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove enable_load_balancer on nonha manifest  https://review.openstack.org/34367314:38
bandinihewbrocca: rotfl14:39
hewbroccaheh14:39
hewbroccaI couldn't resist14:39
*** zoliXXL is now known as zoli|afk14:39
jtomasekmandre: well, the execution has 'state' of 'ERROR/SUCCESS/RUNNING' values. But since we decide not to use that to track validation status, it is imo ok to use 'status': 'RUNNING/SUCCESS/FAILED' for it.14:40
jtomasekmandre: as that is in general what we've been using for other workflows14:40
*** rajinir has joined #tripleo14:41
jaosoriorayoung: which environment variable did I need to set up to specify the domain for keystone? for the stackrc14:45
ayoungjaosorior, there are 2.14:45
ayoungOne is for the User the other for the project:14:45
ayoungjaosorior, http://adam.younglogic.com/2015/08/template-for-a-keystonev3-rc/14:45
ayoungjaosorior, in either case it can be *_DOMAIN_NAME or *_DOMAIN_ID14:45
jaosoriorayoung: ACtually I was looking for that blogpost, I remembered you had written something. But I failed to find it14:46
*** jpeeler has joined #tripleo14:46
*** jpeeler has joined #tripleo14:46
ayoungjaosorior, I just redid the indexing of it.  If you go to the main page, it lists a lot of the posts, including just about everything I've done for Keystone14:46
jaosorioraaah14:47
jaosoriorI see14:47
ayoungyeah, I was having trouble finding things myself14:47
ayoungjaosorior, I might transition some of those from blog posts to Pages, as the pages function in Wordpress actually allows me to organize them by topic as opposed to just time14:47
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: profile/base/nova: declare nova class properly  https://review.openstack.org/32834714:49
ayoungjaosorior, sounds like debuigging failed deploys is still not happening?14:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove usage of ::nova class in THT  https://review.openstack.org/32598314:49
EmilienMayoung: Happy Birthday14:49
ayoungEmilienM, TYVM14:50
shardyayoung: FYI there is a new heatclient interface, try running "openstack stack failures list overcloud"14:51
shardywe need to wire that in so it's run by default on any deploy failure14:51
shardyin many/most cases that will surface the error without manual inspection of nested stacks14:52
bandinimarios: ok I know what is happening, not sure yet why. wrote to Andrew14:56
openstackgerritMerged openstack-infra/tripleo-ci: Exit with non-zero status on create and update errors  https://review.openstack.org/31935214:57
jaosoriorayoung: It's your birthday? Hey congrats dude!14:57
ayoungjaosorior, thanks.14:57
ayoungshardy, will do.  I am running quickstart, which was Mitaka based (I think) so I would need to update to master in order to pick that up, right?14:57
*** dtrainor has joined #tripleo14:58
shardyayoung: Yes, or just pip install the latest heatclient14:58
*** ebalduf_ has joined #tripleo14:59
*** jubapa has quit IRC14:59
*** jubapa has joined #tripleo15:00
EmilienMjaosorior: so alee is on pto, do you want to chat a bit about barbican?15:01
mariosbandini: ack catchup in sec?15:01
jaosoriorEmilienM: Sure15:01
*** limao has quit IRC15:02
socialdtantsur: hmm have you seen errors like this? /bin/dd: error writing '/dev/disk/by-path/ip-192.0.2.15:3260-iscsi-iqn.2008-10.org.openstack:c9f20d27-dea0-4413-a7d2-cef0ae5af348-lun-1-part2': Input/output error15:02
dtantsursocial, not really15:03
EmilienMjaosorior: so I'm working on https://review.openstack.org/#/c/339806/ which has 2 dependencies15:03
EmilienMjaosorior: the goal is to test Volume Encryption with Tempest15:03
EmilienMjaosorior: until now, we had some auth issues between Barbican & Keystone (using v3)15:04
EmilienMjaosorior: CI jobs are running again now (I rebased & addressed some comments in deps) but will probably fail again. I might need your help on reviewing the parameters in barbican.conf15:04
socialdtantsur: it always takes ~320sec and gets stopped with input/output error15:06
dtantsurlucasagomes, seen that ^^?15:07
*** ebalduf_ has quit IRC15:08
*** anshul_ has quit IRC15:08
*** jrist has quit IRC15:10
*** julim has quit IRC15:10
* lucasagomes looks15:10
EmilienMit sounds like our CI is randomly failing on:15:10
EmilienMError: /Stage[main]/Gnocchi::Db::Sync/Exec[gnocchi-db-sync]: gnocchi-upgrade --config-file /etc/gnocchi/gnocchi.conf --skip-storage --create-legacy-resource-types returned 1 instead of one of [0]\15:10
EmilienMpradk, gfidente ^ have you seen that?15:10
EmilienMex: http://logs.openstack.org/16/341616/10/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/4136edd/logs/postci.txt.gz#_2016-07-18_14_45_05_00015:10
lucasagomessocial, strange... is the disk working normally?15:11
pradkhmm i have not.. any more details on the error?15:11
EmilienMpradk: actually, it fails when we use --skip-storage --create-legacy-resource-types15:11
lucasagomessocial, cause yes, I've seem it before but the disk was full of bad blocks15:11
EmilienMpradk: it's failing for this patch: https://review.openstack.org/#/c/341616/10/puppet/services/gnocchi-base.yaml15:11
pradkEmilienM, is this master or mitaka..15:11
sociallucasagomes: it's in vm, disk should be ok and I have no complains from kernel :/15:11
openstackgerritBen Nemec proposed openstack/tripleo-specs: Remove specs/juno/template.rst  https://review.openstack.org/30855115:12
sshnaidmEmilienM, I think I saw it here, it's marked as resolved: https://etherpad.openstack.org/p/delorean_master_current_issues15:12
EmilienMpradk: master15:12
EmilienMpradk: what options should we use?15:12
pradkEmilienM, those flags are valid and have to be included to work with ceilometer15:12
pradkboth15:12
lucasagomessocial, oh right, in that context I haven't seem it no :-/15:12
* lucasagomes thinks...15:13
jaosoriorEmilienM: Sure, I can check them out15:13
jaosoriorwhat issues have you had with barbican and keystone?15:13
sociallucasagomes: the error is from dd, yes?15:13
jaosoriorthat should have been working15:13
lucasagomessocial, yeah15:13
pradkEmilienM, what is gnocchi::db::mysql::host: {get_param: [EndpointMap, MysqlNoBracketsInternal, host]} setting to?15:13
jaosoriorwe use v3 for the barbican devstack gate15:13
sociallucasagomes: it would say that disk is full if it were full, I'm guessing it's some sort of timeout15:13
*** maxbab has left #tripleo15:13
EmilienMjaosorior: I'll show you once CI fails again15:14
*** bfournie has quit IRC15:14
*** dciabrin has quit IRC15:15
lucasagomessocial, yeah so I don't think we set any timeout for that command really15:15
lucasagomesunless dd itself does, but I doubt it15:15
lucasagomessocial, the image you are using is smaller than the target device right? (Just making sure)15:16
sociallucasagomes: what I think is happening is timeouts in scsi15:16
socialbut dunno what could cause that15:16
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add principal to certmonger's haproxy helper  https://review.openstack.org/34371015:17
lucasagomessocial, hmm they iscsi is sensitive to timeskew, do we have a ntp server running15:17
lucasagomes?15:17
lucasagomesthe*15:17
EmilienMpradk: I'm not sure, jaosorior and gfidente uploaded on it15:19
ayoungshardy, installing an upgraded heatclient in turn, installs several other clients.  We really need a container based install process to isolate the clients dependencies15:19
gfidentepradk, the vip where to reach mysql15:19
gfidentepradk, you can download the /etc directory from the CI jobs to see if anything is misconfigured15:20
EmilienMthis gnocchi error is weird15:20
openstackgerritMerged openstack/tripleo-specs: Remove specs/juno/template.rst  https://review.openstack.org/30855115:20
*** anshul_ has joined #tripleo15:21
*** jrist has joined #tripleo15:25
jaosoriorEmilienM: Seems to me that the gnocchi connection is not set at all for some reason15:25
jaosorioronly the url for the indexer15:26
jaosoriorand the indexer's URL seems to have a correct value15:26
jaosorioror correct-looking15:26
EmilienMlet me look15:26
*** tremble has quit IRC15:27
*** ebarrera has quit IRC15:27
EmilienMjaosorior: only the indexer url does matter, right?15:28
jaosoriorno idea15:28
jaosoriordon't know how gnocchi works. pradk ^^15:29
pradkEmilienM, gnocchi connection needs to be set thats what gnocchi::db::database_connection: does?15:30
pradkwe're already seetting that in the template15:31
*** oshvartz has quit IRC15:31
*** shardy has quit IRC15:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove useless mongodb variables in ha manifest  https://review.openstack.org/34373315:31
pradki dont know what  gnocchi::db::mysql::host: {get_param: [EndpointMap, MysqlNoBracketsInternal is translating to.. as i see you made this change in the current patch15:31
EmilienMoh right in  gnocchi::db::database_connection15:32
pradkchanged that from MysqlVirtual to MysqlNoBracketsInternal15:32
jaosoriorpradk: MysqlVirtual wasn't doing anything15:32
jaosoriorit never did15:32
EmilienMjaosorior: look https://review.openstack.org/#/c/341616/10/puppet/services/gnocchi-base.yaml L4815:32
pradkso we were never setting mysql::host?15:32
jaosoriorpradk: pretty much15:33
EmilienMshould we also update it?15:33
jaosoriorwhich is why in that patch I went ahead and remvoed the usage of MysqlVirtual15:33
jaosoriorit was translating to an empty host15:33
jaosoriorsince it doesn't exist in the endpoint map15:33
jaosoriorEmilienM: seems we gotta set database_connection15:33
*** jrist has quit IRC15:35
*** julim has joined #tripleo15:36
openstackgerritMerged openstack/instack-undercloud: Add a second proxy-logging middleware entry to swift-proxy  https://review.openstack.org/34131415:36
EmilienMjaosorior: you want to update it?15:36
openstackgerritMerged openstack/instack-undercloud: Add a second proxy-logging middleware entry to swift-proxy  https://review.openstack.org/34131515:37
*** anshul_ has quit IRC15:38
*** dciabrin has joined #tripleo15:38
jaosoriorEmilienM: will do15:39
jaosoriorEmilienM: wait up...15:43
jaosoriorbut we ARE setting gnocchi's database_connection15:43
jaosoriorAnd it's using MysqlInternal and everything15:43
jaosoriorwhat the hell15:43
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Hammer and/or Jewel from Ceph repos  https://review.openstack.org/34050415:44
jaosoriordoesn't make sense15:45
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: WIP Next generation HA architecture work  https://review.openstack.org/34265015:45
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: WIP Next generation HA architecture work  https://review.openstack.org/31420815:49
*** abehl has joined #tripleo15:51
*** egafford has quit IRC15:51
*** jrist has joined #tripleo15:51
*** jrist has joined #tripleo15:51
*** egafford has joined #tripleo15:52
*** milan has quit IRC15:52
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: WIP Next generation HA architecture work  https://review.openstack.org/31420815:53
EmilienMjaosorior: I don't get it either yet15:53
*** zoli|afk is now known as zoli15:57
*** zoli is now known as zoliXXL15:57
*** egafford has quit IRC15:59
*** dciabrin has quit IRC16:02
*** sshnaidm has quit IRC16:02
*** egafford has joined #tripleo16:03
*** fzdarsky is now known as fzdarsky|afk16:04
*** julim has quit IRC16:04
*** ebarrera has joined #tripleo16:05
*** jrist has quit IRC16:07
*** bfournie has joined #tripleo16:09
*** links has joined #tripleo16:10
*** masco has quit IRC16:10
*** tesseract- has quit IRC16:10
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355616:13
*** adarazs is now known as adarazs_pto16:13
*** dciabrin has joined #tripleo16:16
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: Customize vcpu_pin_set in nova.conf  https://review.openstack.org/34377016:16
*** ccamacho is now known as ccamacho|out16:19
*** jrist has joined #tripleo16:20
*** jrist has joined #tripleo16:20
*** skramaja has joined #tripleo16:21
*** zoliXXL is now known as zoli|gone16:24
*** zoli|gone is now known as zoli_gone-proxy16:25
*** dtantsur is now known as dtantsur|bbl16:27
*** julim has joined #tripleo16:28
jpeelerdprince: do you have time to look at https://review.openstack.org/#/c/343100/ ?16:28
*** rwsu has joined #tripleo16:29
jmiuccamacho|out: when you're back, do you have any hints for what to look for once the image is mounted?16:29
dprincejpeeler: yep, I'll review16:31
*** jpich has quit IRC16:31
*** ohamada has quit IRC16:34
*** sshnaidm has joined #tripleo16:35
*** sshnaidm is now known as sshnaidm|afk16:36
*** radek2 has quit IRC16:37
jaosoriorbnemec: Hey dude, I added the needed parameter to puppet-ironic, so inspector should not be listening on 0.0.0.0 anymore here https://review.openstack.org/#/c/332641/16:37
bnemecjaosorior: Yeah, I'll try it again.16:37
*** dciabrin has quit IRC16:44
*** rhallisey has quit IRC16:45
*** aufi has quit IRC16:46
*** dciabrin has joined #tripleo16:46
*** rhallisey has joined #tripleo16:47
*** rwsu has quit IRC16:47
*** lucasagomes is now known as lucas-afk16:49
*** milan has joined #tripleo16:49
*** rcernin has quit IRC16:53
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Generate CephX keys and Ceph FSID as overcloud passwords  https://review.openstack.org/34379416:55
*** jaosorior has quit IRC16:56
*** jaosorior has joined #tripleo16:57
*** masco has joined #tripleo16:58
*** pcaruana has quit IRC16:59
openstackgerritMerged openstack/tripleo-heat-templates: Missing CephClientKey parameter in puppet-ceph-devel and storage-environment  https://review.openstack.org/34044716:59
*** rwsu has joined #tripleo17:00
*** dtantsur|bbl is now known as dtantsur17:01
*** cdearborn has joined #tripleo17:01
*** fzdarsky|afk is now known as fzdarsky17:04
*** onovy has quit IRC17:05
*** Ng has quit IRC17:05
*** mwhahaha has quit IRC17:05
*** flaper87 has quit IRC17:05
*** zigo has quit IRC17:06
*** mgagne has quit IRC17:06
*** StevenK has quit IRC17:06
*** zigo has joined #tripleo17:06
*** StevenK has joined #tripleo17:07
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR  https://review.openstack.org/33214717:08
*** rwsu has quit IRC17:09
*** flaper87 has joined #tripleo17:10
*** onovy has joined #tripleo17:10
*** mgagne has joined #tripleo17:11
*** flaper87 is now known as Guest5358617:11
*** Ng has joined #tripleo17:12
*** ChanServ sets mode: +v Ng17:12
*** mgould is now known as mgould|afk17:12
*** mwhahaha has joined #tripleo17:13
*** jaosorior has quit IRC17:13
*** stendulker has joined #tripleo17:17
*** devvesa has quit IRC17:18
trownpradk: I think https://review.openstack.org/#/c/329692/ is broken on master again with the switch to using split out gnocchi role: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/gnocchi-base.yaml#L5817:18
trownnot really sure how tripleo-ci can pass without that17:19
*** jubapa has quit IRC17:19
*** rwsu has joined #tripleo17:21
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Generate CephX keys and FSID regardless of CephStorageCount  https://review.openstack.org/34379417:25
openstackgerritGiulio Fidente proposed openstack/python-tripleoclient: Generate CephX keys and FSID regardless of CephStorageCount  https://review.openstack.org/34379417:26
*** gfidente is now known as gfidente|afk17:26
*** athomas has quit IRC17:26
*** rhallisey has quit IRC17:28
*** ifarkas is now known as ifarkas_afk17:28
*** rhallisey has joined #tripleo17:29
*** skramaja has quit IRC17:32
pradktrown, not sure what you mean by broken .. thats an optional param which creates legacy resources. Ci should not fail if thats not there.. but we do need to make sure to bring it back into the roles17:32
openstackgerritMerged openstack-infra/tripleo-ci: Add undercloud idempotency test  https://review.openstack.org/27921817:32
trownpradk: hmm, k seeing gnocci dbsync fail in RDO promote job for master17:33
trownpradk: testing with the legacy resources option now17:33
pradktrown, whats the error17:33
trownpradk: didnt check and wiped my overcloud to test changing that... just noticed it was different. if it fails on this run I will check17:34
pradkthat flag shouldnt matter .. wrt db sync17:34
trownah k, I just started looking at commit history to find it and found that bug/patch on master that is no longer there because of the switch17:35
trownshould get a failure soon then, and I can get gnocchi logs17:36
pradktrown, right and the flag is back in this patch https://review.openstack.org/#/c/34161617:36
pradktrown, it was not really missing, just the hieradata was separate17:37
*** rcernin has joined #tripleo17:37
trownpradk: oh perfect, so if it fails to fail we have a patch up thanks :)17:37
trownpradk: ah ya I wonder if that gnocchi::db::mysql::host line is the problem actually, in any case if this fails I will get logs then try with that patch... thanks!17:39
*** links has quit IRC17:44
*** stendulker has quit IRC17:45
EmilienMcan we land this quick cleanup change? https://review.openstack.org/#/c/343669/17:46
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355617:46
EmilienMsame for https://review.openstack.org/#/c/343636/, dprince <--- I think you added the params back in times17:46
trownpradk: confirmed that with just the creates legacy resources option overcloud deploys17:47
*** links has joined #tripleo17:47
dprinceEmilienM: this was simply for exact parity with old school TripleO17:48
EmilienMcool :)17:48
dprinceEmilienM: they are still valid FWIW17:48
*** masco has quit IRC17:49
dprinceEmilienM: we can try removing them17:49
EmilienMdprince: I don't think they are used17:51
EmilienMthere were used for nova network iirc17:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove ::nova::cron::archive_deleted_rows  https://review.openstack.org/34366117:55
*** tosky has quit IRC17:55
*** trown is now known as trown|lunch17:56
*** rook-rocketship has quit IRC18:00
*** rook-rocketship has joined #tripleo18:01
*** julim_ has joined #tripleo18:02
*** rhallisey has quit IRC18:04
openstackgerritDan Prince proposed openstack/os-collect-config: Merge deployments data for zaqar collectors  https://review.openstack.org/34383518:05
*** julim has quit IRC18:05
*** jrist has quit IRC18:07
*** shivrao has joined #tripleo18:10
*** julim_ has quit IRC18:15
*** numans has joined #tripleo18:20
*** ebarrera has quit IRC18:21
*** pkovar has quit IRC18:25
*** pcaruana has joined #tripleo18:34
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] Do not exit prior to the inventory of the deployment.  https://review.openstack.org/34150618:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove enable_load_balancer on nonha manifest  https://review.openstack.org/34367318:40
*** jrist has joined #tripleo18:41
*** dprince has quit IRC18:41
*** myoung has quit IRC18:42
EmilienMI have 4 patches for quick cleanup, if anyone can look please https://review.openstack.org/#/q/topic:tripleo/cleanup18:42
*** rhallisey has joined #tripleo18:42
*** myoung has joined #tripleo18:42
*** numans has quit IRC18:43
*** ayoung has quit IRC18:45
*** cdearborn has quit IRC18:48
jidarare there any special requirements for using pxe_ilo in ironic? I ask because it ignores the mac address list I give it and doesn't seem to set a /tftpboot/pxelinux.cfg/ config file18:52
*** ccamacho|out is now known as ccamacho18:52
ccamachojmiu around?18:52
ccamachojmiu find the puppet manifests, and check that you are actually using the latest version of puppet-modules18:53
*** numans has joined #tripleo18:56
*** rcernin has quit IRC18:57
jmiuccamacho: hi yes? was eating a late lunch18:58
ccamachoIm about to have dinner xD18:59
jmiuccamacho: time zones can be so complicated :)18:59
ccamachojmiu indeed19:00
ccamachojmiu try to find this file https://review.openstack.org/#/c/340301/6/manifests/profile/pacemaker/gnocchi.pp19:01
jmiuccamacho: ah thank you for the reminder. :)) i was looking in eavesdrop logs to find it19:01
ccamachocheck the differences there, if you have the version from the left, you are hitting this issue, I recommend, to give some purifying fire to the environment (Usually saves time) and re-install it19:02
jmiuccamacho: there is still no such file19:02
ccamachojmiu, here /tmp/overcloud-full/opt/puppet-modules/tripleo19:03
ccamacho/tmp/overcloud-full/ is were you mounted the image disk19:03
ccamachojmiu should be there, or you will have "can find module... " errors19:04
jmiuccamacho: oh, i was looking under the path that you gave me on friday19:05
ccamachojmiu should be a sym link19:06
jmiuccamacho: there is still nothing there19:06
ccamachonot sure how it works in oooq19:07
jmiuunder opt there is only a directory called 'stack19:07
jmiu'19:07
*** yamahata has joined #tripleo19:07
ccamachommmm jmiu weird, mm what if run an updatedb and then with locate get the file location? is that im not using oooq so not sure were this file is.19:09
jmiui will try that19:09
*** ebalduf has quit IRC19:12
*** r-mibu has quit IRC19:13
*** r-mibu has joined #tripleo19:13
*** rcernin has joined #tripleo19:15
*** rcernin has quit IRC19:16
*** florianf has quit IRC19:16
*** rcernin has joined #tripleo19:16
*** jerrygb has joined #tripleo19:17
*** jerrygb has quit IRC19:18
*** trown|lunch is now known as trown19:21
jmiuccamacho: there is a gnocchi.pp file, but it is nothing like either of the diffs19:25
jmiuccamacho: i think this manifest is to configure gnocchi for ceilometer19:26
*** links has quit IRC19:27
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: update tempest skip file  https://review.openstack.org/34387419:28
openstackgerritMerged openstack/tripleo-quickstart: update tempest skip file  https://review.openstack.org/34387419:29
*** cdearborn has joined #tripleo19:34
*** akshai has quit IRC19:40
trownEmilienM: does https://review.openstack.org/#/c/341616/10 require some puppet-tripleo change? it does not seem to work in my env, but only thing that might be different is puppet-tripleo might not be up to date in dlrn due to weekend outage19:40
*** akshai has joined #tripleo19:41
trownspecifically rabbitmq_environment is clearly in https://review.openstack.org/#/c/341616/10/puppet/services/rabbitmq.yaml but my deploy  fails trying to look up that var19:41
*** cdearborn has quit IRC19:42
trownhmm no commits to puppet-tripleo since before dlrn outage though19:43
EmilienMtrown: yeah something breaks with quotes19:43
EmilienMtrown: can you try to change L50 the quotes by double quotes?19:44
trownEmilienM: surely19:44
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo: Make ::tripleo::profile::base classes work with multiple nodes  https://review.openstack.org/33838719:45
trownEmilienM: the tcp_listen_options line?19:46
trownseems like 45 (RABBITMQ_SERVER_ERL_ARGS) has some crazy quoting and that is in the var puppet is complaining about19:47
EmilienMyeah19:47
EmilienMwe need to use double quotes I guess19:47
trownk I will try 5019:47
EmilienMok19:48
*** cdearborn has joined #tripleo19:48
*** jprovazn has quit IRC19:51
openstackgerritJon Schlueter proposed openstack/python-tripleoclient: Use osc-lib instead of openstackclient  https://review.openstack.org/34388319:52
*** Goneri has quit IRC19:55
*** beagles is now known as beagles_biab19:56
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: add bugs associated w/ tempest failures (master)  https://review.openstack.org/34388419:58
trownEmilienM: same issue with double quotes on 50... I think it must be something with the mixed quoting on 4520:08
*** numans has quit IRC20:09
*** fzdarsky is now known as fzdarsky|afk20:09
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: profile/base/nova: declare nova class properly  https://review.openstack.org/32834720:12
EmilienMtrown: damn20:12
EmilienMI need to re-test it20:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove usage of ::nova class in THT  https://review.openstack.org/32598320:12
trownEmilienM: k, I will keep hacking on it and will push up a change if I get it working20:13
trownEmilienM: otherwise, what do you think of splitting out a patch for only the gnocchi part and rebasing that one on top of it? We need https://review.openstack.org/#/c/341616/10/puppet/services/gnocchi-base.yaml for master promote20:14
EmilienMtrown: sure thing I can do that20:15
EmilienMjust the db sync thing right?20:15
trownEmilienM: ya just the db sync thing allowed me to get CREATE_COMPLETE20:15
EmilienMok let me do it20:15
trownI don't understand the why at all, but it definitely worked20:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: gnocchi: configure db_sync command in the profile  https://review.openstack.org/34390220:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Migrate Puppet Hieradata to composable services  https://review.openstack.org/34161620:17
EmilienMtrown: done ^20:17
trownEmilienM++ you rock thanks!20:18
EmilienMtrown: yeah it's weird, we don't do it in puppet CI20:18
trownEmilienM: it only seems to affect HA for me too20:18
EmilienMtrown: thx for helping in this hiera thing I was a bit stuck20:18
EmilienMah ok20:18
*** abehl has quit IRC20:20
*** jeckersb is now known as jeckersb_gone20:21
trownEmilienM: hmm those config values are in heat now instead of hiera? there must be some heat incantation to see what they look like to heat20:21
trownmight shine some light on where the quoting issue is20:22
*** dprince has joined #tripleo20:24
EmilienMdprince: hey, when moving hiera params from hieradata to heat services, we're seeing lot of syntax issues20:25
EmilienMan example here: https://review.openstack.org/#/c/343661/20:25
EmilienMcan you help?20:25
*** akrivoka has quit IRC20:26
dprinceEmilienM: perhaps, what is the error?20:26
EmilienMhttp://logs.openstack.org/61/343661/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/54ec3a7/logs/postci.txt.gz#_2016-07-18_20_07_27_00020:26
EmilienMdprince: maybe something in https://review.openstack.org/#/c/343661/3/puppet/services/nova-api.yaml ?20:26
dprinceEmilienM: I was going to do these in larger chunks FWIW20:27
EmilienMdprince: same issue in https://review.openstack.org/341616 - I would use your expertise here20:27
EmilienMthese what?20:27
*** mbound has quit IRC20:27
*** [1]cdearborn has joined #tripleo20:28
trownya for 341616 we are not getting the rabbitmq_environment variable though it is clearly in the services yaml Error: Could not find data item rabbitmq_environment in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/rabbitmq.pp:49 on node overcloud-controller-0.localdomain20:28
dprinceEmilienM: I would look at the generated hiera files on the other side20:29
EmilienMdprince: what chunks do talk about?20:30
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: [WIP] Do not exit prior to the inventory of the deployment.  https://review.openstack.org/34150620:32
EmilienMtrown: do you have the hieradata files? maybe I can look at it20:33
trownEmilienM: have a deploy going now that should fail shortly20:33
*** [2]cdearborn has joined #tripleo20:35
trownEmilienM: do those get compiled into service_configs.yaml?20:36
trownhttp://chunk.io/f/d5641a8ae46443f0a1a94b168637956f is that file20:36
trownnothing obviously wrong there though... just missing a bunch of the rabbitmq hiera20:37
*** jayg is now known as jayg|g0n320:38
trownI guess I could try to bisect which line causes it to go missing, though that might be a task for tomorrow20:38
*** rcernin has quit IRC20:38
EmilienMtrown: looking20:39
EmilienMtrown: on which line it says it fails?20:39
*** jeckersb_gone is now known as jeckersb20:39
EmilienMdprince: do you have progress on moving hiera bits?20:40
trownhttp://chunk.io/f/3de95406db3b401e8f9960929ff4b481 is the stderr from puppet, is that what you are asking?20:41
EmilienMmhh, ok so this is another error, now hieradata is missing, before it was incorrect20:42
*** cdearborn has quit IRC20:42
*** [2]cdearborn is now known as cdearborn20:42
*** [1]cdearborn has quit IRC20:44
trownEmilienM: hmm, ya actually just looking at gnocchi entries in the hiera they are not from the services yaml20:45
openstackgerritMerged openstack/tripleo-heat-templates: overcloud_compute.pp: remove nova_config params  https://review.openstack.org/34363620:50
*** Goneri has joined #tripleo20:50
*** jdob has quit IRC20:54
*** noslzzp has quit IRC20:54
trowntrying a run with just the gnocchi change... maybe there is something else wrong with the bigger change... or maybe I am just doing something wrong20:54
*** ayoung has joined #tripleo20:55
*** noslzzp has joined #tripleo20:55
EmilienMtrown: I'm redeploying my env now, i'll probably find the issue tonight or tomorrow20:57
trownEmilienM: cool, with just gnocchi patch I am past the point it is failing with the big patch, so there is at least that :)20:59
EmilienMtrown: ok good, so we can unblock situation to promote, right?21:01
*** Goneri has quit IRC21:01
openstackgerritMerged openstack/tripleo-heat-templates: Remove useless mongodb variables in ha manifest  https://review.openstack.org/34373321:01
trownEmilienM: ya, assuming it passes all the way, still going atm21:02
EmilienMok21:02
openstackgerritMerged openstack/tripleo-heat-templates: Don't collect gnocchi-service tag in THT  https://review.openstack.org/34366921:03
openstackgerritMerged openstack/tripleo-heat-templates: Remove enable_load_balancer on nonha manifest  https://review.openstack.org/34367321:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355621:11
EmilienMpradk: rebased ^ but did you see my comment? I'm trying to reproduce the CI failure with service data21:11
*** trown is now known as trown|outtypewww21:13
pradkEmilienM, yea i'm trying to chase the same error locally.. not sure which role_data its complaining about21:13
EmilienMpradk: I'll continue to debug tonight, but let me know if you found out something, in the gerrit review21:14
EmilienMI'm redeploying my env now, so I should find out quickly also21:14
*** lblanchard has quit IRC21:15
*** akshai has quit IRC21:16
jidarare there any special requirements for using pxe_ilo in ironic? I ask because it ignores the mac address list I give it and doesn't seem to set a /tftpboot/pxelinux.cfg/ config file21:18
*** weshay has quit IRC21:22
openstackgerritMerged openstack/os-collect-config: Set a timeout for all data fetches using requests  https://review.openstack.org/34017921:25
*** fzdarsky|afk has quit IRC21:27
*** mbound has joined #tripleo21:28
*** jcoufal has quit IRC21:28
*** krot_vaca_jul19 is now known as krotscheck21:30
*** paramite has quit IRC21:30
*** rhallisey has quit IRC21:31
*** mbound has quit IRC21:33
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist  https://review.openstack.org/31933721:33
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished  https://review.openstack.org/29732821:33
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job  https://review.openstack.org/29676521:33
*** ccamacho has quit IRC21:42
openstackgerritJeff Peeler proposed openstack/instack-undercloud: Modify LVM filter fix to blacklist iSCSI  https://review.openstack.org/34310021:43
*** fultonj has quit IRC21:44
*** fultonj has joined #tripleo21:44
*** dprince has quit IRC21:48
*** rcernin has joined #tripleo21:49
*** rcernin has quit IRC21:49
*** myoung|remote has joined #tripleo21:56
*** fultonj has quit IRC22:02
*** egafford has quit IRC22:06
*** myoung|remote has quit IRC22:08
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Fix packaging problems for Debian  https://review.openstack.org/34334222:13
*** noslzzp has quit IRC22:17
*** noslzzp has joined #tripleo22:20
openstackgerritJon Schlueter proposed openstack/python-tripleoclient: Use osc-lib instead of openstackclient  https://review.openstack.org/34388322:21
*** noslzzp has quit IRC22:24
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates: Remove NeutronEnableTunnelling from THT and puppet manifests  https://review.openstack.org/33523522:26
*** ebalduf has joined #tripleo22:28
*** bfournie has quit IRC22:34
*** rlandy has quit IRC22:51
*** limao has joined #tripleo22:56
*** cdearborn has quit IRC23:00
*** saneax_AFK is now known as saneax23:03
*** pcaruana has quit IRC23:05
*** cdearborn has joined #tripleo23:09
*** limao has quit IRC23:14
*** limao has joined #tripleo23:14
*** limao has quit IRC23:31
*** yamahata has quit IRC23:41
*** myoung|remote has joined #tripleo23:43
*** myoung|remote has quit IRC23:44
*** yamahata has joined #tripleo23:48
openstackgerritIan Wienand proposed openstack/diskimage-builder: Move element-info a standard entry-point  https://review.openstack.org/33089323:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!