Thursday, 2016-06-23

*** sthillma has quit IRC00:07
*** lmiccini has joined #tripleo00:07
*** sthillma has joined #tripleo00:09
*** tzumainn has quit IRC00:17
*** mbound has quit IRC00:20
*** sthillma has quit IRC00:21
*** akshai has quit IRC00:24
*** limao has joined #tripleo00:30
*** limao_ has joined #tripleo00:34
*** limao has quit IRC00:37
*** fragatina has joined #tripleo00:59
*** dmacpher has joined #tripleo01:03
*** sthillma has joined #tripleo01:04
*** fragatina has quit IRC01:07
*** fragatina has joined #tripleo01:08
*** limao_ has quit IRC01:12
*** limao has joined #tripleo01:14
*** xinwu has quit IRC01:18
*** bfournie has quit IRC01:26
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978901:36
*** bootsha has joined #tripleo01:38
*** bootsha has quit IRC01:43
*** yamahata has quit IRC01:48
*** cllewellyn_ has quit IRC01:49
*** jefrite has quit IRC01:50
*** cllewellyn_ has joined #tripleo01:51
*** thrash is now known as thrash|g0ne02:12
openstackgerritMerged openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/33228102:17
*** TSCHAK has quit IRC02:18
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fix copyright in docs  https://review.openstack.org/33308402:19
*** jonbcraig has joined #tripleo02:19
*** rajinir has quit IRC02:24
*** sthillma has quit IRC02:26
*** greghaynes has quit IRC02:27
*** shivrao has quit IRC02:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: DNM - HA job testing with 332440  https://review.openstack.org/33244102:34
*** sthillma has joined #tripleo02:36
*** greghaynes has joined #tripleo02:38
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308702:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308802:39
*** bootsha has joined #tripleo02:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308802:40
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308902:40
EmilienMbnemec, slagle: once lint jobs are working again I'll +2 +A the patches ^02:41
EmilienMour CI is currently broken because of that ^02:41
*** jonbcraig has quit IRC02:43
*** bootsha has quit IRC02:44
*** sthillma has quit IRC02:44
openstackgerritMerged openstack/tripleo-heat-templates: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308803:03
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Ceilometer composable roles for controller  https://review.openstack.org/32411703:06
openstackgerritMerged openstack/puppet-tripleo: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308703:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: First iteration of libvirt and nova-compute as a composable services  https://review.openstack.org/32968603:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: compute: deploy composable neutron service  https://review.openstack.org/33123403:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Convert SNMP configuration to composable services format  https://review.openstack.org/32059703:16
*** shivrao has joined #tripleo03:16
*** ramishra has joined #tripleo03:17
openstackgerritMerged openstack/puppet-tripleo: Move neutron ml2 plugins in plugins dir  https://review.openstack.org/33286703:17
*** shivrao_ has joined #tripleo03:18
*** shivrao has quit IRC03:20
*** shivrao_ is now known as shivrao03:20
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Remove base/neutron/ml2.pp  https://review.openstack.org/33287003:21
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: neutron plugins: include neutron base  https://review.openstack.org/33289703:22
openstackgerritMerged openstack/tripleo-heat-templates: Update neutron ml2 class  https://review.openstack.org/33286903:25
*** ramishra has quit IRC03:27
*** shivrao has quit IRC03:28
*** cllewellyn_ has quit IRC03:30
*** cllewellyn_ has joined #tripleo03:32
*** ramishra has joined #tripleo03:32
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: nova/compute: add NFS bits  https://review.openstack.org/33295403:38
*** bootsha has joined #tripleo03:40
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: nova/compute: add NFS bits  https://review.openstack.org/33295403:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Remove NFS bits from overcloud_compute manifest  https://review.openstack.org/33295503:41
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308903:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: DNM - HA job testing with 332440  https://review.openstack.org/33244103:44
*** bootsha has quit IRC03:44
*** shivrao has joined #tripleo03:45
*** links has joined #tripleo03:51
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Switch to nova v2.1 and remove v3  https://review.openstack.org/31703303:53
*** ramishra has quit IRC03:53
*** ramishra has joined #tripleo03:54
openstackgerritMerged openstack/tripleo-heat-templates: Drop extraconfig for neutron-nuage.yaml  https://review.openstack.org/32774203:57
openstackgerritMerged openstack/tripleo-heat-templates: Composable opencontrail plugin  https://review.openstack.org/32847103:58
openstackgerritMerged openstack/instack-undercloud: Pin puppet-lint-absolute_classname-check to 0.1.3  https://review.openstack.org/33308903:58
openstackgerritMerged openstack/tripleo-heat-templates: Drop extraconfig for neutron-opencontrail.yaml  https://review.openstack.org/32847204:00
*** numans has joined #tripleo04:14
*** oshvartz has quit IRC04:18
*** liverpooler has quit IRC04:19
*** numans has quit IRC04:19
*** limao has quit IRC04:28
*** xinwu has joined #tripleo04:30
*** numans has joined #tripleo04:31
openstackgerritMerged openstack/instack-undercloud: Switch to nova v2.1 and remove v3  https://review.openstack.org/31703304:36
*** masco has joined #tripleo04:42
*** coolsvap has joined #tripleo04:49
*** ramishra has quit IRC04:52
*** jaosorior has joined #tripleo04:55
*** limao has joined #tripleo04:55
*** ramishra has joined #tripleo04:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Enable SSL for ironic inspector  https://review.openstack.org/33264105:06
*** yamahata has joined #tripleo05:08
*** ramishra has quit IRC05:23
*** shardy has joined #tripleo05:36
*** ramishra has joined #tripleo05:37
*** shardy has quit IRC05:38
*** ramishra has quit IRC05:44
*** sshnaidm_ has joined #tripleo05:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277405:49
*** ramishra has joined #tripleo05:49
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277405:52
*** cllewellyn__ has quit IRC05:55
*** cllewellyn_ has quit IRC05:55
*** yolanda has joined #tripleo05:56
openstackgerritMerged openstack/tripleo-heat-templates: Ceilometer composable roles for controller  https://review.openstack.org/32411705:57
*** saneax_AFK is now known as saneax05:58
*** pkovar has joined #tripleo06:01
*** dmacpher has quit IRC06:03
openstackgerritIan Wienand proposed openstack/diskimage-builder: Handle locales install on Fedora 24  https://review.openstack.org/33311806:04
*** liverpooler has joined #tripleo06:06
*** ramishra has quit IRC06:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277406:09
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Generate TLS endpoints if autogenerate cert is set  https://review.openstack.org/33312106:09
*** ramishra has joined #tripleo06:11
*** dmacpher has joined #tripleo06:15
*** rcernin has joined #tripleo06:15
*** ramishra has quit IRC06:19
*** ramishra has joined #tripleo06:21
openstackgerritMerged openstack/tripleo-ui: Add Delete nodes table action  https://review.openstack.org/33113306:21
openstackgerritMerged openstack/tripleo-ui: Add operation to move nodes to available state  https://review.openstack.org/33113406:23
openstackgerritMerged openstack/tripleo-ui: Add boot_option default value to registered node  https://review.openstack.org/33163106:23
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277406:26
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Generate TLS endpoints if autogenerate cert is set  https://review.openstack.org/33312106:26
*** oshvartz has joined #tripleo06:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277406:27
*** pkovar has quit IRC06:27
*** rasca has joined #tripleo06:28
*** yolanda has quit IRC06:30
*** dmacpher has quit IRC06:34
*** gfidente|afk has quit IRC06:35
*** shivrao_ has joined #tripleo06:39
*** shivrao has quit IRC06:40
*** shivrao_ is now known as shivrao06:40
jaosoriormarios, jistr: are you around?06:44
*** mcornea has joined #tripleo06:46
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277406:47
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add upgrade ci script for CI jobs  https://review.openstack.org/33281006:50
mariosgood morning jaosorior06:50
*** dmacpher has joined #tripleo06:50
bandinimorning *06:52
jaosoriormarios: Hey dude, how's it going?06:54
jaosoriorHow acquainted are you with the undercloud repo?06:54
jaosoriorbandini hey dude!06:54
bandinijaosorior: hola hola!06:57
mariosjaosorior: do you mean instack-undercloud or something else? depends anyway, whats the issue06:57
*** fragatina has quit IRC06:57
*** fragatina has joined #tripleo06:58
jaosoriorinstack-undercloud06:58
jaosoriormarios:So the thing is, I need to get an extra script, for certmonger to run after it updates the certificate from a service06:58
jaosoriorand I was thinking adding it from puppet wouldn't be a good idea as it wouldn't be tracked by the package manager06:58
jaosoriorso, where else can I put it then?06:58
*** cllewellyn_ has joined #tripleo07:00
*** cllewellyn__ has joined #tripleo07:00
*** jpena|off is now known as jpena07:01
*** trozet has joined #tripleo07:01
*** shardy has joined #tripleo07:02
*** bootsha has joined #tripleo07:02
*** rcernin has quit IRC07:02
mariosjaosorior: is this something you would add at install? not sure i understand the point about puppet and not tracking the script by package manager (you mean if you update certmonger package?)07:02
jaosoriormarios: so it would be a pretty small script that just gets the cert and key in a format that HAProxy can understand, overwrites the old file and restarts haproxy07:05
jaosoriorI could write that sh file via puppet07:06
jaosoriorbut when if you uninstall the undercloud or something of the sort, the file would remain there, untracked07:06
jaosoriorso I thought it would be better to have that file more static and to be installed/uninstalled with the undercloud itself07:06
*** ebalduf has quit IRC07:07
mariosjaosorior: i see what you mean. well if during install time i wonder if you could add it to that (instack_undercloud/undercloud.py ) but even then, since we don't have an 'uninstall undercloud' anyway it would still remain i think07:07
*** leanderthal|afk is now known as leanderthal07:08
mariosjaosorior: so really what you need is for the script to be delivered _with_ the instack-undercloud package?07:08
jaosorioroooh07:08
jaosorioralright07:08
jaosoriorI don't need it07:08
jaosoriorjust thought it would be cleaner07:08
jaosoriorthat's all07:08
mariosjaosorior: i mean if you 'uninstall undercloud' that would be the package07:08
mariosif you see what i mean07:08
jaosorioryeah07:09
mariosjaosorior: if you don't find a good solution during today you may want to lurk on our scrum later might get good suggestion there (1800 our time)07:09
mariosjaosorior: ping me then if you like07:09
jaosorioralright07:10
jaosoriorthanks dude07:10
*** dmacpher has quit IRC07:11
marioscoffee.refill()07:11
*** jpich has joined #tripleo07:11
*** tesseract- has joined #tripleo07:13
*** tesseract- has quit IRC07:14
*** ebarrera has joined #tripleo07:14
*** tesseract- has joined #tripleo07:14
*** rcernin has joined #tripleo07:16
*** florianf has joined #tripleo07:17
*** masco has quit IRC07:23
*** zoli_gone-proxy is now known as zoliXXL07:24
*** aufi has joined #tripleo07:27
*** trozet has quit IRC07:27
*** anshul has joined #tripleo07:30
*** anshul is now known as Guest9030907:30
*** akuznetsov has joined #tripleo07:31
*** dsariel has joined #tripleo07:33
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277407:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Generate TLS endpoints if autogenerate cert is set  https://review.openstack.org/33312107:34
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use Openstack CLI for setting undercloud quota  https://review.openstack.org/33315007:34
*** panda has quit IRC07:34
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Timezone service - Controller  https://review.openstack.org/33152807:34
*** masco has joined #tripleo07:35
*** qasims has joined #tripleo07:35
*** panda has joined #tripleo07:35
*** cllewellyn__ has quit IRC07:39
*** cllewellyn_ has quit IRC07:39
bandinijaosorior: if you have a few mins https://review.openstack.org/#/c/302235/ this is now in good shape and worked reproduceably in my tests07:40
*** limao_ has joined #tripleo07:41
*** limao has quit IRC07:44
jaosoriorbandini: question here https://review.openstack.org/#/c/302235/1807:45
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui: Fixes IronicApiService.deleteNode  https://review.openstack.org/33315407:45
bandinijaosorior: uops I suck at rebases obviously07:46
jaosoriorbandini: Is that supposed to be ran?07:46
bandinijaosorior: no. it is not needed during upgrades. and I tested the code as is, so far07:47
jaosoriorok07:48
bandiniresubmitting07:48
jaosoriorbandini: lets do this, update that commit and once it passes CI I can merge it07:48
jaosoriorit's just the removal of a comment anyway07:48
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Keystone liberty mitaka upgrade step  https://review.openstack.org/30223507:48
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Timezone service - Compute  https://review.openstack.org/33153007:49
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Timezone service - Controller  https://review.openstack.org/33152807:49
bandinijaosorior: ack (not that CI does not test this codepath anyway)07:49
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Timezone service - CephStorage  https://review.openstack.org/33153407:49
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Configure BlockStorage services via resource chains  https://review.openstack.org/32285807:49
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Timezone service - ObjectStorage  https://review.openstack.org/33153607:49
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Wire NTP and Timezone services into BlockStorage nodes  https://review.openstack.org/33274007:49
jaosoriorquick review anyone? https://review.openstack.org/#/c/332736/07:52
*** mbound has joined #tripleo07:53
*** ifarkas has joined #tripleo07:53
*** itamarl has joined #tripleo07:54
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Move nova constraint, and refactor its declaration  https://review.openstack.org/33206907:55
*** gus has quit IRC07:57
*** gus has joined #tripleo07:57
*** akuznetsov has quit IRC07:57
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841307:58
*** itamarl has quit IRC08:00
*** dbecker_ has quit IRC08:00
*** itamarl has joined #tripleo08:00
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo: Add gnocchi profiles  https://review.openstack.org/31552708:01
*** jtomasek_ has joined #tripleo08:02
*** cllewellyn_ has joined #tripleo08:04
*** cllewellyn__ has joined #tripleo08:04
*** dbecker has joined #tripleo08:04
*** gfidente has joined #tripleo08:04
*** yolanda has joined #tripleo08:04
openstackgerritCarlos Camacho proposed openstack/tripleo-docs: Composable roles within services Tutorial  https://review.openstack.org/31151208:06
chemccamacho: he, do you have the link to the doc artifact ?08:07
ccamachochem doc, the the tutorial about composable services?08:08
chemccamacho: yeap08:08
ccamachohere: https://review.openstack.org/31151208:08
jaosoriorccamacho: How's the gnocchi patch going? is it stable for review?08:11
ccamachojaosorior, yesterday after the last update in the puppet-tripleo side I'm getting an error, but not able to figure yet the root cause, I have rebased all and now re-deploying again to see the nit.08:14
*** ohamada has joined #tripleo08:15
openstackgerritMerged openstack/tripleo-ui: Rename discovery validation to pre-deployment  https://review.openstack.org/33218208:15
ccamachoThe only line added, besides moving code is https://review.openstack.org/#/c/315527/29..33/manifests/profile/base/gnocchi.pp08:19
*** mbound has quit IRC08:19
jaosoriorccamacho: And what's the error message?08:20
*** jtomasek_ has quit IRC08:20
ccamachojaosorior ^^ the patchset #29 was deploying correctly but need to find what is happening..08:20
chemccamacho: hum, I was thinking about the generated doc08:20
ccamachothats the thing I didnt get an error, only can connect to mongodb.. So im deploying all again to see if it was a problem with my env08:21
ccamachochem this one http://docs-draft.openstack.org/12/311512/30/check/gate-tripleo-docs-docs/00787bd//doc/build/html/  :)08:21
chemccamacho: thanks :)08:22
ccamachochem np!08:22
jaosoriorccamacho: Funky seems that both time out08:24
jaosoriornon-ha times out because of the intermitent issues we saw08:24
jaosoriorso no biggie08:24
jaosoriorand ha timed out cause of keystone08:24
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Configure BlockStorage services via resource chains  https://review.openstack.org/32285808:26
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Switch Ceph Monitor/OSD/Client/External to composable roles  https://review.openstack.org/30469208:26
ccamachoyeahp, but im now checking CI now, im locally testing it as is a little bit faster. But yesterday in my undercloud I executed a "rm -rf" and the tab key was on a strike... and have executed it on the wrong folder...  ;(  Im currently finishing the undercloud deployment..08:27
ccamachojaosorior^^08:27
*** lucas-afk is now known as lucasagomes08:29
openstackgerritMerged openstack/puppet-tripleo: Add Ceph profiles  https://review.openstack.org/30467508:29
*** bootsha has quit IRC08:31
*** shivrao has quit IRC08:32
*** itamarl_ has joined #tripleo08:33
*** xinwu has quit IRC08:35
*** itamarl has quit IRC08:36
*** itamarl_ is now known as itamarl08:36
*** sambetts|afk is now known as sambetts08:36
d0ugalAnyone looking for something smallish to review? https://review.openstack.org/#/c/32261108:38
jaosoriord0ugal any idea why that's failing the gate?08:41
*** derekh has joined #tripleo08:44
jaosorioroh, there was a delorean dns switch, so if some jobs failed cause of package issues; they should be working now and can be rechecked08:46
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add upgrade ci script for CI jobs  https://review.openstack.org/33281008:46
d0ugaljaosorior: None, I don't think it can be related. This code isn't used until the related patchsets land08:49
d0ugaljaosorior: That might be it!08:49
jaosoriord0ugal: I +2ed and rechecked it08:49
d0ugaljaosorior: Thanks08:49
*** rcernin has quit IRC08:50
d0ugaljaosorior: is the DNS change why I am seeing this error locally? http://paste.openstack.org/show/521603/08:52
*** dtantsur|afk is now known as dtantsur08:59
derekhd0ugal: looks like there is another problem09:01
derekh[derekh@Tea540 toci]$ curl -s http://trunk.rdoproject.org/centos7/current-tripleo/delorean.repo | grep moved09:01
derekh<p>The document has moved <a href="http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo">here</a>.</p>09:01
derekhd0ugal: ^09:01
*** yolanda has quit IRC09:01
*** rcernin has joined #tripleo09:01
derekhsshnaidm_: gonna restart geard again, since everything is broken anyways09:01
sshnaidm_derekh, I increased fds max to 6553509:02
derekhsshnaidm_: the error just came up Jun 23 08:58:41 te-broker.novalocal geard[7822]: error: [Errno 24] Too many open files09:02
sshnaidm_derekh, oh.. maybe process should restart to adopt it09:02
d0ugalderekh: oh, fun :/09:03
derekhsshnaidm_: maybe, I'm not sure, its restarted now anyways09:03
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: UPDATE REPO FOR DELOREAN_REPO_URL  https://review.openstack.org/33319809:03
*** mgould|afk is now known as mgould09:03
derekhsshnaidm_: the only thing I've noticed is that sockets seem to be getting leaked in batches09:03
*** ramishra has quit IRC09:04
ccamachohey derekh Im hitting the tripleo.sh --repo-setup when deploying the undercloud09:04
ccamachoI have created the bug/patch ^09:04
*** ramishra has joined #tripleo09:04
sshnaidm_derekh, looked at it too, I noticed that there are batches according to socket change time: /tmp/dates1 /tmp/dates209:05
derekhsshnaidm_: e.g. if you do this later "ls -ltr /proc/5623/fd/ | less" you see a bunch of old tcp sockets with similar timestamps09:05
sshnaidm_derekh, yeah, exactly09:05
sshnaidm_derekh, although in some of this "times" it was login to system, and lsof run.. could it affect anyhow the timestamp of socket? weird09:06
ccamachojaosorio, man can you check this? https://review.openstack.org/#/c/333198 to close https://bugs.launchpad.net/tripleo/+bug/159544809:07
openstackLaunchpad bug 1595448 in tripleo "tripleo.sh --repo-setup fails when fetching delorean.repo" [Undecided,Fix committed] - Assigned to Carlos Camacho (ccamacho)09:07
ccamachojaosorior ^09:07
derekhsshnaidm_: I'm now thinking it something to do with the switch away from jenkins to zuul, that zuul (maybe when its being restarted), kills all its VM's so the gear client doesn't get a chance to close the connections09:07
derekhsshnaidm_: I think the switch happened late last week09:08
sshnaidm_derekh, yes, I noticed zuul logs in part of jobs, but part is still on jenkins09:08
*** dmk0202 has joined #tripleo09:09
sshnaidm_derekh, and how does zull it kill vm? maybe if we shutdown vm before, it will disconnect gracefully09:09
*** jaosorior has quit IRC09:11
derekhsshnaidm_: I think jenkins is gone, I'm not sure how it now works, I could be completely wrong just thinking out loud09:11
*** jaosorior has joined #tripleo09:11
sshnaidm_derekh, I'm looking on gearman, maybe there is some timeout for workers09:12
derekhsshnaidm_: ok09:12
ccamacho sshnaidm_ derekh, guys can you check this?  https://review.openstack.org/#/c/333198 to close https://bugs.launchpad.net/tripleo/+bug/159544809:12
openstackLaunchpad bug 1595448 in tripleo "tripleo.sh --repo-setup fails when fetching delorean.repo" [Undecided,Fix committed] - Assigned to Carlos Camacho (ccamacho)09:12
derekhccamacho: looking at the moment09:13
ccamachothanks man!09:13
*** Guest90309 has quit IRC09:14
*** anshul has joined #tripleo09:14
*** anshul is now known as Guest3608509:15
sshnaidm_ccamacho, does it mean https://trunk.rdoproject.org/centos7/current-tripleo/delorean.repo won't work anymore?09:16
sshnaidm_ccamacho, and we should replace it everywhere..?09:18
ccamachoIs redirecting to the other URL but curl is getting the redirect message instead the content of the new URL09:19
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-pacemaker: CI: pin specinfra to 2.59.0, xenial node, lint.  https://review.openstack.org/33283609:20
*** electrofelix has joined #tripleo09:20
openstackgerritMerged openstack/tripleo-puppet-elements: Add zaqar package to controller image  https://review.openstack.org/33063609:21
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: UPDATE REPO FOR DELOREAN_REPO_URL  https://review.openstack.org/33319809:23
ccamacho sshnaidm_ maybe in this way is less painful the change, just make curl follow the redirection09:24
*** zoliXXL is now known as zoli|mtg09:24
*** zoli|mtg is now known as zoli|mtg-afk09:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277409:25
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart: New place of current-tripleo repo  https://review.openstack.org/33320209:25
sshnaidm_ccamacho, we have it in ansible tasks also, not sure if it will work correctly09:25
ccamachothe new URL will remain, so I think is safe to change it09:27
ccamachosshnaidm_ Ill put the URL as it was without the -L option09:28
*** athomas has joined #tripleo09:30
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: UPDATE REPO FOR DELOREAN_REPO_URL  https://review.openstack.org/33319809:30
jaosoriorHey guys, I want to add a new script to the undercloud09:33
*** yamahata has quit IRC09:33
jaosoriorbut it's pretty hard to test09:33
jaosoriorsince I keep getting this error when I try to test it by packaging it first09:33
jaosoriorwith delorean-build09:33
jaosoriorDEBUG: RPM build errors:09:33
jaosoriorDEBUG: error: Installed (but unpackaged) file(s) found:09:33
sshnaidm_ccamacho, just checked, ansible doesn't follow redirect too09:33
jaosoriorDEBUG:    /usr/bin/do-haproxy-cert-update.sh09:33
jaosoriorDEBUG:     Installed (but unpackaged) file(s) found:09:33
jaosoriorDEBUG:    /usr/bin/do-haproxy-cert-update.sh09:33
jaosoriorDEBUG: Child return code was: 109:33
jaosoriorshardy, marios, derekh: Any ideas? ^^09:33
*** trozet has joined #tripleo09:34
ccamachosshnaidm_ yeahp, is safer to move https://www.redhat.com/archives/rdo-list/2016-June/msg00206.html09:34
mariosjaosorior: nop09:35
derekhjaosorior: you have a chicken and egg problem09:38
derekhjaosorior: is it the instack-undercloud package?09:39
*** _milan_ has quit IRC09:39
jaosoriorderekh: yep09:40
*** tremble has joined #tripleo09:40
*** tremble has joined #tripleo09:40
ccamachoderekh also the deps repos are going to change¿?09:40
derekhccamacho: it doesn't look like it yet at least (no redirect in place), it might be worth asking in #rdo09:41
ccamachoderekh, ack09:42
derekhjaosorior: rename the script to instack-haproxy-cert-update.sh  and it will be ok ;-)09:44
derekhjaosorior: the instack-undercloud packaging packages files named /bin/instack-*09:45
derekhjaosorior: https://github.com/rdo-packages/instack-undercloud-distgit/blob/rpm-master/instack-undercloud.spec#L5709:45
jaosoriorderekh: Awesome!09:45
derekhjaosorior: so you can change the packaging or change the patch09:45
*** dtrainor has quit IRC09:45
jaosoriorwill do09:45
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: UPDATE REPO FOR DELOREAN_REPO_URL  https://review.openstack.org/33319809:47
*** bootsha has joined #tripleo09:49
*** pcaruana has joined #tripleo09:51
*** tosky has joined #tripleo09:55
*** fragatina has quit IRC09:56
openstackgerritChris Jones proposed openstack/tripleo-heat-templates: Dump and restore galera db during major upgrades  https://review.openstack.org/32520509:56
*** masco has quit IRC09:58
bandiniguys why is https://review.openstack.org/#/c/325205/ in merge conflict with a patch that has not been merged yet?09:59
bandinimarios: any ideas ^ ?09:59
*** shardy has quit IRC10:00
mariosbandini: looking10:01
bandinimarios: thank you sir, ANJ sends regards10:01
bandiniafaict my patch is not in conflict with master ATM10:02
mariosbandini: you always go for my achilles heal man :(10:02
*** coolsvap has quit IRC10:02
bandinirotfl10:02
mariosbandini: so why you think it is merge conflicting with what now?10:02
*** gus has left #tripleo10:02
bandinimarios: well jenkins is telling me there is a merge conflict and it only points to your unmerged review10:03
bandinimarios: Ng and I just tried and my patch applies cleanly to master10:03
*** coolsvap has joined #tripleo10:03
mariosbandini: where is it pointing (sry, can't see , or do you mean, when trying to rebase locally to deal with the conflict?)10:04
*** trozet has quit IRC10:04
mariosbandini: can't se any of my review in shortlog https://review.openstack.org/gitweb?p=openstack/tripleo-heat-templates.git;a=shortlog;h=ca642b8fb7a6a0f5cb09c25d4470e10c417e00ae10:04
Ngrebasing locally works fine, but jenkins insists that the patch has a merge conflict10:05
bandinimarios: so here https://review.openstack.org/#/c/325205/ it is pointing (on the right side to your rework pacemaker change https://review.openstack.org/#/c/321027/13)10:05
mariosNg: ack i see that was wondering where10:06
derekhbandini: marios Ng Depends-On: If85672afa8a92de2a1c0a222d28682fd100bcf7d10:06
*** limao_ has quit IRC10:06
mariosbandini: OH. you mean the bit where it says "Conflicts With"10:06
* marios palmface10:06
Ngoho!10:06
mariosbandini: so that part afaik10:06
derekhbandini: marios Ng its abandoned10:06
mariosbandini: is just a warning10:06
mariosbandini: there is indeed a merged conflict with something that landed10:06
Ngand there's a lesson for us all, always scroll through the patch commit message :)10:06
mariosbandini: and *that* will reveal itself only when you rebase10:06
bandiniderekh: HA!10:07
mariosbandini: what's abandoned10:07
bandinimarios: I think the issue is what derekh mentioned10:07
bandinisome depends-on10:07
*** zaneb has joined #tripleo10:07
bandiniderekh: thanks let me try looking into that10:07
mariosderekh: ack10:07
derekhmarios: the patch is depending on one that has been abandoned10:07
bandinimarios: thanks man!10:07
mariosbandini: yeah so the 'conflicts with' on the gerrit page is warning anyway10:07
mariosbandini: it isn't the actual conflict10:07
bandinimarios: yeah, the constant conflict got me totally confused10:08
mariosbandini: more like, watch out this person is also scheming to change this file10:08
bandinimarios: sorry for the noise10:08
derekhyup, that conflicts with message is just a warning about something that would happen if the patch merged10:08
bandiniderekh: would the be a way to get more details about the error line "failed merge" ?10:08
bandinis/the/there/10:08
derekhits a challenge to merge your patch before theirs10:09
derekhbandini: maybe, none that I know of.10:09
bandiniderekh: ack, in any case I learned something. Thanks again10:09
derekhbandini: #infra might have some ideas,10:10
derekhbandini: I just stare at it really hard without blinking10:10
bandiniderekh: lol :)10:11
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Dump and restore galera db during major upgrades  https://review.openstack.org/32520510:11
*** numans has quit IRC10:11
*** itamarl has quit IRC10:12
*** zaneb has quit IRC10:16
*** mburned is now known as mburned_out10:16
*** dtantsur is now known as dtantsur|bbl10:17
*** masco has joined #tripleo10:18
*** akrivoka has joined #tripleo10:23
*** numans has joined #tripleo10:24
*** shardy has joined #tripleo10:24
*** itamarl has joined #tripleo10:25
*** zoli|mtg-afk is now known as zoli|lunch10:27
*** dmk0202 has quit IRC10:29
*** thrash|g0ne is now known as thrash10:31
*** bootsha has quit IRC10:37
*** milan has joined #tripleo10:39
*** akrivoka has quit IRC10:40
*** ramishra has quit IRC10:41
*** ramishra has joined #tripleo10:41
*** bootsha has joined #tripleo10:41
*** coolsvap has quit IRC10:42
pandais the redirect to http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo permanent ?10:43
*** coolsvap has joined #tripleo10:44
*** jpeeler has quit IRC10:44
jaosoriorhey guys10:48
jaosoriordoes TripleO still have the concept of hardware profiles?10:48
*** hewbrocca-afk is now known as hewbrocca10:51
*** derekh has quit IRC10:53
*** mburned_out is now known as mburned10:54
jaosoriorAnd10:54
jaosoriordoes anybody know how is the SELinux policy handled in the undercloud and the overcloud nodes?10:54
*** jistr is now known as jistr|mtg10:56
ccamachohey derekh, Im manually testing the deployment with the new repos, but now i'm getting this issue: http://paste.openstack.org/show/521649/   puppet-tuskar and puppet-qpid not found in the repos..10:58
*** coolsvap has quit IRC10:58
d0ugalTuskar!11:00
*** coolsvap has joined #tripleo11:00
*** dtantsur|bbl is now known as dtantsur11:03
ccamachod0ugal I remember some time ago speaking on #tripleo about tuskar, but... cant remember :(11:03
d0ugalccamacho: heh, yeah, we don't use Tuskar anymore - so I assume that package can be removed11:05
d0ugalbut I guess it depends what release you are testing.11:05
*** akrivoka has joined #tripleo11:05
ccamachoIm deploying master11:05
ccamachod0ugal ^11:05
d0ugalYeah, then you shouldn't need it. I guess it is probably just referenced somewhere11:05
dtantsurhi folks, is CI broken?11:06
dtantsurI see http://logs.openstack.org/97/319297/6/check-tripleo/gate-tripleo-ci-centos-7-nonha/3b49661/console.html#_2016-06-23_10_03_40_63626911:06
ccamachodtantsur yeahp https://bugs.launchpad.net/tripleo/+bug/159544811:07
openstackLaunchpad bug 1595448 in tripleo "tripleo.sh --repo-setup fails when fetching delorean.repo" [Undecided,Fix committed] - Assigned to Carlos Camacho (ccamacho)11:07
ccamachodtantsur, but Im manually testing it and now after fixing the URLs Im getting this  http://paste.openstack.org/show/521649/   puppet-tuskar and puppet-qpid not found in the repos..11:08
dtantsurmeh..11:08
dtantsurok, thanks for tracking it11:08
*** sshnaidm_ is now known as sshnaidm11:11
*** masco has quit IRC11:12
*** masco has joined #tripleo11:12
ccamachodtantsur, just executing these manual steps..: https://gist.github.com/ccamacho/8ed8c144417efd87b611d93db047a904  They used to work..11:12
*** pkovar has joined #tripleo11:17
*** lucasagomes is now known as lucas-hungry11:19
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277411:20
*** bfournie has joined #tripleo11:21
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277411:25
*** rasca has quit IRC11:25
*** bfournie has quit IRC11:26
*** rasca has joined #tripleo11:26
*** dmk0202 has joined #tripleo11:33
jaosoriorderekh: I'm trying to add a new element for the undercloud (will probably do something similar for the overcloud)11:33
jaosoriorcan you check this out? https://review.openstack.org/#/c/332774/11:34
*** panda has quit IRC11:34
jaosoriorfor some reason the new element doesn't seem to get run11:35
*** panda has joined #tripleo11:35
jaosoriorshardy, ^^?11:41
*** fragatina has joined #tripleo11:43
bandinimarios: ahahah brilliant ;)11:43
jaosoriormarios: Are you acquainted with dib?11:44
*** zoli|lunch is now known as zoli11:49
*** rhallisey has joined #tripleo11:49
rookhey shadower - the validations, it seems that the migration of clapper validations haven't landed in the openstack repo yet - are you guys planning on moving things over?11:50
*** jpena is now known as jpena|lunch11:50
mariosjaosorior: some but it has been a while... depends what you're after11:51
shadowerrook: yeah. Thing is, it's just mandre and myself atm and neither can land things. And the cores are busy with other stuff11:51
shadowerrook: we should get core right to that repo soon but it hasn't happened yet11:51
jaosoriormarios: I'm trying to add a new element to the undercloud11:51
rookahhh, shadower - could someone from infra help with that?11:51
jaosoriorand I tried doing so like this https://review.openstack.org/#/c/332774/ but it doesn't seem to get ran11:52
*** masco is now known as masco_afk11:52
shadowerrook: shardy said he was going to do it but I think he's stuck in meetings this week11:52
mariosjaosorior: looking11:53
*** coolsvap_ has joined #tripleo11:53
rookshadower roger.11:53
*** coolsvap has quit IRC11:53
*** weshay has joined #tripleo11:54
slaglejaosorior: you would need to add that element name to the json file under json-files11:56
slaglejaosorior: i left you a review though, i think we can do this without a new element11:56
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Convert swift storage to composable services  https://review.openstack.org/32058011:56
slaglewe are trying to move away from the elements for the undercloud install11:56
mariosjaosorior: ok will have a closer look later but afaics (in terms of adding the element ) should be ok but you are missing pkg-map or did i miss it... looking more11:57
*** coolsvap has joined #tripleo11:57
*** rhallisey has quit IRC11:57
jaosoriorslagle: If we can do this without an element that would be great11:58
*** rhallisey has joined #tripleo11:58
*** coolsvap_ has quit IRC11:58
jaosorioronly thing I actually need is to set the selinux policy11:58
jaosoriorfor it to allow certmonger to restart haproxy11:58
jaosoriorthat's it11:58
slaglejaosorior: i think we can get that added to openstack-selinux11:58
slaglecheck with rhallisey11:58
jaosorioris he around?11:59
rhalliseyhi11:59
slaglehey11:59
rhalliseyjaosorior, do you have some AVC's ?11:59
rhalliseyslagle, hey :)11:59
slaglethis is the policy, https://review.openstack.org/#/c/332774/15/elements/certmonger/selinux/certmonger-post.te11:59
rhalliseykk12:00
jaosoriorrhallisey: I actually will end up needing something similar for the overcloud, but besdies haproxy it will be for every openstack service12:00
jaosoriorcertmonger needs to be able to restart them12:00
*** dprince has joined #tripleo12:01
jaosoriorslagle, if you have time can you check these two https://review.openstack.org/#/c/333121 https://review.openstack.org/#/c/333150 ?12:02
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add third party gating to quickstart  https://review.openstack.org/33222312:02
rhalliseyjaosorior, sure I can add for every service12:02
jaosoriorslagle: CI is currently broken, that's why it's marked as fail in those patches. But I've been deploying using those, and it's working.12:03
slaglejaosorior: k, looking now12:03
*** lucas-hungry is now known as lucas-afk12:04
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud: Use certmonger for automatic cert generation  https://review.openstack.org/33277412:05
sshnaidmccamacho, is this url also should be changed? I don't see it in the mail. https://trunk.rdoproject.org/centos7/current/12:05
*** fragatina has quit IRC12:07
*** zenghui has quit IRC12:08
ccamachosshnaidm I havent changed it, in #rdo are checking the repos status12:08
*** coolsvap has quit IRC12:08
*** numans has quit IRC12:09
*** zoli is now known as zoli|mtg12:10
*** sshnaidm has quit IRC12:14
rookdtantsur is there a mechanism in place were once IPA finishes writing the overcloud image to disk, it reports the time it took?12:16
jaosoriorrhallisey: Thanks dude12:16
*** sshnaidm has joined #tripleo12:18
*** ramishra has quit IRC12:19
rhalliseyjaosorior, no problem. Do you happen to have any AVCs for the any of the services?12:19
EmilienMhello12:21
*** jcoufal has joined #tripleo12:21
*** pradk has joined #tripleo12:21
*** fragatina has joined #tripleo12:22
jaosoriorrhallisey: Not yet, I have been running it in permissive mode. I will pass you the AVCs once I have them12:22
jaosoriorprobably in two or three weeks :P12:22
jaosoriortoday is my last day before vacations12:22
jaosorior:D12:22
rhalliseyjaosorior, that would be fantasic12:22
rhalliseyok :)12:22
*** liverpooler has quit IRC12:22
*** masco_afk has quit IRC12:24
jaosoriorEmilienM: Yo dude, how's it going?12:24
rhalliseyjaosorior, I cc'd you on the bug.  We'll track everything there12:24
EmilienMjaosorior: good, CI was broken last night again12:25
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Revert "Pin puppet-lint-absolute_classname-check to 0.1.3"  https://review.openstack.org/33331212:25
EmilienMjaosorior: but I fixed it12:25
EmilienMjaosorior: see https://review.openstack.org/333312 for context12:25
EmilienMI had to patch tht, puppet-tripleo and instack-undercloud to pin a gem, and +2 +A myself so other patches can work12:25
jaosoriorEmilienM: CI is broken again :(12:25
jaosoriorbut this time is an RDO issue12:26
karthiksFor tripleo SR-IOV , if I need to add another filter "PciPassthroughFilter" to scheduler_default_filters in nova.conf,12:26
karthiksWhat is the preferred approach ?12:26
karthiksIs changing via environment.yaml a good way to change12:26
karthiksExtraConfig:12:26
karthiks     nova::scheduler::filter::scheduler_default_filters:12:26
karthiksor I need to take a parameter from environment.yaml and populate the hieradata.12:26
EmilienMjaosorior: damn12:26
jaosoriorrhallisey: Alright. Here the issue is that certmonger tries to restart Haproxy, and it gets blocked12:26
EmilienMjaosorior: someone is on it?12:26
jaosoriorEmilienM: ccamacho is checking it out12:26
*** jcoufal_ has joined #tripleo12:26
karthiksdprince,  ^^^12:27
EmilienMjaosorior: what is broken exactly?12:27
jaosoriorrhallisey: I see the bug now. Thanks dude12:27
EmilienMccamacho: ^12:27
rhalliseyjaosorior, I can write the policy for all the service, but I hold onto the AVCs so there's no regressions12:27
karthiksshardy, ^^^12:27
rhalliseyI really only need 1 of the AVCs12:27
rhalliseybut all would be nice too12:28
ccamachojaosorior, EmilienM yeahp, https://bugs.launchpad.net/tripleo/+bug/1595448 but after fixing it now im hitting http://paste.openstack.org/show/521649/   puppet-tuskar and puppet-qpid not found. Tuskar should not be installed, Im folowing these steps BTW https://gist.github.com/ccamacho/8ed8c144417efd87b611d93db047a904 On RDO are checking the repo status12:28
openstackLaunchpad bug 1595448 in tripleo "tripleo.sh --repo-setup fails when fetching delorean.repo" [Undecided,Fix committed] - Assigned to Carlos Camacho (ccamacho)12:28
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: DNM - HA job testing with 332440  https://review.openstack.org/33244112:29
*** myoung has joined #tripleo12:29
EmilienMdprince: I think I finally tracked down the keystone issue that we had on HA job: https://review.openstack.org/#/c/332440/12:29
*** jcoufal has quit IRC12:29
EmilienMdprince: we should not have this one anymore12:29
EmilienMccamacho: is it fixed now?12:30
*** ramishra has joined #tripleo12:30
dprinceEmilienM: nice :)12:30
dprincenow we just gotta keep the RDO package repos running and maybe our CI will work!12:31
EmilienMlol maybe12:31
ccamachoEmilienM I proposed the fix for the repo issue, but then we are hitting a dependency issue that should not exist12:31
dprincekarthiks: extradata may be okay as an initial go but the extradata interfaces get clunky when you want to use more than one at a time12:32
dprincekarthiks: do you have a patch, example I can look at?12:33
dprincekarthiks: if you are using composable services this might just be as simple as adding an extra hiera key/value12:33
ccamachoEmilienM https://review.openstack.org/#/c/333198 here are patched the URL repos, and the tripleo.sh --repo-setup ends fine, but when executing "sudo yum install -y instack-undercloud" you will have the deps issue12:33
karthiksdprince, I can put the patch soon if you'd like12:34
*** trown|outtypewww is now known as trown12:34
jaosoriorrhallisey: something like this? http://paste.openstack.org/show/521664/12:35
EmilienMccamacho: why do we change the repo?12:35
EmilienMccamacho: ok it moved12:36
*** masco_afk has joined #tripleo12:36
rhalliseyjaosorior, yes thanks12:37
karthiksdprince,  when we take it as parameter, I need to provide a default value which I am not aware at this point12:38
jaosoriorrhallisey: This is for haproxy http://paste.openstack.org/show/521667/12:41
trownsshnaidm: can you point me to logs for tripleo periodic job? RDO promoted yesterday, so TripleO should have passed this morning12:41
*** ramishra has quit IRC12:41
*** ccamacho is now known as ccamacho|lunch12:42
sshnaidmtrown, which one periodic job..?12:42
*** jpena|lunch is now known as jpena12:43
sshnaidmtrown, we have about 6: http://status-tripleoci.rhcloud.com/12:44
trownsshnaidm: the tripleo periodic jobs for promotion12:44
trownsshnaidm: perfect thanks12:45
sshnaidmtrown, I see all these failed..12:45
*** pradk has quit IRC12:46
*** jayg|g0n3 is now known as jayg12:46
trownhttp://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-nonha/a9a98a1/logs/undercloud/var/log/image_build.txt.gz looks like a problem with tripleo.sh image building12:47
openstackgerritDan Prince proposed openstack/puppet-tripleo: Add new midonet_agent profile.  https://review.openstack.org/33331912:49
rhalliseyjaosorior, why is it that certmonger is restarting services?  Just want to understand what's happening here12:50
openstackgerritMerged openstack/tripleo-puppet-elements: Fix typo in package name python-cradox  https://review.openstack.org/33301512:51
jaosoriorrhallisey: certmonger is in charge of keeping track, asking for and renewing certificates. Whenever a certificate is renewed, we need to reload or restart the service.12:51
jaosoriorwith httpd we can actually do reloads with systemd, but with most openstack services that's not possible12:51
*** fragatina has quit IRC12:51
jaosoriorIf the service is not restarted it will keep serving the old certificate, which might have been expired or revoked. And this is a problem.12:52
*** rlandy has joined #tripleo12:52
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Move --builder next to the other args in the image_group.  https://review.openstack.org/33332412:52
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Default ceph_osd_selinux_permissive to false  https://review.openstack.org/33332612:53
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Improve --help output of quickstart.sh  https://review.openstack.org/33279612:53
*** masco_afk is now known as masco12:53
gfidenteso CI is broken :(12:54
rhalliseyjaosorior, thanks12:54
*** masco has quit IRC12:59
d0ugalgfidente: aye, that it is13:00
gfidentehey d0ugal :)13:00
d0ugalgfidente: Afternoon!13:00
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Properly direct MTU parameters and allow service defaults  https://review.openstack.org/33333313:00
dtantsurrook, no, there is no such thing13:01
*** bootsha has quit IRC13:01
*** zoli|mtg is now known as zoli13:02
*** shardy has quit IRC13:03
*** cdearborn has joined #tripleo13:03
*** fragatina has joined #tripleo13:05
*** bfournie has joined #tripleo13:05
*** tzumainn has joined #tripleo13:14
EmilienMdprince, jaosorior: please review https://review.openstack.org/#/c/333312/13:17
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Revert "Pin puppet-lint-absolute_classname-check to 0.1.3"  https://review.openstack.org/33334913:19
chemEmilienM: puppet-tripleo is not affected, but there are still some rough edge with it, see https://github.com/voxpupuli/puppet-lint-absolute_classname-check/issues/913:20
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci: Ammend the current-tripleo repo to point to centos.org rdo-trunk  https://review.openstack.org/33335113:21
EmilienMchem: in our puppet openstack modules you think?13:21
rhalliseyjaosorior, think you might have found a base policy bug13:21
rhallisey:)13:22
EmilienMchem: we need https://github.com/voxpupuli/puppet-lint-absolute_classname-check/pull/1013:22
chemEmilienM: if any create_resources or the other form documented in the bug appears you will have a lint failure13:22
chemEmilienM: yep, this one correct part of the forms exposed there13:23
chemEmilienM: let's say it fixes them all, at least all the cases I encoutered this morning :)13:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: UPDATE REPO FOR DELOREAN_REPO_URL  https://review.openstack.org/33319813:24
EmilienMchem: we'll see if last release fixed tripleo repos13:24
EmilienMjpena: done ^13:24
chemEmilienM: for tripleo it's ok13:24
EmilienMk13:24
EmilienMchem: this is a disaster, they don't have CI or what?13:25
chemEmilienM: they have added the test with the commit... won't happen again :)13:25
chemEmilienM: CI is not nice those last days ...13:25
EmilienMchem: of course. (lol)13:25
*** akshai has joined #tripleo13:25
EmilienMnope, and it's slowing a lot of things down13:25
chemEmilienM: anyway 0.2.3 will be release soon13:26
EmilienMchem: cool13:26
chemEmilienM: and to be faire from the release number, you can't expect rock solide stability, let's wait for 1.0.0 before being hard :)13:27
chems/faire/fair/13:27
*** coolsvap has joined #tripleo13:29
*** dmacpher has joined #tripleo13:30
*** dmacpher_ has joined #tripleo13:30
*** dmacpher_ has quit IRC13:30
*** oshvartz has quit IRC13:31
mariostrown: hey man, how do i make a new build of openstack-puppet-modules hapen for/in http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo// - i filed a bug for tracking as i figured it may be useful info to have written for someone else to find https://bugs.launchpad.net/tripleo/+bug/159554113:31
openstackLaunchpad bug 1595541 in tripleo "tracking bug for new build of openstack-puppet-modules into http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo please" [Medium,Triaged] - Assigned to Marios Andreou (marios-b)13:31
*** jistr|mtg is now known as jistr13:31
mariosor possibly EmilienM if you know/have time ^^13:31
EmilienMmarios: that's what we're discussing for the last hour on #rdo13:32
EmilienMmarios: and ccamacho|lunch is already on it with https://review.openstack.org/#/c/333198/13:32
mariosEmilienM: hah, ok thx13:32
EmilienMmarios: are you on #rdo?13:32
marioslooking13:32
trownmarios: openstack-puppet-modules is no longer a real package, but just a meta-package that "Requires:" all the individual puppet-* packages13:33
*** ccamacho|lunch is now known as ccamacho13:33
mariosah sorry ccamacho|lunch i missed the review, i will abandon my one.13:33
trownmarios: but the root issue there is being worked on in #rdo13:33
mariosEmilienM: but doesn't answer the version thing though ... ack trown thanks13:33
mariosEmilienM: i mostly filed that bug for the 'get new version '13:34
*** yolanda has joined #tripleo13:34
EmilienMmarios: get new version is done by delorean13:34
*** zoli is now known as zoli|afk13:35
trownya, and really old version got there because of some moving around of infra in RDO that did not go smoothly this morning13:35
trownshould be fixed soon, if not already13:35
EmilienMtrown: just an fyi, puppet did promotion last night, it worked13:36
trownEmilienM: ya we luckily got RDO promotion last night too before this morning's shennanigans13:37
*** jpeeler has joined #tripleo13:37
EmilienMcool13:37
trownEmilienM: I think the fake periodic job for tripleoci doesnt work anymore, but not sure who would be able to look besides derek13:37
trownit is running gate jobs instead of periodic13:38
trownreal periodic job failed in a way that I suspect would fail for all gates that dont use pre-cached images as well... http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-nonha/a9a98a1/logs/undercloud/var/log/image_build.txt.gz13:39
*** lblanchard has joined #tripleo13:39
EmilienMtrown: I can look at it13:41
EmilienMtrown: I noticed puppet periodic job does not work either maybe some infra thing13:41
EmilienMtrown: let me dig a minut13:41
EmilienMhttp://logs.openstack.org/periodic/propose-puppet-openstack-rdo-promote/726367c/console.html#_2016-06-23_08_35_08_71591313:42
trownthanks13:42
EmilienMyeah have asomething wrong here13:42
EmilienMI'll try to reproduce13:42
EmilienMtrown: https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/propose_rdo_promote.sh#L3413:43
EmilienMtrown: something went wrong when getting latest consistent URL13:44
*** gfidente is now known as gfidente|afk13:44
EmilienMtrown: I tested our script locally, it's working. I suspect it's related to RDO things that we had before13:46
EmilienMtrown: I'll look periodic jobs tomorrow13:46
EmilienMtrown: now, looking why OOO periodic jobs fail13:46
trownya, the fake periodic job: https://review.openstack.org/#/c/229789/54 doesnt even run the periodic jobs anymore... not sure what happened there13:47
slagleEmilienM: hey, so i'm testing your nova compute patch with an aio overcloud13:47
slagleEmilienM: i see this in the puppet log:13:47
slagleNotice: /Stage[main]/Nova::Compute/Nova::Generic_service[compute]/Service[nova-compute]/ensure: ensure changed 'stopped' to 'running'13:47
slaglebut despite that, openstack-nova-compute was never attempted to be started13:48
slagleany idea what to check?13:48
*** egafford has joined #tripleo13:48
*** coolsvap has quit IRC13:49
EmilienMslagle: can I see the full catalog?13:49
*** ramishra has joined #tripleo13:49
slagleEmilienM: how do i get that?13:49
EmilienMslagle: can you paste /var/log/messages?13:50
*** coolsvap has joined #tripleo13:50
*** Guest36085 has quit IRC13:51
EmilienMtrown: I don't know enough now to help, probably derek13:51
EmilienMslagle: also, what are you testing exactly? the compute stuff is *really* wip13:51
EmilienMtrown: can you land https://review.openstack.org/#/c/333312/ please?13:52
slagleEmilienM: https://fedorapeople.org/~slagle/messages13:53
EmilienMslagle: /me looking13:53
slagleEmilienM: ok, so what i did was pull down this patch: https://review.openstack.org/#/c/32968613:53
slagleand then added OS::TripleO::Services::NovaCompute and NovaLibvirt to ControllerServices13:54
slagleand deployed with --compute-scale 013:54
trownEmilienM: without CI? is there some critical issue that resolves?13:54
EmilienMslagle: also, nova-compute.log please13:54
EmilienMtrown: it's a Gem fix, nothing with functional jobs13:54
slagleEmilienM: there is none, b/c it never started13:54
EmilienMslagle: ok. what happens when you start it manually?13:55
slaglehaven't tried, but i will :)13:55
EmilienMslagle: let me dig logs13:55
trownEmilienM: oh right... that makes sense :)13:55
*** liverpooler has joined #tripleo13:55
slagleEmilienM: it starts manually fine13:55
EmilienMslagle: but I'm sure we're missing hieradata things (something I haven't moved much until now, I'm focusing on moving puppet code first)13:56
EmilienMslagle: mhh k13:56
*** yolanda has quit IRC13:56
slagleEmilienM: ok, np. i know i'm running ahead here a bit :)13:56
EmilienMslagle: do you have logs once it starts?13:56
slagleyea there's a nova-compute.log now13:56
EmilienMslagle: can you check now if process is still running?13:56
EmilienMmhh13:56
EmilienMstrange13:56
*** pradk has joined #tripleo13:57
EmilienMslagle: oh and also fyi, I have a dep in puppet-nova and puppet-openstacklib that you need in tripleo too13:57
*** bootsha has joined #tripleo13:57
EmilienMand they are not landed yet13:57
EmilienMso https://review.openstack.org/#/c/329686 is not enought to make the thing work13:58
EmilienMthough I don't understand why nova compute does not start with puppet but does manually :/13:58
slagledo i need this as well? https://review.openstack.org/#/c/330172/13:58
slaglei may have overlooked that13:58
EmilienMyes13:58
slaglei thought when i checked yesterday the depends on were merged13:59
EmilienMslagle: and https://review.openstack.org/#/c/331229/13:59
EmilienMnope13:59
EmilienMour CI is currently in bad shape13:59
slagleok, my bad13:59
slaglelet me pull these and try13:59
EmilienMwe are not merging much patches lately :(13:59
EmilienMslagle: I'm not sure it will really help though13:59
slaglealright, np. i dont want to distract you too much with this14:00
slaglei'll keep looking at it14:00
openstackgerritSanjay Upadhyay proposed openstack/tripleo-specs: tripleo-sriov  https://review.openstack.org/31387214:00
EmilienMslagle: your feedback is cool but I suspect this is a bit too early14:01
EmilienMbut I'm working on it14:01
*** bootsha has quit IRC14:02
EmilienMslagle: when it'll work, I'll probably have the tatoo in place14:02
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: First iteration of libvirt and nova-compute as a composable services  https://review.openstack.org/32968614:03
* slagle can't wait to see what "place" you pick14:03
EmilienMslagle: a place where my gf can't see it, she'll kill me otherwise.14:04
EmilienMit was a bad idea to explain what tripleo is to her14:04
*** zoli|afk is now known as zoli14:04
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: compute: deploy composable neutron service  https://review.openstack.org/33123414:05
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: compute: moving out iscsi bits, now in puppet-tripleo  https://review.openstack.org/33124714:05
*** ebalduf has joined #tripleo14:05
slagleshe might get jealous of the owl14:06
EmilienMlol14:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Ceilometer Compute Agent composable service  https://review.openstack.org/33180214:07
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Implement Ceilometer Polling Agent service  https://review.openstack.org/33248314:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: services/ceilometer: switch to polling agent  https://review.openstack.org/33250414:08
openstackgerritMerged openstack/puppet-tripleo: Revert "Pin puppet-lint-absolute_classname-check to 0.1.3"  https://review.openstack.org/33331214:08
*** shardy has joined #tripleo14:09
rookdtantsur can you share the IPA repo with me, curious how hard it would be to implement something like that14:09
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart: Add option to enable pacamaker on overcloud  https://review.openstack.org/33336814:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Convert SNMP configuration to composable services format  https://review.openstack.org/32059714:10
trownohh... tripleowl tattoos? Im down14:11
EmilienMtrown: i found one guy in my street who can make it14:11
rooktrown yeah, the owls are pretty sweet.14:11
EmilienMtrown: I'll probably go tomorrow or this WE14:11
EmilienMtrown: the fun story is that's because a losing bet with slagle14:12
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: UPDATE REPO FOR DELOREAN_REPO_URL  https://review.openstack.org/33319814:12
EmilienMI'll never bet with him anymore14:12
trownhehe, what was the other side of that bet? slagle getting a tripleowl tattoo?14:12
EmilienMI actually can recall14:13
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart: Enable devmode with a single option  https://review.openstack.org/33216314:14
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart: Tempest builder for jobs  https://review.openstack.org/33270814:14
rooktrown maybe you might know... wrt to the overcloud image, can you point me to where the overcloud image writes to disk? ie - user deploys, image is pxed and starts to write oc image to disk...14:15
rookpoint to it in code (github link)14:16
dtantsurrook, https://github.com/openstack/ironic-python-agent talk to JayF on #openstack-ironic, he was thinking about having various metrics in ironic too14:17
trownrook: I think https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/deploy_utils.py#L381 is where things get going14:18
rookahhh that makes more sense now...14:19
rookmy dumbass was looking in tripleo14:19
rookthanks guys14:19
rookIPA== ironic-python-agent... duh14:19
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo: Implement aodh profiles  https://review.openstack.org/33285414:19
trowni have started spelling it i-p-a, because IPA is already a thing14:19
rookand it tastes great.14:20
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-pacemaker: CI: pin specinfra, xenial node, lint, puppet bug.  https://review.openstack.org/33283614:21
openstackgerritMerged openstack/tripleo-ui: Fixes IronicApiService.deleteNode  https://review.openstack.org/33315414:23
openstackgerritDimitri Savineau proposed openstack/tripleo-heat-templates: Allow neutron_options customization for dashboard  https://review.openstack.org/26022614:27
jaosoriorHey guys14:30
jaosoriorI'm about to go on vacations14:30
jaosoriorif anybody has time to shepperd these patches in my absense14:30
jaosoriorat least keep them in sync14:31
jaosoriorhttps://review.openstack.org/#/q/status:open+topic:bp/tls-via-certmonger14:31
jaosoriorI would really appreciate it14:31
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Properly direct MTU parameters and allow service defaults  https://review.openstack.org/33333314:31
ccamachojaosorior, sure man added a postit14:36
jaosoriorccamacho: Thanks man, I appreciate it14:36
ccamachonp14:36
*** ayoung has quit IRC14:37
*** jistr is now known as jistr|mtg14:38
*** jefrite has joined #tripleo14:38
*** pblaho has quit IRC14:38
EmilienMjaosorior: cool, I'll review it also14:38
EmilienMjaosorior: you visiting me or?14:38
rookbeagles yo regarding https://review.openstack.org/#/c/333333/2/puppet/compute.yaml any reason the move from number -> str?14:39
rookthat is my only comment I will make, everything else looks good14:39
jaosoriorEmilienM: haha maybe on my next trip. This time it's Mexico14:39
rookbeagles: is it because we are going with '' ?14:39
beaglesI did that because I wanted a way to indicate a default of "unset"14:39
beaglesyeah14:39
beaglesso '' == I don't want to set this14:40
EmilienMjaosorior: /me sad panda14:40
jaosoriorhahaha14:40
beaglesrook: that's the only reason really...14:40
rookmakes sense... thanks beagles.14:40
beaglesrook: what's funny is IIRC it was inconsisent across compute/controller14:41
pandaok, I give up, I'll probably change nick ..14:41
*** links has quit IRC14:41
beaglesrook: btw, can you think of any negative repercussions for unwiring the mtu setting on the compute node that I'm not thinking of?14:41
*** pcaruana has quit IRC14:41
beaglesrook: it seems to me we should be way beyond the point that we need to do anything with respect to the nova configuration14:42
rookbeagles: not tracking -- what do you mean?14:42
*** jrist has quit IRC14:43
rookbeagles i would suggest these changes are _only_ for Mitaka+14:43
rookanything before mitaka should set some of these changes.14:43
rookbeagles ie, setting dnsmasq to be 145014:43
beaglesrook: ah good point14:44
rookbeagles because w/ mitaka the default bm MTU is set to 1500, so by magic, neutron will use a 1450 (automatically remove 50 from MTU).14:44
beaglesrook: yup14:45
beaglesrook: I was referring to removing nova::compute::network_device_mtu. Scanning code (and reconciling how I thought it worked) if Nova needs to do something with MTU info, it gets it from the VIF.14:46
beaglesrook: VIF details/info that is14:46
EmilienMjaosorior, trown: same for https://review.openstack.org/#/c/333349/ please14:47
*** noslzzp has quit IRC14:49
*** noslzzp has joined #tripleo14:50
*** ramishra has quit IRC14:51
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: Revert "Pin puppet-lint-absolute_classname-check to 0.1.3"  https://review.openstack.org/33334714:52
*** coolsvap has quit IRC14:52
openstackgerritDan Prince proposed openstack/puppet-tripleo: Add new midonet_agent profile.  https://review.openstack.org/33331914:52
EmilienMdprince: ok I was about working on it today ^14:52
EmilienMdprince: can we create a agent dir instead?14:52
EmilienMlike plugins14:53
jaosorior+alright guys, I'm off14:53
jaosoriorsee you later!14:53
EmilienMjaosorior: enjoy14:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable midonet for neutron  https://review.openstack.org/33338714:53
*** jaosorior has quit IRC14:53
EmilienMdprince: like  tripleo::profile::base::neutron::agents::midonet14:53
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable midonet for neutron  https://review.openstack.org/33338714:54
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-pacemaker: CI: specinfra, xenial, lint, puppet bug.  https://review.openstack.org/33283614:54
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable midonet for neutron  https://review.openstack.org/33338714:54
dprinceEmilienM: I'm not sure we need it14:55
dprinceEmilienM: not many vendors have this requirement I think14:55
*** coolsvap has joined #tripleo14:55
*** tbonds has joined #tripleo14:55
dprinceEmilienM: agent is a bit overloaded too... like the midonet agent is different than DHCP, OVS, and metadata14:55
*** jrist has joined #tripleo14:55
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable midonet for neutron  https://review.openstack.org/33338714:56
EmilienMdprince: yes we need it14:57
EmilienMdprince: it's still an agent14:57
EmilienMdprince: look puppet-neutron14:57
rookyeah beagles i think it is safe for mitaka+.. Before mitaka, maybe not so much.14:57
EmilienMdprince: we have metadata agent, but also bigswitch agent, etc... they are agents, let's use the right namespace14:57
beaglesrook: agreed - I'll add text to the descriptions14:58
dprinceEmilienM: agents are very different things14:58
rookroger. thanks beagles14:58
EmilienMdprince: are we arging about names again? :)14:59
* social calls agent smith14:59
EmilienMdprince: we have agents/plugins in puppet-neutron, let's make it consistent14:59
*** shardy has quit IRC14:59
EmilienMdprince: I was about to do it for biswitch too15:00
EmilienMthey also have an agent15:00
*** xinwu has joined #tripleo15:01
openstackgerritMerged openstack/tripleo-heat-templates: Revert "Pin puppet-lint-absolute_classname-check to 0.1.3"  https://review.openstack.org/33334915:02
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: neutron/plugins/ml2/bigswitch: do not require agent  https://review.openstack.org/33339815:03
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: Remove base/neutron/ml2.pp  https://review.openstack.org/33287015:05
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: neutron plugins: include neutron base  https://review.openstack.org/33289715:05
EmilienMdprince: also, please make sure you're aware about my WIP ^ please15:05
dprincewhich WIP15:05
*** pblaho has joined #tripleo15:05
EmilienMdprince: I'm also working on these bits lately15:05
*** fragatina has quit IRC15:06
EmilienMdprince: refactoring neutron bits, for compute nodes15:06
dprinceEmilienM: I'm doing the midonet agent now, which will help compute directly too15:06
EmilienMdprince: right, but it depends on things that depends on things. If you want to take it go ahead15:06
EmilienMI just say, we might conflict somewhere15:06
dprinceEmilienM: I was trying to clean on the controller first15:06
EmilienMdprince: like you had a opinion with Libvirt thing, I have mine about the agent class, please change your patch15:06
dprinceEmilienM: then compute should be easier15:06
EmilienMI want to see all agents in agent directory15:07
EmilienMinstead of calling midonet_agent, make is agents::midonet15:07
dprinceEmilienM: well... my libvirt naming thing was a bit cleaner I think. We can go with agents only because puppet-neutron does it I think too15:07
*** ramishra has joined #tripleo15:08
EmilienMthx, go for it15:08
*** shardy has joined #tripleo15:08
*** ebarrera has quit IRC15:08
openstackgerritMerged openstack/tripleo-quickstart: move release var from positional to an argument  https://review.openstack.org/33009115:09
openstackgerritDan Prince proposed openstack/puppet-tripleo: Add new midonet_agent profile.  https://review.openstack.org/33331915:09
dprinceEmilienM: boom15:09
dprinceEmilienM: because of how the extraconfig data works I think I need to do the Compute and Controller work for the midonet agent in the same patch15:10
EmilienMok15:10
EmilienMdprince: do you remember the floating IP release issue we have in our tripleo CI ?15:10
EmilienMI'm wondering if we can do something like https://review.openstack.org/#/c/315632/1/nodepool/nodepool.yaml15:10
dprinceEmilienM: perhaps, I'd have to look at what clean-floating-ips does15:11
*** xinwu has quit IRC15:12
dprinceEmilienM: I don't think the nodepool tenant has any other floating IPs that are meaningful so cleaning them could be fine15:12
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Enable devmode with a single option  https://review.openstack.org/33216315:12
openstackgerritMerged openstack/tripleo-heat-templates: Add require-all=false to aodh upgrade constraint  https://review.openstack.org/33280415:13
EmilienMdprince: https://github.com/openstack-infra/nodepool/blob/6b2636a0b5a77d3dca42ae191161cd16b5d2a41a/nodepool/provider_manager.py#L345-L34715:13
EmilienMthis is what it does15:13
EmilienMdprince: https://review.openstack.org/33341115:16
EmilienMI'll email derek15:16
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: ensure that pip is at the very latest release  https://review.openstack.org/33282715:16
mandredprince: will you have time to add unit tests to https://review.openstack.org/#/c/310966/? if not, I'm going to give it a try15:16
dprincemandre: if you'd like to jump in go for it15:17
dprincemandre: I won't get to it this week I think15:18
EmilienMdprince: https://review.openstack.org/#/c/333319/ -115:20
*** gfidente|afk is now known as gfidente15:20
mandredprince: this week may be a little tight for me too, I was planning to have a look at it early next week15:21
mandreI'll make sure you're not working on it, I don't want to duplicate work15:21
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: quickstart.sh command line argument fixes  https://review.openstack.org/33276215:22
*** penick has quit IRC15:24
*** shardy has quit IRC15:25
*** tremble has quit IRC15:26
*** aufi has quit IRC15:28
gfidentedprince, hey was looking at the cinder-backup tht submission to see how I could get the backend chosen by the templates without logic in the .pp as mentioned yesterday15:29
gfidentehow about a dumb string manipulation in the 'include' line where the last part (which represents the class name) is built from a 'backend' parameter?15:30
gfidenteassuming we have a list of 'allowed_values' for the backend parameter?15:31
*** panda has quit IRC15:34
*** panda has joined #tripleo15:35
EmilienMtrown: it's failing15:35
EmilienMhttp://logs.openstack.org/98/333198/6/check-tripleo/gate-tripleo-ci-centos-7-ha/e4c9bfa/console.html#_2016-06-23_15_09_30_18771815:35
EmilienMnot sure why though15:35
*** coolsvap has quit IRC15:35
EmilienMhttp://logs.openstack.org/98/333198/6/check-tripleo/gate-tripleo-ci-centos-7-ha/e4c9bfa/logs/postci.txt.gz#_2016-06-23_15_09_57_00015:36
EmilienM2016-06-23 15:09:57.000 | | overcloud                 | a66fc225-11f2-47ee-96c3-b5eac006340c | Resource CREATE failed: The Referenced Attribute (ControllerServiceChain config_settings) is incorrect. | CREATE_FAILED      | 2016-06-23T15:09:27 |15:36
trownEmilienM: hmm insta failing, same way as RDO promote currently15:37
*** ayoung has joined #tripleo15:37
trownEmilienM: which makes me suspect something broken merged in tripleo15:37
EmilienMI don't see anything in THT15:38
EmilienMmaybe in Heat?15:38
EmilienMdprince: can you help looking at it please?15:38
EmilienMit sounds like on Compute also15:39
*** zoli is now known as zoli|gone15:39
*** zoli|gone is now known as zoli_gone-proxy15:39
EmilienMtrown: I'm  comparing packages15:41
EmilienMhttps://www.diffchecker.com/t9lz0qll15:42
jokke_gfidente: I just had(/am having) chat with the cinder guys15:43
EmilienMtrown: wow, see THT version15:43
jokke_gfidente: so the backup configs are all under the [DEFAULT] section of cinder.conf15:43
gfidentejokke_, yeah the question above is more tripleo related really15:43
jokke_yeah15:43
EmilienMtrown: it sounds like a RDO repo thing15:43
gfidentewe might land the puppet-tripleo change as is15:43
jokke_just wanted to confirm that as at least I had no idea15:43
gfidenteack15:43
EmilienMworking job from last night: openstack-tripleo-heat-templates-2.0.1-0.20160622191814.b6052d0.el7.centos.noarch15:43
EmilienMbroken job from today: openstack-tripleo-heat-templates-5.0.0-0.20160623061343.e8fdaf1.el7.centos.noarch15:44
jokke_so we don't need to worry about putting own section for them or anything like that15:44
EmilienMtrown: so promotion definitly does not work15:44
jokke_should make the tripleO side bit easier15:44
*** qasims has quit IRC15:44
gfidenteyeah cause we can't have multiple backup backends15:44
*** ramishra has quit IRC15:45
*** ramishra has joined #tripleo15:46
trownEmilienM: wtf... how did job from last night not use updated tht15:46
*** dmk0202 has quit IRC15:46
EmilienMtrown: I compared packages on undercloud15:46
trownEmilienM: oh... it is because it was from a job that allows cached images15:46
trownEmilienM: and I bet the broken job is not using cached images15:46
EmilienMright15:46
trownEmilienM: my point being we have always taken tht from current, and current would not have a timestamp of 17 days ago15:47
*** coolsvap has joined #tripleo15:47
*** qasims has joined #tripleo15:47
*** mcornea has quit IRC15:48
trownEmilienM: what project was the working job run against?15:48
*** bootsha has joined #tripleo15:48
* trown hopes we are not using pinned tht when gating tht15:48
*** bootsha has joined #tripleo15:48
EmilienMtrown: https://review.openstack.org/#/c/332804/15:49
EmilienMfuck15:49
EmilienMtrown: I'm stupid15:49
trownphew15:49
EmilienMI took a mitaka patch, I didn't see it15:49
trownmitaka :)15:49
EmilienMyeahSORRY :)15:49
EmilienMlet me dig again...15:49
*** itamarl has quit IRC15:49
EmilienMdamn15:49
trownI have a reproducer environment up for the RDO promote issue (which I think is the same we are hitting)15:50
EmilienMtrown: https://www.diffchecker.com/i5etj1ut15:52
*** mcornea has joined #tripleo15:52
EmilienMtrown: lol where is HAproxy?15:52
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-pacemaker: CI: specinfra, xenial, lint, puppet bug.  https://review.openstack.org/33283615:52
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: quickstart.sh command line argument fixes  https://review.openstack.org/33276215:53
*** athomas has quit IRC15:53
*** ramishra has quit IRC15:53
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-pacemaker: CI: specinfra, xenial, lint, puppet bug.  https://review.openstack.org/33283615:54
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Improve --help output of quickstart.sh  https://review.openstack.org/33279615:56
*** myoung has quit IRC15:56
trownEmilienM: downgrade of tht to http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tested/openstack-tripleo-heat-templates-5.0.0-0.20160622164917.203e925.el7.centos.noarch.rpm resolved the issue in my env... so something broken merged to tht15:57
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo: Move nova constraint, and refactor its declaration  https://review.openstack.org/33206915:57
EmilienMtrown: between when and when?16:02
*** dsariel has quit IRC16:02
bnemectrown: thrash: https://bugs.launchpad.net/tripleo/+bug/159561616:02
openstackLaunchpad bug 1595616 in tripleo "Image building with --all is broken" [Critical,Triaged]16:02
trownEmilienM: between 203e925 and e8fdaf116:03
*** mcornea has quit IRC16:03
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Add third party gating to quickstart  https://review.openstack.org/33222316:03
trownnot many to go through there at least16:03
thrashbnemec: ack16:04
EmilienMtrown: https://github.com/openstack/tripleo-heat-templates/compare/203e925...e8fdaf116:05
EmilienMtrown: they all passed CI :/16:05
thrashbnemec: wow... that's...16:05
bnemecthrash: Yes it is :-)16:06
bnemecDean said they hadn't documented this as a Bad Thing(tm) because they didn't think anyone would do it.16:06
*** noslzzp has quit IRC16:07
*** milan has quit IRC16:08
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart: Enable devmode with a single option  https://review.openstack.org/33216316:09
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart: Tempest builder for jobs  https://review.openstack.org/33270816:09
trownEmilienM: k, I suspect the ceilo commit is broken, testing the repo just before that commit16:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Fix empty line in opencontrail config_settings  https://review.openstack.org/33346716:09
EmilienMtrown, dprince: can it be related ^ ?16:09
openstackgerritDan Prince proposed openstack/puppet-tripleo: Add new midonet_agent profile.  https://review.openstack.org/33331916:09
trownEmilienM: oh that sounds promising... and sad16:10
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Composable midonet for neutron  https://review.openstack.org/33338716:10
EmilienMdprince: please look, it's your code, maybe we can sort this out quickly16:10
*** noslzzp has joined #tripleo16:10
EmilienMI also found something in the opencontrail plugin16:10
EmilienM+      config_settings:16:11
EmilienM+        map_merge:16:11
EmilienM+          - get_attr: [NeutronPluginOpenContrail, role_data, config_settings]16:11
EmilienMthe map_merge is useless (and maybe bring error)16:11
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart: Tempest builder for jobs  https://review.openstack.org/33270816:12
trownEmilienM: testing a deploy with your patch now, will know very shortly16:12
EmilienMtrown: ack16:12
EmilienMyeah the error is sent really quickly16:13
trownquestion then is... how did that pass CI16:14
EmilienMyes, that's a good question16:14
EmilienMtrown: the thing is, it passed CI with old packaging16:14
*** dtantsur is now known as dtantsur|afk16:14
EmilienMtrown: and you're trying with newest packaging (ie, openstack, etc)16:14
EmilienMso maybe something heat or?16:14
*** yamahata has joined #tripleo16:15
*** noslzzp has quit IRC16:16
openstackgerritSanjay Upadhyay proposed openstack/puppet-tripleo: SR-IOV nic agent changes in line with composable roles.  https://review.openstack.org/33219116:16
trownEmilienM: that one didnt do it for me :(16:16
trownsame error16:16
EmilienMtrown: ok I have another suggestion16:16
EmilienMa sec16:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Fix empty line in opencontrail config_settings  https://review.openstack.org/33346716:17
EmilienMtrown: ^16:17
*** tesseract- has quit IRC16:17
trownEmilienM: cool trying that16:18
EmilienMtrown: if it fails, can you run heat stack-show <controller-stack-ID> ?16:19
EmilienMso we can start debugging16:19
EmilienMdprince: +2 on your midonet thing, i'll base my patches on top of it for other agents.16:20
*** noslzzp has joined #tripleo16:21
EmilienMthis: Resource CREATE failed: The Referenced Attribute (ControllerServiceChain config_settings) is incorrect. | CREATE_FAILED16:21
EmilienMis worrying me16:21
EmilienMdprince: do we need map_merge? https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/ceilometer-api.yaml#L2516:24
trownEmilienM: sitll no luck... what were you wanting to check?16:25
*** ifarkas has quit IRC16:25
EmilienMtrown: on undercloud16:25
EmilienMrun stack show16:25
* EmilienM afk 10 min16:26
trownhmm.. heat resource-list -n5 overcloud | grep -v COMPLETE gives nothing...16:26
chemCI is failing with file: file:///etc/yum.repos.d/delorean.repo, line: 1, '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n'16:27
EmilienMtrown: do you see that? http://logs.openstack.org/98/333198/6/check-tripleo/gate-tripleo-ci-centos-7-nonha/a474380/logs/postci.txt.gz#_2016-06-23_15_15_05_00016:27
chemis that a new one, or should I just recheck16:27
EmilienMchem: we're working on it for 2 hours16:27
EmilienMtrown: grep CREATE_FAILED16:28
EmilienMchem: all CI is broken16:28
EmilienMchem: http://tripleo.org/cistatus.html16:28
trownEmilienM: ya same... stack show gives same error from deploy command without much else http://chunk.io/f/a4c9361ae62c4adbbd2e5635549d9d8c16:28
trownEmilienM: going to try to revert that patch entirely and see if that is indeed the problem16:29
EmilienMtrown: revert ceilometer maybe16:30
chemEmilienM: I'm aware of the CI status, was just asking about this one.16:30
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Aodh should use service tenant on undercloud  https://review.openstack.org/33347516:31
dprinceEmilienM: yeah, that is bad form16:33
trownEmilienM: ack testing ceilo revert first16:33
EmilienMdprince: any idea in our heat resource failure?16:33
*** saneax is now known as saneax_AFK16:35
dprinceEmilienM: looking16:35
*** noslzzp has quit IRC16:35
trownEmilienM: confirmed ceilo commit is the issue16:38
*** jistr|mtg is now known as jistr16:42
EmilienMtrown: damn it passed CI16:42
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates: Revert "Ceilometer composable roles for controller"  https://review.openstack.org/33348316:43
*** jpich has quit IRC16:44
EmilienMtrown: https://review.openstack.org/#/c/324117/16:44
*** bootsha has quit IRC16:44
trownEmilienM: ya not sure why CI did not catch it16:45
trownEmilienM: it is even recent CI... not like results from weeks ago16:45
*** hanchao has quit IRC16:45
EmilienMtrown: yeah but without recent packaging, like your promotion patch, right?16:46
*** noslzzp has joined #tripleo16:47
trownEmilienM: well ya, my env is using newer non-tripleo packages, but all of our CI failures are not16:48
ccamachoI whish it worked..16:49
ccamachohttp://paste.openstack.org/show/521707/16:49
ccamachomeh!!!16:49
ccamachoIm going to check now what there...16:49
ccamachoseems to be an issue in the templates..16:51
ccamachoif anyone want to have access to the env, just let me know16:51
trownccamacho: https://review.openstack.org/333483 is the fix16:51
*** akshai has quit IRC16:51
ccamacholet me check as maybe is better to fix the nit16:52
openstackgerritimain proposed openstack/tripleo-heat-templates: Output generic role_data in services.yaml  https://review.openstack.org/33286216:52
openstackgerritimain proposed openstack/tripleo-heat-templates: Pass RoleData into -post.yaml stacks  https://review.openstack.org/33292616:52
openstackgerritimain proposed openstack/tripleo-heat-templates: WIP: Containerized Services for Composable Roles  https://review.openstack.org/33065916:52
Slowerhrrm16:52
ccamachojust wait for CI and ill check if I can get the bug out first..16:52
Slowerah, rebased.. hmm16:52
EmilienMtrown: I'm a bit sad to revert it16:52
EmilienMtrown: let me dig a bit before16:52
EmilienMtrown: can we try to fix it before revert?16:53
trownEmilienM: ya, just posted the revert so we have it16:53
trownfix is always better16:53
EmilienMok..16:53
EmilienMdprince: maybe you can review I59c948ead475f449cb8d1b752f39b7eaaf056130 again16:54
EmilienMI'm reading the code again16:54
EmilienMI'm wondering if we need the map_merge thing16:55
*** penick has joined #tripleo16:55
*** qasims has quit IRC16:55
EmilienMtrown: can you checkout master again on your env16:55
EmilienMtrown: so we can do live testing?16:55
trownEmilienM: ya, I have just been deploying from templates in git checkout16:56
trowntht is the easiest package we have to test16:56
trownso we got that going for us16:56
*** akshai has joined #tripleo16:58
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: services/ceilometer: add map_merge in config_settings  https://review.openstack.org/33349316:58
EmilienMtrown: can you try this? ^16:58
*** fragatina has joined #tripleo16:58
trownsure17:00
EmilienMtrown: don't we have another way to bring our CI back until we promote?17:00
trownEmilienM: merging a fix to tht will bring back CI, we pull it from current17:00
EmilienMk17:02
ccamachoEmilienM I just checked the patch17:05
ccamachoand thats the error dude17:05
ccamachomissing map_merge17:05
EmilienMthat's a good news17:06
EmilienMthe question is how it passed CI17:06
ccamachoI had the same issue before17:07
ccamachoThats the question, how it passed CI??!?! :$17:07
dprinceccamacho: I don't think we should need merge map if it is already a map17:07
trownccamacho: https://review.openstack.org/333493 worked for you?17:07
trownccamacho: I got the same error as before17:07
dprinceIt is the pacemaker templates that are wrong17:07
ccamachoat the moment is working for me, im deploying without pacemaker17:08
EmilienMwell,  nonha job failed too17:08
ccamachowithout the map_merge didnt worked17:08
ccamachoEmilienM yeahp17:08
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Fix hiera maps in ceilometer templates  https://review.openstack.org/33349817:08
dprinceThat is probably related ^^^17:09
EmilienMdprince: maybe should we squash our commits17:09
EmilienMdprince: https://review.openstack.org/333493 is also good I think17:09
EmilienMit's like we do in nova, cinder, etc17:09
EmilienMso we'll be consistent at least17:09
EmilienM:infra17:09
ccamachoThat minus, is also wrong meeeeh...17:09
dprinceEmilienM: I don't think that is the error. I could be wrong... but if you only have a single map merge_map isn't required17:10
trownccamacho: ah that would be the diff, my env is ha17:10
ccamachoguys can you squash the commit to testit together ?17:11
*** coolsvap has quit IRC17:11
EmilienMdprince: nonha job fails too17:11
dprinceEmilienM: perhaps for a different reason?17:11
*** noslzzp has quit IRC17:12
dprinceEmilienM: just saying... map_merge is only required if you are actually merging multiple things...17:12
EmilienMI don't know map_merge enought to weight here17:12
EmilienMI'll trust you on this one17:13
EmilienMenough*17:13
*** noslzzp has joined #tripleo17:13
dprinceEmilienM: well... it happens to be one of the few heat features I added... specifically for composable services :)17:13
EmilienMtrown: you running HA, so my patch won't help17:13
EmilienMbut my patch can still help for nonha but dprince says no17:14
EmilienMtrown: do we need to Depends-On the tripleo-ci patch?17:14
trownEmilienM: which tripleo-ci patch?17:14
EmilienMthe one from ccamacho17:14
EmilienMtrown: https://review.openstack.org/#/c/333198/17:15
trownI think we use cached images for tht, if so we dont need to depends-on that17:15
EmilienMk17:16
EmilienMlet's monitor dprince's patch but I'm sure it will fail on nonha job17:16
ccamachoDeploying now the HA job with the three patches together just in case.17:16
*** devananda has quit IRC17:17
*** mgould is now known as mgould|afk17:19
*** coolsvap has joined #tripleo17:20
ccamachothe revert failed because of this 2016-06-23 16:58:20.607848 |  2016-06-23 16:58:20.607874 | File contains no section headers. 2016-06-23 16:58:20.607903 | file: file:///etc/yum.repos.d/delorean.repo, line: 1 2016-06-23 16:58:20.607932 | '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n' 2016-06-23 16:58:20.620339 | + '[' 1 '!=' 0 ']' 2016-06-23 16:58:20.620427 | + echo ERROR DURING PREVIOUS COMMAND '^^^' 2016-06-23 16:58:2017:20
ccamachowe need to depend on https://review.openstack.org/#/c/333198/17:21
EmilienMccamacho: this is chem's issue ^17:21
*** pkovar has quit IRC17:21
ccamachoEmilienM Inside that delorean.repo is the code of the redirection to the new repo..17:22
trownccamacho: k17:24
trownbtw I get the same thing even when cherry-picking both fixes17:25
* trown gets lunch17:25
*** trown is now known as trown|lunch17:25
dprinceI just got an error with CinderApiVirtualIP17:25
dprinceIt isn't even needed anymore17:25
* dprince removes it...17:25
EmilienMI'm afk to get lunch too17:26
*** ayoung has quit IRC17:28
*** ohamada has quit IRC17:29
*** tosky has quit IRC17:34
*** myoung has joined #tripleo17:35
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Drop unused VIP parames to controller.yaml  https://review.openstack.org/33351117:35
dprinceEmilienM: trown|lunch: ^^^ I had to fix that too with master17:35
dprincespecifically the CinderVirtualIp parameter was causing this: https://bugs.launchpad.net/tripleo/+bug/159563417:36
openstackLaunchpad bug 1595634 in tripleo "CinderApiVirtualIP: invalid literal for float()" [High,In progress] - Assigned to Dan Prince (dan-prince)17:36
EmilienMmaybe we need to squash the commits to see green jobs no?17:38
*** rcernin has quit IRC17:38
dprinceEmilienM: unclear to me. Let me actually get this working locally man17:38
*** electrofelix has quit IRC17:38
dprinceEmilienM: things do seem to be hosed...17:38
EmilienMok17:38
EmilienMI'm afk now, eating quickly lunch17:39
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Drop unused VIP params to controller.yaml  https://review.openstack.org/33351117:39
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart: [WIP] Add scale to roles gate  https://review.openstack.org/32954217:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Drop unused VIP params to controller.yaml  https://review.openstack.org/33351117:45
*** shivrao has joined #tripleo17:46
openstackgerritBrad P. Crochet proposed openstack/puppet-tripleo: Add Mistral profiles  https://review.openstack.org/32343117:46
*** gfidente is now known as gfidente|afk17:47
*** shivrao_ has joined #tripleo17:49
openstackgerritBrad P. Crochet proposed openstack/puppet-tripleo: Add zaqar profiles  https://review.openstack.org/33168117:51
*** jpena is now known as jpena|off17:51
*** shivrao has quit IRC17:51
dprinceEmilienM: ceilometer_password in ceilometer-base.yaml17:53
dprinceEmilienM: I will fix it...17:53
*** tosky has joined #tripleo17:54
*** shivrao_ has quit IRC17:55
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168217:57
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Fixes to Ceilometer templates  https://review.openstack.org/33349818:00
dprincetrown|lunch: EmilienM: I've squashed 2 fixes into that now18:00
*** leanderthal is now known as leanderthal|afk18:02
*** noslzzp_ has joined #tripleo18:05
*** akshai has quit IRC18:06
*** noslzzp_ has quit IRC18:07
*** noslzzp has quit IRC18:07
dprinceceilometer_coordination_url is bunk too18:07
dprinceno way CI is tested any of this18:07
*** noslzzp has joined #tripleo18:07
dprince:)18:07
openstackgerritMerged openstack/python-tripleoclient: Add Zaqar password to deployment  https://review.openstack.org/33065018:08
*** fragatina has quit IRC18:08
*** yamahata has quit IRC18:10
*** rbrady has quit IRC18:10
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart: Change to not clone quickstart by default  https://review.openstack.org/33352418:10
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Fixes 3 issues in Ceilometer composable services  https://review.openstack.org/33349818:11
dprinceSlower: ^^^ that may be what you are hitting as well18:11
dprinceSlower: t-h-t master is hosed ATM18:11
*** sthillma has joined #tripleo18:12
*** sshnaidm is now known as sshnaidm|afk18:14
dprinceEmilienM, trown|lunch: just looked here... I think the CI results on that patch were invalid due to a package build failure https://review.openstack.org/#/c/324117/2218:16
Slowerdprince: ah ok18:18
slagledprince: i was just looking into that myself. where are you seeing the package build failure?18:19
EmilienMdprince: back18:20
dprinceslagle: we had a bad Ceilometer patch land18:21
dprinceslagle: https://review.openstack.org/#/c/324117/2218:21
slagleright, i was trying to see how it passed CI to begin with18:21
dprinceI'm wondering if Delorean isn't returing an exit status18:21
dprinceslagle: my patch should fix Ceilometer...18:22
dprinceslagle: https://review.openstack.org/#/c/333498/18:22
thrashdprince: I posted one comment18:22
dprincethrash: I think I did that right?18:23
dprinceceilometer::agent::central::coordination_url: *ceilometer_coordination_url18:23
dprincethrash: similar to line 9218:23
dprincewith the DB connection18:23
Slowerit passed the gate tho?18:23
thrashdprince: am I just not seeing the '*'18:23
thrash?18:23
EmilienMit's so weird, this patch passed ci so much time before we landed it18:23
*** akshai has joined #tripleo18:24
thrashdprince: doh18:24
thrashdprince: lol I was looking at the REMOVED line.18:24
thrashhaha18:24
EmilienMthere is something in our gate that we need to revise18:24
thrashdprince: ignore me.18:24
dprinceEmilienM: I think we should outright revert the Ceilometer fix18:24
openstackgerritMichele Baldessari proposed openstack/tripleo-docs: Upgrade documentation  https://review.openstack.org/30898518:24
dprinceEmilienM: there are likely puppet errors there too18:24
EmilienMok for revert, if it helps to bring CI back18:26
dprinceEmilienM: I also had to do this locally https://review.openstack.org/#/c/333511/18:26
dprinceEmilienM: that CinderVip thing is new... not sure how that slipped in. Possibly related to the Heat version in play18:27
SlowerI see the *18:27
Slowerwow so late :)18:27
EmilienMif we can avoid the revert with your fix it's good. Otherwise, let's revert...18:27
*** florianf has quit IRC18:28
dprinceEmilienM: yep, I'm running locally. Will let you know. Just saying I suspect this has never actually been all tested yet18:28
* Slower is trying it too18:29
EmilienMwhat?18:29
dprincehttp://paste.openstack.org/show/521723/18:30
dprinceEmilienM: ^^ boom, it still fails due to puppet :/18:30
EmilienMwhere?18:30
dprinceduplicate declaration I think...18:31
dprinceEmilienM: that should be an include18:31
EmilienMI'm looking in http://logs.openstack.org/17/324117/22/check-tripleo/gate-tripleo-ci-centos-7-nonha/3758449/logs/overcloud-controller-0/var/log/messages18:31
dprinceEmilienM: I'm testing locally...18:31
EmilienMJun 23 05:13:02 localhost os-collect-config: #033[mNotice: /Stage[main]/Ceilometer::Collector/Service[ceilometer-collector]/ensure: ensure changed 'stopped' to 'running'#033[0m18:31
EmilienMit worked in CI18:31
dprinceEmilienM: much faster than waiting for this18:31
EmilienMwait, you're saying that our CI is not testing THT?18:33
dprinceEmilienM: exactly18:33
dprinceEmilienM: there was a package build issue and it wasn't caught18:33
EmilienMwhere do you see it in logs?18:33
EmilienMany URL handy?18:33
dprincehttps://review.openstack.org/#/c/324117/2218:34
dprinceEmilienM: look at the logs on that18:34
dprinceEmilienM: see my last comment18:34
EmilienMhttp://logs.openstack.org/17/324117/22/check-tripleo/gate-tripleo-ci-centos-7-nonha/3758449/console.html#_2016-06-23_03_46_21_70535418:34
EmilienMso what you're saying is that we landed some patches that were not tested?18:35
EmilienMceilometer, cinder, and maybe more issues?18:35
*** akshai has quit IRC18:35
*** shivrao has joined #tripleo18:35
dprinceEmilienM: DLRN isn't exiting with an error status when it prints this 'packages not built correctly: not updating the consistent symlink'18:35
dprincethis is a DLRN bug18:36
dprincehttps://github.com/openstack-packages/DLRN/blob/master/dlrn/shell.py#L70118:36
EmilienMreally good catch18:37
*** trown|lunch is now known as trown18:37
EmilienMtrown: tl;dr: delorean bug18:38
EmilienMtrown: http://logs.openstack.org/17/324117/22/check-tripleo/gate-tripleo-ci-centos-7-nonha/3758449/console.html#_2016-06-23_03_46_21_70535418:38
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Revert "Ceilometer composable roles for controller"  https://review.openstack.org/33353318:39
dprinceEmilienM, trown: lets revert ceilo. It is quite broken. At least 4 issues I've found so far.18:39
EmilienMi think trown already proposed it18:39
dprinceEmilienM: you and I can follow up and fix Ceilo once our CI is fixed...18:39
EmilienMbut +2 on ^18:39
EmilienMdprince: sure, I'll need your help a bit probably18:40
EmilienMtrown: you ok to revert?18:40
trownya18:40
*** rodrigods has quit IRC18:40
*** rodrigods has joined #tripleo18:40
trownthats rough on the dlrn bug18:40
dprincetrown: are we filing github issues on this?18:41
dprincetrown: probably worth filing a TripleO bug on this too right?18:41
*** coolsvap has quit IRC18:41
*** coolsvap has joined #tripleo18:42
trowndprince: yes on both accounts18:43
EmilienMok so the plan is 1) we merge the revert 2) we update the URL in tripleo-ci18:43
EmilienMtrown: right?18:43
*** rbrady has joined #tripleo18:44
trownEmilienM: ya that hopefully will fix CI18:44
EmilienMok18:44
thrashdprince: what about https://review.openstack.org/#/c/333511/3 ?18:45
EmilienMdo we wait for CI results?18:45
*** r-mibu has quit IRC18:45
EmilienMCI results are false anyway18:45
*** r-mibu has joined #tripleo18:45
dprincethrash: oh, I think we'll need that too18:46
dprincethrash: that is just good solid t-h-t code man18:46
thrashdprince: :)18:47
dprincethrash: I filed a separate bug for that anyways...18:47
dprincethrash: was surprised to see trunk failing for both so I got suspicious...18:47
dprincethrash: there could be more18:47
ccamachoguys Im really tired now, going to sleep, sorry not helping with more18:48
dprinceccamacho: no worries. Sleep man!18:48
trownthanks for the help ccamacho18:48
ccamachonp!18:52
*** dciabrin has quit IRC18:52
*** ccamacho is now known as ccamacho|Zzz18:52
*** dciabrin has joined #tripleo18:53
trowndprince: EmilienM, wait is there some other indication THT didnt build? that INFO message is always there when not building all packages18:55
trownoh, I think http://logs.openstack.org/17/324117/22/check-tripleo/gate-tripleo-ci-centos-7-nonha/3758449/console.html#_2016-06-23_03_40_49_234238 is actually the issue18:55
trownit overwrote the changes18:55
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: ensure that pip is at the very latest release  https://review.openstack.org/33282718:56
EmilienMtrown: ok so it checkout to https://github.com/openstack/tripleo-heat-templates/commit/4ef338574b1a7cef8b1b884d439556b24fb09718 ?18:56
trownEmilienM: yep18:56
EmilienMtrown: which means, we're not too bad, we only merged a few commits18:57
EmilienMso i guess only ceilometer was broken18:57
dprincetrown: okay, so maybe I missed something18:57
dprincetrown: please reply to my thread on the list then :)18:57
trownmaybe... my env failed to deploy even after reverting ceilo patch, just later18:57
trowndidnt look at it yet, because we were heads down on the ceilo issue18:58
dprincetrown: this too https://review.openstack.org/#/c/333511/?18:58
trowndprince: that is probably it, it failed in step418:58
trownwill redeploy with that and ceilo revert to see if anything else is broke18:59
*** akshai has joined #tripleo18:59
*** sambetts is now known as sambetts|afk19:01
*** mburned is now known as mburned_out19:03
*** mburned_out is now known as mburned19:06
dprincetrown: My remove VIPs patch is still valid. But once you have the revert I think it isn't needed19:10
dprincetrown: the issue was the Ceilometer patch changed the 'type' of the CinderApiVirtualIP parameter to number. Thus causing a failure19:11
trowndprince: k in that case we might have another issue, but I will know for sure shortly, it is also possible the issue I hit is only on master everything, because that is how my env is currently setup19:14
dprincetrown: yep19:14
Sloweranyone know what this might be? https://paste.fedoraproject.org/383844/70938614/19:17
dprinceSlower: you puppet-tripleo modules are too old19:17
dprinceSlower: rebuild your overcloud-full.qcow2 image?19:18
Slowerdprince: k19:18
Slowerthx ;)19:18
*** ebalduf has quit IRC19:18
dprinceSlower: or... you can just inject a more recent set of puppet-tripleo modules into /etc/puppet/modules/tripleo in your existing image19:18
dprinceSlower: gotta keep the pace man19:18
Slowerhehe19:18
SlowerI'd rather use atomic :)19:19
Slowerbut I want to work from a proven baseline so.. :)19:19
dprinceSlower: yeah, just blow everything up man19:19
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates: Add environment file to enable DVR  https://review.openstack.org/33214719:19
leifmadsenso I see that ci.centos.org builds out images from RDO for use in testing TripleO via quickstart. Are the images built and just used locally, or are they published somewhere that I could monitor / use?19:19
leifmadsenI'm just trying to determine how much of this infrastructure I need to rebuild for a local set of tests19:19
openstackgerritMerged openstack/tripleo-quickstart: New place of current-tripleo repo  https://review.openstack.org/33320219:20
trownleifmadsen: RDO images are published at http://artifacts.ci.centos.org/rdo/images/19:21
leifmadsentrown: ah thanks, I bet I just didn't see this on the website...19:21
leifmadsenI was looking at the dir for the RPMs19:21
trownleifmadsen: there are also images built in tripleo-ci and quickstart recently got the ability to deploy using those as well19:21
trownthe biggest difference being the repo setup19:22
leifmadsenyea, that's basically what I'm looking to do, is to deploy these images for TripleO quickstart instead of building them locally19:22
leifmadsenI saw the build-images.yml in tripleo-quickstart19:22
leifmadsenI was starting to digest it. Looks to have a publish section that may need to be adjusted, but for my use case, I'm not doing any customization of the packages, so figured building the images myself was really just extra unnecessary work19:22
Slowerdprince: fine I will then :O)19:24
trownleifmadsen: ya publishing is off by default19:24
trownthat part is only used by centos CI19:24
leifmadsengotcha, I must not have read through the playbooks carefully enough19:24
openstackgerritMerged openstack/tripleo-quickstart: Enable devmode with a single option  https://review.openstack.org/33216319:25
*** ayoung has joined #tripleo19:31
*** akshai has quit IRC19:32
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: ensure that pip is at the very latest release  https://review.openstack.org/33282719:34
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Refactor: block-device handling (local loop)  https://review.openstack.org/31959119:34
*** panda has quit IRC19:34
*** xinwu has joined #tripleo19:35
*** panda has joined #tripleo19:35
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart: Explicit Teardown  https://review.openstack.org/33124219:36
EmilienMdprince: why the revert does not pass CI?19:38
dprinceEmilienM: getting ready to file a new ticket on that...19:39
EmilienMdo we also need https://review.openstack.org/#/c/333198/ ?19:39
*** akshai has joined #tripleo19:39
dprinceEmilienM: maybe19:39
dprinceEmilienM: lets recheck that once the revert lands19:39
EmilienMk19:40
dprinceEmilienM: I don't mind skipping CI for a revert in most cases. Especially since it is less than a day old19:40
openstackgerritMerged openstack/tripleo-heat-templates: Revert "Ceilometer composable roles for controller"  https://review.openstack.org/33353319:43
*** qasims has joined #tripleo19:47
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Drop unused VIP params to controller.yaml  https://review.openstack.org/33351119:48
*** dbecker has quit IRC19:48
dprinceEmilienM: +2 on https://review.openstack.org/#/c/333198/ and rechecked19:49
dprinceEmilienM: if it passes we might be good again19:49
EmilienMexcellent19:50
dprincetrown, EmilienM still need to get to the bottom of why CI isn't catching things though...19:50
EmilienMi'm going to revert the revert, they fixed delorean and it's going to land. How to update delorean? cc trown19:50
*** derekh has joined #tripleo19:50
dprinceEmilienM: merge this into your new Ceilometer patch too https://review.openstack.org/#/c/333498/19:51
dprinceEmilienM: once you grab that I will abandone...19:51
trownEmilienM: once it merges we are good... we just clone master for dlrn19:51
trownwhich maybe we shouldnt do that :)19:51
EmilienMdprince: ack, I'll Co-Author it :P19:51
EmilienMtrown: w00t w00t19:51
EmilienMI have a telnet open on https://review.openstack.org/#/c/333198/ jobs19:52
dprinceEmilienM: puppet-tripleo isn't good for Ceilometer yet either. We need to fix the duplicate resources too19:52
dprinceEmilienM: but you know what you are doing there I think ;)19:52
EmilienMdprince: I think it's good19:52
EmilienMdprince:19:52
EmilienMdprince: it's just the delorean bug didn't take the THT commit in account19:52
EmilienMso we had this dup resource maybe?19:52
dprinceEmilienM: it failed for me locally19:52
dprinceEmilienM: we'll see :)19:52
EmilienMdprince: ok I'm looking at it right now19:52
EmilienMdprince: it was collector, right?19:53
dprinceEmilienM: the base ceilometer module was imported twice19:53
dprinceit just showed up in collector19:53
EmilienMk19:53
trownit is actually kind of good CI had a rough week :), imagine all the broken stuff we could have merged19:56
trownsilver linings19:56
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355619:58
*** fragatina has joined #tripleo19:59
derekhhave we still got a problem with the trunk.rdoproject.org redirects?20:00
*** penick has quit IRC20:01
*** penick has joined #tripleo20:01
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355620:02
trownderekh: ya I think https://review.openstack.org/#/c/333198/6 is the fix20:02
trownEmilienM: do you just have workflow -1 waiting for other issues to be resolved so we can test that?20:03
EmilienMtrown: I'm watching for CI20:04
*** ayoung has quit IRC20:04
EmilienMtrown: but nothing blockers20:04
derekhtrown: ack, thanks20:04
*** dbecker has joined #tripleo20:05
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart: Adds ci-script to deploy on baremetal hardware  https://review.openstack.org/33356120:07
*** rajinir has joined #tripleo20:08
*** jcoufal_ has quit IRC20:09
trownI do still fail to deploy master even after ceilo revert... Error: Could not find dependency Pacemaker::Resource::Service[undef] for Pacemaker::Constraint::Base[ceilometer-notification-then-heat-api-constraint] at /etc/puppet/modules/tripleo/manifests/profile/pacemaker/heat.pp20:09
trownnot sure if that is only master everything or not though20:10
*** jayg is now known as jayg|g0n320:10
*** fragatina has quit IRC20:11
thrashtrown: https://review.openstack.org/#/c/327708/ would fix that20:14
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Gnocchi composable roles  https://review.openstack.org/31841320:14
thrashtrown: and https://review.openstack.org/#/c/327709/20:15
trownthrash: thanks, added myself to those. will give them a go once we have the main fire smoldering20:16
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Add Aodh composable roles  https://review.openstack.org/33355620:16
EmilienMpradk: we found issues in way we did ceilo, might be the same for aodh if copy/paste20:17
EmilienMjust fyi20:17
pradkEmilienM, yea i dint use ceilo as ref20:17
pradkEmilienM, can i help with ceilo?20:17
pradkEmilienM, aodh profile should be in good shape to review if you have time to look20:18
*** ayoung has joined #tripleo20:18
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349820:20
EmilienMpradk: ok thx20:20
EmilienMpradk: now, no, I'm trying to dig why puppet code fails20:20
pradkok20:20
EmilienMdprince: ^ squash20:20
*** panda has quit IRC20:27
*** cdearborn has quit IRC20:27
*** rlandy has quit IRC20:27
*** spredzy_ has quit IRC20:27
*** shadower has quit IRC20:27
*** NobodyCam has quit IRC20:27
*** Ng has quit IRC20:27
*** remix_tj has quit IRC20:27
*** igorbelikov has quit IRC20:27
*** dobson has quit IRC20:27
*** trown has quit IRC20:27
*** larstobi has quit IRC20:27
*** zigo has quit IRC20:27
*** patrickeast has quit IRC20:27
*** mgagne has quit IRC20:27
*** onovy has quit IRC20:27
*** saneax_AFK has quit IRC20:27
*** telnoratti has quit IRC20:27
*** spredzy has joined #tripleo20:27
*** onovy has joined #tripleo20:27
*** shadower has joined #tripleo20:27
*** panda has joined #tripleo20:27
*** rlandy has joined #tripleo20:27
*** remix_tj has joined #tripleo20:27
*** cdearborn has joined #tripleo20:28
*** larstobi has joined #tripleo20:28
*** telnoratti has joined #tripleo20:28
*** trown has joined #tripleo20:28
*** dobson has joined #tripleo20:28
*** zigo has joined #tripleo20:29
*** Ng has joined #tripleo20:29
*** ChanServ sets mode: +v Ng20:29
*** NobodyCam has joined #tripleo20:30
*** mgagne has joined #tripleo20:30
*** igorbelikov has joined #tripleo20:30
*** mgagne is now known as Guest2045420:30
*** patrickeast has joined #tripleo20:31
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart: Add third party gating to quickstart  https://review.openstack.org/33222320:31
*** jefrite has quit IRC20:32
*** saneax_AFK has joined #tripleo20:34
*** saneax_AFK is now known as saneax20:34
*** dbecker has quit IRC20:38
EmilienMtrown: watching the CI job, overcloud is deploying20:39
EmilienMdamn it failed20:43
EmilienM2016-06-23 20:39:47.000 | | overcloud                 | c135c8bf-b017-49a7-ac74-d85a19bdb71e | Resource CREATE failed: The Referenced Attribute (ControllerServiceChain config_settings) is incorrect. | CREATE_FAILED      | 2016-06-23T20:39:23 |20:43
EmilienMsame error20:43
EmilienMhttp://logs.openstack.org/98/333198/6/check-tripleo/gate-tripleo-ci-centos-7-ha/9ba4f49/logs/postci.txt.gz#_2016-06-23_20_39_47_00020:43
*** jefrite has joined #tripleo20:45
EmilienMtrown: nonha & upgrade job same20:46
*** weshay has quit IRC20:47
trownEmilienM: hmm, that is the tripleo-ci patch?20:49
EmilienMtrown: ye20:49
bnemecI'm hitting that same problem locally.20:50
*** noslzzp has quit IRC20:50
bnemecI guess it's nice to know it isn't just me...20:50
*** ayoung has quit IRC20:51
*** noslzzp has joined #tripleo20:51
trownI think the revert has not been built yet in dlrn20:51
trownhttps://trunk.rdoproject.org/centos7-master/report.html20:51
trownin the yum log for that job we got Jun 23 20:09:55 Installed: openstack-tripleo-heat-templates-5.0.0-0.20160623164409.a778a97.el7.centos.noarch which is http://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=a778a97d28826221edc43a42772ac52515d36b8720:52
EmilienMtrown: ah right20:52
EmilienMwe don't use source, right20:52
trownshould get built any minute20:53
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Re-enable Ceilometer composable roles for controller  https://review.openstack.org/33349820:59
*** akshai has quit IRC21:01
*** penick has quit IRC21:03
*** oneswig has joined #tripleo21:04
*** mburned is now known as mburned_out21:05
*** rhallisey has quit IRC21:08
*** akshai has joined #tripleo21:08
openstackgerritPradeep Kilambi proposed openstack/instack-undercloud: Aodh should use service tenant on undercloud  https://review.openstack.org/33347521:09
*** lblanchard has quit IRC21:09
*** trown is now known as trown|outtypewww21:10
*** akrivoka has quit IRC21:12
*** akshai has quit IRC21:14
*** sthillma has quit IRC21:29
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168221:32
openstackgerritStephanie Miller proposed openstack/diskimage-builder: Make svc-map support overridden elements  https://review.openstack.org/33359721:35
*** sthillma has joined #tripleo21:35
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168221:35
*** sthillma has quit IRC21:36
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168221:36
openstackgerritMichele Baldessari proposed openstack/tripleo-docs: Upgrade documentation  https://review.openstack.org/30898521:37
*** sthillma has joined #tripleo21:47
*** cdearborn has quit IRC22:03
*** derekh has quit IRC22:11
*** davidlenwell has quit IRC22:12
*** davidlenwell has joined #tripleo22:13
*** ChanServ sets mode: +v davidlenwell22:13
*** bfournie has quit IRC22:20
*** pradk has quit IRC22:21
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist  https://review.openstack.org/31933722:24
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished  https://review.openstack.org/29732822:24
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Stop piping yes to Heat  https://review.openstack.org/31773022:24
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job  https://review.openstack.org/29676522:24
*** penick has joined #tripleo22:25
*** rlandy has quit IRC22:25
*** tosky has quit IRC22:28
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist  https://review.openstack.org/31933722:30
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished  https://review.openstack.org/29732822:30
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Stop piping yes to Heat  https://review.openstack.org/31773022:30
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job  https://review.openstack.org/29676522:30
*** yamahata has joined #tripleo22:41
*** oneswig has quit IRC22:44
*** thrash is now known as thrash|g0ne22:54
*** rasca has quit IRC22:54
*** fragatina has joined #tripleo22:57
*** rasca has joined #tripleo22:58
*** fragatina has quit IRC23:03
*** fragatina has joined #tripleo23:03
*** limao_ has joined #tripleo23:13
*** rcernin has joined #tripleo23:15
openstackgerritStephanie Miller proposed openstack/diskimage-builder: Make svc-map support overridden elements  https://review.openstack.org/33359723:16
*** qasims has quit IRC23:19
openstackgerritMerged openstack-infra/tripleo-ci: UPDATE REPO FOR DELOREAN_REPO_URL  https://review.openstack.org/33319823:19
*** dprince has quit IRC23:19
*** limao_ has quit IRC23:23
*** bootsha has joined #tripleo23:26
*** fragatina has quit IRC23:30
*** bootsha has quit IRC23:30
*** bswartz has quit IRC23:32
*** dmsimard is now known as dmsimard|pto23:48

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!