Thursday, 2016-08-18

*** Ryjedo_ has joined #tripleo00:02
*** Ryjedo has quit IRC00:03
*** Ryjedo_ is now known as Ryjedo00:03
*** julim has quit IRC00:03
*** tzumainn has quit IRC00:04
*** bswartz has quit IRC00:17
*** Guest65663 is now known as saneax_AFK00:22
*** bana_k has quit IRC00:28
*** saneax_AFK is now known as saneax00:30
*** saneax is now known as Guest9608000:30
*** penick has joined #tripleo00:31
*** bswartz has joined #tripleo00:32
beaglespabelanger, typo in env...00:33
* beagles facepalm00:33
beaglespabelanger, thanks for giving me a kick :)00:34
*** limao has joined #tripleo00:37
*** padkrish has joined #tripleo00:38
*** padkrish_ has joined #tripleo00:39
*** padkrish has quit IRC00:42
*** morazi has quit IRC00:45
*** padkrish_ has quit IRC00:56
*** dmacpher has quit IRC01:02
*** xuao has joined #tripleo01:15
openstackgerritGraeme Gillies proposed openstack/tripleo-docs: Updated basic installation page to include links to prebuilt images.  https://review.openstack.org/35682301:18
*** limao has quit IRC01:19
*** jeckersb_gone is now known as jeckersb01:20
*** limao has joined #tripleo01:22
*** padkrish has joined #tripleo01:25
*** padkrish has quit IRC01:32
*** numans has joined #tripleo01:37
*** thrash is now known as thrash|g0ne01:40
*** dmacpher has joined #tripleo01:41
*** padkrish has joined #tripleo01:43
*** lblanchard has quit IRC01:56
*** tbarron is now known as tbarron|afk02:00
*** ebalduf has quit IRC02:21
*** rlandy has quit IRC02:21
*** Ryjedo_ has joined #tripleo02:29
*** Ryjedo has quit IRC02:30
*** Ryjedo_ is now known as Ryjedo02:30
*** coolsvap has joined #tripleo02:45
*** Guest96080 is now known as saneax_AFK02:59
*** rwsu has joined #tripleo03:02
*** padkrish has quit IRC03:05
*** padkrish has joined #tripleo03:05
*** julim has joined #tripleo03:05
*** saneax_AFK is now known as saneax03:06
*** saneax is now known as Guest5396403:06
*** yamahata has quit IRC03:07
*** Goneri has quit IRC03:10
*** limao has quit IRC03:11
*** padkrish has quit IRC03:12
*** numans has quit IRC03:12
*** padkrish has joined #tripleo03:17
*** julim has quit IRC03:19
*** coolsvap is now known as _coolsvap_03:21
*** Guest53964 is now known as saneax_AFK03:22
*** r-mibu has quit IRC03:24
*** r-mibu has joined #tripleo03:25
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds action for template processing  https://review.openstack.org/33761503:25
*** padkrish has quit IRC03:28
*** xuao has quit IRC03:29
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds Deployment Action & Workflow  https://review.openstack.org/29873203:35
openstackgerritRyan Brady proposed openstack/tripleo-common: Adds parameters actions  https://review.openstack.org/29868203:38
*** links has joined #tripleo03:45
*** numans has joined #tripleo03:48
*** padkrish has joined #tripleo04:11
openstackgerritGraeme Gillies proposed openstack/tripleo-docs: Updated basic installation page to include links to prebuilt images.  https://review.openstack.org/35682304:22
openstackgerritMerged openstack/tripleo-heat-templates: Rename NeutronServer to NeutronApi to align with ServiceNetMap  https://review.openstack.org/35506504:24
*** saneax_AFK is now known as saneax04:34
*** saneax is now known as Guest7274604:35
openstackgerritMerged openstack/puppet-tripleo: Allow use of raw disks for Swift storage role  https://review.openstack.org/35084004:38
*** padkrish has quit IRC04:44
*** fragatina has quit IRC05:01
openstackgerritMerged openstack/instack-undercloud: Use http for Ironic deployments  https://review.openstack.org/35548405:03
*** jaosorior has joined #tripleo05:03
*** jprovazn has joined #tripleo05:09
*** padkrish has joined #tripleo05:28
*** Ryjedo_ has joined #tripleo05:28
*** Ryjedo has quit IRC05:29
*** Ryjedo_ is now known as Ryjedo05:29
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add TripleO RSS Feed from Juan Antonio Osorio's blog  https://review.openstack.org/35689805:30
openstackgerritIan Wienand proposed openstack/diskimage-builder: Use temp file for du calculations  https://review.openstack.org/35691705:31
*** rajinir has quit IRC05:35
*** r-mibu has quit IRC05:37
*** bootsha has joined #tripleo05:42
*** padkrish has quit IRC05:45
*** r-mibu has joined #tripleo05:47
*** bootsha has quit IRC05:47
*** bootsha has joined #tripleo05:48
*** bana_k has joined #tripleo05:49
*** bootsha has quit IRC05:53
*** padkrish has joined #tripleo05:53
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Pass TRIPLEO_ROOT directory to heat_deploy_times.sh  https://review.openstack.org/35694606:01
*** masco has joined #tripleo06:09
*** padkrish has quit IRC06:09
*** dsariel has joined #tripleo06:10
*** rcernin has joined #tripleo06:12
openstackgerritGraeme Gillies proposed openstack/tripleo-image-elements: Remove galera package from being explicitly installed with mariadb  https://review.openstack.org/35695206:14
jaosoriorbandini: ping06:25
*** jbadiapa has joined #tripleo06:46
*** pcaruana has joined #tripleo06:52
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Pass ServiceNetMap to services  https://review.openstack.org/35441406:54
bandinijaosorior: pong06:54
*** bana_k has quit IRC06:55
jaosoriorbandini: hey man, stupid question; in an HA case can I still do systemctl reload for haproxy?06:57
gfidentejaosorior, can you merge https://review.openstack.org/#/c/355605/ ?06:58
gfidentewe have a lot of conflicting changes around06:59
jaosoriorgfidente: do we use the endpoint map for anything related to the ports or netipmap?07:00
bandinijaosorior: you should use pcs resource restart for pacemaker resources. because if pacemaker launches the monitor action exactly when haproxy is down (due to your systemctl restart) it will see it is down and race it to restart it. due to the asynchronos way the systemd api works07:00
bandinijaosorior: in general nothing will happen, but it is not a racefree move to restart via systemctl07:00
bandinigfidente: good morning, sir!07:00
gfidentebandini, hey morning07:00
jaosoriorbandini: but I meant, reload07:01
bandinijaosorior: lol -ENOCOFFEE!07:01
jaosoriorsystemctl reload07:01
bandinijaosorior: if the reload action does not imply a restart, yes no problem at all07:01
*** hewbrocca-afk is now known as hewbrocca07:02
gfidentebandini, jaosorior yeah reload in haproxy is not restarting07:02
bandinigfidente: ack then I can't think of any issues07:03
jaosoriornice07:03
jaosoriorthen that's cool07:03
gfidentejaosorior, no I'd say it's the other way around, we build the endpointmap from netipmap07:03
gfidentethat's how it is meant to be anyway07:04
jaosoriorgfidente: great. Just making sure07:04
gfidentethough we use the endpoint map to set the bind address in a few places07:05
jaosoriorgfidente: can you pass that?07:06
jaosoriorwhere we do that07:06
gfidenteso switching to hostnames is good07:06
jaosoriorgfidente: yeah, that's what I'm trying here https://review.openstack.org/#/c/356416/07:06
gfidenteit will get slowly help us get rid of the ipv6 brackets issue07:06
gfidentejaosorior, yep I saw it07:06
jaosoriorgfidente: but it's pretty hard to test it cause my undercloud keeps having OOMs :()07:07
jaosorior:(07:07
gfidentewe need the IPv6 job back in CI07:07
jaosoriorso far it seems that setting the public endpoints to CLOUDNAME works as expected (more or less as before)07:07
gfidentejaosorior, see https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/cinder-api.yaml#L6307:08
gfidenteor https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/cinder-base.yaml#L6107:08
jaosoriorgfidente: aah, that's definitely not an issue07:08
gfidentenot only it isn't, it's good progress07:08
*** Guest72746 is now known as saneax_AFK07:08
jaosoriorgfidente: if we have DNS set up then that will wrk07:08
jaosorior*work07:08
*** saneax_AFK is now known as saneax07:09
gfidentewe have $hosname.$network.$domain in hosts07:09
gfidenteso it passed07:09
gfidenteI think it's fine07:09
gfidente+207:09
*** saneax is now known as Guest8185507:09
gfidentebut we need that ipv6 back asap07:09
jaosoriorgfidente: we definitely do07:10
jaosoriorgfidente: what changes with that commit is that. We used to document that CloudName is the FQDN for the public endpoint07:10
jaosoriorand we have never used it that way07:10
jaosoriornor enforced it07:10
jaosoriorand actually, if you set the fqdn before, it would break the naming we had for the ndoes07:10
jaosorior*nodes07:10
gfidenteyeah it's only the domain part07:11
jaosoriorso, now cloudname is not the FQDN, and the FQDN for the public endpoint is gotten from CloudName + '.' + CloudDomain07:11
*** Guest81855 is now known as saneax_AFK07:11
jaosorioranyway, only change I need to do is do a validation in the client (after this merges) that will check that people don't mess up and include the domain in the cloudname07:12
gfidentejaosorior, only why do you want it per-network ?07:16
*** tesseract- has joined #tripleo07:17
gfidentejaosorior, I don't think we want that because the endpoint network is given by the haproxy listener not by the binding network07:18
jaosoriorgfidente: isn't it the case that each network has a VIP? which haproxy is listening on depending on the service (and the network assigned to it)07:21
*** zoli_gone-proxy is now known as zoliXXL07:22
jaosoriorgfidente: I used pretty much the way that we get the values for the Public VIP and such07:22
*** ebarrera has joined #tripleo07:24
*** leanderthal|afk is now known as leanderthal07:27
gfidentejaosorior, yes but that is for IP_ADDRESS not CLOUDNAME07:28
gfidentein CLOUDNAME goes the public address07:28
jaosoriorgfidente: which is what the change is about07:29
jaosoriorgfidente: now CLOUDNAME in endpoint map can resolve to a name that is network dependant; so that means that those VIPs should be have records in DNS07:29
gfidenteyes but we don't want that07:30
gfidenteI mean07:30
jaosoriorgfidente: why?07:30
gfidentebecause in CLOUDNAME goes the external vip where haproxy is listening07:30
jaosoriorgfidente: check the commit again07:30
jaosoriorgfidente: setting CLOUDNAME in endpoint map no longer goes to just the external VIP07:31
*** akuznetsov has joined #tripleo07:31
gfidenteright because you did it per-network07:31
gfidenteso as it currently is , you should get CloudEndpoints, external07:31
jaosoriorgfidente: so for the public endpoint, CLOUDNAME does go to the name that should be assigned to the external vip07:32
jaosoriorbut that won't be the case for the internal endpoints and such07:32
gfidenteno it doesn't if you take ServiceNetMap, AodhApiNetwork07:33
gfidentethat's my point07:33
jaosoriorgfidente: won't AodhApiNetwork point to to the internal_api?07:34
gfidenteexactly, not external07:34
jaosoriorgfidente: that is the expected behavior for AodhAdmin and AodhInternal07:34
jaosoriorcheck AodhPublic07:34
jaosoriorgfidente: it's line 25107:35
*** florianf has joined #tripleo07:36
*** stendulker has joined #tripleo07:37
jaosoriorgfidente: I use the same mechanism of how we get the correct address if we use IP_ADDRESS. All thanks to zaneb's magical build_endpoint_map.py :P07:37
*** fragatina has joined #tripleo07:37
gfidenteah so it's set based on CLOUDNAME instead of IP_ADDRESS anyway07:38
gfidenteI see it now07:38
*** jpich has joined #tripleo07:38
gfidentewhich wasn't obvious as previously CLOUDNAME was for the public part only07:38
jaosoriorgfidente: exactly07:39
jaosoriorsorry about that07:39
jaosoriorshould I change the naming then?07:39
gfidenteno no sorry, I went to one of the instances using CLUDNAME assuming that was the external endpoint07:39
gfidenteso you want to "deprecate" the tls map making it always use CLOUDNAME after?07:42
jaosoriorgfidente: IP_ADDRESS still works, that's no problem07:42
jaosoriorand we don't need to deprecate if people still want to use ip addresses07:42
gfidenteyeah but we won't need it07:42
*** fragatina has quit IRC07:42
jaosoriorbut this gives the possibility of using FQDNs if the deployer has DNS enabled07:42
gfidenteso it's there for backward compat but we could cleanup the env files07:43
gfidenteif we had those names resolved in the hosts file07:43
jaosoriorgfidente: well, having them in the hosts file can be a huge hassle. I would just recommend people to use predictable IP addresses and set up DNS07:44
*** bana_k has joined #tripleo07:45
gfidenteso +2 on this one meantime07:46
gfidentewhy you don't like having them in hosts ?07:46
*** zoliXXL is now known as zoli|brb07:47
d0ugaljtomasek: ping07:47
jtomasekd0ugal: hi07:47
d0ugaljtomasek: I found something that is added to the resource_registry07:47
d0ugaljtomasek: by the CLI07:47
d0ugaljtomasek: 'resource_registry': {'resources': {'*': {'*': {'UpdateDeployment': {'hooks': []}}}}}07:48
d0ugaljtomasek: No idea what it means, but wanted to make you aware07:48
d0ugaljtomasek: This is added on every stack update.07:48
*** ohamada has joined #tripleo07:48
*** liverpooler has joined #tripleo07:48
jtomasekd0ugal: hmm, interesting07:48
d0ugaljtomasek: Also, I just noticed out deploy action can't even re-deploy07:49
* d0ugal facepalms07:49
d0ugaljtomasek: it does create only.07:49
d0ugals/out/our07:49
jtomasekd0ugal: It that resource_registry addition is something that is required for stack update, then it would be nice if the action did it rather than CLI07:50
jtomasekd0ugal: that is where the data: ... could be used07:50
*** sshnaidm|afk has quit IRC07:50
d0ugaljtomasek: Yeah, I have no idea if it is required or what it means :)07:51
jtomasekd0ugal: IOW, just add it as another environment07:51
jtomasekd0ugal: yeah07:51
jtomasekd0ugal: we need to find out first07:51
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Mistral services  https://review.openstack.org/32343607:52
jtomasekd0ugal: I am testing the updated params/template processing/deploy actions from yesterday now07:52
d0ugaljtomasek: cool07:52
d0ugaljtomasek: I think the reviews look broken btw :/07:52
d0ugaljtomasek: The order of commits is wrong.07:52
d0ugalThe latest deploy commit is based on a really old parameters action commit07:53
jtomasekd0ugal: seems ok to me https://review.openstack.org/#/c/298732/2707:53
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Do not merge, checking composable mistral.  https://review.openstack.org/35294707:53
jtomasekd0ugal: processing -> params -> deployment07:53
d0ugaljtomasek: Yeah, but see the orange circles? It's showing you it isn't the latest one07:53
jtomasekd0ugal: ah I see07:54
d0ugaljtomasek: so you'll need to cherry pick them individually I guess07:54
jtomasekd0ugal: I cherry-picked anyway07:54
d0ugalah07:54
jtomasekd0ugal: as I am applying it on top of capabilities patches07:54
jtomasek:D07:54
jtomasekd0ugal: and to make GUI work completely I'd also have to apply validations patchset07:55
jtomasekd0ugal: btw. this one is broken for me https://review.openstack.org/#/c/355598/07:56
jtomasekd0ugal: need to figure out why07:56
d0ugallol07:56
*** aufi has joined #tripleo07:56
d0ugaljtomasek: I don't think I've ever seen that one07:56
jtomasekd0ugal: it's new07:56
openstackgerritDougal Matthews proposed openstack/python-tripleoclient: Migrate the deploy command to use the Mistral workflows  https://review.openstack.org/34226107:57
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds parameters actions  https://review.openstack.org/29868207:57
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds Deployment Action & Workflow  https://review.openstack.org/29873207:57
jaosoriorgfidente: I have an idea07:59
*** rbrady has quit IRC07:59
jaosoriorlets have the DNS hosts part optional07:59
*** dmacpher has quit IRC07:59
jaosoriorit will be enabled by default07:59
jaosoriorbut deployers could turn it off if they have DNS themselves07:59
*** rbrady has joined #tripleo07:59
jaosoriorgfidente: we could even have it as a composable service08:00
jaosoriorgfidente: https://docs.puppet.com/puppet/latest/reference/type.html#host08:01
*** milan has quit IRC08:01
gfidentethat's cool, we don't use puppet host type yet though08:01
*** sshnaidm has joined #tripleo08:02
jaosoriorgfidente: so if someone has DNS already. they could use hiera or something of the sort to not write to the /etc/hosts file08:02
gfidentebut I think we sould deprecate the element and move there if you have time for this08:02
jaosoriorgfidente: which element?08:02
gfidentewe're setting the hosts via an element08:02
gfidentewhich runs before puppet so the names are set in advance08:02
jaosoriorgfidente: I actually need to go in around half an hour but could work on this on friday08:02
gfidentebut if we find a way to deprecate it I think that'd be nice08:03
jaosoriorgfidente: I think it's possible08:03
jaosoriorwe need to have a puppet-tripleo patch that grabs a dict and does create_resources from that08:03
jaosoriorusing the host type08:03
jaosoriorand it also needs to take a flag so we can disable that08:03
gfidenteyes it should be, we need to make sure local hostname is resolved for puppet to work08:03
gfidentethis is someting cloud-init could do for us08:04
jaosoriorgfidente: exactly08:04
jaosoriorgfidente: do we set anything with cloud init at the moment?08:04
gfidenteI'd need to check actual status honesly08:05
gfidentenot sure08:05
openstackgerritGiulio Fidente proposed openstack/tripleo-puppet-elements: Ceph Jewel repos split packages into ceph-{mon,osd,radosgw}  https://review.openstack.org/35394508:09
*** bvandenh has joined #tripleo08:11
*** hewbrocca is now known as hewbrocca-afk08:14
*** bana_k has quit IRC08:15
*** hewbrocca-afk is now known as hewbrocca08:16
*** saneax_AFK has quit IRC08:20
jaosoriorbandini: httpd is no longer managed by pacemaker, right08:22
jaosorior?08:22
bandinijaosorior: correct08:22
jaosoriorbandini: this seems to run when doing a simple upgrade https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/post_puppet_pacemaker_restart.yaml08:23
jaosoriorbandini: and it ends up failing here https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/pacemaker_resource_restart.sh#L1908:23
bandinijaosorior: https://review.openstack.org/#/c/354891/08:24
jaosoriorbandini: DUDE nice!08:24
*** saneax-_-|AFK has joined #tripleo08:25
bandinijaosorior: :)08:25
mariosbandini: ahem https://review.openstack.org/#/c/321027/08:26
hewbroccaLooks like it just needs one eety beety +108:26
hewbroccaWorkflow...08:26
mariosbandini: honestly i didn't know we'd already moved there (things starting to no longer be pacemakerd)08:26
* social drops small note that now we'll need some tool to get cluster state - eg. on which nodes which service isn't running08:27
*** saneax-_-|AFK is now known as saneax_-_08:27
mariossocial: yeah that is for composable service upgrades though this is for we can't assume that everything is pcmkd managed on controllers08:27
mariossocial: luckily we don't have to deal with that part will newton..ocata08:27
hewbroccasocial: yeah you'd better help paramite out with ops-tools...08:28
hewbroccathat is going to be that tool08:28
mariosbandini: i need to dust that patch off and get it updated08:28
bandinimarios: yeah that one is on my todo for today08:28
mariosbandini: i think EmilienM updated it once too, when i was pulled to the magical land of 908:29
*** Goneri has joined #tripleo08:29
bandinimarios: we totally need that work so we can start sketching the upgrade Full HA -> NG scripts08:29
bandinimarios: lol08:29
mariosbandini: yah, i mean fwiw i tested it lots at the time (notes on the review) but as gfidente pointed out things have changed, services added, core no longer exists etc08:29
* bandini writes some more HA NG HA NG HA NG just to annoy Ng 08:29
mariosbandini: i will also try and get to it today08:29
mariosyeah the pacemaker0ng is really important08:30
mariosbandini: sorry, typo08:30
mariospacemaker-ng08:30
mariosbandini: or is is pacemaker ng08:30
bandinimarios: yeah but I think the changes on top are small. I'd rather get the functions landed sooner and then we will tweak once we get to play with upgrades08:30
mariosbandini: how do you write it? ng? or NG?08:30
bandinimarios: as long as it is NG it is all good08:30
mariosor Ng?08:30
* bandini chuckles08:30
* Ng maintains his calm and totally-ok-with-this face08:30
marioslol08:30
bandiniahahahah08:30
ccamachoguys mind to review https://review.openstack.org/#/c/355904/ (Make sahara run via systemd) and https://review.openstack.org/#/c/356622/  (Remove duplicate resource registry entry in puppet-pacemaker.yaml)08:35
ccamachoim working in a BZ and Ill like to have puppet-pacemaker.yaml aligned upstream with downstream :P08:37
*** jaosorior has quit IRC08:37
Ngccamacho: I wonder if it might be a good idea to rebase 356622 on top of 355904 - the two patches conflict and sooner or later one is going to have to be rebased on top of the other08:37
ccamachonp08:38
*** saneax_-_ has quit IRC08:40
*** athomas has joined #tripleo08:41
*** saneax has joined #tripleo08:43
*** zoli|brb is now known as zoli08:43
ccamachoNg, 355904 its behind HEAD a little bit, if I rebase the patch we will lose the votes :( I prefer land that first and then rebase 35662208:44
ccamachoalso 355904 passed CI08:44
Ngccamacho: agreed that 355904 should stay as-is, but 356622 can be made to depend on 355904 if you want08:44
Ngor we just wait for 355904 to land and then rebase :008:45
Ng:)08:45
*** sanjayu|AFK is now known as sanjayu08:45
*** sanjayu is now known as Guest1966608:45
*** limao has joined #tripleo08:46
ccamachoIm afraid to lose votes/CI results there if messing with git-review :P, lets land 355904 first08:47
*** derekh has joined #tripleo08:47
Ngccamacho: :)08:49
*** bootsha has joined #tripleo08:50
*** Guest19666 has quit IRC08:50
*** paramite has joined #tripleo08:50
*** sanjayu_ has joined #tripleo08:51
*** sanjayu_ is now known as sanjayu|AFK08:52
* bandini tosses an easy review in the channel https://review.openstack.org/#/c/356390/08:54
bandinifreshly passed CI, get it while hot!08:54
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates: Fix check of rpm-python.  https://review.openstack.org/35702208:56
gfidentebandini, so before that one haproxy was always going to one node?08:56
bandinigfidente: yep08:56
gfidentethese roles refactoring ...08:57
bandinimkrcmari found out the other day08:57
gfidente... I said we'd be seeing many like this ...08:57
*** jprovazn has quit IRC08:58
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates: Fix check of rpm-python.  https://review.openstack.org/35702209:00
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Availability monitoring agents support  https://review.openstack.org/25478809:01
jtomasekd0ugal: any idea on this? http://paste.openstack.org/show/560757/09:03
jtomasekd0ugal: I think the action should succeed even when setting the parameter values to empty string and even null09:04
gfidentebandini, one day we talk about http://githubengineering.com/context-aware-mysql-pools-via-haproxy/09:05
gfidentefeeling is mysql going to be big deal in large deployments09:05
gfidentewe had the idea of the check script already09:06
gfidenteit's just what they use it for09:06
*** _coolsvap_ is now known as coolsvap09:06
gfidentenice eh?09:07
* bandini looks09:07
*** zoli is now known as zoli|lunch09:07
*** d0ugal has quit IRC09:08
bandinigfidente: very nice, yes09:10
bandiniwe should totally look into that09:10
gfidentefunny thing is "we had the idea of the check script already"09:10
*** bootsha has quit IRC09:11
gfidentewe're actually halfway there09:11
*** d0ugal has joined #tripleo09:12
openstackgerritJiri Stransky proposed openstack/python-tripleoclient: Don't alarm users with "skipping postconfig" messages  https://review.openstack.org/35703909:13
*** milan has joined #tripleo09:13
*** akuznetsov has quit IRC09:17
*** d0ugal_ has joined #tripleo09:18
d0ugal_jtomasek: Sorry, internet dropped. looking now09:19
jtomasekd0ugal: no problem, I think the issue is on my side09:19
jtomasekd0ugal: I am probably doing json.stringify 2 times09:19
d0ugal_jtomasek: ah okay09:19
*** d0ugal has quit IRC09:20
d0ugal_We need to improve the error situation with these calls09:20
*** d0ugal_ has quit IRC09:20
*** d0ugal has joined #tripleo09:20
*** electrofelix has joined #tripleo09:28
openstackgerritMerged openstack/tripleo-heat-templates: Add tripleo-packages composable service  https://review.openstack.org/35560509:29
*** hjensas has quit IRC09:30
*** sshnaidm has quit IRC09:32
*** hjensas has joined #tripleo09:32
*** hjensas has joined #tripleo09:32
*** sshnaidm has joined #tripleo09:36
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Parameters listing and updating  https://review.openstack.org/35155409:40
*** tvignaud has joined #tripleo09:43
tvignaudzaneb: hi. Is there a bug ref for your openstack-heat changes for mitaka?09:44
hewbroccatvignaud: do you have a link for that review or any way to make it more specific?09:49
*** tosky has joined #tripleo09:49
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: SR-IOV nic agent changes in line with composable roles.  https://review.openstack.org/33219009:57
*** d0ugal has quit IRC09:58
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: Add sriov_numvfs in THT  https://review.openstack.org/34535209:59
*** mhenkel has joined #tripleo10:04
*** d0ugal has joined #tripleo10:05
*** zoli|lunch is now known as zoli10:10
*** zoli is now known as zoliXXL10:10
*** bootsha has joined #tripleo10:11
*** jprovazn has joined #tripleo10:13
*** dsariel has quit IRC10:14
*** pkovar has joined #tripleo10:23
*** bootsha has quit IRC10:26
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Availability monitoring agents support  https://review.openstack.org/25478810:27
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Monitoring node support  https://review.openstack.org/34969010:28
*** mburned is now known as mburned_out10:29
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds Deployment Action & Workflow  https://review.openstack.org/29873210:40
ccamachomarios gfidente, guys when having some free cycles mind to check this review ? https://review.openstack.org/#/c/355904/10:45
mariosccamacho: ack10:45
ccamachothanks :)10:46
gfidenteccamacho, yeah merged10:48
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Composable Mistral services  https://review.openstack.org/32343610:48
ccamachosupa! :)10:49
*** abehl has joined #tripleo10:51
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds Deployment Action & Workflow  https://review.openstack.org/29873210:52
*** coolsvap is now known as _coolsvap_10:55
*** padkrish has joined #tripleo10:58
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Do not merge, checking composable mistral.  https://review.openstack.org/35294711:06
*** mburned_out is now known as mburned11:06
*** nyechiel_ has joined #tripleo11:09
*** nyechiel_ is now known as nyechiel11:09
openstackgerritJiri Tomasek proposed openstack/tripleo-ui: Migrate Deploy action to Mistral  https://review.openstack.org/35712511:11
*** lucasagomes is now known as lucas-hungry11:13
d0ugaljtomasek: re-deploy should work now btw11:15
jtomasekd0ugal: cool, I'll take a look11:15
d0ugal... It both amuses me and worries me that I am the first person to try that out11:15
jtomasekd0ugal: does CI test it once CLI uses that code?11:16
d0ugaljtomasek: I don't think so, but I'm not sure.11:17
d0ugaljtomasek: I think we have upgrade jobs, so they should, right?11:17
*** vijaykc4 has joined #tripleo11:19
*** adarazs is now known as adarazs_lunch11:21
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-mon on controllers  https://review.openstack.org/35713011:22
*** padkrish has quit IRC11:22
gfidente jistr marios ^^ getting initial stuff for ceph ugrade11:22
*** stendulker has quit IRC11:24
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-mon on controllers  https://review.openstack.org/35713011:25
mariosgfidente: ack11:26
*** bootsha has joined #tripleo11:27
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile  https://review.openstack.org/33408111:29
*** ramishra has quit IRC11:31
Jokke_easy review for sale, "Only for you, only today my friend!" https://review.openstack.org/#/c/355394/ ;)11:31
*** bootsha has quit IRC11:32
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: DO NOT MERGE - Periodic test.  https://review.openstack.org/34694911:33
*** ramishra has joined #tripleo11:33
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile  https://review.openstack.org/33408111:34
*** maeca1 has joined #tripleo11:36
sshnaidmdoes anybody deal with undercloud installation failure in CI?11:37
*** nyechiel has quit IRC11:43
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Use sysvinit scripts for Ceph/Hammer restart during upgrade  https://review.openstack.org/35713911:44
openstackgerritMerged openstack/tripleo-ui: Stop Validation  https://review.openstack.org/33656111:44
*** asbishop has joined #tripleo11:44
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Use sysvinit scripts for Ceph/Hammer restart during upgrade  https://review.openstack.org/35714111:44
*** Goneri has quit IRC11:44
*** nyechiel has joined #tripleo11:44
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Use sysvinit scripts for Ceph/Hammer restart during upgrade  https://review.openstack.org/35714111:45
*** ayoung has quit IRC11:50
*** dprince has joined #tripleo11:52
*** nyechiel has quit IRC11:53
*** abehl has quit IRC11:55
EmilienMhola11:57
EmilienMsshnaidm: what kind?11:58
EmilienMlot of red on ovb http://tripleo.org/cistatus.html11:58
EmilienMsounds like something with nova/ironic?11:58
*** nyechiel has joined #tripleo11:59
sshnaidmEmilienM, https://bugs.launchpad.net/tripleo/+bug/161447511:59
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no eth1 was found" [Undecided,New]11:59
EmilienMah again?12:00
EmilienMdamn, I hoped we could have a promotion12:00
EmilienMsshnaidm: do you have a fix already?12:00
*** jpena is now known as jpena|lunch12:00
*** Goneri has joined #tripleo12:00
sshnaidmEmilienM, no, investigating12:00
openstackgerritCarlos Camacho proposed openstack/tripleo-common: Add backwards compatibility for openstackclient  https://review.openstack.org/35714712:00
*** jeckersb is now known as jeckersb_gone12:04
*** zoliXXL is now known as zoli|brb12:06
*** masco has quit IRC12:07
ccamachohey dprince, around? just have submitted https://review.openstack.org/357147 re the fix for upload-swift-artifacts, in my case the new version it's not working so I have added both (SWIFT_INTERNAL_URL), mind to check it when having some time?12:07
*** thrash|g0ne is now known as thrash12:10
dprinceccamacho: ack, so I used openstackclient master I think12:12
dprinceccamacho: which perhaps makes me a bit of an outlier, sorry for the breakage12:13
ccamachodo you think its possible to use both?12:14
dprinceccamacho: yes, it is just sad to see openstackclient breaking itself12:14
EmilienMjust an FYI CI is broken12:14
ccamacho:(12:15
*** jayg|g0n3 is now known as jayg12:15
sshnaidmderekh, hi12:17
EmilienMI thought we fixed that12:19
EmilienMin scripts/deploy.sh12:19
EmilienMwe do a sudo ip link set dev eth1 up12:19
EmilienMok let me dig also12:19
*** lucas-hungry is now known as lucasagomes12:19
EmilienMsshnaidm: do you have logs handy?12:21
sshnaidmEmilienM, I don't see there eth1 at all, not sure what happened. http://logs.openstack.org/55/356755/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/4370620/logs/undercloud/var/log/host_info.txt.gz12:22
EmilienMok12:22
EmilienMgot it12:22
EmilienMhttp://logs.openstack.org/14/354414/13/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/2dcd16b/logs/undercloud/var/log/undercloud_install.txt.gz#_2016-08-18_11_20_08_00012:23
gfidentetoday is the day I upgrade ceph12:23
EmilienMmaybe puppet is run before we create te eth112:23
gfidenteand add some bugs12:23
EmilienMlol12:23
gfidente:P12:23
*** vijaykc4 has quit IRC12:23
EmilienMI don't see the ip link command run12:24
EmilienMok found it12:26
*** padkrish has joined #tripleo12:26
hewbroccamarios: gfidente is adding bugs again12:26
hewbroccamarios: make him stop12:26
*** bootsha has joined #tripleo12:28
gfidentebandini, the thing is that we used to depend on -core which depended on galera/rabbit12:29
* marios puts a hit out on gfidente12:29
gfidenteso we had that 'constraint' before12:29
EmilienMit sounds like a problem with ovb nodes12:30
EmilienMdprince: I'm not root on tripleo infra12:30
EmilienMbut it seems like eth1 is not created12:30
EmilienMI could create a dummy interface but it seems like something went wrong in our tripleo infra12:30
*** pradk has joined #tripleo12:31
bandinigfidente: yes I know we had those. but we set max_db_retries to -1 for all services for this reason. If the service brakes because galera is gone it's a bug12:32
openstackgerritMerged openstack-infra/tripleo-ci: Add TripleO RSS Feed from Juan Antonio Osorio's blog  https://review.openstack.org/35689812:32
dprinceEmilienM: I can try to have a look.12:32
gfidentebandini, right I remember we had different values for gone vs restart12:32
openstackgerritMerged openstack/puppet-tripleo: Configure galera-monitor on all controller nodes  https://review.openstack.org/35639012:32
gfidentethough I agree, it'd be a cinder bug so sounds okay12:32
EmilienMdprince: thx. All ovb jobs are currently failing and I can't do much without root permissions. Though I could workaround with create a dummy interface like we do for multinode jobs but it's not fixing the problem12:33
*** bootsha has quit IRC12:34
bandinigfidente: if all hell will break lose, by all means we'll readd a constraint for the services that don't manage a fix in time12:34
*** athomas has quit IRC12:34
gfidenteac12:34
dprinceEmilienM: I'm not the biggest fan of tripleo::network::os_net_config12:35
*** jprovazn has quit IRC12:35
*** fultonj has joined #tripleo12:35
dprinceEmilienM: I hadn't realized we'd done that.12:35
dprinceEmilienM: probably okay for instack, but not a multi-node undercloud or overcloud I think12:35
EmilienMdprince: well it's the same thing as before dude12:36
EmilienMwe were running the exec in undercloud manifest12:36
*** vijaykc4 has joined #tripleo12:36
EmilienMand now we include this code from a class12:36
EmilienMsame result...12:36
EmilienMwhat we should do is to optionaly run it with a parameter, thing we never did until now12:37
dprinceEmilienM: perhaps, for now. I don't think it is where we want to end up for os-net-config. Shardy wrote a t-h-t script to do it which I like the best12:37
dprinceEmilienM: puppet for some things isn't good I think. I consider network interfaces as part of core provisioning so I'd like to abstract it away from Puppet12:38
saneaxsriov spec needs a push to merge please - the discussions have been addressed https://review.openstack.org/#/c/313872/12:38
EmilienMdprince: I don't disagree12:38
saneaxseeking the cores help on this12:38
EmilienMdprince: my poing is that the code is the same as before my patch12:39
EmilienMI just moved it12:39
*** jprovazn has joined #tripleo12:39
*** rlandy has joined #tripleo12:39
*** athomas has joined #tripleo12:39
dprinceEmilienM: I understand that. My worry is that someone else would see this and try to use it in the overcloud... because they can now. We need to -2 that12:39
EmilienManyway, eth1 is not on ovb jobs anyway12:39
EmilienMcan you ssh an ovb instance?12:39
*** jcoufal has joined #tripleo12:40
*** bfournie has quit IRC12:45
EmilienMdprince: ^12:46
dprinceEmilienM: it'll take me awhile. I've not been close to setting up the new cloud lately12:47
EmilienMok I'm going to try a workaround then12:48
hewbroccaEmilienM: zoli|brb is here if you need help with rh2...12:48
dprinceEmilienM: if 'address' isn't showing up it could imply the port isn't connected12:48
hewbroccaor rh1 rather12:48
*** rodrigods has quit IRC12:48
*** rodrigods has joined #tripleo12:48
*** jeckersb_gone is now known as jeckersb12:50
dprinceEmilienM: so there may not be a work around12:50
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: ovb: create dummy eth1  https://review.openstack.org/35718112:51
EmilienMdprince: ok, just trying "in case"12:51
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile  https://review.openstack.org/33408112:51
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add support for deploying Ceph RGW role  https://review.openstack.org/28902712:51
EmilienMzoli|brb: ping me when you back please12:52
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates: Remove OS::Tripleo::Services::ManilaShare: from puppet-pacemaker.yaml  https://review.openstack.org/35662212:52
*** morazi has joined #tripleo12:52
dprinceEmilienM: sure, try away. I think the dummy interface works for normal infra devstack jobs because they are single node12:52
dprinceEmilienM: in our case eth1 is what we provision other nodes with. It gets added to br-ctlplane... so if it isn't there I think it'll be a total failure to create a dummy interface for it12:53
*** julim has joined #tripleo12:53
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: [NO MERGE] Test Ceph RadosGW as replacement for Swift  https://review.openstack.org/35718212:53
sshnaidmdprince, EmilienM although it's weird that from yesterday vms were created without eth1 on ovb, did you see any changes related to that?12:54
EmilienMdprince: I agree, I'm just trying all I can without any access12:54
EmilienMpabelanger: you around?12:54
EmilienMsshnaidm: yes, pabelanger changed the openstackzuul flavor for rh112:55
EmilienMit might be related?12:55
EmilienMthe number of nic is not part of flavors but I might be wrong12:55
sshnaidmEmilienM, yes12:55
*** jpena|lunch is now known as jpena12:55
sshnaidmEmilienM, not part of, right12:55
hewbroccaderekh: you around?12:56
sshnaidmEmilienM, but if there were works on rh1, it could be something broken there, because I don't see any changes in code that could affect12:56
sshnaidmseems to me as pure infrastructure issue12:57
EmilienMsshnaidm: me neither12:57
EmilienMshadower: yes12:57
EmilienMerr12:57
EmilienMit's an infra thing for sure12:57
*** adarazs_lunch is now known as adarazs12:57
*** jtomasek has quit IRC12:57
sshnaidmEmilienM, any details what pabelanger was working on there..?12:58
sshnaidmI have an access, but no idea what was changed12:58
*** paramite has quit IRC12:58
*** padkrish has quit IRC12:58
*** tzumainn has joined #tripleo12:59
EmilienMsshnaidm: afik it was some config in zuul12:59
EmilienMbut I'm not sure12:59
*** weshay_ has joined #tripleo13:00
derekhhewbrocca: yup, hi13:02
hewbroccaderekh: we've got a problem with rh1 infra, hoping you could help13:03
hewbroccaalthough we may need pabelanger13:03
EmilienMderekh: ovb instances don't have eth113:04
EmilienMderekh: https://bugs.launchpad.net/tripleo/+bug/161447513:04
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no eth1 was found" [Critical,Confirmed]13:04
derekhEmilienM: looking13:04
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Revert "Upgrades: Add initialization stage to 'overcloud upgrade'"  https://review.openstack.org/35719213:05
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Revert "Upgrades: Add finish stage to 'overcloud upgrade'"  https://review.openstack.org/35719413:05
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Revert "Upgrades: Add 'stack upgrade' command"  https://review.openstack.org/35719513:05
*** zoli|brb is now known as zoli13:05
derekhEmilienM: here is where its going wrong http://logs.openstack.org/14/354414/13/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/2dcd16b/console.html#_2016-08-18_11_13_52_57223813:05
derekhEmilienM: 2016-08-18 11:13:52.572238 | 2016-08-18 11:13:52,568 - testenv-client - INFO - Received job : Couldn't retrieve env13:06
derekhEmilienM: the te-broker is failing to create test environments13:06
zoliEmilienM, ping13:06
zoliEmilienM, how can I help you?13:06
EmilienMzoli: hey, we're talking about it with derekh13:06
EmilienMderekh: I guess that's something I can't help much, without rh1 access13:07
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Revert "Upgrades: Add initialization to StackUpgradeManager"  https://review.openstack.org/35719713:07
*** cdearborn has joined #tripleo13:07
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Revert "Upgrades: Add post-upgrade stack update"  https://review.openstack.org/35719813:07
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Revert "Upgrades: Add StackUpgradeManager"  https://review.openstack.org/35719913:08
*** vijaykc4 has quit IRC13:08
derekhEmilienM: correct, slagle dprince are either of ye familiar with it? or do ye want to get familiar with it? /me is moving teams and trying to hand over this stuff when possible13:09
dprincederekh: I am trying to look13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no eth1 was found" [Critical,Confirmed]13:10
derekhEmilienM: btw, merge this to have CI fail when the error happens, so it should be more obvious in future whats going on https://review.openstack.org/#/c/341428/213:10
EmilienMderekh: slagle is on pto13:12
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Revert "Upgrades: Add initialization stage to 'overcloud upgrade'"  https://review.openstack.org/35719213:12
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Revert "Upgrades: Add finish stage to 'overcloud upgrade'"  https://review.openstack.org/35719413:12
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient: Revert "Upgrades: Add 'stack upgrade' command"  https://review.openstack.org/35719513:12
EmilienMderekh: +A13:12
sshnaidmderekh, I'm looking too13:12
*** egafford has joined #tripleo13:14
*** links has quit IRC13:16
*** bfournie has joined #tripleo13:17
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud node configure' command  https://review.openstack.org/34487513:18
*** liverpooler has quit IRC13:20
derekhsshnaidm: EmilienM so to get access to the relevant host you need to be in this list http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/tripleo-cd-admins13:20
derekhdprince: is looking at the te-broker at the moment to find the problem, if ye want ye can add your names to that list for future cases,13:22
EmilienMsure I'll submit my sshkey next week when i'm back from pto13:22
derekhor I could add them temporarily, I'm just reluctant to bypass the normal procedure without input from the other members of the team13:22
derekhbut a lot of people are on PTO so maybe circumstances mean we should do it13:23
sshnaidmderekh, ok, will submit it. I thought everything is here: https://github.com/openstack/tripleo-incubator/blob/master/tripleo-cloud/tripleo-cd-admins13:23
*** vijaykc4 has joined #tripleo13:25
derekhsshnaidm: no that repo is being retired, but looks like the other members of the team +2'd your additions so I'll add your key to the hosts now13:26
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add sshnaidm to tripleo-cd-admins  https://review.openstack.org/35721713:26
sshnaidmderekh, thanks13:27
derekhsshnaidm: dprince I'm going to add sshnaidm's key gimme a minute, then I'll talking ye through whats going on in the te-broker13:28
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Revert "Upgrades: Add initialization to StackUpgradeManager"  https://review.openstack.org/35721913:29
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Revert "Upgrades: Add post-upgrade stack update"  https://review.openstack.org/35722013:29
openstackgerritBrad P. Crochet proposed openstack/tripleo-common: Revert "Upgrades: Add StackUpgradeManager"  https://review.openstack.org/35722113:29
derekhsshnaidm: you should have access now, check mail13:30
*** paramite has joined #tripleo13:31
*** bootsha has joined #tripleo13:31
openstackgerritafazekas proposed openstack/tripleo-docs: Mention nested guest support  https://review.openstack.org/35722313:31
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates: Composable Zaqar services  https://review.openstack.org/33168213:31
sshnaidmderekh, I'm in, thanks13:32
dprincederekh: the bmc nodes in nodepool onlyt have a private net, no provision?13:33
derekhdprince: correct, they only need to talk to nova on the ovb overcloud13:33
derekhsshnaidm: dprince So on that server, every time a new env is requested by a ci job, this script is run13:33
derekh/opt/stack/tripleo-ci/scripts/te-broker/create-env13:34
derekhsomething is going wronge there13:34
derekhdprince: sshnaidm the output of that script and the associated destroy script is being logged here /var/log/testenv-worker.log13:35
*** lblanchard has joined #tripleo13:35
openstackgerritMerged openstack/diskimage-builder: Change DIB_IPA_CERT resulting file name  https://review.openstack.org/35544013:35
*** bootsha has quit IRC13:35
derekhdprince: sshnaidm so lets pick one that failed http://logs.openstack.org/14/354414/13/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/2dcd16b/console.html13:35
derekh2016-08-18 11:11:35.393794 | + /opt/stack/new/tripleo-ci/toci_gate_test.sh::L218:   ./testenv-client -b 192.168.103.254:4730 -t 10200 --envsize 4 --ucinstance f5175ebf-5fa7-493a-b295-714d19684cc6 -- ./toci_instack_ovb.sh13:35
derekhsee : --ucinstance f5175ebf-5fa7-493a-b295-714d19684cc613:36
dprincederekh: I see ERROR (CommandError): No server with a name or ID of 'f0944e41-8f51-4739-ab4b-5ce10c8cbbdf' exists.13:36
derekhwe can search for that uuid in t he logs and see why it failed13:36
dprincederekh: this is after trying to attache to the provisioning net13:36
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: newton/master add ssl option as default to True for the undercloud  https://review.openstack.org/35643113:36
derekhdprince: weird, I've seen this before but only if the CI job was killed by zuul before the interface was attached, this doesn't seem to be the case for f5175ebf-5fa7-493a-b295-714d19684cc613:38
dprincederekh: seeing it consistently at the bottom of the logs. I think it might be the cause of what we are seeing13:39
dprincea race?13:39
hewbroccaNothing like a good old fashioned race13:39
derekhdprince: yup, i'm pretty sure its the cause13:39
dprincederekh: should we put a 30 second loop in to wait for that net to show up perhaps?13:40
*** _coolsvap_ is now known as coolsvap13:42
dprincederekh: it is the compute actually. We need to wait on it?13:43
derekhno I don't think its timing13:44
derekhdprince: the script is trying to add an interfeace to a VM that has existed for ages13:44
dprincederekh: I'm seeing quota exceptions in nova-api too13:45
*** jprovazn has quit IRC13:45
dprincederekh: perhaps our tripleo-ci quote increases put us over the limite13:45
* dprince checks13:45
dprincederekh: 5b239209c0cd85a55e4b79793a6b3e399794bea9 in tripleo-ci bumps us to 5.5 Gigs13:46
derekhdprince: hmm, we might have quota problems also but likly would only hit them when the load is at peak13:47
derekhdprince: this is what I'm finding interesting13:47
dprincederekh: true13:47
*** jprovazn has joined #tripleo13:47
derekhdprince: the ovb nodes and the undercloud are now owned by different tenants, thats new, did it start today?13:48
derekhdprince: so now the openstack-nodepool tenant is trying to attach a interface to a node owned by openstackzuul13:49
dprincederekh: oh, that would do it13:49
dprincederekh: so perhaps an unrelated infra change here?13:49
derekhdprince: but because its not in the same tenant it gets " No server with a name or ID ...."13:49
derekhdprince: exactly, looking to see if I can find out when that changed13:50
dprincederekh: 398c082c1fc9f40b9369d4236bd56c519d07cdee13:51
dprincederekh: in site-config13:51
dprincepabelanger: hey, this is your commit ^^^13:51
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud plan list' command  https://review.openstack.org/35049813:52
openstackgerritJulie Pichon proposed openstack/python-tripleoclient: Add 'openstack overcloud plan delete' command  https://review.openstack.org/35061713:52
sshnaidmderekh, which credentials should use this script (create-env)?13:52
dprincederekh, pabelanger: that commit might be fine. Could just be the config file driving it needs a tweek to use the correct tenant for us?13:52
sshnaidmderekh, I mean, openstackzuulrc or nodepoolrc, or..?13:53
dprincehttps://github.com/openstack-infra/system-config/commit/398c082c1fc9f40b9369d4236bd56c519d07cdee13:54
dprincethat is the only thing I saw related to a tenant change that would effect us13:54
derekhsshnaidm: createnv sources /etc/nodepoolrc so its resources are created as openstack-nodepool13:54
sshnaidmderekh, yeah, I see you found this too..13:54
*** limao has quit IRC13:56
*** ayoung has joined #tripleo13:57
*** limao has joined #tripleo13:58
*** limao has quit IRC13:58
derekhdprince: sshnaidm the new credential started getting used yesterday13:59
derekhdprince: sshnaidm http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-08-17.log.html13:59
derekh#status log tripleo-test-cloud-rh1 credentials update on nodepool.o.o to use opentackzuul project13:59
EmilienMyeah they updates the cloud.yamll14:00
EmilienMto use new credentials14:00
dprincederekh: can we just hard code the correct TENANT for now?14:00
EmilienMit must be related, maybe quotas or14:00
derekhEmilienM: yup, I think this is what causing the problem14:01
*** padkrish has joined #tripleo14:01
derekhdprince: probably if somebody knows the credentials14:01
derekhdprince: also the opentackzuul tenant will need the correct amount of quota set (if it hasn't already)14:02
beaglesI was looking at https://bugs.launchpad.net/tripleo/+bug/1613743...14:03
openstackLaunchpad bug 1613743 in tripleo "Neutron Metadata puppet config incorrect in THT" [Medium,In progress] - Assigned to Tim Rozet (trozet)14:03
trozethi beagles14:03
beaglesis that true that passing a string via hieradata for 'false' or 'true' will end up being evaluated to "true" in puppet?14:03
beagleshi trozet14:03
*** larstobi has quit IRC14:04
beaglesI was going to check it out, but thought I would just ask.. I seem to recall we do that in a few places14:04
beaglesdprince ^ ?14:04
trozetbeagles: I'm not sure in this case.  I've seen different behaviors with string translation, where sometimes you even have to double quote stuff to get it to become a string in hiera14:05
trozetbeagles: but regardless, boolean is a more appropriate value14:05
*** larstobi has joined #tripleo14:06
beaglestrozet, sure.. just wondering if we need to do an audit pass14:06
trozetbeagles: oh14:06
trozetbeagles: whenever I see these I try to fix them if i'm patching something relevant14:06
trozetbeagles: i have deployment setup let me check it14:06
*** weshay_ is now known as weshay_mtg14:06
hewbroccadprince and derekh so is this quickly fixable?14:08
karthiksEmilienM,  Regarding https://review.openstack.org/#/c/337264/,  since the dependent puppet patch is already merged, could you please recheck ?14:08
*** tbonds has quit IRC14:09
EmilienMkarthiks: please set the default to []14:09
EmilienMit's an empty array14:09
dprincehttp://paste.openstack.org/show/560805/14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]14:10
dprincethe quotas for openstackjenkins and openstackzuul match14:10
dprincederekh: ^14:10
EmilienMright they do14:10
EmilienMcould it be another quota?14:10
EmilienMin neutron or?14:10
trozetbeagles: looking at my hieradata on my deployment (where IsolatedMetadata is set to string by default), it looks like it becomes a bool14:11
trozetbeagles: [root@overcloud-controller-0 ~]# hiera  neutron::agents::dhcp::enable_isolated_metadata14:11
trozetfalse14:11
derekhhewbrocca: hopefully but it undoes what pabelanger was trying to achieve14:11
beaglestrozet, you are in a maze of twisty passages, all alike14:11
trozetbeagles: i was grep'ing through all my environment files to make sure I don't override that value to be a bool anywhere14:12
derekhdprince: ok, wanna change the creds in /etc/nodepoolrc and see if it starts working14:12
trozetbeagles: so I think it does get translated, but I also think we should fix it everywhere we can14:12
d0ugaldprince: This is ready: https://review.openstack.org/#/c/33761514:12
d0ugaldprince: and https://review.openstack.org/#/c/29868214:12
karthiksok EmilienM14:12
beaglestrozet, ack14:12
d0ugaldprince: ... and the deploy one will be shortly, I just need to fix the tests I broke earlier.14:12
d0ugaldprince: I think CI might be having issues, ^ neither of those will be covered by CI anyway.14:13
trozetbeagles: also I recall another bug I filed/fixed where the value was being passed to puppet as a string, and puppet was doing an if {variable} on it and it was always returning true because puppet saw "False"14:13
dprinced0ugal: ack, and yep. We are working on it14:14
d0ugalcool :)14:14
dprincederekh: yes, lets do it I guess. Let me see14:14
beaglestrozet, ahhhhh... I vaguely recall that yeah.14:14
beaglestrozet, thanks for the clarification!14:15
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: WIP: Convert the full documentation to rST  https://review.openstack.org/35724814:17
dprincederekh: changed14:18
dprincederekh: might take awhile to see if this plays out... I guess we'll see14:19
derekhdprince: yup14:19
dprincederekh: should I force delete all nodepool instances to speed it along?14:19
dprincederekh: to be clear I set both the username and tenant to 'openstackzuul'14:20
dprincehewbrocca: ^^ this might fix it14:20
hewbroccacrazy stuff14:20
hewbroccadprince: but we'll have to figure out a better way to do what pabelanger wanted, right?14:20
dprincehewbrocca: this might just be fine. All we are doing is aligning the tenants that get used in various places I think14:22
dprincehewbrocca: but yes, I do want pabelanger to review this...14:22
ansiwenEmilienM: just a very short question: the service_available/ec2api was unnecessary, instead I will expose [aws] parameters now. shall I revert the old change, or just remove that in the [aws] change?14:22
derekhdprince: you may need to delete nodepools baremetal_* heat stacks14:22
derekhdprince: what pabelanger is trying to achieve it to have nodepool be the only client responsible for all instances in the tenant it uses, because nodepool currently is loggin errors about alien VM's14:24
dprincederekh: done14:24
derekhdprince: what we've just done will make his nodepool error messages return14:24
EmilienMansiwen: don't revert, remove what is useless and add what is useful ! thanks for working on that14:24
dprincederekh: yep, good point14:25
ansiwenEmilienM: ok!14:25
sshnaidmdprince, where did you change the tenant name? in which file?14:25
dprincederekh: perhaps a worthy goal but it needs actually work too :)14:25
derekhdprince: yup14:25
dprincesshnaidm: in /etc/nodepoolrc on the te-broker14:25
dprincesshnaidm: I left a comment14:26
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo: Add Ceph RGW profile  https://review.openstack.org/33408114:27
dprincederekh, sshnaidm: no stacks for openstackzuul yet. I guess when we see those we'll know it works?14:27
dprincederekh: we should actually make this change dynamic, so that no matter what pabelanger does they get alien VMs14:28
derekhdprince: yep14:28
dprincederekh: :)14:28
derekhlol14:28
* dprince likes how this IRC thread reads now14:28
* derekh goes for tea14:28
*** vijaykc4 has quit IRC14:29
dprincesshnaidm, derekh: okay, It is trying to create stacks14:29
dprincethis error now due to no images: http://paste.openstack.org/show/560810/14:30
sshnaidmdprince, it fails14:30
pabelangermorning14:30
pabelangerjust catching up on backscroll14:30
pabelangerwe chanced from using the openstack-nodepool user to openstackzuul user14:30
pabelangerwhich means we are using a new project to launch nodes14:31
dprincepabelanger: ack, and that caused our network attach commands to fail14:31
dprincepabelanger: because things were in different tenants for us14:31
pabelangerright, that was the man reason for the change. So nodepool doesn't see your private infrastructure14:31
pabelangerdo you have a patch up to fix?14:32
dprincepabelanger: well, it breaks us :/14:32
sshnaidmpabelanger, we used the old one here: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/te-broker/create-env#L1214:32
dprincepabelanger: no patch. We've just switch our /etc/nodepoolrc to use new credentials14:32
dprincepabelanger: so you're problem will come back w/ Alien VM warnings. But our cloud will have a chance at working14:33
dprincepabelanger: we've been down since yesterday14:33
dprincepabelanger: it might be best to revert yesterdays change in infra14:34
pabelangerRight, so in that case we can just revert to openstack-nodepool, but we need to fix the alien vm. it is becoming probematic in our nodepool debug logs14:34
dprincepabelanger: cause I'm gonna need to change a bunch more to make this work in the new tenant: http://paste.openstack.org/show/560810/14:34
pabelangeris there a way to use different projects for that?14:34
pabelangeryes, I can revert now14:34
dprincepabelanger: exactly14:34
dprincepabelanger: I will put our nodepoolrc back to its previous state then14:34
pabelangersure, give me a minute14:34
dprincepabelanger: change is done for me14:35
openstackgerritTomas Sedovic proposed openstack/tripleo-common: Allow multiple validation sources  https://review.openstack.org/35725814:36
pabelangerreverted, will take a few mins for nodepool to update14:36
dprincepabelanger: ack, thanks. WHen that hits ping me and I'll cleanup the stacks in the old tenant14:36
sshnaidmdprince, so not to upload image to other tenant?14:36
dprincesshnaidm: not yet I think. using the old tenant now that pabelanger is involved is much easier I think14:37
pabelangerokay, so just to confirm, today you cannot have 2 tenants (openstack-nodepool) for your private infrastructure and openstackzuul for nodepool only resources? That was the issue at hand.  To do that will require some dev work to make it happen14:38
*** jprovazn has quit IRC14:39
dprincepabelanger: it may require dev work. I think we just need to tune the configuration a bit such that nova allows you to attach to networks in the separate tenant14:39
openstackgerritMerged openstack-infra/tripleo-ci: Fail fast if a testenv couldn't be created  https://review.openstack.org/34142814:39
dprincepabelanger: the exception we were seeing indicated Nova couldn't see the instance which we were trying to attach a NIC to14:40
dprincepabelanger: you can view these exceptions in the /var/log/testenv-worker.log on our te-broker I think14:40
openstackgerritDougal Matthews proposed openstack/tripleo-common: Adds Deployment Action & Workflow  https://review.openstack.org/29873214:40
d0ugalrbrady, dprince: ^ unit test fixed14:40
dprincepabelanger: looks like they were happening consistently since yesterday14:40
* d0ugal will brb14:41
*** padkrish has quit IRC14:41
*** d0ugal has quit IRC14:41
pabelangerdprince: sure, who's the best person to dive more into the failure?14:41
dprincepabelanger: I can try to help you. But not this week :)14:42
dprincepabelanger: anyone nova or neutron can help too here I think14:42
dprincepabelanger: or maybe keystone too since it is project/tenant related14:43
dprincepabelanger: if you configured your dev environment in a similar fashion (with 2 tenants) it should be easy to replicate14:43
pabelangerright14:43
dprincepabelanger: this command failed14:43
dprincepabelanger: nova interface-attach --net-id $(neutron net-show -F id -f value $PROVISIONNET) $UCINSTANCE14:43
*** aufi has quit IRC14:44
pabelangerand that would run from the openstack-nodepool user to an instances in openstackzuul14:44
dprincepabelanger: yep, either direction would probably replicate the failure14:45
pabelangerya, okay. I'll dive into this later today14:45
pabelangermaybe try again next week14:45
openstackgerritMerged openstack/tripleo-heat-templates: Add tripleo-firewall composable service  https://review.openstack.org/35561414:46
sshnaidmpabelanger, maybe it's better send mail in such cases, so that everybody will know that some issues could be expected14:47
*** d0ugal has joined #tripleo14:48
*** rajinir has joined #tripleo14:49
*** vijaykc4 has joined #tripleo14:50
sshnaidmwhat is DSS Cinder CI that checks tripleo-ci repo?14:50
pabelangersshnaidm: sure, we talked about it a few weeks ago plus yesterday.  I'll send out an email about the work we are doing and why14:51
pabelangeralso DSS Cinder CI shouldn't be, and its been disabled I believe14:52
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add sshnaidm to tripleo-cd-admins  https://review.openstack.org/35721714:52
*** numans has quit IRC14:52
sshnaidmpabelanger, saw it in this patch ^^14:52
sshnaidmMerge Failed14:53
dprinced0ugal, rbrady: one thing I noticed is that we are defaulting to the 'overcloud' swift contiainer in multiple places. http://git.openstack.org/cgit/openstack/tripleo-common/tree/scripts/upload-swift-artifacts#n5714:55
dprinced0ugal, rbrady: I'm wondering if one of these should default to a different location for ease of debugging and clarity14:56
bfournieWondering if someone could review this? Just a one-line change and has a +2 - https://review.openstack.org/#/c/350787/14:56
bfournieThanks14:56
dprincebfournie: +2, +A. Thanks14:57
*** vijaykc4 has quit IRC14:57
bfourniedprince: Thank you!!14:57
*** vijaykc4 has joined #tripleo14:58
*** penick has quit IRC14:59
pabelangerdprince: I don't have access to your testenv-worker, can you share /var/log/testenv-worker.log ?14:59
*** tbarron|afk is now known as tbarron15:00
*** milan has quit IRC15:00
*** thrash is now known as thrash|biab15:00
*** saneax is now known as saneax-_-|AFK15:01
dprincepabelanger: i just emailed you a snippet with everything you need to see for one of the job failures15:01
gfidenteslagle, do you know why we set selinux in permissive mode for centos bw?15:02
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Availability monitoring agents support  https://review.openstack.org/25478815:03
d0ugaldprince: What location would you suggest?15:05
nyechielhello, can you please take a look at https://review.openstack.org/#/c/335173/15:05
nyechielthanks!15:05
dprinced0ugal: just wondering if we should change one of them15:08
jeckersbhm, building overcloud images is failing for me with - "No package python-hardware-detect available.", yet yum shows python-hardware-detect.noarch 0.18.1-0.20160707154450.e36c931.el7.centos as available15:09
jeckersbany ideas?15:09
*** d0ugal has quit IRC15:09
*** dtrainor has quit IRC15:09
*** nico_auv has joined #tripleo15:09
*** dtrainor has joined #tripleo15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]15:10
pabelangerdprince: credentials reverted, I am going to use a1273ffa-4d3b-45a6-a7ac-2e7f63043092 in opentackzuul for testing, if you can keep it alive15:10
pabelangerrevert is live I mean15:11
hewbroccapabelanger: thanks for your help15:14
*** bfournie has left #tripleo15:15
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: SR-IOV nic agent changes in line with composable roles.  https://review.openstack.org/33219015:16
*** coolsvap is now known as _coolsvap_15:16
hewbroccadprince: does this mean we're all fixed now?15:18
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: Add sriov_numvfs in THT  https://review.openstack.org/34535215:18
dprincehewbrocca: we should be good15:18
dprincehewbrocca: we'll see in a few15:18
*** bfournie has joined #tripleo15:18
hewbroccarock15:19
pabelangerdprince: can you give openstack-nodepool user rights to openstackzuul?15:19
hewbroccadprince: derekh thanks15:19
pabelangererr15:19
pabelangercan you give openstack-nodepool right to access openstackzuul15:19
derekhhewbrocca: np15:19
*** rcernin has quit IRC15:22
karthiksEmilienM, beagles Regarding review https://review.openstack.org/#/c/344829/,  if the default value set in THT is '', it still overrides the puppet's default15:22
dprincepabelanger: probably15:22
beagleskarthiks, that's okay isn't it as long as it's treated as empty15:22
beagles?15:23
beagleskarthiks, because nova has it's own default and that's what we are trying to enable15:23
beaglespuppet having a default value there other than $::os_service_default is probably wrong15:23
pabelangerI suspect, https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/te-broker/create-env#L44 we need to either source new openstackzuul credentials to run that command, or hopefully give openstack-nodepool permission to access openstackzuul.15:24
karthiksbeagles, The default value in puppet-nova for scheduler_available filter is ['nova.scheduler.filters.all_filters'].15:24
*** d0ugal has joined #tripleo15:25
*** thrash|biab is now known as thrash15:25
hewbroccaparamite: hey, are we deploying ops-tools on a separate node, or as a separate stack entirely?15:27
skramajadsneddon: bfournie i have rebased dpdk os-net-config changes and patched for beagles 's comment.. please take a look.. https://review.openstack.org/#/c/349183/ https://review.openstack.org/#/c/338694/15:27
hewbroccabandini: maybe you know?15:28
beagleskarthiks, mmm.. okay you are saying that this results in an entry in a nova.conf file that has no value?15:28
EmilienMkarthiks: what is result?15:29
beagleskarthiks, if it results in not being set at all, that's good, but an empty entry is ungood15:29
EmilienMbeagles++15:29
karthiksEmilienM,  beagles , nova.conf  did not have entry for scheduler_available_filters15:29
pabelangerdprince: derekh: so, if we need to attached the public network to centos-7 nodes in tripleo-test-cloud-rh1, why doesn't nodepool just do it?  Rather then using the script on the te-broker?15:29
pabelangerderekh: dprince: that would simplify things greatly15:30
pabelangertoday, nodepool is only attaching to the private network15:30
beagleskarthiks, if I understand you correctly, that sounds like what we want15:30
EmilienMkarthiks: great15:30
EmilienMyes15:30
dprincepabelanger: because te-broker creates these networks I think15:31
EmilienMso it's good, '' does what we want :) which is "noop"15:31
dprincepabelanger: each environment has its own networks15:31
EmilienMkarthiks: did you check on overcloud controller nodes?15:31
dprincepabelanger: nodepool doesn't have concepts for this I think15:31
pabelangerAh, okay15:31
pabelangerI was only looking at the default, which was public15:31
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Proper rST formatting of README.rst  https://review.openstack.org/35730715:32
karthiksEmilienM, yes. since this config will be updated only on controller nodes15:32
derekhdprince: pabelanger yup, thats correct, the provisioning network doesn't exists when nodpool creates the slave and there is one per CI job15:32
beagleskarthiks, good stuff!15:32
*** ebarrera has quit IRC15:32
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Add nodepoolrc-openstackzuul to te-broker  https://review.openstack.org/35730815:33
paramitehewbrocca, it is a plan to deploy datastores/aggregators in a separate nodes, data collectors will be deployed on overcloud nodes of course15:33
pabelangerderekh: okay, so at first glance, I think this is what we need to do now ^.  Or see about give openstack-nodepool the permissions to interact with openstackzuul15:33
hewbroccaparamite: OK, cool15:33
pabelangerderekh: if you add the permissions, I can do the test now15:33
hewbroccaparamite: are you guys feeling like you'll make Newton?15:33
paramitehewbrocca, but nothing it merged yet though15:33
hewbroccaOK15:34
pabelangerhave 2 instances going between projects in tripleo-test-cloud-rh115:34
karthiksEmilienM, beagles so if there is no entry for scheduler_available_filters, will nova take the default as 'nova.scheduler.filters.all_filters' ??15:34
paramitehewbrocca, well, we are doing our best to have make it to newton, but as I said, no patch landed yet15:34
hewbroccaparamite: I hear you15:34
hewbroccaOK15:34
paramitehewbrocca, sensu agents patch is done, just needs to be merged (rebase/CI hell mode currently)15:35
hewbroccaright...15:35
paramitehewbrocca, larsks is working on fluentd agents patch15:35
larskshewbrocca: ...and larsks could use some feedback on the design of the patch... :)15:36
paramitehewbrocca, when this is done we will give hands to bandini with monitoring node implementation15:36
tvignaudEmilienM: any news on the CI front (me lazy to read the above irc logs)?15:36
hewbroccalarsks: roger that15:36
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-osd  https://review.openstack.org/35731215:36
beagleskarthiks, yup.. https://github.com/openstack/nova/blob/282c257aff6b53a1b6bb4b4b034a670c450d19d8/nova/conf/scheduler.py#L9415:37
beaglesI just realized that nova.conf is not being generated with docs these days15:39
derekhpabelanger: added comment to the review, do you know what permissions need to be added and how ?  <--- dprince15:39
EmilienMkarthiks: yes15:39
beaglesso it is no help here15:39
EmilienMbeagles was faster to find link again15:39
dprincederekh: not off the top of my head15:39
beaglessorry karthiks, it isn't clear at all that is what is going to happen when nova.conf is now just a bunch of bare entries (if that is what you are seeing)15:40
pabelangerdprince: I am wondering if adding openstack-nodepool user as a member of openstackzuul project is the missing part.  I am thinking it is a permission issue why the instance id was not found15:40
beagleskarthiks, I'm used to seeing a config file with everything documented - including the defaults if they aren't set15:40
dprincepabelanger: yep, it may be that simple15:40
beagleskarthiks, anyways, we should be good!15:41
beagles.. besides, if this goes in and fails CI and hell breaks loose, it'll be on me now :)15:41
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Add nodepoolrc-openstackzuul to te-broker  https://review.openstack.org/35730815:41
pabelangerderekh: updated, see my comment to dprince, it should have been for you15:42
EmilienMtvignaud: wip15:42
tvignaudok15:42
pabelangeralso, /etc/nodepoolrc-openstackzuul would need to be created15:42
karthiksEmilienM, beagles, So  I'll set the default to [] ?15:44
openstackgerritMerged openstack/tripleo-heat-templates: Upgrade scripts to migrate aodh alarm data  https://review.openstack.org/35304215:45
EmilienMkarthiks: have you tried right?15:45
dprincepabelanger: commented15:45
EmilienMkarthiks: and result is "parameter is not set in nova.conf" ?15:45
EmilienMkarthiks: if yes, then go for []15:45
beagleskarthiks, fwiw, I'm good either way. I only brought it up because of the other patch15:46
*** dmacpher has joined #tripleo15:46
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-mon on controllers  https://review.openstack.org/35713015:48
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Rework the pacemaker_common_functions for M..N upgrades  https://review.openstack.org/32102715:48
pabelangerdprince: is the neutron network created by heat?15:49
karthiksEmilienM, yes I've verified the nova.conf in controller and the parameter is not present.  with beagles comment if nova handles the default itself, then it might be OK15:49
derekhpabelanger: adding the openstack-nodepool to the openstackzuul project, presumably we would then be running the interface-attach command as part of the openstackzuul project, then it wouldn't see the network15:49
EmilienMkarthiks: go4it15:49
karthiksThanks EmilienM  beagles15:50
*** chem has quit IRC15:50
pabelangerderekh: right, that's what dprince just pointed out. how is the network created today, with heat?15:50
pabelangerwe'd need to share the public-foo and provision-foo networks between the projects15:51
*** chem has joined #tripleo15:52
derekhpabelanger: yes heat creates the network as the openstack-nodepool user15:54
pabelangerderekh: okay, is that --shared=true today?15:55
pabelangertrying to fine where that is done15:55
derekhpabelanger: probably not, its one of the templates in here https://github.com/cybertron/openstack-virtual-baremetal/tree/master/templates15:56
openstackgerritHaïkel Guémar proposed openstack/tripleo-ui: Add packaging spec and config files  https://review.openstack.org/34493215:56
*** weshay_mtg is now known as wesha_15:59
*** wesha_ is now known as weshay_15:59
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-mon on controllers  https://review.openstack.org/35713015:59
derekhpabelanger: here I think https://github.com/cybertron/openstack-virtual-baremetal/blob/master/templates/quintupleo.yaml#L131-L15715:59
pabelangerokay, let me see if I can do this with heat16:01
pabelangerfirst time for everything16:01
*** leanderthal is now known as leanderthal|afk16:01
tvignaudEmilienM: how many time left before you leave?16:03
EmilienMtvignaud: 1h16:04
EmilienMtvignaud: can I help on something?16:04
*** vijaykc4 has quit IRC16:05
tvignaudEmilienM: just to know if you'll still be here if/when we try to land https://review.openstack.org/#/c/356754/16:05
hewbroccaI would suggest bnemec-pto help, but...16:06
EmilienMtvignaud: no need to push more, people know about this patch16:06
*** padkrish has joined #tripleo16:08
tvignaudEmilienM: sorry :-)16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447516:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]16:10
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart: Enable sahara tests on tempest  https://review.openstack.org/35733216:10
karthiksEmilienM, There is an issue during overcloud update. In first deployment we set scheduler_available_filter='all filters', parameter is updated in nova.conf. In next deployment we set scheduler_available_filter=[],  but the parameter is not cleared.16:11
EmilienMkarthiks: I think beagles can help on this thing ;-)16:12
EmilienMhe has a patch that fix that bug16:12
pabelangerderekh: EmilienM: dprince: can you review my heat syntax? https://github.com/cybertron/openstack-virtual-baremetal/pull/2816:12
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-mon on controllers  https://review.openstack.org/35713016:12
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-mon on controllers  https://review.openstack.org/35713016:13
openstackgerritMerged openstack/tripleo-heat-templates: Add management network to list of networks to ping  https://review.openstack.org/35078716:13
beagleskarthiks, yeah.. I'm in a meeting at the moment, but there was a fix to the modules that you wouldn't have unless you built recently and with puppet source.16:13
*** yamahata has joined #tripleo16:13
beagleskarthiks, but let me get back with you after mtg to confirm, k?16:13
EmilienMpabelanger: it lgtm16:14
EmilienMbut who can approve that if ben is not here?16:14
pabelangerwho is cybertron?16:14
*** zoli is now known as zoli|gone16:14
pabelangerah bnemec-pto16:14
hewbroccaSee you folks, enjoy16:14
karthiksEmilienM, beagles ok16:14
*** zoli|gone is now known as zoli_gone-proxy16:15
*** vijaykc4 has joined #tripleo16:15
derekhpabelanger: EmilienM he left commit access with stevebaker if anything urgent comes up but if its not urgent he might want to take a look himself16:15
EmilienMderekh: I thought it was urgent16:17
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: WIP: Convert the full documentation to rST  https://review.openstack.org/35724816:18
derekhEmilienM: ci should now be onblocked, we're now trying to figure out how to achieve what pabelanger was trying to do16:18
pabelangeris https://github.com/cybertron/openstack-virtual-baremetal/blob/master/templates/env.yaml.example for only tripleo-ci?16:18
pabelangeror do you expect other people to use it16:18
beagleskarthiks, can you check the hieradata on the overcloud controller node to see what's getting there?16:18
derekhpabelanger: I'd expect others to use it, we edit it in create-env16:18
karthiksbeagles, []16:19
EmilienMderekh: unblocked you mean?16:19
EmilienMderekh: can we do recheck?16:19
derekhEmilienM: yup, sorry16:19
EmilienMok thx16:19
EmilienMtrying to get a CI promotion before PTO leave16:19
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: DO NOT MERGE - Periodic test.  https://review.openstack.org/34694916:19
derekhEmilienM: go for it16:19
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: DO NOT MERGE - Periodic test.  https://review.openstack.org/34694916:19
beagleskarthiks, okay cool.. 1s16:20
EmilienMtvignaud: now it's good. /me doing recheck on the patches we need16:20
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart: Convert the full documentation to rST  https://review.openstack.org/35724816:20
*** vijaykc4 has quit IRC16:20
*** Goneri has quit IRC16:20
tvignaudEmilienM: thx16:20
derekhEmilienM: we havn't confirmed everything is working yet but the user has been switched back16:21
EmilienMderekh: ok16:21
pabelangerderekh: okay16:21
*** nico_auv has quit IRC16:22
beagleskarthiks, did you build your overcloud images to use packages or source for the puppet modules and if source, how long ago was that?16:22
*** bana_k has joined #tripleo16:23
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Add nodepoolrc-openstackzuul to te-broker  https://review.openstack.org/35730816:23
skramajabeagles: i was testing with karthiks.. we are using tripleo-quickstart (master) a week older..16:24
pabelangerderekh: EmilienM: dprince: okay, that should be how we enable shared networks ^16:24
EmilienMdprince: could you +2 if patches look good? https://review.openstack.org/#/c/356754/ and https://review.openstack.org/#/c/356755/16:24
skramajabeagles: if you could give the review link, i can check if the code is present or not..16:24
beaglesskramaja, given the timeframe there might be a few :)16:25
*** padkrish has quit IRC16:25
beaglesskramaja, 1s16:25
skramajaok16:25
beaglesskramaja, here is one https://review.openstack.org/#/c/355235/16:25
derekhpabelanger: did the credential change go ok? nodepool doesn't seem to be starting any jobs?16:26
derekhdprince: ^16:26
*** tesseract- has quit IRC16:26
beaglesskramaja, sorry that's the backport to mitaka, but the code is the same16:27
dprincederekh: I reverted back the /etc/nodepoolrc file16:27
pabelangerderekh: yes: http://grafana.openstack.org/dashboard/db/nodepool-tripleo-test-cloud16:27
dprincederekh: must be on nodepool side?16:27
pabelangerlikely overloaded the cloud when we launched 75 nodes16:27
skramajabeagles: this change is NOT present our overcloud image..16:28
pabelangerderekh: if you start killing a few off at a time, nodepool will relaunch16:28
derekhdprince: pabelanger: ahh ok, we may have to wait a bit so16:28
beaglesskramaja, ack.. it was a very recent change16:28
pabelangerotherwise, it takes 1 hour to time uot16:28
pabelangerout*16:28
pabelangerwe also needed new images, so that didn't help16:28
skramajabeagles: ok..16:28
derekhpabelanger: so just nova delete them?16:29
skramajaEmilienM: beagles: now we know why update was not working..16:29
pabelangerderekh: ya, a few at a time16:29
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Enable shared networks for te-broker  https://review.openstack.org/35730816:29
openstackgerritPaul Belanger proposed openstack-infra/tripleo-ci: Add nodepoolrc-openstackzuul to te-broker  https://review.openstack.org/35734116:29
pabelangerokay, over 2 commits now. So we can roll shared network in first16:29
beaglesskramaja, because of this patch?16:29
pabelangerconfirm we can run commands manually16:30
pabelangerthen migrate16:30
beaglesskramaja, or lack thereof or because of another reason?16:30
skramajabeagles: i thought it was because of this patch, since you have said so :)16:30
beaglesskramaja, hah, it might be a factor :)16:31
skramajaok.. gotcha..16:31
beaglesskramaja, the fast way to know would be to patch the puppet in your overcloud image and re-run update16:31
*** stendulker has joined #tripleo16:32
skramajabeagles: i will do that..16:32
skramaja;q16:32
beaglesskramaja, but... you need to do something else too.. gotta think for a sec :)16:32
*** ohamada has quit IRC16:33
*** hewbrocca is now known as hewbrocca-afk16:33
beaglesskramaja, can you check if your heat templates has the EnableConfigPurge option in puppet/services/neutron-base.yaml16:34
*** ccamacho has quit IRC16:34
beaglesskramaja, well nova-base.yaml is really the relevant one but if it isn't in one it isn't in the other16:35
pabelangerderekh: okay, starting to delete a few16:36
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Pass ServiceNetMap to services  https://review.openstack.org/35441416:36
derekhpabelanger: ok, ive deleted a few also16:36
skramajabeagles: both nova-base and neutron-base does not have the param EnableConfigPurge16:37
*** liverpooler has joined #tripleo16:37
beaglesskramaja, if it isn't then we'll need to  get the ::nova::purge into the hiera on the node, either through using ControllerExtraConfig or adding a yaml file to the hieradata directory in the right spot before you run update again16:37
beaglesskramaja, probably safest just to do the extraconfig thing16:38
openstackgerritKarthik S proposed openstack/tripleo-heat-templates: Allow scheduler_available_filter to be customizable  https://review.openstack.org/34482916:38
gfidentedprince, I am tempted to go straight to w+1 with https://review.openstack.org/#/c/354414/ ;)16:39
skramajabeagles: ok.. i will check this with extraconfig and will update u tomorrow.. got to leave now..16:39
beaglesskramaja, cool.. If I get a chance to try something similar before then, I'll try it out to make sure it does what I hope it'll do ;)16:40
beaglesskramaja, cheers16:40
skramajabeagles: thanks..16:40
karthiksThanks & Bye beagles16:40
*** liverpooler has quit IRC16:40
beaglesskramaja, karthiks see you tomorrow! cheers!16:41
*** karthiks is now known as karthiks_afk16:41
*** padkrish has joined #tripleo16:41
*** jpich has quit IRC16:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Move RabbitMQ settings out of controller.yaml  https://review.openstack.org/35664016:42
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Move MySQL settings out of puppet/controller.yaml  https://review.openstack.org/35650516:42
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add DefaultPasswords to composable services  https://review.openstack.org/35646116:42
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Move Keepalived/HAproxy settings out of controller  https://review.openstack.org/35734416:42
*** lucasagomes is now known as lucas-dinner16:42
dprincegfidente: if CI passes I think we can send it16:42
gfidentedprince, ack16:42
dprincegfidente: it has had enough +2's now16:42
dprincegfidente: sorry my patches landed and messed it up16:42
gfidenteI landed those on purpose116:43
gfidenteto not rebase16:43
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Move RabbitMQ settings out of controller.yaml  https://review.openstack.org/35664016:45
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Move MySQL settings out of puppet/controller.yaml  https://review.openstack.org/35650516:45
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Add DefaultPasswords to composable services  https://review.openstack.org/35646116:45
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Move Keepalived/HAproxy settings out of controller  https://review.openstack.org/35734416:45
dprincegfidente: those ^^^ are all rebased on your patch so no worries there16:46
EmilienMdprince: you want me to update 356754 for a typo in parameter?16:47
dprinceEmilienM: yep, please16:47
EmilienMdprince: no prob16:49
openstackgerritEmilien Macchi proposed openstack/instack-undercloud: (mitaka only) Fix sysctl_settings configuration  https://review.openstack.org/35675416:49
EmilienMdone ^16:49
dprinceEmilienM: +216:50
EmilienMdprince: +2 your patches also16:50
*** bvandenh has quit IRC16:51
*** tbonds has joined #tripleo16:51
*** ccamacho has joined #tripleo16:52
*** tosky has quit IRC16:56
derekhdprince: pabelanger I gotta run all the instance nodepool created all still seem to be stuck in the BUILD state, I've run nova delete on some of them and those are stuck deleting16:56
derekhdprince: pabelanger creating 75 at once probably triggered it but I'm not sure exactly what is stuck (or has fallen over)16:57
derekhslagle: ^16:57
dprincederekh: ack, nodepool is a bit harsh here w/ 75 at once16:58
derekhyup16:58
*** bana_k has quit IRC16:58
*** derekh has quit IRC16:59
*** fragatina has joined #tripleo16:59
pabelangerplus image uploads, cloud is not happy16:59
*** vijaykc4 has joined #tripleo16:59
*** fragatina has quit IRC17:00
pabelangeranother 5 mins nodepool will start deleting nodes again17:00
pabelangerthe try to relauch17:00
*** yamahata has quit IRC17:00
*** yamahata has joined #tripleo17:00
*** fragatina has joined #tripleo17:00
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-osd  https://review.openstack.org/35731217:01
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-mon on controllers  https://review.openstack.org/35713017:01
pabelangerstevebaker: do you mind adding https://github.com/cybertron/openstack-virtual-baremetal/pull/28 to your review pipeline17:02
*** ebarrera has joined #tripleo17:02
*** electrofelix has quit IRC17:03
*** jbadiapa has quit IRC17:05
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Upgrade ceph-osd  https://review.openstack.org/35731217:06
*** stendulker has quit IRC17:07
*** stendulker has joined #tripleo17:09
*** stendulker has quit IRC17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447517:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]17:10
*** stendulker has joined #tripleo17:10
*** ebarrera has quit IRC17:12
*** nyechiel has quit IRC17:14
*** fragatina has quit IRC17:16
pabelangerdprince: EmilienM: nodepool has launched nodes in tripleo-test-cloud-rh117:19
pabelanger12 online right now17:19
dprincepabelanger: cool, fingers crossed17:20
*** weshay_ has quit IRC17:20
*** electrofelix has joined #tripleo17:21
*** electrofelix has quit IRC17:22
*** athomas has quit IRC17:25
*** tosky has joined #tripleo17:27
*** dprince has quit IRC17:30
gfidenteguys, tty tomorrow17:30
openstackgerritMatt Young proposed openstack/tripleo-quickstart: Relocate changes to staged publishing.  https://review.openstack.org/35572017:31
*** bana_k has joined #tripleo17:32
*** vijaykc4 has quit IRC17:33
*** stendulker has quit IRC17:36
*** adarazs has quit IRC17:38
*** adarazs has joined #tripleo17:38
openstackgerritayoung proposed openstack/python-tripleoclient: Clear the old environment in rc file  https://review.openstack.org/34755317:40
*** mhenkel_ has joined #tripleo17:41
*** gfidente has quit IRC17:43
*** mhenkel has quit IRC17:44
*** mhenkel_ is now known as mhenkel17:44
*** dprince has joined #tripleo17:48
*** rcernin has joined #tripleo17:51
*** weshay has joined #tripleo17:52
openstackgerritMerged openstack/puppet-tripleo: (mitaka only) loadbalancer: manage ipv6 sysctl  https://review.openstack.org/35675517:53
*** vijaykc4 has joined #tripleo17:55
ansiwenEmilienM: the ec2api CI creates ec2 credentials with the CLI: https://github.com/openstack/ec2-api/blob/master/devstack/create_config#L5117:56
ansiwenEmilienM: how can I do that with puppet?17:56
ansiwenEmilienM: or do I have to call the CLI from puppet somehow?17:56
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Monitoring node support  https://review.openstack.org/34969017:56
*** vijaykc4 has quit IRC17:57
beaglesansiwen, are you working on your ec2api puppet module?18:00
beaglesansiwen, I saw your question to EmilienM above (while I wait for yet another undercloud install ;))18:01
beaglesansiwen, puppet-neutron/lib/puppet/provider/neutron.rb has one example of calling a service's client18:05
beaglesansiwen, I think nova has similar18:05
beaglesansiwen, anyways, there are a few examples kicking around of that kind of thing18:05
*** vijaykc4 has joined #tripleo18:05
*** vijaykc4 has quit IRC18:06
*** jtomasek has joined #tripleo18:08
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447518:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]18:10
*** yamahata has quit IRC18:10
*** fragatina has joined #tripleo18:11
openstackgerritClark Boylan proposed openstack/diskimage-builder: Make disk usage reporting more robust  https://review.openstack.org/35740118:11
*** vijaykc4 has joined #tripleo18:19
ayoungOOM Killer just killed MySQL again, even with the Memoryup to 12 Gb.18:20
*** vijaykc4 has quit IRC18:20
*** vijaykc4 has joined #tripleo18:31
*** rbowen has joined #tripleo18:34
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart: Convert the full documentation to rST  https://review.openstack.org/35724818:34
*** dmacpher has quit IRC18:34
rbowenI'm trying to help close some older questions. I wonder if someone could take a look at this (rather elderly) post on ask.openstack.org - https://ask.openstack.org/en/question/82790/openstack-baremetal-introspection-internal-server-error/18:35
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart: Update configuration docs  https://review.openstack.org/35670018:37
*** ayoung has quit IRC18:37
*** mhenkel has quit IRC18:41
*** honza is now known as honza|afk18:43
*** fultonj has quit IRC18:44
*** yamahata has joined #tripleo18:46
*** fultonj has joined #tripleo18:49
*** padkrish has quit IRC18:51
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Set the default gnocchi driver to rbd  https://review.openstack.org/35438518:55
*** jtomasek has quit IRC18:59
*** mburned is now known as mburned_out19:00
*** pkovar has quit IRC19:00
*** mburned_out is now known as mburned19:00
*** mburned is now known as mburned_out19:00
*** mburned_out is now known as mburned19:01
larsksDoes anyone have a moment to discuss composable service architecture? dprince? I am trying to figure out how to have one service generate something (an ssl certificate) and make that available to another service.19:07
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447519:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]19:10
*** ooolpbot has quit IRC19:10
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: remove devmode  https://review.openstack.org/35741819:12
*** julim has quit IRC19:13
*** oshvartz has quit IRC19:13
*** julim has joined #tripleo19:14
*** padkrish has joined #tripleo19:17
dprincelarsks: hi19:21
dprincelarsks: so we don't have something now that does exactly that19:23
dprincelarsks: but we could add it19:23
dprincelarsks: do you have a bug/feature you can link me for this?19:24
larsksNot that's directly relevant.  I'm working on https://blueprints.launchpad.net/tripleo/+spec/tripleo-opstools-centralized-logging, but that's a fairly high level overview.19:25
larsksIn this case, I am looking at the secure-forward plugin for fluentd.  I would like to run the secure-forward-ca-generate command for the "server" side, and distribute the resulting certificate to the "client" side.19:26
larsksdprince: ^^^19:28
dprincelarsks: we can do it somewhere and capture the cert in an 'outputs' result (from the nested stack)19:31
dprincelarsks: we can prototype that up perhaps19:32
dprincelarsks: question for you about this cert, would it perhaps work with the cert-monger stuff Juan has been working on?19:32
larsksdprince: maybe?  Do you have a link handy for that work?  I'll take a look.19:35
*** florianf has quit IRC19:41
dprincelarsks: I think this is the spec https://review.openstack.org/#/c/282307/19:42
larsksdprince: Thanks!19:42
dprincelarsks: regardless if that works for your specific case this other mechanis to do composable workflow stuff is cool. I'll try to prototype something for you19:42
dprincelarsks: can it wait a day or two?19:42
larsksAbsolutley.  No rush right now.19:43
dprincelarsks: I'd use a combination of Mistral and the remote execution stuff we've got now19:43
dprincelarsks: remote execution just lets you run ad-hoc stuff (like cert generation, or whatever)19:44
dprincelarsks: https://etherpad.openstack.org/p/tripleo-remote-execution19:44
dprincelarsks: also, here if you like video demo's too https://www.youtube.com/watch?v=Hb-Y8AqVt1E19:45
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: align the tripleo-roles.yml playbook w/ quickstart.yml  https://review.openstack.org/35549519:46
openstackgerritwes hayutin proposed openstack/tripleo-quickstart: pin the undercloud-post and overcloud roles  https://review.openstack.org/35666919:46
larsksdprince: Thanks.  Distracted right now by a con call but will look shortly.19:46
*** vijaykc4 has quit IRC19:46
*** mlupton has joined #tripleo19:47
*** vijaykc4 has joined #tripleo19:54
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart: Update configuration docs  https://review.openstack.org/35670019:59
*** lblanchard has quit IRC20:02
*** ayoung has joined #tripleo20:08
*** vijaykc4 has quit IRC20:10
*** ooolpbot has joined #tripleo20:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447520:11
*** ooolpbot has quit IRC20:11
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]20:11
larsksdprince: the remote execution specs looks interesting, but maybe overkill for what I was looking for?  I'm really looking for a way for a SoftwareConfig resource to have an output (maybe provided along with the completion signal?) that could then be accessed via get_attr.  But the cert-monger stuff you pointed at earlier may be a better solution for my immediate needs; I haven't looked at that yet.20:12
*** padkrish has quit IRC20:13
ansiwenbeagles: thanks!20:16
*** padkrish has joined #tripleo20:17
ansiwenbeagles: the interesting question would be: is it possible to create ec2 credentials just by the puppet modules already? or do I have to fire up the cli client?20:18
*** zaneb has quit IRC20:20
*** _coolsvap_ has quit IRC20:21
dprincelarsks: ack, lets sync up again once you investigate a bit20:34
*** zaneb has joined #tripleo20:34
*** jeckersb is now known as jeckersb_gone20:34
*** jcoufal_ has joined #tripleo20:35
*** scooby2 has left #tripleo20:36
*** jcoufal has quit IRC20:37
*** fultonj has quit IRC20:41
*** fultonj has joined #tripleo20:42
asbishopIs gate-tripleo-ci-centos-7-ovb-nonha working for anyone today? I'd like to recheck https://review.openstack.org/#/c/35483920:42
beaglesansiwen, good question - you could but why would you want to :) wouldn't you have to implement the client part of the REST API in ruby?20:55
ansiwenbeagles: no, of course I meant: it's already there maybe?20:56
*** ioggstream has joined #tripleo20:56
beaglesansiwen, oh I don't know.. I don't think so. The only mechanism I've see so far derives from the "openstack" provider in openstacklib (which leverages the universal openstack client)20:59
beaglesansiwen, it is interesting though because if you need to make API calls from within the puppet modules, it kind of forces you to make sure your osc plugin is up to snuff :)21:00
beaglesansiwen, chem might be a good source for juicy details in this respect21:01
*** dprince has quit IRC21:02
ansiwen"up to snuff"... I see ;-)21:02
beaglesansiwen, sorry very old "figures of speech" :)21:02
*** mburned is now known as mburned_out21:02
* beagles laughs at mburned's new nick21:03
*** julim has quit IRC21:04
ansiwenbeagles: someone suggested I might be able to use keystone::resource to create the ec2 credentials21:04
ansiwenbeagles: the problem is: you need these credentials to run the tests21:04
openstackgerritayoung proposed openstack/python-tripleoclient: Clear the old environment in rc file  https://review.openstack.org/34755321:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447521:10
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]21:10
*** ooolpbot has quit IRC21:10
chembeagles: ansiwen not I have enough context here, but inside a provider that use the openstacklib, you can do a "cred = self.class.request('ec2 credential', 'create')" and have something useful back.21:11
*** jayg is now known as jayg|g0n321:12
beagleschem: I don't know if that helps him or not, but that's good stuff :)21:12
chembeagles, ansiwen: it's very late here, so add me as a reviewer in gerrit and I will have a look tomorrow.  drop a comment as what you would like and may be of some help.21:12
beagleschem: thanks!21:13
openstackgerritayoung proposed openstack/python-tripleoclient: Add an overcloud rc.v3 file  https://review.openstack.org/34755421:14
chembeagles: ansiwen as a side note, you use self.class.request if you're in a method and just request if you're in a class method.  Anyway, I'll check the review tomorrow.21:14
ansiwenchem: how late? I'm in CEST... ;-)21:14
chemansiwen: as late as you then :)21:15
chemansiwen: what is the review ?21:15
ansiwenchem: there's no review yet. for running a test I need to create ec credentials. and I wondered if I can to that only with tools that already exist, or if I have to make puppet to call the CLI tool like "openstack ec credentials create"21:17
ansiwenec = ec2... sorry21:17
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates: Enable gnocchi systemd services  https://review.openstack.org/35611121:20
*** bfournie has quit IRC21:21
stevebakerpabelanger: merged21:21
pabelangerstevebaker: great, thanks21:21
chemansiwen: not sure if that could be of some help then https://github.com/openstack/puppet-ec2api , I don't see the credential creation there.  Maybe if that fits it could be added. ... ?21:22
*** Goneri has joined #tripleo21:23
ansiwenchem: yes, in puppet-ec2api there is nothing I guess... I thought it might be possible with puppet-keystone maybe21:25
*** asbishop has quit IRC21:26
ansiwenchem: for te non-puppet CI there is this line: https://github.com/openstack/ec2-api/blob/master/devstack/create_config#L5121:26
ansiwenwhich creates the necessary credentials for the test21:27
ansiwenchem: I wanna run the same tempest tests agains a puppet deployed ec2-api service21:27
chemansiwen: I think the way to go would be to have a provider in puppet-ec2api thattrigger the 'ec2 credential' command, then as the keystone provider does, dump a ec2rc file in /root/ec2rc that would get you back the credential in the environment.21:33
chemansiwen: but as keystone doing that, I don't think it's currently possible, but I'm not too familiar with what the ec2 credential does, so I may be wrong here.21:34
*** jcoufal_ has quit IRC21:34
chemansiwen: more like /root/ec2-<project-name>.rc21:37
ansiwenchem: I see... ok, thanks... I will look into that tomorrow... to tired now :-)21:41
chemansiwen: me too, ping me tomorrow if you want to further discuss the matter.  Have a good one.21:41
ansiwenchem: you too21:41
*** pradk has quit IRC21:45
openstackgerritayoung proposed openstack/python-tripleoclient: Add an overcloud rc.v3 file  https://review.openstack.org/34755421:45
*** ioggstream has quit IRC21:45
*** thrash is now known as thrash|g0ne21:49
*** fultonj has quit IRC22:00
*** tbarron is now known as tbarron|afk22:02
*** jeckersb_gone is now known as jeckersb22:05
*** ooolpbot has joined #tripleo22:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/161447522:11
*** ooolpbot has quit IRC22:11
openstackLaunchpad bug 1614475 in tripleo "CI: undercloud install fails in ovb jobs because no env is provided by te-broker" [Critical,Confirmed]22:11
*** padkrish has quit IRC22:17
*** julim has joined #tripleo22:19
*** Goneri has quit IRC22:20
*** padkrish has joined #tripleo22:21
*** cdearborn has quit IRC22:24
*** padkrish has quit IRC22:35
*** rlandy has quit IRC22:46
*** padkrish has joined #tripleo22:46
*** ccamacho1 has joined #tripleo22:54
*** ccamacho has quit IRC22:54
*** beagles is now known as beagles_biaw22:56
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add memory to overcloud vms up to 6144  https://review.openstack.org/35753222:58
sshnaidmbnemec-pto, are you around just in case?22:59
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Add memory to overcloud vms up to 6144  https://review.openstack.org/35753223:01
*** sshnaidm is now known as sshnaidm|afk23:07
*** ccamacho1 has quit IRC23:14
*** bfournie has joined #tripleo23:15
*** chlong has quit IRC23:20
*** mlupton has quit IRC23:24
*** Ryjedo_ has joined #tripleo23:27
*** Ryjedo has quit IRC23:28
*** Ryjedo_ is now known as Ryjedo23:28
*** tosky has quit IRC23:31
*** rcernin has quit IRC23:32
*** mburned_out is now known as mburned23:33
*** mlupton has joined #tripleo23:41
*** mlupton has quit IRC23:45
openstackgerritGraeme Gillies proposed openstack/tripleo-docs: Updated basic installation page to include links to prebuilt images.  https://review.openstack.org/35682323:50
*** saneax-_-|AFK is now known as saneax23:52
*** morazi has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!