| *** fragatina has quit IRC | 00:12 | |
| *** harlowja has quit IRC | 00:51 | |
| *** nicolasbock has quit IRC | 00:57 | |
| *** gmoro_ has joined #heat | 01:07 | |
| *** felipemonteiro__ has joined #heat | 01:08 | |
| *** gmoro has quit IRC | 01:08 | |
| *** armaan has quit IRC | 01:15 | |
| *** armaan has joined #heat | 01:16 | |
| *** username_ has joined #heat | 01:20 | |
| *** username_ is now known as username__ | 01:23 | |
| *** felipemonteiro__ has quit IRC | 01:27 | |
| *** hongbin has joined #heat | 01:37 | |
| *** crag_ has joined #heat | 01:41 | |
| *** hongbin_ has joined #heat | 01:44 | |
| *** hongbin has quit IRC | 01:45 | |
| *** username__ has quit IRC | 02:35 | |
| *** fragatina has joined #heat | 02:55 | |
| *** fragatina has quit IRC | 02:55 | |
| *** fragatina has joined #heat | 02:56 | |
| *** fragatina has quit IRC | 02:57 | |
| *** fragatina has joined #heat | 02:57 | |
| *** rcernin has quit IRC | 03:14 | |
| *** ricolin_ has joined #heat | 03:14 | |
| *** ramishra has joined #heat | 03:36 | |
| *** ysandeep has joined #heat | 03:37 | |
| ysandeep | k | 03:37 |
|---|---|---|
| *** links has joined #heat | 03:43 | |
| *** gyan_ has joined #heat | 03:44 | |
| *** hongbin_ has quit IRC | 03:46 | |
| *** openstackgerrit has joined #heat | 04:01 | |
| openstackgerrit | Xinni Ge proposed openstack/heat-dashboard master: Replace embedded static files with XStatic-* https://review.openstack.org/551288 | 04:01 |
| openstackgerrit | Merged openstack/heat master: Log useful information in the API log https://review.openstack.org/521642 | 04:22 |
| *** wolverineav has joined #heat | 05:08 | |
| wolverineav | hi, i'm running into an issue during stack delete on the overcloud - deleting security group is taking slightly longer than 60 seconds and due to that the whole stack deletion is getting timed out: http://paste.openstack.org/show/720637/ | 05:11 |
| wolverineav | while I can delete the rule individually from the Compute > Access & Security page. but i'd like to know if there's a way to handle the timeout here ^ so I can tweak it to bring in sync with the backend | 05:13 |
| *** crag_ has quit IRC | 05:13 | |
| ricolin_ | wolverineav, unfortunately it's timeout in NeutronClient, so I guess no way in heat to solve that right now. We should open a story task(bug) to track on this. | 05:21 |
| ricolin_ | wolverineav, is the Security group rule eventually removed? | 05:21 |
| ricolin_ | or is there any exception in neutron? | 05:21 |
| wolverineav | ricolin_: it is eventually removed. but say there are 30 rules in sec group, stack deletion succeeds on the n-th try after each rule is removed. | 05:23 |
| wolverineav | ricolin_: neutron doesn't hit any exception - for some reason the DB is slow in one particular customer setup which i haven't been able to figure out - changing the timeout here seemed like a reasonable workaround | 05:24 |
| ramishra | wolverineav: I think the 504 gateway time out is coming from haproxy | 05:24 |
| wolverineav | ricolin_: would there be a way to change it neutronclient or HAProxy? | 05:24 |
| ramishra | wolverineav: you don't get 504 from any of the api services | 05:24 |
| wolverineav | ricolin_: ah, gotcha. let me google a bit for HAProxy timeouts | 05:25 |
| wolverineav | ramishra: sorry, tagged the wrong person. didn't notice the name change ^_^ | 05:25 |
| ramishra | wolverineav: check this https://bugzilla.redhat.com/show_bug.cgi?id=1566520#c4 | 05:25 |
| openstack | bugzilla.redhat.com bug 1566520 in openstack-heat "Response from stack update is "504 Gateway Timeout"" [Medium,New] - Assigned to zbitter | 05:25 |
| ricolin_ | wolverineav, it's ramishra you're pointing | 05:25 |
| ricolin_ | haha | 05:25 |
| wolverineav | thanks ricolin_ ramishra! appreciate the quick help! | 05:27 |
| *** crag_ has joined #heat | 05:30 | |
| *** hoonetorg has quit IRC | 05:33 | |
| openstackgerrit | Jiye Yu proposed openstack/heat-dashboard master: Modified typo on Change Stack's pop-up Window. https://review.openstack.org/567118 | 05:39 |
| *** jtomasek has joined #heat | 05:41 | |
| *** jtomasek has quit IRC | 05:41 | |
| *** wolverineav has left #heat | 05:41 | |
| *** jtomasek has joined #heat | 05:42 | |
| *** hoonetorg has joined #heat | 05:45 | |
| *** armaan has quit IRC | 06:05 | |
| *** armaan has joined #heat | 06:05 | |
| *** armaan_ has joined #heat | 06:13 | |
| *** armaan has quit IRC | 06:16 | |
| openstackgerrit | Jiye Yu proposed openstack/heat-dashboard master: Modified typo on Change Stack's pop-up Window. https://review.openstack.org/567118 | 06:20 |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Keep old files in file map for rolling update https://review.openstack.org/562727 | 06:23 |
| ramishra | ricolin_: Do we have any concerns for https://review.openstack.org/#/c/562106/ ? Or we want to wait till the day it's removed from devstack:) | 06:30 |
| ricolin_ | ramishra, I don't(as already+2ed):) | 06:33 |
| *** armaan_ has quit IRC | 06:33 | |
| *** armaan has joined #heat | 06:34 | |
| ramishra | ricolin_: thanks! | 06:35 |
| *** wolverineav has joined #heat | 06:58 | |
| *** wolverineav has quit IRC | 07:03 | |
| *** wolverineav has joined #heat | 07:04 | |
| openstackgerrit | Merged openstack/heat master: Remove mox from test-neutron-firewall https://review.openstack.org/553602 | 07:08 |
| *** wolverineav has quit IRC | 07:10 | |
| *** crag_ has quit IRC | 07:12 | |
| *** wolverineav has joined #heat | 07:22 | |
| *** masber has quit IRC | 07:36 | |
| *** mdnadeem has joined #heat | 07:41 | |
| *** mdnadeem has quit IRC | 07:41 | |
| *** armaan has quit IRC | 07:50 | |
| *** armaan has joined #heat | 07:51 | |
| *** dbecker has joined #heat | 07:57 | |
| *** namnh has joined #heat | 08:02 | |
| *** armaan has quit IRC | 08:05 | |
| *** armaan has joined #heat | 08:06 | |
| *** mdnadeem has joined #heat | 08:12 | |
| *** wolverineav has quit IRC | 08:18 | |
| *** skramaja has joined #heat | 08:26 | |
| *** derekh has joined #heat | 08:40 | |
| *** wolverineav has joined #heat | 08:50 | |
| *** gfidente has joined #heat | 08:55 | |
| *** gyankum has joined #heat | 08:55 | |
| *** nicolasbock has joined #heat | 08:56 | |
| *** gkadam__ has joined #heat | 09:06 | |
| *** wolverineav has quit IRC | 09:15 | |
| *** wolverineav has joined #heat | 09:16 | |
| *** wolverineav has quit IRC | 09:20 | |
| *** serlex has joined #heat | 09:28 | |
| openstackgerrit | lei zhang proposed openstack/heat-templates master: Fix the incorrect cirros default password https://review.openstack.org/567174 | 09:36 |
| *** sameer has joined #heat | 09:40 | |
| sameer | hello all | 09:40 |
| sameer | for quota configuration we have max_stacks_per_tenant = 100, can we change it ? | 09:41 |
| ricolin_ | sameer, sure https://github.com/openstack/heat/blob/master/heat/common/config.py#L129 | 09:42 |
| sameer | what are the effects of it on Heat engine and undelying openstack it self ? | 09:42 |
| sameer | do we need to increase RAM as well ? | 09:43 |
| ricolin_ | as long as you not trying to do any resource group/ASG with super huge number of size it should be fine | 09:45 |
| ricolin_ | sameer, as for RAM if you're not plan to create super large number of stack it should be fine | 09:46 |
| ricolin_ | But if you're, try to measure your RAM and DB space | 09:46 |
| sameer | ricloin: max_stacks_per_tenant = 100, means 100 stacks are active at one time per tenant ri8 ? | 09:48 |
| sameer | if i want 200 stack to be active per tenant thn i can increase to 200, | 09:48 |
| sameer | my doubt is it wil have any effect on heat engine ? | 09:49 |
| ricolin_ | sameer, yes, and I don't think it will effect heat engine | 09:50 |
| ricolin_ | it's the number of stacks under action the same time matters to engine I think | 09:50 |
| ricolin_ | try to imaging if you have 1000 stack create action in the same time | 09:51 |
| ricolin_ | but that's not that relative to what you're asking | 09:51 |
| ricolin_ | so change max_stacks_per_tenant won't effect your heat service much | 09:52 |
| sameer | ricloin:it means if i can increase ram and dbspace then that's enough. | 09:53 |
| sameer | i can change max_stacks_per_tenant =200 | 09:53 |
| ricolin_ | if worry about it, try to check your DB (is there space left) and service node(is RAM/CPU good) condition before you add the number | 09:53 |
| sameer | can you please explain this "it's the number of stacks under action the same time matters to engine I think" | 09:54 |
| ricolin_ | IMO I don't think 100 -> 200 really effect anything in most environments | 09:54 |
| ricolin_ | sameer, that means, the number of stacks you have won't effect engine much, since engine won't load all of them together all the time | 09:55 |
| sameer | ohhh , thn how heat-engine works | 09:56 |
| sameer | if it don't load all stacks together thn stack wil fail right ? | 09:56 |
| ricolin_ | but if your service always try to create large number of stacks(with many resources) try to use batch create/update so it won't try to do actions together | 09:57 |
| ricolin_ | that's actually why heat matters, since even when you directly perform 1000 Volume delete together, IMO it will crush your cinder servce | 09:58 |
| ricolin_ | sameer, we load stack from DB when that stack been required | 09:59 |
| sameer | what is batching policy ? | 10:02 |
| sameer | i have never used batch jst read abt it | 10:02 |
| sameer | ricolin:its a very good option to create stack if u creating a huge stack | 10:02 |
| sameer | ricolin: it means if i am launching 1000vms nova server wil crash | 10:03 |
| sameer | bdw how batch works ? | 10:03 |
| sameer | as name suggests 'batch' it wil launch resources in batched as per batching policy | 10:05 |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Keep old files in file map for rolling update https://review.openstack.org/562727 | 10:06 |
| ricolin_ | sameer, here is an example of how you might using it http://paste.openstack.org/show/720654/ | 10:06 |
| ricolin_ | sameer, how much instance create together will crush your environemnt totally depends on your environment, but yes, batch action should help to release that tension | 10:08 |
| sameer | ohhh , | 10:08 |
| sameer | ricolin: batching policy and update policy are same ? | 10:09 |
| sameer | ohh got it | 10:11 |
| ricolin_ | sameer, yes | 10:11 |
| sameer | ricolin: thnks for the info | 10:11 |
| ricolin_ | btw there is no template keyword for batching_policy | 10:12 |
| ricolin_ | the actual implement is updatepolicy | 10:12 |
| ricolin_ | https://review.openstack.org/#/c/185385/23 | 10:12 |
| ricolin_ | sameer, ^^^ | 10:12 |
| sameer | min_in_service: 1 means one stack wil be active and others are in rollback max_batch_size: 2 means what ? pause_time: 1 means what ? | 10:14 |
| ricolin_ | for example you create/update another 100 instance in stack, max_batch_size: 2 means it will create/update 2 instance at a time and wait for those to complete before trigger another 2. And pause_time=1 means it will pause 1 second before trigger next batch | 10:17 |
| sameer | ricolin: thnks | 10:20 |
| ricolin_ | sameer, NP:) | 10:20 |
| *** namnh has quit IRC | 10:28 | |
| *** wolverineav has joined #heat | 10:34 | |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Switch to neutron-* service names https://review.openstack.org/562106 | 10:39 |
| *** priteau has joined #heat | 10:45 | |
| *** hjensas|afk is now known as hjensas | 10:45 | |
| *** derekh_ has joined #heat | 10:54 | |
| *** derekh has quit IRC | 10:54 | |
| *** mchlumsky_ has joined #heat | 10:59 | |
| *** gkadam_ has joined #heat | 10:59 | |
| *** gkadam__ has quit IRC | 10:59 | |
| *** mchlumsky has quit IRC | 10:59 | |
| openstackgerrit | Rico Lin proposed openstack/heat master: Check NotFound in property error when delete pool member https://review.openstack.org/541558 | 11:23 |
| *** armaan has quit IRC | 11:41 | |
| *** armaan has joined #heat | 11:41 | |
| therve | ricolin_: Can you fix launchpad naming? | 11:56 |
| therve | Adding the mention in the project or the milestone is a bit overboard | 11:56 |
| ricolin_ | therve, sure | 11:57 |
| therve | Also are we doing something to fix the gate? | 11:58 |
| therve | I guess we can talk about it during the meeting | 11:59 |
| ricolin_ | therve, is the gate broken? | 12:03 |
| therve | ricolin_: Enough that we recheck all the time | 12:03 |
| therve | I'd say 80% fail rate give or take | 12:03 |
| ricolin_ | therve, added https://wiki.openstack.org/wiki/Meetings/HeatAgenda#Agenda_.282018-05-09_1400_UTC.29 | 12:04 |
| therve | http://status.openstack.org/openstack-health/#/g/project/openstack~2Fheat says around 56%, but on gate only, so if you add check... | 12:04 |
| ricolin_ | yeah, definitely needs to investigate into | 12:06 |
| openstackgerrit | huangshan proposed openstack/python-heatclient master: Update http links in docs https://review.openstack.org/567204 | 12:06 |
| *** armaan has quit IRC | 12:16 | |
| openstackgerrit | Harald Jensås proposed openstack/heat master: Allow updating the segment property of OS::Neutron::Subnet https://review.openstack.org/567206 | 12:18 |
| openstackgerrit | Harald Jensås proposed openstack/heat master: Add first_segment convenience attr to OS::Neutron::Net https://review.openstack.org/567207 | 12:18 |
| *** jmlowe has quit IRC | 12:20 | |
| *** ysandeep has quit IRC | 12:29 | |
| *** armaan has joined #heat | 12:30 | |
| *** skramaja_ has joined #heat | 12:49 | |
| openstackgerrit | Rico Lin proposed openstack/heat master: Check NotFound with pool property in pool member https://review.openstack.org/541558 | 12:49 |
| *** skramaja has quit IRC | 12:50 | |
| *** gyan_ has quit IRC | 12:51 | |
| *** gyankum has quit IRC | 12:51 | |
| *** skramaja has joined #heat | 12:53 | |
| *** skramaja_ has quit IRC | 12:54 | |
| *** armaan has quit IRC | 12:54 | |
| *** jcoufal has joined #heat | 12:58 | |
| *** jmlowe has joined #heat | 13:02 | |
| *** derekh_ has quit IRC | 13:14 | |
| ramishra | therve: http://logs.openstack.org/06/562106/5/check/heat-functional-convg-mysql-lbaasv2-py35/77617be/job-output.txt.gz#_2018-05-09_12_02_56_397471, not sure how many tests we would skip to reduce the failure rate | 13:21 |
| ramishra | unless we find the root cause for these intermittent issues | 13:22 |
| therve | Yeah that one is unfortunate | 13:22 |
| therve | But if we skip octavia and signal that's half of the failures already | 13:22 |
| therve | Also, we should remove jobs | 13:23 |
| ramishra | yeah I'm +1 for removing some jobs, heat-functional-convg-mysql-lbaasv2-identity-v3-only and heat-functional-convg-mysql-lbaasv2-non-apache possibly | 13:26 |
| ricolin_ | maybe heat-functional-convg-mysql-lbaasv2-amqp1 too? | 13:26 |
| ramishra | ricolin_: that's non-voting | 13:27 |
| ramishra | but not sure if we can skip all signal related tests | 13:27 |
| ricolin_ | ramishra, but it's still necessary | 13:27 |
| zaneb | ricolin_: btw I will miss the meeting today | 13:27 |
| ricolin_ | zaneb, got it | 13:28 |
| therve | Yeha we can start by making it non voting and remove from gate | 13:28 |
| ricolin_ | also wondering about grenade-heat, not like it will fail, but in some way isn't grenade-heat-multinode already cover what it's testing for? | 13:29 |
| *** ricolin_ has quit IRC | 13:32 | |
| *** ricolin has joined #heat | 13:33 | |
| *** crose has joined #heat | 13:33 | |
| *** felipemonteiro__ has joined #heat | 13:34 | |
| *** armaan has joined #heat | 13:34 | |
| *** livelace has joined #heat | 13:36 | |
| ricolin | a good start with nail down one now :) | 13:37 |
| ricolin | https://review.openstack.org/#/c/564623/1 | 13:37 |
| *** hongbin has joined #heat | 13:52 | |
| *** felipemonteiro_ has joined #heat | 13:53 | |
| *** felipemonteiro__ has quit IRC | 13:56 | |
| *** TheJulia has joined #heat | 13:59 | |
| TheJulia | o/ | 14:00 |
| ricolin | #startmeeting heat | 14:00 |
| openstack | Meeting started Wed May 9 14:00:16 2018 UTC and is due to finish in 60 minutes. The chair is ricolin. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: heat)" | 14:00 | |
| openstack | The meeting name has been set to 'heat' | 14:00 |
| ricolin | hi TheJulia | 14:00 |
| *** pbourke has quit IRC | 14:00 | |
| ricolin | #topic roll call | 14:00 |
| *** openstack changes topic to "roll call (Meeting topic: heat)" | 14:00 | |
| ramishra | hi | 14:01 |
| ricolin | o/ | 14:01 |
| ricolin | #topic adding items to agenda | 14:02 |
| *** openstack changes topic to "adding items to agenda (Meeting topic: heat)" | 14:02 | |
| ricolin | #link https://wiki.openstack.org/wiki/Meetings/HeatAgenda#Agenda_.282018-05-02_1400_UTC.29 | 14:03 |
| *** pbourke has joined #heat | 14:04 | |
| kazsh | o/ | 14:04 |
| ricolin | kazsh, hi | 14:04 |
| kazsh | sorry for be late | 14:04 |
| ricolin | kazsh, no worry, you just on time | 14:04 |
| ricolin | #topic Gate failure | 14:04 |
| *** openstack changes topic to "Gate failure (Meeting topic: heat)" | 14:04 | |
| ricolin | #link http://status.openstack.org/openstack-health/#/g/project/openstack~2Fheat | 14:05 |
| ricolin | here's some exception I found | 14:05 |
| ricolin | #link https://etherpad.openstack.org/p/heat-gate-failures | 14:05 |
| ricolin | ramishra, do you think it's a wise choice to increase image size for software config test again? | 14:06 |
| ricolin | right now we use image_ref for test like test_server_signal_userdata_format_software_config | 14:06 |
| ramishra | ricolin: my view we've these higher failure rates from time to time, unless we know the root cause (which may be related to infra issues etc), how long we'll skip the tests | 14:07 |
| ramishra | ricolin: I'm not sure if that's the reason, I mean increase the image size would fix the issue, so can't comment | 14:07 |
| ricolin | ramishra, I don't have any root cause from infra though | 14:08 |
| therve | ricolin: Where's the download from? | 14:08 |
| ricolin | TheJulia, maybe you know better on the status of gate infra?:) | 14:08 |
| TheJulia | ricolin: in what terms? | 14:09 |
| ricolin | from local environment IIRC | 14:09 |
| therve | We create an octavia image on every build? :/ | 14:09 |
| TheJulia | yeouch | 14:09 |
| ramishra | TheJulia: not now I suppose, AFAIK, the dib stuff is gone now | 14:10 |
| TheJulia | so yeah, that might be problematic because if your building an image, then your suspect to every upstream failure | 14:10 |
| TheJulia | hmm | 14:10 |
| ramishra | therve: ^^ | 14:10 |
| therve | ramishra: What did rico linked then? | 14:10 |
| TheJulia | I don't know your guys gates/testing well enough recommend anything, but for ironic we split the build out and we save on tarballs.o.o for future builds for our deployment agent | 14:11 |
| ramishra | therve: that's fixed, let me find the patch | 14:11 |
| therve | Ah, ok | 14:11 |
| ricolin | ramishra, cool! | 14:11 |
| ramishra | https://review.openstack.org/#/c/559416/ | 14:12 |
| ricolin | TheJulia, that's good idea | 14:12 |
| therve | ramishra: That patch is 3 weeks old | 14:13 |
| *** pbourke has quit IRC | 14:14 | |
| ramishra | therve: what about the failure? I don't think dib is used now | 14:14 |
| therve | ramishra: http://logs.openstack.org/07/567207/1/check/heat-functional-convg-mysql-lbaasv2-non-apache/ff9c346/logs/devstacklog.txt.gz#_2018-05-09_12_58_07_766 | 14:15 |
| therve | From today | 14:15 |
| ramishra | therve: ok, it seems they still add some dib elements to the ubuntu-minimal image | 14:17 |
| ricolin | maybe I missing something but we using master for octavia in devstack, so I'm not sure that's fixed | 14:17 |
| therve | Overall I'm not sure what testing octavia brings us | 14:18 |
| therve | If anything, it should be something in their gate | 14:18 |
| ramishra | therve: the same way we used to test lbaas stuff earlier;) Though I'm fine if we want not to test the resources and skip the tests | 14:18 |
| ricolin | is there ways we can avoid build that image all over? | 14:18 |
| TheJulia | Even if there is value for you testing, the build should be occuring on their end, not in your job if you can help it at all | 14:18 |
| therve | Ah | 14:19 |
| therve | ramishra: https://tarballs.openstack.org/octavia/test-images/test-only-amphora-x64-haproxy-ubuntu-xenial.qcow2 | 14:19 |
| TheJulia | ricolin: they could have a post job that uploads to tarballs.o.o for you guys? :) | 14:19 |
| TheJulia | Hey, there you go! | 14:19 |
| therve | There already | 14:19 |
| ricolin | therve, yay | 14:20 |
| ramishra | TheJulia: we don't build it, it's there in their destack plugin and we use it | 14:20 |
| therve | Checkout kuryr-kubernetes | 14:20 |
| TheJulia | I believe tarballs.o.o gets mirrored into the various clouds where jobs execute, so downloading that should be safe CI job wise | 14:20 |
| TheJulia | ramishra: ugh | 14:20 |
| therve | TheJulia: I don't think so, but it's better than building it anyway | 14:20 |
| *** pbourke has joined #heat | 14:21 | |
| therve | ricolin: OK, I'll do that fix at least | 14:21 |
| ricolin | ramishra, I guess we can try to report this to octavia team | 14:21 |
| ricolin | therve, that's even better!!:) | 14:21 |
| TheJulia | it would be good for their plugin consumers to be able to opt to download instead of build, fwiw | 14:21 |
| ricolin | TheJulia, agree on that! | 14:22 |
| *** skramaja has quit IRC | 14:22 | |
| ricolin | how about this one http://logs.openstack.org/90/566190/1/gate/heat-functional-orig-mysql-lbaasv2/0fb2e98/job-output.txt.gz#_2018-05-04_12_43_27_744637 | 14:23 |
| openstackgerrit | Thomas Herve proposed openstack/heat master: Download octavia image in tests https://review.openstack.org/567238 | 14:24 |
| therve | ricolin: I mean, we're not getting through errors during the meeting | 14:25 |
| ramishra | ricolin: That seems some issue where it can't communicate with listener and lb goes to ERROR/DEGRADED state | 14:25 |
| TheJulia | looks like there is some nasty libvirt errors in the related nova log | 14:25 |
| ricolin | therve, of course, this is the last one I bring! | 14:26 |
| ricolin | TheJulia, and that means we nearly got no way to fix it:/ | 14:27 |
| ramishra | ricolin: I don't know exactly what's going on there though, there are plenty of failures of the tests using fedora images too | 14:27 |
| ricolin | ramishra, I got no clue at all:/ | 14:28 |
| ramishra | I was suspecting if it's some issue with mirroring for some clouds as we use local mirrors, but not sure | 14:28 |
| ricolin | ramishra, might be, but I'm not sure about that too | 14:28 |
| ricolin | Anyway, let's move on we need time for other stuff | 14:29 |
| ricolin | #topic remove jobs | 14:29 |
| *** openstack changes topic to "remove jobs (Meeting topic: heat)" | 14:29 | |
| ramishra | therve: the failure rates are not that bad to be alarmed IMHO, we had similar periods earlier too:) | 14:29 |
| ricolin | would like to give a quick discuss on that too | 14:29 |
| therve | ramishra: What? We have like 5 rechecks per merge? | 14:30 |
| ramishra | therve: yes, we had them earlier | 14:30 |
| therve | ramishra: And it was horrible? | 14:30 |
| therve | Not sure what's your point | 14:30 |
| *** derekh has joined #heat | 14:31 | |
| ricolin | I guess we can release the gate tension by remove some job?:) | 14:31 |
| therve | ricolin: Yeah let's make the non-apache non voting | 14:31 |
| ricolin | we just remove one non-voting out #link https://review.openstack.org/#/c/564623/ | 14:31 |
| ramishra | therve: my poing is probably it's some infra issue and load on the test infra, though we can make some optimizations where and there | 14:31 |
| ricolin | ramishra, agree on that | 14:32 |
| therve | ramishra: Right, so we should and not just sit waiting then? | 14:32 |
| ricolin | therve, ramishra how about `grenade-heat | 14:32 |
| ricolin | ` | 14:32 |
| ramishra | like it's easier to merge stuff during my morning time, but yeah we should try to find the root cause | 14:32 |
| ramishra | therve: I did not say that | 14:33 |
| therve | ricolin: I don't know about grenade-heat | 14:34 |
| *** felipemonteiro__ has joined #heat | 14:34 | |
| ramishra | ricolin: Let's move on to other stuff and see if we can make the gate stable in the coming days | 14:34 |
| therve | Doesn't seem to be failing | 14:34 |
| therve | ramishra: Every time I type recheck a little part of my soul dies | 14:35 |
| ramishra | therve: I understand, even worse when cores do blind rechecks:/ | 14:35 |
| ricolin | ramishra, sure, just I think we can try to remove some job for good | 14:35 |
| ricolin | I do like the idea to non-voting non-apache | 14:36 |
| *** felipemonteiro_ has quit IRC | 14:37 | |
| ramishra | ricolin: we don't have lot of jobs like other projects, but yes we can make that one non-voting | 14:37 |
| ricolin | if that not making anyone uncomfortable | 14:37 |
| ricolin | ramishra, cool | 14:37 |
| ricolin | let's move on than | 14:38 |
| ricolin | #topic StoryBoard Migrated | 14:38 |
| *** openstack changes topic to "StoryBoard Migrated (Meeting topic: heat)" | 14:38 | |
| ricolin | #link https://storyboard.openstack.org/#!/project_group/82 | 14:38 |
| ricolin | #link https://etherpad.openstack.org/p/Heat-StoryBoard-Migration-Info | 14:38 |
| ricolin | just FYI all our bugs and comments in bugs are there in StoryBoard | 14:39 |
| ricolin | also hope this will make it easier to track | 14:39 |
| ricolin | #link https://storyboard.openstack.org/#!/board/71 | 14:39 |
| ricolin | All cores should have the owner right for that board now | 14:40 |
| ricolin | BTW the board loading is a bit slow, try to figure out what we can improve on that | 14:40 |
| ricolin | therve, I change all launchpad title back now, think you might like to know | 14:41 |
| therve | ricolin: Thanks | 14:41 |
| ricolin | I will keep watching irc, gerrit as long as I can to help on anyone to adopt new platform | 14:42 |
| ricolin | also already add the info to our Vancouver project update, Onboarding, and user feedback session | 14:43 |
| ricolin | Let's all I got | 14:43 |
| ramishra | ricolin: how would be milestone/release tracking/tagging etc be done now? I need to read the documentation though | 14:43 |
| ramishra | may be that can be added to the etherpad too | 14:44 |
| ricolin | ramishra, Okay, I will try to get more information on that part | 14:44 |
| ricolin | thx | 14:44 |
| *** chandankumar is now known as chkumar|off | 14:45 | |
| ricolin | ramishra, also about the reason they not adding Storyboard url to relative Launchpad bug is because with performance issue, it will take extramly long time to do that | 14:46 |
| ricolin | and since most information is there in StoryBoard, they decide not to add them | 14:46 |
| ricolin | that's the information I got from StoryBoard team | 14:46 |
| ricolin | ramishra, think you might like to know:) | 14:47 |
| ricolin | I do like to discuss about Translate Properties failed issue, but since that's also involved with zaneb, let's skip it to next week | 14:48 |
| ricolin | I have update the fix for octavia pool member resource | 14:49 |
| ricolin | #link https://review.openstack.org/#/c/541558/ | 14:49 |
| ramishra | ricolin: it's not easy to find the correspnding story for a bug for someone new, I did not like the reasoning though. However, we are where we're | 14:49 |
| ricolin | but we still have to discuss about how can we deal with property issue for good | 14:49 |
| ricolin | ramishra, I will try my best to make it easier for all developer in heat | 14:50 |
| ricolin | ramishra, maybe do more tagging | 14:51 |
| ricolin | still try to figure out where people suffer the most | 14:51 |
| ricolin | ramishra, I think the finding corresponding bug is no.1 in my list | 14:52 |
| ricolin | so that's good point | 14:52 |
| ricolin | Let's move on | 14:52 |
| ricolin | #topic Bugs and PBs | 14:53 |
| *** openstack changes topic to "Bugs and PBs (Meeting topic: heat)" | 14:53 | |
| ricolin | Anything to raise for any bugs or bps? | 14:53 |
| TheJulia | Is this the appropriate time to try and stir up discussion regarding a bug fix? | 14:53 |
| ricolin | TheJulia, sure:) | 14:54 |
| *** felipemonteiro__ has quit IRC | 14:55 | |
| *** felipemonteiro_ has joined #heat | 14:55 | |
| TheJulia | So I posted https://review.openstack.org/#/c/564104/ which seems to be a really long standing issue because were were hitting major issues downstream downstream with baremetal instances going into ERROR state in nova. There has been some back and forth, but I'd like to either attempt to get consensus or further drive discussion. | 14:55 |
| ricolin | #link https://review.openstack.org/#/c/564104/ | 14:56 |
| therve | I think ramishra said it was fine, so I trust him on that one :) | 14:57 |
| TheJulia | tl;dr ports are being orphaned in neutron in certain cases when an instance being built goes into ERROR state when nova is told to build with a port | 14:57 |
| ramishra | TheJulia: I'm ok with the fix in principle, though checking for resource FAILED status could be better, we can test it at the gate by marking a server resource unhealthy | 14:57 |
| TheJulia | ramishra: is the server resource status ultimately tied to the instance status? | 14:57 |
| ramishra | but it would introduce a bug as we try to rollback FAILED resources | 14:58 |
| TheJulia | Well, as far as I'm aware there is no rolling back an instance in ERROR state *shrugs* | 14:58 |
| ramishra | TheJulia: it's a heat bug which should be fixed | 14:59 |
| TheJulia | the fact that it tries to roll back instnaces in error state now? | 15:00 |
| ramishra | TheJulia: yes, if a server is in error state and heat does not know about it(resource is not in FAILED state), then we probably would not do anything | 15:00 |
| *** rwsu has joined #heat | 15:01 | |
| TheJulia | so would it not make sense to check both instance and resource status? | 15:01 |
| * TheJulia is totally not the expert here | 15:01 | |
| ramishra | TheJulia: In principle we assume things are ok unless we know about it.. | 15:02 |
| TheJulia | so resource makes sense then since it is trying to replace the failed instance. | 15:03 |
| ramishra | For a FAILED resource, if a update is cancelled we do try to rollback which we've to fix | 15:03 |
| TheJulia | okay, so checking resource shouldn't be a problem really... I think | 15:04 |
| TheJulia | your guys call, I can change it to do whatever :) | 15:04 |
| ramishra | I mean we've something like (observe reality) where we check the actual state of the resource in their respective services | 15:05 |
| ramishra | but that's based on user request AFAIK | 15:05 |
| ricolin | TheJulia, you can checking both I think:) | 15:05 |
| *** serlex has quit IRC | 15:06 | |
| TheJulia | that is likely safer rollback wise and I can just put a note in describing why | 15:06 |
| TheJulia | works for me | 15:06 |
| ricolin | TheJulia, cool | 15:06 |
| ricolin | I'm going to close the meeting since we already overtime, Thanks all for join!! | 15:07 |
| ricolin | #endmeeting | 15:07 |
| *** openstack changes topic to "OpenStack Heat Team (logs: http://eavesdrop.openstack.org/irclogs/%23heat/)" | 15:07 | |
| TheJulia | thanks! | 15:07 |
| openstack | Meeting ended Wed May 9 15:07:31 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:07 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/heat/2018/heat.2018-05-09-14.00.html | 15:07 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/heat/2018/heat.2018-05-09-14.00.txt | 15:07 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/heat/2018/heat.2018-05-09-14.00.log.html | 15:07 |
| *** gyankum has joined #heat | 15:08 | |
| *** gyan_ has joined #heat | 15:08 | |
| TheJulia | I'll try to rev the patch later today, fwiw | 15:09 |
| ramishra | ricolin: another failure where could not detach the interface from an instance when replacing the instance http://logs.openstack.org/17/560417/1/gate/heat-functional-orig-mysql-lbaasv2/e38e8cd/logs/screen-n-cpu.txt.gz?level=ERROR#_May_09_14_04_08_008107 | 15:10 |
| ramishra | this also happens from time to time | 15:10 |
| *** felipemonteiro_ has quit IRC | 15:16 | |
| *** felipemonteiro_ has joined #heat | 15:16 | |
| *** fragatina has quit IRC | 15:20 | |
| *** links has quit IRC | 15:25 | |
| *** armaan has quit IRC | 15:25 | |
| *** armaan has joined #heat | 15:26 | |
| *** derekh has quit IRC | 15:26 | |
| *** serlex has joined #heat | 15:30 | |
| *** dyasny_ has joined #heat | 15:30 | |
| ricolin | ramishra, right! added it the the etherpad now, maybe we can resolve that one too | 15:31 |
| *** dyasny__ has quit IRC | 15:32 | |
| ramishra | therve: we probably also have to do https://github.com/openstack/octavia/blob/master/octavia/tests/contrib/gate_hook.sh#L111 ? | 15:38 |
| *** serlex has quit IRC | 15:47 | |
| *** ramishra has quit IRC | 16:09 | |
| *** ramishra has joined #heat | 16:31 | |
| *** gyankum has quit IRC | 16:33 | |
| *** gyan_ has quit IRC | 16:34 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 16:36 | |
| *** masber has joined #heat | 16:40 | |
| *** ramishra has quit IRC | 16:45 | |
| *** ricolin has quit IRC | 16:48 | |
| *** armaan has quit IRC | 16:55 | |
| *** armaan has joined #heat | 16:55 | |
| *** fragatina has joined #heat | 17:09 | |
| *** mdnadeem has quit IRC | 17:16 | |
| *** stevebaker has quit IRC | 17:28 | |
| *** dmellado has quit IRC | 17:29 | |
| *** mchlumsky_ has quit IRC | 17:35 | |
| *** mchlumsky has joined #heat | 17:37 | |
| *** mchlumsky has quit IRC | 17:41 | |
| *** mchlumsky has joined #heat | 17:43 | |
| *** gkadam_ has quit IRC | 17:43 | |
| *** jtomasek has quit IRC | 17:44 | |
| *** armaan has quit IRC | 18:00 | |
| *** armaan has joined #heat | 18:00 | |
| *** armaan has quit IRC | 18:17 | |
| *** armaan has joined #heat | 18:17 | |
| *** armaan has quit IRC | 18:18 | |
| *** armaan has joined #heat | 18:18 | |
| *** mdnadeem has joined #heat | 18:20 | |
| *** jtomasek has joined #heat | 18:22 | |
| *** d0ugal_ has joined #heat | 18:36 | |
| *** d0ugal has quit IRC | 18:37 | |
| *** mdnadeem has quit IRC | 18:39 | |
| *** gfidente is now known as gfidente|afk | 18:53 | |
| *** dmellado has joined #heat | 18:58 | |
| *** wolverineav has quit IRC | 19:01 | |
| *** wolverineav has joined #heat | 19:02 | |
| *** stevebaker has joined #heat | 19:02 | |
| *** wolverineav has quit IRC | 19:06 | |
| *** felipemonteiro__ has joined #heat | 19:11 | |
| *** felipemonteiro_ has quit IRC | 19:15 | |
| *** crose has quit IRC | 19:16 | |
| *** fragatina has quit IRC | 19:19 | |
| *** links has joined #heat | 19:23 | |
| *** links has quit IRC | 19:45 | |
| *** wolverineav has joined #heat | 19:50 | |
| *** wolverineav has quit IRC | 19:54 | |
| *** jmlowe has quit IRC | 19:58 | |
| openstackgerrit | Thomas Herve proposed openstack/heat master: Download octavia image in tests https://review.openstack.org/567238 | 20:41 |
| *** jcoufal has quit IRC | 20:51 | |
| *** jmlowe has joined #heat | 20:53 | |
| *** gfidente|afk has quit IRC | 21:00 | |
| *** dmellado has quit IRC | 21:15 | |
| *** stevebaker has quit IRC | 21:20 | |
| *** dmellado has joined #heat | 21:23 | |
| *** fragatina has joined #heat | 21:26 | |
| *** fragatina has quit IRC | 21:26 | |
| *** fragatina has joined #heat | 21:27 | |
| *** dmellado has quit IRC | 21:27 | |
| *** jmlowe has quit IRC | 21:39 | |
| *** stevebaker has joined #heat | 21:45 | |
| *** stevebaker has quit IRC | 21:58 | |
| *** felipemonteiro__ has quit IRC | 22:06 | |
| *** jtomasek has quit IRC | 22:07 | |
| *** zigo has quit IRC | 22:11 | |
| *** zigo has joined #heat | 22:11 | |
| *** priteau has quit IRC | 22:22 | |
| *** mstrohl has joined #heat | 22:39 | |
| *** hongbin has quit IRC | 22:43 | |
| *** mstrohl has quit IRC | 22:49 | |
| *** livelace has quit IRC | 23:23 | |
| *** stevebaker has joined #heat | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!