| *** dtruong has quit IRC | 00:07 | |
| *** dtruong has joined #heat | 00:07 | |
| *** asalkeld has joined #heat | 00:19 | |
| *** asalkeld has quit IRC | 00:21 | |
| *** asalkeld_ has joined #heat | 00:21 | |
| *** asalkeld__ has joined #heat | 00:27 | |
| *** asalkeld_ has quit IRC | 00:30 | |
| *** asalkeld has joined #heat | 00:37 | |
| *** asalkeld__ has quit IRC | 00:39 | |
| openstackgerrit | Rico Lin proposed openstack/heat-agents master: Skip testing docker cmd hook tests until story 2006430 fixed https://review.opendev.org/678118 | 01:30 |
|---|---|---|
| ricolin | zaneb, ^^^ | 01:31 |
| ricolin | stevebaker, how's the current plan for paunch to support docker? | 01:31 |
| ricolin | stevebaker, we got some issue with paunch blocking heat-agents gate jobs https://storyboard.openstack.org/#!/story/2006430 | 01:32 |
| stevebaker | ricolin: I don't know what the planned timing is for docker removal from paunch, it would probably be best to ask mwhahaha or EmilienM in #tripleo. Docker isn't available in centos-8, hence the switch to podman. As for the heat-agents job breakage, I doubt that was deliberate. (I see there were some reverts proposed yesterday https://review.opendev.org/#/q/topic:revert/bug/1833081 ) | 01:46 |
| ricolin | stevebaker, thx for the info | 01:48 |
| mwhahaha | Docker should still be supported until we've switched to centos 8 | 01:48 |
| mwhahaha | Not sure what broke but we'll fix it | 01:48 |
| mwhahaha | (tomorrow probably) | 01:49 |
| ricolin | mwhahaha, stevebaker I just proposed a patch to support backward compatibility in paunch. Feel free to check https://review.opendev.org/#/c/678117/ | 01:49 |
| mwhahaha | K | 01:50 |
| ricolin | mwhahaha, heat-agents broken because we using a testing cmd and feed it in to paunch.apply, since workflow in paunch change to use podman in default, the test cmd can't actually run anymore | 01:51 |
| ricolin | And that's when I notice the deprecation of docker in paunch | 01:51 |
| ricolin | I think zaneb also provide some comment about that in https://review.opendev.org/#/c/678086 too | 01:52 |
| mwhahaha | I'm not sure we should keep that hook. But we'll figure it out I guess | 01:53 |
| *** asalkeld has quit IRC | 01:53 | |
| openstackgerrit | Rico Lin proposed openstack/heat-agents master: Skip testing docker cmd hook tests until story 2006430 fixed https://review.opendev.org/678118 | 02:21 |
| zaneb | mwhahaha: it seems to me the real problem here is that Heat is relying on a part of TripleO (an inversion of the usual dependencies). and while TripleO doesn't care about supporting anything but CentOS, that isn't the case for Heat | 02:27 |
| zaneb | I don't know what the solution to that looks like though | 02:27 |
| zaneb | stevebaker: would it be possible to test paunch on Ubuntu or some other platform that has docker? | 02:28 |
| stevebaker | zaneb: not really. The unit tests will run anywhere, and the only functional test coverage is tripleo ci. I think it is reasonable for heat to ask the paunch maintainers to keep docker support as long as there are users of that heat-agents hook | 02:35 |
| zaneb | I can't imagine there ever not being users of that hook at this point | 02:37 |
| stevebaker | ricolin: zaneb let me try a fix in heat-agents | 02:41 |
| zaneb | be my guest ;) | 02:41 |
| zaneb | I wish we had co-gating. every paunch release breaks heat-agents | 02:42 |
| ricolin | stevebaker, super! | 02:42 |
| ricolin | what zaneb just said is true;/ | 02:42 |
| stevebaker | zaneb: ricolin +1 for co-gating, yes | 02:59 |
| *** maddtux has joined #heat | 03:02 | |
| ricolin | stevebaker, thx let me know how's your fix works:) | 03:04 |
| stevebaker | ricolin: instead of setting the command to /path/to/config-tool-fake.py, set it to 'docker' and make sure the PATH is set so 'docker' is a copy of config-tool-fake.py | 03:05 |
| ricolin | interesting | 03:07 |
| *** ramishra has joined #heat | 03:17 | |
| *** gkadam has joined #heat | 03:19 | |
| stevebaker | ricolin: actually what it really needed is a rewrite of that test ;) the tests shouldn't be concerned with the internals of paunch and what docker calls are made, and this test will keep breaking as long as it carries on. I'm going to try mocking out all of paunch, and rewriting the test to make sure apply is called with the expected arguments. Is it ok if I do this first thing Monday? | 03:48 |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Use connect_retries when creating clients https://review.opendev.org/678039 | 03:56 |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Ensure _static exists with placeholder https://review.opendev.org/678137 | 03:56 |
| ricolin | stevebaker, sure:) | 04:08 |
| ramishra | ricolin: docs job seems broken looking for _static, not sure why all of a sudden, something changed with sphinx probably, ^^ fixes it | 04:12 |
| *** ricolin has quit IRC | 04:14 | |
| *** ricolin has joined #heat | 04:21 | |
| ramishra | ricolin: not sure if you saw my earlier message about fixing the gate as you got disconnected after that... | 04:31 |
| ricolin | ramishra, I didn't received it;/ | 04:40 |
| ramishra | ricolin: ok https://review.opendev.org/678137 | 04:42 |
| ricolin | ramishra, approved | 04:50 |
| ricolin | thx | 04:50 |
| *** skramaja has joined #heat | 04:55 | |
| *** ricolin has quit IRC | 05:02 | |
| *** ricolin has joined #heat | 05:03 | |
| openstackgerrit | Merged openstack/heat master: Ensure _static exists with placeholder https://review.opendev.org/678137 | 05:13 |
| *** e0ne has joined #heat | 05:33 | |
| *** e0ne has quit IRC | 05:44 | |
| *** skramaja has quit IRC | 06:08 | |
| *** skramaja has joined #heat | 06:11 | |
| *** deepak_mourya_ has quit IRC | 06:35 | |
| *** deepak_mourya_ has joined #heat | 06:35 | |
| *** e0ne has joined #heat | 06:42 | |
| *** gkadam has quit IRC | 06:43 | |
| *** e0ne has quit IRC | 06:43 | |
| *** e0ne has joined #heat | 06:53 | |
| *** e0ne has quit IRC | 06:59 | |
| *** jawad_axd has joined #heat | 07:07 | |
| *** ricolin has quit IRC | 07:15 | |
| *** rcernin has quit IRC | 07:15 | |
| *** gfidente|afk is now known as gfidente | 07:20 | |
| *** jtomasek has joined #heat | 07:29 | |
| *** maddtux has quit IRC | 07:38 | |
| *** maddtux has joined #heat | 07:39 | |
| *** jtomasek has quit IRC | 07:42 | |
| *** e0ne has joined #heat | 08:05 | |
| *** k_mouza has joined #heat | 08:18 | |
| *** ivve has joined #heat | 08:26 | |
| ivve | hey there, i have an issue with heat not accepting a template that looks like this.. https://hastebin.com/qugajevoyu.http in the bottom creating the cloudconfig im trying to fetch the address of the server which is the cause of the error. is there any proper way of getting this information? | 08:33 |
| ivve | { get_attr: [ port_master01, fixed_ips, value ] } ? | 08:34 |
| ivve | my bad | 08:35 |
| ivve | { get_attr: [ port_master01, fixed_ips, ip_address, value ] } ? | 08:35 |
| ivve | { get_attr: [ port_master01, fixed_ips, 0, ip_address ] } | 09:38 |
| *** rmulugu has joined #heat | 09:52 | |
| *** hjensas has quit IRC | 10:00 | |
| rmulugu | Hi, During heat stack update execution .. the stack was failed with error "resources.volumexxx: volume in use" | 10:02 |
| rmulugu | how can we check what are the reasons for recreation of instances | 10:03 |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Add retries when loading keystone data and fetching endpoints https://review.opendev.org/678193 | 10:19 |
| *** k_mouza has quit IRC | 11:05 | |
| *** k_mouza_ has joined #heat | 11:05 | |
| *** hjensas has joined #heat | 11:11 | |
| *** k_mouza_ has quit IRC | 11:15 | |
| *** k_mouza has joined #heat | 11:15 | |
| *** skramaja has quit IRC | 11:16 | |
| *** k_mouza has quit IRC | 11:20 | |
| *** rmulugu has quit IRC | 11:25 | |
| *** k_mouza has joined #heat | 12:12 | |
| *** hjensas has quit IRC | 12:27 | |
| *** maddtux has quit IRC | 12:46 | |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Add retries when loading keystone data and fetching endpoints https://review.opendev.org/678193 | 12:54 |
| *** ivve has quit IRC | 13:24 | |
| *** bnemec has joined #heat | 13:34 | |
| *** bnemec is now known as beekneemech | 13:35 | |
| *** jawad_axd has quit IRC | 13:49 | |
| *** jawad_axd has joined #heat | 13:53 | |
| *** jawad_axd has quit IRC | 13:58 | |
| *** ramishra has quit IRC | 14:01 | |
| *** jawad_axd has joined #heat | 14:46 | |
| *** jawad_axd has quit IRC | 14:51 | |
| *** usr2033 has quit IRC | 14:54 | |
| openstackgerrit | Merged openstack/heat master: Use connect_retries when creating clients https://review.opendev.org/678039 | 15:09 |
| *** jawad_axd has joined #heat | 15:11 | |
| *** jawad_axd has quit IRC | 15:16 | |
| *** k_mouza_ has joined #heat | 15:51 | |
| *** k_mouza_ has quit IRC | 15:53 | |
| *** k_mouza has quit IRC | 15:54 | |
| *** k_mouza has joined #heat | 15:54 | |
| gregwork | im noticing that doing a heat stack delete on stacks with octavia load balancers occasionally fail where the load balancer provisioning state goes into a "Pending Update" mode | 16:02 |
| gregwork | this causes my overall stack delete to get stuck in "DELETE_IN_PROGRESS" | 16:03 |
| gregwork | pretty much all day | 16:03 |
| gregwork | is there a way to stop the hung stack delete | 16:03 |
| openstackgerrit | Rabi Mishra proposed openstack/heat master: Add retries when loading keystone data and fetching endpoints https://review.opendev.org/678193 | 16:06 |
| *** beekneemech has quit IRC | 16:07 | |
| *** bnemec has joined #heat | 16:20 | |
| *** k_mouza has quit IRC | 16:44 | |
| *** bnemec has quit IRC | 16:53 | |
| gregwork | in queens you also cant resource-signal a resource pending delete | 17:19 |
| gregwork | either so this is just hard stuck | 17:19 |
| zaneb | gregwork: delete the LB directly from Octavia | 18:39 |
| gregwork | cant its been set immutable by heat | 18:40 |
| gregwork | i get 409 errors touching it | 18:40 |
| zaneb | that's a thing? | 18:40 |
| gregwork | i know right | 18:40 |
| zaneb | ok, just read the API page and this might be a question for Octavia developers | 18:43 |
| *** e0ne has quit IRC | 18:46 | |
| *** k_mouza has joined #heat | 19:06 | |
| *** bnemec has joined #heat | 19:10 | |
| *** bnemec is now known as beekneemech | 19:11 | |
| gregwork | zaneb: do you know if heat kill -9's vs -15's the octavia controller process (was a question from johnsom in #openstack-lbaas | 19:11 |
| zaneb | heat doesn't touch the octavia process | 19:14 |
| zaneb | gregwork: ^ | 19:14 |
| *** johnsom has joined #heat | 19:14 | |
| gregwork | odd | 19:15 |
| gregwork | an theres johnsom | 19:15 |
| johnsom | Hi | 19:15 |
| johnsom | I'm not familiar with the heat code gregwork mentioned in our channel. | 19:16 |
| *** ash2307 has joined #heat | 19:16 | |
| gregwork | openshift-ansible creates LB resources for itself in openstack by calling OS::Octavia::LoadBalancer / Listener / Pool / Pool member | 19:17 |
| gregwork | the issue we are seeing is when we delete that stack the load balancer gets hung | 19:17 |
| gregwork | hence my inquries in this and the openstack-lbaas channel :) | 19:18 |
| johnsom | Yeah, as I mentioned in our channel, the only way it would get "hung" is if something kill -9 the Octavia controller process instead of a -15 graceful shutdown. | 19:18 |
| gregwork | and zaneb mentioned heat doesnt touch octavia ? | 19:18 |
| johnsom | Where is the code for this "OS::Octavia::LoadBalancer "? | 19:18 |
| zaneb | johnsom: https://opendev.org/openstack/heat/src/branch/master/heat/engine/resources/openstack/octavia/loadbalancer.py | 19:20 |
| zaneb | actually gregwork is on queens, so https://opendev.org/openstack/heat/src/branch/master/heat/engine/resources/openstack/octavia/loadbalancer.py | 19:20 |
| zaneb | https://opendev.org/openstack/heat/src/branch/stable/queens/heat/engine/resources/openstack/octavia/loadbalancer.py I mean | 19:20 |
| johnsom | zaneb This stuff only uses the Octavia API right? It doesn't start/stop service processes right? | 19:21 |
| zaneb | correct | 19:21 |
| johnsom | Yeah, so heat cannot be causing a resource to be stuck in a "PENDING_*" state | 19:21 |
| zaneb | you'd hope not :) | 19:22 |
| *** ivve has joined #heat | 20:03 | |
| gregwork | heat stack-delete openshift-cluster is returning: DELETE_FAILED Resource DELETE failed: JSONDecodeError: resources.masters.resources[1].resources.api_lb_member: Expecting value: line 1 column | 21:19 |
| gregwork | 1 (char 0) | 21:19 |
| gregwork | i havent seen JSONDecodeError as a reason for failing before | 21:19 |
| gregwork | any suggestions on where to look / whats going on | 21:19 |
| gregwork | openstack stack resource show nested-stack-name api_lb_member is the one with JSONDecodeError: resources.api_lb_member: Expectin value: line 1 column 1 (char 0) | 21:24 |
| gregwork | i guess thats kind of the same thing heh | 21:24 |
| gregwork | from resource OS::Octavia::PoolMember | 21:24 |
| gregwork | https://pastebin.com/xgkxd1c6 | 21:32 |
| *** rcernin has joined #heat | 22:11 | |
| *** ivve has quit IRC | 22:17 | |
| *** rcernin has quit IRC | 23:11 | |
| *** rcernin has joined #heat | 23:12 | |
| *** beekneemech is now known as keanu | 23:26 | |
| *** keanu is now known as beekneemech | 23:27 | |
| *** k_mouza has quit IRC | 23:51 | |
| *** k_mouza has joined #heat | 23:51 | |
| *** k_mouza has quit IRC | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!