*** Bhujay has joined #openstack-sahara | 04:18 | |
*** Bhujay has quit IRC | 04:19 | |
*** tmckay has quit IRC | 06:02 | |
*** links has joined #openstack-sahara | 06:16 | |
*** pcaruana has joined #openstack-sahara | 06:39 | |
*** rcernin has quit IRC | 07:02 | |
*** tosky has joined #openstack-sahara | 07:58 | |
*** rcernin has joined #openstack-sahara | 08:59 | |
*** hoonetorg has quit IRC | 09:20 | |
*** rcernin has quit IRC | 09:47 | |
tellesnobrega | tosky, have you seen this error come up? | 11:54 |
---|---|---|
tellesnobrega | File "/usr/lib64/python3.6/selectors.py", line 348, in __init__ | 11:54 |
tellesnobrega | self._poll = select.poll() | 11:54 |
tellesnobrega | AttributeError: module 'select' has no attribute 'poll' | 11:54 |
tosky | tellesnobrega: no, but a quick search may show a connection with eventlet | 11:58 |
tellesnobrega | this is showing up when I run the tests from plugin split | 12:00 |
tosky | I see that it's using python3; is the non-split code working with python3 too? | 12:01 |
tellesnobrega | weird enough, when I run on sahara master code using tox -e debug it appears, but not when I run tox -e py27 or tox -e py36 | 12:02 |
tosky | uhm, if it's really about eventlet, maybe some issue with monkeypatching? | 12:03 |
tellesnobrega | that is what I read | 12:04 |
tellesnobrega | someone saying that gevent removed poll from subprocess | 12:04 |
tellesnobrega | and its failing now | 12:04 |
tellesnobrega | that is on the gevent project | 12:05 |
tellesnobrega | maybe eventlet does something similar | 12:05 |
tellesnobrega | https://github.com/gevent/gevent/issues/446 | 12:05 |
tellesnobrega | http://git.openstack.org/cgit/openstack/glance/commit/?id=630402204e83b9e36c6822fc251fa06cf28963ac | 12:06 |
tosky | for the record, and it matches the expectation, I see the same error on the current (unsplit) master | 12:09 |
tosky | we probably need to call the code from sahara/utils/patches.py also somewhere else, maybe | 12:10 |
tosky | sahara/tests/__init__.py call patches.patch_all(), which should take care of it | 12:10 |
tellesnobrega | yes | 12:11 |
tosky | and I even fixed it | 12:11 |
tosky | O.o | 12:11 |
tellesnobrega | just looking at it | 12:11 |
openstackgerrit | Tobias Urdin proposed openstack/puppet-sahara stable/rocky: Update Gemfile for stable/rocky https://review.openstack.org/597093 | 12:11 |
tosky | I totally forgot about https://review.openstack.org/#/c/449261/ | 12:12 |
tellesnobrega | i guess I forgot to pull that into the plugins part | 12:13 |
tellesnobrega | I'm down to 65 tests failing on the plugins side now | 12:14 |
tellesnobrega | sahara side is still a bunch | 12:14 |
tellesnobrega | but I don't think it will be too much trouble | 12:14 |
tellesnobrega | once I'm done with the plugins side | 12:14 |
tellesnobrega | I will ask you to take a look on how I did things so we can discuss if there is anything I can do to improve the architecture | 12:15 |
tosky | are you keeping the fake plugin inside sahara.git, so that it can be tested standalone? | 12:15 |
tellesnobrega | I will do that next | 12:15 |
tellesnobrega | it is not there right now | 12:15 |
tellesnobrega | but I will move it back | 12:16 |
tosky | and here is my description of the eventlet issue (thanks, logs): http://eavesdrop.openstack.org/irclogs/%23openstack-sahara/%23openstack-sahara.2017-03-22.log.html#t2017-03-22T17:53:23 | 12:16 |
tellesnobrega | just have to figure out how to use stevedore to load from different sources | 12:16 |
tosky | I thought it did the magic somehow | 12:17 |
tellesnobrega | tosky, I'm not sure, will look | 12:52 |
*** cmart has joined #openstack-sahara | 13:07 | |
openstackgerrit | xuan.mingyi proposed openstack/puppet-sahara master: Add the missing 'Table of Contents' in README https://review.openstack.org/596813 | 13:43 |
tosky | tellesnobrega: can you please +1 again the release of sahara 8.0.3? https://review.openstack.org/#/c/596409/ | 13:54 |
tosky | I added the last fix | 13:54 |
tellesnobrega | tosky, yes | 13:54 |
*** links has quit IRC | 14:27 | |
*** pcaruana has quit IRC | 14:29 | |
*** pcaruana has joined #openstack-sahara | 14:30 | |
*** remix_tj has joined #openstack-sahara | 14:31 | |
remix_tj | hi tosky are you there? | 14:31 |
tosky | remix_tj: hi | 14:31 |
remix_tj | i've an ancient newton setup where a cluster is in DELETING status since days | 14:32 |
remix_tj | i've seen this https://bugs.launchpad.net/sahara/+bug/1647411 but i'm sure is not implemented, because i've not updated recently | 14:32 |
openstack | Launchpad bug 1647411 in Sahara "Clusters can stay in Deleting state forever" [Medium,Triaged] | 14:32 |
remix_tj | do you know any workaround to unlock the situation? i can't update node template because is in use | 14:33 |
*** Bhujay has joined #openstack-sahara | 14:33 | |
*** Bhujay has quit IRC | 14:34 | |
*** Bhujay has joined #openstack-sahara | 14:35 | |
tosky | remix_tj: is the underlying heat object removed? | 14:35 |
remix_tj | tosky: seems no, openstack stack list --hidden shows a DELETE_FAILED stack with the matching name | 14:35 |
tosky | remix_tj: kill that | 14:36 |
remix_tj | stack delete is enough? | 14:36 |
tosky | remix_tj: also, --hidden --nested | 14:36 |
tosky | because it may be stuck on deletion of some subelement | 14:36 |
tosky | yes, start with openstack stack delete on that top-level element | 14:36 |
remix_tj | tosky: i'm sure it was suck on creation because nova had problems because if network troubles and redis was not serving nova-* correctly | 14:37 |
remix_tj | has moved to DELETE_IN_PROGRESS i keep the situation monitored and i case i ask you again | 14:40 |
remix_tj | thanks | 14:40 |
remix_tj | Resource DELETE failed: Conflict: resources.clouderarocketv2-clouderanodegrouptemplate-8652b800: Security Group e2bae36c-31f5-4c97-a3a5-d1b260b9441d in use | 14:41 |
remix_tj | wow but i don't have any instance! | 14:41 |
tosky | just force it again | 14:42 |
tosky | the deletion | 14:42 |
remix_tj | yup | 14:42 |
remix_tj | maybe there is still something using that group | 14:43 |
*** cmart has quit IRC | 14:46 | |
*** Bhujay has quit IRC | 14:58 | |
*** pcaruana has quit IRC | 15:00 | |
*** cmart has joined #openstack-sahara | 15:33 | |
*** cmart has quit IRC | 15:35 | |
tosky | remix_tj: was it finally removed? | 16:06 |
remix_tj | no because is stuck on deleting a security group that cannot be removed | 16:06 |
remix_tj | tosky: there were a pending creation of a server, which has failed due to troubles on nova. but the network port were allocated and locking the secgroup. I had to make a query on the db to find which neutron port was holding | 16:10 |
remix_tj | the secgroup | 16:10 |
remix_tj | https://access.redhat.com/solutions/3009811 | 16:10 |
remix_tj | but now the stack disappeared | 16:10 |
*** dave-mccowan has joined #openstack-sahara | 16:13 | |
remix_tj | deletion completed, thanks tosky | 16:13 |
tosky | remix_tj: so hopefully the cluster should disappear too | 16:14 |
remix_tj | i executed again openstack dataprocessing cluster delete and disappeared | 16:14 |
remix_tj | last simple question | 16:15 |
remix_tj | i have a cluster which is reporting Creating cluster failed for the following reason(s): CM API error: HTTP Error 400: Bad Request Error ID: 6e28c85d-6a99-485d-aea6-bd0245d9d5d2 | 16:15 |
remix_tj | how do i see which request was and what happened? that error id is about what? | 16:15 |
remix_tj | i see in cloudera manager some errors, but i want to understand what went wrong from outside | 16:16 |
*** Bhujay has joined #openstack-sahara | 16:17 | |
tosky | if cloudera manager did not report a better error, there is no much to do | 16:17 |
tosky | if you set the logging to debug level and no other details are in sahara-engine.log, then only cloudera manager can say what happened | 16:17 |
tosky | sahara wraps the requests to cloudera manager | 16:18 |
remix_tj | ok, debug is required. I think is because there has been missing parameters on the node template side, but i'm not sure, i don't know cloudera | 16:18 |
remix_tj | and the cluster is being deployed by a data analyst, so don't know also what has set | 16:19 |
remix_tj | tosky: but the error id is an openstack id or CM id? | 16:21 |
*** Bhujay has quit IRC | 16:22 | |
remix_tj | going home, see you tomorrow | 16:23 |
tosky | I don't remember | 16:26 |
*** Bhujay has joined #openstack-sahara | 16:30 | |
*** Bhujay has quit IRC | 16:43 | |
*** Bhujay has joined #openstack-sahara | 16:44 | |
*** Bhujay has quit IRC | 17:24 | |
*** tosky has quit IRC | 18:23 | |
openstackgerrit | Merged openstack/puppet-sahara stable/rocky: Update Gemfile for stable/rocky https://review.openstack.org/597093 | 18:27 |
*** dave-mccowan has quit IRC | 18:36 | |
*** dave-mccowan has joined #openstack-sahara | 18:46 | |
*** hoonetorg has joined #openstack-sahara | 19:22 | |
*** hoonetorg has quit IRC | 19:24 | |
*** dave-mccowan has quit IRC | 19:26 | |
*** hoonetorg has joined #openstack-sahara | 21:36 | |
*** rcernin has joined #openstack-sahara | 21:46 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!