| *** lucasxu has quit IRC | 00:22 | |
| *** tmckay has quit IRC | 00:34 | |
| *** lucasxu has joined #openstack-sahara | 00:35 | |
| *** lucasxu has quit IRC | 00:55 | |
| *** dave-mccowan has joined #openstack-sahara | 01:06 | |
| *** ukaynar_ has quit IRC | 01:09 | |
| *** shuyingya has joined #openstack-sahara | 01:10 | |
| *** tuanluong has joined #openstack-sahara | 01:40 | |
| *** esikache1 has joined #openstack-sahara | 02:20 | |
| *** esikache1 has quit IRC | 02:24 | |
| *** lucasxu has joined #openstack-sahara | 02:30 | |
| openstackgerrit | Ngo Quoc Cuong proposed openstack/python-saharaclient master: Clone sahara hacking checks to saharaclient https://review.openstack.org/483223 | 02:40 |
|---|---|---|
| *** lucasxu has quit IRC | 02:53 | |
| *** ukaynar has joined #openstack-sahara | 03:03 | |
| *** lucasxu has joined #openstack-sahara | 03:17 | |
| *** masber has quit IRC | 03:51 | |
| *** links has joined #openstack-sahara | 03:58 | |
| *** dave-mccowan has quit IRC | 04:01 | |
| *** lucasxu has quit IRC | 04:02 | |
| *** esikache1 has joined #openstack-sahara | 04:40 | |
| *** esikache1 has quit IRC | 05:00 | |
| *** ukaynar_ has joined #openstack-sahara | 05:14 | |
| *** ukaynar has quit IRC | 05:17 | |
| *** esikache1 has joined #openstack-sahara | 05:22 | |
| *** ukaynar_ has quit IRC | 05:29 | |
| *** ukaynar has joined #openstack-sahara | 05:29 | |
| *** ukaynar has quit IRC | 05:34 | |
| *** anshul has joined #openstack-sahara | 05:47 | |
| *** rcernin has joined #openstack-sahara | 05:50 | |
| *** pgadiya has joined #openstack-sahara | 05:54 | |
| *** esikache1 has quit IRC | 06:33 | |
| *** esikachev has joined #openstack-sahara | 06:33 | |
| *** mgoddard_ has joined #openstack-sahara | 07:08 | |
| *** esikache1 has joined #openstack-sahara | 07:15 | |
| *** esikachev has quit IRC | 07:17 | |
| *** tesseract has joined #openstack-sahara | 07:17 | |
| *** mgoddard_ has quit IRC | 08:00 | |
| *** aolwas28 is now known as aolwas | 08:17 | |
| *** anshul has quit IRC | 08:35 | |
| *** openstackgerrit has quit IRC | 08:49 | |
| *** anshul has joined #openstack-sahara | 08:51 | |
| *** tosky has joined #openstack-sahara | 08:56 | |
| *** mgoddard_ has joined #openstack-sahara | 08:58 | |
| *** anshul has quit IRC | 09:14 | |
| *** anshul has joined #openstack-sahara | 09:25 | |
| *** Poornima_K has joined #openstack-sahara | 09:54 | |
| *** Poornima_K has quit IRC | 10:03 | |
| *** pgadiya has quit IRC | 10:05 | |
| *** shuyingya has quit IRC | 10:20 | |
| *** pgadiya has joined #openstack-sahara | 10:21 | |
| *** shuyingya has joined #openstack-sahara | 10:24 | |
| *** shuyingya has quit IRC | 10:24 | |
| *** shuyingya has joined #openstack-sahara | 10:24 | |
| *** raissa_ has quit IRC | 10:40 | |
| *** tellesnobrega has quit IRC | 10:41 | |
| *** pgadiya has quit IRC | 10:52 | |
| *** pgadiya has joined #openstack-sahara | 11:03 | |
| *** tuanluong has quit IRC | 11:05 | |
| *** pgadiya has quit IRC | 11:16 | |
| *** dave-mccowan has joined #openstack-sahara | 11:26 | |
| *** shuyingya has quit IRC | 11:35 | |
| *** shuyingya has joined #openstack-sahara | 11:35 | |
| *** zemuvier has joined #openstack-sahara | 11:41 | |
| *** chlong_ has quit IRC | 11:43 | |
| *** tellesnobrega has joined #openstack-sahara | 11:45 | |
| iwonka | does anyone know how to get pdb to work with sahara-dashboard? whenever i have pdb.set_trace() in code i get BdbQuit | 12:00 |
| *** mgoddard_ has quit IRC | 12:07 | |
| tellesnobrega | iwonka, hum, it should work | 12:08 |
| tellesnobrega | does it say anything else? | 12:08 |
| *** hoonetorg has joined #openstack-sahara | 12:09 | |
| *** tmckay has joined #openstack-sahara | 12:10 | |
| *** tmckay has quit IRC | 12:11 | |
| iwonka | http://paste.openstack.org/show/615845/ | 12:18 |
| iwonka | so it prints pdb prompt | 12:18 |
| iwonka | and then throws the error | 12:18 |
| *** esikache1 has quit IRC | 12:37 | |
| *** jeremyfreudberg has joined #openstack-sahara | 12:49 | |
| *** raissa_ has joined #openstack-sahara | 12:52 | |
| *** rdearauj has joined #openstack-sahara | 12:57 | |
| *** raissa_ has quit IRC | 12:57 | |
| *** lucasxu has joined #openstack-sahara | 13:06 | |
| *** shuyingy_ has joined #openstack-sahara | 13:10 | |
| *** shuyingya has quit IRC | 13:10 | |
| *** tmckay has joined #openstack-sahara | 13:12 | |
| *** shuyingy_ has quit IRC | 13:13 | |
| *** esikache1 has joined #openstack-sahara | 13:21 | |
| *** shuyingya has joined #openstack-sahara | 13:33 | |
| *** ukaynar has joined #openstack-sahara | 13:35 | |
| jeremyfreudberg | iwonka, did you figure it out? | 13:38 |
| iwonka | nope | 13:38 |
| *** shuyingya has quit IRC | 13:38 | |
| jeremyfreudberg | can you try stopping apache, and doing cd /opt/stack/horizon, then tox -e runserver 0.0.0.0 (then visit the IP of your machine on port 8000) | 13:39 |
| tosky | jeremyfreudberg: regarding https://review.openstack.org/#/c/402657/ ; if I remember correctly, I was talking about other fixes that I had to push to fix the gates | 13:41 |
| tosky | so no time to investigate whether Vanilla was working with 16.04 | 13:41 |
| tosky | if you check the other reviews for sahara-image-elements around the date of that review, you will see other fixes | 13:42 |
| jeremyfreudberg | tosky, cool - i will check it out | 13:42 |
| *** openstackgerrit has joined #openstack-sahara | 13:50 | |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates https://review.openstack.org/485210 | 13:50 |
| *** mgoddard_ has joined #openstack-sahara | 13:51 | |
| *** rdearauj is now known as raissa | 13:51 | |
| *** raissa is now known as Guest11014 | 13:52 | |
| *** Guest11014 is now known as raissa_ | 13:52 | |
| openstackgerrit | Iwona Kotlarska proposed openstack/sahara-dashboard master: Add export of node group templates https://review.openstack.org/485215 | 13:57 |
| *** tellesnobrega has quit IRC | 13:57 | |
| *** tellesnobrega has joined #openstack-sahara | 13:58 | |
| iwonka | tellesnobrega: take a look at the commits please | 13:59 |
| tellesnobrega | iwonka, will do | 13:59 |
| iwonka | i still didn't figure out pdb, but export works | 14:00 |
| iwonka | now i should try to add it to cli? | 14:01 |
| *** zemuvier has quit IRC | 14:03 | |
| *** jeremyfreudberg has left #openstack-sahara | 14:08 | |
| *** jeremyfreudberg has joined #openstack-sahara | 14:08 | |
| *** links has quit IRC | 14:18 | |
| openstackgerrit | Iwona Kotlarska proposed openstack/sahara-dashboard master: Add export of node group templates https://review.openstack.org/485215 | 14:20 |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates https://review.openstack.org/485210 | 14:21 |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates https://review.openstack.org/485210 | 14:28 |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates https://review.openstack.org/485210 | 14:30 |
| jeremyfreudberg | iwonka, depends-on should be the change-id, not the url | 14:31 |
| jeremyfreudberg | sorry for not explaining | 14:31 |
| iwonka | ok thanks, sorry, i didn't know | 14:31 |
| iwonka | so Depends-On: I7a2ef7e5cff70e6034c1222252fbf7c5c35a7e1c | 14:31 |
| iwonka | ? | 14:31 |
| jeremyfreudberg | iwonka, exactly | 14:32 |
| iwonka | ok, thanks :) | 14:32 |
| openstackgerrit | Iwona Kotlarska proposed openstack/python-saharaclient master: Add export of node group templates https://review.openstack.org/485210 | 14:33 |
| tosky | does anyone know what sahara could try to do every two second or so with authentication? | 14:33 |
| jeremyfreudberg | tosky, any context around that question? | 14:34 |
| tosky | background: I'm trying to deploy Sahara with TripleO (master) using containers | 14:34 |
| tosky | compared to the packstack installation, I see every two seconds this message in sahara-api.log: | 14:34 |
| tosky | INFO keystonemiddleware.auth_token [-] Rejecting request | 14:34 |
| tosky | I see also other stuff like https://bugs.launchpad.net/oslo.messaging/+bug/1671781, but most of them have are known/coming from something deprecated | 14:35 |
| openstack | Launchpad bug 1671781 in oslo.messaging "rabbit polling spams into logs" [Undecided,Confirmed] | 14:35 |
| openstackgerrit | Iwona Kotlarska proposed openstack/sahara-dashboard master: Add export of node group templates https://review.openstack.org/485215 | 14:35 |
| tosky | that error is the only one (Rejecting request) is the only one that I can't pinpoint | 14:35 |
| * jeremyfreudberg tries to remember, because he's definitely seen it before | 14:36 | |
| * jeremyfreudberg sees it in his production logs | 14:38 | |
| jeremyfreudberg | tosky, to be honest I always ignored it. probably not a good thing | 14:43 |
| jeremyfreudberg | not a good thing to ignore, I mean | 14:43 |
| tosky | jeremyfreudberg: uh | 14:43 |
| tosky | interesting, because I've never seen it before | 14:43 |
| tosky | how do you deploy? | 14:43 |
| jeremyfreudberg | we have our own puppet manifests, and use the rhel-osp packages | 14:44 |
| jeremyfreudberg | nothing particularly fancy about how we do it | 14:44 |
| tosky | which wraps the official puppet-sahara, etc? | 14:44 |
| jeremyfreudberg | yes, the official puppet-sahara | 14:44 |
| tosky | uhm uhm | 14:44 |
| tosky | (unrelated, there is a warning about something something cache deprecated and that we should use memcached_servers) | 14:45 |
| jeremyfreudberg | tosky, are you seeing it really every two seconds? | 14:46 |
| jeremyfreudberg | mine comes exactly at the 1 minute interval | 14:46 |
| tosky | yes, 2 seconds | 14:46 |
| tosky | weird; I'm not sure if it's something happening every 2 seconds, or it tries again it every 2 seconds because it fails, but 2 seconds is not the base interval | 14:47 |
| * jeremyfreudberg thinks | 14:50 | |
| *** tellesnobrega has quit IRC | 14:55 | |
| jeremyfreudberg | tosky, probably not related, but I just realized I don't have periodic_coordinator_backend_url set in sahara.conf | 14:57 |
| tosky | uhm | 14:57 |
| tosky | me neither, but I don't have it also in the packstack deployment which does *not* show the message | 14:58 |
| jeremyfreudberg | and that packstack has periodic_enable=True? | 14:58 |
| tosky | it's commented, but the default value seems to be True | 14:59 |
| jeremyfreudberg | yep | 14:59 |
| jeremyfreudberg | anyway, if I set it to false, I still get the the same middleware reject | 15:00 |
| jeremyfreudberg | so it's not any of the periodic tasks actually contained by sahara/service/periodic.py | 15:00 |
| jeremyfreudberg | tosky - I have to step out for a while, but I'll be back | 15:00 |
| tosky | sure | 15:00 |
| *** jeremyfreudberg has quit IRC | 15:01 | |
| *** hoonetorg has quit IRC | 15:02 | |
| *** anshul has quit IRC | 15:24 | |
| *** jeremyfreudberg has joined #openstack-sahara | 15:25 | |
| jeremyfreudberg | tosky, anything new? | 15:31 |
| tosky | jeremyfreudberg: no :/ | 15:34 |
| jeremyfreudberg | tosky, it almost seems like something external to sahara | 15:37 |
| tosky | jeremyfreudberg: but connected somehow, as it is showing the logs in sahara-api.log | 15:37 |
| jeremyfreudberg | tosky, I mean, for example if were to see something like " DEBUG keystonemiddleware.auth_token [-] Authenticating user token process_request /usr/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py:401 | 15:37 |
| jeremyfreudberg | " | 15:37 |
| jeremyfreudberg | the successful version of our error | 15:38 |
| jeremyfreudberg | something like that comes when a request to sahara is made externally, not a task within sahara itself | 15:38 |
| jeremyfreudberg | if i make sense | 15:38 |
| tosky | uhm | 15:38 |
| tosky | what could it be? | 15:39 |
| tosky | telemetry? | 15:39 |
| jeremyfreudberg | we don't use telemetry/ceilometer in my cloud, so, no, I guess | 15:40 |
| tosky | I naively tried to add a call to traceback but of course it's a green thread or so: | 15:42 |
| tosky | http://paste.openstack.org/show/615868/ | 15:42 |
| jeremyfreudberg | tosky, here's something really interesting. I stop sahara and instead run python -m SimpleHTTPServer 8386 | 15:47 |
| jeremyfreudberg | so I can be sneaky, and if there really is something external, it will reveal itself | 15:48 |
| tosky | honeypot? :) | 15:48 |
| jeremyfreudberg | http://paste.openstack.org/show/615871/ | 15:49 |
| jeremyfreudberg | so there is something external | 15:49 |
| jeremyfreudberg | this could be specific to my environment, but it's still really interesting | 15:51 |
| tosky | still I see it too | 15:54 |
| * tosky puzzled | 15:54 | |
| jeremyfreudberg | the fact that you see it too is a little mind-blowing | 15:55 |
| *** tellesnobrega has joined #openstack-sahara | 15:58 | |
| tellesnobrega | tosky, jeremyfreudberg any progress on the every 2 seconds error? | 15:59 |
| jeremyfreudberg | tellesnobrega, yes and no | 15:59 |
| tellesnobrega | not sure how to process that | 15:59 |
| jeremyfreudberg | basically, in both my env and in tosky env, there is something calling sahara with a bunch of junk | 16:00 |
| jeremyfreudberg | if I stop sahara and run a regular webserver on the sahara port instead, I get http://paste.openstack.org/show/615871/ | 16:00 |
| jeremyfreudberg | so it's a mystery | 16:01 |
| jeremyfreudberg | i have to go now - will be back later today | 16:02 |
| *** jeremyfreudberg has quit IRC | 16:02 | |
| *** rcernin has quit IRC | 16:09 | |
| openstackgerrit | Iwona Kotlarska proposed openstack/sahara-dashboard master: Add export of node group templates https://review.openstack.org/485215 | 16:22 |
| iwonka | ping tellesnobrega | 16:22 |
| *** rcernin has joined #openstack-sahara | 16:23 | |
| *** esikache1 has quit IRC | 16:32 | |
| tellesnobrega | iwonka, pong | 16:43 |
| iwonka | tellesnobrega: cli now? are the commits ok? | 16:44 |
| tellesnobrega | export looks good on the saharaclient | 16:44 |
| iwonka | there are two commits | 16:45 |
| tellesnobrega | and sahara | 16:45 |
| iwonka | saharaclient and sahara-dashboard | 16:45 |
| tellesnobrega | now cli | 16:45 |
| tellesnobrega | dashboard too | 16:46 |
| tellesnobrega | this looks great iwonka | 16:46 |
| iwonka | ok | 16:46 |
| tellesnobrega | congrats | 16:46 |
| iwonka | thanks :D | 16:47 |
| iwonka | cli is also in python-saharaclient? | 16:47 |
| tellesnobrega | now cli and we should be good with export of ngt | 16:47 |
| *** jeremyfreudberg has joined #openstack-sahara | 16:49 | |
| jeremyfreudberg | tosky, you said that you could replicate my honeypot results, right? | 16:50 |
| tosky | jeremyfreudberg: uh, no, sorry, I didn't replicate that scenario | 16:50 |
| jeremyfreudberg | oh, maybe I misunderstood | 16:51 |
| *** ukaynar has quit IRC | 16:52 | |
| *** ukaynar has joined #openstack-sahara | 16:52 | |
| tosky | but maybe it's easier than expected (even with the containerized environment) | 16:54 |
| * tosky tries | 16:54 | |
| *** ukaynar has quit IRC | 16:57 | |
| tosky | uhm, maybe haproxy? | 16:59 |
| jeremyfreudberg | tosky, something like that | 16:59 |
| jeremyfreudberg | i need to talk to my infra guy | 16:59 |
| jeremyfreudberg | and still have to eat lunch | 16:59 |
| tosky | sure, sure | 17:00 |
| jeremyfreudberg | just a question for you: what IP do your bad requests come from, tosky? the exact IP of your controller? | 17:00 |
| tosky | (I'm leaving soonish and disappearing from most of tomorrow) | 17:00 |
| tosky | jeremyfreudberg: uhm, where do I see the IP? I mean, running SimpleHTTPServer I didn't see any output, but I had to disable haproxy first | 17:01 |
| tosky | yep, now haproxy is disabled and no messages | 17:01 |
| * tosky reenable haproxy | 17:01 | |
| jeremyfreudberg | oh, so no requests to simplehttpserver? | 17:02 |
| tosky | and the error continues | 17:02 |
| tosky | so, it's haproxy | 17:02 |
| tosky | good finding :) | 17:02 |
| jeremyfreudberg | makes sense | 17:02 |
| tosky | thanks for the hint, it helped | 17:02 |
| jeremyfreudberg | no problem | 17:02 |
| tellesnobrega | so HAproxy is failing to connect? | 17:03 |
| jeremyfreudberg | i'm not sure about tosky's case, but in my case it's actually not haproxy, it's actually nagios sending junk to it | 17:04 |
| jeremyfreudberg | but in tosky's case I guess it's haproxy | 17:04 |
| jeremyfreudberg | (so my error had nothing to do with it, but it did help us diagnose) | 17:05 |
| tosky | tellesnobrega: not sure if it's failing | 17:05 |
| tosky | but at least I know where I can complain | 17:05 |
| tellesnobrega | cool | 17:05 |
| *** jeremyfreudberg has quit IRC | 17:06 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Image generation for CDH Plugin https://review.openstack.org/448712 | 17:15 |
| *** ukaynar has joined #openstack-sahara | 17:18 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara master: Image generation for CDH Plugin https://review.openstack.org/448712 | 17:19 |
| *** raissa_ has quit IRC | 17:20 | |
| *** ukaynar has quit IRC | 17:29 | |
| *** ukaynar has joined #openstack-sahara | 17:32 | |
| *** tosky has quit IRC | 17:33 | |
| *** ukaynar_ has joined #openstack-sahara | 17:36 | |
| *** ukaynar has quit IRC | 17:39 | |
| *** tesseract has quit IRC | 17:46 | |
| *** mgoddard_ has quit IRC | 17:49 | |
| *** jeremyfreudberg has joined #openstack-sahara | 18:04 | |
| *** tosky has joined #openstack-sahara | 18:04 | |
| *** raissa_ has joined #openstack-sahara | 18:18 | |
| *** lucasxu has quit IRC | 18:32 | |
| *** lucasxu has joined #openstack-sahara | 18:35 | |
| *** lucasxu has quit IRC | 18:41 | |
| *** lucasxu has joined #openstack-sahara | 18:42 | |
| *** jeremyfreudberg has quit IRC | 18:42 | |
| *** esikache1 has joined #openstack-sahara | 18:53 | |
| *** lucasxu has quit IRC | 18:55 | |
| openstackgerrit | Merged openstack/python-saharaclient master: Clone sahara hacking checks to saharaclient https://review.openstack.org/483223 | 19:14 |
| *** chlong_ has joined #openstack-sahara | 19:15 | |
| *** lucasxu has joined #openstack-sahara | 19:30 | |
| *** lucasxu has quit IRC | 19:38 | |
| *** lucasxu has joined #openstack-sahara | 19:39 | |
| *** lucasxu has quit IRC | 19:43 | |
| *** lucasxu has joined #openstack-sahara | 19:44 | |
| openstackgerrit | Jeremy Freudberg proposed openstack/sahara-image-elements master: Build Xenial images for Vanilla and Storm https://review.openstack.org/485343 | 19:50 |
| *** lucasxu has quit IRC | 19:53 | |
| *** lucasxu has joined #openstack-sahara | 19:54 | |
| *** chlong_ has quit IRC | 20:03 | |
| *** esikache1 has quit IRC | 20:31 | |
| *** chlong_ has joined #openstack-sahara | 20:48 | |
| *** lucasxu has quit IRC | 20:57 | |
| *** chlong_ has quit IRC | 21:04 | |
| *** tellesnobrega has quit IRC | 21:13 | |
| *** tellesnobrega has joined #openstack-sahara | 21:21 | |
| *** tmckay has quit IRC | 21:33 | |
| *** shuyingya has joined #openstack-sahara | 21:41 | |
| *** shuyingya has quit IRC | 21:46 | |
| *** shuyingya has joined #openstack-sahara | 21:48 | |
| *** shuyingya has quit IRC | 21:53 | |
| *** ukaynar_ has quit IRC | 23:17 | |
| *** tosky has quit IRC | 23:21 | |
| *** rcernin has quit IRC | 23:34 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!