Wednesday, 2017-01-11

*** harlowja has quit IRC00:09
*** kgriffs has quit IRC00:12
*** kgriffs has joined #openstack-zaqar00:17
*** harlowja has joined #openstack-zaqar00:25
*** mpanetta has joined #openstack-zaqar00:36
*** mpanetta has quit IRC00:41
*** wanghao has joined #openstack-zaqar00:43
openstackgerritMerged openstack/zaqar: Use _LW() to wrap the warning message  https://review.openstack.org/41123401:23
openstackgerritMerged openstack/zaqar: Fix typos in HACKING.rst  https://review.openstack.org/41680301:23
*** yanyanhu has joined #openstack-zaqar01:32
*** lhx__ has joined #openstack-zaqar01:33
*** nadya has joined #openstack-zaqar01:51
*** nadya has quit IRC01:55
*** nadya has joined #openstack-zaqar03:51
*** lhx__ has quit IRC03:52
*** nadya has quit IRC03:56
*** flwang1 has quit IRC03:59
*** lhx__ has joined #openstack-zaqar04:03
*** nadya has joined #openstack-zaqar04:52
*** nadya has quit IRC04:56
*** lhx__ has quit IRC05:13
*** nadya has joined #openstack-zaqar05:32
*** nadya has quit IRC05:34
*** lhx__ has joined #openstack-zaqar06:01
*** nadya has joined #openstack-zaqar06:07
*** nadya has quit IRC06:11
*** itisha has quit IRC06:12
*** pcaruana has joined #openstack-zaqar06:25
*** tesseract has joined #openstack-zaqar07:08
*** nadya has joined #openstack-zaqar07:11
*** lhx__ has quit IRC08:19
*** Eva-i has quit IRC08:22
*** Eva-i has joined #openstack-zaqar08:25
*** lhx__ has joined #openstack-zaqar08:31
*** wanghao has quit IRC09:28
*** nadya has quit IRC09:45
*** AAzza has quit IRC09:56
*** AAzza has joined #openstack-zaqar09:57
*** nadya has joined #openstack-zaqar10:05
*** nadya has quit IRC10:22
openstackgerritavnish proposed openstack/python-zaqarclient: Removed unnecessary utf-8 encoding  https://review.openstack.org/41882410:31
*** nadya has joined #openstack-zaqar10:50
*** nadya has quit IRC11:03
*** yanyanhu has quit IRC11:24
*** nadya has joined #openstack-zaqar11:50
*** rbrady-afk is now known as rbrady12:50
*** AAzza has quit IRC13:06
*** AAzza has joined #openstack-zaqar13:07
*** lhx__ has quit IRC13:08
*** AAzza has quit IRC13:13
*** AAzza has joined #openstack-zaqar13:14
*** AAzza has quit IRC13:18
*** AAzza has joined #openstack-zaqar13:19
*** lhx__ has joined #openstack-zaqar13:45
*** david-lyle has quit IRC13:56
*** david-lyle has joined #openstack-zaqar13:59
*** itisha has joined #openstack-zaqar14:11
*** david-lyle has quit IRC14:16
*** mpanetta has joined #openstack-zaqar14:43
*** mpanetta has quit IRC14:48
*** mpanetta has joined #openstack-zaqar14:49
*** lhx__ has quit IRC15:04
*** AAzza has quit IRC15:16
*** AAzza has joined #openstack-zaqar15:16
*** adu has joined #openstack-zaqar15:24
*** lhx__ has joined #openstack-zaqar15:48
*** wxy| has joined #openstack-zaqar15:50
*** lhx__ has quit IRC16:04
dtrainorHi.  I'm working on proxying the services that UI requires with the Apache instance that's serving the UI.  I've managed to proxy all the services except Zaqar.  This may be for a few different reasons, including my inexperience with how websockets operate over http.  An example of the Apache configuration I'm prototyping is located at http://paste.openstack.org/show/594589/ .  I've also made sure that mod_proxy, mod_proxy_http16:50
dtrainor, and mod_proxy_wstunnel are loaded.  The error I'm getting is "ZaqarWebSocketService.js:16 WebSocket connection to 'wss://8.43.87.242/zaqar-ws' failed: Error during WebSocket handshake: Unexpected response code: 200".  Did some research on this one but I can't find anything related to autobahn, the websocket implementation we're using for UI.16:50
wxy| dtrainor, hi, is there any error log in zaqar-websocket?16:53
wxy|dtrainor: And could you please open a bug for this?16:54
wxy|dtrainor:  basically, response code 200 means that the handshake is sucesse. It's a little strange for your situation.17:00
dtrainorhello, sorry, got distratected for a moment.  working on pulling some more logs17:00
dtrainori had read that as well17:00
*** nadya has quit IRC17:01
dtrainorhowever I don't see any errors (or connection attempts) in the zaqar debug logs, for the wsgi nor the websocket server.  i haven't opened a bug because this is a feature i'm working on.17:01
dtrainorthere's a blueprint associated with it17:01
wxy|dtrainor: So I guess the problem is not in zaqar inside. it's between Apache and Zaqar.17:03
dtrainori wish i could say that with confidence, yes, but my limited knowledge of how websockets work makes me hesitant to point that out exclusively17:04
dtrainorit's slowly coming together in my brain, and troubleshooting implementations like this help17:04
wxy|dtrainor: You can register a bug in Zaqar launchpad first. I'm sure we'll take a look and help you a few hours later. My TZ is UTC +8, it's 1:00 a.m. I have to go sleep now.17:08
dtrainoroh, i haven't yet turned on apache debug logging, taking a look at that17:08
dtrainoroh for sure.  thanks.17:08
wxy|dtrainor: :), good luck.17:08
dtrainorthank you for the time17:08
*** wxy| has quit IRC17:09
*** pcaruana has quit IRC17:12
*** nadya has joined #openstack-zaqar17:14
*** wxy has quit IRC17:14
*** tesseract has quit IRC17:20
*** nadya has quit IRC17:24
*** rbrady has quit IRC17:46
*** nadya has joined #openstack-zaqar17:50
*** vipuls has joined #openstack-zaqar17:58
*** nadya has quit IRC18:01
*** david-lyle has joined #openstack-zaqar18:16
*** nadya has joined #openstack-zaqar18:35
*** wxy has joined #openstack-zaqar19:12
*** rbrady has joined #openstack-zaqar19:52
*** rbrady has quit IRC19:52
*** rbrady has joined #openstack-zaqar19:52
flwangdtrainor: still around?20:02
dtrainoryep sure am.20:02
dtrainori may have figured it out, but I believe my ProxyPassReverse may need tweaking20:03
flwangdtrainor: ok, cool20:05
flwangfeel free ask questions here, we're always around20:05
dtrainorappreciate it, thanks.  what i'm seeing is the client (ui) make that websocket connection, but not actually receiving any data20:06
flwangdtrainor: btw, do you have any doc/blog to track the zaqar usage based on your experience?20:06
dtrainorjust some scratch notes, nothing composed.  this would be a good opportunity to create some though.20:06
*** nadya has quit IRC20:07
flwangdtrainor: yep, you can take this a kind request from zaqar team, tripleO is a good consumer of zaqar, and it would be nice if you guys can write some docs based on your experience, which will benefit the others a lot, i'm sure :)20:07
dtrainorsounds liek a good opportunity all around20:08
flwangdtrainor: thank you in advance ;)20:12
dtrainormy pleasure20:12
dtrainorthese last few days are the first i've ever taken to look in to zaqar, still coming up to speed20:12
*** flwang1 has joined #openstack-zaqar20:14
dtrainor(in case you didn't see it) these last few days are the first i've ever taken to look in to zaqar, still coming up to speed20:15
flwangall good, that could help us to fix some UX issue  :)20:20
flwangi mean make the user easy to use zaqar20:20
dtrainorok, so here's a question.  i see in apache debug logs that a request is made via proxy to the zaqar websocket instance but my client (the ui) never receives any data20:25
dtrainorthat is, things that rely on zaqar ws to be updated in the ui never change20:25
dtrainorthat's why i suspected problems with ProxyPassReverse20:25
dtrainorthough, since it's a websocket, i'm not certain i even need a ProxyPassReverse.... zaqar doesn't provide any kind of redirects or anything, does it?20:27
flwangi don't think zaqar provides any redirect20:38
flwangunless there is a builtin support from falcon20:38
flwangmay i know more background of your feature/test?20:39
flwangcurrently, devstack is using uwsgi as the wsgi server, seems you're using mod_wsgi, right?20:39
flwangand then you have haproxy before the mod_wsgi, is that your architecture?20:40
dtrainorif i understand this correctly, the wsgi server runs but also invokes an additional transport for websockets20:42
flwangcan you talk to zaqar without the haproxy?20:43
dtrainormy platform is the osp10 product but for this, i think it's close enough to devstack and upstream that the problem should exist in these different product variations20:43
dtrainorthat's a good question, i juts assumed "yes", let me see about testing that20:43
dtrainori see in the zaqar debug/verbose logs that requests are coming in20:44
dtrainor2017-01-11 15:41:44.166 32498 INFO zaqar.transport.websocket.protocol [-] Response: API v2 txt, 201. Request: action "subscription_create", body {"queue_name": "tripleo", "ttl": 3600}.20:44
dtrainorwell, that a subscription to the queue happens (if i'm reading this properly) presumably by the client (the ui)20:44
dtrainorok, i can curl zaqar (https://wiki.openstack.org/wiki/Zaqar/Give_Zaqar_a_try) :8888 and get an unauthorized, and curl'ing :9000 (the websocket transport listening port) and get an "curl: (52) Empty reply from server"20:50
dtrainorthe only part of zaqar that ui uses is the websocket transport20:50
dtrainor[Wed Jan 11 15:56:58.530276 2017] [proxy_http:debug] [pid 8108] mod_proxy_http.c(1925): [client 192.0.2.1:60742] AH01113: HTTP: declining URL ws://192.0.2.1:9000/20:57
dtrainoris there a special part of a url i'm missing when sending connections to that websocket transport?  do I need to include /websocket or something in the uri?  i'm seeing a few posts that suggest this sometimes may apply21:01
*** AAzza has quit IRC22:04
*** AAzza has joined #openstack-zaqar22:05
*** AAzza has quit IRC22:09
*** AAzza has joined #openstack-zaqar22:11
*** AAzza has quit IRC22:20
*** AAzza has joined #openstack-zaqar22:30
*** AAzza has quit IRC22:41
*** AAzza has joined #openstack-zaqar22:43
flwangdtrainor: sorry for the late response. was in a long meeting22:54
dtrainorno worries - i was mostly rambling22:54
flwangwhen you run curl, did you set the correct token?22:54
dtrainori didn't use curl to generate a token, just tried to curl the url without authentication.  i was looking at some other angles, and found that apache may upgrade the connection for websockets when using mod_proxy_wstunnel, and that connection gets upgraded for the entireity of the request, which may cause problems such as thi22:55
dtrainor*this22:55
dtrainorhttps://lists.apache.org/thread.html/c0d000d85f5afe1a7d7e0e6fef5c8d6b891dc8483814c567c593bf35@%3Cusers.httpd.apache.org%3E22:55
dtrainorI think this is more of an Apache problem22:56
dtrainorI have another environment that's identical, except it's not using the proxying technique that i'm working on. So I can reproduce happy path or sad path tests to compare against.22:56
dtrainori need to leave to go meet a coworker for dinner22:58
dtrainori really appreciate your help and ideas, thank you. i'll be back at it tonight and tomorrow.22:58
flwangcool, ttyl23:05

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!