Monday, 2017-03-27

*** themurph has quit IRC00:21
boxrick1dmsimard: I have finally upgraded to the new version, seems that Chrome support seems a little broken and in the docs "Set up the Apache virtual host at /etc/apache/sites-available/ara.conf:" -> http://ara.readthedocs.io/en/latest/webserver.html should be /etc/apache2*01:55
boxrick1Also did you ever add in the ability to disable tooltips? An option to default directly to the reports page would be handy!01:57
*** karimb has joined #ara08:09
*** openstackgerrit has quit IRC08:33
*** permalac has quit IRC08:55
*** permalac has joined #ara09:00
*** permalac has quit IRC09:06
*** permalac has joined #ara09:09
*** cuongnv has joined #ara09:15
*** cuongnv has quit IRC10:38
dmsimardboxrick1: hey thanks for spotting the typo11:45
dmsimardboxrick1: yes, there will eventually be a way to disable the tooltips.11:46
boxrick1Ok cool :)11:47
boxrick1With each load, it seems to pull in all the data for that page and each individual playbook run.11:50
boxrick1In my case, this is quite massive. Even if paginated down11:50
boxrick1A full page load is around 50 seconds.11:52
boxrick1From SSDs and a fast hexacore Xeon server.11:52
dmsimardboxrick1: the home page ? Yeah, someone told me that. There's probably a way to fix that. We're doing dumb "select count(*) from <table>"11:58
boxrick1If I have a poke through the code at some point and push some patches, is that the sort of thing you mind?11:59
dmsimardboxrick1: go for it, the more contributors the better12:01
dmsimardboxrick1: keep in mind that the project doesn't use the github workflow so it's a bit more involved but there are many benefits12:02
dmsimardThere's a doc to get started: http://ara.readthedocs.io/en/latest/contributing.html12:02
dmsimardboxrick1: from quick googling around, it seems like a known issue that the way SQLAlchemy counts records is slow, there's some faster ways which are easy to implement so I'll try that firsr12:04
dmsimardfirst*12:04
boxrick1I wonder if it simply just needs a different take on it12:06
boxrick1And only request the records on click ?12:06
*** dougbtv has joined #ara12:08
dmsimardYeah, there's different ways to approach the problem.. I'll at least improve the performance first, it's like a 5 line fix12:10
boxrick1If you want a guinea pig let me know.12:15
dmsimardboxrick1: there will be a 0.12.4 this week, I'll cut a release candidate before12:17
boxrick1Ok cool .12:18
*** themurph has joined #ara12:35
leifmadsendmsimard: thanks again for all the help last week -- got ARA working nicely with TOAD13:20
leifmadsen(again :))13:20
dmsimardneat13:20
dmsimardDoes anyone run ARA in https ? This user mentions there's some links in http causing issues but I can't seem to be able to reproduce it. https://storyboard.openstack.org/#!/story/200094713:22
dmsimardmnaser: ^ he says he uses jenkins html publisher, did you have to hack anything in particular ?13:22
mnaserdmsimard we dont run jenkins over ssl but i think i know whats going on here13:23
mnaserlet me see13:23
dmsimardIt's sort of weird because as far as I know, ARA only uses relative links from the root and doesn't specify the protocol .. but I might have missed something13:26
mnaserlooks like its happening in the modals13:27
mnaserso <a href="#" data-toggle="modal" data-target="#file_modal" data-load="35d04aaa-3674-47b5-8f95-ec810bef9064">/tmp/tmp.l5pXVGn45T/ansible/post-deploy.yml</a>13:27
mnaseri suspect that is where it poops out13:27
*** openstackgerrit has joined #ara13:28
openstackgerritDavid Moreau Simard proposed openstack/ara master: Change http URLs links to https  https://review.openstack.org/45021913:28
dmsimardmnaser: I found ^ but it can,t be related13:28
mnaseryeah most likely not13:28
mnaserim triyig to track down the data-load stuff13:29
dmsimardmnaser: https://github.com/openstack/ara/blob/master/ara/templates/report_list.html#L418-L42913:29
leifmadsenI planned to front ARA with traefik and https on the front with letsencrypt instead of managing multiple certs13:29
leifmadsen(that doesn't help solve this problem :))13:30
leifmadsenjust that I hadn't run into that yet13:30
dmsimarder no13:30
dmsimardmnaser: yeah what I linked is where the modals are handled13:31
mnaserok so it looks the iframe src gets replaced13:31
dmsimardmnaser: yeah, it's a "clever" way to dynamically load the right iframe in the modal on display13:32
dmsimardthe alternative being writing all the modals and all the iframes and throwing them at the browser13:32
dmsimardbut perhaps there's an issue with that particular bit13:33
mnaserdmsimard any reason why you dont just pull the content directly in and avoid the iframe?13:34
dmsimardmnaser: it doesn't scale, it needs to be loaded dynamically13:34
mnaseryeah still load dynamically13:35
mnaserit'll do an ajax request, get the content, put it inside the modal13:35
mnaserso the same thing you're doing now, but instead of an iframe, you can do $(this).find('contaienr-div').html(content);13:35
mnaserand it might eliminate that weird issue as well at the same time, i guess13:36
mnaserwhat could be useful if that bug report included the source code of the playbook reports page (the one where they click the facts from)13:36
dmsimardmnaser: I'm not sure I follow how we can do anything else than what we're doing now without writing and loading things at page load time13:36
mnaserdmsimard so instead of having the iframe load the page, you download the contents (with an ajax request) and put it inside the html div (when the modal gets shown)13:38
dmsimardI suck at ajax stuff, probably part of why I'm having a hard time understanding :(13:39
mnaserits okay no worries13:40
dmsimardI'll try and ask for more details in the bug13:40
mnaserim working on a little propopsal13:40
mnaseri asked for details in the bug13:40
dmsimardoh13:40
mnaserand ill do this13:40
mnaser(getting rid of iframes that is)13:40
dmsimardhey if the end result is the same, it works and resolves this issue I'm down13:41
mnaserhm ok this is not as easy as i thought it would be13:47
mnaserbecause some things you load with a bookmark13:47
mnaserand that cant easily be as replicated :<13:47
mnaserso how do we make storyboard send us notifications..13:48
logan-I'm the big reporter. Out of town today but I've been digging on it some. Is it possible that the auth cookie isn't being passed to Jenkins on the iframe load? I noticed that chrome shows a stalled/cancelled request to https:// and then it seems to attempt http:// as a fallback13:49
logan-Anyway based on what I have found now feel free to let it sit a while and I'll see if I can sort out the root cause this week13:50
mnaserlogan- it could be some weird jenkins stuff to prevent csrf13:50
mnaserit probably blocks iframes or something like that13:50
logan-Yeah I had to disable CSP just to get ARA loading13:50
logan-None of the fonts would load with Jenkins default CSP header13:51
mnaserlogan- https://wiki.jenkins-ci.org/display/JENKINS/XFrame+Filter+Plugin13:51
mnaser ithink this might be it13:51
mnaseri think jenkins has really locked down defaults13:51
mnaserlogan- could be related as well - http://jenkins-ci.361315.n4.nabble.com/iframes-no-longer-displayed-after-Jnekins-upgrade-1-557-td4697705.html13:53
logan-Thanks. I'll give it a try when I'm back at the pc13:54
dmsimardmnaser: you click the star at the top of the story (to subscrbe only to that story) or the star at the top of the project (to subscribe to the whole project)14:02
dmsimardmnaser: you also have to make sure in your personal preferences you have email notifications enabled14:02
mnaserdmsimard awesome thanks, i'll have to figure this out as openstack stuff moves to it14:02
boxrick1When using the new layout ( 0.12 vs 0.11 ) you can sadly no longer share direct pages as links, and when working with a failure it lives in two separate windows ( the role and the failure ) where it used to be all visible on one.14:02
*** tbielawa has joined #ara14:03
dmsimardboxrick1: yeah, so the new UI is great but we not without some sacrifices14:04
dmsimards/we//14:04
dmsimardboxrick1: for "permalinkability" I created an issue here https://storyboard.openstack.org/#!/story/200090414:05
dmsimardmnaser, logan-: if you figure this one out, happy to include some docs on how to do it if it's a jenkins implementation issue14:07
dmsimardIt'd be part of the different use case documentation (i.e, https://storyboard.openstack.org/#!/story/2000860 )14:07
mnaseryeah i think its probably a really common use case14:07
*** tbielawa is now known as tbielawa|mtg14:10
leifmadsensounds like a lot of us seem to be using ARA + Jenkins together14:16
leifmadsenI wonder if there are some "best practices" in this area that we could document together14:16
dmsimardThere's probably different approaches.. I tend to leave artifacts out of jenkins, especially html/js files since they're such a pain to view from Jenkins due to all the security things14:17
dmsimardBut I can see how people might want everything centralized from inside jenkins so we should definitely document some hints and gotchas14:19
dmsimardrussellb: o/ fancy seeing you here, hello sir14:56
russellb:)14:56
russellbleifmadsen was showing me ara the other day, pretty cool.14:57
dmsimardI ought to send him some stickers, he's been a great advocate :)14:57
leifmadsen:D14:58
leifmadsendmsimard: just send me the SVG and I can get some printed out at Roberts Signs and Awnings14:59
leifmadsensaves you the shipping14:59
dmsimardleifmadsen: it costs an envelope and a stamp, I should have just enough left to feed my kids14:59
leifmadsenlol15:00
leifmadsenrussellb: did you even work last week, or did I just get you on a bunch of demos? :)15:02
russellbi was connected to irc all week15:02
leifmadsenlol15:02
leifmadsenaen.15:02
leifmadsenamen*15:02
* dmsimard is connected to IRC 24/2415:02
leifmadsenyou mean 24/7? :)15:03
leifmadsenor are you only connected for just over 3 weeks of every month?15:04
leifmadsenthen you ragequit for a week15:04
leifmadsenall my meetings are done for the day, and now I have no idea what to do lol15:04
dmsimardah, 24/24 doesn't translate very well to english indeed15:05
leifmadsen:D15:05
*** tbielawa|mtg is now known as tbielawa15:12
tbielawalol16:13
openstackgerritMerged openstack/ara master: Use Ansible's CallbackBase._dump_results to dump results  https://review.openstack.org/44982716:46
openstackgerritMerged openstack/ara master: Change http URLs links to https  https://review.openstack.org/45021916:46
*** harlowja has quit IRC17:18
*** harlowja has joined #ara17:24
*** tbielawa is now known as tbielawa|lunch18:36
openstackgerritDavid Moreau Simard proposed openstack/ara master: Fix typo for apache config in WSGI docs for Debian-like distros  https://review.openstack.org/45042219:08
*** tbielawa|lunch is now known as tbielawa19:34
openstackgerritMerged openstack/ara master: Fix typo for apache config in WSGI docs for Debian-like distros  https://review.openstack.org/45042220:07
openstackgerritDavid Moreau Simard proposed openstack/ara master: WIP: Improve count performance  https://review.openstack.org/45044920:29
harlowjadmsimard qq20:40
harlowjaif say we have multiple related ansible playbook runs20:40
harlowjais there anyway to have ara correlate them and show them all as 'one megabook'20:40
harlowjalike by passing an id around20:40
harlowjaor call it a 'tome id'20:40
harlowjalol20:40
harlowjaor bookshelf20:41
harlowjalol20:41
dmsimardharlowja: megabook20:41
dmsimardit has a nice ring to it20:41
harlowjalol20:42
* dmsimard opens upstream ansible issue20:42
harlowjaya, we have distinct activations from python -> different books20:42
dmsimardharlowja: so, it depends on you're running ara20:42
dmsimardharlowja: how are the playbooks related ?20:42
harlowja'deploy openstack'20:42
dmsimardfrom the same ci job or something ?20:42
harlowjasame kind of goal, but with sub books to do each part20:42
dmsimardor just the same playbook file for example20:42
harlowjalike deploy openstack.book is to big20:43
harlowjaso we've broken it up20:43
harlowja(as u can imagine)20:43
harlowjalol20:43
dmsimardharlowja: is it a short lived relation ? :D20:44
dmsimardharlowja: like, for example, OSA has like 35 playbook runs in each of their CI job and they're somewhat grouped together I guess ?20:44
harlowjaya20:44
dmsimardI'm lazy to find a job but it looks like this http://ara-demo.dmsimard.com/index.html20:45
harlowjaya, hmmm20:45
dmsimardharlowja: are you using a centralized setup ? HOW DO YOU USE ARA20:46
dmsimardtell me20:46
harlowja:-P20:46
harlowjawe have a chat operator that is going to kick off all this stuff (when requested)20:46
harlowjaso that chatop container now has ara running inside of it as well20:47
harlowjachatop is in python so that it can do more complicated things (in code)20:47
dmsimardso it's a long-lived/persistent database ?20:47
harlowjai'd like it to be20:47
dmsimardi.e, it's not discarded like for a CI job/context20:47
harlowjaright20:47
dmsimardok, that makes things a bit more complicated if you want to logically group things20:47
dmsimardbecause you see, there's no feature to logically group things20:47
harlowja:)20:48
harlowjaexcept to shove it all under ansible and sort of get a grouping via it20:48
harlowjathat requires everything to be programmed up in ansible though :-/20:48
dmsimardSo there's *something*20:48
harlowjawhich doesn't feel that great for certain things (like 'deploy openstack' i don't think i can full hand it over to ansible without ansible being fully turing complete, lol)20:49
dmsimardharlowja: so there's https://storyboard.openstack.org/#!/story/2000920 but that's not going to help you right now20:50
dmsimardI had documented something somewhere, trying to find it20:50
harlowjaya, intersing20:50
harlowjajust being able to pass in a 'tag_id' ('megabook_id'?)  then having that located later would do it (sort of, lol)20:50
dmsimardharlowja: see the second bullet point here https://storyboard.openstack.org/#!/story/200090420:50
dmsimardARA_PLAYBOOK_OVERRIDE -> http://ara.readthedocs.io/en/latest/configuration.html#ara-playbook-override20:51
harlowjahmmm20:51
dmsimardyou could pseudo-code: ara playbook list -f value |grep openstackbook |awk '{print $1}' and then do something with that20:52
dmsimardbut it's pretty ugly20:52
dmsimardwhat you probably need is really that first story I linked20:53
harlowjamegabook20:53
harlowjalol20:53
dmsimardwell, more generically put, "logical grouping/search of playbooks"20:53
dmsimardharlowja: what'd you like to "search" by ? playbook path ? something else ?20:54
harlowjathat'd be a start20:54
harlowjaor "deployment on XYZ date"?20:54
dmsimardso the challenge is that I'd like, as much as possible, to keep the existing 100% feature parity between the hosted application and the statically generated one20:55
dmsimardI'll try and think of something, but not on my short term todo for now20:56
harlowjak20:57
dmsimardanother user said he might want to take a stab at it20:59
dmsimardI forget who it was20:59
harlowjaalso, another question, if i use the embedded version of ara, do i need to do anything to get the static content to show up21:00
harlowjaseems like its not showing up when pip install ara and then using `/ara-manage runserver -h 0.0.0.0 -p 8090`21:01
dmsimardharlowja: what is not showing up ?21:02
dmsimardharlowja: the playbook runs ?21:02
harlowjahttp://imgur.com/a/rNRGN21:03
harlowjaso the main logo i think?21:03
harlowjabut maybe something else is up?21:03
harlowjalol21:03
dmsimardharlowja: huh, that's weird21:03
dmsimardthose are SVGs, can you see them if you open them up individually ? what browser/OS ?21:04
dmsimardyou gotta see the parrots, that's like the most important part of the UI21:04
harlowjafirefox mac21:04
harlowjawe have ara running out of a docker container21:04
harlowjathough i don't think that matters21:04
dmsimardharlowja: hmmm, WFM on Firefox 52 on fedora21:05
harlowjahttp://imgur.com/a/yCBRj same on chrome21:05
harlowjaso wonder if its just not finding static21:05
dmsimardharlowja: you would not have css/javascript if it couldn't find statifcf21:06
dmsimardharlowja: do you see the logos on http://ara-demo.dmsimard.com/index.html ?21:06
harlowjaya21:06
harlowjawhy u got the logos21:06
harlowjalol21:06
dmsimardwhy do you not have the logos*21:06
harlowjalol21:06
dmsimardif you open up the developer console thing21:07
dmsimarddo you get a 404 or something ?21:07
harlowjalet's see21:07
harlowjahttp://imgur.com/a/FFwCl21:08
harlowjaweird21:08
harlowjafeels like the content-type is wrong21:08
harlowjaand maybe its confused21:08
dmsimardyeah that's probably supposed to be image/svg+xml21:09
harlowjahmmm21:09
dmsimardstackoverflow to the rescue ? http://stackoverflow.com/questions/11494793/how-do-i-serve-a-static-svg-file-with-flask21:11
dmsimardjesus those people21:11
dmsimardA easy (but hacky) way is to add a new route just for svgs21:11
harlowjaweird21:12
harlowjais that normal?21:12
dmsimardI don't know why it wouldn't be served properly out of the box21:13
harlowjaya, whacky21:13
dmsimardharlowja: you said it's installed side by side your chat bot ? can you do a pip freeze ?21:13
harlowjaya21:13
* dmsimard coughs21:18
harlowjacoughs back21:19
harlowjamy manager came by21:19
harlowjalol21:19
harlowjahttps://gist.github.com/harlowja/4967950e9e081aac10a0f9581637493021:19
harlowja'daddy' is the bot21:19
harlowjalol21:19
harlowjamaybe just need a newer flask or osmething21:20
harlowjadidn't expect flask to have weird problems with svg21:20
dmsimardoh ansible 2.2.2 is out21:20
dmsimardTIL21:20
dmsimard2.1.5 too21:20
harlowjai wonder how it gets served for u21:21
dmsimardharlowja: so for the record, a fresh virtualenv http://paste.openstack.org/raw/604383/21:23
harlowjaya, i was trying the following to21:23
harlowja>>> import mimetypes21:23
harlowja>>> mimetypes.types_map['.svg']21:23
harlowjaTraceback (most recent call last):21:23
harlowja  File "<stdin>", line 1, in <module>21:23
harlowjaKeyError: '.svg'21:23
dmsimardonly difference I see is the version of jinja21:23
dmsimardbut that's really be related21:23
dmsimardI expected maybe something different with werkzeug21:23
harlowjaon 3.4python21:24
harlowja>>> import mimetypes21:24
harlowja>>> mimetypes.types_map['.svg']21:24
harlowja'image/svg+xml'21:24
harlowjaevil python21:24
harlowjalol21:24
dmsimardis mimetypes stdlib ?21:25
*** tbielawa has quit IRC21:25
harlowjayes21:25
harlowjathough i am noticing a diff21:25
harlowjacat /etc/mime.types exists on host centos system21:25
harlowjabut not in container21:25
harlowjaso i wonder if that gets installed21:25
dmsimardhuh, maybe.21:26
harlowjarpm -q -f /etc/mime.types21:26
harlowjamailcap-2.1.41-2.el7.noarch21:26
harlowjaweird21:26
dmsimardyeah, mailcap-2.1.41-2.el7.noarch : Helper application and MIME type associations for file types21:28
dmsimardmailcap doesn't exactly scream MIME TYPES to me21:28
dmsimard¯\_(ツ)_/¯21:28
harlowjalol21:28
harlowjaya, let me try shoving that into the docker image21:28
harlowjaand see if svg starts showing up right21:28
dmsimardharlowja: hey completely unrelated, is simplejson better performance wise ?21:29
dmsimardiirc it was json < simplejson < ujson21:29
harlowjathat's what i've heard, though i'm not sure it matters anymore21:29
harlowjapretty sure simplejson went into upstream json?21:29
dmsimardharlowja: fwiw, how to pronounce json: https://www.youtube.com/watch?v=wf-BqAjZb8M&t=110221:30
harlowjajlol21:31
harlowjalol21:31
harlowjalike french21:31
harlowjajsooon21:31
dmsimard:D21:31
harlowjadmsimard what's typical of usage for ara_record?21:34
harlowjalike just various logs?21:34
harlowjaor other blogs21:35
harlowja*blobs21:35
dmsimardharlowja: I know there's someone who uses it on a registered command to get the sha1 git hash of his playbooks dir21:35
harlowjak21:35
harlowjamakes sense21:35
dmsimardharlowja: another uses it to show what host the playbook is running from (play on localhost with gather_facts, record ansible_fqdn)21:35
dmsimardharlowja: since ara does not yet record vars/extra-vars/tags, you can also record interesting ones there21:36
harlowjaright21:36
harlowjaother question21:36
harlowjasince we have ansilble running via a bot21:36
dmsimardAnother example was if the logging/artifact location is known, put it there21:36
harlowjaif we kill the `ansible-playbook` process to stop it, i assume ara wouldn't puke?21:36
harlowjalike 'bot deploy openstack ....'21:37
harlowjathen oh shit, didn't mean to do that, stop stop21:37
harlowjalol21:37
dmsimardharlowja: it would puke just a bit21:37
dmsimardbut it would be good puke21:38
dmsimardsec21:38
dmsimardharlowja: this is actually tested in the gate: https://github.com/openstack/ara/blob/master/run_tests.sh#L83-L8621:38
dmsimardsee the second playbook: http://logs.openstack.org/49/450449/1/check/gate-ara-integration-latest-centos-7/2229b40/logs/build/reports/index.html21:39
dmsimardit's grey and it says it's incomplete21:39
dmsimardit's best effort but data is bound to be incoherent due to mission relationships21:39
harlowjaright21:41
dmsimardharlowja: you see parrots yet ?21:59
harlowjadeploying container21:59
harlowjayup, got it21:59
harlowjamailcap was it22:00
harlowjaweird stuff22:00
harlowjalol22:00
* harlowja would have never guessed this would of happened22:00
harlowjalol22:00
dmsimardShould probably do a "troubleshooting" doc, kinda like FAQs but for problems22:00
harlowjaya, this one would be a good one22:01
dmsimardQ: I don't see parrots22:01
harlowjafeel free to take part of https://gist.github.com/harlowja/1327d63b10ad5955bc6758b8712fb08122:01
dmsimardA: You thought docker would solve all your problems ? Hah22:01
harlowja`RUN yum -y install mailcap` did the trick22:01
harlowjawhich i guess makes sense after the fact (sort of)22:04
harlowjalol22:04
dmsimardgotta give you credit, you found the solution22:05
dmsimardhurray22:05
*** themurph has quit IRC22:05
*** themurph has joined #ara22:11
*** karimb has quit IRC22:21
openstackgerritDavid Moreau Simard proposed openstack/ara master: WIP: Improve count performance  https://review.openstack.org/45044922:30
openstackgerritDavid Moreau Simard proposed openstack/ara master: Improve count performance  https://review.openstack.org/45044922:59
dmsimardboxrick1: do you want to try that patch to see if it helps your performance issue ? https://review.openstack.org/#/c/450449/23:00
dmsimardboxrick1: to test it: http://paste.openstack.org/raw/604391/23:01
boxrick1Sure, I'll have to give it a go tomorrow morning im on a different time zone =) midnight here! Cheers though look forwards to trying it23:11
dmsimardboxrick1: np, it's no miracles but will have to do pending a better solution23:30
boxrick1I clocked in my page load at 50s today ( 100 plays on a page ) so will see how it handles after this23:32
dmsimardYeah23:36
dmsimardThat doesn't make sense :D23:36
boxrick1if a normal 12.xx client is sending data to the mysql is that going to make much difference here?  Or do I need to update everything23:42

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!