Thursday, 2018-04-05

dmsimardNom nom memory00:40
harlowjaya00:46
harlowjasomething has to be like iterating over way more than it should be imho00:47
*** viewlogic has joined #ara00:47
*** hyamamoto has joined #ara00:49
*** hyamamoto has joined #ara00:49
*** Brainspackle has quit IRC00:51
*** hiroki has quit IRC00:51
*** hyamamoto is now known as hiroki00:51
*** gvincent has quit IRC01:13
*** gvincent has joined #ara01:13
*** harlowja has quit IRC01:42
*** dougbtv_ has quit IRC02:38
*** harlowja has joined #ara03:37
*** bcoca has quit IRC03:40
*** harlowja has quit IRC05:22
*** gvincent has quit IRC05:28
*** gvincent has joined #ara05:28
*** paulfantom has quit IRC08:10
*** logan- has quit IRC08:11
*** paulfantom has joined #ara08:11
*** _KaszpiR__ has joined #ara08:12
*** hwoarang has quit IRC08:12
*** _KaszpiR_ has quit IRC08:12
*** hwoarang_ has joined #ara08:12
*** logan- has joined #ara08:13
*** jlozadad[m] has quit IRC08:27
*** jlozadad[m] has joined #ara08:34
*** sshnaidm|afk is now known as sshnaidm|off09:00
*** hwoarang_ is now known as hwoarang09:08
*** rvgate has quit IRC09:13
*** rvgate has joined #ara09:14
*** rvgate has quit IRC09:48
*** rvgate has joined #ara11:04
*** resmo has joined #ara11:53
*** dougbtv has joined #ara12:09
*** dougbtv_ has joined #ara12:56
*** dougbtv has quit IRC12:56
*** tbielawa has joined #ara12:57
*** bcoca has joined #ara13:17
*** bcoca has joined #ara13:17
openstackgerritDavid Moreau Simard proposed openstack/ara master: WIP Handle longer playbook path names  https://review.openstack.org/51202914:51
openstackgerritDavid Moreau Simard proposed openstack/ara master: Make the use of basename on playbook path optional  https://review.openstack.org/51205014:52
openstackgerritDavid Moreau Simard proposed openstack/ara master: Add an option to store a custom playbook path  https://review.openstack.org/51205214:52
*** openstackgerrit has quit IRC15:34
ara-slack<dmsimard> @harlowja when you figure out the "most awesome and optimal" gunicorn config, we should write that down somewhere in the docs15:48
*** resmo has quit IRC15:53
ara-slack<harlowja> @dmsimard yup, gunicorn is just easier than apache to get going (especially inside a docker container)16:16
ara-slack<harlowja> File uploaded https://ara-community.slack.com/files/U6V9WRRTM/FA21JHUE9/-.txt / https://slack-files.com/T6VAB05L7-FA21JHUE9-101cb3c890 - prob this is also useful for folks to...16:17
paulfantomdmsimard: just wanted to say that my project now hosts an ARA demo: https://demo.cloudalchemy.org/ara/ :)16:46
*** tbielawa is now known as tbielawa|lunch16:51
*** harlowja has joined #ara17:21
dmsimardpaulfantom: cool! You got a deployment error :p17:24
paulfantomyeah, working on it :)17:25
*** harlowja has quit IRC17:25
paulfantomhow can I have historical runs in ARA? Currently I'm doing `ara generate html ara && tar cvf ara.tgz ara && ansible -m unarchive -a "src=ara.tgz dest=/var/www/demo/" web` to generate report and copy it to my webserver. But it shows only last run, what I am doing wrong?17:52
dmsimardpaulfantom: as long as the data is in the same database, it should accumulate as many playbook runs as you want17:56
dmsimardpaulfantom: maybe your builds are isolated and running in a different database each time ?17:56
paulfantomoh, forgot about it17:56
dmsimardpaulfantom: FWIW static HTML generation works well for a low volume but doesn't scale very well17:56
paulfantomthanks! I need to rethink how I host this demo site17:57
dmsimardYou might be interested in reading this: https://ara.readthedocs.io/en/latest/advanced.html17:57
paulfantomI know, you told me this some time earlier ;)17:57
paulfantomis there any possibility to merge two separate reports?17:58
paulfantomboth of which are static files17:59
dmsimardpaulfantom: not easily18:00
paulfantomok, so it seems I have two options: 1) leave it as is and serve only last ansible run 2) host a SQL db to which ARA would connect18:01
paulfantomright?18:01
*** tbielawa|lunch is now known as tbielawa18:02
*** harlowja has joined #ara18:29
dmsimardpaulfantom: there's a lot of different ways to do this, depends on your use case and what you prefer tbh19:22
dmsimardserving the last ansible run (the one that deployed this very demo site) is probably okay ? and very simple too19:23
dmsimardif you need more than that, it's going to be a bit more complicated so really that's up to you19:23
paulfantomI think I'll stay with current solution19:24
paulfantomThanks ;-)19:24
*** _KaszpiR__ is now known as _KaszpiR_20:01
*** qwebirc18903 has joined #ara21:11
qwebirc18903I'm new to Ara.  I have it setup running with embedded server.  I can see the playbook reports fine.    However, if I run the playbook via Jenkins pipeline, I don't see the report.21:13
qwebirc18903don't get why Jenkins triggered playbooks don't show up in Ara.21:13
qwebirc18903I've made sure that the global Ansible config under /etc/ansible/ansible.cfg is configured to use ara.  So, I'm really not sure whats the problem21:14
_KaszpiR_not loading plugin, usually21:15
_KaszpiR_or issue connecting to ara server21:15
_KaszpiR_it should be visible in verbose mode what is failing21:15
dmsimardqwebirc18903: by default, the database is located under ~/.ara/ansible.sqlite21:17
dmsimardqwebirc18903: so for example, if jenkins is running the job as the "jenkins" user, this might be in something like /var/lib/jenkins/.ara/ansible.sqlite21:17
dmsimardwhereas, if you're running under a different user, it would be in /home/user/.ara/ansible.sqlite21:17
dmsimardwhen you fire the web server, it needs to know where the database is or assumes the default (which in this case appears empty for you)21:18
*** ChanServ sets mode: +o dmsimard21:18
qwebirc18903ok thanks. that give me something to think about21:19
dmsimardqwebirc18903: another use case that is common with jenkins is to generate a static html report at the end and then recover that in your logs21:20
dmsimardso that a report only contains this one job, for example21:20
qwebirc18903ok. thanks dmsimard.21:21
_KaszpiR_hm... wondering, anyone tried to add ansible execution as ansible-local invoked by, for example, cobbler ( so that ansible is execute by kickstart/preseed) and thus ansible would report to ara?21:21
dmsimard_KaszpiR_: I'm not sure I follow21:22
*** qwebirc18903 has quit IRC21:22
_KaszpiR_ok, let me explain21:22
_KaszpiR_right now I run ara server on my laptop, I aslo use my laptop to run ansible to provision remote hosts - this works fine21:23
_KaszpiR_now the idea is to execute ansible on remote host locally (that is not via ssh) and still to report to remote ara instance (say, my laptop)21:23
_KaszpiR_now, that ansible run could be invoked by hand, or scripted21:24
_KaszpiR_and that script can be wrapped in kickstart or preseed or cloudinit, which are generally used during initial host provisioning21:25
_KaszpiR_so the only thing I would actually have to do would be to script installation of ara plugin for remote logging, ansible config to use ara and then finally invoke ansible provision by downloading required code from git21:26
_KaszpiR_another way would be just to send a notificiation to provisioner server to execute ansible to provision freshy booted server, but actually this makes things a bit more complicated21:27
*** openstackgerrit has joined #ara21:27
openstackgerritDavid Moreau Simard proposed openstack/ara master: Update integration jobs and fix broken unit tests  https://review.openstack.org/55895721:28
_KaszpiR_in general with such setup it would be really easy to integrate ara with cobbler or foreman without any more complex plugins21:28
_KaszpiR_especially under foreman21:28
dmsimard_KaszpiR_: It's probably not a good idea to have servers connecting to your laptop :P21:28
_KaszpiR_'laptop' was just as reference21:29
_KaszpiR_ara could be as dedicated server for reports21:29
_KaszpiR_could be also on the cobbler server itself21:30
dmsimardthere's definitely different approaches21:30
dmsimard1.0 (or 2.0 now?) will make this kind of integration easier with an API server (if you want to use it, it's optional)21:31
_KaszpiR_the thing is, rhight now I don't really need an api server at all21:32
_KaszpiR_what I really need is standalone ara instance just to accept connections to save reports21:32
_KaszpiR_and then adjusted kickstart or preseed files with scripts to clone and execute commands after cloning repoi21:33
_KaszpiR_actually I did that once with puppet in masterless mode21:33
_KaszpiR_of course the code was pretty simple and stored for example only password hashes and so on21:34
dmsimardoh I misunderstood21:34
dmsimardRight now the database credentials are required if you want to talk to a centralized/aggregated ara instance21:35
_KaszpiR_quck google shows noone did that yet21:35
_KaszpiR_hm ara api could be useful to create some temporary token to allow writing to ara instance, say 2h from the moment of requesting token21:37
_KaszpiR_we right now use terraform to spawn certian infra servers21:38
_KaszpiR_for example terraform talks with cobbler and triggers reinstallation of the servers via cobbler, and after cobbler reports the server is provisioed then terraform initiates ansible run to provision server further21:39
_KaszpiR_and this could be mixed with ara for better visibility21:39
dmsimard_KaszpiR_: something like this ? https://getintodevops.com/blog/using-ansible-with-terraform21:40
_KaszpiR_AFAIR yeah something like this21:41
_KaszpiR_but there is more logic to talk to cobbler21:41
dmsimardso terraform executes ansible locally21:41
_KaszpiR_yes21:42
dmsimardbut could it execute ansible on whatever other node instead that would then target the node you're bootstrapping ?21:42
dmsimardlike terraform -> bastion (with ansible and ara) -> new node21:42
*** tbielawa has quit IRC21:43
_KaszpiR_probably21:43
_KaszpiR_https://www.slideshare.net/CodiLime/codilime-tech-talk-micha-poski-creation-of-a-sdwan-performance-test-infrastructure-based-on-baremetals?qid=a574a085-a3b8-420a-be62-9781921d39e9&v=&b=&from_search=5 here's the presentation what we done, unfortuantely in my native language, which is polish21:44
_KaszpiR_but slides are in english21:44
_KaszpiR_slide 1221:45
_KaszpiR_so now terraform pokes cobbler to reboot server via ipmi, it reboots, gets initial scripts for provision via pxe and performs basic provision21:50
_KaszpiR_after that cobbler says server is ready, then terraform invokes locally ansible to connect to fresh server and ontinue provisioing with ansible21:51
_KaszpiR_this way we do not need custom preseed/kickstarts, but then we need to wait for node to report back to terraform21:52
dmsimardso ansible is run on "localhost", the new node being deployed21:52
_KaszpiR_ansible-playbook command is executed on the same node which invokes terraform, for example jenkins slave21:52
dmsimardok and the inventory contains the new node21:53
_KaszpiR_yeah21:53
dmsimardand why couldn't ara be hosted there ? like the jenkins slave21:53
_KaszpiR_it can21:53
_KaszpiR_it's just not implemented21:53
dmsimardokay21:53
_KaszpiR_now it would be super easy to extend it21:54
dmsimardI personally feel like that might be the simplest option ?21:54
_KaszpiR_yeah21:54
_KaszpiR_but my inithal thought was a bit different21:54
_KaszpiR_to invoke ansible-playbook on the provisioned server itself (no need for ssh connection)21:55
_KaszpiR_something like test-kitchen or packer-tool and ansible-local21:55
_KaszpiR_the only remote connection would be to send ara reports21:57
_KaszpiR_gotta try this maybe tomorrow22:00
_KaszpiR_so the only drawback would be a requirement to have python + ansible on provisioned host, or go mental and execute it in container :D22:03
dmsimard_KaszpiR_: harlowja posted a docker container image example the other day :p22:04
dmsimardhttp://paste.openstack.org/raw/718531/22:05
ara-slack<harlowja> https://ara-community.slack.com/files/U6V9WRRTM/FA21JHUE9/-.txt22:05
ara-slack<harlowja> enjoy, ha22:05
_KaszpiR_need account to see that22:06
ara-slack<harlowja> http://paste.openstack.org/raw/718531/ then22:06
dmsimard_KaszpiR_: yeah that's why I pasted it22:06
ara-slack<harlowja> or https://gist.github.com/harlowja/74a95dd6d5ac8bcd02fb0d7c797408a622:06
harlowjaremove or replace https://gist.github.com/harlowja/74a95dd6d5ac8bcd02fb0d7c797408a6#file-gistfile1-txt-L9-L1522:06
_KaszpiR_dmsimard you want me to create slack account?22:07
harlowjau have to be like in all the places22:07
harlowjalol22:07
dmsimard_KaszpiR_: no ?22:07
_KaszpiR_pls22:07
dmsimardI mean there's the ara-slack bridge bot22:07
dmsimardyou don't have to :)22:07
_KaszpiR_irc, slack, rocket-chat, hipchat22:07
_KaszpiR_gitter22:07
harlowjaya, use all of them22:07
harlowjalol22:07
_KaszpiR_make it stop ;D22:07
dmsimardthere was demand for slack so I added it and bridged it22:07
_KaszpiR_what about discord22:08
dmsimardI put one up22:08
harlowjaya, that to22:08
dmsimardbecause I personally like discord22:08
dmsimardbut no one showed up22:08
_KaszpiR_thank god there is a linking bot22:08
dmsimardso I shut it down22:08
_KaszpiR_discord is for games22:08
_KaszpiR_and works perfectky for voice chats22:08
dmsimardbut anyway, there's 46 names in here and .. 71 people in slack22:08
dmsimardso I figure you could say setting up slack was worthwhile (and especially low effort)22:09
dmsimardIt's 2018, I am able to understand that some people dislike IRC :)22:09
harlowjai'm waiting for my hoverboard...22:10
harlowjastill waiting, lol22:10
_KaszpiR_:D22:10
dmsimardI know right22:10
dmsimardflying cars and all that22:10
dmsimardanyway, if you really want to join slack I'm not going to stop you -- the invite is in the readme https://github.com/openstack/ara#community-and-getting-help22:11
dmsimardI probably need to figure out at some point how to bridge the two if slack is really dropping the irc gateway22:11
dmsimardI suppose someone's figured out how to make it work even without the gateway or something by now22:11
_KaszpiR_I think people will just write bot, or there is already one22:12
dmsimardSomeone could probably just use like errbot22:12
dmsimardand bridge the two that way22:13
dmsimard¯\_(ツ)_/¯22:13
_KaszpiR_I bet it would require slight adjusting some existing bot which is rught now used on quakenet to link discord22:13
_KaszpiR_ok, time to hit the pillow, cu22:23
*** Phinnay has quit IRC22:42
*** weshay is now known as weshay_pto23:05

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!