Saturday, 2018-10-13

openstackgerritMatthew Thode proposed openstack-infra/nodepool master: move 01-nodepool-setup to a later phase  https://review.openstack.org/61018800:13
dmsimardI might have a stupid idea but I wanted to share it in case it wasn't01:29
dmsimardCould parts of Zuul itself be delegated to playbooks ?01:30
dmsimardhang on, let me write an example01:30
dmsimardhttps://gist.github.com/dmsimard/baa9863e20c84538956715f4fa03796301:47
dmsimardNodepool could be a good candidate too.. there's already ansible modules for openstack, ec2, openshift, google cloud, etc.01:51
dmsimardFor example working on the ec2 driver is kinda hard tbh, the API isn't good.01:54
dmsimardBut there's already an ansible module that takes care of standing up and down a virtual machine in ec2 https://docs.ansible.com/ansible/2.6/modules/ec2_instance_module.html01:54
dmsimardsame for rds, and a bunch of other amazon resources that I would never for the life of me want to write01:55
tristanCdmsimard: iirc, wouldn't such actions implementation be less efficient than using a library like paramiko or openstacksdk which can re-use a connection pool?01:55
dmsimardtristanC: we can scale the playbook execution with zuul executors, is performance really an issue ?01:55
dmsimardI mean, VMs are already going to take a random amount of seconds to boot and you have the ability to pre-provision them01:56
dmsimardyou no longer need to scale launchers because they're just scheduled to run by nodepool (or zuul) on an executor01:57
dmsimardoh, that starts resembling a bit a discussion about a "boot" phase ahead of the "pre" phase :p01:57
clarkbfor me the big reason for writing nodepool drivers like they are done today is expreasive control flow and control over logging and error handling01:58
clarkball of that is really clunky in ansible01:58
clarkbso people end up writing python modules for ansible anyway01:59
dmsimardYou can keep the amount of business logic you want02:00
tristanCdmsimard: in theory you can rewrite any imperative program into ansible tasks...02:00
dmsimardI'm talking about the idempotent creation and deletion of resources02:00
*** dkehn has quit IRC02:01
dmsimardtristanC: yeah, maybe it's a case of "if you have a hammer, everything looks like a nail" lol02:01
clarkbits like when people want to go from bash to "real" programming langage02:01
clarkbbash/ansible are great for a lot of things02:01
dmsimardHaha, I did a lot of perl02:02
clarkbeventually you need something more expressive and easier to work with at scale02:02
dmsimardAnd then I discovered python02:02
pabelangeroh look, peoples. I actually have a zuul question.02:02
dmsimardUh oh02:03
pabelangerwhen we push a git repo to the node, how can I diff the commit between what node git repo has, and origin/master (assuming branch is master). It gerrit, it is easy, we only do a commit per patchset, but github can have multiple commits02:03
pabelangergit cherry might be a thing, but I'd need to add back origin/master for the repo on the node02:04
pabelangerand I don't think we have any reference on the repo saying, this is the current sha of master when this job ran02:05
pabelangerif that all makes sense02:05
dmsimardI understand and I have no idea02:06
dmsimardThat is indeed problematic02:06
clarkbpabelanger: zuul does leave an origin/$branch ref iirc02:06
clarkbit might not be origin as the prefix but the pointer to diff against is there02:07
pabelangerlet me check again02:08
pabelangerI only looked at git remote -v, which is origin file:///dev/null (push)02:09
clarkbthats orthogonal, that says where the remote is located, not what the remote refs themselves point to02:12
clarkbI think the worlspace setup role logs what all refs get updated02:12
pabelangerclarkb: okay, thanks you look to be right02:16
pabelangergit log origin/master..HEAD works as expected02:16
pabelangershould have tested first02:16
pabelangerbefore asking02:16
*** fbo has quit IRC02:35
*** dkehn has joined #zuul02:59
*** mhu has quit IRC04:29
*** mhu has joined #zuul04:31
*** jimi|ansible has quit IRC05:40
openstackgerritMerged openstack-infra/zuul master: web: add build page  https://review.openstack.org/59702407:05
*** ssbarnea has quit IRC07:26
openstackgerritMerged openstack-infra/zuul master: web: add job page  https://review.openstack.org/59704807:29
*** dmellado_ has joined #zuul07:30
*** dmellado has quit IRC07:31
*** dmellado_ is now known as dmellado07:31
*** slaweq has joined #zuul07:38
*** slaweq has quit IRC07:48
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Fix RST formatting  https://review.openstack.org/61019808:36
tristanCif you ever wondered what would look like the zuul logo in 3d, here is a demo: https://www.shadertoy.com/view/XldfW8 :-)09:11
*** dkehn has quit IRC09:17
*** evrardjp_ has joined #zuul10:19
*** swest has quit IRC10:20
*** evrardjp has quit IRC10:22
*** swest has joined #zuul11:15
mordredtristanC: nice!12:26
*** dkehn has joined #zuul12:30
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use zuul/web/static in setup_hook  https://review.openstack.org/60976412:40
mordredtristanC: on the job page - did you think yet about making the context field have a link to the browseable git repo for the file? I'm guessing it would involve being able to configure a browse-this-file link pattern for each source12:49
mordredtristanC, corvus: interesting ... check out http://zuul.openstack.org/job/devstack-tox-functional12:54
mordredtristanC: stable/pike is in the branch list twice - and I can't see any difference12:55
*** bhavikdbavishi has joined #zuul13:05
tristanCmordred: it also appears twice in http://zuul.openstack.org/api/job/devstack-tox-functional13:28
tristanCmordred: also, have you seen https://review.openstack.org/#/c/604264/ ? it shows an issue regarding to how project-template configs are currently returned by the api13:29
tristanCmordred: for links, we may needs an api/connection to return base_url/giturl, and adds the connection name to the source_context13:30
*** bhavikdbavishi has quit IRC13:31
corvusthat's weird.  we may need the repl to figure out where that came from.  or maybe run an instance of devstack-tox-functional and see if the inheritance_path gives any clues.14:28
dmsimardtristanC: now I need a 3d printed version :p14:28
corvusmordred: \o/ the zuul-web image works!14:30
corvusnext week i'll add that to the quickstart, and then we'll be gating on it14:30
mordredcorvus: woot!14:44
*** smyers has quit IRC14:58
*** dkehn has quit IRC15:17
*** dkehn has joined #zuul15:20
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: Update pypi metadata  https://review.openstack.org/55773816:07
*** evrardjp_ has quit IRC19:07
*** evrardjp_ has joined #zuul19:09
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Use :default: for emit-ara-html/README.rst  https://review.openstack.org/61028620:11
*** evrardjp_ has quit IRC20:11
*** evrardjp_ has joined #zuul20:12
*** jesusaur has quit IRC23:24
*** jesusaur has joined #zuul23:29

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!