Thursday, 2017-12-28

tristanCSpamapS: fwiw, the waitForNodeSet logic is moved to the base class in https://review.openstack.org/52632501:25
tristanCSpamapS: what else would you like to see in the base classes?01:33
*** Wei_Liu has quit IRC01:47
*** persia has quit IRC02:22
*** persia has joined #zuul02:23
SpamapStristanC: that's a lot of it.03:07
SpamapStristanC: there's some stuff in run_handler too, like declining min ready reqs. Maybe that's there too, I should probably just stack on top of yours.03:09
*** xinliang has quit IRC03:12
tristanCSpamapS: i'd also like to propose a generic nodelauncher class to manage thread creation and the statsd logic03:22
tristanCSpamapS: and not sure if you saw it, but there is wip aws driver here: https://review.openstack.org/52898203:23
*** xinliang has joined #zuul03:24
*** xinliang has quit IRC03:24
*** xinliang has joined #zuul03:24
SpamapStristanC: I did, which is why I chose gce. ;)03:28
SpamapSIt feels pretty daunting.03:29
SpamapSIIRC somebody had proposed an exec driver or something that would let us use ansible or maybe other tools to do the heavy lifting instead of python libs. Though I don't really love that.03:30
tristanCthe tricky part is to keep track of instance in the provider, e.g. openstack is using nova metadata to store nodepool_node_id03:31
SpamapSwell technically it uses instance name too03:32
SpamapSThey all give you something you can get back from a list for this purpose.03:33
SpamapSanyway I got a little lost in the gce thing but maybe I can stack on your refactoring03:37
tristanCbeware the aws driver is missing node creation registering, it should store a zk.BUILDING state as soon as the instance is created03:37
tristanCthen if it fails to switch to READY, it should be deleted to avoid leaking resource03:38
tristanCand cleaning alien node remains to be defined03:39
*** bhavik has joined #zuul04:51
*** bhavik has quit IRC05:19
SpamapStristanC: that's good advice. At this point I've pulled away from it. There's just too much going on and I do have a big OpenStack cloud to play with. :-P06:19
SpamapStobiash: have you considered open sourcing your dockerfiles for zuul? I am itching to try Zuul-in-k8s.06:34
tobiashSpamapS: older versions of them are open reviews in zuul and nodepool07:12
tobiashBut there was the feedback that these should not be part of the zuul repo07:13
tobiashI can push up the latest versions if you want07:14
tobiashBut opensourcing them as a separate project/repo is a major process overhead for me compared to contributing to an existing opensource project07:16
SpamapStobiash: Yeah, new repo, new everything. I agree, starting fresh is harder.07:28
SpamapStobiash: well if you ever wanted to just toss them in a github repo somewhere, I'd be happy to move it forward from there.07:53
SpamapSIdeally w/ Helm charts too.07:53
tobiashSpamapS: I'll push up what I have later. Atm I'm not at the PC08:18
*** bhavik has joined #zuul10:02
*** bhavik has quit IRC10:13
*** rcarrill1 has joined #zuul13:36
*** rcarrillocruz has quit IRC13:40
*** rcarrillocruz has joined #zuul13:51
*** rcarrill1 has quit IRC13:53
*** openstackgerrit has joined #zuul14:16
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add Dockerfile  https://review.openstack.org/46591214:16
tobiashSpamapS: ^^ this is my currently in use dockerfile14:17
tobiashI derive scheduler/executor/web specific images from there to add a logging config14:17
tobiashFor the deployment I use openshift and not helm with plain kubernetes so I have no helm chart I could provide14:18
SpamapStobiash: oh that's fine, I meant I'd ideally produce helm charts. ;)15:13
SpamapSthanks!!15:13
SpamapStobiash: also are you able to use a normal ingress to make log streaming work?15:31
SpamapSor do you need another container with a special apache/nginx for that?15:31
tobiashSpamapS: I have an apache in front of it15:32
tobiashBut mainly for url rewrite to /zuul15:32
SpamapSLooks like the nginx ingress controller claims to support websockets.15:33
tobiashI'm using openshift routes which is haproxy15:33
SpamapSyeah, I hear people are actually moving to haproxy in droves anyway because it has some advantages.15:34
SpamapSand the hosted k8s's all don't use it.15:34
SpamapSThe nginx config required these days is really really tiny.15:35
SpamapSIn fact once GH hooks are in zuul-web it's just /static and then throw everything at zuul-web.15:35
SpamapSanybody have a quick pointer to the place where query string args for status.html are documented? Trying to set filters.. not sure how.15:50
tobiashI think filters are implemented client side15:57
*** rcarrill1 has joined #zuul16:14
*** rcarrillocruz has quit IRC16:17
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/zuul feature/zuulv3: WIP Add specific setup inventory  https://review.openstack.org/53026516:24
SpamapStobiash: I am sure they are. I don't know how to read the static html/javascript to figure out how to pass them on the URL16:29
SpamapSI mean I can learn16:29
SpamapSbut was hoping for a quick shortcut :)16:29
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/zuul feature/zuulv3: WIP Add specific setup inventory  https://review.openstack.org/53026516:40
openstackgerritMerged openstack-infra/zuul-jobs master: Fix non-standard docs build  https://review.openstack.org/53008716:42
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/zuul feature/zuulv3: WIP Add specific setup inventory  https://review.openstack.org/53026517:02
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/zuul feature/zuulv3: Add specific setup inventory  https://review.openstack.org/53026517:14
SpamapSjlk: I have learned something in trying to beat hoist into submission enough to be run directly by Zuul. The way we did group_vars was I think the wrong approach.17:14
SpamapSjlk: I think the way to go is to create roles full of defaults, and depend on them.17:15
SpamapSjust thought I'd share17:16
SpamapSKind of struggling with hoist.. which is why I'm bugging tobiash for his Dockerfiles. ;-)17:16
* SpamapS is about 80% of the way through his first post job that deploys stuff to real resources.18:49
SpamapSone tricky part is.. it deploys zuul. ;)18:49
SpamapSso.. inception is a problem. ;)18:50
rcarrill1mordred:20:44
rcarrill12017-12-28 20:36:18,031 DEBUG zuul.AnsibleJob: [build: f1e4cfe7dd8446c0aaa3e5026ea20ba6] Ansible command: ANSIBLE_CONFIG=/tmp/f1e4cfe7dd8446c0aaa3e5026ea20ba6/ansible/setup_playbook/ansible.cfg ansible '*' -v -m setup -i /tmp/f1e4cfe7dd8446c0aaa3e5026ea20ba6/ansible/setup-inventory.yaml -a 'gather_subset=!all'20:44
rcarrill1that from running https://review.openstack.org/#/c/530265/20:44
rcarrill1tl;dr : i create setup-inventory.yaml, with just hosts, so runAnsibleSetup specifically uses it , by passing -i setup-inventory.yaml20:45
rcarrill1the rest just works, as the good ol' inventory.yaml is put on ansible.cfg20:45
rcarrill1the setup-inventory.yaml is populated from getHostList, but simply skipping the nodes with conneciton types put on blacklist (in this case network_cli, could be expanded should other connection types need this behaviour)20:46
*** rcarrill1 is now known as rcarrillocruz20:46
*** Shrews has quit IRC21:06
*** Shrews has joined #zuul21:07
*** harlowja has quit IRC23:37

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!