Wednesday, 2018-03-28

*** rlandy is now known as rlandy|bbl00:11
*** mrhillsman is now known as mrhillsman_in_mm00:11
*** ChanServ changes topic to "Discussion of the project gating system Zuul | Website: https://zuul-ci.org/ | Docs: https://zuul-ci.org/docs/ | Source: https://git.zuul-ci.org/cgit | Channel logs: http://eavesdrop.openstack.org/irclogs/%23zuul/"00:11
*** ChanServ changes topic to "Discussion of the project gating system Zuul | Website: https://zuul-ci.org/ | Docs: https://zuul-ci.org/docs/ | Source: https://git.zuul-ci.org/ | Channel logs: http://eavesdrop.openstack.org/irclogs/%23zuul/"00:12
*** mrhillsman_in_mm is now known as mrhillsman00:13
*** openstack has joined #zuul00:17
*** ChanServ sets mode: +o openstack00:17
openstackgerritJames E. Blair proposed openstack-infra/zuul-website master: Update links to git.zuul-ci.org  https://review.openstack.org/55709900:18
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use git.zuul-ci.org  https://review.openstack.org/55710000:21
corvusi'm really happy with the way the channel topic is shaping up :)00:33
*** acozine1 has joined #zuul00:50
*** odyssey4me has quit IRC00:53
*** odyssey4me has joined #zuul00:53
*** JasonCL has joined #zuul00:55
*** JasonCL has quit IRC00:56
tristanCmordred: the web api route change looks good to me, though it seems like we are doing this because we have one html file per interface page and it's boring to rewrite those from tenant scope01:08
tristanCmordred: i think we should look into having a single index.html page served at /, and make it switch controller and crawl the api (e.g. without loading another html file)01:09
tristanCmordred: then that page could load the asset bundle from a /static location, that would also simplify redirection rule a lot01:10
tristanCbut given what we have today works, i think it's worthy to just split the html and json route at the top-level01:13
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: autohold: prevent using ',' in change argument  https://review.openstack.org/55632901:15
*** JasonCL has joined #zuul01:20
*** JasonCL has quit IRC01:25
*** flepied has quit IRC01:49
*** acozine1 has quit IRC01:52
*** Wei_Liu has quit IRC02:17
*** JasonCL has joined #zuul02:17
*** JasonCL has quit IRC02:22
corvustristanC: in fact, i believe that's actually what we have today -- if you load any of the html files, you get the same thing.  the angular router determines which page to show based on the url, and when you click the links in the navigation bar, it doesn't reload the app, it just changes the url bar and the page it displays.02:48
corvustristanC: however, i think we always want to keep the different html urls working -- ie, we always want to be able to deep-link to '/builds', etc, so i think that means this work will continue to be useful.02:50
corvustristanC: er, there's a possibility that i'm thinking of something further down mordred's stack.  i'm a little fuzzy on whether that's true today, or only after the upgrade to angular v5.  anyway, it's close enough to being true -- hopefully that will land soon too.  :)02:52
tristanCcorvus: iiuc, angular routing usually rely on anchor "#" based path for deep-link. though if the angular v5 patch manage to keep the .html path along with angular router, then that sounds good to me too03:33
tristanCglad mordred did the refactor, it's really appreciated03:38
tristanCanyway i left a -1 on 556967 as it seems like it will break the builds page03:40
*** sshnaidm_ has joined #zuul04:08
*** sshnaidm has quit IRC04:08
*** sshnaidm_ has quit IRC04:32
*** sshnaidm_ has joined #zuul04:48
*** sshnaidm_ has quit IRC05:09
*** sshnaidm has joined #zuul05:24
*** rlandy|bbl has quit IRC05:43
tristanCmordred: would you mind rebasing the angular v5 patch on top of the new api route?05:45
*** xinliang has quit IRC06:52
*** xinliang has joined #zuul07:05
*** hashar has joined #zuul07:14
*** tosky has joined #zuul07:23
*** electrofelix has joined #zuul07:27
*** flepied has joined #zuul07:32
*** flepied has quit IRC07:48
*** flepied has joined #zuul08:36
*** flepied_ has joined #zuul09:05
*** flepied has quit IRC09:07
*** JasonCL has joined #zuul09:13
*** JasonCL has quit IRC09:14
*** JasonCL has joined #zuul09:15
*** JasonCL has quit IRC09:15
*** JasonCL has joined #zuul09:15
*** JasonCL has quit IRC09:38
*** flepied__ has joined #zuul10:05
*** flepied_ has quit IRC10:08
*** flepied__ is now known as flepied10:09
*** JasonCL has joined #zuul10:11
*** JasonCL has quit IRC10:11
*** sshnaidm has quit IRC10:29
*** sshnaidm has joined #zuul10:38
*** sshnaidm has quit IRC10:55
*** sshnaidm has joined #zuul11:07
*** odyssey4me has quit IRC12:22
*** odyssey4me has joined #zuul12:22
*** JasonCL has joined #zuul12:24
*** JasonCL has quit IRC12:30
*** dkranz has joined #zuul12:30
openstackgerritMerged openstack-infra/zuul master: Use requests instead of urllib.request in tests  https://review.openstack.org/55405712:36
*** rlandy has joined #zuul12:37
*** sshnaidm is now known as sshnaidm|afk12:46
*** JasonCL has joined #zuul12:54
*** JasonCL has quit IRC12:58
mordredtristanC: yes- I will rebase the angular v5 patch ... and also - thanks for the review! I'm fixing the stuff you pointed out now - and in one case I was, in fact, thinking of the angular v5 patch (which is set up to handle something for us) and forgot we didn't have that in the angularjs stack yet13:03
mordredtristanC: I have a temporary workaround hacked up - fixing some docs then I'll get both pushed up13:03
tristanCit is hard to juggle with the topic:javascript patches... would be nice if we could merge them soon13:11
tristanCeven without the new pipeline, project and job routes, i could rebase them on top of the angularv5 patch if that helps13:11
*** JasonCL has joined #zuul13:14
*** JasonCL has quit IRC13:24
*** elyezer has quit IRC13:29
*** electrofelix has quit IRC13:29
*** JasonCL has joined #zuul13:34
*** hashar is now known as hasharAway13:39
*** elyezer has joined #zuul13:40
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Reorganize REST API and dashboard urls  https://review.openstack.org/55696713:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198713:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594813:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198913:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199213:51
mordredtristanC: yah - I'm looking forward to getting this stack done :)13:52
mordredtristanC: I'm ont 100% sure https://review.openstack.org/551989 is fully correct with the new routes yet - but there it is rebased and with the first attempt at updating it13:53
mordredtristanC: once we get the api routes landed and updated, I'll make sure 551989 is up to date ... I'll also update the pipeline/project/job route patches - I've mostly just been waiting to finish rebasing those until we're happy with the angular5 patch13:54
*** JasonCL has quit IRC14:04
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Handle ZK session loss during node launch  https://review.openstack.org/55253814:16
Shrewscorvus: i know you really hate the use of mock, but I cannot think of a better way to do the test for 552538 ^^14:16
tristanCmordred: thanks! so i'll wait for you to propose the extra route on top of angular5 patch right?14:17
*** JasonCL has joined #zuul14:18
ShrewstristanC: your fix for session expired reminded me i needed a test for 55253814:18
*** flepied has quit IRC14:19
tristanCShrews: how about setting kazoo client internal state like so: https://github.com/python-zk/kazoo/blob/b4967d16b3daa4b1a00c0f408888b4f61e5486cc/kazoo/tests/test_client.py#L48714:20
*** JasonCL has quit IRC14:20
ShrewstristanC: well, i guess we could, but i dislike poking into external libraries supposedly private areas14:21
ShrewstristanC: and i *think* the tests all share the same zk connection?? if so, that would affect them too14:22
Shrewsoh, that might not actually be true14:23
tristanCShrews: it didn't happen on https://review.openstack.org/#/c/535537/8/nodepool/tests/test_zk.py14:23
Shrewsyeah, see above14:23
Shrewsi remembered incorrectly14:24
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Remove nullwrap config option  https://review.openstack.org/55735014:25
corvusShrews: otoh, when you can't think of any other way, that's probably the time to use mock :)   -- the main risk here is that we haven't actually reproduced kazoo's behavior correctly (somewhat more likely under adverse circumstances).  otoh, the benefit here is it's actually possible to exercise our code, so it's a win.  :)14:28
mordred++14:28
mordredI find mock, judiciously used, can be helpful in tricky circumstances14:29
mordredtristanC: yah - although if you want to just look at https://review.openstack.org/#/c/551989/14/web/app-routing.module.ts you can see how we're using the t/:tenant/status.html type links with @angular/router (which is prettier than the hack I had to had to the angularjs version)14:32
*** JasonCL has joined #zuul14:36
*** JasonCL has quit IRC14:38
*** JasonCL has joined #zuul14:39
fungicorvus: any chance the source for the lunchtime presentation from the ptg is published anywhere?14:49
corvusfungi: it's https://review.openstack.org/54817814:50
fungicorvus: aha, perfect, thanks!14:50
* fungi reviews14:50
fungisome of the foundation staff were asking where to find it14:50
corvuswe still haven't really tackled 'publishing' gertty stuff to the web head-on14:51
corvuser presentty even14:51
fungiyeah, i warned them it would probably be in rst ;)14:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Reorganize REST API and dashboard urls  https://review.openstack.org/55696714:53
mordredcorvus: speaking of presentty - I ran in to more crashing issues in la this weekend - but I was in a hurry so I did not check to see if you'd updated anything since last we poked at things14:54
mordredcorvus, tristanC: ^^ I thnk that should take care of the things tristanC pointed out14:54
corvusmordred: i haven't, sorry, my 'free' time has been spoken for.  i'm hoping to visit that soon (maybe this weekend)14:54
corvusmordred: cool, i'll review after ingesting food14:55
mordredcorvus: also, I pushed up https://review.openstack.org/#/c/557342/ as a followup - it's in the multi-tenant portion which we aren't using in infra anyway, so I figured we could do it as followup and not need to re-review the main puppet patch14:56
*** sshnaidm|afk is now known as sshnaidm14:57
LinuxJediany Ansible gurus able to help me out with a Zuul job? The environment variables here don't appear to be working: http://paste.openstack.org/show/716312/15:04
LinuxJedioh crap! I need more sleep, because I used '=' instead of ':'15:05
* LinuxJedi smacks forehead15:05
mordredLinuxJedi: \o/15:06
LinuxJediyou'd think I'd have written enough YAML by now to spot that :)15:07
mordredheh15:07
*** AJaeger has quit IRC15:08
LinuxJedia thanks to you all for your help this week: https://twitter.com/LinuxJedi/status/97901397693894246415:15
*** flepied has joined #zuul15:19
corvusLinuxJedi: \o/  hey it passed clang *and* noop :)15:28
LinuxJedieverything passes except for scanbuild as scanbuild is newer than when I last ran it and it found a bug ;)15:29
corvusLinuxJedi: maybe a gating ci system will help ;)15:29
LinuxJedialthough tests are currently being skipped as there is no mysql server on the builder so I'm fixing that now15:29
mordredLinuxJedi: woot! I sent you a little PR, just for fun15:30
LinuxJediit is a dead project anyway. So I don't mind it failing. I just wanted something to demo that wasn't too complex and had some CI beforehand (it used Travis CI before)15:31
LinuxJedimordred: nice! Thanks :)15:32
pabelanger\o/15:34
mordredLinuxJedi: amusingly enough - lifeless and I originally discussed that tool back when we were still doing drizzle - we just never got far enough for it to be useful - so I figured it would be fitting :)15:42
LinuxJedimordred: I assume it figures out that certain packages have different names in Fedora, etc... ?15:42
fungiwoah... LinuxJedi returns to us!15:42
mordredLinuxJedi: it does not at all15:42
mordredLinuxJedi: it allows you to list such things and mark them appropriately15:43
LinuxJedimordred: ah, ok. Something I need to be wary of, Ubuntu doesn't always have the best naming system for packages :)15:43
LinuxJedifungi: unfortunately not permanently. Just to demo Zuul to people more important than me ;)15:43
mordredLinuxJedi: yah. that's actually one of the reasons we've found the tool helpful - attempting to standardize on package names from one distro and having something figure out whatyou meant on another distro is awful15:44
fungiLinuxJedi: sure, but _possibly_ longer if you can make that presentation stick ;)15:44
LinuxJedimordred: completely agree, sounds good on the surface, but hell when you get into the guts of it15:45
mordredLinuxJedi: exactly15:45
mordredLinuxJedi: whereas - a human just making a list for each distro is easy15:45
mordredfungi: I sent him a bindep patch :) https://github.com/libattachsql/libattachsql/pull/20315:45
fungii gathered from context that's what you were talking about15:46
LinuxJedifungi: if the presentation sticks then it won't be me implementing the final thing. But I'll be consulting I guess. Maybe acting as a middleman as not many here use IRC (mostly the older guys)15:46
mordredtristanC, corvus, pabelanger, tobiash: https://review.openstack.org/#/c/556967/ <-- that has been updated since last it had 2x +2s15:46
fungiLinuxJedi: either way, great to see you around for a bit!15:48
LinuxJedifungi: great to see you too (and all the familiar nicks) :)15:48
fungithe place hasn't been the same without you ;)15:48
LinuxJediyou mean it has been better? ;)15:49
fungiwell, yes, but not because you left15:49
* fungi is mildly surprised not many devs at mariadb use irc, as an aside15:49
LinuxJedithe foundation devs do, not sure about corporation devs. No one on my team does apart from me. I can't tempt them.15:50
LinuxJediinternally we have to use Slack *vomits slightly in mouth*15:51
fungimy sympathies15:51
LinuxJeditechnically I am corporation side of things, but I do work with foundation on many things15:51
fungithough i've recently discovered the irc client i'm using (weechat) does have a serviceable slack plugin so when i actually need to interact with certain people via slack it at least _looks_ like any other irc channel to me15:52
LinuxJediI use IRCCloud and I've heard they have a Slack connection thing too. But I've not had a chance to try it yet15:54
*** hasharAway is now known as hashar16:04
*** acozine1 has joined #zuul16:05
clarkbLinuxJedi: I've heard great things about irccloud frkm people that have historically resisted irc for reasons of simplicty in consumption16:12
clarkbpparebtly works really well for multiple devices and notifications16:12
LinuxJediclarkb: it solves quite a few problems. I get notifications on my phone/watch instantly. No need to run a ZNC or similar, it stores the scrollback16:13
LinuxJediI was kinda resistant at first, felt a bit like having a cloud based system own my IRC identity. But it has basically made IRC easier than Slack16:14
corvusmordred, tobiash, SpamapS: i'd like to land https://review.openstack.org/557350 pre-3.016:16
mordredcorvus: didn't someone say at the ptg that it was important to them for some reason?16:16
corvusmordred: got a name?16:17
corvusi mean, i linked to the email thread where no one said they were using it16:17
mordredcorvus: no. I'm only half-remembering the conversatoin - but I think it was related to the fact that on k8s bubblewrap requires containers with elevated privs16:18
mordredcorvus: so it might just be that without nullwrap it's not possible to run zuul in a standard non-elevated k8s16:18
corvusmordred: tobiash said that in order to use zuul on openshift, it requires elevated privs, so he uses a non-standard openshift config for that.  he also said it may be possible to find more specific capabilities to narrow that down, but he has not done the work.16:19
mordredcorvus: yah16:19
corvusmordred: perhaps that's what you're remembering?16:19
mordredcorvus: probably so, yeah16:20
tobiashmordred, corvus: rcarrillocruz had an experimental deployment on openshift online which would required nullwrap16:20
tobiashbut that cannot be considered production16:21
corvusat any rate, for the moment, running without bwrap is untenable from a security pov.  if running in an unpriviledged openshift system is important for someone, then someone needs to either address the privilege situation there, or perhaps the more-native-container work we have upcoming may prove a better solution.16:21
mordredcorvus, tobiash: yah - I think it was ricky's deployment in openshift online I was thinking about16:22
mordredthat said, I just pinged vbatts to see if he happens to know already the answer to the lowered privs question16:23
mordredcorvus: I'm fine removing it - just wanted to do the double-check16:23
tobiashcorvus: lgtm16:23
corvuschecking is good16:23
rcarrillocruzYeah, that thing was an experiment. I think writing a driver to use Kube secrets to store Zuul secrets is what we talked at Dublin16:24
mordredrcarrillocruz: ++16:25
mordredtobiash: have a sec to review updates to https://review.openstack.org/#/c/556967 ? tristanC found some bugs in the previous version16:26
tobiashyah16:26
mordredpiddle. I just saw one more little bug ... I'm going to push it up as a fllowup since it won't affect the openstack deployment16:28
tobiashcorvus: just got a customer question, is it possible to define the gate queue in a project template?16:30
tobiashor does that have to be in the project stanza?16:30
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Remove double api prefix from tenants call  https://review.openstack.org/55742916:30
pabelangerI finally got access to openshift.io myself, been trying to find time to play with zuul / nodepool there.  Never enough time :)16:31
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198716:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594816:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198916:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199216:36
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use git.zuul-ci.org  https://review.openstack.org/55710016:41
corvuspabelanger: thanks :) ^16:41
openstackgerritMerged openstack-infra/zuul master: Remove nullwrap config option  https://review.openstack.org/55735016:42
corvusmordred: while you're at it, can you look at https://review.openstack.org/557099 ?16:55
*** tosky has quit IRC16:59
*** acozine1 has quit IRC17:01
mordredcorvus: done17:03
openstackgerritMerged openstack-infra/zuul-website master: Update links to git.zuul-ci.org  https://review.openstack.org/55709917:07
*** hashar is now known as hasharDinner17:07
openstackgerritMerged openstack-infra/zuul master: Reorganize REST API and dashboard urls  https://review.openstack.org/55696717:07
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198917:08
Shrewsfyi, i need to afk for a while. will be available later this evening17:09
openstackgerritTobias Henkel proposed openstack-infra/zuul-website master: Fix doc links in menu  https://review.openstack.org/55744217:11
tobiashcorvus: this fixes broken links ^17:11
corvustobiash: oops, thanks :)17:14
openstackgerritMerged openstack-infra/zuul master: Use git.zuul-ci.org  https://review.openstack.org/55710017:16
pabelangermerge all the things!17:16
openstackgerritJames E. Blair proposed openstack-infra/nodepool master: Switch docs to alabaster theme  https://review.openstack.org/55744517:18
corvusnoticed while clicking around the docs pages ^ :)17:18
openstackgerritMerged openstack-infra/zuul-website master: Fix doc links in menu  https://review.openstack.org/55744217:19
tobiashcorvus: that was the next thing I had in mind ;)17:22
tobiashmordred: is it possible/easy to make the update interval of the status page configurable?17:23
tobiashsome of my customers are impatient when looking at the status page17:24
mordredheh17:24
tobiashit's currently hard coded to 5s if I looked right17:25
mordredtobiash: one of the next things on my list is refactoring the code that fetches things into an angular service17:25
tobiashso I guess that makes it easy17:25
corvusi'd really like to have a system that pushes events out over websockets.17:26
mordredtobiash: should be decently easy to include refresh config while doing that - are you thinking changing the global refresh? or a per-user setting?17:26
mordredcorvus: ++17:26
tobiashmordred: global (per deployment?)17:26
mordredtobiash: nod. that is *very* easy to add17:27
corvusright now, if you look at the openstack status page, you're fetching 1MB every 5s.  it's often much larger.17:27
tobiashzuul-web itself caches the status for 1s so I probably would set it in my deployment to 1s or 2s17:27
mordredcorvus: or maybe even a streaming gRPC API and corresponding web code :)17:27
tobiashcorvus: yah, for openstack 5s is probably on the lower end which is effordable17:27
corvusmain thing is -- i think it's okay to make it adjustable in the near term, but we really need to redesign it so we're not moving so much data around (and not redrawing the page so much)17:28
tobiashcorvus: so I guess it's already now a problem for openstack17:29
mordredcorvus: ++17:33
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add build-time configurable status refresh variable  https://review.openstack.org/55745017:33
mordredtobiash: ^^ there you go17:33
mordredtobiash: if you do npm build:dist -- --define "ZUUL_STATUS_REFRESH=1000"  with that patch17:34
tobiashmordred: whoa that was fast17:34
tobiashthank you :)17:34
mordredtobiash: it should build you a dashboard that refreshes every second17:34
mordredtobiash: I understand the dashboard codebase now :)17:34
mordredtobiash, corvus: per corvus' questoin on the patch - I think we can improve upon that patch pretty easily to have it pull the info from /api/info after we get the angular5 patch in shape17:39
corvusmordred: can we maybe defer it until then?17:40
corvusmordred: opening up the door to build-time user-customization of the dashboard seems like a non-trivial thing which i'd like to avoid17:41
tobiashyah, that sounds even better17:42
tobiashit's not urgent for me as I can just stick a minimal patch onto my stack for now17:43
tobiashmordred: will the url changes break anything for a multi tenant deployment below /zuul/ ?17:46
mordredtobiash: not the initial changes. once we land angular5 a multi-tenant sub-url deployment will need to build with --define "ZUUL_BASE_HREF='https://zuul.example.com/zuul'"17:51
mordredor, rather,17:51
mordred--define "ZUUL_BASE_HREF='/zuul'"17:51
mordred(full url is not needed - just the suburl path)17:52
tobiashmordred: how will that work together with 'python setup.py install'?17:52
tobiashthat's my current installation method within the container17:53
mordrednot particularly well - so let's make sure we solve that method before we land it17:53
mordredtobiash: k. I think I see a way to fix that17:54
tobiashyay17:54
mordredtobiash: also - it's possible we'll be able to solve the need for ZUUL_BASE_HREF before landing that patch as well18:06
*** flepied_ has joined #zuul18:10
*** flepied has quit IRC18:11
*** flepied__ has joined #zuul18:22
* jlk is currently uploading a new github3.py release to pypi18:25
*** flepied_ has quit IRC18:26
tobiashmordred: found a bug18:26
tobiashtenant overview requests /zuul/tenants18:26
tobiashwhich is actually on /zuul/api/tenants18:26
jlkand done!18:27
jlkcorvus: github3.py 1.0.2 is released.18:27
*** jimi_|ansible has joined #zuul18:29
*** jimi|ansible has quit IRC18:29
tobiashmordred: also shift-reload doesn't fix it18:29
tobiashI'll revert to before the url change for now18:29
mordredtobiash: hrm. I thought we had that covered. :( will investigate18:30
EmilienMcorvus: hey good morning - in zuul v2.5, do you know if we can have a layout with skip-if + all-files-match-any + a regex that is *negative* for example: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul/upstream.yaml#L165-L171 (which would basically means: never run except when these 2 files are touched)18:31
EmilienMI think the code for that is here: https://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/cmd/migrate.py#n145018:34
EmilienMbut I just need confirmation my snippet can work18:34
EmilienMthe other option is to use "files:" layout18:36
*** corvus is now known as kermitf18:42
kermitfjlk: yaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaay!18:42
*** kermitf is now known as corvus18:42
jlkcan't keep up with the name changes :D18:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198718:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594818:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198918:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Remove need for ZUUL_BASE_HREF build time option  https://review.openstack.org/55747218:43
corvusjlk: all you need to know is there is a green frog waving his arms widly in celebration :)18:43
jlkhahah18:43
jlkoh let me do the next thing too18:43
mordredcorvus, tobiash: ^^ //review.openstack.org/557472 should remove the need for ZUUL_BASE_HREF - and I updated the job definition to stop using it so we should be able to verify it works (the preview daashboard does not work on logs.o.o otherwise)18:44
corvushttps://i.imgur.com/IvFsn8W.gif18:46
mordredtobiash: which ref did you deploy? just through https://review.openstack.org/#/c/556967 ?18:47
tobiashcurrent master18:47
tobiash;)18:47
*** jimi_|ansible has quit IRC18:47
mordredkk18:47
pabelangerlol, corvus seems excited18:47
corvusEmilienM: i think files: is the way to go there -- any reason not to?18:47
clarkbwhat is the excitement?18:47
tobiashmordred: to be more precise: fddf8f9d + my staging patches18:48
mordredtobiash: sweet. thanks18:48
corvusclarkb: github3 release18:48
EmilienMcorvus: yeah I think files is the way to go, please look https://review.rdoproject.org/r/13130 if you have 2 minutes. Thanks a lot18:49
tobiashnow while I'm at breaking production, I might take the latest gh3 release in ;)18:49
tobiashbut I think it'l be better to test that in the dev instance...18:49
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use github3.py >= 1.0.2  https://review.openstack.org/55747518:49
corvustobiash, jlk: ^18:50
jlkcrap18:50
mordredtobiash: fddf8f9d5a37b8fc8a2fc0752122358df03c17ae is the nullwrap patch - it shouldn't have the api changes18:50
jlkI had just opened one18:50
corvusjlk: i'm very happy to abandon mine in favor of yours :)18:50
tobiashmordred: oops, that's the ref, I'm currently reverting to18:50
mordredtobiash: (asking followup questions so that I can make sure I'm reproducing properly)18:50
mordredtobiash: ok. cool18:50
mordredtobiash: that makes more sense then18:50
tobiashmordred: I meant 1243cf75 + my patches18:50
tobiash;)18:50
tobiashsorry18:51
corvusjlk: oh that's what you meant by the next thing.  sorry, i thought you were off to do something in the github3.py repo18:51
openstackgerritJesse Keating proposed openstack-infra/zuul master: Use latest release of github3.py  https://review.openstack.org/55747818:51
mordredtobiash: sweet! that makes sense (sort of, I'd actually expect that patch to break in the opposite direction - for the web to try to request from /zuul/api/api/tenants18:51
jlkhah yours is more correct18:51
jlkI can close mine and use yours18:52
mordredbut I'll figure it out18:52
corvusjlk: too late, i abandoned.  better fix yours :)18:52
jlk(I had errant spaces)18:52
dmsimardI'm not exactly sure what are the ramifications (positive or negative) but in 2.5, Ansible added a config lookup i.e, https://gist.github.com/bcoca/1800770fe98975dde28d511ae959733718:52
openstackgerritJesse Keating proposed openstack-infra/zuul master: Use latest release of github3.py  https://review.openstack.org/55747818:52
dmsimardI suppose since we ban all lookups it's probably not an issue18:52
jlkthat's the first thing I've thrown at gerrit since getting my github laptop18:53
mordredtobiash: OH18:54
mordredtobiash: actually - I wonder ... in your container build, is it re-using the source dir?18:54
mordredtobiash: what do you want to be the issue is that since there were already js files in place that they didn't get rebuilt?18:55
mordreds/be/bet/18:55
corvusjlk: seems to still work!  :)18:55
jlkheh, I had to install git review and change the git config to use the right email address for this repo, just minor setup things.18:56
tobiashmordred: I'm not sure I groked your question correctly, my container build basically does: git clone zuul; cd srcdir; pip install requirements; python3 setup.py install18:56
tobiashmordred: and the container is built without cache18:57
tobiashmordred: http://paste.openstack.org/show/716364/19:01
tobiashthat's the snippet that installs zuul in the container19:01
tobiash(but I'm always open for better ways ;) )19:01
mordredtobiash: ok good19:04
jlkis that drastically different from just `pip install .` ?19:07
tobiashjlk: I think the problem with pip install was no npm installation of zuul-web19:08
tobiashbut not sure anymore19:08
jlkooooh yeah, it might not do some of those extra steps19:08
tobiashcorvus, jlk: zuul startup was successful with gh3.py 1.0.219:13
jlkoh cool.. CI failed19:13
jlkgithub3.py>=1.0.219:14
jlker19:14
jlkNo matching distribution19:14
jlkIs there caching going on inside of Zuul?19:14
tobiashjlk: openstack is using local mirrors19:14
tobiashmaybe it wasn't updated yet?19:14
jlkgotcha. Any idea how frequently they sync?19:14
tobiashmy installation at least worked19:15
tobiashand zuul started19:15
tobiashnow testing a job19:15
tobiashbuilds also work19:18
*** jimi_|ansible has joined #zuul19:20
*** jimi_|ansible has joined #zuul19:20
tobiashlooks like we don't have to vendor github3.py :)19:21
pabelangerjlk: bandersnatch runs every 5mins19:22
tobiashpabelanger: how long does a run take?19:24
pabelangernot sure, depends how busy pypi is19:24
pabelangerI can check logs19:24
tobiashpabelanger: it's not urgent, we also can just recheck later19:24
pabelanger2018-03-28 18:30:02,913 DEBUG: Getting https://pypi.python.org/packages/13/74/383f0479f3c104edb97a38b1936c62a2b26e7fd807adb4f7e8be8f195aa3/github3.py-1.0.2.tar.gz (serial None)19:25
pabelangershould be in mirrors now19:25
pabelangergive a recheck and lets see19:25
tobiashis the clock correct?19:25
pabelangerUTC19:25
pabelangerbut ya, should be19:26
tobiash18:30 utc is 50mins ago19:26
tobiashI rechecked just 5mins ago19:26
pabelangerhmm19:26
pabelangerlets move to openstack-infra19:27
*** acozine1 has joined #zuul19:41
tobiashcorvus: next week I'll be out of office19:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742919:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add build-time configurable status refresh variable  https://review.openstack.org/55745019:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198719:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594819:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198919:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742919:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add build-time configurable status refresh variable  https://review.openstack.org/55745019:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198719:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594819:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198919:54
corvustobiash: hopefully we can release this week then :)19:54
tobiashis ^ the last blocker?19:55
tobiashone monty patch bomb till release?19:56
tobiash;;)19:56
corvusafaik, yes19:56
corvusmordred: though this one-liner would be nice https://review.openstack.org/55744519:56
corvustobiash: we don't need all of that ... i think; just the first part unless mordred has run into problems that need the upgrade19:57
corvustobiash: (aiui, mordred is continuing to refresh the later patches to make sure we don't back ourselves into a corner, but they shouldn't be necessary for release)19:58
mordredyah19:59
tobiashmordred: https://review.openstack.org/555185 would also be nice20:00
mordredtobiash: done20:00
tobiashalready had a few people asking where to put the depends-on20:01
tobiash:)20:01
mordredtobiash, corvus: I think https://review.openstack.org/557429 should solve the issue tobiash hit. I'm working on trying to verify that right now20:01
tobiashmordred: thanks, I'll try that tomorrow (not in production this time ;) )20:02
mordredtobiash: :)20:02
mordredtobiash: hopefully I'll have verified it before then :)20:02
tobiash:)20:03
openstackgerritMerged openstack-infra/nodepool master: Switch docs to alabaster theme  https://review.openstack.org/55744520:05
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742920:18
mordredcorvus: ^^ ok. I believe I have verified that does the correct thing locally20:18
mordredcorvus: I did this by doing a build of the html, telling apache to serve it from my zuul directory (so that I'd have some suburl in there)20:19
mordredthen going to http://localhost/zuul/web/static/tenants.html, opening the web debugger and seeing that it tried to fetch from http://localhost/zuul/web/static/api/tenants20:19
mordredcorvus: and then checking the non-suburl case - which also worked20:22
mordredadding rewrite rules now so I can test multi-tenant20:23
openstackgerritMerged openstack-infra/zuul master: Clarify location of depends-on footer  https://review.openstack.org/55518520:23
tobiashmordred: PS2 didn't work ;)20:26
tobiashrebuilding with ps420:26
corvusmordred: what does "return path.split('/').slice(0, -1).join('/') + '/'" do?  does that just mean "make sure there's a single / on the end of the path"?20:26
mordredcorvus: well, the '/' ensures the / - the other bits are basically "pop off the last path segment"20:27
corvusmordred: oh, that's what -1 means in this context20:27
corvusgot it -- that jives with what you just said about your test too20:28
mordredya - the equiv python would be path.split('/')[:-1].join('/')20:28
corvusnot all that different20:28
mordredso - I just realized I can rewrite rule apache to point to the live zuul api service - even with it not having the /api running20:28
mordredI have done that, and localhost/status.html properly shows me status output20:28
mordredhopefully tobiash will similarly get functional results from his test20:29
tobiashwe'll see in 10-15minutes20:29
* mordred crosses fingers20:31
tobiashmordred: just wondered why it's still not working20:44
tobiashand then I noticed that I cherry picked the new version of the change but forgot to push up the branch :/20:44
tobiashI guess it's too late...20:44
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use reno for release notes  https://review.openstack.org/26259720:47
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use reno for release notes  https://review.openstack.org/26259720:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use reno for release notes  https://review.openstack.org/26259720:52
openstackgerritColleen Murphy proposed openstack-infra/zuul-jobs master: Fix ansible-lint job  https://review.openstack.org/55750720:53
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Add reno releasenotes support  https://review.openstack.org/53686120:53
*** dkranz has quit IRC20:57
*** acozine1 has quit IRC21:02
tobiashmordred: dashboard works with https://review.openstack.org/55742921:03
tobiashin my dev env21:03
mordredtobiash: woot!21:03
pabelangerjlk: tobiash: recheck of github3 patch should work now21:03
pabelangerbandersnatch did a release21:03
jlktrying21:04
mordredtobiash: you ok with landing it and moving forward with rolling it out to openstack?21:04
tobiashmordred: currently reviewing it21:04
mordredsweet21:04
mordredtobiash: thanks for looking at it - I know it's late there21:05
tobiash23:05 ;)21:05
tobiash+321:05
tobiashso, now really finished for today21:08
tobiashcya21:08
jlkWouldn't be the first time one of us were up to 2300~ plugging away at Zuul...21:09
mordredtobiash: have a good night!21:09
tobiashThanks21:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198721:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594821:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198921:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199221:10
openstackgerritColleen Murphy proposed openstack-infra/zuul-jobs master: Fix ansible-lint job  https://review.openstack.org/55750721:11
openstackgerritMerged openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742921:22
*** rlandy is now known as rlandy|brb21:22
openstackgerritMerged openstack-infra/zuul master: Use latest release of github3.py  https://review.openstack.org/55747821:38
corvuswelp, that's us at zero release blockers21:38
pabelangerwoah, that is awesome21:38
corvusi will start work to prepare for the release; if anyone thinks of anything we missed, now would be a good time to mention it.  :)21:39
clarkbrelease tomorrow? or even now I guess?21:39
pabelangershould we restart all openstack services to pick up latest master as smoke test?21:40
clarkbcorvus maybe just make sure the docs updates from bernd and shrews and linuxjedi are in?21:40
corvuspabelanger: yes, i think mordred was going to finish that21:40
clarkbpabelanger: probavly not a bad Idea21:40
corvusclarkb: i think those changes are only in an etherpad right now :|21:41
clarkb:(21:41
clarkbI'm at lax gate to head home now so not sure I can convert those currently. Last flight I didnt have wifif either21:41
*** hasharDinner has quit IRC21:42
corvusclarkb: i know we're not fully integrated with the openstack foundation yet, and we don't expect to do a marketing push around the release, but i figure we should at least give a heads up, so i'll send an email.21:43
corvusthen probably release asap after that21:43
clarkbcorvus: sounds good21:45
clarkblet me know if you want me to ping them too21:45
corvusclarkb: yeah, if you're about to hop on a plane, maybe just give them a heads up to expect an email from me; i'm writing something now.21:46
clarkbok doing that now21:46
*** rlandy|brb is now known as rlandy21:48
*** harlowja has joined #zuul21:53
-openstackstatus- NOTICE: the zuul web dashboard will experience a short downtime as we roll out some changes - no job execution should be affected21:53
EmilienMcorvus, pabelanger: if I could use 2 min of your time, would you please look at the comment on https://review.rdoproject.org/r/#/c/13130/1/zuul/upstream.yaml and tell if that's true for zuul v2.5 ? I'm trying to stop wasting resources used by RDO CI22:04
corvusEmilienM: i wonder if the job below it is undoing that22:07
EmilienMcorvus: ah, so I might have to move the job below to be the first22:07
EmilienMand then the other ones more restrictive, below22:08
corvusEmilienM: tbh, i'm not positive how they interact.  let me see if i can answer that22:08
EmilienMthanks22:08
corvusEmilienM: i think either way you'll end up with both 'files' and 'skip-if'.  but, if you put the more-specific job after the less-specific one, and add "skip-if: []" to the more-specific one, i think that will remove the skip-if from it.22:11
EmilienMcorvus: ok and then I would have to keep skip-if and duplicate the list of "all-files-match-any" from the more general rule into the specific rules, if I want to keep the skip-if, right?22:13
EmilienMin fact it's doing merged as you go down22:13
EmilienMiiuc22:13
EmilienMmerge*22:13
EmilienMI'll try something22:15
corvusEmilienM: basically, any job regexes which match the job name get applied to the job in order; later ones override earlier values22:16
EmilienMok22:17
EmilienMcorvus: here is my change: https://review.rdoproject.org/r/#/c/13130/1..2/zuul/upstream.yaml22:17
corvusEmilienM: yep -- assuming all those regexes make sense and match the right things (i'm gonna leave that to you :) i think that should work.22:18
EmilienMok thanks for your help22:19
corvusEmilienM: oh, wait, i think i spotted a problem22:19
* EmilienM stops moving22:21
corvusEmilienM: i think "skip-if: []" isn't enough to undo that matcher.  you might have to do something like "skip-if: [{branch: doesnotexist}]"22:22
corvusEmilienM: (there's a simple "if skip_if_matcher" in the code, so the empty list won't create an override; we'd have to add a matcher that will never match)22:22
EmilienMoh ok I see22:24
EmilienMcorvus: what if I don't set skip-if? it'll take the one from above I guess, and that's it?22:26
EmilienMif yes I can remove the fake override, since I'm interested by the "files:" for this one, and the skip-if can't hurt anyway22:26
EmilienMcorvus: I removed it: https://review.rdoproject.org/r/#/c/13130/2..3/zuul/upstream.yaml22:33
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198922:45
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199222:45
mordredcorvus: ^^ those now work against the new api server on my local machine. yay22:46
corvusmordred: have we landed enough of the api stack for the openstack live job to work?22:49
mordredcorvus: yup22:49
corvuscool22:49
pabelangermordred: mostly curious, but does any of your javascript changes add back the time remaining on the progress bar of jobs? Want to say we lost that function at some point, but don't know why22:55
mordredpabelanger: I don't think so - I know a change in the not-too-distant-future will bring back the sparklines though22:56
mordredpabelanger: however, we're in a position soon to refactor the status page, which I think will be nice - so it should be easier to reason about re-adding things22:56
pabelanger++22:57
mordredbtw - this works and I think is cool22:58
mordred$ curl http://zuul.enstack.org/api/info22:58
mordred{"info": {"stats": {"url": null, "prefix": null, "type": "graphite"}, "capabilities": {"job_history": true}, "websocket_url": null, "tenant": "openstack", "rest_api_url": null}}22:58
mordredcorvus: ooh. I want to remove something from that data-structure that's not actually used22:58
mordredcorvus: (before we release - tiny change coming)22:59
clarkbwhats an enstack?22:59
mordredclarkb: wow. a really weird copy/pasta22:59
clarkbo and p werent invited to the arty23:01
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Remove rest_api_url from info payload  https://review.openstack.org/55754423:02
mordredclarkb, pabelanger, corvus: ^^ vestigal attribute in /info payload23:02
corvusmordred: ++23:04
mordredcorvus: are there any "we're working on" or "this is a temporary branch" messages still in the repo?23:05
mordredI think I remember you getting rid of all of them23:05
corvusokay, so my plan is, after 557544 lands, to tag master of nodepool with 3.0.0 and then send this to the zuul-announce list: https://etherpad.openstack.org/p/qrYmtbSUbX23:06
corvuser, tag master of zuul + nodepool23:06
corvusthat sound okay?23:06
corvusmordred: i *think* we got those... but it's a big repo, may be worth some greps23:06
mordredcorvus: I see a few - but nothing we can't clean up later23:06
clarkbetherpad lgtm23:07
mordred++23:07
clarkbthe sitting on plane waiting to push back from gate is the worst btw23:07
*** rlandy has quit IRC23:10
pabelangerlooking23:11
clarkbI'm gonna have to find a bottle of something on way home from airport I guess :)23:11
pabelangeretherpad is great!23:12
pabelangerdid we want to restart nodepool / zuul services now, before we tag?23:13
corvuspabelanger: yeah, let's do that.  557544 should land in about 10m; let's do it then23:32
pabelangerack23:34
pabelangerAFK for a few moments but can help23:34
openstackgerritMerged openstack-infra/zuul master: Remove rest_api_url from info payload  https://review.openstack.org/55754423:35
corvusel, less than 10m :)23:35
corvusmoving to -infra for restart discussion23:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!