| *** meera has quit IRC | 00:00 | |
| jeblair | fungi: gear only extension to the administrative protocol (not the binary one). the admin protocol is a little more loosy goosy. | 00:00 |
|---|---|---|
| jeblair | fungi: if we like what we end up with, we can propose adding it to the c server | 00:01 |
| jhesketh | I think "loosy goosy" needs adding to the official gear docs | 00:01 |
| asselin | jeblair, I restarted the unbound service and the connection times out: ;; connection timed out; no servers could be reached | 00:01 |
| jeblair | fungi: the 'cancel job' feature was also an addition to the admin protocol (though it ended up in the c server first because i had not written gear yet) | 00:01 |
| fungi | i think it's more often spelled "loosey goosey" when you use it in technical manuals though | 00:01 |
| jeblair | fungi: it's important to get exactly correct. | 00:02 |
| fungi | absolutely | 00:02 |
| fungi | it definitely looks important for us post-jenkins. awesome | 00:02 |
| *** slagle has quit IRC | 00:03 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/gear: Add access control https://review.openstack.org/84873 | 00:04 |
| *** lcostantino has joined #openstack-infra | 00:05 | |
| jeblair | jhesketh: okay, i think that's everything then (i added disconnect and also some protection against trying to grant something to self) | 00:05 |
| jhesketh | excellent :-) | 00:05 |
| jhesketh | I'll review it later on (I want to recover most of it since it's quite important) | 00:06 |
| jhesketh | *re-cover | 00:06 |
| jeblair | jhesketh: no rush, thx | 00:06 |
| jeblair | it's important to recover | 00:06 |
| clarkb | jeblair: I should have patches shortly, if I can sort out this last remaining bug | 00:06 |
| *** dims_ has quit IRC | 00:07 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Tasks are now editable https://review.openstack.org/84888 | 00:07 |
| *** xchu_ has joined #openstack-infra | 00:07 | |
| asselin | jeblair, this file is basically empty. Is that expected? /etc/unbound/unbound.conf | 00:08 |
| asselin | http://paste.openstack.org/show/75042/ | 00:08 |
| openstackgerrit | Alex Conrad proposed a change to openstack-infra/jenkins-job-builder: add ability to parse from a file object https://review.openstack.org/85202 | 00:11 |
| *** chrisstreeter_ has quit IRC | 00:11 | |
| *** thuc has quit IRC | 00:12 | |
| *** thuc has joined #openstack-infra | 00:12 | |
| fungi | asselin: our look like http://paste.openstack.org/show/75043/ | 00:12 |
| fungi | note the last line, which is missing from yours | 00:12 |
| fungi | asselin: our prepare_node.sh (the current one in the openstack-infra/config repo) adds that line explicitly | 00:14 |
| asselin | fungi, how did that line get there? I don't have that file either /etc/unbound/forwarding.conf | 00:14 |
| fungi | asselin: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/nodepool/scripts/prepare_node.sh#n63 | 00:15 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add test mixin to make test config flexible. https://review.openstack.org/85204 | 00:16 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 00:16 |
| *** thuc has quit IRC | 00:16 | |
| clarkb | jeblair: jhesketh ^ | 00:16 |
| *** e0ne has joined #openstack-infra | 00:16 | |
| jhesketh | clarkb: oh exciting :-) | 00:17 |
| * jhesketh will review after this meetig | 00:17 | |
| jhesketh | *meeting | 00:17 |
| clarkb | thank you | 00:17 |
| *** chrisstreeter_ has joined #openstack-infra | 00:18 | |
| *** mdenny has joined #openstack-infra | 00:18 | |
| jeblair | i'm going to be afk tomorrow; sorry for the short notice | 00:20 |
| *** e0ne has quit IRC | 00:20 | |
| *** dims_ has joined #openstack-infra | 00:21 | |
| asselin | fungi, interesting. I think the issue is that the dns is failing when unbound is setup by puppet (line 45). Then afterwards the file is moved, but dns issue have already messed up some other puppet configurations...? http://paste.openstack.org/show/75044/ | 00:22 |
| *** chrisstreeter_ has quit IRC | 00:23 | |
| clarkb | jeblair: jhesketh: I think there may still be some imports that are not needed. I am working on cleaning it up but what I have pushed passes testing | 00:23 |
| fungi | asselin: perhaps not... looks like there might be a split-horizon triangulation issue with your name resolution | 00:25 |
| fungi | asselin: i get some odd lookup failures trying to resolve web-proxy.atl.hp.com from the internet at large | 00:25 |
| jeblair | fungi, asselin: yeah, unbound should work without the forwarding line added; in that case, it acts as a recursive resolver | 00:26 |
| fungi | asselin: i suspect a different response might be getting returned from inside that network, which google's global resolvers will be unable to correctly recurse | 00:26 |
| *** mrodden has joined #openstack-infra | 00:26 | |
| *** aconrad has joined #openstack-infra | 00:26 | |
| asselin | fungi, it might only be visible within the firewall. It works fine for the entire script (pip install, apt-get, etc) up to the point of unbound installation. | 00:27 |
| *** bhuvan has quit IRC | 00:27 | |
| jeblair | asselin: what is the output of "dig +dnssec -t soa com. @8.8.8.8" on your server? | 00:28 |
| asselin | jeblair, ; connection timed out; no servers could be reached | 00:29 |
| *** jaypipes has quit IRC | 00:30 | |
| jeblair | asselin: i think your network is behind a firewall that blocks outbount dns | 00:30 |
| jeblair | outbound | 00:30 |
| fungi | actually, manually resolving the address rr that cname aliases against the 5 listed hp.com authoritative resolvers, it looks like they all return the same round-robin of two records, and no errors. i might have had some sort of negative response cached briefly | 00:30 |
| asselin | jeblair, fungi I'm behind a firewall, within a vpn, on a blade, inside a VM :) | 00:30 |
| *** weshay has joined #openstack-infra | 00:30 | |
| fungi | so yes, i believe jeblair has the answer | 00:30 |
| jeblair | asselin: it's a wonder anything works at all ;) | 00:30 |
| fungi | asselin: you will need resolv.conf to have your network's nameservers instead of 8.8.8.8 | 00:30 |
| fungi | er, not resolv.conf | 00:31 |
| fungi | but unbound's config | 00:31 |
| jeblair | fungi: forwarding.conf | 00:31 |
| jeblair | oh, but we add that only after we have a working system | 00:31 |
| jeblair | so yeah, there would need to be some puppet here; maybe the unbound class could take an option to set a default forwarder like you are suggisting, fungi | 00:32 |
| jeblair | i have to run now, | 00:32 |
| asselin | jeblair, thanks for your help | 00:32 |
| asselin | fungi, what's the simplest way to just now install unbound? I don't think I need it. I just plan to run cinder certification tests. | 00:33 |
| asselin | fungi, /now/not/ | 00:33 |
| fungi | asselin: i'm taking a look at the puppet manifest to see where the easiest place to override this would be | 00:34 |
| *** lcostantino has quit IRC | 00:35 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add test mixin to make test config flexible. https://review.openstack.org/85204 | 00:35 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 00:35 |
| clarkb | woo more cleanup and I think that is about it for me today | 00:35 |
| fungi | asselin: the simplest way to not add unbound and its configuration on any systems is to remove this line... http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/template.pp#n46 | 00:36 |
| fungi | asselin: a better option would be for us to add a use_unbound class variable and wrap that line in a conditional around it, then it could be set/unset from the puppet apply call in the nodepool prep scripts more easily | 00:37 |
| asselin | fungi, thanks a lot. I have to go now. I will give it a shot tomorrow. | 00:38 |
| fungi | asselin: an even better option still would be to add a class variable in the unbound module to let a resolver ip address be specified, and better still pick one up from the resolv.conf if that variable is empty/unset | 00:38 |
| fungi | lots of possibilities there | 00:39 |
| asselin | fungi, yes, it was set correctly before | 00:39 |
| asselin | in the /etc/resov.conf | 00:39 |
| clarkb | fungi: asselin: our cloud providers could give us working DNS then this would be a non issue :P | 00:39 |
| fungi | but basically we had to give up on using the dns servers in our providers because they're all broken in different ways, so for now we use a resolver address at google, but your firewall won't let your instances reach that | 00:40 |
| fungi | what clarkb said :/ | 00:40 |
| *** CaptTofu has joined #openstack-infra | 00:40 | |
| fungi | anyway, i have to disappear and catch up on cosmos. it's been rotting on my dvr for days | 00:40 |
| clarkb | also, these images are pretty purpose built... I don't think it is unreasonable to use different nodepool scripts in different environments | 00:40 |
| clarkb | the situation should get much better once nodepool and dib work together | 00:41 |
| fungi | nodepool+dib+glanceclient=win! | 00:41 |
| fungi | <- really gone now, i swear | 00:42 |
| *** amcrn has quit IRC | 00:43 | |
| *** wenlock has joined #openstack-infra | 00:44 | |
| ianw | clarkb: so i want to get fedora gating devstack jobs | 00:44 |
| clarkb | ianw: against the integrated projects or other projects? | 00:45 |
| mordred | clarkb: I wrote a patch for that you know - the nodepool+dib - have you looked at it yet? | 00:45 |
| clarkb | mordred: no you siad it needed updates | 00:46 |
| mordred | yah. I'm sure it does | 00:46 |
| clarkb | ianw: nodepool can build fedora 20 images now | 00:46 |
| mordred | jut aying - the original patch I thnk took me 3 hours to write - it's not much rockscience | 00:46 |
| clarkb | ianw: the biggest concern is more about the mechanics of gating against a distro with short support timeframes. | 00:46 |
| mordred | yup | 00:46 |
| ianw | clarkb: well, initial goal is just against devstack changes | 00:47 |
| clarkb | ianw: right so that is the integrated gate because nova is gated against devstack and so on | 00:47 |
| openstackgerrit | Vladan Popovic proposed a change to openstack-dev/pbr: Add tox -e genconfic for sample conf generation https://review.openstack.org/85207 | 00:47 |
| clarkb | ianw: from infrastructures perspective, time to available image was long (but is now much shorter if we can make DIB a thing and upload to the newly opened glance services, but this depends on us ditching old hp cloud) | 00:48 |
| mordred | clarkb: btw - how is the old hp to new hp game? sorry, I've been extra flaky and have no idea how that's going | 00:49 |
| clarkb | ianw: so that eats into the already short support timeframe. Then ideally we would continue to test a release of openstack (whatever project) against the same distro version it was released under. Though as far as fedora goes people seem to generally be happy to simply stop testing $openstackrelease on $fedorarelease once support ends | 00:49 |
| clarkb | mordred: last I saw there is still a very high error reate | 00:49 |
| mordred | clarkb: awesome | 00:49 |
| clarkb | mordred: we are running with a lower max servers so that that az doesn't provide most of our nodes | 00:49 |
| clarkb | ianw: so assuming we can just drop the devstack test on fedora when support goes away, we can probably do it. My only real remaining concern is do we add _another_ test just for this or swap out the underlying OS on an existing test | 00:50 |
| mordred | clarkb: I say we do that on the one that does postgres and whatever the other thing that's not rabbit is | 00:51 |
| openstackgerrit | Vladan Popovic proposed a change to openstack-dev/pbr: Add tox -e genconfic for sample conf generation https://review.openstack.org/85207 | 00:51 |
| *** german_ has quit IRC | 00:51 | |
| clarkb | mordred: I don't think we test not rabbit today, but ya I think that is reasonable | 00:51 |
| ianw | clarkb: wouldn't we want it as a separate, non-voting test for some time while the issues are worked out? | 00:51 |
| ianw | clarkb: also, it means that it can be dropped easily? | 00:52 |
| clarkb | ianw: sure, but eventually we want to stop spending extra resources | 00:52 |
| clarkb | ianw: because we already go through 20k VMs a day | 00:52 |
| clarkb | ianw: so as far as making this happen goes I think we need one of two things to happen. Either we leave hpcloud 1.0 behdin (we tried this last week and hpcloud 1.1 fell over) or we agree that fedora testing doesn't need to happen on hpcloud 1.0 and if that becomes our only test cloud we drop the test | 00:53 |
| clarkb | once that is done we can add a fedora20 image to nodepool and an experimental job that runs against devstack on nodes with that label | 00:54 |
| *** wenlock has quit IRC | 00:54 | |
| clarkb | then once the kinks are worked out we can check and get devstack on that, and as a final step ( at least for this exercise) swap the underlying os for one of devstack's jobs (this will then get you gating all projects against fedora | 00:55 |
| ianw | clarkb: ok, i'm very new to all this so excuse my ignorance. doesn't the nodepool balance across rackspace & hp cloud? | 00:55 |
| *** chuck_ has quit IRC | 00:55 | |
| clarkb | ianw: it does. nodepool today talks to rax and two versions of hpcloud (and a tripleo cloud) | 00:55 |
| *** e0ne has joined #openstack-infra | 00:55 | |
| clarkb | ianw: historically we have not run jobs that we can only run on one provider (in this case rax and hpcloud 1.1 will meet our fedora needs possibly but hpcloud 1.0 will not) | 00:56 |
| ianw | clarkb: ok, so i'm not quite following, we need to build fedora images on the fly? is that what you mean by DIB? | 00:57 |
| clarkb | hpcloud 1.1 does not have an available fedora image, so we would need to upload an image there and I know jeblair doesn't want to do that until DIB is a thing, so we may need to sort out DIB as a second prereq | 00:58 |
| jhesketh | fungi: ping | 00:58 |
| mordred | clarkb: I will try to work on the DIB patch this wekend | 00:58 |
| clarkb | ianw: sort of. The way nodepool works today is it spins up a VM using a cloud provider provided image, modifies it then snapshots it. We then boot this snapshot for our test VMs. | 00:58 |
| clarkb | ianw: we cannot do that with fedora 20 today | 00:59 |
| clarkb | ianw: but what we can do is if DIB gets sorted we can build our own fedora 20 images (and precise/trusty/whatever) that we upload to our clouds and boot that instead of using snapshots | 00:59 |
| *** CaptTofu has quit IRC | 00:59 | |
| clarkb | mordred: also, don't forget (and I forgot this) that our DIB images will need to boot off of rax and hpcloud which may require two different images and/or formats | 01:00 |
| *** e0ne has quit IRC | 01:00 | |
| ianw | clarkb: ok, thanks, i'm starting to get the picture | 01:01 |
| ianw | clarkb: so, what could i actually do to help? | 01:02 |
| mordred | clarkb: I don't thik it should need two different iamges - it's possible it would need two different formats | 01:03 |
| mordred | lifeless: ^^ am I stupid? | 01:03 |
| ianw | clarkb: are the devstack gate scripts known to work on fedora? it looks like it, but that i something i can verify | 01:03 |
| lifeless | mordred: yes. Sorry, whats the question ? | 01:03 |
| mordred | lifeless: I should be able to use DIB to make one image and then upload that same image to both rax and hp, yeah? (even though rax is xen and hp is kvm) | 01:03 |
| mordred | or do I need to do $things because of xen? | 01:03 |
| clarkb | ianw: yes, I beleive someone at ibm makes sure they are working with fedora but double checking would be great | 01:04 |
| lifeless | I believe xen can run disk images 9(vs ami/ari/aki's) or it couldn't run windows. | 01:04 |
| clarkb | mordred: well we want pvhvm images | 01:04 |
| clarkb | mordred: because they are better | 01:04 |
| lifeless | so you should be able to upload to both, as long as any other dependent services (like metadata, or file injection) are available on both ends | 01:04 |
| clarkb | if you can make pvhvm images that are happy on kvm too then ++ | 01:05 |
| mordred | clarkb: what is a pvhvm image? | 01:05 |
| mordred | lifeless: can I make a pvhvm image? | 01:05 |
| *** slagle has joined #openstack-infra | 01:05 | |
| clarkb | mordred: it is an image with different drivers aiui | 01:05 |
| lifeless | install all the drivers, done. | 01:05 |
| mordred | awesome | 01:05 |
| *** weshay has quit IRC | 01:05 | |
| mordred | clarkb: yes. I can make one of those | 01:05 |
| openstackgerrit | Alex Conrad proposed a change to openstack-infra/jenkins-job-builder: add ability to parse from a file object https://review.openstack.org/85177 | 01:05 |
| clarkb | ianw: you might also be able to help mordred hack on nodepool to do the dib stuff (or help him test it) | 01:05 |
| mordred | it sounds like "don't make a crippled image" is the answer to most of this | 01:06 |
| clarkb | ianw: the last thing that may be good is to add an agenda item on tuesdays infra meeting to discuss whether or not we need to be able to do this on hpcloud 1.0 as well | 01:06 |
| clarkb | ianw: because hpcloud 1.0 does not have up to date fedora images and it does not support glance uploads | 01:06 |
| clarkb | ianw: I am fine with not running fedora tests on hpcloud 1.0 fwiw | 01:07 |
| clarkb | lifeless: disk images 9? | 01:07 |
| ianw | clarkb: ok, will do | 01:08 |
| lifeless | clarkb: from outer space? | 01:08 |
| *** thomasem has quit IRC | 01:09 | |
| *** saschpe has quit IRC | 01:11 | |
| *** saschpe has joined #openstack-infra | 01:13 | |
| *** e0ne has joined #openstack-infra | 01:14 | |
| *** e0ne has quit IRC | 01:19 | |
| *** jlk has quit IRC | 01:21 | |
| *** jlk has joined #openstack-infra | 01:21 | |
| *** thuc has joined #openstack-infra | 01:23 | |
| *** mgagne has quit IRC | 01:24 | |
| *** thuc has quit IRC | 01:27 | |
| ianw | clarkb / mordred : added points from discussion on https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 01:28 |
| *** nosnos has joined #openstack-infra | 01:33 | |
| *** Sukhdev has quit IRC | 01:34 | |
| *** masayukig has quit IRC | 01:36 | |
| clarkb | jhesketh: I think adding the new tests to zuul has tickled bugs in older tests. They seem to be quite flaky after my change | 01:40 |
| jhesketh | :-( | 01:41 |
| clarkb | I notice that periodic jobs are NullChanges and that causes the event processor to throw exceptions but that doesn't seem to be related, I see the same exceptions thrown in my successful runs | 01:42 |
| ilives | hi stackers, we need to setup the icehouse multinode with devstack for poc, we will use neutron not nova-network, for the compute node what will the localrc look like? thanks! | 01:43 |
| clarkb | ilives: you may have better luck in #openstack. this channel is for the openstack developer infrastructure | 01:45 |
| ilives | ok, thanks | 01:47 |
| *** erw has quit IRC | 01:48 | |
| *** khyati has quit IRC | 01:48 | |
| jeblair | jhesketh: the more i think about it, the more i think the 'self' thing is getting too weird and we should make a revoke-self command | 01:54 |
| jhesketh | yeah, I'm not opposed to that | 01:55 |
| jhesketh | and maybe not have any other self-related commands | 01:55 |
| jeblair | okay, i have left a -1 on my patch with that | 01:55 |
| jeblair | jhesketh: yeah, i can't think of any others we would need (if a node really wants to grant itself a perm, it can darn well look up its name :) i was just trying to make it easy for our random workers to not actually have to know their cert name | 01:56 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully. https://review.openstack.org/85217 | 01:56 |
| jeblair | (maybe they will anyway, but it seemed like a nice potential optimization) | 01:56 |
| clarkb | jeblair: jhesketh ^ I think that may make zuul slightly happier but don't necessarily expect it to make the tests more reliable | 01:56 |
| jhesketh | jeblair: yep | 01:57 |
| *** mgagne has joined #openstack-infra | 01:57 | |
| jhesketh | clarkb: cool | 01:57 |
| jhesketh | will look soon sorry | 01:57 |
| jeblair | clarkb: ok; let me know if you want me to dig into race conditions for particular tests (though i may not get to it until next week) | 01:58 |
| jeblair | mordred: actually, nodepool may not have changed _that much_ since your patch; we might be pleasantly surprised | 01:58 |
| *** aconrad has quit IRC | 01:58 | |
| clarkb | jeblair: yup will do, I will probably keep hacking at it. 85217 is a result of that (I wanted to make the logs clean to help debugging) | 01:59 |
| clarkb | it is possible that the NullChange stuff is related though... since the test that has failed a lot is test_idle and it only runs NullChange jobs | 01:59 |
| mordred | jeblair: w00t! | 01:59 |
| clarkb | I am going to AFK as soon as zuul reports results on 85217 | 02:00 |
| *** wenlock has joined #openstack-infra | 02:00 | |
| *** rcleere has joined #openstack-infra | 02:00 | |
| clarkb | I will probably recheck it a bunch too to see if it has a better or worse success rate | 02:00 |
| jeblair | mordred: i think we might need a little workaround in nodepool though to deal with the rax bug | 02:01 |
| jeblair | glance -d --os-image-url=https://iad.images.api.rackspacecloud.com --os-image-api-version=2 image-list | 02:01 |
| jeblair | mordred: that's the glance command we have to use with rax, so we might need to set some of those things with glanceclient (and add them to nodepool config, etc) | 02:02 |
| mordred | ++ | 02:02 |
| jeblair | honestly -- adding dib+glanceclient to nodepool is probably a completely separate process from figure out what an image that works on both providers looks like | 02:03 |
| jeblair | in case we want to parallelize that | 02:03 |
| jeblair | (i mean, ideally 'download image from ubuntu, upload to cloud' would work but i'm not holding my breath) | 02:03 |
| *** mgagne1 has joined #openstack-infra | 02:04 | |
| jeblair | okay, i am now also going to watch cosmos, but not in the same region of space-time as fungi | 02:05 |
| clarkb | woot passed the first round of tests, I have rechecked it and am now AFK gnite | 02:06 |
| *** mgagne has quit IRC | 02:06 | |
| *** Ryan_Lane has quit IRC | 02:08 | |
| *** yamahata has joined #openstack-infra | 02:09 | |
| *** ArxCruz has quit IRC | 02:11 | |
| *** alff has quit IRC | 02:11 | |
| *** alff_ has quit IRC | 02:11 | |
| *** ArxCruz has joined #openstack-infra | 02:11 | |
| *** mgagne1 is now known as mgagne | 02:13 | |
| *** e0ne has joined #openstack-infra | 02:14 | |
| *** ilyashakhat has quit IRC | 02:17 | |
| *** ilyashakhat has joined #openstack-infra | 02:18 | |
| *** e0ne has quit IRC | 02:19 | |
| *** changbl has joined #openstack-infra | 02:22 | |
| *** morganfainberg is now known as morganfainberg_Z | 02:22 | |
| openstackgerrit | Paul Belanger proposed a change to openstack-infra/nodepool: Create launch-timeout setting for providers https://review.openstack.org/85150 | 02:22 |
| *** HenryG has joined #openstack-infra | 02:23 | |
| *** khyati has joined #openstack-infra | 02:24 | |
| *** zhiyan_ is now known as zhiyan | 02:24 | |
| *** rcleere has quit IRC | 02:26 | |
| *** zz_gondoi is now known as gondoi | 02:26 | |
| *** khyati has quit IRC | 02:27 | |
| *** khyati has joined #openstack-infra | 02:28 | |
| *** rcleere has joined #openstack-infra | 02:29 | |
| *** dims_ has quit IRC | 02:29 | |
| *** gondoi is now known as zz_gondoi | 02:31 | |
| jamielennox | hey guys, i've got 1 +2 and 5 +1s on this patch to degrade a job to non-voting: https://review.openstack.org/#/c/84372/ can someone have a look and approve? | 02:34 |
| *** jdurgin has quit IRC | 02:38 | |
| *** zehicle_at_dell has quit IRC | 02:42 | |
| *** jp_at_hp1 has quit IRC | 02:42 | |
| *** zehicle_at_dell has joined #openstack-infra | 02:43 | |
| *** dedpahom has joined #openstack-infra | 02:46 | |
| *** jdurgin has joined #openstack-infra | 02:51 | |
| *** matsuhas_ has joined #openstack-infra | 02:53 | |
| *** matsuhashi has quit IRC | 02:53 | |
| *** matsuhas_ has quit IRC | 02:54 | |
| *** matsuhashi has joined #openstack-infra | 02:56 | |
| *** maxbit has quit IRC | 02:56 | |
| *** rcleere has quit IRC | 02:57 | |
| *** zz_gondoi is now known as gondoi | 02:59 | |
| *** maxbit has joined #openstack-infra | 02:59 | |
| *** matsuhashi has quit IRC | 03:02 | |
| *** matsuhashi has joined #openstack-infra | 03:04 | |
| *** maxbit has quit IRC | 03:06 | |
| *** khyati has quit IRC | 03:09 | |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add subway map to status page https://review.openstack.org/85226 | 03:09 |
| openstackgerrit | Adam Gandelman proposed a change to openstack-infra/config: Enable baremetal scenario test in Ironic's d-s-g https://review.openstack.org/85227 | 03:09 |
| clarkb | jeblair: jhesketh: I think I haev logs that show what is going on with the tests, tl;dr is it appears a gear worker sends work data then shutsdown. On the gear server side the disconnection is processed before the work data is so we get an unknown job exception | 03:10 |
| clarkb | oh, it may be the client that shutsdown | 03:12 |
| jhesketh | interesting | 03:13 |
| jhesketh | jeblair: are you around still? | 03:13 |
| *** gondoi is now known as zz_gondoi | 03:14 | |
| *** e0ne has joined #openstack-infra | 03:14 | |
| clarkb | jhesketh: jeblair http://paste.openstack.org/show/75049/ is the smaller chunk of log that shows it | 03:15 |
| clarkb | you should be able to refer to the failed test_idle jobs on my stack to see the rest of the logs | 03:16 |
| *** timrc is now known as timrc-afk | 03:17 | |
| *** nosnos has quit IRC | 03:17 | |
| *** e0ne has quit IRC | 03:19 | |
| clarkb | oh you know what, I think this is a race between the periodic jobs being queued and the shutdown of the test infrastructure | 03:20 |
| * clarkb goes down that path to see if it leads to anything interesting | 03:20 | |
| *** rcleere has joined #openstack-infra | 03:21 | |
| *** wenlock has quit IRC | 03:26 | |
| adam_g | when a python26/27 job runs tox in jenkins, is it applying any special configuration to it other than what the project's [testenv:jenkins] contains? | 03:27 |
| adam_g | scratching my head over http://logs.openstack.org/33/84033/7/check/gate-ironic-python27/91f469d/console.html | 03:28 |
| clarkb | adam_g: it does run in a wrapper script but that doesn't really come with special config | 03:29 |
| *** rcleere has quit IRC | 03:29 | |
| clarkb | adam_g: what does ironic master's tox.ini look like? is the result of merging your change with master causing that? | 03:30 |
| adam_g | what ends up in /home/jenkins/workspace/gate-ironic-python27/tox.ini ? | 03:30 |
| clarkb | adam_g: http://git.openstack.org/cgit/openstack/ironic/tree/tox.ini#n15 that is the problem I think | 03:31 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Move status stylesheets into css file https://review.openstack.org/84921 | 03:31 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add in sparklines to status page pipelines https://review.openstack.org/84922 | 03:31 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add subway map to status page https://review.openstack.org/84314 | 03:31 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Tweak job layout css in status page https://review.openstack.org/84316 | 03:31 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Adjust change headings on status page https://review.openstack.org/84317 | 03:31 |
| clarkb | adam_g: it is always the result of merging your change to the proposed branch | 03:31 |
| clarkb | adam_g: we test end results | 03:31 |
| adam_g | clarkb, dah! good call. time to rebase, i suppose | 03:31 |
| *** Ryan_Lane has joined #openstack-infra | 03:32 | |
| clarkb | jhesketh: I think I may have an actual fix for the flaky test_idle test. Running it through its paces now | 03:34 |
| jhesketh | cool :-) | 03:34 |
| jhesketh | clarkb: was it racing with the periodic tests? | 03:34 |
| clarkb | jhesketh: the periodic test scheduling was racing against the shutdown of the test infrastructure I think | 03:35 |
| clarkb | jhesketh: basically the timer trigger can put jobs on the queue while we shutdown gear and stuff | 03:35 |
| clarkb | when that happens the assert final state stuff gets cranky | 03:36 |
| jhesketh | clarkb: yep, okay | 03:36 |
| clarkb | I am running it under `testr run --parallel --until-failure` now | 03:37 |
| clarkb | it being my fix | 03:37 |
| *** pcrews_ has quit IRC | 03:42 | |
| *** talluri has joined #openstack-infra | 03:50 | |
| *** xchu_ has quit IRC | 03:51 | |
| *** xchu_ has joined #openstack-infra | 03:55 | |
| *** wenlock has joined #openstack-infra | 03:57 | |
| clarkb | jhesketh: it is looking good, about to push the change | 03:58 |
| jhesketh | cool | 03:58 |
| *** jamielennox is now known as jamielennox|away | 03:58 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Fix race in test_idle test. https://review.openstack.org/85230 | 04:00 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully. https://review.openstack.org/85217 | 04:00 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add test mixin to make test config flexible. https://review.openstack.org/85204 | 04:00 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 04:00 |
| clarkb | jhesketh: I put the test fix at the bottom of the stack | 04:00 |
| *** alff has joined #openstack-infra | 04:01 | |
| *** alff_ has joined #openstack-infra | 04:01 | |
| jhesketh | clarkb: shiny, I'll take a look now | 04:01 |
| *** matsuhashi has quit IRC | 04:01 | |
| *** dedpahom has quit IRC | 04:02 | |
| *** harlowja is now known as harlowja_away | 04:03 | |
| *** jamielennox|away is now known as jamielennox | 04:03 | |
| *** matsuhashi has joined #openstack-infra | 04:05 | |
| jeblair | jhesketh: briefly; are you? :) | 04:06 |
| jhesketh | clarkb: I think there are some other cases of this bug that could be fixed (see comment on patch) | 04:06 |
| jhesketh | jeblair: yep, was just going to discuss the javascript stuff with you | 04:06 |
| jhesketh | jeblair: I left a comment on your rework of the subway map | 04:06 |
| jeblair | jhesketh: works for you? :) | 04:07 |
| clarkb | jhesketh: ya it just failed again in one of the 4 stacked cahnges | 04:07 |
| jhesketh | specifically I can't see what css difficulties you are referring to (and hence why you'd want to drop bootstrap) | 04:07 |
| clarkb | jhesketh: so clearly not completely fixed | 04:07 |
| jhesketh | jeblair: visually, yes (in firefox and chrome) | 04:07 |
| jhesketh | jeblair: But I also wasn't entirely sure what I was looking for.. as in visually it looks good to me on my computer | 04:07 |
| jeblair | jhesketh: okay, that's getting weird. | 04:08 |
| jeblair | it appears to look correct now... | 04:08 |
| jhesketh | jeblair: even if I remove those two css lines you were having trouble with I can't see a difference | 04:08 |
| openstackgerrit | Jamie Lennox proposed a change to openstack-infra/config: Remove py3 gate job from kite https://review.openstack.org/84372 | 04:08 |
| jeblair | okay, it's broken for me in chrome right now; i'll take a ss | 04:09 |
| jhesketh | jeblair: I also fixed your tabs in that patchset and if you get the tail of my changes I've made a few more improvements to the layout | 04:09 |
| jeblair | jhesketh: http://imgur.com/enzWMGQ | 04:10 |
| jhesketh | heh, that looks crazy weird | 04:10 |
| *** david-lyle has joined #openstack-infra | 04:11 | |
| clarkb | jhesketh: oh, it can happen with the first chunk of assertions in test_idle too | 04:11 |
| jeblair | jhesketh: considering the erratic behavior, it's possible those css values are a red herring... maybe something about changing them was triggering some bug | 04:11 |
| clarkb | jhesketh: more patches incoming | 04:11 |
| *** talluri has quit IRC | 04:12 | |
| jhesketh | jeblair: what URL are you using to load the example... chrome doesn't like loading local ajax requests for me | 04:12 |
| jeblair | jhesketh: chromium-browser --allow-file-access-from-files | 04:12 |
| jhesketh | neat | 04:12 |
| jeblair | jhesketh: then zuul/etc/status/public_html/index.html?demo=tree | 04:12 |
| *** dstanek has quit IRC | 04:13 | |
| jhesketh | jeblair: it doesn't happen to me a default zoom level | 04:13 |
| jhesketh | but it does fragment at other zooms | 04:13 |
| jogo | clarkb: so I realized the hacking patch failed because of my requirements patch to fail hard if you try to sneak a req in | 04:14 |
| *** e0ne has joined #openstack-infra | 04:14 | |
| jogo | I saw some comments on that earlier did someone propose a fix? | 04:14 |
| jhesketh | jeblair: wow, that's crazy... If I inspect the elements, when they are off each td has a calculated width of 17px, but at zoom levels where it works the same td's have a calculated width of 16px | 04:15 |
| jhesketh | so the zoom is affecting the calculated width | 04:15 |
| jeblair | jhesketh: the error i'm seeing is at normal zoom | 04:15 |
| jhesketh | yeah so it's likely related to fonts and weird differences | 04:16 |
| clarkb | jogo: sdague had one up iirc | 04:16 |
| clarkb | jogo: he wanted to specify per job when to ignore the reqs mismatches | 04:16 |
| jhesketh | jeblair: do you get the error at other zooms? (or is there a level where it goes away) | 04:16 |
| jeblair | jhesketh: the openstack status page does not display that error | 04:16 |
| jogo | clarkb: thanks | 04:16 |
| jeblair | jhesketh: yes, changing zoom does affect it | 04:16 |
| *** chandan_kumar has joined #openstack-infra | 04:16 | |
| jhesketh | jeblair: does changing line 449 to "min-width" fix it for you? | 04:17 |
| jhesketh | (actually I'm on the tail of my changes, might be a different line number, but the one setting the width to 16px, making it min-width) | 04:18 |
| openstackgerrit | A change was merged to openstack/requirements: Add a file that can detail the requirements files https://review.openstack.org/81589 | 04:18 |
| jogo | clarkb: ahh found it https://review.openstack.org/#/c/85167/ | 04:18 |
| *** e0ne has quit IRC | 04:19 | |
| *** nosnos has joined #openstack-infra | 04:20 | |
| clarkb | jhesketh: so, after thinking about your -1, I don't think that is the right fix, because we explicitly test against that final state | 04:21 |
| clarkb | jhesketh: we would potentially let stuff trickle off that we didn't want. I will hwoever update the other tests that use timer trigger | 04:21 |
| jhesketh | yeah I wasn't sure if it was the right fix | 04:21 |
| jeblair | jhesketh: it changes things but doesn't fix it | 04:22 |
| jeblair | jhesketh: i have to run again now; thanks for looking into it; hopefully we can find a way to reproduce the problem more reliably | 04:23 |
| jhesketh | jeblair: no worries, now I know what you're looking at I can try a few things | 04:23 |
| jhesketh | the min-width fixes most zoom levels for me but there are some slight rending problems at a couple | 04:24 |
| jhesketh | but it's only ever by 1px | 04:24 |
| jhesketh | like a rounding problem with chrome | 04:24 |
| *** jepoy has quit IRC | 04:24 | |
| jeblair | jhesketh: yeah, i have the feeling that may or may not be related to the problem i'm seeing at default zoom | 04:25 |
| jeblair | anyway, goodnight! | 04:25 |
| *** demidof has joined #openstack-infra | 04:25 | |
| jhesketh | okay | 04:25 |
| jhesketh | Seeya :-) | 04:25 |
| *** jepoy has joined #openstack-infra | 04:32 | |
| *** VijayTripathi has joined #openstack-infra | 04:32 | |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Move status stylesheets into css file https://review.openstack.org/84921 | 04:34 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add in sparklines to status page pipelines https://review.openstack.org/84922 | 04:34 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Add subway map to status page https://review.openstack.org/84314 | 04:34 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Tweak job layout css in status page https://review.openstack.org/84316 | 04:34 |
| openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/zuul: Adjust change headings on status page https://review.openstack.org/84317 | 04:34 |
| nibalizer | i have some questions about storyboard | 04:34 |
| nibalizer | mostly that installing from pypi isnt working | 04:34 |
| nibalizer | http://ci.openstack.org/storyboard/install/manual.html says its on pypi but i can't find it | 04:35 |
| *** jepoy has quit IRC | 04:37 | |
| *** jepoy has joined #openstack-infra | 04:39 | |
| *** wchrisj_ has quit IRC | 04:44 | |
| *** skraynev_afk is now known as skraynev | 04:48 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully. https://review.openstack.org/85217 | 04:48 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add test mixin to make test config flexible. https://review.openstack.org/85204 | 04:49 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 04:49 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Fix races in timer trigger tests. https://review.openstack.org/85230 | 04:49 |
| clarkb | jhesketh: ^ ok, I think that covers all tests that use a timer trigger | 04:49 |
| clarkb | jhesketh: not sure if I got all of the corner cases though, but it is late here | 04:49 |
| lifeless | clarkb: hi, we had a small deliberate outage to fix the kernel module on the network node | 04:49 |
| lifeless | clarkb: but we're not seeing nodes now | 04:49 |
| lifeless | clarkb: erm slaves, I mean. | 04:49 |
| lifeless | clarkb: are you about to look? | 04:50 |
| jhesketh | clarkb: cool :-) | 04:50 |
| clarkb | lifeless: not really | 04:50 |
| lifeless | clarkb: okies | 04:51 |
| lifeless | mordred: halp ? | 04:51 |
| lifeless | I'm presuming fungi is fast asleep | 04:51 |
| clarkb | I have been neglecting things I need to do tonight | 04:51 |
| clarkb | turns out taxes are due in soon... | 04:51 |
| lifeless | clarkb: are there any folk west of you with ops access? | 04:51 |
| clarkb | lifeless: no | 04:51 |
| *** wchrisj has joined #openstack-infra | 04:54 | |
| mordred | lifeless: sup? | 04:55 |
| lifeless | mordred: hi | 04:56 |
| lifeless | mordred: we need some help with nodepool | 04:56 |
| mordred | lifeless: what can I do you for? | 04:56 |
| lifeless | mordred: AFAWCT the tripleo ci overcloud is up | 04:56 |
| lifeless | mordred: but zuul shows no jobs running for it | 04:56 |
| lifeless | mordred: there are many active nodes | 04:56 |
| mordred | lifeless: I see a bunch of nodes in tripleo-test-cloud in delete state | 04:57 |
| lifeless | there are 26 ACTIVE nodepool VMs in the cloud | 04:57 |
| lifeless | looks like 4 that are stuck deleting | 04:57 |
| lifeless | oh | 04:57 |
| lifeless | I bet I know whats happened | 04:58 |
| mordred | nope | 04:58 |
| mordred | I have 4 nodes not in delete state | 04:58 |
| lifeless | SpamapS: want to be we killed the tcp connection ? | 04:58 |
| lifeless | this no timeout thing is HILARIOUS | 04:58 |
| mordred | lifeless: jeez. is this still the request library thing in novaclient? | 04:58 |
| lifeless | mordred: ok, so if you do a locate on that server | 04:58 |
| lifeless | you should find killcx somewhere | 04:58 |
| lifeless | have a look in netstat for a connection to 138.35.77.16 | 04:59 |
| lifeless | and do killcx 138.35.77.16:$portofconnection | 04:59 |
| *** LinuxJedi has quit IRC | 05:00 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully. https://review.openstack.org/85217 | 05:00 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add test mixin to make test config flexible. https://review.openstack.org/85204 | 05:00 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 05:00 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Fix races in timer trigger tests. https://review.openstack.org/85230 | 05:00 |
| SpamapS | I'm not sure requests is the problem anymore | 05:01 |
| SpamapS | novaclient _looks_ like it is passing the right timeout | 05:01 |
| SpamapS | but.. at this point I have to sit with pdb and figure out why the timeout never makes it to the socket. | 05:01 |
| lifeless | mordred: failing that, if things are in an ok place, a nodepool restart would also clear it | 05:01 |
| SpamapS | lifeless: we had no network connectivity for about 5 minutes | 05:01 |
| SpamapS | but no timeout should have _saved_ that | 05:02 |
| lifeless | SpamapS: thats long enough to wedge the statemachine - > 2*MSL | 05:02 |
| SpamapS | it would have been in TIME_WAIT and thus given back a FIN/ACK if it had been closed on our server side | 05:02 |
| lifeless | SpamapS: because we know theres a bad firewall in the mix somewhere | 05:02 |
| SpamapS | or RST if it wasn't in TIME_WAIT | 05:02 |
| SpamapS | oh true | 05:03 |
| SpamapS | stupid firewalls | 05:03 |
| lifeless | well not bad, strictly speaking correct, but sheese. | 05:03 |
| SpamapS | Ok have meatspace stuff but yes we were down for more than a few seconds. | 05:03 |
| lifeless | mordred: failing that (e.g. no killcx) if things are ok a nodepool restart will also clear the issue | 05:04 |
| mordred | lifeless: tcp 0 0 192.237.211.91:52977 138.35.77.16:13774 ESTABLISHED | 05:04 |
| mordred | tcp 54 0 192.237.211.91:34734 138.35.77.16:13000 CLOSE_WAIT | 05:04 |
| lifeless | great, killcx both please | 05:05 |
| lifeless | it locally spoofs a RST to the connection | 05:05 |
| mordred | 13774? or 52977? | 05:05 |
| lifeless | killcx 138.35.77.16:13000 ; killcx 138.35.77.16:13774 | 05:05 |
| *** chandan_kumar has quit IRC | 05:06 | |
| *** ben00b has joined #openstack-infra | 05:06 | |
| mordred | we do not seem to have it installed with its deps anywhere | 05:06 |
| StevenK | It's probably not in PATH | 05:06 |
| mordred | nor is it showing up as having run in root's or fungi's history | 05:06 |
| lifeless | interesting, since fungi did that preivously :) | 05:06 |
| lifeless | is this a new nodepool since the tripleo sprint? Or perhaps he cleanedup :) | 05:06 |
| lifeless | the code is small enough to audit by eye and the three deps are packaged | 05:07 |
| lifeless | if you want to avoid a nodepool restart | 05:07 |
| *** ben00b has quit IRC | 05:08 | |
| lifeless | we can't reset it from our end because there is a stateful firewall somewhere that prevents our RST getting through | 05:08 |
| *** chandan_kumar has joined #openstack-infra | 05:08 | |
| *** ildikov_ has quit IRC | 05:11 | |
| *** VijayTripathi has quit IRC | 05:13 | |
| mordred | lifeless: done | 05:14 |
| lifeless | and voila | 05:14 |
| lifeless | tcp 0 0 138.35.77.16:13774 192.237.211.91:47811 ESTABLISHED 5806/stunnel4 | 05:14 |
| lifeless | we now have a connection to the API | 05:14 |
| *** e0ne has joined #openstack-infra | 05:14 | |
| lifeless | mordred: thank you | 05:14 |
| lifeless | new nodes spawning now | 05:15 |
| lifeless | over the next 10m or so I imagine the ACTIVE nodes will be torn down | 05:15 |
| mordred | lifeless: yay! | 05:15 |
| *** LinuxJedi has joined #openstack-infra | 05:16 | |
| lifeless | and this is why firewalls are bad :) | 05:16 |
| mordred | lifeless: this, and SO MANY MORE REASONS | 05:17 |
| nibalizer | all hail the open net! | 05:19 |
| *** e0ne has quit IRC | 05:19 | |
| nibalizer | packets fly free! | 05:19 |
| SpamapS | IPv6 is the new Duke Nukem Forever | 05:19 |
| nibalizer | mordred: maybe tcpdrop could have been used in the case above | 05:20 |
| *** VijayTripathi has joined #openstack-infra | 05:21 | |
| lifeless | mordred: and yes we have nodes | 05:24 |
| lifeless | slaves | 05:24 |
| lifeless | jobs running | 05:25 |
| lifeless | but only 18 | 05:25 |
| lifeless | which is < 1/2 our capacity | 05:25 |
| *** zhiyan is now known as zhiyan_ | 05:25 | |
| lifeless | mordred: if you have time, I'd like to get the other 20 nodes up ;) | 05:25 |
| *** imcsk8 has joined #openstack-infra | 05:26 | |
| *** CaptTofu has joined #openstack-infra | 05:29 | |
| *** harlowja_away has quit IRC | 05:29 | |
| SergeyLukjanov | jeblair, new providers, yay! | 05:31 |
| SergeyLukjanov | SpamapS, heh, Duke Nukem... that was a funny time ;) | 05:32 |
| *** imcsk8 has quit IRC | 05:35 | |
| *** gokrokve has joined #openstack-infra | 05:39 | |
| *** gokrokve_ has joined #openstack-infra | 05:40 | |
| *** talluri has joined #openstack-infra | 05:40 | |
| *** dteselkin_ has joined #openstack-infra | 05:41 | |
| *** ildikov_ has joined #openstack-infra | 05:43 | |
| *** gokrokve has quit IRC | 05:44 | |
| *** _nadya_ has joined #openstack-infra | 05:51 | |
| *** saper has quit IRC | 05:52 | |
| *** saper has joined #openstack-infra | 05:52 | |
| *** CaptTofu has quit IRC | 05:56 | |
| *** markmc has joined #openstack-infra | 06:00 | |
| *** nicedice has quit IRC | 06:04 | |
| *** ArxCruz has quit IRC | 06:05 | |
| *** gokrokve_ has quit IRC | 06:07 | |
| *** _nadya_ has quit IRC | 06:11 | |
| *** VijayTripathi has quit IRC | 06:14 | |
| *** e0ne has joined #openstack-infra | 06:14 | |
| *** e0ne_ has joined #openstack-infra | 06:16 | |
| *** afazekas has joined #openstack-infra | 06:17 | |
| *** e0ne has quit IRC | 06:18 | |
| *** yolanda has joined #openstack-infra | 06:27 | |
| *** wenlock has quit IRC | 06:33 | |
| *** _nadya_ has joined #openstack-infra | 06:42 | |
| *** mrda is now known as mrda_weekend | 06:47 | |
| openstackgerrit | Marc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: Small documentation tweaks https://review.openstack.org/84950 | 06:47 |
| *** Alexandra is now known as alex-gone | 06:48 | |
| *** alex-gone has quit IRC | 06:49 | |
| *** jlibosva has joined #openstack-infra | 06:51 | |
| lifeless | mordred: guessing EOD ? | 06:52 |
| *** demidof has quit IRC | 06:57 | |
| *** chandankumar_ has joined #openstack-infra | 06:59 | |
| *** _nadya_ has quit IRC | 07:04 | |
| *** yamahata has quit IRC | 07:06 | |
| *** matsuhashi has quit IRC | 07:07 | |
| *** saju_m has joined #openstack-infra | 07:12 | |
| openstackgerrit | afazekas proposed a change to openstack-infra/elastic-recheck: Add query for a heat db error https://review.openstack.org/85039 | 07:13 |
| *** jepoy has quit IRC | 07:16 | |
| *** jepoy has joined #openstack-infra | 07:17 | |
| *** jepoy has quit IRC | 07:18 | |
| *** jepoy_ has joined #openstack-infra | 07:20 | |
| *** VijayTripathi has joined #openstack-infra | 07:21 | |
| openstackgerrit | Marc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: Accept file objects as well as filenames https://review.openstack.org/84942 | 07:22 |
| *** jepoy has joined #openstack-infra | 07:22 | |
| *** chandankumar_ has quit IRC | 07:23 | |
| *** yamahata has joined #openstack-infra | 07:24 | |
| *** jepoy_ has quit IRC | 07:24 | |
| *** alff has quit IRC | 07:34 | |
| *** alff_ has quit IRC | 07:34 | |
| openstackgerrit | Marc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: jenkins-job-builder: Allow read/write stdin/stdout https://review.openstack.org/84778 | 07:35 |
| *** jgallard has joined #openstack-infra | 07:38 | |
| openstackgerrit | Marc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: jenkins-job-builder: Allow read/write stdin/stdout https://review.openstack.org/84778 | 07:51 |
| openstackgerrit | lifeless proposed a change to openstack-infra/reviewstats: Add os-cloud-config. https://review.openstack.org/85260 | 07:52 |
| openstackgerrit | lifeless proposed a change to openstack-infra/reviewstats: Add tripleo-ui to horizon program. https://review.openstack.org/85261 | 07:52 |
| lifeless | russellb: ^ FYI | 07:52 |
| *** zhiyan_ is now known as zhiyan | 07:56 | |
| *** matrohon has quit IRC | 08:00 | |
| *** jpich has joined #openstack-infra | 08:00 | |
| *** e0ne_ has quit IRC | 08:01 | |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added parallelization options https://review.openstack.org/75514 | 08:02 |
| *** e0ne has joined #openstack-infra | 08:02 | |
| *** matrohon has joined #openstack-infra | 08:02 | |
| *** matsuhashi has joined #openstack-infra | 08:04 | |
| *** skolekonov has joined #openstack-infra | 08:06 | |
| *** e0ne has quit IRC | 08:06 | |
| *** derekh has joined #openstack-infra | 08:10 | |
| *** hashar has joined #openstack-infra | 08:18 | |
| *** hashar_ has joined #openstack-infra | 08:21 | |
| *** VijayTripathi has quit IRC | 08:24 | |
| *** hashar has quit IRC | 08:24 | |
| *** Ryan_Lane has quit IRC | 08:26 | |
| *** VijayTripathi has joined #openstack-infra | 08:26 | |
| *** pblaho has joined #openstack-infra | 08:29 | |
| openstackgerrit | David Caro proposed a change to openstack-infra/jenkins-job-builder: Added parallelization options https://review.openstack.org/75514 | 08:33 |
| *** wchrisj has quit IRC | 08:33 | |
| *** wchrisj has joined #openstack-infra | 08:33 | |
| *** imcsk8_lap has quit IRC | 08:34 | |
| *** imcsk8_lap has joined #openstack-infra | 08:34 | |
| *** matsuhashi has quit IRC | 08:35 | |
| *** fbo_away is now known as fbo | 08:40 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: add retry-count in general.py https://review.openstack.org/83583 | 08:47 |
| *** matrohon has quit IRC | 08:50 | |
| *** matrohon has joined #openstack-infra | 08:51 | |
| *** matsuhashi has joined #openstack-infra | 08:53 | |
| *** Ryan_Lane has joined #openstack-infra | 08:58 | |
| *** jp_at_hp has joined #openstack-infra | 09:01 | |
| *** ominakov has joined #openstack-infra | 09:06 | |
| *** Ryan_Lane has quit IRC | 09:06 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Add support for Slave Utilization plugin https://review.openstack.org/82693 | 09:07 |
| *** matrohon has quit IRC | 09:07 | |
| *** e0ne has joined #openstack-infra | 09:08 | |
| hashar_ | I am still amazed by the numbers of folks contributing to JJB | 09:17 |
| *** hashar_ is now known as hashar | 09:17 | |
| *** ociuhandu has quit IRC | 09:24 | |
| *** miarmak has quit IRC | 09:26 | |
| *** miarmak has joined #openstack-infra | 09:31 | |
| *** Ryan_Lane has joined #openstack-infra | 09:33 | |
| *** mihgen has joined #openstack-infra | 09:34 | |
| *** achuprin_ has joined #openstack-infra | 09:35 | |
| *** Ryan_Lane has quit IRC | 09:37 | |
| *** dizquierdo has joined #openstack-infra | 09:38 | |
| *** e0ne_ has joined #openstack-infra | 09:41 | |
| *** VijayTripathi has quit IRC | 09:43 | |
| *** e0ne has quit IRC | 09:45 | |
| *** matsuhashi has quit IRC | 09:47 | |
| *** matsuhashi has joined #openstack-infra | 09:47 | |
| *** ociuhandu has joined #openstack-infra | 09:48 | |
| openstackgerrit | Sean Dague proposed a change to openstack/requirements: allow for NON_STANDARD_REQS override https://review.openstack.org/85167 | 09:50 |
| *** saju_m has quit IRC | 09:56 | |
| *** jamespage_ has joined #openstack-infra | 09:58 | |
| *** wenlock has joined #openstack-infra | 10:00 | |
| *** esker has quit IRC | 10:03 | |
| *** wenlock has quit IRC | 10:04 | |
| *** _nadya_ has joined #openstack-infra | 10:05 | |
| *** jamespage_ has quit IRC | 10:06 | |
| *** esker has joined #openstack-infra | 10:06 | |
| *** _nadya_ has quit IRC | 10:09 | |
| *** saju_m has joined #openstack-infra | 10:09 | |
| *** xchu_ has quit IRC | 10:11 | |
| *** e0ne_ has quit IRC | 10:12 | |
| *** jgallard has quit IRC | 10:12 | |
| *** e0ne has joined #openstack-infra | 10:12 | |
| *** saju_m has quit IRC | 10:14 | |
| *** mihgen has quit IRC | 10:16 | |
| *** e0ne has quit IRC | 10:17 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: support the new devstack image finder https://review.openstack.org/85293 | 10:17 |
| *** matsuhashi has quit IRC | 10:23 | |
| *** saju_m has joined #openstack-infra | 10:30 | |
| *** matsuhashi has joined #openstack-infra | 10:30 | |
| ttx | sdague: we have Swift RC1 now so we can cut the requirements milestone-proposed branch | 10:31 |
| ttx | might make sense to accept https://review.openstack.org/#/c/85058/ first | 10:32 |
| ttx | and maybe https://review.openstack.org/#/c/84245/ | 10:32 |
| sdague | ttx: are we sure that all works correctly on testing? | 10:32 |
| ttx | sdague: you mean the milestone-proposed branch of requirements being used with other milestone-propsoed branch testing ? | 10:33 |
| sdague | yes | 10:33 |
| *** nosnos has quit IRC | 10:33 | |
| ttx | sdague: jeblair said it SHOULD work | 10:33 |
| ttx | if not, now is probably as god as a time as any to break it anyway | 10:33 |
| ttx | good* | 10:33 |
| *** Ryan_Lane has joined #openstack-infra | 10:34 | |
| sdague | sure | 10:34 |
| ttx | sdague: I think the most likely fail would be that the MP branches still get tested with master requirements | 10:34 |
| *** saju_m has quit IRC | 10:35 | |
| *** e0ne has joined #openstack-infra | 10:35 | |
| sdague | do we know which package triggered this - https://review.openstack.org/#/c/84245/1 ? | 10:35 |
| sdague | I approved 85058 | 10:35 |
| sdague | removing things is good | 10:35 |
| ttx | no, it's a bit unclear which packaged caused 84245 | 10:35 |
| *** saju_m has joined #openstack-infra | 10:35 | |
| sdague | I'd like an explanation before we work around it | 10:35 |
| ttx | maybe we can leave it out to discuss with doug, and backport it to MP if REALLY needed | 10:36 |
| ttx | no bug linked & explanation a bit short | 10:36 |
| sdague | yeh | 10:36 |
| *** e0ne_ has joined #openstack-infra | 10:37 | |
| sdague | I'm starting to really get on people that they need to explain the "why" and be specific in a commit message | 10:37 |
| *** Ryan_Lane has quit IRC | 10:38 | |
| *** matsuhashi has quit IRC | 10:38 | |
| ttx | hrm, so keystone removed pam from its requirements, but after the RC1 cut | 10:38 |
| ttx | we probably need to backport that one in MP | 10:38 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: fix the literalinclude reference to least-load test https://review.openstack.org/83510 | 10:39 |
| *** chandankumar_ has joined #openstack-infra | 10:39 | |
| *** nosnos has joined #openstack-infra | 10:39 | |
| *** e0ne has quit IRC | 10:40 | |
| *** saju_m has quit IRC | 10:40 | |
| *** saju_m has joined #openstack-infra | 10:40 | |
| ttx | sdague: I'll just cut milestone-proposed from the current commit, and we can backport the pam removal if we sort it out in keystone mp | 10:41 |
| *** matsuhas_ has joined #openstack-infra | 10:41 | |
| openstackgerrit | Victor Boivie proposed a change to openstack-infra/jenkins-job-builder: Support for matrix axis as a space-delimited string https://review.openstack.org/84733 | 10:41 |
| *** rlandy has joined #openstack-infra | 10:42 | |
| ttx | sdague: OK, branch cut. Let's see if I broke things. | 10:43 |
| *** andreykurilin_ has joined #openstack-infra | 10:43 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/devstack-gate: allow for generic branch overrides https://review.openstack.org/84829 | 10:44 |
| *** achuprin_ has quit IRC | 10:46 | |
| *** mrmartin has joined #openstack-infra | 10:47 | |
| andreykurilin_ | sdague, hi! | 10:48 |
| *** jamielennox is now known as jamielennox|away | 10:49 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: use {obj:key} as a way to pass an object and not only strings to templates https://review.openstack.org/73990 | 10:51 |
| *** matsuhas_ has quit IRC | 10:52 | |
| *** matsuhashi has joined #openstack-infra | 10:52 | |
| *** rlandy has quit IRC | 10:52 | |
| sdague | andreykurilin_: hey | 10:53 |
| andreykurilin_ | sdague, I'd like to discuss my change:) https://review.openstack.org/#/c/83903/ | 10:54 |
| *** chandankumar_ has quit IRC | 10:55 | |
| sdague | sure, let me get another cup of coffee, back in 2 minutes | 10:55 |
| *** matsuhashi has quit IRC | 10:57 | |
| ttx | sdague, fungi, jeblair: so we actually have an issue -- which is that no requirements updates are ever proposed to milestone-proposed. | 10:57 |
| ttx | none are tried until we create the MP branch, and when the MP branch is created, git review -t openstack/requirements milestone-proposed fails with "ambiguous argument 'milestone-proposed': unknown revision or path not in the working tree" | 10:57 |
| ttx | See https://jenkins.openstack.org/job/propose-requirements-updates/153/console | 10:57 |
| *** esker has quit IRC | 10:57 | |
| *** esker has joined #openstack-infra | 10:58 | |
| ttx | Creating a bug to track this | 10:59 |
| *** hashar has quit IRC | 10:59 | |
| openstackgerrit | Victor Boivie proposed a change to openstack-infra/jenkins-job-builder: triggered-builds: Support property file injection https://review.openstack.org/84734 | 11:00 |
| *** ominakov has quit IRC | 11:00 | |
| ttx | https://bugs.launchpad.net/openstack-ci/+bug/1302490 | 11:02 |
| uvirtbot | Launchpad bug 1302490 in openstack-ci "Requirements fail to be synced in milestone-proposed" [Undecided,New] | 11:02 |
| *** ominakov has joined #openstack-infra | 11:03 | |
| *** esker has quit IRC | 11:03 | |
| sdague | andreykurilin_: back | 11:03 |
| andreykurilin_ | sdague, commit-message of patch was changed with information about necessity of this patch. so, could you reexamine it? | 11:03 |
| *** mihgen has joined #openstack-infra | 11:03 | |
| sdague | andreykurilin_: here's the issue that I see there | 11:04 |
| sdague | junit xml isn't a well defined thing, there is litterally no spec | 11:04 |
| sdague | one of the reasons we moved to testr was to get the subunit stream | 11:05 |
| *** e0ne_ has quit IRC | 11:05 | |
| sdague | which is a lot of really good info | 11:05 |
| sdague | so while I realize parsing subunit is a bit harder, we should really focus on that | 11:05 |
| *** e0ne has joined #openstack-infra | 11:05 | |
| sdague | because you'll completely lose things like which process tempest tests are running on if you are filtering through junit | 11:06 |
| *** yolanda has quit IRC | 11:06 | |
| sdague | which I think is probably important to understand some of the variance in your analysis | 11:06 |
| *** e0ne has quit IRC | 11:10 | |
| *** chandankumar_ has joined #openstack-infra | 11:13 | |
| andreykurilin_ | sdague, i want to use this filter for recording final tests results and this process does not affect subunit stream | 11:15 |
| sdague | andreykurilin_: sure, but why not build the tooling against subunit directly | 11:18 |
| sdague | the junitxml is basically just for feeding things like jenkins, which don't understand anything else | 11:18 |
| andreykurilin_ | sdague, parsing xml is much easier than parsing subunit stream:) | 11:20 |
| andreykurilin_ | imo | 11:20 |
| sdague | andreykurilin_: in python? | 11:21 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/devstack-gate: localize variables https://review.openstack.org/85309 | 11:21 |
| *** mwagner_lap has quit IRC | 11:22 | |
| sdague | andreykurilin_: honestly, I remain -2 on. There is no reason rally needs to comply with g-r, but I don't think junitxml should be in g-r for the project | 11:22 |
| sdague | and I really think subunit python tooling is much more beneficial to the project as a whole | 11:22 |
| andreykurilin_ | sdague, thanks anyway | 11:23 |
| *** nosnos has quit IRC | 11:30 | |
| *** timrc-afk is now known as timrc | 11:34 | |
| *** yolanda has joined #openstack-infra | 11:34 | |
| *** Ryan_Lane has joined #openstack-infra | 11:34 | |
| *** yamahata has quit IRC | 11:36 | |
| openstackgerrit | Victor Boivie proposed a change to openstack-infra/jenkins-job-builder: Job name override - used when storing https://review.openstack.org/84736 | 11:36 |
| *** saju_m has quit IRC | 11:38 | |
| *** Ryan_Lane has quit IRC | 11:39 | |
| *** ominakov has quit IRC | 11:42 | |
| *** ominakov has joined #openstack-infra | 11:45 | |
| openstackgerrit | A change was merged to openstack/requirements: Remove pam https://review.openstack.org/85058 | 11:47 |
| *** ominakov has quit IRC | 11:49 | |
| *** matrohon has joined #openstack-infra | 11:51 | |
| *** ominakov has joined #openstack-infra | 11:52 | |
| *** e0ne has joined #openstack-infra | 11:52 | |
| *** david-lyle has quit IRC | 11:54 | |
| *** e0ne_ has joined #openstack-infra | 11:54 | |
| *** ihrachys has quit IRC | 11:55 | |
| *** e0ne has quit IRC | 11:57 | |
| *** e0ne_ has quit IRC | 11:59 | |
| *** mwagner_lap has joined #openstack-infra | 12:03 | |
| *** saju_m has joined #openstack-infra | 12:10 | |
| *** pdmars has joined #openstack-infra | 12:10 | |
| dolphm | is there an easy way to download all the logs for a jenkins run? (and extract them) | 12:13 |
| *** jlibosva is now known as jlibosva|afk | 12:14 | |
| *** saju_m has quit IRC | 12:14 | |
| *** saju_m has joined #openstack-infra | 12:15 | |
| openstackgerrit | Akihiro Motoki proposed a change to openstack-infra/config: Use tox "docs" env if exists for docs build job https://review.openstack.org/85324 | 12:16 |
| *** dprince has joined #openstack-infra | 12:19 | |
| openstackgerrit | A change was merged to openstack-infra/config: Remove py3 gate job from kite https://review.openstack.org/84372 | 12:20 |
| *** jgallard has joined #openstack-infra | 12:21 | |
| *** maxbit has joined #openstack-infra | 12:22 | |
| sdague | dolphm: you'd just have to do a wget --mirror or the like | 12:22 |
| sdague | dolphm: what are you trying to do? And is it doable with logstash instead? | 12:23 |
| dolphm | sdague: wget works for me - i just want to browse the logs locally because i can't find what went wrong in this run :) | 12:23 |
| sdague | dolphm: sure | 12:24 |
| *** hashar has joined #openstack-infra | 12:24 | |
| *** alaski has quit IRC | 12:24 | |
| sdague | one of the upsides of the log server is the ability to quickly filter down to certain levels | 12:24 |
| *** weshay has joined #openstack-infra | 12:26 | |
| *** dcramer_ has quit IRC | 12:28 | |
| fungi | perhaps in our new swift-based log utopia the frontend can intercept calls for dirname.tar.gz and feed you a tarball | 12:29 |
| ttx | fungi: please see https://bugs.launchpad.net/openstack-ci/+bug/1302490 when you're fully awake | 12:30 |
| uvirtbot | Launchpad bug 1302490 in neutron "Requirements fail to be synced in milestone-proposed" [Medium,New] | 12:30 |
| ttx | we'll need it fixed to get the latest requirements sync in for RC2s | 12:30 |
| fungi | ttx: yep, saw that in scrollback. i'll start poking at it when i'm finished generating the electorate rolls for anteaya | 12:30 |
| *** dstanek has joined #openstack-infra | 12:31 | |
| fungi | ttx: in summary, the logic for the proposal job is that when you merge a change to the reqs repo, it proposes an update to all listed projects which have the same branch name as the change you merged... so the fact that it didn't try until reqs cit an m-p branch makes some sense (and we'd want to define alternative behavior if that needs to change). as to why it broke once you did, i'll have to dig | 12:32 |
| fungi | deeper | 12:32 |
| *** alaski has joined #openstack-infra | 12:32 | |
| ttx | yes, I understand that the first part is working as intended | 12:32 |
| ttx | it just creates a gap that we have to close at RC2 | 12:33 |
| *** mbacchi has joined #openstack-infra | 12:33 | |
| sdague | fungi: we could do that today actually | 12:33 |
| fungi | i'm open to the idea that while it's working as originally intended, it's not working as actually needed and we need to special-case m-p due to the nature of our release process | 12:33 |
| *** ominakov has quit IRC | 12:33 | |
| sdague | ttx: is there a reason we don't just call it stable/foo ? | 12:34 |
| sdague | from the beginning? | 12:34 |
| fungi | the only argument i ever heard was that it might confuse people into thinking we'd already released | 12:34 |
| ttx | fungi: yes, the nature of the tarballs created is the main reason | 12:34 |
| ttx | BUT | 12:34 |
| ttx | the key reason is that you have different approval groups for stable/* and mp | 12:35 |
| fungi | though also... yes that | 12:35 |
| fungi | the acls | 12:35 |
| ttx | mp is release team, stable is stable-maint | 12:35 |
| *** e0ne has joined #openstack-infra | 12:35 | |
| *** Ryan_Lane has joined #openstack-infra | 12:35 | |
| fungi | different parties have control over m-p vs stable branches | 12:35 |
| ttx | so the rename serves as a hands-off | 12:35 |
| *** skraynev is now known as skraynev_afk | 12:35 | |
| fungi | though really, those latter bits are process developed around the branch renaming itself... if we brainstormed we might come up with an alternate means to solve that same issue | 12:36 |
| fungi | though again, probably easier to just stick with them for now | 12:36 |
| sdague | there is however an upgrade exposure | 12:37 |
| sdague | because mp basically is bypassing grenade entirely | 12:37 |
| sdague | which is less important now that we don't have the forward jobs | 12:38 |
| sdague | but is a very weird hole | 12:38 |
| sdague | and means we basically can't start porting upgrade testing until well after the release | 12:39 |
| *** ominakov has joined #openstack-infra | 12:39 | |
| *** amotoki has joined #openstack-infra | 12:39 | |
| *** Ryan_Lane has quit IRC | 12:39 | |
| sdague | so for Juno I'd really like to revisit mp branches, because I could be working on stable/icehouse support in grenade right now if we didn't do mp | 12:39 |
| sdague | which would mean we'd have a chance for upgrade testing working at release day | 12:40 |
| *** rfolco has joined #openstack-infra | 12:40 | |
| fungi | well, this goes back to the earlier discussion about using proposed/icehouse instead of milestone-proposed, and having the tooling treat "proposed/" and "stable/" the same from a testing standpoint | 12:41 |
| fungi | the big hiccup i see with upgrade testing is during the window where some projects have a proposed branch and some don't yet | 12:42 |
| fungi | in which case i guess the simplest solution is to test an upgrade from stable to mixed proposed+master, and an upgrade from mixed proposed+master to pure master | 12:43 |
| *** VijayTripathi has joined #openstack-infra | 12:44 | |
| sdague | sure, but if we went to stable sooner, we'd close that window | 12:44 |
| sdague | I'm -1 on putting proposed logic into grenade | 12:45 |
| fungi | but more fluidity in testing is the main reason i was in favor of proposed/icehouse instead of reusing milestone-proposed (even though i know the main reason it was brought up was that some people didn't like having to delete local copies of m-p branches from the previous cycle) | 12:45 |
| *** jlibosva|afk is now known as jlibosva | 12:45 | |
| sdague | because by definition it only exists 1 out of every 6 months | 12:45 |
| sdague | so I guaruntee it will rot out | 12:45 |
| sdague | and we'll be firedrilling every go around | 12:45 |
| sdague | vs the stable logic which is tested all the time | 12:45 |
| *** alexpilotti has joined #openstack-infra | 12:46 | |
| sdague | tarballs can be set by tags | 12:46 |
| sdague | I think the only issue is the review groups | 12:46 |
| sdague | but that feels like socially solvable | 12:46 |
| fungi | well, i think if it's coded to always look for (stable|proposed)/relname that might not be as likely to bitrot | 12:46 |
| sdague | it will rot | 12:46 |
| sdague | looking for, and running, are very different things :) | 12:47 |
| fungi | if we also tested upgrades from master to master, then perhaps not | 12:47 |
| sdague | look how stable/grizzly testing rotted | 12:47 |
| *** chandankumar_ has quit IRC | 12:47 | |
| sdague | sure | 12:47 |
| fungi | from a "is it working" perspective, the point at which the proposed branches deviate from master they should be identical to master in every respect | 12:48 |
| sdague | fungi: sure | 12:48 |
| fungi | it's the lag between that point and when we get back to doing upgrade testing on them again where the risk for rot lies | 12:48 |
| sdague | the issue is the tooling rotting | 12:49 |
| sdague | we refactor all the time | 12:49 |
| *** eharney has joined #openstack-infra | 12:49 | |
| sdague | so m-p gets cut | 12:49 |
| sdague | all the tests pass | 12:49 |
| sdague | and we don't realize we aren't actually using m-p | 12:49 |
| sdague | until 2 weeks later | 12:49 |
| *** flaper87|afk is now known as flaper87 | 12:49 | |
| *** signed8bit has joined #openstack-infra | 12:49 | |
| *** VijayTripathi has quit IRC | 12:51 | |
| fungi | if we were to go to matching on proposed and stable branch name prefixes and treating them the same, we might ought to bake in alpha order and just look for (proposed|stable)/(.).* and not have the tooling care about the actual full branch names there | 12:51 |
| fungi | though in 8 years that will bite us ;) | 12:52 |
| *** CaptTofu has joined #openstack-infra | 12:52 | |
| fungi | but it could cut down on release-time churn in the design of the tools which need to know what order the branches come in | 12:53 |
| fungi | however, i guess the bigger issue is tracking what projects were available/ready to be tested under which branches | 12:53 |
| *** ameade has joined #openstack-infra | 12:53 | |
| fungi | abstracting that metadata out would get more complicated | 12:53 |
| sdague | yeh, I think it's more complicated because of the things in d-g & grenade that have to change | 12:54 |
| sdague | however, got to run now, back on in a couple hours | 12:54 |
| *** julim has joined #openstack-infra | 12:55 | |
| *** thuc has joined #openstack-infra | 12:55 | |
| *** thuc_ has joined #openstack-infra | 12:56 | |
| *** sw_away is now known as sandywalsh | 12:57 | |
| *** saju_m has quit IRC | 12:57 | |
| *** mfer has joined #openstack-infra | 12:59 | |
| *** thuc has quit IRC | 13:00 | |
| *** julim has quit IRC | 13:03 | |
| *** alexpilotti_ has joined #openstack-infra | 13:03 | |
| *** julim has joined #openstack-infra | 13:05 | |
| *** alexpilotti has quit IRC | 13:06 | |
| *** alexpilotti_ has quit IRC | 13:06 | |
| *** andreykurilin_ has quit IRC | 13:06 | |
| *** CaptTofu has quit IRC | 13:07 | |
| *** mrmartin has quit IRC | 13:08 | |
| openstackgerrit | João Vale proposed a change to openstack-infra/jenkins-job-builder: Allow using template variables in "defaults" field. https://review.openstack.org/85336 | 13:09 |
| *** dizquierdo has quit IRC | 13:10 | |
| *** esker has joined #openstack-infra | 13:11 | |
| openstackgerrit | Dirk Mueller proposed a change to openstack/requirements: Raise oslo.messaging to 1.3.0 https://review.openstack.org/85337 | 13:11 |
| *** wchrisj is now known as wchrisj_ | 13:14 | |
| *** maxbit has quit IRC | 13:16 | |
| *** CaptTofu has joined #openstack-infra | 13:17 | |
| *** jeckersb_gone is now known as jeckersb | 13:20 | |
| *** krtaylor has joined #openstack-infra | 13:23 | |
| *** vhoward- has joined #openstack-infra | 13:26 | |
| *** e0ne_ has joined #openstack-infra | 13:26 | |
| *** rlandy has joined #openstack-infra | 13:26 | |
| *** e0ne has quit IRC | 13:29 | |
| *** dkliban has joined #openstack-infra | 13:31 | |
| *** ominakov has quit IRC | 13:31 | |
| *** mriedem has joined #openstack-infra | 13:31 | |
| *** ominakov has joined #openstack-infra | 13:32 | |
| *** freyes has joined #openstack-infra | 13:35 | |
| *** aconrad has joined #openstack-infra | 13:35 | |
| *** malini_afk is now known as malini | 13:38 | |
| *** thuc_ has quit IRC | 13:40 | |
| *** zz_gondoi is now known as gondoi | 13:41 | |
| *** thuc has joined #openstack-infra | 13:41 | |
| *** zns has joined #openstack-infra | 13:42 | |
| *** thuc has quit IRC | 13:45 | |
| *** thuc has joined #openstack-infra | 13:46 | |
| *** dcramer_ has joined #openstack-infra | 13:48 | |
| openstackgerrit | Thierry Carrez proposed a change to openstack-infra/config: Fix milestone-proposed requirements update https://review.openstack.org/85352 | 13:49 |
| ttx | fungi: that should fix the requirements update thing ^ | 13:49 |
| fungi | ttx: interesting! i wonder if this was also (or would have been) affecting stable branches | 13:50 |
| ttx | fungi: probably | 13:51 |
| ttx | the whole "detached HEAD" state for that branch was wrong anyway. It happened to work on master because master is always checked out, but any other branch would have failed imho | 13:52 |
| openstackgerrit | Marc Abramowitz proposed a change to openstack-infra/jenkins-job-builder: Small documentation tweaks https://review.openstack.org/84950 | 13:52 |
| ttx | fungi: -B makes sure it doesn't error out on the already-checked-out master | 13:52 |
| fungi | agreed, we don't really care about commits which aren't on a remote branch anyway, so we don't need a detached anything for this | 13:53 |
| *** prad has joined #openstack-infra | 13:54 | |
| *** gondoi is now known as zz_gondoi | 13:54 | |
| ttx | I'll watch the next requirements things to make sure they now work properly | 13:55 |
| *** zz_gondoi is now known as gondoi | 13:55 | |
| ttx | well, with the puppet propagation delay of course | 13:56 |
| openstackgerrit | A change was merged to openstack-infra/config: Fix milestone-proposed requirements update https://review.openstack.org/85352 | 13:56 |
| fungi | ttx: no need. once puppet gets ^ that onto the proposal slave, i'll re-trigger the previously failed job | 13:56 |
| ttx | fungi: sure, but want to check that I didn't bork master in the process of ficing mp :) | 13:57 |
| *** e0ne_ has quit IRC | 13:57 | |
| ttx | +x | 13:57 |
| fungi | oh, that too, yes ;) | 13:57 |
| *** e0ne has joined #openstack-infra | 13:57 | |
| *** maxbit has joined #openstack-infra | 13:58 | |
| *** zehicle_at_dell has quit IRC | 14:00 | |
| *** e0ne has quit IRC | 14:02 | |
| krotscheck | nibalizer: Storyboard hasn’t cut an official release yet. Maybe you can help us get that done? | 14:02 |
| *** skolekonov has quit IRC | 14:03 | |
| *** zns has quit IRC | 14:04 | |
| *** krotscheck has left #openstack-infra | 14:04 | |
| *** thuc has quit IRC | 14:04 | |
| *** thuc has joined #openstack-infra | 14:04 | |
| *** zns has joined #openstack-infra | 14:04 | |
| *** zns has quit IRC | 14:05 | |
| *** thuc has quit IRC | 14:08 | |
| *** andreykurilin_ has joined #openstack-infra | 14:09 | |
| ttx | fungi: it's on: http://puppetboard.openstack.org/report/proposal.slave.openstack.org/0bc41bd62c4762fb9f08e69f1c20b37b7a948eb4 | 14:10 |
| ttx | fungi: I have a requirements MP change lined up | 14:11 |
| ttx | fungi: maybe it's not necessary to trigger a run manually | 14:11 |
| *** dizquierdo has joined #openstack-infra | 14:12 | |
| *** derekh has quit IRC | 14:13 | |
| *** zns has joined #openstack-infra | 14:14 | |
| *** jgrimm has joined #openstack-infra | 14:15 | |
| fungi | ttx: okay, go for it in that case | 14:15 |
| *** alexpilotti has joined #openstack-infra | 14:15 | |
| ttx | sdague: could you sanity-check this requirements m-p backport: https://review.openstack.org/#/c/85363/ ? | 14:16 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/requirements: Work around atexit bug in python < 2.7.4 https://review.openstack.org/84245 | 14:17 |
| ttx | hmm, wait | 14:17 |
| ttx | sdague: hmm, wait, we should have https://review.openstack.org/#/c/85328/ in first | 14:17 |
| dhellmann | ttx, sdague : that change isn't needed for the milestone, but it's needed before syncing requirements into stevedore and cliff will work smoothly | 14:18 |
| dhellmann | ttx, sdague : re: 84245 | 14:18 |
| *** ameade has quit IRC | 14:18 | |
| ttx | dhellmann: ok | 14:18 |
| jeblair | fungi: i agree, the tooling to support stable==proposed should be minimal; i think that would work if we wanted to pursue it. though i would also be happy if they just started out as stable. we could also potentially do mass acl updates (ugh). | 14:19 |
| *** msabramo has quit IRC | 14:20 | |
| *** markmcclain has joined #openstack-infra | 14:21 | |
| fungi | jeblair: ttx: looking at http://git.openstack.org/cgit/openstack-infra/config/tree/tools/atc/email-stats.py#n49 it seems that we only ever generated electorate lists with all their gerrit e-mail addresses in a basically random order, and never looked at the preferred_email column from the accounts table at all? | 14:21 |
| *** rcleere has joined #openstack-infra | 14:22 | |
| fungi | emails.csv being a dump from the external_ids table and accounts.csv being a dump from the accounts table | 14:22 |
| ttx | fungi: wow, check tests really didn't like my innocent-looking https://review.openstack.org/#/c/85363/. Still in progress but it's painted red on zuul status | 14:23 |
| ttx | difficult to tell while until the logs are uploaded | 14:23 |
| jeblair | fungi: that sounds about right | 14:23 |
| *** homeless has joined #openstack-infra | 14:23 | |
| ttx | fungi: that's totally possible :) | 14:23 |
| fungi | jeblair: okay, working on fixing that real quick so i can regenerate the earlier list... anteaya, you haven't actually dumped the first batch into civs yet, right? | 14:24 |
| anteaya | no | 14:24 |
| anteaya | no dumping yet | 14:24 |
| jeblair | fungi: they should be a superset, so one should be more likely to reach them | 14:24 |
| fungi | okay, hold off and i'll have you another in ~30 minutes | 14:24 |
| anteaya | thank yo | 14:24 |
| anteaya | u | 14:24 |
| anteaya | standing by | 14:24 |
| * anteaya fixes another cup of tea | 14:24 | |
| fungi | jeblair: agreed, but the election notice asked atcs to make sure their preferred e-mail in gerrit was correct :/ | 14:25 |
| *** vhoward- has left #openstack-infra | 14:25 | |
| jeblair | fungi: i guess that works for summit invites but not for civs | 14:25 |
| *** sdake_ has quit IRC | 14:25 | |
| fungi | and civs bases votes off of each address individually, so we can't just dump all the addresses in there or some people get extra votes ;) | 14:25 |
| *** pcm_ has joined #openstack-infra | 14:26 | |
| pcm_ | sdague: ping | 14:26 |
| *** thedodd has joined #openstack-infra | 14:26 | |
| anteaya | no extra votes | 14:27 |
| *** nithya_g has quit IRC | 14:27 | |
| *** sdake_ has joined #openstack-infra | 14:27 | |
| *** saju_m has joined #openstack-infra | 14:31 | |
| *** krotscheck has joined #openstack-infra | 14:31 | |
| *** wenlock_ has joined #openstack-infra | 14:32 | |
| *** mihgen has quit IRC | 14:34 | |
| *** saju_m has quit IRC | 14:34 | |
| *** saju_m has joined #openstack-infra | 14:35 | |
| *** msabramo has joined #openstack-infra | 14:35 | |
| *** david-lyle has joined #openstack-infra | 14:38 | |
| *** hashar has quit IRC | 14:41 | |
| *** lcostantino has joined #openstack-infra | 14:41 | |
| *** hashar has joined #openstack-infra | 14:41 | |
| *** mkerrin has quit IRC | 14:42 | |
| therve | fungi, Hi, gentle reminder about https://review.openstack.org/#/c/83761/ | 14:42 |
| *** phschwartz has quit IRC | 14:44 | |
| *** phschwartz has joined #openstack-infra | 14:44 | |
| fungi | therve: gentle +2 on the patch, thanks for the reminder ;) | 14:45 |
| *** bnemec is now known as beekneemech | 14:45 | |
| therve | fungi, Thanks a lot! :) | 14:45 |
| therve | jeblair, If you have some time as well... | 14:45 |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Add os-cloud-config. https://review.openstack.org/85260 | 14:46 |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Add tripleo-ui to horizon program. https://review.openstack.org/85261 | 14:46 |
| *** gokrokve has joined #openstack-infra | 14:48 | |
| *** phschwartz has quit IRC | 14:52 | |
| *** phschwartz has joined #openstack-infra | 14:52 | |
| *** aconrad has quit IRC | 14:54 | |
| fungi | jogo: your missing requirements check barfs on removals to the requirements list... http://logs.openstack.org/63/85363/1/check/check-tempest-dsvm-full/5d5b4fb/logs/devstacklog.txt.gz | 14:55 |
| *** yamahata has joined #openstack-infra | 14:55 | |
| fungi | jogo: "'pam' is not a global requirement but it should be,something went wrong" on https://review.openstack.org/85363 which removes pam from the list of global requirements | 14:55 |
| fungi | jogo: oh, or not... looks like it was actually catching a removal of a requirement where we hadn't removed that requirement from all the projects being tested. nevermind! | 14:57 |
| fungi | and ttx and i raced on the recheck | 14:57 |
| fungi | ;) | 14:57 |
| ttx | fungi: was actually surprised that it caught it :) | 14:58 |
| fungi | pleasant surprise | 14:58 |
| *** matrohon has quit IRC | 14:59 | |
| *** akurilin_ has joined #openstack-infra | 14:59 | |
| *** andreykurilin_ has quit IRC | 15:01 | |
| *** thuc_ has joined #openstack-infra | 15:01 | |
| *** alff_ has joined #openstack-infra | 15:03 | |
| *** alff has joined #openstack-infra | 15:03 | |
| *** thuc_ has quit IRC | 15:03 | |
| *** thuc_ has joined #openstack-infra | 15:04 | |
| *** CaptTofu has quit IRC | 15:04 | |
| *** mgagne has quit IRC | 15:07 | |
| *** yolanda has quit IRC | 15:07 | |
| *** atiwari has joined #openstack-infra | 15:08 | |
| *** signed8bit has quit IRC | 15:08 | |
| *** signed8bit has joined #openstack-infra | 15:09 | |
| *** kashyap has joined #openstack-infra | 15:09 | |
| *** pcrews_ has joined #openstack-infra | 15:09 | |
| *** kashyap has quit IRC | 15:09 | |
| *** kashyap has joined #openstack-infra | 15:09 | |
| *** signed8bit has quit IRC | 15:10 | |
| *** signed8bit has joined #openstack-infra | 15:10 | |
| *** jlibosva has quit IRC | 15:18 | |
| *** hashar has quit IRC | 15:19 | |
| *** ameade has joined #openstack-infra | 15:19 | |
| *** german has joined #openstack-infra | 15:19 | |
| openstackgerrit | João Vale proposed a change to openstack-infra/jenkins-job-builder: Support variable-specific substitutions in templates. https://review.openstack.org/85383 | 15:20 |
| *** signed8bit has quit IRC | 15:21 | |
| *** signed8bit has joined #openstack-infra | 15:22 | |
| *** hogepodge has joined #openstack-infra | 15:23 | |
| *** ameade has quit IRC | 15:23 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Make ATC lists sort E-mails with preferred first https://review.openstack.org/85385 | 15:24 |
| *** ilives has quit IRC | 15:25 | |
| *** mgagne has joined #openstack-infra | 15:28 | |
| *** mgagne1 has joined #openstack-infra | 15:31 | |
| *** mgagne has quit IRC | 15:33 | |
| ttx | fungi, jeblair, clarkb: had a question for you re: translations updates | 15:34 |
| ttx | fungi, jeblair, clarkb: is there any convenient way to trigger them to refresh milestone-proposed branches ? | 15:35 |
| *** saju_m has quit IRC | 15:35 | |
| ttx | or that just doesn't make any sense since the translations strings are imported from master and are now potentially branched | 15:35 |
| *** msabramo has quit IRC | 15:36 | |
| fungi | ttx: i think the latter. right now those updates are configured to *only* fire for changes to master, and propose only to master branches | 15:37 |
| fungi | and the translators work only on master | 15:37 |
| ttx | ok so translations are basically over at RC1 | 15:37 |
| fungi | so merging master proposals to m-p are potentially hairy | 15:37 |
| *** thuc_ has quit IRC | 15:38 | |
| fungi | if we froze teh translation update jobs when m-p appeared for each project, and at the same time started proposing updates to both m-p and master on those same projects, then that would probably work around it | 15:38 |
| fungi | but a strict string freeze would almost certainly be necessary on master between rc and release to make that viable | 15:39 |
| fungi | otherwise the updates proposed to master would quickly cease to be applicable | 15:39 |
| fungi | or perhaps we stop proposing updates to master while an m-p branch exists (make that symmetric) | 15:39 |
| fungi | so basically if the project has a milestone-proposed branch, the upstream update and proposal jobs use that, otherwise use master | 15:40 |
| fungi | that might work, but clarkb will likely tell me i'm on crack | 15:41 |
| fungi | that would at least preserve continuity for translators up to the release, at the expense of translation lag on master during the rc period and a larger delta come release day | 15:42 |
| fungi | but maybe that's not so bad a trade-off? | 15:43 |
| *** hogepodge has quit IRC | 15:46 | |
| *** mdenny has quit IRC | 15:47 | |
| *** hogepodge has joined #openstack-infra | 15:47 | |
| *** mdenny has joined #openstack-infra | 15:47 | |
| *** msabramo has joined #openstack-infra | 15:47 | |
| *** msabramo has quit IRC | 15:48 | |
| *** msabramo has joined #openstack-infra | 15:48 | |
| *** markmcclain has quit IRC | 15:48 | |
| *** aconrad has joined #openstack-infra | 15:49 | |
| *** atiwari has quit IRC | 15:54 | |
| *** pblaho has quit IRC | 15:58 | |
| zaro | morning | 16:00 |
| *** zns has quit IRC | 16:02 | |
| *** mdenny has quit IRC | 16:03 | |
| anteaya | morning zaro | 16:05 |
| anteaya | go: http://lists.openstack.org/pipermail/openstack-dev/2014-April/031919.html | 16:06 |
| *** comstud is now known as bearhands | 16:06 | |
| *** russellb is now known as rustlebee | 16:06 | |
| *** dansmith is now known as damnsmith | 16:06 | |
| *** gokrokve has quit IRC | 16:06 | |
| *** zns has joined #openstack-infra | 16:07 | |
| *** atiwari has joined #openstack-infra | 16:11 | |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Update solum core-team https://review.openstack.org/84939 | 16:11 |
| *** e0ne has joined #openstack-infra | 16:12 | |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Add oslo.messaging project https://review.openstack.org/84641 | 16:13 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Make ATC lists sort E-mails with preferred first https://review.openstack.org/85385 | 16:14 |
| fungi | making code safely importable has the side benefit that it's more accessible to static analysis | 16:14 |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Add the ironic-python-agent project https://review.openstack.org/84773 | 16:15 |
| *** YorikSar has quit IRC | 16:15 | |
| *** thuc has joined #openstack-infra | 16:16 | |
| *** e0ne has quit IRC | 16:17 | |
| *** thuc_ has joined #openstack-infra | 16:17 | |
| *** thuc_ has quit IRC | 16:17 | |
| fungi | dhellmann: are you on board with https://review.openstack.org/85162 ? if so, we can get the acl change applied today when we're adding new projects | 16:18 |
| dhellmann | fungi: should there be a separate milestone group, too? | 16:18 |
| fungi | dhellmann: up to you, mr ptl | 16:18 |
| *** thuc_ has joined #openstack-infra | 16:18 | |
| dhellmann | heh | 16:18 |
| dhellmann | let's say no, for now, and go with what markmc put together | 16:18 |
| *** jpich has quit IRC | 16:18 | |
| *** thuc_ has quit IRC | 16:19 | |
| *** ameade has joined #openstack-infra | 16:19 | |
| *** alff_ has quit IRC | 16:19 | |
| *** alff has quit IRC | 16:19 | |
| *** thuc_ has joined #openstack-infra | 16:19 | |
| *** thuc has quit IRC | 16:20 | |
| ttx | fungi: https://review.openstack.org/#/c/85363/ now in gate queue, when it lands it should trigger the requirements updates on milestone-proposed. I'll probably be gone when it does | 16:21 |
| ttx | fungi: if the post-requirements job fails, could you capture the log for me ? Not sure how we can retrieve those once they expire from jenkins | 16:21 |
| *** mdenny has joined #openstack-infra | 16:22 | |
| openstackgerrit | A change was merged to openstack-infra/config: New gerrit group - oslo-messaging-core https://review.openstack.org/85162 | 16:23 |
| *** ameade has quit IRC | 16:23 | |
| *** aconrad has quit IRC | 16:23 | |
| *** marun has quit IRC | 16:23 | |
| fungi | ttx: i can show you where they end up | 16:23 |
| fungi | ttx: http://logs.openstack.org/<first two chars of sha>/<full sha> | 16:24 |
| *** akurilin_ has quit IRC | 16:24 | |
| fungi | where the sha is for the corresponding merge commit which landed in the repo | 16:25 |
| fungi | below there they're sorted by pipeline, job name, id... | 16:25 |
| dhellmann | fungi, ttx: https://pypi.python.org/pypi/git-os-job | 16:25 |
| fungi | or use that neat utility dhellmann wrote which i keep forgetting exists ;) | 16:26 |
| ttx | hah! cool. thanks | 16:26 |
| dhellmann | :-) | 16:26 |
| fungi | ttx: but i'll also make a note to check in on it in a while | 16:26 |
| *** UtahDave has joined #openstack-infra | 16:29 | |
| *** markmc has quit IRC | 16:31 | |
| *** jp_at_hp1 has joined #openstack-infra | 16:31 | |
| *** alff has joined #openstack-infra | 16:31 | |
| *** alff_ has joined #openstack-infra | 16:31 | |
| *** medieval1 has quit IRC | 16:33 | |
| *** medieval1 has joined #openstack-infra | 16:33 | |
| *** jp_at_hp has quit IRC | 16:33 | |
| pleia2 | good morning | 16:34 |
| anteaya | morning pleia2 | 16:34 |
| msabramo | clarkb: can you please rereview https://review.openstack.org/84950 when you get a chance? | 16:36 |
| *** talluri has quit IRC | 16:37 | |
| openstackgerrit | João Vale proposed a change to openstack-infra/jenkins-job-builder: Support variable-specific substitutions in templates. https://review.openstack.org/85383 | 16:38 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Gerrit-2.8: Add secondary index support https://review.openstack.org/60080 | 16:39 |
| *** gondoi is now known as zz_gondoi | 16:39 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Gerrit-2.8: Add secondary index support https://review.openstack.org/60080 | 16:39 |
| *** bhuvan has joined #openstack-infra | 16:39 | |
| *** chandankumar_ has joined #openstack-infra | 16:42 | |
| *** nicedice has joined #openstack-infra | 16:44 | |
| *** jgallard has quit IRC | 16:46 | |
| *** jogo is now known as flashgordon | 16:46 | |
| flashgordon | fungi: glad to see it works | 16:47 |
| fungi | flashgordon: yes, i was surprised to see someone propose a global req removal before it was actually no longer in use. pretty awesome | 16:49 |
| fungi | though in this case i think the m-p backports merely happened in the wrong order | 16:49 |
| *** mkoderer has quit IRC | 16:51 | |
| *** ominakov has quit IRC | 16:54 | |
| flashgordon | it looks like I get to vote in all 6 elections | 16:54 |
| *** markmcclain has joined #openstack-infra | 16:55 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Gerrit-2.8: Add secondary index support https://review.openstack.org/60080 | 16:55 |
| *** markwash has joined #openstack-infra | 16:55 | |
| pleia2 | http://lopsa-east.org/2014/keynote-speakers/ I'm in good company \o/ | 16:56 |
| pleia2 | we already took over open source conferences, about time we took over operations ones :) | 16:56 |
| pleia2 | (openstack, that is) | 16:56 |
| fungi | we are a conference-eating machine | 16:57 |
| *** markmcclain1 has joined #openstack-infra | 16:57 | |
| *** JoshNang has joined #openstack-infra | 16:58 | |
| *** markmcclain has quit IRC | 16:59 | |
| *** aconrad has joined #openstack-infra | 17:00 | |
| *** gokrokve has joined #openstack-infra | 17:00 | |
| *** ildikov_ has quit IRC | 17:01 | |
| *** markmcclain1 has quit IRC | 17:01 | |
| JoshNang | hey all, i have a pep8 check that is failing saying i'm reimporting mock, but neither of the lines it mentions are importing mock. tests are passing locally. any ideas? https://review.openstack.org/#/c/84303/ | 17:02 |
| *** mihgen has joined #openstack-infra | 17:03 | |
| *** harlowja has joined #openstack-infra | 17:04 | |
| fungi | JoshNang: when was the last time you rebased your change? what flake8 is actually testing is the state of your proposed change merged to the master branch... | 17:04 |
| *** signed8b_ has joined #openstack-infra | 17:04 | |
| fungi | so someone else may have already merged a change to master which imports mock in that file | 17:04 |
| fungi | JoshNang: http://git.openstack.org/cgit/openstack/ironic-python-agent/tree/ironic_python_agent/tests/ironic_api_client.py#n20 | 17:05 |
| JoshNang | fungi: i don't think I have yet. I'll try that. thanks! | 17:05 |
| fungi | yep, that's what's happened | 17:05 |
| JoshNang | ahh! you rock! thanks! | 17:05 |
| fungi | no problem | 17:05 |
| clarkb | morning | 17:06 |
| clarkb | ttx: fungi you can push them manually if you need fixes | 17:06 |
| *** maxbit has quit IRC | 17:06 | |
| *** signed8bit has quit IRC | 17:06 | |
| clarkb | ttx: fungi the automation won't interfere with translation updates like that | 17:06 |
| *** SumitNaiksatam has quit IRC | 17:06 | |
| fungi | clarkb: more just wondering what "the right way" is there, and whether we can make things seamless for the translators up to release time (the project drivers still get final say on whether the proposed updates make it into the rc/release anyway) | 17:07 |
| *** ArxCruz has joined #openstack-infra | 17:07 | |
| clarkb | fungi: we could make the scripts update only milestone proposed if it exists | 17:08 |
| clarkb | fungi: but that gets hairy for swift maybe since they do inter cycle mp branche | 17:08 |
| clarkb | s | 17:08 |
| fungi | clarkb: yeah, that's where my thought experiment finally took me | 17:08 |
| *** _nadya_ has joined #openstack-infra | 17:08 | |
| fungi | though i don't know that it gets hairy for swift, it just happens at a different time/frequency | 17:08 |
| nibalizer | krotscheck: can probably help at least a bit | 17:08 |
| nibalizer | im probably the first user of the software that isn't trying to actively develop it | 17:09 |
| fungi | more that it gets hairy if someone forgets to delete the m-p branch ;) | 17:09 |
| *** chandankumar_ has quit IRC | 17:09 | |
| nibalizer | i'm trying to build a conversion script from lp -> storyboard so naturally spinning up a local storyboard was a requirement | 17:09 |
| clarkb | fungi: that | 17:09 |
| nibalizer | and yea, watch out for some docs commits and such as the docs weren't overly illuminating | 17:09 |
| krotscheck | nibalizer: Thanks - I’d be more than happy to contribute to those. | 17:10 |
| *** talluri has joined #openstack-infra | 17:10 | |
| *** _nadya_ has quit IRC | 17:10 | |
| krotscheck | nibalizer: I’ve also got a doc commit I really should go fix... | 17:10 |
| *** miarmak has quit IRC | 17:10 | |
| nibalizer | krotscheck: for sure | 17:11 |
| krotscheck | nibalizer: Actually, if you could do me a favor and give us a few pointers on how we can make the install as stupidly easy as possible, that’d be awesome :) | 17:11 |
| nibalizer | thats my plan | 17:12 |
| nibalizer | i dont want to make changes to your doc until i've actually got it running | 17:12 |
| nibalizer | but then yea i'll submit changes to imporve the doucmentation | 17:12 |
| krotscheck | nibalizer: There’s a puppet manifest in infra/config that does an install. | 17:12 |
| nibalizer | got bit by the tox {posargs} bug last night | 17:12 |
| krotscheck | nibalizer: DOH | 17:12 |
| nibalizer | krotscheck: yea i saw that, decided to try manually first | 17:12 |
| nibalizer | also didn't want to go through the trouble of generating ssl keys and such | 17:13 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Activate secondary index support for Gerrit https://review.openstack.org/79005 | 17:13 |
| fungi | nibalizer is such a puppet-hater ;) | 17:13 |
| nibalizer | well you can try to puppet something you don't understand if you want to | 17:13 |
| nibalizer | but you won't get that time back | 17:14 |
| nibalizer | its just gone | 17:14 |
| *** _nadya_ has joined #openstack-infra | 17:14 | |
| *** Ryan_Lane has joined #openstack-infra | 17:14 | |
| fungi | yeah, my first experience with setting up a gerrit dev server was "here's all this puppet spaghetti, i'm just going to ignore it--quick, to the docs!" | 17:14 |
| fungi | much easier to maintain puppet manifests after you reverse-engineer them | 17:15 |
| openstackgerrit | Joshua Harlow proposed a change to openstack/requirements: Taskflow 0.2 released https://review.openstack.org/85423 | 17:15 |
| *** signed8b_ has quit IRC | 17:16 | |
| clarkb | fungi: iirc I had just done a whole bunch of fixes to them so that they worked too | 17:16 |
| fungi | yup. that was so long ago now | 17:16 |
| clarkb | fungi: this month marks 2 years hacking on openstack for me | 17:17 |
| clarkb | I think I did that math correctly | 17:17 |
| fungi | i've got another 4 months to go before i hit 2 years | 17:17 |
| *** pmoosh has joined #openstack-infra | 17:18 | |
| nibalizer | i've got another few days before i hit 2 months | 17:18 |
| nibalizer | wooo new generation! | 17:19 |
| fungi | nibalizer: congrats! | 17:19 |
| fungi | the first two months are the hardest | 17:19 |
| fungi | (bold-faced lie) | 17:19 |
| nibalizer | ya right now i'm kinda like 'look at all this low hanging fruit and no responsibility!' | 17:20 |
| *** signed8bit has joined #openstack-infra | 17:20 | |
| * fungi will say anything to make contributors stick around | 17:20 | |
| fungi | you know, infra has a magic lamp, and any atc on an infra project gets three wishes from the genie | 17:21 |
| *** SumitNaiksatam has joined #openstack-infra | 17:21 | |
| *** jp_at_hp1 has quit IRC | 17:22 | |
| clarkb | fungi: anteaya: I don't know that I will be able to drive the new projects and acl config update stuff today | 17:22 |
| clarkb | being pulled in far too many directions. Any chance one of you will be able to do that? | 17:23 |
| fungi | clarkb: no worries, i've got it handled | 17:23 |
| clarkb | woot thanks | 17:23 |
| fungi | going back over the two submitted ones as i type this | 17:23 |
| *** _nadya_ has quit IRC | 17:23 | |
| fungi | very light npf for a change | 17:24 |
| clarkb | fungi: there is also at least one acl config update change | 17:25 |
| clarkb | to give tripleo-ptl group the rights to create branches | 17:25 |
| *** dprince has quit IRC | 17:25 | |
| fungi | clarkb: ahh, hadn't gotten to that one in my queue yet. i'll make sure it goes in. i merged a couple acl changes this week already (with proper warning that they wouldn't take effect until today) | 17:26 |
| nibalizer | fungi: whats npf? | 17:26 |
| fungi | nibalizer: "new projects friday" | 17:26 |
| nibalizer | haha | 17:26 |
| fungi | a very recent tradition, started to help us work around a nagging bug | 17:26 |
| fungi | we batch up all new project request changes and apply them once a week at the moment | 17:27 |
| fungi | so that if they break we troubleshoot them all at once rather than having it interrupt us constantly at random throughout the week | 17:27 |
| nibalizer | okay that makes sense | 17:28 |
| nibalizer | yea ops work causes lots of context switch | 17:28 |
| * fungi is all switch and no context anyway | 17:28 | |
| *** zz_gondoi is now known as gondoi | 17:32 | |
| fungi | i'm approving new projects and acl changes now if they look good, and then i'll run m-p once everything's squared away and create-cgitrepos has populated empty repos on all the servers in the git farm | 17:35 |
| *** CaptTofu has joined #openstack-infra | 17:36 | |
| *** prad has quit IRC | 17:39 | |
| *** prad has joined #openstack-infra | 17:39 | |
| *** CaptTofu has quit IRC | 17:42 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Add new stackforge project DriverLog (driver verification) https://review.openstack.org/85033 | 17:42 |
| fungi | added a separate -ptl group for branch manipulation and tagging ^ | 17:42 |
| *** CaptTofu has joined #openstack-infra | 17:42 | |
| *** zhiyan is now known as zhiyan_ | 17:42 | |
| *** jeckersb is now known as jeckersb_gone | 17:43 | |
| *** morganfainberg_Z is now known as morganfainberg | 17:45 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add specs-cookiecutter to openstack-dev https://review.openstack.org/83192 | 17:45 |
| fungi | clarkb: does https://review.openstack.org/85171 actually work? i thought you needed control of refs/* to do branch manipulation in gerrit | 17:46 |
| *** CaptTofu has quit IRC | 17:47 | |
| clarkb | fungi: maybe? I would need to double check | 17:48 |
| clarkb | fungi: it works for refs/tags/* | 17:48 |
| clarkb | but tags aren't quite branches | 17:48 |
| *** Ajaeger has joined #openstack-infra | 17:49 | |
| fungi | i'll play around on review-dev for a few minutes and see if i can confirm what does and doesn't allow that | 17:49 |
| sdague | fungi: how do you feel about landing this - https://review.openstack.org/#/c/84864/ ? | 17:50 |
| *** thuc_ has quit IRC | 17:50 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Run docs jobs on qa-specs commits https://review.openstack.org/85431 | 17:51 |
| openstackgerrit | A change was merged to openstack-infra/config: Add new stackforge project DriverLog (driver verification) https://review.openstack.org/85033 | 17:51 |
| *** ociuhandu has quit IRC | 17:52 | |
| *** _nadya_ has joined #openstack-infra | 17:54 | |
| anteaya | clarkb: k | 17:55 |
| anteaya | fungi: I don't think I have access to drive npf even if I wanted to, do I? | 17:55 |
| anteaya | I would need ssh access to the gerrit server | 17:55 |
| fungi | sdague: yep, sound approach, and will let us check the proposed project branch override tooling | 17:56 |
| fungi | anteaya: you are correct | 17:56 |
| sdague | fungi: also, any idea if nodepool took the new heat images? | 17:57 |
| *** thuc has joined #openstack-infra | 17:57 | |
| fungi | sdague: what was the change number? | 17:57 |
| *** thuc has quit IRC | 17:57 | |
| *** mbacchi has quit IRC | 17:58 | |
| sdague | https://review.openstack.org/#/c/85057/ | 17:58 |
| sdague | merged last night at 9:40pm EST | 17:58 |
| *** thuc has joined #openstack-infra | 17:58 | |
| pabelanger | fungi, jeblair: Any issue getting nodepool patches in today? Or is doing it on a Friday a concern? | 17:58 |
| *** wchrisj_ has quit IRC | 17:59 | |
| *** wchrisj has joined #openstack-infra | 17:59 | |
| *** openstackgerrit has quit IRC | 18:01 | |
| *** openstackgerrit has joined #openstack-infra | 18:02 | |
| *** marun has joined #openstack-infra | 18:02 | |
| *** bookwar has quit IRC | 18:03 | |
| openstackgerrit | A change was merged to openstack-infra/config: add tempest-master jobs https://review.openstack.org/84864 | 18:04 |
| *** mrmartin has joined #openstack-infra | 18:05 | |
| *** thomasem has joined #openstack-infra | 18:08 | |
| *** freyes has quit IRC | 18:11 | |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Correct update-image to image-update for nodepool https://review.openstack.org/85435 | 18:12 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/nodepool: Correct update-image to image-update in samples https://review.openstack.org/85436 | 18:12 |
| fungi | sdague: we failed to successfully build devstack-precise images in hpcloud-az{1,2,3} and devstack-precise-check in rax-iad. also, the image updates don't seem to happen when we think they do ^ | 18:12 |
| sdague | fungi: interesting | 18:13 |
| sdague | any idea on the reasons for the fails? | 18:13 |
| *** mdenny has quit IRC | 18:13 | |
| fungi | sdague: our providers are surprisingly unstable | 18:13 |
| fungi | or perhaps unsurprisingly | 18:13 |
| sdague | I wonder if the image downloads are a big part of that, and if we put retry logic in there we could succeed more often | 18:13 |
| sdague | right, I just wonder if there is retry logic we could apply to succeed more often | 18:14 |
| *** morganfainberg is now known as morganfainberg_Z | 18:14 | |
| sdague | because if the fedora iso has a 1 in 10 chance of failing, I can imagine a huge fail rate in aggregate | 18:14 |
| fungi | it looks like the image rebuilds started roughly 36 minutes after that change merged, so the ones which did build should have that update... i'm spot-checking one now to make sure | 18:15 |
| fungi | then if that's good, i'll start loops on the remaining 4 | 18:15 |
| sdague | cool | 18:15 |
| *** freyes has joined #openstack-infra | 18:15 | |
| *** mdenny has joined #openstack-infra | 18:16 | |
| sdague | https://review.openstack.org/#/c/85293/ is related when you get time | 18:16 |
| sdague | that should take advantage of the new devstack tool once it lands | 18:16 |
| *** markmcclain has joined #openstack-infra | 18:16 | |
| *** zns has quit IRC | 18:17 | |
| fungi | sdague: though if you want to mine http://nodepool.openstack.org/image.log to identify whether the downloads failed and broke image builds, hopefully it should be apparent (you'll need to grep for the image/provider name combinations since the builds are all interleaved in that log) | 18:17 |
| sdague | sure, I can do that in a sec, got a couple of plates spinning that I want to handle first | 18:17 |
| *** zns has joined #openstack-infra | 18:18 | |
| *** denis_makogon_ has joined #openstack-infra | 18:18 | |
| *** denis_makogon_ is now known as denis_makogon | 18:19 | |
| *** ameade has joined #openstack-infra | 18:19 | |
| *** yamahata has quit IRC | 18:19 | |
| fungi | oh, though i should finish npf first... otherwise nodepool image updates are guaranteed to fail because they'll try to clone broken git repos | 18:22 |
| *** ameade has quit IRC | 18:23 | |
| *** vhoward- has joined #openstack-infra | 18:24 | |
| *** julim has quit IRC | 18:27 | |
| Ajaeger | clarkb: I'd like to see https://review.openstack.org/#/c/84191/ merged in soonish. Do you want to add --ignore-obsolete=true now or should we do this in a second step? The patch itself is a great step forward. | 18:28 |
| sdague | fungi: hmmm... I can't make heads or tails of failures in those logs, they seem to be all at INFO, interleaved, and no obvious deaths that I can see | 18:29 |
| fungi | sdague: i think you end up having to grep for one of the failed image+provider combinations and look at what the last few lines were | 18:30 |
| clarkb | Ajaeger: lets do that in a follow up change, do you want to propose the ignore-obsolete change? and do it for all the files that need it? | 18:30 |
| clarkb | fungi: see https://review.openstack.org/#/c/84191/ is that something we want to approve without a second +2? | 18:30 |
| clarkb | fungi: I think worst case we end up debugging more translation proposal weirdness | 18:30 |
| Ajaeger | clarkb: I can do that. | 18:30 |
| *** _nadya_ has quit IRC | 18:30 | |
| fungi | clarkb: seems reasonable. it's not too onerous, and Ajaeger has just thrown himself on the grenade | 18:31 |
| * Ajaeger has more fun than he likes to have - the small "msgfmt -c" test is more involved than I expected - see http://lists.openstack.org/pipermail/openstack-dev/2014-April/031938.html | 18:32 | |
| Ajaeger | fungi: I'll watch the jobs and will help fixing for sure if anything comes up | 18:32 |
| fungi | we're all about manufactured fun in here | 18:33 |
| Ajaeger | ;) | 18:33 |
| *** jepoy has quit IRC | 18:33 | |
| anteaya | paging nibalizer | 18:34 |
| nibalizer | anteaya: hai | 18:34 |
| anteaya | there you are | 18:34 |
| anteaya | thanks | 18:34 |
| *** jepoy has joined #openstack-infra | 18:34 | |
| anteaya | so looking at http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/git_backend.pp#n97 | 18:34 |
| anteaya | I know zip about subscribe | 18:34 |
| anteaya | care to fill me in on how it works | 18:34 |
| nibalizer | sure | 18:34 |
| * anteaya listens | 18:35 | |
| nibalizer | so the subscribe parmaeter works with the refreshonly parameter | 18:35 |
| nibalizer | the refreshonly parmaeter is setting exec to only run the first time, and never again until poked by something else to run again | 18:35 |
| nibalizer | the subscribe is setting it so that the exec will only fire when that yaml file resource is modified | 18:36 |
| nibalizer | so 99% of the time puppet will check the contents of that yaml file, find that they are okay, and move on, not firing the exec | 18:36 |
| anteaya | so the exec is fired if puppet checks the file and notices a change | 18:36 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully. https://review.openstack.org/85217 | 18:36 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add base test class to make subclassing possible https://review.openstack.org/85204 | 18:36 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 18:36 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Fix races in timer trigger tests. https://review.openstack.org/85230 | 18:36 |
| nibalizer | but when new content is pushed by us, through puppet, into that yaml file, puppet will set the file contents and then tell the exec to fire | 18:36 |
| clarkb | bam, there is my morning's fun | 18:36 |
| *** morganfainberg_Z is now known as morganfainberg | 18:37 | |
| clarkb | jhesketh: thank you for the reviews, I haven't addressed anything, but should've left comments on things when I didn't | 18:37 |
| nibalizer | anteaya: require => something and before => something are inverse relations | 18:37 |
| nibalizer | so you can in a file require a service | 18:37 |
| nibalizer | or in a service you can before a file | 18:37 |
| nibalizer | o'r whatever you feel like doing | 18:37 |
| nibalizer | similarly notify and subscribe are inverse relations | 18:37 |
| nibalizer | execs and services and subscribe to stuff | 18:38 |
| nibalizer | and files can notify services and execs | 18:38 |
| anteaya | let's get back to what triggers the exec to run | 18:38 |
| nibalizer | in the case of a service, it will bounce or reload the service if it gets a subscibe/notify message | 18:38 |
| nibalizer | sure | 18:38 |
| anteaya | so if puppet changes the file, puppet tells the exec to run | 18:38 |
| anteaya | is that accurate? | 18:38 |
| nibalizer | yep | 18:38 |
| anteaya | and puppet also checks the file | 18:39 |
| anteaya | and will tell exec to run if it notices a change | 18:39 |
| nibalizer | yep | 18:39 |
| nibalizer | uh thats kinda accurate | 18:39 |
| anteaya | what did I get wrong? | 18:39 |
| *** khyati has joined #openstack-infra | 18:40 | |
| nibalizer | you're correct but there are gonna be corner cases where your statement is not generally true | 18:40 |
| nibalizer | so if you look at that file resource | 18:40 |
| nibalizer | the puppet code is setting the content | 18:40 |
| *** jeckersb_gone is now known as jeckersb | 18:40 | |
| nibalizer | so every time puppet runs it will md5sum that file and if its not exactly the same value as set in the content => parameter, it will overwrite it with the content puppet thinks it should have | 18:40 |
| *** mrmartin has quit IRC | 18:41 | |
| nibalizer | if puppet does overwrite the file, it will also trigger any downstream execs and services that are chained by subscribe/notify metaparameters | 18:41 |
| anteaya | and overwriting it will trigger exec create-cgit-repos to run, yes? | 18:41 |
| anteaya | great | 18:41 |
| nibalizer | if puppet finds the file to be in conformance, it wont fire the exces | 18:41 |
| * anteaya nods | 18:42 | |
| nibalizer | also the refreshonly parameter on the exec is important | 18:42 |
| nibalizer | without that, the exec would fire every time | 18:42 |
| asselin | hi, today when creating a new image, the script is stuck on "Running: ['git', 'clone', 'https://github.com/openstack-dev/specs-cookiecutter.git', 'openstack-dev/specs-cookiecutter'] | 18:42 |
| asselin | " | 18:42 |
| *** e0ne has joined #openstack-infra | 18:42 | |
| anteaya | that is the param that requires the md5sum diff for firing the exec? | 18:42 |
| *** vhoward- has left #openstack-infra | 18:42 | |
| asselin | when I try it myself, I'm requested to input a username and password....is that expected? | 18:42 |
| nibalizer | no its not that specific | 18:42 |
| *** thuc has quit IRC | 18:43 | |
| nibalizer | it just tells the exec not to fire unless it recieves a notify/subscibe message | 18:43 |
| fungi | asselin: that will clear up soon. we're adding new projects, so that project (and one other) are in the projects.yaml file but have broken initial repositories on our gti server farm until replication is triggered | 18:43 |
| nibalizer | an exec with refreshonly set and no subscribe/notify would never fire | 18:43 |
| *** thuc has joined #openstack-infra | 18:43 | |
| asselin | fungi, thanks I guess this is a good time for a lunch break! | 18:43 |
| anteaya | so what sends out the notify/subscribe message? | 18:43 |
| nibalizer | the other resources | 18:43 |
| nibalizer | its not like actual network traffic or anything | 18:44 |
| *** yamahata has joined #openstack-infra | 18:44 | |
| nibalizer | its just a way of thinking about it | 18:44 |
| fungi | asselin: oh, though the reason you're getting a login prompt is that you're cloning from github instead of our git servers... in this particular case github just doesn't have the repository yet. same basic reason and will be fixed at the same time | 18:44 |
| anteaya | nibalizer: so in this example this file resource sends out the notify/subscribe message: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/git_backend.pp#n76 | 18:44 |
| nibalizer | yep | 18:45 |
| anteaya | great | 18:45 |
| anteaya | okay I think we have covered what fires this exec with subscribe and refreshonly | 18:45 |
| anteaya | next | 18:45 |
| anteaya | how is the success of the command evaluated? | 18:45 |
| anteaya | so exec create-cgit-repos is fired | 18:46 |
| anteaya | it runs | 18:46 |
| anteaya | it finishes | 18:46 |
| nibalizer | so a very common pattern is package{ 'foo': ensure => present } file { 'foo.conf': ensure => present, require => Package['foo']} service { 'foo': ensure => running, subscribe => File['foo.conf']} | 18:46 |
| anteaya | and then? | 18:46 |
| *** thuc_ has joined #openstack-infra | 18:46 | |
| *** thuc has quit IRC | 18:46 | |
| *** thuc_ has quit IRC | 18:46 | |
| nibalizer | the package gets installed, the config file comes after, and then the service is started; and any changes to the config file trigger a reload of the service | 18:47 |
| nibalizer | super neat | 18:47 |
| anteaya | except this isn't a running service | 18:47 |
| *** maxbit has joined #openstack-infra | 18:47 | |
| anteaya | so ensure => running can't be used | 18:47 |
| anteaya | the script runs, and finishes | 18:47 |
| *** thuc has joined #openstack-infra | 18:47 | |
| *** thuc has quit IRC | 18:47 | |
| nibalizer | anteaya: ya im just providing some basic context around subscibe still | 18:47 |
| nibalizer | haven't answered your questions | 18:47 |
| anteaya | nibalizer: ah okay, carry on | 18:47 |
| nibalizer | uhm sothe problem with execs is that puppet records their exit code and thats about it | 18:48 |
| * anteaya loves to watch a good teacher in action | 18:48 | |
| nibalizer | it can tell when an exec returns fail | 18:48 |
| *** thuc has joined #openstack-infra | 18:48 | |
| anteaya | where does exec record the exit code? | 18:48 |
| nibalizer | and so if you have a resource downstream from the exec and the exec returns 1, then puppet reports the exec resource as failing and doesn't even try the dependent resource | 18:49 |
| *** andreykurilin_ has joined #openstack-infra | 18:49 | |
| nibalizer | but this is what I call 'dropping kids off at the mall' | 18:49 |
| nibalizer | we just don't know what happened in the exec | 18:49 |
| anteaya | good analogy | 18:49 |
| anteaya | yes | 18:49 |
| nibalizer | we can know if they were there to be picked up | 18:49 |
| nibalizer | but thats abou tit | 18:49 |
| *** thuc_ has joined #openstack-infra | 18:49 | |
| anteaya | right | 18:49 |
| anteaya | okay | 18:49 |
| nibalizer | generally the puppet community is very harsh against exec resources | 18:49 |
| anteaya | is there a better way to do this then? | 18:50 |
| nibalizer | they want ruby types and providers to be leveraged to fully manage resources | 18:50 |
| nibalizer | but for a ton of stuff in sysadministration, especially in the 'init' phase of a service like this, you kinda gotta exec | 18:50 |
| anteaya | we are going to start incorporating salt as a next step, I just want to ensure we have gotten all we can from puppet on this | 18:50 |
| anteaya | ah yeah | 18:51 |
| nibalizer | i'm not sure what exactly 'create_cgitrepos' does | 18:51 |
| anteaya | we just want the script to run | 18:51 |
| nibalizer | but the name implies that it creates cgit repos | 18:51 |
| anteaya | it does | 18:51 |
| anteaya | and we have a git farm | 18:51 |
| anteaya | 5 servers | 18:51 |
| nibalizer | the 'more puppety' way to do it is to start managing cgitrepos as puppet types | 18:51 |
| *** dizquierdo has quit IRC | 18:51 | |
| nibalizer | so we would say cgitrepo { 'storybboard': ensure => present, url => something, otherparam => something} | 18:52 |
| anteaya | so the repos need to be created and finished on all 5 before the next step is executed | 18:52 |
| anteaya | other wise there is a race | 18:52 |
| nibalizer | all 5 .. machines? | 18:52 |
| mordred | nibalizer: yeah - we did not choose to go that route | 18:52 |
| nibalizer | all 5 servers | 18:52 |
| anteaya | all 5 servers | 18:52 |
| anteaya | correct | 18:52 |
| fungi | nibalizer: right now we have those in a giant yaml file (several hundred entries). should we dynamically generate the puppet from them in that case? | 18:52 |
| mordred | nibalizer: we manage repos via a file called projects.yaml | 18:52 |
| anteaya | so this is where salt comes in | 18:52 |
| *** hogepodge has quit IRC | 18:52 | |
| *** thuc has quit IRC | 18:52 | |
| anteaya | we need to figure out a way to say we are finished on all 5 servers | 18:53 |
| anteaya | do the next thing | 18:53 |
| anteaya | which is run manage-projects | 18:53 |
| nibalizer | ya internode in puppet is hard | 18:53 |
| *** thuc_ has quit IRC | 18:53 | |
| *** SumitNaiksatam has quit IRC | 18:53 | |
| anteaya | which I figured was the case, I just wanted to ensure I wasn't missing something obvious | 18:53 |
| nibalizer | using salt or bash or fabric to tell the first five to go, then wait, then the next 6 to go, then wait is the right approach i think | 18:53 |
| nibalizer | i have some ideas on how to do it in puppet | 18:53 |
| nibalizer | really cool ideas | 18:54 |
| *** thuc has joined #openstack-infra | 18:54 | |
| nibalizer | but way to unimplemented and hacky to put in this project right now | 18:54 |
| anteaya | let me dig up my salt etherpads | 18:54 |
| mordred | the current idea is to start using salt to drive runs of puppet on the machines | 18:54 |
| *** SumitNaiksatam has joined #openstack-infra | 18:54 | |
| mordred | and to stop running puppet as long-running agents | 18:54 |
| mordred | but instead trigger runs from the master in sequence | 18:54 |
| anteaya | this is the most recent: https://etherpad.openstack.org/p/OVMqR5SOHq | 18:54 |
| nibalizer | fungi: you could do that! if the yaml goes into a hiera dir somewhere you can pull it out with a simple call then iterate over it making cgitrepo resoruces! | 18:55 |
| mordred | and have salt trigger "pupept agent --test" | 18:55 |
| fungi | nibalizer: yeah, i was wondering whether hiera could handle arbitrary yaml like that | 18:55 |
| nibalizer | it might need a massage | 18:55 |
| mordred | I don't think we want to couple this more to puppet, tbh | 18:55 |
| anteaya | which directly addresses one solution for getting a report back on when create-cgit-repos is finished and fires manage-projects | 18:55 |
| mordred | manage-projects is usable by gerrit people who do not use puppet. that is desirable | 18:56 |
| fungi | mordred: i agree on that front | 18:56 |
| nibalizer | fungi: http://docs.puppetlabs.com/hiera/1/lookup_types.html | 18:56 |
| anteaya | and here is infrastructure priorites just for the heck of it: https://etherpad.openstack.org/p/infrastructure-priorities | 18:56 |
| fungi | more just curious about ways to blend hiera with other yaml-consuming systems off the same content | 18:56 |
| fungi | nibalizer: neat--thanks! | 18:57 |
| nibalizer | ya its easy to get overexcited about doing things in puppet that don't make sense | 18:57 |
| anteaya | here is another salt etherpad: https://etherpad.openstack.org/p/Salt-Event-System | 18:57 |
| *** rwsu has quit IRC | 18:57 | |
| anteaya | I think that is what I have | 18:57 |
| anteaya | nibalizer: it would be great to have your input | 18:58 |
| fungi | zaro: what's a quick and dirty way to modify group membership on review-dev without using the webui? thet moved the membership lists into files right? | 19:00 |
| *** Ajaeger has quit IRC | 19:00 | |
| nibalizer | anteaya: i have to go back to work | 19:01 |
| anteaya | nibalizer: makes sense to me | 19:01 |
| nibalizer | but i'll review it later and provide feedback if I have any | 19:01 |
| nibalizer | sorry | 19:01 |
| anteaya | nibalizer: thanks for your time, I really enjoyed the tour or refreshonly and subscribe | 19:01 |
| nibalizer | no prob | 19:01 |
| anteaya | nibalizer: no need to explain | 19:01 |
| anteaya | thank you | 19:01 |
| anteaya | :D | 19:01 |
| nibalizer | :) | 19:01 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: add query for boto volume race https://review.openstack.org/85449 | 19:02 |
| *** hashar has joined #openstack-infra | 19:03 | |
| *** Sukhdev has joined #openstack-infra | 19:04 | |
| zaro | fungi: if you checkout ref/meta/config you'll have a groups file. i believe you can just modify then push back up to gerrit. | 19:04 |
| fungi | zaro: oh, that may not help me then. i need to test adding and removing myself from groups, particularly administrator. if my account needs to work to be able to modify my account membership in a group, then chicken and egg | 19:05 |
| *** e0ne has quit IRC | 19:05 | |
| fungi | in old gerrit i could just make update queries in the db | 19:05 |
| fungi | bummer | 19:05 |
| fungi | i guess i could just be very careful and push to the local filesystem copy, but probably have to restart the gerrit service in the process | 19:06 |
| *** e0ne has joined #openstack-infra | 19:06 | |
| zaro | fungi: could you not use another admin account? | 19:06 |
| fungi | zaro: i could. is there an easy way to set up accounts which bypass openid? | 19:07 |
| fungi | otherwise i guess i need additional openids | 19:07 |
| zaro | yes, you can put gerrit in BECOME_ANYONE mode and create local accounts. | 19:08 |
| fungi | i'm tempted to just approve 85171 because actually testing it is going to be far more work than just trying something else if it ends up not working | 19:08 |
| *** e0ne has quit IRC | 19:09 | |
| fungi | zaro: you don't happen to know off the top of your head whether you need permissions on refs/* to add and remove branches, or whether just having it on refs/heads/* works? | 19:10 |
| zaro | not really, but it makes sense that you would need permission on refs/* as well | 19:11 |
| fungi | oh, though i also think 85171 is unlikely to work for other reasons... there are exclusive permissions granted on refs/heads/stable/* in all-projects, so the plan they outline in their commit message won't actually work | 19:12 |
| *** ociuhandu has joined #openstack-infra | 19:13 | |
| *** rwsu has joined #openstack-infra | 19:13 | |
| anteaya | so pleia2 is helping me understand create-cgitrepos | 19:14 |
| anteaya | which I am wrong, doesn't create git repos across the git server farm | 19:14 |
| *** pmoosh has quit IRC | 19:14 | |
| anteaya | it creates the web interface for the project that will soon exist | 19:14 |
| fungi | anteaya: and also inits the git repos in /var/lib/git if they don't exist yet | 19:15 |
| pleia2 | ah yes, I forgot about that part | 19:15 |
| anteaya | what server has /var/lib/git | 19:15 |
| fungi | anteaya: so that gerrit will be able to replicate into them | 19:15 |
| fungi | anteaya: all the git servers | 19:15 |
| anteaya | the git servers? | 19:15 |
| anteaya | k | 19:15 |
| pleia2 | anteaya: so the init-in of the git repos is where the race condition is | 19:15 |
| pleia2 | init-ing | 19:16 |
| *** mbacchi has joined #openstack-infra | 19:16 | |
| anteaya | so ensuring /var/lib/git for each project exists on each git server is our run manage-projects trigger | 19:16 |
| zaro | fungi: you think you would be able to fast track this? https://review.openstack.org/#/c/85114 | 19:18 |
| anteaya | if that is the case I disagree with line 47 | 19:18 |
| anteaya | # We don't actually use these, but jeepyb requires them. | 19:18 |
| fungi | zaro: i'll look at it when i'm done fast-tracking all the other things i'm in the middle of. what is it? | 19:18 |
| *** khyati has quit IRC | 19:19 | |
| zaro | fungi: quick fix to jjb job to buid gerrit plugins. referenced wrong directory on copy | 19:19 |
| * zaro nearly gets puppet to stand review-dev | 19:19 | |
| pleia2 | anteaya: line 47 in which file? | 19:20 |
| anteaya | beg pardon http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/git_backend.pp#n47 | 19:20 |
| pleia2 | anteaya: ah, the comment is about the variables themselves | 19:21 |
| pleia2 | we don't end up using those variables in the puppet config, but jeepyb barfs if they variables don't exist | 19:21 |
| anteaya | I would go with this file doesn't use these variables | 19:21 |
| anteaya | right what you said | 19:21 |
| fungi | zaro: looks okay, though you don't need teh ./ in front of those | 19:21 |
| anteaya | though I would choose a word other than barfs | 19:22 |
| pleia2 | sure, the comment can be improved :) | 19:22 |
| anteaya | not my favourite word | 19:22 |
| pleia2 | haha, it's friday | 19:22 |
| anteaya | that it is | 19:22 |
| pleia2 | I used up all my delicate earlier this week | 19:22 |
| pleia2 | :) | 19:22 |
| anteaya | ha ha ha | 19:22 |
| anteaya | I wondered if that was possible | 19:22 |
| anteaya | good for you | 19:22 |
| pleia2 | it's been a long week | 19:22 |
| * anteaya applauds | 19:22 | |
| anteaya | yup | 19:22 |
| anteaya | pleia2: you have the better comment, do you want to offer the patch? | 19:23 |
| anteaya | may as well take credit for it | 19:23 |
| pleia2 | sure, on it | 19:23 |
| anteaya | thanks | 19:23 |
| * anteaya has her upvote ready | 19:23 | |
| *** malini is now known as malini_afk | 19:25 | |
| *** mgagne1 is now known as mgagne | 19:25 | |
| *** pcm_ has quit IRC | 19:25 | |
| dhellmann | fungi: I'm working out the change to add the new oslo lib jobs based on that parameterization change you reviewed earlier this week. It's going to be a lot of little similar changes. Would you prefer a series of patches, one per oslo lib, or one big patch? | 19:26 |
| openstackgerrit | Elizabeth Krumbach Joseph proposed a change to openstack-infra/config: Clarify comment about variables in git_backend.pp https://review.openstack.org/85456 | 19:28 |
| anteaya | very nice | 19:28 |
| pleia2 | thanks | 19:29 |
| fungi | dhellmann: one big patch seems fine unless you need a phased approach for some reason | 19:31 |
| dhellmann | fungi: sounds good | 19:32 |
| * pleia2 goes burrito hunting | 19:33 | |
| zaro | fungi: thanks! | 19:34 |
| *** CaptTofu has joined #openstack-infra | 19:35 | |
| fungi | new empty repos seem to exist on all the git servers, manage-projects is running now | 19:36 |
| *** CaptTofu has quit IRC | 19:36 | |
| *** CaptTofu has joined #openstack-infra | 19:37 | |
| anteaya | cool | 19:37 |
| openstackgerrit | A change was merged to openstack-infra/config: fix gerrit plugin build job https://review.openstack.org/85114 | 19:38 |
| *** dstanek has quit IRC | 19:38 | |
| clarkb | fungi: \o/ | 19:40 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully. https://review.openstack.org/85217 | 19:41 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add base test class to make subclassing possible https://review.openstack.org/85204 | 19:41 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 19:41 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Fix races in timer trigger tests. https://review.openstack.org/85230 | 19:41 |
| clarkb | now ^ should pass testing | 19:41 |
| *** fbo is now known as fbo_away | 19:41 | |
| *** CaptTofu has quit IRC | 19:41 | |
| *** wenlock_ has quit IRC | 19:41 | |
| *** morganfainberg is now known as morganfainberg_Z | 19:42 | |
| *** zehicle_at_dell has joined #openstack-infra | 19:42 | |
| *** sdake has quit IRC | 19:42 | |
| *** adalbas has quit IRC | 19:45 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: add query for boto volume race https://review.openstack.org/85449 | 19:45 |
| *** CaptTofu has joined #openstack-infra | 19:45 | |
| fungi | does d-g move the contents of ~jenkins/cache/files into /opt/stack/new/devstack/files ? | 19:46 |
| *** dstanek has joined #openstack-infra | 19:46 | |
| *** zehicle_at_dell has quit IRC | 19:47 | |
| *** sdake has joined #openstack-infra | 19:47 | |
| *** sdake has quit IRC | 19:47 | |
| *** sdake has joined #openstack-infra | 19:47 | |
| * fungi checks recent logs | 19:47 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Handle NullChange "merges" gracefully. https://review.openstack.org/85217 | 19:49 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add base test class to make subclassing possible https://review.openstack.org/85204 | 19:49 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Add a remote url override location https://review.openstack.org/76057 | 19:49 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/zuul: Fix races in timer trigger tests. https://review.openstack.org/85230 | 19:49 |
| clarkb | zuul tests hate me, but I think this last patchset should be pretty good | 19:49 |
| fungi | ahh, it does, good... http://logs.openstack.org/23/84923/6/check/check-tempest-dsvm-full/3a25268/logs/devstack-gate-setup-workspace-new.txt.gz#_2014-04-04_18_59_11_456 | 19:49 |
| clarkb | fungi: ya | 19:50 |
| sdague | flashgordon, fungi : https://review.openstack.org/#/c/85167/ | 19:50 |
| sdague | that's the requirements fix for barbican | 19:50 |
| fungi | sdague: i spot-checked a node built from one of the images which successfully updated overnight, and it has a /opt/stack/new/devstack/files/Fedora-x86_64-20-20131211.1-sda.qcow2 | 19:50 |
| sdague | cool | 19:51 |
| sdague | ok, I'll phase that in tomorrow | 19:51 |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Added global CSS class to allow style targeting. https://review.openstack.org/85185 | 19:52 |
| openstackgerrit | A change was merged to openstack-infra/storyboard-webclient: Tasks are now editable https://review.openstack.org/84888 | 19:52 |
| fungi | manage-projects finished running, all 5 git servers have commits in their copies of the two new repos | 19:52 |
| mtreinish | fungi: cool | 19:52 |
| fungi | and both projects have acls applied | 19:53 |
| fungi | setting up initial group members now | 19:53 |
| *** amotoki has quit IRC | 19:54 | |
| anteaya | yay | 19:55 |
| fungi | ilyashakhat: i've set you as the initial member of driverlog-core and driverlog-ptl groups | 19:56 |
| fungi | okay, starting nodepool image update loops for devstack images which didn't take overnight | 19:57 |
| *** adalbas has joined #openstack-infra | 19:58 | |
| *** signed8bit has quit IRC | 19:58 | |
| *** mihgen has quit IRC | 19:59 | |
| *** e0ne has joined #openstack-infra | 19:59 | |
| sdague | jeblair: do you have an opinion about whether to put elastic recheck in infra or qa tracks for summit? | 20:00 |
| *** morganfainberg_Z is now known as morganfainberg | 20:00 | |
| mordred | sdague: it should get its own track | 20:02 |
| *** Sukhdev has quit IRC | 20:02 | |
| sdague | or it's own summit :) | 20:02 |
| *** zehicle_at_dell has joined #openstack-infra | 20:02 | |
| openstackgerrit | Ben Nemec proposed a change to openstack-infra/config: Make ironic-undercloud and fedora jobs non-voting https://review.openstack.org/85468 | 20:02 |
| mordred | sdague: you coudl start an elastic-recheck as a service project | 20:03 |
| sdague | :) | 20:04 |
| *** vhoward- has joined #openstack-infra | 20:04 | |
| dhellmann | do zuul templates take parameters? that is, can I pass a parameter to the template when I use it, like in jjb? | 20:04 |
| *** aconrad has quit IRC | 20:05 | |
| sdague | well, I was starting to see a pattern to generalize the er flow for other problems. Like the same hit list model would work for going after error log issues in projects. | 20:05 |
| sdague | or anything you can detected at periodic intervals | 20:05 |
| sdague | that's all definitely far futures though | 20:06 |
| *** khyati has joined #openstack-infra | 20:07 | |
| *** e0ne has quit IRC | 20:08 | |
| *** e0ne has joined #openstack-infra | 20:08 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: cloner to easily clone dependent repositories https://review.openstack.org/70373 | 20:09 |
| fungi | sdague: the remaining four devstack images which don't have that new file cached are running in update loops now. hopefully they'll all get new ones by tomorrow | 20:10 |
| sdague | fungi: great | 20:10 |
| *** talluri has quit IRC | 20:10 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: cloner to easily clone dependent repositories https://review.openstack.org/70373 | 20:10 |
| asselin | fungi, yes I changed the cache_git_repos.py script to use github b/c I need to use http protocol instead of git for the remote to get out of my corporate proxy. It seems to work for the other packages. I don't know how to get the http url for the openstack git server | 20:10 |
| sdague | we have to come up with a clever way for us to send in images that we aren't yet trying to download on devstack installs but we want nodepool to grab | 20:11 |
| *** msabramo has quit IRC | 20:11 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: cloner to easily clone dependent repositories https://review.openstack.org/70373 | 20:11 |
| *** khyati has quit IRC | 20:12 | |
| dhellmann | fungi, jeblair : is http://paste.openstack.org/show/75115/ going to work with a zuul template? | 20:12 |
| fungi | asselin: same as the git protocol url, just switch git:// to http:// | 20:12 |
| asselin | fungi, ok will try that thanks | 20:12 |
| *** e0ne has quit IRC | 20:12 | |
| * dhellmann thinks the last line of his paste needs to be indented | 20:13 | |
| fungi | dhellmann: with that first block in the templates list and the second block in the projects list presumably? | 20:13 |
| dhellmann | fungi: yes | 20:13 |
| dhellmann | fungi: the part that isn't clear is if I can pass "lib" to the template when I use it | 20:14 |
| fungi | dhellmann: yeah, i think {name} may be a special case... jeblair will know for sure but i don't think you can define replacement macros within the layout.yaml | 20:15 |
| fungi | though i will be thrilled to learn i am wrong | 20:15 |
| *** khyati has joined #openstack-infra | 20:15 | |
| *** morganfainberg is now known as morganfainberg_Z | 20:15 | |
| dhellmann | fungi: ok, I'll continue repeating myself :-) | 20:15 |
| *** CaptTofu has quit IRC | 20:16 | |
| *** CaptTofu has joined #openstack-infra | 20:16 | |
| fungi | there's so much repetition in that file already that i don't think you can make it much worse (though the name-based template groups are helping considerably) | 20:17 |
| *** zns has quit IRC | 20:18 | |
| boris-42 | could somebody take a look https://review.openstack.org/#/c/84719/ (already +2 and a lot of +1) please=) | 20:20 |
| *** markmcclain has quit IRC | 20:20 | |
| *** CaptTofu has quit IRC | 20:20 | |
| dhellmann | fungi: it would be interesting to extract the yaml template stuff from jjb into a library and reuse it | 20:20 |
| fungi | slagle: wrt 85171 would you like me to create those branches now? if so i just need to know the shas you want them branched from. if not, ping me when you're ready and i can help | 20:20 |
| *** CaptTofu has joined #openstack-infra | 20:21 | |
| fungi | slagle: though it might help to discuss with ttx what exactly you want to do, and he might just be able to work it into normal release management processes | 20:21 |
| *** e0ne has joined #openstack-infra | 20:22 | |
| slagle | fungi: it would just be the shas of the latest tags in each of those repos | 20:23 |
| *** CaptTofu has quit IRC | 20:24 | |
| fungi | slagle: shas of the latest tags currently in those repos? if so, i'll add the branches now | 20:24 |
| slagle | fungi: previously ttx said that he could just create branches whenever, so i think that was likely his plan as well | 20:24 |
| slagle | when we discussed on openstack-dev | 20:24 |
| slagle | fungi: yes, the latest tags. i tagged stuff yesterday in each of those repos, with the exception of tripleo-incubator | 20:25 |
| fungi | slagle: yeah, he usually just does it for the other official programs, so i don't see wht doing so for deployment projects would be any different in that regard | 20:25 |
| slagle | fungi: for tripleo-incubator, latest sha is fine | 20:25 |
| fungi | s/wht/why/ | 20:25 |
| *** Sukhdev has joined #openstack-infra | 20:26 | |
| *** msabramo has joined #openstack-infra | 20:28 | |
| fungi | slagle: created. double-check that those correspond to the commits you intended | 20:30 |
| slagle | fungi: ok, checking | 20:30 |
| annegentle | on openstack-planet, https://review.openstack.org/#/c/85437/, do I have to wait for a second +2 on that or can I just approve? image is correct, feed is fine. | 20:32 |
| slagle | fungi: looks good, thanks | 20:32 |
| mordred | annegentle: I tend to single-+2 approve planet changes - because almost nobody ever reviews them | 20:32 |
| annegentle | mordred: yeah that's what I figured | 20:33 |
| fungi | slagle: you're welcome. note you still may have acl issues +2'ing/approving changes proposed to those branches, so if you're not going to fall under the control of the stable branch maintainers you probably need overrides for refs/heads/stable/* to your -milestone group or whoever intends to work on stable backports | 20:34 |
| *** sandywalsh is now known as sw_away | 20:34 | |
| slagle | fungi: ok. i'll figure out what's needed and propose to infra/config | 20:35 |
| *** aconrad has joined #openstack-infra | 20:35 | |
| fungi | slagle: there's an exclusive -2/+2 review, 0/+1 approve for the stable-branch-maint group in the global acl which gets inherited by other acls, but you should be able to find override examples in some of the other acl files (particularly some stackforge acls) | 20:35 |
| slagle | ok | 20:36 |
| fungi | slagle: for example, i think libra uses similar branches | 20:36 |
| *** msabramo has left #openstack-infra | 20:36 | |
| *** julim has joined #openstack-infra | 20:39 | |
| fungi | boris-42: i've left you a quick question on 84719 | 20:39 |
| fungi | oh, just spotted something else too | 20:39 |
| *** markmcclain has joined #openstack-infra | 20:41 | |
| sdague | clarkb: I found a bug in https://review.openstack.org/#/c/84829/ so respun it with more tests | 20:43 |
| sdague | however that should be ready to go now | 20:43 |
| *** esker has quit IRC | 20:43 | |
| *** mihgen has joined #openstack-infra | 20:44 | |
| *** esker has joined #openstack-infra | 20:44 | |
| german | hi | 20:44 |
| german | quick question: I uploaded a new package to lp ppa -- how long do i need to wait before it builds | 20:45 |
| german | ? | 20:45 |
| fungi | german: you might want to ask in #launchpad | 20:45 |
| *** lcostantino has quit IRC | 20:45 | |
| german | thanks. I am totally new to all this. Thanks a lot. | 20:46 |
| fungi | german: there might be one or two ubuntu package maintainers hanging out in here who use ppas, but most of us are focused on other sorts of release publication channels | 20:46 |
| pleia2 | can I get some eyes on https://review.openstack.org/#/c/85194/ ? just want to make it non-voting until things sort themselves out and we can actually see if it works | 20:46 |
| pleia2 | lifeless: ^^ you too :) | 20:47 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Make ATC lists sort E-mails with preferred first https://review.openstack.org/85385 | 20:47 |
| lifeless | pleia2: we could just land https://review.openstack.org/#/c/85468/ | 20:48 |
| pleia2 | lifeless: ok, I wasn't sure if a separate discussion needed to happen over the ironic stuff | 20:48 |
| lifeless | nah | 20:48 |
| pleia2 | didn't want to hold this up | 20:48 |
| *** esker has quit IRC | 20:48 | |
| *** hashar has quit IRC | 20:48 | |
| lifeless | see the email I sent saying its broken | 20:48 |
| lifeless | :) | 20:48 |
| *** signed8bit has joined #openstack-infra | 20:48 | |
| pleia2 | so many emails | 20:48 |
| lifeless | clarkb: fungi: ^ - 85468 landing would avoid considerable reviewer confusion, I think. | 20:48 |
| openstackgerrit | James Slagle proposed a change to openstack-infra/config: Add acl overrides on stable branches for tripleo https://review.openstack.org/85485 | 20:50 |
| openstackgerrit | Ben Nemec proposed a change to openstack-infra/config: Make ironic-undercloud job non-voting https://review.openstack.org/85468 | 20:50 |
| fungi | lifeless: pleia2: bnemec: you probably want to get on the same page first ;) | 20:51 |
| pleia2 | doh | 20:51 |
| anteaya | pick a patch | 20:51 |
| anteaya | any patch | 20:51 |
| lifeless | beekneemech: ^ :( | 20:52 |
| *** mbacchi has quit IRC | 20:52 | |
| pleia2 | oh friday nicks | 20:52 |
| beekneemech | Hmm, I seem to have angered Gerrit. | 20:56 |
| *** dstanek has quit IRC | 20:56 | |
| openstackgerrit | Ben Nemec proposed a change to openstack-infra/config: Make ironic-undercloud and fedora jobs non-voting https://review.openstack.org/85468 | 20:56 |
| beekneemech | There we go. | 20:56 |
| fungi | lgtm | 20:57 |
| *** mihgen has quit IRC | 20:57 | |
| beekneemech | fungi: Thanks | 20:57 |
| fungi | beekneemech: my pleasure | 20:58 |
| pleia2 | thanks beekneemech :) | 20:58 |
| fungi | sdague: so far the image update failures i'm seeing while looping in hpcloud are all the metadata server timeouts | 20:59 |
| sdague | fungi: ok, so not download related | 20:59 |
| sdague | good to know | 20:59 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Add cross-project unit tests for oslo libraries https://review.openstack.org/85487 | 21:00 |
| *** zns has joined #openstack-infra | 21:01 | |
| *** VijayTripathi has joined #openstack-infra | 21:01 | |
| *** mfer has quit IRC | 21:02 | |
| *** gilliard has quit IRC | 21:03 | |
| zaro | fungi: need some help with hiera params. | 21:03 |
| zaro | trying to get local puppet to stand up a review-dev | 21:04 |
| *** gilliard has joined #openstack-infra | 21:04 | |
| zaro | i'm having a problem with the keys. | 21:04 |
| flashgordon | sdague: can you make your comment rhyme? | 21:04 |
| zaro | fungi: can you tell me what format the keys take? | 21:04 |
| * anteaya wonders if sdague can rap | 21:04 | |
| *** Guest60641 has joined #openstack-infra | 21:05 | |
| Guest60641 | warning | 21:05 |
| Guest60641 | you may be watched | 21:05 |
| Guest60641 | do usa&israel use the internet(facebook,youtube,twitter, chat rooms ..ect)to spy?? | 21:05 |
| Guest60641 | do usa&israel use the internet 2 collect informations,,can we call that spying?? | 21:05 |
| Guest60641 | do they record&analyse everything we do on the internet,,can they harm you using these informations?? | 21:05 |
| Guest60641 | تحذير | 21:05 |
| Guest60641 | قد تكون مراقب | 21:05 |
| Guest60641 | هل تستخدم امريكا و اسرائيل الانترنت بمواقعه (فيس بوك,يوتيوب,تويتر,غرف الشات....الخ) للتجسس؟warning | 21:05 |
| Guest60641 | you may be watched | 21:05 |
| Guest60641 | do usa&israel use the internet(facebook,youtube,twitter, chat rooms ..ect)to spy?? | 21:05 |
| Guest60641 | do usa&israel use the internet 2 collect informations,,can we call that spying?? | 21:05 |
| Guest60641 | do they record&analyse everything we do on the internet,,can they harm you using these informations?? | 21:05 |
| *** VijayTripathi has quit IRC | 21:05 | |
| pleia2 | hehe | 21:05 |
| sdague | flashgordon: oh no, what did I do now? | 21:06 |
| *** Guest60641 has quit IRC | 21:06 | |
| pleia2 | nice when they show themselves out | 21:06 |
| *** Guest60641 has joined #openstack-infra | 21:06 | |
| zaro | fungi: i mean should the pub key contain 'ssh-rsa' at the beginning of the keys? | 21:06 |
| *** Guest60641 has quit IRC | 21:06 | |
| flashgordon | sdague: your entertaining and useful comment in https://review.openstack.org/#/c/85167/ | 21:06 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Add cross-project unit tests for oslo libraries https://review.openstack.org/85487 | 21:07 |
| zaro | fungi: also do i need to pass private key with begin and end headers? | 21:07 |
| sdague | flashgordon: I'm glad you enjoy :) | 21:07 |
| *** e0ne has quit IRC | 21:07 | |
| *** e0ne has joined #openstack-infra | 21:08 | |
| flashgordon | sdague: you do write entertaining commit msgs and comments | 21:09 |
| sdague | I try to make life fun | 21:10 |
| fungi | zaro: yes, in hiera we include the ssh-rsa leader on public key strings and begin and end lines on private key blocks | 21:11 |
| * fungi needs to disappear and grab dinner... back in a while | 21:11 | |
| *** e0ne has quit IRC | 21:11 | |
| sdague | flashgordon: btw, best code comment ever - https://github.com/mmehnert/xscreensaver/blob/master/hacks/screenhackI.h#L12 | 21:13 |
| * mordred misses .plan files | 21:13 | |
| flashgordon | haha | 21:13 |
| mtreinish | hahaha | 21:13 |
| sdague | mordred: yeh, me too. Though I guess they are mostly blogs and tweets now. | 21:14 |
| flashgordon | sdague: btw thoughts on moving check-tempest-dsvm-cells-full to experimental? | 21:14 |
| mordred | sdague: wait - those are different things? | 21:14 |
| sdague | flashgordon: it's nv on nova | 21:15 |
| sdague | oh, you want to make it experimental? | 21:15 |
| flashgordon | yeah | 21:15 |
| zaro | fungi: thanks. | 21:15 |
| flashgordon | it has no chance of passing in the near future | 21:15 |
| flashgordon | seems like a waste | 21:15 |
| sdague | sure, though we don't need the nodes right now | 21:16 |
| sdague | honestly, I'd like to wait until juno 1 to drop it to experimental | 21:16 |
| flashgordon | true, no rush on it. I was partially wondering of it was on purpose | 21:16 |
| flashgordon | sdague: sounds reasonable | 21:17 |
| sdague | well, I was hoping someone would care | 21:17 |
| flashgordon | ahh nice try :) | 21:17 |
| sdague | it turned out we didn't even have it on experimental | 21:17 |
| clarkb | these little focus roojms ~.~. | 21:17 |
| clarkb | gah | 21:18 |
| clarkb | silly ssh | 21:18 |
| sdague | hehe | 21:18 |
| clarkb | these little rooms are soo cold. Could be walk in refridgerators | 21:18 |
| mordred | clarkb: what are you doing in a tiny cold room/ | 21:19 |
| mordred | clarkb: it seems like an unpleasant choice to have made | 21:19 |
| anteaya | is this the same place with the unlevel tables? | 21:20 |
| clarkb | mordred: phonecalls | 21:20 |
| clarkb | anteaya: no that is a different room | 21:20 |
| anteaya | you have to go into a refrigerator to do phonecalls? | 21:20 |
| anteaya | this office upgrade isn't sounding too appealing | 21:20 |
| clarkb | anteaya: :P | 21:21 |
| mordred | anteaya: in the next office upgrade, they will also dump water on you while you sit in the refrigerator | 21:21 |
| clarkb | anteaya: actually the old floor had similar problems. I think the thermostat is wonky | 21:21 |
| mordred | anteaya: and poke you with sticks | 21:21 |
| anteaya | should increase productivity | 21:21 |
| clarkb | Monday is going to be work from outside day, 68F practically summer | 21:22 |
| anteaya | yeah | 21:22 |
| anteaya | I'm loving forward to seattle in august | 21:22 |
| * jesusaurus notes to work from the rooftop on monday | 21:22 | |
| anteaya | I love the rides on the ferry | 21:22 |
| anteaya | but I might avoid the office | 21:22 |
| *** pdmars has quit IRC | 21:23 | |
| clarkb | fungi: ok, I think I am done juggling the things I was juggling. Anything I can help with this afternoon? nodepool image creation or npf? | 21:24 |
| anteaya | I think he is consuming or preparing food to be consumed | 21:24 |
| anteaya | and npf is all done | 21:25 |
| clarkb | cool | 21:25 |
| anteaya | no idea about the statue of nodepool image creation | 21:25 |
| * clarkb checks nodepool then | 21:25 | |
| mordred | clarkb, fungi: I'm about to go back home where the internet isn't blocked by dancing apes | 21:25 |
| mordred | and when I do, I'll get the dib nodepool patch reworked | 21:26 |
| clarkb | looks like fungi triggered image builds | 21:26 |
| openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Add cross-project unit tests for oslo libraries https://review.openstack.org/85487 | 21:26 |
| *** german has left #openstack-infra | 21:28 | |
| *** fbo_away is now known as fbo | 21:30 | |
| *** alff has quit IRC | 21:30 | |
| *** alff_ has quit IRC | 21:30 | |
| *** mwagner_lap has quit IRC | 21:38 | |
| mgagne | anyone else having an event taking up all the page space here? http://openstacksummitmay2014atlanta.sched.org/grid-full | 21:38 |
| clarkb | mgagne: the alice in wonderland one? yup | 21:39 |
| mgagne | clarkb: yep, is the event really that wonderful that it has to last for days? :D | 21:40 |
| *** david-lyle has quit IRC | 21:40 | |
| *** eharney has quit IRC | 21:41 | |
| *** Ryan_Lane has quit IRC | 21:42 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-dev/hacking: Bump pep8, pyflakes and flake8 versions https://review.openstack.org/84913 | 21:43 |
| *** weshay has quit IRC | 21:45 | |
| *** amotoki has joined #openstack-infra | 21:49 | |
| *** jeckersb has quit IRC | 21:49 | |
| flashgordon | http://logs.openstack.org/13/84913/2/check/gate-hacking-pep8/f5873d1/console.html | 21:50 |
| flashgordon | I can't rev hackings since it is trying to use pypi.openstack.org | 21:50 |
| flashgordon | how do I specify to not use pypi.openstack.org | 21:50 |
| clarkb | flashgordon: you can't | 21:51 |
| *** e0ne has joined #openstack-infra | 21:51 | |
| flashgordon | clarkb: then gah | 21:51 |
| flashgordon | so the original thinking was pin pep8,flake8 and pyflakes in hacking | 21:51 |
| flashgordon | so perhaps we can do that, but add those unpinned to the global reqs? | 21:52 |
| flashgordon | but then no that wont work | 21:52 |
| clarkb | flashgordon: no | 21:52 |
| clarkb | flashgordon: you should just test it locally | 21:52 |
| flashgordon | clarkb: I did | 21:52 |
| flashgordon | it worked | 21:52 |
| clarkb | ok, now propose the change to openstack/requirements | 21:52 |
| clarkb | then update hacking | 21:52 |
| flashgordon | ohh I see | 21:53 |
| *** amotoki has quit IRC | 21:53 | |
| *** jeckersb has joined #openstack-infra | 21:54 | |
| openstackgerrit | Joe Gordon proposed a change to openstack/requirements: Bump pep8, pyflakes and flake8 versions https://review.openstack.org/85496 | 21:56 |
| *** thomasem has quit IRC | 21:56 | |
| flashgordon | clarkb: that should do it ^ | 21:56 |
| *** alff has joined #openstack-infra | 21:56 | |
| *** alff_ has joined #openstack-infra | 21:56 | |
| *** rcleere has quit IRC | 21:57 | |
| flashgordon | clarkb: oh right | 21:59 |
| clarkb | flashgordon: I would comma delimit them, don't use a range | 21:59 |
| clarkb | flashgordon: that way you are asserting two versions that work in the interim | 21:59 |
| zaro | clarkb: the keys in review_site/etc shoud match one in puppet file right? | 22:00 |
| clarkb | zaro: yes | 22:00 |
| clarkb | zaro: if they don't then you know that string needs to be edited in the puppet manifest | 22:00 |
| zaro | ok. thanks. | 22:00 |
| *** dcramer_ has quit IRC | 22:01 | |
| *** zns has quit IRC | 22:01 | |
| *** CaptTofu has joined #openstack-infra | 22:03 | |
| * clarkb relocates to home | 22:03 | |
| openstackgerrit | Joe Gordon proposed a change to openstack/requirements: Bump pep8, pyflakes and flake8 versions https://review.openstack.org/85496 | 22:04 |
| *** denis_makogon has quit IRC | 22:04 | |
| *** flaper87 is now known as flaper87|afk | 22:05 | |
| *** prad has quit IRC | 22:06 | |
| *** thuc has quit IRC | 22:08 | |
| *** CaptTofu has quit IRC | 22:08 | |
| *** zns has joined #openstack-infra | 22:08 | |
| *** thuc has joined #openstack-infra | 22:08 | |
| *** thuc has quit IRC | 22:13 | |
| *** mriedem has quit IRC | 22:15 | |
| *** ameade has joined #openstack-infra | 22:21 | |
| *** thedodd has quit IRC | 22:22 | |
| *** dstanek has joined #openstack-infra | 22:23 | |
| *** jgrimm has quit IRC | 22:24 | |
| *** mriedem has joined #openstack-infra | 22:24 | |
| *** ameade has quit IRC | 22:25 | |
| *** Sukhdev has quit IRC | 22:26 | |
| *** melwitt has joined #openstack-infra | 22:33 | |
| *** gondoi is now known as zz_gondoi | 22:33 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-dev/hacking: Make hacking pass pep8 1.5.x https://review.openstack.org/85505 | 22:35 |
| *** maxbit has quit IRC | 22:40 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Fixes to parameters and layout in documentation https://review.openstack.org/83591 | 22:42 |
| *** fbo is now known as fbo_away | 22:43 | |
| *** Ryan_Lane has joined #openstack-infra | 22:43 | |
| openstackgerrit | A change was merged to openstack-infra/storyboard: Fix token validation https://review.openstack.org/84965 | 22:43 |
| *** dcramer_ has joined #openstack-infra | 22:43 | |
| *** gokrokve has quit IRC | 22:44 | |
| *** Ryan_Lane has quit IRC | 22:47 | |
| flashgordon | sdague: want to pass this idea off someone: don't move to pep8 1.5 in hacking 0.9 | 22:47 |
| flashgordon | https://pypi.python.org/pypi/pep8 | 22:47 |
| flashgordon | pep8 1.5 is still really new and they are already up to 1.5.3 due to bug fixes | 22:48 |
| flashgordon | and the biggest addition is we can enforce the space after a '#' in a comment | 22:48 |
| *** dstanek has quit IRC | 22:49 | |
| flashgordon | but then again some of those bug fixes may fix issues in our current version | 22:49 |
| flashgordon | hmm there are a bunch of fix false positives | 22:50 |
| flashgordon | for E12*s | 22:50 |
| flashgordon | going to push forward to 1.5 | 22:51 |
| clarkb | flashgordon: I think keeping up is the best thing, that way we keep the delta as small as possible each release | 22:51 |
| clarkb | otherwise we will need to do the work at some point | 22:51 |
| flashgordon | yeah thats my thinking | 22:52 |
| flashgordon | just a bit concerend in seeing a new version come out just today | 22:52 |
| *** dstanek has joined #openstack-infra | 22:53 | |
| *** hogepodge has joined #openstack-infra | 22:57 | |
| *** zns has quit IRC | 22:57 | |
| *** homeless has quit IRC | 22:58 | |
| *** jeckersb is now known as jeckersb_gone | 22:59 | |
| *** saschpe has quit IRC | 23:00 | |
| *** rlandy has quit IRC | 23:01 | |
| *** adalbas has quit IRC | 23:01 | |
| *** e0ne has quit IRC | 23:04 | |
| *** e0ne has joined #openstack-infra | 23:05 | |
| *** LinuxJedi has quit IRC | 23:07 | |
| *** e0ne has quit IRC | 23:09 | |
| *** Sukhdev has joined #openstack-infra | 23:11 | |
| *** esker has joined #openstack-infra | 23:11 | |
| *** LinuxJedi has joined #openstack-infra | 23:12 | |
| *** adalbas has joined #openstack-infra | 23:18 | |
| *** gokrokve has joined #openstack-infra | 23:23 | |
| *** saschpe has joined #openstack-infra | 23:24 | |
| jhesketh | Morning | 23:31 |
| *** adalbas has quit IRC | 23:32 | |
| pabelanger | fungi: jeblair: Is there any downside with decreasing the DELETE_DELAY timeout in nodepool from 60? | 23:34 |
| clarkb | jhesketh: hi there, I mostly addressed your comments on my zuul stack. The one big thing I didn't address is the comments about the two new tests in the merger poll class | 23:35 |
| *** andreykurilin_ has quit IRC | 23:35 | |
| clarkb | jhesketh: mostly because I wanted to talk with you and jeblair about what we think is appropriate to test there | 23:35 |
| jhesketh | clarkb: sure | 23:35 |
| clarkb | pabelanger: iirc, it is to avoid a race between getting told the job is finished and any IO that is still happening on the slave | 23:36 |
| *** esker has quit IRC | 23:36 | |
| clarkb | pabelanger: for example our console log scp ops complete after the job finished event fires | 23:36 |
| *** Sukhdev has quit IRC | 23:36 | |
| *** Sukhdev has joined #openstack-infra | 23:37 | |
| *** dstanek has quit IRC | 23:37 | |
| pabelanger | clarkb: Ah, interesting. Ya, I'm seeing multiple jobs being launched on nodepool images. Was trying to come up with a way of inforcing one-time use. | 23:38 |
| *** hogepodge has quit IRC | 23:38 | |
| clarkb | pabelanger: if using zuul + gearman jenkins plugin, you can set an option in zuul to offline the slave after the job starts | 23:38 |
| clarkb | then slave will then stay offline until nodepool deletes it | 23:39 |
| * clarkb finds the options | 23:39 | |
| pabelanger | clarkb: Oooh | 23:39 |
| pabelanger | nice | 23:39 |
| *** dstanek has joined #openstack-infra | 23:39 | |
| clarkb | pabelanger: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/openstack_functions.py#n34 does it for us | 23:39 |
| clarkb | pabelanger: then in layout.yaml you do http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n2 and http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/layout.yaml#n310 | 23:40 |
| pabelanger | clarkb: perfect, let me try that out | 23:41 |
| *** thuc has joined #openstack-infra | 23:42 | |
| *** Ryan_Lane has joined #openstack-infra | 23:42 | |
| jhesketh | clarkb: so with your timer race fixes.. I'm wondering if there is another race there. Eg when you load in the non-periodic layout.yaml does it remove the jobs or mark them as lost on the reconfiguration? (I can't remember zuul's functionality) | 23:42 |
| clarkb | jhesketh: the same jobs exist in the other layout, so I think it keeps them | 23:43 |
| jhesketh | ah okay | 23:43 |
| clarkb | however in the one that reports via smtp, I can't change the layout until after the reporting happens | 23:43 |
| jhesketh | perhaps for clarity should we use a 'minimal' layout? | 23:43 |
| clarkb | because that does depend on the original layout | 23:43 |
| *** moted has quit IRC | 23:43 | |
| clarkb | jhesketh: could do that too | 23:43 |
| jhesketh | clarkb: would it be too picky to ask for that? | 23:44 |
| clarkb | no, drop a comment and I can add that | 23:45 |
| clarkb | that way if the other layout changes it won't break these tests | 23:46 |
| jhesketh | awesome, thanks | 23:46 |
| *** amotoki has joined #openstack-infra | 23:49 | |
| *** SumitNaiksatam has quit IRC | 23:50 | |
| *** esker has joined #openstack-infra | 23:51 | |
| *** e0ne has joined #openstack-infra | 23:52 | |
| *** amotoki has quit IRC | 23:54 | |
| *** wenlock has joined #openstack-infra | 23:54 | |
| *** dcramer_ has quit IRC | 23:54 | |
| mordred | clarkb: this: http://blog.habets.pp.se/2011/07/OpenSSH-certificates seems like something we want, because it seems moar better - but on the other hand, I think it's been too long of a week for me to actually understand what the heck is going on | 23:54 |
| clarkb | mordred: you should talk to nibalizer I am pretty sure when he is bored he makes things like that work | 23:55 |
| *** bhuvan has quit IRC | 23:55 | |
| mordred | nibalizer: do openssh certificates make our lives better? worse? or the same? | 23:55 |
| *** e0ne has quit IRC | 23:56 | |
| mordred | hrm. reading more - it doesn't seem like it reall solves much... | 23:58 |
| clarkb | mordred: I honestly think the idea that a vpn gets you seomthing over ssh is silly | 23:59 |
| mordred | clarkb: I agree | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!