Wednesday, 2014-01-01

fungiit may make sense to reapply puppet configuration first to reset as much of that as possible00:00
fungisince that will hopefully fix ownership and permissions back on any critical files we tracked in the manifest00:00
fungihowever, that will also undo local edits you've done to, for example, the apache vhost so you'd need to remember to redo those if so00:01
*** loq_mac has joined #openstack-infra00:01
*** nati_ueno has joined #openstack-infra00:01
*** krotscheck has quit IRC00:03
*** markmcclain1 has joined #openstack-infra00:07
*** markmcclain has quit IRC00:07
*** rakhmerov has joined #openstack-infra00:13
jeblairfungi: i'd like to merge 63019.  i think the best way to get more feedback on it at this point is to start running it and see if people feel strongly about it.  it's completly (and trivially) reversible, so i think doing so is low-cost.00:15
jeblairhttps://review.openstack.org/#/c/63019/00:16
jeblair(i'm personally in favor of it; it looks like the original sketches i drew when i designed nnfi)00:16
Alex_Gaynorjeblair: complaint about the code: if you `command click` the link to the review, it still minimizes the box :(00:16
Alex_Gaynorjeblair: probably the minification shouldn't happen if a modifier key is held down00:17
*** rakhmerov has quit IRC00:18
jeblairAlex_Gaynor: i think even a regular click on the link causes it00:18
Alex_Gaynorjeblair: it does, but if you're leaving hte page who cares ;)00:18
jeblairAlex_Gaynor: it still bothers me a little (it provides the wrong kind of visual feedback -- you clicked to leave the page, not to modify it, why is it being modified?) but i agree it has less of a real effect00:19
jeblairAlex_Gaynor: either solution (don't change when clicking the link, or don't change when holding a modifier would be an improvement)00:20
*** loq_mac has quit IRC00:25
*** jcooley_ has joined #openstack-infra00:27
*** dims has quit IRC00:29
*** jcooley_ has quit IRC00:32
*** dstanek has quit IRC00:35
*** loq_mac has joined #openstack-infra00:36
*** rongze has joined #openstack-infra00:38
*** rongze has quit IRC00:42
*** dims has joined #openstack-infra00:44
fungijeblair: i'm fine with it merging, i just didn't want to approve it myself if there were people who still wanted to weigh in, as opposed to the typical "2x +2 and you're in"00:49
fungiat this point it's been stable for about a week with no objections, so seems like it's had plenty of time now00:51
*** loq_mac has quit IRC00:51
clarkbsqlalchemy 0.9.0 is a thing now00:53
clarkbthey warn that pinning will probably be necessary :/00:54
fungia "working" thing, or a "broken" thing? (or do we not yet know whether the cesium atom decayed and released the cyanide gas canister?)00:54
clarkbI think they consider it working. I highly doubt openstack will work with it00:55
clarkbbut it is on pypi00:55
zaroclarkb, jeblair, fungi : please review-dev.o.o  a quick test run.  it finally looks to be working now.00:57
fungizaro: funny, i had just now re-checked it on a whim. looks good so far!00:57
openstackgerritA change was merged to openstack-infra/config: zuul status: Collapse changes by default  https://review.openstack.org/6301900:57
clarkbzaro: I notice that the plugins list is empty, does that mean even the default plugins are not installed?00:57
zarofound one problem.  new user signup, agreeing to license causes don't have permission error.00:58
clarkbzaro: did the upgrade kill the CLA signing? I have to resign the CLA looks like00:59
zarogotta head out now. but will check the .war i used.  i thought it was the _full_ released one, but might be just gerrit without plugins.00:59
*** senk has joined #openstack-infra01:06
fungiclarkb: zaro: agreed, it seems to think i haven't signed the icla, even though the db still has my entry in there as valid01:10
fungiand trying to agree to it again is giving me "The page you requested was not found, or you do not have permission to view this page."01:10
fungiquick, to the logs!01:10
jog0WAT https://review.openstack.org/#/c/63567/01:11
clarkbjog0: welcome to the jungle01:12
* jog0 carefully his steps and walks away01:13
clarkbjog0: tl;dr I think that is what happens when you have users that don't use git review01:13
jog0backtraces ^01:13
clarkbit is possible to push specific commits without their dependencies01:13
jog0clarkb: o_O01:13
clarkbI am trying to remember the circumstances around that01:13
clarkbSpamapS: didn't you run into that once?01:14
*** rakhmerov has joined #openstack-infra01:14
clarkbjog0: basically that change will need to be rebased and you can ask the contributor how they pushed it in the first place01:15
clarkbchances are drafts, no git review, or cherry pick are involved01:15
*** senk has quit IRC01:16
jog0clarkb: done01:17
*** dstanek has joined #openstack-infra01:17
fungiclarkb: zaro: the only anomalous thing i can find in the gerrit and apache logs so far is that my browser is trying (and failing) to get /accounts/self/avatar?s=10001:18
clarkbfungi: silly avatars01:18
fungiand i don't think that would be likely to cause the icla weirdness01:18
*** rakhmerov has quit IRC01:19
clarkbfungi: I agree01:19
SpamapSclarkb: run into what?01:19
clarkbSpamapS: cannot merge because parent commit is unknown01:19
clarkbin gerrit01:19
*** senk has joined #openstack-infra01:21
fungiclarkb: what's weird is that zuul was able to check out the change successfully so that tests could be run01:22
clarkbfungi: ya, I think the parent may be in git but not tracked as a change in gerrit01:22
fungiagreed, trying to see if i can tell how/why01:23
fungigit log claims the parent change is I6683c41d39685dcb7f7a619a36210a987c9e982501:23
fungia.k.a. https://review.openstack.org/6281901:24
*** adam_g has quit IRC01:25
*** adam_g has joined #openstack-infra01:25
*** adam_g has quit IRC01:25
*** adam_g has joined #openstack-infra01:25
fungibut its sha in the git log (de7ad2c) is not the sha of any of the patchsets for that change01:25
clarkbfungi: and patchset 4 of the broken change depends on the previous patchset of 6281901:25
clarkbsomehow they got detached01:25
clarkbthere is a group of users out there not using git-review because apparently they were told that was a work around for the auto rebasing (which we actually want in most cases)01:26
*** senk has quit IRC01:27
clarkbdoes 62819 have a draft patchset 10?01:27
fungidoesn't seem to, no01:29
fungihowever git log claims "CommitDate: Tue Dec 31 11:14:40 2013 +0800" for 62819, which is newer than the last patchset in gerrit01:30
fungiabout two minutes earlier than the latest patchset for 6356701:31
fungiso i suspect that the author rebased them, but then only pushed the tip commit to review rather than the parent with it01:32
fungier, but then how did de7ad2c get into gerrit...01:33
* mordred is a fan of our new review-dev overlord01:34
clarkbfungi: de7ad2c got in because it was dragged in by the broken change01:34
clarkbfungi: so the git bits have it but gerrit never saw it01:34
fungimmm... that seems like a bit of an oversight, that gerrit allows that to happen at all, but i guess i'm overlooking some reason why that's acceptable or possibly even necessary under some circumstances01:36
clarkbI think it is a bug01:36
lifelessisn't it because gerrit does a merge not a rebase, to bring revisions in ?01:38
*** rongze has joined #openstack-infra01:38
*** dcramer_ has quit IRC01:38
lifelessIf the rev being merged had a dep which was evolved then landed, the prior change id shows as merged01:39
lifelessin gerrit's head, but not in gits head.01:39
lifelessbasically, standard git rules - either use merge everywhere, or rebase everywhere.01:39
clarkblifeless: no the problem appears to be that gerrit never had a change created for the parent commit01:39
clarkbthe commit is in git itself, but Gerrit doesn't know about it from a review standpoint01:39
*** nati_ueno has quit IRC01:41
fungiin other news of the weird, gerrit 2.5 added the ability to code-review acl changes ("save for review" button on acl editor ui)01:41
fungiautomatically adds project owners to the change (which thankfully for us is just "administrators" so no new back door there)01:41
clarkbfungi: it will also prevent ssh event stream for most users by default01:42
clarkbwe will need to update the ACLs for that01:42
fungiyep, i saw that mentioned01:42
*** rongze has quit IRC01:43
fungimore relevant to the current problem at hand, contributor agreements changed in 2.5 to be config-centric and use the db less... so that might point to our behavior change there. still digging into the details and seeing whether that evolved further by 2.801:43
fungi"Add a new schema to move the ContributorAgreement, AccountAgreement, and AccountGroupAgreement information into the All-Projects project.config."01:44
fungi(from the 2.5 release notes)01:44
fungi2.6 added some contributor agreement documentation01:46
fungiseems nothing new mentioned in 2.7 or 2.8, so that narrows the scope of what we need to look at i think01:46
fungihttps://review-dev.openstack.org/Documentation/config-cla.html01:48
*** nati_ueno has joined #openstack-infra01:51
fungilooks like the upgrade routine did copy the relevant agreement configs from the database into refs/meta/config for all-projects01:55
fungihowever the icla config section refers to a group named "CLA Accepted - ICLA"01:57
fungiand that group is not in the groups list that i can see01:57
fungiso that *might* be the issue01:57
*** CaptTofu has quit IRC01:58
*** CaptTofu has joined #openstack-infra01:58
fungiwhile the docs don't say, i suspect the account_agreements table is no longer used, and group membership is the only mechanism used for that now01:58
*** blamar has joined #openstack-infra01:59
fungiwhich means we'll probably need to precreate and auto-add all icla signers to "CLA Accepted - ICLA" prior to (or while) upgrading01:59
fungiclarkb: zaro: ^02:00
clarkbfungi: interesting02:00
*** xchu has joined #openstack-infra02:01
clarkbfungi: should I try accepting it through the normal process and see what happens?02:01
fungiit looks like the autoverify feature now adds your account to the specified group in the all-projects project.config now instead of adding an entry to the table in the db02:02
fungiclarkb: if you try accepting it, you get an error right now02:02
fungii'm thinking that's probably because it wants to add you to the group since you aren't in it, but then discovers that group dne02:02
fungicurrent hunch--haven't actually tried to prove that out02:03
clarkbCannot store contact information02:03
clarkboh the group DNE02:03
fungioh, that's separate. i didn't try adding contact info since it seemed to know i'd already filed contact info in march02:04
fungithe error i get is the vague one i mentioned earlier about "page doesn't exist or maybe you don't have permission to view this page"02:05
fungiwhich i think is it trying to access the nonexistent group to add me to it02:05
fungianyway, need to split for a bit, but back in a while02:06
*** adam_g has quit IRC02:07
*** adam_g has joined #openstack-infra02:07
*** adam_g has quit IRC02:07
*** adam_g has joined #openstack-infra02:07
fungiwe'll of course also want to test contact info mechanics once we work out the cla issues (separate but interrelated features)02:10
*** rakhmerov has joined #openstack-infra02:15
*** jcooley_ has joined #openstack-infra02:16
*** rakhmerov has quit IRC02:20
*** jcooley_ has quit IRC02:21
*** rongze has joined #openstack-infra02:39
*** jerryz has quit IRC02:42
*** rongze has quit IRC02:43
*** AaronGr is now known as AaronGr_Zzz03:07
*** tma996 has joined #openstack-infra03:07
*** jcooley_ has joined #openstack-infra03:10
*** CaptTofu has quit IRC03:13
*** CaptTofu has joined #openstack-infra03:13
*** tma996_ has joined #openstack-infra03:14
*** tma996 has quit IRC03:14
*** jcooley_ has quit IRC03:15
*** rakhmerov has joined #openstack-infra03:16
*** loq_mac has joined #openstack-infra03:19
*** rakhmerov has quit IRC03:20
*** tma996_ has quit IRC03:28
*** loq_mac has quit IRC03:32
*** tma996_ has joined #openstack-infra03:33
*** dstanek has quit IRC03:37
*** adam_g has quit IRC03:37
*** adam_g has joined #openstack-infra03:37
*** adam_g has quit IRC03:37
*** adam_g has joined #openstack-infra03:37
*** rongze has joined #openstack-infra03:38
*** rongze has quit IRC03:45
*** CaptTofu has quit IRC03:57
*** CaptTofu has joined #openstack-infra03:58
*** tma996_ has quit IRC04:03
*** tma996 has joined #openstack-infra04:04
*** jcooley_ has joined #openstack-infra04:05
*** jcooley_ has quit IRC04:11
*** rakhmerov has joined #openstack-infra04:16
*** rakhmerov has quit IRC04:21
*** jcooley_ has joined #openstack-infra04:25
*** thedodd has joined #openstack-infra04:25
*** praneshp_ has joined #openstack-infra04:31
*** praneshp has quit IRC04:32
*** praneshp_ is now known as praneshp04:32
*** jcooley_ has quit IRC04:33
*** jcooley_ has joined #openstack-infra04:34
*** rongze has joined #openstack-infra04:38
*** ArxCruz has quit IRC04:44
*** rongze has quit IRC04:47
*** rakhmerov has joined #openstack-infra05:17
*** adam_g has quit IRC05:19
*** adam_g has joined #openstack-infra05:19
*** adam_g has quit IRC05:19
*** adam_g has joined #openstack-infra05:19
*** rakhmerov has quit IRC05:22
clarkbwoah when did https://pypi.python.org/pypi/libvirt-python happen and why wasn't it bigger news around here?05:28
clarkbif no one has sorted that before I get back from LCA I am going to have to make nova consume that instead of system pacakges05:29
clarkb(this depends on updating libvirt on precise whcih require cloud archive which doesn't work, but there is real incentive now)05:29
fungii saw it got discussed that the effort was underway--is it operable now?05:30
*** jcooley_ has quit IRC05:30
clarkbfungi: its on pypi05:30
fungiwell, yeah, *something's* on pypi at least ;)05:31
clarkbfungi: it requires newer C libvirt than what we have on precise because the linkage stuff wasn't correct until later05:31
fungii have to assume something working05:31
*** jcooley_ has joined #openstack-infra05:31
fungisure, that much i'd have expected anyway05:31
clarkbso it won'y actually build against our current slaves, we need to get the gate working with newer libvirt05:31
clarkb0.9.8 iirc05:31
fungiyeah, any news on the "libvirt breaks tempest tests" front? i haven't checked back in on that bug in a while05:32
clarkbfungi: I think it is still broken05:32
clarkbits kind of hilariously bad because in theory that means openstack doesn't work on newer ubuntu05:33
openstackgerritClark Boylan proposed a change to openstack/requirements: Add libvirt-python in prep for using pypi libvirt  https://review.openstack.org/6459505:33
clarkbpushed that to get it up, I don't expect it to actually pass check testing05:34
fungii didn't really understand how there was such excitement to get that turned on, so we did, everything broke, someone worked on it for a while, said "it's fixed!" but i decided to try it anyway and... nope, still broken05:34
*** garyk has quit IRC05:34
fungisince i've not noticed new updates on the bug, i'm guessing people lost interest in figuring out why it was broken05:34
clarkbthe excitement for me is we can stop using system packages in nova tox.ini virtualenvs05:35
*** jcooley_ has quit IRC05:35
fungioh, i understand the excitement in being able to use all sorts of new features which come with the various packages in uca. what i don't understand is why there's not been more effort to get it to work05:36
clarkbfungi: I think the incentive has been minimal, but with libvirt-python being a thing I have reason to spend time on it05:36
clarkbreally we should point Mr. Berrange at it and beg, but I think the fact that ubuntu is broken hurts us05:37
*** adam_g has quit IRC05:37
*** adam_g has joined #openstack-infra05:37
*** adam_g has quit IRC05:37
*** adam_g has joined #openstack-infra05:37
fungii couldn't agree more05:37
clarkbworst case icehouse maintains status quo and juno hops on trusty with whatever libvirt is available there05:38
clarkbI completely missed the J name vote somehow, but my vote wouldn't have mattered anyways05:41
fungii wanted jekyll, but juno will be easier to type i guess, so there's always that05:42
*** rongze has joined #openstack-infra05:42
clarkbya but juno is that movie05:42
clarkbalso a city in alaska05:42
clarkb>_>05:42
*** jhesketh has joined #openstack-infra05:43
*** CaptTofu has quit IRC05:45
fungiand a goddess in the roman pantheon05:45
*** CaptTofu has joined #openstack-infra05:45
*** rongze has quit IRC05:47
clarkbwe need to strategically plant the 'R' release summit in seattle. For Rainier05:47
fungior just plain rainy05:49
clarkbI would accept rainy as well05:52
*** tma996 has quit IRC05:54
*** jcooley_ has joined #openstack-infra06:01
*** jcooley_ has quit IRC06:02
*** jcooley_ has joined #openstack-infra06:03
*** jcooley_ has quit IRC06:08
*** dcramer_ has joined #openstack-infra06:10
*** rakhmerov has joined #openstack-infra06:18
*** jcooley_ has joined #openstack-infra06:20
*** rakhmerov has quit IRC06:24
*** tma996 has joined #openstack-infra06:25
*** rongze has joined #openstack-infra06:38
*** rongze has quit IRC06:42
*** tma996 has quit IRC06:58
*** tma996 has joined #openstack-infra07:04
*** garyk has joined #openstack-infra07:06
*** rakhmerov has joined #openstack-infra07:21
*** rakhmerov has quit IRC07:25
*** rongze has joined #openstack-infra07:26
*** blamar has quit IRC07:28
*** jhesketh has quit IRC07:37
*** tma996 has quit IRC07:37
*** banix has joined #openstack-infra07:51
*** rakhmerov has joined #openstack-infra08:21
*** banix has quit IRC08:24
*** rakhmerov has quit IRC08:26
*** rcarrillocruz has joined #openstack-infra08:33
*** tma996 has joined #openstack-infra08:34
*** rongze has quit IRC08:50
*** rongze has joined #openstack-infra08:51
*** sHellUx has joined #openstack-infra08:53
*** rongze has quit IRC08:55
*** rongze has joined #openstack-infra08:59
*** jcooley_ has quit IRC09:06
*** tma996 has quit IRC09:07
*** nati_ueno has quit IRC09:08
*** loq_mac has joined #openstack-infra09:09
*** rakhmerov has joined #openstack-infra09:22
*** jcooley_ has joined #openstack-infra09:24
*** jcooley_ has quit IRC09:25
*** garyk has quit IRC09:26
*** rakhmerov has quit IRC09:27
*** garyk has joined #openstack-infra09:27
*** nati_ueno has joined #openstack-infra09:27
*** jcooley_ has joined #openstack-infra09:29
*** jcooley_ has quit IRC09:34
*** loq_mac has quit IRC09:43
*** thedodd has quit IRC09:48
*** salv-orlando has joined #openstack-infra09:50
*** loq_mac has joined #openstack-infra09:52
*** nati_ueno has quit IRC09:56
*** tma996 has joined #openstack-infra10:04
*** garyk has quit IRC10:09
*** tma996 has quit IRC10:09
*** garyk has joined #openstack-infra10:10
*** garyk has quit IRC10:21
*** rakhmerov has joined #openstack-infra10:23
*** rakhmerov has quit IRC10:28
*** garyk has joined #openstack-infra10:29
*** sHellUx has quit IRC10:32
*** adam_g has quit IRC10:40
*** adam_g has joined #openstack-infra10:40
*** adam_g has quit IRC10:40
*** adam_g has joined #openstack-infra10:40
*** tma996 has joined #openstack-infra10:50
*** loq_mac has quit IRC11:01
*** salv-orlando has quit IRC11:04
*** dguitarbite has quit IRC11:07
*** dguitarbite has joined #openstack-infra11:07
*** rongze has quit IRC11:13
*** rongze has joined #openstack-infra11:14
*** jhesketh_ has joined #openstack-infra11:16
*** rongze has quit IRC11:18
*** dguitarbite has quit IRC11:21
*** rakhmerov has joined #openstack-infra11:24
*** rakhmerov has quit IRC11:28
*** cyeoh_ has joined #openstack-infra11:29
*** cyeoh_ is now known as cyeoh11:29
*** rongze has joined #openstack-infra11:34
*** xchu has quit IRC12:03
*** rakhmerov has joined #openstack-infra12:24
*** CaptTofu has quit IRC12:30
*** CaptTofu has joined #openstack-infra12:30
*** salv-orlando has joined #openstack-infra12:39
*** rakhmerov has quit IRC12:41
*** jhesketh_ has quit IRC12:49
*** CaptTofu has quit IRC13:03
*** Protux has quit IRC13:06
*** sdake has joined #openstack-infra13:23
*** sdake has quit IRC13:23
*** sdake has joined #openstack-infra13:23
*** rakhmerov has joined #openstack-infra13:44
*** CaptTofu has joined #openstack-infra13:55
*** sileht_ is now known as sileht13:56
*** xchu has joined #openstack-infra14:01
*** xchu has quit IRC14:07
*** rongze has quit IRC14:09
*** thomasbiege has joined #openstack-infra14:11
*** thomasbiege has quit IRC14:16
*** rakhmerov has quit IRC14:16
*** rongze has joined #openstack-infra14:20
*** rongze has quit IRC14:39
*** rongze has joined #openstack-infra14:39
*** rongze has quit IRC14:44
*** dstanek has joined #openstack-infra14:52
*** rakhmerov has joined #openstack-infra14:57
*** rongze has joined #openstack-infra14:59
*** adalbas has joined #openstack-infra15:02
openstackgerritKei YAMAZAKI proposed a change to openstack-infra/jenkins-job-builder: Fix multibyte character problem  https://review.openstack.org/6461015:09
openstackgerritKei YAMAZAKI proposed a change to openstack-infra/jenkins-job-builder: Fix multibyte character problem  https://review.openstack.org/6461015:14
*** HenryG has joined #openstack-infra15:26
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add libvirt-dev in anticipation of python-libvirt  https://review.openstack.org/6461115:36
mordredclarkb: ^^ that's needed for https://review.openstack.org/6459515:36
*** banix has joined #openstack-infra15:46
*** CaptTofu has quit IRC15:53
*** DennyZhang has joined #openstack-infra15:53
*** CaptTofu has joined #openstack-infra15:53
*** garyk has quit IRC16:01
*** banix has quit IRC16:03
anteayathe place in Alaska is Juneau16:03
anteayaJuno isn't my favourite goddess but she'll do16:03
*** salv-orlando has quit IRC16:05
*** nati_ueno has joined #openstack-infra16:09
*** annegentle_ has joined #openstack-infra16:21
mordredI can't believe we didn't pick jekyll - that seemed like such an obvious choice16:29
*** adalbas has quit IRC16:29
annegentle_mordred: juno all the way baby16:30
annegentle_any ideas for how to get enough entropy on a cloud server to generate my key? fungi ideas?16:30
annegentle_it has been sitting there for about 10 minutes now16:33
clarkbanteaya thats the joke :P16:35
clarkbmordred cool thanks (it needs newer libvirt too iirc)16:36
*** tma996 has quit IRC16:50
*** nati_ueno has quit IRC16:50
*** DennyZha` has joined #openstack-infra16:55
*** DennyZhang has quit IRC16:55
*** DennyZha` has quit IRC16:59
*** blamar has joined #openstack-infra17:07
*** adam_g has quit IRC17:14
*** adam_g has joined #openstack-infra17:14
*** adam_g has quit IRC17:14
*** adam_g has joined #openstack-infra17:14
*** rakhmerov has quit IRC17:17
*** jcooley_ has joined #openstack-infra17:23
fungiannegentle_: oh, wow... i usually generate mine locally, but... i guess just keep waiting?17:29
fungi(presumably it's finished now? hopefully?)17:29
*** jcooley_ has quit IRC17:31
*** jcooley_ has joined #openstack-infra17:32
*** jcooley_ has quit IRC17:36
*** nati_ueno has joined #openstack-infra17:38
*** jcooley_ has joined #openstack-infra17:38
* fungi disappears for a few hours... back later17:41
anteayaclarkb: sorry I am so out of touch lately17:48
anteayaI feel like I am in the twilight zone17:49
*** rakhmerov has joined #openstack-infra17:53
*** adam_g has quit IRC17:57
*** adam_g has joined #openstack-infra17:57
*** adam_g has quit IRC17:57
*** adam_g has joined #openstack-infra17:57
anteayadoes each jenkins have its own nodepool? or is there one nodepool for all the jenkins?17:59
anteayaa jenkins has an upper limit of about 185 jobs running on individual nodes, yes?17:59
anteayadoes nodepool have an upper limit?17:59
*** rakhmerov has quit IRC18:08
*** ArxCruz has joined #openstack-infra18:16
*** banix has joined #openstack-infra18:27
*** nati_ueno has quit IRC18:31
*** nati_ueno has joined #openstack-infra18:34
*** rakhmerov has joined #openstack-infra18:39
*** adam_g has quit IRC18:40
*** adam_g has joined #openstack-infra18:40
*** adam_g has quit IRC18:40
*** adam_g has joined #openstack-infra18:40
clarkbanteaya: one nodepool for all. nodepool limits tend to come from the cloud providers when they rate limit it18:43
*** salv-orlando has joined #openstack-infra18:44
anteayaclarkb: great thanks18:44
*** salv-orlando has quit IRC18:44
*** salv-orlando has joined #openstack-infra18:45
*** adam_g has quit IRC18:45
*** adam_g has joined #openstack-infra18:46
*** adam_g has quit IRC18:46
*** adam_g has joined #openstack-infra18:46
*** dcramer_ has quit IRC18:46
*** CaptTofu has quit IRC18:51
*** CaptTofu has joined #openstack-infra18:51
*** adam_g has quit IRC18:51
*** adam_g has joined #openstack-infra18:51
*** adam_g has quit IRC18:51
*** adam_g has joined #openstack-infra18:51
*** senk has joined #openstack-infra18:51
*** rakhmerov has quit IRC18:52
*** senk has quit IRC18:53
*** adam_g has quit IRC18:58
*** adam_g has joined #openstack-infra18:58
*** adam_g has quit IRC18:58
*** adam_g has joined #openstack-infra18:58
*** blamar has quit IRC19:00
*** rongze has quit IRC19:06
*** jcooley_ has quit IRC19:07
*** jcooley_ has joined #openstack-infra19:08
*** senk has joined #openstack-infra19:08
*** adam_g has quit IRC19:11
*** adam_g has joined #openstack-infra19:11
*** adam_g has quit IRC19:11
*** adam_g has joined #openstack-infra19:11
*** adam_g has quit IRC19:18
*** adam_g has joined #openstack-infra19:18
*** adam_g has quit IRC19:18
*** adam_g has joined #openstack-infra19:18
*** rakhmerov has joined #openstack-infra19:19
*** rcarrillocruz has quit IRC19:21
*** rakhmerov has quit IRC19:23
*** CaptTofu has quit IRC19:26
*** CaptTofu has joined #openstack-infra19:26
openstackgerritAndreas Jaeger proposed a change to openstack-dev/hacking: Properly show licensing text  https://review.openstack.org/6461819:27
*** senk has quit IRC19:38
*** ivar-lazzaro has joined #openstack-infra19:43
*** ivar-lazzaro has quit IRC19:44
*** vladan_ has joined #openstack-infra19:50
*** jd__` has joined #openstack-infra19:50
*** dkehn_ has joined #openstack-infra19:51
*** rahmu_ has joined #openstack-infra19:51
*** ianw- has joined #openstack-infra19:52
*** dcramer_ has joined #openstack-infra19:53
*** nijaba_ has joined #openstack-infra19:54
*** ianw has quit IRC19:58
*** dkehn has quit IRC19:58
*** rahmu has quit IRC19:58
*** jd__ has quit IRC19:58
*** nijaba has quit IRC19:58
*** vladan has quit IRC19:58
*** rahmu_ is now known as rahmu19:58
*** jd__` is now known as jd__19:58
*** ianw- is now known as ianw19:59
*** vladan_ is now known as vladan19:59
anteayaso this is the slide I have created that show gerrit, zuul, gearman, jenkins and nodepool: https://www.dropbox.com/s/dxz9xw5hw9d03va/gerrit_zuul_jenkins_01.png20:00
*** dcramer_ has quit IRC20:00
anteayalet me know where I err20:00
*** nati_ueno has quit IRC20:01
*** yamahata__ has joined #openstack-infra20:01
*** gema_ has joined #openstack-infra20:03
*** dangers_` has joined #openstack-infra20:05
*** MIDENN_ has joined #openstack-infra20:06
*** rahmu has quit IRC20:07
*** b3nt_pin` has joined #openstack-infra20:07
*** jcooley_ has quit IRC20:08
*** adam_g has quit IRC20:08
*** adam_g has joined #openstack-infra20:08
*** adam_g has quit IRC20:08
*** adam_g has joined #openstack-infra20:08
*** b3nt_pin has quit IRC20:09
*** dangers_away has quit IRC20:09
*** harlowja_away has quit IRC20:09
*** yamahata_ has quit IRC20:09
*** gema has quit IRC20:09
*** mdenny has quit IRC20:09
*** rahmu has joined #openstack-infra20:09
*** jcooley_ has joined #openstack-infra20:09
*** dims has quit IRC20:10
*** dims has joined #openstack-infra20:13
*** dcramer_ has joined #openstack-infra20:13
clarkbanteaya: looks correct, note that most nodepool hosts are connected to jenkins at all times20:15
anteayanodepool hosts20:17
clarkbthe VMs spun up and deleted by nodepool20:17
anteayaso would that be the blue shape creating the stars?20:17
clarkbno the stars20:18
clarkbthe stars are slaves right?20:18
anteayayes20:18
clarkbya the slaves then20:18
anteayanodes/vms/slaves20:18
anteayaI thought nodepool had a reserve of nodes at all times20:18
anteayaand that a jenkins would go fetch a node from the pool when it wanted one20:19
clarkbthere is a reserve of nodes at all times but they are already given to the jenkins20:19
anteayathen nodepool would notice one was missing and spin up a replacement20:19
anteayaah20:19
anteayathat was the part I was missing20:19
anteayaare the equally distributed to all the jenkins?20:19
anteayathe reserve nodes20:20
clarkbyes20:20
anteayagreat thanks20:20
*** rakhmerov has joined #openstack-infra20:20
anteayawill try to depict that relationship20:20
*** dcramer_ has quit IRC20:22
*** rakhmerov has quit IRC20:25
anteayaclarkb: does refreshing give you an edited image?20:29
*** dims has quit IRC20:32
anteayaif not: https://www.dropbox.com/s/dxz9xw5hw9d03va/gerrit_zuul_jenkins_01.png20:33
*** dims has joined #openstack-infra20:34
*** rongze has joined #openstack-infra20:36
*** rongze_ has joined #openstack-infra20:38
*** rongze has quit IRC20:38
*** rongze_ has quit IRC20:43
*** niska has quit IRC20:45
clarkbthat look sgood20:45
anteayathanks20:45
anteayamoving on20:46
*** primeministerp has quit IRC20:46
morganfainbergclarkb, hate to bug you, but ... is zuul unhappy?20:47
clarkbmorganfainberg: a quick glance doesn't indicate so. What are you seeing?20:48
clarkboh a refresh returns nothing20:48
morganfainbergno jobs running (just did a recheck)20:48
morganfainbergand it errored trying to merge a patchset that was based on current master?20:49
morganfainberghttps://review.openstack.org/#/c/63564/20:49
clarkbmorganfainberg: have a link to that?20:49
anteayaI also see no jobs running: http://status.openstack.org/zuul/20:49
*** dims has quit IRC20:49
clarkbit may have run out of file descriptors again :(20:49
morganfainbergah boo20:49
morganfainberg:(20:49
clarkbI really thought my change would fix that but no apparently not20:49
*** dims has joined #openstack-infra20:49
clarkbmorganfainberg: give me a couple minutes I will kick it20:49
morganfainbergsure thing20:49
morganfainbergglad i caught it now rather than.. say in the rush tomorrow morning right?20:50
morganfainberg;)20:50
*** jcooley_ has quit IRC20:50
morganfainbergbecause... there will be a rush :P20:50
anteayahung over code20:50
*** jcooley_ has joined #openstack-infra20:50
morganfainberganteaya, lol.  NaH, just watched the Rose Parade from my office window(s).  figured i'd get some work in while i was in the office20:51
anteayaha ha ha20:51
clarkbwhy are you in the office?20:51
*** niska has joined #openstack-infra20:51
anteayawhy not?20:51
clarkbalso putting the games on ESPN is seriously irritating20:51
anteayawhy?20:51
anteayaadvertising?20:51
clarkbanteaya: ESPN requires cable or satellite20:51
anteayaoh20:51
morganfainbergclarkb, so i could look out of the window and see the rose parade live :) it's kinda nice watching it live w/o needing to camp out20:51
clarkbI want to pay for neither. Prior to the espn deal all BCS games were broadcast20:51
clarkbmorganfainberg: oh gotcha20:52
clarkbderp20:52
morganfainbergclarkb, advantages to living in Pasadena and working from an office with a view of colorado blvd.20:52
anteayasince we have been on satelitte for tv for the last 10+ years, that isn't an obstacle for me20:52
anteayaIf I wanted to watch ESPN20:52
anteayamorganfainberg: how was the parade?20:53
morganfainberganteaya, was pretty cool20:53
anteayanice20:53
morganfainbergStanford's marching band was _awesome_.  also one of the other bands did gangnam style as their song, was entertaining20:53
morganfainbergthe details on the floats are really cool when you're seeing them from like ~25ft away compared to on tv.20:54
*** jcooley_ has quit IRC20:55
*** markmcclain has joined #openstack-infra20:56
*** markmcclain1 has quit IRC20:56
clarkbzuul has been kicked20:56
morganfainbergclarkb, thank you much20:56
anteayaI just checked, I get TSN and ESPN if I want to pay more - I don't20:56
anteayaif I wanted to watch sports I would be watching the winter classic20:57
*** loq_mac has joined #openstack-infra20:57
morganfainberganteaya, clarkb, is it just my browser or ... is the CSS/display kinda wonky on http://status.openstack.org/zuul/ now, i only see [openstack/keystone <patch> <time>] but no stats on the jobs running?20:57
anteayasold out crowd, I understand20:58
morganfainbergi accept it might be my browser20:58
morganfainbergor is that intended.20:58
anteayamorganfainberg: this is a new patch that just went in20:58
anteayaclick the job, it expands20:58
morganfainbergoh20:58
morganfainberg.. *sighs* sometimes i feel less than bright20:59
anteayahttps://review.openstack.org/#/c/63019/20:59
anteayano no20:59
anteayaI just read it today20:59
morganfainbergah20:59
anteayaI would have responded the same as you20:59
morganfainbergmaybe we should get a little + thing on there.20:59
morganfainbergor other iconography that indicates it expands20:59
anteayayeah, it isn't obvious it is clickable21:00
anteayamy cursor moves from an arrow to a vertical line when I hover over the job21:00
anteayaI like it21:00
morganfainbergmine stays an arrow21:00
anteayadoes it21:01
morganfainbergyep. chrome21:01
morganfainbergon os x21:01
openstackgerritClark Boylan proposed a change to openstack-infra/config: Give Zuul file descriptor breathing room.  https://review.openstack.org/6462121:01
clarkbI don't expect jeblair to like 64621 but should give us more room to grow before it falls over21:01
anteayafirefox and ubuntu21:01
morganfainbergclarkb, sometimes you need to fix an issue until the long-term solution can be found21:02
*** dims has quit IRC21:03
anteayaI like the zuul collapse/expand, it will make viewing the page for a specific patch easier21:03
anteayathe learning curve with be... well a curve21:03
*** dims has joined #openstack-infra21:05
*** pcrews_ has joined #openstack-infra21:11
*** senk has joined #openstack-infra21:15
*** dstanek has quit IRC21:16
*** praneshp_ has joined #openstack-infra21:18
*** praneshp has quit IRC21:19
*** praneshp_ is now known as praneshp21:19
*** rakhmerov has joined #openstack-infra21:21
*** rakhmerov has quit IRC21:25
*** jcooley_ has joined #openstack-infra21:30
*** loq_mac has quit IRC21:30
*** loq_mac has joined #openstack-infra21:31
*** loq_mac has quit IRC21:32
*** loq_mac has joined #openstack-infra21:32
*** rongze has joined #openstack-infra21:37
*** primeministerp has joined #openstack-infra21:38
*** Daviey has quit IRC21:40
*** rongze has quit IRC21:44
*** dims has quit IRC21:50
*** Daviey has joined #openstack-infra21:51
*** dims has joined #openstack-infra21:51
*** banix has quit IRC21:53
*** dims has quit IRC22:01
*** dims has joined #openstack-infra22:01
anteayahere is a slide for how to evaluate what tests we are running by looking at the jenkins jobs: https://www.dropbox.com/s/mrt5sury7i51md7/jenkins_jobs.png22:03
anteayaas in how to find the jobs22:03
anteayaam I missing anything important?22:07
*** loq_mac has quit IRC22:13
*** rakhmerov has joined #openstack-infra22:21
*** rakhmerov has quit IRC22:26
anteayaclarkb: this job has failed: https://jenkins02.openstack.org/job/gate-tempest-dsvm-neutron-pg-isolated/351/console22:26
anteayadoes it have anything to do with file descriptors?22:27
anteayathe message mentions a file discriptor issue22:27
anteayadescriptor22:27
clarkbno the file descriptor leak message in the jenkins console logs is harmless22:27
clarkbit is just a warning that the job created files outside the workspace22:28
clarkbthat is a legit failure22:28
anteayaokay thanks22:28
*** dstanek has joined #openstack-infra22:39
*** praneshp_ has joined #openstack-infra22:40
*** rongze has joined #openstack-infra22:40
*** praneshp has quit IRC22:40
*** praneshp_ is now known as praneshp22:40
*** pcrews_ has quit IRC22:43
*** rongze has quit IRC22:45
*** dstanek has quit IRC22:51
*** rakhmerov has joined #openstack-infra23:22
*** adam_g has quit IRC23:26
*** adam_g has joined #openstack-infra23:26
*** adam_g has quit IRC23:26
*** adam_g has joined #openstack-infra23:26
*** rakhmerov has quit IRC23:27
*** dstanek has joined #openstack-infra23:28
*** adam_g has quit IRC23:31
*** adam_g has joined #openstack-infra23:31
*** adam_g has quit IRC23:31
*** adam_g has joined #openstack-infra23:31
*** praneshp has quit IRC23:31
*** senk has quit IRC23:37
*** rongze has joined #openstack-infra23:41
*** jcooley_ has quit IRC23:42
*** jcooley_ has joined #openstack-infra23:43
*** rongze has quit IRC23:45
*** jcooley_ has quit IRC23:48
*** dstanek has quit IRC23:49
*** senk has joined #openstack-infra23:55
*** mgagne has joined #openstack-infra23:58
*** mgagne has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!