Wednesday, 2016-01-06

*** ddieterly has quit IRC00:01
openstackgerritEmilien Macchi proposed openstack-infra/project-config: zuul/layout: disable puppet-tuskar jobs  https://review.openstack.org/26392300:04
*** sdake has quit IRC00:06
*** pahuang has quit IRC00:06
*** camunoz has quit IRC00:06
*** aeng has quit IRC00:06
*** gyee has quit IRC00:07
*** unicell1 has joined #openstack-infra00:07
openstackgerritJay Faulkner proposed openstack/requirements: Add mimic to global requirements to use in tests  https://review.openstack.org/22026800:08
JayFdims: I updated https://review.openstack.org/#/c/220268/ to include the template questions, if you wanna take another look.00:09
*** annegentle has quit IRC00:09
*** unicell has quit IRC00:09
openstackgerritJay Faulkner proposed openstack/requirements: Add mimic to global requirements to use in tests  https://review.openstack.org/22026800:09
*** piet has quit IRC00:13
*** piet has joined #openstack-infra00:13
dimsJayF : ack. starred it, will wait for the ci to finish00:14
*** gyee has joined #openstack-infra00:14
JayFtyvm00:14
*** pfallenop has quit IRC00:19
*** hdd has quit IRC00:19
*** pfallenop has joined #openstack-infra00:19
*** hichihara has joined #openstack-infra00:22
jeblair    RewriteRule ^([^/])([^/]*)/$ /mirror/pypi/web/simple/$1/$1$2/00:22
jeblair    RewriteRule ^([^/])([^/]*)/([^/]+)$/ /mirror/pypi/web/simple/$1/$1$2/$300:22
jeblairkrotscheck: ^00:22
*** Sukhdev has joined #openstack-infra00:22
anteayataron: sorry had a phone call00:23
*** pahuang has joined #openstack-infra00:23
*** aeng has joined #openstack-infra00:23
*** camunoz has joined #openstack-infra00:23
*** gyee has quit IRC00:24
anteayataron: so what options had you considered when codesearch had something it needed to reindex?00:25
clarkbinternap took about 50 minutes to run that job so thats good00:26
clarkband it succeeded \o/00:26
*** harlowja_ has joined #openstack-infra00:27
anteayayay00:27
jeblairwhew00:28
clarkbjeblair: mgagne is next step bumping quota up a bit?00:28
taronanteaya: no worries, I'm somewhat distracted by work00:28
mgagneclarkb that's the plan my boss is pushing =)00:29
jeblairclarkb: ++00:29
anteayataron: yup, I understand, thanks for being available00:29
anteayataron: so restarting hound was the choice because hound has no concept of re-indexing, yes?00:30
*** harlowja has quit IRC00:30
taronanteaya: yes00:30
clarkbjeblair: mgagne are we able to do that now? or do we need to do some layer8 first?00:30
anteayataron: was there any conversation with upstream about hound able to reindex while keeping itself alive?00:31
mgagneclarkb found out we added IPs to the wrong account. fixing now. should have about ~10 instances for now, more once fixed00:31
anteayamgagne: should we offer a patch for 10 instances or wait for the ip fix?00:32
*** dchen has joined #openstack-infra00:32
mgagnewill be fixed in a couple of minutes00:32
* anteaya stands by00:32
anteayaor what number should the patch be after the fix?00:32
*** sdake has joined #openstack-infra00:32
anteayawill take 10 minutes to get through our system00:33
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add a script to list change owner statistics  https://review.openstack.org/26397100:34
taronanteaya: they were receptive to it being added, and auggy (I'm assuming auggy = mmmpork) worked out a rough pull request00:34
taronI'm not sure what occurred after that00:34
taronbut I can take a look at the code again, I've got a much better handle on go now than I did before00:34
fungijeblair: ^ there's a start. still needs to replace some hard-coded constants with configuration or command-line options and add support for extra-atcs00:34
anteayataron: if you would, that would be great00:35
auggytaron: i can share the pull request with you, i haven't made an progress on it since i hashed it out initially00:35
auggytaron: i got sucked into nova stuff so i haven't had time to work on it00:35
anteayataron: if upstream already has some history, it is best to continue with that, rather than asking them to repeat themselves00:35
taronauggy: sure00:35
taronwriting an irc bot is a surprisingly good crash course in finding your way around the basics of a language00:36
auggytaron: https://github.com/missaugustina/hound/tree/bug_119_recheck_for_new_repos00:36
auggyyeah feel free to clean it up, i got this working on linux00:36
auggybut it's still in hack and slash mode00:36
* taron nods00:37
auggysomeone commented on my pull request that they ddidn't get it running locally00:37
auggyi don't think it will run on MacOs but I'm not sure00:37
auggyit depends on how fsnotify works on MacOS00:37
auggyor if it works on MacOS00:37
taronI know someone got hound running on windows as well, don't know how fsnotify works there either00:38
taronbut according to the readme it should00:38
mgagneclarkb should be able to provision 12 instances without much overcommit and 36 with overcommit. more hardware capacity coming soon.00:39
*** rbrndt__ has joined #openstack-infra00:39
clarkbmgagne: cool, maybe we start with 12 then to get it going00:39
clarkbjeblair: anteaya ^00:39
anteayaI can get behind 1200:40
mgagneclarkb yea and see where it goes regarding perf00:40
anteayaclarkb: do you want to do the patch?00:40
clarkbtaron: auggy so is the problem that we restart the service hwenever a new repo is created?00:40
anteayaclarkb: yes00:40
clarkbanteaya: ya I can write it00:40
anteayathanks00:40
anteayaclarkb: upstream doesn't have the use case of the index changing00:40
mgagneclarkb I think our CPU model isn't junk and can overcommit without too much impact if possible =)00:40
auggyclarkb: yes00:41
anteayatheir hound instance indexes once and then runs, done00:41
taronclarkb: just for good measure, have a third yes00:41
jeblairclarkb, mgagne: yeah, let's start with 12 so we have a baseline before we go to 3600:41
auggyclarkb: taron: my patch adds an inotify listener that watches the config file00:41
auggyso when someone adds a repo to the config file, it creates an index process for it00:41
auggyin the meantime, the workaround is to restart hound00:42
taronclarkb: puppet restarts it when projects.yaml changes right now as a stopgap00:42
jeblairhi auggy!00:42
openstackgerritClark Boylan proposed openstack-infra/project-config: Bump internap to 12 nodepool nodes  https://review.openstack.org/26397400:42
auggyall indexing is already stored though so it doesn't have ot restart indexing00:42
clarkbthere we go00:42
anteayafungi: less than 50% of contributors have more than 5 changes, is that for the last 12 months?00:42
auggyjeblair: hi!00:42
jeblairauggy: if notify is a problem, what about a reindex signal?00:42
fungianteaya: 6 months00:42
auggyjeblair: idk, at the time inotify seemed like the way to go on this00:43
anteayafungi: thanks00:43
anteayaclarkb: +200:43
auggyjeblair: but really whatever makes sense00:43
jeblairauggy: it's definitely cooler :)00:43
*** Montgallet has joined #openstack-infra00:43
*** otter768 has joined #openstack-infra00:43
anteayaso right now we believe that upstream is open to this feature addition?00:43
taronit's probably also worth asking the commentor in what way it wasn't working00:44
*** rbrndt__ has quit IRC00:44
jeblairauggy: seems like the right way until words like "windows" and "compatability" start getting thrown around at least :)00:44
anteayawe don't have to maintain a fork?00:44
auggyjeblair: yeah agreed, i'm not sure what kind of support the fsnotify library offers00:44
*** bpokorny has joined #openstack-infra00:44
taronanteaya: yes00:44
taronto upstream support that is00:45
anteayataron: great, thanks00:45
* anteaya nods00:45
taronhttps://github.com/go-fsnotify/fsnotify seems like it should support windows00:45
auggyjeblair: taron: clarkb: yeah feel free to poke around with it, i'm happy to hand it off to taron since i don't really have time to work on it right now :)00:45
taronconveniently, I'm much more free this term than I was last quarter00:45
anteayanice00:46
taronI regret not keeping a running tally of the number of times people asked me "how are you still alive" last term00:47
*** eil397 has joined #openstack-infra00:48
anteayaheh00:48
anteayafungi: any thing I should be aware of prior to testing out your script?00:50
openstackgerritGhanshyam Mann proposed openstack-infra/project-config: Makes non-admin job to use pre provisioned cred  https://review.openstack.org/26397600:51
*** hdd has joined #openstack-infra00:53
anteayajeblair fungi feeling like +3'ing 263974 to increase internap quota from 1 to 12?00:53
fungianteaya: nope, it should "just work" in its current form as long as you put your gerrit username on the command line and then enter your http api password for gerrit when prompted00:54
fungiand then go find something to do for a while00:54
anteayavery good, I'm following your instructions in the comments, then I'll go for a walk00:54
fungiit will warn about some "missing" repos (mentioned in governance but not in gerrit) some of which need cleanup patches to governance to address00:54
anteayawonderful00:55
jeblairanteaya: done00:55
anteayajeblair: thanks00:55
anteayafungi: or maybe not: http://paste.openstack.org/show/483092/00:58
anteayaI copy/pasted my http password and entered it at the prompt00:59
anteayafungi: it wants something I don't have apparently00:59
fungianteaya: are you using a virtualenv?00:59
anteayayes00:59
fungiahh, you activated it, i see there00:59
*** rockyg has quit IRC01:00
fungiinterestingly i also don't get the sni/insecure platform warnings either01:00
*** eil397 has quit IRC01:00
anteayahmmmmm01:00
anteayais this because I am not a gerrit admin I wonder01:00
fungii don't think you should need gerrit admin access for any of the queries01:01
fungibut it's possible i'm wrong01:02
anteayahmmmm01:02
fungineed to see what error it returned from the query01:02
anteayawell so far I'm not doing it right yet01:02
anteayaoh01:02
anteayado you want me to try again after you have some logs tailed?01:02
openstackgerritMerged openstack-infra/project-config: Bump internap to 12 nodepool nodes  https://review.openstack.org/26397401:03
fungichange the emails = json.loads( to just print( and then drop the .text[4:]01:04
anteayaI'll try01:04
fungithen it should display what requests sent back01:04
fungiobviously this script needs better debugging and error handling too ;)01:04
anteaya:)01:05
*** ybathia has quit IRC01:06
anteayafungi: I have this now01:06
anteayahttp://paste.openstack.org/show/483095/01:06
mgagnelooks like change applied to nodepool01:07
anteayaemails = print(requests.get(GERRIT_URL +01:07
anteaya                 ^01:07
anteayaSyntaxError: invalid syntax01:07
anteayamgagne: yay01:07
*** Sukhdev has quit IRC01:08
fungichange the """emails = json.loads(""" to just """print(""" and then drop the """.text[4:]"""01:08
anteayaah sorry01:08
*** eharney has quit IRC01:08
fungino worries, i omitted crucial quoting to separate code from prose in my first try01:09
anteayaNameError: global name 'emails' is not defined01:10
anteayaI'll have to comment the entire next section I think01:10
fungibefore that traceback it should have printed the response from requests though01:12
*** ashleighfarnham has quit IRC01:12
anteayait is just giving me insecure platform warnings01:13
anteayaI'm just getting response 40301:13
anteayahttp://paste.openstack.org/show/483096/01:14
fungioh, drop the [4:] but not the .text01:14
fungisorry01:14
anteayaah01:14
fungiit's telling you the http return code01:14
anteayano problem01:14
fungithough 403 likely means, as you suspected, insufficient permission for the emails method01:15
fungiin which case... disappointed :/01:15
mgagneall instances are active so yea :D01:15
clarkbdouble checking gerrit memory use at the end of the day it was GCing for a semi non trivial01:15
clarkber semi non trivial amount of time01:15
anteayaI currently have this: http://paste.openstack.org/show/483097/01:16
anteayamgagne: yay01:16
*** bpokorny_ has joined #openstack-infra01:16
anteayaclarkb: how much is semi non-trivial?01:17
openstackgerritMerged openstack-infra/devstack-gate: Use qemu everywhere  https://review.openstack.org/26381001:17
clarkb2%01:17
*** clayton has quit IRC01:17
*** clayton has joined #openstack-infra01:18
*** gampel1 has quit IRC01:18
fungianteaya: yeah, that should in theory provide you with the detailed explanation of why it's failing that query for you with a 40301:18
mgagnemuch better now I guess http://goo.gl/jtjBCH (launched nodes stats)01:18
anteayanot allowed to list email addresses: http://paste.openstack.org/show/483098/01:18
anteayafungi: so yes, more helpful than 40301:18
fungianteaya: yep, so you guessed correctly originally01:18
anteayathat makes me sad though01:18
anteayaI wanted to be able to generate electoral roles if need be01:19
anteayaor at least be able to confirm yours01:19
fungii guess we need to figure out: 1. if having that call restricted is for the best, 2. if we think it should be public knowledge then can gerrit control that with a config change, and 3. if not then does someone want to propose new functionality upstream to make that permission configurable01:20
*** bpokorny has quit IRC01:20
anteayawell for me it is most important that your script does what it says it does, even if only for you01:20
anteayawas trying to test the script to confirm that01:21
anteayaas for permissions, well we have gotten this far without the ability, we aren't losing anything if we don't have it01:21
*** bpokorny_ has quit IRC01:21
anteayagiven the number of things we want to ensure notedb does for us, I think upstream focus should be there01:21
anteayathose are my thoughts01:22
anteayafungi: but I like all your comments in your code, very helpful, thank you01:22
fungii think the answer to #1 is no, given that the preferred e-mail is already included in (anonymous!) change query responses, and the only thing for which gerrit uses the non-preferred addresses is determining under which other addresses you can propose changes/patchsets01:23
fungiwhich end up in the committer metadata in git (also public record)01:23
anteayaright01:23
fungiso if this isn't a configurable permission, we should be able to make a case for it becoming configurable01:24
fungizaro: ^ any idea if we're overlooking a setting for that?01:24
anteayaI think I am going to try to get a walk in, do let me know if there is anything I can test01:24
anteayathanks for helping me fungi01:25
fungianteaya: have fun, and thanks for finding the holes in my testing ;)01:25
anteaya:)01:25
*** aeng has quit IRC01:26
*** camunoz has quit IRC01:26
*** dchen has quit IRC01:27
*** pahuang has quit IRC01:27
*** Sukhdev has joined #openstack-infra01:29
*** julim has quit IRC01:30
*** clayton has quit IRC01:30
*** julim has joined #openstack-infra01:30
*** gyee has joined #openstack-infra01:31
*** Qiming has quit IRC01:32
*** sputnik13 has quit IRC01:32
*** [1]Thelo has joined #openstack-infra01:33
clarkbwe are using all 12 internap nodes now01:34
fungiawesome01:34
mgagneyep :D01:34
*** hdd has quit IRC01:34
*** Thelo has quit IRC01:36
*** [1]Thelo is now known as Thelo01:36
*** sridhar_ram has quit IRC01:36
*** aeng has joined #openstack-infra01:38
*** camunoz has joined #openstack-infra01:38
*** dchen has joined #openstack-infra01:39
*** pahuang has joined #openstack-infra01:40
*** sdake has quit IRC01:40
*** ddieterly has joined #openstack-infra01:41
*** gongysh has joined #openstack-infra01:43
*** gongysh has quit IRC01:47
*** sam_wan has joined #openstack-infra01:47
*** Liuqing has joined #openstack-infra01:47
*** rhallisey has quit IRC01:50
*** clayton has joined #openstack-infra01:50
*** Liuqing has quit IRC01:52
*** Swami has quit IRC01:56
*** aeng has quit IRC01:59
*** andreykurilin__ has quit IRC02:02
*** sridhar_ram has joined #openstack-infra02:02
*** mtanino has quit IRC02:07
*** piet has quit IRC02:09
*** annegentle has joined #openstack-infra02:10
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Take parameter order from yaml in trigger_parameterized_builds  https://review.openstack.org/19366002:12
*** annegentle has quit IRC02:14
*** piet has joined #openstack-infra02:15
*** rajinir has quit IRC02:15
*** sridhar_ram has quit IRC02:17
*** Montgallet has quit IRC02:22
*** aeng has joined #openstack-infra02:23
*** Montgallet has joined #openstack-infra02:23
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Simplify 'update and delete old jobs' test  https://review.openstack.org/26294902:23
*** Qiming has joined #openstack-infra02:24
*** sdake has joined #openstack-infra02:27
*** Montgallet_ has joined #openstack-infra02:27
*** Montgallet has quit IRC02:28
*** zhurong has joined #openstack-infra02:32
*** yamamoto has joined #openstack-infra02:35
*** piet has quit IRC02:37
*** yolanda has quit IRC02:38
*** Sukhdev has quit IRC02:39
*** mudassirlatif has quit IRC02:39
*** hichihara has quit IRC02:40
*** weshay_xchat has joined #openstack-infra02:45
*** yamamoto has quit IRC02:48
*** Montgallet_ has quit IRC02:49
*** yamamoto has joined #openstack-infra02:54
*** thorst has quit IRC02:56
*** yamamoto_ has joined #openstack-infra02:57
*** thorst has joined #openstack-infra02:57
*** yamamoto has quit IRC02:57
*** dims has quit IRC02:59
*** thorst has quit IRC03:02
*** yamamoto_ has quit IRC03:07
*** unicell1 has quit IRC03:10
*** thorst has joined #openstack-infra03:17
*** weshay_xchat has quit IRC03:23
*** armax has joined #openstack-infra03:26
openstackgerritMerged openstack-infra/shade: Fix filtering in search_stacks()  https://review.openstack.org/26372403:26
openstackgerritMerged openstack-infra/shade: Add tests for stack search API  https://review.openstack.org/25972703:27
openstackgerritMerged openstack-infra/shade: correct rpmlint errors  https://review.openstack.org/26352603:27
*** gyee has quit IRC03:30
*** pahuang has quit IRC03:32
*** dchen has quit IRC03:32
*** camunoz has quit IRC03:34
*** aeng has quit IRC03:34
*** woodster_ has quit IRC03:36
*** annegentle has joined #openstack-infra03:37
*** unicell has joined #openstack-infra03:37
*** annegentle has quit IRC03:39
openstackgerritSachi King proposed openstack-dev/pbr: Make setup.py --help-commands work without testrepository  https://review.openstack.org/26392803:40
openstackgerritSachi King proposed openstack-dev/pbr: Add dependencies for building wheels  https://review.openstack.org/26401003:40
*** sabeen1 has joined #openstack-infra03:41
*** annegentle has joined #openstack-infra03:44
*** sabeen2 has joined #openstack-infra03:44
*** pahuang has joined #openstack-infra03:45
*** sabeen1 has quit IRC03:46
*** dchen has joined #openstack-infra03:49
*** sputnik13 has joined #openstack-infra03:50
*** aeng has joined #openstack-infra03:51
*** links has joined #openstack-infra03:51
*** yamahata has quit IRC03:52
*** bpokorny has joined #openstack-infra03:52
*** unicell has quit IRC03:54
*** yamamoto has joined #openstack-infra03:57
*** sputnik13 has quit IRC03:59
*** bhunter71 has quit IRC04:02
*** thorst has quit IRC04:04
*** thorst has joined #openstack-infra04:04
*** davideagnello has quit IRC04:05
*** coolsvap|away is now known as coolsvap04:06
*** yamamoto has quit IRC04:06
*** otter768 has quit IRC04:07
*** aeng has quit IRC04:08
*** PsionTheory has quit IRC04:13
*** thorst has quit IRC04:13
*** ramineni has joined #openstack-infra04:13
raminenihi, can someone please review https://review.openstack.org/#/c/258799/204:14
ramineniit will help congress gate tests to pass on stable branches04:15
*** tlian has quit IRC04:24
openstackgerritMerged openstack/requirements: add graphviz library  https://review.openstack.org/25329004:26
*** coolsvap is now known as coolsvap|away04:29
*** sam_wan has quit IRC04:32
*** sam_wan has joined #openstack-infra04:36
*** sdake has quit IRC04:38
*** dchen has quit IRC04:42
*** dahoo has quit IRC04:42
*** sdake has joined #openstack-infra04:44
*** _ody has quit IRC04:44
*** treaki_ has joined #openstack-infra04:45
*** Ramanjaneya has joined #openstack-infra04:48
*** treaki has quit IRC04:49
*** pahuang has quit IRC04:49
*** annegentle has quit IRC04:49
*** oomichi has quit IRC04:49
*** gongysh has joined #openstack-infra04:50
*** annegentle has joined #openstack-infra04:51
*** zhurong has quit IRC04:54
*** ddieterly has quit IRC04:54
*** camunoz has joined #openstack-infra04:55
*** dchen has joined #openstack-infra04:55
zarofungi: there shouldn't be a restriction any restriction to access user emails.  i'm wondering if it might be due to restricted access to groups ->  https://review.openstack.org/#/c/253260/04:57
zarothat change won't change access rights for existing groups.  i believe you'll need to manually do that.04:58
fungizaro: would be odd for groups to be involved since they're not being queried there04:58
zarofungi: well i mean any user can see another user's email from the UI.04:59
fungithis is a query for accounts/<id>/emails05:00
fungiyou can see other users' preferred email from the ui, but not the additional addresses from the "external_account_ids" table05:00
fungier, account_external_ids05:01
*** pahuang has joined #openstack-infra05:02
fungithe rest api query to that method is working for me, but anteaya is getting a 403 forbidden with detail "not allowed to list email addresses"05:03
fungiwhich i suspect is because my account is an administrator and hers is not05:03
openstackgerritIWAMOTO Toshihiro proposed openstack/requirements: Bump ryu to 3.29  https://review.openstack.org/26402605:05
jlvillalAnyone an expert on /opt/git/ and ~jenkins/workspace-cache/?  Basically what should go in them? Working on trying to run developer copy of devstack-gate.05:05
*** gongysh has quit IRC05:06
zarofungi: let me see if it works for me.05:06
jlvillalFollowing the README in https://github.com/openstack-infra/devstack-gate and it says to checkout the code into ~jenkins/workspace-cache/ but in devstack-gate it does an 'rm -fr ~jenkins/workspace-cache/'05:06
*** davideagnello has joined #openstack-infra05:06
clarkbit should rsync before that?05:08
clarkbor at least mv/cp?05:08
jlvillalI see an rsync in devstack-gate-dev.sh.05:09
jlvillalBut the instructions led me to run: devstack-vm-gate-wrap.sh05:09
jlvillalThe rsync was in devstack-vm-gate-dev.sh, I mean.05:10
*** gongysh has joined #openstack-infra05:10
*** thorst has joined #openstack-infra05:10
jlvillalThe content in /opt/git/*  Should those be bare repositories or 'git clone' type repositories?05:10
*** davideagnello has quit IRC05:11
clarkbgit clone05:12
jlvillalThanks05:12
clarkbthey end up being the repos used for devstack so you want to be able to interact with them05:12
jlvillalsetup_workspace is what does the 'rm -fr ~/workspace-cache' in functions.sh as an FYI.05:13
jlvillalNoted on devstack repos. Thanks.05:13
fungithough keep in mind that the copies in /opt/git are optional (unless that's changed since the last time i looked) and are simply copied as a starting point to allow you to pre-cache them on your images and avoid additional network traffic05:14
jlvillalfungi, Thanks. Yes I was hoping to speed things up a bit as I am doing this inside our firewall. So I was hoping to have a cache to help with speed.05:15
fungiin that case, that's exactly what we use /opt/git for as well05:15
fungihence why it's there05:15
jlvillalGreat :)05:15
jlvillalThe README mentiones setting ZUUL_URL to ~jenkins/workspace-cache/ and then doing a git clone.05:16
fungithat's to avoid modifying what's in /opt/git05:16
jlvillalBut it appears that later on the ~jenkins/workspace-cache/ gets blown away. At least I saw that in my logfile.05:17
fungiit in turn gets used when building the checkouts in ~stack05:17
*** fawadkhaliq has joined #openstack-infra05:17
jlvillalI wonder if I should set ZUUL_URL to some other directory. I will probably test that tomorrow05:17
*** thorst has quit IRC05:18
jlvillal'it' being /opt/git?05:18
jlvillalOr ZUUL_URL?05:18
fungiboth05:18
jlvillalOkay.05:19
fungibut my goal with the readme section was to treat /opt/git as read-only, and provide a means to test a modified, e.g., nova repository05:19
jlvillalI must admit, that coming into this with zero experience and trying to figure stuff out has been a tad challenging. But interesting! :)05:19
fungii can _completely_ sympathize05:19
fungigranted, that's how i feel every day of the week ;)05:20
jlvillalNot sure, does it make a difference if I am doing a Grenade job? I have a big long list of projects in PROJECTS05:20
* jlvillal has the ultimate goal of getting the Ironic grenade jobs working.05:20
fungii hope it doesn't make any difference being grenade, but i don't think i explicitly tested grenade with those instructions back when i first wrote them (and they've since been updated by others in an attempt to keep page with devstack and d-g changes)05:21
jlvillalI was trying not to send every test through Zuul. I was hoping setting it up locally I could test changes faster.05:21
jlvillalOkay. I will proceed with it shouldn't make a difference. Probably I should just try a simple 'ironic' devstack run first. Once that is working, then try the grenade job.05:22
fungiit grew out of the vmt's need to have instructions they and others could use to privately replicate d-g based job results for embargoed security fixes05:22
fungiand we mostly just used it for tempest spot-checks05:22
jlvillalI have hopes it will help with my work in trying to get the Ironic grenade job working :)05:23
jlvillalIf I discover errors in the document, I will submit patch(es)05:23
fungiplease do--that's how it's been managing to stay mostly correct05:24
jlvillalI did an initial minor patch: https://review.openstack.org/26354805:24
jlvillalThanks for the help. I'm going to call it a night. And start fresh in the morning.05:24
fungilgtm05:25
fungithanks!05:25
jlvillalThank you!05:25
fungiafter midnight here, so probably time for me to get some sleep as well05:25
jlvillal+105:26
*** rguillebert has quit IRC05:27
*** abregman has joined #openstack-infra05:34
zaroyeah, doesn't work for me either.  i'm getting 'unauthorized' for just about all account endpoints, even with 'self'05:34
*** unicell has joined #openstack-infra05:34
zarofungi: i'm wondering about this capability, https://gerrit-documentation.storage.googleapis.com/Documentation/2.11/access-control.html#capability_viewAllAccounts05:34
fungizaro: seems like we might need to enable that for registered users (or anonymous/all users?)05:35
fungithanks for finding that05:35
*** coolsvap|away is now known as coolsvap05:35
*** annegentle has quit IRC05:36
zaronot, sure since the doc is a bit unclear but worth a try05:36
fungii'll take a closer look tomorrow05:36
*** annegentle has joined #openstack-infra05:36
*** zhurong has joined #openstack-infra05:39
*** gampel has joined #openstack-infra05:43
openstackgerritSachi King proposed openstack-dev/pbr: Add dependencies for building wheels  https://review.openstack.org/26401005:49
openstackgerritSachi King proposed openstack-dev/pbr: Make setup.py --help-commands work without testrepository  https://review.openstack.org/26392805:49
*** piet has joined #openstack-infra05:49
waynrif i want to merge jenkins-job-builder master up into feature/2.0.x, is there a best practice for doing that with gerrit?05:51
*** bpokorny has quit IRC05:52
waynrin this case it's really just a fast forward since none of the feature/2.0.x commits have been merged yet05:53
*** irenab has joined #openstack-infra05:55
*** coolsvap is now known as coolsvap|away05:55
*** ddieterly has joined #openstack-infra05:56
*** ramineni has quit IRC05:58
*** annegentle has quit IRC06:00
*** annegentle has joined #openstack-infra06:00
*** ddieterly has quit IRC06:01
*** annegentle has quit IRC06:04
zarofungi: well i was finally able to retrieve data for /accounts/self/emails but not for any other user. looked up the code and it seems like what's blocking it is indeed viewAllAccounts capability. https://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-server/src/main/java/com/google/gerrit/server/account/AccountControl.java?h=openstack/2.11.4#n10706:06
*** unicell1 has joined #openstack-infra06:06
*** unicell has quit IRC06:07
*** otter768 has joined #openstack-infra06:08
*** piet has quit IRC06:12
*** otter768 has quit IRC06:13
*** thorst has joined #openstack-infra06:16
*** harlowja_at_home has joined #openstack-infra06:16
*** coolsvap|away is now known as coolsvap06:18
*** Ramanjaneya has quit IRC06:19
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Trying the creation of a change using the web ui.  https://review.openstack.org/26403906:19
*** aopincar has joined #openstack-infra06:22
*** thorst has quit IRC06:23
*** david-lyle_ has joined #openstack-infra06:24
*** Qiming has quit IRC06:34
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/26359206:35
*** masber has quit IRC06:36
*** gongysh has quit IRC06:36
*** Sukhdev has joined #openstack-infra06:37
*** isaacb has joined #openstack-infra06:38
*** gampel has quit IRC06:39
*** nelsnels_ has quit IRC06:42
*** nelsnelson has joined #openstack-infra06:49
*** chlong has quit IRC06:50
*** harlowja_at_home has quit IRC06:51
*** kushal has quit IRC06:53
*** sabeen2 has quit IRC06:54
*** david-lyle_ has quit IRC06:56
*** Ramanjaneya has joined #openstack-infra06:56
*** ddieterly has joined #openstack-infra06:57
*** Qiming has joined #openstack-infra06:58
*** Ramanjaneya has quit IRC07:02
*** ddieterly has quit IRC07:02
*** armax has quit IRC07:07
*** davideagnello has joined #openstack-infra07:07
*** dchen has quit IRC07:10
*** davideagnello has quit IRC07:13
*** gampel has joined #openstack-infra07:15
*** isaacb has quit IRC07:20
*** thorst has joined #openstack-infra07:21
openstackgerritlvdongbing proposed openstack-infra/project-config: New Project - Bilean  https://review.openstack.org/26405407:23
*** kushal has joined #openstack-infra07:24
*** e0ne has joined #openstack-infra07:25
*** thorst has quit IRC07:28
*** Ramanjaneya has joined #openstack-infra07:37
*** fawadkhaliq has quit IRC07:37
openstackgerritlvdongbing proposed openstack-infra/project-config: New Project - Bilean  https://review.openstack.org/26405407:39
*** fawadkhaliq has joined #openstack-infra07:40
*** Thelo has quit IRC07:41
*** Sukhdev has quit IRC07:46
*** fawadkhaliq has quit IRC07:48
*** fawadkhaliq has joined #openstack-infra07:49
*** Sukhdev has joined #openstack-infra07:49
*** yolanda has joined #openstack-infra07:56
*** Sukhdev has quit IRC07:57
*** ddieterly has joined #openstack-infra07:58
*** ifarkas has joined #openstack-infra07:59
*** coolsvap is now known as coolsvap|away08:00
*** isaacb has joined #openstack-infra08:00
*** yamahata has joined #openstack-infra08:01
*** arxcruz has joined #openstack-infra08:01
*** ddieterly has quit IRC08:03
*** coolsvap|away is now known as coolsvap08:06
*** otter768 has joined #openstack-infra08:09
*** chlong has joined #openstack-infra08:11
*** otter768 has quit IRC08:14
*** samuelBartel has joined #openstack-infra08:18
*** apoorvad has joined #openstack-infra08:20
*** yaume has joined #openstack-infra08:20
*** thorst has joined #openstack-infra08:26
*** gongysh has joined #openstack-infra08:30
*** jcoufal has joined #openstack-infra08:31
*** mattt has left #openstack-infra08:32
*** shardy has joined #openstack-infra08:32
*** mrmartin has joined #openstack-infra08:33
*** dtardivel has joined #openstack-infra08:33
*** matrohon has joined #openstack-infra08:33
*** thorst has quit IRC08:33
*** masber has joined #openstack-infra08:35
*** flepied1 has quit IRC08:35
*** samuelBartel has quit IRC08:36
*** samuelBartel has joined #openstack-infra08:36
*** AJaeger has joined #openstack-infra08:40
AJaegeryolanda: any reason not to +W https://review.openstack.org/#/c/263568/ ? Clarkb merged yesterday a similar change: https://review.openstack.org/#/c/263566/ . Thanks for the reviews!08:41
yolandai prefered to don't +W a change of this kind, because no time to babysit08:41
*** gongysh has quit IRC08:41
AJaegerah - but that ones should not have any effects. Ok, I'll ask somebody else later...08:42
yolandaif that isn't urgent, i prefer to be cautious and approve when there is some infra-root around...08:43
*** jlanoux has joined #openstack-infra08:43
openstackgerritMerged openstack-infra/project-config: Add ansible-role-functional-jobs-(centos|trusty)-nv  https://review.openstack.org/25868208:43
AJaegeryolanda: it's not urgent, just wanted to understand the reason for not approving...08:45
AJaegerthanks, yolanda08:45
yolandanp08:46
openstackgerritMerged openstack-infra/project-config: net-bagpipe: remove now unneeded -liberty jobs  https://review.openstack.org/26380908:46
openstackgerritMerged openstack-infra/project-config: zuul/layout: disable puppet-tuskar jobs  https://review.openstack.org/26392308:46
*** fawadkhaliq has quit IRC08:46
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Remove deprecated 'extended-choice' properity.  https://review.openstack.org/26301208:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Disentangle YamlParser and ModuleRegistry classes  https://review.openstack.org/26301308:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: TestSubCommand inherit from UpdateSubCommand.  https://review.openstack.org/26301008:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Test at more appropriate boundaries for update.  https://review.openstack.org/26295008:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Remove YamlParser references from JJB modules.  https://review.openstack.org/26301108:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Move 'update' yaml parsing to JenkinsJobs.execute.  https://review.openstack.org/26295108:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Move 'delete' yaml parsing to JenkinsJobs.execute.  https://review.openstack.org/26295208:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Move subcommand logic into subcommand classes.  https://review.openstack.org/26295508:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Factor XmlJobGenerator out of YamlParser.  https://review.openstack.org/26306208:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Don't expose YamlParser methods unnecessarily.  https://review.openstack.org/26295708:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Cleanup to eliminate deprecation warnings.  https://review.openstack.org/26407708:48
openstackgerritWayne Warren proposed openstack-infra/jenkins-job-builder: Remove Python 2.6 compatibility patch.  https://review.openstack.org/26407808:48
*** dingyichen has quit IRC08:49
*** nmagnezi has joined #openstack-infra08:51
*** AJaeger has quit IRC08:55
*** ihrachys has joined #openstack-infra08:55
*** fawadkhaliq has joined #openstack-infra08:56
*** jordanP has joined #openstack-infra08:57
*** ddieterly has joined #openstack-infra08:59
*** _nadya_ has joined #openstack-infra09:00
*** fhubik has joined #openstack-infra09:00
*** sdake has quit IRC09:02
*** nmagnezi has quit IRC09:02
openstackgerritRamana Raja proposed openstack-infra/project-config: Add Manila with CephFSNative driver CI job  https://review.openstack.org/25932309:03
*** ddieterly has quit IRC09:03
*** flepied has joined #openstack-infra09:04
*** flepied1 has joined #openstack-infra09:04
*** fhubik is now known as fhubik_brb09:05
*** sshnaidm_ has joined #openstack-infra09:07
*** fawadkhaliq has quit IRC09:07
*** flepied has quit IRC09:09
*** davideagnello has joined #openstack-infra09:09
*** Ramanjaneya has quit IRC09:10
*** sfinucan has joined #openstack-infra09:12
*** hashar has joined #openstack-infra09:14
*** davideagnello has quit IRC09:14
*** nmagnezi has joined #openstack-infra09:14
*** derekh has joined #openstack-infra09:16
*** jistr has joined #openstack-infra09:17
*** Hal has joined #openstack-infra09:18
*** masber has quit IRC09:18
*** Hal is now known as Guest7658009:19
*** jlanoux has quit IRC09:22
*** jlanoux has joined #openstack-infra09:24
*** apoorvad has quit IRC09:24
openstackgerritlvdongbing proposed openstack-infra/project-config: New Project - Bilean  https://review.openstack.org/26405409:27
*** thorst has joined #openstack-infra09:31
*** zhurong has quit IRC09:31
*** ociuhandu has quit IRC09:34
*** fawadkhaliq has joined #openstack-infra09:35
*** ociuhandu has joined #openstack-infra09:35
*** fawadkhaliq has quit IRC09:36
*** thorst has quit IRC09:38
*** fhubik_brb is now known as fhubik09:38
*** bookwar has quit IRC09:40
*** vkramskikh_ has quit IRC09:42
*** fawadkhaliq has joined #openstack-infra09:43
*** ociuhandu has quit IRC09:44
*** fhubik is now known as fhubik_brb09:45
openstackgerritJesse Pretorius proposed openstack/requirements: Add OpenStack-Ansible to projects  https://review.openstack.org/26409809:49
*** ramineni has joined #openstack-infra09:51
ramineniyolanda: hi09:51
*** vkramskikh has joined #openstack-infra09:52
*** bookwar has joined #openstack-infra09:53
ramineniyolanda: could you please review https://review.openstack.org/#/c/258799/ , it helps to unblock gate for merging stable branch patches into congress project09:54
*** aopincar has quit IRC09:58
*** masber has joined #openstack-infra09:59
*** nmagnezi has quit IRC09:59
*** zeih has joined #openstack-infra10:00
*** ddieterly has joined #openstack-infra10:00
*** aopincar has joined #openstack-infra10:00
*** rguillebert has joined #openstack-infra10:03
*** ddieterly has quit IRC10:05
*** fawadkhaliq has quit IRC10:09
*** otter768 has joined #openstack-infra10:10
*** nmagnezi has joined #openstack-infra10:12
*** otter768 has quit IRC10:14
*** _nadya_ has quit IRC10:15
*** hashar has quit IRC10:15
*** hashar has joined #openstack-infra10:16
*** fhubik_brb is now known as fhubik10:17
*** samuelBartel has quit IRC10:18
*** andreykurilin__ has joined #openstack-infra10:20
*** cdent has joined #openstack-infra10:28
*** ociuhandu has joined #openstack-infra10:31
*** dtantsur|afk is now known as dtantsur10:33
openstackgerritJulien Danjou proposed openstack-infra/project-config: Revert "fix stable/liberty telemetry integration job"  https://review.openstack.org/26411210:34
*** thorst has joined #openstack-infra10:36
*** ramineni has quit IRC10:36
*** ramineni has joined #openstack-infra10:40
*** thorst has quit IRC10:43
*** fawadkhaliq has joined #openstack-infra10:44
*** fawadkhaliq has quit IRC10:45
*** dims has joined #openstack-infra10:47
*** fhubik is now known as fhubik_brb10:48
*** BobBall has quit IRC10:50
*** binbincong has quit IRC10:53
*** binbincong has joined #openstack-infra10:53
*** fawadkhaliq has joined #openstack-infra10:54
*** BobBall has joined #openstack-infra10:56
*** fawadkhaliq has quit IRC10:56
*** ddieterly has joined #openstack-infra11:01
*** fhubik_brb is now known as fhubik11:03
*** kushal has quit IRC11:05
*** kushal has joined #openstack-infra11:06
*** lucas-dinner is now known as lucasagomes11:06
*** ddieterly has quit IRC11:06
*** rfolco has joined #openstack-infra11:09
*** fawadkhaliq has joined #openstack-infra11:10
*** zhurong has joined #openstack-infra11:10
*** zeih has quit IRC11:10
*** davideagnello has joined #openstack-infra11:10
Kiallclarkb: re designate+tempest, yah, we noticed everything started failing. I believe someone is already on it, thanks for the heads up :)11:12
*** davideagnello has quit IRC11:15
*** hashar has quit IRC11:15
openstackgerritChristoph Albers proposed openstack-infra/project-config: Removed EOL icehouse from testjobs  https://review.openstack.org/26413011:18
*** sam_wan has quit IRC11:23
*** fawadkhaliq has quit IRC11:24
*** mriedem has joined #openstack-infra11:28
*** cdent has quit IRC11:28
*** ramineni has left #openstack-infra11:29
andreykurilin__hi all! Zuul allows to configure job to be launched only if specified files are changed. Does it possible to launch such jobs by comment "check all" or something like that? Use-case: launch all jobs before new release.11:36
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Add neutron on-steroids job template for advanced features  https://review.openstack.org/24769711:39
*** nmagnezi has quit IRC11:40
*** thorst has joined #openstack-infra11:41
*** fhubik is now known as fhubik_brb11:45
*** coolsvap is now known as coolsvap|away11:47
*** thorst has quit IRC11:48
*** zeih has joined #openstack-infra11:51
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Add gnocchi for gate-ceilometer-dsvm-integration with oslo.messaging  https://review.openstack.org/26414411:53
dimsjd__ : sdague : oslo.messaging changes got stuck when we dropped gnocchi from gate-ceilometer-dsvm-integration  definition ^^11:56
jd__dims: everything is broken actually, I pushed a revert https://review.openstack.org/#/c/264112/11:57
*** jd__ has left #openstack-infra11:57
dimsjd__ : ah even better11:57
*** jd__ has joined #openstack-infra11:57
*** apoorvad has joined #openstack-infra11:57
*** doug-fish has joined #openstack-infra11:59
*** ddieterly has joined #openstack-infra12:02
*** zhurong has quit IRC12:04
*** skraynev has quit IRC12:04
*** apoorvad has quit IRC12:06
*** zhurong has joined #openstack-infra12:06
*** ddieterly has quit IRC12:06
*** jlanoux has quit IRC12:10
*** ilyashakhat has quit IRC12:10
*** otter768 has joined #openstack-infra12:11
*** otter768 has quit IRC12:15
openstackgerritMerged openstack-infra/tripleo-ci: Use local puppet modules in DIB  https://review.openstack.org/23792912:19
*** dstepanenko_ has quit IRC12:20
*** xwizard_ has quit IRC12:20
*** zeih has quit IRC12:21
*** Ramanjaneya has joined #openstack-infra12:21
*** gordc has joined #openstack-infra12:26
*** samuelBartel has joined #openstack-infra12:29
openstackgerritMerged openstack-infra/project-config: Revert "fix stable/liberty telemetry integration job"  https://review.openstack.org/26411212:31
*** fawadkhaliq has joined #openstack-infra12:38
*** fawadkhaliq has quit IRC12:39
*** fawadkhaliq has joined #openstack-infra12:39
*** jaypipes has joined #openstack-infra12:42
*** claudiub has joined #openstack-infra12:42
*** pradk has quit IRC12:45
*** nadya has joined #openstack-infra12:54
*** nadya is now known as Guest4998612:55
*** trown|outttypeww is now known as trown12:57
openstackgerritlvdongbing proposed openstack-infra/project-config: New Project - Bilean  https://review.openstack.org/26405412:58
*** fhubik_brb is now known as fhubik13:01
*** thorst has joined #openstack-infra13:02
*** ddieterly has joined #openstack-infra13:02
*** hashar has joined #openstack-infra13:03
*** baoli has joined #openstack-infra13:05
*** zz_dimtruck is now known as dimtruck13:06
*** baoli has quit IRC13:06
*** ddieterly has quit IRC13:07
*** baoli has joined #openstack-infra13:07
*** dprince has joined #openstack-infra13:09
*** kgiusti has joined #openstack-infra13:10
*** baoli has quit IRC13:11
*** amuller has joined #openstack-infra13:13
*** rhallisey has joined #openstack-infra13:15
*** yolanda has quit IRC13:15
*** baoli has joined #openstack-infra13:16
*** yolanda has joined #openstack-infra13:16
*** ddieterly has joined #openstack-infra13:16
*** baoli_ has joined #openstack-infra13:17
*** baoli has quit IRC13:20
*** nikil89_ has joined #openstack-infra13:20
*** nikil89_ is now known as nandhu13:20
*** nandhu is now known as naggappan13:20
*** Ramanjaneya has quit IRC13:21
openstackgerritDmitry Tantsur proposed openstack-infra/project-config: Switch to IPA as a primary ramdisk for ironic-inspector jobs  https://review.openstack.org/26416813:21
*** dslev has joined #openstack-infra13:22
*** tzn has joined #openstack-infra13:27
jklarehi, anybody around who knows how to properly remove old eol branches from repositories in github?13:28
jklarelike the ones here https://github.com/openstack/cookbook-openstack-compute/branches13:28
openstackgerritMerged openstack-infra/zmq-event-publisher: Remove broken scm section  https://review.openstack.org/26356813:30
*** weshay_xchat has joined #openstack-infra13:30
fungijklare: normally the deletions propagate when those branches are deleted from gerrit13:30
*** dimtruck is now known as zz_dimtruck13:31
*** weshay_xchat is now known as weshay13:31
jklarefungi: for me it looks like they do not exist in gerrit anymore https://review.openstack.org/#/admin/projects/openstack/cookbook-openstack-bare-metal,branches13:31
jklarefungi13:31
jklarefungi ups wrong project13:31
jklarefungi so you are right13:31
fungijklare: look at for example https://review.openstack.org/#/admin/projects/openstack/cookbook-openstack-compute,branches13:32
fungiif there are branches which need deleting from gerrit, let us know13:32
jklarefungi can is send you a list or something?13:32
*** links has quit IRC13:32
jklarefungi i guess there are multiple repositories which need some cleanup13:32
*** esker has joined #openstack-infra13:33
*** jlanoux has joined #openstack-infra13:33
*** masber has quit IRC13:33
fungijklare: sure, send a list of deletion needs to openstack-infra@lists.openstack.org and one of the gerrit admins will get to it as time allows13:33
jklarefungi great ty13:33
*** edmondsw has joined #openstack-infra13:34
*** tlian has joined #openstack-infra13:36
*** amrith is now known as _amrith_13:38
*** piet has joined #openstack-infra13:38
*** dslev has quit IRC13:38
*** aopincar has quit IRC13:41
*** ddieterly has quit IRC13:43
*** eharney has joined #openstack-infra13:43
*** Ramanjaneya has joined #openstack-infra13:44
*** thiagop has joined #openstack-infra13:49
*** dkranz has joined #openstack-infra13:52
*** Guest49986 has quit IRC13:53
*** naggappan has quit IRC13:54
*** tzn has quit IRC13:55
*** nadya has joined #openstack-infra13:55
*** nadya is now known as Guest2169113:56
*** zeih has joined #openstack-infra13:58
*** annegentle has joined #openstack-infra14:01
*** Guest21691 has quit IRC14:02
openstackgerritMerged openstack-infra/release-tools: Keep py3.X compatibility for urllib  https://review.openstack.org/26123314:02
*** julim has quit IRC14:03
*** bcourt has quit IRC14:05
*** ilyashakhat has joined #openstack-infra14:07
*** ayoung has joined #openstack-infra14:11
*** otter768 has joined #openstack-infra14:12
*** kzaitsev_mb has joined #openstack-infra14:13
*** zz_dimtruck is now known as dimtruck14:15
*** otter768 has quit IRC14:16
openstackgerritZara proposed openstack-infra/storyboard-webclient: Make it clear that all fields are required  https://review.openstack.org/26419314:17
*** gampel1 has joined #openstack-infra14:17
*** peristeri has joined #openstack-infra14:18
*** skraynev has joined #openstack-infra14:18
*** dstepanenko_ has joined #openstack-infra14:18
*** changbl has quit IRC14:19
*** gampel has quit IRC14:19
*** gampel has joined #openstack-infra14:20
*** bcourt has joined #openstack-infra14:20
*** gampel1 has quit IRC14:22
*** links has joined #openstack-infra14:22
*** gampel1 has joined #openstack-infra14:23
*** zhurong has quit IRC14:23
*** kzaitsev_mb has quit IRC14:24
*** jordan__ has joined #openstack-infra14:26
*** gampel has quit IRC14:26
*** AJaeger has joined #openstack-infra14:27
*** ddieterly has joined #openstack-infra14:27
*** ddieterly has quit IRC14:27
*** ddieterly has joined #openstack-infra14:27
*** links has quit IRC14:28
AJaegersdague: could you review https://review.openstack.org/#/c/258799/2/jenkins/jobs/congress.yaml , please? The way of disabling tempest looks strange to me and I'd like somebody else to check this14:28
*** kzaitsev_mb has joined #openstack-infra14:29
*** dimtruck is now known as zz_dimtruck14:29
*** jordanP has quit IRC14:29
*** lucasagomes is now known as lucas-hungry14:30
openstackgerritEmilien Macchi proposed openstack-infra/project-config: run integration jobs for puppet-ironic  https://review.openstack.org/26419614:31
*** jsavak has joined #openstack-infra14:32
*** jsavak has quit IRC14:32
*** esker has quit IRC14:32
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Add OpenStack-Ansible check-requirements job  https://review.openstack.org/26419714:32
*** jsavak has joined #openstack-infra14:33
*** Ramanjaneya has quit IRC14:33
openstackgerritJesse Pretorius proposed openstack/requirements: Add OpenStack-Ansible to projects  https://review.openstack.org/26409814:33
*** gordc has quit IRC14:37
AJaegerodyssey4me: I suggest you first get your requirements lists fixed so that it only includes packages in global-requirements, otherwise you will get problems merging changes...14:38
*** Swami has joined #openstack-infra14:38
*** piet has quit IRC14:39
*** _amrith_ is now known as amrith14:39
odyssey4meAJaeger oh, can the project not have any requirements outside of those specified in global-requirements?14:39
odyssey4meie if we have requirements, we need to put them into global-requirements too?14:39
*** kzaitsev_mb has quit IRC14:39
*** piet has joined #openstack-infra14:39
pabelangeryolanda: AJaeger: fungi: mordred: do you mind helping with stastd 3.0 for zuul? https://review.openstack.org/#/c/229232/ I'd like to ask jeblair to cut a new release today and would love to land that14:40
AJaegerodyssey4me: read the requirements developer document that I referenced in the requirements change, it explains it.14:40
AJaegerodyssey4me: you can't get half-wet, either you join the requirements process or not.14:40
odyssey4meAJaeger I'm busy doing exactly that :)14:40
sdagueAJaeger: the tempest all plugins thing is weird14:41
sdaguethe rest of it seems fine14:41
AJaegersdague: thanks for confirming my suspicion14:41
*** ari has joined #openstack-infra14:41
AJaegerpabelanger: sorry, zuul is out of my expertise14:42
*** amitgandhinz has joined #openstack-infra14:42
*** pradk has joined #openstack-infra14:42
*** itzdilip has joined #openstack-infra14:46
*** esker has joined #openstack-infra14:46
*** bhunter71 has joined #openstack-infra14:49
*** julim has joined #openstack-infra14:49
fungipabelanger: no way to support statsd 2 and 3 at the same time?14:51
* anteaya has to run an errand, back in a few hours14:52
*** itzdilip has quit IRC14:53
*** bcourt has quit IRC14:54
*** annegentle has quit IRC14:55
*** gordc has joined #openstack-infra14:55
*** annegentle has joined #openstack-infra14:55
*** zeih has quit IRC14:56
*** nadya has joined #openstack-infra14:57
*** nadya is now known as Guest934514:57
*** mrmartin has quit IRC14:58
*** sigmavirus24_awa is now known as sigmavirus2414:59
mordredinfra-root: I'm going to cut a new shade. I do not expect it to have any noticable effects on infra thinga, but wanted to give a heads up14:59
pabelangerfungi: sure we could, just code.  We've already migrated nodepool to 3.0 a few weeks ago14:59
SamYaple/w/win 1314:59
AJaegerfungi, clarkb, could either of you review https://review.openstack.org/263678 - especially the way etcd is downloaded? We do not have etcd on our nodes and I'm curious what you think about the download from remote for each test...14:59
pabelangerAJaeger: np14:59
*** zeih has joined #openstack-infra15:02
*** thiagop is now known as thiagop-lunch15:03
mordredShrews: ^^ 0.14.0 yeah? on sha 457ea844aa85dd59343fb51bae41b98f782eb4e815:04
fungipabelanger: yep, i see it's consistent with nodepool, thanks. precedent!15:05
Shrewsmordred: yeah15:05
*** bcourt has joined #openstack-infra15:06
Shrewsmordred: uhh, 1.4.0 ?15:06
mordredShrews: yes. that's what I meant15:06
mordredclearly15:06
Shrewsmordred: i don't know that. you might be drunk15:07
*** cdent has joined #openstack-infra15:07
mordredShrews: tag pushed15:07
Shrews\o/15:08
fungiAJaeger: i think we had originally suggested to run those jobs on fedora, which has etcd available15:08
mordredAJaeger, fungi: I agree about that suggestoin15:08
fungiAJaeger: i didn't mean for the package install revert to imply that we shouldn't install etcd packages, just that we shouldn't try to install them on platforms where they're unavailable15:08
*** regXboi has joined #openstack-infra15:09
*** notnownikki has joined #openstack-infra15:09
*** sparkyco_ has joined #openstack-infra15:10
AJaegerok, let me add a comment to it now, thanks15:10
*** zz_dimtruck is now known as dimtruck15:10
fungii just did15:11
AJaegergreat, then I press cancel ;)15:11
fungii'm not super concerned about the download if that's what they want (hence no -1 from me). it's just tooz after all, so low change volume and not likely to be a major gate impact if the job goes flaky15:11
*** davideagnello has joined #openstack-infra15:12
*** annegentle has quit IRC15:12
fungibut i don't want them to feel like they have to "roll their own" etcd because we're being annoying about what packages they can install15:13
AJaegerthanks for the explanation.15:13
*** rraja has joined #openstack-infra15:15
*** dprince has quit IRC15:16
*** davideagnello has quit IRC15:16
*** amitgandhinz has quit IRC15:16
*** amitgandhinz has joined #openstack-infra15:17
AJaegerfungi, what is Infra's official URL? Looking at http://git.openstack.org/cgit/openstack-infra/puppet-infra-cookiecutter/tree/puppet-%7B%7Bcookiecutter.project_name%7D%7D/README.md#n17 I see "[OpenStack-infra](https://git.openstack.org/cgit/openstack-infra)" which looks strange to me. In governance it's http://git.openstack.org/cgit/openstack/governance/tree/reference/projects.yaml#n90415:18
*** dprince has joined #openstack-infra15:18
AJaeger"http://docs.openstack.org/infra/system-config/"15:18
AJaegerShould we use http://docs.openstack.org/infra/ in both cases?15:18
AJaegerOr do you have a better URL?15:19
fungiAJaeger: yeah, i guess the docs url is preferable for referring to our team in puppet modules15:20
*** xyang0 has joined #openstack-infra15:20
krotscheckjeblair: Danke :)15:20
*** dprince has quit IRC15:20
AJaegerfungi: also in governance?15:20
*** dprince has joined #openstack-infra15:20
*** sparkyco_ has quit IRC15:21
openstackgerritDmitry Tantsur proposed openstack/requirements: Bump futurist g-r to 0.6.0  https://review.openstack.org/26422015:21
fungiAJaeger: sorry, i misread that you had suggested a third url which was also docs15:21
fungilet's stick with the system-config docs as the team url15:21
fungiit's more relevant than a list of random project documents15:22
AJaegerok15:22
fungiwhich is why i chose that when updating governance15:22
fungi(previously it was a wiki article which linked to our system-config docs, which were originally the top-level index on the ci.o.o site)15:23
AJaegeryes, the other doc URL includes infra manual and other stuff. I'm fine with the system-config one.15:23
AJaegerah...15:23
*** dloi has left #openstack-infra15:23
fungiyeah, http://ci.openstack.org/ became http://docs.openstack.org/infra/system-config/15:24
fungiso that we weren't publishing documents from different repos as subtrees of documents from other repos15:24
fungithat way lies madness15:24
vponomaryovfungi: do you know some specific changes to "infra stuff" that could happen on 3 january, 2016, about 4 PM?15:24
fungivponomaryov: my ring buffer only holds so much. might browse the channel log on eavesdrop?15:25
vponomaryovfungi: I mean some "rebuilds" of something15:25
fungi4pm utc?15:26
AJaegervponomaryov: what broke at that time?15:26
vponomaryovfungi: that is not seen in logs of CI jobs15:26
AJaegernew images?15:26
vponomaryovfungi: zuul timezone15:26
*** yamahata has quit IRC15:26
AJaegervponomaryov: zuul timezone = UTC15:26
fungiyeah, zuul (all our servers) use utc15:26
*** mtanino has joined #openstack-infra15:26
*** yamahata has joined #openstack-infra15:26
vponomaryovAJaeger, fungi: Nova started to be very slow at attaching volume to VMs that causes following bug - https://bugs.launchpad.net/nova/+bug/153084715:27
openstackLaunchpad bug 1530847 in OpenStack Compute (nova) "TypeError attaching volume to instance" [High,In progress] - Assigned to Matt Riedemann (mriedem)15:27
vponomaryovAJaeger, fungi: started suddenly, all packages and code are the same15:27
fungiso... worker image updates start at 14:14 utc daily these days and do start having some workers getting into rotation by 16:0015:27
openstackgerritAndreas Jaeger proposed openstack-infra/puppet-infra-cookiecutter: Update Infra URL  https://review.openstack.org/26422415:28
fungiit's possible ubuntu pushed updated packages for something in 14.04 lts on the 2nd or 3rd?15:28
*** saggi has quit IRC15:28
vponomaryovfungi: exactly 3rd january15:28
vponomaryovfungi: Ci jobs started before 3pm were ok15:28
fungivponomaryov: you might have luck comparing the distro package lists from jobs which broke and jobs which worked to see what's different between them (if anything)15:29
fungii'm pretty sure we dump a dpkg -i in devstack15:29
vponomaryovfungi: I did, no diff15:29
fungihuh, so not that15:29
fungiany differences in the pip freeze?15:30
vponomaryovfungi: it is same too15:30
vponomaryovfungi: for same node type15:30
vponomaryovfungi: but behavior is the same for all nodes15:30
openstackgerritAndreas Jaeger proposed openstack-infra/puppet-grafyaml: Update Infra URL  https://review.openstack.org/26422515:30
fungiand no nova changes landed around that time to account for the behavior difference either?15:30
vponomaryovfungi: yes15:31
openstackgerritAndreas Jaeger proposed openstack-infra/puppet-infracloud: Update Infra URL  https://review.openstack.org/26422715:31
fungiare you seeing it for every run or just occasionally?15:31
vponomaryovfungi: stable since 3rd january15:31
mriedemvponomaryov: i don't see how that one pci schema db change in nova would cause that failure you're seeing15:31
mriedemwith devices not being detached15:32
mriedemon 1/315:32
fungiif it's just some runs experiencing this, might want to check logstash to see if it's exhibiting in some providers but not others15:32
openstackgerritAndreas Jaeger proposed openstack-infra/puppet-odsreg: Update Infra URL  https://review.openstack.org/26423115:32
*** Guest9345 has quit IRC15:32
*** dprince has quit IRC15:32
vponomaryovmriedem: do you have "timing" statistics for "attaching" ?15:32
*** dprince has joined #openstack-infra15:32
vponomaryovmriedem: creation of VM, voluem and its attach takes about 9 minutes now15:33
vponomaryovmriedem: 4 min for Vm and 5 for other things15:33
*** lucas-hungry is now known as lucasagomes15:33
vponomaryovmriedem: that is the reason15:33
vponomaryovmriedem: we excceed limit for 26 devices15:33
vponomaryov3 times slower15:33
vponomaryovthan it was15:33
vponomaryovmriedem: devices cannot be detached because of transient state, so nothing bad about "release"15:34
vponomaryovmriedem: need get to know why it became so slow15:35
*** isaacb has quit IRC15:35
*** annegentle has joined #openstack-infra15:36
vponomaryovmriedem: tempest just cannot afford itself waiting so long and runs other tests not deleting previous resources15:36
fungivponomaryov: have you been able to recreate that behavior locally? if so, try bisecting nova around that date?15:37
vponomaryovfungi: not yet15:37
vponomaryovfungi: own lab was slow always15:38
AJaegerfungi, is cutting a juno-eol tag for openstack-manuals still on your list? It's not urgent, just don't want to have it lost - see http://lists.openstack.org/pipermail/openstack-infra/2015-December/003561.html15:38
fungivponomaryov: gate jobs run on an 8gb vm with ~8 vcpu cores if you have access to something similar15:38
pc_mOn tox.ini files, why do some of the constraints environments, like pep8-constraints repeat definitions from non-constraints (e.g. pep8's 'commands')? There doesn't look like any variable substitution.15:39
fungiAJaeger: yeah, it is. summit invite season jumped me in a dark alley so i've prioritized getting that working with gerrit 2.11 for the moment15:39
pc_mAnyone know?15:39
vponomaryovfungi: 8 cores with which frequenzy?15:39
mriedemvponomaryov: always 8 VCPU and 8 GB RAM15:40
*** Sukhdev has joined #openstack-infra15:40
fungivponomaryov: various, but i'll find something representative15:40
AJaegerpc_m: lifeless and Nakato are the experts for that but let me check this - do you have an example?15:40
AJaegerpc_m: neutron?15:40
*** tonytan4ever has joined #openstack-infra15:40
mriedemvponomaryov: have we looked at cinder history around 1/3 to see if cinder is taking longer for attach/detach?15:40
pc_mAJaeger: Sure... the cookiecutter example for one: http://git.openstack.org/cgit/openstack-dev/cookiecutter/commit/%7b%7bcookiecutter.repo_name%7d%7d/tox.ini?id=3a4cfd2225b93f7bca767d305432266bf0bafc0515:41
vponomaryovmriedem:I don't such info15:41
mriedemvponomaryov: we should probably jump to the -nova channel15:41
mriedemthis is happening on all test nodes from what i can tell, so it's not really infra15:41
*** zeih has quit IRC15:41
pc_mAJaeger: cover-constraints duplicates what is used for 'commands', as is in cover.  Ditto for docs, pep8, etc.15:41
vponomaryovmriedem: ok15:41
vponomaryovfungi, mriedem, AJaeger: thank you15:42
fungivponomaryov: an example from rackspace's iad region has /proc/cpuinfo claiming "Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz"15:42
pc_mAJaeger: I'm try to add constraints to VPN and have followed suit for targets, but wondering if needed, if there is no {envdir} or the like.15:42
openstackgerritMark Vanderwiel proposed openstack-infra/project-config: Add heat lbaas specific test for v1 and v2  https://review.openstack.org/23715615:42
fungivponomaryov: and bogomips: 5187.1415:42
*** notnownikki has quit IRC15:43
fungivponomaryov: so basically 8x2.6ghz15:44
*** zaro has quit IRC15:44
AJaegerpc_m: I see this here http://git.openstack.org/cgit/openstack/neutron/tree/tox.ini#n175 but don't know why it's not done for the other cases in the same way. Best ask lifeless directly15:44
vponomaryovfungi: good to know, thank you15:44
fungiyw15:45
*** notnownikki has joined #openstack-infra15:45
fungiAJaeger: pc_m: also http://codesearch.openstack.org/ is great for finding examples of similar patterns in things like tox.ini across all projects15:45
*** tsg has joined #openstack-infra15:45
AJaegerfungi: yes, codesearch is really great - helped me with updating the Infra URL ;)15:46
*** pc_m has quit IRC15:46
*** Ramanjaneya has joined #openstack-infra15:47
*** cloudtrainme has joined #openstack-infra15:47
openstackgerritAri proposed openstack-infra/jenkins-job-builder: Updated to support changes to openshift pipeline plugin  https://review.openstack.org/26335415:48
*** pc_m has joined #openstack-infra15:48
*** jordanP has joined #openstack-infra15:48
*** devananda has quit IRC15:48
fungiinstalling scipy from pypi is bringing my workstation to its knees15:49
* fungi sighs15:49
*** jordan__ has quit IRC15:51
pc_mlifeless: ping?15:52
*** hdd has joined #openstack-infra15:52
*** zaro has joined #openstack-infra15:53
openstackgerritAndreas Jaeger proposed openstack-infra/jenkins-job-builder: Warn only once for masked definitions  https://review.openstack.org/26424115:54
AJaegerpc_m: he's in New Zealand - contact him later15:55
pc_mAJaeger: thanks15:55
pc_mAJaeger: I'm going to play with this locally some and see what the variables show, when using other environments.15:56
AJaegerpc_m: did you get my neutron reference before you disappeared?15:56
*** hdd has quit IRC15:56
openstackgerritAndreas Jaeger proposed openstack-infra/jenkins-job-builder: Warn only once for masked definitions  https://review.openstack.org/26424115:57
*** nadya has joined #openstack-infra15:57
pc_mAJaeger: yes. Thank you. I don't see a consistent use... some duplicate, some reuse.15:57
pc_mAJaeger: e.g. pep8 duplicates.15:58
*** nadya is now known as Guest8976115:58
AJaegerpc_m: I agree, this could use a consistent setup15:58
*** krtaylor has quit IRC15:58
pc_mAJaeger: I'm doing printenv in the targets and seeing what things are saying.15:58
*** Qiming has quit IRC15:59
AJaegerpc_m: Nakato did that change in  Ie679904330a83e4b7eb75c189b48afef127b0d22 - and it's not consistent either.15:59
AJaegerpc_m: have to leave now, looking forward to a clean solution ;)16:00
*** AJaeger has quit IRC16:00
*** esker has quit IRC16:00
*** Guest89761 has quit IRC16:01
*** devananda has joined #openstack-infra16:01
*** sabeen1 has joined #openstack-infra16:02
*** cloudtrainme has quit IRC16:03
*** saggi has joined #openstack-infra16:04
*** sabeen2 has joined #openstack-infra16:04
*** austin81 has joined #openstack-infra16:04
*** jsavak has quit IRC16:04
openstackgerritMerged openstack/requirements: Keep py3.X compatibility for urllib  https://review.openstack.org/26119016:05
*** arxcruz has quit IRC16:06
*** rajinir has joined #openstack-infra16:06
*** unicell has joined #openstack-infra16:06
*** sabeen1 has quit IRC16:06
rrajayolanda: hi! it'd be great if you could review this patch when you got time, https://review.openstack.org/#/c/259323/ . thanks!16:06
*** cloudtrainme has joined #openstack-infra16:07
*** gampel1 has quit IRC16:07
*** jsavak has joined #openstack-infra16:08
*** unicell1 has quit IRC16:08
*** krtaylor has joined #openstack-infra16:10
*** salv-orlando has joined #openstack-infra16:12
*** esker has joined #openstack-infra16:12
jeblairmordred: would you have a few minutes today for the two of us to work together on the ansible run stuff?  reading the log on puppetmaster makes me think there's still work to do there.16:12
*** esker has quit IRC16:12
*** davideagnello has joined #openstack-infra16:12
*** otter768 has joined #openstack-infra16:12
*** rraja_ has joined #openstack-infra16:13
*** vgridnev has joined #openstack-infra16:13
*** davideagnello has quit IRC16:14
*** davideagnello has joined #openstack-infra16:14
*** sdake has joined #openstack-infra16:14
*** esker has joined #openstack-infra16:14
pleia2good morning16:14
*** otter768 has quit IRC16:17
openstackgerritJames E. Blair proposed openstack-infra/system-config: Redirect puppet cron output to a log file  https://review.openstack.org/26425216:19
jeblairpleia2: good morning!16:19
jeblairpleia2, fungi: ^ 4.6G of my mail spool is that16:19
jeblairalso, i really hope none of it is passwords showing up in puppet diffs.16:20
openstackgerritZara proposed openstack-infra/storyboard: Rudimentary Templates for Tasks  https://review.openstack.org/26425516:23
*** sparkyco_ has joined #openstack-infra16:26
fungijeblair: indeed, my ~/Maildir/.openstack-cronspam is 3.1gb according to du, and i have a cronjob which deletes any messages older than 30 days from it16:27
*** sparkyco_ has quit IRC16:28
*** masber has joined #openstack-infra16:29
*** fhubik is now known as fhubik_brb16:31
openstackgerritIsaac Beckman proposed openstack-infra/puppet-jenkins: Allow setting java heap size in jenkins default  https://review.openstack.org/26278716:31
*** bpokorny has joined #openstack-infra16:31
*** isaacb has joined #openstack-infra16:32
*** bpokorny has quit IRC16:32
pleia2jeblair: grumble, so /opt/system-config/production/run_all.sh doesn't actually dump all its output into its defined log file16:32
*** bpokorny has joined #openstack-infra16:32
*** fhubik_brb is now known as fhubik16:33
*** matrohon has quit IRC16:33
jeblairpleia2: well, at the top it sets ANSIBLE_LOG_PATH which apparently tells ansible where to log, so the puppet_run_all log does in fact have the output of all the puppet runs, but just not the output of the script that performs all the puppet runs.  :)  i thought about renaming them further, but it's all a bit ambiguous.  if you or someone else has strong feelings i'd be fine with that.16:34
pleia2jeblair: yeah, the commit message was helpful but it still took me a few moments to figure out why we had two cron jobs with similar names16:36
pleia2I think it's ok though16:36
*** ashleighfarnham has joined #openstack-infra16:37
*** ashleighfarnham has quit IRC16:37
*** ashleighfarnham has joined #openstack-infra16:37
openstackgerritAri proposed openstack-infra/jenkins-job-builder: Updated to support changes to openshift pipeline plugin  https://review.openstack.org/26335416:38
*** davideagnello has quit IRC16:39
*** abregman has quit IRC16:41
*** dtantsur is now known as dtantsur|afk16:41
*** armax has joined #openstack-infra16:42
openstackgerritMerged openstack-infra/puppet-hound: Append to logfile instead of overwriting  https://review.openstack.org/26395316:42
openstackgerritIsaac Beckman proposed openstack-infra/puppet-openstackci: Pass java heap size as parameter to jenkins master  https://review.openstack.org/26302116:42
*** rfolco has quit IRC16:45
jeblairpleia2: you mean two logrotate entries?16:46
pleia2jeblair: er, yeah16:46
jeblairwhew16:46
vponomaryovguys, does CI nodes have access to internet?16:46
vponomaryovs/does/do/16:47
jesusaurusvponomaryov: yes, they do16:47
pleia2vponomaryov: yes, but I advise careful consideration when running tests that download things, failing tests due to sites being down are sad16:48
vponomaryovjesusaurus, pleia2: thank you16:48
*** rfolco has joined #openstack-infra16:49
*** ddieterly has quit IRC16:50
*** piet has quit IRC16:50
*** fhubik has quit IRC16:51
*** erlon has joined #openstack-infra16:51
*** ddieterly has joined #openstack-infra16:52
isaacbjeblair: Can you please look in: https://review.openstack.org/#/c/239363/16:53
clarkbsdague: is there a bug tracking the cirros boot fails on ovh? wonder if e-r will tell us if the qemu switch fixed it16:57
sdagueclarkb: yeh, there is an ER signature16:57
*** salv-orlando has quit IRC16:57
*** nadya has joined #openstack-infra16:58
*** gyee has joined #openstack-infra16:58
sdagueclarkb: http://status.openstack.org//elastic-recheck/#153115516:58
*** nadya is now known as Guest1026016:58
clarkbthanks16:58
sdagueit hasn't failed in the last 24 hours, but it was pretty spotty previously, so that's not a guaruntee that it's gone16:58
*** salv-orlando has joined #openstack-infra16:58
sdaguebut it should tell us in a week16:58
clarkbya will need to see how it does over a greater span of time16:59
*** jordanP has quit IRC16:59
*** ddieterly has quit IRC16:59
*** mrmartin has joined #openstack-infra17:00
*** dslevin_ has joined #openstack-infra17:00
jeblairisaacb: we should ask clarkb to look at https://review.openstack.org/#/c/239363/17:01
*** ddieterly has joined #openstack-infra17:01
*** Sukhdev has quit IRC17:01
*** sean-k-mooney has joined #openstack-infra17:02
clarkbjeblair: isaacb my only thing would be to check if ip addr add has a similar flag to the --may-exist for ovs-vsctl17:02
mordredjeblair: there is definitely still work to do there17:03
clarkb(doesn't look like it)17:03
waynrzaro hashar zxiiro anyone have time to review https://review.openstack.org/#/c/193660/ ?17:05
hasharwaynr: sorry I am unlikely to review anything this week :(17:05
fungizaro: now i'm remembering one other challenge i ran into the last time i tried to work on rest-ifying our atc listing script... there's not actually an authoritative indication in the change details indicating _when_ a change merged. the closest i seem to be able to get is to scrape comments for a comment without an author field and take the date field from that (optionally matching on the text17:05
fungi"Change has been successfully merged"). doable but could be a lot cleaner if gerrit exposed the "submitted" date (which is what we were using from the ssh api details)17:05
*** jlanoux has quit IRC17:05
waynrhashar: okay i'll try to remember17:06
clarkbfungi: and that isn't another option you can pass?17:06
fungiclarkb: not that i've been able to find so far17:07
waynrfungi: i don't necessarily want it now, but i am curious if i should ping you to get a merge up to feature/2.0.x from master branch on jenkins-job-builder?17:07
fungiwaynr: didn't i create one weeks ago when you asked?17:07
fungiwaynr: nevermind, i misread17:07
fungiwaynr: you want a merge from master into the feature branch so you can sync in updatews17:07
fungiwaynr: yeah, when you're ready for one let me know17:08
clarkbfungi: and I guess the updated field is not sufficient because comments can be made at arbitraary times after merging17:08
fungiclarkb: correct17:08
fungiclarkb: also matching just on the comment text risks spoofing17:08
waynryeah, yesterday I tried creating a merge commit with "git commit --no-ff" and submittng that as a review, but gerrit rejected it because I don't have permission to push merge commits17:08
*** tongli has joined #openstack-infra17:09
*** trown is now known as trown|lunch17:09
fungiclarkb: and i also worry that matching on lack of an author in the comment may be twitchy too if that's a behavior which has changed at some point in a gerrit release17:09
*** sshnaidm_ has quit IRC17:09
*** isaacb has quit IRC17:09
waynrwhich is interesting because prior to yesterday it never occurred to me that there is a kind of protocol difference between merge and code commits17:09
jeblairfungi: it really lacks author?17:09
fungijeblair: yep17:09
openstackgerritZara proposed openstack-infra/storyboard: Rudimentary Templates for Tasks  https://review.openstack.org/26425517:10
jeblairfungi: i'm skeptical...17:10
fungiand as i understand it, the ssh api treats "submitted" as a hidden label, but because that's an implementation detail they don't want to expose it as a queryable label in the rest api17:10
jeblairfungi: it should be a special 'Gerrit Code Review' account as the author17:11
fungijeblair: for example pull https://review.openstack.org/changes/262321/detail and then look at ['messages'][9]17:11
fungiit's the only comment in that change with no 'author' key17:12
fungias i said, possible that it's a behavior change in gerrit too, which makes it even riskier to match on17:12
jeblairfungi: oh yep, you're right.17:13
jeblairfungi: fwiw, gertty depends on that behavior to identify the system account17:13
jeblairfungi: so it's been there since 2.8 at least17:13
clarkbfungi: the labels get timestamps too17:13
clarkbso you could take the oldest of the +2s17:14
fungiclarkb: yep, however submitted is not a "label" from the rest api standpoint (though it is in the ssh api)17:14
jeblairfungi: i think matching on 'no author' and 'Change has been successfully merged' is good17:14
jeblairfungi: or, i suppose, getting the last message from the system accunt on a merged change would work as well.17:15
*** jgriffith is now known as jgriffith_away17:15
jeblairfungi: (just be aware that in the middle, the system account may leave messages like 'unable to merge')17:15
fungijeblair: yeah, it's good enough for now. i'll see what is possible for getting that exposed through the rest api somehow in a future gerrit release17:15
mordredjeblair: I'm in a meeting all day today - but I can try to sync up with you on next steps - I've got the config option we need added to the underlying inventory code17:16
*** piet has joined #openstack-infra17:17
jeblairmordred: you free later this week?17:18
mordredjeblair: 3 day meeting. of course, I can still type to you while in a meeting - it just might be clunky17:19
mordredjeblair: actually, meeting starts each day at 11am central - so we could do tomorrow morning17:19
Sam-I-Ammornings.17:19
*** bhunter71 has quit IRC17:19
sean-k-mooneyhi sorry to interupt but does anyone know what the best way to delete a remote tag is?17:19
*** salv-orlando has quit IRC17:19
jeblairmordred: let's do that for maximum syncage, then i can run with it.  i'll zuulv3 today.17:20
*** salv-orlando has joined #openstack-infra17:20
fungisean-k-mooney: there really isn't17:20
fungisean-k-mooney: deletion replicates to push mirrors, but not via git pull17:21
mordredjeblair: cool17:21
fungisean-k-mooney: so anyone who has done a remote update (including systems in our infrastructure which fire on tags) will have that tag indefinitely even if it's deleted from the remote17:21
fungisean-k-mooney: worse, if you then attempt to replace the tag with another of the same name, pull/update won't see it change17:22
sean-k-mooneyfungi: i created an alias tag as we are changing form the old data based versions to semantic versioning but now i have a pbr error with the old tags so i need to remove the new tags17:22
fungisean-k-mooney: usually best to pretend tags are undeletable instead17:22
*** rockyg has joined #openstack-infra17:22
sean-k-mooneyfungi:  ValueError: git history requires a target version of pbr.version.SemanticVersion(2015.1.0), but target version is pbr.version.SemanticVersion(1.0.0)17:23
fungisean-k-mooney: sounds like you neglected to adjust setup.cfg maybe?17:23
sean-k-mooneyfungi well i was tagging a reviously tagged commit but kept both tags17:24
*** mrmartin has quit IRC17:24
sean-k-mooneyso i could not update the commit17:24
*** hashar has quit IRC17:24
*** isaacb has joined #openstack-infra17:24
*** sfinucan has quit IRC17:24
fungisean-k-mooney: someone with deeper pbr-fu than i probably needs to weigh in (mordred? lifeless?)17:25
*** esker has quit IRC17:25
clarkbI am pretty sure you need to update setup.cfg then tag that17:25
lifelesspc_m: its a limtation of tox's interpretation of things, Nakato went to fix the bug, but then tox folk went weird and into a messy sideways design debate17:25
*** ashleighfarnham has quit IRC17:25
clarkblifeless: oh that happened to you all too?17:25
clarkbfun fun17:25
lifelesspc_m: IIRC the details it's : must copy if interpolation is being used17:25
lifelessclarkb: isn't it just17:26
pleia2fungi: side note, I feel like we explain deletion of tags and branches a lot, I don't think we document this so I'll do that now17:26
*** cloudtrainme has quit IRC17:26
lifelessfungi: sup ?17:26
jeblairpleia2: ++17:26
isaacbclarkb: I remember I tried to find a flag for the "ip addr add" command but I couldn't find such. In our CI system, as a workaround,  we simply remove the interface if it exists17:27
sean-k-mooneyok in this case i dont see a clean way to fix this other then deleteing the new tags.17:27
*** esker has joined #openstack-infra17:27
pc_mlifeless: Hi. I found that one can refer to other environments, iff 'posargs' is not used, as it cannot be used. So docs works, but pep8 will not.17:27
clarkbsean-k-mooney: the cleanup is make change that updates setup.cfg and tag that with 1.0.1 or whatever17:28
clarkband maybe a best effort delete of 1.0.017:28
clarkb(with the disclaimer that anyone that has pulled it will have to do manual cleanup o ntheir end)17:28
lifelesspc_m: ao in cookiecutter we don't refer to other environments, so that its consistent and folk don't need to do the deep diving you're doing :)17:28
sean-k-mooneyyes but how can i do that for tags that are not at the top of a branch?17:29
lifelesssean-k-mooney: scrollback i slong - whats up ?17:29
*** esker has quit IRC17:30
*** samuelBartel has quit IRC17:30
sean-k-mooneylifeless: basically we decided to chage to form the old date based tag to the semantic version tag for networking-ovs-dpdk17:30
fungilifeless: sorry, was just redirecting sean-k-mooney in your direction17:30
*** jgriffith_away is now known as jgriffith17:30
sean-k-mooneylifeless: to be consistent i created new 1.0 and 1.1 tags for the 2015.1 and 2015.1.1 tags17:30
pc_mlifeless: Do we need the dependencies (install_command) for targets like docs and cover?17:31
lifelesspc_m: yes17:31
clarkbzaro: today's gerrit memory and gc use looks similar to yesterdays17:31
lifelesspc_m: api docs depend on importing the code; coverage on running it17:31
*** flepied has joined #openstack-infra17:31
lifelesssean-k-mooney: ok, and whats going wrong?17:31
pc_mlifeless: thanks.17:31
*** bhunter71 has joined #openstack-infra17:32
*** flepied1 has quit IRC17:32
*** e0ne has quit IRC17:32
sean-k-mooneylifeless: if i checkout the either the old or new tag now i get this error. ValueError: git history requires a target version of pbr.version.SemanticVersion(2015.1.0), but target version is pbr.version.SemanticVersion(1.0.0)17:32
*** sridhar_ram has joined #openstack-infra17:32
* pc_m duh. on the coverage...17:32
zaromorning17:33
lifelesssean-k-mooney: ok, so delete the new tags. There's a specific process to convert, which dhellmann outlined in his release team emails17:33
lifelesssean-k-mooney: let me dig that up17:33
*** cloudtrainme has joined #openstack-infra17:33
sean-k-mooneyso i was hoping to understand what gerrit acls i need to add to the [access "refs/tags/*"] to allow me to delete the tag. i belive push with the force option17:34
anteayamorning zaro17:34
fungiit should work even if you just delete your local tags and tag a newer commit17:34
sean-k-mooneylifeless: the issue is im not sure how to specify the for option in the acls.17:35
openstackgerritZara proposed openstack-infra/storyboard: POST Templates for Stories  https://review.openstack.org/26428617:35
clarkbsean-k-mooney: you can't an admin will have to do it for you17:35
lifelesssean-k-mooney: for a one-off rate thing I'd just ask infra to do it. There's no need for use to have regular access to delete tags :)17:35
fungialso in the past we've said no to deleting tags17:35
fungibecause it's effectiveness is at best spotty17:36
fungier, its17:36
sean-k-mooneyya that was my other taught so i was hoping a gerrit admin might be about the infra channel that can take pitty on me :)17:36
*** unicell has quit IRC17:36
lifelessfungi: so these should be deleted17:36
lifelessfungi: because there's no way to fix up those revisions17:36
zarofungi: now that gerrit upgrade is behind us i should have more time to work on https://code.google.com/p/gerrit/issues/detail?id=357917:36
fungiand we don't want projects to get the idea that tag deletion is an effective thing they can rely on17:36
lifelesshttp://lists.openstack.org/pipermail/openstack-dev/2015-November/080692.html is the process the release team followed17:37
lifelessit is: tag head to the new version, this is lower than the version setup.cfg specifies. Then edit setup.cfg to remove the version specification.17:37
sean-k-mooneylifeless: thanks i will read it now. fungi: yes sorry for the trouble17:37
fungisean-k-mooney: it's not so much that it's a trouble. it's not a complete solution17:38
lifelesssean-k-mooney: I am presuming, since you did not mention it, that your setup.cfg still says 2015 ?17:38
lifelesssean-k-mooney: but -if it doesn't, then the rectification is different...17:38
openstackgerritElizabeth K. Joseph proposed openstack-infra/infra-manual: Document deletion of tags and branches  https://review.openstack.org/26428717:38
BobBallWhat needs to happen for a "closes-bug: #" comment in the commit message for my repo (fuel-plugin-xenserver) to automatically close the bug when a change is merged?  Is there some magic config somewhere that enables this for other repos?17:38
fungideleting the tag from gerrit doesn't delete it everywhere (and in fact there are plenty of places covered by "everywhere" over which we have absolutely no control)17:39
*** notnownikki has quit IRC17:39
sean-k-mooneyfungi: it is not in my setup.cfg at all. lifeless:the command is git push gerrit -f :refs/tags/1.017:40
sean-k-mooneyfungi: https://github.com/openstack/networking-ovs-dpdk/blob/1.0/setup.cfg17:40
*** Guest10260 has quit IRC17:40
sean-k-mooneyoh that was ment for lifeless sorry17:41
fungiBobBall: project-config says its bugs should be opened against https://bugs.launchpad.net/fuel17:41
fungiBobBall: do you have an example which didn't work?17:41
*** ifarkas has quit IRC17:41
BobBallOh.  Bugs are opened against fuel-plugin-xenserver17:42
*** yamahata has quit IRC17:42
BobBallhttps://review.openstack.org/#/c/244467/ is an example.  I'll chat with the Fuel folk to see what their views are.  I think the project-config setting to use the fuel project was recommended by them.17:42
lifelesssean-k-mooney: ok so this is weird, without setup.cfg specifying version, that error shouldn't happen17:42
fungiBobBall: yep, if you want it to not be in groups: fuel you need to update gerrit/projects.yaml (then it will default to expecting an lp project matching the gerrit repo name)17:42
lifelesssean-k-mooney: I don't get an error17:43
BobBallOK, thanks17:43
lifelesssean-k-mooney: onmaster... is it only on the tag you get the error?17:43
sean-k-mooneylifeless: ya i did not spot the error as it only happes if your checkout the tag explicitly on master or stable/kilo in this case it is fine but 1.0/2015.1 are broken17:44
clarkbmtreinish: could be coincidence but ovh and internap have a similar fail rate and neither have swap17:44
pleia2BobBall: also note that the bug number has to be in the first change, it doesn't pick it up if you add it a subsequent commit message17:44
clarkbI don't think anyone else has whipped up a change to make a swap file, maybe I should go ahead and do that17:44
lifelesssean-k-mooney: so, I think this is a bug17:44
lifelesssean-k-mooney: but you have to make new tags anyway17:44
mtreinishclarkb: hmm, that's interesting17:44
fungipleia2: that's just for leaving a comment in the bug when switching it to in progress and assigning it17:44
BobBallOh right - I didn't know that - thanks pleia2.  I'm sure some bugs will not be closed due to that since we added bugs in a subsequent change17:44
lifelesssean-k-mooney: because master generates a version of 2015 still17:45
fungipleia2: as long as it's there in the last patchset that merges, it should close the bug fine17:45
*** jistr has quit IRC17:45
lifelesssean-k-mooney: (because 2015 > 1, and no tag is closer in history)17:45
pleia2fungi: oh right, *closing* the bug should work fine17:45
*** amuller is now known as amuller_afk17:45
fungiBobBall: also you need to make sure that your bug supervisor group for that project in lp includes the OpenStack Infra (hudson-openstack) user17:45
pleia2it just won't update the bug saying it's being worked on17:45
clarkbbtrfs does not support swap files17:46
clarkbgood thing we don't btrfs17:46
fungiBobBall: or else you won't get comments/in-progress/reassignment17:46
sean-k-mooneylifeless: so what i was going to do if i had had permission was delete 1.0 and 1.2 and only use the new format for new tags17:46
mtreinishclarkb: I really need to add recent run history to the dashboard17:46
fungiclarkb: huh? you can't put a swapfile on btrfs? that seems like an odd restriction17:46
lifelesssean-k-mooney: yes.17:47
BobBallfungi: Thanks.  Added.17:47
lifelessfungi: so, if we don't delete these tags, the tagged versions can't be used17:48
*** eil397 has joined #openstack-infra17:48
lifelessfungi: yes its nto a complete solution, but its better than nothing IMO17:48
mtreinishfungi: https://btrfs.wiki.kernel.org/index.php/FAQ#Does_btrfs_support_swap_files.3F17:48
mtreinishit is kinda weird17:48
clarkbfungi: according to arch wiki it is a very bad idea and can result in fs corruption17:48
fungiclarkb: oh, i wonder if the kernel tries to bypass the filesystem in some ways to directly address blocks in the swapfile17:49
clarkbanyways change shortly in d-g to use a swapfile if we don't use an ephemeral drive17:49
mtreinishfungi: that's what the wiki link I pasted seems to indicate17:49
sean-k-mooneyfungi: perhaps it is someting to do with the copy on write nature of btrfs17:49
fungilifeless: you've confirmed that pbr goes sideways if there are two tags on one commit?17:49
*** efried has joined #openstack-infra17:50
lifelessfungi: two ones that are semantically incompatible yes17:51
*** AJaeger has joined #openstack-infra17:51
lifelessfungi: or possibly the dates are in the wrong order and describe is saying one thing, log is saying another17:51
fungiin that case, yes, we'll delete the errant tags from gerrit, but the release managers of that repo need to know not to try to replace them with new tags of the same name pointing to other commits, and anyone who has existing clones may need to manually clean them up or they're run into the same issue17:51
lifelessyah17:51
lifelesseither way, pbr will bail on the repo as it stands, for the two tagged revisions17:52
mordredinfra-root: last I checked, today was the projected date for go-live of ansible 2.0 - it should be a no-op for us, but since we use ansible in multi-node tests, if somehting goes sideways weirdly, it might be worth keeping in mind17:52
*** bharathm has quit IRC17:52
sean-k-mooneyfungi: as i am the only one on our team who tags commits for networking-ovs-dpdk i will remember not to do that again17:52
fungimordred: thanks for the heads up17:52
fungisean-k-mooney: so which tags did you want deleted? 1.0.0 and 1.1.0 or 2015.0.0 and 2015.1.0?17:53
*** cloudtrainme has quit IRC17:53
fungioh, you didn't push full tags anyway17:54
sean-k-mooneyfungi:  1.0.0 and 1.1.0 we have some released deployment code that depend on the old names17:54
sean-k-mooneyfungi: so we need to keep 2015.1 and 2015.1.117:54
fungikeep in mind that 1.0 and 1.1 are not pep-440 normalized semver, so those would have broken release jobs regardless17:54
*** mrmartin has joined #openstack-infra17:55
*** BobBall is now known as BobBall_AWOL17:55
fungiin the future, push only three-component versions as tags17:55
fungiso 1.0.0 and 1.1.017:55
efriedHowdy folks.  Hopefully I'm in the right forum for this question.  In tempest, the doc for 'ssh_user_regex' says, "List of user mapped to regex to matching image names."  Having a hard time understanding what that means.  (https://github.com/openstack/tempest/blob/master/tempest/config.py#L1172)17:55
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use a swapfile if no swap and no ephemeral disk  https://review.openstack.org/26428817:55
clarkbmtreinish: fungi ^ something like that17:56
sean-k-mooneyfungi: ok i will keep that in mind. i have not enabled the auto pip push job yet either so at present i push the signed pip packages manually17:56
anteayaefried: you probably will get your best response in #openstack-qa17:56
fungiclarkb: i thought someone had already written that change a week or two ago17:56
efriedanteaya, thanks.17:56
*** cloudtrainme has joined #openstack-infra17:56
clarkbfungi: oh I hadn't seen it but holidays would explain that17:56
clarkblet me look17:56
anteayaefried: welcome17:56
clarkbfungi: I remember asking at least one person to do it then never seeing a patch but that may have been due to EHOLIDAYS17:56
jeblairhttps://review.openstack.org/26107017:57
fungiclarkb: i forget who now, but someone working on one of the projects whose jobs were impacted by lack of swap in ovh17:57
jeblairclarkb, fungi: ^?17:57
*** isaacb has quit IRC17:57
clarkbfound it https://review.openstack.org/#/c/261070/1/functions.sh17:57
fungijeblair: yep17:57
clarkbya but I wonder why we need a loopback device17:57
*** efried has left #openstack-infra17:57
clarkbis that because its sparse?17:58
jeblairclarkb: to be sparse17:58
jeblairclarkb: you can't directly swapon a sparse device17:58
jeblairclarkb: so the loopback launders it so the kernel doesn't know it's not sparse17:58
jeblairer doesn't know its sparse17:58
sean-k-mooneylifeless: fungi: thanks for your help17:59
*** nadya has joined #openstack-infra17:59
*** samuelBartel has joined #openstack-infra17:59
fungiclarkb: jeblair: and sparseness was a workaround for not preallocating and then eating already slim available space in, e.g., ovh17:59
*** nadya is now known as Guest2916217:59
clarkbok in that case I think the only thing we need there is ot make sure that we use an actually available loop device17:59
clarkbsince loop1 may not actually be available17:59
fungigood point17:59
*** derekh has quit IRC17:59
fungineed to pick next available or something17:59
clarkbyup17:59
*** Swami has quit IRC18:00
clarkbI will leave that comment18:00
sean-k-mooneyfungi: if you can delete http://git.openstack.org/cgit/openstack/networking-ovs-dpdk/tag/?h=1.0 and http://git.openstack.org/cgit/openstack/networking-ovs-dpdk/tag/?h=1.1 then that will resolve the issue and i will document the need to delete them locally in a know issues section in our readme18:00
mgagneis there an way to get stats about jenkins jobs running on a specific provider?18:00
jeblairmgagne: here, let me start on that grafana dashboard18:00
clarkband outside of graphite/grafana logstash and subunit2sql include a node_provider field on their results18:01
mgagnejeblair cool. I'm looking for average run times. But I came to the conclusion it would be +/- possible due to huge number of different jobs and our little number of executors. so average wouldn't be statistically significant.18:02
jeblairmgagne: we do record job runtime per-provider and per-job, so we can look at, say, 'gate-tempest-dsvm' (that's one of the graphs i'll add to the dashboard)18:03
mgagneoh, I didn't know. very curious to see results :D18:03
*** Ramanjaneya has quit IRC18:04
*** esker has joined #openstack-infra18:04
*** esker has quit IRC18:05
*** yamahata has joined #openstack-infra18:05
fungisean-k-mooney: done. took me a minute since i had to elevate my gerrit privs to do that18:06
*** dahoo has joined #openstack-infra18:07
*** esker has joined #openstack-infra18:07
fungisean-k-mooney: as mentioned, you'll still need to git tag -d 1.0 and so on locally or you'll still see that error18:08
sean-k-mooneyfungi: thanks :) that has propagated to github too.18:08
*** salv-orlando has quit IRC18:08
fungiyep, it will propagate to push mirrors, just not via pull or remote update18:08
sean-k-mooneyfungi: yes i will do that18:08
*** salv-orlando has joined #openstack-infra18:09
sean-k-mooneyfungi: understood18:09
fungiso anyone/anything who pulled a copy of those tags will still have them through future pulls and remote updates unless they manually delete their copies or reclone completely18:09
*** ihrachys has quit IRC18:10
clarkbok I have abandoned my change and left a comment about using losetup -f to find the next free loopback device18:10
*** unicell has joined #openstack-infra18:10
dmsimardclarkb: okay, was about to ask if we went for your change or mine :)18:11
dmsimardI'll address it18:11
greghaynesThats how DIB does it (losetup -f)18:11
fungiwwdd?18:11
clarkbdmsimard: ya I think starting with sparse is better, then if we find the performenace is terrible address it then18:11
*** isaacb has joined #openstack-infra18:11
clarkbdmsimard: but once the losetup -f thing is done I am +218:11
greghaynesfungi: New shirt for the summit18:12
fungin-deed18:12
fungidmsimard: clarkb: same18:12
*** trown|lunch is now known as trown18:12
mgagnedmsimard: wwdd: What Would David Do? :D18:12
dmsimardoh hai mgagne o/18:13
fungihah18:13
openstackgerritElizabeth K. Joseph proposed openstack-infra/infra-manual: Document deletion of tags and branches  https://review.openstack.org/26428718:13
*** otter768 has joined #openstack-infra18:13
fungipleia2: thanks!18:13
dmsimardmgagne: inap will join the openstack-infra providers ?18:13
mgagneyes we are18:14
*** jsavak has quit IRC18:14
dmsimardcool :)18:14
*** jsavak has joined #openstack-infra18:14
fungidmsimard: we're already running 12 nodepool vms there to test the waters18:14
*** dslevin_ has quit IRC18:14
fungiprogressing well18:14
anteayahpcloud seems to be erroring a lot right now18:15
dmsimardclarkb: do you want me to add that note about Internap and OVH specifically ?18:16
fungianteaya: thanks, i'm checking for leaked floating ips there now18:16
anteayathanks18:17
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Adds an API migration and docs generation tool, fairy-slipper  https://review.openstack.org/24535218:17
AJaegeranteaya: could you review the change above, please ? I just fixed the ACLs and rebased...18:17
*** isaacb has quit IRC18:17
anteayaon hold, will look18:17
openstackgerritDavid Moreau Simard proposed openstack-infra/devstack-gate: Use a sparse swapfile on rootfs for providers without ephemeral disks  https://review.openstack.org/26107018:18
dmsimard^18:18
*** otter768 has quit IRC18:18
lifelesssean-k-mooney: yw18:18
mordredclarkb: I'm in a  meeting - but bluebox is pretty constant error and I haven't been able to track down why yet18:19
*** mrmartin has quit IRC18:19
*** bharathm has joined #openstack-infra18:20
*** dslevin_ has joined #openstack-infra18:22
*** mudassirlatif has joined #openstack-infra18:23
*** PsionTheory has joined #openstack-infra18:24
*** nelsnelson has quit IRC18:24
*** nelsnels_ has joined #openstack-infra18:24
*** Swami has joined #openstack-infra18:25
*** sputnik13 has joined #openstack-infra18:25
fungianteaya: apparently we leaked 498 floating ips in hpcloud. deleting them now18:25
Clintyikes18:25
fungiyeah, in reference to yesterday's discussion about turning hpcloud down early, we basically did? ;)18:26
*** hdd has joined #openstack-infra18:26
openstackgerritJames E. Blair proposed openstack-infra/project-config: Grafana: Add nodepool Internap dashboard  https://review.openstack.org/26429818:26
jeblairmgagne, mordred, clarkb, fungi, anteaya: ^18:27
*** gampel has joined #openstack-infra18:27
mgagnewhy are we a special case? :D18:28
jeblairmgagne: you're the first18:28
mgagnew00t18:28
*** esker has quit IRC18:28
fungipabelanger: you probably also want to peruse 26429818:28
jeblairi believe we can go ahead and add ovh and bluebox; but probably best to land that and make sure it looks right first18:29
mgagnegood idea18:29
jeblairi'm sure we can add hpcloud too if we desire18:29
jeblairstill need to ask rax...18:29
jeblairi'm not sure who to ask there18:29
funginot much point in adding hpcloud18:29
mgagneask?18:29
*** jsavak has quit IRC18:30
fungimgagne: we're hesitant to publish provider-specific performance stats without getting agreement form the providers. want to make sure they're okay with it18:30
fungis/form/from/18:30
jeblairyeah, people have been so far, but i don't want to surprise anyone18:30
mgagneright, I understand18:31
fungijeblair: could probably ask pvo, just no guarantees he'd have time to respond18:31
fungijroll might have suggestions for who to bring it up with18:32
jrollhi18:32
nibalizerjeblair: neat!18:33
jrollfungi: jeblair: is there a plain text description of this dashboard I can send people?18:33
fungijroll: there will probably be an actual demonstration here shortly with our other providers18:34
jeblairjroll: yeah, let me grab what i've sent other folks18:34
jrollor a 'why does rackspace want this?'18:34
jrollok18:34
jrolldoes/should18:34
*** nelsnels_ has quit IRC18:35
*** nelsnelson has joined #openstack-infra18:35
fungiit's mainly for helping us spot problems and refine our per-provider tuning configuration but there's always the risk people could view it in a different light18:35
mtreinishfungi, jeblair: fwiw I was planning on adding that kinda graphing to openstack-health eventually too (it'd be an artifact of doing per metadata performance graphing)18:36
mgagnefungi you could always anonymize the provider name like: "Provider A", "Provider B" and let people figure out which is which :D18:36
mtreinishbut it'll probably be some time until I take a crack at that18:37
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add DB API method to get a list of recent by metadata  https://review.openstack.org/26430318:38
fungimgagne: true, that's probably an option18:38
*** sabeen2 has quit IRC18:38
*** bharathm has quit IRC18:38
*** odlD2 has quit IRC18:38
*** jsavak has joined #openstack-infra18:40
*** sabeen1 has joined #openstack-infra18:41
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Add pip-and-virtualenv element  https://review.openstack.org/23956118:42
openstackgerritLucas Alvares Gomes proposed openstack/diskimage-builder: Install IPA in a virtual enviroment  https://review.openstack.org/23584318:42
*** sabeen3 has joined #openstack-infra18:44
*** bharathm has joined #openstack-infra18:44
*** e0ne has joined #openstack-infra18:44
*** sabeen1 has quit IRC18:46
*** armax has quit IRC18:46
*** pvaneck has joined #openstack-infra18:50
*** fawadkhaliq has quit IRC18:50
*** odlD2 has joined #openstack-infra18:51
sputnik13Hi, project-config patch has 2x +2, needs +A, can someone please take a look?  https://review.openstack.org/#/c/259188/18:52
sputnik13it had +A before, I guess it was rebased due to merge conflicts18:52
anteayapabelanger jeblair is there anyway I can test https://review.openstack.org/#/c/264298/1 locally?18:52
openstackgerritAdam Reznechek proposed openstack-infra/system-config: Add openstack-powervm to meetbot channels  https://review.openstack.org/26430718:53
*** krtaylor has quit IRC18:53
anteayafungi: thanks for cleaning up the leaked floating ips18:54
jeblairanteaya: i am not aware of a simple one.  i have not tested it.18:54
nibalizerhttp://paste.openstack.org/show/483168/ is in the hound logs18:55
AJaegersputnik13: I'll check..18:55
*** dahoo is now known as jerryz18:57
anteayajeblair: guess we get to test it in production then18:57
jeblairnibalizer: something related to renamed repos maybe?18:57
sputnik13AJaeger thank you18:58
nibalizerjeblair: i thought that as well18:58
*** jcoufal has quit IRC18:58
nibalizerthe remote looks correct though18:58
AJaegernibalizer: was that a one time thing? I had to recheck one change today due to git timeout18:58
nibalizergit://git.openstack.org/openstack-attic/akanda18:58
nibalizerAJaeger: this seems to happen regularly in the logs18:59
nibalizerand I can reproduce after copying the failing repo to my homedir18:59
AJaegershould we really include abandoned repos in codesearch?18:59
nibalizeri think thats a good question19:00
fungiAJaeger: if we properly delete their content and replace it with just a readme, then seems safe enough19:00
nibalizeri tend to think not19:00
pabelangerfungi: anteaya: if you run tox -egrafyaml it will do validation.  Otherwise, you'd need to have grafana running locally, to actually import the yaml file to visually review19:00
*** AJaeger has quit IRC19:01
jeblairwow, the grafana json is anything goes as far as dashes and underscores :)  "y-axis", "y_formats"19:01
*** jordanP has joined #openstack-infra19:01
*** ybathia has joined #openstack-infra19:02
nibalizerjeblair: yojo19:02
jeblairha19:02
nibalizerdo we any any way of dry-running changes like your grafana change?19:02
nibalizerI looked at it and basically said 'yep thats yaml without spelling mistakes'19:02
*** andreykurilin__ has quit IRC19:02
jeblairnibalizer: 19:00 < pabelanger> fungi: anteaya: if you run tox -egrafyaml it will do validation.  Otherwise, you'd need to have grafana running locally, to actually import the yaml file to visually review19:02
funginibalizer: see pabelanger's comment19:02
jeblairnibalizer: i think that's all19:02
fungiyeah, that19:02
nibalizerhaha thanks19:03
anteayapabelanger: thanks19:03
jeblairhaving said that, grafana is dockered so it's not super hard if you are so inclined19:03
anteayanibalizer: I went as far as "yep that's yaml"19:04
anteayanibalizer: you are more diligent than I19:04
*** tonytan4ever has quit IRC19:04
reedhttp://governance.openstack.org/resolutions/index.html is still missing yesterday's resolutions?19:05
openstackgerritMerged openstack-infra/project-config: Moving Cue rally test to non-voting check job  https://review.openstack.org/25918819:05
clarkbreed: they appear to be queuued in post still19:06
*** cloudtrainme has quit IRC19:06
clarkbits been a busy zuul day19:06
jeblairpabelanger: if i want to add 'leftYAxisLabel' do i just add it to the schema and it gets passed through?19:06
reedclarkb, thanks... I'll remember to check zuul queue next time :)19:06
*** piet has quit IRC19:06
*** bpokorny has quit IRC19:06
fungiclarkb: i think it was starvation because of nodepool thinking a lot of the hpcloud churn was satisfying available demand19:06
*** fawadkhaliq has joined #openstack-infra19:06
clarkbfungi: dmsimard before i approve 261070 I want to make sure at least one of the test runs runs on a cloud without ephemeral disks just to make sure we get that tested19:06
dmsimardsure19:07
fungiclarkb: yep, i assumed that's why you only +2'd19:07
*** krtaylor has joined #openstack-infra19:07
*** flepied has quit IRC19:07
fungiwant to recheck a few times to make sure it demonstrates working correctly for both branches of the logic19:07
clarkbhopefully we catch it on internap or ovh on one of the many runs19:08
fungiunless you get lucky the first time19:08
clarkbthe firs ttime around19:08
*** mrmartin has joined #openstack-infra19:08
*** yaume has quit IRC19:09
*** amuller_afk is now known as amuller19:09
*** sharikapongubala has joined #openstack-infra19:10
pabelangerjeblair: Ya, should be straightforward to add it.  Let me confirm19:11
jeblairpabelanger: cool, i'm halfway through, i'll have a change for you in a sec19:11
*** fawadkhaliq has quit IRC19:13
openstackgerritJames E. Blair proposed openstack-infra/grafyaml: Add support for Y axis labels  https://review.openstack.org/26431419:13
jeblairpabelanger: ^ ?19:13
*** edmondsw has quit IRC19:14
pabelangerjeblair: checking19:14
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add a script to list change owner statistics  https://review.openstack.org/26397119:14
*** tonytan4ever has joined #openstack-infra19:15
openstackgerritJames E. Blair proposed openstack-infra/grafyaml: Add support for Y axis labels  https://review.openstack.org/26431419:15
jeblairpabelanger: now with passing tests ^ :)19:16
*** cloudtrainme has joined #openstack-infra19:16
openstackgerritMatthew Treinish proposed openstack-infra/system-config: Update common.js to include OpenStack-Health  https://review.openstack.org/24037919:16
pabelangerjeblair: Just confirming on play.grafana.org19:17
jeblairpabelanger: yeah, that's where i learned what the names were :)19:17
*** edmondsw has joined #openstack-infra19:17
openstackgerritMerged openstack-infra/system-config: Redirect puppet cron output to a log file  https://review.openstack.org/26425219:17
nibalizerI'm pretty stumped19:17
nibalizerhttp://paste.openstack.org/show/483173/19:17
*** Guest29162 has quit IRC19:17
*** bharathm has quit IRC19:18
anteayafungi: is your script still admin only?19:18
*** harlowja_ has quit IRC19:18
fungianteaya: i'm about to push up the change to discuss whether we can make the emails method available to all registered users (or even to anonymous users)19:18
jeblairnibalizer: what's the remote?19:18
fungianteaya: so, for now, yes19:18
anteayafungi: okey dokey, thanks19:18
*** jordanP has quit IRC19:19
*** harlowja has joined #openstack-infra19:19
pabelangerjeblair: LGTM19:19
pabelangerwaiting for gate to pass19:19
nibalizerjeblair: git://git.openstack.org/openstack-attic/akanda19:20
*** jordanP has joined #openstack-infra19:20
*** bharathm has joined #openstack-infra19:20
nibalizeryou're also welcome to poke at that dir in my homedir on codesearch.o.o if you wish19:20
funginibalizer: if i clone fromm that remote then it seems to work fine (even on codesearch.o.o(19:21
funginibalizer: where is the original copy of that clone?19:21
nibalizerfungi: yep, its impressive19:21
nibalizerfungi: see /var/log/hound.log19:21
jeblairpabelanger: if you are only interested in the binary success/fail output, you could go ahead and leave your vote and rely on the gate to prevent it from landing if something fails; of course if you want to examine some output that's a different story19:21
nibalizerthere is a pretty gross path inside /home/hound/data19:21
fungifatal: bad object e1e6761df1d3dd78d42ea67739f0141b3629e47c19:22
fungidoesn't seem to even be in that repo19:22
*** yolanda has quit IRC19:22
*** piet has joined #openstack-infra19:22
fungiand gerrit doesn't know that commit either19:22
pabelangerjeblair: this is true19:22
*** piet has quit IRC19:23
*** piet has joined #openstack-infra19:24
funginibalizer: check out git loh19:25
fungier, git log19:25
zarofungi: RE: https://code.google.com/p/gerrit/issues/detail?id=357919:25
funginibalizer: and speculate as to the possible causes there ;)19:25
nibalizerfungi: hrm... i only see one commit, the creation commit19:25
funginibalizer: and the real copy of the repo has no creation commit from jeepyb because it was imported19:26
nibalizerso maybe akanda was submitted for creation, got created, then whoops we meant to pull from github or migrate from stakforge or something19:26
nibalizerso now it cant ff?19:26
zarofungi: ohh nevermind.19:26
nibalizerand git is for some reason saying 'hung up unexpectedly' ?19:26
funginibalizer: yeah, our mirrors are updated with extreme prejudice, but hound is pulling so needs fast-forwardability19:27
anteayazaro: what did you do 49 minutes ago, is there a patch up?19:27
fungisomething to keep in mind for the future19:27
fungizaro: thanks for working on that. once it's solved it will allow some useful cleanup in the tool i'm currently hacking on19:28
anteayazaro: sorry I don't understand the significance of comment #319:28
fungianteaya: i think it was when he assigned the issue to himself19:29
*** kzaitsev_mb has joined #openstack-infra19:29
fungiat least that's how i can imagine that's supposed to read if i squint like Clint19:29
zaroyeah, not fixed yet.19:29
openstackgerritRob Crittenden proposed openstack-infra/devstack-gate: DO NOT MERGE - testing enabling tls-proxy service  https://review.openstack.org/18843619:29
zaroanteaya: fungi is correct.19:29
anteayafungi: ah thank you19:29
anteayaI could never squint like Clint19:30
anteayaso much practice required19:30
*** bharathm has quit IRC19:31
zarofungi: so if your using REST now the best you can get is merged date, correct?19:31
fungizaro: not sure what you mean by "best you can get is merged date"19:32
fungizaro: that's what i want, but i don't see it listed19:32
zarofungi: do you want the submitted timestamp or the merged timestamp?19:33
fungizaro: merged would be ideal, submitted is good enough, right now it has neither19:33
fungizaro: so i'm inferring it by looking for the last comment message with no author field and using the date of that19:34
zaroi see "status": "MERGED" and "updated": "2016-01-05 21:11:28.250000000" in the change detail response.19:34
zarois that not the same thing?19:34
funginope19:34
*** changbl has joined #openstack-infra19:35
*** ociuhandu has quit IRC19:35
openstackgerritAdam Reznechek proposed openstack-infra/system-config: Add openstack-powervm to meetbot channels  https://review.openstack.org/26430719:35
fungiyou can leave comments on changes which are in a merged state, and then updated gets reset to the current date and time19:35
fungiso doesn't necessarily reflect the date it was merged19:35
zaroohh right.19:35
openstackgerritAdam Reznechek proposed openstack-infra/system-config: Add openstack-powervm to meetbot and statusbot channels  https://review.openstack.org/26430719:36
fungii'm currently relying on the fact that system messages seem to have no author (at least as far back as 2.8?), and the "successfully merged" message gerrit leaves on the change _should_ be the last system message (unless something goes horribly wrong, but at least it's unlikely someone could spoof it)19:36
*** bharathm has joined #openstack-infra19:37
rajinirasselin or clarkb: how to force nodepool to allocate a node? Looks like something is messed up. http://paste.openstack.org/show/483177/19:37
fungizaro: but since the ssh api provides a SUBM grantedOn timestamp, it seemed like a reasonable thing to ask for the rest api to also provide19:38
jeblairomg the grafana folks used a non-ascii value as a key19:38
jeblairmuch pain ensues19:39
*** jordanP has quit IRC19:39
fungizaro: if gerrit devs are more amenable to replacing it with a merged-on time or something, then that's fine too. i was just going on the assumption that feature parity between ssh and rest api would be a slam-dunk argument19:39
*** mrmartin has quit IRC19:41
asselinrajinir, seems nodepool is unable to delete and you must have a max set to 119:42
zarofungi: i don't think it's an issue.  it would have been struck down in the bug if it was.19:42
fungizaro: yeah, what you have described in comment #1 seems fine for our purposes, and provides an equivalent for anyone else who was relying on that feature of the ssh api19:44
nibalizerfungi: I'm going to remove hound's clone then19:44
nibalizerwhich should trigger a reclone I think19:44
funginibalizer: yep, that was going to be exactly my recommendation19:45
*** Sukhdev has joined #openstack-infra19:46
*** dslevin_ has quit IRC19:47
*** nadya has joined #openstack-infra19:47
*** nadya is now known as Guest4812719:47
*** e0ne has quit IRC19:47
*** andreykurilin__ has joined #openstack-infra19:47
*** vgridnev has quit IRC19:48
openstackgerritSpencer Krum proposed openstack-infra/system-config: Hound Maintenance  https://review.openstack.org/26432619:49
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: add command to actually send email announcements  https://review.openstack.org/26391319:51
pleia2nibalizer: thanks for documenting that19:52
*** dslevin_ has joined #openstack-infra19:52
openstackgerritPaul Michali proposed openstack-infra/project-config: Constraint based experimental jobs for neutron-vpnaas  https://review.openstack.org/26339819:54
openstackgerritRob Crittenden proposed openstack-infra/devstack-gate: DO NOT MERGE - testing enabling tls-proxy service  https://review.openstack.org/18843619:54
*** bharathm has quit IRC19:55
openstackgerritJames E. Blair proposed openstack-infra/grafyaml: Add support for Y axis formats  https://review.openstack.org/26433119:56
jeblairpabelanger: ^ adventures in unicode!19:56
jeblair(microseconds is what causes the excitement)19:57
*** baoli_ has quit IRC19:57
docaedojeblair: microseconds usually do cause excitement19:58
*** bharathm has joined #openstack-infra19:59
jeblairdocaedo: but not for long!19:59
docaedohaha20:01
*** mrmartin has joined #openstack-infra20:01
*** amrith is now known as _amrith_20:02
anteayafungi: hpcloud seems to be much happier, something is causing unhappiness for rax and ovh (may be unrelated) but it just started20:02
docaedoI have a q about https://review.openstack.org/#/c/260230/ - just wondering if anyone has thoughts on when it might merge? I don't want to pester because I know it's not like it will be forgotten, but wondering if there's concerns with it or something20:02
*** masber has quit IRC20:03
*** lucasagomes is now known as lucas-dinner20:03
anteayadocaedo: looks like it just needs one more system-config core to push it over the edge20:03
jeblairit already has two, i'm guessing the last one wasn't around to babysit, i'll just aprv it20:04
docaedoanteaya jeblair - thanks!20:04
*** jsavak has quit IRC20:05
*** thiagop-lunch is now known as thiagop20:07
*** kzaitsev_mb has quit IRC20:08
*** hashar has joined #openstack-infra20:08
clarkbfungi: dmsimard https://jenkins07.openstack.org/job/gate-tempest-dsvm-multinode-full/2466/console is running on ovh20:09
openstackgerritJames E. Blair proposed openstack-infra/project-config: Grafana: Add nodepool Internap dashboard  https://review.openstack.org/26429820:09
*** baoli has joined #openstack-infra20:10
*** ociuhandu has joined #openstack-infra20:11
*** bharathm has quit IRC20:12
*** woodster_ has joined #openstack-infra20:12
*** unicell has quit IRC20:12
*** unicell1 has joined #openstack-infra20:12
*** krtaylor has quit IRC20:13
openstackgerritMerged openstack-infra/system-config: Add requestsexceptions to proposal slave  https://review.openstack.org/26023020:13
*** otter768 has joined #openstack-infra20:14
*** yolanda has joined #openstack-infra20:15
*** cloudtrainme has quit IRC20:15
fungiexcellent20:16
clarkbhttps://jenkins06.openstack.org/job/gate-tempest-dsvm-neutron-multinode-full/1828/ too20:16
*** Guest48127 has quit IRC20:16
*** nadya has joined #openstack-infra20:17
*** flepied has joined #openstack-infra20:17
*** nadya is now known as Guest2270120:17
*** bharathm has joined #openstack-infra20:17
dmsimardctrl+f swap = nothing ? (should it be there? not familiar with devstack jobs)20:18
clarkbdmsimard: it will be in the setup log not the console log20:18
dmsimardoh.20:18
clarkbdmsimard: so we have to wait for the job to finish or log into the test machine20:18
*** otter768 has quit IRC20:19
openstackgerritPaul Michali proposed openstack-infra/project-config: Skip py27/34 jobs when VPN doc (only) change  https://review.openstack.org/26340920:20
*** sharikapongubala has quit IRC20:21
*** pkarikh has quit IRC20:21
openstackgerritMerged openstack-infra/project-config: Grafana: Add nodepool Internap dashboard  https://review.openstack.org/26429820:24
*** pkarikh has joined #openstack-infra20:25
openstackgerritlvdongbing proposed openstack-infra/project-config: New Project - Bilean  https://review.openstack.org/26405420:25
*** ddieterl_ has joined #openstack-infra20:26
openstackgerritMerged openstack-infra/project-config: Skip if doc only change for neutron-lib  https://review.openstack.org/26378620:27
*** gampel1 has joined #openstack-infra20:27
*** e0ne has joined #openstack-infra20:28
*** ddieterl_ has quit IRC20:29
*** rfolco has quit IRC20:29
*** e0ne has quit IRC20:29
*** ddieterly has quit IRC20:29
*** jsavak has joined #openstack-infra20:29
*** e0ne has joined #openstack-infra20:30
*** ddieterly has joined #openstack-infra20:31
*** gampel has quit IRC20:31
*** ddieterl_ has joined #openstack-infra20:32
*** rkukura_ has joined #openstack-infra20:33
*** e0ne has quit IRC20:33
*** vgridnev has joined #openstack-infra20:33
*** mrmartin has quit IRC20:33
*** rkukura has quit IRC20:34
*** rkukura_ is now known as rkukura20:34
*** ddieterly has quit IRC20:36
*** kzaitsev_mb has joined #openstack-infra20:36
*** aopincar has joined #openstack-infra20:36
*** jsavak has quit IRC20:37
*** jsavak has joined #openstack-infra20:38
*** armax has joined #openstack-infra20:40
*** dtroyer_zz has quit IRC20:43
*** krtaylor has joined #openstack-infra20:43
pabelangerjeblair: woah20:44
*** dtroyer has joined #openstack-infra20:45
*** rfolco has joined #openstack-infra20:45
fungiheh, µs20:45
fungiit's all greek to me20:46
*** rocky has joined #openstack-infra20:46
*** matrohon has joined #openstack-infra20:47
jeblairthe funny thing is that apparently "\u00b5" is equally valid as the actual character in json, and that's what grafyaml ultimately outputs :)20:48
*** rocky_g has joined #openstack-infra20:48
anteayafungi: this patch of yours in project-config is gathering dust, should it still stay alive? https://review.openstack.org/#/c/190367/20:48
*** baoli has quit IRC20:48
fungijeblair: yeah, similarly representable in yaml too20:49
*** rocky has left #openstack-infra20:50
HenryGWhere can I ask dumb questions about using gertty?20:52
jeblairHenryG: right here!20:52
fungianteaya: it's probably dead-ish. i'll abandon and reopen later if i get annoyed by it again. thanks20:53
jeblairmight get dumb answers, but hey20:53
HenryGjeblair: thanks :)20:53
anteayafungi: thank you20:53
HenryGI am looking at a patch, and I see it has comments. How do I view the comments?20:53
HenryGThat ^^ is a gertty question20:54
fungiHenryG: d takes you into the diff view where you can see code comments20:54
jeblairHenryG: select the "< Diff >" button below the patch, or hit 'd'.20:54
fungiHenryG: or choose diff on the patchset you want20:54
fungiyeah20:54
HenryGfungi: that's what I thought, but I don't see the comments20:54
anteayaHenryG: thanks for the disclaimer for those viewing at home :)20:54
fungiHenryG: which change?20:54
fungiHenryG: you might be looking at a newer patchset than the one with the comments?20:54
HenryG253715, patch set 220:55
openstackgerritPaul Michali proposed openstack-infra/project-config: Skip py27/34 jobs when VPN doc (only) change  https://review.openstack.org/26340920:55
HenryGwait, no, wrong patch20:55
*** annegentle has quit IRC20:55
anteayamordred: do we still feel that 198886 has a future? Retire devstack-trusty in favor of ubuntu-trusty it is aging like fine wine20:55
*** annegentle has joined #openstack-infra20:56
mordredI like fine aged wine20:56
fungianteaya: that's stalled by getting the uploads to stop image uploads getting timed out/broken in rackspace20:56
anteayamordred: I know20:56
anteayafungi: ah thanks20:56
HenryGBah, the patch merged. It was review 263841, patch set 220:56
fungier, some combination of those words20:56
anteayafungi: I heard, the patch needs to live20:57
anteayafungi: which was what I needed, thanks20:57
jeblairRevert "Revert "Revert "Remove TEMPEST_CONFIG_DIR in the api tox env"""20:57
HenryGjeblair: aye20:57
fungiHenryG: if you expand patchset 2 you can select diff on it. otherwise you're probably looking at patchset 320:57
fungiHenryG: oh, also i don't see the comments...20:57
HenryGfungi: how do I go to a specific review given the number?20:58
jeblairi don't see them either20:58
mgagnejeblair trying to debug issue with one of the graph in new internap grafana dashboard: "fetchData dbResults = dbFile.fetch( timestamp(startTime), timestamp(endTime), timestamp(now)) TypeError: fetch() takes exactly 3 arguments (4 given)" for "Node Launch Attempts"20:58
fungiHenryG: ctrl-o and then put in the number20:58
*** david-lyle_ has joined #openstack-infra20:59
*** david-lyle_ has quit IRC20:59
HenryGfungi: thanks!20:59
fungiHenryG: jeblair: https://review.openstack.org/#/c/263841/2/tox.ini shows them20:59
openstackgerritlvdongbing proposed openstack-infra/project-config: New Project - Bilean  https://review.openstack.org/26405420:59
fungilooks like it's outside of the diff context20:59
fungiis gertty maybe not retrieving that?20:59
jeblair2016-01-06 13:00:19,259 Unable to display all comments: {u'new-3-tox.ini': [(34793, [('comment-name', u'Henry Gessau'), ('comment', u': Should we update this?')]), (34795, [('comment-name', u'Ihar Hrachyshka'), ('comment', u': It works with 2.0 actually, just not with 2.2. Should we? I am ok to bump.')]), (34794, [('comment-name', u'Henry Gessau'), ('comment', u': I think we should, to save users the trouble if they happen to have 2.2 in th21:00
*** baoli has joined #openstack-infra21:00
*** kzaitsev_mb has quit IRC21:00
*** _amrith_ is now known as amrith21:01
fungiperhaps it doesn't like comments that are not on context lines21:01
fungigerrit seems to have a special behavior of expanding a window of context around comments even if they're on lines outside the diff's context windows21:02
jeblairi think both of those cases have been tested.. it should work21:02
jeblairfungi: gertty does that too21:02
jeblairmgagne: heh, it's becaus there have been no errors from internap, so the metric doesn't exist :)21:03
jeblairmgagne: break something, then it'll work ;)21:04
mgagnejeblair can't grafana default to 0 in that case?21:04
*** Sukhdev has quit IRC21:05
jeblairmgagne: it's a graphite thing, and i'm not sure if you can say "return nulls if metric database doesn't exist"21:05
anteayagreghaynes: what is the status on https://review.openstack.org/#/c/239562/4 Switch simple-init to pip-and-virtualenv element  on diskimage-builder21:05
jeblairHenryG: i'll dig into it after lunch; thanks and sorry21:05
fungijeblair: ahh, so it does. just tested and confirmed21:05
fungiso definitely not that21:06
clarkbhttp://logs.openstack.org/70/261070/2/check/gate-tempest-dsvm-multinode-full/5bf6b82/logs/devstack-gate-setup-workspace-new.txt.gz#_2016-01-06_19_56_54_731 looks good as does http://logs.openstack.org/70/261070/2/check/gate-tempest-dsvm-multinode-full/5bf6b82/logs/screen-dstat.txt.gz21:06
clarkbdmsimard: fungi ^ so I will approve that change now21:06
*** bharathm has quit IRC21:06
HenryGjeblair: NP. Just my luck that I hit a bug on my first serious attempt at using gertty. :D21:07
dmsimard\o/21:07
fungiclarkb: yep, lgtm21:07
HenryGjeblair: I shall continue trying gertty with some other patches21:08
*** cdent has quit IRC21:08
fungiHenryG: yeah, i'm using it pretty heavily and it's the first time i've run into that behavior21:09
fungiat least as far as i've noticed21:09
clarkbunsurprisingly we don't swap during multinode test runs though21:09
clarkboh wait no its does for 184k21:10
fungieven better. exercised successfully21:10
fungimultiple pages swapped out, no crashy-crashy!21:10
clarkbhowever does look like live migrations are having trouble21:11
clarkbso that will count against ovh, but I don't think it is ovh's fault21:11
clarkbmtreinish: ^21:11
*** baoli has quit IRC21:12
*** baoli has joined #openstack-infra21:13
mtreinishclarkb: well on the dashboard the live mgirations won't come into play because it's still gate only21:13
clarkbmtreinish: ah ok21:13
*** tzn has joined #openstack-infra21:14
*** kragniz is now known as {^-^}21:17
*** {^-^} is now known as Guest4635321:18
*** Guest46353 is now known as kragniz21:18
mgagnejeblair trying to find a function for that. there is fill(0) for influxdb but don't know what's the JSON syntax for that or if it works with graphite21:19
clarkbmgagne: tranformNull I think21:19
clarkb*transform21:20
jeblairmgagne: graphite has a function to return null where there is no data, but i'm not aware of a function to return null or zero when there is no *database*21:20
mgagnefound that one too and tried by using it against the series name. didn't work as I think fetch is executed and fails before function is called.21:20
jeblairclarkb: yes, that one :)21:20
*** bharathm has joined #openstack-infra21:21
*** vipul has quit IRC21:21
*** SlickNik has quit IRC21:21
*** spiffxp has quit IRC21:21
*** SlickN1k is now known as SlickNik21:21
*** hashar has quit IRC21:21
*** aeng has joined #openstack-infra21:21
clarkblogstash-worker20 is much much happier now21:24
*** baoli has quit IRC21:24
clarkbso I think I will go ahead and update the puppet changes to drop ES from the workers and use logstash's built in load balncing21:24
*** Guest22701 has quit IRC21:24
*** baoli has joined #openstack-infra21:25
*** jsavak has quit IRC21:25
*** jsavak has joined #openstack-infra21:25
*** weshay_xchat has joined #openstack-infra21:26
*** julim has quit IRC21:27
*** weshay has quit IRC21:27
*** ozamiatin has quit IRC21:28
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add accessDatabase and emailReviewers capabilities  https://review.openstack.org/26435721:29
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Make Gerrit account details public  https://review.openstack.org/26435821:29
fungii've enabled that second one on review-dev temporarily while testing whether it exposes anything dangerous. in the meantime i'll mark it wip21:30
*** jsavak has quit IRC21:31
mgagneI think it would be more simple to create an empty series and forcefully insert a 0 value21:31
*** jsavak has joined #openstack-infra21:31
*** weshay_xchat is now known as weshay_21:32
*** xyang0 has quit IRC21:34
*** baoli has quit IRC21:36
clarkbcrinkle: nibalizer in an erb puppet template do I need to do anything special to convert a puppet array to text like [ "foo", "bar" ] ?21:37
*** baoli has joined #openstack-infra21:37
clarkbhrm looks like elasticsearch yml config file does some fancy join21:38
*** aopincar has quit IRC21:38
HenryGfungi: jeblair: another dumb gertty question: how do I leave a top comment ("recheck") without changing my vote on a review?21:38
jeblairHenryG: just ensure the vote values are the same21:39
*** dprince has quit IRC21:39
HenryGjeblair: ok21:39
jeblairmaybe they should default to one's most recent vote?21:39
fungiHenryG: the r key21:39
*** nadya has joined #openstack-infra21:40
HenryGjeblair: that would be nice21:40
*** bharathm has quit IRC21:40
*** nadya is now known as Guest4989221:40
fungiHenryG: ? key or F1 gives you context help on relevant keybindings21:40
anteayamy isp went away, and their phone line gives a busy signal :(21:40
crinkleclarkb: yeah i think you want array.to_s to print it with the brackets like that21:40
fungiHenryG: and you might have to scroll down to see them all21:40
clarkbcrinkle: and it will double quote not single quote? thats easy21:41
fungiheading out to get an early dinner, back later21:41
anteayaclarkb: I was just looking at logstashworker20 as well, something happened in the last 24 hours to make the memory blip but it is still lower than 0121:41
anteayafungi: enjoy dinner21:41
crinkleclarkb: looks like? http://paste.openstack.org/show/483183/21:41
nibalizerclarkb: you can see the string reprensentation with irb21:41
HenryGfungi: thanks, I was using 'r' but it defaults to score 0,0 even if I have already voted.21:42
nibalizerhaha crinkle hi521:42
crinkleo/21:42
*** trown is now known as trown|outttypeww21:42
clarkbya that looks right. last question. is scope['somescope::here'] the new way of doing cross scope var lookups in erb?21:43
*** bharathm has joined #openstack-infra21:43
docaedoAnyone familiar with proposal-bot care to take a look at this log? Something is obviously wrong but it looks like the error was with git_review rather than my link-check script and that seems unlikely - http://logs.openstack.org/93/262293/1/experimental/propose-app-catalog-update/2591cd1/21:44
*** kgiusti has left #openstack-infra21:45
crinkleclarkb: yeah it's exactly the same as scope.lookupvar https://docs.puppetlabs.com/puppet/latest/reference/lang_template_erb.html#scopevariable-or-scopelookupvarvariable21:45
crinkleclarkb: using the @ syntax is still best when possible21:46
*** peristeri has quit IRC21:46
*** dtardivel has quit IRC21:47
openstackgerritClark Boylan proposed openstack-infra/system-config: Logstash 2.0 compat ES output rule  https://review.openstack.org/24771421:48
clarkbsomething like ^ should do the logstash 2.0 setup as currently on worker2021:49
*** Guest49892 has quit IRC21:51
*** baoli has quit IRC21:51
*** ari has quit IRC21:52
*** rfolco has quit IRC21:52
*** baoli has joined #openstack-infra21:53
*** armax has quit IRC21:53
*** matrohon has quit IRC21:53
mordredoh good. bluebox is booting nodes so far21:54
*** ozamiatin has joined #openstack-infra21:54
anteayayay21:55
*** baoli has quit IRC21:55
*** baoli has joined #openstack-infra21:55
*** vgridnev has quit IRC21:55
*** bharathm has quit IRC21:56
*** erlon has quit IRC21:56
mgagnejeblair how much time should we wait before bumping max servers? I would like to test overcommit and see if our cpu model can provides enough performance for jobs21:57
*** weshay_ has quit IRC21:57
*** jsavak has quit IRC21:58
anteayaall your nodes seem to be performing without error, I am fine bumping the number of nodes for internap if you are mgagne21:59
clarkbheads up that devstack-centos7 is only provided by hpcloud currently21:59
clarkbso uh we need to figure that out21:59
mgagneanteaya I'm asking since ref guide strongly suggests not using overcommit due to previous experimentation showing it was bad.22:00
clarkbkolla, anvil, rally, oslo.messaging, and dib all use that label22:00
anteayamgagne: currently set at 12, what do you want it to be?22:00
mgagne2422:00
anteayamgagne: very good, I will create a patch and we can decide when to merge it if now is not the right time22:01
mgagnethanks!22:01
*** bharathm has joined #openstack-infra22:01
anteayawelcome22:01
clarkboh I know how to fix this, its a dib image so we can just upload to ovh and internap22:01
*** baoli has quit IRC22:01
*** baoli has joined #openstack-infra22:02
*** ociuhandu_ has joined #openstack-infra22:04
*** baoli has quit IRC22:04
*** rguillebert has quit IRC22:04
*** lindsayk has quit IRC22:04
*** dtroyer has quit IRC22:04
*** DuncanT has quit IRC22:04
*** bradjones has quit IRC22:04
*** ociuhandu has quit IRC22:04
*** dimtruck has quit IRC22:04
*** mescanef_ has quit IRC22:04
*** ociuhandu_ is now known as ociuhandu22:04
Nakatopc_m: The only way to make it consistent is to always duplicate `commands`.  Here's the relevant bug: https://bitbucket.org/hpk42/tox/issues/279/     There's another bug to make sections factorable...22:04
*** MIDENN_ has joined #openstack-infra22:04
*** aorourke_ has joined #openstack-infra22:04
*** lindsayk- has joined #openstack-infra22:04
*** bradjones has joined #openstack-infra22:04
*** bradjones has quit IRC22:04
*** bradjones has joined #openstack-infra22:04
*** baoli has joined #openstack-infra22:04
*** Swami has quit IRC22:04
*** vkramskikh has quit IRC22:04
*** rguillebert has joined #openstack-infra22:05
*** Swami has joined #openstack-infra22:05
*** khappone_ has joined #openstack-infra22:05
*** markvan has quit IRC22:05
*** aorourke has quit IRC22:05
*** mdenny has quit IRC22:05
*** sdague has quit IRC22:05
*** maximov has quit IRC22:05
*** khappone has quit IRC22:05
*** dougwig has quit IRC22:05
openstackgerritAnita Kuno proposed openstack-infra/project-config: Increase internap max servers from 12 to 24  https://review.openstack.org/26437022:05
anteayahttps://review.openstack.org/#/c/264370/22:05
anteayathere you are22:05
*** markvan has joined #openstack-infra22:05
*** rhallisey has quit IRC22:05
*** bharathm has quit IRC22:06
clarkbwe also have jobs running on fedora21 still which is EOL iirc22:06
*** angdraug has joined #openstack-infra22:07
openstackgerritClark Boylan proposed openstack-infra/project-config: Set hpcloud max-servers to -1  https://review.openstack.org/26437122:07
openstackgerritClark Boylan proposed openstack-infra/project-config: Remove HPCloud nodepool config  https://review.openstack.org/26437222:07
clarkbI have WIP'd the first one22:08
*** maximov has joined #openstack-infra22:08
*** bharathm has joined #openstack-infra22:08
clarkbhow do we want to approach the fedora 21 end of life? I think we have always said we would just turn that testing off?22:08
*** ozamiatin has quit IRC22:08
*** salv-orl_ has joined #openstack-infra22:09
*** baoli has quit IRC22:10
clarkbalso confirmed EOL was beginning of last month22:10
*** dtroyer has joined #openstack-infra22:10
*** amuller has quit IRC22:10
*** sdague has joined #openstack-infra22:11
*** dimtruck has joined #openstack-infra22:11
clarkbdib is one of the projects tested on f2122:11
*** weshay_ has joined #openstack-infra22:11
clarkbgreghaynes: SpamapS ^ would it make sense to do centos7 instead?22:11
*** piet has quit IRC22:11
*** salv-orlando has quit IRC22:12
greghayneshrm22:12
clarkboh centos7 is already there. I am just going to push a stop f21ing change22:12
greghaynesis f23 not available yet?22:13
greghaynesas a test node22:13
clarkbI don't think so22:13
greghaynesok, well yep - its EOL so SGTM22:13
*** vkramskikh has joined #openstack-infra22:13
*** dkranz has quit IRC22:14
*** _ody has joined #openstack-infra22:14
*** tzn has quit IRC22:14
*** otter768 has joined #openstack-infra22:15
*** weshay_ has quit IRC22:17
*** dougwig has joined #openstack-infra22:17
*** rhallisey has joined #openstack-infra22:17
*** DuncanT has joined #openstack-infra22:17
openstackgerritJames E. Blair proposed openstack/gertty: Add process mark to project list  https://review.openstack.org/25970122:18
openstackgerritJames E. Blair proposed openstack/gertty: Add project topics  https://review.openstack.org/25967122:18
openstackgerritJames E. Blair proposed openstack/gertty: Cache counts of project changes  https://review.openstack.org/26008522:18
openstackgerritJames E. Blair proposed openstack/gertty: Correct display of comments at start of file  https://review.openstack.org/26437522:18
jeblairHenryG, fungi: https://review.openstack.org/26437522:19
*** otter768 has quit IRC22:20
*** fmccrthy has quit IRC22:22
*** baoli has joined #openstack-infra22:22
openstackgerritClark Boylan proposed openstack-infra/project-config: Fedora 21 is EOL stop using it  https://review.openstack.org/26437822:22
openstackgerritClark Boylan proposed openstack-infra/project-config: Remove Fedora 21 from nodepool  https://review.openstack.org/26437922:22
*** dims has quit IRC22:22
clarkbgreghaynes: looks like there are fedora 23 nodes but not sure what state they are in, you can add them to dib and find out though22:23
openstackgerritSpencer Krum proposed openstack-infra/puppet-hound: Logrotate the hound log  https://review.openstack.org/26438022:23
greghaynesclarkb: awesome22:23
jrolljeblair: you have buyoff for nodepool-rax dashboard22:23
*** fmccrthy has joined #openstack-infra22:24
jeblairjroll: awesome, thanks!22:24
jrollnp22:24
*** Sukhdev has joined #openstack-infra22:24
*** tonytan4ever has quit IRC22:26
*** ozamiatin has joined #openstack-infra22:26
*** shardy has quit IRC22:26
HenryGjeblair: thanks!!22:26
*** baoli has quit IRC22:28
*** austin81 has left #openstack-infra22:29
*** jtomasek has quit IRC22:30
*** cloudtrainme has joined #openstack-infra22:36
openstackgerritJames E. Blair proposed openstack-infra/project-config: Grafana: Add Rackspace nodepool graph  https://review.openstack.org/26438422:37
openstackgerritJames E. Blair proposed openstack-infra/project-config: Grafana: adjust internap graphs to match rax  https://review.openstack.org/26438522:37
*** ozamiatin has quit IRC22:40
*** hdd has quit IRC22:42
craigeo/22:43
jeblairfungi: would you be so kind as to ack https://review.openstack.org/264392 ?22:44
*** tonytan4ever has joined #openstack-infra22:45
*** mriedem has quit IRC22:46
*** kzaitsev_mb has joined #openstack-infra22:46
*** bpokorny has joined #openstack-infra22:49
*** krtaylor has quit IRC22:51
*** baoli has joined #openstack-infra22:52
*** dims has joined #openstack-infra22:53
*** thorst has quit IRC22:54
*** bharathm has quit IRC22:54
*** baoli has quit IRC22:56
*** baoli has joined #openstack-infra22:57
*** mhayden has quit IRC22:57
*** davideagnello has joined #openstack-infra22:57
clarkbI have rechecked the use a swap file change. It failed grenade due to an ssh failure23:00
*** bharathm has joined #openstack-infra23:02
craigeI've hit a small SQL problem in the Phabricator migration script that's currently got me stumped. If anyone like rbradfor would like take a squiz at the problem, I've written it up here: https://etherpad.openstack.org/p/SQLPHAB23:04
*** dims has quit IRC23:04
openstackgerritMerged openstack/requirements: Bump os-client-config constraint and minimum  https://review.openstack.org/26009223:05
*** dingyichen has joined #openstack-infra23:06
*** bharathm has quit IRC23:07
*** tonytan4ever has quit IRC23:07
*** regXboi has quit IRC23:08
*** tzn has joined #openstack-infra23:08
*** baoli has quit IRC23:09
*** dimtruck is now known as zz_dimtruck23:11
openstackgerritMerged openstack/requirements: Bump minimum oslo.config version  https://review.openstack.org/26114723:11
*** bharathm has joined #openstack-infra23:11
openstackgerritMerged openstack/requirements: Bump SQLAlchemy version to 1.0.10  https://review.openstack.org/25953223:11
*** tzn has quit IRC23:13
*** rocky_g has quit IRC23:14
clarkbjeblair: in grpahite when querying the jobs launched numbers, the numbers/graph seem to fall off at about novemeber23:16
clarkbjeblair: could that be related to the dezeroing of the files? or any other ideas?23:17
jeblairclarkb: i believe i re-orged them then; before then the numbers are in a different metric file23:17
*** rfolco has joined #openstack-infra23:17
clarkbaha23:17
clarkbjeblair: but that file still exists? so its just a matter of summing the two?23:18
*** amitgandhinz has quit IRC23:18
jeblairclarkb: (though, i thought i moved many of the most important ones? maybe i missed jobs launched?)23:18
jeblairclarkb: should be yeah23:18
clarkbgreat, that should be enough to sort this out. thank you23:18
*** pradk has quit IRC23:18
jeblairclarkb: hrm, i think this one wasn't affected23:20
*** kzaitsev_mb has quit IRC23:20
clarkbya looking at the git log for the status page I don't think it was23:20
*** davideagnello has quit IRC23:20
clarkbjeblair: but if you do say -1year and incrememnt on 1month you get a huge spike in novemeber and onward23:20
*** davideagnello has joined #openstack-infra23:21
jeblairclarkb: i wonder if it's related to fixing the rollup, which i also did around the same time23:21
*** hdd has joined #openstack-infra23:24
*** mhayden has joined #openstack-infra23:25
*** sigmavirus24 is now known as sigmavirus24_awa23:25
*** davideagnello has quit IRC23:25
jeblairhrm, i can't get grafana to display graphs with an absolute start time (only "30 days ago")23:26
jeblair(back to graphite)23:26
*** woodster_ has quit IRC23:26
clarkbits right around 50-60k jobs launched per month until november then it spikes to 300k and above23:27
clarkbduring busy times 50-60k is half a week23:27
*** dims_ has joined #openstack-infra23:29
*** hdd_ has joined #openstack-infra23:29
*** hdd has quit IRC23:29
clarkbI wonder if thats scaled down somehow23:30
clarkbsince * 10 is roughly what the current values are23:30
*** mescanef has joined #openstack-infra23:30
*** davideagnello has joined #openstack-infra23:34
*** dims_ has quit IRC23:34
jeblairclarkb: there is an archive transition at 1week, and that event appears to be about 1 week before when i ran the commands to adjust the databases; it's at least plausible that there was a rollup error then23:35
*** sridhar_ram1 has joined #openstack-infra23:36
fungiback, catching up on scrollback now23:36
*** annegentle has quit IRC23:36
*** dims_ has joined #openstack-infra23:36
*** sridhar_ram has quit IRC23:37
openstackgerritMax Kovgan proposed openstack-infra/jenkins-job-builder: Adds support for additional authorizations  https://review.openstack.org/12602523:37
*** baoli has joined #openstack-infra23:38
openstackgerritMerged openstack/requirements: Add i18n to the projects list  https://review.openstack.org/25697623:40
*** thorst has joined #openstack-infra23:40
clarkbjeblair: so probably can't rely on that then23:41
*** Qiming has joined #openstack-infra23:41
*** rfolco has quit IRC23:41
clarkbat least not before that point in time23:41
fungidocaedo: it looks like it is attempting to propose a change from a job run on an unmerged change. i'm not sure that running post jobs (is this meant to eventually run in the post pipeline?) in the experimental pipeline is the best idea23:41
*** ddieterl_ has quit IRC23:42
docaedofungi: ah that explains it - yes .. it was suggested that I make this experimental to test it23:42
fungigreghaynes: clarkb: ianw was working out the remaining issues with using f23 (and i guess it was decided to skip f22 in favor of f23 but now maybe that was a less great idea?)23:42
*** baoli has quit IRC23:43
docaedofungi: it is intended to run periodically on it's own - just not sure how best to make sure it works right before making it periodic23:43
fungijeblair: yep, 264375 is solving it for me too23:43
clarkbjeblair: as an alternative I guess we can look at the total number of nodes that were used23:43
clarkblet me see what that data looks like23:43
jeblairclarkb: it seems likely that the error can be compensated for by straightforward scaling (since we know the order of magnitude was the same before and after that point)23:44
*** mriedem has joined #openstack-infra23:44
jeblairclarkb: depends on if this is going in a scientific journal or the back of a napkin23:44
*** thorst has quit IRC23:45
clarkbback of napkin is probably fine23:45
*** krtaylor has joined #openstack-infra23:45
fungidocaedo: it might make more sense to put it directly into periodic and then check the logs for signs of failure. running it in experimental (a change-oriented pipeline) when it wants to propose changes from runs on periodic (a non-change-oriented pipeline) is likely to result in strangeness23:47
*** rguillebert has quit IRC23:47
fungijeblair: marketing material, so whatever's even lower than cocktail napkin on that scale23:48
docaedofungi: thanks for that, I'll fix it up then and just make it periodic - how often do the periodic jobs get triggered? Or is that something I specify somewhere (and if so I'll poke around more to become educated, just let me know(23:48
fungidocaedo: it depends on which periodic pipeline it runs in (or if you're defining a new periodic pipeline then you get to choose)23:49
fungidocaedo: usually daily though23:49
*** baoli has joined #openstack-infra23:49
docaedofungi: daily would be what I want, thanks23:49
docaedofungi: I'll look at other examples to make sure I specify the right pipeline23:50
jeblairclarkb, fungi: enough things are x10 that i'd beleive that as a compensating factor23:51
clarkbok, thats roughly what I see too so I will go with that23:51
*** tsg has quit IRC23:51
clarkbjeblair: now to find out when the rollup happened and get two sets of numbres to add23:51
clarkblooks like around 11/1923:52
*** gordc has quit IRC23:52
jeblairclarkb: the error appears at 11/10 in the data23:53
clarkbthanks23:53
clarkbso I can do 20150101 to 20151110 and 20151111 to 2015123123:54
clarkbscale first numbers by 10x23:54
jeblairyeah, i think that will be reasonable23:54
openstackgerritMerged openstack/gertty: Correct display of comments at start of file  https://review.openstack.org/26437523:56
*** Sukhdev has quit IRC23:58
*** oomichi has joined #openstack-infra23:59
clarkbhrm from=20150101&until=20151110 still shows me after the until23:59
*** ajmiller has quit IRC23:59
clarkbprobably doing something wrong with the api23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!