Tuesday, 2013-12-03

sdaguejeblair: so... the jobs that runs are very different than other jobs00:00
*** rongze has quit IRC00:00
sdaguebut if you have a better fingerprint, have at :)00:00
jeblairsdague: i don't understand your answer.00:01
openstackgerritClark Boylan proposed a change to openstack-infra/config: Import zuul-packaging into openstack-infra  https://review.openstack.org/5610700:01
clarkbjeblair: fungi: mordred: ^ pabelanger's change merge conflicted. I am going to self approve the resolution change shortly00:02
sdaguethe neutron large ops job runs a completely different payload than other jobs, so it was probably a short circuit00:02
clarkbbut do feel free to rereview :)00:02
*** fbo_away is now known as fbo00:02
sdaguebasically, it is effective unique, but I agree, using job name is less than ideal00:02
jeblairsdague: fyi we now have 100.0 devstack tempest jobs.00:03
sdaguenice00:03
sdague.000:03
clarkbwe are going to delete about half of them though00:03
sdaguevery precise :)00:03
sdagueheh00:04
jeblairsdague: that's 3 significant digits, not 1.  :)00:04
*** NobodyCam_afk is now known as NobodyCam00:04
clarkb(not quite half as some of them are extras from my changes that aren't being run yet)00:04
jeblairclarkb: no, that's a local count in a clean jjb run.00:04
clarkboh wow00:04
fungiclearly we need MORE00:05
jeblairsdague: so anyway, i bring it up because 1250168 only matches 1 of the 7 jobs that could trigger it.00:05
jeblairsdague: and listing all 7 is clearly not the right answer to that.  :)00:06
sdagueok, cool00:06
sdaguesorry, my brain is lost in trying to implement locally nested facets with the er results, because we can't get that from er00:06
jeblairsdague: and now my brain is lost too.00:07
clarkbsdague: where clauses would be so nice00:07
clarkband sub query like things00:07
sdagueclarkb: yeh00:08
sdagueoh well00:08
*** datsun_F40PH has quit IRC00:08
*** hogepodge has joined #openstack-infra00:08
ArxCruzclarkb: around?00:09
*** mrodden has quit IRC00:09
clarkbArxCruz: yes00:09
ArxCruzclarkb: so, do you want me to add a patch to ssh -t in nodepool ?00:09
clarkbArxCruz: yes, I think that will be required00:09
ArxCruzusing paramiko00:09
clarkbArxCruz: jeblair may have better ideas, but I don't want to rely on special images as nodepool is building the special images for us00:10
ArxCruzclarkb: okay, it's when nodepool try to connect through ssh in the vm to install stuff correct ?00:10
clarkbArxCruz: yes00:10
clarkbArxCruz: the other alternative is to ssh in as root and do all of the things there00:10
ArxCruzclarkb: I see, so, o-infra is already testing fedora ?00:10
clarkbArxCruz: I think some of what nodepool does happens ssh'd in as root00:10
ArxCruzafaik this only happens in fedora, not in precise00:10
clarkbArxCruz: we tried adding fedora hosts late last week so that dprince could start that and this is when we saw the problem00:11
ArxCruzclarkb: I see, I got this problem my my FC too, but this there's nothing to do with my patch correct? It's a new patch, I wondering why you had to rollback00:11
clarkbArxCruz: we had to rollback the change that added fedora nodes to nodepool because they were failing image builds00:12
clarkband taking up resources00:12
ArxCruzthe easiest way to fix in my side was enable tty in visudoers00:12
ArxCruzclarkb: ahhh, not mine patch, got it00:12
clarkbArxCruz: right, but it is nodepool's job to do that for us and it can't :)00:12
openstackgerritA change was merged to openstack-infra/config: Import zuul-packaging into openstack-infra  https://review.openstack.org/5610700:12
ArxCruzclarkb: tomorrow I will work on a patch :)00:12
clarkbArxCruz: awesome thanks00:12
ArxCruzyw00:13
*** rcleere has quit IRC00:13
*** fbo is now known as fbo_away00:13
*** yamahata_ has quit IRC00:15
*** weshay has joined #openstack-infra00:16
*** dkliban has quit IRC00:17
*** wenlock_ has quit IRC00:17
pabelangerclarkb, cool!00:18
pabelangeralso00:18
pabelanger\o/00:18
clarkbpabelanger: we are using you as the guinea pig to see if new manage-projects is happy00:18
pabelangerclarkb, fair enough00:19
clarkbwaiting for puppet to fire and pull run manage-projects is pretty boring00:21
fungibrace for impending disappointment (maybe)00:21
clarkbjog0: https://jenkins02.openstack.org/job/gate-tempest-devstack-vm-neutron-large-ops-default/75/console large ops seems to be failing a bit00:22
clarkbfor the new hpcloud region nodepool config change, I think I may apply that change to nodepool.o.o by hand to make it easy to deal with "reverts"00:23
*** dims has joined #openstack-infra00:23
*** dcramer_ has quit IRC00:24
clarkbmanage-projects is running00:24
*** rnirmal has quit IRC00:27
clarkbseems to have populated data for zuul-packaging, but hasn't updated the acls00:27
clarkbwaiting for the script to finish running before I hit it with a hammer00:27
openstackgerritA change was merged to openstack-infra/config: Make job names shorter  https://review.openstack.org/5956400:28
*** matsuhashi has joined #openstack-infra00:29
*** markwash has quit IRC00:30
pabelangerclarkb, ping me once the repo is good, I have some patches already lined up00:30
clarkbhrm there is a cron that runs manage-projects too00:32
clarkbI bet that is one reason we have trouble with github00:32
clarkbtoo many cooks in the kitchen00:32
fungiclarkb: github project creation succeeded00:32
*** nati_uen_ has joined #openstack-infra00:33
clarkbfungi: I think everything worked, but applying the ACLs00:33
fungialso, i'm not again' a cron job running m-p but if we keep it we should have that and the puppet one share a lockfile00:33
clarkbfungi: or just remove the exec in puppet and ask people to wait half an hour00:34
*** nati_ueno has quit IRC00:35
clarkbrerunning it by hand populated the ACLs00:35
clarkbI forgot I had to add a -v to see the debug output though :( so I didn't see any data00:35
fungidisappointing. i wonder what the issue was00:35
clarkbI am guessing there may still be a race around group creation00:35
clarkbwe might need to do something hacky and add a sleep00:36
clarkbpabelanger: in any case you are good to go00:36
*** ^d has quit IRC00:36
clarkbzuul clone looks good too00:37
*** ^d has joined #openstack-infra00:37
*** CaptTofu has quit IRC00:38
pabelangerclarkb, roger that00:38
*** CaptTofu has joined #openstack-infra00:39
pabelangernow that it is imported, I'll remove my repo and clone00:39
openstackgerritClark Boylan proposed a change to openstack-infra/jeepyb: Always sleep after group creation.  https://review.openstack.org/5958300:39
clarkbfungi: hacks like ^ might help00:39
clarkbI need to head home shortly to catch the beginning of the football game00:40
clarkbI plan on adding the new hpcloud region by hand to nodepool once there00:40
clarkbunless someone else wants to give it a shot00:40
* clarkb AFKs00:41
fungiawcrapdoubleunplus00:44
fungii'll reverify the changes which got lost when zuul tried to fire nonexistent "dvsm" jobs in the past few minutes00:45
fungiat least the ~3 i spotted00:45
*** nati_uen_ has quit IRC00:45
fungiand i even saw the mention that we'd probably want to stop puppet on zuul.o.o for that change, then totally spaced it00:46
*** nati_ueno has joined #openstack-infra00:46
*** sdake_ has quit IRC00:47
*** sdake has quit IRC00:47
*** hogepodge has quit IRC00:49
*** matsuhashi has quit IRC00:50
clarkboh whoops00:50
fungizaro: on 57333 i was going to add the three new entries for your change to hiera... what do i need to do to generate the uuid-like identifier for jenkins_dev_credentials_id?00:50
*** matsuhashi has joined #openstack-infra00:50
dimsmessage:"No workspace found, files cannot be copied." <<< Just logged a bug 125712500:51
uvirtbotLaunchpad bug 1257125 in openstack-ci "No workspace found, files cannot be copied" [Undecided,New] https://launchpad.net/bugs/125712500:51
fungidims: have an example change?00:52
fungii'm trying to figure out how to get to the ful log for a failure matching that from the logstash reference you linked in the bug00:53
fungi(there's a good chance it's my fault)00:53
*** michchap_ has quit IRC00:53
*** matsuhas_ has joined #openstack-infra00:53
*** michchap has joined #openstack-infra00:53
fungiahh, found one00:53
*** matsuhashi has quit IRC00:54
*** krotscheck has quit IRC00:54
fungiand yeah, that was me--thanks for filing that, dims. at least now i know what it's going to look like for the others which haven't reported yet00:54
dimscool :)00:55
dimsbiab00:55
*** dangers is now known as danger_fo_away00:55
*** marun has joined #openstack-infra00:55
*** dolphm has quit IRC00:56
*** dcramer_ has joined #openstack-infra00:59
*** reaper has quit IRC01:00
dimsfungi, job rename issues?01:01
fungidims: well, me issues. for merging a job rename change hastily01:01
*** jerryz has quit IRC01:01
fungithankfully it only seems to have impacted a small handful of jobs, but that was one of them01:02
*** marun has quit IRC01:02
dimsnice thanks01:02
*** sdake has joined #openstack-infra01:03
*** ryanpetrello has joined #openstack-infra01:03
fungilooks like the last of that hanmdful of changes has reported and been rechecked/reverified as needed01:08
*** herndon_ has joined #openstack-infra01:13
*** sdake has quit IRC01:15
ekarlsoanyone here with git kungfu skills ?01:17
clarkbsure, whats up01:18
ekarlsotrying to rebase https://review.openstack.org/#/c/58316/, so I do a git review -d <changeset> then do git rebase master01:18
ekarlsobut it borks Failed to merge in the changes.... so I fix it up and do "git add" on the files01:18
ekarlsobasically struggling with rebase at all :(01:19
*** beagles has quit IRC01:19
clarkbafter you git add all of the files that show up as unmerged in `git status` you need to `git rebase --continue`01:20
*** yamahata_ has joined #openstack-infra01:20
*** mrodden has joined #openstack-infra01:23
ekarlsoclarkb: yeh, and then after fixing the "both modified and doing add on them01:26
*** nosnos has joined #openstack-infra01:26
ekarlsoI do --continue and get No changes - did you forget to use 'git add'?01:26
clarkbekarlso: what does git status say?01:27
*** rongze has joined #openstack-infra01:27
clarkbekarlso: it sounds like you reverted all of the changes01:27
clarkbin the fixup you went back to the base instead of the new code01:27
ekarlsohmmm01:28
ekarlsoshouldn't it be01:28
ekarlsogit review -d <changeset>01:28
ekarlsogit rebase master01:28
ekarlso?01:28
clarkbyes01:29
clarkbekarlso: but when you resolve the conflicts you can essentially go back to having what was in master01:29
ekarlsohmmmms, my head doesn't wrap around that atm /:01:30
clarkbekarlso: so with a rebase you are taking two commit trees and pasting one on top of the other01:30
ekarlsoyeah01:30
clarkbekarlso: this process is unable to automagically happen because there are conflicts. when resolving those conflicts it is possible to essentially noop the paste making the new code on master not change anything01:31
*** rongze has quit IRC01:31
clarkbyou are doing master + something else. when resolving the conflicts something else can become nil01:31
*** yamahata_ has quit IRC01:34
ekarlsoclarkb: is "git rebase" the way to make my change up to speed ?01:35
clarkbyes it moves your change from the old base to the new base01:36
*** jcooley_ has joined #openstack-infra01:37
ekarlsoso rebase master, then git add ?01:37
clarkbyou have to resolve any git conflicts in between01:38
clarkbgit status will show you which files are unmerged01:38
ekarlsohttp://pastebin.com/EP7kaMC5 < clarkb, I know how to resolve the both modifieds but what's up with "added by us" ?01:39
*** sjing has joined #openstack-infra01:39
clarkbekarlso: they are new files added by your change01:40
fungipossibly the unspoken part here is that you need to edit the files which are marked as "both modified" and then git add those once they look they way that you'll want them in the final merged version01:40
clarkbthey are not in master01:41
*** sarob_ has joined #openstack-infra01:41
fungidifferences between the two will be denoted by start and end markers like <<<<<<<< and ======== and >>>>>>>>01:41
fungiinside the files you need to edit01:42
clarkbfungi: you going to be around for a little bit longer? if so I am going to try the hpcloud nodepool change shortly01:42
fungiclarkb: yes, will be right here01:42
*** CaptTofu has quit IRC01:42
ekarlsoclarkb: they are very much in master the added by us files...01:42
*** CaptTofu has joined #openstack-infra01:43
ekarlsofungi: I fixed the confliects and did a git add on the both modified files01:43
*** sarob has quit IRC01:43
clarkbhmm is master "us" in this case?01:43
clarkbit might be01:43
ekarlsoalso after resolving and trying --continue again I get: No changes - did you forget to use 'git add'?...01:44
ekarlsoI guess my git-fu isn't good :(01:44
clarkbekarlso: right, that implies that you resolved the conflicts by setting them to what is in master01:44
clarkbso there are no changes01:44
fungiekarlso: you needed to edit designate/tests/__init__.py and designate/tests/test_backend/test_nsd4slave.py (saving them in your editor), then git add each of them, then git rebase --continue01:45
*** jcooley_ has quit IRC01:45
ekarlsofungi: and yes I did ..01:45
*** ryanpetrello has quit IRC01:45
fungiokay, just making sure01:45
clarkbekarlso: also check out git for four year olds or whatever schwerns talk is called, it is very good for understanding how git works01:45
*** sarob_ has quit IRC01:45
fungihttp://2010.osdc.com.au/proposal/196/git-ages-4-and01:46
fungiaww, that conference took down the video linked there01:46
ekarlsowell, not today.. :) it's allmost 3 am and I wanted to get my change rebased before bed :)01:46
*** kui has joined #openstack-infra01:47
openstackgerritClark Boylan proposed a change to openstack-infra/config: Add new HP Cloud region  https://review.openstack.org/5626001:49
clarkbfungi: ^ that is just a rebase (too many other changes would have been made to nodepool.o.o without the rebase01:49
clarkbfungi: applying that now01:50
*** slong is now known as summerlong01:50
fungiclarkb: yep, looks like what we discussed, i just hadn't circled back around to it since the azs got collapsed into one01:51
fungilgtm01:52
clarkbthe image build is going01:53
*** nibalizer has quit IRC01:57
clarkbpuppet is running02:00
*** reed has quit IRC02:00
clarkbif this pans out I am going to have to request a bunch of quota in that region tomorrow02:00
openstackgerritPaul Belanger proposed a change to openstack-infra/config: Add zuul-packaging to #openstack-infra  https://review.openstack.org/5959502:00
*** jcooley_ has joined #openstack-infra02:01
*** MarkAtwood has quit IRC02:01
*** jcooley_ has quit IRC02:02
*** nibalizer has joined #openstack-infra02:03
ekarlsonighty clarkb  and thanks ! :)02:03
*** mriedem has joined #openstack-infra02:05
*** rongze has joined #openstack-infra02:06
*** yaguang has joined #openstack-infra02:07
fungiclarkb: what was the upshot of floating-ip quota discussions for that region?02:08
clarkbfungi: I think we are just going to ask for a bunch of quota02:08
openstackgerritA change was merged to openstack-infra/devstack-gate: Remove kernel-headers apt-get call  https://review.openstack.org/5438602:08
clarkband see what happens :)02:08
funginot unlike... all previous quota requests i guess. sounds fine by me02:08
funginow that i am not a network architect at an internet service provider, i've completely lost touch with ipv4 runout02:09
*** nati_ueno has quit IRC02:09
clarkbwell I don't know if you noticed, but HP has two /8s02:09
clarkbI think it is silly to hold back on IPs but whatever02:09
fungiyes. in fact, i'd noticed that well before i worked for them. legacy grants02:09
fungiaww, arin's stopped printing their ipv4 death clock on their main page02:11
clarkbI get a public address at my desk which is silly02:11
*** esker has joined #openstack-infra02:13
*** vkozhukalov has joined #openstack-infra02:19
fungiahh, enough hunting finds it at https://www.arin.net/resources/request/ipv4_countdown.html02:19
fungiarin still has 1.57 /8 blocks unallocated in aggregate02:20
clarkbimage builds take forever02:21
*** CaptTofu has quit IRC02:21
*** CaptTofu has joined #openstack-infra02:21
*** dkliban has joined #openstack-infra02:25
*** ryanpetrello has joined #openstack-infra02:27
*** matsuhas_ has quit IRC02:31
*** matsuhashi has joined #openstack-infra02:31
*** sdake has joined #openstack-infra02:32
clarkbimage build still going...02:37
clarkbI am assuming we are waiting on the snapshot to happen because the log isn't saying much anymore02:37
clarkball of the old hpcloud region image builds started after new region and have appeared to complete before new region02:38
clarkbmordred: ^02:38
clarkbso that doesn't bode well02:39
*** ryanpetrello has quit IRC02:43
*** nati_ueno has joined #openstack-infra02:43
clarkbfungi: what do you think?02:45
clarkbI don't see anything ni the logs02:45
clarkbspoke too soon, we appear to have an image now02:47
fungimmm02:47
fungiclearly i disappeared for just the right amount of time02:48
clarkbwaiting for some slaves to show up now02:48
fungiso it seems... slower so far?02:48
clarkbimage builds are slower02:49
clarkbI am guessing that is due to time to create snapshot02:49
*** senk has joined #openstack-infra02:49
clarkbsince the scripty bits seems to fly along just fine02:49
clarkbthen the whole process hangs02:49
clarkbthere is a region b slave building for jenkins02 right now02:53
*** nati_ueno has quit IRC02:53
*** dkranz has joined #openstack-infra02:54
fungii guess we'll have more meaningful stats soon enough, in that case02:55
clarkbhttps://jenkins02.openstack.org/computer/devstack-precise-hpcloud-region-b-774933/02:56
*** sdake_ has joined #openstack-infra02:56
*** sdake_ has quit IRC02:56
*** sdake_ has joined #openstack-infra02:56
*** CaptTofu has quit IRC02:56
clarkband https://jenkins02.openstack.org/job/check-tempest-dsvm-neutron/44/console02:56
*** CaptTofu has joined #openstack-infra02:57
*** dcramer_ has quit IRC02:57
clarkbif that test comes out looking ok, I am going to leave nodepool.o.o as is, or you can approve the change that adds the region and I will restart puppet there02:58
*** nosnos has quit IRC02:58
*** nosnos has joined #openstack-infra02:59
fungii can approve at that point03:00
*** loq_mac has joined #openstack-infra03:00
mordredclarkb: awesome. I'm sure the team will love to hear that :)03:01
clarkbmordred: are you watching the game? I am enjoying this03:03
*** dkliban has quit IRC03:04
*** dkranz has quit IRC03:04
clarkbthere are 5 jobs running on region-b hosts, I have all of them open and will keep an eye on them03:04
*** wenlock_ has joined #openstack-infra03:05
*** chandankumar has joined #openstack-infra03:06
*** nati_ueno has joined #openstack-infra03:07
*** gyee has quit IRC03:14
*** nati_ueno has quit IRC03:17
clarkbfungi: https://jenkins02.openstack.org/job/gate-swift-dsvm-functional/9/ passed03:23
clarkbfungi: that isn't a tempest test though, we can wait a little longer for tempest things to finish03:23
fungiyeah, i'm continuing to keep tabs on the neutron one you linked earlier03:24
clarkbit seems a tad bit slower03:25
*** dstanek_afk has joined #openstack-infra03:26
fungieh03:26
fungiperhaps03:27
clarkbthe swift functional test typically runs in ~14 minutes according to jenkins, it took ~18-19 on new host03:27
clarkbbut that could just be normal variability, need more numbers03:27
fungisounds on par with rackspace03:27
*** jcooley_ has joined #openstack-infra03:29
*** mrodden has quit IRC03:29
*** markwash has joined #openstack-infra03:31
*** mrodden has joined #openstack-infra03:36
mriedemi've never seen this gate error before, not sure how to handle03:37
mriedemhttp://logs.openstack.org/78/35178/10/check/check-tempest-dsvm-full/0dbf076/logs/devstack-gate-setup-workspace-new.txt03:37
mriedemUnable to find ref refs/zuul/master/Zd2b3b9d225c04027a545a4dcfc9101f8 for openstack/glance03:37
mriedemis that an infra problem?03:37
clarkbmriedem: yes, there is a bug under openstack-ci somewhere03:38
mriedemlooking03:38
clarkbthe web server in front of those git repos can't keep up03:38
clarkbfungi: the neutron tests are pretty slow :(03:39
fungimriedem: that message doesn=t usually indicate an error though03:39
mriedemfungi: just trying to look for something on that one to reverify against03:40
mriedemconsole.html didn't show much of anything03:40
clarkbfungi: are you sure? I thought all projects get the ref when zuul does a merge03:40
fungithe setup script asks forgiveness rather than permission when identifying which projects have zuul refs prepared03:41
pabelangerfungi, re: https://review.openstack.org/#/c/46339/03:41
pabelangerIf there is nothing else in the home/gerrit2/review_site/lib/ folder, you could setup puppet to purge the files03:41
pabelangervs selecting specific files and setting them to absent03:42
clarkbfungi: ah gotcha, only projects with changes in them need to have zuul refs03:42
pabelangerI don't know what else is in the dir to properly comment03:42
*** matsuhashi has quit IRC03:42
*** dims has quit IRC03:43
mriedemfungi: is there something i'm not seeing in this log? http://logs.openstack.org/78/35178/10/check/check-tempest-dsvm-full/0dbf076/console.html03:44
fungipabelanger: i'd have to check... i think there could be other stuff, but if memory serves (if it's the change i'm thinking about) then that might be the remainder03:45
*** nati_ueno has joined #openstack-infra03:45
fungimriedem: no idea--i'm not on a computer where i can browse those logs easily03:46
*** sdake has quit IRC03:46
*** sdake has joined #openstack-infra03:46
*** sdake has quit IRC03:46
*** sdake has joined #openstack-infra03:46
pabelangerfungi, okay, comment left. Might be cleaner with purge to maintain it. Just noticed it passing by03:46
fungiclarkb: looks like the neutron job succeeded03:46
clarkbfungi: the neutron check test passed, I thnik we should go ahead and approve the config change, can you do that?03:46
clarkbjinx03:46
fungiyup--doing03:47
clarkbmriedem: it would be something in the setup workspace log that shows why it failed, that scripted exit 1'd for some reason03:47
fungipabelanger: thanks03:48
mriedemclarkb: yeah, it exited with 1 after this "Unable to find ref refs/zuul/master/Zd2b3b9d225c04027a545a4dcfc9101f8 for openstack/glance"03:48
clarkbmriedem: yeah notice the RPC failed message, I think that was the problem03:48
mriedemyup03:49
openstackgerritA change was merged to openstack-infra/config: Add new HP Cloud region  https://review.openstack.org/5626003:49
mriedemclarkb: i couldn't find an existing bug so i opened bug 125715503:49
uvirtbotLaunchpad bug 1257155 in openstack-ci "check-tempest-dsvm-full fails in the gate" [Undecided,New] https://launchpad.net/bugs/125715503:49
mriedemso i could reverify against it quick03:50
*** loq_mac has quit IRC03:52
*** loq_mac has joined #openstack-infra03:57
*** esker has quit IRC03:58
*** loq_mac has quit IRC03:58
*** esker has joined #openstack-infra03:59
*** ^d has quit IRC04:00
*** ^d has joined #openstack-infra04:01
*** resker has joined #openstack-infra04:03
*** esker has quit IRC04:03
clarkbfungi: puppet is running on nodepool.o.o again04:04
*** wenlock_ has quit IRC04:04
clarkbI think we are good I am going to watch new orleans continue to lose04:04
fungiclarkb: awesome. enjoy04:04
*** loq_mac has joined #openstack-infra04:05
*** loq_mac has quit IRC04:05
*** resker has quit IRC04:08
*** loq_mac has joined #openstack-infra04:11
*** weshay has quit IRC04:17
mriedemclarkb: it'll only really be fun if carolina beats new orleans at home in a week04:17
clarkbno no this is fun :)04:18
mriedemclarkb: are you in seattle?04:19
clarkbyes04:19
mriedemwell then, congratulations04:20
mriedemi'm in minnesota and well, you know how their season is going :( percy came back from injury just long enough to trounce the vikings and then get injured again.04:20
*** michchap has quit IRC04:21
*** michchap has joined #openstack-infra04:21
*** rcleere has joined #openstack-infra04:25
*** matsuhashi has joined #openstack-infra04:25
*** rongze has quit IRC04:31
*** CaptTofu has quit IRC04:34
*** CaptTofu has joined #openstack-infra04:35
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Updates to static.o.o volume management docs  https://review.openstack.org/5961504:38
*** herndon_ has quit IRC04:43
lifelessmordred: any answer for my q on https://review.openstack.org/#/c/58106/ ?04:43
lifelessrussellb: btw I meant to ping you about reviewstats for bandwidth, but ELIFEGOTBUSY04:44
*** mriedem has quit IRC04:53
*** DinaBelova has joined #openstack-infra04:56
*** DennyZhang has joined #openstack-infra04:57
*** sarob has joined #openstack-infra04:57
*** DinaBelova has quit IRC04:57
*** senk has quit IRC05:00
*** matsuhashi has quit IRC05:00
*** nono1 has joined #openstack-infra05:01
nono1Question regarding weekly meetup - Is this done on the same IRC channel #openstack-infra ??05:01
*** wenlock_ has joined #openstack-infra05:02
clarkbno it is in #openstack-meeting05:03
nono1so to attend the mtg, i go on webchat for #openstack-meeting ?05:05
lifelessIRC, yes.05:05
nono1that means, no need to mention "openstack-infra" anywhere? but just "#openstack-meeting?"05:06
*** jcoufal has joined #openstack-infra05:07
*** matsuhashi has joined #openstack-infra05:08
nono11 more q - IRC channel doesn't have Audio, right? then for the meeting how does Audio work? Is there any google hangout link for Tuesday mtgs?05:08
*** dstanek has joined #openstack-infra05:09
*** ryanpetrello has joined #openstack-infra05:11
nono1pls someone answer to my query about Audio pls...05:12
openstackgerritKhai Do proposed a change to openstack-dev/pbr: show diff between pip installed packages and requirements  https://review.openstack.org/5463905:12
pleia2nono1: it's all text-based, no audio05:12
*** ryanpetrello has quit IRC05:12
*** ryanpetrello has joined #openstack-infra05:13
*** senk has joined #openstack-infra05:16
*** nono1 has quit IRC05:16
*** markwash has quit IRC05:16
*** ryanpetrello has quit IRC05:17
*** pcrews has quit IRC05:19
*** nicedice has quit IRC05:23
*** crank has quit IRC05:26
*** matsuhashi has quit IRC05:27
fungiwow, that was a surreal series of questions05:29
*** crank has joined #openstack-infra05:31
*** DennyZhang has quit IRC05:31
*** jaypipes has quit IRC05:33
*** loq_mac has quit IRC05:34
*** ^demon has joined #openstack-infra05:41
*** ^d has quit IRC05:43
*** ^demon has quit IRC05:45
*** SergeyLukjanov has joined #openstack-infra05:48
*** sarob has quit IRC05:51
*** sarob has joined #openstack-infra05:51
*** jaypipes has joined #openstack-infra05:54
*** sarob has quit IRC05:56
*** senk has quit IRC05:56
*** matsuhashi has joined #openstack-infra05:59
*** ArxCruz has quit IRC06:00
openstackgerritKhai Do proposed a change to openstack-infra/config: add nodepool to jenkins-dev server  https://review.openstack.org/5733306:01
zarofungi: ^06:01
zarofungi: that jenkins_dev_credentials_id var was a copy/paste mistake.06:02
*** markwash has joined #openstack-infra06:02
*** DennyZhang has joined #openstack-infra06:08
*** pcrews has joined #openstack-infra06:18
*** dstanek has quit IRC06:19
*** sarob has joined #openstack-infra06:22
*** dstanek has joined #openstack-infra06:25
*** pcrews has quit IRC06:26
*** SergeyLukjanov has quit IRC06:27
lifelessdevananda: config/modules/openstack_project/templates/nodepool/nodepool.yaml.erb is where the nodepool stuff is bTW06:31
*** jpeeler has quit IRC06:34
*** fungi has quit IRC06:35
*** fungi has joined #openstack-infra06:36
*** jpeeler has joined #openstack-infra06:37
*** sarob has quit IRC06:38
*** dstanek has quit IRC06:43
*** yamahata_ has joined #openstack-infra06:46
*** vkozhukalov has quit IRC06:47
*** denis_makogon has joined #openstack-infra06:48
*** rcleere has quit IRC06:53
*** summerlong is now known as slong-gone07:01
*** yamahata_ has quit IRC07:07
katyaferventHi! Do you guys know where chat log can be found?07:08
*** bingbu has joined #openstack-infra07:09
*** sdake_ has quit IRC07:09
*** ryanpetrello has joined #openstack-infra07:13
*** ryanpetrello has quit IRC07:19
*** sarob has joined #openstack-infra07:22
*** DinaBelova has joined #openstack-infra07:24
*** vipul has quit IRC07:32
*** vipul has joined #openstack-infra07:33
*** jcooley_ has quit IRC07:35
*** jcooley_ has joined #openstack-infra07:36
*** yolanda has joined #openstack-infra07:38
*** zenoway has joined #openstack-infra07:42
*** nprivalova has joined #openstack-infra07:46
*** DennyZhang has quit IRC07:52
*** fbo_away is now known as fbo07:52
*** _david_ has joined #openstack-infra07:53
*** sarob has quit IRC07:55
*** _david_ has quit IRC07:59
*** flaper87|afk is now known as flaper8708:03
*** avishayb has joined #openstack-infra08:12
*** osanchez has joined #openstack-infra08:14
*** pblaho has joined #openstack-infra08:20
*** sarob has joined #openstack-infra08:22
*** SergeyLukjanov has joined #openstack-infra08:23
*** che-arne has quit IRC08:25
*** vkozhukalov has joined #openstack-infra08:27
*** zenoway has quit IRC08:31
*** jcooley_ has quit IRC08:36
*** jcooley_ has joined #openstack-infra08:38
*** pblaho has quit IRC08:40
*** guohliu has joined #openstack-infra08:41
*** denis_makogon has quit IRC08:42
*** dizquierdo has joined #openstack-infra08:42
*** sjing has quit IRC08:49
*** guohliu has quit IRC08:49
*** ArxCruz has joined #openstack-infra08:50
*** jorisroovers has joined #openstack-infra08:53
*** nati_ueno has quit IRC08:56
*** sarob has quit IRC08:56
*** derekh has joined #openstack-infra08:57
*** dpyzhov has quit IRC08:58
*** guohliu has joined #openstack-infra09:01
*** jpich has joined #openstack-infra09:02
*** boris-42 has joined #openstack-infra09:03
*** jroovers has joined #openstack-infra09:05
*** jorisroovers has quit IRC09:05
*** Ryan_Lane has joined #openstack-infra09:08
*** yassine has joined #openstack-infra09:10
*** avishayb has quit IRC09:10
openstackgerritTom Fifield proposed a change to openstack-infra/jeepyb: Add script to post a gerrit welcome message  https://review.openstack.org/5890009:11
*** hashar has joined #openstack-infra09:12
*** ryanpetrello has joined #openstack-infra09:16
*** ryanpetrello has quit IRC09:20
*** sarob has joined #openstack-infra09:22
*** ilyashakhat_ has quit IRC09:31
*** dizquierdo has quit IRC09:32
*** ilyashakhat has quit IRC09:32
*** jroovers has quit IRC09:32
*** jcooley_ has quit IRC09:34
openstackgerritSergey Lukjanov proposed a change to openstack/requirements: Bump python-savannaclient version to >= 0.4.0  https://review.openstack.org/5965709:39
*** che-arne has joined #openstack-infra09:42
*** markmc has joined #openstack-infra09:48
*** pblaho has joined #openstack-infra09:48
*** kushi_ has joined #openstack-infra09:50
*** matsuhashi has quit IRC09:51
*** kui has quit IRC09:52
*** bingbu has quit IRC09:53
*** matsuhashi has joined #openstack-infra09:54
*** kushi_ has quit IRC09:55
*** sarob has quit IRC09:55
jog0clarkb: both large ops seem to be failing09:56
jog0we have a bug for it https://bugs.launchpad.net/neutron/+bug/123230309:58
uvirtbotLaunchpad bug 1232303 in tempest "FAIL: tempest.scenario.test_large_ops.TestLargeOpsScenario.test_large_ops_scenario[compute,image]" [Undecided,New]09:58
*** jishaomei has joined #openstack-infra10:02
openstackgerritA change was merged to openstack-infra/elastic-recheck: Update job names  https://review.openstack.org/5957310:04
*** jcooley_ has joined #openstack-infra10:05
*** ilyashakhat has joined #openstack-infra10:06
openstackgerritYuuichi Fujioka proposed a change to openstack-dev/hacking: cheking for metaclass to be Python 3.x compatible  https://review.openstack.org/5689010:08
*** dizquierdo has joined #openstack-infra10:09
*** jishaomei has quit IRC10:09
*** jcooley_ has quit IRC10:12
*** boris-42 has quit IRC10:13
*** nprivalova has quit IRC10:20
*** marun has joined #openstack-infra10:20
*** pblaho has quit IRC10:21
*** pblaho has joined #openstack-infra10:22
*** sarob has joined #openstack-infra10:22
*** Ryan_Lane has quit IRC10:23
*** yamahata_ has joined #openstack-infra10:26
*** wenlock_ has quit IRC10:26
*** rongze has joined #openstack-infra10:28
*** giulivo has joined #openstack-infra10:28
*** fbo is now known as fbo_away10:28
giulivoguys , need some pointer to upstream code or someone who can volunteer some of his time explaining me10:28
giulivofor which jobs we use the various [sections] in the tempest's tox.ini file10:29
giulivospecifically, when is that we run testenv:testr-full when testenv:all and when testenv:smoke10:30
giulivo?10:30
*** jcoufal has quit IRC10:34
*** dizquierdo has quit IRC10:37
*** guohliu has quit IRC10:42
*** nprivalova has joined #openstack-infra10:42
*** yamahata_ has quit IRC10:43
*** rongze has quit IRC10:46
*** avishayb has joined #openstack-infra10:48
*** markmcclain has joined #openstack-infra10:49
*** lcestari has joined #openstack-infra10:51
*** Ryan_Lane has joined #openstack-infra10:53
*** sarob has quit IRC10:55
*** zoresvit has quit IRC10:56
*** weshay has joined #openstack-infra10:58
*** Ryan_Lane has quit IRC10:58
*** markmcclain has quit IRC11:00
*** markmcclain has joined #openstack-infra11:00
*** rongze has joined #openstack-infra11:03
*** jcooley_ has joined #openstack-infra11:05
*** jcooley_ has quit IRC11:10
*** DinaBelova has quit IRC11:11
*** weshay has quit IRC11:11
*** wenlock has quit IRC11:14
*** weshay has joined #openstack-infra11:16
*** ryanpetrello has joined #openstack-infra11:17
*** kui has joined #openstack-infra11:17
*** weshay has quit IRC11:17
*** ryanpetrello has quit IRC11:22
*** sarob has joined #openstack-infra11:22
*** Ryan_Lane has joined #openstack-infra11:24
matelHi, anyone fancy a review? This change has been in the queue since september, and is needed to get devstack passing: https://review.openstack.org/#/c/48092/511:25
matelA change that depends on it has been approved.11:26
*** boris-42 has joined #openstack-infra11:27
*** dizquierdo has joined #openstack-infra11:28
*** Ryan_Lane has quit IRC11:29
*** jcoufal has joined #openstack-infra11:31
*** rongze has quit IRC11:39
*** fifieldt has quit IRC11:40
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Setup devstack-gate tests for Savanna  https://review.openstack.org/5731711:50
*** jcooley_ has joined #openstack-infra11:51
*** adalbas has joined #openstack-infra11:53
*** rongze_ has joined #openstack-infra11:56
*** sarob has quit IRC11:56
*** dims has joined #openstack-infra11:58
*** DinaBelova has joined #openstack-infra12:02
*** yaguang has quit IRC12:04
*** boris-42_ has joined #openstack-infra12:05
*** DinaBelova has quit IRC12:05
*** boris-42 has quit IRC12:08
*** CaptTofu has quit IRC12:08
*** CaptTofu has joined #openstack-infra12:08
*** bingbu has joined #openstack-infra12:13
*** bingbu has quit IRC12:19
*** sarob has joined #openstack-infra12:22
*** crank has quit IRC12:24
*** jcooley_ has quit IRC12:25
*** boris-42_ has quit IRC12:27
*** crank has joined #openstack-infra12:30
*** markmcclain has quit IRC12:30
*** beagles has joined #openstack-infra12:31
*** markmcclain has joined #openstack-infra12:32
*** boris-42 has joined #openstack-infra12:33
*** crank has quit IRC12:35
*** crank has joined #openstack-infra12:36
*** markmcclain has quit IRC12:36
*** markmcclain has joined #openstack-infra12:40
*** crank has quit IRC12:41
*** crank has joined #openstack-infra12:48
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server  https://review.openstack.org/5364412:51
*** smarcet has joined #openstack-infra12:52
*** adalbas has quit IRC12:52
sdaguelifeless: when you get up, I'm trying to understand the config_drive vs. metadata issue, and want to walk through the code on what's not hit in nova to understand what we should be doing here12:54
*** sarob has quit IRC12:55
*** wenlock has joined #openstack-infra12:55
*** wenlock has quit IRC12:56
*** fbo_away is now known as fbo12:56
*** wenlock has joined #openstack-infra12:57
*** dkranz has joined #openstack-infra12:58
smarcethi , please review https://review.openstack.org/#/c/53644, thx12:58
*** yaguang has joined #openstack-infra12:58
*** SpamapS has quit IRC12:59
*** bingbu has joined #openstack-infra12:59
*** ryanpetrello has joined #openstack-infra13:02
*** jcooley_ has joined #openstack-infra13:08
*** yamahata_ has joined #openstack-infra13:08
*** dstanek has joined #openstack-infra13:08
*** adalbas has joined #openstack-infra13:09
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Added basic error handling  https://review.openstack.org/5970613:10
*** dolphm has joined #openstack-infra13:11
*** jergerber has joined #openstack-infra13:11
*** jcooley_ has quit IRC13:13
*** CaptTofu has quit IRC13:15
*** dolphm has quit IRC13:16
*** CaptTofu has joined #openstack-infra13:16
*** weshay has joined #openstack-infra13:18
*** dims has quit IRC13:21
*** sarob has joined #openstack-infra13:22
*** jcooley_ has joined #openstack-infra13:23
*** sandywalsh has quit IRC13:24
*** dims has joined #openstack-infra13:25
*** Ryan_Lane has joined #openstack-infra13:26
*** dolphm has joined #openstack-infra13:28
*** jcooley_ has quit IRC13:28
openstackgerritDzmitry Horbach proposed a change to openstack-infra/jenkins-job-builder: Corrected typo in example for pipeline plugin  https://review.openstack.org/5970913:28
*** zul has quit IRC13:29
*** zul has joined #openstack-infra13:31
*** Ryan_Lane has quit IRC13:31
*** cyril__ has quit IRC13:34
*** cyril__ has joined #openstack-infra13:35
*** sandywalsh has joined #openstack-infra13:36
*** kui has quit IRC13:37
*** dkliban has joined #openstack-infra13:37
*** matsuhashi has quit IRC13:40
*** thomasem has joined #openstack-infra13:40
*** inkerra has joined #openstack-infra13:41
*** aguzikov1 has joined #openstack-infra13:44
ekarlsocan zuul be used to fire off say tests towards diff versions of a compiler in parallell in different slaves ?13:45
*** bingbu has quit IRC13:46
*** DinaBelova has joined #openstack-infra13:55
*** sarob has quit IRC13:55
*** rcleere has joined #openstack-infra13:58
*** aguzikova has joined #openstack-infra13:58
*** dprince has joined #openstack-infra13:59
*** SergeyLukjanov has quit IRC14:00
*** aguzikova has quit IRC14:00
*** aguzikova has joined #openstack-infra14:00
*** pblaho has quit IRC14:01
*** julim has joined #openstack-infra14:01
mordredekarlso: yes14:01
*** inkerra__ has joined #openstack-infra14:02
*** avishayb has quit IRC14:03
*** inkerra__ has quit IRC14:03
*** inkerra_ has joined #openstack-infra14:03
*** DinaBelova has quit IRC14:03
mordredmorning sdague and fungi14:04
*** inkerra_ has quit IRC14:04
*** aguzikova has quit IRC14:04
*** reaper has joined #openstack-infra14:04
*** aguzikov1 has quit IRC14:04
*** inkerra has quit IRC14:05
*** bpokorny1 has joined #openstack-infra14:05
*** inkerra has joined #openstack-infra14:05
*** inkerra has quit IRC14:08
sdaguemordred: morning14:08
*** inkerra has joined #openstack-infra14:09
*** mriedem has joined #openstack-infra14:10
*** pabelanger_ has joined #openstack-infra14:10
mordredsdague: I miss anyhting exciting?14:10
*** avishayb has joined #openstack-infra14:10
*** markmcclain has quit IRC14:10
sdaguenot that I know of, but I was writing sieve rules yesterday afternoon, so not really paying attension14:11
*** pabelanger_ has quit IRC14:12
*** pabelanger_ has joined #openstack-infra14:12
*** pabelanger has quit IRC14:12
*** pabelanger_ is now known as pabelanger14:12
*** pabelanger_ has joined #openstack-infra14:13
*** dizquierdo has quit IRC14:13
*** inkerra_ has joined #openstack-infra14:14
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Move stevedore to stackforge  https://review.openstack.org/5838914:14
*** inkerra_ has quit IRC14:15
*** dstanek has quit IRC14:15
*** krtaylor has quit IRC14:15
*** pabelanger has quit IRC14:16
*** pabelanger has joined #openstack-infra14:16
*** jcooley_ has joined #openstack-infra14:17
*** dkranz has quit IRC14:18
*** nosnos has quit IRC14:20
*** jcooley_ has quit IRC14:21
*** sarob has joined #openstack-infra14:22
*** dizquierdo has joined #openstack-infra14:25
fungihowdy14:27
*** rongze_ has quit IRC14:27
* fungi works back through the numerous scrollback questions first14:28
*** reaper has quit IRC14:28
fungikatyafervent: by chat logs i assume you mean the irc log for this channel. if so, http://eavesdrop.openstack.org/irclogs/%23openstack-infra/14:29
fungigiulivo: where do you need tempest's tox.ini file explained? i can point you to the jenkins jobs corresponding to tox commands calling different sections (environments), but anything tempest-specific is better covered in #openstack-qa14:30
giulivofungi! thanks for helping14:31
*** CaptTofu has quit IRC14:31
*** mfer has joined #openstack-infra14:31
giulivoI think I'm okay with the tempest side but I'm trying to figure by which jenkins jobs get spawned the different testenv14:31
*** CaptTofu has joined #openstack-infra14:31
fungimatel: if you're trying to find core reviewers for devstack, you'll get better results asking in #openstack-qa14:31
*** krtaylor has joined #openstack-infra14:33
fungigiulivo: i can point you to where that configuration is broken out. just a sec14:33
*** salv-orlando has quit IRC14:33
fungismarcet: i'll retest your latest patchset on 53644 shortly and see if that hopefully gets us closer to being able to puppet a server with it (at which point you'll be able to iterate a little more rapidly once you can get to it in our environment)14:36
smarcetfungi: thx a lot :)14:36
*** rongze has joined #openstack-infra14:38
fungigiulivo: the main switch (well, elif series which would probably work better as a switch) you want is at http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n29414:38
mordreddhellmann: ooh, neat (re stevedore change)14:38
giulivofungièè14:38
giulivodoh fungi++14:38
fungigiulivo: that correlates different vars from the calling environment to the various tox environments (sections)14:38
fungigiulivo: then you can see here where the jenkins job templates are defined, and what envvars get passed to the script from each... http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/devstack-gate.yaml14:39
mordredfungi: can I be helpful there?14:39
fungimordred: by all means!14:39
mordredfungi: (on the smarcet change)14:40
fungimordred: please. review it, test it, anythinog14:40
mordredfungi: what if I just approve it without looking at it? is that helpful?14:40
fungimordred: mmm... probably slightly less so14:40
*** alcabrera has joined #openstack-infra14:40
mordredok. good to know where the line is14:40
*** amotoki has quit IRC14:41
mordredfungi: you know - when I look at this change, it makes me think that perhaps we should really be writing more facter things14:41
fungimordred: though i think it's close to being able to spin up the dev openid server (smarcet has done great). just working through testing the redis module he wrote14:41
mordredlike, I feel like our collective dislike of ruby may have led us to do some things not in facter that could probably be done there more sensibly14:42
fungii would buy that assertion14:42
giulivofungi, I see there is a "structured" naming scheme there as jobs suffixed with -full run testenv:full14:44
giulivothanks14:44
mordredsmarcet: I have questions...14:44
mordredsmarcet: mainly owing to not doing much with facter myself14:44
mordredsmarcet: you have a facter thing, which looks like an excellent thing and something I should use more14:44
smarcet mordred: sure tell me14:44
mordredwhich tells the version of the server14:44
mordredbut then the redis class takes version as an input param and switches on that14:44
smarcet mordred: yes but for some reason its not working on your servers14:44
mordredhow does redis_version get used?14:44
smarceti already tested on my local env and works14:45
mordredah. so the facter thing doesn't get used, because of $reasons - which is why we have explicit version14:45
smarcethowever, i would remove that custom fact14:45
mordred?14:45
smarcetyes14:45
mordredawesome14:45
*** sarob has quit IRC14:45
mordredwell, I'm sad that it doesn't work on our servers14:45
mordredbecause it looks really slick14:45
mordredbut  that makes sense14:45
*** johnthetubaguy has joined #openstack-infra14:45
fungii suspect it's a bootstrapping problem... it may be either getting called while there is no redis installed?14:45
smarceti put already put a variable there just to explicit the redis version14:45
mordredI'm going to blame bodepd14:46
smarcetfungi: not sure14:46
fungi(or at some other point where the version can't be determined)14:46
smarcettested on a raw ubuntu server14:46
smarcetand worked like a charm14:46
mordredfungi: I know that I have had issues trying to deal with ruby plugins in our setup14:46
mordredfungi: I tihn kthere is something weird with caching14:46
mordredhave we tried this since clarkb landed the change to touch files on the puppetmaster?14:46
fungismarcet: just for some background, i'm hitting that error when trying to apply the puppet manifest to a completely unconfigured/fresh vm, so there could be all sorts of stuff not installed yet if the dependencies aren't properly defined14:47
mordredthere was a thing bodepd pointed out about how puppetmaster caches things14:47
fungimordred: i think so--i last tested it yesterday14:47
*** dizquierdo has quit IRC14:47
mordredok.14:47
mordredthen yes14:47
*** nprivalova has quit IRC14:47
*** dolphm has quit IRC14:48
smarcetfungi: i tested on a fresh ubuntu server14:48
*** ruhe has joined #openstack-infra14:49
fungismarcet: okay, perfect. i'll go ahead and try the latest patchset now14:50
smarcetfungi: ok cool :)14:51
openstackgerritShantanu Tushar proposed a change to openstack-infra/devstack-gate: Adds retry and timeout to git_fetch_at_ref Closes-Bug: 1252137  https://review.openstack.org/5974214:54
*** jamesmcarthur has joined #openstack-infra14:54
*** esker has joined #openstack-infra14:55
*** sarob has joined #openstack-infra14:55
fungismarcet: out of curiosity, what amount of memory should we be targeting with this server? will a 2gb vm be sufficient for dev or does it need more/less?14:56
*** dizquierdo has joined #openstack-infra14:57
smarcetfungi:well it depends, if server will host also db server , i think that 4gb would me more suitable, if not, 2gb will be enough i think14:57
*** dolphm has joined #openstack-infra14:58
fungismarcet: awesome--thanks! 2gb then, since the db is in a separate 2gb ram trove instance anyway14:58
*** dolphm has quit IRC14:58
smarcetcool14:58
*** krtaylor has quit IRC14:58
*** dolphm has joined #openstack-infra14:59
*** sarob has quit IRC15:00
*** afazekas has joined #openstack-infra15:01
*** dstanek has joined #openstack-infra15:03
*** Loquacity has quit IRC15:04
*** Loquacity has joined #openstack-infra15:04
fungismarcet: looks like fixing that problem exposed an unresolved dependency elsewhere in openid_dev.pp. i'll mark it in the review so you have a bit more context to go on15:09
smarcetfungi: ok tnx15:09
openstackgerritShantanu Tushar proposed a change to openstack-infra/devstack-gate: Adds retry and timeout to git_fetch_at_ref  https://review.openstack.org/5974215:10
*** prad has joined #openstack-infra15:11
fungismarcet: i'll make that change on my local checkout and see if i can spot anything else breaking15:11
*** rfolco has quit IRC15:12
smarcetfungi: roger, and thx again15:14
*** nprivalova has joined #openstack-infra15:16
*** jcooley_ has joined #openstack-infra15:17
*** jcoufal has quit IRC15:17
*** dkranz has joined #openstack-infra15:18
*** avishayb has quit IRC15:19
*** rcleere has quit IRC15:19
*** jcooley_ has quit IRC15:21
*** sarob has joined #openstack-infra15:22
fungismarcet: i'd hold off on updating it yet, because i think that require may need to be replaced with a different one (hit another unsatisfied requirement deeper inside the mysql::db class manifest)15:22
fungii'll have it identified here in a bit15:22
smarcetfungi : roger that15:24
*** Ryan_Lane has joined #openstack-infra15:24
*** Ryan_Lane has quit IRC15:29
*** mfer has quit IRC15:32
*** rfolco has joined #openstack-infra15:33
*** krtaylor has joined #openstack-infra15:35
*** datsun180b has joined #openstack-infra15:35
*** mfer has joined #openstack-infra15:35
*** ruhe has quit IRC15:36
*** dolphm has quit IRC15:37
*** ruhe has joined #openstack-infra15:38
*** dcramer__ has joined #openstack-infra15:38
*** rcleere has joined #openstack-infra15:40
*** dolphm has joined #openstack-infra15:41
jeblairfungi, mordred, clarkb: please review https://review.openstack.org/#/c/58841/ we're waiting on it to remove reverify.15:43
mordredlooking15:43
*** vkozhukalov has quit IRC15:45
fungismarcet: got that mysql class dependency figured out and uncovered what i think is a service typo in the redis module now. testing with my proposed correction to see if it works15:47
*** datsun180b is now known as datsun_F40PH15:47
smarcetfungi: roger, thx15:47
fungismarcet: but i'm about to head into a meeting, so will be somewhat afk over the next hour15:47
dolphmfun question... the global requirements update job is actually closing a bug in keystone, so a revised the commit message on the automated patch to include a Closes-Bug...15:48
dolphmA) if jenkins uploads a new patchset, will the current commit message be preserved?15:48
*** datsun_F40PH is now known as datsun180b15:48
smarcetfungi: sure np , and thx again15:48
dolphmB) if A, will the universe explode?15:48
*** yaguang has quit IRC15:49
dolphms/so a revised/so I revised/15:49
*** mrodden has quit IRC15:50
dolphmi assume hudson-openstack will reassign the bug to itself if that happens15:50
*** SpamapS has joined #openstack-infra15:51
ekarlsois there a way to see the test logs when using testr ?15:51
*** sarob has quit IRC15:55
*** reed has joined #openstack-infra15:57
*** reaper has joined #openstack-infra16:01
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server  https://review.openstack.org/5364416:02
*** dkranz has quit IRC16:02
*** dcramer__ has quit IRC16:02
*** primemin1sterp is now known as primeministerp16:02
*** jcooley_ has joined #openstack-infra16:04
*** ^d has joined #openstack-infra16:05
*** jamesmcarthur has quit IRC16:05
*** sdake_ has joined #openstack-infra16:06
*** sdake_ has quit IRC16:07
*** sdake_ has joined #openstack-infra16:07
*** sdake_ has quit IRC16:07
*** sdake_ has joined #openstack-infra16:07
*** jamesmcarthur has joined #openstack-infra16:08
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server  https://review.openstack.org/5364416:08
*** rnirmal has joined #openstack-infra16:08
*** dkranz has joined #openstack-infra16:17
*** mrodden has joined #openstack-infra16:18
*** jcooley_ has quit IRC16:19
openstackgerritRoman Prykhodchenko proposed a change to openstack-infra/config: Adds devstack-gate tests for Ironic  https://review.openstack.org/5391716:19
*** jcooley_ has joined #openstack-infra16:19
*** jcooley_ has quit IRC16:20
*** sarob has joined #openstack-infra16:22
*** nicedice has joined #openstack-infra16:23
pleia2good morning16:23
*** hashar has quit IRC16:23
*** pete5 has joined #openstack-infra16:24
*** Ryan_Lane has joined #openstack-infra16:24
*** dprince has quit IRC16:25
*** romcheg has joined #openstack-infra16:26
romchegclarkb: Hi, are you around?16:26
*** nprivalova has quit IRC16:28
*** Ryan_Lane has quit IRC16:29
jaypipesjeblair, clarkb, fungi: question for you guys... so the chef+openstack community would like to add a post-merge hook that updates cookbook version strings (in metadata.rb files) and adds a Changelog entry automatically (either by git commit -a --amend'ing the commit or creating a separate "version commit"). Would the appropriate place to put code like that be the "post" Zuul pipeline, or would you recommend we go wi16:29
jaypipesth some other approach?16:29
openstackgerritBen Nemec proposed a change to openstack-dev/hacking: Enforce grouping like imports together  https://review.openstack.org/5440216:29
openstackgerritBen Nemec proposed a change to openstack-dev/hacking: Enforce import group ordering  https://review.openstack.org/5440316:29
romchegOr maybe there is someone else who can help me with infra config16:31
jeblairjaypipes: i'd highly recommend working out a tag-based release system, like we use for client libs, etc.  :)16:31
*** atiwari has joined #openstack-infra16:31
jeblairjaypipes: but if not, yeah, post is "after every commit lands"16:31
jaypipesjeblair: I totally agree :) unfortunately, in Chef-land, the version string in the metadata.rb file is what is used... :(16:32
jeblairjaypipes: (so such a job would have to ignore commits that it generated, otherwise you'd have a cycle)16:32
*** danger_fo_away is now known as dangers16:32
jeblairjaypipes: zaro has done some interesting work in that area...16:32
jeblairjaypipes: he has created tag-based release jobs for java libraries, where versions are in a pom.xml file16:32
jaypipesjeblair: I'd actually prefer to "inline amend" the commit if that is possible in one of the other pipelines...16:33
jeblairjaypipes: it's possible that it's similar enough you could adapt zaro's work.16:33
mordredjaypipes: if it's in metadata.rb ... couldn't you write ruby code in there which knows how to pull from tags?16:33
mordredyeah - what jeblair said16:33
jaypipesmordred: ah, that might actually work... hmmm...16:34
romchegmordred: Do you have a minute?16:34
mordredromcheg: I do not - I'm on the phone :(16:34
*** sparkycollier has joined #openstack-infra16:34
romchegmordred: Oh, sorry then16:34
jaypipesmordred: so if we were able to do that, then all we'd need to do is copy one of the existing git tag jobs and adapt to our needs, yeah?16:34
mordredjaypipes: yup16:34
mordredromcheg: I mean, feel free to ask me thing -16:35
*** jcooley_ has joined #openstack-infra16:35
mordredromcheg: I can respond to things a bit16:35
*** sarob has quit IRC16:35
*** sarob has joined #openstack-infra16:35
*** marun has quit IRC16:37
*** pcrews has joined #openstack-infra16:37
romchegmordred: I will try then. I have made some changes to add two new jobs for Ironic: https://review.openstack.org/#/c/53917/7. I tried running Jenkins Job Builder and I found that it generates the appropriate jobs. However config-compare-xml says that Jenkins XML output is unchanged.16:38
*** hashar has joined #openstack-infra16:38
romchegmordred: Is that a problem?16:38
jeblairromcheg: not a problem16:38
romchegjeblair: Oh, thanks16:38
jeblairromcheg: there's a defect in the config compare job: it does not notice new jobs16:38
romchegjeblair: Ah, that explains the things. Thank you16:39
jaypipesmordred: bah, that ain't gonna work... tooling like Berkshelf can't handle "code in metadata.rb that sets version string based on git tag". And, Matt Ray points out that once a cookbook is uploaded to a Chef server, it no longer is in a Git repository and all git tags are lost...16:39
jaypipesjeblair: got a link to zaro's work I could check out? :)16:40
jeblairjaypipes: just amin16:41
mordredjaypipes: heh. so, basically they have a git-based workflow that has an sdist-like step but that doesn't actually have the benefit of sdist artifact generation16:41
jaypipesmordred: yup :(16:41
mordredjaypipes: wow. what a great design </endsnark>16:42
jaypipesmordred: welcome to chef. :)16:42
mordredjaypipes: so what you'd want is a knife plugin I think16:42
*** mattray has joined #openstack-infra16:42
mordredjaypipes: that generates metadata.rb perhaps16:42
mordred?16:42
jaypipesmordred: no, I don't think so...16:42
mordredok16:42
* mordred just trying to say chef words16:42
jaypipeslol16:42
openstackgerritRoman Prykhodchenko proposed a change to openstack-infra/config: Adds devstack-gate tests for Ironic  https://review.openstack.org/5391716:43
jeblairhttp://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/jenkins-plugin-jobs.yaml16:45
jeblairhttp://git.openstack.org/cgit/openstack-infra/config/tree/modules/jenkins/files/slave_scripts/maven-properties.sh16:45
jeblairhttp://git.openstack.org/cgit/openstack-infra/gearman-plugin/tree/pom.xml16:45
jeblairjaypipes: ^16:45
katyaferventfungi, Yes, thanks! I asked question about branch creation and missed the answer :)16:45
jeblairjaypipes: the rough overview is that the maven-properties.sh script generates a version number, and then it's passed to "mvn package" as a command line parameter, and that is used when generating the .war file16:46
fungikatyafervent: right, which project was it for? i can check the acl16:46
*** jcooley_ has quit IRC16:47
jaypipesjeblair: rock on. much appreciated. I suspect we'll need to do something similar, calling a ThorSCM ruby script instead of the maven-properties.sh script. Thanks again!16:47
jeblairjaypipes: no problem, good luck!16:48
*** herndon has joined #openstack-infra16:49
*** yassine has quit IRC16:49
*** mestery has quit IRC16:49
*** mestery has joined #openstack-infra16:50
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Remove tempest coverage job  https://review.openstack.org/5977516:50
openstackgerritMatthew Treinish proposed a change to openstack-infra/devstack-gate: Rip out the tempest coverage runs from devstack-gate  https://review.openstack.org/5977716:51
*** gyee has joined #openstack-infra16:52
*** SpamapS has quit IRC16:52
*** DennyZhang has joined #openstack-infra16:52
romchegGuys, does that UNSTABLE in a lot of *-docs jobs mean that there is a problem?16:52
romcheghttp://status.openstack.org/zuul/16:52
jeblairromcheg: yes16:53
*** moted has quit IRC16:53
jeblairfungi: so how's the volume move on static coming?16:53
*** ruhe has quit IRC16:53
fungijeblair: slowly. i've got two of the .5t pvs moved16:54
*** hashar has quit IRC16:54
katyaferventfungi, murano-docs. oh, I just found person who can see the create branch button. But I forget where this config file is located16:54
fungipvmove takes hours to complete, so i keep nudging it one pv at a time16:54
jeblairfungi: any space we can allocate to docs-draft right now?16:54
fungijeblair: definitely. i'll do that now16:54
*** openstackstatus has joined #openstack-infra16:54
fungiahh, yeah. filled up it did16:55
*** hashar has joined #openstack-infra16:55
*** moted has joined #openstack-infra16:55
EmilienMsomeone from infra-core could approve a patch to add ironic puppet module into stackforge ? > https://review.openstack.org/#/c/59247/16:56
jeblair#status alert docs jobs are failing due to a full filesystem; fix eta 1750 UTC16:56
openstackstatusNOTICE: docs jobs are failing due to a full filesystem; fix eta 1750 UTC16:56
*** ChanServ changes topic to "docs jobs are failing due to a full filesystem; fix eta 1750 UTC"16:57
jeblairfungi: logs needs some immediate help too.16:57
*** marun has joined #openstack-infra16:57
fungijeblair: there's available space on docs-draft again now16:57
fungidoing logs16:58
*** Ryan_Lane has joined #openstack-infra16:59
fungiresize2fs sure takes a while when you edge up into the multi-tb range17:03
*** guitarzan is now known as primemin1sterp17:03
*** primemin1sterp is now known as guitarzan17:04
mordredfungi: maybe we should use reiser17:04
pleia2mordred: yeah, with mongo17:04
fungimordred: i did, for years. too bad it stagnated17:04
fungimordred: itym "maybe we should use btrfs"17:04
*** sarob has quit IRC17:04
*** SpamapS has joined #openstack-infra17:05
*** SpamapS has quit IRC17:05
*** SpamapS has joined #openstack-infra17:05
*** sarob has joined #openstack-infra17:05
*** hashar has quit IRC17:07
fungibut yeah, back when reiserfs was pretty much the only option for online resizing, it was so useful17:08
zarogood morning17:09
zarojaypipes: you interested in something about java?17:09
*** dolphm has quit IRC17:10
jeblairzaro: he was looking at doing tag-based versioning for ruby, so i pointed him at your java work because it may be similar enough it could be helpful17:10
fungiokay, breathing room added to docs-draft and logs filesystems on static.o.o, snmpd restarted17:12
*** syerrapragada has quit IRC17:12
zarook. help if i can, but i know nothing about ruby.17:12
* fungi resumes shuffling physical volumes there17:12
*** jcooley_ has joined #openstack-infra17:12
*** UtahDave has joined #openstack-infra17:13
*** syerrapragada has joined #openstack-infra17:13
zarofungi: did you see the change to https://review.openstack.org/#/c/54639/17:13
*** marun has quit IRC17:13
jeblair#status ok17:14
*** ChanServ changes topic to "Discussion of OpenStack Project Infrastructure | Docs http://ci.openstack.org/ | Bugs https://launchpad.net/openstack-ci | Code https://git.openstack.org/cgit/openstack-infra/"17:14
fungizaro: yeah, saw you updated it. haven't circled back around to re-review since last night17:14
fungithanks@17:14
*** jcooley_ has quit IRC17:15
*** Ryan_Lane has quit IRC17:15
zarofungi: opps, i meant the nodepool about the jenkins_dev_credentials_id  https://review.openstack.org/#/c/57333/17:15
fungizaro: right that one17:16
*** jcooley_ has joined #openstack-infra17:16
*** reed has quit IRC17:16
*** dstanek has quit IRC17:16
fungizaro: i'll try to get the hiera entries generated and added for the other two items here shortly17:16
zarofungi: no wait. i made a mistake.  that var is used.17:17
fungiokay17:18
zarofungi: i'll have to revert.17:18
fungii assume there's a way to generate it (an api credential for jenkins-dev, right?)17:18
fungieither from an api call or via the webui17:18
zaroi'm not sure.  let me take a look to see if i can figure it out.17:20
jeblairfungi, clarkb, mordred: i'm going to single-core approve some stackforge changes.  any objections?17:20
*** jcooley_ has quit IRC17:20
fungijeblair: no objection from me17:20
mordredjeblair: do it17:20
*** jcooley_ has joined #openstack-infra17:23
zaromgagne: got a minute?17:23
mgagnezaro: go17:23
zaromgagne: i think either i'm wrong or i'm not getting the point across, https://review.openstack.org/#/c/5746917:24
openstackgerritA change was merged to openstack-infra/config: Remove rtfd-id from jenkins_jobs_builder  https://review.openstack.org/5891317:24
*** markmc has quit IRC17:24
openstackgerritA change was merged to openstack-infra/config: Add docs and readthedocs.org support to solum  https://review.openstack.org/5891217:24
mgagnezaro: batch_task in a subentry in tasks17:24
zaromgagne: does it need to be inside the for loop?17:25
mgagnezaro: just like this one: https://github.com/openstack-infra/jenkins-job-builder/blob/master/jenkins_jobs/modules/publishers.py#L97817:25
mgagnezaro: from what I understand, batch_task is some kind of reference to the newly created element. You can't reuse it for a 2nd element.17:26
zaromgagne: yes, that will work. but will it not work if it's outside the for loop?17:26
mgagnezaro: it looks to be a reference, updating the SAME element would update the previous one17:27
openstackgerrityolanda.robla proposed a change to openstack-infra/jenkins-job-builder: Enable ignore_cache flag on jenkins_jobs.ini  https://review.openstack.org/5951517:27
zaromgagne: ohh, i see.  i got it now.17:28
zaromgagne: thnx.17:28
mgagnezaro: np17:28
*** krtaylor has quit IRC17:28
*** dcramer__ has joined #openstack-infra17:32
*** dcramer__ has quit IRC17:33
*** dcramer__ has joined #openstack-infra17:33
*** senk has joined #openstack-infra17:35
fungigrr... i'm stuck on troubleshooting behavior for the mysql::db class in puppet. want to have it contain a copy of the account credentials but not actually attempt to create the account17:35
jeblairfungi: why do you want it to have a copy then?17:36
fungijeblair: mmm, that's a very good point... presumably the variables can just get stuffed directly into the apps that need them17:36
fungithough the reason why this arises is... interesting. apparently it wants to create hostname-specific credentials in the db, and the hostnames rackspace hands out for trove databases are too long (i think according to mysql, though i guess it might be a puppet mysql module limitation instead)17:37
*** boris-42 has quit IRC17:38
*** fbo is now known as fbo_away17:38
jeblairfungi: isn't a hostname specifier in a mysql auth record indicating the _connecting_ hostname?17:38
fungireturned 1: ERROR 1470 (HY000) at line 1: String 'blahblahblah.rackspaceclouddb.com' is too long for host name (should be no longer than 60)17:38
jeblairfungi: (so, not the hostname of the trove db?)17:38
fungioh, that's a good point17:39
fungii wonder why it's trying to do that17:39
jeblairmordred: ^ (double check me?)17:39
mordredme look17:39
fungierr: /Stage[main]/Openstack_project::Openid_dev/Mysql::Db[openstackid_openid_dev17:40
fungier, i'll use paste.o.o. stray newlines in this buffer17:40
mordredthat's correct17:40
jaypipeszaro: have a moment to chat?17:40
mordredhostnames in auth db are for connecting from hosts17:40
*** reed has joined #openstack-infra17:41
mordredand we don't want puppet to _create_ databases for us - we just want to configure what creds it should use to connect to the one that's there17:41
zarojaypipes: yup17:41
*** derekh has quit IRC17:41
ekarlsohas the jeepyb stuff been landed ?17:42
jaypipeszaro: so, the chef+openstack community is trying to get something like this executed when a patch is merged into one of the repositories: https://gist.github.com/mattray/768349117:42
fungimordred: jeblair: slightly more context... http://paste.openstack.org/show/54372/17:42
jaypipeszaro: I know it's Ruby, but the gist of that is that a file (metadata.rb) has a version string replaced and a Changelog entry is generated.17:42
jaypipeszaro: and then git commit'd to the repository17:43
mattrayzaro: it reads the git tag, increments it based on the commit message and writes it out to the metadata.rb and changelog17:43
jaypipeszaro: what we'd like to do is follow your maven example, only what I can't figure out is how you commit the change to the pom.xml file back to the openstack-infra/gearman-plugin project...17:43
zarowant to do this for every build?17:43
jeblairmattray, jaypipes: so one of the fundamental things about tag-based versioning is that we don't have commits for version increments17:43
jaypipeszaro: every commit to every cookbook in stackforge, yeah.17:44
jaypipesjeblair: yes, I don't want them either.17:44
jaypipesjeblair: I want to amend the existing commit if possible.17:44
jeblairmattray, jaypipes: let me amend my statement then -- the versioning is not in the code at all17:44
jaypipesjeblair: the only problem with that is ensuring that multiple patches queued for merging get the correct version.17:44
jeblairmattray, jaypipes: it's in either the tag history of the git repo, or in the release artifact17:45
jaypipesjeblair: yes, I understand that, but I can't change a deficiency in Chef unfortunatyely :(17:45
jaypipesjeblair: is pom.xml considered a release artifact?17:45
zarotypically yes.17:46
jeblairjaypipes: it's used to generate the metadata that are stored in the archive that is built upon release.17:46
*** cyril__ has quit IRC17:46
jaypipesjeblair: understood.17:46
jaypipesmattray: does Chef have anything like that? basically, the problem is that the metadata.rb is not a release artifact (generated from a release/sdist procedure). it's in the repository as code itself17:47
jaypipesjeblair: ^^ correct me if I am wrong in above statement... I think that sums up the issue, yes?17:47
jeblairjaypipes: i think so.  it would be easy enough to re-write it upon building a release, but you'd still need something to handle the case that you are running or installing directly from a git repo.17:48
mattraythe metadata.rb gets converted to a metadata.json file when uploaded to the server. Same difference as a pom.xml, it defines dependencies and versions17:48
jaypipesmattray: the difference is that other projects don't store version information in a file in the repo itself. they use git tags.17:50
jeblairmattray, jaypipes: oh, that sounds promising.  you could look into opportunities to alter how metadata.json gets built.17:50
jaypipesjeblair: problem is that it is built from metadata.rb, not git tags ;)17:50
jeblairmattray, jaypipes: either hook into that, or modify it post-facto.17:50
mattrayjaypipes: so require client-side tooling specific to StackForge :/17:50
jaypipesmattray: specific to git, but yeah....17:51
reedshould https://wiki.openstack.org/wiki/Programs page list Telemetry instead of Metering?17:51
mordredmattray, jaypipes: but the things that buld metadata.json from metadata.rb - are those extensible?17:51
jaypipesmordred: I don't think so.17:51
jaypipesmattray: ?17:51
reedttx, should https://wiki.openstack.org/wiki/Programs page list Telemetry instead of Metering?17:51
fungii know this is probably crazy ugly, but what if a release artifact of the tagged commit were a second git repo, for clients who want to consume directly from git?17:51
mattrayjaypipes: yeah, that's knife17:52
mordredjaypipes: I was right earlier!17:52
jeblairscore 1 point for mordred!17:52
mordredmattray: so, in theory, a knife plugin that knew how to do different things with metadata.json17:52
mordredmattray: would be what we'd be looking for here, right?17:52
jaypipesmordred: the problem is all the Chef tooling like Berkshelf that reads the metadata.rb file as-is...17:52
mattraymordred: yeah, we've preferred to keep the tooling standard17:52
mordredok. well, I agree with keeping tooling standard17:53
mattrayI mean, we can do all sorts of crazy stuff on the client side17:53
mordredI'd love it if it were possible to declare a particular extension and have that be executed17:53
mattraybut some users may not even use git17:53
*** alcabrera is now known as alcabrera|afk17:53
mordredright.17:53
jaypipesmattray: it's not about git, though... it's about storing the release artifact in the source tree.17:53
mordredso what you're saying is that chef really requires the versoin to be in metadata.rb and having it be computed is really hard17:54
clarkbmorning17:54
jaypipesmordred: precvisely.17:54
mordredare we expecting peiple to consume chef-openstack repos not from git?17:54
*** dkranz has quit IRC17:55
mordredI know people can use chef without git17:55
mordredbut do we expect to support people using chef-nova from not-git?17:55
mattraymordred: that is one of the goals17:55
mordredok17:55
*** vkozhukalov has joined #openstack-infra17:55
*** alcabrera|afk is now known as alcabrera17:55
mordredin that case, I do not believe creating tag-based-versioning for chef is possible17:55
mordredand you're going to be stuck with making additional commits to the repo17:56
*** jamesmcarthur has quit IRC17:56
mordredfor python- we have two different supported ways you can work17:56
mattrayyeah, I'd kinda already accepted that. But it gets us past the conflicting merges on versions faster17:56
mordredeither you use git17:56
mordredor you use a tarball which is built17:57
jaypipesmattray: so we expect folks to be able to git clone git@github.com:stackforge/cookbook-openstack-compute and then not use git? :(17:57
mordredthe tarball can contain cached info from builtfrom git17:57
*** jamesmcarthur has joined #openstack-infra17:57
mattrayjaypipes: if we publish the cookbooks on the community site, there's no use of git17:57
mattrayjaypipes: of course, that could require the client-side change before the upload17:58
jaypipesmattray: explain...17:58
*** BobBall is now known as BobBallAway17:58
*** rongze has quit IRC17:58
mattrayjaypipes: if we use git tags without modifying metadata.rb, we could require users to have a knife plugin or berksfile plugin that automatically modifies the metadata.rb locally.17:59
mattrayjaypipes: Berkshelf understands git tags, so that's fine17:59
mattrayjaypipes: and if we upload to the community site, whoever does that has to manually update the metadata.rb17:59
jaypipesmattray: and how would we then queue versions up properly?18:00
mattrayjaypipes: ignore versioning completely in reviews?18:00
mattrayand let the workstation-side update it?18:00
mattrayseems potentially error prone and requires more out of developers18:00
*** ArxCruz has quit IRC18:00
jaypipesmattray: and how does the workstation know about other proposed commits, though...18:01
jaypipesmattray: that is what Zuul and the infrastructure here is for :)18:01
mattrayjaypipes: it just reads the git log?18:01
jaypipesmattray: but then you'll have multiple people submitting patches with the exact same version in metadata.rb...18:01
*** ArxCruz has joined #openstack-infra18:01
mattrayjaypipes: so what if we take metadata.rb and changelog out of git?18:01
jaypipesmattray: ++!18:02
mattrayand make those generated?18:02
jaypipesyay!18:02
mattraychangelog we could drop, tell people to read git log18:02
jaypipesthey are build artifacts, after all...18:02
mattrayjust requires writing more client-side tooling18:02
mattrays/client/workstation/18:03
jaypipesmattray: the only problem I see is that various Chef tooling like Berkshelf and ridley rely on metadata.rb existing and having the version identifier (and proper cookbook name, etc)18:03
*** markmcclain has joined #openstack-infra18:03
mattrayjaypipes: berkshelf will pull a git tag, but yeah we may need a berkshelf plugin too :(18:03
clarkbmordred: still around? I am going to activate hpcloud region-a on the jenkins account too and put up a nodepool change to use that region as well18:05
mattrayjaypipes: I'm going to have to think how we get this to all work18:05
jaypipesmattray: I think it would be best to move to a git tag-based versioning system, with metadata.rb possibly just containing some placeholder for the version.18:05
mattrayjaypipes: I agree with that, can we get the git tag automatically incremented major/minor/patch?18:05
mattrayread the git tag, push it into metadata.rb, upload to server18:06
jaypipesmattray: yup, already prior art for that.18:06
clarkbmordred: shouldn't be any opposition to that right?18:06
mordredclarkb: do it18:06
mattrayjaypipes: parsing commit messages for #major, #minor? cool18:07
jaypipesmattray: sure, totally.18:07
mattrayok, I'll look at the problem again.18:07
*** dkranz has joined #openstack-infra18:07
*** UtahDave has quit IRC18:08
openstackgerritClark Boylan proposed a change to openstack-infra/config: Add HPCloud region-a to nodepool.  https://review.openstack.org/5980118:09
clarkbmordred: jeblair: fungi: I think we can probably just push that through since region-b seems to be mostly ok18:10
clarkbI can babysit18:10
jeblairclarkb: any chance you want to review and approve https://review.openstack.org/#/c/59572/ first?18:11
clarkbjeblair: sure looking18:11
*** sandywalsh_ has joined #openstack-infra18:11
clarkbjeblair: is the idea behind that to have the bare minimum root capable slave?18:12
*** krtaylor has joined #openstack-infra18:12
clarkbjeblair: were you going to babysit that change?18:13
jeblairclarkb: no, jenkins does not have root on a bare_slave.18:13
clarkbgotcha18:13
clarkbI see the commit message now (I really should read that first)18:13
clarkbapproved18:13
*** sandywalsh has quit IRC18:14
*** wabat has joined #openstack-infra18:14
*** nati_ueno has joined #openstack-infra18:15
*** vipul is now known as vipul-away18:15
jeblairclarkb: likewise18:15
openstackgerritA change was merged to openstack-infra/config: Add a bare precise node to nodepool  https://review.openstack.org/5957218:15
openstackgerritA change was merged to openstack-infra/config: Add HPCloud region-a to nodepool.  https://review.openstack.org/5980118:16
clarkbwoot thanks18:16
openstackgerritClark Boylan proposed a change to openstack-infra/jeepyb: Always sleep after group creation  https://review.openstack.org/5958318:17
*** DennyZhang has quit IRC18:17
clarkbso ^ fixes H780318:17
clarkb*H80318:17
openstackgerritA change was merged to openstack-infra/config: Add zuul-packaging to #openstack-infra  https://review.openstack.org/5959518:18
clarkbmordred: fungi: after the meeting I can babysit https://review.openstack.org/#/c/58653/1 if that change doesn't look too horrible to you guys18:18
*** sdake has quit IRC18:19
openstackgerritJames E. Blair proposed a change to openstack-infra/jeepyb: Ignore E125 and H flake8 violations.  https://review.openstack.org/5980218:19
*** sdake has joined #openstack-infra18:19
*** sdake has quit IRC18:19
*** sdake has joined #openstack-infra18:19
clarkbromcheg: pong18:19
jeblairthis ^ also fixes H803.18:19
*** sdake has quit IRC18:20
*** sdake has joined #openstack-infra18:20
*** sdake has quit IRC18:20
*** sdake has joined #openstack-infra18:20
openstackgerritKhai Do proposed a change to openstack-infra/config: add nodepool to jenkins-dev server  https://review.openstack.org/5733318:22
openstackgerritA change was merged to openstack-infra/config: Use purge option where appropriate.  https://review.openstack.org/5955318:24
*** datsun180b is now known as datsun_F40PH18:25
clarkbjeblair: double checking, but won't https://review.openstack.org/#/c/57098/4/modules/openstack_project/files/jenkins_job_builder/config/solum.yaml fail to match the single use slave regex?18:25
pleia2jeblair: is there a file that has both violations I can run this tox.ini again to test?18:25
clarkbjeblair: the job should use devstack-vm of dsvm18:25
*** ryanpetrello has quit IRC18:26
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server  https://review.openstack.org/5364418:26
*** markmcclain has quit IRC18:26
clarkbpleia2: H803 is period at the end of commit message, E125 is well I thought I would have an example but paste.o.i is slow18:27
clarkbpleia2: finally http://paste.openstack.org/show/54374/18:27
pleia2clarkb: cool, thanks18:27
*** jerryz has joined #openstack-infra18:27
jeblairclarkb: you're right; it should be called 'gate-solum-devstack-dsvm'18:27
clarkbjeblair: thanks, leaving a comment now18:28
jeblairpleia2: i intentionally violated H803 in my commit for that change.18:28
jeblaircommit msg18:29
*** DinaBelova has joined #openstack-infra18:29
clarkbjeblair: gate-solum-devstack-dsvm or gate-solum-dsvm ?18:29
jeblairclarkb: i don't feel strongly, but if i were naming it, i would go with gate-solum-devstack-dsvm because the test itself is "devstack" (eg, the exercises)18:30
mordred++18:30
clarkbok18:30
*** dizquierdo has quit IRC18:30
*** senk has quit IRC18:30
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server  https://review.openstack.org/5364418:30
fungismarcet: i'll give that one ^ a try. sorry about the churn on the earlier patchset--i hadn't finished trying fixes when i posted the first few comments18:31
*** krotscheck has joined #openstack-infra18:31
*** vipul-away is now known as vipul18:32
*** SergeyLukjanov has joined #openstack-infra18:32
smarcetfungi: np, althought i think that we would need to use https://forge.puppetlabs.com/puppetlabs/apt bc the php version ( need php 5.4) to add ppa  ppa:ondrej/php5-oldstable18:32
sdagueit's going to take me a while for dsvm to mean something to me :)18:33
*** osanchez has quit IRC18:33
*** openstackgerrit has quit IRC18:33
*** openstackgerrit has joined #openstack-infra18:33
fungismarcet: i think we can probably accept using a ppa for a backport from a later ubuntu release for something like this if it's needed18:34
jeblairsdague: i wanted to get rid of it entirely, and hope too once all our slaves are dynamic.18:34
openstackgerritRussell Bryant proposed a change to openstack-infra/config: Add gate-solum-devstack job  https://review.openstack.org/5709818:34
fungisdague: my eyes still see it as "dsm-iv" (damn you, college psych class!)18:35
sdagueheh18:35
jeblairsdague: er, so configdrive/metadata.... where did we get with that?18:36
jeblairsdague: do you want to test both?  or only one?18:36
sdagueso... actually, I want to wait for lifeless to get back on18:36
sdaguebecause I was reading the relevant nova code, and now I feel like I want to understand more about exactly what we missed testing18:37
fungizomg red hat marketing just spammed my personal e-mail address out of be blue. who do i hunt down and kill?18:37
fungiout of the blue18:37
*** ruhe has joined #openstack-infra18:38
jeblairsdague: ok.  i'm going to WIP that change and indicate that i would like to know which things we plan to use, and also, you still have some unanswered questions.18:38
sdaguesounds good18:38
*** dprince has joined #openstack-infra18:39
openstackgerritA change was merged to openstack-infra/config: Add jenkins jobs for puppet-savanna  https://review.openstack.org/5930418:40
clarkbjeblair: russellb addressed the solum devstack gate change -118:40
openstackgerritJames E. Blair proposed a change to openstack-infra/elastic-recheck: add support for installing the web dashboard  https://review.openstack.org/5928918:41
*** sarob has quit IRC18:41
*** sarob has joined #openstack-infra18:41
fungiwe've got another split queue showing on the gate status page, fyi18:43
*** herndon has quit IRC18:43
fungii expect it'll clear up once 54626,4 reports though18:44
jeblairsdague: i want to make sure to draw your attention to my comment on https://review.openstack.org/#/c/59289/18:44
fungiand there it goes18:44
jeblairfungi: er, it's not fixed, it's just hidden.18:44
fungiahh18:44
clarkbI think I approved the savanna devstack related cahnges in the wrong order, but those jobs aren't voting so hopefully not a problem18:44
clarkbjeblair: fungi: is that related to the rendering of data or is there actually a split gate?18:45
SergeyLukjanovoops, I was offline, am I missed something?18:45
jeblairclarkb: i believe there is actually a split gate.18:45
russellbclarkb: appreciate the help18:45
*** sarob has quit IRC18:46
SergeyLukjanovclarkb, jeblair, thanks for reviewing and merging https://review.openstack.org/#/c/57317/18:46
fungithe last time this appeared, zuul logged during a config reload that it configured two gates with those separate lists of projects, and when we did another reload (restart?) it cleared up18:47
jeblairclarkb, fungi: I have requested a graceful zuul restart.18:47
sdaguejeblair: yep, good point on config18:47
fungisounds good18:47
sdagueactually, is mordred active?18:47
sdagueI had a pbr feature question18:47
sdagueit would be really nice to have config_files=18:47
sdaguelike data_files=18:47
sdagueexcept it does not overwrite18:47
jeblairsdague: one more step on the road to being a complete package manager...18:48
sdagueso that we could seed a good approximation of /etc18:48
sdagueyep18:48
*** herndon_ has joined #openstack-infra18:48
sdaguewell, it would be super handy18:48
*** rongze has joined #openstack-infra18:49
jeblairclarkb, fungi: i'll see if i can replicate the zuul bug; however, it's going to be _very_ difficult.18:50
yolandahi jeblair, i saw your comment, do you mean create a new section in .ini file, or just list this arg as optional in documentation?18:51
jeblairyolanda: just documentation18:51
yolandaok18:51
mordredsdague: I do not think that's a good feature18:52
openstackgerritA change was merged to openstack-infra/config: Setup devstack-gate tests for Savanna  https://review.openstack.org/5731718:52
mordredsdague: I think that trying to do config file management is way out of scope18:52
mordredactually, I want debs and rpms that stop trying to manage those things18:52
lifelesssdague: hi18:53
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: make ResultSet actually inherit from list  https://review.openstack.org/5980518:53
mordredbecause you're really going ot have to have config management to deal with a real deployment anyway18:53
clarkbSergeyLukjanov: np, you may notice some weirdness until the d-g change gets in (I didn't realize that wasn't already approved) but the jobs are non voting so it shouldn't hurt anything you are doing18:53
*** dkranz has quit IRC18:53
sdaguemordred: that's fine, but providing stubs for installation that you can edit are actually nice18:53
lifelesssdague: config drive is generated once from the hypervisor; metadata is generated on demand from the API server18:53
mordredsdague: so - pip can't deal with upgrades in a sensible way anyway18:54
sdaguelifeless: ok, one sec, let me argue with mordred first :)18:54
SergeyLukjanovclarkb, that's why I'd like to see them working as non-voting first ;)18:54
mordredsdague: but - I could be argued down potentially18:54
sdaguemordred: ok, so here's the thing. Take something like elastic-recheck18:54
*** rongze has quit IRC18:54
SergeyLukjanovclarkb, but it's not clear for me - what kind of weirdness could happen?18:54
sdagueit actually requires a reasonable amount of stuff in /etc to work18:54
*** mrodden has quit IRC18:55
lifelesssdague: I would never get in the way of that18:55
sdagueand it would be really nice if in a blank environment it generated a full set of stubs18:55
openstackgerrityolanda.robla proposed a change to openstack-infra/jenkins-job-builder: Enable ignore_cache flag on jenkins_jobs.ini  https://review.openstack.org/5951518:55
clarkbSergeyLukjanov: the savanna stuff won't actually run until the devstack-gate change goes in18:55
lifelesssdague: BTW my 4 hours of hell starts in 5m, so you'll have some bw issues from me later :)18:55
clarkbSergeyLukjanov: but the job will still run18:55
sdaguebecause otherwise you are hunting a lot to get the 4 config files in the right place18:55
sdague(note: er has other issues about silent failures.... but one thing at a time)18:56
sdaguelifeless: I can hit you up in 4 hrs18:56
SergeyLukjanovclarkb, oh, that's ok, I think that you mean some really bad behavior ;)18:56
sdagueor even 518:56
lifelesssdague: hit me up whenever just explaining why I'll be high latency18:56
pleia2woo #MeetingTuesday18:57
zarofungi: ok. figured out how to create jenkins credentials.18:57
jeblairsdague, mordred: i would be really upset if 'python setup.py install' started putting files in system locations.  i am much happier just 'cp samples/etc/* /etc/foo'.18:57
fungizaro: awesome--thanks. i'll try to get that knocked out after the meeting18:57
mordredjeblair: ++18:58
sdaguelifeless: ok, the root of it is the variable that dprince flipped to force config drive on always, the chunk of nova code that that enables is really narrow18:58
*** pblaho has joined #openstack-infra18:58
sdagueand mostly just turns off file injection18:58
lifelesssdague: if you ignore the API server entirely, sure.18:59
*** alcabrera is now known as alcabrera|afk18:59
*** pblaho has left #openstack-infra18:59
sdaguelifeless: as far as I can tell that variable only effects a really narrow amount of the virt driver19:00
notmynameI've not seen a jenkins gate fail with "unstable" before now. what does that mean?19:00
sdagueso I'm second guessing whether reverting that change, or making it flip in d-g is actually going to address your issue19:00
lifelesssdague: right, its nto a virt driver problem.19:00
jeblairnotmyname: if it's a docs build, it was due to an error earlier since corrected19:00
notmynamejeblair: ah, ok. it was. and what should I reference to reverify?19:01
lifelesssdague: examining as a virt driver problem misses the bug, which wasn't a virt driver bug.19:01
pleia2meeting time19:01
sdaguelifeless: right, but that means that my d-g patch is probably not the right one19:01
jeblairnotmyname: not sure someone filed a bug; 'no bug' should be fine; the filesystem filled up.19:01
notmynamejeblair: I thought reverify no bug was turned off19:01
jeblairnotmyname: almost, not yet.19:02
lifelesssdague: why not?19:02
fungijeblair: the related change for that lgtm though19:02
notmynamejeblair: FWIW, I'm reiterating that I'd prefer not turning it off, for times like this :-)19:02
jeblairnotmyname: we'll file a bug in the future.  :)19:02
clarkbnotmyname: can you reapprove?19:02
clarkbI don't see a change so don't know what we are talking about19:03
notmynameclarkb: https://review.openstack.org/#/c/59481/19:03
clarkbnotmyname: right so you can just reapprove that change19:03
clarkbwhich is why I don't think we need reverify no bug19:03
notmynameclarkb: does it require me reapproving? just a reverify would work19:03
*** ryanpetrello has joined #openstack-infra19:04
fungibasically taking out "reverify no bug" simply increases the burden for documentation on non-core reviewers19:04
fungicore reviewers can just use the approve button19:04
clarkbtoday reverify works fine, but the way to deal with reverify no bug going away in my opinion is to have core reviewers reapprove19:04
sdaguelifeless: ok, so is the part that I'm missing that cloud-init looks for config-drive, if it doesn't find it, it fails back to md server?19:04
lifelesssdague: yes19:05
sdagueok, fair19:05
*** che-arne has quit IRC19:05
sdagueso... in the nova drivers, we do ugly file injection if we are not down the config-drive path19:05
sdagueanyway, I actually think the right patch is probably just to revert dprince's blanket devstack patch19:06
SpamapSsoren: could you have uvirtbot join #openstack-meeting-alt ? kthxbai19:07
dprincesdague: Ideally we would continue to test config drive somewhere though...19:07
*** jamesmcarthur_ has joined #openstack-infra19:08
mtreinishdprince: there are config drive tests in tempest19:09
dprincemtreinish: Those didn't stop the regression a month or so back...19:10
*** jamesmcarthur has quit IRC19:10
*** jamesmcarthur_ is now known as jamesmcarthur19:10
mtreinishdprince: then we need more tests :)19:10
sdaguedprince: so the problem is now, we're not testing metadata server19:10
*** dkranz has joined #openstack-infra19:11
dprincemtreinish: I also like config drive by default because it avoids using injection which in my experience is quite slow. With config drive my experience was it was much faster.19:11
mtreinishI think the config drive tests there now are pretty limited (I'm not sure though I haven't really looked in detail)19:11
sdaguewhich let it get broken in neutron, and totally busted tripleo, as they can't use config drive for the undercloud19:11
mtreinishdprince: I use config drive by default too, but sdague brings up the good point that we don't test the metadata server that way19:11
ttxreed: indeed19:12
dprincesdague: My only concern is that we have config_drive=True for at least one test configuration. At the time everyone seemed to think using it as the default was the way to go.19:12
sdaguedprince: yeh, well I didn't think about the undercloud problem19:12
dprincesdague: Disabling it for a single run works too...19:12
ttxcan't wait until we get those pages in sync with governance repo19:12
reedttx, thanks, fixing it now19:12
sdagueI +2ed your patch, so I did agree previously19:12
sdaguebut lifeless brought up this very specific break we caused in tripleo19:13
ttxreed: I fixed it19:13
reedttx, you were faster than me :)19:13
lifelessdprince: I want config drive in one config and metadata + neutron in another.19:13
lifelesswe need to test both, since both will be used19:14
lifelessas baremetal really can't do config drive, not for the indefinite future19:14
dprincelifeless: exactly, me too (we agree for once!)19:14
jog0notmyname: misspellings doesn't do grammer, and no I don't plan on gating19:14
sdaguedprince: no fair, I agreed with lifeless today as well19:14
notmynamejog0: good to know, but why me?19:15
sdagueok, so I guess my d-g change is probably the right one19:15
notmynamejog0: I was staying out of that thread. maybe you meant jgriffith?19:15
*** chandankumar has quit IRC19:15
* jgriffith runs for the door19:16
sdaguejej19:16
jog0notmyname: woops wrong john19:16
sdagueheh19:16
clarkbjog0: the way I feel about a lot of these things is we should just shame people into using a proper editor. but then we would never get any work done...19:16
jog0jgriffith: ^19:17
jgriffithjog0: :)19:17
sdaguejgriffith: if it's any consolation, I tried to talk him out of it in #openstack-qa this morning :)19:17
jgriffithsdague: well thanks for that at any rate19:17
jog0clarkb: shaming is always fun, I use spell check in mine19:17
*** fbo_away is now known as fbo19:17
jgriffithafraid that posting just came up on a bad day19:17
jgriffithnormally I just ignore19:17
sdague:)19:18
jgriffithjog0: clarkb isn't that supposed to be "shameing"19:18
jog0jgriffith: someone -1 you for grammar?19:18
jgriffith:)19:18
jgriffithjog0: I've seen it happen to other people multiple times and it's happened to me in the past19:18
jgriffithbut I'm just a grumpy old man today19:18
jgriffithit's cold and gray and I'm a grouch19:18
sdaguejeblair: https://review.openstack.org/#/c/59303/1 - so we actually agree on that change now19:19
jog0jgriffith: yeah the grammer thing is a whole nother can of worms19:19
jog0that you just opened, so have fun!19:19
sdague-1 nother not a word19:19
jgriffithdarn me!!19:19
sdaguedprince: ok, so that review of mine will give us the infrastructure to test both, then we can just pick which jobs are on which19:19
*** shardy is now known as shardy_afk19:20
jeblairsdague: so you plan on dividing it up?  say, running postgres with metadata or something?19:20
lifelessjeblair: isn't postgresql flakey already?19:20
lifelessjeblair: If I have any influence here I'd want to see mysql + neutron + metadata.19:20
sdagueyeh, I'd say we'd put the neutron job on it19:21
jeblairlifeless: my example was arbitrary19:21
lifelessWe have to pair neutron + metadata.19:21
sdaguethe big concern is neutron is doing extra cleverness here19:21
lifelessthats the combo that we need coverage on, which we won't get anywhere else.19:21
lifelessthe namespace escaping code, the proxying of requests to the api server on behalf of the user.19:22
jeblairis non-neutron metadata interesting? since neutron runs so few tests19:22
sdaguejeblair: and, yes, I'll propose it19:22
sdaguejeblair: it does boot some guests19:22
sdaguehonestly, I'd actually probably turn this on for some of the neutron jobs19:22
sdagueand we can pick which nova job as well19:22
*** sarob has joined #openstack-infra19:23
*** sdake has quit IRC19:24
*** sdake has joined #openstack-infra19:24
*** reed has quit IRC19:25
*** reed has joined #openstack-infra19:28
*** dkranz has quit IRC19:28
*** jerryz has quit IRC19:28
openstackgerritA change was merged to openstack-infra/devstack-gate: Add Savanna testing support  https://review.openstack.org/5732519:29
*** melwitt has joined #openstack-infra19:29
*** melwitt has quit IRC19:29
*** melwitt has joined #openstack-infra19:29
*** ewindisch has joined #openstack-infra19:31
*** vipul is now known as vipul-away19:33
*** vipul-away is now known as vipul19:33
*** gyee has quit IRC19:35
*** jcooley_ has quit IRC19:37
*** jcooley_ has joined #openstack-infra19:37
*** denis_makogon has joined #openstack-infra19:39
*** dkranz has joined #openstack-infra19:41
*** jcooley_ has quit IRC19:41
*** Hunner_irssi has quit IRC19:42
*** jcooley_ has joined #openstack-infra19:42
*** cederb02 has joined #openstack-infra19:44
*** ewindisch has quit IRC19:46
*** cederb02 has quit IRC19:46
*** jcooley_ has quit IRC19:47
*** jcooley_ has joined #openstack-infra19:47
jog0jeblair: https://review.openstack.org/#/c/59289/19:50
jog0I am confused at your +219:50
*** rongze has joined #openstack-infra19:51
jaypipesjeblair, mordred: are we allowed to git tag inside a script block in a jenkins/zuul job?19:51
*** jcooley_ has quit IRC19:51
jeblairjog0: it means it looks good to me.  what's confusing about it?19:51
jaypipesalso, IIRC, only zuul/jenkins and gerrit admins are allowed to push tags to projects... is that correct? we will likely need help from your team to do initial git tags on the cookbooks.19:52
*** jcooley_ has joined #openstack-infra19:52
jeblairjaypipes: no, small groups of core folks can push tags.  jenkins is not allowed to do that.19:52
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server  https://review.openstack.org/5364419:53
*** vipul is now known as vipul-away19:53
jog0jeblair: the name stuff in that repo19:53
jaypipesjeblair: ok. so by default, can the openstack-chef-core team (or whatever it's called, can't remember) push tags to the cookbook repos?19:53
jog0I guess we will jsut remember to change it19:53
mordredjaypipes: yeah19:54
jaypipesmordred: cheers.19:54
jeblairjog0: oh, you mean the comment before my +2.  i'm saying that job names should not be in e-r, they should be in config.19:54
mordredjaypipes: well, however you have set up in your acls files19:54
jeblairjog0: so in the long run, e-r should grow the ability to have config files that list things like job names19:54
jeblairjog0: (eg, for things like that graph)19:54
jog0jeblair: ahh19:54
jaypipesmordred: if jenkins/zuul is not able to push tags, how exactly is a pipeline job supposed to automatically call git tag with an incremented semver?19:54
mordredwhat?19:55
jog0I ask because I want to add a line to that graph19:55
*** sparkycollier has quit IRC19:55
mordredoh - I have no idea, it's one of the reasons that we have done things in the opposite direction19:55
jog0will just do a dependandant change19:55
jaypipesmordred: is that what for me? :)19:55
mordredjaypipes: yeah - sorry, I'm splitting my attention in 4 different directions right now - so I might be scattered19:55
jaypipesno worries :)19:55
lifelessno, really?19:55
jeblairjog0: well, right now i think you'd just add it to the e-r repo19:56
*** rongze has quit IRC19:56
jeblairjog0: but that's what i'm saying won't work in the long run, because we can, and will, change job names and you'll be forever catching up if they aren't in the infra/config repo19:57
fungimordred: jaypipes: the bits i gleaned suggest they want autoversioning akin to how pbr makes magic version numbers for arbitrary git commits which don't correspond to a tag19:57
jaypipesmordred: so we are trying to go in the *same* direction :) we are removing what are essentially build artifacts from the cookbook trees, but we still need to increment the cookbook semver on commits. we were planning to calculate the version based on git tags, but in order to have the branch tag'd with a semver, we need to be able to apply the git tag during some Zuul (post-merge?) pipeline19:57
jaypipesfungi: precisely.19:58
fungiwhich would, by definition, not be tags19:58
mordredjaypipes: ah - so, we do the git tag ourselves19:58
jaypipesfungi: well...19:58
mordredjaypipes: as in, we drive the whole process by a human doing a git tag on the repo and pushing the tag19:58
pleia2clarkb: can I borrow you for a call+etherpad to chat about the process for tagging our historical publications?19:59
fungiwhich i can imagine is potentially burdensome if someone is going to need to tag every commit by hand, even when they're not release-worthy commits (minor tyop correction)19:59
pleia2clarkb: doesn't need to be now, just some time this week if you have time19:59
jog0jeblair: right, so long run its config. thanks for the clarification20:00
*** mrodden has joined #openstack-infra20:00
mordredjaypipes: sorry - this is too complex for split attention - let me find you when I can give you good attention20:00
clarkbpleia2: sure I can do that after lunch20:00
jaypipesmordred: we are currently doign this versioning crap in reviews for the cookbooks, and it is a giant pain in the butt (having to constantly rebase just to change the semver increment). We're trying to automate the process of tagging each commit with an appropriately-incremented semantic version that we can then use to drive further Chef-specific automation20:00
jaypipesmordred: I understand you're busy, no probs.20:01
clarkbpleia2: ~1:30 pm PST work? if not I can do times later this week20:01
pleia2clarkb: perfect20:01
SergeyLukjanovare there any docs about nodepool project?20:02
fungijaypipes: the short answer is that tag-based versioning alone may not be suitable for that specific use case. we use tags for human-determined release and prerelease/milestone points in the code, but commits in between those get autogenerated dev versions which do not have corresponding tags20:03
jeblairfungi, clarkb, mordred: the devstack gate shared queue looks more normal now.20:03
jaypipesfungi: I understand.20:03
clarkbjeblair: woot20:03
clarkbI am going to grab lunch now20:03
*** dhellmann has quit IRC20:04
*** vipul-away is now known as vipul20:04
fungijaypipes: if chef itself expects every single commit in a git repo to have non-repeated/ever-increasing version numbers while at the same time providing no mechanism to generate those (for example looking at git describe), that sounds mildly broken20:04
jaypipesfungi: preaching to the choir :)20:05
fungijaypipes: it just sounds like they haven't thought through their consume-directly-from-git tooling20:05
*** thingee has quit IRC20:06
jaypipesfungi: no, it's because of a whole bunch of dependent tooling in Chef land...20:06
*** jcooley_ has quit IRC20:06
fungibecause people don't usually increase the version number of a project for every single commit20:06
jaypipesfungi: well, semver actually does do that...20:06
*** rockyg has joined #openstack-infra20:06
fungisemver a thing (not just the spec?)20:06
openstackgerritKhai Do proposed a change to openstack-dev/pbr: show diff between pip installed packages and requirements  https://review.openstack.org/5463920:07
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Remove queries for bugs 1225024 and 1225664  https://review.openstack.org/5981620:07
uvirtbotLaunchpad bug 1225024 in tempest "tempest.api.compute.admin.test_hosts.HostsAdminTestXML.test_list_hosts_with_zone[gate]  unexpected conductor service" [Undecided,Incomplete] https://launchpad.net/bugs/122502420:07
uvirtbotLaunchpad bug 1225664 in devstack "Swift: No space left on device" [Undecided,Fix committed] https://launchpad.net/bugs/122566420:07
fungijaypipes: you mean there's some tool named semver which chef uses to generate intermediate version numbers for non-tagged commits in a git repository?20:08
jaypipesfungi: berkshelf and other Chef tooling uses semver to differentiate between cookbook versions, so if we change pretty much *anything* in the cookbook, we need to increment the semver.20:08
fungior you just mean that the idea of semver suggests that there should be a way to make up a version number for situations like that20:08
jaypipesfungi: no, I mean the spec...20:08
*** elasticio has joined #openstack-infra20:08
*** elasticio is now known as Guest5075020:09
*** dhellmann has joined #openstack-infra20:09
fungiit really sounds like they don't want people consuming non-release versions of cookbooks then20:09
*** Guest50750 has quit IRC20:09
jaypipesfungi: which is kinda antithetical to continuously-deployed systems, don't ya think? :)20:09
fungii guess their assumption is that you queue up your edits, and then squash them all together and commit that as your "next version"20:10
jaypipesfungi: a lot of this is because the way that Chef and Berkshelf determine conflicting dependencies between cookbooks is solely by the use of semver.20:10
*** datsun180b has joined #openstack-infra20:11
*** dolphm has joined #openstack-infra20:11
*** elasticio__ has joined #openstack-infra20:11
*** vipul is now known as vipul-away20:11
*** vipul-away is now known as vipul20:12
fungiright, so presumably they expect very-slow-moving/glacial cookbook development where commits fall far enough apart so as to correspond to actual releases, or the idea of consuming these from a version control system directly suggests the need for some artificial filter to batch up those changes into versions20:12
*** thingee has joined #openstack-infra20:12
openstackgerritRyan Petrello proposed a change to openstack-infra/config: Run pecan-ceilometer gate tests on centos6  https://review.openstack.org/5981820:12
*** datsun_F40PH has quit IRC20:13
mattrayfungi: sounds right. Unfortunately we're trying to have it both ways20:13
*** ^d is now known as ^demon|lunch20:13
fungiwhich takes me back to the (not entirely serious) suggestion that one of the release artifacts could be an artificially-constructed separate git repository conforming to those questionable assumptions20:14
*** datsun180b has quit IRC20:14
*** datsun180b has joined #openstack-infra20:14
fungi"git the way chef expects it, not the way devs are using it)20:14
fungior perhaps a branch which gets merge commits from git tags in development20:15
*** DinaBelova has quit IRC20:15
fungiso that at any point in time the latest commit on that branch corresponds to an actual release tag20:15
mgagnejaypipes: if zuul (or whatever) autotags every commits with a version based on symver spec. How are major version cut?20:16
jaypipesfungi: right... we're not saying it's pretty. :)20:16
fungiand downstream consumers simply don't ever see a state where what they're using has intermediate between-tag commits20:16
jaypipesmgagne: zuul does not autotag anything.20:16
mgagnejaypipes: I was referring to an hypothetical situation mentioned above.20:16
*** elasticio__ has left #openstack-infra20:16
fungiright, in our workflow tags are something humans deliberate, cryptographically sign to assert a particular set of conditions, push to the repository and then automation triggers from those20:17
jaypipesmgagne: oh... looking for #major in the commit message was a proposed solution.20:17
*** salv-orlando has joined #openstack-infra20:17
jaypipesfungi: we're not arguing with you about the merit of that approach :)20:17
mgagnejaypipes: I'm interested in what you guys have to set. just asking questions for clarification =)20:17
fungiyeah, got it20:17
mgagnesay*20:17
jaypipesmgagne: oh, no worries... mainly just brainstorming here...20:18
mordredthis hurts my head20:18
mordredhow does this work in a non-gerrit workflow?20:18
mgagnejaypipes: we have a similar internal system here.20:18
mordreddoes a person edit metadata.rb on every commit?20:18
mgagnejaypipes: but it's kind of cumbersome20:18
* mordred feels there is something he's missing on how the system is intended to work20:19
mgagnejaypipes: version is stored in pom.xml and incremented accordingly which kind of results in 2n commits20:19
*** vkozhukalov has quit IRC20:19
jaypipesmgagne: yes, it's very cumbersome for us right now... manually having to keep in our mind the next patch number for semver.. sounds like we're going to give up the ghost on a patch number increment and just focus on minor increments and tag manually.20:19
fungiso i think having the automation add tags to every commit is missing the point... tail wagging the dog as it were. instead tooling could just trigger off the commits themselves, regardless of the presence of tags (that is, tags lose their meaning if they're autogenerated and apply to every single commit)20:19
jaypipesfungi: agreed20:20
*** _david_ has joined #openstack-infra20:20
*** dstanek has joined #openstack-infra20:20
mattrayfungi: yeah, that tooling exists. Again the problem with trying to solve everyone's use cases simultaneously20:22
*** alcabrera|afk is now known as alcabrera20:22
*** elasticio__ has joined #openstack-infra20:22
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: implementation of FacetSet for client side nested facets  https://review.openstack.org/5982220:24
mgagnejaypipes: on a side note, it still looks to be the perfect solution (tag everything) for people pedantic (or very concerned) about versioning and control. I still haven't found an alternate solution for people with this kind of needs. People aiming for continuous delivery have this issue. (IMO/AFAIK)20:24
jaypipesmgagne: yes, but fungi's point about if you tag every commit, you lose the meaning of the tag -- why not just use the SHA1 at that point? :)20:25
mordredwell, sha or even commit count since last tag20:26
jaypipesindeed.20:26
mordredthat's what we do on the things between tags20:26
mgagnejaypipes: is it correct to say chef/cookbook only understands symver ?20:26
mikalSo... In zuul, if I have a success layout entry which says gerrit verified 0, will that just put a comment on the review with no review score?20:26
mordred$tag.$revcount (althoug we do pep 440 - so it's $tag.a$revcount)20:26
jaypipesmgagne: pretty much, yes... at least, the dependency and cookbook conflict resolution only works on semver.20:26
*** vipul is now known as vipul-away20:27
mgagnejaypipes: My conclusion is that we have common needs (although for different systems/softwares).20:27
* mgagne listens20:27
jaypipes:)20:27
*** jasond has joined #openstack-infra20:27
jasondhow can i add a new group in gerrit?20:28
mgagnejaypipes: Does it have to be from git? Or can artifacts (for each commit) be published somewhere else? Is the version stored somewhere in the artifact itself?20:28
*** salv-orlando_ has joined #openstack-infra20:28
mgagnedamn, it's semver btw, right? =)20:29
mgagnehttp://semver.org/20:29
mgagnebasically the same versioning system as every respectful libraries20:30
*** salv-orlando has quit IRC20:30
*** salv-orlando has joined #openstack-infra20:31
jaypipesmgagne: right.20:31
fungimikal: i believe so20:32
fungijasond: which gerrit. the review.openstack.org gerrit or any random gerrit?20:32
mikalfungi: thanks20:32
jasondfungi: in review.openstack.org20:33
fungijasond: we autogenerate groups from project acls20:33
jaypipesmgagne: our (the OpenStack+Chef) community seems to be moving towards using git tags for major and minor semver increments, with core reviewers manually pushing those tags themselves, removing the manual Changelog entries in the cookbooks (and generating that information from git logs), and essentially stopping the enforcement of the patch semver increment entirely.20:33
*** salv-orlando_ has quit IRC20:33
jasondfungi: oh ok, thanks20:34
fungijasond: so any group mentioned in an acl will be created automatically. we simply add accounts to them (for most groups, an initial member only, and let that member add more users to a self-managed group)20:34
*** hartsocks has joined #openstack-infra20:34
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server  https://review.openstack.org/5364420:34
mikalfungi: where does the zuul merger get its git repo from? I'm getting ssh permission denieds not that I've moved out zuul to using that new service account you setup yesterday.20:34
mikalfungi: I'm not sure if that's a problem on my side or yours20:35
fungimikal: zuul constructs a git reference in a checkout of the project or projects in question and serves that to be accessed by the jenkins slaves (acting in the role of git clients to it)20:35
mikalfungi: ugh, found it. The origin in the git repo has jhesketh's account name hard coded.20:36
fungior rather, zuul doesn't serve it, so much as it passes along the reference name in a parameter, and an apache vhost on the zuul server actually serves the repo20:36
fungimikal: that'd do it. is flogging mandated in that situation?20:37
mikalHeh20:37
*** yolanda has quit IRC20:37
mikalIt doesn't help that jhesketh is in a training course20:37
mikalI'm jsut trying to cover for him (badly)20:37
fungioh, then he's already being punished enough from the sound of it20:37
*** elasticio__ has quit IRC20:38
*** elasticio__ has joined #openstack-infra20:38
*** kui has joined #openstack-infra20:39
mikalfungi: sorry to be a pain. What does "no connected gearman servers" from zuul mean? That all my workers are down? Or is there a central gearman process?20:40
*** dstanek has quit IRC20:41
*** rockyg has quit IRC20:42
fungimikal: zuul and the jenkins master(s) connect to a gearman server, which could be (often is) the built-in lightweight gearman server provided in zuul20:43
mikalfungi: ok, I will try restarting zuul then to see if it fixes the server20:44
mikalfungi: noting that will dump the queue, but that I don't care at the moment20:44
fungimikal: i'd have to look through the source to confirm the circumstances under which it will log that error, and whether it is emitted by the zuul server thread or zuul's gearman server20:44
notmynamewhat is "dvsm"?20:45
fungimikal: also, graceful restart of zuul should resume the previous queue contents, though you have to wait for running jobs to report first20:45
funginotmyname: dsvm? DevStack Virtual Machine20:45
*** vipul-away is now known as vipul20:45
notmynamefungi: thanks. I just started seeing it today in the job names20:45
funginotmyname: job names got way too long as our combinatorials exploded20:46
funginotmyname: so they got renamed/abbrev'd yesterday20:46
mordredfungi: we sohuld maybe send out a dev list email about that20:46
mikalfungi: is there a way to ask zuul how many workers it thinks are attached?20:47
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Cleanup graphite graph  https://review.openstack.org/5982920:47
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Remove check jobs from graphite graph  https://review.openstack.org/5983020:47
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add more gate jobs to graphite graph  https://review.openstack.org/5983120:47
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: port check_success to facets  https://review.openstack.org/5983220:48
fungimikal: mmm, not sure. if it's not in the status.json (which i think it's probably not) then you'd have to figure it out from the log file or trigger a thread dump and count the worker threads maybe20:48
mordredmikal: buy it a drink20:48
mikalHeh20:49
fungithough would make a great wishlist bug for new feature in the zuul client tool up for review currently20:49
fungieither that or maybe a way to expose it through the server status details20:49
*** johnthetubaguy has quit IRC20:50
*** salv-orlando has quit IRC20:51
fungimikal: you might be able to determine it by looking at netstat -nt (is gearman tcp?) and doing a grep -c for the gearman port number20:51
* fungi tries that20:51
mikalfungi: looking at a worker, I think they were disconnected by the grceless zuul restart20:51
*** jcooley_ has joined #openstack-infra20:51
*** jasond has left #openstack-infra20:52
*** jcooley_ has quit IRC20:53
*** alcabrera has quit IRC20:53
*** rongze has joined #openstack-infra20:53
mikalfungi: so to provide some context, because we're not ready to expose the test run logs we want to run tests but not provide scores (just a comment). We'll then work on fixing the log issue. We're also only going to run tests on changesets which have already passed jenkins to reduce our false positive chatter.20:53
fungimmm, when i 'netstat -nt|grep -c :4730' on zuul.o.o i get 28820:53
fungiwhich looks like it might roughly correspond to the number of active jenkins slaves we have at the moment20:54
mikalfungi: wow, I do that on my zuul and get a number roughly double the number of workers I expect20:55
fungimikal: maybe some of those are in timewait or something other than established20:56
*** CaptTofu has quit IRC20:56
funginetstat -nt|grep -c ':4730.*ESTABLISHED'20:57
mikalfungi: oh, possible20:57
*** CaptTofu has joined #openstack-infra20:57
mikalfungi: except they're all established20:57
fungihuh. neat20:57
*** hashar has joined #openstack-infra20:58
*** dhellmann has quit IRC20:58
*** rongze has quit IRC20:58
mikalfungi: yeah, I get two entries per connecting worker20:58
mikalfungi: but there is only one worker process on this here random worker I am looking at20:59
*** dhellmann has joined #openstack-infra20:59
*** krotscheck has quit IRC21:00
*** datsun_F40PH has joined #openstack-infra21:00
*** vipul is now known as vipul-away21:00
*** krotscheck has joined #openstack-infra21:01
fungimikal: perhaps half of those are stale connections? tcpdump them and see if some aren't chatty at all?21:02
*** rockyg has joined #openstack-infra21:03
*** datsun180b has quit IRC21:03
*** datsun_F40PH is now known as datsun180b21:03
*** hartsocks has left #openstack-infra21:04
*** che-arne has joined #openstack-infra21:04
*** hogepodge has joined #openstack-infra21:04
openstackgerritYathiraj Udupi proposed a change to openstack/requirements: Added a requirement to COIN PULP LP Modeler module  https://review.openstack.org/5344621:05
*** boris-42 has joined #openstack-infra21:07
*** shardy_afk is now known as shardy21:07
jog0we are  seeing nova unit tests fail and its a timeout, was hoping a few infra can look at it21:08
jog0we are talking about it in infra21:08
jeblairmikal: yes, 1 sec21:08
jeblairmikal: gearman has a text-based admin protocol on the same port21:08
jeblairmikal: telnet HOST 473021:09
jeblairmikal: and issue commands like "status"  and "workers"21:09
jeblairmikal: http://gearman.org/protocol/21:10
jeblairmikal: (search for "Administrative Protocol" on that page, i don't think it has an anchor)21:10
*** sandywalsh_ has quit IRC21:10
fungioh, right--i totally forgot about the admin proto21:11
fungijog0: have a link (review, log, something)?21:11
jog0fungi: in -qa yeah21:12
fungijog0: oh, you said in -infra ;)21:12
jog0doh, FWIW its 11PM here21:13
*** dhellmann has quit IRC21:13
*** weshay has quit IRC21:13
*** dhellmann has joined #openstack-infra21:14
mikaljeblair: thanks21:15
jeblairmikal, fungi: and totally not opposed to including some of that it status.json21:15
jeblair_in_ status.json21:15
jeblairi'm going to crawl into a hole and try very hard to reproduce this zuul bug21:16
mikaljeblair: good luck!21:17
clarkbpleia2: I am back from lunch, ping me when you are ready21:19
*** vipul-away is now known as vipul21:19
*** mfer has quit IRC21:19
*** dhellmann has quit IRC21:19
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Corrected typo in example for pipeline plugin  https://review.openstack.org/5970921:19
pleia2clarkb: hey, now is fine, want to give our asterisk server a spin?21:20
*** hogepodge has quit IRC21:20
clarkbpleia2: sure (I will be using a normal phone though so anything works)21:20
clarkbpleia2: let me hide in a quiet room21:20
pleia2clarkb: ok :)21:20
*** mfer has joined #openstack-infra21:21
*** dhellmann has joined #openstack-infra21:21
clarkbof course xrandr hates me and won't let me undock21:22
clarkbpleia2: I may be a few minutes21:22
*** CaptTofu has quit IRC21:22
pleia2clarkb: no worries21:22
*** jcooley_ has joined #openstack-infra21:24
*** sandywalsh_ has joined #openstack-infra21:27
*** dhellmann has quit IRC21:27
*** elasticio__ has quit IRC21:27
*** gyee has joined #openstack-infra21:28
zaropleia2: i created a patch for python-jenkins project in LP.  i can't tell whether it's active. do you know?21:28
pleia2zaro: I'll have a look21:28
zaropleia2: https://code.launchpad.net/~zaro0508/python-jenkins/plugin-info-method21:29
jeblairzaro: i think i have access there, but haven't had time to look in a while21:29
*** CaptTofu has joined #openstack-infra21:29
pleia2zaro: yeah, looks like https://code.launchpad.net/python-jenkins/+activereviews21:30
pleia2zaro: technically it looks like you did everything right :)21:30
*** ruhe has quit IRC21:31
pleia2socially I'm not sure about their nudging procedure for looking at MPs21:31
jeblairnudge me because i don't look at launchpad21:31
zarojeblair, pleia2 : good to know.21:32
clarkbpleia2: ok I am going to dial into the asterisk server in just a minute21:33
pleia2clarkb: cool, let's use 600121:34
clarkbok21:34
pleia2hehe, it hangs up on me21:34
clarkbme too21:35
jeblairdialing in via sip wfm21:37
*** dstanek has joined #openstack-infra21:37
SergeyLukjanovlooks like https://review.openstack.org/#/c/58702/ was missed by zuul, am I right?21:37
*** vipul is now known as vipul-away21:39
*** pabelanger has quit IRC21:39
*** vipul-away is now known as vipul21:39
jeblairclarkb, pleia2: weird; after a few hangups, it worked21:39
jeblair(using pstn)21:39
fungiSergeyLukjanov: no, it's waiting for someone to approve https://review.openstack.org/57098 (and will potentially need rebasing when that happens)21:41
jeblairclarkb, pleia2: try again?21:41
fungiSergeyLukjanov: you can see that in the "dependencies" for the change you linked21:42
SergeyLukjanovfungi, several page refreshes helps me... thank you21:42
*** mrodden1 has joined #openstack-infra21:42
*** mrodden has quit IRC21:43
jeblairclarkb, pleia2: i restarted asterisk; it seems more reliable now :/21:46
*** fbo is now known as fbo_away21:47
*** Ryan_Lane has joined #openstack-infra21:50
*** MarkAtwood has joined #openstack-infra21:50
*** luisg has quit IRC21:51
*** rockyg has quit IRC21:51
*** markvan has joined #openstack-infra21:53
*** rongze has joined #openstack-infra21:55
*** Ryan_Lane has quit IRC21:57
ekarlsoCan this be approved ? https://review.openstack.org/#/c/56927/21:57
*** rongze has quit IRC22:00
*** jcoufal has joined #openstack-infra22:02
*** dkliban has quit IRC22:03
*** Ryan_Lane has joined #openstack-infra22:03
*** krtaylor has quit IRC22:05
*** reed has quit IRC22:06
*** che-arne_ has joined #openstack-infra22:06
*** che-arne has quit IRC22:07
*** reed has joined #openstack-infra22:07
*** Ryan_Lane has quit IRC22:08
bnemecHey, quick question.  I'm looking at https://review.openstack.org/#/c/59270/2 and wondering why the requirements change didn't get synced automatically when it merged in global requirements.22:08
clarkbjeblair: thanks, sorry missed it, we ended up just doing a normal phone call22:08
bnemecDid that job get shut off because of https://bugs.launchpad.net/openstack-ci/+bug/1246249 ?22:08
uvirtbotLaunchpad bug 1246249 in openstack-ci "Auto update requirement review proposal run on wrong branches" [Undecided,New]22:08
clarkbbnemec: yes22:08
clarkbbnemec: gerrit doesn't provide branch info after things have merged so there isn't a good easy way to make that change work22:09
jeblairclarkb: it doesn't?22:09
bnemecclarkb: Okay, thanks.  It came up on the review and I wanted to find out what was going on before approving any requirements changes.22:09
jeblairclarkb: pretty sure ref-updated tells you what ref (eg master, stable/foo) was updated...22:10
*** reed has quit IRC22:10
*** sdake_ has quit IRC22:10
jeblairclarkb: and there's always the 'change-merged' event.22:10
*** reed has joined #openstack-infra22:10
*** sdake_ has joined #openstack-infra22:10
clarkbjeblair: hmm there is no ZUUL_BRANCH should we look at ZUUL_REF in post?22:11
jeblairclarkb: correct22:12
*** mrodden1 has quit IRC22:12
clarkbI will need to look at that again22:12
*** krotscheck has quit IRC22:14
Alex_GaynorHmm, are teh failures on https://review.openstack.org/#/c/59533/ because of the changes in CI?22:15
*** pabelanger_ has quit IRC22:15
*** pabelanger has joined #openstack-infra22:15
clarkbAlex_Gaynor: looks like dkranz's log filtering failed that job22:17
*** krotscheck has joined #openstack-infra22:17
clarkbjeblair: is ZUUL_REF or ZUUL_REFNAME better for getting master or stable/foo?22:17
*** torgomatic has joined #openstack-infra22:18
jeblairclarkb: equivalent; i'd go with ref22:18
clarkbjeblair: thanks22:18
jeblairclarkb: look for existing usage in slave_scripts; you may need to do some regex matching to avoid doing things on tags.22:19
jeblairclarkb: oh, nm, zuul handles that22:19
Alex_Gaynorclarkb: meaning everything is going to fail right now?22:19
clarkbAlex_Gaynor: meaning everything with ERRORs in the service logs is going to fail (with the exception of some whitelisted failures)22:19
dkranzclarkb: This seems to be a very infrequent but persistent log error http://logstash.openstack.org/#eyJzZWFyY2giOiJcIjQwNCBOb3QgRm91bmQgIFtmaXJzdCA2MCBjaGFycyBvZiByZXNwb25zZV1cIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTM4NjEwOTExNTkzN30=22:20
clarkbjeblair: where does zuul do that?22:20
fungiAlex_Gaynor: ERROR swiftclient [-] Object GET failed: http://127.0.0.1:8080/v1/AUTH_4d22a858761e4b90b536f489ccff34ca/glance/a6c33fc7-4871-45f7-8b3c-fd0a7452cea0 404 Not Found  [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.<22:20
dkranzAlex_Gaynor: This is a flaky issue happening 19 times in the past 7 days22:20
jeblairclarkb: in the layout, post jobs only run on commits22:21
Alex_GaynorOk, so not my fault, it's killing everyone :/22:21
clarkbjeblair: is that what the negative lookahead regex is doing in the pipeline manager for post?22:21
jeblairclarkb: yeah22:21
openstackgerritTom Fifield proposed a change to openstack-infra/jeepyb: Add script to post a gerrit welcome message  https://review.openstack.org/5890022:21
dkranzAlex_Gaynor: I'm not sure 19 times in a week out of all runs is killing.22:21
Alex_Gaynordkranz: sorry s/killing/effecting/ is all I meant22:21
*** ryanpetrello has quit IRC22:22
dkranzAlex_Gaynor: Well, other ones have been killing :)22:22
*** dprince has quit IRC22:22
dkranzI will file a bug22:23
openstackgerritClark Boylan proposed a change to openstack-infra/config: Enable requirement update proposal jobs  https://review.openstack.org/5985522:23
clarkbjeblair: something like that? I can't believe it is so simple (I think I convinced myself that this is hard for some reason)22:23
dkranzclarkb: Is there an easy way to go from some value reported in a logstash result to the patch whose build caused it?22:23
clarkbisn't there another set of jobs that have trouble with this?22:23
jeblairclarkb: can it wait for a bit?  (zuul hole)22:23
clarkbjeblair: yup no rush22:24
clarkbdkranz: yes, the change and patchset numbers are recorded in the events22:24
clarkbdkranz: in kibana just click on one of them to expand the whole thing22:24
dkranzclarkb: ok, great.22:24
*** thomasem has quit IRC22:27
*** smarcet has left #openstack-infra22:28
*** ArxCruz has quit IRC22:29
*** ArxCruz has joined #openstack-infra22:30
*** luisg has joined #openstack-infra22:30
*** salv-orlando has joined #openstack-infra22:33
*** denis_makogon has quit IRC22:34
dkranzAlex_Gaynor: I filed https://bugs.launchpad.net/glance/+bug/1257509 and did a reverify on that patch22:34
uvirtbotLaunchpad bug 1257509 in glance "swiftclient ERROR in g-api after successful tempest run" [Undecided,New]22:34
*** fifieldt has joined #openstack-infra22:35
Alex_Gaynordkranz: thanks22:37
*** mriedem has quit IRC22:39
clarkbfungi: mordred: https://review.openstack.org/#/c/54639/ seems to be ready and gives us a nice extra requirements list22:39
clarkbzaro: ^ the recent change appears to have fixed it22:39
reedI think we need to re-establish the reply-to in openstack-dev to its sane configuration22:40
* reed ranting again22:40
jeblairclarkb, fungi: i have reproduced the zuul bug!22:40
jeblairclarkb, fungi: moreover, i understand it, and can write a test/fix!22:40
fungijeblair: that *is* exciting22:41
clarkbjeblair: hurray!22:41
clarkbI think we should all drink a shot now22:41
fungias long as we don't turn elastic recheck into a drinking game. i don't think my liver would survive that22:41
jeblairfungi: haha!22:41
mordredjeblair: wow!22:41
clarkbI will be very interested in readnig the fix22:42
mordredjeblair: I must tell you I was fully expecting that bug to be un understandable22:42
mordredso I'm impressed22:42
* reed cheers at jeblair22:43
fungiit seemed infrequent and likely hard to recreate the exact conditions22:43
jeblairmordred: i wrote the bug, but i'm pretty sure the reason it's cropped up now is your fault.  :)22:43
mordredjeblair: my god. how did I break ZUUL ?22:43
reedmordred, not surprising, you break a lot of stuff22:43
reed:)22:43
reeduhm ... a dude from adobe.com sent a hard-to-parse message to the general list22:44
fungiwas it in pdf? (couldn't resist)22:46
fungiwas it a list of password hashes?22:46
bnemecHeh, the elastic recheck drinking game.22:46
fungiokay, i'll stop now22:46
* bnemec has a new suggestion for his New Year's Eve party...22:46
openstackgerritDavid Ostrovsky proposed a change to openstack-infra/config: Delete melody  https://review.openstack.org/5985922:47
reedfungi, LOL22:48
reedmoments of pure entertainment22:48
*** krtaylor has joined #openstack-infra22:50
*** Ryan_Lane has joined #openstack-infra22:52
*** fifieldt_ has joined #openstack-infra22:52
*** dkranz has quit IRC22:53
*** michchap has quit IRC22:56
*** Ryan_Lane has quit IRC22:56
*** bpokorny1 has quit IRC22:56
*** CaptTofu has quit IRC22:57
*** rongze has joined #openstack-infra22:57
*** jamesmcarthur has quit IRC22:57
*** jamesmcarthur has joined #openstack-infra22:59
*** jpich has quit IRC23:01
*** mfer has quit IRC23:01
*** michchap has joined #openstack-infra23:02
*** thingee has quit IRC23:02
*** luisg has quit IRC23:02
*** rongze has quit IRC23:02
*** jcoufal has quit IRC23:02
*** thingee has joined #openstack-infra23:03
*** CaptTofu has joined #openstack-infra23:03
*** _david_ has quit IRC23:04
*** fifieldt_ has quit IRC23:05
*** sarob has quit IRC23:07
*** fifieldt_ has joined #openstack-infra23:07
*** sarob has joined #openstack-infra23:07
*** mrodden has joined #openstack-infra23:10
*** sarob has quit IRC23:11
*** hashar has quit IRC23:12
zarofungi: i just added instrcutions on how to create maven central account: https://review.openstack.org/#/c/4609923:12
*** markvan has quit IRC23:14
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Fix merging transitively-connected change queues.  https://review.openstack.org/5986523:14
fungizaro: great--adding to my list of things i'll hopefully look at this evening23:16
*** jcooley_ has quit IRC23:18
*** jamesmcarthur has quit IRC23:19
EmilienMjeblair: for your comment on  https://review.openstack.org/#/c/59039/1 - I'm wondering if i have to add the grenade jobs in devstack-gate-periodic-jobs.yaml (there is no job for grenade yet in periodics)23:19
jeblairclarkb: do you want to answer that? ^23:20
EmilienMfyi, current periodics jobs don't support grenade. I'm adding neutron support to grenade jobs and just wonder if i also add jobs in periodics23:21
*** esker has quit IRC23:24
*** giulivo has quit IRC23:24
*** dolphm has quit IRC23:25
*** SergeyLukjanov has quit IRC23:26
sdaguedstufft: you about? just chatting with the heat guys who are blocked on some gating things waiting on pip 1.4.2 to release23:26
sdaguecurious what the update is on when that's going to happen23:26
dstufftsdague: pip 1.4.2 was killed in favor of 1.523:26
dstufftwhich there is a RC available for23:26
sdagueok, so when does that go to release?23:26
dstufftnext week or two probably23:26
dstufftDec 29th is the deadline for a 1.5 final23:27
dstufftfor inclusion in Python 3.423:27
sdaguehmph23:27
dstufftwhat problem are they having?23:27
sdague1.4.1 can't install disk image builder23:27
sdaguewhich they need in the gate23:27
dstufftcan 1.5?23:28
*** nati_uen_ has joined #openstack-infra23:28
sdaguestevebaker: comments? on above?23:28
stevebakerdstufft: I would say so. What I needed was already fixed in master23:29
*** nati_uen_ has quit IRC23:29
*** nati_uen_ has joined #openstack-infra23:30
dstufftso even if we moved to release a 1.4.2 it'd probably come out after 1.5 at this point23:30
*** nati_ueno has quit IRC23:30
dstufftI'm not sure how to help here besides try to get 1.5 out sooner :)23:30
*** dolphm has joined #openstack-infra23:32
dstufftunless you all are willing to run a pre release version of pip, but I'm not sure what the policy would be on that23:32
openstackgerritA change was merged to openstack-infra/config: Add gerrit notifications to #storyboard  https://review.openstack.org/5914323:32
stevebakerA workaround could be to install dib in devstack by unpacking the tarball and setup.py install, but I had assumed there would be objections to that23:33
fungireed: i took pity on vague adobe guy and responded too23:34
*** yamahata_ has quit IRC23:34
stevebakersdague: but waiting for fedora 20 might be a reasonable workaround23:34
sdaguestevebaker: ok23:35
sdaguethat's next week?23:35
*** paul-- has joined #openstack-infra23:35
jeblairfungi, clarkb, mordred: i'm single-core approving week-old changes.23:35
mordred++23:35
stevebakersdague: next week, assuming the cloud image lands at the same time as the main release23:36
fungijeblair: fine with me. i'm still trying to work through some that old, but in cases where it needs testing/vetting it's taking time23:36
openstackgerritA change was merged to openstack-infra/config: Install graphite-web and carbon with pip.  https://review.openstack.org/5865323:37
sdaguestevebaker: ok, lets do that.23:37
*** mrodden has quit IRC23:38
openstackgerritA change was merged to openstack-infra/config: Sort subscriber map alphabetically  https://review.openstack.org/5863323:38
openstackgerritA change was merged to openstack-infra/config: Add some documentation to the start of subscriber_map  https://review.openstack.org/5863723:38
openstackgerritA change was merged to openstack-infra/config: Adding in Matt Oliver to rcbau team  https://review.openstack.org/5867423:38
dstufftsdague: stevebaker let me know if there's something pip can do to help out besides trying to get 1.5 out as fast as we can :)23:38
openstackgerritYuuichi Fujioka proposed a change to openstack-dev/hacking: checking for metaclass to be Python 3.x compatible  https://review.openstack.org/5689023:40
openstackgerritA change was merged to openstack-infra/config: Add new openstack-doc-tools project  https://review.openstack.org/5862323:40
stevebakerdstufft: ok, thanks23:41
stevebakersdague: so just to confirm, is this a halt on any changes to heat-slow tests until they are runnable in gate?23:41
openstackgerritA change was merged to openstack-infra/config: Add Climate-nova sub-project  https://review.openstack.org/5856023:41
openstackgerritA change was merged to openstack-infra/config: Climate project: add gerrit tags ACL  https://review.openstack.org/5868823:42
openstackgerritA change was merged to openstack-infra/config: Move stevedore to stackforge  https://review.openstack.org/5838923:42
openstackgerritA change was merged to openstack-infra/config: Readd object-storage-manual for Grizzly  https://review.openstack.org/5831323:43
*** CaptTofu has quit IRC23:44
openstackgerritJeremy Stanley proposed a change to openstack-infra/git-review: Ignore content of merge commits in reporting  https://review.openstack.org/5040123:44
fungiclarkb: does that updated commit message jove? if so, approving23:44
fungis/jove/jive/ by jove23:45
sdaguestevebaker: we really shouldn't be landing code we can't execute, or have something able to execute them.23:45
sdagueso yeh, we should hold until we can get some job running some of this23:45
openstackgerritA change was merged to openstack-infra/config: Start running regular jobs on reviewstats.  https://review.openstack.org/5821023:45
*** rnirmal has quit IRC23:45
sdagueif it's a smaller job, that's cool, or if we can piece together that job so it can work with an rc pip (outside the integrated gate), that's cool as well23:46
*** sarob has joined #openstack-infra23:46
stevebakersdague: ok, that will be motivating ;)23:46
*** slong has joined #openstack-infra23:47
*** dolphm has quit IRC23:47
*** slong-gone has quit IRC23:48
sdaguestevebaker: awesome :)23:48
sdagueI look forward to it23:48
*** atiwari has quit IRC23:49
*** dstanek_afk has quit IRC23:50
*** mattray has quit IRC23:51
*** loq_mac has joined #openstack-infra23:52
fungimordred: did you want to answer lifeless's question on https://review.openstack.org/58106 before i approve it? also, does that additionally address bugs 1251462 and 1257079?23:52
uvirtbotLaunchpad bug 1251462 in openstack-ci "Don't require pypi.python.org to install pip" [Undecided,New] https://launchpad.net/bugs/125146223:52
uvirtbotLaunchpad bug 1257079 in devstack "SyntaxError occured with the retieval of devstack/files/get-pip.py in gate" [Undecided,New] https://launchpad.net/bugs/125707923:52
fungiif so, i'll mark them as dupes of bug 125427523:52
uvirtbotLaunchpad bug 1254275 in openstack-ci "check-swift-devstack-vm-functional fails fetching requirements from pypi.python.org" [Undecided,In progress] https://launchpad.net/bugs/125427523:52
*** Ryan_Lane has joined #openstack-infra23:52
mordredlifeless, fungi: uhm. it's cached in the devstack location ...23:53
fungiyeah, i can dig it out of the devstack source code if it's an important detail23:53
mordredfungi: and yes, I believe they are dupes of that23:53
mordredfungi: ALTHOUGH23:54
mordredthe devstack bug should probably also be fixed if it's pulling the wrong location23:54
fungithe two components there seem to be that the script gets pulled from github and then retrieves a package from pypi.p.o23:54
*** CaptTofu has joined #openstack-infra23:55
lifelessmordred: ok, so we cache a copy of the get-pip upstream script?23:55
lifelessor the pip that that script gets?23:55
mordredwe cache a copy of the git-pip upstream script in d-g23:55
lifelessCause the thing worrying me is that caching get-pip doesn't get you freedom from internet downloads23:55
mordredlifeless: it can23:55
lifelessyou need to cache a copy of the result23:55
lifelessdon't you?23:55
mordrednope23:55
mordredwell, kinda23:56
mordredyou can cache get-pip23:56
mordredand then you can tell get-pip to use the mirror23:56
mordredso get-pip itself can grab pip from the mirror23:56
mordredOR23:56
*** openstackgerrit has quit IRC23:56
mordredif you get really clever, you can tell git-pip to install the pip it finds in itself (which is I believe how I fixed devsack)23:56
*** openstackgerrit has joined #openstack-infra23:56
*** kui has quit IRC23:56
lifelessoh, am blind  - read https://raw.github.com/pypa/pip/master/contrib/get-pip.py23:56
mordredso if devstack finds a get-pip script in its cache location23:56
openstackgerritEmilien Macchi proposed a change to openstack-infra/config: Neutron support in Grenade jobs  https://review.openstack.org/5903923:57
*** Ryan_Lane has quit IRC23:57
*** luisg has joined #openstack-infra23:57
lifelessso23:57
lifelesssince get-pip is unversioned23:57
*** ^demon|lunch has quit IRC23:57
*** mrodden has joined #openstack-infra23:57
lifelesswhen a new pip is released23:57
lifelesswe'll install newer pip, not whatever our requirements say we want23:58
*** dangers is now known as danger_fo_away23:58
lifeless?23:58
*** jerryz has joined #openstack-infra23:58
EmilienMjeblair: I've applied your comment for neutron / grenade patch23:58
*** rongze has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!