Monday, 2015-12-21

*** thorst has joined #openstack-infra00:01
*** thorst has quit IRC00:02
*** salv-orlando has quit IRC00:03
*** thorst has joined #openstack-infra00:03
*** markvoelker has quit IRC00:04
*** ArxCruz has quit IRC00:04
*** chlong has joined #openstack-infra00:05
*** gildub_ has joined #openstack-infra00:06
*** thorst has quit IRC00:11
*** tzn has quit IRC00:16
*** hogepodge has quit IRC00:16
*** piet has joined #openstack-infra00:17
*** hogepodge has joined #openstack-infra00:22
*** hogepodge has quit IRC00:27
*** piet has quit IRC00:35
*** salv-orl_ has quit IRC00:36
*** piet has joined #openstack-infra00:38
*** piet has quit IRC00:40
*** piet has joined #openstack-infra00:41
*** Qiming has joined #openstack-infra00:42
*** hogepodge has joined #openstack-infra00:43
*** dims has joined #openstack-infra00:43
*** otter768 has joined #openstack-infra00:43
*** otter768 has quit IRC00:48
*** piet has quit IRC00:57
*** triggerwarning has joined #openstack-infra01:00
*** triggerwarning has quit IRC01:01
*** triggerwarning has joined #openstack-infra01:01
*** dims has quit IRC01:02
*** sdake_ has joined #openstack-infra01:03
tonybis there anything strange going on in project-config and running local tests?01:03
*** sdake has quit IRC01:04
tonybI can't get tox to pass on origin/master01:04
*** markvoelker has joined #openstack-infra01:05
*** dcentral has quit IRC01:08
*** triggerwarning has quit IRC01:08
*** thorst has joined #openstack-infra01:09
*** markvoelker has quit IRC01:10
openstackgerritTony Breeds proposed openstack-infra/project-config: Do not run heatclient functional tests on kilo  https://review.openstack.org/25982001:13
*** armax has quit IRC01:15
*** thorst has quit IRC01:16
*** lykinsbd has joined #openstack-infra01:17
*** Qiming has quit IRC01:19
*** piet has joined #openstack-infra01:22
openstackgerritDiana Whitten proposed openstack-infra/project-config: Add openstack-ux repo  https://review.openstack.org/25923901:23
*** piet has quit IRC01:27
*** lykinsbd has quit IRC01:28
*** lykinsbd has joined #openstack-infra01:29
*** salv-orlando has joined #openstack-infra01:37
*** jyuso1 has joined #openstack-infra01:41
*** piet has joined #openstack-infra01:41
fungiclarkb: on the lack of swap, we can mkswap a sparse file on the rootfs and activate it if jobs want swap (we may in fact want to ensure we have roughly the same amount of swap in all providers)01:47
* fungi goes back to not really being at a computer01:47
*** Qiming has joined #openstack-infra01:52
*** dims has joined #openstack-infra02:07
*** vilobhmm11 has joined #openstack-infra02:10
*** vilobhmm11 has quit IRC02:11
*** salv-orlando has quit IRC02:12
*** thorst has joined #openstack-infra02:14
*** thorst has quit IRC02:21
*** markvoelker has joined #openstack-infra02:36
*** woodster_ has quit IRC02:36
*** harlowja_at_home has joined #openstack-infra02:39
*** markvoelker has quit IRC02:40
*** BenJ has joined #openstack-infra02:44
*** BenJ is now known as Guest7429102:44
*** otter768 has joined #openstack-infra02:44
*** Guest74291 has quit IRC02:45
*** rvasilets___ has quit IRC02:45
*** BenCW has joined #openstack-infra02:46
*** sdake_ has quit IRC02:47
*** otter768 has quit IRC02:49
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Fix regression in change tracking  https://review.openstack.org/25928102:51
*** harlowja_at_home has quit IRC02:54
*** piet has quit IRC02:57
*** janonymous has joined #openstack-infra02:58
*** sdake has joined #openstack-infra03:04
*** sdake_ has joined #openstack-infra03:06
*** sdake has quit IRC03:09
*** zz_dimtruck is now known as dimtruck03:13
*** thorst has joined #openstack-infra03:19
dimslifeless : have you seen this before? raise ValueError, "No closing quotation"03:20
dimslifeless : example in http://logs.openstack.org/07/259707/2/check/gate-releases-tox-validate/c18a4b5/console.html#_2015-12-21_03_09_48_01903:20
lifelessdims: nope, but it sounds like it might be the thing ansible ran into - see the mail on -dev about renaming their functional test target03:22
*** coolsvap|away is now known as coolsvap03:23
dimslifeless : ack will check it out tomorrow. thanks03:23
lifelessdims: (or it may not be ;))03:25
*** links has joined #openstack-infra03:26
openstackgerritTony Breeds proposed openstack-infra/project-config: Add oldstable jobs for python-barbicanclient  https://review.openstack.org/25982803:27
*** thorst has quit IRC03:27
*** JbHuNt has joined #openstack-infra03:31
*** dims has quit IRC03:32
openstackgerritTony Breeds proposed openstack-infra/project-config: Barbican does not support python34 in kilo  https://review.openstack.org/25983003:32
*** coolsvap is now known as coolsvap|away03:33
*** coolsvap|away is now known as coolsvap03:40
openstackgerritIan Wienand proposed openstack-infra/glean: Handle invalid symlinks in written files  https://review.openstack.org/25983103:40
*** lykinsbd has quit IRC03:44
*** zhurong has joined #openstack-infra03:51
openstackgerritIan Wienand proposed openstack-infra/glean: Minor testing cleanups  https://review.openstack.org/25983403:51
*** otter768 has joined #openstack-infra04:07
openstackgerritIan Wienand proposed openstack-infra/glean: Check for network service enablement  https://review.openstack.org/25983804:12
*** zhurong has quit IRC04:20
*** claudiub has joined #openstack-infra04:22
*** thorst has joined #openstack-infra04:24
*** mahatic has joined #openstack-infra04:26
*** jyuso1 has quit IRC04:28
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal: leave behind dummy /etc/resolv.conf  https://review.openstack.org/25717304:29
*** thorst has quit IRC04:31
*** jyuso1 has joined #openstack-infra04:34
*** markvoelker has joined #openstack-infra04:37
*** otter768 has quit IRC04:37
*** dimtruck is now known as zz_dimtruck04:40
*** markvoelker has quit IRC04:41
*** tlian2 has quit IRC04:44
*** zz_dimtruck is now known as dimtruck04:46
*** otter768 has joined #openstack-infra04:48
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Skip based off commit message  https://review.openstack.org/25137104:53
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Filter events by commit message  https://review.openstack.org/25137304:53
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Filter jobs off commit message  https://review.openstack.org/25137204:53
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Fix regression in change tracking  https://review.openstack.org/25928104:53
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Expose commitMessage as a Change attribute  https://review.openstack.org/22279104:53
*** harlowja_at_home has joined #openstack-infra04:57
*** bharathm has joined #openstack-infra05:00
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal: do not configure eth0 & eth1 for DHCP automatically  https://review.openstack.org/25717205:04
*** jyuso1 has quit IRC05:08
*** bharathm has quit IRC05:08
*** markvoelker has joined #openstack-infra05:10
*** zhurong has joined #openstack-infra05:12
*** jyuso1 has joined #openstack-infra05:15
*** amotoki has joined #openstack-infra05:21
*** harlowja_at_home has quit IRC05:23
*** mudassirlatif has joined #openstack-infra05:27
*** thorst has joined #openstack-infra05:29
*** otter768 has quit IRC05:30
*** maishsk has quit IRC05:32
*** thorst has quit IRC05:36
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Turn off -e in check-git-commit-message.sh  https://review.openstack.org/25984205:39
openstackgerritKen'ichi Ohmichi proposed openstack-infra/devstack-gate: Enable SameHostFilter and DifferentHostFilter  https://review.openstack.org/25984305:53
*** julim has quit IRC05:56
*** yuanying has joined #openstack-infra05:56
*** nihilifer has joined #openstack-infra06:00
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/25984706:02
*** Thelo has quit IRC06:05
*** oomichi has joined #openstack-infra06:06
openstackgerritGal Sagie proposed openstack-infra/project-config: Export enabled services from devstackgaterc in Dragonflow  https://review.openstack.org/25984806:15
*** rossella_s has quit IRC06:21
*** rossella_s has joined #openstack-infra06:22
*** oomichi has quit IRC06:30
*** dimtruck is now known as zz_dimtruck06:32
*** abregman has joined #openstack-infra06:33
*** aopincar has joined #openstack-infra06:34
*** thorst has joined #openstack-infra06:34
*** thorst has quit IRC06:41
*** vilobhmm11 has joined #openstack-infra06:46
*** _nadya_ has joined #openstack-infra06:49
*** triggerwarning has joined #openstack-infra06:51
*** Ramanjaneya has joined #openstack-infra06:51
*** dcentral has joined #openstack-infra06:51
*** oomichi has joined #openstack-infra06:53
*** Thelo has joined #openstack-infra06:56
*** amotoki has quit IRC06:59
*** _nadya_ has quit IRC07:00
*** HeOS has joined #openstack-infra07:00
*** gildub has quit IRC07:03
*** gildub_ has quit IRC07:03
*** maishsk has joined #openstack-infra07:09
*** chlong has quit IRC07:13
TheloHi all, in the third party documentation it is written that we need a "normal reviewer account in gerrit" to read the event stream. Is this different from a normal account?07:13
*** sdake_ has quit IRC07:17
*** markvoelker has quit IRC07:21
*** triggerwarning has quit IRC07:24
openstackgerritIan Wienand proposed openstack/diskimage-builder: [WIP] yum-minimal : install selinux policy packages  https://review.openstack.org/25986707:25
*** markvoelker has joined #openstack-infra07:25
*** _nadya_ has joined #openstack-infra07:28
*** _nadya_ has quit IRC07:28
openstackgerritAnton Tcitlionok proposed openstack-infra/jenkins-job-builder: Clarify 'trigger-parametrized-builds' description  https://review.openstack.org/25987007:29
openstackgerritAnton Tcitlionok proposed openstack-infra/jenkins-job-builder: Clarify 'trigger-parametrized-builds' description  https://review.openstack.org/25987007:31
*** AJaeger has joined #openstack-infra07:31
*** irenab has quit IRC07:31
*** otter768 has joined #openstack-infra07:31
*** claudiub has quit IRC07:32
*** lezbar has joined #openstack-infra07:34
*** otter768 has quit IRC07:36
*** unicell has quit IRC07:38
*** unicell has joined #openstack-infra07:38
*** lezbar has quit IRC07:39
*** thorst has joined #openstack-infra07:39
*** mudassirlatif has quit IRC07:42
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Do not run heatclient functional tests on kilo  https://review.openstack.org/25982007:42
*** lezbar__ has joined #openstack-infra07:43
openstackgerritKirill Zaitsev proposed openstack-infra/project-config: Adds release notes jobs to murano deliverables  https://review.openstack.org/25987407:44
*** flepied has quit IRC07:44
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/25984707:45
*** _nadya_ has joined #openstack-infra07:45
*** thorst has quit IRC07:46
*** BenCW has quit IRC07:52
openstackgerritKirill Zaitsev proposed openstack-infra/project-config: Make python3 jobs voting for murano-dashboard  https://review.openstack.org/25987707:54
*** migi has joined #openstack-infra07:57
openstackgerritKirill Zaitsev proposed openstack-infra/project-config: Adds release notes jobs to murano deliverables  https://review.openstack.org/25987408:01
*** vilobhmm11 has quit IRC08:03
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Revert "Check for correct DocImpact tag usage"  https://review.openstack.org/25956908:03
*** salv-orlando has joined #openstack-infra08:11
openstackgerrityolanda.robla proposed openstack/diskimage-builder: Create new partitioning element.  https://review.openstack.org/25988108:11
*** flepied has joined #openstack-infra08:12
*** irenab has joined #openstack-infra08:12
*** flepied1 has joined #openstack-infra08:13
*** salv-orlando has quit IRC08:14
*** ihrachys has joined #openstack-infra08:14
*** flepied has quit IRC08:17
*** Benjj has joined #openstack-infra08:19
BenjjVolumeSizeExceedsAvailableQuota: Requested volume or snapshot exceeds allowed gigabytes quota. Requested 1G, quota is 1G and 1G has been consumed.08:20
BenjjI get this error msg. where should I change the settings?08:20
Benjjtried in cinder.conf but not works08:21
openstackgerritKirill Zaitsev proposed openstack-infra/project-config: Adds release notes jobs to murano deliverables  https://review.openstack.org/25987408:22
*** unicell1 has joined #openstack-infra08:23
*** unicell has quit IRC08:24
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal : install selinux policy packages  https://review.openstack.org/25986708:24
BenjjI install it using devstack08:25
openstackgerritNicko Glayre proposed openstack-infra/jenkins-job-builder: Adding support for maven-metadata-plugin  https://review.openstack.org/25743008:25
*** abregman has quit IRC08:28
*** chlong has joined #openstack-infra08:31
*** abregman has joined #openstack-infra08:33
*** jcoufal has joined #openstack-infra08:34
*** shardy has joined #openstack-infra08:37
*** dizquierdo has joined #openstack-infra08:40
*** markus_z has joined #openstack-infra08:40
*** thorst has joined #openstack-infra08:44
*** zhurong has quit IRC08:45
*** ifarkas has joined #openstack-infra08:45
*** Hal1 has joined #openstack-infra08:45
*** zhurong has joined #openstack-infra08:48
*** abregman has quit IRC08:49
*** thorst has quit IRC08:51
*** kzaitsev1mb has joined #openstack-infra08:53
*** asselin__ has joined #openstack-infra08:55
openstackgerrityolanda.robla proposed openstack/diskimage-builder: Create new partitioning element.  https://review.openstack.org/25988108:55
*** asselin_ has quit IRC08:57
AJaegerBenjj: for devstack better ask on #openstack-qa - or on #openstack-dev08:57
*** kzaitsev1mb has quit IRC09:00
*** daemontool has joined #openstack-infra09:00
*** abregman has joined #openstack-infra09:04
*** yamamoto has joined #openstack-infra09:05
*** hashar has joined #openstack-infra09:05
*** [HeOS] has joined #openstack-infra09:18
*** HeOS has quit IRC09:19
*** sfinucan has joined #openstack-infra09:20
*** HeOS has joined #openstack-infra09:20
*** Benjj has quit IRC09:21
*** [HeOS] has quit IRC09:23
*** markmcd has quit IRC09:25
*** markvoelker has quit IRC09:25
*** dizquierdo has quit IRC09:26
*** markmcd has joined #openstack-infra09:27
*** HeOS has quit IRC09:29
openstackgerritMerged openstack-infra/project-config: Adds release notes jobs to murano deliverables  https://review.openstack.org/25987409:29
openstackgerritMerged openstack-infra/project-config: Do not run heatclient functional tests on kilo  https://review.openstack.org/25982009:30
*** mpavone has joined #openstack-infra09:31
*** otter768 has joined #openstack-infra09:32
openstackgerritMerged openstack-infra/project-config: Check for dead links in App Catalog  https://review.openstack.org/25923209:32
*** HeOS has joined #openstack-infra09:32
*** bexelbie has joined #openstack-infra09:32
openstackgerritMerged openstack-infra/project-config: Add oldstable jobs for python-barbicanclient  https://review.openstack.org/25982809:33
*** salv-orlando has joined #openstack-infra09:34
openstackgerritMerged openstack-infra/project-config: Fix rally jobs for networking-ovn, kuryr and dragonflow  https://review.openstack.org/25834709:35
*** yamamoto has quit IRC09:36
*** otter768 has quit IRC09:36
*** HeOS has quit IRC09:38
*** Qiming has quit IRC09:38
*** openstack has joined #openstack-infra15:36
yolandahere it comes15:36
*** irenab has quit IRC15:36
AJaegerthanks, yolanda !15:36
*** sdake has joined #openstack-infra15:36
fungishort story is that those bots are extensions to supybot which is built on the twisted framework. twisted has an ssl+ipv6 incompatibility where it can't establish ssl sockets to ipv6 addresses but tries to do so anyway if the dns response for the destination includes at least one ipv6 address15:37
*** xarses has joined #openstack-infra15:37
AJaegeryolanda: Yeah, #success works again.15:37
yolandanice15:37
fungiit's been that way for years and nobody working on twisted has had the time to solve it (apparently a fairly subtle/complex challenge)15:37
yolandai'll know for next time15:37
openstackgerrityolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes  https://review.openstack.org/25204115:38
*** bexelbie has joined #openstack-infra15:38
AJaegerTime to do some shopping. Bye for now...15:38
*** AJaeger has quit IRC15:38
*** otter768 has quit IRC15:39
*** jsavak has quit IRC15:39
*** jsavak has joined #openstack-infra15:40
*** maishsk has quit IRC15:40
asselin__fungi, if you have a chance, could you review this: https://review.openstack.org/#/c/253619/15:42
*** apuimedo_ has quit IRC15:44
*** apuimedo_ has joined #openstack-infra15:44
*** smarcet1981 has joined #openstack-infra15:45
*** jsavak has quit IRC15:45
*** aopincar has quit IRC15:45
*** sdake has quit IRC15:45
*** smarcet has quit IRC15:45
fungiasselin__: it looks like we haven't had much diversity of reviewers on the related patches. i'd like to see nibalizer weigh in on that if he's around15:46
fungii am not confident in my ability to spot the risks on that change15:46
*** GheRiver1 has quit IRC15:47
*** sdake has joined #openstack-infra15:48
asselin__fungi, understood.15:49
fungiand the system-config change looks like sort of a fulcrum for the others15:50
*** yamamoto has joined #openstack-infra15:50
*** smarcet has joined #openstack-infra15:51
*** smarcet1981 has quit IRC15:51
*** apuimedo_ has quit IRC15:51
*** apuimedo has quit IRC15:51
*** harlowja_at_home has joined #openstack-infra15:52
*** sdake_ has joined #openstack-infra15:52
*** sdake has quit IRC15:53
*** apuimedo has joined #openstack-infra15:53
*** yamamoto has quit IRC15:54
*** apuimedo_ has joined #openstack-infra15:54
*** mtanino has joined #openstack-infra15:54
*** yamamoto has joined #openstack-infra15:54
*** changbl has quit IRC15:54
asselin__fungi, we need to pick one or the other, having both fails miserable.15:54
*** bexelbie has quit IRC15:54
*** tonytan4ever has joined #openstack-infra15:55
*** smarcet has quit IRC15:55
*** smarcet1981 has joined #openstack-infra15:55
fungiasselin__: makes sense, just want to make sure we're not about to head down a road to somewhere we don't want to be with that module15:55
*** vgridnev has quit IRC15:56
openstackgerrityolanda.robla proposed openstack-infra/system-config: Add instructions on how to troubleshoot bots  https://review.openstack.org/26006815:59
*** sdake has joined #openstack-infra16:00
*** apuimedo has quit IRC16:00
*** vgridnev has joined #openstack-infra16:00
*** apuimedo_ has quit IRC16:00
*** dizquierdo has quit IRC16:01
jeblairfungi: review-dev.openstack.org COMMAND=/usr/bin/service exit  -- is that a known incident?16:01
*** yamamoto has quit IRC16:02
*** apuimedo has joined #openstack-infra16:02
*** apuimedo_ has joined #openstack-infra16:02
*** mrmartin has joined #openstack-infra16:02
*** yamamoto has joined #openstack-infra16:02
*** sdake_ has quit IRC16:02
*** yamamoto has quit IRC16:03
fungijeblair: it is not. i assumed that was something zaro was testing but meant to look into it, then got sidetracked16:03
jeblairfungi: review.openstack.org COMMAND=/usr/bin/touch GerritSiteHeader.html  -- also that16:03
fungithat one is known. i saw jhesketh/yolanda discussing it in scrollback i think after approving a patch to the javascript. i assume it was an errant sudo16:03
fungithe timimg matched up anyway so i didn't look further16:03
*** vgridnev has quit IRC16:05
jeblairzaro was logged in during that time16:05
jeblair(and was the only one)16:05
*** esker has quit IRC16:06
yolandafungi, i don't follow that.. i didn't log into review-dev. You mean, touching html and css files on gerrit? i did that on review.opensatck16:06
jeblairfungi: and then sudo'd 'service gerrit stop' from zaro shortly thereafter, so, yeah looks harmless16:06
yolandaalso, is something i wanted to raise the attention of some infra-root. Why these files are owned by root, and not by gerrit2? any reason?16:06
jeblairyolanda: because gerrit2 does not need to alter them16:07
krotscheckDo we have historical data on gerrit usage? i.e. how user behavior changed pre-upgrade to post-upgrade?16:07
jeblairyolanda: it's generally good for web applications not to be permitted to modify more than necessary16:07
* krotscheck is curious about whether it's possible to extract the habituation time for a new user interface from that data.16:07
yolandaok16:07
jeblairyolanda: particularly so that if they are compromised in some small way, they can't have their own code changed by the attacker so that they could then be compromised in some laregr way.16:08
fungiyolanda: yep, i was talking about the second one16:08
openstackgerritValeriy Ponomaryov proposed openstack-infra/project-config: Add 'dsvm' to manila-image-elements dsvm-job name  https://review.openstack.org/26005116:08
yolandamakes sense16:08
jeblairkrotscheck: i believe our only such metric is, erm, unsolicited user feedback on the mailing list and irc.16:08
jeblairkrotscheck: it doesn't record dwell time metrics or anything like that16:09
jeblairkrotscheck: we have 1 month of apache logs, from which one could, potentially, reconstruct some information based on the backend js api requests.  however, i think that would be a big project.16:09
*** [1]Thelo has joined #openstack-infra16:09
krotscheckjeblair: Yeah, it would.16:10
anteayakrotscheck: also it has public knowledge that new screen is coming so some folks have been migrating to new screen using 2.8 voluntarily16:10
jeblairkrotscheck: one could potentially get some really macro-scale stats from gerrit and/or stackalytics; like overall reviewer efficiency.16:11
krotscheckjeblair: I may be able to get things from the stackalytics data. Determine if pre-upgrade shows a notable change to net reviews performed.16:11
krotscheckright. that.16:11
krotscheckThere's a statistical method by which one can determine variable causality too if the dataset is large enough.16:11
krotscheckBut it's harder with aggregate things.16:11
* krotscheck ponders...16:11
*** Thelo has quit IRC16:11
*** [1]Thelo is now known as Thelo16:11
* krotscheck looks at his todo list....16:12
* krotscheck shelves this idea until later.16:12
jeblairkrotscheck: may want to consider whether gertty has an impact on that data; it's not a huge user set, but last i looked it was perhaps on the order of 10016:12
jeblairand of course, this time of year has effects on reviewer throughput as well16:13
asselin__jeblair, this patch needs some reviews please: https://review.openstack.org/#/c/252768/16:13
*** HeOS has quit IRC16:14
fungii was about to say, yeah i expect any impact on review volume will be impacted more by it being what is traditionally our slowest time of year, project-wise, and so any shift from interface learning curve is likely to end up as noise by comparison16:15
*** admin0 has quit IRC16:15
*** lykinsbd has joined #openstack-infra16:15
krotscheckjeblair: It really does.16:15
openstackgerritMerged openstack-infra/shade: Add support for querying role assignments.  https://review.openstack.org/25914716:15
krotscheckMy old prof showed me how to compensate for regular seasonal variation. That was over a decade ago though :/16:16
mordredI will restate the unuseful "I find the new screen excruciatingly difficult to navigate"16:16
jeblairmordred: on that note, did you see i added project topics to gertty over the weekend?16:17
mordredjeblair: I did not - neat!16:17
*** markus_z has quit IRC16:17
blogancan anyone tell me how I can retrigger the gate job on a review that failed?16:17
fungiyeah, some people preemptively started getting themselves used to the new review screen in 2.8 in preparation for the upgrade, i preemptively shifted more of my workflow to gertty instead16:18
*** bastelfreak has quit IRC16:18
jeblairoh, i have some other fixes; i think i need to brown-paper-bag 1.3.116:18
anteayablogan: well posting a comment with content 'recheck' on the patch sends it back to the check queue16:18
Shrewsjeblair: making gertty easier while making gerrit more difficult, eh?... my theory that this is all a well calculated plot seems to have some validity!16:18
Shrews:)16:19
blogananteaya: yeah but that won't run the gate merge jobs though no?16:19
jesusaurusmordred: hear hear, it is definitely more difficult16:19
anteayablogan: if it exits the check queue with +1 from Jenkins and has a +1 workflow on it (with a +2 from at least one core reviewer) it will head into the gate queue16:19
blogananteaya: could have sworn reverify worked in the past but doesn't now16:19
anteayablogan: it has to pass check to pass gate16:19
blogananteaya: ahh okay, thanks16:19
anteayablogan: correct, reverify was removed16:19
anteayablogan: if you are a core reviewer you can reapply +1 workflow16:20
jeblairShrews: you're on to something.  the two are definitely related; but the causality runs in the non-sinister direction.16:20
jeblair(which i guess means it runs to the right)16:20
blogananteaya: i did that, but still didn't kick them off, ill do a recheck though16:20
anteayablogan: which patch?16:20
bloganhttps://review.openstack.org/#/c/253884/16:20
Shrewsjeblair: so, quick novice gertty question... is there a visual cue to see when a review is dependent on another review that needs to be rebased (i.e., outdated)?16:20
jesusaurusjeblair: the dexter direction?16:20
jeblairShrews: yes, it will say [OUTDATED] in the 'depends-on' area16:21
jeblair(just like oldscreen gerrit)16:21
jeblairjesusaurus: that's the one!16:21
openstackgerritgordon chung proposed openstack-infra/project-config: fix stable/liberty telemetry integration job  https://review.openstack.org/25864216:21
blogananteaya: so on that review, a recheck was posted on the 19th, but the last time the gate jobs ran was the 17th16:22
anteayablogan: I see that16:22
openstackgerritJames E. Blair proposed openstack/gertty: Fix config validation to accept new keymap format  https://review.openstack.org/25925316:23
openstackgerritJames E. Blair proposed openstack/gertty: Fix multi-key handling at top level  https://review.openstack.org/26008416:23
openstackgerritJames E. Blair proposed openstack/gertty: Cache counts of project changes  https://review.openstack.org/26008516:23
anteayablogan: yes kevinbenton posted a recheck on the 19th that returned successfuly and should have put that patch in the gate queue, but that didn't seem to happen16:23
anteayablogan: I'm perplexed16:23
blogananteaya: me too :)16:24
mordredjeblair: can I get gertty to prioritize download changes for the project I'm looking at?16:24
jeblairmordred: if you hit ctrl-r it will do that16:24
jeblairmordred: i have 'make that happen automatically when it makes sense' on my todo list16:24
*** harlowja_at_home has quit IRC16:24
jeblairoh16:24
jeblairsorry16:24
blogananteaya: last resort will be to just push up another patchset and lobby for those +2s again16:25
anteayablogan: stand by16:25
jeblairmordred: i misread that as 'the change i'm looking at', not the 'project i'm looking at'16:25
blogananteaya: unless yall want to troubleshoot it16:25
blogananteaya: sure thing16:25
jeblairmordred: 1 sec16:25
anteayacan any infra-root not currently addressing gerrit/gertty interfaces take a peek at the history of https://review.openstack.org/#/c/253884/16:25
anteayaneither blogan nor myself can figure out why it refuses to enter the gate16:26
fungianteaya: blogan: recheck on a change which already has a jenkins +1 doesn't enqueue into the gate. gerrit doesn't emit a vote change event when replacing a +1 with a +116:26
fungineeds a new workflow +1 added instead16:26
jeblairmordred: okay, yes, ctrl-r in a list of changes for a project will already do a high-priority sync for that project.16:26
clarkbin this case it is the depends on16:26
mordredcool16:26
bloganfungi: i did that last night htough16:26
anteayafungi: blogan did so and I still don't see it in the status page16:26
bloganfungi: and it didn't enter the gate16:26
clarkbfungi anteaya blogan ^16:26
anteayaclarkb: thanks16:26
mordredhttps://review.openstack.org/#/q/I940b541f4ef9c489126cd2d215b1d857f0624de0,n,z16:26
fungianteaya: blogan: which can also be accomplished by the person who posted the previous workflow +1 removing and readding it16:26
jeblairmordred: (but if you're looking at a query that just happens to be for one project, it's not smart enough to figure that one out so it will sync all subscribed projects in that case)16:26
bloganoh that depends-on bc of the backports!16:27
fungianteaya: blogan: yes, what clarkb said16:27
blogangood catch clarkb i remember that happening16:27
jeblairmordred: (but the 'hit enter on a project in the project list case' -- that's handled)16:27
fungithat will also keep it from getting enqueued16:27
mordredjeblair: nah, single project was fine16:27
anteayablogan: that depends on points to 3 different patches: https://review.openstack.org/#/q/I940b541f4ef9c489126cd2d215b1d857f0624de0,n,z16:27
*** mpavone has quit IRC16:27
anteayablogan: that is a poor choice for a depends-on workflow16:27
blogananteaya: yeah, since the one got merged into master i can remove this depends-on16:27
anteayaclarkb: sorry, I missed that16:27
blogananteaya: i didnt add the backport ones, just the one to master16:28
anteayablogan: in future don't put a depends-on that links to 3 different patches16:28
anteayablogan: well socialize a solution then, but zuul will take you literally if you state you depend on 3 different patches16:28
*** stevemar_znc is now known as stevemar16:28
blogananteaya: i didn't, i think some person(s) forgot to remove the depends-on when doing a cherry-pick to16:28
anteayano the cherry picks use the same change id16:29
blogananteaya: will do, thanks again16:29
anteayaclarkb fungi thanks16:29
blogananteaya: thats what i mean sorry, so in that case what would the proper workflow be? generate a new change-idf or the backports?16:29
anteayato be honest I don't know16:30
fungithe zuul behavior with regard to change ids on multiple branches is at odds with the backport workflow duplicating change ids on other branches16:31
fungiespecially if you end up with one of them getting abandoned. then you can never merge the depending-on change without removing the depends-on from its commit message first16:31
fungiso easiest solution for now is to just remove the depends-on from the commit message and then reapprove the change once the update passes jobs16:32
jesusaurusfungi: i wrote up 254957 to address exactly that16:32
bloganfungi: yeah thats what i figured would be the solution for now16:32
openstackgerritBrant Knudson proposed openstack-infra/project-config: Change postgres job to use standard deployment  https://review.openstack.org/25800616:33
fungijesusaurus: we've discussed and dismissed that behavior change in the past16:33
jesusaurusfungi: oh, i missed that discussion16:33
fungijesusaurus: it averts a disaster where my change depends on some functionality in your change, and then your change gets abandoned and someone blindly approves mine16:33
*** ifarkas has quit IRC16:34
*** yamamoto has joined #openstack-infra16:34
fungiif zuul were free to ignore abandoned changes, then once it merges my change *boom*16:34
jesusaurusi see16:34
blogananteaya, fungi, clarkb: thanks for the help and information16:34
jeblairShrews, mordred: if you were considering firing up gertty, gimme a sec to fix some things i noticed over the weekend16:34
fungiadmittedly this is partly because depends-on encodes two behaviors: 1. don't merge change B until A merges, 2. if possible test change B with change A applied16:35
fungijesusaurus: so your change is an attempt to solve for behavior 2, while missing the safeguard it provided for behavior 116:35
anteayablogan: thanks for your patience and understanding16:36
bloganfungi, jesusaurus: what if it checked only for the same branch? which would solve the problem i've run into?16:36
*** reed has quit IRC16:36
*** reed has joined #openstack-infra16:36
openstackgerritMonty Taylor proposed openstack-infra/shade: Fall back to nova on 404s from glance  https://review.openstack.org/26008716:36
fungijeblair: i've been using 1.3.0 since friday, albeit lightly. i'll upgrade once you have tagged16:36
*** zeih has joined #openstack-infra16:36
openstackgerritMonty Taylor proposed openstack-infra/shade: Fall back to nova on 404s from glance  https://review.openstack.org/26008716:37
mordredjeblair, Shrews: ^^ this patch makes me sad16:37
*** gyee has joined #openstack-infra16:37
fungiblogan: depends-on is intended to support dependencies for upgrade tests as well, so for example we can post a kilo change that grenade needs in place to be able to merge some change on liberty16:37
mordredjeblair, Shrews: I cannot explain WHY I'm getting 404s on hpcloud16:37
mordredit's on ly HP16:37
mordredand it's not broken in the command line client16:37
fungiblogan: so cross-branch dependencies were an intentional part of the design16:37
bloganfungi: ah yeah, i understand the issue there now16:37
*** flepied1 has quit IRC16:38
*** yamamoto has quit IRC16:38
*** flepied has joined #openstack-infra16:38
blogantough one to solve, this probably happens so infrequently that its not too big of a deal16:38
*** EricGonczer_ has joined #openstack-infra16:38
anteayanow that bots are back up, here is the paste of the third-party meeting earlier: http://paste.openstack.org/show/482421/16:39
*** f1ller is now known as filler16:41
*** jpr has quit IRC16:41
*** markvoelker has joined #openstack-infra16:43
*** maishsk has joined #openstack-infra16:44
notmorganmordred: weird only in the CLI?16:44
openstackgerritMonty Taylor proposed openstack/requirements: Bump os-client-config constraint  https://review.openstack.org/26009216:45
mordrednotmorgan: no, CLI works. shade list_images() does not16:45
*** dimtruck is now known as zz_dimtruck16:45
mordrednotmorgan: also, I cannot for the life of me figure out how to get the glanceclient debug output to print when I'm consuming through shade16:45
openstackgerritmathieu bultel proposed openstack-infra/shade: Add normalize stack function for heat stack_list  https://review.openstack.org/25433716:46
*** apuimedo has quit IRC16:46
*** apuimedo_ has quit IRC16:47
openstackgerritJames E. Blair proposed openstack/gertty: Fix multi-key handling at top level  https://review.openstack.org/26008416:47
openstackgerritJames E. Blair proposed openstack/gertty: Fix config validation to accept new keymap format  https://review.openstack.org/25925316:47
openstackgerritJames E. Blair proposed openstack/gertty: Support >= 2.9 query batching  https://review.openstack.org/25970516:47
openstackgerritJaume Devesa proposed openstack-infra/project-config: Add puppet-midonet to OpenStack infrastructure  https://review.openstack.org/26009316:47
*** apuimedo has joined #openstack-infra16:47
*** flepied has quit IRC16:47
*** apuimedo_ has joined #openstack-infra16:48
*** flepied has joined #openstack-infra16:48
anteayaIf anyone cares, I'm out on Wednesday until after Christmas, will be back next week16:48
*** markvoelker has quit IRC16:48
*** hurgleburgler has joined #openstack-infra16:48
jeblairanteaya: thanks, enjoy!16:48
openstackgerritJaume Devesa proposed openstack-infra/project-config: Add fuel-plugin-midonet notifications at #midonet  https://review.openstack.org/26009416:49
anteayajeblair: thanks16:49
*** flepied has quit IRC16:49
anteayastill here until Wednesday just sharing16:49
*** vgridnev has joined #openstack-infra16:50
Shrewsmordred: weird16:51
mordredwoot. I figured out http tracing via shade16:51
jeblairoh! mrunge found and fixed a long standing bug in 259992 i think16:51
krotscheckjeblair: I have a new update from the npm mirror team, they're basically saying "You need a TB".16:52
mordredShrews: REQ: curl -g -i -X GET https://region-b.geo-1.images.hpcloudsvc.com:443/v1.0/v2/images?limit=100016:52
mordredthat would be it16:52
*** ihrachys has quit IRC16:52
mordredShrews, notmorgan: bug in that os-client-config pass version patch I think16:52
anteayakrotscheck: that presents a challenge16:52
openstackgerritDiana Whitten proposed openstack-infra/project-config: Add openstack-ux repo  https://review.openstack.org/25923916:53
Shrewsmordred: is that due to the occ change that just merged?16:54
jeblairkrotscheck: neat.  we have a couple hundred mb.  so i think we need someone to a) figure out if we can get 1.5tb+ on each of our providers; b) see if we can use afs; c) look into some other gfs; or d) pivot to a caching proxy strategy rather than mirrors.16:54
mordredShrews: yah. working on a fix now16:54
Shrewsmordred: and a test, i'm sure  ;)16:54
*** apuimedo has quit IRC16:54
krotscheckjeblair: Or e) Write an opportunistic mirror.16:54
jeblairmordred, fungi, clarkb, greghaynes: see my conv w/ krotscheck16:54
jeblairkrotscheck: ya16:54
*** apuimedo_ has quit IRC16:54
*** armax has joined #openstack-infra16:55
*** apuimedo has joined #openstack-infra16:55
*** apuimedo_ has joined #openstack-infra16:56
krotscheckjeblair: Caching Proxy is basically an opportunistic mirror.16:56
krotscheckAnd it sanely handles the weirdness of "Some of our mirrors are normal mirrors and some we build ourselves (wheel)"16:56
jeblairkrotscheck: with the advantage of being content agnostic16:56
jeblairi guess wheel building would fit in there by us running a single "real" wheel mirror and then just accesing it through the proxy like anything else.16:57
krotscheckYep16:57
mordredjeblair: wow16:57
krotscheckSo, would we prefer a swift thing or building our own thing?16:57
*** zeih has quit IRC16:58
hasharare you talking about caching wheels ?16:58
jeblairkrotscheck: not following that one?16:58
krotscheckjeblair: We can configure swift to basically be a CDN no? Or we can build a server to be a CDN.16:58
* krotscheck may have that wrong16:58
krotscheckhashar: Yes16:58
mordredkrotscheck: unfortunately, we need per-cloud-region things- so I think swift would be extra complex16:59
jeblairkrotscheck: oh, i think that's "rax public access to swift is via cdn".  i think generic cdn is a separate non-openstack service.16:59
mordredkrotscheck: putting things in rax swift will not help our nodes in ovh in terms of not hitting internets16:59
mordredfor instance16:59
*** abregman has quit IRC17:00
mordredkrotscheck: does the npm format allow for filesystem storae? or does it need 1TB of contiguous block?17:00
krotscheckmordred: Ok, so apache's mod_disk_cache?17:00
jeblairmordred: ah i think i see where krotscheck is going -- if we build a mirror in swift, and publish it via cdn, we will have brought the mirror very close to ovh by virtue of the cdn17:01
jeblairhowever, it's still ovh-external traffic17:01
mordredyah. and it has the downside of not being able to do atomic updates17:01
hasharI myself looked at several possibilities to cache packages from various package managers. It is rather messy.17:01
jeblairso network traffic wise, not as optimal as us having something inside each provider17:01
jeblairmordred, krotscheck: or squid17:01
krotscheckmordred: The NPM Mirror tries to simulate a couchdb in the filesystem.17:02
hasharI looked at Squid with SSL interception (ssl-bump feature).  Wrote my findings at https://phabricator.wikimedia.org/T11601517:02
mordredjeblair: isn't there a problem with caching ... yeah, that ^^17:02
hasharfor python there is devpi that is rather straightforward to setup  ( evaluated at https://phabricator.wikimedia.org/T114871 )17:03
mordredoh golly no17:03
hasharhehe17:03
mordreddevpi is way not a production service17:03
krotscheckmordred: And, well, those documents in couchdb point at CDN locations that npm itself manages. Those docs have to be rewritten on disk before they can find the package.17:03
* krotscheck ponders squid.17:04
mordredkrotscheck: so part of our mirroring code would need to rewrite the documents as we store them, yeah?17:04
krotscheckmordred: Yep. There's a program out there called "registry-static" taht does this for us.17:04
hasharArtifactory does have support for npm/pip/gem caching  but it is not included in the open source solution (though the code is free apparently)17:04
krotscheckAnd it's maintained by the yahoo people.17:04
mordredjeblair, krotscheck: I'd kind of love to make an earnest stab at AFS mirror17:04
mordredkrotscheck: neat!17:05
jeblairmordred: i'm game17:05
krotscheckmordred: But that requires 1TB of disk.17:05
mordredkrotscheck: not 1TB on a single server17:05
jeblairmordred: the infrastructure is basically ready to go17:05
krotscheckmordred: True.17:05
openstackgerritMerged openstack-infra/jenkins-job-builder: Implement bzr SCM module.  https://review.openstack.org/23436517:05
mordredand we can get atomic updates for our things that need it17:05
krotscheckmordred, jeblair: Well, since we're creating brand new mirror boxes anyway...17:05
*** _nadya_ has quit IRC17:06
hasharkrotscheck: a problem with squid / http caches, is that  they will not cache compiled modules which might needed if you want to speed up install17:06
fungiyeah, content-agnostic proxies actually create new problems with package managers17:06
zaromorning17:06
jeblairkrotscheck: afs lets us have a single instance of the mirror on one arbitrarily large filesystem (which can be spread across many servers), then we put mirror nodes in each provider which are simply afs clients with a large local cache17:06
fungibecause they're not aware of the holistic state of what's getting cached17:06
*** hdd has joined #openstack-infra17:06
krotscheckjeblair: mirror master and afs client, right.17:07
jeblairkrotscheck: as the local cache warms up, the local afs client mirror-serving host converges to "serve the subset of files we are interested in from local disk" automatically17:07
*** ZZelle has joined #openstack-infra17:07
fungifor example, apt has several smart proxy implementations available that deal with those consistency issues for cached access to apt package repositories17:07
jeblairanything it doesn't have in its local cache, it fetches over the internet from the afs server17:07
mordredbut - it does so in a resilent way that assumes the internet will break :)17:07
krotscheckjeblair: The main issue that would cause with npm is that the URL rewrite to http:/mirror-master/foo.tgz would need to be different for each afs client.17:07
openstackgerritChristopher Aedo proposed openstack-infra/project-config: Fixing app-catalog dead-link checker  https://review.openstack.org/26011517:08
mordredkrotscheck: can it do file urls?17:08
*** notnownikki has quit IRC17:08
mordredkrotscheck: or do they have to be http?17:08
*** devananda has quit IRC17:08
krotscheckmordred: Lemme check.17:08
jeblairkrotscheck: when i was looking into afs for pypi mirroring, i did some mod-rewrite magic17:08
jeblairmordred: you're thinking of having the test nodes fetch from afs?17:09
krotscheckjeblair: whoa, mod-rewrite can parse json?17:09
jeblairkrotscheck: no17:09
krotscheckoh.17:09
openstackgerritJaume Devesa proposed openstack-infra/project-config: Add fuel-plugin-midonet notifications at #midonet  https://review.openstack.org/26009417:09
krotscheckyou had my hopes up!17:09
jeblairwell, i mean, maybe17:09
mordredkrotscheck: if they can do file, we can rewrite the docuemnts to contain file:///afs/openstack.org/mirror/npm/foo17:09
jeblairkrotscheck: i don't understand the rewriting problem yet, just throwing that out there in case it makes sense17:09
krotscheckmordred: Would that actually provide a performance improvement?17:10
mordredwhich doesn't work well for pip, becuase pip deal poorly witih file urls17:10
mordredkrotscheck: not really - but it would fix the url-in-json-document problem17:10
jeblairmordred: again -- that's for having our actual test nodes use afs -- is that what you want to do?17:10
krotscheckjeblair: Right. a package might be index.json -> { things, more things, package: 'https://location/foo.version.tgz'}17:10
jeblairkrotscheck: and in "package: <location>", <location> must be an absolute rather than relative url?17:11
mordredjeblair: well, aiui, the above ^^ says that the files we store on disk in the mirror may contain explcit urls, rather than relative paths17:11
krotscheckjeblair: I _think_ yes.17:11
krotscheckjeblair: I can test that17:11
krotscheckjeblair: But I believe that it does, because the index.json is downloaded to "Wherever the npm command is invoked", which may not know the registry context.17:11
jeblairkrotscheck: oh, then there's a separate invocation to actuall get the thing and it's lost the context of the original index download?17:12
anteayamorning zaro17:13
krotscheckjeblair: I'm not certain. Will have to rebuild a mirror with the new puppet modules to test.17:13
hasharkrotscheck: for npm, I am pretty sure you also need to rewrite urls in the package.json files17:13
krotscheckhashar: Probably.17:13
*** maishsk has quit IRC17:13
hasharkrotscheck: cause the ones coming from npmjs.org would have hardcoded npmjs.org url in their json payload :(17:13
*** maishsk has joined #openstack-infra17:14
jeblairkrotscheck, mordred: so assuming that's the case, we can solve it either with mordred's idea of using file urls (which means afs clients on all our test nodes), or we could solve it by having a different _index_ for each mirror so it can have different urls, but still having a single set of packages.  depending on the exact directory structure, there are some afs tricks we can do to make that easier.  failing those, we can have mod_rewrite17:14
hasharkrotscheck: one of Jfrog Artifactory / Sonatype Nexus have plugins that handles the rewrite for you.  Aka an "intelligent" proxy/cache17:14
*** devananda has joined #openstack-infra17:15
notmorganmordred: fwiw, we probably need to bump the min-req on OCC as well for novalicent.17:15
krotscheckhashar: Yeah, but those are $$ and not happily licensed.17:15
notmorganmordred: not just the upper constraint17:15
openstackgerritRandall Burt proposed openstack-infra/elastic-recheck: Add query for bug 1527483  https://review.openstack.org/26011917:15
openstackbug 1527483 in neutron "VPNaaS - No providers specified for 'VPN' service" [Critical,Confirmed] https://launchpad.net/bugs/1527483 - Assigned to Martin Hickey (martin-hickey)17:15
hasharkrotscheck: maybe the plugins are actually open source but just disabled via a feature flag :-D  (not sure whether it will breach their license though)17:16
krotscheckjeblair, mordred: Is there a compelling other reason to add an AFS client to our nodes? It seems a bit... heavy handed.17:16
*** woodster_ has quit IRC17:16
mordredkrotscheck, jeblair: new idea17:17
*** rlandy has quit IRC17:17
mordredwe use the ready script to write an entry into /etc/hosts that points to a per-region IP of a server that's running Apache on AFS17:17
mordredand we rewrite the node documents to refer to that hostname17:17
jeblairkrotscheck: if we did that, we could concievably drop mirrors altogether, however, warming the afs cache on each test node would be difficult.  i agree, i think it's not our best option.17:17
mordredso that the docuemnts can be served17:17
hasharanother idea we had is that when a change merge, we run a job that install the dependencies, save the package managers caches and send them to an object store like swift.  Namespaced by repo/branch.   Then jobs can grab that central cache to warm up the instance.17:17
mordredhashar: we still don't have a swift per region though17:18
jeblairmordred: i'm usually not excited about ideas that involve writing to /etc/hosts, but that actually sounds like a not terrible use of that17:18
mordredjeblair: in this case, I _think_ it would solve the problem17:18
mordredwhich is that we have some physical needs to put an identical thing in each region17:18
krotscheckmordred, jeblair: Would that cause issues with known_hosts?17:18
jeblairyeah, basically, npm wants to know what "the mirror" is, and we'll tell it "the mirror".. just differently for each region.17:19
mordredkrotscheck: it shouldn't - becaues we'd pick a fake hostname that we'd only use for http17:19
jeblairi mean, if we had a more sophisticated dns system, we could do geolocal dns17:19
krotscheckOk, that should be doable.17:19
*** piet has quit IRC17:19
mordred"mirror.local" or something17:19
jeblairwhich is a perfectly respectable thing to do and functionally equivalent to this :)17:19
jeblairi like it if we can get it past fungi :)17:19
mordredfungi: ?17:20
krotscheckjeblair: This NPM mirror effort of mine is becoming a VERY hairy yak ;)17:20
*** _nadya_ has joined #openstack-infra17:20
notmorganjeblair: i would advocate dns but...17:20
mordredkrotscheck: but it's kind of become a fun on17:20
mordredone17:20
jeblairkrotscheck: i like that "pivot" has positive connotations.17:20
*** maishsk has quit IRC17:20
mordredShrews: ok. found the occ problem17:21
mordredShrews: it actualy was not in the version patch17:21
Shrews\o/17:21
fungijeblair: mordred: you know what a luddite i am. this reminds me of the global hosts file from the pre-dns days ;)17:22
mordredShrews: you're not going to like the patch that  solves it :) /me glares at glance for being different17:22
fungii think it's not a terrible idea now for the same reasons it wasn't a terrible idea then17:22
fungidns came about once the global hosts file had hundreds of entries being kept in sync via ftp from many hundreds of sites17:22
fungiit scaled pretty well below that17:22
anteayafungi: yes luddite is the word that comes to mind when I think of you17:23
*** mudassirlatif has joined #openstack-infra17:23
*** sfinucan has quit IRC17:24
* krotscheck has a bind9 ansible playbook around here somewhere....17:24
fungikrotscheck: i mostly just don't want to see the npm yak shave stop us from finishing the wheel building mirror work, which will have a huge positive impact on most of the jobs we run17:24
* anteaya picks up her stone hammer17:24
*** hashar has quit IRC17:24
jeblairfungi: whew, thanks for clarifying; i wasn't sure how many layers of sarcasm and irony i was seing in your initial response :)17:24
krotscheckfungi: It's easy enough to peel those apart, they're on separate branches.17:24
jeblairturns out it was just my own reflection17:24
fungihah17:25
krotscheckfungi: If we can start with this, and only this patch, we can focus on the wheel things for a bit.17:26
krotscheckhttps://review.openstack.org/#/c/253236/17:26
docaedoAny change I could get a quick look at https://review.openstack.org/260115 ? It's a one line change that fixes an experimental test that merged this morning (SHOULD fix it anyway)17:26
krotscheck(The followup patch is the one where we actually have to make servers)17:26
fungikrotscheck: awesome, i'll stick that on my priority pile now17:27
*** piet has joined #openstack-infra17:27
krotscheckfungi: Thanks :)17:28
*** apuimedo has quit IRC17:28
openstackgerritJames E. Blair proposed openstack/gertty: Add process mark to project list  https://review.openstack.org/25970117:28
openstackgerritJames E. Blair proposed openstack/gertty: Add project topics  https://review.openstack.org/25967117:28
openstackgerritJames E. Blair proposed openstack/gertty: Cache counts of project changes  https://review.openstack.org/26008517:28
openstackgerritJames E. Blair proposed openstack/gertty: Fix multi-key handling in diff view  https://review.openstack.org/26012317:28
*** apuimedo_ has quit IRC17:28
openstackgerritJames E. Blair proposed openstack/gertty: Fix list index out of range  https://review.openstack.org/25999217:29
openstackgerritJames E. Blair proposed openstack/gertty: Fix multi-key handling in diff view  https://review.openstack.org/26012317:29
jeblair(yeah, i'm using gertty to stack up commits into different branches)17:30
*** fawadkhaliq has quit IRC17:30
EmilienMhow can we merge two patches that Depends-On each others (if possible)? (note that they only pass unit/functional tests with that Depends-On)17:30
*** apuimedo has joined #openstack-infra17:30
fungiEmilienM: presumably only one needs to depends-on the other?17:30
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder: Add support for credentials properties in authorization matrix  https://review.openstack.org/19954717:30
*** apuimedo_ has joined #openstack-infra17:30
*** AJaeger has joined #openstack-infra17:30
EmilienMfungi: I have a chicken&egg issue17:30
jeblairmordred, Shrews: this is how i use gertty to understand patch series: http://paste.openstack.org/show/482434/17:31
EmilienMI'll need to land one first17:31
*** hashar has joined #openstack-infra17:31
fungiEmilienM: two patches should not interdepend. that breaks continuous deployment assumptions. is it possible that if it's staged into three or four changes it can be implemented incrementally and asynchronously instead?17:31
krotscheckjeblair: So... we're now doing AFS mirrors and geolocal dns?17:31
jeblairmordred, Shrews: would it help if that view also indicated whether something is outdated?17:31
EmilienMfungi: yes it can17:32
EmilienMfungi: if I touch to unit testing17:32
jeblairkrotscheck: it seems among our better options.  since we have an afs cell, we should probably do some quick informal testing with npm17:32
fungiEmilienM: zuul assumes all changes are serialized when gating, so if your changes have to be introduced in lock-step it can't actually test at least one of them17:32
jeblairkrotscheck: just to make sure there isn't a showstopper17:32
EmilienMfungi: ok, I see17:32
EmilienMfungi: I'll split commit in commits17:32
openstackgerritSean M. Collins proposed openstack-infra/devstack-gate: Stop hard coding SERVICE_HOST  https://review.openstack.org/22911117:33
krotscheckjeblair: Works for me. Is this a thing you'd like me to do, or someone else?17:33
jeblairkrotscheck: maybe we could write an index file and drop a couple packages in afs, and then serve that through apache and try installing some things that way17:33
jeblairkrotscheck: you up for installing a local afs client?17:33
krotscheckjeblair: I can try!17:33
fungiEmilienM: what i've seen in similar past situations is that it also makes reviewing easier, because you are clearly calling out the order in which things change17:33
krotscheckjeblair: Not today though17:33
*** unicell1 has quit IRC17:33
jeblairkrotscheck: i think we even have instructions17:33
jeblairkrotscheck: http://docs.openstack.org/infra/system-config/afs.html#client-configuration17:34
jeblairkrotscheck: so we could make a principal for you and give you full access to a volume, and then you can probably do most of the work from there17:34
mordred++17:34
krotscheckjeblair: That sounds like authority.17:35
*** apoorvad has joined #openstack-infra17:35
* krotscheck is allergic to authority17:35
mordreddistributed kerberized filesystems fwi17:35
mordredftw17:35
jeblairmordred: fyi its ftw17:35
mordredkrotscheck: nah. just write access to a volume in our AFS cell17:35
krotscheckOh good.17:35
mordredkrotscheck: so that you can write files to it17:35
mordredkrotscheck: without needing one of us to do something17:35
notmorganmordred: amazing when technology works17:35
mordrednotmorgan: inorite?17:35
jeblairi'll make the principal and volume now while i'm thinking about it17:35
*** otter768 has joined #openstack-infra17:35
krotscheckSo I could run a registry-mirroring script for a few cycles, write into that cell with the appropriate settings, and then see if I can install from there.17:36
anteayajeblair: pretty17:36
mordredkrotscheck: yes. I think that's a great idea - can you do that on a small subset of packages?17:36
krotscheckmordred: I can. There's a "Just run this for one package" setting.17:36
mordredneat!17:36
mordredthat sounds like a stellar test17:36
jeblairkrotscheck: username krotscheck?17:37
krotscheckjeblair: Works for me.17:37
*** maishsk has joined #openstack-infra17:37
* krotscheck feels like he's in college again :)17:38
mordredkrotscheck: it's out main goal most days17:38
mordredkrotscheck: "make these computers work almost as well as the ones from college"17:38
krotscheckmmmmmspark17:38
mordreds/out/our/17:38
*** BobBall is now known as BobBall_AWOL17:39
mordrednotmorgan, Shrews: https://review.openstack.org/26012617:39
mordrednotmorgan, Shrews: need to add tests - just wanted you to see the thing17:39
*** otter768 has quit IRC17:40
krotscheckmordred, jeblair: While I'm at it, I'll go ahead and create a different server with a public IP and an apache vhost.17:40
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add krotscheck to users  https://review.openstack.org/26012917:41
jeblairmordred, fungi: ^ instapprove to get the uid reservation?17:41
mordredjeblair, fungi: +217:42
*** zeih has joined #openstack-infra17:42
jeblairkrotscheck: different server for what?17:42
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Add krotscheck to users  https://review.openstack.org/26012917:43
*** admin0 has joined #openstack-infra17:43
* krotscheck fixed a typo ^^17:43
krotscheckjeblair: One to run the mirror script on. One to run apache. Full test of transfer to a 'remote' mirror server.17:43
*** maishsk has quit IRC17:44
fungii need to go run some lunch errands, back in a little while17:44
krotscheckAFK as well, back in 2017:44
*** markvoelker has joined #openstack-infra17:44
jeblairkrotscheck: (sorry for the typo, i blame this chiclet keyboard)17:44
*** yaume has quit IRC17:44
*** admin0 has quit IRC17:46
*** zz_dimtruck is now known as dimtruck17:46
*** maishsk has joined #openstack-infra17:46
bkeroAlways blame chiclet keyboard17:47
*** e0ne has quit IRC17:49
nibalizerasselin__: fungi likely we can land that patch but pabelanger_ is doing work to have us simply use the apache module17:49
*** markvoelker has quit IRC17:49
*** jpr has joined #openstack-infra17:49
*** apuimedo has quit IRC17:50
*** ayoung has quit IRC17:51
*** amuller is now known as amuller_afk17:51
*** gyee has quit IRC17:51
*** apuimedo has joined #openstack-infra17:53
*** maishsk has quit IRC17:53
michaelxinThanks for your help all the time. I have two CR: https://review.openstack.org/#/c/260120/ and https://review.openstack.org/#/c/260099/ Both are in the stage of "Needs Verified". But Jenkins already +1 both. Any idea why? Thanks.17:53
*** apuimedo_ has quit IRC17:54
openstackgerritMerged openstack/gertty: Fix config validation to accept new keymap format  https://review.openstack.org/25925317:54
*** hashar has quit IRC17:54
*** maishsk has joined #openstack-infra17:54
*** apuimedo_ has joined #openstack-infra17:54
*** ZZelle has quit IRC17:54
asselinnibalizer, if pabelanger_ change won't happen soon, we just merge this one and switch to apache module from there.17:55
openstackgerritJames E. Blair proposed openstack/gertty: Fix multi-key handling at top level  https://review.openstack.org/26008417:56
openstackgerritMerged openstack/gertty: Fix multi-key handling at top level  https://review.openstack.org/26008417:56
jrollmichaelxin: those patches depend on each other17:57
openstackgerritMerged openstack-infra/system-config: Add krotscheck to users  https://review.openstack.org/26012917:57
*** smarcet1981 has quit IRC17:57
michaelxinjroll: How to fix it? Thanks.17:57
Shrewsjeblair: I would LOVE for that view to show outdated somehow17:57
jrollmichaelxin: you have the first patch dependent on the second via depends-on, and the second dependent on the first because they were submitted together in that order17:57
jrollmichaelxin: you need to remove the depends-on there17:57
jeblairShrews: cool, i bet it won't be too hard17:58
michaelxinjroll: Got it. Thanks.17:59
jrollnp17:59
*** apuimedo_ has quit IRC17:59
*** Swami has joined #openstack-infra18:00
*** salv-orl_ has joined #openstack-infra18:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Add option to enable HTTP tracing  https://review.openstack.org/26013418:00
jeblairShrews, mordred: were you having a problem with zuul enqueing changes?18:00
*** apuimedo_ has joined #openstack-infra18:00
mordredjeblair: not to my knowledge18:00
mordredShrews, notmorgan: ^^ that's the easy way to get http trace logging when hacking with shade18:01
jeblairok, wasn't sure if your troubles with dependent changes extended to that18:01
mordrednah. it was just UI not being able to figure out what the hell was going on18:01
*** eharney has quit IRC18:01
jeblairi am, and i suspect it's another manifestation of the change caching thing that hopefully that patch from jhesketh fixes18:01
mordrednotmorgan, Shrews: https://review.openstack.org/260126 fixes the glance issue with HP and adds more tests18:01
openstackgerritJames E. Blair proposed openstack/gertty: Support >= 2.9 query batching  https://review.openstack.org/25970518:01
openstackgerritTravis McPeak proposed openstack-infra/project-config: Adding voting Bandit on Bandit gate  https://review.openstack.org/26013518:02
openstackgerritMerged openstack/gertty: Support >= 2.9 query batching  https://review.openstack.org/25970518:02
openstackgerritJames E. Blair proposed openstack/gertty: Fix multi-key handling in diff view  https://review.openstack.org/26012318:02
*** apuimedo has quit IRC18:02
*** zeih has quit IRC18:02
openstackgerritJames E. Blair proposed openstack/gertty: Fix list index out of range  https://review.openstack.org/25999218:02
openstackgerritMerged openstack/gertty: Fix multi-key handling in diff view  https://review.openstack.org/26012318:02
*** hurgleburgler has quit IRC18:03
openstackgerritMerged openstack/gertty: Fix list index out of range  https://review.openstack.org/25999218:03
*** apuimedo has joined #openstack-infra18:03
*** salv-orlando has quit IRC18:03
notmorganmordred: going to need to bug someone about shade functional tests against a live cloud (if there is a good doc on it). Seems wierd.18:03
*** jsavak has joined #openstack-infra18:03
openstackgerritJames E. Blair proposed openstack/gertty: Add process mark to project list  https://review.openstack.org/25970118:03
openstackgerritJames E. Blair proposed openstack/gertty: Add project topics  https://review.openstack.org/25967118:03
openstackgerritJames E. Blair proposed openstack/gertty: Cache counts of project changes  https://review.openstack.org/26008518:03
jeblairmordred, fungi, Shrews: okay, gertty master should be much happier with gerrit 2.11.18:04
zarowas wondering if anybody here can help me setup a smtp (outgoing mail only) server?18:05
jeblairmordred, fungi, Shrews: or check out https://review.openstack.org/260085 for project topics if you are adventurous (it has a schema migration, so you may want to keep a db backup)18:05
EmilienMit would be useful if zuul UI could filter by Gerrit topic, what do you think?18:05
jeblairzaro: "apt-get install exim-daemon-light"18:05
mordredzaro: ++ ^^18:05
zarothanks, was trying to do with postfix but couldn't get it to work.18:06
*** dtantsur is now known as dtantsur|afk18:06
zarowill give exim-daemon-light a try18:07
*** apuimedo has quit IRC18:07
*** apuimedo_ has quit IRC18:07
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/25974118:07
*** jsavak has quit IRC18:07
*** otter768 has joined #openstack-infra18:08
notmorganmordred: so now occ only uses endpoint override, just if the user requests we populate the override instead of endpoint to avoid double version construction?18:08
*** yamahata has joined #openstack-infra18:08
*** jsavak has joined #openstack-infra18:08
*** apuimedo has joined #openstack-infra18:08
notmorganBases on your patch to fix glance.18:08
mordrednotmorgan: yah18:08
mordrednotmorgan: for glance that is18:08
notmorganNot a bad dodge18:08
*** pblaho has quit IRC18:08
*** apuimedo_ has joined #openstack-infra18:09
notmorganWill check it again when Jenkins finishes and I am done with coffee.18:09
notmorganBut it looks good at a first glance18:09
mordredcoolio. thanks18:09
mordredflaper87: if you are bored, you might want to look at https://review.openstack.org/26012618:10
anteayamy vlc media player is sporting a christmas hat18:11
anteayahow festive18:12
*** jsavak has quit IRC18:13
*** bastelfreak has joined #openstack-infra18:13
*** jerryz has joined #openstack-infra18:14
*** Guest95009 is now known as jgriffith18:15
anteayaEmilienM: by zuul UI do you mean http://status.openstack.org/zuul/18:15
EmilienManteaya: yes18:15
anteayathat's not a bad idea18:15
*** apuimedo has quit IRC18:15
anteayaI always forget where the code for that view lives18:15
* anteaya tries system-config18:16
*** apuimedo has joined #openstack-infra18:16
*** yamahata has quit IRC18:16
*** yamahata has joined #openstack-infra18:16
EmilienManteaya: somewhere around https://github.com/openstack-infra/zuul/blob/master/zuul/webapp.py18:17
AJaegerEmilienM: could you check https://review.openstack.org/#/c/260093/ , please? puppet-midonet repo...18:17
*** ayoung has joined #openstack-infra18:18
EmilienMAJaeger: ok18:18
EmilienMAJaeger: thx for highlight...18:18
openstackgerritMerged openstack-infra/system-config: Use httpd::mod instead of httpd_mod  https://review.openstack.org/25361918:18
anteayaEmilienM: I think this should tell you where all the files are that come together to make that page: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/status.pp#n16118:20
*** apuimedo has quit IRC18:20
*** apuimedo_ has quit IRC18:20
openstackgerritTravis McPeak proposed openstack-infra/project-config: Adding voting Bandit on Bandit gate  https://review.openstack.org/26013518:21
EmilienMAJaeger: done18:21
*** rossella_s has quit IRC18:21
AJaegerthanks, EmilienM !18:21
*** electrichead is now known as redrobot18:21
*** rossella_s has joined #openstack-infra18:22
*** apuimedo has joined #openstack-infra18:22
EmilienManteaya: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/zuul/status.js.erb18:22
*** gyee has joined #openstack-infra18:22
openstackgerritMerged openstack-infra/puppet-openstackci: Allow logserver to run on CI server (part 2)  https://review.openstack.org/25412818:22
*** apuimedo_ has joined #openstack-infra18:22
*** ZZelle has joined #openstack-infra18:22
anteayaEmilienM: wonderful18:22
EmilienManteaya: I wanted to make sure it's useful18:23
*** unicell has joined #openstack-infra18:23
*** Hal2 has joined #openstack-infra18:23
*** notnownikki has joined #openstack-infra18:23
*** smarcet has joined #openstack-infra18:24
*** tonytan4ever has quit IRC18:24
*** gyee has quit IRC18:25
*** Hal1 has quit IRC18:26
anteayaI would use it18:26
*** tzn has joined #openstack-infra18:26
*** apuimedo has quit IRC18:26
* anteaya is afk for a bit18:27
*** apuimedo_ has quit IRC18:27
*** apuimedo has joined #openstack-infra18:27
*** unicell has quit IRC18:27
*** apuimedo_ has joined #openstack-infra18:28
*** ZZelle has quit IRC18:29
*** maishsk has quit IRC18:30
*** jpr has quit IRC18:30
*** woodster_ has joined #openstack-infra18:30
*** apuimedo has quit IRC18:32
*** apuimedo_ has quit IRC18:32
krotscheckjeblair, mordred: There's already a mirror directory in this cell, shall I just add /mirror/npm?18:33
*** apuimedo has joined #openstack-infra18:33
*** unicell has joined #openstack-infra18:34
*** apuimedo_ has joined #openstack-infra18:34
krotscheckOh, I can't.18:34
krotscheckNevermind :)18:34
*** unicell has quit IRC18:34
*** unicell1 has joined #openstack-infra18:34
*** e0ne has joined #openstack-infra18:34
*** otter768 has quit IRC18:35
*** yamamoto has joined #openstack-infra18:37
*** hurgleburgler has joined #openstack-infra18:38
openstackgerritMerged openstack-infra/project-config: Fixing app-catalog dead-link checker  https://review.openstack.org/26011518:40
*** apuimedo has quit IRC18:40
*** apuimedo_ has quit IRC18:41
*** tmcpeak has joined #openstack-infra18:41
AJaegerhurgleburgler: Regarding openstack-ux: You stated that openstack-ux is an official project, correct?18:41
*** yamamoto has quit IRC18:42
*** apuimedo has joined #openstack-infra18:42
tmcpeakAJaeger: regarding your comment on #260135 - this is a different kind of Bandit gate and projects may want to use both.  This one is a baseline based on project changes, it runs a different script18:42
jeblairkrotscheck: i'll set up mirror/npm and give you perms there18:42
tmcpeakso it's a different tox env name on purpose18:42
*** apuimedo_ has joined #openstack-infra18:42
krotscheckjeblair: Cool, I'm almost ready to run this thing.18:42
mordredkrotscheck: woot18:42
krotscheckI'm going to use 'mirror.local' for now.18:43
AJaegertmcpeak: so, why not use bandit-baseline? Those two names are unrelated...18:43
tmcpeakAjaeger: we considered bandit baseline, but thought codesec sounded more intuitive in terms of a project that hasn't used Bandit before and will start with this18:43
hurgleburglerAJaeger It is an official project18:43
AJaegerhurgleburgler: I double checked governance repo and UX is indeed an official project, sorry for missing that before. So, you need to create a change for goverance repo which adds the nrew repo to the UX lists18:44
*** jyuso1 has joined #openstack-infra18:44
AJaegerAnd then your PTL has to +1 the changes.18:44
*** ZZelle has joined #openstack-infra18:44
AJaegerhurgleburgler: http://docs.openstack.org/infra/manual/creators.html#add-new-repository-to-the-governance-repository18:44
hurgleburglerAJaeger Gotcha, thanks for the direction!  I'll do that now18:45
AJaegerMkae the governance change Depends-On the project-config change and add as comment in project-config a link to the governance one18:45
AJaegerBut  that still leaves specs.openstack.org, do you really consider what you publish as specifications?18:45
AJaegerOtherwise you can publish on docs.openstack.org/developer/openstack-ux18:46
AJaegertmcpeak: would that other project need two targets? codesec and bandit? Or only either of these?18:47
tmcpeakAJaeger: most likely both18:47
tmcpeakthe original Bandit reports all issues, so it isn't as good for a gate but is still useful to have, the new one, codesec is what we're planning to use for a gate18:48
*** maishsk has joined #openstack-infra18:48
AJaegertmcpeak: that's confusing for me and might be for others. But let's look at something else first: bandit is a linting target, isn't it?18:49
*** jyuso1 has quit IRC18:50
tmcpeakAJaeger: how do you mean that?18:50
tmcpeak-linting-target18:51
AJaegerbandit does code-analysis, doesn't it?18:51
tmcpeakyep18:51
*** amuller_afk is now known as amuller18:51
AJaegerfound it - README has "security linter" ;)18:51
AJaegerwhy not add bandit target to the pep8 tox environment which is our usual "lint" environment?18:52
tmcpeakI'd like to have separate results for pep8 and Bandit18:52
AJaegerYou can add any number of commands to it...18:52
*** eharney has joined #openstack-infra18:52
*** rvasilets___ has joined #openstack-infra18:52
tmcpeakseparate reports, separate command line, everything18:52
*** maishsk has quit IRC18:52
*** gyee has joined #openstack-infra18:53
AJaegertmcpeak: if both are voting, it's expensive. The runtimes are short but for each we start a new virtual machine...18:53
tmcpeakohhh18:53
tmcpeakyeah, that is expensive18:53
tmcpeakis it possible to set both to run at the same time but keep output separate?18:53
*** apuimedo has quit IRC18:53
AJaegernot possible18:54
*** apuimedo_ has quit IRC18:54
tmcpeakAJaeger: hmm..  can I at least have them fail or pass independently?18:54
*** apuimedo has joined #openstack-infra18:54
AJaegerthat gets tricky, let me check something...18:55
tmcpeakAJaeger: thank you18:55
*** apuimedo_ has joined #openstack-infra18:55
notmorganmordred: +2 on your glance fix, but i think it means we need to get a larger integration test (betamax?) spun up for OCC18:56
mordrednotmorgan: agree18:56
mordrednotmorgan: because without testing against actual in-the-wild clouds, all of this is synthetic18:56
notmorganexactly18:56
notmorganthe KSA betamax thing landed, not sure if we've released since then.18:57
AJaegertmcpeak: I'm not seeing an obvious solution. Let's ask others.18:57
tmcpeakAJaeger: ok, thank you for checking18:57
AJaegermordred, fungi, clarkb : What do you propose here? Add bandit targets everywhere? Or have bandit run as part of pep8? And can we somehow show easily what fails?18:58
*** shardy is now known as shardy_afk18:58
mordredAJaeger: it's a good question18:58
*** piet has quit IRC18:58
*** tonytan4ever has joined #openstack-infra18:59
fungiAJaeger: giving tox multiple commands works (exits nonzero if at least one command exits nonzero) but can be a pain to track down in the console log since it doesn't short-circuit18:59
mordredAJaeger: part of me wants to say "add logic to run-pep8.sh to detect if bandit is there and if so run it- but it makes it hard for a project to add a non-voting bandit, then make it voting"18:59
notmorganfungi: ++18:59
*** piet has joined #openstack-infra18:59
notmorganfrom someone trying to debug out things such as bandit - i really don't like lumping more and more into the linting18:59
fungii wonder if bandit could easily be run as a flake8 plugin/extension?18:59
notmorganthis isn't strictly linting19:00
mordredso I think honestly just add bandit targets everywhere19:00
tmcpeaknotmorgan: that was kind of my feeling as well19:00
fungiyeah, the fact that it's not a linter makes the flake8 plugin path suboptimal19:00
mordredand we can deal with making it more efficient as part of zuul v3 / container execution possibilities19:00
pleia2sick family member care this morning, aroundish now, but kind of in and out19:00
AJaegerfungi, do you mean tox -e command1,command2 - that fails currently AFAIR19:00
notmorganAJaeger: it can work.19:00
fungipleia2: go focus on important family things, there's nothing urgent here19:00
mordredbut knowing that we _should_ run command1,command2 would be hard19:01
pleia2fungi: very useful summary, thank you19:01
AJaegerfungi: tox 2 short-circuits now19:01
fungioh? that's new, then19:01
AJaegerfungi: http://tox.readthedocs.org/en/latest/config.html#confval-ignore_errors=True|False%28default%2919:01
notmorganmordred: you can do it from within the tox.ini but ick.19:01
*** pvaneck has joined #openstack-infra19:01
fungiahh, it's configurable. good to know19:01
AJaegerfungi: and the default changed from tox 1 to tox 2 ;(19:01
fungioh, that's... interesting19:02
*** angdraug has joined #openstack-infra19:02
fungibut i guess it's a major version bump19:02
notmorgani would still say a "security" target might be better. - we can move all security things into it including bandit and force tooling around making it easy to detect the failures once you move beyond bandit only?19:02
fungiso anything's game19:02
notmorgani mean... it's more VMs. but it isn't a linter, and debugging things in multi commands is ick..19:02
notmorganunless you move bandit to being more of a linter  - then it can be flake8 included and that'd be, in my mind the right time to put it into pep8 test19:03
* notmorgan gets off soapbox19:03
mordredyah. I think we should do what's 'right'19:03
AJaegernotmorgan: read http://git.openstack.org/cgit/openstack/bandit/tree/README.rst#n419:03
fungiso anyway, i've either not seen or quickly dismissed the arguments against having a separate bandit job19:03
tmcpeakwhat's the distinction of linter/non-linter here?19:03
mordredand deal with optimization more systemically19:03
*** tonytan4ever has quit IRC19:03
AJaeger"A security linter from OpenStack Security"19:03
notmorganAJaeger: i am familiar with it19:04
tmcpeakthat might not be correct, we just call it that19:04
notmorganbut it's not "really" a linter right now.19:04
clarkbI have long said using the existing linting target is simplest19:04
notmorganit's somewhere between linter and other anaylsis19:04
clarkbbecause it exists wverywhere and people can opt in wirhout our review19:04
notmorganit could easily be swing back towards something that easily works as a flake8 plugin19:05
clarkband it is a linter as far as I know19:05
notmorganwhich would be a nice bonus since each of the catch types could be included/excluded in a familiar way19:05
*** weshay_pto has quit IRC19:05
notmorganif the bandit team is open to that19:05
*** changbl has joined #openstack-infra19:05
openstackgerritDiana Whitten proposed openstack-infra/project-config: Add openstack-ux repo  https://review.openstack.org/25923919:05
clarkbas a dev keeping track of a bunch of special targets is not fun19:06
clarkbespecially whe  you push to jenkins after running tox and something new fails19:06
notmorganwhich case linking to pep8 with that as the next step would be also acceptable19:06
clarkbbecause tox is misconfigured19:06
notmorganwith my dev hat on19:06
fungi[JARGON FILE] lint: A Unix C language processor which carries out more thorough checks on the code than is usual with C compilers. Lint is named after the bits of fluff it supposedly picks from programs. Judging by references on Usenet this term has become a shorthand for desk check at some non-Unix shops, even in languages other than C. Also used as delint.19:06
fungivague enough i'd be willing to argue that there's no clear reason to say bandit is not a "linter"19:07
AJaegerSo, should we take the christmas break and rename pep8 to lint and include bashate, bandit, etc in it?19:07
*** maishsk has joined #openstack-infra19:07
AJaeger(as tox environment I mean)19:07
tmcpeakso then will we get separate pass/fail or no?19:08
tmcpeakAJaeger: ^19:08
AJaegertmcpeak: no separate pass/fail, just a general: linting failed19:08
notmorgantmcpeak: it wouldn't be a separate fail - it would be a "pep8" job fail, but you can know which linter failed19:09
AJaegerlike today "pep8 failed"19:09
notmorganif you looked at the log19:09
tmcpeakAJaeger: ok so the idea is that means something in the linters isn't happy, which could be code style, security, etc as opposed to "something in the unit tests failed"19:09
AJaegertmcpeak: yes19:09
tmcpeakAJaeger: and then if somebody wanted to use the command line in their local dev environment, they also run them all at once?19:10
* notmorgan wonders how hard it would be to make bandit checks also flake8 targets.19:10
fungii'm certainly in favor of a new and more generic tox target for a collection of linters, given how misnamed the "pep8" env is for many projects at this point19:10
nibalizerfungi: ++19:10
notmorganfungi: ++19:10
fungithis also might make a good addition to the cross-projects spec for the standard testing interface19:11
AJaegertmcpeak: you can have as many tox environments as you want - so one that includes all linters but also separate ones if you want...19:11
*** apuimedo has quit IRC19:11
fungiif we come up with a good new recommendation for something like that19:11
nibalizerhttps://wiki.openstack.org/wiki/Testing mentions 'style checks'19:11
notmorganAJaeger: we can also do some limited templating in tox.ini to address multiples/overrides19:11
*** apuimedo_ has quit IRC19:11
AJaegerinframanual has "Running the style checks" and invokes pep819:11
notmorganso if you want to limit/eliminate some linters it can be done via tox if we wanted to go down that road19:12
*** apuimedo has joined #openstack-infra19:12
fungii'd almost argue for tox -e lint except, as evidenced by my jargon file quote above, we'd just be committing the same sin all over again (if perhaps at least giving credit to the first well-known tool name for this sort of thing?)19:12
*** apuimedo_ has joined #openstack-infra19:13
AJaegerfungi, "style"?19:13
AJaegerfungi, do you have a reference to the cross-spec?19:13
notmorganfungi: -elinters would be fine even in light of the jargon19:13
jeblairkrotscheck: you have full access on /afs/openstack.org/mirror/npm; that volume has a 100G quota; is that enough for now?19:14
notmorganfungi: as long as we keep it to style/lint-style checks imo19:14
AJaegernotmorgan: the plural is nice to say it's more than one...19:15
notmorganAJaeger: that was my goal :)19:15
fungiAJaeger: http://governance.openstack.org/reference/project-testing-interface.html i guess it predates the cross-project specs repo19:15
*** _nadya_ has quit IRC19:16
jeblairkrotscheck: i also added read perms for system:anyuser to that volume19:16
AJaegerthanks, fungi19:16
jeblairkrotscheck: we have a decidedly unofficial apache server that just serves afs, so you can probably use it for testing: http://afstest.openstack.org/mirror/19:17
*** jcoufal has quit IRC19:17
*** apuimedo has quit IRC19:17
*** rlandy has joined #openstack-infra19:17
jeblairkrotscheck: (or, of course, you can just run your own; there's nothing special about it)19:17
*** tzn has quit IRC19:17
*** apuimedo_ has quit IRC19:17
AJaegerso, next step would be a spec for openstack-specs for this?19:18
jeblairfungi, mordred: i am happy to report that all of the krb/afs commands i needed to do worked, so the cell does not seem to have bitrotted.19:18
fungiAJaeger: not necessarily. having at least one example implementation in the wild is probably first19:18
fungijeblair: wow! i did actually not expect that19:18
fungiespecially since we had some crashes in the past19:19
*** apuimedo has joined #openstack-infra19:19
AJaegerany guinea pigs around where we can do this? tmcpeak can we use bandit? ;)19:19
tmcpeakAJaeger: yep, volunteered19:19
*** apuimedo_ has joined #openstack-infra19:19
AJaegertmcpeak: how do you like me to help with that?19:20
tmcpeakAJaeger: let me make sure I understand19:20
fungicross-project specs are, as i understand (being not as involved in them as i should), an attempt to encode our community established practices where successful and promote wider adoption19:20
tmcpeakwe're going to add bandit to the pep8 section with the idea that pep8 will be renamed in some way?19:20
funginot so much a sounding board for "it would be nice if..."19:20
AJaegertmcpeak: create a new environemnt called "linters"19:21
*** reed has quit IRC19:21
fungiwe could in fact add bandit to a new [linters] section which runs the same things the current [pep8] env does plus bandit, and then add a job to run the linters env commands19:21
fungiyeah, what AJaeger said in fewer words19:21
tmcpeakfungi, AJaeger: got it19:21
tmcpeakI'll do the change and throw you guys on the review19:22
fungiat which point the pep8 env for whatever project that is can be deprecated and no longer run as a stand-alone job19:22
tmcpeakcool, sounds good19:22
fungiand then we can point to how well this is working on $project and wouldn't more projects like to take advantage of such splendor here's how19:22
tmcpeakfungi: perfect19:23
AJaegerthanks, tmcpeak, fungi, et al19:23
tmcpeakAJaeger, fungi, et al: thanks!19:23
AJaegerfungi, clarkb, do you have time for another discussion? what shall we do with the nova DocImpact change? It's currently completely broken. We can a) fix it - https://review.openstack.org/259842 - b) revert change https://review.openstack.org/#/c/259569/ c) leave scripts in, disable check for now (259842+new change to disable it). What's your opinon?19:24
AJaegertmcpeak: add me to any change and I'll happily review - and help push this through in project-config19:25
tmcpeakAJaeger: sounds great, thank you19:25
*** reed has joined #openstack-infra19:25
*** apuimedo_ has quit IRC19:26
*** apuimedo_ has joined #openstack-infra19:28
openstackgerrityolanda.robla proposed openstack/diskimage-builder: Add dib element to generate logical volumes  https://review.openstack.org/25204119:29
*** doug-fish has quit IRC19:29
*** apuimedo has quit IRC19:30
*** moravec1 has quit IRC19:31
*** apuimedo has joined #openstack-infra19:31
*** apuimedo_ has quit IRC19:33
*** apuimedo_ has joined #openstack-infra19:33
*** angdraug has quit IRC19:33
krotscheckjeblair: Should be enough, thanks19:34
*** angdraug has joined #openstack-infra19:34
krotscheckjeblair: That decidedly unoffical one is refusing my connections19:34
*** moravec has joined #openstack-infra19:34
fungiAJaeger: i'll defer to nova leadership on whether to revert it or patch it up while fleshing out the better reno-oriented solution19:35
*** ZZelle has quit IRC19:36
fungiAJaeger: i don't really have a preference as long as nova and docs teams agree there is some benefit to the current job19:36
AJaegerfor that we first have to merge 259842  - let me approve that one and if johnthetubaguy speaks up, we can still disable/revert. Ok?19:36
AJaegerjohnthetubaguy: are you around for docimpact discussion? Otherwise feel free to ping me tomorrow19:37
*** apuimedo_ has quit IRC19:38
notmorganfungi: do we support OS X for python-*client libs/CLIs? [in any reasonable way] (cc clarkb, mordred, pleia2, anteaya) - as in "best effort" or just "nope not supporteD"19:39
notmorganfungi, clarkb, mordred, and i need to ask how we handle patches proposed on LP and not through gerrit [it appears someone posted a patch to LP and someone else converted to gerrit]19:39
*** apuimedo_ has joined #openstack-infra19:39
* notmorgan would love to be able to disable patch posting on lp.19:40
clarkbI do not provide any os x  support19:41
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Include query results in graph  https://review.openstack.org/26018819:42
*** apuimedo has quit IRC19:43
*** notnownikki has quit IRC19:44
*** apuimedo_ has quit IRC19:44
*** markvoelker has joined #openstack-infra19:45
*** apuimedo has joined #openstack-infra19:45
funginotmorgan: considering our "if it's not tested it's broken" slogan and the corollary "we don't support what's broken" i have to assume the official answer is "no"19:45
*** apuimedo_ has joined #openstack-infra19:45
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Replace bashate/pep8 in project-config by linters  https://review.openstack.org/26019219:46
AJaegertmcpeak, fungi, clarkb: Let's lead by example in project-config ^19:46
funginotmorgan: as for handling patches posted to lp/github/notgerrit, someone else can forward the patch in but they are most likely violating the icla in so doing19:46
notmorganfungi: ok i'll comment on the bug.19:47
*** reed has quit IRC19:47
fungithat's not to say that i object personally, but their employer's lawyers might be concerned about it19:47
notmorganfungi: yeah i am also not super worried cause the fix is low19:48
crinklemordred: is https://review.openstack.org/#/c/198417/ still on your radar? it would be cool for our bifrost server to be able to use that19:48
notmorganinnovation - it's just a "fix what opts are passed to socket" on OS X19:48
fungithe vmt sometimes reproposes into gerrit patches attached to embargoed vulnerability reports in lp, but that's generally patches proposed by existing contributors who were temporarily avoiding gerrit so they didn't prematurely end an embargo19:49
tmcpeakAJaeger: this is awesome19:49
openstackgerritPhilipp Marek proposed openstack-infra/ciwatch: Performance improvement for loading.  https://review.openstack.org/26019319:49
tmcpeakAJaeger: I was trying to grok the necessary magics to do the change but you're fast :)19:49
*** apuimedo has quit IRC19:49
AJaegertmcpeak: once my patch is in, you can use gate-{name}-linters for it ;)19:50
tmcpeaksweet19:50
AJaegertmcpeak: I wanted more than one guinea pig ;)19:50
*** apuimedo_ has quit IRC19:50
tmcpeakAJaeger: awesome, thanks man!19:50
*** markvoelker has quit IRC19:50
*** apuimedo has joined #openstack-infra19:50
*** apuimedo_ has joined #openstack-infra19:51
*** angdraug has quit IRC19:52
*** lucasagomes is now known as lucas-dinner19:53
*** esker has joined #openstack-infra19:53
*** reed has joined #openstack-infra19:54
*** esker has quit IRC19:54
*** tzn has joined #openstack-infra19:54
*** esker has joined #openstack-infra19:54
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Replace bashate/pep8 in project-config by linters  https://review.openstack.org/26019219:54
anteayanotmorgan: I also do not provide any os x support19:55
AJaegerfungi, thanks for review - unfortunately the jenkins tests failed and I had to fix the test tool as well19:55
AJaegersee updated patch ^19:55
*** apuimedo has quit IRC19:55
*** lezbar has joined #openstack-infra19:56
*** apuimedo has joined #openstack-infra19:56
notmorgananteaya: commented on the bug saying "yeah you can land this fix, but it'll break again"19:56
openstackgerritMerged openstack-infra/project-config: Turn off -e in check-git-commit-message.sh  https://review.openstack.org/25984219:56
anteayapleia2: hope family members feel better soon19:56
fungiAJaeger: oh, yep! does that need to be replicated in any checks in the jjb repo too?19:56
mordredcrinkle: yes. I think that would be lovely19:57
AJaegeryeah, I guess I should add description everywhere- let me split the change after checking jjb19:57
anteayanotmorgan: ha ha ha19:57
jeblairmordred, fungi, krotscheck: if the nodepool ready script is basically just 'host $NODEPOOL_PROVIDER_THINGIE.openstack.org >>/etc/hosts' there's basically no downside from using dns; we'll get timely address updates in general.19:57
jeblairkrotscheck: oh, i think i need to disable puppet on it19:57
fungijeblair: also, less flaky than additional dns lookups? (local nscd aside)19:58
mordredjeblair: ++19:58
notmorganugh nscd :( boo ...19:58
pleia2anteaya: thanks :)19:58
*** ZZelle has joined #openstack-infra19:58
* notmorgan was hurt in the past by nscd :P19:58
*** lezbar__ has quit IRC19:58
fungiand you still carry the scars, obviously19:58
notmorganfungi: exactly19:58
notmorganfungi: :P19:59
jeblairkrotscheck: afstest fixed19:59
TheJuliaQuestion, on using the file publishing, where does source setting expect the files to be located on the filesystem?20:00
*** lezbar has quit IRC20:00
*** reed has quit IRC20:01
jrollTheJulia: the root of the project the job is on, e.g. https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ironic-python-agent-jobs.yaml#L3120:02
*** hashar has joined #openstack-infra20:03
*** reed has joined #openstack-infra20:03
TheJuliajroll: as in $WORKSPACE?20:03
fungiTheJulia: yep20:04
TheJuliaOk, thanks!20:04
*** ZZelle has quit IRC20:04
*** dcentral has joined #openstack-infra20:04
fungiTheJulia: if you're using the ftp publisher there are options to strip/munge some of the prepended path within the workspace. if using the scp publisher which lacks those options, there are workarounds involving copying/renaming file paths around and i can dig up examples if you need20:05
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Include query results in graph  https://review.openstack.org/26018820:06
TheJuliafungi: I'll just make it like jroll's IPA job, I just need to change the folder things are in so the publisher finds the files.20:06
*** irenab has joined #openstack-infra20:06
fungishould be easy then20:06
*** irenab has quit IRC20:06
TheJuliayup20:06
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Replace bashate/pep8 in project-config by linters  https://review.openstack.org/26019220:07
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add description label to jenkins checker  https://review.openstack.org/26020220:07
AJaegerfungi, updated and split into two changes ^20:08
openstackgerritgreghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat  https://review.openstack.org/23280020:08
openstackgerritJulia Kreger proposed openstack-infra/project-config: Build a Debian simple-init images  https://review.openstack.org/25489220:08
*** irenab has joined #openstack-infra20:09
*** moravec has quit IRC20:10
*** apuimedo has quit IRC20:10
fungiAJaeger: waiting to make sure that passes since not actually sure what jjb will do with the description on a template20:10
*** ZZelle has joined #openstack-infra20:11
*** irenab has quit IRC20:11
*** apuimedo has joined #openstack-infra20:11
AJaegerfungi, just found a bug...20:11
tmcpeakAJaeger: happy you're taking this on instead of me,.. 'description': v.All(str), would have been WAYYY over my head20:12
AJaegerfungi, see tests/yamlparser/fixtures/add_managed_to_desc.yaml in jenkins-job-builder20:12
AJaegertmcpeak: pabelanger_ showed me that and I extendet it ;)20:12
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add description label to jenkins checker  https://review.openstack.org/26020220:12
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Replace bashate/pep8 in project-config by linters  https://review.openstack.org/26019220:12
tmcpeakahhh20:13
*** apuimedo_ has quit IRC20:14
*** dkranz has quit IRC20:15
*** rkukura has quit IRC20:16
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Replace bashate/pep8 in project-config by linters  https://review.openstack.org/26019220:16
*** Swami has quit IRC20:16
*** apuimedo_ has joined #openstack-infra20:16
openstackgerritMonty Taylor proposed openstack-infra/shade: Add option to enable HTTP tracing  https://review.openstack.org/26013420:17
openstackgerritMatthew Treinish proposed openstack/requirements: Bump minimum tempest-lib version  https://review.openstack.org/25926620:18
*** apuimedo has quit IRC20:18
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: DO NOT MERGE changes needed for delorean promotion  https://review.openstack.org/25814020:19
*** apuimedo has joined #openstack-infra20:19
*** irenab has joined #openstack-infra20:20
*** _nadya_ has joined #openstack-infra20:21
krotscheckjeblair: Can I trouble you to put DirectoryIndex index.html index.json into the aftest mirror?20:23
*** dkranz has joined #openstack-infra20:23
*** _nadya_ has quit IRC20:25
*** e0ne has quit IRC20:25
*** janonymous_ has quit IRC20:26
*** apuimedo_ has quit IRC20:26
*** apuimedo has quit IRC20:26
*** apuimedo has joined #openstack-infra20:27
*** apuimedo_ has joined #openstack-infra20:27
*** rkukura has joined #openstack-infra20:28
*** moravec has joined #openstack-infra20:29
onovyhi, someone for final +A for 256671 and 256668? thanks20:29
*** e0ne has joined #openstack-infra20:29
onovyand 256755 - three same patches20:30
*** irenab has quit IRC20:31
jeblairkrotscheck: done20:31
*** irenab has joined #openstack-infra20:31
*** apuimedo_ has quit IRC20:32
*** irenab has quit IRC20:32
*** apuimedo_ has joined #openstack-infra20:33
*** e0ne has quit IRC20:34
*** irenab has joined #openstack-infra20:35
*** otter768 has joined #openstack-infra20:36
openstackgerritAlex Schultz proposed openstack-infra/project-config: Add fuel-plugin-etckeeper repository for Fuel  https://review.openstack.org/26020820:36
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Replace bashate/pep8 in project-config by linters  https://review.openstack.org/26019220:36
*** irenab has quit IRC20:36
tmcpeakAJaeger: making you work for it, huh? ;)20:36
AJaegertmcpeak: yeah, interesting bugs I have to fix first...20:36
*** apuimedo_ has quit IRC20:37
*** _nadya_ has joined #openstack-infra20:37
*** e0ne has joined #openstack-infra20:38
*** apuimedo has quit IRC20:38
*** apuimedo_ has joined #openstack-infra20:38
*** apuimedo has joined #openstack-infra20:39
fungihrm, almost ready with the changes to strip the branch-dependent worker parameter functions, but double-checking the jobs which are being explicitly overridden to precise is time-consuming20:40
*** baoli has quit IRC20:40
mordredfungi: woot20:40
*** otter768 has quit IRC20:40
*** mwhahaha has joined #openstack-infra20:40
AJaegergreat, fungi!20:41
*** esker has quit IRC20:42
*** apuimedo_ has quit IRC20:43
*** irenab has joined #openstack-infra20:43
*** esker has joined #openstack-infra20:43
*** apuimedo_ has joined #openstack-infra20:43
*** apuimedo has quit IRC20:44
fungijust down to checking into the chef jobs which have icehouse/juno branches pinned to precise because of berkshelf/gecode dependencies20:45
*** e0ne has quit IRC20:45
*** mrmartin has quit IRC20:45
*** apuimedo has joined #openstack-infra20:45
*** _nadya_ has quit IRC20:46
*** Hal2 has quit IRC20:46
*** apoorvad has quit IRC20:46
fungialso this thing has probably already been merge-conflicted in the hour i've been writing it20:47
*** ZZelle has quit IRC20:48
*** irenab has quit IRC20:48
*** apuimedo_ has quit IRC20:48
*** apoorvad has joined #openstack-infra20:49
AJaeger260202 and 260192 passed the tests now - the linters change for project-config. Could I get some reviews, please? Then tmcpeak can base the bandit changes on top of these...20:49
tmcpeakwoohoo20:49
AJaegerfungi, I doubt we merged anything in the last hour...20:49
*** irenab has joined #openstack-infra20:49
*** e0ne has joined #openstack-infra20:50
AJaegerfungi: you're lucky - last merge was 54 mins ago to a script, and the one before 4h ago, so you shouldn't have any conflicts...20:50
*** apuimedo_ has joined #openstack-infra20:50
fungithe one i'm stuck on now is the gate-openstack-chef-repo job20:51
krotscheckjeblair, mordred: So, with a hosts entry pointing mirror.local to afstest, this works http://paste.openstack.org/show/482447/20:51
fungioh, i see20:51
*** hichihara has joined #openstack-infra20:51
mordredkrotscheck: sweet! and it only downloaded things from mirror.local?20:51
krotscheckyep20:52
jeblairkrotscheck: i notice that http://afstest.openstack.org/mirror/npm/ looks like it might be dir-per-package... is that the case?20:52
*** ZZelle has joined #openstack-infra20:52
krotschecki had to mirror all those deps before it worked20:52
krotscheckjeblair: i believe so20:53
*** irenab has quit IRC20:53
jeblairkrotscheck: how many packages we talkin about?20:53
krotscheck218,27520:53
krotscheckas of right now20:53
tmcpeakAJaeger: question - how is python-jobs going to change?20:53
tmcpeakAJaeger: we're currently just using the python-jobs template in Bandit20:54
jeblairkrotscheck: in our local mirror scripty thingy, can we diretory-hash those?  so they end up in eg "mirror/npm/j/ja/jason/"20:54
AJaegertmcpeak: for now: Not at all. In the future: First step the jenkins template will get it...20:54
*** irenab has joined #openstack-infra20:54
AJaegertmcpeak: just add 'gate-{name}-linters' to bandit in jenkins/jobs/projects.yaml20:54
AJaegerSee the two places I changed it for project-config - in projects.yaml and in zuul/layout.yaml20:55
jeblairkrotscheck: afs has a directory limit of (well it's complicated but for discussion let's say) 64k entries.20:55
krotscheckjeblair: not if we want it to work, i think20:55
*** bardia has joined #openstack-infra20:55
krotscheckIt's faking a CouchDB instance after all20:56
jeblairkrotscheck: aren't we writing the url ourselves anyway?20:56
tmcpeakAJaeger: sure, but if I just add it, won't it run twice now since "python-jobs" is already calling pep8 too?20:56
krotscheckjeblair: We are rewriting the index.json file, yes, but the path of {mirror}/{packagename}/index.json still has to resolve.20:57
tmcpeakfor project-config you guys weren't using that python-jobs template (which includes a bunch of other stuff)20:57
*** irenab has quit IRC20:57
AJaegertmcpeak: indeed, you have to change that, don't use python-jobs template in zuul/layout.yaml but the single jobs.20:57
tmcpeakin Bandit we use 'python-jobs' to run pep8, py27 and py3 unit tests, etc20:57
tmcpeakAJaeger: ok20:57
tmcpeakAJaeger: won't those then run on separate VM's too?20:58
AJaegertmcpeak: they already all run on separate VMs20:58
tmcpeakAJaeger: ahh ok20:58
jeblairkrotscheck, mordred: this seems to be a disease common to language package mirror authors.20:58
AJaegerpython-jobs is just syntactic sugar to not have to write these everytime20:58
jeblairkrotscheck: we may be able to solve that with a rewrite rule20:58
tmcpeakit seems like we'd need to split python-jobs to "with linter target" and "without linter target" otherwise projects won't be able to use it anymore20:58
AJaegertmcpeak: yeah, that's the next step. Let me put one change on top of my latest for this...20:59
jheskethMorning20:59
*** irenab has joined #openstack-infra20:59
krotscheckjeblair: I think in this case it's the npm authors, not the mirror authors.20:59
tmcpeakAJaeger: ok cool, is that the way you see it splitting out?  two different "python-jobs" - one running with legacy pep8 and one running with linter target?20:59
*** moravec has quit IRC20:59
mordredkrotscheck, jeblair: we're already rewriting urls when we write out index.json in the tool that the yahoo folks maintain21:00
krotscheckjeblair: I think the npm mirror daemon has hooks we can add, let me check.21:00
mordredwe could add a feature to add in {firstletter}/{packagename}21:00
mordredand they might land it quicker than the bandersnatch folks21:00
jeblairmordred: if i'm understanding krotscheck it's the initial lookup of "mirror/packagename" that needs to be solved, yeah?21:00
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Get rid of precise||trusty job node declarations  https://review.openstack.org/26021321:01
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Remove precise/trusty label mapping in Zuul config  https://review.openstack.org/26021421:01
fungiAJaeger: clarkb: mordred: ^21:01
mordredoh - does it?21:01
krotscheckYep, and that's an npm thing, not a registry-static thing.21:01
mordredjeblair: in that case, yeah, we'll need rewrite rule there too21:01
jeblairmordred: like when you say "npm install foo" it does "GET /mirror/foo"21:01
mordredyah21:01
jeblairkrotscheck: i have a set of rewrite rules (they are actually pretty simple) that will let us serve "mirror/npm/foo' from 'mirror/f/o/foo'21:01
krotscheckAs long as we can get the mirroring script to build that structure, yes?21:02
jeblairkrotscheck: yep21:02
krotscheckAlright, lemme look for hooks21:02
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add new python-jobs-linters template  https://review.openstack.org/26021521:02
jeblairkrotscheck: cool, if you can build that structure, i'll put the rewrite rules in place on afstest21:02
*** vilobhmm11 has joined #openstack-infra21:02
*** irenab has quit IRC21:03
*** dprince has quit IRC21:03
jeblairkrotscheck: (one letter package names should just hash to one dir level deep; 2 and greater to 2 levels deep)21:03
*** moravec has joined #openstack-infra21:03
*** dizquierdo has joined #openstack-infra21:04
tmcpeakAJaeger: perfect!21:05
*** irenab has joined #openstack-infra21:05
*** irenab has quit IRC21:06
*** migi has quit IRC21:06
*** apuimedo has quit IRC21:08
*** migi has joined #openstack-infra21:08
*** irenab has joined #openstack-infra21:08
*** ociuhandu has quit IRC21:09
AJaegerfungi, what a change, woow21:09
*** apuimedo has joined #openstack-infra21:09
fungiAJaeger: it's ambitious... i don't expect it to pass on the first attempt21:09
*** weshay_xchat has joined #openstack-infra21:09
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders  https://review.openstack.org/22239821:10
fungiand even once it does, i expect there will be at least some nuance we miss in review which causes us some post-facto correcting21:10
*** vilobhmm111 has joined #openstack-infra21:10
fungibut it needs to get done, and the sooner the better21:10
fungiwe could have done this a cycle ago21:10
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders distinguish between failure and exception  https://review.openstack.org/24213121:10
*** vilobhmm11 has quit IRC21:10
openstackgerritgreghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance  https://review.openstack.org/23213521:11
ianwgreghaynes / SpamapS : so ... do you think i could get F23 minimal for christmas?  there's 3 dib changes out there, pretty small, but with that i get a booting f23 in rax with glean21:11
openstackgerritgreghaynes proposed openstack-infra/nodepool: Builders can be run on their own  https://review.openstack.org/23225121:11
SpamapSianw: I was literally just opening up gertty so I'll prioritize dib :)21:11
fungiAJaeger: also it will collect merge conficts so rapidly that we probably can't merge it unless we prioritize it over other changes21:11
greghaynesianw: haha, I'll have a look21:12
*** Swami has joined #openstack-infra21:12
* AJaeger votes for prioritizing it21:12
*** gchamoul has quit IRC21:12
ianwSpamapS: thanks; https://review.openstack.org/#/c/257172/ (the eth0/eth1 thing) is maybe the mostly interesting one21:12
*** irenab has quit IRC21:13
fungiAJaeger: i'm around for the next few days, so happy to be the rooter to run jjb manually everywhere and also to make whatever adjustments we find are lacking afterward21:13
*** changbl has quit IRC21:14
SpamapSianw: it's confusing to me that glean considers a DHCP-configured interface as something it shouldn't touch, since last I checked every Ubuntu cloud image ships with eth0 setup for DHCP21:14
fungiAJaeger: hrm, those changes succeeded their jobs on the first try. i'm suspicious--that almost never happens to me21:14
greghaynesianw: re the eth0/1 thing - doesn't infra still run f21?21:14
greghaynesianw: I am specifically worried that we will break them21:14
*** irenab has joined #openstack-infra21:14
SpamapSGuessing nobody has tried the combination of Ubuntu-not-minimal, configdrive-only cloud, and glean21:14
*** irenab has quit IRC21:14
ianwSpamapS: it's in the systemd .service file -- it checks if the eth0 script exists, and if it does, it does not run glean21:14
greghaynesSpamapS: I have by accident a few times21:14
ianwgreghaynes: that's why i want f23  :)  to kill off f21 in infra :)21:15
SpamapSWhy would glean do that?21:15
greghaynesianw: Yes, but we probably should not break them in doing so...21:15
greghaynesianw: hrm, actually, I think if glean sees no config drive it will write out dhcp config21:15
ianwgreghaynes: it's totally broken at the moment, i can't run devstack with missing packgaes21:15
greghaynesianw: so maybe we wont21:15
*** gchamoul has joined #openstack-infra21:16
ianwSpamapS: https://github.com/openstack-infra/glean/blob/master/glean/init/glean%40.service#L521:16
*** dizquierdo has quit IRC21:16
AJaegerfungi, your change looks fine at first sight, I'm willing to take the risk.21:16
greghaynesSpamapS: I think we want to change that glean behavior FWIW21:16
ianwSpamapS: glean triggers this on udev net rules21:16
fungiAJaeger: now we just need a second brave soul to agree with you ;)21:16
AJaegerfungi, if we want to go through with it, we should not merge anything before your change goes in...21:16
greghaynesSpamapS: probably by making it do the cloud-init thing where it writes out the last applied config to disk and if it sees the same config on disk as in config drive it bails21:17
fungii would like clarkb to give 260213 and 260214 a once-over since i recall he did a lot of the legwork on the original transition to run jobs on trusty after the icehouse release21:17
fungiand i'm basically attempting to unravel that21:18
AJaegeryes, clarkb reviewing these would be great.21:18
*** irenab has joined #openstack-infra21:18
SpamapSgreghaynes: Ah yes I've been suggesting that for a while. OK.21:18
*** claudiub has quit IRC21:18
jeblairi'm going to go back into my zuulv3 hole for a while21:19
*** irenab has quit IRC21:19
*** shardy_afk is now known as shardy21:19
anteayajeblair: hope it is cozy21:19
AJaegerfungi, if there's any fallout tomorrow morning European time, I can keep an eye on it - and if yolanda is around, so can she...21:19
fungisounds cozy. especially if there are cookies there21:19
fungiAJaeger: thanks21:19
AJaegercookies and coffee? Or something stronger? jeblair enjoy!21:19
jeblairfungi: there definitely are: http://www.hanescookies.com/hanes_cs/default.asp21:20
AJaegerfungi, if you have time to review my linters series starting at  26020, it would be nice - but let's get your changes in first!21:20
jeblairAJaeger: ^ :)21:20
fungijeblair: from north carolina!21:21
AJaegerjeblair: my current favorites: http://www.lebkuchen-mirus.de/ ;) Sorry, German only21:21
jeblairfungi: my hometown even :)21:21
* anteaya looks at 260213 and puts the kettle on21:21
fungijeblair: even better21:21
AJaegerjeblair: enjoy!21:22
AJaegerthanks, anteaya ! Make it a strong tea/coffee ;)21:22
anteayaheh21:22
*** marekd has joined #openstack-infra21:23
anteayathe cookies look delicious21:23
*** apuimedo has quit IRC21:23
krotscheckAJaeger: Oh, yum.21:23
* krotscheck is baking his own stollen this year21:23
krotscheckI had to candy my own lemon peel.21:23
AJaegerkrotscheck: yummy!21:23
fungithe console log of the xml diff for the job change is >13mb21:24
AJaegerfungi: new record ;)21:24
anteayakrotscheck: that sounds like fun21:24
anteayaha ha ha21:24
*** apuimedo has joined #openstack-infra21:25
*** kgiusti has left #openstack-infra21:26
anteayafungi: so we don't _have_ to get rid of quotes they were just a casualty of your script? https://review.openstack.org/#/c/260213/1/jenkins/jobs/astara.yaml21:26
*** bnemec has quit IRC21:26
*** irenab has joined #openstack-infra21:26
fungianteaya: yeah, it was accompanying cleanup. easier to normalize the quoting on them as i went21:26
*** irenab has quit IRC21:27
AJaegeranteaya: those quotes are optional, I'm happy to see them gone21:27
anteayafungi: makes sense21:27
fungithe reason most of them were there is because someone copied them from somewhere without realizing they were unnecessary21:27
anteayaAJaeger: fair enough, just trying to understand the changes21:27
AJaegersure, anteaya21:27
anteayafungi: fair enough21:28
fungianteaya: mostly it made checking them after the fact slightly easier21:28
anteayafungi: yup21:28
anteayaso next question, this file: https://review.openstack.org/#/c/260213/1/jenkins/jobs/chef-jobs.yaml21:28
anteayawhy did bare-precise win vs bare-trusty here?21:28
*** bnemec has joined #openstack-infra21:28
fungianteaya: those were being explicitly set to bare-precise in the zuul configuration21:29
fungiyou'll find some groups and openstackid jobs with a similar fate21:29
AJaegeranteaya: see https://review.openstack.org/#/c/260214/1/zuul/layout.yaml21:30
bknudson_there used to be a button in gerrit to edit the commit message21:30
AJaegeranteaya: line 69821:30
AJaegerbknudson_: it's still there - but now for every file21:30
AJaegerReview the commit message and you have the button21:30
fungibknudson_: now you can edit anything, not just commit messages21:30
anteayafungi: thank you, I will continue to look for that21:30
bknudson_ok, I found the edit button on the main page21:30
*** markvoelker has joined #openstack-infra21:30
anteayaAJaeger: ah thanks21:31
*** irenab has joined #openstack-infra21:31
*** irenab has quit IRC21:31
AJaegerI have to leave now, looking forward to the outcome of this! Bye...21:32
anteayadoe and fawn in my garden21:32
anteayaAJaeger: night21:32
*** AJaeger has quit IRC21:32
*** dcentral has quit IRC21:32
*** dims_ has quit IRC21:33
*** dims has joined #openstack-infra21:33
*** irenab has joined #openstack-infra21:35
*** irenab has quit IRC21:35
*** 18VAACSN1 has quit IRC21:35
*** michaelxin has quit IRC21:35
*** lindsayk has quit IRC21:35
*** markvoelker has quit IRC21:36
tonybCan anyone see where this https://review.openstack.org/#/c/259830/ change is?  The last thing form jenkins was starting jobs check zuul but I can't see it in zuul (I may be blind)21:36
tonybis there somewhere else I can check?21:36
*** apuimedo_ has quit IRC21:37
*** ZZelle has quit IRC21:38
anteayayou've lost your change?21:38
*** apuimedo_ has joined #openstack-infra21:39
anteayaI don't see it in status.openstack.org/zuul21:39
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal: do not configure eth0 & eth1 for DHCP automatically  https://review.openstack.org/25717221:39
tonybanteaya: yeah and I miss it ;P21:39
*** angdraug has joined #openstack-infra21:39
ianwSpamapS: ^ yeah, you're right, using "-n" there isn't a good idea because you can't unset easily21:39
ianwchanged it to a 0/1 match21:39
anteayatonyb: :(21:39
*** irenab has joined #openstack-infra21:39
anteayajenkins said it was starting gate jobs about 12 hours ago and then it didn't finish21:40
*** irenab has quit IRC21:40
anteayatonyb: I'll recheck it to get a +1 verified on it again21:40
anteayatonyb: if it passes recheck find me and I'll reapprove21:41
anteayatonyb: I don't know what happened21:41
tonybanteaya: okay thanks.21:41
*** apuimedo has quit IRC21:41
*** ZZelle has joined #openstack-infra21:41
*** apuimedo has joined #openstack-infra21:41
anteayanp21:42
*** vgridnev has quit IRC21:42
fungi2015-12-21 09:33:46,632 DEBUG zuul.DependentPipelineManager: Reported change <Change 0x7f2ea9e0b410 259830,1> failed tests or failed to merge21:43
*** dims has quit IRC21:43
*** zeih has joined #openstack-infra21:43
fungiaha, i have a traceback, just a sec21:43
tmcpeakfungi: the implicit 0x in front of it makes it look more intimidating :P21:44
*** nikhil_k has joined #openstack-infra21:44
tmcpeakhex scares me, I just like representations that magically fall into the 0-F range21:44
fungihttp://paste.openstack.org/show/482454/21:45
fungino idea what's up with the KeyError: 'LOG_PATH' there, but i'm working from the kitchen and semi-distracted at the moment21:46
fungithough it looks like it was going to fail anyway...21:47
fungi2015-12-21 09:33:39,056 DEBUG zuul.DependentPipelineManager: <QueueItem 0x7f2da26af6d0 for <Change 0x7f2ea9e0b410 259830,1> in gate> is a failing item because ['it has a merge conflict', 'at least one job failed']21:47
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal : install selinux policy packages  https://review.openstack.org/25986721:48
tonybfungi: Thanks.21:48
*** nikhil has quit IRC21:48
anteayafungi: thanks21:48
anteayatonyb: do you want to rebase?21:48
tonybfungi: I assume if your're in the kitchen you're cooking so get back to that :D21:48
tonybanteaya: yup doign it now.21:49
*** irenab has joined #openstack-infra21:49
*** dims has joined #openstack-infra21:49
jheskethfungi: that looks like a zuul bug.. I'll take a dig into it21:50
anteayajhesketh: thanks21:50
openstackgerritRamy Asselin proposed openstack-infra/elastic-recheck: Include query results in graph  https://review.openstack.org/26018821:51
anteayafungi: when you are finished cooking/dining, the chef-<jobs>.yaml file were all on precise since they don't work on trusty as we discussed above, shouldn't the cookbook repos also be on precise then? https://review.openstack.org/#/c/260213/1/jenkins/jobs/projects.yaml starting at line 66221:52
openstackgerritTony Breeds proposed openstack-infra/project-config: Barbican does not support python34 in kilo  https://review.openstack.org/25983021:53
tonybanteaya: it was a merge conflict with another of my changes.21:54
*** apuimedo_ has quit IRC21:55
*** apuimedo has quit IRC21:55
*** apuimedo_ has joined #openstack-infra21:56
*** apuimedo has joined #openstack-infra21:56
anteayayou21:56
fungianteaya: they have other jobs besides those in that same job group which use bare-trusty instead, so it was easiest to just change the precise-based ones21:56
anteayaglad you figured it out21:56
anteayafungi: okey dokey21:57
fungialso makes it a little more obvious what's going to break when we get rid of precise soonish21:57
openstackgerritMerged openstack-infra/elastic-recheck: Add query for bug 1527483  https://review.openstack.org/26011921:57
* anteaya refortifies before heading into the wilderness of fuel21:57
openstackbug 1527483 in neutron "VPNaaS - No providers specified for 'VPN' service" [Critical,Confirmed] https://launchpad.net/bugs/1527483 - Assigned to Martin Hickey (martin-hickey)21:57
anteayafungi: yep21:57
fungianteaya: tonyb: i think i've seen that keyerror for log_path on reporting in the past when we've got a custom report string which is trying to use that parameter for a job where it doesn't exist/isn't defined21:58
*** thorst_ has quit IRC21:59
anteayaah ha, thank you22:01
tmcpeakAJaeger, fungi: you guys fighting other fires or is it a decent time to merge that 'linters' change?22:02
tmcpeakoh, AJaeger is gone :)22:03
*** apuimedo has quit IRC22:03
*** apuimedo has joined #openstack-infra22:05
*** apuimedo_ has quit IRC22:05
*** eil397 has joined #openstack-infra22:05
*** zeih has quit IRC22:05
*** apuimedo_ has joined #openstack-infra22:06
*** dims_ has joined #openstack-infra22:08
*** dims has quit IRC22:08
*** apuimedo has quit IRC22:09
*** piet has quit IRC22:10
*** apuimedo has joined #openstack-infra22:11
docaedowhere are requirements for jenkins tests declared? I had assumed requestsexceptions would be in the jenkins slave environment but guess not: http://logs.openstack.org/98/260198/3/experimental/propose-app-catalog-update/c037fc8/console.html22:12
*** shardy has quit IRC22:12
*** dims has joined #openstack-infra22:12
mordreddocaedo: for that slave, it's all managed in puppet22:13
*** lindsayk has joined #openstack-infra22:13
*** dims_ has quit IRC22:13
mordreddocaedo: openstack-infra/system-config:modules/openstack_project/manifests/proposal_slave.pp22:13
zaroI've got exim working, sends emails locally but can't get it to work with external connection.  anybody know how to setup exim to accept external connections?22:14
*** dcentral has joined #openstack-infra22:14
docaedomordred: ah wow ok, thanks :)22:14
*** apuimedo has quit IRC22:15
*** apuimedo has joined #openstack-infra22:16
*** apuimedo_ has quit IRC22:16
*** apuimedo_ has joined #openstack-infra22:16
openstackgerritMonty Taylor proposed openstack-infra/system-config: Add requestsexceptions to proposal slave  https://review.openstack.org/26023022:17
mordreddocaedo: ^^22:17
*** dkranz has quit IRC22:17
docaedomordred: yikes fast! I was about to do that, thank you so much!22:18
mordreddocaedo: :)22:18
mordreddocaedo: I type clickyclicky22:18
openstackgerritIan Wienand proposed openstack-infra/glean: Fixup invalid hostnames  https://review.openstack.org/25935722:19
docaedomordred: no kidding!22:19
*** apuimedo has quit IRC22:20
*** sdake has quit IRC22:21
anteayamordred: do you say clickyclicky while you are typing?22:21
anteayaplease say yes, please say yes22:21
*** apuimedo has joined #openstack-infra22:22
*** apuimedo_ has quit IRC22:23
*** apuimedo_ has joined #openstack-infra22:24
pleia2hehe22:24
bkeroHaha22:24
bkeromordred: Do you do fancy keyboard clickyclicky?22:25
*** ZZelle has quit IRC22:26
mordredanteaya: yes22:27
mordredbkero: always22:27
pleia2this is why we all have to work from home22:28
bkeromordred: I'm still waiting for a laptop with a clicky keyboard :<22:28
*** apuimedo_ has quit IRC22:28
*** ZZelle has joined #openstack-infra22:28
mordredbkero: you are in good company in this channel then :)22:28
bkeroHaha22:29
*** dims has quit IRC22:29
*** apuimedo_ has joined #openstack-infra22:29
bkero:)22:29
bkeromordred: It already exists, but we should stop complaining and just use it despite flaws. http://e5c351ecddc2f880ef72-57d6ff1fc59ab172ec418789d348b0c1.r69.cf1.rackcdn.com/images/Z1jgrRQVIWfS.878x0.Z-Z96KYq.jpg22:29
*** mriedem is now known as mriedem_away22:30
*** apoorvad has quit IRC22:30
*** zeih has joined #openstack-infra22:30
mordredbkero: :)22:31
bkeroI'd love to see you try to use that in an airplane coach seat22:31
anteayamordred: oh good22:31
anteayafungi: I'm fine with https://review.openstack.org/#/c/260213/1 and like the idea of you self-approving when you are ready22:31
fungianteaya: okay, if clarkb is around enough to at least +1 the basic concept in that pair of patches i'm happy to press forward and babysit it into the evening22:32
anteayafungi: understood22:33
anteayafungi: and you had said you wanted clarkb to take a peek so I figured I'd wait and you are best to press the go button anyway22:33
clarkbfungi anteaya sorry got movie day today22:34
anteayaclarkb: oh yes that's right, STAR WARS!22:35
*** e0ne has quit IRC22:35
anteayaclarkb: have fun22:35
anteayafungi: their is a sentence in the commit message on 260214 I don't parse22:36
anteayathere*22:36
*** apuimedo has quit IRC22:36
anteaya"and let it trusty that any worker registering the job name"22:36
*** otter768 has joined #openstack-infra22:36
anteayait lost me22:36
*** apuimedo has joined #openstack-infra22:37
*** admin0 has joined #openstack-infra22:37
openstackgerritMerged openstack-infra/project-config: Barbican does not support python34 in kilo  https://review.openstack.org/25983022:39
jheskethtonyb, fungi: hmm, so it worked this time around ^22:39
jheskethI'm also confused because I can't see any jobs on project-config that use the LOG_PATH in their success_pattern22:39
tonybjhesketh: yeah there was race/merge conflict the first time22:39
tonybjhesketh: nothing specific in the change22:39
jheskethI'll add some hardening so that next time it happens we'll have better logging22:39
jheskethhmm okay, must have missed that part of the conversation22:40
*** otter768 has quit IRC22:41
jheskethnot sure why a merge conflict would cause the LOG_PATH to not exist though22:41
fungii don't know that it was a race/merge conflict22:42
*** dimtruck is now known as zz_dimtruck22:42
fungithe message said it was being dequeued *either* because of a failed job or a merge conflict22:42
fungii didn't dig back far enough in the debug log to find out which22:42
anteayaokay so this is a big file: https://review.openstack.org/#/c/260213/1/jenkins/jobs/projects.yaml22:43
anteayaI used to be able to control-f for the page22:43
anteayanow control-f is taken by either the left diff or the right22:43
anteayaand ends up in some js controlled search22:43
anteayawhich stalls because the file is very big22:43
anteayaso I can't search that file22:43
jheskethhmm, so the dequeue event caused a report, but formatting the report failed22:43
anteayawhich makes me sad22:43
fungianteaya: hah at typo in the commit message. s/trusty/trust/ there. i'll fix ;)22:43
jheskethI wonder if we're missing all of the merge conflict reports?22:44
anteayafungi: was hoping that was it22:44
anteayafungi: my brain is a little jelly from 21322:44
fungianteaya: as for your ctrl-f woes, you can checkout the change locally and just `git show jenkins/jobs/projects.yaml` and use / and the n key to search in ne22:45
anteayatrue I can do that22:45
fungialso gertty has search now22:45
anteayaI'm thinking of giving gertty another shot after I get christmas over with22:45
anteayacurrently doing battle with my cat over who has say where my wrist goes22:46
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Remove precise/trusty label mapping in Zuul config  https://review.openstack.org/26021422:46
*** markvoelker has joined #openstack-infra22:46
fungicommit message typo addressed ^22:46
anteayaat least she has given me my keyboard back22:47
anteayafungi: thank you22:47
*** lykinsbd has quit IRC22:47
fungithanks for reviewing it22:48
*** moravec has quit IRC22:48
anteayafungi: if I read the comments on removed in this file correctly: https://review.openstack.org/#/c/260214/1/zuul/layout.yaml the infra puppet repos should be running on precise nodes, yes?22:48
anteayafungi: welcome, thanks for doing the work22:49
*** tzn has quit IRC22:49
fungianteaya: the system-config one22:49
fungigate-system-config-puppet.*22:49
anteayaoh okay thanks22:50
* anteaya looks again22:50
fungiwhich i couldn't find. i should look again just to be sure22:50
fungiahh, gate-system-config-puppet-syntax may need to get forced to bare-precise22:50
fungichecking now22:50
anteayathat looks like a job that should be defined in zuul/layout.yaml22:51
*** pvaneck has quit IRC22:51
*** lykinsbd has joined #openstack-infra22:51
*** markvoelker has quit IRC22:51
fungithough i'm also okay with starting to run that one on bare-trusty instead, i agree that should probably be a separate change22:51
anteayaokay as long as you have a plan22:53
anteayaI'm fine with whatever it is22:53
fungihuh, i'm not having a lot of luck finding where that job is actually defined22:54
nibalizermaybe in puppet.yaml?22:54
nibalizerwe (infra) have some but not perfect overlap with the puppet modules team22:54
fungilooks like it's in the puppet-check-jobs job group, though we pass in a node: override there to bare-trusty and i haven't changed that22:55
fungiso sort of strange that it was working before this22:55
anteayafungi: it is possible it is an old comment from when all the puppet modules were in system-config22:55
*** smarcet has quit IRC22:55
anteayafungi: and I have posted a comment on ps1 of 21422:55
fungithanks22:56
fungii'm still pondering this22:56
anteayawelcome22:56
anteayayup22:56
*** irenab has joined #openstack-infra22:57
*** irenab has quit IRC22:57
*** apoorvad has joined #openstack-infra22:58
*** ajmiller has quit IRC22:58
*** ajmiller_ has joined #openstack-infra22:58
fungiyeah, if you look in jenkins/jobs/projects.yaml you'll see we add the puppet-check-jobs group to the system-config project22:58
fungiand we pass a node: bare-trusty parameter to that group22:58
fungithat job-group includes the gate-{name}-puppet-syntax template22:59
fungi(in the jenkins/jobs/puppet-module-jobs.yaml file)22:59
anteayaI see that22:59
anteayaI think perhaps that comment is an artifact23:00
fungiand that job-template has a node: '{node}' parameterization23:00
anteayaof configurations gone by23:00
fungiwell, except that we're matching ^gate-system-config-puppet.*$ and calling the set_node_options_default_precise() function on that23:01
fungiwhich should be switching it to bare-precise from zuul's perspective, i think23:01
*** Guest17831 is now known as ruagair23:01
*** ruagair is now known as Guest1006423:02
fungii mean, there's a simple way to see what that's doing. can look at the layout job23:02
*** apuimedo_ has quit IRC23:02
fungion the first change and then the second23:02
*** apuimedo_ has joined #openstack-infra23:02
fungior look at a recent job and see where it ran23:03
*** irenab has joined #openstack-infra23:03
*** mtanino has quit IRC23:03
fungihttps://jenkins01.openstack.org/job/gate-system-config-puppet-syntax/261/23:04
fungibare-trusty23:04
fungiso yeah, whatever that was supposed to be matching, it never worked23:04
*** irenab has quit IRC23:04
*** apuimedo has quit IRC23:05
anteayawoooo23:05
*** amuller has quit IRC23:05
*** apuimedo has joined #openstack-infra23:05
*** hashar has quit IRC23:05
*** woodster_ has quit IRC23:06
*** irenab has joined #openstack-infra23:07
fungianteaya: and yeah, good catch on the dev param functions file23:07
fungii deleted one line too many in it23:08
anteayaoh good23:08
* anteaya was helpful today!23:08
*** irenab has quit IRC23:09
*** apuimedo_ has quit IRC23:09
*** moravec has joined #openstack-infra23:09
*** apuimedo has quit IRC23:10
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Remove precise/trusty label mapping in Zuul config  https://review.openstack.org/26021423:10
fungianteaya: ^ thanks!23:10
*** apuimedo has joined #openstack-infra23:11
anteayawelcome23:11
*** irenab has joined #openstack-infra23:12
*** apuimedo_ has joined #openstack-infra23:12
*** irenab has quit IRC23:13
*** darvon has quit IRC23:15
*** apuimedo has quit IRC23:15
*** apuimedo_ has quit IRC23:16
*** apuimedo has joined #openstack-infra23:16
*** irenab has joined #openstack-infra23:16
*** apuimedo_ has joined #openstack-infra23:17
*** irenab has quit IRC23:17
mordredinfra-root: "I have the upgrade for the CPUs scheduled for tomorrow (12.22.15) at 5pm PST."23:18
mordredinfra-root: that's re: bluebox cloud23:18
nibalizerfor bluebox?23:18
*** darvon has joined #openstack-infra23:18
nibalizerawesome23:18
mordredyah23:18
fungiyay!23:18
anteayamordred: nice23:18
pleia2cool23:18
nibalizeri hope the people doing the upgrade get to take the rest of the week off23:18
mordredso we should probably bleed it down to 0 if it's not already and/or quiesce the mirror?23:18
anteayaI think it is still 023:19
fungii think we didn't bring it back up above 1 max yet23:20
anteayasorry no, it was 1 on Friday23:20
anteayayeah23:20
fungiso pretty easy to do (or ignore) before then23:20
anteayahttp://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nodepool.yaml#n92523:20
anteayado we want it at 0 or -1?23:21
*** apuimedo has quit IRC23:21
*** dims has joined #openstack-infra23:21
*** apuimedo_ has quit IRC23:21
*** smarcet has joined #openstack-infra23:22
*** apuimedo has joined #openstack-infra23:22
*** irenab has joined #openstack-infra23:22
*** apuimedo_ has joined #openstack-infra23:22
*** irenab has quit IRC23:23
*** tzn has joined #openstack-infra23:24
*** baoli has joined #openstack-infra23:25
*** smarcet has quit IRC23:26
*** asselin_ has joined #openstack-infra23:26
*** apuimedo has quit IRC23:26
openstackgerritMerged openstack/diskimage-builder: Fix unmount/remove race in cleanup_build_dir  https://review.openstack.org/25958623:27
*** tmcpeak has left #openstack-infra23:27
*** apuimedo has joined #openstack-infra23:27
*** asselin__ has quit IRC23:27
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add extra hardening on success-pattern url  https://review.openstack.org/26024323:28
*** baoli has quit IRC23:28
jheskethfungi: ^ that will make things a little better23:28
fungianteaya: ideally 0 if they're taking it offline for a while23:29
fungijhesketh: thanks!23:29
anteayafungi: okay I'll offer a patch23:30
*** tzn has quit IRC23:30
*** dims has quit IRC23:30
*** sabeen has joined #openstack-infra23:32
*** krtaylor has quit IRC23:32
fungisounds good23:32
*** dims has joined #openstack-infra23:32
*** irenab has joined #openstack-infra23:33
*** ZZelle has quit IRC23:33
openstackgerritAnita Kuno proposed openstack-infra/project-config: Turn bluebox servers off in nodepool.  https://review.openstack.org/26024723:35
*** ZZelle has joined #openstack-infra23:36
boris-42fungi: hi23:36
openstackgerritMerged openstack/requirements: Bump minimum tempest-lib version  https://review.openstack.org/25926623:36
boris-42fungi: so recently https://review.openstack.org/#/c/252590/ one of jobs was removed from Rally project23:36
anteayamordred: 26024723:36
*** apuimedo_ has quit IRC23:36
boris-42fungi: unfortunatelly nobody notify rally team about this...23:36
boris-42fungi: however is it possible to add it back? or at least add centos7 instead?23:37
*** apuimedo has quit IRC23:37
*** otter768 has joined #openstack-infra23:37
anteayaboris-42: there were many patches like that: https://review.openstack.org/#/q/topic:juno-eol23:37
*** apuimedo has joined #openstack-infra23:38
anteayaboris-42: I tried to get a hold of you, you weren't in channel, it would have been a courtesy ping anyway, I wasn't going to try to find you on the mailing list23:38
boris-42anteaya: it would be nice if at least one of core members or PTL of project will be notified23:38
anteayaI tried23:38
anteayayou weren't in channel as I said23:38
*** apuimedo_ has joined #openstack-infra23:38
anteayaand I wasn't going to try to find you on the mailing list23:38
anteayaas the job was going to be removed23:38
boris-42anteaya: ok23:39
boris-42anteaya: in any case is there centos7 job?23:39
fungiboris-42: yeah, i didn't know that one was done without the knowledge of the rally team, though there was quite a bit of discussion on the -dev ml about how we were dropping centos 6.x testing once we no longer needed it to support python 2.623:39
boris-42fungi: sure no worries23:39
boris-42fungi: so is there now centos 7?23:39
fungireadding a centos6 job worker is not going to happen at this point, but if centos 7 will work for you then that sounds like a fine alternative. we have them23:39
boris-42fungi: great so same name just centos7?23:40
fungiwe have devstack-centos7 nodes (don't let the name fool you, they don't have devstack running, they just avoid installing extra packages so that frameworks like devstack can declare what they want to install instead)23:41
*** gordc has quit IRC23:42
openstackgerritBoris Pavlovic proposed openstack-infra/project-config: Add experimental job to check Rally installation on Centos 7  https://review.openstack.org/26025823:43
*** sputnik1_ has joined #openstack-infra23:43
boris-42fungi: so it's not bare-centos7?23:43
boris-42fungi: so it will be better to Rally team to have just really not modifed centos image23:44
openstackgerritDiana Whitten proposed openstack-infra/project-config: Add openstack-ux repo  https://review.openstack.org/25923923:44
*** krtaylor has joined #openstack-infra23:44
*** apuimedo has quit IRC23:45
*** sdake has joined #openstack-infra23:45
*** apuimedo_ has quit IRC23:45
fungiboris-42: yes, the bare-.* node labels are also misleading. they're not actually "bare" but rather have a lot of packages preinstalled while the devstack-.* nodes preinstall as little as possible23:45
*** zz_dimtruck is now known as dimtruck23:46
boris-42fungi: so i should deffintelly use devstack- one?23:46
*** apuimedo has joined #openstack-infra23:46
boris-42definitely*23:46
fungiwe're working toward dropping all the bare-.* types and running jobs exclusively on the devstack-.* types (though we're planning to rename the latter to just indicate the distro-release and drop the terms "bare" and "devstack")23:46
fungiyes, try it on devstack-centos7 for now23:46
*** apuimedo_ has joined #openstack-infra23:46
openstackgerritBoris Pavlovic proposed openstack-infra/project-config: Add experimental job to check Rally installation on Centos 7  https://review.openstack.org/26025823:46
boris-42fungi: ^ fixed23:46
fungiboris-42: i think you missed restoring the lines which were dropped from jenkins/jobs/projects.yaml in the change you're sort of reverting23:48
*** piet has joined #openstack-infra23:50
*** apuimedo has quit IRC23:50
*** baoli has joined #openstack-infra23:50
*** baoli has quit IRC23:51
*** apuimedo_ has quit IRC23:51
*** apuimedo has joined #openstack-infra23:52
*** ZZelle has quit IRC23:52
*** apuimedo_ has joined #openstack-infra23:52
*** gildub has joined #openstack-infra23:54
zaroyo! anybody good with setting up smtp mail server?23:55
fungizaro: pretty good. spent much of my life as a mailserver admin in at least some capacity, and still run some smtp servers even today23:56
*** ildikov has quit IRC23:56
*** apuimedo has quit IRC23:56
fungiwhat specifically are you trying to do? send messages out? receive and deliver messages locally? receive messages and forward them back out?23:56
*** otter768 has quit IRC23:57
*** apuimedo_ has quit IRC23:57
*** irenab has joined #openstack-infra23:57
*** changbl has joined #openstack-infra23:57
*** apuimedo has joined #openstack-infra23:57
*** dimtruck is now known as zz_dimtruck23:57
zarofungi: i setup exim as outgoing mail server in a VM.  got it to work from localhost.  but can't seem to get it to list from external IPs23:57
zaro*list/listen23:58
*** apuimedo_ has joined #openstack-infra23:58
fungiaha, so you want it to receive messages from the internet?23:58
*** irenab has quit IRC23:58
*** Guest10064 is now known as TongMaster23:58
fungizaro: in the typical ubuntu/debian packages of exim4 there should be a /etc/exim4/update-exim4.conf.conf file23:59
zarofungi: basically i want to use it for testing gerrit emails.  want to setup gerrit to connect to i23:59
zaroi/it23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!