Tuesday, 2018-10-09

*** sthussey has quit IRC00:05
*** jamesmcarthur has joined #openstack-infra00:12
*** jamesmcarthur has quit IRC00:16
*** yamamoto has quit IRC00:22
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: fetch-javascript-content-tarball: fix tarball relative path  https://review.openstack.org/60879400:22
*** hwoarang has quit IRC00:27
*** hwoarang has joined #openstack-infra00:28
*** longkb has joined #openstack-infra00:30
corvusrpioso, fungi: also, if you want mouse integration, you can shift-click (that's what i do)00:42
corvus(and yeah, that makes 'copy rectangle' shift-ctl-alt click-drag, which is.. fun to do)00:43
fungiindeed. i just turn off mouse integration in all my console apps that have grown it over time. wish my terminal emulator could simply be configured not to pass pointer events through at all00:44
*** bdodd_ has joined #openstack-infra00:47
*** bdodd has quit IRC00:50
*** yamamoto has joined #openstack-infra00:50
openstackgerritTristan Cacqueray proposed openstack-infra/puppet-zuul master: Revert "Revert "Revert "Revert "Add rewrite rules for HTML5 url""""  https://review.openstack.org/60660100:55
*** rlandy|bbl is now known as rlandy00:59
*** tdasilva has quit IRC00:59
*** tristanC has quit IRC01:01
*** tristanC has joined #openstack-infra01:01
*** zhangfei has joined #openstack-infra01:04
*** hongbin has joined #openstack-infra01:08
*** zhangfei has quit IRC01:18
*** slagle has joined #openstack-infra01:20
*** mrsoul has quit IRC01:35
openstackgerritMerged openstack-infra/zuul-jobs master: fetch-javascript-content-tarball: fix tarball relative path  https://review.openstack.org/60879401:41
tristanCinfra-root: can someone please re-enqueue openstack-infra/zuul post jobs, e.g. zuul enqueue-ref --tenant openstack --trigger gerrit --pipeline post --project openstack-infra/zuul --ref master01:43
*** d0ugal has quit IRC01:48
*** annp has quit IRC01:49
*** longkb has quit IRC01:49
*** longkb has joined #openstack-infra01:50
*** annp has joined #openstack-infra01:50
*** d0ugal has joined #openstack-infra01:51
*** yamamoto has quit IRC01:56
mordredtristanC: done02:06
fungitristanC: mordred: instead i approved a couple of small doc improvements for zuul which already had a +202:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: WIP: docker-compose quickstart example  https://review.openstack.org/60834402:12
*** bobh has joined #openstack-infra02:14
*** apetrich has quit IRC02:15
*** rlandy has quit IRC02:22
*** longkb has quit IRC02:23
mordredfungi: awesome!02:23
*** longkb has joined #openstack-infra02:24
*** yamamoto has joined #openstack-infra02:24
openstackgerritMerged openstack-infra/zuul master: Doc: executor operations document pause, remove graceful  https://review.openstack.org/60245502:36
openstackgerritMerged openstack-infra/zuul master: Doc: executor operations - explain jobs will be restarted at restart  https://review.openstack.org/60313602:36
tristanCmordred: hum, the enqueue-ref didn't worked, all jobs failed with retry_limit...02:38
tristanCnow the doc changes entered the post, lets see how it goes02:38
mordredtristanC: ++02:39
*** psachin has joined #openstack-infra02:40
*** armax has joined #openstack-infra02:43
*** lbragstad has joined #openstack-infra02:43
tristanCalright, zuul web content got published, let's wait for puppet pass now02:50
tristanCok, it worked, but index.html is not loaded on '/', just for http://zuul.openstack.org/index.html02:50
tristanCinfra-core: could we push for https://review.openstack.org/#/c/606601/ now?02:51
*** eernst has joined #openstack-infra02:54
mordredtristanC: will 606601 fix that - I'm guessing the rewrite rules are expecting a behavior that that tarball isn't providing?02:59
mordredtristanC: oh - wait a sec - that's the puppet-zuul change03:00
mordredfungi: in a position to +2 606601 again?03:00
*** dave-mccowan has quit IRC03:02
tristanCmordred: 606601 should fix zuul.openstack.org url serving that are not "/index.html"03:04
mordredtristanC: I just applied it by hand and it doesn't seem to have worked03:04
mordredtristanC: I just applied it by hand and it doesn't seem to have worked03:07
mordredgah03:07
*** ramishra has joined #openstack-infra03:08
tristanCmordred: hum, that's weird, curl -I https://zuul.openstack.org/status still says "Server: CherryPy/18.0.1"03:08
tristanCmordred: which seems like the L45 of the previous version of https://review.openstack.org/#/c/606601/2/templates/zuulv3.vhost.erb03:09
mordreddoes apache2ctl graceful not work anymore?03:09
*** psachin has quit IRC03:10
mordredtristanC: I agree with the behaivor from curl - I get the same thing03:11
*** armax has quit IRC03:12
*** armax has joined #openstack-infra03:13
mordredtristanC: ok - missed a line on the status one - that's fine now03:15
mordredtristanC: but / still doesn't work03:15
tristanCmordred: yes, now something else broke, curl https://zuul.openstack.org/static/css/main.6956f7aa.css doesn't returns the css but the index.html...03:16
mordredisn't that what RewriteRule . /index.html [L] will do?03:16
mordredoh  nevermind - that's got the conditions on it03:17
tristanCthe condition should make it return existing files like css03:17
mordredyah03:17
tristanCabout '/' returning 404, does apache configuration has "DirectoryIndex index.html" ?03:19
mordredtristanC: nope - adding03:20
mordredno luck03:20
tristanCmordred: and about existing file not being returned, could we try adding "RewriteBase /" right before the "RewriteCond %{REQUEST_FILENAME} !-f"?03:20
mordredRewriteBase: only valid in per-directory config files03:21
* tristanC scratchs head... then maybe wrapping all the rewrite rules into a "<Location />" ?03:23
*** bobh has quit IRC03:23
tristanCor, replace "RewriteCond %{REQUEST_FILENAME} !-f" byt ""RewriteCond <%= @docroot %>/%{REQUEST_FILENAME} !-f"03:25
mordredtristanC: location worked03:26
tristanCyeah, not sure what you did but it's now working03:26
mordredtristanC: adding the location wrap around the rules03:26
tristanCbut now, the /api isn't being forwarded to the /api03:27
tristanCto the zuul-web*03:27
mordred*headdesk*03:27
mordredtristanC: http://paste.openstack.org/show/731725/03:27
mordredtristanC: and the docroot addition does not work03:29
tristanCwait, now https://zuul.openstack.org/status is working fine03:29
tristanCbut, https://zuul.openstack.org/ still returns 40403:29
*** armax has quit IRC03:30
mordredI reverted the locaiton putting it back03:32
*** carl_cai has quit IRC03:32
tristanCmordred: maybe we need to drop the "RewriteRule ^/$ /status [L]" line03:35
mordredtristanC: ok ... / is back03:37
mordredtristanC: I think I got it03:40
*** dayou has quit IRC03:41
tristanCmordred: '/' seems to work indeed, but we lost the /api/* redir to zuul-web :)03:41
mordredoh - poo03:41
*** psachin has joined #openstack-infra03:44
*** lbragstad has quit IRC03:46
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build  https://review.openstack.org/60883403:47
tristanCmordred: anything i can do to help? could you paste the current httpd.conf?03:47
*** lbragstad has joined #openstack-infra03:48
* ianw checks the status page, worries, checks irc, sees the A Team are on it :)03:49
mordredtristanC:, ianw: http://paste.openstack.org/show/731729/03:50
mordredLocation fixes / being index.html but breaks api proxy03:51
tristanCmordred: could we try dropping the "^/" before the api rewrites rule?03:51
*** eernst has quit IRC03:52
ianwahh, i get an obscure javascript error in the console, but nothing particularly helpful03:53
tristanCianw: that's because '/api/info' returns the index.html instead of a json object03:54
mordredtristanC: boom - got it03:56
mordredtristanC: it should all be good now?03:56
ianwhrm, unless i'm cached up the wazoo or something, i'm still seeing just "loading..."03:57
tristanCmordred: nice, seems to work as expected03:57
tobiashLooks good on my phone03:57
tristanCianw: "loading..." page doesn't actually retry, you need to refresh03:57
tristanCmordred: could you paste the working conf, i'll update the puppet change with it03:57
mordredtristanC: I'm about to just send in the puppet update :)03:57
tristanCmordred: even better :) thanks!03:58
ianwhrm, even in an incognito window still not working for me03:58
*** lbragstad has quit IRC03:58
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Revert "Revert "Revert "Revert "Add rewrite rules for HTML5 url""""  https://review.openstack.org/60660103:58
tristanCianw: are you using the https:// scheme?03:58
mordredhttp://paste.openstack.org/show/731730/03:58
mordredlemme apply to http too03:58
ianwahhh, yeah, ok that's it03:59
tristanCmordred: much better, using rewriterule in location is hard^Wnot recommended :)03:59
clarkbbuilds listing doesn't have all the filters anymore04:00
mordred++ yah - srrsly04:00
mordredclarkb, ianw: could y'all +A 606601 ?04:00
*** hongbin has quit IRC04:00
mordredclarkb: good poiunt - tristanC - the new thing has a selector box for filter - the old let you combine?04:01
tristanCclarkb: actually, there should be more filters available, there is a selector04:01
tristanCmordred: you should be able to combine multiple filter, like pipeline: gate, pipeline: post04:02
clarkbah if you hit enter it adds them as ANDed together04:02
clarkbthat isn't clear through the UI fwiw until you try it04:02
mordredAH - I see it04:02
clarkblooks like a single selector otherwise04:03
clarkb(good enoguh for now)04:03
mordredyup - but now that I know I agree - I can do those things04:03
mordredtristanC: as a followup - I just tried overtyping  a project filter on status - and because a refresh happened I lost my typing04:04
clarkbmordred: in 606601 where does the zuul.openstack.org is actually openstack tenant stuff happen? is that all purely in the api proxied data? I guess it must be04:04
mordredtristanC: I have no idea how to fix that - but we might want to play around with it some04:04
clarkband then index.html is rendering only04:04
tristanCmordred: sure, the hardest part was to get it served ;)04:05
tristanCafk lunch, bbl04:05
mordredclarkb: yah - in our apache rewrite rules we proxy to /api/tenant/openstack04:05
clarkbright, I want to say there is or was tenant info encoded into the js/html/css stuff at one point though04:06
clarkbbut that must all be gone because its  only the api proxied paths that seem to know now04:06
clarkbhrm no this still knows, the top right says tenant: openstack04:07
*** udesale has joined #openstack-infra04:07
clarkbmaybe that is from the api04:07
clarkbzomg console streaming autoscroll disable works now04:08
clarkbfavorite feature04:08
*** dayou has joined #openstack-infra04:08
mordredclarkb: the status filtering is all reactive and pretty instant now too04:13
mordredso I *thnk* people's browsers should be much happier WRT cpu04:13
clarkbit seems my phone still says 404 or maybe its reverted?04:13
mordredclarkb: yah - I hand-edited the files - so puppet probably unedited them for me04:14
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build  https://review.openstack.org/60883404:14
clarkbmordred: ok 606601 has the +2s you need but I didn't approve it04:14
clarkbI need to find bed now04:14
mordredI'll +A right now04:14
clarkbmordred: tristanC did the fixes end up being purely in the apache config then? zuul itself was fine as is?04:15
mordredthere was also a fix to the tarball build job04:15
clarkbah04:15
mordredandwe have a decent amount of work in front of us to make sure this is properly tested04:15
clarkband what makes react so much more efficient here compraed to the old angular stuff?04:16
clarkbwe didn't make the json smaller04:16
clarkbapparently react does magic04:17
*** e0ne has joined #openstack-infra04:27
*** e0ne has quit IRC04:27
*** jaosorior has joined #openstack-infra04:28
mordredclarkb: well- the old stuff wasn't angular yet - the old stuff was jquery iterating over the json structures04:29
mordredclarkb: the react patch also rewrite the status page in native react - so the fancy react dom binding and whatnot gets to do its happy stuff04:29
mordredAJaeger: whence you awaken, the status page is currently unhappy - puppet patch to fix is in flight04:30
mordredAJaeger: workaround is to just hit https://zuul.openstack.org/status instead of https://zuul.openstack.org/04:30
tobiashmordred: how shall we proceed with the react revert?04:30
tobiashIt has +a but failed check04:31
mordredtobiash: I think we've got the deploy issues sorted for openstack - so I vote we don't revert and roll forward fixing things04:31
mordred(like adding better testing and documentation around this)04:32
tobiashmordred: then someone should vote on that so a recheck won't land it04:32
mordredtobiash: done04:33
tobiash:)04:35
*** pcaruana has joined #openstack-infra04:38
mnaserhmm04:38
mnaserzuul.o.o is 404-ing04:39
mnaseroh i guess https://review.openstack.org/#/c/606601/ is the fix04:39
mnaserok http://zuul.openstack.org/index.html is the page to use04:40
mnaserooooh hello thats pretty!04:40
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build  https://review.openstack.org/60883404:46
jaosoriorthat's looking pretty good04:50
openstackgerritMerged openstack-infra/puppet-zuul master: Revert "Revert "Revert "Revert "Add rewrite rules for HTML5 url""""  https://review.openstack.org/60660104:52
prometheanfirerevert revert revert revert revert?04:55
prometheanfireianw: if around, mind looking at the dib caching stuff?04:56
ianwif it's even it's good, if it's odd it's bad04:56
ianwpromethanfire: did it pass the ci gentoo build?04:56
prometheanfireshould have04:57
prometheanfirelolnope04:58
ianwwell maybe fix that first :)04:58
prometheanfiredid finalize.d change or something?04:58
prometheanfirehttp://logs.openstack.org/68/604268/6/check/dib-dsvm-functests-python2-ubuntu-trusty-extras/c23f2b7/job-output.txt.gz#_2018-10-08_06_12_29_347252 means /usr/porage was cleaned up04:58
ianwwe haven't changed anything structural like that04:59
prometheanfirethe cache, is it available during finalize.d?05:00
prometheanfiresince I mount /usr/porage with it05:00
prometheanfireya, looks like that's probably it05:01
*** e0ne has joined #openstack-infra05:04
*** e0ne has quit IRC05:04
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: enable caching for gentoo builds  https://review.openstack.org/60426805:05
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: simplify python3.6 selection on gentoo  https://review.openstack.org/60857605:06
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: web: add build page  https://review.openstack.org/59702405:07
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: simplify python3.6 selection on gentoo  https://review.openstack.org/60857605:10
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: simplify overlay logic for Gentoo  https://review.openstack.org/60857705:10
*** diablo_rojo has joined #openstack-infra05:14
*** jbadiapa has quit IRC05:14
*** janki has joined #openstack-infra05:25
*** apetrich has joined #openstack-infra05:32
*** diablo_rojo has quit IRC05:36
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: web: fix rewrite rule installation doc  https://review.openstack.org/60885005:44
openstackgerritTrinh Nguyen proposed openstack-infra/project-config master: Create storyboard project for python-freezerclient  https://review.openstack.org/60885205:48
*** quiquell has joined #openstack-infra05:53
*** carl_cai has joined #openstack-infra05:58
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: enable caching for gentoo builds  https://review.openstack.org/60426806:03
*** kushinauwu has joined #openstack-infra06:25
kushinauwuI'm an outreachy applicant. Can I know if this the right channel to discuss about openstack outreachy projects? Thanks.06:33
*** aojea has joined #openstack-infra06:35
*** jbadiapa has joined #openstack-infra06:36
*** kopecmartin|off is now known as kopecmartin|ruck06:38
*** coolsvap has joined #openstack-infra06:38
AJaegerkushinauwu, welcome! #openstack-outreachy is the proper channel for outreachy in general.06:40
kushinauwuoh thanks!06:41
*** slaweq has joined #openstack-infra06:59
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: remove job settings for barbican repositories  https://review.openstack.org/59966307:04
*** rcernin has quit IRC07:08
*** jtomasek has joined #openstack-infra07:08
openstackgerritAntonio Ojea proposed openstack-infra/openstack-zuul-jobs master: DNM - testing opensuse leap 15.0  https://review.openstack.org/60885907:10
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: DNM - testing opensuse leap 15.0  https://review.openstack.org/60885907:12
*** ginopc has joined #openstack-infra07:12
*** Emine has joined #openstack-infra07:22
*** electrofelix has joined #openstack-infra07:25
*** annp has quit IRC07:28
*** annp has joined #openstack-infra07:30
*** kjackal has joined #openstack-infra07:35
ssbarnea_AJaeger: regarding silencing rsync, this a real deal, especially with ARA files. it makes no sense for listing all ARA files when this takes >50-60% of the entire console output, just because someone *may* need it. for the same reason we could even dump the entire node memory on disk, as it could clearly help someone debug things at some point. I see no point of seeing on screen huge list of files that were successfully copied to log07:40
ssbarnea_ server, the files are already there is someone needs to look at them. quiet rsync does not mean hiding the errors, it only hides copied files.07:40
AJaegerssbarnea_: please discuss with rest of team.07:41
ssbarnea_AJaeger: sure, maybe adding the subject to today team meeting. i know decisions about verbosity are always trade-offs07:41
openstackgerritLiam Young proposed openstack-infra/project-config master: Add cells charm and interfaces  https://review.openstack.org/60886707:42
*** tosky has joined #openstack-infra07:46
*** priteau has joined #openstack-infra07:48
*** roman_g has joined #openstack-infra07:49
*** priteau has quit IRC07:50
AJaegerssbarnea_: good idea, please add to wiki page07:50
ssbarnea_AJaeger: already did.07:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build  https://review.openstack.org/60883407:52
ianwssbarnea_: i know it's frustrating, it's often difficult to get everyone on board with changing as the status quo is a big hurdle to overcome.  if it ain't broke and all that ... convincing people it is broke can be some effort07:55
ianwas usual, an xkcd for everything :) https://xkcd.com/1172/07:55
*** jpich has joined #openstack-infra07:57
ssbarnea_ianw: indeed, one of my favs.07:57
*** kushinauwu has quit IRC08:05
*** dtantsur|afk is now known as dtantsur08:08
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Use merger to get list of files for pull-request  https://review.openstack.org/60328708:10
*** rossella_s has quit IRC08:10
*** e0ne has joined #openstack-infra08:11
*** rossella_s has joined #openstack-infra08:14
*** janki is now known as janki|lunch08:16
*** e0ne has quit IRC08:17
*** e0ne has joined #openstack-infra08:18
*** e0ne has quit IRC08:26
*** sshnaidm|afk is now known as sshnaidm08:29
*** rossella_s has quit IRC08:37
*** rossella_s has joined #openstack-infra08:38
*** shardy has joined #openstack-infra08:40
*** priteau has joined #openstack-infra08:45
*** kushinauwu has joined #openstack-infra08:46
*** dpawlik has quit IRC08:51
*** dpawlik has joined #openstack-infra08:52
fricklerinfra-root: has anyone looked into possible issues with the upcoming ksk rollover in relation to our unbound setup? I'm fearing https://www.unbound.net/root-11sep-11oct.html may be an issue for fresh instances08:53
*** psachin has quit IRC08:54
*** lbragstad has joined #openstack-infra08:56
*** markmcd has quit IRC09:03
*** ginux has joined #openstack-infra09:04
*** ginux is now known as Guest6890309:05
*** ginopc has quit IRC09:07
*** Guest68903 is now known as ginopc09:07
*** markmcd has joined #openstack-infra09:12
openstackgerritLiam Young proposed openstack-infra/project-config master: Add cells charm and interfaces  https://review.openstack.org/60886709:15
*** panda has quit IRC09:22
ianwfrickler: would if affect us just using unbound as a forwarder?09:24
*** panda has joined #openstack-infra09:24
openstackgerritTobias Henkel proposed openstack-infra/nodepool master: Reduce socket connect timeout in nodescan  https://review.openstack.org/60889709:28
*** kushinauwu has left #openstack-infra09:38
*** kushinauwu has quit IRC09:38
*** imacdonn has quit IRC09:39
*** vabada has quit IRC09:46
*** jamesmcarthur has joined #openstack-infra09:48
*** dave-mccowan has joined #openstack-infra09:49
*** jamesmcarthur has quit IRC09:52
*** imacdonn has joined #openstack-infra09:52
fricklerianw: unbound would still perform the dnssec validation locally, I think09:55
openstackgerritArx Cruz proposed openstack-infra/devstack-gate master: Enable process_stackviz function to be optional  https://review.openstack.org/47578809:56
arxcruzfungi: mtreinish hey, can you guys take a look at this when you have time? ^09:57
*** vabada has joined #openstack-infra09:57
*** janki|lunch is now known as janki10:02
*** tosky has quit IRC10:04
*** tosky has joined #openstack-infra10:04
*** kjackal has quit IRC10:05
*** rossella_s has quit IRC10:09
*** rossella_s has joined #openstack-infra10:10
*** yamamoto has quit IRC10:12
*** yamamoto has joined #openstack-infra10:13
*** yamamoto has quit IRC10:13
*** yamamoto has joined #openstack-infra10:14
*** lbragstad has quit IRC10:16
*** quiquell is now known as ssquique10:16
*** ssquique is now known as quiquell10:22
*** markvoelker has joined #openstack-infra10:25
*** yamamoto has quit IRC10:25
*** yamamoto has joined #openstack-infra10:26
*** yamamoto has quit IRC10:30
*** kjackal has joined #openstack-infra10:30
*** rossella_s has quit IRC10:46
*** rossella_s has joined #openstack-infra10:49
*** udesale has quit IRC10:52
*** armax has joined #openstack-infra10:53
*** markvoelker has quit IRC10:58
*** rossella_s has quit IRC11:04
*** rossella_s has joined #openstack-infra11:05
*** ansmith has quit IRC11:12
*** amoralej is now known as amoralej|lunch11:14
*** yamamoto has joined #openstack-infra11:15
*** longkb has quit IRC11:17
*** slagle has quit IRC11:22
*** armax has quit IRC11:27
*** jrist has joined #openstack-infra11:29
*** aidin has joined #openstack-infra11:31
*** jrist has quit IRC11:36
quiquellWe need a infra-root to prioritize a promotion-blocker review for tripleo11:41
*** yamamoto has quit IRC11:49
*** aidin has quit IRC11:49
*** yamamoto has joined #openstack-infra11:50
*** yamamoto has quit IRC11:50
*** yamamoto has joined #openstack-infra11:50
*** markvoelker has joined #openstack-infra11:51
*** rossella_s has quit IRC11:56
*** aidin has joined #openstack-infra11:58
*** rossella_s has joined #openstack-infra12:00
*** jesusaur has quit IRC12:01
*** carl_cai has quit IRC12:02
*** zul has joined #openstack-infra12:05
*** aidin has quit IRC12:06
*** jesusaur has joined #openstack-infra12:06
*** emerson has quit IRC12:08
*** rh-jelabarre has joined #openstack-infra12:10
*** tpsilva has joined #openstack-infra12:14
*** rosmaita has joined #openstack-infra12:15
*** emerson has joined #openstack-infra12:15
fungiquiquell: the last time you asked, it wasn't fixing any problem with your gate pipeline jobs and was something to do with periodic jobs which weren't going to run again until the next day12:16
fungiquiquell: when you say promotion-blocker are you talking about a bug blocking changes from succeeding testing in tripleo's gate pipeline this time?12:17
quiquellfungi: We needed that fix the promotion jobs12:17
quiquellfungi: It's again a promotion blocker12:17
fungiquiquell: i have no idea what promotion jobs you're talking about12:17
fungiis this an rdo thing?12:17
quiquellfungi: Sorry you are right, it's not a gate issue12:18
quiquellfungi: Excuse me for the last time, we were in a hurry12:18
*** chandankumar has joined #openstack-infra12:19
fungiyeah, i'm not inclined to perform manual intervention on your behalf because you're in a hurry, sorry12:19
fungiwe normally promote gate-breaking bug fixes in order to conserve what would otherwise be wasted test resources spent on repeated gate resets12:20
fungiit has nothing to do with how much of a hurry anyone's in, and everything to do with using our test quota responsibly12:21
*** yamamoto has quit IRC12:23
*** yamamoto has joined #openstack-infra12:24
rosmaitaapologies if this has already been answered somewhere, but is there documentation for the zuul builds page, specifically how to construct URLs that will display a particular project/job/pipeline etc perhaps even in a particular time range?12:27
*** trown|outtypewww is now known as trown12:28
*** rlandy has joined #openstack-infra12:28
*** yamamoto has quit IRC12:29
tristanCrosmaita: it's not documented, but the recent new dashboard let you set filter through query string, e.g.: https://zuul.openstack.org/builds?project=openstack%2Fcinder&pipeline=periodic12:29
tristanCrosmaita: time range aren't implemented yet, this will need some server side modifications12:29
tristanCmultiple filter should be possible, but it seems like there is a bug server side which makes it returns internal error12:30
*** sthussey has joined #openstack-infra12:34
*** kgiusti has joined #openstack-infra12:34
*** yamamoto has joined #openstack-infra12:34
*** apetrich has quit IRC12:35
rosmaitatristanC: thanks! now i see why my old URLs aren't working any more, it used to be "builds.html?querystring" but now that redirects to status; "builds?querystring" is working fine12:37
*** apetrich has joined #openstack-infra12:42
*** kushinauwu has joined #openstack-infra12:43
*** kushinauwu has quit IRC12:45
fungirosmaita: part of why it's not documented yet is that it's still in flux, but hopefully this will all stabilize very soon12:45
*** njohnston has joined #openstack-infra12:46
*** amoralej|lunch is now known as amoralej12:47
openstackgerritMichal Cila proposed openstack-infra/project-config master: add openstack/flare project  https://review.openstack.org/60894012:51
*** carl_cai has joined #openstack-infra12:52
*** agopi has quit IRC12:57
rosmaitafungi: just a suggestion, it would be helpful if the items in the dropdown reflected the keys in the query string, took me a while (had to open the JS that builds the dropdown to find out that 'job' in the dropdown is really 'job_name' in the URL) ... probably too late for that, though12:57
rosmaitadon't get me wrong, though, it's much better having an undocumented interface that works well (like this one does) than a documented crappy one12:58
*** lpetrut has joined #openstack-infra12:58
*** kgiusti has quit IRC13:01
fungiyeah, not a bad idea13:01
fungirosmaita: if you don't have time to add a quick story at https://storyboard.openstack.org/#!/project/openstack-infra/zuul suggesting that improvement, let me know and i'll write something13:03
*** ansmith has joined #openstack-infra13:04
*** dpawlik has quit IRC13:07
*** ociuhandu has joined #openstack-infra13:07
*** zul has quit IRC13:09
*** ijw has joined #openstack-infra13:09
*** ijw has quit IRC13:12
*** ijw has joined #openstack-infra13:12
*** udesale has joined #openstack-infra13:13
*** bobh has joined #openstack-infra13:13
*** panda has quit IRC13:13
*** panda has joined #openstack-infra13:14
*** agopi has joined #openstack-infra13:16
*** quiquell is now known as quiquell|lunch13:16
*** yamamoto has quit IRC13:17
*** yamamoto has joined #openstack-infra13:17
*** ginopc has left #openstack-infra13:17
*** mriedem has joined #openstack-infra13:19
*** udesale has quit IRC13:21
openstackgerritMartin Kopec proposed openstack-infra/elastic-recheck master: Add check for bug 1796849  https://review.openstack.org/60896813:21
openstackbug 1796849 in tripleo "Mirror/network issues at mirror.us-west-1.packethost.openstack.org" [Undecided,New] https://launchpad.net/bugs/179684913:21
*** janki has quit IRC13:23
*** aojeagarcia has joined #openstack-infra13:25
*** rlandy_ has joined #openstack-infra13:26
mriedemhttps://review.openstack.org/#/c/606853/ and its dependent change would help move forward placement extraction into its own repo for our dsvm jobs13:26
*** rlandy has quit IRC13:26
*** lbragstad has joined #openstack-infra13:28
*** aojea has quit IRC13:28
*** quiquell|lunch is now known as quiquell13:36
*** rlandy_ is now known as rlandy13:44
*** hongbin has joined #openstack-infra13:48
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Add openstack/placement to legacy-dsvm-base required-projects  https://review.openstack.org/60826613:53
*** boden has joined #openstack-infra13:57
*** felipemonteiro has joined #openstack-infra13:58
*** eharney has joined #openstack-infra14:00
*** beagles is now known as beagles_cough14:03
*** beagles_cough is now known as beagles14:03
*** ansmith has quit IRC14:08
openstackgerritMichal Cila proposed openstack-infra/project-config master: Add openstack/flare project. Flare is a service for running and scheduling burstable task resources. Typical job is unlimited scientific batch from multiple teams with multiple priorities, which runs on limited compute resources (GPUs for example).  https://review.openstack.org/60900814:09
openstackgerritMichal Cila proposed openstack-infra/project-config master: Add openstack/flare project. Flare is a service for running and scheduling burstable task resources. Typical job is unlimited scientific batch from multiple teams with multiple priorities, which runs on limited compute resources (GPUs for example).  https://review.openstack.org/60901014:12
*** mugsie has joined #openstack-infra14:13
*** yamamoto has quit IRC14:16
*** yamamoto has joined #openstack-infra14:17
*** eharney has quit IRC14:18
*** yamamoto has quit IRC14:21
*** ansmith has joined #openstack-infra14:21
clarkbon mobile the drop down menu for selecting dtatus jobs and builds doesnt seem to work?14:23
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: enable caching for gentoo builds  https://review.openstack.org/60426814:24
fungiconfirmed, if i shrink my browser frame small enough to trigger the "mobile" view, the drop-down menu is nonfunctional for me in firefox14:26
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: simplify python3.6 selection on gentoo  https://review.openstack.org/60857614:26
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: simplify overlay logic for Gentoo  https://review.openstack.org/60857714:27
AJaegerclarkb, fungi, same situation on chromium14:27
*** eharney has joined #openstack-infra14:33
*** quiquell is now known as quiquell|off14:39
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fixed delete presentation for CFP  https://review.openstack.org/60902314:43
openstackgerritMerged openstack-infra/openstackid-resources master: Fixed delete presentation for CFP  https://review.openstack.org/60902314:44
*** bobh has quit IRC14:49
*** ramishra has quit IRC14:55
*** munimeha1 has joined #openstack-infra14:55
*** lpetrut has quit IRC14:56
*** bobh has joined #openstack-infra14:56
*** yamamoto has joined #openstack-infra14:57
*** hamzy has quit IRC14:57
*** carl_cai has quit IRC15:01
*** bobh has quit IRC15:01
*** hamzy has joined #openstack-infra15:01
*** jbadiapa has quit IRC15:02
openstackgerritMichal Cila proposed openstack-infra/project-config master: Add openstack/flare project.  https://review.openstack.org/60901015:07
*** bobh has joined #openstack-infra15:11
*** jamesmcarthur has joined #openstack-infra15:13
*** armax has joined #openstack-infra15:14
*** tdasilva has joined #openstack-infra15:16
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fix on set status on presentation for CFP  https://review.openstack.org/60902915:16
openstackgerritMerged openstack-infra/openstackid-resources master: Fix on set status on presentation for CFP  https://review.openstack.org/60902915:18
rosmaitafungi: was adding a story to storyboard, but while doing that discovered that the new interface displays the querystring in the URL as you add filters, so really no need for documentation15:26
rosmaitathough i did get a 400 trying to add the story to storyboard, and then got a 400 trying to add a story to the storyboard board reporting the bug.  i suspect something is set weird in my browser (chrome on Fedora 28)15:27
*** kgiusti has joined #openstack-infra15:28
fungirosmaita: did you use the create new drop-down or the add story button?15:29
rosmaitafungi: create-new dropdown15:29
fungiyou probably hit https://storyboard.openstack.org/#!/story/2003650 in that case15:30
openstackgerritDoug Hellmann proposed openstack-infra/yaml2ical master: add monthly recurrence options  https://review.openstack.org/60868015:30
fungiit's a regression introduced by the new name-based project urls, unfortunately15:30
rosmaitafungi: you're right, that's the issue15:31
openstackgerritDoug Hellmann proposed openstack-infra/yaml2ical master: add monthly recurrence options  https://review.openstack.org/60868015:31
*** eharney_ has joined #openstack-infra15:31
*** eharney has quit IRC15:34
*** Goneri has joined #openstack-infra15:39
*** ianychoi has quit IRC15:39
*** armax has quit IRC15:39
fungiheading out to grab lunch and run some errands but should be back well in advance of the meeting at 1900z15:39
fungiprobably no more than 2 hours15:40
*** Goneri has quit IRC15:41
*** munimeha1 has quit IRC15:43
*** armstrong has joined #openstack-infra15:43
*** diablo_rojo has joined #openstack-infra15:44
armstrong@diablo_rojo_phon: hello, please can I have a list of all the projects that migrated from launchpad to storyboard?15:44
*** aojeagarcia has quit IRC15:46
armstrongSorry meant to @diablo_rojo: hello, please can I have a list of all the projects that migrated from launchpad to storyboard?15:49
*** hamzy has quit IRC15:50
*** janki has joined #openstack-infra15:52
toskyarmstrong: you can check the projects where use_storyboard: true is set in gerrit/projects.yaml, openstack-infra/project-config.git15:55
armstrong@tosky: thanks for tour quick response15:58
armstrongI appreciate15:58
toskyuse-storyboard: true, not use_storyboard: true15:59
armstrongOk16:03
diablo_rojoarmstrong, yeah that's the quickest way to see which use sb already16:04
diablo_rojounless there is one in particular, I can probably answer that for you16:04
openstackgerritMerged openstack-infra/zuul master: Speed up build list query under mysql  https://review.openstack.org/60517016:04
weshaycan tripleo please get this patch moved to the top of the queue https://review.openstack.org/#/c/606986/16:09
weshayresolves some gate failures we're seeing16:09
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: docker-compose quickstart example  https://review.openstack.org/60834416:17
openstackgerritChris Hoge proposed openstack-infra/irc-meetings master: RefStack is in maintenance, cancel meeting  https://review.openstack.org/60904716:17
*** felipemonteiro has quit IRC16:19
*** kashyap has left #openstack-infra16:19
clarkbconfig-core infra-root can we get reviews on https://review.openstack.org/#/c/608303/ to address one of the gate issues on the infra side of things16:19
corvusclarkb: you tested it right?16:20
clarkbcorvus: yes I shouldve left links with those details on the change but maybe I only did that here16:20
clarkbcorvus https://review.openstack.org/#/c/608732/ is the test change16:21
corvusclarkb: i'll comment and approve16:21
*** coolsvap has quit IRC16:23
*** jpich has quit IRC16:23
*** kjackal has quit IRC16:24
*** diablo_rojo has quit IRC16:25
*** panda has quit IRC16:34
*** armax has joined #openstack-infra16:36
*** panda has joined #openstack-infra16:36
clarkbweshay: promoting that change will restart jobs for the tripleo gate queue. I assume worth it in this case because this is fixing a failure causing bug?16:42
clarkbweshay: I'm ready to promote it now if you are still wanting to do that16:42
*** gyee has joined #openstack-infra16:43
clarkbbut then I've got to go back to conferencing.16:43
*** mriedem is now known as mriedem_stew16:43
clarkbrelated to ^ my talk happens just a few minutes after the infra meeting so I may have fungi chair the meeting today so that I can prep for that but I will likely attend the meeting as it falls during our lunch break16:44
openstackgerritMerged openstack-infra/zuul-jobs master: Retry failed git pushses on workspace setup  https://review.openstack.org/60830316:45
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Updated Presentation serializer  https://review.openstack.org/60905416:46
*** armax has quit IRC16:46
openstackgerritMerged openstack-infra/openstackid-resources master: Updated Presentation serializer  https://review.openstack.org/60905416:47
*** jbadiapa has joined #openstack-infra16:47
*** jrosser has joined #openstack-infra16:47
*** boden has quit IRC16:49
*** eharney_ is now known as eharney16:52
*** boden has joined #openstack-infra16:52
*** bhavikdbavishi has joined #openstack-infra16:57
*** bhavikdbavishi1 has joined #openstack-infra17:02
*** kushinauwu has joined #openstack-infra17:03
*** bhavikdbavishi has quit IRC17:04
*** bhavikdbavishi1 is now known as bhavikdbavishi17:04
weshayclarkb, sorry for the late reply .. that change will fix a fairly consistent gate failure we've seen w/ ara and our ansible playbooks17:05
weshayimho it's worth it17:05
weshaymwhahaha, ^17:05
mwhahahai concur17:06
clarkbok promoting now17:06
clarkbdone17:07
*** yamamoto has quit IRC17:08
*** yamamoto has joined #openstack-infra17:08
*** dtantsur is now known as dtantsur|afk17:08
weshaythanks clarkb17:09
*** boden has quit IRC17:14
*** janki has quit IRC17:14
*** kushinauwu has quit IRC17:17
*** kushinauwu has joined #openstack-infra17:18
*** trown is now known as trown|lunch17:19
*** janki has joined #openstack-infra17:22
*** apetrich has quit IRC17:22
*** jamesmcarthur has quit IRC17:22
*** jamesmcarthur has joined #openstack-infra17:22
*** jamesmcarthur has quit IRC17:27
priteauIs there something wrong with https://review.openstack.org/#/c/602173/ or with the infra? The patch got its W+1 9 hours ago, but I don't see it listed anywhere on http://zuul.openstack.org/status17:32
clarkbpriteau: gerrit doesnt seem to know about the parent commit of that vhange? I'm on a phone at a conf so not in a great spot to debug further17:40
*** shardy has quit IRC17:41
priteauThe parent commit is a merge commit, but it is in master.17:42
priteauShould I just rebase it to work around the issue or do you want the opportunity to investigate it further?17:44
clarkbits probably worth undersranding the problem17:44
clarkbthe little orange dot next to the parent commit sha is why I look at that17:44
clarkbcorvus or fungi may be able to take another look17:45
priteauOK, I will leave it untouched for now.17:45
*** ociuhandu has quit IRC17:45
*** jamesmcarthur has joined #openstack-infra17:45
*** amoralej is now known as amoralej|off17:49
corvushrm, i don't see an orange dot, and the parent seems to be legitimately in the git history17:49
*** Swami has joined #openstack-infra17:49
*** electrofelix has quit IRC17:50
corvuspriteau: it looks like zuul missed the event from gerrit; i don't see it in the logs.  you can go ahead and add another workflow+1 (or remove and add the existing one) to try triggering it again17:53
openstackgerritCorey Bryant proposed openstack-infra/openstack-zuul-jobs master: Create openstack-tox-py37 job  https://review.openstack.org/60906617:54
priteauI see the orange dot.17:56
priteauIt doesn't make sense though: "If an ancestor change is marked with an orange dot it means that the currently viewed patch set depends on a outdated patch set of the ancestor change. This is because a new patch set for the ancestor change was uploaded in the meantime and as result the currently viewed patch set now needs to be rebased."17:56
priteauThis patch was created after the parent commit was merged in master17:57
clarkbya that may be a bug in gerrit?17:57
priteauDoes the orange dot next to parent actually mean something else?17:58
*** armax has joined #openstack-infra17:58
clarkbpriteau: if you ut your mouse pointer over the top of it it should give you the specific data for that context17:58
priteauAnyway, if the issue is a missed event, I guess the orange dot was just a red herring17:58
clarkbyup17:59
priteau"Not current - rebase possible"17:59
openstackgerritCorey Bryant proposed openstack-infra/openstack-zuul-jobs master: Add openstack-python37-jobs-* templates  https://review.openstack.org/60907017:59
priteauDoes it just mean that parent != HEAD?17:59
corvusoh weird, the orange dot only shows up if you're logged in18:00
priteauGerrit view for this patch after I W+1'ed is showing: "Updated: in the future"18:01
priteauAnyway, Zuul has started gate jobs, thanks corvus and clarkb!18:01
*** hamzy has joined #openstack-infra18:05
AJaegerinfra-root, I think we're leaking ports in ovh-bhs1 again, see http://grafana.openstack.org/d/BhcSH5Iiz/nodepool-ovh?orgId=1 - can you check ports, please?18:06
*** yamamoto has quit IRC18:07
*** yamamoto has joined #openstack-infra18:07
*** yamamoto has quit IRC18:08
*** kushinauwu has quit IRC18:08
AJaegerinfra-root, any known problems with packethost? The node usage graph looks odd http://grafana.openstack.org/d/U462abNik/nodepool-packethost?orgId=118:08
*** yamamoto has joined #openstack-infra18:09
fungithe mirror server seems to be up this time, at least18:10
*** jamesmcarthur has quit IRC18:10
*** jamesmcarthur has joined #openstack-infra18:10
*** yamamoto has quit IRC18:13
*** annp has quit IRC18:20
*** armstrong has quit IRC18:24
*** kaiokmo has quit IRC18:26
ShrewsAJaeger: fungi: openstack.exceptions.SDKException: Error in creating the server: Build of instance 20b02ba1-1ea1-42ed-ad11-07b17e4fb81c aborted: Failed to allocate the network(s) with error No fixed IP addresses available for network: b71a8dc0-709d-4994-87a4-6ecec4c4391c, not rescheduling.18:27
Shrewslatest packethost error in nodepool logs18:28
fungifun, so probably a fip leak18:28
Shrewsor we finally ran out of IPv4 addresses!18:29
*** mriedem_stew is now known as mriedem18:31
fungihttps://ipv6.he.net/statistics/18:31
fungiafrica and europe still have a few18:32
*** ijw has quit IRC18:37
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Convert some more repos to publish-to-pypi-python3  https://review.openstack.org/60908718:37
*** bhavikdbavishi has quit IRC18:38
*** eernst has joined #openstack-infra18:38
*** janki has quit IRC18:38
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-tempest-dsvm-cinder-v1  https://review.openstack.org/60908918:42
*** kjackal has joined #openstack-infra18:43
clarkbfungi: it probably would be best if you can chair the meeting. Not sure if you saw that earlier. This way I can grab something to eat and make sure the projector works before my talk18:46
clarkbscheduling is hard18:47
*** armax has quit IRC18:49
*** kaiokmo has joined #openstack-infra18:51
*** yamamoto has joined #openstack-infra18:51
fungiyeah, happy to steer18:51
fungig'luck on your talk!18:51
*** trown|lunch is now known as trown18:52
*** eharney has quit IRC18:53
*** ijw has joined #openstack-infra18:57
fungiinfra meeting coming up in one minute in #openstack-meeting18:59
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: update caldav client lib due an error on vcard response parsing  https://review.openstack.org/60909318:59
fungibe thoroughly prepared for me to be thoroughly unprepared18:59
openstackgerritMerged openstack-infra/openstackid-resources master: update caldav client lib due an error on vcard response parsing  https://review.openstack.org/60909319:00
*** jamesmcarthur has quit IRC19:02
*** jamesmcarthur has joined #openstack-infra19:03
*** eharney has joined #openstack-infra19:08
*** markvoelker has quit IRC19:09
*** markvoelker has joined #openstack-infra19:09
*** hamzy_ has joined #openstack-infra19:10
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Update publish-to-pypi-neutron  https://review.openstack.org/60909719:11
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove usage of tox -e venv from release job  https://review.openstack.org/60909819:12
smcginnisWhoa, just checked zuul.openstack.org for the first time in a day or two. Lookin' pretty schnazzy there zuul.19:12
*** jamesmcarthur has quit IRC19:12
clarkbsmcginnis: more importantly the auto scroll disable on streaming console logs works now :P19:12
AJaegerdhellmann, smcginnis, could you review https://review.openstack.org/609098 , please? I think we're ready to go forward now - and timing should be good...19:12
*** jamesmcarthur has joined #openstack-infra19:12
*** hamzy has quit IRC19:12
*** armax has joined #openstack-infra19:12
smcginnisclarkb: Haven't you learned by now? Looking schnazzy online is more important than functionality. ;)19:13
smcginnisAJaeger: On it.19:13
dhellmannAJaeger : do we still need those old release jobs?19:13
smcginnisAnd is venv needed for playbooks/python-branch-tarball/post.yaml? Checking that out now.19:15
*** markvoelker has quit IRC19:15
dhellmannit looks like we do have a couple of projects still using release-openstack-python-without-pypi19:15
AJaegerdhellmann: I'm currently figuring out what can be cleaned up - do you propose to cleanup more? What exactly?19:15
AJaegerdhellmann: yeah ;(19:15
AJaegerdhellmann: not many...19:15
dhellmannthe other day we discussed the idea of having a language-independent-tarball-release job that didn't rely on pbr or setuptools to build the tarball, and switching anything that didn't want to be published to pypi to use that19:16
AJaegerdhellmann: yeah, that could be used for those...19:17
dhellmannI think I would rather do that than change what those existing jobs do19:17
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove obsolete publish-to-pypi-{neutron,horizon}  https://review.openstack.org/60909919:17
dhellmannbut I don't have time to do either myself, so if this is an improvement in your mind then it's OK with me19:17
*** markvoelker has joined #openstack-infra19:17
AJaegerdhellmann: with the -python3 release jobs now working fine, I feel confident to make this change as intermediate step. Yes, release-openstack-python-without-pypi could be changed - but I think we need the rest. OR do you see others obsolete as well?19:20
dhellmannno, I'm just not clear why this is an improvement over the current situation, I guess19:21
AJaegerdhellmann: it's an improovement since we can remove all the required-projects...19:21
dhellmannok, I guess that's something19:22
AJaegerdhellmann: and having *one* instead of *two* playbooks that do the same is also an improvement19:22
dhellmannI'm a little concerned about reusing the playbooks because when I work on those I really only think about the whole end-to-end publish to pypi aspects, but I guess we can fix errors if we find them19:22
AJaegerdhellmann: regarding https://review.openstack.org/609097  - do you think all of them can be updated to use python3?19:24
AJaegerthose are not official repos, so I didn't do it...19:24
dhellmannI never ran into any issues with any repo that actually needed python2 as long as we weren't installing any dependencies19:25
AJaegerok, then let me switch...19:25
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Update publish-to-pypi-neutron  https://review.openstack.org/60909719:28
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove usage of tox -e venv from release job  https://review.openstack.org/60909819:28
AJaegerdhellmann: updated ^19:28
*** jamesmcarthur has quit IRC19:29
dhellmannlgtm19:29
*** jamesmcarthur has joined #openstack-infra19:30
*** armax has quit IRC19:35
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove now obsolete required-repos  https://review.openstack.org/60910819:35
AJaegerdhellmann: and that's the final cleanup that is now possible ^19:35
*** jamesmcarthur has quit IRC19:35
*** jamesmcarthur has joined #openstack-infra19:36
dhellmannAJaeger : I think that step needs to be done with the step that changes the release jobs, doesn't it? otherwise the repo will have 2 release jobs attached to it for a period of time19:38
AJaegerdhellmann: It's based on top of it19:38
dhellmannyeah, I meant shoudln't it be squashed?19:38
dhellmannor do you intend to land all of these together?19:38
AJaegerdhellmann: yeah, landing them together is needed...19:39
dhellmannok19:39
AJaegerdhellmann: let me ask what rest of team thinks.19:39
*** jamesmcarthur has quit IRC19:48
*** jamesmcarthur has joined #openstack-infra19:51
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fixed composer.lock  https://review.openstack.org/60911319:54
openstackgerritMerged openstack-infra/openstackid-resources master: Fixed composer.lock  https://review.openstack.org/60911319:55
*** stevebaker has quit IRC19:57
*** gouthamr has quit IRC19:58
*** dmellado has quit IRC19:58
AJaegerconfig-core, could you review the stack starting at https://review.openstack.org/#/c/609087 . I'd like to merge them together, thus gave WIP to the first one.20:01
ianwAJaeger: did you get an answer on ovs-bhs1?20:04
*** eernst has quit IRC20:04
AJaegerianw: no20:05
ianwOS_CLIENT_CONFIG_FILE=/etc/openstack/all-clouds.yaml openstack --os-cloud=openstackjenkins-ovh --os-region BHS1 port list | grep 'fa:16' | wc -l20:05
ianw30020:05
ianwthat is very suspicious20:06
AJaegerianw: clarkb run a script last Friday (?) to delete those...20:06
ianwyeah, there's only ~ 90 servers, so something has gone wrong20:07
ianwlet me track back through logs to see if there's any context20:07
*** colonwq has quit IRC20:09
AJaegerthanks for looking into this, ianw20:09
fungilast we heard they're having performance with their switch backend for neutron since the newton upgrade20:09
fungiwe know that if nova's port delete call to neutron times out/fails it doesn't retry it20:09
fungithere was some discussion of whether we could add port tracking in nodepool to identify and clean up leaked ports20:10
AJaegerfungi, could you also put the stack starting at 609087 on your review list, please? Like to get that early in this cycle...20:10
fungibut for right now the only solution is to manually delete ports which have been in a down state for long enough that it's not likely just waiting to get attached to a newly booting instance20:10
* AJaeger waves good night20:12
openstackgerritJonathan Rosser proposed openstack-infra/project-config master: Refresh openstack-ansible grafana dashboard  https://review.openstack.org/60911720:12
openstackgerritSorin Sbarnea proposed openstack-infra/puppet-openstackci master: Enforce use of UTF-8 encoding for plain text files  https://review.openstack.org/60911820:12
*** ijw_ has joined #openstack-infra20:13
*** ijw has quit IRC20:13
openstackgerritJonathan Rosser proposed openstack-infra/project-config master: Refresh openstack-ansible grafana dashboard  https://review.openstack.org/60911720:20
ianwfungi: how is "long enough" determined?20:21
*** kgiusti has left #openstack-infra20:23
ianwi can't see there's a timestamp.  i can remove the DOWN ones20:24
fungiianw: what i've done in the past is make a list of downed port uuids, sleep for something like 300, then do it again and any which appear on both lists can be safely deleted20:27
fungithough if you prematurely delete a port which was destined to be attached to an instance, the instance will just get recycled anyway as a broken one20:27
*** pcaruana has quit IRC20:37
*** ijw_ has quit IRC20:41
*** ijw has joined #openstack-infra20:42
*** hamzy_ has quit IRC20:46
*** gouthamr has joined #openstack-infra20:50
*** dmellado has joined #openstack-infra20:53
*** ansmith has quit IRC20:58
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add a helper for manual port cleanup  https://review.openstack.org/60913321:00
ianwfungi: ^ maybe don't want to merge that, but it's what i've got going removing the ports now21:01
njohnstonIs this the right place to ask a question about the new zuul web UI, or is there a separate zuul-related channel for that now?21:01
ianwnjohnston: there is #zuul21:03
njohnstonthanks ianw21:04
ianwnjohnston: if it's specific to infra we can help, if it's something you'd like implemented, probably #zuul21:04
*** eharney has quit IRC21:05
*** trown is now known as trown|outtypewww21:05
njohnstonMy question is: Yesterday I could put a space-delimited list of change IDs in the "Change or project name" field on zuul.o.o/status and it would show any changes that matched any one of those change IDs.  Now it seems that causes zuul to match nothing.  Is there a way to do this with a different syntax now, or is there a way to say "show jobs where I am the submitter"?21:05
funginjohnston: sounds like the regression https://review.openstack.org/593605 is intended to address21:05
njohnstonah thanks21:06
fungioh, or maybe not21:06
fungithis is build-oriented and you're filtering on multiple change ids?21:06
fungicould be a different, not-yet-reported regression21:07
njohnstonyes, for example right now I tried to put in "592164 584061" and instead of 2 job results I got zero21:07
njohnstonI can file a storyboard story for it21:08
*** bobh has quit IRC21:08
ianwyeah, that seems reasonable ... not sure i realised you could do that with the old version :)21:08
funginjohnston: yes please, https://storyboard.openstack.org/#!/project/openstack-infra/zuul while logged in and use the +add story button on the right side21:09
fungi(the create new drop-down has an issue with prepopulated task projects right now)21:10
*** stevebaker has joined #openstack-infra21:10
*** kjackal has quit IRC21:13
njohnstonianw fungi: Thanks very much https://storyboard.openstack.org/#!/story/200402921:13
*** jrist has joined #openstack-infra21:14
*** priteau has quit IRC21:15
*** jamesmcarthur has quit IRC21:16
*** Emine has quit IRC21:17
imacdonnhmmm, something funky with the new zuul dashboard ... I have a list of change IDs in the filter field - if I try to delete one of them by highlighting it and hitting backspace, it immediately reappears21:18
ianwi think that's a known problem with the auto-refresh, maybe21:18
njohnstonyes, you have to get it - and hit enter - before the refresh21:19
imacdonnok, if it's known .. and yeah, it works if I hit Enter right after Backspace21:20
ianwimacdonn: hrm, perhaps "known" is too strong, mordred mentioned it http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-10-09.log.html#t2018-10-09T04:04:3021:22
ianwtristanC: ^ is this something you want to track?21:22
clarkbok I think the talk went well21:23
fungimight warrant another story21:23
fungiclarkb: awesome!21:23
fungidid you get sidelined with lots of questions in the hallway afterward, hopefully?21:23
clarkbfungi: thank you for handling the meeting. I was eating a light lunch and figuring out xrandr for weird projector and ya fun times21:23
clarkbfungi: yes I did21:23
fungii use xrandr to add/remove projectors on my portable devices. highly recommend21:24
ianwclarkb / fungi : ok, so after about 15 minutes we're still leaking ports in BHS1.  do we just run the manual cleanup in a loop for now, or what?21:28
clarkbianw: ya  Ithink we need or want to add that to nodepool :(21:28
clarkbI havne't had a chance to look at writing that so feel free to if it interests you21:28
*** jtomasek has quit IRC21:29
ianwclarkb: ok, that sounds like a longer term solution ... if you like, i can run the script from 609133 in a screen on bridge say, every 1/2 hour21:34
*** armax has joined #openstack-infra21:34
clarkbianw: ya that may be a reasonable short term solution21:34
fungiat least until ovh is able to rectify the performance regression21:35
fungi(or upgrade to even newer openstack)21:36
clarkbwe should really try to get neutron involved21:36
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add docker-compose quickstart example  https://review.openstack.org/60834421:36
clarkbI'm guessing this isn't just an ovh problem since we see similar with packethost21:36
fungiwhat release is that ph cloud on, any idea?21:37
dhellmannin the new zuul UI, did we lose the ability to search for multiple things at once? or did the syntax for that change? using "release,heat" used to show me both projects, now it returns no results21:38
dhellmannthat's on http://zuul.openstack.org/status if that wasn't clear21:39
*** bobh has joined #openstack-infra21:41
ianwdhellmann: we were just discussing that :)  it seems it has regressed and https://storyboard.openstack.org/#!/story/2004029 was filed21:45
*** bobh has quit IRC21:45
dhellmannianw : nice, thanks! I just noticed both the UI change and the behavior change, so wondered if it was intentional. I'll subscribe to the story.21:47
corvusi'm restarting zuul-web21:47
corvushttp://zuul.openstack.org/builds.html is lightning-fast now21:48
clarkbfungi: I don't know21:49
clarkbcorvus: new sql query merged?21:49
corvusclarkb: yep21:49
corvuser http://zuul.openstack.org/builds is correct url21:50
ianw#status log OVH BSH1 manual port cleanup is running periodically (every 20 minutes) in a root screen on bridge.o.o until a better solution appears21:52
openstackstatusianw: finished logging21:52
*** armax has quit IRC21:54
*** bobh has joined #openstack-infra21:54
*** rossella_s has quit IRC22:03
*** rossella_s has joined #openstack-infra22:03
*** carl_cai has joined #openstack-infra22:04
clarkbfungi: fwiw no more mirror issues after you allocated disk22:06
*** bobh has quit IRC22:09
fungiyeah, i've been logged into it watching to see it randomly die on us22:15
fungistill fine22:15
*** slaweq has quit IRC22:17
ianwfungi / clarkb : would you agree with my comments on https://review.openstack.org/#/c/609118 ?  every time i look at htmlify etc i have to context switch how it all works back in :)22:20
*** dhill_ has quit IRC22:25
fungii think you're right22:26
clarkbya those wont be served directly and go through os-loganalyze22:28
ianwoh, https://git.openstack.org/cgit/openstack-infra/os-loganalyze/tree/os_loganalyze/util.py#n47 splits off the charset22:30
dmsimardShould we update gerrit ? https://groups.google.com/forum/m/#!topic/repo-discuss/XDNbORnDqAk22:34
*** rossella_s has quit IRC22:36
fungidmsimard: https://projects.eclipse.org/projects/technology.jgit/releases/4.11.422:37
fungi"JGit itself is not affected by this vulnerability. This release implements validation of .gitmodules files in JGit to protect unguarded tools."22:37
*** panda has quit IRC22:37
dmsimardI'm not sure what's the take away but haven't finished reading about it either22:38
fungispecifically, if an attacker pushed up a specially-crafted .gitmodules file and then convinced a victim to git clone --recursive the affected repo directly from gerrit (which we already discourage), _and_ the victim was running an outdated git client version, then they could be affected22:38
dmsimardDoes gerrit bundle jgit ?22:38
fungiyes22:38
*** panda has joined #openstack-infra22:39
fungithey're recommending upgrading to a version of gerrit which has a newer vendored-in jgit version including the cve-2018-17456 patch22:39
*** rossella_s has joined #openstack-infra22:40
dmsimardWow January 2012 commit from corvus: https://github.com/openstack-infra/gerrit22:41
dmsimardI don't think I even knew OpenStack existed back then22:41
openstackgerritMerged openstack-infra/storyboard master: accept tag values in the body as well as URL  https://review.openstack.org/60872722:41
fungiwe don't build from the master branch. we create upstream tracking branches22:42
*** rcernin has joined #openstack-infra22:42
dmsimardYeah, I fell on it due to the default branch22:42
dmsimardI was curious what was the delta with upstream, I never bothered to really check22:43
fungijust backports of fixes we need from later branches22:44
*** owalsh is now known as owalsh_away22:47
*** rpioso is now known as rpioso|afk22:50
*** ansmith has joined #openstack-infra22:55
*** mriedem has quit IRC22:57
*** hongbin has quit IRC22:58
*** lbragstad has quit IRC23:01
openstackgerritMerged openstack-infra/project-config master: Move performa jobs to project repository  https://review.openstack.org/60828923:04
openstackgerritMerged openstack-infra/project-config master: Move Stackalytics jobs to project repository  https://review.openstack.org/60828623:06
*** pbourke has quit IRC23:09
*** pbourke has joined #openstack-infra23:09
*** slaweq has joined #openstack-infra23:11
*** efried has quit IRC23:12
*** efried has joined #openstack-infra23:13
openstackgerritMerged openstack-infra/project-config master: Add publish jobs for StarlingX api-ref and releasenotes  https://review.openstack.org/60830423:13
*** slaweq has quit IRC23:16
*** tosky has quit IRC23:21
*** yamamoto has quit IRC23:28
*** ijw has quit IRC23:29
*** sshnaidm is now known as sshnaidm|afk23:32
openstackgerritLogan V proposed openstack-infra/project-config master: Bump Limestone to max-servers 50  https://review.openstack.org/60916723:35
*** Swami has quit IRC23:43
*** jamesmcarthur has joined #openstack-infra23:48
*** yamamoto has joined #openstack-infra23:55
*** agopi is now known as agopi|brb23:56
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Provide for an EPEL mirror during build  https://review.openstack.org/60883423:57
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Set EPEL mirror during openstack-ci-mirrors  https://review.openstack.org/60916923:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!