*** sthussey has quit IRC | 00:05 | |
*** jamesmcarthur has joined #openstack-infra | 00:12 | |
*** jamesmcarthur has quit IRC | 00:16 | |
*** yamamoto has quit IRC | 00:22 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: fetch-javascript-content-tarball: fix tarball relative path https://review.openstack.org/608794 | 00:22 |
---|---|---|
*** hwoarang has quit IRC | 00:27 | |
*** hwoarang has joined #openstack-infra | 00:28 | |
*** longkb has joined #openstack-infra | 00:30 | |
corvus | rpioso, fungi: also, if you want mouse integration, you can shift-click (that's what i do) | 00:42 |
corvus | (and yeah, that makes 'copy rectangle' shift-ctl-alt click-drag, which is.. fun to do) | 00:43 |
fungi | indeed. i just turn off mouse integration in all my console apps that have grown it over time. wish my terminal emulator could simply be configured not to pass pointer events through at all | 00:44 |
*** bdodd_ has joined #openstack-infra | 00:47 | |
*** bdodd has quit IRC | 00:50 | |
*** yamamoto has joined #openstack-infra | 00:50 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/puppet-zuul master: Revert "Revert "Revert "Revert "Add rewrite rules for HTML5 url"""" https://review.openstack.org/606601 | 00:55 |
*** rlandy|bbl is now known as rlandy | 00:59 | |
*** tdasilva has quit IRC | 00:59 | |
*** tristanC has quit IRC | 01:01 | |
*** tristanC has joined #openstack-infra | 01:01 | |
*** zhangfei has joined #openstack-infra | 01:04 | |
*** hongbin has joined #openstack-infra | 01:08 | |
*** zhangfei has quit IRC | 01:18 | |
*** slagle has joined #openstack-infra | 01:20 | |
*** mrsoul has quit IRC | 01:35 | |
openstackgerrit | Merged openstack-infra/zuul-jobs master: fetch-javascript-content-tarball: fix tarball relative path https://review.openstack.org/608794 | 01:41 |
tristanC | infra-root: can someone please re-enqueue openstack-infra/zuul post jobs, e.g. zuul enqueue-ref --tenant openstack --trigger gerrit --pipeline post --project openstack-infra/zuul --ref master | 01:43 |
*** d0ugal has quit IRC | 01:48 | |
*** annp has quit IRC | 01:49 | |
*** longkb has quit IRC | 01:49 | |
*** longkb has joined #openstack-infra | 01:50 | |
*** annp has joined #openstack-infra | 01:50 | |
*** d0ugal has joined #openstack-infra | 01:51 | |
*** yamamoto has quit IRC | 01:56 | |
mordred | tristanC: done | 02:06 |
fungi | tristanC: mordred: instead i approved a couple of small doc improvements for zuul which already had a +2 | 02:10 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: WIP: docker-compose quickstart example https://review.openstack.org/608344 | 02:12 |
*** bobh has joined #openstack-infra | 02:14 | |
*** apetrich has quit IRC | 02:15 | |
*** rlandy has quit IRC | 02:22 | |
*** longkb has quit IRC | 02:23 | |
mordred | fungi: awesome! | 02:23 |
*** longkb has joined #openstack-infra | 02:24 | |
*** yamamoto has joined #openstack-infra | 02:24 | |
openstackgerrit | Merged openstack-infra/zuul master: Doc: executor operations document pause, remove graceful https://review.openstack.org/602455 | 02:36 |
openstackgerrit | Merged openstack-infra/zuul master: Doc: executor operations - explain jobs will be restarted at restart https://review.openstack.org/603136 | 02:36 |
tristanC | mordred: hum, the enqueue-ref didn't worked, all jobs failed with retry_limit... | 02:38 |
tristanC | now the doc changes entered the post, lets see how it goes | 02:38 |
mordred | tristanC: ++ | 02:39 |
*** psachin has joined #openstack-infra | 02:40 | |
*** armax has joined #openstack-infra | 02:43 | |
*** lbragstad has joined #openstack-infra | 02:43 | |
tristanC | alright, zuul web content got published, let's wait for puppet pass now | 02:50 |
tristanC | ok, it worked, but index.html is not loaded on '/', just for http://zuul.openstack.org/index.html | 02:50 |
tristanC | infra-core: could we push for https://review.openstack.org/#/c/606601/ now? | 02:51 |
*** eernst has joined #openstack-infra | 02:54 | |
mordred | tristanC: will 606601 fix that - I'm guessing the rewrite rules are expecting a behavior that that tarball isn't providing? | 02:59 |
mordred | tristanC: oh - wait a sec - that's the puppet-zuul change | 03:00 |
mordred | fungi: in a position to +2 606601 again? | 03:00 |
*** dave-mccowan has quit IRC | 03:02 | |
tristanC | mordred: 606601 should fix zuul.openstack.org url serving that are not "/index.html" | 03:04 |
mordred | tristanC: I just applied it by hand and it doesn't seem to have worked | 03:04 |
mordred | tristanC: I just applied it by hand and it doesn't seem to have worked | 03:07 |
mordred | gah | 03:07 |
*** ramishra has joined #openstack-infra | 03:08 | |
tristanC | mordred: hum, that's weird, curl -I https://zuul.openstack.org/status still says "Server: CherryPy/18.0.1" | 03:08 |
tristanC | mordred: which seems like the L45 of the previous version of https://review.openstack.org/#/c/606601/2/templates/zuulv3.vhost.erb | 03:09 |
mordred | does apache2ctl graceful not work anymore? | 03:09 |
*** psachin has quit IRC | 03:10 | |
mordred | tristanC: I agree with the behaivor from curl - I get the same thing | 03:11 |
*** armax has quit IRC | 03:12 | |
*** armax has joined #openstack-infra | 03:13 | |
mordred | tristanC: ok - missed a line on the status one - that's fine now | 03:15 |
mordred | tristanC: but / still doesn't work | 03:15 |
tristanC | mordred: yes, now something else broke, curl https://zuul.openstack.org/static/css/main.6956f7aa.css doesn't returns the css but the index.html... | 03:16 |
mordred | isn't that what RewriteRule . /index.html [L] will do? | 03:16 |
mordred | oh nevermind - that's got the conditions on it | 03:17 |
tristanC | the condition should make it return existing files like css | 03:17 |
mordred | yah | 03:17 |
tristanC | about '/' returning 404, does apache configuration has "DirectoryIndex index.html" ? | 03:19 |
mordred | tristanC: nope - adding | 03:20 |
mordred | no luck | 03:20 |
tristanC | mordred: and about existing file not being returned, could we try adding "RewriteBase /" right before the "RewriteCond %{REQUEST_FILENAME} !-f"? | 03:20 |
mordred | RewriteBase: only valid in per-directory config files | 03:21 |
* tristanC scratchs head... then maybe wrapping all the rewrite rules into a "<Location />" ? | 03:23 | |
*** bobh has quit IRC | 03:23 | |
tristanC | or, replace "RewriteCond %{REQUEST_FILENAME} !-f" byt ""RewriteCond <%= @docroot %>/%{REQUEST_FILENAME} !-f" | 03:25 |
mordred | tristanC: location worked | 03:26 |
tristanC | yeah, not sure what you did but it's now working | 03:26 |
mordred | tristanC: adding the location wrap around the rules | 03:26 |
tristanC | but now, the /api isn't being forwarded to the /api | 03:27 |
tristanC | to the zuul-web* | 03:27 |
mordred | *headdesk* | 03:27 |
mordred | tristanC: http://paste.openstack.org/show/731725/ | 03:27 |
mordred | tristanC: and the docroot addition does not work | 03:29 |
tristanC | wait, now https://zuul.openstack.org/status is working fine | 03:29 |
tristanC | but, https://zuul.openstack.org/ still returns 404 | 03:29 |
*** armax has quit IRC | 03:30 | |
mordred | I reverted the locaiton putting it back | 03:32 |
*** carl_cai has quit IRC | 03:32 | |
tristanC | mordred: maybe we need to drop the "RewriteRule ^/$ /status [L]" line | 03:35 |
mordred | tristanC: ok ... / is back | 03:37 |
mordred | tristanC: I think I got it | 03:40 |
*** dayou has quit IRC | 03:41 | |
tristanC | mordred: '/' seems to work indeed, but we lost the /api/* redir to zuul-web :) | 03:41 |
mordred | oh - poo | 03:41 |
*** psachin has joined #openstack-infra | 03:44 | |
*** lbragstad has quit IRC | 03:46 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build https://review.openstack.org/608834 | 03:47 |
tristanC | mordred: anything i can do to help? could you paste the current httpd.conf? | 03:47 |
*** lbragstad has joined #openstack-infra | 03:48 | |
* ianw checks the status page, worries, checks irc, sees the A Team are on it :) | 03:49 | |
mordred | tristanC:, ianw: http://paste.openstack.org/show/731729/ | 03:50 |
mordred | Location fixes / being index.html but breaks api proxy | 03:51 |
tristanC | mordred: could we try dropping the "^/" before the api rewrites rule? | 03:51 |
*** eernst has quit IRC | 03:52 | |
ianw | ahh, i get an obscure javascript error in the console, but nothing particularly helpful | 03:53 |
tristanC | ianw: that's because '/api/info' returns the index.html instead of a json object | 03:54 |
mordred | tristanC: boom - got it | 03:56 |
mordred | tristanC: it should all be good now? | 03:56 |
ianw | hrm, unless i'm cached up the wazoo or something, i'm still seeing just "loading..." | 03:57 |
tristanC | mordred: nice, seems to work as expected | 03:57 |
tobiash | Looks good on my phone | 03:57 |
tristanC | ianw: "loading..." page doesn't actually retry, you need to refresh | 03:57 |
tristanC | mordred: could you paste the working conf, i'll update the puppet change with it | 03:57 |
mordred | tristanC: I'm about to just send in the puppet update :) | 03:57 |
tristanC | mordred: even better :) thanks! | 03:58 |
ianw | hrm, even in an incognito window still not working for me | 03:58 |
*** lbragstad has quit IRC | 03:58 | |
openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Revert "Revert "Revert "Revert "Add rewrite rules for HTML5 url"""" https://review.openstack.org/606601 | 03:58 |
tristanC | ianw: are you using the https:// scheme? | 03:58 |
mordred | http://paste.openstack.org/show/731730/ | 03:58 |
mordred | lemme apply to http too | 03:58 |
ianw | ahhh, yeah, ok that's it | 03:59 |
tristanC | mordred: much better, using rewriterule in location is hard^Wnot recommended :) | 03:59 |
clarkb | builds listing doesn't have all the filters anymore | 04:00 |
mordred | ++ yah - srrsly | 04:00 |
mordred | clarkb, ianw: could y'all +A 606601 ? | 04:00 |
*** hongbin has quit IRC | 04:00 | |
mordred | clarkb: good poiunt - tristanC - the new thing has a selector box for filter - the old let you combine? | 04:01 |
tristanC | clarkb: actually, there should be more filters available, there is a selector | 04:01 |
tristanC | mordred: you should be able to combine multiple filter, like pipeline: gate, pipeline: post | 04:02 |
clarkb | ah if you hit enter it adds them as ANDed together | 04:02 |
clarkb | that isn't clear through the UI fwiw until you try it | 04:02 |
mordred | AH - I see it | 04:02 |
clarkb | looks like a single selector otherwise | 04:03 |
clarkb | (good enoguh for now) | 04:03 |
mordred | yup - but now that I know I agree - I can do those things | 04:03 |
mordred | tristanC: as a followup - I just tried overtyping a project filter on status - and because a refresh happened I lost my typing | 04:04 |
clarkb | mordred: in 606601 where does the zuul.openstack.org is actually openstack tenant stuff happen? is that all purely in the api proxied data? I guess it must be | 04:04 |
mordred | tristanC: I have no idea how to fix that - but we might want to play around with it some | 04:04 |
clarkb | and then index.html is rendering only | 04:04 |
tristanC | mordred: sure, the hardest part was to get it served ;) | 04:05 |
tristanC | afk lunch, bbl | 04:05 |
mordred | clarkb: yah - in our apache rewrite rules we proxy to /api/tenant/openstack | 04:05 |
clarkb | right, I want to say there is or was tenant info encoded into the js/html/css stuff at one point though | 04:06 |
clarkb | but that must all be gone because its only the api proxied paths that seem to know now | 04:06 |
clarkb | hrm no this still knows, the top right says tenant: openstack | 04:07 |
*** udesale has joined #openstack-infra | 04:07 | |
clarkb | maybe that is from the api | 04:07 |
clarkb | zomg console streaming autoscroll disable works now | 04:08 |
clarkb | favorite feature | 04:08 |
*** dayou has joined #openstack-infra | 04:08 | |
mordred | clarkb: the status filtering is all reactive and pretty instant now too | 04:13 |
mordred | so I *thnk* people's browsers should be much happier WRT cpu | 04:13 |
clarkb | it seems my phone still says 404 or maybe its reverted? | 04:13 |
mordred | clarkb: yah - I hand-edited the files - so puppet probably unedited them for me | 04:14 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build https://review.openstack.org/608834 | 04:14 |
clarkb | mordred: ok 606601 has the +2s you need but I didn't approve it | 04:14 |
clarkb | I need to find bed now | 04:14 |
mordred | I'll +A right now | 04:14 |
clarkb | mordred: tristanC did the fixes end up being purely in the apache config then? zuul itself was fine as is? | 04:15 |
mordred | there was also a fix to the tarball build job | 04:15 |
clarkb | ah | 04:15 |
mordred | andwe have a decent amount of work in front of us to make sure this is properly tested | 04:15 |
clarkb | and what makes react so much more efficient here compraed to the old angular stuff? | 04:16 |
clarkb | we didn't make the json smaller | 04:16 |
clarkb | apparently react does magic | 04:17 |
*** e0ne has joined #openstack-infra | 04:27 | |
*** e0ne has quit IRC | 04:27 | |
*** jaosorior has joined #openstack-infra | 04:28 | |
mordred | clarkb: well- the old stuff wasn't angular yet - the old stuff was jquery iterating over the json structures | 04:29 |
mordred | clarkb: the react patch also rewrite the status page in native react - so the fancy react dom binding and whatnot gets to do its happy stuff | 04:29 |
mordred | AJaeger: whence you awaken, the status page is currently unhappy - puppet patch to fix is in flight | 04:30 |
mordred | AJaeger: workaround is to just hit https://zuul.openstack.org/status instead of https://zuul.openstack.org/ | 04:30 |
tobiash | mordred: how shall we proceed with the react revert? | 04:30 |
tobiash | It has +a but failed check | 04:31 |
mordred | tobiash: I think we've got the deploy issues sorted for openstack - so I vote we don't revert and roll forward fixing things | 04:31 |
mordred | (like adding better testing and documentation around this) | 04:32 |
tobiash | mordred: then someone should vote on that so a recheck won't land it | 04:32 |
mordred | tobiash: done | 04:33 |
tobiash | :) | 04:35 |
*** pcaruana has joined #openstack-infra | 04:38 | |
mnaser | hmm | 04:38 |
mnaser | zuul.o.o is 404-ing | 04:39 |
mnaser | oh i guess https://review.openstack.org/#/c/606601/ is the fix | 04:39 |
mnaser | ok http://zuul.openstack.org/index.html is the page to use | 04:40 |
mnaser | ooooh hello thats pretty! | 04:40 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build https://review.openstack.org/608834 | 04:46 |
jaosorior | that's looking pretty good | 04:50 |
openstackgerrit | Merged openstack-infra/puppet-zuul master: Revert "Revert "Revert "Revert "Add rewrite rules for HTML5 url"""" https://review.openstack.org/606601 | 04:52 |
prometheanfire | revert revert revert revert revert? | 04:55 |
prometheanfire | ianw: if around, mind looking at the dib caching stuff? | 04:56 |
ianw | if it's even it's good, if it's odd it's bad | 04:56 |
ianw | promethanfire: did it pass the ci gentoo build? | 04:56 |
prometheanfire | should have | 04:57 |
prometheanfire | lolnope | 04:58 |
ianw | well maybe fix that first :) | 04:58 |
prometheanfire | did finalize.d change or something? | 04:58 |
prometheanfire | http://logs.openstack.org/68/604268/6/check/dib-dsvm-functests-python2-ubuntu-trusty-extras/c23f2b7/job-output.txt.gz#_2018-10-08_06_12_29_347252 means /usr/porage was cleaned up | 04:58 |
ianw | we haven't changed anything structural like that | 04:59 |
prometheanfire | the cache, is it available during finalize.d? | 05:00 |
prometheanfire | since I mount /usr/porage with it | 05:00 |
prometheanfire | ya, looks like that's probably it | 05:01 |
*** e0ne has joined #openstack-infra | 05:04 | |
*** e0ne has quit IRC | 05:04 | |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: enable caching for gentoo builds https://review.openstack.org/604268 | 05:05 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify python3.6 selection on gentoo https://review.openstack.org/608576 | 05:06 |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add build page https://review.openstack.org/597024 | 05:07 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify python3.6 selection on gentoo https://review.openstack.org/608576 | 05:10 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify overlay logic for Gentoo https://review.openstack.org/608577 | 05:10 |
*** diablo_rojo has joined #openstack-infra | 05:14 | |
*** jbadiapa has quit IRC | 05:14 | |
*** janki has joined #openstack-infra | 05:25 | |
*** apetrich has joined #openstack-infra | 05:32 | |
*** diablo_rojo has quit IRC | 05:36 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: fix rewrite rule installation doc https://review.openstack.org/608850 | 05:44 |
openstackgerrit | Trinh Nguyen proposed openstack-infra/project-config master: Create storyboard project for python-freezerclient https://review.openstack.org/608852 | 05:48 |
*** quiquell has joined #openstack-infra | 05:53 | |
*** carl_cai has joined #openstack-infra | 05:58 | |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: enable caching for gentoo builds https://review.openstack.org/604268 | 06:03 |
*** kushinauwu has joined #openstack-infra | 06:25 | |
kushinauwu | I'm an outreachy applicant. Can I know if this the right channel to discuss about openstack outreachy projects? Thanks. | 06:33 |
*** aojea has joined #openstack-infra | 06:35 | |
*** jbadiapa has joined #openstack-infra | 06:36 | |
*** kopecmartin|off is now known as kopecmartin|ruck | 06:38 | |
*** coolsvap has joined #openstack-infra | 06:38 | |
AJaeger | kushinauwu, welcome! #openstack-outreachy is the proper channel for outreachy in general. | 06:40 |
kushinauwu | oh thanks! | 06:41 |
*** slaweq has joined #openstack-infra | 06:59 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: remove job settings for barbican repositories https://review.openstack.org/599663 | 07:04 |
*** rcernin has quit IRC | 07:08 | |
*** jtomasek has joined #openstack-infra | 07:08 | |
openstackgerrit | Antonio Ojea proposed openstack-infra/openstack-zuul-jobs master: DNM - testing opensuse leap 15.0 https://review.openstack.org/608859 | 07:10 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: DNM - testing opensuse leap 15.0 https://review.openstack.org/608859 | 07:12 |
*** ginopc has joined #openstack-infra | 07:12 | |
*** Emine has joined #openstack-infra | 07:22 | |
*** electrofelix has joined #openstack-infra | 07:25 | |
*** annp has quit IRC | 07:28 | |
*** annp has joined #openstack-infra | 07:30 | |
*** kjackal has joined #openstack-infra | 07:35 | |
ssbarnea_ | AJaeger: regarding silencing rsync, this a real deal, especially with ARA files. it makes no sense for listing all ARA files when this takes >50-60% of the entire console output, just because someone *may* need it. for the same reason we could even dump the entire node memory on disk, as it could clearly help someone debug things at some point. I see no point of seeing on screen huge list of files that were successfully copied to log | 07:40 |
ssbarnea_ | server, the files are already there is someone needs to look at them. quiet rsync does not mean hiding the errors, it only hides copied files. | 07:40 |
AJaeger | ssbarnea_: please discuss with rest of team. | 07:41 |
ssbarnea_ | AJaeger: sure, maybe adding the subject to today team meeting. i know decisions about verbosity are always trade-offs | 07:41 |
openstackgerrit | Liam Young proposed openstack-infra/project-config master: Add cells charm and interfaces https://review.openstack.org/608867 | 07:42 |
*** tosky has joined #openstack-infra | 07:46 | |
*** priteau has joined #openstack-infra | 07:48 | |
*** roman_g has joined #openstack-infra | 07:49 | |
*** priteau has quit IRC | 07:50 | |
AJaeger | ssbarnea_: good idea, please add to wiki page | 07:50 |
ssbarnea_ | AJaeger: already did. | 07:51 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use EPEL mirror during build https://review.openstack.org/608834 | 07:52 |
ianw | ssbarnea_: i know it's frustrating, it's often difficult to get everyone on board with changing as the status quo is a big hurdle to overcome. if it ain't broke and all that ... convincing people it is broke can be some effort | 07:55 |
ianw | as usual, an xkcd for everything :) https://xkcd.com/1172/ | 07:55 |
*** jpich has joined #openstack-infra | 07:57 | |
ssbarnea_ | ianw: indeed, one of my favs. | 07:57 |
*** kushinauwu has quit IRC | 08:05 | |
*** dtantsur|afk is now known as dtantsur | 08:08 | |
openstackgerrit | Simon Westphahl proposed openstack-infra/zuul master: Use merger to get list of files for pull-request https://review.openstack.org/603287 | 08:10 |
*** rossella_s has quit IRC | 08:10 | |
*** e0ne has joined #openstack-infra | 08:11 | |
*** rossella_s has joined #openstack-infra | 08:14 | |
*** janki is now known as janki|lunch | 08:16 | |
*** e0ne has quit IRC | 08:17 | |
*** e0ne has joined #openstack-infra | 08:18 | |
*** e0ne has quit IRC | 08:26 | |
*** sshnaidm|afk is now known as sshnaidm | 08:29 | |
*** rossella_s has quit IRC | 08:37 | |
*** rossella_s has joined #openstack-infra | 08:38 | |
*** shardy has joined #openstack-infra | 08:40 | |
*** priteau has joined #openstack-infra | 08:45 | |
*** kushinauwu has joined #openstack-infra | 08:46 | |
*** dpawlik has quit IRC | 08:51 | |
*** dpawlik has joined #openstack-infra | 08:52 | |
frickler | infra-root: has anyone looked into possible issues with the upcoming ksk rollover in relation to our unbound setup? I'm fearing https://www.unbound.net/root-11sep-11oct.html may be an issue for fresh instances | 08:53 |
*** psachin has quit IRC | 08:54 | |
*** lbragstad has joined #openstack-infra | 08:56 | |
*** markmcd has quit IRC | 09:03 | |
*** ginux has joined #openstack-infra | 09:04 | |
*** ginux is now known as Guest68903 | 09:05 | |
*** ginopc has quit IRC | 09:07 | |
*** Guest68903 is now known as ginopc | 09:07 | |
*** markmcd has joined #openstack-infra | 09:12 | |
openstackgerrit | Liam Young proposed openstack-infra/project-config master: Add cells charm and interfaces https://review.openstack.org/608867 | 09:15 |
*** panda has quit IRC | 09:22 | |
ianw | frickler: would if affect us just using unbound as a forwarder? | 09:24 |
*** panda has joined #openstack-infra | 09:24 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Reduce socket connect timeout in nodescan https://review.openstack.org/608897 | 09:28 |
*** kushinauwu has left #openstack-infra | 09:38 | |
*** kushinauwu has quit IRC | 09:38 | |
*** imacdonn has quit IRC | 09:39 | |
*** vabada has quit IRC | 09:46 | |
*** jamesmcarthur has joined #openstack-infra | 09:48 | |
*** dave-mccowan has joined #openstack-infra | 09:49 | |
*** jamesmcarthur has quit IRC | 09:52 | |
*** imacdonn has joined #openstack-infra | 09:52 | |
frickler | ianw: unbound would still perform the dnssec validation locally, I think | 09:55 |
openstackgerrit | Arx Cruz proposed openstack-infra/devstack-gate master: Enable process_stackviz function to be optional https://review.openstack.org/475788 | 09:56 |
arxcruz | fungi: mtreinish hey, can you guys take a look at this when you have time? ^ | 09:57 |
*** vabada has joined #openstack-infra | 09:57 | |
*** janki|lunch is now known as janki | 10:02 | |
*** tosky has quit IRC | 10:04 | |
*** tosky has joined #openstack-infra | 10:04 | |
*** kjackal has quit IRC | 10:05 | |
*** rossella_s has quit IRC | 10:09 | |
*** rossella_s has joined #openstack-infra | 10:10 | |
*** yamamoto has quit IRC | 10:12 | |
*** yamamoto has joined #openstack-infra | 10:13 | |
*** yamamoto has quit IRC | 10:13 | |
*** yamamoto has joined #openstack-infra | 10:14 | |
*** lbragstad has quit IRC | 10:16 | |
*** quiquell is now known as ssquique | 10:16 | |
*** ssquique is now known as quiquell | 10:22 | |
*** markvoelker has joined #openstack-infra | 10:25 | |
*** yamamoto has quit IRC | 10:25 | |
*** yamamoto has joined #openstack-infra | 10:26 | |
*** yamamoto has quit IRC | 10:30 | |
*** kjackal has joined #openstack-infra | 10:30 | |
*** rossella_s has quit IRC | 10:46 | |
*** rossella_s has joined #openstack-infra | 10:49 | |
*** udesale has quit IRC | 10:52 | |
*** armax has joined #openstack-infra | 10:53 | |
*** markvoelker has quit IRC | 10:58 | |
*** rossella_s has quit IRC | 11:04 | |
*** rossella_s has joined #openstack-infra | 11:05 | |
*** ansmith has quit IRC | 11:12 | |
*** amoralej is now known as amoralej|lunch | 11:14 | |
*** yamamoto has joined #openstack-infra | 11:15 | |
*** longkb has quit IRC | 11:17 | |
*** slagle has quit IRC | 11:22 | |
*** armax has quit IRC | 11:27 | |
*** jrist has joined #openstack-infra | 11:29 | |
*** aidin has joined #openstack-infra | 11:31 | |
*** jrist has quit IRC | 11:36 | |
quiquell | We need a infra-root to prioritize a promotion-blocker review for tripleo | 11:41 |
*** yamamoto has quit IRC | 11:49 | |
*** aidin has quit IRC | 11:49 | |
*** yamamoto has joined #openstack-infra | 11:50 | |
*** yamamoto has quit IRC | 11:50 | |
*** yamamoto has joined #openstack-infra | 11:50 | |
*** markvoelker has joined #openstack-infra | 11:51 | |
*** rossella_s has quit IRC | 11:56 | |
*** aidin has joined #openstack-infra | 11:58 | |
*** rossella_s has joined #openstack-infra | 12:00 | |
*** jesusaur has quit IRC | 12:01 | |
*** carl_cai has quit IRC | 12:02 | |
*** zul has joined #openstack-infra | 12:05 | |
*** aidin has quit IRC | 12:06 | |
*** jesusaur has joined #openstack-infra | 12:06 | |
*** emerson has quit IRC | 12:08 | |
*** rh-jelabarre has joined #openstack-infra | 12:10 | |
*** tpsilva has joined #openstack-infra | 12:14 | |
*** rosmaita has joined #openstack-infra | 12:15 | |
*** emerson has joined #openstack-infra | 12:15 | |
fungi | quiquell: the last time you asked, it wasn't fixing any problem with your gate pipeline jobs and was something to do with periodic jobs which weren't going to run again until the next day | 12:16 |
fungi | quiquell: when you say promotion-blocker are you talking about a bug blocking changes from succeeding testing in tripleo's gate pipeline this time? | 12:17 |
quiquell | fungi: We needed that fix the promotion jobs | 12:17 |
quiquell | fungi: It's again a promotion blocker | 12:17 |
fungi | quiquell: i have no idea what promotion jobs you're talking about | 12:17 |
fungi | is this an rdo thing? | 12:17 |
quiquell | fungi: Sorry you are right, it's not a gate issue | 12:18 |
quiquell | fungi: Excuse me for the last time, we were in a hurry | 12:18 |
*** chandankumar has joined #openstack-infra | 12:19 | |
fungi | yeah, i'm not inclined to perform manual intervention on your behalf because you're in a hurry, sorry | 12:19 |
fungi | we normally promote gate-breaking bug fixes in order to conserve what would otherwise be wasted test resources spent on repeated gate resets | 12:20 |
fungi | it has nothing to do with how much of a hurry anyone's in, and everything to do with using our test quota responsibly | 12:21 |
*** yamamoto has quit IRC | 12:23 | |
*** yamamoto has joined #openstack-infra | 12:24 | |
rosmaita | apologies if this has already been answered somewhere, but is there documentation for the zuul builds page, specifically how to construct URLs that will display a particular project/job/pipeline etc perhaps even in a particular time range? | 12:27 |
*** trown|outtypewww is now known as trown | 12:28 | |
*** rlandy has joined #openstack-infra | 12:28 | |
*** yamamoto has quit IRC | 12:29 | |
tristanC | rosmaita: it's not documented, but the recent new dashboard let you set filter through query string, e.g.: https://zuul.openstack.org/builds?project=openstack%2Fcinder&pipeline=periodic | 12:29 |
tristanC | rosmaita: time range aren't implemented yet, this will need some server side modifications | 12:29 |
tristanC | multiple filter should be possible, but it seems like there is a bug server side which makes it returns internal error | 12:30 |
*** sthussey has joined #openstack-infra | 12:34 | |
*** kgiusti has joined #openstack-infra | 12:34 | |
*** yamamoto has joined #openstack-infra | 12:34 | |
*** apetrich has quit IRC | 12:35 | |
rosmaita | tristanC: thanks! now i see why my old URLs aren't working any more, it used to be "builds.html?querystring" but now that redirects to status; "builds?querystring" is working fine | 12:37 |
*** apetrich has joined #openstack-infra | 12:42 | |
*** kushinauwu has joined #openstack-infra | 12:43 | |
*** kushinauwu has quit IRC | 12:45 | |
fungi | rosmaita: part of why it's not documented yet is that it's still in flux, but hopefully this will all stabilize very soon | 12:45 |
*** njohnston has joined #openstack-infra | 12:46 | |
*** amoralej|lunch is now known as amoralej | 12:47 | |
openstackgerrit | Michal Cila proposed openstack-infra/project-config master: add openstack/flare project https://review.openstack.org/608940 | 12:51 |
*** carl_cai has joined #openstack-infra | 12:52 | |
*** agopi has quit IRC | 12:57 | |
rosmaita | fungi: just a suggestion, it would be helpful if the items in the dropdown reflected the keys in the query string, took me a while (had to open the JS that builds the dropdown to find out that 'job' in the dropdown is really 'job_name' in the URL) ... probably too late for that, though | 12:57 |
rosmaita | don't get me wrong, though, it's much better having an undocumented interface that works well (like this one does) than a documented crappy one | 12:58 |
*** lpetrut has joined #openstack-infra | 12:58 | |
*** kgiusti has quit IRC | 13:01 | |
fungi | yeah, not a bad idea | 13:01 |
fungi | rosmaita: if you don't have time to add a quick story at https://storyboard.openstack.org/#!/project/openstack-infra/zuul suggesting that improvement, let me know and i'll write something | 13:03 |
*** ansmith has joined #openstack-infra | 13:04 | |
*** dpawlik has quit IRC | 13:07 | |
*** ociuhandu has joined #openstack-infra | 13:07 | |
*** zul has quit IRC | 13:09 | |
*** ijw has joined #openstack-infra | 13:09 | |
*** ijw has quit IRC | 13:12 | |
*** ijw has joined #openstack-infra | 13:12 | |
*** udesale has joined #openstack-infra | 13:13 | |
*** bobh has joined #openstack-infra | 13:13 | |
*** panda has quit IRC | 13:13 | |
*** panda has joined #openstack-infra | 13:14 | |
*** agopi has joined #openstack-infra | 13:16 | |
*** quiquell is now known as quiquell|lunch | 13:16 | |
*** yamamoto has quit IRC | 13:17 | |
*** yamamoto has joined #openstack-infra | 13:17 | |
*** ginopc has left #openstack-infra | 13:17 | |
*** mriedem has joined #openstack-infra | 13:19 | |
*** udesale has quit IRC | 13:21 | |
openstackgerrit | Martin Kopec proposed openstack-infra/elastic-recheck master: Add check for bug 1796849 https://review.openstack.org/608968 | 13:21 |
openstack | bug 1796849 in tripleo "Mirror/network issues at mirror.us-west-1.packethost.openstack.org" [Undecided,New] https://launchpad.net/bugs/1796849 | 13:21 |
*** janki has quit IRC | 13:23 | |
*** aojeagarcia has joined #openstack-infra | 13:25 | |
*** rlandy_ has joined #openstack-infra | 13:26 | |
mriedem | https://review.openstack.org/#/c/606853/ and its dependent change would help move forward placement extraction into its own repo for our dsvm jobs | 13:26 |
*** rlandy has quit IRC | 13:26 | |
*** lbragstad has joined #openstack-infra | 13:28 | |
*** aojea has quit IRC | 13:28 | |
*** quiquell|lunch is now known as quiquell | 13:36 | |
*** rlandy_ is now known as rlandy | 13:44 | |
*** hongbin has joined #openstack-infra | 13:48 | |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add openstack/placement to legacy-dsvm-base required-projects https://review.openstack.org/608266 | 13:53 |
*** boden has joined #openstack-infra | 13:57 | |
*** felipemonteiro has joined #openstack-infra | 13:58 | |
*** eharney has joined #openstack-infra | 14:00 | |
*** beagles is now known as beagles_cough | 14:03 | |
*** beagles_cough is now known as beagles | 14:03 | |
*** ansmith has quit IRC | 14:08 | |
openstackgerrit | Michal Cila proposed openstack-infra/project-config master: Add openstack/flare project. Flare is a service for running and scheduling burstable task resources. Typical job is unlimited scientific batch from multiple teams with multiple priorities, which runs on limited compute resources (GPUs for example). https://review.openstack.org/609008 | 14:09 |
openstackgerrit | Michal Cila proposed openstack-infra/project-config master: Add openstack/flare project. Flare is a service for running and scheduling burstable task resources. Typical job is unlimited scientific batch from multiple teams with multiple priorities, which runs on limited compute resources (GPUs for example). https://review.openstack.org/609010 | 14:12 |
*** mugsie has joined #openstack-infra | 14:13 | |
*** yamamoto has quit IRC | 14:16 | |
*** yamamoto has joined #openstack-infra | 14:17 | |
*** eharney has quit IRC | 14:18 | |
*** yamamoto has quit IRC | 14:21 | |
*** ansmith has joined #openstack-infra | 14:21 | |
clarkb | on mobile the drop down menu for selecting dtatus jobs and builds doesnt seem to work? | 14:23 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: enable caching for gentoo builds https://review.openstack.org/604268 | 14:24 |
fungi | confirmed, if i shrink my browser frame small enough to trigger the "mobile" view, the drop-down menu is nonfunctional for me in firefox | 14:26 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify python3.6 selection on gentoo https://review.openstack.org/608576 | 14:26 |
openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: simplify overlay logic for Gentoo https://review.openstack.org/608577 | 14:27 |
AJaeger | clarkb, fungi, same situation on chromium | 14:27 |
*** eharney has joined #openstack-infra | 14:33 | |
*** quiquell is now known as quiquell|off | 14:39 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fixed delete presentation for CFP https://review.openstack.org/609023 | 14:43 |
openstackgerrit | Merged openstack-infra/openstackid-resources master: Fixed delete presentation for CFP https://review.openstack.org/609023 | 14:44 |
*** bobh has quit IRC | 14:49 | |
*** ramishra has quit IRC | 14:55 | |
*** munimeha1 has joined #openstack-infra | 14:55 | |
*** lpetrut has quit IRC | 14:56 | |
*** bobh has joined #openstack-infra | 14:56 | |
*** yamamoto has joined #openstack-infra | 14:57 | |
*** hamzy has quit IRC | 14:57 | |
*** carl_cai has quit IRC | 15:01 | |
*** bobh has quit IRC | 15:01 | |
*** hamzy has joined #openstack-infra | 15:01 | |
*** jbadiapa has quit IRC | 15:02 | |
openstackgerrit | Michal Cila proposed openstack-infra/project-config master: Add openstack/flare project. https://review.openstack.org/609010 | 15:07 |
*** bobh has joined #openstack-infra | 15:11 | |
*** jamesmcarthur has joined #openstack-infra | 15:13 | |
*** armax has joined #openstack-infra | 15:14 | |
*** tdasilva has joined #openstack-infra | 15:16 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fix on set status on presentation for CFP https://review.openstack.org/609029 | 15:16 |
openstackgerrit | Merged openstack-infra/openstackid-resources master: Fix on set status on presentation for CFP https://review.openstack.org/609029 | 15:18 |
rosmaita | fungi: was adding a story to storyboard, but while doing that discovered that the new interface displays the querystring in the URL as you add filters, so really no need for documentation | 15:26 |
rosmaita | though i did get a 400 trying to add the story to storyboard, and then got a 400 trying to add a story to the storyboard board reporting the bug. i suspect something is set weird in my browser (chrome on Fedora 28) | 15:27 |
*** kgiusti has joined #openstack-infra | 15:28 | |
fungi | rosmaita: did you use the create new drop-down or the add story button? | 15:29 |
rosmaita | fungi: create-new dropdown | 15:29 |
fungi | you probably hit https://storyboard.openstack.org/#!/story/2003650 in that case | 15:30 |
openstackgerrit | Doug Hellmann proposed openstack-infra/yaml2ical master: add monthly recurrence options https://review.openstack.org/608680 | 15:30 |
fungi | it's a regression introduced by the new name-based project urls, unfortunately | 15:30 |
rosmaita | fungi: you're right, that's the issue | 15:31 |
openstackgerrit | Doug Hellmann proposed openstack-infra/yaml2ical master: add monthly recurrence options https://review.openstack.org/608680 | 15:31 |
*** eharney_ has joined #openstack-infra | 15:31 | |
*** eharney has quit IRC | 15:34 | |
*** Goneri has joined #openstack-infra | 15:39 | |
*** ianychoi has quit IRC | 15:39 | |
*** armax has quit IRC | 15:39 | |
fungi | heading out to grab lunch and run some errands but should be back well in advance of the meeting at 1900z | 15:39 |
fungi | probably no more than 2 hours | 15:40 |
*** Goneri has quit IRC | 15:41 | |
*** munimeha1 has quit IRC | 15:43 | |
*** armstrong has joined #openstack-infra | 15:43 | |
*** diablo_rojo has joined #openstack-infra | 15:44 | |
armstrong | @diablo_rojo_phon: hello, please can I have a list of all the projects that migrated from launchpad to storyboard? | 15:44 |
*** aojeagarcia has quit IRC | 15:46 | |
armstrong | Sorry meant to @diablo_rojo: hello, please can I have a list of all the projects that migrated from launchpad to storyboard? | 15:49 |
*** hamzy has quit IRC | 15:50 | |
*** janki has joined #openstack-infra | 15:52 | |
tosky | armstrong: you can check the projects where use_storyboard: true is set in gerrit/projects.yaml, openstack-infra/project-config.git | 15:55 |
armstrong | @tosky: thanks for tour quick response | 15:58 |
armstrong | I appreciate | 15:58 |
tosky | use-storyboard: true, not use_storyboard: true | 15:59 |
armstrong | Ok | 16:03 |
diablo_rojo | armstrong, yeah that's the quickest way to see which use sb already | 16:04 |
diablo_rojo | unless there is one in particular, I can probably answer that for you | 16:04 |
openstackgerrit | Merged openstack-infra/zuul master: Speed up build list query under mysql https://review.openstack.org/605170 | 16:04 |
weshay | can tripleo please get this patch moved to the top of the queue https://review.openstack.org/#/c/606986/ | 16:09 |
weshay | resolves some gate failures we're seeing | 16:09 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP: docker-compose quickstart example https://review.openstack.org/608344 | 16:17 |
openstackgerrit | Chris Hoge proposed openstack-infra/irc-meetings master: RefStack is in maintenance, cancel meeting https://review.openstack.org/609047 | 16:17 |
*** felipemonteiro has quit IRC | 16:19 | |
*** kashyap has left #openstack-infra | 16:19 | |
clarkb | config-core infra-root can we get reviews on https://review.openstack.org/#/c/608303/ to address one of the gate issues on the infra side of things | 16:19 |
corvus | clarkb: you tested it right? | 16:20 |
clarkb | corvus: yes I shouldve left links with those details on the change but maybe I only did that here | 16:20 |
clarkb | corvus https://review.openstack.org/#/c/608732/ is the test change | 16:21 |
corvus | clarkb: i'll comment and approve | 16:21 |
*** coolsvap has quit IRC | 16:23 | |
*** jpich has quit IRC | 16:23 | |
*** kjackal has quit IRC | 16:24 | |
*** diablo_rojo has quit IRC | 16:25 | |
*** panda has quit IRC | 16:34 | |
*** armax has joined #openstack-infra | 16:36 | |
*** panda has joined #openstack-infra | 16:36 | |
clarkb | weshay: promoting that change will restart jobs for the tripleo gate queue. I assume worth it in this case because this is fixing a failure causing bug? | 16:42 |
clarkb | weshay: I'm ready to promote it now if you are still wanting to do that | 16:42 |
*** gyee has joined #openstack-infra | 16:43 | |
clarkb | but then I've got to go back to conferencing. | 16:43 |
*** mriedem is now known as mriedem_stew | 16:43 | |
clarkb | related to ^ my talk happens just a few minutes after the infra meeting so I may have fungi chair the meeting today so that I can prep for that but I will likely attend the meeting as it falls during our lunch break | 16:44 |
openstackgerrit | Merged openstack-infra/zuul-jobs master: Retry failed git pushses on workspace setup https://review.openstack.org/608303 | 16:45 |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updated Presentation serializer https://review.openstack.org/609054 | 16:46 |
*** armax has quit IRC | 16:46 | |
openstackgerrit | Merged openstack-infra/openstackid-resources master: Updated Presentation serializer https://review.openstack.org/609054 | 16:47 |
*** jbadiapa has joined #openstack-infra | 16:47 | |
*** jrosser has joined #openstack-infra | 16:47 | |
*** boden has quit IRC | 16:49 | |
*** eharney_ is now known as eharney | 16:52 | |
*** boden has joined #openstack-infra | 16:52 | |
*** bhavikdbavishi has joined #openstack-infra | 16:57 | |
*** bhavikdbavishi1 has joined #openstack-infra | 17:02 | |
*** kushinauwu has joined #openstack-infra | 17:03 | |
*** bhavikdbavishi has quit IRC | 17:04 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 17:04 | |
weshay | clarkb, sorry for the late reply .. that change will fix a fairly consistent gate failure we've seen w/ ara and our ansible playbooks | 17:05 |
weshay | imho it's worth it | 17:05 |
weshay | mwhahaha, ^ | 17:05 |
mwhahaha | i concur | 17:06 |
clarkb | ok promoting now | 17:06 |
clarkb | done | 17:07 |
*** yamamoto has quit IRC | 17:08 | |
*** yamamoto has joined #openstack-infra | 17:08 | |
*** dtantsur is now known as dtantsur|afk | 17:08 | |
weshay | thanks clarkb | 17:09 |
*** boden has quit IRC | 17:14 | |
*** janki has quit IRC | 17:14 | |
*** kushinauwu has quit IRC | 17:17 | |
*** kushinauwu has joined #openstack-infra | 17:18 | |
*** trown is now known as trown|lunch | 17:19 | |
*** janki has joined #openstack-infra | 17:22 | |
*** apetrich has quit IRC | 17:22 | |
*** jamesmcarthur has quit IRC | 17:22 | |
*** jamesmcarthur has joined #openstack-infra | 17:22 | |
*** jamesmcarthur has quit IRC | 17:27 | |
priteau | Is there something wrong with https://review.openstack.org/#/c/602173/ or with the infra? The patch got its W+1 9 hours ago, but I don't see it listed anywhere on http://zuul.openstack.org/status | 17:32 |
clarkb | priteau: gerrit doesnt seem to know about the parent commit of that vhange? I'm on a phone at a conf so not in a great spot to debug further | 17:40 |
*** shardy has quit IRC | 17:41 | |
priteau | The parent commit is a merge commit, but it is in master. | 17:42 |
priteau | Should I just rebase it to work around the issue or do you want the opportunity to investigate it further? | 17:44 |
clarkb | its probably worth undersranding the problem | 17:44 |
clarkb | the little orange dot next to the parent commit sha is why I look at that | 17:44 |
clarkb | corvus or fungi may be able to take another look | 17:45 |
priteau | OK, I will leave it untouched for now. | 17:45 |
*** ociuhandu has quit IRC | 17:45 | |
*** jamesmcarthur has joined #openstack-infra | 17:45 | |
*** amoralej is now known as amoralej|off | 17:49 | |
corvus | hrm, i don't see an orange dot, and the parent seems to be legitimately in the git history | 17:49 |
*** Swami has joined #openstack-infra | 17:49 | |
*** electrofelix has quit IRC | 17:50 | |
corvus | priteau: it looks like zuul missed the event from gerrit; i don't see it in the logs. you can go ahead and add another workflow+1 (or remove and add the existing one) to try triggering it again | 17:53 |
openstackgerrit | Corey Bryant proposed openstack-infra/openstack-zuul-jobs master: Create openstack-tox-py37 job https://review.openstack.org/609066 | 17:54 |
priteau | I see the orange dot. | 17:56 |
priteau | It doesn't make sense though: "If an ancestor change is marked with an orange dot it means that the currently viewed patch set depends on a outdated patch set of the ancestor change. This is because a new patch set for the ancestor change was uploaded in the meantime and as result the currently viewed patch set now needs to be rebased." | 17:56 |
priteau | This patch was created after the parent commit was merged in master | 17:57 |
clarkb | ya that may be a bug in gerrit? | 17:57 |
priteau | Does the orange dot next to parent actually mean something else? | 17:58 |
*** armax has joined #openstack-infra | 17:58 | |
clarkb | priteau: if you ut your mouse pointer over the top of it it should give you the specific data for that context | 17:58 |
priteau | Anyway, if the issue is a missed event, I guess the orange dot was just a red herring | 17:58 |
clarkb | yup | 17:59 |
priteau | "Not current - rebase possible" | 17:59 |
openstackgerrit | Corey Bryant proposed openstack-infra/openstack-zuul-jobs master: Add openstack-python37-jobs-* templates https://review.openstack.org/609070 | 17:59 |
priteau | Does it just mean that parent != HEAD? | 17:59 |
corvus | oh weird, the orange dot only shows up if you're logged in | 18:00 |
priteau | Gerrit view for this patch after I W+1'ed is showing: "Updated: in the future" | 18:01 |
priteau | Anyway, Zuul has started gate jobs, thanks corvus and clarkb! | 18:01 |
*** hamzy has joined #openstack-infra | 18:05 | |
AJaeger | infra-root, I think we're leaking ports in ovh-bhs1 again, see http://grafana.openstack.org/d/BhcSH5Iiz/nodepool-ovh?orgId=1 - can you check ports, please? | 18:06 |
*** yamamoto has quit IRC | 18:07 | |
*** yamamoto has joined #openstack-infra | 18:07 | |
*** yamamoto has quit IRC | 18:08 | |
*** kushinauwu has quit IRC | 18:08 | |
AJaeger | infra-root, any known problems with packethost? The node usage graph looks odd http://grafana.openstack.org/d/U462abNik/nodepool-packethost?orgId=1 | 18:08 |
*** yamamoto has joined #openstack-infra | 18:09 | |
fungi | the mirror server seems to be up this time, at least | 18:10 |
*** jamesmcarthur has quit IRC | 18:10 | |
*** jamesmcarthur has joined #openstack-infra | 18:10 | |
*** yamamoto has quit IRC | 18:13 | |
*** annp has quit IRC | 18:20 | |
*** armstrong has quit IRC | 18:24 | |
*** kaiokmo has quit IRC | 18:26 | |
Shrews | AJaeger: fungi: openstack.exceptions.SDKException: Error in creating the server: Build of instance 20b02ba1-1ea1-42ed-ad11-07b17e4fb81c aborted: Failed to allocate the network(s) with error No fixed IP addresses available for network: b71a8dc0-709d-4994-87a4-6ecec4c4391c, not rescheduling. | 18:27 |
Shrews | latest packethost error in nodepool logs | 18:28 |
fungi | fun, so probably a fip leak | 18:28 |
Shrews | or we finally ran out of IPv4 addresses! | 18:29 |
*** mriedem_stew is now known as mriedem | 18:31 | |
fungi | https://ipv6.he.net/statistics/ | 18:31 |
fungi | africa and europe still have a few | 18:32 |
*** ijw has quit IRC | 18:37 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Convert some more repos to publish-to-pypi-python3 https://review.openstack.org/609087 | 18:37 |
*** bhavikdbavishi has quit IRC | 18:38 | |
*** eernst has joined #openstack-infra | 18:38 | |
*** janki has quit IRC | 18:38 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-tempest-dsvm-cinder-v1 https://review.openstack.org/609089 | 18:42 |
*** kjackal has joined #openstack-infra | 18:43 | |
clarkb | fungi: it probably would be best if you can chair the meeting. Not sure if you saw that earlier. This way I can grab something to eat and make sure the projector works before my talk | 18:46 |
clarkb | scheduling is hard | 18:47 |
*** armax has quit IRC | 18:49 | |
*** kaiokmo has joined #openstack-infra | 18:51 | |
*** yamamoto has joined #openstack-infra | 18:51 | |
fungi | yeah, happy to steer | 18:51 |
fungi | g'luck on your talk! | 18:51 |
*** trown|lunch is now known as trown | 18:52 | |
*** eharney has quit IRC | 18:53 | |
*** ijw has joined #openstack-infra | 18:57 | |
fungi | infra meeting coming up in one minute in #openstack-meeting | 18:59 |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: update caldav client lib due an error on vcard response parsing https://review.openstack.org/609093 | 18:59 |
fungi | be thoroughly prepared for me to be thoroughly unprepared | 18:59 |
openstackgerrit | Merged openstack-infra/openstackid-resources master: update caldav client lib due an error on vcard response parsing https://review.openstack.org/609093 | 19:00 |
*** jamesmcarthur has quit IRC | 19:02 | |
*** jamesmcarthur has joined #openstack-infra | 19:03 | |
*** eharney has joined #openstack-infra | 19:08 | |
*** markvoelker has quit IRC | 19:09 | |
*** markvoelker has joined #openstack-infra | 19:09 | |
*** hamzy_ has joined #openstack-infra | 19:10 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Update publish-to-pypi-neutron https://review.openstack.org/609097 | 19:11 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove usage of tox -e venv from release job https://review.openstack.org/609098 | 19:12 |
smcginnis | Whoa, just checked zuul.openstack.org for the first time in a day or two. Lookin' pretty schnazzy there zuul. | 19:12 |
*** jamesmcarthur has quit IRC | 19:12 | |
clarkb | smcginnis: more importantly the auto scroll disable on streaming console logs works now :P | 19:12 |
AJaeger | dhellmann, smcginnis, could you review https://review.openstack.org/609098 , please? I think we're ready to go forward now - and timing should be good... | 19:12 |
*** jamesmcarthur has joined #openstack-infra | 19:12 | |
*** hamzy has quit IRC | 19:12 | |
*** armax has joined #openstack-infra | 19:12 | |
smcginnis | clarkb: Haven't you learned by now? Looking schnazzy online is more important than functionality. ;) | 19:13 |
smcginnis | AJaeger: On it. | 19:13 |
dhellmann | AJaeger : do we still need those old release jobs? | 19:13 |
smcginnis | And is venv needed for playbooks/python-branch-tarball/post.yaml? Checking that out now. | 19:15 |
*** markvoelker has quit IRC | 19:15 | |
dhellmann | it looks like we do have a couple of projects still using release-openstack-python-without-pypi | 19:15 |
AJaeger | dhellmann: I'm currently figuring out what can be cleaned up - do you propose to cleanup more? What exactly? | 19:15 |
AJaeger | dhellmann: yeah ;( | 19:15 |
AJaeger | dhellmann: not many... | 19:15 |
dhellmann | the other day we discussed the idea of having a language-independent-tarball-release job that didn't rely on pbr or setuptools to build the tarball, and switching anything that didn't want to be published to pypi to use that | 19:16 |
AJaeger | dhellmann: yeah, that could be used for those... | 19:17 |
dhellmann | I think I would rather do that than change what those existing jobs do | 19:17 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove obsolete publish-to-pypi-{neutron,horizon} https://review.openstack.org/609099 | 19:17 |
dhellmann | but I don't have time to do either myself, so if this is an improvement in your mind then it's OK with me | 19:17 |
*** markvoelker has joined #openstack-infra | 19:17 | |
AJaeger | dhellmann: with the -python3 release jobs now working fine, I feel confident to make this change as intermediate step. Yes, release-openstack-python-without-pypi could be changed - but I think we need the rest. OR do you see others obsolete as well? | 19:20 |
dhellmann | no, I'm just not clear why this is an improvement over the current situation, I guess | 19:21 |
AJaeger | dhellmann: it's an improovement since we can remove all the required-projects... | 19:21 |
dhellmann | ok, I guess that's something | 19:22 |
AJaeger | dhellmann: and having *one* instead of *two* playbooks that do the same is also an improvement | 19:22 |
dhellmann | I'm a little concerned about reusing the playbooks because when I work on those I really only think about the whole end-to-end publish to pypi aspects, but I guess we can fix errors if we find them | 19:22 |
AJaeger | dhellmann: regarding https://review.openstack.org/609097 - do you think all of them can be updated to use python3? | 19:24 |
AJaeger | those are not official repos, so I didn't do it... | 19:24 |
dhellmann | I never ran into any issues with any repo that actually needed python2 as long as we weren't installing any dependencies | 19:25 |
AJaeger | ok, then let me switch... | 19:25 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Update publish-to-pypi-neutron https://review.openstack.org/609097 | 19:28 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove usage of tox -e venv from release job https://review.openstack.org/609098 | 19:28 |
AJaeger | dhellmann: updated ^ | 19:28 |
*** jamesmcarthur has quit IRC | 19:29 | |
dhellmann | lgtm | 19:29 |
*** jamesmcarthur has joined #openstack-infra | 19:30 | |
*** armax has quit IRC | 19:35 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove now obsolete required-repos https://review.openstack.org/609108 | 19:35 |
AJaeger | dhellmann: and that's the final cleanup that is now possible ^ | 19:35 |
*** jamesmcarthur has quit IRC | 19:35 | |
*** jamesmcarthur has joined #openstack-infra | 19:36 | |
dhellmann | AJaeger : I think that step needs to be done with the step that changes the release jobs, doesn't it? otherwise the repo will have 2 release jobs attached to it for a period of time | 19:38 |
AJaeger | dhellmann: It's based on top of it | 19:38 |
dhellmann | yeah, I meant shoudln't it be squashed? | 19:38 |
dhellmann | or do you intend to land all of these together? | 19:38 |
AJaeger | dhellmann: yeah, landing them together is needed... | 19:39 |
dhellmann | ok | 19:39 |
AJaeger | dhellmann: let me ask what rest of team thinks. | 19:39 |
*** jamesmcarthur has quit IRC | 19:48 | |
*** jamesmcarthur has joined #openstack-infra | 19:51 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fixed composer.lock https://review.openstack.org/609113 | 19:54 |
openstackgerrit | Merged openstack-infra/openstackid-resources master: Fixed composer.lock https://review.openstack.org/609113 | 19:55 |
*** stevebaker has quit IRC | 19:57 | |
*** gouthamr has quit IRC | 19:58 | |
*** dmellado has quit IRC | 19:58 | |
AJaeger | config-core, could you review the stack starting at https://review.openstack.org/#/c/609087 . I'd like to merge them together, thus gave WIP to the first one. | 20:01 |
ianw | AJaeger: did you get an answer on ovs-bhs1? | 20:04 |
*** eernst has quit IRC | 20:04 | |
AJaeger | ianw: no | 20:05 |
ianw | OS_CLIENT_CONFIG_FILE=/etc/openstack/all-clouds.yaml openstack --os-cloud=openstackjenkins-ovh --os-region BHS1 port list | grep 'fa:16' | wc -l | 20:05 |
ianw | 300 | 20:05 |
ianw | that is very suspicious | 20:06 |
AJaeger | ianw: clarkb run a script last Friday (?) to delete those... | 20:06 |
ianw | yeah, there's only ~ 90 servers, so something has gone wrong | 20:07 |
ianw | let me track back through logs to see if there's any context | 20:07 |
*** colonwq has quit IRC | 20:09 | |
AJaeger | thanks for looking into this, ianw | 20:09 |
fungi | last we heard they're having performance with their switch backend for neutron since the newton upgrade | 20:09 |
fungi | we know that if nova's port delete call to neutron times out/fails it doesn't retry it | 20:09 |
fungi | there was some discussion of whether we could add port tracking in nodepool to identify and clean up leaked ports | 20:10 |
AJaeger | fungi, could you also put the stack starting at 609087 on your review list, please? Like to get that early in this cycle... | 20:10 |
fungi | but for right now the only solution is to manually delete ports which have been in a down state for long enough that it's not likely just waiting to get attached to a newly booting instance | 20:10 |
* AJaeger waves good night | 20:12 | |
openstackgerrit | Jonathan Rosser proposed openstack-infra/project-config master: Refresh openstack-ansible grafana dashboard https://review.openstack.org/609117 | 20:12 |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/puppet-openstackci master: Enforce use of UTF-8 encoding for plain text files https://review.openstack.org/609118 | 20:12 |
*** ijw_ has joined #openstack-infra | 20:13 | |
*** ijw has quit IRC | 20:13 | |
openstackgerrit | Jonathan Rosser proposed openstack-infra/project-config master: Refresh openstack-ansible grafana dashboard https://review.openstack.org/609117 | 20:20 |
ianw | fungi: how is "long enough" determined? | 20:21 |
*** kgiusti has left #openstack-infra | 20:23 | |
ianw | i can't see there's a timestamp. i can remove the DOWN ones | 20:24 |
fungi | ianw: what i've done in the past is make a list of downed port uuids, sleep for something like 300, then do it again and any which appear on both lists can be safely deleted | 20:27 |
fungi | though if you prematurely delete a port which was destined to be attached to an instance, the instance will just get recycled anyway as a broken one | 20:27 |
*** pcaruana has quit IRC | 20:37 | |
*** ijw_ has quit IRC | 20:41 | |
*** ijw has joined #openstack-infra | 20:42 | |
*** hamzy_ has quit IRC | 20:46 | |
*** gouthamr has joined #openstack-infra | 20:50 | |
*** dmellado has joined #openstack-infra | 20:53 | |
*** ansmith has quit IRC | 20:58 | |
openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add a helper for manual port cleanup https://review.openstack.org/609133 | 21:00 |
ianw | fungi: ^ maybe don't want to merge that, but it's what i've got going removing the ports now | 21:01 |
njohnston | Is this the right place to ask a question about the new zuul web UI, or is there a separate zuul-related channel for that now? | 21:01 |
ianw | njohnston: there is #zuul | 21:03 |
njohnston | thanks ianw | 21:04 |
ianw | njohnston: if it's specific to infra we can help, if it's something you'd like implemented, probably #zuul | 21:04 |
*** eharney has quit IRC | 21:05 | |
*** trown is now known as trown|outtypewww | 21:05 | |
njohnston | My question is: Yesterday I could put a space-delimited list of change IDs in the "Change or project name" field on zuul.o.o/status and it would show any changes that matched any one of those change IDs. Now it seems that causes zuul to match nothing. Is there a way to do this with a different syntax now, or is there a way to say "show jobs where I am the submitter"? | 21:05 |
fungi | njohnston: sounds like the regression https://review.openstack.org/593605 is intended to address | 21:05 |
njohnston | ah thanks | 21:06 |
fungi | oh, or maybe not | 21:06 |
fungi | this is build-oriented and you're filtering on multiple change ids? | 21:06 |
fungi | could be a different, not-yet-reported regression | 21:07 |
njohnston | yes, for example right now I tried to put in "592164 584061" and instead of 2 job results I got zero | 21:07 |
njohnston | I can file a storyboard story for it | 21:08 |
*** bobh has quit IRC | 21:08 | |
ianw | yeah, that seems reasonable ... not sure i realised you could do that with the old version :) | 21:08 |
fungi | njohnston: yes please, https://storyboard.openstack.org/#!/project/openstack-infra/zuul while logged in and use the +add story button on the right side | 21:09 |
fungi | (the create new drop-down has an issue with prepopulated task projects right now) | 21:10 |
*** stevebaker has joined #openstack-infra | 21:10 | |
*** kjackal has quit IRC | 21:13 | |
njohnston | ianw fungi: Thanks very much https://storyboard.openstack.org/#!/story/2004029 | 21:13 |
*** jrist has joined #openstack-infra | 21:14 | |
*** priteau has quit IRC | 21:15 | |
*** jamesmcarthur has quit IRC | 21:16 | |
*** Emine has quit IRC | 21:17 | |
imacdonn | hmmm, something funky with the new zuul dashboard ... I have a list of change IDs in the filter field - if I try to delete one of them by highlighting it and hitting backspace, it immediately reappears | 21:18 |
ianw | i think that's a known problem with the auto-refresh, maybe | 21:18 |
njohnston | yes, you have to get it - and hit enter - before the refresh | 21:19 |
imacdonn | ok, if it's known .. and yeah, it works if I hit Enter right after Backspace | 21:20 |
ianw | imacdonn: hrm, perhaps "known" is too strong, mordred mentioned it http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-10-09.log.html#t2018-10-09T04:04:30 | 21:22 |
ianw | tristanC: ^ is this something you want to track? | 21:22 |
clarkb | ok I think the talk went well | 21:23 |
fungi | might warrant another story | 21:23 |
fungi | clarkb: awesome! | 21:23 |
fungi | did you get sidelined with lots of questions in the hallway afterward, hopefully? | 21:23 |
clarkb | fungi: thank you for handling the meeting. I was eating a light lunch and figuring out xrandr for weird projector and ya fun times | 21:23 |
clarkb | fungi: yes I did | 21:23 |
fungi | i use xrandr to add/remove projectors on my portable devices. highly recommend | 21:24 |
ianw | clarkb / fungi : ok, so after about 15 minutes we're still leaking ports in BHS1. do we just run the manual cleanup in a loop for now, or what? | 21:28 |
clarkb | ianw: ya Ithink we need or want to add that to nodepool :( | 21:28 |
clarkb | I havne't had a chance to look at writing that so feel free to if it interests you | 21:28 |
*** jtomasek has quit IRC | 21:29 | |
ianw | clarkb: ok, that sounds like a longer term solution ... if you like, i can run the script from 609133 in a screen on bridge say, every 1/2 hour | 21:34 |
*** armax has joined #openstack-infra | 21:34 | |
clarkb | ianw: ya that may be a reasonable short term solution | 21:34 |
fungi | at least until ovh is able to rectify the performance regression | 21:35 |
fungi | (or upgrade to even newer openstack) | 21:36 |
clarkb | we should really try to get neutron involved | 21:36 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add docker-compose quickstart example https://review.openstack.org/608344 | 21:36 |
clarkb | I'm guessing this isn't just an ovh problem since we see similar with packethost | 21:36 |
fungi | what release is that ph cloud on, any idea? | 21:37 |
dhellmann | in the new zuul UI, did we lose the ability to search for multiple things at once? or did the syntax for that change? using "release,heat" used to show me both projects, now it returns no results | 21:38 |
dhellmann | that's on http://zuul.openstack.org/status if that wasn't clear | 21:39 |
*** bobh has joined #openstack-infra | 21:41 | |
ianw | dhellmann: we were just discussing that :) it seems it has regressed and https://storyboard.openstack.org/#!/story/2004029 was filed | 21:45 |
*** bobh has quit IRC | 21:45 | |
dhellmann | ianw : nice, thanks! I just noticed both the UI change and the behavior change, so wondered if it was intentional. I'll subscribe to the story. | 21:47 |
corvus | i'm restarting zuul-web | 21:47 |
corvus | http://zuul.openstack.org/builds.html is lightning-fast now | 21:48 |
clarkb | fungi: I don't know | 21:49 |
clarkb | corvus: new sql query merged? | 21:49 |
corvus | clarkb: yep | 21:49 |
corvus | er http://zuul.openstack.org/builds is correct url | 21:50 |
ianw | #status log OVH BSH1 manual port cleanup is running periodically (every 20 minutes) in a root screen on bridge.o.o until a better solution appears | 21:52 |
openstackstatus | ianw: finished logging | 21:52 |
*** armax has quit IRC | 21:54 | |
*** bobh has joined #openstack-infra | 21:54 | |
*** rossella_s has quit IRC | 22:03 | |
*** rossella_s has joined #openstack-infra | 22:03 | |
*** carl_cai has joined #openstack-infra | 22:04 | |
clarkb | fungi: fwiw no more mirror issues after you allocated disk | 22:06 |
*** bobh has quit IRC | 22:09 | |
fungi | yeah, i've been logged into it watching to see it randomly die on us | 22:15 |
fungi | still fine | 22:15 |
*** slaweq has quit IRC | 22:17 | |
ianw | fungi / clarkb : would you agree with my comments on https://review.openstack.org/#/c/609118 ? every time i look at htmlify etc i have to context switch how it all works back in :) | 22:20 |
*** dhill_ has quit IRC | 22:25 | |
fungi | i think you're right | 22:26 |
clarkb | ya those wont be served directly and go through os-loganalyze | 22:28 |
ianw | oh, https://git.openstack.org/cgit/openstack-infra/os-loganalyze/tree/os_loganalyze/util.py#n47 splits off the charset | 22:30 |
dmsimard | Should we update gerrit ? https://groups.google.com/forum/m/#!topic/repo-discuss/XDNbORnDqAk | 22:34 |
*** rossella_s has quit IRC | 22:36 | |
fungi | dmsimard: https://projects.eclipse.org/projects/technology.jgit/releases/4.11.4 | 22:37 |
fungi | "JGit itself is not affected by this vulnerability. This release implements validation of .gitmodules files in JGit to protect unguarded tools." | 22:37 |
*** panda has quit IRC | 22:37 | |
dmsimard | I'm not sure what's the take away but haven't finished reading about it either | 22:38 |
fungi | specifically, if an attacker pushed up a specially-crafted .gitmodules file and then convinced a victim to git clone --recursive the affected repo directly from gerrit (which we already discourage), _and_ the victim was running an outdated git client version, then they could be affected | 22:38 |
dmsimard | Does gerrit bundle jgit ? | 22:38 |
fungi | yes | 22:38 |
*** panda has joined #openstack-infra | 22:39 | |
fungi | they're recommending upgrading to a version of gerrit which has a newer vendored-in jgit version including the cve-2018-17456 patch | 22:39 |
*** rossella_s has joined #openstack-infra | 22:40 | |
dmsimard | Wow January 2012 commit from corvus: https://github.com/openstack-infra/gerrit | 22:41 |
dmsimard | I don't think I even knew OpenStack existed back then | 22:41 |
openstackgerrit | Merged openstack-infra/storyboard master: accept tag values in the body as well as URL https://review.openstack.org/608727 | 22:41 |
fungi | we don't build from the master branch. we create upstream tracking branches | 22:42 |
*** rcernin has joined #openstack-infra | 22:42 | |
dmsimard | Yeah, I fell on it due to the default branch | 22:42 |
dmsimard | I was curious what was the delta with upstream, I never bothered to really check | 22:43 |
fungi | just backports of fixes we need from later branches | 22:44 |
*** owalsh is now known as owalsh_away | 22:47 | |
*** rpioso is now known as rpioso|afk | 22:50 | |
*** ansmith has joined #openstack-infra | 22:55 | |
*** mriedem has quit IRC | 22:57 | |
*** hongbin has quit IRC | 22:58 | |
*** lbragstad has quit IRC | 23:01 | |
openstackgerrit | Merged openstack-infra/project-config master: Move performa jobs to project repository https://review.openstack.org/608289 | 23:04 |
openstackgerrit | Merged openstack-infra/project-config master: Move Stackalytics jobs to project repository https://review.openstack.org/608286 | 23:06 |
*** pbourke has quit IRC | 23:09 | |
*** pbourke has joined #openstack-infra | 23:09 | |
*** slaweq has joined #openstack-infra | 23:11 | |
*** efried has quit IRC | 23:12 | |
*** efried has joined #openstack-infra | 23:13 | |
openstackgerrit | Merged openstack-infra/project-config master: Add publish jobs for StarlingX api-ref and releasenotes https://review.openstack.org/608304 | 23:13 |
*** slaweq has quit IRC | 23:16 | |
*** tosky has quit IRC | 23:21 | |
*** yamamoto has quit IRC | 23:28 | |
*** ijw has quit IRC | 23:29 | |
*** sshnaidm is now known as sshnaidm|afk | 23:32 | |
openstackgerrit | Logan V proposed openstack-infra/project-config master: Bump Limestone to max-servers 50 https://review.openstack.org/609167 | 23:35 |
*** Swami has quit IRC | 23:43 | |
*** jamesmcarthur has joined #openstack-infra | 23:48 | |
*** yamamoto has joined #openstack-infra | 23:55 | |
*** agopi is now known as agopi|brb | 23:56 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Provide for an EPEL mirror during build https://review.openstack.org/608834 | 23:57 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Set EPEL mirror during openstack-ci-mirrors https://review.openstack.org/609169 | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!