Tuesday, 2019-08-27

*** eernst has joined #openstack-infra00:08
*** markvoelker has joined #openstack-infra00:10
*** rlandy|ruck is now known as rlandy|ruck|bbl00:11
*** rh-jelabarre has quit IRC00:14
*** markvoelker has quit IRC00:15
*** eernst has quit IRC00:15
clarkbI wonder what it is about tyat volume that makes it prone to that00:15
*** aaronsheffield has quit IRC00:16
*** xenos76 has quit IRC00:16
openstackgerritMerged openstack/project-config master: Cleanup roles that have moved to opendev/base-jobs  https://review.opendev.org/67830400:17
*** gyee has quit IRC00:18
fungivery large amounts of churn?00:18
*** bobh has joined #openstack-infra00:20
*** eernst has joined #openstack-infra00:21
*** threestrands has joined #openstack-infra00:24
*** bobh has quit IRC00:30
*** seongsoocho has joined #openstack-infra00:34
*** hongbin has joined #openstack-infra00:37
*** eernst has quit IRC00:40
ianwit seems to have finished ... i need to improve the logging a bit, it's too hard to figure out what's going on00:47
ianwfungi: yeah, there wasn't any changes since the last rsync run afaics00:48
fungioh... huh00:48
*** ociuhandu has joined #openstack-infra00:53
*** michael-beaver has quit IRC00:55
*** gregoryo has joined #openstack-infra00:57
*** ociuhandu has quit IRC00:57
*** eernst has joined #openstack-infra00:59
*** zhurong has joined #openstack-infra01:00
*** bobh has joined #openstack-infra01:10
*** slaweq has joined #openstack-infra01:11
*** rcernin has quit IRC01:13
*** bobh has quit IRC01:13
*** slaweq has quit IRC01:16
ianwso on afs02, kswapd is running at ~100% ...01:24
ianwthe host appears under no memory pressure01:24
*** calebb has quit IRC01:25
ianw... interesting -- i did "echo 1 > /proc/sys/vm/drop_caches" and almost instantly the vos release finished01:26
fungiwacky01:26
ianw... no scratch that, i'm a dolt, i just stopped my tail of the log file01:27
fungiheh01:27
ianwhowever, kswapd0 has disappeared from top01:27
ianwafs01 has the same thing going on01:28
ianwSwap:       7999484           0     799948401:28
ianwit is not touching swap01:28
fungiso they're virtual memory hungry i guess?01:28
fungii'm curious to take a look at cacti now01:29
ianwfungi: maybe double check afs01 too and make sure i'm not crazy ...01:29
fungiyeah: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=6400&rra_id=all01:30
fungialmost all cache memory01:30
fungialso the network bandwidth utilization is rather high for what i would have expected01:31
fungihttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=6405&rra_id=all01:31
*** bhavikdbavishi has joined #openstack-infra01:31
*** factor has joined #openstack-infra01:33
*** bhavikdbavishi1 has joined #openstack-infra01:35
*** bhavikdbavishi has quit IRC01:35
*** bhavikdbavishi1 is now known as bhavikdbavishi01:35
ianwi will keep an eye on both to see if it comes back ...01:44
ianw#status log run "/proc/sys/vm/drop_caches" on afs01 & afs02 dfw to reset very high kswapd0 cpu usage01:45
openstackstatusianw: finished logging01:45
openstackgerritClark Boylan proposed zuul/zuul master: This is a stub for a bug to help us find and fix it  https://review.opendev.org/67871001:53
*** apetrich has quit IRC02:10
*** slaweq has joined #openstack-infra02:11
*** rcernin has joined #openstack-infra02:13
*** slaweq has quit IRC02:16
*** larainema has joined #openstack-infra02:23
*** whoami-rajat has joined #openstack-infra02:27
*** rlandy|ruck|bbl is now known as rlandy|ruck02:29
*** rlandy|ruck has quit IRC02:29
*** markvoelker has joined #openstack-infra03:10
ianwpabelanger: something i've noticed just auditing why afs01.dfw isn't in cacti ... pbx.openstack.org has a full disk03:13
ianwroot@pbx01:/var/log/asterisk# ls -lh /var/log/asterisk/messages.303:13
ianw-rw-r--r-- 1 asterisk asterisk 27G Aug 27 03:13 /var/log/asterisk/messages.303:13
ianwmust be something about how it rotates ...03:14
*** markvoelker has quit IRC03:15
*** eernst_ has joined #openstack-infra03:23
*** eernst has quit IRC03:23
*** nicolasbock has quit IRC03:25
*** psachin has joined #openstack-infra03:33
*** ramishra has joined #openstack-infra03:36
fungiyeah, if a logfile grows too rapidly and there's insufficient space to write the compressed copy that can happen03:48
*** jtomasek has quit IRC04:00
*** rfolco has quit IRC04:03
*** udesale has joined #openstack-infra04:06
*** markvoelker has joined #openstack-infra04:10
*** slaweq has joined #openstack-infra04:11
*** odicha has joined #openstack-infra04:13
openstackgerritIan Wienand proposed opendev/system-config master: fedora-mirror-update: update logging  https://review.opendev.org/67871704:13
*** hongbin has quit IRC04:13
*** markvoelker has quit IRC04:15
openstackgerritAndreas Jaeger proposed openstack/project-config master: Fix paths for static docs playbook  https://review.opendev.org/67871804:15
AJaegerconfig-core, can we merge this, please? Sorry for wrong path ^04:16
*** slaweq has quit IRC04:16
ianwfungi: yeah, that host is under spam attack04:16
*** bdodd_ has joined #openstack-infra04:17
*** bdodd has quit IRC04:17
AJaegerthanks, ianw !04:18
AJaegerand good evening to you04:18
ianwAJaeger: i don't know if you saw, i put on the agenda for meeting tomorrow (or today, or whenever it is :) about the future of static.o.o04:18
AJaegerah ;)04:19
AJaegerdidn't catch yet - and will be out tonight so won't make it...04:19
ianwi did an audit of what it's doing ... a bunch of legacy redirects, and serving the few static things we write out04:19
ianw(once logs.o.o component ages out)04:20
AJaegerYes, we could put these all into AFS and serve from there...04:20
ianwthat's ok ... has there been prior talk about moving those jobs to afs04:20
ianwheh, jinx :)04:20
AJaegerI don't rememember04:20
ianwi wondered if it was a "can't do that" or more just nobody got around to it04:20
AJaegerI think the later - but ask in the meeting04:21
AJaegerianw: do you know how to reenque a promote job once 678718  is merged?04:21
ianwhrm, i can try ...04:22
ianwmy attempts at submitting periodic jobs did not go so well04:22
ianwdo you have a link to the job failure?04:23
AJaegerhttps://review.opendev.org/67835204:23
AJaegersince it's promote pipeline, should be the same as in enqueue into gate04:23
*** raukadah is now known as chkumar|rover04:26
ianwAJaeger: yeah, i can try an enqueue (as opposed to enqueue-ref ... that's where things get tricky figuring out what arguments are required)04:26
AJaegerah04:29
*** eernst_ has quit IRC04:34
openstackgerritMerged openstack/project-config master: Fix paths for static docs playbook  https://review.opendev.org/67871804:35
AJaegerisn't it simply zuul enqueue --tenant openstack --trigger gerrit --pipeline promote --project election --change 678352,1 ?04:36
*** dave-mccowan has quit IRC04:36
ianwAJaeger: yeah (openstack/election) ... looks like it still failed though04:38
ianwhttp://zuul.openstack.org/stream/6e42137688154d8fa6759ec5dcf03651?logfile=console.log04:38
ianwThe task includes an option with an undefined variable. The error was: 'target_dir' is undefined04:39
ianwhttps://a7722bebdf1066e6385d-82d79a041e998664bd1d0bc4b6e78332.ssl.cf5.rackcdn.com/678352/1/promote/promote-tox-docs-static/6e42137/job-output.txt04:39
ianw(gotta run out for a bit, back in 20 mins)04:40
AJaegerthanks04:40
*** whoami-rajat has quit IRC04:42
AJaegerI don't understand that - let me revert...04:43
*** jtomasek has joined #openstack-infra04:43
openstackgerritAndreas Jaeger proposed openstack/project-config master: Don't use static promote jobs yet  https://review.opendev.org/67872204:48
AJaegerianw: that's my quick fix ^04:48
AJaegerand then I need help to figure out why target_dir - which is set earlier in "Set target directory if master" is not passed on to the remote host.04:49
AJaegerbut that's for another time...04:49
*** ociuhandu has joined #openstack-infra04:53
openstackgerritAndreas Jaeger proposed openstack/project-config master: Don't use static promote jobs yet  https://review.opendev.org/67872204:54
*** ociuhandu has quit IRC04:57
*** markvoelker has joined #openstack-infra05:10
*** eernst has joined #openstack-infra05:10
*** slaweq has joined #openstack-infra05:11
*** markvoelker has quit IRC05:15
*** slaweq has quit IRC05:16
AJaegerconfig-core, can we merge that quickly? Sorry for the breakage ;(05:41
*** factor has quit IRC05:41
ianwAJaeger: yeah, i'm just looking ... should we try and fix it?05:41
ianwgive me a sec for a proposal05:41
AJaegerif you have an idea for fix - cool ;)05:44
openstackgerritAndreas Jaeger proposed openstack/project-config master: Fix pipelines for promote jobs  https://review.opendev.org/67872605:45
AJaegerif we fix it, we need this one as well ^05:45
openstackgerritIan Wienand proposed openstack/project-config master: static-docs: use target from fileserver  https://review.opendev.org/67872705:47
ianwAJaeger: ^ the other thing you could probably do is use {{ hostvars['localhost']['target_dir'] }} below ... but i don't think that's necessary05:48
*** eernst has quit IRC05:50
AJaegerianw: I see - thanks!05:50
AJaegerlet's merge and re-enqueue ;)05:50
*** ccamacho has quit IRC05:52
ianwworth a shot :)05:54
*** hamzy has quit IRC05:59
*** lpetrut has joined #openstack-infra06:02
*** e0ne has joined #openstack-infra06:06
openstackgerritIan Wienand proposed opendev/system-config master: Filter docker directories out of cacti  https://review.opendev.org/67873006:07
openstackgerritMerged openstack/project-config master: static-docs: use target from fileserver  https://review.opendev.org/67872706:10
AJaegerianw: merged - want to enqueue again, please?06:10
AJaegeryou're fast ;)06:10
*** e0ne has quit IRC06:11
*** slaweq has joined #openstack-infra06:11
ianwwell it was all in history :)06:11
* AJaeger watches console log06:12
AJaegerit uploaded!06:12
ianwto the right place?06:12
AJaegerhttps://governance.openstack.org/election/ is not updated ;(06:15
*** slaweq has quit IRC06:15
AJaegerso, did it use wrong place?06:15
AJaegerhttps://zuul.opendev.org/t/openstack/build/7cfabe4924394acd98eaf18485e85a55/console#1/1/0/static.openstack.org06:16
AJaegeris that path correct?06:16
AJaegeror missing an "/" ?06:16
ianwhrm, it looks right ... where did it go if not there!?06:18
*** prometheanfire has quit IRC06:18
openstackgerritAndreas Jaeger proposed openstack/project-config master: Add missing / to static-docs promote  https://review.opendev.org/67873106:19
AJaegerone level up?06:19
AJaegerianw: 678731 is the fix06:19
ianwhrm, weird, i can't see it a directory up06:20
AJaegerstrange, so where did it copy it to???06:21
AJaegerIs /srv/static/election correct?06:21
*** prometheanfire has joined #openstack-infra06:22
AJaegerianw: All is fine!06:23
AJaegerIt promoted a job that was run a few hours earlier!06:23
*** zzehring has quit IRC06:24
AJaeger"2019-08-27T00:22:05"06:24
AJaegermy browser shows "27 August 2019, 02.20.31 CEST" which is UTC+2 hours, so all fine06:24
AJaeger\o/06:24
AJaegerianw: ^06:25
* AJaeger still wonders about the "/" compared to playbooks/publish/static-tox-docs.yaml06:26
ianwyeah ... how many hours have been lost to rsync "/" semantics i'd hate to think :)06:27
AJaegeroh, yeah.06:27
AJaegerso, I think we're all fine - have a nice evening, ianw and thanks a LOT for helping to fix this!06:28
ianwi *think* that / on the dest doesn't make a difference ... / on the source does though06:29
AJaegerI would need to look it up ;(06:30
*** whoami-rajat has joined #openstack-infra06:30
AJaegeryes, according to man page, it's on source only06:31
ianwok, good, sounds like all mysteries are solved :)06:32
AJaegeryep!06:39
openstackgerritAndreas Jaeger proposed opendev/system-config master: Docs: Zuul v2 is dead  https://review.opendev.org/67873306:40
AJaegerI stumbled upon an outdated docs page, hope this change for our docs is fine ^06:40
* AJaeger is now going offline for a bit...06:40
openstackgerritMerged openstack/project-config master: Fix pipelines for promote jobs  https://review.opendev.org/67872606:43
*** trident has quit IRC07:00
openstackgerritIan Wienand proposed opendev/base-jobs master: log-processor: include full exception traceback  https://review.opendev.org/67873507:01
*** markvoelker has joined #openstack-infra07:06
*** georgk has quit IRC07:07
*** fdegir has quit IRC07:07
*** georgk has joined #openstack-infra07:08
*** fdegir has joined #openstack-infra07:08
*** trident has joined #openstack-infra07:10
*** slaweq has joined #openstack-infra07:11
*** pkopec has joined #openstack-infra07:11
*** markvoelker has quit IRC07:15
*** slaweq has quit IRC07:15
*** xek has joined #openstack-infra07:30
*** threestrands has quit IRC07:32
*** markvoelker has joined #openstack-infra07:35
*** dtantsur|afk is now known as dtantsur07:37
*** rcernin has quit IRC07:40
*** jpena|off is now known as jpena07:40
*** markvoelker has quit IRC07:40
openstackgerritMonty Taylor proposed zuul/zuul master: Make json outfile seeking clearer  https://review.opendev.org/67874007:43
*** pkopec has quit IRC07:50
*** slaweq has joined #openstack-infra07:52
*** ralonsoh has joined #openstack-infra07:52
*** lucasagomes has joined #openstack-infra07:53
*** mgoddard has joined #openstack-infra07:54
*** pkopec has joined #openstack-infra07:56
*** gfidente has joined #openstack-infra08:00
*** panda has quit IRC08:02
*** panda has joined #openstack-infra08:02
*** tkajinam has quit IRC08:07
*** dchen has quit IRC08:09
*** xenos76 has joined #openstack-infra08:13
*** piotrowskim has joined #openstack-infra08:22
*** apetrich has joined #openstack-infra08:22
*** markvoelker has joined #openstack-infra08:40
*** gregoryo has quit IRC08:40
*** markvoelker has quit IRC08:45
openstackgerritIan Wienand proposed opendev/base-jobs master: log-processor: include full exception traceback  https://review.opendev.org/67873508:45
*** ccamacho has joined #openstack-infra08:47
*** priteau has joined #openstack-infra08:50
*** derekh has joined #openstack-infra08:50
*** slaweq has quit IRC08:53
*** eernst has joined #openstack-infra08:56
*** Lucas_Gray has joined #openstack-infra09:01
*** eernst has quit IRC09:02
*** Lucas_Gray has quit IRC09:08
*** slaweq has joined #openstack-infra09:10
*** auristor has quit IRC09:11
*** zbr has joined #openstack-infra09:12
*** Lucas_Gray has joined #openstack-infra09:13
*** slaweq has quit IRC09:14
*** slaweq has joined #openstack-infra09:20
*** exsdev has quit IRC09:22
*** slaweq has quit IRC09:25
openstackgerritMerged openstack/ptgbot master: Generate etherpad links automatically  https://review.opendev.org/67462209:25
*** dtantsur is now known as dtantsur|bbl09:31
openstackgerritStephen Finucane proposed openstack/pbr master: Mark strings as raw  https://review.opendev.org/67876909:35
openstackgerritStephen Finucane proposed openstack/pbr master: Update to latest hacking  https://review.opendev.org/67877009:35
openstackgerritStephen Finucane proposed openstack/pbr master: trivial: Use 'open' context manager  https://review.opendev.org/67877109:35
*** psachin has quit IRC09:37
*** psachin has joined #openstack-infra09:41
*** sshnaidm is now known as sshnaidm|afk09:41
*** jaosorior has quit IRC09:43
*** psachin has quit IRC09:48
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul Web: add /api/user/authorizations endpoint  https://review.opendev.org/64109909:48
*** lucasagomes has quit IRC09:53
*** apetrich has quit IRC09:55
*** lucasagomes has joined #openstack-infra09:58
*** auristor has joined #openstack-infra09:58
*** apetrich has joined #openstack-infra10:00
openstackgerritMonty Taylor proposed zuul/zuul master: Write errors from ansible execution into json log  https://review.opendev.org/67672310:02
*** Lucas_Gray has quit IRC10:04
*** dpawlik has quit IRC10:04
*** cgoncalves has quit IRC10:04
*** cgoncalves has joined #openstack-infra10:04
*** Lucas_Gray has joined #openstack-infra10:06
openstackgerritFabien Boucher proposed zuul/zuul master: A Zuul reporter for Elasticsearch  https://review.opendev.org/64492710:09
*** e0ne has joined #openstack-infra10:11
*** ginopc has quit IRC10:25
*** e0ne has quit IRC10:26
*** ginopc has joined #openstack-infra10:27
*** e0ne has joined #openstack-infra10:28
*** e0ne has quit IRC10:32
*** slaweq has joined #openstack-infra10:55
*** ginopc has quit IRC11:01
*** nicolasbock has joined #openstack-infra11:02
*** udesale has quit IRC11:02
*** tesseract has joined #openstack-infra11:11
*** hamzy has joined #openstack-infra11:18
*** dpawlik has joined #openstack-infra11:18
*** jaosorior has joined #openstack-infra11:20
*** jpena is now known as jpena|lunch11:30
*** slaweq has quit IRC11:31
*** slaweq has joined #openstack-infra11:33
*** dave-mccowan has joined #openstack-infra11:34
*** bdodd has joined #openstack-infra11:35
*** bdodd_ has quit IRC11:35
*** slaweq has quit IRC11:41
openstackgerritMerged zuul/zuul master: Apply changes to command module from ansible 2.6  https://review.opendev.org/67859411:42
*** AJaeger is now known as AJaeger_11:50
openstackgerritBenedikt Löffler proposed zuul/zuul master: Report retried builds in a build set via mqtt.  https://review.opendev.org/63272711:51
openstackgerritBenedikt Löffler proposed zuul/zuul master: Report retried builds via sql reporter.  https://review.opendev.org/63350111:51
*** slaweq has joined #openstack-infra11:52
*** odicha has quit IRC11:56
*** slaweq has quit IRC11:57
*** sshnaidm|afk is now known as sshnaidm11:59
*** rh-jelabarre has joined #openstack-infra12:05
*** aedc has joined #openstack-infra12:07
*** dtantsur|bbl is now known as dtantsur12:08
*** markvoelker has joined #openstack-infra12:10
*** slaweq has joined #openstack-infra12:12
*** rcosnita has joined #openstack-infra12:13
*** ginopc has joined #openstack-infra12:14
*** rcosnita is now known as radu-cosnita12:15
*** radu-cosnita has quit IRC12:15
*** rcosnita has joined #openstack-infra12:16
*** slaweq has quit IRC12:17
*** rfolco has joined #openstack-infra12:22
*** rcosnita has quit IRC12:25
*** rcosnita_ has joined #openstack-infra12:25
*** rlandy has joined #openstack-infra12:28
*** rlandy is now known as rlandy|ruck12:29
*** jpena|lunch is now known as jpena12:32
*** larainema has quit IRC12:35
*** jaosorior has quit IRC12:39
*** jaosorior has joined #openstack-infra12:39
*** slaweq has joined #openstack-infra12:40
openstackgerritMatthieu Huin proposed zuul/zuul master: Zuul Web: add /api/user/authorizations endpoint  https://review.opendev.org/64109912:43
*** priteau has quit IRC12:44
openstackgerritFabien Boucher proposed zuul/zuul master: Add reference pipelines file for Gerrit driver  https://review.opendev.org/67268312:48
openstackgerritFabien Boucher proposed zuul/zuul master: Add reference pipelines file for Github driver  https://review.opendev.org/67271212:57
*** aaronsheffield has joined #openstack-infra12:58
*** jcoufal has joined #openstack-infra13:00
*** slaweq has quit IRC13:04
*** Goneri has joined #openstack-infra13:05
*** yolanda has quit IRC13:06
*** yolanda__ has joined #openstack-infra13:06
*** rcosnita_ has quit IRC13:09
*** jaosorior has quit IRC13:09
*** sthussey has joined #openstack-infra13:10
*** mriedem has joined #openstack-infra13:22
*** eharney has joined #openstack-infra13:23
*** Lucas_Gray has quit IRC13:24
*** whoami-rajat has quit IRC13:25
*** bhavikdbavishi has quit IRC13:29
*** bhavikdbavishi has joined #openstack-infra13:29
*** udesale has joined #openstack-infra13:32
*** jaosorior has joined #openstack-infra13:33
*** dklyle has quit IRC13:38
*** david-lyle has joined #openstack-infra13:38
*** rcosnita has joined #openstack-infra13:38
openstackgerritMohammed Naser proposed openstack/project-config master: zuul: add openstack/magnum to opendev  https://review.opendev.org/67884013:39
mnaserfungi: ^ you mentioned this the other day, let me know if thats what you meant13:39
*** priteau has joined #openstack-infra13:44
dtantsurhi folks! can I run a publish-openstack-artifacts job in the check/gate queues to make sure it works?13:45
dtantsurwe keep breaking our post jobs, I'm trying to find something to protect from it13:45
dtantsurto be clear: I don't need it to actually publish anything, just check whatever comes before13:45
*** e0ne has joined #openstack-infra13:54
*** ginopc has quit IRC13:54
*** michael-beaver has joined #openstack-infra13:55
openstackgerritTristan Cacqueray proposed zuul/zuul master: webtrigger: add web route and rpclistener  https://review.opendev.org/55483913:56
*** zzehring has joined #openstack-infra13:56
*** jcoufal_ has joined #openstack-infra14:02
*** jeliu_ has joined #openstack-infra14:02
*** jeliu_ has quit IRC14:02
*** jeliu_ has joined #openstack-infra14:03
*** liuyulong has joined #openstack-infra14:05
*** jcoufal has quit IRC14:05
*** roman_g has quit IRC14:08
*** roman_g has joined #openstack-infra14:08
*** rcosnita has quit IRC14:11
openstackgerritMerged zuul/zuul master: Write json log file by seeking and appending  https://review.opendev.org/67671714:12
openstackgerritBenedikt Löffler proposed zuul/zuul master: Report retried builds in a build set via mqtt.  https://review.opendev.org/63272714:16
openstackgerritBenedikt Löffler proposed zuul/zuul master: Report retried builds via sql reporter.  https://review.opendev.org/63350114:16
*** rcosnita has joined #openstack-infra14:25
corvusdtantsur: it may be worth looking into whether you can move those to gate/promote jobs14:26
corvusdtantsur: then the likely-to-break stuff would be in gate, and promote would be a simple copy unlikely to break14:26
dtantsurthat sounds good. is there any reference on how to do it?14:27
corvusdtantsur: AJaeger_ recently moved the docs builds to use that pattern; the artifact builds in zuul/zuul are set up that way14:27
dtantsurnice! TheJulia ^^^14:27
TheJuliahmmm14:28
* TheJulia ponders14:28
corvusdtantsur, TheJulia: i don't have full docs yet, but take a look at this job and the jobs around it: https://opendev.org/opendev/base-jobs/src/branch/master/zuul.d/jobs.yaml#L42114:29
*** sshnaidm_ has joined #openstack-infra14:29
dtantsurthanks!14:29
dtantsurTheJulia: it will help us avoiding the troubles with breaking POST jobs14:29
corvusalso speeds things up and makes it more efficient (almost as soon as a change lands, the artifact is published)14:30
*** sshnaidm has quit IRC14:30
AJaeger_dtantsur: So, you would run build-python-release in check/gate and then opendev-promote-python in promote (instead of post) and opendev-promote-python just copies the files from the gate to the server (so, no rebuilds)14:30
dtantsuryep, although I need to figure out how to write the jobs this way14:31
*** udesale has quit IRC14:32
AJaeger_TheJulia, dtantsur, could you retire Networking-generic-switch-tempest correctly, please? It's still in Zuul...14:32
dtantsurAJaeger_: ugh, yeah. I'll put on my TODO list.14:32
AJaeger_TheJulia, dtantsur , all explained at https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project - you did step 5 and missed steps 1-414:33
AJaeger_dtantsur: thanks!14:33
*** sshnaidm__ has joined #openstack-infra14:34
*** spsurya has joined #openstack-infra14:35
*** dpawlik has quit IRC14:35
openstackgerritMonty Taylor proposed zuul/zuul master: Write errors from ansible execution into json log  https://review.opendev.org/67672314:35
*** sshnaidm_ has quit IRC14:36
openstackgerritDmitry Tantsur proposed openstack/project-config master: Stop gating for networking-generic-switch-tempest-plugin  https://review.opendev.org/67886814:38
dtantsurAJaeger_: step two ^^14:38
*** signed8bit has joined #openstack-infra14:38
*** priteau has quit IRC14:39
AJaeger_\o/14:40
*** aedc has quit IRC14:40
*** lpetrut has quit IRC14:44
*** whoami-rajat has joined #openstack-infra14:48
openstackgerritDmitry Ukov proposed openstack/project-config master: New project request: airship/images  https://review.opendev.org/67794414:49
dtantsuris it possible to customize this https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/add-fileserver/tasks/main.yaml#L22 ?14:50
dtantsurspecifically, use another project name?14:50
*** sshnaidm__ is now known as sshnaidm14:51
openstackgerritMonty Taylor proposed opendev/system-config master: Run a gerrit container (test only)  https://review.opendev.org/63040615:00
openstackgerritMonty Taylor proposed opendev/system-config master: Expose a volume for the gerrit hooks directory  https://review.opendev.org/67887515:00
openstackgerritMonty Taylor proposed opendev/system-config master: Expand the volumes list  https://review.opendev.org/67887615:00
*** david-lyle has quit IRC15:01
*** david-lyle has joined #openstack-infra15:01
TheJuliadtantsur: are you going to nuke the repo contents and put a readme in place for that repo?  I guess someone might still somehow be referencing it somewhere...15:02
roman_gHello everyone. Could we ask #airshipit ChanOp to set topic on our channel? =)15:04
roman_gdue to glitches of openstackbot we lost normal topic past week15:04
dtantsurTheJulia: for n-g-s-tempest? yes, although it's barely usable in its current form.15:04
clarkbroman_g: mattmceuen is an op15:04
clarkbI'm in meetings for the next while but can do it after if it isn't already done15:05
*** jamesmcarthur has joined #openstack-infra15:05
AJaeger_dtantsur: everything is possible to customize, best define what exactly you need and somebody might be able to help or propose an alternative15:12
dtantsurAJaeger_: we're currently publishing ready-to-use ironic-python-agent images to tarballs.o.o/ironic-python-agent. now we're splitting the build scripts into a new repository, ironic-python-agent-builder. The thing is, the same jobs running on it publish to tarballs.o.o/ironic-python-agent-builder, i.e. to a new location.15:13
dtantsurwe'd like both post/publish jobs to publish to tarballs.o.o/ironic-python-agent15:13
TheJuliaSince either thing being changed should update the same artifact that other jobs pickup instead of trying to build from scratch for every single run15:15
*** mattw4 has joined #openstack-infra15:17
AJaeger_dtantsur: so, you want to chnage the project-name on that one. Not sure about the best option, hope others can help.15:19
AJaeger_config-core, FYI, I'll be out most of the next 10 days with limited access. I might pop in and out, but don't depend on it ;)15:20
*** mattw4 has quit IRC15:22
*** ccamacho has quit IRC15:23
fungiroman_g: mattmceuen should also be able to add additional channel access15:25
fungiroman_g: something like `msg chanserv access #airshipit add roman_g +Aeortv`15:25
fungier, that's /msg not just msg15:26
roman_gclarkb: fungi thank you! All worked.15:27
fungiawesome. the goal is to make it fairly self-service for projects15:28
*** dpawlik has joined #openstack-infra15:29
*** chkumar|rover is now known as raukadah15:31
openstackgerritMerged zuul/zuul master: Improve visualization retry attempts in UI  https://review.opendev.org/67814715:32
*** dpawlik has quit IRC15:33
AJaeger_fungi: thanks for merging the election promote job, ianw and myself fixed it earlier today, so all should be good now. Want to merge ossa at some time, please? https://review.opendev.org/678354 (no urgency)15:34
fungiAJaeger_: yeah, i saw the revert when you pushed it up, but since you and ianw were brainstorming actual fixes i left it alone15:37
fungiwill take a look at the ossa job today now that it's working for election15:37
*** gyee has joined #openstack-infra15:37
fungionce i get off this conference call15:37
AJaeger_thanks15:41
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add tests for manifest generation for missing files  https://review.opendev.org/67857315:52
*** e0ne has quit IRC15:52
*** sshnaidm is now known as sshnaidm|afk15:54
openstackgerritStephen Finucane proposed openstack/pbr master: Mark strings as raw  https://review.opendev.org/67876915:57
openstackgerritStephen Finucane proposed openstack/pbr master: Update to latest hacking  https://review.opendev.org/67877015:57
openstackgerritStephen Finucane proposed openstack/pbr master: trivial: Use 'open' context manager  https://review.opendev.org/67877115:57
*** jpena is now known as jpena|off16:04
*** xenos76 has quit IRC16:07
*** lucasagomes has quit IRC16:07
openstackgerritClark Boylan proposed zuul/zuul master: Check refs and revs for repo needing updates  https://review.opendev.org/67889516:09
*** xenos76 has joined #openstack-infra16:20
*** rcosnita has quit IRC16:20
*** rcosnita has joined #openstack-infra16:21
*** jamesmcarthur has quit IRC16:22
*** david-lyle is now known as dklyle16:23
*** jamesmcarthur has joined #openstack-infra16:27
*** slaweq has joined #openstack-infra16:33
*** liuyulong has quit IRC16:33
*** rcosnita has quit IRC16:35
openstackgerritClark Boylan proposed zuul/zuul master: Check refs and revs for repo needing updates  https://review.opendev.org/67889516:40
*** dtantsur is now known as dtantsur|afk16:42
*** amotoki is now known as amotoki_16:42
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add tests for manifest generation for missing files  https://review.opendev.org/67857316:44
openstackgerritJeff Liu proposed zuul/zuul-operator master: Add PerconaXDB Cluster to Zuul-Operator  https://review.opendev.org/67731516:44
*** jamesmcarthur has quit IRC16:47
*** psachin has joined #openstack-infra16:53
*** armax has quit IRC16:56
openstackgerritClark Boylan proposed zuul/zuul master: Check refs and revs for repo needing updates  https://review.opendev.org/67889516:57
*** e0ne has joined #openstack-infra17:01
*** diablo_rojo has joined #openstack-infra17:02
*** gfidente has quit IRC17:02
*** derekh has quit IRC17:02
*** jaosorior has quit IRC17:16
clarkbfungi: https://review.opendev.org/#/c/678326/1 is the last outstanding cleanup for the logstash handling of swift hosted logs. Any objection to me approving that with your +2?17:23
clarkbit is a fairly small change and I expect no problems from it17:23
clarkb(trying to clear out my backlog)17:23
fungigo for it. seems low/no-impact17:26
*** slaweq has quit IRC17:27
*** jamesmcarthur has joined #openstack-infra17:27
*** slaweq has joined #openstack-infra17:28
*** psachin has quit IRC17:29
*** dpawlik has joined #openstack-infra17:29
*** tesseract has quit IRC17:30
*** psachin has joined #openstack-infra17:33
*** slaweq has quit IRC17:33
*** dpawlik has quit IRC17:34
*** rh-jelabarre has quit IRC17:36
*** rh-jelabarre has joined #openstack-infra17:38
*** ralonsoh has quit IRC17:38
*** psachin has quit IRC17:45
*** e0ne has quit IRC17:49
*** jamesmcarthur has quit IRC17:52
*** bhavikdbavishi has quit IRC17:52
*** eharney has quit IRC17:54
*** bhavikdbavishi has joined #openstack-infra17:54
*** jcoufal_ has quit IRC17:55
*** jcoufal has joined #openstack-infra17:59
*** jaosorior has joined #openstack-infra18:00
openstackgerritMerged opendev/puppet-log_processor master: Handle case where content encoding isn't set  https://review.opendev.org/67832618:01
*** diablo_rojo has quit IRC18:03
*** dpawlik has joined #openstack-infra18:08
openstackgerritBrian Rosmaita proposed openstack/project-config master: Identify Cinder as the Block Storage Service  https://review.opendev.org/67893118:10
*** dpawlik has quit IRC18:13
*** bhavikdbavishi has quit IRC18:13
openstackgerritTristan Cacqueray proposed zuul/zuul master: webtrigger: add web route and rpclistener  https://review.opendev.org/55483918:28
*** jcoufal_ has joined #openstack-infra18:29
*** pkopec has quit IRC18:32
*** jcoufal has quit IRC18:32
fricklerAJaeger_: you didn't touch build-openstack-specs-site job yet in the recent refactoring, did you? see https://review.opendev.org/67893118:34
*** rkukura has quit IRC18:43
*** ramishra has quit IRC18:43
*** armax has joined #openstack-infra18:51
*** e0ne has joined #openstack-infra18:51
*** bobh has joined #openstack-infra18:52
clarkbWe'll have a team meeting shortly18:56
clarkbover in #openstack-meeting in ~4 minutes18:56
* fungi starts the log walk to the other channel18:57
fungier, long walk18:57
*** bobh has quit IRC18:57
clarkbdon't let the log roll on you18:57
*** eharney has joined #openstack-infra19:00
* fungi starts humming the "log" theme19:00
openstackgerritTobias Henkel proposed zuul/zuul master: Revert "Revert "Create zuul/web/static on demand""  https://review.opendev.org/66310819:02
*** jamesmcarthur has joined #openstack-infra19:03
*** michael-beaver has quit IRC19:04
*** markvoelker has quit IRC19:07
*** markvoelker has joined #openstack-infra19:08
*** e0ne has quit IRC19:19
AJaeger_frickler: correct, I didn't - want to do it?19:22
openstackgerritMohammed Naser proposed openstack/project-config master: zuul: add openstack/magnum to opendev  https://review.opendev.org/67884019:30
*** rkukura has joined #openstack-infra19:37
onovycan someone look to https://review.opendev.org/#/c/678368/ and https://review.opendev.org/#/c/678385/ pls? only one +2 missing :) thanks a lot19:45
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: fix connections list github base_url  https://review.opendev.org/67895019:47
fungiclarkb: to follow up on the renames topic, it seems to be summarized by ttx's comment in the releases repo change: "Also if possible I'd rather wait until the repository is renamed, rather than have a x/foo oddity in the openstack release management team files."20:00
clarkbfungi: do you know if getting it renamed prior to RC1 happens is early enough for that to be effective?20:01
clarkbRC1 happens the week after20:01
fungii suspect before rc1 would suffice20:01
clarkbgreat the 16th is sounding like a good option then20:02
clarkbmordred: enjoy vacation20:02
fungiso it's a question of whether the release and kayobe teams would like to start releasing stuff sooner, or whether temporarily having an "x" directory in the train deliverables tree is untenable20:02
mordredclarkb: thanks!20:03
mordredclarkb: this is "road trip up the norwegian coast" vacation - so it should be nice20:04
openstackgerritTobias Henkel proposed zuul/zuul master: Update heuristing of parallel starting builds.  https://review.opendev.org/67170220:07
*** prometheanfire has quit IRC20:08
*** prometheanfire has joined #openstack-infra20:09
*** dpawlik has joined #openstack-infra20:09
*** weshay is now known as weshay_pto20:11
*** dpawlik has quit IRC20:13
*** jcoufal has joined #openstack-infra20:17
*** ijw has joined #openstack-infra20:19
*** jcoufal_ has quit IRC20:20
clarkbonovy: I approved the first one and then you can get the depends on for the second in20:34
*** xek has quit IRC20:34
openstackgerritTobias Henkel proposed zuul/zuul master: web: test trailing slash are removed from renderTree  https://review.opendev.org/67682420:34
openstackgerritMerged openstack/project-config master: Retire swauth - stop gating  https://review.opendev.org/67836820:43
*** jcoufal has quit IRC20:46
*** jamesmcarthur has quit IRC20:46
*** lpetrut has joined #openstack-infra20:50
*** lpetrut has quit IRC20:51
*** lpetrut has joined #openstack-infra20:51
*** ijw has quit IRC20:57
*** lpetrut has quit IRC20:58
*** ijw has joined #openstack-infra20:59
*** ijw has quit IRC21:03
*** spsurya has quit IRC21:07
*** Goneri has quit IRC21:13
openstackgerritMerged zuul/zuul master: web: extract pure functions from the TaskOutput component  https://review.opendev.org/67546021:18
*** whoami-rajat has quit IRC21:18
*** markvoelker has quit IRC21:19
openstackgerritJeff Liu proposed zuul/zuul-operator master: Add PerconaXDB Cluster to Zuul-Operator  https://review.opendev.org/67731521:20
*** jtomasek has quit IRC21:29
openstackgerritMerged zuul/nodepool master: Functional testing: add journal-to-console element  https://review.opendev.org/66978721:32
openstackgerritMerged zuul/zuul master: github: properly exist when failing to get a pull request  https://review.opendev.org/67694821:33
*** ijw has joined #openstack-infra21:34
*** ijw has quit IRC21:37
*** ijw has joined #openstack-infra21:37
openstackgerritMerged zuul/zuul master: Hide "root" variable in job web page  https://review.opendev.org/67546121:47
*** mriedem has quit IRC21:48
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: add build button to trigger job  https://review.opendev.org/63571621:54
*** trident has quit IRC22:05
openstackgerritJeff Liu proposed zuul/zuul-operator master: Add PerconaXDB Cluster to Zuul-Operator  https://review.opendev.org/67731522:08
*** dpawlik has joined #openstack-infra22:10
*** trident has joined #openstack-infra22:13
*** dpawlik has quit IRC22:15
*** rcernin has joined #openstack-infra22:15
*** markvoelker has joined #openstack-infra22:15
*** markvoelker has quit IRC22:20
*** jeliu_ has quit IRC22:25
openstackgerritMerged opendev/system-config master: fedora-mirror-update: update logging  https://review.opendev.org/67871722:31
clarkbianw: ^ heres hoping that gives us better info22:45
*** armax has quit IRC22:51
ianwclarkb: thanks, it's mostly the timestamps so we can better correlate22:58
*** aaronsheffield has quit IRC23:03
*** tkajinam has joined #openstack-infra23:06
*** markvoelker has joined #openstack-infra23:15
ianwinfra-root: a quick one from something i noticed yesterday -> https://review.opendev.org/#/c/678730/ ... stops cacti making more and more empty graphs23:16
ianwin a related note, do we know if the login to cacti is setup?  i think the only way to clear things is to manually log in to the admin page?23:17
clarkbianw: I want to say it is in the passwords file?23:18
clarkbI seem to recall people having done similar in the past23:18
clarkb(I've never done it though)23:18
ianwyeah, ok, found it in there23:20
*** markvoelker has quit IRC23:20
ianwok if i remove all the vanilla/chocolate cloud bits?23:20
clarkb++23:21
ianwi guess we can remove git0*.openstack.org stuff too?23:24
clarkbyea23:24
fungisgtm, thx23:25
ianwi guess git.openstack.org is just a double of files.o.o23:26
clarkbit was an haproxy load balancer but we updated dns to point at files23:28
clarkbso the snmp requests would go there now I guess23:28
clarkbshould be safe to remove git.o.o23:28
ianwi might as well go through the failing to connect messages while i'm here ...23:28
*** prometheanfire has quit IRC23:33
*** prometheanfire has joined #openstack-infra23:33
ianwhrmm, here's the list http://paste.openstack.org/show/766135/23:34
ianwremoving pbx.openstack.org as that's pbx01.opendev.org23:36
clarkbthe ze hosts and zk hosts should be fine23:37
clarkbso the full list is maybe not safe to remove23:37
*** auristor has quit IRC23:38
ianwno, yeah that's just showing things that have been down at some point ...23:38
ianwbut the higher the number, the more it's been down23:39
clarkbah23:39
ianwok, removed aliased zuul.openstack.org (now zuul01 and graphite.openstack.org (now graphite01.opendev.org)23:40
ianwadns1 is not one i'd expect to be showing as down, wonder if snmpd is not working23:41
clarkbwe switched them to .opendev.org so the .openstack.org servers went away23:42
clarkbwhich explains one of the two entries)23:42
ianw14333 adns1.opendev.org23:42
fungiis that somewhere we might need to update security groups for snmp traffic?23:43
ianwAug 27 23:40:10 adns1 snmpd[630]: Connection from UDP/IPv6: [2001:4800:7821:105:be76:4eff:fe04:b9a5]:3299223:43
fungii guess not!23:43
ianwi wonder if it's intermittent ipv6 issues though?23:43
fungipossibly23:44
*** auristor has joined #openstack-infra23:46
ianwfungi: could you look over https://review.opendev.org/#/c/678730/ to stop the graphs coming back for gitea before i go delete them manually23:46
ianwluckily under "graph management" searching for "/var/lib/docker" only matches these dud graphs so it's pretty easy to remove23:48
openstackgerritBruno Cornec proposed openstack/project-config master: Remove python 2.7 jobs for python-redfish  https://review.opendev.org/67896823:48
*** markvoelker has joined #openstack-infra23:55
*** sthussey has quit IRC23:55
*** rlandy|ruck has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!