Tuesday, 2020-04-14

*** openstack has joined #openstack-infra09:53
*** ChanServ sets mode: +o openstack09:53
*** dpawlik has quit IRC09:55
*** hrw has joined #openstack-infra09:55
hrwmorning09:55
*** ysandeep|lunch is now known as ysandeep09:55
hrwif I want to make centos-8-aarch64 image available in zuul then should I start from diskimagebuilder project or go further?09:56
*** dpawlik has joined #openstack-infra09:56
*** tetsuro has quit IRC09:59
priteauThank you frickler10:01
*** ricolin has quit IRC10:09
*** owalsh_afk is now known as owalsh10:20
*** rpittau is now known as rpittau|bbl10:23
*** ysandeep is now known as ysandeep|afk10:37
*** ysandeep|afk is now known as ysandeep|rover10:53
openstackgerritSorin Sbarnea proposed zuul/zuul-jobs master: WIP: tox: allow tox to be upgraded  https://review.opendev.org/69005710:54
*** jcapitao is now known as jcapitao_lunch10:57
*** apetrich has quit IRC11:09
*** apetrich has joined #openstack-infra11:11
*** priteau has quit IRC11:14
*** drifterza has quit IRC11:14
*** cdearborn has joined #openstack-infra11:30
*** udesale_ has joined #openstack-infra11:34
*** apetrich has quit IRC11:34
*** jpena is now known as jpena|lunch11:36
*** udesale has quit IRC11:36
*** ysandeep|rover is now known as ysandeep|coffee11:39
*** ociuhandu has quit IRC11:41
*** apetrich has joined #openstack-infra11:41
*** gshippey has joined #openstack-infra11:48
*** rh-jelabarre has joined #openstack-infra11:51
*** ysandeep|coffee is now known as ysandeep11:51
*** ysandeep is now known as ysandeep|rover11:56
*** nightmare_unreal has joined #openstack-infra11:58
*** hashar has joined #openstack-infra12:02
*** tkajinam has quit IRC12:12
*** rlandy has joined #openstack-infra12:14
*** jcapitao_lunch is now known as jcapitao12:17
*** ociuhandu has joined #openstack-infra12:19
openstackgerritSorin Sbarnea proposed zuul/zuul-jobs master: tox: allow tox to be upgraded  https://review.opendev.org/69005712:28
*** rpittau|bbl is now known as rpittau12:31
*** ociuhandu has quit IRC12:34
*** ociuhandu has joined #openstack-infra12:35
*** jpena|lunch is now known as jpena12:40
*** lpetrut has quit IRC12:54
*** dklyle has joined #openstack-infra12:56
*** lpetrut has joined #openstack-infra13:01
*** Goneri has joined #openstack-infra13:10
*** mmethot has joined #openstack-infra13:25
*** artom has joined #openstack-infra13:25
*** tkajinam has joined #openstack-infra13:33
openstackgerritMerged openstack/project-config master: Add kernel to StarlingX  https://review.opendev.org/71877213:50
*** jdelaros1 has quit IRC13:50
*** dougwig has quit IRC13:50
*** hrybacki has quit IRC13:50
*** evgenyl has quit IRC13:50
*** vdrok has quit IRC13:50
*** ykarel is now known as ykarel|away13:50
*** jdelaros1 has joined #openstack-infra13:50
*** dougwig has joined #openstack-infra13:50
*** hrybacki has joined #openstack-infra13:50
openstackgerritStephen Finucane proposed openstack/pbr master: Add support for virtualenv 20.x  https://review.opendev.org/71996413:50
*** jamespage has quit IRC13:50
*** rpittau has quit IRC13:50
*** ab-a has quit IRC13:51
*** vdrok has joined #openstack-infra13:51
*** jamespage has joined #openstack-infra13:51
*** rpittau has joined #openstack-infra13:51
*** evgenyl has joined #openstack-infra13:51
openstackgerritStephen Finucane proposed openstack/pbr master: Fix periodic integration jobs  https://review.opendev.org/71832213:52
openstackgerritStephen Finucane proposed openstack/pbr master: Replace old requires-python with python-requires  https://review.opendev.org/71550913:52
openstackgerritStephen Finucane proposed openstack/pbr master: Map requires-python to python-requires  https://review.opendev.org/71548413:52
openstackgerritStephen Finucane proposed openstack/pbr master: Update python requires packaging metadata for package  https://review.opendev.org/71591713:53
*** jackedin has joined #openstack-infra13:53
*** jackedin has joined #openstack-infra13:53
*** derekh has quit IRC13:56
*** derekh has joined #openstack-infra13:56
*** derekh has quit IRC13:59
*** derekh has joined #openstack-infra14:00
*** zxiiro has joined #openstack-infra14:00
*** ociuhandu has quit IRC14:03
*** ociuhandu has joined #openstack-infra14:04
openstackgerritMonty Taylor proposed openstack/project-config master: Remove deps from remote-puppet-else  https://review.opendev.org/71997614:06
*** mihalis68_ has joined #openstack-infra14:14
*** tkajinam has quit IRC14:17
*** tkajinam has joined #openstack-infra14:18
*** udesale_ has quit IRC14:20
*** lpetrut has quit IRC14:24
*** sshnaidm has joined #openstack-infra14:29
*** sshnaidm has quit IRC14:30
*** ysandeep|rover is now known as ysandeep|away14:50
openstackgerritMerged openstack/project-config master: Remove deps from remote-puppet-else  https://review.opendev.org/71997615:02
*** ricolin has joined #openstack-infra15:03
*** ricolin_ has joined #openstack-infra15:03
*** ricolin_ has quit IRC15:03
*** dosaboy_ is now known as dosaboy15:04
*** ociuhandu has quit IRC15:19
*** ociuhandu has joined #openstack-infra15:21
*** JasonF is now known as JayF15:25
*** ociuhandu has quit IRC15:25
*** __ministry has quit IRC15:28
*** seco has quit IRC15:29
*** drifterza has joined #openstack-infra15:33
*** pkopec has quit IRC15:37
*** pgaxatte has quit IRC15:47
*** bdodd has quit IRC15:51
*** lmiccini has quit IRC15:55
*** bdodd has joined #openstack-infra15:55
*** ociuhandu has joined #openstack-infra15:56
*** gyee has joined #openstack-infra16:01
*** rpittau is now known as rpittau|afk16:02
*** drifterza has quit IRC16:07
*** rlandy is now known as rlandy|brb16:14
redrobotHello infra friends!  Have y'all seen errors like this at the gate:16:15
redrobot> UserWarning: conflicting basepython version (set 3.6, should be 3.7) for env 'py37'16:15
clarkbredrobot: I think that means your tox.ini is using python3.6 for the py37 env16:16
clarkbredrobot: can you link to the tox.ini in question?16:16
redrobotclarkb, https://opendev.org/openstack/barbican/src/branch/master/tox.ini#L7316:16
clarkbredrobot: https://opendev.org/openstack/barbican/src/branch/master/tox.ini#L7 I believe that is the issue. On Ubuntu Bionic, Centos8, and probably others `python3` gets you python3.6 and not python3.716:17
clarkbtox detects this and warns you that tox -epy37 will run under python3.6 and not python3.716:17
redrobotclarkb, interesting ... that'd explain why it only happens on some jobs16:18
redrobotclarkb, I'll try deleting that.16:18
redrobotthanks!16:18
clarkbredrobot: the downside to deleting that is it can allow your non python version specific targets to run under python216:18
clarkbredrobot: what you might want to do instead is stub out py3X targets and override basepython in them to be specific to that version of python16:18
clarkb(tox defaults to the python version it was installed under which is why relying on defaults might not get you what you want in all cases)16:19
*** tkajinam has quit IRC16:20
fungiclarkb: redrobot: that's what the ignore_basepython_conflict option is supposed to solve16:23
fungidoesn't look like it's being set in that tox.ini16:23
redrobotignore_basepython_conflict = true ?16:24
fungiyep16:24
fungihttps://tox.readthedocs.io/en/latest/config.html#conf-ignore_basepython_conflict16:24
fungiin the global [tox] section16:24
fungiyou'll see examples of that if you look at other projects' tox.ini files16:24
redrobotfungi, I see, yeah that seems like what I need to do in my tox file.  Thanks!16:25
fungiyw!16:25
fungishouldn't need any stub testenvs with more specific basepython on them. that was the short-lived workaround before ignore_basepython_conflict was added as an option16:26
clarkbfungi: ah thanks16:27
*** psachin has quit IRC16:34
*** ricolin has quit IRC16:35
*** rlandy|brb is now known as rlandy16:35
*** evrardjp has quit IRC16:37
*** evrardjp has joined #openstack-infra16:37
zbrwho knows more about the download-logs.sh file?16:41
clarkbzbr: ianw implemented it16:42
zbri have one from today which fails with 404, failing to get the build manifest. https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1b5/719542/3/check/tripleo-ci-centos-8-standalone/1b55bee/16:42
clarkbit relies on the zuul job file manifest and basically scripts out a download of its contents16:42
clarkbzbr: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_1b5/719542/3/check/tripleo-ci-centos-8-standalone/1b55bee/zuul-manifest.json that is the manifest file for that job16:42
clarkbzbr: maybe double check that is what it is trying to download16:42
zbr Querying https://zuul.opendev.org/api/tenant/openstack/build/1b55beed5c6e4e16995ae45a67c713d9 for manifest16:43
clarkbthat build is indeed a 40416:44
clarkbzbr: was that job part of an aborted buildset?16:45
clarkb Ithink the issue maybe that we never recorded that specific build in the database16:45
clarkbthis will be addressed when zuul starts to require the database then everything can be written to it aiui16:45
fungiwell, that will still require an overhaul of how it's implemented today, since we couldn't rely on a reporter if we want to record results outside of the reporting event16:46
clarkbfungi: ya but it removes needing to have the user explicitly opt in to using the db as is the current situation16:47
clarkbthe code still needs updating but it can assume the db is there and always record to it16:47
*** hashar has quit IRC16:49
zbrso I should only tell users that 404 is expected for aborted builds, until we find a fix?16:50
clarkbzbr: yes, 404 is expected until zuul is able to record every job run in the database. There are plans for this, but hasn't been done yet.16:51
clarkbalso users should feel free to reach out to us directly16:51
fungi404 for aborted builds or for builds whose buildset has not yet reported16:52
fungionly builds corresponding to a reported buildset will have the available data16:53
zbrclarkb: well... i can make a PR to improve the error message to give some hints.16:53
*** derekh has quit IRC16:54
*** jcapitao has quit IRC16:54
zbrclarkb: apparently this builset not even finished: http://zuul.openstack.org/status/change/719542,316:57
*** dtantsur is now known as dtantsur|afk16:57
zbri do see one job failure, but the one that failed to download did pass.16:58
zbrif the downloads script would work only when all jobs in a buildset passed it would not be of much practical use.16:58
zbrwoudn't be more reliable not to even query zuul api and get the manifest directly from the log-server?16:59
clarkbzbr: no that isn't what we are saying. It will only work once the buildset has reported16:59
clarkbit doesn't matter if the jobs pass or fail16:59
clarkbif a job is aborted it is not reported17:00
zbrwith jobs running for many hours, I am sure this would confuse people trying to download results from them.17:00
zbris not possible to avoid having to rely on zuul api?17:01
clarkbzbr: it is, but corvus specifically asked we not do that in order to make this tool agnostic to the upload system17:01
clarkbzbr: and the limitation is known and planned to be fixed17:01
zbrokey, reporting back. i will also try to pot a custom error in the script, to avoid further questions.17:02
*** jpena is now known as jpena|off17:05
openstackgerritSorin Sbarnea proposed zuul/zuul-jobs master: Improve 404 error message on download-logs.sh  https://review.opendev.org/72003517:13
fungizbr: also i think it was assumed that people would generally get notification of the results of a build when its buildset reports, so wouldn't know about builds which that script doesn't work on17:15
*** __ministry has joined #openstack-infra17:16
fungiif they're looking at comments from zuul in code review, or build results in the builds/buildsets tabs of the zuul dashboard, those have already reported17:16
zbrfungi: i think that not all people wait for n hours, some may look at live results from CI/CD :D17:18
fungiyep, in that case they may need to resort to alternative solutions17:18
zbri am sure that i am not the only one using https://opendev.org/x/coats/src/branch/master/coats/openstack_gerrit_zuul_status.user.js17:19
zbri was hoping to see gerrit upgraded so we could make use of CI API, but i guess that this work will take a lot more time.17:20
zbri think that a proper error message should be enough, for the moment.17:20
*** Goneri has quit IRC17:23
fungigerrit is now deployed from container images we're building as of three days ago, so it's time to start planning our upgrade schedule in earnest17:30
fungiby "CI API" i assume you're talking about gerrit's checks api, support for that is evolving in zuul as the feature itself evolves in gerrit. right now its data model doesn't support some of the things we would want to report into it17:30
fungibut also as far as i know the idea was still that zuul would update the checks api with results when the buildset reports (i'm not positive about that, but don't see how it would work currently otherwise)17:32
clarkbfungi: yes I think we were still going to be buildset oriented17:37
clarkbfungi: because yo udon't want early results to make a change mergable then the slow running test to make it unmergeable has results after the change has merged17:37
clarkbnormaly gerrit sorts that out by explicitly listing all the jobs that need to pass but we want zuul to be able to decide if a job should run or not17:38
clarkband that means basically having a buildset result as the checks api return I think17:38
fungiright, otherwise that buildset may be aborted after some builds report, leaving inconsistent results until the restarted builds all finish17:39
fungiso you could see a build reporting failure on your change and then later success because it was reenqueued in a gate reset or whatever17:40
*** ociuhandu has quit IRC17:40
fungiand if your change has a temporarily failing build due to a broken change ahead of it in the pipeline, showing that in the code review interface would be extra confusing17:41
*** ociuhandu has joined #openstack-infra17:41
*** ociuhandu has quit IRC17:46
*** Goneri has joined #openstack-infra17:52
*** gfidente is now known as gfidente|afk18:02
*** dpawlik has quit IRC18:02
mordredyes, that's correct18:07
mordred(the "still use checks api")18:07
*** nightmare_unreal has quit IRC18:08
*** abhishekk has joined #openstack-infra18:09
abhishekkhi team, earlier to move specs from one directory (approved) to another (implemented) we were using .htaccess files18:09
abhishekkhow this is handled now?18:10
abhishekkReference #link https://review.opendev.org/#/c/576996/18:10
fungiabhishekk: .htaccess files don't move anything as far as i know. are you talking about redirects?18:11
abhishekkfungi, yes18:11
abhishekkfungi, I have posted a reference patch18:12
fungiabhishekk: i can't think of anything recently which would have changed that. your question implies something isn't working the way you expect. can you maybe re-ask it?18:12
abhishekkfungi, how to use redirects, any idea?18:12
fungimy answer to the question you asked is "same way as before, i think"18:12
AJaegerabhishekk: what triggers you asking here?18:13
fungilike, is it *not* working?18:13
abhishekkAJaeger, I never done this before, and before going ahead I just wanted to be sure18:14
*** ociuhandu has joined #openstack-infra18:14
abhishekkfungi, I will try it, not sure whether it will work or not18:14
AJaegerabhishekk: it should work, go ahead ;) If not, let's talk again...18:15
abhishekkAJaeger, ack18:15
abhishekkfungi, AJaeger thank you18:15
*** __ministry has quit IRC18:16
*** tobiash has quit IRC18:16
fungihttps://specs.openstack.org/openstack/glance-specs/specs/rocky/approved/glance/Support-revert-pending-delete.html doesn't seem to redirect, for what it's worth18:17
*** tobiash has joined #openstack-infra18:17
AJaegerabhishekk, fungi, see https://docs.openstack.org/doc-contrib-guide/redirects.html#adding-a-htaccess-file-to-your-repo18:18
AJaegerwait, that's on specs.o.o?18:19
fungithen again, neither are earlier ones in that file working: https://specs.openstack.org/openstack/glance-specs/specs/queens/approved/glance/deprecate-registry.html18:19
AJaegerfungi: I linked to what to do for docs.o.o - I don't know whether we allow .htaccess on specs.o.o.18:19
AJaegerfungi: can you check apache config?18:19
fungilooking18:19
AJaegerabhishekk: that link is not relevant for specs.o.o18:19
abhishekkAJaeger, ack18:20
rosmaitasorry to be late to the discussion here18:22
fungiAJaeger: it's here https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/static/files/50-specs.openstack.org.conf18:22
fungiAllowOverrideList Redirect RedirectMatch18:23
fungiso it should allow the redirect rules in that .htaccess file18:23
fungihowever, those are not the correct paths, i don't think18:23
fungiunless absolute paths in .htaccess files are remapped to be relative to the directory containing the .htaccess file18:24
rosmaitait did used to work with those paths18:26
rosmaita"used to" == back around rocky18:26
fungi/afs/openstack.org/project/specs.openstack.org/openstack/glance-specs/.htaccess exists and has content18:29
AJaegerfungi: yeah, those need to be relative18:30
fungilooks like that .htaccess file was added in november 2017 by rosmaita18:35
rosmaitasounds about right18:36
fungiand the first entry added to it was Redirect 301 /specs/queens/approved/glance/deprecate-registry.html /specs/queens/implemented/glance/deprecate-registry.html18:36
fungiso used absolute paths even back then18:36
fungithat line was never updated, so must have been tested and worked18:36
rosmaitaand it did actually work18:36
AJaegerfungi: so, absolute might work - but no time to dig further into this now.18:42
AJaegerdocs.openstack.org/glance/latest/cache.html redirects correctly, rule is https://opendev.org/openstack/glance/src/branch/master/doc/source/_extra/.htaccess#L1218:43
fungiyeah, that's using redirectmatch rules18:45
fungii wonder if something happened with how plain redirect rules are being parsed18:45
fungi(sometime in the past 2.5 years)18:46
*** jackedin has quit IRC18:47
abhishekkwill try to dig out what went wrong18:48
fungias soon as my ill-timed kernel upgrade completes i can continue digging into what other projects have in afs for doing this on the specs.o.o site18:49
*** ralonsoh has quit IRC18:49
abhishekkfungi, thank you18:49
*** ociuhandu has quit IRC18:50
fungilooks like cinder is the only other project doing this18:50
rosmaita:)18:51
*** ociuhandu has joined #openstack-infra18:51
fungithey have 3 redirect rules for train specs which moved to ussuri18:51
rosmaitai don't think those have ever worked18:52
fungiRedirect 301 /specs/train/query-cinder-resources-filter-by-time-comparison-operators.rst /specs/ussuri/query-cinder-resources-filter-by-time-comparison-operators.rst18:52
fungihttps://specs.openstack.org/openstack/cinder-specs/specs/train/query-cinder-resources-filter-by-time-comparison-operators.html18:52
fungi40418:52
fungiyeah18:52
rosmaitai just reproduced the glance stuff18:53
fungiwhile the ussuri version of that url loads fine, 200 ok18:53
rosmaitayeah, that's where the actual doc is18:53
fungiright, just saying it's not redirecting to a 404, it's just returning a 40418:53
rosmaitagotcha18:54
*** ociuhandu has quit IRC18:55
AJaegerfungi: cinder-specs is the only other one18:56
fungiAJaeger: agreed, it's the only .htaccess file find returned within /afs/openstack.org/project/specs.openstack.org/18:57
fungibesides the one in glance-specs i mean18:57
*** gshippey has quit IRC19:03
clarkbfungi: we upgraded to bionic for the server19:11
clarkbthat may change behavior?19:11
*** Lucas_Gray has joined #openstack-infra19:11
*** ociuhandu has joined #openstack-infra19:16
*** Lucas_Gray has quit IRC19:21
*** Lucas_Gray has joined #openstack-infra19:22
fungiclarkb: that or the coincident move of all that content into afs19:23
fungia bunch of stuff changed around the same time19:23
fungibut honestly this could have broken any time in the past 2.5 years19:23
fungithere are only two specs projects even doing anything with .htaccess files and it's only the redirects for a few old specs links they're serving, so odds of anyone noticing and pointing it out are slim19:24
fungi(we only just discovered it's broken because i went and tested it after looking at the content of glance-specs's file and wondering how it was working at all)19:25
*** Lucas_Gray has quit IRC19:41
*** Lucas_Gray has joined #openstack-infra19:45
*** Goneri has quit IRC19:57
*** Goneri has joined #openstack-infra19:58
mnasercorvus: if you have a minute, we're looking for your input on https://review.opendev.org/#/c/719047/ :)20:08
openstackgerritMerged openstack/project-config master: Revert "wheel-build : temporary pip with checksum output"  https://review.opendev.org/71970720:09
*** mtreinish has joined #openstack-infra20:12
openstackgerritMerged openstack/project-config master: Update Grafana dashboards for stable Neutron releases  https://review.opendev.org/71867620:16
*** tobberydberg_ has quit IRC20:17
*** fdegir4 has quit IRC20:19
*** fdegir4 has joined #openstack-infra20:19
*** fdegir4 has quit IRC20:20
*** tobberydberg has joined #openstack-infra20:22
*** tobberydberg has quit IRC20:30
*** tobberydberg has joined #openstack-infra20:36
*** tobberydberg has quit IRC20:37
*** tobberydberg has joined #openstack-infra20:42
*** tobberydberg has quit IRC20:43
*** Lucas_Gray has quit IRC20:44
*** tobberydberg has joined #openstack-infra20:45
*** tobberydberg has quit IRC20:45
*** ociuhandu has quit IRC20:45
*** tobberydberg has joined #openstack-infra20:46
*** tobberydberg has quit IRC20:46
*** ociuhandu has joined #openstack-infra20:46
*** tobberydberg has joined #openstack-infra20:46
*** tobberydberg has quit IRC20:47
*** tobberydberg has joined #openstack-infra20:47
*** tobberydberg has quit IRC20:47
*** tobberydberg has joined #openstack-infra20:51
*** ociuhandu has quit IRC20:52
*** tobberydberg has quit IRC20:55
*** xek has quit IRC20:56
*** Lucas_Gray has joined #openstack-infra20:58
*** ociuhandu has joined #openstack-infra21:02
*** ociuhandu has quit IRC21:06
*** mmethot has quit IRC21:06
*** Lucas_Gray has quit IRC21:06
*** KeithMnemonic has joined #openstack-infra21:08
*** Lucas_Gray has joined #openstack-infra21:09
*** Lucas_Gray has quit IRC21:15
*** KeithMnemonic has quit IRC21:16
*** KeithMnemonic has joined #openstack-infra21:17
*** tobiash has quit IRC21:18
*** ociuhandu has joined #openstack-infra21:20
*** Lucas_Gray has joined #openstack-infra21:20
*** tobiash has joined #openstack-infra21:20
*** Lucas_Gray has quit IRC21:32
corvusmnaser: ah cool, thanks21:34
*** ccamacho has quit IRC21:36
*** Lucas_Gray has joined #openstack-infra21:42
*** Lucas_Gray has quit IRC21:52
*** ociuhandu has quit IRC21:55
*** ociuhandu has joined #openstack-infra21:56
*** ociuhandu has quit IRC22:01
*** slaweq_ has quit IRC22:18
*** ociuhandu has joined #openstack-infra22:46
*** tkajinam has joined #openstack-infra22:46
openstackgerritGoutham Pacha Ravi proposed openstack/project-config master: Add devstack-plugin-ceph notifications to manila channel  https://review.opendev.org/72009722:56
*** rlandy has quit IRC23:00
*** ociuhandu has quit IRC23:01
*** rh-jelabarre has quit IRC23:06
openstackgerritGoutham Pacha Ravi proposed openstack/project-config master: Add devstack-plugin-ceph notifications to manila channel  https://review.opendev.org/72009723:20
*** tosky has quit IRC23:20
*** ociuhandu has joined #openstack-infra23:35
*** dayou has joined #openstack-infra23:46
*** ociuhandu has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!