Friday, 2019-08-16

*** igordc has quit IRC00:11
*** igordc has joined #openstack-infra00:11
*** goldyfruit has quit IRC00:30
openstackgerritJames E. Blair proposed zuul/zuul master: WIP: super hacky demo of logfile under the manifest  https://review.opendev.org/67684300:31
*** goldyfruit has joined #openstack-infra00:31
*** gyee has quit IRC00:34
*** igordc has quit IRC00:44
*** igordc has joined #openstack-infra00:45
*** markvoelker has joined #openstack-infra00:45
*** markvoelker has quit IRC00:50
*** goldyfruit has quit IRC00:55
*** ricolin has joined #openstack-infra00:58
*** markvoelker has joined #openstack-infra01:03
*** spsurya has joined #openstack-infra01:14
*** dklyle has quit IRC01:18
*** armax has quit IRC01:31
*** dave-mccowan has joined #openstack-infra01:38
*** bhavikdbavishi has quit IRC01:38
*** ramishra has joined #openstack-infra01:51
*** markvoelker has quit IRC01:51
*** armax has joined #openstack-infra01:51
*** armax has quit IRC01:54
*** armax has joined #openstack-infra02:00
*** goldyfruit has joined #openstack-infra02:04
*** bobh has joined #openstack-infra02:06
*** slaweq has joined #openstack-infra02:11
*** tinwood has quit IRC02:12
*** tinwood has joined #openstack-infra02:13
*** slaweq has quit IRC02:16
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: highlight selected line  https://review.opendev.org/67684902:18
*** markvoelker has joined #openstack-infra02:35
*** hwoarang has quit IRC02:36
*** markvoelker has quit IRC02:40
*** hwoarang has joined #openstack-infra02:40
*** harlowja has quit IRC02:59
*** slaweq has joined #openstack-infra03:11
*** dave-mccowan has quit IRC03:12
*** slaweq has quit IRC03:16
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: highlight selected line  https://review.opendev.org/67684903:18
*** bhavikdbavishi has joined #openstack-infra03:19
*** raukadah is now known as chkumar|ruck03:24
*** bobh has quit IRC03:25
*** ramishra has quit IRC03:30
*** ramishra has joined #openstack-infra03:39
*** markvoelker has joined #openstack-infra04:00
*** markvoelker has quit IRC04:04
*** igordc has quit IRC04:11
*** rh-jelabarre has quit IRC04:22
*** Pavan has quit IRC04:23
*** gagehugo has quit IRC04:25
*** gagehugo has joined #openstack-infra04:26
*** markvoelker has joined #openstack-infra04:30
*** markvoelker has quit IRC04:35
*** jaosorior has quit IRC04:40
*** odicha has quit IRC05:04
*** odicha has joined #openstack-infra05:08
*** slaweq has joined #openstack-infra05:11
*** xarses has quit IRC05:11
*** xarses_ has joined #openstack-infra05:11
*** e0ne has joined #openstack-infra05:13
*** slaweq has quit IRC05:16
*** e0ne has quit IRC05:27
*** jtomasek has joined #openstack-infra05:37
*** dpawlik has joined #openstack-infra05:43
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [wip] f30 boot test  https://review.opendev.org/67658205:45
openstackgerritIan Wienand proposed openstack/diskimage-builder master: rpm-distro: ensure we selinux relabel underlying directories  https://review.opendev.org/67685505:45
ianwpabelanger: ^ i think this gets us there ... (fingers crossed emoji)05:46
openstackgerritIan Wienand proposed zuul/nodepool master: Add a dib-cmd option for diskimages  https://review.opendev.org/67219606:03
*** zhurong has joined #openstack-infra06:12
*** pkopec has joined #openstack-infra06:25
*** yamamoto has joined #openstack-infra06:26
*** yamamoto has quit IRC06:28
*** yamamoto has joined #openstack-infra06:29
*** ociuhandu has joined #openstack-infra06:31
*** yamamoto has quit IRC06:34
*** ociuhandu has quit IRC06:35
*** kjackal has joined #openstack-infra06:39
*** dpawlik has quit IRC06:51
*** slaweq has joined #openstack-infra06:51
*** kopecmartin|off is now known as kopecmartin06:53
*** tdasilva has joined #openstack-infra06:54
*** yolanda has joined #openstack-infra06:55
*** dpawlik has joined #openstack-infra07:00
*** markvoelker has joined #openstack-infra07:05
*** xenos76 has joined #openstack-infra07:08
*** smcginnis|pto has quit IRC07:08
*** markvoelker has quit IRC07:10
*** jtomasek has quit IRC07:25
*** e0ne has joined #openstack-infra07:52
yoctozeptohey infra, how can I view the ara report for primary host on this https://zuul.opendev.org/t/openstack/build/5d4860b01db846fb91cdc92aed955dd8/logs path: primary/ara-report08:02
yoctozeptoreading sqlite database in text mode does not help :-)08:02
*** lucasagomes has joined #openstack-infra08:02
*** trident has quit IRC08:03
frickleryoctozepto: corvus: seems that this is a feature that is still missing in the swift log switch08:08
*** trident has joined #openstack-infra08:11
*** jaosorior has joined #openstack-infra08:11
fricklerI'm also noticing that in order to be able to view the standard ara reports, I need to tell noscript to trust all swift sites, which I find rather annoying, cause we share the content there with possibly lots of other customers. just trusting opendev.org was way easier08:11
*** jaosorior has quit IRC08:11
AJaegerfrickler: reading backscroll, that might be a missing CORS header - and thus might need investigation.08:13
fricklerAJaeger: do you know how to verify that? indeed it seems to affect only some reports and not all of them08:21
AJaegerfrickler: no idea - didn't follow everything and don't remember seeing instructions08:26
AJaegerbut if you have a report where it is needed, I recommend give the URL and let's see whether corvus can help08:27
*** tkajinam has quit IRC08:27
fricklercorvus: https://zuul.opendev.org/t/openstack/build/05bd8ef8a30040bf90725d8cfbe9f4de/logs and https://zuul.opendev.org/t/openstack/build/13cbdfa4748a4938a4db0ec339b354e1/logs are two more samples in addition to the one yoctozepto showed above, maybe that helps to find a pattern08:29
fricklerone is on rackcdn, the other on ovh. some other reports on rackcdn do seem to work fine, though08:29
*** derekh has joined #openstack-infra08:37
*** kaisers has quit IRC08:44
*** kaisers has joined #openstack-infra08:45
*** jaosorior has joined #openstack-infra09:02
*** yamamoto has joined #openstack-infra09:08
*** yamamoto has quit IRC09:13
*** kaisers has quit IRC09:31
*** Lucas_Gray has joined #openstack-infra09:37
*** kaisers has joined #openstack-infra09:41
*** jaosorior has quit IRC09:41
*** jaosorior has joined #openstack-infra09:44
*** tdasilva has quit IRC09:46
*** ociuhandu has joined #openstack-infra09:48
*** ociuhandu has quit IRC09:50
*** markvoelker has joined #openstack-infra10:01
*** markvoelker has quit IRC10:10
*** ociuhandu has joined #openstack-infra10:25
*** Lucas_Gray has quit IRC10:32
*** jaosorior has quit IRC10:35
*** ociuhandu has quit IRC10:38
*** ociuhandu has joined #openstack-infra10:39
*** ociuhandu has quit IRC10:42
*** ociuhandu has joined #openstack-infra10:42
*** Lucas_Gray has joined #openstack-infra10:43
*** markvoelker has joined #openstack-infra10:45
*** markvoelker has quit IRC10:50
*** kjackal has quit IRC10:51
*** ociuhandu has quit IRC10:53
*** tdasilva has joined #openstack-infra10:56
*** ociuhandu has joined #openstack-infra10:58
*** bhavikdbavishi has quit IRC11:02
*** jtomasek has joined #openstack-infra11:03
*** bhavikdbavishi has joined #openstack-infra11:03
*** gfidente has joined #openstack-infra11:04
*** kjackal has joined #openstack-infra11:14
fricklerAJaeger: I just spotted this post failure of promote-openstack-manuals, just making sure that you are aware of it https://object-storage-ca-ymq-1.vexxhost.net/v1/86bbbcfa8ad043109d2d7af530225c72/logs_99/99920e8a49f0a2be881da517d45269c131ba5c42/post/promote-openstack-manuals/635c481/job-output.txt11:19
*** bhavikdbavishi has quit IRC11:22
*** ijw has joined #openstack-infra11:27
*** ijw has quit IRC11:32
AJaegerfrickler: thanks, will look into it...11:38
*** ociuhandu has quit IRC11:38
AJaegerfrickler: was waiting for the first time run of it and then missed it ;(11:38
*** ociuhandu has joined #openstack-infra11:40
AJaegerfrickler: argh, it should have run in promote - instead of post. On it...11:40
*** ociuhandu has quit IRC11:44
*** markvoelker has joined #openstack-infra11:48
*** ociuhandu has joined #openstack-infra11:50
*** yamamoto has joined #openstack-infra11:50
*** mgoddard has quit IRC11:52
*** Lucas_Gray has quit IRC11:53
*** ociuhandu has quit IRC11:55
*** yamamoto has quit IRC11:55
*** dchen has quit IRC11:58
*** rh-jelabarre has joined #openstack-infra12:14
openstackgerritMark Meyer proposed zuul/zuul master: Rework a cache invalidation issue  https://review.opendev.org/67442512:28
*** goldyfruit has quit IRC12:32
*** rlandy has joined #openstack-infra12:33
*** rlandy is now known as rlandy|rover12:33
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: highlight selected line  https://review.opendev.org/67684912:35
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: do not scroll into view more than once  https://review.opendev.org/67692412:35
*** ociuhandu has joined #openstack-infra12:40
AJaegeryeah, promote job working for openstack-manuals12:42
AJaeger\o/12:42
mordredAJaeger: woot!12:45
*** yamamoto has joined #openstack-infra12:46
*** Lucas_Gray has joined #openstack-infra12:51
*** yamamoto has quit IRC12:51
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile highlight selected line  https://review.opendev.org/67684912:57
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile do not scroll into view more than once  https://review.opendev.org/67692412:57
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile do not use anchor for line selection  https://review.opendev.org/67692812:57
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile scroll into view a bit more  https://review.opendev.org/67692912:57
*** yamamoto has joined #openstack-infra12:57
*** ociuhandu has quit IRC12:57
*** asettle has joined #openstack-infra13:04
asettleclarkb, hey fam!13:04
asettleI got a real hilarious problem for you13:04
asettleSorta hilarious, I guess13:04
asettleWhenever I go to opendev, it automatically adjusts to Korean...13:05
asettleThis is not a setting I have you know... anywhere else... in my browser.13:05
asettlePerhaps mordred might know13:10
jrosserasettle: I saw this a few weeks ago too but I think Turkish from memory....13:10
asettleHAHA oh my13:10
*** goldyfruit has joined #openstack-infra13:10
asettleI've never read anything in Korean in my life... or Turkish...13:11
jrosserIt would be surprising for it to remember a language setting server side? I too was kinda baffled, then it “fixed itself” :)13:13
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile scroll into view a bit more  https://review.opendev.org/67692913:20
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile do not use anchor for line selection  https://review.opendev.org/67692813:20
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile support multi line selection through shift-click  https://review.opendev.org/67693713:20
*** odicha has quit IRC13:20
mordredasettle: yeah ... we don't really have a per-user settings for opendev ... that's super weird. I don't actually know the answer :(13:21
odyssey4measettle: think of is as an opportunity to learn something new ;)13:23
mordredodyssey4me: ++13:24
*** dpawlik has quit IRC13:24
mnaserasettle: that happened to me once13:26
mnaseri clicked a google link that has a a korean locale in the url13:26
mnaserfor opendev13:26
asettleodyssey4me, ah yes, for all that time I've wanted to learn korean through opendev13:27
asettleMy prayers are answered13:27
asettlemnaser, hhaha oh dear13:27
asettleHow did you fix?13:27
mnaserasettle: fwiw, scroll down to the end, bottom right, there is a little globe13:27
asettlemordred, oh... hmm... okay so it's not just me?13:27
mnaserthat has the langauges there13:27
asettlemnaser, OMG SAVED13:27
asettleThank <313:27
asettleBless13:27
asettleChrome wasn't very good at translating it13:27
mnaserno problem :)13:27
*** kjackal has quit IRC13:30
*** kjackal has joined #openstack-infra13:32
*** aaronsheffield has joined #openstack-infra13:32
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: DNM: testing openshift job  https://review.opendev.org/67694313:34
*** ociuhandu has joined #openstack-infra13:38
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Remove sphinx_output_dir  https://review.opendev.org/67694513:41
*** ociuhandu has quit IRC13:42
*** sthussey has joined #openstack-infra13:44
*** jeliu_ has joined #openstack-infra13:44
corvusyoctozepto: you'll need to switch that job to generate static versions of the ara report13:45
*** ociuhandu has joined #openstack-infra13:45
openstackgerritTristan Cacqueray proposed zuul/zuul master: manager: check if parent_layout exists before looking for errors  https://review.opendev.org/67694713:47
corvusfrickler, AJaeger: no, those cors settings are fine -- it sounds like the issue is due to ara being a javascript application itself, so noscript doesn't run it by default13:50
Shrewsinfra-root: So, yesterday I thought the builders had an issue with dib mounts, but it appears it's actually that the opensuse-423 just refuses to build. Doesn't appear we've uploaded a new image in 2 months.13:50
openstackgerritTristan Cacqueray proposed zuul/zuul master: github: properly exist when failing to get a pull request  https://review.opendev.org/67694813:50
Shrewsinfra-root: But on the plus side, I haven't seen any image object leaks in rax since we restarted with the latest sdk version.13:51
AJaegerShrews: I think we stopped building opensuse-423, if it's still used best talk with cmurphy and dirk13:58
ShrewsAJaeger: i have no idea if it's still used.14:00
mnaseri think opensuse 42 was dropped because it was like the 'fedora' of opensuse .. or something like that14:01
mnaserthe 15x are the ones that are important14:01
mnaserthose are the rhel-y equivs14:01
mnaserevrardjp: might have input too14:01
AJaegerdirk or cmurphy can confirm14:01
* mnaser hides before saying anything more stupid14:01
yoctozepto<corvus> yoctozepto: you'll need to switch that job to generate static versions of the ara report14:02
yoctozepto:-(14:02
yoctozeptomnaser: don't worry, we all do from time to time14:02
*** bdodd has joined #openstack-infra14:02
openstackgerritTristan Cacqueray proposed zuul/nodepool master: zk: except NotEmptyError in deleteRawNode  https://review.opendev.org/67695314:03
*** goldyfruit_ has joined #openstack-infra14:03
yoctozeptocorvus: no way it gets fixed any time soon?14:05
yoctozepto:-)14:05
*** yamamoto has quit IRC14:06
*** goldyfruit has quit IRC14:06
cmurphyAJaeger: i think we don't care about opensuse-423 any more but dirk knows for sure14:10
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: logfile remember if initial scroll was performed  https://review.opendev.org/67695414:11
AJaegerShrews: where is opensuse-423 build? What needs cleaninug up?14:11
AJaegerthanks, cmurphy14:11
corvusyoctozepto: it's not broken14:11
ShrewsAJaeger: on nb01/nb02 nodepool.yaml configs14:12
*** yamamoto has joined #openstack-infra14:12
corvusyoctozepto: if you have a job that produces an ara report, it will need to be static now; there is no log server running middleware14:12
corvusyoctozepto: it's just an option change to the ara generation to tell it to do static generation14:13
yoctozeptocorvus: ok, I get you, though is that efficient?14:15
yoctozeptowill adapt if there is no other way :-)14:15
openstackgerritTristan Cacqueray proposed zuul/nodepool master: zk: except NotEmptyError in deleteRawNode  https://review.opendev.org/67695314:16
corvusyoctozepto: it's not that bad; it uses a little bit of storage, but it compresses well.  same network traffic for the end user14:17
*** yamamoto has quit IRC14:17
yoctozeptocorvus: ok, will switch then, thanks14:18
corvusyoctozepto: sorry about that, i should have called that out in the emails, but i forgot14:19
yoctozeptocorvus: nah, there was a general note about wsgi middleware being gone, turned out ara was no magic but wsgi :-)14:21
yoctozeptoman just does not realize that on time though :D14:21
corvusefried: if you have a second, can you take a look at something for me and give me some user feedback?  this is a preview build of a very work-in-progress change.  if you follow this link, then click the "Builds" tab, then one of the "SUCCESS" or "FAILURE" links, then "Logs", then click on one of the black logfile names (not the blue ones), you'll see the log show up at the bottom of the page:14:27
corvushttps://b412b70df00484e20424-05b6d53ba60e291a63e8a8b82b9d5ccd.ssl.cf5.rackcdn.com/676843/1/check/zuul-build-dashboard/c538e6e/npm/html/status14:27
efried...14:28
efriedI get a 404 clicking on that :(14:28
efriedcorvus: ^14:28
corvusbah14:29
corvushttps://b412b70df00484e20424-05b6d53ba60e291a63e8a8b82b9d5ccd.ssl.cf5.rackcdn.com/676843/1/check/zuul-build-dashboard/c538e6e/npm/html/14:29
efriedhm, but when I go one directory back...14:29
efriedyeah.14:29
corvusefried: ^ sorry -- i always do that14:29
corvus(we can't deep-link in the preview builds)14:29
efriedit redirects me to same (afaics) though...14:29
openstackgerritAndreas Jaeger proposed openstack/project-config master: Rename manuals build jobs  https://review.opendev.org/67696014:30
efriedoh? That seems... not as useful as it could be?14:30
corvusefried: yep.  it's a weird fake javascript redirect, not a real one :)14:30
*** liuyulong has joined #openstack-infra14:31
corvusefried: yeah, it's annoying, but it's more or less not possible to fix, so we live with it.  the preview builds themselves (built from changes pushed to gerrit and hitting real production data) are magic enough that we're still thrilled :)14:31
efriedI'm up to "black logfile names". I must have picked the wrong build14:31
corvusefried: like "job-output.txt"14:31
corvusthey are clickable, they just don't look like it because i haven't restyled them yet14:31
efriedah14:32
efriedokay, off the bat, it would be nice to have a visual (spinny thing or whatever) telling me "we're working on loading that up for you"14:32
openstackgerritMerged zuul/zuul-jobs master: install-openshift: bump version to 3.11.0  https://review.opendev.org/67278514:32
corvusefried: ack14:33
*** bobh has joined #openstack-infra14:33
efriedso now yeah, this loads up and browser scrollbars work natively and that's cool.14:33
efriednone of this is clickable/anchorable14:33
corvusnope that's all broken14:33
corvusit's a really broken change14:34
efriedcan't tell if filterable because job-output ain't anyway.14:34
efriedokay, wasn't sure if that was a thing you were planning to add to this.14:34
corvusmostly looking for "is the idea of putting it on the same page worth exploring?"14:34
efriedgotcha. I think definitely yes. Because that leaves me the nav tree to move around in.14:34
efriedas long as Shift+Click/Ctrl+Click works to open in new window/tab14:35
efriedOne thing that would be nice is an option to toggle wrap14:35
efriedMy DHTML knowledge is old (probably DHTML isn't even an acronym that's used anymore) but I would think that should be fairly easy to make.14:36
efriedBecause horiz scrolling isn't always ideal.14:36
efriedbut neither is wrap :)14:36
efriedanother featurelet for this would be, I click, the file loads up, *and* I get bumped down to where it starts. Otherwise (esp if my tree is big or my window is small) I can't tell that anything happened.14:37
corvusall good feedback, thanks :)14:40
efriedany time14:42
*** bnemec is now known as beekneemech14:48
*** cmurphy is now known as cmorpheus14:48
ShrewsAJaeger: I just grepped launcher logs for opensuse-423 and found recent node requests for it. Seems something is still using it14:48
AJaegerand it's still in project-config . best discuss with dirk or evrardjp - perhaps better on monday14:49
Shrews++14:52
*** armax has joined #openstack-infra15:01
corvusa patch to remove it from project-config may tell you where it's used15:02
*** dklyle has joined #openstack-infra15:05
beekneemechHey, https://review.opendev.org/#/c/675454 is failing on "InterpreterNotFound: python3.7"15:05
beekneemechIs there something else I need to set to get a py37-capable env?15:05
*** kopecmartin is now known as kopecmartin|off15:06
openstackgerritDavid Shrewsbury proposed openstack/project-config master: DNM: Remove opensuse-423  https://review.opendev.org/67697115:08
AJaegerconfig-core, could you review https://review.opendev.org/676960 , please? I need to rename jobs and thus change the promote jobs names again .15:10
clarkbbeekneemech: you'll need to install python 37 too iirc. py36 is default on bionic so you dont get 37 automatically.15:11
AJaegerbeekneemech: for jobs inheriting from tox-py37, we install python3715:11
AJaegerso, better inherit from openstack-tox-py37 then from openstack-tox15:12
AJaegeror install python 3.7 yourself as clarkb suggested15:12
beekneemechAh, okay. Thanks!15:12
*** gyee has joined #openstack-infra15:12
*** ramishra has quit IRC15:14
*** Garyx has joined #openstack-infra15:17
*** goldyfruit___ has joined #openstack-infra15:27
openstackgerritTristan Cacqueray proposed zuul/zuul master: executor: add merge_jobs options to disable gearman merge jobs  https://review.opendev.org/67697415:27
*** diablo_rojo has joined #openstack-infra15:28
*** goldyfruit_ has quit IRC15:28
*** goldyfruit_ has joined #openstack-infra15:29
AJaegermordred: could you do a quick review ,please? https://review.opendev.org/67696015:29
openstackgerritJames E. Blair proposed zuul/zuul master: Collect more information from quickstart failures  https://review.opendev.org/67697615:31
*** noorul has joined #openstack-infra15:32
*** goldyfruit___ has quit IRC15:32
*** gyee has quit IRC15:35
AJaegerclarkb: thanks for reviewing 676960  - I'll self-approve to move forward with the docs jobs since the dependency is merged if that's ok.15:40
*** ociuhandu has quit IRC15:40
*** ociuhandu has joined #openstack-infra15:41
*** eharney has joined #openstack-infra15:42
clarkbAJaeger: ok15:42
*** ociuhandu has quit IRC15:45
AJaegercorvus: Am I correct that a promote job should be only used for a job that we always run in gate? The api-ref jobs have a file section, so are only run when changes are done - so, in this case, the promote job would fail since there's nothing to publish. Should we still do promote - and can we add the same file trigger there, or better leave it?15:48
openstackgerritJames E. Blair proposed zuul/zuul master: Collect more information from quickstart failures  https://review.opendev.org/67697615:48
*** gyee has joined #openstack-infra15:48
corvusAJaeger: you can put the same file trigger (promote is change based, so it behaves just like a job in gate)15:49
AJaegercorvus: cool! ok, then I'll continue this road ;)15:49
*** ociuhandu has joined #openstack-infra15:50
*** noorul has quit IRC15:51
*** josephrsandoval has joined #openstack-infra15:51
*** gyee has quit IRC15:52
openstackgerritAndreas Jaeger proposed openstack/project-config master: Add promote api-ref/guide jobs  https://review.opendev.org/67663015:54
AJaegercorvus: added file trigger, then the change above and https://review.opendev.org/#/c/676624 are ready15:54
*** ociuhandu has quit IRC15:54
AJaegerconfig-core, reviews welcome once you're through all the swift log changes ;) ^15:55
*** ociuhandu has joined #openstack-infra15:55
*** efried is now known as efried_afk15:56
corvusAJaeger: lgtm, though it might be worth looking into whether we can move some of that into the -manuals repo so the file matchers can stay in sync15:56
openstackgerritMerged openstack/project-config master: Rename manuals build jobs  https://review.opendev.org/67696015:56
corvusAJaeger: oh, i think i see why that's not practical15:57
corvusignore me15:57
AJaegercorvus: can we access the secrets there?15:57
corvusAJaeger: these jobs are used in lots of repos, right?15:57
AJaegercorvus: yes15:57
mnaserhttps://review.opendev.org/#/c/676705/ is a simple accessbot change :>15:58
AJaegernova, cinder, - everything that has an API basically...15:58
corvusthe build job is in openstack-zuul-jobs right?15:58
*** e0ne has quit IRC15:58
AJaegeryes15:58
AJaegercorvus: see https://review.opendev.org/#/c/676624/1 for that update15:59
corvusAJaeger: is there a reason you set final:true?15:59
AJaegerI just copied what hte publish job had before ;) If we don't need it, I can remove15:59
AJaegerthat was me being paranoid ;)16:00
corvusAJaeger: as long as the playbook of the job can't be tricked into doing something it shouldn't by a user changing a variable or running a pre-playbook, then i think it's not necessary16:02
*** ijw has joined #openstack-infra16:02
corvusAJaeger: and if you turn off final:true, then you can inherit from it in openstack-zuul-jobs and add the files matcher there16:02
*** lucasagomes has quit IRC16:03
corvusAJaeger: (and then you can use yaml anchors to make sure it stays in sync)16:03
clarkbfungi: on that lists.o.o 550 error is "The following organization rejected your message: m9a0001g.houston.software=grp.com." implying they are talking to a mailserver that isn't ours?16:03
corvusclarkb, fungi: that's how i read it16:03
clarkbok that appears to be a microfocus host16:05
clarkband as far as I know we require no tls16:06
*** yamamoto has joined #openstack-infra16:07
*** diablo_rojo has quit IRC16:07
openstackgerritMerged openstack/project-config master: ircbot: add #openstack-ansible-sig to bots  https://review.opendev.org/67670516:07
*** noorul has joined #openstack-infra16:08
*** gyee has joined #openstack-infra16:08
*** rkukura_ has joined #openstack-infra16:09
*** rkukura has quit IRC16:09
*** rkukura_ is now known as rkukura16:09
*** yamamoto has quit IRC16:11
clarkbalso I'm noticing this example email is from july 916:13
clarkbNot sure how much effort we want to spend debugging something from over a month ago (I've confirmed that email seems to be flowing according to the exim mainlog between lists.o.o and the source of this email)16:13
*** Lucas_Gray has quit IRC16:13
clarkbfungi: ^ I'll let you decide if we need to do anything more there when you return to things16:16
openstackgerritMerged zuul/zuul master: JS: account for header when scrolling to line  https://review.opendev.org/67681816:17
*** bnemec has joined #openstack-infra16:19
*** beekneemech has quit IRC16:19
*** bnemec is now known as beekneemech16:20
*** josephrsandoval has quit IRC16:27
*** ociuhandu_ has joined #openstack-infra16:28
*** yolanda has quit IRC16:30
openstackgerritLogan V proposed openstack/diskimage-builder master: Stop deleting random things from /usr/share  https://review.opendev.org/67698316:30
*** josephrsandoval has joined #openstack-infra16:30
openstackgerritLogan V proposed openstack/diskimage-builder master: Stop deleting random things from /usr/share  https://review.opendev.org/67698316:31
*** ociuhandu has quit IRC16:31
clarkblogan-: I agree cracklib seems like one that is less safe to remove but docs and info files and gnome help entries seems like they would be mostly safe?16:32
*** goldyfruit_ has quit IRC16:32
*** beekneemech has quit IRC16:32
clarkbI'm trying to reason about whether there is a balance to be achived there16:32
logan-yeah i'm on the fence16:32
*** ociuhandu_ has quit IRC16:32
logan-if we have the disk usage report enabled in the gate we should be able to see what the du impact is by leaving those dirs16:33
logan-but yeah i'm open to limiting that change to cracklib only if thats preferred16:34
AJaegercorvus: or add file section in project-template in openstack-zuul-jobs?16:34
*** bnemec has joined #openstack-infra16:35
corvusAJaeger: i think that would work16:35
openstackgerritMerged zuul/zuul master: JS: Break log viewer out of the panel  https://review.opendev.org/67682716:36
AJaegercorvus: so, remove final:true and update project-template? Will do!16:36
corvusAJaeger: you don't need to remove final:true if you aren't going to inherit16:36
AJaegerah...16:37
*** yolanda has joined #openstack-infra16:37
corvuswhichever you prefer :)16:37
AJaegerbut I could remove the files then...16:38
openstackgerritAndreas Jaeger proposed openstack/project-config master: Add promote api-ref/guide jobs  https://review.opendev.org/67663016:38
openstackgerritAndreas Jaeger proposed openstack/openstack-zuul-jobs master: Switch to promote jobs for api-ref/-guide  https://review.opendev.org/67663116:41
AJaegercorvus: updated ^16:41
*** ijw_ has joined #openstack-infra16:41
*** bnemec has quit IRC16:44
*** kjackal has quit IRC16:44
*** ijw has quit IRC16:45
*** bnemec has joined #openstack-infra16:45
*** tdasilva has quit IRC16:45
openstackgerritAndreas Jaeger proposed openstack/project-config master: Fix download_artifact_job for  promote-openstack-manuals-developer  https://review.opendev.org/67698816:46
AJaegerconfig-core, one more job rename for review, please ^16:46
*** kjackal has joined #openstack-infra16:46
openstackgerritAndreas Jaeger proposed openstack/openstack-zuul-jobs master: Switch to promote jobs for api-ref/-guide  https://review.opendev.org/67663116:47
*** rlandy|rover is now known as rlandy|rover|brb16:47
*** gfidente has quit IRC16:48
*** derekh has quit IRC16:48
*** kjackal has quit IRC16:49
openstackgerritAndreas Jaeger proposed openstack/openstack-zuul-jobs master: Switch to promote jobs for api-ref/-guide  https://review.opendev.org/67663116:50
*** goldyfruit_ has joined #openstack-infra16:53
openstackgerritMerged zuul/zuul master: JS: add line numbers to log file  https://review.opendev.org/67683016:53
clarkbAJaeger: I think you can approve 676988 if you want16:58
AJaegerthanks, clarkb16:58
AJaegerclarkb: could you review https://review.opendev.org/676945 , please?16:59
*** eharney has quit IRC17:00
*** panda has quit IRC17:00
AJaegerclarkb: and since you reviewed two of the three api-ref promote changes, please look at https://review.opendev.org/#/c/676624/ as well17:00
AJaegerbbl17:00
*** mattw4 has joined #openstack-infra17:01
*** bnemec has quit IRC17:02
*** panda has joined #openstack-infra17:02
*** bnemec has joined #openstack-infra17:03
*** igordc has joined #openstack-infra17:04
*** ociuhandu has joined #openstack-infra17:05
*** igordc has quit IRC17:08
*** ociuhandu has quit IRC17:09
openstackgerritMerged openstack/project-config master: Fix download_artifact_job for  promote-openstack-manuals-developer  https://review.opendev.org/67698817:09
*** markvoelker has quit IRC17:10
*** rlandy|rover|brb is now known as rlandy|rover17:11
openstackgerritMerged zuul/zuul master: web: logfile highlight selected line  https://review.opendev.org/67684917:13
*** bnemec has quit IRC17:14
*** bnemec has joined #openstack-infra17:15
openstackgerritMerged zuul/zuul-jobs master: Remove sphinx_output_dir  https://review.opendev.org/67694517:17
*** markvoelker has joined #openstack-infra17:18
*** mattw4 has quit IRC17:20
AJaegerinfra-root, one of our git mirrors is broken - I just checked out an empty instack-undercloud repo but https://opendev.org/openstack/instack-undercloud looks ok17:24
*** igordc has joined #openstack-infra17:26
*** bnemec has quit IRC17:31
*** bnemec has joined #openstack-infra17:34
*** josephrsandoval has quit IRC17:34
*** ijw_ has quit IRC17:35
openstackgerritJames E. Blair proposed zuul/zuul master: WIP: super hacky demo of logfile under the manifest  https://review.opendev.org/67684317:37
*** dklyle has quit IRC17:40
*** bnemec has quit IRC17:40
openstackgerritDavid Shrewsbury proposed openstack/project-config master: DNM: Remove opensuse-423 from nodepool  https://review.opendev.org/67697117:40
*** bnemec has joined #openstack-infra17:42
*** bobh has quit IRC17:46
*** igordc has quit IRC17:49
*** igordc has joined #openstack-infra17:50
*** mattw4 has joined #openstack-infra17:50
*** jtomasek has quit IRC17:53
mnaserso i really want to make magnum CI happen.  right now, it's not possible because of nested virt woes.  does anyone have any ideas how we can work around that?17:53
mnaserbesides going all metal?>17:54
jrollmnaser: what's special about magnum, compared to ironic or octavia where CI is slow, but we get by?17:59
mnaserjroll: i think magnum actually needs to do a lot of work inside the VM which makes it much slower afaik18:00
jrollk8s in the inner VMs too heavy?18:00
jrollyeah18:00
mnaseryeah, deploying k8s is a bit more than "ok its pingable, we're good"18:00
mnaseri mean i dont know how bad qemu is compared to kvm18:00
jrollany i/o inside that vm is slow18:00
jrolljust wanted to be sure I'm not missing something18:00
johnsomqemu adds about 50 minutes to some of our tempest runs vs kvm18:00
mnaseryeah and we would do way more than octavia does18:01
mnaserthis might be throwing in something wild, but i wonder if firecracker might fare better at running inside vms18:01
mnaserbecause its a lot more simple18:01
jrollcrazy workaround idea: magnum talks to a real openstack cloud instead of the devstack cloud it's running on, and boots real vms?18:01
donnydmnaser: maybe give my special extra memory flavors a whirl18:01
mnaserjroll: that's actually something i've considered, i'd be happy to provide resources, the issue here is figuring out how to do it (somewhat) in parallel18:02
donnydseems to me like most of the jobs are memory constrained18:02
mnaserand afaik magnum requires admin credentials too18:02
mnaserdonnyd: yeah but in this case this is running a vm inside of a vm which is tricky18:02
*** tdasilva has joined #openstack-infra18:02
jrolloh, admin credentials would make this impossible, ugh18:02
mnaseri mean, it could be a good effort to _remove_ the need for magnum to need admin credentials *but* keystonemiddleware requires it18:02
jrollyeah18:03
jrollthough keystonemiddleware could validate tokens against devstack, but magnum could auth as non-admin to another cloud, right?18:03
mnaseri am not sure if it can be made to work that way18:03
jrollthis is getting hacky, but worth a look18:03
mnaseri think the trick could be to make heat run against another cloud18:05
mnaserif heat can run against another cloud, then you'd be golden18:05
jrolloh right, it all depends on heat18:06
mnaserone time use accounts sure sounds nice now18:06
mnaseri guess if we find a way to run the shell-y bits against nodepool vms18:07
donnydapplication creds?18:07
mnaserthat'll cover a big part of the things that go wrong18:07
donnyddo those work for that kind of use case18:07
mnaserapplication creds are good but we arent at astate whre you can have a user that creates and deletes their own projects (but not a cloud admin)18:08
donnydoh yea, that makes sense18:08
donnydcan't one create custom policy to do something like that18:08
mnaseryou could but i usually dont like entering that realm, for something that feels like it should be natively handled :)18:09
donnydwe need something like nested projects..18:10
donnydcan a domain be created where someone is admin, but only for that domain?18:12
*** roman_g has quit IRC18:12
*** josephrsandoval has joined #openstack-infra18:12
clarkbmnaser: so the two major options we've we've been pushing for years for these types of projects is to either get baremetal resources or use compute that isn't virtualized18:13
clarkblxc nova driver for example18:13
clarkbI think octavia was making progress with lxd then that driver was killed18:13
mnaserso for #2, i am curious/wondering if that would actually work because in this case we're deploying k8s18:13
mnaserlxc using libvirt is still a thing though afaik, so thats valid, but i wonder if that would be problematic having those two 'layers'18:14
clarkbmnaser: you can run k8s in containers aiui (in fact this is how magnum does it with the atomic image)18:14
clarkbmagnum just happens to also add a layer of virtualization under the containers too18:14
johnsomclarkb I had a working proof of concept.18:14
mnaseryes but k8s will run inside containers which also will run inside lxc18:14
mnaserand im wondering if docker runs ok inside lxc18:14
*** liuyulong has quit IRC18:15
*** rkukura_ has joined #openstack-infra18:15
logan-mnaser: it does if you use the nested container apparmor profile18:16
mnaserokay that's exciting18:16
mnaserso maybe step 1 is to see if devstack can deploy nova with lxc (using libvirt) in gate18:16
clarkbAJaeger: looks like gitea03, you can confirm with GIT_SSL_NO_VERIFY=1 git clone https://gitea03.opendev.org:3000/openstack/instack-undercloud18:17
mnaserhttps://github.com/openstack/devstack/blob/master/lib/nova_plugins/hypervisor-libvirt#L90-L10318:17
mnaserokay18:17
clarkbAJaeger: I'm checking that host now18:17
*** rkukura has quit IRC18:19
*** rkukura_ is now known as rkukura18:19
clarkbAJaeger: looks like gitea restarted yseterday on that host. Do you know if the docker image was updated?18:20
AJaegerclarkb: thanks18:21
clarkbAJaeger: I triggered replication manually and now it clones18:21
clarkbI'm going to trigger replication against gitea03 for all repos now18:21
*** eharney has joined #openstack-infra18:21
clarkbnote that there doesn't appear to be an OOM event on that host18:21
clarkbso that isn't why gitea restarted18:21
*** chkumar|ruck is now known as raukadah18:23
openstackgerritMerged zuul/zuul master: web: logfile do not scroll into view more than once  https://review.opendev.org/67692418:24
*** ricolin has quit IRC18:24
*** bobh has joined #openstack-infra18:26
openstackgerritTristan Cacqueray proposed zuul/zuul master: gerrit: ensure patchset numbre is a number  https://review.opendev.org/67700718:29
openstackgerritAndreas Jaeger proposed openstack/project-config master: Add promote-openstack-tox-docs  https://review.opendev.org/67700818:29
openstackgerritAndreas Jaeger proposed openstack/openstack-zuul-jobs master: Use promote jobs for openstack-tox-docs  https://review.opendev.org/67700918:29
*** bobh has quit IRC18:32
jrossershould "inner" ara reports work - like this? https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_32/675632/2/check/openstack-ansible-functional-debian-stable/db4919b/logs/ara-report/18:32
logan-no18:32
jrosser:(18:32
logan-we need to start rendering static ara reports18:32
openstackgerritAndreas Jaeger proposed openstack/project-config master: Add promote-openstack-tox-docs  https://review.opendev.org/67700818:34
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove now obsolete publish-jobs  https://review.opendev.org/67701318:34
AJaegerconfig-core, corvus, I switched openstack-tox-docs now also to a promote job. Full patch series at https://review.opendev.org/#/q/status:open+++topic:promote-docs18:36
*** bdodd has quit IRC18:36
*** ijw has joined #openstack-infra18:38
*** jcoufal has joined #openstack-infra18:39
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove now obsolete publish-jobs  https://review.opendev.org/67701318:41
openstackgerritAndreas Jaeger proposed openstack/project-config master: Avoid duplication of secret  https://review.opendev.org/67701618:41
AJaegerwow, that gives "Unknown configuration error" ^18:42
AJaegerlet's merge dependency and recheck ;)18:42
openstackgerritMerged zuul/zuul master: web: logfile scroll into view a bit more  https://review.opendev.org/67692918:43
*** bobh has joined #openstack-infra18:48
*** yamamoto has joined #openstack-infra18:49
*** efried_afk is now known as efried18:52
*** yamamoto has quit IRC18:54
openstackgerritMerged zuul/zuul master: web: logfile do not use anchor for line selection  https://review.opendev.org/67692819:00
*** jcoufal has quit IRC19:01
*** noorul has quit IRC19:02
openstackgerritMohammed Naser proposed openstack/project-config master: projects: add vexxhost/kue  https://review.opendev.org/67702119:17
mnaser^ can i get this so i have my weekend to hack on things :)19:18
*** ociuhandu has joined #openstack-infra19:28
*** ociuhandu has quit IRC19:29
*** ociuhandu has joined #openstack-infra19:31
*** bobh has quit IRC19:32
*** ociuhandu has quit IRC19:34
*** ociuhandu has joined #openstack-infra19:34
*** josephrsandoval has quit IRC19:35
openstackgerritMerged openstack/project-config master: projects: add vexxhost/kue  https://review.opendev.org/67702119:37
*** ociuhandu has quit IRC19:48
*** ociuhandu has joined #openstack-infra19:48
*** ijw has quit IRC19:55
*** ociuhandu has quit IRC19:56
*** tdasilva has quit IRC20:08
*** larainema has quit IRC20:08
openstackgerritMerged zuul/zuul master: web: logfile support multi line selection through shift-click  https://review.opendev.org/67693720:10
*** bobh has joined #openstack-infra20:11
*** bnemec is now known as beekneemech20:14
*** bobh has quit IRC20:16
openstackgerritJeremy Houser proposed openstack/project-config master: Remove Ranger testing control from project-config  https://review.opendev.org/67702720:18
openstackgerritMerged zuul/zuul master: web: logfile remember if initial scroll was performed  https://review.opendev.org/67695420:24
*** markvoelker has quit IRC20:25
*** markvoelker has joined #openstack-infra20:30
*** markvoelker has quit IRC20:33
*** markvoelker has joined #openstack-infra20:33
*** mattw4 has quit IRC20:34
*** mattw4 has joined #openstack-infra20:35
corvustristanC: ^ that's the whole stack \o/20:44
*** yolanda__ has joined #openstack-infra20:45
*** yolanda has quit IRC20:46
tristanCcorvus: great!20:46
*** ociuhandu has joined #openstack-infra20:48
*** rfolco has quit IRC20:48
openstackgerritMerged zuul/zuul master: Collect more information from quickstart failures  https://review.opendev.org/67697620:50
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: extract pure functions from the TaskOutput component  https://review.opendev.org/67546020:50
corvusefried, TheJulia: i also sent a reply to the list mentioning tristanC's new range highlighting feature: http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008547.html20:51
efried++20:51
efriedcorvus: This is slick!20:52
efriedNow, how about my 'wrap' toggle? :*20:53
* efried is just getting greedy now20:53
*** mattw4 has quit IRC20:53
*** mattw4 has joined #openstack-infra20:53
corvusefried: yeah, i think that should be possible; i just didn't prioritize it as much since i didn't think it was a regression20:54
corvusefried: also, you know you want to learn react20:54
efriedoh for sure20:54
efriedwait!20:54
corvusno takebacks20:54
efried"for sure" was against the first comment, agreeing with your prioritization!20:54
efriednooooo20:55
*** pcaruana has quit IRC20:57
*** ociuhandu has quit IRC20:58
*** eharney has quit IRC20:59
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: console mark syntax error task as failed  https://review.opendev.org/67703021:00
*** igordc has quit IRC21:01
*** igordc has joined #openstack-infra21:01
*** eernst has joined #openstack-infra21:07
*** eernst has quit IRC21:11
*** markvoelker has quit IRC21:12
*** rh-jelabarre has quit IRC21:21
*** rh-jelabarre has joined #openstack-infra21:21
*** ijw has joined #openstack-infra21:26
*** ijw has quit IRC21:28
*** ijw has joined #openstack-infra21:29
openstackgerritTristan Cacqueray proposed zuul/nodepool master: kubernetes: add missing image-pull documentation  https://review.opendev.org/67703621:29
*** yamamoto has joined #openstack-infra21:31
*** yamamoto has quit IRC21:36
*** rlandy|rover has quit IRC21:41
*** haleyb is now known as haleyb|away21:54
*** markvoelker has joined #openstack-infra22:10
*** pkopec has quit IRC22:13
*** markvoelker has quit IRC22:15
*** spsurya has quit IRC22:23
*** ociuhandu has joined #openstack-infra22:29
*** xenos76 has quit IRC22:29
*** ociuhandu has quit IRC22:33
*** dayou_ has quit IRC22:34
*** jeliu_ has quit IRC22:45
*** igordc has quit IRC22:46
*** dayou_ has joined #openstack-infra22:56
*** ociuhandu has joined #openstack-infra23:00
*** ociuhandu has quit IRC23:05
*** armax has quit IRC23:08
*** vesper11 has quit IRC23:32
*** guoqiao has quit IRC23:33
*** sthussey has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!