| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add upload-logs-google role https://review.opendev.org/703711 | 00:07 |
|---|---|---|
| *** mattw4 has quit IRC | 00:10 | |
| *** derekh has quit IRC | 00:16 | |
| openstackgerrit | Merged opendev/system-config master: Remove unused linaro credentials https://review.opendev.org/703534 | 00:41 |
| openstackgerrit | Merged opendev/system-config master: Add Linaro US cloud https://review.opendev.org/703535 | 00:41 |
| clarkb | one thing I've found looking at zuul's slow tests is that a lot of time is spent on git operations. git operations are often io limited. Looking at our test nodes we mount / with barriers=1 and relatime. | 00:42 |
| clarkb | infra-root: what are your thoughts on setting barrier=0 and noatime? | 00:42 |
| clarkb | that should make filesystem operations quicker (though I'm not sure how much quicker) | 00:42 |
| clarkb | for our test nodes I think if the host crashes we should be throwing away that test result anyway so unsafe fs operations are probably ok? | 00:43 |
| fungi | that also may have no tangible benefits given how filesystem caching works these days, but it can't hurt to try | 00:44 |
| *** hwoarang has quit IRC | 01:08 | |
| *** hwoarang has joined #openstack-infra | 01:09 | |
| *** pcrews has joined #openstack-infra | 01:14 | |
| *** Lucas_Gray has quit IRC | 01:15 | |
| *** hwoarang has quit IRC | 01:26 | |
| *** jamesmcarthur has joined #openstack-infra | 01:26 | |
| *** hwoarang has joined #openstack-infra | 01:27 | |
| *** jamesmcarthur has quit IRC | 01:38 | |
| *** yamamoto has joined #openstack-infra | 01:42 | |
| *** jamesmcarthur has joined #openstack-infra | 01:47 | |
| ianw | kevinz: when you're around ... i've started a mirror node on the linaro-us cloud ... it doesn't have a public ipv6 address | 01:49 |
| ianw | ok, the router seems to have 2604:1380:4111:3e50::25 | 01:53 |
| ianw | in os-control project | 01:53 |
| *** yamamoto has quit IRC | 01:53 | |
| *** gyee has quit IRC | 02:04 | |
| *** smarcet has joined #openstack-infra | 02:21 | |
| *** yamamoto has joined #openstack-infra | 02:23 | |
| *** jamesmcarthur has quit IRC | 02:50 | |
| ianw | kevinz: ok, i see what's going on, os-control doens't have a ipv6 subnet. i'm not sure what range to use? | 02:53 |
| *** ramishra has joined #openstack-infra | 02:54 | |
| *** diablo_rojo has quit IRC | 03:06 | |
| *** apetrich has quit IRC | 03:10 | |
| *** jamesmcarthur has joined #openstack-infra | 03:13 | |
| openstackgerrit | sebastian marcet proposed opendev/puppet-openstackid master: Updated build https://review.opendev.org/703720 | 03:15 |
| *** smarcet has left #openstack-infra | 03:24 | |
| *** yamamoto has quit IRC | 03:27 | |
| *** ramishra has quit IRC | 04:03 | |
| *** udesale has joined #openstack-infra | 04:04 | |
| openstackgerrit | Jeremy Stanley proposed opendev/puppet-openstackid master: Updated build https://review.opendev.org/703720 | 04:07 |
| openstackgerrit | Jeremy Stanley proposed opendev/puppet-openstackid master: Puppet-lint says "class included by absolute name" https://review.opendev.org/703724 | 04:07 |
| *** jamesmcarthur has quit IRC | 04:14 | |
| *** jamesmcarthur has joined #openstack-infra | 04:15 | |
| *** jamesmcarthur has quit IRC | 04:21 | |
| *** ykarel|away is now known as ykarel | 04:34 | |
| fungi | infra-puppet-core: ^ yet another mindless linter update | 04:37 |
| fungi | there's a more relevant config change i rebased onto it tyhough | 04:37 |
| fungi | s/tyhough/though/ | 04:38 |
| openstackgerrit | Rico Lin proposed opendev/system-config master: Remove TW User Group ML https://review.opendev.org/584035 | 04:43 |
| *** jamesmcarthur has joined #openstack-infra | 04:45 | |
| *** rh-jelabarre has quit IRC | 04:47 | |
| *** rlandy has quit IRC | 04:47 | |
| *** jamesmcarthur has quit IRC | 04:49 | |
| *** raukadah is now known as chandankumar | 04:50 | |
| *** yamamoto has joined #openstack-infra | 04:56 | |
| *** artom has quit IRC | 05:28 | |
| ianw | kevinz: i am not sure i have got the right person in storyboard, but i have created https://storyboard.openstack.org/#!/story/2007195 to track the new cloud, and there is a task in there for the ipv6 subnet assigned to you because i'm still not sure what address range to use | 05:33 |
| *** evrardjp has quit IRC | 05:34 | |
| *** evrardjp has joined #openstack-infra | 05:34 | |
| kevinz | hi ianw | 05:43 |
| kevinz | I saw your email. | 05:43 |
| kevinz | Do you need the os-control and os-jobs in a same private subnet? | 05:44 |
| kevinz | ianw: os-control and os-jobs should share the same private subnet right, for ipv4 and ipv6? | 05:45 |
| *** Jeffrey4l has quit IRC | 05:45 | |
| *** Jeffrey4l has joined #openstack-infra | 05:46 | |
| *** surpatil has joined #openstack-infra | 05:47 | |
| openstackgerrit | Merged opendev/puppet-openstackid master: Puppet-lint says "class included by absolute name" https://review.opendev.org/703724 | 05:57 |
| openstackgerrit | Merged opendev/puppet-openstackid master: Updated build https://review.opendev.org/703720 | 05:57 |
| *** ramishra has joined #openstack-infra | 06:04 | |
| *** ociuhandu has joined #openstack-infra | 06:15 | |
| *** ociuhandu has quit IRC | 06:20 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove legacy-tempest-dsvm-full-devstack-plugin-ceph https://review.opendev.org/700078 | 06:22 |
| *** jtomasek has joined #openstack-infra | 06:27 | |
| *** lmiccini has joined #openstack-infra | 06:39 | |
| *** piotrowskim has joined #openstack-infra | 07:15 | |
| *** onovy has quit IRC | 07:16 | |
| *** onovy has joined #openstack-infra | 07:16 | |
| *** pgaxatte has joined #openstack-infra | 07:31 | |
| *** rpittau|afk is now known as rpittau | 07:37 | |
| *** lpetrut has joined #openstack-infra | 07:47 | |
| *** surpatil has quit IRC | 07:53 | |
| *** slaweq_ has joined #openstack-infra | 07:59 | |
| *** surpatil has joined #openstack-infra | 08:04 | |
| *** pgaxatte has quit IRC | 08:08 | |
| *** tesseract has joined #openstack-infra | 08:08 | |
| *** tesseract has quit IRC | 08:09 | |
| *** tesseract has joined #openstack-infra | 08:09 | |
| *** bnemec has joined #openstack-infra | 08:09 | |
| *** tkajinam has quit IRC | 08:10 | |
| *** pgaxatte has joined #openstack-infra | 08:10 | |
| *** surpatil has quit IRC | 08:12 | |
| ianw | kevinz: yeah, i think that way we can avoid all external traffic | 08:14 |
| ianw | thanks, i'll launch the node now, see how we go | 08:14 |
| *** gfidente has joined #openstack-infra | 08:15 | |
| *** apetrich has joined #openstack-infra | 08:17 | |
| *** dychen has quit IRC | 08:18 | |
| *** tosky has joined #openstack-infra | 08:27 | |
| *** TomStappaerts has joined #openstack-infra | 08:32 | |
| *** slaweq_ has quit IRC | 08:33 | |
| *** xek_ has joined #openstack-infra | 08:34 | |
| ricolin | \o/ | 08:35 |
| *** xek has quit IRC | 08:37 | |
| *** jpena|off is now known as jpena | 08:43 | |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Centralize logging adapters https://review.opendev.org/703407 | 08:50 |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Pass node request handler to launcher base class https://review.opendev.org/703549 | 08:50 |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Annotate logs in launcher https://review.opendev.org/703558 | 08:50 |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Annotate logs in node request handler https://review.opendev.org/703559 | 08:50 |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Include event id in node request listings https://review.opendev.org/703560 | 08:50 |
| openstackgerrit | Simon Westphahl proposed zuul/nodepool master: Annotate logs in zk module https://review.opendev.org/703561 | 08:50 |
| *** ralonsoh has joined #openstack-infra | 08:51 | |
| *** hashar has joined #openstack-infra | 08:53 | |
| *** yolanda has quit IRC | 08:54 | |
| openstackgerrit | Liron Kuchlani proposed openstack/os-testr master: subunit2html dealing with incorrect data format https://review.opendev.org/700778 | 08:55 |
| *** jaosorior has joined #openstack-infra | 08:59 | |
| *** yolanda has joined #openstack-infra | 09:00 | |
| *** yamamoto has quit IRC | 09:02 | |
| *** lucasagomes has joined #openstack-infra | 09:02 | |
| *** ykarel is now known as ykarel|afk | 09:04 | |
| *** pkopec has joined #openstack-infra | 09:09 | |
| openstackgerrit | Ian Wienand proposed opendev/zone-opendev.org master: Add linaro-us mirror details https://review.opendev.org/703746 | 09:10 |
| *** fabo has joined #openstack-infra | 09:14 | |
| *** fabo has quit IRC | 09:16 | |
| *** TomStappaerts has quit IRC | 09:18 | |
| *** TomStappaerts has joined #openstack-infra | 09:18 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Add linaro-us mirror https://review.opendev.org/703748 | 09:19 |
| *** jklare has quit IRC | 09:19 | |
| *** aedc has quit IRC | 09:21 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: ensure-tox: use pip3 in preference to pip https://review.opendev.org/703694 | 09:22 |
| openstackgerrit | Benjamin Schanzel proposed zuul/zuul master: Fix Test Case "TestScheduler.test_timer_with_jitter" https://review.opendev.org/703749 | 09:22 |
| openstackgerrit | Benjamin Schanzel proposed zuul/zuul master: Fix Test Case "TestScheduler.test_timer_with_jitter" https://review.opendev.org/703749 | 09:25 |
| frickler | ianw: what about dropping the "set pipefail", too, as a cleanup? | 09:27 |
| ianw | frickler: we can, doesn't hurt though? i assume it got there via some linter | 09:28 |
| frickler | ianw: I'd prefer to remove anything that is not really needed, avoids confusion and clutter | 09:29 |
| frickler | oh, I have another comment, give me a minute | 09:30 |
| ianw | if you really want to re-write it, should probably have an ansible task do the check for tox variable, then skip the second install task | 09:31 |
| frickler | ianw: commented on the review. more ansible than bash would be another option, yes | 09:32 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: ensure-tox: use pip3 in preference to pip https://review.opendev.org/703694 | 09:39 |
| openstackgerrit | Merged zuul/zuul master: tox: reduce deps used for pep8 env https://review.opendev.org/703634 | 09:47 |
| *** dtantsur|afk is now known as dtantsur | 09:48 | |
| openstackgerrit | Benjamin Schanzel proposed zuul/zuul master: Fix Test Case "TestScheduler.test_timer_with_jitter" https://review.opendev.org/703749 | 09:53 |
| AJaeger | yeah, the ircbot changes work, see http://eavesdrop.openstack.org/irclogs/%23openstack-ironic/%23openstack-ironic.2020-01-22.log.html#t2020-01-22T09:50:41 "Verification of a change to openstack/ironic-inspector failed: Use bionic job for bifrost integration https://review.opendev.org/703668" | 10:02 |
| AJaeger | config-core, want to get rid of #openstack-merges? See https://review.opendev.org/703421, please | 10:04 |
| openstackgerrit | Lajos Katona proposed openstack/project-config master: Remove python2 jobs for tap-as-a-service https://review.opendev.org/703752 | 10:08 |
| *** derekh has joined #openstack-infra | 10:13 | |
| *** TomStappaerts has quit IRC | 10:20 | |
| *** TomStappaerts has joined #openstack-infra | 10:20 | |
| *** kjackal has joined #openstack-infra | 10:25 | |
| *** TomStappaerts has left #openstack-infra | 10:29 | |
| ralonsoh | AJaeger, hi, about https://review.opendev.org/#/c/703751/1/zuul.d/project.yaml@20 | 10:29 |
| ralonsoh | if a job is included in a template, can I redefine it again in the jobs list? | 10:29 |
| ralonsoh | in this case, as you suggest, changing the timeout | 10:30 |
| ralonsoh | will this override the template job? | 10:30 |
| *** ociuhandu has joined #openstack-infra | 10:30 | |
| *** ociuhandu has quit IRC | 10:31 | |
| *** ociuhandu has joined #openstack-infra | 10:31 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Make ara-report role to zuul_return an artifact https://review.opendev.org/697681 | 10:33 |
| *** iurygregory has quit IRC | 10:36 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 10:37 |
| *** kjackal has quit IRC | 10:42 | |
| *** aedc has joined #openstack-infra | 10:44 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 10:47 |
| *** aedc has quit IRC | 10:49 | |
| openstackgerrit | Antoine Musso proposed zuul/zuul master: test: prevent ResourceWarning in test_bubblewrap https://review.opendev.org/703767 | 10:51 |
| *** ykarel|afk is now known as ykarel | 10:54 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 10:55 |
| *** hashar has quit IRC | 10:56 | |
| *** pcaruana has joined #openstack-infra | 11:02 | |
| *** dciabrin_ has joined #openstack-infra | 11:14 | |
| *** ociuhandu has quit IRC | 11:15 | |
| *** dciabrin has quit IRC | 11:18 | |
| *** kjackal has joined #openstack-infra | 11:18 | |
| *** ociuhandu has joined #openstack-infra | 11:27 | |
| AJaeger | ralonsoh, yes, it changes the job, this will work fine. | 11:38 |
| ralonsoh | AJaeger, thanks! | 11:38 |
| AJaeger | ralonsoh: check https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_70f/703751/3/check/openstack-tox-py36/70f0944/zuul-info/inventory.yaml | 11:39 |
| AJaeger | second last line has the timeout | 11:39 |
| *** rpittau is now known as rpittau|bbl | 11:41 | |
| *** ociuhandu has quit IRC | 11:42 | |
| *** ccamacho has joined #openstack-infra | 11:45 | |
| *** hashar has joined #openstack-infra | 11:46 | |
| *** ccamacho has quit IRC | 11:55 | |
| *** ccamacho has joined #openstack-infra | 11:55 | |
| *** zxiiro has quit IRC | 11:56 | |
| *** lucasagomes is now known as lucas-hungry | 11:57 | |
| *** lucas-hungry is now known as lucasagomes | 11:57 | |
| openstackgerrit | Antoine Musso proposed zuul/zuul master: test: prevent ResourceWarning in test_client https://review.opendev.org/703782 | 11:58 |
| *** ociuhandu has joined #openstack-infra | 12:00 | |
| *** udesale_ has joined #openstack-infra | 12:04 | |
| *** kjackal has quit IRC | 12:06 | |
| *** udesale has quit IRC | 12:07 | |
| *** ociuhandu has quit IRC | 12:08 | |
| *** ociuhandu has joined #openstack-infra | 12:09 | |
| *** kjackal has joined #openstack-infra | 12:13 | |
| *** jpena is now known as jpena|lunch | 12:16 | |
| *** gfgdfgdfg4 has joined #openstack-infra | 12:18 | |
| *** gfgdfgdfg4 has quit IRC | 12:19 | |
| *** udesale_ has quit IRC | 12:21 | |
| *** udesale has joined #openstack-infra | 12:21 | |
| *** gfgdfgdfg4 has joined #openstack-infra | 12:23 | |
| *** dmellado has quit IRC | 12:24 | |
| *** iurygregory has joined #openstack-infra | 12:25 | |
| openstackgerrit | Lajos Katona proposed openstack/project-config master: Move tap-as-a-service job templates https://review.opendev.org/703752 | 12:25 |
| *** dmellado has joined #openstack-infra | 12:26 | |
| *** hashar has quit IRC | 12:27 | |
| *** iokiwi has quit IRC | 12:28 | |
| *** iokiwi has joined #openstack-infra | 12:29 | |
| *** iurygregory_ has joined #openstack-infra | 12:29 | |
| *** gfgdfgdfg4 has quit IRC | 12:30 | |
| *** iurygregory has quit IRC | 12:30 | |
| *** gfgdfgdfg4 has joined #openstack-infra | 12:31 | |
| *** iurygregory_ has quit IRC | 12:32 | |
| *** gfgdfgdfg4 has quit IRC | 12:32 | |
| *** zbr has quit IRC | 12:34 | |
| *** iurygregory has joined #openstack-infra | 12:34 | |
| *** smarcet has joined #openstack-infra | 12:34 | |
| *** zbr has joined #openstack-infra | 12:35 | |
| *** smarcet has quit IRC | 12:36 | |
| *** iurygregory has quit IRC | 12:39 | |
| *** iurygregory has joined #openstack-infra | 12:40 | |
| *** zbr_ has joined #openstack-infra | 12:43 | |
| *** iokiwi has quit IRC | 12:44 | |
| *** iokiwi has joined #openstack-infra | 12:45 | |
| *** zbr has quit IRC | 12:46 | |
| *** zbr_ has quit IRC | 12:46 | |
| *** zbr has joined #openstack-infra | 12:48 | |
| *** iokiwi has quit IRC | 12:49 | |
| *** iokiwi has joined #openstack-infra | 12:49 | |
| *** iokiwi has quit IRC | 12:54 | |
| *** iokiwi has joined #openstack-infra | 12:55 | |
| *** rlandy has joined #openstack-infra | 12:59 | |
| *** kjackal has quit IRC | 13:01 | |
| *** goldyfruit has joined #openstack-infra | 13:04 | |
| *** yamamoto has joined #openstack-infra | 13:08 | |
| *** rh-jelabarre has joined #openstack-infra | 13:10 | |
| *** jaosorior has quit IRC | 13:12 | |
| *** jaosorior has joined #openstack-infra | 13:12 | |
| *** ociuhandu has quit IRC | 13:14 | |
| AJaeger | dansmith: could you review https://review.opendev.org/#/c/703421/ , please? | 13:15 |
| *** xek_ is now known as xek | 13:15 | |
| *** ociuhandu has joined #openstack-infra | 13:18 | |
| *** jamesmcarthur has joined #openstack-infra | 13:18 | |
| *** rpittau|bbl is now known as rpittau | 13:20 | |
| *** jpena|lunch is now known as jpena | 13:21 | |
| *** ociuhandu has quit IRC | 13:22 | |
| *** zbr has quit IRC | 13:26 | |
| *** zbr has joined #openstack-infra | 13:29 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 13:33 |
| *** jamesmcarthur has quit IRC | 13:34 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 13:35 |
| openstackgerrit | Jens Harbott (frickler) proposed openstack/devstack-gate master: Drop peakmem_tracker service https://review.opendev.org/703792 | 13:35 |
| *** smarcet has joined #openstack-infra | 13:36 | |
| *** jamesmcarthur has joined #openstack-infra | 13:49 | |
| *** kjackal has joined #openstack-infra | 13:53 | |
| *** sshnaidm is now known as sshnaidm|mtg | 13:55 | |
| *** yamamoto has quit IRC | 14:01 | |
| *** rcernin has quit IRC | 14:03 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed zuul/zuul master: Add irrelevant-branches negative matcher https://review.opendev.org/552809 | 14:05 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed zuul/zuul master: Use re2 for change_matcher https://review.opendev.org/536389 | 14:05 |
| *** yamamoto has joined #openstack-infra | 14:10 | |
| *** yamamoto has quit IRC | 14:10 | |
| *** yamamoto has joined #openstack-infra | 14:10 | |
| *** hashar has joined #openstack-infra | 14:13 | |
| *** jamesmcarthur has quit IRC | 14:14 | |
| *** yamamoto has quit IRC | 14:15 | |
| *** ociuhandu has joined #openstack-infra | 14:18 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed zuul/zuul-jobs master: Add a markdownlint job and role https://review.opendev.org/607691 | 14:20 |
| openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Correct LOGS path in wheel build script https://review.opendev.org/703802 | 14:21 |
| *** lbragstad has quit IRC | 14:23 | |
| *** lbragstad has joined #openstack-infra | 14:28 | |
| *** hashar has quit IRC | 14:28 | |
| *** eharney has joined #openstack-infra | 14:34 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed zuul/zuul master: Use re2 for change_matcher https://review.opendev.org/536389 | 14:35 |
| *** roman_g has joined #openstack-infra | 14:37 | |
| roman_g | Good morning everyone. | 14:39 |
| *** ociuhandu has quit IRC | 14:40 | |
| *** ociuhandu has joined #openstack-infra | 14:41 | |
| *** jamesmcarthur has joined #openstack-infra | 14:45 | |
| fungi | good morning roman_g | 14:45 |
| *** jamesmcarthur has quit IRC | 14:46 | |
| *** jamesmcarthur has joined #openstack-infra | 14:46 | |
| openstackgerrit | Tobias Henkel proposed opendev/system-config master: Upgrade pip in python-builder and base https://review.opendev.org/703807 | 14:48 |
| openstackgerrit | Tobias Henkel proposed zuul/nodepool master: Temporarily fix image build in nodepool https://review.opendev.org/703811 | 14:52 |
| *** priteau has joined #openstack-infra | 14:58 | |
| *** smarcet has quit IRC | 14:59 | |
| *** ykarel is now known as ykarel|away | 15:01 | |
| *** smarcet has joined #openstack-infra | 15:04 | |
| smarcet | fungi: morning, first thx for correction on my patch | 15:06 |
| smarcet | fungi: where i could check the status of puppet build for openstackid-dev ? | 15:06 |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 15:06 |
| fungi | smarcet: if you're logged into it, you can check /var/log/syslog to see if it's getting applied (filter for messages including "puppet-user") and possibly any errors which are getting raised by it | 15:07 |
| smarcet | fungi: ok thx u :) | 15:08 |
| *** chandankumar is now known as chkumar|ruck | 15:10 | |
| fungi | smarcet: looks like it happened around 06:38:51 utc in the logs | 15:11 |
| *** zxiiro has joined #openstack-infra | 15:12 | |
| roman_g | clarkb: Hello Clark. We have got approval from Ericsson. You can shoot an e-mail to the mailing list in reply to the thread http://lists.openstack.org/pipermail/openstack-infra/2020-January/006566.html | 15:12 |
| *** ociuhandu has quit IRC | 15:13 | |
| roman_g | clarkb: would need another call, I guess? Which days/time would be convenient to you? | 15:14 |
| *** Sundar has joined #openstack-infra | 15:21 | |
| Sundar | Hello all, a number of py37 jobs have been timing out, across Neutron and Cyborg: https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-py37&result=TIMED_OUT | 15:22 |
| *** chkumar|ruck is now known as chkumar|rover | 15:23 | |
| Sundar | It is not clear that it is related to the job: occasionally it will pass with a recheck. In some cases, it has passed till a certain patchset and failed from the next, but it was a rebase. So, I'd like some help in chasing this down. | 15:24 |
| AJaeger | Sundar: Cyborg is broken in py37 - and neutron has a change up. | 15:24 |
| AJaeger | https://review.opendev.org/703751 will cover neutron | 15:24 |
| AJaeger | Sundar: Cyborg runs py36 in 4 minutes, so a timeout for py37 means that cyborg is somehow broken, maybe a race in the testsuite? | 15:26 |
| Sundar | AJaeger: how would I start investigating it? | 15:27 |
| Sundar | AJaeger: Also, many Cyborg patches do pass py37: https://review.opendev.org/#/c/703333/ | 15:27 |
| *** priteau has quit IRC | 15:28 | |
| Sundar | You said: "Neutron has a change up" -- can you give a pointer? | 15:28 |
| AJaeger | Sundar: I gave the link above | 15:28 |
| AJaeger | But that will not help Cyborg - and I don't know how to debug that myself, maybe others have an idea | 15:29 |
| Sundar | AJaeger: What is the default timeout? | 15:30 |
| AJaeger | 40 minutes for the job | 15:31 |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 15:31 |
| AJaeger | But if it finishes in 4 minutes normally, enlarging it will not help... | 15:31 |
| Sundar | Yea. That seems plenty. | 15:31 |
| Sundar | gmann: Could you give me some pointers? We have investigated individual patches and nothing stands out. | 15:35 |
| *** chkumar|rover is now known as raukadah | 15:35 | |
| *** sshnaidm|mtg is now known as sshnaidm | 15:37 | |
| *** pgaxatte has quit IRC | 15:37 | |
| *** adriancz has joined #openstack-infra | 15:39 | |
| *** jackedin has joined #openstack-infra | 15:40 | |
| *** ociuhandu has joined #openstack-infra | 15:47 | |
| Sundar | Ajaeger: I think some infra issue may also be at play. Please see: https://review.opendev.org/#/c/703287/ -- it is a doc change but timed out. It passed after a recheck. | 15:47 |
| *** kjackal has quit IRC | 15:48 | |
| *** goldyfruit has quit IRC | 15:48 | |
| Sundar | AJaeger: ^ | 15:48 |
| *** goldyfruit has joined #openstack-infra | 15:48 | |
| *** artom has joined #openstack-infra | 15:49 | |
| *** smarcet has quit IRC | 15:49 | |
| AJaeger | Sundar: that might still be a race in there. Can you figure out whats common about the timeouts ? Do they all run in the same region? | 15:50 |
| AJaeger | Sundar: sorry, can't help further right now... | 15:50 |
| Sundar | AJaeger: I am not sure how a doc change can produce a race. | 15:51 |
| AJaeger | Sundar: I'm saying there's a race already in Cyborg | 15:52 |
| clarkb | roman_g: ok I'll try to get the email out today. As for another call today is probably bad given short notice and tomorrow I have doctor visits. Maybe early next week? might also be good for ya'll to start on your end so we can address any questions that come up? | 15:56 |
| *** kjackal has joined #openstack-infra | 15:57 | |
| roman_g | clarkb: no, call is not to be scheduled for today of course. Next week works. | 15:57 |
| roman_g | clarkb: I'm working on questions. | 15:58 |
| Sundar | AJaeger: thanks, will follow up. Have a good day. | 15:58 |
| fungi | AJaeger: Sundar: one other thing i noticed earlier today... the wheel cache we build only has python 2.7, 3.5 and 3.6 wheels, so any jobs using python 3.7 will likely wind up building c extensions for any platform-specific python dependencies | 16:00 |
| clarkb | roman_g: what about in exactly a week. wednesday at 1600UTC. Otherwise I can do Monday or Tuesday at 1700UTC | 16:01 |
| openstackgerrit | Merged zuul/zuul master: test: prevent ResourceWarning in test_bubblewrap https://review.opendev.org/703767 | 16:01 |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 16:07 |
| *** ociuhandu has quit IRC | 16:11 | |
| roman_g | clarkb: I'm trying to agree date/time with other participants. Will get back to you. Not Tuesday for sure. | 16:13 |
| *** ociuhandu has joined #openstack-infra | 16:15 | |
| *** gyee has joined #openstack-infra | 16:16 | |
| *** iurygregory has quit IRC | 16:16 | |
| rajinir | Has something changed recently I see errors in the devstack installation ERROR: Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall. | 16:19 |
| *** iurygregory has joined #openstack-infra | 16:19 | |
| *** smarcet has joined #openstack-infra | 16:19 | |
| clarkb | rajinir: yes devstack stopped using old pip which has problems with pyyaml. https://review.opendev.org/#/c/703735/6 is the fix | 16:20 |
| *** lmiccini has quit IRC | 16:20 | |
| *** ociuhandu has quit IRC | 16:20 | |
| rajinir | Clarkb, thanks, good to know | 16:20 |
| openstackgerrit | Merged opendev/system-config master: Upgrade pip in python-builder and base https://review.opendev.org/703807 | 16:22 |
| *** dtantsur is now known as dtantsur|afk | 16:23 | |
| *** mattw4 has joined #openstack-infra | 16:24 | |
| openstackgerrit | sebastian marcet proposed opendev/puppet-openstackid master: Updated Build https://review.opendev.org/703834 | 16:25 |
| roman_g | clarkb: Wednesday, 1600UTC should work. Not 100%, but most probably this time would work. Monday and Tuesday don't work. | 16:26 |
| roman_g | clarkb: room number? | 16:29 |
| clarkb | roman_g: I'm tempted to try jitsi. I used it recently and it worked really well for what I was doing | 16:30 |
| roman_g | you want video and/or screen sharing? | 16:30 |
| *** tosky has quit IRC | 16:31 | |
| clarkb | roman_g: https://meet.jit.si/AirshipCICloudFun no, but the audio quality was really good when I used it | 16:31 |
| clarkb | mostly I want to kick the tires on it a bit as it is open source alternative to things like hangouts and zoom that we can point out to peolpe using those tools | 16:31 |
| clarkb | roman_g: and if ^ that fails for some reason we can fall back to the same pbx.o.o room 6001 we used last time | 16:32 |
| * roman_g doesn't like anything which requires registration | 16:32 | |
| clarkb | jitsi does not require registration | 16:32 |
| clarkb | so another win for it too :) | 16:32 |
| roman_g | clarkb: cool. thanks. | 16:33 |
| roman_g | OK, I'm sending an invite with this URL then | 16:33 |
| roman_g | confirm? | 16:33 |
| clarkb | ok | 16:33 |
| roman_g | ok | 16:33 |
| *** diablo_rojo has joined #openstack-infra | 16:34 | |
| *** armax has joined #openstack-infra | 16:35 | |
| roman_g | who clarkb | 16:36 |
| roman_g | oops. | 16:36 |
| roman_g | clarkb: who else is joining from Infra - fwd invite, please | 16:37 |
| clarkb | roman_g: I can, I'll also point it out in our meeting on tuesday | 16:38 |
| *** kjackal has quit IRC | 16:44 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 16:48 |
| *** bnemec has quit IRC | 16:51 | |
| *** ociuhandu has joined #openstack-infra | 16:56 | |
| frickler | rajinir: where did you see that failure? the patch clarkb mentioned is just a workaround, the real fix would be to make devstack not try to override system-installed libs | 16:56 |
| *** iurygregory has quit IRC | 16:57 | |
| *** rpittau is now known as rpittau|afk | 17:03 | |
| *** udesale has quit IRC | 17:05 | |
| *** lucasagomes has quit IRC | 17:07 | |
| *** mattw4 has quit IRC | 17:12 | |
| *** redrobot has joined #openstack-infra | 17:13 | |
| redrobot | Ohai infra friends! | 17:14 |
| redrobot | Is it just me, or are logs no longer readable on the zuul site? | 17:14 |
| redrobot | e.g. https://zuul.opendev.org/t/openstack/build/d3991fa044174c958b193f3933c6c46c/log/logs/devstacklog.txt.gz | 17:14 |
| clarkb | redrobot: it depends on the job. In order to have swift not mangle our foo.tar.gz files we had to start treating .gz files as actually compressed and not for direct consumption | 17:16 |
| clarkb | redrobot: otherwise when you download the tarballs you get back a tarfile instead. | 17:16 |
| clarkb | redrobot: what this means is jobs should stop compressing things that are not expected to be natively compressed. We will still compress on upload and storage but logically treat those entities as uncompressed allowing us to treat actually compressed files as compressed | 17:17 |
| clarkb | wow that was a mouth full | 17:17 |
| * clarkb digs up the openstack-discuss email on the subject | 17:17 | |
| redrobot | clarkb, ack, thanks! | 17:17 |
| clarkb | redrobot: in this case your job is likely a legacy devstack-gate job right? if you switch it to a native zuulv3 devstack job it should just work | 17:18 |
| * redrobot should probably stop using legacy jobs | 17:18 | |
| redrobot | haha, figured as much | 17:18 |
| clarkb | redrobot: http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html | 17:18 |
| redrobot | yeah, I have it on my to-do list to get those jobs updated | 17:18 |
| clarkb | redrobot: we likely would have just dealt with the pain around tarballs except that it was breaking release artifacts and those are important :) | 17:18 |
| *** mattw4 has joined #openstack-infra | 17:19 | |
| *** ociuhandu has quit IRC | 17:22 | |
| smcginnis | We had a release job failure. Looks like a git clone failure? | 17:23 |
| smcginnis | https://b3bb445b2ea48a53087f-684276f95d5c1a3d3bafd1fdb356229c.ssl.cf5.rackcdn.com/9bd0c0626b72da21c8ff563efb28e2321169de8c/release/propose-update-constraints/38926e7/job-output.txt | 17:23 |
| clarkb | that looks similar to the problems we noticed yesterday, but cacti doesn't seem to corroborate that happening today | 17:25 |
| smcginnis | Should we try to reenqueue that job and see if it was just a blip? | 17:26 |
| clarkb | smcginnis: let me try cloning requirements from here really quickly against all 8 backends | 17:26 |
| clarkb | smcginnis: why doesn't that job let zuul manage the repo for it? | 17:27 |
| *** sshnaidm is now known as sshnaidm|afk | 17:27 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add tags support for aws provider https://review.opendev.org/703651 | 17:27 |
| smcginnis | clarkb: I'm not sure. | 17:27 |
| smcginnis | Could be just old enough that that wasn't an option? | 17:27 |
| clarkb | well its always been an option :) that is what zuul does | 17:28 |
| clarkb | my hunch is this is a script yall run locally too? | 17:28 |
| clarkb | and so would need a switch between local and CI mode? | 17:29 |
| smcginnis | It probably started as a locally run script, then was moved into CI. | 17:29 |
| clarkb | aha I see why cacti isn't showing me data, its beacuse gitea04 is completely out to lunch | 17:30 |
| clarkb | I'm going to assume huawei again for now, but gitea04 is quite unhappy trying to ssh in | 17:30 |
| smcginnis | Memory issues again? | 17:30 |
| clarkb | right now its fine, but ya I think so | 17:31 |
| clarkb | yup confirmed dmesg shows it just OOM'd again | 17:31 |
| clarkb | ugh | 17:31 |
| clarkb | its seems to have recovered at this point | 17:31 |
| smcginnis | Maybe we should blacklist that source IP and see who complains. | 17:32 |
| clarkb | I'm going to kick off replication to it just to be sure it didn't lose any commits | 17:32 |
| clarkb | smcginnis: heh. That is certainly a possibility | 17:32 |
| clarkb | let me kick off replication then look at the logs again to try and confirm the same thing as yseterday happened | 17:32 |
| clarkb | (and if anyone knows anyone at huawei maybe we can start reaching out?) | 17:32 |
| *** harlowja has joined #openstack-infra | 17:33 | |
| *** smarcet has quit IRC | 17:33 | |
| *** evrardjp has quit IRC | 17:34 | |
| *** evrardjp has joined #openstack-infra | 17:34 | |
| clarkb | smcginnis: lets wait for replication to complete before retriggering the job just to be safe (it will probably take 15 minutes or so) | 17:35 |
| smcginnis | ++ | 17:36 |
| clarkb | yup confirmed huawei prefix is just over half the total number of connections this time | 17:38 |
| clarkb | with a similar number of connections too | 17:38 |
| clarkb | (though my time frame window may have shifted, I think this window is smaller because I have more concrete data of when via catching it in the act) | 17:38 |
| rajinir | <frickler> Our thirdparty Cis are failing. Dell Ironic CI | 17:40 |
| *** smarcet has joined #openstack-infra | 17:40 | |
| *** diablo_rojo has quit IRC | 17:42 | |
| *** jpena is now known as jpena|off | 17:48 | |
| openstackgerrit | Merged zuul/zuul master: tests: remove test_repo_repr https://review.opendev.org/703698 | 17:49 |
| *** Sundar has quit IRC | 17:50 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed zuul/zuul-jobs master: Add a markdownlint job and role https://review.opendev.org/607691 | 17:50 |
| noonedeadpunk | fungi: I think you can drop the hold 198.72.124.91 now - thanks for helping me:) | 17:51 |
| openstackgerrit | sebastian marcet proposed opendev/puppet-openstackid master: Updated Build https://review.opendev.org/703834 | 17:56 |
| *** derekh has quit IRC | 18:00 | |
| AJaeger | fungi, the cyborg py37 jobs - if they pass - also only need 4 minutes, so the building would not explain the timeout IMHO. | 18:00 |
| *** eharney has quit IRC | 18:03 | |
| *** jamesmcarthur has quit IRC | 18:05 | |
| *** jamesmcarthur has joined #openstack-infra | 18:06 | |
| fungi | AJaeger: i agree, just pointing it out as a possible reason why some py37 jobs may take (considerably) longer than their py36 or py35 equivalents | 18:06 |
| *** jamesmcarthur has quit IRC | 18:07 | |
| clarkb | I need to take a break for food, but replication has completed to gitea04 if someone can trigger that job for smcginnis | 18:07 |
| *** gfidente is now known as gfidente|afk | 18:11 | |
| fungi | roman_g: clarkb: i also worked out how to find the dial-in information for jitsi. if you go to the room url, click on the little circled "i" icon at the bottom-right of the browser | 18:13 |
| fungi | (regarding jitsimeet) | 18:13 |
| openstackgerrit | Merged openstack/devstack-gate master: Drop peakmem_tracker service https://review.opendev.org/703792 | 18:14 |
| *** smarcet has quit IRC | 18:15 | |
| *** eharney has joined #openstack-infra | 18:15 | |
| fungi | noonedeadpunk: thanks! i've released that node back into our available quota now | 18:16 |
| fungi | glad it was of some help | 18:16 |
| *** smarcet has joined #openstack-infra | 18:17 | |
| noonedeadpunk | yeah, it was actually veeery helpful! | 18:18 |
| *** diablo_rojo has joined #openstack-infra | 18:19 | |
| *** goldyfruit has quit IRC | 18:24 | |
| *** goldyfruit has joined #openstack-infra | 18:24 | |
| fungi | noonedeadpunk: out of curiosity, what did you discover which would have been tough to diagnose by adding more debugging in the job? | 18:32 |
| fungi | knowing use cases always helps us | 18:32 |
| noonedeadpunk | actually for some reason my sandbox vms were not spawning tempest jobs correctly. still not sure why this happened, but inside hold I get working config done without doing another several patches which passed tempest... | 18:34 |
| noonedeadpunk | I think it's some problem with my environment which I'll investigate | 18:34 |
| fungi | interesting | 18:34 |
| noonedeadpunk | yeah, actually this might be disabled nested virt as while comparing things I found that spawned by tempest vms were weird | 18:35 |
| noonedeadpunk | Or, maybe I just did wrong sandboxes (as that patch has lots of dependecies, so I could miss one) | 18:36 |
| *** jtomasek has quit IRC | 18:36 | |
| fungi | infra-puppet-core: i never can remember the rules for using classvars in default assignments for other classvars within the same class. does what's going on in https://review.opendev.org/703834 actually work? | 18:36 |
| *** jamesmcarthur has joined #openstack-infra | 18:38 | |
| *** aedc has joined #openstack-infra | 18:39 | |
| *** tesseract has quit IRC | 18:40 | |
| clarkb | fungi: I'm not finding any examples of us doing that. We do use vars in the default values from global scope though | 18:41 |
| fungi | yeah, for some reason i thought there was a problem with trying to evaluate a classvar within another classvar assignment | 18:43 |
| redrobot | Hmm... looks like we (barbican) are running into PyYAML errors mentioned in this patch: https://review.opendev.org/#/c/561597/ | 18:43 |
| redrobot | our tempest gate is broken because of it. :( | 18:43 |
| redrobot | is there a workaround we can implement? | 18:44 |
| ykarel|away | redrobot, possibly https://review.opendev.org/#/c/703735/ | 18:45 |
| redrobot | ykarel|away, I'll take a look, thanks! | 18:46 |
| *** hashar has joined #openstack-infra | 18:56 | |
| *** yamamoto has joined #openstack-infra | 18:59 | |
| *** smarcet has quit IRC | 18:59 | |
| *** jamesmcarthur has quit IRC | 19:00 | |
| *** yamamoto has quit IRC | 19:04 | |
| *** ralonsoh has quit IRC | 19:06 | |
| *** paladox is now known as paladox_UK_IN_EU | 19:09 | |
| *** paladox_UK_IN_EU is now known as paladox | 19:09 | |
| *** jtomasek has joined #openstack-infra | 19:10 | |
| *** jamesmcarthur has joined #openstack-infra | 19:13 | |
| smcginnis | fungi: Not sure if you saw the discussion earlier with clarkb, but we had a propose-update-constraints job fail due to an OOM on one of the gitea servers. | 19:13 |
| smcginnis | fungi: Is that something you can kick off again? | 19:14 |
| openstackgerrit | Merged zuul/nodepool master: Make flake8 config compatible with latest version https://review.opendev.org/703410 | 19:14 |
| openstackgerrit | Merged zuul/nodepool master: Handle event id in node requests https://review.opendev.org/703406 | 19:14 |
| *** paladox is now known as paladox_UK_IN_EU | 19:15 | |
| clarkb | smcginnis: I can probably get to it now | 19:17 |
| clarkb | I have to figure out how first though :P | 19:18 |
| clarkb | smcginnis: fungi `zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=release --project=openstack/tempest --ref=refs/tags/23.0.0 --newrev=9bd0c0626b72da21c8ff563efb28e2321169de8` that look correct to you? | 19:20 |
| smcginnis | clarkb: Looks right to me. | 19:21 |
| fungi | seems so. i usually just feed a failure inventory to the script in https://review.opendev.org/613676 | 19:25 |
| clarkb | I've run that command | 19:26 |
| clarkb | Next on my todo list is to write that email for roman_g and write a different email to huawei about the ddos | 19:26 |
| *** goldyfruit has quit IRC | 19:27 | |
| fungi | so much writing today | 19:27 |
| fungi | i feel like that's all i've been doing too | 19:27 |
| clarkb | fungi: since the beginning of the year seems like | 19:27 |
| fungi | yep | 19:27 |
| fungi | and before! | 19:27 |
| *** hashar has quit IRC | 19:30 | |
| *** smarcet has joined #openstack-infra | 19:30 | |
| *** hashar has joined #openstack-infra | 19:30 | |
| stevebaker | AJaeger: nice, I might post to os-discuss so other project know it is possible now | 19:33 |
| openstackgerrit | Merged zuul/nodepool master: Centralize logging adapters https://review.opendev.org/703407 | 19:34 |
| *** gmann is now known as gmann_afk | 19:38 | |
| *** smarcet has quit IRC | 19:39 | |
| *** jackedin has quit IRC | 19:40 | |
| smcginnis | clarkb, fungi: Sorry, I wasn't thinking. Only one of the jobs failed, but it's one that's only run on the tagging. Rerun of the tagging failed since the package is already uploaded to pypi, so it skipped the rest. | 19:43 |
| smcginnis | It's easy enough to manually propose. I was just thinking it would be good to rerun in CI to make sure we are all good for the next run, but simple enough to take care of. | 19:43 |
| smcginnis | Thanks for looking at the issue. | 19:43 |
| fungi | yeah, that's not going to work. what specifically needs to be done? | 19:43 |
| fungi | like, which job actually failed? | 19:44 |
| smcginnis | fungi: I just need to run the propose update script. | 19:44 |
| fungi | oh, for reqs? | 19:44 |
| smcginnis | propose-update-constraints | 19:44 |
| smcginnis | Yeah | 19:44 |
| fungi | yeah, manual is the wtg there | 19:44 |
| fungi | or just wait for the next periodic proposal | 19:44 |
| fungi | if it's non-urgent | 19:45 |
| smcginnis | Yeah, not sure. Think I'll just do it in case it is needed. | 19:45 |
| fungi | i'm popping out for a late lunch and some errands, but should be back in a couple hours if anybody needs me | 19:46 |
| *** goldyfruit has joined #openstack-infra | 19:48 | |
| *** paladox_UK_IN_EU is now known as paladox | 19:51 | |
| *** kjackal has joined #openstack-infra | 19:53 | |
| *** smarcet has joined #openstack-infra | 19:57 | |
| *** aedc has quit IRC | 20:01 | |
| *** aedc has joined #openstack-infra | 20:01 | |
| *** szaher has quit IRC | 20:03 | |
| *** eharney has quit IRC | 20:04 | |
| *** szaher has joined #openstack-infra | 20:09 | |
| *** gmann_afk is now known as gmann | 20:18 | |
| *** aedc has quit IRC | 20:19 | |
| *** aedc has joined #openstack-infra | 20:19 | |
| *** aedc_ has joined #openstack-infra | 20:25 | |
| *** aedc has quit IRC | 20:28 | |
| openstackgerrit | Antoine Musso proposed opendev/gear master: inline helps for interactive commands https://review.opendev.org/66591 | 20:32 |
| *** smarcet has quit IRC | 20:38 | |
| *** diablo_rojo has quit IRC | 20:38 | |
| *** jtomasek has quit IRC | 20:40 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add upload-logs-google role https://review.opendev.org/703711 | 20:48 |
| *** panda has quit IRC | 20:49 | |
| *** panda has joined #openstack-infra | 20:51 | |
| *** artom has quit IRC | 20:52 | |
| *** goldyfruit has quit IRC | 20:58 | |
| *** goldyfruit has joined #openstack-infra | 20:59 | |
| *** slaweq_ has joined #openstack-infra | 21:07 | |
| *** pcaruana has quit IRC | 21:07 | |
| *** kjackal has quit IRC | 21:08 | |
| *** goldyfruit has quit IRC | 21:15 | |
| *** goldyfruit has joined #openstack-infra | 21:16 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: kubernetes: add release note about service account token issue https://review.opendev.org/703869 | 21:21 |
| *** eharney has joined #openstack-infra | 21:23 | |
| *** diablo_rojo has joined #openstack-infra | 21:34 | |
| openstackgerrit | Merged zuul/zuul master: Fix Test Case "TestScheduler.test_timer_with_jitter" https://review.opendev.org/703749 | 21:40 |
| *** Lucas_Gray has joined #openstack-infra | 21:41 | |
| *** rcernin has joined #openstack-infra | 21:50 | |
| *** hashar has quit IRC | 21:51 | |
| *** hashar has joined #openstack-infra | 21:52 | |
| ianw | infra-root: if i could get some eyes on https://review.opendev.org/#/q/topic:linaro-us+(status:open+OR+status:merged) should add the linaro-us mirror, and i think it's probably ready for jobs | 21:52 |
| *** xek has quit IRC | 21:54 | |
| *** goldyfruit_ has joined #openstack-infra | 22:01 | |
| *** goldyfruit has quit IRC | 22:02 | |
| *** armax_ has joined #openstack-infra | 22:07 | |
| *** armax has quit IRC | 22:12 | |
| *** armax_ is now known as armax | 22:12 | |
| clarkb | ianw: looking | 22:13 |
| clarkb | also I just sent out a summary of the airship call | 22:13 |
| clarkb | roman_g: fungi ^ others that might be interested might want to double check I've not misconstrued anythin | 22:14 |
| *** gfidente|afk has quit IRC | 22:25 | |
| *** slaweq_ has quit IRC | 22:25 | |
| *** aedc_ has quit IRC | 22:26 | |
| *** dchen has quit IRC | 22:31 | |
| *** goldyfruit_ has quit IRC | 22:34 | |
| *** goldyfruit_ has joined #openstack-infra | 22:35 | |
| *** hashar has quit IRC | 22:37 | |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: WIP: Add estimated time remaining tooltip to UI https://review.opendev.org/703892 | 22:39 |
| *** goldyfruit has joined #openstack-infra | 22:41 | |
| *** goldyfruit_ has quit IRC | 22:42 | |
| *** bdodd has quit IRC | 22:43 | |
| *** jamesmcarthur has quit IRC | 22:44 | |
| clarkb | ianw: if I want to set mount options for / in DIB it seems I need to use the newish yaml tree structure. What isn't clear to me is if I can set those options via a standalone - fstab entry or if I have to define the whole stack to get partitions, filesystems, mounts, and fstab ? | 22:53 |
| ianw | hrm, this is not the first time this sort of thing has come up, it was similar with journal flags for mkfs | 22:54 |
| clarkb | it seems mkfs_root may be a magicaly node name I can set as base | 22:55 |
| ianw | we have a bunch of magic flags that get merged in to the default configuration | 22:56 |
| ianw | MKFS_OPTS | 22:56 |
| clarkb | well these would be mount time options not mkfs options | 22:57 |
| ianw | yeah, i think the root cause is the same though, that you can't really pass it through | 22:58 |
| ianw | what you're saying, that you need a complete .yaml file, is the case | 22:59 |
| clarkb | oh hrm | 22:59 |
| *** Lucas_Gray has quit IRC | 23:00 | |
| clarkb | oh I see ya it bails out early if you supply the config and won't use the default in that case | 23:00 |
| clarkb | for a half second I thought it would merge them | 23:00 |
| fungi | ianw: https://review.opendev.org/703802 is a trivial fix for the wheel cache jobs we've been discussing weekly, if you have a moment to confirm my shame | 23:00 |
| ianw | clarkb: ... zuul has yaml merging functions, right ... | 23:00 |
| fungi | er, s/weekly/lately/ | 23:01 |
| clarkb | ianw: uh maybe? | 23:01 |
| ianw | clarkb: if that were extracted, and we somehow flagged a file as being for merge, that might solve a few issues. i don't think we considered this approach in prior discussions | 23:02 |
| *** Lucas_Gray has joined #openstack-infra | 23:02 | |
| fungi | i don't know of any generic "yaml merging" feature in zuul, just that it knows to combine elements for certain associative arrays | 23:04 |
| fungi | you can't blindly concatenate yaml documents with pyyaml because of how it handles duplicate keys | 23:05 |
| fungi | but zuul's not operating directly on serialized yaml afaik, only on python objects which resulted from parsing yaml | 23:06 |
| *** tkajinam has joined #openstack-infra | 23:07 | |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Set root mount options on debian buster image https://review.opendev.org/703895 | 23:07 |
| ianw | fungi: wheel LGTM; i'll trade you for https://review.opendev.org/#/c/702579/ :) which adds centos8 openafs client jobs, so we can build wheels there too | 23:07 |
| fungi | lookin' | 23:07 |
| clarkb | ianw: fungi ^ is roughyl what I am trying to do. I copied what I think is the default config for block device element and the modified it with the optionschanges | 23:07 |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: WIP: Add estimated time remaining tooltip to UI https://review.opendev.org/703892 | 23:07 |
| clarkb | then apply it only to debian buster as a first step to limit blast redius | 23:07 |
| ianw | "Additionally, the nobarrier option should never be used on storage configured on virtual machines. " | 23:10 |
| fungi | ...for reasons which matter to us? | 23:11 |
| fungi | (on ephemeral test nodes) | 23:11 |
| ianw | yeah, i dunno ... that is old https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/storage_administration_guide/writebarrieronoff | 23:11 |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Set root mount options on debian buster image https://review.opendev.org/703895 | 23:12 |
| clarkb | ianw: oh interesting. Also I figured out what the actual config we used is and modified that in new ps ^ | 23:12 |
| fungi | like, if it's because there might be data loss on an unexpected hard reboot... | 23:12 |
| clarkb | and honestly I'll take a 3% performance boost at this point :/ | 23:13 |
| clarkb | I wish that wasn't the case but IO seems to be killing us | 23:13 |
| fungi | on the other hand, if it results in data loss while the machine is running or following a graceful reboot, it could destabilize jobs | 23:13 |
| fungi | ianw: clarkb noted a possibly misleading typo for a task name in 702579 | 23:14 |
| fungi | not sure if you want to fix that before i approve | 23:14 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: openafs-client: add centos8 https://review.opendev.org/702579 | 23:14 |
| clarkb | fwiw I'm happy to only set noatime to start and prove that this works | 23:14 |
| clarkb | in general I actually kinda like being explicit about this as we'll be able to switch to lvm and gpt and all that at our own speed if we do that | 23:15 |
| openstackgerrit | Merged openstack/project-config master: Correct LOGS path in wheel build script https://review.opendev.org/703802 | 23:15 |
| clarkb | (though maybe we won't ever lvm) | 23:15 |
| ianw | i'm not that fussed; what do upstream cloud images do? | 23:19 |
| *** smarcet has joined #openstack-infra | 23:19 | |
| clarkb | I haven't checked those, but that is a good question | 23:19 |
| * clarkb finds an ubuntu cloud image | 23:19 | |
| *** smarcet has quit IRC | 23:20 | |
| *** pkopec has quit IRC | 23:21 | |
| *** rlandy is now known as rlandy|bbl | 23:22 | |
| ianw | heh, i only have a rhel guest image, and then realised it's xfs ... maybe that's an option too | 23:22 |
| clarkb | the downside to xfs is you can't thin provision files on it | 23:22 |
| clarkb | which admittedly also has problems with it but speeds up some aspects of certain jobs | 23:23 |
| clarkb | of course if the aggregate is slower then a switch might be good | 23:23 |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: WIP: Add estimated time remaining tooltip to UI https://review.opendev.org/703892 | 23:26 |
| ianw | is there some other way to start a shell with a kerberos ticket other than kstart that is more widely used? | 23:27 |
| ianw | i wonder why the epel8 build for it hasn't got any traction, i'd think people use it a lot | 23:28 |
| *** auristor has quit IRC | 23:34 | |
| *** hwoarang has quit IRC | 23:38 | |
| fungi | kinit | 23:40 |
| fungi | along with aklog | 23:41 |
| fungi | though doing that inside a temporary pagsh is preferred to avoid leaking credentials | 23:41 |
| clarkb | LABEL=cloudimg-rootfs>--/>------ ext4>--defaults>-------0 0 is how ubuntu's official cloud image mounts / | 23:42 |
| clarkb | er those >---'s are vim showing me tabs | 23:42 |
| clarkb | so our config is pretty similar | 23:42 |
| *** hwoarang has joined #openstack-infra | 23:45 | |
| *** auristor has joined #openstack-infra | 23:45 | |
| ianw | fungi: so do you think we should change our scripts and reduce our dependency on it? is there a particular reason we use kstart? | 23:47 |
| ianw | we don't really run daemons, as such | 23:47 |
| *** diablo_rojo has quit IRC | 23:51 | |
| *** mattw4 has quit IRC | 23:51 | |
| *** dchen has joined #openstack-infra | 23:53 | |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: Add estimated time remaining tooltip to UI https://review.opendev.org/703892 | 23:55 |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: Add estimated time remaining tooltip to UI https://review.opendev.org/703892 | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!