*** dychen has joined #openstack-infra | 00:02 | |
*** yamamoto has quit IRC | 00:02 | |
*** diablo_rojo has joined #openstack-infra | 00:09 | |
*** yamamoto has joined #openstack-infra | 00:12 | |
*** dchen has quit IRC | 00:13 | |
*** dchen has joined #openstack-infra | 00:14 | |
*** ricolin has joined #openstack-infra | 00:32 | |
*** yamamoto has quit IRC | 00:36 | |
*** jamesmcarthur has joined #openstack-infra | 00:41 | |
*** jamesmcarthur has quit IRC | 00:48 | |
*** jamesmcarthur has joined #openstack-infra | 00:49 | |
*** diablo_rojo has quit IRC | 00:49 | |
*** yamamoto has joined #openstack-infra | 00:50 | |
*** diablo_rojo has joined #openstack-infra | 00:50 | |
*** diablo_rojo has quit IRC | 00:51 | |
*** diablo_rojo has joined #openstack-infra | 00:52 | |
*** jamesmcarthur has quit IRC | 00:54 | |
*** jamesmcarthur has joined #openstack-infra | 00:55 | |
*** dychen has quit IRC | 01:01 | |
*** jamesmcarthur has quit IRC | 01:10 | |
*** jamesmcarthur has joined #openstack-infra | 01:11 | |
*** jamesmcarthur has quit IRC | 01:16 | |
*** jamesmcarthur has joined #openstack-infra | 01:21 | |
*** yamamoto has quit IRC | 01:31 | |
*** yamamoto has joined #openstack-infra | 01:34 | |
*** ykarel|away has joined #openstack-infra | 01:55 | |
*** diablo_rojo has quit IRC | 02:00 | |
*** jamesmcarthur has quit IRC | 02:02 | |
*** tkajinam_ has joined #openstack-infra | 02:06 | |
*** tkajinam has quit IRC | 02:09 | |
*** yamamoto has quit IRC | 02:24 | |
*** yamamoto has joined #openstack-infra | 02:28 | |
*** auristor has quit IRC | 02:32 | |
*** yamamoto has quit IRC | 02:45 | |
*** markvoelker has joined #openstack-infra | 02:46 | |
*** dychen has joined #openstack-infra | 02:49 | |
*** dychen has quit IRC | 02:50 | |
*** auristor has joined #openstack-infra | 02:53 | |
*** yamamoto has joined #openstack-infra | 03:38 | |
*** bradm has quit IRC | 03:38 | |
*** yamamoto has quit IRC | 03:42 | |
*** yamamoto has joined #openstack-infra | 03:44 | |
*** jamesmcarthur has joined #openstack-infra | 03:45 | |
*** psachin has joined #openstack-infra | 03:55 | |
*** dciabrin_ has quit IRC | 04:04 | |
*** udesale has joined #openstack-infra | 04:04 | |
*** toabctl has joined #openstack-infra | 04:07 | |
*** jamesmcarthur has quit IRC | 04:14 | |
*** whoami-rajat has joined #openstack-infra | 04:24 | |
*** ociuhandu has joined #openstack-infra | 04:30 | |
*** ociuhandu has quit IRC | 04:35 | |
*** ykarel|away has quit IRC | 04:36 | |
*** jtomasek has quit IRC | 04:36 | |
AJaeger | ianw: ^ | 04:43 |
---|---|---|
AJaeger | config-core, please review https://review.opendev.org/679806 https://review.opendev.org/684374 and https://review.opendev.org/684124 https://review.opendev.org/681270 | 04:44 |
*** ykarel|away has joined #openstack-infra | 04:53 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [wip] pip-and-virtualenv : deprecate source for CentOS 8, new variables https://review.opendev.org/684462 | 05:01 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fix networking for CentOS 8 https://review.opendev.org/684513 | 05:01 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: CentOS 8 minimal testing and support https://review.opendev.org/684860 | 05:01 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: WIP: CentOS 8 support https://review.opendev.org/684308 | 05:01 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [wip] simple-init: Use wrappers to call pip for glean install https://review.opendev.org/685643 | 05:01 |
*** markvoelker has quit IRC | 05:02 | |
*** jaosorior has joined #openstack-infra | 05:03 | |
*** pcaruana has joined #openstack-infra | 05:24 | |
*** dpawlik has joined #openstack-infra | 05:28 | |
*** pcaruana has quit IRC | 05:30 | |
*** soniya29 has joined #openstack-infra | 05:31 | |
*** raukadah is now known as chandankumar | 05:33 | |
*** janki has joined #openstack-infra | 05:35 | |
*** yamamoto has quit IRC | 05:38 | |
*** yamamoto has joined #openstack-infra | 05:57 | |
*** markvoelker has joined #openstack-infra | 05:58 | |
*** dpawlik has quit IRC | 06:01 | |
*** kjackal has joined #openstack-infra | 06:02 | |
*** markvoelker has quit IRC | 06:02 | |
*** iurygregory has quit IRC | 06:04 | |
*** soniya29 has quit IRC | 06:04 | |
*** soniya29 has joined #openstack-infra | 06:05 | |
openstackgerrit | Merged openstack/project-config master: Use iptables for openSUSE https://review.opendev.org/683236 | 06:05 |
*** soniya29 has quit IRC | 06:12 | |
*** soniya29 has joined #openstack-infra | 06:15 | |
*** jamesmcarthur has joined #openstack-infra | 06:16 | |
*** jtomasek has joined #openstack-infra | 06:17 | |
*** jamesmcarthur has quit IRC | 06:20 | |
openstackgerrit | Masayuki Igawa proposed openstack/hacking master: Add PDF documentation build https://review.opendev.org/685655 | 06:22 |
*** slaweq has joined #openstack-infra | 06:23 | |
*** soniya29 has quit IRC | 06:28 | |
*** dpawlik has joined #openstack-infra | 06:29 | |
*** soniya29 has joined #openstack-infra | 06:30 | |
*** ykarel|away is now known as ykarel | 06:31 | |
*** pgaxatte has joined #openstack-infra | 06:38 | |
*** whoami-rajat has quit IRC | 06:39 | |
*** pcaruana has joined #openstack-infra | 06:41 | |
*** bradm has joined #openstack-infra | 06:48 | |
*** pgaxatte has quit IRC | 06:58 | |
*** pgaxatte has joined #openstack-infra | 07:00 | |
*** iurygregory has joined #openstack-infra | 07:01 | |
*** whoami-rajat has joined #openstack-infra | 07:01 | |
openstackgerrit | Simon Westphahl proposed zuul/zuul master: Add optional support for circular dependencies https://review.opendev.org/685354 | 07:05 |
*** kopecmartin has joined #openstack-infra | 07:05 | |
*** jtomasek has quit IRC | 07:06 | |
*** jtomasek has joined #openstack-infra | 07:07 | |
*** pkopec has joined #openstack-infra | 07:13 | |
*** rcernin has quit IRC | 07:14 | |
*** tesseract has joined #openstack-infra | 07:17 | |
*** e0ne has quit IRC | 07:19 | |
openstackgerrit | Simon Westphahl proposed zuul/zuul master: Add optional support for circular dependencies https://review.opendev.org/685354 | 07:19 |
*** jchhatbar has joined #openstack-infra | 07:23 | |
*** arxcruz|zzz is now known as arxcruz|ruck | 07:25 | |
*** janki has quit IRC | 07:25 | |
*** jpena|off is now known as jpena | 07:29 | |
*** iurygregory has quit IRC | 07:34 | |
openstackgerrit | Masayuki Igawa proposed openstack/hacking master: Add PDF documentation build https://review.opendev.org/685655 | 07:36 |
*** tesseract has quit IRC | 07:43 | |
*** tesseract has joined #openstack-infra | 07:43 | |
*** surpatil has joined #openstack-infra | 07:45 | |
*** dpawlik has quit IRC | 07:45 | |
*** rpittau|afk is now known as rpittau | 07:52 | |
*** soniya29 has quit IRC | 07:53 | |
*** ykarel is now known as ykarel|lunch | 07:53 | |
*** markvoelker has joined #openstack-infra | 08:00 | |
*** ralonsoh has joined #openstack-infra | 08:00 | |
*** tkajinam_ has quit IRC | 08:00 | |
*** dpawlik has joined #openstack-infra | 08:04 | |
*** markvoelker has quit IRC | 08:04 | |
*** iurygregory has joined #openstack-infra | 08:11 | |
*** dchen has quit IRC | 08:14 | |
*** xek has joined #openstack-infra | 08:23 | |
*** dtantsur|afk is now known as dtantsur | 08:24 | |
openstackgerrit | Merged openstack/project-config master: Update Networking OVN failure rate dashboard https://review.opendev.org/684124 | 08:25 |
*** xenos76 has joined #openstack-infra | 08:26 | |
*** e0ne has joined #openstack-infra | 08:31 | |
*** derekh has joined #openstack-infra | 08:38 | |
*** dpawlik has quit IRC | 08:39 | |
*** georgk5 has quit IRC | 08:41 | |
*** georgk has joined #openstack-infra | 08:41 | |
*** ykarel|lunch is now known as ykarel | 08:43 | |
*** yamamoto has quit IRC | 08:44 | |
openstackgerrit | Simon Westphahl proposed zuul/zuul master: Add optional support for circular dependencies https://review.opendev.org/685354 | 08:53 |
*** soniya29 has joined #openstack-infra | 08:54 | |
*** dpawlik has joined #openstack-infra | 08:59 | |
*** dpawlik has quit IRC | 09:04 | |
*** tosky has joined #openstack-infra | 09:10 | |
*** dpawlik has joined #openstack-infra | 09:13 | |
*** ricolin has quit IRC | 09:13 | |
*** smcginnis has quit IRC | 09:14 | |
*** yamamoto has joined #openstack-infra | 09:19 | |
openstackgerrit | Merged zuul/zuul-jobs master: Use iptables for openSUSE https://review.opendev.org/685491 | 09:21 |
*** zbr is now known as zbr|ruck | 09:24 | |
*** yamamoto has quit IRC | 09:24 | |
*** tobiash has quit IRC | 09:27 | |
*** tobiash has joined #openstack-infra | 09:29 | |
*** dpawlik has quit IRC | 09:29 | |
*** dpawlik has joined #openstack-infra | 09:48 | |
*** odicha has quit IRC | 09:48 | |
*** yamamoto has joined #openstack-infra | 09:49 | |
*** ociuhandu has joined #openstack-infra | 09:52 | |
*** gfidente has joined #openstack-infra | 09:55 | |
*** odicha has joined #openstack-infra | 09:56 | |
*** aedc has quit IRC | 10:04 | |
*** yamamoto has quit IRC | 10:13 | |
*** gfidente has quit IRC | 10:16 | |
*** tosky has quit IRC | 10:17 | |
*** tosky has joined #openstack-infra | 10:18 | |
*** soniya29 has quit IRC | 10:26 | |
*** soniya29 has joined #openstack-infra | 10:26 | |
*** dciabrin_ has joined #openstack-infra | 10:28 | |
openstackgerrit | Simon Westphahl proposed zuul/zuul master: Add optional support for circular dependencies https://review.opendev.org/685354 | 10:32 |
*** ociuhandu has quit IRC | 10:40 | |
frickler | infra-root: exim strikes again https://exim.org/static/doc/security/CVE-2019-16928.txt | 10:44 |
*** yamamoto has joined #openstack-infra | 10:46 | |
*** yamamoto has quit IRC | 10:52 | |
*** ociuhandu has joined #openstack-infra | 10:53 | |
*** ricolin has joined #openstack-infra | 10:54 | |
frickler | oh, I misread the affected versions, that's >=4.92 only, so bionic with 4.90 not affected | 10:56 |
*** dchen has joined #openstack-infra | 10:57 | |
*** jchhatbar has quit IRC | 11:00 | |
*** yamamoto has joined #openstack-infra | 11:01 | |
*** markvoelker has joined #openstack-infra | 11:01 | |
*** yamamoto_ has joined #openstack-infra | 11:03 | |
*** markvoelker has quit IRC | 11:06 | |
*** yamamoto has quit IRC | 11:07 | |
zbr|ruck | out of curiosity, can we do somethign about the log urls which became very unfriendly (long)? auth in url, non standard ports... example https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_341/685466/1/gate/tripleo-ci-centos-7-containers-multinode/34175b4/job-output.txt | 11:09 |
zbr|ruck | soon they will no longer fit in a single irc message | 11:10 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: WIP - gitlab - bootstrap the driver structure + Webhook support https://review.opendev.org/685682 | 11:10 |
*** chandankumar is now known as raukadah | 11:11 | |
*** gfidente has joined #openstack-infra | 11:12 | |
*** udesale has quit IRC | 11:13 | |
fungi | zbr|ruck: switch to sharing the log view from zuul's build results interface? like https://zuul.opendev.org/t/openstack/build/34175b4984fa4c70b5dc11ad9dc1b6e9/log/job-output.txt | 11:25 |
zbr|ruck | fungi: the build failures are almost never on the job-output log, so you do need to browse the logs. | 11:26 |
*** odicha has quit IRC | 11:27 | |
fungi | well, you linked job-output.txt in your example, but the log viewer can browse to whatever you want | 11:27 |
zbr|ruck | fungi: ok, i wil be back a this, now i got pinged by ruck dufy... :( | 11:28 |
zbr|ruck | duty | 11:28 |
*** rcernin has joined #openstack-infra | 11:28 | |
fungi | example: https://zuul.opendev.org/t/openstack/build/34175b4984fa4c70b5dc11ad9dc1b6e9/log/logs/delorean_logs/20/e6/20e69383e10878e38a0944e2f1d0514269500e2c_dev/rpmbuild.log.txt.gz | 11:31 |
*** jpena is now known as jpena|lunch | 11:31 | |
*** ociuhandu has quit IRC | 11:35 | |
*** ociuhandu has joined #openstack-infra | 11:36 | |
*** smarcet has joined #openstack-infra | 11:37 | |
openstackgerrit | Feruzjon Muyassarov proposed openstack/project-config master: Create a project for Airship go-redfish client https://review.opendev.org/685688 | 11:37 |
*** ianychoi has quit IRC | 11:39 | |
*** xek has quit IRC | 11:39 | |
*** xek_ has joined #openstack-infra | 11:39 | |
*** odicha has joined #openstack-infra | 11:39 | |
*** ianychoi has joined #openstack-infra | 11:40 | |
*** weshay has joined #openstack-infra | 11:43 | |
openstackgerrit | Feruzjon Muyassarov proposed openstack/project-config master: Add airship/go-redfish project https://review.opendev.org/685688 | 11:55 |
*** yamamoto_ has quit IRC | 11:59 | |
*** kjackal_v2 has joined #openstack-infra | 12:04 | |
*** kjackal has quit IRC | 12:07 | |
*** goldyfruit has quit IRC | 12:18 | |
*** yamamoto has joined #openstack-infra | 12:24 | |
*** yamamoto has quit IRC | 12:26 | |
*** jamesmcarthur has joined #openstack-infra | 12:26 | |
*** otherwiseguy_ is now known as otherwiseguy | 12:28 | |
*** jpena|lunch is now known as jpena | 12:30 | |
ykarel | Are there some mirror issues in ovh? | 12:31 |
ykarel | i see error in our job related to it | 12:33 |
ykarel | example:- https://5e6d48fe25fecf1b2eda-cc994f454b3da94a07b55a097da7db60.ssl.cf5.rackcdn.com/685393/5/check/puppet-openstack-integration-5-scenario001-tempest-centos-7-luminous/0abbb26/job-output.txt | 12:33 |
*** rfolco has joined #openstack-infra | 12:33 | |
ykarel | ttp://mirror.bhs1.ovh.openstack.org:8080/buildlogs.centos/centos/7/storage/x86_64/ceph-luminous/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable | 12:33 |
ykarel | also seeing with http://mirror.gra1.ovh.openstack.org:8080/rdo, may be issues are there with more servers | 12:33 |
*** jamesmcarthur has quit IRC | 12:35 | |
*** smarcet has quit IRC | 12:37 | |
openstackgerrit | Feruzjon Muyassarov proposed openstack/project-config master: Add airship/go-redfish project - Jira Issue https://airship.atlassian.net/browse/AIR-169 - The go-redfish library is currently hosted on github.com/Nordix/go-redfish Change-Id: Ic04eb2f1f631ae84556437425e1c3ed84c8804d5 https://review.opendev.org/685688 | 12:40 |
openstackgerrit | Feruzjon Muyassarov proposed openstack/project-config master: Add airship/go-redfish project https://review.opendev.org/685688 | 12:42 |
*** odicha has quit IRC | 12:44 | |
*** Goneri has joined #openstack-infra | 12:44 | |
*** odicha has joined #openstack-infra | 12:45 | |
fungi | ykarel: those aren't really mirrors, just caching proxies. generally if they're returning a 503 it means that there was some problem reaching the real services they're proxying | 12:45 |
ykarel | fungi, so from above two logs, one was returning 503, and other returning 404 Not found for some packages | 12:46 |
fungi | if the official sites for buildlogs.centos and rdo are served from the same network, then maybe it's not reachable from there | 12:46 |
fungi | ahh, 404 would generally indicate that it did reach the backend and the backend said that file wasn't available/existent | 12:47 |
fungi | currently http://mirror.bhs1.ovh.openstack.org:8080/buildlogs.centos/centos/7/storage/x86_64/ceph-luminous/repodata/repomd.xml is returning content, so seems it's able to fetch it now | 12:48 |
fungi | http://mirror.gra1.ovh.openstack.org:8080/rdo/ is also returning content, not sure what subpath was giving you a 404 though | 12:49 |
*** rcernin has quit IRC | 12:50 | |
* ykarel checks | 12:50 | |
*** aaronsheffield has joined #openstack-infra | 12:52 | |
ykarel | fungi, 404 was with packages in same repo:- http://mirror.gra1.ovh.openstack.org:8080/buildlogs.centos/centos/7/storage/x86_64/ceph-luminous/ | 12:57 |
ykarel | https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_702/685393/5/check/puppet-openstack-integration-5-scenario003-tempest-centos-7/7028141/logs/puppet.txt.gz | 12:58 |
*** dtantsur is now known as dtantsur|afk | 12:58 | |
*** dklyle has quit IRC | 13:00 | |
*** markvoelker has joined #openstack-infra | 13:02 | |
fungi | ahh, okay, so buildlogs.centos again, but from an entirely different provider that time | 13:03 |
fungi | i don't see a 404 in that puppet.txt.gz log | 13:04 |
*** markvoelker has quit IRC | 13:06 | |
*** smarcet has joined #openstack-infra | 13:10 | |
*** dave-mccowan has joined #openstack-infra | 13:16 | |
*** goldyfruit has joined #openstack-infra | 13:18 | |
*** yamamoto has joined #openstack-infra | 13:22 | |
*** mriedem has joined #openstack-infra | 13:25 | |
*** smarcet has quit IRC | 13:27 | |
*** whoami-rajat has quit IRC | 13:29 | |
*** smarcet has joined #openstack-infra | 13:30 | |
*** sthussey has joined #openstack-infra | 13:30 | |
*** soniya29 has quit IRC | 13:31 | |
*** yamamoto has quit IRC | 13:33 | |
*** dpawlik has quit IRC | 13:36 | |
*** roman_g has joined #openstack-infra | 13:41 | |
*** bdodd has joined #openstack-infra | 13:43 | |
*** dklyle has joined #openstack-infra | 13:43 | |
*** dklyle has quit IRC | 13:48 | |
*** david-lyle has joined #openstack-infra | 13:48 | |
*** munimeha1 has joined #openstack-infra | 13:49 | |
*** rosmaita has joined #openstack-infra | 13:50 | |
*** odicha has quit IRC | 13:52 | |
AJaeger | pabelanger: please review https://review.opendev.org/685615 and dependencies | 13:54 |
*** jamesdenton has quit IRC | 13:54 | |
clarkb | fungi: I agree the error in that last log paste appears to be related to sql connection details missing | 13:58 |
*** ociuhandu has quit IRC | 13:58 | |
clarkb | as for debugging proxy connectivity my process tends to be: 1) fetch url on mirror and confirm it is not working 2) construct url for backend direct access and check if that also fails. 3a) if 2) fails then problem is with backend, report it upstream as able 3b) if backend works check network connectivity between mirror and backend | 13:59 |
*** redrobot has joined #openstack-infra | 13:59 | |
clarkb | as fungi mentions that 3a) case is likely to produce 404s the whole way through whereas 3b will be 500s of some sort | 14:00 |
openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Testing templates in templates... https://review.opendev.org/685716 | 14:03 |
AJaeger | frickler: I doubt this works as you suggested, but let's give it a try ^ | 14:03 |
AJaeger | clarkb: good morning, ianw flagged https://review.opendev.org/683431 for PTL review if you want to tackle it at some point. it adds a special nested label for VMs. | 14:04 |
pabelanger | AJaeger: what is the opendev docs process? Given that windmill isn't openstack, I'm unsure if we want to depend on that job? | 14:04 |
pabelanger | also, maybe it should be moved into opendev tenant | 14:04 |
openstackgerrit | David Shrewsbury proposed zuul/zuul-website master: Revert "CSS fix for ul/li in FAQ" https://review.opendev.org/685717 | 14:04 |
*** jamesdenton has joined #openstack-infra | 14:06 | |
AJaeger | pabelanger: there's opendev-tox-docs - but no template. | 14:06 |
pabelanger | okay, let me poke into that and see | 14:06 |
pabelanger | I can do that this week | 14:06 |
AJaeger | thanks, pabelanger | 14:07 |
*** smcginni1 has joined #openstack-infra | 14:08 | |
*** adriant has quit IRC | 14:09 | |
*** iokiwi has quit IRC | 14:09 | |
*** dchen has quit IRC | 14:09 | |
*** smcginni1 is now known as smcginnis_ | 14:11 | |
*** iokiwi has joined #openstack-infra | 14:12 | |
frickler | AJaeger: o.k., thanks for testing that | 14:14 |
openstackgerrit | Merged zuul/zuul-website master: Revert "CSS fix for ul/li in FAQ" https://review.opendev.org/685717 | 14:17 |
*** pcaruana has quit IRC | 14:18 | |
AJaeger | config-core, please review https://review.opendev.org/679806 https://review.opendev.org/684374 and https://review.opendev.org/681270 | 14:21 |
openstackgerrit | Merged openstack/openstack-zuul-jobs master: Add Python3 project templates for Ussuri release https://review.opendev.org/685453 | 14:21 |
*** pgaxatte has quit IRC | 14:32 | |
*** Lucas_Gray has joined #openstack-infra | 14:32 | |
*** ociuhandu has joined #openstack-infra | 14:33 | |
openstackgerrit | Matt Riedemann proposed opendev/elastic-recheck master: Generalize query for bug 1808010 https://review.opendev.org/685725 | 14:35 |
mriedem | clarkb: ^ | 14:35 |
openstack | bug 1808010 in OpenStack Compute (nova) "Tempest cirros ssh setup fails due to lack of disk space causing config-drive setup to fail forcing fallback to metadata server which fails due to hitting 10 second timeout." [Medium,Confirmed] https://launchpad.net/bugs/1808010 | 14:35 |
*** diablo_rojo has joined #openstack-infra | 14:46 | |
*** smcginnis_ is now known as smcginnis | 14:46 | |
*** surpatil has quit IRC | 14:48 | |
*** brtknr has joined #openstack-infra | 14:48 | |
*** slaweq has quit IRC | 14:48 | |
brtknr | hey all | 14:48 |
brtknr | just wondering if anyone know about why these jobs are failing: https://review.opendev.org/#/c/685620/ | 14:50 |
*** slaweq has joined #openstack-infra | 14:50 | |
brtknr | the changes are yaml file changes... so effectively a noop | 14:50 |
brtknr | the same jobs are passing locally | 14:50 |
*** goldyfruit_ has joined #openstack-infra | 14:51 | |
clarkb | my suggestion here will be the same as in #openstack-qa. There isn't enough information logged by the individual test cases to understand why they are failing. You will likely need to add that logging so that we can determine the case of failure then go from there | 14:51 |
clarkb | it appears that http requests are failing because the webserver isn't running | 14:52 |
clarkb | if we can get logs from the webserver that will likely help a lot | 14:52 |
brtknr | clarkb: if you look at the py36 results, the error is "BlockingIOError: [Errno 11] write could not complete without blocking" | 14:52 |
*** goldyfruit has quit IRC | 14:53 | |
brtknr | only in py27, it is "Resource temporarily unavailable"... | 14:53 |
clarkb | ok so your file is opened for asyncio and raises and exception if it would block? if that is the acse then you'll need to handle blocking there | 14:54 |
openstackgerrit | Merged opendev/elastic-recheck master: Generalize query for bug 1808010 https://review.opendev.org/685725 | 14:55 |
openstack | bug 1808010 in OpenStack Compute (nova) "Tempest cirros ssh setup fails due to lack of disk space causing config-drive setup to fail forcing fallback to metadata server which fails due to hitting 10 second timeout." [Medium,Confirmed] https://launchpad.net/bugs/1808010 | 14:55 |
clarkb | also is the unittest job running linter checks? | 14:57 |
clarkb | (might be a good idea to move those into the linter job?) | 14:57 |
clarkb | brtknr: looks like this is happening with print() function calls so stdout would block | 14:59 |
clarkb | I don't see magnum replacing stdout with a iostring fixture like many of the other unittests do. Its possible that the actual stdout buffer is filling as a result | 15:00 |
brtknr | clarkb: could you show me an example? | 15:01 |
brtknr | the same tests were working on 26/09... they've been broken since 27/09... not a lot has changed on our end | 15:02 |
*** markvoelker has joined #openstack-infra | 15:02 | |
brtknr | clarkb: here's an example of a PS which passed on 26/09 and fails on 30/09: https://review.opendev.org/#/c/675511/ | 15:03 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 15:03 |
clarkb | brtknr: note if it is due to the system stdout buffer filling then it could just be a timing/performance issue | 15:04 |
brtknr | clarkb: could you translate that for me please? | 15:04 |
*** iurygregory has quit IRC | 15:05 | |
clarkb | stdout is provided to a process by the operating system. Depending on where the operating system is running you will get different performance and timing of the job and stdout handling. If the timing lines up on certain test instances such that the buffer is full and would require blocking you may see that only on some test runs | 15:06 |
*** roman_g has quit IRC | 15:07 | |
clarkb | brtknr: https://opendev.org/openstack/nova/src/branch/master/nova/tests/fixtures.py#L206-L231 is the fixture definition and https://opendev.org/openstack/nova/src/branch/master/nova/test.py#L222-L223 is where it gets used | 15:09 |
clarkb | brtknr: what nova is doing there is replacing stdout provided by the operating system with one that is process internal so that the data can be captured without interleaving streams when stestr runs the tests in parallel | 15:10 |
openstackgerrit | Merged zuul/zuul master: Support nodes setting 'auto' python-path https://review.opendev.org/682275 | 15:18 |
*** Jeffrey4l has quit IRC | 15:19 | |
*** ykarel is now known as ykarel|afk | 15:20 | |
*** Jeffrey4l has joined #openstack-infra | 15:20 | |
openstackgerrit | Merged zuul/zuul master: Annotate cancelJobInQueue with build id https://review.opendev.org/684373 | 15:25 |
brtknr | clarkb: ive added an output stream fixture: https://review.opendev.org/685735 | 15:26 |
*** gyee has joined #openstack-infra | 15:30 | |
*** mattw4 has joined #openstack-infra | 15:33 | |
*** eernst has joined #openstack-infra | 15:33 | |
*** jcoufal has joined #openstack-infra | 15:34 | |
*** eernst has quit IRC | 15:38 | |
*** jamesmcarthur has joined #openstack-infra | 15:41 | |
*** ykarel|afk is now known as ykarel|away | 15:44 | |
*** pcaruana has joined #openstack-infra | 15:46 | |
*** rpittau is now known as rpittau|afk | 15:48 | |
*** tesseract has quit IRC | 15:55 | |
*** xek_ is now known as xek | 15:59 | |
*** roman_g has joined #openstack-infra | 15:59 | |
clarkb | brtknr: see comments on the change | 16:05 |
*** ociuhandu has quit IRC | 16:13 | |
*** xenos76 has quit IRC | 16:16 | |
*** e0ne has quit IRC | 16:27 | |
mordred | infra-root: I have arrived back in Stockholm and am now enjoying an evening of jetlag. (yay!) I expect to be back online properly working tomorrow. OR - in a few hours when I wake up senselessly at 1am or something | 16:32 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: Gitlab - bootstrap the driver structure + Webhook support https://review.opendev.org/685682 | 16:35 |
*** whoami-rajat has joined #openstack-infra | 16:36 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 16:41 |
*** eernst has joined #openstack-infra | 16:41 | |
*** cgoncalves has quit IRC | 16:42 | |
*** cgoncalves has joined #openstack-infra | 16:42 | |
*** eernst has quit IRC | 16:43 | |
*** cgoncalves has quit IRC | 16:43 | |
*** jcoufal_ has joined #openstack-infra | 16:44 | |
*** Lucas_Gray has quit IRC | 16:45 | |
*** cgoncalves has joined #openstack-infra | 16:45 | |
*** jpena is now known as jpena|off | 16:45 | |
*** Lucas_Gray has joined #openstack-infra | 16:45 | |
*** bdodd has quit IRC | 16:46 | |
*** jaosorior has quit IRC | 16:46 | |
*** jcoufal has quit IRC | 16:47 | |
*** zbr|ruck is now known as zbr | 16:52 | |
*** slaweq has quit IRC | 16:59 | |
*** cgoncalves has quit IRC | 16:59 | |
*** derekh has quit IRC | 17:00 | |
*** cgoncalves has joined #openstack-infra | 17:00 | |
*** slaweq has joined #openstack-infra | 17:01 | |
*** ykarel|away has quit IRC | 17:06 | |
*** igordc has joined #openstack-infra | 17:08 | |
*** Lucas_Gray has quit IRC | 17:09 | |
*** owalsh has quit IRC | 17:09 | |
*** owalsh has joined #openstack-infra | 17:10 | |
*** markvoelker has quit IRC | 17:17 | |
*** ociuhandu has joined #openstack-infra | 17:19 | |
*** markvoelker has joined #openstack-infra | 17:20 | |
*** smarcet has quit IRC | 17:24 | |
*** ykarel|away has joined #openstack-infra | 17:24 | |
*** ociuhandu has quit IRC | 17:27 | |
*** e0ne has joined #openstack-infra | 17:28 | |
*** Lucas_Gray has joined #openstack-infra | 17:30 | |
*** smarcet has joined #openstack-infra | 17:30 | |
*** yamamoto has joined #openstack-infra | 17:31 | |
*** yamamoto has quit IRC | 17:35 | |
*** e0ne has quit IRC | 17:36 | |
*** anteaya has joined #openstack-infra | 17:37 | |
openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Use import_role on persistent-firewall https://review.opendev.org/685765 | 17:40 |
*** Lucas_Gray has quit IRC | 17:41 | |
*** imacdonn has joined #openstack-infra | 17:50 | |
Shrews | clarkb: i'm seeing a lot of connection errors to all providers in the nb01 logs. ever seen this before? | 17:55 |
Shrews | and zk session losses, too | 17:55 |
Shrews | maybe a reboot is in order? | 17:55 |
clarkb | Shrews: no usually it is provider specific due to an outage or whatever. Not recalling anything affecting all providers | 17:56 |
Shrews | seems the networking stack is bonkers | 17:56 |
*** psachin has quit IRC | 17:56 | |
clarkb | doesn't look like nodepool is running at all there | 17:56 |
Shrews | oh! | 17:56 |
Shrews | died a couple of hours ago | 17:57 |
clarkb | it OOM'd and ya nodepool-builder was selected to be culled | 17:57 |
Shrews | Sep 30 14:08:35 nb01 kernel: [1714559.275405] Out of memory: Kill process 1676 (nodepool-builde) score 116 or sacrifice child | 17:58 |
Shrews | fun | 17:58 |
Shrews | #status log Restarted nodepool-builder on nb01 that OOM'd | 18:00 |
openstackstatus | Shrews: finished logging | 18:00 |
Shrews | wow. there are dib processes running on nb02 that have been running for several days | 18:02 |
Shrews | i don't know what that means, off hand | 18:03 |
Shrews | lots of select() related errors in the logs | 18:05 |
Shrews | https://www.irccloud.com/pastebin/ZjsLrHZ4/ | 18:05 |
Shrews | that's polling the dib process | 18:06 |
Shrews | nodepool has 761 subprocesses. yikes | 18:07 |
Shrews | never seen this before | 18:08 |
Shrews | killing nodepool-builder to see how many die off | 18:11 |
*** diablo_rojo has quit IRC | 18:15 | |
*** smarcet has quit IRC | 18:15 | |
Shrews | Still a few hundred left. I'm going to reboot the host | 18:16 |
*** e0ne has joined #openstack-infra | 18:19 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 18:19 |
*** gmann is now known as gmann_afk | 18:19 | |
*** prometheanfire has quit IRC | 18:22 | |
*** prometheanfire has joined #openstack-infra | 18:22 | |
Shrews | aaaaand... it does not appear reachable *sigh* | 18:23 |
AJaeger | config-core, please review https://review.opendev.org/679806 https://review.opendev.org/684374 and https://review.opendev.org/681270 | 18:23 |
clarkb | Shrews: it may be fscking | 18:24 |
Shrews | true. 'server show' says it is running | 18:24 |
*** ricolin has quit IRC | 18:27 | |
*** elod has quit IRC | 18:28 | |
*** xenos76 has joined #openstack-infra | 18:33 | |
*** smarcet has joined #openstack-infra | 18:34 | |
*** pkopec has quit IRC | 18:43 | |
*** jtomasek has quit IRC | 18:43 | |
*** ociuhandu has joined #openstack-infra | 18:45 | |
*** whoami-rajat has quit IRC | 18:46 | |
*** jtomasek has joined #openstack-infra | 18:48 | |
Shrews | clarkb: starting to think it's not coming back | 18:49 |
*** jtomasek has quit IRC | 18:50 | |
*** jtomasek has joined #openstack-infra | 18:52 | |
*** jtomasek has quit IRC | 18:52 | |
clarkb | this is 02 or 01? you can check the console via the rax web ui and or hard reboot it via the api | 18:54 |
Shrews | 02 | 18:54 |
*** ykarel|away has quit IRC | 18:54 | |
openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Record vulnerability management teams used in SB https://review.opendev.org/685778 | 18:54 |
*** elod has joined #openstack-infra | 18:55 | |
fungi | i can take a look in the console if you want | 18:56 |
Shrews | just at it | 18:57 |
Shrews | and as soon as i open it, ssh now works | 18:57 |
Shrews | go figure | 18:57 |
Shrews | maybe it needed a proper poke | 18:58 |
fungi | it was probably a long fsck | 18:59 |
fungi | those instances have some largeish attached filesystems | 18:59 |
*** weshay has quit IRC | 18:59 | |
fungi | occasional boot delays on reboot would not shock me | 18:59 |
Shrews | #status log Rebooted nb02 to deal with 100's of stray dib processes | 18:59 |
openstackstatus | Shrews: finished logging | 18:59 |
Shrews | fungi: i'll have to remember that and be more patient | 19:00 |
fungi | i think you can `sudo touch /fastboot` to skip autochecking filesystems which have been to long since their last fsck | 19:00 |
fungi | er, too long | 19:00 |
*** jamesmcarthur has quit IRC | 19:01 | |
*** ociuhandu has quit IRC | 19:04 | |
*** jamesmcarthur has joined #openstack-infra | 19:06 | |
*** jbadiapa has joined #openstack-infra | 19:17 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 19:21 |
*** ccamacho has joined #openstack-infra | 19:22 | |
*** jamesmcarthur has quit IRC | 19:34 | |
*** jamesmcarthur has joined #openstack-infra | 19:41 | |
*** e0ne has quit IRC | 19:41 | |
*** kopecmartin is now known as kopecmartin|off | 19:47 | |
yoctozepto | interesting listing behavior: https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d59/681573/28/check/kolla-ansible-ubuntu-source-ceph-ipv6/d59c360/primary/logs/kolla/ceph/ - the 3rd file is a trap | 19:47 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 19:51 |
fungi | yoctozepto: oh, neat, i wonder what's caused that to be indexed as a relative filename? | 19:57 |
fungi | presumably a bug in our index generator | 19:57 |
*** kjackal_v2 has quit IRC | 19:59 | |
clarkb | fungi: if you look at the page source it isn't any different than the other files. I think it has to do with the ::s | 20:02 |
clarkb | ya https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d59/681573/28/check/kolla-ansible-ubuntu-source-ceph-ipv6/d59c360/primary/logs/kolla/ceph/ceph-mon.fd%3A%3A3.txt.gz works fine | 20:03 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 20:04 |
*** markvoelker has quit IRC | 20:04 | |
fungi | aha, so in our index we need to escape : in filenames i guess | 20:08 |
clarkb | ya I've got a quick patch I'm working on | 20:09 |
fungi | awesome, thanks! | 20:09 |
timburke | now i want to see what swift's staticweb middleware does with a listing like that... | 20:11 |
*** smarcet has quit IRC | 20:13 | |
*** e0ne has joined #openstack-infra | 20:14 | |
clarkb | its going to take way more time writing a test than it is to write the actual fix :) | 20:14 |
*** smarcet has joined #openstack-infra | 20:19 | |
*** e0ne has quit IRC | 20:19 | |
fungi | timburke: probably "the right thing"[tm] | 20:20 |
fungi | (i.e., just run file urls through something like urllib3's bog standard url escaper) | 20:20 |
clarkb | fungi: timburke the issue is in the webbrowser | 20:26 |
clarkb | so unless swift is rewriting object payloads I don't think swift can fix this | 20:26 |
openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Escape special filename characters in urls https://review.opendev.org/685785 | 20:27 |
clarkb | fungi: yoctozepto ^ fyi | 20:27 |
*** jbadiapa has quit IRC | 20:27 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: WIP: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 20:27 |
fungi | depends on what you consider the problem to be as to whether that's in the browser or in the content ;) | 20:29 |
clarkb | fungi: well the browser is follwoing what it has parsed to be a url then deciding the url is invalid as it doesn't understand the scheme | 20:30 |
fungi | "browser can't handle unescaped :: in url paths" vs "index generator should be passing urls through a safe escaper" | 20:30 |
clarkb | well we definitely need to escape it | 20:30 |
clarkb | I just mean that a server side middleware can't handle this | 20:31 |
*** Lucas_Gray has joined #openstack-infra | 20:31 | |
clarkb | unless it is scanning payload data and rewriting it to do the escaping | 20:31 |
fungi | ahh, i wasn't sure what swift's staticweb middleware was, thought maybe it had something akin to apache mod_autoindex | 20:31 |
timburke | it's similar, and yeah, we quote() it: https://github.com/openstack/swift/blob/2.22.0/swift/common/middleware/staticweb.py#L351 | 20:32 |
fungi | at least that's how i interpreted timburke's comment | 20:32 |
clarkb | oh I see. In this case we provide our own index so that should override | 20:32 |
timburke | yup | 20:32 |
timburke | i just wanted to *make sure* swift quotes when it does generate pages ;-) | 20:33 |
fungi | i suspect the reason we're generating our own is that some of the object stores we upload to don't have that middleware as an option (due to not actually being swift) | 20:33 |
timburke | i think there was also a desire to have accurate Last Modified columns for directory-like prefixes, which Swift can't do | 20:34 |
clarkb | yup | 20:35 |
clarkb | (you can't currently sort on that column though, but at least the data is acurate) | 20:35 |
openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Initial implementation https://review.opendev.org/683958 | 20:36 |
*** yamamoto has joined #openstack-infra | 20:38 | |
*** jbadiapa has joined #openstack-infra | 20:46 | |
*** ralonsoh has quit IRC | 20:49 | |
*** ociuhandu has joined #openstack-infra | 20:49 | |
*** pcaruana has quit IRC | 20:50 | |
rm_work | hey, with the SDK when I do: `user_cloud = admin_cloud.connect_as_project(user_project)`, and try to access `user_cloud.identity`, it fails because it can | 20:51 |
rm_work | *can't determine the identity api version | 20:51 |
rm_work | but `admin_cloud.identity` works fine | 20:51 |
rm_work | something isn't getting copied over? | 20:52 |
*** markvoelker has joined #openstack-infra | 20:52 | |
*** xeno_os76_xyz has joined #openstack-infra | 20:52 | |
*** signed8bit has joined #openstack-infra | 20:53 | |
rm_work | I'm not sure how it's determining the version in the original but not the new one | 20:54 |
*** irclogbot_3 has quit IRC | 20:55 | |
*** xenos76 has quit IRC | 20:55 | |
*** irclogbot_0 has joined #openstack-infra | 20:55 | |
*** ccamacho has quit IRC | 20:57 | |
*** irclogbot_0 has quit IRC | 21:01 | |
*** Goneri has quit IRC | 21:01 | |
*** irclogbot_1 has joined #openstack-infra | 21:01 | |
openstackgerrit | Paul Belanger proposed openstack/project-config master: Add ansible-role-zuul-registry role for windmill https://review.opendev.org/685791 | 21:03 |
openstackgerrit | Clark Boylan proposed opendev/elastic-recheck master: Add query for 1846093 https://review.opendev.org/685792 | 21:05 |
clarkb | mriedem: ^ any chance I can get a review on that one? trying to track down this issue | 21:05 |
clarkb | rm_work: you might have better luck in the sdk channel | 21:06 |
*** irclogbot_1 has quit IRC | 21:07 | |
rm_work | clarkb: on one hand, yes, it's probably the correct channel. on the other hand, no one actually responds there usually and you folks actually use shade/sdk more than probably anyone else lol | 21:07 |
*** irclogbot_0 has joined #openstack-infra | 21:07 | |
rm_work | so yeah, if it's annoying to see that chatter here, I can try there instead | 21:08 |
mriedem | rm_work: efried is over there | 21:08 |
clarkb | well we very rarely (at this point never?) interact with the clouds as admin users | 21:08 |
mriedem | mordred is traveling otherwise he'd probably help | 21:08 |
rm_work | yeah i'll just summarize my question there and see, but urgency is gone since i'm working around it | 21:08 |
rm_work | figured out how to just avoid using the identity client | 21:09 |
efried | rm_work: I'm listening (here or in -sdks) | 21:09 |
clarkb | rm_work: in general I believe that you are supposed to hit the root of the keystone service which gives you back a json document with versions in it. Then sdk choses one based on whether or not you've supplied v3 auth details (domains essentially) | 21:09 |
rm_work | hmm k so maybe the domain stuff isn't getting set properly for autodetection | 21:10 |
rm_work | anywho, you're correct about the channel so i'll move over there | 21:10 |
mriedem | clarkb: comment in our e-r patch | 21:10 |
mriedem | *your | 21:10 |
*** jamesmcarthur has quit IRC | 21:11 | |
openstackgerrit | Clark Boylan proposed opendev/elastic-recheck master: Add query for 1846093 https://review.opendev.org/685792 | 21:11 |
clarkb | mriedem: done ^ | 21:11 |
openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Escape special filename characters in urls https://review.opendev.org/685785 | 21:12 |
*** ociuhandu has quit IRC | 21:12 | |
clarkb | fungi: ^ fyi that needed a linting fix. Apparently vim overindents by default | 21:12 |
*** irclogbot_0 has quit IRC | 21:13 | |
*** irclogbot_1 has joined #openstack-infra | 21:14 | |
*** xek has quit IRC | 21:17 | |
*** jamesmcarthur has joined #openstack-infra | 21:17 | |
*** e0ne has joined #openstack-infra | 21:18 | |
*** irclogbot_1 has quit IRC | 21:19 | |
*** Lucas_Gray has quit IRC | 21:19 | |
*** irclogbot_0 has joined #openstack-infra | 21:20 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 21:22 |
*** e0ne has quit IRC | 21:24 | |
*** irclogbot_0 has quit IRC | 21:25 | |
openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Initial implementation https://review.opendev.org/683958 | 21:25 |
*** irclogbot_1 has joined #openstack-infra | 21:25 | |
*** serim has joined #openstack-infra | 21:30 | |
*** irclogbot_1 has quit IRC | 21:33 | |
*** gfidente has quit IRC | 21:35 | |
openstackgerrit | Jeremy Stanley proposed zuul/zuul-website master: Link to instructions on vulnerability reporting https://review.opendev.org/685799 | 21:35 |
*** irclogbot_1 has joined #openstack-infra | 21:35 | |
*** eernst has joined #openstack-infra | 21:37 | |
*** irclogbot_1 has quit IRC | 21:41 | |
*** irclogbot_1 has joined #openstack-infra | 21:42 | |
*** eernst has quit IRC | 21:42 | |
openstackgerrit | Merged opendev/elastic-recheck master: Add query for 1846093 https://review.opendev.org/685792 | 21:43 |
*** irclogbot_1 has quit IRC | 21:47 | |
*** irclogbot_3 has joined #openstack-infra | 21:48 | |
*** yamamoto has quit IRC | 21:48 | |
*** yamamoto has joined #openstack-infra | 21:48 | |
*** smarcet has quit IRC | 21:50 | |
openstackgerrit | Merged zuul/zuul-jobs master: Escape special filename characters in urls https://review.opendev.org/685785 | 21:52 |
corvus | clarkb, fungi, mordred: i wonder if we should add libc/gcc stuff to the python-build image to save time in subsequent container image builds? | 21:52 |
*** irclogbot_3 has quit IRC | 21:53 | |
*** irclogbot_1 has joined #openstack-infra | 21:54 | |
*** goldyfruit_ has quit IRC | 21:56 | |
*** irclogbot_1 has quit IRC | 21:59 | |
openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Fix container image build https://review.opendev.org/685808 | 21:59 |
*** irclogbot_0 has joined #openstack-infra | 22:00 | |
*** irclogbot_0 has quit IRC | 22:05 | |
*** dave-mccowan has quit IRC | 22:05 | |
*** irclogbot_0 has joined #openstack-infra | 22:06 | |
*** adriant has joined #openstack-infra | 22:14 | |
*** slaweq has quit IRC | 22:14 | |
*** irclogbot_0 has quit IRC | 22:15 | |
*** irclogbot_2 has joined #openstack-infra | 22:16 | |
fungi | does it spend a significant amount of time (re)installing those? | 22:19 |
*** goldyfruit_ has joined #openstack-infra | 22:23 | |
*** tosky has quit IRC | 22:24 | |
*** rcernin has joined #openstack-infra | 22:24 | |
*** munimeha1 has quit IRC | 22:28 | |
*** yamamoto has quit IRC | 22:33 | |
*** yamamoto has joined #openstack-infra | 22:34 | |
*** xeno_os76_xyz has quit IRC | 22:36 | |
*** harlowja has quit IRC | 22:36 | |
*** mriedem has quit IRC | 22:44 | |
*** mriedem has joined #openstack-infra | 22:45 | |
*** jbadiapa has quit IRC | 22:53 | |
ianw | infra-root: could i get some eyes on a rather mechanical change to up the log rotation times on mirror-update; the current roll-over makes it harder than it needs to be to correlate if we're having problems : https://review.opendev.org/682786 | 22:56 |
clarkb | ianw: frickler had a couple comments in there you may want to address? | 22:58 |
clarkb | I'm ok with it as is as both items could be addressed in a follow up | 22:58 |
ianw | ahh ok, sorry missed that, will do now | 22:58 |
ianw | there is something wrong with the dib gate, unsure yet if it's related to our mirrors ... that's why i'm poking :) | 22:59 |
openstackgerrit | Ian Wienand proposed opendev/system-config master: logrotate: better rotation options https://review.opendev.org/682786 | 23:01 |
*** tkajinam has joined #openstack-infra | 23:02 | |
*** smarcet has joined #openstack-infra | 23:06 | |
*** mriedem has quit IRC | 23:08 | |
*** aaronsheffield has quit IRC | 23:12 | |
openstackgerrit | Merged zuul/zuul-jobs master: Use import_role on persistent-firewall https://review.opendev.org/685765 | 23:17 |
corvus | fungi: yeah, for anything where we might need to build binary libs, etc, as part of installing deps. which i think most/all of the zuul components do. basically, it seems like a nice batteries-included thing for a 'python-builder' image to provide. | 23:21 |
*** goldyfruit_ has quit IRC | 23:21 | |
fungi | agreed, particularly if there are no wheels fitting the platform on which those images are based | 23:22 |
*** dchen has joined #openstack-infra | 23:22 | |
fungi | there's a way to add those as a "build" layer which can then be excluded from the requirements for the top layer, right? or did i imagine that? | 23:23 |
corvus | fungi: yes -- python-builder is a published image but it's only purpose is to serve as a throwaway build layer for other "real" images. so anything we install there does not end up in, say "zuul/zuul-scheduler" | 23:24 |
*** mattw4 has quit IRC | 23:26 | |
corvus | what i'm seing right now, building the zuul-registry image over and over, is that, while i have 'python-builder' cached locally, we start with that, and then, since the step where we install gcc, etc, is part of that throwaway build layer, that has to happen each time. | 23:26 |
corvus | but if it were already present in python-builder, we would save that time (at the cost of the python-builder image being larger) | 23:27 |
corvus | but since it's likely to be needed by a lot of python builds, i think we'd win playing those odds. | 23:27 |
corvus | and since i seem to have an error on every single character of my dockerfile, i have a lot of time to talk about this | 23:28 |
corvus | 1 upgraded, 32 newly installed, 0 to remove and 11 not upgraded. Need to get 42.6 MB of archives. After this operation, 172 MB of additional disk space will be used. | 23:29 |
*** yamamoto has quit IRC | 23:30 | |
*** yamamoto has joined #openstack-infra | 23:31 | |
fungi | yeah, sounds like a clear win then | 23:35 |
openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Fix container image build https://review.opendev.org/685808 | 23:40 |
*** exsdev0 has joined #openstack-infra | 23:47 | |
*** exsdev has quit IRC | 23:47 | |
*** exsdev0 is now known as exsdev | 23:47 | |
*** sthussey has quit IRC | 23:50 | |
*** jamesmcarthur has quit IRC | 23:57 | |
*** jamesmcarthur has joined #openstack-infra | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!