*** tetsuro_ has quit IRC | 00:00 | |
*** tetsuro has joined #openstack-infra | 00:01 | |
*** sreejithp has joined #openstack-infra | 00:08 | |
*** sreejithp has quit IRC | 00:19 | |
*** sreejithp has joined #openstack-infra | 00:20 | |
*** sreejithp has quit IRC | 01:22 | |
openstackgerrit | Ian Wienand proposed openstack/project-config master: Remove publish-zuul-python-branch-tarball and release-zuul-python https://review.opendev.org/705367 | 01:22 |
---|---|---|
kevinz | ianw: ping | 01:28 |
kevinz | ianw: sorry I just back from holiday | 01:28 |
*** tetsuro_ has joined #openstack-infra | 01:58 | |
*** tetsuro has quit IRC | 02:01 | |
*** ramishra has joined #openstack-infra | 02:05 | |
*** dSrinivas has joined #openstack-infra | 02:22 | |
dSrinivas | Hi All, Can anyone please provide the document link to configure new Openstack CI with Zuul new version. Thank you. | 02:23 |
*** rcernin has joined #openstack-infra | 02:27 | |
ianw | kevinz: hey, no worries, how's it going | 02:33 |
kevinz | ianw: thx. I tried upload a ubuntu bionic cloud image with admin user in remote node, it works fine | 02:34 |
ianw | kevinz: i'll have to just context switch back in, but i think our issue was nb03 -> linaro-us connectivity, let me see | 02:36 |
ianw | kevinz: ok, checking the logs right now, first i'm seeing | 02:37 |
ianw | openstack.exceptions.HttpException: HttpException: 503: Server Error for url: https://uk.linaro.cloud:9292/v2/images, 503 Service Unavailable: No server is available to handle this request. | 02:37 |
kevinz | ianw: uk? | 02:38 |
kevinz | I thought it should be us.linaro.cloud | 02:38 |
ianw | kevinz: yes, i think this is a new issue :/ | 02:39 |
ianw | http://paste.openstack.org/show/789042/ is the log | 02:39 |
ianw | ok, we are *also* seeing the same failures to connect to us.linaro.cloud -> http://paste.openstack.org/show/789043/ | 02:40 |
ianw | so, which one to debug first :) | 02:41 |
dSrinivas | @ianw Hi | 02:41 |
ianw | hello | 02:42 |
*** jamesmcarthur has quit IRC | 02:43 | |
dSrinivas | ianw: Can you please provide me the document link to configure the new Openstack CI with new Zuul version | 02:44 |
ianw | dSrinivas: unfortunately, step-by-step instructions for setting up a zuulv3 third-party CI system are not currently available | 02:44 |
dSrinivas | ianw: Ok. Can I use this link https://opendev.org/opendev/puppet-openstackci/src/branch/master/doc/source/third_party_ci.rst to configure Openstack CI and then later upgrade the Zuul version to V3 | 02:46 |
ianw | dSrinivas: there is a spec available @ https://docs.opendev.org/opendev/infra-specs/latest/specs/zuulv3-3rd-party-ci.html that covers a lot of the topics | 02:46 |
kevinz | ianw: sorry I think the glance service in linaro london is dead, now glance is recovered. Could you retry? | 02:47 |
ianw | dSrinivas: you probably could, but the upgrade will be significant. TBH i'd try something like https://zuul-ci.org/docs/zuul/tutorials/quick-start.html#quick-start | 02:48 |
ianw | this is not focused at 3rd party ci, but will lead you in the right direction | 02:48 |
dSrinivas | i | 02:50 |
ianw | kevinz: checking ... | 02:50 |
dSrinivas | ianw: Ok. Thanks for the information | 02:50 |
ianw | dSrinivas: we would love to get 3rd-party ci focused documentation updated; if you're in a position to contribute to that as you progress that would be great | 02:51 |
ianw | perhaps read through that spec above, and if you have ideas bring them up | 02:52 |
*** jamesmcarthur has joined #openstack-infra | 02:53 | |
dSrinivas | ianw: Ok But Can i follow old document puppet modules and system-config inorder to setup the jenkins, nodepool etc. except zuul | 02:53 |
ianw | dSrinivas: well that's the thing; the architecture has changed significantly if you're using zuulv3. the extant puppet is really a dead end, it is not being maintained, let alone improved | 02:54 |
ianw | kevinz: | 0000086134 | 0000000626 | linaro-london | ubuntu-xenial-arm64 | None | None | uploading | 00:00:10:17 | | 02:56 |
ianw | looks like we're uploading | 02:56 |
ianw | kevinz: so that brings us back to why nb03.openstack.org can't talk to us.linaro.cloud:5000 | 02:57 |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: upload-afs: rename to upload-afs-roots; add afs-upload-synchronize https://review.opendev.org/705368 | 03:07 |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: upload-afs: rename to upload-afs-roots; add afs-upload-synchronize https://review.opendev.org/705368 | 03:18 |
openstackgerrit | Ian Wienand proposed openstack/project-config master: Remove publish-zuul-python-branch-tarball and release-zuul-python https://review.opendev.org/705367 | 03:19 |
openstackgerrit | Ian Wienand proposed openstack/project-config master: Migrate to upload-afs-roots role https://review.opendev.org/705370 | 03:19 |
openstackgerrit | Ian Wienand proposed opendev/base-jobs master: Migrate to upload-afs-roots role https://review.opendev.org/705371 | 03:19 |
*** jamesmcarthur has quit IRC | 03:22 | |
kevinz | ianw: could you add my pub.key to that node nb03.openstack.org , so that I can check | 03:24 |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Remove deprecated upload-afs role https://review.opendev.org/705373 | 03:24 |
dSrinivas | ianw: Can i configure the Openstack CI with the Old configuration such that Our CI will be running for the driver and later we can upgrade the zuul to new version. Is it ok | 03:24 |
*** jamesmcarthur has joined #openstack-infra | 03:28 | |
*** rcernin has quit IRC | 03:31 | |
ianw | dSrinivas: i'm not sure i can really tell you what to do ... i would not really recommend starting fresh with a largely unsupported software stack. there's the quickstart guide i mentioned, or you might like to investigate other options like https://www.softwarefactory-project.io/docs/3.4/operator/quickstart.html#third-party-ci-quickstart | 03:37 |
dSrinivas | ianw: OK. Thank you for the information | 03:39 |
openstackgerrit | Ian Wienand proposed openstack/project-config master: upload-artifacts-with-afs: use upload-afs-synchronzie role https://review.opendev.org/705374 | 03:41 |
*** jamesmcarthur has quit IRC | 03:46 | |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: upload-afs: rename to upload-afs-roots; add afs-upload-synchronize https://review.opendev.org/705368 | 03:48 |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Remove deprecated upload-afs role https://review.opendev.org/705373 | 03:48 |
*** jamesmcarthur has joined #openstack-infra | 03:51 | |
ianw | kevinz: http://paste.openstack.org/show/789046/ ... traceroute from nb03 -> us.linaro.cloud | 03:54 |
*** ykarel|away is now known as ykarel | 04:07 | |
*** tetsuro_ has quit IRC | 04:07 | |
*** tetsuro has joined #openstack-infra | 04:08 | |
*** psachin has joined #openstack-infra | 04:29 | |
*** jamesmcarthur has quit IRC | 04:50 | |
*** raukadah is now known as chkumar|rover | 04:55 | |
*** dSrinivas has quit IRC | 05:20 | |
*** hongbin has joined #openstack-infra | 05:23 | |
*** dSrinivas has joined #openstack-infra | 05:26 | |
*** evrardjp has quit IRC | 05:33 | |
*** evrardjp has joined #openstack-infra | 05:34 | |
*** icarusfactor has joined #openstack-infra | 05:36 | |
*** factor has quit IRC | 05:38 | |
*** soniya29 has joined #openstack-infra | 05:45 | |
*** udesale has joined #openstack-infra | 05:49 | |
*** viks___ has joined #openstack-infra | 05:54 | |
*** dSrinivas has quit IRC | 05:58 | |
*** jamesmcarthur has joined #openstack-infra | 06:01 | |
*** icarusfactor has quit IRC | 06:02 | |
*** dSrinivas has joined #openstack-infra | 06:04 | |
*** jamesmcarthur has quit IRC | 06:06 | |
*** dSrinivas has quit IRC | 06:12 | |
*** dSrinivas has joined #openstack-infra | 06:16 | |
*** hongbin has quit IRC | 06:16 | |
*** mattw4 has joined #openstack-infra | 06:17 | |
*** dSrinivas has quit IRC | 06:20 | |
*** ricolin has quit IRC | 06:24 | |
*** dSrinivas has joined #openstack-infra | 06:28 | |
*** tetsuro_ has joined #openstack-infra | 06:35 | |
*** tetsuro has quit IRC | 06:39 | |
dSrinivas | ianw: Is it mandatory to use Zuul V3 now or later we can change | 06:43 |
dSrinivas | it | 06:43 |
*** mattw4 has quit IRC | 06:43 | |
*** Lucas_Gray has joined #openstack-infra | 06:44 | |
ianw | dSrinivas: it is not mandatory to use zuul v3; the old zuul codebase can still listen to gerrit and make changes | 06:45 |
*** dSrinivas has quit IRC | 06:46 | |
*** lmiccini has joined #openstack-infra | 06:48 | |
*** roman_g has joined #openstack-infra | 07:05 | |
*** AJaeger has quit IRC | 07:06 | |
*** AJaeger has joined #openstack-infra | 07:08 | |
*** lpetrut has joined #openstack-infra | 07:09 | |
*** dSrinivas has joined #openstack-infra | 07:10 | |
*** dpawlik has joined #openstack-infra | 07:12 | |
*** dpawlik has quit IRC | 07:13 | |
*** dpawlik has joined #openstack-infra | 07:14 | |
*** tetsuro_ has quit IRC | 07:14 | |
*** tetsuro has joined #openstack-infra | 07:14 | |
*** dtantsur|afk is now known as dtantsur | 07:20 | |
*** dSrinivas has quit IRC | 07:30 | |
*** tkajinam has quit IRC | 07:36 | |
*** hwoarang has quit IRC | 07:36 | |
*** hwoarang has joined #openstack-infra | 07:37 | |
*** Adri2000 has joined #openstack-infra | 07:37 | |
*** tkajinam has joined #openstack-infra | 07:38 | |
*** slaweq has joined #openstack-infra | 07:38 | |
*** pcaruana has joined #openstack-infra | 07:43 | |
*** iurygregory has joined #openstack-infra | 07:51 | |
*** ykarel is now known as ykarel|lunch | 07:51 | |
*** gfidente has joined #openstack-infra | 07:52 | |
*** Lucas_Gray has quit IRC | 07:58 | |
*** ralonsoh has joined #openstack-infra | 07:59 | |
*** piotrowskim has joined #openstack-infra | 08:00 | |
*** kopecmartin has joined #openstack-infra | 08:00 | |
*** tkajinam_ has joined #openstack-infra | 08:01 | |
*** Lucas_Gray has joined #openstack-infra | 08:03 | |
*** tkajinam has quit IRC | 08:04 | |
*** rpittau|afk is now known as rpittau | 08:05 | |
*** dchen has quit IRC | 08:10 | |
*** tesseract has joined #openstack-infra | 08:14 | |
*** apetrich has joined #openstack-infra | 08:16 | |
*** yboaron has joined #openstack-infra | 08:25 | |
*** tetsuro has quit IRC | 08:27 | |
*** tosky has joined #openstack-infra | 08:29 | |
*** yboaron_ has joined #openstack-infra | 08:30 | |
*** yboaron has quit IRC | 08:33 | |
*** dSrinivas has joined #openstack-infra | 08:33 | |
*** dSrinivas has quit IRC | 08:36 | |
*** yboaron_ has quit IRC | 08:37 | |
*** yboaron_ has joined #openstack-infra | 08:37 | |
*** tkajinam_ has quit IRC | 08:38 | |
*** dSrinivas has joined #openstack-infra | 08:39 | |
*** ociuhandu has joined #openstack-infra | 08:46 | |
*** tetsuro has joined #openstack-infra | 08:48 | |
*** ociuhandu has quit IRC | 08:50 | |
*** lucasagomes has joined #openstack-infra | 08:55 | |
*** ociuhandu has joined #openstack-infra | 09:02 | |
*** yolanda has joined #openstack-infra | 09:03 | |
*** ociuhandu has quit IRC | 09:07 | |
*** rchanter has joined #openstack-infra | 09:07 | |
openstackgerrit | Felix Schmidt proposed zuul/zuul master: Implement github checks API https://review.opendev.org/705168 | 09:18 |
*** tetsuro has quit IRC | 09:21 | |
*** Lucas_Gray has quit IRC | 09:23 | |
*** ykarel|lunch is now known as ykarel | 09:29 | |
*** xek has joined #openstack-infra | 09:30 | |
*** sshnaidm|off is now known as sshnaidm | 09:30 | |
*** pkopec has joined #openstack-infra | 09:35 | |
*** derekh has joined #openstack-infra | 09:39 | |
*** Lucas_Gray has joined #openstack-infra | 09:39 | |
*** Tengu has quit IRC | 09:46 | |
*** Tengu has joined #openstack-infra | 09:48 | |
*** Tengu has quit IRC | 09:54 | |
*** gshippey has joined #openstack-infra | 09:54 | |
*** lucasagomes_ has joined #openstack-infra | 09:55 | |
*** Tengu has joined #openstack-infra | 09:55 | |
*** lucasagomes has quit IRC | 09:55 | |
*** lucasagomes_ is now known as lucasagomes | 09:56 | |
*** jaosorior has joined #openstack-infra | 10:01 | |
*** Tengu has quit IRC | 10:03 | |
*** Tengu has joined #openstack-infra | 10:03 | |
*** Tengu has quit IRC | 10:08 | |
*** Lucas_Gray has quit IRC | 10:09 | |
*** Tengu has joined #openstack-infra | 10:13 | |
*** Tengu_ has joined #openstack-infra | 10:14 | |
*** Tengu_ has quit IRC | 10:15 | |
*** ociuhandu has joined #openstack-infra | 10:18 | |
*** ociuhandu has quit IRC | 10:23 | |
*** rchanter has quit IRC | 10:27 | |
*** lucasagomes has quit IRC | 10:27 | |
*** lucasagomes has joined #openstack-infra | 10:41 | |
*** ociuhandu has joined #openstack-infra | 10:47 | |
*** Lucas_Gray has joined #openstack-infra | 10:59 | |
*** Lucas_Gray has quit IRC | 11:09 | |
*** Lucas_Gray has joined #openstack-infra | 11:10 | |
*** tkajinam has joined #openstack-infra | 11:28 | |
*** Lucas_Gray has quit IRC | 11:31 | |
*** yboaron_ has quit IRC | 11:35 | |
mordred | morning folks | 11:38 |
*** Lucas_Gray has joined #openstack-infra | 11:41 | |
AJaeger | good morning, mordred! feeling already at home or do you live in boxes? | 11:42 |
*** rpittau is now known as rpittau|bbl | 11:42 | |
mordred | AJaeger: a little of both - we're out of most of the boxes, but there's still a bunch of organization left. internet works though! :) | 11:43 |
*** ociuhandu has quit IRC | 11:44 | |
*** ociuhandu has joined #openstack-infra | 11:45 | |
*** hashar has joined #openstack-infra | 11:48 | |
AJaeger | great! | 11:48 |
*** ociuhandu has quit IRC | 11:48 | |
*** ociuhandu has joined #openstack-infra | 11:48 | |
*** ociuhandu has quit IRC | 11:51 | |
*** yboaron_ has joined #openstack-infra | 11:59 | |
*** Lucas_Gray has quit IRC | 12:05 | |
*** ociuhandu has joined #openstack-infra | 12:09 | |
*** Lucas_Gray has joined #openstack-infra | 12:11 | |
mordred | ianw, dSrinivas: dtroyer has been working on a windmill-based 3PCI Zuul v3 setup and mentioned maybe writing up some docs on how to do that | 12:12 |
*** ociuhandu has quit IRC | 12:15 | |
*** ociuhandu has joined #openstack-infra | 12:16 | |
dSrinivas | mordred: How can I configure new openstack CI freshly without using puppet modules as it is going to move to ansible. | 12:21 |
*** rfolco has joined #openstack-infra | 12:24 | |
mordred | dSrinivas: yeah - that would be what dtroyer has been working on - he's using windmill (ansible) to setup the zuul - I'm not sure there's any docs on it yet | 12:26 |
dSrinivas | mordred: Ok | 12:34 |
*** soniya29 has quit IRC | 12:41 | |
*** rosmaita has left #openstack-infra | 12:47 | |
*** rosmaita has joined #openstack-infra | 12:47 | |
noonedeadpunk | mornings folks. Can I ask for a hold of https://zuul.opendev.org/t/openstack/build/70dca1b262264ec98c5e623892cfa8a1 ? I'm really puzzled why it's failing as this dir should be created according to logs https://zuul.opendev.org/t/openstack/build/70dca1b262264ec98c5e623892cfa8a1/log/job-output.txt#17538 | 12:49 |
noonedeadpunk | Also I can't reproduce this in the sandbox... | 12:50 |
*** ramishra has quit IRC | 12:51 | |
*** ociuhandu has quit IRC | 12:54 | |
*** ociuhandu has joined #openstack-infra | 12:54 | |
*** udesale_ has joined #openstack-infra | 12:55 | |
*** udesale has quit IRC | 12:57 | |
*** rh-jelabarre has joined #openstack-infra | 12:58 | |
*** ociuhandu has quit IRC | 13:00 | |
*** rlandy has joined #openstack-infra | 13:01 | |
*** rosmaita has quit IRC | 13:05 | |
openstackgerrit | Merged zuul/zuul master: Dockerfile: create a zuul user with uid 10001 https://review.opendev.org/650246 | 13:09 |
*** rosmaita has joined #openstack-infra | 13:10 | |
*** ramishra has joined #openstack-infra | 13:10 | |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Add Apache to Ansible for Gerrit https://review.opendev.org/704498 | 13:11 |
*** psachin has quit IRC | 13:16 | |
*** yboaron_ has quit IRC | 13:19 | |
*** jamesmcarthur has joined #openstack-infra | 13:21 | |
*** derekh has quit IRC | 13:24 | |
*** rpittau|bbl is now known as rpittau | 13:34 | |
*** jamesmcarthur has quit IRC | 13:34 | |
*** ykarel is now known as ykarel|afk | 13:36 | |
*** ykarel|afk is now known as ykarel|away | 13:39 | |
*** Goneri has joined #openstack-infra | 13:40 | |
*** jamesmcarthur has joined #openstack-infra | 13:46 | |
*** mrmartin has joined #openstack-infra | 13:55 | |
openstackgerrit | Monty Taylor proposed opendev/system-config master: Add Apache to Ansible for Gerrit https://review.opendev.org/704498 | 13:57 |
*** ykarel|away is now known as ykarel | 14:04 | |
*** Lucas_Gray has quit IRC | 14:04 | |
*** Lucas_Gray has joined #openstack-infra | 14:05 | |
*** ahosam has joined #openstack-infra | 14:07 | |
ttx | Weird thing happened on kata-dev ML this morning with mass unsubscription at 9UTC sharp | 14:09 |
ttx | about 35% of the subscribers | 14:10 |
ttx | The timing sounds consistent with mailman monthly tasks... | 14:10 |
ttx | Notification of the unsubscription did not give any detail on why | 14:11 |
ttx | Any idea of what could trigger that? | 14:14 |
ttx | (I was personally unsubscribed and did nothing to trigger it) | 14:14 |
*** sreejithp has joined #openstack-infra | 14:14 | |
*** tkajinam has quit IRC | 14:16 | |
*** derekh has joined #openstack-infra | 14:17 | |
*** ykarel is now known as ykarel|mtg | 14:19 | |
*** ahosam has quit IRC | 14:19 | |
*** jamesmcarthur has quit IRC | 14:21 | |
*** jamesmcarthur has joined #openstack-infra | 14:23 | |
*** Lucas_Gray has quit IRC | 14:31 | |
*** Lucas_Gray has joined #openstack-infra | 14:32 | |
*** yboaron_ has joined #openstack-infra | 14:34 | |
*** jamesmcarthur has quit IRC | 14:35 | |
*** zxiiro has joined #openstack-infra | 14:36 | |
*** chkumar|rover is now known as raukadah | 14:37 | |
*** eharney has joined #openstack-infra | 14:41 | |
*** smarcet has joined #openstack-infra | 14:46 | |
*** dtantsur is now known as dtantsur|brb | 14:50 | |
*** ykarel|mtg is now known as ykarel | 14:52 | |
*** Sundar has joined #openstack-infra | 15:04 | |
*** artom has joined #openstack-infra | 15:04 | |
*** apetrich has quit IRC | 15:07 | |
*** ociuhandu has joined #openstack-infra | 15:07 | |
Sundar | Hello all, regarding https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-py37&result=TIMED_OUT, we are trying to find a good way to determine the cause of the Zoom timeout in Cyborg. The test reports only indicate what worked. So: (a) how can we find out which tests timed out, if any? (b) Is there a message that Zuul sends indicating | 15:11 |
Sundar | timeout? | 15:11 |
*** jamesmcarthur has joined #openstack-infra | 15:12 | |
*** Lucas_Gray has quit IRC | 15:14 | |
Sundar | In previous discussions http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-01-22.log.html#t2020-01-22T15:22:32, it was said that perhaps Cyborg has some race conditions. While we looked at it in general, this is too general. We need to know which tests timed out.. | 15:14 |
*** lpetrut has quit IRC | 15:18 | |
*** mattw4 has joined #openstack-infra | 15:18 | |
*** Lucas_Gray has joined #openstack-infra | 15:20 | |
AJaeger | Sundar: One way: recheck and follow the output - go to zuul.opendev.org, find your change and click on it - and you get a terminal | 15:20 |
*** mattw4 has quit IRC | 15:25 | |
*** eharney has quit IRC | 15:25 | |
*** zbr has quit IRC | 15:30 | |
*** smarcet has quit IRC | 15:31 | |
*** armax has joined #openstack-infra | 15:31 | |
*** sgw has joined #openstack-infra | 15:32 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Cap cheroot to fix issues with concurrent requests https://review.opendev.org/705459 | 15:32 |
*** eharney has joined #openstack-infra | 15:33 | |
sgw | Morning all, anyone awake yet? How long does it take to propogate a SSH Key change from Ubuntu One -> review.opendev.org? Also once a OneID is created should will an owner: search on review.opendev.org match or does that person have to have submitted a code review? | 15:34 |
*** zbr has joined #openstack-infra | 15:34 | |
*** hashar has quit IRC | 15:35 | |
* sgw says nevermind! | 15:39 | |
*** ahosam has joined #openstack-infra | 15:41 | |
*** ahosam has quit IRC | 15:43 | |
*** rfolco is now known as rfolco|eats | 15:43 | |
*** ociuhandu has quit IRC | 15:44 | |
*** ykarel is now known as ykarel|away | 15:44 | |
*** ociuhandu has joined #openstack-infra | 15:45 | |
*** electrofelix has joined #openstack-infra | 15:47 | |
*** ociuhandu has quit IRC | 15:52 | |
*** yboaron_ has quit IRC | 15:52 | |
*** eharney has quit IRC | 15:59 | |
clarkb | ttx: is it possible that is related to the recent pbl (un)listing? maybe mailman does unsubs for bounces periodically? | 16:00 |
clarkb | sgw we dont import keys from ubuntuone | 16:01 |
*** dSrinivas has quit IRC | 16:02 | |
sgw | Yeah, we found the problem, partly our starlingx setup docs, partly human factors! | 16:04 |
*** gyee has joined #openstack-infra | 16:04 | |
*** dtantsur|brb is now known as dtantsur | 16:05 | |
*** yboaron_ has joined #openstack-infra | 16:07 | |
*** nicolasbock has joined #openstack-infra | 16:10 | |
*** ociuhandu has joined #openstack-infra | 16:23 | |
*** eharney has joined #openstack-infra | 16:23 | |
*** Lucas_Gray has quit IRC | 16:26 | |
*** sshnaidm is now known as sshnaidm|afk | 16:27 | |
*** mattw4 has joined #openstack-infra | 16:31 | |
*** mattw4 has quit IRC | 16:32 | |
*** eernst has joined #openstack-infra | 16:32 | |
*** udesale_ has quit IRC | 16:32 | |
*** jamesmcarthur has quit IRC | 16:33 | |
*** rpittau is now known as rpittau|afk | 16:33 | |
*** ociuhandu has quit IRC | 16:34 | |
*** jamesmcarthur has joined #openstack-infra | 16:37 | |
*** zxiiro has quit IRC | 16:45 | |
*** ramishra has quit IRC | 16:48 | |
*** mattw4 has joined #openstack-infra | 16:51 | |
*** rfolco|eats is now known as rfolco | 16:51 | |
*** lmiccini has quit IRC | 16:54 | |
*** ociuhandu has joined #openstack-infra | 16:55 | |
*** mattw4 has quit IRC | 16:56 | |
*** eernst has quit IRC | 16:57 | |
*** eernst has joined #openstack-infra | 16:58 | |
ttx | clarkb: mayyybe | 16:59 |
clarkb | ttx: elsewhere jbryce seems to have attributed it to bounces | 17:02 |
*** eernst has quit IRC | 17:03 | |
*** lucasagomes has quit IRC | 17:07 | |
*** yboaron_ has quit IRC | 17:07 | |
*** mattw4 has joined #openstack-infra | 17:08 | |
*** yboaron_ has joined #openstack-infra | 17:08 | |
*** ociuhandu has quit IRC | 17:09 | |
*** ociuhandu has joined #openstack-infra | 17:10 | |
*** yboaron_ has quit IRC | 17:13 | |
*** ociuhandu has quit IRC | 17:15 | |
*** ociuhandu has joined #openstack-infra | 17:17 | |
*** eharney has quit IRC | 17:19 | |
*** ociuhandu has quit IRC | 17:20 | |
*** ociuhandu has joined #openstack-infra | 17:21 | |
openstackgerrit | Merged opendev/gear master: Add BSD/Darwin support. https://review.opendev.org/671674 | 17:29 |
*** eharney has joined #openstack-infra | 17:32 | |
openstackgerrit | Brian Haley proposed openstack/project-config master: Update Octavia failure rate dashboard https://review.opendev.org/705496 | 17:32 |
*** evrardjp has quit IRC | 17:33 | |
openstackgerrit | Merged opendev/gear master: Ignore keepalive on unsupported platforms https://review.opendev.org/702816 | 17:34 |
*** evrardjp has joined #openstack-infra | 17:34 | |
*** yboaron_ has joined #openstack-infra | 17:35 | |
openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: Dockerfile: create a nodepool user with uid 10001 https://review.opendev.org/705497 | 17:38 |
*** smarcet has joined #openstack-infra | 17:38 | |
*** yboaron_ has quit IRC | 17:39 | |
openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: Dockerfile: remove the uid_entrypoint service https://review.opendev.org/705241 | 17:41 |
*** TViernion has joined #openstack-infra | 17:42 | |
*** smarcet_ has joined #openstack-infra | 17:47 | |
*** smarcet has quit IRC | 17:48 | |
*** smarcet_ is now known as smarcet | 17:48 | |
* mordred goes to find some lunch | 17:50 | |
*** Sundar has quit IRC | 17:53 | |
*** ociuhandu_ has joined #openstack-infra | 17:54 | |
*** ociuhandu has quit IRC | 17:57 | |
*** ociuhandu_ has quit IRC | 17:59 | |
*** gfidente is now known as gfidente|afk | 17:59 | |
*** derekh has quit IRC | 18:00 | |
*** electrofelix has quit IRC | 18:06 | |
*** yboaron_ has joined #openstack-infra | 18:08 | |
*** drifterza has joined #openstack-infra | 18:09 | |
*** jamesmcarthur has quit IRC | 18:12 | |
*** jamesmcarthur has joined #openstack-infra | 18:19 | |
*** weshay is now known as weshay|ruck | 18:30 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add foreground option https://review.opendev.org/635649 | 18:30 |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Deprecate -d switch for running in foreground https://review.opendev.org/705185 | 18:30 |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Don't enforce foreground with -d switch https://review.opendev.org/705189 | 18:30 |
*** drifterza has quit IRC | 18:33 | |
*** smarcet has quit IRC | 18:42 | |
*** smarcet has joined #openstack-infra | 18:47 | |
*** ralonsoh has quit IRC | 18:51 | |
*** smarcet has quit IRC | 18:51 | |
openstackgerrit | Ghanshyam Mann proposed openstack/hacking master: [ussuri][goal] Drop python 2.7 support and testing https://review.opendev.org/705514 | 18:52 |
clarkb | mordred: when you return from lunch can you point me in the right direction for web proxy setup in the docker-compose world of ours? re https://review.opendev.org/#/c/705258/ | 18:54 |
*** jamesmcarthur has quit IRC | 18:54 | |
clarkb | mordred: I think being consistent there with review and everything else would be nice if we can manage it | 18:55 |
mordred | clarkb: uhm ... I'm not sure if I can point you to the RIGH?T direction | 18:57 |
mordred | clarkb: https://review.opendev.org/#/c/704498/ is the direction I've been going with gerrit | 18:57 |
clarkb | looks like that doesn't use a container'd web server but instead runs it on the host? | 18:58 |
mordred | yeah. I was thinking that it might be nicer to go container - but hadn't gotten there yet | 18:58 |
clarkb | I can go that route too. I think that was mostly what I was looking at whether or not it made sense to put that in a container or not | 18:58 |
clarkb | I think what gets tricky is a host level apache can route on port 443 based on sni names | 18:58 |
clarkb | but if we containerized them we cannot | 18:59 |
mordred | why not? if it's using host networking there should be no difference | 18:59 |
mordred | my main concern with containerizing them is whether or not graceful would still work properly | 18:59 |
clarkb | right it presumes a single apache | 18:59 |
clarkb | with host networking that works | 18:59 |
clarkb | without it you'd be running many apaches (though we don't deploy like that today) | 19:00 |
mordred | yeah. I wouldn't think multiple apaches - I was mostly thinking containerized just so it could be in the compose file | 19:00 |
clarkb | gotcha | 19:00 |
mordred | but - this is just me thinking - I'm probably wrong about everything :) | 19:00 |
clarkb | when you run apache on the host its a bit more explicit there is a single apache | 19:00 |
mordred | yeah. it's also not hard to run an apache on the host | 19:01 |
clarkb | ok after lunch I'll try to get started on similar for refstack and LE it up | 19:01 |
mordred | otoh - if we shift in the future from compose to k8s - we'll need to sort out containerized apache - but maybe we just sort that at that point in time | 19:01 |
*** eharney has quit IRC | 19:02 | |
*** diablo_rojo has joined #openstack-infra | 19:02 | |
mordred | clarkb: I'm thinking similarly launching a new review-dev, putting it on opendev and LEing it up | 19:02 |
clarkb | however, I'm beginning to worry that the fixes to make the docker image build at all are just going to sit unreviewed. | 19:02 |
clarkb | and that makes me wonder how much more effort I should invest in this | 19:02 |
clarkb | its been a great learning experience up to this point and helped to fix some bugs in our container testing | 19:02 |
mordred | clarkb: is there a core team? | 19:03 |
mordred | clarkb: yeah - I'd be very surprised if you get any reviews, given the core team | 19:03 |
clarkb | ya, and ttx and diablo_rojo are in it, so probably going to be up to them | 19:03 |
clarkb | not sure if anyone else is active. maybe tosky | 19:03 |
openstackgerrit | Ghanshyam Mann proposed openstack/os-performance-tools master: [ussuri][goal] Drop python 2.7 support and testing https://review.opendev.org/705520 | 19:04 |
*** pkopec has quit IRC | 19:07 | |
*** pkopec has joined #openstack-infra | 19:08 | |
tosky | clarkb: uh, where? | 19:09 |
openstackgerrit | Ghanshyam Mann proposed openstack/os-testr master: [ussuri][goal] Drop python 2.7 support and testing https://review.opendev.org/705522 | 19:09 |
diablo_rojo | clarkb, I can take a look, but I had little context when I got given +2 power.. | 19:09 |
clarkb | tosky: diablo_rojo https://review.opendev.org/#/c/705265/ is the bottom of the stack. I don't think it is urgent, but it would be helpful to understand if work like that is useful or if the project is effectively dead and maybe we need to think about not hosting it anymore rather than updating its deployment | 19:11 |
* diablo_rojo opens tab | 19:11 | |
*** eharney has joined #openstack-infra | 19:14 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add tenant reconfiguration when main.yaml changed https://review.opendev.org/703631 | 19:15 |
*** stevebaker has joined #openstack-infra | 19:15 | |
*** eharney has quit IRC | 19:17 | |
tosky | clarkb: oh, the refstack server | 19:21 |
tosky | I believe that diablo_rojo may provide more details on the Foundation position on it; I've got the +2 from work on refstack-client (and tempestclient), but I can help with reviews | 19:22 |
*** hashar has joined #openstack-infra | 19:26 | |
* clarkb pop out for late breakfast/early lunch | 19:30 | |
openstackgerrit | Merged zuul/zuul master: Add gcloud_service auth option for Gerrit driver https://review.opendev.org/704904 | 19:30 |
diablo_rojo | tosky, at the board meeting in shanghai it sounded like Refstack is till an important effort to maintain, but there wasn't a lot of progress in terms of getting board members to HELP support the effort. | 19:31 |
diablo_rojo | tosky, when hogepodge left the foundation ttx and I were given +2 power on the repos so that we could add people when they came along I think. | 19:32 |
diablo_rojo | That's about all I got for info :) | 19:32 |
openstackgerrit | James E. Blair proposed zuul/zuul master: Gerrit: poll for merged changes if no stream events https://review.opendev.org/705053 | 19:38 |
openstackgerrit | James E. Blair proposed zuul/zuul master: Add google-cloud-storage to executor ansible https://review.opendev.org/705279 | 19:38 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add CONTRIBUTE file https://review.opendev.org/705535 | 19:43 |
*** smarcet has joined #openstack-infra | 19:46 | |
*** gshippey has quit IRC | 19:50 | |
*** dtantsur is now known as dtantsur|afk | 19:53 | |
*** gfidente|afk is now known as gfidente | 19:56 | |
*** tesseract has quit IRC | 20:01 | |
*** irclogbot_1 has quit IRC | 20:05 | |
*** irclogbot_3 has joined #openstack-infra | 20:06 | |
openstackgerrit | Andreas Jaeger proposed openstack/os-performance-tools master: Fix docs building https://review.opendev.org/705543 | 20:18 |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: DNM: Debug container build https://review.opendev.org/704215 | 20:19 |
*** jamesmcarthur has joined #openstack-infra | 20:20 | |
*** fresta has quit IRC | 20:22 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Use apt mirror infrastructure during zuul-quick-start https://review.opendev.org/649448 | 20:22 |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: DNM: Debug container build https://review.opendev.org/704215 | 20:22 |
openstackgerrit | Radosław Piliszek proposed openstack/project-config master: Add RP to devstack https://review.opendev.org/705547 | 20:23 |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Enable ansible cleanup https://review.opendev.org/636015 | 20:24 |
*** fresta has joined #openstack-infra | 20:24 | |
*** artom has quit IRC | 20:26 | |
tosky | diablo_rojo: and I think one of you added me and Chandan, I think; ok, I can't guarantee I can do many stuff, but I can review patches | 20:28 |
*** gfidente has quit IRC | 20:28 | |
openstackgerrit | Andreas Jaeger proposed openstack/os-performance-tools master: Fix docs building https://review.opendev.org/705543 | 20:28 |
diablo_rojo | tosky, reviewing is what we need right now with clarkb's patch so that's perfect :) | 20:29 |
tosky | clarkb: so, just to summarize, is this part of the effoert for making sure refstack (server) works with a more modern stack, or do you want to continue with the containerization? Is there some additional document about this (maybe the logs of the -infra meetings, or an email I may have missed on the lists?) | 20:29 |
openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: Dockerfile: create a nodepool user with uid 10001 https://review.opendev.org/705497 | 20:29 |
openstackgerrit | Andreas Jaeger proposed openstack/os-performance-tools master: Fix docs building https://review.opendev.org/705543 | 20:29 |
openstackgerrit | Andreas Jaeger proposed openstack/os-performance-tools master: Fix docs building https://review.opendev.org/705543 | 20:31 |
clarkb | tosky: this started because we need to upgrade the server that refstack currently runs on. When I looked at the puppet I realized that much of it needed updating anyway so rather than invest in that I looked at conatinerizing it using our new deployment tooling | 20:34 |
clarkb | tosky: this only started on like friday so no meeting stuff yet | 20:34 |
clarkb | but it is related to the server upgrades topic that we've been having over recent meetings | 20:35 |
mordred | yah - but in general we're rolling out more containerized stuff across opendev | 20:35 |
clarkb | My concern is that I don't want to invest in modifying a lot of stuff for refstack if things on the development side are dead | 20:35 |
clarkb | I've basically shown what needs to be done to make refstack deployable in a modern state. But if we aren't able to maintain the software we should probably sunset the service instead of updating its deployment | 20:36 |
tosky | so containerize it as much as it is, like a fat application containerized, and not really a set of "micro"services? | 20:36 |
clarkb | tosky: no I've undone the fat application containerizing that is already in refstacki | 20:36 |
clarkb | in part because that dockerfile does not work | 20:36 |
mordred | yah. we like container-per-process | 20:36 |
clarkb | https://review.opendev.org/#/c/705258/ is what it currently looks like in system-config and that has simple testing that is working | 20:36 |
tosky | but haven't you mentioned some issues with apache earlier? | 20:36 |
tosky | I guess I should re-read it | 20:36 |
clarkb | tosky: I need to add apache to 258 | 20:37 |
clarkb | but it will not be added to the refstack dockerfile. that is orthogonal | 20:37 |
AJaeger | tosky: I think in this case a fat monolith is superior - and the right step. | 20:37 |
clarkb | the TODO add HTTPS is another way of saying "add apache" | 20:37 |
AJaeger | Btw. https://changelog.com/posts/monoliths-are-the-future is worth reading | 20:37 |
clarkb | AJaeger: you think a single container with mysql, apache, and refstack is better? | 20:38 |
*** jamesmcarthur has quit IRC | 20:38 | |
AJaeger | clarkb: no - a microservice would be 10 more container ;) | 20:38 |
tosky | I guess this is the vi vs emacs for the '20s | 20:38 |
AJaeger | clarkb: those three are "normal" | 20:38 |
tosky | but anyway | 20:38 |
tosky | is the set of non-WIP patches good enough already for a proper review, or may it change if the deployment part is changed? | 20:39 |
clarkb | tosky: the first two changes I expect are good enough for review. The third I think may be conversation worthy. | 20:39 |
tosky | oki | 20:40 |
mordred | AJaeger: I think there may be different definitions of "fat monolith" around here :) | 20:40 |
clarkb | I've sort of punted on the third by putting the dockerfile in system-config | 20:40 |
AJaeger | mordred: yeah ;) | 20:40 |
clarkb | beacuse I don't actually care how refstack the project wants to build its images as long as I can build one myself. And for that I need to fix bindep (second change) | 20:40 |
mordred | clarkb: ++ | 20:40 |
AJaeger | mordred: btw. could you find some reviewers for https://review.opendev.org/686590 , please? | 20:41 |
mordred | AJaeger: nice article | 20:41 |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: upload-afs: rename to upload-afs-roots; add afs-upload-synchronize https://review.opendev.org/705368 | 20:42 |
openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Remove deprecated upload-afs role https://review.opendev.org/705373 | 20:42 |
clarkb | tosky: from my side I just don't awnt to invest more time and resources in this if the end result is refstack is a dead end | 20:43 |
tosky | clarkb: I think there are still users, and what reported by diablo_rojo seems to confirm that | 20:43 |
openstackgerrit | Merged zuul/zuul master: Gerrit: poll for merged changes if no stream events https://review.opendev.org/705053 | 20:43 |
clarkb | so far I've justified the work because I've learned a lot and its been useful in that way, but I think I've got to the point where its going to be cookiecutter service replacement/upgrade that I've done a million times over so less interested in continuing unless upstream is maintained | 20:43 |
clarkb | tosky: yes there are users, but that doesn't matter if th softwrae isn't maintained and can't be made deployable | 20:44 |
tosky | clarkb: that's right, so let's try to fix it, I'd say | 20:44 |
diablo_rojo | clarkb, an update on figuring how to test the new server..I talked to egle and she said she didn't know what has been done in the past and referred me to Mark who also doesn't know what was done in the past but is digging into it. I also just realized hogepodge may have left details in his giant google doc status thing he wrote before he left that I will take a look at. | 20:45 |
clarkb | ok. The two basic things I need are correct workable bindep file (so that I can install deps in docker image build) and python3.7 support because python3.7 is what our base python images are built on | 20:45 |
clarkb | I think the second change covers ^ | 20:45 |
tosky | clarkb: is this (bindep,py37) something that can be tested also in the normal gates, without docker? | 20:46 |
clarkb | diablo_rojo: thanks thats the second TODO on my change above :) I'm hoping we can automate that at least for this aspect (then we'll likely do it by hand once deployed in prod) | 20:46 |
tosky | (I guess yes) | 20:46 |
clarkb | tosky: bindep should already be tested because the unittests use it. Python37 would require adding a new job (doable but not yet done) | 20:47 |
tosky | diablo_rojo: do you think that part of those content (the non-restricted ones) could be put $somewhere? | 20:47 |
diablo_rojo | tosky, yeah, once I have info I plan to add it to docs somewhere | 20:47 |
*** yboaron_ has quit IRC | 20:48 | |
*** eharney has joined #openstack-infra | 20:53 | |
openstackgerrit | Merged zuul/zuul master: Cap cheroot to fix issues with concurrent requests https://review.opendev.org/705459 | 20:54 |
openstackgerrit | Andreas Jaeger proposed openstack/os-performance-tools master: Fix docs building https://review.opendev.org/705543 | 20:59 |
openstackgerrit | Andreas Jaeger proposed openstack/os-performance-tools master: Fix docs building https://review.opendev.org/705543 | 21:04 |
openstackgerrit | Andreas Jaeger proposed openstack/os-performance-tools master: Fix docs building https://review.opendev.org/705543 | 21:14 |
*** Goneri has quit IRC | 21:16 | |
*** smarcet has quit IRC | 21:17 | |
clarkb | infra-root can I get reviews on https://review.opendev.org/#/c/705134/ I updated it to remove the no longer necessary auth_url line | 21:19 |
clarkb | I can watch that this afternoon if it goes in | 21:19 |
clarkb | once cloud setup is complete the next step will be to dobule check quotas and then add to nodepool config | 21:19 |
clarkb | thanks I've approved it | 21:24 |
*** harlowja has quit IRC | 21:25 | |
*** nicolasbock has quit IRC | 21:29 | |
johnsom | Is there a path forward for stable branch log files that are in gzip format? Example: https://zuul.opendev.org/t/openstack/build/3f8e35e4e7fe4b18bd4a86609cf7d191/log/logs/devstacklog.txt.gz | 21:33 |
johnsom | Oh, I see that was from the 25th, so maybe fixed? | 21:35 |
openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Use unique loop vars to avoid conflicts https://review.opendev.org/705337 | 21:35 |
clarkb | johnsom: I sent email at the beginning of the year to oepnstack-discuss.Long story short stop explicitly compressing in the jobs | 21:36 |
clarkb | you should only compress when the file is a compressed file type like a .tar.gz tarball | 21:36 |
johnsom | Yeah, saw that, but I thought it said "we are fixing thise" | 21:36 |
johnsom | Oh, I am a dork. Sorry, that was a neutron-lbaas job, so pre-zuul3 probably. | 21:37 |
johnsom | Fun with deprecated code and stable branches. | 21:37 |
clarkb | no, I didn't promise to fix things. I think we thought devstack zuulv3 was already good to go | 21:37 |
clarkb | just legacy jobs and we expect people to fix those by deleting them | 21:37 |
openstackgerrit | Merged zuul/zuul master: Add google-cloud-storage to executor ansible https://review.opendev.org/705279 | 21:38 |
fungi | tosky: clarkb: mordred: to be clear, hosting for refstack *probably* will always remain an openstack-infra thing and not an opendev thing, since it's clearly very openstack-specific | 21:46 |
fungi | also, yes, deletion is the ultimate "fix" for all legacy pre-zuulv3 jobs | 21:47 |
clarkb | fungi: yes, but if the software isnt maintaned nor deployable it wont be an opemstack-infra thing either | 21:48 |
clarkb | that is my concern, I dont want to invest further in deploying it unless it is maintained and that seems to be a bit in thr air | 21:48 |
fungi | oh, totally | 21:49 |
*** artom has joined #openstack-infra | 21:49 | |
fungi | was just trying to clarify with mordred's (i think) comment about opendev switching to containery things | 21:49 |
fungi | it logically follows that openstack-infra probably should follow suit, but we have to take care not to conflate the two | 21:50 |
clarkb | fungi: fwiw I got it as far as running the service via docker compose last week. Need to add web server proxy with ssl termination as well as some functional testing | 21:50 |
fungi | awesome! | 21:50 |
fungi | sorry i've been useless over the weekend | 21:50 |
clarkb | I have zero interest in updating the puppet for this service if someone else wants to take that apprpach they may do so | 21:50 |
clarkb | I looked an realizedut needed some big updates for nodejs stuff | 21:50 |
fungi | yeah, i caught some of that | 21:51 |
fungi | excellent work | 21:51 |
clarkb | but my progress requires updates to refstack | 21:51 |
fungi | i'm willing to pitch in there once i get home, recover and file expense reports | 21:52 |
*** dpawlik has quit IRC | 21:53 | |
*** jamesmcarthur has joined #openstack-infra | 21:53 | |
openstackgerrit | Merged opendev/system-config master: Add airship CI cloud https://review.opendev.org/705134 | 21:59 |
*** slaweq has quit IRC | 22:02 | |
*** mattw4 has quit IRC | 22:09 | |
*** mattw4 has joined #openstack-infra | 22:09 | |
*** slaweq has joined #openstack-infra | 22:11 | |
*** slaweq has quit IRC | 22:16 | |
mordred | fungi: yes - good point re: not conflating opendev/openstack-infra | 22:17 |
*** sreejithp has quit IRC | 22:18 | |
clarkb | tosky: diablo_rojo the functional testing is the other bit beacuse I don't want to do a fairly major upgrade and not be able to confrim it is working afterwords. I think what we want is some fake data we can submit both in our gate testing and in production as well as directions on how to do that (I'm assuming the actual submission process is documented for users so I can find that, but I don't have | 22:21 |
clarkb | acloud to generate the data against) | 22:21 |
*** dchen has joined #openstack-infra | 22:21 | |
tosky | I need to recheck, but I think it's not difficult to gather some test data | 22:22 |
diablo_rojo | clarkb, yeah I think that info of adding a submission is documented. Danny can probably get you that if you can't find it anywhere. | 22:24 |
*** mattw4 has quit IRC | 22:29 | |
*** mattw4 has joined #openstack-infra | 22:29 | |
*** xek has quit IRC | 22:29 | |
*** jamesmcarthur has quit IRC | 22:32 | |
*** rfolco has quit IRC | 22:36 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: use-buildset-registry: disable docker userland proxy https://review.opendev.org/702753 | 22:36 |
*** dciabrin has quit IRC | 22:38 | |
*** dciabrin has joined #openstack-infra | 22:43 | |
openstackgerrit | Merged zuul/zuul master: Fix github app authentication to work with checks API endpoints https://review.opendev.org/705167 | 22:46 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add tenant reconfiguration when main.yaml changed https://review.opendev.org/703631 | 22:46 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add CONTRIBUTE file https://review.opendev.org/705535 | 22:46 |
*** tkajinam has joined #openstack-infra | 22:53 | |
openstackgerrit | Merged zuul/zuul master: Add some debug lines for provides/requires https://review.opendev.org/705313 | 23:00 |
clarkb | our run_all.sh loop seems to be getting slow again. Current run is at 2 hours | 23:08 |
clarkb | logs seem to jump from 21:01:46 to 23:01:47 | 23:09 |
clarkb | From PLAY [Base: set up users and base package repositories on all hosts] *********** to PLAY [Bridge: configure the bastion host] ************************************** | 23:10 |
clarkb | I guess we aren't logging what it does to setup users and base package repos? | 23:10 |
clarkb | does ^ make sense to anyone | 23:10 |
clarkb | the current run_all.sh script started at 21:00 fwiw | 23:10 |
clarkb | (so not two loops there) | 23:10 |
*** slaweq has joined #openstack-infra | 23:11 | |
*** jamesmcarthur has joined #openstack-infra | 23:11 | |
ianw | clarkb: that should be graphed ... | 23:14 |
ianw | http://grafana.openstack.org/d/qzQ_v2oiz/bridge-runtime?orgId=1 looks disappointingly empty :/ | 23:15 |
*** slaweq has quit IRC | 23:15 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: DNM: install-docker: enable setting docker userland proxy https://review.opendev.org/702753 | 23:16 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add OpenShift SCC and functional test https://review.opendev.org/702758 | 23:16 |
*** jamesmcarthur has quit IRC | 23:17 | |
ianw | everything looks disappointingly empty ... it's either me or something up with graphite | 23:17 |
clarkb | no its sad for me too | 23:18 |
clarkb | I get "no data" | 23:18 |
ianw | i'm guessing graphite.opendev.org has crashed ... let me see if any console | 23:20 |
openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add upload-logs-gcs role https://review.opendev.org/703711 | 23:20 |
openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add index_links option to zuul manifest https://review.opendev.org/705580 | 23:20 |
ianw | yeah, stuff about hung i/o processes ... kicking it now | 23:22 |
clarkb | thanks | 23:22 |
*** pkopec has quit IRC | 23:22 | |
*** hashar has quit IRC | 23:26 | |
ianw | http://grafana.openstack.org/d/qzQ_v2oiz/bridge-runtime?orgId=1&from=now-60d&to=now ... definitely periods where something goes astray, but a very slow upward trend | 23:26 |
ianw | #status log rebooted graphite.opendev.org due to it being hung with storage i/o errors | 23:26 |
openstackstatus | ianw: finished logging | 23:26 |
ianw | looks like pretty standard rax-migrated-but-it-didn't-really-work crash | 23:27 |
*** harlowja has joined #openstack-infra | 23:28 | |
*** jaosorior has quit IRC | 23:34 | |
openstackgerrit | James E. Blair proposed zuul/zuul master: web: link to index.html if index_links is set https://review.opendev.org/705585 | 23:45 |
ianw | corvus: so looking, i think that having afs_target set with {{ zuul.project.name}} in https://review.opendev.org/#/c/705374/1/playbooks/publish/openstack-artifacts-with-afs.yaml should be sufficient to stop any users of the publish jobs from writing elsewhere. they can't override this? | 23:47 |
*** jaosorior has joined #openstack-infra | 23:49 | |
clarkb | ianw: I wonder if the run_all.sh stalled out on reporting to graphite? | 23:53 |
clarkb | thats udp though and should be fire and forget? | 23:53 |
ianw | clarkb: yep, udp send for that ... fire and hope it gets there :) | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!