*** zbr has quit IRC | 00:09 | |
*** slaweq has joined #openstack-infra | 00:11 | |
*** rkukura has quit IRC | 00:11 | |
*** rkukura has joined #openstack-infra | 00:15 | |
*** slaweq has quit IRC | 00:16 | |
*** kjackal has quit IRC | 00:27 | |
*** ociuhandu has joined #openstack-infra | 00:28 | |
*** ociuhandu has quit IRC | 00:39 | |
*** kjackal has joined #openstack-infra | 00:43 | |
*** mriedem has quit IRC | 00:44 | |
*** Wryhder has joined #openstack-infra | 00:53 | |
*** yoctozepto has quit IRC | 00:53 | |
*** Lucas_Gray has quit IRC | 00:54 | |
*** yoctozepto has joined #openstack-infra | 00:54 | |
*** Wryhder is now known as Lucas_Gray | 00:54 | |
*** kjackal has quit IRC | 01:02 | |
*** yoctozepto has quit IRC | 01:05 | |
*** yoctozepto has joined #openstack-infra | 01:05 | |
*** rkukura has quit IRC | 01:08 | |
*** rkukura has joined #openstack-infra | 01:12 | |
*** ociuhandu has joined #openstack-infra | 01:14 | |
mordred | infra-root: https://github.com/wagoodman/dive is an interesting tool to poke around and look at docker images | 01:18 |
---|---|---|
*** ociuhandu has quit IRC | 01:18 | |
*** lbragstad_ has joined #openstack-infra | 01:24 | |
*** lbragstad has quit IRC | 01:26 | |
*** rh-jelabarre has quit IRC | 01:27 | |
*** rfolco has quit IRC | 01:54 | |
*** ociuhandu has joined #openstack-infra | 01:57 | |
*** ociuhandu has quit IRC | 02:08 | |
*** rlandy|ruck|bbl is now known as rlandy|ruck | 02:11 | |
*** slaweq has joined #openstack-infra | 02:11 | |
*** slaweq has quit IRC | 02:16 | |
*** Lucas_Gray has quit IRC | 02:18 | |
*** roman_g has quit IRC | 02:34 | |
*** rlandy|ruck has quit IRC | 02:34 | |
*** ociuhandu has joined #openstack-infra | 02:46 | |
*** ociuhandu has quit IRC | 02:51 | |
*** rcernin_ has joined #openstack-infra | 03:00 | |
*** rcernin has quit IRC | 03:03 | |
*** apetrich has quit IRC | 03:08 | |
*** kjackal has joined #openstack-infra | 03:13 | |
*** rkukura has quit IRC | 03:18 | |
*** rcernin_ has quit IRC | 03:26 | |
*** rcernin has joined #openstack-infra | 03:26 | |
*** yamamoto has joined #openstack-infra | 03:31 | |
*** yamamoto has quit IRC | 03:36 | |
*** udesale has joined #openstack-infra | 03:41 | |
*** udesale has quit IRC | 03:45 | |
*** udesale has joined #openstack-infra | 03:46 | |
*** yamamoto has joined #openstack-infra | 03:48 | |
openstackgerrit | Colleen Murphy proposed opendev/irc-meetings master: Remove keystone team office hours https://review.opendev.org/693763 | 03:56 |
*** slaweq has joined #openstack-infra | 04:11 | |
*** slaweq has quit IRC | 04:16 | |
*** ykarel|away has joined #openstack-infra | 04:25 | |
*** tkajinam_ has joined #openstack-infra | 04:29 | |
*** ykarel|away is now known as ykarel | 04:31 | |
*** tkajinam has quit IRC | 04:32 | |
*** ociuhandu has joined #openstack-infra | 04:34 | |
*** ociuhandu has quit IRC | 04:41 | |
*** kjackal has quit IRC | 04:45 | |
*** tkajinam_ has quit IRC | 04:58 | |
*** tkajinam has joined #openstack-infra | 04:59 | |
*** surpatil has joined #openstack-infra | 05:15 | |
*** slaweq has joined #openstack-infra | 05:26 | |
*** rkukura has joined #openstack-infra | 05:30 | |
*** ociuhandu has joined #openstack-infra | 05:30 | |
*** ociuhandu has quit IRC | 05:35 | |
*** udesale has quit IRC | 05:43 | |
*** udesale has joined #openstack-infra | 05:43 | |
*** udesale has quit IRC | 05:44 | |
*** udesale has joined #openstack-infra | 05:44 | |
*** lpetrut has joined #openstack-infra | 06:33 | |
*** lpetrut has quit IRC | 06:34 | |
*** lpetrut has joined #openstack-infra | 06:35 | |
*** dpawlik has joined #openstack-infra | 06:49 | |
*** dpawlik has quit IRC | 06:55 | |
*** armax has quit IRC | 07:01 | |
*** udesale has quit IRC | 07:03 | |
*** udesale has joined #openstack-infra | 07:04 | |
*** ociuhandu has joined #openstack-infra | 07:10 | |
*** ociuhandu has quit IRC | 07:10 | |
*** ociuhandu has joined #openstack-infra | 07:11 | |
*** dpawlik has joined #openstack-infra | 07:14 | |
*** ociuhandu has quit IRC | 07:16 | |
*** rcernin has quit IRC | 07:22 | |
*** piotrowskim has joined #openstack-infra | 07:34 | |
*** trident has quit IRC | 07:37 | |
*** apetrich has joined #openstack-infra | 07:43 | |
*** jpena|off is now known as jpena | 07:46 | |
*** iurygregory has joined #openstack-infra | 07:46 | |
*** ociuhandu has joined #openstack-infra | 07:48 | |
*** trident has joined #openstack-infra | 07:48 | |
*** tosky has joined #openstack-infra | 07:52 | |
yoctozepto | AJaeger: yeah, ironic folks only know it is notmyname behind the bot implementation but other knowledge seems to be gone :-) I contacted notmyname and await response | 07:52 |
*** yamamoto has quit IRC | 07:53 | |
*** ociuhandu has quit IRC | 07:54 | |
*** yamamoto has joined #openstack-infra | 07:58 | |
*** yamamoto has quit IRC | 08:01 | |
*** dchen has quit IRC | 08:01 | |
*** dchen has joined #openstack-infra | 08:03 | |
*** yamamoto has joined #openstack-infra | 08:08 | |
*** adriant has quit IRC | 08:08 | |
*** iokiwi has quit IRC | 08:08 | |
*** yamamoto has quit IRC | 08:09 | |
*** tesseract has joined #openstack-infra | 08:11 | |
*** ralonsoh has joined #openstack-infra | 08:14 | |
*** dchen has quit IRC | 08:15 | |
*** pgaxatte has joined #openstack-infra | 08:25 | |
*** zbr has joined #openstack-infra | 08:30 | |
*** dpawlik has quit IRC | 08:31 | |
*** tosky has quit IRC | 08:32 | |
*** dpawlik has joined #openstack-infra | 08:34 | |
*** zbr has quit IRC | 08:35 | |
*** zbr has joined #openstack-infra | 08:36 | |
*** tosky has joined #openstack-infra | 08:37 | |
*** tkajinam has quit IRC | 08:37 | |
*** amoralej|off is now known as amoralej | 08:38 | |
*** yamamoto has joined #openstack-infra | 08:41 | |
*** yamamoto has quit IRC | 08:46 | |
*** dtantsur|afk is now known as dtantsur | 08:48 | |
*** priteau has joined #openstack-infra | 08:58 | |
*** pkopec has joined #openstack-infra | 08:58 | |
*** rpittau|afk is now known as rpittau | 08:59 | |
*** ociuhandu has joined #openstack-infra | 09:01 | |
openstackgerrit | Merged opendev/irc-meetings master: Remove keystone team office hours https://review.opendev.org/693763 | 09:07 |
*** xek_ has joined #openstack-infra | 09:09 | |
*** yamamoto has joined #openstack-infra | 09:13 | |
*** iurygregory has quit IRC | 09:17 | |
*** iurygregory has joined #openstack-infra | 09:18 | |
*** ykarel is now known as ykarel|lunch | 09:23 | |
*** sshnaidm|off is now known as sshnaidm|rover | 09:30 | |
*** ociuhandu has quit IRC | 09:30 | |
*** ociuhandu has joined #openstack-infra | 09:31 | |
*** irclogbot_0 has quit IRC | 09:39 | |
*** irclogbot_0 has joined #openstack-infra | 09:40 | |
*** tosky has quit IRC | 09:41 | |
*** tosky has joined #openstack-infra | 09:42 | |
*** ociuhandu has quit IRC | 09:42 | |
*** ociuhandu has joined #openstack-infra | 09:44 | |
*** yamamoto has quit IRC | 09:44 | |
*** rcernin has joined #openstack-infra | 09:44 | |
*** apetrich has quit IRC | 09:47 | |
*** jaosorior has joined #openstack-infra | 09:51 | |
*** tosky_ has joined #openstack-infra | 09:52 | |
*** ociuhandu has quit IRC | 09:53 | |
*** yamamoto has joined #openstack-infra | 09:53 | |
*** ociuhandu has joined #openstack-infra | 09:54 | |
*** tosky has quit IRC | 09:54 | |
*** ociuhandu has quit IRC | 09:55 | |
*** ociuhandu has joined #openstack-infra | 09:56 | |
*** yamamoto_ has joined #openstack-infra | 09:56 | |
*** yamamoto has quit IRC | 09:57 | |
*** ociuhandu has quit IRC | 09:57 | |
*** tosky has joined #openstack-infra | 09:58 | |
*** ociuhandu has joined #openstack-infra | 09:58 | |
*** apetrich has joined #openstack-infra | 09:59 | |
*** ociuhandu has quit IRC | 10:00 | |
*** ociuhandu has joined #openstack-infra | 10:01 | |
*** tosky_ has quit IRC | 10:01 | |
*** ociuhandu has quit IRC | 10:02 | |
*** yamamoto_ has quit IRC | 10:02 | |
*** ociuhandu has joined #openstack-infra | 10:03 | |
*** gfidente|afk is now known as gfidente | 10:03 | |
*** tosky_ has joined #openstack-infra | 10:05 | |
*** tosky has quit IRC | 10:08 | |
*** ociuhandu has quit IRC | 10:08 | |
*** rfolco has joined #openstack-infra | 10:08 | |
*** soniya29 has joined #openstack-infra | 10:10 | |
*** rcernin has quit IRC | 10:11 | |
*** tosky has joined #openstack-infra | 10:14 | |
*** tosky_ has quit IRC | 10:17 | |
*** tosky_ has joined #openstack-infra | 10:21 | |
*** tosky has quit IRC | 10:24 | |
*** panda has quit IRC | 10:24 | |
*** yamamoto has joined #openstack-infra | 10:29 | |
*** panda has joined #openstack-infra | 10:29 | |
*** yamamoto has quit IRC | 10:29 | |
*** vesper has quit IRC | 10:30 | |
*** vesper11 has joined #openstack-infra | 10:31 | |
*** tosky has joined #openstack-infra | 10:34 | |
*** tosky_ has quit IRC | 10:36 | |
*** soniya29 has quit IRC | 10:37 | |
*** tosky_ has joined #openstack-infra | 10:43 | |
*** tosky has quit IRC | 10:45 | |
*** ykarel|lunch has quit IRC | 10:46 | |
*** tosky_ has quit IRC | 10:46 | |
*** tosky has joined #openstack-infra | 10:46 | |
*** yamamoto has joined #openstack-infra | 10:47 | |
*** dpawlik has quit IRC | 10:47 | |
*** ociuhandu has joined #openstack-infra | 10:48 | |
*** rcernin has joined #openstack-infra | 10:49 | |
*** hashar has joined #openstack-infra | 10:51 | |
*** ociuhandu has quit IRC | 10:54 | |
*** yamamoto has quit IRC | 11:01 | |
*** tosky has quit IRC | 11:01 | |
*** tosky has joined #openstack-infra | 11:01 | |
*** tosky_ has joined #openstack-infra | 11:05 | |
*** tosky has quit IRC | 11:06 | |
*** tosky_ has quit IRC | 11:09 | |
*** tosky has joined #openstack-infra | 11:09 | |
*** jaosorior has quit IRC | 11:10 | |
*** xek_ has quit IRC | 11:12 | |
*** dpawlik has joined #openstack-infra | 11:15 | |
*** ykarel|lunch has joined #openstack-infra | 11:15 | |
*** udesale has quit IRC | 11:17 | |
*** tosky has quit IRC | 11:17 | |
*** ykarel|lunch is now known as ykarel | 11:18 | |
*** dpawlik has quit IRC | 11:19 | |
*** kjackal has joined #openstack-infra | 11:20 | |
*** tosky has joined #openstack-infra | 11:23 | |
*** roman_g has joined #openstack-infra | 11:26 | |
*** rcernin has quit IRC | 11:26 | |
*** dpawlik has joined #openstack-infra | 11:27 | |
zbr | clarkb: let me know when you are back, i want to explain bindep *role* issue. | 11:31 |
*** ramishra has quit IRC | 11:35 | |
*** hashar has quit IRC | 11:38 | |
*** surpatil has quit IRC | 11:40 | |
*** aedc_ has joined #openstack-infra | 11:46 | |
*** aedc has quit IRC | 11:47 | |
*** tosky_ has joined #openstack-infra | 11:47 | |
*** ykarel_ has joined #openstack-infra | 11:49 | |
*** tosky has quit IRC | 11:49 | |
*** tosky has joined #openstack-infra | 11:50 | |
*** ykarel has quit IRC | 11:51 | |
*** tosky_ has quit IRC | 11:53 | |
*** aedc_ has quit IRC | 11:53 | |
*** surpatil has joined #openstack-infra | 12:00 | |
*** yamamoto has joined #openstack-infra | 12:09 | |
*** Lucas_Gray has joined #openstack-infra | 12:11 | |
*** dpawlik has quit IRC | 12:12 | |
*** jpena is now known as jpena|lunch | 12:26 | |
*** amoralej is now known as amoralej|lunch | 12:27 | |
*** ykarel_ is now known as ykarel|afk | 12:28 | |
*** ssbarnea has quit IRC | 12:38 | |
*** dpawlik has joined #openstack-infra | 12:39 | |
*** openstackgerrit has quit IRC | 12:41 | |
*** dpawlik has quit IRC | 12:44 | |
*** yamamoto has quit IRC | 12:44 | |
*** ociuhandu has joined #openstack-infra | 12:46 | |
*** dpawlik has joined #openstack-infra | 12:47 | |
*** ykarel_ has joined #openstack-infra | 12:49 | |
*** rlandy has joined #openstack-infra | 12:50 | |
*** ociuhandu has quit IRC | 12:50 | |
*** ykarel|afk has quit IRC | 12:52 | |
*** ykarel_ is now known as ykarel|afk | 12:53 | |
*** rlandy is now known as rlandy|ruck | 12:54 | |
*** weshay|rover is now known as weshay | 12:54 | |
*** sshnaidm|rover is now known as sshnaidm|ruck | 12:55 | |
*** rlandy|ruck is now known as rlandy|over | 12:55 | |
*** rlandy|over is now known as rlandy|rover | 12:56 | |
*** jaosorior has joined #openstack-infra | 12:57 | |
*** surpatil has quit IRC | 13:00 | |
*** liuyulong has joined #openstack-infra | 13:02 | |
*** soniya29 has joined #openstack-infra | 13:03 | |
*** eharney has quit IRC | 13:04 | |
*** rh-jelabarre has joined #openstack-infra | 13:07 | |
noonedeadpunk | hey:) it looks like gerrit bot died :( | 13:10 |
*** eharney has joined #openstack-infra | 13:12 | |
fungi | noonedeadpunk: indeed, i'll prod it now | 13:13 |
fungi | #status log restarted gerritbot after it hit a freenode ping timeout at 12:41:15 | 13:15 |
openstackstatus | fungi: finished logging | 13:15 |
*** ociuhandu has joined #openstack-infra | 13:16 | |
*** carl_cai has joined #openstack-infra | 13:17 | |
*** ssbarnea has joined #openstack-infra | 13:18 | |
*** soniya29 has quit IRC | 13:22 | |
*** jpena|lunch is now known as jpena | 13:27 | |
*** mriedem has joined #openstack-infra | 13:37 | |
*** ociuhandu has quit IRC | 13:38 | |
*** ociuhandu has joined #openstack-infra | 13:39 | |
*** amoralej|lunch is now known as amoralej | 13:39 | |
*** ociuhandu has quit IRC | 13:44 | |
*** rlandy|rover is now known as rlandy|rover|mtg | 13:45 | |
*** Goneri has joined #openstack-infra | 13:48 | |
*** dpawlik has quit IRC | 13:57 | |
*** dpawlik has joined #openstack-infra | 13:58 | |
*** Lucas_Gray has quit IRC | 13:59 | |
*** rlandy|rover|mtg is now known as rlandy|rover | 13:59 | |
*** Lucas_Gray has joined #openstack-infra | 14:00 | |
*** Lucas_Gray has quit IRC | 14:01 | |
*** ykarel|afk is now known as ykarel | 14:02 | |
*** ociuhandu has joined #openstack-infra | 14:02 | |
*** priteau has quit IRC | 14:04 | |
*** dpawlik has quit IRC | 14:06 | |
*** xek_ has joined #openstack-infra | 14:07 | |
*** dpawlik has joined #openstack-infra | 14:09 | |
*** ociuhandu has quit IRC | 14:13 | |
*** ociuhandu has joined #openstack-infra | 14:14 | |
*** ociuhandu has quit IRC | 14:19 | |
*** ykarel_ has joined #openstack-infra | 14:19 | |
*** dpawlik has quit IRC | 14:20 | |
*** dpawlik has joined #openstack-infra | 14:21 | |
*** ykarel has quit IRC | 14:22 | |
*** eharney has quit IRC | 14:23 | |
*** goldyfruit has joined #openstack-infra | 14:44 | |
*** openstackgerrit has joined #openstack-infra | 14:47 | |
openstackgerrit | Tobias Henkel proposed zuul/nodepool master: Delete images by id https://review.opendev.org/693672 | 14:47 |
*** michael-beaver has joined #openstack-infra | 14:51 | |
*** ociuhandu has joined #openstack-infra | 14:56 | |
*** ykarel_ is now known as ykarel|afk | 14:59 | |
*** tosky_ has joined #openstack-infra | 15:00 | |
openstackgerrit | Corey Bryant proposed openstack/openstack-zuul-jobs master: Add non-voting tox py38 jobs to Ussuri templates https://review.opendev.org/693401 | 15:00 |
*** tosky has quit IRC | 15:00 | |
*** ociuhandu has quit IRC | 15:00 | |
*** tosky_ is now known as tosky | 15:01 | |
*** raschid has joined #openstack-infra | 15:03 | |
*** eharney has joined #openstack-infra | 15:05 | |
*** dpawlik has quit IRC | 15:06 | |
*** eharney has quit IRC | 15:17 | |
*** lbragstad_ is now known as lbragstad | 15:20 | |
*** kjackal has quit IRC | 15:21 | |
*** rfolco is now known as rfolco|brbr | 15:22 | |
*** rfolco|brbr is now known as rfolco|brb | 15:22 | |
*** carl_cai has quit IRC | 15:26 | |
*** armax has joined #openstack-infra | 15:27 | |
*** pcaruana has joined #openstack-infra | 15:28 | |
*** eharney has joined #openstack-infra | 15:30 | |
*** sreejithp has joined #openstack-infra | 15:30 | |
*** tosky has quit IRC | 15:31 | |
*** tosky has joined #openstack-infra | 15:32 | |
*** aedc has joined #openstack-infra | 15:39 | |
*** ociuhandu has joined #openstack-infra | 15:44 | |
*** ociuhandu has quit IRC | 15:44 | |
*** ociuhandu has joined #openstack-infra | 15:46 | |
*** ociuhandu has quit IRC | 15:53 | |
*** ykarel|afk is now known as ykarel | 16:05 | |
*** jhesketh has quit IRC | 16:05 | |
*** lpetrut has quit IRC | 16:10 | |
*** sreejithp_ has joined #openstack-infra | 16:15 | |
*** gyee has joined #openstack-infra | 16:15 | |
*** sreejithp has quit IRC | 16:17 | |
*** jaosorior has quit IRC | 16:18 | |
*** jhesketh has joined #openstack-infra | 16:21 | |
*** tesseract has quit IRC | 16:32 | |
*** ociuhandu has joined #openstack-infra | 16:33 | |
*** ociuhandu has quit IRC | 16:33 | |
*** ociuhandu has joined #openstack-infra | 16:34 | |
*** ociuhandu has quit IRC | 16:40 | |
clarkb | zbr: reading scrollback in #zuul I think you and pabelanger may have sorted out that a bootstrap playbook is appropriate? | 16:44 |
zbr | clarkb: not really, the virtualenv issue was more of a red herring in that case. | 16:45 |
zbr | the real issue is that "bindep role" fails to install deps even if the bindep.txt is valid. | 16:46 |
*** jpena is now known as jpena|off | 16:46 | |
clarkb | zbr: because bindep doesn't understand how to bootstrap additional repos | 16:46 |
clarkb | this is true of PPAs or epel | 16:46 |
clarkb | I think it is outside of the scope of bindeps current design to have it try and solve that, instead you should configure needed repos prior | 16:46 |
zbr | clarkb: its not bindep job to do this, but installing first package does activate the repository | 16:46 |
*** ociuhandu has joined #openstack-infra | 16:47 | |
zbr | true, outside the scope of bindep, but not outside the scope of bindep-role | 16:47 |
zbr | if I use "yum install epel-release && yum install re2-devel" it works. | 16:47 |
clarkb | except that will get you epel not using our mirrors | 16:47 |
clarkb | and that is unreliable | 16:47 |
zbr | mirror support was never in bindep role spec. one could question why not using http proxies, still lets try to find a solution. | 16:49 |
clarkb | right something other than bindep should ensure that epel is configured prior to running the bindep role | 16:49 |
clarkb | this is my point | 16:49 |
clarkb | then you can properly configure mirrors or an http proxy or whatever else is appropriate for your CI system | 16:49 |
zbr | from the UX point of view, a developer would list packages under bindep.txt -- especatatio is to get CI to install them | 16:49 |
zbr | why? installing "epel-release" package is enabling this repository, this default system behavior. is not some new feature. | 16:50 |
zbr | (the disabled epel is something else which needs to be sorted outside bindep, i do agree on that aspect) | 16:51 |
AJaeger | clarkb: do you have time to discuss next step for the opensuse-15 nodes - or should I ask you later this week? | 16:51 |
clarkb | because in at least one case (mine) I don't want to just enable that repo. I want to consume it from our mirrors because we know the upstream is unreliable | 16:51 |
*** artom has joined #openstack-infra | 16:51 | |
clarkb | enabling epel in the manner you describe is bad for my system | 16:51 |
clarkb | AJaeger: I was going to ask you about that today too so today is fine | 16:51 |
*** ociuhandu has quit IRC | 16:52 | |
zbr | i hope i do not annoy you too much but my impression was that our CI is aiming to test supported configuration of various distros. the default scenario is installing the package. | 16:53 |
zbr | so your personal use case may be convenient for you but is not an official supported channel | 16:53 |
clarkb | zbr: we try to strike a balance between reliability and defaults | 16:53 |
AJaeger | clarkb: https://review.opendev.org/#/q/status:open+topic:use-opensuse-15 is the list, we need to force-merge IMHO the two glance changes. I stacked Dirk's changes and suggest you abandon your two open ones in favor of dirk's. | 16:53 |
zbr | (i know well why you want caching, not debating this) | 16:53 |
zbr | clarkb: well said. is a trade-off | 16:53 |
clarkb | zbr: and I don't think there is any problem with simply having something configure the needed repos prior to running bindep | 16:54 |
AJaeger | clarkb: once the glance are in, it's devstack and tempest - and then infra ;) | 16:54 |
clarkb | zbr: in my case that means configuring the mirrors. In your case it may mean using the defaults | 16:54 |
clarkb | zbr: both should be fine for bindep | 16:54 |
clarkb | there is no conflict | 16:54 |
clarkb | AJaeger: ok I can abandon mine then look at merging the glance changes | 16:54 |
zbr | still the average developer knows to populate bindep.txt file, do we expect them to alter lots of CI jobs to make it work? | 16:55 |
*** mgutehall has joined #openstack-infra | 16:55 | |
AJaeger | clarkb: we should check with glance folks but their PTL is not around right now | 16:55 |
AJaeger | clarkb: so, that's all ;) | 16:55 |
zbr | i was trying to find a solution where the developer is not forced to update zuul job definitions to make it work. the expectation is that zuul will load the bindep.txt file and install what is mentioned there.] | 16:55 |
artom | o/ Possibly the wrong place to ask, but I have a question about the best place to define a nodeset that's going to be shared between different projects. So for example Nova and a tempest plugin (https://review.opendev.org/#/c/691062/56/.zuul.yaml@3 specifically). Do we just just define the nodeset in one of those, and have the other use it? Or is there like a "central repository" for shared nodeset definitions? | 16:56 |
clarkb | AJaeger: abandon https://review.opendev.org/#/c/690438/ and https://review.opendev.org/#/c/690435/ ? | 16:56 |
zbr | can we do it? (me trying to avoid future work on other repos) | 16:56 |
clarkb | zbr: if a developer runs bindep locally they won't get the behavior your are trying to bake into the bindep role | 16:56 |
AJaeger | clarkb: yes, those two | 16:56 |
clarkb | zbr: I don't think your proposal addresses that concern | 16:56 |
clarkb | zbr: so you've still only solved it for the ci case | 16:57 |
clarkb | and if we are going to solve a ci specific case imo we should do that for the ci case then which means mirrors etc | 16:57 |
zbr | funny part is that we already have epel installed on the images, but disabled | 16:57 |
clarkb | artom: there is a central repo that defines nodesets: openstack/openstack-zuul-jobs | 16:57 |
AJaeger | artom: define it together with the job that needs it. | 16:57 |
AJaeger | clarkb: in this specific case, I don't think we need it in openstack-zuul-jobs, the nodeset is very special IMHO | 16:58 |
zbr | i could do "if epel-release inside bindep output, activate repo", but I guess you may not like it. | 16:58 |
clarkb | AJaeger: ya probably better in the job specific location | 16:58 |
artom | clarkb, AJaeger, it is pretty niche, yeah. But two proposed patches have it: https://review.opendev.org/#/c/679656/13/.zuul.yaml and https://review.opendev.org/#/c/691062/56/.zuul.yaml | 16:58 |
clarkb | zbr: what is the problem with having a "enable-epel" role run in jobs if you need epel? | 16:58 |
artom | So just... stick in one of them, and whichever merges first wins? | 16:58 |
clarkb | artom: I would only put it in one. Use depends-on | 17:00 |
zbr | clarkb: extra maintainance, that's all. if we need that for very few jobs not a problem, but if that explodes, it may need altering lots of job definitions, that's all. | 17:00 |
*** rpittau is now known as rpittau|afk | 17:00 | |
zbr | probably we want a generic option to enable/add extra repositories, not a special one for epel? | 17:01 |
artom | clarkb, understood, thanks! Also, do you have any idea what Sean's talking about when he mentions the new multi numa labels, that are presumably replacing the ubuntu-bionic-expanded one? | 17:01 |
clarkb | zbr: ya and possible it falls under the existing rewrite of mirror configuration for jobs | 17:01 |
AJaeger | artom: since nova job is inherited in whitebox put the nodeset to the *parent* which isi nova | 17:02 |
zbr | likely I would create an ensure-repo that gets a list of repos to enable. 1st version would support only epel. | 17:02 |
clarkb | mostly I want to avoid making a simple thing that doesn't actually solve what users need (and in my case that means configuring epel to use a mirror and not simply relying on the upstream) | 17:02 |
*** pgaxatte has quit IRC | 17:02 | |
zbr | but at least we could build on top of it later. | 17:02 |
artom | AJaeger, wait, nova job is inherited in whitebox? I... don't think so? :) At least not intentionally | 17:02 |
*** dtantsur is now known as dtantsur|afk | 17:02 | |
artom | I'll probably put it in whitebox - the Nova patch I have no idea when/if it'll ever merge | 17:02 |
AJaeger | artom: nova is parent job, whitebox is child and thus inherits. | 17:02 |
artom | Whereas whitebox it's just me and Sean, so we should get it in fairly quickly | 17:03 |
AJaeger | artom: sorry, not parent job. Misread line | 17:03 |
artom | AJaeger, but the whitebox job inherits from tempest-multinode-py3-full... | 17:03 |
*** Tengu has quit IRC | 17:03 | |
*** pcaruana has quit IRC | 17:03 | |
AJaeger | artom: or name them differently... | 17:04 |
zbr | clarkb: where is the mirror config for jobs? maybe i can alter this to enable epel optionally. | 17:04 |
artom | AJaeger, yeah eh? It's not like we're consuming any additional resources by naming them differently. I just have this idea in my head that if 2 things are the same they should be called the same :) | 17:05 |
*** ociuhandu has joined #openstack-infra | 17:05 | |
*** Tengu has joined #openstack-infra | 17:05 | |
clarkb | zbr: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/configure-mirrors via https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/base/pre.yaml#L35 | 17:05 |
*** Tengu has quit IRC | 17:06 | |
*** iurygregory has quit IRC | 17:06 | |
AJaeger | artom: you can also: Add to whitebox with different name, merge, once nova merged: remove nodeset from whitebox and use common definition ;) | 17:06 |
clarkb | AJaeger: looking at the 150 changes we need the glance ones in before the depends on for tempest and devstack are satisfied. I agree would be good to get someone to ack those glance changes first and that they likely need force merging because things have bitrotted | 17:07 |
*** Tengu has joined #openstack-infra | 17:07 | |
artom | AJaeger, ah, I like that, thanks! | 17:08 |
clarkb | rosmaita: can you take a look at https://review.opendev.org/#/c/692526/ and https://review.opendev.org/692035 ? you are on glance stable maint | 17:09 |
rosmaita | clarkb: ack | 17:09 |
artom | ... and I think I found the labels I was looking for in project-config/nodepool/nl02.openstack.org.yaml | 17:09 |
artom | Thank you folks! | 17:10 |
AJaeger | rosmaita: I propose that we force-merge them but we'd like to have your blessing ;) | 17:10 |
*** ociuhandu has quit IRC | 17:11 | |
*** rkukura has quit IRC | 17:11 | |
*** ykarel is now known as ykarel|away | 17:11 | |
*** ociuhandu has joined #openstack-infra | 17:15 | |
*** Tengu has quit IRC | 17:16 | |
*** Tengu has joined #openstack-infra | 17:18 | |
openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: POC: allow configure-mirrors to enable extra repos https://review.opendev.org/693887 | 17:19 |
rosmaita | AJaeger: ok, i hope abhishekk doesn't kill me, though | 17:23 |
AJaeger | rosmaita: one is a backport, the other needs merging with master. So, happy to join the discussion ;) thanks! | 17:25 |
rosmaita | actually, you have https://review.opendev.org/#/c/692526/ going into a feature branch -- i think this change is already at HEAD of master | 17:26 |
rosmaita | so it shouldn't be a big deal | 17:26 |
AJaeger | yes, it is at HEAD of master. | 17:27 |
clarkb | AJaeger: I guess we should be good to merge those two now? Then we can bug qa team to get tempest change in | 17:28 |
AJaeger | clarkb: agreed | 17:29 |
*** chandankumar is now known as rrrrrrrrrrrr | 17:29 | |
AJaeger | clarkb: I'll ask qa team... | 17:30 |
*** rfolco|brb is now known as rfolco | 17:30 | |
clarkb | ok done | 17:31 |
AJaeger | thanks, clarkb | 17:31 |
* AJaeger asked on #openstack-qa | 17:31 | |
*** ociuhandu has quit IRC | 17:32 | |
*** ociuhandu has joined #openstack-infra | 17:33 | |
*** ociuhandu has quit IRC | 17:33 | |
*** ociuhandu has joined #openstack-infra | 17:34 | |
*** rrrrrrrrrrrr is now known as chandankumar | 17:34 | |
clarkb | AJaeger: do we still need the openstack/project-config side change to remove that image too? | 17:35 |
clarkb | from nodepool and grafana and all that | 17:36 |
AJaeger | clarkb: yes, that is needed as well. Want to push it? | 17:36 |
AJaeger | Not sure whether anything else is missing for cleanup... | 17:36 |
*** ociuhandu has quit IRC | 17:36 | |
clarkb | ya I can work on that change though might not get it up until after today's meeting | 17:38 |
*** ociuhandu has joined #openstack-infra | 17:38 | |
*** chandankumar is now known as raukadah | 17:38 | |
*** david-lyle is now known as dklyle | 17:41 | |
*** ociuhandu has quit IRC | 17:42 | |
*** ykarel|away has quit IRC | 17:44 | |
*** ociuhandu has joined #openstack-infra | 17:45 | |
*** rkukura has joined #openstack-infra | 17:50 | |
*** ociuhandu has quit IRC | 17:54 | |
*** igordc has joined #openstack-infra | 17:59 | |
*** sreejithp has joined #openstack-infra | 18:07 | |
artom | Another ansible question if I may - when writing a role for one project, is it possible to include_role from another project? | 18:08 |
*** sreejithp_ has quit IRC | 18:09 | |
artom | Oh actually, 'copy-build-sshkey' is a Zuul role, so it should be available magically. Sorry for the noise. | 18:09 |
clarkb | artom: yes, but you'll need to list that project as roles: entry in the job | 18:09 |
clarkb | oh ya the zuul jobs roles should already be there | 18:10 |
* artom is new to this whole world. What's not easy is telling the difference between OpenDev-specific stuff and Zuul stuff. | 18:11 | |
*** gfidente is now known as gfidente|afk | 18:12 | |
*** aedc has quit IRC | 18:25 | |
*** amoralej is now known as amoralej|off | 18:33 | |
*** ralonsoh has quit IRC | 18:34 | |
*** eernst has joined #openstack-infra | 18:39 | |
*** raschid has quit IRC | 18:53 | |
*** kjackal has joined #openstack-infra | 18:58 | |
*** pkopec has quit IRC | 19:05 | |
*** ociuhandu has joined #openstack-infra | 19:08 | |
*** michael-beaver has quit IRC | 19:10 | |
*** ociuhandu has quit IRC | 19:12 | |
*** kjackal has quit IRC | 19:17 | |
*** mgutehall has quit IRC | 19:30 | |
*** mgutehall has joined #openstack-infra | 19:32 | |
*** jaosorior has joined #openstack-infra | 19:39 | |
*** eernst has quit IRC | 19:40 | |
*** sshnaidm|ruck is now known as sshnaidm|afk | 19:42 | |
*** lbragstad has quit IRC | 19:50 | |
*** lbragstad has joined #openstack-infra | 19:51 | |
*** Goneri has quit IRC | 19:51 | |
eharney | this cinder job looks like it's been stuck for some time: http://zuul.openstack.org/stream/625f41d621ed4d1c8438d0994faa947a?logfile=console.log | 19:58 |
Shrews | oh, ooops. looks like i need to adjust my calendar for time change | 19:58 |
eharney | i'm not sure what "TASK [get df disk usage]" does exactly, but maybe it got wedged on a broken NFS share? | 19:59 |
clarkb | eharney: its a task that only runs against failed jobs to determine disk usage as we've found some jobs fail due to lack of disk and that is otherwise unlogged | 19:59 |
clarkb | eharney: it uses the ansible raw module to run df which should be fairly resilient itself, but if df is failing due to broken filesystems that may explain it | 20:00 |
clarkb | it should timeout, though I would've expected the timeout to be hit already | 20:00 |
eharney | right, looks like it's been there since sunday? | 20:03 |
openstackgerrit | Clark Boylan proposed openstack/project-config master: Remove opensuse-150 https://review.opendev.org/693915 | 20:08 |
clarkb | AJaeger: ^ that look right? | 20:09 |
clarkb | eharney: ya | 20:09 |
AJaeger | clarkb: do we first need to go to 0 before we can remove? | 20:10 |
AJaeger | clarkb: otherwise looks fine - but will download and double check once the rest is in. thanks! | 20:11 |
clarkb | AJaeger: I thought we did with the 423 removal but pretty sure we didn't | 20:12 |
clarkb | I think nodepool will see the 150 nodes as leaked once we remove the config for it then clean them up automatically | 20:12 |
clarkb | we only need to set things to zero when removing provider configs as the provider config is necessary to clean up resources. In this case it is just resource config not provider config we are cleaning up | 20:12 |
clarkb | eharney: I am able to ssh onto the test node but manual run of df does seem to not be doing much | 20:14 |
clarkb | eharney: stat("/opt/stack/data/cinder/mnt/896fb15da6036b68a917322e72ebfe57" is what strace says it is hanging on | 20:16 |
eharney | clarkb: ok, so it is a stuck nfs share | 20:16 |
*** jaosorior has quit IRC | 20:16 | |
clarkb | localhost:/srv/nfs1 on /opt/stack/data/cinder/mnt/896fb15da6036b68a917322e72ebfe57 type nfs4 (rw,relatime,vers=4.1,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp6,timeo=600,retrans=2,sec=sys,clientaddr=::1,local_lock=none,addr=::1) | 20:17 |
clarkb | mount seems to confirm that | 20:17 |
clarkb | eharney: I can kill the ansible process which will force the job to report. However, if I do that the job node will get deleted | 20:18 |
clarkb | eharney: is it worth putting a hold on that job first? | 20:18 |
*** panda has quit IRC | 20:18 | |
eharney | clarkb: a hold for further examination you mean? | 20:18 |
clarkb | yes | 20:19 |
clarkb | I am not sure if "nfs is very broken" is the sort of thing the cinder team wants to investigate | 20:19 |
*** lbragstad has quit IRC | 20:19 | |
eharney | clarkb: not sure, it seems to be completing everywhere else, so i'm not sure that this particular failure is too interesting | 20:19 |
clarkb | ok, if it happens again I guess we hold it there. For now I'll just kill the ansible process and force this job to complete | 20:19 |
eharney | we could do something like change the mount options to "soft, intr" so that it would fail more gracefully if this continues to happen | 20:20 |
*** lbragstad has joined #openstack-infra | 20:20 | |
*** munimeha1 has joined #openstack-infra | 20:20 | |
*** armax has quit IRC | 20:20 | |
*** panda has joined #openstack-infra | 20:21 | |
AJaeger | clarkb: do we have other jobs in this state? Could there be a larger problem ? | 20:21 |
clarkb | AJaeger: no that was the only one | 20:22 |
AJaeger | clarkb: looking at zuul.opendev.org, this is the only one I see - so we should be good | 20:22 |
AJaeger | clarkb: great | 20:22 |
*** armax has joined #openstack-infra | 20:22 | |
eharney | thanks for taking a look | 20:23 |
clarkb | we can also add timeouts directly to the tasks we run in that cleanup playbook to make them more resilient to this | 20:25 |
openstackgerrit | Clark Boylan proposed opendev/base-jobs master: Timeout cleanup playbook tasks https://review.opendev.org/693924 | 20:29 |
clarkb | eharney: AJaeger ^ something like that | 20:29 |
*** sreejithp has quit IRC | 20:34 | |
*** sreejithp_ has joined #openstack-infra | 20:34 | |
ianw | clarkb: how come the job timeout doesn't apply? | 20:37 |
AJaeger | clarkb: https://review.opendev.org/#/c/691966/ is the next opensuse-150 change. Dependencies are approved and in gate now... | 20:40 |
AJaeger | dependencies are the tempest and devstack changes | 20:40 |
*** sreejithp_ has quit IRC | 20:42 | |
*** slaweq has quit IRC | 20:47 | |
smcginnis | There is a group called cinder-release that I am assuming was used before we had release automation. I don't see it referenced anywhere now. | 20:48 |
smcginnis | https://review.opendev.org/#/admin/groups/144,members | 20:48 |
smcginnis | Anyone know if that is correct, and if so, how we can get the group deleted? | 20:48 |
fungi | ianw: post phase uses a separate timeout from pre/run, doesn't it? | 20:48 |
fungi | smcginnis: we can't delete gerrit groups, but we can empty, rename and hide them | 20:49 |
smcginnis | fungi: Do you think it's worth the effort? | 20:49 |
smcginnis | I can just continue to ignore it. :) | 20:50 |
fungi | that's mostly what we do | 20:50 |
fungi | but you were asking if you could get the group deleted | 20:50 |
smcginnis | Works for me. | 20:50 |
ianw | fungi: yes, but it still should timeout eventually? | 20:53 |
fungi | i don't know | 20:53 |
fungi | maybe? | 20:53 |
fungi | i guess we have a default timeout for it, yeah | 20:54 |
fungi | infra-root: rackspace just opened an incident for a problem with the host ze01 is running on | 20:54 |
ianw | from my reading of self.runAnsiblePlaybook i think we always have a timeout setup | 20:55 |
fungi | we may see some job impact from that vm suddenly getting rebooted, but more likely it'll just have a bunch of cruft which needs to get cleaned up | 20:55 |
*** eharney has quit IRC | 20:57 | |
paladox | fungi the deletion of group is being worked on at the hackathon this week at least that was what the google doc said :) | 21:00 |
fungi | paladox: ooh, neat! | 21:00 |
paladox | https://gerrit-review.googlesource.com/c/gerrit/+/129130 | 21:01 |
*** rfolco has quit IRC | 21:01 | |
*** rfolco has joined #openstack-infra | 21:01 | |
*** Goneri has joined #openstack-infra | 21:02 | |
paladox | fungi we've also set a tentative date for our upgrade! NoteDB made it easier to test mediawiki/core operations/puppet since all i had to do was git mirror and then reindex! | 21:02 |
paladox | (almost like i have db access) | 21:03 |
fungi | that does indeed sound convenient | 21:03 |
fungi | easier than mysqldump/source | 21:03 |
paladox | yup | 21:03 |
clarkb | ianw: my guess is bug in cleanup phase or with raw module breaking the watchdog maybe | 21:04 |
*** exsdev has quit IRC | 21:05 | |
*** rfolco has quit IRC | 21:06 | |
*** aluria has quit IRC | 21:07 | |
*** dosaboy has quit IRC | 21:07 | |
*** exsdev has joined #openstack-infra | 21:09 | |
*** ociuhandu has joined #openstack-infra | 21:09 | |
*** dosaboy has joined #openstack-infra | 21:13 | |
*** ociuhandu has quit IRC | 21:13 | |
*** ociuhandu has joined #openstack-infra | 21:15 | |
*** rcernin has joined #openstack-infra | 21:17 | |
*** ociuhandu has quit IRC | 21:19 | |
*** ociuhandu has joined #openstack-infra | 21:23 | |
*** dpawlik has joined #openstack-infra | 21:24 | |
*** ociuhandu has quit IRC | 21:28 | |
*** dpawlik has quit IRC | 21:28 | |
*** gfidente|afk has quit IRC | 21:30 | |
*** xek_ has quit IRC | 21:31 | |
*** Goneri has quit IRC | 21:43 | |
*** ociuhandu has joined #openstack-infra | 21:44 | |
*** Goneri has joined #openstack-infra | 21:46 | |
*** ociuhandu has quit IRC | 21:49 | |
*** Goneri has quit IRC | 21:57 | |
*** Goneri has joined #openstack-infra | 21:57 | |
*** eharney has joined #openstack-infra | 21:58 | |
*** Goneri has quit IRC | 22:01 | |
*** Goneri has joined #openstack-infra | 22:01 | |
*** slaweq has joined #openstack-infra | 22:11 | |
*** mriedem has quit IRC | 22:12 | |
*** aluria has joined #openstack-infra | 22:14 | |
*** slaweq has quit IRC | 22:15 | |
*** ociuhandu has joined #openstack-infra | 22:17 | |
*** ociuhandu has quit IRC | 22:22 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Introduce manual setting of DIB_INIT_SYSTEM https://review.opendev.org/414179 | 22:27 |
*** eharney has quit IRC | 22:31 | |
*** adriant has joined #openstack-infra | 22:41 | |
*** slaweq has joined #openstack-infra | 22:46 | |
*** ociuhandu has joined #openstack-infra | 22:51 | |
*** ociuhandu has quit IRC | 22:58 | |
*** igordc has quit IRC | 23:06 | |
*** tkajinam has joined #openstack-infra | 23:08 | |
openstackgerrit | Alex Schultz proposed openstack/project-config master: Add tripleo-operators-ansible https://review.opendev.org/693945 | 23:14 |
*** dchen has joined #openstack-infra | 23:26 | |
*** goldyfruit has quit IRC | 23:28 | |
openstackgerrit | Alex Schultz proposed openstack/project-config master: Add tripleo-operators-ansible https://review.opendev.org/693945 | 23:28 |
*** ociuhandu has joined #openstack-infra | 23:29 | |
*** ociuhandu has quit IRC | 23:30 | |
*** ociuhandu has joined #openstack-infra | 23:30 | |
*** igordc has joined #openstack-infra | 23:31 | |
mordred | clarkb, AJaeger, ianw: followup from infra meeting - the reason to not switch to podman across the board isn't anything to do with podman - it's that we need to add podman support to the container jobs. right now we don't have speculative container image support for podman | 23:31 |
mordred | podman *itself* is fine | 23:31 |
mordred | it's ok right now for review(-dev) because we're not really changing those images super frequently and can live with the need to land a change before taking the next step | 23:32 |
ianw | mordred: do you have time to run me through how those speculative jobs might work for dib? | 23:35 |
*** ociuhandu has quit IRC | 23:36 | |
mordred | ianw: speculative image jobs would really only come in to play for dib if we wind up testing building dib images based on container images that we also build. ... so other than that, I'm not sure I've given it much thought. | 23:40 |
mordred | unless you mean something different ... | 23:40 |
openstackgerrit | Monty Taylor proposed zuul/nodepool master: [wip] move openstack testing to use containerised daemon https://review.opendev.org/693464 | 23:41 |
ianw | mordred: what i mean is, how to get a dib change into a nodepool-builder container for testing in the functional jobs | 23:41 |
mordred | AH | 23:42 |
ianw | i'm looking at "assemble" | 23:42 |
ianw | https://opendev.org/opendev/system-config/src/branch/master/docker/python-builder/scripts/assemble | 23:42 |
ianw | IIRC, the Dockerfile in the nodepool source copies the nodepool source into /tmp/src in the image | 23:43 |
ianw | and then "assemble" installs it? | 23:43 |
mordred | yes, that's right. | 23:43 |
mordred | (this is going to be a 'fun' problem) | 23:43 |
mordred | ianw: this is so that we can test dib changes right? | 23:44 |
ianw | yep, in the devstack functional test that starts up nodepool, builds the images and boots them | 23:45 |
mordred | I think what we might want to do is make a testing specific image that is FROM opendevorg/nodepool-builder | 23:45 |
mordred | and installs dib from source into it | 23:45 |
ianw | the other trick is that that job pulls in glean & openstacksdk from source | 23:45 |
mordred | then have the dib job build that image as step one | 23:45 |
ianw | but one thing at a time :) | 23:46 |
mordred | yeah | 23:46 |
mordred | well | 23:46 |
mordred | maybe we just make it an image that installs all three from source - since it's not a produciton image, we don't really need to worry about making it as optimized size-wise as we do for nodepool-builder itself | 23:46 |
ianw | i guess nodepool-builder+openstack sdk need to be installed | 23:47 |
ianw | for glean, we need the source tree, as the dib element installs from it | 23:47 |
ianw | i think the glean case is just a matter of mapping in the zuul directory to the right place for the builder | 23:47 |
*** munimeha1 has quit IRC | 23:49 | |
ianw | hrm, ok, so i think i got more an idea, we can just build an image in the functional test; we don't need to have a whole buildset repository setup to pull from | 23:53 |
mordred | yeah. that said - we probably still want one - because we'd want to be able to depends-on nodepool changes and so we'd want speculative nodepool-builder images | 23:54 |
mordred | but- as you said - one step at a time :) | 23:55 |
ianw | yeah, right now i'd like to test 414179 which fixes running in containers without init systems (yes, we've known about the problem for a long time :) | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!