Monday, 2020-07-13

*** ryohayakawa has joined #openstack-infra00:04
*** tetsuro has joined #openstack-infra00:07
*** jamesmcarthur has quit IRC00:08
*** jamesmcarthur has joined #openstack-infra00:15
*** hongbin has quit IRC00:20
*** hongbin has joined #openstack-infra00:22
*** jamesmcarthur has quit IRC00:27
*** jamesmcarthur has joined #openstack-infra00:29
*** yamamoto has joined #openstack-infra00:36
*** yamamoto has quit IRC00:42
*** markvoelker has joined #openstack-infra01:15
*** markvoelker has quit IRC01:19
*** EmilienM|PTO is now known as EmilienM01:27
*** ociuhandu has joined #openstack-infra01:33
*** yamamoto has joined #openstack-infra01:38
*** ociuhandu has quit IRC01:38
*** markvoelker has joined #openstack-infra02:21
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use upload-docker-image in periodic jobs  https://review.opendev.org/74056002:25
*** markvoelker has quit IRC02:25
*** ricolin has joined #openstack-infra02:33
*** markvoelker has joined #openstack-infra02:34
*** markvoelker has quit IRC02:39
*** tetsuro has quit IRC02:48
*** weshay_ruck is now known as weshay_pto03:04
*** jamesmcarthur has quit IRC03:07
*** jamesmcarthur_ has joined #openstack-infra03:07
*** jamesmcarthur_ has quit IRC03:09
*** ociuhandu has joined #openstack-infra03:10
*** ociuhandu has quit IRC03:14
*** Tengu has quit IRC03:21
*** Tengu has joined #openstack-infra03:22
*** hongbin has quit IRC03:26
*** markvoelker has joined #openstack-infra03:31
*** psachin has joined #openstack-infra03:36
*** markvoelker has quit IRC03:36
*** dave-mccowan has quit IRC03:37
*** ramishra has joined #openstack-infra03:44
*** tetsuro has joined #openstack-infra03:47
*** tetsuro has quit IRC03:51
*** Tengu has quit IRC04:21
*** Tengu has joined #openstack-infra04:22
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-infra04:33
*** soniya29 has joined #openstack-infra04:38
*** Tengu has quit IRC04:41
*** bhagyashris|away is now known as bhagyashris04:41
*** Tengu has joined #openstack-infra04:42
*** ykarel has joined #openstack-infra04:43
*** ricolin_ has joined #openstack-infra04:56
*** ricolin has quit IRC04:57
*** psachin has quit IRC04:58
*** tetsuro has joined #openstack-infra05:03
*** tetsuro has quit IRC05:08
*** ykarel has quit IRC05:11
*** ykarel has joined #openstack-infra05:12
*** hamalq has joined #openstack-infra05:21
*** hamalq has quit IRC05:25
*** lmiccini has joined #openstack-infra05:26
*** markvoelker has joined #openstack-infra05:32
*** marios has joined #openstack-infra05:35
*** markvoelker has quit IRC05:36
*** udesale has joined #openstack-infra05:38
*** ysandeep|away is now known as ysandeep05:50
*** ysandeep is now known as ysandeep|afk05:51
*** rcernin has quit IRC06:02
*** rcernin has joined #openstack-infra06:11
*** ykarel has quit IRC06:15
*** Tengu has quit IRC06:21
*** Tengu has joined #openstack-infra06:23
openstackgerritJames Page proposed openstack/openstack-zuul-jobs master: Add template for charm check and gate  https://review.opendev.org/74061406:23
openstackgerritJames Page proposed openstack/openstack-zuul-jobs master: Add template for charm check and gate  https://review.opendev.org/74061406:26
*** tosky has joined #openstack-infra06:39
*** ykarel has joined #openstack-infra06:50
*** vishalmanchanda has joined #openstack-infra06:54
*** yolanda has joined #openstack-infra07:07
*** xek has joined #openstack-infra07:07
*** nightmare_unreal has joined #openstack-infra07:09
*** ccamacho has joined #openstack-infra07:13
*** ralonsoh has joined #openstack-infra07:19
*** xek has quit IRC07:44
*** ysandeep|afk is now known as ysandeep|rover07:53
*** pkopec has joined #openstack-infra08:03
*** rcernin has quit IRC08:06
*** ociuhandu has joined #openstack-infra08:10
*** ociuhandu has quit IRC08:16
*** ysandeep|rover is now known as ysandeep|lunch08:16
*** hamalq has joined #openstack-infra08:17
*** hamalq_ has joined #openstack-infra08:18
*** hamalq has quit IRC08:21
*** hamalq_ has quit IRC08:23
*** ramishra has quit IRC08:28
*** ramishra has joined #openstack-infra08:29
*** dtantsur|afk is now known as dtantsur08:34
*** ociuhandu has joined #openstack-infra08:50
*** ysandeep|lunch is now known as ysandeep|rover08:55
*** derekh has joined #openstack-infra09:00
*** Lucas_Gray has joined #openstack-infra09:01
*** yamamoto has quit IRC09:03
*** sshnaidm|afk is now known as sshnaidm09:09
*** yamamoto has joined #openstack-infra09:11
AJaegerttx, the maintain-github-openstack-mirror job succeeded for the first time, see https://zuul.opendev.org/t/openstack/build/7bf6b09b554c416e8e237ea754531837 - is that all fine now?09:27
*** aedc_ has joined #openstack-infra09:27
*** yamamoto has quit IRC09:33
*** yamamoto has joined #openstack-infra09:38
ttxAJaeger: It looks good! Thanks for doing another iteration over the weekend. I was operating under the assumption that yaml was systematically installed (much like requests is)09:47
ttxI'll watch it for the rest of the week, but I'm optimistic it's all fine now09:48
*** rcernin has joined #openstack-infra09:53
AJaegerttx, a new venv does not include yaml.09:54
AJaegerttx, it looked good to me as well. Glad to hear!09:54
*** ccamacho has quit IRC09:58
*** xek has joined #openstack-infra09:58
*** ricolin_ has quit IRC10:01
*** rcernin has quit IRC10:03
*** xek has quit IRC10:03
*** rcernin has joined #openstack-infra10:07
*** zbr has joined #openstack-infra10:34
*** rcernin has quit IRC10:40
*** yamamoto has quit IRC10:54
*** finucannot is now known as stephenfin10:57
*** Lucas_Gray has quit IRC10:59
*** Lucas_Gray has joined #openstack-infra11:00
*** markvoelker has joined #openstack-infra11:06
*** markvoelker has quit IRC11:16
*** hamalq has joined #openstack-infra11:19
*** ricolin_ has joined #openstack-infra11:23
*** hamalq has quit IRC11:24
*** yamamoto has joined #openstack-infra11:26
*** bhagyashris is now known as bhagyashris|afk11:33
*** ccamacho has joined #openstack-infra11:34
*** hamalq has joined #openstack-infra11:35
*** tkajinam has quit IRC11:37
*** hamalq has quit IRC11:40
*** yamamoto has quit IRC11:42
*** yamamoto has joined #openstack-infra11:43
*** yamamoto has quit IRC11:44
*** lmiccini has quit IRC11:47
*** yamamoto has joined #openstack-infra11:49
*** yamamoto has quit IRC11:52
*** lmiccini has joined #openstack-infra11:54
*** adriant has quit IRC11:58
*** masayukig has quit IRC11:58
*** masayukig has joined #openstack-infra11:58
*** adriant has joined #openstack-infra11:59
*** markvoelker has joined #openstack-infra12:01
*** rfolco has joined #openstack-infra12:04
*** markvoelker has quit IRC12:04
*** yamamoto has joined #openstack-infra12:04
*** rlandy has joined #openstack-infra12:05
*** rlandy is now known as rlandy|ruck12:06
*** udesale_ has joined #openstack-infra12:09
*** dave-mccowan has joined #openstack-infra12:11
*** udesale has quit IRC12:12
*** dave-mccowan has quit IRC12:15
*** derekh has quit IRC12:26
*** ryohayakawa has quit IRC12:29
*** osmanlicilegi has quit IRC12:33
*** bhagyashris|afk is now known as bhagyashris12:35
*** xek has joined #openstack-infra12:38
*** osmanlicilegi has joined #openstack-infra12:42
*** ralonsoh has quit IRC12:43
*** ralonsoh has joined #openstack-infra12:44
*** xek has quit IRC12:44
*** yamamoto has quit IRC12:51
*** lbragstad_ is now known as lbragstad12:51
*** rlandy|ruck is now known as rlandy|ruck|mtg13:01
*** eharney has joined #openstack-infra13:04
*** zombieJulia is now known as TheJulia13:06
*** derekh has joined #openstack-infra13:09
*** mmethot has joined #openstack-infra13:10
*** Tengu has quit IRC13:13
*** Tengu has joined #openstack-infra13:15
*** ramishra has quit IRC13:22
*** soniya29 has quit IRC13:22
*** aedc_ has quit IRC13:26
*** Goneri has joined #openstack-infra13:26
*** ramishra has joined #openstack-infra13:26
*** udesale_ has quit IRC13:27
*** rlandy|ruck|mtg has quit IRC13:27
*** rfolco has quit IRC13:27
*** sean-k-mooney has quit IRC13:27
*** bdodd has quit IRC13:27
*** irclogbot_1 has quit IRC13:27
*** niedbalski has quit IRC13:27
*** lathiat has quit IRC13:27
*** zbr|ruck has quit IRC13:27
*** aarents has quit IRC13:27
*** udesale_ has joined #openstack-infra13:28
*** rlandy|ruck|mtg has joined #openstack-infra13:28
*** rfolco has joined #openstack-infra13:28
*** sean-k-mooney has joined #openstack-infra13:28
*** bdodd has joined #openstack-infra13:28
*** irclogbot_1 has joined #openstack-infra13:28
*** niedbalski has joined #openstack-infra13:28
*** lathiat has joined #openstack-infra13:28
*** zbr|ruck has joined #openstack-infra13:28
*** aarents has joined #openstack-infra13:28
*** yamamoto has joined #openstack-infra13:28
*** noonedeadpunk has quit IRC13:31
*** noonedeadpunk has joined #openstack-infra13:33
*** yamamoto has quit IRC13:36
*** soniya29 has joined #openstack-infra13:44
*** d34dh0r53 has joined #openstack-infra13:45
*** bhagyashris is now known as bhagyashris|afk13:56
*** artom has joined #openstack-infra13:56
*** xek has joined #openstack-infra13:57
*** ykarel has quit IRC14:11
*** ykarel has joined #openstack-infra14:22
*** __ministry1 has joined #openstack-infra14:26
fungii wouldn't expect a new venv to include requests either. for me, when i create one locally with `python3 -m venv foo` the only packages preinstalled are pip and setuptools14:26
*** zxiiro has joined #openstack-infra14:27
*** __ministry1 has quit IRC14:29
*** ysandeep|rover is now known as ysandeep|away14:32
*** beekneemech is now known as bnemec14:38
*** dklyle has joined #openstack-infra14:39
*** ykarel is now known as ykarel|away14:45
*** Goneri has quit IRC14:50
ttxfungi: indeed, PyGitHub depends on requests. I should probably add the depend more explicitly14:55
ttxsince I make direct use of it14:55
ttx(I was confused by the "python on the nodes has requests and yaml preinstalled" factoid I used for the runs-on-node jobs)14:56
*** lmiccini has quit IRC14:56
*** Goneri has joined #openstack-infra15:03
*** rkukura has joined #openstack-infra15:05
*** rkukura has quit IRC15:06
*** udesale_ has quit IRC15:07
fungiyeah, if you import something then best to directly declare it as a dependency. at one time we had a poc tool to find places where projects were importing transitive dependencies, though it relied on some pip internals which weren't portable to the new world order15:09
fungifrom time to time, whatever direct dependency was bringing that in suddenly refactors and decides to do things a different way so drops that dependency, and then your application breaks15:10
openstackgerritThierry Carrez proposed openstack/project-config master: maintain-github-mirror: add requests dependency  https://review.opendev.org/74071115:10
ttxthat should do it ^15:10
*** hamalq has joined #openstack-infra15:15
*** hamalq has quit IRC15:17
*** soniya29 has quit IRC15:17
*** hamalq has joined #openstack-infra15:17
*** hamalq_ has joined #openstack-infra15:20
*** armax has joined #openstack-infra15:23
*** hamalq has quit IRC15:23
*** xek has quit IRC15:27
*** rlandy|ruck|mtg is now known as rlandy|ruck15:31
*** yamamoto has joined #openstack-infra15:36
*** gyee has joined #openstack-infra15:41
*** armax has quit IRC15:44
*** d34dh0r53 has quit IRC15:47
openstackgerritJames Page proposed openstack/openstack-zuul-jobs master: Add template for charm check and gate  https://review.opendev.org/74061415:49
*** yamamoto has quit IRC15:53
*** marios is now known as marios|out15:54
*** d34dh0r53 has joined #openstack-infra15:58
*** artom has quit IRC16:07
*** pkopec has quit IRC16:10
*** marios|out has quit IRC16:13
*** Lucas_Gray has quit IRC16:13
*** artom has joined #openstack-infra16:18
*** d34dh0r53 has quit IRC16:29
*** d34dh0r53 has joined #openstack-infra16:32
*** ykarel|away has quit IRC16:39
*** derekh has quit IRC17:00
*** sean-k-mooney has quit IRC17:01
*** johnthetubaguy has quit IRC17:02
*** ociuhandu has quit IRC17:03
*** johnthetubaguy has joined #openstack-infra17:03
*** dtantsur is now known as dtantsur|afk17:15
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use upload-docker-image in periodic jobs  https://review.opendev.org/74056017:22
*** ralonsoh has quit IRC17:23
*** ricolin_ has quit IRC17:40
*** rkukura has joined #openstack-infra17:48
*** yamamoto has joined #openstack-infra17:53
*** yamamoto has quit IRC18:08
*** rkukura has quit IRC18:22
*** nightmare_unreal has quit IRC18:26
*** ociuhandu has joined #openstack-infra19:12
*** ociuhandu has quit IRC19:17
*** Ajohn has joined #openstack-infra19:55
*** Ajohn has quit IRC20:02
openstackgerritMerged zuul/zuul-jobs master: Strip path from default ensure_pip_from_upstream_interpreters  https://review.opendev.org/74050520:04
*** yamamoto has joined #openstack-infra20:10
*** xek has joined #openstack-infra20:22
*** yamamoto has quit IRC20:23
*** Lucas_Gray has joined #openstack-infra20:26
smcginnisThat last merge hopefully addresses any remaining concerns for https://review.opendev.org/73892620:44
smcginnisWould be nice to get that merged to see if we can get nightly requirements updates going again.20:44
*** johnthetubaguy has quit IRC20:46
clarkbsmcginnis: left a note on https://review.opendev.org/73892620:46
smcginnisclarkb: responded20:47
*** johnthetubaguy has joined #openstack-infra20:47
clarkbsmcginnis: I think there is a conflict then because you are using the upstream interpreters list to specify not upstream packages?20:47
smcginnisWe need the packages installed. Installing from pypi isn't going to get installed for each version. It's a standard lib that's packaged separately for each version.20:47
clarkbI don't know that it works that way20:48
clarkbit being the role20:48
smcginnisclarkb: Yeah, we had discussed that in the zuul updates. It's an unfortunate naming problem with the variable now that will be a bunch of work to fix now.20:48
smcginnisSo it sounds like it is only for upstream, but it is used in the package task too.20:48
clarkboh I see this was updated recently20:49
smcginnisclarkb: Found the discussion we had about the naming: http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2020-07-09.log.html#t2020-07-09T20:48:5520:50
clarkbsmcginnis: what we can do is call the var ensure_pip_interpreters and default the other older value to the new thing20:50
clarkbthen use the new name to reduce confusion20:50
smcginnisclarkb: Hah, read the dicsussion.20:51
clarkbI'm not saying template the name20:51
clarkbI'm saying make a new var for both things then default the old names to that value20:52
smcginnisSorry, jump down: http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2020-07-09.log.html#t2020-07-09T21:26:3420:52
*** ccamacho has quit IRC20:52
clarkbya I mean its a bit clunky in the ansible but it is doable20:53
clarkbyou have to create an internal artificial value20:54
clarkbpuppet actually basically forced you to do this since you couldn't redefine things, you run into similar sets of problems with ansible though20:54
smcginnisHow would it be kept up to date so the right value is used? Once the default is set, you don't know if you are using the default or using something someone specified, and for which variable.20:55
clarkbyou set the default at the artificial value20:55
smcginnisThe other option was to have a completely duplicate but separate variable.20:55
clarkbyou do something lik x = nil, y = nil, z = if x then x else if y then y else default20:56
clarkbthen you only uze z internally20:56
clarkb(and you don't expect users to modify z)20:57
smcginnisThen I think any time anyone would use that variable, they would need to know to do that long check, right?20:57
smcginnisBecause you can't default it.20:57
clarkbyou can default it the way I described20:58
clarkbthe key is to stop setting defaults on x and y which are you external facing api20:58
clarkbthat way you can tell if the user has set it or not20:58
clarkbthen define z with the default if neither x or y are defined20:59
smcginnisBut then the default is set before the other variables are overridden by the user.20:59
clarkbthats not how it works20:59
clarkbroles are evaluated in order20:59
smcginnisOK, that's not the order of operations that were explained to me, so I guess that's good.20:59
clarkbI think you can't do it in the dfeaults file maybe21:00
smcginnisOh, add another task in a common role or every role that uses the variable to set the other variable.21:00
clarkbbut I'm positive you can do it as the first task in the role21:00
clarkband probably you can do it in a vars file21:00
*** eharney has quit IRC21:08
*** vishalmanchanda has quit IRC21:08
*** JayF has quit IRC21:23
*** JayF has joined #openstack-infra21:24
*** hamalq_ has quit IRC22:02
*** hamalq has joined #openstack-infra22:03
*** yamamoto has joined #openstack-infra22:28
*** rlandy|ruck is now known as rlandy|bbl22:34
*** yamamoto has quit IRC22:38
*** tosky has quit IRC22:42
prometheanfirespeaking again from yesterday looks like setuptools is rolling forward with the setuptools-48 behaviour, I think we'll need to pin setuptools until openstack gate is ready (set envars I think) https://github.com/pypa/setuptools/issues/223222:43
prometheanfiredoes infra have a workaround or do we need to pin setuptools22:43
clarkbprometheanfire: devstack installs its own version of pip and setuptools and all that so the fixing needs to be in there I think22:44
clarkbfor other jobs I would expect they are largely in virtualenvs so won't have these problems22:44
clarkbin general though moving towards virtualenvs as much as possible is likely a good idea22:44
fungiyeah, the problem is mainly going to crop up in jobs which use `sudo pip install ...`22:53
fungiand even then they may not notice it unless there's a collision with distro-supplied packages getting installed on the same system22:53
clarkbfungi: no the collisions aren't an issue22:53
*** tkajinam has joined #openstack-infra22:54
clarkbpip will already fail if it cannot uninstall a distro installed package which is based on whether or not distutils was used and not setuptools (regardless of the pathing)22:54
prometheanfirehard coded paths iirc?22:54
clarkbthe issue we're facing is hard coded paths to /usr/local/bin which won't be used anymore22:54
clarkba simple fix is to simply rely on PATH and get away from using hard coded path22:54
fungiahh, yeah, granted those wouldn't have worked on rh-based distros anyway22:54
fungiso it was already a non-portable pattern22:55
*** rcernin has joined #openstack-infra23:05
*** rcernin has quit IRC23:05
*** rcernin has joined #openstack-infra23:08
prometheanfireso, they are gonna roll forward tomorrow, fyi23:14
clarkbprometheanfire: maybe you can send an emailto the thread that was started for the issue and rewarn people?23:18
fungithis is the second thing they've permanently broken with the `sudo pip install ...` case in the past year or so23:18
clarkbbut I think its largely up to the tools like devstack to address it23:18
*** aarents has quit IRC23:18
fungi(well, between pip and setuptools, but same crowd)23:19
*** aarents has joined #openstack-infra23:19
*** adriant has quit IRC23:32
*** adriant has joined #openstack-infra23:33
*** xek has quit IRC23:40
*** hamalq has quit IRC23:50
*** aarents has quit IRC23:54
*** aarents has joined #openstack-infra23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!