Wednesday, 2019-10-02

*** michael-beaver has quit IRC00:02
*** jamesmcarthur has quit IRC00:04
*** smarcet has quit IRC00:04
*** gyee has quit IRC00:08
*** jamesmcarthur has joined #openstack-infra00:10
*** igordc has quit IRC00:15
*** jamesmcarthur has quit IRC00:16
*** whoami-rajat has quit IRC00:17
*** mattw4 has quit IRC00:17
*** jamesmcarthur has joined #openstack-infra00:19
*** hongbin has joined #openstack-infra00:30
*** lathiat has quit IRC00:37
*** lathiat has joined #openstack-infra00:38
*** jamesmcarthur has quit IRC00:41
*** jamesmcarthur has joined #openstack-infra00:42
*** hongbin has quit IRC00:50
*** yamamoto has quit IRC00:52
*** yamamoto has joined #openstack-infra00:56
*** ricolin has joined #openstack-infra00:59
*** smarcet has joined #openstack-infra01:02
*** smarcet has quit IRC01:10
*** jamesmcarthur has quit IRC01:11
*** jamesmcarthur has joined #openstack-infra01:11
openstackgerritMerged zuul/zuul master: Set url scheme on HTTP Gerrit events  https://review.opendev.org/68605401:22
*** yamamoto has quit IRC01:23
*** yamamoto has joined #openstack-infra01:26
funginow that's ^ merged i guess it'll take effect at the next scheduler restart?01:33
clarkbya that code was in the gerrit connection driver so needs a scheduler restart01:34
*** ricolin has quit IRC01:34
*** ricolin has joined #openstack-infra01:35
*** markvoelker has quit IRC01:35
*** strigazi has quit IRC01:37
*** strigazi has joined #openstack-infra01:39
*** jamesmcarthur has quit IRC01:41
*** jamesmcarthur has joined #openstack-infra01:42
*** jamesmcarthur has quit IRC01:47
*** spsurya has joined #openstack-infra01:47
*** armax has quit IRC01:56
*** jamesmcarthur has joined #openstack-infra01:59
*** yamamoto has quit IRC01:59
*** jamesmcarthur has quit IRC02:03
*** jamesmcarthur has joined #openstack-infra02:04
*** yamamoto has joined #openstack-infra02:04
*** irclogbot_2 has quit IRC02:09
*** jamesmcarthur has quit IRC02:09
*** irclogbot_0 has joined #openstack-infra02:12
*** jamesmcarthur has joined #openstack-infra02:33
*** roman_g has quit IRC02:34
*** jamesmcarthur has quit IRC02:41
*** eernst has joined #openstack-infra03:00
*** markvoelker has joined #openstack-infra03:10
*** yamamoto has quit IRC03:23
openstackgerritIan Wienand proposed opendev/system-config master: mirror-update: Add EPEL 8 mirroring  https://review.opendev.org/68608103:26
*** armax has joined #openstack-infra03:32
*** jamesmcarthur has joined #openstack-infra03:37
*** Jeffrey4l has quit IRC03:38
*** Jeffrey4l has joined #openstack-infra03:40
*** kjackal has joined #openstack-infra03:41
*** jamesmcarthur has quit IRC03:44
*** yamamoto has joined #openstack-infra04:02
*** yamamoto has quit IRC04:02
*** yamamoto has joined #openstack-infra04:05
*** yamamoto has quit IRC04:07
*** yamamoto has joined #openstack-infra04:09
*** yamamoto has quit IRC04:17
*** yamamoto has joined #openstack-infra04:22
*** yamamoto has quit IRC04:26
ianw9215  chmod(".", 02755)                 = -1 EACCES (Permission denied)04:28
ianwepel 8 mirror is setting setgid which makes afs unhappy ... i feel like i've reported this upstream before as a weird thing to do04:28
*** eernst has quit IRC04:28
*** yamamoto has joined #openstack-infra04:29
openstackgerritIan Wienand proposed opendev/system-config master: mirror-update: Add EPEL 8 mirroring  https://review.opendev.org/68608104:30
*** yamamoto has quit IRC04:31
*** eernst has joined #openstack-infra04:33
*** ricolin_ has joined #openstack-infra04:36
*** kaisers has quit IRC04:37
*** cgoncalves has quit IRC04:37
*** kaisers has joined #openstack-infra04:38
*** fdegir9 has joined #openstack-infra04:40
*** ricolin has quit IRC04:40
*** fdegir has quit IRC04:40
*** tobiash has quit IRC04:40
*** jamesdenton has quit IRC04:41
*** tobiash has joined #openstack-infra04:41
*** jamesdenton has joined #openstack-infra04:44
*** cgoncalves has joined #openstack-infra04:46
*** pcaruana has joined #openstack-infra04:52
*** jamesmcarthur has joined #openstack-infra05:05
*** ykarel|away has joined #openstack-infra05:09
*** jamesmcarthur has quit IRC05:10
*** yamamoto has joined #openstack-infra05:11
*** yamamoto has quit IRC05:19
*** armax has quit IRC05:29
*** armax has joined #openstack-infra05:31
*** dpawlik has joined #openstack-infra05:36
*** icarusfactor has joined #openstack-infra05:39
*** factor has quit IRC05:39
*** kopecmartin|off is now known as kopecmartin05:49
*** AJaeger has quit IRC05:57
*** rcernin_ has joined #openstack-infra05:59
*** rcernin has quit IRC06:01
*** AJaeger has joined #openstack-infra06:02
*** dpawlik has quit IRC06:06
*** dpawlik has joined #openstack-infra06:11
openstackgerritMerged opendev/system-config master: mirror-update: Add EPEL 8 mirroring  https://review.opendev.org/68608106:19
*** yamamoto has joined #openstack-infra06:21
*** yamamoto has quit IRC06:27
openstackgerritOpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/68608706:31
*** jamesmcarthur has joined #openstack-infra06:36
*** icarusfactor has quit IRC06:41
*** rcernin_ has quit IRC06:45
*** rcernin has joined #openstack-infra06:45
*** jamesmcarthur has quit IRC06:49
*** pgaxatte has joined #openstack-infra06:50
openstackgerritMerged openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/68608706:52
*** xek has joined #openstack-infra06:55
*** tesseract has joined #openstack-infra06:57
*** jbadiapa has joined #openstack-infra07:00
*** iurygregory has joined #openstack-infra07:00
*** dciabrin has joined #openstack-infra07:01
*** jaosorior has joined #openstack-infra07:03
*** rcernin has quit IRC07:04
*** yamamoto has joined #openstack-infra07:07
*** slaweq has joined #openstack-infra07:10
*** jbadiapa has quit IRC07:13
*** tosky has joined #openstack-infra07:17
*** yamamoto has quit IRC07:17
*** diablo_rojo has joined #openstack-infra07:18
*** jbadiapa has joined #openstack-infra07:19
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [wip] Add NetworkManager and dhcp-client for CentOS 8  https://review.opendev.org/68609007:20
*** pkopec has joined #openstack-infra07:23
*** jamesmcarthur has joined #openstack-infra07:25
*** jamesmcarthur has quit IRC07:31
*** jbadiapa has quit IRC07:34
*** ralonsoh has joined #openstack-infra07:38
*** slaweq has quit IRC07:38
*** jamesmcarthur has joined #openstack-infra07:39
*** jamesmcarthur has quit IRC07:44
*** jamesmcarthur has joined #openstack-infra07:44
*** jpena|off is now known as jpena07:48
*** jamesmcarthur has quit IRC07:51
*** pkopec has quit IRC07:56
*** jamesmcarthur has joined #openstack-infra07:56
*** slaweq has joined #openstack-infra07:57
*** rpittau|afk is now known as rpittau07:57
*** e0ne has joined #openstack-infra07:57
*** rosmaita has quit IRC08:03
*** tkajinam has quit IRC08:04
*** whoami-rajat has joined #openstack-infra08:08
*** jamesmcarthur has quit IRC08:09
*** markvoelker has quit IRC08:09
*** jpena is now known as jpena|brb08:10
*** weshay has quit IRC08:15
*** weshay has joined #openstack-infra08:16
*** e0ne has quit IRC08:20
*** dchen has quit IRC08:23
*** pkopec has joined #openstack-infra08:25
*** rosmaita has joined #openstack-infra08:26
*** ykarel|away has quit IRC08:28
*** ykarel has joined #openstack-infra08:30
*** ykarel is now known as ykarel|away08:30
*** lpetrut has joined #openstack-infra08:30
*** dpawlik has quit IRC08:31
*** gfidente has joined #openstack-infra08:32
*** ociuhandu has joined #openstack-infra08:32
*** ociuhandu has quit IRC08:32
*** jpena|brb is now known as jpena08:32
*** ociuhandu has joined #openstack-infra08:33
*** ociuhandu has quit IRC08:34
*** ociuhandu has joined #openstack-infra08:35
*** jaosorior has quit IRC08:37
*** derekh has joined #openstack-infra08:38
*** ricolin_ is now known as ricolin08:41
*** panda has quit IRC08:48
*** dpawlik has joined #openstack-infra08:49
*** panda has joined #openstack-infra08:49
*** kmarc_ is now known as kmarc08:50
jrosseri've had a few jobs fail like this https://zuul.opendev.org/t/openstack/build/5b184b93fd2442ba86709ea14c8f7b54/log/job-output.txt#293708:56
*** odicha has quit IRC08:57
jrosserbut poking around in http://mirror.gra1.ovh.openstack.org i can't really tell if the libssl and libssl packages are consistent versions there08:57
jrosser*libssl and libssl-dev09:09
*** xenos76 has joined #openstack-infra09:09
openstackgerritMatthieu Huin proposed zuul/zuul master: Authorization rules: support YAML nested dictionaries  https://review.opendev.org/68479009:10
*** diablo_rojo has quit IRC09:13
*** kjackal has quit IRC09:14
*** diablo_rojo has joined #openstack-infra09:14
*** yamamoto has joined #openstack-infra09:17
*** yamamoto has quit IRC09:18
brtknrhow do we change IRC channel topic?09:22
toskybrtknr: your IRC client should allow you to do it (at most there is the /topic command), but the topic may be locked in some channels, where only operators can change it09:23
*** e0ne has joined #openstack-infra09:24
*** ab-a has quit IRC09:30
*** jbadiapa has joined #openstack-infra09:30
openstackgerritMatthieu Huin proposed zuul/zuul master: authentication config: add optional token_expiry  https://review.opendev.org/64240809:48
*** kaisers has quit IRC09:52
*** jaosorior has joined #openstack-infra09:52
*** kaisers has joined #openstack-infra09:53
*** roman_g has joined #openstack-infra09:54
*** iurygregory has quit IRC09:57
*** yamamoto has joined #openstack-infra09:58
*** hwoarang has quit IRC10:01
*** hwoarang has joined #openstack-infra10:02
*** ociuhandu has quit IRC10:02
*** ociuhandu has joined #openstack-infra10:03
*** yamamoto has quit IRC10:04
*** ociuhandu has quit IRC10:08
*** diablo_rojo has quit IRC10:08
*** yamamoto has joined #openstack-infra10:09
*** gfidente has quit IRC10:09
*** markvoelker has joined #openstack-infra10:10
*** markvoelker has quit IRC10:15
*** iurygregory has joined #openstack-infra10:17
*** whoami-rajat has quit IRC10:18
*** rcernin has joined #openstack-infra10:24
*** pgaxatte has quit IRC10:29
*** ykarel|away has quit IRC10:31
*** slaweq has quit IRC10:38
*** zbr|ruck is now known as zbr|lunch10:39
*** slaweq has joined #openstack-infra10:42
*** tosky_ has joined #openstack-infra10:49
*** slaweq has quit IRC10:51
*** e0ne has quit IRC10:51
*** tosky has quit IRC10:52
*** diablo_rojo has joined #openstack-infra10:54
*** slaweq has joined #openstack-infra10:57
*** jbadiapa has quit IRC10:57
*** tosky_ is now known as tosky10:58
*** ociuhandu has joined #openstack-infra10:58
*** tosky_ has joined #openstack-infra11:02
*** tosky is now known as Guest1863911:02
*** tosky_ is now known as tosky11:02
*** jaosorior has quit IRC11:02
*** dpawlik has quit IRC11:03
*** rh-jelabarre has quit IRC11:04
*** Guest18639 has quit IRC11:04
*** rh-jelabarre has joined #openstack-infra11:05
*** jovial[m] has quit IRC11:07
*** openstackstatus has quit IRC11:09
*** dpawlik has joined #openstack-infra11:14
noonedeadpunkHi folks! It looks like debian repos are out of sync right now https://zuul.opendev.org/t/openstack/build/5b184b93fd2442ba86709ea14c8f7b54/log/job-output.txt#293711:21
noonedeadpunkSo all debian tasks are failing with retry limits right now11:21
*** gfidente has joined #openstack-infra11:22
*** jpena is now known as jpena|lunch11:24
*** jaosorior has joined #openstack-infra11:28
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add NetworkManager and dhcp-client for CentOS 8  https://review.opendev.org/68609011:36
openstackgerritIan Wienand proposed openstack/diskimage-builder master: CentOS 8 minimal testing and support  https://review.opendev.org/68486011:36
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [wip] use mirrors for functional test builds  https://review.opendev.org/68588511:36
*** jamesmcarthur has joined #openstack-infra11:36
*** rpittau is now known as rpittau|afk11:38
*** yamamoto has quit IRC11:42
*** jamesmcarthur has quit IRC11:43
*** jamesmcarthur has joined #openstack-infra11:51
*** goldyfruit_ has quit IRC12:03
*** yamamoto has joined #openstack-infra12:03
*** yamamoto has quit IRC12:06
*** jbadiapa has joined #openstack-infra12:06
*** pgaxatte has joined #openstack-infra12:08
*** jamesmcarthur has quit IRC12:11
*** goldyfruit_ has joined #openstack-infra12:11
*** yamamoto has joined #openstack-infra12:11
*** jamesmcarthur has joined #openstack-infra12:11
*** goldyfruit_ has quit IRC12:17
*** ianychoi has quit IRC12:21
*** ianychoi has joined #openstack-infra12:25
*** derekh has quit IRC12:27
*** jpena|lunch is now known as jpena12:29
*** jamesmcarthur has quit IRC12:30
*** jamesmcarthur has joined #openstack-infra12:30
*** jbadiapa has quit IRC12:35
*** diablo_rojo has quit IRC12:37
*** rlandy has joined #openstack-infra12:40
*** jamesmcarthur has quit IRC12:45
*** diablo_rojo has joined #openstack-infra12:49
*** jamesmcarthur has joined #openstack-infra12:53
*** Goneri has joined #openstack-infra12:53
redrobotHi friends!  I need some help trying to fix a requirements check12:53
redrobotfor stable/stein12:53
*** jamesmcarthur has quit IRC12:54
*** jamesmcarthur has joined #openstack-infra12:54
redrobotI think I'm having a problem matching the Sphinx package12:55
redrobot#link https://opendev.org/openstack/requirements/src/branch/stable/stein/test-requirements.txt#L15-L1612:55
AJaegerredrobot: what exactly is the problem?12:56
AJaegerredrobot: copy in *both* lines12:56
AJaegerand add a minimal version, like ">= 1.6.2"12:56
redrobotAJaeger, yeah, the minimal version part is what seems not to work12:57
AJaegerredrobot: do you have an example?12:57
redrobot> Requirement for package sphinx has no lower bound12:57
AJaegerwhich review?12:57
redrobotAJaeger, https://review.opendev.org/#/c/686020/ ... but I haven't pushed my latest edits with the 2 lines for sphinx12:58
redrobotcurrently running locally12:58
AJaegertell me once you pushed it and I can check...12:58
*** derekh has joined #openstack-infra12:59
redrobotAJaeger, with the lower bound added, should it look like this?12:59
redrobotphinx!=1.6.6,!=1.6.7,>=1.6.2,<2.0.0;python_version=='2.7'  # BSD12:59
redrobotsphinx!=1.6.6,!=1.6.7,>=1.6.2;python_version>='3.4'  # BSD12:59
redrobotwith that I get this error:13:00
redrobot> Requirement(package='sphinx', location='', specifiers='!=1.6.6,!=1.6.7,<2.0.0,>=1.6.2', markers="python_version=='2.7'", comment='# BSD', extras=frozenset()) 'markers': "python_version=='2.713:00
redrobot'" does not match "python_version>='3.4'"13:00
AJaegerdo you have both lines there? Push it to gerrit and I'll check...13:01
*** hwoarang has quit IRC13:01
*** hwoarang has joined #openstack-infra13:03
AJaegerredrobot: looking at the log: You can ignore these. The error is elsewhere...13:03
redrobotAJaeger, oh ...  hmm ...13:04
AJaeger"Could not find a global requirements entry to match package {}. If the package is already included in the global list, the name or platform markers there may not match the local settings." is the error AFAIU - the {} is odd13:04
AJaegerbest ask on #openstack-requirements13:04
redrobotAJaeger, ack, thanks for the help!13:05
AJaegerredrobot: let me try somethign locally as well ;)13:05
*** ociuhandu has quit IRC13:06
*** ociuhandu has joined #openstack-infra13:07
*** mriedem has joined #openstack-infra13:08
*** jaosorior has quit IRC13:08
*** ociuhandu has quit IRC13:11
*** e0ne has joined #openstack-infra13:13
*** kjackal has joined #openstack-infra13:20
*** dpawlik has quit IRC13:20
*** aaronsheffield has joined #openstack-infra13:22
AJaegerfor reference, it was the sphinx line, there was one and not two13:26
*** yamamoto has quit IRC13:29
*** yamamoto has joined #openstack-infra13:29
AJaegerpabelanger: are the windmill readthedocs changes still on your radar for this week?13:30
*** ociuhandu has joined #openstack-infra13:31
pabelangerAJaeger: yes, but low to be honest. :(  It might just be better to remove them, over migrating them if that is blocking something.13:32
pabelangerthen I can go back and readd docs stuff13:33
openstackgerritJan Kubovy proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check  https://review.opendev.org/64455713:33
pabelangeras I need to learn more about opendev log publishing process13:33
AJaegerpabelanger: ok, I'll remove the dependency and leave the reviews there for you and you can take over ;)13:35
pabelangerAJaeger: wfm13:35
AJaegerif you need help with opendev docs publishing, please ask, happy to help13:35
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove windmill docs jobs  https://review.opendev.org/68561513:37
openstackgerritAndreas Jaeger proposed openstack/project-config master: Bye, bye readthedocs-failing  https://review.opendev.org/68561613:37
AJaegerpabelanger: want to +2 685615, please? ^13:37
pabelanger+213:38
AJaegerthanks13:40
*** ykarel has joined #openstack-infra13:45
*** zbr|lunch is now known as zbr|ruck13:48
*** zul has joined #openstack-infra13:51
AJaegerlogan-: could you review https://review.opendev.org/683431 , please - are you fine with that one?13:52
*** michael-beaver has joined #openstack-infra13:52
*** diablo_rojo has quit IRC13:52
AJaegerjamespage: could you review https://review.opendev.org/685617/ , please?13:53
*** markvoelker has joined #openstack-infra13:53
jamespageAJaeger: done13:54
*** bdodd has joined #openstack-infra13:54
AJaegerthanks, jamespage !13:54
*** jaosorior has joined #openstack-infra13:54
*** markvoelker has quit IRC13:58
*** prometheanfire has quit IRC13:58
*** eernst has quit IRC13:59
*** prometheanfire has joined #openstack-infra13:59
*** yamamoto has quit IRC13:59
*** eernst has joined #openstack-infra14:01
*** eernst has quit IRC14:06
*** panda has quit IRC14:06
*** panda has joined #openstack-infra14:08
*** goldyfruit has joined #openstack-infra14:09
noonedeadpunkso, is there any info regarding debian repos? as tasks still failing... Maybe you can init mirrors re-sync?14:09
*** mriedem has quit IRC14:10
*** mriedem has joined #openstack-infra14:10
AJaegerconfig-core, could you review https://review.opendev.org/685615 https://review.opendev.org/685616 and https://review.opendev.org/685618, please?14:12
*** goldyfruit_ has joined #openstack-infra14:15
brtknrttx: would you minding chaning the topic for #openstack-containers to "OpenStack Containers Team meets every Wednesday @ 9AM UTC (https://tinyurl.com/magnum-agenda)"14:15
brtknrturns out no one in our channel has the power to do it14:15
*** goldyfruit has quit IRC14:17
*** jaosorior has quit IRC14:18
AJaegerbrtknr: "/msg chanserv access #openstack-containers list" shows who has access14:19
AJaegerbrtknr: and indeed, none of the active folks have access. who's current PTL?14:19
brtknrAJaeger: looks like you do too :)14:20
brtknrflwang14:20
AJaegerbrtknr: let me add flwang so that he can do it - ok?14:20
brtknrsure14:20
AJaegerbrtknr: done, now flwang should be able to help further - and give permissions to others ;)14:22
brtknrAJaeger: excellent, thank you :)14:23
AJaegeryou're welcome14:23
AJaeger#status log added flwang to #openstack-containers channel with permissions +Aeortv14:24
AJaegerinfra-root, did we loose the bot? ^14:26
*** markvoelker has joined #openstack-infra14:26
*** openstackstatus has joined #openstack-infra14:28
*** ChanServ sets mode: +v openstackstatus14:28
corvusAJaeger: restarted14:28
*** jamesmcarthur has quit IRC14:28
AJaegerthanks, corvus . Do we need to log that one - or leave it out?14:29
*** rcernin has quit IRC14:30
*** goldyfruit___ has joined #openstack-infra14:33
jrossermy debian-stretch jobs are failing since yesterday, i think there may be a problem with the mirror, can anyone take a look?14:34
*** goldyfruit_ has quit IRC14:35
*** pgaxatte has quit IRC14:37
*** kaisers has quit IRC14:39
openstackgerritJan Kubovy proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check  https://review.opendev.org/64455714:40
openstackgerritMerged zuul/zuul-website master: CSS fix for ul/li in FAQ  https://review.opendev.org/68600314:41
corvusAJaeger: i'd log it14:44
openstackgerritMerged openstack/openstack-zuul-jobs master: Remove legacy sheepdog tests  https://review.opendev.org/66050514:46
*** jamesmcarthur has joined #openstack-infra14:48
funginoonedeadpunk: jrosser: i wasn't aware of problems with the debian-stretch mirror. i've been trying to work out what went wrong with the debian-buster index updates weeks ago, but my available time has been very scattered14:50
fungiit might be helpful if folks with disk space and bandwidth were to run the same script we use to build/update our copy14:51
fungiit's really just reprepro wrapped in a shell script14:51
jrosseri tried what is failing in our CI jobs locally, and that worked http://paste.openstack.org/show/780746/14:52
jrosseri'm wondering if the repo is has updated versions of the libssl but not libssl-dev (or vice-versa)14:52
fungisame suites and components as used in your job?14:52
jrosserwe don't mess with the repo settings in the job at all14:53
jrosserso it's whatever is there in the image14:53
AJaeger#status log added flwang to #openstack-containers channel with permissions +Aeortv14:54
openstackstatusAJaeger: finished logging14:54
fungiyeah, just wondering if your local test used the same mix of stretch, stretch-security, stretch-updates, stretch-backports and so on14:54
jrosserhmmm14:54
fungiyou should be able to compare the output of the apt update command in both logs and see if they've got similar suite/component entries (noting that the base urls will be different of course)14:55
fungibut yeah, the failure you linked earlier looks like you got libssl 1.1.0l-1~deb9u1 with an older libssl-dev 1.1.0k-1~deb9u114:56
jrosseryes, and i tried browsing around the mirror repo and it was quite confusing to unpick what came from where14:57
jrosseralso monumentally slow to browse14:57
fungiyes, the indices in an apt repository are under the dists tree while the packages themselves are under the pool tree14:58
fungiwhich makes it somewhat challenging to correlate14:59
fungi(this structure dates back to the origins of the "shared package pool" circa sarge, i think)14:59
jrosserdo you think it might be a view of the upstream repo half way through them updating the k -> l version of that package?15:00
fungiin investigating the earlier problem with the buster mirror i've gotten as far as determining that some of the indices don't seem to be getting updated, leading me to suspect reprepro either stopped writing them or started writing them to the wrong place15:01
fungijrosser: that's entirely possible, i saw a dsa yesterday or this morning about libssl15:01
fungireprepro is supposed to make sure the index refers to the packages which were retrieved, but it isn't necessarily safe against package transitions... though that's not supposed to happen because the upstream mirror we're fetching from shouldn't have an index in that state15:02
jrosserit checks consistency doesnt it, but thats likley just that the packages file is consistent with the names and hashes of the packages it has15:02
jrosseri'd be surprised if that extended to making sure all the dependancies were sane15:03
*** armax has joined #openstack-infra15:03
fungiright, i'm quite sure it assumes you're mirroring from an index which doesn't contain incompatible versions of dependent packages15:03
fungiso it's possible the mirror we're mirroring from had an index in an inconsistent state15:04
fungiwe're hitting http://ftp.us.debian.org/ though, which is a dns rr so not sure which actual mirror it hit15:05
jrosserseems that deb.debian.org is actually fastly cdn15:07
fungiyes15:08
clarkbfungi: jrosser: fwiw the buster issue is similar. The files in the index are not what we have in the package repo15:08
jrosserthe only difference between my local test and the faild job (other than the url) is extra contrib and non-free components here locally15:09
clarkbjrosser: and I assume using a different mirror?15:09
fungiyeah, if you're not installing any packages from contrib and non-free (libssl is in main) then that's irrelevant15:10
clarkbThe buster issue is very clearly a problem with what reprepro is writing out15:10
jrosseryes, deb.debian.org here15:10
clarkbwouldn't surprise me if stretch is now affected by the same problem15:10
toskydeb.debian.org is the suggested CDN iirc15:10
fungitosky: for clients but not necessarily for mirroring15:10
toskyoh15:11
clarkbnote the buster issue isn't a problem with the upstream we are mirroring from15:11
clarkbwas able to rule that out15:11
clarkbits in the new repo that reprepro writes out, but I don't understand the intricate details of how apt repos are supposed to work15:11
fungiyeah, i'm putting together a list of the last modified timestamps of the various packages.gz indices now15:11
jrosserfailing debian-stretch is a much bigger deal for us than buster as we check/gate on it15:12
jrosserso pragmatic decision on if we just move those to non-voting would be helpful15:12
clarkbjrosser: another option is to disable the use of our mirrors in jobs until we can sort out why reprepro isn't doing the right thing15:13
fungiinterestingly, the only packages.gz files with a last modified date in october are for stretch-backports and buster-backports15:13
clarkbfungi: but the log likely shows updates for packages in other repos right?15:14
clarkbthis is what I found with buster15:14
clarkbits not updating the index15:14
fungibuster-updates and stretch-updates have last modified times in the past couple weeks15:15
*** gfidente has quit IRC15:20
*** yamamoto has joined #openstack-infra15:22
*** mattw4 has joined #openstack-infra15:23
*** markvoelker has quit IRC15:25
fungiaptmethod got 'http://security.debian.org/pool/updates/main/o/openssl/libssl-dev_1.1.0k-1~deb9u1_amd64.deb'15:27
fungiaptmethod got 'http://security.debian.org/pool/updates/main/o/openssl/libssl1.1_15:27
fungi1.1.0k-1~deb9u1_amd64.deb'15:27
fungithose were from the debian-security update "Tue Jul  2 06:25:39 2019"15:28
*** yamamoto has quit IRC15:29
*** goldyfruit_ has joined #openstack-infra15:30
*** gyee has joined #openstack-infra15:30
logan-thanks AJaeger, reviewed15:31
fungiclarkb: jrosser: noonedeadpunk: oh! i think our images may have updated with newer indices15:32
* fungi can't find references to 1.1.0l-1~deb9u1 in our mirrors15:33
*** goldyfruit___ has quit IRC15:33
noonedeadpunkoh, yep, that may explain15:34
fungi2019-10-02 04:51:44.642303 | debian-stretch | Ign:3 http://mirror.gra1.ovh.openstack.org/debian-security stretch InRelease15:35
fungifrom the example failure15:35
fungi"ign" there means it ignored the index on the mirror15:35
jrosserah - why does it do that? it thinks it is old?15:36
fungibecause the one it already had was at least as new15:36
clarkbgj debian15:37
clarkbthe image builds should use our mirrorsiirc, but if it is ignoring our mirror there too...15:37
*** iurygregory has quit IRC15:37
* fungi checks the last image build log15:38
fungi2019-10-01 21:56:49.473 | Get:7 http://security-cdn.debian.org stretch/updates/main amd64 libssl1.1 amd64 1.1.0l-1~deb9u1 [1358 kB]15:39
fungihttps://nb02.openstack.org/debian-stretch-0000048979.log15:39
* fungi sighs15:39
clarkboh but we don't use our security mirror15:40
clarkbfor the build I mean15:40
fungi2019-10-01 21:56:02.402 | backports:deb http://mirror.dfw.rax.openstack.org/debian stretch-backports main15:41
fungi2019-10-01 21:56:02.402 | updates:deb http://mirror.dfw.rax.openstack.org/debian stretch-updates main15:41
fungi2019-10-01 21:56:02.402 | security:deb http://security.debian.org/ stretch/updates main15:41
*** tosky_ has joined #openstack-infra15:41
fungiexactly15:41
*** tosky is now known as Guest8305815:41
*** tosky_ is now known as tosky15:41
clarkbI think the fix is either use security from our mirror in image builds or use security from upstream in jobs15:43
clarkbsticking to the mirror across the board improves consistency and removes surprises15:43
*** Guest83058 has quit IRC15:43
noonedeadpunkI'd vote for the mirror:)15:44
fungii concur, just need to figure out why it's not picking up our security mirror15:44
pabelangerI didn't think we mirror security15:44
pabelangerand always went upstream15:45
jrosserhttps://opendev.org/zuul/zuul-jobs/commit/e330de0e09a5ce8a1f298e112bc36651eaa3d7cd15:46
fungifor long-running servers we shouldn't hit provider mirrors of the security archive, but for test nodes our jobs use we should always hit mirrors for improved performance and consistency15:47
*** ianychoi has quit IRC15:51
fungii think it's coming from here: https://opendev.org/openstack/diskimage-builder/src/branch/master/diskimage_builder/elements/debian-minimal/environment.d/10-debian-minimal.bash#L1615:52
*** lpetrut has quit IRC15:52
clarkbfungi: yup that will do it15:53
*** ianychoi has joined #openstack-infra15:54
fungiso the spirit of that default seems to be to discourage folks building debian images from relying on mirrors of security.debian.org (which is a laudable goal since that reduces the time to receive critical security updates)15:55
fungii think we want to preserve that, but still make it possible to override intentionally15:55
fungiif you're creating an image for a long-running server with debian-minimal, the behavior there makes sense. we have a corner case (ci node images) where it's suboptimal and where the normal concerns about speed of receiving security fixes don't apply15:58
*** ociuhandu has quit IRC15:58
*** ociuhandu has joined #openstack-infra15:59
fungiso i'll propose a patch to add a $DIB_DISTRIBUTION_SECURITY_MIRROR variable which defaults to http://security.debian.org/ so it's kept independent of the rest of the url generation15:59
*** ykarel is now known as ykarel|away16:01
clarkbthat seems like a reasonable compromise16:01
*** smarcet has joined #openstack-infra16:03
*** ociuhandu has quit IRC16:03
*** jamesmcarthur has quit IRC16:06
openstackgerritDavid Shrewsbury proposed zuul/nodepool master: Deregister a launcher when removed from config  https://review.opendev.org/68619816:09
openstackgerritJeremy Stanley proposed openstack/diskimage-builder master: Add security mirror override for debian-minimal  https://review.opendev.org/68619916:09
*** gfidente has joined #openstack-infra16:09
*** pcaruana has quit IRC16:10
*** pcaruana has joined #openstack-infra16:11
openstackgerritJeremy Stanley proposed openstack/project-config master: Override security mirror for Debian image builds  https://review.opendev.org/68620416:13
fungiclarkb: jrosser: noonedeadpunk: ^16:13
clarkbfungi: ^ small bug in that16:14
* fungi is unsurprised ;)16:14
jrosseris that going to get clobbered by the configure-mirrors role?16:14
fungijrosser: nope, that's specifically for the image building16:15
clarkbjrosser: no one is image build time the other is job run time16:15
jrosserright yes, so then the same mirror was used in both sitautions16:16
*** smarcet has quit IRC16:20
openstackgerritJeremy Stanley proposed openstack/diskimage-builder master: Add security mirror override for debian-minimal  https://review.opendev.org/68619916:21
*** rlandy is now known as rlandy|brb16:22
fungiall our mirrors have consistency assured by serving content from the same shared network filesystem, we just need to make sure our images are built from the mirrored package sets so that we don't get packages or indices on them newer than the ones our mirrors provide16:22
*** fdegir9 is now known as fdegir16:23
fungiusing one of our mirrors at image build time and a different one of our mirrors at job run time should be fine16:23
clarkbthrough the power of afs16:23
fungihowever, using official debian mirrors at image build time and our mirrors at job runtime risks race conditions like we've just observed16:23
fungiit's a problem we've known about and thought we'd stamped out, we just didn't notice debian image builds weren't using our mirrors for the security archive16:24
*** whoami-rajat has joined #openstack-infra16:26
fungialso entirely possible this was the cause of the confusing behaviors we've seen from the debian-buster images too16:26
*** tesseract has quit IRC16:29
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Replace command with shell in persistent-firewall  https://review.opendev.org/68621216:30
clarkbfungi: I think in buster I confirmed the packages in our mirror index were not in our mirror package pool16:31
fungiyeah16:31
clarkbthe index continued to list the old files but the pool had the new files16:31
fungii'm not expecting this to fix buster16:31
*** rlandy|brb is now known as rlandy16:37
*** tosky_ has joined #openstack-infra16:40
*** tosky has quit IRC16:43
*** derekh has quit IRC16:43
*** rfolco is now known as rfolco|dentist16:44
*** tosky_ is now known as tosky16:45
*** ociuhandu has joined #openstack-infra16:48
*** ociuhandu has quit IRC16:52
*** e0ne has quit IRC16:55
openstackgerritMerged openstack/project-config master: Remove windmill docs jobs  https://review.opendev.org/68561517:01
openstackgerritMerged openstack/project-config master: Bye, bye readthedocs-failing  https://review.opendev.org/68561617:02
*** factor has joined #openstack-infra17:14
openstackgerritFabien Boucher proposed zuul/zuul master: WIP - Gitlab - Basic handling of merge_requests event  https://review.opendev.org/68599017:15
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Replace command with shell in persistent-firewall  https://review.opendev.org/68621217:18
*** gfidente has quit IRC17:22
*** ykarel|away has quit IRC17:23
*** jpena is now known as jpena|off17:27
openstackgerritMerged zuul/zuul-registry master: Initial implementation  https://review.opendev.org/68395817:28
AJaegerthanks, logan-17:30
AJaegerconfig-core, please review https://review.opendev.org/#/c/685618/1 to remove now obsolete jobs/template in openstack-zuul-jobs17:32
*** pcaruana has quit IRC17:45
*** jamesmcarthur has joined #openstack-infra17:51
openstackgerritMerged zuul/zuul-jobs master: Replace command with shell in persistent-firewall  https://review.opendev.org/68621217:54
*** ykarel|away has joined #openstack-infra17:57
openstackgerritAndreas Jaeger proposed opendev/base-jobs master: Add docs templates  https://review.opendev.org/68622818:00
AJaegerteam, is there a reason we had no project-templates in opendev/base-jobs? The change above adds a first one ^18:01
AJaegerpabelanger: those templates might be interesting for your windmill repos - and mnaser can use them as well in https://opendev.org/vexxhost/openstack-monitoring/src/branch/master/zuul.d/project.yaml#L1718:02
clarkbAJaeger: I'm guessing because most stuff in there is expected to be parented to?18:02
clarkbshould be fine to add them if the jobs work without adding children18:02
*** igordc has joined #openstack-infra18:03
AJaegerclarkb: yes, works without children, see the vexxhost usage and the change itself (the repo will use the template ;)18:03
*** rossella_ has quit IRC18:04
openstackgerritTristan Cacqueray proposed zuul/zuul-registry master: Fix container image build  https://review.opendev.org/68580818:05
openstackgerritTristan Cacqueray proposed zuul/zuul-registry master: Add tox configuration and fixe flake8 errors  https://review.opendev.org/68623018:05
*** mattw4 has quit IRC18:16
*** ykarel|away has quit IRC18:16
*** mattw4 has joined #openstack-infra18:17
clarkbAJaeger: comment on the templates chnage18:18
*** iurygregory has joined #openstack-infra18:21
openstackgerritAndreas Jaeger proposed opendev/base-jobs master: Add docs templates  https://review.opendev.org/68622818:23
AJaegerclarkb: thanks, fixed18:23
mnaserAJaeger: neat, i can borrow that when it merges.18:24
openstackgerritClark Boylan proposed opendev/puppet-zuul master: Tell manage-ansible to upgrade zuul's ansible versions  https://review.opendev.org/68623718:30
clarkbtristanC: ^ that should ensure we get updated ansible versions18:30
openstackgerritMerged zuul/zuul-registry master: Fix container image build  https://review.opendev.org/68580818:33
jrosserI have funky behaviour trying to open embedded ara reports on iOS devices, like this https://4516fba44fa14a9699f2-2426a842487e6155337d0caa8d4dcb05.ssl.cf1.rackcdn.com/588372/7/check/openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic/9d39dbd/logs/ara-report/index.html18:34
*** e0ne has joined #openstack-infra18:34
jrosser“Safari cannot open the page, cannot decode raw data”18:35
clarkbopening that index.html or loading sub pages?18:36
jrosserI can’t open the index on an iPhone, for example18:39
clarkbas a sanity check it does open on my android phone with chrome. Do you get any other debugging info?18:39
*** e0ne has quit IRC18:40
jrossernothing useful on the device18:41
jrosseriirc you can use safari on a usb connected Mac as a remote debug console thing18:41
clarkbone thing I notice looking at headers when requeting that file is we have two content encodings specified18:42
clarkbdeflate and gzip18:42
jrosserbut that will have to wait till I’m not commuting18:42
clarkbI wonder if the phone doesn't know how to handle that (I'm not actually sure what the rules are around that but firefox and chrome seem to handle it somehow)18:43
clarkbThe index here https://4516fba44fa14a9699f2-2426a842487e6155337d0caa8d4dcb05.ssl.cf1.rackcdn.com/588372/7/check/openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic/9d39dbd/ does not do it, but the index at https://4516fba44fa14a9699f2-2426a842487e6155337d0caa8d4dcb05.ssl.cf1.rackcdn.com/588372/7/check/openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic/9d39dbd/logs/ does18:44
clarkbjrosser: can you try opening those two urls and see if one, both or none load?18:44
jrosserfirst one opens, second doesn’t18:45
jrosseron the first I can’t enter a dir though, same error18:45
clarkbya its those subdirs with the two content encodings18:45
jrosseroh, can go in Zuul-info, not logs/18:45
clarkbmultiple encodings are allowed, but they must be listed in the order in which they were applied18:47
clarkbsays the rfc https://tools.ietf.org/html/rfc2616#section-14.11 at least that means the server isn't doing anything obviously wrong unless the encodings are applied wronly18:47
jrosserthis used to work before the  ui revamp / swift logs, if that’s helpful data18:49
clarkbpossibly. Its a completely different set of webservers (that we don't control) now with swift18:49
*** mattw4 has quit IRC18:50
clarkbhttps://4516fba44fa14a9699f2-2426a842487e6155337d0caa8d4dcb05.ssl.cf1.rackcdn.com/588372/7/check/openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic/9d39dbd/logs/openstack/ is a subdir without multiple encodings18:50
jrosserI see that, but can’t enter the first subdue in there18:51
clarkbwgetting the file and running `file` against it shows it to be a zlib compressed object. decompressing that I get html18:53
clarkbso doesn't appear to be multi encoded18:53
clarkbjrosser: does this url work for you https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_b26/670051/23/check/openstack-ansible-deploy-aio_lxc-centos-7/b2677a2/logs/ara-report/18:55
clarkbits possible this behavior is rax specific18:55
openstackgerritTristan Cacqueray proposed zuul/zuul-registry master: WIP: add type annotations  https://review.opendev.org/68624918:56
jrosser clarkb works!19:00
*** dave-mccowan has joined #openstack-infra19:01
clarkbjrosser: ok I think that really does narrow this down to the multiple encodings behavior. I do not know why that is happening19:02
openstackgerritMerged openstack/project-config master: add common nested-virt lables  https://review.opendev.org/68343119:05
*** kopecmartin is now known as kopecmartin|off19:05
openstackgerritCorey Bryant proposed openstack/project-config master: New charm and interface for placement split  https://review.opendev.org/68625119:07
openstackgerritCorey Bryant proposed openstack/project-config master: New charm and interface for placement split  https://review.opendev.org/68625119:09
*** spsurya has quit IRC19:09
clarkbjrosser: ok after properly setting accept-encoding to match what my browser does I've confirmed that I get a gzip of a zlib of html19:09
clarkbjrosser: I think that implies (assuming this is the issue) that your browser cannot handle nested encodings properly19:10
clarkbjrosser: while odd, my read of this is it is entirely valid as long as your browser sends each of the encoding types in its accept encoding list19:12
clarkband if this is being applied by the remote webserver which we don't control I'm not sure what we can do to influence it19:12
clarkbyou don't get this scenario when requesting the file without an accept encodings list19:12
*** ykarel has joined #openstack-infra19:14
openstackgerritMerged zuul/nodepool master: Deregister a launcher when removed from config  https://review.opendev.org/68619819:22
*** ccamacho has joined #openstack-infra19:24
*** yamamoto has joined #openstack-infra19:27
*** ccamacho has quit IRC19:28
*** ykarel is now known as ykarel|away19:30
*** yamamoto has quit IRC19:32
*** rkukura has joined #openstack-infra19:34
corvusclarkb, fungi, mordred: continuing the google auth saga -- i attempted to use my work phone number (i have a work phone number! how cool!) with the 'automated voice call' option, and also received 'this phone number cannot be used for verification'.19:36
fungiyeesh19:40
fungii'm happy to try to "verify" it with my cell phone, but i don't usually leave the battery in it unless i'm expecting a call19:41
fungiwell, s/happy/willing/ anyway19:42
corvusfungi: it would probably work.  i'm extremely wary of doing anything that could tie this account with my personal google accounts (which i *have* verified with my personal cell phone) lest some perceived abuse on this account cause me to lose personal access to google services.  that is a real thing that has happened to people.  so i wouldn't ask that of anyone.19:44
fungihrm, yeah, i don't recall if i've used this number to verify another google account in the past19:45
corvusi've been talking to edwin, and he's been talking to other folks who know more, but i wouldn't really say we're close to a solution (other than a suggestion that maybe, perhaps, if we configured totp that might avoid this [even that is unclear], but of course, we can't log in to do that right now)19:46
corvusyou can use a number to verify multiple accounts, but the support page says "In an effort to protect you from abuse, we limit the number of accounts each phone number can create." so that's not a blank check.19:46
*** ykarel|away has quit IRC19:46
corvuspresumably there is some quota, and doing this would count against it19:47
corvusi am somewhat tempted to grab a prepaid sim and stick it in an old phone, but i'd give that a 90% chance of hitting "this phone number cannot be used for verification"19:48
*** dpawlik has joined #openstack-infra19:56
*** dpawlik has quit IRC20:01
*** dave-mccowan has quit IRC20:04
*** dave-mccowan has joined #openstack-infra20:10
*** remi_ness has joined #openstack-infra20:14
*** markvoelker has joined #openstack-infra20:21
*** jamesmcarthur has quit IRC20:23
*** mattw4 has joined #openstack-infra20:24
*** jamesmcarthur has joined #openstack-infra20:33
openstackgerritClark Boylan proposed opendev/puppet-zuul master: Tell manage-ansible to upgrade zuul's ansible versions  https://review.opendev.org/68623720:47
*** remi_ness has quit IRC20:54
*** dpawlik has joined #openstack-infra20:56
*** Goneri has quit IRC21:02
*** kjackal has quit IRC21:04
*** tosky_ has joined #openstack-infra21:05
*** lpetrut has joined #openstack-infra21:06
*** tosky has quit IRC21:06
*** dpawlik has quit IRC21:07
*** xek has quit IRC21:08
*** tosky_ is now known as tosky21:08
*** rakhmerov has quit IRC21:09
*** markvoelker has quit IRC21:11
auristorianw: sgid can be set in /afs but the client must be authenticated as a member of the system:administrators group21:11
*** markvoelker has joined #openstack-infra21:12
openstackgerritJames E. Blair proposed opendev/system-config master: Switch the insecure-ci-registry to zuul-registry  https://review.opendev.org/68629821:14
paladoxcorvus you've tied your number to your google account?21:14
* paladox tries to keep his number out of all his accounts :P21:15
*** lpetrut has quit IRC21:15
paladoxthat's the only way to keep the spammers call list down :)21:15
brtknrhmm flwang got added today as operator for #openstack-infra but he is still unable to change the topic21:16
brtknrs/infra/containers21:17
*** factor has quit IRC21:17
corvuspaladox: it's pretty hard to create a google account without a phone number for anti-bot verification.21:17
paladoxoh21:17
paladoxthat must be semi new21:17
clarkbbrtknr: flwwill have to op first if using /topic iirc21:18
clarkber tab complete fail21:18
clarkbif you eant you can have chanserv set it without op'ing up first21:18
brtknrclarkb: sorry i dont 100% understand what you mean21:19
*** dpawlik has joined #openstack-infra21:19
brtknrwhat is "op'ing"?21:19
clarkbbrtknr: with irc services they look at your current level of privileges. By default we all tend to operate at a normal level. You can explicitly /op into the operator privs to perform privileged tasks like setting the topic21:20
clarkbthen when done you can /deop21:20
clarkbas an alternative you can /msg ChanServ topic #channel-name topic here21:21
clarkband if you do that instead of /topic I don't think you need to do the op step21:21
clarkbThe other thing to check is that flwang is identified with nickserv21:22
clarkbbut I think all of our channels require you be identified before joining so that should all be fine already21:22
*** dpawlik has quit IRC21:24
*** auristor has quit IRC21:24
brtknrclarkb: is it /op or rather /msg ChanServ OP #openstack-containers flwang?21:25
clarkbbrtknr: both should work. The first is a client shortcut, the other direct communication to chanserv21:26
corvuspaladox: i noticed you turned off +r for #gerrit -- i haven't been keeping up with freenode happenings -- is that generally safe now, or, since we've already updated our docs to tell people how to register, do you think we should go ahead and keep it set?21:26
paladoxcorvus it should be safe now, freenode have implemented some measures. But some people manage to get through it.21:27
paladoxIf necessary we can turn +r back on, but because i haven't seen the type of attack that happened repeat it's self, it feels safe for me to disable it.21:28
corvuspaladox: thanks.  let's see if other folks feel like keeping the registration requirement is beneficial, or if maybe we should turn it off on a test channel and see how it goes...21:29
paladoxok :)21:29
paladoxi think some wikimedia channels switched this off, but could be remembering wrong.21:29
paladoxthe wikipedia-en channel did, but has to keep switching it on due to vandals sometimes.21:29
*** yamamoto has joined #openstack-infra21:31
corvusmy guess is that at this point we're probably pretty conservative and needing to turn it on sometimes is probably enough for us to want to keep it on21:31
paladoxah, ok21:32
*** auristor has joined #openstack-infra21:37
openstackgerritJames E. Blair proposed zuul/zuul master: web: render log manifest consistently  https://review.opendev.org/68630721:38
*** markvoelker has quit IRC21:41
*** markvoelker has joined #openstack-infra21:41
*** markvoelker has quit IRC21:45
*** markvoelker has joined #openstack-infra21:45
*** e0ne has joined #openstack-infra21:49
*** jamesmcarthur has quit IRC21:56
*** rfolco|dentist is now known as rfolco22:17
*** pkopec has quit IRC22:17
*** markvoelker has quit IRC22:17
*** mriedem has quit IRC22:31
*** goldyfruit_ has quit IRC22:33
*** yamamoto has quit IRC22:34
*** e0ne has quit IRC22:35
*** slaweq has quit IRC22:35
openstackgerritTristan Cacqueray proposed zuul/zuul-registry master: Add type annotations  https://review.opendev.org/68624922:46
*** rcernin has joined #openstack-infra22:48
*** tkajinam has joined #openstack-infra22:54
*** whoami-rajat has quit IRC22:59
*** dchen has joined #openstack-infra23:01
*** hogepodge has left #openstack-infra23:04
*** xenos76 has quit IRC23:06
*** yamamoto has joined #openstack-infra23:09
*** tosky has quit IRC23:16
openstackgerritTristan Cacqueray proposed zuul/zuul-registry master: Add type annotations  https://review.opendev.org/68624923:20
*** mattw4 has quit IRC23:28
*** aaronsheffield has quit IRC23:35
*** panda is now known as panda|off23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!