Wednesday, 2018-11-14

ianwI wonder if it has to do with "Vary: Accept-Encoding, Accept-Encoding"00:00
*** yamamoto has quit IRC00:02
ianwpypi seems to only send back "Vary: Accept-Encoding" when using curl00:02
*** emerson has joined #openstack-infra00:18
logan-is it still occurring? one of our upstreams had a problem from 10:20-11:00 UTC00:34
logan-(well,  they were still having the problem at 11:00 UTC but we disabled the problematic carrier)00:35
*** longkb has joined #openstack-infra00:44
*** longkb has quit IRC00:45
ianwlogan-: there are possibly two errors going on00:51
ianw(104)Connection reset by peer: [client 2001:4802:7805:104:be76:4eff:fe20:27f1:45986] AH01102: error reading status line from remote server pypi.org:44300:51
ianwthis sort of thing we're seeing fairly regularly00:51
ianwthe other thing, the mod_proxy(?) missing data file error, i'm not sure if it's related00:52
ianwlogan-: afaics, i don't think we're getting the "status line" errors on other hosts, mostly iad?  would that match up?00:55
*** tosky has quit IRC00:55
logan-hmm not sure, i was reading the backscroll and noticing the rackspace iad and our (limestone's) mirror had problems reaching upstream resources at the same time as we observed a major network outage on hurricane electric's network in NYC. so I wonder if some things were hitting routing instability during that event00:58
logan-fwiw hurricane's noc confirmed a router reloaded unexpectedly in NYC causing all kinds of routing changes there, and it is back online now. we just brought HE back online on our network and are not seeing any more losses at this time.. so it seems like they've recovered.01:00
logan-I'm signing off, it is late in Berlin. but if there are still odd things happening ping me and I'll follow up in the morning! we saw a lot of impact from that HE event so I suspect it is related and probably resolved now.01:11
EmilienMianw: I think we need to force merge https://review.openstack.org/617852 and https://review.openstack.org/#/c/617845/ if you don't mind01:12
EmilienMour situation is pretty bad now01:12
ianwEmilienM: ok01:14
EmilienMthanks01:14
ianw#status log force-merged 617852 & 617845 at the request of triple-o to help with long gate backlog01:19
openstackstatusianw: finished logging01:19
ianwEmilienM: ^01:19
EmilienMianw: thx01:20
ianwjust wandering out for some lunch, back in about 40 minutes01:20
*** rh-jelabarre has quit IRC01:21
*** gyee has quit IRC01:23
*** imacdonn has quit IRC01:38
*** longkb has joined #openstack-infra01:38
*** imacdonn has joined #openstack-infra01:39
*** dhill_ has quit IRC01:53
*** armax has quit IRC02:04
*** yamamoto has joined #openstack-infra02:30
*** yamamoto has quit IRC02:35
*** mrsoul has joined #openstack-infra02:37
*** rlandy has quit IRC02:49
*** psachin has joined #openstack-infra02:49
*** ijw has quit IRC02:59
*** ijw has joined #openstack-infra03:06
*** ijw has quit IRC03:10
*** roman_g has quit IRC03:11
dmsimardwhoever it is that thought about "your-readthedocs-job-requires-attention", that is clever03:21
dmsimard++03:21
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Fix docs-on-readthedocs for ara  https://review.openstack.org/61786403:32
ianwI think maybe there's something on this caching error ...03:37
ianwUser-Agent: setuptools/40.6.2 Python-urllib/2.703:37
ianwthis is not a common user-agent03:38
*** ramishra_ has joined #openstack-infra03:40
*** ijw has joined #openstack-infra03:44
dmsimardsounds like pip ?03:46
dmsimardheh, I should have expected the first hit on google https://pypi.org/project/user-agents/03:47
dmsimardhttps://github.com/pypa/pip/blob/master/src/pip/_internal/download.py#L70-L13603:48
*** ijw has quit IRC03:49
ianwyeah, pip has it's own UA03:51
ianwthis is too weird, definitely something going on with mod_cache i think03:51
ianwi'll write up a story03:52
*** Bhujay has joined #openstack-infra03:53
*** armax has joined #openstack-infra03:55
dmsimardianw: great work on https://review.openstack.org/#/c/617216/, added a comment03:57
dmsimardreplied on 611228 too03:58
ianwdmsimard: it is a bit of a pita to support versions in the name, because you have to blank out the "version" paramater ... i think i've got it fairly logical in the change i referenced ... at least it hides the complexity in the role and at the top level it's logical04:03
*** udesale has joined #openstack-infra04:05
*** ijw has joined #openstack-infra04:34
*** ijw has quit IRC04:40
*** udesale has quit IRC04:50
*** lpetrut has joined #openstack-infra04:51
*** udesale has joined #openstack-infra05:02
*** efried has joined #openstack-infra05:13
*** chandankumar has joined #openstack-infra05:25
*** lpetrut has quit IRC05:25
*** auristor has quit IRC05:26
*** Bhujay has quit IRC05:29
openstackgerritMerged openstack-infra/project-config master: Fix docs-on-readthedocs for ara  https://review.openstack.org/61786405:34
*** efried has quit IRC05:36
*** ijw has joined #openstack-infra05:44
*** janki has joined #openstack-infra05:44
*** ijw has quit IRC05:48
*** dave-mccowan has joined #openstack-infra05:49
*** dave-mccowan has quit IRC05:54
ianw#status log rebooting mirror01.iad.rax.openstack.org to see if it helps with persistent pypi.org connection resets -- see comment in https://storyboard.openstack.org/#!/story/2004334#comment-11039405:57
openstackstatusianw: finished logging05:57
*** dave-mccowan has joined #openstack-infra06:02
*** chandankumar is now known as chkumar|ruck06:04
*** d0ugal has quit IRC06:04
*** armax has quit IRC06:05
*** Douhet has quit IRC06:06
*** Douhet has joined #openstack-infra06:15
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/61788506:17
*** d0ugal has joined #openstack-infra06:18
*** kjackal has joined #openstack-infra06:18
*** rfolco has quit IRC06:29
*** apetrich has quit IRC06:31
*** auristor has joined #openstack-infra06:32
*** ifat_afek has joined #openstack-infra06:35
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/61788506:48
ianwhrm, storyboard is eating my comments, i just got "500: POST /api/v1/stories/2004334/comments: 'ExceptionContextImpl' object has no attribute 'engine' "06:53
ianw#status log after receiving several 500 errors from storyboard.o.o; i restarted the worker services and apache2 on the server.  backtrace is in apache error logs and matches what was seen on client error box06:59
openstackstatusianw: finished logging06:59
ianwfungi: ^06:59
ianwlogan- / infra-root: i think that mirror.iad.rax.openstack.org is having issues with ipv6 -- see comment https://storyboard.openstack.org/#!/story/2004334#comment-11039807:00
ianwinfra-root: however, these mod_disk_cache errors that we see on all the servers I still am stymied by ... see all comments on https://storyboard.openstack.org/#!/story/200433407:01
ianwfor now, i think i give up :)07:02
*** yamamoto has joined #openstack-infra07:02
*** yamamoto has quit IRC07:09
*** lpetrut has joined #openstack-infra07:21
*** dave-mccowan has quit IRC07:25
*** annp has joined #openstack-infra07:30
*** quiquell|off is now known as quiquell07:39
quiquellianw: Good morning, Can I download the image cooked here https://github.com/openstack-infra/project-config/blob/master/nodepool/nodepool.yaml#L120 ?07:40
*** mriedem has joined #openstack-infra07:40
*** pcaruana has joined #openstack-infra07:42
clarkbquiquell: yes check https://nb01.openstack.org/images and nb02 as well07:43
quiquellclarkb: thanks07:43
clarkbit is a self signed cert07:43
quiquellclarkb: ack07:43
quiquellclarkb: Will trust it :-)07:43
*** lpetrut has quit IRC07:44
fungithe only reason we even set those to support https is that one of them is in a network in china which seems to break long-running http sessions07:55
*** Douhet has quit IRC07:58
*** Douhet has joined #openstack-infra07:59
ianwgood morning everyone :)08:01
*** ginopc has joined #openstack-infra08:03
fungiguten morgen herr ianw08:03
*** lbragstad has joined #openstack-infra08:08
*** yamamoto has joined #openstack-infra08:10
*** e0ne has joined #openstack-infra08:13
*** yamamoto_ has joined #openstack-infra08:13
*** yamamoto has quit IRC08:14
*** yamamoto_ has quit IRC08:23
*** yamamoto has joined #openstack-infra08:24
corvusfungi, clarkb: jimmy said the scs folks didn't like our dnskey record... i forwarded you the email... can you help me double check that?  i'm not quite sure how to respond08:33
*** yamamoto has quit IRC08:34
*** yamamoto has joined #openstack-infra08:36
clarkbhave an ip address of an ns1/ns2 handy?08:38
corvus104.239.140.165 162.253.55.1608:38
*** yamamoto has quit IRC08:39
*** yamamoto has joined #openstack-infra08:39
*** tosky has joined #openstack-infra08:42
quiquellclarkb: It's possible to use key-name with the centos-7 openstack-infra image ?08:44
clarkbquiquell: yes it use glean and will configure that key for root user08:44
quiquellclarkb: I was trying zuul user, ok will use root08:45
*** e0ne has quit IRC08:47
*** phausman has joined #openstack-infra08:47
quiquellclarkb: working thanks !08:48
*** e0ne has joined #openstack-infra08:49
*** e0ne has quit IRC08:50
*** e0ne has joined #openstack-infra08:51
*** yamamoto has quit IRC08:52
*** yamamoto has joined #openstack-infra08:53
*** jpena|off is now known as jpena08:54
*** ifat_afek has quit IRC08:56
*** e0ne has quit IRC08:57
fungicorvus: too many characters huh? same number as my dnssec key for yuggoth.org08:58
*** smarcet has joined #openstack-infra08:58
clarkbcorvus: dig dnskey opendev.org @104... doesnt return a result? Im on my phone so could be pebkac08:58
*** e0ne has joined #openstack-infra08:58
*** jpich has joined #openstack-infra09:02
*** markvoelker has joined #openstack-infra09:03
*** yamamoto has quit IRC09:05
*** yamamoto has joined #openstack-infra09:05
*** e0ne has quit IRC09:10
corvusclarkb: i'm not sure it's supposed to; i think the delegating zone would return that (eg .org)09:10
corvusclarkb: be aware that evil hijacking is happening at the conference, so best to do testing from a shell elsewhere09:11
*** e0ne has joined #openstack-infra09:12
clarkbya Im using remote shell on phone09:13
*** e0ne has quit IRC09:13
*** apetrich has joined #openstack-infra09:14
*** e0ne has joined #openstack-infra09:14
*** e0ne has quit IRC09:15
*** ralonsoh has joined #openstack-infra09:16
fungi`host -t dnskey zuul-ci.org ns1.openstack.org` seems to work09:17
*** ianychoi has quit IRC09:20
fungior `dig dnskey zuul-ci.org @ns1.openstack.org` if you prefer09:20
fungibut i agree i'm not sure whether that's something we should expect to work if it's not chained from the tld09:21
quiquellcorvus: How is openstack-infra nodepool working, is the zuul key known for nodepool ?09:21
quiquellcorvus: I mean 'zuul' user key09:21
corvusfungi: hrm, i agree, that seems to be different.  i wonder why (though i'm not sure it's critical for the registry)09:22
quiquellcorvus: is there something I can add so it injects key-name to zuul user ?09:23
fungicorvus: right, i'm not sure it's relevant, just noting it's a (perhaps expected?) difference in behavior09:24
*** markvoelker has quit IRC09:24
*** dkehn has quit IRC09:25
fungiquiquell: those images rely on glean to set up ssh keys from configdrive or metadata server in your cloud09:25
fungiif you're trying to boot them locally, configdrive is probably the simpler of the two to satisfy09:25
corvusfungi: it looks like when bind signs the zone, it adds dnskey records09:26
*** roman_g has joined #openstack-infra09:26
corvusit looks like the new servers aren't doing that09:29
quiquellfungi: Was playing around with local nodepool instance over those images, can I add some config at nodepool to do that ?09:29
clarkbquiquell: you can modify the image locally09:31
fungiyeah, that's also a (likely easy) option. mount it on loopback and add .ssh/authorized_keys entries09:33
fungiroot login is enabled, so easiest to add keys to the root account09:34
quiquellfungi, clarkb: And an easy way to modify it so zuul user get the keys from "key-name" ?09:34
quiquelllooks like it's working for root user09:34
clarkbquiquell: glean doesnt support that. It is opinionated that way09:35
clarkbyou can modify the image to include your key in the zuul user09:35
quiquellclarkb: ack, will do that good enough for testing09:36
quiquellclarkb, fungi: thank you guys09:36
*** derekh has joined #openstack-infra09:40
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Fix key filename on master ns  https://review.openstack.org/61791709:40
corvusclarkb, fungi: ^ maybe that's the problem09:40
*** yamamoto has quit IRC09:43
fungioh! good catch. i was going to resort to more in-depth side-by-side configuration comparisons once keynotes wrapped up09:44
*** jtomasek has joined #openstack-infra09:46
fungicorvus: perms on the directory differ too, fwiw09:48
*** Bhujay has joined #openstack-infra09:50
*** Bhujay has quit IRC09:51
*** smarcet has quit IRC09:51
*** Bhujay has joined #openstack-infra09:51
*** dave-mccowan has joined #openstack-infra09:54
*** yamamoto has joined #openstack-infra09:54
*** yamamoto has quit IRC09:55
*** yamamoto has joined #openstack-infra09:55
*** jtomasek has quit IRC09:55
*** bobh has joined #openstack-infra09:59
*** apetrich has quit IRC10:00
*** ijw has joined #openstack-infra10:01
*** bobh has quit IRC10:01
*** yamamoto has quit IRC10:01
*** yamamoto has joined #openstack-infra10:03
*** lbragstad has quit IRC10:03
*** bobh has joined #openstack-infra10:05
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: Add allowed-labels tenant setting  https://review.openstack.org/61774010:05
*** ijw has quit IRC10:06
*** dave-mccowan has quit IRC10:07
*** yamamoto has quit IRC10:07
*** ifat_afek has joined #openstack-infra10:07
*** markmcd has joined #openstack-infra10:08
*** yamamoto has joined #openstack-infra10:09
*** yamamoto has quit IRC10:11
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: Remove nodepool-k8s-functional and install-nodepool roles  https://review.openstack.org/61640910:13
*** yamamoto has joined #openstack-infra10:13
*** priteau has joined #openstack-infra10:14
*** yamamoto has quit IRC10:17
*** e0ne has joined #openstack-infra10:24
*** yamamoto has joined #openstack-infra10:26
*** florianf has joined #openstack-infra10:26
*** ccamacho has joined #openstack-infra10:27
*** ccamacho has quit IRC10:27
*** ccamacho has joined #openstack-infra10:27
*** ijw has joined #openstack-infra10:28
*** e0ne has quit IRC10:29
*** yamamoto has quit IRC10:30
*** yamamoto has joined #openstack-infra10:32
*** ijw has quit IRC10:33
*** priteau has quit IRC10:39
*** yamamoto has quit IRC10:39
*** mriedem has quit IRC10:40
*** bobh has quit IRC10:40
*** phausman has quit IRC10:42
*** phausman has joined #openstack-infra10:44
*** ijw has joined #openstack-infra10:44
*** rossella_s has joined #openstack-infra10:45
*** ijw has quit IRC10:48
*** lbragstad has joined #openstack-infra10:49
fungioh, and on the key files themselves. comments left on the change10:54
*** smarcet has joined #openstack-infra10:54
fungii'm happy to push the perms/ownership config in another patchset if you like10:55
*** e0ne has joined #openstack-infra10:57
*** udesale has quit IRC10:59
*** ijw has joined #openstack-infra11:00
*** priteau has joined #openstack-infra11:01
ssbarnea|bkp2corvus: hi! regarding gertty, i seen you are the sole core-survivor on it :)11:03
*** ijw has quit IRC11:04
*** rfolco has joined #openstack-infra11:05
*** dave-mccowan has joined #openstack-infra11:06
*** longkb has quit IRC11:06
*** rossella_s has quit IRC11:09
*** eernst has joined #openstack-infra11:11
*** ijw has joined #openstack-infra11:16
*** smarcet has quit IRC11:18
*** lbragstad has quit IRC11:18
*** ijw has quit IRC11:20
*** eernst has quit IRC11:23
quiquellclarkb: Where can I see the zuul.conf ? I want to check how openstack-infra connects to git.openstack.org11:23
*** smarcet has joined #openstack-infra11:25
*** ijw has joined #openstack-infra11:28
*** dave-mccowan has quit IRC11:28
*** e0ne has quit IRC11:30
*** ijw has quit IRC11:32
*** priteau has quit IRC11:32
*** smarcet has joined #openstack-infra11:33
*** electrofelix has joined #openstack-infra11:43
*** ijw has joined #openstack-infra11:43
*** ijw has quit IRC11:48
*** ifat_afek has quit IRC11:54
corvusfungi: if you can that would be great11:55
fungiglad to!11:55
fungiworking on it now11:55
*** ijw has joined #openstack-infra11:59
*** ijw has quit IRC12:04
quiquellcorvus: do you know where can I take a look at zuul.conf openstack-infro uses ? I don't find it a project-config12:04
corvusquiquell: i think it's generated by puppet through templates12:05
corvusquiquell: may be easier for me to just paste the result :)12:05
quiquellcorvus: Just want to check "gerrit" connection items (I don't want to see passwords either :-)12:06
corvusquiquell: http://paste.openstack.org/show/734818/12:07
quiquellcanonical_hostname=git.openstack.org that was the missing piece12:08
quiquell:-)12:08
quiquellthanks12:08
corvusquiquell: ah that basically "renames" all the repos in zuul, so they are referenced as (and put on disk as) for example git.o.o/openstack/nova12:12
quiquellcorvus: I was using driver: git but I want to test Depends-On12:12
quiquellcorvus: with driver: git you cannot point out to refspecs (I think)12:12
*** smarcet has quit IRC12:13
*** bobh has joined #openstack-infra12:15
*** priteau has joined #openstack-infra12:16
*** ifat_afek has joined #openstack-infra12:17
*** mriedem has joined #openstack-infra12:19
corvusquiquell: the git drier isn't really designed for proposed changes; it can only handle post-merge jobs (or be used to load configuration)12:23
quiquellcorvus: Will try github12:24
quiquellcorvus: Can I add a Depends-On at a github commit pointing to gerrit ?12:24
quiquellcorvus: It should work ?12:24
corvusquiquell: yes that should work12:26
clarkbfungi: (and other infra-root at the summit) I am in tristanC and dirk's log machine learning session12:26
clarkbis someone going to be able to make it to ttx's forum session in this slot?12:26
*** dave-mccowan has joined #openstack-infra12:26
*** ijw has joined #openstack-infra12:30
*** smarcet has joined #openstack-infra12:30
*** bhavikdbavishi has joined #openstack-infra12:30
*** jpena is now known as jpena|lunch12:31
*** ijw has quit IRC12:35
*** priteau has quit IRC12:36
*** eernst has joined #openstack-infra12:39
*** bnemec has joined #openstack-infra12:39
* AJaeger is in tobiash's Zuul session now12:39
*** quiquell is now known as quiquell|lunch12:40
*** yamamoto has joined #openstack-infra12:41
fungiclarkb: i am in the better exposing what we produce session now, yes12:42
*** panda is now known as panda|rover12:42
fungihad to sprint back from the diversity and inclusion thing12:42
*** bobh has quit IRC12:42
*** rh-jelabarre has joined #openstack-infra12:44
*** smarcet has quit IRC12:45
*** ijw has joined #openstack-infra12:47
AJaegerfungi, clarkb, do you know how to reach the www.openstack.org admin? The server is not reachable for me  at all ;(12:49
fnordahlconfig-core: would anyone be around for a second review of https://review.openstack.org/#/c/615855/12:50
clarkbAJaeger: yes I can ping them12:50
fungiAJaeger: jamesmcarthur is here in the room with me and working on it12:50
clarkbah ok already on it12:51
* fungi is not working on it, just happens to be sitting in the same session12:51
*** ijw has quit IRC12:51
openstackgerritJeremy Stanley proposed openstack-infra/system-config master: Tighten permissions on zone keys  https://review.openstack.org/61793912:52
AJaegerfungi, thanks for info.12:52
AJaegerclarkb: thanks as well12:53
fungilooks like it should be back again12:53
*** eernst has quit IRC12:54
AJaegerfungi: indeed - thanks, jamesmcarthur12:56
*** yamamoto has quit IRC12:57
*** yamamoto has joined #openstack-infra12:57
*** trown|outtypewww is now known as trown13:01
*** lbragstad has joined #openstack-infra13:01
*** bobh has joined #openstack-infra13:07
*** yamamoto has quit IRC13:07
*** bnemec has quit IRC13:08
*** yamamoto has joined #openstack-infra13:09
fricklerfnordahl: there's a second branch on https://github.com/openstack-charmers/charm-barbican-vault , can you confirm that you want that one imported, too?13:09
*** yamamoto has quit IRC13:11
fnordahlfrickler: I merged it into master and removed it now13:11
*** yamamoto has joined #openstack-infra13:11
fricklerfnordahl: k, thx13:13
*** rlandy has joined #openstack-infra13:14
*** jaosorior has joined #openstack-infra13:14
*** Bhujay has quit IRC13:14
*** bobh has quit IRC13:18
*** jaosorior has quit IRC13:18
*** ijw has joined #openstack-infra13:19
*** dhill_ has joined #openstack-infra13:20
*** yamamoto has quit IRC13:21
openstackgerritMerged openstack-infra/project-config master: Add new charm repositories  https://review.openstack.org/61585513:21
*** dkehn has joined #openstack-infra13:22
*** ijw has quit IRC13:23
*** e0ne has joined #openstack-infra13:23
clarkbtristanC: dirk re the infra  spec for logclassify it is marked/labeled as a draft. Would you like feedback at this point or does it still need updates first?13:25
*** bobh has joined #openstack-infra13:25
*** udesale has joined #openstack-infra13:27
*** ijw has joined #openstack-infra13:29
*** yamamoto has joined #openstack-infra13:30
*** rh-jelabarre has quit IRC13:32
*** quiquell|lunch is now known as quiquell13:32
*** armstrong has joined #openstack-infra13:33
*** aspiers[m] has joined #openstack-infra13:33
armstrong@aspiers:13:34
*** ijw has quit IRC13:34
*** rh-jelabarre has joined #openstack-infra13:35
*** rh-jelabarre has quit IRC13:36
*** chkumar|ruck has quit IRC13:37
*** jpena|lunch is now known as jpena13:37
*** yamamoto has quit IRC13:37
*** lbragstad has quit IRC13:38
*** yamamoto has joined #openstack-infra13:38
*** e0ne has quit IRC13:38
*** rh-jelabarre has joined #openstack-infra13:41
*** eernst has joined #openstack-infra13:43
aspiers[m]armstrong: I'll message you privately13:44
openstackgerritMarkus Hosch proposed openstack-infra/zuul master: Allow to select the merge method in GitHub  https://review.openstack.org/61794913:44
openstackgerritMerged openstack-infra/system-config master: Fix key filename on master ns  https://review.openstack.org/61791713:45
*** ijw has joined #openstack-infra13:45
*** yamamoto has quit IRC13:46
*** yamamoto has joined #openstack-infra13:46
*** ijw has quit IRC13:50
*** ccamacho has quit IRC13:51
*** openstackgerrit has quit IRC13:51
*** bobh has quit IRC13:51
*** ccamacho has joined #openstack-infra13:53
*** zigo has joined #openstack-infra13:58
*** eernst has quit IRC14:00
*** ijw has joined #openstack-infra14:01
*** dave-mccowan has quit IRC14:03
*** boden has joined #openstack-infra14:03
*** pbourke has quit IRC14:03
*** pbourke has joined #openstack-infra14:04
*** ifat_afek has quit IRC14:04
*** ijw has quit IRC14:06
*** yamamoto has quit IRC14:09
*** efried has joined #openstack-infra14:16
*** ijw has joined #openstack-infra14:17
*** ijw has quit IRC14:21
*** lbragstad has joined #openstack-infra14:23
*** yamamoto has joined #openstack-infra14:24
fnordahlfrickler: ta!14:27
*** ijw has joined #openstack-infra14:27
*** bhavikdbavishi has quit IRC14:29
*** openstackgerrit has joined #openstack-infra14:32
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Handle existing .ssh dir on merger  https://review.openstack.org/61795514:32
*** ijw has quit IRC14:32
*** e0ne has joined #openstack-infra14:35
*** ijw has joined #openstack-infra14:36
*** dklyle has quit IRC14:39
dirkclarkb: tristanC and I probably want to update it first14:39
dirkBecause things changes slightly meanwhile14:39
dirkI'll get to look at that next week14:40
*** rossella_s has joined #openstack-infra14:40
*** bobh has joined #openstack-infra14:41
*** agopi has quit IRC14:41
tristanCclarkb: thanks for joining. To follow your question, yes we are looking forward running the model with openstack-infra build data.14:45
*** rossella_s has quit IRC14:45
tristanCclarkb: but we need to better measure its performance, and maybe setup an opt-in system to begin steps by steps14:46
*** e0ne has quit IRC14:51
*** ifat_afek has joined #openstack-infra14:55
*** ijw has quit IRC14:57
*** agopi has joined #openstack-infra15:00
corvusfungi: with the 'K' fix in place, zuul-ci.org is correctly signed and has DNSKEY records, but opendev produces this: Nov 14 14:39:29 adns1 named[13395]: dns_dnssec_findmatchingkeys: error reading key file Kopendev.org.+008+03945.private: private key is invalid15:01
corvusclarkb: ^15:01
*** agopi_ has joined #openstack-infra15:01
*** bobh has quit IRC15:02
corvusclarkb, fungi: i think there's a copypasta error in private hiera; i will fix15:04
*** lbragstad has quit IRC15:04
corvusor whatever we call private hiera now :)15:04
*** agopi has quit IRC15:04
*** mriedem has quit IRC15:06
*** lbragstad has joined #openstack-infra15:06
*** agopi_ is now known as agopi15:06
corvusclarkb, fungi: done; hopefully should splat out the right thing in the next run15:07
clarkbyay15:07
corvusclarkb, fungi: i still haven't seen anything that suggests that we sent invalid data, but once this is through we should be able to prove that :)15:08
*** yamamoto has quit IRC15:08
openstackgerritJose Luis Franco proposed openstack-infra/project-config master: ansible-role-redhat-subscription: switch to non-pypi jobs  https://review.openstack.org/61797415:09
*** apetrich has joined #openstack-infra15:09
corvusodyssey4me: who was working on the reproducer script?  arxcruz|summit may be intersted in helping15:17
corvusodyssey4me: (for zulu)15:18
corvuszuul15:18
arxcruz|summitodyssey4me: hey, you :)15:18
odyssey4mecorvus arxcruz|summit o/ I'm at the summit in the Open Infrastructure lounger if you wanna chat?15:18
arxcruz|summitcorvus: is odyssey4me also the one related to the rest api ?15:18
*** bobh has joined #openstack-infra15:19
arxcruz|summitodyssey4me: i'm at zuul onboarding now, but we can chat later, today or tomorrow un the osa dinner, i'll be there15:19
*** mriedem has joined #openstack-infra15:20
odyssey4mearxcruz|summit Unfortunately I'm leaving Berlin tomorrow evening, so missing the dinner.15:20
*** kopecmartin has joined #openstack-infra15:20
arxcruz|summitodyssey4me: in one hour today ? i really need to watch this one :/15:20
odyssey4mearxcruz|summit Sure. I'm not going anywhere for a while.15:21
openstackgerritJose Luis Franco proposed openstack-infra/project-config master: ansible-role-* projects switch to non-pypi jobs  https://review.openstack.org/61797415:21
*** yamamoto has joined #openstack-infra15:21
arxcruz|summitodyssey4me: cool! i'll ping you in one hour :)15:21
*** kopecmartin has quit IRC15:22
*** e0ne has joined #openstack-infra15:22
*** efried has quit IRC15:26
openstackgerritQuique Llorente proposed openstack-infra/zuul master: Prevet exception at executor  https://review.openstack.org/61798415:33
openstackgerritQuique Llorente proposed openstack-infra/zuul master: Prevent exception at executor  https://review.openstack.org/61798415:34
openstackgerritSteve Kowalik proposed openstack-infra/project-config master: Set translate option for contributor-guide  https://review.openstack.org/61798615:34
openstackgerritQuique Llorente proposed openstack-infra/zuul master: Prevent exception at executor  https://review.openstack.org/61798415:35
*** jtomasek has joined #openstack-infra15:35
fungiopendev.org has DNSKEY record 257 3 8 AwEAAbd/UcFezTMMxdPElieNYM7aJJy7MYKFkznXrDx3yz7Bb/Qth7Ts J3uhmkfBxaEbCz+fpz/F0Bupf4gIZEBBL2VvkSw0yGCV1+8IEYWl+A7Q Lq/oDayWRhKHhULMY/X/EsuwXflpAceFrEcxHMZQEYqHLTL/r+EIfLS9 BJ+WjiZy7Nvxk6xRbK/rqXUtyrvllC/PluDyyizrTcqRrvHiSSmUjA7X h++GTbx1ddGW05MeYnJGx6GMMKEtUOZM223d/hrHwRbimq1SFrYbPhr1 7pbpXiQHHHjWSiVjGBO0/+jDOth9JKOPT3W2Heh9/3QNvHuOAHEPk0gF DvGKHE6MV3E=15:45
fungicorvus: clarkb: ^ looks like it's resolving from the opendev nameservers now15:45
clarkbis the space there expected?15:46
fungiyes15:47
fungispaces (there are some half-dozen spaces in the key, they get elided by verifiers)15:48
fungiin particular, base64 decoding ignores spaces15:49
fungiyou can compare to other working dnssec-using domains15:49
clarkbI wonder if that causes the confusion?15:52
fungiit matches how my personal domains are configured as well (perhaps because i also followed the bind configuration examples? not because one system was copied from the other)15:53
*** yamamoto has quit IRC15:54
clarkbya just wondering if they are byte counting and see those spaces as extra bytes not realizing they will be eaten by base64 decode15:54
*** dklyle has joined #openstack-infra15:55
fungiisc.org has DNSKEY record 257 3 5 BEAAAAOhHQDBrhQbtphgq2wQUpEQ5t4DtUHxoMVFu2hWLDMvoOMRXjGr hhCeFvAZih7yJHf8ZGfW6hd38hXG/xylYCO6Krpbdojwx8YMXLA5/kA+ u50WIL8ZR1R6KTbsYVMf/Qx5RiNbPClw+vT+U8eXEJmO20jIS1ULgqy3 47cBB1zMnnz/4LJpA0da9CbKj3A254T515sNIMcwsB8/2+2E63/zZrQz Bkj0BrN/9Bexjpiks3jRhZatEsXn3dTy47R09Uix5WcJt+xzqZ7+ysyL KOOedS39Z7SDmsn2eA0FKtQpwA6LXeG2w+jxmw3oA8lVUgEf/rzeC/bB yBNsO70aEFTd15:58
fungiif spaces are the problem, it's hard to argue with isc.org ;)15:59
*** jrist has quit IRC15:59
*** lbragstad has quit IRC16:00
clarkboh definitely I'm more thinking thatay be their confusion16:00
*** tosky has quit IRC16:00
*** tosky has joined #openstack-infra16:00
fungithey don't seem to need any excuse to get confused, unfortunately16:01
mgagnehttps://www.ietf.org/rfc/rfc4034.txt  Whitespace is allowed within the Base64 text.16:01
fungiunfortunately they didn't exactly come back to us with more than a vague "it has too many characters"16:02
*** dave-mccowan has joined #openstack-infra16:04
*** ccamacho has quit IRC16:07
clarkbfungi is the 3 the key type?16:07
*** irclogbot_1 has quit IRC16:07
clarkbor is it 5 vs 8?16:08
clarkbalso I may pop out of this session early. fading fast and would like to get back to hotel16:08
*** irclogbot_1 has joined #openstack-infra16:09
*** mriedem has quit IRC16:10
*** mriedem has joined #openstack-infra16:12
*** jrist has joined #openstack-infra16:12
*** smarcet has joined #openstack-infra16:13
*** eernst has joined #openstack-infra16:13
frickler5 vs 8 is the key type/algorithm. and 8 doesn't seem to be defined in the rfc, so maybe that should actually be a 5 instead?16:14
*** yamamoto has joined #openstack-infra16:15
fricklerah, no, that is listed here, SHA-1 vs. SHA-256 https://www.iana.org/assignments/dns-sec-alg-numbers/dns-sec-alg-numbers.xhtml16:19
*** dave-mccowan has quit IRC16:20
*** ccamacho has joined #openstack-infra16:23
*** roman_g has quit IRC16:23
*** roman_g has joined #openstack-infra16:24
fungiyeah, just covered under a later rfc16:24
*** armax has joined #openstack-infra16:25
openstackgerritSorin Sbarnea proposed openstack-infra/elastic-recheck master: Preparatory fixes for py3  https://review.openstack.org/61657816:28
*** pcaruana has quit IRC16:29
*** eernst has quit IRC16:29
*** Emine has joined #openstack-infra16:30
*** smarcet has quit IRC16:32
*** e0ne has quit IRC16:33
*** ccamacho has quit IRC16:35
*** udesale has quit IRC16:36
*** dims has quit IRC16:37
*** yamamoto has quit IRC16:40
*** dims has joined #openstack-infra16:41
*** bobh has quit IRC16:41
*** Emine has quit IRC16:43
*** ramishra_ has quit IRC16:51
*** mriedem has quit IRC16:53
*** phausman has quit IRC16:57
*** psachin has quit IRC16:58
*** jtomasek has quit IRC17:04
*** jpich has quit IRC17:07
*** auristor has quit IRC17:08
*** agopi is now known as agopi|food17:10
*** pcaruana has joined #openstack-infra17:11
*** armstrong has quit IRC17:13
*** smarcet has joined #openstack-infra17:14
*** janki has quit IRC17:14
*** gyee has joined #openstack-infra17:14
*** yamamoto has joined #openstack-infra17:22
*** florianf is now known as florianf|afk17:24
*** yamamoto has quit IRC17:26
*** ifat_afek has quit IRC17:27
*** yamamoto has joined #openstack-infra17:27
*** panda|rover is now known as panda|rover|off17:47
*** smarcet has quit IRC17:48
*** kjackal has quit IRC17:52
*** kjackal has joined #openstack-infra17:53
*** anteaya has joined #openstack-infra17:57
*** agopi|food is now known as agopi18:00
*** derekh has quit IRC18:04
*** chandankumar has joined #openstack-infra18:07
*** psachin has joined #openstack-infra18:11
*** jpena is now known as jpena|off18:16
*** trown is now known as trown|lunch18:19
*** bobh has joined #openstack-infra18:23
*** psachin has quit IRC18:25
*** auristor has joined #openstack-infra18:26
*** ralonsoh has quit IRC18:38
*** roman_g has quit IRC18:42
*** jrist has quit IRC18:43
*** roman_g has joined #openstack-infra18:43
*** bobh has quit IRC18:50
*** bobh has joined #openstack-infra18:52
*** chandankumar has quit IRC18:53
*** jrist has joined #openstack-infra18:55
*** jtomasek has joined #openstack-infra18:58
*** anteaya has quit IRC19:12
*** electrofelix has quit IRC19:22
*** trown|lunch is now known as trown19:28
*** Emine has joined #openstack-infra19:28
*** Emine has quit IRC19:31
*** xek_ has joined #openstack-infra19:37
*** xek has quit IRC19:40
*** jtomasek has quit IRC19:42
*** jtomasek has joined #openstack-infra19:48
*** bobh has quit IRC19:51
*** pcaruana has quit IRC19:54
*** bobh has joined #openstack-infra19:55
*** apetrich has quit IRC19:57
*** apetrich has joined #openstack-infra20:10
*** yamamoto has quit IRC20:10
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul master: Add the process environment to zuul.conf parser  https://review.openstack.org/61282420:26
*** jtomasek has quit IRC20:33
*** yamamoto has joined #openstack-infra20:45
*** yamamoto has quit IRC20:50
*** agopi is now known as agopi|brb20:54
*** agopi|brb has quit IRC20:58
*** yamamoto has joined #openstack-infra21:18
*** yamamoto has quit IRC21:22
*** markmcd has quit IRC21:32
*** markmcd has joined #openstack-infra21:33
*** xek_ has quit IRC21:39
*** trown is now known as trown|outtypewww21:53
*** yamamoto has joined #openstack-infra21:54
*** yamamoto has quit IRC21:59
*** markvoelker has joined #openstack-infra22:10
*** e0ne has joined #openstack-infra22:35
*** e0ne has quit IRC22:36
*** rh-jelabarre has quit IRC22:40
*** dayou has quit IRC22:49
*** dayou has joined #openstack-infra22:50
*** boden has quit IRC22:58
*** e0ne has joined #openstack-infra23:02
*** dayou has quit IRC23:05
*** dayou has joined #openstack-infra23:06
*** dave-mccowan has joined #openstack-infra23:11
*** bobh has quit IRC23:16
*** yamamoto has joined #openstack-infra23:21
*** kjackal has quit IRC23:25
*** yamamoto has quit IRC23:26
*** e0ne has quit IRC23:35
*** dayou_ has joined #openstack-infra23:48
openstackgerritAdam Spiers proposed openstack-infra/irc-meetings master: Add meeting for the self-healing SIG  https://review.openstack.org/61806423:49
*** dayou has quit IRC23:51
*** yamamoto has joined #openstack-infra23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!