Wednesday, 2019-06-05

clarkbI suppose if it persists we can try a reboot? and if it continues further pull that mirror out of rotation (the old one still exists right?)00:00
fungitempting to restart the afsd (or just reboot) if none of this helps... still seems like more than coincidence this appears to have started about the time the proxy volume filled up (though i still can't imagine how, other than really terrible explanations we likely would rather not entertain)00:00
ianwold still exists, yep.  this was pretty much why i wanted to run a single server for a while :)00:00
clarkb23:57:28 is last occurence00:00
corvusif we reboot, we should remove the cache dir during the downtime00:01
clarkbnow in utc00:01
clarkbso fs flush may have done it (but not flush volume for reasons I don't understand)00:01
clarkbroots shell history has the commands. Gonna pop out now (sorry)00:02
*** rh-jelabarre has quit IRC00:02
clarkbthat last occurence is still the last occurence00:02
*** hamzy has joined #openstack-infra00:02
ianwok, will watch for a bit, i guess next is to stop, clear caches and reboot00:02
ianw*then* start with things like ppa builds of later openafs client versions :/00:03
*** rh-jelabarre has joined #openstack-infra00:03
*** slaweq has quit IRC00:03
fungiextra double :/ on that prospect00:03
*** rh-jelabarre has quit IRC00:05
*** weifan has quit IRC00:07
*** weifan has joined #openstack-infra00:07
*** michael-beaver has quit IRC00:08
ianwhas kibana always been showing the timestamp in local time?00:09
fungii couldn't tell you since for me there's no distinction00:10
*** weifan has quit IRC00:12
openstackgerritDavid Moreau Simard proposed openstack/project-config master: Update gerritbot channels for #ara  https://review.opendev.org/66317300:14
ianwfungi: you run your interactive session in UTC?  that's hardcore mode :)00:17
mordredianw: I believe he sets his meatspace clocks to UTC as well00:19
funginot sure what you mean by "interactive session" but i set my wall clocks to utc too, not just my computers00:19
fungieasier not to have to care about daylight savings time that way00:20
ianwok, super hardcore.  i mean i run all my servers etc in UTC, but when I log in, the clock up the top reflects local time :)00:20
fungiyears ago i learned to automatically do tz calculations if i need to know what local time is wherever i am (or wherever somebody else is as long as i know their tz)00:20
fungieasier with a utc reference clock00:21
fungijust requires a small shift in thinking00:21
fungiand also a compromise with the wife (she has her own clocks and only occasionally complains about mine)00:22
*** slaweq has joined #openstack-infra00:23
*** mriedem_away has quit IRC00:30
*** slaweq has quit IRC00:33
*** aaronsheffield has quit IRC00:33
*** yamamoto has quit IRC00:34
*** mattw4 has quit IRC00:44
*** diablo_rojo has quit IRC00:49
*** slaweq has joined #openstack-infra00:51
*** hwoarang has quit IRC00:51
*** hwoarang has joined #openstack-infra00:57
*** slaweq has quit IRC01:03
*** rkukura has quit IRC01:14
*** spsurya has joined #openstack-infra01:19
*** slaweq has joined #openstack-infra01:21
*** rlandy has quit IRC01:31
*** slaweq has quit IRC01:33
*** rfolco has quit IRC01:46
*** hongbin has joined #openstack-infra01:47
*** rfolco has joined #openstack-infra01:47
gmannclarkb: can you check my reply on this- https://review.opendev.org/#/c/647912/01:49
clarkbgmann I think you are correct. I've already forgptten how the v2 jobs worked01:53
gmannclarkb: thanks.01:54
*** slaweq has joined #openstack-infra01:54
fungii've gladly drank away soooo many of those brain cells01:55
*** apetrich has quit IRC01:57
*** hwoarang has quit IRC01:58
*** hwoarang has joined #openstack-infra02:00
*** happyhemant has quit IRC02:01
*** dave-mccowan has quit IRC02:02
*** lseki has quit IRC02:02
*** slaweq has quit IRC02:03
ianwhttp://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Mirror%20sync%20in%20progress%5C%2202:05
ianwi would say it's back.02:05
ianwi'll go to step two; stop apache, clear caches, reboot02:06
openstackgerritjacky06 proposed openstack/os-testr master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65506202:06
ianwok, that is done ... i'm seeing the last errors @ 2019-06-05T12:03:32.555+10:00 ... have to duck out for a bit, and will check back if we're still getting them in ~ hour02:10
fungiyou cleared the afs cache before the reboot then?02:10
ianwboth apache & afs02:10
fungithanks!02:11
fungicrossing fingers02:11
*** slaweq has joined #openstack-infra02:14
openstackgerritcaoyuan proposed openstack/os-testr master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65506202:18
*** yamamoto has joined #openstack-infra02:23
*** slaweq has quit IRC02:25
*** slaweq has joined #openstack-infra02:41
*** slaweq has quit IRC02:54
*** markvoelker has joined #openstack-infra02:59
*** xinranwang has joined #openstack-infra03:05
openstackgerritIan Wienand proposed opendev/system-config master: [wip] backups  https://review.opendev.org/66265703:08
ianwunfortunately i'm seeing errors at 2019-06-05T13:09:03.664+10:00 ... so a clearout and reboot doesn't seem to have worked03:11
*** rosmaita has quit IRC03:12
*** slaweq has joined #openstack-infra03:15
ianwhttps://gerrit.openafs.org/#/c/13443/ seems to be about the only thing i can find that discusses data corruption from cache in post 1.8.1 era03:24
*** rosmaita has joined #openstack-infra03:25
*** slaweq has quit IRC03:26
ianwthe errors stopped between 22019-06-05T12:06:19.638+10:00 -> 019-06-05T12:45:56.312+10:0003:29
*** markvoelker has quit IRC03:30
ianwi think we had an ansible run inbetween, but it's not a smoking gun for "this happened right after ansible ran"03:32
*** hwoarang has quit IRC03:34
*** hwoarang has joined #openstack-infra03:37
*** slaweq has joined #openstack-infra03:42
*** hongbin has quit IRC03:52
*** slaweq has quit IRC03:55
*** ricolin has joined #openstack-infra03:58
*** gyee has quit IRC04:02
*** slaweq has joined #openstack-infra04:12
*** eernst has joined #openstack-infra04:15
*** threestrands has joined #openstack-infra04:15
*** hwoarang has quit IRC04:21
*** bnemec has quit IRC04:23
*** gmann has quit IRC04:23
*** hwoarang has joined #openstack-infra04:24
*** slaweq has quit IRC04:25
*** bnemec has joined #openstack-infra04:25
*** markvoelker has joined #openstack-infra04:27
*** gmann has joined #openstack-infra04:27
*** kjackal has joined #openstack-infra04:28
*** pcaruana has joined #openstack-infra04:30
*** markvoelker has quit IRC05:00
*** tkajinam has quit IRC05:01
*** slaweq has joined #openstack-infra05:02
*** tkajinam has joined #openstack-infra05:03
*** eernst has quit IRC05:15
*** pkopec has joined #openstack-infra05:18
*** bdodd has quit IRC05:29
*** tkajinam has quit IRC05:33
*** kopecmartin|off is now known as kopecmartin05:34
*** bdodd has joined #openstack-infra05:40
*** ykarel|away has joined #openstack-infra05:40
*** ykarel|away has quit IRC05:45
*** jtomasek has joined #openstack-infra05:48
*** bdodd has quit IRC05:51
*** hwoarang has quit IRC05:54
*** markvoelker has joined #openstack-infra05:56
AJaegerpabelanger, clarkb, I removed nearly all usage of tools/tox_install.sh - using it broke constraints as well as tox-siblings support. Last remaining repos are dead, see https://review.opendev.org/#/q/status:open+++topic:tox-siblings for my open review. There's also blazar-nova, compute-hyperv and taskflow using it (in openstack namespace) but I did not taggle those - and won't be able to do in the05:57
AJaegernext weeks probably05:57
*** hwoarang has joined #openstack-infra05:58
AJaegerthere are a few more odd ones - and all check for existance of zuul-cloner06:02
* AJaeger might cover a few more...06:02
*** tkajinam has joined #openstack-infra06:03
*** dpawlik has joined #openstack-infra06:10
*** dpawlik has quit IRC06:15
*** dpawlik has joined #openstack-infra06:22
yoctozeptohello, infra team, openstack search does not work for me because search.openstack.org has an expired certificate (looks like letsencrypt bot failed to run for some time)06:23
yoctozeptosee https://search.openstack.org06:24
AJaegeryoctozepto: I don't know that site and suggest to use http://codesearch.openstack.org/ instead06:24
*** bdodd has joined #openstack-infra06:24
AJaegeryoctozepto: thanks for report, hope an infra-root can later look at it.06:24
yoctozeptoAJaeger: docs.openstack.org seem to use it06:25
yoctozeptoin background06:25
yoctozeptoto do the search06:25
AJaegeryoctozepto: interesting, might be a service by openstack foundation and not infra team? Let's see what others report later on06:26
yoctozeptoAJaeger: might be but I have no idea how to check this06:27
*** markvoelker has quit IRC06:28
*** dtantsur|afk is now known as dtantsur\06:29
*** dtantsur\ is now known as dtantsur06:29
*** e0ne has joined #openstack-infra06:31
AJaegeryoctozepto: sorry, was meant for rest of infra team06:32
AJaegeryoctozepto: those that might know are US based and read normally backscroll...06:32
*** takamatsu has joined #openstack-infra06:32
*** apetrich has joined #openstack-infra06:33
frickleryoctozepto: AJaeger: the server is running in vexxhost-sjc1 but doesn't appear in our list of servers, I also cannot log in, so very likely foundation06:38
fricklermnaser: I'm also seeing a rather high number of ERRORes nodes, mainly centos, too, maybe you want to take a look06:39
openstackgerritjacky06 proposed openstack/os-testr master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65506206:43
yoctozeptofrickler, AJaeger: thanks for your support, where should I report it then?06:43
openstackgerritjacky06 proposed openstack/os-testr master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65506206:43
frickleryoctozepto: they should be reading this channel, too, so just waiting for US working hours should be fine for now06:44
yoctozeptofrickler: ok, thanks for the explanation06:45
*** lpetrut has joined #openstack-infra06:58
*** rcernin has quit IRC06:59
*** factor has joined #openstack-infra07:03
*** pgaxatte has joined #openstack-infra07:03
*** sshnaidm|off is now known as sshnaidm07:06
*** hwoarang has quit IRC07:06
*** hwoarang has joined #openstack-infra07:07
*** ginopc has joined #openstack-infra07:14
*** rpittau|afk is now known as rpittau07:14
*** e0ne has quit IRC07:15
*** yolanda has joined #openstack-infra07:15
*** tesseract has joined #openstack-infra07:25
yoctozeptohmm, digging deeper it looks like search.openstack.org is not the only cause of current troubles with doc searching; I tricked the browser into trusting the domain and it only fixed the upper search widget07:29
*** woojay has quit IRC07:32
*** ginopc has quit IRC07:34
*** ginopc has joined #openstack-infra07:36
*** whoami-rajat has joined #openstack-infra07:45
*** weifan has joined #openstack-infra07:48
*** ralonsoh has joined #openstack-infra07:51
*** jpena|off is now known as jpena07:56
*** iurygregory has joined #openstack-infra08:00
ianwyeah, infra as such doesn't have anything to do with search.openstack.org AFAIK, and certainly it's not using our letsencrypt infrastructure to renew08:02
ianwbut as mentioned, the US people will have the right contacts with the openstack.org people to look into it08:02
evrardjpclarkb: thanks for that pointer. Indeed I can see the permission denied thing :D08:03
yoctozeptoianw: thanks for explaining it even further :-)08:03
yoctozeptofor completeness of discussion (most likely completely not-infra-related) here is the other problem with search: https://bugs.launchpad.net/openstack-manuals/+bug/183170708:05
openstackLaunchpad bug 1831707 in openstack-manuals "search in latest (master) docs fails (never ends)" [Undecided,New]08:05
*** gfidente has joined #openstack-infra08:07
*** sshnaidm is now known as sshnaidm|afk08:07
ianwclarkb/fungi: it seems the opendev.org afs errors have ... stopped.  I have started up -> https://etherpad.openstack.org/p/opendev-mirror-afs with some times, to see if we can correlate anything08:08
*** ramishra has joined #openstack-infra08:09
*** xek has joined #openstack-infra08:09
*** Lucas_Gray has joined #openstack-infra08:13
*** panda|ruck has quit IRC08:14
*** dchen has quit IRC08:14
*** lucasagomes has joined #openstack-infra08:15
*** derekh has joined #openstack-infra08:18
openstackgerritMerged openstack/project-config master: Update gerritbot channels for #ara  https://review.opendev.org/66317308:23
*** weifan has quit IRC08:25
*** markvoelker has joined #openstack-infra08:26
*** panda has joined #openstack-infra08:28
*** ginopc has quit IRC08:35
*** tkajinam has quit IRC08:37
*** happyhemant has joined #openstack-infra08:38
*** threestrands has quit IRC08:39
*** openstackgerrit has quit IRC08:47
*** panda is now known as panda|ruck08:52
evrardjpfungi: not sure if you want me to edit https://review.opendev.org/#/c/662870/2 . Also with the discussion of yesterday, do you think we should implement something like a date lookup? That sounds overkill to me08:56
*** kei-ichi has quit IRC08:57
evrardjppabelanger corvus if you could step in on https://review.opendev.org/#/c/662817/ to discuss the approach, that would be nice (alternative would be to implement a date lookup the jobs could use)08:57
*** rcernin has joined #openstack-infra08:57
*** markvoelker has quit IRC08:59
*** kmarc has quit IRC09:01
*** kmarc has joined #openstack-infra09:04
*** Emine has joined #openstack-infra09:21
roman_gHello team. I would like to thank you for updating Gitea to support Git Blame in GUI. That's really cool.09:22
*** priteau has joined #openstack-infra09:22
*** e0ne has joined #openstack-infra09:30
*** yamamoto has quit IRC09:50
*** markvoelker has joined #openstack-infra09:57
*** openstackgerrit has joined #openstack-infra10:03
openstackgerritTristan Cacqueray proposed zuul/zuul master: web: remove SafeLoader left-over from ZuulJSONEncoder  https://review.opendev.org/65902610:03
openstackgerritTristan Cacqueray proposed zuul/zuul master: config: add tenant.toDict() method and REST endpoint  https://review.opendev.org/62134410:05
*** verdurin has joined #openstack-infra10:08
*** lpetrut has quit IRC10:09
*** sreejithp has joined #openstack-infra10:20
*** lpetrut has joined #openstack-infra10:22
*** yamamoto has joined #openstack-infra10:24
*** sreejithp has quit IRC10:24
*** sshnaidm|afk is now known as sshnaidm10:25
*** dave-mccowan has joined #openstack-infra10:27
*** markvoelker has quit IRC10:29
*** yamamoto has quit IRC10:33
*** yamamoto has joined #openstack-infra10:34
*** yamamoto has quit IRC10:35
*** ricolin has quit IRC10:47
*** yamamoto has joined #openstack-infra10:48
openstackgerritTristan Cacqueray proposed zuul/zuul master: jsonutil: do not encode SourceContext or ZuulMark  https://review.opendev.org/66329810:50
*** yamamoto has quit IRC10:53
openstackgerritTristan Cacqueray proposed zuul/zuul master: config: add tenant.toDict() method and REST endpoint  https://review.opendev.org/62134410:55
*** yamamoto has joined #openstack-infra11:06
*** jpena is now known as jpena|lunch11:07
*** ociuhandu has joined #openstack-infra11:09
*** iokiwi has quit IRC11:12
*** adriant has quit IRC11:12
*** panda|ruck is now known as panda|ruck|eat11:19
asettleclarkb, AJaeger just recently brought to my attention that docs.o.o is still on a virtual server at Rackspace...11:20
asettlePotentially over thinking it but since Rackspace has more-or-less pulled out of OpenStack, should we be considering moving docs.o.o?11:21
*** pkopec has quit IRC11:23
*** Lucas_Gray has quit IRC11:24
*** markvoelker has joined #openstack-infra11:26
*** pkopec has joined #openstack-infra11:37
*** yamamoto has quit IRC11:44
*** yolanda has quit IRC11:48
*** xek has quit IRC11:49
*** xek has joined #openstack-infra11:50
*** markvoelker has quit IRC12:00
*** rfarr has joined #openstack-infra12:01
*** jpena|lunch is now known as jpena12:01
*** gmann has quit IRC12:03
*** ricolin has joined #openstack-infra12:03
*** ociuhandu_ has joined #openstack-infra12:06
*** rfarr_ has joined #openstack-infra12:06
*** ociuhandu has quit IRC12:06
*** yamamoto has joined #openstack-infra12:09
*** rfarr has quit IRC12:09
*** hwoarang has quit IRC12:09
*** hwoarang has joined #openstack-infra12:11
*** rlandy has joined #openstack-infra12:15
*** hjensas has quit IRC12:20
openstackgerritMark Meyer proposed zuul/zuul master: Create a basic Bitbucket build status reporter  https://review.opendev.org/65833512:22
openstackgerritMark Meyer proposed zuul/zuul master: Create a basic Bitbucket event source  https://review.opendev.org/65883512:22
openstackgerritMark Meyer proposed zuul/zuul master: Upgrade formatting of the patch series.  https://review.opendev.org/66068312:22
openstackgerritMark Meyer proposed zuul/zuul master: Extend event reporting  https://review.opendev.org/66213412:22
*** panda|ruck|eat is now known as panda|ruck12:30
*** adriant has joined #openstack-infra12:34
*** iokiwi has joined #openstack-infra12:34
*** rcernin has quit IRC12:37
*** priteau has quit IRC12:41
*** adriant has quit IRC12:43
*** iokiwi has quit IRC12:43
*** adriant has joined #openstack-infra12:46
*** iokiwi has joined #openstack-infra12:46
fungiyoctozepto: frickler: ianw: AJaeger: the place they normally expect issues to be raised is https://bugs.launchpad.net/openstack-org/+filebug but i've given them a heads up about it12:49
AJaegerthanks, fungi12:51
fungievrardjp: no motive in pointing you to 662870 other than just to say we're working on a way to generate good passwords on the executor so nobody will need to resort to using datestamps for passwords12:51
mnaserfrickler: that server us indeed manager directly by the osf, I will ping them.12:52
mnaser(cc yoctozepto AJaeger :))12:52
mnaserfrickler: regarding the other issues w/ boots in sjc1.. I'd be bet its cinder quota again12:53
mnasermaybe there is an actual issue here12:53
*** priteau has joined #openstack-infra12:54
evrardjpfungi: I see :)12:55
evrardjpfungi: I like it12:55
*** rh-jelabarre has joined #openstack-infra12:55
evrardjpI just wanted to help, as usual, but I don't know how you prefered this collaboration to be done :)12:55
evrardjp(therefore see comment on 662870)12:56
fungievrardjp: oh! thanks, i hadn't seen it yet. still waking up13:01
*** eharney has joined #openstack-infra13:06
openstackgerritMark Meyer proposed zuul/zuul master: Extend event reporting  https://review.opendev.org/66213413:08
*** mriedem has joined #openstack-infra13:10
*** apetrich has quit IRC13:10
fungiyoctozepto: frickler: ianw: AJaeger: the search.o.o cert has been manually updated and smarcet is looking into what caused it not to auto-renew13:12
fungimnaser: ^13:12
*** Goneri has joined #openstack-infra13:14
*** apetrich has joined #openstack-infra13:23
*** _erlon_ has joined #openstack-infra13:27
*** yamamoto has quit IRC13:28
*** jcoufal has joined #openstack-infra13:31
*** tdasilva has joined #openstack-infra13:31
*** iurygregory has quit IRC13:32
*** egonzalez has left #openstack-infra13:35
fungievrardjp: 663119 isn't going to pass until the dependency merges and gets deployed. that's the reason it's failing currently13:36
evrardjpfungi: but doesn't the 2.7/2.8 folders need to be pointing to the base?13:36
fungitheir contents already are13:37
evrardjpoh got it13:37
evrardjpmy bad13:37
*** iurygregory has joined #openstack-infra13:37
evrardjpfungi: what's the reason you're holding 662870? Want to wait for a conversation?13:38
openstackgerritFabien Boucher proposed zuul/zuul master: URLTrigger driver time based - artifact change jobs triggering driver  https://review.opendev.org/63556713:39
*** lseki has joined #openstack-infra13:40
*** rcernin has joined #openstack-infra13:41
*** eharney has quit IRC13:41
mnaserthanks for the update fungi :)13:42
openstackgerritFabien Boucher proposed zuul/zuul master: URLTrigger driver time based  https://review.opendev.org/63556713:43
*** bobh has joined #openstack-infra13:47
*** jamesmcarthur has joined #openstack-infra13:48
*** bobh has quit IRC13:50
*** michael-beaver has joined #openstack-infra13:52
*** spsurya has quit IRC13:55
*** eharney has joined #openstack-infra13:57
*** eharney has quit IRC14:02
fungievrardjp: see earlier wip comment on 662870, i want to make sure i add tests in zuul's testsuite to exercise it *and* attempt actions it should forbid so that this doesn't slip later and open up a security hole14:07
fungievrardjp: unfortunately i fear the lack of testing for the other allowed plugins may already have done so14:08
*** jamesmcarthur has quit IRC14:09
*** dpawlik has quit IRC14:10
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Don't use allowed-projects  https://review.opendev.org/66333914:12
*** nwilburn has joined #openstack-infra14:13
*** jaosorior has joined #openstack-infra14:15
*** eharney has joined #openstack-infra14:15
*** Lucas_Gray has joined #openstack-infra14:18
*** jamesmcarthur has joined #openstack-infra14:18
fungicorvus: i wonder if this will eventually allow mailing lists and forwarders to work around spf/dkim/dmarc pains: https://datatracker.ietf.org/doc/draft-ietf-dmarc-arc-protocol/14:22
*** jamesmcarthur has quit IRC14:22
fungilooks like it's getting some traction14:23
*** bnemec has quit IRC14:23
*** bnemec has joined #openstack-infra14:25
*** jamesmcarthur has joined #openstack-infra14:26
fungithe way i read that, an ml implementation could affirm the message it received authenticated correctly, and then indicate the changes it needed to make to the message in the process of forwarding and provide attestation of them for the next mta in the chain to authenticate14:26
*** yamamoto has joined #openstack-infra14:27
*** lpetrut has quit IRC14:28
corvusfungi: 7.1.3 certainly seems to suggest so -- but what i don't grok yet is how/why someone like yahoo would choose to trust the arc header set by lists.o.o asserting that the message as originally received from gmail was legit14:29
openstackgerritMark Meyer proposed zuul/zuul master: Extend event reporting  https://review.opendev.org/66213414:30
*** aaronsheffield has joined #openstack-infra14:32
*** yamamoto has quit IRC14:32
fungicorvus: i think if it's got the differences encoded then the receiver can actually confirm it?14:32
fungistill trying to determine whether it does14:33
corvusfungi: but how does that differ from a malicious site which completely replaces the content with spam and then signs it...?14:33
*** eharney has quit IRC14:35
mordredyeah - it would seem for that to work the MTA would need to include the entire original message with the original signature as well as the declaration of the diff - so that the receiving MTA could verify the message sent by the MTA, then see it had an attached diff declaration and original message and then verify that the original message validates14:35
fungii wonder if dmarc rules can specify allowances for append/prepend alterations14:35
mordredlike if the original message was included as an attachement completely unaltered. of course, that would suck from a duplication perspective14:36
fungibut also if modifying the message-id is disallowed, then that requires a fresh original for each replay14:36
fungimaybe not so high a bar14:36
mordredmaybe it if JUST included a diff declaration in the new message in such a way that the validating receiver could reverse the diff and then validate the original14:37
*** iurygregory_ has joined #openstack-infra14:37
fungii do suspect body and subject alterations are likely exploitable enough that a typical dmarc policy would disallow those... then again we've seen most problems resulting from ultra-strict dmarc policies forbidding alteration of indentation in metadata headers14:38
*** iurygregory has quit IRC14:38
fungiso my hopes are not high that any new protocol would convince those vendors/operators to relax their policies if they haven't with dkim as it stands14:39
corvusyeah, though i guess the difference here is that the policy decision is on the receiving side?14:40
*** eharney has joined #openstack-infra14:48
*** iurygregory has joined #openstack-infra14:49
*** iurygregory_ has quit IRC14:50
*** lpetrut has joined #openstack-infra14:52
corvusfungi, mordred: this seems to suggest that indeed may be a problem, and that the ultimate value of this is not that it solves the problem for all ML providers, but rather, it either allows big mail hosts to trust other big mail hosts to do mailing lists, or that it allows mail hosts to apply reputational scoring rules to ML hosts: http://lists.dmarc.org/pipermail/arc-discuss/2018-August/000395.html14:53
*** eharney has quit IRC14:54
*** lpetrut has quit IRC14:54
*** lpetrut has joined #openstack-infra14:55
*** factor has quit IRC14:55
*** icarusfactor has joined #openstack-infra14:55
fungicorvus: well, yes, i was hoping it might help as a side effect, but ultimately you have to look at who's on the dmarc wg and make some assumptions about the goals of their employers14:56
*** sreejithp has joined #openstack-infra14:57
fungithey're never going to go to this degree of effort for altruistic reasons like helping the experience of small mailing list and forwarder operators14:57
corvushttp://lists.dmarc.org/pipermail/arc-discuss/2018-August/000402.html14:58
corvushttp://lists.dmarc.org/pipermail/arc-discuss/2018-August/000401.html14:58
corvusthose are good msgs too14:58
corvus"Our plan is to learn reputation for all senders, but I imagine it will have some minimum bar for effectiveness."14:58
fungiit's going to be about solidifying the hegemony. maybe time to revisit the usenet/nntp idea14:58
corvusthat does give hope that a site of our size would be able to gain sufficient reputation to be useful14:59
corvusfungi: combined nntp+web forum system?15:00
*** woojay has joined #openstack-infra15:01
corvushttps://forum.dlang.org/15:02
fungicombined nntp+mm3 would get web forums for free15:02
fungithough it would be a web view of the ml side of things i guess, not the newsgroup side15:02
corvuswe're not running any software written in D yet... seems like an oversight ;)  https://github.com/CyberShadow/DFeed15:05
*** lennyb has quit IRC15:07
*** lennyb has joined #openstack-infra15:07
*** eharney has joined #openstack-infra15:07
openstackgerritJan Kundrát proposed zuul/zuul-jobs master: upload-logs-swift: option for disabling the indexer  https://review.opendev.org/66335515:09
openstackgerritMerged zuul/zuul master: web: remove SafeLoader left-over from ZuulJSONEncoder  https://review.opendev.org/65902615:11
*** diablo_rojo has joined #openstack-infra15:16
*** panda|ruck is now known as panda15:19
*** rlandy is now known as rlandy|ruck15:19
*** derekh has quit IRC15:23
*** derekh has joined #openstack-infra15:23
*** Goneri has quit IRC15:24
*** derekh has quit IRC15:25
*** rcernin has quit IRC15:26
*** liuyulong has quit IRC15:26
*** yolanda has joined #openstack-infra15:26
*** derekh has joined #openstack-infra15:26
*** gyee has joined #openstack-infra15:27
*** jaosorior has quit IRC15:27
fungianyway, i discovered the arc draft in reading a thread on the debian-devel ml, best summarized in this short reply: https://lists.debian.org/debian-devel/2019/06/msg00089.html15:27
lpetrutHi. We'd like to retire the https://github.com/openstack/cloudbase-init repo and have the readme point to this repo instead: https://github.com/cloudbase/cloudbase-init15:28
lpetrutWe'll add zuul jobs to mirror https://opendev.org/x/cloudbase-init to the github repo.15:28
*** derekh has quit IRC15:29
*** derekh has joined #openstack-infra15:29
lpetrutThe idea is that cloudbase-init is an unofficial openstack project, used by most if not all Windows guests running on Openstack. Using the opendev project, it's easy for openstack contributors to send cloudbase-init patches so we'd like to keep that. We can't keep the github.com/openstack/cloudbase-init mirror though since it's not an official openstack project.15:30
*** derekh has quit IRC15:31
*** derekh has joined #openstack-infra15:31
openstackgerritMerged zuul/zuul-jobs master: Don't use allowed-projects  https://review.opendev.org/66333915:34
*** derekh has quit IRC15:34
*** derekh has joined #openstack-infra15:34
*** pgaxatte has quit IRC15:46
openstackgerritMonty Taylor proposed zuul/nodepool master: Explicitly set use_direct_get to False  https://review.opendev.org/66336815:48
yoctozeptofungi, mnaser: thanks for handling the issue with the cert15:51
*** ramishra has quit IRC15:52
*** kopecmartin is now known as kopecmartin|off15:53
*** Qiming has quit IRC15:54
openstackgerritPaul Belanger proposed zuul/nodepool master: Clean up utils.nodescan function  https://review.opendev.org/66337215:55
*** Lucas_Gray has quit IRC15:55
*** _erlon_ has quit IRC15:57
*** Qiming has joined #openstack-infra15:58
*** iurygregory_ has joined #openstack-infra16:00
*** dtantsur is now known as dtantsur|afk16:01
*** iurygregory has quit IRC16:02
*** panda is now known as panda|off16:02
mordredlpetrut: we can rename https://github.com/openstack/cloudbase-init to https://github.com/cloudbase/cloudbase-init16:03
mordredin github - so that redirects work16:03
*** markvoelker has joined #openstack-infra16:04
mordredand then you do the step you said about adding the github replication jobs16:04
lpetrutmordred: that's great, thanks!16:04
mordredyou'll need to delete the copy you've got there currently first - let me get logged in and then we can coordinate - you have admin on the github.com/cloudbase org?16:05
*** iurygregory_ is now known as iurygregory16:06
lpetrutyep, we have admin rights on this repo. not sure why we have to delete it first though.16:07
mordredbecause I'm going to do a repo transfer in github, which means it's goig to move the one from openstack - and the one that's already there is in the way16:07
*** lucasagomes has quit IRC16:07
mordredif you delete the one taht's there, then I do the transfer, you accept it, then you can push current state and it'll be back like you had it - but users coming to the openstack one will get redirected and all will be happy16:08
*** rpittau is now known as rpittau|afk16:08
clarkbyou can also rename the other one or not do the transfer and give up on redirects16:08
clarkb(the transfer is ideal for the redirects though)16:09
lpetrutmakes sense now. I'll sync with someone from my team that has the required access rights16:09
mordredhrm. you're using gh issues there16:10
*** Goneri has joined #openstack-infra16:10
lpetrutit's a weird situation, at some point the project got moved to github.com/openstack and now it's moving back16:11
lpetrutnot sure if we can move the github issues16:11
*** aakarsh has quit IRC16:11
mordredah - I'm guessing those issues are from before you moved it to openstack16:11
mordredyeah - the comments in those indicate they're not being used16:12
mordredso I think the cleanest thing to get you into a good state would be to delete that one, then we can do the transfer16:12
*** mattw4 has joined #openstack-infra16:13
*** rkukura has joined #openstack-infra16:14
*** ginopc has joined #openstack-infra16:15
lpetrutsounds good to me16:15
*** ginopc has quit IRC16:16
lpetrutit's 7 pm local time, I'll probably have someone delete the repo tomorrow morning and then we can pick it up from there. thank you for your help!16:17
*** ekultails has joined #openstack-infra16:18
*** lpetrut has quit IRC16:28
*** Emine has quit IRC16:30
*** panda|off has quit IRC16:33
*** panda has joined #openstack-infra16:35
openstackgerritPaul Belanger proposed zuul/nodepool master: Toggle host-key-checking for openstack provider.labels  https://review.opendev.org/66337816:35
fungi#status log deleted old 2012.2 release from https://pypi.org/project/horizon/16:36
openstackstatusfungi: finished logging16:36
fungiopenstackstatus is feeling a bit sluggish today... perhaps it needs some coffee16:36
*** xek has quit IRC16:37
*** panda has quit IRC16:39
*** bnemec has quit IRC16:44
*** aakarsh has joined #openstack-infra16:45
*** otherwiseguy_ has quit IRC16:46
*** haleyb has quit IRC16:46
*** mhu has quit IRC16:46
*** mhu has joined #openstack-infra16:46
*** otherwiseguy has joined #openstack-infra16:46
*** panda has joined #openstack-infra16:48
zbrare we running low on tox nodes? asking because I had a change where I disabled all fat jobs and kept only the tox ones, which is still waiting in the queue for more than 1:30h. i guess it does not matter what kind of jobs is triggers.16:50
pabelangerzbr: you can usually check http://grafana.openstack.org/dashboard/db/nodepool for the health of nodepool, looking at Error Node Launch Attempts, looks like a provider might be having issues16:51
pabelangervexxhost looks choppy: http://grafana.openstack.org/dashboard/db/nodepool-vexxhost16:52
pabelangerwonder if we leaked volumes again16:52
pabelangerand ovh, also looks choppy16:52
pabelangerhttp://grafana.openstack.org/dashboard/db/nodepool-ovh16:52
openstackgerritMerged zuul/zuul-website master: Revert "Revert promotional message banner and event list"  https://review.opendev.org/66023216:53
pabelangerzbr: by looking into those, it should at least explain what is happening16:53
fungialternatively look at http://grafana.openstack.org/dashboard/db/zuul-status and note in particular the node requests and test nodes graphs16:53
zbrpabelanger: our dashboard reports 3h queue :p16:53
pabelangerinap seems to be disabled16:53
fungiwe're backlogged ~1.2k node requests currently, and basically maxed out on capacity16:53
*** e0ne has quit IRC16:53
mgagnepabelanger: still is. Super sorry for that. There is a lot going on with that region atm and we can't enable it for now.16:54
pabelangermgagne: ah, thanks! Haven't really been following along there.16:54
pabelangerI have a few minutes to look at vexxhost16:54
mgagnepabelanger: didn't post news either since region was disabled.16:54
fungiif yuo adjust that zuul status dashboard you'll see we most recently reached capacity on nodes around 08:15 utc and the node request backlog has been growing ever since16:55
fungiwhen the node requests graph starts trending downward then we're gaining ground, and once it hits 0 we'll start to recover capacity16:55
fungibut basically while the node requests graph continues to rise, so will queue wait times16:56
pabelangerefd7f33a-ed36-4912-8791-54f8b6fa47f4 | clarkb-test-boot-volume | available |   8016:56
pabelangerclarkb: can that be deleted?^ that is in vexxhost-sjc116:56
*** derekh has quit IRC17:00
*** eernst has joined #openstack-infra17:02
*** xek has joined #openstack-infra17:05
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Return javascript content artifact records to Zuul  https://review.opendev.org/66305617:07
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Return python artifact records to Zuul  https://review.opendev.org/66305317:07
*** xek has quit IRC17:08
*** xek has joined #openstack-infra17:09
*** HenryG has quit IRC17:10
*** HenryG has joined #openstack-infra17:11
*** jpena is now known as jpena|off17:13
openstackgerritJeremy Stanley proposed zuul/zuul master: Safely add Ansible password lookup plugin  https://review.opendev.org/66287017:16
fungievrardjp: ^ what that new patchset adds is why i still had it marked wip17:17
*** happyhemant has quit IRC17:22
*** weifan has joined #openstack-infra17:23
*** ralonsoh has quit IRC17:28
*** ociuhandu has joined #openstack-infra17:33
evrardjpmmm gerrit is doing a weird thing to me there. the 33 lines of the password lookup don't appear.17:34
evrardjpI think it's time for me to stop working and start fresh tomorrow17:34
*** ociuhandu_ has quit IRC17:36
*** haleyb has joined #openstack-infra17:37
*** ociuhandu has quit IRC17:39
clarkbpabelanger: yes17:41
clarkbpabelanger: but check if there is a vm running on it tirst (and delete that too)17:41
fungievrardjp: oh, indeed, that's bizarre. i expect gerrit doesn't do a good job of handling a change which replaces a symlink with a normal file17:43
fungievrardjp: gertty does at least display it, though as two different diffs (one for zuul/ansible/base/lookup/password.py to empty for the symlink replacement, and one for empty to zuul/ansible/base/lookup/password.py for the file content)17:44
AJaegerconfig-core,infra-root, FYI, I'll go this weekend on a two week vacation and need to prepare the next days a bit for that. I'll be completely off the grid for those two weeks.17:45
clarkbAJaeger: enjoy the time off!17:46
corvusAJaeger: request denied!  (j/k :)17:46
AJaegercorvus: Lol. Glad that you're not my manager ;)17:46
fungihave a great holiday!17:46
*** zul has quit IRC17:47
AJaegerthanks! I might do a few reviews and might show up here the next two days - but not much...17:47
corvusAJaeger: i'll try to address them promptly to help clear your plate17:48
*** yamamoto has joined #openstack-infra17:48
AJaegerthanks17:53
*** yamamoto has quit IRC17:53
*** xek has quit IRC17:54
*** jcoufal has quit IRC17:55
*** rkukura has quit IRC17:56
*** tesseract has quit IRC17:57
*** weifan has quit IRC18:06
*** weifan has joined #openstack-infra18:06
openstackgerritMerged opendev/storyboard master: Project Group UI should permit removing project group even if it is not empty.  https://review.opendev.org/64226618:09
openstackgerritJames E. Blair proposed opendev/base-jobs master: Add jobs to publish artifacts to tarballs.opendev.org  https://review.opendev.org/66287718:15
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Return javascript content artifact records to Zuul  https://review.opendev.org/66305618:17
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Return python artifact records to Zuul  https://review.opendev.org/66305318:17
openstackgerritJames E. Blair proposed zuul/zuul master: DNM: test zuul-jobs artifact changes  https://review.opendev.org/66308118:17
*** e0ne has joined #openstack-infra18:20
*** zul has joined #openstack-infra18:23
rpiosohogepodge: https://review.opendev.org/#/c/660534/ merged \o/; however, the drivers it adds don't appear in the OpenStack Marketplace -- https://www.openstack.org/marketplace/drivers/18:23
openstackgerritAnkita Bansal proposed opendev/storyboard-webclient master: Project Group UI should permit removing project group even if it is not empty. Story: 2000164 Task: 2274  https://review.opendev.org/64226518:25
*** pabelanger has quit IRC18:26
*** weshay has quit IRC18:26
*** mhu has quit IRC18:26
*** mhu has joined #openstack-infra18:27
*** weshay has joined #openstack-infra18:27
fungirpioso: i don't think the marketplace is updated instantaneously. there's probably a periodic import which happens to update the content there but jamesmcarthur can probably tell you18:29
*** weifan has quit IRC18:29
jamesmcarthurrpioso: hi - which updates are you looking for?18:32
rpiosofungi: Thank you!18:32
rpiosojamesmcarthur: Ironic ipmi and redfish drivers, which were added by https://review.opendev.org/#/c/660534/18:33
jamesmcarthurOk - yeah... That data is currently maintained by Mirantis and ingested by us. There have been some problems since they made some recent updates18:34
openstackgerritMerged opendev/storyboard master: Add a 'security' flag to Teams  https://review.opendev.org/64082318:34
jamesmcarthurBut I believe the issue is being worked on.18:34
jamesmcarthurrpioso: we ingest from this page: https://www.stackalytics.com/driverlog/api/1.0/drivers18:35
jamesmcarthurSo first thing would be to confirm that your data is there.18:35
*** sshnaidm is now known as sshnaidm|afk18:36
*** dulek has quit IRC18:37
jamesmcarthurrpioso: If so, it should ingest overnight.  If NOT, I'm happy to update the data by hand for you if you want to email me the update (jimmy@openstack.org)18:38
*** kaiokmo has quit IRC18:39
rpiosojamesmcarthur: The data isn't presently there.18:39
*** weifan has joined #openstack-infra18:40
*** weifan has quit IRC18:40
jamesmcarthurCan you send me the review for the update? I'm happy to send them a note to see what's going on.18:40
*** weifan has joined #openstack-infra18:40
*** ricolin has quit IRC18:41
*** tdasilva has quit IRC18:41
rpiosojamesmcarthur: https://review.opendev.org/#/c/660534/18:41
jamesmcarthurrpioso: it might just be a delay on their side as well.18:41
rpiosojamesmcarthur: How about if patiently wait until tomorrow to see if the additions flow through to the Marketplace?18:42
rpioso*if we18:42
*** jcoufal has joined #openstack-infra18:42
* rpioso wasn't familiar with the flow18:43
jamesmcarthurrpioso: don't worry - i just went ahead and added it: https://www.openstack.org/marketplace/drivers#vendor=openstack%20community&project=ironic18:44
rpiosojamesmcarthur: Thank you for explaining the moving parts and offering to assist.18:45
jamesmcarthurWe are meant to stop pulling from that API, but haven't had the budget to revamp the drivers page to reflect this.18:45
*** weifan has quit IRC18:45
jamesmcarthurrpioso: happy to help!18:45
*** dulek has joined #openstack-infra18:45
rpiosojamesmcarthur: Yeah, I believe fungi recently mentioned a different approach to me.18:47
jamesmcarthurIt's on my short-long list.18:47
rpiosojamesmcarthur: Understood :-)18:53
openstackgerritMerged opendev/storyboard master: Add a table mapping Teams to Projects  https://review.opendev.org/64171818:55
*** jcoufal has quit IRC18:57
rpiosojamesmcarthur: Here's the link to the beginning of fungi and my discussion about the new approach --http://eavesdrop.openstack.org/irclogs/%23openstack-ironic/%23openstack-ironic.2019-05-24.log.html#t2019-05-24T15:02:5119:00
rpiosojamesmcarthur: And fungi followed up starting at http://eavesdrop.openstack.org/irclogs/%23openstack-ironic/%23openstack-ironic.2019-05-24.log.html#t2019-05-24T16:41:2419:00
rpiosojamesmcarthur: Is that the thing that's on your list?19:01
fungirpioso: yep, i had some more discussions with people over the past week to come up to speed on what had been implemented previously and get a feel for how broader implementation might work out as a pop-up team and/or cycle goal19:01
rpiosofungi: Cool19:01
*** ociuhandu has joined #openstack-infra19:02
rpiosofungi: And what's your sense?19:02
fungirpioso: it looks like cmurphy was working on it recently and got an implementation merged into keystone a few weeks back https://review.opendev.org/52780819:03
fungiprobably the next step is to start an ml discussion and get input from the people who have worked on or are interested in helping with the effort19:04
fungii just need to write up a summary to start it off19:04
jamesmcarthurfungi: this all seems pretty doable. I know that the project was started a while back, but then kind of fell off the radar.19:06
rpiosofungi: That would be great.19:06
*** priteau has quit IRC19:06
jamesmcarthurWe have some bandwidth in the next month or so if we could get a source for the data.19:06
fungiit's apparently been continuing to get some traction, but could stand a bit of a spotlight to reach resolution19:06
jamesmcarthurfungi: my feeling would be an MVP to replace Mirantis' API19:07
jamesmcarthurfungi: then build on it from there19:07
fungiyes, i think we basically need to get it implemented in the projects currently listed in the drivers section of the marketplace at a minimum19:07
*** priteau has joined #openstack-infra19:07
fungiwhich was a reasonably small number if memory serves19:08
fungicinder, designate, ironic, manila, neutron, nova, sahara19:08
fungiobviously any other projects who want to jump on the bandwagon are welcome too19:08
*** rkukura has joined #openstack-infra19:09
*** ociuhandu has quit IRC19:09
*** Vadmacs has joined #openstack-infra19:11
rpiosojamesmcarthur: I just pulled up the Marketplace link for viewing the newly added Ironic ipmi and redfish drivers in the Marketplace.19:12
*** weifan has joined #openstack-infra19:13
rpiosojamesmcarthur: redfish appears, but the new ipmi and other Ironic drivers don't. I see there are two Ironic-ish projects, "Ironic" and "Ironic (Bare Metal Provisioning)".19:14
jamesmcarthurrpioso: - I just saw that Ironic issue. About to fix.19:15
rpiosojamesmcarthur: Thanks, again!19:15
jamesmcarthurLet me double check on the other drivers19:15
* rpioso believes there's a number of Ironic drivers which haven't been appearing prior to his change, but doesn't understand why they haven't19:17
rpiosojamesmcarthur: Perhaps it's intended that those Ironic drivers not appear.19:18
*** panda has quit IRC19:19
*** pabelanger has joined #openstack-infra19:19
*** panda has joined #openstack-infra19:20
jamesmcarthurrpioso: It's quite possible that some are missing.  If you know of some others, let me know and I'll get them added.19:20
jamesmcarthurMeantime: https://www.openstack.org/marketplace/drivers/#project=ironic%20(bare%20metal%20provisioning)19:21
jamesmcarthurI've got ipmi and redfish updated here.19:21
jamesmcarthurAlso added the missing release data for redfish.19:21
jamesmcarthurrpioso: looks like at least this one is missing as well: pxe_ipmitool19:23
*** lpetrut has joined #openstack-infra19:23
jamesmcarthurrpioso: I'm not sure if those were intentionally left off or not.  All the more reason to manage this on our own IMO.19:23
*** dabukalam has quit IRC19:23
jamesmcarthurfungi: could we just switch from the current Mirantis source to https://opendev.org/x/driverlog/src/branch/master/etc/default_data.json19:27
*** lpetrut has quit IRC19:27
fungijamesmcarthur: i don't see why not. that's closer to the origin of the data anyway19:27
rpiosojamesmcarthur: For now, let's not continue to pull on the missing Ironic driver entries thread.19:28
fungivery well may be that there are two delays, and the first is that the stackalytics service doesn't import the driverlog repo instantly either19:28
jamesmcarthurok, if that's a reasonable place to start, we could call that the MVP19:28
jamesmcarthurand then tweak from there19:28
jamesmcarthurat least we would eliminate one potential source of failure19:28
fungijamesmcarthur: oh, well the mvp i was thinking of was for the plan to consume driver matrix structured data files from each service project repository19:29
rpiosojamesmcarthur: I took a cursory look at the Ironic driver entries that are listed, and clicked through a bunch of the links. Looks more better :-)19:29
fungithe x/driverlog repository still (for most of us anyway) has the same problem as the stackalytics service itself, that it's a team at mirantis acting as gatekeepers of official project info19:30
jamesmcarthurfungi: got it. Still, it seems driverlog is more up to date than the stackalytics.19:30
fungiyep, for sure19:31
jamesmcarthurfungi: So maybe call this a hot fix and then wait for specs for the MFP w/ the files from each project repo19:31
fungiyeah, the effort i was referring to was consuming files like https://opendev.org/openstack/keystone/src/branch/master/doc/source/admin/identity-support-matrix.ini to build the lists of driver info19:32
jamesmcarthurright - i forgot about the matrix :)19:33
fungieach project adds one or more files like that and the marketplace consumes those. it puts the responsibility on the individual service maintainers to manage their driver information19:33
jamesmcarthurthanks for the info fungi: and rpioso: - let's keep in touch on this. As I said, it's been on my list for some time. Would love to get this fixed for the community.19:33
fungithanks yourself!19:33
rpiosofungi, jamesmcarthur: And thank you!19:38
*** weifan has quit IRC19:41
openstackgerritDavid Shrewsbury proposed zuul/zuul master: WIP: Add caching of autohold requests  https://review.opendev.org/66341219:42
*** Emine has joined #openstack-infra19:45
openstackgerritTobias Henkel proposed zuul/zuul master: Add spec for enhanced regional executor distribution  https://review.opendev.org/66341319:46
*** slaweq has quit IRC19:47
*** slaweq has joined #openstack-infra19:48
*** weifan has joined #openstack-infra19:49
*** imacdonn has quit IRC19:53
*** imacdonn has joined #openstack-infra19:53
*** jamesmcarthur has quit IRC19:59
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Return javascript content artifact records to Zuul  https://review.opendev.org/66305620:06
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: Return python artifact records to Zuul  https://review.opendev.org/66305320:06
openstackgerritJames E. Blair proposed opendev/base-jobs master: Add jobs to publish artifacts to tarballs.opendev.org  https://review.opendev.org/66287720:07
*** weifan has quit IRC20:08
*** weifan has joined #openstack-infra20:10
*** Vadmacs has quit IRC20:16
*** Goneri has quit IRC20:30
openstackgerritJames E. Blair proposed opendev/zone-opendev.org master: Update .gitreview after project rename  https://review.opendev.org/66342320:39
openstackgerritJames E. Blair proposed opendev/zone-opendev.org master: Add tarballs.opendev.org cname  https://review.opendev.org/66342420:39
corvusfungi, clarkb, mordred: apparently we need an ssl cert if we're going to use files.openstack.org to serve tarballs, and that hasn't been ported to le yet20:40
clarkbyou should be able to le just the opendev.org name(s)20:41
clarkbwe'll restart the whole apache server when they update but that isnt ahuge issue I dont think20:41
corvushrm, okay, i'll look into that20:41
openstackgerritJames E. Blair proposed opendev/zone-opendev.org master: Add tarballs.opendev.org cname  https://review.opendev.org/66342420:43
*** Goneri has joined #openstack-infra20:44
*** dave-mccowan has quit IRC20:44
corvusdo we have a docs page on LE yet?20:47
*** eernst has quit IRC20:52
clarkbI dont think so. graphite.opendev.org serves as an example as does mirror.dfw.rax.opendev.org20:53
corvusthere's a *lot* to grep for20:53
clarkbiirc you set an ansible var and add a handler to the roles handler file to do whatever is necessary on cert refresh20:55
clarkbansible var has cert name details20:55
corvusyeah, i got that20:55
corvusit's more like... is that an exhaustive list of things i need to do20:55
clarkband add it to the le ansible group20:56
openstackgerritJames E. Blair proposed opendev/system-config master: Get an LE cert for tarballs.opendev.org  https://review.opendev.org/66342820:57
corvusclarkb: is that everything ^?20:57
*** nwilburn has quit IRC20:57
*** jtomasek has quit IRC20:57
clarkbI think that with the earlier dns update should do it20:58
*** pcaruana has quit IRC20:59
*** tdasilva has joined #openstack-infra20:59
*** Emine has quit IRC21:00
*** pkopec has quit IRC21:02
*** eernst has joined #openstack-infra21:02
fungiianw may have suggestions if he's around21:05
openstackgerritMerged opendev/storyboard master: Add an endpoint for getting Projects related to a Team  https://review.opendev.org/64171921:07
openstackgerritMerged opendev/storyboard master: Use version 2 in docker-compose.yml  https://review.opendev.org/65642621:07
openstackgerritMerged opendev/storyboard master: Allow Teams to be filtered by project_id  https://review.opendev.org/64172021:07
openstackgerritMerged opendev/storyboard master: Add a security flag to Stories  https://review.opendev.org/64205621:07
openstackgerritMerged opendev/storyboard master: Add RESTful endpoints for Story permissions  https://review.opendev.org/64205721:07
clarkboh the apache vhost will also need to look for the files acme.sh writes out21:08
openstackgerritJames E. Blair proposed opendev/system-config master: Add tarballs.opendev.org vhost  https://review.opendev.org/66343121:10
corvusclarkb: yeah that wasn't easy21:10
*** priteau has quit IRC21:10
corvusclarkb, fungi, mordred: topic:opendev-tarballs should have everything that's required now21:11
*** rh-jelabarre has quit IRC21:12
*** dmsimard has quit IRC21:16
*** dmsimard8 has joined #openstack-infra21:16
*** dmsimard8 is now known as dmsimard21:16
*** tjgresha has quit IRC21:18
*** rcernin has joined #openstack-infra21:26
weifanfungi: do you know how is the github repo transfer process going? I remember you saying that some script modification would be done for transferring repo under x/, so it would just need to send an email, instead of requiring admin permission. Our github admin has not received any email so far.21:31
weifanThe github repo is: https://github.com/openstack/networking-bigswitch and it should be transferred to bigswitch (organization)21:31
mordredweifan: sorry - I was going to write that script and haven't gotten to it yet (a few other things ahead of it in the queue) - I can do that one manually for now21:36
weifanmordred: that's fine. thanks:)21:36
clarkbwhat is wrong with dmsimard's script?21:37
fungimordred: would https://opendev.org/opendev/system-config/src/branch/master/tools/github-org-transfer.py work as-is?21:37
mordredclarkb: I was going to update it to use the new REST API21:37
fungiahh, cool21:37
mordredwhich we were thinking obviated the need to have admin in teh destination org21:37
mordredhowever - I'm not 100% sure why we thought that - I just tried doing it manually and it still requires admin in the destination21:38
weifanthat's weird.. thought we saw some github doc saying that it is not needed21:39
mordredyeah. I thought that too21:39
mordredmaybe it's not needed if we use the REST API?21:39
fungithey changed the process *very* recently21:40
fungiso now it sends a request to the new org admins to accept the transfer21:40
weifanso, does it work if it is transferred to a person, and then to the organization?21:41
mordredyes. but I just tried a manual transfer and it did not do that21:41
fungihuh21:41
fungithat may be that it has to be transferred to an account rather than an org to get that behavior21:41
corvusmordred: i can't vouch for this myself, but my recollection of the previous conversation has me thinking that folks were under the impression that using the rest api was what obtained the new acceptance procedure21:41
mordrednod21:42
fungiwell, the gh docs about performing transfers through the webui were also updated to reflect that workflow21:42
ianwfungi / corvus: i'm not sure i've thought through what happens if it's a CNAME to an openstack.org; it's only ever ended up as an A / AAAA record in opendev.org21:43
ianwwrt letsencrypt tarballs change21:43
ianwi guess it just cares you control the cname record, not where it goes?21:44
corvusianw: that's my understanding21:45
*** gmann has joined #openstack-infra21:45
fungiand now i'm not finding the repo transferring kb article which outlined that request/accept workflow21:46
ianwlgtm, worst that can happen is we don't get a cert :)21:47
mordredfungi: me either21:47
mordredfungi: maybe shared hallucination?21:48
fungiahh, https://help.github.com/en/articles/transferring-a-repository21:49
fungi"When the current owner initiates the transfer, the new owner will receive an email giving the option to accept or reject the transfer. If the new owner doesn't accept the transfer within one day, it won't complete."21:49
fungibut that may be talking about transferring to an account and not an org?21:49
mordredyeah - there's also:21:50
fungiand the api documentation is https://developer.github.com/v3/repos/#transfer-a-repository21:50
mordredhttps://help.github.com/en/articles/transferring-a-repository#repository-transfers-and-organizations21:50
mordred"To transfer repositories to an organization, you must have repository creation permissions in the receiving organization. If organization owners have disabled repository creation by organization members, only organization owners can transfer repositories out of or into the organization."21:50
mordredwhich is our original understanding21:51
mordredvery weird and confusing21:51
fungiokay, so maybe they never changed that, and the difference is personal vs org ownership21:51
fungii'll admit to being fuzzy on how they differentiate, but i guess their data model treats them separately21:52
*** slaweq has quit IRC21:52
fungii always assumed an account just came with a de facto org that had the same name21:52
fungiwhich i guess is not actually true21:52
weifanso, basically the transfer can only be done via  organization -> admin in organization2 -> organization2?21:54
fungior directly organization -> organization2 if the initiator is an admin in both21:55
fungiso say the docs anyway21:55
fungibut transferring to an individual account seems like a reasonable workaround21:55
weifanmordred: could you try tranfering to sarath-kumar to see if it works? he's one of our github admin21:56
fungihe'll have to accept the transfer request before it's completed, if the documentation is to be believed21:58
weifanyep, i'll ask him to check it21:58
ianwclarkb: so no hits for the mirror sync / weird file size from afs issues for 12+ hours now?21:58
*** whoami-rajat has quit IRC22:00
clarkb ianw I havent checked as Im doing dadops today. My wife is on jury duty22:01
*** adriant has quit IRC22:01
ianwoh, np ... well i'm not seeing them :/  glitch in the matrix maybe ...22:02
*** adriant has joined #openstack-infra22:02
ianwi'll keep an eye, maybe start up another rax mirror this afternoon and we can double the testing footprint22:02
*** slaweq has joined #openstack-infra22:03
*** rfarr_ has quit IRC22:04
*** rcernin has quit IRC22:04
*** slaweq has quit IRC22:08
*** icarusfactor has quit IRC22:12
*** icarusfactor has joined #openstack-infra22:13
*** e0ne has quit IRC22:13
*** rlandy|ruck is now known as rlandy|ruck|bbl22:14
*** icarusfactor has quit IRC22:14
*** icarusfactor has joined #openstack-infra22:15
*** icarusfactor has quit IRC22:16
aakarshhttp://lists.openstack.org/pipermail/openstack-discuss/2019-April/005007.html dmsimard curious if for this to work, we'd need to transfer ownership or create a repo with the same name in the target github org if the host is github.com?22:16
*** icarusfactor has joined #openstack-infra22:16
*** icarusfactor has quit IRC22:18
*** icarusfactor has joined #openstack-infra22:18
*** icarusfactor has quit IRC22:19
aakarshAJaeger, maybe you know the answer for this so tagging you. ^22:19
*** icarusfactor has joined #openstack-infra22:20
*** icarusfactor has quit IRC22:21
*** icarusfactor has joined #openstack-infra22:21
*** icarusfactor has quit IRC22:23
*** icarusfactor has joined #openstack-infra22:23
mordredweifan: "sarath-kumar/networking-bigswitch already exists and You can only transfer a repository from an organization to yourself at this time"22:25
mordredweifan: sigh22:25
*** icarusfactor has quit IRC22:26
*** ekultails has quit IRC22:26
weifanso he would need to delete it or rename it, right?22:26
mordredaakarsh: transferring the repo is the best idea22:26
mordredweifan: yes - but the second part of that error makes me worry that I would only be able to transfer it to myself anyway22:26
*** icarusfactor has joined #openstack-infra22:26
mordredweifan: so - we might just want to do the "give us admin, transfer repo, remove admin" dance22:27
weifani understand, but the management has concern and does not like the idea :(22:27
*** icarusfactor has quit IRC22:28
weifanlet's try tranferring to WeifanFu-bsn ..22:29
weifani'll transfer to him later if this works22:29
*** icarusfactor has joined #openstack-infra22:29
aakarshmordred, ack so this for https://github.com/openstack/browbeat . Do you know how I can request for this to be transferred into the new org i.e. cloud-bulldozer ? the concering review is https://review.opendev.org/#/c/663451/22:30
weifani think even if you are only allowed to transfer to yourself, you should be able to transfer to other individuals after that...22:31
*** sreejithp has quit IRC22:34
mordredweifan: "WeifanFu-bsn already has a repository in the openstack/networking-bigswitch network and You can only transfer a repository from an organization to yourself at this time"22:38
mordredweifan: this is "fun" isn't it?22:38
weifanhmm.. i renamed it though22:38
mordredI think it's because it's a fork22:38
mordredso it's still "in the network"22:38
clarkbfwiw we've done it the way dmsimard and I documented it mulyiple times now. Works fine22:38
weifanlet me delete it then :(22:38
mordredclarkb: yah - that requires the admin dance, yeah?22:39
clarkbyes22:39
clarkbI'm just saying that us our documented process, it works22:39
mordred++22:40
weifanit's now deleted, lets do last try?22:40
mordredclarkb: yah - taking a couple of stabs to see if any of these alternate clicky-clicks avoid the admin dance. I'm not holding out much hope atm22:40
weifansorry for the troubles :(22:40
clarkbanotheroption may be to use an intermediate org22:41
clarkbone where $management wont care if we have admin for 30 seconds22:41
mordredok. I transferred the repo to the openstackadmin user account. then from that account I transferred to WeifanFu-bsn22:42
mordredweifan: github thinks you should have a transfer to accept now22:42
weifanmordred: thanks so much, i received the confirmation22:42
fungii do wonder if proxying through a throwaway org breaks the redirect if that org gets deleted, but may be worth a try too22:42
aakarshmordred, can you please do the same for browbeat to cloud-bulldozer as well if its not much work :)22:42
aakarshopenstack/browbeat :) ^22:43
mordredaakarsh: can you add the openstackadmin user to cloud-bulldozer as an admin? (this is the quickest way - you can remove it again in just a minute)22:44
zxiiroHey folks. We're trying to work with pypi folks to alias some package names to python-jenkins but they want someone who is listed in pypi as a maintainer of a project to comment. Who should I talk to, to get access or if someone in this list can comment on the GitHub issue? https://github.com/pypa/warehouse/issues/4294#issuecomment-49925823122:44
aakarshack mordred let me do it one sec22:44
aakarshdone mordred22:45
zxiiromaintainers are: javacruft, kwc, and openstackci it seems...22:45
clarkbzxiiro: we can probably add you to the pypi admin/owner list for python-jenkins and jjb, does that work?22:45
zxiiroclarkb: works for me22:45
zxiiroclarkb: maybe add me to jenkins-job-builder one too while you're in there22:45
clarkbI'm not at the computer today but maybe fungi or mordred  or ianw can do that22:46
*** yamamoto has joined #openstack-infra22:46
fungisure, just a moment22:46
fungizxiiro: what's your pypi username?22:46
zxiirofungi: zxiiro22:46
fungii... should have guessed ;)22:47
zxiirowell you never know :)22:47
mordredaakarsh: "You don’t have the permission to create repositories on cloud-bulldozer"22:47
mordredaakarsh: I think there might be a missing permission22:47
fungizxiiro: yes, was just making sure before i did anything22:47
aakarshmordred, did you accept the invitation?22:48
aakarshit shows me that the invitation is still pending22:48
mordredoh. hah22:48
*** icarusfactor has quit IRC22:48
clarkbif you navigate to the org in the web ui you can accept it22:49
clarkbother option is dig up the invite email22:49
aakarshhttps://github.com/orgs/cloud-bulldozer heres the org link :)22:50
aakarshthere we go :) you're in :)22:50
zxiirofungi: appreciate it, thanks! I see them now.22:50
mordredaakarsh: done. you can remove that account now22:50
aakarshperfect thank you :)22:50
fungizxiiro: yep, done! by the way, when did pypi maintainers add project aliasing? what does that do? just a redirect?22:50
aakarshso mordred once https://review.opendev.org/#/c/663451/ is merged we should be good. the review is based on the mailing list thread sent by dmsimard22:51
aakarshor are there any other missing steps, that I should be keeping in mind.22:51
clarkbthats it22:52
mordredaakarsh: should be good - assuming the credentials in the secret are good (which I obviously can't see :) )22:52
aakarshack thanks mordred22:52
aakarshmordred++22:52
zxiirofungi: I have no idea. ssbarnea requested it originally so I'm assuming it's possible.22:53
*** tdasilva has quit IRC22:53
*** dchen has joined #openstack-infra22:56
*** tkajinam has joined #openstack-infra23:00
*** aakarsh has quit IRC23:13
openstackgerritIan Wienand proposed opendev/system-config master: bridge.opendev.org: use Ansible 2.8.0 stable  https://review.opendev.org/66266223:18
openstackgerritIan Wienand proposed opendev/system-config master: [wip] backups  https://review.opendev.org/66265723:18
openstackgerritIan Wienand proposed opendev/system-config master: bridge.opendev.org: use Ansible 2.8.0 stable  https://review.opendev.org/66266223:24
openstackgerritIan Wienand proposed opendev/system-config master: [wip] backups  https://review.opendev.org/66265723:24
openstackgerritMerged opendev/zone-opendev.org master: Update .gitreview after project rename  https://review.opendev.org/66342323:35
openstackgerritMerged opendev/zone-opendev.org master: Add tarballs.opendev.org cname  https://review.opendev.org/66342423:35
*** hwoarang has quit IRC23:41
*** hwoarang has joined #openstack-infra23:42
*** Goneri has quit IRC23:43
*** slaweq has joined #openstack-infra23:48
*** yamamoto has quit IRC23:48
*** bobh has joined #openstack-infra23:56
*** weifan has quit IRC23:58
*** weifan has joined #openstack-infra23:58
*** aakarsh has joined #openstack-infra23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!