Sunday, 2020-09-13

*** DSpider has quit IRC00:20
*** keonwoolee has quit IRC00:50
*** Goneri has quit IRC01:31
*** qchris has quit IRC06:21
*** qchris has joined #opendev06:33
*** hillpd has quit IRC06:48
*** jrosser has quit IRC06:48
*** donnyd has quit IRC06:48
*** dviroel has quit IRC06:48
*** ajya|afk has quit IRC06:48
*** odyssey4me has quit IRC06:48
*** jrosser has joined #opendev07:25
*** donnyd has joined #opendev07:25
*** hillpd has joined #opendev07:25
*** dviroel has joined #opendev07:25
*** ajya|afk has joined #opendev07:25
*** odyssey4me has joined #opendev07:25
*** moppy has quit IRC08:01
*** moppy has joined #opendev08:02
*** DSpider has joined #opendev08:31
*** tosky has joined #opendev08:56
openstackgerritSorin Sbarnea (zbr) proposed opendev/system-config master: Make install-from-bindep allow custom workdir  https://review.opendev.org/75160809:34
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/diskimage-builder master: Fix python-stow-versions  https://review.opendev.org/75161010:47
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python  https://review.opendev.org/75161111:31
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/diskimage-builder master: Run autoremove on post-install step  https://review.opendev.org/75161412:13
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/diskimage-builder master: Run autoremove on post-install step  https://review.opendev.org/75161412:14
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/diskimage-builder master: Run autoremove on post-install step  https://review.opendev.org/75161412:14
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python  https://review.opendev.org/75161112:33
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python  https://review.opendev.org/75161112:50
*** user_19173783170 has joined #opendev14:48
user_19173783170hello, is someone online?14:48
user_19173783170i want to ask what the differences between individuals and companies when i register my opendev account14:49
fungiuser_19173783170: are you asking about contributor license agreements? or can you be more specific about where you are "registering your opendev account?"15:39
fungiuser_19173783170: are you talking about this step? (signing up for an ubuntuone openid) https://docs.opendev.org/opendev/infra-manual/latest/gettingstarted.html#get-a-single-sign-on-openid15:43
*** tosky has quit IRC15:45
fungiuser_19173783170: it's been a while since i set up an ubuntu one account for myself, but it doesn't look like they ask you to specify whether you're making an individual or company account, they just ask for an e-mail address15:45
user_19173783170but if i submmit my code, how to use company's name?15:51
fungiuser_19173783170: you could contribute with an e-mail address which has your company's domain on it15:51
user_19173783170i see some info at https://www.openstack.org/join/15:53
user_19173783170What is Fundation Member Account used for?15:54
fungiuser_19173783170: yes, opendev and the openstack foundation are separate, but many people who contribute to projects in opendev also set up an openstack foundation account15:54
fungiopendev doesn't use that for anything directly, but you can declare an affiliation in your profile there which we'll include in some demographic analysis we perform15:55
fungimain reasons to create an osf account are if you want to participate in the governance of the osf (vote in elections for or run for a seat on the osf board of directors) or any projects represented by the osf (vote in leadership elections, run for elected office) both of which require becoming a member of the foundation. you can also use an osf account without being a member if you want to coordinate your15:59
fungischedule for their conferences or submit proposed talks for one of their conferences15:59
fungibut also if you want to declare company affiliations for your personal account, you can also do that in your osf account profile15:59
fungiopendev and the osf don't have "company accounts" for authentication, and sharing a single account among multiple people is a terrible idea whether they work at the same company or not16:00
user_19173783170thanks a lot16:06
user_19173783170i read for some time because my english is poor16:07
fungiuser_19173783170: no need to apologize, english is not the first language for most people here16:08
user_19173783170it's very kind of you !16:10
user_19173783170qqwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww16:10
*** user_19173783170 has quit IRC16:11
*** tosky has joined #opendev16:48
openstackgerritClark Boylan proposed opendev/system-config master: Run multiple zuul-web processes  https://review.opendev.org/75142619:26
clarkbSO_REUSEADDR is likely more complicated and needs more help from cherrypy so doing the brute force option instead19:28
clarkb(also SO_REUSEPORT is now a thing and I don't understand the difference)19:28
fungiheh, and apparently on stackoverflow someone has asked exactly that: https://stackoverflow.com/questions/14388706/how-do-so-reuseaddr-and-so-reuseport-differ20:02
openstackgerritClark Boylan proposed opendev/system-config master: Run multiple zuul-web processes  https://review.opendev.org/75142620:23
clarkbwe have been using the config item for the port :)20:23
clarkbI think that means I can clean up the config a bit since port=%(ZUUL_WEB_PORT)s will be ignored if not in the zuul web context20:24
clarkbI thought it would be checked via something like voluptuous but the ini config isn't20:24
clarkbanyway lets see if that works and worry about cleanup later20:24
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python  https://review.opendev.org/75161120:45
clarkbyup that latest patchset works according to testinfra20:59
clarkbI'm not sure if that load balanced setup will work if we add auth to zuul-web but we don't do auth now so should be fine21:00
fungiif we hash by source address then that would probably still work21:02
fungialbeit not with as even a distribution across the backend listeners21:02
clarkbya I figured we can sort that out if/when we add auth21:02
clarkbfor now the simple setup should be fine21:02
fungiright, more pointing out we have options when we decide it's desirable21:03
clarkbreading that stackoverflow response it seems SO_REUSEPORT (with SO_REUSEADDR) is what we'd need to do what the earlier patchset attempted21:07
clarkbalso zuul web is much happier today but I can't seem to induce a cached status on the opendev vhost21:13
clarkbsomething must still be going on there beyond just the slowness coupled with short ttl21:14
fungiyeah, unsurprising it's performing better, zuul-web is using ~10% of a vcpu according to top21:15
fungias opposed to 100%+21:15
clarkbI'm also tempted to restart zuul-web to pick up https://review.opendev.org/#/c/751425/ but I'm not sure I'll have any backup if it gets sad21:28
fungii'm around21:28
fungimowing the lawn before it gets too wet again, but around21:28
clarkbfungi: cool should I go ahead and do a zuul-web restart then?21:28
fungigo for it21:28
fungihappy to have the excuse to take a break if something breaks ;)21:29
clarkbits been restarted21:29
clarkbpulling up ff dev tools to see if status stops being loaded when the tab is inactive21:30
clarkbyup it seems to have corrected that issue21:31
clarkbI can see status get loaded on an interval then I switch tabs and it doesn't load again until I open that tab up again21:31
clarkbpreviously it just kept loading status21:31
fungigood, maybe that'll be enough to smooth things out this week21:33
funginot that we should stop trying to work out the caching issue21:33
clarkbanything that helps is a goo dthing :) including bug fixes, caching, and more zuul-webs :)21:33
fungibut i have a feeling caching for that has been broken for a while, maybe even forever21:33
clarkbya21:34
clarkbre Mowing, I need to mow and pick up apples (the wind storm early this week basically dropped the entire tree's worth of apples) but air outside is still bad21:35
clarkbwe got two apple crisps out of it this year so I won't be too sad about it21:35
clarkbfungi: is Paulette going to give you trouble?21:36
fungiit's way, way, waaay too soon to guess. current nws/noaa/nhc projections have it running scared21:43
clarkbthe internet wants everyone to know its 16e8 day (unix epoch time)21:43
clarkber that was yseterday!21:43
* fungi runs `date +%s`21:44
fungiindeed, 1600033438 now21:44
fungithis time yesterday was 159994712621:45
clarkbwould've been during sleep time for me I guess21:46
clarkbmaybe not for you?21:46
fungino idea21:46
ianwhey, sorry running late today22:36
ianwlooking back at the zuul-web stuff which i seem to have missed22:36
ianw#status rebooted regionone.linaro-us mirror as it had gone into shutdown22:40
openstackstatusianw: unknown command22:40
ianw#status log rebooted regionone.linaro-us mirror as it had gone into shutdown22:40
openstackstatusianw: finished logging22:40
fungiit's certainly an intriguing situation. if you can work out why apache just doesn't cache the multi-tenant status api responses, that would be a breakthrough22:40
fungi(the regular expressions and locationmatch attempt are a red herring, even just specifying the openstack tenant path with cacheenable specifically so no wildcarding whatsoever, it still doesn't seem to even try)22:42
ianwclarkb: so nb03 is also shutoff in linaro, i'm presuming you didn't do that22:42
clarkbianw: I did not22:43
clarkbits a bionic node to match the other buildres but the old one was xenial so maybe a kernel thing22:43
ianwyeah, the mirror is a focal node, so it seems unlikely to be both having issues at once22:44
ianw#status started nb03.opendev.org which had gone into shutdown22:47
openstackstatusianw: unknown command22:47
ianw#status log started nb03.opendev.org which had gone into shutdown22:47
openstackstatusianw: finished logging22:47
fungiyeah, i definitely did not shut off that server22:47
fungimaybe we need netconsole set up streaming from both instances22:47
ianwkevinz: ^ i think it might be useful for us to look through the logs and see what might have happened22:47
ianwfungi: yeah, i can setup that on a bridge screen22:48
fungithat could get us some useful details the next time it happens, thanks!22:52
*** tkajinam has joined #opendev22:56
*** tosky has quit IRC23:14
ianwfungi: the response from zuul has  "Cache-Control: public, max-age=1" which seems to me to be saying the json file is valid only for one second.  did we already consider that angle?23:28
clarkbyes, according to corvus the 1 second ttl is intentional but we should cache it for that long23:33
ianw[2020-09-13 23:32:58.490] "GET /api/status HTTP/1.1" 200 29653 cache hit "https://zuul.openstack.org/status" "Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:79.0) Gecko/20100101 Firefox/79.0"23:33
clarkbover the weekend we may not get enough requests to hit that though I tried to induce it with wget23:33
clarkbya thats the opendtack vhost which does work23:33
ianwahh, right, so that's what the multi-tenant responses bit means23:34
ianwI wonder if this has to do with "ServerName zuul.openstack.org"23:51
ianw200 98463 cache miss: attempting entity save "https://zuul.openstack.org/status"23:52
ianwthe only one it seems to say that for is "zuul.openstack.org/status"23:52
ianwoh i see, zuul.opendev.org is in 000-default23:57
ianwok, it's kind of confusing at first because they both log to the same file23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!