Monday, 2019-02-11

eanderssonIs there a reason why the base job for zuul no longer containers the openstack-zuul-jobs?00:20
eandersson*containst he roles from openstack-zuul-jobs00:20
*** wolverineav has joined #openstack-infra00:21
*** markvoelker has joined #openstack-infra00:21
*** bobh has joined #openstack-infra00:28
clarkbeandersson: the base jobs were moved into a more generic repo (not openstack specififc)00:35
clarkbyou can add the roles back in explicitly00:35
*** armax has quit IRC00:46
fungiwe thought we caught most of those, but could be some unique in-repo stragglers00:49
*** markvoelker has quit IRC00:54
*** armax has joined #openstack-infra00:56
*** yikun has joined #openstack-infra01:06
eanderssonclarkb, yea noticed that, it was moved, but modified01:06
eanderssonalso, why that org name? why not something that does not already exist on github?01:07
eanderssonvery confusing01:07
clarkbwe've needed a "generic" or non openstack name for a while and that was the one agreed on after much discussion01:11
clarkbas for the github collision we dont intend on replicating there I dont think01:12
fungieandersson: github is irrelevant, opendev is a service we're building out of the bones of the openstack developer infrastructure01:12
eanderssonSure - just difficult to know where to look if you are not that involved01:13
eanderssonI never go to git.openstack.org01:13
eanderssonbut maybe that is just me01:13
fungiand yeah, like clarkb says, i at least see no reason to mirror a copy of the opendev namespace repo(s eventually) to proprietary third-party services like bitbucket or github01:13
*** wolverineav has quit IRC01:13
fungieandersson: if the cgit interface at git.openstack.org is the reason, we're very close to running a beta deployment of gitea on opendev.org01:19
eanderssonYea - that is the main reason01:19
eanderssonPlus just general habit, as I use github extensively, so going to github instead of some old cgit instance is just natural :p01:19
eanderssonbut that sounds great01:20
fungii'm not much of a fan of the github ui myself, but gitea does seem to have a lot more "github feel" to the layout and features01:20
eanderssonbtw how do I add a dependency on openstack-zuul-jobs to my playbook? :D01:21
eanderssonAlso, is openstack-zuul-jobs here to stay?01:22
clarkbyes that repo isnt going anywhere01:22
eanderssonhttps://github.com/openstack/magnum/blob/master/playbooks/container-builder-setup-gate.yaml#L401:23
clarkbto add the roles back you add a roles: section to the job and list that repo01:23
clarkbthat goes in the zuul.yaml (instead of the ansible playbook)01:23
eanderssonah perfect - it was the last part that wasn't clear to me01:24
clarkbin the zuul config you list the rpeo with the rolrs and all are available01:25
clarkbthe in the ansible you use the specific roles you need01:25
eanderssonhttps://review.openstack.org/#/c/631092/3/.zuul.yaml ?01:28
eanderssonLooks good now! :D Thanks01:30
eanderssonOn a slightly unrelated topic. Who can review for os-loganalyze?01:36
eanderssonGot a couple of commits that I have had to look at every day now since Nov01:37
*** armax has quit IRC01:38
*** yamamoto has joined #openstack-infra01:46
*** markvoelker has joined #openstack-infra01:51
*** bobh has quit IRC01:54
*** bobh has joined #openstack-infra01:54
*** fried_rice has quit IRC02:05
*** bobh has quit IRC02:10
*** wolverineav has joined #openstack-infra02:13
*** wolverineav has quit IRC02:15
*** wolverineav has joined #openstack-infra02:15
fungieandersson: the gear next to the project name in the gerrit webui will take you to the project details, go to the access tab and look for the group allowed code-review -2..+2 then click on that and you should see a members list02:15
fungiin this case it's really just the infra-core group though (it's included in the os-loganalyze-core group along with sdague who isn't really around these days)02:18
*** markvoelker has quit IRC02:24
*** bobh has joined #openstack-infra02:31
*** jtomasek has joined #openstack-infra02:39
*** fried_rice has joined #openstack-infra02:42
*** wolverineav has quit IRC02:43
*** jtomasek has quit IRC02:44
*** wolverineav has joined #openstack-infra02:46
*** yamamoto has quit IRC02:48
*** fried_rice has quit IRC02:52
*** bhavikdbavishi has joined #openstack-infra02:53
*** fried_rice has joined #openstack-infra02:55
*** wolverineav has quit IRC02:58
*** psachin has joined #openstack-infra03:04
*** sdake has quit IRC03:08
*** sdake has joined #openstack-infra03:11
*** ykarel has joined #openstack-infra03:17
*** markvoelker has joined #openstack-infra03:22
*** ramishra has joined #openstack-infra03:27
*** bobh has quit IRC03:39
*** jtomasek has joined #openstack-infra03:47
*** fried_rice has quit IRC03:50
*** markvoelker has quit IRC03:54
openstackgerritMerged openstack-infra/nodepool master: bindep: add sudo  https://review.openstack.org/63587603:54
*** udesale has joined #openstack-infra04:02
*** bobh has joined #openstack-infra04:05
*** wolverineav has joined #openstack-infra04:05
*** wolverineav has quit IRC04:10
*** gcutrini has joined #openstack-infra04:12
*** gcutrini has quit IRC04:14
*** zaneb has quit IRC04:17
*** hongbin has joined #openstack-infra04:25
*** janki has joined #openstack-infra04:25
openstackgerritTristan Cacqueray proposed openstack-infra/openstack-zuul-jobs master: Add add-build-sshkey tests  https://review.openstack.org/63608504:31
*** chandankumar is now known as chkumar|ruck04:32
*** bobh has quit IRC04:35
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: add-build-sshkey: remove previously authorized build-sshkey  https://review.openstack.org/63262004:44
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608704:44
*** jtomasek has quit IRC04:48
*** markvoelker has joined #openstack-infra04:51
*** hongbin has quit IRC04:53
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608704:54
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608705:00
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608705:16
*** markvoelker has quit IRC05:24
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608705:27
*** ykarel is now known as ykarel|afk05:48
*** ykarel|afk has quit IRC05:53
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: add-build-sshkey: remove previously authorized build-sshkey  https://review.openstack.org/63262006:00
*** kjackal has joined #openstack-infra06:05
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608706:06
chkumar|ruckianw: Hello06:09
chkumar|ruckianw: Is it possible to test github depends on in openstack zuul ci?06:09
chkumar|ruckianw: I wanted to test this pr https://github.com/gnocchixyz/gnocchi/pull/1017 with this review https://review.openstack.org/60431106:10
*** ykarel|afk has joined #openstack-infra06:14
*** ykarel|afk is now known as ykarel06:14
*** markvoelker has joined #openstack-infra06:22
ianwchkumar|ruck: yes ... but it will probably take some work.  gnocchi has to be being installed from the zuul checkout, and has to be setup as as zuul project06:27
ianwsee some changes like https://review.openstack.org/#/c/625467/ , https://review.openstack.org/#/c/626075/06:29
chkumar|ruckianw: sure,06:31
openstackgerritChandan Kumar proposed openstack-infra/project-config master: Add github gnocchixyz/gnocchi to project list  https://review.openstack.org/63609306:38
chkumar|ruckianw: ^^06:39
*** sshnaidm|off is now known as sshnaidm|afk06:45
*** yamamoto has joined #openstack-infra06:46
*** quiquell|off is now known as quiquell|rover06:48
*** yamamoto has quit IRC06:51
*** markvoelker has quit IRC06:55
*** jbadiapa has joined #openstack-infra07:04
*** kopecmartin|off is now known as kopecmartin07:07
*** AJaeger has quit IRC07:10
*** AJaeger has joined #openstack-infra07:23
*** e0ne has joined #openstack-infra07:23
*** ijw has joined #openstack-infra07:24
*** toabctl has joined #openstack-infra07:26
*** calbers has joined #openstack-infra07:28
*** ijw has quit IRC07:35
*** yboaron has quit IRC07:35
*** ijw has joined #openstack-infra07:35
*** ijw_ has joined #openstack-infra07:36
*** ijw has quit IRC07:38
*** quiquell|rover is now known as quique|rover|brb07:39
*** ijw has joined #openstack-infra07:40
*** jtomasek has joined #openstack-infra07:42
*** ijw_ has quit IRC07:42
*** jtomasek has quit IRC07:43
*** psachin has quit IRC07:45
*** e0ne has quit IRC07:47
*** slaweq has joined #openstack-infra07:49
*** ociuhandu_ has quit IRC07:49
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608707:50
*** ijw has quit IRC07:51
*** pgaxatte has joined #openstack-infra07:52
*** markvoelker has joined #openstack-infra07:52
*** jtomasek has joined #openstack-infra07:54
*** ociuhandu has joined #openstack-infra07:54
*** gfidente has joined #openstack-infra07:56
*** ociuhandu has quit IRC07:58
*** ykarel is now known as ykarel|lunch07:59
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608708:00
*** ginopc has joined #openstack-infra08:00
*** e0ne has joined #openstack-infra08:00
*** wolverineav has joined #openstack-infra08:01
*** adriancz has joined #openstack-infra08:04
*** e0ne has quit IRC08:05
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608708:05
*** ccamacho has joined #openstack-infra08:06
*** rpittau has joined #openstack-infra08:07
*** rascasoft has joined #openstack-infra08:07
*** Dobroslaw has joined #openstack-infra08:07
openstackgerritTristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey  https://review.openstack.org/63608708:11
*** electrofelix has joined #openstack-infra08:18
*** Emine has joined #openstack-infra08:18
*** jpena|off is now known as jpena08:22
*** jaosorior has joined #openstack-infra08:23
*** markvoelker has quit IRC08:24
*** xek has joined #openstack-infra08:30
*** wolverineav has quit IRC08:34
*** electrofelix has quit IRC08:35
*** wolverineav has joined #openstack-infra08:35
*** electrofelix has joined #openstack-infra08:37
*** Emine has quit IRC08:37
*** quique|rover|brb is now known as quiquell|rover08:39
*** Emine has joined #openstack-infra08:42
*** gfidente has quit IRC08:43
*** ykarel|lunch is now known as ykarel08:46
*** yboaron has joined #openstack-infra08:48
*** finucannot is now known as stephenfin08:51
*** yboaron_ has joined #openstack-infra08:53
*** tosky has joined #openstack-infra08:54
*** iurygregory has joined #openstack-infra08:55
*** yboaron has quit IRC08:55
*** bnemec-pto has quit IRC08:57
*** bnemec has joined #openstack-infra08:59
*** shardy has joined #openstack-infra09:04
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: enable zuul_return to update Ansible inventory  https://review.openstack.org/59009209:08
*** wolverineav has quit IRC09:09
openstackgerritMatthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions  https://review.openstack.org/57690709:11
*** bhavikdbavishi has quit IRC09:16
*** gfidente has joined #openstack-infra09:17
*** jpich has joined #openstack-infra09:21
*** markvoelker has joined #openstack-infra09:21
*** sshnaidm|afk is now known as sshnaidm09:26
*** Emine has quit IRC09:29
*** derekh has joined #openstack-infra09:35
*** Emine has joined #openstack-infra09:36
*** wolverineav has joined #openstack-infra09:41
*** dtantsur|afk is now known as dtantsur09:48
*** markvoelker has quit IRC09:54
*** bhavikdbavishi has joined #openstack-infra10:08
*** wolverineav has quit IRC10:14
*** whoami-rajat has joined #openstack-infra10:20
*** jtomasek has quit IRC10:22
*** ociuhandu has joined #openstack-infra10:24
*** jtomasek has joined #openstack-infra10:25
*** gfidente has quit IRC10:34
openstackgerritFabien Boucher proposed openstack-infra/zuul-jobs master: Add the skip_bindep option to the tox job  https://review.openstack.org/63587710:37
*** ldnunes has joined #openstack-infra10:38
openstackgerritFabien Boucher proposed openstack-infra/zuul-jobs master: Add the tox_install_bindep option to the tox job  https://review.openstack.org/63587710:38
*** aojea has joined #openstack-infra10:50
*** markvoelker has joined #openstack-infra10:52
openstackgerritFabien Boucher proposed openstack-infra/zuul master: [WIP] URLTrigger driver time based - artifact change jobs triggering driver  https://review.openstack.org/63556711:07
*** wolverineav has joined #openstack-infra11:11
*** gfidente has joined #openstack-infra11:13
*** jtomasek has quit IRC11:17
*** jtomasek has joined #openstack-infra11:18
*** markvoelker has quit IRC11:25
*** kjackal has quit IRC11:34
*** kjackal has joined #openstack-infra11:35
openstackgerritTobias Urdin proposed openstack-infra/project-config master: Rework to use new upload-forge module  https://review.openstack.org/63596511:44
*** wolverineav has quit IRC11:44
*** Emine has quit IRC11:46
*** bhavikdbavishi has quit IRC11:56
*** udesale has quit IRC12:05
*** udesale has joined #openstack-infra12:06
*** dave-mccowan has joined #openstack-infra12:12
*** markvoelker has joined #openstack-infra12:21
*** smarcet has joined #openstack-infra12:24
*** jpena is now known as jpena|lunch12:32
*** fried_rice has joined #openstack-infra12:33
*** Emine has joined #openstack-infra12:35
*** whoami-rajat has quit IRC12:40
*** kjackal has quit IRC12:41
*** wolverineav has joined #openstack-infra12:42
*** kjackal has joined #openstack-infra12:42
*** rh-jelabarre has joined #openstack-infra12:47
*** janki has quit IRC12:50
*** jchhatbar has joined #openstack-infra12:50
*** gcutrini has joined #openstack-infra12:50
zbrcorvus: can you please check these two simple bindep CRs?  https://review.openstack.org/#/c/635590/ and https://review.openstack.org/#/c/635576/ thanks.12:53
*** bauwser is now known as bauzas12:54
*** markvoelker has quit IRC12:54
*** gcutrini has quit IRC12:56
*** derekh has quit IRC12:58
*** yamamoto has joined #openstack-infra13:00
*** yamamoto has quit IRC13:05
*** rlandy has joined #openstack-infra13:10
*** trown|outtypewww is now known as trown13:13
*** wolverineav has quit IRC13:14
*** jamesmcarthur has joined #openstack-infra13:19
*** jamesmcarthur has quit IRC13:19
*** jamesmcarthur has joined #openstack-infra13:20
*** gcutrini has joined #openstack-infra13:25
*** jamesmcarthur has quit IRC13:33
*** jpena|lunch is now known as jpena13:35
*** yamamoto has joined #openstack-infra13:40
*** mriedem has joined #openstack-infra13:43
mordredzbr: FASCINATING. I had no idea you could do dnf install /usr/bin/docker13:44
*** yamamoto has quit IRC13:44
mordredthat's a really cool feature13:45
zbrmordred: very useful when same tool is provided by various rpms.13:45
mordredtotally. and, like your example, when the package is called different things and all you want is to install the 'right' one13:45
mordredanyway - +2 on both from me - +3 on the second one13:46
*** edmondsw has quit IRC13:46
*** derekh has joined #openstack-infra13:49
*** quiquell|rover is now known as quique|rover|eat13:49
*** roman_g has joined #openstack-infra13:50
openstackgerritMerged openstack-infra/project-config master: Remove unused pbrx container publish job  https://review.openstack.org/63601813:51
*** markvoelker has joined #openstack-infra13:52
*** dklyle has quit IRC13:52
AJaegerconfig-core, could you review these opendev/base-jobs chagens, please? https://review.openstack.org/636027 and https://review.openstack.org/636008 - and then let's merge https://review.openstack.org/636006 and https://review.openstack.org/63600713:54
*** jamesmcarthur has joined #openstack-infra13:54
*** jamesmcarthur has quit IRC13:54
*** jamesmcarthur has joined #openstack-infra13:54
*** ykarel is now known as ykarel|away13:55
*** fried_rice is now known as efried13:55
openstackgerritMerged openstack-infra/bindep master: Allow mentioning tools paths in bindep  https://review.openstack.org/63557613:55
*** bgmccollum has quit IRC13:57
*** bgmccollum has joined #openstack-infra13:58
*** ykarel|away has quit IRC14:01
*** yboaron_ has quit IRC14:03
*** yboaron_ has joined #openstack-infra14:03
*** bgmccollum has quit IRC14:10
*** wolverineav has joined #openstack-infra14:11
*** quique|rover|eat is now known as quiquell|rover14:17
*** jamesmcarthur has quit IRC14:21
*** markvoelker has quit IRC14:24
*** edmondsw has joined #openstack-infra14:27
*** ykarel has joined #openstack-infra14:27
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid master: Updated deploy functions  https://review.openstack.org/63613714:32
*** mkarray has joined #openstack-infra14:36
*** jamesmcarthur has joined #openstack-infra14:37
*** jamesmcarthur has quit IRC14:38
*** jamesmcarthur has joined #openstack-infra14:39
*** agopi has joined #openstack-infra14:42
*** bgmccollum has joined #openstack-infra14:44
*** wolverineav has quit IRC14:45
*** ekultails has joined #openstack-infra14:45
*** jchhatbar has quit IRC14:49
smarcetfungi: clarkb: mordred: morning please review https://review.openstack.org/#/c/636137/1 when u get a chance14:51
smarceti found a few issues on openstackid-dev01 deployment, also we need to repoint openstackid-dev domain to 104.130.246.1414:52
smarcetthat is the ip of openstackid-dev0114:53
*** bdodd has joined #openstack-infra14:53
fungismarcet: yep, i was holding off making the dns change until we knew the new server was working14:57
smarcetfungi: yes problem that dev01 is getting the openstackid-dev hostname14:58
smarcetfungi: i would say first we need to merge https://review.openstack.org/#/c/636137/1  test server dev01 changing the hostname by hand and then we could do the move if u agree14:58
fungiright, under our current server management design, the openstackid-dev.openstack.org record will be a cname alias to the openstackid-dev01.openstack.org server14:59
fungi(the hostname of the server itself stays the same)14:59
*** ldnunes has quit IRC15:02
fungiso ideally once we're comfortable it's working, all we need to do is delete the address records for the old openstackid-dev server and add a cname from openstackid-dev to openstackid-dev0115:03
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Fix excluded config if excluded in earlier tenant  https://review.openstack.org/63614615:03
*** bhavikdbavishi has joined #openstack-infra15:03
fungiand this makes future server rebuilds much easier since the service name in dns is no longer tied to the hostname of the server providing it15:04
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Don't exclude config if excluded in earlier tenant  https://review.openstack.org/63614615:04
smarcetfungi: understood :)15:06
*** ekultails has quit IRC15:06
*** snapiri has quit IRC15:08
*** yboaron_ has quit IRC15:21
*** yboaron_ has joined #openstack-infra15:21
*** markvoelker has joined #openstack-infra15:22
*** ekultails has joined #openstack-infra15:23
fungimordred: looks like you're not in #storyboard, but see if https://review.openstack.org/636014 makes sense15:31
fungi(it's a very small hotfix related to database inserts)15:33
mordredfungi: seems reasonable15:37
*** armax has joined #openstack-infra15:39
*** quiquell|rover is now known as quiquell|off15:39
*** agopi has quit IRC15:39
*** yboaron_ has quit IRC15:42
clarkbmordred: have a sec for https://review.openstack.org/#/c/635543/ a puppet-4 cleanup that should hopefully make things happy so we can continue to switch to puppet-415:42
*** wolverineav has joined #openstack-infra15:42
*** yboaron_ has joined #openstack-infra15:42
roman_gHello. Could I get reviews on https://review.openstack.org/#/c/635381/ - Replace deprecated docs job in docs-on-readthedocs template (Change docs-on-readthedocs project template from using deprecated build-openstack-sphinx-docs job for check and gate to openstack-tox-docs job.). Thank you.15:44
pabelangerAJaeger: zbr: I thought we marked bindep-fallback.txt as deprecated a while ago, why are we continuing to add testing around it? https://review.openstack.org/635590/ and https://review.openstack.org/617282/ I pushed up a bunch of patches 6 months around to convert jobs to stop using it, think we might be at a good place now to actually remove it (if somebody confirms).15:45
zbrpabelanger: i seen your comment. correct me if I am wrong: bindep-fallback.txt use is deprecated, so for testing bindep itself, I should move the file inside repo and rest it (or something based on it).15:51
clarkbzbr: rather than test the fallback file we can feed it a file specifically for testing (and maybe the first version of that file is a copy of the fallback file)15:52
zbrclarkb: doing it right now, we are on the same page.15:53
*** markvoelker has quit IRC15:56
fungiyeah, we originally tested the actual bindep-fallback.txt from project-config in both directions (making sure changes to bindep still worked with the existing contents of that file, and that proposed changes to that file worked with the released version of bindep) because lots of jobs relied on it to replicate the packages we used to preinstall in our old "thick" test node images15:57
*** dklyle has joined #openstack-infra15:58
openstackgerritSorin Sbarnea proposed openstack-infra/bindep master: Replace deprecated bindep-fallback testing  https://review.openstack.org/63616315:58
*** gcutrini has quit IRC16:00
*** e0ne has joined #openstack-infra16:04
openstackgerritSorin Sbarnea proposed openstack-infra/bindep master: Replace deprecated bindep-fallback testing  https://review.openstack.org/63616316:04
*** electrofelix has quit IRC16:05
*** ramishra has quit IRC16:09
*** gfidente has quit IRC16:13
*** smarcet has quit IRC16:13
openstackgerritSorin Sbarnea proposed openstack-infra/bindep master: Replace deprecated bindep-fallback testing  https://review.openstack.org/63616316:13
*** wolverineav has quit IRC16:14
*** udesale has quit IRC16:15
*** e0ne has quit IRC16:17
*** ykarel is now known as ykarel|away16:19
*** e0ne has joined #openstack-infra16:21
*** Emine has quit IRC16:21
clarkbinfra-root https://review.openstack.org/#/c/635898/ is the second part of the dns changes to address problems with opendns rrsig failures16:22
*** diablo_rojo has joined #openstack-infra16:22
clarkb(the first change that merged configures the base node images, this change refines that config on a per job basis based on local networking)16:22
*** gfidente has joined #openstack-infra16:24
*** chkumar|ruck is now known as chandankumar16:24
*** e0ne has quit IRC16:26
*** yboaron_ has quit IRC16:28
clarkbcmurphy: did you see https://review.openstack.org/#/c/635543/ I think that may "fix" the puppet-4 thing16:30
*** bhavikdbavishi has quit IRC16:32
cmurphyclarkb: not yet will look after meetings16:36
*** e0ne has joined #openstack-infra16:36
openstackgerritMerged openstack-infra/storyboard master: Stop passing new lanes' "worklist" key to add_lane  https://review.openstack.org/63601416:40
*** roman_g has quit IRC16:47
*** pgaxatte has quit IRC16:47
*** roman_g has joined #openstack-infra16:48
*** dmsimard6 has joined #openstack-infra16:48
corvusclarkb: +316:50
*** dmsimard6 is now known as dmsimard16:51
clarkbdanke16:51
*** markvoelker has joined #openstack-infra16:52
*** aojea has quit IRC17:03
*** eernst has joined #openstack-infra17:06
*** ykarel|away has quit IRC17:08
zbrpabelanger: clarkb corvus : remove of bindep-fallback: https://review.openstack.org/#/c/636163/17:12
*** wolverineav has joined #openstack-infra17:12
*** gfidente has quit IRC17:12
*** sdake has quit IRC17:12
AJaegerpabelanger, zbr: we still use bindep-fallback in many jobs. So, I think it's too early to remove it17:13
AJaegerpabelanger: we said we will not add more content to it - but it's still used17:14
zbrAJaeger: let me correct myself: is removing it from bindep's jobs itself.17:14
*** gfidente has joined #openstack-infra17:15
*** sdake has joined #openstack-infra17:16
*** wolverineav has quit IRC17:19
*** e0ne has quit IRC17:20
*** ijw has joined #openstack-infra17:24
*** gyee has joined #openstack-infra17:24
*** markvoelker has quit IRC17:24
AJaegerconfig-core, could you review these opendev/base-jobs related changes, please? https://review.openstack.org/636027 and https://review.openstack.org/636008 - and then let's merge these for base-jobs: https://review.openstack.org/636006 and https://review.openstack.org/63600717:25
*** ginopc has quit IRC17:27
*** smarcet has joined #openstack-infra17:28
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Add intermediate registry push/pull roles  https://review.openstack.org/63482917:29
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add a job to use the intermediate registry  https://review.openstack.org/63434717:29
*** jpena is now known as jpena|off17:35
*** panda is now known as panda|off17:41
*** xek has quit IRC17:42
*** shardy has quit IRC17:43
*** rpittau has quit IRC17:44
*** rpittau has joined #openstack-infra17:45
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add a note about sqlalchemy metadata  https://review.openstack.org/63618917:45
*** bhavikdbavishi has joined #openstack-infra17:46
*** auristor has quit IRC17:46
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Update API code to work with Presentation Moderators collection (+N)  https://review.openstack.org/63619017:47
*** bhavikdbavishi has quit IRC17:47
clarkbAJaeger: I think if we merge https://review.openstack.org/#/c/636027/2 then my addition of noop jobs to that project from openstack-infra/project-config will stop working?17:50
clarkboh I see https://review.openstack.org/#/c/636006/2/zuul.yaml is what backfills that?17:51
clarkboh that is only in kata ok I'm figuring this out :)17:52
clarkbso basically openstack tenant will host opendev/base-jobs17:52
clarkbthen we added jobs directly to the repo17:52
*** auristor has joined #openstack-infra17:52
corvus+317:53
corvusclarkb: can you take a look at insecure-ci-registry.opendev.org?17:54
corvusclarkb: i see 2 problems -- first, i forgot to poke a hole in the firewall.  that's easy to fix.  but we can log into the host to look at the next thing....17:54
corvusclarkb: oh!17:55
corvusclarkb: i was about to say nothing is listening, but i was wrong, i see it.17:55
corvusso the only problem is the firewall.  sorry.17:55
corvus(i forgot that the registry runs on 5000)17:55
clarkbtcp6       0      0 :::5000                 :::*                    LISTEN      28261/registry17:55
clarkbyup17:55
*** gcutrini has joined #openstack-infra17:55
corvusso the host-networking option worked as expected.17:55
corvusi'll just push up a fw patch now.17:56
clarkbseems to. I can hit that port with telnet from the main host network namespace17:56
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Open port 5000 on the docker intermediate registry  https://review.openstack.org/63619317:57
corvusclarkb: ^17:57
*** jpich has quit IRC17:57
clarkb+217:58
*** derekh has quit IRC17:58
*** gcutrini has quit IRC18:00
*** sdake has quit IRC18:01
*** trown is now known as trown|lunch18:03
*** sdake has joined #openstack-infra18:03
*** dtantsur is now known as dtantsur|afk18:07
openstackgerritMerged openstack-infra/zuul master: Return artifacts as dicts and add metadata  https://review.openstack.org/63482518:07
*** mriedem is now known as mriedem_lunch18:09
openstackgerritMerged openstack-infra/project-config master: Add opendev/base-jobs to gerritbot  https://review.openstack.org/63600818:09
openstackgerritMerged openstack-infra/project-config master: Update tenant config for opendev  https://review.openstack.org/63602718:09
fungigonna go grab some lunch but should return shortly if anyone needs me18:09
clarkbre jemalloc and zuul is that something we should think about deploying with too? I know we've had swap/memory pressure on our executors in particular18:10
corvusclarkb: as an experiment?18:10
clarkbya, tobiash mentioned it helped in his experimenting. I'd be curious to see if our memory issues were helped too.18:11
corvusyeah, seems like it might be worthwhile18:12
AJaegerclarkb: want to babysit and self-approve  https://review.openstack.org/635900 ?18:12
*** rpittau has quit IRC18:12
clarkbhttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=64005&rra_id=all is a graph we'd want to watch if we did do that18:12
*** kopecmartin is now known as kopecmartin|off18:12
clarkbAJaeger: sure18:12
clarkbAJaeger: I've approved it and am around to keep an eye on it18:13
AJaegergreat - and thanks for those reviews18:13
openstackgerritMatthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI  https://review.openstack.org/63619718:14
clarkbcorvus: do you think take one of the executors out of the puppet/ansible rotation and manually restart it with LD PRELOADed jemalloc? then we can compare in a few days what that looks like? (maybe we restart another executor as control)18:14
corvusclarkb: yes, that sounds good, but i'd like to do a restart to pick up the patch that just landed, so let's do it as part of that18:15
clarkbcorvus: ok18:15
corvus(so actually, all our executors will be the control then)18:16
corvusclarkb: want to pick one that is not already an outlier on the graphs?18:16
AJaegerconfig-core, we're now ready to merge changes to enable tests for opendev/base-jobs. Please review base-jobs: https://review.openstack.org/636006 and https://review.openstack.org/636007 - and then https://review.openstack.org/636009 to remove noop-jobs18:16
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Install kubectl on bridge  https://review.openstack.org/63559318:17
clarkbcorvus: ze08 maybe?18:18
clarkbI can instll the jemalloc package there real quick18:19
corvusclarkb: lgtm.  most of the executors are pretty balanced right now aren't they?18:19
clarkb3.6.0-9ubuntu1 is the version available there which according to the blog post people were looking at isn't worth as much as latest jemalloc but still quite good18:20
clarkbcorvus: ya18:20
clarkbze01 and ze02 look like maybe outliers18:20
corvustobiash: ^ any thoughts about jemalloc versions?  what did you end up using?18:20
clarkbcorvus: the celery improvement was ~30% for 3.5.something and ~40% for 5.0.118:20
clarkbgiven the ease of using distro packages I'm willing to experiment iwth that version18:21
corvusyeah, it at least seems like it should be significant enough for us to see18:21
*** markvoelker has joined #openstack-infra18:21
clarkbI'll go ahead and install it on ze08 now so we are ready when things are restarted18:22
clarkb#status log Installed libjemalloc1 on ze08.openstack.org to experiment with alternate malloc implementations. Other executors will act as controls18:22
openstackstatusclarkb: finished logging18:22
mordredyay fun18:23
*** roman_g has quit IRC18:23
*** ociuhandu_ has joined #openstack-infra18:25
openstackgerritMerged openstack-infra/project-config master: Cleanup ozj confingure-unbound usage  https://review.openstack.org/63590018:26
corvusinfra-root: based on our work on the netlify stuff on friday, mordred and i cooked this up: http://lists.zuul-ci.org/pipermail/zuul-discuss/2019-February/000739.html  --  if we run that docker image in opendev, we can have a working site preview.  i've verified it works locally.18:26
tobiashcorvus: I only compared py36,py37 without jemalloc and py37 with jemalloc (latest release from source)18:27
tobiashin docker with bionic base image18:27
*** sdake has quit IRC18:27
corvustobiash: ack, thx18:27
*** ociuhandu has quit IRC18:28
tobiashcorvus: that's one day production workload: https://paste.pics/581cc286226407ab0be400b94951a7d918:28
openstackgerritMerged openstack-infra/nodepool master: Rename aws flavor-name to instance-type  https://review.openstack.org/63515318:28
tobiashcorvus: note that this graph is the rss of the whole executor container so the graphs are executor+ansible processes18:29
clarkbcorvus: I thought we wanted to get away from running an os-loganalyze type service for the logs18:30
*** sdake has joined #openstack-infra18:30
*** ociuhandu_ has quit IRC18:30
corvusclarkb: i still do.  i don't think this is like that.18:30
corvusclarkb: the only thing this does is serve data from the root of a url18:31
*** sdake has quit IRC18:32
corvusthere's no data processing or anything.  it's just mod_rewrite+mod_proxy.18:32
clarkbcorvus: I thought the ../html root was supposed to work? did that not work?18:32
corvusclarkb: none of the changes i tried work.  see https://review.openstack.org/635987 and its parents18:32
*** smarcet has quit IRC18:32
corvuswe've seen that both vuepress and react really like to know what uri they're deployed under.  for me, that suggests a pattern, and so i figure this is a simple way to solve it generally.18:34
corvusalso, to be clear, i'm not suggesting that all the logs should be served through this; just site previews.18:35
corvusi would have the job return two artifacts.  one called "site" which is the log_url + 'npm/html/', and the second called "preview" which is the url for the preview site.  would probably make that the success-url too.18:36
clarkbthat is an unfortunate pattern (since it shouldn't really matter if there are relative urls), but also out of our control18:37
corvusclarkb: agreed18:37
*** ociuhandu has joined #openstack-infra18:37
*** wolverineav has joined #openstack-infra18:38
corvusbtw, if you want to try it out, you can do so with a host entry like this:18:38
corvus172.17.0.3 site.926bb0aaddad4bc3853269451e115dcb.openstack.preview.opendev.org18:38
corvusthen run: docker run -e ZUUL_API_URL=http://zuul.opendev.org/ -it jeblair/preview18:38
mordredcorvus, clarkb: ++ to all of the above - think it should be for preview sites18:39
clarkbI have to say C++ reads less well with all that auto var stuff :) I miss that extra type info when reading/writing python18:39
mordredclarkb: :) ... and here I was happy about all the auto vars :)18:39
*** jamesmcarthur has quit IRC18:39
corvusoh, well we don't have to use 'auto'.  we can certainly specify the type wherever it's useful.  :)18:39
*** eernst has quit IRC18:39
corvusbut at least it *is* typed, auto or no.  :)18:39
clarkbya will still fail if your mismatch somewhere18:40
mordredyah. gcc has gotten much better at error messages too, btw18:40
*** whoami-rajat has joined #openstack-infra18:40
mordredclarkb: http://paste.openstack.org/show/744792/ check that out18:41
*** ociuhandu has quit IRC18:41
*** gfidente has quit IRC18:41
*** ijw has quit IRC18:42
clarkboh wow18:42
mordredright?18:43
*** ociuhandu has joined #openstack-infra18:43
corvusthis is the fun part for me -- some folks in our merry band have been saying "modern c++ is awesome", so here's a simple concrete thing that fits into our current work where we can see what it's like, and what we like and don't like about it.18:45
Shrewsoh, it makes suggestions now?18:45
mordredShrews: yah. isn't that friendly?18:45
corvusthe program solves a real problem so it's interesting (it's not just an academic exercise), but it's simple enough we can refactor it in a few minutes.18:45
Shrewsmordred: i somehow still prefer "unknown type; get bent you stupid programmer"18:46
mordredShrews: I wonder if there is a config setting for that :)18:46
clarkbthe other thing to keep in mind is portability, though zuul has basically said linux only for event loop purposes18:46
clarkbso maybe its a non concern18:46
mordredyah. I don't expect us to grow support for executing zuul on non-linux18:46
corvusagreed.  though if you don't know who wrote the http/json request library that uses, you may be surprised.18:47
clarkbha18:48
*** wolverineav has quit IRC18:50
*** xek has joined #openstack-infra18:51
corvusi added an item for the meeting tomorrow in case we want to discuss it then18:51
*** ijw has joined #openstack-infra18:51
*** openstackgerrit has quit IRC18:51
*** mriedem_lunch is now known as mriedem18:52
*** rlandy is now known as rlandy|brb18:52
*** openstackgerrit has joined #openstack-infra18:53
openstackgerritMerged openstack-infra/system-config master: Open port 5000 on the docker intermediate registry  https://review.openstack.org/63619318:53
*** efried has quit IRC18:53
*** wolverineav has joined #openstack-infra18:53
*** markvoelker has quit IRC18:55
*** efried has joined #openstack-infra18:56
*** sdake has joined #openstack-infra18:56
*** jamesmcarthur has joined #openstack-infra18:59
AJaegermordred, do you have time for some reviews, please? we're now ready to merge changes to enable tests for opendev/base-jobs. https://review.openstack.org/636006 and https://review.openstack.org/636007 - and then we can merge https://review.openstack.org/636009 to remove noop-jobs19:02
*** xek_ has joined #openstack-infra19:04
*** jamesmcarthur has quit IRC19:04
*** xek has quit IRC19:06
*** jamesmcarthur has joined #openstack-infra19:06
clarkbcorvus: fungi: I'm finally getting around to sorting out the foundation voip.ms account for pbx.o.o and have a couple questions. The first is: do we need a DID number? is that what the POTS number is called? and second I assume once I get that setup I update hiera and pbx will auto reconfigure with the new connection details? (note I haven't changed the passwd or added the credentials to the19:07
clarkbpasswords file that is my next task but figured I'd ask questions now19:07
corvusclarkb: yes.  yes.  i assume so.19:08
clarkbcorvus: the old number is a local USA number right (austin even iirc). I guess I can set up another one of those. Do we care what region it is from?19:09
corvusclarkb: not really, i just picked austin 'cause.19:09
*** rlandy|brb is now known as rlandy19:09
*** sdake has quit IRC19:09
*** jamesmcarthur has quit IRC19:11
clarkbok what I'll probably do is get passwd changed, update passwds file. Order a DID then have you double check it then figure out how to apply that to pbx19:11
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Add gitea-cluster extra vars  https://review.openstack.org/63559919:11
corvusclarkb, fungi, mordred: https://review.openstack.org/635593 and https://review.openstack.org/635599 are ready for review19:12
corvusthose are the next steps in the opendev gite cluster19:12
corvusgitea19:12
*** jamesmcarthur has joined #openstack-infra19:13
clarkbI'm taking the passwds file lock19:14
*** efried has quit IRC19:15
*** efried1 has joined #openstack-infra19:15
clarkband done with the lock19:16
zbrwould anyone be against adding two more cores to git-review? i was thinking about Marc Herbert and Darragh Bailey as I got very good feedback from them so far.19:17
*** efried1 is now known as efried19:17
mordredAJaeger: on 636006 - corvus left a comment about an update to main.yaml - do you know if that's happened?19:19
*** trown|lunch is now known as trown19:20
mordredAJaeger: ok. looks like we did19:21
openstackgerritMerged opendev/base-jobs master: Add linting jobs  https://review.openstack.org/63600619:21
*** efried has quit IRC19:22
clarkbcorvus: fungi ok I've got a number set up. Looks like we haev to set a SIP passwd and voip.ms wants to do that via randomly setting it and sending an email?19:25
clarkbfungi: ^ do you know if scott ended up with the sip passwd already and/or if I can get access to that passwd if it is emailed?19:25
clarkbbut then I think I update hiera to set the username and passwd and the new number should work19:25
AJaegermordred: yes, we did - thanks for reviewing!19:28
fungiclarkb: i do not recall, you might need to test and/or reach out to him19:29
AJaegerclarkb: could you review https://review.openstack.org/636009 to remove the noop-jobs from opendev/base-jobs, please?19:29
clarkbfungi: thanks doing that now19:29
AJaegerwe have again a tripleo Fedora 28 job for over 100h waiting for a node, see openstack-infra/tripleo-ci change 634410,619:30
clarkbAJaeger: done19:31
clarkbI've asked scott about forwarding that passwd on to me if I have them set a random one. Then I'll update the passwd file with whatever it gets reset to via local pwgen19:31
*** smarcet has joined #openstack-infra19:32
AJaegerthanks, clarkb19:32
*** wolverineav has quit IRC19:33
*** wolverineav has joined #openstack-infra19:34
*** wolverineav has quit IRC19:34
*** wolverineav has joined #openstack-infra19:35
openstackgerritAndreas Jaeger proposed opendev/base-jobs master: Add bindep.txt  https://review.openstack.org/63620819:36
AJaegerThe new tests on opendev/base-jobs are broken, hope this fixes it ^19:37
*** wolverineav has quit IRC19:40
*** ociuhandu has quit IRC19:40
*** wolverineav has joined #openstack-infra19:41
*** e0ne has joined #openstack-infra19:41
*** wolverineav has quit IRC19:41
*** wolverineav has joined #openstack-infra19:41
*** efried has joined #openstack-infra19:42
clarkbI'm taking the passwd file lock again19:47
*** zaneb has joined #openstack-infra19:48
clarkbok I've updated hiera and expect the next run against pbx.o.o to update to use the new credentials19:51
clarkb737 241 0231 is the new number. Once I've confirmed that is working I will update the wiki19:51
*** gyee has quit IRC19:52
*** markvoelker has joined #openstack-infra19:52
openstackgerritMerged openstack-infra/project-config master: Remove opendev/base-jobs jobs  https://review.openstack.org/63600919:53
clarkbpasswd lock released fwiw19:57
*** wolverineav has quit IRC19:58
*** gyee has joined #openstack-infra20:00
fungiclarkb: i'm happy to help test the new number once you think it's live too20:00
clarkbfungi: great. I've just checked syslog on that server and expect we have about a half hour wait from now before that applies20:01
fungigood to know20:01
zbrclarkb: fungi: can we workflow https://review.openstack.org/#/c/630661/ https://review.openstack.org/#/c/628655/ ?20:01
clarkbzbr: I'll look. As for adding reviewers I think as long as we continue to stick to the basic rule of avoiding changes that require major updates to docs we should be fine with that20:02
mordredclarkb: got a sec to +3 this: https://review.openstack.org/#/c/631485/120:02
clarkbzbr: we should clearly communicate that to anyone we add though20:02
clarkbmordred: trade you https://review.openstack.org/#/c/635543/20:03
fungiinfra-root: i think we've successfully ironed out the last of the issues with the upgraded storyboard-dev server, so i need to pick a time to replace the production storyboard server now and move its database. maintenance plan is https://etherpad.openstack.org/p/gCj4NfcnbW and i'm thinking this friday... opinions?20:03
fungioutage is on the order of 5 minutes, and that's more because of dns propagation than database dump and import20:03
clarkbfungi: friday works great for me. I can help out then20:04
zbrclarkb: sure, if it needs docs probably is not a good idea. there is one important change I want to do: use tox-docker for testing gerrit via container instead of curreny flaky approach. this is only about testing but it should make much easier to test with multiple gerrit versions (containers).20:04
fungiideally there will be no help needed, but having some backup on hand will be nice20:04
clarkbzbr: ya changes like that should be safe since they are not focused on user experience things20:05
mordredfungi: I will be out friday, but support you going ahead20:05
fungimordred: i support you being out friday!20:05
clarkbmordred: approved, can you clean up the contents on the server when that goes in? since puppet won't remove them20:05
clarkbmordred: from a confusion perspective that hsould help roots being confused on server20:06
mordredinfra-root: I will be out wed-fri to watch some parades in new orleans20:06
mordredclarkb: ++20:06
fungimordred: now i'm wishing i had planned to just do that instead :/20:06
clarkbthat sounds like fun20:06
fungigranted, wading through the rivers of vomit on bourbon st. isn't really that fun20:07
openstackgerritAndreas Jaeger proposed opendev/base-jobs master: Fix tests - Add bindep.txt tec  https://review.openstack.org/63620820:07
mordredwell - I don't think we have any plans to go to bourbon street :)20:07
fungigood call20:07
clarkbI'm trying to get back into the swing of things with a full week back not involving travel. But now you make me think I should do something fun on the weekend. I had hoped for snow here over last weekend but all we got was ice and rain20:08
*** e0ne has quit IRC20:08
mordredthe main attraction this week is Krewe du Vieux - and we have an apartment with a balcony on Frenchmen20:08
*** ekultails has quit IRC20:08
funginiiiice!20:08
mordredclarkb: ice and rain are not nearly as much fun as snow20:08
clarkbmordred: ya was really disappointing. Portland airport got like 5" of snow20:08
clarkbso lots of different weather depending on your exact location here over the weekend20:09
fungii do enjoy staying in the french quarter, but personally prefer it when things are less crowded20:09
*** ekultails has joined #openstack-infra20:09
mordredfungi: yah - should be a lot of fun! we'll also be seeing gothicmindfood which will be great20:09
mordredand yeah - the quarter is great when it's not full of people20:10
fungiooh! tell her i said "hi" and we miss her!20:10
mordredI shall indeed!20:11
fungimordred: "upgraded-octo-giggle" is yet another randomly generated project name?20:14
corvusyeah, if we adopt it into zuul, i expect we'd call it "zuul-preview"20:15
*** ekultails has quit IRC20:15
fungithe example uses a generated dns name. are we anticipating the opendev zuul getting some subdelegation at preview.opendev.org and how would that bit work? (ddns updates, runs its own named, et cetera)?20:16
corvusfungi: we should be able to wildcard under that, yeah?20:16
mordredfungi: yeah - randomly generated20:16
* mordred was thinking wildcard too20:16
fungicorvus: oh, fair, i suppose that does count as a sort of very static delegation ;)20:16
corvusso i think: *.preview.opendev.org IN A preview.opendev.org20:17
corvuser20:17
corvusCNAME even20:17
fungiyeah, that ought to work so long as they all get served by the same system(s)20:18
corvusyep, that's the idea.  that system will then proxy to whatever logserver (static, swift, region-local-swift) happens to be used20:18
fungithe readme doesn't say what the apache config would look like... is there any example?20:18
corvusfungi: yes, it's here: https://github.com/emonty/upgraded-octo-giggle/blob/master/vhost.conf20:19
fungihuh. you'd think my eye would have been drawn to that. it's linked from the exact page i'm looking at20:19
openstackgerritMerged openstack-infra/git-review master: Allow user to control Java version used by tox  https://review.openstack.org/63066120:20
*** ijw has quit IRC20:20
corvusfungi: that repo is set up to build a docker container running apache.  so we could tell people how to set that up, or we could just say "run the docker container we publish"20:20
*** ekultails has joined #openstack-infra20:20
fungiso basically we use the default vhost and the magic happens at RewriteMap preview "prg://usr/local/bin/zuul-preview"20:20
clarkband zuul stores the backend urls20:21
clarkbso it doesn't matter where those are20:21
corvusfungi: yep, or the next line: RewriteRule "^/?(.*)$" "${preview:%{ENV:ZUUL_API_URL} %{HTTP_HOST}}/$1" [P]20:21
fungii was less concerned with how to set it up, and more with how to find the apache feature i should be familiarizing myself with20:21
corvusyeah, "rewritemap" and "program" are the keywords there20:21
fungithanks!20:21
corvusthat rewrite rule says "send the contents of the env variable ZUUL_API_URL and the incoming HTTP hostname to stdin of the program zuul-preview, and then proxy the request to whatever url that program spits out on stdout"20:22
fungiyep, it seems pretty straightforward20:22
corvusthe program looks up the url from zuul as clarkb says20:22
fungiwhat would the hosting for this end up looking like? would we run it on files.o.o or a dedicated server or...?20:23
corvushere's the apache docs: https://httpd.apache.org/docs/current/rewrite/rewritemap.html#prg20:23
corvusfungi: dedicated server running the docker container, just as we just did for the docker registry20:24
*** markvoelker has quit IRC20:24
corvusi expect it would be small.  maybe even 2G ram?20:24
fungiand then point that at the swift container where the files get archived?20:24
corvusfungi: it doesn't need to know the archive location, it gets that from zuul for each build.  so it'll proxy to our static server for now, and when we switch to swift, it will automatically follow suit.20:25
openstackgerritAndreas Jaeger proposed opendev/base-jobs master: Fix tests - Add bindep.txt tec  https://review.openstack.org/63620820:26
fungioh, got it, so it basically just queries zuul and then pulls the files from whatever it says and serves them up20:26
mordredfungi: when someone goes tp http://site.926bb0aaddad4bc3853269451e115dcb.openstack.preview.opendev.org - apache passes site.926bb0aaddad4bc3853269451e115dcb.openstack to zuul-preview, which hits the zuul api and gets http://logs.openstack.org/24/635924/5/check/netlify-sandbox-build-site/926bb0a/npm/html/ which it returns to apache20:26
mordredfungi: which apache then uses as the mod_rewrite/mod_proxy target20:26
fungipretty straightforward20:27
corvusthat's my favorite part about it.20:27
mordredfungi: if you build it and run the command, you can just put things like site.926bb0aaddad4bc3853269451e115dcb.openstack into stdin, and it'll respond with the url on stdout - it's pretty neat20:28
corvusany time we can just let apache be apache, i'm happy :)20:28
fungii've used some similar apache features, so yeah it's nice that it just expects to be able to use pipes and stdin/stdout20:29
fungirefreshingly unix20:29
mordredfungi: ++20:30
fungiit's not that often any longer that you get to write traditional unix tools whose input is stdin and whose output is stdout20:30
mordredikr?20:30
fungi(they were standard for a reason!!!)20:30
openstackgerritMerged openstack-infra/system-config master: Remove top level hiera lookups  https://review.openstack.org/63554320:31
*** wolverineav has joined #openstack-infra20:32
fungiany infra-puppet-core reviewers game for reviewing https://review.openstack.org/636137 to unblock the openstackid xenial migration?20:33
mordredfungi: it's all you20:34
fungithanks!20:34
clarkbfungi: pbx sip.conf updated but asterisk wans't restarted. I don't know if that is necessary. I need to make lunch though20:34
*** quiquell|off is now known as quiquell|rover20:35
fungii'll let you know )though asterisk seems like the sort of system which expects a restart when phonelines get changed out from under it20:35
*** wolverineav has quit IRC20:36
*** wolverineav has joined #openstack-infra20:37
*** gouthamr has quit IRC20:38
*** dmellado has quit IRC20:39
*** wolverineav has quit IRC20:40
*** wolverineav has joined #openstack-infra20:40
*** stevebaker has quit IRC20:40
*** mriedem has quit IRC20:41
*** raissa has joined #openstack-infra20:43
*** mriedem has joined #openstack-infra20:44
fungiafter finding my phone, i've confirmed it responds with a busy signal. i guess that's how we know we need to restart the service20:45
openstackgerritMerged openstack-infra/system-config master: Remove legacy zuul status page  https://review.openstack.org/63148520:45
openstackgerritMerged openstack-infra/system-config master: Add a color to the .status_DISK_FULL class  https://review.openstack.org/63148820:45
*** ijw has joined #openstack-infra20:53
*** jamesmcarthur has quit IRC20:57
*** raissa has quit IRC20:58
*** jamesmcarthur has joined #openstack-infra20:58
ianwmordred: you seem to have about the most "blame" with the devstack localrc setup, etc, could you take a look at -> https://review.openstack.org/#/c/634621/ which moves local.conf creation later, so we can add things to it before devsatck starts20:59
openstackgerritAndreas Jaeger proposed opendev/base-jobs master: Fix tests - Add bindep.txt tec  https://review.openstack.org/63620821:00
*** quiquell|rover is now known as quiquell|off21:00
ianwit hooks into using local mirrors for the nodepool functional jobs.  dib has a role to setup the mirrors, but it exports the path to customised repo files that i want to pass to devstack (and hence nodepool devstack plugin) via ansible21:00
*** jamesmcarthur has quit IRC21:03
clarkbfungi: I just restarted asterisk21:05
*** ijw has quit IRC21:05
*** jamesmcarthur has joined #openstack-infra21:05
clarkbfungi: I was able to dial into room 600021:05
clarkbIm going to update the wiki now21:06
clarkb#status log pbx.openstack.org's POTS number updated (see wiki for new number) due to an account shuffle.21:07
openstackstatusclarkb: finished logging21:07
clarkbcorvus: ^ fyi I think you can clean up the number you had if it still around21:07
*** wolverineav has quit IRC21:09
fungiclarkb: confirmed, i'21:10
AJaegerconfig-core, https://review.openstack.org/636208 fixes the opendev/base-jobs test failures, could you review it, please?21:10
fungim able to dial into it now as well. thanks!21:10
*** wolverineav has joined #openstack-infra21:11
*** wolverineav has quit IRC21:13
*** wolverineav has joined #openstack-infra21:13
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Update API code to work with Presentation Moderators collection (+N)  https://review.openstack.org/63619021:14
openstackgerritMerged openstack-infra/puppet-openstackid master: Updated deploy functions  https://review.openstack.org/63613721:15
clarkbfungi: cmurphy http://paste.openstack.org/show/744892/ the hiera lookup for elasticsearch nodes removal seems to have fixed that error on etherpad-dev0121:15
clarkbI think that means we can proceed with upgrades now that it is working as expected21:15
fungiexcellent!21:15
*** gcutrini has joined #openstack-infra21:16
cmurphyclarkb: yay21:17
clarkbI need to pop out again for a few now that both pbx and etherpad-dev are happy but back shortly21:17
*** smarcet has quit IRC21:17
*** gcutrini has quit IRC21:19
*** xek_ has quit IRC21:21
*** markvoelker has joined #openstack-infra21:22
*** hwoarang has quit IRC21:32
*** hwoarang has joined #openstack-infra21:34
*** e0ne has joined #openstack-infra21:34
pabelangerclarkb: you should have see chan_sip try to reload, but possible it needed to be unloaded / loaded in memory21:34
*** wolverineav has quit IRC21:38
*** gouthamr has joined #openstack-infra21:39
*** wolverineav has joined #openstack-infra21:40
clarkbpabelanger: well its working now so not going to complain :)21:40
*** ociuhandu has joined #openstack-infra21:40
*** e0ne has quit IRC21:41
*** dmellado has joined #openstack-infra21:43
*** ociuhandu has quit IRC21:44
*** wolverineav has quit IRC21:45
*** harlowja has joined #openstack-infra21:46
*** harlowja has quit IRC21:47
*** wolverineav has joined #openstack-infra21:49
openstackgerritMatthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI  https://review.openstack.org/63619721:54
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add a note about sqlalchemy metadata  https://review.openstack.org/63618921:55
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Fix typo in build api endpoint  https://review.openstack.org/63622721:55
*** markvoelker has quit IRC21:55
*** jamesmcarthur has quit IRC21:57
*** trown is now known as trown|outtypewww22:00
openstackgerritMerged openstack-infra/system-config master: Install kubectl on bridge  https://review.openstack.org/63559322:02
*** stevebaker has joined #openstack-infra22:02
openstackgerritClark Boylan proposed opendev/base-jobs master: Move base test swift job into the base-jobs repo  https://review.openstack.org/63590622:14
clarkbAJaeger: ^ fyi that ran into a merge conflict with the jobs addition22:14
openstackgerritMerged openstack-infra/system-config master: Add gitea-cluster extra vars  https://review.openstack.org/63559922:14
*** stevebaker has quit IRC22:17
*** stevebaker has joined #openstack-infra22:18
*** sdake has joined #openstack-infra22:20
openstackgerritKendall Nelson proposed openstack-infra/storyboard-webclient master: Add page size of 1000 to preferences  https://review.openstack.org/60443722:20
*** markvoelker has joined #openstack-infra22:20
*** slaweq has quit IRC22:26
*** wolverineav has quit IRC22:27
*** wolverineav has joined #openstack-infra22:28
clarkbinfra-root https://review.openstack.org/#/c/635901/ is a role cleanup in ozj (role moved to opendev/base-jobs) and passes tests now. Thanks ianw for the recheck22:29
*** wolverineav has quit IRC22:31
*** wolverineav has joined #openstack-infra22:31
clarkbalso can someone else review https://review.openstack.org/#/c/636208/ as it fixes issues with tests on my other change that needed rebasing22:33
*** whoami-rajat has quit IRC22:33
*** ijw has joined #openstack-infra22:36
*** jamesmcarthur has joined #openstack-infra22:41
*** jamesmcarthur has quit IRC22:45
*** mkarray has quit IRC22:50
*** sdake has quit IRC22:51
openstackgerritMerged opendev/base-jobs master: Fix tests - Add bindep.txt tec  https://review.openstack.org/63620822:52
*** sdake has joined #openstack-infra22:56
*** tkajinam has joined #openstack-infra22:57
*** wolverineav has quit IRC22:58
*** sdake has quit IRC22:59
*** wolverineav has joined #openstack-infra22:59
*** wolverineav has quit IRC23:01
*** wolverineav has joined #openstack-infra23:01
clarkbhttps://review.openstack.org/#/c/635906/ passes tests now and adds the swift logging base test job to opendev/base-jobs23:06
clarkbcorvus: ^ I know you asked to add that back in23:06
*** sdake has joined #openstack-infra23:06
*** ijw has quit IRC23:07
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove configure-unbound role  https://review.openstack.org/63590123:09
*** rascasoft has quit IRC23:10
*** gcutrini has joined #openstack-infra23:14
corvusclarkb: want to restart zuul now?23:16
clarkbcorvus: sure. Give me a second to figure out how to set LD_PRELOAD on ze08's executor23:16
corvusclarkb: ok.  i'll add ze08 to emergency and prep for shutdown23:16
clarkbcorvus: thanks23:17
clarkbexport LD_PRELOAD /usr/lib/x86_64-linux-gnu/libjemalloc.so.1 in /etc/default/zuul-executor should do it I think23:18
clarkbI'll add that to the file now, then you can restart normally23:19
openstackgerritKendall Nelson proposed openstack-infra/storyboard master: Add documentation for private stories  https://review.openstack.org/63623523:19
clarkber needs an = between the two clumps of words but ya23:19
corvusclarkb: well, it won't be completely normal, because it'll still be in disabled.  but that should work.  i'll handle the restart of ze08 with the rest.23:19
corvusor, i reckon i can modify the playbook for this :)23:20
clarkbcorvus: ok default file is written so you should be good to go whenever ready23:20
clarkband I'm on deck if you need an extra set of hands23:20
corvusok.  starting now23:20
corvus#status log restarted all of zuul with git sha 5957d7a95e677116f39e52c2a44d4ca8b795da34; ze08 is in the disabled list and configured to use jemalloc23:21
openstackstatuscorvus: finished logging23:21
clarkbI'm guessing that was a pre log item and that the restarts are actually still in progress23:24
corvusya23:24
corvuswell, it was after the stop and before the start at least.23:25
corvuswe're currently waiting on executors to stop23:25
corvusoh neat.  the scheduler bombed.23:25
clarkbyay?23:26
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add more whitespace to zuul tenant config  https://review.openstack.org/63623723:28
corvusthat's in place manually on the scheduler23:28
corvuswhich is now starting23:29
clarkbI've approved the change23:29
*** sdake has quit IRC23:31
*** gcutrini has quit IRC23:31
corvuszuul is back up, re-enqueueing23:32
clarkbI've double checked /proc for the running zuul-executor on ze08 and the LD_PRELOAD setting is present23:33
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add zuul-preview project  https://review.openstack.org/63623823:35
corvusre-enqueue complete23:39
*** jistr_ has joined #openstack-infra23:39
*** dtantsur has joined #openstack-infra23:39
clarkbze08 is using less memory than ze05. I've not done a broad check simply because we need longer term data than me quickly checking output of free23:40
clarkbbut at least we don't have evidence of it doing the wrong thing immediately23:40
*** hwoarang_ has joined #openstack-infra23:40
*** kjackal_v2 has joined #openstack-infra23:40
corvusthat is a good sanity check23:43
corvusyay https://insecure-ci-registry.opendev.org:5000/ works23:43
clarkbcorvus: you got a successful zuul_return?23:44
corvusno, i just mean the server is up23:44
clarkbah23:44
corvusnext is merging https://review.openstack.org/63482923:44
*** stephenfin_ has joined #openstack-infra23:45
corvus(which is ready to go now)23:45
*** hemna_ has joined #openstack-infra23:45
corvusthe test failure is just the thing that 636189 fixes23:46
openstackgerritMatthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI  https://review.openstack.org/63619723:46
*** hwoarang has quit IRC23:46
*** kjackal has quit IRC23:46
*** dtantsur|afk has quit IRC23:46
*** jistr has quit IRC23:46
*** icey has quit IRC23:46
*** mrhillsman has quit IRC23:46
*** mnasiadka has quit IRC23:46
*** hemna has quit IRC23:46
*** csatari has quit IRC23:46
*** davidlenwell has quit IRC23:46
*** TheJulia has quit IRC23:46
*** sweston has quit IRC23:46
*** phausman has quit IRC23:46
*** stephenfin has quit IRC23:46
*** coreycb has quit IRC23:46
clarkbhogepodge: do you know if OSH jobs use a local caching proxy? There are pip install errors I'm skimming through and from OSH jobs is ProxyError Cannot connect to proxy when pip installing docker23:51
clarkb(apparently docker is a valid pypi package)23:51
corvus(i think the ansible docker module uses the docker python module to docker docker docker docker)23:52
openstackgerritMerged openstack-infra/project-config master: Add more whitespace to zuul tenant config  https://review.openstack.org/63623723:52
clarkbOSA jobs fail to install heat using what appears to be a local mirror (not the region local mirror but a job local mirror?)23:54
clarkbI think (based on skimming of job logs) that infra is mostly in the clear for those particular pip failures to find distributions23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!