eandersson | Is there a reason why the base job for zuul no longer containers the openstack-zuul-jobs? | 00:20 |
---|---|---|
eandersson | *containst he roles from openstack-zuul-jobs | 00:20 |
*** wolverineav has joined #openstack-infra | 00:21 | |
*** markvoelker has joined #openstack-infra | 00:21 | |
*** bobh has joined #openstack-infra | 00:28 | |
clarkb | eandersson: the base jobs were moved into a more generic repo (not openstack specififc) | 00:35 |
clarkb | you can add the roles back in explicitly | 00:35 |
*** armax has quit IRC | 00:46 | |
fungi | we thought we caught most of those, but could be some unique in-repo stragglers | 00:49 |
*** markvoelker has quit IRC | 00:54 | |
*** armax has joined #openstack-infra | 00:56 | |
*** yikun has joined #openstack-infra | 01:06 | |
eandersson | clarkb, yea noticed that, it was moved, but modified | 01:06 |
eandersson | also, why that org name? why not something that does not already exist on github? | 01:07 |
eandersson | very confusing | 01:07 |
clarkb | we've needed a "generic" or non openstack name for a while and that was the one agreed on after much discussion | 01:11 |
clarkb | as for the github collision we dont intend on replicating there I dont think | 01:12 |
fungi | eandersson: github is irrelevant, opendev is a service we're building out of the bones of the openstack developer infrastructure | 01:12 |
eandersson | Sure - just difficult to know where to look if you are not that involved | 01:13 |
eandersson | I never go to git.openstack.org | 01:13 |
eandersson | but maybe that is just me | 01:13 |
fungi | and yeah, like clarkb says, i at least see no reason to mirror a copy of the opendev namespace repo(s eventually) to proprietary third-party services like bitbucket or github | 01:13 |
*** wolverineav has quit IRC | 01:13 | |
fungi | eandersson: if the cgit interface at git.openstack.org is the reason, we're very close to running a beta deployment of gitea on opendev.org | 01:19 |
eandersson | Yea - that is the main reason | 01:19 |
eandersson | Plus just general habit, as I use github extensively, so going to github instead of some old cgit instance is just natural :p | 01:19 |
eandersson | but that sounds great | 01:20 |
fungi | i'm not much of a fan of the github ui myself, but gitea does seem to have a lot more "github feel" to the layout and features | 01:20 |
eandersson | btw how do I add a dependency on openstack-zuul-jobs to my playbook? :D | 01:21 |
eandersson | Also, is openstack-zuul-jobs here to stay? | 01:22 |
clarkb | yes that repo isnt going anywhere | 01:22 |
eandersson | https://github.com/openstack/magnum/blob/master/playbooks/container-builder-setup-gate.yaml#L4 | 01:23 |
clarkb | to add the roles back you add a roles: section to the job and list that repo | 01:23 |
clarkb | that goes in the zuul.yaml (instead of the ansible playbook) | 01:23 |
eandersson | ah perfect - it was the last part that wasn't clear to me | 01:24 |
clarkb | in the zuul config you list the rpeo with the rolrs and all are available | 01:25 |
clarkb | the in the ansible you use the specific roles you need | 01:25 |
eandersson | https://review.openstack.org/#/c/631092/3/.zuul.yaml ? | 01:28 |
eandersson | Looks good now! :D Thanks | 01:30 |
eandersson | On a slightly unrelated topic. Who can review for os-loganalyze? | 01:36 |
eandersson | Got a couple of commits that I have had to look at every day now since Nov | 01:37 |
*** armax has quit IRC | 01:38 | |
*** yamamoto has joined #openstack-infra | 01:46 | |
*** markvoelker has joined #openstack-infra | 01:51 | |
*** bobh has quit IRC | 01:54 | |
*** bobh has joined #openstack-infra | 01:54 | |
*** fried_rice has quit IRC | 02:05 | |
*** bobh has quit IRC | 02:10 | |
*** wolverineav has joined #openstack-infra | 02:13 | |
*** wolverineav has quit IRC | 02:15 | |
*** wolverineav has joined #openstack-infra | 02:15 | |
fungi | eandersson: the gear next to the project name in the gerrit webui will take you to the project details, go to the access tab and look for the group allowed code-review -2..+2 then click on that and you should see a members list | 02:15 |
fungi | in this case it's really just the infra-core group though (it's included in the os-loganalyze-core group along with sdague who isn't really around these days) | 02:18 |
*** markvoelker has quit IRC | 02:24 | |
*** bobh has joined #openstack-infra | 02:31 | |
*** jtomasek has joined #openstack-infra | 02:39 | |
*** fried_rice has joined #openstack-infra | 02:42 | |
*** wolverineav has quit IRC | 02:43 | |
*** jtomasek has quit IRC | 02:44 | |
*** wolverineav has joined #openstack-infra | 02:46 | |
*** yamamoto has quit IRC | 02:48 | |
*** fried_rice has quit IRC | 02:52 | |
*** bhavikdbavishi has joined #openstack-infra | 02:53 | |
*** fried_rice has joined #openstack-infra | 02:55 | |
*** wolverineav has quit IRC | 02:58 | |
*** psachin has joined #openstack-infra | 03:04 | |
*** sdake has quit IRC | 03:08 | |
*** sdake has joined #openstack-infra | 03:11 | |
*** ykarel has joined #openstack-infra | 03:17 | |
*** markvoelker has joined #openstack-infra | 03:22 | |
*** ramishra has joined #openstack-infra | 03:27 | |
*** bobh has quit IRC | 03:39 | |
*** jtomasek has joined #openstack-infra | 03:47 | |
*** fried_rice has quit IRC | 03:50 | |
*** markvoelker has quit IRC | 03:54 | |
openstackgerrit | Merged openstack-infra/nodepool master: bindep: add sudo https://review.openstack.org/635876 | 03:54 |
*** udesale has joined #openstack-infra | 04:02 | |
*** bobh has joined #openstack-infra | 04:05 | |
*** wolverineav has joined #openstack-infra | 04:05 | |
*** wolverineav has quit IRC | 04:10 | |
*** gcutrini has joined #openstack-infra | 04:12 | |
*** gcutrini has quit IRC | 04:14 | |
*** zaneb has quit IRC | 04:17 | |
*** hongbin has joined #openstack-infra | 04:25 | |
*** janki has joined #openstack-infra | 04:25 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/openstack-zuul-jobs master: Add add-build-sshkey tests https://review.openstack.org/636085 | 04:31 |
*** chandankumar is now known as chkumar|ruck | 04:32 | |
*** bobh has quit IRC | 04:35 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: add-build-sshkey: remove previously authorized build-sshkey https://review.openstack.org/632620 | 04:44 |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 04:44 |
*** jtomasek has quit IRC | 04:48 | |
*** markvoelker has joined #openstack-infra | 04:51 | |
*** hongbin has quit IRC | 04:53 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 04:54 |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 05:00 |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 05:16 |
*** markvoelker has quit IRC | 05:24 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 05:27 |
*** ykarel is now known as ykarel|afk | 05:48 | |
*** ykarel|afk has quit IRC | 05:53 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: add-build-sshkey: remove previously authorized build-sshkey https://review.openstack.org/632620 | 06:00 |
*** kjackal has joined #openstack-infra | 06:05 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 06:06 |
chkumar|ruck | ianw: Hello | 06:09 |
chkumar|ruck | ianw: Is it possible to test github depends on in openstack zuul ci? | 06:09 |
chkumar|ruck | ianw: I wanted to test this pr https://github.com/gnocchixyz/gnocchi/pull/1017 with this review https://review.openstack.org/604311 | 06:10 |
*** ykarel|afk has joined #openstack-infra | 06:14 | |
*** ykarel|afk is now known as ykarel | 06:14 | |
*** markvoelker has joined #openstack-infra | 06:22 | |
ianw | chkumar|ruck: yes ... but it will probably take some work. gnocchi has to be being installed from the zuul checkout, and has to be setup as as zuul project | 06:27 |
ianw | see some changes like https://review.openstack.org/#/c/625467/ , https://review.openstack.org/#/c/626075/ | 06:29 |
chkumar|ruck | ianw: sure, | 06:31 |
openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Add github gnocchixyz/gnocchi to project list https://review.openstack.org/636093 | 06:38 |
chkumar|ruck | ianw: ^^ | 06:39 |
*** sshnaidm|off is now known as sshnaidm|afk | 06:45 | |
*** yamamoto has joined #openstack-infra | 06:46 | |
*** quiquell|off is now known as quiquell|rover | 06:48 | |
*** yamamoto has quit IRC | 06:51 | |
*** markvoelker has quit IRC | 06:55 | |
*** jbadiapa has joined #openstack-infra | 07:04 | |
*** kopecmartin|off is now known as kopecmartin | 07:07 | |
*** AJaeger has quit IRC | 07:10 | |
*** AJaeger has joined #openstack-infra | 07:23 | |
*** e0ne has joined #openstack-infra | 07:23 | |
*** ijw has joined #openstack-infra | 07:24 | |
*** toabctl has joined #openstack-infra | 07:26 | |
*** calbers has joined #openstack-infra | 07:28 | |
*** ijw has quit IRC | 07:35 | |
*** yboaron has quit IRC | 07:35 | |
*** ijw has joined #openstack-infra | 07:35 | |
*** ijw_ has joined #openstack-infra | 07:36 | |
*** ijw has quit IRC | 07:38 | |
*** quiquell|rover is now known as quique|rover|brb | 07:39 | |
*** ijw has joined #openstack-infra | 07:40 | |
*** jtomasek has joined #openstack-infra | 07:42 | |
*** ijw_ has quit IRC | 07:42 | |
*** jtomasek has quit IRC | 07:43 | |
*** psachin has quit IRC | 07:45 | |
*** e0ne has quit IRC | 07:47 | |
*** slaweq has joined #openstack-infra | 07:49 | |
*** ociuhandu_ has quit IRC | 07:49 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 07:50 |
*** ijw has quit IRC | 07:51 | |
*** pgaxatte has joined #openstack-infra | 07:52 | |
*** markvoelker has joined #openstack-infra | 07:52 | |
*** jtomasek has joined #openstack-infra | 07:54 | |
*** ociuhandu has joined #openstack-infra | 07:54 | |
*** gfidente has joined #openstack-infra | 07:56 | |
*** ociuhandu has quit IRC | 07:58 | |
*** ykarel is now known as ykarel|lunch | 07:59 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 08:00 |
*** ginopc has joined #openstack-infra | 08:00 | |
*** e0ne has joined #openstack-infra | 08:00 | |
*** wolverineav has joined #openstack-infra | 08:01 | |
*** adriancz has joined #openstack-infra | 08:04 | |
*** e0ne has quit IRC | 08:05 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 08:05 |
*** ccamacho has joined #openstack-infra | 08:06 | |
*** rpittau has joined #openstack-infra | 08:07 | |
*** rascasoft has joined #openstack-infra | 08:07 | |
*** Dobroslaw has joined #openstack-infra | 08:07 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: DNM: trying to test add-build-sshkey https://review.openstack.org/636087 | 08:11 |
*** electrofelix has joined #openstack-infra | 08:18 | |
*** Emine has joined #openstack-infra | 08:18 | |
*** jpena|off is now known as jpena | 08:22 | |
*** jaosorior has joined #openstack-infra | 08:23 | |
*** markvoelker has quit IRC | 08:24 | |
*** xek has joined #openstack-infra | 08:30 | |
*** wolverineav has quit IRC | 08:34 | |
*** electrofelix has quit IRC | 08:35 | |
*** wolverineav has joined #openstack-infra | 08:35 | |
*** electrofelix has joined #openstack-infra | 08:37 | |
*** Emine has quit IRC | 08:37 | |
*** quique|rover|brb is now known as quiquell|rover | 08:39 | |
*** Emine has joined #openstack-infra | 08:42 | |
*** gfidente has quit IRC | 08:43 | |
*** ykarel|lunch is now known as ykarel | 08:46 | |
*** yboaron has joined #openstack-infra | 08:48 | |
*** finucannot is now known as stephenfin | 08:51 | |
*** yboaron_ has joined #openstack-infra | 08:53 | |
*** tosky has joined #openstack-infra | 08:54 | |
*** iurygregory has joined #openstack-infra | 08:55 | |
*** yboaron has quit IRC | 08:55 | |
*** bnemec-pto has quit IRC | 08:57 | |
*** bnemec has joined #openstack-infra | 08:59 | |
*** shardy has joined #openstack-infra | 09:04 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: enable zuul_return to update Ansible inventory https://review.openstack.org/590092 | 09:08 |
*** wolverineav has quit IRC | 09:09 | |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 09:11 |
*** bhavikdbavishi has quit IRC | 09:16 | |
*** gfidente has joined #openstack-infra | 09:17 | |
*** jpich has joined #openstack-infra | 09:21 | |
*** markvoelker has joined #openstack-infra | 09:21 | |
*** sshnaidm|afk is now known as sshnaidm | 09:26 | |
*** Emine has quit IRC | 09:29 | |
*** derekh has joined #openstack-infra | 09:35 | |
*** Emine has joined #openstack-infra | 09:36 | |
*** wolverineav has joined #openstack-infra | 09:41 | |
*** dtantsur|afk is now known as dtantsur | 09:48 | |
*** markvoelker has quit IRC | 09:54 | |
*** bhavikdbavishi has joined #openstack-infra | 10:08 | |
*** wolverineav has quit IRC | 10:14 | |
*** whoami-rajat has joined #openstack-infra | 10:20 | |
*** jtomasek has quit IRC | 10:22 | |
*** ociuhandu has joined #openstack-infra | 10:24 | |
*** jtomasek has joined #openstack-infra | 10:25 | |
*** gfidente has quit IRC | 10:34 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add the skip_bindep option to the tox job https://review.openstack.org/635877 | 10:37 |
*** ldnunes has joined #openstack-infra | 10:38 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul-jobs master: Add the tox_install_bindep option to the tox job https://review.openstack.org/635877 | 10:38 |
*** aojea has joined #openstack-infra | 10:50 | |
*** markvoelker has joined #openstack-infra | 10:52 | |
openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: [WIP] URLTrigger driver time based - artifact change jobs triggering driver https://review.openstack.org/635567 | 11:07 |
*** wolverineav has joined #openstack-infra | 11:11 | |
*** gfidente has joined #openstack-infra | 11:13 | |
*** jtomasek has quit IRC | 11:17 | |
*** jtomasek has joined #openstack-infra | 11:18 | |
*** markvoelker has quit IRC | 11:25 | |
*** kjackal has quit IRC | 11:34 | |
*** kjackal has joined #openstack-infra | 11:35 | |
openstackgerrit | Tobias Urdin proposed openstack-infra/project-config master: Rework to use new upload-forge module https://review.openstack.org/635965 | 11:44 |
*** wolverineav has quit IRC | 11:44 | |
*** Emine has quit IRC | 11:46 | |
*** bhavikdbavishi has quit IRC | 11:56 | |
*** udesale has quit IRC | 12:05 | |
*** udesale has joined #openstack-infra | 12:06 | |
*** dave-mccowan has joined #openstack-infra | 12:12 | |
*** markvoelker has joined #openstack-infra | 12:21 | |
*** smarcet has joined #openstack-infra | 12:24 | |
*** jpena is now known as jpena|lunch | 12:32 | |
*** fried_rice has joined #openstack-infra | 12:33 | |
*** Emine has joined #openstack-infra | 12:35 | |
*** whoami-rajat has quit IRC | 12:40 | |
*** kjackal has quit IRC | 12:41 | |
*** wolverineav has joined #openstack-infra | 12:42 | |
*** kjackal has joined #openstack-infra | 12:42 | |
*** rh-jelabarre has joined #openstack-infra | 12:47 | |
*** janki has quit IRC | 12:50 | |
*** jchhatbar has joined #openstack-infra | 12:50 | |
*** gcutrini has joined #openstack-infra | 12:50 | |
zbr | corvus: can you please check these two simple bindep CRs? https://review.openstack.org/#/c/635590/ and https://review.openstack.org/#/c/635576/ thanks. | 12:53 |
*** bauwser is now known as bauzas | 12:54 | |
*** markvoelker has quit IRC | 12:54 | |
*** gcutrini has quit IRC | 12:56 | |
*** derekh has quit IRC | 12:58 | |
*** yamamoto has joined #openstack-infra | 13:00 | |
*** yamamoto has quit IRC | 13:05 | |
*** rlandy has joined #openstack-infra | 13:10 | |
*** trown|outtypewww is now known as trown | 13:13 | |
*** wolverineav has quit IRC | 13:14 | |
*** jamesmcarthur has joined #openstack-infra | 13:19 | |
*** jamesmcarthur has quit IRC | 13:19 | |
*** jamesmcarthur has joined #openstack-infra | 13:20 | |
*** gcutrini has joined #openstack-infra | 13:25 | |
*** jamesmcarthur has quit IRC | 13:33 | |
*** jpena|lunch is now known as jpena | 13:35 | |
*** yamamoto has joined #openstack-infra | 13:40 | |
*** mriedem has joined #openstack-infra | 13:43 | |
mordred | zbr: FASCINATING. I had no idea you could do dnf install /usr/bin/docker | 13:44 |
*** yamamoto has quit IRC | 13:44 | |
mordred | that's a really cool feature | 13:45 |
zbr | mordred: very useful when same tool is provided by various rpms. | 13:45 |
mordred | totally. and, like your example, when the package is called different things and all you want is to install the 'right' one | 13:45 |
mordred | anyway - +2 on both from me - +3 on the second one | 13:46 |
*** edmondsw has quit IRC | 13:46 | |
*** derekh has joined #openstack-infra | 13:49 | |
*** quiquell|rover is now known as quique|rover|eat | 13:49 | |
*** roman_g has joined #openstack-infra | 13:50 | |
openstackgerrit | Merged openstack-infra/project-config master: Remove unused pbrx container publish job https://review.openstack.org/636018 | 13:51 |
*** markvoelker has joined #openstack-infra | 13:52 | |
*** dklyle has quit IRC | 13:52 | |
AJaeger | config-core, could you review these opendev/base-jobs chagens, please? https://review.openstack.org/636027 and https://review.openstack.org/636008 - and then let's merge https://review.openstack.org/636006 and https://review.openstack.org/636007 | 13:54 |
*** jamesmcarthur has joined #openstack-infra | 13:54 | |
*** jamesmcarthur has quit IRC | 13:54 | |
*** jamesmcarthur has joined #openstack-infra | 13:54 | |
*** ykarel is now known as ykarel|away | 13:55 | |
*** fried_rice is now known as efried | 13:55 | |
openstackgerrit | Merged openstack-infra/bindep master: Allow mentioning tools paths in bindep https://review.openstack.org/635576 | 13:55 |
*** bgmccollum has quit IRC | 13:57 | |
*** bgmccollum has joined #openstack-infra | 13:58 | |
*** ykarel|away has quit IRC | 14:01 | |
*** yboaron_ has quit IRC | 14:03 | |
*** yboaron_ has joined #openstack-infra | 14:03 | |
*** bgmccollum has quit IRC | 14:10 | |
*** wolverineav has joined #openstack-infra | 14:11 | |
*** quique|rover|eat is now known as quiquell|rover | 14:17 | |
*** jamesmcarthur has quit IRC | 14:21 | |
*** markvoelker has quit IRC | 14:24 | |
*** edmondsw has joined #openstack-infra | 14:27 | |
*** ykarel has joined #openstack-infra | 14:27 | |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Updated deploy functions https://review.openstack.org/636137 | 14:32 |
*** mkarray has joined #openstack-infra | 14:36 | |
*** jamesmcarthur has joined #openstack-infra | 14:37 | |
*** jamesmcarthur has quit IRC | 14:38 | |
*** jamesmcarthur has joined #openstack-infra | 14:39 | |
*** agopi has joined #openstack-infra | 14:42 | |
*** bgmccollum has joined #openstack-infra | 14:44 | |
*** wolverineav has quit IRC | 14:45 | |
*** ekultails has joined #openstack-infra | 14:45 | |
*** jchhatbar has quit IRC | 14:49 | |
smarcet | fungi: clarkb: mordred: morning please review https://review.openstack.org/#/c/636137/1 when u get a chance | 14:51 |
smarcet | i found a few issues on openstackid-dev01 deployment, also we need to repoint openstackid-dev domain to 104.130.246.14 | 14:52 |
smarcet | that is the ip of openstackid-dev01 | 14:53 |
*** bdodd has joined #openstack-infra | 14:53 | |
fungi | smarcet: yep, i was holding off making the dns change until we knew the new server was working | 14:57 |
smarcet | fungi: yes problem that dev01 is getting the openstackid-dev hostname | 14:58 |
smarcet | fungi: i would say first we need to merge https://review.openstack.org/#/c/636137/1 test server dev01 changing the hostname by hand and then we could do the move if u agree | 14:58 |
fungi | right, under our current server management design, the openstackid-dev.openstack.org record will be a cname alias to the openstackid-dev01.openstack.org server | 14:59 |
fungi | (the hostname of the server itself stays the same) | 14:59 |
*** ldnunes has quit IRC | 15:02 | |
fungi | so ideally once we're comfortable it's working, all we need to do is delete the address records for the old openstackid-dev server and add a cname from openstackid-dev to openstackid-dev01 | 15:03 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix excluded config if excluded in earlier tenant https://review.openstack.org/636146 | 15:03 |
*** bhavikdbavishi has joined #openstack-infra | 15:03 | |
fungi | and this makes future server rebuilds much easier since the service name in dns is no longer tied to the hostname of the server providing it | 15:04 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Don't exclude config if excluded in earlier tenant https://review.openstack.org/636146 | 15:04 |
smarcet | fungi: understood :) | 15:06 |
*** ekultails has quit IRC | 15:06 | |
*** snapiri has quit IRC | 15:08 | |
*** yboaron_ has quit IRC | 15:21 | |
*** yboaron_ has joined #openstack-infra | 15:21 | |
*** markvoelker has joined #openstack-infra | 15:22 | |
*** ekultails has joined #openstack-infra | 15:23 | |
fungi | mordred: looks like you're not in #storyboard, but see if https://review.openstack.org/636014 makes sense | 15:31 |
fungi | (it's a very small hotfix related to database inserts) | 15:33 |
mordred | fungi: seems reasonable | 15:37 |
*** armax has joined #openstack-infra | 15:39 | |
*** quiquell|rover is now known as quiquell|off | 15:39 | |
*** agopi has quit IRC | 15:39 | |
*** yboaron_ has quit IRC | 15:42 | |
clarkb | mordred: have a sec for https://review.openstack.org/#/c/635543/ a puppet-4 cleanup that should hopefully make things happy so we can continue to switch to puppet-4 | 15:42 |
*** wolverineav has joined #openstack-infra | 15:42 | |
*** yboaron_ has joined #openstack-infra | 15:42 | |
roman_g | Hello. Could I get reviews on https://review.openstack.org/#/c/635381/ - Replace deprecated docs job in docs-on-readthedocs template (Change docs-on-readthedocs project template from using deprecated build-openstack-sphinx-docs job for check and gate to openstack-tox-docs job.). Thank you. | 15:44 |
pabelanger | AJaeger: zbr: I thought we marked bindep-fallback.txt as deprecated a while ago, why are we continuing to add testing around it? https://review.openstack.org/635590/ and https://review.openstack.org/617282/ I pushed up a bunch of patches 6 months around to convert jobs to stop using it, think we might be at a good place now to actually remove it (if somebody confirms). | 15:45 |
zbr | pabelanger: i seen your comment. correct me if I am wrong: bindep-fallback.txt use is deprecated, so for testing bindep itself, I should move the file inside repo and rest it (or something based on it). | 15:51 |
clarkb | zbr: rather than test the fallback file we can feed it a file specifically for testing (and maybe the first version of that file is a copy of the fallback file) | 15:52 |
zbr | clarkb: doing it right now, we are on the same page. | 15:53 |
*** markvoelker has quit IRC | 15:56 | |
fungi | yeah, we originally tested the actual bindep-fallback.txt from project-config in both directions (making sure changes to bindep still worked with the existing contents of that file, and that proposed changes to that file worked with the released version of bindep) because lots of jobs relied on it to replicate the packages we used to preinstall in our old "thick" test node images | 15:57 |
*** dklyle has joined #openstack-infra | 15:58 | |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/bindep master: Replace deprecated bindep-fallback testing https://review.openstack.org/636163 | 15:58 |
*** gcutrini has quit IRC | 16:00 | |
*** e0ne has joined #openstack-infra | 16:04 | |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/bindep master: Replace deprecated bindep-fallback testing https://review.openstack.org/636163 | 16:04 |
*** electrofelix has quit IRC | 16:05 | |
*** ramishra has quit IRC | 16:09 | |
*** gfidente has quit IRC | 16:13 | |
*** smarcet has quit IRC | 16:13 | |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/bindep master: Replace deprecated bindep-fallback testing https://review.openstack.org/636163 | 16:13 |
*** wolverineav has quit IRC | 16:14 | |
*** udesale has quit IRC | 16:15 | |
*** e0ne has quit IRC | 16:17 | |
*** ykarel is now known as ykarel|away | 16:19 | |
*** e0ne has joined #openstack-infra | 16:21 | |
*** Emine has quit IRC | 16:21 | |
clarkb | infra-root https://review.openstack.org/#/c/635898/ is the second part of the dns changes to address problems with opendns rrsig failures | 16:22 |
*** diablo_rojo has joined #openstack-infra | 16:22 | |
clarkb | (the first change that merged configures the base node images, this change refines that config on a per job basis based on local networking) | 16:22 |
*** gfidente has joined #openstack-infra | 16:24 | |
*** chkumar|ruck is now known as chandankumar | 16:24 | |
*** e0ne has quit IRC | 16:26 | |
*** yboaron_ has quit IRC | 16:28 | |
clarkb | cmurphy: did you see https://review.openstack.org/#/c/635543/ I think that may "fix" the puppet-4 thing | 16:30 |
*** bhavikdbavishi has quit IRC | 16:32 | |
cmurphy | clarkb: not yet will look after meetings | 16:36 |
*** e0ne has joined #openstack-infra | 16:36 | |
openstackgerrit | Merged openstack-infra/storyboard master: Stop passing new lanes' "worklist" key to add_lane https://review.openstack.org/636014 | 16:40 |
*** roman_g has quit IRC | 16:47 | |
*** pgaxatte has quit IRC | 16:47 | |
*** roman_g has joined #openstack-infra | 16:48 | |
*** dmsimard6 has joined #openstack-infra | 16:48 | |
corvus | clarkb: +3 | 16:50 |
*** dmsimard6 is now known as dmsimard | 16:51 | |
clarkb | danke | 16:51 |
*** markvoelker has joined #openstack-infra | 16:52 | |
*** aojea has quit IRC | 17:03 | |
*** eernst has joined #openstack-infra | 17:06 | |
*** ykarel|away has quit IRC | 17:08 | |
zbr | pabelanger: clarkb corvus : remove of bindep-fallback: https://review.openstack.org/#/c/636163/ | 17:12 |
*** wolverineav has joined #openstack-infra | 17:12 | |
*** gfidente has quit IRC | 17:12 | |
*** sdake has quit IRC | 17:12 | |
AJaeger | pabelanger, zbr: we still use bindep-fallback in many jobs. So, I think it's too early to remove it | 17:13 |
AJaeger | pabelanger: we said we will not add more content to it - but it's still used | 17:14 |
zbr | AJaeger: let me correct myself: is removing it from bindep's jobs itself. | 17:14 |
*** gfidente has joined #openstack-infra | 17:15 | |
*** sdake has joined #openstack-infra | 17:16 | |
*** wolverineav has quit IRC | 17:19 | |
*** e0ne has quit IRC | 17:20 | |
*** ijw has joined #openstack-infra | 17:24 | |
*** gyee has joined #openstack-infra | 17:24 | |
*** markvoelker has quit IRC | 17:24 | |
AJaeger | config-core, could you review these opendev/base-jobs related changes, please? https://review.openstack.org/636027 and https://review.openstack.org/636008 - and then let's merge these for base-jobs: https://review.openstack.org/636006 and https://review.openstack.org/636007 | 17:25 |
*** ginopc has quit IRC | 17:27 | |
*** smarcet has joined #openstack-infra | 17:28 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add intermediate registry push/pull roles https://review.openstack.org/634829 | 17:29 |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add a job to use the intermediate registry https://review.openstack.org/634347 | 17:29 |
*** jpena is now known as jpena|off | 17:35 | |
*** panda is now known as panda|off | 17:41 | |
*** xek has quit IRC | 17:42 | |
*** shardy has quit IRC | 17:43 | |
*** rpittau has quit IRC | 17:44 | |
*** rpittau has joined #openstack-infra | 17:45 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add a note about sqlalchemy metadata https://review.openstack.org/636189 | 17:45 |
*** bhavikdbavishi has joined #openstack-infra | 17:46 | |
*** auristor has quit IRC | 17:46 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Update API code to work with Presentation Moderators collection (+N) https://review.openstack.org/636190 | 17:47 |
*** bhavikdbavishi has quit IRC | 17:47 | |
clarkb | AJaeger: I think if we merge https://review.openstack.org/#/c/636027/2 then my addition of noop jobs to that project from openstack-infra/project-config will stop working? | 17:50 |
clarkb | oh I see https://review.openstack.org/#/c/636006/2/zuul.yaml is what backfills that? | 17:51 |
clarkb | oh that is only in kata ok I'm figuring this out :) | 17:52 |
clarkb | so basically openstack tenant will host opendev/base-jobs | 17:52 |
clarkb | then we added jobs directly to the repo | 17:52 |
*** auristor has joined #openstack-infra | 17:52 | |
corvus | +3 | 17:53 |
corvus | clarkb: can you take a look at insecure-ci-registry.opendev.org? | 17:54 |
corvus | clarkb: i see 2 problems -- first, i forgot to poke a hole in the firewall. that's easy to fix. but we can log into the host to look at the next thing.... | 17:54 |
corvus | clarkb: oh! | 17:55 |
corvus | clarkb: i was about to say nothing is listening, but i was wrong, i see it. | 17:55 |
corvus | so the only problem is the firewall. sorry. | 17:55 |
corvus | (i forgot that the registry runs on 5000) | 17:55 |
clarkb | tcp6 0 0 :::5000 :::* LISTEN 28261/registry | 17:55 |
clarkb | yup | 17:55 |
*** gcutrini has joined #openstack-infra | 17:55 | |
corvus | so the host-networking option worked as expected. | 17:55 |
corvus | i'll just push up a fw patch now. | 17:56 |
clarkb | seems to. I can hit that port with telnet from the main host network namespace | 17:56 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Open port 5000 on the docker intermediate registry https://review.openstack.org/636193 | 17:57 |
corvus | clarkb: ^ | 17:57 |
*** jpich has quit IRC | 17:57 | |
clarkb | +2 | 17:58 |
*** derekh has quit IRC | 17:58 | |
*** gcutrini has quit IRC | 18:00 | |
*** sdake has quit IRC | 18:01 | |
*** trown is now known as trown|lunch | 18:03 | |
*** sdake has joined #openstack-infra | 18:03 | |
*** dtantsur is now known as dtantsur|afk | 18:07 | |
openstackgerrit | Merged openstack-infra/zuul master: Return artifacts as dicts and add metadata https://review.openstack.org/634825 | 18:07 |
*** mriedem is now known as mriedem_lunch | 18:09 | |
openstackgerrit | Merged openstack-infra/project-config master: Add opendev/base-jobs to gerritbot https://review.openstack.org/636008 | 18:09 |
openstackgerrit | Merged openstack-infra/project-config master: Update tenant config for opendev https://review.openstack.org/636027 | 18:09 |
fungi | gonna go grab some lunch but should return shortly if anyone needs me | 18:09 |
clarkb | re jemalloc and zuul is that something we should think about deploying with too? I know we've had swap/memory pressure on our executors in particular | 18:10 |
corvus | clarkb: as an experiment? | 18:10 |
clarkb | ya, tobiash mentioned it helped in his experimenting. I'd be curious to see if our memory issues were helped too. | 18:11 |
corvus | yeah, seems like it might be worthwhile | 18:12 |
AJaeger | clarkb: want to babysit and self-approve https://review.openstack.org/635900 ? | 18:12 |
*** rpittau has quit IRC | 18:12 | |
clarkb | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=64005&rra_id=all is a graph we'd want to watch if we did do that | 18:12 |
*** kopecmartin is now known as kopecmartin|off | 18:12 | |
clarkb | AJaeger: sure | 18:12 |
clarkb | AJaeger: I've approved it and am around to keep an eye on it | 18:13 |
AJaeger | great - and thanks for those reviews | 18:13 |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 18:14 |
clarkb | corvus: do you think take one of the executors out of the puppet/ansible rotation and manually restart it with LD PRELOADed jemalloc? then we can compare in a few days what that looks like? (maybe we restart another executor as control) | 18:14 |
corvus | clarkb: yes, that sounds good, but i'd like to do a restart to pick up the patch that just landed, so let's do it as part of that | 18:15 |
clarkb | corvus: ok | 18:15 |
corvus | (so actually, all our executors will be the control then) | 18:16 |
corvus | clarkb: want to pick one that is not already an outlier on the graphs? | 18:16 |
AJaeger | config-core, we're now ready to merge changes to enable tests for opendev/base-jobs. Please review base-jobs: https://review.openstack.org/636006 and https://review.openstack.org/636007 - and then https://review.openstack.org/636009 to remove noop-jobs | 18:16 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Install kubectl on bridge https://review.openstack.org/635593 | 18:17 |
clarkb | corvus: ze08 maybe? | 18:18 |
clarkb | I can instll the jemalloc package there real quick | 18:19 |
corvus | clarkb: lgtm. most of the executors are pretty balanced right now aren't they? | 18:19 |
clarkb | 3.6.0-9ubuntu1 is the version available there which according to the blog post people were looking at isn't worth as much as latest jemalloc but still quite good | 18:20 |
clarkb | corvus: ya | 18:20 |
clarkb | ze01 and ze02 look like maybe outliers | 18:20 |
corvus | tobiash: ^ any thoughts about jemalloc versions? what did you end up using? | 18:20 |
clarkb | corvus: the celery improvement was ~30% for 3.5.something and ~40% for 5.0.1 | 18:20 |
clarkb | given the ease of using distro packages I'm willing to experiment iwth that version | 18:21 |
corvus | yeah, it at least seems like it should be significant enough for us to see | 18:21 |
*** markvoelker has joined #openstack-infra | 18:21 | |
clarkb | I'll go ahead and install it on ze08 now so we are ready when things are restarted | 18:22 |
clarkb | #status log Installed libjemalloc1 on ze08.openstack.org to experiment with alternate malloc implementations. Other executors will act as controls | 18:22 |
openstackstatus | clarkb: finished logging | 18:22 |
mordred | yay fun | 18:23 |
*** roman_g has quit IRC | 18:23 | |
*** ociuhandu_ has joined #openstack-infra | 18:25 | |
openstackgerrit | Merged openstack-infra/project-config master: Cleanup ozj confingure-unbound usage https://review.openstack.org/635900 | 18:26 |
corvus | infra-root: based on our work on the netlify stuff on friday, mordred and i cooked this up: http://lists.zuul-ci.org/pipermail/zuul-discuss/2019-February/000739.html -- if we run that docker image in opendev, we can have a working site preview. i've verified it works locally. | 18:26 |
tobiash | corvus: I only compared py36,py37 without jemalloc and py37 with jemalloc (latest release from source) | 18:27 |
tobiash | in docker with bionic base image | 18:27 |
*** sdake has quit IRC | 18:27 | |
corvus | tobiash: ack, thx | 18:27 |
*** ociuhandu has quit IRC | 18:28 | |
tobiash | corvus: that's one day production workload: https://paste.pics/581cc286226407ab0be400b94951a7d9 | 18:28 |
openstackgerrit | Merged openstack-infra/nodepool master: Rename aws flavor-name to instance-type https://review.openstack.org/635153 | 18:28 |
tobiash | corvus: note that this graph is the rss of the whole executor container so the graphs are executor+ansible processes | 18:29 |
clarkb | corvus: I thought we wanted to get away from running an os-loganalyze type service for the logs | 18:30 |
*** sdake has joined #openstack-infra | 18:30 | |
*** ociuhandu_ has quit IRC | 18:30 | |
corvus | clarkb: i still do. i don't think this is like that. | 18:30 |
corvus | clarkb: the only thing this does is serve data from the root of a url | 18:31 |
*** sdake has quit IRC | 18:32 | |
corvus | there's no data processing or anything. it's just mod_rewrite+mod_proxy. | 18:32 |
clarkb | corvus: I thought the ../html root was supposed to work? did that not work? | 18:32 |
corvus | clarkb: none of the changes i tried work. see https://review.openstack.org/635987 and its parents | 18:32 |
*** smarcet has quit IRC | 18:32 | |
corvus | we've seen that both vuepress and react really like to know what uri they're deployed under. for me, that suggests a pattern, and so i figure this is a simple way to solve it generally. | 18:34 |
corvus | also, to be clear, i'm not suggesting that all the logs should be served through this; just site previews. | 18:35 |
corvus | i would have the job return two artifacts. one called "site" which is the log_url + 'npm/html/', and the second called "preview" which is the url for the preview site. would probably make that the success-url too. | 18:36 |
clarkb | that is an unfortunate pattern (since it shouldn't really matter if there are relative urls), but also out of our control | 18:37 |
corvus | clarkb: agreed | 18:37 |
*** ociuhandu has joined #openstack-infra | 18:37 | |
*** wolverineav has joined #openstack-infra | 18:38 | |
corvus | btw, if you want to try it out, you can do so with a host entry like this: | 18:38 |
corvus | 172.17.0.3 site.926bb0aaddad4bc3853269451e115dcb.openstack.preview.opendev.org | 18:38 |
corvus | then run: docker run -e ZUUL_API_URL=http://zuul.opendev.org/ -it jeblair/preview | 18:38 |
mordred | corvus, clarkb: ++ to all of the above - think it should be for preview sites | 18:39 |
clarkb | I have to say C++ reads less well with all that auto var stuff :) I miss that extra type info when reading/writing python | 18:39 |
mordred | clarkb: :) ... and here I was happy about all the auto vars :) | 18:39 |
*** jamesmcarthur has quit IRC | 18:39 | |
corvus | oh, well we don't have to use 'auto'. we can certainly specify the type wherever it's useful. :) | 18:39 |
*** eernst has quit IRC | 18:39 | |
corvus | but at least it *is* typed, auto or no. :) | 18:39 |
clarkb | ya will still fail if your mismatch somewhere | 18:40 |
mordred | yah. gcc has gotten much better at error messages too, btw | 18:40 |
*** whoami-rajat has joined #openstack-infra | 18:40 | |
mordred | clarkb: http://paste.openstack.org/show/744792/ check that out | 18:41 |
*** ociuhandu has quit IRC | 18:41 | |
*** gfidente has quit IRC | 18:41 | |
*** ijw has quit IRC | 18:42 | |
clarkb | oh wow | 18:42 |
mordred | right? | 18:43 |
*** ociuhandu has joined #openstack-infra | 18:43 | |
corvus | this is the fun part for me -- some folks in our merry band have been saying "modern c++ is awesome", so here's a simple concrete thing that fits into our current work where we can see what it's like, and what we like and don't like about it. | 18:45 |
Shrews | oh, it makes suggestions now? | 18:45 |
mordred | Shrews: yah. isn't that friendly? | 18:45 |
corvus | the program solves a real problem so it's interesting (it's not just an academic exercise), but it's simple enough we can refactor it in a few minutes. | 18:45 |
Shrews | mordred: i somehow still prefer "unknown type; get bent you stupid programmer" | 18:46 |
mordred | Shrews: I wonder if there is a config setting for that :) | 18:46 |
clarkb | the other thing to keep in mind is portability, though zuul has basically said linux only for event loop purposes | 18:46 |
clarkb | so maybe its a non concern | 18:46 |
mordred | yah. I don't expect us to grow support for executing zuul on non-linux | 18:46 |
corvus | agreed. though if you don't know who wrote the http/json request library that uses, you may be surprised. | 18:47 |
clarkb | ha | 18:48 |
*** wolverineav has quit IRC | 18:50 | |
*** xek has joined #openstack-infra | 18:51 | |
corvus | i added an item for the meeting tomorrow in case we want to discuss it then | 18:51 |
*** ijw has joined #openstack-infra | 18:51 | |
*** openstackgerrit has quit IRC | 18:51 | |
*** mriedem_lunch is now known as mriedem | 18:52 | |
*** rlandy is now known as rlandy|brb | 18:52 | |
*** openstackgerrit has joined #openstack-infra | 18:53 | |
openstackgerrit | Merged openstack-infra/system-config master: Open port 5000 on the docker intermediate registry https://review.openstack.org/636193 | 18:53 |
*** efried has quit IRC | 18:53 | |
*** wolverineav has joined #openstack-infra | 18:53 | |
*** markvoelker has quit IRC | 18:55 | |
*** efried has joined #openstack-infra | 18:56 | |
*** sdake has joined #openstack-infra | 18:56 | |
*** jamesmcarthur has joined #openstack-infra | 18:59 | |
AJaeger | mordred, do you have time for some reviews, please? we're now ready to merge changes to enable tests for opendev/base-jobs. https://review.openstack.org/636006 and https://review.openstack.org/636007 - and then we can merge https://review.openstack.org/636009 to remove noop-jobs | 19:02 |
*** xek_ has joined #openstack-infra | 19:04 | |
*** jamesmcarthur has quit IRC | 19:04 | |
*** xek has quit IRC | 19:06 | |
*** jamesmcarthur has joined #openstack-infra | 19:06 | |
clarkb | corvus: fungi: I'm finally getting around to sorting out the foundation voip.ms account for pbx.o.o and have a couple questions. The first is: do we need a DID number? is that what the POTS number is called? and second I assume once I get that setup I update hiera and pbx will auto reconfigure with the new connection details? (note I haven't changed the passwd or added the credentials to the | 19:07 |
clarkb | passwords file that is my next task but figured I'd ask questions now | 19:07 |
corvus | clarkb: yes. yes. i assume so. | 19:08 |
clarkb | corvus: the old number is a local USA number right (austin even iirc). I guess I can set up another one of those. Do we care what region it is from? | 19:09 |
corvus | clarkb: not really, i just picked austin 'cause. | 19:09 |
*** rlandy|brb is now known as rlandy | 19:09 | |
*** sdake has quit IRC | 19:09 | |
*** jamesmcarthur has quit IRC | 19:11 | |
clarkb | ok what I'll probably do is get passwd changed, update passwds file. Order a DID then have you double check it then figure out how to apply that to pbx | 19:11 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Add gitea-cluster extra vars https://review.openstack.org/635599 | 19:11 |
corvus | clarkb, fungi, mordred: https://review.openstack.org/635593 and https://review.openstack.org/635599 are ready for review | 19:12 |
corvus | those are the next steps in the opendev gite cluster | 19:12 |
corvus | gitea | 19:12 |
*** jamesmcarthur has joined #openstack-infra | 19:13 | |
clarkb | I'm taking the passwds file lock | 19:14 |
*** efried has quit IRC | 19:15 | |
*** efried1 has joined #openstack-infra | 19:15 | |
clarkb | and done with the lock | 19:16 |
zbr | would anyone be against adding two more cores to git-review? i was thinking about Marc Herbert and Darragh Bailey as I got very good feedback from them so far. | 19:17 |
*** efried1 is now known as efried | 19:17 | |
mordred | AJaeger: on 636006 - corvus left a comment about an update to main.yaml - do you know if that's happened? | 19:19 |
*** trown|lunch is now known as trown | 19:20 | |
mordred | AJaeger: ok. looks like we did | 19:21 |
openstackgerrit | Merged opendev/base-jobs master: Add linting jobs https://review.openstack.org/636006 | 19:21 |
*** efried has quit IRC | 19:22 | |
clarkb | corvus: fungi ok I've got a number set up. Looks like we haev to set a SIP passwd and voip.ms wants to do that via randomly setting it and sending an email? | 19:25 |
clarkb | fungi: ^ do you know if scott ended up with the sip passwd already and/or if I can get access to that passwd if it is emailed? | 19:25 |
clarkb | but then I think I update hiera to set the username and passwd and the new number should work | 19:25 |
AJaeger | mordred: yes, we did - thanks for reviewing! | 19:28 |
fungi | clarkb: i do not recall, you might need to test and/or reach out to him | 19:29 |
AJaeger | clarkb: could you review https://review.openstack.org/636009 to remove the noop-jobs from opendev/base-jobs, please? | 19:29 |
clarkb | fungi: thanks doing that now | 19:29 |
AJaeger | we have again a tripleo Fedora 28 job for over 100h waiting for a node, see openstack-infra/tripleo-ci change 634410,6 | 19:30 |
clarkb | AJaeger: done | 19:31 |
clarkb | I've asked scott about forwarding that passwd on to me if I have them set a random one. Then I'll update the passwd file with whatever it gets reset to via local pwgen | 19:31 |
*** smarcet has joined #openstack-infra | 19:32 | |
AJaeger | thanks, clarkb | 19:32 |
*** wolverineav has quit IRC | 19:33 | |
*** wolverineav has joined #openstack-infra | 19:34 | |
*** wolverineav has quit IRC | 19:34 | |
*** wolverineav has joined #openstack-infra | 19:35 | |
openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Add bindep.txt https://review.openstack.org/636208 | 19:36 |
AJaeger | The new tests on opendev/base-jobs are broken, hope this fixes it ^ | 19:37 |
*** wolverineav has quit IRC | 19:40 | |
*** ociuhandu has quit IRC | 19:40 | |
*** wolverineav has joined #openstack-infra | 19:41 | |
*** e0ne has joined #openstack-infra | 19:41 | |
*** wolverineav has quit IRC | 19:41 | |
*** wolverineav has joined #openstack-infra | 19:41 | |
*** efried has joined #openstack-infra | 19:42 | |
clarkb | I'm taking the passwd file lock again | 19:47 |
*** zaneb has joined #openstack-infra | 19:48 | |
clarkb | ok I've updated hiera and expect the next run against pbx.o.o to update to use the new credentials | 19:51 |
clarkb | 737 241 0231 is the new number. Once I've confirmed that is working I will update the wiki | 19:51 |
*** gyee has quit IRC | 19:52 | |
*** markvoelker has joined #openstack-infra | 19:52 | |
openstackgerrit | Merged openstack-infra/project-config master: Remove opendev/base-jobs jobs https://review.openstack.org/636009 | 19:53 |
clarkb | passwd lock released fwiw | 19:57 |
*** wolverineav has quit IRC | 19:58 | |
*** gyee has joined #openstack-infra | 20:00 | |
fungi | clarkb: i'm happy to help test the new number once you think it's live too | 20:00 |
clarkb | fungi: great. I've just checked syslog on that server and expect we have about a half hour wait from now before that applies | 20:01 |
fungi | good to know | 20:01 |
zbr | clarkb: fungi: can we workflow https://review.openstack.org/#/c/630661/ https://review.openstack.org/#/c/628655/ ? | 20:01 |
clarkb | zbr: I'll look. As for adding reviewers I think as long as we continue to stick to the basic rule of avoiding changes that require major updates to docs we should be fine with that | 20:02 |
mordred | clarkb: got a sec to +3 this: https://review.openstack.org/#/c/631485/1 | 20:02 |
clarkb | zbr: we should clearly communicate that to anyone we add though | 20:02 |
clarkb | mordred: trade you https://review.openstack.org/#/c/635543/ | 20:03 |
fungi | infra-root: i think we've successfully ironed out the last of the issues with the upgraded storyboard-dev server, so i need to pick a time to replace the production storyboard server now and move its database. maintenance plan is https://etherpad.openstack.org/p/gCj4NfcnbW and i'm thinking this friday... opinions? | 20:03 |
fungi | outage is on the order of 5 minutes, and that's more because of dns propagation than database dump and import | 20:03 |
clarkb | fungi: friday works great for me. I can help out then | 20:04 |
zbr | clarkb: sure, if it needs docs probably is not a good idea. there is one important change I want to do: use tox-docker for testing gerrit via container instead of curreny flaky approach. this is only about testing but it should make much easier to test with multiple gerrit versions (containers). | 20:04 |
fungi | ideally there will be no help needed, but having some backup on hand will be nice | 20:04 |
clarkb | zbr: ya changes like that should be safe since they are not focused on user experience things | 20:05 |
mordred | fungi: I will be out friday, but support you going ahead | 20:05 |
fungi | mordred: i support you being out friday! | 20:05 |
clarkb | mordred: approved, can you clean up the contents on the server when that goes in? since puppet won't remove them | 20:05 |
clarkb | mordred: from a confusion perspective that hsould help roots being confused on server | 20:06 |
mordred | infra-root: I will be out wed-fri to watch some parades in new orleans | 20:06 |
mordred | clarkb: ++ | 20:06 |
fungi | mordred: now i'm wishing i had planned to just do that instead :/ | 20:06 |
clarkb | that sounds like fun | 20:06 |
fungi | granted, wading through the rivers of vomit on bourbon st. isn't really that fun | 20:07 |
openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Fix tests - Add bindep.txt tec https://review.openstack.org/636208 | 20:07 |
mordred | well - I don't think we have any plans to go to bourbon street :) | 20:07 |
fungi | good call | 20:07 |
clarkb | I'm trying to get back into the swing of things with a full week back not involving travel. But now you make me think I should do something fun on the weekend. I had hoped for snow here over last weekend but all we got was ice and rain | 20:08 |
*** e0ne has quit IRC | 20:08 | |
mordred | the main attraction this week is Krewe du Vieux - and we have an apartment with a balcony on Frenchmen | 20:08 |
*** ekultails has quit IRC | 20:08 | |
fungi | niiiice! | 20:08 |
mordred | clarkb: ice and rain are not nearly as much fun as snow | 20:08 |
clarkb | mordred: ya was really disappointing. Portland airport got like 5" of snow | 20:08 |
clarkb | so lots of different weather depending on your exact location here over the weekend | 20:09 |
fungi | i do enjoy staying in the french quarter, but personally prefer it when things are less crowded | 20:09 |
*** ekultails has joined #openstack-infra | 20:09 | |
mordred | fungi: yah - should be a lot of fun! we'll also be seeing gothicmindfood which will be great | 20:09 |
mordred | and yeah - the quarter is great when it's not full of people | 20:10 |
fungi | ooh! tell her i said "hi" and we miss her! | 20:10 |
mordred | I shall indeed! | 20:11 |
fungi | mordred: "upgraded-octo-giggle" is yet another randomly generated project name? | 20:14 |
corvus | yeah, if we adopt it into zuul, i expect we'd call it "zuul-preview" | 20:15 |
*** ekultails has quit IRC | 20:15 | |
fungi | the example uses a generated dns name. are we anticipating the opendev zuul getting some subdelegation at preview.opendev.org and how would that bit work? (ddns updates, runs its own named, et cetera)? | 20:16 |
corvus | fungi: we should be able to wildcard under that, yeah? | 20:16 |
mordred | fungi: yeah - randomly generated | 20:16 |
* mordred was thinking wildcard too | 20:16 | |
fungi | corvus: oh, fair, i suppose that does count as a sort of very static delegation ;) | 20:16 |
corvus | so i think: *.preview.opendev.org IN A preview.opendev.org | 20:17 |
corvus | er | 20:17 |
corvus | CNAME even | 20:17 |
fungi | yeah, that ought to work so long as they all get served by the same system(s) | 20:18 |
corvus | yep, that's the idea. that system will then proxy to whatever logserver (static, swift, region-local-swift) happens to be used | 20:18 |
fungi | the readme doesn't say what the apache config would look like... is there any example? | 20:18 |
corvus | fungi: yes, it's here: https://github.com/emonty/upgraded-octo-giggle/blob/master/vhost.conf | 20:19 |
fungi | huh. you'd think my eye would have been drawn to that. it's linked from the exact page i'm looking at | 20:19 |
openstackgerrit | Merged openstack-infra/git-review master: Allow user to control Java version used by tox https://review.openstack.org/630661 | 20:20 |
*** ijw has quit IRC | 20:20 | |
corvus | fungi: that repo is set up to build a docker container running apache. so we could tell people how to set that up, or we could just say "run the docker container we publish" | 20:20 |
*** ekultails has joined #openstack-infra | 20:20 | |
fungi | so basically we use the default vhost and the magic happens at RewriteMap preview "prg://usr/local/bin/zuul-preview" | 20:20 |
clarkb | and zuul stores the backend urls | 20:21 |
clarkb | so it doesn't matter where those are | 20:21 |
corvus | fungi: yep, or the next line: RewriteRule "^/?(.*)$" "${preview:%{ENV:ZUUL_API_URL} %{HTTP_HOST}}/$1" [P] | 20:21 |
fungi | i was less concerned with how to set it up, and more with how to find the apache feature i should be familiarizing myself with | 20:21 |
corvus | yeah, "rewritemap" and "program" are the keywords there | 20:21 |
fungi | thanks! | 20:21 |
corvus | that rewrite rule says "send the contents of the env variable ZUUL_API_URL and the incoming HTTP hostname to stdin of the program zuul-preview, and then proxy the request to whatever url that program spits out on stdout" | 20:22 |
fungi | yep, it seems pretty straightforward | 20:22 |
corvus | the program looks up the url from zuul as clarkb says | 20:22 |
fungi | what would the hosting for this end up looking like? would we run it on files.o.o or a dedicated server or...? | 20:23 |
corvus | here's the apache docs: https://httpd.apache.org/docs/current/rewrite/rewritemap.html#prg | 20:23 |
corvus | fungi: dedicated server running the docker container, just as we just did for the docker registry | 20:24 |
*** markvoelker has quit IRC | 20:24 | |
corvus | i expect it would be small. maybe even 2G ram? | 20:24 |
fungi | and then point that at the swift container where the files get archived? | 20:24 |
corvus | fungi: it doesn't need to know the archive location, it gets that from zuul for each build. so it'll proxy to our static server for now, and when we switch to swift, it will automatically follow suit. | 20:25 |
openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Fix tests - Add bindep.txt tec https://review.openstack.org/636208 | 20:26 |
fungi | oh, got it, so it basically just queries zuul and then pulls the files from whatever it says and serves them up | 20:26 |
mordred | fungi: when someone goes tp http://site.926bb0aaddad4bc3853269451e115dcb.openstack.preview.opendev.org - apache passes site.926bb0aaddad4bc3853269451e115dcb.openstack to zuul-preview, which hits the zuul api and gets http://logs.openstack.org/24/635924/5/check/netlify-sandbox-build-site/926bb0a/npm/html/ which it returns to apache | 20:26 |
mordred | fungi: which apache then uses as the mod_rewrite/mod_proxy target | 20:26 |
fungi | pretty straightforward | 20:27 |
corvus | that's my favorite part about it. | 20:27 |
mordred | fungi: if you build it and run the command, you can just put things like site.926bb0aaddad4bc3853269451e115dcb.openstack into stdin, and it'll respond with the url on stdout - it's pretty neat | 20:28 |
corvus | any time we can just let apache be apache, i'm happy :) | 20:28 |
fungi | i've used some similar apache features, so yeah it's nice that it just expects to be able to use pipes and stdin/stdout | 20:29 |
fungi | refreshingly unix | 20:29 |
mordred | fungi: ++ | 20:30 |
fungi | it's not that often any longer that you get to write traditional unix tools whose input is stdin and whose output is stdout | 20:30 |
mordred | ikr? | 20:30 |
fungi | (they were standard for a reason!!!) | 20:30 |
openstackgerrit | Merged openstack-infra/system-config master: Remove top level hiera lookups https://review.openstack.org/635543 | 20:31 |
*** wolverineav has joined #openstack-infra | 20:32 | |
fungi | any infra-puppet-core reviewers game for reviewing https://review.openstack.org/636137 to unblock the openstackid xenial migration? | 20:33 |
mordred | fungi: it's all you | 20:34 |
fungi | thanks! | 20:34 |
clarkb | fungi: pbx sip.conf updated but asterisk wans't restarted. I don't know if that is necessary. I need to make lunch though | 20:34 |
*** quiquell|off is now known as quiquell|rover | 20:35 | |
fungi | i'll let you know )though asterisk seems like the sort of system which expects a restart when phonelines get changed out from under it | 20:35 |
*** wolverineav has quit IRC | 20:36 | |
*** wolverineav has joined #openstack-infra | 20:37 | |
*** gouthamr has quit IRC | 20:38 | |
*** dmellado has quit IRC | 20:39 | |
*** wolverineav has quit IRC | 20:40 | |
*** wolverineav has joined #openstack-infra | 20:40 | |
*** stevebaker has quit IRC | 20:40 | |
*** mriedem has quit IRC | 20:41 | |
*** raissa has joined #openstack-infra | 20:43 | |
*** mriedem has joined #openstack-infra | 20:44 | |
fungi | after finding my phone, i've confirmed it responds with a busy signal. i guess that's how we know we need to restart the service | 20:45 |
openstackgerrit | Merged openstack-infra/system-config master: Remove legacy zuul status page https://review.openstack.org/631485 | 20:45 |
openstackgerrit | Merged openstack-infra/system-config master: Add a color to the .status_DISK_FULL class https://review.openstack.org/631488 | 20:45 |
*** ijw has joined #openstack-infra | 20:53 | |
*** jamesmcarthur has quit IRC | 20:57 | |
*** raissa has quit IRC | 20:58 | |
*** jamesmcarthur has joined #openstack-infra | 20:58 | |
ianw | mordred: you seem to have about the most "blame" with the devstack localrc setup, etc, could you take a look at -> https://review.openstack.org/#/c/634621/ which moves local.conf creation later, so we can add things to it before devsatck starts | 20:59 |
openstackgerrit | Andreas Jaeger proposed opendev/base-jobs master: Fix tests - Add bindep.txt tec https://review.openstack.org/636208 | 21:00 |
*** quiquell|rover is now known as quiquell|off | 21:00 | |
ianw | it hooks into using local mirrors for the nodepool functional jobs. dib has a role to setup the mirrors, but it exports the path to customised repo files that i want to pass to devstack (and hence nodepool devstack plugin) via ansible | 21:00 |
*** jamesmcarthur has quit IRC | 21:03 | |
clarkb | fungi: I just restarted asterisk | 21:05 |
*** ijw has quit IRC | 21:05 | |
*** jamesmcarthur has joined #openstack-infra | 21:05 | |
clarkb | fungi: I was able to dial into room 6000 | 21:05 |
clarkb | Im going to update the wiki now | 21:06 |
clarkb | #status log pbx.openstack.org's POTS number updated (see wiki for new number) due to an account shuffle. | 21:07 |
openstackstatus | clarkb: finished logging | 21:07 |
clarkb | corvus: ^ fyi I think you can clean up the number you had if it still around | 21:07 |
*** wolverineav has quit IRC | 21:09 | |
fungi | clarkb: confirmed, i' | 21:10 |
AJaeger | config-core, https://review.openstack.org/636208 fixes the opendev/base-jobs test failures, could you review it, please? | 21:10 |
fungi | m able to dial into it now as well. thanks! | 21:10 |
*** wolverineav has joined #openstack-infra | 21:11 | |
*** wolverineav has quit IRC | 21:13 | |
*** wolverineav has joined #openstack-infra | 21:13 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Update API code to work with Presentation Moderators collection (+N) https://review.openstack.org/636190 | 21:14 |
openstackgerrit | Merged openstack-infra/puppet-openstackid master: Updated deploy functions https://review.openstack.org/636137 | 21:15 |
clarkb | fungi: cmurphy http://paste.openstack.org/show/744892/ the hiera lookup for elasticsearch nodes removal seems to have fixed that error on etherpad-dev01 | 21:15 |
clarkb | I think that means we can proceed with upgrades now that it is working as expected | 21:15 |
fungi | excellent! | 21:15 |
*** gcutrini has joined #openstack-infra | 21:16 | |
cmurphy | clarkb: yay | 21:17 |
clarkb | I need to pop out again for a few now that both pbx and etherpad-dev are happy but back shortly | 21:17 |
*** smarcet has quit IRC | 21:17 | |
*** gcutrini has quit IRC | 21:19 | |
*** xek_ has quit IRC | 21:21 | |
*** markvoelker has joined #openstack-infra | 21:22 | |
*** hwoarang has quit IRC | 21:32 | |
*** hwoarang has joined #openstack-infra | 21:34 | |
*** e0ne has joined #openstack-infra | 21:34 | |
pabelanger | clarkb: you should have see chan_sip try to reload, but possible it needed to be unloaded / loaded in memory | 21:34 |
*** wolverineav has quit IRC | 21:38 | |
*** gouthamr has joined #openstack-infra | 21:39 | |
*** wolverineav has joined #openstack-infra | 21:40 | |
clarkb | pabelanger: well its working now so not going to complain :) | 21:40 |
*** ociuhandu has joined #openstack-infra | 21:40 | |
*** e0ne has quit IRC | 21:41 | |
*** dmellado has joined #openstack-infra | 21:43 | |
*** ociuhandu has quit IRC | 21:44 | |
*** wolverineav has quit IRC | 21:45 | |
*** harlowja has joined #openstack-infra | 21:46 | |
*** harlowja has quit IRC | 21:47 | |
*** wolverineav has joined #openstack-infra | 21:49 | |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 21:54 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add a note about sqlalchemy metadata https://review.openstack.org/636189 | 21:55 |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix typo in build api endpoint https://review.openstack.org/636227 | 21:55 |
*** markvoelker has quit IRC | 21:55 | |
*** jamesmcarthur has quit IRC | 21:57 | |
*** trown is now known as trown|outtypewww | 22:00 | |
openstackgerrit | Merged openstack-infra/system-config master: Install kubectl on bridge https://review.openstack.org/635593 | 22:02 |
*** stevebaker has joined #openstack-infra | 22:02 | |
openstackgerrit | Clark Boylan proposed opendev/base-jobs master: Move base test swift job into the base-jobs repo https://review.openstack.org/635906 | 22:14 |
clarkb | AJaeger: ^ fyi that ran into a merge conflict with the jobs addition | 22:14 |
openstackgerrit | Merged openstack-infra/system-config master: Add gitea-cluster extra vars https://review.openstack.org/635599 | 22:14 |
*** stevebaker has quit IRC | 22:17 | |
*** stevebaker has joined #openstack-infra | 22:18 | |
*** sdake has joined #openstack-infra | 22:20 | |
openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard-webclient master: Add page size of 1000 to preferences https://review.openstack.org/604437 | 22:20 |
*** markvoelker has joined #openstack-infra | 22:20 | |
*** slaweq has quit IRC | 22:26 | |
*** wolverineav has quit IRC | 22:27 | |
*** wolverineav has joined #openstack-infra | 22:28 | |
clarkb | infra-root https://review.openstack.org/#/c/635901/ is a role cleanup in ozj (role moved to opendev/base-jobs) and passes tests now. Thanks ianw for the recheck | 22:29 |
*** wolverineav has quit IRC | 22:31 | |
*** wolverineav has joined #openstack-infra | 22:31 | |
clarkb | also can someone else review https://review.openstack.org/#/c/636208/ as it fixes issues with tests on my other change that needed rebasing | 22:33 |
*** whoami-rajat has quit IRC | 22:33 | |
*** ijw has joined #openstack-infra | 22:36 | |
*** jamesmcarthur has joined #openstack-infra | 22:41 | |
*** jamesmcarthur has quit IRC | 22:45 | |
*** mkarray has quit IRC | 22:50 | |
*** sdake has quit IRC | 22:51 | |
openstackgerrit | Merged opendev/base-jobs master: Fix tests - Add bindep.txt tec https://review.openstack.org/636208 | 22:52 |
*** sdake has joined #openstack-infra | 22:56 | |
*** tkajinam has joined #openstack-infra | 22:57 | |
*** wolverineav has quit IRC | 22:58 | |
*** sdake has quit IRC | 22:59 | |
*** wolverineav has joined #openstack-infra | 22:59 | |
*** wolverineav has quit IRC | 23:01 | |
*** wolverineav has joined #openstack-infra | 23:01 | |
clarkb | https://review.openstack.org/#/c/635906/ passes tests now and adds the swift logging base test job to opendev/base-jobs | 23:06 |
clarkb | corvus: ^ I know you asked to add that back in | 23:06 |
*** sdake has joined #openstack-infra | 23:06 | |
*** ijw has quit IRC | 23:07 | |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove configure-unbound role https://review.openstack.org/635901 | 23:09 |
*** rascasoft has quit IRC | 23:10 | |
*** gcutrini has joined #openstack-infra | 23:14 | |
corvus | clarkb: want to restart zuul now? | 23:16 |
clarkb | corvus: sure. Give me a second to figure out how to set LD_PRELOAD on ze08's executor | 23:16 |
corvus | clarkb: ok. i'll add ze08 to emergency and prep for shutdown | 23:16 |
clarkb | corvus: thanks | 23:17 |
clarkb | export LD_PRELOAD /usr/lib/x86_64-linux-gnu/libjemalloc.so.1 in /etc/default/zuul-executor should do it I think | 23:18 |
clarkb | I'll add that to the file now, then you can restart normally | 23:19 |
openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Add documentation for private stories https://review.openstack.org/636235 | 23:19 |
clarkb | er needs an = between the two clumps of words but ya | 23:19 |
corvus | clarkb: well, it won't be completely normal, because it'll still be in disabled. but that should work. i'll handle the restart of ze08 with the rest. | 23:19 |
corvus | or, i reckon i can modify the playbook for this :) | 23:20 |
clarkb | corvus: ok default file is written so you should be good to go whenever ready | 23:20 |
clarkb | and I'm on deck if you need an extra set of hands | 23:20 |
corvus | ok. starting now | 23:20 |
corvus | #status log restarted all of zuul with git sha 5957d7a95e677116f39e52c2a44d4ca8b795da34; ze08 is in the disabled list and configured to use jemalloc | 23:21 |
openstackstatus | corvus: finished logging | 23:21 |
clarkb | I'm guessing that was a pre log item and that the restarts are actually still in progress | 23:24 |
corvus | ya | 23:24 |
corvus | well, it was after the stop and before the start at least. | 23:25 |
corvus | we're currently waiting on executors to stop | 23:25 |
corvus | oh neat. the scheduler bombed. | 23:25 |
clarkb | yay? | 23:26 |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add more whitespace to zuul tenant config https://review.openstack.org/636237 | 23:28 |
corvus | that's in place manually on the scheduler | 23:28 |
corvus | which is now starting | 23:29 |
clarkb | I've approved the change | 23:29 |
*** sdake has quit IRC | 23:31 | |
*** gcutrini has quit IRC | 23:31 | |
corvus | zuul is back up, re-enqueueing | 23:32 |
clarkb | I've double checked /proc for the running zuul-executor on ze08 and the LD_PRELOAD setting is present | 23:33 |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add zuul-preview project https://review.openstack.org/636238 | 23:35 |
corvus | re-enqueue complete | 23:39 |
*** jistr_ has joined #openstack-infra | 23:39 | |
*** dtantsur has joined #openstack-infra | 23:39 | |
clarkb | ze08 is using less memory than ze05. I've not done a broad check simply because we need longer term data than me quickly checking output of free | 23:40 |
clarkb | but at least we don't have evidence of it doing the wrong thing immediately | 23:40 |
*** hwoarang_ has joined #openstack-infra | 23:40 | |
*** kjackal_v2 has joined #openstack-infra | 23:40 | |
corvus | that is a good sanity check | 23:43 |
corvus | yay https://insecure-ci-registry.opendev.org:5000/ works | 23:43 |
clarkb | corvus: you got a successful zuul_return? | 23:44 |
corvus | no, i just mean the server is up | 23:44 |
clarkb | ah | 23:44 |
corvus | next is merging https://review.openstack.org/634829 | 23:44 |
*** stephenfin_ has joined #openstack-infra | 23:45 | |
corvus | (which is ready to go now) | 23:45 |
*** hemna_ has joined #openstack-infra | 23:45 | |
corvus | the test failure is just the thing that 636189 fixes | 23:46 |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 23:46 |
*** hwoarang has quit IRC | 23:46 | |
*** kjackal has quit IRC | 23:46 | |
*** dtantsur|afk has quit IRC | 23:46 | |
*** jistr has quit IRC | 23:46 | |
*** icey has quit IRC | 23:46 | |
*** mrhillsman has quit IRC | 23:46 | |
*** mnasiadka has quit IRC | 23:46 | |
*** hemna has quit IRC | 23:46 | |
*** csatari has quit IRC | 23:46 | |
*** davidlenwell has quit IRC | 23:46 | |
*** TheJulia has quit IRC | 23:46 | |
*** sweston has quit IRC | 23:46 | |
*** phausman has quit IRC | 23:46 | |
*** stephenfin has quit IRC | 23:46 | |
*** coreycb has quit IRC | 23:46 | |
clarkb | hogepodge: do you know if OSH jobs use a local caching proxy? There are pip install errors I'm skimming through and from OSH jobs is ProxyError Cannot connect to proxy when pip installing docker | 23:51 |
clarkb | (apparently docker is a valid pypi package) | 23:51 |
corvus | (i think the ansible docker module uses the docker python module to docker docker docker docker) | 23:52 |
openstackgerrit | Merged openstack-infra/project-config master: Add more whitespace to zuul tenant config https://review.openstack.org/636237 | 23:52 |
clarkb | OSA jobs fail to install heat using what appears to be a local mirror (not the region local mirror but a job local mirror?) | 23:54 |
clarkb | I think (based on skimming of job logs) that infra is mostly in the clear for those particular pip failures to find distributions | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!