Tuesday, 2019-03-12

openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044500:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429800:00
*** rascasoft has quit IRC00:00
*** dsneddon has joined #tripleo00:02
*** dsneddon has quit IRC00:06
*** rlandy has quit IRC00:20
*** gfidente|afk has quit IRC00:22
*** vinaykns has joined #tripleo00:33
*** dsneddon has joined #tripleo00:35
*** vinaykns has quit IRC00:39
*** mcornea has quit IRC00:47
*** dsneddon has quit IRC00:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Manage system timezone with ansible  https://review.openstack.org/64258900:54
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Manage system timezone with ansible  https://review.openstack.org/64258900:56
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Rename docker_puppet_apply to container_puppet_apply  https://review.openstack.org/64205300:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Rename docker_puppet_apply to container_puppet_apply  https://review.openstack.org/64205300:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Move Designate to Experimental  https://review.openstack.org/64049500:58
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Switch ContainerCli to podman by default  https://review.openstack.org/64089900:59
*** ade_lee has joined #tripleo01:02
*** agopi has quit IRC01:04
openstackgerritMerged openstack/tripleo-heat-templates master: Remove Congress  https://review.openstack.org/64019301:05
openstackgerritMerged openstack-infra/tripleo-ci master: Create two loop devices for bluestore and filestore  https://review.openstack.org/64147901:11
openstackgerritMerged openstack/tripleo-heat-templates master: Refactored configuration options for nova/neutron in manila  https://review.openstack.org/64143601:11
*** dsneddon has joined #tripleo01:15
*** wolverineav has quit IRC01:18
*** wolverineav has joined #tripleo01:18
*** wolverineav has quit IRC01:23
*** itlinux has joined #tripleo01:24
*** dsneddon has quit IRC01:28
*** aedc has quit IRC01:32
*** wolverineav has joined #tripleo01:33
*** wolverineav has quit IRC01:33
*** rascasoft has joined #tripleo01:36
*** dsneddon has joined #tripleo01:39
*** rascasoft has quit IRC01:44
*** itlinux has quit IRC01:51
*** dsneddon has quit IRC01:55
*** dsneddon has joined #tripleo02:00
openstackgerritMerged openstack/tripleo-heat-templates master: Drop unused parameters  https://review.openstack.org/64165402:06
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: clean up reproducer files  https://review.openstack.org/64257802:17
*** openstackstatus has quit IRC02:22
*** openstack has joined #tripleo02:23
*** ChanServ sets mode: +o openstack02:23
*** openstackstatus has joined #tripleo02:24
*** ChanServ sets mode: +v openstackstatus02:24
*** wolverineav has joined #tripleo02:59
*** rascasoft has joined #tripleo03:00
*** dsneddon has quit IRC03:05
*** agopi has joined #tripleo03:06
*** rascasoft has quit IRC03:10
*** apetrich has quit IRC03:16
*** saneax has joined #tripleo03:18
*** dsneddon has joined #tripleo03:23
*** dsneddon has quit IRC03:28
*** dsneddon has joined #tripleo03:32
*** dsneddon has quit IRC03:37
*** ykarel|away has joined #tripleo03:39
*** ykarel|away is now known as ykarel03:39
*** udesale has joined #tripleo03:49
*** rh-jelabarre has quit IRC03:51
*** saneax has quit IRC03:51
*** skramaja has joined #tripleo03:52
*** dsneddon has joined #tripleo03:56
*** skramaja has quit IRC03:56
*** skramaja has joined #tripleo03:57
*** ramishra has joined #tripleo04:02
openstackgerritMerged openstack/tripleo-heat-templates master: Disable TripleO UI service  https://review.openstack.org/64174304:29
openstackgerritMerged openstack/python-tripleoclient master: Mark enable_ui as deprecated  https://review.openstack.org/64174404:30
openstackgerritMerged openstack/puppet-tripleo master: Fix kolla permissions errors inside nova_virtlogd  https://review.openstack.org/64254904:33
*** janki has joined #tripleo04:38
*** rascasoft has joined #tripleo04:41
*** udesale has quit IRC04:45
*** udesale has joined #tripleo04:46
*** rascasoft has quit IRC04:49
*** wolverineav has quit IRC05:00
*** wolverineav has joined #tripleo05:01
*** dsneddon has quit IRC05:05
*** marios has joined #tripleo05:10
*** wolverineav has quit IRC05:17
*** wolverineav has joined #tripleo05:18
*** wolverineav has quit IRC05:22
*** wolverineav has joined #tripleo05:25
*** wolverineav has quit IRC05:30
*** wolverineav has joined #tripleo05:32
*** pdeore has joined #tripleo05:33
*** dsneddon has joined #tripleo05:35
openstackgerritMerged openstack/tripleo-heat-templates master: Copy tripleo-admin key to mistral home directory  https://review.openstack.org/63832205:37
*** dsneddon has quit IRC05:39
*** wolverineav has quit IRC05:40
*** ykarel is now known as ykarel|afk05:40
*** dsneddon has joined #tripleo05:42
*** jtomasek has joined #tripleo05:59
*** rf0lc0 has joined #tripleo06:00
*** slaweq_ has joined #tripleo06:01
*** ykarel|afk is now known as ykarel06:01
*** Hobbestigrou has quit IRC06:03
*** PhilSliderS has quit IRC06:03
*** wolverineav has joined #tripleo06:04
*** wolverineav has quit IRC06:04
*** jbadiapa has quit IRC06:05
*** Hobbestigrou has joined #tripleo06:05
*** slaweq has quit IRC06:07
*** rfolco|ruck|off has quit IRC06:07
*** PhilSliderS has joined #tripleo06:09
*** andreaf has quit IRC06:09
*** flaper87 has quit IRC06:10
*** panda|rover|off has quit IRC06:10
*** gpocentek has quit IRC06:10
*** andreaf has joined #tripleo06:12
*** panda has joined #tripleo06:12
*** gpocentek has joined #tripleo06:13
*** flaper87 has joined #tripleo06:13
*** wolverineav has joined #tripleo06:14
*** dr_gogeta86 has quit IRC06:16
*** rascasoft has joined #tripleo06:19
*** wolverineav has quit IRC06:32
*** rascasoft has quit IRC06:32
*** ksambor has joined #tripleo06:37
*** saneax has joined #tripleo06:49
*** paramite has joined #tripleo07:00
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Fix typo in the retagging for periodic containers build job  https://review.openstack.org/64266207:07
mariosykarel: panda fyi ^07:08
ykarelmarios, good to check built_images and fix that together with ^^07:08
mariosjaosorior: if you're around typo please ^07:08
mariosykarel: ack but problem is the retag happens only in periodic07:09
mariosykarel: cos the conditional is if periodic in zuul pipeline07:09
ykarelmarios, you can try with testproject07:09
mariosykarel: ah yeah good idea lets run in check there07:09
mariosykarel: https://review.rdoproject.org/r/1913107:11
ykarelmarios, ^^ will not run07:12
ykareltagging07:12
mariosykarel: yeah have to simulate periodic right07:12
mariosykarel: sec07:12
*** apetrich has joined #tripleo07:13
ykarelmarios, need to tweak:- https://review.openstack.org/#/c/642662/1/playbooks/tripleo-buildcontainers/run.yaml@8907:13
mariosykarel: yah i'll post something on top to do that (if you mean for simulate periodic)07:13
ykarelmarios, yes07:14
mariosykarel: ack sec07:14
ykarelmarios, also remove jobs from zuul.d to avoid running unnecessary job in test patch of openstack-infra/tripleo-ci to save some ci resrouces07:14
*** yprokule has joined #tripleo07:15
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: DO NOT MERGE testing https://review.openstack.org/642662  https://review.openstack.org/64266307:17
mariosykarel: ^^ & updated the testproject to depende on ^07:18
ykarelmarios, ack now you can request to hold the node for job to debug built_images quickly07:18
mariosykarel: how/who07:19
ykarelmarios, ask tristanC on #rdo07:19
ykarelhe will help07:19
mariosykarel: ack thanks will do in a sec07:19
*** florianf has joined #tripleo07:19
*** hberaud|gone has quit IRC07:20
*** dsneddon has quit IRC07:22
*** rascasoft has joined #tripleo07:23
*** hberaud has joined #tripleo07:23
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: DO NOT MERGE testing https://review.openstack.org/642662  https://review.openstack.org/64266307:26
*** avivgt has quit IRC07:27
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: DO NOT MERGE testing https://review.openstack.org/642662  https://review.openstack.org/64266307:28
mariosykarel: hoping this should tell us too maybe we don't need the hold? https://review.openstack.org/#/c/642663/3/playbooks/tripleo-buildcontainers/run.yaml@9707:29
ykarelmarios, yup but in case it's blank and want to know why you need to reproduce07:30
mariosykarel: ack will try rdo in a sec wondering if its still early for central eu07:31
mariosthanks for looking jaosorior07:31
*** pcaruana has joined #tripleo07:39
*** owalsh has quit IRC07:39
*** pcaruana has quit IRC07:43
*** pcaruana has joined #tripleo07:43
*** moguimar has quit IRC07:46
*** avivgt has joined #tripleo07:46
*** moguimar has joined #tripleo07:47
*** dsneddon has joined #tripleo07:49
*** ykarel is now known as ykarel|lunch07:52
*** kopecmartin|off is now known as kopecmartin07:53
*** dsneddon has quit IRC07:54
*** jbadiapa has joined #tripleo07:54
*** wolverineav has joined #tripleo07:55
*** wolverineav has quit IRC07:59
*** rpittau|afk is now known as rpittau07:59
Tenguhello there08:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429808:00
*** tkajinam has quit IRC08:07
*** jfrancoa has joined #tripleo08:07
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Add testrepository.subunit file to root dir  https://review.openstack.org/64164108:09
*** rbrady has joined #tripleo08:09
*** holser_ has joined #tripleo08:10
*** threestrands_ has quit IRC08:11
*** aufi has joined #tripleo08:12
*** ykarel|lunch is now known as ykarel08:20
*** cylopez has joined #tripleo08:20
*** ccamacho has joined #tripleo08:21
*** cylopez has quit IRC08:26
*** cylopez has joined #tripleo08:28
*** dsneddon has joined #tripleo08:29
*** chem has joined #tripleo08:29
TenguFolks, PTAL ? https://review.openstack.org/#/c/641608/  would be great to get it merged :).08:32
*** xek has joined #tripleo08:34
*** iurygregory has joined #tripleo08:35
*** amoralej|off is now known as amoralej08:36
*** moguimar is now known as moisa08:36
*** jschlueter has quit IRC08:39
*** jschlueter has joined #tripleo08:40
*** jpena|off is now known as jpena08:44
*** bogdando has joined #tripleo08:46
*** morazi has joined #tripleo08:49
*** morazi has quit IRC08:49
*** morazi has joined #tripleo08:49
*** dtantsur|afk is now known as dtantsur08:52
*** jpich has joined #tripleo09:01
*** suuuper has joined #tripleo09:03
*** iurygregory has quit IRC09:06
*** dmacpher has joined #tripleo09:07
sshnaidmjaosorior, fyi: https://bugs.launchpad.net/tripleo/+bug/181960309:16
openstackLaunchpad bug 1819603 in tripleo "All TLS jobs fails to install overcloud with error: resources.ServiceServerMetadataHook: u'type'" [Critical,Triaged]09:16
bandinimwhahaha, EmilienM: https://review.openstack.org/#/c/642495/ i'll let you guys merge it when you get online09:23
*** iurygregory has joined #tripleo09:32
*** rf0lc0 is now known as rfolco|ruck09:34
*** derekh has joined #tripleo09:34
*** dsneddon has quit IRC09:35
*** florianf has quit IRC09:38
*** tosky has joined #tripleo09:44
*** gfidente has joined #tripleo09:45
*** florianf has joined #tripleo09:45
jaosoriorsshnaidm: yeah; I have a fix already, but needed ovb to be fixed first09:57
jaosoriorsshnaidm: https://review.openstack.org/#/c/640948/09:57
jaosorioroh, wrong patch09:57
jaosoriorit's this one https://review.openstack.org/#/c/640944/09:57
sshnaidmjaosorior, was the breakage from tht repo?09:59
jaosoriorsshnaidm: yeah, the breakage happened because of the flattening of the redis template.10:00
jaosoriorsshnaidm: however, OVB had been broken for other reasons; so I wanted those to get fixed first before merging this fix.10:00
*** dsneddon has joined #tripleo10:01
*** dsneddon has quit IRC10:06
sshnaidmjaosorior, I see10:08
*** owalsh has joined #tripleo10:14
*** brault has joined #tripleo10:16
*** michchap has joined #tripleo10:16
openstackgerritSaravanan KR proposed openstack/tripleo-common master: Create individual logs for each ansible run for better debugging  https://review.openstack.org/64271210:19
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Add timestamp to containers' build log  https://review.openstack.org/63908910:21
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Add testrepository.subunit file to root dir  https://review.openstack.org/64164110:22
*** panda is now known as panda|rover10:22
*** skramaja has quit IRC10:25
openstackgerritRafael Folco proposed openstack/tripleo-quickstart-extras master: Improve warning message on docker group issue  https://review.openstack.org/64180810:25
*** iurygregory has quit IRC10:29
*** iurygregory has joined #tripleo10:29
paramiteHey guys, how can I load mistral workbook from file? I modified one workbook in tripleo common, but it seems that mistral keeps the old one in memory.10:30
d0ugalparamite: With the `mistral workbook-update` command10:30
paramited0ugal, thx a lot10:31
*** dsneddon has joined #tripleo10:34
*** dsneddon has quit IRC10:39
*** ykarel is now known as ykarel|lunch10:40
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix idempotency for horizon container logs  https://review.openstack.org/64271710:43
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/queens: Fix idempotency for horizon container logs  https://review.openstack.org/64271810:44
bogdandojaosorior: the best ninja-core ever. thanks10:46
jaosoriorbogdando: thanks for the commit :)10:46
*** hberaud is now known as hberaud|lunch10:51
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Fix undercloud backup via tripleoclient  https://review.openstack.org/64034410:59
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Enable mistral_executor to perform backups  https://review.openstack.org/64003811:00
*** dsneddon has joined #tripleo11:04
*** pdeore has quit IRC11:06
*** ykarel|lunch is now known as ykarel11:07
*** dsneddon has quit IRC11:10
*** chkumar|pto is now known as chandankumar11:11
*** dprince has joined #tripleo11:12
*** waleedm has joined #tripleo11:19
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Fix retag with trileo-ci-testing for periodic containers build job  https://review.openstack.org/64266211:30
*** chandankumar is now known as chkumar24611:35
*** aedc has joined #tripleo11:37
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Fix retag with trileo-ci-testing for periodic containers build job  https://review.openstack.org/64266211:39
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: DO NOT MERGE testing https://review.openstack.org/642662  https://review.openstack.org/64266311:39
*** dsneddon has joined #tripleo11:39
*** dprince has quit IRC11:42
*** dsneddon has quit IRC11:44
*** pdeore has joined #tripleo11:49
*** pdeore has quit IRC11:49
*** owalsh has quit IRC11:50
*** chem has quit IRC11:51
*** owalsh has joined #tripleo11:52
*** abishop has joined #tripleo11:53
*** rh-jelabarre has joined #tripleo11:53
panda|roverderekh: I was looking at scenarios, and the sceanrio006 looked a lot like scenario012. I see that in scenario012 we are configuring pacemaker. Did we need both scena006 and scen012 ?11:53
panda|roverderekh: I will probably need help to fix the scen012 standalone ...11:53
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Include docker.yaml before docker-ha.yaml  https://review.openstack.org/64158911:55
*** jpena is now known as jpena|lunch11:56
*** owalsh has quit IRC11:56
*** owalsh has joined #tripleo11:57
*** dsneddon has joined #tripleo12:01
*** rlandy has joined #tripleo12:01
openstackgerritMerged openstack/tripleo-docs master: Add os_tempest documentation  https://review.openstack.org/64085912:02
*** iurygregory has quit IRC12:03
*** iurygregory has joined #tripleo12:03
*** dsneddon has quit IRC12:05
*** owalsh has quit IRC12:06
*** hberaud|lunch is now known as hberaud12:07
*** owalsh has joined #tripleo12:07
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Fix retag with trileo-ci-testing for periodic containers build job  https://review.openstack.org/64266212:09
*** trown|outtypewww is now known as trown12:10
*** aufi has quit IRC12:11
*** aufi has joined #tripleo12:11
EmilienMpanda|rover: are you actually working on https://bugs.launchpad.net/tripleo/+bug/1819632 ? or can I take over?12:12
openstackLaunchpad bug 1819632 in tripleo "[gate] Error pulling image: invalid character '<' parsing 404 response" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)12:12
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Fix retag with trileo-ci-testing for periodic containers build job  https://review.openstack.org/64266212:12
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: DO NOT MERGE testing https://review.openstack.org/642662  https://review.openstack.org/64266312:12
mariospanda|rover: ^12:12
derekhpanda|rover: I wouldn't be surprised if you could just delete 006 iirc it was for a CI job that never merged, I've never heard of anybody using it,12:13
panda|roverEmilienM: go ahead, standard procedure to assign the bug to the rover12:13
EmilienMrfolco|ruck, panda|rover : also closed https://bugs.launchpad.net/tripleo/+bug/1819631, duplicate of https://bugs.launchpad.net/tripleo/+bug/181963212:13
openstackLaunchpad bug 1819632 in tripleo "duplicate for #1819631 [gate] Error pulling image: invalid character '<' parsing 404 response" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)12:13
openstackLaunchpad bug 1819632 in tripleo "[gate] Error pulling image: invalid character '<' parsing 404 response" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)12:13
*** jpich has quit IRC12:14
panda|roverEmilienM: my job would the be to poke people that can solve itm if I can't by myself12:14
derekhpanda|rover: is the problem it scenario012 something to do with netansible switching to ovn (from ovs?), I believe jlibosva was looking into it, he isn't on at the moment though12:14
EmilienMpanda|rover: ok so i'm taking over the bug and will investigate12:14
EmilienMpanda|rover: do we have high rate of failure due to this bug in the gate?12:15
rfolco|ruckEmilienM, thanks for looking at this. I guessed these were pretty much the same, wasn't sure.12:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Manage system timezone with ansible  https://review.openstack.org/64258912:15
EmilienMrfolco|ruck: no problem at all12:15
panda|roverEmilienM: I see a single hit at the moment for that bug12:16
*** jpich has joined #tripleo12:17
EmilienMpanda|rover: ok good. That gives me some time then.12:17
panda|roverderekh: yep it probably is, I was contacted by jakub, but wasn't able to offer much help there, I'll investigate a bit more and continue to work with him then.12:18
*** mcornea has joined #tripleo12:18
panda|roverderekh: and probably remove 006 at this point , thanks.12:18
*** owalsh has quit IRC12:18
derekhpanda|rover: ok, if ye have a env up I'm happy to help debug it just let me know, but I don't know anything about the change to ovn expect that I know its a thing that happened12:20
panda|roverderekh: ack, thanks.12:21
*** owalsh has joined #tripleo12:21
*** panda|rover is now known as panda|rover|lunc12:21
*** bfournie has quit IRC12:23
*** toure has joined #tripleo12:29
*** raildo has joined #tripleo12:29
*** ade_lee has quit IRC12:32
*** dsneddon has joined #tripleo12:33
*** chem has joined #tripleo12:33
paramited0ugal, can I please bother you a bit more regarding mistral?12:35
d0ugalparamite: ask away - I am just going to get lunch, but I'll reply when I get back. apetrich might be faster :)12:37
*** dsneddon has quit IRC12:39
*** iurygregory has quit IRC12:39
*** mjturek has joined #tripleo12:40
*** iurygregory has joined #tripleo12:40
*** jaosorior has quit IRC12:43
paramited0ugal, ok thanks, so I've added parameter in mistral workbook in tripleo common and updated it as you suggested, I've also modified the relevant python action in tripleo common both on undercloud and in mistral_executer container, but running the workflow it fails with unexpected parameter for action: http://paste.openstack.org/show/747605/  ... I've tried to mistral action-update, but that apparently does not expect python source code12:43
paramiteapetrich, ^12:43
apetrichparamite, looking12:44
paramiteapetrich, thx12:44
*** mjturek has quit IRC12:45
apetrichparamite, do you have a gerrit patch for me to look at too?12:45
paramiteapetrich, yup: https://review.openstack.org/#/c/64034412:45
apetrichcheers12:46
apetrichparamite, just a silly question are you coding and testing it on a instance or are you deploying with the patch. I mean stuff like have you restarted the services and updated the workflow definitions12:49
*** udesale has quit IRC12:50
*** udesale has joined #tripleo12:51
paramiteapetrich, so I deployed undercloud with the THT patch, but kolla patch and tripleo-common patch I applied manually12:51
*** ansmith has joined #tripleo12:52
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Add testrepository.subunit file to root dir  https://review.openstack.org/64164112:56
apetrichparamite, could you do a mistral workbook-get-definition tripleo.undercloud_backup.v112:57
*** bfournie has joined #tripleo12:57
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: [WIP] Fix the copy of tempest directories  https://review.openstack.org/64242012:57
apetrichparamite, or tripleo.undercloud_backup.v1.backup12:57
apetrichnot sure which12:57
paramiteapetrich, sure12:58
apetrichparamite, I think the workflow definition in the database might be old12:58
*** janki has quit IRC12:59
*** janki has joined #tripleo12:59
paramiteapetrich, http://paste.openstack.org/show/747608/13:00
paramiteapetrich, I've run mistral workbook-update before13:00
apetrichparamite, dang. that would be the easy error. still looking then13:00
*** jpena|lunch is now known as jpena13:00
apetrichparamite, cheers13:00
paramiteapetrich, do you want access to my env>13:00
paramite?13:01
*** owalsh has quit IRC13:01
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: tripleo-container-image-prepare/logging: fix exception formating  https://review.openstack.org/64274113:01
*** owalsh has joined #tripleo13:02
*** slaweq_ is now known as slaweq13:08
apetrichparamite, maybe. Let me just finish what I'm doing then I can focus on that.13:10
*** owalsh has quit IRC13:10
paramiteapetrich, ack13:11
*** panda|rover|lunc is now known as panda|rover13:12
*** gfidente has quit IRC13:13
EmilienMpanda|rover, rfolco|ruck : I sent https://review.openstack.org/#/c/642741 - until this is landed and the bug happens again, I suspect I'll have a hard time to find out what the exact trace was exactly. I'll still investigate the 401, which I think is part of the root cause.13:15
*** jaosorior has joined #tripleo13:15
*** dsneddon has joined #tripleo13:15
*** owalsh has joined #tripleo13:15
rfolco|ruckEmilienM, ack13:17
*** ade_lee has joined #tripleo13:19
*** owalsh has quit IRC13:19
*** dsneddon has quit IRC13:20
*** owalsh has joined #tripleo13:20
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: clean up base log dir  https://review.openstack.org/64258313:24
*** iurygregory has quit IRC13:24
*** dsneddon has joined #tripleo13:25
*** irclogbot_3 has quit IRC13:26
Tenguflorianf: jfrancoa ccamacho dpeacock mtg in 2 minutes :)13:28
*** irclogbot_3 has joined #tripleo13:29
*** dsneddon has quit IRC13:32
larsksI'm seeing some timeouts in tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (and other RDO tests).  I don't believe these are related to the change on which they're failing. Is RDO CI healthy?13:33
jaosoriorlarsks: it isn't :(13:33
larsksjaosorior: thanks. darn.  So I should just wait for now?13:34
jaosorioryeah :/13:34
*** tzumainn has joined #tripleo13:34
apetrichparamite, sorry for the delay. Still having the issue?13:37
openstackgerritRonelle Landy proposed openstack/tripleo-heat-templates stable/rocky: DNM - testing rocky branch change  https://review.openstack.org/64275113:40
openstackgerritMerged openstack/tripleo-heat-templates master: Deploy Sahara with unversioned endpoints  https://review.openstack.org/58389013:46
openstackgerritMerged openstack/os-net-config stable/queens: Configure switchdev mode in SR-IOV in os-net-config  https://review.openstack.org/64214713:46
openstackgerritMerged openstack/tripleo-heat-templates master: Install and configure tmpwatch for log cleanup  https://review.openstack.org/64160813:46
openstackgerritMerged openstack/tripleo-heat-templates master: Set setype on etcd's service directory  https://review.openstack.org/64177213:47
TenguFolks, now that my work on tmpwatch has been merged, can we get that one last merged as well? :) https://review.openstack.org/#/c/616945/13:48
Tengubogdando: -^^ please transform your +1 in +2 :)13:49
Tenguoh.13:49
Tenguwait13:49
Tenguwtf13:49
bogdandoрьь13:50
bogdandohmmm13:50
*** owalsh has quit IRC13:50
Tenguhave to dig in the CI logs13:50
Tengudidn't see zuul was sad13:50
paramiteapetrich, yes, I did not figure it out still13:51
*** lennyb has quit IRC13:51
apetrichparamite, no worries. Could I have access to the env?13:51
Tenguah, ok, yeah. thought I had that corrected already.13:51
paramiteapetrich, sure, just give me ssh key13:52
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates stable/queens: Switch scenario004-multinode-containers to Ceph filestore  https://review.openstack.org/64275413:52
Tengubogdando: was the other patch it depended on. should be OK now in fact. Just running a recheck.13:53
bogdandook13:53
apetrichparamite, https://github.com/frac.keys the last one is enough13:54
d0ugalapetrich, paramite: did you manage to figure it out? or can I help somehow?13:54
*** jbadiapa has quit IRC13:55
d0ugaloh, /me just seen the last few messages.13:55
apetrichd0ugal, so the workflow definition is right on the database13:55
d0ugalright13:55
fultonjksambor: any update on https://bugs.launchpad.net/tripleo/+bug/1818161 ?13:55
openstackLaunchpad bug 1818161 in tripleo "podman pull centos-binary-ovn-sb-db-server fails in CI" [High,In progress] - Assigned to Kamil Sambor (ksambor)13:55
d0ugalapetrich: What is the problem or what isn't working?13:55
apetrichd0ugal, there's an extra parameter to the python action that mistral is not recognizing13:56
*** dsneddon has joined #tripleo13:56
*** owalsh has joined #tripleo13:56
apetrichd0ugal, what I think it might be is the workflow is right but the python action might be old :questionmark:13:56
d0ugalapetrich: Makes sense.13:56
d0ugalparamite: So you updated one of the Python actions? That change needs to be applied to the Mistral container.13:57
paramited0ugal, yup, I've put my paranoid hat on and updated it on all mistral containers running on undercloud13:57
paramited0ugal, and also on undercloud itself ... to be sure :)13:58
d0ugalparamite: Have you run "sudo mistral-db-manage populate"?13:58
d0ugalparamite: Mistral inspects the Python actions to see what args they accept13:59
*** openstack has joined #tripleo15:38
*** ChanServ sets mode: +o openstack15:38
*** openstackstatus has joined #tripleo15:39
*** ChanServ sets mode: +v openstackstatus15:39
*** dsneddon has joined #tripleo15:41
*** jbadiapa has quit IRC15:41
*** cylopez has quit IRC15:44
*** jchhatbar has quit IRC15:47
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Run unused packages in system_upgrade_prepare step.  https://review.openstack.org/64280015:50
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Remove retag tripleo-ci-testing for periodic containers build job  https://review.openstack.org/64266215:54
mariosweshay: panda|rover rfolco|ruck ^15:54
openstackgerritMerged openstack/tripleo-heat-templates master: Fix metadata_settings for redis  https://review.openstack.org/64094415:56
rfolco|ruckmarios, retag affects centos jobs ? not understanding this15:59
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429816:00
mariosrfolco|ruck: the rdo kolla build job was tagging containers with both 'tripleo-ci-testing' and the tripleo-ci-testing delorean repo hash16:00
mariosrfolco|ruck: here we are now only tagging with the hash, cos as discussed in the community call the periodics are using the hash anyway and not 'tripleo-ci-testing'16:01
rfolco|ruckmarios, bug https://bugs.launchpad.net/tripleo/+bug/1818994 applies for centos jobs... and you have a if 'periodic' condition in the retag that was removed16:01
openstackLaunchpad bug 1818994 in tripleo "ovb jobs broken because pacemaker is unconfigured" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)16:01
mariosrfolco|ruck: assuming that's the case we don't need to re-tag then we can just remove it altogether16:01
mariosrfolco|ruck: well it would apply to periodic jobs not only centos f28 is pushing using the tripleo-ci-testing repo hash16:03
mariosrfolco|ruck: because of https://github.com/openstack-infra/tripleo-ci/blob/668c03178df892055d3d30dde1c04b5d50883f90/playbooks/tripleo-buildcontainers/templates/kolla-build.conf.j2#L516:03
rfolco|ruckmarios, I see... centos build containers push... got it16:03
mariosrfolco|ruck: https://github.com/openstack-infra/tripleo-ci/blob/668c03178df892055d3d30dde1c04b5d50883f90/playbooks/tripleo-buildcontainers/run.yaml#L15-L2316:03
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Run unused packages in system_upgrade_prepare step.  https://review.openstack.org/64280016:03
rfolco|ruckmarios, thanks for your patience in explaining me.16:03
mariosrfolco|ruck: np man thanks for asking16:04
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Run unused packages in system_upgrade_prepare step.  https://review.openstack.org/64280016:06
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Manage system timezone with ansible  https://review.openstack.org/64258916:08
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Run unused packages in system_upgrade_prepare step.  https://review.openstack.org/64280016:09
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Use Docker v2 registry mirrors from Opendev infra  https://review.openstack.org/64280816:11
*** aufi has quit IRC16:15
*** yprokule has quit IRC16:15
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Use Docker v2 registry mirrors from Opendev infra  https://review.openstack.org/64280816:17
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates stable/rocky: Refactored configuration options for nova/neutron in manila  https://review.openstack.org/64281016:18
*** weshay is now known as Dwight16:18
EmilienMweshay: what's up Dwight16:18
EmilienMlol16:18
*** Dwight is now known as DwightH16:18
*** DwightH is now known as weshay16:19
weshayhey fella's16:19
weshayya16:19
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates stable/rocky: Refactored configuration options for nova/neutron in manila  https://review.openstack.org/64281016:20
openstackgerritMerged openstack/puppet-tripleo master: certmonger: Add dnsnames parameter to redis cert request  https://review.openstack.org/64094816:22
*** agopi has joined #tripleo16:22
*** morazi has quit IRC16:27
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates stable/queens: Refactored configuration options for nova/neutron in manila  https://review.openstack.org/64281316:28
*** ccamacho has quit IRC16:29
*** dmacpher has quit IRC16:31
*** jfrancoa has quit IRC16:31
*** holser_ has quit IRC16:31
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: DNM: removing most upgrade tasks to test upgrade.  https://review.openstack.org/64281416:33
*** rbrady has quit IRC16:35
*** udesale has quit IRC16:37
*** chem has quit IRC16:38
openstackgerritMerged openstack/tripleo-heat-templates master: Rename docker_puppet_apply to container_puppet_apply  https://review.openstack.org/64205316:44
*** wolverineav has joined #tripleo16:45
*** wolverineav has quit IRC16:45
*** wolverineav has joined #tripleo16:45
*** wolverineav has quit IRC16:47
*** wolverineav has joined #tripleo16:48
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: [WIP] Fix the copy of tempest directories  https://review.openstack.org/64242016:55
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Switch to distro_python_version  https://review.openstack.org/64277216:56
*** ade_lee has quit IRC16:58
*** rpittau is now known as rpittau|afk16:59
panda|roverEmilienM: proposed https://review.rdoproject.org/r/19340 as a dependency for  https://review.openstack.org/642808, or rdo job will be broken.17:01
openstackgerritMerged openstack/paunch master: Delay check CI jobs until the pep8/unit passes..  https://review.openstack.org/64070317:03
*** d0ugal has quit IRC17:04
*** kopecmartin is now known as kopecmartin|off17:05
ksamborfultonj, yeah this is a fix should help: https://review.openstack.org/#/c/640716/17:11
openstackgerritTrevor Vardeman proposed openstack/tripleo-docs master: Added missing installation steps to overcloud validation  https://review.openstack.org/64282817:13
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Translating scenario010 to standalone  https://review.openstack.org/64171117:19
*** agurenko has quit IRC17:19
*** trown is now known as trown|lunch17:20
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: experiment w/ q35 for NovaHWMachineType  https://review.openstack.org/64254717:20
*** ansmith has quit IRC17:24
*** ansmith has joined #tripleo17:24
*** panda|rover is now known as panda|rover|off17:24
*** jpich has quit IRC17:26
*** gfidente is now known as gfidente|afk17:31
*** dtantsur is now known as dtantsur|afk17:39
*** thrash is now known as thrash|biab17:39
openstackgerritSorin Sbarnea proposed openstack/tripleo-heat-templates master: Fix NovaHWMachineType to be compatible with fedora  https://review.openstack.org/64244317:39
openstackgerritSorin Sbarnea proposed openstack/tripleo-heat-templates master: Make NovaHWMachineType use q35 arch  https://review.openstack.org/64283517:42
*** amoralej is now known as amoralej|off17:47
openstackgerritSorin Sbarnea proposed openstack/tripleo-heat-templates master: Make NovaHWMachineType use q35 arch  https://review.openstack.org/64283517:47
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Improve warning message on docker group issue  https://review.openstack.org/64180817:48
*** hberaud is now known as hberaud|gone17:52
*** bogdando has quit IRC17:52
EmilienMpanda|rover|off: ok cool17:53
*** brault has quit IRC17:54
*** derekh has quit IRC17:55
*** jbadiapa has joined #tripleo17:58
*** thrash|biab is now known as thrash18:02
*** dprince has joined #tripleo18:09
*** shardy has quit IRC18:09
*** d0ugal has joined #tripleo18:09
*** nkinder has quit IRC18:10
*** sshnaidm is now known as sshnaidm|afk18:11
*** ade_lee has joined #tripleo18:13
*** trown|lunch is now known as trown18:13
openstackgerritJohn Fulton proposed openstack/tripleo-quickstart-extras master: WIP/DNM: Add split-controlplane-standalone.yml playbook  https://review.openstack.org/61736818:19
openstackgerritJohn Fulton proposed openstack/tripleo-quickstart master: WIP/DNM: Add featureset 59 for split controlplane  https://review.openstack.org/61598718:20
openstackgerritBob Fournier proposed openstack/os-net-config stable/rocky: Fix os-net-config interface restarts when applying routes  https://review.openstack.org/64284718:22
openstackgerritJohn Fulton proposed openstack-infra/tripleo-ci master: WIP/DNM: Add split-controlplane standalone non-voting job definition  https://review.openstack.org/61598818:22
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: WIP delete overcloud_containers.yaml  https://review.openstack.org/60350518:26
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Make container list optional for builds  https://review.openstack.org/63984618:26
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: WIP delete overcloud_containers.yaml  https://review.openstack.org/60350518:27
openstackgerritLuke Short proposed openstack/tripleo-common stable/queens: Add ssh_network input  https://review.openstack.org/64109018:28
*** sudeepbatra has quit IRC18:36
*** suuuper has quit IRC18:36
*** pcaruana has quit IRC18:39
*** jpena is now known as jpena|off18:44
openstackgerritMerged openstack/tripleo-heat-templates master: Fix idempotency for horizon container logs  https://review.openstack.org/64271718:45
openstackgerritMerged openstack/puppet-tripleo stable/queens: Support cephfs_volume_mode parameter  https://review.openstack.org/64020318:45
openstackgerritMerged openstack/tripleo-heat-templates master: Update the min tox version to 2.0  https://review.openstack.org/63094518:45
openstackgerritMerged openstack/tripleo-common master: Update tox min version to 2.0  https://review.openstack.org/63094618:45
openstackgerritMerged openstack/tripleo-image-elements master: Update hacking version  https://review.openstack.org/63487418:45
openstackgerritMerged openstack/tripleo-common-tempest-plugin master: Drop py35 jobs  https://review.openstack.org/63964418:45
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list  https://review.openstack.org/60084318:46
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: clean up reproducer files  https://review.openstack.org/64257818:54
*** aedc has quit IRC18:59
*** aedc has joined #tripleo18:59
openstackgerritAlex Schultz proposed openstack/tripleo-common master: remove skydive-ansible from mistral container  https://review.openstack.org/63714419:08
*** wolverineav has quit IRC19:09
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list  https://review.openstack.org/60084319:11
openstackgerritMerged openstack/tripleo-common master: tripleo-container-image-prepare/logging: fix exception formating  https://review.openstack.org/64274119:13
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add testrepository.subunit file to root dir  https://review.openstack.org/64164119:13
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: update reproducer doc w/ command options  https://review.openstack.org/64286619:20
*** d0ugal has quit IRC19:23
*** wolverineav has joined #tripleo19:29
*** betherly has joined #tripleo19:32
*** wolverineav has quit IRC19:34
openstackgerritJon Schlueter proposed openstack/tripleo-common master: remove libvirt-daemon-driver-lxc  https://review.openstack.org/64287019:35
*** betherly has quit IRC19:37
openstackgerritMerged openstack/tripleo-heat-templates master: Delay check CI jobs until the pep8 passes..  https://review.openstack.org/64071219:55
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Use ansible virtual package  https://review.openstack.org/64287519:55
*** wolverineav has joined #tripleo20:02
*** wolverineav has quit IRC20:06
*** wolverineav has joined #tripleo20:06
*** gfidente|afk has quit IRC20:09
*** toure is now known as toure|gpne20:09
*** toure|gpne is now known as toure|gone20:10
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list  https://review.openstack.org/60084320:12
*** cylopez has joined #tripleo20:17
ade_leeweshay, in case you were wondering arxcruz is awesome20:22
*** cylopez has quit IRC20:22
arxcruz\o/20:22
ade_leeweshay, arxcruz helped get my novajoin tempest tests working -- even though its ridiculously late there20:23
weshayarxcruz++20:26
weshayarxcruz is awesome , I love that guy :)20:26
weshaythanks for letting me know ade_lee :) send him a redhat-reward20:26
arxcruzglad to help :)20:26
ade_leeweshay, ack -- on the way20:28
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the ovn service configurations  https://review.openstack.org/63911920:29
openstackgerritTrevor Vardeman proposed openstack/tripleo-docs master: Added missing installation steps to overcloud validation  https://review.openstack.org/64282820:31
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Fix: Unknown Property ML2HostConfigs  https://review.openstack.org/64288520:34
*** dprince has quit IRC20:34
*** Vorrtex has quit IRC20:36
*** agopi has quit IRC20:42
*** ade_lee has quit IRC20:43
*** fmount has quit IRC20:43
*** fmount has joined #tripleo20:44
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: DNM: Test debug mode for capturing trace on errors  https://review.openstack.org/64288820:46
*** chkumar246 is now known as chandankumar20:47
*** ansmith has quit IRC20:51
weshaymwhahaha heh.. ur right about maint..  https://github.com/openstack/tripleo-heat-templates/commit/836705161cfdd847c4ef0ff37f0e5708b520e763 broke fedora because we don't have a standard yum repo20:53
weshayhttps://trunk.rdoproject.org/fedora/stable-base/latest/Packages/20:53
weshaytmpwatch is not there20:53
weshayI'm still going to open a bug20:53
mwhahahafun20:53
weshaydang it20:53
mwhahahathat shouldn't be missing because it's required for the overcloud images20:53
mwhahahabut i guess we never built fedora overcloud images?20:53
weshaynot needed20:54
weshayfor standalone20:54
weshayonly20:54
mwhahaharight but that also means we don't actually do that build process20:54
weshayya20:54
mwhahahaso we don't have a python3 overcloud image build job20:54
weshayright20:54
* weshay waits for RHEL20:54
*** mjturek has quit IRC20:57
weshaymwhahaha do you want that on f28?20:57
mwhahahanot really but it probably wouldn't be a bad idea20:58
weshayovercloud image build?20:58
weshaylolz20:58
weshayk20:58
mwhahahai did generate the tripleo-common yaml for fedora20:58
mwhahahait's been a while since i tested them tho20:58
weshaythe job that runs the overcloud image build.. actually tests the images20:58
mwhahahaso i know it used to work20:58
weshayimho I would rather prioritize rhel when it's avail20:59
mwhahahafine with me20:59
weshayk20:59
*** abishop has quit IRC21:01
*** bfournie has quit IRC21:07
*** raildo has quit IRC21:10
*** xek has quit IRC21:16
*** ade_lee has joined #tripleo21:17
*** wolverineav has quit IRC21:20
*** betherly has joined #tripleo21:21
*** betherly has quit IRC21:26
*** wolverineav has joined #tripleo21:26
*** agopi has joined #tripleo21:27
*** wolverineav has quit IRC21:31
*** ab-a has quit IRC21:37
*** ab-a has joined #tripleo21:38
openstackgerritMerged openstack/tripleo-heat-templates master: Make sure ContainerCli is set to the stack  https://review.openstack.org/64243621:39
openstackgerritMerged openstack/tripleo-heat-templates master: Switch ContainerCli to podman by default  https://review.openstack.org/64089921:40
openstackgerritMerged openstack/tripleo-common master: Remove Congress  https://review.openstack.org/64019421:40
*** russellb has joined #tripleo21:43
*** russellb has left #tripleo21:43
*** wolverineav has joined #tripleo21:45
*** aedc has quit IRC21:47
*** aedc has joined #tripleo21:47
*** vkapalav has quit IRC21:51
*** d0ugal has joined #tripleo21:53
*** rcernin has joined #tripleo22:01
*** betherly has joined #tripleo22:08
*** betherly has quit IRC22:12
openstackgerritLuke Short proposed openstack/paunch master: Handle defined containers that are stopped.  https://review.openstack.org/64291022:22
openstackgerritAlex Schultz proposed openstack/tripleo-image-elements stable/queens: Add upper constraints for stable/queens  https://review.openstack.org/64291122:22
*** agopi has quit IRC22:23
*** florianf has quit IRC22:26
openstackgerritAlex Schultz proposed openstack/tripleo-image-elements stable/queens: Add upper constraints for stable/queens  https://review.openstack.org/64291122:27
*** tosky has quit IRC22:43
*** jjoyce has quit IRC22:46
*** jjoyce has joined #tripleo22:48
*** jjoyce has quit IRC22:51
*** jjoyce has joined #tripleo22:52
*** tkajinam has joined #tripleo22:53
openstackgerritLuke Short proposed openstack/python-tripleoclient stable/queens: Use sync action get_deployment_failures  https://review.openstack.org/64291923:04
*** rascasoft has quit IRC23:05
*** ansmith has joined #tripleo23:06
*** betherly has joined #tripleo23:10
*** betherly has quit IRC23:15
openstackgerritGoutham Pacha Ravi proposed openstack/tripleo-heat-templates master: [dnm] debug permissions issue with manila-share  https://review.openstack.org/64292323:18
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Parameterize undercloud masquerade networks overrides  https://review.openstack.org/64292423:21
*** slaweq has quit IRC23:24
*** ansmith has quit IRC23:25
*** itlinux has joined #tripleo23:37
*** rascasoft has joined #tripleo23:40
*** betherly has joined #tripleo23:42
*** dsneddon has quit IRC23:46
*** betherly has quit IRC23:46
openstackgerritGoutham Pacha Ravi proposed openstack/tripleo-heat-templates master: [dnm] Test manila without pacemaker  https://review.openstack.org/64292623:46
*** thrash is now known as thrash|g0ne23:50
openstackgerritGoutham Pacha Ravi proposed openstack/tripleo-heat-templates master: [dnm] Test manila without pacemaker  https://review.openstack.org/64292623:51
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Use Docker v2 registry mirrors from Opendev infra  https://review.openstack.org/64280823:51
*** rascasoft has quit IRC23:53
*** mcornea has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!