| *** sdake_ has joined #tripleo | 00:08 | |
| *** sdake has quit IRC | 00:11 | |
| *** sdake has joined #tripleo | 00:18 | |
| *** sdake_ has quit IRC | 00:21 | |
| *** shadower has quit IRC | 00:23 | |
| *** shadower has joined #tripleo | 00:23 | |
| *** sdake_ has joined #tripleo | 00:47 | |
| *** sdake__ has joined #tripleo | 00:49 | |
| *** sdake has quit IRC | 00:50 | |
| *** sdake_ has quit IRC | 00:53 | |
| *** sdake__ is now known as sdake | 00:54 | |
| *** chlong has joined #tripleo | 01:02 | |
| *** Hazelesque has quit IRC | 01:03 | |
| *** Hazelesque has joined #tripleo | 01:03 | |
| *** Hazelesque has quit IRC | 01:03 | |
| *** Hazelesque has joined #tripleo | 01:03 | |
| *** spzala has joined #tripleo | 01:13 | |
| *** Prophidys has quit IRC | 01:22 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-image-elements: Pin python-netaddr to 0.7.15 https://review.openstack.org/219088 | 01:27 |
|---|---|---|
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Pin python-netaddr to 0.7.15 https://review.openstack.org/219090 | 01:32 |
| openstackgerrit | Graeme Gillies proposed openstack/os-cloud-config: Add wol ironic driver support https://review.openstack.org/213956 | 01:45 |
| *** shivrao has quit IRC | 01:51 | |
| *** sthillma has quit IRC | 02:04 | |
| *** spzala has quit IRC | 02:10 | |
| *** rhallisey has quit IRC | 02:11 | |
| *** noslzzp_ has quit IRC | 02:19 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-incubator: Updates to support glanceclient v1_0 --visibility https://review.openstack.org/219095 | 02:22 |
| *** shivrao has joined #tripleo | 02:27 | |
| *** shivrao_ has joined #tripleo | 02:29 | |
| *** shivrao has quit IRC | 02:31 | |
| *** shivrao_ has quit IRC | 02:33 | |
| greghaynes | https://cloud-images.ubuntu.com/trusty/current/SHA256SUMS - getting HTTP 403 :( | 02:40 |
| greghaynes | not good for tests | 02:40 |
| *** yamahata has quit IRC | 02:50 | |
| *** lazy_prince has joined #tripleo | 02:50 | |
| *** shivrao has joined #tripleo | 02:52 | |
| *** untriaged-bot has joined #tripleo | 03:00 | |
| untriaged-bot | Untriaged bugs so far: | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488366 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1486778 | 03:00 |
| openstack | Launchpad bug 1488366 in tripleo "TripleO Deployments get stuck sometimes until a timeout is reached" [Undecided,New] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1489436 | 03:00 |
| openstack | Launchpad bug 1486778 in tripleo "Property error: resources.VipPort.properties.fixed_ips: "{}" is not a list" [High,New] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486689 | 03:00 |
| openstack | Launchpad bug 1489436 in heat "ceilometer becoming a devstack plugin will impact gate job config" [High,Triaged] - Assigned to Angus Salkeld (asalkeld) | 03:00 |
| openstack | Launchpad bug 1486689 in diskimage-builder "Ramdisk should consider the size unit when inspecting the amount of RAM" [Undecided,In progress] - Assigned to Brad Lodgen (lodgenbd) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/os-collect-config/+bug/1482510 | 03:00 |
| openstack | Launchpad bug 1482510 in heat "OS::Heat::SoftwareDeployment failed due SSL certificate verification error" [Medium,Triaged] - Assigned to Rico Lin (rico-lin) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488445 | 03:00 |
| openstack | Launchpad bug 1488445 in diskimage-builder "ubuntu/ipa ramdisk cannot be boot successfully" [Undecided,In progress] - Assigned to Ligong Duan (duanlg) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1490639 | 03:00 |
| openstack | Launchpad bug 1490639 in tripleo "Floating IP's no longer working" [Undecided,New] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488969 | 03:00 |
| openstack | Launchpad bug 1488969 in bifrost "debian image w/ironic-agent failing to build" [Medium,Triaged] - Assigned to Julia Kreger (juliaashleykreger) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1489339 | 03:00 |
| openstack | Launchpad bug 1489339 in diskimage-builder "Met the "pkg-map failed"issue for building ubuntu/IPA and debian/IPA ramdisk" [Undecided,In progress] - Assigned to Ye-hong Fang (hongyefang) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1487063 | 03:00 |
| openstack | Launchpad bug 1487063 in tripleo "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,In progress] - Assigned to Wang Wei (wangw-fnst) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488176 | 03:00 |
| openstack | Launchpad bug 1488176 in tripleo "(tripleo heat templates) Not configuring neutron mechanism drivers in any puppet based deploys" [Undecided,In progress] - Assigned to Marios Andreou (marios-b) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1487067 | 03:00 |
| openstack | Launchpad bug 1487067 in tuskar "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,New] - Assigned to Wang Wei (wangw-fnst) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1471802 | 03:00 |
| openstack | Launchpad bug 1471802 in diskimage-builder "ironic-agent element hardcodes interfaces names for DHCP." [Undecided,Fix committed] - Assigned to Om Kumar (om-kumar) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1490584 | 03:00 |
| openstack | Launchpad bug 1490584 in diskimage-builder "ramdisk-image-create ironic-agent fails when using source-install" [Undecided,New] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486967 | 03:00 |
| openstack | Launchpad bug 1486967 in diskimage-builder "Config drive creation fails in UEFI boot mode for whole disk image" [Undecided,In progress] - Assigned to Shivanand Tendulker (stendulker) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1483385 | 03:00 |
| openstack | Launchpad bug 1483385 in diskimage-builder "install_grub failing for centos7" [Undecided,In progress] - Assigned to Abel Lopez (al592b) | 03:00 |
| *** untriaged-bot has quit IRC | 03:00 | |
| *** chlong has quit IRC | 03:12 | |
| *** shivrao has quit IRC | 03:14 | |
| *** chlong has joined #tripleo | 03:38 | |
| *** rlandy has joined #tripleo | 03:42 | |
| *** links has joined #tripleo | 03:46 | |
| *** chlong_ has joined #tripleo | 04:04 | |
| *** chlong has quit IRC | 04:04 | |
| *** tzumainn has quit IRC | 04:29 | |
| *** rlandy has quit IRC | 04:36 | |
| *** shivrao has joined #tripleo | 04:49 | |
| *** sthillma has joined #tripleo | 05:10 | |
| *** killer_prince has joined #tripleo | 05:16 | |
| *** sthillma_ has joined #tripleo | 05:16 | |
| *** lazy_prince has quit IRC | 05:17 | |
| *** sthillma has quit IRC | 05:20 | |
| *** sthillma_ is now known as sthillma | 05:20 | |
| *** masco has joined #tripleo | 05:21 | |
| *** ukalifon1 has joined #tripleo | 05:32 | |
| *** ukalifon1 has left #tripleo | 05:32 | |
| *** bandini has joined #tripleo | 05:40 | |
| *** qasim has joined #tripleo | 05:48 | |
| *** qasim has left #tripleo | 05:49 | |
| *** sdake_ has joined #tripleo | 06:05 | |
| *** killer_prince is now known as lazy_prince | 06:07 | |
| *** jtomasek has joined #tripleo | 06:08 | |
| *** sdake has quit IRC | 06:08 | |
| *** sdake has joined #tripleo | 06:11 | |
| *** sdake has joined #tripleo | 06:13 | |
| *** lazy_prince has quit IRC | 06:14 | |
| *** sdake_ has quit IRC | 06:15 | |
| *** jprovazn has joined #tripleo | 06:45 | |
| *** dtantsur|afk is now known as dtantsur | 06:57 | |
| *** slagle has quit IRC | 07:06 | |
| *** chlong_ has quit IRC | 07:24 | |
| *** aukhan has joined #tripleo | 07:29 | |
| *** ifarkas has joined #tripleo | 07:34 | |
| *** shardy has joined #tripleo | 07:35 | |
| *** akrivoka has joined #tripleo | 07:57 | |
| openstackgerrit | Marios Andreou proposed openstack/os-cloud-config: Add wol ironic driver support https://review.openstack.org/213956 | 07:57 |
| *** lucas-dinner has joined #tripleo | 08:00 | |
| *** lucas-dinner has quit IRC | 08:00 | |
| *** lucasagomes has joined #tripleo | 08:00 | |
| *** panda|Zz is now known as panda | 08:02 | |
| dtantsur | hey folks! this line seems broken now: https://github.com/openstack/diskimage-builder/blob/master/elements/ubuntu/root.d/10-cache-ubuntu-tarball#L32 | 08:02 |
| dtantsur | looks like Ubuntu renamed their stuff | 08:02 |
| *** shivrao has quit IRC | 08:02 | |
| *** marios has quit IRC | 08:04 | |
| *** sthillma has quit IRC | 08:04 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-common: Check if regexp is valid when updating packages https://review.openstack.org/213101 | 08:04 |
| *** paramite has joined #tripleo | 08:05 | |
| *** jistr has joined #tripleo | 08:08 | |
| dtantsur | here's a bug: https://bugs.launchpad.net/ironic/+bug/1490864 it seems to break all ironic gates | 08:08 |
| openstack | Launchpad bug 1490864 in Ironic "Ubuntu mirror file renaming broken "ubuntu" element" [Critical,Confirmed] | 08:08 |
| *** regebro has joined #tripleo | 08:16 | |
| *** regebro has quit IRC | 08:19 | |
| *** regebro has joined #tripleo | 08:20 | |
| openstackgerrit | Antoine Musso proposed openstack/diskimage-builder: Disable DIB_DEBUG_TRACE by default https://review.openstack.org/219176 | 08:23 |
| *** yamahata has joined #tripleo | 08:26 | |
| *** fedora has quit IRC | 08:26 | |
| *** karume has joined #tripleo | 08:26 | |
| *** panda is now known as panda|bbl | 08:27 | |
| *** marios has joined #tripleo | 08:28 | |
| *** jcoufal has joined #tripleo | 08:34 | |
| *** mcornea has joined #tripleo | 08:36 | |
| *** pino|work has joined #tripleo | 08:38 | |
| *** derekh has joined #tripleo | 08:49 | |
| *** qasim has joined #tripleo | 08:51 | |
| *** Marga_ has joined #tripleo | 08:56 | |
| *** Marga__ has joined #tripleo | 08:57 | |
| *** untriaged-bot has joined #tripleo | 09:00 | |
| untriaged-bot | Untriaged bugs so far: | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488366 | 09:00 |
| openstack | Launchpad bug 1488366 in tripleo "TripleO Deployments get stuck sometimes until a timeout is reached" [Undecided,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1486778 | 09:00 |
| openstack | Launchpad bug 1486778 in tripleo "Property error: resources.VipPort.properties.fixed_ips: "{}" is not a list" [High,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1489436 | 09:00 |
| openstack | Launchpad bug 1489436 in heat "ceilometer becoming a devstack plugin will impact gate job config" [High,Triaged] - Assigned to Angus Salkeld (asalkeld) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486689 | 09:00 |
| openstack | Launchpad bug 1486689 in diskimage-builder "Ramdisk should consider the size unit when inspecting the amount of RAM" [Undecided,In progress] - Assigned to Brad Lodgen (lodgenbd) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1490639 | 09:00 |
| openstack | Launchpad bug 1490639 in tripleo "Floating IP's no longer working" [Undecided,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/os-collect-config/+bug/1482510 | 09:00 |
| openstack | Launchpad bug 1482510 in heat "OS::Heat::SoftwareDeployment failed due SSL certificate verification error" [Medium,Triaged] - Assigned to Rico Lin (rico-lin) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488445 | 09:00 |
| openstack | Launchpad bug 1488445 in diskimage-builder "ubuntu/ipa ramdisk cannot be boot successfully" [Undecided,In progress] - Assigned to Ligong Duan (duanlg) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1487063 | 09:00 |
| openstack | Launchpad bug 1487063 in tripleo "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,In progress] - Assigned to Wang Wei (wangw-fnst) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488969 | 09:00 |
| openstack | Launchpad bug 1488969 in bifrost "debian image w/ironic-agent failing to build" [Medium,Triaged] - Assigned to Julia Kreger (juliaashleykreger) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1489339 | 09:00 |
| openstack | Launchpad bug 1489339 in diskimage-builder "Met the "pkg-map failed"issue for building ubuntu/IPA and debian/IPA ramdisk" [Undecided,In progress] - Assigned to Ye-hong Fang (hongyefang) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1490864 | 09:00 |
| openstack | Launchpad bug 1490864 in Ironic "Ubuntu mirror file renaming broken "ubuntu" element" [Critical,Confirmed] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488176 | 09:00 |
| openstack | Launchpad bug 1488176 in tripleo "(tripleo heat templates) Not configuring neutron mechanism drivers in any puppet based deploys" [Undecided,In progress] - Assigned to Marios Andreou (marios-b) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1487067 | 09:00 |
| openstack | Launchpad bug 1487067 in tuskar "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,New] - Assigned to Wang Wei (wangw-fnst) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1471802 | 09:00 |
| openstack | Launchpad bug 1471802 in diskimage-builder "ironic-agent element hardcodes interfaces names for DHCP." [Undecided,Fix committed] - Assigned to Om Kumar (om-kumar) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1490584 | 09:00 |
| openstack | Launchpad bug 1490584 in diskimage-builder "ramdisk-image-create ironic-agent fails when using source-install" [Undecided,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486967 | 09:00 |
| openstack | Launchpad bug 1486967 in diskimage-builder "Config drive creation fails in UEFI boot mode for whole disk image" [Undecided,In progress] - Assigned to Shivanand Tendulker (stendulker) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1483385 | 09:00 |
| openstack | Launchpad bug 1483385 in diskimage-builder "install_grub failing for centos7" [Undecided,In progress] - Assigned to Abel Lopez (al592b) | 09:00 |
| *** untriaged-bot has quit IRC | 09:00 | |
| *** Marga_ has quit IRC | 09:01 | |
| *** yamahata has quit IRC | 09:01 | |
| *** pelix has joined #tripleo | 09:05 | |
| *** regebro has quit IRC | 09:12 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/diskimage-builder: Map ubuntu versions to match the SHA256SUMs https://review.openstack.org/219199 | 09:20 |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-incubator: Updates to support glanceclient v1_0 https://review.openstack.org/219095 | 09:23 |
| *** lucasagomes is now known as lucas-afk-bank | 09:23 | |
| *** karume has quit IRC | 09:30 | |
| *** karume has joined #tripleo | 09:31 | |
| *** Marga__ has quit IRC | 09:32 | |
| *** Marga_ has joined #tripleo | 09:32 | |
| *** dtantsur is now known as dtantsur|brb | 09:41 | |
| *** marios has quit IRC | 09:44 | |
| *** Marga_ has quit IRC | 09:52 | |
| *** paramite is now known as paramite|afk | 09:56 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-incubator: Updates to support glanceclient v1_0 https://review.openstack.org/219095 | 10:11 |
| *** dtantsur|brb is now known as dtantsur | 10:23 | |
| *** panda|bbl is now known as panda | 10:23 | |
| *** paramite|afk is now known as paramite | 10:27 | |
| *** h00327910__ has quit IRC | 10:43 | |
| *** paramite is now known as paramite|afk | 10:43 | |
| *** paramite|afk is now known as paramite | 10:45 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Clean any yum cached data https://review.openstack.org/219227 | 10:54 |
| *** marios has joined #tripleo | 10:55 | |
| *** marios has quit IRC | 10:55 | |
| *** marios has joined #tripleo | 10:56 | |
| *** spzala has joined #tripleo | 11:01 | |
| *** aukhan has quit IRC | 11:03 | |
| *** lucas-afk-bank is now known as lucasagomes | 11:11 | |
| *** slagle has joined #tripleo | 11:12 | |
| openstackgerrit | John Trowbridge proposed openstack/diskimage-builder: [ironic-agent] Use svc-map for enabling agent https://review.openstack.org/218879 | 11:13 |
| *** Goneri has joined #tripleo | 11:26 | |
| *** paramite is now known as paramite|afk | 11:28 | |
| *** paramite|afk is now known as paramite | 11:30 | |
| *** pbourke has quit IRC | 11:30 | |
| *** pbourke has joined #tripleo | 11:36 | |
| *** karume has quit IRC | 11:37 | |
| slagle | jprovazn: is there a heatclient command i can use to clear all the breakpoints at once during a stack update? | 11:39 |
| jprovazn | slagle: yes, sec | 11:39 |
| jprovazn | slagle: heat hook-clear | 11:39 |
| slagle | jprovazn: i have to specify a resource name for that | 11:40 |
| *** rhallisey has joined #tripleo | 11:40 | |
| slagle | jprovazn: i've been trying with various forms of the wildcard, but can't seem to find the one that works for all the breakpoints set | 11:41 |
| derekh | all, the issue with netaddr we were having yesterday is now gone, we now have a new problem that the new heat client that was released | 11:41 |
| slagle | jprovazn: i have 65 nodes, so i dont want to clear them 1 by 1 :) | 11:41 |
| jprovazn | slagle: aah :) | 11:41 |
| derekh | dprince pushed a patch up for thios last night https://review.openstack.org/#/c/219095/3 | 11:41 |
| jprovazn | slagle: yes, iirc wildcard should work too, could you please paste me how looks output of: | 11:42 |
| derekh | I've updated it, but now were are failing, I think because of stale yum metadata on the jenkins node image | 11:42 |
| derekh | so hopefully this will fix it https://review.openstack.org/#/c/219227/1 | 11:42 |
| jprovazn | slagle: heat hook-poll -n 5 overcloud | 11:42 |
| slagle | jprovazn: k, it's running, 1 sec | 11:44 |
| jprovazn | slagle: btw, how did you set hooks? as part of "openstack overcloud update"? | 11:44 |
| jprovazn | slagle: if yes, the update cmd accepts regexp so yo ucould use ".*" | 11:45 |
| jprovazn | when prompt for removing another one | 11:45 |
| derekh | Also one of my infra patch merged, we are no longer running CI on ubuntu, or on most of the non tripleo projects | 11:45 |
| derekh | slagle: fyi ^ | 11:45 |
| *** Marga_ has joined #tripleo | 11:49 | |
| slagle | jprovazn: http://paste.openstack.org/show/437580/ | 11:50 |
| *** pradk has joined #tripleo | 11:50 | |
| slagle | jprovazn: yes, that's what i ran, but i didn't pass -i. i was hoping it would clear them automatically | 11:51 |
| jprovazn | slagle: if stack is still in progress, just re-run again the update cmd including "-i" | 11:52 |
| jprovazn | slagle: it will continue in the running update | 11:52 |
| *** karume has joined #tripleo | 11:52 | |
| slagle | derekh: thx, i see. i +2'd those other ci patches as well | 11:53 |
| derekh | slagle: cool, thanks | 11:53 |
| jprovazn | slagle: you can then remove remove hooks by regexp when it prompts you | 11:53 |
| slagle | jprovazn: ok, i'll try that. i was curious though how to do it with heatclient | 11:54 |
| slagle | maybe you can't | 11:54 |
| jprovazn | slagle: with heatclient you can use wildcards as you mentioned, for nested stacks it would look like: | 11:55 |
| *** shadower_ has joined #tripleo | 11:55 | |
| *** shadower_ has quit IRC | 11:56 | |
| *** thrash|g0ne is now known as thrash | 11:56 | |
| *** shadower_ has joined #tripleo | 11:57 | |
| *** shadower_ has quit IRC | 11:57 | |
| *** karume has quit IRC | 11:58 | |
| jprovazn | slagle: probably: heat hook-clear overcloud nested_stack/nested_2/NestedResource where you can use wildcards instead of nested resource names | 11:58 |
| *** Marga_ has quit IRC | 11:59 | |
| *** yog_ has joined #tripleo | 11:59 | |
| *** Goneri has quit IRC | 12:00 | |
| slagle | yea, that doesn't work | 12:01 |
| slagle | at least now what i'm trying :) | 12:01 |
| slagle | i tried */*/UpdateDeployment | 12:01 |
| *** lucasagomes is now known as lucas-hungry | 12:01 | |
| *** Marga_ has joined #tripleo | 12:02 | |
| *** paramite is now known as paramite|afk | 12:04 | |
| *** qasim has quit IRC | 12:05 | |
| *** karume has joined #tripleo | 12:05 | |
| *** morazi has joined #tripleo | 12:08 | |
| *** chlong_ has joined #tripleo | 12:08 | |
| *** Marga_ has quit IRC | 12:09 | |
| jprovazn | slagle: weird, you might try to pass a simple env file which looks like this: https://github.com/rdo-management/tripleo-common/blob/master/tripleo_common/update.py#L76 (and replace self.hook_resource with 'UpdateDeployment') | 12:09 |
| *** paramite|afk is now known as paramite | 12:09 | |
| jprovazn | I mean pass to stack-update | 12:09 |
| jprovazn | slagle: and with "unset_hook" instead of "hooks" :) | 12:12 |
| *** jcoufal has quit IRC | 12:17 | |
| *** jayg|g0n3 is now known as jayg | 12:17 | |
| *** trown|outttypeww is now known as trown | 12:18 | |
| *** Prophidys has joined #tripleo | 12:18 | |
| *** dprince has joined #tripleo | 12:31 | |
| slagle | jprovazn: think i figured it out: | 12:36 |
| slagle | heat hook-clear --pre-update overcloud Compute/*/UpdateDeployment | 12:36 |
| jprovazn | slagle: ah, cool | 12:37 |
| slagle | you have to specify that first "stack" name...Compute or Controller, etc | 12:37 |
| slagle | and the help on hook-clear says that should be a stack name, but it clearly isn't, it's a resource name | 12:37 |
| jprovazn | slagle: hmpf, I would expect * would do the same trick | 12:37 |
| slagle | the problem with *, is that heatclient will pick a resource that is not a nested stack, and then error | 12:38 |
| slagle | so there are at least 2 bugs here in heatclient | 12:38 |
| slagle | the help text should say that you specify a resource name that is a nested stack | 12:38 |
| slagle | not the actual nested stack name | 12:38 |
| slagle | shardy: does that sound right? ^ | 12:39 |
| slagle | (not sure if you're familiar with the heatclient hook commands at all) | 12:39 |
| *** jcoufal has joined #tripleo | 12:40 | |
| *** lucas-hungry is now known as lucasagomes | 12:40 | |
| slagle | jprovazn: part of the reason i was trying to do all at once is b/c it's taking "openstack overcloud update stack" 90s to individually clear each breakpoint | 12:40 |
| slagle | even when you specify the regex, it still clears them one by one, sequentially | 12:41 |
| slagle | so with 65 nodes, it takes over an hour just to clear breakpoints :) | 12:41 |
| ryansb | o.O | 12:41 |
| ryansb | not so good | 12:41 |
| shardy | slagle: Hey, yeah that sounds right, the hooks are set wrt the resource names from the parent stack | 12:43 |
| shardy | feel free to raise some heatclient bugs and/or send patches :) | 12:43 |
| slagle | :), yea, i will | 12:43 |
| jprovazn | slagle: hehe, nice time :) - I *think* that removing a hook is a cheap call, so I would expect it's just 65 API calls done quite quickly | 12:43 |
| jprovazn | shardy: any idea why removing one hook API call should take so long? | 12:44 |
| slagle | jprovazn: yea i think the delay might be on the tripleo-common side | 12:44 |
| * jprovazn checks what is being done | 12:44 | |
| slagle | b/c it only took heat hook-clear about one minute to clear them all | 12:44 |
| shardy | jprovazn: It shouldn't be particularly expensive, but if you narrow it down to being a heat delay please raise a bug and we can dig into it | 12:45 |
| jprovazn | slagle: well, once minute is quite long time, isn't it? | 12:45 |
| *** fedora has joined #tripleo | 12:45 | |
| slagle | jprovazn: not too bad, b/c heatclient is walking the whole stack and looking for resources that match the regex | 12:45 |
| shardy | jprovazn: it's possible that similar to the | 12:46 |
| slagle | then doing individual api calls if it finds a match | 12:46 |
| slagle | so a minute or so for a 65 node deployment is not too bad | 12:46 |
| shardy | max_resources_per_stack thing it's just very expensive to repeatedly re-load an entire tree of nested templates from the DB | 12:46 |
| shardy | we should allow for one/less API calls to do it tho | 12:46 |
| *** dprince has quit IRC | 12:46 | |
| slagle | jprovazn: this is what the output when using "overcloud openstack update stack" looks like: http://paste.openstack.org/show/437637/ | 12:46 |
| slagle | i typed those times in at line 23 and 25, so i could measure it | 12:47 |
| shardy | If you do raise any heat bugs, please tag them "tripleo" as it'll help me keep track of them | 12:47 |
| shardy | hook-clear hasn't been widely used in the community yeat AFAICT, so I'd not be surprised if there are optimisations we can do | 12:47 |
| shardy | s/yeat/yet | 12:48 |
| *** dprince has joined #tripleo | 12:48 | |
| derekh | Ok, can we merge these 2 to unblock CI (or find the next problem), https://review.openstack.org/#/c/219227/1 https://review.openstack.org/#/c/219095/ | 12:49 |
| derekh | dprince: ^ | 12:50 |
| derekh | with them 2 of the puppet jobs are back passing, havn't looked at why the non puppet job didn't pass (and wont get to it this afternoon) | 12:50 |
| dprince | derekh: lets do it | 12:51 |
| derekh | hopfully the non puppet job failure is just transient | 12:51 |
| *** stendulker has joined #tripleo | 12:51 | |
| derekh | dprince: thanks, I gotta run hopfully we'll see more green now, ttyl | 12:52 |
| *** rlandy has joined #tripleo | 12:52 | |
| *** derekh has quit IRC | 12:52 | |
| openstackgerrit | Merged openstack/tripleo-incubator: Updates to support glanceclient v1_0 https://review.openstack.org/219095 | 12:54 |
| jprovazn | shardy: slagle: in james' case this is what is being called 65 times: https://github.com/rdo-management/tripleo-common/blob/master/tripleo_common/stack_update.py#L36, it seems that suspected 2 calls which might take a long time are: https://github.com/rdo-management/tripleo-common/blob/master/tripleo_common/stack_update.py#L45 and https://github.com/rdo-management/tripleo-common/blob/master/tripleo_common/stack_update.py#L174 | 12:55 |
| jprovazn | I'll look later how to optimize, for sure it's possible at least by sending the hook clear signal for all nodes at once | 12:56 |
| slagle | jprovazn: i have access to this evnrionment for a few more hours if you have some time now to take a look | 12:59 |
| jprovazn | slagle: that would be great, I'm on a call now, will ping you later, thanks | 13:00 |
| slagle | sure, np | 13:00 |
| *** Goneri has joined #tripleo | 13:01 | |
| shardy | jprovazn: Ok, thanks, looking at the resource-signal code I suspect it's just DB load, because we re-load the stack for every signal | 13:01 |
| shardy | jprovazn: at the RPC layer, there is a sync_call flag for resource signal, that's currently only used by the CFN API | 13:02 |
| shardy | one option is to expose that (disabled by default) for the native API, then it will return immediately, e.g like create | 13:02 |
| shardy | atm it's waiting until the signal is handled before returning | 13:02 |
| shardy | which is good for error reporting, bad for performance, I guess | 13:02 |
| *** tzumainn has joined #tripleo | 13:03 | |
| shardy | I'll do some local testing and look for any easy ways to make it a bit faster | 13:03 |
| *** stendulker has quit IRC | 13:14 | |
| *** sdake has quit IRC | 13:17 | |
| *** sdake has joined #tripleo | 13:21 | |
| *** julim has joined #tripleo | 13:22 | |
| *** lazy_prince has joined #tripleo | 13:30 | |
| *** lblanchard has joined #tripleo | 13:42 | |
| *** lazy_prince has quit IRC | 13:44 | |
| *** noslzzp has joined #tripleo | 13:49 | |
| *** lazy_prince has joined #tripleo | 13:49 | |
| jprovazn | slagle: could you please run pkg update with a patch I would send you? | 13:54 |
| slagle | jprovazn: sure, send it on | 13:56 |
| *** rpothier has joined #tripleo | 14:02 | |
| jprovazn | slagle: sent, it eliminates loading whole stack for each breakpoint and adds some times to see if it makes sense optimize further | 14:03 |
| *** noslzzp has quit IRC | 14:03 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Example of passing per-node config data in pre_deploy config https://review.openstack.org/215116 | 14:06 |
| slagle | jprovazn: running now | 14:08 |
| dprince | critical fix for instack upstream: https://review.gerrithub.io/244988 | 14:15 |
| *** links has quit IRC | 14:23 | |
| *** masco has quit IRC | 14:24 | |
| jprovazn | slagle: did you get some numbers? | 14:28 |
| *** shardy_ has joined #tripleo | 14:30 | |
| *** shardy has quit IRC | 14:32 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add "AllNodes" ExtraConfig interface https://review.openstack.org/214740 | 14:34 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Enable Cisco Nexus and UCSM plugins https://review.openstack.org/198754 | 14:34 |
| *** shardy_ has quit IRC | 14:35 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add "AllNodes" ExtraConfig interface https://review.openstack.org/214740 | 14:35 |
| *** shardy has joined #tripleo | 14:36 | |
| shardy | rpothier: Hi, I just pushed a new version of https://review.openstack.org/#/c/214740/ so https://review.openstack.org/#/c/215694/ will need a rebase | 14:37 |
| shardy | I didn't want to rebase the latter for you as I wasn't sure what changes you still had in-progress, but let me know if you'd like me to do it :) | 14:37 |
| *** jprovazn has quit IRC | 14:40 | |
| *** jprovazn has joined #tripleo | 14:40 | |
| *** killer_prince has joined #tripleo | 14:42 | |
| *** jprovazn has quit IRC | 14:42 | |
| *** lazy_prince has quit IRC | 14:44 | |
| *** shardy_ has joined #tripleo | 14:47 | |
| *** shardy has quit IRC | 14:48 | |
| openstackgerrit | Sergey Vilgelm proposed openstack/tuskar: Switch to the oslo_log library https://review.openstack.org/205391 | 14:50 |
| *** shardy_ has quit IRC | 14:52 | |
| *** shardy has joined #tripleo | 14:53 | |
| *** sdake_ has joined #tripleo | 14:53 | |
| *** stendulker has joined #tripleo | 14:56 | |
| *** links has joined #tripleo | 14:57 | |
| *** sdake has quit IRC | 14:58 | |
| *** jistr is now known as jistr|call | 14:58 | |
| *** untriaged-bot has joined #tripleo | 15:00 | |
| untriaged-bot | Untriaged bugs so far: | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488366 | 15:00 |
| openstack | Launchpad bug 1488366 in tripleo "TripleO Deployments get stuck sometimes until a timeout is reached" [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1486778 | 15:00 |
| openstack | Launchpad bug 1486778 in tripleo "Property error: resources.VipPort.properties.fixed_ips: "{}" is not a list" [High,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1489436 | 15:00 |
| openstack | Launchpad bug 1489436 in heat "ceilometer becoming a devstack plugin will impact gate job config" [High,Triaged] - Assigned to Angus Salkeld (asalkeld) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486689 | 15:00 |
| openstack | Launchpad bug 1486689 in diskimage-builder "Ramdisk should consider the size unit when inspecting the amount of RAM" [Undecided,In progress] - Assigned to Brad Lodgen (lodgenbd) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1490639 | 15:00 |
| openstack | Launchpad bug 1490639 in tripleo "Floating IP's no longer working" [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/os-collect-config/+bug/1482510 | 15:00 |
| openstack | Launchpad bug 1482510 in heat "OS::Heat::SoftwareDeployment failed due SSL certificate verification error" [Medium,Triaged] - Assigned to Rico Lin (rico-lin) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488445 | 15:00 |
| openstack | Launchpad bug 1488445 in diskimage-builder "ubuntu/ipa ramdisk cannot be boot successfully" [Undecided,In progress] - Assigned to Ligong Duan (duanlg) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1487063 | 15:00 |
| openstack | Launchpad bug 1487063 in tripleo "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,In progress] - Assigned to Wang Wei (wangw-fnst) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488969 | 15:00 |
| openstack | Launchpad bug 1488969 in bifrost "debian image w/ironic-agent failing to build" [Medium,Triaged] - Assigned to Julia Kreger (juliaashleykreger) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1489339 | 15:00 |
| openstack | Launchpad bug 1489339 in diskimage-builder "Met the "pkg-map failed"issue for building ubuntu/IPA and debian/IPA ramdisk" [Undecided,In progress] - Assigned to Ye-hong Fang (hongyefang) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1490864 | 15:00 |
| openstack | Launchpad bug 1490864 in diskimage-builder "Ubuntu mirror file renaming broken "ubuntu" element" [Undecided,In progress] - Assigned to Lucas Alvares Gomes (lucasagomes) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488176 | 15:00 |
| openstack | Launchpad bug 1488176 in tripleo "(tripleo heat templates) Not configuring neutron mechanism drivers in any puppet based deploys" [Undecided,In progress] - Assigned to Marios Andreou (marios-b) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1487067 | 15:00 |
| openstack | Launchpad bug 1487067 in tuskar "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,New] - Assigned to Wang Wei (wangw-fnst) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1471802 | 15:00 |
| openstack | Launchpad bug 1471802 in diskimage-builder "ironic-agent element hardcodes interfaces names for DHCP." [Undecided,Fix committed] - Assigned to Om Kumar (om-kumar) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1490584 | 15:00 |
| openstack | Launchpad bug 1490584 in diskimage-builder "ramdisk-image-create ironic-agent fails when using source-install" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486967 | 15:00 |
| openstack | Launchpad bug 1486967 in diskimage-builder "Config drive creation fails in UEFI boot mode for whole disk image" [Undecided,In progress] - Assigned to Shivanand Tendulker (stendulker) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1483385 | 15:00 |
| openstack | Launchpad bug 1483385 in diskimage-builder "install_grub failing for centos7" [Undecided,In progress] - Assigned to Abel Lopez (al592b) | 15:00 |
| *** untriaged-bot has quit IRC | 15:00 | |
| *** daemontool_ has quit IRC | 15:01 | |
| *** ukalifon1 has joined #tripleo | 15:02 | |
| *** sdake_ is now known as sdake | 15:06 | |
| *** Marga_ has joined #tripleo | 15:08 | |
| *** shivrao has joined #tripleo | 15:11 | |
| *** pblaho has quit IRC | 15:13 | |
| *** yuanying has quit IRC | 15:13 | |
| *** rhallisey has quit IRC | 15:15 | |
| *** yamahata has joined #tripleo | 15:15 | |
| dtantsur | greghaynes, hi, around re https://review.openstack.org/#/c/211521/ ? | 15:16 |
| *** links has quit IRC | 15:16 | |
| *** paramite is now known as paramite|afk | 15:17 | |
| *** jprovazn has joined #tripleo | 15:19 | |
| *** shivrao has quit IRC | 15:19 | |
| *** stendulker has quit IRC | 15:19 | |
| *** paramite|afk has quit IRC | 15:21 | |
| *** tzumainn has quit IRC | 15:21 | |
| *** tzumainn has joined #tripleo | 15:22 | |
| greghaynes | dtantsur: so, I think were still missing some clear understanding of whats going on... | 15:22 |
| dtantsur | greghaynes, dnf by default cleans up the dependencies of a remove package | 15:23 |
| greghaynes | dtantsur: It shouldnt if that package has been installed individually? | 15:23 |
| dtantsur | greghaynes, but they don't (or didn't until this week) have a way to mark package as manually installed | 15:23 |
| greghaynes | what | 15:23 |
| greghaynes | thats crazypants | 15:23 |
| dtantsur | greghaynes, so if we install cloud-init before manually installing dmidecode, dmidecode will get removed when installing cloud-init | 15:24 |
| greghaynes | manually installed sounds to me like alternatives, not you installed the package from dnf? | 15:24 |
| dtantsur | slagle, also ^^ | 15:24 |
| dtantsur | greghaynes, sorry, I'm not sure I got your last comment.. | 15:24 |
| *** Marga_ has quit IRC | 15:25 | |
| greghaynes | I am mostly just amazed that is true, that sounds like something that would break a lot of stuff | 15:25 |
| dtantsur | maybe.. | 15:25 |
| *** Marga_ has joined #tripleo | 15:25 | |
| *** ukalifon1 has quit IRC | 15:26 | |
| slagle | dtantsur: if i: dnf install dmidecode; dnf install cloud-init; dnf erase cloud-init; then dmidecode stays installed | 15:26 |
| dtantsur | dnf 1.1.1 added dnf mark command, not sure if we can use it already | 15:26 |
| dtantsur | slagle, start with installing cloud-init | 15:26 |
| greghaynes | slagle: what if the install dmidecode and cloud-init are swapped | 15:26 |
| slagle | ok, in that case it wants to remove dmidecode | 15:28 |
| greghaynes | aye, ok | 15:28 |
| greghaynes | dtantsur: ok, ill reply on review | 15:29 |
| dtantsur | thanks! | 15:29 |
| *** yuanying has joined #tripleo | 15:30 | |
| slagle | dnf ... they never claimed it was done | 15:30 |
| greghaynes | heh | 15:30 |
| trown | lol | 15:30 |
| greghaynes | well, is that default on some of the distros we support? | 15:31 |
| greghaynes | or, curious what the criteria are where dib uses it | 15:31 |
| slagle | it's the default in f22 | 15:31 |
| trown | f22+ | 15:31 |
| greghaynes | ah, ok. | 15:31 |
| *** killer_prince has quit IRC | 15:33 | |
| lucasagomes | folks pip install -e <diskimage-builder repo> fails | 15:33 |
| lucasagomes | cause it requires stuff to be present at /usr/local/share/diskimage-builder | 15:33 |
| greghaynes | dtantsur: ok, commented | 15:33 |
| dtantsur | greghaynes, thanks, will update soon | 15:34 |
| *** alop has joined #tripleo | 15:34 | |
| *** Marga_ has quit IRC | 15:35 | |
| dprince | shardy: I have a hunch that we may be loosing heat notification due to not having a validation like this in place https://review.openstack.org/#/c/197739/4 | 15:39 |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder: ironic-agent: ensure dmidecode and ipmitool are installed https://review.openstack.org/211521 | 15:40 |
| dtantsur | greghaynes, slagle ^^ | 15:40 |
| dprince | shardy: as in os-net-config runs... the net is down for a split second and os-collect-config fails to send a notification out (rarely but it could happen) | 15:40 |
| shardy | dprince: hmm, interesting, do you see the curl from s99-refresh-completed fail? | 15:41 |
| dprince | shardy: yes, I saw this consistently when I tested the static IPs on the ctplane patches. | 15:41 |
| dprince | shardy: what I've done here fixed that race condiction | 15:42 |
| dprince | shardy: sleep 10 would fix it too... but that is dirty | 15:42 |
| dprince | shardy: I suspect we have a low rate of failure in other cases (not using static IPs on the ctlplane for example) | 15:42 |
| *** hewbrocca has quit IRC | 15:42 | |
| dprince | shardy: the gist is, network connectivity back to the Heat API must work before we call network configuration complete | 15:43 |
| shardy | dprince: cool, well I'm +1 on landing the validation, I'd just prefer we fixed the cfn oac coupling first | 15:43 |
| shardy | it should be pretty simple, we just need to fall-through a few different queries until we get a valid METADATA_IP_ADDR | 15:44 |
| shardy | same logic needed in s99-refresh-completed | 15:44 |
| *** shivrao has joined #tripleo | 15:44 | |
| shardy | then, if we e.g want to move to swift signals everything won't break :) | 15:44 |
| dprince | shardy: is there even a heat bug/feature for this? | 15:44 |
| dprince | shardy: I'm willing to add this myself if need be, because we really need this | 15:45 |
| *** stendulker has joined #tripleo | 15:45 | |
| shardy | dprince: I'm not sure I understand, what heat feature is needed? | 15:45 |
| dprince | shardy: essentially just exposing the configured heat_metadata_server_url value or something | 15:45 |
| shardy | we already support multiple signal transports, the problem is your 20-os-net-config only supports one | 15:46 |
| shardy | dprince: yeah, it'd be nice if we could expose it in a generic way | 15:46 |
| shardy | but for now we'll have to look in the paths aligned with the keys heat uses: | 15:46 |
| dprince | shardy: Right, the problem as I see it is I can only get that from CFN at the moment, if we disable CFN then we'd have to add it somewhere else (in heat) | 15:47 |
| shardy | dprince: No, that is what I'm saying, there is always a URL for every transport | 15:47 |
| shardy | maybe I didn't explain it well enough in the review, sorry | 15:47 |
| dprince | shardy: okay, then we may be okay | 15:47 |
| dprince | shardy: so, taking a step back | 15:48 |
| shardy | https://github.com/openstack/heat/blob/master/heat/engine/resources/openstack/nova/server.py#L543 | 15:48 |
| dprince | shardy: I sort of kinda hate having Swift in my instack undercloud | 15:48 |
| shardy | we just need some elifs in 20-os-net-config which align with that | 15:48 |
| shardy | dprince: Ok, why's that? | 15:48 |
| dprince | shardy: I mean it is a horrable way to install swift, as a single node.... not recommended by any means | 15:48 |
| dprince | shardy: I suppose I'd see an option to use a robust external Swift cluster as valuable | 15:49 |
| shardy | It's a far more efficient polling mechanism, because we can HEAD the container instead of continually reading from heat, which is pretty inefficient | 15:49 |
| shardy | e.g it doesn't scale too well and it hammers the DB | 15:49 |
| dprince | shardy: understood, and we can support that case... via an external Swift cluster | 15:49 |
| shardy | dprince: well I guess I'm assuming deploying some more nodes in the multi-node use-case would enable that | 15:50 |
| dprince | shardy: but a single node swift "cluster" in a VM (or on baremetal) is pretty bad I think | 15:50 |
| shardy | dprince: Ok, perhaps, it could be that we want to use heat native signalling, then we can not install the CFN API at all in the undercloud | 15:50 |
| shardy | It's not possible atm because of these various places hard-coded to expect CFN | 15:51 |
| dprince | shardy: sure, perhaps native signalling as a default | 15:51 |
| shardy | personally I'd love to see TripleO not require a *cloudformation* compatible API, ugh! | 15:51 |
| dprince | shardy: with the option to use Swift temp URL polling on a more robust undercloud installation | 15:51 |
| shardy | dprince: sure, +1 | 15:51 |
| dprince | shardy: cool, I'm just kind of hating seeing Swift on by default in my instack undercloud VM | 15:52 |
| shardy | dprince: Yeah, or zaqar which is also supported by heat now | 15:52 |
| dprince | shardy: I always use a VM BTW, and my guess is most people we prefer that sort of thing too | 15:52 |
| *** spzala has quit IRC | 15:53 | |
| dprince | shardy: I think the "Baremetal" undercloud might be an urban legend... people talk about it, but if they really think about what they want it is actually just a provisioning VM | 15:53 |
| shardy | dprince: cool, well +1 on making it optional, but there may be other cases where having it available is useful, such as when a UI needs somewhere to push environment data after getting forms submitted | 15:53 |
| shardy | the UI can't store it to the local filesystem, so something like swift is convenient if it's available | 15:54 |
| dprince | shardy: yeah, theres always git | 15:54 |
| shardy | dprince: yup, that would be good, but we don't configure a git server on the undercloud atm | 15:55 |
| dprince | shardy: again, I just see a single node swift installation as being sort of a developer testbed at best | 15:55 |
| slagle | swift is also used for the ahc data | 15:55 |
| shardy | ah, yeah, I forgot about that | 15:55 |
| dprince | slagle: ahc? | 15:55 |
| * dprince has too many acronyms in his head | 15:55 | |
| shardy | dprince: discovery/introspection data | 15:56 |
| slagle | the data sent back from the discovery ramdisk | 15:56 |
| shardy | we recover a gadzillion facts about the hardware and dump it all in swift | 15:56 |
| dprince | slagle: right, perhaps a pluggable filesystem backend could deal with that just as easily | 15:56 |
| dprince | slagle: much more lightweight... | 15:56 |
| dprince | slagle: I'd like the option to use Swift for all these things mind you | 15:56 |
| dprince | slagle: I just think using Swift by default in an all-in-one configuration is sort of undesirable | 15:57 |
| shardy | dprince: It sounds like we're all basically agreeing, e.g that other alternatives and optional swift would be good | 15:57 |
| dprince | shardy: yes, exactly | 15:57 |
| shardy | it's just that right now, we don't have any alternatives implemented | 15:57 |
| dprince | shardy: sure, swift can certainly stay on until then... | 15:58 |
| slagle | yea i think we mainly picked swift for ahc b/c there was no other great alternative | 15:59 |
| slagle | and everyone was saying swift was going to be there for the heat polling anyway | 15:59 |
| *** rhallisey has joined #tripleo | 15:59 | |
| *** sdake_ has joined #tripleo | 16:05 | |
| *** jtomasek has quit IRC | 16:06 | |
| *** dtantsur is now known as dtantsur|afk | 16:06 | |
| shardy | dprince: added comments to https://review.openstack.org/#/c/197739/ re how we can support all the transports | 16:07 |
| shardy | Looking at s99-refresh-complete I think that may be OK after all, as it looks at the per-deployment URL for signalling | 16:07 |
| dprince | shardy: okay, I will test this out | 16:08 |
| dprince | shardy: so native POLL_SERVER_HEAT should work then as is? | 16:09 |
| *** sdake has quit IRC | 16:09 | |
| shardy | dprince: Actually, no, because S99-refresh-completed expects a pre-signed URL it can just POST to | 16:09 |
| shardy | doh | 16:09 |
| shardy | we need to enhance it to get a keystone token, then call heat | 16:09 |
| shardy | Or, use heat-config-notify | 16:10 |
| dprince | shardy: well that sounds fun | 16:10 |
| shardy | which already does that | 16:10 |
| dprince | shardy: I think I like the idea of heat-config-notify | 16:10 |
| shardy | but the problem isn't coupling to the CFN metadata format as I initially thought | 16:10 |
| shardy | yeah, that's probably the cleanest way I think | 16:10 |
| shardy | dprince: The other thing I've wondered about for a while is making os-apply-config configs applied via a heat-config hook | 16:12 |
| shardy | if we did that we'd get the heat-config-notify stuff for free | 16:12 |
| shardy | but it'd probably prevent the cross-deployment hacks where we expect the oac merging behavior | 16:12 |
| shardy | group: heat-os-apply-config or something | 16:13 |
| *** ifarkas has quit IRC | 16:20 | |
| *** sdake_ is now known as sdake | 16:21 | |
| *** jistr|call has quit IRC | 16:28 | |
| *** stendulker has quit IRC | 16:31 | |
| *** trown is now known as trown|lunch | 16:37 | |
| *** pblaho has joined #tripleo | 16:39 | |
| *** david-ly_ has joined #tripleo | 16:49 | |
| *** david-lyle has quit IRC | 16:49 | |
| *** mcornea has quit IRC | 16:51 | |
| *** karume has quit IRC | 16:51 | |
| *** julim has quit IRC | 17:00 | |
| *** julim has joined #tripleo | 17:03 | |
| *** w_ has joined #tripleo | 17:03 | |
| *** sdake_ has joined #tripleo | 17:06 | |
| *** sdake has quit IRC | 17:06 | |
| *** sdake has joined #tripleo | 17:07 | |
| *** olaph has quit IRC | 17:07 | |
| *** david-ly_ has quit IRC | 17:07 | |
| *** sdake_ has quit IRC | 17:10 | |
| *** noslzzp has joined #tripleo | 17:14 | |
| *** lucasagomes is now known as lucas-dinner | 17:14 | |
| *** w_ is now known as olaph | 17:15 | |
| *** marios has quit IRC | 17:32 | |
| *** penick has joined #tripleo | 17:38 | |
| *** pelix has quit IRC | 17:45 | |
| *** trown|lunch is now known as trown | 17:46 | |
| *** david-lyle has joined #tripleo | 17:54 | |
| *** penick has quit IRC | 17:55 | |
| *** david-lyle has quit IRC | 18:01 | |
| *** rbrady has quit IRC | 18:03 | |
| dprince | slagle: so here is an idea to help maintain puppet coverage within the instack job | 18:07 |
| dprince | slagle: http://paste.openstack.org/show/438282/ | 18:07 |
| dprince | slagle: do you have any better ideas? | 18:07 |
| dprince | slagle: I hate to scp in a custom DIB environments.d file... but I don't see a cleaner way to do this | 18:07 |
| dprince | slagle: perhaps just expose the environment to the stack user and source that? | 18:08 |
| dprince | source 00-puppet-pins (as the stack user)? | 18:08 |
| *** penick has joined #tripleo | 18:10 | |
| *** paramite has joined #tripleo | 18:13 | |
| *** david-lyle has joined #tripleo | 18:19 | |
| *** w_ has joined #tripleo | 18:19 | |
| *** Marga_ has joined #tripleo | 18:21 | |
| *** shivrao has quit IRC | 18:22 | |
| *** olaph has quit IRC | 18:22 | |
| slagle | dprince: dunno about anything "better" | 18:26 |
| slagle | dprince: you could add all the exports down where the commands are run over ssh | 18:26 |
| slagle | or, bake the file in to the undercloud image when disk-image-create is called | 18:26 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 18:27 |
| dprince | slagle: try that | 18:27 |
| dprince | slagle: it will fail until this patch lands though https://review.gerrithub.io/#/c/244988/ | 18:28 |
| slagle | dprince: ok, looks fine to me. one thing we may want to consider is how we document folks to do this manually | 18:30 |
| slagle | but we can always adjust the CI to match that later | 18:30 |
| dprince | slagle: I've got a local instack.sh that I use to create a VM and do this locally in much the same way | 18:30 |
| dprince | slagle: without the RPM building though... | 18:31 |
| dprince | slagle: The CI job needs that, yes. but I think that is sort of out of scope for a devtest_instack.sh sort of script | 18:31 |
| dprince | slagle: essentially just making RPM building pluggable, and not actually doing it is the right approach I think | 18:31 |
| slagle | right. eventually we may want a CI job that only uses the latest delorean repo and builds nothing | 18:32 |
| slagle | that way we'll have a known good delorean repo | 18:32 |
| dprince | slagle: ack, that is exactly what I'm using on a daily basis at this point | 18:32 |
| *** jtomasek has joined #tripleo | 18:32 | |
| slagle | that we know we can fuly use to deploy tripleo | 18:32 |
| slagle | fully | 18:32 |
| dprince | slagle: have you seen this https://review.gerrithub.io/#/c/244751/ | 18:33 |
| dprince | slagle: there is some issue w/ apache failing to start w/ the latest Horizon packages | 18:33 |
| dprince | slagle: we probably need to look at (or temporarily disable) this for the overcloud too though | 18:33 |
| dprince | slagle: regardless, for the undercloud I would like the option to not install Horizon/Tuskar for CI | 18:34 |
| *** w_ is now known as olaph | 18:34 | |
| dprince | slagle: because we aren't using it | 18:34 |
| *** shivrao has joined #tripleo | 18:34 | |
| slagle | fine by me | 18:35 |
| slagle | i did see the patch, will take a closer look | 18:36 |
| slagle | i've been rapidly trying to get the tripleo docs ready | 18:36 |
| dprince | slagle: cool, thanks | 18:37 |
| dprince | slagle: is there somewhere we can see those now? your progress? | 18:37 |
| dprince | slagle: or just local so far? | 18:37 |
| dprince | slagle: also, before too long we have to have this too https://review.gerrithub.io/#/c/243608/ | 18:38 |
| dprince | slagle: otherwise we can't fine tune anything in the CI jobs | 18:39 |
| dprince | slagle: oscplugin is super rigid and needs to get out of the business of mucking w/ parameters altogether. Until this this is a first step which allows environments to override things... | 18:40 |
| * dprince needs to finish proper unit tests on that patch though | 18:40 | |
| slagle | dprince: i'm going to submit a PR to the staging repo that derekh setup with what i've done so far | 18:40 |
| slagle | i should have something by the end of the day | 18:41 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Clean any yum cached data https://review.openstack.org/219227 | 18:41 |
| *** CaptTofu__ is now known as CaptTofu | 18:41 | |
| slagle | just trying to get all the rdo/rhos/internal stuff cleaned out of it | 18:41 |
| dprince | slagle: IRC meeting today? | 18:42 |
| *** paramite is now known as paramite|afk | 18:42 | |
| *** paramite|afk is now known as paramite | 18:42 | |
| slagle | dprince: it's next week | 18:42 |
| dprince | slagle: okay, possibly lots to talk about then | 18:43 |
| dprince | slagle: if we get all this landed that is | 18:43 |
| dprince | slagle: so is this okay to merge then https://review.gerrithub.io/#/c/244988/ | 18:44 |
| dprince | slagle: I'd like to get that landed and recheck derekh's job before too long | 18:44 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Clean any yum cached data https://review.openstack.org/219227 | 18:44 |
| dprince | slagle: there is no good way to cherry pick that I'm afraid... | 18:44 |
| *** paramite has quit IRC | 18:47 | |
| *** paramite has joined #tripleo | 18:47 | |
| slagle | ok, merged | 18:53 |
| *** Marga_ has quit IRC | 18:53 | |
| slagle | dprince: this needs too merge as well: https://review.openstack.org/#/c/211124/ should we recheck again? | 18:54 |
| dprince | slagle: it does, but I think there is a Depends-on: for that one | 18:55 |
| slagle | there is | 18:55 |
| slagle | was just wondering if we shoudl recheck | 18:56 |
| *** akrivoka has quit IRC | 19:00 | |
| *** penick has quit IRC | 19:12 | |
| *** sdake_ has joined #tripleo | 19:12 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/os-cloud-config: register-nodes: add support for fake_pxe https://review.openstack.org/219414 | 19:13 |
| *** sdake has quit IRC | 19:13 | |
| *** sdake has joined #tripleo | 19:13 | |
| *** julim has quit IRC | 19:14 | |
| *** penick has joined #tripleo | 19:14 | |
| slagle | dprince: https://github.com/derekhiggins/tripleo-docs/pull/1/commits | 19:17 |
| *** sdake_ has quit IRC | 19:18 | |
| slagle | actually it might be easier to just clone my repo: https://github.com/slagle/tripleo-docs.git | 19:18 |
| slagle | and checkout the tripleo branch | 19:18 |
| slagle | bnemec: ^^ too. | 19:18 |
| slagle | if you have written off the docs since i used the separate repo :) | 19:19 |
| openstackgerrit | Bertrand Lallau proposed openstack/tuskar: Removing unused dependency: posix_ipc https://review.openstack.org/219417 | 19:19 |
| openstackgerrit | Merged openstack/python-tuskarclient: Replace assert_called_once() calls https://review.openstack.org/205152 | 19:19 |
| openstackgerrit | Merged openstack/python-tuskarclient: Switch to oslo_i18n https://review.openstack.org/205382 | 19:19 |
| bnemec | slagle: Meh, I'll just start ignoring the docs like everyone else does. ;-) | 19:22 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 19:25 |
| dprince | slagle: updated the tripleo-ci patch to use the latest instack-undercloud Delorean URL | 19:26 |
| *** bandini has quit IRC | 19:28 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Make README.rst a bit more generic https://review.openstack.org/218043 | 19:32 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add DIB_KEEP_PACKAGE_CACHE variable https://review.openstack.org/208321 | 19:32 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add DIB_USE_PACKAGE_CACHE variable https://review.openstack.org/211434 | 19:32 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add #!/bin/bash to library functions https://review.openstack.org/218100 | 19:32 |
| *** lifeless has quit IRC | 19:34 | |
| *** thrash has quit IRC | 19:34 | |
| *** matbu has quit IRC | 19:34 | |
| *** whydidyoustealmy has quit IRC | 19:34 | |
| *** dtantsur|afk has quit IRC | 19:34 | |
| *** jrist has quit IRC | 19:34 | |
| *** dobson has quit IRC | 19:34 | |
| *** dobson has joined #tripleo | 19:34 | |
| *** lifeless has joined #tripleo | 19:35 | |
| *** thrash has joined #tripleo | 19:35 | |
| *** matbu has joined #tripleo | 19:35 | |
| *** whydidyoustealmy has joined #tripleo | 19:35 | |
| *** dtantsur|afk has joined #tripleo | 19:35 | |
| *** jrist has joined #tripleo | 19:35 | |
| *** whydidyoustealmy has quit IRC | 19:35 | |
| *** w_ has joined #tripleo | 19:35 | |
| *** whydidyoustealmy has joined #tripleo | 19:35 | |
| openstackgerrit | Lennart Regebro proposed openstack/python-tuskarclient: Add a parameter to load plan parameters from a JSON file https://review.openstack.org/190164 | 19:35 |
| *** olaph has quit IRC | 19:38 | |
| *** w_ has quit IRC | 19:40 | |
| *** paramite has quit IRC | 19:42 | |
| *** sdake_ has joined #tripleo | 19:45 | |
| *** lifeless has quit IRC | 19:47 | |
| *** thrash has quit IRC | 19:47 | |
| *** matbu has quit IRC | 19:47 | |
| *** dtantsur|afk has quit IRC | 19:47 | |
| *** jrist has quit IRC | 19:47 | |
| *** sdake has quit IRC | 19:49 | |
| *** sdake has joined #tripleo | 19:49 | |
| *** penick has quit IRC | 19:49 | |
| *** lifeless has joined #tripleo | 19:52 | |
| *** thrash has joined #tripleo | 19:52 | |
| *** matbu has joined #tripleo | 19:52 | |
| *** dtantsur|afk has joined #tripleo | 19:52 | |
| *** jrist has joined #tripleo | 19:52 | |
| *** sdake_ has quit IRC | 19:53 | |
| *** olaph has joined #tripleo | 19:53 | |
| *** penick has joined #tripleo | 19:54 | |
| *** julim has joined #tripleo | 19:58 | |
| *** jtomasek has quit IRC | 19:59 | |
| *** jprovazn has quit IRC | 20:05 | |
| *** jayg is now known as jayg|g0n3 | 20:05 | |
| *** jcoufal has quit IRC | 20:11 | |
| *** rlandy has quit IRC | 20:16 | |
| *** rlandy has joined #tripleo | 20:17 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add "AllNodes" ExtraConfig interface https://review.openstack.org/214740 | 20:19 |
| *** pblaho has quit IRC | 20:21 | |
| *** jcoufal has joined #tripleo | 20:26 | |
| *** olaph has quit IRC | 20:28 | |
| *** julim has quit IRC | 20:29 | |
| *** dprince has quit IRC | 20:38 | |
| *** julim has joined #tripleo | 20:42 | |
| *** olaph has joined #tripleo | 20:43 | |
| *** absubram has joined #tripleo | 20:43 | |
| *** olaph has quit IRC | 20:47 | |
| *** yamahata has quit IRC | 20:49 | |
| *** sdake has quit IRC | 20:53 | |
| *** olaph has joined #tripleo | 20:55 | |
| *** Goneri has quit IRC | 20:57 | |
| *** rbrady has joined #tripleo | 20:58 | |
| openstackgerrit | Antoine Musso proposed openstack/diskimage-builder: dib-run-parts: make cp to target root more robust https://review.openstack.org/219453 | 20:58 |
| *** trown is now known as trown|outttypeww | 20:59 | |
| *** olaph has quit IRC | 21:00 | |
| *** untriaged-bot has joined #tripleo | 21:01 | |
| untriaged-bot | Untriaged bugs so far: | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488366 | 21:01 |
| openstack | Launchpad bug 1488366 in tripleo "TripleO Deployments get stuck sometimes until a timeout is reached" [Undecided,New] | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1486778 | 21:01 |
| openstack | Launchpad bug 1486778 in tripleo "Property error: resources.VipPort.properties.fixed_ips: "{}" is not a list" [High,New] | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1489436 | 21:01 |
| openstack | Launchpad bug 1489436 in heat "ceilometer becoming a devstack plugin will impact gate job config" [High,Triaged] - Assigned to Angus Salkeld (asalkeld) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486689 | 21:01 |
| openstack | Launchpad bug 1486689 in diskimage-builder "Ramdisk should consider the size unit when inspecting the amount of RAM" [Undecided,In progress] - Assigned to Brad Lodgen (lodgenbd) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1490639 | 21:01 |
| openstack | Launchpad bug 1490639 in tripleo "Floating IP's no longer working" [Undecided,New] | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/os-collect-config/+bug/1482510 | 21:01 |
| openstack | Launchpad bug 1482510 in heat "OS::Heat::SoftwareDeployment failed due SSL certificate verification error" [Medium,Triaged] - Assigned to Rico Lin (rico-lin) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488445 | 21:01 |
| openstack | Launchpad bug 1488445 in diskimage-builder "ubuntu/ipa ramdisk cannot be boot successfully" [Undecided,In progress] - Assigned to Ligong Duan (duanlg) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1487063 | 21:01 |
| openstack | Launchpad bug 1487063 in tripleo "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,In progress] - Assigned to Wang Wei (wangw-fnst) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1491035 | 21:01 |
| openstack | Launchpad bug 1491035 in diskimage-builder "Can't install diskimage-builder via "pip install -e"" [Undecided,New] | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1488969 | 21:01 |
| openstack | Launchpad bug 1488969 in bifrost "debian image w/ironic-agent failing to build" [Medium,Triaged] - Assigned to Julia Kreger (juliaashleykreger) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1489339 | 21:01 |
| openstack | Launchpad bug 1489339 in diskimage-builder "Met the "pkg-map failed"issue for building ubuntu/IPA and debian/IPA ramdisk" [Undecided,In progress] - Assigned to Ye-hong Fang (hongyefang) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1490864 | 21:01 |
| openstack | Launchpad bug 1490864 in diskimage-builder "Ubuntu mirror file renaming broken "ubuntu" element" [Undecided,In progress] - Assigned to Lucas Alvares Gomes (lucasagomes) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1488176 | 21:01 |
| openstack | Launchpad bug 1488176 in tripleo "(tripleo heat templates) Not configuring neutron mechanism drivers in any puppet based deploys" [Undecided,In progress] - Assigned to Marios Andreou (marios-b) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1487067 | 21:01 |
| openstack | Launchpad bug 1487067 in tuskar "Replace 'nova_overcloud_config.yml' with 'nova_overcloud_config.yaml'" [Undecided,New] - Assigned to Wang Wei (wangw-fnst) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1471802 | 21:01 |
| openstack | Launchpad bug 1471802 in diskimage-builder "ironic-agent element hardcodes interfaces names for DHCP." [Undecided,Fix committed] - Assigned to Om Kumar (om-kumar) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1490584 | 21:01 |
| openstack | Launchpad bug 1490584 in diskimage-builder "ramdisk-image-create ironic-agent fails when using source-install" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1486967 | 21:01 |
| openstack | Launchpad bug 1486967 in diskimage-builder "Config drive creation fails in UEFI boot mode for whole disk image" [Undecided,In progress] - Assigned to Shivanand Tendulker (stendulker) | 21:01 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1483385 | 21:01 |
| *** untriaged-bot has quit IRC | 21:01 | |
| openstack | Launchpad bug 1483385 in diskimage-builder "install_grub failing for centos7" [Undecided,In progress] - Assigned to Abel Lopez (al592b) | 21:01 |
| *** lblanchard has quit IRC | 21:05 | |
| *** rbrady has quit IRC | 21:07 | |
| *** rbrady has joined #tripleo | 21:07 | |
| *** pradk has quit IRC | 21:11 | |
| *** pradk has joined #tripleo | 21:12 | |
| *** julim has quit IRC | 21:25 | |
| *** Goneri has joined #tripleo | 21:33 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: loadbalancer: use 'source' for novnc balance mode https://review.openstack.org/219464 | 21:35 |
| *** alop has quit IRC | 21:37 | |
| *** Goneri has quit IRC | 21:46 | |
| *** rpothier has quit IRC | 21:48 | |
| shardy | slagle: Hey if you get a moment, could you revisit https://review.openstack.org/#/c/185882/ pls? | 21:56 |
| shardy | adds support for a zaqar transport to occ (heat already supports this, but we need occ for it to work with software deployments) | 21:57 |
| shardy | It needed a rebase after your previous review/+2 | 21:57 |
| *** shardy has quit IRC | 22:01 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 22:06 |
| *** rlandy has quit IRC | 22:08 | |
| *** jcoufal has quit IRC | 22:09 | |
| *** morazi has quit IRC | 22:20 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: loadbalancer: use 'source' for novnc balance mode https://review.openstack.org/219464 | 22:23 |
| *** pino|work has quit IRC | 22:35 | |
| *** chlong_ is now known as chlong | 23:18 | |
| *** olaph has joined #tripleo | 23:18 | |
| *** absubram has quit IRC | 23:24 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!