| openstackgerrit | Paul Belanger proposed openstack/python-tripleoclient: Initial support for bindep https://review.openstack.org/353929 | 00:05 |
|---|---|---|
| *** Ryjedo_ has joined #tripleo | 00:19 | |
| *** Ryjedo has quit IRC | 00:20 | |
| *** Ryjedo_ is now known as Ryjedo | 00:20 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove deprecated net_ip_subnet_map output https://review.openstack.org/346055 | 00:22 |
| pabelanger | EmilienM: bnemec: https://review.openstack.org/354448 fixes a typo with an ovb job. It should be in experimental-tripleo, not experimental | 00:23 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove deprecated net_ip_uri_map output https://review.openstack.org/354381 | 00:24 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove unneeded net_ip_map dump into hieradata https://review.openstack.org/354391 | 00:24 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Pass ServiceNetMap to services https://review.openstack.org/354414 | 00:26 |
| *** limao has joined #tripleo | 00:28 | |
| *** limao has quit IRC | 00:29 | |
| *** limao has joined #tripleo | 00:29 | |
| *** rajinir has quit IRC | 00:35 | |
| *** sarath has quit IRC | 00:47 | |
| EmilienM | pabelanger: ack | 00:49 |
| pabelanger | EmilienM: success! http://logs.openstack.org/29/353929/3/experimental/gate-tripleo-buildimage-overcloud-full-centos-7-nv/59f4e05//console.html | 00:52 |
| pabelanger | overcloud-full job working in experimental | 00:52 |
| EmilienM | pabelanger: awesome :D | 00:52 |
| pabelanger | http://logs.openstack.org/29/353929/3/experimental/gate-tripleo-buildimage-overcloud-full-centos-7-nv/59f4e05//logs/dib-overcloud-full.log | 00:52 |
| *** davidlenwell has quit IRC | 00:53 | |
| pabelanger | takes 25mins to build | 00:53 |
| *** TicToc has joined #tripleo | 00:59 | |
| TicToc | bash quickstart.sh localhost always ends up with a ssh to the undercloud error even though I can manually ssh into the undercloud instance .. any tips on getting things working | 01:05 |
| *** davidlenwell has joined #tripleo | 01:05 | |
| *** ChanServ sets mode: +v davidlenwell | 01:05 | |
| *** xuao has joined #tripleo | 01:06 | |
| *** TicToc has quit IRC | 01:15 | |
| *** rhallisey has joined #tripleo | 01:24 | |
| *** zeroshft has joined #tripleo | 01:26 | |
| *** zeroshft has quit IRC | 01:30 | |
| *** limao_ has joined #tripleo | 01:36 | |
| *** limao has quit IRC | 01:39 | |
| *** bana_k has quit IRC | 01:40 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Pass ServiceNetMap to services https://review.openstack.org/354414 | 01:56 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add temporary pin to last known good current tripleo repo https://review.openstack.org/354481 | 02:01 |
| *** rhallisey has quit IRC | 02:01 | |
| *** yamahata has quit IRC | 02:02 | |
| slagle | CI failing due to https://bugs.launchpad.net/tripleo/+bug/1612434 | TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt | 02:03 |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Undecided,New] | 02:03 |
| *** slagle changes topic to "CI failing due to https://bugs.launchpad.net/tripleo/+bug/1612434 | TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt" | 02:03 | |
| EmilienM | slagle: hey | 02:03 |
| EmilienM | I think I know why | 02:03 |
| EmilienM | isn't it required to the cinder volume thing? | 02:04 |
| EmilienM | cinder volume type ing* | 02:04 |
| slagle | yea we promoted a bad repo accidentally | 02:04 |
| slagle | it's in the bug | 02:04 |
| EmilienM | gfidente has a patch iirc | 02:04 |
| EmilienM | ok | 02:04 |
| gfidente | oh god guys | 02:04 |
| gfidente | I abandoned those all | 02:05 |
| EmilienM | slagle: what's the fix now? | 02:05 |
| gfidente | they fixed it in cinder | 02:05 |
| EmilienM | gfidente: you here???? | 02:05 |
| gfidente | and that's where the fix belongs :) | 02:05 |
| EmilienM | gfidente: it landed 53 minutes ago | 02:05 |
| EmilienM | https://review.openstack.org/#/c/353665/ | 02:05 |
| slagle | EmilienM: it's in the bug | 02:05 |
| gfidente | zaneb, is teaching me some python on a heat submission | 02:05 |
| EmilienM | swift also broke | 02:06 |
| slagle | EmilienM: we need to get the rdo admins to restore the previosu symlink, or we can go with this pin, https://review.openstack.org/#/c/354481/ | 02:06 |
| EmilienM | but I have a patch https://review.openstack.org/354476 | 02:06 |
| EmilienM | slagle: dmsimard is here | 02:06 |
| EmilienM | dmsimard: can you help dude? | 02:06 |
| dmsimard | help what | 02:06 |
| slagle | dmsimard: check your mail | 02:07 |
| EmilienM | can you restore the previous tripleo symlink please? | 02:07 |
| gfidente | slagle, shouldn't we get a new promote now that the fix is landed in cinder? | 02:07 |
| *** yamahata has joined #tripleo | 02:07 | |
| slagle | i emailed it to you | 02:07 |
| slagle | gfidente: no. b/c of like 2 or 3 new unrelated issues | 02:07 |
| slagle | the swift thing being one of them | 02:07 |
| EmilienM | slagle: fixed by https://review.openstack.org/354476 | 02:07 |
| EmilienM | slagle: see REGEX skills dude | 02:08 |
| dmsimard | slagle: the buildlogs content is a CDN | 02:08 |
| dmsimard | updating the symlink will not be effective immediate | 02:08 |
| dmsimard | tely | 02:08 |
| dmsimard | but I can check if the symlink was updated properly | 02:08 |
| gfidente | EmilienM, right, I believe without asking | 02:08 |
| dmsimard | slagle: the dlrn server has current-tripleo -> c6/bd/c6bd3cb95b9819c03345f50bf2812227e81314ab_4e6dfa3c right now | 02:09 |
| dmsimard | you want 8e/b0/8eb0c893074f6ba912114ce50995ee0118930775_fc22fbaf/ ? | 02:09 |
| EmilienM | dmsimard: yeah, should be ok for us | 02:10 |
| *** ooolpbot has joined #tripleo | 02:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 02:11 |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 02:11 |
| *** ooolpbot has quit IRC | 02:11 | |
| gfidente | I am leaving guys, drank too much | 02:11 |
| slagle | dmsimard: yes, we need to go back to the 8e/b0 one | 02:11 |
| gfidente | better to smoke now | 02:11 |
| EmilienM | gfidente: lol | 02:11 |
| gfidente | have good night | 02:11 |
| *** gfidente has quit IRC | 02:11 | |
| EmilienM | slagle: do you want me to +2 +A your ooo-ci patch? | 02:12 |
| slagle | EmilienM: if you want. we won't need it if the symlink gets updated | 02:12 |
| dmsimard | slagle: done lrwxrwxrwx. 1 root root 55 Aug 12 02:12 current-tripleo -> 8e/b0/8eb0c893074f6ba912114ce50995ee0118930775_fc22fbaf | 02:12 |
| EmilienM | good | 02:12 |
| EmilienM | so we don't need the ooo-ci patch | 02:12 |
| EmilienM | dmsimard: thx dude | 02:13 |
| dmsimard | slagle: please note that buildlogs is not updated immediately | 02:13 |
| slagle | dmsimard: thanks | 02:13 |
| slagle | ok | 02:13 |
| dmsimard | I will reply to the email | 02:13 |
| EmilienM | dmsimard: ok so Swift should be fixed in my patch | 02:13 |
| EmilienM | dmsimard: Nova error looked like random, since it passed on scenario001 | 02:13 |
| EmilienM | we should be good for a promotion this time... | 02:13 |
| *** slagle changes topic to "TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt" | 02:15 | |
| dmsimard | afk now | 02:15 |
| slagle | me 2 | 02:15 |
| slagle | night folks | 02:15 |
| EmilienM | night folks | 02:15 |
| *** zeroshft has joined #tripleo | 02:27 | |
| *** bswartz has quit IRC | 02:33 | |
| *** zeroshft has quit IRC | 02:36 | |
| *** bswartz has joined #tripleo | 02:37 | |
| *** zeroshft has joined #tripleo | 02:42 | |
| *** tzumainn has quit IRC | 02:46 | |
| *** zeroshft has quit IRC | 02:46 | |
| *** ayoung has joined #tripleo | 02:49 | |
| *** rhefner has quit IRC | 02:55 | |
| *** rhefner has joined #tripleo | 02:55 | |
| *** mwhahaha has quit IRC | 02:55 | |
| *** mwhahaha has joined #tripleo | 02:59 | |
| *** Ryjedo has quit IRC | 03:01 | |
| *** zeroshft has joined #tripleo | 03:02 | |
| *** zeroshft has quit IRC | 03:03 | |
| *** Ryjedo has joined #tripleo | 03:03 | |
| *** zeroshft has joined #tripleo | 03:03 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 03:10 |
| *** zeroshft has quit IRC | 03:12 | |
| *** limao_ has quit IRC | 03:13 | |
| *** yamahata has quit IRC | 03:14 | |
| *** links has joined #tripleo | 03:33 | |
| *** limao has joined #tripleo | 03:38 | |
| *** ayoung has quit IRC | 03:45 | |
| *** numans has joined #tripleo | 03:46 | |
| *** ramishra_ has joined #tripleo | 03:49 | |
| *** ramishra has quit IRC | 03:49 | |
| *** liverpooler has quit IRC | 03:49 | |
| *** masco has joined #tripleo | 04:02 | |
| *** numans has quit IRC | 04:03 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 04:10 |
| *** fragatina has quit IRC | 04:16 | |
| *** limao has quit IRC | 04:19 | |
| *** limao has joined #tripleo | 04:20 | |
| *** fragatina has joined #tripleo | 04:58 | |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Add support for OVS DPDK Bridge and Port https://review.openstack.org/338694 | 05:00 |
| *** skramaja has joined #tripleo | 05:00 | |
| *** radeks has joined #tripleo | 05:02 | |
| *** fragatina has quit IRC | 05:03 | |
| *** jaosorior has joined #tripleo | 05:04 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 05:10 |
| *** TicToc has joined #tripleo | 05:19 | |
| TicToc | still looking for some help on the Localhost install and the ssh into undercloud or some other tips I can try | 05:23 |
| jaosorior | TicToc: It's pretty early at the moment for people. Might need to wait for later when more people log in | 05:27 |
| jaosorior | I'd say a couple of hours | 05:27 |
| TicToc | thanks! | 05:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Include journal in the outputted logs https://review.openstack.org/354536 | 05:30 |
| *** coolsvap has joined #tripleo | 05:34 | |
| *** r-mibu_ has quit IRC | 05:46 | |
| *** r-mibu has joined #tripleo | 05:46 | |
| *** rcernin has quit IRC | 05:51 | |
| *** hewbrocca-afk is now known as hewbrocca | 05:53 | |
| *** saneax_AFK is now known as saneax | 05:54 | |
| *** saneax is now known as Guest89739 | 05:54 | |
| jaosorior | hewbrocca: hey man, do you remember what happened to that cinder volume type issue that was blocking RDO promotino? | 06:00 |
| jaosorior | *promotion | 06:00 |
| *** xuao has quit IRC | 06:01 | |
| openstackgerrit | Merged openstack/tripleo-common: Fix upload-swift-artifacts with keystone v3 https://review.openstack.org/300139 | 06:06 |
| hewbrocca | jaosorior: I think we worked around it in t-h-t, but then something else (of course) came along that is blocking rdo promotion | 06:07 |
| *** limao has quit IRC | 06:08 | |
| *** limao_ has joined #tripleo | 06:08 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 06:10 |
| *** jprovazn has joined #tripleo | 06:11 | |
| jaosorior | hewbrocca: I think this bug is related to the volume type issue ^^ | 06:12 |
| *** limao_ has quit IRC | 06:15 | |
| *** limao has joined #tripleo | 06:15 | |
| jaosorior | ah, funky, multinode-nonha seems to be passing now | 06:16 |
| jaosorior | cool | 06:16 |
| *** fultonj has quit IRC | 06:17 | |
| *** rcernin has joined #tripleo | 06:22 | |
| *** aufi has joined #tripleo | 06:23 | |
| *** pgadiya has joined #tripleo | 06:30 | |
| *** pgadiya has quit IRC | 06:31 | |
| hewbrocca | jaosorior: huh does that mean we can close that bug? | 06:38 |
| Jokke_ | moin | 06:38 |
| jaosorior | hewbrocca: lets wait a few more patches to pass CI | 06:40 |
| ccamacho | Happy Friday guys! | 06:47 |
| Jokke_ | stormy Friday it is | 06:50 |
| ccamacho | Here in Madrid its like to be in the Sahara :P | 06:52 |
| Jokke_ | Got one of those "Unplug everything" Thunderstorms coming over abount an hour ago | 06:54 |
| bandini | morning folks | 06:56 |
| bandini | ccamacho: lovely 16 degrees here :P | 06:56 |
| * bandini *ducks* | 06:56 | |
| bandini | folks, can we get some reviews on the monitoring agents reviews: https://review.openstack.org/#/c/254788/? CI passed, I tested it as well and we need it for our upcoming opstools work. | 06:57 |
| bandini | eternal glory and beers from me as reward :) | 06:58 |
| *** tesseract- has joined #tripleo | 06:59 | |
| ccamacho | :) ajaj bandini, deploying your submission, after it finishes, what can I run to check that actually works as expected? | 07:02 |
| *** ebalduf has quit IRC | 07:03 | |
| *** florianf has joined #tripleo | 07:06 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 07:10 |
| bandini | ccamacho: so just set some bogus monitoring parameters (https://paste.fedoraproject.org/406579/85866147/) and verify that in /etc/sensu/*json everything is configured correctly | 07:11 |
| bandini | ccamacho: a more thorough test needs the monitoring node stuff to land, and that is not finished yet | 07:11 |
| ccamacho | nice :) Ill let you know when it finishes | 07:12 |
| bandini | ccamacho: thank you, sir ;) | 07:13 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Include journal in the outputted logs https://review.openstack.org/354536 | 07:16 |
| *** yamahata has joined #tripleo | 07:19 | |
| *** jpena|off is now known as jpena | 07:25 | |
| *** akuznetsov has joined #tripleo | 07:31 | |
| *** ebarrera has joined #tripleo | 07:38 | |
| *** abehl has joined #tripleo | 07:40 | |
| *** abehl has quit IRC | 07:41 | |
| *** iogg has joined #tripleo | 07:42 | |
| *** akuznetsov has quit IRC | 07:43 | |
| *** pgadiya has joined #tripleo | 07:44 | |
| *** amoralej|off is now known as amoralej | 07:44 | |
| *** Guest89739 has quit IRC | 07:45 | |
| *** ifarkas_afk is now known as ifarkas | 07:46 | |
| *** saneax has joined #tripleo | 07:46 | |
| *** saneax is now known as Guest34085 | 07:47 | |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Add support for OVS DPDK Bond https://review.openstack.org/349183 | 07:48 |
| *** jpich has joined #tripleo | 07:49 | |
| *** ohamada has joined #tripleo | 07:49 | |
| *** xuao has joined #tripleo | 07:49 | |
| jaosorior | hewbrocca, shardy, I guess we can close that bug 1612434. Doesn't seem to be failing anymore | 07:49 |
| openstack | bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] https://launchpad.net/bugs/1612434 | 07:49 |
| *** iogg has quit IRC | 07:49 | |
| *** milan has joined #tripleo | 07:50 | |
| *** xuao has quit IRC | 07:51 | |
| *** xuao has joined #tripleo | 07:51 | |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Add support for OVS DPDK Bond https://review.openstack.org/349183 | 07:52 |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Add support for OVS DPDK Bridge and Port https://review.openstack.org/338694 | 07:52 |
| *** hewbrocca is now known as hewbrocca-afk | 07:54 | |
| *** yamahata has quit IRC | 07:55 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Availability monitoring agents support https://review.openstack.org/254788 | 07:59 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Monitoring node support https://review.openstack.org/349690 | 07:59 |
| marios | bandini: heh we pushed the button at the same time | 08:00 |
| marios | bandini: ah ok my vote wasn't wiped so np | 08:00 |
| bandini | marios: yeah it was just a rebase, although I did explicitly add --no-rebase to git review so I have no idea how that happened | 08:01 |
| marios | bandini: well, was gfidente anywhere near you when this occurred? | 08:01 |
| bandini | marios: ahahahah | 08:01 |
| *** Goneri has joined #tripleo | 08:04 | |
| *** athomas has joined #tripleo | 08:07 | |
| *** social has joined #tripleo | 08:08 | |
| *** TicToc has quit IRC | 08:08 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 08:10 |
| *** shardy has joined #tripleo | 08:11 | |
| Jokke_ | shardy: morning | 08:13 |
| shardy | Jokke_: Hi! | 08:13 |
| Jokke_ | shardy: I think Won't Fix is the right one to close that https://bugs.launchpad.net/tripleo/+bug/1589922 | 08:14 |
| openstack | Launchpad bug 1589922 in tripleo "OSD data dir expected in /var/lib/ceph/osd" [High,In progress] - Assigned to Erno Kuvaja (jokke) | 08:14 |
| *** xuao has quit IRC | 08:14 | |
| shardy | Jokke_: ack - gfidente said he was looking into a fix yesterday, I assume you guys have discussed it? | 08:14 |
| Jokke_ | shardy: actually we haven't ... that whole thing was deemed too dagerous to fix due to upgrades | 08:15 |
| *** lucas-dinner is now known as lucasagomes | 08:15 | |
| Jokke_ | that was at least the last discussion we had with wider audience | 08:16 |
| *** xuao has joined #tripleo | 08:16 | |
| Jokke_ | and it's annoyance at max anyways | 08:16 |
| shardy | Jokke_: Ok, sounds good, well lets sync with gfidente when he comes online and if you guys agree we'll wontfix it and remove from n-3 | 08:16 |
| shardy | thanks for the update | 08:16 |
| Jokke_ | sure | 08:16 |
| shardy | I agree it seems risky for something pretty minor | 08:16 |
| *** skramaja has quit IRC | 08:18 | |
| *** dbecker has joined #tripleo | 08:20 | |
| *** stendulker has joined #tripleo | 08:25 | |
| *** TicToc has joined #tripleo | 08:26 | |
| *** TicToc has quit IRC | 08:27 | |
| *** xuao has quit IRC | 08:28 | |
| *** electrofelix has joined #tripleo | 08:28 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Allow to skip kernel cleanup https://review.openstack.org/353994 | 08:29 |
| *** hewbrocca-afk is now known as hewbrocca | 08:29 | |
| *** bfournie1 has joined #tripleo | 08:31 | |
| *** bfournie has quit IRC | 08:33 | |
| *** bfournie1 has quit IRC | 08:36 | |
| *** gfidente has joined #tripleo | 08:37 | |
| *** gfidente has quit IRC | 08:37 | |
| *** gfidente has joined #tripleo | 08:37 | |
| *** numans has joined #tripleo | 08:37 | |
| *** Goneri has quit IRC | 08:38 | |
| *** anshul has joined #tripleo | 08:43 | |
| *** radeks has quit IRC | 08:46 | |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Use non-bracketed version of addresses for keystone.initialize https://review.openstack.org/354443 | 08:47 |
| ccamacho | bandini my local env hangs on any deployment.. still trying to make it work.. | 08:48 |
| *** oshvartz has joined #tripleo | 08:49 | |
| shardy | Anyone looked into why even the nonha job is now taking over 2.5hrs to run? | 08:51 |
| shardy | some jobs are getting killed by the infra timeout even when everything has worked, it's just taking too long :( | 08:51 |
| shardy | My local testing indicates we're spending a really long time in Step3 because of keystone stuff | 08:52 |
| *** dtantsur|afk is now known as dtantsur | 08:52 | |
| *** d0ugal has quit IRC | 08:52 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Pass ServiceNetMap to services https://review.openstack.org/354414 | 08:52 |
| *** Goneri has joined #tripleo | 08:53 | |
| bandini | ccamacho: oh ouchers | 08:55 |
| ccamacho | shardy that might the same issue hitting me today | 08:55 |
| ccamacho | **might be | 08:56 |
| ccamacho | I'm waiting for the deployment to fail and check what's going up there | 08:57 |
| bandini | I did not notice that last night, will retry this morning and see what's up | 08:57 |
| shardy | gfidente: Hey, re passing the ServiceNetMap - I had one alternative idea | 08:57 |
| shardy | what if we wrote the ServiceNetMap and the per-node NetIpMap in hiera | 08:58 |
| *** athomas has quit IRC | 08:58 | |
| shardy | then used a two step hiera interpolation? | 08:58 |
| shardy | http://paste.openstack.org/show/555928/ | 08:58 |
| shardy | e.g like that | 08:58 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/348695 | 08:58 |
| dtantsur | hey folks! I've got a new bunch of changes for ironic-in-overcloud up: https://review.openstack.org/#/c/341433/ | 08:58 |
| dtantsur | this brings us to the point of nova-compute installed on the controller and recognizing Ironic resources | 08:58 |
| dtantsur | folks keen on using THT for installing undercloud should definitely review it ;) | 08:58 |
| shardy | gfidente: then in the service template, it'd just be like "%{hiera(\"HeatApiNetwork\")}" | 08:58 |
| dtantsur | the WIP docs if you want to try it: https://review.openstack.org/354016 | 08:59 |
| gfidente | shardy, right but didn't we want to do it in heat? | 08:59 |
| gfidente | what I was doing is setting bind_host: {get_param: ServiceNeMap} | 09:00 |
| shardy | gfidente: sure, either way is valid - I just thought previously we said the hiera approach was not possible because interpolation can't do a map lookup | 09:00 |
| gfidente | ao that map_replace would replace internal_api with the net_ip_map address | 09:00 |
| shardy | this would be a way around that | 09:00 |
| gfidente | if we wanted to lookup say the _uri or _subnet | 09:01 |
| jaosorior | shardy: What keystone stuff is taking that long? | 09:01 |
| gfidente | we'd have to do the mangling in heat anyway to make hiera interpolation to work | 09:01 |
| *** numans has quit IRC | 09:01 | |
| shardy | jaosorior: creating roles, users and stuff | 09:01 |
| shardy | it takes forever | 09:01 |
| shardy | I think retry logic was added which means it's spinning on each step | 09:02 |
| shardy | chem: ^^ can you confirm, puppet-keystone now retries all-the-things because keystone was being flaky? | 09:02 |
| jpich | Is tripleo-common part of the "non-client library freeze" or is it something else? Would a cycle-trailing deadline also apply here? | 09:02 |
| shardy | gfidente: Yeah, true, Ok cool, just wanted to mention it :) | 09:02 |
| gfidente | the hiera way tough doesn't require us to pass servicenetmap to the services | 09:02 |
| *** athomas has joined #tripleo | 09:03 | |
| gfidente | but I like heat way of doing | 09:03 |
| shardy | gfidente: ack, fine we can continue with the heat approach for sure | 09:03 |
| shardy | gfidente: https://review.openstack.org/#/c/353680/ got me thinking about the hiera options, that's all :) | 09:04 |
| *** xuao has joined #tripleo | 09:04 | |
| shardy | I was working on that yesterday with EmilienM, so we can adjust the puppet providers to enable interpolating the per-service rabbit_ips | 09:04 |
| hewbrocca | oh, ugh, is that why we're running out of memory setting up keystone? | 09:07 |
| hewbrocca | It seems absurd that it should be this difficult... | 09:07 |
| shardy | hewbrocca: Yeah, we need to investigate further, it shouldn't be this difficult, and we shouldn't really need while(true) around openstackclient stuff in puppet | 09:08 |
| marios | hewbrocca: is it multicore boxes? because puppet-keystone default makes for bad performace (but is/should be fixed in master) sec there was a bz | 09:08 |
| shardy | something in either our ordering, or keystone, must be broken | 09:08 |
| jaosorior | this looks suspicious in puppet-keystone https://github.com/openstack/puppet-keystone/commit/07cee48dfc63641e9390ea6fd4c7034fe06f28d2 | 09:10 |
| marios | https://bugzilla.redhat.com/show_bug.cgi?id=1347305 shardy is this somethign in ci you are talking about /me reads back | 09:10 |
| openstack | bugzilla.redhat.com bug 1347305 in openstack-tripleo-heat-templates "Overcloud deployed with keystone as single process leads to abysmal performance" [Unspecified,On_qa] - Assigned to mandreou | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 09:10 |
| jaosorior | specially that last sentence in the commit message | 09:10 |
| jaosorior | shardy ^^ | 09:11 |
| *** panda|zz is now known as panda | 09:12 | |
| *** pkovar has joined #tripleo | 09:13 | |
| *** numans has joined #tripleo | 09:13 | |
| shardy | https://github.com/openstack-infra/tripleo-ci/blob/master/test-environments/worker-config.yaml#L10 | 09:13 |
| shardy | KeystoneWorkers: 1 in CI | 09:13 |
| *** chem has quit IRC | 09:15 | |
| shardy | Ok lets try increasing that, but we've also got OOM issues, so probably not by too much | 09:15 |
| marios | shardy: well there is also a lp for it fwiw https://bugs.launchpad.net/tripleo/+bug/1598092 | 09:15 |
| openstack | Launchpad bug 1598092 in tripleo "Performance issues with keystone under wsgi apache on a multinode machine" [Medium,Fix released] - Assigned to Marios Andreou (marios-b) | 09:15 |
| shardy | marios: ya, but I think with your patch landed, we still force the number of workers to 1 in CI | 09:15 |
| gfidente | marios, shardy though I think we're running with 1 worker from quite a while now | 09:16 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Try increasing KeystoneWorkers to improve performance https://review.openstack.org/354606 | 09:17 |
| shardy | lets see how that goes | 09:18 |
| *** limao has quit IRC | 09:18 | |
| gfidente | ok I'm looking at ordering | 09:18 |
| marios | shardy: ack at least it is still overriding the Threads to 1 (in hiera) so possibly it isn't the same issue. I mean, bug was was because workers 1 and processor threads but the ci env had then 1 worker (override) and 1 thread (we specify via hiera for that bugfix) | 09:18 |
| shardy | marios: ya, but with that change to KeystoneWorkers, and your patch that landed, we'll increase keystone::wsgi::apache::workers from 1, right? | 09:19 |
| shardy | and the bz says to increase that while leaving threads as 1, so hopefully the CI change may help? | 09:19 |
| marios | shardy: yeah if you > in ci the override it should help | 09:20 |
| shardy | cool, thanks, lets see how long it takes | 09:20 |
| * shardy will time it locally too | 09:20 | |
| shardy | Another wierd thing is keystone-manage bootstrap seems to get stuck sometimes | 09:21 |
| shardy | http://paste.openstack.org/show/555940/ | 09:21 |
| shardy | it's possible that's related to my local environment though, but it doesn't fail gracefully when keystone isn't responding | 09:22 |
| shardy | just gets wedged forever | 09:22 |
| *** chem has joined #tripleo | 09:23 | |
| jaosorior | shardy: chem just logged in ^^ | 09:24 |
| chem | jaosorior: hi, well, I just reconnect actualy :) | 09:25 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Devmode: rename delorean current so any existing repo is overwritten https://review.openstack.org/335953 | 09:25 |
| gfidente | though looking at our keystone profile is substantially unchanged from june | 09:26 |
| jaosorior | chem: aah, alright, sorry about the extra ping then | 09:26 |
| chem | jaosorior: but I did lost some minutes of log, what's the matter ? | 09:26 |
| shardy | chem: Hey, I noticed that our deployment step where we configure keystone is taking a long time recently | 09:27 |
| *** stendulker has quit IRC | 09:27 | |
| shardy | chem: I wanted to confirm, are there retry loops around things like creating roles and users via openstackclient in puppet-keystone now? | 09:27 |
| gfidente | but I think one thing we could try is to move ::roles and ::endpoint in 4 | 09:27 |
| gfidente | so I'll try that | 09:27 |
| chem | shardy: they have always been retry around *all* openstack call in puppet lib. The default timeout/retry has indeed been modified some time ago: each call is tried during a longer time and the overall time we retry stuff as been increased as well | 09:29 |
| chem | shardy: been done to accomodate CI | 09:29 |
| shardy | chem: Ok, thanks | 09:29 |
| chem | shardy: https://github.com/openstack/puppet-openstacklib/blob/stable/mitaka/lib/puppet/provider/openstack.rb#L17-L20 | 09:30 |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Move ::roles and ::endpoint after ::keystone and ::wsgi https://review.openstack.org/354613 | 09:31 |
| gfidente | ^^ that's an attempt to avoid the retries | 09:32 |
| shardy | chem: is there a similar timeout around the /usr/bin/keystone-manage bootstrap command? | 09:33 |
| chem | shardy: hum ... unlikely. let me check. | 09:33 |
| shardy | chem: In my local testing it looks like it's possible for that to get stuck (if keystone is misconfigured or otherwise unresponsive) | 09:34 |
| *** jpeeler has quit IRC | 09:35 | |
| chem | shardy: keystone-manage is simply a exec puppet resource, no provider, no default retry. | 09:36 |
| shardy | chem: Ok, thanks, that explains what I was seeing then | 09:36 |
| *** mgould|afk is now known as mgould | 09:47 | |
| *** jpeeler has joined #tripleo | 09:50 | |
| *** ooolpbot has joined #tripleo | 10:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1612434 | 10:11 |
| *** ooolpbot has quit IRC | 10:11 | |
| openstack | Launchpad bug 1612434 in tripleo "multinode jobs failing during pingtest with "Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown""" [Critical,In progress] | 10:11 |
| *** Ryjedo_ has joined #tripleo | 10:11 | |
| *** Ryjedo has quit IRC | 10:12 | |
| *** Ryjedo_ is now known as Ryjedo | 10:12 | |
| *** coolsvap is now known as _coolsvap_ | 10:13 | |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo: UI profile for tripleo https://review.openstack.org/354630 | 10:14 |
| *** tosky has joined #tripleo | 10:15 | |
| openstackgerrit | Martin André proposed openstack/instack-undercloud: Introduce 'enable_ui' option https://review.openstack.org/344140 | 10:19 |
| *** dtantsur is now known as dtantsur|brb | 10:20 | |
| * rook reads back.. shardy you guys are going to fix the KeyStone worker bug where you create 1 process and # of cores as threads? -- there are other services that are like that not sure if you want to tackle those too | 10:26 | |
| *** xuao has quit IRC | 10:27 | |
| *** leanderthal|afk is now known as leanderthal | 10:27 | |
| *** xuao has joined #tripleo | 10:29 | |
| shardy | rook: Yeah, but we'll have to look at where the fix goes - traditionally the defaults to launch number of workers == number of cores happened in oslo, but that doesn't apply with the move to httpd for many services | 10:32 |
| rook | right, it is a total regression wrt Performance. | 10:32 |
| rook | wrt Keystone and Ceilometer for example | 10:32 |
| shardy | rook: Sure, but we've generally just deployed the service defaults, so it'd be nice if there was a common solution which just made those defaults sane again | 10:33 |
| rook | right | 10:33 |
| shardy | vs a special-case for TripleO | 10:33 |
| shardy | if we need to it can be calculated and set via puppet tho | 10:33 |
| rook | shardy: we have _tried_ to fix this upstream just get the whole: We don't tune for performance bullshit answer. | 10:33 |
| rook | and it isn't a performance thing, it is just a regression | 10:34 |
| rook | we even shared performance results. | 10:34 |
| shardy | rook: Ok, well that definitely sucks, if folks want to httpd all the things they should deal with the fallout IMO | 10:34 |
| *** pkovar has quit IRC | 10:34 | |
| shardy | rook: raise a tripleo bug if you haven't already (performance results would be great), we'll figure out some way to wire in sane defaults | 10:35 |
| rook | we have one for keystone for sure. | 10:35 |
| shardy | rook: we can also discuss with EmilienM, sounds like something the puppet community may already be seeking to address in a common way | 10:37 |
| *** xuao has quit IRC | 10:38 | |
| *** dsariel has quit IRC | 10:43 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: [WIP] Parameters listing and updating https://review.openstack.org/351554 | 10:48 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Allow to skip kernel cleanup https://review.openstack.org/353994 | 10:49 |
| *** dsariel has joined #tripleo | 10:55 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Reinstate CloudDomain properties for Controller/Compute roles https://review.openstack.org/354069 | 11:00 |
| slagle | anyone looking into the latest CI error? Exception registering nodes: Node 59ecc491-41b0-4950-8d00-ddce532ba0f4 is locked by host localhost.localdomain, please retry after the current operation is completed | 11:09 |
| shardy | slagle: I just saw that one a moment ago, until then most failures I've seen have been timeouts | 11:10 |
| jistr | chem: hi, are you still looking into the puppet-pacemaker refactoring? is that something likely to land in Newton? (The reason i ask is that i'm kinda tempted to make an attempt to solve our 'services are always restarted on stack-update and scale up' problem. The solution would probably be slightly different based on if we do or do not have the refactoring already present.) | 11:11 |
| shardy | http://logs.openstack.org/37/353637/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/064451b/console.html#_2016-08-12_08_50_16_458188 | 11:11 |
| shardy | happended here, not yet looked into why or reproduced | 11:11 |
| slagle | shardy: ok it's affecting the periodic job as well, wasn't sure about check-tripleo | 11:11 |
| slagle | https://bugs.launchpad.net/tripleo/+bug/1612622 | 11:12 |
| openstack | Launchpad bug 1612622 in tripleo "CI: Exception registering nodes: Node 59ecc491-41b0-4950-8d00-ddce532ba0f4 is locked by host localhost.localdomain, please retry after the current operation is completed" [Critical,In progress] - Assigned to James Slagle (james-slagle) | 11:12 |
| slagle | bug filed anyway | 11:12 |
| shardy | slagle: I pushed https://review.openstack.org/#/c/354606/ because many patches I looked at have hit the infra timeout even for the nonha job | 11:12 |
| shardy | slagle: my local testing indicates that is at least in part because the keystone performance during step3 is horrible | 11:13 |
| chem | jistr: basically everything is in place. I was waiting for the pacemaker light architecture (pla) to land to make the refactoring on puppet-triplo/tht . I don't know the current status of the pla, do you ? | 11:14 |
| slagle | shardy: yea i've noticed the same | 11:14 |
| *** weshay has joined #tripleo | 11:14 | |
| chem | jistr: when newtown is supposed to land ? | 11:14 |
| jistr | chem: if you mean the next gen architecture where we don't manage OS services with pacemaker, i think that's already landed now | 11:15 |
| jistr | chem: IIRC the code freeze for Newton is around the end of this month or beginning of next one | 11:15 |
| shardy | http://releases.openstack.org/newton/schedule.html | 11:16 |
| *** yolanda has quit IRC | 11:16 | |
| shardy | we agreed to observe feature freeze at the same time as other projects, so the end of this month, with the possibility of feature freeze exceptions | 11:17 |
| chem | oki, so newton will be with the new pacemker architecture. If it has landed, then, I could tell you by next mid-week if there is hope to have it landed before the end of the month. Would it be ok for you ? | 11:17 |
| *** thrash|g0ne is now known as thrash | 11:18 | |
| *** yolanda has joined #tripleo | 11:18 | |
| chem | jistr: ^ we could arrange a quick meeting to discuss its state, WDYT ? | 11:18 |
| jistr | chem: yea sure. Just to clarify the intention -- you want to arrange the meeting next week or now? I'm fine with either. | 11:19 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: Only set if it is not already defined https://review.openstack.org/354365 | 11:20 |
| jistr | chem: possibly next week we'll have more data though. I could *hopefully* (just got pinged with 2 BZs :D) look into possible approach re the restart problem and try guesssing how much it's interwoven with the puppet-pacemaker refactoring. E.g. can we do it in parallel, or do we have to land the refactoring first. | 11:23 |
| jistr | chem: i think the landcape changed quite a bit with the next gen HA for both (both the refactoring and the restart issue) | 11:23 |
| jistr | changed for the better i should say :) | 11:24 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: update service workers to match upstream https://review.openstack.org/354660 | 11:27 |
| chem | jistr: on Wednesday if that's fine by you. I can arrange it. It gives me time I have to have a look at the current state of the tht and my patch refactoring (Monday is off in France) | 11:28 |
| jistr | chem: sure, WFM, thanks :) | 11:28 |
| *** jaosorior has quit IRC | 11:29 | |
| chem | jistr: ack, nice. Thanks for reaching out. I'll send the invitatation as soon as I've deciphered how to do such thing with google stuff. | 11:30 |
| *** jaosorior has joined #tripleo | 11:30 | |
| *** maeca1 has joined #tripleo | 11:32 | |
| jaosorior | whois weshay | 11:32 |
| jaosorior | weshay, larsks, are you guys around? | 11:32 |
| weshay | hey | 11:32 |
| jaosorior | weshay: hey dude, quickstart related question | 11:33 |
| jaosorior | weshay: So...I'm deploying my overcloud nodes with network isolation. And I see that the network-environment.yaml is autogenerated. Where is the DnsServers option coming from? | 11:33 |
| jaosorior | somehow when I have network isolation I'm not able to ping it. Thought it would be the hypervisor host there | 11:34 |
| *** dtantsur|brb is now known as dtantsur | 11:34 | |
| weshay | jaosorior, undercloud/defaults line 23 | 11:35 |
| weshay | the external network is defined in roles/common/defaults/main.yml line 91 | 11:36 |
| EmilienM | hello | 11:36 |
| chem | yo | 11:37 |
| jaosorior | weshay: alright, makes sense... now it seems there's a route missing or something of the sort there. The one that's configured by default by quickstart is not usable if I use network isolation | 11:38 |
| jaosorior | EmilienM: hey dude, how's it going? | 11:38 |
| *** jistr has quit IRC | 11:39 | |
| EmilienM | jaosorior: good thx | 11:41 |
| Jokke_ | jaosorior: I would have assumed _isolation_ being indication for that, maybe jut me ;) | 11:41 |
| Jokke_ | just | 11:41 |
| *** StevenK has quit IRC | 11:41 | |
| *** StevenK has joined #tripleo | 11:42 | |
| jaosorior | Jokke_: the nameserver is in the management network... not sure if the nodes not being able to access the name sever which is in the management network is assumed with network isolation | 11:42 |
| gfidente | shardy, jaosorior in a combination of rechecks this passed all jobs https://review.openstack.org/#/c/342900/ | 11:46 |
| gfidente | I would actually merge it before we need more rebases and such | 11:46 |
| gfidente | ack? | 11:46 |
| jaosorior | ack | 11:47 |
| *** masco has quit IRC | 11:52 | |
| Jokke_ | jaosorior: I might have been trolling just a tiny bit with that comment ;) | 11:55 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: tripleo-jobs-gerrit.py: update undercloud & multinode job names https://review.openstack.org/354679 | 11:56 |
| EmilienM | slagle: ^ | 11:56 |
| jaosorior | EmilienM: hey dude, what's your opinion on https://review.openstack.org/#/c/353865/ ? I actually now unsure if we need ~> | 11:56 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-common: Minor update to the upgrade-non-controller.sh https://review.openstack.org/354680 | 11:56 |
| slagle | EmilienM: thanks. i was wondering what was up with that :) | 11:56 |
| jaosorior | Jokke_: hah fair enough. I need coffee | 11:57 |
| EmilienM | jaosorior: ok keep it | 11:57 |
| EmilienM | jaosorior: +2 | 11:57 |
| EmilienM | shardy, rook: what's up? | 11:58 |
| jaosorior | Any +A for this? https://review.openstack.org/#/c/353865/2 | 11:58 |
| *** Guest34085 is now known as saneax_AFK | 12:00 | |
| *** lucasagomes is now known as lucas-hungry | 12:00 | |
| jaosorior | thanks slagle | 12:01 |
| *** ccamacho is now known as ccamacho|lunch | 12:02 | |
| *** morazi has joined #tripleo | 12:04 | |
| shardy | gfidente: ack, yes, thanks for approving! :) | 12:05 |
| *** jayg|g0n3 is now known as jayg | 12:06 | |
| shardy | EmilienM: Hey, there has been discussion re the default workers/threads for services that are moving to httpd, e.g keystone | 12:06 |
| shardy | previously oslo.service defaults mostly meant that it was easy to default to workers == num_cpu's | 12:06 |
| shardy | but now the defaults generally appear to be 1, which results in a performance regression on upgrade | 12:07 |
| EmilienM | shardy: afik we didn't change the default in puppet-* | 12:07 |
| EmilienM | it must be in THT services | 12:07 |
| *** pkovar has joined #tripleo | 12:07 | |
| *** bfournie has joined #tripleo | 12:07 | |
| EmilienM | oh wait | 12:07 |
| EmilienM | I am wrong | 12:07 |
| shardy | EmilienM: THT doesn't know the number of CPUs per node, can we detect that through some puppet facts? | 12:07 |
| EmilienM | sure we can | 12:08 |
| EmilienM | so let me rephrase my statement : | 12:08 |
| EmilienM | httpd config in puppet-* modules are using 1 by default (I don't know why) | 12:08 |
| EmilienM | example here: https://github.com/openstack/puppet-keystone/blob/master/manifests/wsgi/apache.pp#L168 | 12:08 |
| shardy | EmilienM: Ok, well https://bugzilla.redhat.com/show_bug.cgi?id=1347305 started this discussion | 12:08 |
| *** morazi has quit IRC | 12:08 | |
| openstack | bugzilla.redhat.com bug 1347305 in openstack-tripleo-heat-templates "Overcloud deployed with keystone as single process leads to abysmal performance" [Unspecified,On_qa] - Assigned to mandreou | 12:08 |
| shardy | it appears that for upgrading operators, that is a bad/surprising new default | 12:08 |
| EmilienM | so yeah, we could override the value | 12:09 |
| EmilienM | and use the fact | 12:09 |
| shardy | when previously taking no action resulted in num_cores | 12:09 |
| *** morazi has joined #tripleo | 12:09 | |
| EmilienM | do we want to use $::processorcount ? | 12:09 |
| shardy | if that's not going to be handled in the puppet modules, I guess we'll have to change THT for every service that's under httpd | 12:09 |
| EmilienM | workers = $::processorcount ? | 12:09 |
| shardy | EmilienM: Yeah, but we'll still need to allow override via the *Workers parameters | 12:09 |
| EmilienM | sure | 12:10 |
| EmilienM | we can change it in puppet modules | 12:10 |
| shardy | EmilienM: anyway, not something we have to do right now, I just wondered if the puppet community were already addressing it, e.g by setting defaults to processorcount | 12:10 |
| EmilienM | the question is to what | 12:10 |
| EmilienM | we set: threads to $::processorcount already | 12:10 |
| EmilienM | do we would need to set $workers too? | 12:10 |
| ansiwen | hi EmilienM | 12:10 |
| shardy | EmilienM: ah, well in the bz it suggests threads=1 and workers=processorcount | 12:11 |
| EmilienM | we have physicalprocessorcount and processorcount facts | 12:11 |
| shardy | so we may need to do some testing and see if those settings are interchangeable | 12:11 |
| EmilienM | ok so thread would be physicalprocessorcount | 12:11 |
| *** iogg has joined #tripleo | 12:11 | |
| EmilienM | and workers=processorcount | 12:11 |
| ansiwen | regarding the buckets_path problem of the puppet-ec2api: it's set here https://github.com/openstack/puppet-ec2api/blob/master/manifests/s3.pp#L65 | 12:11 |
| EmilienM | right? | 12:11 |
| shardy | EmilienM: Yeah, what is suggested in the bz is workers=processorcount and threads=1 | 12:12 |
| *** bfournie has quit IRC | 12:12 | |
| shardy | I *think* that is the closest we can get the old behavior, but I've not tested to compare threads/workers count | 12:12 |
| EmilienM | threads=1 ? we need to hardcode 1? | 12:12 |
| ansiwen | EmilienM: does it mean the default value is wrong, or do we always have to set it accordingly when instantiation ec2api::s3 ? | 12:12 |
| *** ohamada has quit IRC | 12:13 | |
| EmilienM | shardy: https://review.openstack.org/#/c/297342/9/manifests/wsgi/apache.pp | 12:13 |
| EmilienM | someone tried already | 12:13 |
| shardy | EmilienM: aha, that is the reporter of the BZ ;) | 12:14 |
| EmilienM | shardy: I'll take over the patch | 12:14 |
| EmilienM | and try again | 12:14 |
| shardy | EmilienM: thanks - we may need some more performance results to establish good defaults I guess | 12:14 |
| shardy | rook: ^^ can you help with that? | 12:14 |
| EmilienM | yeah | 12:14 |
| *** rhallisey has joined #tripleo | 12:15 | |
| shardy | EmilienM: I can say the current settings cause horrible performance for keystone, I've seen it locally | 12:15 |
| EmilienM | shardy: how urgent is it? | 12:15 |
| *** ohamada has joined #tripleo | 12:15 | |
| shardy | EmilienM: Not super urgent, but something we need to fix before users upgrade to newton | 12:15 |
| EmilienM | shardy: ok I'll fix it today if I can | 12:16 |
| EmilienM | trying to prioritize a bit :) | 12:16 |
| shardy | EmilienM: sure, I'd leave it until next week if you have other stuff to do, just wanted to discuss it :) | 12:16 |
| shardy | thanks! | 12:17 |
| EmilienM | ansiwen: I haven't looked depper but it looks like the default value in ec2api might be risky or packaging broken. Again I have no idea about ec2api, I tried to help you on the puppet side | 12:17 |
| *** amoralej is now known as amoralej|lunch | 12:23 | |
| *** jistr has joined #tripleo | 12:24 | |
| *** jpena is now known as jpena|lunch | 12:25 | |
| EmilienM | shardy: https://review.openstack.org/#/c/297342/ | 12:25 |
| pabelanger | panda: myoung: So, this passed last night: http://logs.openstack.org/29/353929/3/experimental/gate-tripleo-buildimage-overcloud-full-centos-7-nv/59f4e05/console.html It is the experimental job I added to build overcloud-full.qcow2 outside tripleo-ci | 12:26 |
| shardy | EmilienM: thanks! :) | 12:27 |
| *** fultonj has joined #tripleo | 12:27 | |
| ansiwen | EmilienM: where does the packaging happen? is that dlrn? or rdo? | 12:29 |
| EmilienM | dlrn is rdo | 12:30 |
| *** jistr has quit IRC | 12:31 | |
| *** jistr has joined #tripleo | 12:32 | |
| *** chlong|mtg has quit IRC | 12:33 | |
| ansiwen | EmilienM: I thought dlrn is built for fedora on a nightly basis, and RDO is build for centos releases? | 12:35 |
| *** fultonj has quit IRC | 12:35 | |
| *** fultonj has joined #tripleo | 12:36 | |
| *** dbecker has quit IRC | 12:37 | |
| *** jistr has quit IRC | 12:41 | |
| EmilienM | ansiwen: no, dlrn builds at each commit in OpenStack, and we support Fedora and CentOS. | 12:42 |
| EmilienM | please read https://trunk.rdoproject.org/ | 12:42 |
| EmilienM | https://www.rdoproject.org/documentation/packaging/ | 12:42 |
| panda | pabelanger: we're still low on undercloud images .. :) can you show me the source of this job ? | 12:42 |
| pabelanger | panda: JJB config: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/tripleo.yaml#n64 | 12:44 |
| pabelanger | panda: does python-tripleoclient build undercloud images today? | 12:45 |
| *** rlandy has joined #tripleo | 12:45 | |
| pabelanger | panda: or what is the syntax to build undercloud images | 12:46 |
| panda | pabelanger: no | 12:46 |
| slagle | we should not be using python-tripleoclient to prebuild uc images | 12:47 |
| slagle | we shouldnt be using prebuilt uc images at all | 12:47 |
| pabelanger | slagle: how do undercloud images get built? | 12:47 |
| pabelanger | or is that an operator choice? | 12:47 |
| slagle | pabelanger: you run the undercloud installer on a centos host | 12:48 |
| slagle | there aren't any predelivered images | 12:48 |
| pabelanger | slagle: because I don't know, what is the undercloud installer? | 12:50 |
| slagle | "openstack undercloud install" | 12:50 |
| *** anshul has quit IRC | 12:51 | |
| *** bfournie has joined #tripleo | 12:51 | |
| pabelanger | okay, so that expects your OS to already be installed | 12:52 |
| slagle | yes | 12:52 |
| larsks | On my compute node I have hiera_include('compute_classes', []) in /var/lib/heat-config/..., but on my controller I have hiera_include('controller_classes') (note the lack of a default), which is failing. Why is the hiera_include call different on the controller? | 12:52 |
| *** dbecker has joined #tripleo | 12:52 | |
| pabelanger | slagle: so, that said, why was tripleo-ci building undercloud images before ovb? | 12:52 |
| larsks | And is the fact that controller_classes doesn't seem to be defined anywhere indicative of a problem, or is that typical? | 12:53 |
| *** links has quit IRC | 12:53 | |
| *** tzumainn has joined #tripleo | 12:53 | |
| slagle | pabelanger: for quickstart aiui | 12:54 |
| pabelanger | k | 12:55 |
| shardy | larsks: that appears to be a bug that is fixed on master | 12:56 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/stable/mitaka/puppet/manifests/overcloud_controller.pp#L725 | 12:56 |
| slagle | pabelanger: i think we also cached them. but only if it has passed tripleo-ci | 12:56 |
| *** jdob has quit IRC | 12:56 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/manifests/overcloud_controller.pp#L20 | 12:56 |
| *** jdob has joined #tripleo | 12:57 | |
| larsks | shardy: actually, that's what was puzzling me, because I'm running from master. But it seems something is still picking up the installation in /usr/share/openstack-tripleo-heat-templates, even though I am passing "--templates tripleo-heat-templates" to overcloud deploy. | 12:57 |
| slagle | pabelanger: i'd like to clarify how we are going to get these images validated by tripleo-ci before we move forward adding more builds for quickstart to consume | 12:57 |
| shardy | larsks: Are you updating an existing deployment? | 12:57 |
| slagle | i dont want to end up with 2 different processes | 12:57 |
| larsks | shardy: In what sense? I am deploying a new overcloud (not updating an existing one). | 12:58 |
| larsks | I am going to try removing the directory from /usr/share and see what happens. | 12:58 |
| shardy | larsks: if you're updating an existing overcloud we do a PATCH update, so --templates foo isn't enough to update all the content inside heat | 12:59 |
| larsks | Yeah, not updating an existing overcloud. | 12:59 |
| shardy | for a new deployment, it shouldn't be using anything from /usr/share when you pass --templates | 12:59 |
| *** amoralej|lunch is now known as amoralej | 12:59 | |
| larsks | I will see if I can reproduce this while paying attention to things. | 12:59 |
| shardy | larsks: ack - FWIW I'd probably run the deploy with --debug & tee the result so you can be absolutely sure what got passed into heat in the files map | 13:00 |
| larsks | Will do. | 13:00 |
| *** lucas-hungry is now known as lucasagomes | 13:00 | |
| pabelanger | slagle: I don't see quickstart consuming these images, I think that happens some place else. Basically, this image is the tip of master for all dependent projects. However validation of that image happens in the next step in the pipeline. But for now, we are just confirming python-tripleoclient and build it | 13:01 |
| larsks | shardy: actually, take a look at this: http://chunk.io/f/dd8aecd5d033402499f5b66bfdf69e6b | 13:01 |
| larsks | Given '--templates tripleo-heat-templates', why is it looking in /usr/share/openstack-tripleo-heat-templates? Am I making a stupid cli error? | 13:02 |
| shardy | larsks: you're passing a bunch of environments from usr/share | 13:02 |
| larsks | Oh, duh. | 13:02 |
| openstackgerrit | Martin André proposed openstack/puppet-tripleo: UI profile for tripleo https://review.openstack.org/354630 | 13:02 |
| shardy | you probably need to rewrite the prefix for all of them | 13:02 |
| larsks | Sorry, that's what I get for using a script :/ | 13:02 |
| shardy | hehe | 13:02 |
| * larsks runs and hides. | 13:02 | |
| *** lblanchard has joined #tripleo | 13:03 | |
| *** jistr has joined #tripleo | 13:03 | |
| *** pkovar has quit IRC | 13:04 | |
| slagle | pabelanger: as long as what we validate builds as tripleo-ci does | 13:04 |
| slagle | not using pip, git, etc | 13:04 |
| bswartz | marios: ping | 13:08 |
| marios | bswartz: hi | 13:09 |
| gfidente | shardy, marios this actually passed CI https://review.openstack.org/#/c/354613/ and moved ::roles a bit later | 13:12 |
| gfidente | but doesn't look like it's making deployment any faster? | 13:12 |
| *** jistr has quit IRC | 13:13 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: M/N upgrade fix galera restart. https://review.openstack.org/354713 | 13:13 |
| bswartz | marios: hey thanks for starting work on https://review.openstack.org/#/c/354019/ I'm going to take a look at that and offer feedback | 13:13 |
| *** fragatina has joined #tripleo | 13:13 | |
| bswartz | marios: did you do any refactoring of the manila generic driver code such that it only installs with m-shr (and not m-sch and m-api)? | 13:13 |
| *** ccamacho|lunch is now known as ccamacho | 13:14 | |
| *** jistr1 has joined #tripleo | 13:14 | |
| shardy | http://logs.openstack.org/13/354613/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/4d020c5/logs/postci.txt.gz#_2016-08-12_12_07_54_000 | 13:14 |
| shardy | gfidente: Yeah, and it actually doesn't look like step3 is the slowest thing there either | 13:15 |
| *** jcoufal has joined #tripleo | 13:15 | |
| *** tbarron|gone is now known as tbarron | 13:16 | |
| shardy | We are spending nearly an hour running puppet on the controller in total though | 13:16 |
| gfidente | step4 1264.0 | 13:17 |
| *** fragatina has quit IRC | 13:18 | |
| *** dprince has joined #tripleo | 13:18 | |
| marios | bswartz: hey np, i just had a first pass yesterday to see what it looked like. you were right about the rebase. I didn't do any refactoring to any of the generic code yet. but i was mainly just aiming to tidy up a bit puppet-tripleo side where we are unnecessarily grabbit hiera data for things that are actually set correctly in the templates manila service files | 13:19 |
| *** dprince has quit IRC | 13:19 | |
| marios | bswartz: there is a question on the review about which backends we enable by default, and whether or not it makes sense to have more than one - it could affect how the review shapes up | 13:19 |
| gfidente | shardy, interestingly step5 taking almost as much even though it's not doing much | 13:20 |
| *** [1]cdearborn has joined #tripleo | 13:20 | |
| shardy | gfidente: Yeah, that is strange, that seems to run quite fast locally | 13:20 |
| *** dprince has joined #tripleo | 13:20 | |
| shardy | I guess we'll have to profile each step and figure out where the time is going | 13:20 |
| bswartz | marios: yes, that brings up a related question | 13:21 |
| bswartz | marios: I'm trying to test tripleo and I don't know where to configure the list of enabled services | 13:21 |
| bswartz | or enabled drivers | 13:21 |
| marios | bswartz: you mean to enable manila generic for example? | 13:21 |
| bswartz | marios: both to enable the manila service at all, and which manila driver to enable | 13:22 |
| marios | bswartz: so this is the example review we used for testing https://review.openstack.org/#/c/342961/ | 13:22 |
| bswartz | okay but how would a user do it? | 13:22 |
| bswartz | how to end users configure their tripleo cloud how they want? | 13:22 |
| marios | bswartz: for manila generic, you should just have to enable the manila-generic-config.yaml env file... | 13:23 |
| bswartz | how do you "enable" an env file | 13:23 |
| marios | bswartz: and similarly if you also wanted netapp, the way the review is right now, you'd also include -e | 13:23 |
| marios | bswartz: ah sorry... | 13:23 |
| marios | bswartz: i mean you include that environment file in your deployment command | 13:23 |
| *** akuznetsov has joined #tripleo | 13:23 | |
| bswartz | okay | 13:23 |
| marios | bswartz: so openstack overcloud deploy --control-scale .... etc -e /environments/manila-generic-config.yaml | 13:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Convert EndpointMap to not require per-service VIP parameters https://review.openstack.org/342900 | 13:24 |
| bswartz | okay | 13:24 |
| bswartz | so regarding your earlier question, we should enable some manila driver by default | 13:24 |
| bswartz | generic would be acceptable but honestly we should add support for lvm (another open source driver which is much simpler) and use that as the default | 13:25 |
| tbarron | bswartz: we should prob get lvm plugin in for that | 13:25 |
| tbarron | there are distribution issues with generic that we can talk about | 13:25 |
| bswartz | tbarron: +1 | 13:25 |
| bswartz | tbarron: indeed | 13:25 |
| tbarron | either that, or don't introduce any env by default but require a choice when manila is deployed | 13:26 |
| marios | bswartz: so the way the review is right now, we'd include both manila-generic.config.yaml and also the manila-netapp-config.yaml for getting both backends... but that then brings us back to the question on the review | 13:26 |
| bswartz | marios: sounds like tbarron says yes, and I concur | 13:27 |
| *** jistr1 is now known as jistr | 13:27 | |
| marios | bswartz: ack, if you could please add a comment/thoughts there then I will udpate, probably Monday at this point | 13:27 |
| bswartz | tbarron: you could add more color, which would help: https://review.openstack.org/#/c/354019/2/puppet/services/manila-base.yaml | 13:27 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: use overcloud_templates_path for all template references https://review.openstack.org/354722 | 13:28 |
| tbarron | bswartz: marios bbiam, in a bluejeans meeting | 13:28 |
| *** akuznetsov has quit IRC | 13:28 | |
| *** jpena|lunch is now known as jpena | 13:31 | |
| jaosorior | Any +A for this? https://review.openstack.org/#/c/352319/ | 13:31 |
| openstackgerrit | Merged openstack/instack-undercloud: Add constraints needed for ironic and inspector https://review.openstack.org/353865 | 13:32 |
| tbarron | bswartz: marios i will update the review later today, am a bit overcommitted this morning, but ... | 13:33 |
| tbarron | bswartz: marios we will need to split generic off as its own env parallel to netapp, cephfsnative, etc. | 13:33 |
| tbarron | bswartz: marios i am going to study what cinder does w.r.t. lvm, whether is is set up by default, etc. | 13:34 |
| tbarron | bswartz: marios or whether you just choose which envs you want to deploy and none are on by default | 13:34 |
| tbarron | bswartz: marios Jokke_ i was talking with Jokke_ yesterday on this | 13:35 |
| rbrady | jtomasek: can I find out more information about your environment? I'm not able to replicate the bug you mentioned in the comments on https://review.openstack.org/#/c/298682/. | 13:36 |
| tbarron | bswartz: marios Jokke_ it may be good not to have any enabled_backends or enabled_protocols on by default, i.e. these comma-separated-string values would be constructed dependinng on which envs are deployed | 13:36 |
| tbarron | bswartz: marios Jokke_ we need to compare with cinder volume and the newly deployed cinder backup for this question as well | 13:37 |
| rbrady | jtomasek: I tried to replicate what you pasted and created a new default plan, added a param, changed a param and added additional params. http://paste.openstack.org/show/555987/ | 13:37 |
| * jtomasek looks | 13:37 | |
| jtomasek | rbrady: yeah, and now run the gerParameters action | 13:38 |
| marios | bswartz: OK, sounds good and lets use the review for discussion. WRT 'split generic off' ... we could restructure the files, right now generic and netapp config all goes into manila-base.yaml. Wether or not each is then activated will depend on the inclusion or ommission of the relevant environment file (assuming we go with default everything off) | 13:38 |
| jtomasek | rbrady: that's what fails | 13:38 |
| marios | tbarron: err tbarron sorry ^ | 13:38 |
| rbrady | jtomasek: ahh...trying now | 13:39 |
| *** rodrigods has quit IRC | 13:39 | |
| *** rodrigods has joined #tripleo | 13:40 | |
| tbarron | marios: ack, will study it, that's helpful | 13:40 |
| marios | tbarron: i am personally fine with having the config for all the backends in one place, we could move into driver specific files too | 13:40 |
| marios | tbarron: but that is orthogonal to whether or not a backend is enabled, is my point | 13:40 |
| Jokke_ | tbarron: yeah, that all will need to wait (at least on my part) for next week | 13:40 |
| tbarron | marios: sure, i don't have any religion on that, care more about the behavior | 13:40 |
| openstackgerrit | Rich Bowen proposed openstack/tripleo-quickstart: rst format, rather than markdown. https://review.openstack.org/354728 | 13:41 |
| tbarron | Jokke_: your weekend and marios weekend should be starting now! | 13:41 |
| *** trozet has quit IRC | 13:41 | |
| marios | tbarron: hahaha wishful thinking | 13:42 |
| * marios cries | 13:42 | |
| tbarron | marios: :( | 13:42 |
| Jokke_ | tbarron: agreed | 13:43 |
| rlandy | dmsimard: I dropped the flavor requirements for ovb - to match ben's flavors as closely as possible. I have successful runs on mitaka - I am still debugging master | 13:45 |
| rlandy | we would have to just try a few runs on your cloud. | 13:45 |
| rlandy | I don't have access to create exact flavors in central-ci | 13:45 |
| dmsimard | rlandy: there's no heat yet though and I won't have the time to do it for a while .. although the deployment recipes for that cloud are open source and could have someone help :) | 13:46 |
| rlandy | dmsimard: I am on the hook to document baremetal in general first - after that I can try | 13:47 |
| dmsimard | rlandy: ok | 13:47 |
| *** trozet has joined #tripleo | 13:50 | |
| *** d0ugal has joined #tripleo | 13:51 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove unneeded net_ip_map dump into hieradata https://review.openstack.org/354391 | 13:55 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove deprecated net_ip_subnet_map output https://review.openstack.org/346055 | 13:55 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Remove deprecated net_ip_uri_map output https://review.openstack.org/354381 | 13:55 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Pass ServiceNetMap to services https://review.openstack.org/354414 | 13:55 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Convert ServiceNetMap to a nested template https://review.openstack.org/353032 | 13:55 |
| EmilienM | bnemec: to get a tripleo ci promotion, doing recheck on https://review.openstack.org/#/c/229789/ would be enough? | 13:56 |
| EmilienM | I always forget | 13:56 |
| *** pkovar has joined #tripleo | 13:56 | |
| EmilienM | bnemec: modulo L161 that we might need to clean | 13:57 |
| jaosorior | gfidente: +A for this https://review.openstack.org/#/c/352319/ ? :D | 13:57 |
| gfidente | totally! | 13:58 |
| radez | dprince: ping, this was +2ed a while back but never merged: https://review.openstack.org/#/c/327449/ | 13:58 |
| radez | dprince: is there something missing for it to be mereged? | 13:58 |
| gfidente | speedmerge | 13:58 |
| gfidente | we need a button in gerrit to post a message on the irc channel when something is ready | 13:59 |
| mandre | EmilienM: thanks for the review of https://review.openstack.org/#/c/354630/ | 13:59 |
| mandre | EmilienM: so jsut to make sure I understand correctly, only the (currently) commented code will make it to this patch | 13:59 |
| *** myoung is now known as myoung|mtg | 13:59 | |
| mandre | EmilienM: the rest will live in THT, correct? | 14:00 |
| slagle | bandini: is httpd still managed by pacemaker? | 14:00 |
| bandini | slagle: nope | 14:00 |
| dprince | radez: looking | 14:00 |
| EmilienM | mandre: in fact, the class you created will never exist, you need to move bits to other services/profiles | 14:00 |
| dprince | slagle: can you review this for radez https://review.openstack.org/#/c/327449/ | 14:01 |
| dprince | slagle: easy one | 14:01 |
| dprince | radez: 2 +2's are required | 14:01 |
| dprince | radez: then we +A it | 14:01 |
| radez | dprince: ah, right on, thx dprince slagle | 14:01 |
| EmilienM | I approved it, lgtm | 14:02 |
| mandre | EmilienM: ugh... so I guess we don't need a UI profile if it's all spread out to different services/profiles anyway | 14:02 |
| EmilienM | right | 14:02 |
| shardy | slagle: Hey, if I need to change the name of OS::TripleO::Services::NeutronServer, is there any way I can do it now the multinode job is gating? | 14:02 |
| shardy | I can't think of a way because of the reference to the name in tripleo-ci for the all-in-one services list | 14:03 |
| shardy | I guess I'll have to leave it until we move that environment into tht? | 14:03 |
| *** pkovar has quit IRC | 14:03 | |
| EmilienM | shardy: do you remember how we can manually trigger the promotion job ? | 14:03 |
| EmilienM | shardy: is it https://review.openstack.org/#/c/229789? | 14:03 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Remove httpd from pacemaker_resource_restart.sh https://review.openstack.org/354740 | 14:03 |
| dprince | shardy: can't you just add a new key with the same name/effect? | 14:03 |
| shardy | dprince: aha, yeah that will work | 14:04 |
| shardy | thanks :) | 14:04 |
| slagle | bandini: can u review https://review.openstack.org/354740 | 14:04 |
| *** pradk has quit IRC | 14:05 | |
| slagle | i got ping'd by 3 people in the last 3 minutes :) | 14:05 |
| bswartz | slagle: ping | 14:05 |
| bandini | slagle: ping | 14:05 |
| * bandini chuckles | 14:05 | |
| bandini | slagle: looking | 14:06 |
| slagle | :) | 14:06 |
| hewbrocca | slagle: ping | 14:06 |
| hewbrocca | teehee | 14:06 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job https://review.openstack.org/229789 | 14:06 |
| EmilienM | slagle: ^ | 14:06 |
| EmilienM | (lol) | 14:06 |
| slagle | i just hope hewbrocca doesnt ping me. i wouldnt see it though since he is /ignored | 14:06 |
| * hewbrocca cries | 14:07 | |
| EmilienM | ahahah | 14:07 |
| bnemec | EmilienM: I have very little idea how promotion works. | 14:07 |
| bnemec | rofl | 14:07 |
| slagle | EmilienM: please kill that asap | 14:07 |
| *** bnemec is now known as beekneemech | 14:07 | |
| EmilienM | bnemec: me too, but I'll try to get it today | 14:07 |
| EmilienM | slagle: kill what | 14:07 |
| slagle | EmilienM: it will false promote | 14:07 |
| slagle | see the bug i filed yesterday | 14:07 |
| EmilienM | damn | 14:07 |
| *** pradk has joined #tripleo | 14:07 | |
| slagle | EmilienM: the overriding of JOB_NAME means that if mitaka passes, it will report the master job as passed to the promote script | 14:08 |
| EmilienM | jobs are killed, it's good. | 14:08 |
| slagle | EmilienM: that's why we had to rollback the symlink yesterday :) | 14:08 |
| EmilienM | note: when you abandon/restore a patch, it kills CI jobs | 14:08 |
| EmilienM | slagle: ok so how can we get promotion? | 14:08 |
| slagle | EmilienM: look at how i'm doing it here: https://review.openstack.org/#/c/346949/ | 14:09 |
| slagle | i think it is safe | 14:09 |
| EmilienM | good | 14:09 |
| EmilienM | I did recheck | 14:10 |
| EmilienM | slagle: but you didn't export the jobtype | 14:10 |
| EmilienM | does it matter to actually promote? | 14:10 |
| slagle | EmilienM: promote is triggered by CACHEUPLOAD | 14:11 |
| slagle | which i explicitly set | 14:11 |
| slagle | EmilienM: please review the patch :) | 14:11 |
| EmilienM | good | 14:11 |
| slagle | i think it's safe, but i can't be online today until 10pm to make sure in case it goes awry :) | 14:11 |
| slagle | it's my "don't attempt CI trickery as friday afternoon approaches" rule | 14:12 |
| EmilienM | hopefully we can promote before | 14:12 |
| EmilienM | I see 0 blocker now | 14:12 |
| EmilienM | puppet ci promoted 1h ago | 14:12 |
| *** ebalduf has joined #tripleo | 14:13 | |
| slagle | EmilienM: yea, i just got a successful ha deploy locally using consistent | 14:13 |
| slagle | trying pingtest now | 14:13 |
| *** _coolsvap_ is now known as coolsvap | 14:16 | |
| honza | dprince: hey, was the tripleo deep dive recorded yesterday? do you happen to have a link? | 14:16 |
| dprince | honza: I think slagle recorded it, slagle got a link yet? | 14:18 |
| slagle | honza: all the recording links are in the etherpad | 14:18 |
| hewbrocca | dprince: what sort of propaganda did you dispense yesterday? | 14:19 |
| dprince | hewbrocca: radical ideas man | 14:19 |
| honza | slagle: awesome, thanks | 14:19 |
| hewbrocca | excellent | 14:19 |
| dprince | hewbrocca: pretty standard network deep dive | 14:19 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: tripleo-jobs-gerrit.py: update undercloud & multinode job names https://review.openstack.org/354679 | 14:22 |
| openstackgerrit | Rich Bowen proposed openstack/tripleo-quickstart: rst format, rather than markdown. Change-Id: Ib50837db5f85cca117684949299069843242873f https://review.openstack.org/354728 | 14:22 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Update pacemaker_resource_restart.sh for new HA arch https://review.openstack.org/354740 | 14:22 |
| slagle | bandini: updated based on your comments ^ | 14:23 |
| slagle | bandini: do we need to add some sort of wait now though? | 14:23 |
| slagle | b/c all the calls to check_resource are removed | 14:23 |
| bandini | slagle: good point. we definitely were not entirely clean there previously either (i.e. we did not wait fully for all services to be up, just openstack-core) | 14:25 |
| gfidente | so I don't want to | 14:26 |
| gfidente | but I think https://review.openstack.org/#/c/353637/ and https://review.openstack.org/#/c/353582/ are delicate | 14:26 |
| gfidente | and good to merge quickly, shardy, EmilienM, jaosorior ^^ | 14:26 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Move Nova settings out of puppet/compute.yaml https://review.openstack.org/353748 | 14:27 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Mv Ceilometer settings out of puppet/compute.yaml https://review.openstack.org/354063 | 14:27 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Move neutron settings out of puppet/compute.yaml https://review.openstack.org/354201 | 14:27 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: use overcloud_templates_path for all template references https://review.openstack.org/354722 | 14:27 |
| gfidente | jaosorior++ :) | 14:27 |
| dprince | jaosorior, EmilienM: ^^ more composable work to cleanup compute.yaml | 14:27 |
| EmilienM | dprince++ | 14:27 |
| * dprince is working on controller.yaml now | 14:27 | |
| gfidente | dprince++ :) | 14:28 |
| EmilienM | dprince: did you sync with jaosorior who is also doing the same thing iirc? | 14:28 |
| *** saneax_AFK is now known as saneax | 14:28 | |
| *** saneax is now known as Guest47565 | 14:28 | |
| dprince | EmilienM: well I pointed out the BZ's which I filed | 14:28 |
| jaosorior | gfidente: https://review.openstack.org/#/c/353582/ seems to me that this one hasn't passed nonha | 14:28 |
| dprince | EmilienM: I thought we agreed to track the rest of the composable work in LP bugs (not BZs) | 14:29 |
| shardy | gfidente: thanks, be good to see those land :) | 14:29 |
| EmilienM | dprince: cool I'm just saying that because I saw patches from jaosorior | 14:29 |
| dprince | https://bugs.launchpad.net/tripleo/+bug/1604412 | 14:30 |
| openstack | Launchpad bug 1604412 in tripleo "Composable services: move hiera settings out of compute role" [High,In progress] - Assigned to Dan Prince (dan-prince) | 14:30 |
| dprince | jaosorior, EmilienM: sorry, I thought we discussed this 2 weeks back | 14:30 |
| dprince | EmilienM: this is why I liked my etherpad | 14:31 |
| jaosorior | EmilienM, dprince it's all good. I just did some parameters but it's no biggie | 14:31 |
| jaosorior | I actually did them cause I needed to fix something else. And then found those accidentally | 14:31 |
| jaosorior | when I submitted those patches I actually wasn't aware of the LP | 14:31 |
| dprince | shardy: are you actually working on this, because I'd like to do it next https://bugs.launchpad.net/tripleo/+bug/1604414 | 14:31 |
| openstack | Launchpad bug 1604414 in tripleo "Composable services: move hiera data out of controller role" [High,Triaged] - Assigned to Steven Hardy (shardy) | 14:31 |
| jaosorior | and then EmilienM pointed it out | 14:31 |
| EmilienM | no biggies! it's friday | 14:32 |
| shardy | dprince: Not got to it, feel free to take it :) | 14:32 |
| larsks | shardy: should referencing a missing parameter in the output section cause a failure? | 14:32 |
| shardy | dprince: been busy trying to battle through the custom-roles refactoring | 14:32 |
| dprince | shardy: I just did the same for compute.yaml which besides a few local bind ports is very clean here now: https://review.openstack.org/#/c/354201/2/puppet/compute.yaml | 14:32 |
| shardy | dprince: Nice, thanks, will check it out | 14:33 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't deploy net-iso env when we won't use it https://review.openstack.org/347503 | 14:33 |
| shardy | larsks: it should, but there's a heat bug which means we're not strictly validating outputs right now | 14:33 |
| dprince | shardy: right, so you are planning on doing this then https://bugs.launchpad.net/tripleo/+bug/ | 14:33 |
| *** paramite has quit IRC | 14:33 | |
| dprince | shardy: FWIW, this is directly related to the roles work in that roles won't work without this | 14:33 |
| shardy | https://bugs.launchpad.net/heat/+bug/1599114 larsks | 14:33 |
| openstack | Launchpad bug 1599114 in heat "Outputs aren't correctly validated" [Medium,In progress] - Assigned to Oleksii Chuprykov (ochuprykov) | 14:33 |
| shardy | dprince: I'm not planning to do the controller refactor atm so please feel free to take it | 14:34 |
| dprince | shardy: for example I tried, MySQL. The composable service is incomplete because the controller.yaml still has many of the MySQL settings in it still | 14:34 |
| beagles | ci is still sad? | 14:34 |
| shardy | dprince: I'm refactoring allNodesConfig primarily | 14:34 |
| larsks | shardy: thanks. I spent hours (hours!) yesterday tracking down a problem that was actually a missing parameter in a deeply nested template. | 14:34 |
| *** myoung|mtg is now known as myoung | 14:34 | |
| dprince | shardy: ack, cool. Appreciate the work on all nodes | 14:35 |
| larsks | The error ultimately produced by heat was unhelpful. I will take a look at the bug. | 14:35 |
| dprince | shardy: is the local bind IP prototype close yet? | 14:35 |
| shardy | dprince: gfidente has some patches which I think he refreshed today | 14:35 |
| shardy | dprince: the map_replace part for all the roles has landed | 14:35 |
| shardy | larsks: Yeah, it's definitely easy to be misled because the error isn't surfaced clearly | 14:36 |
| gfidente | dprince, hey TIP is https://review.openstack.org/#/c/318344/, when that passes we can start moving things | 14:36 |
| dprince | gfidente: boom, thanks | 14:36 |
| shardy | we need that heat bug fixed, there is a patch bug I've not had time to test it | 14:36 |
| shardy | larsks: if you felt like trying it and providing feedback, that would be helpful | 14:36 |
| larsks | Sure. | 14:37 |
| gfidente | shardy, actually I think I also got the repeat/for_each change to use maps to pass | 14:37 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-quickstart: use overcloud_templates_path for all template references https://review.openstack.org/354722 | 14:38 |
| gfidente | https://review.openstack.org/#/c/350822/ | 14:38 |
| *** jistr has quit IRC | 14:38 | |
| *** jistr has joined #tripleo | 14:39 | |
| shardy | gfidente: nice! That will be super helpful | 14:39 |
| gfidente | I had a use case | 14:39 |
| gfidente | was curious to dive a little into heat | 14:40 |
| *** pkovar has joined #tripleo | 14:40 | |
| gfidente | zaneb helped | 14:40 |
| shardy | Cool, will try to find time to review/test later | 14:40 |
| * zaneb +2s | 14:42 | |
| *** pkovar has quit IRC | 14:44 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/puppet-tripleo: [WIP] updates to fluentd support https://review.openstack.org/353507 | 14:45 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: [WIP] Add fluentd service https://review.openstack.org/353506 | 14:46 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates: [WIP] Add fluentd client service https://review.openstack.org/353506 | 14:46 |
| larsks | If someone has a moment to look at https://review.openstack.org/#/c/353506/ I would appreciate feedback as to whether or not that is heading in the right direction. | 14:51 |
| slagle | EmilienM: well the promote may or may not happen | 14:53 |
| slagle | EmilienM: in my local env, node registration is hanging | 14:54 |
| EmilienM | damn | 14:54 |
| *** rajinir has joined #tripleo | 14:58 | |
| *** Guest47565 is now known as saneax_AFK | 15:05 | |
| openstackgerrit | John Browning proposed openstack/tripleo-validations: Added check for ceilometerdb size https://review.openstack.org/354775 | 15:05 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Only set $LOCATION if it is not already defined https://review.openstack.org/354365 | 15:08 |
| *** leanderthal is now known as leanderthal|afk | 15:09 | |
| jaosorior | slagle: What's your output for $ mistral action-get baremetal_introspection.wait_for_finish | 15:10 |
| *** ayoung has joined #tripleo | 15:10 | |
| jaosorior | slagle: if the inputs for that action are empty you have to re-run the mistral-db-manage populate command | 15:13 |
| jaosorior | and it was an ordering issue in the undercloud | 15:13 |
| *** toymachine has joined #tripleo | 15:13 | |
| slagle | jaosorior: it finally finished but took 20 minutes | 15:13 |
| jaosorior | ah, ok, then it was probably not that then | 15:13 |
| slagle | http://paste.openstack.org/show/556118/ | 15:13 |
| *** ebarrera has quit IRC | 15:13 | |
| slagle | possibly related to the poor keystone performance we've been seeing? | 15:13 |
| jaosorior | slagle: that's for the overcloud | 15:14 |
| jaosorior | AFAIK | 15:14 |
| jaosorior | the undercloud keystone should be alright | 15:14 |
| jaosorior | slagle: well, strange still | 15:14 |
| jaosorior | Anyway, I gotta go | 15:14 |
| jaosorior | have a good weekend folks! | 15:15 |
| *** jaosorior has quit IRC | 15:15 | |
| slagle | should it be processes=1 threads=4 ? | 15:15 |
| *** hewbrocca is now known as hewbrocca-afk | 15:15 | |
| slagle | i only have a single keystone-main process | 15:15 |
| *** bana_k has joined #tripleo | 15:15 | |
| slagle | shardy: do we need to increase processes or threads for the keystone wsgi conf? | 15:16 |
| *** yamahata has joined #tripleo | 15:20 | |
| shardy | slagle: according to https://bugzilla.redhat.com/show_bug.cgi?id=1347305 its the workers, which I think KeystoneWorkers will do ref https://review.openstack.org/#/c/336520/ | 15:23 |
| openstack | bugzilla.redhat.com bug 1347305 in openstack-tripleo-heat-templates "Overcloud deployed with keystone as single process leads to abysmal performance" [Unspecified,On_qa] - Assigned to mandreou | 15:23 |
| *** florianf has quit IRC | 15:23 | |
| *** pcaruana has quit IRC | 15:23 | |
| *** jistr is now known as jistr|call | 15:23 | |
| shardy | slagle: I've not done comparitive testing on performance tho, just going by those reports | 15:23 |
| shardy | the tripleo-ci patch seems inconclusive | 15:23 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart: fix documentation directory in the readme file https://review.openstack.org/351787 | 15:24 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates: Decouple EndpointMap from SSL certificate params https://review.openstack.org/348037 | 15:26 |
| slagle | shardy: thanks | 15:28 |
| slagle | will play with it a bit | 15:28 |
| shardy | slagle: ack, thanks | 15:28 |
| shardy | I think we need to profile the step4/5 stuff too, as it seems to actually be worse than step3 in CI, despite my impressions from local testing | 15:28 |
| *** beagles is now known as beagles_brb | 15:29 | |
| slagle | i guess i'd expect them to be worse | 15:30 |
| *** florianf has joined #tripleo | 15:31 | |
| *** ifarkas is now known as ifarkas_afk | 15:33 | |
| *** ayoung has quit IRC | 15:33 | |
| dmsimard | EmilienM: what do you think of doing the same "client-side" promotion for tripleo ci repository than is done in p-o-i ? | 15:35 |
| EmilienM | dmsimard: ++ | 15:35 |
| dmsimard | EmilienM: i.e, instead of nightly periodic job that promotes if successful, we do the promotion client side in tripleo | 15:35 |
| EmilienM | it would avoid us to promote manually | 15:35 |
| EmilienM | dmsimard: thought it could be done in RDO CI, no? | 15:36 |
| EmilienM | so we can run it more often | 15:36 |
| EmilienM | every 24h is not enough IMHO | 15:36 |
| dmsimard | EmilienM: we can run it as often as required, just need to submit new patchsets | 15:36 |
| dmsimard | :) | 15:36 |
| dmsimard | There'd be a proposal bot review every 24h, but that doesn't prevent us from submitting reviews on specific hashes whenever required | 15:36 |
| slagle | why would we move tripleo ci promotion to rdo ci? | 15:37 |
| dmsimard | slagle: that's not what I'm saying | 15:37 |
| EmilienM | slagle: we're talking about puppet ci | 15:37 |
| dmsimard | slagle: puppet-openstack-integration has it's own self-contained promotion mechanism https://review.openstack.org/#/q/project:openstack/puppet-openstack-integration+status:merged+promote | 15:37 |
| dmsimard | slagle: i.e, it doesn't rely on a symlink server side, it carries the exact hash in it's manifest and updates it as required (automatically or manually) | 15:38 |
| EmilienM | it would be great to run a 6h periodic job in RDO CI that does puppet promotion for us | 15:38 |
| dmsimard | EmilienM: we could just submit a new patchset to p-o-i every 6h :p | 15:38 |
| EmilienM | it sucks | 15:38 |
| slagle | ok we used to do that in tripleo-ci as well | 15:38 |
| EmilienM | it still requires people to +2 +A the patch | 15:38 |
| slagle | i dont really remember why we switched to the symlink | 15:38 |
| EmilienM | we want something automtic | 15:38 |
| EmilienM | when I leave in PTO nobody takes care of puppet CI promotion | 15:39 |
| EmilienM | while symlink, it would be automatic | 15:39 |
| EmilienM | oh I have an idea | 15:39 |
| slagle | i think it was b/c the CI and docs would get out of sync | 15:39 |
| EmilienM | and if the RDO job fail, submit the change in Puppet CI | 15:39 |
| EmilienM | so it's visible | 15:39 |
| *** aufi has quit IRC | 15:39 | |
| dmsimard | EmilienM: it'd hardly be automatic, it stills needs to be troubleshooted if it fails | 15:39 |
| EmilienM | until it fails; promote every 6h; done | 15:40 |
| EmilienM | right ! | 15:40 |
| *** numans has quit IRC | 15:40 | |
| dmsimard | EmilienM: and it probably has less visibility in rdo ci than it does in upstream | 15:40 |
| EmilienM | but if it fails, submit it upstream | 15:40 |
| EmilienM | so we can see the patch and we know it fails | 15:40 |
| EmilienM | submit a patch "Failed to promote RDO trunk" in poi upstream | 15:40 |
| EmilienM | with a RDO gerrit account | 15:40 |
| EmilienM | it would be awesome | 15:40 |
| dmsimard | I guess | 15:41 |
| *** jistr|call is now known as jistr | 15:42 | |
| EmilienM | dmsimard: openstack infra wouldn't let us to run 6h periodic jobs | 15:44 |
| dmsimard | EmilienM: I mean a periodic job on our end | 15:44 |
| dmsimard | that would create a patch every 6h | 15:44 |
| dmsimard | it's cheating | 15:44 |
| *** jpich has quit IRC | 15:45 | |
| EmilienM | dmsimard: no, I mean, do the promotion (with symblink) ever 6h in RDO CI | 15:45 |
| EmilienM | dmsimard: and if the promotion job fails, submit a patch in p-o-i with the hash | 15:45 |
| EmilienM | so we can see the output in upstream jobs | 15:46 |
| EmilienM | and maybe send only 1 patch? or use git amend? | 15:46 |
| *** rcernin has quit IRC | 15:47 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move gnocchi's kestone::auth parameters to API profile https://review.openstack.org/352319 | 15:48 |
| openstackgerrit | Merged openstack/os-cloud-config: Adding the congress service https://review.openstack.org/327449 | 15:48 |
| dmsimard | EmilienM: yes, I understand what you mean | 15:49 |
| dmsimard | EmilienM: I just ideally don't want to offload upstream work down to RDO | 15:49 |
| dmsimard | we help upstream a lot but we don't want to carry that responsability | 15:49 |
| dmsimard | submitting a patch in case of failure is fine with me | 15:49 |
| jrist | slagle: ping, re: mistral stuff | 15:51 |
| jrist | slagle: we've got a boatload of things that need to land in mistral/cli for the UI for Newton N-3 | 15:51 |
| *** weshay is now known as weshay_brb | 15:51 | |
| jrist | slagle: rbrady has kindly detailed a bunch of them here | 15:51 |
| jrist | slagle: https://etherpad.openstack.org/p/tripleo-mistral-api | 15:51 |
| openstackgerrit | Miles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package https://review.openstack.org/344214 | 15:51 |
| *** bana_k has quit IRC | 15:51 | |
| jrist | slagle: additionally, d0ugal is working on a patch for the deployment via CLI here: https://review.openstack.org/342261 | 15:52 |
| d0ugal | jrist, slagle: FYI, I have added it to the TripleO meeting agenda for Tuesday to try and get more eyes. | 15:52 |
| jrist | d0ugal: well, with respect, I'm hoping to get more eyes sooner | 15:53 |
| jrist | than Tuesday | 15:53 |
| jrist | d0ugal: but I appreciate that :) | 15:53 |
| d0ugal | jrist: aye, that'd be nice but it isn't that long away either :) Just letting you know | 15:53 |
| slagle | jrist: are blueprints filed? | 15:54 |
| jrist | slagle: with regard to what? the UI needs or the CLI/Mistral needs? | 15:54 |
| d0ugal | slagle: it is mostly based on the Mistral spec | 15:54 |
| jrist | slagle: and that is kind of a general question | 15:54 |
| jrist | slagle: so I am not sure if I can answer it to your satisfaction | 15:55 |
| slagle | jrist: https://blueprints.launchpad.net/tripleo/+spec/mistral-deployment-library | 15:55 |
| slagle | that's the remaining work | 15:55 |
| slagle | (so i thought) | 15:55 |
| *** TicToc has joined #tripleo | 15:55 | |
| jrist | well | 15:55 |
| slagle | are we talking about new things? or things already known? | 15:55 |
| jrist | that's the definition of work needed | 15:55 |
| thrash | d0ugal: sucks that the swift client in OSC is lacking. :/ | 15:55 |
| jrist | no new things | 15:55 |
| jrist | slagle: that i know of | 15:55 |
| jrist | at the moment | 15:55 |
| d0ugal | thrash: lol, yeah, it's weird and really limited | 15:55 |
| jrist | slagle: but we need this dozen or so patches to land for both the UI, and the CLI | 15:56 |
| d0ugal | thrash: I think they are doing that in an effort to reduce deps | 15:56 |
| jrist | slagle: I'm starting to get a little concerned | 15:56 |
| thrash | d0ugal: that'd be my guess | 15:56 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Align node_ips hiera keys with the service name. https://review.openstack.org/353637 | 15:57 |
| thrash | jrist: I'll start taking a look as soon as I get a clean env going. | 15:57 |
| *** beagles_brb is now known as beagles | 15:57 | |
| jrist | thrash++ | 15:57 |
| slagle | jrist: yea, understood | 15:57 |
| slagle | i'm not aware of any spare capacity | 15:58 |
| jrist | haha | 15:58 |
| jrist | that's fair | 15:58 |
| jrist | so would you say you have a similar level of concern? | 15:58 |
| slagle | jrist: i don't anticipate being 100% feature complete on a lot of things by newton-3 | 15:58 |
| slagle | so, yes, if that's what you mean | 15:59 |
| d0ugal | Breaking news :) | 15:59 |
| jrist | haha | 15:59 |
| jrist | slagle: do you think it'd be worth cutting anything... and is there anything to cut | 15:59 |
| jrist | or should we wait a few days to see if we can land some stuff | 15:59 |
| slagle | if the main features are landed, we can always follow up with bugfixes | 15:59 |
| *** weshay_brb is now known as weshay | 15:59 | |
| slagle | if the features are not landed, we can propose them as exceptions | 15:59 |
| slagle | and i think all these critical blueprints would likely be approved exceptions | 16:00 |
| slagle | jrist: there is nothing to cut that i'm aware of | 16:00 |
| slagle | but these things tend to change the closer we get to deadlines | 16:00 |
| *** bana_k has joined #tripleo | 16:00 | |
| jrist | ok | 16:01 |
| jrist | slagle: thanks for the explanation | 16:02 |
| *** yamahata has quit IRC | 16:03 | |
| *** dsneddon has quit IRC | 16:08 | |
| *** dsneddon has joined #tripleo | 16:09 | |
| ansiwen | EmilienM: looks better now: https://review.openstack.org/#/c/352552 | 16:13 |
| EmilienM | ansiwen: +2 | 16:13 |
| ansiwen | EmilienM: oh, you can do that although you are the owner? | 16:14 |
| EmilienM | you're the last commiter | 16:14 |
| EmilienM | it's fine in this case... | 16:14 |
| ccamacho | Guys quick question.. just have finished to install manually OOO from master, following the docs, now the AODH profiles were not included in puppet-tripleo returning a Could not find class tripleo::profile::base::aodh::api for overcloud-co... error Do you know if there are any issues with the packages from RDO? | 16:16 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Migrate the deploy command to use the Mistral workflows https://review.openstack.org/342261 | 16:16 |
| ccamacho | seems to be an old version | 16:16 |
| slagle | ccamacho: what version do you have? | 16:17 |
| honza | jrist: this deep dive recording about networking is pretty much perfect, thanks | 16:17 |
| ccamacho | I deleted the env, but re doing all to give you the version. | 16:18 |
| ccamacho | slagle ^ | 16:18 |
| *** florianf has quit IRC | 16:18 | |
| ccamacho | will take about 30 mins | 16:18 |
| slagle | check the repos that are used for the oc image building | 16:19 |
| jrist | honza: :) | 16:19 |
| ccamacho | slagle, these http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo/delorean.repo and http://trunk.rdoproject.org/centos7/delorean-deps.repo | 16:20 |
| ccamacho | but 2 days ago worked fine, the issue comes from yesterday or today I believe | 16:21 |
| ccamacho | slagle, yeahp aodh its not there | 16:23 |
| slagle | ccamacho: that repo is 9 days old | 16:24 |
| slagle | ccamacho: are you also using tripleo-heat-templates from that same repo? | 16:25 |
| ccamacho | The base URL points to http://trunk.rdoproject.org/centos7/8e/b0/8eb0c893074f6ba912114ce50995ee0118930775_fc22fbaf/puppet-tripleo-5.0.0-0.20160803011341.cb44295.el7.centos.noarch.rpm but in that RPM the AODH profiles are not there | 16:25 |
| slagle | if you're using tht latest, with that repo, i'd execpt there might be some incompabilities | 16:25 |
| ccamacho | yeahp | 16:25 |
| *** yamahata has joined #tripleo | 16:26 | |
| ccamacho | indeed.. | 16:26 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds parameters actions https://review.openstack.org/298682 | 16:27 |
| ccamacho | Thats the issue THT its from master | 16:27 |
| rbrady | jtomasek: I've added the ResetParams action you asked for the morning. Please see the test. I'm still working on the heatclient validation issue. https://review.openstack.org/#/c/298682/ | 16:28 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs: Document decoupled SSL config https://review.openstack.org/348038 | 16:29 |
| *** fragatina has joined #tripleo | 16:30 | |
| *** fragatin_ has joined #tripleo | 16:31 | |
| *** athomas has quit IRC | 16:32 | |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Use non-bracketed version of addresses for keystone.initialize https://review.openstack.org/354443 | 16:33 |
| *** fragatina has quit IRC | 16:35 | |
| *** ohamada has quit IRC | 16:35 | |
| *** tesseract- has quit IRC | 16:35 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs: Spec: undercloud-ntp-server - Add NTP services to Undercloud https://review.openstack.org/350729 | 16:36 |
| jtomasek | rbrady: thanks! | 16:36 |
| *** electrofelix has quit IRC | 16:37 | |
| *** dtantsur is now known as dtantsur|afk | 16:41 | |
| openstackgerrit | Haïkel Guémar proposed openstack/tripleo-ui: Add packaging spec and config files https://review.openstack.org/344932 | 16:45 |
| *** [1]cdearborn has quit IRC | 16:49 | |
| gfidente | shardy, you still around? regarding https://bugs.launchpad.net/tripleo/+bug/1600209 I don't think we can append a char to the default format or we'd go back to the upgrade/rename problem | 16:50 |
| openstack | Launchpad bug 1600209 in tripleo "HostnameMap can result in partial replacement" [High,Triaged] - Assigned to Steven Hardy (shardy) | 16:50 |
| gfidente | shardy, had other ideas for a THT fix? | 16:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add parameter for enabling purging configuration files https://review.openstack.org/353543 | 16:50 |
| openstackgerrit | Alan Bishop proposed openstack/os-net-config: Enhance and fix NIC mapping feature https://review.openstack.org/354839 | 16:51 |
| *** jpena is now known as jpena|off | 16:52 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: DO NOT MERGE https://review.openstack.org/354842 | 16:54 |
| *** lucasagomes is now known as lucas-dinner | 16:55 | |
| *** bana_k has quit IRC | 16:59 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: DO NOT MERGE https://review.openstack.org/354842 | 17:04 |
| *** bana_k has joined #tripleo | 17:05 | |
| *** bana_k has quit IRC | 17:09 | |
| *** ayoung has joined #tripleo | 17:13 | |
| *** bana_k has joined #tripleo | 17:21 | |
| *** coolsvap has quit IRC | 17:21 | |
| slagle | EmilienM: on to the ping test in the ha periodic job | 17:27 |
| EmilienM | slagle: I see it | 17:27 |
| slagle | EmilienM: the nonha however will fail | 17:27 |
| EmilienM | yeah | 17:27 |
| slagle | no valid host | 17:27 |
| EmilienM | Message: No valid host was found | 17:27 |
| *** amoralej is now known as amoralej|off | 17:27 | |
| slagle | we can recheck that if ha passes | 17:28 |
| slagle | but let's wait | 17:28 |
| EmilienM | yup | 17:28 |
| slagle | BOOM | 17:29 |
| slagle | passed | 17:29 |
| EmilienM | it smells good | 17:29 |
| EmilienM | slagle: I propose we retrigger the patch now to save time | 17:29 |
| slagle | EmilienM: wait | 17:29 |
| slagle | EmilienM: we need ha to finish | 17:30 |
| EmilienM | it doesn't matter i think | 17:30 |
| EmilienM | since one of both will fail | 17:30 |
| EmilienM | promotion won't happen, right? | 17:30 |
| slagle | it does matter | 17:30 |
| EmilienM | we need both jobs green, no? | 17:30 |
| slagle | the ha pass will still get registered | 17:30 |
| EmilienM | ah I didn't know that | 17:30 |
| EmilienM | in the csv? | 17:30 |
| slagle | yea | 17:30 |
| EmilienM | ok now I understand how it works | 17:31 |
| EmilienM | ok it runs the upload thing, so I guess it registers | 17:33 |
| EmilienM | slagle: isn't it a problem if http://trunk.rdoproject.org/centos7/consistent changed between 2 jobs? | 17:34 |
| EmilienM | like ok now we register ha job with 92/fc | 17:35 |
| EmilienM | but what if the consistent URL changed at next run? | 17:35 |
| slagle | EmilienM: yea that would be a problem | 17:36 |
| slagle | EmilienM: so we should update the patch to pin to that repo | 17:37 |
| slagle | and in the job name we need to s/gate/periodic | 17:37 |
| slagle | just noticed that | 17:37 |
| slagle | anyway, if nonha passes, we can fix that manually | 17:37 |
| EmilienM | good idea | 17:38 |
| EmilienM | with repohash=92/fc/92fc595cbc2186a8471987b93f6fb2d57912f565_e940f443 | 17:38 |
| EmilienM | slagle: done, success | 17:38 |
| EmilienM | not reported yet in Gerrit | 17:38 |
| EmilienM | but it's in the csv, right? | 17:38 |
| EmilienM | I confirm consistent repo has changed | 17:41 |
| EmilienM | I compared themm | 17:41 |
| EmilienM | slagle: what is the url again where we can look csv? | 17:43 |
| *** mgould has quit IRC | 17:50 | |
| *** iogg has quit IRC | 17:50 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: DO NOT MERGE - Periodic test https://review.openstack.org/346949 | 17:52 |
| *** gfidente has quit IRC | 17:52 | |
| slagle | EmilienM: on the rdo server? i'm not sure actually | 17:53 |
| slagle | i dont see it anymore | 17:53 |
| *** pblaho has quit IRC | 17:53 | |
| EmilienM | slagle: I don't undestand why you wanted to wait for the job to finish actually | 17:53 |
| EmilienM | because I don't see where it write the csv | 17:53 |
| EmilienM | where is the csv? | 17:53 |
| slagle | Ok. let's reset | 17:53 |
| slagle | i dont know what csv you are talking about | 17:54 |
| slagle | there is a file on the tripleo mirror server called metadata.txt where the successes are written | 17:54 |
| EmilienM | how does it register? | 17:54 |
| EmilienM | ok | 17:54 |
| EmilienM | where can we read it? | 17:54 |
| slagle | on the mirror server | 17:54 |
| EmilienM | is there a public URL? | 17:55 |
| slagle | let me check | 17:55 |
| EmilienM | my question was just if we had to wait for all jobs to finish or just ha job | 17:55 |
| EmilienM | but it seems like registration happens within the the job so we don't wait for all jobs to finish | 17:55 |
| *** jdob has quit IRC | 17:56 | |
| slagle | EmilienM: they're under here http://66.187.229.18/builds/ | 17:56 |
| slagle | it's organized by repo | 17:56 |
| *** [1]cdearborn has joined #tripleo | 17:56 | |
| EmilienM | http://66.187.229.18/builds/92/fc/92fc595cbc2186a8471987b93f6fb2d57912f565_e940f443/metadata.txt | 17:57 |
| EmilienM | gate-tripleo-ci-centos-7-ovb-ha=SUCCESS | 17:57 |
| EmilienM | ok so we need gate-tripleo-ci-centos-7-ovb-nonha=SUCCESS | 17:57 |
| EmilienM | and promotion will happen I guess | 17:57 |
| slagle | so you can see http://66.187.229.18/builds/92/fc/92fc595cbc2186a8471987b93f6fb2d57912f565_e940f443/metadata.txt | 17:57 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Reinstall python-requests in bootstrap script https://review.openstack.org/350521 | 17:57 |
| slagle | EmilienM: yes, except it needs to be s/gate/periodic | 17:57 |
| slagle | which i fixed in my patch | 17:57 |
| slagle | and if nonha passes, i will fix the metadata.txt manually so we get a promote | 17:57 |
| EmilienM | slagle: good | 17:58 |
| *** jdob has joined #tripleo | 17:58 | |
| EmilienM | slagle: sounds like good plan, thanks. And now I undertand how it works :-) | 17:58 |
| *** fragatin_ has quit IRC | 18:02 | |
| slagle | c | 18:04 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add parameter for enabling purging configuration files https://review.openstack.org/354878 | 18:06 |
| beagles | EmilienM, when the smoke clears, what are your thoughts on proliferating purge_config throughout the service definitions that use relevant puppet modules with the purge_config parameter? | 18:08 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Make $TRIPLEO_ROOT overrideable https://review.openstack.org/350539 | 18:08 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Raise ping test count after multinode setup https://review.openstack.org/351916 | 18:08 |
| beagles | the mtu thing forced our hand for nova and neutron, but I bet it's bound to bite something else in the future | 18:09 |
| beagles | (if it isn't already and we just havent' figured it out yet) | 18:09 |
| slagle | is this why my nova.conf looks so sparse now? :) | 18:09 |
| beagles | slagle, probably :) | 18:10 |
| beagles | slagle, although tbh.. I noticed nova doing that before we merged the recent changes. I think it might be doing something else | 18:10 |
| * beagles makes a note to look into that.. | 18:11 | |
| dprince | rbrady: +2 here, but I had a question for you inline https://review.openstack.org/#/c/298682/15 | 18:12 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Fix resetting /etc/hosts https://review.openstack.org/351917 | 18:14 |
| *** chem is now known as chem|off | 18:16 | |
| openstackgerrit | Merged openstack/tripleo-quickstart: use overcloud_templates_path for all template references https://review.openstack.org/354722 | 18:19 |
| rbrady | dprince: the parameters are stored in a mistral environment in the variables attribute. I have no control over the "variables" naming, this is a mistral thing. Anything in variables is json encoded and stored in db | 18:21 |
| dprince | rbrady: oh right, thanks for jogging my memory | 18:21 |
| rbrady | dprince: so the parameters are stored in variables['parameter_defaults'] | 18:22 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: DO NOT MERGE - Periodic test https://review.openstack.org/346949 | 18:22 |
| dprince | rbrady: probably fine | 18:22 |
| rbrady | dprince: I have no strong opinion on the naming of any of these things and if you feel there is something more descriptive, I have no issue changing anything | 18:22 |
| rbrady | dprince: I'm still working on that patch at the moment to find the source of an odd behavior. | 18:23 |
| dprince | rbrady: okay, mark it as a WIP? | 18:23 |
| rbrady | dprince: will do. | 18:23 |
| dprince | rbrady: I really wanted to try the CLI patch | 18:23 |
| dprince | rbrady: but it has a ways to go still | 18:23 |
| rbrady | dprince: thanks for taking a look at the patches. I think the Plan List and Plan Deletion actions are ready | 18:25 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Update pacemaker_resource_restart.sh for new HA arch https://review.openstack.org/354891 | 18:25 |
| *** jdob has quit IRC | 18:27 | |
| *** jdob has joined #tripleo | 18:27 | |
| *** sarath has joined #tripleo | 18:27 | |
| dprince | shardy: I'd be happy to see this land as is I think https://review.openstack.org/#/c/330283/8 | 18:29 |
| *** weshay is now known as weshay_mtg | 18:33 | |
| *** sarath has quit IRC | 18:34 | |
| shardy | dprince: sure, I'm fine with landing it, but when we wire in custom roles it'll need to be reworked | 18:43 |
| dprince | shardy: yep, roger that | 18:45 |
| shardy | Obviously it'll also break if anyone ever uses ResourceGroup for any other reason in overcloud.yaml, but we can figure that out if/when it happens | 18:45 |
| beagles | shardy, re: https://review.openstack.org/#/c/354878/ - this is cherry-pick'ed backport in name only, really none of the changes translated, but I figured it could be okay if the commit message was annotated a bit | 18:46 |
| *** jdob has quit IRC | 18:46 | |
| *** jdob has joined #tripleo | 18:47 | |
| shardy | beagles: ack, sounds fine will review shortly | 18:48 |
| beagles | shardy, yup.. just wanted to run it by you before you departed for the weekend | 18:48 |
| beagles | the commit/backport thing, not the review ... other's can do that if need be ;) | 18:49 |
| EmilienM | beagles: sure thing | 18:49 |
| EmilienM | pabelanger: can you review https://review.openstack.org/#/c/354172/ pplease? | 18:49 |
| beagles | shardy, besides it's probably fair for it pass CI before anybody weighs in there | 18:49 |
| beagles | EmilienM, you are referring the purge_config thing? | 18:50 |
| EmilienM | beagles: yes | 18:50 |
| beagles | EmilienM, if so cool.. :) | 18:50 |
| beagles | (too much happening at once ;)) | 18:50 |
| *** TicToc has quit IRC | 18:54 | |
| *** tosky has quit IRC | 18:58 | |
| *** fragatina has joined #tripleo | 19:01 | |
| *** jprovazn has quit IRC | 19:03 | |
| *** fultonj has quit IRC | 19:04 | |
| *** fultonj has joined #tripleo | 19:04 | |
| openstackgerrit | Andreas Jaeger proposed openstack/puppet-pacemaker: Move other-requirements.txt to bindep.txt https://review.openstack.org/355001 | 19:11 |
| trozet | dsneddon: hi | 19:11 |
| dsneddon | trozet, Yo | 19:12 |
| trozet | dsneddon: an OPNFV user is hitting this: https://bugzilla.redhat.com/show_bug.cgi?id=1297535 | 19:12 |
| openstack | bugzilla.redhat.com bug 1297535 in openstack-puppet-modules "Undercloud installation fails ::aodh::keystone::auth not found for instack" [Unspecified,Assigned] - Assigned to emacchi | 19:12 |
| trozet | dsneddon: did you ever figure out the exact cause? He also has to use a proxy in his lab to allow undercloud to install correctly. | 19:12 |
| trozet | dsneddon: seems to do some kind of yum update/install | 19:13 |
| *** jdob has quit IRC | 19:13 | |
| dsneddon | trozet, I think this was a problem in upstream TripleO that was fixed some time ago. Is someone hitting it recently? | 19:14 |
| trozet | dsneddon: yeah I need to check which version of our RPMs he is using, but I thought he was on latest, which would mean latest stable/mitaka images produced by trown|outtypewww | 19:15 |
| *** TicToc has joined #tripleo | 19:15 | |
| *** jdob has joined #tripleo | 19:15 | |
| trozet | dsneddon: we don't see it at all in our CI, so I'm thinking it has something to do with the required proxy/yum failing | 19:15 |
| dsneddon | trozet, Your user is getting this error with downstream? I don't think the problem that caused me to open that bug was ever present in the downstream packages. | 19:16 |
| trozet | dsneddon: no it is RDO | 19:16 |
| dsneddon | trozet, Ah, OK, yeah, so latest stable delorean packages. | 19:16 |
| trozet | dsneddon: yah, what is the undercloud installation yum updating/installing? | 19:17 |
| dsneddon | trozet, I haven't attempted a stable/mitaka tripleo install in a long time, I just know that trunk doesn't have that problem anymore. | 19:17 |
| trozet | dsneddon: we don't want it to go to the internet at all | 19:17 |
| trozet | dsneddon: ah | 19:17 |
| *** weshay_mtg is now known as weshay | 19:17 | |
| dsneddon | trozet, I don't know if that is related to package installation on the overcloud image, or what. | 19:17 |
| dsneddon | trozet, But I think that the best thing might be a yum proxy, so it could go out and get any requested packages without a direct connection. That way the operator wouldn't have to ensure they had every relevant package mirrored. | 19:18 |
| trozet | dsneddon: in opnfv we advertise that the installation does not require internet, so we don't want the undercloud install going to internet at all | 19:19 |
| trozet | dsneddon: so i guess we need to figure out what is causing that | 19:19 |
| dsneddon | trozet, Yeah, well, I'm probably not the right person to ask, because I don't know what the undercloud is actually doing with the packages. | 19:19 |
| *** milan has quit IRC | 19:20 | |
| trozet | dsneddon: np just saw that bugzilla so thought I would ask. Thanks anyway | 19:20 |
| dsneddon | trozet, Also, using "DIB_INSTALLTYPE_puppet_modules=source" will definitely require internet access. | 19:20 |
| dsneddon | trozet, Because it will need to use git | 19:20 |
| trozet | dsneddon: right it looks like all of those DIB_ISNTALLTYPE values are set to package | 19:22 |
| slagle | beekneemech: are you here or just casual? :) | 19:22 |
| beekneemech | slagle: casual :-) | 19:22 |
| dsneddon | trozet, Although, looking closer at this ticket, this error didn't happen when the undercloud was downloading packages. This was actually a missing package during the undercloud installation steps, | 19:22 |
| slagle | beekneemech: alright, well, i was thinking of stopping sahara services on rh1 oc | 19:23 |
| slagle | i mean really, what's the point. might help with cpu. they are occassionaly consuming 10% | 19:23 |
| trozet | dsneddon: my theory is, something is missing on undercloud, causing it to trigger install from internet | 19:23 |
| beekneemech | slagle: +1. I already killed gnocchi there. | 19:23 |
| dsneddon | trozet, Yeah, I guess I could see that. Do you have log messages showing that a remote RPM install failed? | 19:24 |
| slagle | hold onto your butts | 19:24 |
| trozet | dsneddon: we have a meeting with the intel guys in a few minutes who are hitting it | 19:24 |
| trozet | dsneddon: we log the entire undercloud installation, so we should be able to find it | 19:24 |
| *** rajinir has quit IRC | 19:25 | |
| dsneddon | trozet, Cool, good luck with troubleshooting. In my case, the openstack-puppet-modules RPM didn't get installed (for whatever reason). So that might be something to look for. | 19:25 |
| trozet | dsneddon: thanks. will let you know if it pertains to the same bugzilla | 19:27 |
| *** fragatina has quit IRC | 19:28 | |
| *** fragatina has joined #tripleo | 19:29 | |
| *** fragatina has quit IRC | 19:29 | |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Enable sysctl nonlocal_bind https://review.openstack.org/355051 | 19:56 |
| panda | pabelanger: how do I re run doc jobs ? | 19:56 |
| slagle | EmilienM: i wrote yaml and ruby in the same patch ^ | 19:58 |
| EmilienM | omg | 19:59 |
| beekneemech | slagle: My deepest sympathies ;-) | 20:00 |
| EmilienM | slagle: I'm on something now but I suggest to use tripleo::profile::base::kernel | 20:01 |
| *** radeks has joined #tripleo | 20:01 | |
| pabelanger | panda: recheck | 20:04 |
| *** jdob has quit IRC | 20:11 | |
| *** radeks has quit IRC | 20:21 | |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Enable sysctl nonlocal_bind https://review.openstack.org/355051 | 20:23 |
| *** iogg has joined #tripleo | 20:24 | |
| *** yamahata has quit IRC | 20:25 | |
| *** dprince has quit IRC | 20:25 | |
| *** rajinir has joined #tripleo | 20:27 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Create composable mapping between enabled services and role ips https://review.openstack.org/348974 | 20:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert ServiceNetMap to a nested template https://review.openstack.org/353032 | 20:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Remove deprecated node_ips hiera keys https://review.openstack.org/355064 | 20:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Rename NeutronServer to NeutronApi to align with ServiceNetMap https://review.openstack.org/355065 | 20:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add service_ips in csv format to allNodes hieradata https://review.openstack.org/355066 | 20:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Move ceph cluster config out of allNodesConfig https://review.openstack.org/355067 | 20:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Generate composable service node_names lists https://review.openstack.org/355068 | 20:28 |
| openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo: Move ceilometer api to run under apache wsgi https://review.openstack.org/352476 | 20:29 |
| beekneemech | rh1 is about to get a workout... :-) | 20:29 |
| slagle | oh you're still here :) | 20:30 |
| slagle | beekneemech: is there anyway to logon to the uc during a running job? | 20:30 |
| slagle | i guess you might have to be infra root for ssh access | 20:30 |
| beekneemech | slagle: Yeah, it doesn't look like we boot them with a key. | 20:31 |
| beekneemech | key_name | - | 20:31 |
| slagle | yep | 20:32 |
| trozet | dsneddon: ping? | 20:32 |
| *** shardy has quit IRC | 20:32 | |
| dsneddon | trozet, pong | 20:32 |
| trozet | dsneddon: it looks like there are some packages missing in undercloud image which is why it is going to the internet | 20:33 |
| trozet | dsneddon: but they got around it by configuring proxy to get hte packages | 20:33 |
| openstackgerrit | Merged openstack/tripleo-common: Adds Plan List Action https://review.openstack.org/300221 | 20:33 |
| dsneddon | trozet, OK, that sounds like you can maybe work around it by downloading and installing the packages. That is worthy of an upstream bug on bugs.launchpad.net | 20:33 |
| trozet | dsneddon: now they are hitting Error: Could not prefetch keystone_service provider 'openstack': Command: 'openstack ["service", "list", "--quiet", "--format", "csv", "--lo | 20:34 |
| trozet | ng"]' has been running for more than 20 seconds (tried 8, for a total of 170 seconds) | 20:34 |
| *** jayg is now known as jayg|g0n3 | 20:34 | |
| dsneddon | trozet, They should check to make sure that the keystone and other openstack services are running. | 20:34 |
| trozet | dsneddon: mysql looks ok | 20:34 |
| dsneddon | trozet, "openstack-service status" | 20:35 |
| trozet | dsneddon: yeah looking at htat | 20:36 |
| trozet | dsneddon: do you mind joining this call fora few minutes? | 20:38 |
| vkmc | pabelanger, hey there :) quick question about diskimage-builder... can you build debian images from a centos server? | 20:39 |
| vkmc | pabelanger, what dependency should I have to get debootstrap? | 20:39 |
| dsneddon | slagle, Can I get a review of https://review.openstack.org/#/c/353072 We need to include that downstream for an OSP 9 zero day fix. | 20:39 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Add constraint to prohibit balance-tcp from BondInterfaceOvsOptions https://review.openstack.org/355073 | 20:40 |
| slagle | dsneddon: it appears to be already merged | 20:40 |
| pabelanger | vkmc: yes you can, last time I tested it | 20:41 |
| slagle | EmilienM: nonha job is not looking good | 20:41 |
| EmilienM | slagle: ovb? | 20:41 |
| dsneddon | slagle, Oh, I didn't realize bnemec had pushed it through, thanks. | 20:41 |
| EmilienM | they re running | 20:41 |
| pabelanger | vkmc: https://github.com/openstack/ansible-role-diskimage-builder/blob/master/vars/RedHat.yaml#L19 should be the only packages you need | 20:42 |
| vkmc | pabelanger, thanks | 20:42 |
| pabelanger | if you need more, I need to update my ansible playbook | 20:42 |
| *** rhallisey has quit IRC | 20:43 | |
| EmilienM | even undercloud job is broken | 20:43 |
| EmilienM | and takes > 40 min? | 20:43 |
| EmilienM | undercloud sanity check passed | 20:44 |
| slagle | EmilienM: i think the uc job failed b/c of how i forced the periodic job | 20:44 |
| EmilienM | something fails *after* | 20:44 |
| slagle | it tried an overcloud-delete | 20:44 |
| EmilienM | yeah | 20:44 |
| slagle | which clearly aint going to pass | 20:44 |
| EmilienM | right | 20:44 |
| EmilienM | but now why nonha doesn't pass | 20:45 |
| slagle | dunno. it's stuck deploying the controller again | 20:45 |
| slagle | will have to check logs when it fails | 20:45 |
| EmilienM | no logs http://logs.openstack.org/49/346949/6/check/gate-tripleo-ci-centos-7-nonha-multinode/ef1819b/logs/ | 20:45 |
| slagle | EmilienM: the ovb job | 20:45 |
| EmilienM | slagle: ovb job hasn't failed | 20:46 |
| EmilienM | they are both running atm afik | 20:46 |
| slagle | it's going to | 20:46 |
| slagle | it's been stuck on deploying controller for 30 minutes | 20:46 |
| EmilienM | damn | 20:46 |
| *** weshay is now known as weshay_afk | 20:47 | |
| EmilienM | slagle: at this stage, we can retrigger them | 20:48 |
| slagle | yes i'd like to get logs from this and then we can recheck | 20:48 |
| EmilienM | yeah | 20:49 |
| beagles | did gerrit just go *plonk* | 20:50 |
| bswartz | beagles: scheduled restart | 20:50 |
| beagles | bswartz, ah | 20:51 |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is restarting for a scheduled upgrade, but should return to service momentarily: http://lists.openstack.org/pipermail/openstack-dev/2016-August/101394.html | 20:51 | |
| bswartz | beagles: ^ | 20:51 |
| bswartz | slow bot is slow | 20:51 |
| * bswartz pokes openstackstatus with a sharp stick | 20:51 | |
| beagles | :) | 20:52 |
| * beekneemech gives openstackstatus a carrot | 20:52 | |
| beekneemech | Difference in philosophy :-D | 20:52 |
| -openstackstatus- NOTICE: The Mediawiki service at wiki.openstack.org will be offline from 21:00 UTC until approximately 23:00 UTC for a planned upgrade http://lists.openstack.org/pipermail/openstack-dev/2016-August/101395.html | 21:00 | |
| *** ChanServ changes topic to "The Mediawiki service at wiki.openstack.org will be offline from 21:00 UTC until approximately 23:00 UTC for a planned upgrade http://lists.openstack.org/pipermail/openstack-dev/2016-August/101395.html" | 21:00 | |
| *** fultonj has quit IRC | 21:01 | |
| *** shivrao has joined #tripleo | 21:04 | |
| *** lblanchard has quit IRC | 21:08 | |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Enable sysctl nonlocal_bind https://review.openstack.org/355051 | 21:10 |
| *** fragatina has joined #tripleo | 21:11 | |
| *** iogg has quit IRC | 21:11 | |
| *** yamahata has joined #tripleo | 21:16 | |
| *** fragatina has quit IRC | 21:19 | |
| TicToc | Can anyone explain "tripleo quick start ~/.quickstart/ssh.config.ansible will try to proxy through the localhost to ssh to the localhost and will cause an error if ssh is not setup to support it" how do you proxy through localhost to ssh? keep getting the ssh error connecting to undercloud though I can manually connect to it | 21:24 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Expand templated bash to allow for doc generation https://review.openstack.org/347592 | 21:28 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: DO NOT MERGE - Periodic test https://review.openstack.org/346949 | 21:31 |
| *** myoung is now known as myoung|biab | 21:38 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Deploy minimal services in multinode job https://review.openstack.org/355097 | 21:43 |
| *** toymachine has quit IRC | 21:46 | |
| *** jistr has quit IRC | 21:47 | |
| *** fragatina has joined #tripleo | 21:48 | |
| *** fragatina has quit IRC | 21:50 | |
| *** fragatina has joined #tripleo | 21:50 | |
| *** jistr has joined #tripleo | 21:51 | |
| *** pradk has quit IRC | 22:00 | |
| *** jistr has quit IRC | 22:00 | |
| *** shivrao has quit IRC | 22:04 | |
| *** lblanchard has joined #tripleo | 22:08 | |
| *** jistr has joined #tripleo | 22:09 | |
| *** shivrao has joined #tripleo | 22:10 | |
| *** beekneemech is now known as bnemec-pto | 22:12 | |
| *** bfournie has quit IRC | 22:14 | |
| *** [1]cdearborn has quit IRC | 22:16 | |
| *** lynxman has quit IRC | 22:18 | |
| *** jistr has quit IRC | 22:19 | |
| *** jistr has joined #tripleo | 22:25 | |
| *** TicToc has quit IRC | 22:27 | |
| *** panda has quit IRC | 22:31 | |
| *** TicToc has joined #tripleo | 22:34 | |
| *** lblanchard has quit IRC | 22:38 | |
| *** maeca1 has quit IRC | 22:39 | |
| *** lynxman has joined #tripleo | 22:43 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist https://review.openstack.org/319337 | 22:48 |
| *** apetrich has quit IRC | 22:54 | |
| -openstackstatus- NOTICE: ok https://wiki.openstack.org/ is now running Mediawiki 1.27.0; please let us know in #openstack-infra if anything seems wrong | 23:03 | |
| *** ChanServ changes topic to "ok https://wiki.openstack.org/ is now running Mediawiki 1.27.0; please let us know in #openstack-infra if anything seems wrong" | 23:03 | |
| *** ChanServ changes topic to "TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt" | 23:09 | |
| -openstackstatus- NOTICE: https://wiki.openstack.org/ is now running Mediawiki 1.27.0; please let us know in #openstack-infra if anything seems wrong | 23:09 | |
| *** bfournie has joined #tripleo | 23:13 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Remove NeutronEnableTunnelling from templates https://review.openstack.org/335235 | 23:17 |
| ayoung | trown|outtypewww, larsks if either of you are here: what do I need to do to deploy OSP8 (or liberty) with TripleO Quickstart? | 23:21 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Only set $LOCATION if it is not already defined https://review.openstack.org/354365 | 23:22 |
| *** chem|off has quit IRC | 23:22 | |
| *** Ryjedo_ has joined #tripleo | 23:25 | |
| *** Goneri has quit IRC | 23:26 | |
| *** saneax_AFK is now known as saneax | 23:26 | |
| *** saneax is now known as Guest48269 | 23:27 | |
| *** chem|off has joined #tripleo | 23:27 | |
| *** Ryjedo has quit IRC | 23:29 | |
| *** Ryjedo_ is now known as Ryjedo | 23:29 | |
| *** rlandy has quit IRC | 23:29 | |
| *** trozet has quit IRC | 23:31 | |
| *** trozet has joined #tripleo | 23:32 | |
| *** shivrao has quit IRC | 23:32 | |
| *** TicToc has quit IRC | 23:34 | |
| *** TicToc has joined #tripleo | 23:36 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: DO NOT MERGE - Periodic test https://review.openstack.org/346949 | 23:51 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Deploy minimal services in multinode job https://review.openstack.org/355097 | 23:55 |
| *** hparekh has quit IRC | 23:58 | |
| *** yamahata has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!