*** rook-lappy has joined #tripleo | 00:07 | |
*** penick has quit IRC | 00:36 | |
*** tiswanso_ has quit IRC | 00:42 | |
*** tiswanso has joined #tripleo | 00:43 | |
*** Erming__ has joined #tripleo | 00:52 | |
*** Marga_ has quit IRC | 00:53 | |
*** Erming_ has quit IRC | 00:54 | |
*** Marga_ has joined #tripleo | 01:06 | |
*** Marga_ has quit IRC | 01:11 | |
slagle | EmilienM: have you looked into why it's failing? | 01:20 |
---|---|---|
EmilienM | slagle: yes and it seems related to the bug you reported lately | 01:20 |
slagle | which one? | 01:20 |
rhallisey | is anyone else unable to deploy with master atm? | 01:21 |
rhallisey | ironic is struggling :/ | 01:21 |
EmilienM | slagle: bug 1563554 | 01:22 |
openstack | bug 1563554 in tripleo "CI: HA jobs failing with 500 Internal server error during pingtest" [High,Triaged] https://launchpad.net/bugs/1563554 - Assigned to James Slagle (james-slagle) | 01:22 |
*** weshay has quit IRC | 01:30 | |
*** psanchez has quit IRC | 01:32 | |
slagle | EmilienM: ok, i guess do whatever you feel is best | 01:32 |
EmilienM | slagle: I'm waiting for the CI run | 01:33 |
slagle | EmilienM: the HA job is basically totally unreliable at this point | 01:33 |
EmilienM | that's why I don't merge it | 01:33 |
slagle | we ought to just disable it if we can't figure out how to fix it | 01:33 |
EmilienM | we won't want to add regression... | 01:33 |
slagle | well yea, but what good does it to fail 10 times and pass once on a patch | 01:33 |
EmilienM | right, I just want to confirm it's consistent... | 01:34 |
*** psanchez has joined #tripleo | 01:36 | |
*** rhallisey has quit IRC | 01:43 | |
*** akuznetsov has joined #tripleo | 02:01 | |
*** akuznetsov has quit IRC | 02:05 | |
*** ramishra has joined #tripleo | 02:13 | |
*** julim has joined #tripleo | 02:18 | |
*** mannidi__ has joined #tripleo | 02:28 | |
*** shivrao has quit IRC | 02:31 | |
*** yamahata has quit IRC | 02:34 | |
*** Nakato_ is now known as Nakato | 02:44 | |
*** cwolferh has quit IRC | 02:52 | |
*** MaxPC has joined #tripleo | 03:02 | |
*** Marga_ has joined #tripleo | 03:14 | |
*** ebalduf has joined #tripleo | 03:14 | |
*** Marga_ has quit IRC | 03:18 | |
*** Marga_ has joined #tripleo | 03:21 | |
*** yuanying has quit IRC | 03:22 | |
*** yamahata has joined #tripleo | 03:31 | |
*** Marga_ has quit IRC | 03:36 | |
*** Marga_ has joined #tripleo | 03:37 | |
*** links has joined #tripleo | 03:40 | |
*** tiswanso has quit IRC | 03:42 | |
*** ramishra has quit IRC | 03:50 | |
*** ramishra has joined #tripleo | 03:51 | |
*** ebalduf has quit IRC | 04:00 | |
*** masco has joined #tripleo | 04:04 | |
*** akshai has quit IRC | 04:06 | |
openstackgerrit | Rabi Mishra proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 04:09 |
openstackgerrit | Nisha Agarwal proposed openstack/diskimage-builder: Install proliantutils in IPA's virtualenv https://review.openstack.org/299116 | 04:16 |
*** yuanying has joined #tripleo | 04:24 | |
*** oshvartz has quit IRC | 04:28 | |
*** MaxPC has quit IRC | 04:29 | |
*** qasims has joined #tripleo | 04:31 | |
*** akuznetsov has joined #tripleo | 04:43 | |
*** akuznetsov has quit IRC | 04:48 | |
*** akuznetsov has joined #tripleo | 05:04 | |
openstackgerrit | Qasim Sarfraz proposed openstack/tripleo-heat-templates: PLUMgrid Neutron integration https://review.openstack.org/299119 | 05:04 |
*** akuznetsov has quit IRC | 05:08 | |
*** tenaglia_ has joined #tripleo | 05:11 | |
*** jaosorior has joined #tripleo | 05:14 | |
*** tenaglia has quit IRC | 05:15 | |
*** rlandy has quit IRC | 05:17 | |
*** tenaglia has joined #tripleo | 05:19 | |
*** mannidi__ has quit IRC | 05:20 | |
*** tenaglia_ has quit IRC | 05:22 | |
*** shadower has joined #tripleo | 05:42 | |
*** shivrao has joined #tripleo | 05:51 | |
*** oshvartz has joined #tripleo | 05:54 | |
*** shivrao has quit IRC | 05:55 | |
*** liverpooler has joined #tripleo | 05:57 | |
*** tzumainn has quit IRC | 05:59 | |
openstackgerrit | Qasim Sarfraz proposed openstack/tripleo-heat-templates: PLUMgrid Neutron integration https://review.openstack.org/299119 | 06:09 |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 06:20 |
*** mikelk has joined #tripleo | 06:20 | |
*** ccamacho_ has joined #tripleo | 06:20 | |
*** ccamacho has quit IRC | 06:23 | |
*** panda has quit IRC | 06:25 | |
*** panda has joined #tripleo | 06:26 | |
*** rcernin has joined #tripleo | 06:26 | |
*** aufi has joined #tripleo | 06:36 | |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-docs: First documentation for Operational tools https://review.openstack.org/265271 | 06:37 |
openstackgerrit | Qasim Sarfraz proposed openstack/tripleo-heat-templates: PLUMgrid Neutron integration https://review.openstack.org/299151 | 06:39 |
*** ccamacho_ has quit IRC | 06:43 | |
*** ccamacho has joined #tripleo | 06:44 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: change the default satellite tools rpm repo. https://review.openstack.org/245895 | 06:44 |
*** tesseract has joined #tripleo | 06:45 | |
*** tesseract is now known as Guest23157 | 06:46 | |
*** spredzy_ has joined #tripleo | 06:48 | |
*** spredzy has quit IRC | 06:49 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: change the default satellite tools rpm repo. https://review.openstack.org/299157 | 06:49 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: change the default satellite tools rpm repo. https://review.openstack.org/299158 | 06:50 |
*** qasims has quit IRC | 06:57 | |
openstackgerrit | Merged openstack/tripleo-docs: Add MidoNet documentation in advanced deployment https://review.openstack.org/270320 | 07:00 |
*** jprovazn has joined #tripleo | 07:01 | |
*** jtomasek_ has joined #tripleo | 07:02 | |
*** shardy has joined #tripleo | 07:07 | |
*** florianf has joined #tripleo | 07:11 | |
*** bvandenh has joined #tripleo | 07:14 | |
*** spredzy_ is now known as spredzy | 07:15 | |
*** akuznetsov has joined #tripleo | 07:16 | |
*** akuznetsov has quit IRC | 07:16 | |
*** yamahata has quit IRC | 07:16 | |
*** yamahata has joined #tripleo | 07:17 | |
*** jpena|off is now known as jpena | 07:24 | |
*** ifarkas has joined #tripleo | 07:28 | |
*** bvandenh has quit IRC | 07:32 | |
*** shivrao has joined #tripleo | 07:33 | |
jaosorior | shardy: Is there documentation on how to interact with nested stacks via the heatclient? | 07:41 |
jaosorior | (python API) | 07:41 |
*** gfidente has joined #tripleo | 07:41 | |
shardy | jaosorior: Not documentation exactly - what do you need, I wrote a blog post about nested stack introspection a while back | 07:45 |
shardy | basically you just get the ID of the stack (which is the physical_resource_id of the owning resource) | 07:45 |
shardy | then you can use all the normal stack-* commands/APIs on it | 07:45 |
shardy | e.g do heat resource-list overcloud | grep Controller | 07:46 |
shardy | grab the resource ID for the Controller ResourceGroup, then do heat resource-list on it | 07:46 |
shardy | you'll see the results for the nested stack | 07:46 |
shardy | does that help at all? | 07:46 |
jaosorior | shardy: I'm looking into starting to use the EndpointMap in the pythonclient | 07:46 |
jaosorior | I mean, the tripleoclient | 07:47 |
jaosorior | so instead of having the VIPs in the outputs, start using the values for the EndpointMap | 07:47 |
jaosorior | shardy: So, I don't want to call an external command if heat already has the python API. I just haven't figured out how to interact yet with the nested stacks | 07:48 |
*** shivrao_ has joined #tripleo | 07:48 | |
*** hewbrocca has quit IRC | 07:48 | |
*** shivrao has quit IRC | 07:48 | |
*** shivrao_ is now known as shivrao | 07:48 | |
jaosorior | shardy: I see I can get the parameters for the stack, and the outputs... but not the attributes or nested stacks | 07:49 |
*** rdopiera has joined #tripleo | 07:51 | |
*** hewbrocca has joined #tripleo | 07:53 | |
jaosorior | shardy: figured it out | 07:54 |
shardy | jaosorior: the attributes are the same as the outputs | 07:54 |
shardy | e.g get_attr: [nested_thing, foo] is the same as the output "foo" from the nested_thing nested stack | 07:55 |
shardy | In general I wonder about clients fishing data out of deeply nested templates like that, but it's certainly possible | 07:55 |
shardy | the main issue is we consider most of the intra-template interfaces "private" and they may change | 07:56 |
shardy | I suppose that's likely to become more rigid with composable services | 07:56 |
shardy | and if there's a compelling requirement we can perhaps define the EndpointMap interfaces too | 07:56 |
shardy | now it's mechanically generated I guess it should be predictable | 07:56 |
*** jtomasek has quit IRC | 07:58 | |
jaosorior | shardy: well, in that case I could get the same output from the endpointmap to be an output of the overcloud main template | 07:59 |
jaosorior | the VIPs by themselves are not very useful, as opposed to having info about the ports and protocols used | 07:59 |
*** mbound has joined #tripleo | 07:59 | |
shardy | jaosorior: Yeah, exposing the whole map certainly could be useful | 08:00 |
*** jtomasek_ has quit IRC | 08:01 | |
*** snecklifter has quit IRC | 08:08 | |
*** shivrao has quit IRC | 08:14 | |
*** olap has joined #tripleo | 08:19 | |
*** ohamada has joined #tripleo | 08:20 | |
*** yamahata has quit IRC | 08:22 | |
*** mcornea has joined #tripleo | 08:23 | |
*** lucas-dinner is now known as lucasagomes | 08:23 | |
*** jcoufal has joined #tripleo | 08:24 | |
*** jistr has joined #tripleo | 08:25 | |
*** derekh has joined #tripleo | 08:29 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Deploy ceph in the nonha job https://review.openstack.org/293051 | 08:31 |
shardy | We just landed https://review.openstack.org/#/c/299112 in Heat which should fix the delete issues observed yesterday | 08:37 |
derekh | shardy: cool, to use it we now need to promote to a new current-tripleo, I don't think deploying with trunk is working at the moment so we need to figure that out first | 08:40 |
shardy | ack, oh well at least it's one problem ticked off the list ;) | 08:40 |
*** mgould has joined #tripleo | 08:41 | |
derekh | shardy: yup, I'll take a look at why its not working in a bit | 08:41 |
*** tosky has joined #tripleo | 08:46 | |
mgould | morning everyone | 08:47 |
shardy | 'morning mgould | 08:49 |
mgould | huh, I'm sure check-tripleo wasn't on http://status.openstack.org/zuul/ when I looked yesterday | 08:49 |
mgould | does that mean it wasn't working but it is now? | 08:50 |
mgould | morning shardy | 08:50 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Use 'deeper' hiera_hash merge behavior for all roles https://review.openstack.org/281822 | 08:55 |
*** nico_auv has joined #tripleo | 08:56 | |
openstackgerrit | Imre Farkas proposed openstack/python-tripleoclient: Update baremetal ready state command https://review.openstack.org/285977 | 09:06 |
openstackgerrit | Imre Farkas proposed openstack/python-tripleoclient: [WIP] Add DRAC RAID configuration to baremetal ready state command https://review.openstack.org/299221 | 09:06 |
shardy | mgould: I'm not sure what the issue was, but I'd assume the answer is yes - the patch you linked yesterday defintely wasn't getting picked up so I guess there was an infra issue | 09:13 |
mgould | shardy, thanks | 09:13 |
mgould | good to know that check-tripleo is expected to be on that page; I'm sure I've failed to find it there before | 09:14 |
openstackgerrit | Carlos Camacho proposed openstack/instack-undercloud: Overcloud is not able to deploy with the default 4GB of RAM using instack-undercloud https://review.openstack.org/299232 | 09:19 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Use --overcloud-update in the upgrades job https://review.openstack.org/260466 | 09:21 |
shardy | marios: Hey, added some links to https://review.openstack.org/#/c/259568 | 09:24 |
shardy | happy to chat if it would help clarify things | 09:24 |
shardy | tl;dr the actual steps are now defined in puppet-tripleo per-service profiles/manifests | 09:24 |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 on the upgrades job https://review.openstack.org/289445 | 09:26 |
marios | shardy: o/ many thanks shardy, i'd like to take another pass in tomorrow's review run, if i get the chance ;) - looking at your comment | 09:26 |
marios | shardy: yeah thanks shardy the glance example does help | 09:27 |
shardy | np - it's actually a really nice model when you get your head around it :) | 09:27 |
shardy | I really like that we're moving towards a cleaner separation between t-h-t and the puppet manifests | 09:28 |
*** akrivoka has joined #tripleo | 09:28 | |
shardy | marios: re https://review.openstack.org/#/c/299119/ | 09:32 |
shardy | I'm debating the stable/mitaka thing - we agreed a much stricter stance re backports for mitaka, and we need to decide if that includes vendor plugins | 09:32 |
shardy | Maybe we can consider this another backport exception tho | 09:33 |
* shardy worries about everything-is-an-exception abuse :( | 09:33 | |
shardy | I'll drop a reply to the ML perhaps as a follow-up to the gnocchi thing | 09:33 |
openstackgerrit | Merged openstack/tripleo-heat-templates: compute: restart OVS agent on neutron.conf changes https://review.openstack.org/298946 | 09:35 |
marios | shardy: sorry, in another upgrades chat, reading | 09:36 |
shardy | marios: np, it's about the plumgrid patch backport | 09:37 |
shardy | I actually think we have to backport if if we're going to land it on stable/liberty | 09:37 |
shardy | but then we have to align stable/liberty with the same policy as stable/mitaka e.g bugs only | 09:38 |
*** lucasagomes has quit IRC | 09:38 | |
shardy | we can't have an older stable branch gaining more features than a newer one | 09:38 |
marios | shardy: right, so moving forward it should be clear we won't be landing anything new here into stable/liberty but only stable/mitaka | 09:39 |
*** dtantsur|afk is now known as dtantsur | 09:39 | |
shardy | marios: no, we agreed no feature backports for stable/mitaka, so we have to shift both branches to bugfixes-only I think | 09:39 |
marios | shardy: yeah just read back and had flashback from irc meetings... sorry so in general only bug fixes | 09:40 |
rook-lappy | shardy RE updated ping, I did have the -W for the gateway, however it was a change from the previous version. Also, it was using ping instead of $ping, so I went ahead and fixed that. | 09:40 |
shardy | marios: cool, I'll ping the ML about this ref an exception, then send another mail seeking to clarify our approach going forward | 09:41 |
marios | shardy: hm, so i wasn't involved with this integration. apart from plumgrid, is there anything else pending that's like this? | 09:41 |
shardy | rook-lappy: np, not saying we should fix it in your patch, just pointing it out | 09:41 |
shardy | marios: that's a good question, kinda the point of the mitaka blockers etherpad was to work that out, but we can discuss again on the ML | 09:42 |
marios | shardy: if it's really 'the last one' then we could just make another exception for it - original timestamp on that is like December so it isn't something 'last minute' ... k. i guess am saying it probably qualifies for the exception and I'd support it | 09:43 |
marios | shardy: thanks for the ping and reminder about the backport policy :) | 09:43 |
*** lucasagomes has joined #tripleo | 09:43 | |
* marios goes back to converging upgrade setup | 09:43 | |
shardy | marios: Yeah, although this one wasn't that actively updated, it's probably an OK exception | 09:43 |
jaosorior | shardy, marios: this CR https://review.openstack.org/#/c/294438/ had already passed the CI, but started failing in HA after I did some commit message and documentation changes (which are clearly not the cause of the failure). Should I keep re-checking it? The changes shouldn't even have effect in the HA gate as it's defaults for SSL | 09:44 |
marios | shardy: yeah, in my defense i was in 'upgrades mode' and we need things in stable libert (and of course we already agreed exception for those) | 09:44 |
marios | shardy: so i saw stable/liberty and thought 'yup +2' | 09:45 |
shardy | marios: cool, np - sorry for all the interruptions | 09:45 |
marios | shardy: np thanks again for the reminder | 09:45 |
shardy | just wanted to discuss it before everyone started going "WHAT no backports!!" etc ;) | 09:45 |
dtantsur | hey folks! a second +2 is needed for https://review.openstack.org/288417 please | 09:46 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Updated documentation for the default RAM size of the overcloud VMs https://review.openstack.org/299260 | 09:52 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Updated documentation for the default RAM size of the overcloud VMs https://review.openstack.org/299260 | 09:54 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 09:54 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Updated documentation for the default RAM size of the overcloud VMs https://review.openstack.org/299260 | 09:55 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 10:01 |
*** chem has quit IRC | 10:08 | |
*** chem has joined #tripleo | 10:10 | |
*** rhallisey has joined #tripleo | 10:25 | |
*** panda has quit IRC | 10:25 | |
*** panda has joined #tripleo | 10:26 | |
*** rhallisey has quit IRC | 10:26 | |
gfidente | derekh hey the matrix | 10:30 |
gfidente | so should I remove at least undercloud/overcloud? | 10:30 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/os-cloud-config: Allow customizing keystone endpoint ports https://review.openstack.org/299279 | 10:31 |
gfidente | on the distros support I'm unsure ... it doesn't add much value right now so we could remove that too | 10:31 |
derekh | gfidente: They're fine, I was just trying to shorten it a little to make it easier to read, I'm +2 either way so which ever you want is ok with me | 10:32 |
gfidente | yeah and I think it's better | 10:35 |
gfidente | give me a sec to update | 10:35 |
gfidente | derekh shall I remove the 'stable' column too? | 10:35 |
*** chem has quit IRC | 10:35 | |
derekh | gfidente: ya, were running all the jobs on stable branches anyways | 10:36 |
gfidente | reboot? | 10:37 |
derekh | gfidente: we should probably leave that one in so we don't forget about it at some stage we may add a reboot | 10:38 |
gfidente | yeah let me add a 'o' for the ha job there | 10:38 |
derekh | gfidente: ack | 10:39 |
*** snecklifter has joined #tripleo | 10:39 | |
gfidente | and also turn upgrade into 'o' | 10:39 |
gfidente | not that can stay x | 10:40 |
gfidente | I mean, we need to do some more work but it's just wip | 10:40 |
dtantsur | shardy, hi! I assume you saw https://review.openstack.org/#/c/298866/ didn't you? | 10:41 |
openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Update wanted_ci_job to reflect current status of things https://review.openstack.org/294071 | 10:41 |
dtantsur | it seems to affect the way tripleo is released quite a lot | 10:41 |
shardy | dtantsur: Yeah, I've not fully figured out the process changes yet but I saw it, thanks | 10:42 |
*** bvandenh has joined #tripleo | 10:44 | |
jaosorior | damn... I think trunk.rdoproject.org is down :/ | 10:57 |
*** derekh changes topic to "TripleO | NOTICE: trunk.rdoproject.org is down | CI status: http://tripleo.org/cistatus.html | Docs: http://tripleo.org/" | 10:59 | |
jaosorior | derekh: Isn't trunk.rdoproject.org being down | 11:01 |
jaosorior | *Won't trunk.rdoproject.org being down affect the CI? | 11:01 |
jaosorior | ah, yep... it seems it does affect it | 11:01 |
derekh | jaosorior: Yup, all ci will fail until its back ;-( | 11:03 |
hewbrocca | They are rebuilding the instance | 11:03 |
hewbrocca | apparently the ephemeral disk was a bit more ephemeral than they hoped | 11:03 |
jaosorior | I see | 11:04 |
*** rhallisey has joined #tripleo | 11:05 | |
*** dprince has joined #tripleo | 11:05 | |
*** pblaho has joined #tripleo | 11:06 | |
openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again https://review.openstack.org/288915 | 11:12 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: compute: restart OVS agent on neutron.conf changes https://review.openstack.org/299303 | 11:13 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Updated documentation for the default RAM size of the overcloud VMs https://review.openstack.org/299260 | 11:14 |
-openstackstatus- NOTICE: Gate on project-config is currently broken due to IRC tests. The problem has been detected and we are working to fix the issue as soon as possible. | 11:15 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Updated documentation for the default RAM size of the overcloud VMs https://review.openstack.org/299260 | 11:16 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: compute: restart OVS agent on neutron.conf changes https://review.openstack.org/299305 | 11:17 |
marios | EmilienM: hey o/ it worked great for me i made the cherrypicks ^^^ | 11:17 |
*** dprince has quit IRC | 11:20 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Tempest for tripleo CI https://review.openstack.org/295844 | 11:21 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 11:21 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Don't restart Pacemaker-managed services from Puppet https://review.openstack.org/298847 | 11:23 |
*** rook-lappy has quit IRC | 11:23 | |
*** rook-lappy has joined #tripleo | 11:26 | |
*** bvandenh has quit IRC | 11:26 | |
*** rook-lappy has quit IRC | 11:29 | |
*** ibravo has joined #tripleo | 11:29 | |
gfidente | sshnaidm hey | 11:29 |
sshnaidm | gfidente, hi | 11:29 |
gfidente | I saw your submission to use tempest in tripleo ci and it's great | 11:30 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Add quotes around the cinder_iscsi_ip_address value https://review.openstack.org/298827 | 11:30 |
*** mkovacik_ has joined #tripleo | 11:30 | |
gfidente | why not for the HA job though? | 11:30 |
gfidente | maybe I missed some conversation about the topic? | 11:30 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Add quotes around the cinder_iscsi_ip_address value https://review.openstack.org/298828 | 11:30 |
sshnaidm | gfidente, in last meeting we agreed to make it for periodical jobs only, it takes about 20-35 minutes | 11:30 |
sshnaidm | gfidente, http://eavesdrop.openstack.org/meetings/tripleo/2016/tripleo.2016-03-29-14.00.log.html | 11:31 |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Added validation to tripleo.sh --overcloud-deploy option. https://review.openstack.org/296362 | 11:31 |
*** mkovacik has quit IRC | 11:32 | |
*** rook-lappy has joined #tripleo | 11:32 | |
*** ibravo has quit IRC | 11:34 | |
EmilienM | marios: hey | 11:35 |
EmilienM | marios: good news | 11:37 |
EmilienM | marios: I remember your patch did some things more that I did not address | 11:37 |
marios | EmilienM: no it as just for the restart | 11:37 |
marios | s/as/was | 11:37 |
*** ibravo has joined #tripleo | 11:37 | |
EmilienM | oh, ok | 11:37 |
EmilienM | marios: so keep in mind what I wrote in the code, in comments | 11:37 |
gfidente | sshnaidm periodic is fine but I don't see any reference to not running tempest against the ha job? | 11:38 |
slagle | derekh: hey, the mitaka periodic job setup was merged, do i need to make any changes to tripleo-jobs.py to get it to show up on the status page? | 11:40 |
sshnaidm | gfidente, I still test it against CI environment to see which test load it capable to carry, if HA tests will pass as well I don't see any problem to test them too | 11:40 |
marios | EmilienM: ack thanks for the comment | 11:41 |
marios | EmilienM: makes sense | 11:41 |
sshnaidm | gfidente, actually you gave me idea to test it right now.. | 11:41 |
openstackgerrit | Merged openstack/tripleo-heat-templates: change the default satellite tools rpm repo. https://review.openstack.org/299157 | 11:42 |
jaosorior | Does anyone have a recent overcloud deployment? | 11:42 |
derekh | slagle: ya a change is needed but its not tripleo-jobs.py , its a script that runs on the tripleo.org instance ( we need to add it to the params that are passed into tripleo-jobs.py) | 11:43 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: Add a service provider. https://review.openstack.org/286124 | 11:43 |
derekh | slagle: I add it now | 11:43 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 11:43 |
gfidente | sshnaidm I think it's particularily useful against the HA job because it will be distributing load across different nodes so it might pick up issues which are only seen on parallel access to services | 11:44 |
sshnaidm | gfidente, yeah, I thought to start with non-HA because not so stable HA jobs, but in periodic ones it shouldn't be a problem | 11:45 |
derekh | slagle: done, it should appear there at some stage soon | 11:46 |
gfidente | sshnaidm but that's a push for us to fix the ha job, please don't drop the ball there :P | 11:46 |
*** openstackgerrit has quit IRC | 11:47 | |
*** dprince has joined #tripleo | 11:47 | |
sshnaidm | gfidente, yeeeah, but a thousand rechecks for a patch can frustrate any contributor )) | 11:47 |
*** openstackgerrit has joined #tripleo | 11:48 | |
slagle | derekh: cool, thanks | 11:49 |
slagle | the job just merged, so it should run tonight | 11:49 |
*** MaxPC has joined #tripleo | 11:50 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Documentation updated for the Overcloud default configuration https://review.openstack.org/299325 | 11:50 |
*** masco has quit IRC | 11:51 | |
gfidente | adarazs I see so it's running without any depends-on now ... fingers crossed :) | 11:52 |
gfidente | bandini you around? | 11:53 |
adarazs | gfidente: yep, everything got merged that it needs. | 11:53 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-docs: Documentation updated for the Overcloud DNS default configuration https://review.openstack.org/299325 | 11:54 |
*** ibravo has quit IRC | 11:55 | |
bandini | gfidente: yo | 11:57 |
bandini | sorta | 11:57 |
gfidente | bandini fine was thinking about that openstack-keystone > openstack-core rename | 11:58 |
gfidente | and how to mix up / merge the two patches | 11:58 |
gfidente | it's rather urgent because I think we just branched mitaka | 11:58 |
gfidente | and in mitaka it's named openstack-core | 11:58 |
gfidente | while in liberty was openstack-keystone | 11:59 |
*** rodrigods has quit IRC | 11:59 | |
*** rodrigods has joined #tripleo | 11:59 | |
gfidente | so we need to figure how to make the upgrade go and cherry-pick to mitaka branch | 11:59 |
gfidente | well urgent not as in today but in next week | 11:59 |
gfidente | jistr marios that would be https://review.openstack.org/#/c/296592/ and https://review.openstack.org/#/c/292535/ | 12:01 |
gfidente | ^^ | 12:02 |
dprince | jpeeler: hi, looking at https://review.openstack.org/#/c/247724/. Would it make sense to just call it docker_upload instead of the more generic upload? | 12:04 |
*** trown|outtypewww is now known as trown | 12:05 | |
dprince | jpeeler: reason I ask this is because we eventually will want to have a glance image loader as well. And that one would likely be able to share some of the same YAML syntax as the image builds... so it would be quite a different YAML format I think. But the verb for that is still 'uploads'. | 12:05 |
*** weshay has joined #tripleo | 12:07 | |
*** weshay has quit IRC | 12:08 | |
*** weshay has joined #tripleo | 12:09 | |
*** thrash|g0ne is now known as thrash | 12:11 | |
*** akrivoka has quit IRC | 12:16 | |
*** david-lyle_ has joined #tripleo | 12:17 | |
*** david-lyle has quit IRC | 12:17 | |
*** jayg|g0n3 is now known as jayg | 12:17 | |
*** akrivoka has joined #tripleo | 12:18 | |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Deprecate "baremetal show capabilities" command https://review.openstack.org/299350 | 12:20 |
*** pradk has quit IRC | 12:21 | |
*** morazi has joined #tripleo | 12:21 | |
*** pradk has joined #tripleo | 12:21 | |
openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates: Enable galera replication for Mariadb 10.1 https://review.openstack.org/299352 | 12:21 |
*** lucasagomes is now known as lucas-hungry | 12:25 | |
*** openstackgerrit has quit IRC | 12:33 | |
*** openstackgerrit has joined #tripleo | 12:33 | |
*** mbound has quit IRC | 12:34 | |
*** bvandenh has joined #tripleo | 12:34 | |
*** mbound has joined #tripleo | 12:36 | |
*** jaosorior has quit IRC | 12:38 | |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: [WIP] Allow import command to set deploy image and local boot https://review.openstack.org/299362 | 12:38 |
*** jaosorior has joined #tripleo | 12:39 | |
*** jpena is now known as jpena|lunch | 12:42 | |
*** ayoung has quit IRC | 12:46 | |
EmilienM | have you already seen that error in HA jobs lately? http://logs.openstack.org/21/298421/1/check-tripleo/gate-tripleo-ci-f22-ha/f825ced/console.html#_2016-03-29_18_40_21_393 | 12:51 |
EmilienM | Error: /Stage[main]/Keystone::Roles::Admin/Keystone_user[admin]: Could not evaluate: Command: 'openstack [\"token\", \"issue\", [\"--format\", \"value\"]]' has been running for more then 20 seconds! | 12:51 |
EmilienM | I'm wondering if it's just me and a patch I'm pushing or if it also affects someone else | 12:52 |
jaosorior | no, the stuff that I'm seeing is: Error: /Stage[main]/Glance::Db::Sync/Exec[glance-manage db_sync]: Failed to call refresh: glance-manage --config-file /etc/glance/glance-registry.conf db_sync returned 1 instead of one of [0] | 12:54 |
jaosorior | Error: /Stage[main]/Glance::Db::Sync/Exec[glance-manage db_sync]: glance-manage --config-file /etc/glance/glance-registry.conf db_sync returned 1 instead of one of [0] | 12:54 |
jaosorior | not sure if someone has seen that too | 12:54 |
*** rlandy has joined #tripleo | 12:56 | |
adarazs | EmilienM, dprince, derekh, gfidente: IPv6 passed using the (proper) upgrade job. if we can agree that that's a good place for it, we can submit it. if there's still doubt I can write an email about it to the dev list... | 12:58 |
adarazs | https://review.openstack.org/289445 | 12:58 |
EmilienM | jaosorior: I did not see it | 12:58 |
EmilienM | jaosorior: which patch? | 12:59 |
jaosorior | EmilienM: https://review.openstack.org/#/c/294438/ | 12:59 |
jaosorior | EmilienM: What patch are you reffering to? | 12:59 |
EmilienM | adarazs: +2 but I'll let derekh, shardy or slagle to take the decision to approve it or not | 12:59 |
EmilienM | jaosorior: https://review.openstack.org/298421 | 13:00 |
jaosorior | lets see | 13:00 |
EmilienM | jaosorior: yeah, your patch is not related | 13:01 |
dprince | adarazs: I think I'd defer to derek as to the immediate answer here | 13:01 |
dprince | derekh: you okay to have this IPv6 job live alongside upgrades for now? | 13:01 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Use wait_for_finish from python-ironic-inspector-client https://review.openstack.org/299377 | 13:01 |
dtantsur | mgould, ^^ | 13:01 |
derekh | dprince: adarazs I happy to have it there, looking at the logs at the moment to make sure it doing what it say it is | 13:02 |
derekh | 2016-03-30 11:39:36.374 | Stack overcloud UPDATE_FAILED | 13:03 |
derekh | adarazs: gfidente ^ was that happening before the IPv6 addition ? | 13:03 |
gfidente | oh interesting so we didn't catch the failed update | 13:04 |
adarazs | oh, I didn't look at the update part, just for the pingtest and original stack create. | 13:04 |
gfidente | I mean job was green | 13:04 |
derekh | gfidente: yup, job is green, looks like the error from the update is being ignored | 13:05 |
adarazs | derekh: it's the same error in the last gate job of the update https://review.openstack.org/#/c/260466/ -- http://logs.openstack.org/66/260466/15/check-tripleo/gate-tripleo-ci-f22-upgrades/a8db5e6/console.html#_2016-03-30_08_08_22_708 | 13:07 |
adarazs | gfidente: ^ | 13:07 |
openstackgerrit | Gonéri Le Bouder proposed openstack/instack-undercloud: ironic: turn on ipxe timout https://review.openstack.org/294787 | 13:08 |
jaosorior | EmilienM: In the patch you refferred to, there seem to be a big bunch of errors related to mysql | 13:09 |
adarazs | derekh, gfidente: so on the bright side, ipv6 doesn't make things worse ;) | 13:10 |
*** akshai has joined #tripleo | 13:10 | |
shadower | lol | 13:10 |
derekh | gfidente: adarazs ok, so we can either merge it now or wait until we have a chance to debug the problem without complicating things, gfidente are you going to look into it? if so which would you prefer? | 13:10 |
dprince | shardy: hey, regarding https://review.openstack.org/#/c/295588/7/overcloud.yaml I think I should probably remove all the overcloud.yaml parameters then that are moving into the keystone service | 13:12 |
dprince | shardy: like all the top level parameters.... | 13:12 |
dprince | shardy: either that or mark them as deprecated | 13:12 |
*** bvandenh has quit IRC | 13:12 | |
gfidente | derekh yep looking into both | 13:13 |
adarazs | looks like the error is: ValueError: The Referenced Attribute (StoragePort ip_subnet) is incorrect. | 13:13 |
gfidente | why we don't catch the failure and why TenantPort is unhappy | 13:13 |
*** ccamacho_ has joined #tripleo | 13:14 | |
*** ccamacho_ has quit IRC | 13:14 | |
hewbrocca | derekh, dprince thanks for weighing in on the CI thread | 13:16 |
*** mbound has quit IRC | 13:16 | |
derekh | hewbrocca: np | 13:16 |
*** mbound has joined #tripleo | 13:17 | |
hewbrocca | I need to check the specs on these dell blades (will do shortly) | 13:18 |
*** openstackgerrit has quit IRC | 13:18 | |
derekh | EmilienM: seeing this in ci jobs Invalid resource type oslo::messaging_rabbit^[[0m | 13:18 |
EmilienM | jaosorior: can you look https://review.openstack.org/#/c/296497/ when you have time please? | 13:18 |
derekh | EmilienM: is that what this was going to prevent? https://review.openstack.org/#/c/293999/ | 13:18 |
*** openstackgerrit has joined #tripleo | 13:18 | |
hewbrocca | but it seems like 16 of them would at least keep some level of CI service available | 13:18 |
derekh | hewbrocca: yup | 13:18 |
EmilienM | derekh: yes | 13:18 |
EmilienM | derekh: let me check. | 13:19 |
*** Marga__ has joined #tripleo | 13:19 | |
*** larstobi has quit IRC | 13:19 | |
jaosorior | EmilienM: No problem | 13:19 |
jaosorior | will do | 13:19 |
EmilienM | derekh: we don't use puppet-oslo yet https://review.openstack.org/#/c/292309/ was not merged | 13:19 |
adarazs | gfidente, derekh: isn't the problem that "-e /usr/share/openstack-tripleo-heat-templates/environments/puppet-ceph-devel.yaml" is missing from OVERCLOUD_DEPLOY_ARGS in upgrades)? | 13:19 |
adarazs | gfidente, derekh: https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L61 | 13:19 |
*** larstobi has joined #tripleo | 13:19 | |
EmilienM | derekh: on which patch did you see the error? | 13:20 |
* adarazs is just trying to compare the nonha ceph job with the upgrades that is supposed to be ceph too. | 13:20 | |
derekh | EmilienM: all of the recent ones I've looked at so far http://tripleo.org/cistatus.html | 13:21 |
derekh | EmilienM: let me find an example | 13:21 |
EmilienM | damn | 13:21 |
*** Marga_ has quit IRC | 13:21 | |
EmilienM | let me check what we recently merged. | 13:21 |
*** lblanchard has joined #tripleo | 13:21 | |
*** ibravo has joined #tripleo | 13:22 | |
*** tiswanso has joined #tripleo | 13:22 | |
EmilienM | derekh: I don't understand | 13:22 |
derekh | EmilienM: actually it might be just puppet-* repositories | 13:22 |
EmilienM | derekh: https://review.openstack.org/#/q/owner:%22Ivan+Berezovskiy%22+status:open | 13:22 |
EmilienM | look the 3 first patches | 13:23 |
EmilienM | they are not merged but indeed, not passing OOO CI | 13:23 |
EmilienM | they won't merge until OOO CI is green. | 13:23 |
derekh | EmilienM: ok, false alarm, I saw so many of them I though it was a global problem | 13:25 |
derekh | EmilienM: sorry | 13:25 |
*** trozet has joined #tripleo | 13:25 | |
EmilienM | derekh: no problem, please continue to report me issues, it's useful feedback :) | 13:25 |
*** egafford has joined #tripleo | 13:25 | |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Use wait_for_finish from python-ironic-inspector-client https://review.openstack.org/299377 | 13:25 |
EmilienM | derekh: for your info, we are standardizing the way to configure oslo projects (messaging, logging, etc). | 13:25 |
derekh | EmilienM: sounds good, thanks | 13:26 |
EmilienM | this is the kind of standardization: https://review.openstack.org/#/c/292309/9/manifests/init.pp | 13:26 |
*** links has quit IRC | 13:30 | |
EmilienM | derekh: what kind of error is it ? http://logs.openstack.org/93/298893/4/check-tripleo/gate-tripleo-ci-f22-nonha/8a5306b/console.html#_2016-03-30_12_29_47_422 | 13:30 |
EmilienM | is it because tripleo cloud is down? | 13:31 |
derekh | EmilienM: no, the command that files is a few lines up "/tmp/tripleo-ci/scripts/tripleo.sh --undercloud" | 13:31 |
derekh | EmilienM: you have to download the undercloud tarball, and look in the file /var/log/undercloud_install.txt | 13:32 |
EmilienM | mhh ok | 13:32 |
derekh | EmilienM: the other error is because we are trying to collect logs from something that doesn't exist yet | 13:32 |
EmilienM | it would be cool to add debug messages (I can work on it) | 13:33 |
derekh | EmilienM: this is supposed to make it more obvious https://review.openstack.org/#/c/296375/1 | 13:33 |
EmilienM | derekh: excellent | 13:34 |
*** liverpooler has quit IRC | 13:34 | |
*** lucas-hungry is now known as lucasagomes | 13:36 | |
*** trown is now known as trown|afk | 13:37 | |
EmilienM | derekh: I don't understand why we have this error, we added puppet-oslo to jenkins/jobs/tripleo.yaml and also to tripleo-puppet-elements | 13:37 |
*** tzumainn has joined #tripleo | 13:37 | |
EmilienM | oh I figured | 13:38 |
EmilienM | I always forget that undercloud does not use puppet elements | 13:38 |
openstackgerrit | Merged openstack/tripleo-heat-templates: compute: restart OVS agent on neutron.conf changes https://review.openstack.org/299305 | 13:39 |
EmilienM | well, it does not | 13:42 |
EmilienM | it does now*, it seems | 13:42 |
*** mkovacik_ has quit IRC | 13:42 | |
*** derekh changes topic to "TripleO | NOTICE: trunk.rdoproject.org has traveled back in time a week, strange things may happen | CI status: http://tripleo.org/cistatus.html | Docs: http://tripleo.org/" | 13:42 | |
*** mkovacik_ has joined #tripleo | 13:43 | |
*** ebalduf has joined #tripleo | 13:43 | |
*** mkovacik_ has quit IRC | 13:43 | |
derekh | gfidente: could $topic be the cause of your problems (unlikly I think but just pointing it out incase) | 13:43 |
derekh | gfidente: the main trunk server was having problem so its been switched to one from a week ago, we're now using packages that are a week older then we were this morning | 13:44 |
derekh | EmilienM: FYI ^ | 13:45 |
derekh | EmilienM: might be the cause of your problems aswell | 13:45 |
gfidente | I am still looking at why we didn't catch the failure in the first place tbh | 13:45 |
derekh | gfidente: ok | 13:45 |
EmilienM | derekh: well, we're using git to pull elements, right? | 13:45 |
*** mkovacik_ has joined #tripleo | 13:45 | |
gfidente | we do catch the status correctly | 13:46 |
gfidente | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L259 | 13:46 |
gfidente | as it prints it's in failed state | 13:46 |
*** saneax is now known as saneax_AFK | 13:46 | |
gfidente | http://logs.openstack.org/45/289445/32/check-tripleo/gate-tripleo-ci-f22-upgrades/5bc5b3c/console.html#_2016-03-30_11_39_36_374 | 13:46 |
derekh | EmilienM: yes, the puppet modules come from git but if your relying on a change to a tripleo package that merged in the last week then we mightn't have it | 13:47 |
gfidente | but then the caller does not raise apparently | 13:47 |
gfidente | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L300 | 13:47 |
EmilienM | derekh: only puppet-elements | 13:47 |
*** jprovazn has quit IRC | 13:47 | |
derekh | EmilienM: ok | 13:47 |
jpeeler | dprince: i responded to the review, thanks for looking at it. see if you disagree with anything i said there before i go changing things. | 13:48 |
*** mkovacik has joined #tripleo | 13:48 | |
*** mkovacik_ has quit IRC | 13:48 | |
*** jpena|lunch is now known as jpena | 13:50 | |
dprince | jpeeler: lets not change it yet | 13:51 |
dprince | jpeeler: for the glance case I was imagining that the build and upload YAML would be the same | 13:52 |
dprince | jpeeler: with the new uploader format would that work though? wouldn't you want the glance version to be in the new uploads file format (with different settings than docker, but still a separate file) | 13:53 |
jpeeler | let me look at the image build yaml | 13:54 |
*** akrivoka has quit IRC | 13:54 | |
derekh | gfidente: weird, it appears to be hitting this line https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_deploy.py#L929 | 13:54 |
*** akrivoka has joined #tripleo | 13:55 | |
jaosorior | EmilienM: Who can I ping about the CR you pointed me to? | 13:55 |
jpeeler | dprince: i don't know that either are exactly a perfect overlap. but i was thinking the "uploader" would be changed to glance and similar fields could be used for glance uploading | 13:55 |
derekh | gfidente: stdout is up a little http://logs.openstack.org/45/289445/32/check-tripleo/gate-tripleo-ci-f22-upgrades/5bc5b3c/console.html#_2016-03-30_11_39_36_370 | 13:55 |
jaosorior | not sure which nickname Dimitri Savineau has | 13:55 |
EmilienM | jaosorior: which one? | 13:56 |
EmilienM | ah | 13:56 |
jpeeler | dprince: if i changed as i commented on the review, i think adding a separate section entirely for glance uploading would be easy to do | 13:56 |
*** ebalduf has quit IRC | 13:58 | |
*** mkovacik has quit IRC | 13:58 | |
dprince | jpeeler: lets go with this as is I think | 13:59 |
jpeeler | well, i won't complain about that | 13:59 |
dprince | jpeeler: perhaps I was just overloading the YAML's a bit | 13:59 |
gfidente | derekh oh I see the output is there yes | 13:59 |
dprince | jpeeler: thanks for this | 14:00 |
*** dustins has joined #tripleo | 14:01 | |
jpeeler | dprince: sure, it shouldn't be hard to tweak either way | 14:01 |
gfidente | derekh but this guy is logging DONE twice | 14:01 |
gfidente | https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo.sh#L494 | 14:01 |
gfidente | on L504 too, as if it exited 0 | 14:01 |
derekh | gfidente: line 504 | 14:01 |
derekh | gfidente: yup, agreed | 14:02 |
gfidente | so I just reproduced it though, exit code from client is 0 in despite raise | 14:02 |
*** marcusvrn_ has joined #tripleo | 14:02 | |
*** mgould has quit IRC | 14:03 | |
jpeeler | shardy: if you're around, https://review.openstack.org/#/c/247724/ | 14:06 |
*** chem has joined #tripleo | 14:13 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: composable keystone services https://review.openstack.org/295588 | 14:18 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Configure ControllerServices via resource chains https://review.openstack.org/259568 | 14:18 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: composable glance services https://review.openstack.org/237370 | 14:18 |
openstackgerrit | Imre Farkas proposed openstack/python-tripleoclient: Update baremetal ready state command https://review.openstack.org/285977 | 14:18 |
*** trown|afk is now known as trown | 14:21 | |
*** bvandenh has joined #tripleo | 14:23 | |
*** oshvartz has quit IRC | 14:24 | |
openstackgerrit | Merged openstack/tripleo-common: Upload docker image files from yaml config file https://review.openstack.org/247724 | 14:29 |
*** links has joined #tripleo | 14:30 | |
*** jprovazn has joined #tripleo | 14:31 | |
shardy | dprince: Hey, sorry been in $meetings | 14:31 |
shardy | yeah agree we should just remove them from overcloud.yaml, as they won't be wired in and we use parameter_defaults everywhere now | 14:32 |
*** dustins has quit IRC | 14:32 | |
dprince | shardy: I had assumed we would have a deprecation period for anyone not using python-tripleoclient I guess | 14:33 |
dprince | shardy: but I'd be fine to go on and nuke them all I guess | 14:33 |
*** akrivoka has quit IRC | 14:34 | |
shardy | dprince: I'm not really sure what use a deprecation period would be here, because they become immediately non-functional | 14:34 |
shardy | may as well make it explicit IMO | 14:34 |
dprince | shardy: yep, agree | 14:35 |
*** akrivoka has joined #tripleo | 14:35 | |
tenaglia | guys, can someone help me on debugging why those tests fail? https://review.openstack.org/#/c/292943/ I'm trying to submit a couple of patches for puppet-pacemaker and I don't understand the failures of gate-tripleo-ci-f22-ha (and another "Fuel CI" recently added). | 14:35 |
*** dustins has joined #tripleo | 14:36 | |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 14:36 |
*** olap has quit IRC | 14:37 | |
gfidente | derekh looks like the openstackclient doesn't care about what we return | 14:37 |
gfidente | either we raise or return | 14:37 |
derekh | gfidente: so it just throws away the error? | 14:38 |
gfidente | unless we raise yes | 14:40 |
gfidente | so it seems | 14:40 |
gfidente | i'll send something for tripleoclient and add client guys on the review | 14:40 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: composable keystone services https://review.openstack.org/295588 | 14:41 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: composable glance services https://review.openstack.org/237370 | 14:41 |
gfidente | derekh in fact when heat doesn't fail validation I get return code 0 from the client on new deployments too | 14:42 |
gfidente | even though the stack is in create_compleate | 14:43 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Allow import command to set deploy image and local boot https://review.openstack.org/299362 | 14:44 |
*** links has quit IRC | 14:49 | |
EmilienM | mcornea: https://bugzilla.redhat.com/show_bug.cgi?id=1322336 | 14:49 |
openstack | bugzilla.redhat.com bug 1322336 in openstack-tripleo-heat-templates "IPv6 overcloud deployment fails" [Urgent,Post] - Assigned to gfidente | 14:49 |
EmilienM | mcornea: it's fixed by https://review.openstack.org/#/c/298827/ | 14:49 |
EmilienM | oops, bug alrady updated :) so fast | 14:50 |
mcornea | EmilienM: yes, I noticed that later. It worked after applying it | 14:50 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: [WIP] Allow 'baremetal import' command to also start introspection https://review.openstack.org/299388 | 14:50 |
EmilienM | mcornea: excellent! | 14:50 |
mcornea | EmilienM: I've got another IPv6 related one, it's not harmful but if anyone could take a look it would be great: https://bugzilla.redhat.com/show_bug.cgi?id=1322369 | 14:51 |
openstack | bugzilla.redhat.com bug 1322369 in rhel-osp-director "In IPv6 deployments Redis replication reports the internal_api vip and the redis vip addresses as slave nodes" [High,New] - Assigned to athomas | 14:51 |
EmilienM | mcornea: let me look | 14:52 |
*** dtantsur is now known as dtantsur|bbl | 14:52 | |
EmilienM | gfidente: can you confirm this is a bug? I remember you did some code with redis recently | 14:53 |
openstackgerrit | Merged openstack/tripleo-heat-templates: change the default satellite tools rpm repo. https://review.openstack.org/299158 | 14:54 |
pradk | trown, hey i'm seeing some recently merged patches not getting included in the delorean builds | 14:55 |
pradk | trown, in the ci | 14:55 |
gfidente | EmilienM looking now | 14:55 |
trown | pradk: ya, we had an outage, and the backup was a week behind, we are switching back to the primary now though (just waiting on DNS TTL) | 14:56 |
pradk | trown, cool ok i'll hold of on recheck until you say so | 14:57 |
*** yamahata has joined #tripleo | 14:58 | |
openstackgerrit | Merged openstack/instack-undercloud: Overcloud is not able to deploy with the default 4GB of RAM using instack-undercloud https://review.openstack.org/299232 | 15:02 |
trown | pradk: https://trunk.rdoproject.org/centos7-mitaka/report.html looks fixed now | 15:03 |
pradk | trown, cool, thx | 15:03 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Gnocchi as a Ceilometer metrics storage backend https://review.openstack.org/252032 | 15:04 |
*** TSCHAK has quit IRC | 15:05 | |
openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Dont install ceilometer alarms with aodh https://review.openstack.org/299462 | 15:08 |
*** MaxPC has quit IRC | 15:09 | |
*** MaxPC has joined #tripleo | 15:11 | |
pradk | EmilienM, looks like we're including ceilo service in liberty undercloud can you review https://review.openstack.org/#/c/299462/ | 15:13 |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 15:13 |
EmilienM | pradk: will look | 15:13 |
pradk | thx | 15:13 |
openstackgerrit | Merged openstack/tripleo-incubator: Using host-passthrough cpu mode with virtual hosts https://review.openstack.org/273364 | 15:14 |
*** saneax_AFK is now known as saneax | 15:16 | |
openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Dont install ceilometer alarms with aodh https://review.openstack.org/299462 | 15:17 |
*** mgould has joined #tripleo | 15:17 | |
*** dustins has quit IRC | 15:17 | |
*** dustins has joined #tripleo | 15:18 | |
*** olap has joined #tripleo | 15:21 | |
*** mikelk has quit IRC | 15:21 | |
*** Guest23157 has quit IRC | 15:21 | |
slagle | pradk: so it's either ceiloemter alarm or aodh? | 15:27 |
slagle | tzumainn: ^ | 15:27 |
openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Use Fedora 23 atomic in container gate https://review.openstack.org/293108 | 15:27 |
slagle | pradk: tzumainn : i wonder if we should just revert aodh in liberty b/c: a) it's not set up for ssl apparently, b) i think cloudforms relies on ceilometer alarms | 15:28 |
pradk | slagle, yea either or | 15:29 |
openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Centos gives /dev/pts/ptmx the wrong perms https://review.openstack.org/295570 | 15:29 |
openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Remove hack the pulls latest docker https://review.openstack.org/293110 | 15:29 |
pradk | slagle, looks like it got merged into undercloud .. so if we have aodh, we shouldnt be running cceilo alarms | 15:29 |
shardy | Cloudforms relies on ceilometer alarms from the undercloud? | 15:29 |
slagle | shardy: i thought it did, yes | 15:30 |
slagle | need tzumainn to confirm | 15:30 |
shardy | Interesting, I didn't realize we used undercloud ceilo for anything atm | 15:30 |
pradk | slagle, i guess thats fine.. i dont see any advantage o f having aodh on undercloud with it being on overcloud .. fact that it made it is cool, but if we want to revert i'll let you guys make that decision | 15:30 |
pradk | without* it | 15:30 |
slagle | ok | 15:30 |
*** bvandenh has quit IRC | 15:30 | |
pradk | slagle, it working fine i think, just that ceilo alarm is also being setup which it shoudlnt | 15:31 |
slagle | i was just thinking revert since we would have to fix ssl support for it otherwise | 15:31 |
pradk | slagle, whats the ssl issue? | 15:31 |
slagle | pradk: https://bugzilla.redhat.com/show_bug.cgi?id=1322311 | 15:31 |
openstack | bugzilla.redhat.com bug 1322311 in rhel-osp-director "On SSL enabled undercloud the aodh publicURL gets configured as non-https" [Urgent,New] - Assigned to pkilambi | 15:31 |
slagle | i just saw it this morning | 15:31 |
slagle | lol, someone assigned it to *you* | 15:32 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add EndpointMap as output https://review.openstack.org/299473 | 15:32 |
slagle | not sure why that happened :) | 15:32 |
pradk | slagle, oh hehe, ok.. undercloud support was pretty much all done by EmilienM, if he's ok with revert I'm fine. Or we could just fix the publicUrl to use https, EmilienM ? | 15:33 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/os-cloud-config: Allow customizing keystone endpoint ports https://review.openstack.org/299279 | 15:33 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/python-tripleoclient: Use values from endpoint map for service endpoints https://review.openstack.org/299475 | 15:33 |
jaosorior | bnemec, mcornea: These three CRs https://review.openstack.org/299473 https://review.openstack.org/299279 https://review.openstack.org/299475 will allow us to finally persist what's changed in the endpoint map to the keystone endpoints that are set up via os-cloud-config | 15:36 |
jaosorior | mcornea: So that will allow us to have the ports configurable. But it doesn't work with upgrades as os-cloud-config and the tripleoclient don't support that. | 15:36 |
jaosorior | bnemec: And that also fixes the issue where all the public endpoints where the same as the keystone public endpoint. | 15:37 |
tzumainn | slagle, hi! sorry for the delay - cloudforms doesn't use ceilometer alarms atm | 15:37 |
EmilienM | pradk: you want me to look 1322311 ? | 15:37 |
slagle | tzumainn: ok, thanks good to know | 15:38 |
*** yamahata has quit IRC | 15:38 | |
pradk | EmilienM, so the question is should we revert aodh on undercloud or not.. looks like we have two issues 1. is ssl 2. is ceilo alarms are installed as well | 15:39 |
*** bvandenh has joined #tripleo | 15:39 | |
openstackgerrit | Imre Farkas proposed openstack/tripleo-docs: Document ready-state configuration https://review.openstack.org/299481 | 15:39 |
pradk | EmilienM, wanted your input | 15:39 |
pradk | for liberty that si | 15:39 |
pradk | i think if we can quickly fix the ssl issue, i prefer we dont revert | 15:40 |
pradk | the ceilo alarm issue i published a patch already | 15:41 |
pradk | slagle, what do we use ceilometer for on undercloud? | 15:42 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/python-tripleoclient: Use values from endpoint map for service endpoints https://review.openstack.org/299475 | 15:42 |
shardy | Regardless of the revert, can we just disable the services on the undercloud and save some memory? | 15:42 |
shardy | pradk: I don't think we do atm | 15:42 |
*** dprince has quit IRC | 15:43 | |
mcornea | jaosorior: that's great. re the upgrades are you refering to 7->8 upgrades? | 15:43 |
*** dprince has joined #tripleo | 15:43 | |
pradk | shardy, ah ok, yea perhaps we should just disable ceilo on undercloud then will saves 2 extra services consuming memory | 15:44 |
jaosorior | mcornea: once os-cloud-config creates the endpoints. There is no support for updating them. Has to be done manually. | 15:45 |
jaosorior | mcornea: Which is why I hope we stop using os-cloud-config for that and get that into the puppet manifests. Because then that would be fixed. | 15:45 |
jaosorior | but that commit still hasn't merged | 15:45 |
openstackgerrit | Imre Farkas proposed openstack/tripleo-docs: Fix comment for current-tripleo repo https://review.openstack.org/291078 | 15:45 |
mcornea | jaosorior: ok, I understand what you mean. Fair enough | 15:46 |
jaosorior | mcornea: If that doesn't merge soon I guess I'll have to add support for updating those endpoints in os-cloud-config | 15:47 |
pradk | shardy, regardless i think we'll need this https://review.openstack.org/#/c/299462/ | 15:47 |
*** saneax is now known as saneax_AFK | 15:48 | |
*** rbrady has quit IRC | 15:49 | |
*** rbrady has joined #tripleo | 15:49 | |
*** rbrady has quit IRC | 15:52 | |
*** rbrady has joined #tripleo | 15:52 | |
*** aufi has quit IRC | 15:55 | |
*** cwolferh has joined #tripleo | 15:55 | |
trown | slagle: shardy, do we follow the milestone or intermediary release model? or neither? ie, are we bound by http://lists.openstack.org/pipermail/openstack-dev/2016-March/090877.html | 15:55 |
*** tosky has quit IRC | 15:55 | |
openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Raise instead of returning False when take_action fails https://review.openstack.org/299494 | 15:56 |
shardy | trown: I don't think we're tagged as subscribing to either, but I guess atm we're closest to the intermediary model | 15:58 |
*** tosky has joined #tripleo | 15:58 | |
shardy | only we never publish intermediate releases except for clients/liberies we depend on | 15:58 |
openstackgerrit | Jeff Peeler proposed openstack/python-tripleoclient: Add ability to push docker images to registry https://review.openstack.org/255535 | 15:59 |
*** yamahata has joined #tripleo | 16:00 | |
*** rajinir has joined #tripleo | 16:00 | |
*** penick has joined #tripleo | 16:02 | |
*** rdopiera has quit IRC | 16:03 | |
*** jaosorior has quit IRC | 16:06 | |
*** dtantsur|bbl is now known as dtantsur | 16:06 | |
gfidente | thrash https://review.openstack.org/#/c/299494/ | 16:06 |
*** penick has quit IRC | 16:07 | |
trown | shardy: the reason I ask is for https://review.openstack.org/#/c/299352 it came up on the RDO meeting that we planned to have mariadb10 in the mitaka release repo, so we may want/need to backport that | 16:08 |
thrash | gfidente: ack | 16:09 |
thrash | will take a look | 16:09 |
shardy | trown: ack - from the description it sounds like a justifiable bug backport | 16:09 |
*** penick has joined #tripleo | 16:09 | |
gfidente | thrash yeah thanks | 16:10 |
gfidente | but maybe this is indeed osc misbehaving | 16:10 |
*** jistr has quit IRC | 16:10 | |
*** mkovacik has joined #tripleo | 16:10 | |
gfidente | though presently echo $? is 0 in that case | 16:10 |
*** bvandenh has quit IRC | 16:11 | |
trown | shardy: cool, I was just checking if we are restricted by needing it merged and backported by tomorrow, which is pretty tight, or if we can create our GA release whenever we feel like it | 16:12 |
*** penick_ has joined #tripleo | 16:12 | |
*** penick has quit IRC | 16:14 | |
*** penick_ is now known as penick | 16:14 | |
*** jcoufal has quit IRC | 16:16 | |
*** qasims has joined #tripleo | 16:20 | |
*** openstack has joined #tripleo | 17:04 | |
rhallisey | dprince, I think this is what you're looking for: https://github.com/openstack/kolla/blob/master/ansible/group_vars/all.yml | 17:05 |
*** openstackstatus has joined #tripleo | 17:05 | |
*** ChanServ sets mode: +v openstackstatus | 17:05 | |
rhallisey | dprince, Also, I looked over your compose roles patches. Do you need any help writing them? I can take a service if you want | 17:07 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: [WIP] Allow 'baremetal import' command to also start introspection https://review.openstack.org/299388 | 17:07 |
dprince | rhallisey: sure, it'd be cool to have you jump in | 17:08 |
dprince | rhallisey: currently waiting on the next round of puppet-tripleo stuff though I think | 17:08 |
rhallisey | kk | 17:09 |
dprince | rhallisey: also, I think it would be nice to land the first couple of patches before too long so we know we have agreement | 17:09 |
*** jtomasek_ has joined #tripleo | 17:09 | |
dprince | rhallisey: trying to keep it organize here https://etherpad.openstack.org/p/tripleo-composable-services | 17:09 |
dprince | rhallisey: so anything you are working on or going to work on just list it there | 17:09 |
dprince | rhallisey: these sorts of patches are somewhat conflict sensitive so a patch series is probably best. But we can have some parallel efforts too I think | 17:10 |
rhallisey | dprince, I did have one question. Can these outputs be abstracted out to resource chain https://review.openstack.org/#/c/295588/9/puppet/services/keystone.yaml | 17:10 |
rhallisey | to decouple puppet | 17:10 |
rhallisey | or is that not desired/in the scope | 17:11 |
rhallisey | dprince, an patches I have will be on top of what you have now | 17:11 |
dprince | rhallisey: I tried to name things generically. config_settings and config_steps | 17:11 |
dprince | rhallisey: so that at the high level there is nothing puppet specific | 17:11 |
rhallisey | but the outputs from keystone.yaml -> keystone::admin_token | 17:12 |
rhallisey | those are heira right? | 17:12 |
dprince | rhallisey: so I think the answer to your question is yes. The services live in puppet/services though so those will have hiera settings as outputs | 17:12 |
dprince | rhallisey: the initial step is puppet | 17:12 |
dprince | rhallisey: how that fits w/ docker (and whether we can continue using puppet for docker configuration) is the next stepp I think | 17:13 |
rhallisey | I'm not saying we can't, I just want to be sure we try and decouple everything best we can | 17:13 |
dprince | rhallisey: right now, just splitting up the huge manifests is a huge help and will IMO help us land code faster | 17:13 |
dtantsur | trown|lunch, hi! please check if https://review.openstack.org/299362 might break you somehow. it works with the default ordering, but dunno about quickstart and RDO CI | 17:13 |
rhallisey | dprince, agreed | 17:14 |
*** dtantsur is now known as dtantsur|afk | 17:16 | |
*** TSCHAK has joined #tripleo | 17:17 | |
larsks | dprince: just back from lunch. I was recently trying to find something like "doxygen" for ansible playbooks, which I guess is a similar quest, and came up empty handed. I thought about writing my own thing, but haven't yet. | 17:17 |
dprince | larsks: yeah. I was reading Zane's essay and some of the replies to it and this came to mind | 17:18 |
dprince | larsks: specifically, we are trying to converge the UI and CLI depoyment cases. And Heat stack-validate does a really nice job of building up the parameters list as you add services to roles (this assumes we do composable services w/ heat) | 17:19 |
ibravo | I'm hitting some issues with the ramdisk on a baremetal (HP BL460c). What is the best way to troubleshoot? Looking at the virtual terminal screen is too fast to make any sense of it. | 17:19 |
larsks | dprince: The thing, heat's input has a structured way of representing per-parameter documentation, but ansible's parameter input is just key: value, and has no place for structured docs. | 17:20 |
larsks | dprince: So the only way to introduce that kind of documentation is to make up your own way of annotating things via comments. | 17:20 |
dprince | larsks: I was just wondering how anything like this would work w/ Ansible. Seems like the advanced cases are well covered with Ansible. Like say I know that I want to set 'config_drive=True' in nova.conf | 17:20 |
openstackgerrit | Merged openstack/tripleo-heat-templates: Set UpdateIdentifier for upgrade converge, to prevent services down https://review.openstack.org/298684 | 17:20 |
larsks | dprince: unless I am misunderstanding what you want. *I* want documentation for the variables that are available in, e.g., somerole/defaults/main.yml. | 17:21 |
dprince | larsks: but the opposite isn't true. Ansible would cause a lot of trouble for us here I think and drive the UI team crazy in keeping manual lists of this and that | 17:21 |
larsks | dprince: Yeah, totally. | 17:21 |
larsks | One option would be to maintain parameters using heat-like syntax with structured documentation, and then *generate* the corresponding YAML files for ansible from that. | 17:21 |
dprince | larsks: yep, we could build our own thing | 17:22 |
larsks | That might work for a specific project, but isn't necessary a great generic solution. | 17:22 |
larsks | So I guess I got nothin' :) But I agree that would be useful to have. We already have that problem in tripleo-quickstart, where there are various things that can be set scattered over several roles. I've tried to centralize much of the important stuff, but discovery is still hard. | 17:23 |
*** gfidente has quit IRC | 17:25 | |
*** bvandenh has quit IRC | 17:26 | |
*** electrofelix has quit IRC | 17:28 | |
*** rlandy has quit IRC | 17:28 | |
*** Goneri has quit IRC | 17:28 | |
*** rlandy has joined #tripleo | 17:29 | |
*** mcornea_ has quit IRC | 17:29 | |
*** trown|lunch is now known as trown | 17:30 | |
trown | dtantsur|afk: thanks, we follow the same flow as the docs, so should be fine | 17:30 |
*** ayoung has joined #tripleo | 17:30 | |
*** mgould has quit IRC | 17:31 | |
*** jtomasek_ has quit IRC | 17:31 | |
shardy | EmilienM: Hey I have a question about puppet support for policy.json changes | 17:33 |
shardy | I just tested, and it would appear we're not currently using it | 17:33 |
shardy | an alternative (possibly simpler) approach is do use the deploy artefacts interface we just discussed to deploy a directory of policy files to the nodes | 17:34 |
shardy | I just tested that, and it works, wondering if it's worth the effort of a docs patch, or if we should wait pending integration with the puppet policy stuff | 17:34 |
*** jpena is now known as jpena|off | 17:36 | |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 17:42 |
*** Goneri has joined #tripleo | 17:42 | |
EmilienM | shardy: the puppet implementation is (right now) pretty static to one policy.json file. | 17:42 |
openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again https://review.openstack.org/288915 | 17:42 |
EmilienM | we allow to add/modify policies in /etc/<...>/policy.son file | 17:42 |
EmilienM | we support all projects, keystone included. | 17:42 |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 17:42 |
*** dmacpher has joined #tripleo | 17:43 | |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 17:43 |
*** nico_auv has quit IRC | 17:44 | |
shardy | EmilienM: Ok, thanks - I'll give that approach a try too | 17:45 |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 17:45 |
openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Revert "Deploy Aodh services, replacing Ceilometer Alarm" https://review.openstack.org/299553 | 17:46 |
EmilienM | shardy: I can give you an example | 17:49 |
EmilienM | shardy: a sec | 17:49 |
EmilienM | shardy: http://paste.openstack.org/show/DY9v88LGF9jOwT92044X/ | 17:51 |
EmilienM | it's very simple | 17:51 |
*** Goneri has quit IRC | 17:52 | |
*** Goneri has joined #tripleo | 17:52 | |
*** rbrady_ has joined #tripleo | 17:53 | |
*** rbrady has quit IRC | 17:53 | |
*** dmacpher is now known as dmacpher-afk | 17:55 | |
openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud: Revert "Deploy Aodh services, replacing Ceilometer Alarm" https://review.openstack.org/299558 | 17:56 |
shardy | EmilienM: thanks, that's very helpful | 17:56 |
shardy | the key/value thing is weird | 17:56 |
EmilienM | yeah maybe I did it wrong | 17:57 |
EmilienM | let me check | 17:57 |
shardy | but I guess it's consistent with e.g the *::config::*_config interfaces | 17:57 |
shardy | https://github.com/openstack/puppet-heat/blob/master/manifests/policy.pp | 17:57 |
EmilienM | yeah | 17:57 |
shardy | that indicates a slightly different syntax | 17:57 |
* shardy tries | 17:57 | |
EmilienM | shardy: that is the code that actually manage the file: https://github.com/openstack/puppet-openstacklib/blob/master/manifests/policy/base.pp | 17:58 |
EmilienM | we are using augeas | 17:58 |
EmilienM | so we don't touch existing policies | 17:58 |
*** tiswanso has quit IRC | 18:00 | |
*** tiswanso has joined #tripleo | 18:01 | |
*** thrash|f00dz is now known as thrash | 18:01 | |
*** jayg is now known as jayg|g0n3 | 18:02 | |
*** ohamada has quit IRC | 18:04 | |
*** shivrao has joined #tripleo | 18:09 | |
*** rbrady_ has quit IRC | 18:10 | |
*** rbrady has joined #tripleo | 18:10 | |
shardy | EmilienM: So, that works, but it strips the json file of all formatting | 18:14 |
shardy | so it ends up pretty unreadable | 18:14 |
*** michchap has quit IRC | 18:14 | |
EmilienM | shardy: how that? | 18:14 |
EmilienM | it's weird, we used it in production with spinal stack before | 18:15 |
shardy | EmilienM: It probably works, it's just hard to read | 18:15 |
EmilienM | shardy: can you show me please? | 18:15 |
*** Marga__ has quit IRC | 18:17 | |
shardy | http://fpaste.org/347598/14593618/ | 18:17 |
shardy | EmilienM: It's just stripped all the linefeeds | 18:18 |
shardy | the context_is_admin change got applied tho :) | 18:18 |
EmilienM | shardy: ouchhh | 18:18 |
EmilienM | I agree it is ugly | 18:18 |
EmilienM | we can probably fix it, if you plan to use it in tripleo | 18:18 |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 18:19 |
*** Slower_ is now known as Slower | 18:19 | |
shardy | EmilienM: Is this wired to other parts of the implementation, e.g if I change the policy via heat::policy will heat-api get restarted? | 18:20 |
shardy | (modulo the pacemaker stuff of course) | 18:20 |
shardy | I'm trying to figure out the advantage of this, vs just a tarball via the deploy artefacts interface | 18:20 |
EmilienM | shardy: today: no. Nothing is currently wired on the service orchestration because of the way we deploy pacemaker | 18:21 |
EmilienM | shardy: have you seen my email from last night about the future of service orchestration with pacemaker? | 18:21 |
EmilienM | we are working on a service provider in puppet-pacemaker | 18:21 |
shardy | EmilienM: Yup, that sounds like excellent news | 18:22 |
EmilienM | shardy: https://github.com/openstack/puppet-heat/blob/master/manifests/policy.pp#L36-L38 | 18:22 |
shardy | EmilienM: FYI here's the environment I used: http://fpaste.org/347602/14593620/ | 18:22 |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 18:22 |
shardy | we can use controller_classes to include the class via hiera | 18:22 |
EmilienM | shardy: so in the future deployments, yes, policy.json changes will notify a restart of heat | 18:22 |
EmilienM | shardy: excellent! very light | 18:23 |
shardy | EmilienM: Ok, then I guess we should prefer this approach vs just dropping the files on the nodes | 18:23 |
EmilienM | yes | 18:23 |
EmilienM | and if the file is not beautiful, we can fix it. | 18:23 |
shardy | ayoung: ^^ that's an example of applying custom policy.json via puppet | 18:24 |
EmilienM | I think it's related to Augeas | 18:24 |
openstackgerrit | James Slagle proposed openstack/instack-undercloud: Revert "Deploy Aodh services, replacing Ceilometer Alarm" https://review.openstack.org/299558 | 18:24 |
shardy | EmilienM: ack, it's only a cosmetic thing but would be nice to fix for the sake of my eyes :D | 18:24 |
EmilienM | shardy: we'll work on it | 18:24 |
shardy | EmilienM: thanks! :) | 18:25 |
*** davidlenwell has quit IRC | 18:27 | |
EmilienM | shardy: it looks like a limitation of augeas. Maybe we'll have to write a ruby provider for that | 18:29 |
rook | shardy: do we need to re-check this patch? https://review.openstack.org/#/c/298919/ | 18:29 |
*** tiswanso has quit IRC | 18:34 | |
*** davidlenwell has joined #tripleo | 18:34 | |
*** ChanServ sets mode: +v davidlenwell | 18:34 | |
*** tiswanso has joined #tripleo | 18:34 | |
EmilienM | bnemec: you're a puppet master https://review.openstack.org/#/c/299576/1/manifests/inspector.pp :) | 18:35 |
bnemec | EmilienM: I'm excellent at hacky workarounds, at least. ;-) | 18:36 |
EmilienM | bnemec: did you try it? | 18:36 |
EmilienM | does it help you? | 18:36 |
bnemec | EmilienM: Yes, it allowed my undercloud install to complete again. | 18:36 |
*** akrivoka has quit IRC | 18:37 | |
EmilienM | bnemec: can you update spec/classes/ironic_inspector_spec.rb please ? :-) and I'll +2 right away | 18:37 |
pradk | can someone shed some light on what this error is http://logs.openstack.org/32/252032/34/check-tripleo/gate-tripleo-ci-f22-nonha/51fc5be/console.html#_2016-03-30_16_41_15_205 | 18:39 |
pradk | i only see this in nonha case, ha and upgrade jobs pass fine | 18:40 |
ayoung | shardy, reading up.... | 18:40 |
EmilienM | pradk: I saw that already | 18:41 |
EmilienM | gfidente fixed it | 18:41 |
EmilienM | let me find the patch | 18:41 |
pradk | EmilienM, oh yay! | 18:42 |
EmilienM | pradk: https://review.openstack.org/#/c/297222/ | 18:42 |
EmilienM | next ! | 18:42 |
*** Marga_ has joined #tripleo | 18:42 | |
pradk | EmilienM, oh its merged already.. hmm wonder why i still see it | 18:42 |
EmilienM | pradk: did you rebase + recheck? | 18:43 |
ayoung | EmilienM, file format is not bad | 18:43 |
ayoung | EmilienM, if someone wants to prettify it upon read, they can run it through python -m json or jq | 18:44 |
EmilienM | right, it's not a bug | 18:44 |
bnemec | EmilienM: Done, thanks for looking. | 18:44 |
EmilienM | bnemec: +2 | 18:44 |
pradk | EmilienM, hmm is that the right patch? the one you pasted looks like cinder related? | 18:45 |
*** shardy has quit IRC | 18:45 | |
EmilienM | pradk: yes, it's very complex to debug but I had the same issue at the time we landed a patch for ipv6 and gfidente found out this patch would help | 18:45 |
ayoung | EmilienM, so that sets the rule context_is_admin to be the same thing in all of the policy files? | 18:45 |
EmilienM | pradk: show me your patch that fails please | 18:45 |
EmilienM | ayoung: only for a component. | 18:46 |
pradk | EmilienM, https://review.openstack.org/#/c/252032/ as you see nonha only fails | 18:46 |
EmilienM | ayoung: http://fpaste.org/347602/14593620/ | 18:46 |
EmilienM | ayoung: only for heat... | 18:46 |
EmilienM | but you can do the same for neutron, keystone, etc | 18:46 |
ayoung | heat::policy::policies: got it | 18:46 |
EmilienM | yep | 18:46 |
EmilienM | pradk: looking | 18:46 |
ayoung | EmilienM, is there anyway you coud do that for all policy files at once? | 18:46 |
EmilienM | pradk: can I rebase it and check again? I had a similar issue today with puppet elements not picking the last commit. | 18:47 |
pradk | EmilienM, i thought trown said thats resolved | 18:47 |
pradk | EmilienM, rdo delorean was down so builds dint catch up | 18:48 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Gnocchi as a Ceilometer metrics storage backend https://review.openstack.org/252032 | 18:48 |
pradk | EmilienM, did a rebase lets see.. worth a try i guess | 18:48 |
EmilienM | pradk: ok, ping me if it happens again, maybe another bug. | 18:49 |
pradk | sure, thx EmilienM | 18:49 |
*** dustins has joined #tripleo | 18:50 | |
EmilienM | mburned: do you know when rhel8 is out? | 18:51 |
EmilienM | mburned: dmsimard found out that ruby was too recent in latest fedora to support puppet3.x | 18:51 |
EmilienM | and we have 2 options: downgrade ruby to 2.1.x or upgrade puppet to 4 in fedora | 18:51 |
dmsimard | EmilienM: note that this was entirely out of context of openstack, just trying to run puppet on a fedora box :) | 18:52 |
mburned | EmilienM: no date that i'm aware of | 18:53 |
EmilienM | ok | 18:53 |
EmilienM | anyway, we're pushing hard in Newton to support puppet4 | 18:53 |
*** qasims has joined #tripleo | 18:56 | |
*** tiswanso has quit IRC | 19:03 | |
openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Add Glance profiles https://review.openstack.org/296076 | 19:04 |
EmilienM | dprince: done ^ let me know feedback | 19:04 |
*** tiswanso has joined #tripleo | 19:04 | |
dprince | EmilienM: cool, I will look shortly | 19:05 |
EmilienM | dprince: not sure about my manifests/profile/pacemaker/glance.pp | 19:05 |
*** tiswanso_ has joined #tripleo | 19:07 | |
*** tiswanso has quit IRC | 19:08 | |
*** jtomasek_ has joined #tripleo | 19:14 | |
*** akshai has quit IRC | 19:19 | |
*** akshai has joined #tripleo | 19:20 | |
*** prometheanfire has left #tripleo | 19:21 | |
*** akshai has quit IRC | 19:24 | |
*** akshai has joined #tripleo | 19:30 | |
openstackgerrit | Dmitry Ilyin proposed openstack/puppet-pacemaker: [WIP] Merge with fuel-infra/puppet-pacemaker https://review.openstack.org/296440 | 19:46 |
*** mbound has joined #tripleo | 19:48 | |
*** lblanchard has quit IRC | 19:59 | |
*** jtomasek_ has quit IRC | 20:00 | |
*** pleia2 has quit IRC | 20:19 | |
*** pleia2 has joined #tripleo | 20:20 | |
bnemec | EmilienM: What's up with http://logs.openstack.org/76/299576/2/check/gate-puppet-ironic-puppet-beaker-rspec-devstack-centos7/945b69b/console.html ? | 20:23 |
bnemec | Isn't 2 a successful return value? | 20:24 |
EmilienM | bnemec: I bet it's RDO delorean instance | 20:24 |
EmilienM | bnemec: our CI is currently running (supposed at least) mitaka/current-passed-ci | 20:25 |
EmilienM | bnemec: I'm investigating. | 20:26 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use cached instack qcow image for all ci tests https://review.openstack.org/299537 | 20:26 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Pre install packages on the instack image https://review.openstack.org/299538 | 20:26 |
bnemec | EmilienM: Okay, thanks. | 20:26 |
EmilienM | something with ironic conductor, mhh | 20:28 |
EmilienM | http://logs.openstack.org/65/299065/1/check/gate-puppet-ironic-puppet-beaker-rspec-devstack-centos7/ad230b6/logs/ironic/ironic-conductor.txt.gz#_2016-03-30_19_55_20_301 | 20:28 |
EmilienM | it sounds like a bug in ironic conductor | 20:28 |
EmilienM | where ironic conductor kills the process if amqp is not recheable, instead of retrying later | 20:28 |
EmilienM | like do other projects | 20:28 |
EmilienM | I reported a bug like this last month, let me check | 20:29 |
EmilienM | bnemec: https://bugs.launchpad.net/aodh/+bug/1557154 | 20:29 |
openstack | Launchpad bug 1557154 in Aodh "aodh listener does not retry to connect to rpc if connection failure" [Medium,Triaged] - Assigned to Liusheng (liusheng) | 20:29 |
EmilienM | I found the same issue in Aodh | 20:29 |
EmilienM | pradk: ^ | 20:29 |
EmilienM | ironic is suffering of the same bug I guess | 20:29 |
EmilienM | bnemec: let me fix it | 20:30 |
EmilienM | in puppet | 20:30 |
EmilienM | and also report the bug in ironic | 20:30 |
bnemec | EmilienM: Cool, thanks | 20:30 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: ssh less https://review.openstack.org/295973 | 20:31 |
EmilienM | bnemec: you're not lucky | 20:33 |
EmilienM | bnemec: look timestamps on the bug report https://bugs.launchpad.net/ironic/+bug/1564075 | 20:33 |
openstack | Launchpad bug 1564075 in Ironic "ironic-conductor does not retry to connect to rpc if connection failure" [Undecided,New] | 20:33 |
EmilienM | by 5 seconds, it would work :-) | 20:33 |
bnemec | Yay race bugs! | 20:35 |
pradk | EmilienM, hmm rebase dint help same error https://jenkins04.openstack.org/job/gate-tripleo-ci-f22-nonha/1455/console "Error: Error from DataBinding 'hiera' while looking up 'tripleo::packages::enable_install':" | 20:35 |
pradk | weird it doesnt happen on ha or upgrade case | 20:35 |
EmilienM | pradk: weird :( | 20:36 |
EmilienM | bnemec: https://review.openstack.org/299616 | 20:36 |
EmilienM | bnemec: can you rebase on top of it? | 20:36 |
*** trown is now known as trown|outtypewww | 20:37 | |
*** ebalduf has joined #tripleo | 20:38 | |
bnemec | EmilienM: Sure | 20:38 |
EmilienM | bnemec: stop finding bugs also, please | 20:38 |
bnemec | EmilienM: I would like nothing better. :-) | 20:40 |
*** ebalduf has quit IRC | 20:48 | |
*** openstackgerrit has quit IRC | 20:48 | |
*** openstackgerrit has joined #tripleo | 20:48 | |
*** qasims has quit IRC | 20:49 | |
*** apetrich has quit IRC | 20:50 | |
bandini | lol | 20:53 |
*** MaxPC has quit IRC | 20:54 | |
openstackgerrit | Merged openstack/instack-undercloud: Add missing zaqar password and horizon key https://review.openstack.org/297353 | 21:01 |
openstackgerrit | Merged openstack/instack-undercloud: Enable Mistral by default. https://review.openstack.org/298330 | 21:01 |
*** chem has quit IRC | 21:03 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-specs: Add initial lightweight architecture spec https://review.openstack.org/299628 | 21:04 |
bandini | EmilienM: ^ | 21:05 |
EmilienM | bandini: excellent | 21:05 |
bandini | EmilienM: it's my first spec, so do shout if I missed out on something ;) | 21:06 |
*** julim has quit IRC | 21:08 | |
*** dprince has quit IRC | 21:09 | |
*** julim has joined #tripleo | 21:11 | |
*** florianf has joined #tripleo | 21:15 | |
slagle | http://trunk.rdoproject.org/ down again? | 21:16 |
slagle | let me rephrase | 21:17 |
slagle | http://trunk.rdoproject.org/ down again | 21:17 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Ports parameters to redux https://review.openstack.org/297180 | 21:19 |
EmilienM | lol | 21:20 |
EmilienM | slagle: I hope it will be up this week-end so we can work :-) | 21:20 |
slagle | yea, i know, exactly | 21:21 |
*** florianf1 has joined #tripleo | 21:23 | |
*** florianf has quit IRC | 21:23 | |
*** jprovazn has quit IRC | 21:25 | |
* bnemec bookmarks http://www.downforeveryoneorjustme.com/trunk.rdoproject.org | 21:28 | |
*** florianf1 has quit IRC | 21:29 | |
*** rhallisey has quit IRC | 21:31 | |
*** dustins has quit IRC | 21:43 | |
*** tiswanso_ has quit IRC | 21:46 | |
*** davidlenwell has quit IRC | 21:48 | |
*** davidlenwell has joined #tripleo | 21:55 | |
*** ChanServ sets mode: +v davidlenwell | 21:55 | |
*** ccamacho has quit IRC | 21:56 | |
*** egafford has quit IRC | 21:58 | |
*** weshay has quit IRC | 21:59 | |
*** ccamacho has joined #tripleo | 22:03 | |
*** pradk has quit IRC | 22:07 | |
*** TSCHAK has quit IRC | 22:08 | |
dsneddon | bnemec, Regarding https://review.openstack.org/#/c/283209/ I had partially decided to modify the original bond templates instead of create new ones because you had brought up the difficulty of maintaining too many separate sets of templates. ;-) | 22:13 |
dsneddon | bnemec, But if you think that having separate bond templates would be better, I'm game for that. | 22:14 |
dsneddon | bnemec, I don't think it will break existing deployments, because the network config doesn't run by default on updates, but I could imagine it causing confusion. | 22:14 |
openstackgerrit | Dan Prince proposed openstack/tripleo-common: Expose documented --second option https://review.openstack.org/299642 | 22:18 |
openstackgerrit | Dan Prince proposed openstack/tripleo-common: Add upload-puppet-modules script https://review.openstack.org/299643 | 22:18 |
*** mbound has quit IRC | 22:28 | |
*** sshnaidm has quit IRC | 22:30 | |
*** r-mibu has quit IRC | 22:31 | |
*** r-mibu has joined #tripleo | 22:31 | |
*** cwolferh has quit IRC | 22:33 | |
*** rhallisey has joined #tripleo | 22:35 | |
*** sshnaidm has joined #tripleo | 22:36 | |
*** akshai has quit IRC | 22:44 | |
bnemec | dsneddon: Would it cause issues on scale up if the new nodes get a different type of bond? | 22:47 |
dsneddon | bnemec, I see what you mean. It wouldn't cause issues per se, but I wouldn't want half my cloud running with a different configuration than the first ones. So if you upgrade first then scale up without paying attention, you could end up with that. | 22:47 |
*** dsneddon has quit IRC | 22:51 | |
bnemec | dsneddon: Yeah, I don't even know how much of a problem it is because I don't know if anyone is actually using our templates verbatim like that, but it makes me nervous because even if we doc it as a gotcha for upgrades, my experience is that no one reads upgrade docs. :-/ | 22:51 |
*** dsneddon has joined #tripleo | 22:52 | |
*** morazi has quit IRC | 23:02 | |
*** saneax_AFK is now known as saneax | 23:09 | |
openstackgerrit | Rhys Oxenham proposed openstack/tripleo-heat-templates: Updates ControlPlaneSubnetCidr to be a string https://review.openstack.org/299664 | 23:16 |
*** ebalduf has joined #tripleo | 23:25 | |
*** social has quit IRC | 23:51 | |
*** social has joined #tripleo | 23:52 | |
openstackgerrit | Merged openstack/tripleo-heat-templates: compute: restart OVS agent on neutron.conf changes https://review.openstack.org/299303 | 23:53 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!