| *** sanagikoki has quit IRC | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:11 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 00:11 |
| *** ooolpbot has quit IRC | 00:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 00:11 |
| *** dmacpher_ has quit IRC | 00:16 | |
| jaosorior | bnemec: still around? | 00:29 |
| openstackgerrit | Merged openstack/diskimage-builder master: Unify tidy up logs in lib/img-functions https://review.openstack.org/420318 | 00:29 |
| *** bkopilov_ has quit IRC | 00:33 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Switch item notation to jinja format https://review.openstack.org/428293 | 00:38 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Revert "set innodb_file_per_table to ON for MySQL / Galera" https://review.openstack.org/428435 | 00:38 |
| *** rbrady-afk has quit IRC | 00:42 | |
| *** jaosorior has quit IRC | 00:46 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-heat-templates master: Containerized Swift Services. https://review.openstack.org/425434 | 00:58 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Fix style nits in contrail manifests https://review.openstack.org/427890 | 00:58 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Delete the unnecessary word in numvfs_persistence.pp https://review.openstack.org/423918 | 01:00 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Call VF configuration from udev rules https://review.openstack.org/423312 | 01:00 |
| openstackgerrit | Merged openstack/puppet-tripleo master: add cache to object-expirer pipeline https://review.openstack.org/421006 | 01:01 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs https://review.openstack.org/428476 | 01:02 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add initial profiles for rest of Octavia services https://review.openstack.org/411422 | 01:02 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Use transport_url for rabbitmq connection parameters in heat https://review.openstack.org/410333 | 01:03 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs https://review.openstack.org/428476 | 01:04 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 01:05 |
| *** ooolpbot has joined #tripleo | 01:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 01:11 |
| *** ooolpbot has quit IRC | 01:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 01:11 |
| *** skramaja_ has joined #tripleo | 01:16 | |
| *** skramaja has quit IRC | 01:19 | |
| *** ansmith has joined #tripleo | 01:20 | |
| dtrainor | can i get some reviews on https://review.openstack.org/#/c/424909/ and https://review.openstack.org/#/c/424903 please | 01:21 |
| openstackgerrit | yunfeng zhou proposed openstack/instack master: Add 6 spaces before url. https://review.openstack.org/412696 | 01:21 |
| openstackgerrit | yunfeng zhou proposed openstack/instack master: Add 6 spaces before url. https://review.openstack.org/412696 | 01:22 |
| *** twiggy has quit IRC | 01:23 | |
| *** owalsh has joined #tripleo | 01:28 | |
| *** sdake has joined #tripleo | 01:28 | |
| *** owalsh-afk has quit IRC | 01:28 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add quickstart release files for ocata https://review.openstack.org/428362 | 01:28 |
| *** dmacpher has joined #tripleo | 01:34 | |
| *** kberger has quit IRC | 01:44 | |
| *** tbonds has quit IRC | 01:44 | |
| *** rbrady-afk has joined #tripleo | 01:54 | |
| *** twiggy_ has joined #tripleo | 01:54 | |
| *** ansmith has quit IRC | 02:09 | |
| *** ooolpbot has joined #tripleo | 02:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 02:11 |
| *** ooolpbot has quit IRC | 02:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 02:11 |
| *** rajinir has quit IRC | 02:26 | |
| *** skramaja_ has quit IRC | 02:28 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker memcached service https://review.openstack.org/428546 | 02:35 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Enable docker services in the registry https://review.openstack.org/421567 | 02:36 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker heat services https://review.openstack.org/417639 | 02:42 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker ironic services https://review.openstack.org/421517 | 02:43 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker neutron services https://review.openstack.org/422999 | 02:44 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker mistral services https://review.openstack.org/425744 | 02:44 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker zaqar service https://review.openstack.org/425976 | 02:45 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker nova services https://review.openstack.org/420921 | 02:46 |
| *** mburned_out is now known as mburned | 02:46 | |
| *** kbyrne has quit IRC | 02:47 | |
| *** brault has quit IRC | 02:49 | |
| *** kbyrne has joined #tripleo | 02:50 | |
| *** pmannidi has quit IRC | 02:57 | |
| *** pmannidi has joined #tripleo | 02:58 | |
| *** brault has joined #tripleo | 03:00 | |
| *** yamahata has quit IRC | 03:02 | |
| *** ramishra has joined #tripleo | 03:09 | |
| *** ooolpbot has joined #tripleo | 03:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 03:11 |
| *** ooolpbot has quit IRC | 03:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 03:11 |
| *** mrunge has quit IRC | 03:12 | |
| *** mrunge has joined #tripleo | 03:17 | |
| *** owalsh has quit IRC | 03:33 | |
| *** owalsh_ has joined #tripleo | 03:33 | |
| *** sdake has quit IRC | 03:41 | |
| *** owalsh_ is now known as owalsh-afk | 04:01 | |
| *** psahoo has joined #tripleo | 04:03 | |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: OVN bridge mappings for tripleo https://review.openstack.org/402293 | 04:07 |
| *** sdake has joined #tripleo | 04:08 | |
| *** ooolpbot has joined #tripleo | 04:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 04:11 |
| *** ooolpbot has quit IRC | 04:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 04:11 |
| *** sdake_ has joined #tripleo | 04:11 | |
| *** tzumainn has quit IRC | 04:11 | |
| *** nmathew has joined #tripleo | 04:12 | |
| *** sdake has quit IRC | 04:12 | |
| *** udesale has joined #tripleo | 04:13 | |
| *** remix_tj has quit IRC | 04:14 | |
| *** jaganathan has joined #tripleo | 04:15 | |
| *** remix_tj has joined #tripleo | 04:17 | |
| *** gkadam has joined #tripleo | 04:26 | |
| *** yamahata has joined #tripleo | 04:43 | |
| *** sudipto has joined #tripleo | 04:58 | |
| *** sudipto_ has joined #tripleo | 04:59 | |
| *** psahoo_ has joined #tripleo | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 05:11 |
| *** ooolpbot has quit IRC | 05:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 05:11 |
| *** pgadiya has joined #tripleo | 05:11 | |
| *** sudipto_ has quit IRC | 05:13 | |
| *** sudipto has quit IRC | 05:13 | |
| *** prateek has joined #tripleo | 05:25 | |
| *** skramaja has joined #tripleo | 05:30 | |
| *** anshul has quit IRC | 05:31 | |
| *** psahoo_ has quit IRC | 05:36 | |
| *** yamahata has quit IRC | 05:43 | |
| *** rlandy has quit IRC | 05:49 | |
| *** zoli|pto has quit IRC | 06:03 | |
| *** cschwede has quit IRC | 06:03 | |
| *** cschwede has joined #tripleo | 06:05 | |
| *** zoli has joined #tripleo | 06:08 | |
| *** ooolpbot has joined #tripleo | 06:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 06:11 |
| *** ooolpbot has quit IRC | 06:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 06:11 |
| *** saneax-_-|AFK is now known as saneax | 06:18 | |
| *** dmacpher has quit IRC | 06:32 | |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui master: Add release notes for Ocata 3.0.0 https://review.openstack.org/425979 | 06:37 |
| *** jbadiapa has quit IRC | 06:43 | |
| *** sdake_ has quit IRC | 06:52 | |
| *** jbadiapa has joined #tripleo | 06:55 | |
| openstackgerrit | gecong proposed openstack/tripleo-incubator master: Delete H803 from ignore list https://review.openstack.org/428601 | 06:55 |
| openstackgerrit | gecong proposed openstack/os-apply-config master: Delete H803 from ignore list https://review.openstack.org/428603 | 07:01 |
| *** ebarrera has joined #tripleo | 07:05 | |
| openstackgerrit | gecong proposed openstack/os-cloud-config master: Delete H803 from ignore list https://review.openstack.org/428605 | 07:07 |
| *** brault has quit IRC | 07:08 | |
| *** ooolpbot has joined #tripleo | 07:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 07:11 |
| *** ooolpbot has quit IRC | 07:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 07:11 |
| *** rasca has joined #tripleo | 07:14 | |
| *** brault has joined #tripleo | 07:15 | |
| *** ealcaniz has joined #tripleo | 07:18 | |
| *** tesseract has joined #tripleo | 07:20 | |
| *** twiggy has joined #tripleo | 07:21 | |
| *** twiggy_ has quit IRC | 07:21 | |
| *** tremble has joined #tripleo | 07:21 | |
| *** tremble has joined #tripleo | 07:21 | |
| *** twiggy_ has joined #tripleo | 07:22 | |
| *** twiggy has quit IRC | 07:22 | |
| *** iranzo has joined #tripleo | 07:23 | |
| *** dsariel has joined #tripleo | 07:23 | |
| openstackgerrit | gecong proposed openstack/os-refresh-config master: Delete H803 from ignore list https://review.openstack.org/428609 | 07:24 |
| *** twiggy has joined #tripleo | 07:24 | |
| *** flepied has quit IRC | 07:24 | |
| *** rcernin has joined #tripleo | 07:26 | |
| *** twiggy_ has quit IRC | 07:27 | |
| *** florianf has joined #tripleo | 07:27 | |
| *** athomas has joined #tripleo | 07:28 | |
| *** aufi has joined #tripleo | 07:32 | |
| *** aufi has quit IRC | 07:32 | |
| *** aufi has joined #tripleo | 07:34 | |
| *** nyechiel has joined #tripleo | 07:41 | |
| openstackgerrit | gecong proposed openstack/os-collect-config master: Delete H803 from ignore list https://review.openstack.org/428618 | 07:43 |
| openstackgerrit | gecong proposed openstack/tripleo-puppet-elements master: Delete H803 from ignore list https://review.openstack.org/428619 | 07:47 |
| *** nyechiel has quit IRC | 07:47 | |
| *** yprokule has joined #tripleo | 07:49 | |
| openstackgerrit | gecong proposed openstack/tripleo-image-elements master: Delete H803 from ignore list https://review.openstack.org/428622 | 07:51 |
| *** hjensas has quit IRC | 07:54 | |
| *** psahoo has quit IRC | 07:57 | |
| *** panda|zZ is now known as panda | 07:57 | |
| *** cylopez has joined #tripleo | 07:57 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Fix initialization of novaclient https://review.openstack.org/428105 | 08:04 |
| *** flepied has joined #tripleo | 08:05 | |
| *** ooolpbot has joined #tripleo | 08:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 08:11 |
| *** ooolpbot has quit IRC | 08:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 08:11 |
| *** flepied has quit IRC | 08:11 | |
| *** jlinkes has joined #tripleo | 08:14 | |
| *** twiggy has quit IRC | 08:21 | |
| *** twiggy has joined #tripleo | 08:22 | |
| *** amoralej|off is now known as amoralej | 08:26 | |
| *** hjensas has joined #tripleo | 08:29 | |
| *** hjensas has quit IRC | 08:29 | |
| *** hjensas has joined #tripleo | 08:29 | |
| *** jpich has joined #tripleo | 08:32 | |
| *** hjensas has quit IRC | 08:36 | |
| *** flepied has joined #tripleo | 08:36 | |
| *** jaganathan has quit IRC | 08:38 | |
| *** cylopez has quit IRC | 08:44 | |
| *** sudipto has joined #tripleo | 08:48 | |
| *** sudipto_ has joined #tripleo | 08:48 | |
| *** paramite has joined #tripleo | 08:51 | |
| *** cylopez has joined #tripleo | 08:53 | |
| *** fzdarsky has joined #tripleo | 08:53 | |
| *** shardy has joined #tripleo | 08:54 | |
| *** jaganathan has joined #tripleo | 08:55 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** zzzeek has joined #tripleo | 09:00 | |
| *** pgadiya has quit IRC | 09:02 | |
| *** hjensas has joined #tripleo | 09:03 | |
| *** hjensas has quit IRC | 09:03 | |
| *** hjensas has joined #tripleo | 09:03 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled https://review.openstack.org/419886 | 09:06 |
| *** ooolpbot has joined #tripleo | 09:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 09:11 |
| *** ooolpbot has quit IRC | 09:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 09:11 |
| *** suuuper has joined #tripleo | 09:11 | |
| *** derekh has joined #tripleo | 09:13 | |
| *** anshul has joined #tripleo | 09:15 | |
| *** pgadiya has joined #tripleo | 09:17 | |
| shardy | marios: Hey, 'morning! | 09:17 |
| shardy | marios: ^^ looks good, I can give it a try if you're busy again today | 09:18 |
| shardy | marios: I had an idea to run the ansible tasks via a similar script, so I may write a follow-up patch based on yours that does that for discussion | 09:18 |
| shardy | then we can over time migrate the shell script logic into the service template tasks | 09:19 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Moving the validation for using the template alias version for all templates https://review.openstack.org/428062 | 09:20 |
| *** yprokule has quit IRC | 09:22 | |
| *** flepied has quit IRC | 09:23 | |
| *** dtantsur|afk is now known as dtantsur | 09:23 | |
| jpich | https://review.openstack.org/#/c/428146/ looks like it will fix the tripleoclient gate failures, if someone familiar with tripleo-image-elements would like to take a peek and comment | 09:23 |
| marios | shardy: unfortunately am on this call again and probably going to be for all of today :( | 09:26 |
| marios | shardy: not sure how much time i'll get to work on that today | 09:26 |
| *** karimb has joined #tripleo | 09:27 | |
| shardy | marios: Ok no worries, I'll test it and push the follow-up ansible patch I mentioned | 09:28 |
| *** udesale__ has joined #tripleo | 09:28 | |
| shardy | marios: I'm not in next week but you can pick up the ansible patch if you feel it's useful | 09:28 |
| *** udesale has quit IRC | 09:30 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: Added further security functionality in release notes. https://review.openstack.org/428666 | 09:31 |
| lhinds | shardy / marios: I guess that won't need an FFE ^ ? | 09:32 |
| lhinds | its not code, just some additional release note info. | 09:32 |
| shardy | lhinds: no anything release notes related is fine | 09:32 |
| lhinds | thanks shardy | 09:32 |
| *** athomas has quit IRC | 09:34 | |
| matbu | shardy: marios i'm also the 3 reviews pacemaker nova and yours (marions) | 09:36 |
| matbu | marios: shardy do you think it would be possible to try to merge the nova review today (or maybe pacemaker but probably needs an update in the CI) | 09:37 |
| matbu | (s/marions/marios/ sorry :)) | 09:37 |
| *** lucas-afk is now known as lucasagomes | 09:38 | |
| *** chlong has quit IRC | 09:38 | |
| marios | shardy: thanks matbu will try and help with reviews later still on this call for now | 09:39 |
| shardy | matbu: well I'd be happy to see the nova patch land, it needs rebasing | 09:39 |
| shardy | matbu: ah, I see you just did it :) | 09:39 |
| shardy | matbu: oh, the recheck won't work - it needs rebasing, I'll do it now | 09:40 |
| marios | matbu: but yes the pacemaker one needed some update then we should land them | 09:40 |
| matbu | shardy: ack, yes i just recheck the CI :) | 09:40 |
| shardy | matbu: it won't work, it'd based on a broken version of https://review.openstack.org/#/c/424905/ I think? | 09:40 |
| matbu | marios: k i'll make a review in tripleo-ci | 09:40 |
| * shardy rebases | 09:40 | |
| matbu | marios: hm your review looks broken | 09:41 |
| *** salmankhan has joined #tripleo | 09:42 | |
| matbu | maybe we should add a jinja lint or something that gate that | 09:42 |
| b00tcat | hi, let's assume that I needed a step 6 in my tripleo deployment, would that be possible without altering the tripleo codebase? | 09:42 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades https://review.openstack.org/405241 | 09:42 |
| marios | matbu: damn yeah i was meant to test it yesterday .... | 09:42 |
| marios | matbu: thanks for looking anyway will try and get to it later | 09:43 |
| shardy | So we now have two patches rebased on https://review.openstack.org/#/c/424905/ (the nova one and marios's patch to deliver upgrade scripts) | 09:43 |
| marios | matbu: but which one you mean? the ini scripts one right https://review.openstack.org/#/c/419886/ | 09:43 |
| shardy | it's passing CI so can I get reviews on that, then we won't block those two patches? | 09:43 |
| matbu | marios: hm not sure | 09:44 |
| matbu | shardy: yep, i add a timeout for nova db sync yesterday | 09:44 |
| shardy | b00tcat: currently no, but we could consider making it configurable via a jinja variable | 09:44 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/post.j2.yaml#L59 | 09:44 |
| matbu | like Michael was mentionned it | 09:44 |
| *** udesale__ has quit IRC | 09:46 | |
| *** udesale has joined #tripleo | 09:46 | |
| *** udesale has quit IRC | 09:46 | |
| b00tcat | shardy: ok thanks! | 09:47 |
| shardy | b00tcat: actually, there is a way, but it would involve overriding the rendered puppet/post.yaml with a file containing the extra steps | 09:47 |
| shardy | which I was assuming you wouldn't want to do | 09:47 |
| shardy | probably adding some j2 variables to control both deploy and upgrade steps would be a good idea | 09:48 |
| b00tcat | shardy: your assumption is right, I'll try to workaround it for now :D | 09:48 |
| shardy | we just don't have anywhere to input them right now | 09:48 |
| *** udesale has joined #tripleo | 09:52 | |
| *** hjensas has quit IRC | 09:57 | |
| *** gfidente has joined #tripleo | 09:58 | |
| *** gfidente has quit IRC | 09:58 | |
| *** gfidente has joined #tripleo | 09:58 | |
| *** akrivoka has joined #tripleo | 09:59 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Fix descriptions on bonding templates https://review.openstack.org/428672 | 10:00 |
| *** bogdando has joined #tripleo | 10:01 | |
| karimb | hello folks, what can cause overcloud deployment to hang when scheduling nodes deployment? | 10:01 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Fix descriptions on bonding templates https://review.openstack.org/428672 | 10:01 |
| karimb | my nodes were properly introspected and assigned profiles. i launch stack and dont get no valid hosts, but my nodes still dont start booting..... | 10:02 |
| gfidente | karimb possibly ironic failing to powerup/boot the nodes? | 10:02 |
| karimb | gfidente introspection worked well so this part does work | 10:02 |
| gfidente | probably the flavor doesn't match the node's specs then? | 10:03 |
| karimb | gfidente it rather feels like the message to boot those nodes dont reach ( i guess nova-compute) | 10:03 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Add monitoring and logging agents deployment to CI https://review.openstack.org/410210 | 10:03 |
| karimb | gfidente if it was the flavor, i would get a no valid hosts found | 10:03 |
| karimb | and the nodes wouldnt appear as scheduling i d say | 10:03 |
| gfidente | oh you mean they are in scheduling state in nova? | 10:04 |
| gfidente | then maybe you have something in the nova conductor logs? | 10:05 |
| *** ooolpbot has joined #tripleo | 10:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 10:11 |
| *** ooolpbot has quit IRC | 10:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 10:11 |
| *** jaganathan has quit IRC | 10:17 | |
| *** twiggy_ has joined #tripleo | 10:21 | |
| *** twiggy__ has joined #tripleo | 10:24 | |
| *** twiggy_ has quit IRC | 10:24 | |
| *** twiggy has quit IRC | 10:24 | |
| *** yprokule has joined #tripleo | 10:24 | |
| *** twiggy has joined #tripleo | 10:24 | |
| *** mcornea has joined #tripleo | 10:25 | |
| *** twiggy__ has quit IRC | 10:28 | |
| *** bogdando has quit IRC | 10:28 | |
| *** udesale__ has joined #tripleo | 10:30 | |
| *** jaganathan has joined #tripleo | 10:32 | |
| *** flepied has joined #tripleo | 10:33 | |
| *** udesale__ has quit IRC | 10:33 | |
| *** udesale has quit IRC | 10:33 | |
| *** owalsh-afk is now known as owalsh | 10:35 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Fix initialization of novaclient https://review.openstack.org/428105 | 10:39 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Explicitly configure credentials used by ironic to access other services https://review.openstack.org/428680 | 10:41 |
| openstackgerrit | Saravanan KR proposed openstack/puppet-tripleo master: Add support to changing the Rabbitmq password on update https://review.openstack.org/402061 | 10:46 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Fix and improve 'flake8' test. https://review.openstack.org/428689 | 10:50 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Explicitly configure credentials used by ironic to access other services https://review.openstack.org/428680 | 10:51 |
| dtantsur | folks, could you check https://review.openstack.org/428052 please? ironic overcloud support can get broken at any moment, if we don't merge it (or something) | 10:54 |
| *** dtantsur is now known as dtantsur|bbl | 10:55 | |
| *** jaganathan has quit IRC | 10:59 | |
| shardy | dtantsur|bbl: Thanks for the fix, but I think it needs to move to ServiceNetMap like all the other service->network mappings? | 11:02 |
| shardy | I can push the adjustment if you agree | 11:03 |
| *** salmankhan has quit IRC | 11:03 | |
| dtantsur|bbl | shardy, do you realize that this is an **overcloud** network? | 11:04 |
| *** salmankhan has joined #tripleo | 11:05 | |
| dtantsur|bbl | I thought we only put undercloud networks to ServiceNetMap... | 11:05 |
| dtantsur|bbl | and do not touch overcloud objects at all (otherwise the code would be quite different) | 11:05 |
| shardy | dtantsur|bbl: well did you realize that network names like "external" will get replaced with the bind IP of that network on overcloud nodes? | 11:05 |
| shardy | dtantsur|bbl: the ServiceNetMap defines the networks for overcloud services | 11:06 |
| dtantsur|bbl | like, for all fields? Oo | 11:06 |
| shardy | dtantsur|bbl: yeah for every key in config_settings | 11:06 |
| dtantsur|bbl | so if I happen to have a value called "external" somewhere, it will get replaced? | 11:06 |
| shardy | so you'll get the bind IP for the external nic | 11:06 |
| shardy | dtantsur|bbl: right now, yes, because we had a chicken/egg problem with the service templates | 11:07 |
| shardy | many services need a bind_ip, but you don't know it when the service templates are instantiated | 11:07 |
| dtantsur|bbl | ugh, this is super ugly | 11:07 |
| shardy | so we use the network names e.g "internal_api" as a placeholder (read from the ServiceNetMap) | 11:07 |
| dtantsur|bbl | do we have a way to force this behavior to not happen? like some dummy string operation? | 11:08 |
| shardy | dtantsur|bbl: it does exact matching so " external" would probably defeat the replacement | 11:08 |
| shardy | I agree it's ugly but it's the only solution we could find at the time | 11:08 |
| *** yolanda has quit IRC | 11:08 | |
| dtantsur|bbl | ok, thanks for catching this.. I'll fix when I come back. | 11:09 |
| *** salmankhan has quit IRC | 11:09 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller-role.yaml#L477 | 11:10 |
| * dtantsur|bbl wishes we actually created a default network in the overcloud neutron, then he could just use it | 11:10 | |
| *** yolanda has joined #tripleo | 11:10 | |
| shardy | dtantsur|bbl: thanks ^^ is where that happens, perhaps we could implement a blacklist/whitelist or something | 11:10 |
| shardy | I'll think about how that might work | 11:10 |
| dtantsur|bbl | thanks! | 11:10 |
| * dtantsur|bbl disappears again | 11:11 | |
| *** ooolpbot has joined #tripleo | 11:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 11:11 |
| *** ooolpbot has quit IRC | 11:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 11:11 |
| *** jaganathan has joined #tripleo | 11:11 | |
| gfidente | dtantsur|bbl sorry but when you say an overcloud network, you mean a network provisioned on the nodes where ironic is running, or a network provisioned in the overcloud neutron? | 11:15 |
| *** anshul has quit IRC | 11:15 | |
| *** sdake has joined #tripleo | 11:18 | |
| *** panda is now known as panda|brb | 11:19 | |
| *** athomas has joined #tripleo | 11:21 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Fix and improve 'flake8' test. https://review.openstack.org/428689 | 11:21 |
| *** thrash|g0ne is now known as thrash | 11:22 | |
| *** ansmith has joined #tripleo | 11:23 | |
| *** jaganathan has quit IRC | 11:23 | |
| *** twiggy_ has joined #tripleo | 11:24 | |
| *** twiggy has quit IRC | 11:24 | |
| *** flepied has quit IRC | 11:25 | |
| *** jprovazn has joined #tripleo | 11:25 | |
| *** twiggy has joined #tripleo | 11:25 | |
| *** twiggy__ has joined #tripleo | 11:27 | |
| *** anshul has joined #tripleo | 11:28 | |
| *** twiggy_ has quit IRC | 11:28 | |
| *** twiggy has quit IRC | 11:30 | |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-quickstart-extras master: WIP Remove tags and use vars everywhere https://review.openstack.org/427243 | 11:30 |
| *** cdearborn has joined #tripleo | 11:33 | |
| *** jaganathan has joined #tripleo | 11:36 | |
| *** salmankhan has joined #tripleo | 11:37 | |
| *** jkilpatr has quit IRC | 11:38 | |
| *** panda|brb is now known as panda | 11:40 | |
| *** sdake_ has joined #tripleo | 11:42 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add batch upgrade configs to output & clarify disabled configs https://review.openstack.org/428349 | 11:44 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Disable batch upgrade deployments for disabled roles https://review.openstack.org/428348 | 11:44 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Disable puppet on upgrade for roles not upgrading https://review.openstack.org/424905 | 11:44 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Simplify/fix config enabled conditions for upgrades https://review.openstack.org/428309 | 11:44 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Reduce number of steps for upgrades https://review.openstack.org/428310 | 11:44 |
| *** adarazs is now known as adarazs_lunch | 11:45 | |
| *** salmankhan has quit IRC | 11:45 | |
| *** salmankhan has joined #tripleo | 11:46 | |
| d0ugal | so many FFE emails | 11:46 |
| *** sdake has quit IRC | 11:46 | |
| *** salmankhan1 has joined #tripleo | 11:47 | |
| *** salmankhan has quit IRC | 11:50 | |
| *** salmankhan1 is now known as salmankhan | 11:50 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add batch upgrade configs to output & clarify disabled configs https://review.openstack.org/428349 | 11:50 |
| *** ansmith has quit IRC | 11:51 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration. https://review.openstack.org/428093 | 11:52 |
| *** pmannidi has quit IRC | 11:54 | |
| *** jkilpatr has joined #tripleo | 11:57 | |
| *** lucasagomes is now known as lucas-hungry | 11:57 | |
| *** salmankhan has quit IRC | 12:00 | |
| *** salmankhan has joined #tripleo | 12:03 | |
| *** pkovar has joined #tripleo | 12:03 | |
| b00tcat | is it possible to deploy overclouds with centos 7.3? | 12:03 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add batch upgrade configs to output & clarify disabled configs https://review.openstack.org/428349 | 12:03 |
| *** jkilpatr has quit IRC | 12:04 | |
| shardy | b00tcat: yes, all of the upstream CI jobs are running centos 7.3, I'm deploying on 7.3.1611 locally | 12:06 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix and improve flake8 test. https://review.openstack.org/428710 | 12:06 |
| b00tcat | shardy: ah ok, I was being hit by https://bugs.launchpad.net/nova/+bug/1649527 | 12:06 |
| openstack | Launchpad bug 1649527 in OpenStack Compute (nova) newton "nova creates an invalid ethernet/bridge interface definition in virsh xml" [Medium,Fix committed] - Assigned to Roman Podoliaka (rpodolyaka) | 12:06 |
| *** salmankhan1 has joined #tripleo | 12:07 | |
| *** sudipto has quit IRC | 12:07 | |
| *** sudipto_ has quit IRC | 12:07 | |
| openstackgerrit | Ricardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service https://review.openstack.org/428089 | 12:08 |
| *** salmankhan has quit IRC | 12:09 | |
| *** salmankhan1 is now known as salmankhan | 12:09 | |
| *** rhallisey has joined #tripleo | 12:10 | |
| *** ooolpbot has joined #tripleo | 12:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 12:11 |
| *** ooolpbot has quit IRC | 12:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 12:11 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Remove openstack-ceilometer-expirer check https://review.openstack.org/428711 | 12:12 |
| *** dougbtv has quit IRC | 12:15 | |
| *** jkilpatr has joined #tripleo | 12:17 | |
| *** dougbtv has joined #tripleo | 12:19 | |
| *** pgadiya has quit IRC | 12:20 | |
| *** michapma_alt has quit IRC | 12:21 | |
| *** dougbtv_ has joined #tripleo | 12:24 | |
| *** morazi has quit IRC | 12:26 | |
| *** panda is now known as panda|lch | 12:26 | |
| *** dougbtv has quit IRC | 12:27 | |
| *** jaganathan has quit IRC | 12:27 | |
| *** sdake has joined #tripleo | 12:27 | |
| *** sdake_ has quit IRC | 12:30 | |
| *** rcernin has quit IRC | 12:31 | |
| EmilienM | bonjour | 12:39 |
| *** skramaja has quit IRC | 12:43 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: implement a collectd composable service https://review.openstack.org/411048 | 12:44 |
| EmilienM | panda|lch: fyi, we've got a promotion mainly because we reverted again nova and pin it to ocata-3 | 12:44 |
| EmilienM | panda|lch: oh I saw your comment on Trello, so I guess you know that, my bad :) | 12:45 |
| EmilienM | can someone review this patch to enable debug everywhere in our OVB CI? https://review.openstack.org/#/c/428476/ | 12:46 |
| d0ugal | jtomasek: "I am quite convinced that there have been good reasons to not to do this and use Mistral environment." | 12:46 |
| d0ugal | jtomasek: I am not convinced. What are the reasons? :) | 12:46 |
| jtomasek | d0ugal: hmm, you probably know the answer better, I thought that mistral environment is better accessible from mistral actions/workflows and has been used as a natural fit | 12:48 |
| d0ugal | jtomasek: I think I thought it would be, but it isn't really. | 12:48 |
| d0ugal | In some ways it is harder to access than swift :) | 12:48 |
| jtomasek | d0ugal: whereas swift was intended to be used just as a storage | 12:48 |
| d0ugal | jtomasek: right, but we use the mistral environment as storage and it wasn't designed for that :) | 12:49 |
| jtomasek | d0ugal: I am ok with either solution, but we should stick to one, rather than having the plan 'state' stored in mistral environment and swift files | 12:49 |
| d0ugal | jtomasek: agreed, I just replied to your email anyway | 12:49 |
| *** nrado has joined #tripleo | 12:49 | |
| jtomasek | d0ugal: thanks! | 12:49 |
| d0ugal | somebody might be able to remind me why we are using Mistral envs. | 12:49 |
| d0ugal | but AFAICT a mistral environment, as we use it, is no better than a json file in swift. | 12:50 |
| jtomasek | d0ugal: ok, good to know, I think I was looking for this answer:) | 12:50 |
| *** adarazs_lunch is now known as adarazs | 12:52 | |
| *** athomas has quit IRC | 12:52 | |
| *** athomas has joined #tripleo | 12:52 | |
| openstackgerrit | Ricardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service https://review.openstack.org/428089 | 12:54 |
| therve | EmilienM, Hey, want to chat about https://bugs.launchpad.net/tripleo/+bug/1661412 ? | 12:55 |
| openstack | Launchpad bug 1661412 in tripleo "NetworkDeployment is executed even if NetworkDeploymentActions is set to ["CREATE"] only" [High,Triaged] | 12:55 |
| *** fzdarsky is now known as fzdarsky|lunch | 12:55 | |
| *** rhallisey has quit IRC | 12:56 | |
| *** salmankhan has quit IRC | 12:56 | |
| EmilienM | therve: yeah, I'm still figuring out why I have that | 12:56 |
| therve | EmilienM, it's a newton to ocata upgrade? | 12:57 |
| EmilienM | therve: exactly | 12:57 |
| therve | EmilienM, Does the resource exist in newton? | 12:58 |
| EmilienM | therve: yes, the overcloud is deployed on Newton, it only fails when I run stack update | 12:58 |
| *** lucas-hungry is now known as lucasagomes | 12:59 | |
| *** dmarlin has quit IRC | 12:59 | |
| shardy | the SoftwareConfig resource is changing though | 12:59 |
| therve | EmilienM, I mean, is there a NetworkDeployment resource in the newton template? | 12:59 |
| shardy | therve: yeah the NetworkDeployment should be the same, only the config changes | 12:59 |
| therve | OK | 12:59 |
| therve | Looking at the log, we get into replace phase | 12:59 |
| slagle | the config gets mapped to a new nested stack actually | 13:00 |
| therve | That's why we re-create it, and don't respect the actions | 13:00 |
| slagle | but the actions on the Deployment are ["CREATE"] | 13:00 |
| shardy | slagle: does the upgrade switch the dummy server to the new DeployedServer resource? | 13:00 |
| *** milan has joined #tripleo | 13:01 | |
| slagle | shardy: yes, i think so | 13:01 |
| shardy | if the server ID changes, the deployment gets replaced | 13:01 |
| shardy | so that may be why | 13:01 |
| shardy | http://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Heat::SoftwareDeployment-prop-server | 13:01 |
| *** ccamacho is now known as ccamacho|lunch | 13:02 | |
| slagle | ok, so then we need to set NetworkDeploymentActions to [] on update | 13:02 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration. https://review.openstack.org/428093 | 13:02 |
| slagle | that should fix it for this case? | 13:02 |
| *** jaganathan has joined #tripleo | 13:02 | |
| shardy | Or ensure the server ID doesn't change (which would be the normal update case, as the nova server isn't changing) | 13:02 |
| *** jayg|g0n3 is now known as jayg | 13:04 | |
| *** rlandy has joined #tripleo | 13:05 | |
| ansiwen | matbu: so, https://review.openstack.org/#/c/405241 includes the pre-upgrade safety online_data_migration... but it doesn't include the post-db-sync online_data_migration. do you have plans to include that somewhere else, so it will be executed during the service running? | 13:08 |
| ansiwen | matbu: and can I help somehow? | 13:08 |
| *** ealcaniz has quit IRC | 13:09 | |
| matbu | ansiwen: the post-db-sync should be run when the package nova-api is updated and running ? | 13:10 |
| matbu | ansiwen: i think it could be add at the end of the step5 | 13:10 |
| *** ooolpbot has joined #tripleo | 13:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 13:11 |
| *** ooolpbot has quit IRC | 13:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 13:11 |
| shardy | matbu: we can't start nova-api via ansible because we need it reconfiguring for httpd via puppet | 13:11 |
| shardy | matbu, ansiwen: so I think the post-start sync has to go in puppet-nova? | 13:11 |
| ansiwen | matbu: the idea of "online_data_migration" is to extract migration steps from db_sync, that could be executed in the running system, to keep the db-sync as short as possible and have a short downtime. so it is not _necessary_ to run the online_data_migration in the running system, but it's possible and would therefore reduce the downtime. does that make sense? | 13:12 |
| shardy | probably we should remove all the syncs that aren't migrations not handled by puppet | 13:12 |
| shardy | but yeah if it's not handled by puppet, and nova-api doesn't need to be runing we can do it in step5 | 13:13 |
| *** jaganathan has quit IRC | 13:13 | |
| ansiwen | shardy: yeah, it doesn't need to be running. | 13:13 |
| *** dmarlin has joined #tripleo | 13:14 | |
| ansiwen | matbu, shardy: in case you missed it, I created an etherpad to get a kind of overview of the whole situation: https://etherpad.openstack.org/p/tripleo-nova-online-data-migration | 13:14 |
| matbu | ansiwen: thx | 13:14 |
| therve | slagle, It sound like not changing the server ID will be tough | 13:16 |
| therve | It ought to be the correct thing, because we may have other unexpected issue by not reusing it | 13:17 |
| matbu | ansiwen: so we run the online_data_migration at step 5 (line 205) so this part should be run at the end of the dbs sync (nova db and api db?) | 13:17 |
| ansiwen | shardy, matbu: however, to keep downtime during upgrade short, the online_data_migration is designed to be run in the running system, that's why it's called "online". so optimal would be a background process after the system is up and running, that does the online_data_migration, and marks the system as fully "upgraded" once it's finished. subsequest updates could then check for that "upgrade-mark", but that is a bit over-engineered | 13:18 |
| ansiwen | probebly, because a very quick upgrade over two major versions is not a common usecase I assume. | 13:18 |
| *** morazi has joined #tripleo | 13:18 | |
| matbu | ansiwen: do you know how long could it take on a production environment ? | 13:19 |
| *** bfournie has quit IRC | 13:20 | |
| *** sudipto has joined #tripleo | 13:20 | |
| *** sudipto_ has joined #tripleo | 13:20 | |
| ansiwen | matbu: no idea... but it was done, beccause for large deployments a db-sync took to long, so they decided to split it up into an offline-part (db-sync) and an online part (online_data_migrations), so it's a fair assumtions, that it takes too long as that you wanna wait for it to finish before you restart the system. | 13:21 |
| *** hjensas has joined #tripleo | 13:21 | |
| *** hjensas has quit IRC | 13:21 | |
| *** hjensas has joined #tripleo | 13:21 | |
| EmilienM | shardy, slagle, therve, thanks guys. It seems we have 2 solutions, maybe I can start with James's solution first and maybe do shardy's one too, to be safer | 13:21 |
| therve | EmilienM, *potential* solutions :) | 13:22 |
| therve | But yeah the action restrictions sound easier to try at least | 13:22 |
| EmilienM | right, it's worst a try | 13:22 |
| *** dprince has joined #tripleo | 13:23 | |
| matbu | ansiwen: hmm yep, idk what shardy thinks about that, imho we could keep the review as is in a first pass and then itterate to make an async process to the online_data db sync | 13:23 |
| matbu | ansiwen: actually we can do that easily with ansible | 13:25 |
| *** morazi has quit IRC | 13:25 | |
| shardy | Yeah that sounds like something we can consider after we get the initial with-downtime workflow proven | 13:26 |
| shardy | matbu, ansiwen: So, are we OK to land https://review.openstack.org/#/c/405241/ as it is, then iterate on any fixes, or do we need to wait? | 13:27 |
| *** panda|lch is now known as panda | 13:27 | |
| EmilienM | slagle: do you have an example in THT where we set a resource for a specific action? | 13:27 |
| shardy | I'd like to add it to the upgrades CI job, but we can do that as a followup if it's been proven locally | 13:27 |
| matbu | shardy: i think we can use the async option on this task, and make the poll configurable, so if we want to "launch and forget the db sync" we just have to set the poll to 0 | 13:28 |
| *** gkadam has quit IRC | 13:28 | |
| nrado | Can someone please help me concerning the tripleo-image-elements: https://github.com/openstack/tripleo-image-elements/blob/master/elements/seed-stack-config/install.d/01-seed-stack-heat-metadata | 13:28 |
| nrado | I want to change the auth_url in /etc/etc/os-collect-config.conf, because it points to an internal VIP which is not accessible for VMs deployed with my Heat stack. | 13:28 |
| nrado | How do the params come into the config file I sent in the link above? | 13:28 |
| EmilienM | shardy: my question is why does it fail for me in scenarios and not for your job? | 13:28 |
| matbu | shardy: i'm in favor of landing if all reviewer are agree | 13:28 |
| matbu | shardy: and then work on another pass | 13:28 |
| matbu | EmilienM: do you have an example ? | 13:29 |
| EmilienM | matbu: +1 on landing nova | 13:29 |
| EmilienM | we can iterate later | 13:29 |
| *** jaganathan has joined #tripleo | 13:29 | |
| * shardy pulls and tries locally | 13:29 | |
| EmilienM | matbu: see https://bugs.launchpad.net/tripleo/+bug/1661412 - it seems like you're not hiting this bug in your upgrade job | 13:29 |
| openstack | Launchpad bug 1661412 in tripleo "NetworkDeployment is executed even if NetworkDeploymentActions is set to ["CREATE"] only" [High,Triaged] | 13:29 |
| shardy | Ok I'll do a test locally then approve if it works | 13:29 |
| shardy | EmilienM: honestly I'm not sure - are we using the master deployed-server config in the current CI job? | 13:30 |
| shardy | EmilienM: I'll check and compare the logs when I've tested this nova patch | 13:30 |
| EmilienM | ok, let me look that | 13:30 |
| matbu | marios: may i update your review (https://review.openstack.org/419886) to fix the jinja rendering or do you prefer me to comment on the review the things which failed the rendering ? | 13:30 |
| *** arxcruz has quit IRC | 13:30 | |
| ansiwen | shardy, matbu: so if you want to have a fully working upgrade with increased downtime, you need to add a last online_data_mitration step that is executed on at least on controller node with database connection. without it, the upgrade is not complete. | 13:32 |
| *** rhallisey has joined #tripleo | 13:32 | |
| *** trown|outtypewww is now known as trown | 13:32 | |
| shardy | ansiwen: Ok, and that needs to happen after the package update, but can happen before the nova services are started? | 13:33 |
| *** pradk has joined #tripleo | 13:33 | |
| ansiwen | shardy, matbu: but if you accept that the upgrade process is not complete yet with this change, then you can merge as is, and add the online_data_migration elsewhere | 13:33 |
| ansiwen | shardy: after the db sync | 13:33 |
| shardy | ansiwen: please comment on the review and I'll try it - we can decide if we post a follow up patch or modify this one | 13:33 |
| shardy | ansiwen: thanks for the feedback :) | 13:34 |
| slagle | EmilienM: it's setting a parameter | 13:34 |
| ansiwen | shardy: ok, I'll do | 13:34 |
| *** shardy is now known as shardy_mtg | 13:34 | |
| *** Vijayendra has quit IRC | 13:37 | |
| *** flepied has joined #tripleo | 13:37 | |
| *** arxcruz has joined #tripleo | 13:38 | |
| ansiwen | shardy_mtg: done | 13:38 |
| *** morazi has joined #tripleo | 13:38 | |
| *** ansmith has joined #tripleo | 13:39 | |
| slagle | EmilienM: i'd use the version of net-config-multinode.yaml from tripleo-ci instead of tripleo-heat-templates | 13:39 |
| slagle | that's what we are using in the upgrades job | 13:39 |
| nrado | any advice? | 13:41 |
| *** jpena is now known as jpena|lunch | 13:42 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: [overcloud-ssl] fix library to work with ocata https://review.openstack.org/428726 | 13:43 |
| matbu | ansiwen: yes thanks for the feedback | 13:43 |
| *** prateek_ has joined #tripleo | 13:43 | |
| matbu | ansiwen: but just a question does the L205 is required at this stage ? | 13:44 |
| ansiwen | shardy_mtg, matbu: you're very welcome, actually I'm here not only for feedback, but I can actually do work, so if you tell me what is the right approach I can actually get my hands dirty | 13:45 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration. https://review.openstack.org/428093 | 13:46 |
| *** fzdarsky|lunch is now known as fzdarsky | 13:46 | |
| ansiwen | matbu: oh, no, that's wrong!, didn't notice it! I will comment on it | 13:46 |
| EmilienM | slagle: ok | 13:46 |
| matbu | ansiwen: hehe thanks then :) | 13:46 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix and improve flake8 test. https://review.openstack.org/428710 | 13:47 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add ReNo support for managing release notes in TripleO-Quickstart-Extras https://review.openstack.org/428729 | 13:47 |
| ansiwen | matbu: commented | 13:49 |
| *** anshul has quit IRC | 13:49 | |
| matbu | ansiwen: awesome thank you :) | 13:49 |
| trown | weshay: can you use the example of centosci/ocata.yml (pulled into that patch via rebase) to add repo configs for the other releases being added in that patch? https://review.openstack.org/428362 | 13:50 |
| *** bfournie has joined #tripleo | 13:50 | |
| weshay | trown++ ya np | 13:51 |
| ansiwen | matbu: I can prepare a patchset now, if you are busy with other stuff, what do you think? | 13:51 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Add repo configuration to release configs https://review.openstack.org/424212 | 13:51 |
| honza | jtomasek: Did I understand your comments correctly that you wanted me to rewrite the dist/ patch using HtmlWebpackPlugin? | 13:52 |
| jtomasek | honza: yes, if you agree | 13:52 |
| honza | jtomasek: I don't care either way. Happy to redo it. | 13:52 |
| jtomasek | honza: my thinking is that we'll need to do that sooner or later anyway | 13:52 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix and improve flake8 test. https://review.openstack.org/428710 | 13:52 |
| matbu | ansiwen: you mean for the online_data_migration on a running system ? | 13:53 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix initialization of novaclient https://review.openstack.org/428105 | 13:53 |
| matbu | ansiwen: i'm about to move the L205 to the end | 13:53 |
| ansiwen | matbu: no, as an intermediate step I would move the wrong one to the end with a comment that this is a intermediate solution, until we have a background solution | 13:54 |
| ansiwen | matbu: ok, that's what I would have done as well, ok :-) | 13:54 |
| matbu | ansiwen: ha ok, i'm pushing a new change so | 13:54 |
| *** jpich has quit IRC | 13:55 | |
| matbu | ansiwen: i'm wondering if we need to make it async ? | 13:55 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades https://review.openstack.org/405241 | 13:55 |
| jtomasek | honza: re https://review.openstack.org/#/c/424547/7/src/js/utils/nodes.js | 13:56 |
| honza | jtomasek: saw the email, haven't read the comments yet | 13:56 |
| *** kberger has joined #tripleo | 13:56 | |
| jtomasek | honza: ok, no rush, I'll wait for your feedback and update the patch accordingly | 13:56 |
| ansiwen | matbu: what exactly? | 13:57 |
| *** tzumainn has joined #tripleo | 13:58 | |
| matbu | ansiwen: the online_data_migration task | 13:58 |
| ansiwen | matbu: the last online_data_migration step? | 13:58 |
| matbu | ansiwen: yep | 13:58 |
| ansiwen | matbu: what does it mean exactly? it would be started in the background, and then the service would be started no matter if it finished? | 13:59 |
| ansiwen | matbu: actually that would be sufficient I giess, but I would like to ask out nova-core about that first... | 14:00 |
| matbu | ansiwen: ansible will execute the data migration , forked in background and then the upgrade process will continue | 14:00 |
| ansiwen | matbu: what I mean is, then we would not need any other solution... | 14:00 |
| *** dtantsur|bbl is now known as dtantsur | 14:00 | |
| *** salmankhan has joined #tripleo | 14:03 | |
| *** rbrady-afk is now known as mock-hates-me | 14:04 | |
| *** nrado has left #tripleo | 14:04 | |
| larsks | EmilienM: mmagr's patch at https://review.openstack.org/#/c/410210/ has a depends-on for that tripleo-ci patch, but look at the console log it doesn't appear to be running with that patch active. | 14:06 |
| larsks | I'm looking at http://logs.openstack.org/10/410210/6/check/gate-tripleo-ci-centos-7-scenario001-multinode/50b6998/console.html#_2017-02-03_10_10_14_878067. | 14:06 |
| dtantsur | gfidente, (late response) network provisioned in the overcloud neutron | 14:06 |
| gfidente | dtantsur so if it has to be in the overcloud neutron and you want just a string there? | 14:07 |
| dtantsur | yep, this is a future network, that users will create (yes, I realize how it sounds) | 14:08 |
| *** dsavineau has left #tripleo | 14:10 | |
| EmilienM | slagle: I think I found why, see https://review.openstack.org/#/c/404831/76/heat-templates/net-config-multinode.yaml | 14:10 |
| EmilienM | slagle: you were right, something went wrong in the "ip"command | 14:10 |
| marios | matbu: hey man, am still on this call | 14:10 |
| marios | matbu: please feel free to update it if you can/have time thanks very much | 14:11 |
| *** ooolpbot has joined #tripleo | 14:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661242 | 14:11 |
| *** ooolpbot has quit IRC | 14:11 | |
| openstack | Launchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged] | 14:11 |
| marios | matbu: otherwise i will try and update it later if you want to add a comment | 14:11 |
| *** mock-hates-me is now known as rbrady | 14:11 | |
| *** shardy_mtg is now known as shardy | 14:11 | |
| *** dsavineau has joined #tripleo | 14:12 | |
| rbrady | shardy: ping https://bugs.launchpad.net/tripleo/+bug/1644875 | 14:12 |
| openstack | Launchpad bug 1644875 in tripleo "Plan isn't purged of roles_data on a new create" [High,Triaged] - Assigned to Dougal Matthews (d0ugal) | 14:12 |
| *** jmelvin has joined #tripleo | 14:12 | |
| shardy | rbrady: Hi! | 14:12 |
| rbrady | shardy: I was reading this bug and thinking about the previous desire to decouple plans from stacks | 14:13 |
| matbu | marios: ack, thank you, i have few things to update but i still have some weird behavior | 14:14 |
| matbu | but will do | 14:14 |
| shardy | rbrady: Yeah, maybe the answer is to somehow enforce running plan delete or overcloud delete | 14:15 |
| rbrady | shardy: is there still a desire to separate plans from stacks? if so should we be looking at creating something else that manages the state of what plans were used to create stacks | 14:15 |
| shardy | rbrady: I always expected them to be a bit less coupled than they are, but I think the current model is working OK so I'm not pushing too hard to change it :) | 14:17 |
| shardy | rbrady: I think the main problem is that we overwrite the roles_data.yaml in the default t-h-t, instead I think we need the process_templates logic be able to pick up a user defined roles_data file (either from the swift container or the mistral env) | 14:19 |
| shardy | but then default to the tht/roles-data.yaml if the user doesn't pass -r on a new deployment | 14:19 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: Provide a default value for Ironic cleaning_network configuration https://review.openstack.org/428052 | 14:19 |
| dtantsur | shardy, let's try this ^^^ | 14:19 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic https://review.openstack.org/428053 | 14:20 |
| shardy | then we could still consume updates to the --templates directory without clobbering the users roles_data.yaml | 14:20 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: net-config-multinode: make controlplane int idempotent https://review.openstack.org/428747 | 14:20 |
| *** athomas has quit IRC | 14:20 | |
| EmilienM | shardy, slagle ^ | 14:20 |
| *** ccamacho|lunch is now known as ccamacho | 14:20 | |
| *** adarazs is now known as adarazs_afk | 14:20 | |
| shardy | dtantsur: so, this is really just a placeholder, which will be updated when the network is created in the overcloud neutron? | 14:21 |
| *** Goneri has joined #tripleo | 14:22 | |
| dtantsur | shardy, essentially yes. the docs will recommend creating a network with this name, so in simplest case an update will not be needed | 14:22 |
| * dtantsur is sad with this, but he does not see a better way out | 14:22 | |
| shardy | dtantsur: Ok thanks for clarifying, I was confused by the "and should be changed to an actual UUID" part | 14:23 |
| *** colonwq has quit IRC | 14:23 | |
| shardy | in the parameter description | 14:23 |
| shardy | maybe that can be reworded to say it can be a network name, so no update is required if the names match? | 14:23 |
| shardy | dtantsur: FYI I was talking with beagles about a very similar requirement for octavia | 14:24 |
| shardy | that requires overcloud neutron resources to be created, then wired into the octavia config | 14:24 |
| dtantsur | shardy, I don't want to recommend using names for non-PoC cases, as names in neutron are not unique | 14:25 |
| shardy | perhaps we can discuss at the PTG possible ways to make those steps integrate more cleanly | 14:25 |
| shardy | dtantsur: ack, Ok no worries | 14:25 |
| *** owalsh is now known as owalsh-brb | 14:25 | |
| *** jtomasek has quit IRC | 14:25 | |
| dtantsur | shardy, ++ for PTG discussion | 14:25 |
| *** hjensas has quit IRC | 14:26 | |
| *** jtomasek has joined #tripleo | 14:26 | |
| *** athomas has joined #tripleo | 14:26 | |
| *** tobias_fiberdata has quit IRC | 14:27 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud stable/newton: export OS_BAREMETAL_API_VERSION in stackrc https://review.openstack.org/428756 | 14:27 |
| *** colonwq has joined #tripleo | 14:28 | |
| *** tobias_fiberdata has joined #tripleo | 14:28 | |
| dtantsur | may I have this backport please ^^^? | 14:29 |
| *** owalsh-brb has quit IRC | 14:29 | |
| *** ealcaniz has joined #tripleo | 14:29 | |
| *** liverpooler has joined #tripleo | 14:32 | |
| *** owalsh-brb has joined #tripleo | 14:32 | |
| EmilienM | dtantsur: please add bug reference and we're good | 14:33 |
| *** tobias_fiberdata has quit IRC | 14:34 | |
| dtantsur | EmilienM, creating a bug as we speak | 14:34 |
| EmilienM | dtantsur: cool | 14:35 |
| *** jcoufal has joined #tripleo | 14:35 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled https://review.openstack.org/419886 | 14:36 |
| *** ealcaniz has quit IRC | 14:36 | |
| *** tobias_fiberdata has joined #tripleo | 14:36 | |
| EmilienM | any thoughts on enabling more Debug in CI? https://review.openstack.org/#/c/428476/ | 14:36 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud stable/newton: export OS_BAREMETAL_API_VERSION in stackrc https://review.openstack.org/428756 | 14:36 |
| *** lblanchard has joined #tripleo | 14:36 | |
| dtantsur | done ^^^ | 14:37 |
| *** tobias_fiberdata has quit IRC | 14:37 | |
| *** tobias_fiberdata has joined #tripleo | 14:39 | |
| *** salmankhan has quit IRC | 14:40 | |
| *** amoralej is now known as amoralej|lunch | 14:40 | |
| *** jpena|lunch is now known as jpena | 14:40 | |
| EmilienM | larsks: let me look in a bit | 14:41 |
| larsks | EmilienM: the dependency worked for the collectd job, so maybe mmagr just needs a recheck. | 14:41 |
| larsks | We'll do that first. | 14:41 |
| EmilienM | ok | 14:41 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs https://review.openstack.org/427802 | 14:42 |
| weshay | matbu, do you have an estimate of when you will have the upgrade validation check in a review for oooq? | 14:43 |
| weshay | matbu, we'd like to start reviewing and merging the upgrade role | 14:44 |
| weshay | and I think that is the only item left | 14:44 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add scenario005 job (4nodes) https://review.openstack.org/418098 | 14:45 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Add scenario005 scenario https://review.openstack.org/418099 | 14:45 |
| matbu | weshay: i will add a new role in a different review | 14:46 |
| matbu | weshay: as i said in by email, i think that should not block the review since it will be in another review | 14:47 |
| matbu | weshay: and + the time and work for maintaining and rebasing the both review will be very useless | 14:47 |
| matbu | weshay: and btw i think this kind of sanity checks, is more global and not limited to only the upgrade scope | 14:48 |
| *** fultonj has joined #tripleo | 14:49 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: Update bare metal cleaning documentation with latest changes https://review.openstack.org/428066 | 14:50 |
| dtantsur | shardy, docs bit for this ironic issue ^^^ | 14:50 |
| d0ugal | thrash: the downside is that the CLI currently just ignored any messages that are not from the "parent" workflow. | 14:51 |
| d0ugal | therve: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/plugin.py#L152-L153 | 14:51 |
| d0ugal | oops, sorry therve - you'd think I would learn | 14:51 |
| thrash | d0ugal: yeah.. that would make that unuseful. :D | 14:51 |
| d0ugal | thrash: ^ that link shows where the CLI drops it. | 14:51 |
| matbu | weshay: but to answer to your question, i'll try to push something by the end of this week or the begining of next week | 14:52 |
| thrash | d0ugal: I'll base my patch on your multimessage patch | 14:52 |
| d0ugal | thrash: I wouldn't, yet :) | 14:52 |
| d0ugal | thrash: because I hit issues and I wont be able to fix them for a week | 14:52 |
| d0ugal | thrash: (but now that there is a use case, I have more motivation!) | 14:53 |
| *** paramite has quit IRC | 14:53 | |
| weshay | matbu, we can't merge the work w/o a functional gate | 14:53 |
| d0ugal | thrash: you could always just hack in a print in that loop so you can see them all for testing purposes. | 14:53 |
| weshay | part of the gate is the validation | 14:53 |
| *** jeckersb_gone is now known as eck` | 14:53 | |
| thrash | d0ugal: haha | 14:53 |
| weshay | matbu, if you need someone else to write the validation I can facilitate that.. but we're looking for a cut/paste of what is in tripleo-ci atm | 14:53 |
| thrash | d0ugal: noted. | 14:54 |
| thrash | biab | 14:54 |
| *** thrash is now known as thrash|biab | 14:54 | |
| *** salmankhan has joined #tripleo | 14:56 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add quickstart release files for ocata https://review.openstack.org/428362 | 15:01 |
| *** adarazs_afk is now known as adarazs | 15:05 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add quickstart release files for ocata https://review.openstack.org/428362 | 15:09 |
| *** pcaruana has quit IRC | 15:11 | |
| *** fultonj has quit IRC | 15:11 | |
| jtomasek | akrivoka: plan import export is planned for pike, right? | 15:12 |
| akrivoka | jtomasek: yes | 15:13 |
| *** Vijayendra has joined #tripleo | 15:13 | |
| EmilienM | shardy: quick heads-up on nova upgrades | 15:16 |
| EmilienM | shardy: with nova trunk we hit: https://bugs.launchpad.net/nova/+bug/1661360 | 15:16 |
| openstack | Launchpad bug 1661360 in OpenStack Compute (nova) "tempest test fails with "Instance not found" error" [Undecided,In progress] - Assigned to Dan Smith (danms) | 15:16 |
| EmilienM | shardy: they're trying to fix it with https://review.openstack.org/#/c/428415/ but I'm not sure it will make it on time for ocata | 15:16 |
| EmilienM | shardy: another option is to revert nova/wsgi in tripleo and deploy eventlet again (like we did in Mitaka) | 15:17 |
| *** pcaruana has joined #tripleo | 15:17 | |
| EmilienM | shardy: I think Juan implemented it during Ocata so we might just need to revert the patches | 15:18 |
| shardy | EmilienM: Ok thanks for the update, reverting to eventlet seems saest to me | 15:18 |
| shardy | safest I mean | 15:18 |
| EmilienM | ok I'll check with Dan Smith | 15:18 |
| *** dmacpher has joined #tripleo | 15:18 | |
| shardy | but yeah lets chat with jaosorior as I got the impression the tls-everywhere stuff was somehow coupled to moving the services under wsgi | 15:19 |
| *** saneax is now known as saneax-_-|AFK | 15:19 | |
| shardy | "Since those deployments are risking instability anyway" | 15:19 |
| shardy | what does that mean? | 15:20 |
| shardy | is httpd not reccomended/supported for nova? | 15:20 |
| shardy | probably need to clarify that with dansmith | 15:20 |
| *** flepied has quit IRC | 15:20 | |
| EmilienM | mriedem | given we haven't really flushed out testing with that, i think it's prudent at this point in ocata | 15:22 |
| EmilienM | shardy: ^ | 15:22 |
| EmilienM | Nova PTL suggest we switch WSGi off for nova api | 15:22 |
| shardy | EmilienM: Ok, thanks - I guess that tells us what we need to do | 15:22 |
| EmilienM | I'm on it | 15:22 |
| shardy | ack, thanks EmilienM | 15:22 |
| *** fultonj has joined #tripleo | 15:23 | |
| *** chlong has joined #tripleo | 15:23 | |
| *** prateek has quit IRC | 15:23 | |
| *** prateek_ has quit IRC | 15:23 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled https://review.openstack.org/419886 | 15:24 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Move libvirt_uri to common role https://review.openstack.org/424319 | 15:25 |
| *** owalsh-brb is now known as owalsh | 15:28 | |
| *** tobias_fiberdata has quit IRC | 15:28 | |
| panda | derekh: mh http://66.187.229.139/builds/current-tripleo/ overcloud-full.tar image is missing | 15:30 |
| *** tobias_fiberdata has joined #tripleo | 15:31 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428778 | 15:32 |
| *** Vijayendra has quit IRC | 15:33 | |
| EmilienM | amoralej|lunch: fyi ^ | 15:33 |
| *** amoralej|lunch is now known as amoralej | 15:34 | |
| amoralej | ufff | 15:34 |
| *** jcoufal_ has joined #tripleo | 15:34 | |
| dtrainor | can i get some reviews on https://review.openstack.org/#/c/424909/ and https://review.openstack.org/#/c/424903 please? | 15:35 |
| *** rajinir has joined #tripleo | 15:36 | |
| panda | I think this is a red alert ... | 15:36 |
| panda | the gates are not using the promoted images | 15:36 |
| *** vpickard has joined #tripleo | 15:36 | |
| *** jcoufal has quit IRC | 15:36 | |
| panda | they are rebuilding new images everytime | 15:37 |
| panda | because there is not promoted image in the mirror | 15:37 |
| amoralej | EmilienM, is that intended just temporal to be fixed before ocata GA? | 15:37 |
| EmilienM | amoralej: I don't think it will be fixed by GA | 15:38 |
| amoralej | we don't rely on httpd for SSL termination, right? | 15:38 |
| amoralej | we always do it with haproxy, iirc | 15:38 |
| EmilienM | amoralej: right | 15:39 |
| EmilienM | unless you use TLS everywhere | 15:39 |
| *** tremble has quit IRC | 15:39 | |
| EmilienM | Juan will hate me | 15:39 |
| amoralej | and for newton -> ocata migrations, we'll need to undo the apache part | 15:40 |
| *** jaosorior has joined #tripleo | 15:40 | |
| EmilienM | amoralej: in newton, nova api was not in wsgi | 15:40 |
| amoralej | oh, i thought it was | 15:40 |
| jaosorior | amoralej: I thought it was as well | 15:41 |
| amoralej | frankly, i think it's the best we can do, while it's not tested in nova gate | 15:41 |
| jaosorior | at least it was for the undercloud | 15:41 |
| panda | EmilienM: bnemec derekh https://bugs.launchpad.net/tripleo/+bug/1661656 | 15:41 |
| openstack | Launchpad bug 1661656 in tripleo "CI: promoted overcloud-full image is missing in the mirror" [Critical,Triaged] | 15:41 |
| bnemec | panda: I literally just discovered that myself. :-) | 15:41 |
| bnemec | panda: The mirror server is full. | 15:42 |
| * panda facepalms | 15:43 | |
| * panda runs to the rack with his 500G hard drive | 15:43 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428783 | 15:43 |
| jaosorior | :( | 15:43 |
| *** mcornea has quit IRC | 15:43 | |
| panda | bnemec: I guess we are not removing old images then ... | 15:43 |
| bnemec | panda: Doesn't look like it. | 15:44 |
| bnemec | derekh: Did you have any sort of a cleanup script for the mirror server? | 15:44 |
| panda | bnemec: EmilienM the problem is we've lost the promoted overcloud image from today | 15:45 |
| panda | so we'll have to start manual promotion again. | 15:45 |
| jaosorior | EmilienM: so there was no other solution? | 15:46 |
| EmilienM | jaosorior: nova PTL and Dan Smith strongly suggested us to not deploy nova APi in WSGI with Apache | 15:47 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Explicitly configure credentials used by ironic to access glance https://review.openstack.org/428680 | 15:47 |
| EmilienM | jaosorior: moreover, there are some bugs related to it | 15:47 |
| EmilienM | at this point of the cycle, I'm reverting this work so we can go back on nova trunk one day | 15:47 |
| EmilienM | sorry | 15:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Cleanup nova-api workaround for wsgi/eventlet https://review.openstack.org/428784 | 15:47 |
| panda | yeah if it's not supported nor gated, will be a pain to maintain | 15:48 |
| EmilienM | jaosorior: I would ask you to ASAP review https://review.openstack.org/#/q/topic:bug/1661360+owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22 | 15:48 |
| EmilienM | and let me know if I did something wrong | 15:48 |
| EmilienM | jaosorior: feel free to take over the patches also | 15:48 |
| EmilienM | jaosorior: if possible I want to merge it today | 15:48 |
| jaosorior | EmilienM: ok, lets do that | 15:50 |
| jaosorior | EmilienM: lets wait for it to pass CI | 15:50 |
| panda | can someone merge this so I can be more helpful in the infra next time ? https://review.openstack.org/410157 thanks. | 15:50 |
| jaosorior | on a quick review it looks good to me | 15:50 |
| panda | bnemec: will this give me access to the mirror server too ? ^ | 15:50 |
| EmilienM | jaosorior: ok thx | 15:50 |
| EmilienM | panda: approved | 15:50 |
| panda | EmilienM: thanks. | 15:51 |
| bnemec | panda: It should, yes. | 15:53 |
| panda | great | 15:53 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled https://review.openstack.org/419886 | 15:54 |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428785 | 15:55 |
| openstackgerrit | Merged openstack/tripleo-image-elements master: Follow HTTP/HTTPS redirects https://review.openstack.org/428146 | 15:56 |
| ansiwen | shardy, matbu: ok, it's getting more complicated. :-( | 15:57 |
| ansiwen | shardy, matbu: online_data_migrations is not guaranteed to succeed in a single executed, so it must be an after upgrade task, that is repeated until the tool reports the successfull migrations of everything. | 15:58 |
| ansiwen | so, the overcloud is fully functional already then, but still the online migrations have to be done. | 15:59 |
| matbu | ansiwen: ack, and until how many times we can considere it as failed ? | 16:01 |
| matbu | ansiwen: cause we can make retry easily depending on the output, but how many times ? | 16:02 |
| *** jcoufal_ has quit IRC | 16:03 | |
| bnemec | panda: I've cleaned up some of the old images on the mirror server and copied the last good image to the current-tripleo directory, so hopefully we're back up and running again. | 16:03 |
| *** jcoufal has joined #tripleo | 16:03 | |
| *** aufi has quit IRC | 16:04 | |
| panda | bnemec: ok I'll kick a manual promotion | 16:04 |
| ansiwen | matbu: there is no limit :-/ | 16:05 |
| jaosorior | EmilienM: commented to the nova patch | 16:05 |
| shardy | ansiwen: that makes no sense, how can nova have a tool which requires infinite retries until it works? | 16:05 |
| shardy | that retry logic should depend on some state, and the state should be inspected inside the tool | 16:06 |
| bnemec | Oops, except I had the file owned as root. Now it should be working. I see jobs requesting the image and getting it. | 16:06 |
| shardy | this is a horrible experience for operators IMO | 16:06 |
| jaosorior | bnemec: hey dude, did you have time to test the VNC bits yesterday? | 16:06 |
| EmilienM | jaosorior: can you do it please? | 16:06 |
| panda | bnemec: yeah, even I can download it | 16:06 |
| EmilienM | jaosorior: you know better the options than I do | 16:06 |
| jaosorior | EmilienM: sure man | 16:06 |
| EmilienM | thx | 16:07 |
| ansiwen | shardy: well... there are all kinds of reasons why migrations are deferred, so there is no hard limit. | 16:07 |
| bnemec | jaosorior: I did, and it worked for me, so I think that's good to go. | 16:07 |
| ansiwen | shardy: and I didn't design that, so I will not defend it :-) | 16:07 |
| bnemec | I just haven't had a chance yet today to get back and leave feedback. | 16:07 |
| ansiwen | shardy: this whole tooling was developed with human operators in mind | 16:07 |
| *** jcoufal_ has joined #tripleo | 16:07 | |
| *** sdake_ has joined #tripleo | 16:07 | |
| *** rhallisey has quit IRC | 16:08 | |
| *** rhallisey has joined #tripleo | 16:08 | |
| ansiwen | shardy: read this article, that step is even called "homework" ;-) http://www.danplanet.com/blog/2015/06/26/upgrading-nova-to-kilo-with-minimal-downtime/ | 16:08 |
| shardy | ansiwen: how many sysadmins want to manually retry a tool which is expected to fail an indeterminate number of times? | 16:08 |
| *** sdake has quit IRC | 16:08 | |
| shardy | ansiwen: ack, thanks | 16:08 |
| ansiwen | shardy: again, I can't defend that... | 16:08 |
| shardy | ansiwen: I appreciate it's not your fault, I'm just observing that this doesn't seem to have been designed with real-world operators in mind at all ;) | 16:09 |
| *** sdake has joined #tripleo | 16:09 | |
| *** jcoufal has quit IRC | 16:09 | |
| shardy | I guess we'll test it and pick a number based on the number of retries observed | 16:09 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428783 | 16:10 |
| ansiwen | shardy: that is highly depending on the size of the deployment | 16:10 |
| *** yamahata has joined #tripleo | 16:10 | |
| ansiwen | shardy: if you have 1000s of compute nodes, the likelyhood that some are not migratable is pretty high and it will need a lot more retries | 16:10 |
| *** ccamacho has quit IRC | 16:11 | |
| *** jcoufal has joined #tripleo | 16:11 | |
| *** ooolpbot has joined #tripleo | 16:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1661656 | 16:11 |
| openstack | Launchpad bug 1661656 in tripleo "CI: promoted overcloud-full image is missing from the mirror" [Critical,Triaged] | 16:11 |
| *** ooolpbot has quit IRC | 16:11 | |
| bnemec | panda: ^ is not critical IMHO. Jobs still work, they just take a little longer because they have to build the image themselves. | 16:11 |
| *** sdake has quit IRC | 16:12 | |
| ansiwen | shardy: I think we need a periodic taks, like a cronjob or something, which will run until everything is migrated and send out warnings until it's finished. | 16:12 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: nova/libvirt: switch vnc server binding https://review.openstack.org/427339 | 16:12 |
| jaosorior | bnemec: what about that? ^^ | 16:12 |
| *** sdake_ has quit IRC | 16:12 | |
| shardy | ansiwen: I guess that's an option, but that will mean it's not integrated with the upgrades workflow | 16:12 |
| ansiwen | shardy: or better we need an ansible task or puppet thing that periodically retries until it succeeds | 16:12 |
| panda | bnemec: it's not critical, I wanted to warn people that they weren't having the protection of the promotion | 16:13 |
| *** ccamacho has joined #tripleo | 16:13 | |
| bnemec | panda: We're still fine. The images built in the jobs still use current-tripleo, so you're getting the same packages either way. | 16:13 |
| bnemec | It just takes less time when we start from the cached image. | 16:13 |
| *** jcoufal_ has quit IRC | 16:13 | |
| ansiwen | shardy: right, we need two notions of "upgrade finished", first the offline stuff, and then a "soft" part, that will finish during runtime | 16:13 |
| weshay | yolanda, leifmadsen greetings.. wondering if you guys have additional git repos that you use alongside oooq I can poke at? | 16:14 |
| *** priley has joined #tripleo | 16:15 | |
| yolanda | hi weshay . Well, i also rely on the ansible-role-tripleo-image-builder to construct OSP images | 16:15 |
| weshay | yolanda, anything specific for your network testing? | 16:16 |
| yolanda | weshay not at the moment, because we mostly rely on virtualized deploys | 16:17 |
| *** ebarrera has quit IRC | 16:17 | |
| *** [1]cdearborn has joined #tripleo | 16:17 | |
| *** jaganathan has quit IRC | 16:17 | |
| *** thrash|biab is now known as thrash | 16:17 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Explicitly configure credentials used by ironic to access glance and neutron https://review.openstack.org/428680 | 16:18 |
| matbu | ansiwen: shardy i agree w/ shardy , it's really a bad user experience, and even with an infinite cron job | 16:18 |
| *** tzumainn has quit IRC | 16:18 | |
| matbu | ansiwen: shardy imagine, it never finished ? | 16:18 |
| *** tzumainn has joined #tripleo | 16:18 | |
| matbu | we will provide to customer an infinite loop on the controller, and + it can consume a bunch of memories | 16:19 |
| derekh | panda: did ye find the missing image? sorry was on a call | 16:20 |
| matbu | ansiwen: shardy i think maybe it would be nice to open a LP about this "infinite" part and just leave the review as is | 16:20 |
| matbu | ansiwen: shardy i can implement the retries, test it and discuess in the LP bug | 16:20 |
| panda | derekh: no, we've lost it, storage full | 16:20 |
| matbu | im running the upgrade patch atm with a catch of the log output from online_data_migration to see more details about that | 16:21 |
| shardy | matbu: +1 if the current patch works enough to enable folks to start testing I agree, lets fix this in a followup | 16:21 |
| panda | derekh: bnemec freed some space and copied yesterday's image | 16:22 |
| matbu | ansiwen: do you want to open the LP or i can do it | 16:22 |
| *** egafford has joined #tripleo | 16:22 | |
| ansiwen | matbu, shardy: one condition for online_data_migration to succeed is, that all compute nodes are upgraded already, is this guaranteed at that point in time? | 16:22 |
| panda | derekh: and we rekicked a promotion. All good :) | 16:22 |
| *** panda is now known as panda|bbl | 16:23 | |
| shardy | ansiwen: No, we upgrade the control plane first | 16:23 |
| matbu | ansiwen: nop | 16:23 |
| shardy | then operators drive the compute upgrades | 16:23 |
| shardy | then we do a final overcloud "converge" update | 16:23 |
| shardy | perhaps we just have to document this as part of the operator driven steps | 16:23 |
| derekh | panda|bbl: ok, there was a clean up script that should have been deleting old images | 16:23 |
| matbu | shardy: yep maybe | 16:24 |
| matbu | in all case i think having all details in a LP would help to figure out that part | 16:24 |
| ansiwen | shardy: do we have such steps? that would be certainly the easiest option, if there are manual steps anyway | 16:25 |
| matbu | we can add an extra step which would be applied during the converge btw | 16:25 |
| ansiwen | matbu: I have to go AFK now, but I could do it later | 16:25 |
| *** nmathew has quit IRC | 16:25 | |
| matbu | ansiwen: yep we have some manual intervention in some cases | 16:25 |
| matbu | ansiwen: at least some sanity checks from the operator for pacemaker for example | 16:26 |
| matbu | ansiwen: no pb, thanks for all your input | 16:26 |
| matbu | ansiwen: assign the LP to me if you want | 16:26 |
| *** fultonj has quit IRC | 16:27 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Fix and improve flake8 test. https://review.openstack.org/428689 | 16:27 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add registry and role service list entries for Octavia https://review.openstack.org/418596 | 16:29 |
| openstackgerrit | Andy Smith proposed openstack/puppet-tripleo master: WIP Use rpc and notify transport_url for oslo_messaging backends https://review.openstack.org/425484 | 16:31 |
| *** cdearborn has quit IRC | 16:31 | |
| *** bnemec is now known as beekneemech | 16:33 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428783 | 16:33 |
| dtrainor | jrist, I remember you talking about some troubles you were having with reno the other day - did you ever figure that out? | 16:33 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428778 | 16:34 |
| jrist | dtrainor: mostly? heh | 16:35 |
| jrist | dtrainor: there are some patches to rearrange so the reno stuff works | 16:35 |
| jrist | dtrainor: have a look and do some reviews if you can | 16:36 |
| *** chlong has quit IRC | 16:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: nova: disable API in WSGI by default https://review.openstack.org/428807 | 16:36 |
| dtrainor | reading | 16:37 |
| *** jlinkes has quit IRC | 16:43 | |
| gfidente | shardy shall we merge from https://review.openstack.org/#/c/428348/ and below? | 16:46 |
| shardy | gfidente: yes, please (unless anyone else has any objections) | 16:47 |
| shardy | marios, matbu: ^^ | 16:47 |
| gfidente | shardy I went through the reviews | 16:47 |
| gfidente | it's complicated to understand what is happening after jinja is compiled but seems good to me | 16:47 |
| shardy | I'm on PTO next week so would be good to clear those | 16:47 |
| gfidente | ack | 16:47 |
| shardy | gfidente: ./tools/process-templates.py in tht builds the rendered versions | 16:48 |
| shardy | so you can check it out if you like :) | 16:48 |
| gfidente | shardy yeah exactly | 16:48 |
| gfidente | tks | 16:48 |
| EmilienM | shardy: wait what | 16:48 |
| EmilienM | no you can't leave us | 16:49 |
| shardy | hehe, I'm sure you'll manage ;) | 16:49 |
| marios | shardy: still didn't get a chance to check those to be honest | 16:50 |
| marios | shardy: but yeah lets land things i mean we've already said this... there is no current 10-11 workflow so we aren't breaking anything yet | 16:51 |
| shardy | marios: Ok cool - they're passing CI and I've locally tested (mostly single node), are you OK to land then deal with any fixes? | 16:51 |
| shardy | marios: ack, thanks | 16:51 |
| *** chlong has joined #tripleo | 16:51 | |
| *** d0ugal is now known as d0ugal|skiing | 16:54 | |
| *** priley has quit IRC | 17:03 | |
| *** yolanda has quit IRC | 17:03 | |
| dtantsur | EmilienM, sorry to distract, but which job uses https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode-3nodes.yaml ? may we put ironic there on Controller role? | 17:03 |
| *** suuuper has quit IRC | 17:04 | |
| *** athomas has quit IRC | 17:04 | |
| *** yolanda has joined #tripleo | 17:06 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job https://review.openstack.org/427481 | 17:06 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin) https://review.openstack.org/427482 | 17:06 |
| marios | shardy: land this simple one ? https://review.openstack.org/#/c/427218/ | 17:06 |
| marios | shardy: would be nice to have this as at least some minor improvement to the script | 17:07 |
| *** cylopez has quit IRC | 17:09 | |
| larsks | slagle: do you have a moment for a question re: https://review.openstack.org/#/c/427802/5/scripts/tripleo.sh? | 17:11 |
| *** Vijayendra has joined #tripleo | 17:12 | |
| openstackgerrit | Dimitri Savineau proposed openstack/tripleo-quickstart-extras master: Tempest: ensure heat_stack_owner is present https://review.openstack.org/420896 | 17:12 |
| shardy | marios: lgtm | 17:12 |
| EmilienM | dtantsur: 3nodes-multinode-nv , see http://tripleo.org/cistatus.html | 17:12 |
| shardy | marios: hey sorry I didn't get as far as I expected on the script running ansible thing I mentioned | 17:12 |
| EmilienM | dtantsur: why would we add ironic? they are multinode jobs, we wouldn't test ironic correctly | 17:12 |
| shardy | marios: I'll add some notes to your patch explaining what I was thinking & you can decide if it's worth persuing next week | 17:12 |
| dtantsur | EmilienM, we can't quite test ironic without heat resources for it anyway, no? | 17:13 |
| dtantsur | so I thought we can at least put it somewhere to test it still starts.. | 17:13 |
| larsks | EmilienM: do you have a couple of minutes re: overcloud images and tripleo.sh? | 17:14 |
| EmilienM | larsks: it's not a good time no, I'm dealing with release blockers issue at this time | 17:14 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Add gcerami to tripleo-cd-admins https://review.openstack.org/410157 | 17:14 |
| larsks | EmilienM: I understand. Sorry for bugging you. | 17:14 |
| EmilienM | np | 17:14 |
| *** rwsu has quit IRC | 17:15 | |
| dtantsur | I'm kind of worried that ironic is probably the only service we support that does not have any CI coverage whatsoever | 17:15 |
| * dtantsur may be wrong in the "only" part | 17:15 | |
| marios | shardy: thanks. me approaching eod (hopefully soon) we are still on this call ... mostly waiting now for the compute reboots but my brain is pretty much fried at this point | 17:15 |
| larsks | trown: got a sec, also re tripleo.sh? | 17:16 |
| *** chlong has quit IRC | 17:16 | |
| trown | larsks: sure, heading to lunch soon, but maybe I can get you unblocked quickly | 17:16 |
| larsks | trown: I hope so. I'm looking at the patch to tripleo.sh, https://review.openstack.org/#/c/427802/5/scripts/tripleo.sh | 17:17 |
| larsks | There is a change in the overcloud_images function...but that is only called when tripleo.sh gets called with --overcloud-images. | 17:17 |
| larsks | And *that* doesn't happen as part of the gate jobs (e.g., those failing on https://review.openstack.org/#/c/411048/25). | 17:17 |
| larsks | mmagr and I both have patches blocked on this...what do I need to do to get our jobs to see images that have the appropriate packages? | 17:18 |
| openstackgerrit | Ben Nemec proposed openstack/instack-undercloud master: Clear any previous environment in stackrc https://review.openstack.org/428821 | 17:18 |
| *** Vijayendra has quit IRC | 17:19 | |
| *** b00tcat has quit IRC | 17:20 | |
| trown | larsks: ah right the multinode jobs are using cached images... | 17:21 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs https://review.openstack.org/427802 | 17:23 |
| larsks | trown: okay. So, how do we get new cached images? :) | 17:23 |
| trown | larsks: hmm... that is a good (but tough question)... how do we make changes that require a change in the cached image... | 17:23 |
| *** rasca has quit IRC | 17:23 | |
| trown | larsks: the cached images are updated via the periodic jobs when they promote a repo | 17:23 |
| larsks | trown: presumably we need to https://review.openstack.org/#/c/427802/ to merge, then, before it will have any impact? | 17:24 |
| trown | larsks: ya, it would need to merge, and then we would need to promote ... but that means we cant get real CI on the patch | 17:24 |
| larsks | Yay! EmilienM ^^^^^ | 17:24 |
| *** dtantsur is now known as dtantsur|afk | 17:25 | |
| larsks | trown: I am at a loss on what to do here. | 17:25 |
| beekneemech | trown: larsks: You can get CI on the patch by adding a depends-on in a patch to a repo involved in image building (tripleo-common, tripleoclient, any of the elements projects). | 17:25 |
| beekneemech | Those jobs don't use cached images. | 17:25 |
| trown | beekneemech: that could work... but then if we merge this opstools patch the multinode scenario001 will fail until we promote anywhere we dont build images | 17:26 |
| beekneemech | Strictly speaking tripleo-ci probably shouldn't either, but those jobs already eat up a huge amount of our capacity so I ignore it. | 17:26 |
| beekneemech | trown: multinode doesn't use images at all. How would that matter? | 17:26 |
| larsks | beekneemech: taking a step back...if multinode isn't using images, then maybe I just need to fix my patch to tripleo.sh. | 17:27 |
| larsks | Do you have a second to look? | 17:27 |
| *** charliejllewelly has joined #tripleo | 17:27 | |
| charliejllewelly | Hey all...does anyone know if it is possible to use output from one resource in another in the same file? | 17:28 |
| trown | larsks: ah right... repo setup should take care of all you need for multinode, but the repo is not there http://logs.openstack.org/02/427802/5/check/gate-tripleo-ci-centos-7-nonha-multinode/1cf73de/logs/subnode-2/etc/yum.repos.d/ | 17:28 |
| trown | larsks: oh... wait that is not scenario001 | 17:29 |
| larsks | trown: this goes back to my initial question: we have some code that's in the overcloud_images function. Should that just be moved? | 17:29 |
| larsks | trown: @ line 546 | 17:30 |
| *** cdearborn has joined #tripleo | 17:30 | |
| beekneemech | Are we sure the variable is getting set correctly? | 17:30 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool https://review.openstack.org/423340 | 17:30 |
| trown | larsks: no that is needed in all cases, it does not help you though | 17:30 |
| beekneemech | The tripleo.sh change looks right to me. | 17:30 |
| *** derekh has quit IRC | 17:30 | |
| trown | beekneemech: larsks ya I think the tripleo.sh patch looks right, but we need to actually run the scenario001 job to test it | 17:31 |
| larsks | beekneemech: trown: we are! And it's failing. | 17:31 |
| *** jkilpatr_ has joined #tripleo | 17:31 | |
| trown | that is the only case where the code in that patch is turned on | 17:31 |
| larsks | http://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/a7b4100/console.html | 17:31 |
| larsks | You can see that's using the patched toci_gate_test.sh script, e.g., at http://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/a7b4100/console.html#_2017-02-03_14_53_48_284336 | 17:31 |
| trown | ok, the repo isnt showing up on the subnode... http://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/a7b4100/logs/subnode-2/etc/yum.repos.d/ | 17:32 |
| larsks | ...but it doesn't result in the centos-opstools repository getting enabled. | 17:32 |
| trown | so something is not working | 17:32 |
| larsks | trown: right, hence my questions :) | 17:32 |
| trown | :) | 17:32 |
| *** jkilpatr has quit IRC | 17:32 | |
| beekneemech | Oh wait. | 17:32 |
| beekneemech | That variable isn't getting added to deploy.env. | 17:32 |
| beekneemech | larsks: trown: ^ | 17:32 |
| beekneemech | So it won't show up on the subnode at all. | 17:32 |
| trown | ah, that is it ^ | 17:32 |
| larsks | which variable where? | 17:33 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker keystone service https://review.openstack.org/416605 | 17:33 |
| beekneemech | larsks: The enable opstools variable needs to be added to http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n317 | 17:33 |
| larsks | beekneemech: awesome. Let me give that a shot. | 17:34 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs https://review.openstack.org/427802 | 17:34 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/newton: net-config-multinode: make controlplane int idempotent https://review.openstack.org/428828 | 17:34 |
| *** trown is now known as trown|lunch | 17:35 | |
| larsks | trown|lunch: thanks! | 17:36 |
| *** lucasagomes is now known as lucas-afk | 17:36 | |
| *** flepied has joined #tripleo | 17:37 | |
| *** shardy has quit IRC | 17:38 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration. https://review.openstack.org/428093 | 17:41 |
| *** [1]cdearborn has quit IRC | 17:41 | |
| EmilienM | jaosorior: https://review.openstack.org/#/c/428785/ is ready for review | 17:42 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration. https://review.openstack.org/428093 | 17:42 |
| EmilienM | jaosorior: oh wait no | 17:43 |
| *** ccamacho has quit IRC | 17:43 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428785 | 17:43 |
| EmilienM | jaosorior: I forgot to remove the upgrade bits | 17:43 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Add html-webpack-plugin dependency https://review.openstack.org/428149 | 17:44 |
| *** gbarros has quit IRC | 17:44 | |
| EmilienM | panda|bbl, sshnaidm|off, weshay, bkero: can you please review https://review.openstack.org/#/c/428476/ from a oooq point of view? | 17:44 |
| *** dprince has quit IRC | 17:50 | |
| *** jmelvin has quit IRC | 17:50 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache https://review.openstack.org/428783 | 17:50 |
| *** nrado has joined #tripleo | 17:53 | |
| *** yamahata has quit IRC | 17:53 | |
| *** gbarros has joined #tripleo | 17:54 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Remove dist/ directory https://review.openstack.org/428156 | 17:54 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Add html-webpack-plugin dependency https://review.openstack.org/428149 | 17:54 |
| bkero | EmilienM: I think debug might have gotten disabled for multinode oooq jobs. Someone had the opinion that it made the log unreadable | 17:54 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: nova: disable API in WSGI by default https://review.openstack.org/428807 | 17:55 |
| EmilienM | bkero: that's what our users want | 17:55 |
| EmilienM | to have more debug | 17:55 |
| *** EmilienM has quit IRC | 17:56 | |
| *** dr_gogeta86 has quit IRC | 17:56 | |
| *** rodrigods has quit IRC | 17:56 | |
| *** gmann has quit IRC | 17:56 | |
| *** Nakato has quit IRC | 17:56 | |
| *** matbu has quit IRC | 17:56 | |
| *** bandini has quit IRC | 17:56 | |
| *** r2bit has quit IRC | 17:56 | |
| *** george_goh has quit IRC | 17:56 | |
| *** chandankumar has quit IRC | 17:56 | |
| *** dr_gogeta86 has joined #tripleo | 17:56 | |
| *** dr_gogeta86 has quit IRC | 17:56 | |
| *** dr_gogeta86 has joined #tripleo | 17:56 | |
| *** rodrigods has joined #tripleo | 17:56 | |
| *** r2bit has joined #tripleo | 17:56 | |
| *** andreaf has quit IRC | 17:56 | |
| *** jmiu has quit IRC | 17:56 | |
| *** matbu has joined #tripleo | 17:56 | |
| *** mjblack has quit IRC | 17:56 | |
| *** cinerama has quit IRC | 17:56 | |
| *** shadower has quit IRC | 17:56 | |
| *** lyarwood has quit IRC | 17:56 | |
| *** dmsimard has quit IRC | 17:56 | |
| *** lyarwood has joined #tripleo | 17:56 | |
| *** jmiu has joined #tripleo | 17:56 | |
| *** chandankumar has joined #tripleo | 17:56 | |
| bkero | okay | 17:56 |
| *** EmilienM has joined #tripleo | 17:56 | |
| *** cinerama has joined #tripleo | 17:56 | |
| *** shadower has joined #tripleo | 17:56 | |
| *** dmsimard has joined #tripleo | 17:57 | |
| bkero | EmilienM: Oh, right. I was thinking ansible debug, which is nasty. Definitely +1 on THT/overcloud deploy debug | 17:57 |
| *** gmann has joined #tripleo | 17:57 | |
| *** Nakato has joined #tripleo | 17:57 | |
| *** george_goh has joined #tripleo | 17:57 | |
| *** mjblack has joined #tripleo | 17:57 | |
| *** bandini has joined #tripleo | 17:58 | |
| *** andreaf has joined #tripleo | 17:58 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Add html-webpack-plugin dependency https://review.openstack.org/428149 | 18:02 |
| *** Vijayendra has joined #tripleo | 18:03 | |
| openstackgerrit | Rajini Ram proposed openstack/tripleo-heat-templates master: Composable services support for Cinder Dell EMC PS Series https://review.openstack.org/425861 | 18:03 |
| openstackgerrit | Ricardo Noriega proposed openstack/puppet-tripleo master: Add support for BGPVPN service plugin https://review.openstack.org/427669 | 18:04 |
| *** yprokule has quit IRC | 18:04 | |
| openstackgerrit | Rajini Ram proposed openstack/tripleo-heat-templates master: Composable service support for Cinder Dell EMC Storage Center https://review.openstack.org/425866 | 18:04 |
| weshay | EmilienM, it's not everyday I get to -1 your patches :) | 18:05 |
| EmilienM | weshay: :-O | 18:07 |
| bkero | hehe bnemec just +2d him saying the same thing | 18:07 |
| *** sudipto has quit IRC | 18:07 | |
| *** sudipto_ has quit IRC | 18:07 | |
| EmilienM | I'll change it | 18:07 |
| EmilienM | you guys are rude | 18:08 |
| EmilienM | lol | 18:08 |
| weshay | lolz | 18:08 |
| openstackgerrit | Rajini Ram proposed openstack/tripleo-heat-templates master: Composable service support for Cinder Dell EMC Storage Center https://review.openstack.org/425866 | 18:08 |
| EmilienM | joking | 18:08 |
| EmilienM | more seriously, weshay: https://github.com/openstack/tripleo-heat-templates/commits/master/environments/debug.yaml is not in stable/newton and stable/mitaka | 18:08 |
| EmilienM | not a big deal I guess | 18:08 |
| openstackgerrit | Rajini Ram proposed openstack/tripleo-heat-templates master: Composable services support for Cinder Dell EMC PS Series https://review.openstack.org/425861 | 18:09 |
| EmilienM | weshay: commented | 18:09 |
| *** salmankhan has quit IRC | 18:10 | |
| *** fzdarsky is now known as fzdarsky|afk | 18:10 | |
| weshay | ah I see | 18:11 |
| openstackgerrit | Alex Schultz proposed openstack/instack-undercloud master: Increase sync timeout for nova db syncs https://review.openstack.org/428843 | 18:11 |
| openstackgerrit | Dan Radez proposed openstack/tripleo-heat-templates master: adding Congress Support https://review.openstack.org/330050 | 18:12 |
| openstackgerrit | Rajini Ram proposed openstack/tripleo-heat-templates master: Enables support for configuring Cinder with Dell EMC ScaleIO storage backend. https://review.openstack.org/422238 | 18:12 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Disable puppet on upgrade for roles not upgrading https://review.openstack.org/424905 | 18:13 |
| *** flepied has quit IRC | 18:15 | |
| *** priley has joined #tripleo | 18:15 | |
| *** priley has quit IRC | 18:15 | |
| *** flepied has joined #tripleo | 18:17 | |
| openstackgerrit | Merged openstack/instack-undercloud stable/newton: export OS_BAREMETAL_API_VERSION in stackrc https://review.openstack.org/428756 | 18:17 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Revert "Revert "set innodb_file_per_table to ON for MySQL / Galera"" https://review.openstack.org/428846 | 18:18 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Revert "Revert "set innodb_file_per_table to ON for MySQL / Galera"" https://review.openstack.org/428846 | 18:19 |
| mwhahaha | gotta love those revert reverts | 18:19 |
| *** dprince has joined #tripleo | 18:20 | |
| *** florianf has quit IRC | 18:21 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/newton: Backport new environment for debug https://review.openstack.org/428848 | 18:21 |
| *** akuznetsov has joined #tripleo | 18:22 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration. https://review.openstack.org/428093 | 18:22 |
| dtrainor | haha | 18:23 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/mitaka: Backport new environment for debug https://review.openstack.org/428849 | 18:23 |
| weshay | EmilienM, ok.. backported it | 18:25 |
| EmilienM | weshay: you didn't git cherry-pick ... | 18:25 |
| EmilienM | weshay: you have a nice button in Gerrit | 18:25 |
| EmilienM | please use it | 18:26 |
| weshay | ah crud | 18:26 |
| weshay | k.. | 18:26 |
| *** akuznetsov has quit IRC | 18:26 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Make network-isolation environment rendered for all roles https://review.openstack.org/409920 | 18:28 |
| jrist | <3 | 18:29 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/newton: Add new environment for debug https://review.openstack.org/428848 | 18:31 |
| *** priley has joined #tripleo | 18:31 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: net-config-multinode: make controlplane int idempotent https://review.openstack.org/428747 | 18:33 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates stable/mitaka: Add new environment for debug https://review.openstack.org/428849 | 18:34 |
| *** yamahata has joined #tripleo | 18:34 | |
| weshay | EmilienM, :P | 18:34 |
| weshay | yolanda, so to follow back up.. do you have your own general_configs that you use for nfv deployments? | 18:35 |
| weshay | there has to be some diff | 18:35 |
| *** jcoufal_ has joined #tripleo | 18:35 | |
| EmilienM | weshay: thx sir | 18:36 |
| *** nrado has quit IRC | 18:38 | |
| *** chlong has joined #tripleo | 18:38 | |
| *** tesseract has quit IRC | 18:38 | |
| *** jcoufal has quit IRC | 18:38 | |
| *** priley1 has joined #tripleo | 18:42 | |
| *** priley has quit IRC | 18:42 | |
| *** prateek_ has joined #tripleo | 18:42 | |
| *** prateek has joined #tripleo | 18:42 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras master: Add optional Sphinx build verification https://review.openstack.org/425868 | 18:43 |
| *** jmelvin has joined #tripleo | 18:43 | |
| *** Goneri has quit IRC | 18:43 | |
| jaosorior | beekneemech: do you know where the os-collect-config logs are in the overcloud nodes? | 18:44 |
| jaosorior | beekneemech: oh, I'm also seeing this in the logs: | 18:46 |
| beekneemech | jaosorior: I just look in /var/log/messages. | 18:46 |
| beekneemech | It's in the journal file too if you download it, but that's a PITA. | 18:46 |
| *** priley1 has quit IRC | 18:46 | |
| jaosorior | Job os-collect-config.service/start deleted to break ordering cycle starting with multi-user.target/start | 18:46 |
| * beekneemech impotently shakes his fist at monolithic blob log files | 18:46 | |
| jaosorior | beekneemech: Thing is, I see the NetworkDeployment of all the nodes in the overcloud stall, and I'm trying to figure out why :/ | 18:47 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs https://review.openstack.org/427802 | 18:47 |
| beekneemech | jaosorior: Hmm, sounds like something is wrong with the os-collect-config service file. | 18:47 |
| jaosorior | beekneemech: where can I check that? | 18:48 |
| *** trown|lunch is now known as trown | 18:48 | |
| beekneemech | jaosorior: I think service files are shipped as part of the package. | 18:49 |
| jaosorior | beekneemech: actually, we're updating cloud-init in these images | 18:49 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add composable deployment config files and mixed release https://review.openstack.org/410831 | 18:52 |
| beekneemech | jaosorior: You lost me. What does that have to do with occ? | 18:52 |
| jaosorior | beekneemech: nothing, but it does depend on the multi-user.target/start | 18:53 |
| beekneemech | jaosorior: Oh, so maybe new cloud-init created a cycle? | 18:53 |
| jaosorior | right | 18:54 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs https://review.openstack.org/427468 | 18:55 |
| *** gfidente is now known as gfidente|afk | 18:56 | |
| jaosorior | beekneemech: these are the errors I see in the log http://paste.openstack.org/show/597607/ | 18:56 |
| *** sdake has joined #tripleo | 18:56 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart master: Ensure gate jobs verify sphinx output https://review.openstack.org/425936 | 18:58 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras master: Fix overcloud-scale failure msg and regression https://review.openstack.org/425352 | 19:02 |
| jaosorior | beekneemech: hey dude, got a running system? | 19:03 |
| *** pkovar has quit IRC | 19:04 | |
| beekneemech | jaosorior: Several. | 19:05 |
| jaosorior | beekneemech: could you get the output of the cloud-* service files? I wanna compare it with this one http://paste.openstack.org/show/597609/ (that's the failing system) | 19:06 |
| beekneemech | jaosorior: http://paste.openstack.org/show/597610/ | 19:08 |
| *** flepied has quit IRC | 19:09 | |
| *** chlong has quit IRC | 19:11 | |
| jidar | is there any way to do baremetal provision as part of a tripleO overcloud deployment? Like have all of the heat resources available to a template for a straight up baremetal node? I want to add some other services to my cloud as part of provision | 19:14 |
| *** ansmith has quit IRC | 19:15 | |
| *** nrado has joined #tripleo | 19:16 | |
| *** jkilpatr_ has quit IRC | 19:18 | |
| *** jkilpatr has joined #tripleo | 19:20 | |
| EmilienM | any review on https://review.openstack.org/#/q/topic:bug/1661360+status:open+owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22 would be welcome, thanks | 19:20 |
| EmilienM | owalsh: please ping me when you around, it seems like we have a nova/ironic problem with the tripleo common patch you did | 19:20 |
| *** Vijayendra has quit IRC | 19:21 | |
| *** chlong has joined #tripleo | 19:21 | |
| *** pblaho has quit IRC | 19:23 | |
| *** milan has quit IRC | 19:23 | |
| EmilienM | beekneemech: do you mind looking https://review.openstack.org/#/c/428828/ please? | 19:24 |
| *** chlong has quit IRC | 19:27 | |
| *** prateek_ has quit IRC | 19:33 | |
| *** prateek has quit IRC | 19:33 | |
| yolanda | hi weshay so we have everything in https://github.com/redhat-nfvpe | 19:34 |
| yolanda | there is ansible-cira, that is the playbook that orchestrates everything, and then jenkins-jobs and job-configs, with the jobs and settings we use | 19:34 |
| yolanda | the most relevant thing, is that we have OSP deploys relying on subscriptions, not on internal RedHat VPN | 19:35 |
| weshay | very cool | 19:35 |
| * weshay looking | 19:35 | |
| yolanda | the OSP deploys are still a bit wip... i'm working on the repos and image local sync | 19:36 |
| yolanda | weshay, btw, i was hitting this error on a server today: /sys/module/kvm_intel/parameters/nested: No such file or directory | 19:37 |
| yolanda | do you know what can be going on? | 19:37 |
| *** jcoufal_ has quit IRC | 19:37 | |
| *** jcoufal has joined #tripleo | 19:37 | |
| weshay | yolanda, hrm.. haven't seen any errors like that, trown have you? ^ | 19:38 |
| *** b00tcat has joined #tripleo | 19:38 | |
| *** gbarros has quit IRC | 19:39 | |
| yolanda | i'm thinking in maybe virtualization not being enabled | 19:40 |
| weshay | yolanda, send us more details if you have them | 19:40 |
| *** chlong has joined #tripleo | 19:40 | |
| yolanda | i cannot modprobe kvm or intel, says is not supported | 19:40 |
| trown | seem likely to be here https://github.com/openstack/tripleo-quickstart/blob/5d751760ab868a72b8efc27a62fd21b2612b6e01/roles/parts/kvm/tasks/main.yml#L33 | 19:41 |
| yolanda | i'm trying to reboot and see bios | 19:41 |
| trown | maybe that should only run if the cpu has nested support | 19:42 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: [overcloud-ssl] fix library to work with ocata https://review.openstack.org/428726 | 19:42 |
| *** charliejllewelly has quit IRC | 19:43 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs https://review.openstack.org/427468 | 19:44 |
| openstackgerrit | Dan Trainor proposed openstack/puppet-tripleo master: Proxy API endpoints that UI uses https://review.openstack.org/424909 | 19:45 |
| *** Vijayendra has joined #tripleo | 19:47 | |
| yolanda | weshay, trown , so i cannot find my server ipmi access, so hard to check... but modprobe is not working, that's what i can tell | 19:49 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo master: Revert "Revert "set innodb_file_per_table to ON for MySQL / Galera"" https://review.openstack.org/428846 | 19:50 |
| *** jcoufal has quit IRC | 19:53 | |
| *** jcoufal has joined #tripleo | 19:53 | |
| EmilienM | beekneemech: I see a lot of timeouts: http://logs.openstack.org/49/428349/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/8dda071/console.html#_2017-02-03_19_32_27_130512 | 19:54 |
| *** iranzo has quit IRC | 20:00 | |
| *** gbarros has joined #tripleo | 20:00 | |
| beekneemech | EmilienM: jaosorior was talking about an issue with os-collect-config earlier that might be related. | 20:01 |
| *** gbarros has quit IRC | 20:02 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 20:05 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker_puppet_tasks initialization on primary node https://review.openstack.org/426565 | 20:05 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Containerized Swift Services. https://review.openstack.org/425434 | 20:05 |
| *** gbarros has joined #tripleo | 20:05 | |
| *** jcoufal has quit IRC | 20:06 | |
| *** jcoufal has joined #tripleo | 20:06 | |
| *** gbarros has quit IRC | 20:07 | |
| *** flepied has joined #tripleo | 20:08 | |
| EmilienM | beekneemech, jaosorior: have we some WIP? any bug reported? | 20:08 |
| *** amoralej is now known as amoralej|off | 20:08 | |
| jaosorior | EmilienM, beekneemech what's up? | 20:10 |
| EmilienM | jaosorior: I see a lot of ovb jobs timing out | 20:11 |
| jaosorior | EmilienM: on what step? | 20:11 |
| jaosorior | EmilienM: was cloud-init updated? | 20:11 |
| EmilienM | jaosorior: http://logs.openstack.org/49/428349/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/8dda071/console.html#_2017-02-03_19_32_27_130512 | 20:11 |
| *** sasha21 has joined #tripleo | 20:11 | |
| EmilienM | might need help on this one, I'm already debugging another nova issue, blocking our release | 20:11 |
| sasha21 | Hi all, my undercloud deployment with quickstart fails with "Error: /Stage[main]/Neutron::Db::Sync/Exec[neutron-db-sync]/returns: change from notrun to 0 failed: neutron-db-manage upgrade heads returned 1 instead of one of" | 20:12 |
| sasha21 | trown: ^ known issue? | 20:12 |
| weshay | sasha21, lot's talk about that issue on list https://trello.com/c/CcMIA0LB/54-cix-nova-rdophase2-uc-install-fails-during-nova-db-sync | 20:12 |
| jaosorior | EmilienM: I'm not sure if it's related, here the node is actually created, but running any software config times out cause os-collect-config fails to start | 20:13 |
| beekneemech | jaosorior: That's pretty much exactly what I'm seeing the ci jobs. | 20:13 |
| beekneemech | The node is deployed, but then the deployment times out without running anything further. | 20:13 |
| jaosorior | oh | 20:14 |
| beekneemech | Let me check the package version. | 20:14 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Enable docker services in the registry https://review.openstack.org/421567 | 20:14 |
| *** gfidente|afk has quit IRC | 20:14 | |
| *** panda|bbl is now known as panda | 20:15 | |
| beekneemech | cloud-init-0.7.5-10.el7.centos.1.x86_64 | 20:15 |
| *** Vijayendra has quit IRC | 20:15 | |
| beekneemech | Hmm, that matches a job that passed though. | 20:15 |
| sasha21 | weshay: that's another issue | 20:17 |
| sasha21 | weshay: I filed the bz for the one in trello card | 20:17 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Add release notes for Ocata 2.0.0 https://review.openstack.org/429026 | 20:17 |
| sasha21 | weshay: the bz in the cards is for nova, while here it's neutron :) | 20:18 |
| trown | EmilienM: do you have the etherpad handy for ocata releasenote status tracking? | 20:18 |
| trown | finally got to putting something up for quickstart | 20:19 |
| EmilienM | trown: the only thing I have is https://docs.google.com/spreadsheets/d/1qsp528xrYtTt5s6kdHrLEhIqFekbV4IxAFkfjGozH74/edit#gid=0 | 20:19 |
| trown | EmilienM: awesome... that is why I couldnt find it :) it is not an etherpad | 20:19 |
| *** Goneri has joined #tripleo | 20:20 | |
| *** jprovazn has quit IRC | 20:21 | |
| *** dsneddon is now known as dsneddon_afk | 20:21 | |
| trown | EmilienM: should I mark tht as green? I followed https://review.openstack.org/#/c/424365/6 as an example, so seems like it is done | 20:21 |
| sasha21 | trown: are we aware of this error "Error: /Stage[main]/Neutron::Db::Sync/Exec[neutron-db-sync]/returns: change from notrun to 0 failed: neutron-db-manage upgrade heads returned 1 instead of one of" upon deploying undercloud? not related to the one in trello card | 20:22 |
| EmilienM | trown: is it merged? | 20:22 |
| trown | EmilienM: ya | 20:22 |
| *** jcoufal_ has joined #tripleo | 20:22 | |
| EmilienM | trown: GREEN ! | 20:23 |
| *** jcoufal has quit IRC | 20:23 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs https://review.openstack.org/427802 | 20:26 |
| jaosorior | beekneemech: Can you run this for getting the service files? so we get a similar output like in the original paste: tail -n +1 -- cloud-* | 20:26 |
| *** rajinir has quit IRC | 20:26 | |
| trown | sasha21: I have not seen that | 20:26 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs https://review.openstack.org/427802 | 20:27 |
| beekneemech | jaosorior: http://paste.openstack.org/show/597621/ | 20:29 |
| sasha21 | trown: ack, https://bugs.launchpad.net/tripleo/+bug/1661736 | 20:31 |
| openstack | Launchpad bug 1661736 in tripleo "Error: neutron-db-manage upgrade heads returned 1 instead of one of [0] during undercloud deployment" [Undecided,New] | 20:31 |
| jaosorior | beekneemech: so this is the difference with the cloud init version we tried it with https://www.diffchecker.com/eg4siAPT | 20:31 |
| jaosorior | beekneemech: red is the original | 20:31 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Add release notes for Ocata 2.0.0 https://review.openstack.org/429026 | 20:34 |
| jaosorior | beekneemech: oh, so cloud-init didn't change | 20:34 |
| jaosorior | well, crap | 20:34 |
| jaosorior | beekneemech: might this be an issue with os-collect-config then? | 20:35 |
| *** spredzy has quit IRC | 20:35 | |
| beekneemech | No, doesn't look like that's the problem here. | 20:35 |
| jaosorior | beekneemech: can you pass me the logs of a job that failed? | 20:35 |
| *** fzdarsky|afk has quit IRC | 20:35 | |
| *** b00tcat has quit IRC | 20:38 | |
| beekneemech | jaosorior: http://logs.openstack.org/39/427339/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/94f4204/logs/ | 20:38 |
| *** gbarros has joined #tripleo | 20:38 | |
| jaosorior | beekneemech: it's not the same issue. In this case os-collect-config did start | 20:39 |
| *** agurenko has joined #tripleo | 20:39 | |
| beekneemech | WTF? That job had epel enabled. | 20:40 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Add release notes for Ocata 2.0.0 https://review.openstack.org/429026 | 20:40 |
| *** sasha21 has quit IRC | 20:40 | |
| *** karimb has quit IRC | 20:42 | |
| *** karimb has joined #tripleo | 20:43 | |
| *** spredzy has joined #tripleo | 20:43 | |
| *** agurenko has quit IRC | 20:47 | |
| *** karimb has quit IRC | 20:48 | |
| jaosorior | beekneemech: so, what packages changed? | 20:49 |
| beekneemech | jaosorior: A lot. It almost looks like we used a stable/mitaka image in a master job. | 20:50 |
| beekneemech | jaosorior: https://www.diffchecker.com/7ZPJ9jVo | 20:51 |
| beekneemech | The openstack package versions are all way back. | 20:51 |
| openstackgerrit | Petr Kovar proposed openstack/tripleo-docs master: Fix all sphinx errors & warnings https://review.openstack.org/429038 | 20:51 |
| jaosorior | holy siht | 20:52 |
| jaosorior | *shit | 20:52 |
| EmilienM | what? | 20:52 |
| beekneemech | I don't understand. The patch is clearly against master. | 20:53 |
| jaosorior | beekneemech: so the openstack packages seem to be older actually | 20:53 |
| jaosorior | EmilienM: ^^ | 20:53 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: nova/api: more cleanup https://review.openstack.org/429039 | 20:54 |
| EmilienM | mwhahaha, jaosorior ^ fyi | 20:54 |
| EmilienM | beekneemech: everywhere or in one job? | 20:54 |
| *** dsneddon has joined #tripleo | 20:55 | |
| beekneemech | EmilienM: All of the timeout jobs I've looked at. | 20:55 |
| EmilienM | I checked multinode jobs and they are fine (I know they are not image based but at least something that works) | 20:55 |
| EmilienM | ovh-ha undercloud has ocata packages | 20:55 |
| EmilienM | overcloud too | 20:56 |
| beekneemech | Okay, it's only jobs using the cached image: https://review.openstack.org/#/c/428821/1 | 20:56 |
| EmilienM | beekneemech: in the link you gave, openstack-nova-api-15.0.0-0.20170203000238.f9d7b38.el7.centos.noarch | 20:56 |
| EmilienM | it's ocata | 20:56 |
| EmilienM | on the undercloud | 20:56 |
| beekneemech | The two where we rebuilt images passed, the one that uses cached images failed with a timeout. | 20:57 |
| EmilienM | openstack-nova-api-13.1.3-0.20170103124634.d726e0d.el7.centos.noarch | 20:57 |
| EmilienM | damn you're right | 20:57 |
| beekneemech | I'm wondering if the image I copied into the mirror server this morning was bad, but I can't imagine why we would have had any image that old there. | 20:59 |
| EmilienM | (I have no idea tbh) | 20:59 |
| beekneemech | Or the last promotion job uploaded a bad image somehow. | 20:59 |
| beekneemech | Hmm, that could be it. The first instance of this failure that I can find is about 2.5 hours after I fiddled with the mirror server. | 21:01 |
| beekneemech | Huh? http://paste.openstack.org/show/597626/ | 21:04 |
| beekneemech | What promotion job would have run a combination of mitaka and ocata jobs? | 21:04 |
| beekneemech | That's the problem though. This is the image I copied over this morning. | 21:04 |
| beekneemech | It should be fixed now. We had a promotion since then and that one appears to be right. | 21:05 |
| *** sdake has quit IRC | 21:06 | |
| EmilienM | beekneemech: sorry for the question, but what did you do on the mirror server this morning? | 21:10 |
| beekneemech | EmilienM: I copied a previously cached overcloud-full image into the current-tripleo directory because the server's disk had filled up so we lost the one from the last promotion. | 21:11 |
| *** eck` is now known as jeckersb_gone | 21:11 | |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Deploy the undercloud with Heat https://review.openstack.org/351351 | 21:12 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Add heat_launcher module to help launch heat-all https://review.openstack.org/427530 | 21:12 |
| openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Add fake_keystone class https://review.openstack.org/427531 | 21:12 |
| beekneemech | Apparently we had run a promotion job that wasn't against master though, and that was the most recent image I found. | 21:12 |
| EmilienM | beekneemech: I see | 21:14 |
| EmilienM | beekneemech: do we have rotations? | 21:14 |
| EmilienM | to cleanup automatically | 21:14 |
| bkero | EmilienM: If you have some time, I'm encountering this error in the scenario multinode-oooq jobs, and I'm not sure why. http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/postci.txt.gz#_2017-02-03_20_34_10_000 | 21:16 |
| jaosorior | bkero: ceph::profile::params::client_keys in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/nova/compute/libvirt.pp:36:22 | 21:19 |
| jaosorior | :/ | 21:19 |
| EmilienM | Error: Evaluation Error: Error while evaluating a Function Call, Could not find data item ceph::profile::params::client_keys in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/nova/compute/libvirt.pp:36:22 on node centos-7-2-node-osic-cloud1-disk-7108731-411498[0m | 21:20 |
| EmilienM | 2017-02-03 20:34:10.000 | +(./..//tripleo-ci/scripts/common_functions.sh:189): postci(): eval sudo journalctl --ou | 21:20 |
| jaosorior | bkero: so one of this $rbd_ephemeral_storage or $rbd_persistent_storage is evaluating to true, and in that case, you need that hiera key to be avialable | 21:21 |
| bkero | I wonder why that is the case, I'm not touching puppet params at all | 21:21 |
| jaosorior | bkero: what's the change? | 21:21 |
| *** jayg is now known as jayg|g0n3 | 21:21 | |
| jaosorior | bkero: and is the deployment supposed deploy rbd persistent storage? | 21:21 |
| bkero | jaosorior: just adding -e scenario001-multinode.yml to the tripleo-quickstart multinode job. https://review.openstack.org/#/c/427468/ | 21:22 |
| bkero | EmilienM: Yeah, I saw the error before. I'm just having a hard time figuring out why it popped up when I started testing scenario001, and why I can't replicate with tripleo-quickstart outside a multinode environment. | 21:23 |
| beekneemech | EmilienM: Not that I know of, and at this point I'm kind of afraid to try to write one since I clearly don't understand all the ways this server is being used. | 21:23 |
| *** rwsu has joined #tripleo | 21:23 | |
| EmilienM | beekneemech: can I have a review on https://review.openstack.org/#/c/428778/2 please | 21:23 |
| EmilienM | I want to land it over the week end | 21:23 |
| bkero | Line 77 of scenario001-multinode.yaml contains CephClientKey: 'AQC+vYNXgDAgAhAAc8UoYt+OTz5uhV7ItLdwUw==' | 21:23 |
| EmilienM | I figured it will help us to promote nova in our CI | 21:24 |
| bkero | jaosorior: Should that ^ end up in hiera for use with the modules? | 21:24 |
| EmilienM | beekneemech: same for https://review.openstack.org/#/c/428785/ | 21:24 |
| jaosorior | bkero: right, but does that end up in the hiera key? | 21:24 |
| jaosorior | bkero: no idea, I haven't touched the ceph bits :/ | 21:24 |
| bkero | Neither have I | 21:24 |
| jaosorior | bkero: can you check the resulting hiera? | 21:25 |
| bkero | jaosorior: Do you know that's stored in job logs somewhere? | 21:25 |
| jaosorior | bkero: /etc/puppet/hieradata/service_config.yaml | 21:25 |
| bkero | http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/etc/puppet/hieradata/ | 21:26 |
| jaosorior | bkero: that's the undercloud | 21:26 |
| bkero | http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/oooq/collected_logs/subnode-1/etc/puppet/hieradata/service_configs.json.txt.gz | 21:26 |
| bkero | I don't actually see a ceph:: section in there | 21:27 |
| jaosorior | bkero: so, seems that ceph isn't being deployed | 21:27 |
| jaosorior | and that's the issue | 21:27 |
| bkero | You mean that the ceph config bits in the heat templates aren't getting entered into the heira data? | 21:28 |
| *** gbarros has quit IRC | 21:28 | |
| jaosorior | bkero: this is what's being deployed http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/oooq/collected_logs/subnode-1/etc/puppet/hieradata/service_names.json.txt.gz | 21:28 |
| *** gbarros has joined #tripleo | 21:28 | |
| jaosorior | bkero: nothing ceph-related seems to be deployed | 21:28 |
| jaosorior | bkero: I think that job is not using the needed environment that sets the services to be deployed, and it goes for the defaults | 21:29 |
| jaosorior | not sure | 21:29 |
| bkero | OS::TripleO::Services::CephClient is in the heat template | 21:29 |
| jaosorior | bkero: where is it? | 21:30 |
| jaosorior | bkero: and are you sure that's being taken into account? | 21:30 |
| jaosorior | the list sure doesn't show it | 21:30 |
| bkero | jaosorior: This is a passing job using the same heat template: http://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/f0e8afb/console.html#_2017-02-03_19_19_53_582742 | 21:30 |
| bkero | jaosorior: and here is the overcloud deploy of the failing job: http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/oooq/collected_logs/undercloud/home/jenkins/overcloud-deploy.sh | 21:30 |
| jaosorior | bkero: they are using different environments | 21:32 |
| jaosorior | the passing one is using /usr/share/openstack-tripleo-heat-templates/ci/environments/scenario001-multinode.yaml | 21:32 |
| jaosorior | the failing one is using this one /usr/share/openstack-tripleo-heat-templates/ci/environments/multinode.yaml | 21:32 |
| bkero | jaosorior: Oh I see. The non-scenario template isn't used in scenario tests. | 21:33 |
| jaosorior | bkero: yep, and that's the issue | 21:33 |
| *** spredzy has quit IRC | 21:33 | |
| jaosorior | bkero: oh crap | 21:34 |
| jaosorior | nevermind | 21:34 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs https://review.openstack.org/427468 | 21:34 |
| bkero | ? | 21:34 |
| jaosorior | bkero: I misread | 21:34 |
| jaosorior | both are using the scenario001 template | 21:34 |
| jaosorior | I mean | 21:34 |
| jaosorior | environment | 21:34 |
| jaosorior | damn | 21:34 |
| jaosorior | now I'm puzzled | 21:34 |
| bkero | The working job sitll doesn't include /usr/share/openstack-tripleo-heat-templates/ci/environments/multinode.yaml | 21:35 |
| jaosorior | true that | 21:35 |
| bkero | and the ordering is different | 21:35 |
| bkero | That could affect things with overrides I imagine | 21:35 |
| jaosorior | bkero: well, ideally stuff shouldn't be overlapping | 21:36 |
| *** liverpooler has quit IRC | 21:36 | |
| bkero | That would be ideal | 21:36 |
| *** spredzy has joined #tripleo | 21:37 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Configure VNC Server listen address through t-h-t https://review.openstack.org/427908 | 21:40 |
| *** bfournie has quit IRC | 21:41 | |
| openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates master: Use an OS::Heat::Value resource inside EndpointMap https://review.openstack.org/427915 | 21:41 |
| openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates master: Don't recalculate EndpointMap to get outputs https://review.openstack.org/427836 | 21:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Simplify/fix config enabled conditions for upgrades https://review.openstack.org/428309 | 21:41 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: net-config-multinode: make controlplane int idempotent https://review.openstack.org/428828 | 21:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Reduce number of steps for upgrades https://review.openstack.org/428310 | 21:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Disable batch upgrade deployments for disabled roles https://review.openstack.org/428348 | 21:42 |
| *** chlong has quit IRC | 21:44 | |
| openstackgerrit | Matt Young proposed openstack/tripleo-quickstart-extras master: virthost-full-cleanup: Fix typo in README.md https://review.openstack.org/429055 | 21:44 |
| owalsh | EmilienM: hey, what's up | 21:45 |
| EmilienM | owalsh: brb 1 min | 21:45 |
| *** ebarrera has joined #tripleo | 21:50 | |
| *** ebarrera has quit IRC | 21:50 | |
| EmilienM | beekneemech: I'm cleaning up in https://review.openstack.org/#/c/429039/1 | 21:51 |
| openstackgerrit | Merged openstack/tripleo-docs master: Fix a TBD, broken links and markup https://review.openstack.org/428333 | 21:52 |
| *** jcoufal has joined #tripleo | 21:53 | |
| beekneemech | EmilienM: Ack, thanks. Didn't see that. | 21:53 |
| * beekneemech wants it to be the weekend already | 21:53 | |
| EmilienM | beekneemech: ahah me too | 21:53 |
| EmilienM | beekneemech: and not think about nova | 21:54 |
| EmilienM | oops osrry | 21:54 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: nova/api: more cleanup https://review.openstack.org/429039 | 21:54 |
| *** jcoufal_ has quit IRC | 21:54 | |
| EmilienM | owalsh: ok back | 21:55 |
| EmilienM | owalsh: so we decided to revert the change in tripleo that switched nova to be deployed in WSGI with Apache | 21:55 |
| EmilienM | owalsh: because Nova team doesn't support it | 21:56 |
| EmilienM | they say it's experimental | 21:56 |
| owalsh | EmilienM: yea... | 21:56 |
| EmilienM | I've been testing tripleo without nova/wsgi + nova from trunk (like master) and it pass on multinode job: https://review.openstack.org/#/c/429008/ | 21:56 |
| EmilienM | it's waiting for OVB job now | 21:56 |
| EmilienM | but I saw some ironic failures this morning | 21:56 |
| EmilienM | let me find logs | 21:56 |
| EmilienM | owalsh: and nova team thought it could be related to the patch in tripleo-common | 21:57 |
| *** rlandy has quit IRC | 21:57 | |
| owalsh | EmilienM: err, really? how? | 21:58 |
| EmilienM | owalsh: http://logs.openstack.org/15/428415/1/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/92a342e/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-02-03_01_06_01_049 | 21:58 |
| EmilienM | see Total disk: 40 GB, used: 0.00 GB | 21:59 |
| EmilienM | and then Total disk: 40 GB, used: 40.00 GB | 21:59 |
| EmilienM | on http://logs.openstack.org/15/428415/1/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/92a342e/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-02-03_01_06_02_016 | 21:59 |
| EmilienM | I don't know if it has a relation with cells thing | 21:59 |
| EmilienM | but they think it's tripleo related | 21:59 |
| EmilienM | I might be wrong | 21:59 |
| owalsh | Still don't see the connection to running host discovery... | 22:01 |
| EmilienM | owalsh: I'm watching 429008 in zuul | 22:01 |
| EmilienM | owalsh: if OVB pass on it we can dance | 22:01 |
| EmilienM | it means that disabling Nova WSGI fixed out issues with nova trunk | 22:02 |
| EmilienM | owalsh: FYI right now we pin nova-ocata-3 | 22:02 |
| owalsh | EmilienM: ok... in my change mistral is polling nova until the ironic nodes are in the resource tracker | 22:05 |
| owalsh | EmilienM: but it's happening just after the state change to available... | 22:05 |
| *** jcoufal has quit IRC | 22:06 | |
| EmilienM | oh wait | 22:07 |
| EmilienM | see https://bugs.launchpad.net/nova/+bug/1341420 | 22:07 |
| openstack | Launchpad bug 1341420 in OpenStack Compute (nova) "gap between scheduler selection and claim causes spurious failures when the instance is the last one to fit" [Wishlist,New] - Assigned to Yingxin (cyx1231st) | 22:07 |
| EmilienM | sounds like ironic gate has similar thing | 22:07 |
| EmilienM | maybe it's something else, dunno | 22:08 |
| EmilienM | beekneemech: can we close https://bugs.launchpad.net/tripleo/+bug/1661656 ? | 22:08 |
| openstack | Launchpad bug 1661656 in tripleo "CI: promoted overcloud-full image is missing from the mirror" [Critical,Triaged] | 22:08 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios https://review.openstack.org/426370 | 22:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Switch to net-config-multinode https://review.openstack.org/426372 | 22:09 |
| *** jcoufal has joined #tripleo | 22:10 | |
| slagle | dtrainor: EmilienM : i've not seen any FFE request for https://blueprints.launchpad.net/tripleo/+spec/proxy-undercloud-api-services | 22:11 |
| slagle | did it happen? | 22:11 |
| slagle | was about to approve https://review.openstack.org/#/c/424903/ | 22:11 |
| slagle | but didn't want to get my hand slapped :) | 22:12 |
| EmilienM | slagle: I've granted it to dtrainor after a chat on IRC | 22:13 |
| EmilienM | I should have formalized it on openstack-dev, my fault | 22:13 |
| EmilienM | slagle: good question for tabs lol | 22:14 |
| slagle | i checked stackoverflow about puppet style | 22:14 |
| slagle | i dunno, they told me to get lost | 22:14 |
| *** karimb has joined #tripleo | 22:14 | |
| EmilienM | lol | 22:14 |
| EmilienM | dtrainor: there is a whitespace on https://review.openstack.org/#/c/424903/7/releasenotes/notes/add-additional-endpoints-96cb28a13c79e9d9.yaml | 22:14 |
| EmilienM | but I won't block it, approved | 22:15 |
| *** karimb has quit IRC | 22:17 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: Add optional Sphinx build verification https://review.openstack.org/425868 | 22:23 |
| *** dprince has quit IRC | 22:24 | |
| *** trown is now known as trown|outtypewww | 22:25 | |
| EmilienM | I'm off | 22:26 |
| *** nrado has left #tripleo | 22:26 | |
| bkero | o/ | 22:27 |
| jaosorior | have a good one | 22:27 |
| owalsh | EmilienM: have a good weekend | 22:28 |
| *** gbarros has quit IRC | 22:30 | |
| *** sdake has joined #tripleo | 22:31 | |
| *** sdake has quit IRC | 22:32 | |
| *** morazi has quit IRC | 22:33 | |
| *** sdake has joined #tripleo | 22:33 | |
| *** gbarros has joined #tripleo | 22:35 | |
| *** gbarros has quit IRC | 22:37 | |
| *** jcoufal has quit IRC | 22:39 | |
| *** owalsh is now known as owalsh-afk | 22:40 | |
| *** jcoufal has joined #tripleo | 22:40 | |
| *** flepied has quit IRC | 22:40 | |
| *** chlong has joined #tripleo | 22:42 | |
| *** cdearborn has quit IRC | 22:48 | |
| *** jcoufal has quit IRC | 22:50 | |
| *** jcoufal has joined #tripleo | 22:51 | |
| *** jkilpatr has quit IRC | 22:51 | |
| *** karimb has joined #tripleo | 22:52 | |
| *** jaosorior has quit IRC | 22:52 | |
| openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates master: Use an OS::Heat::Value resource inside EndpointMap https://review.openstack.org/427915 | 22:52 |
| openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates master: Don't recalculate EndpointMap to get outputs https://review.openstack.org/427836 | 22:52 |
| openstackgerrit | Merged openstack/instack-undercloud master: Stop setting deprecated enable_setting_ipmi_credentials option https://review.openstack.org/427202 | 22:55 |
| *** nrado has joined #tripleo | 22:57 | |
| *** nrado has left #tripleo | 22:59 | |
| *** jcoufal has quit IRC | 23:06 | |
| *** dsneddon has quit IRC | 23:07 | |
| dtrainor | EmilienM++ slagle++ thanks :) | 23:07 |
| dtrainor | i | 23:08 |
| dtrainor | i'll make a note to get that whitespace | 23:08 |
| dtrainor | slagle, re: tabs i couldn't find an answer either | 23:09 |
| dtrainor | puppet doesn't provide the tests, it's not a puppet manifest, so i'm not sure | 23:09 |
| *** jcoufal has joined #tripleo | 23:09 | |
| dtrainor | well no that's kind of a lie - i meant to say, i couldn't find anything on puppet tests that's critical either way of spaces | 23:10 |
| *** sdake has quit IRC | 23:11 | |
| *** dsneddon has joined #tripleo | 23:14 | |
| *** jmelvin has quit IRC | 23:17 | |
| jidar | lint is typically how you'd find white space | 23:17 |
| jidar | I believe anyhow | 23:17 |
| openstackgerrit | Merged openstack/instack-undercloud master: Add additional proxy and config endpoints for UI https://review.openstack.org/424903 | 23:17 |
| *** panda is now known as panda|Zz | 23:18 | |
| *** pmannidi has joined #tripleo | 23:20 | |
| *** jcoufal has quit IRC | 23:21 | |
| *** jcoufal has joined #tripleo | 23:21 | |
| *** jkilpatr has joined #tripleo | 23:25 | |
| *** pmannidi has quit IRC | 23:26 | |
| mwhahaha | generally no tabs. techincally it's not a lint issue, just a best practice | 23:27 |
| dtrainor | me too, but i saw no errors | 23:27 |
| dtrainor | right, i don't disagree | 23:27 |
| *** pmannidi has joined #tripleo | 23:29 | |
| *** gbarros has joined #tripleo | 23:30 | |
| *** pradk has quit IRC | 23:30 | |
| *** kbyrne has quit IRC | 23:32 | |
| jidar | > puppet-lint --no-trailing_whitespace-check path/to/file.pp | 23:33 |
| *** kbyrne has joined #tripleo | 23:34 | |
| *** saneax-_-|AFK is now known as saneax | 23:35 | |
| *** dbecker has quit IRC | 23:36 | |
| *** dsariel has quit IRC | 23:38 | |
| dtrainor | thx | 23:39 |
| dtrainor | i pulled the change down. vim doesn't see it, and even deleting all the whitespace in that line and replacing it with spaces, git doesn't see a change in the file | 23:41 |
| *** akrivoka has quit IRC | 23:43 | |
| *** gbarros has quit IRC | 23:44 | |
| *** karimb has quit IRC | 23:45 | |
| *** rbrady has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!