Monday, 2016-02-29

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077200:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)00:10
*** saneax is now known as saneax_AFK00:17
*** saneax_AFK is now known as saneax00:28
*** beekneemech has quit IRC00:29
*** bnemec has joined #tripleo00:31
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077201:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)01:10
mandrewhen installing the undercloud, do we support having a mix of puppet modules installed from source and from package?01:21
*** Marga_ has quit IRC01:21
*** Marga_ has joined #tripleo01:22
*** Marga__ has joined #tripleo01:22
*** Marga__ has quit IRC01:23
*** Marga_ has quit IRC01:23
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Use set -e for validation-scripts/all-nodes.sh  https://review.openstack.org/28585701:23
*** Marga_ has joined #tripleo01:23
mandreaccording to the doc all is needed is export DIB_INSTALLTYPE_puppet_xxx=source for the desired module, but in that case the module cannot be found in /etc/puppet/modules/01:23
*** Marga_ has quit IRC01:24
mandreit's missing symlinks from /opt/stack/puppet-modules/* to /etc/puppet/modules/01:25
*** Marga_ has joined #tripleo01:25
openstackgerritDan Prince proposed openstack/tripleo-puppet-elements: Add overcloud-base element  https://review.openstack.org/28585801:29
openstackgerritDan Prince proposed openstack-infra/tripleo-ci: Enable network isolation on all the jobs.  https://review.openstack.org/28567401:32
openstackgerritMartin AndrĂ© proposed openstack/tripleo-puppet-elements: Fix puppet modules in mixed src/pkg environments  https://review.openstack.org/28586001:38
mandre^ would appreciate a review, I'm not sure the issue is due to my environment or not01:39
*** Marga__ has joined #tripleo01:42
*** Marga_ has quit IRC01:46
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077202:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)02:10
*** rwsu has joined #tripleo02:12
*** rwsu has quit IRC02:12
*** rwsu has joined #tripleo02:25
*** trozet has joined #tripleo02:27
*** rhallisey has quit IRC02:33
*** Marga__ has quit IRC02:33
*** Marga_ has joined #tripleo02:33
*** dmacpher has joined #tripleo02:39
*** trozet has quit IRC02:39
*** saneax is now known as saneax_AFK02:40
*** rbrady has quit IRC02:45
*** julim has quit IRC03:07
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077203:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)03:10
*** links has joined #tripleo03:44
*** links has quit IRC04:01
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fix PATH when being run from unactivated venv  https://review.openstack.org/28587804:06
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077204:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)04:10
*** david-lyle has joined #tripleo04:13
*** links has joined #tripleo04:18
*** masco has joined #tripleo04:26
*** david-lyle has quit IRC04:36
openstackgerritgreghaynes proposed openstack/diskimage-builder: Prioritize venv python on hose  https://review.openstack.org/28588504:49
openstackgerritgreghaynes proposed openstack/diskimage-builder: Prioritize venv python on host  https://review.openstack.org/28588504:50
*** david-lyle has joined #tripleo04:50
*** saneax_AFK is now known as saneax04:51
*** david-lyle has quit IRC04:56
openstackgerritgreghaynes proposed openstack/diskimage-builder: Make debootstrap cache opt-in  https://review.openstack.org/28588605:03
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077205:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)05:10
*** yuanying has quit IRC05:24
*** yuanying_ has joined #tripleo05:24
openstackgerritIshant Tyagi proposed openstack/os-collect-config: Add insecure option to the cfn collector  https://review.openstack.org/28472505:26
openstackgerritMichael Chapman proposed openstack/tripleo-heat-templates: Adds OpenDaylight support  https://review.openstack.org/20025305:33
*** anande has joined #tripleo05:35
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077206:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)06:10
*** tserong has joined #tripleo06:14
*** tserong has joined #tripleo06:14
*** saneax is now known as saneax_AFK06:44
*** rcernin has joined #tripleo06:44
*** liverpooler has joined #tripleo06:44
*** ianw has quit IRC06:45
*** rcernin has quit IRC06:49
*** ianw has joined #tripleo06:50
*** jaosorior has joined #tripleo07:01
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077207:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)07:10
*** dshulyak has joined #tripleo07:17
*** rcernin has joined #tripleo07:24
openstackgerritMartin AndrĂ© proposed openstack/tripleo-specs: Spec for TripleO validations  https://review.openstack.org/25579207:25
*** hjensas has joined #tripleo07:43
*** pcaruana has joined #tripleo07:43
*** jprovazn has joined #tripleo07:44
*** saneax_AFK is now known as saneax07:48
*** hewbrocca has joined #tripleo07:49
*** gus has quit IRC07:50
*** gus has joined #tripleo07:52
*** leanderthal|afk is now known as leanderthal07:53
*** olap has quit IRC07:55
*** xinwu has quit IRC07:55
jaosoriormarios; Hey dude, if you get some time could you give this spec a read? https://review.openstack.org/#/c/282307/ There is some stuff I need to solidify (mostly regarding the renovation workflow) but getting more input would be appreciated08:02
mariosjaosorior: will do (added to list, if don't get to it today will do tomorrow review time)08:03
*** fgimenez has joined #tripleo08:05
jaosoriormarios: Thanks dude08:06
*** rdopiera has joined #tripleo08:06
*** jtomasek has joined #tripleo08:07
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077208:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)08:10
*** dmacpher has quit IRC08:11
*** xinwu has joined #tripleo08:15
*** aufi has joined #tripleo08:19
*** cmyster has quit IRC08:20
*** aufi has quit IRC08:24
*** ifarkas has joined #tripleo08:25
*** aufi has joined #tripleo08:28
*** rcernin has quit IRC08:29
*** olap has joined #tripleo08:34
*** rcernin has joined #tripleo08:37
*** olap has quit IRC08:39
*** cmyster has joined #tripleo08:40
*** olap has joined #tripleo08:41
*** mcornea has joined #tripleo08:44
*** d0ugal_ has quit IRC08:46
*** d0ugal has joined #tripleo08:46
*** Guest45202 is now known as panda08:53
*** ohamada has joined #tripleo08:53
openstackgerritLenny Verkhovsky proposed openstack/diskimage-builder: Get max retries for the interface from environment  https://review.openstack.org/28594208:55
*** paramite has joined #tripleo08:57
*** shardy has joined #tripleo09:03
*** mbound has joined #tripleo09:08
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077209:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)09:10
*** xinwu has quit IRC09:12
*** mcornea has quit IRC09:16
*** mcornea has joined #tripleo09:16
*** jistr has joined #tripleo09:20
*** derekh has joined #tripleo09:21
*** fgimenez has quit IRC09:22
*** patrickeast has quit IRC09:24
*** athomas has joined #tripleo09:24
*** akrivoka has joined #tripleo09:25
*** patrickeast has joined #tripleo09:25
*** fgimenez has joined #tripleo09:26
*** fgimenez has quit IRC09:26
*** fgimenez has joined #tripleo09:26
*** gfidente has joined #tripleo09:28
openstackgerritMerged openstack/tripleo-heat-templates: Enable notifications on the overcloud  https://review.openstack.org/24142109:29
*** mkovacik has joined #tripleo09:31
*** nico_auvv has joined #tripleo09:38
jistrmarios: good morning. your t-h-t patch is in the gate now09:39
mariosjistr: o/ thanks man, I just finished my main round of reviews and started looking at my outstanding things in review09:43
jistrmarios: was thinking about what slagle wrote here https://review.openstack.org/#/c/284722/  -- in theory operators can select the node names freely AFAIK, so perhaps detecting by node name isn't bulletproof. This circles back to what i think gfidente suggested some time ago -- perhaps we don't need to have any special detection to exclude controllers from that script. They should never contain the tripleo_upgrade_node.sh, so we can09:50
jistreffectively exclude them by checking+printing "upgrade script not found on this node". (Perhaps we could also rename the operator tool script to upgrade-node.sh.) I don't see any of this as a blocker though. The operators should only attempt to run the script on non-controller node types, and for this use case, nothing changes with the discussed things. (I don't think someone would name their compute nodes with "controller" in the hostname.)09:50
hewbroccaIf they do, they can keep both halves09:52
jistrmarios: ^ re rename -- that's just a nit too. I know i asked a rename before :) This is all just hazy corner cases. My 2 cents is that we should probably land what we have now.09:52
openstackgerritIshant Tyagi proposed openstack/tripleo-image-elements: Add insecure option for cfn in os-collect-config conf  https://review.openstack.org/28595709:53
mariosjistr: yeah ok, i can revisit that should be quick enough... but to be clear, in detecting and just exiting when the file doesn't exist, it doesn't really address slagle comment. I would have like to land this today and fixup. I think it makes more sense to fix the 'detect non controlelr bit' and then add the 'detect names from heat' as an enhancement09:54
*** olap has quit IRC09:54
*** olap has joined #tripleo09:54
jistrmarios: yup, agreed. So we just need someone else to add another +2 on that patch.09:54
* hewbrocca adds +209:55
mariosjistr: yeah probably gfidente will do once we implement the 'all nodes' since that was his main concern09:55
hewbroccaoh, wait...09:55
mariosjistr: but i will update in a bit09:55
marioshewbrocca: thanks :) you can always +1 things though09:56
marioshewbrocca: or -1 for that matter09:56
* hewbrocca +1s all the things09:56
*** chem has joined #tripleo09:59
gfidentejistr, marios morning10:00
jistrgfidente: good morning10:00
openstackgerritMerged openstack/tripleo-heat-templates: Write the compute upgrade script for tripleo major upgrade workflow  https://review.openstack.org/28314610:03
marioso/ gfidente10:07
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077210:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)10:10
mariosjistr: if we ignore the controller bit and we don't care what node. then we don't need to query heat at all10:10
jistrmarios: yeah, at least not for checking which nodes to prevent upgrading, since we wouldn't be preventing anything. Things would prevent themselves by not finding the script.10:12
mariosjistr: i guess it is enough that the operator will have to explicitly deliver the upgrade script with a follow on command10:16
*** dtantsur|afk is now known as dtantsur10:16
jistrmarios: yeah. but we're not expecting them to run anything on the controllers anyway, at the moment. So in the ideal case we don't expect any script delivery via the tripleo-common script. That's there just as a "plan B".10:17
* jistr likes having a plan B whenever possible10:18
*** tosky has joined #tripleo10:18
mariosjistr: right i meant from the angle of 'safety' like we don't want this run on controllers typically10:18
jistryea10:18
mariosjistr: 'it is enough'10:18
mariosjistr: https://github.com/marios/yum_update_non_heat/blob/master/tripleo_upgrade_non_heat_main.sh#L1910:19
mariosjistr: digital recycling10:19
mariosjistr: i didn't know where this was going to end up so just threw beta-1 on github10:20
mariosjistr: also had a post upgrade reboot there... :)10:21
mariosjistr: nyway, doing that is what makes me so resistant to this script doing any more/less than it needs to10:22
marios(like the stackrc check)... though agree gfidente you were right about the name/not checking controller10:23
marioswill make it simpler10:23
jistrmarios: ++, except the error message could be misleading from finding the root cause in some situation (could just change to "script cannot be found or has incorrect permissions"). Also given that we run it like "/bin/bash /root/$YUM_UPDATE_SCRIPT", the file actually doesn't need to be executable, so alternatively we don't have to check for it. I'm fine with it either way.10:24
mariosjistr: yeah yewah going to shape it to fit10:24
mariosi mean not going to blidnly copy/paste that10:24
*** mgould has joined #tripleo10:29
mariosjistr: sry +1 on the error message I see what you meant there10:29
marioswilll do10:29
*** olap has quit IRC10:38
*** olap has joined #tripleo10:40
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add mirror server  https://review.openstack.org/23841410:48
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Used the mirror server for the centos image and git repos  https://review.openstack.org/28525710:48
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use instack-qcow2 from cache if available and appropriate  https://review.openstack.org/28525910:48
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Upload the instack qcow image after periodic jobs  https://review.openstack.org/28525810:48
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978910:48
*** hewbrocca has quit IRC10:53
openstackgerritImre Farkas proposed openstack/python-tripleoclient: [WIP] Update baremetal ready state command  https://review.openstack.org/28597710:54
openstackgerritImre Farkas proposed openstack/python-tripleoclient: [WIP] Update baremetal ready state command  https://review.openstack.org/28597710:57
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077211:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)11:10
jaosoriorWhere can I get the logs for the puppet apply that's done when installing the undercloud?11:16
openstackgerritMarios Andreou proposed openstack/tripleo-common: Adds a bash script that operators will use during upgrades  https://review.openstack.org/28472211:16
jaosoriorWhile trying to deploy I've been getting an error in that phase but have been unable to find where the errors are dumped to :/11:17
jaosorior'puppet apply exited with exit code 6' ... and I haven't found any error in the run :/ pretty weird11:18
mariosjistr: gfidente v6 https://review.openstack.org/#/c/284722/6/scripts/upgrade-non-controller.sh (jistr: removed the permissions check alltogether)11:19
mariosjaosorior: did you try .instack/install-undercloud.log11:20
gfidentemarios, ack11:21
gfidenteguys, have you tried upgrading with https://review.openstack.org/#/c/210405/ ?11:21
jaosoriorAaaah now I find the error11:22
jaosoriorMistral install fails :/11:22
gfidenteI think the pcmk restart should make that work now11:22
gfidentemarios, jistr any chance you could try pulling it in when doing controller update?11:22
jaosoriorthanks marios11:24
gfidentemarios, should confirm_ exit if file is not found?11:27
dtantsurmorning folks! A trivial patch with 1x +2 for your consideration please: https://review.openstack.org/#/c/284762/11:27
dtantsurthis may finally end the painful story about nova-ironic race11:27
dtantsur(at least for vast majority of cases)11:27
mariosgfidente: we have set -e so exits in that case (file not found)11:28
dtantsuralso please another one profile matching patch: https://review.openstack.org/#/c/277974/ (gate passed, more than a week without reviews)11:29
gfidentemarios, ah right11:30
gfidenteso I think it's cool11:30
*** olap has quit IRC11:33
*** Guest22888 is now known as beagles11:33
*** mburned_` is now known as mburned11:34
*** olap has joined #tripleo11:34
*** liverpooler has quit IRC11:36
*** liverpooler has joined #tripleo11:37
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Write the compute upgrade script for tripleo major upgrade workflow  https://review.openstack.org/28598911:45
*** fgimenez has quit IRC11:49
*** fgimenez has joined #tripleo11:50
*** fgimenez has quit IRC11:50
*** fgimenez has joined #tripleo11:50
openstackgerritMerged openstack/instack-undercloud: Increase scheduler_max_attempts on undercloud and make it configurable  https://review.openstack.org/28476211:53
mariosjistr: you are already +2 here, green run from friday https://review.openstack.org/#/c/270110/ (won't merge anyway since has the "Add IPv6 Support to Isolated Networks" parent review)11:53
mariosjistr: (green run don't mean much here since we don't have net-isolation, never mind v6 at this piont so)11:54
*** marcusvrn_ has joined #tripleo11:55
jistrmarios: +A'd, but yeah, it won't merge just yet11:56
mariosjistr: thx11:56
mariosjistr: jistr hmm i see there is no stable/liberty for the v6 yet so can't cherrypick (there will be quite a few reviews in this state gfidente right?, i mean that have the main v6 review as parent)11:57
*** mburned is now known as mburned_out11:57
*** dshulyak has quit IRC11:58
*** olap has quit IRC12:03
*** olap has joined #tripleo12:05
*** lucasagomes is now known as lucas-hungry12:06
openstackgerritJavier Peña proposed openstack/tripleo-heat-templates: Bind Galera on a hostname for compat with IPv6 addresses  https://review.openstack.org/28599712:06
-openstackstatus- NOTICE: Infra currently has a long backlog. Please be patient and where possible avoid rechecks while it catches up.12:07
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077212:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)12:10
*** dshulyak has joined #tripleo12:12
gfidentemarios, yeah I'm trying to make netiso to pass12:15
gfidentemarios, so we can test the ipv6 changes on the netiso job12:15
gfidente(even though we'll be testing ipv4/netiso initially)12:15
gfidentemarios, https://review.openstack.org/#/c/273424/ should you find anything ... it seems to be timing out12:17
mariosgfidente: great!noted (likely tomorrow reviews)12:18
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Add Gentoo to the list of supported distributions  https://review.openstack.org/28196012:20
gfidentemarios, jistr, https://review.openstack.org/#/c/270831/6 this is pretty much same as the memcached fixup12:24
gfidentewhich just landed12:24
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud: Increase scheduler_max_attempts on undercloud and make it configurable  https://review.openstack.org/28600812:26
*** ohamada has quit IRC12:31
jistrmarios: do we want to `exit 1` if the script wasn't found there? https://review.openstack.org/#/c/284722/6/scripts/upgrade-non-controller.sh12:32
*** anande has quit IRC12:32
mariosjistr: we have set -e12:33
mariosjistr: so it fails,. seemed to work ok for me12:33
*** jaosorior has quit IRC12:33
jistrmarios: ah ok. +212:34
*** jaosorior has joined #tripleo12:34
*** tremble has joined #tripleo12:34
*** ohamada has joined #tripleo12:36
*** rhallisey has joined #tripleo12:36
mariosjistr: thx12:44
mariosjistr: if we need a recheck I'll remove the results var12:47
jistrmarios: ack, thx12:47
*** pcaruana has quit IRC12:53
*** mbound has quit IRC12:54
*** ohamada has quit IRC12:54
*** julim has joined #tripleo12:56
*** ohamada has joined #tripleo12:57
*** rlandy has joined #tripleo12:57
*** mbound has joined #tripleo12:59
*** jprovazn has quit IRC13:04
*** Oku_OS has joined #tripleo13:05
*** lucas-hungry is now known as lucasagomes13:06
*** olap has quit IRC13:06
*** olap has joined #tripleo13:07
*** pcaruana has joined #tripleo13:08
slaglehi everyone, it looks like IPA has been reverted back to the liberty build in rdo liberty, hopefully that will fix up the tripleo liberty ci13:08
slaglei rechecked a change on stable/liberty to test13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077213:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)13:10
gfidentejistr, I asked to marios same question only few lines early13:10
gfidenteso I think this deserves a topic13:11
gfidente"ask marios on irc"13:11
jistrmarios, gfidente: oh sorry, i missed that :/13:14
gfidentejistr, oh that wasn't the point13:15
mariosgfidente: no thanks. jistr np. as usual, it was gfidente's fault for not updating the review.13:15
mariosbut what can you do?13:15
gfidenteahahaha13:15
jistrlol13:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates: Adds v6 capability to the deploy validation test (pings)  https://review.openstack.org/28603113:16
EmilienMa backport to stable/liberty ^13:16
*** jayg|g0n3 is now known as jayg13:17
EmilienMcan we have a review on this backport please ? https://review.openstack.org/#/c/280496/13:18
*** links has quit IRC13:18
openstackgerritDan Prince proposed openstack/tripleo-heat-templates: Use set -e for validation-scripts/all-nodes.sh  https://review.openstack.org/28585713:18
*** shadower has joined #tripleo13:20
*** dprince has joined #tripleo13:23
*** jprovazn has joined #tripleo13:27
jistrContrail integration is still ready to land. just sayin :) https://review.openstack.org/#/c/238097/13:32
*** ibravo has joined #tripleo13:33
*** jtomasek_ has joined #tripleo13:35
*** jdob has joined #tripleo13:39
*** dmacpher has joined #tripleo13:40
*** liverpooler has quit IRC13:42
*** masco has quit IRC13:46
*** fgimenez has quit IRC13:50
dprinceshardy: this will help fix IPv4 network isolation upstream https://review.openstack.org/#/c/285544/13:50
dprincemarios: also, related to getting IPv4 network isolation working again could you have a look at both patches in this ticket: https://bugs.launchpad.net/tripleo/+bug/155104813:51
openstackLaunchpad bug 1551048 in tripleo "network validation tests fail: No module named ipaddr" [Critical,In progress] - Assigned to Dan Prince (dan-prince)13:51
*** fgimenez has joined #tripleo13:52
*** fgimenez has quit IRC13:52
*** fgimenez has joined #tripleo13:52
jistrdprince: so that makes it work so that Heat notifications can go through swift rather than heat-cfn API?13:53
* jistr inclined to +2+A13:54
shardydprince: Hi!  Ouch, that's confusing, we use metadata_put_url inside heat, then request/metadata_url in the occ data13:54
jistroh sorry metadata... ok i'll just +1 and leave the rest to shardy :D13:55
openstackgerritMerged openstack/tripleo-image-elements: Correct ping test when using Swift temp_urls  https://review.openstack.org/28554413:55
dprincejistr: We already switched our default (upstream) to use Swift. What I'm fixing here is the ability to obtain the correct metadata_url13:55
dprinceshardy: yes, it is confusing13:55
*** jtomasek_ has quit IRC13:55
shardyjistr: Hey, sorry I just +A'd it13:55
dprinceshardy: I actually had to review the code to get this right. What I've posted functionally works though13:55
jistrshardy: haha np :)13:55
dprincegfidente: hi, so I've made progress on the IPv4 network isolation CI job: https://review.openstack.org/#/c/285674/13:56
mariosdprince: looking13:57
dprincegfidente: it is now hanging in the Post deployment steps. On the non-HA job it seems to hang in the compute post deploy... Puppet apply is running but then it times out/aborts13:57
*** links has joined #tripleo13:58
gfidentedprince, noticed, non-ha doesn't use netiso though right?13:59
dprincegfidente: I pushed a patch to enable it in all of them (as a test)14:00
*** mbound has quit IRC14:00
gfidentedprince, ah okay I was looking only at the older patch14:00
dprincegfidente: once we get it working we can land only the HA patch I guess. We can debate this. See my patch also has some critical fixes to allow it to get further14:00
*** bswartz has joined #tripleo14:01
gfidentedprince, oh you mean this https://review.openstack.org/#/c/285544/14:02
gfidenteit landed though14:02
dprincegfidente: yes, it did :). 5 minutes ago14:02
gfidenteah14:02
gfidente:P14:03
dprincegfidente: my patch also Depends-On these fixes too: https://bugs.launchpad.net/tripleo/+bug/155104814:03
openstackLaunchpad bug 1551048 in tripleo "network validation tests fail: No module named ipaddr" [Critical,In progress] - Assigned to Dan Prince (dan-prince)14:03
dprincegfidente: anyways, with that fixed our network isolation seems to be working. We can ping things anyway14:04
gfidenteyeah a recheck might pass now without the BZ patches14:05
gfidentecan I look for a specific indication in the logs14:05
gfidenteto figure if the timeout was due to https://review.openstack.org/#/c/285544/ ?14:05
gfidenteshardy, can I change in CI stack-show with resource-list -n514:08
gfidenteso we get understanding of which nested stack is going bad? dprince ^^14:08
gfidentedprince, I don't see the output from last puppet apply14:09
*** mbound has joined #tripleo14:09
gfidenteso some puppet must be timing out there ... that's why resource-list :)14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077214:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155123414:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)14:10
openstackLaunchpad bug 1551234 in tripleo "stable/liberty: openstack-keystone failing to start with ImportError: No module named Cryptodome.PublicKey" [Critical,In progress] - Assigned to Alan Pevec (apevec)14:10
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Collect status of all nested stacks in resource-list and event-list  https://review.openstack.org/28606214:12
*** mburned_out is now known as mburned14:12
gfidente^^ :)14:12
gfidentelet me depend on it and see if we get anywhere further14:12
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Use netiso in the ha job  https://review.openstack.org/27342414:13
dprincegfidente: exactly, there is no output. It just hangs14:13
gfidentedprince, yeah because I think some puppet is timing out14:14
gfidenteso I am trying the -n5 to see if heat can give better indication of when this happens14:14
*** links has quit IRC14:16
*** saneax is now known as saneax_AFK14:18
*** tzumainn has joined #tripleo14:18
*** tiswanso has joined #tripleo14:20
*** lblanchard has joined #tripleo14:22
*** jcoufal has joined #tripleo14:26
*** bvandenh has joined #tripleo14:30
*** bvandenh has quit IRC14:31
*** bvandenh has joined #tripleo14:32
*** xinwu has joined #tripleo14:34
zigogreghaynes: Hi there, is there any reason why https://review.openstack.org/#/c/264726/ is stuck?14:36
zigoI'm looking forward having it approved, because that's blocking the Debian image patch in infra, which blocks Debian packaging on upstream infra.14:37
gfidentedprince, regarding the ip on vlan10 and related FLOATING_* settings, I didn't add that because we default to 192.0.2. in upstream CI14:37
gfidentehttps://github.com/openstack/tripleo-common/blob/master/scripts/tripleo.sh#L567-L57214:37
gfidentewhich we should reach from the undercloud14:37
*** pcaruana has quit IRC14:38
*** Goneri has joined #tripleo14:40
zigogreghaynes: I was in fact talking to that one: https://review.openstack.org/#/c/211859/14:41
zigoThe other one is the Debian one which is stuck because of #21185914:41
*** olap has quit IRC14:42
*** olap has joined #tripleo14:43
*** dustins has joined #tripleo14:45
*** pradk has joined #tripleo14:50
*** pcaruana has joined #tripleo14:52
*** bvandenh has quit IRC14:53
dtantsurfolks, one more kind request to review https://review.openstack.org/#/c/277974/14:54
openstackgerritMerged openstack/tripleo-common: Updated from global requirements  https://review.openstack.org/26854914:54
dtantsurthis small patch will open much more opportunities for the profile matching (and other advanced introspection applications)14:54
jistrgfidente: hmm i'm not sure about this one https://review.openstack.org/#/c/28371214:55
*** yamahata_ has quit IRC14:55
jistrHeat could use a way to do per-OS defaults of some sort14:55
jistror t-h-t rather than Heat14:55
jistrby moving ::osfamily up in the hierarchy, we're essentially saying "CinderISCSIHelper" stack parameter on RH platforms will always be ignored14:56
gfidentejistr, so let me add some context14:56
gfidenteyes we're saying the hiera value preveals on the tht value, for a specific platform and people can only override it with ExtraConfig hiera14:57
jistryea :(14:57
gfidenteon the other hand, I like the idea of per-OS defaults in tht but we don't have it today14:57
gfidenteand my interest in this change was landing https://review.openstack.org/#/c/256670/14:58
gfidentewhich "relies" on appropriate default for that CinderISCSI thing14:58
jistroh i think we might make the per-os defaults work actually14:58
gfidentein tht?14:58
*** dustins has quit IRC14:59
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud: Enable IPA debug logging during introspection when undercloud_debug is True  https://review.openstack.org/28609614:59
jistrgfidente: yea. will describe on the review14:59
rhalliseydprince, ping got a puppet tags question14:59
shardyOne way to enable optional additional overrides from a mapping is shown here btw:14:59
shardyhttps://review.openstack.org/#/c/275605/15:00
shardy(needs reviews! ;)15:00
shardyThat would get messy if we wanted lots of os-specific overrides, but it might work for simple cases15:00
gfidenteshardy, ah so the map overwrites the str template15:01
gfidenteyou're damned15:01
gfidenteas in cool but reads more like 'how did you even think about that'15:01
shardywell it makes sense in the hostname case, where you know that e.g you'll always have overcloud-controller-0, and you want to map that to something different15:02
shardyit may not be a clean solution for general hiera overrides, just wanted to point out the technique15:02
gfidenteshardy, yeah because we need for each param we want to override15:03
*** trozet has joined #tripleo15:03
jistrgfidente: wdyt https://review.openstack.org/#/c/283712/15:03
jistri mean https://review.openstack.org/#/c/283712/1/puppet/hieradata/RedHat.yaml15:04
dprincerhallisey: hi, whats up?15:04
gfidentejistr, I think it's fine15:05
rhalliseydprince, I'm wondering if we're missing a tag. I'm not seeing puppet generate /usr/share/neutron15:05
rhalliseymaybe neutron_api_config ?15:05
*** mgould has quit IRC15:05
gfidentejistr, if we don't move osfamily though we'll have to do that for all the params which need os-specific default15:06
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Install dstat after we set the fedora mirror  https://review.openstack.org/28610115:07
jistrgfidente: yes, but only if we want to combine setting them from a Heat stack parameter with an os-specific default15:08
dprincerhallisey: /usr/share/neutron would be owned by the neutron package right?15:08
jistrgfidente: i hope there wouldn't be so many of those (we have 1st one now)15:08
gfidenteyeah so the real thing here is in letting tht preveal when we have two definitions15:08
dprincerhallisey: I'm not sure puppet-neutron generates that. My guess is that it doesn't15:08
jistrgfidente: yea exactly15:08
rhalliseydprince, ok so if it doesn't then..15:08
rhalliseymaybe we need to install another neutron package15:09
jistrgfidente: honestly, i think the best solution here would be to not have CinderISCSIHelper param at all... but that breaks backwards comp.15:09
gfidenteexactly15:09
gfidenteyou had me there15:09
gfidenteagreed then15:09
derekh8 falures in CI caused by a failing fedora mirror list, this should fix it https://review.openstack.org/#/c/286101/15:09
jistrgfidente: alright, thanks15:09
derekh*8 failures today15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077215:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155123415:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)15:10
openstackLaunchpad bug 1551234 in tripleo "stable/liberty: openstack-keystone failing to start with ImportError: No module named Cryptodome.PublicKey" [Critical,In progress] - Assigned to Alan Pevec (apevec)15:10
openstackgerritMerged openstack/tripleo-heat-templates: Change the default value for NetworkNexusVxlanGlobalConfig  https://review.openstack.org/28195715:11
jistrgfidente: rather than CinderISCSIHelper in particular, i don't like the ::osfamily move in the hierarchy and introducing the pattern of overriding per-role params via osfamily. That's reverse order than what it should be like.15:11
*** dustins has joined #tripleo15:12
* jistr going to mention that on the review too actually15:12
*** mgould has joined #tripleo15:12
gfidentejistr, yeah but I am unsure what we want to override there15:12
gfidentebecause tht doesn't have per-OS defaults15:12
gfidenteso it makes sense to have per-OS defaults in hiera overriding the tht defaults15:13
rhalliseydprince, nevermind.  Ya it can't be puppet.. Something is just off with the config15:13
rhalliseythanks15:13
gfidentewhat I liked of the %{} is that it behaves as phasing out a parameter15:14
gfidentejistr, ^^15:14
jistrgfidente: "so it makes sense to have per-OS defaults in hiera overriding the tht defaults" -- yeah i see what you mean... but still, then we have a stack parameter that doesn't work on the platform where we made the override. Feels like the priority (tht custom set value vs. hiera defaults) is then reversed on that platform.15:17
gfidenteyes15:17
gfidenteso I'll update it without moving osfamily15:17
jistrgfidente: cool, thanks!15:17
gfidenteas in your comment15:17
gfidentewe'll probably never cross it again and put defaults in common/RedHat appropriately instead of THT15:18
jistrgfidente: yea agreed. Usually for the parameters where we want per-OS defaults, we wouldn't want users to customize those super-easily, i think. As we discussed above, the ideal solution here would probably be "simple" defaults in hiera, and not introduce the CinderISCSIHelper parameter at all.15:20
jistrso i hope there's a good chance we won't hit this issue again15:20
* jistr crosses fingers15:20
*** olap has quit IRC15:27
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Default CinderISCSIHelper to lioadm for RH based systems  https://review.openstack.org/28371215:28
dprincemarios: I commented here. https://review.openstack.org/#/c/285857/. I'd like to see us maintain the custom error messages I think. That was the reason for the set +e, set -e bits.15:31
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Default CinderISCSIHelper to lioadm for RH based systems  https://review.openstack.org/28371215:31
openstackgerritMerged openstack/tripleo-heat-templates: OpenContrail heat templates  https://review.openstack.org/23809715:31
dprincegfidente: you realize you just put a hiera setting at the top level here: https://review.openstack.org/#/c/283712/3/overcloud.yaml15:32
dprincegfidente: we can't/shouldn't do that!15:32
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Aodh services, replacing Ceilometer Alarm  https://review.openstack.org/24140815:33
gfidentegfidente, see last 2/3 comments in the review ;)15:34
gfidentedprince, ^^15:34
*** aufi has quit IRC15:34
*** jaosorior is now known as jaosorior_away15:37
jistrdprince: ok, good point. Do you have some idea how to do OS-specific defaults in t-h-t though? We need iloadm on RH platform, tgtadm elsewhere. Putting it into RedHat.yaml won't help, because it's going to get overriden by the t-h-t param. Moving ::osfamily up in the hierarchy does the reverse -- it makes the t-h-t param effectively ignored, regardless what you set.15:37
*** panda has quit IRC15:37
*** panda has joined #tripleo15:38
*** pblaho_ is now known as pblaho15:38
*** xinwu has quit IRC15:40
mariosjistr: thanks15:41
marioserr... sorry i mean dprince thanks (revisited the review)15:41
jistrgfidente, dprince: we might get back to what gfidente had initially, if that does the least amount of damage (having hiera hierarchy of "osfamily > per-role > common" rather than the usual "per-role > osfamily > common"). i forgot to pay attention to non-puppet use cases when reviewing15:42
jistrdprince: would you be ok with the hierarchy change? ^15:42
jistrdprince: patch set 1 https://review.openstack.org/#/c/283712/115:43
gfidentedprince, /me overlooked the non puppet scenario too, thanks :)15:45
gfidenteI'm telling you the review process is important!15:45
*** julim has quit IRC15:51
*** julim has joined #tripleo15:53
*** dtantsur is now known as dtantsur|brb15:53
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-pacemaker: Basic beaker one node test.  https://review.openstack.org/28137615:54
*** dustins has quit IRC15:57
*** dustins has joined #tripleo15:58
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-pacemaker: Add a service provider.  https://review.openstack.org/28612415:58
*** penick has joined #tripleo15:59
*** jeh has joined #tripleo16:03
*** jeh has left #tripleo16:03
openstackgerritDan Radez proposed openstack/os-cloud-config: Adding support for pxe_amt  https://review.openstack.org/28207716:03
*** dsneddon has joined #tripleo16:05
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Move ::osfamily up in the hiera hierarchy, after extraconfig  https://review.openstack.org/28371216:05
openstackgerritSagi Shnaidman proposed openstack/tripleo-common: Print failed overcloud info  https://review.openstack.org/28613216:07
akrivokadprince: may I suggest flfuchs as a tripleo-ui core, instead of myself? he's much more familiar with the code base than me16:07
akrivokadprince: https://github.com/rdo-management/rdo-director-ui/graphs/contributors16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155123416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)16:10
openstackLaunchpad bug 1551234 in tripleo "stable/liberty: openstack-keystone failing to start with ImportError: No module named Cryptodome.PublicKey" [Critical,In progress] - Assigned to Alan Pevec (apevec)16:10
jistrgfidente: changed my -1 to +1. Would be nice to see a third core give a + there, as it seems to be somewhat controversial. Sorry about misleading you towards the hiera defaults way.16:13
gfidentejistr, ack16:13
*** rcernin has quit IRC16:16
*** pcaruana has quit IRC16:17
*** dmacpher is now known as dmacpher-afk16:23
*** penick has quit IRC16:23
*** mcornea has quit IRC16:24
*** tiswanso has quit IRC16:30
*** tiswanso has joined #tripleo16:31
*** jtomasek_ has joined #tripleo16:32
*** jtomasek has quit IRC16:34
*** dustins_ has joined #tripleo16:34
*** electrofelix has joined #tripleo16:36
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Add a sample network-environment.yaml file to environments  https://review.openstack.org/28614416:37
*** nkinder has joined #tripleo16:38
*** dshulyak has quit IRC16:40
*** aufi has joined #tripleo16:42
*** bandini has quit IRC16:44
*** bandini has joined #tripleo16:45
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Upgrades: quiet yum update  https://review.openstack.org/28615516:48
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Upgrades: install zaqarclient  https://review.openstack.org/28615616:48
*** dustins has quit IRC16:52
*** dustins_ is now known as dustins16:52
*** paramite is now known as paramite|afk16:55
*** dtantsur|brb is now known as dtantsur16:56
*** absubram has joined #tripleo16:57
*** paramite|afk is now known as paramite16:58
*** paramite is now known as paramite|afk17:00
*** dshulyak has joined #tripleo17:01
gfidentedprince, so from the new output we can tell it's loadbalancer_step1 failing17:03
*** yamahata has joined #tripleo17:04
gfidentedprince, corosync says it couldn't reach the other nodes17:07
*** jaosorior_away is now known as jaosorior17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155077217:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/155123417:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1550772 in tripleo "stable/liberty CI: all jobs failing due to nodes stuck in wait call-back" [Critical,In progress] - Assigned to James Slagle (james-slagle)17:10
openstackLaunchpad bug 1551234 in tripleo "stable/liberty: openstack-keystone failing to start with ImportError: No module named Cryptodome.PublicKey" [Critical,In progress] - Assigned to Alan Pevec (apevec)17:10
*** paramite|afk is now known as paramite17:11
slagleboth of those should now be fixed ^^^17:11
gfidentederekh, dprince I think we're blocking multicast17:12
derekhgfidente: in the test envs ?17:13
gfidentederekh, yeah17:15
gfidenteand I remember we could configure corosync for regular upnp but I'd need to check how and if the puppet module supports this17:15
gfidente*udp17:15
*** akrivoka has quit IRC17:17
derekhgfidente: hmm, so eth1 on the undercloud is on the same ovs bridge at eth0 on each barmetal node, nothing should be getting blocked in that scenario17:17
*** openstackgerrit has quit IRC17:18
*** openstackgerrit has joined #tripleo17:18
gfidentederekh, multicast should be going across the nodes on the interface where we plug the internal_api network17:18
gfidentederekh, I'm bringing up something locally to have better understanding17:18
*** xinwu has joined #tripleo17:18
gfidente(across the overcloud nodes only)17:18
gfidentethe corosync timeouts are in the pcs logs17:19
*** xinwu has quit IRC17:19
derekhgfidente: ok, if you have no luck give me a shout and I'll set you up a test env on the ci Rack incase your local env is somehow different17:20
openstackgerritMerged openstack/python-tripleoclient: Removes MANIFEST.in as it is not needed explicitely by PBR  https://review.openstack.org/25717817:20
*** fgimenez has quit IRC17:20
dprinceakrivoka: yes, perhaps just reply with his name on the list instead of yours17:20
gfidentederekh, so corosync resolves by name, in non-ha corosync that is 192.0.217:20
gfidentederekh, sorry in non-netiso17:21
gfidentederekh, in netiso that becomes the internal_api vlan17:21
dprincegfidente: I was looking at the more simple non-HA job. And it was even hanging17:21
gfidentederekh, but I don't see why that should fail given this all goes on same physical nic17:21
dprincegfidente: on compute though17:21
gfidentedprince, so we might hit that too but for HA we're stuck in Step1 (I can tell now that I added the -n5 thing to resource-list)17:22
gfidente:)17:22
openstackgerritJames Slagle proposed openstack/instack-undercloud: Set max_resources_per_stack to -1  https://review.openstack.org/28616517:22
derekhCan I get a second +2 on this, A+ it also ;-), it has passed all 3 jobs https://review.openstack.org/#/c/286101/17:23
*** ayoung has quit IRC17:23
*** akrivoka has joined #tripleo17:24
gfidentedprince, what was the submission fixing ImportError: No module named ipaddr ?17:24
*** trown is now known as trown|lunch17:25
derekhAlso while I'm on the topic, all of our jobs are being delayed by an hour, as they are waiting on the containers job to finish, what do ye think of temporarily disabling it? https://review.openstack.org/#/c/285325/17:25
dprincegfidente: two I would recommend. This makes the script fail better: https://review.openstack.org/#/c/285857/17:25
*** jcoufal has quit IRC17:26
dprincegfidente: and this actually adds the python-ipaddr dependency https://review.openstack.org/#/c/285858/17:26
gfidentegod you pointed me there before17:26
gfidente:(17:26
*** jistr has quit IRC17:26
akrivokadprince: ping, not sure if you saw my msgs earlier17:27
akrivoka<akrivoka> dprince: may I suggest flfuchs as a tripleo-ui core, instead of myself? he's much more familiar with the code base than me17:28
akrivoka<akrivoka> dprince: https://github.com/rdo-management/rdo-director-ui/graphs/contributors17:28
openstackgerritMerged openstack/tripleo-puppet-elements: Add overcloud-base element  https://review.openstack.org/28585817:28
dprinceakrivoka: yes, sorry.l I thought I replied17:28
dprinceakrivoka: I'm fine with your suggestion, would you mind proposing the alternative to the list?17:28
akrivokadprince: sure, will do17:29
akrivokadprince: thanks!17:29
openstackgerritMerged openstack-infra/tripleo-ci: Install dstat after we set the fedora mirror  https://review.openstack.org/28610117:29
shardyrhallisey: ^^ can you respond to derekh's comment re disabling the containers job?17:29
shardywhat's the status re making that reliable?17:29
shardyI recall it was working for a time, but not recently?17:29
*** david-lyle has joined #tripleo17:30
rhalliseyshardy, after rebuilding some of the containers neutron-ovs-agents isn't working properly17:30
rhalliseyso it's causing the ping test to fail17:30
rhalliseytrying to adjust to some of the changes in the images17:30
rhalliseyshardy, comments on the review17:31
rhalliseyI think we should disable until further notice..17:31
shardyrhallisey: Ok, thanks for confirming!17:32
*** electrofelix has quit IRC17:32
dprincerhallisey: is there no way to easily revert to a working container currently?17:33
rhalliseyno problem17:33
rhalliseydprince, I could go back and build an old one with new packages.  The only issues though is it increases our delta from kolla17:34
rhalliseywhich I'd rather not do17:34
*** electrofelix has joined #tripleo17:35
gfidentederekh, dprince I'm trying to switch hostname resolve network to ctlplane so corosync will use 192.0.2 for multicast17:39
gfidentecause that used to work without netiso17:39
openstackgerritBen Nemec proposed openstack/instack-undercloud: Add ability to auto-generate self-signed certificates  https://review.openstack.org/27323317:39
derekhgfidente: ok17:40
jaosoriorbnemec: Was that just a rebase? ^^17:41
bnemecjaosorior: Yes.  And the only conflict was in the sample config file, so I just regenerated it. :-)17:41
jaosoriorbnemec: Alright17:41
*** penick has joined #tripleo17:44
*** mbound has quit IRC17:44
dprincegfidente: okay, would that fix the other non-HA jobs too?17:44
gfidentedprince, no I don't think it's same issue17:44
dprincegfidente: Right now I'd take any job as the network isolation job17:44
gfidenteoh I see what you mean17:45
dprincegfidente: right, so if that only fixes corosync I'm wondering if perhaps we should focus on non-HA first17:45
gfidenteok well I had this 'on hands', I'm checking the non-ha now17:49
EmilienMgfidente: if you remember our IPv6 concerns about adding brackets when needed, you  might want to look https://github.com/openstack/puppet-openstacklib/blob/master/lib/puppet/parser/functions/normalize_ip_for_uri.rb17:51
gfidenteEmilienM, nice :)17:52
EmilienMgfidente: puppet-nova already has it to add brackers for VNC URLs17:52
EmilienMand I'm doing a patch in puppet-glance to add it too for registry_host17:52
EmilienMgfidente: we should use it, instead of adding brackets in the manifests (if we did)17:52
gfidenteyes17:53
gfidentetotally nice17:53
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Collect status of all nested stacks in resource-list and event-list  https://review.openstack.org/28606217:53
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Use netiso in the ha job  https://review.openstack.org/27342417:53
*** derekh has quit IRC17:53
*** tiswanso has quit IRC17:54
*** Marga_ has quit IRC17:54
openstackgerritRichard Su proposed openstack/tripleo-heat-templates: Add missing createUser line to /etc/snmp/snmpd.conf  https://review.openstack.org/26399117:55
*** david-lyle has quit IRC17:55
*** david-lyle_ has joined #tripleo17:55
*** dtantsur is now known as dtantsur|afk17:59
*** aufi has quit IRC18:00
bnemecCould somebody push the button on https://review.openstack.org/#/c/282508/ and https://review.openstack.org/#/c/273452/ ?18:01
bnemecThey're simple ci changes to add more information to our logs.18:02
*** tiswanso has joined #tripleo18:03
shardybnemec: lgtm, done18:04
bnemecshardy: Thanks!18:04
*** lucasagomes is now known as lucas-dinner18:05
openstackgerritMerged openstack-infra/tripleo-ci: Get more info from ps command  https://review.openstack.org/28250818:07
openstackgerritMerged openstack-infra/tripleo-ci: Remove unused urllib  https://review.openstack.org/26118218:07
openstackgerritMerged openstack-infra/tripleo-ci: Run top in batch mode  https://review.openstack.org/27345218:07
*** xinwu has joined #tripleo18:08
gfidentebnemec, https://review.openstack.org/#/c/273424/12 ?18:10
gfidentesorry wrong link18:10
gfidentehttps://review.openstack.org/#/c/286062/18:10
bnemecgfidente: What about it?18:14
gfidenteI noticed you were in 'more logs' mood18:14
bnemecgfidente: Ah, gotcha.  I was kind of enjoying the <1 MB console.logs though. :-P18:18
gfidenteI forgot you -1 my patches anyway18:19
gfidentecan I get resource-list -n5 five at least? :)18:19
bnemecgfidente: I +2'd it.  I'm just giving you a hard time. :-)18:21
gfidenteand that's good18:22
gfidenteI tell the review process is important18:22
*** electrofelix has quit IRC18:22
*** Marga_ has joined #tripleo18:28
*** mgould has quit IRC18:28
*** rdopiera has quit IRC18:35
gfidentedprince, so yes there must be some connectivity issue across nodes on the vlans, it isn't only multicast for corosync because compute never gets to connect to rabbit in non-ha18:36
dprincegfidente: right, and it doesn't effect the ping check. Because that is now passing18:37
dprincegfidente: do you have it failing locally?18:37
gfidenteno not locally18:37
dprincegfidente: yeah, me neither :/18:37
*** tosky has quit IRC18:37
*** paramite has quit IRC18:40
*** nico_auvv has quit IRC18:41
gfidentedprince, I just noticed this from derek18:43
gfidente<derekh> gfidente: hmm, so eth1 on the undercloud is on the same ovs bridge at eth0 on each barmetal node, nothing should be getting blocked in that scenario18:43
gfidentedoes that mean on overcloud nodes the vlans should go on eth1 and not eth0 ?18:43
gfidenteoh no he said eth0 on overcloud nodes18:43
*** akuznetsov has joined #tripleo18:45
dprincegfidente: yeah, we can certainly review this but last we talked about it I don't think the bridges should block anything18:45
gfidentedprince, oh I am thinking the ping test in non-ha works because it's a single node18:47
gfidenteso it has all the IPs locally18:48
*** trown|lunch is now known as trown18:50
*** jaosorior has quit IRC18:54
*** jaosorior has joined #tripleo18:58
*** jprovazn has quit IRC19:04
*** akuznetsov has quit IRC19:04
*** apetrich_ has joined #tripleo19:05
*** athomas has quit IRC19:06
*** julim has quit IRC19:07
*** jaosorior has quit IRC19:07
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add Satellite 5 support  https://review.openstack.org/26660219:09
*** apetrich has quit IRC19:09
*** julim has joined #tripleo19:10
openstackgerritLeon Zachery proposed openstack/tripleo-heat-templates: Cisco nexus config template - obsolete parameter (replay count).  https://review.openstack.org/28623219:10
openstackgerritBen Nemec proposed openstack/instack-undercloud: Delete default flavors in Python  https://review.openstack.org/28623319:11
bnemec^is what happens when I'm sitting around waiting for images to build :-)19:11
*** akuznetsov has joined #tripleo19:11
*** ifarkas has quit IRC19:16
*** tiswanso has quit IRC19:16
*** tiswanso has joined #tripleo19:19
*** akrivoka has quit IRC19:19
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Add Satellite 5 support  https://review.openstack.org/26660219:23
*** rwsu has quit IRC19:28
*** rwsu has joined #tripleo19:29
*** ohamada has quit IRC19:30
*** bandini has quit IRC19:38
*** bandini has joined #tripleo19:40
*** mbound has joined #tripleo20:11
openstackgerritKambiz Aghaiepour proposed openstack/instack-undercloud: Enable AMT driver  https://review.openstack.org/28625220:11
*** olap has joined #tripleo20:12
*** david-lyle_ is now known as david-lyle20:12
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Aodh services, replacing Ceilometer Alarm  https://review.openstack.org/24140820:14
*** yamahata has quit IRC20:18
*** nkinder has quit IRC20:19
*** sshnaidm has quit IRC20:22
*** trozet has quit IRC20:24
openstackgerritMerged openstack/tripleo-common: Adds a bash script that operators will use during upgrades  https://review.openstack.org/28472220:31
openstackgerritLeon Zachery proposed openstack/tripleo-heat-templates: Cisco nexus config template - obsolete parameter (replay count).  https://review.openstack.org/28623220:31
*** sshnaidm has joined #tripleo20:32
*** akuznetsov has quit IRC20:36
*** akuznetsov has joined #tripleo20:36
*** akuznetsov has quit IRC20:37
*** dprince has quit IRC20:45
*** leanderthal is now known as leanderthal|afk20:55
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Gnocchi as a Ceilometer metrics storage backend  https://review.openstack.org/25203220:55
openstackgerritMerged openstack/tripleo-heat-templates: Convert port cidr splitting to str_split  https://review.openstack.org/26624620:56
*** rpothier has joined #tripleo20:57
*** dshulyak has quit IRC20:57
*** chlong_ has joined #tripleo21:00
*** jprovazn has joined #tripleo21:02
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: DO NOT MERGE: Print output of ovs-vsctl show from hosting node  https://review.openstack.org/28627921:03
*** trozet has joined #tripleo21:04
openstackgerritSteve Baker proposed openstack/tripleo-common: Implement ViewManager list_software_deployments  https://review.openstack.org/26882221:08
openstackgerritSteve Baker proposed openstack/tripleo-common: Implement ViewManager list_stack_failures  https://review.openstack.org/27054621:08
openstackgerritSteve Baker proposed openstack/tripleo-common: Implement ViewManager show_software_deployment  https://review.openstack.org/27054521:08
trownif 2 environment files define controllerExtraConfig, what is the expected behavior? merge the two dicts? overwrite the contents of the last one?21:10
dmsimard"RDO Manager" is now "TripleO" https://www.rdoproject.org/blog/2016/02/rdo-manager-is-now-tripleo/21:11
*** ayoung has joined #tripleo21:17
gfidentedmsimard :)21:18
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: DO NOT MERGE: Print output of brctl show from hosting node  https://review.openstack.org/28627921:23
*** lucas-dinner has quit IRC21:28
*** yamahata has joined #tripleo21:29
*** stevebaker has quit IRC21:35
*** lucasagomes has joined #tripleo21:36
*** stevebaker has joined #tripleo21:36
trownfor anyone curious about my question above wrt controllerExtraConfig, the behavior is to merge21:38
*** ibravo has quit IRC21:39
*** r-mibu has quit IRC21:46
*** r-mibu has joined #tripleo21:46
*** jprovazn has quit IRC21:49
*** dshulyak has joined #tripleo21:52
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Revert "Revert "neutron: enable nova-event-callback by default""  https://review.openstack.org/26982721:54
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Revert "Revert "neutron: enable nova-event-callback by default""  https://review.openstack.org/26982721:55
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates: Set project name for nova -> neutron notifications  https://review.openstack.org/28550921:57
*** dshulyak has quit IRC21:57
slaglebnemec: i'm feeling good about that one ^ :)21:58
slagleapparently we need the suffix in neutron.conf, but not nova.conf21:58
bnemecslagle: Consistency FTW! :-)21:58
slaglewell it is in mitaka i guess :)21:59
*** mbound has quit IRC21:59
slagleactually it's the other way around, no suffix in neutron.conf, suffix in nova.conf22:00
pradkslagle, could we bump the memory on oc nodes? i keep hitting - Cannot allocate memory - fork(2)22:04
*** lblanchard has quit IRC22:05
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates: Enable notifications on the overcloud  https://review.openstack.org/28629922:08
*** jayg is now known as jayg|g0n322:12
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates: Add IPv6 Support to Isolated Networks  https://review.openstack.org/23542322:17
*** yamahata has quit IRC22:18
*** yamahata has joined #tripleo22:19
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Gnocchi as a Ceilometer metrics storage backend  https://review.openstack.org/25203222:19
*** trown is now known as trown|lunch22:21
*** trown|lunch is now known as trown|outtypewww22:21
*** dustins has quit IRC22:22
*** rhallisey has quit IRC22:25
*** absubram has quit IRC22:28
dmsimardDon't know if anyone could answer this guy, just don't want to redirect him to rdo-list http://lists.openstack.org/pipermail/openstack-operators/2016-February/009698.html22:30
*** rpothier has quit IRC22:30
*** Goneri has quit IRC22:31
bnemecdmsimard: I'm not on the operators list, but the config he wants is max_concurrent_builds in /etc/nova/nova.conf.22:33
dmsimardok i'll get back to him22:33
dmsimardthanks22:34
*** julim has quit IRC22:39
*** tiswanso has quit IRC22:50
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates: Deploy Aodh services, replacing Ceilometer Alarm  https://review.openstack.org/24140823:02
*** thrash is now known as thrash|g0ne23:08
*** akuznetsov has joined #tripleo23:10
*** gfidente has quit IRC23:11
*** yamahata has quit IRC23:12
*** akuznetsov has quit IRC23:15
*** dshulyak has joined #tripleo23:19
*** saneax_AFK is now known as saneax23:20
*** dshulyak has quit IRC23:23
*** penick has quit IRC23:29
*** penick has joined #tripleo23:31
*** pradk has quit IRC23:32
*** zbitter is now known as zaneb23:35
*** mkovacik has quit IRC23:36
*** hjensas has quit IRC23:37
*** panda has quit IRC23:37
*** panda has joined #tripleo23:38
*** jtomasek_ has quit IRC23:50
openstackgerritColleen Murphy proposed openstack/diskimage-builder: Add --version option to disk-image-create  https://review.openstack.org/27765823:56
openstackgerritColleen Murphy proposed openstack/diskimage-builder: Add --version option to disk-image-create  https://review.openstack.org/27765823:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!