Friday, 2015-05-15

*** mestery has quit IRC00:14
*** eghobo has quit IRC00:25
*** yuanying has joined #tripleo00:31
*** bvandenh has joined #tripleo00:45
*** yamahata has joined #tripleo00:59
*** sdake has quit IRC01:03
*** yuanying has quit IRC01:04
*** sdake has joined #tripleo01:05
*** yuanying has joined #tripleo01:25
*** BadCub is now known as BadCub-Hiding01:26
*** yuanying has quit IRC01:27
*** bvandenh has quit IRC01:40
*** sdake_ has joined #tripleo01:51
*** sdake has quit IRC01:55
*** thrash is now known as thrash|g0ne02:04
*** tzumainn has quit IRC02:13
*** yuanying has joined #tripleo02:43
openstackgerritYanis Guenane proposed openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes  https://review.openstack.org/18310302:45
*** julim has quit IRC02:49
*** yamahata has quit IRC02:50
*** untriaged-bot has joined #tripleo03:00
untriaged-botUntriaged bugs so far:03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145517503:00
openstackLaunchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107)03:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985203:00
openstackLaunchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)03:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985403:00
openstackLaunchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480303:00
openstackLaunchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New]03:00
untriaged-bothttps://bugs.launchpad.net/tuskar/+bug/145275203:00
openstackLaunchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed]03:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480203:00
openstackLaunchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New]03:00
*** untriaged-bot has quit IRC03:00
openstackgerritYanis Guenane proposed openstack/tripleo-heat-templates: Makes sure galera can handle the connections  https://review.openstack.org/18304403:03
*** panda has quit IRC03:13
*** panda has joined #tripleo03:14
*** ukalifon1 has quit IRC03:15
openstackgerritYanis Guenane proposed openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes  https://review.openstack.org/18310303:18
*** sdake has joined #tripleo03:33
*** sdake_ has quit IRC03:36
*** sdake_ has joined #tripleo03:38
*** sdake has quit IRC03:41
*** yamahata has joined #tripleo03:42
*** lazy_prince has joined #tripleo03:45
*** HenryG has quit IRC03:51
*** eghobo has joined #tripleo03:56
*** eghobo_ has joined #tripleo04:21
*** eghobo has quit IRC04:24
*** Marga_ has quit IRC04:24
*** sdake_ has quit IRC04:35
*** daneyon has joined #tripleo04:36
*** Marga_ has joined #tripleo05:00
*** rainya has quit IRC05:05
*** eghobo has joined #tripleo05:30
*** eghobo_ has quit IRC05:32
*** ukalifon has joined #tripleo05:33
*** HenryG has joined #tripleo05:38
*** mestery has joined #tripleo05:44
*** aufi has joined #tripleo05:50
*** sdake has joined #tripleo05:52
*** mestery has quit IRC05:53
*** mestery has joined #tripleo05:53
*** sdake has quit IRC05:53
*** sdake has joined #tripleo05:54
*** jtomasek has joined #tripleo05:56
*** masco has joined #tripleo05:58
*** sdake has quit IRC05:58
*** ukalifon has quit IRC06:01
*** Marga_ has quit IRC06:12
*** mestery has quit IRC06:13
*** dshulyak has joined #tripleo06:15
*** sdake has joined #tripleo06:16
*** jprovazn has joined #tripleo06:21
*** daneyon has quit IRC06:21
*** mmagr has joined #tripleo06:22
*** daneyon has joined #tripleo06:23
*** eghobo has quit IRC06:30
*** yog_ has quit IRC06:41
*** Marga_ has joined #tripleo06:43
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Makes sure galera can handle the connections  https://review.openstack.org/18304406:48
*** Marga_ has quit IRC06:48
mariosspredzy|afk: thanks very very much for fixing that man, muchas gracias06:51
mariosspredzy|afk: i just updated the commit message06:51
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates: Add Redis as a Pacemaker resource when EnablePacemaker  https://review.openstack.org/18261706:55
mariosspredzy|afk: quid pro qo ^^^ updated that for you :) happy friday06:57
*** ishant has joined #tripleo06:59
*** daneyon has quit IRC07:03
*** sdake_ has joined #tripleo07:05
*** rlandy has joined #tripleo07:06
*** aufi has quit IRC07:08
*** sdake has quit IRC07:08
*** Goneri has joined #tripleo07:13
*** ifarkas has joined #tripleo07:13
*** panda has quit IRC07:13
*** panda has joined #tripleo07:14
*** jcoufal has joined #tripleo07:27
*** aufi has joined #tripleo07:27
*** Goneri has quit IRC07:30
*** chlong has quit IRC07:32
*** jistr has joined #tripleo07:33
*** regebro has joined #tripleo07:42
*** Marga_ has joined #tripleo07:44
*** Goneri has joined #tripleo07:48
*** Marga_ has quit IRC07:49
*** Goneri has quit IRC07:58
*** Goneri has joined #tripleo07:59
*** yog_ has joined #tripleo08:00
*** gfidente has joined #tripleo08:10
*** derekh has joined #tripleo08:13
*** al has quit IRC08:21
*** al has joined #tripleo08:22
*** dtantsur|afk is now known as dtantsur08:27
*** yamahata has quit IRC08:33
*** mmagr has quit IRC08:40
*** Marga_ has joined #tripleo08:44
*** Marga_ has quit IRC08:50
*** mcornea has joined #tripleo08:52
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes  https://review.openstack.org/18310308:53
*** lucasagomes has joined #tripleo08:57
jistroops didn't notice spredzy|afk did some changes in the meantime... will merge that and resubmit08:58
*** dobson has quit IRC08:59
openstackgerritMerged openstack/tripleo-heat-templates: Makes sure galera can handle the connections  https://review.openstack.org/18304408:59
*** untriaged-bot has joined #tripleo09:00
untriaged-botUntriaged bugs so far:09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145517509:00
openstackLaunchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107)09:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985209:00
openstackLaunchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)09:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985409:00
openstackLaunchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480309:00
openstackLaunchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New]09:00
untriaged-bothttps://bugs.launchpad.net/tuskar/+bug/145275209:00
openstackLaunchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed]09:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480209:00
openstackLaunchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New]09:00
*** untriaged-bot has quit IRC09:00
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Provide RabbitMQ clients with a list of servers instead of VIP  https://review.openstack.org/18108109:02
gfidentemarios, ^^ I've fixed the typo and updated the comment09:02
mariosgfidente: thanks looking09:04
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Environment which configures puppet pacemaker.  https://review.openstack.org/18309709:04
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes  https://review.openstack.org/18310309:05
gfidentejistr, https://review.openstack.org/#/c/180490 :)09:06
openstackgerritMerged openstack/tripleo-heat-templates: Ensure haproxy is not enabled by puppet-tripleo when EnablePacemaker  https://review.openstack.org/18049009:07
jistrgfidente: ^ :)09:07
gfidentethat was an easy one09:07
gfidentestole a commit09:07
gfidentecores, if you want to help with ceph as well https://review.openstack.org/#/c/183096/09:08
*** dobson has joined #tripleo09:10
jistrgfidente, marios: re puppet HA -- can't get rabbitmq to start there yet09:11
gfidentejistr !?09:11
jistryeah... dunno why, it says port is in use09:11
*** adrianopetrich has quit IRC09:11
gfidentejistr, I think jayg|g0n3 saw this as well on occasion09:12
jistri'll now redeploy with the latest version09:12
gfidentethe rabbit logs saying it is attempting to bind on 0.0.0.0 ?09:12
jistryeah i think so09:12
jistriirc09:12
jistrwill revalidate09:12
gfidenteokay so I checked the astapor manifest09:12
gfidentethe only dependency we don't have, compared to astapor is this09:12
gfidentehttps://review.openstack.org/#/c/181398/09:13
gfidentebut then I checked the ::install module and it looks like it is only ensuring the package is installed09:13
gfidenteso I abandoned it09:13
gfidenteI don't think we ever saw the bind issue when testing that change though09:14
gfidenteas if it was introducing some minimal but essential delay of some sort09:14
gfidenteideas?09:14
jistrhmm this might be a race again09:14
jistrone thing i noticed is that on the master node it starts ok09:15
jistri wonder if it could be that it's trying to start rabbitmq on the other nodes *before* the config file has been written there09:15
jistrso using the defaults, trying to bind on 0.0.0.009:15
gfidenteyou mean pcs?09:15
gfidenteyeah looks like a good idea :)09:16
jistri mean: config written on master -> pcs resource create -> config written on others09:16
gfidenteso that would be09:16
gfidentethe other nodes have already joined the cluster09:16
gfidentebut didin't apply the rabbit config yet?09:16
jistryeah they join the cluster in step 1, rabbit is configured and started later, but both config and start happen in the same step09:17
jistri can try moving the rabbit config a step earlier than rabbit start09:18
hewbroccaWell that seems prudent in any case09:20
hewbroccaWe can't be starting unconfigured rabbits09:20
hewbroccawho knows where it would lead09:20
gfidentejistr, that is moving to step 1 or moving up in step 209:23
gfidente?09:23
jistrgfidente: step 1. Dependencies within step 2 won't help because that only can do ordering within one machine. Within one node everything is ok, the issue is an inter-node race condition, where puppet is helpless. This can only be solved on heat level.09:25
* hewbrocca thinks puppet is usually helpless09:26
gfidenteyeah I asked if you wanted to enforce the split09:26
gfidenteso I am no expert of validation09:26
gfidentebut can we validate a service on step 1 which is configured but not running?09:26
jistrgfidente: i don't think so, we'd have to validate rabbit on step 209:27
gfidenteso given the same problem exists potentially for the other infra services09:28
gfidenteis it worth doing the split for the others as well, should it work for rabbit?09:28
hewbroccaIdeally, you would validate in step 1 that the config has been written and is correct09:28
hewbroccabut not validate that the service is running until step 209:29
gfidenteand anyway, I wonder how this got worked around in astapor09:29
jistrgfidente: they used a trick with pacemaker properties to do inter-node ordering09:31
jistrgfidente: clever stuff, but the manifests are loaded with "->" arrows09:31
gfidenteand we ideally want to have that in heat probably09:32
gfidentelet's try to move first to make sure the fix is valid09:34
gfidentethen we see if it is worth doing for others maybe, I would like to avoid 'exceptions'09:34
gfidentetry to associate a known config level to each step09:35
*** shardy has joined #tripleo09:39
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes  https://review.openstack.org/18310309:40
jistrgfidente: it worked, still failing because of something else, will investigate after lunch, folks are waiting for me09:40
gfidentejistr, what failed?09:40
gfidentethe update patch or rabbit?09:41
jistrrabbit is ok09:41
jistrdeployment failed09:41
* jistr lunch, bbl09:41
gfidenteah the update09:41
gfidentejistr, let's keep this out of the update patch though, there are already a couple of other things going into the update which don't belong there09:44
gfidentejistr, seems problem generic enough to have its own commit and history09:44
gfidentejistr, and not due to update09:45
*** Marga_ has joined #tripleo09:45
*** athomas_ has joined #tripleo09:48
*** Marga_ has quit IRC09:50
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Fix RabbitMQ startup race preventing it to bind on 0.0.0.0  https://review.openstack.org/18139809:53
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Fix RabbitMQ startup race  https://review.openstack.org/18139809:54
*** thrash|g0ne is now known as thrash10:00
*** akrivoka has joined #tripleo10:16
*** jprovazn has quit IRC10:16
openstackgerritMerged openstack-infra/tripleo-ci: Allow puppet jobs to also run on F21  https://review.openstack.org/18272210:17
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Environment which configures puppet pacemaker.  https://review.openstack.org/18309710:29
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates: Add a directory for overcloud heat environments  https://review.openstack.org/18309610:29
jistrgfidente: yeah i already squashed 4 bugfixes into that commit... I'll keep working in this way for now and then i'll extract them out.10:34
gfidentejistr, I added you to the rabbit one10:34
gfidenteas long as fixes are small it's okay10:34
gfidentebut this one looks like deserves history and some tracking10:34
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Use environments file for Ceph and HA jobs  https://review.openstack.org/18347210:40
*** ishant has quit IRC10:41
*** Marga_ has joined #tripleo10:45
*** adrianopetrich has joined #tripleo10:46
*** Marga__ has joined #tripleo10:47
*** Marga_ has quit IRC10:47
*** Marga__ has quit IRC10:48
*** Marga_ has joined #tripleo10:48
*** jprovazn has joined #tripleo10:50
*** Marga_ has quit IRC10:53
jistr /Main/Pacemaker::Resource::Service[mongod]/Pacemaker::Resource::Systemd[mongod]/Pcmk_resource[mongod]: Dependency Mongodb_conn_validator[mongodb] has failures: true10:53
jistrhuh10:53
jistrordering problem again10:54
*** adrianopetrich has quit IRC10:54
*** weshay has joined #tripleo10:55
mariosguys which one fixed the httpd file ensure again?10:56
marios1;31mError: Could not set 'file' on ensure: No such file or directory - /etc/httpd/conf/httpd.conf20150515-24698-fyqv6s10:56
gfidentehuh?10:56
marioshehe... sec looking closer10:57
jistrmarios: up-to-date tripleo-puppet-elements and puppet-horizon fixes that. /cc jtomasek10:57
marios(I thought it was somethign i'd seen a lot last week), may still be ^^^10:57
mariosjistr: thx10:57
jistrmarios: you hit that on RDO, not devtest, right?10:58
mariosjistr: rdo yeah10:58
mariosjistr: i haven't applied anything to puppet elements10:58
mariosjistr: so i guess i have to pull master and rebuild images10:58
jtomasekjistr: so openstack-puppet-elements is already updated? I was having the issue yesterday that puppet-horizon was not updated there10:59
mariosjistr: https://github.com/openstack/tripleo-puppet-elements/commits/master10:59
*** lazy_prince has quit IRC10:59
mariosi don't think i see it there10:59
jtomasekjistr: because instack-undercloud started using package installation of puppet elements instead of source recently10:59
mariosah11:00
gfidentemarios, I think the update is in puppet-horizon11:00
jistrjtomasek, marios: puppet-horizon is in OPM. I don't see it updated yet https://github.com/redhat-openstack/openstack-puppet-modules11:00
gfidenteis it the overcloud or the undercloud failing?11:00
mariosgfidente: overcloud controller11:00
gfidentein overcloud it only landed a week ago11:00
jistrjtomasek: i saw you discuss that yesterday with someone, not sure if someone took some action re updating it11:00
jtomasekyes, that is the problem11:00
* gfidente not sure, marios mentioning overcloud and there packages are from git no?11:01
jtomasekjistr: I think mmagr was about to do it11:01
jtomasekbut it apparently is not there yet11:01
gfidentes/packages/modules/11:01
gfidentejtomasek, what is the commit supposedly fixing?11:02
jtomasekjistr: in the end we need to see a new build of openstack-puppet-modules here: http://trunk.rdoproject.org/centos70/report.html11:02
jtomasekgfidente: it adds latest updates to puppet-horizon. For me it is adding tuskar-ui configuration options that I can use in instack-undercloud to configure tuskar-ui11:03
jistrok i'll see if i can figure out how to submit a change to OPM :D11:03
jtomasekjistr: what is the problem you're experiencing?11:03
jistrjtomasek: it's broken for marios when using RDO because we don't have the updates there yet11:04
jistr[12:56:28] <marios> 1;31mError: Could not set 'file' on ensure: No such file or directory - /etc/httpd/conf/httpd.conf20150515-24698-fyqv6s11:04
mariossec...11:04
marioshttp://paste.openstack.org/show/223696/11:05
*** Marga_ has joined #tripleo11:05
mariosliek dis11:05
mariosjtomasek: this the one?11:05
jtomasekjistr: marios: I think mrunge can help us with this to confirm things, but as I am looking at the openstack-puppet-elements we have here: http://trunk.rdoproject.org/centos70/latest-RDO-trunk-CI/11:06
jtomasekjistr: it is even older version, which misses collectstatic command, which might cause problems11:07
mariosjtomasek: ok, so maybe i have stale environment?11:07
jtomasekmarios: I don't think so11:07
* marios misunderstands. 11:07
jistrso yeah we need two things: puppet-horizon update in OPM and rebase of tripleo-puppet-elements11:07
mariosjtomasek: ok, can i justa pply your change to my setup?11:07
mariosjtomasek: can you point me to the reviews then i can just use those for now11:07
jtomasekmarios: the latest package just didnt pass our ci yet11:07
jtomasekmarios: let me check your trace, I'll try to search whats the problem there11:08
mariosjtomasek: ok, thanks i will wait then np and no intent to rush/pressure11:08
mariosjtomasek: please carry on with whatever you were doing11:08
jtomasekmarios: but I am almost sure this is caused by the switch to puppet packages instead of git source11:08
mariosjtomasek: i can work with this (I jus want to see pcs green for neutron services, by this point they are, well, were last week when i was hitting this)11:09
mariosjtomasek: jistr thanks11:09
jtomasekmarios: ok11:09
openstackgerritJames Slagle proposed openstack/tripleo-incubator: Document needed pins for Puppet  https://review.openstack.org/18347811:12
*** panda has quit IRC11:14
*** panda has joined #tripleo11:14
*** masco has quit IRC11:38
*** adrianopetrich has joined #tripleo11:48
*** ifarkas has quit IRC11:52
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Align puppet Controller post-deploy Deployment names  https://review.openstack.org/18238111:56
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: Add support for generic controller validations  https://review.openstack.org/17415011:56
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates: overcloud stepped deployment environment  https://review.openstack.org/16192711:56
*** Marga_ has quit IRC11:56
*** ifarkas has joined #tripleo11:58
*** morazi has joined #tripleo12:02
*** dprince has joined #tripleo12:02
*** Marga_ has joined #tripleo12:07
*** links has joined #tripleo12:13
*** lucasagomes is now known as lucas-hungry12:17
*** ukalifon has joined #tripleo12:20
jprovaznjdob, morning12:22
jdobmorning12:22
jdober, afternoon?12:22
jdobgood *12:22
jdobwe'll leave it at that12:22
jdobgood $TIMEZONE, i like that better12:22
jdob...12:22
jdobi swear i havent been drinking12:22
jprovaznjdob, :) thanks for the patch, it works as expected12:22
dasmjdob: +1 :)12:23
jdobjprovazn: \o/  i was worried this was gonna be bad news12:23
jprovaznjdob, I was about to +2 your patch, though I can hold on until you are sure WIP can be removed (which I think it can)12:24
jdobya, the WIP was largely waiting on you, so i'll remove it12:24
jprovazncool12:24
*** ukalifon has quit IRC12:26
*** Marga_ has quit IRC12:30
*** jayg|g0n3 is now known as jayg12:32
*** jtomasek has quit IRC12:38
jistri reverted to spredzy|afk 's approach to dealing with mongodb because of an issue, but puppet has this in the logs12:41
jistr /Stage[main]/Mongodb::Server::Service/Service[mongodb]/ensure: ensure changed 'stopped' to 'running'12:41
jistrwe don't want that12:41
jistri think we'll need to merge the two approaches12:42
jistrugly things :/12:42
jistrwe need this https://github.com/puppetlabs/puppetlabs-mongodb/pull/19812:42
jistrthen everything will be nice again12:42
*** derekh_ has joined #tripleo12:49
gfidentereverted as in git revert?12:50
gfidenteI think mongo isn't a priority in pacemaker12:50
gfidenteso we can keep the 'presence' check, let systemd start it and cope with pacemaker when the PR is merged?12:51
*** jayg is now known as jayg|g0n312:51
*** jayg|g0n3 is now known as jayg12:51
jistrgfidente: no, only within the patch to fix HA, not git revert12:52
jistrstill trying to find the correct solution for mongodb12:52
*** derekh has quit IRC12:52
gfidenteyeah how about we remove the resource and let systemd deal with it until PR is merged?12:52
*** rhallisey has joined #tripleo12:52
gfidentejistr, in which case, we just need to keep the presence exec to make sure the replicaset is created when nodes are online\12:54
jistrgfidente: you mean remove mongodb from pacemaker?12:55
gfidenteyes12:55
*** links has quit IRC12:57
jistrgfidente: well, maybe... we could also let systemd and pacemaker race for now :D it might not cause it to fail, but we need to fix it subsequently12:57
jistrgfidente: i'm testing a thing that might actually fix it for good until we get PR 198 merged12:57
gfidenteyeah but I meant to say we don't need to work on it urgently12:58
gfidenteso we can wait for the PR12:58
*** pblaho has quit IRC12:58
*** sdake has joined #tripleo13:00
jistrhuh funny... so i now prevented the service {....} from starting it and let pacemaker deal with it, which fails the deployment... there's something fishy in there13:02
openstackgerritDan Prince proposed openstack/tripleo-incubator: Generate multiple baremetal MACs in sequence  https://review.openstack.org/18350313:02
jistrack re not dealing with it right now13:02
*** sdake_ has quit IRC13:02
*** sdake_ has joined #tripleo13:03
jistrgfidente: so i'll remove the rabbit fix from my commit and rebase on top of the commit you extracted13:03
*** pblaho has joined #tripleo13:04
gfidentejistr, thanks13:04
gfidenteor even keep them not depending on each other13:04
gfidentewhatever13:04
*** sdake_ has quit IRC13:07
*** sdake has quit IRC13:07
*** akrivoka has quit IRC13:08
jistrgfidente: https://review.openstack.org/#/c/181398/3/puppet/manifests/overcloud_controller_pacemaker.pp13:10
jistrgfidente: why flip the order of service vs. cookie?13:10
jistrgfidente: i'm a bit concerned that it might confuse us if we try to consolidate into a single manifest for pcmk + non-pcmk in the future13:11
*** sdake has joined #tripleo13:11
hewbroccadprince: hey... what do you think about flipping the default overcloud network mode in CI over to vxlan?13:13
hewbroccadprince: I have a sense nobody in the real world cares about GRE13:13
gfidentejistr, the flip is because ::rabbitmq makes sure the software is installed, so for file class to use a valid path13:14
gfidenteI should probably do that in the non-pacemaker version as well and I just forgot about it ...13:14
dprincehewbrocca: we've got enough CI jobs to run both I think.13:15
jistrgfidente: hmm but in the non-pacemaker case is also starts the service13:15
gfidenteah non-pacemaker passes config_cluster true so it's fine13:15
gfidenteyeah so all is well there13:16
dprincehewbrocca: there is also the vlan case as well, which we aren't covering in CI either13:16
jistrgfidente: and by that time the cookie has to be already present afaik13:16
jistrgfidente: would you be ok with not flipping the order in this commit and only addressing the issue in the commit message?13:16
hewbroccadprince: Indeed13:16
gfidentejistr, yes I am okay13:16
hewbroccaI'm less clear on how we CI vlan13:17
gfidenteI don't see why you don't want to do it?13:17
openstackgerritDerek Higgins proposed openstack/tripleo-puppet-elements: Ensure the hieradata directory isn't world readable  https://review.openstack.org/18350913:17
hewbroccabut I would love to get CI on vxlan if it is at all possible13:17
dprincehewbrocca: I'm fine having a job on vxlan. I think it is pretty simple actually.13:17
dprincehewbrocca: you should totally submit this tripleo-ci patch BTW ;)13:18
jistrgfidente: cool thx. Because i don't want the versions to diverge more than necessary, and it's also counterintuitive that the pcmk and non-pcmk version have the dependency order flipped without further documentation at least in the commit message.13:18
jistrgfidente: given that we deploy from images, the path should already exist there anyway13:18
dprincehewbrocca: but if you aren't interested I can look at it too :)13:18
gfidentejistr, where is tha they diverge?13:18
jistrgfidente: so keeping it the current way wouldn't be an issue either13:18
gfidentejistr, I must miss something13:18
hewbroccadprince: you are right, I should13:18
hewbroccaIt will take me three days to figure out how to do it though :)13:19
slaglethere's a weekend coming up13:19
jistrgfidente: after the patch, pcmk would have "rabbitmq -> cookie" but non-pcmk would have "cookie -> rabbitmq"13:19
jistrwhich i think is pretty confusing13:19
dprincehewbrocca: first we'll test that it works. Something like this: https://review.openstack.org/#/c/183092/1/toci_gate_test.sh,cm13:19
gfidentejistr, non-pcmk doesn't have cookie13:19
dprincehewbrocca: then we can add a specific section for the vxlan job... Then we can either chnage the default for Fedora or something to it. Or go to infra and add a "-vxlan" varient of one of our existing jobs.13:20
jistrgfidente: ah i thought it did have since we had non-pcmk experiments with multi-node at some point13:21
gfidentejistr, non-pcmk doesn't need it because module handles cluster_config13:21
gfidentejistr, so we're good to go I think13:21
dprincehewbrocca: I can handle it if you want. But it would be easy to start I think... because the params exist in the Heat templates already.13:21
jistrgfidente: ok then, that makes sense, thx :)13:22
*** pblaho has quit IRC13:22
gfidentejistr, alternativel I can make file depends on rabbit::install13:23
*** sdake has quit IRC13:23
jistrgfidente: nah that's fine, i was concerned just about the divergence of the manifests, but they'd be diverged anyway13:24
gfidenteack13:24
derekh_dprince: slagle this patch switches up to F21 jenkins nodes, can ye ACK (if ye agree of course) so infra know its ok https://review.openstack.org/#/c/183513/13:27
jprovaznthrash, good morning13:28
gfidentederekh_, I have this as well for ceph https://review.openstack.org/#/c/183473/, will rebase on your13:28
thrashjprovazn: hello13:28
dprincederekh_: thanks, looking13:28
jprovaznthrash, I'm about to add a CLI command which allows removing specific nodes from overcloud - IOW user can pass nova instance ids which he wants to remove, I wonder what would be ideal CLI command naming?13:30
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes  https://review.openstack.org/18310313:30
derekh_gfidente: ok, cool, thanks13:30
*** lucas-hungry is now known as lucasagomes13:31
thrashjprovazn: wouldn't you just use the existing nova commands for that?13:31
jprovaznthrash, this is not so straightforward, required steps are:13:32
jprovazn2) for compute nodes delete compute service13:32
jprovazn3) find tuskar role for specified nodes13:32
jprovazn4) decrease count of nodes for each of the roles in tuskar plan13:32
jprovazn5) update heat stack with update counts for each of roles, use "removal_policies" property of role's ResourceGroup to specify node ids13:32
thrashjprovazn: all of the 'openstack server' commands13:32
thrashjprovazn: ok...13:33
jprovaznthrash, IOW using just nova command is not sufficient, and an wrapper CLI command would be handy13:33
*** sdake has joined #tripleo13:35
jprovaznthrash, how about use "openstack overcloud scaledown stack" (and rename existing to "openstack overcloud scaleup stack"?13:35
*** tzumainn has joined #tripleo13:35
thrashjprovazn: -113:35
thrash:D13:35
jprovazn:)13:35
thrashif you see it as the opposite of the existing command...13:36
thrashand you probably don't want it handled in the same class...13:36
thrashlet me think about it for a minute.13:36
jprovaznprobably different class - parameters passed for scaledown are different - no roles/nums, just list of instance ids to remove13:37
thrashjprovazn: ok13:37
*** akrivoka has joined #tripleo13:39
hewbroccaI would love to say that I will add that13:39
hewbrocca(vxlan CI)13:39
hewbroccaand I will have a look just so I understand how...13:39
hewbroccabut the chances of it actually happening are between slim and none :)13:39
thrashjprovazn: what's the terminology... node? server? host?13:40
thrash'openstack overcloud node delete' is where I am leaning.13:40
jprovaznthrash, that might work pretty well too, regarding the terminology - I expect nova instance ids, but I like "node" most probably13:42
thrashunless I'm missing the point.13:42
*** sdake has quit IRC13:42
thrashhowever, I would expect that command to only take one node13:43
jprovaznthrash, -113:43
jprovaznthrash, I should probably check with PM input, but I can imagine single node as very limiting13:43
thrashlet me check on something.13:44
zanebo/13:44
*** ryansb has joined #tripleo13:44
jprovaznzaneb, ^ what do you think about single vs multiple nodes when doing remove? I think we should support multiple13:45
thrashjprovazn: looks like multiple is kosher13:45
thrashgo for it.13:45
thrash:)13:45
thrashI just looked at the 'openstack server delete' command...13:45
jprovaznthrash, cool, thanks!13:45
thrashhelp=_('Server(s) to delete (name or ID)'),13:45
zanebcan't think of a reason not to allow multiple13:45
*** regebro has quit IRC13:46
thrashjprovazn: https://github.com/openstack/python-openstackclient/blob/master/openstackclient/compute/v2/server.py#L56213:46
jprovaznzaneb, ack, I address multiple anyway13:46
thrashjprovazn: and I've done a little bit of discovery, and have determined how to call other commands, which sounds like will be helpful to you.13:47
jprovaznthrash, thanks for the link13:47
thrashfor instance, calling the 'server delete' command directly.13:47
jprovaznthrash, what do you mean by calling the 'server delete' command directly.?13:48
thrashThere is an 'openstack server delete' command in openstackclient.13:48
jprovaznyes13:49
jprovaznah, right13:49
thrashIf you were going to script this outside of the plugin, would you use that command?13:49
thrashI think you see what I mean. I've just figured out how to call that from within the plugin.13:50
jprovaznthrash, you mean this call? compute_client.servers.delete(server_obj.id)13:51
thrashyeah... I guess that's an easier case. :P13:51
thrashSince that's a simple enough api to use.13:52
thrashif you had a more complex example, and you just want to call the command as if it were run from the cli, and didn't want to duplicate error checking that may already be in the existing command...13:52
jprovaznin my case, this scaledown will be in tripleo-common lib, so I will refer to tripleo-common instead13:53
thrashjprovazn: I see... So that wouldn't help you necessarily..13:53
*** fungi has joined #tripleo13:53
thrashBecause I'm guessing you don't want to refer to osc code directly in tripleo-common13:54
jprovaznthrash, correct13:54
jprovaznthrash, ok, thanks for the help!13:54
thrashnp13:55
*** jprovazn is now known as jprovazn_bbl13:56
*** fungi has left #tripleo13:56
*** fungi has joined #tripleo13:57
*** BadCub-Hiding is now known as BadCub13:59
*** fungi has left #tripleo14:01
*** regebro has joined #tripleo14:06
jayggfidente jistr: question, when testing patches here, I need to set overcloud-resource-registry-puppet.yaml::OS::TripleO::ControllerConfig: puppet/controller-config-pacemaker.yaml, but what is the best way to do that? altering the file leaves me with a local change I need to be sure not to accidentally commit14:08
*** sdake has joined #tripleo14:08
gfidentejayg, https://review.openstack.org/#/c/183472/1/toci_gate_test.sh,cm14:10
gfidenteyou can define that in a file and point OVERCLOUD_CUSTOM_HEAT_ENV there14:10
gfidentethanks dprince for that :P14:10
jistrhttps://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L40-L4814:11
* jistr too slow :D14:11
jaygthanks guys!14:12
gfidentejayg, now you're called into real work14:12
gfidenteno excuses14:12
gfidente:P14:12
jayghaha14:12
*** sdake has quit IRC14:16
*** dasm is now known as dasm|afk14:17
*** mcornea has quit IRC14:18
*** bvandenh has joined #tripleo14:20
openstackgerritSteven Hardy proposed openstack/tripleo-incubator: Adding stepped deployment to devtest_overcloud.sh  https://review.openstack.org/16210914:20
openstackgerritSteven Hardy proposed openstack/tripleo-incubator: Add support for overriding cache just for seed  https://review.openstack.org/16310814:20
*** jcoufal has quit IRC14:21
*** adrianopetrich has quit IRC14:21
openstackgerritDan Prince proposed openstack/tripleo-incubator: Rename brbm.xml template to net.xml  https://review.openstack.org/18353914:23
openstackgerritDan Prince proposed openstack/tripleo-incubator: setup-network: add support for vlan trunks  https://review.openstack.org/18354014:23
openstackgerritDan Prince proposed openstack/tripleo-incubator: Move vm.xml to domain.xml  https://review.openstack.org/18354114:23
*** sdake has joined #tripleo14:28
*** adrianopetrich has joined #tripleo14:33
*** adrianopetrich has quit IRC14:46
*** bvandenh has quit IRC14:47
*** adrianopetrich has joined #tripleo14:50
*** eghobo has joined #tripleo14:59
*** aufi has quit IRC15:00
openstackgerritDan Prince proposed openstack/tripleo-incubator: Generate multiple baremetal MACs in sequence  https://review.openstack.org/18350315:00
*** untriaged-bot has joined #tripleo15:00
untriaged-botUntriaged bugs so far:15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145517515:00
openstackLaunchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107)15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985215:00
openstackLaunchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)15:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985415:00
openstackLaunchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480315:00
openstackLaunchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New]15:00
untriaged-bothttps://bugs.launchpad.net/tuskar/+bug/145275215:00
openstackLaunchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed]15:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480215:00
openstackLaunchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New]15:00
*** untriaged-bot has quit IRC15:00
*** eghobo_ has joined #tripleo15:01
*** radez_g0n3 is now known as radez15:02
*** sdake_ has joined #tripleo15:03
*** eghobo has quit IRC15:04
*** rlandy has quit IRC15:06
*** yog_ has quit IRC15:07
*** sdake has quit IRC15:08
*** gus has quit IRC15:08
*** gus has joined #tripleo15:09
gfidentejistr, I was wondering, regarding https://review.openstack.org/#/c/181398/ L33315:09
gfidenteis the require safe there given in step 2 we don't ented the step 1 conditional?15:10
jistrgfidente: we do enter the step 1 conditional in step 2, as there's ">="15:11
gfidenteAH :P15:11
gfidenteright :)15:11
jistrall the changes to manifests in steps are supposed to be additive15:11
gfidenteyeah sorry15:11
gfidenteso I won't even make it depend on File15:11
gfidenteI'll leave it as is15:11
gfidenteI think we should patch the upstream module for that15:11
gfidenteit doesn't look like there is any reason why the cookie should be only written if clustered15:12
gfidenteI mean, it's not 'needed' but one might still want to have control over which cookie is used15:12
jistrbtw i saw an intermittent db sync issue right now :(15:12
jistrwill investigate after scrum15:12
jistri think it's not the first time we've hit that one15:12
jaygwhat kind of issue?15:12
jistrnova db sync fail15:12
jayghmm, ok15:13
*** jistr is now known as jistr|mtgh15:15
*** jistr|mtgh is now known as jistr|mtg15:15
*** rhallisey has quit IRC15:25
*** rhallisey has joined #tripleo15:26
*** jistr|mtg is now known as jistr15:28
jistrso actually, we're not alone here15:28
*** eghobo_ has quit IRC15:28
jistrEmilienM is hitting the same issue with SpinalStack https://bugzilla.redhat.com/show_bug.cgi?id=122056715:29
openstackbugzilla.redhat.com bug 1220567 in openstack-nova "`nova-manage db sync` randomly fails" [Unspecified,New] - Assigned to eglynn15:29
*** radez is now known as radez_g0n315:29
jistrso it might not be a problem in our manifests after all15:29
*** weshay has quit IRC15:30
*** yamahata has joined #tripleo15:30
*** akrivoka has quit IRC15:30
openstackgerritYanis Guenane proposed openstack-infra/tripleo-ci: Provide a longer timeout for HA scenario  https://review.openstack.org/18356915:31
*** rhallisey has quit IRC15:33
EmilienMjistr: quick comment on https://review.openstack.org/#/c/18139815:37
openstackgerritYanis Guenane proposed openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes  https://review.openstack.org/18310315:39
jistrEmilienM: replied15:40
EmilienMjistr: ok, +115:40
*** weshay has joined #tripleo15:43
gfidenteEmilienM, the point to flip class/file was hat class makes sure the path exists before file15:46
gfidenteEmilienM, I was saying this should be sorted in the module though, the module does create the cookie but only when cluster_config true15:46
gfidentelooks a bit like unneeded dependency, like sync_db15:46
*** hewbrocca has quit IRC15:46
EmilienMgfidente: maybe something to patch in puppetlabs-rabbitmq15:49
gfidenteyeah15:50
gfidentederekh_, https://review.openstack.org/#/c/181114/15:51
*** rhallisey has joined #tripleo15:51
*** alop has joined #tripleo15:51
*** jrist has quit IRC15:52
derekh_gfidente: looking15:52
*** dshulyak has quit IRC15:53
openstackgerritMerged openstack/tripleo-incubator: Wire in load-images  https://review.openstack.org/17552215:53
gfidentederekh_, that was depending on ^^15:53
jistractually the db syncs run on all controllers it seems, not only on bootstrap host15:54
* jistr investigates15:54
gfidentederekh_, and finally makes this possible https://review.openstack.org/#/c/177060/15:54
gfidentedprince, ^^15:54
dprincegfidente: yes, thanks for looking at these :)15:56
*** ifarkas has quit IRC15:58
*** shakamunyi has quit IRC16:00
*** barra204 has quit IRC16:00
*** sdake_ has quit IRC16:00
*** Marga_ has joined #tripleo16:00
greghaynesSpamapS: curious if you agree on https://review.openstack.org/#/c/182364/16:01
SpamapSgreghaynes: I disagree16:02
greghaynesWhyfor? :)16:02
SpamapSgreghaynes: the distro elements are actually a pretty awesome way to assert the name. lsb_release is _HEAVY_16:02
*** lucasagomes is now known as lucas-packing16:02
jistrgfidente, spredzy|afk: re passing "=> undef" https://projects.puppetlabs.com/issues/16221 https://projects.puppetlabs.com/issues/1639616:02
SpamapSgreghaynes: worth noting that while lsb-release is a single package in Debian and Ubuntu, in fedora they have to pull in all of LSB16:03
jistrgfidente, spredzy|afk: it looks like it's meant to pick up the default in that case, not keep that undef value16:03
jistrthat's why the service_ensure => undef trick didn't work for us...16:03
greghaynesthats fine, if we want to encode that and hopefully enforce it somehow then id be ok with it. My concern is we havent actually established that convention (its not codified anywhere ATM) and until very recently all the distro elements didnt set it (some still might not)16:04
jistrjayg: ^^16:04
EmilienMspredzy|afk: have you looked https://review.openstack.org/181398 ?16:04
*** akrivoka has joined #tripleo16:05
EmilienMgfidente: I'm trying to make a patch in puppetlabs-rabbitmq16:05
gfidenteEmilienM++16:05
EmilienMgfidente: so, we should be able to create the cookie without cluster_config = True, right?16:05
jistrgfidente, spredzy|afk, jayg: it would work if we pass that undef directly to a class which calls that resource, but if it's proxied through another class, it will pick up a default value on the way. It's best visible from the first link i pasted. Puppet can be surprising sometimes :)16:06
* jayg reads back16:06
jistrjayg: i'm referring to the fact that this doesn't do the trick and puppet in the end ensures it to 'running' https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/manifests/overcloud_controller_pacemaker.pp#L8716:08
*** dshulyak has joined #tripleo16:09
jaygsigh16:09
*** Goneri has quit IRC16:09
jistrspredzy|afk has a patch that will fix things for us though https://github.com/puppetlabs/puppetlabs-mongodb/pull/19816:09
greghaynesSpamapS: ok, updated my comment16:10
jaygjistr: so we are doing something different here than we did in quickstack, I guess?  I don't think we had this problem16:10
gfidenteEmilienM, I'd say so, it is essential to share cookie when clustered16:10
jaygI do remember seeing the mongo patch16:10
gfidentebut one might want to set a specific cookie even though nodes are not clustered16:10
EmilienMI gfidente why not setting config_cluster at true then?16:10
gfidentecluster true is for the module to setup the rabbitmq cluster16:11
SpamapSgreghaynes: let's follow up with an entry in README about the operating-system provides that it should set that variable.16:11
gfidentewe don't really want the module to do the clustering, only to make sure it uses same cookie across all nodes16:11
gfidenteI think, apart from pacemaker needs, one might legitimately want to set some specific cookie even on single node16:12
gfidenteI read it a bit like setting the horizon secret for the cookies16:12
*** BadCub is now known as BadCub-Traveling16:12
gfidenteit's not necessary to customize, but you might want to do it16:12
EmilienMgfidente: why not defining ::rabbitmq::erlang_cookie ?16:12
greghaynesSpamapS: Theres also the case of if someone is depending on those elements and using their own distro element which doesnt set it...16:12
gfidenteoh we do that16:12
gfidentebut module only uses that if config_cluster true16:12
EmilienMah16:12
gfidenteor that is my interpretation16:12
*** jrist has joined #tripleo16:13
jistrjayg: dunno where's the difference there :/ i was actually able to switch that off truly via a collector, but then the deployment failed, pacemaker didn't start the service on two nodes again, possibly another "config file was written on *all* nodes" vs. "pcs resource create" race condition...16:13
EmilienMgfidente: I see the bug now16:13
EmilienMgfidente: sorry16:13
EmilienMgfidente: writing a fix right now16:13
gfidenteEmilienM, https://github.com/puppetlabs/puppetlabs-rabbitmq/blob/master/manifests/config.pp#L15516:14
jistrjayg: didn't investigate that deeply though so i might be wrong16:14
EmilienMgfidente: patch is coming16:15
*** dshulyak has quit IRC16:18
openstackgerritDan Prince proposed openstack/tripleo-incubator: devtest_testenv.sh: support for multiple bridges  https://review.openstack.org/17788016:19
openstackgerritDan Prince proposed openstack/tripleo-incubator: Rename brbm.xml template to net.xml  https://review.openstack.org/18353916:19
openstackgerritDan Prince proposed openstack/tripleo-incubator: setup-network: add support for vlan trunks  https://review.openstack.org/18354016:19
openstackgerritDan Prince proposed openstack/tripleo-incubator: cleanup-env: Allow configurable bridge names.  https://review.openstack.org/17787716:19
openstackgerritDan Prince proposed openstack/tripleo-incubator: Move vm.xml to domain.xml  https://review.openstack.org/18354116:19
openstackgerritDan Prince proposed openstack/tripleo-incubator: Wire --vlan-trunk-ids into devtest_testenv.sh  https://review.openstack.org/18358816:19
*** adrianopetrich has quit IRC16:20
*** rhallisey has quit IRC16:22
gfidenteEmilienM, the rabbit change, why -1 though? :(16:23
gfidentethe reason for that is the steps not the cookie16:24
EmilienMgfidente: to track my work16:24
EmilienMgfidente: ok16:24
EmilienM+1 if you like16:24
gfidentecookie was already there16:24
EmilienMok ok16:24
gfidentewe shall make sure to remove it16:24
EmilienMyou can merge it without me16:24
gfidenteactually, how do we make sure it won't break16:24
gfidenteafter the change to rabbitmq module get in?16:24
gfidenteoh it won't anyway, will just overwrite the same file ...16:25
*** dtantsur is now known as dtantsur|afk16:25
gfidente... so seems safe to me, when rabbitmq change merges we cleanup16:25
*** derekh_ has quit IRC16:25
gfidentemaybe we add a comment there?16:25
gfidenteEmilienM, you have a link to the rabbitmq change?16:25
dprincedsneddon: hitting occasional issues w/ https://review.openstack.org/#/c/183503/216:27
dprincedsneddon: added a comment with the error I'm seeing (occasionally)16:27
EmilienMgfidente: I'm writting unit test16:29
gfidenteEmilienM, ack :)16:29
dprincedsneddon: I added notes to the top of the etherpad for how I'm testing this stuff too https://etherpad.openstack.org/p/tripleo-service-endpoints16:29
dsneddondprince, Thanks, I'll take a look16:30
dprincedsneddon: this is how I do it: devtest_testenv.sh --baremetal-bridge-names="brbm brbm2 brbm3" --vlan-trunk-ids="10 20 30 40 50" ~/testenv.json16:30
greghaynesadam_g: do youall have your own distro element?16:30
dprincedsneddon: brbm is for provisioning (the ctlplane)16:31
greghaynesadam_g: or have you just been dealing with the debian breakage16:31
dprincedsneddon: the other two bridges are what I'm bonding16:31
dprincedsneddon: all the bridges support the VLAN IDs. Which isn't required on brbm but it doesn't hurt anything there either because we have VLAN 0 set to untagged16:31
*** eghobo has joined #tripleo16:32
adam_ggreghaynes, ive just been using dib<0.1.4316:33
dsneddondprince, This isn't a valid MAC address, look at the "100": '00:98:15:2c:7f:100'16:33
dprincedsneddon: I know!16:33
greghaynesadam_g: ah16:33
dprincedsneddon: I have written some apparently bad code :)16:33
adam_ggreghaynes, tho i still hit that cloud-utils issue anytime i try with the latest. any ideas?16:33
greghaynesadam_g: none :(16:33
*** sparkycollier has joined #tripleo16:33
greghaynesmaybe SpamapS can provide some wisdom16:34
dprincedsneddon: I think a corner case isn't being handled16:34
EmilienMgfidente: https://github.com/puppetlabs/puppetlabs-rabbitmq/pull/35216:34
SpamapSgreghaynes: most of my wisdom comes from fortune cookies16:34
EmilienMgfidente: can you review it and let me know if it's what you want?16:34
*** eghobo_ has joined #tripleo16:34
adam_ggreghaynes, nothing looks broken package wise, its as if the local dpkg db is corrupted or something16:34
SpamapSadam_g: do we need to add distro test builds to our CI? I'd be really happy to do so btw.16:35
greghaynesSpamapS: http://logs.openstack.org/61/181161/4/check/gate-dib-dsvm-functests-devstack-trusty/91bd92d/console.html.gz#_2015-05-08_20_38_23_50116:35
jistrgfidente, jayg: i think the next thing we need to do for green CI is figure out why db sync happens on all nodes and not just bootstrap. I even extracted the assignment to top level like this, but doesn't help http://fpaste.org/222369/31707668/16:35
greghaynesSpamapS: That is specifically what I was trying to add when I ran into this :)16:35
SpamapSgreghaynes: aha!16:35
*** Marga_ has quit IRC16:35
SpamapSthat looks like good old fashioned apt skew16:36
SpamapSgreghaynes: it fails like this every time?16:36
gfidentejistr, we'll talk next week :)16:36
greghaynesSpamapS: yes16:36
SpamapSoh wait16:36
greghaynesSpamapS: disk-image-create debian should repro16:36
SpamapSis that debian unstable?16:36
jaygjistr: that is weird, seems like it should do what you want16:36
greghaynesSpamapS: I believe so16:36
SpamapSit's _entirely_ possible unstable is just screwed16:36
adam_gyea16:37
SpamapSIt happens way less often these days but it's still possible16:37
adam_gtho the packages looks fine and their dependencies are there16:37
adam_gin fact, the dependencies are all already installed16:37
jistrjayg, gfidente: yeah exactly, i'm looking at it in awe, wondering what's wrong. Maybe fresh Monday eyes will see it better.16:37
adam_gAFAICS there was no reason either of those couldn't be installed16:37
SpamapSyeah unstable is just broken16:37
greghayneshah16:38
greghaynesok, seems like we shouldnt unstable by default anyhow16:38
greghaynesI wonder if we were before...16:38
*** eghobo has quit IRC16:38
jaygjistr: one can hope!16:38
gfidente^_^ :)16:38
SpamapSno bugs reported yet16:39
EmilienMjistr: can you review also please ?16:39
EmilienMjistr: https://github.com/puppetlabs/puppetlabs-rabbitmq/pull/35216:39
gfidenteEmilienM, the change in code looks good to me but16:40
SpamapSthis is definitely weird tho16:40
gfidenteit's not that with pacemaker we don't use rabbitmq clustering, we don't let the puppet module setup the rabbitmq clustering16:40
gfidentebut we still use rabbitmq clustering at app level, it's just that pacemaker will configure rabbitmq for that16:41
gfidenteso we don't want the puppet module to do that bit of the configuration16:41
EmilienMgfidente: ok so I can just use Pacemaker as an example16:41
EmilienMgfidente: so why do you need the cookie?16:41
*** spzala has joined #tripleo16:41
EmilienMgfidente: though I think mentioning pacemake is not a bad idea, it gives a picture of the real use case and the need16:42
gfidenteEmilienM, I agree16:43
jistrgfidente, EmilienM: yeah so with EmilienM's patch we'd have it just set up the cookie iiuc, and we wouldn't have to declare the file { } in pcmk controller manifest16:44
gfidenteI'm just saying, in the description, don't make it look like we don't use rabbitmq clustering16:44
gfidentewe do, but we do the rabbitmq clustering via pacemaker16:44
gfidenteEmilienM, the trick is this16:44
gfidenterabbitmq can be configured for clustering via its config file OR at runtime16:44
gfidentepuppet module does it in config file16:45
gfidentepacemaker does it at runtime16:45
gfidentebecause it orchestrates things16:45
gfidenteso we still want puppet module to do SOME part of the configuration (eg. cookie)16:45
gfidentebut we don't want the module to configure the clustering part16:45
jistrgfidente: ack so you mean we should change the sentence in readme16:46
jistrgfidente: from "we don't want rabbitmq clustering" to something like "we don't want Puppet to set up rabbitmq clustering"16:46
*** yamahata has quit IRC16:47
jistrs/Puppet/puppetlabs-rabbitmq/ to be precise :)16:47
EmilienMgfidente: ok, updating the commit16:47
*** subscope has joined #tripleo16:48
gfidenteEmilienM, from a different perspective16:48
gfidentethere is no reason why one should prevent erlang_cookie setting based on cluster16:48
gfidentejistr, ^^?16:48
gfidentejistr one more (last!) thing16:49
jistrgfidente: right, i think that's what EmilienM is fixing16:49
jistrto give us the option to have erlang_cookie even without cluster16:49
gfidenteyep yep, I was only trying to come up with different reason16:50
gfidenteEmilienM++ indeed for taking over the task :)16:50
gfidentejistr, one last thing, for the horizon fix16:50
EmilienMgfidente: anytime :-)16:50
gfidentethere is nothing in tripleo-puppet-elements that I know of, it's just puppet-horizon change right?16:50
jistrgfidente: it's also t-p-e, but the master is fine, the issue was that RDO was behind, it still had horizon packages removed because of how horizon was broken a couple weeks ago16:51
gfidentetpe?16:52
gfidentewhat is from tpe that we need?16:52
jistrgfidente: this https://github.com/openstack/tripleo-puppet-elements/commit/12105d4869a84afdaed7f837e5f809b2caad5fe416:52
gfidentejistr, aaah but that is old stuff16:52
gfidenteit's already in tpe RPM no16:53
gfidente?16:53
gfidentewe also landed with EmilienM the config bits later16:53
SpamapS09:51 < ah> SpamapS: because util-linux Breaks: cloud-utils16:53
SpamapS09:51 < ah> SpamapS: the just uploaded 2.26.2-3 has made that Breaks versioned.16:53
SpamapSgreghaynes: ^16:53
EmilienMgfidente: I would suggest a #TODO in the code16:53
SpamapSadam_g: ^16:53
gfidenteEmilienM, ack!16:53
jistrgfidente: huh it's still not in mgt-kilo https://github.com/rdo-management/tripleo-puppet-elements/commits/mgt-kilo16:54
gfidentejistr, https://github.com/openstack/tripleo-heat-templates/commit/cf4d918cd923c228d37fc06ecadf2f48c80ef40016:54
gfidenteHOLY16:54
gfidentehow can it not be?16:54
gfidentenobody rebased?16:54
jistrprobably...16:54
gfidenteahahahah16:55
adam_gSpamapS, cool16:55
*** sparkycollier has quit IRC16:55
*** radez_g0n3 is now known as radez16:55
SpamapS  * Add Breaks on cloud-utils since it uses now-removed sfdisk options.16:55
SpamapS    - this should be made a versioned breaks once Bug#783826 gets fixed.16:55
*** radez is now known as radez_g0n316:56
SpamapSsince April 3016:56
*** pelix has quit IRC16:56
gfidentemarios, good not to rebase though16:56
*** eghobo_ has quit IRC16:56
*** radez_g0n3 is now known as radez16:56
*** sparkycollier has joined #tripleo16:57
mariosgfidente: I WILL NOT16:57
mariosI REFUSE16:57
*** radez is now known as radez_g0n316:57
greghaynesSpamapS: huh16:58
mariosgfidente: you should have a recording of me from earlier and blackmale me16:58
mariosblackmail?16:58
marios:)16:58
gfidenteno worries16:58
SpamapSgreghaynes: basically, util-linux was _trying_ to avoid people having broken cloud instances.16:58
greghaynessplendid16:59
greghaynesim guessing we can hide under a rock and use !unstable though16:59
greghaynes?16:59
*** regebro has quit IRC16:59
*** eghobo has joined #tripleo17:00
greghaynesanyhow, at least I have stuff to poke at to move that testing forward17:00
SpamapSgreghaynes: well apt is being a little obtuse here.17:01
SpamapSgreghaynes: if you try it with aptitude, it figures out that you could downgrade util-linux to avoid the breaks.17:01
greghaynesheh17:02
dsneddondprince, I'm confused. You said to run  devtest_testenv.sh --baremetal-bridge-names=[...], but my devtest_testenv.sh doesn't recognize the --baremetal-bridge-names option.17:02
gfidentebye all have nice WE :)17:02
SpamapSgreghaynes: and for people who already had cloud-utils installed, it would have avoided installing the new util-linux.17:03
dprincedsneddon: Yeah, you have to pull patches. See lines 6-11 of the etherpad17:03
*** gfidente has quit IRC17:03
dsneddondprince, Ah, right, no problem.17:03
greghaynesSpamapS: yep, im guessing the old debian was image based and had that already17:03
greghaynesSpamapS: If we include cloud-utils as part of our initial debootstrap I wonder if itll 'just work'?17:04
*** eghobo has quit IRC17:04
*** Marga_ has joined #tripleo17:04
*** eghobo has joined #tripleo17:07
*** yamahata has joined #tripleo17:10
SpamapSgreghaynes: no, debian has always been debootstrap based. Entirely possible we're adding cloud-utils in the debootstrap and that means we get old util-linux17:11
greghayneshrm17:11
*** jistr has quit IRC17:12
dsneddondprince, I think I found the issue. The line "    if (start + count) > 0xff:" should be "    if (start + (count*2)) > 0xff:"17:12
openstackgerritPino Toscano proposed openstack/diskimage-builder: doc: small snippet about operating system elements  https://review.openstack.org/18361617:15
*** panda is now known as panda|gone17:19
dprincedsneddon: looking...17:20
dprincedsneddon: yep, I think that gets it17:23
*** akrivoka has quit IRC17:25
openstackgerritDan Prince proposed openstack/tripleo-incubator: Generate multiple baremetal MACs in sequence  https://review.openstack.org/18350317:25
*** mestery has joined #tripleo17:26
*** sparkycollier has quit IRC17:30
*** daneyon has joined #tripleo17:31
*** daneyon_ has joined #tripleo17:33
*** bvandenh has joined #tripleo17:35
*** daneyon has quit IRC17:36
*** rhallisey has joined #tripleo17:38
*** dshulyak has joined #tripleo17:38
openstackgerritMerged openstack/diskimage-builder: rax-nova-agent: switch to $DISTRO_NAME  https://review.openstack.org/18236417:40
openstackgerritMerged openstack/diskimage-builder: ramdisk: switch from lsb_release to $DISTRO_NAME  https://review.openstack.org/18236217:40
openstackgerritMerged openstack/diskimage-builder: vm: use $DISTRO_NAME instead of lsb_release  https://review.openstack.org/18236317:40
*** athomas_ has quit IRC17:42
*** bvandenh has quit IRC17:42
*** subscope has quit IRC17:44
*** subscope has joined #tripleo17:49
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates: Bind novncproxy to controller_host  https://review.openstack.org/18363017:55
*** jprovazn_bbl has quit IRC17:56
*** eghobo_ has joined #tripleo18:00
*** eghobo has quit IRC18:03
openstackgerritMerged openstack/diskimage-builder: centos/centos7: switch to epel element  https://review.openstack.org/18054818:07
*** daneyon has joined #tripleo18:11
*** daneyon_ has quit IRC18:11
*** eghobo has joined #tripleo18:16
*** eghobo_ has quit IRC18:19
*** eghobo has quit IRC18:20
*** openstackgerrit has quit IRC18:22
*** openstackgerrit has joined #tripleo18:22
*** eghobo has joined #tripleo18:23
*** dshulyak has quit IRC18:25
*** Marga_ has quit IRC18:26
*** barra204 has joined #tripleo18:36
*** shakamunyi has joined #tripleo18:36
*** dshulyak has joined #tripleo18:36
*** lucas-packing has quit IRC18:43
*** bvandenh has joined #tripleo18:45
*** dshulyak has quit IRC18:50
*** lucas-packing has joined #tripleo18:55
*** Marga_ has joined #tripleo18:57
*** MasterPiece has joined #tripleo18:57
*** bvandenh has quit IRC19:00
*** Marga__ has joined #tripleo19:01
*** Marga_ has quit IRC19:01
greghaynesSpamapS: adam_g oh, hey, looks like the old debian was broken for a while too19:04
greghaynesso -minimal is not totally to blame19:04
*** Marga__ has quit IRC19:05
*** dshulyak has joined #tripleo19:06
*** dshulyak has quit IRC19:07
*** jdob has quit IRC19:09
*** Marga_ has joined #tripleo19:12
*** panda|gone has quit IRC19:14
*** Marga__ has joined #tripleo19:14
*** Marga_ has quit IRC19:14
*** panda|gone has joined #tripleo19:14
*** daneyon has quit IRC19:27
*** eghobo has quit IRC19:41
*** dshulyak has joined #tripleo19:44
*** barra204 has quit IRC19:48
*** pdb has joined #tripleo19:48
*** shakamunyi has quit IRC19:48
*** subscope has quit IRC19:54
*** eghobo has joined #tripleo20:06
*** dshulyak has quit IRC20:07
*** Marga__ has quit IRC20:08
*** Marga__ has joined #tripleo20:11
*** sparkycollier has joined #tripleo20:16
*** sparkycollier has quit IRC20:16
*** daneyon has joined #tripleo20:25
*** bvandenh has joined #tripleo20:26
*** jayg is now known as jayg|g0n320:29
*** eghobo__ has joined #tripleo20:34
*** eghobo has quit IRC20:34
*** bvandenh has quit IRC20:36
*** Marga__ has quit IRC20:39
*** Marga_ has joined #tripleo20:40
*** lucas-packing has quit IRC20:40
*** untriaged-bot has joined #tripleo21:00
untriaged-botUntriaged bugs so far:21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145517521:00
openstackLaunchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107)21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985221:00
openstackLaunchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)21:00
untriaged-bothttps://bugs.launchpad.net/diskimage-builder/+bug/144985421:00
openstackLaunchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87)21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480321:00
openstackLaunchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New]21:00
untriaged-bothttps://bugs.launchpad.net/tuskar/+bug/145275221:00
openstackLaunchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed]21:00
untriaged-bothttps://bugs.launchpad.net/tripleo/+bug/145480221:00
openstackLaunchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New]21:00
*** untriaged-bot has quit IRC21:00
*** rainya has joined #tripleo21:19
*** dprince has quit IRC21:37
*** Marga_ has quit IRC21:47
*** Marga_ has joined #tripleo21:48
*** Marga_ has quit IRC21:50
*** Marga_ has joined #tripleo21:52
*** Marga_ has quit IRC21:55
*** thrash is now known as thrash|wknd22:01
*** eghobo__ has quit IRC22:13
*** Marga_ has joined #tripleo22:14
*** pdb has quit IRC22:24
*** eghobo has joined #tripleo22:27
*** penick has joined #tripleo22:31
*** penick has quit IRC22:31
*** penick has joined #tripleo22:31
*** spzala has quit IRC22:40
*** yamahata has quit IRC22:48
*** rainya has quit IRC22:50
*** rainya has joined #tripleo22:57
*** MasterPiece has quit IRC23:05
*** Marga_ has quit IRC23:11
*** Marga_ has joined #tripleo23:18
*** Marga_ has quit IRC23:31
*** Marga_ has joined #tripleo23:40
*** rainya has quit IRC23:56
*** Marga_ has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!