Friday, 2017-03-31

openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027700:00
*** funzo has joined #tripleo00:06
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167477000:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged]00:10
*** funzo has quit IRC00:12
*** bfournie has joined #tripleo00:13
*** bfournie has quit IRC00:16
*** ramishra has quit IRC00:17
*** bfournie has joined #tripleo00:17
*** funzo has joined #tripleo00:28
*** funzo has quit IRC00:30
openstackgerritDan Trainor proposed openstack/puppet-tripleo master: Add tunnel timeout for ui proxy container  https://review.openstack.org/45201700:40
trozetdsneddon: ack. looking at it now00:42
*** limao has joined #tripleo00:44
*** funzo has joined #tripleo00:45
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167477001:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged]01:10
*** jcoufal has joined #tripleo01:11
trozetcan somone please review https://review.openstack.org/#/c/448831/ ?01:11
*** dprince has joined #tripleo01:15
*** jcoufal has quit IRC01:17
*** dprince has quit IRC01:26
*** thrash is now known as thrash|g0ne01:29
*** gbarros has joined #tripleo01:33
*** gbarros_ has joined #tripleo01:37
*** tzumainn has quit IRC01:38
*** gbarros has quit IRC01:41
*** gbarros has joined #tripleo01:41
*** gbarros__ has joined #tripleo01:45
*** gbarros_ has quit IRC01:45
*** gbarros has quit IRC01:48
*** brault|away has joined #tripleo01:48
*** brault|away has quit IRC01:53
*** oanson has quit IRC01:55
*** oanson has joined #tripleo01:56
*** dixiaoli has joined #tripleo01:58
*** gbarros has joined #tripleo02:00
*** gbarros__ has quit IRC02:03
*** yamahata has quit IRC02:08
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167477002:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1674770 in tripleo "Update timeout too long in CI" [Critical,Triaged]02:10
openstackgerritMerged openstack-infra/tripleo-ci master: Use shorter timeout for update step  https://review.openstack.org/44877802:24
*** gbarros has quit IRC02:47
*** masco has joined #tripleo02:51
*** hamzy has joined #tripleo02:58
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Run cluster check on nodes configured in wsrep_cluster_address.  https://review.openstack.org/45146703:23
*** nyechiel_ has joined #tripleo03:30
*** psahoo has joined #tripleo03:31
openstackgerritDan Trainor proposed openstack/puppet-tripleo master: Add tunnel timeout for ui proxy container  https://review.openstack.org/45201703:36
*** nyechiel_ has quit IRC03:45
*** dixiaoli has quit IRC03:48
*** nyechiel_ has joined #tripleo03:52
*** dixiaoli has joined #tripleo03:52
*** mdnadeem has joined #tripleo03:52
*** dixiaoli has quit IRC04:00
*** cwolferh has quit IRC04:15
*** gkadam has joined #tripleo04:17
*** ramishra has joined #tripleo04:18
*** masco has quit IRC04:19
*** japestinho has quit IRC04:20
*** dixiaoli has joined #tripleo04:24
*** dixiaoli has quit IRC04:25
*** dmacpher has quit IRC04:26
*** dmacpher has joined #tripleo04:37
*** janki has joined #tripleo04:41
*** skramaja has joined #tripleo04:43
*** yprokule has joined #tripleo04:48
openstackgerritSaravanan KR proposed openstack/puppet-tripleo stable/newton: Add support to changing the Rabbitmq password on update  https://review.openstack.org/45174205:02
*** ratailor has joined #tripleo05:07
openstackgerritSaravanan KR proposed openstack/puppet-tripleo stable/newton: Add support to changing the Rabbitmq password on update  https://review.openstack.org/45174205:08
*** udesale has joined #tripleo05:10
openstackgerritSaravanan KR proposed openstack/puppet-tripleo stable/newton: Add support to changing the Rabbitmq password on update  https://review.openstack.org/45174205:10
*** nyechiel_ has quit IRC05:13
*** fragatin_ has joined #tripleo05:14
*** fragatina has quit IRC05:17
*** fragatin_ has quit IRC05:18
*** prateek has joined #tripleo05:23
*** rlandy has quit IRC05:24
*** jaganathan has joined #tripleo05:26
*** Vijayendra_ has joined #tripleo05:27
*** Vijayendra has quit IRC05:27
*** brault|away has joined #tripleo05:30
*** fragatina has joined #tripleo05:31
*** fragatina has quit IRC05:31
*** fragatina has joined #tripleo05:31
*** fragatina has quit IRC05:34
*** fragatina has joined #tripleo05:34
*** dixiaoli has joined #tripleo05:35
*** aufi has joined #tripleo05:41
*** dixiaoli has quit IRC05:43
*** rcernin has joined #tripleo05:44
*** lmiccini has joined #tripleo05:44
*** yolanda has joined #tripleo05:54
openstackgerritTong Liu proposed openstack/tripleo-heat-templates master: Add initial support for NSX plugin  https://review.openstack.org/44166805:54
*** jaosorior has joined #tripleo05:56
*** dixiaoli has joined #tripleo05:59
*** dixiaoli has quit IRC06:00
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Add pre-selected Control Plane IP support.  https://review.openstack.org/41327806:01
openstackgerritTong Liu proposed openstack/puppet-tripleo master: Add resource profile for vmware nsx_v3  https://review.openstack.org/45204706:02
*** anton- has joined #tripleo06:05
*** anton- is now known as anton06:06
*** masco has joined #tripleo06:09
*** dixiaoli has joined #tripleo06:14
*** jaganathan has quit IRC06:16
*** udesale__ has joined #tripleo06:29
*** udesale has quit IRC06:31
*** udesale has joined #tripleo06:33
*** udesale__ has quit IRC06:34
*** paramite has joined #tripleo06:37
*** jaganathan has joined #tripleo06:39
*** pgadiya has joined #tripleo06:40
*** leanderthal|afk is now known as leanderthal06:44
leanderthalo/06:44
*** d0ugal has joined #tripleo06:52
*** d0ugal has quit IRC06:54
*** d0ugal has joined #tripleo06:58
*** d0ugal has quit IRC06:58
*** d0ugal has joined #tripleo06:58
*** florianf has joined #tripleo06:58
jaosoriorsshnaidm|off: there seems to be a lot of timeouts from mirror.regionone.tripleo-test-cloud-rh1.openstack.org/centos/7/os/x86_64/repodata/repomd.xml :/06:59
*** b00tcat_ has joined #tripleo07:00
*** pgadiya has quit IRC07:01
*** dparkes has joined #tripleo07:02
*** karthiks has joined #tripleo07:07
*** japestinho has joined #tripleo07:07
*** tesseract has joined #tripleo07:08
*** anshul has joined #tripleo07:10
*** pgadiya has joined #tripleo07:10
*** anshul has quit IRC07:10
*** anshul has joined #tripleo07:10
*** jpich has joined #tripleo07:14
*** anshul has quit IRC07:16
*** jprovazn has joined #tripleo07:17
*** jlinkes has joined #tripleo07:18
openstackgerritDirk Mueller proposed openstack/diskimage-builder master: DNM: give me more debug  https://review.openstack.org/45080007:21
*** d0ugal has quit IRC07:22
*** iranzo has joined #tripleo07:23
*** pmannidi has quit IRC07:26
*** d0ugal has joined #tripleo07:26
*** d0ugal has quit IRC07:26
*** d0ugal has joined #tripleo07:26
*** pcaruana has joined #tripleo07:27
*** anshul has joined #tripleo07:27
*** dixiaoli has quit IRC07:29
*** udesale has quit IRC07:30
*** udesale has joined #tripleo07:30
*** dixiaoli has joined #tripleo07:32
*** jpena|off is now known as jpena07:36
*** yprokule_ has joined #tripleo07:37
*** fragatina has quit IRC07:37
*** anton has quit IRC07:37
*** anton has joined #tripleo07:38
*** yprokule has quit IRC07:38
*** yprokule_ is now known as yprokule07:38
*** suuuper has joined #tripleo07:38
*** bogdando has joined #tripleo07:39
*** chem has joined #tripleo07:42
-openstackstatus- NOTICE: Jobs in gate are failing with POST_FAILURE. Infra roots are investigating07:46
*** ChanServ changes topic to "Jobs in gate are failing with POST_FAILURE. Infra roots are investigating"07:46
jaosoriortherve: I'm unable to deploy the overcloud :/ and it seems to be issues with zaqar getting 401's with swift http://paste.openstack.org/show/605005/07:48
thervejaosorior, Is there anything special in your setup?07:50
jaosoriorno07:52
jaosoriorjust deployed it yesterday07:52
jaosoriorwith the defaults from tripleo-quickstart :/07:52
jaosoriorI'm not even using SSL for the udnercloud07:52
thervejaosorior, Can you check zaqar user role in the undercloud?07:52
*** jprovazn has quit IRC07:53
*** katkapilatova has quit IRC07:54
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from deploy_plan  https://review.openstack.org/44643707:54
*** rcernin has quit IRC07:54
*** dtantsur has quit IRC07:54
*** yprokule has quit IRC07:54
*** yprokule_ has joined #tripleo07:54
*** yprokule_ is now known as yprokule07:54
*** jprovazn has joined #tripleo07:54
chemmarios: hi, thanks for fixing the last nit yesterday.  It looks like we have a winner for this patch :)07:54
*** tesseract has quit IRC07:54
*** katkapilatova has joined #tripleo07:55
*** tesseract has joined #tripleo07:55
jaosoriortherve: http://paste.openstack.org/show/605007/07:56
*** rcernin has joined #tripleo07:56
thervejaosorior, I think it's missing the Reseller role for swift07:56
jaosoriortherve: shouldn't that have been created in the undercloud setup?07:57
thervejaosorior, Well yeah. Probably what happens in CI otherwise everything would be broken07:57
*** dtantsur has joined #tripleo07:57
jaosoriortherve: how is that set in CI?07:58
thervejaosorior, I don't know, let me try to find it07:58
jaosoriortherve: these are the roles I currently see http://paste.openstack.org/show/605008/07:59
*** zzzeek has quit IRC08:00
thervejaosorior, And what's in your swift URI in zaqar.conf?08:02
*** gfidente has joined #tripleo08:02
thervejaosorior, https://review.openstack.org/#/c/439640/ Now I remember08:03
jaosoriortherve: http://paste.openstack.org/show/605010/08:03
therveSo it's done in puppet-zaqar08:03
*** dmacpher has quit IRC08:04
*** zzzeek has joined #tripleo08:04
openstackgerritAlfredo Moralejo proposed openstack/tripleo-quickstart-extras master: Remove setting nodes as manageable when enabling introspection  https://review.openstack.org/45208708:04
jaosoriortherve: so, for some reason, an initial deployment did work. And when I tried to redeploy it all went to shit :/.08:04
*** dixiaoli has quit IRC08:05
*** dixiaoli has joined #tripleo08:05
thervejaosorior, What do you mean by redeploy?08:06
*** athomas has joined #tripleo08:06
jaosoriortherve: openstack stack delete --yes overcloud && openstack overcloud plan delete overcloud && openstack overcloud deploy ...08:07
jaosoriorso, nuked my overcloud, and re-deployed08:07
jaosoriorfairly common operation while developing08:07
therveSo it shouldn't have touched your undercloud?08:07
jaosoriorno08:07
therveOK that doesn't make any sense :)08:08
therveIf you have the keystone logs of the undercloud that'd be interesting08:08
jaosoriortherve: what do you need from those logs?08:08
thervejaosorior, Like, is there is a DELETE of some sort08:08
jaosoriorthere is a role deletion at some point08:09
jaosoriortherve: first off08:10
*** ealcaniz has joined #tripleo08:10
jaosoriorlet's try to fix it. You say the zaqar user should have the Reseller role, right?08:10
therveYep08:10
jaosoriornot Reseller admin, right?08:10
*** zoli|gone is now known as zoli08:10
therveNo ResellerAdmin08:11
therveReseller doesn't exist08:11
jaosoriorok08:11
jaosoriorso lets do that manually first and see if that fixes this08:11
bogdandoplease merge https://review.openstack.org/#/c/447623/08:12
jaosoriortherve: dude added the role while an deploy (update) for my undercloud was running08:13
jaosoriorand I saw this in the puppet logs08:13
jaosorior2017-03-31 08:12:43,857 INFO: Notice: /Stage[main]/Zaqar::Keystone::Auth/Keystone::Resource::Service_identity[zaqar]/Keystone_user_role[zaqar@service]/roles: roles changed ['admin', 'ResellerAdmin'] to 'admin'08:13
therveThat's not nice :)08:13
jaosorioryeah08:13
*** karimb has joined #tripleo08:13
jaosoriorwell, shit08:13
thervejaosorior, Change zaqar hiera?08:14
jaosoriortherve: where?08:14
bogdandoadarazs: and https://review.openstack.org/#/c/448294/ please08:14
jaosoriortherve: I didn't change the hiera. But is the role set in hieradata somewhere?08:14
thervejaosorior, Yeah that's the puppet zaqar patch I linked08:15
thervezaqar::keystone::auth::roles08:15
jaosoriortherve: I missed the link08:15
*** dmacpher has joined #tripleo08:16
therveWait hold on, where is it used though08:16
jaosoriorright08:16
jaosoriorwtf08:16
jaosoriorI added the ResellerAdmin role and still get the error :/08:16
therveBecause it removed it behind your back, no?08:17
*** karimb has quit IRC08:17
jaosoriorright, but then I re-added it08:17
*** ccamacho has joined #tripleo08:17
jaosoriorso the undercloud deploy removed it; when that ended, I re-added it. Tried the overcloud deploy, and it still fails08:17
marioschem: hey man, yeah will hopefully get some clean runs today08:19
therveStill fail with a 401?08:19
marioschem: sorry i am staring at templates trying to figure why https://review.openstack.org/#/c/448602/7/puppet/major_upgrade_steps.j2.yaml not working08:20
thervejaosorior, FWIW https://review.openstack.org/#/c/439204/ is the other part I forgot about08:20
bogdandoneeds review please https://review.openstack.org/#/c/448543/08:20
therveIt's setting the roles properly08:20
jaosoriortherve: so this is what the zaqar logs show http://paste.openstack.org/show/605016/08:20
jaosoriortherve: aah right, but where is that done in instack-undercloud?08:21
marioschem: and wanted to come up with something new to try there before setting off the upgrade with the latest of that ovs08:21
thervejaosorior, Does it need something there as well?08:21
marioschem: but for sure will run it today and i'll update with comments there08:21
therveSo there are no 401 in there08:22
chemmarios: what do you have in mind ?08:22
jaosoriortherve: no, but mistral outputs that for some reason http://paste.openstack.org/show/605017/08:22
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Adapt getthelogs UX for more use cases  https://review.openstack.org/44955208:22
marioschem: something new, i mean for https://review.openstack.org/#/c/448602/7/puppet/major_upgrade_steps.j2.yaml not the openvswitch one08:22
d0ugaljaosorior: that is just printed out from the CLI?08:23
*** karimb has joined #tripleo08:23
thervejaosorior, So there should be a corresponding 401 in the logs08:23
jaosoriord0ugal: right08:23
*** yprokule has quit IRC08:23
d0ugalWeird08:23
flaper87slagle: EmilienM sorry for not having assumed good faith on the change to the CI job. I was a bit frustrated and let it slip w/o triple (pun intended) checking. You guys mentioned you had pinged the containers squad but I honestly didn't receive any ping. Not a big deal. I know you (both?) had a chat with mandre yday, which is awesome. Thanks08:24
*** yprokule has joined #tripleo08:24
chemmarios: ah, yes, I wanted to give it some though as well.  I'm going to have a look before midday.08:24
jaosoriortherve: depends, if it's coming from authtoken middleware one sees no logs about that :/08:24
thervejaosorior, It can't, zaqar is the one talking to swift08:25
chemmarios: when I looked yesterday it kinda made sense, nothing was obviously wrong.08:25
jaosoriortherve: why does it need the ResellerAdmin role? by the way08:26
thervejaosorior, Because of swift configuration08:26
jaosoriorok08:26
jaosoriortherve: and yeah, I think it's needed in instack-undercloud08:26
jaosorior::zaqar::keystone::auth::roles defaults to undef08:26
*** shardy has joined #tripleo08:26
jaosoriorand nothing is setting it at the moment08:26
*** social has quit IRC08:26
*** lucas-afk is now known as lucasagomes08:26
-openstackstatus- NOTICE: logs.openstack.org has corrupted disks, it's being repaired. Please avoid rechecking until this is fixed08:27
*** ChanServ changes topic to "logs.openstack.org has corrupted disks, it's being repaired. Please avoid rechecking until this is fixed"08:27
thervepoi is not on the undercloud?08:27
*** social has joined #tripleo08:27
jaosoriortherve: not at all08:27
jaosoriortherve: poi is where they test puppet modules. It's not used by the undercloud08:27
thervejaosorior, How does it work in tripleo CI then?08:27
jaosoriortherve: that's the real question here08:28
jaosoriortherve: I have no clue08:28
therveFantastic08:28
mariosthanks chem appreciate any thoughts08:30
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Update pip in DLRN venv  https://review.openstack.org/43874608:30
openstackgerritThomas Herve proposed openstack/instack-undercloud master: Set Zaqar roles  https://review.openstack.org/45209808:31
thervejaosorior, ^08:31
*** snecklifter has joined #tripleo08:31
jaosoriortherve: was trying to set up my environment to test that08:32
jaosoriortherve: great08:32
jaosoriorI'll try it out in a bit08:32
*** derekh has joined #tripleo08:32
chemmarios: ah, by the way this one has merged in master, we can unlock it https://review.openstack.org/#/c/449093/08:32
*** shardy has quit IRC08:37
marioschem: thanks08:37
ccamachohey jaororior :) dude Im trying to read some CI logs and im getting a big ERR_CONNECTION_REFUSED.. Is this a known issue?08:37
ccamacho.. from logs.openstack.org08:38
jaosoriorccamacho: check the title08:38
*** shardy has joined #tripleo08:38
jaosoriorccamacho: seems there's issues with logs.openstack.org08:38
*** salmankhan has joined #tripleo08:39
ccamachojaosorior, damned small letter size :) thanks man08:39
jaosoriorno biggie08:40
chemmarios: you explicitely want somebody else to workflow it, or it's just you forgot ? (sorry I'm boring ...)08:40
jaosoriortherve: testing it now. Removed the role from the zaqar user just to make sure it adds it there.08:40
*** snecklifter has quit IRC08:40
mariossorry just forgot done chem08:41
chemmarios: ack cool, thanks08:41
*** dixiaoli has quit IRC08:45
jaosoriortherve: ok. It adds the role as expected now. however, I still see this as the output http://paste.openstack.org/show/605022/08:50
jaosoriord0ugal: ^^08:50
*** ipsecguy has quit IRC08:51
d0ugaljaosorior: anything in the mistral logs?08:51
*** ipsecguy has joined #tripleo08:51
gfidentemarios morning08:52
jaosoriord0ugal: which of the three?08:53
d0ugaljaosorior: executor prob08:53
mariosflaper87: \o08:54
mariosgfidente: even o/ flaper87 sorry for noise08:54
*** fzdarsky has joined #tripleo08:55
jaosoriord0ugal: nothing relevant really08:55
gfidentemarios so what's the shortest path to test the change?08:55
gfidentemarios I guess I don't really need to update any package and can just deploy from master and trigger upgrade?08:56
mariosgfidente: i can't think of a short circuit. i was hoping you could try it for the ceph services i mean they are th eonly ones that use it except l3 agent08:56
d0ugaljaosorior: weird, no good ideas really.08:56
mariosgfidente: yeah right the package update doesnt matter so much, i just want to enforce the ordering of batch tasks first08:57
thervejaosorior, Can you try openstack queue create foo ?08:57
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Switch stackrc and undercloud.py to use Keystone v3  https://review.openstack.org/44675208:58
jaosoriortherve:08:58
jaosorior(undercloud) [stack@undercloud ~]$ openstack queue create foo08:58
jaosorior+-------+-------+08:59
jaosorior| Field | Value |08:59
jaosorior+-------+-------+08:59
jaosorior| Name  | foo   |08:59
jaosorior+-------+-------+08:59
therveOK so it works08:59
gfidentemarios is https://docs.openstack.org/developer/tripleo-docs/post_deployment/upgrade.html valid or do I need more steps?08:59
openstackgerritAlfredo Moralejo proposed openstack/tripleo-quickstart-extras master: Remove setting nodes as manageable when enabling introspection  https://review.openstack.org/45208709:00
jaosoriortherve: right09:00
jaosoriorso... why is not not working with tripleoclient though09:01
*** hewbrocca_afk is now known as hewbrocca09:01
jaosorioror mistral09:01
mariosgfidente: yeah is fine undercloud no current issues i'm aware of, for overcloud you'll need to apply the review to /usr/shar templates before upgrade https://docs.openstack.org/developer/tripleo-docs/post_deployment/upgrade.html#upgrading-the-overcloud-to-ocata-and-beyond09:01
thervejaosorior, Can I access your env? I don't have an idea for now09:01
gfidentemarios ack, tty in a bit09:01
gfidentethanks09:01
jaosoriortherve: you can't :/ it's not in the red hat network09:01
jaosoriorit's below my desk :/09:01
therveWell you have internet no? :)09:02
shardyjaosorior: just use tmate09:02
*** pgadiya has quit IRC09:02
therveAnyway, maybe restart the various services, refresh your tokens09:02
jaosoriorgood idea09:03
*** dixiaoli has joined #tripleo09:05
*** milan has joined #tripleo09:10
*** arxcruz|pto has quit IRC09:11
gfidentemarios seems like a syntax issue because I don't see the depends_on added in the rendered templates09:17
*** snecklifter has joined #tripleo09:17
*** pgadiya has joined #tripleo09:18
*** arxcruz|pto has joined #tripleo09:19
mariosgfidente: cool (could be a j2 loop thing?)09:19
gfidentemarios dunno, trying to mess with it locally09:20
*** jaganathan is now known as jaganathan_lunch09:22
honzaWhat does POST_FAILURE mean in gate job results?  Logs are missing.  https://review.openstack.org/#/c/451987/09:22
shardyhonza: see the channel subject, there are infra issues09:23
honzashardy: thanks09:24
* honza just woke up09:24
*** limao has quit IRC09:25
*** yatinkarel is now known as yatin_away09:26
*** pgadiya has quit IRC09:26
*** limao has joined #tripleo09:26
*** limao has quit IRC09:26
*** snecklifter has quit IRC09:27
*** zoli is now known as zoli|lunch09:28
*** snecklifter has joined #tripleo09:28
*** pgadiya has joined #tripleo09:30
*** dsneddon has quit IRC09:33
*** tosky has joined #tripleo09:35
*** udesale__ has joined #tripleo09:35
mariosgfidente: indeed, i don't see the depends on for upgrade_step009:35
mariosgfidente: i see it from 1 to 0 but not from 0 to the batch tasks09:36
gfidentebut if you remove the if role.name in enabled_roles condition09:36
gfidenteit does pop up09:36
gfidenteleft a comment in gerrit09:36
mariosgfidente: thanks09:36
*** jaganathan_lunch is now known as jaganathan09:36
*** udesale has quit IRC09:37
*** dsneddon has joined #tripleo09:38
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Switch stackrc and undercloud.py to use Keystone v3  https://review.openstack.org/44675209:44
adarazsbogdando: I put back the +2 on it. waiting for another +2 before submitting though.09:47
bogdandoadarazs: thank you09:47
*** snecklifter has quit IRC09:48
skramajashardy: regrading derived parameters, we discussed in PTG that service name can be associated with deriving parameters.. but on validating the stack, the outputs are not available, it is not possible to get the service name with validated output.09:49
mariosgfidente: could it be the "{%-" thing?09:50
shardyskramaja: In the flattened parameters schema, the parameters you want to calculate are present though?09:50
skramajashardy: other possibility that i was thinking was associate the derive parmaeter tags (like dpdk, hci, sriov) with the roles via roles_data.yaml, which can be used for executing workflows.09:50
shardyskramaja: Another approach is we can do a heat stack-preview which will give the list of enabled services09:50
shardyskramaja: I guess I was initially thinking you'd just see that DpdkFoo was in the flattened parameters, and that would trigger the calculation09:51
shardywould that work?09:51
shardyskramaja: if possible, it'd be nice to avoid putting service specific flags in the roles_data, but that is another approach we could consider I guess09:51
skramajashardy: the issues is if the parameter is common between 2 services, it will an issue. like OVS-DPDK and ODL-DPDK09:52
*** shadower has joined #tripleo09:52
shardyskramaja: So, you'd want a different parameter for two roles?09:52
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Enforce upgrade_batch_tasks before upgrade_tasks order  https://review.openstack.org/44860209:53
shardyskramaja: I remember we discussed that, but in general parameter names hold exactly one value09:53
skramajashardy: another thing i tried was to vefiy with type. but type is also not hardcoded, service type name can be overridden via resource registryu, like we do it for DPDK.09:53
skramajashardy: we discussed on passing RoleParameters to service templates.09:54
gfidentemarios seems like a more general issue09:54
gfidentewith enabled_roles09:54
*** snecklifter has joined #tripleo09:54
gfidentefor example, I don't see the depends_on supposedly set on line 108/109 which are unrelated to your patch09:54
gfidentedo you see those?09:54
skramajashardy:  i am working that change too - https://review.openstack.org/#/c/437956/09:54
skramajashardy: "but in general parameter names hold exactly one value" - it may be true for the root stack (overcloud)..09:55
shardyskramaja: can you look at the *Services parameter, then you know which services are enabled on which role?09:55
mariosgfidente: yeah i added another one as well i mean see line 192 https://review.openstack.org/#/c/448602/8/puppet/major_upgrade_steps.j2.yaml09:56
mariosgfidente: lets see if this fixes the batch depends on first though09:56
shardyskramaja: so if OS::TripleO::Services::DpdkFoo is enabled on DpdkCompute123 role, you can calculate the parameter to be passed either to all roles, or only to that role via the RoleParameters override?09:57
*** cylopez has joined #tripleo09:58
skramajashardy: 2 thing here, (1) identifying with type - OS::Tripleo::Services:DpdkFoo - not possible, because the name is not fixed, it can be overriden via resource_registry09:59
skramajashardy: (2) with existing service marmetesr -09:59
gfidentemarios I think I found it, it's enabled_roles itself which seems to be 'garbage'09:59
gfidentemarios try to print it in the templates09:59
shardyskramaja: under what circumstances will the alias in the resource_registry change?09:59
shardyskramaja: in general we don't expect that to happen, do we?09:59
skramajashardy: like in compute we hvae ComputeOvsAgent service for reguar ovs09:59
skramajashardy: in case of dpdk , we override this service with dpdk service file. like10:00
skramajashardy: https://github.com/openstack/tripleo-heat-templates/blob/master/environments/neutron-ovs-dpdk.yaml#L310:00
shardyskramaja: Ugh, Ok, let me think about this for a moment10:01
*** athomas has quit IRC10:01
skramajashardy: with existing service parmeter, we cannot uniquely identify the service, we need introduce a hiddle parameter like DdpkKEnabled: true10:01
skramajashardy: *hidden10:01
rnoriegaone more little review :-D :-D https://review.openstack.org/#/c/449081/10:01
skramajashardy: if we do this hidden parameter, then it is possible to identify the service specifically.10:02
shardyskramaja: yeah, that would work, but lets see if there's a way we can get service_name: neutron_ovs_dpdk_agent prior to creating the stack10:03
* shardy tries experiments with stack preview10:03
*** udesale__ has quit IRC10:03
skramajashardy: yes. i will also check that, that would be first option.10:04
*** cylopez has quit IRC10:05
shardyskramaja: note you'll need this heat fix which hasn't yet landed10:05
shardyhttps://review.openstack.org/#/c/441047/10:05
*** akrivoka has joined #tripleo10:05
skramajashardy: noted.10:05
skramajashardy: apart from this, i want your input on the highlevel workflow - https://review.openstack.org/#/c/450022/1/workbooks/derive_params.yaml10:06
skramajashardy: if you agree on this, we will incorporate one end to end formula..10:07
*** athomas has joined #tripleo10:09
*** athomas has quit IRC10:09
*** athomas has joined #tripleo10:09
shardyskramaja: the overall workflow looks fine to me10:11
skramajathanks shardy. the YAQL formulas will be separte workbook and workflow (per feature) so that if need to customize, updating only that specific worklow will be enough. hope it is inline with your inputs.10:14
shardyskramaja: yes it looks like it will fit together quite nicely, thanks!10:15
skramajaok10:15
skramajashardy: coming back to role specific parameters, i have created review with the changes dicussed (and perodically updating to cope-up with new docker services). on a highlevel do you agree on the parameters for service tempalte? - https://review.openstack.org/#/c/437956/15/overcloud.j2.yaml  && https://review.openstack.org/#/c/437956/15/puppet/services/README.rst10:17
*** ratailor has quit IRC10:18
*** [1]cdearborn has joined #tripleo10:22
*** funzo has quit IRC10:23
gfidentemarios I have it! :)10:24
gfidenteit's " if role in enabled_roles "10:24
gfidentenot role.name10:24
mariosgfidente: please :) - i am playing with '-' a10:24
shardyskramaja: yes that looks OK to me - it's a shame services will have to opt-in to role specific parameters, but I can't think of any way to avoid it10:24
gfidenteenabled_roles contains the full roles definition, like roles, not the name only10:25
mariosgfidente: o_O10:25
mariosgfidente: so it is broken already at least one place i can see (line 107)10:25
skramajathanks shardy.10:25
*** thrash|g0ne is now known as thrash10:26
mariosgfidente: +++++ going to update and try it now10:26
gfidentemarios wooohoooo10:26
gfidentebut we fixed it10:26
gfidente:P10:26
*** jprovazn has quit IRC10:26
mariosgfidente: you fixed it man10:26
matbumarios: gfidente hey you are moving too ffast :) i have 2 patchset late10:27
*** janki has quit IRC10:27
suuuperhi, can tripleo configure stonith?10:27
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Add a new command to get the overcloudrc files  https://review.openstack.org/40435410:29
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Enforce upgrade_batch_tasks before upgrade_tasks order  https://review.openstack.org/44860210:32
gfidentemarios thing is enabled_roles needs the full role definitions because somewhere else we do for role in enabled_roles10:32
ansiwenEmilienM: CI was nice to me, if you wanna have another look: puppet apply -e 'include ::ec2api::keystone::authtoken'10:32
ansiwenEmilienM: oops10:32
gfidentemarios I tried with map(attribute='name') and that returns the list of names only but it doesn't seem the right approach, better to just do if role in enabled_roles imho10:32
ansiwenEmilienM: https://review.openstack.org/#/c/45043410:32
ansiwenEmilienM: (wrong clipboard ;-) )10:33
mariosgfidente: so in the rendered templates i see what we needed all along, from upgrade step0 to batch step2 so it seems to have worked10:33
mariosgfgoing to try in on the env in a little bit10:33
gfidentemarios cool10:33
mariosgfidente: man thanks so much i completely forgot about checking the rendered templates !10:33
gfidentehopefully it's not uncovering other bugs with the depends_on10:33
*** ratailor has joined #tripleo10:33
gfidentethe ones we didn't set before10:34
mariosgfidente: well indeed, it isn't just the batch dependencies which are broken10:34
gfidenteyeah10:34
shardysuuuper: Yes, Ng has been working on automating fencing configuration but I'm not sure there are docs for it yet10:35
shardysuuuper: in the past configuring stoninth was a manual task performed directly via pacemaker10:35
Ngshardy: suuuper: no particularly useful docs yet, sorry :/10:35
shardyNg: no worries, would be nice to add when you get the chance :)10:36
Ngshardy: well I have to for downstream :)10:36
shardyNg: a good starting point is a tripleo-docs patch, the content can always be reused elsewhere if needed10:37
suuupershardy,  Ng thanks! :-)10:37
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/45213610:39
shardyskramaja: So, looking at the stack-preview output, we expose the EnabledServices output from overcloud.yaml, but don't calculate its value10:42
shardyskramaja: if we could fix that, it would contain the data you need I think10:42
shardyskramaja: historically the problem is you can't calculate values from resources that aren't actually created10:42
shardyskramaja: but in this case, we know the data is static and could, in theory, be used to evaluate all the intrinsic functions10:43
*** ffiore has joined #tripleo10:43
shardyskramaja: I'll try to take a look, perhaps there's some way we can make that work10:44
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: DNM Other test for 451445  https://review.openstack.org/45197810:45
*** snecklifter has quit IRC10:46
*** dparkes has quit IRC10:47
ansiwengfidente: wanna +2 a high value, low effort patch? ;-) https://review.openstack.org/#/c/45043410:47
skramajashardy: yes. only the values provided as input were being updated in the previewed stack. resource creation to a certain extent during stack validate, because thats when it is possible to know nested resources.10:47
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Enforce upgrade_batch_tasks before upgrade_tasks order  https://review.openstack.org/44860210:48
gfidenteansiwen looks fine but do we test ec2 in ci ?10:48
skramajashardy: i was looking at the heat code, to check if anything can be done, but nothing that i can find as of now.10:48
*** zoli|lunch is now known as zoli10:49
ansiwengfidente: only deployment, functionality is only tested in puppet ci. I will prepare a ping-test for ec2 api next.10:49
*** ealcaniz has quit IRC10:49
*** dixiaoli has quit IRC10:49
*** dixiaoli has joined #tripleo10:51
gfidenteansiwen curious what is the default tokens_url ?10:51
ansiwengfidente: localhost:500010:51
*** dsariel has joined #tripleo10:52
*** ffiore has quit IRC10:52
gfidentefound it http://localhost:5000/v3/ec2tokens10:52
gfidenteansiwen ack +210:53
jaosorioransiwen: commentedon your patch https://review.openstack.org/#/c/450434/310:53
gfidentejaosorior seems what we want to me, no?10:54
gfidenteyou wanted to use http://${host} ?10:54
jaosoriorwhy handle it via a list-join and not just add it to the endpoint map?10:54
jaosorioransiwen: ^^10:55
ansiwenjaosorior: why creating an extra endpoint?10:55
jaosorioransiwen: there is already an entry for /v2.0/ec2tokens even10:56
jaosoriorno need for an extra endpoint10:56
ansiwenjaosorior: I know, but we need v3 now, and I wanted to delete that endpoint even, if we don't need it anymore. as you can see in the comments, it was just a workaround10:57
jaosorioransiwen: also, why is it the internal endpoint?10:57
ansiwenjaosorior: why not?10:57
jaosorioransiwen: why yes?10:57
jaosorioransiwen: where will this be access from?10:57
jaosoriorhonest question10:57
jaosoriorI don't know10:57
ansiwenjaosorior: this is the url how the ec2-api internally connects to keystone, so I think the internal endpoint is the corerect one10:58
jaosoriornot trying to be stubborn here, but it would help me review by knowing how this will be used; then it could be that this is just fine. Or I could recommend something else.10:58
*** rhallisey has joined #tripleo10:59
ansiwenjaosorior: no worries, I'm not offended by your questions10:59
jaosorioransiwen: alright; if that's the case then it's fine to have the internal one10:59
ansiwenjaosorior: I would have assumed that internal is always better than external if it is sufficient11:00
jaosorioransiwen: so, why do you think it's not a good idea to add it to the endpoint map?11:00
*** ratailor has quit IRC11:00
jaosorioransiwen: would be just one entry here https://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_data.yaml#L22811:01
*** ratailor has joined #tripleo11:01
ansiwenjaosorior: do we want to have an extra endpoint for all variations in URI paths? to my understanding the /ec2tokens is not another endpoint, but just a subservice11:01
ansiwenjaosorior: I know that it would be possible, but I thought it's the wrong thing to do11:01
*** ffiore has joined #tripleo11:01
jaosorioransiwen: also, are we still using the v2.0/ec2tokens endpoint?11:02
ansiwenjaosorior: that is what I also would like to know. if not, I'd like to remove the v2 endpoint11:03
jaosorioralright11:03
jaosoriorthat's fine for me then11:03
jaosorioransiwen: seems that heat-engine and mistral-base use it11:04
jaosoriorif the aim is to get rid of that; I think you should do a commit removing that endpoint and updating to the way you just proposed in heat-engine and mistral-api.11:05
ansiwenjaosorior: by the way, is there an easier way than the list_join function? like inline variable evaluation, something like "${get_param: [EndpointMap, KeystoneV3Internal, uri]}/ec2tokens"11:06
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: [N->O] is creating 2 default cell_v2 cells  https://review.openstack.org/44916911:07
jaosoriorshardy: is ther? ^^11:07
jaosorior*there11:07
jaosoriortherve: ^^11:07
shardyjaosorior, ansiwen: No, because that's not valid yaml11:07
jaosoriorwell, that makes sense11:07
*** fzdarsky is now known as fzdarsky|afk11:08
ansiwenshardy: that's why I said "something like", there could be a way that is valid yaml, I suppose?11:08
shardyansiwen: you can use str_replace or list_join to generate the string, I'm not aware of any other way11:09
ansiwenjaosorior: the question is, if heat and mistral are really using it... I have no idea for what11:09
shardyansiwen: the keystone ec2 endpoint?11:09
jaosoriorright11:10
ansiwenshardy: yes11:10
shardyheat uses it to validate signatures for the heat-api-cfn11:10
*** fzdarsky|afk has quit IRC11:10
jaosoriorshardy: is it tied at all to it being a v2.0 endpoint?11:10
jaosorioror can we just seamlessly switch it to use v3/ec2tokens ?11:10
shardyjaosorior: probably not but we'd have to test it with the v3 API11:10
shardyjaosorior: I think it should just work but someone should test it and/or add coverage to CI11:11
ansiwenshardy: what does validate mean here? because in the default deployment the v2.0 uri doesn't work, we had to use v311:11
*** snecklifter has joined #tripleo11:11
shardyansiwen: we make a request to the keystone API to validate a signature11:11
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Fix token auth in ansible inventory script  https://review.openstack.org/45214711:11
ansiwenshardy: but ehy ec2tokens?11:12
ansiwen*why11:12
shardyansiwen: because it's an AWS ec2 format URL/signature11:12
shardysame is used by cloudformation and cloudwatch11:12
shardyand heat supports that format11:13
ansiwenshardy: hmm... weird that v2.0 doesn't work for ec2-api then...11:13
shardyansiwen: IME almost all problems with that keystone API are related to details of how the request is formatted11:13
shardyyou have to get it exactly right or the signature calculated won't match11:14
*** shardy is now known as shardy_lunch11:14
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change heat and mistral to use v3/ec2tokens url  https://review.openstack.org/45214911:15
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove EC2 endpoint from EndpointMap  https://review.openstack.org/45215011:15
jaosorioransiwen: ^^11:16
*** anshul has quit IRC11:16
*** funzo has joined #tripleo11:17
*** ccamacho is now known as ccamacho|lunch11:17
jaosorioransiwen: that should probably be working as well, as that's what we're already using for Heat in the undercloud11:20
*** adarazs is now known as adarazs_lunch11:20
*** jkilpatr has joined #tripleo11:21
ansiwenjaosorior: what do you mean? v3?11:22
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS-everywhere: Enable for TLS libvirt live migration  https://review.openstack.org/45072611:24
jaosorioransiwen: keystone v311:24
*** [1]cdearborn has quit IRC11:27
*** lucasagomes is now known as lucas-hungry11:28
EmilienMhello11:31
jaosoriorEmilienM: sup dude, how's it going?11:31
EmilienMI need to figure out why https://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master-tripleo/ is not updated with our promoted repo11:32
EmilienMwe had a promotion yesterday but CDN is not updated so our CI doesn't pick the packages yet11:32
jaosorioroh, that explains what I was seeing11:32
*** jprovazn has joined #tripleo11:34
ansiwendownstream we also had overcloud images with too old images... (undercloud was ok though)11:35
ansiwen*too old packages11:35
EmilienMjpena, amoralej: any idea of what's going on?11:35
jpenaEmilienM: synchronization to CDN seems to be broken, it's also wrong for current-passed-ci11:38
jpenaI'd swear we had a bug open to the ci.centos infra, didn't we amoralej?11:38
EmilienMjpena: the dashboard is broken for puppet CI because of https://review.rdoproject.org/r/#/c/6108/11:38
amoralejyes, i filled one for the repos i knew about11:38
amoralejjpena, https://bugs.centos.org/view.php?id=1299411:39
*** snecklifter has quit IRC11:41
jpenaI'm asking for an update in #centos-devel11:41
EmilienMjpena: should we switch to https://trunk.rdoproject.org/centos7-master/current-tripleo/ in the meantime?11:42
jpenaEmilienM: yes, please do until it's fixed11:42
EmilienMk11:42
*** pblaho has quit IRC11:45
thrashtherve: I assume the problem you are reporting here: https://bugs.launchpad.net/python-heatclient/+bug/1676896 is the same as what I reported here: https://bugs.launchpad.net/python-heatclient/+bug/1675035 ?11:46
openstackLaunchpad bug 1676896 in python-heatclient "hook-pool doesn't work with nested stack" [High,Fix released] - Assigned to Thomas Herve (therve)11:46
openstackLaunchpad bug 1675035 in python-heatclient "hook poll doesn't return pre-update hooks" [High,Incomplete] - Assigned to Thomas Herve (therve)11:46
thrashtherve: Obviously my conclusion was wrong, but I think the bugs are the same? If so, I'll just mark mine as a duplicate of yours..11:46
thervethrash, Yeah, I was just wondering if you saw something specific WRT in progress status11:47
thrashtherve: I think I just misread the comment in the heat client code about the hooks. :D11:48
thervethrash, Alright :)11:48
thrashtherve: I'll just mark mine as a duplicate.11:48
therveGreat thanks11:48
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates master: Adds service for managing securetty  https://review.openstack.org/44915311:48
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Switch OVB to use promoted repos from trunk.rdoproject.org  https://review.openstack.org/45216411:49
EmilienMjpena, amoralej ^ any feedback is welcome11:49
EmilienMso that's for OVB11:49
*** skramaja_ has joined #tripleo11:50
*** jayg|g0n3 is now known as jayg11:50
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/ocata: Include panko in the default dispatcher  https://review.openstack.org/45177511:51
openstackgerritMerged openstack-infra/tripleo-ci master: Update pip in DLRN venv  https://review.openstack.org/43874611:51
pradkcan i get some reviews on https://review.openstack.org/#/c/451532/ and https://review.openstack.org/#/c/451533/11:52
*** skramaja has quit IRC11:52
jprovaznhi, anyone here willing to +2+A a trivial patch https://review.openstack.org/#/c/436411/ ?11:53
*** morazi has joined #tripleo11:53
*** dixiaoli has quit IRC11:54
EmilienMjpena: I just realized UPGRADE_REPO_URL is not used anywhere I think11:55
jaosoriorpradk: commented on https://review.openstack.org/#/c/451532/511:56
*** dparkes has joined #tripleo11:56
jaosoriorpradk: nevermind11:57
jaosoriorsaw it now11:57
pradkjaosorior, see both patches, hiera param is used in the next patch11:57
pradkthx11:57
pradkEmilienM, could you review as well please.. need that for an RFE11:59
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Switch OVB to use promoted repos from trunk.rdoproject.org  https://review.openstack.org/45216411:59
*** liverpooler has quit IRC12:00
*** liverpooler has joined #tripleo12:00
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Remove unused variables for Upgrades  https://review.openstack.org/45217012:00
EmilienMpradk: not the best time right now12:00
*** prateek has quit IRC12:01
*** prateek has joined #tripleo12:01
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch tripleo-ci master to use promoted repos from trunk.rdoproject.org  https://review.openstack.org/45217412:02
EmilienMadarazs_lunch: when you're back, please ^12:02
*** shardy_lunch is now known as shardy12:03
*** nyechiel_ has joined #tripleo12:04
*** florianf has quit IRC12:07
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] Add Toolbar component and filters state  https://review.openstack.org/45217512:07
*** dprince has joined #tripleo12:08
*** diana_clarke has joined #tripleo12:09
*** dparkes_ has joined #tripleo12:09
*** dparkes has quit IRC12:10
jaosoriorEmilienM: what's creating the ResellerAdmin role in the undercloud?12:12
*** dougbtv_ has joined #tripleo12:13
*** dougbtv_ is now known as dougbtv|laptop12:13
*** dciabrin has quit IRC12:13
diana_clarkeHere's an easy 1 character, friday kind of review (typo in url, tripleo upgrade docs): https://review.openstack.org/#/c/450342/ cheers ;)12:14
gfidented0ugal can you help me understand better how the mistral envs work12:15
d0ugalgfidente: sure, I can try. What do you want to know?12:15
gfidenteso assuming I have an env with a var for a workflow input12:15
gfidentehow do run an execution so that it pulls the value from the env?12:15
*** dparkes has joined #tripleo12:16
gfidenteor, should all references to env variables be $.env.varname ?12:16
d0ugalgfidente: You can either use the mistral action to get the environment from the workflow12:16
weshayadarazs_lunch, easy review https://review.openstack.org/#/c/423503/12:17
d0ugalgfidente: or I think there is a way to pass it into the execution creation too... I've not used this yet. Just looking it up12:17
*** dparkes_ has quit IRC12:18
d0ugalgfidente: why can't you just use workflow input?12:18
openstackgerritMerged openstack/tripleo-docs master: typo: centos7-oacata -> centos7-ocata  https://review.openstack.org/45034212:18
*** pblaho has joined #tripleo12:18
*** jaganathan has quit IRC12:19
*** adarazs_lunch is now known as adarazs12:19
*** yprokule has quit IRC12:19
*** ccamacho|lunch is now known as ccamacho12:20
*** lmiccini has quit IRC12:21
adarazsEmilienM: +2, weshay: submitted.12:21
weshaythanks12:21
*** trown|outtypewww is now known as trown12:22
*** diana_clarke has left #tripleo12:22
*** florianf has joined #tripleo12:22
*** dparkes has quit IRC12:22
*** lucas-hungry is now known as lucasagomes12:22
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Setting keystone region for tacker  https://review.openstack.org/44755812:23
adarazstrown: we should get this in ASAP: https://review.openstack.org/#/c/452087/12:23
*** nyechiel_ has quit IRC12:23
adarazsweshay: what do you mean in that review about "do we need to consider versions here?"12:23
adarazsweshay: there is mitaka.12:23
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: allow easy access to undercloud's horizon dashboard  https://review.openstack.org/44446412:24
gfidented0ugal I can use input indeed12:24
*** pgadiya has quit IRC12:24
gfidenteI was trying to understand the purpose of the environment12:24
gfidenteI expected it to be execution-bound12:24
gfidenteor something that could be used for a particular execution12:24
weshayadarazs, yes.. but do we need to keep setting it manage for certain versions12:24
gfidentebut it doesn't seem to be the case?12:24
d0ugalgfidente: yeah, so it is a bit strange - you can have global named enviroments or execution bound environments.12:25
weshayfor node in $(openstack baremetal node list --fields uuid -f value) ; do12:25
weshay            openstack baremetal node manage $node ;12:25
weshay        done12:25
weshaydoes that need to run for certain versions12:25
d0ugalgfidente: I have not really used the execution bound version - I think you maybe pass that in via --params on the CLI when creating a execution12:25
weshayvs.. just removing it12:25
trownadarazs: we definitely want that to pass ci12:25
adarazsweshay: I think introspect bulk is an all in one command that does it all.12:25
adarazsbut I'll check12:25
gfidente--params {"env":{ ... }} ?12:25
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Enforce upgrade_batch_tasks before upgrade_tasks order  https://review.openstack.org/44860212:25
gfidented0ugal ^^12:25
d0ugalgfidente: yeah, something like that - but I've never tried it and I can't see any examples :/12:26
gfidentebut that works for me :)12:26
gfidenteit's to implement the heat resource12:26
adarazsweshay: so this addition makes the nodes automatically manageable: https://review.openstack.org/#/c/44051812:26
rbradygfidente: in a workflow you can use <% env().variable_name %>12:26
gfidentehttps://review.openstack.org/#/c/267770/9/specs/pike/custom-resource-mistral-workflows.rst 83/8512:26
adarazsweshay: so setting them is not needed, in fact that broke us.12:26
weshayk12:27
d0ugalrbrady: but the question is how you get something into that env()?12:27
Ngwhat determines which MAC address on a machine, shows up in Ironic's port list? Does the discovery ramdisk try to DHCP on all interfaces and Ironic notes which one(s) it sees?12:27
adarazsthanks to not doing introspection on master where we could have noticed it.12:27
d0ugalgfidente: your example of --params seems to be correct12:29
d0ugalgfidente: https://github.com/openstack/mistral/blob/5b07537b59f7127958e157081a5fb61430f6d6dd/mistral/workflow/data_flow.py#L289-L29312:29
d0ugalgfidente: env() as rbrady suggested, accesses __env in the internal context12:29
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Add upgrade tasks for gnocchi container services  https://review.openstack.org/44562712:29
openstackgerritPradeep Kilambi proposed openstack/tripleo-common master: Add redis images to overcloud containers  https://review.openstack.org/44217912:30
*** rook is now known as rook|tower12:31
*** lblanchard has joined #tripleo12:32
*** pkovar has joined #tripleo12:33
*** lmiccini has joined #tripleo12:37
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing ec2api::api::keystone_ec2_tokens_url config  https://review.openstack.org/45043412:40
*** chlong has joined #tripleo12:40
*** dmsimard|afk is now known as dmsimard12:41
*** sshnaidm|off has quit IRC12:42
*** snecklifter has joined #tripleo12:42
matbumarios: hey man,  i comment your review (upgrade_batch)12:43
matbumarios: i saw your -1 the last one, i think it related to my comment12:43
mariosmatbu: yeah i think so too i am looking at the template some more12:43
EmilienMFYI all there is a critical outage on infra, a lot of static content is down12:44
EmilienMlogs.o.o included12:44
adarazsoh okay, so it's not just me.12:44
mariosmatbu: but strange it ran first time12:44
adarazsEmilienM: good thing we also got some intermittent network failures in the BRQ office so I expected it's on my end :)12:45
matbumarios: yep i was faced to a similar issues12:45
matbumarios: i debuged heat also12:46
mariosmatbu: i think we talked about this before... did you even find a way to recover from the reference error other than reset env?12:46
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud master: Set Zaqar roles  https://review.openstack.org/45209812:47
matbumarios: because i think there is a nits in heat also, because if the user make shit with his templates heat should not let him create shit and break itself12:47
matbumarios: erf no, you can fix the database (heat)12:47
matbumarios: but most of the time i did a mysqldump of the heat db12:47
pabelangerEmilienM: did you figure out beaker issue?12:48
matbumarios: this is what i have done before testing your review btw :)12:48
*** rlandy has joined #tripleo12:48
mariosmatbu: k thanks12:48
mariosmatbu: i think i can squeeze in one more deploy/upgrade before eod... anyway in the meantime i can figure out how to fixup the reference there i can make it also conditional on the upgrade tasks being defined12:49
matbumarios: conditional with : role.disable_upgrade_deployment|default(false) ?12:50
mariosmatbu: no i meant on UpgradeBatchConfigEnabled12:51
mariosmatbu: as you pointed out12:51
*** dparkes has joined #tripleo12:51
mariosmatbu: but will play with it and get the templates render locally, i have like 1hr till my overcloud deploys and undercloud upgrades12:52
matbumarios: yep but if none of the UpgradeBatch is not enabled, it won't create the Upgrade_Step resources12:52
mariosmatbu: trouble is impossible to check these reference errors12:52
mariosmatbu: i mean even with rendered templates12:52
matbumarios: ack i can test it also, i was testing the ovs review from chem and this one today12:53
matbumarios: think about backup your heat db  when your overcloud will be deployed :)12:53
mariosmatbu: so unfortnately it failed before reaching chem ovs upgrade (since now the batch tasks were actually working). it failed on l3 agent issue (well neutron-openvswitch-agent bug) so on the second run i go ttheis reference error12:54
*** dciabrin has joined #tripleo12:54
mariosmatbu: my second env (slow beaker box) is almost deployed overcloud so i think i'll try without the batch tasks just chem review there12:54
EmilienMpabelanger: not yet, on my list of things for this morning12:56
EmilienMpabelanger: I'll let you know12:56
*** psahoo has quit IRC12:56
*** dparkes has quit IRC12:56
*** flepied has quit IRC12:57
*** dparkes has joined #tripleo12:57
*** gkadam has quit IRC12:57
*** jlinkes has quit IRC12:57
*** Goneri has joined #tripleo12:57
*** morazi_ has joined #tripleo13:00
*** morazi has quit IRC13:01
*** dparkes_ has joined #tripleo13:02
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates master: Update ceph-rgw acccepted roles to fix OSP upgrade  https://review.openstack.org/45219713:03
*** cylopez has joined #tripleo13:04
*** dparkes has quit IRC13:04
*** iranzo has quit IRC13:06
*** jaganathan has joined #tripleo13:07
*** gfidente has quit IRC13:10
*** dparkes_ has quit IRC13:12
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373113:12
*** jcoufal has joined #tripleo13:13
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357613:13
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Add a new command to get the overcloudrc files  https://review.openstack.org/40435413:13
*** toure|gone is now known as toure13:13
*** flepied has joined #tripleo13:14
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357613:15
adarazsweshay, trown: can you guys review this? https://review.rdoproject.org/r/610213:15
trownadarazs: ya seems good, though I realized it doesnt solve the issue we had13:15
trownadarazs: issue was with the convert-image role being used in image building not in devmode13:16
adarazsoh. anyway, it can't hurt, it was still a gap :)13:16
trownadarazs: indeed13:17
*** dparkes has joined #tripleo13:18
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Containers - ensure keystone.log has correct ownership  https://review.openstack.org/45220013:18
*** ratailor has quit IRC13:19
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Create or update deployment plan from git repository  https://review.openstack.org/41728013:19
*** eck`gone is now known as eck`13:19
matbumarios: btw i dont think you could use this: UpgradeBatchConfigEnabled13:20
matbumarios: because the condition, so the boolean is revolv by heat only13:20
matbumarios: so useless for jinja13:21
*** dparkes has quit IRC13:23
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Fix panko-dbsync container command  https://review.openstack.org/45220113:24
*** snecklifter has quit IRC13:24
*** tzumainn has joined #tripleo13:26
b00tcat_hi all - I got a deployment with 10+ boxes stuck in "overcloud.AllNodesValidationConfig: CREATE_COMPLETE" (or I think it's stuck)13:27
*** tzumainn has quit IRC13:28
b00tcat_how can I check that it is really not?13:28
*** tzumainn has joined #tripleo13:28
*** morazi has joined #tripleo13:28
*** dhill_ has joined #tripleo13:29
openstackgerritSimon Dodsley proposed openstack/tripleo-heat-templates master: Enables support for configuring Cinder with Pure Storage FlashArray storage backend  https://review.openstack.org/45220413:30
*** mdnadeem has quit IRC13:31
mariosmatbu: ack yeah i realised this couple minutes ago, i am even thinking if we want to remove the condition from the batch tasks? they should all be '[]' anyway i mean except couple ceph ones13:31
dprincemandre: hi, sorry I missed your patch regarding overlay13:31
*** morazi_ has quit IRC13:32
openstackgerritSimon Dodsley proposed openstack/puppet-tripleo master: Composable services support for Cinder Pure Storage FlashArray  https://review.openstack.org/45220513:32
EmilienMpabelanger: https://review.openstack.org/45220613:32
mandredprince: it's ok, mine was really just a quick  hack to check if we could get a massive boost by switching to overlayfs13:33
dprincemandre: It isn't a "silver bullet". But I think it is a step in the right direction. I think it might help runtime in some cases.13:34
*** dparkes has joined #tripleo13:34
*** masco has quit IRC13:35
*** skramaja_ is now known as skramaja13:36
pabelangerEmilienM: why are beaker tests not using mirrors?13:36
pabelangerEmilienM: fix they are going outside the network for jobs, them you run the risk of failures still13:37
EmilienMpabelanger: because we don't run run_tests.sh script13:38
EmilienMpabelanger: I agree, my patch is short term13:38
EmilienMpabelanger: I'm working on a Ruby fact that will read nodepool file and use it13:38
EmilienMpabelanger: but not before next week13:38
*** dparkes has quit IRC13:38
pabelangerEmilienM: okay, as long as we work to having beaker also use mirrors, that makes me happy13:39
*** tbarron|out is now known as tbarron13:39
EmilienMpabelanger: yes it's on the (long) list :D13:39
*** dparkes has joined #tripleo13:39
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357613:41
*** artom_ has quit IRC13:46
*** yprokule has joined #tripleo13:46
*** artom_ has joined #tripleo13:47
*** mrunge- is now known as mrunge13:47
*** artom_ has quit IRC13:48
*** artom_ has joined #tripleo13:48
*** gfidente has joined #tripleo13:48
*** gfidente has quit IRC13:48
*** gfidente has joined #tripleo13:48
weshaytrown, adarazs fyi.. we have a failure in master-tripleo-ci https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-extras-gate-master-tripleo-ci-delorean-full-minimal_pacemaker-1209/undercloud/home/stack/undercloud_install.log.gz13:51
adarazsweshay: I think that has been logged some time ago: https://trello.com/c/SkWL9TlK/73-tripleo-error-when-running-os-refresh-config-in-undercloud-install-step && https://bugs.launchpad.net/tripleo/+bug/166911013:53
openstackLaunchpad bug 1669110 in tripleo "undercloud fails with " [ERROR] Could not lock /var/run/os-refresh-config.lock."" [Medium,Triaged]13:53
adarazsit is intermittent.13:53
weshayadarazs, ah.. thank you sir13:53
*** amoralej is now known as amoralej|lunch13:54
weshayadarazs, it may be a diff bug13:55
*** dparkes has quit IRC13:56
adarazsweshay: might be. I see the error doesn't much exactly, I was just looking for os-refresh-config.13:57
adarazs*match13:57
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373114:00
mariosmatbu: gfidente shardy i am considering removing the conditional create for the batch upgrade tasks on next run, unless anyone has better ideas. added a comment at L131 https://review.openstack.org/#/c/448602/11/puppet/major_upgrade_steps.j2.yaml14:01
d0ugalrbrady, jpich: just a few left if you want to do some quick reviews! https://review.openstack.org/#/q/topic:cli-multi-message+status:open14:02
d0ugal(ignore the two failing CI for now)14:03
*** artom_ is now known as artom14:04
gfidentemarios I like removing that14:04
trozetcan someone please review https://review.openstack.org/#/c/448831/ ?14:04
*** gfidente has quit IRC14:05
*** ratailor has joined #tripleo14:05
*** fragatina has joined #tripleo14:06
*** jprovazn has quit IRC14:06
*** cylopez has quit IRC14:07
jaosoriorpradk, can you check this out https://review.openstack.org/#/c/452149/1 ?14:08
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357614:09
*** jaganathan has quit IRC14:10
*** dparkes has joined #tripleo14:10
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Add supplemental node provisioner  https://review.openstack.org/45152314:10
*** paramite has quit IRC14:11
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373114:11
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: [WIP] Add role to deploy FreeIPA  https://review.openstack.org/43619814:11
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Fix potential cluster setup race  https://review.openstack.org/45182814:12
*** dparkes has quit IRC14:15
*** paramite has joined #tripleo14:15
trownweshay: adarazs that seems like a legit bug... 2017-03-31 08:31:51 | 2017-03-31 08:31:51,182 INFO: [mNotice: /Stage[main]/Ironic::Inspector::Db::Sync/Exec[ironic-inspector-dbsync]/returns:     self._overflow = 0 - pool_size[0m14:18
trown2017-03-31 08:31:51 | 2017-03-31 08:31:51,183 INFO: [mNotice: /Stage[main]/Ironic::Inspector::Db::Sync/Exec[ironic-inspector-dbsync]/returns: TypeError: unsupported operand type(s) for -: 'int' and 'str'[0m14:18
jistrmandre, dprince: hi, have you seen something like this? https://bugs.launchpad.net/tripleo/+bug/167813814:18
openstackLaunchpad bug 1678138 in tripleo "ocata->pike upgrade - panko_dbsync container fails" [High,In progress] - Assigned to Jiří Stránský (jistr)14:18
trownweshay: adarazs though unlikely a quickstart one... looking at puppet-ironic14:19
EmilienMtrown: where do you see that?14:19
trownEmilienM: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-extras-gate-master-tripleo-ci-delorean-full-minimal_pacemaker-1209/undercloud/home/stack/undercloud_install.log.gz14:19
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Enforce upgrade_batch_tasks before upgrade_tasks order  https://review.openstack.org/44860214:19
jistrmandre, dprince: initially i thought it's a problem with the service and that we should have the `command:` as an array, but i see the non-array definition in so many places that i think the problem must be elsewhere14:19
dprincejistr: not yet I think. I've had several successful containers overclouds this week with recent containers14:19
mandrejistr: beautiful :)14:20
jistrhehe14:20
EmilienMtrown: it's not in puppetr-ironic14:20
EmilienMit's in ironic14:20
EmilienMthe dbsync failed14:20
dprincestevebaker: had thoughts on this. I think he updates the docker-cmd hook to support both14:20
dprincejistr: ^^^14:20
mandrejistr: it's possible that the string version that you're seing is for the kolla_config14:20
trownEmilienM: well but it failed on some config option, and we shouldnt have latest ironic in the gate14:20
EmilienMtrown: where do you see that? in promotion jobs?14:20
trownEmilienM: no that is a gate14:20
EmilienMtrown: why not, we got a promotion last day14:21
mandrejistr: sbaker has a patch to have docker-cmd hook accept string in addition to list14:21
mandrejistr: https://review.openstack.org/#/c/439945/14:21
trownEmilienM: oh I suppose that job would be using the tripleo promoted repo even though rdo has not promoted14:22
EmilienMtrown: OVB jobs are fine, they used an image with recent packaging14:22
EmilienMtrown: multinode aren't fine, they use old packages because CDN didn't update14:22
EmilienMtrown: https://review.openstack.org/#/c/452174/114:23
EmilienMtrown: is it safe to land https://review.openstack.org/#/c/452174/ ?14:23
EmilienMI see ovb didn't pass but I guess it's not related to my patch?14:23
*** gfidente has joined #tripleo14:23
*** gfidente has quit IRC14:23
*** gfidente has joined #tripleo14:23
EmilienMsince ovb is using the image14:23
jaosoriorgfidente: could you check this out https://review.openstack.org/#/c/452149/1 ?14:23
trownEmilienM: ya seems fine14:24
jistrmandre, dprince: that looks exactly like what i need. What puzzles me is how come things ever worked without this patch :D14:24
jistrmandre, dprince: thanks :)14:24
trownEmilienM: maybe that is the problem with the centos job above too... some mixed repos because centos did not sync the content after promote14:24
jaosoriorEmilienM: did OVB just update? cause earlier today I saw some jobs fail with errors that should be fixed with the latest packages.14:24
EmilienMtrown: maybe14:25
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Add --skip-deploy-identifier  https://review.openstack.org/45222314:25
*** dsavineau has quit IRC14:27
*** dsavineau has joined #tripleo14:28
EmilienMtrown: not having logs from openstack doesn't help :/14:28
*** skramaja has quit IRC14:29
trownEmilienM: ya... that is pretty rough14:29
EmilienMthey're on it14:29
*** milan has quit IRC14:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: [N->O] Fix wrong database connection for cell0 during upgrade.  https://review.openstack.org/44909314:32
*** jroll has quit IRC14:32
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart master: Fix depends-on for tipleo-quickstart  https://review.openstack.org/45222514:33
*** jroll has joined #tripleo14:34
*** amoralej|lunch is now known as amoralej14:36
*** morazi has quit IRC14:36
*** snecklifter has joined #tripleo14:38
*** iranzo has joined #tripleo14:38
EmilienMmatbu: I've commented the release note on https://review.openstack.org/#/c/434346/, if you decide to fix it, you can do it in a patch on top of this one to not waste CI resources14:39
EmilienMmatbu: if that's the case, i'll transform my -1 in +214:39
*** prateek has quit IRC14:39
matbuEmilienM: ack14:41
jpichd0ugal: Hey! Trade you for a review on https://review.openstack.org/#/c/451725/ ? ;)14:42
ccamachoHEy EmilienM, quick question, how do you feel about this patch? https://review.openstack.org/#/c/443553/ Is it about to install bgpvpn on scenario004, my plan is to do the same with all the neutron plugins that are ongoing.14:42
*** yolanda has quit IRC14:43
d0ugaljpich: sure!14:43
EmilienMccamacho: how can you test it?14:44
*** chem has quit IRC14:46
*** chem has joined #tripleo14:46
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras master: Allow complex upgrade deployment for N to O  https://review.openstack.org/43959814:46
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373114:46
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart-extras master: Download rpm tht package for mixed upgrade  https://review.openstack.org/44935014:46
*** dparkes has joined #tripleo14:46
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart master: Fix depends-on for tipleo-quickstart  https://review.openstack.org/45222514:46
ccamachoEmilienM, there is no sanity check for it, yet. But the packages are being installed, neutron is configured accordingly and the service itself is at this stage running. i.e. I have detected some configuration issues when trying to run it on scenario000414:47
*** cylopez has joined #tripleo14:47
*** yolanda has joined #tripleo14:47
EmilienMccamacho: nice, go for it14:49
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP, make script work in CI and interactive  https://review.openstack.org/44937014:49
*** ratailor has quit IRC14:49
*** imran_work has joined #tripleo14:49
*** snecklifter has quit IRC14:50
ccamachoEmilienM cool, thanks!14:50
imran_workso playing around with tripleo and ironic introspection14:50
EmilienMccamacho: no, thank you14:50
imran_workcan get a baremetal node to pxe boot into the ironic ramdisk thing14:51
imran_workhowever it doesn't seem to be doign dhcp right14:51
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Upgrade to containerized overcloud  https://review.openstack.org/44857614:51
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Fix overcloud repo curls  https://review.openstack.org/45223314:51
imran_workand never gets a ip address so it never finsihes intospection14:51
imran_workbut if i log into the baremetal node and just run "dhclient eth0", it works and all starts working as i'd expect14:52
*** morazi has joined #tripleo14:52
*** Vijayendra_ has quit IRC14:52
shardyimran_work: Hi, dtantsur ^^ may have some ideas14:53
*** dparkes has quit IRC14:55
matbuchem: im doing it right now14:56
matbuchem: (the release not review)14:56
*** limao has joined #tripleo14:56
*** bogdando has quit IRC14:57
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Update release note for ovs manual upgrade  https://review.openstack.org/45223614:57
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373114:59
EmilienMmatbu: I meant the second one14:59
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357614:59
EmilienMmatbu: the second part of https://review.openstack.org/#/c/452236/1/releasenotes/notes/ovs-2.5-2.6-composable-upgrades-workaround-73f4e56127c910b4.yaml is not something users can easily understand14:59
EmilienMmatbu: unless they are developers14:59
*** limao_ has joined #tripleo15:00
*** limao has quit IRC15:01
*** jaganathan has joined #tripleo15:02
matbuEmilienM: ha k :) sorry just sa your comment15:04
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: No need for a upgrade field on composable upgrade workaround.  https://review.openstack.org/45224115:04
chemEmilienM: matbu I'm pushing the review now15:05
chemEmilienM: matbu ^15:05
chemEmilienM: for https://review.openstack.org/#/c/451736/1 do you want me to remove the blank line for W+1 ?15:06
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue  https://review.openstack.org/43434615:07
EmilienMmatbu: sorry for nitpicks but I think it's imporant to clarify what is done in the patch15:07
EmilienMchem, matbu: you are updating the same file FYI, you might want to talk :)15:08
*** rcernin has quit IRC15:08
matbuEmilienM: chem yep but chem doesn't respond to ping ;)15:09
chemmatbu: that's so low15:09
matbuchem: lol15:10
chemmatbu: I've replied in the comment :)15:10
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Update release note for ovs manual upgrade  https://review.openstack.org/45223615:10
chemmatbu: I think it doesn't make sense and that we should just remove it altogether15:10
chemmatbu: (by the way I cannot seem to fixe my failed notification beside restarting my session and I don't want to do it yet)15:11
chemmatbu: https://review.openstack.org/45224115:11
mariosmatbu: chem https://review.openstack.org/#/c/434346/26 lgtm15:13
marioshttp://paste.openstack.org/show/605084/ chem fyi15:13
mariosmatbu: i updated the release note15:14
mariosmatbu: EmilienM: i posted v 2615:14
EmilienMthanks15:14
EmilienMmarios, matbu: I guess we don't need https://review.openstack.org/#/c/452236 and https://review.openstack.org/#/c/452241/15:15
EmilienMsince you kicked-off new CI jobs... please update http://paste.openstack.org/show/605084/ then15:15
mariosmatbu: EmilienM i -2 at https://review.openstack.org/#/c/452236/ the other one i don't know15:16
EmilienMmarios: so about https://review.openstack.org/#/c/434346/26/releasenotes/notes/ovs-2.5-2.6-composable-upgrades-workaround-73f4e56127c910b4.yaml15:17
EmilienMI won't nitpick, but just explain15:17
mariosEmilienM: sure we can copy/paste matbu one into there15:17
EmilienMeach entry in the YAML is a note. So when you start the note by "This means", the reader won't understand15:18
EmilienM"what is This"?15:18
mariosEmilienM: i am just saying since it isn't landed why are we making a new review for the release note. for this particular issue it is already confusing enough15:18
mariosEmilienM: thanks for the feedback15:18
*** jcoufal has quit IRC15:18
EmilienMmarios: write a sentence that says: "The upgrade from openvswitch 2.5 to 2.6 is handled gracefully (...)"15:19
jistrall our upgrades are handled with grace15:19
*** jcoufal has joined #tripleo15:19
mariosEmilienM: ack, matbu do you want to update that with the content of your note?15:19
mariosmatbu: i mean will you update https://review.openstack.org/#/c/434346/26/releasenotes/notes/ovs-2.5-2.6-composable-upgrades-workaround-73f4e56127c910b4.yaml ?15:19
chemmarios:  matbu EmilienM in https://review.openstack.org/452241 I think I've made a pretty good case on why we should just delete this upgrade entry  altogether15:20
chemmarios:  matbu EmilienM the change doesn't require any action from the user15:20
matbumarios: as you want i don't care15:21
* matbu is just hungry :)15:21
chemmatbu: eat!15:22
chemEmilienM: for this https://review.openstack.org/#/c/451736/, I'll do a review on top of it that to remove the blank line or we don't care ?15:22
*** limao has joined #tripleo15:22
mariosmatbu: doing15:22
*** limao_ has quit IRC15:22
*** yprokule has quit IRC15:22
EmilienMchem: please update https://review.openstack.org/#/c/434346 and w're good...15:23
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Add manual ovs upgrade script for workaround ovs upgrade issue  https://review.openstack.org/43434615:24
EmilienMchem, matbu, marios: ok are we good now?15:25
mariosEmilienM: ack yeah it lgtm i tested it tday and commented there15:26
EmilienMcool, so let's merge it15:26
matbucool thx15:27
chemEmilienM: so we keep the release as I drop https://review.openstack.org/#/c/452241/, right ?15:27
*** lmiccini has quit IRC15:27
*** jaosorior has quit IRC15:28
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Support container upgrades in multinode OOOQ CI  https://review.openstack.org/45078415:31
mariosEmilienM: we need this one too https://review.openstack.org/#/c/450607/ its the other half of that, also tested15:32
mariosEmilienM: i left a comment on the review i mean about the testing15:32
chemmarios:: hi, could you workflow this one https://review.openstack.org/#/c/451736/ ?15:33
gfidentecommented on https://review.openstack.org/#/c/448602/1215:33
EmilienMmarios: remove the note and +215:33
gfidentethere is one change you mentioned tou wanted to do, but it's missing15:33
marioschem: done15:36
chemmarios: thanks :)15:36
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357615:38
*** jaganathan has quit IRC15:38
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Add special case upgrade from openvswitch 2.5.0-14  https://review.openstack.org/45060715:39
mariosEmilienM: done ^ thanks15:39
mariosgfidente: please vote ^15:39
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests  https://review.openstack.org/40373115:39
*** aufi has quit IRC15:40
*** morazi has quit IRC15:41
*** artom has quit IRC15:42
*** cwolferh has joined #tripleo15:42
*** artom has joined #tripleo15:42
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224915:42
mariosgfidente: chem matbu https://review.openstack.org/#/c/448602/12 this one works for me ... i've removed the conditional alltogther (just left a relevant comment). cc shardy fyi this is the batch upgrade tasks ordering one15:43
adarazsweshay: I don't have time today to finish up the change, but I put up a WIP here: https://review.openstack.org/45224915:43
adarazsweshay: if you add the workarounds to fetch the unmerged changes to the bottom of devmode.sh it should do the same thing as https://review.openstack.org/#/c/449370/5/ci-scripts/full-deploy-ovb.sh15:43
weshaytrown, still hit an undercloud error w/ https://review.openstack.org/#/c/452174/  /me looks for the error15:44
weshayadarazs, ack.. thanks will look15:44
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates stable/ocata: Update ceph-rgw acccepted roles to fix OSP upgrade  https://review.openstack.org/45225015:45
*** hewbrocca is now known as hewbrocca_afk15:45
* adarazs off15:45
*** pcaruana has quit IRC15:46
chemccamacho: hi, could you give this review https://review.openstack.org/#/c/450607/ a little boost ?15:47
weshaytrown, http://paste.openstack.org/show/605089/ http://chunk.io/f/b98db66e4e8f433b88a90cf04a6b126c15:47
*** artom has quit IRC15:48
*** deadnull has joined #tripleo15:48
*** artom has joined #tripleo15:48
chemEmilienM: marios: I think we forgot W+1 on this https://review.openstack.org/#/c/434346/ ?15:50
chemEmilienM: marios: sorry ignore me we waiting for verified15:50
EmilienMdone15:51
chemEmilienM: cool thanks.15:52
trownweshay: yep that is the same ironic inspector dbsync error15:54
chemtrozet: hi, are you cool with the new look of https://review.openstack.org/#/c/432165/18 ?15:54
*** morazi has joined #tripleo15:55
*** ramishra has quit IRC15:55
*** pkovar has quit IRC15:55
*** fragatina has quit IRC15:56
*** arxcruz|pto has quit IRC15:56
*** leanderthal is now known as leanderthal|afk15:57
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: [WIP] Add supplemental node provisioner  https://review.openstack.org/45152315:58
weshaytrown, do you know if there is a bug on that yet?15:58
trownweshay: so far I have not found any changes in ironic/inspector/puppet-ironic that look suspicious15:58
trownweshay: no we need one15:58
weshayk15:58
trownweshay: someone downstream reported it to me too15:58
trownweshay: I can file a bug now, then work on it more after lunch15:59
weshaytrown, ok.. thanks15:59
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates stable/ocata: Update ceph-rgw acccepted roles to fix OSP upgrade  https://review.openstack.org/45225015:59
trowngoing to file it under tripleo for now with quickstart tag, since we dont really know the cause yet15:59
openstackgerritKeith Schincke proposed openstack/tripleo-heat-templates master: Update ceph-rgw acccepted roles to fix OSP upgrade  https://review.openstack.org/45219716:00
dtrainorone of my changes in gerrit has POST_FAILURE as the status of some of the jobs.  What's that mean?16:00
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations  https://review.openstack.org/40357616:02
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: [WIP] Add role to deploy FreeIPA  https://review.openstack.org/43619816:02
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: [WIP] Add role to deploy FreeIPA  https://review.openstack.org/43619816:03
trownweshay: https://bugs.launchpad.net/tripleo/+bug/167821816:05
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,Triaged]16:05
*** arxcruz|pto has joined #tripleo16:06
weshaytrown, thanks!16:07
*** dtrainor has quit IRC16:08
imran_workright on a node that has booted the introspection rd, running /usr/local/sbin/dhcp-all-interfaces-wahtever-the-script-is-called.sh with no args I see "eth0 has config, skipping"16:09
*** dhill_ has quit IRC16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167821816:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,Triaged]16:10
EmilienMtrown: is it affecting ovb jobs in our gate?16:10
*** dtrainor has joined #tripleo16:11
rnoriegahappy reviewer before the weekend? https://review.openstack.org/#/c/449081/16:11
rnoriegaxD16:11
EmilienMweshay, trown: second question, have we pinged someone from ironic folks?16:11
shardyrnoriega: you may have better luck chasing in #puppet-openstack as only a couple of tripleo folks are puppet cores16:12
rnoriegaoh s*&%! shardy you're right! wrong channel16:13
rnoriegasorry16:13
rnoriega:)16:13
trownEmilienM: really hard to know if it is affecting ovb jobs because we have no log server :(16:13
trownEmilienM: but they seem to be failing in a time frame that would be around undercloud install16:13
trownEmilienM: nack on pinging ironic folks... I was still in initial investigation mode16:14
*** artom has quit IRC16:14
EmilienMtrown: let me try16:14
EmilienMon #openstack-ironic16:14
*** zoli is now known as zoli|gone16:14
*** artom has joined #tripleo16:14
EmilienMtrown: looking on http://tripleo.org/cistatus.html16:14
trownk I will check that before getting lunch16:14
EmilienMtrown: it doesn't seems like it affect OVB jobs16:14
trownEmilienM: k, maybe it is a quickstart only problem16:15
*** jpich has quit IRC16:16
*** artom has quit IRC16:16
*** artom has joined #tripleo16:16
trownEmilienM: the quickstart ovb jobs arent on that status page, but the random sampling of patches I looked at today they are failing in around 25-30 min16:16
EmilienMok16:17
*** derekh has quit IRC16:18
*** toure is now known as toure|food16:21
shardyEmilienM: should we land https://review.openstack.org/#/c/441894/ so scenario 004 can work for n->o upgrades?16:21
chemgfidente: he, could you W+1 this one https://review.openstack.org/#/c/450607/ so that it can land during the weekend ?16:21
*** suuuper has quit IRC16:24
openstackgerritMartin André proposed openstack/tripleo-quickstart master: Set -q option to ssh in ProxyCommand  https://review.openstack.org/45225816:27
*** lucasagomes is now known as lucas-afk16:28
*** karimb has quit IRC16:30
chemzaneb: he, if you have some time to land this backport https://review.openstack.org/#/c/451454/ that would be awesome :)16:30
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Download overcloud_release rpm for mixed upgrade  https://review.openstack.org/44934916:30
*** karimb has joined #tripleo16:32
zanebchem: +2'd and added shardy to the review16:33
shardyzaneb, chem: approved16:33
shardyThere is also https://review.openstack.org/#/c/451674/ for newton16:33
chemzaneb: shardy thanks16:33
* zaneb looks16:33
chemshardy: yep, didn't want to push my luck to far :)16:33
zanebapproved16:34
zanebchem: what else you got while we're here? ;)16:34
chemzaneb: hum ... I think we've have landed everything we could for the day.  Thanks for the offer :)16:36
zanebsuccess16:36
*** karimb has quit IRC16:36
chemzaneb: but if you insist there is https://review.openstack.org/#/c/446893/ :)16:37
zanebchem: I'm not core on that16:37
chemzaneb: right, sorry got exited :)16:38
zaneblol16:38
chemgfidente: he, now could you land this one https://review.openstack.org/#/c/446893/ before leaving ?16:40
chemgfidente: well it's starting to be late and this can wait16:42
chemand with that I'm gone.16:42
*** chem is now known as chem_gone16:42
weshaydtantsur, you avail to look at https://bugs.launchpad.net/tripleo/+bug/1678218 ?16:43
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,Triaged]16:43
*** dhill_ has joined #tripleo16:43
ccamachohey chem wasnt in my desk but check this one #/c/446893/ also16:44
*** fragatina has joined #tripleo16:45
*** karimb has joined #tripleo16:45
*** tosky has quit IRC16:45
*** florianf has quit IRC16:51
EmilienMshardy: yes16:51
EmilienMshardy: thanks16:52
EmilienMtrown: have you check if you had https://github.com/openstack/ironic-inspector/commit/a509edd993852b56fafce370840f477c36115c48 ?16:52
*** limao has quit IRC16:54
*** paramite has quit IRC16:54
*** jpena is now known as jpena|off16:55
*** ramishra has joined #tripleo16:56
*** flepied has quit IRC17:05
*** athomas has quit IRC17:06
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167821817:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,Triaged]17:10
*** dhill_ has quit IRC17:15
*** dhill_ has joined #tripleo17:16
*** shardy has quit IRC17:17
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224917:18
*** yamahata has joined #tripleo17:19
*** ramishra has quit IRC17:20
openstackgerritSteven Hardy proposed openstack/python-tripleoclient master: Write user parameters environment to swift  https://review.openstack.org/45026417:21
openstackgerritSteven Hardy proposed openstack/python-tripleoclient master: Write rhel registration parameters env to swift  https://review.openstack.org/45070817:21
openstackgerritSteven Hardy proposed openstack/python-tripleoclient master: Write breakpoint cleanup env to swift  https://review.openstack.org/45070917:21
openstackgerritSteven Hardy proposed openstack/python-tripleoclient master: Don't merge environments during plan creation  https://review.openstack.org/44820917:21
*** dhill_ has quit IRC17:21
*** jcoufal_ has joined #tripleo17:21
*** jcoufal has quit IRC17:24
*** dsneddon has quit IRC17:26
*** dsneddon has joined #tripleo17:27
*** ffiore has quit IRC17:28
trownEmilienM: back from food... the repo I have has inspector from Mar 9 which is indeed before that commit17:34
bkeroTime to rebase?17:34
trownbkero: more of a dlrn repo thing17:34
bkeroAh okay17:35
bkeroTime to force dlrn rebuilds :)17:35
*** toure|food is now known as toure17:35
*** salmankhan has quit IRC17:37
trownbkero: EmilienM, ah yep a bug in tripleo-ci/master repo config in quickstart https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L3317:37
trownit is pointing to "RDO promotion of tripleo promotion" not "tripleo promotion"17:37
* EmilienM in a call, brb17:38
*** milan has joined #tripleo17:42
openstackgerritOpenStack Proposal Bot proposed openstack/os-cloud-config master: Updated from global requirements  https://review.openstack.org/42327617:47
bnemecHmm, need to remove that from the sync list if it's being retired.17:48
trownEmilienM: tldr is: your patch for the sync issue should fix this for us. updated the bug and confirming locally17:49
openstackgerritBen Nemec proposed openstack/os-net-config master: Updated from global requirements  https://review.openstack.org/45227317:50
openstackgerritBen Nemec proposed openstack/os-net-config master: Fix coverage tox config  https://review.openstack.org/45227417:50
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/45107517:51
*** cylopez has quit IRC17:52
openstackgerritDan Prince proposed openstack/tripleo-quickstart-extras master: Add undercloud_registry_pull_source option  https://review.openstack.org/45227517:54
openstackgerritDan Prince proposed openstack-infra/tripleo-ci master: Update ovb-nonha-oooq to use local registry mirror  https://review.openstack.org/45227617:54
openstackgerritBen Nemec proposed openstack/os-refresh-config master: Fix coverage job  https://review.openstack.org/45227717:59
openstackgerritSarath Kumar Sankaran Kutty proposed openstack/tripleo-heat-templates stable/ocata: Re-Add bigswitch agent support  https://review.openstack.org/45227818:01
*** mnaser has joined #tripleo18:01
mnaserhi!  i had a small question about how tripleo maintains consistency when building images (trying to see if maybe other projects have solved this issue to bring the solution to kolla)18:02
mnaserright now our docker image build process is non deterministic, the same code can build 2 different images if ran at different times18:02
*** jcoufal has joined #tripleo18:03
*** jcoufal_ has quit IRC18:04
*** milan has quit IRC18:07
mwhahahamnaser: cause we use packages </troll>18:09
mnaseroh so do we for binary builds mwhahaha18:09
mwhahahathen what's different?18:09
mnaserso you don't pin package versions?18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167821818:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,Triaged]18:10
mwhahahamnaser: we use stablish repos18:10
mwhahahamnaser: so the question is what's changing?18:10
mwhahahawe aren't necessarily building the same image everytime because the source repo might change. but if you have a static repo source  it'll be the same18:11
mnaserwhen we build images for kolla version 3.0.3 based on the stable repos, they'll include nova 13.0.0 (today, for example).  in 6 months, if someone runs that same code and the repo updates to 13.0.1, now technically the code to build image with "version" 3.0.3 will not always give the same result18:11
mnaserwhere i would imagine the "right" thing would be that we control the version bumps and then release kolla 3.0.4 with updated nova/etc18:12
mnaserthat way 3.0.3 is always the same versions18:12
EmilienMtrown: you're welcome18:12
EmilienMlol18:13
mwhahahamnaser: our images aren't used for that, that's where the package stability comes in. that would be the equivalent build process. the only way to guarentee stable images is to have a stable source18:13
mnasermwhahaha i guess the approach seems a bit weird and different because docker has the whole idea of an immutable image18:14
mwhahahamnaser: this is the problem with docker container building is that it's all about the stability of the source to guarentee reproducability18:14
mnaseryeah18:14
mnaseri think it would be ideal that kolla 3.0.3 images will always have the same package versions, regardless of which day you build in time (granted you have access to those packages still)18:14
trownEmilienM: thanks for the precognition to fix that :)18:15
EmilienMtrown: I'll still double check it works fine in CI but without logs18:16
mwhahahamnaser: so currently for the non docker stuff we're not versioning our images and it's up to the operator to handle that. downstream has stable repos so  building it today is the same as tomorrow unless the repo changes.  the equivalent for  us would be our packages which we would either use a stable branch or pin a hash18:16
mwhahahamnaser: i think the fuel-ccp guys were trying to solve the build reproducability problem but i'm not sure if they ever came up with something18:17
mnasermwhahaha gotcha, that makes sense so for you not to be a major concern in this case18:18
mnaseri might want to ping fuel folks then if they come up with something18:18
mnaserthank you for your helpful information18:19
*** tesseract has quit IRC18:21
*** fragatina has quit IRC18:24
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224918:29
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224918:30
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: Add OVB support to devmode.sh  https://review.openstack.org/45224918:32
weshaytrown, did you retest of  https://review.openstack.org/452174 work? I can try it if ur busy18:34
*** jcoufal_ has joined #tripleo18:35
trownweshay: no... I just updated the bug18:37
*** jcoufal has quit IRC18:37
trownweshay: it is only a libvirt issue... and the reason is https://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/undercloud/tasks/inject_repos.yml is not using the repo-setup role18:37
weshaytrown, nice debug18:39
trownweshay: I think the quickest fix is to update https://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/undercloud/tasks/inject_repos.yml#L11 like EmilienM patch, then we can change up that code to use repo-setup role as a follow-up18:39
weshay+118:39
trownk, I will put up the simple patch asap18:39
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Switch tripleo-ci to use trunk.rdoproject.org repos  https://review.openstack.org/45228618:44
openstackgerritAna Krivokapic proposed openstack/tripleo-common master: Remove Mistral environment from plan actions  https://review.openstack.org/45229118:53
*** amoralej is now known as amoralej|off18:54
EmilienMtrown: you want me to send it?19:02
trownEmilienM: if you would19:05
trownEmilienM: I dont think there are any other quickstart cores on19:05
EmilienMtrown: done. The patch is safe.19:06
*** chem_gone has quit IRC19:06
Sloweris CI still backed up?19:07
*** chem_gone has joined #tripleo19:07
Sloweroh ya nm :)19:07
* Slower reads the topic19:07
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167821819:10
*** ooolpbot has quit IRC19:10
openstackooolpbot: Error: Could not gather data from Launchpad for bug #1678218 (https://launchpad.net/bugs/1678218). The error has been logged19:10
*** akrivoka has quit IRC19:11
weshaybnemec, what would be your guess with regards to the number of concurrent ovb environments are running when things are busy.. atm I only see 1219:14
weshay30?19:14
slagle6019:15
weshayk.. thanks slagle19:16
bnemecweshay: It's actually 70 now.19:16
weshayright now?19:16
bnemecAlso, there's 36 running at the moment.19:16
slagleoh did we up that?19:16
weshayrlandy, ^19:16
bnemec70 max19:16
bnemec36 current19:16
EmilienMweshay: http://zuul-status.tripleo.org19:16
weshayya.. that is what I'm looking at..19:17
bnemecslagle: Yeah, I bumped it a couple of times recently.19:17
EmilienMI'll repeat it here in case folks didn't see the emails and IRC topic: please don't do recheck19:17
weshayoh ya.. aight.. got it19:17
bnemecweshay: There are three jobs per patch, each one is a separate env.19:17
weshayyup.. thanks19:18
rlandyweshay: if we want to spin more concurrent jobs, we'll need to up the quotas19:18
bnemecBut please don't start at 70 on rdo cloud.  It took a while for us to ramp up that high on rh1.19:18
rlandyspinning 10 concurrent atm19:18
weshay:).. we're at 10 now19:18
weshayjust wondering how high to go19:18
rlandywould could likely up that to 12 within our current quotas19:19
slaglei need one of these rdo cloud accounts19:19
bnemecAre we actively running tripleo-ci, or are these separate test jobs?19:19
rlandywe're running test jobs19:19
bnemecOh, actually I can answer that myself.19:19
bnemec36 heat stacks on rh1, 36 jobs, means all on rh1. :-)19:19
weshayrlandy, we'll probably have to turn off logging on one of the jobs our log server is just not big enough for that19:21
pabelangerEmilienM: aside from logs, have you had mirror failures today?19:21
EmilienMpabelanger: not afik19:21
rlandyweshay: ok - will up the jobs to 12 concurrent and I'll kill logging on the HA jobs19:22
EmilienMbut it's hard to tell tbh19:22
pabelangerack19:22
EmilienMpabelanger: any ETA on the logs thing?19:22
pabelangera while still19:22
EmilienMpabelanger: hours?19:22
pabelangerbut we are trying to work around it19:22
pabelangeryes19:22
pabelangershould know more shortly19:22
EmilienMpabelanger: ok thx, good luck folks19:22
*** Goneri has quit IRC19:23
weshayrlandy, I can also reduce the retention settings on those two jobs.. that is probably better19:24
weshayjust in case things get choppy19:24
*** dhill_ has joined #tripleo19:28
*** karimb has quit IRC19:36
*** morazi has quit IRC19:41
*** milan has joined #tripleo19:50
*** morazi has joined #tripleo19:56
-openstackstatus- NOTICE: lists.openstack.org will be offline from 20:00 to 23:00 UTC for planned upgrade maintenance20:00
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Add pre-selected Control Plane IP support.  https://review.openstack.org/41327820:00
trozetEmilienM: nobody has reviewed https://review.openstack.org/#/c/448831/ so asking you directly when you have time...20:07
*** rhallisey has quit IRC20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167821820:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,In progress] - Assigned to John Trowbridge (trown)20:10
openstackgerritJames Slagle proposed openstack/tripleo-common master: Add skip_deploy_identifier  https://review.openstack.org/45231420:14
*** jayg is now known as jayg|g0n320:14
openstackgerritMerged openstack/python-tripleoclient master: Fix return code when failing before launching the stack  https://review.openstack.org/44647020:15
openstackgerritMerged openstack/tripleo-quickstart master: Switch tripleo-ci master to use promoted repos from trunk.rdoproject.org  https://review.openstack.org/45217420:15
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Add --skip-deploy-identifier  https://review.openstack.org/45222320:16
dr_gogeta86hi peeps20:17
dr_gogeta86anyone paved the tripleo with hpe iscsi_ilo20:18
dr_gogeta86or agent_ilo20:18
*** milan has quit IRC20:22
*** iranzo has quit IRC20:29
*** arxcruz|pto has quit IRC20:29
*** vpickard_afk is now known as vpickard_20:30
*** gbarros has joined #tripleo20:30
*** arxcruz|pto has joined #tripleo20:35
*** dprince has quit IRC20:36
*** sshnaidm|off has joined #tripleo20:46
*** trown is now known as trown|outtypewww20:47
*** morazi has quit IRC20:47
*** bnemec is now known as beekneemech20:49
*** dougbtv|laptop has quit IRC20:50
beekneemechEmilienM: Coverage jobs for the python projects, as we discussed at the PTG: https://review.openstack.org/45232120:55
beekneemechAlso https://review.openstack.org/45232220:55
*** gbarros has quit IRC20:57
*** lblanchard has quit IRC20:59
*** morazi has joined #tripleo21:00
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Stop openstack-nova-compute during nova-ironic upgrade  https://review.openstack.org/45080221:03
openstackgerritMerged openstack/tripleo-common master: Handle re-created resources in StackUpdateManager  https://review.openstack.org/45172521:04
*** fragatina has joined #tripleo21:05
*** gfidente has quit IRC21:07
*** fragatin_ has joined #tripleo21:08
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167821821:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,In progress] - Assigned to John Trowbridge (trown)21:10
*** fragatin_ has quit IRC21:10
*** fragatin_ has joined #tripleo21:11
*** fragatina has quit IRC21:12
*** morazi has quit IRC21:12
*** salmankhan has joined #tripleo21:23
*** thrash is now known as thrash|g0ne21:24
*** milan has joined #tripleo21:27
*** jcoufal has joined #tripleo21:32
*** jcoufal_ has quit IRC21:34
*** Goneri has joined #tripleo21:35
*** fultonj has quit IRC21:40
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/ocata: Include panko in the default dispatcher  https://review.openstack.org/45177521:43
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Set auth flag so ceilometer auth is enabled  https://review.openstack.org/45153221:45
-openstackstatus- NOTICE: The upgrade maintenance for lists.openstack.org has been completed and it is back online.21:52
*** milan has quit IRC21:59
*** flepied has joined #tripleo22:00
*** rlandy has quit IRC22:00
*** jcoufal_ has joined #tripleo22:02
*** dougbtv_ has joined #tripleo22:04
*** jcoufal has quit IRC22:05
*** jcoufal_ has quit IRC22:06
*** dougbtv has quit IRC22:07
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/167821822:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1678218 in tripleo "Undercloud install failing with ironic-inspector dbsync error" [Critical,In progress] - Assigned to John Trowbridge (trown)22:10
*** salmankhan has quit IRC22:12
*** mburned has quit IRC22:15
*** artom has quit IRC22:26
*** artom has joined #tripleo22:26
*** artom has quit IRC22:30
*** mburned has joined #tripleo22:30
*** artom has joined #tripleo22:30
*** funzo has quit IRC22:41
*** padkrish has joined #tripleo22:43
*** Goneri has quit IRC22:44
openstackgerritLukas Bezdicka proposed openstack/os-collect-config master: Don't fail on non-valid json in cache files  https://review.openstack.org/44489822:47
openstackgerritMerged openstack/tripleo-heat-templates master: Don't check haproxy if external load-balancer is used.  https://review.openstack.org/45173622:53
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Moved some variable definitions to global scope  https://review.openstack.org/44689322:53
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Remove ceph mds service from newton scenario 004  https://review.openstack.org/44189422:53
openstackgerritMerged openstack-infra/tripleo-ci master: Add gate-tripleo-ci-centos-7-ovb-containers-oooq-nv to cistatus  https://review.openstack.org/45184522:53
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/45213622:53
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/45107522:55
openstackgerritMerged openstack/tripleo-quickstart-extras master: Remove setting nodes as manageable when enabling introspection  https://review.openstack.org/45208722:57
openstackgerritMerged openstack/tripleo-quickstart master: Switch tripleo-ci to use trunk.rdoproject.org repos  https://review.openstack.org/45228622:57
*** padkrish has quit IRC23:20
*** padkrish has joined #tripleo23:23
*** padkrish has quit IRC23:23
*** padkrish has joined #tripleo23:23
*** padkrish has quit IRC23:25
*** fragatina has joined #tripleo23:41
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Move horizon to step 3  https://review.openstack.org/45234923:42
*** deadnull has quit IRC23:44
*** fragatin_ has quit IRC23:44
*** b00tcat_ has quit IRC23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!