Thursday, 2018-08-30

openstackgerritDoug Hellmann proposed openstack/tripleo-heat-templates stable/queens: import zuul job settings from project-config  https://review.openstack.org/59783500:00
*** srini_ has joined #tripleo00:00
openstackgerritDoug Hellmann proposed openstack/tripleo-image-elements stable/queens: import zuul job settings from project-config  https://review.openstack.org/59783600:00
openstackgerritDoug Hellmann proposed openstack/tripleo-ipsec stable/queens: import zuul job settings from project-config  https://review.openstack.org/59783700:00
openstackgerritDoug Hellmann proposed openstack/tripleo-puppet-elements stable/queens: import zuul job settings from project-config  https://review.openstack.org/59783800:00
openstackgerritDoug Hellmann proposed openstack/tripleo-ui stable/queens: import zuul job settings from project-config  https://review.openstack.org/59783900:00
openstackgerritDoug Hellmann proposed openstack/tripleo-upgrade stable/queens: import zuul job settings from project-config  https://review.openstack.org/59784000:00
openstackgerritDoug Hellmann proposed openstack/tripleo-validations stable/queens: import zuul job settings from project-config  https://review.openstack.org/59784100:00
openstackgerritDoug Hellmann proposed openstack/instack stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784200:00
openstackgerritDoug Hellmann proposed openstack/instack-undercloud stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784300:00
openstackgerritDoug Hellmann proposed openstack/os-apply-config stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784400:00
openstackgerritDoug Hellmann proposed openstack/os-collect-config stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784500:00
openstackgerritDoug Hellmann proposed openstack/os-net-config stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784600:00
openstackgerritDoug Hellmann proposed openstack/os-refresh-config stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784700:00
openstackgerritDoug Hellmann proposed openstack/paunch stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784800:00
openstackgerritDoug Hellmann proposed openstack/puppet-tripleo stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784900:00
openstackgerritDoug Hellmann proposed openstack/python-tripleoclient stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785000:00
openstackgerritDoug Hellmann proposed openstack/tripleo-common stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785100:01
openstackgerritDoug Hellmann proposed openstack/tripleo-heat-templates stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785200:01
openstackgerritDoug Hellmann proposed openstack/tripleo-image-elements stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785300:01
openstackgerritDoug Hellmann proposed openstack/tripleo-puppet-elements stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785400:01
openstackgerritDoug Hellmann proposed openstack/tripleo-ui stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785500:01
openstackgerritDoug Hellmann proposed openstack/tripleo-validations stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785600:01
*** srini_ has quit IRC00:01
*** srini_ has joined #tripleo00:02
*** srini_ has quit IRC00:19
*** srini_ has joined #tripleo00:20
*** rpioso is now known as rpioso|afk00:21
*** lblanchard has joined #tripleo00:24
*** srini_ has quit IRC00:25
*** srini_ has joined #tripleo00:26
*** srini_ has quit IRC00:36
*** srini_ has joined #tripleo00:37
openstackgerritJames Slagle proposed openstack/tripleo-common master: Add config_download_timeout input  https://review.openstack.org/58635600:39
*** dxiri has quit IRC00:43
dpeacockI see Doug's been busy with patches.  Plenty for me to review there! :-)00:52
dpeacock...tomorrow. :-)00:52
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: import zuul job settings from project-config  https://review.openstack.org/59613100:58
*** khyr0n has quit IRC01:03
*** srini_ has quit IRC01:09
*** rh-jelabarre has quit IRC01:16
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: import zuul job settings from project-config  https://review.openstack.org/59611501:21
openstackgerritMerged openstack/tripleo-image-elements stable/queens: import zuul job settings from project-config  https://review.openstack.org/59613201:21
openstackgerritMerged openstack/tripleo-image-elements stable/pike: import zuul job settings from project-config  https://review.openstack.org/59611601:21
openstackgerritMerged openstack/tripleo-image-elements master: Fix unit tests in python3  https://review.openstack.org/59636001:21
openstackgerritMerged openstack/instack-undercloud stable/queens: import zuul job settings from project-config  https://review.openstack.org/59612201:21
openstackgerritMerged openstack/tripleo-ui master: import zuul job settings from project-config  https://review.openstack.org/59607801:21
openstackgerritMerged openstack/tripleo-ui master: switch documentation job to new PTI  https://review.openstack.org/59607901:21
openstackgerritMerged openstack/tripleo-ui stable/ocata: import zuul job settings from project-config  https://review.openstack.org/59610301:21
openstackgerritMerged openstack/tripleo-ui stable/pike: import zuul job settings from project-config  https://review.openstack.org/59611801:21
openstackgerritMerged openstack/tripleo-ui stable/queens: import zuul job settings from project-config  https://review.openstack.org/59613501:21
openstackgerritMerged openstack/tripleo-upgrade master: import zuul job settings from project-config  https://review.openstack.org/59608001:21
mwhahahamarios|rover, EmilienM: not sure if it matters but the ocata nonha-multinode-oooq job is timing out https://review.openstack.org/#/c/596086/. Given that we're almost to EOL upstream, perhaps we should just nuke it01:33
*** rlandy|bbl is now known as rlandy01:37
*** lblanchard has quit IRC01:39
*** rlandy has quit IRC01:42
*** dmacpher has joined #tripleo01:45
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944801:54
openstackgerritMerged openstack/tripleo-upgrade master: switch documentation job to new PTI  https://review.openstack.org/59608102:07
openstackgerritMerged openstack/tripleo-upgrade stable/queens: import zuul job settings from project-config  https://review.openstack.org/59613602:07
openstackgerritMerged openstack/tripleo-upgrade stable/pike: import zuul job settings from project-config  https://review.openstack.org/59611902:07
openstackgerritMerged openstack/instack-undercloud stable/pike: import zuul job settings from project-config  https://review.openstack.org/59610602:07
openstackgerritMerged openstack/instack-undercloud master: Add start/stop command for ironic-inspector-dnsmasq  https://review.openstack.org/59349802:07
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Add FFU upgrade steps to Sahara services  https://review.openstack.org/59527002:07
openstackgerritMerged openstack/tripleo-heat-templates master: Include ssh known_hosts entries for non-default port  https://review.openstack.org/59716502:07
openstackgerritMerged openstack/tripleo-heat-templates master: Enable configuration of Designate's pools.yaml  https://review.openstack.org/58052602:07
*** slaweq has joined #tripleo02:11
*** slaweq has quit IRC02:16
*** apetrich has quit IRC02:16
*** tzumainn has quit IRC02:34
*** shyamb has joined #tripleo02:39
shyambHi02:45
openstackgerritJason E. Rist proposed openstack/tripleo-quickstart-extras master: Checks to see if VIRTHOST IP has been properly written in config file.  https://review.openstack.org/59797902:45
shyambI am facing an issue while deploying overcloud with ssl on public virtual ip02:46
shyambI am following "https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ssl.html#overcloud-ssl"02:46
shyambdoc02:46
* jrist *might* be able to help, but I doubt it02:47
shyambok02:47
shyambI see this error on screen: http://paste.openstack.org/show/729095/02:48
shyambI am not providing this template which it is trying to read02:48
shyambI am using passing these templates to overcloud deploy command: http://paste.openstack.org/show/729096/02:49
jristdtrainor: still around ^02:50
jristthat file is there shyamb ? Could not fetch contents for file:///home/puppet/extraconfig/tls/tls-cert-inject.yaml02:50
*** psachin has joined #tripleo02:51
shyambjrist: no, file is not there02:51
jristwell there you go02:51
jrist:)02:51
shyambok02:52
jristshyamb: here's what I have /home/jrist/workspace/tripleo-heat-templates/puppet/extraconfig/tls/tls-cert-inject.yaml02:52
shyambI have provided all the templates it needs02:52
jristit's in tripleo-heat-templates in puppet/extraconfig/tls/tls-cert-inject.yaml02:52
jristmust be pointed to the wrong place somewhere02:52
shyambok02:52
jristdouble check that it exists somewhere and wherever is pointing to /home/puppet/extraconfig/tls is pointing to the correct place02:53
shyambSo should I copy this file in /home/puppet/extraconfig/tls  directory?02:53
shyambok02:53
shyambwhat this file is supposed to contain?02:53
jristshyamb: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/extraconfig/tls/tls-cert-inject.yaml02:56
shyambjrist: this file is there in tripleo heat templates02:56
shyambhttp://paste.openstack.org/show/729097/02:56
shyambI want to enable ssl on public vip02:56
shyambI see02:57
shyambthis is the heat template we need to pass to overcloud deploy command02:58
shyambotherwise it will not accept the ssh keys we are passing02:58
shyambbut this doc has completely missed it to mention: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ssl.html#overcloud-ssl02:59
jristperhaps03:04
jristpatches accepted on docs :) and bugs!03:04
jristweshay|pto: fyi: https://review.openstack.org/597979 for when you're back haha03:05
EmilienMmwhahaha: no we don't care at this point.03:07
jristshyamb: also you could consider using the UI which is literally just checking a box for SSL :)03:20
*** shyamb has quit IRC03:22
*** ykarel has joined #tripleo03:24
*** sri_ has joined #tripleo03:25
*** ykarel_ has joined #tripleo03:31
*** ykarel has quit IRC03:33
openstackgerritMerged openstack/tripleo-heat-templates master: Configure rndc to listen on internal_api network  https://review.openstack.org/58190103:42
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/59634203:42
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky  https://review.openstack.org/59634303:42
*** Petersingh has joined #tripleo03:46
*** Petersingh has joined #tripleo03:47
*** Petersingh is now known as Petersingh|afk03:48
*** skramaja has joined #tripleo03:49
*** sri_ has quit IRC03:49
*** sri_ has joined #tripleo03:50
*** gkadam has joined #tripleo03:52
*** ykarel__ has joined #tripleo03:58
*** ykarel_ has quit IRC03:58
*** moshele has joined #tripleo04:00
openstackgerritMerged openstack/tripleo-puppet-elements stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/59634804:00
*** sri_ has quit IRC04:02
*** sri_ has joined #tripleo04:03
*** moshele has quit IRC04:04
*** janki has joined #tripleo04:05
openstackgerritMerged openstack/tripleo-image-elements stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/59634504:06
openstackgerritMerged openstack/tripleo-image-elements stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky  https://review.openstack.org/59634604:06
openstackgerritMerged openstack/puppet-tripleo stable/pike: import zuul job settings from project-config  https://review.openstack.org/59611204:06
*** shyamb has joined #tripleo04:06
*** ramishra has joined #tripleo04:12
jankiCan I please get some reviews for https://review.openstack.org/#/c/585159/04:19
*** shyamb has quit IRC04:19
jankiEmilienM, jaosorior jistr ^04:19
openstackgerritMerged openstack/python-tripleoclient master: Fix the way how we do argument negation  https://review.openstack.org/59040004:20
openstackgerritMerged openstack/python-tripleoclient stable/queens: Use user specified ssh key when removing tmp key  https://review.openstack.org/59705304:20
openstackgerritMerged openstack/python-tripleoclient master: Update reno for stable/rocky  https://review.openstack.org/58980304:20
*** jaganathan has joined #tripleo04:21
*** sri_ has quit IRC04:22
*** jaganathan has left #tripleo04:22
*** sri_ has joined #tripleo04:22
*** ykarel__ has quit IRC04:22
*** moshele has joined #tripleo04:25
*** sri_ has quit IRC04:37
*** sri_ has joined #tripleo04:38
*** shyamb has joined #tripleo04:38
*** sri_ has quit IRC04:39
*** Petersingh|afk is now known as Petersingh04:41
*** shyamb has quit IRC04:46
*** radeks_ has joined #tripleo04:48
*** kopecmartin has joined #tripleo04:50
openstackgerritMerged openstack/tripleo-common master: import zuul job settings from project-config  https://review.openstack.org/59605304:52
openstackgerritMerged openstack/tripleo-common master: switch documentation job to new PTI  https://review.openstack.org/59605404:54
openstackgerritMerged openstack/tripleo-common master: add python 3.6 unit test job  https://review.openstack.org/59605504:54
openstackgerritMerged openstack/python-tripleoclient master: Bump the timeout for plan creation workflow to 20 minutes  https://review.openstack.org/59670004:54
openstackgerritMerged openstack/python-tripleoclient master: Move ironic http boot reno to the correct section  https://review.openstack.org/58415404:54
openstackgerritMerged openstack/python-tripleoclient master: Add fixtures instead mock  https://review.openstack.org/57953804:54
openstackgerritMerged openstack/tripleo-common stable/rocky: Do not require username/password when enrolling Redfish nodes  https://review.openstack.org/59702504:54
*** ykarel__ has joined #tripleo04:58
*** moshele has quit IRC04:59
*** ykarel__ is now known as ykarel05:00
*** jbadiapa has quit IRC05:01
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates stable/queens: Add NeutronSriovHostConfig mapping to neutron-sriov.yaml file  https://review.openstack.org/59798505:08
*** slaweq has joined #tripleo05:11
*** slaweq has quit IRC05:15
*** shyamb has joined #tripleo05:26
Tenguhello there05:27
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Add role definition for ComputeOvsDpdkSriov role  https://review.openstack.org/59798805:27
*** waleedm has joined #tripleo05:32
*** yprokule has joined #tripleo05:34
openstackgerritMerged openstack/tripleo-common master: Add workflow for config-download export  https://review.openstack.org/58576705:35
openstackgerritMerged openstack/python-tripleoclient master: Use workflow config_download_export  https://review.openstack.org/58589805:35
openstackgerritMerged openstack/tripleo-common master: Use keystone group for loading auth params  https://review.openstack.org/58590405:35
openstackgerritMerged openstack/puppet-tripleo stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/59633405:35
openstackgerritMerged openstack/puppet-tripleo stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky  https://review.openstack.org/59633505:35
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Always enable image prepare service for docker clouds  https://review.openstack.org/59698605:35
openstackgerritMerged openstack/tripleo-validations master: import zuul job settings from project-config  https://review.openstack.org/59608205:35
*** shyamb has quit IRC05:37
*** ccamacho has joined #tripleo05:38
flaper87mandre: I believe there's a way to do this but we'll have to define a new node profile.05:44
*** shyamb has joined #tripleo05:46
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Add config option for ODL IPv6 deployment  https://review.openstack.org/58501505:48
openstackgerritMerged openstack/puppet-tripleo stable/queens: import zuul job settings from project-config  https://review.openstack.org/59612805:51
*** udesale has joined #tripleo05:53
*** moshele has joined #tripleo05:54
*** agurenko has joined #tripleo06:02
*** ksambor has joined #tripleo06:05
*** openstackgerrit has quit IRC06:07
*** ramishra has quit IRC06:07
*** udesale has quit IRC06:07
*** sanjayu_ has joined #tripleo06:08
*** udesale has joined #tripleo06:08
*** sanjayu__ has joined #tripleo06:09
*** sanjayu_ has quit IRC06:12
*** ramishra has joined #tripleo06:14
*** shyamb has quit IRC06:15
*** shyamb has joined #tripleo06:15
shyambHi06:20
shyambWe have a horizon plugin06:21
*** jfrancoa has joined #tripleo06:21
*** radeks_ has quit IRC06:21
shyambHow can we integrate it with openstack horizon container?06:22
*** radeks has joined #tripleo06:23
*** hamdyk has joined #tripleo06:24
*** janki has quit IRC06:30
*** jchhatbar has joined #tripleo06:30
*** shardy has joined #tripleo06:32
*** openstackgerrit has joined #tripleo06:45
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Set virt queue size as 1024 for all OVS-DPDK roles  https://review.openstack.org/59805206:45
*** aufi has joined #tripleo06:47
ykarelso can i get +W to move this https://review.openstack.org/#/c/594111/06:51
ykareljaosorior, bandini ^^06:51
ykareljistr, looks like updates job going good after promotion last night06:53
bandiniykarel: done06:53
ykarelseen multiple passes06:53
ykarelbandini, Thanks06:53
bandininp :)06:53
jaosoriorykarel: was there promotion?06:54
ykareljaosorior, yes last night06:54
ykareljaosorior, 9ad93affedba8870315dd72c714770875ce24759_b72f0c42 was promoted06:54
jaosoriorykarel: was that for master or for rocky?06:56
shardyjaosorior: note you can check all the pins at https://dashboards.rdoproject.org/rdo-dev06:56
ykareljaosorior, both were recently promoted06:56
jaosoriorshardy: right, that's what I saw doing, and it says master RDO promotion CI was promoted 16 days ago06:56
shardyyeah but we use the tripleo master pin in CI06:57
ykareljaosorior, shardy those are for rdo-ci, current-tripleo-rdo, upstream ci relays on triple-ci promotion aka current-tripleo06:57
ykarelyes correct06:57
jaosoriorah I see06:57
jaosoriorso, if I use quickstart to deploy, and use the release master-tripleo-ci. It'll use the latest?06:57
shardyyes should do06:58
ykarelyes06:58
*** shyamb has quit IRC07:01
*** f1 has joined #tripleo07:04
*** f1 is now known as florianf07:04
Tengujaosorior: heya! are you available for a quick thing?07:05
Tenguwell, "quick"...07:06
jaosoriorTengu: yes, but my girlfriend took my headset, so can't really od bluejeans07:06
Tengujaosorior: we can IRC, no problem07:06
Tengujaosorior: need to understand an error in order to check where/what to look for with (apparently) selinux.07:07
Tengujaosorior: while deploying nova stuff, I get Security class "passwd" is not defined in the SELinux policy. || Access denied by SELinux, must be privileged to use -u  ||  Error: Puppet::Util::FileType::FileTypeCrontab could not write nova: Broken pipe07:08
*** apetrich has joined #tripleo07:09
Tengunot really sure WHAT caused those error. funky part, just before I have a mention for a cron: Notice: /Stage[main]/Nova::Cron::Archive_deleted_rows/Cron[nova-manage db archive_deleted_rows]/ensure: created   but it's apparently "created" as expected.07:09
jaosoriorTengu: must be the action straight after that07:10
jaosoriorfiletypecrontab?07:11
jaosorioris it trying to create a cron job?07:11
Tenguguess so07:11
*** slaweq has joined #tripleo07:11
jaosoriorany idea which job?07:11
*** shyamb has joined #tripleo07:12
*** radeks has quit IRC07:12
Tengunot really :/. nova seems to want to install two jobs.07:12
*** radeks has joined #tripleo07:13
jaosoriorok, lets take a look07:13
TenguI suspect the "cron" type tries to do some weird things on selinux-enabled system... maybe that's it07:13
Tenguhttps://github.com/openstack/puppet-nova/blob/master/manifests/cron/archive_deleted_rows.pp07:13
Tenguwell, both are here: https://github.com/openstack/puppet-nova/tree/master/manifests/cron07:13
*** jbadiapa has joined #tripleo07:14
jaosoriorTengu: can you pass the rest of the logs?07:14
Tengujaosorior: started a tmate, easier07:14
*** pcaruana has joined #tripleo07:14
*** slaweq has quit IRC07:16
jaosoriorTengu: found this https://bugzilla.redhat.com/show_bug.cgi?format=multiple&id=82100407:16
shardyCan someone check https://review.openstack.org/#/c/521197/ (docs patch) - it has a -1 but I think we need to merge it anyway because the current docs no longer work07:16
Tenguerf07:16
*** radeks has quit IRC07:16
shardyOr I can fix the nits and we can merge it I guess07:17
Tengujaosorior: well.... back in 2012 o_O. so it should not kick in anymore07:17
jaosorioroh, lol07:18
jaosoriorhadn't seen the date07:18
*** rdopiera has joined #tripleo07:19
Tengualthouh it's the same error message.07:20
Tengumight be linked.07:20
jaosoriorTengu: it is also the same situation, we do have a different context, which is what the MLS system bit refers to07:20
*** rcernin has quit IRC07:20
cgoncalvesstevebaker, ping07:20
Tengujaosorior: hmm. how can we workaround this?07:20
jaosoriorTengu: let me check07:21
*** yprokule has quit IRC07:21
Tengucgoncalves: I doubt stevebaker is available, he's in new zeland iirc07:21
jaosoriorTengu: where is the cron job created? on the host or in a container?07:21
Tengujaosorior: in the container07:21
Tenguthe log you can see is the log from the podman container07:21
Tengui.e. puppet run in order to bootstrap its service.07:22
cgoncalvesTengu, yeah, I know but still tried my chance :)07:22
Tengucgoncalves: :)07:22
jaosoriorTengu: we probably shouldn't try to create cron jobs in the nova container. It should be done in a container of its own07:22
Tengujaosorior: hm, that means a dedicated container, meaning new container, infra change and the like.07:22
jaosoriorTengu: not relly, we can re-use the nova image07:23
*** slaweq has joined #tripleo07:23
Tengunever told "image" :).07:23
Tengubut container07:23
jaosoriorthen I don't get your infra change comment.07:23
jaosoriorwe already run certain cron jobs on their own container.07:23
Tengujaosorior: well, adding a new container means we change the infra - more over, this will impact the way puppet receipt is created, and we will most probably need to change the puppet-nova module07:24
Tengunot a big deal of course, but this requires some work and sync with nova team I guess07:25
jaosoriorTengu: not necessarily, we can keep it as-is, and change the tags that are executed07:25
Tenguand it's weird it's working in docker. will just check something.07:25
jaosoriorTengu: do you know where is the source code for the cron resource?07:26
*** yprokule has joined #tripleo07:26
Tengujaosorior: inside puppet code directly, it's a native type07:26
Tenguoh... jaosorior maybe we just need to set the container to "privileged" for that one task?07:27
jaosoriorTengu: well, we could do that for the docker-puppet run07:27
Tengumight be sufficient and wouldn't require a big change.07:27
Tengulemme check that.07:27
jaosoriorI wanted to avoid that though, and only run the cron job creation as privileged07:27
openstackgerritMerged openstack/tripleo-docs master: Update docs to reflect updates to os-net-config mechanism  https://review.openstack.org/52119707:28
jaosorioror better yet, decipher how the cron resource works and check if we can limit what it does07:28
Tengujaosorior: well, as I understand, we can't apply a cron to a user using the standard crontab -u flag.07:31
Tenguas puppet runs as root, it uses this capacity, of course.07:31
Tengubecause it's the right way to do things on a standard system07:31
jaosoriorTengu: right... but I wonder why SELinux gives issues, shouldn't we be running in the container's user namespace, so... it should be fine07:32
Tengujaosorior: apparently nova_api_cron is a dedicated container for cronjob for nova.07:34
Tenguso your proposal won't solve the issue, as it's apparently already done like that :).07:34
jaosoriorOK07:34
jaosoriorso, running on privileged mode just gives that container all capabilities07:34
jaosoriormaybe we can instead figure out what capability is needed07:34
jaosoriorand just add that one07:34
jaosoriorinstead of giving it all07:34
jaosoriorTengu: also, note it's the puppet run and not the actual cron job. So the only container that needs that capability is the one that runs puppet to generate the crontab entry07:36
Tenguhmm true. so that's not the one I have right now in view.07:37
*** tosky has joined #tripleo07:38
Tengujaosorior: although in this very case, we might as well push files in /etc/cron.* instead....07:39
jaosoriorTengu: I think that's already happening07:39
Tenguhmmm07:39
Tengushould not.07:39
Tengucrontab -e writes in another location07:39
Tenguin /var/spool/cron/crontab/<user> iirc07:39
jaosoriorI see07:40
Tenguand that's what the "cron" type does07:40
*** janki has joined #tripleo07:43
*** jchhatbar has quit IRC07:44
*** dxiri has joined #tripleo07:44
jaosoriorTengu: docker-puppet.py, which reads the puppet_config bits, doesn't have a lot of options. So we need to extend it to accept the configuration for us to tell it to run as privileged for that one container.07:45
Tengudoes it really read it=07:46
Tengu?07:46
Tenguah, didn't see it imports json07:46
jaosorior~yep07:47
*** Petersingh is now known as Petersingh|lunch07:48
Tenguhmm.07:48
Tenguthere's something useless in the script I think. well. anyway.07:48
*** dxiri has quit IRC07:49
*** jchhatbar has joined #tripleo07:49
*** janki has quit IRC07:49
Tenguwtf.... code repetition X(07:52
Tengujaosorior: guess we can trash the vagrant box? or do you want to check something in it?07:53
*** jpena|off is now known as jpena07:54
*** shyamb has quit IRC07:54
Tengujaosorior: also... how is the json generated?07:54
*** jpich has joined #tripleo07:56
Tenguoh. fu.k. not that easy, we must dig far deeper I think.07:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722408:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/56428508:00
jaosoriorTengu: went for moar coffee08:01
jaosoriorTengu: did you change docker-puppet.py already?08:02
*** yprokule has quit IRC08:06
openstackgerritKamil Sambor proposed openstack/python-tripleoclient master: Add fixtures instead mocks  https://review.openstack.org/58134208:07
Tengujaosorior: yep08:13
Tengujaosorior: at least it should be OK.08:13
jaosoriorTengu: was the alright08:13
Tenguhmm.08:14
jaosoriorTengu: the puppet_config section is written on the puppet_config.yaml file directly. That is eventually copied on to docker-puppet.json08:14
Tengujaosorior: and that puppet_config.yaml seems to be generated as well.08:15
Tenguunless this is out of the t-h-t tree ?08:15
jaosoriorTengu: It's magically generated :D08:16
* Tengu launches sparkles in the sky08:16
Tengujaosorior: undercloud - not overcloud yet08:16
*** hjensas has joined #tripleo08:16
jaosoriorTengu: similar mechanisms though08:16
jistrykarel: great that updates job is good after promotion, that's exactly what we expected :) The bad news is that this sorta proves that the way we inject up-to-date RPMs into containers in CI is indeed broken.08:18
jistrwe can hit such breakage anytime again, in any job, not just updates08:18
jistrwe have some debugging/inspection attempts from yesterday08:19
jistrhttps://review.openstack.org/#/c/597525/08:19
jistrhttps://review.openstack.org/#/c/597466/08:19
Tengujaosorior: it looks for puppet_config in the role_data "role-name"08:20
jaosorioryes08:20
Tengumeaning the tab on the left should point to the right section already08:20
jaosoriorit does. But I'm still trying to figure out where that is persisted exactly08:20
Tenguwell we can run the vagrant :).08:21
jaosoriorbut yeah, puppet_config is already the section that gets persisted, for every service, in the docker-puppet.json file08:21
Tenguwe'll see what's happening.08:21
Tengujaosorior: it will take ~6 minutes to bootstrap the box08:21
Tengu#coffee08:21
jaosoriorok08:22
ykareljistr, ack, need to look more on the injection part of RPM, what's wrong, is the issue listed somewhere?08:22
*** akrivoka has joined #tripleo08:23
ykareli think the issue is the ci is testing current repo, but containers are current-tripleo08:23
ykarelci is testing current + consistent repo08:24
ykarelconsistent/current-tripleo08:24
*** ykarel is now known as ykarel|lunch08:30
jistrykarel: yea running with current-tripleo is not correct. So we have this patch to pull in dlrn-current (for just the includepkgs= subset of packages) into the containers via yum update https://review.openstack.org/#/c/592577/08:31
jistrykarel|lunch: but that ^ still doesn't seem to do the trick08:31
openstackgerritMerged openstack/tripleo-docs master: Add squads to the docs  https://review.openstack.org/59756508:31
ykarel|lunchjistr, okk will check that post lunch08:32
jistrykarel|lunch: we've already discussed that we'll need container images with latest non-promoted content so that we don't have to do as much `yum update` in each CI job. Folks are on board with the idea now.08:32
jistrbut still there's something broken in modify-image or the way we execute it, otherwise what we curently have would be slow, but it would at least work08:33
jistrykarel|lunch: ack enjoy your lunch :)08:33
*** shyamb has joined #tripleo08:40
shyambHi08:46
shyambMy overcloud deployment is getting stuck at this step: http://paste.openstack.org/show/729107/08:46
shyambTengu: jaosorior: Any thoughts?08:47
Tengujaosorior: seems to go as expected now - so that's a possibility.08:47
shyambIt's in the same state from last 1 and half hour08:47
shyambSo, I started doubting08:47
Tengushyamb: you might want to get some more info directly from the stack, something like `openstack stack list --nested | grep -vi complete'08:48
Tenguthat should show you the stack being deployed, and from that we might have some more information about the real state.08:48
shyambok08:48
Tengujaosorior: so the --privileged might do the trick for the cron stuff. Ugly as shit08:49
Tengubut at least, it works, and it should be temporary.08:49
jaosorioryeah :/08:49
Tengujaosorior: the iscsi thingy is known08:49
jaosoriorTengu: but at lesat it's only for one container08:49
jaosorioris it?08:49
*** dtantsur|afk is now known as dtantsur08:49
Tengujaosorior: EmilienM said something about that yeah - it's only in podman context.08:49
Tenguprobably the same thing with docker creating missing host locations vs podman failing.08:49
Tengujaosorior: EmilienM has a couple of review about that08:50
Tenguso no obsession on that precise issue :).08:50
jaosoriorok08:50
shyambTengu: I see stacks are in-progress08:50
shyambhttp://paste.openstack.org/show/729109/08:50
openstackgerritSagi Shnaidman proposed openstack/ansible-role-tripleo-modify-image master: Fix type in variable which blocked updates  https://review.openstack.org/59808908:50
sshnaidmslagle, jistr mwhahaha found a bug ^^08:50
shyambTengu: I see some errors in system logs on undercloud08:51
shyambhttp://paste.openstack.org/show/729108/08:51
sshnaidmjistr, that's why containers didn't update.. I think we can revert delorean current patch..08:51
shyambAny thoughts from logs08:51
*** yprokule has joined #tripleo08:52
*** panda is now known as panda|rover08:52
jaosoriorTengu: aaah accidentally left the inner tmux session08:53
Tengujaosorior: no problem ;). so I can now go forward. Thanks for the help!08:54
jaosoriorno biggie, glad to help08:55
Tengushyamb: so apparently you may have a stuck thing on a controller.08:56
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading  https://review.openstack.org/57310208:56
Tengumight be good to check logs on your controller(s) - you can also describe the resources of the stack "overcloud-AllNodesDeploySteps-c3blyfi4eeap-ControllerDeployment_Step3-4ejekwt5dyv4"08:56
sshnaidmssbarnea, fyi, containers haven't been updated in CI recently with built packages, see https://review.openstack.org/59808908:57
openstackgerritSaravanan KR proposed openstack/tripleo-docs master: Add commands in the doc to generate the nic configs  https://review.openstack.org/59618808:59
*** noama has joined #tripleo09:00
*** ramishra has quit IRC09:00
openstackgerritIlya Etingof proposed openstack/tripleo-quickstart master: Handle VirtualBMC 1.4.0+ setup  https://review.openstack.org/59809509:01
shyambTengu: Sure, thanks09:01
*** holser_ has joined #tripleo09:02
*** holser_ has quit IRC09:02
*** holser_ has joined #tripleo09:03
noamahi09:06
noamaim trying out rocky branch a for some reason deployment failed with no valid host..09:07
noamai have inspected nova-scheduler and it failed on RamFilter09:08
*** sri_ has joined #tripleo09:08
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading  https://review.openstack.org/57310209:08
noama2018-08-30 08:25:18.522 32 DEBUG nova.scheduler.filters.ram_filter [req-d2eaeb8f-6d79-49dc-8930-e634eaacbbd4 99e4051c40b14c2e9c2516d832e4e8cf c9d2810ec8b44d4cb4da7d6213676744 - default default] (cloudx-uc4.localdomain, ff3d35ed-0c1d-49d6-b05e-61d348f27570) ram: 0MB disk: 0MB io_ops: 0 instances: 0 does not have 4096 MB usable ram before overcommit, it only has 0 MB. host_passes09:09
noama/usr/lib/python2.7/site-packages/nova/scheduler/filters/ram_filter.py:4609:09
noama2018-08-30 08:25:18.523 32 INFO nova.filters [req-d2eaeb8f-6d79-49dc-8930-e634eaacbbd4 99e4051c40b14c2e9c2516d832e4e8cf c9d2810ec8b44d4cb4da7d6213676744 - default default] Filter RamFilter returned 0 hosts09:09
shyambTengu: It's throwing mysql connection refused error09:09
shyambI see mariadb container is in running state09:09
shyambmaybe I need to restart the container09:09
ssbarneaif any core is around, here is an urgent CR for fixing the missing package updates on images: https://review.openstack.org/#/c/598089/ -- fixing a typo, that changes a lot.09:10
shyambTengu: which is should I restart?09:10
shyambhttp://paste.openstack.org/show/729113/09:10
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates master: scenario010: enable Ceph RBD  https://review.openstack.org/59293809:13
*** ramishra has joined #tripleo09:13
openstackgerritMerged openstack/tripleo-quickstart master: [FS021] Switch to containerized undercloud net config  https://review.openstack.org/59411109:15
openstackgerritMerged openstack/tripleo-ui master: Fix network lines rendering  https://review.openstack.org/59493809:15
openstackgerritMerged openstack/tripleo-ui master: List deployment plan in nodes list for deployed nodes  https://review.openstack.org/59026009:15
*** hkominos_ has joined #tripleo09:15
hkominos_Hi all. Can I get some quick input regarding CI in tripleo ?09:16
*** ykarel|lunch is now known as ykarel09:18
shyambTengu: Got the issue09:20
shyambI have specified a different ip in env file09:21
shyamband overcloud deployment has assigned another ip to haproxy frontend09:21
shyambNeed to fix it in env file and redeploy09:21
shyambHope, it will complete this time :D09:21
Tengushyamb: :) well.... I'm currently looping on the undercloud deploy in order to get selinux working properly with podman (another way to get containers - works "like" docker. we're adding support for it in tripleo)09:24
Tengushyamb: at least you almost have an overcloud ;)09:24
*** udesale has quit IRC09:26
*** shyamb has quit IRC09:26
*** shyamb has joined #tripleo09:27
jistrykarel, sshnaidm: the patch trying to get info from modify-image progress worked, and it ran before the promotion happened, so we do have more info about the breakage now: http://logs.openstack.org/66/597466/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/f71d2af/logs/undercloud/home/zuul/install-undercloud.log.txt.gz09:30
*** shyamb has quit IRC09:31
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: [WIP] Workflow for provisioning bare metals without Nova  https://review.openstack.org/57685609:33
*** flaper87 has quit IRC09:34
*** flaper87 has joined #tripleo09:36
Tengujaosorior: https://review.openstack.org/#/c/595831/13  bingo :)09:38
*** moguimar has quit IRC09:39
*** ccamacho has quit IRC09:39
*** ccamacho has joined #tripleo09:39
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Fix neutron dhcp log path  https://review.openstack.org/59810509:43
*** Petersingh|lunch is now known as Petersingh|mtg09:45
*** moguimar has joined #tripleo09:46
*** sri_ has quit IRC09:46
*** sri_ has joined #tripleo09:47
dtantsurshardy: morning! I'm trying to follow https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html but the 'default' command does not accept -r, and without 'default' it outputs empty parameter_defaults...09:49
dtantsur./overcloud-prep-containers.sh fails with 'NoneType' object has no attribute 'get'09:50
dtantsuris anybody deploying with custom roles? could you please help me?09:50
shardydtantsur: Ok that sounds like a bug, can you just omit the -r and let it pull all the images?09:51
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Sanitize deployment failure messages  https://review.openstack.org/59810809:51
dtantsurshardy: with or without 'default'?09:51
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: List deployment plan in nodes list for deployed nodes  https://review.openstack.org/59810909:51
shardydtantsur: I think if you specify default it'll pull everything?09:51
dtantsurshardy: okay, I got some non-empty file with 'default' and without -r09:52
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Enable sorting of environments  https://review.openstack.org/59811009:52
shardydtantsur: Ok, does it have the images which were missing when you deployed before?09:52
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Fix error message in case of available roles listing failure  https://review.openstack.org/59811109:53
dtantsurshardy: it does not look so.. http://paste.openstack.org/show/729118/09:53
dtantsurI mean, I cannot see any images here in that format09:53
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: New regex for the FQDN that handles many subdomains  - also case insensitive.  https://review.openstack.org/59811509:54
dtantsurbtw, I'm curious, which timezone are you in shardy?09:54
shardydtantsur: I'm in the UK09:54
dtantsurah, I did not realize it09:54
ykareljistr, ack, looking09:56
sshnaidmjistr, did you see? https://review.openstack.org/#/c/598089/09:57
jistrykarel, sshnaidm: the output from that log looks good, but unfortunately it's because that very patch is going to tripleo-common, so tripleo-common is pulled from gating-repo there instead of dlrn-current. The update job was broken by not getting tripleo-common from dlrn-current in some container images. So we didn't manage to reproduce that.09:57
jistrsshnaidm: i didn't. And ouch :) So whenever there weren't any packages to update, we updated all? But still i'm not sure if that could be the cause of the bug... Nice catch though :)09:59
shardydtantsur: have you tried running prepare with no -r or -e arguments, e.g "tripleo container image prepare --verbose --output-env-file /home/stack/shtmp.yaml -e /home/stack/containers-prepare-parameter.yaml"09:59
sshnaidmjistr, no, we didn't update anything09:59
jistrsshnaidm: oh i see now, lol. Ok that could definitely be the cause of the bug. Ship it! :D10:00
jistr+210:00
ykarelsshnaidm, cool10:00
sshnaidmjistr, actually CI wasn't checking anything these days..10:00
jistrsshnaidm: well that explains things... :D10:01
sshnaidmjistr, I found this due to your patch with logs, looking now how we do this constantly..10:01
*** shyamb has joined #tripleo10:03
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] DO NOT MERGE  https://review.openstack.org/59713010:07
jistrsshnaidm: i see.. looking at the logs again, it always printed "No packages were found for update..." in each modify-image run. Well... :D10:07
dtantsurshardy: mmm, something is happening now :)10:08
dtantsurokay, I got an environment file which looks like something I need10:08
dtantsurshardy: may I dare asking why tripleo does not do it automatically?10:09
dtantsurlike, I did two commands that are just magic to me and required no input from me10:09
shardydtantsur: cool - you should be able to filter the images by passing -r, but if that's not working the alternative is to pull/push everything10:09
shardydtantsur: because it'd use disk space and CI time which is not necessarily needed, but yeah perhaps we could streamline this and have the option of just pulling everything during the undercloud install10:10
shardyor as a post-install task that runs automatically10:10
dtantsurshardy: I'd at least expect quickstart to do it..10:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Convert NewPlan form to redux-form  https://review.openstack.org/59811810:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Update plans state management  https://review.openstack.org/59811910:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Convert EditPlan form to redux-form  https://review.openstack.org/59812010:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Re-add ability to update plan via tarball  https://review.openstack.org/59812110:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Add ability to create plan using default templates  https://review.openstack.org/59812210:10
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/rocky: Add ability to import plan from Git repository  https://review.openstack.org/59812310:10
dtantsuralso, if I have problems understanding this, imagine an operator first time using tripleo :)10:11
shardydtantsur: the command basically does three images, attempt to filter the enabled services and map them to images to pull/push, pull those images, push them to the local registry, finally it writes a heat environment file pointing to the things it pushed to the local registry10:11
shardysorry s/three images/three things10:11
shardyonly I just said four ;)10:11
sshnaidmjistr, I think we can revert patch added delorean-current to repos, since that wasn't root cause for a problem10:11
dtantsurheh10:12
shyambHi10:12
shardydtantsur: quickstart does do this, if you run it with the right tags, but by default it writes overcloud-prep-containers but doesn't run it10:12
jistrsshnaidm: no we still need it i think. Not having dlrn-current content in CI would also be a bug.10:12
shyambKolla-build command is not recognizing -i option10:12
dtantsurshardy: yep, and it writes overcloud-prep-containers that does not even work...10:12
shyambIs it removed?10:12
jistrsshnaidm: we'd be CIing promoted content instead of latest content => wrong10:12
shardydtantsur: Ok that's probably a bug - are you specifying some custom roles in the quickstart config, or defining them after the deploy?10:13
shardye.g quickstart deploy10:13
dtantsurshardy: after deploy (I do essentially everything post-deploy)10:13
*** morazi has quit IRC10:13
dtantsurshardy: the script ends up referencing non-existent /home/stack/containers-default-parameters.yaml10:13
shardydtantsur: Ok so quickstart doesn't know what services you need, so I guess it doesn't set PREPARE_ARGS for overcloud-prep-containers, since it doesn't run it10:13
dtantsur(which I now generated, but I had to learn how)10:13
shardydtantsur: can you share your quickstart config please?10:14
jistrykarel, sshnaidm: so now that we'll actually start running the yum updates we should, i wonder what it's going to do to CI run times... :)10:14
sshnaidmjistr, well, right..10:14
dtantsurshardy: http://paste.openstack.org/show/729119/ (I also have custom nodes config)10:14
sshnaidmjistr, maybe to update containers by 2 steps, firstly gating repo and then delorean-current..10:15
shardydtantsur: If you add containerized_overcloud: true it should create /home/stack/containers-default-parameters.yaml10:15
dtantsurshardy: shouldn't it be the default?10:15
shardyYeah I think there's a bug where that defaults to false incorrectly since it wasn't the default until recently10:16
jistrsshnaidm: but that would not do any speed up, no?10:16
dtantsuresp. since we don't support non-containerized overclouds..10:16
sshnaidmjistr, no, I mean it won't erase built package with newer one from delorean-current10:16
shardydtantsur: yeah it's something we need to fix I think10:16
shardyI explicitly set containerized_undercloud: true and containerized_overcloud: true in my config in the meantime10:16
jtomasekI've been trying to get this one pass the CI for around a month now https://review.openstack.org/#/c/587380/ is the legacy-DLRN-rpmbuild timeout known issue? Is there anything I can do to get this patch pass CI?10:16
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Make redeploy idempotent  https://review.openstack.org/59000810:17
ykareljistr, hmm let's see how much time it increase and well it increases with delays in promotion10:17
shardydtantsur: I'll raise a bug so we can track fixing it in quickstart10:17
jistrsshnaidm: i think it shouldn't do that either way. If we pull both repos into a single update, the highest version package will be selected. (I *hope* that gating repo would name packages with newer version than dlrn-current.)10:17
dtantsurshardy: thanks!10:17
* dtantsur updates his config10:17
ykareljistr, gating repo has higher priority10:18
jaosoriorHas anybody seen this error in quickstart? http://paste.openstack.org/show/729121/10:18
sshnaidmjistr, well, that's the case - it has higher version only if built package in on top of repo HEAD10:18
jistrykarel, sshnaidm: so the higher priority would take care of it. So we should be good i hope.10:18
sshnaidmjistr, if somebody just now merged something to tripleo-common - your patch is not more higher than this one from delorean-current which built from head10:18
sshnaidmjistr, unfortunately it does not10:19
sshnaidmjistr, maybe it would work wiht "yum install", but it definitely doesn't work with "yum update"10:20
jistrsshnaidm: well if that's the case then we may need to tackle this indeed10:21
shyambTengu: Any thoughts? kolla-build is not recognizing -i option10:22
jistrsshnaidm, ykarel: btw for job speed up, what could help is having images built daily or 2x per day with latest content, so that there's not so many packages that need updating in each job (that's what we discussed on CI call on tuesday)10:22
shyambit is required to register to RHN10:22
sshnaidmjistr, yeah.. because if patch if not rebased we don't test it actually (again!) :D10:22
shyambjistr: ?10:22
* jistr looks up what's -i for kolla-buid10:24
ykareljistr, u mean building/pushing containers on docker.io?10:24
Tengushyamb: you're deploying centos or redhat OS? If you're deploying redhat, you might want to check the doc related to "openstack plateform" and "director" I think.10:24
jistrykarel: yea anywhere, probably docker.io. Instead of "tripleo-current" we'd use "tripleo-latest" or something like that (not sure how to call it :) ).10:24
Tengushyamb: note that centos doesn't need RHN.10:24
*** jaosorior has quit IRC10:25
*** jaosorior has joined #tripleo10:27
shyambI need to use rhel as base image10:28
shyamband build my container on it10:28
shyambTengu: using kolla-build10:28
Tengushyamb: you then might want to go on  the kolla dedicated channel10:29
*** leanderthal has joined #tripleo10:30
shyambok10:30
jistrshyamb: there's a hint at the bottom of this section: https://github.com/openstack/kolla/blob/d609c318bf374217c5d2e40a9e51dd565581333d/doc/source/admin/image-building.rst#build-openstack-from-source10:31
shyambjistr: Thanks, will check10:32
*** udesale has joined #tripleo10:33
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates stable/rocky: [WIP] logging test DO NOT MERGED  https://review.openstack.org/59812810:34
*** sambetts has joined #tripleo10:36
sambettsshardy: Hi, do you know if there is a way to convert a string to a json in heat templates? I'm reading in a json file a one point and want to convert it to a dict to pass into another resource10:38
shardydtantsur: https://bugs.launchpad.net/tripleo/+bug/1789881 raised which I think desribes your issue10:39
openstackLaunchpad bug 1789881 in tripleo "tripleo-quickstart fails to generate /home/stack/containers-default-parameters.yaml" [Medium,Triaged]10:39
dtantsurthanks!10:39
shardysambetts: yes str_replace in recent versions will serialized a map/list to a json string10:39
shardyhttps://docs.openstack.org/heat/latest/template_guide/hot_spec.html#str-replace10:39
sambettsshardy: I think thats the wrong way around, I need string to json10:39
sambettsor rather string to parsed json10:40
shardysambetts: Ah, then you can pass the string to a json parameter, e.g a nested stack10:40
shardyjson parameters accept json strings and map/list data10:40
shardyhttps://docs.openstack.org/heat/latest/template_guide/hot_spec.html#parameters-section10:41
*** shyamb has quit IRC10:41
shardysambetts: there's no way at present to parse a json string inside a single template though10:41
sambettsI was surprised that declaring the output type of my software deployment thats reading the file as "Json" didn't parse it for me :/10:41
sambettsshardy: ah, thats frustrating :( I wonder if I can create a nested stack that literally takes the string as a parameter, and then just returns the converted dict as an output10:42
shardysambetts: the Json output probably should parse it so perhaps that's a bug - what do you need to pass the data into?10:44
*** udesale has quit IRC10:44
*** udesale has joined #tripleo10:44
sambettsI want to pull some of the keys out into a heira data config10:45
sri_shardy, Hi if you have min i need your help, my overcloud faield with "resources.WorkflowTasks_Step2_Execution: ERROR" I am trying to see why it's failed I am not able understand the error message  http://paste.openstack.org/show/729123/10:45
*** abishop has joined #tripleo10:47
shardysri_: try openstack stack failures list --long overcloud10:56
shardysambetts: yeah that may work, or possibly yaql, but I think the Json output lack of parsing is probably a bug so perhaps worth filing one10:56
*** shardy is now known as shardy_lunch10:57
sambettsshardy: I wondered if yaql was an option but I wasn't sure if it would handle it as a string or converted it to a dict first10:57
sri_shardy, it's not as useful usefull http://paste.openstack.org/show/729126/10:58
openstackgerritMerged openstack/tripleo-quickstart-extras master: Log collection: list installed rpms and their source repos  https://review.openstack.org/59752510:59
*** shyamb has joined #tripleo11:00
*** gfidente has joined #tripleo11:04
*** ansmith has quit IRC11:13
*** holser_ has quit IRC11:14
*** holser_ has joined #tripleo11:15
*** jcoufal has joined #tripleo11:20
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Simplify ssh known_hosts entries for non-default port  https://review.openstack.org/59813711:25
*** jpena is now known as jpena|lunch11:27
*** sshnaidm is now known as sshnaidm|afk11:28
*** bfournie has quit IRC11:34
*** rnm has joined #tripleo11:34
*** rnm is now known as rmart0411:36
*** threestrands has quit IRC11:38
*** rh-jelabarre has joined #tripleo11:39
*** rmart04 has quit IRC11:40
*** rnm has joined #tripleo11:40
*** rnm has quit IRC11:42
*** Petersingh|mtg is now known as Petersingh11:42
*** rnm has joined #tripleo11:42
*** rnm is now known as rmart0411:43
EmilienMflorianf: sounds like validations are in bad shape with containeirzed undercloud11:44
EmilienMflorianf: https://bugs.launchpad.net/tripleo/+bug/178988611:45
openstackLaunchpad bug 1789886 in tripleo "Validation runs through mistral are breaking" [High,Triaged]11:45
EmilienMflorianf: let me know if we can help11:46
*** dprince has joined #tripleo11:46
*** shyamb has quit IRC11:47
*** gouthamr has quit IRC11:49
*** dmellado has quit IRC11:50
*** shyamb has joined #tripleo11:50
*** stevebaker has quit IRC11:51
shyambHi11:52
shyambWhen I try to build container with rhel base, it's failing following error11:53
shyambhttp://paste.openstack.org/show/729127/11:53
*** Petersingh is now known as Petersingh|afk11:56
shyambjaosorior: owalsh: Any idea here?11:57
shyambI am following this doc11:58
shyambhttps://github.com/openstack/kolla/blob/d609c318bf374217c5d2e40a9e51dd565581333d/doc/source/admin/image-building.rst#build-openstack-from-source11:58
*** fultonj has joined #tripleo11:58
*** morazi has joined #tripleo12:00
*** trown|outtypewww is now known as trown12:06
*** udesale has quit IRC12:08
*** bfournie has joined #tripleo12:09
*** agurenko has quit IRC12:11
*** udesale has joined #tripleo12:11
*** agurenko has joined #tripleo12:12
*** agurenko has quit IRC12:13
*** khyr0n has joined #tripleo12:17
trownEmilienM: would you mind looking at https://review.openstack.org/596713 ... it will stop us getting random failures trying to connect to fedoraproject registry in scenario00912:18
*** shardy_lunch is now known as shardy12:18
EmilienMtrown: sure12:18
EmilienMtrown: boom12:18
trownEmilienM++ thanks  ... I dont care what anyone says about you... you are alright :P12:19
EmilienM:-O12:19
sri_shardy, openstack stack failures list --long overcloud http://paste.openstack.org/show/729126/12:20
*** akrivoka has quit IRC12:20
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10  https://review.openstack.org/58249512:21
trownmandre: ^ thanks. kicked a local run with that12:24
owalshshyamb: https://review.openstack.org/58851812:25
shardysri_: Hmm, my best guess is this is an old release and that workflow is failing while installing ceph12:25
shardysri_: perhaps check /var/log/mistral/ceph-install-workflow.log on the undercloud12:25
shardyor gfidente/fultonj may have some ideas12:25
*** akrivoka has joined #tripleo12:25
jistrpanda|rover: maybe it would be better to remove the +A from https://review.openstack.org/#/c/598089/ for now, until we see what it does to CI run times. It's likely that current CI doesn't test much, but the patch might make it timeout, which wouldn't be too much of an improvement...12:26
jistrpanda|rover: i'm a bit worried that we'll have 2 bad options to choose from (broken CI or timing out CI), we'll see...12:26
panda|roverjistr: removed, sorry. Didn't have enough context it seems12:27
shardyhmm images.rdoproject.org seems to be down12:27
sri_shardy, ack, ceph-install-workflow.log does not exist12:27
*** tzumainn has joined #tripleo12:27
shardysri_: Hmm Ok - it may be necessary to look at the mistral logs to figure out what workflow failed then12:28
shardysri_: that error from heat isn't great, lately we do this all via ansible which generally gives some clearer errors12:29
sri_shardy, I think this is ansible logs http://paste.openstack.org/show/729123/12:29
fultonjsri_: on a call12:30
sri_fultonj, ack, I will wait12:30
fultonjsri_: http://blog.johnlikesopenstack.com/2017/09/debug-tripleo-ceph-ansible.html12:31
*** jpena|lunch is now known as jpena|off12:31
fultonjsri_: read the section "Why didn't the ceph-ansible playbook run?"12:31
*** jpena|off is now known as jpena12:32
shardyThere are no workflow_tasks for the RoleConfig which is surprising considering the failure is in WorkflowTasks_Step212:33
shardysri_: you could perhaps do openstack stack resource list 28b1cf80-0a02-433a-bc9d-6a42936c7bd1 and try to get more details on why the WorkflowTasks_Step2 resource failed12:34
*** slaweq has quit IRC12:34
shardyor openstack stack resource show 28b1cf80-0a02-433a-bc9d-6a42936c7bd1 WorkflowTasks_Step212:34
shardyif that doesn't provide clues the next step is probably heat/mistral logs unfortunately12:34
*** slaweq has joined #tripleo12:34
EmilienMsshnaidm|afk: please add more context on https://bugs.launchpad.net/tripleo/+bug/1789871 and details on what tasks we need logging, we'll do it12:35
openstackLaunchpad bug 1789871 in tripleo "Tripleo modify image role doens't have verbosity and logs" [High,Triaged]12:35
EmilienMmwhahaha: about https://bugs.launchpad.net/tripleo/+bug/1789771 - I'm wondering if we really need iSCSI on the undercloud12:36
openstackLaunchpad bug 1789771 in tripleo "iscsid unavaiable after rebooting undercloud " [High,Triaged]12:36
sri_shardy, fultonj,  openstack stack resource show 28b1cf80-0a02-433a-bc9d-6a42936c7bd1 WorkflowTasks_Step2  http://paste.openstack.org/show/729132/12:36
shyambowalsh: thanks12:36
*** rlandy has joined #tripleo12:37
sri_shardy, fultonj I've just re-run the stack after failure.12:37
*** gkadam has quit IRC12:38
shyambowalsh: I see it is merged in master12:38
shyambI have install koll using pip install kolla12:38
shyambI think I should clone kolla repo and use it12:39
*** udesale has quit IRC12:40
mwhahahaEmilienM: ironic uses it or something12:41
EmilienMnot even sure12:43
EmilienMcinder for sure12:44
florianfEmilienM: sorry, replied in the wrong channel before... Yes, the patch to fix the empty listing works now, but validation runs via mistral are currently broken12:44
EmilienMflorianf: why are we testing that only now?12:44
EmilienMflorianf: we switched the containerized undercloud months ago12:45
*** thrash|g0ne is now known as thrash12:45
shyambowalsh: Hi12:45
shyambWe want to run our horizon plugin as part of horizon container12:46
shyambWhat is the recommended approach for this?12:46
ssbarneaEmilienM: do you think you could add me to tripleo project on LP? so I can edit bug statuses.12:47
EmilienMssbarnea: sure what's your LP id?12:47
shyambOne approach I know is: 1. Use kolla extend feature and build horizon container with trilio horizon packages appended and user should install this container instead od openstack12:48
*** raildo has joined #tripleo12:48
shyambhorizon container12:48
shyambowalsh: jaosorior: Any other way you see?12:48
ssbarneaEmilienM: ssbarnea, as usual.12:48
florianfEmilienM: I had several oooq environments running from master just fine until the problem with the listing showed up only recently. Not really sure why it didn't show up earlier, I was wondering this myself.12:48
EmilienMssbarnea: done12:48
EmilienMflorianf: are you saying it used to work in a containerized undercloud before and it doesn't anymore?12:49
ssbarneaEmilienM: thanks! the only reason why i keep using the same nick is that is really unique.12:49
florianfEmilienM: I can't really pinpoint it to be honest, because I didn't really test the containerized version specifically myself until the listing was broken.12:51
*** udesale has joined #tripleo12:53
jistrflorianf, EmilienM: it's possible that CI results of late were misreporting because of https://review.openstack.org/#/c/598089/ -- that could have caused both false positives and false negatives12:54
EmilienMjistr: indeed12:55
*** shyamb has quit IRC12:55
slagledang, should have ninja'd all my changes in12:55
jistr:)12:56
*** ansmith has joined #tripleo12:57
fultonjsri_: version?12:57
fultonje.g. queens?12:57
sri_stable/queens12:57
fultonjdid you inject a trust anchor?12:57
fultonjor did you update your undercloud.conf to disable ssl?12:58
sri_fultonj, I did enable the ssl in my undercloud12:58
fultonjsri_: did you inject a trust anchor?12:58
slaglejistr: why don't we just always run yum update?12:58
sri_fultonj, no12:58
slaglejistr: yum already has the logic builtin to determine if needs to update anything :)12:58
fultonjsri_: then that's your problem12:59
slaglejistr: and the expensive repodata download is not saved since we are running repoquery anyway12:59
fultonjsri_: do you need encrypted connections between your undercluod and overcloud?12:59
sri_fultonj, not really12:59
fultonjmy recomendation is to disable it unless you need it12:59
sri_fultonj, does this means I enable ssl generate_service_certificate = true ?13:00
fultonjgenerate_service_certificate = False13:00
sri_fultonj, i see13:00
fultonjyou want ^13:00
jistrslagle: i'm not the author but i imagine that the intent was to update as little as possible. I.e. it wouldn't update rhel or delorean-deps or delorean snapshot. It only updates the whitelist and their deps: https://github.com/openstack/tripleo-quickstart/blob/68c8a313ed742488da1e2ead139f471784a3868a/config/release/tripleo-ci/master.yml#L59-L7213:00
fultonjthen you want to reinstall the UC13:00
sri_fultonj, Ok13:00
fultonjsri_: https://review.openstack.org/#/c/58821613:01
slaglejistr: ack. it seems that would still be possible with just a yum update --disablerepo=* --enablerepo=delorean-current. exactly as is done with the repoquery command earlier up13:01
fultonjsri_: ^ explanation in the comments of13:01
sri_fultonj, ack, I will reinstall my undercloud13:01
fultonjsri_: https://bugzilla.redhat.com/show_bug.cgi?id=1565861#c613:02
openstackbugzilla.redhat.com bug 1565861 in ceph-ansible "enable_ssh_admin task unable to signal undercloud due to SSL handshake error" [Low,Closed: notabug] - Assigned to johfulto13:02
*** myoung|pto is now known as moyung13:03
*** moyung is now known as myoung13:03
sri_fultonj, the only reason i enable ssl is to run uc-ui in my external/managemnt network13:03
jistrslagle: i guess that could fail if something from dlrn-current depends on a newer version of package from some of the other repos. Quite a rare situation i guess, but could happen IMO.13:03
*** jbadiapa has quit IRC13:03
sshnaidm|afkEmilienM, commented https://bugs.launchpad.net/tripleo/+bug/178987113:03
openstackLaunchpad bug 1789871 in tripleo "Tripleo modify image role doens't have verbosity and logs" [High,Triaged]13:03
fultonjsri_: there are many networks and many paths to encrypt13:04
fultonjhttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ssl.html13:04
jistrEmilienM: i have a related DNM patch, but it's all just hardcoded to max verbosity there (we needed something to debug quickly) https://review.openstack.org/#/c/597466/13:04
jistrit inflates the install-undercloud.log considerably13:05
jistrto 1.8 MB13:05
jistrhttp://logs.openstack.org/66/597466/1/check/tripleo-ci-centos-7-containers-multinode/3eb4765/logs/undercloud/home/zuul/install-undercloud.log.txt.gz13:05
*** moshele has quit IRC13:06
sri_fultonj, got it, to reinstall my UC i just need to run openstack undercloud install ?13:07
fultonjsri_: yes13:07
sri_fultonj, understood, http://paste.openstack.org/show/729135/13:08
fultonjsri_: +113:09
*** Petersingh|afk has quit IRC13:13
sri_fultonj, couple of questions reinstalling undercloud also updates templates ? my udnercloud 10 day old , if so using updated templates would be better right ?13:13
fultonjsri_: i don't think it does update your templates13:14
fultonji never modify /usr/share/openstack-tripleo-heat-templates13:14
fultonji reference it and have my own overrides.yaml or similar13:14
fultonjif i need to modify it i make my own copy13:15
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates stable/rocky: Remove unused config file when start ovs agent  https://review.openstack.org/59815813:15
fultonjsri_: you're not installing the RPMs by running the install script13:15
fultonjthey're brought in as deps13:15
fultonjAFICT13:15
fultonjsri_: if there's templates in /usr/share/openstack-tripleo-heat-templates you modified, then copy them to be safe13:16
sri_fultonj, ack, generally I copy /usr/share/openstack-tripleo-heat-templates to my home/stack13:16
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates stable/queens: Remove unused config file when start ovs agent  https://review.openstack.org/59816113:17
*** lvdombrkr has joined #tripleo13:19
*** pdeore has joined #tripleo13:20
*** jbadiapa has joined #tripleo13:22
sri_fultonj, http://paste.openstack.org/show/729139/ I run in to this error while reinstalling13:22
*** raildo has quit IRC13:24
fultonjsri_: did you read that log?13:25
fultonjlog can be found at /home/stack/.instack/install-undercloud.log.13:25
dtrainorjrist, did you still need me from 10 hours ago?13:26
jristdtrainor: it was for helping a rando13:26
jristso, no13:26
jristunless he's still around13:26
jristwhich he/she is not13:26
jristI think I helped?13:27
*** lblanchard has joined #tripleo13:29
dtrainorcool!13:29
noamahi13:30
noamai think https://review.openstack.org/#/c/596093/ should be backported to rocky13:30
noamai face same issue https://bugs.launchpad.net/tripleo/+bug/178791013:31
openstackLaunchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)13:31
*** raildo has joined #tripleo13:31
*** fultonj has quit IRC13:31
openstackgerritNoam Angel proposed openstack/tripleo-heat-templates stable/rocky: Do not enable Ram/Disk Filter with filter_scheduler  https://review.openstack.org/59816713:32
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: DNM: OVN test  https://review.openstack.org/59305613:35
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Revert "add delorean-current to repolist for updates"  https://review.openstack.org/59580313:42
sshnaidm|afkpanda|rover, jistr this could save time in jobs ^^ although it also has side-effects13:42
sri_fultonj, yes it's not clear tho, I think it's because of I didn't delete the stack and nodes before I reinstalling the UC13:43
ykarelnoama, but the nova patch(https://review.openstack.org/#/c/565841) for which https://review.openstack.org/#/c/596093/ was proposed is not backported to rocky so i don't think backport for https://review.openstack.org/#/c/596093/ is required13:47
ykareldid u see the same symptom in the scheduler log, RamFilter returned 0 hosts?13:47
noamai see same issue in rocky13:48
ykarelnoama, where? link?13:48
*** udesale has quit IRC13:49
*** udesale has joined #tripleo13:50
noama2018-08-30 08:25:20.195 28 DEBUG nova.scheduler.filters.ram_filter [req-b9da3ce6-b491-41bf-be8e-b8dbd0171aca 99e4051c40b14c2e9c2516d832e4e8cf c9d2810ec8b44d4cb4da7d6213676744 - default default] (cloudx-uc4.localdomain, 8bc64efd-fc1d-4739-a90a-c6d56fe5a595) ram: 0MB disk: 0MB io_ops: 0 instances: 0 does not have 4096 MB usable ram before overcommit, it only has 0 MB. host_passes13:50
noama/usr/lib/python2.7/site-packages/nova/scheduler/filters/ram_filter.py:4613:50
noama2018-08-30 08:25:20.195 28 DEBUG nova.scheduler.filters.ram_filter [req-b9da3ce6-b491-41bf-be8e-b8dbd0171aca 99e4051c40b14c2e9c2516d832e4e8cf c9d2810ec8b44d4cb4da7d6213676744 - default default] (cloudx-uc4.localdomain, c92ffec3-1406-4b0b-a796-822771fe4c71) ram: 0MB disk: 0MB io_ops: 0 instances: 0 does not have 4096 MB usable ram before overcommit, it only has 0 MB. host_passes13:50
noama/usr/lib/python2.7/site-packages/nova/scheduler/filters/ram_filter.py:4613:50
noama2018-08-30 08:25:20.196 28 INFO nova.filters [req-b9da3ce6-b491-41bf-be8e-b8dbd0171aca 99e4051c40b14c2e9c2516d832e4e8cf c9d2810ec8b44d4cb4da7d6213676744 - default default] Filter RamFilter returned 0 hosts13:50
*** psachin has quit IRC13:51
*** jistr is now known as jistr|call13:51
openstackgerritBrad P. Crochet proposed openstack/python-tripleoclient master: Make usage of --*-flavor and --*-count an error  https://review.openstack.org/56420713:52
*** waleedm has quit IRC13:56
*** gbarros has joined #tripleo13:56
*** hamdyk has quit IRC13:59
*** ykarel is now known as ykarel|away14:00
* ykarel|away will be online after half hour14:00
*** pdeore has quit IRC14:02
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Edit some post update tasks logic  https://review.openstack.org/58515914:05
*** ykarel|away has quit IRC14:06
*** sshnaidm|afk has quit IRC14:10
openstackgerritMerged openstack/tripleo-ui stable/rocky: Imported Translations from Zanata  https://review.openstack.org/59651814:18
*** sshnaidm|afk has joined #tripleo14:19
*** rpioso|afk is now known as rpioso14:19
*** sshnaidm|afk is now known as sshnaidm14:20
*** jistr|call is now known as jistr14:21
*** aufi has quit IRC14:22
*** mpasserini has joined #tripleo14:27
mpasseriniHi all… with moving to tripleo with containerized services, how do you advice running post install scripts inside containers, which change files after puppet is run ?14:29
*** aufi has joined #tripleo14:29
mpasseriniafter changing files we'd also want to restart the service , or maybe restart the container (without loosing the edits)14:29
mpasseriniif we edit the dockerfile , puppet overwrites the changes …14:30
mpasseriniwe can't/don't want to do these changes with puppet14:30
jaosoriormpasserini: if the configuration is managed by puppet, you could change /var/lib/config-data/puppet-generated/<service name>/ ... of course, you always need to run this in extraconfig14:34
*** ykarel has joined #tripleo14:35
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: WIP: Testing atomic package from virt-sig  https://review.openstack.org/59819014:42
*** jchhatbar has quit IRC14:43
trownmandre: I wonder if atomic is pre-installed on the nodepool nodes... I can not figure out why that issue would only happen in local environments otherwise14:44
sambettsshardy: creating a template for doing the string to dict conversion works so I've just registered it as a type in my setup and can now call it like ConvertToJson: type: OS::TrupleO::JsonConverter properties: data: <my string> and then I can do {get_attr: [ConvertToJson, converted]} to get it back out14:46
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Workflow for provisioning bare metals without Nova  https://review.openstack.org/57685614:47
dtantsurshardy, hjensas, updated ^^^ but completely untested14:47
shardysambetts: good news, perhaps we can follow up and work out a cleaner approach but good that you have a workaround14:48
shardydtantsur: ack thanks, will give it a try14:49
sambettsshardy: yeah it seems like a heat bug that defining outputs: - name: myoutput type: Json doesn't convert it on read14:49
shardysambetts: yeah I agree - are you planning to raise a bug to track resolving that?14:49
*** sanjayu__ has quit IRC14:50
sambettsshardy: where does heat track its bug reports these days launchpad or storyboard?14:50
shardysambetts: https://storyboard.openstack.org/#!/project/989 I think14:51
sambettscool thanks :D14:51
*** ykarel has quit IRC14:54
owalshbetherly_: shyamb was asking about 3rd party horizon plugins + containers for trilio integration with OSP. Are you the right person to point him at?14:55
dtantsurshardy: trying your instruction, but immediately hitting Error: image tripleomaster/centos-binary-mistral-executor:current-tripleo not found14:58
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944815:00
shardydtantsur: are you running it on the undercloud, where e.g 192.168.24.1:8787/tripleomaster/centos-binary-mistral-executor:current-tripleo exists from running overcloud image prepare?15:00
mandretrown: upstream started hitting the atomic install issue, http://logs.openstack.org/95/582495/18/check/tripleo-ci-centos-7-scenario009-multinode-oooq/04e61f8/logs/undercloud/var/lib/mistral/overcloud/openshift/playbook.log.txt.gz15:00
dtantsurshardy: it's on the undercloud15:01
trownmandre: oh ... I guess we can rebase on https://review.openstack.org/598190 then ... but we cant merge https://review.openstack.org/598190 :(15:01
shardydtantsur: Ok, rdocloud is down so I wonder if it's failing trying to pull the remote image?15:02
shardyI can't rebuild my undercloud until it comes back up but I'll re-test when it does15:02
dtantsurshardy: http://paste.openstack.org/show/729145/15:02
*** sdoran has joined #tripleo15:03
*** ykarel has joined #tripleo15:03
mpasserinijaosorior that's awesome! It worked, thanks a lot.15:03
shardydtantsur: what does docker images | grep mistral show?15:03
jaosoriormpasserini: glad to help.15:03
dtantsurshardy: http://paste.openstack.org/show/729146/15:04
*** udesale has quit IRC15:04
*** zul has quit IRC15:05
shardydtantsur: can you use docker image inspect on the -executor image to see what tags it has?15:07
shardydoesn't look like your prepare command pulled/pushed a new mistral image earlier though?15:07
sambettsshardy: https://storyboard.openstack.org/#!/story/200360615:08
shardysambetts: ack thanks, maybe ramishra or zaneb can take a look15:08
mandretrown: any idea what should we do to mirror the virt-sig repo?15:10
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10  https://review.openstack.org/58249515:11
*** pcaruana has quit IRC15:12
trownmandre: not sure... I will ask rdo folks what to do if that patch helps us15:13
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: WIP: Testing atomic package from virt-sig  https://review.openstack.org/59819015:14
mandrewe'll see... I've added it as a dependency of our patch15:14
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Revert "Revert "Move to openshift-ansible 3.10""  https://review.openstack.org/58946915:14
trownmandre: that doesnt work :P15:15
trownhave to do it like ^15:15
trowni dont know if it is quickstart or zuul... but multiple patches in the same repo in zuul_changes doesnt include them all15:16
*** kopecmartin has quit IRC15:16
mandreack I keep forgetting15:16
ykarelnoama, where u see that error in CI, how u deployed, actually i wanted to see if somehow have master bits, as in rocky ci we are not seeing it15:16
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10  https://review.openstack.org/58249515:16
numansEmilienM, shardy Hi, can you please take a look at this patch - https://review.openstack.org/#/c/596594/ when you get some time.15:16
numansthanks15:16
EmilienMsure15:17
trownmandre: fixed it all up15:17
*** thrash is now known as thrash|f00dz15:23
dtantsurshardy: the only RepoTag is docker.io/tripleomaster/centos-binary-mistral-executor:0743a561fd1021f651e5d4d98690415bb3a6674f_2a6352ec15:25
*** ykarel has quit IRC15:25
*** ykarel has joined #tripleo15:29
shardydtantsur: did you fix the issue with missing containers-prepare-parameter.yaml then run overcloud-prep-containers?15:29
shardythat set the tag and pulls/pushes the current-tripleo images, assuming the master-tripleo-ci release15:30
shardydtantsur: alternatively you can point the FROM directly at docker.io15:30
dtantsurshardy: it was the same environment, so I assume I could have messed with it15:30
*** lvdombrkr has quit IRC15:31
shardydtantsur: Ok, it doesn't look to me like the images cached in the local registry are correct/updated15:31
dtantsurokay, docker.io doing soemthing15:31
*** mpasserini has quit IRC15:32
*** aufi has quit IRC15:32
*** jtomasek has quit IRC15:38
*** ykarel_ has joined #tripleo15:38
*** ykarel has quit IRC15:39
*** dprince has quit IRC15:43
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: DNM: Test lowercase issue from BZ 1619556.  https://review.openstack.org/59820815:47
*** ykarel_ is now known as ykarel15:55
*** trown is now known as trown|lunch15:55
sri_gfidente, if have min I need help with ceph-ansible, perversely my deployment failed at resources.WorkflowTasks_Step2_Execution: ERROR, that's because of I enable the ssl in undercloud, that time ceph-ansible didn't run, so I reinstall the undercloud disabling ssl this time ceph-ansbile run but deployment faild again at "resources.WorkflowTasks_Step2_Execution: ERROR"  I didn't find any error in ceph-install-workflow.log http://paste.openstack.org/show/72915515:56
sri_/15:56
*** yprokule has quit IRC15:56
gfidentesri_ hi, you mean you see in the ceph-ansible-install.log you see the playbook finished successfully?15:57
gfidentesri_ and yet the task failed?15:58
sri_gfidente, I am not sure why task failed, I am not able to find the any error messages15:59
sri_gfidente, I think it's failed to create OSD's15:59
gfidentesri_ ok so you should have the output of the ceph-ansible run in /var/lib/mistral/ceph-ansible-install.log16:00
*** hamzy has quit IRC16:00
*** ykarel has quit IRC16:00
sri_gfidente, yes http://paste.openstack.org/show/729157/16:02
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: DNM: OVN test  https://review.openstack.org/59305616:02
gfidentesri_ that's not the full log though16:02
*** leanderthal has quit IRC16:02
sri_gfidente, sorry it's cut off16:02
*** rdopiera has quit IRC16:03
sri_gfidente, https://pastebin.com/NFRSpXPu16:05
sri_I don't why paste.openstack.org not showing full logs16:05
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Remove "when failed" from debug task names  https://review.openstack.org/59822116:09
*** rbrady is now known as rbrady-afk16:10
*** jpich has quit IRC16:10
sri_gfidente,  ceph-osd-node /var/log/message http://paste.openstack.org/show/729161/16:12
gfidentesri_ fatal: [10.1.24.31]: FAILED! => {"changed": false, "failed": true, "msg": "please choose an osd scenario"}16:13
*** ykarel has joined #tripleo16:14
sri_gfidente, my ceph config http://paste.openstack.org/show/729162/   I am passing osd_scenario: collocated16:15
gfidentesri_ ah yeah but it's wrongly indented16:16
gfidenteit's outside the CephAnsibleExtraConfig param16:16
gfidenteso it got ignored completely16:16
*** ykarel has quit IRC16:17
sri_gfidente, oh my bad :P16:17
gfidentesri_ I am sure it will fail again on something else16:17
gfidenteno worries16:17
gfidente:D16:17
*** ccamacho has quit IRC16:19
*** rlandy is now known as rlandy|afk16:19
sri_gfidente, thanks for the heads up :)16:19
*** moguimar has quit IRC16:21
*** ykarel has joined #tripleo16:25
*** ykarel_ has joined #tripleo16:29
*** jfrancoa has quit IRC16:29
*** noama has quit IRC16:30
*** moshele has joined #tripleo16:30
*** ykarel has quit IRC16:31
*** sambetts is now known as sambetts|afk16:31
*** gbarros has quit IRC16:35
*** jbadiapa has quit IRC16:35
*** bnemec has quit IRC16:35
*** rpioso is now known as rpioso|afk16:37
openstackgerritHarald Jensås proposed openstack/instack-undercloud stable/rocky: Add start/stop command for ironic-inspector-dnsmasq  https://review.openstack.org/59822816:39
openstackgerritHarald Jensås proposed openstack/instack-undercloud stable/queens: Add start/stop command for ironic-inspector-dnsmasq  https://review.openstack.org/59822916:40
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59688716:40
*** agopi has quit IRC16:40
*** rmart04 has quit IRC16:41
*** gbarros has joined #tripleo16:41
openstackgerritHarald Jensås proposed openstack/tripleo-common master: Allow networks in roles_data to be dict or list  https://review.openstack.org/59557016:41
*** agopi has joined #tripleo16:42
*** dprince has joined #tripleo16:42
*** dprince has quit IRC16:43
*** dprince has joined #tripleo16:44
*** ksambor has quit IRC16:47
*** gouthamr has joined #tripleo16:49
*** thrash|f00dz is now known as thrash16:49
*** gbarros has quit IRC16:49
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59690616:49
*** ykarel_ has quit IRC16:53
*** ykarel has joined #tripleo16:55
*** ykarel has quit IRC16:55
*** shardy has quit IRC16:56
*** ccamacho has joined #tripleo16:58
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: python3ification of docker-puppet.py  https://review.openstack.org/59823417:00
*** ykarel has joined #tripleo17:01
*** dprince has quit IRC17:01
*** dtantsur is now known as dtantsur|afk17:04
*** stack has joined #tripleo17:05
*** ykarel_ has joined #tripleo17:06
*** ykarel has quit IRC17:08
*** agopi has quit IRC17:11
openstackgerritMerged openstack/tripleo-heat-templates master: Create missing directories before mounting them  https://review.openstack.org/59583117:11
openstackgerritMerged openstack/tripleo-ui stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59785517:11
openstackgerritMerged openstack/tripleo-ui stable/queens: import zuul job settings from project-config  https://review.openstack.org/59783917:11
openstackgerritMerged openstack/tripleo-ui stable/pike: import zuul job settings from project-config  https://review.openstack.org/59782117:11
openstackgerritMerged openstack/tripleo-ui stable/ocata: import zuul job settings from project-config  https://review.openstack.org/59780617:11
openstackgerritMerged openstack/tripleo-ui stable/queens: Imported Translations from Zanata  https://review.openstack.org/59700417:11
openstackgerritMerged openstack/tripleo-heat-templates master: Add OctaviaEventStreamerDriver and change default  https://review.openstack.org/59308317:11
openstackgerritMerged openstack/tripleo-quickstart-extras master: Remove deprecated ironic command from prep images  https://review.openstack.org/59743217:11
openstackgerritMerged openstack/tripleo-ui stable/rocky: Enable sorting of environments  https://review.openstack.org/59811017:11
openstackgerritMerged openstack/tripleo-ui stable/rocky: Sanitize deployment failure messages  https://review.openstack.org/59810817:11
openstackgerritMerged openstack/tripleo-ui stable/rocky: New regex for the FQDN that handles many subdomains  - also case insensitive.  https://review.openstack.org/59811517:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: List deployment plan in nodes list for deployed nodes  https://review.openstack.org/59810917:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: Fix error message in case of available roles listing failure  https://review.openstack.org/59811117:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: Convert NewPlan form to redux-form  https://review.openstack.org/59811817:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: Update plans state management  https://review.openstack.org/59811917:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: Convert EditPlan form to redux-form  https://review.openstack.org/59812017:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: Re-add ability to update plan via tarball  https://review.openstack.org/59812117:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: Add ability to create plan using default templates  https://review.openstack.org/59812217:12
openstackgerritMerged openstack/tripleo-ui stable/rocky: Add ability to import plan from Git repository  https://review.openstack.org/59812317:12
openstackgerritMerged openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare  https://review.openstack.org/57347617:12
*** trown|lunch is now known as trown17:13
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates stable/rocky: Add OctaviaEventStreamerDriver and change default  https://review.openstack.org/59824017:13
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates stable/queens: Add OctaviaEventStreamerDriver and change default  https://review.openstack.org/59824117:13
*** gkadam has joined #tripleo17:15
*** bnemec has joined #tripleo17:17
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944817:17
sshnaidmjistr, I think you need to remove -2 from https://review.openstack.org/#/c/59746617:19
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944817:21
*** skramaja has quit IRC17:23
*** ccamacho has quit IRC17:24
sri_gfidente, your right it faild again , this time no FAILED messages in  ceph-ansible-install.log17:24
sri_gfidente, http://paste.openstack.org/show/729168/ this errors are earlier17:27
*** jpena is now known as jpena|away17:27
*** khyr0n has quit IRC17:28
*** hamzy has joined #tripleo17:28
sri_gfidente, I've 4 3.8 TB OSD's  is this configuration looks right http://paste.openstack.org/show/729169/ ?17:30
*** ykarel_ is now known as ykarel|away17:32
*** holser_ has quit IRC17:35
*** ykarel|away has quit IRC17:36
jristmwhahaha, EmilienM - do you guys know how to un-abandone? https://review.openstack.org/#/c/563941/17:38
EmilienMdone17:38
EmilienMyou have to be core: https://review.openstack.org/#/admin/projects/openstack/tripleo-validations,access17:38
jristgotcha thanks EmilienM17:38
jristvalidations humans, can we get a review https://review.openstack.org/#/c/563941/17:43
jristthank youuuuuuuuuu <hug>17:43
*** dmellado has joined #tripleo17:44
*** stevebaker has joined #tripleo17:48
*** agopi has joined #tripleo17:48
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: nodepool-setup: add NODEPOOL_CBS_CENTOS_PROXY  https://review.openstack.org/59825517:54
*** moshele has quit IRC17:58
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enable virt7-container-common-candidate repo starting in Stein  https://review.openstack.org/59207918:00
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Enable virt7-container-common-candidate repo starting in Stein  https://review.openstack.org/59207918:00
*** rpioso|afk is now known as rpioso18:04
*** morazi has quit IRC18:05
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Initial support for Podman in docker-puppet  https://review.openstack.org/58865518:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker-puppet: don't force FACTER_hostname  https://review.openstack.org/59527418:08
*** khyr0n has joined #tripleo18:11
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman  https://review.openstack.org/59058718:14
openstackgerritNicolas Hicher proposed openstack-infra/tripleo-ci master: DNM: add vexxhost env for validation  https://review.openstack.org/59643218:16
*** gkadam has quit IRC18:17
*** dprince has joined #tripleo18:24
*** moshele has joined #tripleo18:26
openstackgerritCarlos Goncalves proposed openstack/tripleo-quickstart master: featureset038: run Octavia tempest tests  https://review.openstack.org/58011918:29
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: python3ification of docker-puppet.py  https://review.openstack.org/59823418:29
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Gate on scenario010  https://review.openstack.org/58701518:36
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Fix skip of octavia-undercloud Ansible role  https://review.openstack.org/59141318:37
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Download CentOS-based amphora image if not present  https://review.openstack.org/59199718:38
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944818:39
*** khyr0n has quit IRC18:39
*** khyr0n has joined #tripleo18:41
*** khyr0n has quit IRC18:52
*** gfidente has quit IRC18:54
*** khyr0n has joined #tripleo18:54
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Move Octavia config opts to common config directory  https://review.openstack.org/59637318:58
*** akrivoka has quit IRC19:00
sshnaidmdoes anyone has problems with launchpad?19:00
openstackgerritSagi Shnaidman proposed openstack/ansible-role-tripleo-modify-image master: Install yum priorities to containers before update  https://review.openstack.org/59832219:01
*** rlandy|afk is now known as rlandy19:05
*** moshele has quit IRC19:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: rabbit: do not mount /etc/rabbitmq in RO  https://review.openstack.org/59832719:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman  https://review.openstack.org/59058719:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman  https://review.openstack.org/59058719:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: rabbit: do not mount /etc/rabbitmq in RO  https://review.openstack.org/59832719:08
*** rbrady-afk is now known as rbrady19:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman  https://review.openstack.org/59058719:09
*** khyr0n has quit IRC19:10
*** khyr0n has joined #tripleo19:11
*** ansmith has quit IRC19:15
*** dxiri has joined #tripleo19:22
*** bfournie has quit IRC19:26
*** dxiri has quit IRC19:27
openstackgerritCarlos Goncalves proposed openstack/tripleo-quickstart master: featureset038: run Octavia tempest tests  https://review.openstack.org/58011919:27
mwhahahaEmilienM, owalsh: so placement api getting moved to it's own repo... have we lined up the required packaging changes so we don't get screwed at some point this cycle?19:29
EmilienMprobably not yet19:37
*** jpena|away is now known as jpena|off19:38
openstackgerritMerged openstack/tripleo-quickstart master: Use mirrored etcd container for openshift CI  https://review.openstack.org/59671319:38
*** khyr0n has quit IRC19:41
openstackgerritMerged openstack/python-tripleoclient master: Use tripleo-admin user for minor updates  https://review.openstack.org/59679719:53
*** hamzy has quit IRC19:54
*** hamzy has joined #tripleo19:55
*** dxiri has joined #tripleo19:56
mwhahahaare the jobs broken?19:59
mwhahahaseeing an odd error about some neutron puppet stuff19:59
mwhahahamaybe it's this change20:01
openstackgerritNicolas Hicher proposed openstack-infra/tripleo-ci master: DNM: add vexxhost env for validation  https://review.openstack.org/59643220:03
*** Guest58453 has joined #tripleo20:04
*** morazi has joined #tripleo20:05
*** nhicher has joined #tripleo20:08
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Revert "bump ansible from 2.5.5 to 2.5.8"  https://review.openstack.org/59833920:10
*** paramite|clone has quit IRC20:10
*** bfournie has joined #tripleo20:23
*** mugsie has quit IRC20:25
*** tzumainn has quit IRC20:27
rlandyrdocloud jobs have an issue atm ... investigating 2018-08-30 20:19:36.298102 | tripleo-ovb-centos-7 | ERROR! Unexpected Exception: No module named manager20:27
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Revert "bump ansible from 2.5.5 to 2.5.8"  https://review.openstack.org/59833920:29
*** dprince has quit IRC20:39
*** mugsie has joined #tripleo20:39
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944820:39
*** tzumainn has joined #tripleo20:40
openstackgerritMerged openstack/ansible-role-tripleo-modify-image master: Fix type in variable which blocked updates  https://review.openstack.org/59808920:46
*** rmart04 has joined #tripleo20:48
*** raildo has quit IRC20:50
openstackgerritMerged openstack/tripleo-heat-templates master: Remove uneececary conditionals in network-environment jinja  https://review.openstack.org/59490620:56
openstackgerritMerged openstack/tripleo-heat-templates master: Run designate pool update only on bootstrap node  https://review.openstack.org/58366820:56
*** hamzy has quit IRC20:59
*** trown is now known as trown|outtypewww21:03
*** lblanchard has quit IRC21:04
openstackgerritMerged openstack/tripleo-heat-templates master: Open designate-mdns ports in firewall  https://review.openstack.org/58366921:12
openstackgerritMerged openstack/tripleo-heat-templates master: Pass in rndc key to Designate deployment  https://review.openstack.org/58367021:12
*** rmart04 has quit IRC21:16
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59688721:18
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59690621:18
*** holser_ has joined #tripleo21:19
*** jcoufal has quit IRC21:20
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59688721:23
*** thrash is now known as thrash|g0ne21:26
*** tzumainn has quit IRC21:30
*** dmellado has quit IRC21:31
*** dmellado has joined #tripleo21:31
*** stevebaker has quit IRC21:36
*** holser_ has quit IRC21:37
*** agopi has quit IRC21:40
*** stevebaker has joined #tripleo21:41
*** holser_ has joined #tripleo21:42
*** myoung has quit IRC21:47
*** rcernin has joined #tripleo21:49
*** florianf has quit IRC21:54
*** khyr0n has joined #tripleo22:07
*** tosky has quit IRC22:23
*** holser_ has quit IRC22:30
*** sshnaidm is now known as sshnaidm|off22:35
*** dbecker has quit IRC22:37
*** lblanchard has joined #tripleo22:38
*** lblanchard has quit IRC22:42
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59688722:55
*** rpioso is now known as rpioso|afk23:02
*** dbecker has joined #tripleo23:06
*** agopi has joined #tripleo23:12
*** lblanchard has joined #tripleo23:25
*** lblanchard has quit IRC23:25
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59690623:32
*** sri_ has quit IRC23:33
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59690623:33
*** sri_ has joined #tripleo23:33
*** lblanchard has joined #tripleo23:41
*** khyr0n has quit IRC23:47
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59690623:48
*** dxiri has quit IRC23:54
*** dxiri has joined #tripleo23:55
openstackgerritMerged openstack/instack-undercloud stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784323:56
*** rcernin has quit IRC23:56
*** rcernin has joined #tripleo23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!