Friday, 2018-04-06

slagleto do all the stopping/disabling00:00
*** waleedm has quit IRC00:00
slagleof course subprocess works as well :)00:00
slaglehaving to go through the whole upgrade flow to use upgrade_tasks does seem a little heavy handed00:00
EmilienMslagle: I was trying to avoid subprocess... and rather use ansible00:00
EmilienMthat's what I thought00:01
EmilienMbut good idea of your proposal with host_prep_tasks00:01
EmilienMI'll investigate that!00:01
EmilienMslagle: thanks00:01
slagleit might be tricky b/c you might need things stopped before getting that far00:02
EmilienMha, yes00:03
EmilienMand AFIK host_prep_tasks has no step support00:03
EmilienMon the other hand it's worth a try, host_prep_tasks runs before the deployment steps00:03
EmilienMbefore docker_puppet_tasks I mean00:04
*** fpan has quit IRC00:06
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755600:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]00:10
*** d0ugal has quit IRC00:13
*** d0ugal has joined #tripleo00:17
*** tosky has quit IRC00:19
*** chlong has quit IRC00:19
*** hamzy has quit IRC00:19
*** hamzy has joined #tripleo00:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic-conductor: configure ipxe_timeout to 60  https://review.openstack.org/55913000:23
*** dprince has joined #tripleo00:37
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: mistral: align parameters with undercloud  https://review.openstack.org/55865400:37
EmilienMdprince, slagle : I was thinking to rename --use-heat to something more obvious for our operators, like, --containerized or something like this. What do you think?00:41
EmilienMsince the heat-installer is actually containerizing our undercloud00:42
EmilienM(I guess this parameter will disappear in Stein release, when we make the containerized undercloud a default)00:42
dprinceEmilienM: so the reason --use-heat was there was we could have easily supported baremetal with this same setup00:45
*** lblanchard has quit IRC00:45
dprinceEmilienM: I think I would rather just see the option go away long term00:45
dprinceEmilienM: keep it as is, then lets cut over and drop it00:45
dprinceEmilienM: no need to support 2 underclouds long term I think00:45
EmilienMok00:45
EmilienMindeed00:45
dprinceless options, better!00:46
EmilienMdprince: I just thought, while we support it (one or 2 releases), rename it00:46
EmilienMopenstack undercloud install --containerized00:46
EmilienMour ops understand "oh my undercloud will be containerized"00:46
EmilienMvs. --use-heat00:46
EmilienM"what? I'll use heat? why?"00:46
dprinceEmilienM: if we set it to true by default, nobody will use it anyway00:47
EmilienMwe won't set to true in Rocky I guess? I'm not sure00:47
dprinceEmilienM: the plan was deliver this in rocky00:48
EmilienMI would be happy too00:48
EmilienMdprince: today we switched ovb-ha job to it00:48
EmilienMand we also have one multinode gating on it00:48
dprincenice00:48
EmilienMwe also made good progress on upgrade path00:49
EmilienManyway, we'll see00:49
*** dmacpher has joined #tripleo00:50
*** colonwq has joined #tripleo00:53
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: test_undercloud: refactor args to avoid duplication  https://review.openstack.org/55920500:53
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: containerized/undercloud: disable verbosity by default  https://review.openstack.org/55914000:56
*** lblanchard has joined #tripleo00:57
*** lblanchard has quit IRC01:02
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755601:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]01:10
*** cshastri has joined #tripleo01:25
openstackgerritMerged openstack/tripleo-quickstart-extras master: add mtu summary for each nic on each node  https://review.openstack.org/55913801:48
*** fzdarsky_ has joined #tripleo01:52
*** ykarel|afk has joined #tripleo01:55
*** fzdarsky|afk has quit IRC01:55
*** fzdarsky_ has quit IRC01:57
*** dprince has quit IRC01:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Implement UndercloudUpgrade service  https://review.openstack.org/55921001:58
EmilienMslagle: ^ first attempt, feedback welcome01:58
EmilienMI missed a bunch of things to teardown, like the crontabs01:58
*** fragatina has quit IRC01:59
*** fzdarsky_ has joined #tripleo02:00
openstackgerritMerged openstack/tripleo-heat-templates master: Enable ironic rescue mode by default  https://review.openstack.org/55533602:04
openstackgerritMerged openstack/tripleo-image-elements stable/queens: Add a dependency on block-device-mbr element  https://review.openstack.org/55905702:04
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Implement UndercloudUpgrade service  https://review.openstack.org/55921002:06
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755602:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]02:10
*** owalsh_ has joined #tripleo02:14
*** ykarel|afk has quit IRC02:16
*** owalsh has quit IRC02:17
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: containerized/undercloud: disable verbosity by default  https://review.openstack.org/55914002:20
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: containerized/undercloud: disable verbosity by default  https://review.openstack.org/55914002:25
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - Test fs027 with --debug  https://review.openstack.org/55917902:25
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Manage upgrades to a containerized undercloud  https://review.openstack.org/54962402:32
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Manage upgrades to a containerized undercloud  https://review.openstack.org/54962402:33
*** dparkes has joined #tripleo02:33
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: WIP - containerized undercloud upgrade  https://review.openstack.org/55362902:34
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: WIP - containerized undercloud upgrade  https://review.openstack.org/55362902:36
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363302:37
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363302:37
*** dparkes has quit IRC02:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: heat: align config with instack-undercloud  https://review.openstack.org/55835402:38
*** psachin` has joined #tripleo02:50
*** janki has joined #tripleo02:52
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: firewall: cleanup nat rules  https://review.openstack.org/55925902:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797202:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797202:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove nat/masquerading config workarounds.  https://review.openstack.org/55785102:53
*** ramishra has joined #tripleo02:59
*** jaganathan has quit IRC02:59
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755603:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]03:10
*** ooolpbot has quit IRC03:10
*** ramishra has quit IRC03:17
*** ramishra has joined #tripleo03:19
*** fragatina has joined #tripleo03:25
*** fragatin_ has joined #tripleo03:26
*** fragatina has quit IRC03:30
*** links has joined #tripleo03:48
*** psahoo has joined #tripleo03:48
*** ykarel has joined #tripleo03:59
*** rcernin has quit IRC04:04
*** ratailor has joined #tripleo04:05
*** anilvenkata has joined #tripleo04:05
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755604:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]04:10
*** ooolpbot has quit IRC04:10
*** udesale has joined #tripleo04:12
*** jaganathan has joined #tripleo04:12
*** udesale has quit IRC04:13
*** udesale has joined #tripleo04:13
*** rcernin has joined #tripleo04:19
*** pgadiya has joined #tripleo04:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Run containerized mistral-api eventlet"  https://review.openstack.org/55855704:32
*** hanish has joined #tripleo04:33
*** dsariel has quit IRC04:35
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix autorun option in reproducer script  https://review.openstack.org/55825704:46
openstackgerritMerged openstack/tripleo-quickstart master: Test containerized undercloud with TLS  https://review.openstack.org/55727604:46
*** dsariel has joined #tripleo04:48
*** thrash is now known as thrash|g0ne04:55
*** pgadiya has quit IRC05:06
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755605:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]05:10
Tenguhello there05:12
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: chown config to deployment user  https://review.openstack.org/55926505:19
*** jfrancoa has joined #tripleo05:19
*** pgadiya has joined #tripleo05:20
openstackgerritDoug Hellmann proposed openstack/diskimage-builder master: add lower-constraints job  https://review.openstack.org/55541205:23
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP DNR initial sketches for proper resource change support  https://review.openstack.org/55751205:25
*** pgadiya has quit IRC05:27
*** pgadiya has joined #tripleo05:27
*** jchhatbar has joined #tripleo05:30
*** shreshtha has joined #tripleo05:32
openstackgerrityatin proposed openstack/paunch master: Add ulimit option for run action  https://review.openstack.org/55926705:33
*** moshele has joined #tripleo05:33
*** janki has quit IRC05:33
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: firewall/masquerading: cleanup nat rules  https://review.openstack.org/55925905:36
*** yprokule has joined #tripleo05:36
EmilienMjfrancoa: hey, you around?05:36
jfrancoaEmilienM: hey!05:37
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797205:37
EmilienMjfrancoa: hey I have a question05:37
EmilienMor rather need some help05:37
jfrancoaEmilienM: sure, shoot05:37
EmilienMon https://review.openstack.org/#/c/553633/ I'm adding a Depends-On a patch in THT05:37
EmilienM(and more)05:37
*** psahoo has quit IRC05:37
EmilienMbut when I upgrade, the patch in THT isn't applied05:38
*** psahoo has joined #tripleo05:38
EmilienMI wonder if it's because of the semver issue and because we haven't pushed any tag in rocky yet05:38
EmilienM(I think I just realize that)05:38
EmilienMI'm going to try to remove the rpm, as a workaround05:38
jfrancoaEmilienM: let me have a look at the patch one min05:38
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: WIP - containerized undercloud upgrade  https://review.openstack.org/55362905:39
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: WIP - Introduce tripleo-ci-centos-7-containerized-undercloud-upgrades  https://review.openstack.org/55363305:39
jfrancoaEmilienM: by the way, I was thinking (in my insomnia time), for the undercloud upgrades, I changed the way we handle the releases, I mean...05:39
EmilienMjfrancoa: logs can be seen here: http://logs.openstack.org/33/553633/20/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/8eb16ff/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz05:40
openstackgerrityatin proposed openstack/tripleo-heat-templates master: Set ulimit for neutron agent containers  https://review.openstack.org/55926805:40
jfrancoaEmilienM: up to know, if we were in pike, we were deploy pike overcloud and upgrading it to queens, but I changed it for undercloud upgrades that if the release is queens, we upgrade it to master...I guess that doesn't make much sense, does it?05:40
jfrancoaEmilienM: instead of going backwards, we'd move forward05:41
* jfrancoa checking logs05:41
EmilienMyeah it's good05:41
EmilienMI think THT wasn't upgraded because the semver is the same in Queens in master now05:42
EmilienMwhich is why, I think05:42
EmilienManyway, i'll check tomorrow. Time to disconnect05:42
EmilienMjfrancoa: I'm making good progress on upgrades05:42
*** masco has joined #tripleo05:43
jfrancoaEmilienM: I'll ask today in the Upgrades upstream meeting if we can get some eyes on the base upgrades job, to at least have it merged (so you don't need to keep that crazy chain of dependencies to test your job)05:45
EmilienMjfrancoa: thanks!05:46
*** skramaja has joined #tripleo05:46
*** gkadam_ has joined #tripleo05:48
jfrancoaEmilienM: i'll continue checking the logs and if i find anything I'll add a comment05:48
EmilienMjfrancoa: thanks05:49
jfrancoaEmilienM: good night over there05:49
EmilienMhave a great morning :)05:49
*** anilvenkata has quit IRC05:52
chem|eodso many greetings ...05:56
*** chem|eod is now known as chem05:57
*** numans_ is now known as numans05:57
chemjfrancoa: EmilienM well if depends-on is broken by design it not good :)05:57
chemjfrancoa: a bit early for me but if I'm lucky I hope I can review today05:58
jfrancoachem: morning! I think the issue was other, maybe you can confirm it: https://review.openstack.org/#/c/559210/05:59
chemjfrancoa: gmv ;)05:59
chemlooking05:59
chemjfrancoa: which log is relevant ?06:00
jfrancoachem: http://logs.openstack.org/33/553633/20/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/8eb16ff/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz06:00
jfrancoachem: it can't find the env file, which is searching under environments/undercloud-upgrade.yaml. At the end of the log06:01
chemjfrancoa: that tripleoclient-9aO1jj/templates/environments/undercloud-upgrade.yaml06:01
*** aufi has joined #tripleo06:01
jfrancoachem: my guess is that the tht patch should be adding the env file under environments/ instead of under environments/services/06:02
jfrancoaok, I just saw the comment from EmilienM, so it isn't the problem. it seems to be with depends-on06:03
EmilienMno it's not the depends-on06:03
EmilienMDepends-On works fine06:03
EmilienMit's the fact we don't have a new semver in Rocky, like I said06:03
EmilienMyum believes there is nothing to update06:03
EmilienMbecause the semver is the same as queens06:04
EmilienMit'll be solved when openstack rocky-m1 will be out06:04
EmilienMso I worked around by removing the rpm and re-installing06:04
EmilienM(see my last patchset) https://review.openstack.org/55362906:04
jfrancoaEmilienM: ok, right, that makes total sense06:04
EmilienMin other words, we can't test package upgrades before m106:04
EmilienM(so just undercloud)06:04
jfrancoaEmilienM: I was missing a further context, sorry for the noise in the patch06:05
*** jaosorior has joined #tripleo06:05
EmilienMno worries :)06:05
* EmilienM disappears06:05
*** anilvenkata has joined #tripleo06:05
* jfrancoa needs coffee06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755606:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]06:10
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Include local CA installation outside of HAProxy cert setup  https://review.openstack.org/55927406:21
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Add option to run performance tasks with security disabled  https://review.openstack.org/55841206:23
*** dparkes has joined #tripleo06:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842406:25
*** holser__ has joined #tripleo06:28
*** dparkes has quit IRC06:28
*** dparkes has joined #tripleo06:29
*** jistr has quit IRC06:30
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add ability to set protocol in endpoint_data.yaml file  https://review.openstack.org/55842306:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Default NodeTLSData to always attempt setting TLS cert  https://review.openstack.org/55681706:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842406:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove empty default for SSLKey  https://review.openstack.org/55927906:32
*** jistr has joined #tripleo06:32
*** suuuper has joined #tripleo06:33
*** dparkes has quit IRC06:37
*** dmacpher has quit IRC06:38
*** gkadam_ has quit IRC06:42
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144106:42
*** gkadam has joined #tripleo06:42
*** ccamacho has quit IRC06:43
*** pcaruana has joined #tripleo06:47
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Rename test_regex to test_white_regex  https://review.openstack.org/55928106:49
*** lbrune has joined #tripleo06:49
*** ccamacho has joined #tripleo06:53
*** florianf has joined #tripleo06:56
*** ramishra has quit IRC06:59
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208407:00
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: Add roles-data into overcloud upgrade prepare.  https://review.openstack.org/55538907:00
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch.  https://review.openstack.org/55208007:00
*** bogdando has joined #tripleo07:04
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755607:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]07:10
*** holser__ has quit IRC07:11
*** matbu_ is now known as matbu07:12
*** gfidente has joined #tripleo07:15
*** gfidente has quit IRC07:15
*** gfidente has joined #tripleo07:15
*** hanish has quit IRC07:17
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/55928607:19
*** tesseract has joined #tripleo07:20
*** holser__ has joined #tripleo07:25
*** paramite has joined #tripleo07:26
*** DekayEU has joined #tripleo07:32
*** tosky has joined #tripleo07:34
*** threestrands has quit IRC07:36
*** rcernin has quit IRC07:37
*** ramishra has joined #tripleo07:41
openstackgerritSergii Golovatiuk proposed openstack/instack-undercloud master: Replace LOG.warn with LOG.warning  https://review.openstack.org/55881507:41
*** amoralej|off is now known as amoralej07:45
*** fzdarsky_ is now known as fzdarsky07:46
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Default environment/services/* to docker  https://review.openstack.org/55679907:48
*** moshele has quit IRC07:48
openstackgerritMerged openstack/diskimage-builder master: add lower-constraints job  https://review.openstack.org/55541207:49
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Delete not-used services-docker files  https://review.openstack.org/55679407:51
bogdandoPTAL folks the final step https://review.openstack.org/#/c/556794/ for the containers-default07:52
jaosoriorbogdando: why delete those files?07:54
jaosoriorbogdando: while they're not used, it's how folks enable services.07:54
*** jpena|off is now known as jpena07:54
jaosorioruhm...07:55
bogdandojaosorior: that was the plan, to not allow desync of contents. All of those now reside in the services, instead of services-docker07:55
jaosoriorright07:55
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260707:55
bogdandowe had to copy them, before deleting07:55
*** jpich has joined #tripleo07:55
jaosorioryeah07:55
jaosoriorI noticed that part merged now07:55
bogdandoor I can not land the dependency changes otherwise07:55
bogdandoya07:55
jaosoriormy only concern is that folks will mess it up by still trying to use services-docker to enable a service07:55
*** ratailor_ has joined #tripleo07:55
bogdandoso better we delete, less problems to sync ongoing changes07:55
bogdandoso the faster07:56
bogdandolike https://review.openstack.org/#/c/556794/3/environments/services/neutron-l2gw-opendaylight.yaml07:56
bogdandohm, I think we cannot delete w/o https://review.openstack.org/#/q/topic:containers-default+(status:open+OR+status:merged) remainings07:57
bogdandoyeah, I'll update dependencies07:57
*** ratailor has quit IRC07:58
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Delete not-used services-docker files  https://review.openstack.org/55679407:59
*** pblaho has joined #tripleo07:59
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Delete not-used services-docker files  https://review.openstack.org/55679408:01
*** pblaho has quit IRC08:01
*** pblaho has joined #tripleo08:01
*** ratailor__ has joined #tripleo08:07
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Delete not-used services-docker files  https://review.openstack.org/55679408:08
*** ratailor_ has quit IRC08:09
*** lbrune has quit IRC08:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755608:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]08:10
bogdandolooking onto dependencies and changes coming in services-docker, that won't be easy...08:10
*** DekayEU has quit IRC08:12
*** arxcruz|off is now known as arxcruz|ruck08:13
*** lucas-afk is now known as lucasagomes08:13
jaosoriorbogdando: seems that the containers-multinode job is using a containerized undercloud. Where is that defined?08:13
bogdandofs010, jaosorior08:13
bogdandohttps://review.openstack.org/#/c/542906 was the change08:14
jaosoriorok08:15
*** Dekay has joined #tripleo08:15
*** derekh has joined #tripleo08:15
jaosoriorbogdando: thanks08:15
*** shardy has joined #tripleo08:16
*** lbrune has joined #tripleo08:26
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/55928608:32
*** karts has joined #tripleo08:36
*** karthiks has quit IRC08:37
*** kopecmartin has joined #tripleo08:47
*** akrivoka has joined #tripleo08:52
*** gkadam has quit IRC08:52
*** gkadam has joined #tripleo08:53
*** safchain has left #tripleo09:02
bogdandofolks, my undercloud all-in-one PoC stuck with a very odd thing "HEAT-E99001 Service mistral is not available for resource type OS::Mistral::Workflow" ... Any ideas why it could be so?09:02
bogdandoI'm trying to deploy with this t-h-t env https://github.com/bogdando/oooq-warp/blob/384c74a806c671ea090d95cf90fada06d27d2133/tht/environments/all-in-one-local.yaml09:03
*** ratailor_ has joined #tripleo09:03
bogdandoand the undercloud-deploy.sh is https://pastebin.com/MCXapgsF09:03
*** ratailor__ has quit IRC09:05
bogdandoshardy: perchance please?..09:05
bogdandowhy it wants mistral? I'm about to deploy it from a scratch, no underclouds available09:06
bogdandoshall I set OS::Mistral::Workflow : None to resource registry or something?..09:07
shardybogdando: I think it's because you're enabling octavia, which uses mistral to drive some post-deploy ansible things09:07
bogdandooooh09:07
shardythat isn't part of a normal undercloud install09:07
bogdandoso all-in-one is not very possible :(09:07
bogdandosigh09:07
shardybogdando: this is why we're moving to config download by default09:07
bogdando:)09:08
shardythen t-h-t won't use mistral anymore09:08
shardybut right now it still does in a few places09:08
shardymostly Ceph and Octavia IIRC09:08
bogdandook, I think I missed that bit in my setup, I should be using config download09:08
shardybogdando: yeah I think all-in-one should only use config download09:08
shardybogdando: but that's not enough to fix this09:08
bogdandoright, I hoped it does, I missed some configs...09:08
shardybogdando: octavia and ceph need to convert to external_deploy_tasks, vs service_workflow_tasks09:09
*** dsariel has quit IRC09:09
shardybogdando: so for now the only solution is not to use those services09:09
bogdandothat's really bad, I wanted to give it a try to simplify shift-on-stack folks life09:09
shardyor we need to do the work to convert them (ceph is already in progress ref gfidente patch, not sure about octavia)09:09
bogdandoyou know, setup all in one with kuryr and octavia09:09
shardybogdando: well it's a known, and solvable issue09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755609:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]09:10
shardybogdando: https://review.openstack.org/#/c/546966/ is the ceph patch09:10
shardyI've not seen one for octavia but maybe it is in progress already09:11
shardyI'd chat with beagles about it when he's around09:11
bogdandobeagles: hi ^^ perchance?09:11
*** salmankhan has joined #tripleo09:11
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144109:11
bogdandoshardy: thanks a lot! that was really helpful09:11
chandankumararxcruz|ruck: sshnaidm|off ^^ above adds default skip list for undercloud09:11
Tengu\o/ my BM -> Container migration inside Pike deploy seems to be WORKING! second step running: the compute + ceph migration \o/09:11
bogdandoshardy: hm, I wonder, if I deployed all in one before octavia, then I'll have a "self-hosted" mistral, and then re-deploy with octavia added? would that work? :)09:12
* Tengu sees some light, meaning it might be the end of the tunnel.09:12
* Tengu just hopes this isn't a train09:12
shardybogdando: the work for octavia is https://review.openstack.org/#/c/508195/ and https://review.openstack.org/#/c/515402/ need to be refactored like that ceph patch09:13
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on fs027 using containerized tempest  https://review.openstack.org/55144209:14
bogdandoshardy: thanks! I'll try with a self-hosted mistral as well :)09:14
bogdandolike this https://en.wikipedia.org/wiki/M%C3%BCnchhausen_trilemma#/media/File:Muenchhausen_Herrfurth_7_500x789.jpg09:14
shardybogdando: personally I'd just do the work to convert to external_deploy_tasks09:14
DekayAnyone have time for some template questions. I'm trying to deploy the OC with multiple nics (2 nics) with VLANs.09:14
shardyas the self-hosted-mistral thing isn't something we want so support, so maybe not worth spending time on?09:14
DekayMissed a "?" there09:14
*** karts has quit IRC09:15
*** jchhatbar has quit IRC09:15
*** janki has joined #tripleo09:15
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Run tempest on undercloud on fs003  https://review.openstack.org/55452209:16
shardyDekay: Hi, if you ask your questions we'll try to help :)09:16
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Rename test_regex to test_white_regex  https://review.openstack.org/55928109:17
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144109:18
*** ssbarnea_ has joined #tripleo09:18
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add deployment status tracking infrastructure  https://review.openstack.org/55902109:19
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] Run config-download deployment from UI  https://review.openstack.org/55902209:19
*** fragatin_ has quit IRC09:20
*** Sandy619 has joined #tripleo09:20
*** jchhatbar has joined #tripleo09:20
*** fragatina has joined #tripleo09:20
jtomasekd0ugal: hi, can we discuss the standard message format please? https://review.openstack.org/#/c/425060/26/workbooks/messaging.yaml09:22
d0ugaljtomasek: we can!09:22
Dekayshardy, thank you. I'm trying to deploy a a stack with 1 compute and 1 controller with 2 nics each. nic1 should be provision network and nic2 the rest on tagged VLANs. My network-environment.yaml looks like this: https://pastebin.com/d0AvHY7J09:22
d0ugaljtomasek: unless you are just going to tell me that it is broken, I am working on a fix now :)09:23
*** janki has quit IRC09:23
jtomasekd0ugal: I believe that status, execution_id and message should be in payload09:23
d0ugaljtomasek: are they not?09:23
bogdandoshardy: right. Sadly, that never become a thing for Queens09:23
bogdandocan't be backported09:23
bogdando:(09:23
DekayAnd I've created a nic-config called all-vlans.yaml that looks like: https://pastebin.com/3NUWJsr109:24
DekayBut is there more to it? I'm kinda new to tripleo09:24
jtomasekd0ugal: so it conforms to the convention of body: { type, payload } which we aggreed on as a general convention for zaqar messages which also heat uses09:24
Dekayshardy, I deploy with -e with both templates09:24
bogdandowhile self-hosted undercloud upgrading itself technically may be supported IMO, shardy09:25
bogdandolike scale out, but with new roles09:25
shardybogdando: Personally I don't think the all-in-one case should rely on mistral at all, we should do a one-time translation from t-h-t to ansible and drive the entire workflow via ansible09:26
d0ugaljtomasek: I think that is the opposite of what we discussed before :)09:26
jtomasekd0ugal: the way the data are passed to the messaging workflow is fine, the messaging workflow should consume the input and send the zaqar message in format: body: {type, payload: { status, execution_id, message, <other arbitraty data keys> }09:26
shardybogdando: and the undercloud doesn't support scale out or multiple nodes for rolling updates etc09:26
*** anilvenkata has quit IRC09:27
d0ugaljtomasek: that is what we do now, but we talked with thrash|g0ne about it because we didn't like it :)09:27
d0ugaljtomasek: for example: https://github.com/openstack/tripleo-common/blob/master/workbooks/deployment.yaml#L249-L25609:27
shardyDekay: you need the -e option to point to an environment file, which maps e.g OS::TripleO::Controller::Net::SoftwareConfig: your_template.yaml09:27
shardyhttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html#create-network-environment-file09:28
bogdandoshardy: for Rocky and late, I'm fully agree it should not rely on mistral. I'm talking of the released Queens :)09:28
d0ugaljtomasek: https://etherpad.openstack.org/p/zaqar_message09:28
bogdandotechnically, all-in-one is there, and doable09:28
bogdandothough, not fully :(09:28
d0ugaljtomasek: the popular choice seemed to be the "alternative" at the bottom09:28
shardybogdando: sure, I think for queens we just say Octavia and Ceph are not supported for the single node case09:28
bogdandoright. I wish it would though, using self-hosted magic09:29
*** zoli is now known as zoli|lunch09:29
openstackgerrithanish proposed openstack/tripleo-heat-templates master: Added network enabled check in multiple nic role rendering file  https://review.openstack.org/55930109:30
shardybogdando: I don't get the point of special-casing a solution for a release that's already shipped, we should focus on making the all-in-one case work really well for Rocky IMO09:30
shardyanything else is going to be wasted effort?09:30
bogdandoat least as experimental mode, which prolly can be added post-release , just in docs?..09:30
bogdandoupstream only09:30
bogdandonever mind, it seems useless to pursue09:30
jtomasekd0ugal: problem is that the alternative does not conform to the general zaqar message convention though :/ with the current approach when client receives a message, it knows that payload is where all specific data are09:30
shardybogdando: Sure, I get that it's interesting, I'm just trying to focus on making progress towards the final (supportable) implementation09:31
Dekayshardy, But isn't that what I'm doing in https://pastebin.com/d0AvHY7J ?09:31
jtomasekd0ugal: with the alternative, the client has to implement a mechanism to check for keys based on where the message arrives from (Heat/TripleO...)09:31
d0ugaljtomasek: right, that is why the workflow duplicates the status, message and execution in the payload09:31
d0ugaljtomasek: see lines 78 - 83 https://review.openstack.org/#/c/425060/27/workbooks/messaging.yaml09:31
d0ugaljtomasek: that should make it backwards compatible until we move over?09:31
shardyDekay: No, if you compare your paste with the docs you're not mapping any templates09:32
shardyDekay: it's help if you could paste your entire deploy command and the whole environment for each -e file09:32
*** karts has joined #tripleo09:32
d0ugaljtomasek: is there something describing the general zaqar message convention?09:32
d0ugaljtomasek: this is a new thing to me.09:32
shardye.g in that last paste I don't see any parameter_defaults or resource_registry keys, so it's not clear if it's a full environment file or not09:33
d0ugaljtomasek: I didn't know Heat used the same format - did they just copy tripleo-common?09:33
shardyd0ugal: at one point therve was trying to get a cross-project spec around the zaqar message format agreed IIRC09:34
shardyI don't think it landed though09:34
d0ugalah, that would be a good idea :)09:34
d0ugalfwiw, I don't really mind what we used. I just thought I was moving towards what jtomasek wanted :)09:34
jtomasekd0ugal: I think it came up from this discussion: http://lists.openstack.org/pipermail/openstack-dev/2016-May/095575.html but it is not probably docummented anywhere. At that time we were trying to ensure that format of zaqar messages coming from heat are the same structure as ones from tripleo09:34
shardyd0ugal: yeah I think we're close, but perhaps we can tweak the format to align with the existing heat/tripleo message format09:35
d0ugalI thought the whole point was that people wanted to change it.09:35
*** owalsh_ is now known as owalsh09:35
d0ugalI am happy to stick with what we have, that would have made my life much easier.09:35
jtomasekd0ugal: the common send_message workflow actually makes it work pretty well, because we can (and are) tweaking the input to fit tripleo needs so it is not too verbose, the workflow itself then can nicely transition the input into a standard message09:36
d0ugaljtomasek: yup, makes sense09:36
Dekayshardy, In the example https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html#deploying-the-overcloud-with-network-isolation the template referred to does not exist so I've used /usr/share/openstack-tripleo-heat-templates/ci/environments/network/multiple-nics/network-environment.yaml as inspiration and deploy with openstack overcloud deploy --templates -e /home/stack/network-environment.yml09:36
d0ugaljtomasek: I can remove some weirdness in the workflow that handles both the old and the new format now.09:36
d0ugalI'll include that in the update I am doing.09:37
jtomasek(by moving the tripleo specific data (execution_id, status and message) into payload09:37
jtomasekd0ugal: nice, thanks!09:37
Dekayshardy, will have a look at the docs again since I've misunderstood the way templates work09:37
d0ugaljtomasek: https://review.openstack.org/#/c/425060/27/workbooks/messaging.yaml09:38
d0ugaljtomasek: added a comment at the top just to clarify09:38
jtomasekd0ugal: yes, perfect09:38
d0ugaljtomasek: btw, what does Heat use for "type"?09:38
d0ugalresource name or something?09:39
jtomasekd0ugal: not sure, I haven't seen heat message so far. shardy or mandre maybe?09:39
d0ugaloh, it doesn't really matter - I was just curious09:39
*** StevenK has quit IRC09:39
*** jillr has quit IRC09:40
*** anilvenkata has joined #tripleo09:41
shardyDekay: ack, using and modifying that file is fine, but from your pastes I don't see the resource_registry mapping09:41
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/network/multiple-nics/network-environment.yaml#L2..L709:41
*** jillr has joined #tripleo09:42
shardyDekay: as I said we probably need to see a complete view of your configuration to help further09:42
*** StevenK has joined #tripleo09:42
jtomasekshardy: I have a question about the plan_status, currently the patch makes each interested workflow to set plan_status string explicitly. What if we simplified plan_status to just a boolean flag and wrote the message to swift object if it is true? Then we could create a separate action to determine status from type/status combination. I am currently doing this in GUI code: https://review.openstack.org/#/c/559021/5/src/js/selectors/deployment.js09:42
*** salmankhan has quit IRC09:43
jtomasekshardy: the benefit of that approach would be that the swift object would just hold a message without any additional data and a single action would know how to determine the status, rather than keeping status changes across multiple workflows09:43
Dekayshardy, I hear you and starting to grasp the SoftwareConfig part. Will update my configuration. It's all wrong now :)09:44
Dekayshardy, thank you for the pointer09:44
*** salmankhan has joined #tripleo09:45
*** panda|off is now known as panda09:45
d0ugaljtomasek: we previously passed the full execution in the message - is it save to change that to the ID only?09:47
openstackgerritMartin Mágr proposed openstack/tripleo-common master: Activate another set of healthchecks  https://review.openstack.org/55050809:47
d0ugaljtomasek: (no, it isn't: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/workflows/base.py#L66 )09:49
jtomasekd0ugal: we have made a step towards it with UI, but in some parts, we still use execution from the message. for example we check the input etc. We would need to make sure, that these required data are in message payload09:53
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Add option to run performance tasks with security disabled  https://review.openstack.org/55841209:53
d0ugaljtomasek: ack, I guess I could provide both for now and aim to remove it later09:53
jtomasekd0ugal: yes, I totally agree with deprecating it. Once you're finished with transitioning the workflows, We could test removing using execution in GUI to see how much effort that would be. I think it should be quite straightforward09:55
jtomasekd0ugal: We could do some test with some workflows soon09:55
d0ugalsounds good.09:55
shardyjtomasek: I'm OK with doing that, but the reason I added plan_status was to enable a single file to give definitive plan status regardless of what workflow set it09:57
shardyjtomasek: your approach seems fine, but instead of updating each plan-altering workflow to add plan_status, we'd have to maintain a mapping of workflows to the plan status09:58
shardythere are pros/cons to each approach I guess, either is fine with me09:58
*** dtantsur|afk is now known as dtantsur09:59
jtomasekshardy: ok, let's keep it as is for now09:59
shardyif you prefer we can add an action with same/similar logic to your patch, I'm fine with that but bit busy with other stuff today09:59
shardyd0ugal: any thoughts on ^^09:59
* d0ugal reads up10:00
jtomasekshardy: I'll be working on plan_status state transitions today, so I should have better idea when that's done10:01
*** sri_ has quit IRC10:02
d0ugalshardy, jtomasek - I don't think I really understand plan_status yet :) so my thoughts are confused.10:03
d0ugalThe goal of plan status is that if the GUI is refreshed it knows the latest state? What sort of information is needed?10:04
openstackgerritLukas Bezdicka proposed openstack/tripleo-quickstart-extras master: Introduce undercloud_templates_* variables  https://review.openstack.org/53251610:05
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755610:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]10:10
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Fix Switch VLANs validation  https://review.openstack.org/55930410:10
shardyd0ugal: many of the workflows change the state of the plan, which is independent of the individual execution status, e.g deploy plan changes a "ready" plan to "deployed" etc10:10
shardyd0ugal: the UI currently has some code implementing that state machine, but I was attempting to encode it in each state-altering workflow instead10:11
shardyso you can just get one file and know both the plan status, and the associated status of the most recent plan-state-altering workflow10:11
shardyd0ugal: the CLI currently has no notion of this state machine, but it'd be nice if e.g openstack overcloud plan list could show this same info, e.g which plans are deployed vs just loaded into swift etc10:12
shardycurrently that's a UI only concept10:12
d0ugalshardy: right, that makes sense10:13
d0ugalshardy: it feels like a slightly off side effect of a message sending workflow tbh10:14
shardyd0ugal: the question is which approach is best, mine which makes each plan-state-altering workflow explicitly set a "plan_status", or a state machine e.g in a special action which figures it out by looking at which workflow ran last, and the outcome of it10:14
d0ugalbut I can see it is a convenient place to do it10:14
shardyd0ugal: yeah I guess, it was a convenient place to patch it in, but if you prefer we can copy/paste the state machine from the js code and have a "get plan status" action10:15
d0ugalIn a workflow it might be nicer to read if there was an action like "tripleo.transition_to plan=overcloud state=deployed" (or similar)10:15
shardythat's fine with me, but the disadvantage is every new workflow that changes the plan state needs to be added10:15
d0ugalyeah10:15
shardyI guess that's relatively static at this point though10:15
shardyI was thinking more that workflow authors could just annotate their workflows by declaring the plan_status where needed10:15
shardybut I'm fine with either approach10:16
d0ugalwe should probably go for the quicker/easier approach for now :)10:16
d0ugalHow the state is managed should be fully internal anyway10:16
d0ugalso the question is - should the state be in a swift object or be accessed via a mistral action?10:17
shardyd0ugal: yeah, I went with the former, I think jtomasek was advocating for the latter10:19
shardyI was thinking it was cheaper to get one object, vs call a workflow/action which then gets potentially multiple objects and applies some logic10:19
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Replace LOG.warn with LOG.warning  https://review.openstack.org/55880410:20
shardythe trade off is all the state altering workflows need to be updated10:20
shardyvs having a big case statement like in that js10:20
d0ugalA workflow would give us more flexability, making it easier to change how and what is stored.10:21
shardyd0ugal: Ok, provided it's still fast enough I guess that's fine10:21
shardyI was a bit wary as some of the workflows already cause noticable delays to the UI10:21
shardyI know that's not the fault of mistral, but I was looking to remove as many layers as possible when I changed your patch :)10:22
d0ugalAgreed.10:22
d0ugalI would be fine with just storing in swift too10:22
d0ugalI guess we can experiment and see if it will be a problem10:22
shardy++ sounds good10:23
*** cshastri has quit IRC10:27
*** jistr has quit IRC10:27
*** adarazs is now known as adarazs_lunch10:32
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Fix Switch VLANs validation  https://review.openstack.org/55930410:32
*** jistr has joined #tripleo10:36
*** tesseract has quit IRC10:37
*** tesseract has joined #tripleo10:38
*** dbecker has joined #tripleo10:39
*** dbecker has quit IRC10:39
*** gkadam has quit IRC10:47
*** anilvenkata has quit IRC10:49
*** abishop has joined #tripleo10:53
*** tesseract-RH has joined #tripleo10:59
*** tesseract has quit IRC10:59
*** yprokule has quit IRC10:59
*** zoli|lunch is now known as zoli11:01
*** abishop has quit IRC11:02
*** salmankhan1 has joined #tripleo11:02
Tengu\o/ lab-compute-0 being upgraded. Upgrade second step is running, just a tiny network glitch, but… at least… apparently, it seems to work.11:03
*** salmankhan has quit IRC11:04
*** salmankhan1 is now known as salmankhan11:04
Tenguand it's a first success. lab-compute-2 running.11:08
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755611:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]11:10
*** cshastri has joined #tripleo11:13
openstackgerritJiri Stransky proposed openstack/python-tripleoclient stable/queens: Generate inventory with tripleo-admin user  https://review.openstack.org/55931011:16
openstackgerritJiri Stransky proposed openstack/python-tripleoclient stable/queens: Allow providing --ssh-user for update/upgrade run commands  https://review.openstack.org/55931111:17
openstackgerritJiri Stransky proposed openstack/tripleo-upgrade stable/queens: Support --ssh-user argument to upgrade/update run command  https://review.openstack.org/55931211:18
*** dprince has joined #tripleo11:19
*** waleedm has joined #tripleo11:20
*** pkovar has joined #tripleo11:20
openstackgerritDmitry Tantsur proposed openstack/tripleo-common stable/queens: Fix error handling in set_provision_state/set_power_state workflows  https://review.openstack.org/55931411:24
*** ledo_ has joined #tripleo11:25
*** Sandy619 has quit IRC11:26
*** waleedm has quit IRC11:28
*** lucasagomes is now known as lucas-hungry11:28
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Update environment files for Q upgrade and ffwd upgrade  https://review.openstack.org/55906111:30
*** leanderthal has joined #tripleo11:38
*** jpena is now known as jpena|lunch11:38
*** karts is now known as karthiks11:45
jtomasekshardy, d0ugal: thing is that even if we have separate action to get plan status, the workflows which alter it via message still need to send plan_state boolean flag, which is very close to adding actual plan state to it (which is what shardy did now) so I think current approach is ok11:45
jtomasekIf I hit some problems with it I'll let you know11:45
d0ugaljtomasek: thanks11:46
shardyjtomasek: ack thanks for confirming, we can adjust if if needed11:48
*** shreshtha has quit IRC11:48
*** ledo__ has joined #tripleo11:49
openstackgerritMerged openstack/python-tripleoclient master: Add tripleo-ui docker service to undercloud config  https://review.openstack.org/52284211:51
*** ledo_ has quit IRC11:52
*** abishop has joined #tripleo11:52
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Disable FluentClient service for ffwd/upgrades.  https://review.openstack.org/55931711:55
*** athomas has joined #tripleo11:58
jistrjfrancoa: i think the difference between the dev envs and the job is probably that by default, dev envs will already have FluentdClient mapped to OS::Heat::None. So there's no need for the workaround in the first place.12:00
jistrhowever CI has this in Pike12:00
jistrhttps://github.com/openstack/tripleo-heat-templates/blob/stable/pike/ci/environments/scenario001-multinode-containers.yaml#L2912:00
jistrso it needs the workaround, but apparently it doesn't work. We must be trying to process the templates (download referenced files from swift) before applying the env files from command line or something like that.12:01
jfrancoajistr: I'm reproducing it in rdo cloud, if you have some time and want to help me debugging it, I'd appreciate12:01
jistrso it's likely that yprokule + mcornea were right that we have an actual issue12:01
jistrcc chem ^^12:01
*** bfournie has joined #tripleo12:01
*** lblanchard has joined #tripleo12:02
*** jistr is now known as jistr|mtg12:02
*** ssbarnea_ has quit IRC12:03
*** ratailor_ has quit IRC12:04
*** ssbarnea_ has joined #tripleo12:05
*** udesale has quit IRC12:05
*** liverpooler has joined #tripleo12:05
*** thrash|g0ne is now known as thrash12:07
*** raildo has joined #tripleo12:08
*** rfolco|off is now known as rfolco|rover12:09
openstackgerritJames Slagle proposed openstack/tripleo-quickstart master: Convert remaining multinode jobs to config-download  https://review.openstack.org/55896512:09
openstackgerritJames Slagle proposed openstack/tripleo-quickstart master: Convert remaining ovb jobs to config-download  https://review.openstack.org/55906712:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755612:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]12:10
*** adarazs_lunch is now known as adarazs12:10
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Added Liquidio service definition in overcloud puppet registry  https://review.openstack.org/55905612:14
openstackgerritMerged openstack/tripleo-quickstart master: Change container registry file to the default paremters  https://review.openstack.org/55876012:14
openstackgerritMerged openstack-infra/tripleo-ci master: Default to docker.io instead of trunk.registry.rdoproject.org  https://review.openstack.org/54587312:14
*** karthiks has quit IRC12:15
*** mburned_out is now known as mburned12:19
*** colonwq has quit IRC12:20
*** ssbarnea_ has quit IRC12:22
*** psahoo has quit IRC12:23
*** cshastri has quit IRC12:26
slagleanyone know how to trigger tripleo-ovb-experimental jobs?12:29
*** mburned is now known as mburned_out12:30
*** lucas-hungry is now known as lucasagomes12:30
*** ramishra has quit IRC12:30
*** dougbtv has joined #tripleo12:31
*** panda is now known as panda|lunch12:31
*** fpan has joined #tripleo12:31
*** karthiks has joined #tripleo12:31
*** jistr|mtg is now known as jistr12:31
*** chlong has joined #tripleo12:32
slaglecheck rdo experimental12:33
slagleif anyone else was wondering12:33
*** jcoufal has joined #tripleo12:34
*** noslzzp has joined #tripleo12:35
*** bfournie has quit IRC12:35
*** ledo__ has quit IRC12:35
*** ledo__ has joined #tripleo12:36
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add prepare/converge env files for update  https://review.openstack.org/55931912:37
*** ledo_ has joined #tripleo12:40
*** jpena|lunch is now known as jpena12:41
skramajaEmilienM: could you take a look at https://review.openstack.org/#/c/555661/?12:44
*** ledo__ has quit IRC12:44
jaosoriorshardy: hey, do we have the path to the heat templates somewhere in tripleo-common? as part of the swift environment?12:44
jaosoriorshardy: nevermind. I think I have another solution12:47
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Hard link http boot contents for Ironic  https://review.openstack.org/55651612:47
*** trown|outtypewww is now known as trown12:48
*** colonwq has joined #tripleo12:49
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842412:51
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove empty default for SSLKey  https://review.openstack.org/55927912:51
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add endpoint map environment without TLS  https://review.openstack.org/55932212:51
*** rbowen has quit IRC12:52
*** rbowen has joined #tripleo12:52
*** pchavva has joined #tripleo12:53
openstackgerritSergii Golovatiuk proposed openstack/tripleo-common master: Poll heat events and send it to messaging queue  https://review.openstack.org/52956712:53
*** pblaho has quit IRC12:53
shardyjaosorior: Hey no I think all paths are relative to the root of the plan container12:53
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Ensure openvswitch user exist before package update  https://review.openstack.org/55716412:54
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Change ovs user and fix permissions on ovs upgrade  https://review.openstack.org/55847112:54
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Default environment/services/* to docker  https://review.openstack.org/55679912:55
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: TLS by default for the overcloud  https://review.openstack.org/55492612:56
*** artom has quit IRC12:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Use no TLS environment explicitly  https://review.openstack.org/55932312:58
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Use no TLS environment explicitly  https://review.openstack.org/55932312:59
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842413:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove empty default for SSLKey  https://review.openstack.org/55927913:00
*** jaganathan has quit IRC13:01
DekayIs ManagementNetworkVlanID and ManagementIpSubnet new stuff or deprecated?13:04
openstackgerrityolanda.robla proposed openstack/tripleo-heat-templates stable/newton: Ensure openvswitch user exist before package update  https://review.openstack.org/55716413:05
*** masco has quit IRC13:08
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755613:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]13:10
*** derekh has quit IRC13:10
*** Goneri has joined #tripleo13:11
*** skramaja has quit IRC13:12
*** derekh has joined #tripleo13:13
*** lvdombrkr has joined #tripleo13:16
*** fragatina has quit IRC13:18
*** yproklue has joined #tripleo13:19
*** pgadiya has quit IRC13:20
*** fragatina has joined #tripleo13:20
*** mcornea has joined #tripleo13:20
*** pradk has joined #tripleo13:22
*** yproklue has left #tripleo13:22
*** yproklue has joined #tripleo13:22
*** yproklue has left #tripleo13:23
*** yproklue has joined #tripleo13:23
*** yproklue has left #tripleo13:24
*** yproklue has joined #tripleo13:24
*** yproklue has left #tripleo13:24
*** jmelvin has joined #tripleo13:24
*** yproklue has joined #tripleo13:25
*** yproklue has quit IRC13:25
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: firewall/masquerading: cleanup nat rules  https://review.openstack.org/55925913:25
*** yprokule has joined #tripleo13:27
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Update network_data.yaml file in swift for update/upgrade  https://review.openstack.org/55636413:27
*** tosky__ has joined #tripleo13:28
*** psachin` has quit IRC13:28
*** links has quit IRC13:28
*** tosky is now known as Guest674713:28
*** Guest6747 has quit IRC13:28
*** tosky__ is now known as tosky13:28
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Fix Cinder's default db purge cron settings  https://review.openstack.org/55932913:29
*** gkadam has joined #tripleo13:30
*** colonwq has quit IRC13:31
*** yprokule has quit IRC13:34
*** yprokule has joined #tripleo13:34
*** toure is now known as toure|biab13:36
*** kopecmartin has quit IRC13:38
*** dansmith is now known as superdan13:40
*** morazi has quit IRC13:43
*** panda|lunch is now known as panda13:47
openstackgerritRyan Brady proposed openstack/tripleo-common master: Deprecates tripleo.roles.list action  https://review.openstack.org/54475113:48
*** dmacpher has joined #tripleo13:49
*** ykarel is now known as ykarel|away13:50
*** ykarel|away is now known as ykarel13:50
*** toure|biab is now known as toure13:51
bogdandoPTAL https://review.openstack.org/#/c/559130/213:53
*** pblaho has joined #tripleo13:53
*** ykarel has quit IRC13:56
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Switch Zaqar to use Redis  https://review.openstack.org/55887413:56
*** bnemec has joined #tripleo13:59
*** bnemec is now known as beekneemech13:59
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144114:01
*** melwitt is now known as jgwentworth14:02
arxcruz|ruckchandankumar: ^14:02
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements master: Remove Openstack and Ceph packages  https://review.openstack.org/52117214:03
*** ledo_ has quit IRC14:04
*** zshi has quit IRC14:05
*** artom has joined #tripleo14:05
*** agopi has joined #tripleo14:07
*** artom_ has joined #tripleo14:08
*** lbrune has quit IRC14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755614:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]14:10
*** artom has quit IRC14:10
*** yprokule has left #tripleo14:12
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144114:16
*** zshi has joined #tripleo14:19
mcorneabeagles: hey o/ quick question: which container should run the keepalived processes? neutron_l3_agent ?14:20
*** lvdombrkr has quit IRC14:22
ccamachohey! quick question, anyone with a little bit of swift CLI expertise around??14:23
ccamachoYesterday I was getting some information to push some big files to swift using service.py14:23
ccamachoI managed to do it, but now Ill need to be able to download those files.. this is the result of my last test14:23
ccamachohttps://paste.fedoraproject.org/paste/V0JsXVqkYuj~XQb0HaN3MA14:23
ccamachocan anyone if having some cycles tell me how to download the big file uploaded (6GB) instead of the manifest with all the segments?14:23
ccamachoin the paste there is a better description i.e. from docs (https://docs.openstack.org/swift/latest/overview_large_objects.html)14:23
ccamachoSo now, the following swift command should download the entire large object: `swift download test_container large_file`14:23
ccamachoBut, the CLI is always getting the manifest file, not getting the segments as a single file...14:23
ccamacho(undercloud) [stack@undercloud kk]$ swift download undercloud-backupsasdf asdf.tar.gz14:23
ccamachoasdf.tar.gz [auth 3.399s, headers 3.787s, total 3.788s, 0.003 MB/s]14:23
ccamacho(undercloud) [stack@undercloud kk]$ ls -ltah14:23
ccamachostack stack 1019 Apr  6 13:47 asdf.tar.gz14:23
*** lebauce has quit IRC14:25
pradkcan some one merge this please https://review.openstack.org/#/c/558864/14:26
*** lebauce has joined #tripleo14:26
thrashccamacho: maybe try with the openstack version of the client? I've seen some differences between the two.14:29
openstackgerritAlfredo Moralejo proposed openstack/tripleo-quickstart-extras master: Enable extras repo when updating containers  https://review.openstack.org/55934314:29
*** hamzy has quit IRC14:30
*** udesale has joined #tripleo14:31
ccamachohey thrash that's what I tried in first place but no luck there.. It just download the manifest file (without putting together the segments)14:31
thrashccamacho: odd14:31
*** bfournie has joined #tripleo14:31
ccamachothrash it actually download what is inside the container (the manifest) but no assembly of the segments.. :(14:32
*** yamahata has quit IRC14:34
*** hamzy has joined #tripleo14:36
*** udesale has quit IRC14:38
*** salmankhan has quit IRC14:39
beaglesbogando, sorry were you looking for this https://review.openstack.org/#/c/559267/14:39
beaglesI'd started working on it but yatin scooped me while I was sleeping (stupid hoomans wasting time sleeping)14:40
beaglesoh you were looking for external deploy tasks14:41
*** rpioso|afk is now known as rpioso14:42
*** suuuper has quit IRC14:42
beaglesshardy, bogdando, yeah I haven't had a chance to start working on the external deploy tasks conversion - still focused on release related work14:42
shardybeagles: ack thanks for confirming!14:43
slaglebeagles: for octavia?14:43
beaglesslagle, right14:43
slaglebeagles: jillr has started looking at that fwiw14:43
slaglemay have some initial progress soon14:44
beaglesslagle, okay cool14:44
*** lbrune has joined #tripleo14:45
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Configure segment_size in swift put_object  https://review.openstack.org/55902414:46
*** ykarel has joined #tripleo14:48
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Add roles-data into overcloud upgrade prepare.  https://review.openstack.org/55537014:49
*** waleedm has joined #tripleo14:49
*** gkadam_ has joined #tripleo14:51
openstackgerritChristian Schwede proposed openstack/instack-undercloud master: Enable missing support for large objects in Swift  https://review.openstack.org/55934914:51
*** gkadam has quit IRC14:53
*** fpan has quit IRC14:53
*** fpan has joined #tripleo14:54
*** hanish has joined #tripleo14:55
*** morazi has joined #tripleo14:56
hanishhi all, i am trying queens based tripleo installation. neutron api container fails with config file not found14:59
*** salmankhan has joined #tripleo14:59
*** pblaho has quit IRC15:02
*** gkadam_ has quit IRC15:10
*** agopi is now known as agopi|lunch15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755615:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]15:10
*** artom_ has quit IRC15:12
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797215:15
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Configure segment_size in swift put_object  https://review.openstack.org/55902415:15
*** dprince has quit IRC15:15
openstackgerritCarlos Camacho proposed openstack/instack-undercloud master: Enable missing support for large objects in Swift  https://review.openstack.org/55934915:17
*** yolanda_ is now known as yolanda15:20
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Configure segment_size in swift put_object  https://review.openstack.org/55902415:22
*** waleedm has quit IRC15:22
*** aufi has quit IRC15:30
*** artom has joined #tripleo15:33
*** openstackgerrit has quit IRC15:33
*** jcoufal_ has joined #tripleo15:34
*** jcoufal has quit IRC15:35
*** jcoufal_ has quit IRC15:37
*** leanderthal has quit IRC15:40
beaglesdoes anyone know the reasoning behind kolla containers setting a uid that's different than that which might be on the baremetal?15:41
*** agopi|lunch is now known as agopi15:41
*** dprince has joined #tripleo15:44
*** ykarel_ has joined #tripleo15:45
*** anilvenkata has joined #tripleo15:46
*** ykarel has quit IRC15:46
*** openstackgerrit has joined #tripleo15:46
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Adding featureset048  https://review.openstack.org/55881615:46
*** pcaruana has quit IRC15:49
*** jfrancoa has quit IRC15:50
*** pradk has quit IRC15:51
openstackgerritJulie Pichon proposed openstack/python-tripleoclient master: Remove role commands deprecated in Queens  https://review.openstack.org/55905015:52
*** lbrune has quit IRC15:55
*** morazi has quit IRC15:58
*** artom has quit IRC16:01
openstackgerritMerged openstack/puppet-pacemaker master: Drop ubuntu 14.04 from spec tests  https://review.openstack.org/55875016:01
openstackgerritMerged openstack/tripleo-quickstart-extras master: Overcloud update CI with tripleo-upgrade role  https://review.openstack.org/54220116:02
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Define overcloud_docker_registry_namespace for rdocloud  https://review.openstack.org/55703516:03
*** artom has joined #tripleo16:04
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Default environment/services/* to docker  https://review.openstack.org/55679916:05
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755616:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]16:10
*** zoli is now known as zoli|gone16:12
*** zoli|gone is now known as zoli16:12
*** salmankhan has quit IRC16:12
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates stable/queens: [queens] Put back (now empty) fluentd-client.yaml  https://review.openstack.org/55936516:14
*** dtantsur is now known as dtantsur|pto16:14
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144116:17
openstackgerritMerged openstack/tripleo-common master: Log ansible and ansible-playbook command.  https://review.openstack.org/55732016:19
openstackgerritMerged openstack-infra/tripleo-ci master: Add multinode-overcloud-update playbook to run list  https://review.openstack.org/54705816:19
openstackgerritMerged openstack/tripleo-heat-templates master: mistral: align parameters with undercloud  https://review.openstack.org/55865416:19
openstackgerritMerged openstack/tripleo-heat-templates master: ironic-conductor: configure ipxe_timeout to 60  https://review.openstack.org/55913016:19
*** derekh has quit IRC16:20
*** salmankhan has joined #tripleo16:20
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Allow uploading big files to swift (5GB)  https://review.openstack.org/55902416:23
*** ykarel__ has joined #tripleo16:23
*** chlong has quit IRC16:23
openstackgerrityatin proposed openstack/tripleo-heat-templates master: Set ulimit for neutron agent containers  https://review.openstack.org/55926816:24
*** jpich has quit IRC16:25
*** ykarel_ has quit IRC16:26
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144116:32
arxcruz|ruckchandankumar: Goneri ^16:33
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch.  https://review.openstack.org/55208016:33
arxcruz|ruckI hope now it will work properly16:33
*** trown is now known as trown|lunch16:33
arxcruz|ruckI tried to reduce the if's and else's in the jinja template16:33
chemholser__: jistr ^ see you on Monday :)16:33
holser__you too chem16:33
holser__Have a great weekend16:33
holser__:D16:33
*** etingof has quit IRC16:34
openstackgerritMerged openstack/diskimage-builder master: Formalise saving of /etc/resolv.conf  https://review.openstack.org/55836216:36
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Correct the InternalTLSVncCAFile to comply with selinux policy  https://review.openstack.org/55937116:42
*** ykarel__ has quit IRC16:43
*** lucasagomes is now known as lucas-afk16:44
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Standardise Workflow messaging and optionally persist messages  https://review.openstack.org/42506016:44
*** etingof has joined #tripleo16:48
jistrchem, holser__: thanks, have a good weekend guys16:50
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Adding wrapper scripts for neutron agent subprocesses  https://review.openstack.org/55022416:51
chemjistr: you too16:51
*** anilvenkata has quit IRC16:53
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: WIP: Migrate Octavia to external_deploy_task  https://review.openstack.org/55937416:53
holser__thanks jistr, you too16:53
*** jchhatbar has quit IRC16:54
jillrbeagles: heya, ^ octavia WIP16:55
beaglesjillr, ack thanks!16:55
jillrnp16:55
hanishhi i am trying container based overcloud installation, neutron api server container fails with  Failed to find some config files: /etc/neutron/plugin.ini16:56
hanishdoes it happen to anyone16:56
*** fragatina has quit IRC16:56
*** links has joined #tripleo16:57
beagleshanish: that's odd. Is it that the container isn't running after deployment or are you doing something different for trying to start the container16:58
hanish@beagles container is in restarting state, when i did container logs i got the above error16:59
openstackgerritMerged openstack/tripleo-quickstart-extras master: only build rpm changes for the branch in use  https://review.openstack.org/55914317:00
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Include database in the default event dispatchers  https://review.openstack.org/55886417:00
beagleshanish, does the file exist in /var/lib/config-data/puppet-generated/neutron/etc/neutron on the baremetal?17:00
*** ykarel__ has joined #tripleo17:00
hanish@beagles: no in that location only neutron.conf is available17:01
*** jpena is now known as jpena|off17:01
beagleshmm.. that's weird17:02
hanish@beagles i am trying ovn on baremetal and neutron in container, does that cause any issue17:03
*** links has quit IRC17:06
beagleshanish, not sure17:06
*** links has joined #tripleo17:07
EmilienMbogdando: I was talking to mwhahaha about tripleoclient-gG4kUF directory17:07
EmilienMbogdando: 2 things, we thought17:08
EmilienMbogdando: 1) we should rename tripleoclient-gG4kUF to be templates-gG4kUF17:08
EmilienMbogdando: and put templates files in there directly17:08
*** dsariel has joined #tripleo17:08
EmilienMbogdando: 2) once deployment finish fine, we should rename to templates/17:08
mwhahahawell no17:08
mwhahahai think we should timestamp them17:08
bogdandothe code is not so templates only http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/v1/overcloud_deploy.py#n345 and http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/v1/undercloud_deploy.py#n32017:08
mwhahaharather than using a random string17:09
EmilienMyeah or timestamp17:09
hanishbeagles do you have any idea about the location of the ovn container images17:09
mwhahahaso we can see what ran with what and when17:09
numanshanish, hi17:09
numanshanish, about ovn container images17:09
hanishnumas hi17:09
mwhahahai hate having to sort by time in ls because it's not always accurate17:09
EmilienMyes, same17:10
numanshanish, you want to know what ?17:10
EmilienMbogdando: could we fix that?17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755617:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]17:10
hanishnumans, can you please share the location of the ovn containers17:10
numanshanish, you mean in the docker registry ?17:11
mwhahahaon a different subject, EmilienM do we have an upstream job that builds images for CI? or is it just covered in the rdocloud jobs17:11
hanishnumans, yes17:11
EmilienMmwhahaha: we do, once sec17:11
numanshanish, one sec17:11
EmilienMmwhahaha: we have tripleo-buildimage-overcloud-full-centos-7 and rdo-kolla-build-integration17:12
EmilienMrdo-kolla-build-integration is more to see if we can build containers17:12
bogdandoEmilienM, mwhahaha: yeah, we can do that17:12
EmilienMand tripleo-buildimage-overcloud-full-centos-7 is to build the image17:12
bogdandohave to go now folks. Have a nice weekends!17:12
EmilienMbogdando: i'm filling a bug. would you be up to work on it?17:12
mwhahahaEmilienM: we should run buildimage on t-p-e17:12
EmilienMmwhahaha: ack I'll patch zuul layout17:12
numanshanish, tripleomaster/centos-binary-ovn-northd, tripleomaster/centos-binary-ovn-controller17:13
numanshanish, you are trying with ovn db pacemaker profile right ?17:13
*** holser__ has quit IRC17:13
*** salmankhan has quit IRC17:13
hanishnumans, no, ovn without ha17:13
numanshanish, tripleomaster/centos-binary-ovn-nb-db-server and tripleomaster/centos-binary-ovn-sb-db-server17:14
numanshanish, oh. i wouldn't recommend that though.17:14
openstackgerritEmilien Macchi proposed openstack/tripleo-puppet-elements master: zuul: add tripleo-buildimage-jobs  https://review.openstack.org/55938017:15
EmilienMmwhahaha: ^ done17:15
numanshanish, any issues you are facing ?17:15
*** etingof has quit IRC17:15
mwhahahabeekneemech: do you know what's the backend disk store in rh2 for vms?17:15
EmilienMafik it's local lvm17:15
hanishnumans, i am facing issue with nuetron server container failing to start17:15
numanshanish, most likely it is not able to connect to the ovn db servers.17:16
*** bogdando has quit IRC17:17
numanshanish, i guess you are including this env file -  -e /usr/share/openstack-tripleo-heat-templates/environments/services/neutron-ovn.yaml17:17
hanishnumans, yes17:17
openstackgerritMerged openstack/tripleo-common master: Make two workflows from 'validations' produce output  https://review.openstack.org/55908717:18
numanshanish, can you share your deploy command in paste ?17:18
*** rbowen is now known as DrBacchus17:19
hanishnumans, please find it here http://paste.openstack.org/show/718617/17:20
numanshanish, the reason is you are including ovn's baremetal env file - -e ~/templates/openstack-tripleo-heat-templates/environments/neutron-ml2-ovn.yaml17:21
numanshanish, you should include this one - https://github.com/openstack/tripleo-heat-templates/blob/master/environments/services-docker/neutron-ovn.yaml17:22
hanishnumans, ovn has to be containerized?17:22
numanshanish, if you want neutron-server to be containerized and ovn to be bm, then you need to tweek your env files17:23
numanshanish, any particular reason you don't want to containerize ovn ?17:23
numanshanish, that is what tested in CI now17:23
hanishnumans, i do want to run ovn in containerized env but could not find appropriate document for it,17:24
hanishnumans, one that is available https://docs.openstack.org/networking-ovn/latest/install/tripleo.html is not clear to me as i am not using tripleo quickstart17:25
numanshanish, can you please see this guide here - http://logs.openstack.org/03/555803/7/check/build-openstack-sphinx-docs/188d1b3/html/17:25
EmilienMslagle, mwhahaha : could you please review https://bugs.launchpad.net/tripleo/+bug/1761810 and give feedback in the bug report? thanks17:25
openstackLaunchpad bug 1761810 in tripleo "Templates & config-download directories should be renamed for better visibility" [High,Triaged]17:25
*** dsariel has quit IRC17:25
numanshanish, this should help you - http://logs.openstack.org/03/555803/7/check/build-openstack-sphinx-docs/188d1b3/html/install/tripleo.html17:26
numansprobably we need to have a link in tripleo to point here .17:26
beekneemechmwhahaha: It's all local storage.  I believe some of the nodes are SSD and some are HDD.17:27
*** dhill__ has quit IRC17:27
*** dhill__ has joined #tripleo17:27
mwhahahabeekneemech: hmm ok. basically i'm getting overlayfs errors in rh2 but not rdo cloud. wondering if it's the hypervisor disk setup17:28
numanshanish, plz see this - http://logs.openstack.org/98/556798/2/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/cf9298d/logs/undercloud/home/zuul/containers-default-parameters.yaml.txt.gz and grep for ovn17:29
beekneemechmwhahaha: Weird.  The only other difference I can think of would be that we enable unsafe caching on rh2, but unless your compute node crashes that shouldn't matter.17:29
numanshanish, you need to define these parameters related to ovn. hope this helps you17:29
mwhahahabeekneemech: i think that'd do it17:29
mwhahahabeekneemech: the problem is that we're having files 'dissapear' during an rsync17:29
mwhahahaso perhaps caching is causing it17:29
beekneemechmwhahaha: To the vm it shouldn't make any difference though, unless there's a serious bug in the Linux file caching layer.17:30
hanishnumans, thanks it helps17:30
mwhahahabeekneemech: [57689.493261] overlayfs: upper fs needs to support d_type. This is an invalid configuration.17:30
mwhahahai don't get that on rdo17:31
beekneemechI have no idea what any of that means. :-P17:31
mwhahahawelcome to my world17:31
EmilienMrdocloud4life17:32
mwhahahaif rdocloud was stable, sure17:32
mwhahahabeekneemech: what exactly is the unsafe cache config you're talking about? /me would like to try some reproducing elsewhere17:34
beekneemechmwhahaha: Is it possible this is related to old images in rh2?  I find this: https://www.systutorials.com/linux-kernels/91356/ovl-warn-instead-of-error-if-d_type-is-not-supported-linux-4-6-5/17:34
beekneemechWhich suggests that this requirement might be relatively new.17:34
mwhahahano cause i yum updated on the vm17:34
beekneemechDid you reboot?17:34
mwhahahaso unless it's because of the kernel on the hypervisor17:34
mwhahahayes17:34
mwhahahai always do that first thing17:34
mwhahaha3.10.0-693.21.1.el7.x86_64 is what the latest is and i'm running that17:35
* mwhahaha shrugs17:35
*** tesseract-RH has quit IRC17:35
mwhahahai just don't want a customer to hit this cause you know they will17:36
beekneemechmwhahaha: It seems to be a libvirt setting: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/rh2-env.yaml#n2717:36
mwhahahai think i'm ending in tears per the comment17:36
mwhahahaso yea this is likely something we may need to document around containers with out overlayfs usage17:37
* mwhahaha goes to lunch and will try later17:37
beekneemechmwhahaha: It should only be an issue if the underlying compute node reboots unexpectedly though.17:37
beekneemechWhen they say "unsafe" they don't mean "incorrect".17:37
mwhahahano i know they don't mean incorrect17:38
beekneemechIt's just that if someone trips over the power cord and kills the system, some of your data may have only existed in memory and be lost.17:38
mwhahahabut i think it might be an interaction between the overlayfs and what's being seen17:38
mwhahahabecause i'm getting io errors & files disappearing17:39
beekneemechI will grant that it's entirely possible we found a bug though.17:39
slagleEmilienM: there is https://review.openstack.org/#/c/550577/17:39
mwhahahatoo many layers of abstraction in this one :D17:39
mwhahahahypervisor -> vm -> docker -17:39
mwhahaha> sadness17:40
*** fragatina has joined #tripleo17:40
beekneemechmwhahaha: What exactly is triggering this?  I'm pretty sure I run unsafe caching in my local cloud too and don't have any problems with containerized deployments.17:40
beekneemechAlthough, there again my local cloud is much newer than rh2.17:40
mwhahahabeekneemech: the docker-puppet interaction17:41
mwhahahai'm doing containerized undercloud deploy17:41
mwhahahaand it fails at config generation17:41
*** fragatina has quit IRC17:41
beekneemechAh.17:41
mwhahahawith random (aka useless) errors17:41
* beekneemech runs away17:41
*** fragatina has joined #tripleo17:41
mwhahahain theory we should have seen this on overcloud, but i was able to successfully do this with the overcloud17:41
mwhahahaso who the hell knows17:41
*** fragatina has quit IRC17:41
mwhahahai just know it's 100% consistent on rh2 for me17:41
*** fragatina has joined #tripleo17:42
*** fragatina has quit IRC17:43
*** jcoufal has joined #tripleo17:43
EmilienMslagle, jillr : what would be the default config_dir here?17:43
EmilienMslagle, jillr : mwhahaha's idea was to use timestamps by default17:43
*** fragatina has joined #tripleo17:43
*** fragatina has quit IRC17:43
jillrEmilienM: https://review.openstack.org/#/c/550585/  ~/tripleo-config17:44
*** fragatina has joined #tripleo17:44
slagleEmilienM: the point is to make it predictable17:44
slagleif you wanted to use a timestamp, you could. generate the timestamp, pass it in.17:44
*** trown|lunch is now known as trown17:45
EmilienMslagle: ok, fair enough17:46
EmilienMslagle, jillr : in that case, my only comment is that we don't see the tripleo-config dir in http://logs.openstack.org/77/550577/4/check/tripleo-ci-centos-7-undercloud-containers/ddf0cd3/logs/undercloud/home/zuul/17:46
EmilienMI guess we need to update quickstart17:47
EmilienMI can do it17:47
slagleyou would think!17:47
slaglebut you actually need to update tripleo-ci17:47
EmilienMah yes...17:47
slagleb/c we like maintaining the list of log files in 2 places17:47
slagleit's fun that way17:47
EmilienMwait it's in 2 places?17:47
EmilienMI think only one is used17:47
EmilienM(afik)17:47
slagleyes, it's in quickstart and tripleo-ci.17:48
slaglethe default is overridden. why the default in quickstart isnt just what we need for tripleo-ci, i don't know17:48
jillrwell, TIL17:49
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Add $HOME/tripleo-config dir  https://review.openstack.org/55938717:49
EmilienMslagle: I'm not sure why, tbh.17:49
EmilienMjillr: can you add a Depends-On ^ please? so we can test that we have the directory and can browse it, etc17:50
EmilienMthanks17:50
jillrEmilienM: for sure17:50
EmilienMjillr: thanks, you did half of the bug report https://bugs.launchpad.net/tripleo/+bug/176181017:52
openstackLaunchpad bug 1761810 in tripleo "Templates & config-download directories should be renamed for better visibility" [High,Triaged]17:52
EmilienM:)17:52
jillr:)17:53
openstackgerritJill Rouleau proposed openstack/tripleo-common master: config download support for a fixed directory  https://review.openstack.org/55057717:54
EmilienMjillr: thx, +217:55
*** shardy has quit IRC18:03
openstackgerritMerged openstack/tripleo-quickstart-extras master: undercloud: allow to configure ctlplane_masquerade in undercloud.conf  https://review.openstack.org/55799118:05
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755618:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]18:10
*** shardy has joined #tripleo18:21
*** salmankhan has joined #tripleo18:28
*** akrivoka has quit IRC18:29
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add experimental job to test overcloud updates  https://review.openstack.org/55939418:29
*** salmankhan has quit IRC18:33
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add experimental job to test overcloud updates  https://review.openstack.org/55939418:33
openstackgerritAndy Smith proposed openstack/tripleo-heat-templates master: Support separate oslo.messaging services for RPC and Notification  https://review.openstack.org/50796318:35
*** hanish has quit IRC18:44
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144118:48
*** amoralej is now known as amoralej|off18:51
*** athomas has quit IRC18:51
*** pkovar has quit IRC18:52
openstackgerritMerged openstack/puppet-tripleo master: Include local CA installation outside of HAProxy cert setup  https://review.openstack.org/55927418:56
openstackgerritMerged openstack/tripleo-upgrade master: Fix tag for rolling upgrade compute task  https://review.openstack.org/55788018:56
openstackgerritMerged openstack/tripleo-upgrade master: Expose overcloud_ssh_user var to infrared options  https://review.openstack.org/55809718:56
*** dhill__ has quit IRC19:02
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755619:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]19:10
*** shardy has quit IRC19:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: heat: align config with instack-undercloud  https://review.openstack.org/55835419:29
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Match Net:SoftwareConfig resource in scenario000 to other scenarios  https://review.openstack.org/55915219:29
*** dsariel has joined #tripleo19:30
openstackgerritMarc Methot proposed openstack/tripleo-heat-templates master: Add nfs as a cinder backup driver option to CinderBackupBackend  https://review.openstack.org/53577619:37
*** bfournie has quit IRC19:38
*** bfournie has joined #tripleo19:38
*** bfournie has quit IRC19:43
*** lblanchard has quit IRC19:49
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: containerized/undercloud: disable verbosity by default  https://review.openstack.org/55914019:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - Test fs027 with --debug  https://review.openstack.org/55917919:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - Test fs027 with --debug  https://review.openstack.org/55917919:52
mwhahahabeekneemech: so not that you care, but i figured out my problem. https://github.com/moby/moby/blob/v1.13.0-rc4/docs/deprecated.md#backing-filesystem-without-d_type-support-for-overlayoverlay219:52
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Neutron l3 agent failover check during upgrade  https://review.openstack.org/55941019:53
mwhahahabeekneemech: the image on rh2 the xfs disk has ftype=0 cause it's so old19:53
*** lblanchard has joined #tripleo19:53
*** jbadiapa_ has joined #tripleo19:55
*** jbadiapa has quit IRC19:57
*** etingof has joined #tripleo19:58
beekneemechmwhahaha: You make me sound so heartless. :-P19:59
beekneemech(but I'm technically on PTO this afternoon, so you're not wrong)19:59
mwhahaha:D19:59
mwhahahaon a friday i wouldn't want to know about this one. i'll make sure to send a note to the upgrade team to ruin their day19:59
mwhahahacause any node that has an old xfs can't be upgraded to containers19:59
mwhahahaand you have to offline the disk to change it (still not sure you can, but i think so)20:00
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Neutron l3 agent failover check during upgrade  https://review.openstack.org/55941020:00
openstackgerritMerged openstack/python-tripleoclient master: Make download_config backwards compatible  https://review.openstack.org/55546520:00
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Neutron l3 agent failover check during upgrade  https://review.openstack.org/55941020:02
sai1dsneddon: theres supposed to be a script that converts pre osp13 nic-configs to osp13 compliant configs, can u point me to it please20:03
beekneemechThat sounds like fun.20:03
beekneemechI suppose nobody has actually upgraded any older deployments to Pike yet.20:03
mwhahahayea20:04
mwhahahait'll be an FFU thing though20:04
mwhahahaunless it's always had crc/ftype enabled in RHEL20:04
mwhahahathen maybe we don't hit it20:04
* mwhahaha shrugs20:04
*** dougbtv has quit IRC20:06
*** florianf has quit IRC20:08
*** etingof has quit IRC20:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755620:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]20:10
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Manage upgrades to a containerized undercloud  https://review.openstack.org/54962420:12
*** dsariel has quit IRC20:14
*** salmankhan has joined #tripleo20:16
*** gfidente has quit IRC20:20
*** artom has quit IRC20:21
*** etingof has joined #tripleo20:23
*** links has quit IRC20:28
*** holser__ has joined #tripleo20:32
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: firewall/masquerading: cleanup nat rules  https://review.openstack.org/55925920:34
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: firewall/masquerading: cleanup nat rules  https://review.openstack.org/55925920:34
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs001: enable masquerading via THT  https://review.openstack.org/55797220:34
*** abishop has quit IRC20:42
*** pchavva has quit IRC20:44
*** beekneemech has quit IRC20:48
*** rfolco|rover is now known as rfolco|off20:48
*** salmankhan has quit IRC20:50
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: chown config to deployment user  https://review.openstack.org/55926520:50
*** Goneri has quit IRC20:53
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Run containerized mistral-api eventlet"  https://review.openstack.org/55855720:55
EmilienMslagle: if you have time, I implemented your idea of the undercloud upgrade service, tested it and it works quite well: https://review.openstack.org/#/c/559210/20:56
EmilienMslagle: it makes the tripleoclient patch much easier: https://review.openstack.org/#/c/549624/20:56
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove nat/masquerading config workarounds.  https://review.openstack.org/55785120:56
EmilienMdprince: I updated the containerized undercloud doc, if you have time for review https://review.openstack.org/#/c/558893/20:58
*** salmankhan has joined #tripleo20:59
*** paramite has quit IRC21:01
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: containerized/undercloud: disable verbosity by default  https://review.openstack.org/55914021:03
*** itlinux has joined #tripleo21:03
*** jtomasek has quit IRC21:04
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: containerized/undercloud: disable verbosity by default  https://review.openstack.org/55914021:04
*** agopi is now known as agopi|out21:06
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755621:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]21:10
*** agopi|out has quit IRC21:11
*** lblanchard has quit IRC21:17
*** itlinux has quit IRC21:18
*** artom has joined #tripleo21:23
*** dprince has quit IRC21:25
*** mcornea has quit IRC21:27
*** holser__ has quit IRC21:27
openstackgerritLiz Blanchard proposed openstack/tripleo-ui master: Move Logout under User Name Dropdown  https://review.openstack.org/55699121:28
openstackgerritJames Slagle proposed openstack/tripleo-common master: Don't set deployments as hostvars  https://review.openstack.org/55943321:30
slagleEmilienM: ok. will have a look next week probably21:31
*** jcoufal has quit IRC21:39
EmilienMslagle: perfect, thx21:40
*** raildo has quit IRC21:41
*** slaweq_ has joined #tripleo21:44
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Refactored validate-tempest role for undercloud and containers  https://review.openstack.org/55144121:45
*** slaweq_ has quit IRC21:46
*** agopi|out has joined #tripleo21:46
*** slaweq has quit IRC21:46
*** slaweq has joined #tripleo21:47
openstackgerritJill Rouleau proposed openstack/python-tripleoclient master: Add missing unit tests for undercloud_deploy  https://review.openstack.org/55545621:49
*** slaweq_ has joined #tripleo21:50
openstackgerritJames Slagle proposed openstack/tripleo-common master: Use hostnames in inventory  https://review.openstack.org/55855021:52
*** lblanchard has joined #tripleo21:53
slaglehostnames FTW. welcome to 198021:53
*** slaweq has quit IRC21:55
*** salmankhan has quit IRC21:55
jillr:)21:56
*** jmelvin has quit IRC21:57
*** waleedm has joined #tripleo22:03
openstackgerritClark Boylan proposed openstack/diskimage-builder master: Don't use -e to test for what might be broken symlink  https://review.openstack.org/55943622:06
*** ledo_ has joined #tripleo22:07
*** waleedm has quit IRC22:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755622:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]22:10
*** lblanchard has quit IRC22:18
*** lbrune has joined #tripleo22:24
*** superdan is now known as dansmith22:25
*** salmankhan has joined #tripleo22:34
*** salmankhan has quit IRC22:41
jristhonza: if you're still around https://review.openstack.org/#/c/554501/22:49
*** liverpooler has quit IRC22:49
*** dtrainor has quit IRC22:52
*** lbrune has quit IRC22:55
*** Goneri has joined #tripleo22:57
*** Goneri has quit IRC23:03
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175755623:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1757556 in tripleo "timeouts in neutron are causing ssh failures in tempest test instances" [Critical,Triaged]23:10
*** rpioso is now known as rpioso|afk23:12
*** dprince has joined #tripleo23:15
*** tosky has quit IRC23:29
*** itlinux has joined #tripleo23:39
*** dprince has quit IRC23:45
*** apetrich has quit IRC23:45
*** apetrich has joined #tripleo23:46
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:55
*** waleedm has joined #tripleo23:55
*** moshele has joined #tripleo23:57
*** ledo_ has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!