Monday, 2017-08-21

*** tosky has quit IRC00:04
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295500:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191300:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]00:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)00:10
*** achadha has joined #tripleo00:16
*** catintheroof has quit IRC00:33
*** limao has joined #tripleo00:34
*** limao has quit IRC00:34
*** limao has joined #tripleo00:34
openstackgerritLukas Bezdicka proposed openstack/python-tripleoclient master: WIP: Add minor-update-init option to get heat stack outputs  https://review.openstack.org/49565800:42
*** dsariel has joined #tripleo00:49
*** dmacpher has joined #tripleo00:57
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295501:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191301:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]01:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)01:10
*** cshastri has joined #tripleo01:11
*** funzo has joined #tripleo01:27
*** funzo has quit IRC01:31
*** gvrangan__odl has joined #tripleo01:39
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement  https://review.openstack.org/44271601:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name  https://review.openstack.org/44275501:41
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector  https://review.openstack.org/45782201:41
*** dsariel has quit IRC01:46
*** itlinux has joined #tripleo01:56
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295502:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191302:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]02:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)02:10
*** gvrangan__odl has quit IRC02:24
*** funzo has joined #tripleo02:28
*** achadha has quit IRC02:28
*** funzo has quit IRC02:32
*** ebarrera has quit IRC02:46
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295503:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191303:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)03:10
*** ecerquei__ has quit IRC03:16
*** artom has quit IRC03:19
openstackgerritzhongshengping proposed openstack/puppet-pacemaker master: Update reno>=2.5.0  https://review.openstack.org/49570803:20
openstackgerritzhongshengping proposed openstack/puppet-tripleo master: Update reno>=2.5.0  https://review.openstack.org/49571503:21
*** ramishra has joined #tripleo03:37
*** gkadam has joined #tripleo03:51
*** tonyb has quit IRC03:53
*** psahoo has joined #tripleo03:54
*** links has joined #tripleo03:54
*** ykarel__ has joined #tripleo03:57
*** gvrangan__odl has joined #tripleo03:58
*** tonyb has joined #tripleo04:00
*** shardy has quit IRC04:06
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295504:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191304:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)04:10
*** skramaja has joined #tripleo04:10
*** shardy has joined #tripleo04:13
*** ykarel__ has quit IRC04:16
*** ykarel has joined #tripleo04:17
*** udesale has joined #tripleo04:21
*** funzo has joined #tripleo04:29
*** jaganathan has joined #tripleo04:29
*** funzo has quit IRC04:33
*** itlinux has quit IRC04:35
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: Derive params support for ODL DPDK feature  https://review.openstack.org/48642504:35
*** shreshtha has joined #tripleo04:38
*** gvrangan__odl has quit IRC04:49
*** jaganathan has quit IRC04:53
openstackgerritSteve Baker proposed openstack/tripleo-common master: Upload remove default for pull_source  https://review.openstack.org/48983704:59
*** dpawar has joined #tripleo05:03
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295505:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191305:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)05:10
openstackgerritSaravanan KR proposed openstack/python-tripleoclient master: Add a warning message for the list of unused parameters  https://review.openstack.org/49530005:22
*** pdeore has joined #tripleo05:24
*** gvrangan_odl has joined #tripleo05:27
*** anshul has joined #tripleo05:40
*** udesale__ has joined #tripleo05:42
*** udesale has quit IRC05:45
*** brault has joined #tripleo05:47
*** ramishra has quit IRC05:48
*** pgadiya has joined #tripleo05:55
*** rmcadams has quit IRC05:56
*** yprokule has joined #tripleo05:58
*** ratailor has joined #tripleo05:59
*** rcernin has joined #tripleo06:04
*** ramishra has joined #tripleo06:06
*** gbarros has joined #tripleo06:06
*** mdnadeem has joined #tripleo06:07
*** iranzo has joined #tripleo06:07
*** agurenko has joined #tripleo06:07
*** jfrancoa has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295506:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191306:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]06:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)06:10
*** gbarros has quit IRC06:16
*** jaosorior has joined #tripleo06:16
*** jtomasek has joined #tripleo06:21
*** dsariel has joined #tripleo06:21
*** masco has joined #tripleo06:22
*** jaganathan has joined #tripleo06:26
*** funzo has joined #tripleo06:29
jaosoriorjistr, bandini: Could you check this out https://review.openstack.org/#/c/494085/ ?06:29
bandinisure06:30
*** pcaruana has joined #tripleo06:30
jaosoriorbandini: anything you need me to check out?06:32
*** funzo has quit IRC06:34
bandinijaosorior: not at the moment, thanks06:34
*** bogdando has joined #tripleo06:36
*** dmacpher has quit IRC06:42
*** jprovazn has joined #tripleo06:43
mandrejaosorior: hey! have you already seen this error with tls_everywhere_provisioner.sh? http://paste.openstack.org/show/618869/06:49
mandrejaosorior: running the virt-install command a second time succeeds :-/06:49
*** ykarel has quit IRC06:53
*** ffiore has joined #tripleo06:54
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145106:54
*** ebarrera has joined #tripleo06:55
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Add logrotate with crond service  https://review.openstack.org/49005006:56
*** ykarel has joined #tripleo07:05
bogdandomandre: hi. Do you mind to get https://review.openstack.org/#/c/494367/ accepted as is?07:06
bogdandoit's a drastic improvement for CI jobs time, kudos to stevebaker07:06
*** florianf has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295507:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191307:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)07:10
*** jbadiapa has quit IRC07:11
*** jlinkes has joined #tripleo07:12
*** jbadiapa has joined #tripleo07:12
*** ramishra has quit IRC07:17
mandrebogdando: sure! I see stevebaker replied to my comments and promised to push a follow up patch07:20
bogdandomandre: thanks!07:20
*** amoralej|off is now known as amoralej07:20
*** aufi has joined #tripleo07:21
*** cylopez has joined #tripleo07:25
*** jbadiapa has quit IRC07:26
*** jpena|off is now known as jpena07:26
*** ramishra has joined #tripleo07:27
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart-extras master: Add OS_REGION_NAME to clouds.yaml  https://review.openstack.org/49574507:32
*** jpich has joined #tripleo07:32
bogdandowhat a strange error http://logs.openstack.org/55/489955/6/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/c5c8c0f/logs/overcloud-controller-0/var/log/messages.txt.gz#_Aug_18_08_45_3507:33
bogdandoitems undefined?.. hm07:34
*** paramite has joined #tripleo07:34
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139907:35
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh]  https://review.openstack.org/49141107:35
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mistral]  https://review.openstack.org/49347107:35
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi]  https://review.openstack.org/49143307:35
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-1]  https://review.openstack.org/49519507:35
*** jbadiapa has joined #tripleo07:42
*** egonzalez has joined #tripleo07:45
*** shardy has quit IRC07:49
*** shardy has joined #tripleo07:49
*** ffiore has quit IRC07:51
*** oidgar has joined #tripleo07:54
*** mcornea has joined #tripleo07:55
*** mdnadeem has quit IRC07:56
*** mdnadeem has joined #tripleo07:56
*** athomas has joined #tripleo08:06
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Switch scenario004 to run Tempest  https://review.openstack.org/49111308:07
jaosoriormandre: I think I've seen that before. Hasn't happened to me but it did to a colleague08:10
jaosoriornot sure how he resolved it.08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295508:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191308:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)08:10
jaosoriormandre: were you able to move forward?\08:10
jaosoriorshardy: hey, could you check this out https://review.openstack.org/#/c/494085/ ?08:11
*** udesale has joined #tripleo08:11
*** udesale__ has quit IRC08:12
*** fzdarsky has joined #tripleo08:13
hanishwe are planning to integrate our hardware with openstack and use tripleo templates to configure the openstack to  use our hardware and upstream it to heat templates project.08:13
hanishcan anyone provide the procedure08:14
jaosoriorbogdando: what's the patch?08:14
jaosoriorhanish: depends, what sort of hardware you're talking about; you would need to contribute a plugin for a specific project, once that's done, then you could start thinking about deploying that plugin with tripleo08:16
bogdandojaosorior: https://review.openstack.org/#/c/489955/08:17
*** dpawar has quit IRC08:21
jaosoriorbogdando: wow, that IS quite strange...08:22
bogdandojaosorior: today is a dya of strange error messages08:22
jaosoriorbogdando: only thing I can think of is to deploy that locally and check what the contents of {{role.name}}/host_prep_tasks.yaml is08:23
*** derekh has joined #tripleo08:23
*** ffiore has joined #tripleo08:23
bogdandoit's a pity we don't have rendered env templates included into CI logs08:25
*** lucas-afk is now known as lucasagomes08:25
jaosoriorbogdando: that would sure be a nice addition to the CI :D08:26
bogdandoan easy karma ^^ , folks around :D08:26
bogdandoa few lines for quickstart extras or so08:27
*** funzo has joined #tripleo08:30
jaosoriorbogdando: check this https://review.openstack.org/#/c/489955/6/docker/services/horizon.yaml08:31
jaosoriorbogdando: should be item, not items08:31
mandrejaosorior: I've added a retry in the script and that got me a bit further, where it's now stuck booting the VM08:31
*** dpawar has joined #tripleo08:32
jaosoriormandre: hrybacki might also be able to help when he logs in. He wrote the provisioning of FreeIPA via quickstart :)08:32
jaosoriormandre: the stuck booting VM issue was the same as you were talking before? or is this another thing?08:32
mandrejaosorior: I'm trying to unpin ansible now in the hope it's going to fix my libvirt issues with f26 but that opened a whole different can of worms08:33
jaosoriorcrap :(08:33
mandrejaosorior: let's see where it leads me08:33
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175908:33
*** cschwede has joined #tripleo08:34
*** funzo has quit IRC08:35
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart-extras master: Add OS_REGION_NAME to clouds.yaml  https://review.openstack.org/49574508:41
lvdombrkrguys, what can mean in ramdisk logs: Aug 21 08:20:04 localhost ironic-python-agent[890]: 2017-08-21 08:20:04.063 890 DEBUG oslo_concurrency.processutils [-] CMD "hardware-detect" returned: 0 in 5.162s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:38508:47
lvdombrkr?08:47
*** tosky has joined #tripleo08:47
*** pcaruana has quit IRC08:53
lvdombrkrguys, i have question, IPMI and PXE physicaly must be one interface or it can be diferent?08:53
jaosoriorlvdombrkr: I recommend you also ask in #openstack-ironic08:54
*** pcaruana has joined #tripleo08:55
*** dpawar has quit IRC08:56
lvdombrkr<jaosorior08:56
lvdombrkrjaosorior: thank you, a asked08:56
lvdombrkrany ideas in this channel? )08:57
*** pdeore has quit IRC09:08
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295509:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191309:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)09:10
*** ykarel has quit IRC09:11
openstackgerritMerged openstack/python-tripleoclient master: Filter container images by deployed services  https://review.openstack.org/49436709:13
*** salmankhan has joined #tripleo09:14
*** jbadiapa_ has joined #tripleo09:15
*** yprokule_ has joined #tripleo09:16
*** pdeore has joined #tripleo09:16
*** jbadiapa has quit IRC09:17
*** adarazs has quit IRC09:17
*** dtantsur has quit IRC09:18
*** yprokule has quit IRC09:19
*** yprokule_ is now known as yprokule09:19
*** pcaruana has quit IRC09:19
*** tosky_ has joined #tripleo09:19
*** tosky has quit IRC09:19
*** jprovazn has quit IRC09:19
*** aufi has quit IRC09:19
*** lyarwood_ has joined #tripleo09:20
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/49412709:20
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Containerized Fluentd client  https://review.openstack.org/46707209:23
*** dtantsur has joined #tripleo09:24
*** dtantsur has quit IRC09:24
*** dtantsur has joined #tripleo09:24
*** dtantsur has quit IRC09:24
*** adarazs has joined #tripleo09:24
*** dtantsur has joined #tripleo09:24
*** dtantsur has quit IRC09:24
openstackgerritFlavio Percoco proposed openstack/tripleo-quickstart master: Add featureset33 for scenario009  https://review.openstack.org/49441809:27
*** limao has quit IRC09:27
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift using OOO on the overcloud  https://review.openstack.org/49447009:28
*** dtantsur has joined #tripleo09:29
*** artom has joined #tripleo09:31
*** aufi has joined #tripleo09:32
*** pcaruana has joined #tripleo09:32
*** jprovazn has joined #tripleo09:33
openstackgerritFlavio Percoco proposed openstack-infra/tripleo-ci master: Collect mistral-ansible execution files from /tmp  https://review.openstack.org/48386709:33
dtantsurmorning folks! could you please check https://review.openstack.org/#/c/493943/ all jobs passed on it in several rechecks (the last one ended with an infra problem). it's not going to be good, if this patch chain does not merge before the final release..09:33
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift using OOO on the overcloud  https://review.openstack.org/49447009:34
openstackgerritAlfredo Moralejo proposed openstack/tripleo-quickstart-extras master: Add quickstart-* repos to build-images role  https://review.openstack.org/49578709:35
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart-extras master: Add OS_REGION_NAME to clouds.yaml  https://review.openstack.org/49574509:36
*** gfidente has joined #tripleo09:39
*** gfidente has quit IRC09:39
*** gfidente has joined #tripleo09:39
*** yprokule_ has joined #tripleo09:42
*** adarazs has quit IRC09:44
*** tosky has joined #tripleo09:44
*** yprokule has quit IRC09:44
*** yprokule_ is now known as yprokule09:44
*** adarazs has joined #tripleo09:44
*** dtantsur has quit IRC09:44
*** jprovazn has quit IRC09:45
*** pcaruana has quit IRC09:45
*** aufi has quit IRC09:45
*** tosky_ has quit IRC09:45
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart-extras master: Add OS_REGION_NAME to clouds.yaml  https://review.openstack.org/49574509:48
lvdombrkrguys, in node which i try introcpect i see looping this error: https://pasteboard.co/GGET73u.jpg09:48
lvdombrkrwhat it can means?09:48
lvdombrkrand no answer back to undercloud node?09:49
*** dtantsur has joined #tripleo09:50
lvdombrkr?09:54
*** dpawar has joined #tripleo09:57
*** aufi has joined #tripleo09:58
*** jprovazn has joined #tripleo09:58
*** pcaruana has joined #tripleo09:58
*** egonzalez has quit IRC09:59
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift using OOO on the overcloud  https://review.openstack.org/49447010:00
*** cshastri has quit IRC10:01
*** athomas has quit IRC10:01
jaosoriormandre: for some reason only the paste.ini file is being passed to the barbican container here https://review.openstack.org/#/c/481451/  what's missing for us to bind-mount or copy the puppet-generated config to the container?10:01
yolandahi, i'm seeing some issues with a backport to newton, for puppet-tripleo, it doesn't seem to be passing tests10:03
yolandahttps://review.openstack.org/#/c/490578/10:03
yolandait has been up there for a while, is there some known problem?10:04
hanishjaosorior: Thanks related plugin work is going on, can we work in parallel. Or only after plugin gets accepted can we put patch for heat templates10:04
*** ebarrera has quit IRC10:05
*** ebarrera has joined #tripleo10:05
bogdandojaosorior: thanks for the caught typo! :)10:06
jaosoriorbogdando: no biggie.10:06
mandrejaosorior: looking10:06
lvdombrkr guys, in node which i try introcpect i see looping this error: https://pasteboard.co/GGET73u.jpg10:07
lvdombrkr what it can means?10:07
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Persist containerized services httpd logs  https://review.openstack.org/48995510:08
jaosoriorshardy: is there a bootstrap node for each role? or is that only for the primary role?10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295510:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191310:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202910:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)10:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)10:10
jaosoriormandre: thanks for the review!10:10
mandrejaosorior: the puppet tag was wrong, barbican_api_config vs barbican_config, commented on the review10:10
shardyjaosorior: it's only one for all roles10:10
shardyjaosorior: actually it looks like we have an issue there because we've reverted to '0' vs using yaql first to get the first list item10:11
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps.j2#L17610:11
shardyjaosorior: but it's going to work unless you remove overcloud-controller-010:11
*** akrivoka has joined #tripleo10:11
jaosoriorshardy: seems that it might break for some deployers, since they do change the overcloud-controller-X convention often.10:12
shardyjaosorior: well the server name doesn't influence that resource name10:12
shardyjaosorior: it's a regression tho, it will break if someone does a node delete replacement of the first controller10:12
shardywe'll have to switch it to use yaql first like we did previously in overcloud.j2.yaml10:13
shardythat got lost in translation to the container architecture I think10:13
*** ramishra has quit IRC10:16
*** ffiore has quit IRC10:16
jaosoriorshardy, owalsh: Is there a reason why we use the NovaApiNetwork for the vnc proxy https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-vnc-proxy.yaml#L74 ? instead of the actual network that's in the service map https://github.com/openstack/tripleo-heat-templates/blob/master/network/service_net_map.j2.yaml#L61 ?10:16
mandrejaosorior: btw, I gave up with f26 and installed a centos on top of it, now libvirt is behaving normally10:17
jaosoriormandre: yeah, I guess at some point it was the easiest thing to do.10:17
mandrejaosorior: still the quickstart command won't complete, I'm now stuch at "Create FreeIPA deployment script" for more than 10 min10:17
*** ramishra has joined #tripleo10:18
jaosoriormandre: that one does take some time.10:18
jaosorioroh wait10:18
jaosoriorcreate the deploy script?10:18
jaosoriorno... that shouldn't take that long10:18
jaosoriorIIRC that merely copies the script on to the node10:18
*** jaganathan has quit IRC10:18
mandrejaosorior: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/freeipa-setup/tasks/main.yml#L1410:18
jaosoriorand doesn't execute it y et10:19
jaosoriorlet meverify10:19
shardyjaosorior: not sure, looks like a mistake to me10:19
jaosoriorshardy: ok, I'll file a bug and fix that up.10:19
jaosoriormandre: right... that makes no sense :/10:19
jaosoriormandre: how's the memory situation in your host node?10:19
mandrejaosorior: is that supposed to run on the ipa VM?10:19
jaosoriormandre: yep10:20
*** egonzalez has joined #tripleo10:20
mandrejaosorior: I've more than enough memory :)10:21
jaosoriormandre: what about the cache?10:21
*** ffiore has joined #tripleo10:23
mandrejaosorior: fwiw I can see the /home/stack/deploy_freeipa.sh script on the ipa vm10:23
jaosoriormandre: well that's good, but it's still stuck on that step?10:23
mandrejaosorior: right...10:24
mandrejaosorior: I'll leave it running, it took 10 min to create the script10:25
mandrejaosorior: and now the task succeeded!10:25
mandreperfect10:25
mandrejaosorior: hmm the playbook eventually failed, http://paste.openstack.org/show/618891/10:27
mandrejaosorior: I'll try again after lunch10:27
*** funzo has joined #tripleo10:28
skramajashardy: https://review.openstack.org/#/c/495300/, ptal. could you check if it is worth pushing to stable..10:30
*** funzo has quit IRC10:32
*** pdeore has quit IRC10:32
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart-extras master: Read external network name from openstackclient  https://review.openstack.org/49581310:33
shardyskramaja: looks good, but I added one question/comment10:35
*** shreshtha has quit IRC10:35
shardywe now have a way to not always define every *Image parameter, and that's probably to be encourged since otherwise you waste time pulling images in the overcloud image upload step?10:36
*** udesale has quit IRC10:36
*** pdeore has joined #tripleo10:37
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656710:38
*** udesale has joined #tripleo10:38
*** jkilpatr has quit IRC10:41
*** shardy has quit IRC10:41
*** shardy has joined #tripleo10:41
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656710:41
*** ansmith has quit IRC10:47
*** atoth has quit IRC10:47
*** shardy has quit IRC10:50
*** shardy has joined #tripleo10:51
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Remove printing the introspection status  https://review.openstack.org/49424910:52
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656710:52
*** masco has quit IRC10:53
jaosoriorshardy: do you know why OS::TripleO::Services::ComputeNeutronMetadataAgent is set to None ? https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L23610:56
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656710:57
jaosoriorshardy: hey, got time to check this out https://review.openstack.org/#/c/494989/ ?11:00
*** jkilpatr has joined #tripleo11:01
gfidentecan anybody point me to where it is best to reproduce https://review.openstack.org/#/c/494340/ in oooq?11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295511:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191311:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202911:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]11:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)11:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)11:10
*** mburned_out has quit IRC11:10
*** thrash|g0ne is now known as thrash11:15
*** pdeore has quit IRC11:15
*** bnemec has joined #tripleo11:17
*** ffiore has quit IRC11:17
*** openstackgerrit has quit IRC11:17
jaosoriorjistr: thanks for the reviews :D11:21
*** bnemec is now known as bnemeclipse11:21
jaosoriorbnemeclipse: around yet?11:22
bnemeclipsejaosorior: Yep11:23
bnemeclipseIt's stupid early here, but I couldn't sleep.11:24
jaosoriorbummer :/11:24
bnemeclipseAnd I'm playing hooky for an hour or two this afternoon to watch the eclipse so I'm making up for it now. :-)11:24
jaosoriorbnemeclipse: do you know why OS::TripleO::Services::ComputeNeutronMetadataAgent is set to None ? https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L23611:24
*** egonzalez has quit IRC11:26
bnemeclipsejaosorior: I would assume because it's not something we deploy by default.11:27
bnemeclipsejaosorior: Yeah, it's an optional service for DVR, according to https://github.com/openstack/tripleo-heat-templates/commit/deb098c29a2f9660bded6c44ba06f210cfde85f811:27
*** openstackgerrit has joined #tripleo11:30
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175911:30
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656711:31
*** milan has joined #tripleo11:33
*** ykarel|away has joined #tripleo11:36
*** ykarel|away is now known as ykarel11:36
*** udesale has quit IRC11:36
*** udesale has joined #tripleo11:38
openstackgerritJuan Badia Payno proposed openstack/tripleo-quickstart master: Handle undercloud autostart dependant on ansible version  https://review.openstack.org/49582711:39
jaosoriorhrybacki: ping11:41
openstackgerritMerged openstack/puppet-tripleo master: Certmonger: Make postsave command configurable  https://review.openstack.org/49408511:42
lvdombrkrguys after succesfull introspection nodes provision state stay as managable and i cant find any errors ir logs11:42
lvdombrkrany ideas?11:42
*** jprovazn has quit IRC11:42
*** bkopilov has quit IRC11:43
*** ykarel has quit IRC11:43
*** atoth has joined #tripleo11:43
*** lucasagomes is now known as lucas-hungry11:44
lvdombrkrguys after succesfull introspection nodes provision state stay as managable and i cant find any errors ir logs11:48
lvdombrkrany ideas?11:48
bnemeclipselvdombrkr: You have to pass --provide to the introspection command to have them become available after introspection.11:48
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Containarise Barbican API  https://review.openstack.org/48145111:48
openstackgerritMerged openstack/tripleo-heat-templates master: Enable TLS for containerized RabbitMQ  https://review.openstack.org/49363211:49
*** shreshtha has joined #tripleo11:51
*** bkopilov has joined #tripleo11:51
*** limao has joined #tripleo11:53
*** pgadiya has quit IRC11:53
*** beagles has joined #tripleo11:53
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656711:55
lvdombrkrbnemeclipse: thank you, its helps ))11:55
skramajashardy: thanks for the comment. but i still think that the refered patch still adds all the mapped services in the via docker.yaml, which will also add more parameters unused.. i will try to get the updates list based on this patch, and we can conclude on it.11:56
*** social has joined #tripleo11:56
*** dprince has joined #tripleo11:57
*** shreshtha has quit IRC11:58
*** shreshtha has joined #tripleo11:58
*** shreshtha has quit IRC11:59
*** shreshtha has joined #tripleo11:59
*** dprince has quit IRC12:00
*** dprince has joined #tripleo12:00
openstackgerritSaravanan KR proposed openstack/python-tripleoclient master: Add a warning message for the list of unused parameters  https://review.openstack.org/49530012:01
*** shreshtha has quit IRC12:02
*** shreshtha has joined #tripleo12:03
*** jprovazn has joined #tripleo12:03
*** jpich has quit IRC12:03
*** adarazs is now known as adarazs_lunch12:04
*** egonzalez has joined #tripleo12:06
*** pradk has joined #tripleo12:08
*** rbowen has joined #tripleo12:09
*** ratailor has quit IRC12:09
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656712:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295512:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171191312:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202912:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1711913 in tripleo "CI: OVB cloud doesn't provide stacks for jobs" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)12:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)12:10
*** ebarrera has quit IRC12:11
*** limao_ has joined #tripleo12:11
*** ebarrera has joined #tripleo12:12
*** trown|outtypewww is now known as trown12:12
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement  https://review.openstack.org/44271612:12
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name  https://review.openstack.org/44275512:12
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector  https://review.openstack.org/45782212:12
*** limao has quit IRC12:12
*** jpena is now known as jpena|lunch12:12
*** limao_ has quit IRC12:17
*** iranzo has quit IRC12:17
*** iranzo has joined #tripleo12:18
*** iranzo has joined #tripleo12:18
*** deadnull has joined #tripleo12:18
*** jpich has joined #tripleo12:26
*** aditya_r has joined #tripleo12:26
*** amoralej is now known as amoralej|lunch12:27
lvdombrkrguys, after i run openstack overcloud deploy i get error : ERROR: Failed to validate: : resources.ControllerServiceChain: : The Resource Type (OS::TripleO::Services::Docker) could not be found.",12:27
lvdombrkr u'status': u'FAILED'}12:27
lvdombrkrany ideas?12:28
*** lucas-hungry is now known as lucasagomes12:28
jaosoriorlvdombrkr: what release are you using?12:28
*** adarazs_lunch is now known as adarazs12:28
lvdombrkrjaosorior: ocata12:29
*** udesale has quit IRC12:29
jaosoriorlvdombrkr: what command did you use to deploy?12:29
*** bnemeclipse has quit IRC12:30
lvdombrkrjaosorior:  openstack overcloud deploy --templates -e one.yaml --compute-scale 012:30
*** ramishra has quit IRC12:30
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS for containerized horizon  https://review.openstack.org/49498912:30
*** udesale has joined #tripleo12:31
jaosoriorlvdombrkr: what does one.yaml contain?12:31
lvdombrkrjaosorior: im deploying all in one ( compute node and controller not seperate) http://paste.openstack.org/show/618524/12:31
jaosoriorlvdombrkr: are you trying to deploy a containerized environment?12:32
lvdombrkrjaosorior: not12:32
jaosoriorlvdombrkr: removing     - OS::TripleO::Services::Docker    will help12:33
*** ffiore has joined #tripleo12:33
lvdombrkrjaosorior: thank you for quick answer i will try!12:35
*** morazi has joined #tripleo12:35
*** rlandy has joined #tripleo12:36
*** bnemec has joined #tripleo12:36
*** ecerquei has joined #tripleo12:37
*** ramishra has joined #tripleo12:37
*** ecerquei has joined #tripleo12:39
*** gkadam has quit IRC12:41
*** psahoo has quit IRC12:41
openstackgerritMatthias Runge proposed openstack/tripleo-quickstart-extras master: Read external network name from openstackclient  https://review.openstack.org/49581312:42
oidgarhi guys, I'm having troubles with tripleo mistral workflow "tripleo.stack.v1.wait_for_stack_complete_or_failed". I call it with stack ID as input parameter and sometimes it just fails although the stack still exists and running.12:43
oidgarfor example, one task execution action list and results of it: http://paste.openstack.org/show/618905/12:43
oidgardid anyone else encountered this or have an idea how to solve it?12:44
*** ansmith has joined #tripleo12:44
lvdombrkrjaosorior: False, u'container': u'overcloud', u'timeout': 240}']\n ERROR: Failed to validate: : resources.ControllerServiceChain: : The Resource Type (OS::TripleO::Services::NovaMigrationTarget) could not be found.",12:45
lvdombrkr u'status': u'FAILED'}12:45
lvdombrkr jaosorior: i need to remove olso NovaMigrationTarget"12:45
lvdombrkr?12:45
*** jbadiapa_ has quit IRC12:45
jaosoriorlvdombrkr: well, you need to check /usr/share/openstack-tripleo-heat-templates/overcloud-resource-registry-puppet.j2.yaml  and check that every service that you added in your environment file is present there.12:46
*** skramaja has quit IRC12:48
lvdombrkrjaosorior: no there is no NovaMigration presented here12:48
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for vncproxy  https://review.openstack.org/49584612:50
jaosoriorlvdombrkr: then you gotta delete it12:50
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable TLS in the internal network for vnc proxy  https://review.openstack.org/49584812:51
*** dprince has quit IRC12:51
*** dpawar has quit IRC12:51
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Enable TLS in the internal network for vnc proxy  https://review.openstack.org/49584812:52
jaosoriorbandini: small review here https://review.openstack.org/#/c/495288/ if you have time :D12:53
hrybackijaosorior: pong12:54
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Containerized deployment with pacemaker via OOOQ  https://review.openstack.org/49585012:56
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Workaround is not needed for releases after ocata  https://review.openstack.org/48565312:57
lvdombrkrjaosorior: thank you12:57
*** cschwede has quit IRC12:58
*** jcoufal has joined #tripleo12:58
jaosoriorhrybacki: hey, mandre was having issues with the deployment of FreeIPA using the supplemental node. Wondering if you have some time to help him out.12:58
hrybackiI can try, what's up mandre ?12:59
*** tzumainn has joined #tripleo12:59
*** cschwede has joined #tripleo13:00
*** jbadiapa_ has joined #tripleo13:01
*** abishop has joined #tripleo13:02
openstackgerritJuan Badia Payno proposed openstack/tripleo-quickstart master: Handle undercloud autostart dependant on ansible version  https://review.openstack.org/49582713:08
*** florianf has quit IRC13:09
*** udesale has quit IRC13:10
*** ffiore has quit IRC13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295513:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202913:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)13:10
*** amoralej|lunch is now known as amoralej13:11
*** florianf has joined #tripleo13:12
jaosoriorowalsh: ping13:14
hrybackijaosorior: I saw your response to the openstack-dev thread. Emilien is on PTO today, hopefully we get a response tomorrow -- I wasn't sure what he meant exactly either but it sounded like he had a pretty good handle on it13:16
*** jlabarre has joined #tripleo13:18
*** jaganathan has joined #tripleo13:18
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Support initramfs images in modify-image role  https://review.openstack.org/47989613:21
lvdombrkrguys, how long time aprox. overcloud deployment can take?13:22
*** ffiore has joined #tripleo13:23
jaosoriorlvdombrkr: it can vary a lot depending on what you're deploying. Is it baremetal or virtualized?13:23
*** jpena|lunch is now known as jpena13:23
lvdombrkrjaosorior: baremetal13:23
*** pchavva has joined #tripleo13:27
jaosoriorlvdombrkr: well, it could take about an hour or so13:28
*** dougbtv has joined #tripleo13:29
*** aditya_r has quit IRC13:31
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: DNM simulating project-config patch merged  https://review.openstack.org/48307713:31
lvdombrkrjaosorior: thank you ))13:31
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: DNM testing https://review.openstack.org/483077  https://review.openstack.org/48307813:32
*** dprince has joined #tripleo13:32
*** gvrangan_odl has quit IRC13:33
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Introduced tempest_extra_config flag for tempest.conf  https://review.openstack.org/49439413:33
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Switch to overcloudrc.v3 for running tempest  https://review.openstack.org/49303013:34
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart master: Switch containers multinode CI to deploy HA  https://review.openstack.org/47172413:35
*** deadnull has quit IRC13:37
lvdombrkrjaosorior: what can me this error? maybe some quick ideas? http://paste.openstack.org/raw/618914/13:38
mandrehey hrybacki, getting back to it... I have issues connecting to the ipa VM via ssh13:38
jaosoriorlvdombrkr: well, you need to check the nova logs in order to get more info.13:39
jaosoriorlvdombrkr: could be many reasons, but the logs will tell13:39
hrybackimandre: from your laptop, the virsthost running the VM? How are you attempting to connect to it13:39
lvdombrkrjaosorior: intresting that deployment not interupted13:40
jaosoriorlvdombrkr: it will retry the action13:40
lvdombrkrjaosorior: i can interrupt it myself?13:41
mandrehrybacki: from the host where I run quickstart, "ssh -F /home/martin/.quickstart-gouda/ssh.config.ansible supplemental"13:41
mandrehrybacki: it takes about 3 minutes to connect but eventually succeeds13:41
jaosoriorlvdombrkr: I suggest you let it running, open another console, and check the logs from there.13:42
mandrehrybacki: connecting to the undercloud vm is immediate13:42
hrybackimandre: so I've experienced that with quicktart in the past but never really spent the time to figure out why. Would you be willing to submit a bug against TripleO in launchpad so we can set a priority and track work against it?13:42
jaosoriorbeagles: are you around?13:42
* hrybacki understands how frustrating that bit is13:43
mandrehrybacki: sure13:43
mandrehrybacki: any idea what I can try to get past the issue?13:43
hrybackimandre++ just ping me when it's created and I'll make sure it gets triaged quicky13:43
beaglesjaosorior, yep (stupid xchat bug is hiding my tripleo window on my notebook)13:43
lvdombrkrjaosorior: it should be in nova-compute.log ?13:44
beaglesjaosorior, 'sup?13:44
hrybackimandre: you may be able to access the VM directly from the virthost. OR try to ssh to it from the undercloud. Is it slow every time you attempt to log in13:44
hrybackiusing the ssh.config.ansible file13:44
mandrehrybacki: from the virthost, the vm appears to reject the key13:45
*** cylopez has quit IRC13:51
mandrehrybacki: bug filled at https://bugs.launchpad.net/tripleo/+bug/171208113:56
openstackLaunchpad bug 1712081 in tripleo "SSH connection to supplemental ipa VM takes minutes" [Undecided,New]13:56
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Enable mistral mod_wsgi in undercloud  https://review.openstack.org/45848213:56
hrybackimandre: thanks. Were you able to ssh into the supp. vm via the undercloud?13:57
mandrehrybacki: not yet, trying to figure out what's wrong13:57
*** bnemec has quit IRC13:58
mandrehrybacki: ah wait, I haven't tried from the undercloud, I did try from virthost13:58
*** dmsimard|off is now known as dmsimard13:59
mandrewhat command do you use to connect from the undercloud? I don't see any keys present13:59
jaganathand0ugal, shardy please look into https://review.openstack.org/#/c/480587/14:00
hrybackimandre: I'm not sure off the top of my head. can you paste me your ssh.config.ansible file?14:00
hrybackimandre: this is not a typical flow, we're basically pulling out what we need from that file (and if nescessary, adding keys to undercloud to allow you to do so)14:00
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Mock out the creation of the tempest config  https://review.openstack.org/49532814:02
*** Goneri has joined #tripleo14:02
*** stee_3 has joined #tripleo14:03
mandrehrybacki: why do we have id_rsa_virt_host and id_rsa_virt_power?14:04
*** bugzy_ has joined #tripleo14:04
hrybackimandre: that's a way-back question that may best be answered by adarazs or trown14:05
hrybackiI'm not sure how clear the docs are on those. We did a major clean up last cycle within oooq but there is still a lot left to do14:05
adarazsmandre: not sure either. maybe rlandy or weshay knows why we have both.14:05
mandrehrybacki: something's fishy with these identity files14:05
*** shreshtha has quit IRC14:06
*** stee_3_ has quit IRC14:07
*** bugzy has quit IRC14:07
lvdombrkrguys, any ideas about this error after running overcloud deploy ? http://paste.openstack.org/raw/618917/14:08
jaosoriorlvdombrkr: what did the nova and the ironic logs say?14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295514:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202914:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)14:10
lvdombrkrjaosorior: there is no error in nova logs14:10
jaosoriorlvdombrkr: what about ironic?14:10
*** ffiore has quit IRC14:10
*** ffiore_ has joined #tripleo14:10
*** bnemec has joined #tripleo14:11
*** bnemec is now known as bnemeclipse14:12
*** liverpooler has joined #tripleo14:13
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates master: Add Mistral event engine  https://review.openstack.org/46297514:14
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Deploy Mistral with Keystone v3 options (authtoken)  https://review.openstack.org/47614414:17
lvdombrkrjaosorior: interesting but i cant find any erorrs14:17
jaosoriorlvdombrkr: no IPMI errors or something of the sort?14:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656714:19
*** dpawar has joined #tripleo14:19
*** jlabarre has quit IRC14:19
*** jlabarre has joined #tripleo14:21
openstackgerritMerged openstack-infra/tripleo-ci master: Copy Ceph logs from running containers  https://review.openstack.org/49434014:25
*** anshul has quit IRC14:25
*** florianf has quit IRC14:26
*** aufi has quit IRC14:27
lvdombrkrjaosorior: can it be related that my node which i tagg to flavor has same amount of RAM as flavor required not more14:28
*** agurenko has quit IRC14:28
jaosoriorlvdombrkr: not sure to be honest.14:29
mandrehrybacki: found the cause of the slowdown, it's a DNS issue14:29
*** funzo has joined #tripleo14:29
hrybackimandre: interesting, please expand (it's always a DNS issue...)14:29
mandrehrybacki: I commented on https://bugs.launchpad.net/tripleo/+bug/171208114:30
openstackLaunchpad bug 1712081 in tripleo "SSH connection to supplemental ipa VM takes minutes" [Undecided,New]14:30
mandrenot sure what sets the DNS to 10.11.5.1914:30
hrybackimandre: was that on your laptop that it changed your dns server?14:31
*** ramishra has quit IRC14:31
mandrehrybacki: on the ipa VM14:31
*** dpawar has quit IRC14:32
hrybackimandre: ah yes, IIUC the IPA VM must become the DNS server for the deployment (paging jaosorior to confirm my stale knowledge)14:32
mandrehrybacki: hmmmf, the DNS is hardcoded in /etc/sysconfig/network-scripts/ifcfg-eth014:33
lvdombrkrjaosorior: i find it under nova logs14:33
*** funzo has quit IRC14:33
lvdombrkr2017-08-21 17:31:54.293 78393 DEBUG nova.virt.ironic.driver [-] [instance: 30ea888f-655e-4f4a-89a4-c4b765d8f181] Still waiting for ironic node 8825765a-a40c-4361-9a31-cd7c7a918e68 to become ACTIVE: power_state="power on", target_power_state=None, provision_state="wait call-back", target_provision_state="active" _log_ironic_polling /usr/lib/python2.7/site-packages/nova/virt/ironic/driver.py:12214:33
mandrehrybacki: https://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/supplemental/templates/tls_everywhere_provisioner.sh.j2#L3814:35
mandreshould probably be 192.168.23.114:35
jaosoriormandre, hrybacki: The IPA node should be the DNS server for the undercloud and the overcloud nodes.14:35
jaosoriorhrybacki, mandre: The ipa node should have some working DNS server though, so that it can use it as a forwarder, and DNS will work for every node.14:36
hrybackimandre: I ran into issues getting the undercloud to register with FreeIPA using that network14:36
jaosoriorhrybacki: ideally, the IPA DNS should be configurable14:36
lvdombrkrjaosorior: ERROR nova.compute.manager [instance: 30ea888f-655e-4f4a-89a4-c4b765d8f181] InstanceDeployFailure: Failed to provision instance 30ea888f-655e-4f4a-89a4-c4b765d8f181: Timeout reached while waiting for callback for node 8825765a-a40c-4361-9a31-cd7c7a918e6814:37
hrybackijaosorior: that's not a hard change to make. I'm hesitant to tie it to the default undercloud external network (192.168.23.*/24) though14:38
mandrejaosorior, hrybacki: what is 10.11.5.19 anyway? it doesn't respond from the ipa VM14:38
hrybackimandre: the default used for a similar (but different) deployment enhancement to oooq14:38
jaosoriorhrybacki: don't tie it to that, but do make it configurable. mandre could use the google DNS and that wouldn't really matter, as long as it can resolve.14:39
* hrybacki nods14:39
hrybackimandre: I'll make this field configurable and submit a review14:39
mandrejaosorior, hrybacki: ok, I'll give it another try with a public dns server14:40
*** ffiore_ has quit IRC14:40
hrybackiadarazs: can you set https://bugs.launchpad.net/tripleo/+bug/1712081 to triaged and set an importance level please14:41
openstackLaunchpad bug 1712081 in tripleo "SSH connection to supplemental ipa VM takes minutes" [Undecided,Confirmed] - Assigned to Harry Rybacki (hrybacki-h)14:41
*** florianf has joined #tripleo14:41
adarazshrybacki: I can, but why don't you set it to triaged? :)14:46
adarazshrybacki: also you can set the importance to how important it is for you guys.14:46
hrybackiadarazs: I would but I lack the rights on tripleo to do that =/14:47
pradkcan we merge this https://review.openstack.org/#/c/494589/ please14:47
adarazshrybacki: hmm, you should be part of the tripleo group. let me find the URL where you can apply14:48
gfidentesshnaidm any clue how to replicate https://review.openstack.org/494340 in oooq?14:48
sshnaidmgfidente, don't we copy them?14:49
adarazshrybacki: https://launchpad.net/~tripleo -- apply to this team and EmilienM will approve probably fast. :)14:49
*** ffiore_ has joined #tripleo14:50
adarazsmandre: you should probably do the same.14:51
*** rbowen has quit IRC14:51
gfidentesshnaidm where?14:52
*** rbowen has joined #tripleo14:53
sshnaidmgfidente, I mean - we copy container logs, do we have a specific problem with ceph?14:53
gfidentesshnaidm sorry but I am not familiar with the code doing the copy14:53
pabelangermorning14:54
hrybackiadarazs: done!14:54
gfidenteso I am not sure if ceph requires special treatment14:54
hrybackithanks14:54
sshnaidmgfidente, in oooq we copy all container logs14:54
gfidentesshnaidm so where is the copying happening?14:54
gfidenteif it's copying the /var/log/containers/ directory then ceph won't be in there14:54
lvdombrkrguys, someone meet this error? http://paste.openstack.org/raw/618917/14:55
*** ratailor has joined #tripleo14:55
sshnaidmgfidente, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/collect-logs/tasks/collect.yml#L15114:56
*** paramite has quit IRC14:56
*** links has quit IRC14:56
gfidentesshnaidm that should do it14:56
gfidentehttps://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/collect-logs/tasks/collect.yml#L17614:57
gfidenteit was commented out in the tripleo-ci script14:57
gfidentebut I see it's still effective in the oooq yml so, no need to make changes14:57
gfidentethanks sshnaidm :D14:58
*** yamahata has joined #tripleo14:59
*** rlandy is now known as rlandy|mtg15:00
*** oidgar has quit IRC15:01
*** dpawar has joined #tripleo15:01
mandreadarazs: how is tripleo team different from https://launchpad.net/~tripleo-drivers? one if for the core reviewers and the other one for everyone else?15:01
*** mdnadeem has quit IRC15:02
*** dpawar has quit IRC15:02
*** dpawar has joined #tripleo15:03
lvdombrkrguys, someone meet this error? http://paste.openstack.org/raw/618917/15:03
*** ebarrera has quit IRC15:04
jaosoriorshardy, dtantsur: any reason why ComputeCapabilitiesFilter would be returning 0 hosts?15:04
mwhahahajaosorior: compute is disabled on the undercloud15:04
jaosoriorhuh?15:05
mwhahahajaosorior: i've seen this one before and it's annoying15:05
mwhahahajaosorior: for some reason compute gets disable on the undercloud15:05
jaosoriormwhahaha: how does one fix that?15:05
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Introduced tempest_extra_config flag for tempest.conf  https://review.openstack.org/49439415:05
mwhahahajaosorior: check the compute service status15:05
mwhahahajaosorior: there's a command to renable it15:05
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: Make FreeIPA supplemental node DNS server configureable  https://review.openstack.org/49589915:05
mwhahahajaosorior: openstack compute service list and you'll probably see nova-comopute is disabled15:06
* mwhahaha digs up the enable command15:06
*** rcrit has joined #tripleo15:06
jaosoriorrcrit: mwhahaha said: openstack compute service list and you'll probably see nova-comopute is disabled15:06
hrybackimandre: fix is up, need to verify locally15:06
jaosoriorlvdombrkr: ^^15:07
mwhahaharcernin: lvdombrkr: nova-manage service enable nova-compute <undercloud host name>15:07
jaosoriorrcernin: ^^15:07
jaosoriorrcrit: ^^15:07
jaosoriorlol, sorry for the spam rcernin15:08
mandrehrybacki: I saw, just wondering why you're keeping the default to an IP that doesn't respond... wouldn't it be better to use a public DNS?15:08
rcritmine are all up15:08
jaosorioreh shit15:08
jaosorior:(15:08
* mwhahaha runs away then15:08
jaosoriorrcrit: time to remove that filter then :D15:08
mwhahahathat's the last reason why i saw computefilter fail15:08
hrybackimandre: hmm. I'll have to try that outside of our VPN. I've hit issues trying to use public dns from here15:09
*** mwhahaha changes topic to "CI Status: REDish (github is broken) | "you can't land a Cessna with workarounds, so don't try in Quickstart" - TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC here."15:09
jaosoriormwhahaha: Cessna?15:09
hrybackimandre: which public dns would you recommend trying? 8.8.8.8?15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295515:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202915:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]15:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)15:10
mwhahahajaosorior: http://www.edcoatescollection.com/ac3/Civil%20Planes/Cessna%20210E.jpg  that was added for EmilienM a while back :D15:10
mandrehrybacki: not sure which one is the best, I think we got rate limited a few time using 8.8.8.815:10
jaosoriorfunky15:11
mwhahahahrybacki: it's best to use a dns server local to your environment so it depends on where you're running15:11
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Heat]  https://review.openstack.org/49139915:11
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Aodh]  https://review.openstack.org/49141115:11
hrybackimandre: ack. tonight I will confirm that 1) this workflow works 2) I can use a (default) public DNS from outside of the VPN15:11
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mistral]  https://review.openstack.org/49347115:11
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Gnocchi]  https://review.openstack.org/49143315:11
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Add validation task in docker services [Mixed-1]  https://review.openstack.org/49519515:11
hrybackimwhahaha: /me nods -- just trying to think of a 'sane default'15:11
mwhahahahrybacki: there isn't one. honestly we should probably setup a basic dns server on the undercloud15:12
lvdombrkrjaosorior: compute servises are enabled already http://paste.openstack.org/raw/618929/15:12
jaosoriorlvdombrkr: damn :/ ok, then that wasn't the issue15:13
jaosoriorlvdombrkr: seems that you and rcrit might be stumbling upon the same issue15:13
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Make Ansible env variables configurable  https://review.openstack.org/49590015:13
mwhahahalvdombrkr: what does nova-scheduler report as to why it failed? (i might have missed the context previously)15:13
mandrehrybacki: FWIW, using google's DNS I'm now way past the failure of my previous attempts :)15:13
*** axisys has joined #tripleo15:14
hrybackiwoot15:14
*** rcernin has quit IRC15:15
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates master: Add Mistral event engine  https://review.openstack.org/46297515:15
*** yprokule has quit IRC15:16
*** dpawar has quit IRC15:16
lvdombrkrmwhahaha: I find that filter removed instacnes but not sure why: http://paste.openstack.org/raw/618930/15:17
sshnaidmdoes it sound familiar to somebody about a glance? AttributeError: 'NoneType' object has no attribute 'Rados'15:19
mwhahahalvdombrkr: hmm yea not too much info there, might be a question for nova/ironic folks15:19
mwhahahasshnaidm: context?15:19
sshnaidmmwhahaha, failing pingtest in promotion, can't upload cirros to glance: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024/43660e1/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-08-21_08_11_1815:20
chandankumarEmilienM: mwhahaha sshnaidm https://review.openstack.org/493030 and https://review.openstack.org/49439415:20
mwhahahasshnaidm: wonder if we didn't install the rados python stuff15:21
sshnaidmmwhahaha, what is rados..?15:22
chandankumarplease have a look15:22
mwhahahasshnaidm: python-rados.x86_64 : Python libraries for the RADOS object store (ceph stuff)15:22
*** pcaruana has quit IRC15:22
*** cylopez has joined #tripleo15:24
sshnaidmmwhahaha, I see only librados2 installed..15:24
mwhahahasshnaidm: yea probably a question for the storage folks, my assumption would be a missing dependency15:25
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Enable mistral mod_wsgi in undercloud  https://review.openstack.org/45848215:25
numansEmilienM, hi, can you please take a look at this when you get some time - https://review.openstack.org/#/c/468860/24, the CI experimental job is passing. It has a couple of dependent patches - https://review.openstack.org/#/c/495258/ and https://review.openstack.org/#/c/490624/15:25
mwhahahanumans: EmilienM is on PTO this week15:25
numansmwhahaha, ok. thanks for the info. Hope  you can add these patches to your review queue :)15:27
mwhahahanumans: yea I'll take a look15:28
numansmwhahaha, thank you15:28
gfidentejprovazn passed15:28
*** achadha has joined #tripleo15:28
gfidentejprovazn who doesn't need a recheck these days15:29
*** aditya_r has joined #tripleo15:29
*** achadha has quit IRC15:33
*** achadha has joined #tripleo15:34
sshnaidmgfidente, do you know about "Rados" dependencies in glance maybe?15:34
*** limao has joined #tripleo15:34
gfidentesshnaidm hey a little bit15:35
gfidentewhat is the issue?15:35
sshnaidmgfidente, we have a problem: https://bugs.launchpad.net/tripleo/+bug/171210215:35
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]15:35
gfidentewhich job is that?15:35
sshnaidmgfidente, it's all ovb jobs15:35
*** limao has quit IRC15:35
sshnaidmgfidente, with "consistent" repos15:35
gfidenteok sec let me check15:35
gfidentebasically looks like python-rados is not installed15:36
*** limao has joined #tripleo15:36
sshnaidmgfidente, it's not15:36
sshnaidmgfidente, where should we install it..?15:36
gfidentesshnaidm but I want to understand what is going in15:36
gfidentewe have other jobs passing15:37
gfidenteand kolla is installing it in the gnlance-base image so it should be in there15:38
gfidentesshnaidm any clue when did this problem started?15:39
sshnaidmgfidente, this happen in "consistent" repos only, in promotion jobs15:40
sshnaidmgfidente, from 18.08.201715:40
gfidentesshnaidm and those images are built on the 8th?15:41
gfidentesorry, the 18th?15:41
gfidente(the container images)15:41
sshnaidmgfidente, it's not container job15:42
gfidenteah so the issue should be in the baremetal image15:42
gfidentenot kolla15:42
*** dprince has quit IRC15:43
sshnaidmgfidente, mwhahaha hmm.. I wonder if this was a problem: https://review.openstack.org/#/c/495787/15:44
*** aditya_r has quit IRC15:44
mwhahahasshnaidm: it's possible, but shouldn't the build process fail if it can't install a dep? or is it just getting an older one15:44
lvdombrkrany other ideas about this issue? http://paste.openstack.org/raw/618917/15:44
*** fultonj has joined #tripleo15:44
numansmwhahaha, thanks for the review.15:45
*** fultonj has quit IRC15:45
sshnaidmmwhahaha, basically should..15:47
*** aufi has joined #tripleo15:47
*** owalsh has quit IRC15:49
bnemeclipsemwhahaha: It depends on whether it's a dep of something that is installed.  Yum will happily report success if it can't find a package you specify on the command-line.15:51
bnemeclipseSo if I do "yum install python-tripleoclient something-that-doesnt-exist" yum may still return 0 as long as it could install python-tripleoclient.15:51
mwhahahahmmm15:51
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Deploy Mistral with Keystone v3 options (authtoken)  https://review.openstack.org/47614415:51
mwhahahasounds problematic15:52
bnemeclipseIt's bitten us several times in the past, so it wouldn't surprise me if that's what is going on here.15:52
*** mwhahaha changes topic to "CI Status: YELLOWish (github was broken) | "you can't land a Cessna with workarounds, so don't try in Quickstart" - TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC here."15:52
mwhahahaseems like yum needs a --detailed-status-codes :D15:53
bnemeclipseEvery time an application uses a non-zero exit code to report success an angel loses its wings.15:54
bnemeclipseThat's how that saying goes, right? ;-)15:54
mwhahahawell considering the user might not think it was a sucess, sure :D15:55
sshnaidmwow, I thought github didn't work for me only15:55
mwhahahastatus.github.com they had some problems ~1hr ago15:55
mwhahahashould be clear now15:55
bnemeclipseYeah, it's working for me again anyway.15:56
*** aditya_r has joined #tripleo15:57
lvdombrkrany other ideas about this issue? http://paste.openstack.org/raw/618917/15:58
*** ffiore has joined #tripleo15:58
*** ffiore_ has quit IRC15:59
*** jlinkes has quit IRC16:01
*** bnemeclipse has quit IRC16:04
*** noslzzp has joined #tripleo16:04
*** bnemec has joined #tripleo16:06
*** bnemec is now known as bnemeclipse16:06
*** itlinux has joined #tripleo16:07
*** itlinux has quit IRC16:08
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202916:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210216:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]16:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)16:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]16:10
*** iranzo has quit IRC16:11
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add nova metadata to TLS everywhere/docker services list  https://review.openstack.org/49591716:12
*** egonzalez has quit IRC16:13
*** owalsh has joined #tripleo16:13
*** dprince has joined #tripleo16:14
ansiwentrown: I wanted to enable realtime-sceduling for the compute-vm from the stack user, but it says: "error: Cannot set scheduler parameters for pid 25619: Operation not permitted"16:17
ansiwentrown: any idea, how I can give the stack user the necessary permissions?16:17
trownansiwen: hmm not sure... cant do it with sudo because of session vm?16:18
lvdombrkrany other ideas about this issue? http://paste.openstack.org/raw/618917/?16:18
ansiwentrown: you mean I should start the vm with sudo? will it find the stack-user session then?16:18
*** itlinux has joined #tripleo16:18
*** ffiore has quit IRC16:18
ansiwentrown: the compute vm belongs to the stack user session, right?16:19
trownansiwen: I guess I dont understand how one enables realtime-scheduling16:19
trownansiwen: ya it is session vm16:19
ansiwentrown: so you mean I should point a root virsh to the stack user session?16:19
trownansiwen: well... not sure that will work either. it is possible the realtime-scheduling is not compatible with session vms16:20
ansiwentrown: I did "virsh edit compute_0" and added cputune configs16:20
*** SlickNik has quit IRC16:20
*** SlickNik has joined #tripleo16:23
*** jlabarre has quit IRC16:25
*** dougbtv_ has joined #tripleo16:26
*** lucasagomes is now known as lucas-afk16:27
*** limao has quit IRC16:27
*** jlabarre has joined #tripleo16:27
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404316:29
openstackgerritJakub Libosvar proposed openstack/os-net-config master: Delete controller for standalone OVS bridges  https://review.openstack.org/49591916:30
*** funzo has joined #tripleo16:30
*** rlandy|mtg is now known as rlandy16:32
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC Isilon Manila Driver  https://review.openstack.org/48888916:33
*** funzo has quit IRC16:35
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404316:35
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC Isilon Manila Driver  https://review.openstack.org/48888916:35
weshayarxcruz, don't forget those lp bugs :)16:37
*** jaganathan has quit IRC16:38
*** ratailor has quit IRC16:38
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Enable mistral mod_wsgi in undercloud  https://review.openstack.org/45848216:39
*** dougbtv_ has quit IRC16:41
*** aufi has quit IRC16:42
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Enable mistral mod_wsgi in undercloud  https://review.openstack.org/45848216:43
*** fpan has quit IRC16:44
lvdombrkrany other ideas about this issue? http://paste.openstack.org/raw/618917/?16:45
*** jpich has quit IRC16:48
openstackgerritAndy Smith proposed openstack/tripleo-common master: Add Qdrouterd to the overcloud containers  https://review.openstack.org/49188916:49
*** stendulker has joined #tripleo16:50
gfidentelvdombrkr I'd check in the undercloud nova-compute nova-scheduler and ironic logs16:51
*** cylopez has quit IRC16:51
gfidentein one of them you'll probably find the error which is preventing nodes from starting16:52
*** links has joined #tripleo16:52
*** ecerquei_ has joined #tripleo16:54
lvdombrkrgfidente: 2017-08-21 19:37:36.700 73339 WARNING ironic.conductor.utils [req-b3f818c9-8f6a-4438-b3c0-a66743f62a4a a7db71b6fa23403aa6bfd3014001035a 3762398686ad40f799aaa607b78c6f92 - - -] Not going to change node 8825765a-a40c-4361-9a31-cd7c7a918e68 power state because current state = requested state = 'power off'.16:54
lvdombrkrgfidente: this can be the reason?16:55
gfidentelvdombrkr so looks like just a WARNING16:55
gfidentetrying to power off a node which is already off apparently16:55
gfidenteI am sorry but I am going AFK for a while16:55
*** ecerquei has quit IRC16:56
gfidentethough I think in one of those logs you should find the ERROR which prevents the overcloud nodes from starting16:56
lvdombrkrgfidente: okey thnak you ;)16:56
jprovazngfidente, cool!16:56
gfidentejprovazn yeah we're in the third part of august16:57
gfidentethings are cooling down here too16:57
gfidentettyt!16:57
openstackgerritBrad P. Crochet proposed openstack/instack-undercloud master: Deploy Mistral with Keystone v3 options (authtoken)  https://review.openstack.org/47614416:58
*** derekh has quit IRC17:00
*** gfidente has quit IRC17:01
*** ebarrera has joined #tripleo17:01
*** pchavva has quit IRC17:01
*** rcernin has joined #tripleo17:05
*** aditya_r has quit IRC17:05
*** links has quit IRC17:06
*** shardy has quit IRC17:07
*** aditya_r has joined #tripleo17:08
*** milan has quit IRC17:08
*** achadha has quit IRC17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295517:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171202917:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210217:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1712029 in tripleo "build-image roles is not adding qemu repo to images in periodic jobs" [Critical,In progress] - Assigned to Alfredo Moralejo (amoralej)17:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]17:10
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VMAX ISCSI Backend  https://review.openstack.org/48939317:10
*** mcornea has quit IRC17:13
openstackgerritMerged openstack/tripleo-heat-templates master: TLS for containerized horizon  https://review.openstack.org/49498917:13
*** florianf has quit IRC17:14
openstackgerritJuan Badia Payno proposed openstack/tripleo-quickstart master: Handle undercloud autostart dependant on ansible version  https://review.openstack.org/49582717:21
*** fpan has joined #tripleo17:22
openstackgerritMerged openstack/tripleo-heat-templates master: Let mds create manila key and fs  https://review.openstack.org/48249617:22
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Increase the flavor size of the baremetal and undercloud nodes  https://review.openstack.org/49593517:27
*** yamahata has quit IRC17:28
*** jpena is now known as jpena|off17:28
*** tosky has quit IRC17:28
*** trown is now known as trown|lunch17:31
*** dciabrin has quit IRC17:33
*** dciabrin has joined #tripleo17:33
*** pchavva has joined #tripleo17:37
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add quickstart-* repos to build-images role  https://review.openstack.org/49578717:44
*** achadha has joined #tripleo17:44
*** achadha has quit IRC17:44
*** achadha has joined #tripleo17:44
*** amoralej is now known as amoralej|off17:45
*** gvrangan_odl has joined #tripleo17:46
*** bnemeclipse has quit IRC17:49
*** bogdando has quit IRC17:49
*** fpan has quit IRC17:51
*** yamahata has joined #tripleo17:58
*** dtantsur is now known as dtantsur|afk18:01
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add /root/.cache/image-create to cleanup role  https://review.openstack.org/47935618:03
openstackgerritMerged openstack/tripleo-heat-templates master: Add logrotate with crond service  https://review.openstack.org/49005018:04
openstackgerritIan Main proposed openstack/tripleo-common master: Set healthchecks executable.  https://review.openstack.org/49594418:07
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295518:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210218:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]18:10
*** tosky has joined #tripleo18:12
*** funzo has joined #tripleo18:16
*** rlandy is now known as rlandy|biab18:16
openstackgerritAthlan-Guyot sofer proposed openstack/python-tripleoclient master: Consume new RoleConfig data in config download  https://review.openstack.org/48573218:18
*** funzo has quit IRC18:20
*** jlabarre has quit IRC18:21
*** aditya_r has quit IRC18:22
*** jlabarre has joined #tripleo18:22
*** stendulker has quit IRC18:27
*** trown|lunch is now known as trown18:30
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Add support for updating initramfs images in CI  https://review.openstack.org/47990018:32
*** catintheroof has joined #tripleo18:32
*** noslzzp has quit IRC18:33
*** salmankhan has quit IRC18:34
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Render port templates via j2  https://review.openstack.org/49536718:43
*** bnemec has joined #tripleo18:51
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49540718:51
*** ebarrera has quit IRC18:51
openstackgerritMerged openstack/instack-undercloud master: Adds execution of post-upgrade validations on undercloud upgrade  https://review.openstack.org/47457818:54
*** rlandy|biab is now known as rlandy18:54
openstackgerritMerged openstack/tripleo-heat-templates master: TLS everywhere/haproxy: Remove empty postsave command  https://review.openstack.org/49528818:55
mwhahahalooks like ovb jobs are just timing out now19:05
*** Lokesh_Jain__ has joined #tripleo19:06
Lokesh_Jain__Hi.. Can somebody please take a look at cherry-picks: https://review.openstack.org/#/c/492224 and https://review.openstack.org/#/c/49224519:06
*** iranzo has joined #tripleo19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295519:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210219:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]19:10
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC Unity Manila Driver  https://review.openstack.org/49058119:11
pabelangermwhahaha: has anybody looked into why yet?19:14
mwhahahaprobably not19:14
pabelangermwhahaha: the gate pipeline looks very good today.19:14
mwhahahayea seems to be just ovb19:14
mwhahahasome pingtest timeouts and some other timeouts19:15
mwhahaharajinir: please rebase the puppet-tripleo patches on eachother so we can land them all19:16
*** funzo has joined #tripleo19:16
mwhahaharajinir: otherwise everytime we land one the others will conflict19:17
openstackgerritMichele Baldessari proposed openstack/tripleo-validations master: Do not output empty variables in inventory  https://review.openstack.org/49596519:17
*** catintheroof has quit IRC19:17
*** iranzo has quit IRC19:19
*** funzo has quit IRC19:21
*** jtomasek has quit IRC19:21
*** atoth has quit IRC19:22
rcritlvdombrkr, did you ever figure out why you were getting No hosts? I'm seeing the same thing and so far I haven't found anything useful in the logs19:26
*** noslzzp has joined #tripleo19:27
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC VNX Manila Driver  https://review.openstack.org/49064219:29
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VMAX Manila Backend  https://review.openstack.org/49109419:31
*** jtomasek has joined #tripleo19:31
openstackgerritRajini Karthik proposed openstack/tripleo-heat-templates master: Add support for Dell EMC VNX Manila Backend  https://review.openstack.org/49108819:33
*** ansmith has quit IRC19:34
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Configure mistral event engine container  https://review.openstack.org/49596619:37
openstackgerritBrad P. Crochet proposed openstack/tripleo-heat-templates master: Add Mistral event engine  https://review.openstack.org/46297519:38
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add containers periodic test  https://review.openstack.org/47574719:48
*** pchavva has quit IRC19:51
*** ebarrera has joined #tripleo19:55
bnemecmwhahaha: Hmm, that's interesting.  I'm seeing pingtest timeouts locally too.  Although I think I stood this environment up on Friday.19:55
bnemecThe only thing I've found so far is an error in the Neutron logs: AttributeError: 'function' object has no attribute 'accepted_namespaces'19:56
mwhahahaodd19:56
*** bnemec is now known as bnemeclipsed19:57
bnemeclipsedFull disclosure, I'm also testing a non-standard ssl configuration, but this doesn't appear to be related to that.19:58
*** jtomasek has quit IRC19:58
bnemeclipsedI don't see the same thing in the ci logs either, so maybe unrelated.20:01
*** jprovazn has quit IRC20:03
*** salmankhan has joined #tripleo20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210220:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]20:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]20:10
*** jlabarre has quit IRC20:12
arxcruzweshay: already opened https://bugs.launchpad.net/tripleo/+bug/171209820:12
openstackLaunchpad bug 1712098 in tripleo "Periodic master tempest job with 107 failures" [Critical,New] - Assigned to Arx Cruz (arxcruz)20:12
*** thrash is now known as thrash|bbl20:17
weshayarxcruz, added triaged, tags= alert ci20:19
weshayarxcruz, for the escalation20:19
*** jcoufal has quit IRC20:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-validations master: Make sure to keep case when for host definition in host inventory.  https://review.openstack.org/49597520:25
*** dparkes has joined #tripleo20:29
*** jlabarre has joined #tripleo20:29
*** jfrancoa has quit IRC20:30
*** dparkes has quit IRC20:30
*** paramite has joined #tripleo20:32
dhill_hi guys !20:33
dhill_what could cause a NetworkDeployment to have the following config:  "config": "<html><h1>Bad Request</h1><p>The server could not comply with the request since it is either malformed or otherwise incorrect.</p></html>", ?20:33
*** fpan has joined #tripleo20:34
*** jkilpatr has quit IRC20:35
*** dparkes has joined #tripleo20:37
*** sbrzozow has joined #tripleo20:39
*** salmankhan has quit IRC20:39
*** paramite has quit IRC20:42
*** bnemeclipsed has quit IRC20:45
*** rcernin has quit IRC20:47
*** Goneri has quit IRC20:56
*** abishop has quit IRC20:59
*** trown is now known as trown|outtypewww21:02
openstackgerritMerged openstack/tripleo-quickstart-extras master: Support initramfs images in modify-image role  https://review.openstack.org/47989621:02
pabelangerdhill_: do you have a log?21:06
*** sbrzozow has quit IRC21:06
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295521:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171209821:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210221:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1712098 in tripleo "Periodic master tempest job with 107 failures" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)21:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]21:10
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49540721:16
*** ansmith has joined #tripleo21:16
*** funzo has joined #tripleo21:17
*** noslzzp has quit IRC21:18
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49540721:18
*** funzo has quit IRC21:22
*** morazi has quit IRC21:22
*** dsariel has quit IRC21:26
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Generalize OVB settings to fit feature set pattern  https://review.openstack.org/49540521:27
*** dprince has quit IRC21:40
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Filter image list by deployed services  https://review.openstack.org/49476721:44
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Filter image list by deployed services  https://review.openstack.org/49476721:45
*** akrivoka has quit IRC21:46
*** jkilpatr has joined #tripleo21:53
*** ecerquei_ has quit IRC21:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260722:00
*** gvrangan_odl has quit IRC22:01
*** thrash|bbl is now known as thrash22:04
*** dparkes has quit IRC22:05
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295522:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171209822:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210222:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1712098 in tripleo "Periodic master tempest job with 107 failures" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)22:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]22:10
*** itlinux has quit IRC22:14
openstackgerritMichael Bayer proposed openstack/puppet-tripleo stable/newton: Enable innodb_buffer_pool_size configuration  https://review.openstack.org/49057822:14
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Deprecate --pull-source for container prepare command  https://review.openstack.org/49436622:15
*** tzumainn has quit IRC22:30
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170295523:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171209823:10
openstackLaunchpad bug 1702955 in tripleo "tripleo upgrade jobs timeout on stable/ocata" [Critical,Triaged]23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171210223:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1712098 in tripleo "Periodic master tempest job with 107 failures" [Critical,Triaged] - Assigned to Arx Cruz (arxcruz)23:10
openstackLaunchpad bug 1712102 in tripleo "CI: glance on overcloud fails with AttributeError: 'NoneType' object has no attribute 'Rados'" [Critical,Triaged]23:10
*** tosky has quit IRC23:16
pabelangergate-tripleo-ci-centos-7-undercloud-oooq is 100% today in the gate23:16
pabelangeronly 6 runs however23:16
*** sshnaidm is now known as sshnaidm|off23:18
*** cschwede_ has joined #tripleo23:21
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC Unity Manila Driver  https://review.openstack.org/49058123:23
*** cschwede has quit IRC23:23
*** catintheroof has joined #tripleo23:29
*** rlandy is now known as rlandy|bbl23:44
openstackgerritMerged openstack/puppet-tripleo master: Do not create fs and server side key from manila  https://review.openstack.org/48250123:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!