Monday, 2018-07-23

*** agopi has joined #tripleo00:07
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226700:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259800:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]00:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)00:10
openstackgerritMerged openstack/tripleo-heat-templates master: Add a ComputePPC64LE role  https://review.openstack.org/54024100:33
*** wolverineav has joined #tripleo00:49
*** bdodd has quit IRC00:54
*** wolverineav has quit IRC00:54
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226701:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259801:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]01:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)01:10
*** edmondsw has joined #tripleo01:11
*** Petersingh has joined #tripleo01:15
*** edmondsw has quit IRC01:15
*** mrsoul has joined #tripleo01:16
*** mrsoul` has quit IRC01:19
*** bfournie has quit IRC01:37
*** bfournie has joined #tripleo01:38
*** bfournie has quit IRC01:42
*** lblanchard has quit IRC01:52
*** tristanC has joined #tripleo01:58
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226702:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259802:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]02:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)02:10
*** akhilaki_ has joined #tripleo02:11
*** akhilaki has quit IRC02:11
*** akhilaki_ has quit IRC02:12
*** akhilaki has joined #tripleo02:12
*** psachin has joined #tripleo02:49
*** brault has quit IRC02:54
*** brault has joined #tripleo02:55
*** dhill_ has quit IRC02:56
*** edmondsw has joined #tripleo02:59
*** bdodd has joined #tripleo03:00
*** edmondsw has quit IRC03:04
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226703:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259803:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)03:10
*** Petersingh is now known as Petersingh|afk03:18
*** psachin has quit IRC03:22
openstackgerritSteve Baker proposed openstack/tripleo-common master: Action to perform container image prepare  https://review.openstack.org/55897203:34
*** pdeore has joined #tripleo03:37
*** psachin has joined #tripleo03:39
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare  https://review.openstack.org/57347603:40
*** psahoo has joined #tripleo03:48
*** akhilaki has quit IRC03:51
*** slaweq has quit IRC03:52
*** Haresh has joined #tripleo03:55
*** udesale has joined #tripleo03:55
*** marrusl has joined #tripleo03:59
*** jaganathan has joined #tripleo03:59
*** slaweq has joined #tripleo03:59
*** jaganathan has quit IRC04:04
*** jaganathan has joined #tripleo04:05
*** mdnadeem has joined #tripleo04:06
*** Petersingh|afk is now known as Petersingh04:07
*** ykarel has joined #tripleo04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226704:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259804:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]04:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)04:10
*** ramishra has joined #tripleo04:20
*** mburned is now known as mburned_out04:26
*** Haresh has quit IRC04:38
*** shreshtha has joined #tripleo04:40
*** owalsh has quit IRC04:43
*** cmyster has quit IRC04:47
*** edmondsw has joined #tripleo04:47
*** Petersingh is now known as Petersingh|afk04:51
*** edmondsw has quit IRC04:52
*** janki has joined #tripleo04:54
openstackgerritMerged openstack/puppet-tripleo stable/pike: Added new parameter: $activate_httplog  https://review.openstack.org/58450904:59
openstackgerritMerged openstack/puppet-tripleo stable/pike: Let haproxy_defaults be overridable  https://review.openstack.org/58451004:59
openstackgerritMerged openstack/puppet-tripleo master: Add ODL puppet lib functions to zuul path  https://review.openstack.org/58324504:59
openstackgerritMerged openstack/puppet-tripleo stable/pike: Enforce proper ordering when applying firewall rules  https://review.openstack.org/58310704:59
openstackgerritMerged openstack/puppet-tripleo master: Remove unused code in ovn dbs bundle to set the sysctl value  https://review.openstack.org/58252304:59
openstackgerritMerged openstack/tripleo-ui master: Add release note link in README  https://review.openstack.org/57869104:59
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/58199504:59
*** pgadiya has joined #tripleo05:02
*** janki has quit IRC05:03
*** janki has joined #tripleo05:04
*** skramaja has joined #tripleo05:06
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Use tempest user with tempest container  https://review.openstack.org/58396105:06
*** brault_ has joined #tripleo05:07
*** brault has quit IRC05:09
Tenguhello there05:10
*** cmyster has joined #tripleo05:10
*** cmyster has joined #tripleo05:10
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226705:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259805:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]05:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)05:10
*** cmyster has quit IRC05:11
*** brault has joined #tripleo05:11
*** skramaja_ has joined #tripleo05:11
*** cmyster has joined #tripleo05:11
*** cmyster has joined #tripleo05:11
*** skramaja has quit IRC05:11
*** brault_ has quit IRC05:13
*** Petersingh|afk is now known as Petersingh05:13
*** ratailor has joined #tripleo05:21
openstackgerritSaravanan KR proposed openstack/tripleo-quickstart master: DO NOT MERGE: Test boot params  https://review.openstack.org/58282905:24
*** Petersingh is now known as Petersingh|afk05:25
*** brault has quit IRC05:30
*** cshastri has joined #tripleo05:37
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add a OpenShift on OpenStack HW validation  https://review.openstack.org/57574905:37
*** links has joined #tripleo05:38
*** udesale_ has joined #tripleo05:42
*** udesale has quit IRC05:45
*** avivgt has joined #tripleo05:46
*** quiquell|off is now known as quiquell05:48
jaganathanTengu, hi05:52
openstackgerritCédric Jeanneret proposed openstack/tripleo-specs master: Validation Framework specifications.  https://review.openstack.org/58347505:57
Tengujaganathan: heya!05:58
jaganathanTengu, Regarding https://review.openstack.org/#/c/572678/ comments05:58
jaganathanTengu, my env only management network has enable status true http://paste.openstack.org/show/726417/05:59
chkumar|ruckmandre: Hello05:59
chkumar|ruckmandre: my tempest user patch broke tripleo tempest https://bugs.launchpad.net/tripleo/+bug/178305505:59
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where tempest is runned from container" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)05:59
chkumar|ruckmandre: I need some help05:59
jaganathanTengu, is that fine having only enabled networks for the current network instead of current_networks[0]05:59
jaganathan?05:59
*** pgadiya has quit IRC06:00
Tengujaganathan: hmm wait. have to dig back into this.06:00
*** sanjayu has joined #tripleo06:01
*** psachin has quit IRC06:01
Tengujaganathan: it's for the overcloud right? I'm mixing up things06:01
jaganathanTengu, yes06:01
Tengujaganathan: the name of the external network isn't hard coded right?06:02
*** psachin` has joined #tripleo06:02
Tengui.e. in your case, it's called "External", but I don't think we can ensure this is the right name for everyone..?06:02
jaganathanTengu, yes06:03
*** jfrancoa has joined #tripleo06:03
Tenguhumpf06:03
*** ksambor has joined #tripleo06:04
Tengujaganathan: so we must in some way access ExternalIpSubnet value directly I guess?06:05
Tenguelse we're pretty lost.06:05
Tenguor ExternalNetCidr or ExternalAllocationPools - anyway, this might be the right way.06:06
*** pmannidi has quit IRC06:06
jaganathanTengu, need to change the logic to use ExternalIpSubnet, instead of getting from list of networks06:06
jaganathan?06:06
Tengujaganathan: maybe not. wait, still digging.06:07
*** Petersingh|afk is now known as Petersingh06:07
*** ksambor has quit IRC06:08
Tengujaganathan: another solution might be to access ExternalNetName, and filter out the network list based on that value, as we have "name" and "name_lower" in the hash entries.06:09
Tengujaganathan: probably the best way to do that, as we still get access to the full hash in the end.06:09
*** yprokule has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226706:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259806:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305506:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)06:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where tempest is runned from container" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)06:10
jaganathanTengu,             "name_lower": "external",06:10
jaganathanbut enable status is missing06:11
jaganathanno enabled filed06:11
jaganathan*field06:11
*** jtomasek has joined #tripleo06:12
Tengufilter it then.06:12
Tengui.e. we want a network matching ExternalNetName name, AND enabled06:12
Tenguit we have an empty set, then no external/public network06:12
*** jtomasek has quit IRC06:13
jaganathanTengu, any check needs to be added like using enabled field is true or not to get external network.06:13
*** mschuppert has joined #tripleo06:13
*** ksambor has joined #tripleo06:13
jaganathanTengu, then if no network found, will fail to derive fixed IP, is that fine?06:13
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add a OpenShift on OpenStack HW validation  https://review.openstack.org/57574906:13
*** brault has joined #tripleo06:14
Tengujaganathan: slagle comment concerns the function determining if we're using network isolation - so it will return false if no enabled external network is found06:14
jaganathanTengu, oh, will exclude if any network is having enabled filed value 'false'06:15
*** agurenko has joined #tripleo06:15
jaganathan*field06:15
Tengueither "enabled == false" or "enabled not in keys()"06:15
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Fix network config conflicts for containerized UC  https://review.openstack.org/58250806:16
Tenguguess no "enabled" means "false" by default.06:16
*** bogdando has joined #tripleo06:17
jaganathanTengu, if so http://paste.openstack.org/show/726417/  having only management network is enabled, remaining are disabled. then no network found for external06:17
jaganathanTengu, is this expected scenario?06:18
*** ksambor has quit IRC06:18
jaganathanthis case will fail to derive fixed ip and raises error message that no external network found06:18
Tengujaganathan: hmm. I wondering if the comment is relevent at all in fact.06:19
Tenguwe don't want to get anything from that current_networks in fact. Just check if it has something in it. Maybe the check should be more something like "len(current_network) > 1) or something like that, in order to ensure we are using network isolation.06:20
Tenguthe VIP is calculated from the actual ExternalAllocationPools directly.06:20
Tenguin another method, line 52106:20
Tengujaganathan: might be better to check with slagle directly?06:21
jaganathanTengu, yes, this logic to check whether network isolation is used06:21
mandrechkumar|ruck: hi, looking06:21
jaganathanTengu, if not used, then also logic to derive it06:21
*** ksambor has joined #tripleo06:23
jaganathanTengu, ok06:23
mandrechkumar|ruck: who do the /home/zuul/tempest directory belongs to on the host?06:23
jaganathanTengu, i am also confused06:23
chkumar|ruckmandre: yes it is on the host undercloud06:24
mandrechkumar|ruck: you probably need a task that changes the ownership to the tempest user from _inside_ the container06:24
mandrechkumar|ruck: what is the ownership of /home/zuul/tempest?06:24
chkumar|ruckmandre: it is the stack user owning the tempest directory06:25
chkumar|ruckmandre: I create temepst directory on undercloud06:25
chkumar|ruckmandre: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/configure-tempest.sh.j2#L4306:26
chkumar|ruckmandre: and here is the list of files moutning https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/run-tempest.sh.j2#L4806:26
mandrechkumar|ruck: ok, so either you relax the perms on /home/zuul/tempest or you change the ownership to the tempest user from inside the container06:27
*** nyechiel has joined #tripleo06:28
mandrein that case, you would need to run a docker command in your configure-tempest.sh script06:28
mandresame principle as what we're doing at https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/tempest.yaml#L50-L5606:29
chkumar|ruckmandre: we need to mount a volume which owns the tempest user permission?06:29
*** jtomasek has joined #tripleo06:30
chkumar|ruckmandre: the thing is that, we are mount lots of files with container06:30
mandrechkumar|ruck: you need to mount /home/zuul/tempest in a container running the tempest image, and change the ownership to the tempest user06:31
mandrechkumar|ruck: the docker command will look like06:31
mandredocker run --volume /home/zuul/tempest:/tempest_dir --user root 'chown -R tempest:tempest /tempest_dir'06:34
mandredocker run --volume /home/zuul/tempest:/tempest_dir --user root your_tempest_image 'chown -R tempest:tempest /tempest_dir'06:34
Tengujaganathan: the right guy who can answer is jaosorior, but apparently he's still on PTO, at least today. Not sure when he'll be back -.-'06:34
mandre^^ chkumar|ruck06:34
chkumar|ruckmandre: trying out06:34
jaganathanTengu, ok06:35
*** edmondsw has joined #tripleo06:35
Tengujaganathan: I was just helping at that time, trying to understand how it was to be launched and so on -.-'.06:35
Tengubut I'd say we don't really care about the content returned by the commented line - we just want to ensure there's actually "something"06:36
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP abstract container backend away  https://review.openstack.org/58466106:37
*** ccamacho has joined #tripleo06:39
*** edmondsw has quit IRC06:39
*** links has quit IRC06:41
*** udesale__ has joined #tripleo06:43
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add a OpenShift on OpenStack HW validation  https://review.openstack.org/57574906:43
*** udesale_ has quit IRC06:45
*** dtantsur|afk is now known as dtantsur06:45
*** paramite has joined #tripleo06:50
bogdandojfrancoa, marios: hi, do you know from which place overcloud_release and _templates* get values for fs51 http://logs.openstack.org/15/583515/3/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/9b73b05/logs/undercloud/var/log/extra/dump_variables_vars.json.txt.gz ?06:55
*** Petersingh is now known as Petersingh|afk06:55
*** jaosorior has joined #tripleo06:55
bogdandoI do not see those defined in featureset, while other fs have those set explicitly06:56
jaosoriorGood day folks!06:56
jfrancoabogdando: let me check06:56
bogdandohi jfrancoa06:56
bogdandohi jaosorior :)06:56
jfrancoabogdando: hey o/06:56
*** ffiore has joined #tripleo06:58
*** nyechiel_ has joined #tripleo06:58
jfrancoabogdando: It takes the values from the release file in tripleo-quickstart https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master-undercloud-queens-overcloud.yml06:58
bogdandojfrancoa: I'm updating config/general_config/featureset051.yml in https://review.openstack.org/#/c/583515/  as https://review.openstack.org/#/c/465047/ does not set up custom UC tht for mixed cases, so just wondering if I have to put it like https://pastebin.com/TsV7gZjC or just the last 206:58
*** nyechiel has quit IRC06:58
bogdandooh well, then we only need to update that file06:59
jfrancoabogdando: yes, that would be the perfect place for it06:59
*** links has joined #tripleo07:00
*** florianf has joined #tripleo07:00
jfrancoabogdando: we were discussing about improving the releases definition for the overcloud-undercloud so we wouldn't need to depend on these release files, but we are not there yet07:00
*** zoli is now known as zli|wfh07:00
*** holser_ has joined #tripleo07:00
*** zli|wfh is now known as zoli|wfh07:00
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Enable containerized undercloud in scenario000-upgrades.  https://review.openstack.org/58351507:02
bogdandojfrancoa: updated07:02
*** pcaruana has joined #tripleo07:02
jfrancoabogdando: thanks, I will have a look at the patches in a while when I start with the Monday morning reviews, but first....coffee!07:03
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Unify custom t-h-t install steps for UC/OC/upgrade  https://review.openstack.org/46504707:04
*** Petersingh|afk is now known as Petersingh07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226707:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259807:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305507:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]07:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)07:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where tempest is runned from container" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)07:10
*** zoli|wfh is now known as zoli07:11
*** cylopez has joined #tripleo07:11
*** amoralej|off is now known as amoralej07:13
*** jpich has joined #tripleo07:13
bogdandochkumar|ruck: hi, do we have tempest cases running VMs in CI? Just wondering if https://review.openstack.org/#/c/584380 had improved things for those.07:14
bogdandoI hope it did :)07:15
*** skramaja has joined #tripleo07:16
*** skramaja_ has quit IRC07:20
*** numans has quit IRC07:20
*** Haresh has joined #tripleo07:21
*** numans has joined #tripleo07:21
*** tesseract has joined #tripleo07:21
*** quiquell is now known as quiquell|bbl07:22
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add a networking check for OpenShift on OpenStack  https://review.openstack.org/58164407:25
*** akrivoka has joined #tripleo07:27
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add a networking check for OpenShift on OpenStack  https://review.openstack.org/58164407:29
*** ksambor has quit IRC07:29
jaosoriorlhinds: sup dude!07:29
*** ksambor has joined #tripleo07:29
bandinijaosorior: welcome back, dude!07:34
*** links has quit IRC07:34
*** tosky has joined #tripleo07:36
Tengubandini: heya! care to validate this review? https://review.openstack.org/#/c/583886/07:37
Tengubandini: I can update the check in order to get rid of the "socat" call - I think it would be best.07:37
bandiniack let me take a proper look07:38
*** ykarel is now known as ykarel|lunch07:38
Tenguthank you :)07:38
*** leanderthal has joined #tripleo07:40
*** tvignaud has quit IRC07:41
bogdandobandini: hi, replied to https://review.openstack.org/#/c/584460/07:41
bandinibogdando: ah thanks, exactly what I wanted to know (/me still super behind on containerized UC)07:44
bogdandoit just like containerized overcloud, bandini no special patterns to apply for inter-services dependencies :)07:45
bogdandoexcept that no pacemaker ;(07:46
*** links has joined #tripleo07:47
bogdandobandini: I hope we can leave the rabbitmq steps as is, but adjust those for docker/services/keepalived.yaml07:48
bandinibogdando: I hope so too :)07:48
bogdandoor just let kill keepalived haha07:48
bandinieheh07:48
Tenguhmm there was a thread about that :D07:49
bogdandoit seems rabbit container (nonHA) uses step1 order 2, not much space to inject things :D07:50
mariosbogdando: o/ sorry for late but as jfrancoa said. fwiw it doesn't apply to the job you pointed at (seems it isn't enabled there yet) but releases are getting set by the emit_release_file like e.g. http://logs.openstack.org/15/583515/3/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/f6736a3/logs/releases.sh http://logs.openstack.org/15/583515/3/check/tripleo-ci-centos-7-containers-multinode-queens/f25c02e/logs/releases.sh etc and mo07:50
mariosbogdando: doesnt apply to the _templates though07:50
bogdandobandini: hm, so rabbit has step1, oder2, and KA has step1, order007:51
bogdandoit shall not race already07:51
bogdandonoth to fix07:51
bogdandomarios: thanks for the info! Seems like not affecting the update I posted for https://review.openstack.org/#/c/583515/ ?07:52
bandinibogdando: ah perfect!07:52
*** quiquell|bbl is now known as quiquell07:52
mariosbogdando: right it doesn't apply to the job you pointed at if you are interested in that specifically07:53
jaosoriorbandini: thanks!07:53
bogdandomarios: ok, thanks07:54
jfrancoamarios: I didn't know of the existence of that releases.sh, does it take the values from the config/release/ files? or where from?07:55
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates master: [DNM] Test review  https://review.openstack.org/58317907:56
bogdandomagic! :)07:56
*** tvignaud has joined #tripleo07:56
quiquelljfrancoa, marios: releases.sh is generated reading, featureset and release07:58
quiquellmarios, jfrancoa: Do we have an issue with emit_releases_file.py ?07:58
mariosquiquell: no08:01
bogdandoquiquell: I think we do not, just asked if I understood the job defaults dumped http://logs.openstack.org/15/583515/3/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/9b73b05/logs/undercloud/var/log/extra/dump_variables_vars.json.txt.gz right08:01
bogdandoand it seems clear now08:01
quiquellmarios, bogdando: ack08:01
Tengubandini: thanks for your comment :). I'll propose a change in t-h-t.08:03
bogdandoTengu++08:04
Tengubandini: care to put a w+1?08:04
bandininp :) thanks for reminding me08:04
bandinionce rdo is green I'll +W08:05
Tengubandini: hmmm will RDO be green one day?08:05
* Tengu runs away08:05
bandini:) it is so much better than it used to be08:05
*** kopecmartin has joined #tripleo08:06
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Update/correct vrrp check for haproxy  https://review.openstack.org/58475408:07
Tengubogdando: ah, thanks for the check-rdo :)08:07
Tengubandini: -^^  change in t-h-t08:07
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226708:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259808:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305508:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)08:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where tempest is runned from container" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)08:10
*** Petersingh is now known as Petersingh|lunch08:12
*** dtantsur is now known as dtantsur|brb08:18
*** chem has joined #tripleo08:18
Tengubandini: answered to your comments, thanks!08:20
*** owalsh has joined #tripleo08:22
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Update/correct vrrp check for haproxy  https://review.openstack.org/58475408:22
Tenguah, guess we can just put the change ID in plain.08:22
*** holser_ has quit IRC08:22
Tengu\o/ yes08:22
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates master: [DNM] To test 'Take featureset out'  https://review.openstack.org/58476008:23
Tenguhttps://www.mediawiki.org/wiki/Gerrit/Commit_message_guidelines  <- helpful doc when you're not sure.08:23
*** edmondsw has joined #tripleo08:23
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates master: [DNM] To test 'Take environment_type out'  https://review.openstack.org/58476108:24
TenguI'll be back in ~an hour.08:24
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates master: [DNM] To test 'Take nodes out'  https://review.openstack.org/58476208:24
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates master: [DNM] To test 'Take periodic and dry run out'  https://review.openstack.org/58476308:25
*** suuuper has joined #tripleo08:26
*** owalsh_ has joined #tripleo08:27
*** owalsh has quit IRC08:27
*** edmondsw has quit IRC08:28
*** ykarel|lunch is now known as ykarel08:28
*** holser_ has joined #tripleo08:29
*** holser_ has quit IRC08:29
ratailorcan anybody pl review https://review.openstack.org/#/q/owner:self+topic:bp/numa-aware-vswitches08:30
*** holser_ has joined #tripleo08:31
*** holser_ has quit IRC08:31
*** lvdombrkr has joined #tripleo08:32
*** derekh has joined #tripleo08:33
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container  https://review.openstack.org/58477108:40
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Set container_images_file for containerized undercloud.  https://review.openstack.org/58428608:41
*** athomas has joined #tripleo08:42
*** jaosorior has quit IRC08:50
rnoriegaHello guys!! Anyone with expertise deploying heat plugins with TripleO??08:54
rnoriegaeverybody I guess...right?? xD xD08:55
*** pfo_ has joined #tripleo08:55
rnoriegadoes anybody know if python directories are exposed via volumes to the host??? I see none...08:55
openstackgerritTuan Do Anh proposed openstack/tripleo-common master: Fix typo of function naming conventions in parameters.py  https://review.openstack.org/58117808:55
pfo_hey guys. I want to introduce a new heat param for a puppet manifest that currently hard codes some values. Is there any lightweight toturial how to pass data from heat into hiera?08:56
*** nenad has joined #tripleo08:56
*** Petersingh|lunch is now known as Petersingh08:57
*** wolverineav has joined #tripleo09:01
*** wolverineav has quit IRC09:06
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226709:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259809:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305509:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]09:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)09:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where tempest is runned from container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)09:10
rnoriegapfo_, https://oglok.github.io/2017-04-29-Developing-a-TripleO-composable-service/09:12
rnoriegapfo_, it's a bit old, but you can see the essentials...09:12
*** sanjayu has quit IRC09:15
*** nyechiel has joined #tripleo09:16
*** nyechiel_ has quit IRC09:16
*** saneax has joined #tripleo09:19
bogdandopfo_: hi, not sure for the guide, but here is an example http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/etcd.yaml#n6309:23
bogdandooverrides in hiera etcd::manage_service: false09:24
bogdandoas we do not want manage services in containers09:24
bogdandoand EtcdPuppetBase refers to the main puppet/services/etcd.yaml template09:24
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates stable/queens: Lower reserved memory for nova-compute  https://review.openstack.org/58120109:27
*** jistr|off is now known as jistr09:29
Tenguback.09:33
pfo_bogdando: thx!09:33
*** links has quit IRC09:34
*** dtantsur|brb is now known as dtantsur09:38
*** links has joined #tripleo09:41
*** owalsh_ is now known as owalsh09:41
*** nyechiel_ has joined #tripleo09:46
*** nyechiel has quit IRC09:46
*** panda|off is now known as panda09:48
*** saneax has quit IRC09:49
*** Haresh has quit IRC09:49
*** sshnaidm|afk is now known as sshnaidm|rover09:56
openstackgerritAdam Harwell proposed openstack/diskimage-builder master: cache-url requires curl  https://review.openstack.org/54235009:57
*** cshastri has quit IRC09:58
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates master: Allow setting physical network MTU via heat template  https://review.openstack.org/58321109:59
*** sshnaidm|rover is now known as sshnaidm|ruck10:00
*** chkumar|ruck is now known as chkumar|rover10:01
*** Petersingh has quit IRC10:04
*** suuuper has quit IRC10:07
*** pblaho has joined #tripleo10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226710:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259810:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305510:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)10:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where tempest is runned from container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)10:10
*** edmondsw has joined #tripleo10:11
*** morazi has quit IRC10:14
*** edmondsw has quit IRC10:16
jfrancoabogdando: one question about the containerized-undercloud-upgrades job, I am realizing we are not running the prep-containers step anywhere in the job, and I wanted to add it. But I am not very sure how do you pass the containers file during the upgrade, this is the command used now: http://logs.openstack.org/80/583280/3/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/9988005/logs/undercloud/home/zuul/undercloud_upgrade.sh.t10:18
jfrancoaxt.gz10:18
*** saneax has joined #tripleo10:27
*** jaosorior has joined #tripleo10:28
bogdandojfrancoa: via undercloud.conf container_images_file10:28
jfrancoabogdando: I guess I will have to add a undercloud setup step before running the upgrade. Thanks for the info10:30
jfrancoabogdando: by the way, the job failed: http://logs.openstack.org/15/583515/4/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/9126046/job-output.txt.gz#_2018-07-23_08_24_04_035611 I added a comment in https://review.openstack.org/#/c/465047/15 when you have some time10:31
*** janki has quit IRC10:33
*** skramaja has quit IRC10:33
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Unify custom t-h-t install steps for UC/OC/upgrade  https://review.openstack.org/46504710:34
bogdandojfrancoa: fixed that undercloud_tht_rpm_url10:34
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: reproducer: cherry pick zuul changes  https://review.openstack.org/58296310:36
TenguPTAL folk? https://review.openstack.org/#/c/566277/  thank you :) (it's a really, really old commit)10:36
*** ukalifon has joined #tripleo10:37
*** shreshtha has quit IRC10:38
*** janki has joined #tripleo10:39
*** quiquell is now known as quiquell|bbl10:39
*** khyr0n has quit IRC10:40
*** links has quit IRC10:44
Tengubandini: you can add the W+1 I guess: https://review.openstack.org/#/c/583886/  it's good for the RDO CI :)10:45
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart-extras master: reproducer: cherry pick zuul changes  https://review.openstack.org/58296310:48
*** links has joined #tripleo10:48
Tengujaosorior: thanks for the w+1 then10:50
Tengu:)10:50
*** zoli is now known as zoli|lunch10:53
*** pdeore has quit IRC10:58
Tenguhey guys, PTAL? That would be really nice! https://review.openstack.org/#/c/584754/11:00
Tengujaosorior: :)11:02
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container  https://review.openstack.org/58477111:02
*** lucasagomes is now known as lucas-hungry11:03
*** gfidente has joined #tripleo11:03
*** gfidente has quit IRC11:03
*** gfidente has joined #tripleo11:03
*** lucas-hungry is now known as lucasagomes11:03
*** quiquell|bbl is now known as quiquell11:03
openstackgerritMerged openstack/instack-undercloud master: Configure keepalived before rabbitmq  https://review.openstack.org/58446011:06
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226711:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259811:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305511:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]11:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)11:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)11:10
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Don't clean node in ci.centos  https://review.openstack.org/58480111:12
*** links has quit IRC11:13
Tengubandini: re "vrrp update in t-h-t: probable useless volume": I'm maybe mixing up containers, have to re-check where haproxy runs from.11:14
*** links has joined #tripleo11:15
Tengubandini: ok, got your point. Updating.11:15
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Update/correct vrrp check for haproxy  https://review.openstack.org/58475411:16
Tengubandini: -^^  dropped the now useless volume.11:16
Tengubandini: that said - the vrrp script is launched by what container?11:17
jaosoriorbandini: is the deep_compare stuff for pcmk available in older deployments? or just rocky?11:20
*** ratailor has quit IRC11:20
bandiniTengu: in the keepalived if I understood things correctly, probably worth double-checking to be 100% sure11:20
*** dhill_ has joined #tripleo11:21
Tengubandini: hm, so the updated vrrp script won't work11:25
*** udesale__ has quit IRC11:25
*** holser_ has joined #tripleo11:25
openstackgerritMerged openstack/tripleo-common master: Take WSGIScriptAlias into account in docker healthcheck.  https://review.openstack.org/58288311:26
paramiteamoralej, Hey Alfredo, what should I do to update puppet-stdlib to 4.25?11:29
amoralejparamite, for rocky?11:30
*** numans has quit IRC11:30
amoralejparamite, we are already in 4.25 for rocky11:32
amoralejwe follow master trunk11:32
*** ffiore has quit IRC11:32
*** brault has quit IRC11:33
paramiteamoralej, ok great11:33
*** brault has joined #tripleo11:34
paramiteamoralej, I didn't find the version in CBS, so I thought you are stucked at 4.24 for some reason11:34
paramiteamoralej, thanks for update11:34
amoralejparamite, that's queens11:35
paramiteamoralej, ack11:35
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Collectd QDR connection  https://review.openstack.org/57115211:36
*** amoralej is now known as amoralej|lunch11:37
*** numans has joined #tripleo11:38
*** morazi has joined #tripleo11:39
pandaI need an Ironic expert11:47
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: ansible: replace yum module by package module when possible  https://review.openstack.org/58448011:48
EmilienMsshnaidm|ruck: patches in tripleo-common don't trigger OVB jobs :(11:49
quiquellpanda: Souns like a joke11:49
pandaderekh: in OVB, the part that provide images via bootp to a node is part of ironic, or tripleo ?11:50
pandaderekh: OVB/Baremetal11:51
derekhpanda: ironic with parts being setup by ironics integration with tripleo, (and dhcp provided by neutron)11:53
derekhpanda: whats going wrong?11:54
*** mburned_out is now known as mburned11:54
*** deepeecoq has quit IRC11:55
Tengubandini: I think I can abandon the patch on t-h-t in fact. That command won't work since it's launched from another container than the haproxy.11:55
Tengubandini: and now, I'm a bit worried about the other patch - OK it doesn't throw any error in the CI, but still... what container launches that script as well? :/11:56
bandiniTengu: maybe worth stepping back a sec and relook at the problem you're trying to solve? (in a call atm)11:57
Tengubandini: yep, might be worth. any way to stop the gating?11:58
*** quiquell is now known as quiquell|lunch11:59
bandiniTengu: I think what you did should work11:59
Tengubandini: hopefully. Will be in a call as well in a couple of seconds11:59
Tenguwill take that back on the work table.12:00
bandiniack sounds like a plan12:00
*** leanderthal has quit IRC12:01
EmilienMchkumar|rover: FYI patches on tripleo-common don't trigger third party CI jobs anymore :(12:01
chkumar|roverEmilienM: checking12:02
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: WIP - Force utf8 on openstack-db execs  https://review.openstack.org/58367512:03
sshnaidm|ruckEmilienM, I know, working on that with SF dfg12:05
EmilienMoh ok12:05
EmilienMsshnaidm|ruck: thanks12:05
chkumar|roverEmilienM: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master  and gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master  were runing against tripleo/common12:05
sshnaidm|ruckEmilienM, it was misconfiguration in zuul12:05
chkumar|roverboth are hitting with node_Failure from last couple of days12:05
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: undercloud: configure insecure registry with undercloud.conf  https://review.openstack.org/58299912:05
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: undercloud: configure insecure registry with undercloud.conf  https://review.openstack.org/58299912:05
chkumar|roverEmilienM: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch also started hitting node_Failure today12:06
openstackgerritSagi Shnaidman proposed openstack/tripleo-common master: Add container-update to scripts  https://review.openstack.org/57679612:06
EmilienMbogdando: hey, can you review https://review.openstack.org/#/c/581534/ again please?12:06
pandaderekh: I'm trying to understand where are we testing the dhcp part, beside the OVB jobs12:08
pandaderekh: do you know where I should look if I want to modify the dhcp configuration ?12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226712:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259812:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305512:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)12:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)12:10
*** nenad has quit IRC12:10
*** tzumainn has joined #tripleo12:11
*** zoli|lunch is now known as zoli12:11
*** zoli is now known as zoli|wfh12:12
*** zoli|wfh is now known as zoli12:12
*** pchavva has joined #tripleo12:12
*** leanderthal has joined #tripleo12:13
*** edmondsw has joined #tripleo12:13
*** agopi has quit IRC12:14
*** jcoufal has joined #tripleo12:14
openstackgerritDougal Matthews proposed openstack/instack-undercloud master: [WIP] Enable the Zaqar notifier  https://review.openstack.org/58484812:16
*** dpeacock has joined #tripleo12:17
*** suuuper has joined #tripleo12:18
*** ohochman has joined #tripleo12:18
*** suuuper has quit IRC12:19
*** suuuper has joined #tripleo12:19
*** thrash|g0ne is now known as thrash12:20
*** fultonj has joined #tripleo12:22
*** bogdando has quit IRC12:23
EmilienMd0ugal: for https://review.openstack.org/584848, I would rather not doing it in instack-undercloud12:24
*** quiquell|lunch is now known as quiquell12:24
*** trown|outtypewww is now known as trown12:24
*** atoth has joined #tripleo12:24
EmilienMd0ugal: simply because most of our CI doesn't use this project anymore12:24
EmilienMwhich makes me think we need to update the zuul layout.12:24
d0ugalEmilienM: aha, so where should I do it? I just wanted to test enabling it so I can see how badly it fails :)12:25
EmilienMd0ugal: I would rather make it work for the containerized undercloud, so THT for example12:25
EmilienMd0ugal: THT12:25
d0ugalEmilienM: aha, thanks. I'll go figure out how that works.12:25
EmilienMd0ugal: with Depends-On, as well, it should work.12:25
*** dprince has joined #tripleo12:27
*** pradk has quit IRC12:27
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: zuul: remove jobs with overcloud  https://review.openstack.org/58485112:28
openstackgerritMichele Baldessari proposed openstack/instack-undercloud stable/queens: Configure keepalived before rabbitmq  https://review.openstack.org/58485212:28
*** saneax has quit IRC12:29
*** bogdando has joined #tripleo12:30
*** saneax has joined #tripleo12:30
*** ffiore has joined #tripleo12:31
*** mdnadeem_ has joined #tripleo12:31
*** pradk has joined #tripleo12:32
*** etingof has joined #tripleo12:33
etingofbogdando, hey, have you got the new logs from the job following ilo/kolla fixes? -- https://bugs.launchpad.net/tripleo/+bug/178226712:34
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]12:34
*** mdnadeem has quit IRC12:35
*** beagles_afk is now known as beagles12:38
*** holser_ has quit IRC12:38
*** yrabl has joined #tripleo12:39
*** yrabl is now known as liverpooler12:39
*** rlandy has joined #tripleo12:39
*** wolverineav has joined #tripleo12:40
*** holser_ has joined #tripleo12:41
*** jistr is now known as jistr|mtg12:41
bogdandoEmilienM: https://review.openstack.org/#/c/581534/ has mine +212:43
EmilienMbogdando: oh indeed, thx12:43
*** agopi has joined #tripleo12:44
*** yrabl_ has joined #tripleo12:45
bogdandoetingof: not sure the patch changed anything https://logs.rdoproject.org/65/584265/1/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/f730e8a/logs/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz#_2018-07-20_14_47_16_20312:45
openstackgerritDougal Matthews proposed openstack/tripleo-heat-templates master: [WIP] Add support for the Mistral notifier services  https://review.openstack.org/58485312:46
*** mcornea has joined #tripleo12:47
*** liverpooler has quit IRC12:47
*** holser_ has quit IRC12:47
etingofbogdando, is not that the old log from July 20?12:47
bogdandothat's the log for the patch https://review.openstack.org/#/c/584265 and it contains the changes in https://logs.rdoproject.org/65/584265/1/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/f730e8a/logs/undercloud/home/zuul/tripleo-heat-installer-templates/docker/services/12:48
bogdandodtantsur: hi ^^ not sure I can fix anything else for the subject, etingof :(12:50
*** holser_ has joined #tripleo12:51
*** stendulker has joined #tripleo12:51
*** holser_ has quit IRC12:52
*** arxcruz is now known as arxcruz|off12:53
dtantsursorry, I'm a bit out of context12:54
*** jbadiapa_ is now known as jbadiapa12:55
*** holser_ has joined #tripleo12:55
*** udesale has joined #tripleo12:56
*** holser_ has quit IRC12:56
jbadiapabogdando, are you talking about the timeout on the introspection?12:57
*** toure|gone is now known as toure12:59
bogdandojbadiapa: yes, https://bugs.launchpad.net/tripleo/+bug/1782267, but specifically a red herring (I believe it is) error messages the related patch https://review.openstack.org/#/c/584265 was intended to fix (but failed hard)12:59
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]12:59
bogdandoI can be wrong and those access denied errors may be root cause ofc13:00
bogdandoanyway, couldn't fix it, have no more ideas13:00
etingofit looks like access denied errors are gone -- http://logs.openstack.org/65/584265/1/gate/tripleo-ci-centos-7-undercloud-oooq/cd8ce77/logs/undercloud/var/log/ironic/ironic-conductor.log.txt.gz13:00
bogdandoum13:00
*** trozet has joined #tripleo13:00
bogdandowell, I checked OVB for the submitted patch, and it was there still13:00
bogdandosee:13:01
bogdandoetingof: not sure the patch changed anything https://logs.rdoproject.org/65/584265/1/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/f730e8a/logs/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz#_2018-07-20_14_47_16_20313:01
bogdando3:48:32 PM GMT+3 - bogdando: that's the log for the patch https://review.openstack.org/#/c/584265 and it contains the changes in https://logs.rdoproject.org/65/584265/1/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/f730e8a/logs/undercloud/home/zuul/tripleo-heat-installer-templates/docker/services/13:01
bogdandojbadiapa: ^^13:01
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container  https://review.openstack.org/58477113:01
*** ksambor has quit IRC13:02
bogdandoso the containerized ironic services was deployed from that tht configs, containing the fix...13:02
jbadiapalet me take a look13:02
*** ksambor1 has joined #tripleo13:02
bogdandowere*13:02
*** lblanchard has joined #tripleo13:03
openstackgerritTim Rozet proposed openstack/puppet-tripleo stable/queens: Add ODL puppet lib functions to zuul path  https://review.openstack.org/58485913:04
jbadiapabogdando, let me redeploy but I think is something related to neutron rpc calls13:04
bogdandoetingof: btw,  that tripleo-ci-centos-7-undercloud-oooq deploys with instack http://logs.openstack.org/65/584265/1/gate/tripleo-ci-centos-7-undercloud-oooq/cd8ce77/logs/undercloud/home/zuul/install-undercloud.log.txt.gz and my t-h-t patch does not affect instack UC13:04
bogdandojbadiapa: ack13:05
jbadiapabogdando, the main issue is that is not tested on the gate IMHO13:05
* bogdando sigh13:05
jbadiapaor I was not able to find it13:05
Tengubandini: I'm launching a containerized undercloud in order to check WHICH container runs the vrrp check. That will help I hope.13:06
*** ksambor1 has quit IRC13:06
bandiniaye13:07
jbadiapaBTW, is there a chance of running the undercloud non-containerized?13:07
Tengujbadiapa: --use-heat=False with rocky. But this will dropped later I think13:09
jbadiapaTengu, thx13:10
Tengu"The future is boxed, the future is Containers" (for those knowing the Orange ad)13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226713:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259813:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305513:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]13:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)13:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)13:10
*** stendulker has quit IRC13:11
*** mjturek has joined #tripleo13:12
*** rbrady has joined #tripleo13:16
*** rbrady has joined #tripleo13:16
derekhpanda: we(in tripleo) used to configure neutron to start dnsmasq with --conf-file=/etc/.... , so you could add custome config in there but we no longer do that13:17
*** gfidente has quit IRC13:17
*** numans_ has joined #tripleo13:17
*** dtrainor has quit IRC13:18
derekhpanda: so now neutron creates the dhcp config for the port, the boot details are added to the port by ironic, on sec and I'll find the code13:19
*** numans has quit IRC13:19
*** ccamacho has quit IRC13:20
*** dtrainor has joined #tripleo13:21
derekhpanda: in ironic, various dhcp options are set on the port here http://git.openstack.org/cgit/openstack/ironic/tree/ironic/common/pxe_utils.py#n325 , neutron then sets the options in the dhcp config for each port13:25
*** numans has joined #tripleo13:27
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Update the config for FS021  https://review.openstack.org/58320213:28
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift  https://review.openstack.org/58314513:29
*** numans_ has quit IRC13:30
*** ksambor has joined #tripleo13:30
*** eck`gone is now known as eck`13:31
openstackgerritDerek Higgins proposed openstack/tripleo-heat-templates master: [WIP] Add scenario 012 - overlcoud baremetal+ansible-ml2  https://review.openstack.org/57960313:32
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates master: Allow setting physical network MTU via heat template  https://review.openstack.org/58321113:32
*** numans has quit IRC13:33
Tengubandini: well. so. the keepalived container on the undercloud wants to run this command: echo "show info" | socat unix-connect:/var/lib/kolla/haproxy/haproxy.sock stdio > /dev/null  path is wrong...13:36
Tengunow I have to find out where this command comes from.13:36
Tenguo_______O13:38
Tenguwell. that's interesting.....13:38
*** numans has joined #tripleo13:38
*** jcoufal has quit IRC13:40
*** bdodd has quit IRC13:42
*** bdodd has joined #tripleo13:42
Tengubandini: ok. so the command is launched by the "keepalived" container, thus the command in t-h-t is actually working, and my patch on puppet-tripleo doesn't do any good. Will update my review on puppet-tripleo, and abandon the one on t-h-t.13:44
*** myoung has joined #tripleo13:49
*** thrash is now known as thrash|biab13:49
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: Correct vrrp script for haproxy status  https://review.openstack.org/58388613:49
jristhonza: how'd you get past TASK [overcloud-prep-images : Prepare the overcloud images for deploy] ?13:49
Tengubandini: -^13:49
honzajrist: magic?13:50
jristhonza: a fine answer13:50
honzajrist: thank you13:50
*** amoralej|lunch is now known as amoralej13:50
jristhonza: if you have my voodoo doll will you please take out some stuffing from the mid section?13:50
honzajrist: i didn't have to do anything special13:50
honzajrist: i used a reproducer-script13:51
*** ykarel is now known as ykarel|away13:51
honzajrist: it all worked automatically in rdo cloud13:51
*** jcoufal has joined #tripleo13:51
*** bdodd has quit IRC13:51
*** ykarel|away has quit IRC13:51
*** mdnadeem_ has quit IRC13:52
*** stendulker has joined #tripleo13:53
pfo_is there a way to just run puppet for all services?13:55
pfo_(for development iterations)13:55
honzajrist: still broken for on regular quickstart.sh on libvirt13:58
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Update/correct vrrp check for haproxy  https://review.openstack.org/58475413:58
jaosoriorpfo_: you mean just puppet and not containerized?13:58
*** dougbtv has joined #tripleo13:59
pandaderekh: I see, thanks.14:00
pfo_jaosorior: no, I mean run puppet apply in all containers (or just a specific one to make it a but quicker)14:00
*** psahoo has quit IRC14:00
jaosoriorI see14:01
jaosoriorwell, I'm not sure how to do that :/14:01
dpeacockflorianf: can you take another look at https://review.openstack.org/#/c/577397/ please?14:02
*** quiquell is now known as quiquell|off14:02
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Unify custom t-h-t install steps for UC/OC/upgrade  https://review.openstack.org/46504714:06
*** stendulker has quit IRC14:08
*** psachin` has quit IRC14:08
*** ccamacho has joined #tripleo14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226714:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259814:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305514:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)14:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)14:10
*** shreshtha has joined #tripleo14:10
*** agurenko has quit IRC14:10
*** shreshtha has quit IRC14:11
*** shreshtha has joined #tripleo14:12
*** jistr|mtg is now known as jistr14:13
*** thrash|biab is now known as thrash14:15
*** agurenko has joined #tripleo14:16
dpeacockakrivoka: Hey - are you able to review and +2 https://review.openstack.org/#/c/577397/ please?14:18
*** derekh has quit IRC14:19
*** yolanda__ has joined #tripleo14:19
florianfdpeacock: on pto, but yup, will have another look.14:19
dpeacockflorianf: no no, I apologize; i didn't realize you were on PTO - please don't work on holiday :-)  I've asked ana to take a look.14:20
*** stendulker has joined #tripleo14:20
*** suuuper has quit IRC14:20
*** aufi has joined #tripleo14:21
florianfdpeacock: no need to apologize. I shouldn't go on irc and then complain if someone talks to me :)14:21
dpeacockflorianf: lol get out of here ;-)14:21
*** yolanda_ has quit IRC14:21
*** rpioso|afk is now known as rpioso14:21
florianfdpeacock: Have you checked the output when the validation_output plugin is used?14:21
florianfdpeacock: lol14:21
etingofbogdando, aside from that ilo permission denied error in the log, do you still see any issues with ironic? it seems to deploy in the end14:22
dpeacockflorianf: I ran it from the root dir, I'm not sure if I needed to run mistral stuff specifically?14:22
*** links has quit IRC14:22
honzajtomasek: what is a good way of introducing errors into a deployment plan?  something that will fail quickly?14:22
florianfdpeacock: the root of the tripleo-validations repo? or /root ?14:23
dpeacockflorianf: it looked cleaner from my tests; if you have a specific test you want me to run I can do that then give you access to the system or present you the output in a pastebin14:23
florianfdpeacock: (sorry if I'm asking the obvious)14:23
jtomasekhonza: good question14:23
*** derekh has joined #tripleo14:23
dpeacockflorianf: sorry, I meant the tripleo-validations repo root14:23
jtomasekhonza: I'll try to figure something out14:23
florianfdpeacock: ok, if it looked cleaner than it got picked up :)14:23
florianf*then14:23
bogdandoetingof: nothing else looked weird to me14:25
etingofbogdando, should consider this issue as resolved then?14:25
dpeacockflorianf: I tested with the inventory, with a broken inventory (no ctlplane_ip var provided), and with inventory, and none of those runs caused problems14:26
florianfdpeacock: sounds good14:26
*** yolanda__ is now known as yolanda14:26
jtomasekhonza: I was testing listing of the failures by naming the plan with capital letter, that gave me a failure later e.g. MY-tht-plan14:26
bogdandoetingof: I don't think so I do not have the environment with the original errors14:26
bogdandojust worked on a side issue with that permission denies14:26
jbadiapabogdando, etingof, nope the timeout is still there14:26
dpeacockflorianf: ok cool - if you feel it's ready for a +2 I'd be very happy14:26
honzajtomasek: right14:27
jtomasekhonza: that was giving me AnsibleUndefinedVariable: 'dict object' has no attribute u'newtht-controller-0'14:27
jbadiapabogdando, I've just have an env up. do you want to take a look?14:27
bogdandojbadiapa: yes please, although I'm not ironic expert :)14:27
etingofjbadiapa, can I also take a look?14:28
jbadiapasure but it's going to be a tmate session14:29
honzajtomasek: trying it now14:30
honzarbrady: how can i reload tripleo-common during development?  the instructions in the readme now longer work due to containers...14:35
honzajtomasek: maybe you know ^^^ ?14:37
jtomasekhonza: ouch14:38
* honza is now sad14:38
*** agurenko has quit IRC14:43
*** ksambor has quit IRC14:48
*** bdodd has joined #tripleo14:49
openstackgerritCédric Jeanneret proposed openstack/tripleo-validations master: Enhanced checkdisk for undercloud  https://review.openstack.org/58431414:50
*** jfrancoa has quit IRC14:51
*** jfrancoa has joined #tripleo14:55
*** beekneemech is now known as bnemec15:00
*** bnemec is now known as beekneemech15:01
*** beekneemech is now known as bnemec15:01
d0ugalhonza: when you find out, I'd like to know :)15:03
d0ugalhonza: I've been avoiding a container setup for this reason.15:03
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: Correct vrrp script for haproxy status  https://review.openstack.org/58388615:06
bogdandojbadiapa, etingof: from what I can tell, that permission denied error seem not related to the timing out introspection15:07
etingofbogdando, that's my impression as well15:08
bogdandoI'm afraid that's it I could take a look for in ironic logs :)15:08
bogdandohave no idea how to debug those time outs actually :(15:08
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226715:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178259815:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305515:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1782598 in tripleo "container health check fails in step 5 on centos-binary-nova-api" [Critical,In progress] - Assigned to Oliver Walsh (owalsh)15:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)15:10
*** dciabrin_ has quit IRC15:17
*** dciabrin__ has joined #tripleo15:17
*** jaganathan has quit IRC15:18
*** bryan_att has quit IRC15:18
*** patrickeast has quit IRC15:19
*** mbarnett has quit IRC15:19
*** diablo_rojo_phon has quit IRC15:19
*** csatari has quit IRC15:19
*** apetrich has quit IRC15:20
*** sdoran has quit IRC15:20
*** Hazelesque has quit IRC15:21
*** andreaf has quit IRC15:21
*** mbarnett has joined #tripleo15:21
*** bryan_att has joined #tripleo15:21
*** patrickeast has joined #tripleo15:21
*** lvdombrkr has quit IRC15:22
*** dparkes has joined #tripleo15:22
*** Hazelesque has joined #tripleo15:22
*** assassin has quit IRC15:22
*** sdoran has joined #tripleo15:23
*** diablo_rojo_phon has joined #tripleo15:23
*** csatari has joined #tripleo15:23
*** Hazelesque has quit IRC15:24
*** Hazelesque has joined #tripleo15:24
*** sdoran has quit IRC15:24
*** sdoran has joined #tripleo15:24
*** jaganathan has joined #tripleo15:24
*** andreaf has joined #tripleo15:25
*** sdoran has quit IRC15:25
*** mcornea has quit IRC15:26
*** sdoran has joined #tripleo15:26
*** sdoran has quit IRC15:27
*** sdoran has joined #tripleo15:27
*** assassin has joined #tripleo15:28
*** mcornea has joined #tripleo15:28
*** bdodd has quit IRC15:28
*** bdodd has joined #tripleo15:29
*** ukalifon has quit IRC15:29
openstackgerritMerged openstack/tripleo-quickstart-extras master: Reproducer don't fail if workspace path doesn't exist yet  https://review.openstack.org/57958715:31
*** apetrich has joined #tripleo15:33
*** dparkes has quit IRC15:33
*** dparkes has joined #tripleo15:34
*** cdearborn has joined #tripleo15:40
*** bdodd_ has joined #tripleo15:40
*** holser_ has joined #tripleo15:41
*** holser_ has quit IRC15:42
Tengusee you tomorrow!15:43
*** bdodd has quit IRC15:43
*** gfidente has joined #tripleo15:44
*** gfidente has quit IRC15:44
*** gfidente has joined #tripleo15:44
*** itlinux has joined #tripleo15:44
bogdandoIs it tripleoclient rpm requires an outdated version of tripleo common? https://bugs.launchpad.net/tripleo/+bug/178315615:44
openstackLaunchpad bug 1783156 in tripleo "Tripleo common package/dependencies should be updated to fix "Exception: write_default_ansible_cfg() got an unexpected keyword argument 'transport'"" [Critical,New]15:44
bogdandoEmilienM: PTAL ?15:44
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: copy ceph config in manila-share container bundle  https://review.openstack.org/58494915:45
*** leanderthal has quit IRC15:46
*** alee has joined #tripleo15:46
pandaderekh: when we install baremetal nodes through ironic, is there a way to launch a custom script as first thing right after the node has rebooted with OS ?15:49
bogdandohttps://review.rdoproject.org/r/#/c/14965/ ^^15:50
*** akrivoka has quit IRC15:50
*** akrivoka has joined #tripleo15:51
*** jcoufal_ has joined #tripleo15:52
derekhpanda: earlier then cloud-config or something similar? only thing I know of would be to build a script into the image15:52
*** yprokule has quit IRC15:52
pandaderekh: it's enough to launch the script before overcloud deployment15:54
*** bogdando has quit IRC15:54
*** nyechiel_ has quit IRC15:55
*** jcoufal has quit IRC15:55
*** udesale has quit IRC15:56
*** jcoufal_ has quit IRC15:56
*** aufi has quit IRC15:57
derekhif you can't build it into the image, I don't think there is an ironic provided method, perhaps tripleo has a hook point for scripts that run early enough in the deploy process16:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044516:00
derekhpanda: ^^, but others in here would know details of that better then me16:00
pandaderekh: ok, thanks.16:00
*** holser_ has joined #tripleo16:02
zzzeekim ...getting an SSL issue when I try to deploy overcloud all the sudden, is this known issue ?16:04
zzzeekhttp://paste.openstack.org/show/726458/16:04
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226716:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178315616:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]16:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)16:10
openstackLaunchpad bug 1783156 in tripleo "Tripleo common package/dependencies should be updated to fix "Exception: write_default_ansible_cfg() got an unexpected keyword argument 'transport'"" [Critical,New]16:10
*** shreshtha has quit IRC16:10
*** tcw1 has joined #tripleo16:12
*** pblaho has quit IRC16:13
*** jcoufal has joined #tripleo16:13
*** tcw has quit IRC16:16
*** tcw1 is now known as tcw16:18
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container  https://review.openstack.org/58477116:23
chkumar|rovermandre: ^6 above will work16:23
*** zoli is now known as zoli|gone16:27
*** zoli|gone is now known as zoli16:28
*** panda is now known as panda|off16:30
*** mjturek has quit IRC16:30
*** jpich has quit IRC16:30
honzaEmilienM: how can i reload tripleo-common during development?  the instructions in the readme now longer work due to containers... (resending because of irc issues)16:34
sshnaidm|ruckEmilienM, btw, tripleo-common should run now OVB jobs16:34
trozetdoes anyone know why heat_stack_owner role is not created with OOO deployments?16:35
*** gfidente has quit IRC16:35
*** betherly is now known as betherly-afk16:40
*** betherly_ is now known as betherly16:40
*** trown is now known as trown|lunch16:42
*** stendulker has quit IRC16:42
*** avivgt has quit IRC16:45
*** pcaruana has quit IRC16:47
*** ccamacho has quit IRC16:49
*** akhilaki has joined #tripleo16:49
*** ffiore has quit IRC16:52
EmilienMsshnaidm|ruck: thx16:54
EmilienMhonza: yum update in the container?16:54
honzainteresting16:55
openstackgerritMerged openstack/puppet-pacemaker master: Initial support for adding cluster nodes to an existing cluster  https://review.openstack.org/56753716:55
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/queens: Fix gnocchi auth mode to basic  https://review.openstack.org/58496816:57
*** dparkes has quit IRC17:01
*** tesseract has quit IRC17:02
*** derekh has quit IRC17:02
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Enable octavia-api health check  https://review.openstack.org/58100817:05
*** nyechiel_ has joined #tripleo17:07
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Edit some post update tasks logic  https://review.openstack.org/57918217:07
*** khyr0n has joined #tripleo17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226717:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305517:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178315617:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]17:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)17:10
openstackLaunchpad bug 1783156 in tripleo "Tripleo common package/dependencies should be updated to fix "Exception: write_default_ansible_cfg() got an unexpected keyword argument 'transport'"" [Critical,New]17:10
*** jcoufal has quit IRC17:13
*** jcoufal has joined #tripleo17:15
chkumar|rovertrown|lunch: hello17:15
*** ramishra has quit IRC17:16
chkumar|rovertrown|lunch: i was able to deploy scenario009 using libvirt reproducer17:17
chkumar|rovertrown|lunch: but keystone is down17:17
*** pfo_ has quit IRC17:18
openstackgerritMerged openstack-infra/tripleo-ci master: Set common vars at vars/common.yaml  https://review.openstack.org/58288517:21
*** dtantsur is now known as dtantsur|afk17:24
*** mcornea has quit IRC17:26
*** myoung is now known as myoung|bbl17:29
honzaJeffrey4l: hey, question about https://bugs.launchpad.net/tripleo/+bug/1744215 where can i check if that "gate" mentioned therein is still failing?17:33
openstackLaunchpad bug 1744215 in tripleo "tripleo ui image is failed and block the gate" [Critical,Triaged] - Assigned to Honza Pokorny (hpokorny)17:33
honzaJeffrey4l: I'd like to close the bug, and I'm not sure how to verify that it's been fixed.17:35
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable keystone tempest tests in scenario009  https://review.openstack.org/58498017:36
*** cylopez has quit IRC17:37
*** mcornea has joined #tripleo17:38
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: WIP: Migrate neutron aux processes from baremetal to container on upgrades  https://review.openstack.org/58498117:39
*** yamahata has quit IRC17:39
*** thrash is now known as thrash|biab17:41
*** mjturek has joined #tripleo17:42
*** akhilaki has quit IRC17:44
*** amoralej is now known as amoralej|off17:46
*** trown|lunch is now known as trown17:47
trownchkumar|rover: scenario009 doesnt deploy openstack :)17:47
trownchkumar|rover: the undercloud is instead deploying openshift directly on baremetal (in this case a nodepool virt pretending to be baremetal)17:48
openstackgerritMerged openstack/tripleo-common master: Copy deployments.yaml to top level config-dir  https://review.openstack.org/57447317:51
*** isq_ has joined #tripleo17:51
*** isq has quit IRC17:53
openstackgerritRaoul Scarazzini proposed openstack/tripleo-ha-utils master: Introduce latency test  https://review.openstack.org/58498718:00
*** nyechiel_ is now known as nyechiel18:01
chkumar|rovertrown: so on subnode2 openshift is deployed18:03
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add Browbeat enable settings to fs053  https://review.openstack.org/58357818:04
*** itlinux has quit IRC18:05
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add Browbeat env settings to rdocloud  https://review.openstack.org/58357618:05
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Include minimal Browbeat playbook in baremetal playbook  https://review.openstack.org/58148818:06
errrI am wanting to run a tripleo all in one on a single 20G server I have. Is that possible using the tripleo quickstart script?18:07
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM: Persist ceph-ansible fetch_directory using config-download  https://review.openstack.org/58281118:09
errrit is just a POC thing so performance does not matter much to me. I just need to test something things on the platform where I have the overcloud and undercloud18:09
trownchkumar|rover: yep18:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226718:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305518:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]18:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)18:10
*** akrivoka has quit IRC18:10
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Take periodic and dryrun out of TOCI_JOBTYPE  https://review.openstack.org/58238718:10
*** yamahata has joined #tripleo18:11
*** yamahata__ has joined #tripleo18:13
*** isq_ has quit IRC18:13
*** moguimar has joined #tripleo18:19
*** akhilaki has joined #tripleo18:21
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM: Persist ceph-ansible fetch_directory using config-download  https://review.openstack.org/58281118:21
openstackgerritJose Luis Franco proposed openstack/tripleo-common master: Set known hosts when --limit is set.  https://review.openstack.org/58499418:23
*** tosky has quit IRC18:23
*** jfrancoa has quit IRC18:24
*** moguimar has quit IRC18:25
openstackgerritToure Dunnon proposed openstack/python-tripleoclient master: Notes warning for mixing multiple command line clients.  https://review.openstack.org/57097118:29
*** dhill_ has quit IRC18:32
EmilienMsdoran: I just sent an email about https://github.com/ansible/ansible/pull/41811 on openstack-dev / tripleo, let me know if you have insights18:34
*** jtcressy has joined #tripleo18:34
*** dhill_ has joined #tripleo18:34
* sdoran looking18:34
*** jcoufal has quit IRC18:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: nova: add parameters to configure nova::cron::archive_deleted_rows  https://review.openstack.org/58499818:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: nova: add parameters to configure nova::cron::archive_deleted_rows  https://review.openstack.org/58499818:43
*** morazi has quit IRC18:45
*** dougbtv has quit IRC18:46
*** agurenko has joined #tripleo18:50
*** jtcressy has quit IRC18:52
*** holser_ has quit IRC18:58
*** dsneddon has quit IRC18:58
*** kopecmartin has quit IRC19:01
*** thrash|biab is now known as thrash19:09
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container  https://review.openstack.org/58477119:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226719:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305519:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]19:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)19:10
*** xteknoid has joined #tripleo19:10
*** pfo_ has joined #tripleo19:11
*** pfo has joined #tripleo19:13
*** pfo_ has quit IRC19:16
*** jtcressy has joined #tripleo19:21
*** atoth has quit IRC19:32
*** dprince has quit IRC19:37
jtcressyAfternoon all, on my most recent attempt to deploy containerized queens, I encountered a problem with gnocchi again. Last time, mwhahaha pointed out that it was an incorrect container image. This time, i'm pulling images from docker.io/tripleoqueens and while I'm getting a new error, gnocchi is still failing. I have a hastebin of the container log output from controller-0 and the output of 'openstack stack failures list overcloud':19:38
jtcressy https://hastebin.com/toxutuciyo https://hastebin.com/duliruxizu19:38
mwhahahajtcressy: always fun, so i'm back now19:40
mwhahahajtcressy: so still the same problem, though i find it weird that we're not hitting that in CI, i wonder if we even deploy gnocchi still19:40
mwhahahaso we do in scenario001/002 so we're not hitting that in CI19:41
jtcressyWhile it'd be nice to have metrics in the overcloud, can I omit gnocchi/aodh/ceil to get the ball rolling?19:41
mwhahahajtcressy: yea19:41
jtcressyis there a variable i can set to "no" in an environment.yaml to stop it?19:42
mwhahahajtcressy: just add -e $THT/environments/disable-telemetry.yaml to your deploy19:42
jtcressysweet. i'll give that a try after I tear down the current deployment.19:42
mwhahahawhere $THT is your tripleo-heat-templates path (defaut would be /usr/share/openstack-tripleo-heat-templates)19:42
radezAnyone that could help me debug a container delpoyment availble? my controller fails with this: http://paste.openstack.org/show/726461/ and controller's var log messages has a bunch of these:19:43
radezError getting v2 registry: Get https://10.9.92.129:8787/v2/: http: server gave HTTP response to HTTPS client19:43
mwhahaharadez: that error message is not related19:43
mwhahaharadez: it's failing because /etc/neutron isn't in the container (bad container maybe?)19:44
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Add config option for ODL IPv6 deployment  https://review.openstack.org/58501519:44
mwhahaharadez: 2018-07-23 16:00:35 |         "Warning: [norpm] Attempting to install openstack-neutron but it will not be installed",19:44
mwhahaha2018-07-23 16:00:35 |         "Warning: [norpm] Attempting to install openstack-neutron-ml2 but it will not be installed",19:44
mwhahaharadez: that means the container attempting to be used doesn't have neutron installed19:44
radez:/19:44
radezoh19:44
* mwhahaha is glad he added that warning back in Ocata :D19:45
radezwithout a doubt! mwhahaha++19:45
radezok well I see if I can dig in deeper and figure out what's up with that19:46
mwhahaharadez: likely the wrong container image is being used, is this is a normal deploy? or something special19:46
radezmwhahaha: it's a featureset001 delpoy and I've added the templates on in extra args to include ironic in the overcloud and networking-ansible19:47
*** janki has quit IRC19:47
radezit's a bit unexpected to not have neutron in the container? I thin i'm just using default containers19:48
mwhahaharadez: ok i can't tell from what snippet, but it's likely the container config image setting for whatever service needs to be the correct neutron image (or maybe a ironic container needs neutron installed)19:48
mwhahaharadez: it's not like the previous iamges, not all software installed everywhere19:48
mwhahaharadez: the containers only have what they need to run19:48
radezack, is there a way to tell what container that error came from?19:49
mwhahahayea it should say in error messaging19:49
mwhahaharadez: it should say something like 2018-07-20 03:20:41,747 ERROR: 24152 -- ERROR configuring gnocchi"19:49
*** jcoufal has joined #tripleo19:49
*** jcoufal_ has joined #tripleo19:49
mwhahahathat last bit is the service it was configuring19:49
mwhahahaso if the ironic service fails to configure, the ironic container doesn't have neutron (which would make sense)19:50
*** jcoufal is now known as Guest835519:50
radezkk, I just turned over a deploy, next time I hit this I'll see if I can figure out which container, thx for the info mwhahaha19:50
*** Guest8355 has quit IRC19:50
*** jcoufal_ has quit IRC19:51
*** praefect has joined #tripleo19:52
*** praefect has quit IRC19:52
mwhahahaEmilienM: don't we use the latest ansible with all versions of tripleo or are we shipping a specific version19:56
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading  https://review.openstack.org/57310219:56
*** agurenko has quit IRC19:58
EmilienMmwhahaha: https://github.com/redhat-openstack/rdoinfo/blob/master/deps.yml#L304620:00
mwhahahaEmilienM: okc ool20:00
bnemecHrm, puppet-tripleo unit tests failing on a module I didn't change: https://review.openstack.org/#/c/583658/20:01
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Removing the deprecated environment files for hw offloading  https://review.openstack.org/57310220:01
mwhahahabnemec: blame bandini20:01
* mwhahaha throws things at bandini 20:02
* bnemec blames bandini20:02
mwhahahahttp://logs.openstack.org/58/583658/3/check/puppet-openstack-unit-4.8-centos-7/58d8a84/job-output.txt.gz#_2018-07-23_18_25_32_55020520:02
bnemecDone. :-P20:02
openstackgerritAlex Schultz proposed openstack/puppet-pacemaker master: Revert "Initial support for adding cluster nodes to an existing cluster"  https://review.openstack.org/58502020:03
mwhahahabnemec: -^ will likely fix it20:03
bnemecmwhahaha: Thanks20:04
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM: Persist ceph-ansible fetch_directory using config-download  https://review.openstack.org/58281120:04
*** yrabl_ has quit IRC20:05
openstackgerritAlex Schultz proposed openstack/puppet-pacemaker master: Revert "Initial support for adding cluster nodes to an existing cluster"  https://review.openstack.org/58502020:06
openstackgerritIan Main proposed openstack/tripleo-common master: WIP: Use process-templates.py and cache templates to speed up plan ops.  https://review.openstack.org/58115320:06
*** brault has quit IRC20:08
EmilienMslagle: I did recheck and your tripleo-common backports are in RDO Zuul now20:09
*** edmondsw has quit IRC20:09
EmilienMhttps://review.rdoproject.org/zuul/status.html20:09
EmilienMsee 57963420:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226720:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305520:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)20:10
*** dsneddon has joined #tripleo20:10
*** brault has joined #tripleo20:15
openstackgerritIan Main proposed openstack/python-tripleoclient master: WIP: Speed up plan operations by using a tarball in swift.  https://review.openstack.org/58114120:18
*** brault has quit IRC20:23
*** brault has joined #tripleo20:23
*** slaweq has quit IRC20:34
*** slaweq has joined #tripleo20:35
*** itlinux has joined #tripleo20:35
itlinuxhello guys, what's the best options to set glance to use cinder.. as default.. so I do not have to go through and make the changes after that20:36
*** dougbtv has joined #tripleo20:40
*** morazi has joined #tripleo20:44
*** brault_ has joined #tripleo20:48
*** lblanchard has quit IRC20:50
*** brault has quit IRC20:51
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Move toci_quickstart variables to yaml  https://review.openstack.org/58246620:51
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Cleanup variables and toci_jobtype leftovers  https://review.openstack.org/58446520:51
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: WIP: Replace TAGS with ansible var  https://review.openstack.org/58450820:51
openstackgerritMerged openstack/tripleo-docs master: Update status and failures commands  https://review.openstack.org/58373220:53
openstackgerritRonelle Landy proposed openstack/tripleo-heat-templates master: DNM - change to test toci_gate_test.sh.j2  https://review.openstack.org/58503220:56
*** edmondsw has joined #tripleo20:56
*** trown is now known as trown|outtypewww20:56
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Keep plan on update and store user env_files into swift  https://review.openstack.org/58314521:00
jtcressymwhahaha: I failed again on WorkflowTasks_Step2_Execution. Which logs would show me the output of this?21:02
mwhahahajtcressy: that was a ceph thing, i think they show up in /var/lib/mistral21:03
openstackgerritMerged openstack/puppet-pacemaker master: Revert "Initial support for adding cluster nodes to an existing cluster"  https://review.openstack.org/58502021:05
jtcressymwhahaha: Looks like ceph failed to get info about the OSD disks21:06
jtcressyssh-ing to investigate21:06
mwhahahajtcressy: when you deleted your systems you may needed to have cleaned up the ceph disks manually21:06
mwhahahajtcressy: ie, zeroing them out21:07
jtcressyfdisk -l only shows the main boot drive for some reason...21:08
mwhahahathat'd also be a problem21:08
jtcressywhoops, i fdisk'd the undercloud. I thought I ssh'd in already21:09
jtcressyok it sees the disks...21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226721:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305521:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]21:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)21:10
mwhahahajtcressy: yea you might need to cleanup the ceph osds first, let me see if i can find some docs around that21:10
mwhahahajtcressy: https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/12/html/deploying_an_overcloud_with_containerized_red_hat_ceph/creation#Formatting_Ceph_Storage_Nodes_Disks_to_GPT21:11
mwhahahajtcressy: i believe clean_nodes is false by default21:11
mwhahahaso you'd need to clean them up yourself21:11
jtcressyBTW, it failed saying this: "Error: Could not stat device /dev/vdb - No such file or directory."21:11
jtcressyall of the disks are /dev/sd[a-z], not vd[a-z]21:12
*** itlinux has quit IRC21:12
mwhahahajtcressy: so you need to specify the disks to ceph, i think it's using the defaults21:12
jtcressyok, are there variables i can define in an env yaml?21:13
mwhahahajtcressy: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ceph_config.html#configure-osd-settings-with-ceph-ansible21:13
jtcressyah ok21:13
jtcressyso if I happened to install an SSD for journaling in these nodes I can specify that too21:14
mwhahahayea21:14
jtcressyWhat would pgcalc look like if i had 6x135GB disks each in 3 nodes? (18 disks total)21:18
jtcressyok, i got it. size 3, 18 OSD's results in 1024 PG total count21:20
*** rcernin has joined #tripleo21:26
*** mcornea has quit IRC21:29
*** mjturek has quit IRC21:30
*** pchavva has quit IRC21:33
sshnaidm|ruckdoes it look familiar to someone? Error: Evaluation Error: Error while evaluating a Function Call, No such file or directory - crm_node at /etc/puppet/modules/pacemaker/manifests/corosync.pp21:39
sshnaidm|ruckhttp://logs.openstack.org/01/584801/1/gate/tripleo-ci-centos-7-containers-multinode/9215508/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-23_21_18_3421:39
sshnaidm|ruckmwhahaha, EmilienM seems like a lot of gate jobs fail because of ^^21:41
sshnaidm|ruckwill submit a bug..21:41
sshnaidm|ruckchkumar|rover, ^^21:41
*** agopi is now known as agopi|brb21:42
mwhahahasshnaidm|ruck: yes21:45
mwhahahasshnaidm|ruck: https://review.openstack.org/#/c/585020/21:45
mwhahahasshnaidm|ruck: https://bugs.launchpad.net/tripleo/+bug/178319921:46
openstackLaunchpad bug 1783199 in tripleo "puppet-tripleo unit tests broken due to puppet-pacemaker running crm_node" [Critical,Triaged]21:46
*** mcornea has joined #tripleo21:46
sshnaidm|ruckmwhahaha, oops.. just submitted :)21:46
sshnaidm|ruckmwhahaha, I'll make it alerting then, it fail gates21:46
mwhahahasshnaidm|ruck: it should be closed now the revert merged21:47
mwhahahasshnaidm|ruck: it'll clear up shortly21:47
*** agopi|brb has quit IRC21:47
sshnaidm|ruckmwhahaha, ack, thanks21:47
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Don't clean node in ci.centos  https://review.openstack.org/58480121:48
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Set update_repo to gating_repo_name parameter  https://review.openstack.org/58232721:50
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix network config conflicts for containerized UC  https://review.openstack.org/58250821:51
*** holser_ has joined #tripleo21:52
*** dhill_ has quit IRC22:00
*** ohochman has quit IRC22:03
*** lblanchard has joined #tripleo22:03
*** edmondsw has quit IRC22:04
*** holser_ has quit IRC22:06
*** alee has quit IRC22:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226722:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]22:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)22:10
*** cdearborn has quit IRC22:12
*** rh-jelabarre has quit IRC22:12
*** agopi has joined #tripleo22:12
*** gfidente has joined #tripleo22:15
*** gfidente has quit IRC22:15
*** gfidente has joined #tripleo22:15
*** mcornea has quit IRC22:19
*** paramite has quit IRC22:22
*** slaweq has quit IRC22:23
*** owalsh_ has joined #tripleo22:25
openstackgerritOliver Walsh proposed openstack/tripleo-common master: Add disable-nouveau element to tripleo images  https://review.openstack.org/57177922:26
*** owalsh has quit IRC22:28
*** owalsh- has joined #tripleo22:28
*** rlandy has quit IRC22:28
openstackgerritMerged openstack/puppet-pacemaker master: Fix OS versions in metadata  https://review.openstack.org/58289322:30
*** owalsh has joined #tripleo22:31
*** owalsh_ has quit IRC22:31
*** florianf has quit IRC22:32
*** owalsh- has quit IRC22:34
*** wolverineav has quit IRC22:34
*** wolverineav has joined #tripleo22:35
*** owalsh_ has joined #tripleo22:35
*** owalsh has quit IRC22:36
*** wolverineav has quit IRC22:40
*** noslzzp has joined #tripleo22:41
*** bdodd_ has quit IRC22:48
*** bdodd has joined #tripleo22:48
*** karthiks has quit IRC22:50
*** itlinux has joined #tripleo22:53
*** tosky has joined #tripleo22:58
*** noslzzp has quit IRC22:59
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Fix deploy health checks  https://review.openstack.org/58411922:59
*** myoung|bbl is now known as myoung22:59
*** noslzzp has joined #tripleo23:00
jtcressymwhahaha: Is this a case of needing to clean the OSD's? "Error: Can't have a partition outside the disk!"23:03
mwhahahajtcressy: i'm not sure, it might be23:03
*** mschuppert has quit IRC23:04
jtcressyI catted /var/log/mistral/ceph* grepped for "fail" and put it here: https://hastebin.com/sezexacipi23:04
jtcressyseems 3 devices it fails with this error.23:04
mwhahahajtcressy: wonder if something is wrong on that node. that being said fultonj or gfidente would be more versed in the ceph errors23:05
jtcressyThis is what I get when re-running that command manually: https://hastebin.com/upiguranet23:06
gfidentejtcressy looks like there are existing partitions23:07
gfidentebut not sure how it got one bigger than the disk itsel23:07
jtcressyok, i'll clean them out23:07
gfidenteis sdd big enough or an unwanted disk?23:07
jtcressyI think it might have stale metadata from a raid5 volume it used to be a member of.23:08
jtcressywhich explains the big partition23:08
gfidenteah okay23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178226723:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178305523:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged]23:10
openstackLaunchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246)23:10
*** slaweq has joined #tripleo23:11
*** slaweq has quit IRC23:16
*** noslzzp has quit IRC23:16
*** noslzzp has joined #tripleo23:24
*** lblanchard has quit IRC23:26
*** pradk has quit IRC23:26
*** tosky has quit IRC23:27
*** threestrands has joined #tripleo23:30
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Don't run host_prep_tasks from {{role}}HostPrepDeployment  https://review.openstack.org/58505223:37
*** edmondsw has joined #tripleo23:38
slaglestevebaker: have a look at my comment on https://review.openstack.org/#/c/58191723:40
slaglestevebaker: and I think that above patch ^^ will fix it so that you don't need to install the package in the bootstrap script23:41
*** edmondsw has quit IRC23:43
stevebakerslagle: thanks, I'll give it a crack. No wonder it confused me23:43
*** noslzzp has quit IRC23:44
*** noslzzp has joined #tripleo23:46
*** noslzzp has quit IRC23:48
*** noslzzp has joined #tripleo23:50
pabelangerEmilienM: weshay_PTO: http://logs.openstack.org/20/583320/3/gate/tripleo-ci-centos-7-undercloud-containers/9fc3e6a/job-output.txt.gz#_2018-07-23_22_00_17_04577323:51
*** rpioso is now known as rpioso|afk23:51
pabelangerwe should be using the reverse proxy cache for that23:51
*** akhilaki has quit IRC23:52
pabelangerso when rdoproject is down, jobs don't fail23:52
*** brault has joined #tripleo23:53
*** noslzzp has quit IRC23:53
*** noslzzp has joined #tripleo23:54
pabelangersshnaidm|ruck: mwhahaha ^fyi23:54
pabelangerthat is causing tripleo gate to fail, and can we dealt with switching to regional reverse proxy cache of rdoproject.org23:55
*** brault_ has quit IRC23:55
*** noslzzp has quit IRC23:56
*** noslzzp has joined #tripleo23:56
mwhahahapabelanger: I don't think we can get away with that23:57
pabelangerno?23:57
pabelangerI'd expect file to be cached23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!