Monday, 2018-10-01

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256000:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500900:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)00:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)00:10
*** slaweq has joined #tripleo00:11
*** moshele has quit IRC00:12
*** slaweq has quit IRC00:16
*** phuongnh has joined #tripleo01:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256001:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500901:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)01:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)01:10
*** slaweq has joined #tripleo01:11
*** slaweq has quit IRC01:16
*** med_ has joined #tripleo01:18
*** pvc has quit IRC01:20
*** mrsoul has joined #tripleo01:21
*** mschuppert has quit IRC01:24
EmilienMstevebaker: thx for the review, I'll push a patchset tomorrow01:24
EmilienMon paunch01:24
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Set proper setype for service directories  https://review.openstack.org/60053401:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Allow to deactivate SELinux separation for selected containers  https://review.openstack.org/60053501:25
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418001:25
stevebakerEmilienM: ok no problem01:25
EmilienMstevebaker: the podman tag thing doesn't work yet01:25
EmilienMwith cap_add SYS_ADMIN01:25
EmilienMit fails in my env01:25
EmilienMhttp://paste.openstack.org/show/731144/01:25
EmilienMI need to debug01:25
EmilienMprob next week01:26
stevebakerEmilienM: I don't see the actual --cap-add argument in that run command, you may not have that paunch change01:29
EmilienMinteresting01:31
EmilienMok01:31
EmilienMwill dig01:31
*** pvc has joined #tripleo01:50
pvchi01:50
pvci have 2 baremetal server with 3 nic each01:50
pvcshould i do something when running openstack overcloud deploy?01:50
*** Ng__ has quit IRC01:50
*** rbrady has quit IRC01:50
*** med_ has quit IRC01:51
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256002:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500902:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)02:10
*** med_ has joined #tripleo02:10
*** bfournie has joined #tripleo02:15
*** huynq has joined #tripleo02:49
*** huynq has quit IRC02:50
*** HuyNQ has joined #tripleo02:52
*** psachin has joined #tripleo02:56
pvchi guys03:01
pvcanyone03:01
*** pvc has quit IRC03:06
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256003:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500903:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)03:10
*** pvc has joined #tripleo03:20
*** ykarel has joined #tripleo03:27
*** med_ has quit IRC03:59
*** pcaruana has joined #tripleo04:06
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256004:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500904:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)04:10
*** med_ has joined #tripleo04:14
*** shyamb has joined #tripleo04:15
*** pcaruana has quit IRC04:23
*** jaganathan has joined #tripleo04:25
*** ykarel_ has joined #tripleo04:28
*** ykarel has quit IRC04:31
*** ykarel__ has joined #tripleo04:33
*** ykarel_ has quit IRC04:35
*** ykarel__ is now known as ykarel04:37
*** shyamb has quit IRC04:45
*** ramishra has joined #tripleo04:47
*** ykarel_ has joined #tripleo05:00
*** ykarel has quit IRC05:02
*** ykarel__ has joined #tripleo05:04
*** Petersingh has joined #tripleo05:05
*** jfrancoa has joined #tripleo05:05
*** ykarel_ has quit IRC05:06
*** shyamb has joined #tripleo05:07
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256005:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500905:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)05:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)05:10
*** dtrainor_ has quit IRC05:14
*** phuongnh has quit IRC05:36
*** phuongnh has joined #tripleo05:36
*** quiquell has joined #tripleo05:36
quiquellGood morning05:37
*** jaosorior has joined #tripleo05:37
Tenguhello there :)05:38
jaosoriorgood morning!05:39
Tengucan a Monday morning be good?05:41
Tengu:D05:41
jaosoriordepends on how much caffeine you have in your system :D05:41
quiquellTengu: if we are chatting here is no good05:42
Tenguuhuhu05:42
Tenguseeing the topic: no good05:42
quiquelljaosorior: Timeouts are back ?05:42
*** shyamb has quit IRC05:42
jaosoriorare they?05:43
jaosoriorI just logged in05:43
jaosoriorstill checking mail05:43
quiquelljaosorior: One of my stupid revies has being abandoned in the corner with this http://lists.openstack.org/pipermail/openstack-dev/2018-September/135224.html05:43
chandankumarTengu: Hello05:44
chandankumarTengu: I need some help related to podman tempest05:44
*** iranzo has joined #tripleo05:44
*** jbadiapa has joined #tripleo05:45
chandankumarTengu: http://logs.openstack.org/56/605356/10/check/tripleo-ci-centos-7-undercloud-containers/59a4887/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-09-29_14_53_2605:45
Tenguchandankumar: podman, or containers?05:45
jaosoriorquiquell: so, yeah, Friday the gate was stacking up.05:45
chandankumarTengu: It is runned using docker and is working fine05:45
*** shyamb has joined #tripleo05:45
jaosoriornot sure if it's related to timeouts, or why though. thought it would be addressed.05:46
Tenguchandankumar: outch.... volumes in /home... bad news.05:46
chandankumarTengu: but it is kicked using podman at this place http://logs.openstack.org/17/600517/38/check/tripleo-ci-centos-7-undercloud-containers/6e87a75/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-09-28_21_50_5105:46
pvchi guys i just want to ask what is the best approach i can use if have 2 overcloud baremetal nodes with 3 nics.05:46
Tenguchandankumar: yeah, in a standard, selinux-enabled env with separation, containers can't access home_t05:47
chandankumarTengu: xtempest = xtempest that part not working as tempest user is not coming in tempest container as we pull it using podman05:47
chandankumarTengu: so what to do?05:47
TenguERROR tempest [-] [Errno 13] Permission denied: '/home/zuul/tempest/tempest_lock': OSError: [Errno 13] Permission denied: '/home/zuul/tempest/tempest_lock'[00m05:47
chandankumarTengu: Will I move this part to /usr/share dir?05:47
Tenguchandankumar: so in that case (CI) at least, we can imagine adding a SELinux policy for that - but NOT from a container05:47
Tenguchandankumar: might be best to move logs in /var/log/containers maybe? or something like that05:48
chandankumarTengu: yup, let me do that05:48
*** dtrainor_ has joined #tripleo05:48
*** sanjayu_ has joined #tripleo05:49
pvchi guys i just want to ask what is the best approach i can use if have 2 overcloud baremetal nodes with 3 nics. Your response is highly appreciated. Thank you05:49
Tenguchandankumar: small possible issue though: ppl are used to that location, mighe need some rsync post-tests or some symlink.05:50
*** sanjayu_ has quit IRC05:50
jaosoriorquiquell: still, actually, we have patches in the queue which have been there for 8 hours; so definitely still have issues there.05:51
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Create reproducer as post  https://review.openstack.org/60687905:51
*** pcaruana has joined #tripleo05:51
Tenguchandankumar: so the lock might fit in /run or something like that, and the logs in /var/log/containers/tempest for example.05:53
Tenguchandankumar: and don't forget the ":z" flag when mounting05:53
chandankumarTengu: yes, I am thinking this05:53
*** ksambor has joined #tripleo05:53
chandankumaradd a volume /usr/share/tempest_data05:53
chandankumarwhere all operation will happen05:53
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Create reproducer at post.yml  https://review.openstack.org/60688105:53
chandankumarrelated to tempest05:53
Tenguchandankumar: hmm not 100% sure container_t can write in there05:54
Tengubut let's try it05:54
*** dxiri has joined #tripleo05:56
*** assassin has joined #tripleo05:59
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/rocky: Configure undercloud for containerized upgrade.  https://review.openstack.org/60566306:05
*** shyamb has quit IRC06:07
*** med_ has quit IRC06:08
*** shyamb has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256006:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500906:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)06:10
jaosoriorquiquell, chandankumar: Did we land the fixes to ARA's logs gathering?06:12
quiquelljaosorior: You mean overcloud ARA ?06:12
jaosoriorseems we did https://review.openstack.org/#/c/605678/06:13
quiquelljaosorior: We have being playing with this http://dashboard-ci.tripleo.org/d/poOr-d0mk/ansible-exploration?orgId=106:13
quiquelljaosorior: it's tripleo-ci-centos-7-container-multinode ansible taks duration06:14
*** Petersingh is now known as Petersingh|afk06:14
quiquelljaosorior: it's still WIP06:14
jaosoriorthat looks useful06:14
quiquelljaosorior: You can filter with whatever you want at 'influxdb_filter' in the top06:14
quiquelljaosorior: If you lick on it06:14
quiquells/lick/click/ <- pleas don't lick it06:15
quiquelljaosorior: Very useful to filter job_result = TIMED_OUT06:15
*** ratailor has joined #tripleo06:16
jaosoriorinstructions unclear, already licked the top of the screen06:17
*** Petersingh|afk is now known as Petersingh06:17
quiquelljaosorior: Damn now I have to refactor it all to do proper clean-up06:17
*** dxiri has quit IRC06:18
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove references to logging_source  https://review.openstack.org/60364906:18
jaosorior:P06:20
*** assassin has left #tripleo06:20
*** ykarel__ is now known as ykarel06:22
*** mschuppert has joined #tripleo06:22
bandinijaosorior: easy cherry-pick https://review.openstack.org/#/c/606848/ to start your Monday like a champ :)06:34
*** shyamb has quit IRC06:51
*** slaweq has joined #tripleo06:53
*** kopecmartin|off is now known as kopecmartin|rove06:54
*** tosky__ has joined #tripleo06:54
*** shyamb has joined #tripleo06:55
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687907:02
*** quiquell is now known as quiquell|brb07:02
*** pvc has quit IRC07:04
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates stable/rocky: Pacemaker-cinder-volume & pacemaker-cinder-backup log path fix  https://review.openstack.org/60689007:07
*** aufi has joined #tripleo07:09
*** jtomasek has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256007:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500907:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)07:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)07:10
*** dxiri has joined #tripleo07:11
*** shardy has joined #tripleo07:14
*** cylopez has joined #tripleo07:27
*** Petersingh is now known as Petersingh|lunch07:34
*** rdopiera has joined #tripleo07:37
openstackgerritMerged openstack/tripleo-common stable/rocky: Update swift_rings_backup workflow to also backup ceph fetch dir  https://review.openstack.org/60477307:38
*** shyamb has quit IRC07:38
*** jpena|off is now known as jpena07:40
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Make sure that ceph-nfs and the VIP start in the right order  https://review.openstack.org/54503507:41
*** quiquell|brb is now known as quiquell07:41
bandinihttps://review.openstack.org/#/c/606026/ simple enough pike backport07:43
*** dxiri has quit IRC07:48
*** Hobbestigrou has joined #tripleo07:51
*** d0ugal has joined #tripleo07:52
*** jpich has joined #tripleo07:53
*** Damjanek_ is now known as Damjanek07:57
*** saneax has joined #tripleo08:02
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo stable/rocky: Fix postrotate to notify holders of rotated logs  https://review.openstack.org/60686408:04
openstackgerritCédric Jeanneret proposed openstack/tripleo-specs master: removed useless placeholders in spec directories  https://review.openstack.org/58915608:04
openstackgerritCédric Jeanneret proposed openstack/tripleo-specs master: Remove useless placeholders in spec directories  https://review.openstack.org/58915608:04
*** bogdando has joined #tripleo08:04
Tenguhum. should really drop from my mind the "past" for the commit message.08:04
openstackgerritJiri Stransky proposed openstack/tripleo-docs master: Undercloud upgrade docs -- "yum update" necessary packages  https://review.openstack.org/60690008:04
*** gfidente has joined #tripleo08:06
*** kopecmartin|rove is now known as kopecmartin|ruck08:06
*** HuyNQ has quit IRC08:07
*** ykarel_ has joined #tripleo08:07
*** saneax has quit IRC08:09
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Deploy openshift all in one in scenario009  https://review.openstack.org/60378008:09
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs  https://review.openstack.org/58386808:09
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Use glusterfs for registry when deploying with CNS  https://review.openstack.org/60582508:09
*** saneax has joined #tripleo08:09
openstackgerritUdi Kalifon proposed openstack/tempest-tripleo-ui master: Selenium infra  https://review.openstack.org/60542408:09
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256008:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500908:10
*** ooolpbot has quit IRC08:10
*** ykarel has quit IRC08:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)08:10
*** ykarel__ has joined #tripleo08:12
*** ykarel_ has quit IRC08:14
*** ykarel_ has joined #tripleo08:16
*** dalvarez has joined #tripleo08:16
*** saneax has quit IRC08:17
*** pvc has joined #tripleo08:18
*** ykarel__ has quit IRC08:18
*** saneax has joined #tripleo08:19
pvchi sir mandre as discussed can you help me setting up my overcloud baremetal nodes with 3 nics with VLAN08:20
pvcthere is a chance that both nodes can get an IP address but sometimes it cannot get an IP address. sometimes only one can get an IP address. so weird08:20
mandrepvc: does it happen for all the nodes?08:21
pvcyes for my 2 nodes. i have a case that i can get an IP address, also a case only one of my nodes have an IP adress sometimes all nodes doesnt get an IP address.08:22
*** chem has joined #tripleo08:23
*** fhubik has joined #tripleo08:24
mandrepvc: would it be possible for you to check that your equipment if working properly first? if you assign a static IP, can the nodes communicate?08:25
pvcmandre also if i run this command on my nodes "ifup <interface name" it have an IP address from DHCP08:26
pvcnetwork service is failing so it cannot complete the NetworkDeployment progress08:27
*** ykarel__ has joined #tripleo08:28
mandrepvc: do you perhaps have the logs of a failing deployment? which service exactly is failing?08:28
*** HuyNQ has joined #tripleo08:28
pvcthe network service. systemctl status network08:29
pvci will do the static ip mandre. i will just delete my deployment and re deploy it again08:29
mandreit would be interesting to understand why your network service is failing08:29
pvcmandre http://paste.openstack.org/show/731155/08:30
*** paramite has joined #tripleo08:30
*** ykarel_ has quit IRC08:30
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687908:31
mandrepvc: are you sure the interface name is correct? is the cable connected to the right interface?08:32
pvcinterface name of the overcloud node when it is not yet on tripleo deploment mandre?08:32
pvcprevious its int4 int5 int608:33
pvcmandre undercloud interface http://paste.openstack.org/show/731157/08:34
mandrepvc: I don't know where it's picking up the interface name from, but that's where I'd start looking08:34
*** ykarel__ has quit IRC08:34
openstackgerritChandan Kumar proposed openstack/tripleo-heat-templates master: Add tempest workspace volume for tempest  https://review.openstack.org/60598008:34
chandankumarTengu: ^^08:35
pvcthats the interface name of my undercloud08:36
*** ykarel has joined #tripleo08:36
*** holser_ has joined #tripleo08:37
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535608:39
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Switch fs027 to deploy with podman  https://review.openstack.org/60051708:39
*** shyamb has joined #tripleo08:41
Tenguchandankumar: lemme check that :)08:42
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Remove telemetry from tempest skip list  https://review.openstack.org/60431108:43
*** tosky has joined #tripleo08:43
Tenguchandankumar: hmm is the /var/log/tempest still needed?08:43
*** tosky__ has quit IRC08:44
chandankumarTengu: yes, it is for keeping the logs there08:44
Tenguchandankumar: and does the base /usr/share/containers exists?08:44
Tenguchandankumar: aren't they supposed to be pushed in /var/log/containers/tempest?08:44
*** shyamb has quit IRC08:45
Tenguespecially seeing the lin 67 and following08:45
*** shyamb has joined #tripleo08:45
chandankumarTengu: /usr/share/containers does not exists08:45
TenguI think it's done in a different fashion for the other services.08:45
Tenguchandankumar: not sure it will be properly created then - don't remember if the "file" in ansible creates the full tree08:45
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687908:46
chandankumarTengu: I need a volume which I can mount to tempest container to do tempest workspace creation and run tempest tests08:46
chandankumarTengu: let'see how it goes08:46
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Create reproducer at post.yml  https://review.openstack.org/60688108:46
Tenguchandankumar: yeah, understand the need of the volume - the issue might be with ansible not creating the missing directory level.08:47
*** Petersingh|lunch is now known as Petersingh08:47
*** akrivoka has joined #tripleo08:47
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687908:52
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Create reproducer at post.yml  https://review.openstack.org/60688108:53
*** pvc_ has joined #tripleo08:56
pvc_Hi mandre im sorry got dc on my pc08:56
*** derekh has joined #tripleo09:00
*** pvc_ has quit IRC09:01
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo stable/pike: Rework GDPR compliant logrotate config  https://review.openstack.org/60690709:01
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo stable/pike: Fix postrotate to notify holders of rotated logs  https://review.openstack.org/60690809:03
*** aufi has quit IRC09:06
*** aufi has joined #tripleo09:06
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256009:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500909:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)09:10
*** psachin has quit IRC09:17
Tenguflorianf|afk akrivoka heya! Now that the validation framework spce is merged, we might want to organize things - I'd propose a weekly call for "team sync".09:20
ykarelbogdando, hi09:24
akrivokaTengu: sounds good to me09:25
ykarelbogdando, can u check https://ci.centos.org/job/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/415/consoleText seems broken after ur patch https://review.openstack.org/#/c/594055/8/roles/undercloud-deploy/tasks/post-install.yml09:25
ykarelbogdando, it's against master promotion blocker09:25
ykarelquiquell, is there a bug ^^09:26
Tenguakrivoka: you're also CET I think?09:26
akrivokaTengu: yes and florianf|afk as well (though he's away most of this week on vacation)09:26
bogdandoykarel: hi. looking09:26
quiquellmarios: ^09:26
Tenguakrivoka: ok - I'll try to set up a first meeting for next week09:27
*** salmankhan has joined #tripleo09:28
bogdandoykarel: where can I check for collected files09:29
bogdandoneed to see where stackrc really is09:29
ykarelbogdando, stackrc is there09:29
*** shyamb has quit IRC09:30
bogdandowhere is those artifacts, ykarel?09:30
ykarelbogdando, https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-415/09:30
bogdandoykarel:  so The task executes earlier than the stackrc created09:31
ykarelbogdando, nope09:32
ykarelbogdando, i think stackrc creation is part of undercloud install09:32
bogdandooh indeed, that 2018-09-28 21:02 is the job time to collect logs...09:32
ykarelbogdando, the reason seems to be the copy module and the src/dest, looks like u need to use remote_src for this particular copy09:33
bogdandowell crap09:33
bogdandothat stupid remote_src again09:33
bogdando:D09:33
bogdandogot bug link to refer?09:33
*** fhubik is now known as fhubik|brb09:34
ykarelbogdando, don't know if bug is created for htat09:34
bogdandois it promo blocker?09:34
ykarelmay be ruck, rover know09:34
ykarelbogdando, yes09:34
ykarelphase1 not promoting without it09:34
bogdandowho's ruck/rover?09:34
bogdando^^09:34
bogdandotoday09:34
*** sri_ has joined #tripleo09:35
*** phuongnh has quit IRC09:35
ykarelcan't find tagged https://bugs.launchpad.net/tripleo/+bugs?field.tag=promotion-blocker09:35
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Mount /usr/share/ceph-ansible into mistral-executor  https://review.openstack.org/60435709:35
akrivokaTengu: hey sorry forgot that I'm away on Monday next week09:35
mariosquiquell: ykarel ack which job master ... afaics only featureset021 is red @ http://cistatus.tripleo.org/promotion/09:37
*** shyamb has joined #tripleo09:37
ykarelmarios, rdo phase 109:37
Tenguakrivoka: hm. ok. well. lemme finish my current call and I can move it on Tuesday?09:37
akrivokaTuesday works for me09:38
*** ykarel is now known as ykarel|lunch09:38
mariosykarel|lunch: thank09:39
marioss09:39
*** vstinner has joined #tripleo09:39
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Search for stackrc at remote/target undercloud  https://review.openstack.org/60692109:42
mariosykarel|lunch: but last run on http://cistatus.tripleo.org/phase1/ tripleo-quickstart-promote-master-current-tripleo-delorean-minimal09:43
mariosykarel|lunch: is from 23 sept?09:43
mariosykarel|lunch: nm ... the one you pointed at was newer but for some reason not showing up in the cistatus.tripleo09:44
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: move tripleo-ci release files inside CentOS-7 folder  https://review.openstack.org/60564209:48
*** dtantsur|afk is now known as dtantsur09:48
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Create soft links for tripleo-ci release files  https://review.openstack.org/60564309:48
Tenguakrivoka: moved to Tuesday, should be ok then :).09:57
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Do not override resource_registry for UC heat  https://review.openstack.org/60692509:58
*** aedc has joined #tripleo10:00
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Search for stackrc at remote/target undercloud  https://review.openstack.org/60692110:01
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256010:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500910:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)10:10
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Run reproducer at zuulv3 workflow  https://review.openstack.org/60688110:11
openstackgerritMerged openstack/tripleo-quickstart master: Make setup repo task output visible when errored  https://review.openstack.org/59935810:16
openstackgerritMerged openstack/paunch stable/queens: Adjust tenacity mock  https://review.openstack.org/60686710:16
*** ykarel|lunch is now known as ykarel10:17
ykarelmarios, yes may be some issue there in cistatus.tripleo10:18
mariosykarel: ack i filed it with your trace10:19
ykarelack10:19
*** shyamb has quit IRC10:22
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687910:23
*** dciabrin has joined #tripleo10:23
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Run reproducer at zuulv3 workflow  https://review.openstack.org/60688110:23
*** Petersingh is now known as Petersingh|afk10:33
*** boazel has quit IRC10:35
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687910:35
*** shyamb has joined #tripleo10:35
openstackgerritMerged openstack/paunch stable/rocky: Adjust tenacity mock  https://review.openstack.org/60686510:39
*** shyamb has quit IRC10:42
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Remove unused parameter NeutronEnableDHCPAgent  https://review.openstack.org/60692810:43
*** jfrancoa has quit IRC10:43
*** yprokule has joined #tripleo10:44
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove references to logging_source  https://review.openstack.org/60364910:46
*** salmankhan1 has joined #tripleo10:46
chemjfrancoa quiquell so emit release cannot work for upgarde, I've made a bz for standalone but I think it would be an issue for plain upgrade as well10:47
quiquellchem: What do you mean it cannot work for upgrade ?10:48
*** salmankhan has quit IRC10:48
*** salmankhan1 is now known as salmankhan10:48
chemquiquell: https://bugs.launchpad.net/tripleo/+bug/179536710:48
openstackLaunchpad bug 1795367 in tripleo "repo-setup not working correctly during emit_release upgrade jobs." [Critical,New]10:48
chemquiquell: repo-setup is failing the second time we run it during upgrade10:48
chemquiquell: all the time, because of https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/tasks/get-dlrn-hash-newest.yml#L36..L4010:49
chemquiquell: pushing a review now ...10:49
openstackgerritMerged openstack/paunch stable/rocky: import zuul job settings from project-config  https://review.openstack.org/59784810:53
openstackgerritMerged openstack/paunch stable/queens: import zuul job settings from project-config  https://review.openstack.org/59783110:53
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687910:54
quiquellchem: For upgrades the dlrn hash have to be differnt upgrade playbook ?10:56
chemquiquell: well, we use the rocky hash in a master url10:56
chemquiquell: we use   http://mirror.sjc1.vexxhost.openstack.org:8080/rdo/centos7/c9/d0/c9d085729f62dfcfeeaecccf36c3c0161414afb7_b01817dd/delorean.repo10:57
chemquiquell: while c9d085729f62dfcfeeaecccf36c3c0161414afb7_b01817dd correspond to rocky10:57
chemquiquell: http://mirror.sjc1.vexxhost.openstack.org:8080/rdo/centos7-rocky/c9/d0/c9d085729f62dfcfeeaecccf36c3c0161414afb7_b01817dd/delorean.repo10:57
quiquellchem: so the calculation for hash target_release is wrong ?10:58
chemquiquell: no, it's not happening10:58
chemquiquell: because of https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/tasks/main.yml#L6..L710:58
quiquellchem: Have you figure it out or do you need some help ?10:58
chemquiquell: I'm testing solution right now, will let you know when I've got one that works10:59
chemquiquell: I'll take this offer back if I'm stalling :)10:59
quiquellchem: ack, let me know, don't get what's the difference between this and previous queens->rocky10:59
* quiquell hides10:59
*** shyamb has joined #tripleo10:59
*** anande has joined #tripleo11:00
*** anande has quit IRC11:01
chemquiquell: we don't use emit_release mechanism, or I misunderstood your questin11:02
quiquellchem: we don't ?11:03
chemquiquell: do we ?11:03
quiquellchem: what featureset ?11:03
chemquiquell: I've got the issue in the standalone-upgrade jobs11:04
chemquiquell: 05611:04
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687911:04
openstackgerritSam Betts proposed openstack/tripleo-heat-templates master: Remove incorrect mapped_data key from cisco ml2 hieradata  https://review.openstack.org/60039611:04
*** boazel has joined #tripleo11:04
openstackgerritSam Betts proposed openstack/tripleo-heat-templates master: Add helper resource for converting string to map  https://review.openstack.org/60071311:05
quiquellchem: It is the standalone ?11:05
openstackgerritSam Betts proposed openstack/python-tripleoclient master: Ensure that the --template-file option is passed to the kolla builder  https://review.openstack.org/60039311:06
quiquellchem: ensure that the fs is here https://github.com/openstack-infra/tripleo-ci/blob/master/playbooks/tripleo-ci/templates/toci_gate_test.sh.j2#L11811:06
chemquiquell: https://review.openstack.org/#/c/605363/611:06
quiquellchem: yes we reun emit releases (sorry I totally forgot about this)11:07
quiquellchem: emit releases is the one picking the hash for upgrade playbook11:07
quiquellchem: at at 'standalone_target_hash' variable11:08
chemquiquell: but only for dlrn_hash with create delorean repo conf, not for dlrn_hash_tag_newest which creates delorean-current11:09
*** Petersingh|afk is now known as Petersingh11:10
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256011:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500911:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)11:10
openstackgerritMerged openstack/tripleo-common stable/rocky: Set prepare neutron_driver from NeutronMechanismDrivers  https://review.openstack.org/60587011:10
openstackgerritMerged openstack/paunch stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/59633211:10
openstackgerritMerged openstack/puppet-tripleo stable/rocky: Make sure rhel-plugin-push.service is stopped after pacemaker stops  https://review.openstack.org/60684811:10
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Do not disable ipv6 on loopback interface for epmd  https://review.openstack.org/60602611:10
quiquellchem: so master have to point alwasy to dlrn_hash_tag_newest  ?11:11
chemquiquell: don't get the question :)11:11
*** dpeacock has quit IRC11:11
quiquellchem: The real question is what do we need dlrn_hash_tag_newest for ?11:15
*** dpeacock has joined #tripleo11:15
chemquiquell: dlrn_hash_tag_newest is used to create delorean-current repo11:15
quiquellchem: and deloran-current is only used for 'master' release ?11:16
chemquiquell: nope11:17
chemquiquell: but we get the rocky hash in the master url11:18
chem11:18
chemquiquell: I guess the lp isn't clear enough :)11:19
chem11:19
*** HuyNQ has quit IRC11:19
chemquiquell: or I'm missing something11:19
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687911:21
quiquellchem: so emit releases script has to calculate dlrn_hash_tag_newest too ?11:23
*** abishop_ has quit IRC11:24
chemquiquell: dunno what is the best solution ... and even when those tasks are run (calculate the newest stuff) it's doesn't end up in the repo_setup_upgrade.sh script so something else is also at work there ... ping you11:24
chems/ping you//11:25
quiquellchem: ok, let me know where you end, but everything that it's related to calculate release and hash have to end up at emit_releases script11:25
quiquellchem: To unit tests and consolidate the logic11:26
chemquiquell: ah, ok, when I've got the hang of it I make sure the solution end up there then, thanks for the input11:26
quiquellchem: ack, cool11:26
*** jaosorior has quit IRC11:27
*** ratailor has quit IRC11:29
*** jpena is now known as jpena|lunch11:30
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687911:31
*** Tengu has quit IRC11:32
*** Tengu has joined #tripleo11:32
*** weshay_ruck is now known as weshay11:32
weshaychem, quiquell ya.. tricky problem here ^11:39
weshaychem, I thought we narrowed down the problem to the create-repo/main.yml task11:40
chemweshay: well, it can't be the root problem, I tried to put as best I could in the lp issue11:40
chemweshay: I'm starting to think that even the -e dlrn_hash from emit release isn't taken into consideration ... I'll continue testing and let you know11:42
quiquellweshay: yep, will try to help there11:43
chemweshay: I just understood why you guys needed to open up the hash ... to be able to get at which particular repo you were pointing at the time of testing ... this is hell11:45
weshaychem, if the release is correct, you should only need the hash11:45
weshaychem,  the url path, centos-master, centos-queens etc.. is hard coded in the release config file11:46
chemweshay: right11:46
*** ansmith has quit IRC11:46
Tenguakrivoka: beside florianf|afk, do you see any other person to add to the meeting? Or we can discuss that maybe on Tuesday - I've already added chem as he's interested :).11:46
weshaychem, I wanted to ask what is expected workflow for that job?11:47
akrivokaTengu: maybe gchamoul11:47
Tenguakrivoka: will poke him and discuss that a bit then.11:47
weshayis it a same release update/upgrade from the same dlrn hash to new?11:47
chemweshay: ? which jobs standalone upgrade ?11:47
* weshay looks at your bug11:47
chemthanks11:47
weshayso I'm sure I'm talking about that one.. I'm still operating w/ Friday's info11:47
gchamoulakrivoka, Tengu: oh yeah thanks11:50
Tengugchamoul: ok :). Adding you to the BJ - care to share me your mail address?11:50
weshaychem, ya.. ok11:51
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535611:51
weshayhttp://logs.openstack.org/06/604706/17/check/tripleo-ci-centos-7-standalone-upgrade/4f42f2e/logs/emit_releases_file.log11:51
weshaychem, you are passing master for the deploy and the upgrade11:51
weshayquiquell, ^11:51
weshaychem, quiquell 6be368f50cb5136fb00410d04db7490164be0fdf_1bb5bbf5 is rocky11:52
weshaythat's the problem11:52
weshayemit releases needs to pass rocky for the deply11:52
weshayand then this will work11:52
chemweshay: I don't think it's the problem11:53
*** rh-jelabarre has joined #tripleo11:53
weshaychem, can I show you?11:53
chemweshay: yeah11:53
quiquellweshay: http://logs.openstack.org/06/604706/17/check/tripleo-ci-centos-7-standalone-upgrade/4f42f2e/logs/releases.sh11:53
quiquellweshay: ^ that's ok11:53
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role  https://review.openstack.org/60535611:53
quiquellweshay: export STANDALONE_TARGET_HASH="1e2db34c7fabe8591b3a84edaf92e313016caaaa_9e598812"11:53
quiquellthat's master11:54
weshayhttps://bluejeans.com/u/whayutin/11:54
chemweshay: yeah, agree with quiquell that's file is correct11:54
weshayya.. the target is fine11:54
quiquellweshay: and the deploy too11:54
weshayquiquell, no11:54
weshayquiquell, the deploy is a hash that belongs to rocky11:54
quiquellweshay: and that's correct we are at rocky->master11:54
chemweshay: this is expected11:54
openstackgerritMerged openstack/tripleo-docs master: Undercloud upgrade docs -- "yum update" necessary packages  https://review.openstack.org/60690011:54
weshayquiquell, chem then you must pass --release rocky11:55
quiquellweshay: deploy has to be rocky11:55
weshayyes11:55
chemweshay: it's done11:55
weshayk11:55
* weshay checks.. emit_release does look right.. 11:56
weshayhttp://logs.openstack.org/06/604706/17/check/tripleo-ci-centos-7-standalone-upgrade/4f42f2e/job-output.txt.gz#_2018-09-28_19_09_06_06854611:56
weshayya.. that's right11:56
weshaysorry11:56
quiquellweshay: They issue is with other hash we have to handle that points to delorean-current11:57
chemweshay: quiquell that and I think now that repo-setup is flawed as well11:57
quiquellchem: That's my primitive view of it :-)11:57
weshayto current?11:57
weshayor tripleo-current11:57
weshay1e2db34c7fabe8591b3a84edaf92e313016caaaa_9e59881211:57
weshaythis is the right hash for master /1e2db34c7fabe8591b3a84edaf92e313016caaaa_9e59881211:58
chemweshay: delorean-current11:58
*** quiquell is now known as quiquell|lunch11:59
chemweshay: we use the delorean-current hash from rocky when we run master.yml release11:59
weshay01e404f5c24d883f88a7e061214004351d7f41fd_847583c011:59
weshaychem, oh that's not good11:59
weshayshould be current-tripleo11:59
shyambHi12:00
shyambIs is this syntax of heat template correct?12:00
chemweshay: basically https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L38..L39 has the hash that point to rokcy12:00
shyambhttp://paste.openstack.org/show/731170/12:00
shyambI want to make command value dynamic12:00
shyambTengu: shardy:12:01
chemweshay: so master is currently 01e4 or 1e2d ?12:02
weshayhrm.. this is odd https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L1812:02
weshaynot sure what that is for12:02
*** raildo has joined #tripleo12:02
weshayhttps://trunk.rdoproject.org/centos7-master/current-tripleo/delorean.repo12:02
chemweshay: rigth :)12:02
*** amoralej is now known as amoralej|lunch12:03
weshayhrm.. I wonder why the newest hash is default12:05
weshaychem, if the default was current-tripleo that fix this?12:05
EmilienMhi all12:07
chemweshay: I don't think so as it's a cached variable12:07
EmilienMquestion: is anyone aware of failing scenarios in gate?12:07
*** abishop_ has joined #tripleo12:07
EmilienM1 2 3 at very least12:07
chemweshay:   you're talking about default in there rigth -> rdo_dlrn=`curl ${NODEPOOL_RDO_PROXY}/centos7/{{ dlrn_hash_path_newest|default(dlrn_hash_tag_newest, true) }}/delorean.repo -S 2>>~/dlrn_repo_curl_errors.log | grep baseurl | cut -d= -f2`12:07
weshayEmilienM, we're in the seals call atm12:07
weshayEmilienM, I saw the gate failures spike last night, not sure why12:08
weshaymarios|rover, kopecmartin|ruck ^12:08
weshay27 fails in 24 hrs12:08
*** abishop_ has quit IRC12:08
weshayis oz online?12:08
weshayEmilienM, ?12:09
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: SSH to node before validating services.  https://review.openstack.org/60693412:09
*** abishop_ has joined #tripleo12:09
weshaymarios|rover, kopecmartin|ruck can you guys join in my blue after the seals12:09
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: [WIP]Unskip neutron tempest plugin tests  https://review.openstack.org/60693712:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256012:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500912:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)12:10
*** jaosorior has joined #tripleo12:10
EmilienMweshay: yes ^12:11
weshayEmilienM, hrm.. http://logs.openstack.org/41/597441/5/gate/tripleo-ci-centos-7-containers-multinode/4ebadb3/logs/undercloud/var/lib/mistral/overcloud/12:12
weshayno errors file12:12
weshayEmilienM, related to the ansible version?12:13
EmilienMI'll look this morning12:13
* weshay gets coffee12:13
*** vstinner has left #tripleo12:13
weshayjaosorior, please kill the gate jobs12:14
weshayjaosorior, EmilienM http://logs.openstack.org/41/597441/5/gate/tripleo-ci-centos-7-containers-multinode/4ebadb3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz12:15
EmilienMyes I know12:15
EmilienMwe talked about this over the weekend with alex12:15
EmilienMbut this log says nothing12:15
weshayya12:15
weshayI've never seen ansible fail like that12:15
jaosoriorweshay: I can. Although, the gate doesn't look too bad right now. there's 4 jobs running on the gate and they haven't been waiting too long.12:16
*** dprince has joined #tripleo12:16
weshayjaosorior, I think all the jobs are down http://cistatus.tripleo.org/12:16
jaosoriordafuq12:17
weshayjaosorior, note the downward triangle12:17
chandankumarbogdando: EmilienM mandre I need some feedback on this review https://review.openstack.org/60598012:17
weshaymarios|rover, kopecmartin|ruck my blue please12:18
kopecmartin|ruckweshay, sure, what's the link?12:18
*** lblanchard has joined #tripleo12:18
chandankumarbogdando: EmilienM mandre I am thinking of creating a volume which has read/write permission for all tempest related stuff12:18
marios|rover4113567798 weshay bluejeans whayutin12:18
weshaykopecmartin|ruck, https://bluejeans.com/411356779812:18
marios|roverkopecmartin|ruck: ^12:18
marios|roverjoining12:18
jaosoriorweshay: gate cleared12:19
weshayjaosorior, these are not time outs12:19
weshayhttp://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=61&fullscreen12:19
weshaythese are failures12:19
jaosoriorlets check out the logs12:20
beaglesbogdando: thanks for getting the podman stuff on the go - between release blockers and being sick last week I just didn't get to it12:20
*** rfolco has joined #tripleo12:21
chemweshay: do you know way to look at the cached variable in ansible ?12:21
weshaykopecmartin|ruck, marios|rover http://cistatus.tripleo.org/12:21
*** mmethot has joined #tripleo12:21
weshaykopecmartin|ruck, marios|rover http://logs.openstack.org/41/597441/5/gate/tripleo-ci-centos-7-containers-multinode/4ebadb3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz12:22
marios|roverweshay: sorry have to rejoin https://review.rdoproject.org/etherpad/p/ruckrover-sprint2012:22
shyambUsing this one12:23
shyambhttp://paste.openstack.org/show/731173/12:23
shyambstr_replace method12:23
shyambI belive I am on track12:23
weshaymarios|rover, kopecmartin|ruck https://review.openstack.org/#/c/60429812:24
marios|roverhttp://logs.openstack.org/45/560445/151/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/527630d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-01_10_03_0012:24
marios|roveralso scen 2 @ http://logs.openstack.org/45/560445/151/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/cd439d5/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-01_10_03_0512:24
jaosorioruhm... mostly different errors, but a bunch of them have the same: Exception getting deployment failures: Ansible errors file not found at /var/lib/mistral/overcloud/ansible-errors.json12:25
jaosorioranybody knows what's up with that? ^^12:25
weshaymarios|rover, kopecmartin|ruck http://logs.openstack.org/98/604298/14/check/tripleo-ci-centos-7-containers-multinode/ec42f6d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-01_10_02_5412:25
marios|roverhttps://bugs.launchpad.net/tripleo/+bug/1795009 weshay12:25
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)12:25
marios|roverhttps://review.openstack.org/#/c/606179/112:27
marios|roverweshay:12:27
marios|roverweshay: https://semaphore.cloud.upshift.engineering.redhat.com/12:29
marios|roverkopecmartin|ruck:12:29
*** moguimar has joined #tripleo12:29
*** salmankhan1 has joined #tripleo12:30
chandankumarjaosorior: please restore this patch https://review.openstack.org/#/c/603621/ I need to consume it for telemetry tests12:30
jaosoriorchandankumar: done12:31
chandankumarjaosorior: thanks :-)12:31
*** jpena|lunch is now known as jpena12:31
marios|roverweshay: kopecmartin|ruck new rdo promotion bug from today https://bugs.launchpad.net/tripleo/+bug/1795348 fyi12:31
openstackLaunchpad bug 1795348 in tripleo "tripleo-quickstart-promote-master-current-tripleo-delorean-minimal is failing "undercloud-deploy : Copy stackrc created at the UC user $HOME to the working dir] ***" " [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando)12:31
weshayEmilienM, jaosorior the gate failures atm12:31
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Remove telemetry from tempest skip list  https://review.openstack.org/60431112:31
weshaysorry.. marios|rover is driving those.. it looks like the ansible version is still incorrect12:32
*** quiquell|lunch is now known as quiquell12:33
jaosoriormarios|rover: bogdando was working on that one https://review.openstack.org/#/c/606921/12:33
jaosoriorah, you reviewed it as well12:33
jaosoriorcool cool12:33
openstackgerritMartin André proposed openstack/tripleo-docs master: Consistently use literals for long options  https://review.openstack.org/60694012:33
*** med_ has joined #tripleo12:33
marios|roverjaosorior: ack12:33
marios|roverthanks12:33
*** salmankhan has quit IRC12:34
*** salmankhan1 is now known as salmankhan12:34
quiquelljaosorior: I don't see so much timeouts, it's still forbiden to workflow stuff ?12:34
jaosoriorquiquell: there are no timeouts at the moment, but it seems that we're hitting failures12:34
quiquelljaosorior: humm ack12:35
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Run reproducer at zuulv3 workflow  https://review.openstack.org/60688112:36
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687912:36
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Run reproducer at zuulv3 workflow  https://review.openstack.org/60688112:37
*** ykarel_ has joined #tripleo12:37
weshayjaosorior, marios|rover so the patch to watch is still https://review.openstack.org/#/c/606179/12:37
weshayright?12:37
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Run reproducer at zuulv3 workflow  https://review.openstack.org/60688112:37
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: WIP: Run reproducer at zuulv3 workflow  https://review.openstack.org/60688112:38
jaosoriorweshay: that's the only one I'm aware for regarding the ansible issue. For the stackrc issue that marios mentioned, it's https://review.openstack.org/#/c/606921/12:38
mariosweshay: thats for the ansible pinning yes12:38
mariosjaosorior: right12:38
weshayjaosorior, you can prioritize that one?12:38
mariosweshay: https://bugs.launchpad.net/tripleo/+bug/1795348 this is the stackrc one12:38
openstackLaunchpad bug 1795348 in tripleo "tripleo-quickstart-promote-master-current-tripleo-delorean-minimal is failing "undercloud-deploy : Copy stackrc created at the UC user $HOME to the working dir] ***" " [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando)12:38
mariosthat jaosorior mentions12:38
*** ykarel has quit IRC12:39
jaosoriorweshay: not me. "infra-root" folks. Gotta ask in the #infra channel. However, I think there's no need as the gate is clear12:40
weshayk k12:40
jaosoriorweshay, marios: And bogdando's patch will fail at the gate with the ansible issues. So, mwhahaha's patch needs to merge first anyway12:41
weshayyup12:42
*** ramishra has quit IRC12:46
bogdandobeagles: hi. around to talk about https://review.openstack.org/#/c/606095/1//COMMIT_MSG ?12:46
beaglesbogdando: I'm around but in meetings most of the morning12:46
beaglesbogdando: ah this meeting finished early so I have 13 minutes :)12:47
bogdandobeagles: nice! So perhaps I should keep things stopped and removed as is, for now12:47
beaglesbogdando: so yeah, what I was getting at is that a neutron agent spawns lots of sidecars12:48
openstackgerritJames Slagle proposed openstack/tripleo-common stable/rocky: Add config_download_timeout input  https://review.openstack.org/60694212:48
bogdandoI have no ideas how to handle "broken" containers12:48
jaosoriorfuck. the ansible fix timed out..12:48
beaglesbogdando: even of the same type e..g you can have neutron-dnsmaq-foo neutron-dnsmasq-bar running and then start neutron-dnsmasq-alice12:48
bogdandobeagles: may be it should be the neutron who spawns it, to kill them as well :)12:48
beaglesbogdando: so you can't cleanup foo and bar jsut because you are starting alice12:49
beaglesbogdando: neutron does kill them, but through the pid files12:49
bogdandoif that so, we'll see no difference to just sending sigkill to a process, in container or not12:49
bogdandooh, pid files12:49
*** morazi has joined #tripleo12:49
bogdandoso we gonna need pid files, beagles12:49
beaglesbogdando: the killed containers won't be laying around in an unstarted state12:49
beagles?12:50
*** aedc has quit IRC12:50
bogdandothey will :) good point12:50
beaglesbogdando: yup or we reconcile based on network namespaces, not names12:50
bogdandoso right, pid files and removing stopped containers perhaps, what's what those wrappers must do12:50
*** shyamb has quit IRC12:51
*** jcoufal has joined #tripleo12:51
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Create CentOS-7 soft links for future location of release files  https://review.openstack.org/60694312:51
beaglesbogdando: so if we "ip netns" and we have a name that doesn't match any existing network namespace it should just go away - although that probably won't work because I bet we can't delete a namespace if there is a container, running or not, that is meant to run int12:51
beaglesbogdando: yeah, I think pid files are safest12:51
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687912:51
*** dxiri has joined #tripleo12:51
jaosoriorweshay, marios: Hmm...kay.... the fix that was supposed to fix the ansible issues still failed with the same issue it was trying to fix http://logs.openstack.org/79/606179/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a7d1911/logs/undercloud/home/zuul/overcloud_deploy.log.gz12:52
beaglesoh shoot12:52
beaglesbogdando: it's actaully a lot simpler than that sorry12:52
beaglesbogdando: can we list the containers that match a filter that are *NOT* running12:53
bogdandoyes12:53
beaglesbogdando: if so, we just clean those up12:53
bogdandoyes. And those pidfiles need to be added for wrappers12:53
beaglesbogdando: wait why ?12:53
bogdandoso neutron can control them12:54
bogdandoyou said it does via pidfiles12:54
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: [WIP] Enable full tempest api and scenario tests for basic services  https://review.openstack.org/60604612:54
mariosjaosorior: weshay well, i added a comment saying it has ansible 2.5.2 and i mwhahaha change is meant to pin to 2.4.4 via ara 0.15. However, his comment at https://review.openstack.org/#/c/606179/1/roles/undercloud-setup/defaults/main.yml seems to suggest 2.5 is OK so perhaps it doesn't affect master, because 2.5 and the fail there is for something other than the ansible version12:54
beaglesbogdando: the command lines should cause the pidfiles to be written already and neutron uses those12:54
bogdandoI mean controlling processes, not containers12:54
bogdandobeagles: nice, I'll check that12:54
*** jroll has quit IRC12:54
beaglesbogdando: thats' basically how it works now12:55
*** tzumainn has joined #tripleo12:55
bogdandohm, I missed that somehow12:55
*** jroll has joined #tripleo12:55
mwhahahamarios: check the follow up patches that fix it on a branch basis12:55
beaglesbogdando: eg. the command line for dnsmasq has this --pid-file=/var/lib/neutron/dhcp/023a6e3b-d5d3-4465-ba3a-1d098aa28f41/pid12:55
bogdandobeagles: do you think we should also move changes for priv mode to capabilities into other patch?12:56
*** thrash|g0ne is now known as thrash12:56
beaglesbogdando: not sure what you are referring to12:57
*** srini_ has joined #tripleo12:57
*** mmethot_ has joined #tripleo12:57
bogdandohttps://review.openstack.org/#/c/606045/1/docker/services/neutron-l3.yaml beagles12:57
*** artom has quit IRC12:58
*** mmethot has quit IRC12:58
*** sri_ has quit IRC12:58
mariosmwhahaha: thanks will check in  bit12:59
*** mjturek has joined #tripleo12:59
beaglesbogdando: mmm.. still not sure what you mean by that question. FWICT this patch only has that change so I must be misunderstanding13:00
bogdandoI mean I'll not include that change into the main unit of work13:01
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Swap soft linked config/release files with targets  https://review.openstack.org/60694413:03
beaglesbogdando: ah okay13:03
*** cylopez has quit IRC13:04
*** ansmith has joined #tripleo13:04
beaglesbogdando: IIUC  we need the capability mode to be able to run this stuff so we should leave in place...13:07
beaglesbogdando: just reallized probably need to add podman to the kolla container too13:07
*** beagles is now known as beagles_mtg13:07
bogdandoright13:09
*** shyamb has joined #tripleo13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256013:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500913:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)13:10
*** toure|gone is now known as toure13:11
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow  https://review.openstack.org/60687913:11
openstackgerritBogdan Dobrelya proposed openstack/tripleo-common master: Add podman for neutron server packages  https://review.openstack.org/60694613:13
*** srini_ has quit IRC13:14
jaosoriormwhahaha: which follow up patches?13:15
beagles_mtgbogdando: I'll take care of that in a bit after I get clear of these meetngs13:15
EmilienMweshay: hey, have you seen that? http://logs.openstack.org/34/600534/16/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/81a4032/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-01_10_03_3113:15
bogdandobeagles_mtg: https://review.openstack.org/606946 :)13:15
beagles_mtgbogdando: awww snap13:15
bogdandoI'll rework the puppet wrappers et al13:16
bogdandoto use exited only filters13:16
*** shyamb has quit IRC13:17
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: DNM: OVN test  https://review.openstack.org/59305613:20
*** mcornea has joined #tripleo13:20
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: add support for distro and major release delineation  https://review.openstack.org/60584313:20
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: add support for distro and major release delineation  https://review.openstack.org/60584313:20
*** ykarel_ is now known as ykarel13:21
*** amoralej|lunch is now known as amoralej13:21
*** dxiri has quit IRC13:24
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: DNM: OVN test  https://review.openstack.org/59305613:25
EmilienMmarios: sorry if question was already asked - but are you aware of scenarios issues in gate on master?13:27
EmilienMI see some ceph-ansible errors13:27
EmilienMhttp://logs.openstack.org/34/600534/16/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/81a4032/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-01_10_03_3113:27
openstackgerritmathieu bultel proposed openstack/tripleo-quickstart master: Switch upgrade job to master to master  https://review.openstack.org/60694813:28
EmilienMhttp://logs.openstack.org/34/600534/16/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/81a4032/logs/undercloud/var/lib/mistral/overcloud/ceph-ansible/ceph_ansible_command.log.txt.gz#_2018-10-01_10_01_32_57813:28
EmilienM{"msg": "The conditional check 'ceph_docker_image_tag | search(\"ubuntu\")' failed. The error was: [Errno 32] Broken pipe\n\nThe error appears to have been in '/usr/share/ceph-ansible/roles/ceph-defaults/tasks/facts.yml': line 204, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: set_fact ceph_uid for debian based system -13:28
EmilienMcontainer\n  ^ here\n"}13:28
EmilienMgfidente, fultonj ^ are we already tracking this bug?13:28
EmilienMI wonder if it's because of https://github.com/ceph/ceph-ansible/commit/4db6a213f72fef5f3cdabdb8adeb9dd8b25df5c213:29
*** vinaykns has joined #tripleo13:32
mwhahahajaosorior: see the topic of the original patch. I used the same for the other patches13:32
jaosoriorbandini, dciabrin: did you guys figure out how to disable the metadata usage via t-h-t?13:32
* mwhahaha will dig them up when he gets back to a computer13:33
bandinijaosorior: we have a plan but no reviews yet (there is yet another bug we are debugging atm)13:34
bandini(keystone-manage hangs)13:34
jaosoriorack13:35
gfidenteEmilienM first time I see that13:37
gfidenteEmilienM and this should be same version of ceph-ansible we're using from quite some time13:37
*** akrivoka has quit IRC13:40
*** akrivoka has joined #tripleo13:40
*** dxiri has joined #tripleo13:41
fultonjgfidente: reminds me of https://review.openstack.org/#/c/604357/2/environments/undercloud.yaml13:41
*** dxiri has quit IRC13:45
*** cylopez has joined #tripleo13:46
EmilienMchandankumar: hey, for https://review.openstack.org/#/c/600517 I'm wondering if we can remove your dependencies so we can land it asap and iterate with your patch after that13:47
EmilienMchandankumar: so in first iteration we would deploy podman on the undercloud except for tempest, which would run with docker13:47
EmilienMchandankumar: and in your iteration we would run tempest in podman13:47
EmilienMchandankumar: I really want https://review.openstack.org/#/c/600517 merged asap13:47
EmilienMwdyt?13:47
*** jaosorior has quit IRC13:48
gfidentefultonj sorry I don't follow how the things are related13:48
fultonjonly in that we're talking adding a mount option like :z or :ro13:49
fultonjgfidente: i.e. never mind about the other review13:50
mariosEmilienM: yeah aware thanks looks like 2018-10-01 12:03:27 | task path: /var/lib/mistral/overcloud/external_deploy_steps_tasks.yaml:124 e.g. http://logs.openstack.org/79/606179/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a7d1911/logs/undercloud/home/zuul/overcloud_deploy.log.gz13:51
mariosEmilienM: in a call but will file the bug with pointers in a bit13:51
*** aufi has quit IRC13:51
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci master: Move update job back to voting on gate check  https://review.openstack.org/60695213:54
*** artom has joined #tripleo13:57
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates stable/rocky: Add a fact checking xinetd service present  https://review.openstack.org/60695514:01
chandankumarEmilienM: yes, good to go14:02
*** dxiri has joined #tripleo14:02
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Add missing collectd documentation  https://review.openstack.org/60695614:04
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets  https://review.openstack.org/60609514:04
openstackgerritCarol Bouchard proposed openstack/tripleo-heat-templates master: CiscoNexus: Update and Remove deprecated vars  https://review.openstack.org/60695814:06
*** Petersingh has quit IRC14:09
*** ooolpbot has joined #tripleo14:10
*** vinaykns has quit IRC14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256014:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500914:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)14:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)14:10
*** rbrady has joined #tripleo14:11
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Don't merge /etc/collectd.d  https://review.openstack.org/60696114:11
*** Vorrtex has joined #tripleo14:11
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: mysql: use clustercheck credentials to poll galera state  https://review.openstack.org/60361214:12
mschuppertmwhahaha: could you please review https://review.openstack.org/594145 again where you set the -1 and as a follow up https://review.openstack.org/594150 ?14:13
mwhahahamschuppert: k14:14
mschuppertmwhahaha: thx!14:14
mwhahahamschuppert: queens scenarios are broken at the moment due to an unrelated bug, so we'll have to wait to merge14:15
mschuppertmwhahaha: ok thx14:15
*** lblanchard has quit IRC14:15
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/queens: Don't merge /etc/collectd.d  https://review.openstack.org/60696314:16
*** agopi|brb is now known as agopi14:16
openstackgerritCarlos Goncalves proposed openstack/puppet-tripleo master: Enable TLS in the internal network for Octavia API  https://review.openstack.org/59703814:17
*** vinaykns has joined #tripleo14:19
*** beekneemech is now known as bnemec14:21
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: SSH to node before validating services.  https://review.openstack.org/60693414:21
*** aufi has joined #tripleo14:22
chandankumarEmilienM: at which place we are building the tempest container locally using podman?14:24
chandankumarlocally i mean on undercloud14:25
*** itlinux has quit IRC14:25
*** aufi has quit IRC14:25
*** aufi has joined #tripleo14:26
trownmandre: https://review.openstack.org/603050 broke the openshift job, since we dont have the Infra role there yet http://logs.openstack.org/50/603050/3/check/tripleo-ci-centos-7-scenario009-multinode-oooq/8b373e9/logs/undercloud/var/lib/mistral/overcloud/openshift/playbook.log.txt.gz14:29
trownmandre: I wonder if rather than revert, we just make a patch to THT to include that Infra role in the scenario00914:30
EmilienMchandankumar: we pull it from the mirrors, we don't build it on the undercloud. What's the issue with the tempest container?14:31
chandankumarEmilienM: tempest user is missing from the container http://logs.openstack.org/17/600517/39/check/tripleo-ci-centos-7-undercloud-containers/a5e94da/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-01_13_03_3114:31
openstackgerritRajini Karthik proposed openstack/puppet-tripleo master: Dell EMC SC: Add support for excluded_domain_ips  https://review.openstack.org/60444414:32
EmilienMchandankumar: interesting. I'll take a look14:32
trownmandre: maybe we could reorder patches so allinone is lower ... trying with just that and the haproxy patch to see if that fixes the job14:32
*** pvc_ has joined #tripleo14:34
pvc_hi @mandre14:35
pvc_just got home can we talk again my issue about check cable?14:35
derekhif anybody has time to review https://review.openstack.org/#/c/582294/ (see depends on patches) I'd appreciate it, trying to get a CI job running that runs ironic in overcloud14:37
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Pass stack name to enable_ssh_admin workflow  https://review.openstack.org/60696414:37
chandankumarmwhahaha: hello14:41
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch fs027 to deploy with podman  https://review.openstack.org/60051714:41
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch fs027 to deploy with podman  https://review.openstack.org/60051714:41
chandankumarmwhahaha: in order to enable this test http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/config/general_config/featureset005.yml#n34 test in standalone which changes I nedd to make in standalone14:41
chandankumarmwhahaha: compute volume related scenario tests are broken14:41
chandankumar*not working in standalone14:42
mwhahahachandankumar: what do you nee to fix?14:42
mariosweshay: EmilienM mwhahaha fyi i think there are two different issues (at least) at least the traces say so for the scenario jobs i filed https://bugs.launchpad.net/tripleo/+bug/1795411 and https://bugs.launchpad.net/tripleo/+bug/1795418 cc kopecmartin|ruck14:42
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)14:42
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)14:42
*** dxiri has quit IRC14:42
chandankumarmwhahaha: my plan is to run full tempest tests in standalone https://review.openstack.org/#/c/606046/14:42
chandankumartempest api + scenario on standalone14:43
chandankumarmwhahaha: here is the output when i triggered full tempest http://logs.openstack.org/46/606046/1/check/tripleo-ci-centos-7-standalone/968ace6/logs/tempest.html.gz14:43
*** dxiri has joined #tripleo14:43
mwhahahamarios: i think the bug 1795418 might be in the pacemaker config, i see issue starting the bundles (bandini, dciabrin fyi)14:44
openstackbug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] https://launchpad.net/bugs/1795418 - Assigned to Marios Andreou (marios-b)14:44
chandankumarmwhahaha: I have updated second patchset without skip list14:45
mwhahahachandankumar: oh i know why that's failing14:45
bandinimwhahaha: ack, will look shortly14:45
mwhahahachandankumar: you need to set qemu http://logs.openstack.org/46/606046/1/check/tripleo-ci-centos-7-standalone/968ace6/logs/undercloud/var/log/containers/nova/nova-conductor.log.txt.gz#_2018-09-28_14_05_14_33014:45
mwhahahachandankumar: and i think i might have a patch somewhere to add an environment file that we could use in CI14:46
*** quiquell is now known as quiquell|off14:46
pvc_anyone have idea on overcloud failing on check cable?14:46
mwhahahachandankumar: you're missing configuring nova to use libvirt_virt_type qemu.14:48
mwhahahachandankumar: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/standalone.html#deploying-a-standalone-keystone-node vs http://logs.openstack.org/46/606046/1/check/tripleo-ci-centos-7-standalone/968ace6/logs/undercloud/home/zuul/standalone_parameters.yaml.txt.gz14:48
mwhahahachandankumar: we should just have an environment file that lives in ci/environments that sets that14:48
*** pvc_ has quit IRC14:50
weshaykopecmartin|ruck, fyi.. you have marios|rover, jasiordor, mwhahaha and EmilienM to run things by14:50
weshayor just generally ask in channel14:50
chandankumarmwhahaha: checking14:50
*** lblanchard has joined #tripleo14:51
*** fhubik|brb has quit IRC14:53
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets  https://review.openstack.org/60609514:57
*** saneax has quit IRC14:59
*** med_ has quit IRC15:03
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: mysql: use clustercheck credentials to poll galera state  https://review.openstack.org/60361215:04
openstackgerritChandan Kumar proposed openstack/tripleo-heat-templates master: set libvirt_virt_type to qemu for standalone  https://review.openstack.org/60696815:04
chandankumarmwhahaha: ^6 something like that15:05
mwhahahachandankumar: no it should not go in there15:05
mwhahahachandankumar: also that's wrong15:05
*** agopi is now known as agopi|brb15:05
chandankumarmwhahaha: then where? in TQE15:06
chandankumar?15:06
mwhahahachandankumar: gimme a minute15:06
chandankumarmwhahaha: ok15:06
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256015:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500915:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)15:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)15:10
*** ksambor has quit IRC15:10
*** agopi|brb has quit IRC15:10
*** holser_ has quit IRC15:13
mwhahahachandankumar: so yea it might make the most sense to do it in oooq-extras, give me a second15:13
chandankumarmwhahaha: ok15:14
chandankumarmwhahaha: you are meaning something like this http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/standalone/templates/standalone_config.yaml.j2 ?15:16
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Handle virtualized standalone by default  https://review.openstack.org/60697315:17
mwhahahachandankumar: -^ yea that15:18
chandankumarmwhahaha: cool15:18
mwhahahachandankumar: so just depends on that and it should be fine. i didn't know it wasn't already doing that15:19
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: [WIP] Enable full tempest api and scenario tests for basic services  https://review.openstack.org/60604615:19
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: Fix wrapper containers for podman w/o sockets  https://review.openstack.org/60609515:19
chandankumarmwhahaha: ^^ just thought about this last week15:20
chandankumarmwhahaha: if it is going to complete with in 1hr and 30 mins we are good to add it to upstream gates15:20
mwhahahachandankumar: it's already in the gate as that got merged over the weekend15:20
mwhahahaso just need to fix the config :D15:21
*** itlinux has joined #tripleo15:21
*** iranzo has quit IRC15:21
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Rework neutron/own agent wrapper tools for podman  https://review.openstack.org/60697515:22
chandankumarmwhahaha: do we started working on generating standalone config as packstack generates ? something openstack undercloud deploy --standalone --enable-keystone= y ?15:23
chandankumarwhere it will generate a temprory yaml file which will be used during the deployment?15:23
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Rework neutron/own agent wrapper tools for podman  https://review.openstack.org/60697515:24
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Use cap sysadmin for Neutron/OVN agents  https://review.openstack.org/60604515:24
mwhahahachandankumar: that was the hope to have something like that at some point but it's unlikely to occur in this cycle15:24
*** ykarel is now known as ykarel|away15:24
mwhahahachandankumar: the underlying config classes are there, but we haven't wired up what it means to enable each service, https://review.openstack.org/#/c/569535/15:24
chandankumarmwhahaha: since we have keystone standalone already available I think we can translated it to that, which would be a starting point15:25
mwhahahachandankumar: primarily because we don't have the equivalent environment files in THT15:25
mwhahahait just takes time/effort15:25
chandankumarmwhahaha: one thing I am thinking in the mean time currently we enable or diable service by editing undercloud.conf may be we can translate it to enable or disable it from command line that way we might achive to something15:27
chandankumarmwhahaha: like openstack undercloud deploy --enable-tempest=Truew15:28
*** yprokule has quit IRC15:28
mwhahahachandankumar: i don't think we should add it the command line but we can use a standalone.conf with just some basic params. there's already an existing set of classes to handle things like enable_<service>15:28
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Fix comments on metrics-collectd-qdr environment  https://review.openstack.org/60697615:28
chandankumarmwhahaha: you mean generating standalone.conf in the runtime?15:29
*** dxiri has quit IRC15:29
mwhahahachandankumar: it would be similar to what we have with undercloud.conf, an existing one that matches the defaults we currently have15:29
bandinimwhahaha: ok I know what that issue is. not sure yet how to fix it though15:29
chandankumarmwhahaha: I will try to dig into to that, will try to come up with something like that15:30
*** pcaruana has quit IRC15:30
chandankumarmwhahaha: which will do openstack standalone deploy <blah blan>15:30
mwhahahachandankumar: yea probably want openstack tripleo standalone deploy <stuff> but you can try something15:32
*** dxiri has joined #tripleo15:32
chandankumarmwhahaha: yes something like that15:33
weshaymwhahaha, why don't I see 606181 in check or gate queue15:38
mwhahahaweshay: because https://review.openstack.org/#/c/606179/ never landed15:38
mwhahahathanks scenarios15:38
*** holser_ has joined #tripleo15:39
* weshay reads through notes15:39
*** agopi|brb has joined #tripleo15:40
*** agopi|brb is now known as agopi15:41
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Prune empty lists from volumes  https://review.openstack.org/60698415:44
chandankumarEmilienM: if we find out the user not found issue in podman then I need to revert my patch to patchset 1 on oooq-extras as well as THT15:46
chandankumarmandre: around?15:47
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Deploy openshift all in one in scenario009  https://review.openstack.org/60378015:47
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Use openshift-ansible container instead of RPMs  https://review.openstack.org/58386815:47
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Use glusterfs for registry when deploying with CNS  https://review.openstack.org/60582515:47
mandrechandankumar: he's hiding :)15:47
EmilienMchandankumar: the user is supposed to be created when installing tempest in the container?15:47
mandrechandankumar: what's up?15:47
EmilienMchandankumar: have you checked in kolla?15:47
chandankumarEmilienM: https://github.com/openstack/kolla/commit/452ea1f4a4fffe87687b40dc146884386ba16535 -> added user in tempest and is working fine with docker15:48
chandankumarmandre: https://github.com/openstack/kolla/blob/master/docker/tempest/Dockerfile.j2#L15 when I do docker run -it <tempest image hash> bash it always take me to /usr/share/openstack-tempest-*15:49
chandankumarmandre: I am not liking * part, I want to fix it15:49
chandankumarmandre: it should either return /usr/share/tempest or /home/tempest something like that15:50
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: turn off ara install and cfg in multinode  https://review.openstack.org/60698615:50
*** med_ has joined #tripleo15:50
mandretrown: we may want to re-add the master and worker services to infra images to fix the job15:51
weshaymwhahaha, EmilienM anything against just turning off ara in multinode jobs and get it fixed in upcoming reviews https://review.openstack.org/60698615:51
*** weshay is now known as weshay_towtruck15:51
mwhahahaweshay_towtruck: that won't land15:51
mwhahahaweshay_towtruck: cause scenarios, my patches is fine but the CI is borked15:51
trownmandre: ya I was trying to see if the allinone patch could be moved down the patch chain ... since I think that would also fix the issue15:51
*** ykarel_ has joined #tripleo15:52
trownmandre: probably only need to re-add master, since that is the only role deployed by scenario009 currenty15:52
bandinimeh launchpad is acting up15:52
trowncurrently15:52
chandankumarEmilienM: it is from docker run http://logs.openstack.org/56/605356/3/check/tripleo-ci-centos-7-undercloud-containers/cc3bcec/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-09-27_03_21_1515:52
mandrechandankumar: according to https://github.com/openstack/kolla/blob/master/docker/tempest/Dockerfile.j2#L50 it takes you to /tempest, unless we have an override in tripleo15:53
*** aufi has quit IRC15:53
chandankumarmandre: let me check tht15:54
weshay_towtruckmwhahaha, you have anyting more for me than "borked"15:54
mwhahahaweshay_towtruck: yea the open bugs, there are two issues15:54
mandretrown: I got the all-in-one working this morning btw, just pushed the fix15:54
*** ykarel|away has quit IRC15:54
weshay_towtruckk15:54
mwhahahaweshay_towtruck: https://bugs.launchpad.net/tripleo/+bug/1795411 and https://bugs.launchpad.net/tripleo/+bug/179541815:55
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)15:55
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)15:55
chandankumarmandre: but if we need any tempest container provided by kolla then it always comes with /usr/share/openstack-tempest-*15:55
*** homeski has joined #tripleo15:55
mandretrown: i'm not sure of how much work it is to move the all-in-one patch to be the first one of the series15:55
weshay_towtruckmwhahaha, I was "guessing" https://bugs.launchpad.net/tripleo/+bug/1795411 was related to the ansible version15:56
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)15:56
mandrechandankumar: is it causing any issue or is it just cosmetic for when you shell in your container?15:56
*** dxiri has quit IRC15:56
homeskiHey I have a question WRT tripleo on Newton15:56
mwhahahaweshay_towtruck: no bug 1795418 gets cleared bu by that15:56
openstackbug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] https://launchpad.net/bugs/1795418 - Assigned to Marios Andreou (marios-b)15:56
mandrechandankumar: let me pull the kolla container so I can test by myself15:56
mwhahahaweshay_towtruck: 1795411 is a ceph issue i believe15:56
homeskiI restored the Undercloud from an old backup (months ago). And now I cannot do a fresh Overcloud deploy15:57
mwhahahaweshay_towtruck: because if it was just ansible, then my patch to pin ara would have passed15:57
trownmandre: I have a local run going where I just cherry-picked it ... if that doesnt "just work", I will put up a tripleo-common patch to re-add master to the registry and router images15:57
homeskiDeployArtifactURLs points to a stale URL15:57
chandankumarmandre: it is just cosmetic and I am currently not using that path but in tht I am thinking of making it permanent15:57
weshay_towtruckawesome15:57
mwhahahahomeski: just set it to DeploymentArtifcatsURLs: [] in an enviroment file to clear it out15:57
homeskiand no matter what I do, delete Overcloud, remove all Undercloud swift objects, modify templates, it won't clear out15:57
chandankumarmandre: https://review.openstack.org/60598015:57
homeski@mwhahaha thanks, I will try that out now :)15:58
homeskiJust under parameter_defaults ?15:58
mandretrown: did you notice I pushed a new revision of that patch 10 min ago, right?15:58
homeskior under an ExtraConfig15:58
chandankumarmandre: we need a path where we can do read/write operation without changing any thing15:58
chandankumarmandre: currently in validate-tempest role I am carrying lots of hacks15:59
trownmandre: nope missed that, but I will rerun my test with that update15:59
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/60224816:00
*** boazel has quit IRC16:00
mwhahahahomeski: just under parameter_defaults16:00
mwhahahaweshay_towtruck: i'll recheck my pin patch it might fix it but it seems that 1795411 is the cause for the scenario002 failure so i don't think your patch to disable ara fixes it16:01
weshay_towtruckaye16:01
homeskiok cool, and did you mean DeployArtifactsURLs vs Deployment*16:01
mwhahahahomeski: whatever the param is16:02
homeskithanks :)16:02
*** beagles_mtg is now known as beagle16:02
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256016:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500916:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541116:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541816:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)16:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)16:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)16:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)16:10
*** akhila has joined #tripleo16:10
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: New workflow for standalone upgrade.  https://review.openstack.org/60470616:11
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: WIP: emit_release outputs dlrn_hash_tag_newest as well for upgrade.  https://review.openstack.org/60699616:11
openstackgerritMichele Baldessari proposed openstack/tripleo-quickstart-extras master: Fix TLS deployments on oooq  https://review.openstack.org/60699716:13
*** boazel has joined #tripleo16:13
*** weshay_towtruck is now known as weshay16:14
weshaychem, this is interesting Unable to freeze job graph: Decryption failed.16:17
weshaychem, from Nokia Airframe CI16:17
*** kopecmartin|ruck is now known as kopecmartin|off16:19
*** thrash is now known as thrash|biab16:21
chemweshay: is this for real ?16:21
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: docker-puppet.py: used dedicated hiera entry, not uuid  https://review.openstack.org/55918216:21
*** amoralej is now known as amoralej|off16:24
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: WIP: emit_release outputs dlrn_hash_tag_newest as well for upgrade.  https://review.openstack.org/60699616:25
weshaydon't know16:25
mwhahahasounds like the airframe ci is incorrectly configured16:27
mwhahahamight want to raise that with #openstack-infra if they aren't already aware16:27
*** jpich has quit IRC16:29
*** shardy has quit IRC16:30
*** dxiri has joined #tripleo16:31
*** moshele has joined #tripleo16:32
*** pfo has joined #tripleo16:38
pfoi have some vendor tirpleO code that has a certain resource not scoped to custom roles (uplink interface name as string, globally) can anyone point me to some direction how to modify the tripleO code there to scope this variable to custom role definitions?16:39
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Add UseNotifySSL to environments/ssl/enable-internal-tls.yaml  https://review.openstack.org/60700216:40
pfothe puppet code for the implementation just uses a hiera lookup to get that string16:42
mwhahahapfo: you're likely looking to do role specific variables, i'm not sure where the documentation lives but it's traditionally handled in tripleo-heat-templates16:42
mwhahahapfo: in newer versions i think it's just adding the tag - role_specific to a parameter, but i don't know what version you're using16:44
pfoi'm running openstack-tripleo-heat-templates-7.0.12-8.el7ost.noarch16:45
mwhahahapfo: then that would turn it from like UplinkParam to be <rolename>UplinkParam16:45
*** med_ has quit IRC16:45
pfothat is builtin?!16:45
* pfo learns something new about tripleO every day ;)16:45
mwhahahain newer versions yes, i don't think it's in that one but you could try it16:45
pfonewer versions are something like >=8 ?16:46
pfonow I just need to figure out how to add a tag :P16:46
mwhahahayea i see references to role_specific in 8+16:47
*** moshele has quit IRC16:47
*** dxiri has quit IRC16:48
pfomwhahaha: i just read this piece of doc: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/role_specific_parameters.html16:51
pfoit says that the parameter needs to be implemented in a specific way16:51
mwhahaharight that's the tag - role_sepecific thing16:51
mwhahahaOnly some params are setup like that16:52
pfohmm16:52
pfobut I guess I could use some form of hierdata override?16:52
mwhahahaif you create a new one, you can create one but if you're trying to modify an existing thing it's unlikely to work16:52
mwhahahapossibly but i don't know what you're setting16:52
*** zzzeek_ has joined #tripleo16:53
pfothe vendor has provided some tripleO bits that basically render an ifcfg-foobar file for RHEL interface config and ``foobar'' is available as a resource that I can pass in16:53
pfobut only globally16:54
pfoas string16:54
pfoso rather simplistic thing16:54
*** d0ugal has quit IRC16:54
pfoDEVICE=<%= @foo_uplink_iface%> is what is written into the erb template from FooUplinkInterface param16:55
pfobut on my end on different roles i have different ifaces16:55
*** thrash|biab is now known as thrash16:55
bandinianyone around for a  backport https://review.openstack.org/#/c/606849/16:55
mwhahahapfo: so i think net-config items can already be done vi aroles, but not sure16:55
pfono, this is sadly as ''dumb'' as it gets :/16:56
pfono net-config or anything16:56
pfojust string from param pushed into hiera and rendered out from erb template16:56
*** pcaruana has joined #tripleo16:56
*** ansmith has quit IRC16:57
mwhahahapfo: where does that var come from? if it's just hiera you can just use <role>ExtraConfig to set it16:58
*** bogdando has quit IRC16:58
*** derekh has quit IRC17:00
pfook it seems that there is an os-net-config template as well17:01
*** cylopez has quit IRC17:01
*** dtantsur is now known as dtantsur|afk17:03
pfoI could also create a jinja template and do {%- role.name.startswith('foonode') %} UplinkIface: enoX {%- endif %} no?17:04
*** akhila has quit IRC17:04
*** holser_ has quit IRC17:05
*** akrivoka has quit IRC17:05
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256017:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500917:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541117:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541817:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)17:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)17:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)17:10
*** ansmith has joined #tripleo17:11
*** jpena is now known as jpena|off17:11
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Always lowercase role name  https://review.openstack.org/59858917:12
*** dsneddon_ has quit IRC17:12
*** dsneddon has joined #tripleo17:14
*** rdopiera has quit IRC17:16
*** moshele has joined #tripleo17:17
Tengusee you tomorrow folks :).17:18
openstackgerritCarol Bouchard proposed openstack/tripleo-heat-templates master: CiscoNexus: Update and Remove deprecated vars  https://review.openstack.org/60695817:21
*** trown is now known as trown|lunch17:24
*** salmankhan has quit IRC17:31
*** weshay is now known as weshay_airport17:31
*** salmankhan has joined #tripleo17:31
fultonjmwhahaha: is it ok to +w or recheck?17:32
*** dxiri has joined #tripleo17:32
*** pfo has quit IRC17:32
fultonjfixes referenced in ML post seem fixed (http://lists.openstack.org/pipermail/openstack-dev/2018-September/135224.html)17:32
fultonjs/fixed/merged17:32
fultonjEmilienM: should i open a bug for http://logs.openstack.org/34/600534/16/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/81a4032/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-01_10_03_31 ?17:33
*** tosky has quit IRC17:33
EmilienMfultonj: I haven't followed all bugs that were opened today17:34
EmilienMbut if CI folks didn't create one yet, sure17:34
fultonjEmilienM: ack17:34
*** salmankhan has quit IRC17:36
mwhahahafultonj: no the scenario jobs are busted17:39
fultonjmwhahaha: ok, thanks17:39
mwhahahafultonj: so if it doesn't have any of the scenario jobs you can recheck or +w but if it's on a stable branch or has scenario jobs don't17:39
mwhahahafultonj: we haven't fixed pike/queens yet either17:40
mwhahahathat's broken still pending the fix of the master scenario jobs17:40
fultonjok17:40
*** aedc has joined #tripleo17:41
*** moshele has quit IRC17:42
fultonjbandini: do you think https://bugs.launchpad.net/tripleo/+bug/1795468 is a dup of https://bugs.launchpad.net/tripleo/+bug/1789680 ?17:42
openstackLaunchpad bug 1795468 in tripleo "openstack overcloud delete is broken" [High,Triaged]17:42
openstackLaunchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure)17:42
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Cleanup ControllerStorageNfs role  https://review.openstack.org/60566717:44
*** vinaykns has quit IRC17:49
*** moshele has joined #tripleo17:52
*** ykarel__ has joined #tripleo17:59
mwhahahafultonj: it might be but we merged a fix for 178968018:00
*** ansmith has quit IRC18:01
*** ykarel_ has quit IRC18:01
*** ansmith has joined #tripleo18:02
*** holser_ has joined #tripleo18:05
*** iranzo has joined #tripleo18:07
*** moshele has quit IRC18:07
*** ykarel__ has quit IRC18:08
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256018:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500918:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541118:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541818:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)18:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)18:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)18:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)18:10
openstackgerritTong Liu proposed openstack/tripleo-heat-templates master: Add more NSX config parameters  https://review.openstack.org/60485818:10
openstackgerritGoutham Pacha Ravi proposed openstack/tripleo-heat-templates stable/queens: Cleanup ControllerStorageNfs role  https://review.openstack.org/60701518:12
*** iranzo has quit IRC18:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Convert with_dict tasks to use loop and be less chatty  https://review.openstack.org/60325118:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: check mode: puppet host  https://review.openstack.org/60325218:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: check mode: docker_puppet  https://review.openstack.org/60325318:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: check mode: docker_puppet_tasks  https://review.openstack.org/60325418:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: check mode: paunch configs  https://review.openstack.org/60325518:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Name unnamed tasks  https://review.openstack.org/60446018:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Fix tasks in check mode  https://review.openstack.org/60446118:25
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Fix haproxy cert inject for check mode  https://review.openstack.org/60701918:25
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: mysql: fix root password update for containerized mysql  https://review.openstack.org/60249918:26
mwhahahaso i think i figured out the scenario001/002 issue18:27
mwhahahahttps://github.com/openstack/tripleo-quickstart-extras/blob/5e0a6b1e9f3e1e11139fbf8e58aa22612df0eb58/roles/overcloud-prep-images/templates/overcloud-prep-images.sh.j2#L22718:27
mwhahahai think that's the problem18:27
mwhahahai think we're ending up with a newer version of ansible in the container18:28
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Revert "Track ansible overcloud deployment with ARA"  https://review.openstack.org/60702118:29
honzaEmilienM: i'm trying to write a new upstream job, and i need to install headless chromium; it can be installed by adding their yum repo --- what would be the best way to do this in a featureset file?  a new ansible role?18:31
EmilienMis that an open-source library right?18:31
honzaEmilienM: yes https://chromium.googlesource.com/chromium/src/+/lkgr/headless/README.md18:32
honzaEmilienM: we want this for running selenium tests for tripleo-ui18:32
EmilienMyou can maybe add that to tripleo quickstart extras18:33
EmilienMand create a new featureset for the tripleo-ui testing18:33
honzaEmilienM: yes, i was gonna use featureset027 as a base, and go from there18:33
honzaEmilienM: should adding the repo and the yum install go into the featureset file?18:34
EmilienMmhh I would not do that18:34
EmilienMwe already have other repos in place18:35
EmilienMtake example from what exists18:35
EmilienMwe'll need a mirror in infra too18:35
honzaEmilienM: so, create a new role for installing headless chromium, and use that role in the featureset file?18:35
EmilienMhonza: no, sorry I said wrong about oooq18:36
EmilienMoooq-extras18:36
EmilienMwe should create a mirror in infra18:36
EmilienMand consume this mirror in the featureset, like we do have it for some repos already I think18:36
EmilienMfor the ceph jobs, etc18:36
honzaEmilienM: yeah, the role goes into oooq-extra18:36
EmilienMno need of a role18:36
honzaEmilienM: ok, cool, i'll have a look at some of the other examples18:36
mwhahahado we not already have a mirror that has headless chromium?18:37
honzaEmilienM: nice18:37
honzamwhahaha: do tell18:37
mwhahahathat was the question18:37
mwhahahawhat repo are you planning on adding?18:37
mwhahahaalso, can we use a container version?18:38
honzamwhahaha: something like http://dl.google.com/linux/chrome/rpm/stable/ i assume18:38
honzamwhahaha: i will investigate the possibility of using headless chrome in a container18:39
mwhahahahttps://hub.docker.com/r/justinribeiro/chrome-headless/18:41
mwhahahaprobably would be easier to add and less work than all of the other stuff to install it on the host18:41
EmilienMnice work justin18:42
EmilienMwe need this container in our mirror :P18:43
honzamwhahaha: i agree!  i'm looking into how that's supported in the selenium toolchain18:47
*** trown|lunch is now known as trown18:51
fultonjEmilienM: i'm not sure the scenario001 failure in https://review.openstack.org/#/c/600534 should be a separate bug. i added a comment to the review.18:56
honzaEmilienM: mwhahaha: Yes, running the chrome instance in a container works with our library --- what would be the proper way of installing this container in ci (in a featureset)?18:57
mwhahahahonza: likely a new role in oooq-extras to handle the testing18:58
mwhahahawhich would do the post deployment setup18:58
honzamwhahaha: the tests are actually driven with tempest18:58
honzamwhahaha: so i just need to pull and run the container before it gets to that stage18:58
mwhahahahonza: so a modification to the tempest role to handle the setup/start of it18:59
honzamwhahaha: perfect, thank you18:59
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Handle virtualized standalone by default  https://review.openstack.org/60697319:00
*** tosky has joined #tripleo19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256019:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500919:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541119:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541819:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)19:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)19:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)19:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)19:10
*** homeski has quit IRC19:13
*** weshay_airport is now known as weshay19:17
openstackgerritMerged openstack/tripleo-upgrade master: Update required packages for containerized undercloud upgrade  https://review.openstack.org/60574519:21
weshaymwhahaha, I'm happy to doc this if you give me a minute of your time so I know exactly what you are going for here https://review.openstack.org/#/c/606973/219:24
weshayoh wow.. something merged19:25
mwhahahaweshay: what are you talking about19:25
mwhahahait's already documented19:25
weshaystandalone_virtualized19:25
mwhahahasee item 5 from https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/standalone.html#deploying-a-standalone-keystone-node19:25
mwhahahain order to run nova on VM you have to configure it with qemu19:26
mwhahahawe do it in all the scenario files19:26
* mwhahaha is unsure why this is suddenly a new thing19:26
weshayok..19:26
weshayroger that..19:26
mwhahahahttps://github.com/openstack/tripleo-heat-templates/search?q=nova%3A%3Acompute%3A%3Alibvirt%3A%3Aservices%3A%3Alibvirt_virt_type%3A+qemu&unscoped_q=nova%3A%3Acompute%3A%3Alibvirt%3A%3Aservices%3A%3Alibvirt_virt_type%3A+qemu19:26
mwhahahalike i submit a patch to fix it and everyone is like WHOOA WHY WOULD WE DO THAT19:27
mwhahahacause that's how it works?19:27
openstackgerritMerged openstack/puppet-tripleo stable/queens: Make sure rhel-plugin-push.service is stopped after pacemaker stops  https://review.openstack.org/60684919:27
* mwhahaha goes back to figuring out what broke ci19:28
weshaymwhahaha, I was just looking for doc, don't freak out :)19:28
mwhahahayea but you're the 2nd person to raise that today19:28
* weshay pops popcorn in hopes of a third19:29
weshaymwhahaha, one last suggestion https://review.openstack.org/#/c/587572/7/roles/set-libvirt-type/tasks/main.yml19:31
weshaywe could set it to virt_type19:31
* mwhahaha points to being able to seperate the roles19:31
mwhahahaso sure we can, but we have to be able to pass it in19:31
mwhahahaso that logic should live in the playbook19:31
mwhahahacurrently, it's not configurable19:31
mwhahahahence my patch19:31
weshayah k19:32
* weshay looks for that in tht19:32
mwhahahait's not in tht19:32
mwhahahathat's the bits to do it19:33
mwhahahabecause we wouldn't actually assume this is a thing in THT (we assume baremetal)19:33
mwhahahaso this logic has to live in quickstart19:33
mwhahahai was debating adding an environment file for it but it relies on the hiera overrides19:33
mwhahahawe probably should fix that19:34
weshayso that can never be set to kvm? http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/puppet/services/nova-libvirt.yaml#n20719:34
weshayI see tht defaults to qemu everywhere19:34
mwhahahadat historical cruft19:34
mwhahahaso yea we should use NovaComputeLibvirtType19:34
mwhahahacause it does exactly that19:34
* weshay follows your lead here, the role rfolco came up w/ just determines which type of virt is supported on the hardware19:35
mwhahahaso let me fix that so it uses NovaComputeLibvirtType19:36
mwhahahaand we can pass in kvm/qemu19:36
mwhahahathen you could use that role no problem19:36
weshaywoot19:36
mwhahahabut first, let's fix CI :D19:36
weshaymwhahaha, ya.. what can do to help on that front, just got back from renting a car19:36
mwhahahawe should fix that so it's added to the appropriate scenario files as well19:36
mwhahaharight now the ones in tht/ci/environments all hardcode qemu19:37
weshayyup.. see that19:37
openstackgerritTrevor Vardeman proposed openstack/tripleo-common master: Hardcoding x86_64 in template overrides for the  opendaylight repository  https://review.openstack.org/60440119:39
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Handle virtualized standalone by default  https://review.openstack.org/60697319:39
openstackgerritAlex Schultz proposed openstack/tripleo-docs master: Update libvirt config for standalone  https://review.openstack.org/60703219:41
mwhahahaweshay: where is set-libvirt-type used19:47
* weshay gets19:47
weshaymwhahaha, overcloud deploy args http://codesearch.openstack.org/?q=set-libvirt-type&i=nope&files=&repos=tripleo-quickstart,tripleo-quickstart-extras19:48
weshaythat doesn't show it19:48
mwhahahai guess i just need to add it to the multinode-standalone.yml19:48
weshaysec19:48
weshaymwhahaha, http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/config/general_config/deprecated/scale_compute.yml#n3519:50
weshaythe libvirt arg passed to the overcloud deploy command19:50
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Standalone configurable virt type  https://review.openstack.org/60697319:51
mwhahahaweshay: no i mean like -^19:51
mwhahahai think that's what's needed19:51
*** dprince has quit IRC19:52
weshaystandalone_libvirt_type: {{ virt_type }}19:52
weshaymwhahaha, ^19:53
mwhahahapffft naming consistency19:53
*** gfidente has quit IRC19:53
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Standalone configurable virt type  https://review.openstack.org/60697319:53
weshaymwhahaha, diff roles diff var names19:54
* weshay runs19:54
*** cbravo has joined #tripleo19:54
mwhahahathe role name is set-libvirt-type19:54
mwhahahaand returns virt_type :o19:54
* mwhahaha gives up and goes back to doing other things19:55
cbravohello guys, this is my first time around here. I'm probably risking looking like a fool, but does anyone have a for dummies on using tripleo? I've managed to boot the nodes, do the inspection, getting the hardware configuration but that's as far as I've gotten19:56
cbravoI tried setting up queens btw19:56
cbravoI can do it manually, but just wanted to try the automated way19:56
weshaymwhahaha, so I have a live env of scenario00119:56
weshayif that would help19:56
mwhahahacbravo: if it's baremetal there isn't an official automated way, so not sure what you're looking for19:56
mwhahahaweshay: i was in the process of starting one19:57
weshaywant me to tmate you in?19:57
mwhahahaweshay: but if you've got one that might be handy19:57
cbravo@mwhahaha I'm trying to deploy an overcloud on baremetal. I thought TripleO was the way to go since Red Hat's director was based on it19:58
mwhahahacbravo: right but all the things you've mentioned are the setup steps before the deployment19:58
mwhahahacbravo: so i'm wondering what you meant by automated19:59
cbravoOh, I meant that I don't have to login on every single server to do a service by service installation and configuration20:00
cbravobut TripleO can do that for me20:00
mwhahahacbravo: correct it can20:05
mwhahahacbravo: so once you've introspected all the hosts, setup your images and containers, you're ready to start a deployment20:06
mwhahahacbravo: you can either do so via teh UI or cli20:06
mwhahahahttps://docs.openstack.org/tripleo-docs/latest/install/basic_deployment/basic_deployment_cli.html has the basic deployment via the cli20:06
mwhahahadepending on the version you may need to do some container prep bits to generate a file20:07
mwhahahai'm not sure if we still have the queens commands still around20:07
mwhahahabut it's kinda similar to https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/overcloud.html20:07
cbravoThat's where I'm kind of lost. I keep on getting tripleo container is not an openstack command20:09
cbravobut all the information is pointing towards that direction20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256020:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500920:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541120:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541820:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)20:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)20:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,Triaged] - Assigned to Marios Andreou (marios-b)20:10
mwhahahacbravo: yea that's the current command, the previous one was openstack overcloud container image prepare20:14
mwhahahacbravo: https://github.com/openstack/tripleo-docs/blob/master/doc/source/install/containers_deployment/overcloud.rst is the doc, you could try looking at past revisions20:16
*** pvc has quit IRC20:16
*** holser_ has quit IRC20:23
*** jcoufal has quit IRC20:25
rh-jelabarrehad to bring down my controller node on a tripleO setup, and now Horizon isn't able to log in, with an error "Unable to establish connection to keystone endpoint."20:30
*** holser_ has joined #tripleo20:34
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Prune empty lists from volumes  https://review.openstack.org/60698420:37
*** pcaruana has quit IRC20:43
*** ansmith has quit IRC20:48
*** Vorrtex has quit IRC20:53
*** lblanchard has quit IRC20:54
openstackgerritBob Fournier proposed openstack/os-net-config stable/queens: Restart ivs/nvfswitch after config file is updated  https://review.openstack.org/60705120:55
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Revert "Fix postrotate to notify holders of rotated logs"  https://review.openstack.org/60705220:55
mwhahahaweshay: -^ should do a depends on that20:56
weshayk20:56
weshaywill do20:56
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60327520:57
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60327520:57
*** rbrady is now known as rbrady-afk20:58
mwhahahai swear if that's the fix i'm just going to take the rest of the week off to cry20:59
*** raildo has quit IRC21:00
bfourniemwhahaha, EmilienM: if you have a chance, I have a few reviews with +2s and tests passing, could use another review - https://review.openstack.org/#/c/604229/, https://review.openstack.org/#/c/605736/, https://review.openstack.org/#/c/604089/. Thanks21:02
bfourniemwhahaha: thank you!21:05
*** trown is now known as trown|outtypewww21:07
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256021:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500921:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541121:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541821:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)21:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)21:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,In progress] - Assigned to Marios Andreou (marios-b)21:10
*** morazi has quit IRC21:19
*** vinaykns has joined #tripleo21:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add standalone upgrade role and playbook.  https://review.openstack.org/60473621:29
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add standalone upgrade role and playbook.  https://review.openstack.org/60473621:29
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Put create repo script into its own tasks file.  https://review.openstack.org/60536921:34
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Add new featureset 056 for standalone upgarde.  https://review.openstack.org/60536321:34
*** itlinux has quit IRC21:39
*** jabadia has joined #tripleo21:45
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: turn off ara install and cfg in multinode  https://review.openstack.org/60698621:53
*** cbravo has quit IRC21:54
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256022:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500922:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541122:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541822:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)22:10
*** ooolpbot has quit IRC22:10
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add podman support for log collection  https://review.openstack.org/60509022:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)22:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)22:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,In progress] - Assigned to Marios Andreou (marios-b)22:10
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Switch fs027 to deploy with podman  https://review.openstack.org/60051722:10
*** slaweq has quit IRC22:15
*** ianw is now known as ianw_pto22:17
*** holser_ has quit IRC22:19
*** jtomasek has quit IRC22:20
openstackgerritEmilien Macchi proposed openstack/paunch master: podman: create/delete systemd unit files when restart policy is used  https://review.openstack.org/60084922:31
EmilienMstevebaker: https://review.openstack.org/#/c/600849/24..2522:31
EmilienMstevebaker: if you have 5 min for a last revieW22:31
EmilienMjust making sure I addressed all your comments22:31
stevebakerEmilienM: lookin good22:33
*** jcoufal has joined #tripleo22:33
*** vinaykns has quit IRC22:37
*** boazel has quit IRC22:37
EmilienMstevebaker: thx for the good review ;)22:39
*** agopi is now known as agopi|brb22:40
*** threestrands has joined #tripleo22:41
EmilienMfultonj: sorry just saw your message22:42
*** tosky has quit IRC22:43
jabadiaSay I want to test re-deployment , but want to skip the long parts ( e.g virt-customize / skip stack_repo_setup as it was done on previous deployment ) , how can I do it ?22:44
jabadiaI notice the -S / --skip-tags , but it's bit tricky, say I'll find the tag, it will do previous tag which for example re-download the tar and will override the success repo_setup..  Any tricks anyone can share ?22:47
*** rcernin has joined #tripleo22:49
*** agopi|brb has quit IRC22:51
openstackgerritEmilien Macchi proposed openstack/paunch master: Stop hardcoding 'docker' and make it more generic  https://review.openstack.org/60129022:54
*** jcoufal has quit IRC23:05
*** jcoufal has joined #tripleo23:07
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179256023:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179500923:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541123:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179541823:10
openstackLaunchpad bug 1792560 in tripleo "Upgrades in CI still using Q->master instead of R->master release" [Critical,In progress] - Assigned to Jiří Stránský (jistr)23:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1795009 in tripleo "the scenario001/004 multinode-oooq-container job is failing for Queens and Pike for overcloud deployment error "overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution:" " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)23:10
openstackLaunchpad bug 1795411 in tripleo "The scenario001(and 2)-multinode-oooq-container job is failing during the overcloud deploy for "[Run tripleo-container-image-prepare]" " [Critical,Triaged] - Assigned to Marios Andreou (marios-b)23:10
openstackLaunchpad bug 1795418 in tripleo "The containers-multinode scenario jobs fail overcloud deploy on docker-puppet step3 or starting containers" [Critical,In progress] - Assigned to Marios Andreou (marios-b)23:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418023:12
*** med_ has joined #tripleo23:20
*** agopi|brb has joined #tripleo23:25
*** jabadia has quit IRC23:27
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: images: install libseccomp beside podman  https://review.openstack.org/60706623:39
*** jcoufal has quit IRC23:41
*** rh-jelabarre has quit IRC23:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Support podman when tagging container for Pacemaker  https://review.openstack.org/60418023:43
*** med_ has quit IRC23:51
*** moshele has joined #tripleo23:51
*** mjturek has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!