Thursday, 2018-09-13

*** janki has quit IRC00:01
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676400:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179194100:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215800:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)00:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)00:10
*** saneax has quit IRC00:13
*** dciabrin has quit IRC00:18
*** dtrainor has joined #tripleo00:22
*** akhila has quit IRC00:41
*** sri_ has quit IRC00:45
*** dmacpher has joined #tripleo00:45
*** sri_ has joined #tripleo00:45
*** saneax has joined #tripleo00:46
openstackgerritMerged openstack/tripleo-heat-templates master: Fix neutron dhcp log path  https://review.openstack.org/59810500:47
*** Goneri has quit IRC00:53
*** radeks has quit IRC00:59
*** slaweq_ has quit IRC01:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676401:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179194101:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215801:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)01:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)01:10
openstackgerritJon Schlueter proposed openstack/python-tripleoclient master: spelling fix in standalone help text  https://review.openstack.org/60221201:18
*** tzumainn has quit IRC01:27
itlinuxhi guys. has anyone installed the latest pike UC .. since I am trying to login on the UI but I get keystone API could not be established..01:31
openstackgerritMerged openstack/tripleo-common master: Fix available roles listing  https://review.openstack.org/58738001:33
openstackgerritMerged openstack/tripleo-heat-templates master: Add chrony support to validations  https://review.openstack.org/59982501:33
openstackgerritMerged openstack/tripleo-common master: Revert "Reintroduce empty_container for tripleoclient"  https://review.openstack.org/60142701:34
openstackgerritMerged openstack/tripleo-common master: Revert "Use swift bulk-delete when deleting a plan"  https://review.openstack.org/60142801:34
openstackgerritJon Schlueter proposed openstack/python-tripleoclient master: spelling fixes doc string and help strings  https://review.openstack.org/60221201:34
openstackgerritJon Schlueter proposed openstack/python-tripleoclient master: spelling fixes doc string and help strings  https://review.openstack.org/60221201:34
*** rlandy|bbl is now known as rlandy01:43
*** mschuppe1 has joined #tripleo01:45
*** mrsoul` has joined #tripleo01:46
*** sri_ has quit IRC01:46
*** sri_ has joined #tripleo01:47
*** mrsoul has quit IRC01:48
*** mschuppert has quit IRC01:48
openstackgerritMerged openstack/diskimage-builder master: Only append DIB_BOOTLOADER_DEFAULT_CMDLINE to default grub entry  https://review.openstack.org/60193602:05
openstackgerritMerged openstack/diskimage-builder master:   IPA requires iptables  https://review.openstack.org/56916002:05
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676402:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179194102:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215802:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)02:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)02:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)02:10
*** rlandy has quit IRC02:13
openstackgerritAndriy Shevchenko proposed openstack/os-net-config master: Reorganize that 'Documentation' in README  https://review.openstack.org/58683302:29
*** sri_ has quit IRC02:33
*** boazel has quit IRC02:33
*** sri_ has joined #tripleo02:34
*** gbarros has joined #tripleo02:53
*** boazel has joined #tripleo02:55
*** sri_ has quit IRC02:58
*** sri_ has joined #tripleo02:58
*** ansmith has quit IRC03:00
*** ansmith has joined #tripleo03:05
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676403:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179194103:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215803:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)03:10
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)03:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)03:10
*** ipsecguy has quit IRC03:13
*** ipsecguy has joined #tripleo03:14
*** dprince has joined #tripleo03:23
*** ansmith has quit IRC03:25
*** ansmith has joined #tripleo03:38
*** jtomasek has joined #tripleo03:41
*** slaweq_ has joined #tripleo03:44
*** ansmith has quit IRC03:44
*** jtomasek has quit IRC03:46
*** ansmith has joined #tripleo03:48
*** gbarros has quit IRC03:48
*** slaweq_ has quit IRC03:49
*** med_ has joined #tripleo03:51
*** sri_ has quit IRC03:53
*** sri_ has joined #tripleo03:53
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676404:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179194104:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215804:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)04:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)04:10
*** ansmith has quit IRC04:14
*** noslzzp has quit IRC04:14
*** ansmith has joined #tripleo04:15
*** med_ has quit IRC04:18
*** bugzy has quit IRC04:24
*** bfournie has quit IRC04:34
*** bugzy has joined #tripleo04:35
*** agopi|off has joined #tripleo04:39
*** stendulker_ has quit IRC04:57
*** waleedm has joined #tripleo05:03
*** agurenko has joined #tripleo05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676405:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179194105:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215805:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)05:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)05:10
*** phuongnh has joined #tripleo05:17
*** phuongnh has quit IRC05:29
*** artom has joined #tripleo05:29
*** artom has quit IRC05:29
*** psahoo has joined #tripleo05:29
*** artom has joined #tripleo05:30
Tenguhello there05:30
*** yprokule has joined #tripleo05:31
*** quiquell has joined #tripleo05:38
*** quiquell is now known as quiquell|rover05:40
*** dtrainor has quit IRC06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676406:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179194106:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215806:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229606:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)06:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1791941 in tripleo "[CI] Remove dependency from github on periodic/tripleo jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)06:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)06:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)06:10
*** mschuppe1 is now known as mschuppert06:13
*** lvdombrkr has joined #tripleo06:14
*** lvdombrkr89 has joined #tripleo06:17
*** agurenko has quit IRC06:18
*** lvdombrkr has quit IRC06:19
*** hamdyk has joined #tripleo06:32
openstackgerritMartin AndrĂ© proposed openstack/tripleo-common master: Switch to origin-docker-build  https://review.openstack.org/59930706:35
*** noama has joined #tripleo06:39
noamahi06:39
noamais there a way to disable the following messages?06:39
noamaSep 13 09:38:39 overcloud-computesriov-1 kernel: IN=br-mlnx OUT= MAC=ff:ff:ff:ff:ff:ff:7c:fe:90:d5:bb:50:08:00 SRC=0.0.0.0 DST=255.255.255.255 LEN=328 TOS=0x10 PREC=0x00 TTL=128 ID=0 PROTO=UDP SPT=68 DPT=67 LEN=30806:39
noamaSep 13 09:38:39 overcloud-computesriov-1 kernel: IN=br-isol OUT= MAC=ff:ff:ff:ff:ff:ff:7c:fe:90:d5:bb:50:08:00 SRC=0.0.0.0 DST=255.255.255.255 LEN=328 TOS=0x10 PREC=0x00 TTL=128 ID=0 PROTO=UDP SPT=68 DPT=67 LEN=30806:39
noamaSep 13 09:38:40 overcloud-computesriov-1 kernel: IN=p4p1 OUT= MAC=ff:ff:ff:ff:ff:ff:24:8a:07:9c:12:17:08:00 SRC=0.0.0.0 DST=255.255.255.255 LEN=328 TOS=0x10 PREC=0x00 TTL=128 ID=0 PROTO=UDP SPT=68 DPT=67 LEN=30806:39
noamaSep 13 09:38:40 overcloud-computesriov-1 kernel: IN=p4p2 OUT= MAC=ff:ff:ff:ff:ff:ff:24:8a:07:9c:12:17:08:00 SRC=0.0.0.0 DST=255.255.255.255 LEN=328 TOS=0x10 PREC=0x00 TTL=128 ID=0 PROTO=UDP SPT=68 DPT=67 LEN=30806:39
noamaSep 13 09:38:40 overcloud-computesriov-1 kernel: IN=p2p1 OUT= MAC=ff:ff:ff:ff:ff:ff:24:8a:07:9c:12:17:08:00 SRC=0.0.0.0 DST=255.255.255.255 LEN=328 TOS=0x10 PREC=0x00 TTL=128 ID=0 PROTO=UDP SPT=68 DPT=67 LEN=30806:39
noamaSep 13 09:38:40 overcloud-computesriov-1 kernel: IN=p6p2 OUT= MAC=ff:ff:ff:ff:ff:ff:24:8a:07:9c:12:17:08:00 SRC=0.0.0.0 DST=255.255.255.255 LEN=328 TOS=0x10 PREC=0x00 TTL=128 ID=0 PROTO=UDP SPT=68 DPT=67 LEN=30806:39
noamathe spam journal/dmesg/messages06:40
Tenguhmm that's iptables logs.06:40
Tenguthere must be a LOG target or two in the rules.06:41
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Pacemaker-cinder-volume & pacemaker-cinder-backup log path fix  https://review.openstack.org/59746206:43
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60224706:44
*** agurenko has joined #tripleo06:46
*** aufi has joined #tripleo06:47
*** dparkes has joined #tripleo06:47
openstackgerritQuique Llorente proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO  https://review.openstack.org/60224806:48
*** bfournie has joined #tripleo06:49
*** radeks has joined #tripleo06:57
*** dparkes has quit IRC06:59
*** dparkes has joined #tripleo07:01
*** rcernin has quit IRC07:01
*** apetrich has quit IRC07:01
*** tesseract has joined #tripleo07:01
*** rdopiera has joined #tripleo07:02
*** cylopez has joined #tripleo07:06
*** quiquell|rover is now known as quique|rover|bbl07:07
*** rdopiera has quit IRC07:08
*** rdopiera has joined #tripleo07:08
quique|rover|bblSome minor stuff to close bug https://review.openstack.org/#/c/602025/07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676407:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215807:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229607:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)07:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)07:10
*** rdopiera has quit IRC07:10
*** rdopiera has joined #tripleo07:10
*** dtrainor has joined #tripleo07:22
*** mpasserini has joined #tripleo07:31
*** cylopez has quit IRC07:33
*** quique|rover|bbl is now known as quiquell|rover07:41
*** dparkes has quit IRC07:43
*** assassin has joined #tripleo07:43
*** jpena|off is now known as jpena07:44
*** pvc has joined #tripleo07:50
pvchi07:50
pvcanyone using vgpu on tripleo?07:50
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates stable/pike: Add a way to override base path when file driver is used  https://review.openstack.org/60128607:53
*** assassin has quit IRC07:54
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60224708:00
*** jpich has joined #tripleo08:01
*** dparkes has joined #tripleo08:02
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676408:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215808:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229608:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)08:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)08:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)08:10
*** bogdando has joined #tripleo08:13
quiquell|roverbogdando: o/08:14
bogdandoquiquell|rover: hi08:14
quiquell|roverbogdando: good morning sir, maybe you can help me with this https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/undercloud/var/log/containers/mistral/engine.log.txt.gz#_2018-09-12_17_21_20_73808:14
quiquell|roverrascasoft: ^08:15
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: Enable fluentd on multinode-containers scenario  https://review.openstack.org/59740308:15
rascasoftbogdando, quiquell|rover, environment is still available if you want to jump in08:15
bogdandoI'm not really a mistral expert, so not sure I could help here08:16
*** dparkes has quit IRC08:16
quiquell|roverTengu: Do you know about mistral ?08:16
*** radeks has quit IRC08:16
bogdandoseems like some notification from a workflow is missing08:16
bogdandocan't tell why and what tho08:17
*** dparkes has joined #tripleo08:17
Tenguquiquell|rover: not really :/.08:17
*** artom has quit IRC08:18
bogdandowhile I can see that file is in place https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/overcloud-controller-0/var/lib/heat-config/deployed/a557a476-c788-4b44-8e8c-744b0d7120d0.notify.json.txt.gz hm08:18
bogdandoso not sure what's happening there08:18
*** artom has joined #tripleo08:18
quiquell|roverMaybe took too much to appear08:19
*** artom has quit IRC08:19
*** artom has joined #tripleo08:19
*** artom has quit IRC08:20
*** d0ugal has joined #tripleo08:20
*** assassin has joined #tripleo08:20
*** artom has joined #tripleo08:20
*** artom has quit IRC08:21
*** artom has joined #tripleo08:21
bogdandoquiquell|rover: may be, there is a delta of a 6 min08:22
bogdandofrom event to the files timestamps08:22
*** artom has quit IRC08:22
quiquell|roverrascasoft: can you access compute0 and look for creation time of https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/overcloud-novacompute-0/var/lib/heat-config/deployed/f03ad0eb-e67e-4062-b53f-e6eacba24fbc.notify.json.txt.gz08:22
*** artom_ has joined #tripleo08:22
*** artom_ is now known as artom08:22
quiquell|rover"creation_time": "2018-09-12T17:07:12Z",08:23
*** artom has quit IRC08:23
quiquell|roverand failure at https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/undercloud/home/stack/overcloud_deploy.log.txt.gz#_2018-09-12_17_14_1708:23
quiquell|rover17:14:1708:23
rascasoftquiquell|rover, confirmed08:24
quiquell|roverrascasoft: creation time ?08:24
rascasoftquiquell|rover, http://pastebin.test.redhat.com/64546908:24
quiquell|roverrascasoft: So they appear after the check... race condition :-/08:26
rascasoftquiquell|rover, I'm going to open a bug then08:26
quiquell|roverrascasoft: weird thing is here https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/overcloud-novacompute-0/var/lib/heat-config/deployed/f03ad0eb-e67e-4062-b53f-e6eacba24fbc.json.txt.gz08:26
quiquell|roverrascasoft: It says  "creation_time": "2018-09-12T17:07:12Z",08:26
rascasoftquiquell|rover, well, we don't have the effective creation time for the file (birth is not indicated inside the stats) so I think this might be correct08:28
rascasoftquiquell|rover, I'm talking about the difference between times08:28
bogdandoI think that creation_time is something before the execution started08:28
bogdandoand the notification file created after it has finished08:28
*** d0ugal has quit IRC08:29
*** d0ugal has joined #tripleo08:29
quiquell|roverbogdando: This is related to config-download ?08:29
rascasoftbogdando, yes, I was talking on filesystem side, we have xfs so no time of birth is stored08:29
bogdandoI have no idea08:29
bogdandorascasoft: right, but other attributes should be enough as well08:30
quiquell|roverbogdando: I see we check the notify file just after running /usr/libexec/os-refresh-config/configure.d/55-heat-config08:30
quiquell|roverbogdando: Let's wait for a minute08:30
rascasoftquiquell|rover, sorry wait for what?08:35
*** d0ugal has quit IRC08:35
*** ykarel|away has joined #tripleo08:36
quiquell|roverrascasoft: give me a min to do a review08:36
*** d0ugal has joined #tripleo08:36
quiquell|roverbogdando: Could be that we are missing some flushing here ? https://github.com/openstack/heat-templates/blob/master/hot/software-config/elements/heat-config/os-refresh-config/configure.d/55-heat-config#L17308:43
*** d0ugal has quit IRC08:44
*** d0ugal has joined #tripleo08:44
bogdandoquiquell|rover: I'd say this code needs an explicit .close()08:48
quiquell|roverbogdando: the "with" does not do that ?08:48
bogdandoneed to look around for the same paterns08:48
bogdandomaybe it does)08:48
*** athomas has quit IRC08:49
quiquell|roverbogdando: I am putting a os.fsync there08:49
*** cylopez has joined #tripleo08:50
quiquell|roverrascasoft: Do you have the bug ?08:50
*** psahoo has quit IRC08:50
quiquell|roverbogdando, rascasoft: https://review.openstack.org/60227008:52
quiquell|roverbogdando: Sure we have to do similar at other places of it08:52
*** pvc has quit IRC08:52
bogdandoquiquell|rover: I think with does all dances08:53
bogdandohttp://codesearch.openstack.org/?q=os.O_CREAT%20%7C%20os.O_WRONLY&i=nope&files=&repos=08:54
bogdandoso IMO that code is OK08:54
bogdandothough not sure with the fdopen part parking...08:54
quiquell|roverbogdando: The issue is here http://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/templates/deployments.yaml#n3908:55
quiquell|roverbogdando: jq does not find the notification08:55
quiquell|roverbogdando: we can add some latency there or a loop checking, but is weird that the file is not there08:56
quiquell|roverchkumar|ruck: ^08:56
quiquell|roverchkumar|ruck: Looks like a race codition08:57
rascasoftquiquell|rover, I wonder why this does not happen with other files and in general more frequently08:58
rascasoftbogdando, ^^^08:58
bogdandolooks like a race https://review.openstack.org/#/c/554276/8/tripleo_common/templates/deployments.yaml@2108:58
quiquell|roverrascasoft: maybe it's related to the popen thing, maybe it blocks the file descriptor somehow08:58
bogdandothe action taken for *notify file is checked against the other file stat results08:59
quiquell|roverbogdando: Ahh...08:59
bogdandoso it should check against the notify file stat08:59
quiquell|roverbogdando: Ok, review going08:59
bogdandoI think heat creates those two in a non atomic fashion09:00
*** ykarel|away has quit IRC09:00
bogdandod0ugal: ^^09:00
quiquell|roverbogdando, d0ugal: but it's not running this http://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/templates/deployments.yaml#n39 ?09:00
bogdandooh well, so probably the 55-heat-config fails w/o creating that notify file?09:02
quiquell|roverbogdando: The stuff you paste is the previous one09:02
bogdandoyeah09:02
quiquell|roverbogdando: The issue is calling 55-heat-config, and notify file not there09:02
d0ugalbogdando: What am I looking at? :)09:02
bogdandomistral magic! :)09:02
quiquell|roverd0ugal: https://thirdparty.logs.rdoproject.org/jenkins-oooq-rocky-rdo_trunk-bmu-ha-lab-cygnus-float_nic_with_vlans-3/undercloud/home/stack/overcloud_deploy.log.txt.gz#_2018-09-12_17_14_1709:03
bogdandoor heat magic, not sure09:03
Tengumistral should be renamed mystic,09:03
Tengujust sayin'09:03
quiquell|roverd0ugal: Issue here http://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/templates/deployments.yaml#n3909:03
quiquell|roverTengu++09:03
d0ugalquiquell|rover: But what is the issue? do we have a bug?09:03
Tenguno karma-bot. duh :'(09:03
quiquell|roverrascasoft: Did you openned it ?09:03
rascasoftTengu++09:04
rascasoftquiquell|rover, doing it at once09:04
*** quiquell|rover is now known as mistral-bot09:04
*** dtantsur|afk is now known as dtantsur09:04
mistral-botTengu karma is 66609:04
*** mistral-bot is now known as quiquell|rover09:04
chkumar|ruckmistral-bot++09:04
TenguXD09:05
quiquell|rover d0ugal: overcloud deploy fails for a race condition, when it checks for the heat .notify.json files they are not there yet09:06
quiquell|roverd0ugal: exactly at this point http://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/templates/deployments.yaml#n4009:06
d0ugalI don't know what .notify.json is :)09:06
d0ugalThis seems like Heat stuff?09:07
quiquell|roverd0ugal: To be honest me neither, looks like they are write at the end of workflows09:07
quiquell|roverd0ugal: Has put a sure wrong review https://review.openstack.org/#/c/602270/09:07
d0ugalRight, makes sense09:08
d0ugalAlmost certain this must be heat magic09:08
quiquell|roverd0ugal: python 'with' statement is suppose to ensure that the file is there after the scope of it09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676409:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215809:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229609:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)09:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)09:10
d0ugalquiquell|rover: Indeed, I agree with the comment09:11
d0ugalIt closes the file, I guess you can't do that without a flush and sync :)09:12
quiquell|roverd0ugal: popen can affect accessing the file descriptor ?09:12
quiquell|roverDon't know the bash snippet looks very sequencial to me09:13
d0ugalquiquell|rover: hrm, that is a good point. I didn't notice we were using os.fdopen, that might behave differently09:15
quiquell|roverrascasoft: Did you found more of this ?09:18
quiquell|roverd0ugal, bogdando: btw, Can I have some reviewing here ? https://review.openstack.org/#/c/602025/09:19
quiquell|roveris super short09:19
*** pvc has joined #tripleo09:20
pvchi09:20
pvccan i add ceph with compute node or do i need to separate it?09:20
rascasoftquiquell|rover, I've opened the bug https://bugs.launchpad.net/tripleo/+bug/179234309:22
openstackLaunchpad bug 1792343 in tripleo "[tripleo] rocky baremetal deployment fails with jq: error: Could not open file /var/lib/heat-config/deployed/<id>.notify.json" [High,Triaged]09:22
rascasoftmentioning the review09:22
rascasoftquiquell|rover, I'm trying to interpret bogdando comment on the review, but I'm not sure I'm getting the point09:23
quiquell|roverrascasoft: It means that python do those things after closing 'with' scope, at least it's suppose to09:24
rascasoftquiquell|rover, ok so what you added might not be needed09:25
rascasoftshould not09:25
rascasoftbut the problem seems to be related09:25
quiquell|roverrascasoft: Yep it kind of noop09:25
quiquell|roverrascasoft: I am thinking that maybe this is read from a NFS or the like09:25
quiquell|roverrascasoft: And it's out of sync for some seconds09:26
rascasoftquiquell|rover, do we have NFS somewhere during the deployment?09:26
* rascasoft is really scared at this point09:26
quiquell|roverrascasoft: Nah just out of my mind09:26
quiquell|roverrascasoft: We can also try other review, checking the file in a loop09:26
quiquell|roverrascasoft: It's the first time you see this ? I think I have see this before09:28
rascasoftquiquell|rover, yes, but we didn't check rocky/master from a long time (it has been broken since two months for other reasons)09:29
*** akrivoka has joined #tripleo09:30
rascasoftquiquell|rover, I can rerun the deployment, to check whether or not the problem appear again09:31
quiquell|roverrascasoft: Is race condition... who knows...09:31
rascasoftquiquell|rover, from what I know right now this problem can be a race or consistent as well09:31
quiquell|roverrascasoft: this was rocky ?09:31
rascasoftquiquell|rover, yes09:31
rascasoftquiquell|rover, I'm getting all the sosreports and then I'll re deploy09:33
pvcanyone not busy here?09:34
*** psahoo has joined #tripleo09:34
pvchi rascasoft09:34
rascasoftpvc, so not busy == rascasoft :D :D :D ? How this equation works?09:35
pvccan i ask sir?09:35
quiquell|roverd0ugal: Why do we need the popen part if we have already writhe the file ?09:35
rascasoftpvc, sure sure, I was just joking09:35
pvccan i deploy overcloud compute node + ceph?09:35
pvcbecause i only have 3 servers 1 for undercloud and 1 each for overcloud controller and compute09:36
rascasoftpvc, you can use the hyperconverged approach, but I honestly never tried with one single compute09:37
quiquell|roverd0ugal: Ahh nah... we run heat-config-notify after creating t he file09:37
d0ugalquiquell|rover: I think it creates the file if it doesn't exist?09:37
pvcis there any documentation for hypervconverged rascasoft? I can do also the fast-forward-upgrade from ocata to rocky right?09:38
rascasoftpvc, about FFU that's a really good question, I don't know if that kind of hyperconvergence is supported09:39
pvcFFU is possible from ocata to rocky?09:39
quiquell|roverd0ugal: It's executing heat-config-notify using the file as input09:39
rascasoftpvc, check https://docs.openstack.org/tripleo-docs/latest/install/basic_deployment/basic_deployment_cli.html for details about how to use hyperconverged-ceph.yaml09:40
pvcthank you so much. rascasoft. about the FFU it is possible from ocata to rocky09:42
rascasoftpvc, I think it *could* be possible, but we need to check with some FFU experts09:43
quiquell|roverd0ugal: I see a open without close09:44
rascasoftmatbu, look at what pvc wrote09:44
pvcrascasoft with that hyperconverged docs. ceph mon and ceph osd is same with compute node09:45
pvchi matbu just want to ask your expertise09:45
openstackgerritCĂ©dric Jeanneret proposed openstack/tripleo-heat-templates master: Rename "OS::TripleO::Services::Docker" and "OS::TripleO::Services::DockerRegistry"  https://review.openstack.org/60227809:48
Tengudunno why, I'm pretty sure this will break everything....09:48
d0ugalquiquell|rover: where?09:48
Tenguanyway. let's check that.09:48
quiquell|roverd0ugal: I think now it make more sense https://review.openstack.org/60227009:49
matburascasoft: pvc yep09:49
quiquell|roverd0ugal: Maybe not closing it prevent jq from open it09:49
quiquell|roverbogdando: updated https://review.openstack.org/60227009:50
d0ugalquiquell|rover: but isn't jq called after that script finishes?09:50
quiquell|roverd0ugal: Yep, puff don't know, btw not closing the file is not a good practice tough09:51
quiquell|roverd0ugal: Maybe python takes some time to close the openned resources and jq fails, but doesn't make sense09:52
d0ugalquiquell|rover: agreed, it is better to use "with"09:52
d0ugalmaybe, but that would be impressive if Python closes the file sometime after it exits :-D09:52
pvcmatbu thank you so much :) I will just refer to that officel triple o FFU upgrade?09:52
quiquell|roverrascasoft: Can you test the review with a reproducer or the like ?09:53
*** sri_ has quit IRC09:53
*** sri_ has joined #tripleo09:54
*** dtrainor_ has joined #tripleo09:54
rascasoftquiquell|rover, I can do that, yes, but if it's race I'll need to rerun a lot of times the deployment09:55
*** athomas has joined #tripleo09:56
*** dtrainor has quit IRC09:58
*** dtrainor__ has joined #tripleo09:59
matbupvc: yep the procedure should be the same as th doc09:59
quiquell|roverrascasoft: The review is legit and good code, if it works it make sense to merge it.09:59
quiquell|roverrascasoft: Don't worry about reproducing the error, just let's try to merge this10:00
rascasoftquiquell|rover, testing it right now10:00
quiquell|roverrascasoft: thanks :-)10:00
quiquell|roverbogdando, d0ugal: What reviewers do I have to add to openstack/heat-templates ?10:00
*** dtrainor_ has quit IRC10:01
d0ugalquiquell|rover: no idea, it doesn't come under tripleo-core it seems.10:01
d0ugal:)10:01
quiquell|roverDo we have #openstack-heat-templates ? :-)10:02
*** saneax has quit IRC10:02
d0ugalquiquell|rover: I suspect it is a #heat repo?10:02
quiquell|roverd0ugal: ack, thanks10:05
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676410:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215810:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229610:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)10:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)10:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)10:10
quiquell|roverHumm glance is not starting here https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/36edbf9/logs/subnode-2/var/log/containers/glance/api.log.txt.gz10:16
quiquell|rover"Can't connect to MySQL server on '192.168.24.11' ([Errno 113] No route to host)"10:16
quiquell|roverbogdando, d0ugal, Tengu: rings any bell ^ ?10:17
Tenguhmm not that one.10:17
quiquell|roverchkumar|ruck: mysql looks ok https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/36edbf9/logs/subnode-2/var/log/containers/mysql/mysqld.log.txt.gz10:18
*** sri_ has quit IRC10:19
quiquell|roverchkumar|ruck: The ip is different  listening at tcp://192.168.24.3:456710:19
quiquell|roverBut they are in docker, don't know where do we do the mapping10:19
quiquell|roverIt's looking for 192.168.24.1110:20
Tenguquiquell|rover: beware10:21
Tenguquiquell|rover: mysql isn't directly accessed.10:21
Tenguit's proxyfied by haproxy10:21
Tenguso I guess the .11 is owned by haproxy container/service.10:21
quiquell|roverTengu: where do we do the mapping from 192.168.24.11 to //192.168.24.3 ?10:21
Tenguquiquell|rover: well, haproxy service should get its private IP and kind of export it so that services needing mysql (and other services behind haproxy) knows about it.10:22
Tenguso the question is: what's the IP for haproxy?10:22
Tenguuh? no haproxy container log ?!10:23
chkumar|ruckquiquell|rover: from logs ceph is giving error, is it related to that also?10:23
chkumar|ruckError ENOENT: unrecognized pool10:23
Tenguquiquell|rover: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/36edbf9/logs/subnode-2/var/log/config-data/haproxy/etc/haproxy/haproxy.cfg.txt.gz10:25
Tenguquiquell|rover: issue with order I guess - haproxy doesn't seem to run, meaning we can't get logs from it, and probably some IP allocation issue at some point, seeing the "no route to host"10:25
Tenguquiquell|rover: in the linked haproxy.cfg, check for the "listen mysql" block.10:26
Tenguyou'll see how it's supposed to work.10:26
quiquell|roverTengu: I don't see any haproxy container...10:27
Tenguquiquell|rover: and I'd say here, there's something weird with haproxy not being started - we only have the configuration container: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/36edbf9/logs/subnode-2/var/log/extra/docker/docker_allinfo.log.txt.gz10:27
quiquell|roverTengu: How do you know it's only configuration ?10:31
Tenguquiquell|rover: the task + name of the containers10:33
Tenguquiquell|rover: i.e. "/docker_puppet_ap..."   About an hour ago   Exited (0) About an hour ago                       haproxy_init_bundle10:33
quiquell|roverTengu, chkumar|ruck: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/36edbf9/logs/subnode-2/var/log/journal.txt.gz?level=ERROR#_Sep_13_08_00_2810:33
*** radeks has joined #tripleo10:34
quiquell|roverTengu: Is there any place with logs about why the docker cannot start ?10:34
Tenguso yep. issue with the startup of haproxy.10:34
Tenguquiquell|rover: maybe in the var/log/extra/10:35
Tengubut apparently we don't have haproxy stuff :(.10:35
*** slaweq__ has joined #tripleo10:36
*** dprince has quit IRC10:37
*** two_oes has joined #tripleo10:37
Tenguquiquell|rover: maybe it's a one-time error?10:38
quiquell|roverTengu: nope, happends twice in a row in the promotion jobs10:38
chkumar|ruckwe hitted the same issue in rocky and master job10:38
Tenguerf :(10:38
quiquell|rovergoing to reproduce it, to see if accessing subnodes give me more info10:38
*** stendulker has joined #tripleo10:39
Tenguno real idea for that one. without container logs, we're a bit locked.10:39
quiquell|roverTengu: don't know why the logs are not there, looks like it's trying to tart it up ? or not even that ?10:39
Tenguquiquell|rover: well, we have a couple of haproxy "boostrap" containers - but no logs for them. Not sure how the "extras/docker" directory is managed.10:40
TenguI saw how it was done, but it's been a while now.10:40
quiquell|roverTengu: at docker_allinfo.log.txt.gz I see we have a /usr/bin/bootstrapp... this is the one that is suppose to start up ?10:42
quiquell|roverhaproxy_restart_bundle10:42
Tenguquiquell|rover: nope, I think the standard command for haproxy startup is something else. wait, I just could deploy my undercloud.10:42
Tenguquiquell|rover: I have that one here: fc8af906ca2d        docker.io/tripleomaster/centos-binary-haproxy:0d5b1d18e88ad27e87368c8844c325cbfe603fdb_e25bec61                     "kolla_start"            18 minutes ago      Up 18 minutes                                 haproxy10:42
quiquell|roverkolla_start is the command10:43
Tenguyep10:43
quiquell|roverMaybe it's not even kicking it... I don't see it in the list10:43
Tenguthat's the one for the vast majority of the containers in fact.10:43
Tenguquiquell|rover: apparently there's an error at some early stage of the haproxy boostrap.10:43
Tenguseeing the log you pasted earlier.10:43
Tenguupstream-centos-7-rdo-cloud-tripleo-0000174334 lrmd[30343]:   notice: haproxy-bundle-docker-0_start_0:73283:stderr [ ocf-exit-reason:waiting on monitor_cmd to pass after start ]10:44
quiquell|roverTengu: this is just the healthcheck I supose10:44
Tenguyeah, probably. fact is, none of the boostrap haproxy container seems to exit with an error - all have a "0" rc.10:45
Tengubut for some reason the main haproxy container isn't running.10:45
quiquell|roverTengu: who kick that in ?10:45
Tengunot even started once, else we'd see it with some "exited (YX)"10:45
quiquell|roverheat ?10:46
Tenguhmm can't say - that's in t-h-t, and haproxy should be started at end of step 1 I think10:46
Tenguquiquell|rover: I'm still struggling in order to understand who does what in the process - with kolla, paunch, mistral, heat... not really clear to me :/.10:47
quiquell|roverTengu: what the f... is paunch ?10:47
Tenguwrapper for docker :D10:48
quiquell|roverDocker is kind of wrapper too :-P10:48
Tenguhttps://github.com/openstack/paunch10:48
Tenguwe can see it as a "docker-compose" not docker-centric.10:48
chkumar|ruckquiquell|rover: Where we keep all the glues for managing containers in Tripleo Deployment10:48
d0ugalwrappers all the way down?10:48
*** cylopez has quit IRC10:49
Tengud0ugal: you don't wrap your already-wrapped gift twice for Christmas? :)10:49
quiquell|roverchkumar|ruck: I tough heat doin all the orchestration... now I don't know10:49
quiquell|roverchkumar|ruck: Let's check working one, this is a nightmare10:49
quiquell|roverchkumar|ruck: working one https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/0f30dbb/10:50
quiquell|roverwe are missing "bundle-docker-0"10:51
quiquell|rover"/bin/bash /usr/lo..." is the command10:51
*** slaweq__ has quit IRC10:52
chkumar|ruckquiquell|rover: so after 07th Aug, anything which got merged it updated i think10:52
quiquell|roverchkumar|ruck:  let me check if after that the failure is the same10:52
chkumar|rucksorry 7th Sept10:52
*** dparkes has quit IRC10:52
Tenguhm, fact is, you won't get all the containers - some of them are properly cleaned once the bootstrap is done.10:53
chkumar|ruckEarlier it was kuryr tempest plugin issue10:53
quiquell|roverchkumar|ruck: That's right10:53
chkumar|rucktill 10th it is ok10:54
quiquell|roverSo we have to discover who schedules the main haproxy container, to see why it doesn't kicks in10:54
*** dparkes has joined #tripleo10:54
*** assassin has quit IRC10:56
chkumar|ruckI am also not seeing any recent changes merged in tripleo projects related to haproxy also10:57
quiquell|roverchkumar|ruck: Can be a change at kolla or who knows... we are like the last monkeys in the openstack piramid10:57
quiquell|roverchkumar|ruck: And noone is testing with our sh...10:58
*** assassin has joined #tripleo10:58
chkumar|ruckquiquell|rover: https://review.openstack.org/#/q/haproxy+status:merged10:58
quiquell|roverchkumar|ruck: There are some changes the 10th10:59
chkumar|ruckTengu: who take cares of haproxy stuff in Tripleo?10:59
Tenguchkumar|ruck: I don't get the question... ?11:00
quiquell|roverchkumar|ruck: There is an update in the haproxy RPM version https://review.openstack.org/#/c/600359/5/centos-mirror-tools/rpms_centos.lst11:00
quiquell|roverBut this is puppet-haproxy11:00
*** dparkes has quit IRC11:00
chkumar|ruckTengu: Anyone who can help on haproxy issue11:01
Tenguchkumar|ruck: well, I know a bit of haproxy - but that's probably the HA team for that bad boy.11:01
*** dtrainor_ has joined #tripleo11:04
*** dtrainor__ has quit IRC11:06
*** d0ugal has quit IRC11:07
*** d0ugal has joined #tripleo11:08
*** dtrainor__ has joined #tripleo11:09
quiquell|roverMaybe we have something here ? https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/36edbf9/logs/undercloud/var/lib/tripleo-config/11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676411:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215811:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229611:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)11:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)11:10
*** dtrainor_ has quit IRC11:11
*** dparkes has joined #tripleo11:13
*** two_oes has quit IRC11:17
quiquell|roverchkumar|ruck: rocky noop failing upstream http://logs.openstack.org/47/602247/2/check/tripleo-ci-centos-7-undercloud-oooq/e71ef05/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-09-13_08_29_1911:21
*** jtomasek has joined #tripleo11:27
quiquell|roverTengu: and about puppet and undercloud, how do you manage ?11:31
quiquell|roverwe have a rocky gate blocker now :-(/11:31
quiquell|roverhttps://bugs.launchpad.net/tripleo/+bug/179237211:31
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)11:31
Tenguquiquell|rover: puppet - I've done that for some years.11:31
Tenguoh. that one? didn't you provide a patch already, quiquell|rover ?11:32
quiquell|roverTengu: Did I ? pufff possible11:32
quiquell|roverTengu: Do you have your brain reference around ?11:32
Tenguquiquell|rover: lemme check in my logs.11:32
quiquell|roverThe other branches are working fine, it's just rocky11:33
Tenguhmm. let me deploy an undercloud with rocky locally.11:34
openstackgerritMerged openstack-infra/tripleo-ci master: Fix te-broker IP for OVB jobs  https://review.openstack.org/60209611:35
quiquell|roverTengu: So It's declared here https://github.com/openstack/instack-undercloud/blob/stable/rocky/elements/puppet-stack-config/puppet-stack-config.pp11:35
quiquell|roverhttps://github.com/openstack/instack-undercloud/blob/stable/rocky/elements/puppet-stack-config/puppet-stack-config.pp#L51311:36
quiquell|roverand here11:36
Tenguquiquell|rover: ok, so apparently EmilienM is the guy who added the thing in puppet-nova: https://github.com/openstack/puppet-nova/commit/b4f3d6a57132333289804e276175dd90d802391b11:36
quiquell|roverhttps://github.com/openstack/puppet-nova/blob/stable/rocky/manifests/compute.pp#L31611:36
quiquell|roverTengu:  is not this one ? https://github.com/openstack/puppet-nova/commit/48013f39c324e718cc398e2a162fc887a8eb412111:36
Tenguquiquell|rover: well, I'm on master.11:37
quiquell|roverTengu: rocky is the one failing, the job is not executed in master11:37
Tenguquiquell|rover: yeah, I suppose a patch wasn't cherry-picked in rocky.11:37
openstackgerritYurii Prokulevych proposed openstack/tripleo-heat-templates master: Fix typo in ansible's module name.  https://review.openstack.org/60233611:37
Tenguquiquell|rover: i.e. master doesn't have the nova_config in puppet-stack-config.pp anymore11:37
Tengulemme check the history on that file on master.11:38
*** Chaserjim has joined #tripleo11:38
Tenguhttps://github.com/openstack/instack-undercloud/commit/8dcb08a4ec376faa6a8702c644cfe1ae82a6cf4711:38
Tengubingo.11:38
Tenguso we just need to find the modification and backport it to rocky.11:38
*** two_oes has joined #tripleo11:39
Tenguquiquell|rover: https://review.openstack.org/#/c/602042/11:39
Tenguneeds a cr+2 I guess.11:39
quiquell|roverTengu++beer11:40
chkumar|ruckTengu: weshay sshnaidm|ptg bogdando mandre https://review.openstack.org/599355 needs +w11:40
Tengubogdando: care to cr+2 that one? https://review.openstack.org/#/c/602042/  blocker on rocky. Thanks :)11:40
Tenguchkumar|ruck: I'm no core (for now) :'(11:40
quiquell|roverDepends on chain is merged there :-) just the +2 :-(11:41
chkumar|ruckquiquell|rover: http://logs.openstack.org/45/560445/139/check/tripleo-ci-centos-7-containers-multinode/dfc441e/job-output.txt.gz#_2018-09-13_10_20_18_84734811:41
*** Chaserjim has quit IRC11:43
quiquell|roverchkumar|ruck: They are trying to overwrite python executable ? really ?11:43
quiquell|roverchkumar|ruck: It's a noop failure ?11:43
chkumar|ruckquiquell|rover: yes on master11:43
quiquell|roverpuff ok11:43
quiquell|roverchkumar|ruck: open a bug please11:44
chkumar|ruckquiquell|rover: ack11:44
quiquell|roverand update the etherpad11:44
quiquell|roverA lot of new stuff is going today :-(11:44
chkumar|ruckquiquell|rover: --working-dir /home/zuul/workspace//.quickstart11:45
chkumar|ruckwhy working dir is //? any idea11:45
chkumar|ruck(./toci_quickstart.sh:101): ./quickstart.sh --bootstrap --no-clone --working-dir /home/zuul/workspace//.quickstart --playbook noop.yml --retain-inventory 127.0.0.211:45
quiquell|roverchkumar|ruck: That's changes at tripleo-ci for sure, but this is not a big deal11:45
quiquell|roverpath is good11:45
*** saneax has joined #tripleo11:45
chkumar|ruckok11:45
*** assassin has quit IRC11:46
quiquell|roverchkumar|ruck: Looks like it's reusing the virtualenv already set... :-/11:46
quiquell|roverchkumar|ruck: This needs a new one11:46
quiquell|roverIt's a race condition, some are passing11:47
thervequiquell|rover: Unless you modify and old version, heat-agents is the repo holding heat-config11:48
quiquell|rovertherve: About what issue ? I have some of them now at the back of my brain11:49
thervequiquell|rover: Sorry https://review.openstack.org/#/c/602270/11:49
*** ansmith has quit IRC11:49
bogdandoTengu, quiquell|rover, chkumar|ruck: it's pacemaker.log, as we have HA haproxy-bundle-docker-0 here11:50
bogdandoso all details should be looked in pcmk logs11:50
quiquell|rovertherve: what do you mean ?11:50
bogdandobandini: ^^ :)11:50
chkumar|ruckquiquell|rover: https://bugs.launchpad.net/tripleo/+bug/179237511:50
openstackLaunchpad bug 1792375 in tripleo "[master] multinode noop job failure giving IOError: [Errno 26] Text file busy: '/home/zuul/workspace/.quickstart/bin/python'" [Critical,Triaged]11:50
thervequiquell|rover: I mean it's not where the change should be made. It should be made in the heat-agents repo11:50
rascasoftquiquell|rover, bogdando, deploy ended with error: exactly the same11:50
chkumar|ruckquiquell|rover: I am taking over that bug11:51
Tengubogdando: ah, right. thanks for the headsup.11:51
rascasoftquiquell|rover, bogdando, so, good news: it is consistent, bad news: solution doesn't work11:51
quiquell|roverchkumar|ruck: ok, feels like not proper stuff done with virtualenv chkumar|ruck11:51
Tengubogdando: care to make that one pass through the gate? https://review.openstack.org/#/c/602042/  ?11:51
quiquell|roverrascasoft: Looks like the fix have to be done in other repo, give me a sec11:51
quiquell|roverrascasoft: Try with this, I updatd the wrong repo https://review.openstack.org/#/c/602340/11:57
quiquell|roverbogdando, therve, Tengu, d0ugal: Change at correct repo https://review.openstack.org/#/c/602340/11:58
therveThanks11:58
*** apetrich has joined #tripleo11:58
rascasoftquiquell|rover, to be honest I already modified the /usr/bin/heat-config-notify file in the undercloud11:58
quiquell|roverrascasoft: manually ?11:59
rascasoftquiquell|rover, yeah12:00
rascasoftquiquell|rover, we can talk about it in the call12:00
quiquell|roverrascasoft: ack, then red herring...12:00
quiquell|roversure12:00
*** phuongnh has joined #tripleo12:00
quiquell|roverrascasoft: we can try to put in place a guard in the bash snippet12:00
quiquell|roverat least we are reproducing it12:01
quiquell|roverbtw using with is not a bad thing, but maybe I have to remove the Closes-Bug12:01
*** morazi has joined #tripleo12:04
*** tzumainn has joined #tripleo12:04
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676412:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215812:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229612:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237212:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)12:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)12:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)12:10
*** apetrich has quit IRC12:10
*** apetrich has joined #tripleo12:11
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates stable/pike: Fluentd configures rsyslog to send logs properly  https://review.openstack.org/58749612:11
*** lblanchard has joined #tripleo12:13
openstackgerritBogdan Dobrelya proposed openstack/tripleo-docs master: Document standalone/UC update Heat stack specifics  https://review.openstack.org/57879912:15
*** mpasserini has left #tripleo12:17
*** karthiks has quit IRC12:21
quiquell|roverTengu: reproduced the haproxy problem at my RDO cloud12:25
quiquell|roverTengu: Where do I have to look ?12:25
Tenguquiquell|rover: do you have some tmate? I'm in an mtg, free in ~5 minutes12:27
quiquell|roverTengu: CIX ?12:28
Tenguyup12:28
*** jtomasek has quit IRC12:28
Tengu"so now who's that tengu in the user list??" ;)12:28
quiquell|roverMe too12:28
quiquell|roverOk12:29
Tenguhehe12:29
Tenguso, any tmate? might be easier.12:29
quiquell|roverTengu: priv12:29
*** raildo has joined #tripleo12:34
*** rlandy has joined #tripleo12:35
*** raildo has quit IRC12:35
*** rdopiera has quit IRC12:35
*** raildo has joined #tripleo12:36
*** raildo has quit IRC12:37
*** rdopiera has joined #tripleo12:37
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Create venv only when if OPT_WORKDIR is not there  https://review.openstack.org/60234712:41
chkumar|ruckquiquell|rover: ^^12:42
*** raildo has joined #tripleo12:48
*** radeks has quit IRC12:57
*** med_ has joined #tripleo12:58
*** ansmith has joined #tripleo13:02
openstackgerritMartin AndrĂ© proposed openstack/puppet-tripleo master: Add haproxy endpoint config for openshift routers  https://review.openstack.org/60206313:05
*** panda|ptg has joined #tripleo13:06
openstackgerritMartin AndrĂ© proposed openstack/tripleo-heat-templates master: Configure haproxy for openshift infra  https://review.openstack.org/60124113:06
*** gbarros has joined #tripleo13:07
*** pdeore_ has joined #tripleo13:08
quiquell|roverbogdando: Can you +2 EmilienM patch https://review.openstack.org/#/c/602042/ to unblock rocky gates ?13:08
*** rh-jelabarre has quit IRC13:09
*** radeks has joined #tripleo13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676413:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215813:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229613:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237213:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)13:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)13:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)13:10
*** jtomasek has joined #tripleo13:10
*** dparkes has quit IRC13:14
*** rbrady has joined #tripleo13:15
*** rbrady has joined #tripleo13:15
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Add simple validation that OpenShift is deployed  https://review.openstack.org/60006713:15
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Add parameter for docker-registry image  https://review.openstack.org/60235213:15
openstackgerritYurii Prokulevych proposed openstack/tripleo-heat-templates master: Fix syntax for set_fact module.  https://review.openstack.org/60235313:16
*** rbrady has quit IRC13:16
*** jtomasek has quit IRC13:17
*** pdeore_ has quit IRC13:19
*** pdeore_ has joined #tripleo13:19
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Remove timeout logic  https://review.openstack.org/58906813:19
*** quiquell|rover is now known as quique|rover|lch13:23
*** assassin has joined #tripleo13:24
*** dparkes has joined #tripleo13:32
*** pdeore_ has quit IRC13:34
*** phuongnh has quit IRC13:34
*** waleedm has quit IRC13:35
*** lvdombrkr has joined #tripleo13:35
*** lvdombrkr89 has quit IRC13:37
*** dparkes has quit IRC13:37
*** ubijtsa has joined #tripleo13:39
*** dparkes has joined #tripleo13:39
*** assassin has quit IRC13:41
*** assassin has joined #tripleo13:42
*** ubijtsa has quit IRC13:42
*** jaganathan has quit IRC13:43
*** assassin has quit IRC13:44
*** assassin has joined #tripleo13:44
*** thrash has joined #tripleo13:46
*** thrash has joined #tripleo13:46
*** thrash is now known as thrash|biab13:48
*** hamdyk has quit IRC13:49
*** assassin has quit IRC13:49
*** assassin has joined #tripleo13:52
*** quique|rover|lch is now known as quiquell|rover13:54
*** assassin has quit IRC13:56
*** d0ugal has quit IRC13:56
*** d0ugal has joined #tripleo13:56
*** trozet has joined #tripleo13:56
*** pradk has quit IRC13:58
*** two_oes has quit IRC13:58
*** assassin has joined #tripleo13:59
*** pradk has joined #tripleo14:02
*** assassin has quit IRC14:03
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944814:04
*** vinaykns has joined #tripleo14:05
*** assassin has joined #tripleo14:06
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676414:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215814:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229614:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237214:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)14:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)14:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)14:10
*** assassin has quit IRC14:10
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Support virthost localhost via local connection  https://review.openstack.org/57674614:12
*** assassin has joined #tripleo14:13
*** assassin has quit IRC14:17
*** assassin has joined #tripleo14:18
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Better support for the local devbox cases  https://review.openstack.org/59356714:20
*** assassin has quit IRC14:23
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59690614:24
*** assassin has joined #tripleo14:26
*** agopi|off is now known as agopi14:26
*** agurenko has quit IRC14:26
*** pcaruana has joined #tripleo14:28
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59690614:30
EmilienMquiquell|rover: sure14:30
*** assassin has quit IRC14:30
*** thrash|biab is now known as thrash14:32
quiquell|roverEmilienM: rechecked this https://review.openstack.org/#/c/602042/ to force merge14:32
quiquell|roverDon't know why it didn't is needed to unblock rocky gates14:32
*** assassin has joined #tripleo14:32
*** slaweq__ has joined #tripleo14:33
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Better support for the non-disposable devboxes.  https://review.openstack.org/59299614:33
EmilienMTengu: I'm preparing bluejeans14:33
EmilienMwe start in 30 min14:33
EmilienMand i'll post the link here in 30 min14:33
TenguEmilienM: great, thanks! dpeacock -^^ in case you're interested as well.14:33
dpeacockTengu: thanks14:34
*** hamdyk has joined #tripleo14:36
*** dciabrin has joined #tripleo14:37
*** assassin has quit IRC14:37
*** assassin has joined #tripleo14:40
*** rh-jelabarre has joined #tripleo14:40
*** hamdyk has quit IRC14:41
quiquell|roverTengu: Do you think this could be related to the haproxy issue ? http://logs.openstack.org/22/601522/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/456fb7b/logs/undercloud/var/log/containers/mistral/package_update.log.txt.gz#_2018-09-13_13_33_36_98414:41
*** stendulker has quit IRC14:41
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: use fs config to assign standalone role, tests  https://review.openstack.org/57283014:42
*** assassin has quit IRC14:44
Tenguquiquell|rover: the certificate thingy? Not really sure. It's a non-fatal check, soooo...14:44
quiquell|roverTengu: was thinking about, it being checked in the docker image and being the cause of it not running it14:44
Tengushouldn't be the case.14:45
quiquell|roverTengu: ack...14:45
*** zul has joined #tripleo14:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud/stackrc: unset OS_* variables  https://review.openstack.org/60236714:46
Tenguquiquell|rover: you can check in the ansible code what's going on - but I'm not sure *where* it's located.14:46
*** assassin has joined #tripleo14:46
quiquell|roverTengu: who do you think can guide me about the docker orchestration ?14:47
*** stendulker has joined #tripleo14:47
TenguEmilienM: first session for me will be about the security thingy right? i.e. podman+selinux and privilege escalation?14:47
TenguEmilienM: is there some etherpad for that, or should I create mine already?14:47
Tengulhinds: are you around?14:48
EmilienMTengu: https://etherpad.openstack.org/p/tripleo-ptg-stein14:48
EmilienMthat's all I know14:48
TenguEmilienM: ok. Juan isn't around apparently.14:48
EmilienMnot yet14:48
Tenguok, UI have their own pad for the sessions.14:49
Tengusecurity apparently not14:49
*** med_ has quit IRC14:49
*** assassin has quit IRC14:51
Tenguadded a pad - can't do any harm.14:51
*** bnemec has quit IRC14:52
*** slaweq__ has quit IRC14:53
*** noslzzp has joined #tripleo14:53
*** assassin has joined #tripleo14:54
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: use fs config to assign standalone role, tests  https://review.openstack.org/57283014:54
*** slaweq__ has joined #tripleo14:55
chkumar|ruckmwhahaha: Hello14:55
chkumar|ruckmwhahaha: at which places clouds.yaml is getting generated during standalone deployment?14:56
mwhahahachkumar|ruck: it's in THT14:56
mwhahahachkumar|ruck: at the end14:56
mwhahahasec14:56
*** bfournie has quit IRC14:56
openstackgerritMerged openstack/tripleo-quickstart master: Stop relying on old legacy sub_nodes_private  https://review.openstack.org/59688714:56
mwhahahachkumar|ruck: https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/post_deploy/standalone_post.sh14:56
chkumar|ruckmwhahaha: thanks :-)14:57
*** quiquell|rover has quit IRC14:57
*** assassin has quit IRC14:58
*** dparkes has quit IRC14:58
*** jaosorior has joined #tripleo14:59
*** d0ugal has quit IRC14:59
jaosoriorTengu, raildo: Gonna join the security session? shall we get you a bluejeans link?15:00
*** yprokule has quit IRC15:00
Tengujaosorior: EmilienM should get one shortly15:00
jaosoriorok15:00
Tengujaosorior: and of course I need the link if you want me to talk :D15:00
raildowell, would be great to join it, if possible15:00
EmilienMhttps://bluejeans.com/u/emacchi/15:00
Tengujaosorior: I've prepared a pad: https://etherpad.openstack.org/p/tripleo-security-ptg-stein15:00
*** noama has quit IRC15:00
jaosoriorraildo: is moguimar gonna join?15:00
openstackgerritJiri Tomasek proposed openstack/tripleo-common stable/rocky: Fix available roles listing  https://review.openstack.org/60237115:00
Tengudamn vanity link15:01
raildojaosorior, I don't see him online, so probably not15:01
*** jtomasek has joined #tripleo15:01
jaosoriorok15:01
jaosoriorTengu: is that oyu?15:02
jaosorior* you15:02
Tenguyep15:02
jaosoriorgreat15:03
Tengujaosorior: guess you saw https://etherpad.openstack.org/p/tripleo-security-ptg-stein ?15:03
jaosoriorTengu: I hadn't, but thanks!15:04
Tengujaosorior: linked from the main PTG pad - thought it would be good to get a dedicated one for the session ;)15:04
*** mcornea has joined #tripleo15:04
*** bfournie has joined #tripleo15:04
openstackgerritMerged openstack/tripleo-heat-templates master: Set OVS local ip through OVS ODL class  https://review.openstack.org/59700215:07
*** owalsh has quit IRC15:07
*** owalsh has joined #tripleo15:07
*** psahoo has quit IRC15:08
*** mjturek has joined #tripleo15:08
*** stendulker_ has joined #tripleo15:09
*** assassin has joined #tripleo15:09
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Add support for OS_CLOUD  https://review.openstack.org/60058615:09
*** itlinux has quit IRC15:09
*** bfournie has quit IRC15:09
*** dtrainor_ has joined #tripleo15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676415:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215815:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229615:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237215:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)15:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)15:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)15:10
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: use fs config to assign standalone role, tests  https://review.openstack.org/57283015:10
trozethi all, has something changed recently with ironic/nova with memory/ram specification. Seeing nova complain in the undercloud that the nodes have 0 ram15:12
*** dtrainor__ has quit IRC15:12
dtantsurtrozet: hi, yes. there was a patch to remove RamFilter from the undercloud, you might have missed it.15:13
trozetdtantsur: i see this warning:15:13
*** stendulker has quit IRC15:13
trozetWARNING nova.scheduler.filters.ram_filter [req-906b27c4-0f00-4cb1-8dec-69488e2b9dd2 - - - - -] The RamFilter is deprecated since the 19.0.0 Stein release. MEMORY_MB filtering is performed natively using the Placement service when using the filter_scheduler driver. Users of the caching_scheduler driver may still rely on this filter but the caching_scheduler driver is itself15:13
*** stendulker_ has quit IRC15:13
trozetdtantsur: can you point me to that patch please?15:13
*** sshnaidm|ptg has quit IRC15:14
*** dtrainor__ has joined #tripleo15:14
dtantsurtrozet: https://github.com/openstack/tripleo-heat-templates/commit/04b235652b44701b8703f63aee10fac6fad13ced15:14
*** jrist has joined #tripleo15:14
*** jrist has joined #tripleo15:14
*** sshnaidm|ptg has joined #tripleo15:14
trozetdtantsur: ty15:15
*** holser|ptg has joined #tripleo15:15
chkumar|ruckmwhahaha: can we replace the hack with os-client-config directly in tht?15:15
*** bnemec has joined #tripleo15:15
*** dtrainor_ has quit IRC15:17
trozetdtantsur: we do have that patch, but i think the problem is because we are not using containerized undercloud15:18
trozetdtantsur: so nova.conf has RamFilter enabled via puppet15:18
*** chem has joined #tripleo15:22
*** fultonj has joined #tripleo15:22
*** ade_lee has joined #tripleo15:23
*** med_ has joined #tripleo15:23
*** radeks has quit IRC15:23
*** tosky has joined #tripleo15:25
*** radeks has joined #tripleo15:25
*** hjensas has joined #tripleo15:28
*** zaneb has joined #tripleo15:29
*** zaneb has quit IRC15:34
*** dtrainor__ has quit IRC15:34
*** lvdombrkr has quit IRC15:34
*** dtrainor__ has joined #tripleo15:34
*** slaweq__ is now known as slaweq15:34
*** eggmaster has joined #tripleo15:38
*** bfournie has joined #tripleo15:39
*** zaneb has joined #tripleo15:39
*** zaneb has quit IRC15:41
*** zaneb has joined #tripleo15:42
*** hamzy has quit IRC15:43
*** dtrainor_ has joined #tripleo15:44
*** boazel has quit IRC15:44
*** dtrainor__ has quit IRC15:46
openstackgerritTom Barron proposed openstack/tripleo-heat-templates stable/queens: Fix bind-mount to manila's bootstrap container  https://review.openstack.org/59501415:46
dtantsurtrozet: which openstack version is it?15:48
openstackgerritTom Barron proposed openstack/puppet-tripleo master: WIP Make sure that ceph-nfs and the VIP start in the right order  https://review.openstack.org/54503515:48
trozetdtantsur: master, i think we fixed it by just changing the filters in nova.conf15:48
dtantsurtrozet: right, non-containerized undercloud is completely unsupported in master15:49
trozetdtantsur: yeah been putting off the move to containerized undercloud, guess its finally time :)15:49
dtantsurme too, development is so much harder now..15:49
*** mjturek has quit IRC15:51
*** dprince has joined #tripleo15:51
*** Chaserjim has joined #tripleo15:52
*** Chaserjim has quit IRC15:53
*** betherly_ is now known as betherly15:54
*** aufi has quit IRC15:54
*** yolanda has joined #tripleo15:55
*** bogdando has quit IRC15:57
*** med_ has quit IRC15:58
*** mjturek has joined #tripleo15:59
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Add config option for ODL IPv6 deployment  https://review.openstack.org/58501515:59
*** itlinux has joined #tripleo16:00
*** kopecmartin has joined #tripleo16:05
mwhahahachkumar|ruck: which hack?16:08
*** boazel has joined #tripleo16:09
*** assassin has quit IRC16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676416:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179215816:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229616:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237216:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1792158 in tripleo "te-broker was removed from the openstack-nodepool tenant" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)16:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)16:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)16:10
*** vinaykns has quit IRC16:11
*** Goneri has joined #tripleo16:13
*** itlinux is now known as itlinux-away16:15
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: break out release config by distro type  https://review.openstack.org/60238716:16
*** itlinux-away is now known as itlinux16:17
*** med_ has joined #tripleo16:17
*** itlinux is now known as itlinux-away16:17
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt  https://review.openstack.org/59154016:18
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt  https://review.openstack.org/59154016:19
*** jpich has quit IRC16:21
*** dtrainor_ has quit IRC16:24
*** itlinux-away is now known as itlinux16:25
*** itlinux is now known as itlinux-away16:25
*** itlinux-away is now known as itlinux16:25
*** itlinux is now known as itlinux-away16:25
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: fedora28 standalone job definition  https://review.openstack.org/59537416:27
*** itlinux-away is now known as itlinux16:27
*** dtrainor has joined #tripleo16:28
*** jaganathan has joined #tripleo16:30
*** jaganathan has quit IRC16:30
*** jaganathan has joined #tripleo16:30
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: test ovb extra node 1  https://review.openstack.org/60183916:34
*** gfidente has joined #tripleo16:35
*** dprince has quit IRC16:38
*** mjturek has quit IRC16:42
*** dtantsur is now known as dtantsur|afk16:43
*** rainleander has joined #tripleo16:44
*** kopecmartin_ has joined #tripleo16:45
mwhahahabandini: so yes, standalone can replicate the password failure stuff if you change all of them. blows up on the init task16:46
mwhahahabandini: Error: Failed to apply catalog: Execution of '/usr/bin/mysql --defaults-extra-file=/root/.my.cnf -NBe SELECT CONCAT(User, '@',Host) AS User FROM mysql.user' returned 1: ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)16:47
mwhahahaEmilienM: -^ pretty sure that affects undercloud16:47
bandinimwhahaha: ah good catch16:47
bandinilet me start filing the upstream bug16:47
jaosorior:D16:48
mwhahahabandini: we probably need a special UPDATE task for mysql to change the password before in like step 116:48
mwhahaha(it blows up in step 2)16:48
mwhahahaif StackAction == UPDATE { sync passwords }16:49
mwhahahafor mysql16:49
mwhahahaor some thing16:49
bandinidciabrin: ^16:49
dciabrinoh ok16:50
*** sri_ has joined #tripleo16:54
weshaymwhahaha, http://zuul.openstack.org/stream.html?uuid=8961e8078b4b43cf97c099e7184e99b1&logfile=console.log16:54
bandinimwhahaha, dciabrin, EmilienM: https://bugs.launchpad.net/tripleo/+bug/179241616:55
openstackLaunchpad bug 1792416 in tripleo "When moving to containers we broke password changing" [High,Triaged]16:55
*** mjturek has joined #tripleo16:55
dciabrinthx bandini16:55
EmilienMbandini: thanks16:56
*** tesseract has quit IRC17:00
*** brault has quit IRC17:00
*** vinaykns has joined #tripleo17:01
mwhahahasshnaidm|ptg, weshay: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/mistral-executor.yaml#L4317:01
mwhahahaactually17:01
mwhahahahttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/mistral-executor.yaml#L4717:01
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Upgrade webpack toolchain  https://review.openstack.org/60162617:02
*** brault has joined #tripleo17:02
*** zaneb has quit IRC17:03
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Upgrade webpack toolchain  https://review.openstack.org/60162617:03
openstackgerritRafael Folco proposed openstack/tripleo-quickstart-extras master: Set libvirt_type kvm for baremetal overcloud deploy  https://review.openstack.org/60158417:04
*** brault has quit IRC17:05
Tengusee you guys :).17:05
*** jtomasek has quit IRC17:06
*** jpena is now known as jpena|off17:07
*** lvdombrkr has joined #tripleo17:08
*** jtomasek has joined #tripleo17:09
jaosoriorTengu: have a good one17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676417:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229617:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237217:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)17:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)17:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)17:10
weshaymwhahaha, where was your patch for python-virtualenv.. quickstart.sh?17:10
mwhahahaweshay: it was in your patch for tripleo-quickstart17:10
mwhahahaweshay: https://review.openstack.org/#/c/591540/27/quickstart.sh17:11
*** brault has joined #tripleo17:12
*** zaneb has joined #tripleo17:13
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Fix typo in upgrade package ansible resource name.  https://review.openstack.org/60239917:13
honzabeagles: hey, did you want me to avoid using the bool2str() function in the expires header patch?17:13
chemholser|ptg: weshay, so the patch above was found using the all in one upgrade task ^17:14
chemweshay: so it definitively has value, at least as a task validation17:14
beagleshonza: nope sorry - I realized I hadn't responded to your question and didn't review your latest update17:15
beagleshonza: your current code looks fine I think17:15
honzabeagles: cool, thanks for the review17:15
beagleshonza: I totally forgot about bool2str ! so learning ensues17:16
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: libvirt standalone deployment  https://review.openstack.org/59107717:17
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: f28 support for quickstart  https://review.openstack.org/59165217:17
honzabeagles: haha, that's funny because i know next to nothing about puppet :)17:17
*** hamzy has joined #tripleo17:18
beagleshonza: :)17:22
*** lvdombrkr has quit IRC17:23
beagleshonza: how awkward would it be to modify the tests in spec/classes/tripleo_ui_spec.rb to cover this change17:24
*** zaneb has quit IRC17:24
chemmarios: by the way the all-in-one ugprade found a bug, so it definitively has value as a syntaxic validation17:24
honzabeagles: it shouldn't be too bad actually --- how can i run the test suite locally?  or shall i just debug in ci?  /me ducks17:27
*** itlinux is now known as itlinux-away17:27
*** dtrainor_ has joined #tripleo17:28
beagles:)17:28
beagleshonza running tests locally isn't too bad, but you probably want to do it in a VM to avoid "polluting" things17:29
*** itlinux-away is now known as itlinux17:29
beagleshonza: if you want you can "best effort it" and I can pull it down and run it in my puppetdev vm17:29
*** itlinux is now known as itlinux-away17:29
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Track ansible overcloud deployment with ARA  https://review.openstack.org/59722217:29
*** dtrainor has quit IRC17:30
*** itlinux-away is now known as itlinux17:32
*** itlinux is now known as itlinux-away17:32
*** dtrainor__ has joined #tripleo17:32
*** itlinux-away is now known as itlinux17:34
*** itlinux is now known as itlinux-away17:34
*** dtrainor_ has quit IRC17:35
*** itlinux-away is now known as itlinux17:38
*** itlinux is now known as itlinux-away17:38
*** zaneb has joined #tripleo17:40
*** itlinux-away is now known as itlinux17:41
openstackgerritHonza Pokorny proposed openstack/puppet-tripleo master: Add apaches expires directive for js and css files  https://review.openstack.org/58957217:45
*** bnemec has quit IRC17:45
honzabeagles: ^^^17:45
*** akrivoka has quit IRC17:47
marioschem: link? (do you mean the existing stand-alone job?)17:47
chemmarios: no link, run it on my own deployment, but I'll create a dummy jobs in 5 min17:48
marioschem: ack17:48
marioschem: but you mean there was/is some bug in upgrade_tasks for example? which you hit by running it?17:48
chemmarios: yeap see https://review.openstack.org/60239917:49
marioschem: nice very nice17:49
*** akhila has joined #tripleo17:49
chemmarios: indeed, that kinda prove the value of it17:50
*** assassin has joined #tripleo17:50
*** dtrainor_ has joined #tripleo17:58
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: break out release config by distro type  https://review.openstack.org/60238717:58
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt  https://review.openstack.org/59154017:58
*** rwsu has joined #tripleo18:00
*** dtrainor__ has quit IRC18:00
*** zul has quit IRC18:00
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071918:01
*** assassin has quit IRC18:01
*** assassin has joined #tripleo18:01
*** dtrainor__ has joined #tripleo18:01
*** boazel has quit IRC18:03
*** assassin has quit IRC18:04
*** assassin has joined #tripleo18:04
*** dtrainor_ has quit IRC18:05
*** zul has joined #tripleo18:09
*** boazel has joined #tripleo18:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676418:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229618:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237218:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)18:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)18:10
openstackgerritHonza Pokorny proposed openstack/puppet-tripleo master: Add apaches expires directive for js and css files  https://review.openstack.org/58957218:10
*** kopecmartin has quit IRC18:12
*** rdopiera has quit IRC18:12
*** panda|ptg has quit IRC18:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: WIP: test running upgrade in standalone run.  https://review.openstack.org/60241618:17
*** fultonj has quit IRC18:18
*** zul has quit IRC18:20
*** jtomasek has quit IRC18:21
*** jrist has quit IRC18:25
*** slaweq has quit IRC18:25
*** bfournie has quit IRC18:26
*** mcornea has quit IRC18:26
*** sshnaidm|ptg has quit IRC18:27
*** chem has quit IRC18:28
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Revert "Stop relying on old legacy sub_nodes_private"  https://review.openstack.org/60241718:28
*** gfidente has quit IRC18:28
*** mjturek has quit IRC18:29
*** yolanda has quit IRC18:30
*** hjensas has quit IRC18:30
*** zaneb has quit IRC18:32
*** tosky has quit IRC18:36
*** vinaykns has quit IRC18:41
weshaydnf repoquery  --repofrompath=reponame,https://trunk.rdoproject.org/fedora/stable-base/latest --repoid=reponame  -q -a | grep virtual18:41
weshaypython2-virtualenv-0:15.1.0-5.fc28.noarch18:42
weshaypython2-virtualenv-0:16.0.0-1.fc28.noarch18:42
weshaypython2-virtualenv-0:16.0.0-4.fc28.noarch18:42
weshaypython3-virtualenv-0:15.1.0-5.fc28.noarch18:42
weshaypython3-virtualenv-0:16.0.0-1.fc28.noarch18:42
weshaypython3-virtualenv-0:16.0.0-4.fc28.noarch18:42
weshaymwhahaha, ^18:42
*** radeks has quit IRC18:42
mwhahahaweshay: I'd used this role on fedora so must be a repo config problem18:43
openstackgerritMerged openstack/python-tripleoclient master: Introduce container_cli parameter for undercloud.conf  https://review.openstack.org/60049918:47
weshayhttp://logs.openstack.org/71/600871/2/check/tripleo-ci-fedora-latest-standalone/41e4ca0/logs/undercloud/etc/yum.repos.d/fedora-stable.repo.txt.gz18:47
*** vinaykns has joined #tripleo18:53
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add option to use /etc/nodepool files if subnodes is undefined  https://review.openstack.org/60242318:59
*** rcernin has joined #tripleo19:00
*** med_ has quit IRC19:00
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Disable manila tempest tests for ocata and pike currently in order to unblock promotion  https://review.openstack.org/60152219:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676419:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229619:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237219:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)19:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)19:10
openstackgerritRafael Folco proposed openstack/tripleo-quickstart master: WIP: Run scenario001 jobs for config/* changes  https://review.openstack.org/60242519:10
*** zul has joined #tripleo19:11
openstackgerritRafael Folco proposed openstack/tripleo-quickstart master: WIP: Run scenario001 jobs for config/* changes  https://review.openstack.org/60242519:13
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: f28 support for quickstart  https://review.openstack.org/59165219:14
*** Chaserjim has joined #tripleo19:16
*** Chaserjim has quit IRC19:16
*** zul has quit IRC19:17
*** radeks has joined #tripleo19:18
*** mjturek has joined #tripleo19:18
*** itlinux is now known as itlinux-away19:22
*** itlinux-away is now known as itlinux19:23
*** itlinux is now known as itlinux-away19:24
*** itlinux-away is now known as itlinux19:24
*** itlinux is now known as itlinux-away19:24
*** itlinux-away is now known as itlinux19:24
*** itlinux is now known as itlinux-away19:24
*** itlinux-away is now known as itlinux19:25
*** itlinux is now known as itlinux-away19:26
*** khyr0n has joined #tripleo19:27
*** bfournie has joined #tripleo19:28
*** slaweq has joined #tripleo19:28
*** itlinux-away is now known as itlinux19:33
*** itlinux is now known as itlinux-away19:33
*** tosky has joined #tripleo19:35
*** gbarros has quit IRC19:35
*** panda|ptg has joined #tripleo19:36
*** kopecmartin has joined #tripleo19:36
*** itlinux-away is now known as itlinux19:36
*** itlinux is now known as itlinux-away19:36
*** noslzzp has quit IRC19:37
khyr0nHello guys!19:38
khyr0ncan somebody help me with a problem integrating a Nuage platform... getting and error deploying compute nodes (no problems on controller nodes)19:40
khyr0nthis is the error -> Error: Could not find class ::nuage::vrs for qro-compute01.localdomain on node qro-compute01.localdomain19:40
*** zul has joined #tripleo19:40
*** vinaykns has quit IRC19:43
*** radeks has quit IRC19:46
*** vinaykns has joined #tripleo19:49
*** itlinux-away is now known as itlinux19:49
*** radeks has joined #tripleo19:49
*** itlinux is now known as itlinux-away19:50
*** itlinux-away is now known as itlinux19:50
*** jrist has joined #tripleo19:52
*** jrist has joined #tripleo19:52
*** zaneb has joined #tripleo19:53
jaosoriorkhyr0n: ssh to the compute node. Do you find the nuage puppet module in /etc/puppet/modules ?19:53
*** bfournie has quit IRC19:54
*** bnemec has joined #tripleo19:54
*** morazi has quit IRC19:58
*** akhila has quit IRC19:58
*** akhila has joined #tripleo19:59
*** bfournie has joined #tripleo20:00
*** waleedm has joined #tripleo20:00
*** ledo_ has joined #tripleo20:04
*** yolanda has joined #tripleo20:05
*** jtomasek has joined #tripleo20:05
*** hjensas has joined #tripleo20:05
*** slaweq has quit IRC20:07
*** ledo__ has joined #tripleo20:07
*** waleedm has quit IRC20:07
*** assassin has quit IRC20:07
*** zaneb has quit IRC20:08
*** gbarros has joined #tripleo20:08
*** zaneb has joined #tripleo20:08
*** slaweq has joined #tripleo20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676420:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229620:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237220:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)20:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)20:10
*** med_ has joined #tripleo20:11
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Revert "Stop relying on old legacy sub_nodes_private"  https://review.openstack.org/60241720:11
*** ledo_ has quit IRC20:11
*** akhila has quit IRC20:13
khyr0njaosorior: let me see20:14
*** akhila has joined #tripleo20:14
khyr0njaosorior: mmm no nuage modules on that dir20:16
khyr0nI'm seeing some files inside neutron dir20:17
*** jrist has quit IRC20:18
khyr0nI can only see a class named neutron:plugin:nuage20:19
*** kopecmartin has quit IRC20:21
*** rh-jelabarre has quit IRC20:24
*** sshnaidm|ptg has joined #tripleo20:25
jaosoriorkhyr0n: right, so... that package is missing20:26
*** saneax has quit IRC20:28
khyr0nok, I'll check on that :)20:30
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Remove roles blocking zuulv3 tranistion  https://review.openstack.org/60244520:30
khyr0nthanks!20:30
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Remove roles blocking zuulv3 transition  https://review.openstack.org/60244520:31
*** jrist has joined #tripleo20:31
*** jrist has joined #tripleo20:31
*** myoung has quit IRC20:31
*** itlinux is now known as itlinux-away20:33
beagleshonza: mind if I push a change to the test for https://review.openstack.org/#/c/589572/ ?20:35
honzabeagles: please do!20:35
beagleshonza: k20:35
honzai'm out of ideas20:35
openstackgerritBrent Eagles proposed openstack/puppet-tripleo master: Add apaches expires directive for js and css files  https://review.openstack.org/58957220:35
*** itlinux-away is now known as itlinux20:35
*** trown is now known as trown|outtypewww20:36
*** pcaruana has quit IRC20:38
*** abishop has joined #tripleo20:40
*** paramite has quit IRC20:48
*** stendulker has joined #tripleo20:48
*** hamzy has quit IRC20:48
*** rcernin has quit IRC20:51
*** ledo_ has joined #tripleo20:55
openstackgerritSai Ram Peesapati proposed openstack/tripleo-heat-templates stable/rocky: Make vlan_transparent in neutron.conf configurable from Undercloud  https://review.openstack.org/60245420:55
*** ansmith has quit IRC20:57
openstackgerritMerged openstack/ansible-role-tripleo-ui master: Add required role repo contents  https://review.openstack.org/58510520:57
*** pradk has quit IRC20:58
*** bfournie has quit IRC20:58
*** ledo__ has quit IRC20:59
*** itlinux has quit IRC20:59
openstackgerritMerged openstack/ansible-role-tripleo-zaqar master: Add required role repo contents  https://review.openstack.org/58510620:59
openstackgerritMerged openstack/ansible-role-tripleo-tacker master: Add required role repo contents  https://review.openstack.org/58510320:59
openstackgerritMerged openstack/ansible-role-tripleo-sahara master: Add required role repo contents  https://review.openstack.org/58510020:59
openstackgerritMerged openstack/ansible-role-tripleo-rabbitmq master: Add required role repo contents  https://review.openstack.org/58509820:59
openstackgerritMerged openstack/ansible-role-tripleo-tempest master: Add required role repo contents  https://review.openstack.org/58510420:59
openstackgerritMerged openstack/ansible-role-tripleo-swift master: Add required role repo contents  https://review.openstack.org/58510221:01
openstackgerritMerged openstack/ansible-role-tripleo-panko master: Add required role repo contents  https://review.openstack.org/58509621:01
openstackgerritMerged openstack/ansible-role-tripleo-opendaylight master: Add required role repo contents  https://review.openstack.org/58509421:01
openstackgerritMerged openstack/ansible-role-tripleo-neutron master: Add required role repo contents  https://review.openstack.org/58509121:01
openstackgerritMerged openstack/ansible-role-tripleo-memcached master: Add required role repo contents  https://review.openstack.org/58508921:01
openstackgerritMerged openstack/ansible-role-tripleo-ovn master: Add required role repo contents  https://review.openstack.org/58509521:01
openstackgerritMerged openstack/ansible-role-tripleo-octavia master: Add required role repo contents  https://review.openstack.org/58509321:01
*** gbarros has quit IRC21:02
openstackgerritMerged openstack/ansible-role-tripleo-ironic master: Add required role repo contents  https://review.openstack.org/58508621:02
openstackgerritMerged openstack/ansible-role-tripleo-gnocchi master: Add required role repo contents  https://review.openstack.org/58508221:02
openstackgerritMerged openstack/ansible-role-tripleo-heat master: Add required role repo contents  https://review.openstack.org/58508421:02
openstackgerritMerged openstack/ansible-role-tripleo-horizon master: Add required role repo contents  https://review.openstack.org/58508521:02
openstackgerritMerged openstack/ansible-role-tripleo-glance master: Add required role repo contents  https://review.openstack.org/58508121:02
openstackgerritMerged openstack/ansible-role-tripleo-sensu master: Add required role repo contents  https://review.openstack.org/58510121:04
openstackgerritMerged openstack/ansible-role-tripleo-nova master: Add required role repo contents  https://review.openstack.org/58509221:04
openstackgerritMerged openstack/ansible-role-tripleo-rsyslog-sidecar master: Add required role repo contents  https://review.openstack.org/58509921:04
*** abishop has quit IRC21:05
*** itlinux has joined #tripleo21:06
openstackgerritMerged openstack/ansible-role-tripleo-mistral master: Add required role repo contents  https://review.openstack.org/60048621:07
openstackgerritMerged openstack/ansible-role-tripleo-keepalived master: Add required role repo contents  https://review.openstack.org/58508721:07
openstackgerritMerged openstack/ansible-role-tripleo-cinder master: Add required role repo contents  https://review.openstack.org/59733721:07
openstackgerritMerged openstack/ansible-role-tripleo-manila master: Add required role repo contents  https://review.openstack.org/58508821:07
openstackgerritMerged openstack/ansible-role-tripleo-haproxy master: Add required role repo contents  https://review.openstack.org/58508321:07
openstackgerritMerged openstack/ansible-role-tripleo-designate master: Add required role repo contents  https://review.openstack.org/58508021:08
honzabeagles: +1 it works21:08
honzawell done21:08
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: build-test-packages: Add support for zuul inventory vars  https://review.openstack.org/60245621:09
*** bfournie has joined #tripleo21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676421:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229621:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237221:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)21:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)21:10
*** gbarros has joined #tripleo21:10
openstackgerritGabriele Cerami proposed openstack/tripleo-heat-templates master: [DNM] test package build in quickstart  https://review.openstack.org/60245721:13
*** itlinux has quit IRC21:15
*** itlinux has joined #tripleo21:16
sshnaidm|ptgbnemec, hi21:16
sshnaidm|ptgbnemec, which room are you? can you please step by tripleo room? we have a question that you might know to answer :)21:17
*** mjturek has quit IRC21:17
*** dhill_ has quit IRC21:17
*** stendulker has quit IRC21:21
bnemecsshnaidm|ptg: Okay, be right down.21:21
*** gfidente has joined #tripleo21:22
*** slaweq has quit IRC21:24
*** bfournie has quit IRC21:24
*** ledo_ has quit IRC21:25
*** rcernin has joined #tripleo21:29
*** bfournie has joined #tripleo21:29
*** mjturek has joined #tripleo21:31
*** slaweq has joined #tripleo21:32
*** zshi has quit IRC21:32
*** gbarros has quit IRC21:32
*** rlandy is now known as rlandy|brb21:34
*** itlinux has quit IRC21:36
*** itlinux has joined #tripleo21:37
*** yolanda has quit IRC21:38
*** yolanda has joined #tripleo21:39
openstackgerritJason E. Rist proposed openstack/tripleo-ui master: Downstream brand for Red Hat OpenStack Director 14  https://review.openstack.org/60246321:40
*** abishop has joined #tripleo21:40
*** med_ has quit IRC21:42
*** itlinux has quit IRC21:50
*** raildo has quit IRC21:58
*** itlinux has joined #tripleo22:01
*** itlinux has quit IRC22:02
*** jrist has quit IRC22:03
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676422:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229622:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237222:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)22:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)22:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)22:10
*** vinaykns has quit IRC22:10
*** rlandy|brb is now known as rlandy22:11
*** jtomasek has quit IRC22:12
*** dtrainor__ is now known as dtrainor22:13
*** dxiri has joined #tripleo22:16
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: build-test-packages: Add support for zuul inventory vars  https://review.openstack.org/60245622:17
*** jtomasek has joined #tripleo22:25
*** dxiri has quit IRC22:28
*** dxiri has joined #tripleo22:30
*** tosky has quit IRC22:31
openstackgerritEmilien Macchi proposed openstack/tripleo-specs master: Support for Podman in Stein  https://review.openstack.org/60248022:31
openstackgerritEmilien Macchi proposed openstack/tripleo-specs master: Support for Podman in Stein  https://review.openstack.org/60248022:33
*** hjensas has quit IRC22:34
*** rainleander has quit IRC22:34
*** boazel has quit IRC22:37
*** mjturek has quit IRC22:39
sshnaidm|ptgbnemec, shouldn't be "port_security_enabled: False" there? https://github.com/cybertron/openstack-virtual-baremetal/commit/9f93f422c31e62ecf0afd39e68343b3529ae749e22:43
*** jaosorior has quit IRC22:43
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: allow insecure curl downloads  https://review.openstack.org/60248522:44
*** zshi has joined #tripleo22:44
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Make ODL compatible with podman  https://review.openstack.org/60248822:49
*** zul has quit IRC22:50
*** holser|ptg has quit IRC22:50
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: enable fedora-28 for the reproducer  https://review.openstack.org/60249222:51
*** abishop has quit IRC22:52
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Make ODL deployment compatible with podman  https://review.openstack.org/60248822:52
*** chem has joined #tripleo22:56
bnemecsshnaidm|ptg: Yeah, I guess so. Apparently the floating ip template was just broken because removing the security group allows nothing.22:56
*** chem has quit IRC22:57
*** chem has joined #tripleo22:57
*** eggmaster has quit IRC22:57
*** pmannidi has joined #tripleo23:01
*** gfidente has quit IRC23:05
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart-extras master: build-test-packages: Add support for zuul inventory vars  https://review.openstack.org/60245623:05
bnemecsshnaidm|ptg: Try https://github.com/cybertron/openstack-virtual-baremetal/blob/master/templates/baremetal-ports-extra-node-port-security-all.yaml23:08
sshnaidm|ptgbnemec, ok, cool23:08
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178676423:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179229623:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/179237223:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1786764 in tripleo "Wrong versions of tripleo-common in container images updated in CI" [Critical,In progress] - Assigned to Steve Baker (steve-stevebaker)23:10
openstackLaunchpad bug 1792296 in tripleo "Overcloude deploy error:Timed out waiting for messages from Execution" [Critical,New] - Assigned to Quique Llorente (quiquell)23:10
openstackLaunchpad bug 1792372 in tripleo "Undercloud install fails at rocky with Duplicate declaration: Nova_config" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)23:10
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: test ovb extra node 1  https://review.openstack.org/60183923:10
*** sileht has quit IRC23:12
*** sileht has joined #tripleo23:13
*** panda|ptg has quit IRC23:13
mwhahahaweshay: i have no idea why it's not working, i stole the create repo script and ran it and it worked :(23:14
*** tosky has joined #tripleo23:14
*** akhila has quit IRC23:16
openstackgerritRonelle Landy proposed openstack/tripleo-heat-templates stable/ocata: DNM - test review  https://review.openstack.org/60249823:18
mwhahahaweshay: i'm also confused why python-tripleoclient is already installed before the dlrn build stuff23:20
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: break out release config by distro type  https://review.openstack.org/60238723:20
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt  https://review.openstack.org/59154023:20
weshayhrm..23:21
weshaymwhahaha, I'm trying to bring up f28 now23:21
*** noslzzp has joined #tripleo23:21
mwhahahaweshay: yea i tried but rdo cloud is full. so i spun up a regular image and ran the create_repo.sh script then the ansible snippet (it worked)23:22
openstackgerritRonelle Landy proposed openstack/tripleo-heat-templates stable/ocata: DNM - test review  https://review.openstack.org/60249823:22
*** tosky has quit IRC23:22
*** tosky_ has joined #tripleo23:22
mwhahahaweshay: http://logs.openstack.org/71/600871/2/check/tripleo-ci-fedora-latest-standalone/4c3a5a0/job-output.txt.gz#_2018-09-13_19_31_13_464933 shouldn't run prior to dlrn setup23:23
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: mysql: fix root password update for containerized mysql  https://review.openstack.org/60249923:23
*** slaweq has quit IRC23:24
openstackgerritRonelle Landy proposed openstack/tripleo-heat-templates stable/ocata: DNM - test review  https://review.openstack.org/60249823:25
weshaymwhahaha, you can run w/ libvirt.. give me a few.. if you want I can tmate you in23:27
*** chem has quit IRC23:27
*** sshnaidm|ptg has quit IRC23:28
*** tosky_ is now known as tosky23:29
*** dciabrin has quit IRC23:31
*** sshnaidm|ptg has joined #tripleo23:32
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Fix repo setup and undercloud setup order  https://review.openstack.org/60250223:34
mwhahahaweshay: -^ fyi i think this is needed for standalone23:34
*** sri_ has quit IRC23:39
weshayhrm23:39
*** sri_ has joined #tripleo23:39
mwhahahahrm maybe not23:47
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: build-test-packages: Add support for zuul inventory vars  https://review.openstack.org/60245623:49
sshnaidm|ptgmwhahaha, this is not set up for undercloud, just installing some stuff23:51
sshnaidm|ptgmwhahaha, hostname correction etc23:51
mwhahahasshnaidm|ptg: doesn't look like it's run when i was flipping through the logs, but that's fine. trying to track down why we installed python-tripleoclient before the dlrn stuff was properly setup23:52
mwhahahasee http://logs.openstack.org/71/600871/2/check/tripleo-ci-fedora-latest-standalone/4c3a5a0/logs/undercloud/home/zuul/23:52
*** jrist has joined #tripleo23:52
sshnaidm|ptgmwhahaha, after btp role builds changes there is install-built-package that install them in the same playbook, so it will be installed yet before undercloud install23:55
sshnaidm|ptgmwhahaha, and if we don't have changes, then we have a tripleoclient ready from master..23:55
mwhahahasshnaidm|ptg: why wouldn't we just wait to unstall until after we've setup dlrn?23:56
mwhahahathat makes no sense23:56
sshnaidm|ptgmwhahaha, https://github.com/openstack/tripleo-quickstart-extras/blob/b4e000cc6d7365e0f1ac844467886852fd7fc296/playbooks/multinode-standalone.yml#L2523:56
sshnaidm|ptgmwhahaha, not sure about that, don't remember exact reasons..23:57
mwhahahawe'll have to revisit that later23:57
sshnaidm|ptgmwhahaha, yeah, maybe there is a reason, need to look deeper23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!