Tuesday, 2017-02-21

openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027700:00
*** pmannidi has joined #tripleo00:04
*** jerrygb has joined #tripleo00:08
*** ooolpbot has joined #tripleo00:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607200:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]00:11
*** ooolpbot has quit IRC00:11
*** IRCFrEAK has joined #tripleo00:11
*** IRCFrEAK has left #tripleo00:11
*** dmacpher_ has quit IRC00:13
*** tobias__ has quit IRC00:24
*** rlandy has quit IRC00:29
*** rajinir_ has quit IRC00:40
*** limao has joined #tripleo00:41
*** leanderthal|afk has quit IRC00:47
openstackgerritMerged openstack/tripleo-heat-templates master: Adding upgrade_tasks to tacker  https://review.openstack.org/43241700:55
*** leanderthal has joined #tripleo01:01
*** pradk has quit IRC01:06
*** ooolpbot has joined #tripleo01:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607201:11
*** ooolpbot has quit IRC01:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]01:11
*** ansmith has quit IRC01:18
*** pradk has joined #tripleo01:27
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Adds service for OpenDaylight DPDK  https://review.openstack.org/41964801:40
*** alop_ has joined #tripleo01:45
*** alop has quit IRC01:46
*** alop_ is now known as alop01:46
*** alop has quit IRC01:49
*** yamahata has joined #tripleo01:51
*** alop has joined #tripleo01:53
*** fzdarsky has joined #tripleo01:59
*** limao has quit IRC02:00
*** limao has joined #tripleo02:01
*** ooolpbot has joined #tripleo02:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607202:11
*** ooolpbot has quit IRC02:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]02:11
*** flepied has joined #tripleo02:17
*** fzdarsky has quit IRC02:31
*** saneax is now known as saneax-_-|AFK02:43
*** alop has quit IRC02:55
*** jerrygb has quit IRC02:57
*** sudipto has joined #tripleo03:01
*** sudipto_ has joined #tripleo03:01
*** michapma_alt has joined #tripleo03:05
*** limao has quit IRC03:08
*** ooolpbot has joined #tripleo03:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607203:11
*** ooolpbot has quit IRC03:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]03:11
*** liverpooler has quit IRC03:13
*** jtomasek has quit IRC03:16
*** jtomasek_ has quit IRC03:17
*** ansmith has joined #tripleo03:19
*** fragatin_ has joined #tripleo03:21
*** dmacpher has joined #tripleo03:23
*** fragatin_ has quit IRC03:24
*** fragatina has quit IRC03:24
*** flepied has quit IRC03:26
*** yolanda has joined #tripleo03:31
*** fragatina has joined #tripleo03:45
*** fragatina has quit IRC03:50
*** fragatin_ has joined #tripleo03:56
*** ansmith has quit IRC03:57
*** chlong has joined #tripleo04:03
*** limao has joined #tripleo04:09
*** pmannidi_ has joined #tripleo04:09
*** ooolpbot has joined #tripleo04:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607204:11
*** ooolpbot has quit IRC04:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]04:11
*** pmannidi has quit IRC04:11
*** limao has quit IRC04:13
*** dmacpher has quit IRC04:28
*** dmacpher has joined #tripleo04:30
*** sudipto_ has quit IRC04:32
*** sudipto has quit IRC04:32
*** nmathew has joined #tripleo04:39
*** michapma_alt has quit IRC04:43
*** mdnadeem has joined #tripleo04:45
*** nyechiel has joined #tripleo04:45
*** gatuus has quit IRC05:01
*** limao has joined #tripleo05:06
*** yamahata has quit IRC05:11
*** ooolpbot has joined #tripleo05:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607205:11
*** ooolpbot has quit IRC05:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]05:11
*** sudipto has joined #tripleo05:20
*** sudipto_ has joined #tripleo05:20
*** bvandenh has quit IRC05:31
*** gbarros has joined #tripleo05:44
*** twi99y_ has joined #tripleo05:50
*** sdake has joined #tripleo05:52
*** twi99y has quit IRC05:53
*** twi99y has joined #tripleo05:54
*** twi99y_ has quit IRC05:56
*** ooolpbot has joined #tripleo06:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607206:11
*** ooolpbot has quit IRC06:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]06:11
*** agurenko has joined #tripleo06:13
*** jprovazn has joined #tripleo06:21
*** sdake_ has joined #tripleo06:22
*** sdake has quit IRC06:25
*** jaganathan has joined #tripleo06:28
*** bvandenh has joined #tripleo06:36
*** bvandenh has quit IRC06:41
*** gbarros has quit IRC06:42
*** saneax-_-|AFK is now known as saneax06:59
*** ooolpbot has joined #tripleo07:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607207:11
*** ooolpbot has quit IRC07:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]07:11
*** jaosorior has joined #tripleo07:11
*** yprokule has joined #tripleo07:13
jaosoriorsshnaidm: hey dude, any news on the bug from yesterday?07:14
*** iranzo has joined #tripleo07:14
*** iranzo has joined #tripleo07:14
sshnaidmjaosorior, redis package will be replaced with new one, that should be ok07:15
sshnaidmjaosorior, but not sure if it's the root cause, continue to look at it..07:16
jaosoriorsshnaidm: yeah, I'm not sure either to be honest07:17
*** ealcaniz has joined #tripleo07:18
jaosoriorsshnaidm: but it would be worth a try to update the images with the new redis package, do another overcloud deploy, and see if we still get that error with serverlimit and maxclients set to 3207:18
sshnaidmjaosorior, yeah, will try07:18
jaosoriorsshnaidm: anything I can do to help out?07:18
sshnaidmjaosorior, no, it's ok, thanks07:19
*** fragatin_ has quit IRC07:19
*** tremble has joined #tripleo07:20
*** tremble has joined #tripleo07:20
jaosoriorsshnaidm, adarazs: if you guys have time, can you check this out https://review.openstack.org/#/c/422310/ ?07:24
*** tesseract has joined #tripleo07:25
sshnaidmjaosorior, reviewed07:30
*** openstackgerrit has quit IRC07:32
jaosoriorsshnaidm: commented. Mind if I uncomment that in a subsequent commit? pretty hard to get reviews for that one.07:33
sshnaidmjaosorior, I don't understand why this whole block needed07:36
sshnaidmjaosorior, enable_novajoin is equal to enable_tls_everywhere, right?07:36
*** pcaruana has joined #tripleo07:37
jaosoriorsshnaidm: yeah07:37
jaosoriornovajoin isn't used for the undercloud outside of the tls everywhere context07:37
sshnaidmjaosorior, then why do we need additional variable?07:37
jaosoriorsshnaidm: which additional variable?07:38
*** saibarspeis has joined #tripleo07:38
sshnaidmjaosorior, enable_novajoin07:38
*** dsariel has joined #tripleo07:39
jaosoriorsshnaidm: that's not a variable, that's the configuration option in undercloud.conf.j207:39
sshnaidmjaosorior, oh, sorry, I didn't notice that07:39
sshnaidmok, I'm fine then07:40
jaosoriorsshnaidm: so, should I get rid of that commented bit?07:41
*** openstackgerrit has joined #tripleo07:41
openstackgerritMerged openstack/tripleo-quickstart-extras master: Enable novajoin/TLS-everywhere deployment  https://review.openstack.org/42231007:41
sshnaidmjaosorior, no, it's ok in undercloud.conf07:41
jaosoriorsshnaidm: alright, thanks dude07:44
sshnaidmjaosorior, np07:44
*** dmacpher has quit IRC07:52
*** anshul has quit IRC07:57
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027708:00
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test redis  https://review.openstack.org/43634508:00
*** dsariel has quit IRC08:00
*** dsariel has joined #tripleo08:01
*** rasca has joined #tripleo08:02
*** ooolpbot has joined #tripleo08:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607208:11
*** ooolpbot has quit IRC08:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]08:11
*** aufi has joined #tripleo08:15
*** ccamacho has joined #tripleo08:15
ccamachomorning guys!ç08:19
*** abregman has joined #tripleo08:22
*** agurenko has quit IRC08:24
*** amoralej|off is now known as amoralej08:27
*** mcornea has joined #tripleo08:28
*** jpena|away is now known as jpena08:29
*** agurenko has joined #tripleo08:30
jaosoriorccamacho: sup dude08:32
ccamachohey hou! are you again in EU?08:32
*** b00tcat has joined #tripleo08:33
*** b00tcat has joined #tripleo08:33
ccamachojaosorior :)08:33
jaosoriorccamacho: yeah dude, back in Finland.08:33
jaosoriorccamacho: did you go to Atlanta?08:35
ccamachojaosorior awesome man :) let me know if needed to check some submissions, naa Im in home :)08:36
ccamachojaosorior hey I checked this a few weeks ago and it remind me to you08:36
ccamachohttp://www.dailymail.co.uk/news/article-4117128/Would-want-board-flight-666-HEL-Friday-13th-Finnish-jet-flies-Helsinki-today-s-13-year-old-plane.html08:36
ccamachoxD08:36
ccamachojaosorior flying back to hel dude08:37
jaosoriorhahaha fcuk yeah08:37
jaosoriorI would definitely take it08:37
ccamachoajajaja08:37
*** cylopez has joined #tripleo08:39
*** dsariel has quit IRC08:39
*** jpena is now known as jpena|away08:42
*** gbarros has joined #tripleo08:44
*** zoli|gone is now known as zoli08:47
*** zoli is now known as zoliXXL08:49
*** jpena|away is now known as jpena08:50
*** karthiks has joined #tripleo08:52
*** dsariel has joined #tripleo08:52
*** karimb has joined #tripleo08:52
*** tosky has joined #tripleo08:53
*** zzzeek has quit IRC09:00
*** zzzeek has joined #tripleo09:01
remix_tjdhill_: may i ask you if you're still hitting the bug https://bugs.launchpad.net/tripleo/+bug/1620696 ?09:03
openstackLaunchpad bug 1620696 in tripleo "M/N upgrades UPDATE_FAILED .enabled_services.list_join: Incorrect arguments to "list_join" should be: "list_join" : [ " ", [ "str1", "str2"]]" [High,Confirmed] - Assigned to mathieu bultel (mat-bultel)09:03
remix_tjdhill_: i need some confirmations about my findings, in particular the output of openstack stack template show overcloud | grep heat_template_version09:04
*** pmannidi_ has quit IRC09:06
*** ooolpbot has joined #tripleo09:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607209:11
*** ooolpbot has quit IRC09:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]09:11
*** paramite has joined #tripleo09:12
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: Fix container gate  https://review.openstack.org/43621209:14
*** karimb has quit IRC09:14
*** bogdando has joined #tripleo09:15
*** b00tcat_ has joined #tripleo09:21
*** b00tcat has quit IRC09:21
*** b00tcat_ has quit IRC09:21
*** b00tcat_ has joined #tripleo09:22
*** b00tcat_ is now known as b00tcat09:22
*** b00tcat has quit IRC09:22
*** b00tcat has joined #tripleo09:22
*** b00tcat has quit IRC09:22
*** b00tcat has joined #tripleo09:22
*** b00tcat has quit IRC09:25
*** b00tcat has joined #tripleo09:25
*** b00tcat has quit IRC09:27
*** b00tcat has joined #tripleo09:28
*** yprokule has quit IRC09:29
jaosoriorEmilienM: This sets the tls everywhere job as periodic (and non-voting), can you check it out when you get some time https://review.openstack.org/#/c/436381/ ?09:30
*** karimb has joined #tripleo09:39
*** salmankhan has joined #tripleo09:42
*** karimb has quit IRC09:43
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test tempest skip file  https://review.openstack.org/43638709:45
sshnaidmarxcruz, ^^ this will check it upstream09:45
*** karimb has joined #tripleo09:47
*** gbarros has quit IRC09:50
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Force MySQL users to use SSL if internal TLS is enabled  https://review.openstack.org/42627409:50
*** b00tcat has quit IRC09:53
*** b00tcat has joined #tripleo09:53
*** bogdando has quit IRC09:54
sshnaidmfyi https://bugs.launchpad.net/tripleo/+bug/166645909:56
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,Triaged]09:56
sshnaidmjistr, mandre|away could you please take a look? ^^09:56
tobias-fiberdata'openstack overcloud node delete', how come this command doesnt take --environment-directory?09:59
*** ckyriakidou has joined #tripleo10:00
jistrsshnaidm: hmm i'm looking but can't find any more logs than what you already posted into the bug... there's nothing in the journal besides the service getting stopped, and there doesn't seem to be any other log file for docker-distribution service specifically10:03
jistrwe may need to recreate the problem somehow to be able to debug it closer10:04
sshnaidmjistr, I have an env :)10:04
*** dciabrin has quit IRC10:04
*** numans has quit IRC10:04
*** numans has joined #tripleo10:05
jistrsshnaidm: cool, can you please send me login info?10:05
*** nijaba has quit IRC10:05
*** numans has quit IRC10:05
sshnaidmjistr, ssh -ttt centos@8.43.87.251 -A "ssh -ttt jenkins@192.168.100.171 'cd /opt/stack/new/tripleo-ci; bash'"10:06
*** akrivoka has joined #tripleo10:07
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Only add the bind-address entry in nodes where mysql is running  https://review.openstack.org/43639510:07
*** numans has joined #tripleo10:07
*** jaosorior is now known as jaosorior_lunch10:08
jistrtobias-fiberdata: i'm no subject matter expert, but many folks are at PTG in the US east coast timezone, so i'll attempt to answer anyway :) it looks like all the template/environment args for that command are deprecated, probably the deployment plan which is already stored in swift gets used instead. https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_node.py#L45-L6210:09
*** salmankhan has quit IRC10:10
*** gbarros has joined #tripleo10:11
*** ooolpbot has joined #tripleo10:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607210:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166645910:11
*** ooolpbot has quit IRC10:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]10:11
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,Triaged]10:11
*** akrivoka_ has joined #tripleo10:11
*** nijaba has joined #tripleo10:12
*** nijaba has quit IRC10:12
*** nijaba has joined #tripleo10:12
*** akrivoka has quit IRC10:12
jistrsshnaidm: it's not letting me in, can you add my key please? https://github.com/jistr.keys10:12
*** tobias-fiberdata has quit IRC10:14
*** dciabrin has joined #tripleo10:14
sshnaidmjistr, try now10:15
jistrsshnaidm: working, thx10:15
*** sudipto has quit IRC10:17
*** sudipto_ has quit IRC10:17
jistrsshnaidm: phew, the docker-distribution service package got uninstalled somehow... funky :)10:19
*** salmankhan has joined #tripleo10:19
sshnaidmjistr, was it installed ever?10:19
jistryea it was running before that, there are journal entries from it10:20
*** tobias_fiberdata has joined #tripleo10:23
*** flepied has joined #tripleo10:23
*** yprokule has joined #tripleo10:25
*** karimb has quit IRC10:36
*** jbadiapa has quit IRC10:38
*** zoliXXL is now known as zoli|lunch10:54
* jistr lunch bbl10:54
tobias_fiberdatajistr, ah, we are using RHOSP9 so that might be the case yes :)11:06
tobias_fiberdatajistr, we have opened a case on it.11:07
*** nmathew has quit IRC11:08
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: Disable Manila CephFS snapshots by default  https://review.openstack.org/43641111:08
*** ooolpbot has joined #tripleo11:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607211:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166645911:11
*** ooolpbot has quit IRC11:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]11:11
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,Triaged]11:11
*** gbarros_ has joined #tripleo11:15
*** b00tcat is now known as b00tcat|away11:17
*** karimb has joined #tripleo11:17
*** gbarros has quit IRC11:18
*** b00tcat|away is now known as b00tcat11:20
* social looks around for shardy11:20
*** jbadiapa has joined #tripleo11:29
*** rhallisey has joined #tripleo11:32
*** jaganathan has quit IRC11:33
mcorneamarios: hey, we're missing the preupgrade validation for the heat services: e.g https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/heat-api-cfn.yaml#L8911:33
*** karimb has quit IRC11:34
mariosmcornea: ack will have a look in a bit, still having issues with the haproxy check (it isn't the cluster start but actually https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/pacemaker.yaml#L146 the service check (haproxy only, rabbit is ok)11:36
mariosmcornea: i think we may just have to increase the timeout (haproxy does start a few seconds later and is running fine on all nodes)11:36
mcorneamarios: hm, this is odd. I haven't seen it on my system11:38
*** bvandenh has joined #tripleo11:38
*** katkapilatova has joined #tripleo11:40
mariosmcornea: yeah and i wasn't seeing it all of last week either so not sure why it happens now (as i said, it seems at this point just the timeout (haproxy is started everywhere )11:40
*** gbarros_ has quit IRC11:42
*** adarazs is now known as adarazs_lunch11:44
*** karimb has joined #tripleo11:45
*** pkovar has joined #tripleo11:57
*** jerrygb has joined #tripleo11:59
*** jaosorior_lunch is now known as jaosorior12:02
*** jerrygb has quit IRC12:03
*** zoli|lunch is now known as zoli12:04
*** ealcaniz has quit IRC12:06
*** jaganathan has joined #tripleo12:08
*** bvandenh has quit IRC12:09
* marios biab12:09
*** ooolpbot has joined #tripleo12:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607212:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166645912:11
*** ooolpbot has quit IRC12:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]12:11
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,Triaged]12:11
*** jaganathan has quit IRC12:13
*** b00tcat is now known as b00tcat|away12:13
*** ccamacho is now known as ccamacho|lunch12:19
*** panda|bbl is now known as panda|ko12:19
jistrsshnaidm: hmm so far i don't know how it's even possible that the docker-distribution package disappeared in yum.log there's an entry that it's been installed, but there's no mention of it being removed12:20
sshnaidmjistr, yeah, I don't find either in yum history12:21
sshnaidmjistr, seems like it's removed without yum12:21
jistrsshnaidm: are we sure the issue is reproducible? could there be some external involvement causing the issue?12:21
jistryea i was thinking something had to call `rpm -e` on it12:21
jistrbut i grepped OOOQ a bit and didn't find anything suspicious12:21
sshnaidmjistr, it happened both in my env and in periodic jobs, so yes12:21
sshnaidmjistr, it's not in oooq12:22
sshnaidmjistr, this job doesn't use oooq at all12:22
sshnaidmjistr, old school tripleo-ci code12:22
jistrahh12:23
slagleshould we revert https://review.openstack.org/#/c/417437/12:23
jistri didn't gre pthat12:23
slagleseems like the mostly likely cause12:23
jistrhmm i thought it ran fine on 1st run though, and then just the 2nd "idempotency check run" went wrong12:24
* jistr checks12:24
jistrassuming the job runs the same code in both cases...12:25
*** yamahata has joined #tripleo12:25
sshnaidmslagle, seems related.. will test it12:26
*** jaganathan has joined #tripleo12:26
slaglethe other thing is that it looks like all the docker packages got a serious refactoring sometimes in the last few days12:27
*** sdake_ has quit IRC12:27
slaglefrom an underclodu i installed last week:12:27
slagle[centos@user ~]$ rpm -qf /lib/systemd/system/docker.service12:27
slagledocker-1.12.5-14.el7.centos.x86_6412:27
slagleand i dont even have docker-distribution installed12:27
openstackgerritSagi Shnaidman proposed openstack/instack-undercloud master: Revert "Move Docker registry setup into its own profile"  https://review.openstack.org/43643412:28
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test periodic undercloud idempotent  https://review.openstack.org/43643512:32
slaglewell i can't even upgrade my undercloud from last week b/c of this openstack-heat-agents packaging change12:33
openstackgerritArx Cruz proposed openstack/tripleo-specs master: Tool to send tempest report by mail  https://review.openstack.org/42087812:35
EmilienM'hello12:35
*** fzdarsky has joined #tripleo12:36
EmilienMslagle: maybe should we switch enable_docker_registry to false by default12:36
*** ansmith has joined #tripleo12:36
EmilienMI don't know why it's enabled by default ...12:36
openstackgerritMerged openstack/tripleo-heat-templates master: Stop nova-api before upgrading package  https://review.openstack.org/43615012:37
jistrsshnaidm: can i perform write ops on your system?12:37
slagleEmilienM: it's been that way since https://review.openstack.org/#/c/238238/ afaict12:38
sshnaidmjistr, write ops?12:38
EmilienMslagle: let's disable it.12:38
sshnaidmjistr, yeah, it's dev env, do whatever there12:38
EmilienMsshnaidm: where are we with promotion?12:38
jistrsshnaidm: i mean operations that actually modify the state of the system. I want to try installing the docker-distribution again, to see what might be un-installing it.12:39
sshnaidmEmilienM, already two bugs12:39
jistrsshnaidm: ok thanks12:39
EmilienMslagle: http://logs.openstack.org/87/436387/1/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/09a5061/logs/var/log/undercloud_upgrade.txt.gz#_2017-02-21_10_23_18_00012:39
EmilienMamoralej, jpena ^ fyi heat agents upgrade failure ...12:39
* amoralej checking12:40
EmilienMslagle, jistr: have you already filed a bug for docker thing?12:41
jistrEmilienM: sshnaidm did12:41
*** jaganathan has quit IRC12:41
EmilienMjistr: https://bugs.launchpad.net/tripleo/+bug/1666459 ?12:41
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,Triaged]12:41
jistryea12:41
EmilienMit sounds like another thing12:41
EmilienMok12:42
EmilienMmy bad, so we don't have a bug for the undercloud upgrade12:42
EmilienMI'll create it12:42
amoralejEEmilienM, it should be fixed in newer hashes12:42
amoralejEmilienM ^12:42
EmilienMamoralej: ok12:42
amoralejis that latest current-tripleo?12:42
EmilienMsshnaidm, amoralej: do we still have the 504 issue?12:43
amoraleji'm hitting it in RDO-CI with last consistent, but i'm not sure in tripleo-ci12:43
EmilienMamoralej: we haven't had promotion in the last 3 days12:43
amoraleji didn't see it in status-tripleoci12:43
amoralejbut i'd say we are hitting another one before about idempotincy12:44
amoralejso, we don't know12:44
amoralejbut what i see in master job in rdo-ci is not very good12:44
jistrslagle, sshnaidm: i think i see the cause of the docker-distribution issue. This matches docker-distribution too, because it does --whatprovides check, and docker-distribution "provides" docker-registry. I'll have a fix in a minute, should be a oneliner.12:44
sshnaidmEmilienM, yes, redis didn't help there12:44
jistrhttps://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/docker_registry.pp#L40-L4212:44
EmilienMsshnaidm: :(12:44
*** mdnadeem has quit IRC12:44
EmilienMjistr: could we disable enable_docker_registry by default?12:45
EmilienMI don't understand why we're enabling it12:45
EmilienMsince default deployments don't need docker at all12:45
jistrEmilienM: we are enabling it by default12:45
jistrit just gets uninstalled because of the bug :)12:46
EmilienMyeah but my question is why do we enable it by default12:46
EmilienMit doesn't sound correct12:46
jistrah right. Well that's an orthogonal issue with (potentially) a different fix. I'm not sure why we have it on by default. But since we're moving towards containerized overcloud for Pike, i think we'll need it?12:47
*** morazi has joined #tripleo12:48
*** skramaja has joined #tripleo12:48
jistrnot sure if the overcloud does fetch from dockerhub or from underloud by default12:48
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Set enable_docker_registry to false by default  https://review.openstack.org/43644112:48
EmilienMlet's see how CI works on this one12:48
EmilienMjistr: though I agree we need to fix the idempotency issue12:49
jistryea i'm on it, ETA minutes :)12:49
EmilienMjistr: cool. Though even with a fix, I don't think we need to enable the docker registry by default12:49
EmilienMit sounds useless if you don't have docker in your environment, correct?12:50
slaglefwiw, this also completely broke undercloud updates/upgrades: https://review.rdoproject.org/r/#/c/5429/12:50
EmilienMamoralej: ^ I think we need to revert that again, we're very close to the release, and the last thing we want is to break upgrades12:51
EmilienMamoralej: we can do it again in Pike.12:51
amoralejEmilienM, the upgrade issue is because we have a old current-tripleo12:51
amoralejcould we test upgrades to a newer hash?12:52
*** karimb has quit IRC12:52
EmilienMamoralej: because we didn't have a promotion over the last 3 days you mean?12:52
amoralejyes12:52
amoralejEmilienM, or even better, could we test upgrade to https://trunk.rdoproject.org/centos7-ocata/current-tripleo/12:54
amoralejrepo from stable/ocata instead of master12:54
amoralejthat should be good12:54
EmilienMslagle, jistr: even if we fix the idempotency thing with docker registry, I would like a review on https://review.openstack.org/#/c/436441/ because I don't think we need docker registry by default12:54
openstackgerritJiri Stransky proposed openstack/puppet-tripleo master: Stop accidentally removing docker-distribution  https://review.openstack.org/43644212:57
*** limao has quit IRC12:59
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test periodic undercloud idempotent  https://review.openstack.org/43643513:00
*** ansmith has quit IRC13:01
* EmilienM off to the ptg13:01
openstackgerritJiri Stransky proposed openstack/puppet-tripleo master: Stop accidentally removing docker-distribution  https://review.openstack.org/43644213:02
*** jtomasek has joined #tripleo13:02
*** jtomasek_ has joined #tripleo13:02
jistrsshnaidm: i'll wait to see if specs pass locally, and then i'll comment recheck the test patch you submitted13:03
*** gbarros has joined #tripleo13:05
sshnaidmjistr, ok, though I think it'll be ok13:05
openstackgerritMerged openstack-infra/tripleo-ci master: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746813:06
jistrsshnaidm: yea hopefully, just jenkins gave it -1 because i sent a new patch :)13:06
*** liverpooler has joined #tripleo13:06
*** flepied has quit IRC13:07
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix ansible-lint.sh script for roles.  https://review.openstack.org/42178813:07
*** ooolpbot has joined #tripleo13:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607213:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged]13:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166645913:11
*** ooolpbot has quit IRC13:11
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,In progress] - Assigned to Jiří Stránský (jistr)13:11
*** flepied has joined #tripleo13:12
*** Goneri has joined #tripleo13:13
openstackgerritMerged openstack-infra/tripleo-ci master: Revert "Temporarily disable ceph in the updates job"  https://review.openstack.org/40621013:16
*** jkilpatr has joined #tripleo13:16
*** zoli is now known as zoli|FBCI13:16
*** jtomasek_ has quit IRC13:18
*** jtomasek has quit IRC13:19
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test tempest skip file  https://review.openstack.org/43638713:20
*** afazekas is now known as afazekas|broken_13:20
*** jerrygb_ has joined #tripleo13:21
*** colonwq has quit IRC13:21
*** dsariel has quit IRC13:22
*** trown|outtypewww is now known as trown13:22
*** adarazs_lunch is now known as adarazs13:25
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add missing i18n strings to the DataTable component  https://review.openstack.org/43556513:25
*** jayg|g0n3 is now known as jayg13:27
*** jerrygb_ has quit IRC13:30
*** morazi has quit IRC13:33
*** ccamacho|lunch is now known as ccamacho13:37
*** amoralej is now known as amoralej|lunch13:39
*** rlandy has joined #tripleo13:40
*** yamahata has quit IRC13:42
*** jpena is now known as jpena|lunch13:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Enable TLS in the internal network for RabbitMQ  https://review.openstack.org/32748213:43
*** skramaja has quit IRC13:43
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Pass hieradata for internal TLS for RabbitMQ  https://review.openstack.org/40914313:45
*** jayg is now known as jayg|g0n313:46
*** b00tcat|away is now known as b00tcat13:49
*** karimb has joined #tripleo13:50
trownI would assume there is no IRC meeting this week?13:54
*** jmelvin has joined #tripleo13:57
*** amoralej|lunch is now known as amoralej13:57
*** jerrygb has joined #tripleo13:57
sshnaidmtrown, seems like no..13:59
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Remove the string cast for using transport_url  https://review.openstack.org/43646614:00
*** zaneb has joined #tripleo14:01
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Fix fact containing tls-everywhere environments  https://review.openstack.org/43646714:01
*** jayg|g0n3 is now known as jayg14:01
*** mandre|away is now known as mandre14:01
openstackgerritCarlos Camacho proposed openstack/puppet-tripleo master: Remove the string cast for using transport_url  https://review.openstack.org/43646614:01
*** colonwq has joined #tripleo14:02
*** dsneddon has joined #tripleo14:04
*** jpich has joined #tripleo14:05
*** sdake has joined #tripleo14:05
*** yolanda has quit IRC14:05
*** karimb has quit IRC14:06
openstackgerritMerged openstack/tripleo-docs master: Add docs for composable services/roles  https://review.openstack.org/41302514:09
*** ooolpbot has joined #tripleo14:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607214:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166645914:11
*** ooolpbot has quit IRC14:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)14:11
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,In progress] - Assigned to Jiří Stránský (jistr)14:11
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Add step0,validation checks for heat services  https://review.openstack.org/43647214:11
mariosmcornea: ^^ thanks14:12
*** david-lyle has joined #tripleo14:12
*** bvandenh has joined #tripleo14:14
mcorneamarios:cool, I'll check it out14:14
*** lblanchard has joined #tripleo14:14
mariosmcornea: np just as you pointed it out earlier (I'm the one that added the echo o/ there :D we just forgot them)14:15
mariosmcornea: is a simple one14:15
*** ansmith has joined #tripleo14:15
*** tzumainn has joined #tripleo14:17
*** skramaja has joined #tripleo14:18
*** fzdarsky has quit IRC14:18
*** yamahata has joined #tripleo14:19
*** b00tcat is now known as b00tcat|away14:20
*** katkapilatova has left #tripleo14:20
*** zoli|FBCI is now known as zoli14:20
EmilienMslagle: hey, I saw your comment on https://review.openstack.org/#/c/436441/ and it makes sense, I didn't realize there wasn't a parameter in undercloud.conf. Do you suggest to abandon this patch or to send a new patchset that allows users to configure it in undercloud.conf?14:21
*** fzdarsky has joined #tripleo14:21
*** bvandenh has quit IRC14:22
EmilienMtrown: no meeting this week, I thought we mentionned it last week14:22
trownEmilienM: I am sure we did :P14:22
EmilienMjistr: when https://review.openstack.org/#/c/436442/2 merges, please make sure to backport it into stable/ocata14:23
*** yolanda has joined #tripleo14:24
*** b00tcat|away is now known as b00tcat14:25
jistrEmilienM: ack, thanks for the reminder14:27
*** karimb has joined #tripleo14:28
slagleEmilienM: i suggest adding it in undercloud.conf, *if* there is agreement to go ahead and disable by default14:30
slagleEmilienM: and i'm not sure there really is yet14:30
akrivoka_EmilienM: is pike open for new features yet?14:31
*** yolanda has quit IRC14:31
*** pblaho has quit IRC14:34
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/ocata: Add step0,validation checks for heat services  https://review.openstack.org/43648114:34
radezEmilienM: since tacker and congress were FFEs, do I need to intiate a cherry-pick to get them into stable/ocata?14:35
EmilienMslagle: ok, I'll wait a bit and talk with folks. Thanks!14:36
EmilienMradez: when did it merge?14:36
EmilienMradez: after or before the branching?14:36
radezEmilienM: I'm pretty sure after the branching14:37
radezI'm looking at the history now and I don't see the patches14:37
radezin stable/ocata that is14:37
EmilienMso yeah, backport it ASAP14:37
radezack, thx14:37
*** limao has joined #tripleo14:38
*** abregman is now known as abregman|mtg14:40
*** yolanda has joined #tripleo14:41
*** gfidente has joined #tripleo14:41
*** gfidente has quit IRC14:41
*** gfidente has joined #tripleo14:41
EmilienMradez: which patches?14:41
radezEmilienM: nm, looks like I was wrong, I see them both in the octa branch, sry for false alrm14:41
*** noslzzp has quit IRC14:41
EmilienMradez: no worries!14:42
EmilienMradez: and thanks for checking14:42
*** stream10 has joined #tripleo14:43
*** noslzzp has joined #tripleo14:43
*** limao has quit IRC14:43
sshnaidmEmilienM, where is better to disable horizon for job?14:44
*** stream10 has quit IRC14:44
EmilienMsshnaidm: where & why?14:44
sshnaidmEmilienM, puppet-tripleo..?14:44
jaosoriorgfidente: are you around?14:45
sshnaidmEmilienM, I'd like to run job with horizon disabled as amoralej suggests, to test14:45
gfidentejaosorior, hey yes14:45
*** stream10 has joined #tripleo14:45
*** david-lyle has quit IRC14:45
jaosoriorgfidente: hey dude, do you remember what IP did the {get_param: [ServiceNetMap, SomeServiceNetwork]} give? was it the VIP or the node's IP for that network?14:46
*** david-lyle has joined #tripleo14:46
*** david-lyle has quit IRC14:46
EmilienMsshnaidm: you can submit a patch in THT with overriding the resource to OS::Heat::None14:46
EmilienMsshnaidm: into overcloud-resource-registry-puppet.j2.yaml14:46
*** jpena|lunch is now known as jpena14:47
*** limao has joined #tripleo14:47
gfidentejaosorior, it's the node's ip14:47
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool  https://review.openstack.org/42334014:47
gfidenteI think we use it mostly to set the binding address14:47
*** dmacpher has joined #tripleo14:47
jpichakrivoka_: stable/ocata branches have been created so, I think yes, master is now Pike :) If you have -2 remaining on patches they can be removed14:47
jaosoriorgfidente: thanks man14:47
akrivoka_jpich: you read my mind, thanks :)14:48
akrivoka_https://review.openstack.org/#/c/422789/ and https://review.openstack.org/#/c/414169/14:48
*** akrivoka_ is now known as akrivoka14:48
akrivokaEmilienM: could you remove -2 on those? ^14:48
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT MERGE: test 504error without horizon  https://review.openstack.org/43649114:49
*** zaneb has quit IRC14:49
EmilienMakrivoka: sure thing14:50
akrivokaEmilienM: thanks!14:51
EmilienMnp14:51
*** cwolferh has quit IRC14:52
openstackgerritMerged openstack/tripleo-quickstart master: Add config file for cloudsig testing repo  https://review.openstack.org/43609114:53
openstackgerritAna Krivokapic proposed openstack/tripleo-heat-templates master: Add plan-environment.yaml  https://review.openstack.org/41738514:53
*** david-lyle has joined #tripleo14:53
pradkcan i get some reviews onhttps://review.openstack.org/#/c/435979/14:54
*** david-lyle has quit IRC14:57
*** shardy has joined #tripleo14:58
shardyHey all, I just noticed the upgrades CI job is broken14:59
*** abregman|mtg is now known as abregman14:59
shardyhttps://bugs.launchpad.net/tripleo/+bug/166654414:59
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]14:59
shardyappears to be a packaging issue but I probably can't look into it until later today14:59
shardyif anyone has cycles to take it then please do :)14:59
amoralejsshnaidm, about https://review.openstack.org/#/c/436491/, what repos will use those jobs?14:59
sshnaidmamoralej, consistent, as in periodiv15:00
amoralejif they use current-tripleo it will not help15:00
amoralejah, ok15:00
sshnaidmamoralej, I do a patch that will be rebased on this..15:00
amoralejah, ok15:00
*** jtomasek has joined #tripleo15:01
*** jtomasek_ has joined #tripleo15:01
*** noslzzp has quit IRC15:01
*** noslzzp has joined #tripleo15:02
EmilienMshardy: yes, it sounds related to what we talked this morning here, amoralej said we need a promotion15:03
mariosshardy: o/ sure will have a look through the logs (i am having issues with puppet modules still [d/stream] current run ongoing15:03
shardyEmilienM: ah, thanks, I'll check the logs15:04
mariosshardy: (but i didn't hit that obviously as it is different repos)15:04
*** stream10 has quit IRC15:04
*** athomas has joined #tripleo15:04
shardyif it's understood I'll remove the alert from the bug tags15:04
*** bvandenh has joined #tripleo15:04
EmilienMshardy: keep it please15:04
*** skramaja has quit IRC15:05
EmilienMshardy: so we can keep visibility on the 3 blockers we currently have15:05
shardyEmilienM: Ok, re-added to https://bugs.launchpad.net/tripleo/+bug/166654415:05
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]15:05
shardyperhaps someone can comment with some details there15:05
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add checks in ansible upgrade tasks for CephMon and CephOSD  https://review.openstack.org/43550215:07
*** skramaja has joined #tripleo15:08
EmilienMamoralej: ^15:09
amoralejEmilienM, i'm adding some info in the lp15:09
EmilienMthanks15:10
*** rasca has quit IRC15:10
*** nyechiel has quit IRC15:10
*** ooolpbot has joined #tripleo15:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607215:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)15:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166645915:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654415:11
*** ooolpbot has quit IRC15:11
openstackLaunchpad bug 1666459 in tripleo "CI: Undercloud second install (idempotency step) fails on pereiodic nonha job" [Critical,In progress] - Assigned to Jiří Stránský (jistr)15:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]15:11
*** athomas has quit IRC15:11
openstackgerritBernard Cafarelli proposed openstack/diskimage-builder master: pip-and-virtualenv: also handle rhel distros  https://review.openstack.org/43369315:11
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE test without horizon  https://review.openstack.org/43649715:12
*** stream10 has joined #tripleo15:14
*** jtomasek has quit IRC15:14
*** jtomasek_ is now known as jtomasek15:14
openstackgerritGiulio Fidente proposed openstack/tripleo-validations master: Check for Ceph status in post-deployment  https://review.openstack.org/43619415:16
*** rasca_ has joined #tripleo15:17
*** rasca_ has quit IRC15:19
*** gbarros has quit IRC15:20
*** saneax is now known as saneax-_-|AFK15:21
*** aufi has quit IRC15:23
*** dsneddon has quit IRC15:23
*** rasca has joined #tripleo15:25
*** b00tcat is now known as b00tcat|away15:26
*** shardy has quit IRC15:28
*** numans has quit IRC15:29
*** david-lyle_ has joined #tripleo15:29
*** numans has joined #tripleo15:30
*** twi99y has quit IRC15:31
*** twi99y has joined #tripleo15:31
*** dmarlin has joined #tripleo15:32
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Configure authtoken in Nova Placement  https://review.openstack.org/43310915:32
*** twi99y_ has joined #tripleo15:32
*** achadha has joined #tripleo15:33
*** b00tcat|away is now known as b00tcat15:34
*** yamahata has quit IRC15:35
*** twi99y has quit IRC15:36
*** myoung has quit IRC15:36
openstackgerritMerged openstack/tripleo-quickstart-extras master: Use modify-image role and custom dir in repo-setup  https://review.openstack.org/43328715:36
*** myoung has joined #tripleo15:37
mandregfidente: re https://review.openstack.org/436194, are you sure about the 'pcs health' command?15:40
*** flepied has quit IRC15:40
mandregfidente: it's not recognized on my undercloud15:40
gfidentemandre, yeah that is meant to be 'ceph health15:41
gfidentetks :P15:41
openstackgerritGiulio Fidente proposed openstack/tripleo-validations master: Check for Ceph status in post-deployment  https://review.openstack.org/43619415:41
gfidenteupdated :)15:41
*** skramaja_ has joined #tripleo15:42
*** skramaja has quit IRC15:42
*** shardy has joined #tripleo15:43
*** shardy has quit IRC15:43
mandregfidente: ah! thanks :)15:44
gfidentety15:44
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: DONT MERGE: test tempest skip file  https://review.openstack.org/43638715:44
*** nyechiel has joined #tripleo15:45
*** achadha has quit IRC15:48
*** yamahata has joined #tripleo15:49
*** jtomasek has quit IRC15:49
*** pblaho has joined #tripleo15:51
*** skramaja_ is now known as skramaja15:51
*** rasca has quit IRC15:52
*** zoli is now known as zoli|brb15:55
*** zaneb has joined #tripleo15:57
*** jtomasek has joined #tripleo15:57
*** [1]cdearborn has joined #tripleo15:58
*** bnemec has joined #tripleo15:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK  https://review.openstack.org/43027716:00
openstackgerritMerged openstack/tripleo-quickstart-extras master: virthost-full-cleanup: Fix typo in README.md  https://review.openstack.org/42905516:01
*** david-lyle has joined #tripleo16:02
*** david-lyle_ has quit IRC16:02
*** rlandy has quit IRC16:03
*** b00tcat is now known as b00tcat|away16:03
*** marios has quit IRC16:04
*** rlandy has joined #tripleo16:04
*** marios has joined #tripleo16:04
openstackgerritMerged openstack/puppet-tripleo master: Stop accidentally removing docker-distribution  https://review.openstack.org/43644216:07
*** tremble has quit IRC16:08
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: Add host info collection to collect-logs  https://review.openstack.org/41322416:08
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: TLS-everywhere: Add nameserver to ctlplane subnet  https://review.openstack.org/43651916:08
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/ocata: Stop accidentally removing docker-distribution  https://review.openstack.org/43652016:08
EmilienMjistr: backport ^16:08
*** cwolferh has joined #tripleo16:08
jistrEmilienM: thanks :)16:09
*** rasca has joined #tripleo16:09
*** flepied has joined #tripleo16:09
*** trozet has quit IRC16:09
*** jaganathan has joined #tripleo16:09
*** fultonj has joined #tripleo16:09
*** ooolpbot has joined #tripleo16:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607216:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654416:11
*** ooolpbot has quit IRC16:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)16:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]16:11
*** gatuus has joined #tripleo16:11
openstackgerritMerged openstack/tripleo-quickstart-extras master: Set tempest result separately in file  https://review.openstack.org/43042016:13
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: Exclude openstack-heat-agents until we get new promotion  https://review.openstack.org/43652716:16
*** zoli|brb is now known as zoli16:16
*** stream10 has quit IRC16:17
*** jcoufal has joined #tripleo16:17
*** stream10 has joined #tripleo16:17
*** shardy has joined #tripleo16:18
shardyEmilienM, flaper87, kfox1111: Hi, I've been asked by sdake if we can move the TripleO/Kolla collaboration session to 9am tomorrow as he's got a flight to catch, does that work for you guys?16:19
shardyskramaja: ^^ would you be OK switching the NFV session to 11am?16:20
EmilienMshardy: it overlaps with the heat sesssion16:20
EmilienMlet me check the ML16:20
shardyEmilienM: which heat session?  The one I see is on Thursday16:20
shardyhttps://etherpad.openstack.org/p/tripleo-ptg-pike16:20
EmilienM"Orchestration feedback and announcement16:21
EmilienMWill take place at 11:00 on Wednesday in `Macon` room.16:21
skramajashardy: i am Ok with it..16:21
shardyAh, https://etherpad.openstack.org/p/tripleo-ptg-pike has it on Thursday16:21
shardyEmilienM: Ok no worries, I think inc0 can make it at the current time16:21
shardywe can sync with sdake afterwards if it's too difficult to move it16:21
*** stream10 has quit IRC16:21
openstackgerritLukas Bezdicka proposed openstack/python-tripleoclient stable/ocata: Pass empty stack_fields to update manager  https://review.openstack.org/43653416:22
openstackgerritLukas Bezdicka proposed openstack/python-tripleoclient stable/ocata: Fixed overcloud stack update workflow name error  https://review.openstack.org/43653516:22
*** yamahata has quit IRC16:23
EmilienMshardy: oops, we might need to find another slot16:23
*** limao has quit IRC16:23
openstackgerritLukas Bezdicka proposed openstack/tripleo-common stable/ocata: Just set the breakpoints on args passed to heat update  https://review.openstack.org/43653616:23
EmilienMshardy: would it be ok to do it later in the day?16:24
EmilienMshardy: like, on the afternoon16:24
*** limao has joined #tripleo16:24
EmilienMshardy: or on Thursday16:24
shardyEmilienM: that's OK for me but the reason for asking to move it was because sdake is leaving tomorrow morning16:24
*** bvandenh has quit IRC16:24
sdakemy flight departs at 11:40 AM Wed - I really am keen to collaborate howver i understand howt he schedules work16:24
shardyprovided kfox1111 and flaper87 can make a later time I'm OK with moving it16:25
sdakeso we can still collaborate but I'll probably be missing a bunch of useful context16:25
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Collect /var/lib/pacemaker/cib with logs  https://review.openstack.org/43653716:25
EmilienMsdake: well, we can do it tomorrow at first time16:25
*** jcoufal has quit IRC16:25
EmilienMsdake: or this afternoon?16:25
EmilienMI'm ok either way, tbh16:25
sdakei have some conflict at 8-9am wednesday - not sure whats it is about16:25
sdakemoment let me check if this afternoon would work16:25
EmilienMshardy: err, indeed, the heat cross project session is on Thu16:26
shardyhttps://etherpad.openstack.org/p/kolla-pike-ptg-schedule looks fairly full this afternoon16:26
*** paramite has quit IRC16:26
sdakejust thinking about it it will hard to get other people there today from kolla but I could probably amke it - i think we want several kolla people there including the propoer of the session16:26
*** limao_ has joined #tripleo16:26
*** david-lyle has quit IRC16:27
*** jtomasek_ has joined #tripleo16:28
*** limao has quit IRC16:28
*** jtomasek has quit IRC16:31
*** zaneb has quit IRC16:31
*** limao_ has quit IRC16:31
*** jcoufal has joined #tripleo16:31
*** yamahata has joined #tripleo16:32
openstackgerritChristian Schwede proposed openstack/puppet-tripleo master: Migrate Swift ring handling from tripleo-heat-templates to puppet-tripleo  https://review.openstack.org/43555616:32
sdakeanyone have the cross rpojecct wednesday track space ethercalc?  I am struggling to find it in my pile of email16:32
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Use puppet-tripleo to fetch and store Swift rings  https://review.openstack.org/43654316:32
EmilienMsdake: ethercalc.openstack.org/Pike-PTG-Discussion-Rooms16:33
shardysdake: https://ethercalc.openstack.org/Pike-PTG-Discussion-Rooms16:33
sdakethanks :)16:33
sdakei spent 10 mins looking and should have just asked :)16:33
*** abregman has quit IRC16:33
sdakegoing to explore moving my flight to later in the day16:34
*** david-lyle has joined #tripleo16:34
sdakeif I do that, I think i will be busy from 9-11am16:34
*** bnemec has quit IRC16:34
sdakei think eveyrone omving theire schedules aroudn me is rediuclous16:34
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Decouple Swift ringbuilding logic  https://review.openstack.org/43624716:34
sdakeI am wondering if we can move kfox1111 's event to 11-noon?16:34
sdakerather not event session16:35
shardysdake: it's planned for 11-11.50 already16:35
sdakecool16:35
shardyhttps://etherpad.openstack.org/p/tripleo-ptg-pike16:35
sdakethat makes sense, let me seee if I can move my flight16:35
sdakeno guarantees16:35
shardythere is a TripleO/Kuryr/Kolla session at 9am, and we have a TripleO container roadmap session 10-10.5016:36
shardyso basically container discussion all morning ;)16:36
shardybut we can ensure the kolla specific discussion is after 11am if you're planning to attend16:36
*** achadha has joined #tripleo16:37
*** achadha has quit IRC16:37
*** achadha has joined #tripleo16:38
*** aufi has joined #tripleo16:38
sdakeok - sessions end at 11, if I can get a flight at 2, I can get in at 6 in time for my daugther's concert16:39
*** dsariel has joined #tripleo16:40
*** achadha_ has joined #tripleo16:40
sdakehowever day prior to travel changes are difficult - ill brb to see if i can get it changed16:40
*** yamahata has quit IRC16:40
sdakewait, they end at 12, I can get a flight at 2:)16:40
sdakeok that timing still works - let me see what american has available16:41
*** yamahata has joined #tripleo16:42
gfidentemandre, where are you? I don't think we can introspect which services have been enabled16:42
gfidentebut sounds like that would be a nice to have too16:42
gfidentemeantime I can probably only check the return code, because the ceph command itself is always installed anyway16:43
gfidentedoes checking return code look cool to you?16:43
*** jaosorior has quit IRC16:43
*** achadha has quit IRC16:43
openstackgerritMichele Baldessari proposed openstack-infra/tripleo-ci master: Collect /var/lib/pacemaker/cib in the tar files from nodes  https://review.openstack.org/42515116:43
*** alop has joined #tripleo16:44
rook-ptggfidente mandre interesting you guys want to query that. We want the same thing wrt understanding which services are running to build dashbaords16:44
*** bnemec has joined #tripleo16:44
rook-ptgand building collectd configs per-node.16:44
*** dsariel has quit IRC16:48
*** trown is now known as trown|lunch16:48
*** zaneb has joined #tripleo16:48
*** pblaho has quit IRC16:48
*** jaganathan has quit IRC16:48
*** bugzy has quit IRC16:50
*** bugzy has joined #tripleo16:50
*** jtomasek_ is now known as jtomasek16:50
mandregfidente, rook-ptg: not sure it's the best way, but I think we can get the list of enabled services from hieradata on the undercloud16:50
mandregfidente: in the kolla room, 3rd floor16:51
rook-ptgmandre yeah someone mentioned the hieradata (i cannot remember who!)16:51
gfidentemandre, you mean ssh on the overcloud?16:51
*** [1]cdearborn has quit IRC16:52
gfidentewe do have in hieradata the list of enabled services16:52
gfidenteon the overcloud nodes16:52
*** skramaja has quit IRC16:52
*** skramaja has joined #tripleo16:53
mandregfidente: once we have the list of available services, we can easily pass it to ansible16:53
gfidentemandre, that is hiera enabled_services16:54
gfidenteI'll try to use it in the when16:54
ansiwenflaper87: "No such container: heat_all" Any idea?16:54
*** jcoufal_ has joined #tripleo16:58
*** zaneb has quit IRC16:58
*** david-lyle has quit IRC16:58
sdakei changed my flight, we are good to go with the schedule as is16:59
sdakeI am leaving wednesday at 6pm16:59
sdakeplease don't do anything thursday that youw ant me to attend :)16:59
*** sdake has quit IRC16:59
*** jcoufal has quit IRC16:59
*** bnemec has quit IRC17:00
*** jcoufal has joined #tripleo17:01
*** shardy has quit IRC17:01
*** zoli is now known as zoli|gone17:01
mandregfidente: strangely, I don't have the enabled_services key in my hieradata, I suspect my undercloud is busted17:01
ansiwenflaper87: forget it, got it17:01
*** fultonj has quit IRC17:02
*** jcoufal_ has quit IRC17:03
*** jtomasek has quit IRC17:03
*** yamahata has quit IRC17:04
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Configure authtoken in Nova Placement  https://review.openstack.org/43310917:05
*** jcoufal_ has joined #tripleo17:05
*** jpich has quit IRC17:05
*** cylopez has quit IRC17:06
*** jcoufal has quit IRC17:07
*** agurenko has quit IRC17:07
openstackgerritAna Krivokapic proposed openstack/tripleo-common master: Enhance plan creation and update with plan-environment  https://review.openstack.org/41416917:07
*** jcoufal has joined #tripleo17:08
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: Stop nova-api before upgrading package  https://review.openstack.org/43622817:09
*** yolanda has quit IRC17:10
*** colonwq has quit IRC17:10
*** mburned_out is now known as mburned17:10
openstackgerritMerged openstack/tripleo-ui stable/ocata: Add i18n to Register Nodes form  https://review.openstack.org/43571817:10
*** jmelvin has quit IRC17:10
*** jcoufal_ has quit IRC17:10
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add checks in ansible upgrade tasks for CephMon and CephOSD  https://review.openstack.org/43550217:11
*** jmelvin has joined #tripleo17:11
*** ooolpbot has joined #tripleo17:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607217:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654417:11
*** ooolpbot has quit IRC17:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)17:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]17:11
*** pcaruana has quit IRC17:12
*** skramaja has quit IRC17:13
sshnaidmEmilienM, I'd blame gnocchi in promotion blocking..17:14
sshnaidmwho is gnocchi expert on the channel? ;)17:14
*** david-lyle has joined #tripleo17:16
*** david-lyle has quit IRC17:16
*** paramite has joined #tripleo17:16
*** ansmith has quit IRC17:17
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Increase ansible-pacemaker default service start timeout  https://review.openstack.org/43656017:17
*** gfidente has quit IRC17:17
*** ansmith has joined #tripleo17:18
*** jmelvin has quit IRC17:18
*** jkilpatr has quit IRC17:19
*** cwolferh has quit IRC17:21
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT MERGE: test 504error without gnocchi  https://review.openstack.org/43649117:24
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE test without gnocchi  https://review.openstack.org/43649717:25
*** aufi has quit IRC17:31
*** ccamacho has quit IRC17:33
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Change hardcoded ansible user stack to undercloud  https://review.openstack.org/43109217:33
*** saibarspeis has quit IRC17:33
sshnaidmtrown|lunch, seems like my first approach was more successful ^^17:34
*** achadha_ has quit IRC17:35
*** karimb has quit IRC17:38
*** tesseract has quit IRC17:41
*** flepied has quit IRC17:44
*** sdake has joined #tripleo17:47
*** flepied has joined #tripleo17:47
*** b00tcat|away is now known as b00tcat17:48
*** trown|lunch is now known as trown17:48
*** ccamacho has joined #tripleo17:49
*** yolanda has joined #tripleo17:49
*** sdake has quit IRC17:53
*** yolanda has quit IRC17:53
*** flepied has quit IRC17:54
*** sudipto has joined #tripleo17:54
*** sudipto_ has joined #tripleo17:54
*** jmelvin has joined #tripleo17:57
*** jkilpatr has joined #tripleo17:57
*** fragatina has joined #tripleo18:01
*** mburned is now known as mburned_out18:01
*** twi99y has joined #tripleo18:03
*** achadha has joined #tripleo18:03
*** sudipto has quit IRC18:05
*** sudipto_ has quit IRC18:05
*** twi99y_ has quit IRC18:05
*** sudipto_ has joined #tripleo18:05
*** sudipto has joined #tripleo18:06
*** sudipto_ has quit IRC18:07
*** sudipto has quit IRC18:07
*** yolanda has joined #tripleo18:09
*** apetrich has quit IRC18:09
*** nyechiel has quit IRC18:10
*** fpan has quit IRC18:10
*** shardy has joined #tripleo18:10
*** yamahata has joined #tripleo18:11
*** ooolpbot has joined #tripleo18:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607218:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654418:11
*** ooolpbot has quit IRC18:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)18:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]18:11
*** openstack has joined #tripleo18:13
*** dkelson has joined #tripleo18:14
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Collect /var/lib/pacemaker/cib in the tar files from nodes  https://review.openstack.org/42515118:15
*** apetrich has joined #tripleo18:15
*** yamahata has quit IRC18:16
*** sdake has joined #tripleo18:16
*** shardy has quit IRC18:17
*** shardy has joined #tripleo18:17
*** yamahata has joined #tripleo18:18
*** salmankhan has quit IRC18:19
*** sdake has quit IRC18:20
dkelsonI'm using RDO Newton with CentOS7 trying to deploy at 3 controller, 3 compute, 3 ceph-storage overcloud. On two of the three ceph-storage nodes the deployment fails because the metadata_url in /etc/os-collect-config.conf is wrong.18:22
*** fragatina has quit IRC18:23
*** fragatina has joined #tripleo18:24
*** gfidente has joined #tripleo18:24
*** gfidente has quit IRC18:24
*** gfidente has joined #tripleo18:24
*** yprokule has quit IRC18:25
*** jpena is now known as jpena|away18:29
*** jkilpatr has quit IRC18:30
*** jtomasek has joined #tripleo18:30
*** shardy has quit IRC18:34
*** zaneb has joined #tripleo18:35
*** jpich has quit IRC18:35
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add checks in ansible upgrade tasks for CephMon and CephOSD  https://review.openstack.org/43550218:39
*** fragatina has quit IRC18:42
*** jerrygb has quit IRC18:42
mandretrown: hi, where can I find the container CI job logs for https://review.openstack.org/#/c/436212/2?18:44
*** colonwq has quit IRC18:45
*** colonwq has joined #tripleo18:46
*** gbarros has joined #tripleo18:46
*** david-lyle has joined #tripleo18:46
openstackgerritGiulio Fidente proposed openstack/tripleo-validations master: Check for Ceph status in post-deployment  https://review.openstack.org/43619418:48
mandretrown: found it, adarazs left a comment in the review18:48
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Enable panko service by default on overcloud  https://review.openstack.org/43597918:48
sshnaidmmandre, trown please run "check experimental" on containers related patches to check the upstream containers job and I'd like to be added to their reviews too18:49
mandresshnaidm: ack18:49
*** fzdarsky has quit IRC18:50
*** Goneri has quit IRC18:51
*** jpich has joined #tripleo18:52
*** sdake has joined #tripleo18:54
*** mburned_out is now known as mburned18:54
*** gatuus has quit IRC18:55
*** gatuus has joined #tripleo18:56
*** david-lyle has quit IRC18:57
*** achadha has quit IRC18:58
*** gfidente has quit IRC18:58
*** skramaja has joined #tripleo18:58
*** b00tcat has quit IRC18:58
*** bnemec has joined #tripleo19:00
*** ckyriakidou has quit IRC19:00
*** jtomasek_ has joined #tripleo19:01
bandinihas anyone seen scenario004 failing consistently in CI?19:01
EmilienMbandini: logs?19:01
*** achadha has joined #tripleo19:02
bandiniEmilienM: http://logs.openstack.org/92/436192/1/check/gate-tripleo-ci-centos-7-scenario004-multinode/9a93c5e/logs/postci.txt.gz19:02
EmilienMgimme a sc19:02
*** fragatina has joined #tripleo19:02
bandiniI got it twice in a row on that review, so need to look into it a bit more ;)19:02
bandinimerci!19:02
*** flepied has joined #tripleo19:02
openstackgerritGiulio Fidente proposed openstack/tripleo-validations master: Check for Ceph status in post-deployment  https://review.openstack.org/43619419:02
*** yamahata has quit IRC19:03
*** jtomasek has quit IRC19:04
*** jpich has quit IRC19:05
EmilienMbandini: recheck19:05
EmilienMits an infra error19:05
EmilienMhttp://logs.openstack.org/92/436192/1/check/gate-tripleo-ci-centos-7-scenario004-multinode/9a93c5e/logs/postci.txt.gz#_2017-02-21_18_14_34_00019:06
*** zaneb has quit IRC19:06
EmilienMbandini: I've seen scenario004 working in ci status19:07
*** achadha has quit IRC19:08
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/ocata: Enable panko service by default on overcloud  https://review.openstack.org/43659119:10
*** Goneri has joined #tripleo19:10
*** ooolpbot has joined #tripleo19:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607219:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654419:11
*** ooolpbot has quit IRC19:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)19:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]19:11
*** mcornea has quit IRC19:14
*** mburned is now known as mburned_out19:14
*** pkovar has quit IRC19:15
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT MERGE: no gnocchi no ceilometer  https://review.openstack.org/43659519:17
*** gfidente has joined #tripleo19:17
*** stream10 has joined #tripleo19:17
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test periodic without metrics  https://review.openstack.org/43643519:18
*** dprince has joined #tripleo19:21
*** achadha has joined #tripleo19:22
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Add ssh_user jenkins to OVB quickstart jobs  https://review.openstack.org/43659919:22
*** nyechiel has joined #tripleo19:23
*** yamahata has joined #tripleo19:23
*** akrivoka has quit IRC19:24
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras master: Fix container gate  https://review.openstack.org/43621219:26
*** achadha has quit IRC19:27
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras master: Fix container gate  https://review.openstack.org/43621219:27
*** dsneddon has joined #tripleo19:28
*** ccamacho has quit IRC19:28
bandiniEmilienM: ack. so do I just wait and recheck eventually?19:28
EmilienMbandini: recheck now, yeah19:28
EmilienMit looks like a transient issue19:28
*** jcoufal has quit IRC19:30
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates master: Decouple Swift ringbuilding logic  https://review.openstack.org/43624719:30
*** bnemec has quit IRC19:33
*** bnemec has joined #tripleo19:33
*** zaneb has joined #tripleo19:34
*** amoralej is now known as amoralej|off19:34
*** salmankhan has joined #tripleo19:34
bandiniEmilienM: ack, thanks19:34
*** achadha has joined #tripleo19:35
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: [WIP] Add role to deploy FreeIPA  https://review.openstack.org/43619819:36
*** jcoufal has joined #tripleo19:36
*** salmankhan has quit IRC19:39
openstackgerritAna Krivokapic proposed openstack/tripleo-common master: Add plan export action and workflow  https://review.openstack.org/42278919:39
*** achadha has quit IRC19:40
*** nyechiel has quit IRC19:42
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT MERGE: testing no ceilometer  https://review.openstack.org/43662019:48
*** nyechiel has joined #tripleo19:49
openstackgerritSteven Hardy proposed openstack/tripleo-common master: Add support for network_data.yaml to process templates action  https://review.openstack.org/43662119:50
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE testing without ceilometer  https://review.openstack.org/43662319:50
*** hjensas has quit IRC19:50
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add host info collection to collect-logs  https://review.openstack.org/41322419:51
*** karimb has joined #tripleo19:57
*** yolanda has quit IRC19:59
*** jcoufal has quit IRC20:00
*** yolanda has joined #tripleo20:00
*** chlong has quit IRC20:01
*** gatuus has quit IRC20:01
*** david-lyle has joined #tripleo20:01
*** gatuus has joined #tripleo20:01
*** jpich has joined #tripleo20:02
*** sdake has quit IRC20:02
*** gatuus has quit IRC20:06
*** jpich has quit IRC20:06
*** jcoufal has joined #tripleo20:07
*** zaneb has quit IRC20:07
*** chlong has joined #tripleo20:08
*** ooolpbot has joined #tripleo20:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607220:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654420:11
*** ooolpbot has quit IRC20:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)20:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]20:11
EmilienMsshnaidm: any update on 504 ?20:12
sshnaidmEmilienM, just posted to bug :)20:12
sshnaidm wrote a moment ago20:12
*** oneswig has joined #tripleo20:13
EmilienMsshnaidm: 2. option seems good for short term no?20:13
sshnaidmEmilienM, as a workaround, yeah20:14
sshnaidmEmilienM, either disable gnocchi20:14
EmilienMsshnaidm: no20:14
sshnaidmEmilienM, I suppose we don't gate gnocchi and ceilometer patches, right?20:14
EmilienMsshnaidm: I think pradk woulndn't be ok20:14
EmilienMsshnaidm: we do, at least on scenario00120:14
EmilienMthe question is, do we want tripleo default deployments with gnocchi enabled?20:15
EmilienMpradk: ^20:15
EmilienMsshnaidm: can you propose a patch for 2. in the meantime please?20:15
*** dsneddon has quit IRC20:15
sshnaidmEmilienM, I'll run a patch with option 2, let's see if it helps20:15
EmilienMk20:15
EmilienMthx20:15
EmilienMsshnaidm: you can use depends-on, and we we got a promotion, we'll have to quickly merge the THT patch if you see what I mean20:15
sshnaidmEmilienM, we can't run depends-on on promotion job, we disabled it because of such problems..20:16
sshnaidmEmilienM, it's better to test it before..20:17
pradkEmilienM, definitely dont want to disable gnocchi.. we are getting push back for doing for for panko20:17
*** colonwq has quit IRC20:17
EmilienMpradk: yeah, I figured.20:17
EmilienMsshnaidm: let's increase the httpd params20:17
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Stop accidentally removing docker-distribution  https://review.openstack.org/43652020:17
*** jtomasek_ has quit IRC20:17
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates master: Increase apache ServerLimit and workers to 100  https://review.openstack.org/43665020:19
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: testing periodic with apache limits 100  https://review.openstack.org/43665120:20
sshnaidmEmilienM, ^^20:20
*** karimb has quit IRC20:21
sshnaidmI'll bbl to check it20:21
*** david-lyle has quit IRC20:23
*** sdake has joined #tripleo20:23
*** stream10 has quit IRC20:24
*** nyechiel has quit IRC20:27
*** trozet has joined #tripleo20:28
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Make network-isolation environment rendered for all roles  https://review.openstack.org/40992020:29
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add network_data.yaml to encapsulate list of networks for j2  https://review.openstack.org/40992120:29
*** jcoufal has quit IRC20:30
*** bnemec has quit IRC20:33
*** yolanda has quit IRC20:33
*** jcoufal has joined #tripleo20:34
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Make network-isolation environment rendered for all roles  https://review.openstack.org/40992020:36
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add network_data.yaml to encapsulate list of networks for j2  https://review.openstack.org/40992120:36
*** jtomasek_ has joined #tripleo20:37
*** david-lyle has joined #tripleo20:38
*** dsariel has joined #tripleo20:39
*** jkilpatr has joined #tripleo20:39
*** mburned_out is now known as mburned20:39
EmilienMsshnaidm: 100 is a lot no?20:40
*** jcoufal has quit IRC20:41
*** jcoufal has joined #tripleo20:42
*** sdake has quit IRC20:45
pradkhmm if its issues with gnocchi holding on to apache threads .. likely a bug in gnocchi20:45
pradklemme see if i can have someone look at it20:45
*** mburned is now known as mburned_out20:48
pradkalternately we can set the wsgi threads appropriately just for gnocchi20:48
*** gbarros has quit IRC20:48
pradkthat way ist not grabbing all20:48
*** david-lyle has quit IRC20:49
*** skramaja has quit IRC20:52
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add checks in ansible upgrade tasks for CephMon and CephOSD  https://review.openstack.org/43550220:53
*** paramite has quit IRC20:53
*** colonwq has joined #tripleo20:53
*** david-lyle has joined #tripleo20:56
*** yolanda has joined #tripleo20:57
*** sdake has joined #tripleo20:57
*** david-lyle has quit IRC20:59
*** shardy has joined #tripleo20:59
*** zaneb has joined #tripleo21:01
*** salmankhan has joined #tripleo21:01
*** trown is now known as trown|outtypewww21:03
*** jtomasek_ has quit IRC21:03
bandinishardy: https://review.openstack.org/#/c/436153/ easiest review of the day ;)21:06
bandiniPROMISE!21:06
shardybandini: lgtm, one question re -/* formatting21:09
*** dtrainor has quit IRC21:10
*** ooolpbot has joined #tripleo21:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607221:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)21:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654421:11
*** ooolpbot has quit IRC21:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]21:11
*** jayg is now known as jayg|g0n321:12
*** gatuus has joined #tripleo21:13
*** nyechiel has joined #tripleo21:13
bandinishardy: ops :) thanks let me fix that up21:13
*** dtrainor has joined #tripleo21:15
openstackgerritMerged openstack/puppet-tripleo master: Add VPP service  https://review.openstack.org/42743621:16
gfidentebandini, I added a random comment too21:16
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Improve the README for the _setting keys  https://review.openstack.org/43615321:16
openstackgerritMerged openstack/tripleo-heat-templates master: Enable panko service by default on overcloud  https://review.openstack.org/43597921:16
gfidentejust to pretend I reviewed21:16
*** trozet has quit IRC21:16
bandinilol21:16
gfidentewhat does ti spacco la faccia means21:17
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/43193521:18
*** jtomasek_ has joined #tripleo21:20
*** yamahata has quit IRC21:22
*** ansmith has quit IRC21:22
*** bnemec has joined #tripleo21:22
*** jprovazn has quit IRC21:22
openstackgerritMerged openstack/tripleo-heat-templates master: Improve the README for the _setting keys  https://review.openstack.org/43615321:24
*** shardy has quit IRC21:30
*** hjensas has joined #tripleo21:34
*** hjensas has quit IRC21:34
*** hjensas has joined #tripleo21:34
*** gatuus has quit IRC21:36
*** gatuus has joined #tripleo21:36
*** iranzo has quit IRC21:38
*** jtomasek_ is now known as jtomasek21:39
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Configure authtoken in Nova Placement  https://review.openstack.org/43310921:40
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM: test scenario001 upgrade from newton to ocata  https://review.openstack.org/43573821:44
*** ckyriakidou has joined #tripleo21:47
dkelsonI'm deploying a new RDO Newton CentOS7 overcloud with 3 controllers, one of the controllers is failing in overcloud-AllNodesDeploySteps-at4thsmmnpha-ControllerDeployment_Step5-frrbsgw3vukn21:47
dkelsonIn the deploy_stderr, the difference between the failing node and the working two nodes is the following message twice: 'Error: No set of title patterns matched the title "::". on node overcloud-controller-0.localdomain'21:48
dkelsonhow do I troubleshoot this?21:48
*** nyechiel has quit IRC21:50
*** flepied has quit IRC21:53
*** ansmith has joined #tripleo21:53
*** yamahata has joined #tripleo21:54
*** yolanda has quit IRC21:54
*** b00tcat has joined #tripleo21:55
*** b00tcat has quit IRC21:55
*** b00tcat has joined #tripleo21:55
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP DO NOT MERGE Move rabbitmq behind haproxy  https://review.openstack.org/39011421:56
*** lblanchard has quit IRC21:57
*** ckyriakidou has quit IRC21:57
*** jkilpatr has quit IRC21:58
*** jkilpatr has joined #tripleo21:58
*** yamahata has quit IRC21:58
*** b00tcat_ has joined #tripleo21:59
*** dprince has quit IRC22:03
*** b00tcat_ has quit IRC22:03
*** jtomasek has quit IRC22:04
*** dmacpher has quit IRC22:05
*** oneswig has quit IRC22:05
*** bnemec has quit IRC22:05
*** gfidente has quit IRC22:05
*** zaneb has quit IRC22:07
*** larstobi has quit IRC22:09
*** jkilpatr has quit IRC22:10
*** larstobi has joined #tripleo22:10
*** colonwq has quit IRC22:11
*** ooolpbot has joined #tripleo22:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607222:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654422:11
*** ooolpbot has quit IRC22:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)22:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]22:11
*** sdake has quit IRC22:15
*** dmacpher has joined #tripleo22:17
*** tosky has quit IRC22:20
*** gatuus has quit IRC22:23
*** gatuus_ has joined #tripleo22:23
*** mgkwill has joined #tripleo22:31
mgkwillAnyone know Tim Rozet handle?22:32
*** pmannidi has joined #tripleo22:37
openstackgerritMerged openstack-infra/tripleo-ci master: Exclude openstack-heat-agents until we get new promotion  https://review.openstack.org/43652722:41
*** yolanda has joined #tripleo22:43
*** jcoufal_ has joined #tripleo22:44
*** jcoufal has quit IRC22:45
*** Goneri has quit IRC22:49
*** liverpooler has quit IRC22:51
*** dougbtv has quit IRC22:52
*** gatuus_ has quit IRC22:53
*** jmelvin has quit IRC22:53
*** gatuus has joined #tripleo22:59
*** jcoufal has joined #tripleo22:59
*** jcoufal_ has quit IRC23:01
*** flepied has joined #tripleo23:01
*** Goneri has joined #tripleo23:02
*** Goneri has quit IRC23:07
*** ooolpbot has joined #tripleo23:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166607223:11
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)23:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166654423:11
*** ooolpbot has quit IRC23:11
openstackLaunchpad bug 1666544 in tripleo "upgrades CI broken due to package dependencies" [Critical,Triaged]23:11
sshnaidmtrown|outtypewww, EmilienM, slagle, and other cores, this should allow our promotion: https://review.openstack.org/#/c/436650/23:12
*** jpich has joined #tripleo23:14
*** saneax-_-|AFK is now known as saneax23:20
*** Goneri has joined #tripleo23:22
EmilienMDone23:24
EmilienMThanks sshnaidm23:24
*** fzdarsky has joined #tripleo23:25
EmilienMI'm with bnemec, I'll see with him if we can merge it23:25
EmilienMUnless slagle is around23:26
*** Goneri has quit IRC23:28
*** jtomasek has joined #tripleo23:29
*** b00tcat has quit IRC23:30
*** fzdarsky has quit IRC23:30
EmilienMwe are seating at a table with a beer and going to approve this patch23:32
EmilienMthat's how tripleo works :D23:32
EmilienMsshnaidm: approved23:33
EmilienMsshnaidm: please backport it to stable/ocata23:33
EmilienMsshnaidm: and I'll approve it tonight23:33
* EmilienM off23:33
sshnaidm:)23:33
*** Goneri has joined #tripleo23:34
*** jcoufal has quit IRC23:43
*** jcoufal has joined #tripleo23:44
*** Goneri has quit IRC23:47
*** Goneri has joined #tripleo23:50
*** dmarlin has quit IRC23:53
*** Goneri has quit IRC23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!