Wednesday, 2017-12-13

*** alee has joined #tripleo00:00
*** absubram has joined #tripleo00:03
*** dprince has quit IRC00:10
*** rlandy|afk is now known as rlandy00:18
*** dtrainor has quit IRC00:19
*** maeca has joined #tripleo00:19
*** dtrainor has joined #tripleo00:20
*** hamzy has joined #tripleo00:21
*** maeca has quit IRC00:23
*** brault has joined #tripleo00:25
*** tongl has quit IRC00:27
*** brault has quit IRC00:30
*** openstackgerrit has quit IRC00:33
*** ecerquei has joined #tripleo00:34
*** anilvenkata has quit IRC00:37
*** tosky has quit IRC00:39
*** openstackgerrit has joined #tripleo00:56
openstackgerritMerged openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52644000:56
*** stevebaker has joined #tripleo01:11
*** absubram has quit IRC01:13
*** dmacpher has quit IRC01:13
*** yamahata has joined #tripleo01:15
*** dsneddon has quit IRC01:18
*** absubram has joined #tripleo01:19
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574301:20
*** stendulker has joined #tripleo01:21
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Add /var/lib/pacemaker/pengine/pe-input* to saved logs  https://review.openstack.org/52755401:33
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Add /var/lib/pacemaker/pengine/pe-input* to saved logs  https://review.openstack.org/52755401:35
*** cshastri has joined #tripleo01:36
openstackgerritEmilien Macchi proposed openstack/tripleo-puppet-elements master: Update test-requirements to work with reno  https://review.openstack.org/52751801:42
*** tongl has joined #tripleo01:50
*** yamahata has quit IRC01:54
openstackgerritEmilien Macchi proposed openstack/tripleo-puppet-elements master: add puppet-ptp into image  https://review.openstack.org/52663001:55
*** absubram has quit IRC01:56
*** tongl has quit IRC01:56
openstackgerritJames Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download  https://review.openstack.org/52533102:00
*** Grenth has quit IRC02:04
*** absubram has joined #tripleo02:09
*** Grenth has joined #tripleo02:09
*** rodolof has quit IRC02:12
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756102:23
*** absubram has quit IRC02:26
*** mdnadeem has quit IRC02:32
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756102:34
*** liverpooler has quit IRC02:41
*** liverpooler has joined #tripleo02:42
openstackgerritSteve Baker proposed openstack/tripleo-common master: Move more prepare logic into kolla_builder  https://review.openstack.org/52657902:43
openstackgerritSteve Baker proposed openstack/tripleo-common master: Prepare action: extra arguments  https://review.openstack.org/52658002:43
*** absubram has joined #tripleo02:46
*** cdearborn has quit IRC02:48
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756102:49
*** absubram has quit IRC02:51
*** rlandy has quit IRC02:52
*** fragatina has quit IRC02:54
*** stendulker has quit IRC02:55
*** absubram has joined #tripleo02:56
*** moshele has joined #tripleo02:59
*** Grenth has quit IRC03:03
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Move more prepare logic into kolla_builder  https://review.openstack.org/52657603:06
*** Grenth has joined #tripleo03:08
*** moshele has quit IRC03:09
*** dmacpher has joined #tripleo03:11
*** tongl has joined #tripleo03:16
*** ecerquei has quit IRC03:22
*** absubram has quit IRC03:31
*** absubram has joined #tripleo03:32
*** tongl has quit IRC03:41
*** radeks has joined #tripleo03:41
*** psahoo has joined #tripleo03:53
*** bkopilov has quit IRC04:00
*** ramishra has joined #tripleo04:11
*** dhill_ has quit IRC04:11
*** karthiks has joined #tripleo04:11
*** dhill_ has joined #tripleo04:12
*** threestrands has joined #tripleo04:14
*** threestrands has quit IRC04:14
*** threestrands has joined #tripleo04:14
*** jappleii__ has quit IRC04:15
*** threestrands has quit IRC04:15
*** threestrands has joined #tripleo04:16
*** threestrands has quit IRC04:16
*** threestrands has joined #tripleo04:16
*** morazi has joined #tripleo04:16
*** udesale has joined #tripleo04:17
*** openstackgerrit has quit IRC04:18
*** yamahata has joined #tripleo04:20
*** ykarel|afk has joined #tripleo04:22
tonybstevebaker: Are you around?04:24
*** dbecker has quit IRC04:25
*** pmannidi has quit IRC04:27
*** links has joined #tripleo04:30
*** links has quit IRC04:32
*** pmannidi has joined #tripleo04:32
*** threestrands has quit IRC04:36
*** dbecker has joined #tripleo04:39
*** mdnadeem has joined #tripleo04:39
*** absubram has quit IRC04:42
*** threestrands has joined #tripleo04:43
*** karthiks has quit IRC04:43
*** threestrands has quit IRC04:44
*** threestrands has joined #tripleo04:44
*** threestrands has quit IRC04:44
*** threestrands has joined #tripleo04:44
*** threestrands has quit IRC04:45
*** openstackgerrit has joined #tripleo04:45
openstackgerritKarthik S proposed openstack/os-net-config master: WIP: Add network objects sriov_vf and sriov_pf  https://review.openstack.org/52757104:45
*** threestrands has joined #tripleo04:46
*** liverpooler has quit IRC04:46
*** threestrands has quit IRC04:47
*** threestrands has joined #tripleo04:47
*** ykarel|afk is now known as ykarel04:49
*** tzumainn has quit IRC04:54
*** karthiks has joined #tripleo04:55
*** pdeore has joined #tripleo04:58
*** ratailor has joined #tripleo04:59
*** dpawar has joined #tripleo05:04
*** tongl has joined #tripleo05:06
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756105:10
*** pgadiya has joined #tripleo05:10
*** anilvenkata has joined #tripleo05:14
*** skramaja has joined #tripleo05:14
Tenguhello there05:16
TenguEmilienM: time to sleep ;)05:17
EmilienMtrue, I'm off05:18
Tengu:)05:21
*** radeks has quit IRC05:24
*** shreshtha has joined #tripleo05:32
*** janki has joined #tripleo05:32
*** absubram has joined #tripleo05:37
*** dpawar has quit IRC05:41
*** fragatina has joined #tripleo05:49
*** karthiks has quit IRC05:51
*** fragatina has quit IRC05:53
*** marios has joined #tripleo05:54
*** bkopilov has joined #tripleo05:54
*** tongl has quit IRC05:56
*** mdnadeem has quit IRC05:58
*** threestrands has quit IRC06:03
*** pkovar has joined #tripleo06:03
*** d0ugal has quit IRC06:04
*** dparkes_ has quit IRC06:05
*** karthiks has joined #tripleo06:05
*** janki has quit IRC06:07
*** d0ugal has joined #tripleo06:08
*** radeks has joined #tripleo06:17
*** masco has joined #tripleo06:17
*** suuuper has joined #tripleo06:17
openstackgerritMerged openstack/tripleo-quickstart master: Add ansible_facts_cache/ to .gitignore  https://review.openstack.org/52649706:20
openstackgerritMerged openstack/tripleo-validations master: Enhance repo validation to check for unwanted enabled repos  https://review.openstack.org/51541206:20
openstackgerritMerged openstack/tripleo-validations master: Warn if there are not enough node IPs in pools  https://review.openstack.org/51130406:20
openstackgerritMerged openstack/tripleo-validations master: ctlplane-ip-range: Verify lower IP bound is smaller than upper  https://review.openstack.org/51008206:20
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: Add unit tests for tripleo::firewall::service_rules  https://review.openstack.org/52658906:22
*** jaganathan has joined #tripleo06:25
*** brault has joined #tripleo06:26
*** dsariel has joined #tripleo06:26
*** janki has joined #tripleo06:26
*** iranzo has joined #tripleo06:27
*** moshele has joined #tripleo06:29
*** brault has quit IRC06:30
*** jfrancoa has joined #tripleo06:31
*** aditya_r has joined #tripleo06:34
*** mdnadeem has joined #tripleo06:35
moshelehi, can someone do +W on https://review.openstack.org/#/c/507100/ is was approved before I just rebase it so the test will pass06:35
*** aditya_r has quit IRC06:46
*** aditya_r has joined #tripleo06:46
*** absubram has quit IRC06:52
*** hjensas has quit IRC06:56
*** dsariel has quit IRC06:56
*** fragatina has joined #tripleo06:57
*** cshastri has quit IRC06:57
*** fragatin_ has joined #tripleo06:57
openstackgerritMerged openstack/tripleo-heat-templates master: Add parameters for Barbican worker image  https://review.openstack.org/52574206:58
openstackgerritMerged openstack/tripleo-heat-templates master: Add glance config for barbican  https://review.openstack.org/52406306:58
*** dpawar has joined #tripleo06:58
*** psahoo has quit IRC06:58
mosheleEmilienM: can you re-approve  https://review.openstack.org/#/c/507100/ ?06:58
*** dparkes has joined #tripleo07:00
*** udesale__ has joined #tripleo07:01
*** aufi has joined #tripleo07:01
*** fragatina has quit IRC07:02
*** aditya_r has quit IRC07:02
*** aditya_r has joined #tripleo07:02
*** udesale has quit IRC07:03
*** agurenko has joined #tripleo07:03
*** udesale has joined #tripleo07:04
*** pgadiya has quit IRC07:05
*** udesale__ has quit IRC07:06
*** pgadiya has joined #tripleo07:06
*** agurenko has quit IRC07:10
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Support release change during playbook run  https://review.openstack.org/50482207:10
*** bkopilov has quit IRC07:11
*** rcernin has quit IRC07:12
*** hansih has joined #tripleo07:12
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook  https://review.openstack.org/50493907:13
*** agurenko has joined #tripleo07:13
*** psahoo has joined #tripleo07:13
*** dsariel has joined #tripleo07:14
*** cshastri has joined #tripleo07:15
*** dmacpher has quit IRC07:15
*** holser has joined #tripleo07:18
openstackgerritMerged openstack/tripleo-upgrade master: Merge tripleo-upgrade repo from redhat-openstack namespace  https://review.openstack.org/52414107:25
*** lvdombrkr has quit IRC07:26
*** lvdombrkr has joined #tripleo07:27
*** bkopilov has joined #tripleo07:29
*** pmannidi has quit IRC07:29
*** ebarrera has joined #tripleo07:31
*** abregman has joined #tripleo07:34
*** iranzo has quit IRC07:37
*** ykarel is now known as ykarel|lunch07:37
*** daidv has quit IRC07:41
*** daidv has joined #tripleo07:41
*** yamahata has quit IRC07:42
*** iranzo has joined #tripleo07:44
*** iranzo has quit IRC07:44
*** iranzo has joined #tripleo07:44
*** shardy has joined #tripleo07:46
*** udesale__ has joined #tripleo07:46
*** udesale has quit IRC07:49
*** chlong_ has joined #tripleo07:52
*** hjensas has joined #tripleo07:52
*** hjensas has quit IRC07:52
*** hjensas has joined #tripleo07:52
*** fragatin_ has quit IRC07:53
*** chlong has quit IRC07:55
*** chlong_ has quit IRC07:56
*** chlong_ has joined #tripleo07:57
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data  https://review.openstack.org/52560307:58
*** holser has quit IRC07:58
*** holser has joined #tripleo07:59
*** jpena|off is now known as jpena08:09
*** lvdombrkr has quit IRC08:12
*** rcernin has joined #tripleo08:13
*** amoralej|off is now known as amoralej08:14
*** cylopez has joined #tripleo08:15
*** cylopez has left #tripleo08:17
*** gfidente|afk has quit IRC08:19
*** cshastri has quit IRC08:21
*** psahoo has quit IRC08:23
*** tesseract has joined #tripleo08:25
*** apetrich has quit IRC08:25
*** apetrich has joined #tripleo08:26
*** ykarel|lunch is now known as ykarel08:26
*** yprokule has joined #tripleo08:32
*** ffiore has joined #tripleo08:32
*** aditya_r has quit IRC08:32
*** aditya_r has joined #tripleo08:33
*** cshastri has joined #tripleo08:34
*** psahoo has joined #tripleo08:35
*** yolanda__ has joined #tripleo08:37
*** mdnadeem has quit IRC08:37
*** yolanda has quit IRC08:40
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add a validation that checks for available update  https://review.openstack.org/47651708:41
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook  https://review.openstack.org/50493908:42
*** jtomasek has joined #tripleo08:43
*** daidv has quit IRC08:46
*** yolanda__ has quit IRC08:46
*** daidv has joined #tripleo08:46
*** mdnadeem has joined #tripleo08:46
*** yolanda__ has joined #tripleo08:46
*** yolanda__ is now known as yolanda08:47
*** pmannidi has joined #tripleo08:52
pmannidiping tripleo .. I've a basic question .. who generates /var/lib/config-data08:53
pmannidircernin, ^^^08:53
*** dpawar has quit IRC08:55
*** abregman_ has joined #tripleo08:59
*** ukalifon has joined #tripleo08:59
*** ffiore has quit IRC09:00
*** links has joined #tripleo09:00
*** abregman has quit IRC09:01
*** ffiore has joined #tripleo09:01
jankimandre, hey09:02
*** dciabrin has joined #tripleo09:02
*** abregman_ is now known as abregman09:03
*** pmannidi has quit IRC09:04
*** pmannidi has joined #tripleo09:05
shardypmannidi: it's generated by this script:09:05
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-puppet.py09:05
shardyrun here:09:06
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps-tasks.yaml#L3409:06
pmannidishardy, i'm hitting a strange issue09:08
*** jpich has joined #tripleo09:11
*** fragatina has joined #tripleo09:12
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart master: WIP: Use tripleo-upgrade role in CI  https://review.openstack.org/51338209:12
*** agurenko has quit IRC09:15
*** ccamacho has joined #tripleo09:16
jankishardy, hey09:16
*** aditya_r has quit IRC09:17
mandrejanki: hi09:18
*** shreshtha has quit IRC09:18
Tengu\o/ and it's an all-green in my reviews \o/09:18
jankimandre, hey. I have a question regarding logging in containarised deloyment09:19
*** nyechiel_ has joined #tripleo09:19
Tenguanyone with some +2 for code (and workflow) interested in reviewing those two: https://review.openstack.org/526292 https://review.openstack.org/526589  so that we can get some new unit tests in puppet-tripleo? :)09:19
*** isq_ has quit IRC09:20
*** agurenko has joined #tripleo09:20
*** isq_ has joined #tripleo09:21
*** pblaho has joined #tripleo09:21
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test ci  https://review.openstack.org/52644309:23
mandrejanki: how can I help you?09:24
*** bogdando has joined #tripleo09:25
openstackgerritSagi Shnaidman proposed openstack/tripleo-heat-templates stable/ocata: DNM: test ocata  https://review.openstack.org/52764409:27
*** dpawar has joined #tripleo09:29
*** ykarel is now known as ykarel|away09:30
*** abregman has quit IRC09:31
*** lucas-afk is now known as lucasagomes09:32
jankimandre, can we collect service logs via docker logs <container_name>?09:33
jankiwas this point discussed before and any specific reason why logs are written to file09:33
mandrejanki: 'docker logs' shows only what goes to stdout in the container09:37
Tengujanki: I think the logs are written to files in order to be able to send them with fluentd or any other way to some central logging infra (elk, kelk, and so on)09:38
jankimandre, yes. We are thinking of diverting all ODL logs to STDOUT and then read it with "docker logs" and let sosreport read it from there. I wanted to check if there are any risks involved with this.09:39
mandrejanki: so either your service is configured to log to stdout and then you can use 'docker logs', or it is configured to log to file, in which case we mount the /var/log/containers/<service> dir to /var/log/<service> in the container09:39
mandrejanki: you may want to take a look at https://review.openstack.org/#/c/510001/09:40
jankiTengu, cant "docker logs" be sent to centra logging infra? It might also depend on what customers are using09:40
*** ykarel|away has quit IRC09:40
jankimandre, checking09:40
Tengujanki: not sure - in our case (at my job) we use rsyslog in order to send logs away from our rancher environments. it's plugged on the standard docker logging stuff I think, but it's not my part. Only guessing more or less.09:41
jankimandre, Tengu I got disconnected. Hope havent missed any texts in between09:42
*** janki has quit IRC09:42
Tengujanki: just keep in mind `docker logs' has (had) some issues that could make the whole Docker service crash due to poor buffering managment09:42
*** ramishra has quit IRC09:42
Tengujangutter: ah. did you get "not sure - in our case (at my job) we use rsyslog in order to send logs away from our rancher environments. it's plugged on the standard docker logging stuff I think, but it's not my part. Only guessing more or less." ? could be the only missing stuff09:43
*** janki has joined #tripleo09:43
Tengudanr09:43
Tengujanki: -^^09:43
*** ramishra has joined #tripleo09:44
jangutterTengu: hehehe, achievement unlocked: generate misclick due to typo-squatting with my real name.09:45
*** abregman has joined #tripleo09:46
*** shreshtha has joined #tripleo09:46
Tengu:D09:47
*** janki has quit IRC09:49
*** janki has joined #tripleo09:49
*** ffiore has quit IRC09:51
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: OvsDpdkSocketMemory MTU Roundup in bytes  https://review.openstack.org/52765510:01
*** fragatina has quit IRC10:06
jankimandre, thats what I was talking about. I have 1 question though10:06
flaper87mandre: jistr why is it that we bind-mount the openstack-puppet-modules instead of installing the package in the base image?10:15
jankimandre, service specific task is to make them log to stdout. rest of the logic is common for all services right10:16
flaper87jistr: ^10:16
flaper87janki: sorry, wrong mention :D10:16
flaper87oh, mmh, now I'm confused. stupid irc client10:17
jankiflaper87, :)10:17
*** ffiore has joined #tripleo10:17
jistrflaper87: i don't recall the reason... is it causing issues?10:27
Tenguflaper87: maybe for a gain of space?10:28
*** gfidente has joined #tripleo10:31
*** gfidente has quit IRC10:31
*** gfidente has joined #tripleo10:31
openstackgerritYurii Prokulevych proposed openstack/tripleo-heat-templates master: Search for containers within stopped containers.  https://review.openstack.org/52708610:34
*** cshastri has quit IRC10:35
flaper87Tengu: that's my guess right now10:35
*** salmankhan has joined #tripleo10:35
flaper87jistr: not causing issues but, thinking ahead to the k8s based deployment and getting rid of bind mounts, I think we could put them there10:36
jistrflaper87: yea we could. I now recall the reason might have been that we wanted artifacts deployment (custom puppet) to keep working w/ containers.10:37
jistrwithout that we'd have to edit the container image when developing on puppet modules10:37
jistrit would be nice to keep that devel hook in some way, but it may have to be different10:38
Tenguflaper87: k8s doesn't like bind mounts? (not knowing that tech for now, unfortunately no time allocated :'()10:38
flaper87Tengu: it does, I don't.10:40
flaper87jokes apart10:40
Tenguhmm, in some cases, bind mounts are useful ;)10:40
flaper87it does support them but it's not ideal because it's supposed to run distributed so, you don't really know where the container is running10:40
Tenguhmm.10:41
flaper87jistr: gotcha, I'll some extra thoughts on this10:41
Tenguand having a shared FS, like gluster?10:41
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent  https://review.openstack.org/50294310:41
flaper87Tengu: that would work only if you have that shared fs and it might be a bit overkill to setup gluster only for this10:41
Tenguflaper87: true. but it might be used for some other things maybe? like glance (although it's already using other available backends)10:42
Tengujust thinking loudly ;)10:42
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: OvsDpdkSocketMemory MTU Roundup in bytes  https://review.openstack.org/52765510:44
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent  https://review.openstack.org/50294310:45
*** janki has quit IRC10:46
*** dtantsur|afk is now known as dtantsur10:48
*** ykarel|away has joined #tripleo10:59
*** ykarel|away is now known as ykarel10:59
*** tosky has joined #tripleo11:00
*** chlong_ has quit IRC11:01
*** rfolco has joined #tripleo11:05
*** pmannidi has quit IRC11:06
*** eck` is now known as eck`gone11:06
*** pmannidi has joined #tripleo11:07
*** udesale__ has quit IRC11:08
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP fix up the rabbitmq-ready check  https://review.openstack.org/52740311:08
*** janki has joined #tripleo11:08
*** anilvenkata has quit IRC11:08
*** pmannidi has quit IRC11:13
jankijbadiapa, hey11:14
*** chlong_ has joined #tripleo11:14
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603011:15
*** dciabrin has quit IRC11:21
*** dciabrin has joined #tripleo11:21
*** jkilpatr has quit IRC11:23
*** chlong_ has quit IRC11:27
*** nyechiel_ has quit IRC11:31
*** nyechiel has joined #tripleo11:31
*** ykarel_ has joined #tripleo11:32
*** ykarel has quit IRC11:32
*** akrivoka has joined #tripleo11:35
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Improve debugging possibilities for docker-puppet.py time handling  https://review.openstack.org/52767311:37
*** salmankhan has quit IRC11:37
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Cleanup dead code  https://review.openstack.org/52767411:38
paramiteis it just me or tripleo-quickstart stopped generating network-environment.yaml file on undercloud?11:40
*** chlong has joined #tripleo11:41
*** ykarel_ is now known as ykarel|travel11:42
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove the overcloudrc v3 generation  https://review.openstack.org/52194211:44
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Remove the overcloudrc.v3 file  https://review.openstack.org/52194111:44
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Create 8GB file on subnodes  https://review.openstack.org/52767511:44
*** morazi has quit IRC11:47
*** ykarel|travel has quit IRC11:48
*** chlong has quit IRC11:48
*** ebarrera has quit IRC11:50
*** salmankhan has joined #tripleo11:51
*** ebarrera has joined #tripleo11:52
*** bogdando has quit IRC11:53
*** jkilpatr has joined #tripleo11:54
*** ffiore has quit IRC11:55
*** janki has quit IRC12:05
*** raildo has joined #tripleo12:07
*** bkopilov has quit IRC12:07
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Create 8GB file on subnodes  https://review.openstack.org/52767512:10
*** chlong has joined #tripleo12:11
*** skramaja_ has joined #tripleo12:18
*** skramaja has quit IRC12:18
*** dpawar has quit IRC12:19
*** chlong has quit IRC12:21
*** skramaja_ has quit IRC12:23
*** skramaja has joined #tripleo12:23
*** ecerquei has joined #tripleo12:24
*** dmacpher has joined #tripleo12:27
*** pdeore has quit IRC12:27
*** chlong has joined #tripleo12:29
openstackgerritMerged openstack/instack-undercloud stable/pike: Set nova dhcp_domain to empty string  https://review.openstack.org/52632312:30
openstackgerritMerged openstack/instack-undercloud master: Set default_resource_class to baremetal  https://review.openstack.org/52607212:30
openstackgerritMerged openstack/tripleo-puppet-elements master: Update test-requirements to work with reno  https://review.openstack.org/52751812:30
*** janki has joined #tripleo12:31
*** aufi has quit IRC12:31
*** aufi has joined #tripleo12:31
*** psahoo has quit IRC12:33
Tenguanyone "fluent" with the mongoDB setup by tripleo?12:34
*** lucasagomes is now known as lucas-hungry12:35
*** morazi has joined #tripleo12:36
*** chlong has quit IRC12:36
*** chlong has joined #tripleo12:37
*** morazi has quit IRC12:39
*** morazi has joined #tripleo12:43
*** chlong has quit IRC12:45
*** dmellado has quit IRC12:47
*** BryanS68 has joined #tripleo12:47
*** ecerquei has quit IRC12:48
*** tosky has quit IRC12:48
*** ecerquei has joined #tripleo12:49
openstackgerritLuke Hinds proposed openstack/puppet-tripleo master: Implements AIDE Intrusion Detection System  https://review.openstack.org/48302512:49
*** aufi_ has joined #tripleo12:51
*** jpena is now known as jpena|lunch12:53
*** aufi has quit IRC12:53
*** ratailor has quit IRC12:54
*** jcoufal has joined #tripleo12:55
*** aputtur_ has joined #tripleo12:57
*** atoth has joined #tripleo12:58
*** udesale has joined #tripleo12:58
*** dmellado has joined #tripleo12:58
EmilienMmoshele: ack12:59
flaper87jistr: hey, how's the PR on o-a going?12:59
flaper87Can I haz link again?12:59
mosheleEmilienM: thanks12:59
openstackgerritMerged openstack/puppet-tripleo master: Update cephx keys with ACLs for openstack services.  https://review.openstack.org/51953113:01
openstackgerritMerged openstack/tripleo-quickstart-extras master: Updated tempest_version to 17.1.0 for Pike and 16.1.0 for ocata  https://review.openstack.org/51930513:01
openstackgerritMerged openstack/instack-undercloud master: Run nova online data migration before updating packages  https://review.openstack.org/52667513:01
*** amoralej is now known as amoralej|lunch13:01
*** dpawar has joined #tripleo13:02
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for OVN Metadata Agent  https://review.openstack.org/50294313:03
*** rcernin has quit IRC13:04
*** nyechiel has quit IRC13:05
jistrflaper87: https://github.com/openshift/openshift-ansible/pull/644313:05
*** nyechiel has joined #tripleo13:05
jistrflaper87: got pulled into a pike bug so i haven't done anything CoE related today13:05
*** lblanchard has joined #tripleo13:05
flaper87jistr: it's alright! Just wanted to take a look at the PR again13:06
TenguEmilienM: already up n'running?13:07
*** dmellado has quit IRC13:08
*** skramaja has quit IRC13:08
*** dmellado has joined #tripleo13:09
EmilienMTengu: yup13:09
Tenguare you a machine? :)13:09
*** dprince has joined #tripleo13:09
*** thrash|g0ne is now known as thrash13:09
EmilienMTengu: I'm a bot. What's your questioN?13:09
TenguXD13:09
EmilienM(the typo make it unreal now...)13:10
Tengu(indeed ;))13:10
*** tosky has joined #tripleo13:10
TenguEmilienM: as you're here, care to (re) validate my reviews (for the last time I hope)? I had some issues with the release note format. https://review.openstack.org/526292 https://review.openstack.org/52658913:11
*** trown|outtypewww is now known as trown13:13
*** rhallisey has joined #tripleo13:13
flaper87slagle: hey, when you have some time, we've removed the restart of the network service and the messing with NetworkManager-dispatch in the patch but kept the install/enable of network manager.13:13
flaper87slagle: https://review.openstack.org/#/c/494470/34/extraconfig/services/openshift-master.yaml13:13
flaper87slagle: the reason is mostly because without those 2 tasks, the patch simply won't work. We could move it to oooq but then, you would need to run the featureset for it to work13:14
flaper87slagle: as I pointed out in the comment above the tasks, I'm hoping we'll be able to get rid of these steps soon by just consuming the bits from openshift-ansible13:15
flaper87slagle: let me know what you think13:15
slagleflaper87: ok. i'll have another look13:15
flaper87slagle: thanks! If you still feel we should get rid of the install/enable steps, I will do it13:15
*** dprince has quit IRC13:15
flaper87jistr: ^ FYI13:15
*** dprince has joined #tripleo13:16
TenguEmilienM: thanks :).13:18
*** jlabarre has quit IRC13:19
*** BryanS68 has quit IRC13:20
*** BryanS68 has joined #tripleo13:24
*** liverpooler has joined #tripleo13:26
*** nyechiel_ has joined #tripleo13:27
*** nyechiel has quit IRC13:27
thrashcan I get another +2 here? https://review.openstack.org/#/c/518030/13:29
slaglehow about a -1 ;)13:30
slagleheh, i won't13:30
slaglethrash: but did you consider if you don't deploy horizon?13:30
*** shreshtha has quit IRC13:30
*** lucas-hungry is now known as lucasagomes13:30
thrashslagle: sort of... :P It will just be blank. D13:30
slagleyea i figured. a bit odd13:31
thrashslagle: sure.13:31
thrashslagle: I can fix that real quick.13:31
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud  https://review.openstack.org/50819513:31
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia to scenario002 (containers only)  https://review.openstack.org/51833113:31
*** pgadiya has quit IRC13:32
*** adarazs has quit IRC13:33
*** rbrady has joined #tripleo13:34
*** rbrady has quit IRC13:34
*** rbrady has joined #tripleo13:34
*** pdeore has joined #tripleo13:35
thrashslagle: yeah... Gonna add some better tests. :D13:36
*** dprince has quit IRC13:37
Tenguslagle: heya! may I ask you a couple of minutes for two small reviews? https://review.openstack.org/526292 https://review.openstack.org/526589  - they are both allowing to get proper unit tests for two resources in puppet-tripleo :)13:37
Tenguslagle: I'm not sure you're (one of) the right people to ask13:38
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Passes NodeDataLookup to ceph-ansible workflow  https://review.openstack.org/52607313:38
*** chlong has joined #tripleo13:39
*** pchavva has joined #tripleo13:39
*** ansmith has joined #tripleo13:41
*** ebarrera_ has joined #tripleo13:41
*** dprince has joined #tripleo13:46
*** ecerquei has quit IRC13:46
*** ecerquei has joined #tripleo13:47
*** rlandy has joined #tripleo13:47
*** stevebaker has quit IRC13:47
*** ebarrera_ has quit IRC13:49
*** noslzzp has joined #tripleo13:50
*** tesseract has quit IRC13:51
*** akane has joined #tripleo13:52
*** mdnadeem_ has joined #tripleo13:56
*** ecerquei_ has joined #tripleo13:57
*** stevebaker has joined #tripleo13:57
*** mdnadeem has quit IRC13:58
*** jpena|lunch is now known as jpena13:58
slagleTengu: puppet is not my specialty, but I'll take a look :)13:58
*** links has quit IRC13:58
Tenguslagle: np, wasn't sure :). thanks for your time13:59
*** ecerquei has quit IRC13:59
*** links has joined #tripleo14:00
EmilienMslagle: I thought you were an expert.14:00
slagleEmilienM: I am.14:00
slagleaccording to my stackoverflow score. zing!14:01
Tengu14:01
slagleI'm the #1 copy/paster from stackoverflow14:01
*** Goneri has joined #tripleo14:01
*** Goneri has quit IRC14:02
*** dprince has quit IRC14:02
*** agurenko has quit IRC14:02
EmilienMlol14:03
*** Goneri has joined #tripleo14:04
*** links has quit IRC14:05
*** BryanS68 has quit IRC14:06
*** BryanS68 has joined #tripleo14:07
*** cdearborn has joined #tripleo14:07
*** amoralej|lunch is now known as amoralej14:07
*** tzumainn has joined #tripleo14:07
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756114:08
Tenguthat said... I also did some copy&paste for the unit tests ;).14:10
*** cdearborn has quit IRC14:11
*** dtrainor has quit IRC14:12
*** dtrainor has joined #tripleo14:12
*** aufi_ has quit IRC14:14
*** aufi has joined #tripleo14:15
*** aufi has quit IRC14:16
*** jaganathan has quit IRC14:16
*** akane__ has joined #tripleo14:16
*** akane_ has joined #tripleo14:16
*** aufi has joined #tripleo14:16
*** bogdando has joined #tripleo14:16
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Improve debugging possibilities for docker-puppet.py time handling  https://review.openstack.org/52767314:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/pike: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52647314:20
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Push the config container outside of heat stack update  https://review.openstack.org/52769214:21
openstackgerritSergii Golovatiuk proposed openstack/instack-undercloud master: Restore OVSIntPort interfaces after OVS restarts  https://review.openstack.org/52744814:21
chemmatbu: can we merge https://review.openstack.org/#/c/526830/ ?14:21
matbuchem: yep14:23
matbudone14:23
chemmatbu:thanks14:23
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Fix Redis TLS setup and its HA deployment  https://review.openstack.org/52769414:23
*** jmelvin has joined #tripleo14:26
*** jlabarre has joined #tripleo14:27
*** chlong has quit IRC14:27
*** aufi has quit IRC14:30
*** eck`gone is now known as eck`14:31
dalvarezEmilienM, ping re. https://review.openstack.org/#/c/527482  you suggest to include only "::neutron" right? and not sure if i understood you want me to move ovn_metadata class somewhere else? I tried to do the same as neutron metadata does14:32
EmilienMdalvarez: I'm curious why we don't include base profile in this class14:33
EmilienMneutron base profile should be included in all neutron profiles, right?14:33
EmilienMat least that's how we started this thing14:33
dalvarezEmilienM, i'm only interested in the logging part though but yeah i think it's fair14:33
dalvarezright14:33
EmilienMyeah but why not deploying logging for all other neutron profiles?14:33
dalvarezEmilienM, because initially i wasnt going to use neutron.conf in my configuration then i realized that my service wasn't logging into /var/log/neutron14:34
dalvarezEmilienM, all of the options I need in ovn metadata agent are self included in the agent configuration itself so beyond logging options i dont need anything else14:35
dalvarezbut it makes sense to include it though14:35
EmilienMdalvarez: i don't know, maybe I'm wrong. Maybe we can ask mwhahaha to also take a look14:35
*** openstackstatus has quit IRC14:36
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Add ovs hardware Offload support to ovs mechansim driver  https://review.openstack.org/50740114:36
*** dprince has joined #tripleo14:36
dalvarezEmilienM, i mean.. it doesn't hurt i guess so i could do it if for clarity14:36
dalvarezEmilienM, that will end up including ::neutron::logging so it's fine14:38
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Add ovs hardware Offload support to ovs mechansim driver  https://review.openstack.org/50740114:38
*** openstack has quit IRC14:39
*** openstack has joined #tripleo14:40
*** ChanServ sets mode: +o openstack14:40
openstackgerritDaniel Alvarez proposed openstack/puppet-tripleo master: Add neutron base profile to OVN metadata agent  https://review.openstack.org/52748214:41
*** aufi has joined #tripleo14:42
*** openstack has quit IRC14:43
*** openstack has joined #tripleo14:45
*** ChanServ sets mode: +o openstack14:45
*** openstackstatus has joined #tripleo14:45
*** ChanServ sets mode: +v openstackstatus14:45
mwhahahahappy wednesday or something14:48
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates stable/ocata: Revert "Add upgrade task to run gnocchi upgrade"  https://review.openstack.org/52770214:50
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates stable/pike: Revert "Add upgrade task to run gnocchi upgrade"  https://review.openstack.org/52770314:50
EmilienMor something14:51
dtantsurplease tell me something == Friday14:51
openstackgerritMehdi Abaakouk (sileht) proposed openstack/tripleo-heat-templates master: Revert "Add upgrade task to run gnocchi upgrade"  https://review.openstack.org/52770514:53
*** pchavva has joined #tripleo14:55
d0ugalrbrady,d0ugal,apetrich,thrash,toure,jpich,jtomasek: Workflow squad meeting in 5 mins if you want to join. https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:55
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Add ovs hardware Offload support to ovs mechansim driver  https://review.openstack.org/50740114:56
*** pdeore has quit IRC14:57
*** pdeore has joined #tripleo14:58
*** ecerquei_ has quit IRC14:59
*** ecerquei has joined #tripleo15:00
openstackgerritDaniel Alvarez proposed openstack/tripleo-common master: Add OVN Metadata Agent to containerized environments  https://review.openstack.org/52518215:01
rbradyd0ugal: having bluejeans issues15:01
*** janki has quit IRC15:04
d0ugalrbrady: k15:05
*** yamahata has joined #tripleo15:06
*** udesale has quit IRC15:07
openstackgerritAdriano Petrich proposed openstack/tripleo-common master: Validate parameters before updating  https://review.openstack.org/51124915:07
akaneHi15:08
akanemy overcloud deploy is stuck in step 3 for couple of hours now.15:08
akanetried to dig further. Looks like keystone process is waiting in a qeue http://paste.openstack.org/show/628858/15:09
*** nyechiel has joined #tripleo15:09
akanehow can i restore the stack?15:09
*** nyechiel_ has quit IRC15:09
openstackgerritMehdi Abaakouk (sileht) proposed openstack/puppet-tripleo master: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52770915:10
*** ebarrera has quit IRC15:10
rookEmilienM mwhahaha fultonj so, new fun issue at scale. ansible-playbook seems to consume all the free memory on the undercloud :(15:10
rookhttps://gist.github.com/jtaleric/0bc90b4203a88b340b581807580a0f0b15:10
*** ebarrera has joined #tripleo15:10
mwhahahaHEH15:11
mwhahahaWho needs free memory15:11
mwhahahasdoran: -^15:11
fultonjrook: try lowering the fork count15:12
fultonjthat's a nice one :) by the way15:12
*** bkopilov has joined #tripleo15:12
EmilienMouch bad15:12
fultonjrook: let me show you the relevant line15:12
rookfultonj: we did.15:12
fultonjrook: what did you set the fork count to?15:13
rookWe applied the patch that was supplied yesterday15:13
rookI think Dave went with # of nodes, which is < 10015:13
rooklet me check15:13
fultonj(just to clarify i agree it's bad, was just saying i hadn't see local ansible run out of memory)15:13
fultonjrook: yes, exactly15:14
fultonji talked to dave he lowered max forkcount to 5015:14
fultonjthe patch yesterday, should already be in15:14
*** salmankhan has quit IRC15:14
fultonjrook: https://github.com/openstack/tripleo-common/blob/master/workbooks/ceph-ansible.yaml#L5515:15
*** radeks has quit IRC15:15
fultonjit's set for maximum concurency15:15
fultonjcount(ceph nodes) up to 10015:15
fultonjso set it accordingly15:16
fultonjcount(ceph nodes) up to N15:16
fultonjyesterday dave set it to 50 he said 50 had worked15:16
*** lvdombrkr has joined #tripleo15:16
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adds environment file for ODL OVS Hardware Offload  https://review.openstack.org/51871515:17
*** tongl has joined #tripleo15:17
rookfultonj: i tihnk the problem is, it has to touch ceph nodes + computes15:18
rooknot just ceph nodes15:18
rookfultonj we might want to consider setting better defaults.15:18
rookThis host as 64GB of RAM...15:18
fultonjrook: it has to configure computes in order to put the ceph key there15:18
*** links has joined #tripleo15:18
rookthis is like heat-engine all over again.15:18
openstackgerritwaleed mousa proposed openstack/tripleo-heat-templates master: Adds environment file for ODL OVS Hardware Offload  https://review.openstack.org/51871515:18
fultonjrook: happy to adjust the defaults15:19
rookRight fultonj, which will fork yet another ansible-playbook15:19
fultonjright15:19
fultonjwhcih i think is the root cause15:19
rookright15:19
fultonjso we limit how many forks15:19
fultonjas informed by your scale testing15:19
rookI am not sure what is a sane fork15:19
rooklimit.15:19
fultonji'll start a patch to make it easier to update15:19
rookSince people are deploying virt underclouds15:19
rookwhich, ugh15:19
fultonjrook: yeah15:20
fultonjif we had a formula that would be cool :)15:20
fultonjbut for now, let's find a new default15:20
rookright.15:20
fultonji had talked to seb and this was the original formula we came up with to speed up deploys15:21
* mwhahaha puts his finger in the air to check wind speed and picks the new default: 715:21
fultonj:)15:21
rookmwhahaha: sounds good15:21
rookship it15:21
EmilienMlol15:21
rookthat is how all defaults are set.15:21
EmilienMmake sure to reflect that in release note15:21
rooklol15:21
EmilienM"wind in Denver was 7 knots that day"15:21
rookhahaha15:21
fultonjcan't wait to see that in the weekly owl15:22
EmilienMchallenge accepted15:22
fultonj:)15:22
fultonjrook: so as a next step...15:22
fultonjrook: i assume you'll try a new default 6 < X < 50 to get the issue worked around15:23
rooklooking at the logic currently in place.15:23
*** masco has quit IRC15:26
rookfultonj: i was going to say 6 < X < 2515:26
*** moshele has quit IRC15:26
rookbut sure, we can try 5015:26
fultonjrook:  i thought dave set 50 yesterday and hit the issue15:27
rooki wonder if # of OSDs creates more memory utilization15:27
rookyeah15:27
gfidenterook curiosity, how much nodes are you configuring and how much memory you have on the undercloud?15:27
openstackgerritMehdi Abaakouk (sileht) proposed openstack/puppet-tripleo master: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52770915:27
rookgfidente: 64GB of RAM on the UC.15:27
rookgfidente < 100 nodes...15:27
rookI think it was 64 nodes15:27
gfidenterook and ansible is consuming all of it?15:27
rookgfidente obviously not all of it, but a very large portion. I am adding monitoring to track the ansible-playbook processes.15:28
*** nyechiel has quit IRC15:28
fultonjrook: my guess is 25 but 10 should get you through, just slower15:28
*** dprince has quit IRC15:29
rookfultonj again, mwhahaha finger in the air15:29
rookbut yeah15:29
rooklets try to get some better data15:29
*** BryanS68 has quit IRC15:29
rookI want to add some monitoring, mabye we can identify how much each ansible-playbook process is consuming.15:29
fultonjyeah i know, i'm guessing i am just using binary search 100:no, 50:no, 25:?15:29
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Move step 1 preparation to deploy-steps-tasks.yaml  https://review.openstack.org/52526015:29
rookfultonj: yeah, same.15:29
*** dprince has joined #tripleo15:32
fultonjrook: i'll make a bug to track this15:33
rooksure15:33
rookill add some monitoring15:33
*** bogdando has quit IRC15:33
*** shreshtha has joined #tripleo15:34
*** shreshtha has quit IRC15:34
*** shreshtha has joined #tripleo15:35
slagleweshay: hi, do we not get overcloud node logs in case of an ovb timeout?15:36
slagleweshay: e.g., http://logs.openstack.org/31/525331/10/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/2e40088/15:36
d0ugalmwhahaha: if you get a moment can you look at comment 8 here? https://bugs.launchpad.net/tripleo/+bug/173071215:36
openstackLaunchpad bug 1730712 in tripleo "tripleo should not query overcloud if never deployed to prevent extraneous error messages in swift/mistral" [Medium,Triaged] - Assigned to Toure Dunnon (toure)15:36
d0ugaltoure: ^ fyi15:36
* weshay looks15:36
slagleweshay: the job timed out, but I see no overcloud-* logs, so i can see what was taking so long on those nodes15:36
weshaylooks15:37
openstackgerritMichael Bayer proposed openstack/tripleo-quickstart-extras master: Add Nova max_concurrent_builds to undercloud conf  https://review.openstack.org/52771815:37
*** ramishra has quit IRC15:37
*** dpawar has quit IRC15:37
weshaywe do set aside 10min in the job to collect logs and usually it only takes 4min fyi.. but looking slagle15:38
arxcruzALL: we are going to have TripleO CI Communit meeting now, if anyone is interested, please join https://bluejeans.com/707186672815:39
*** fzdarsky has joined #tripleo15:39
weshayslagle, in this case it looks like either the overcloud nodes were not reachable or did not get inventoried15:39
weshayhttp://logs.openstack.org/31/525331/10/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/2e40088/logs/quickstart_collect_logs.txt.gz15:39
weshayit took 6min to collect15:40
slagleweshay: hmm, ok15:40
silehtmwhahaha, can you revisit: https://review.openstack.org/#/c/527709/15:41
*** yamahata has quit IRC15:43
EmilienMarxcruz: in 15min right?15:45
arxcruzEmilienM: nope, right now :)15:45
arxcruzit's happening15:45
arxcruzEmilienM: https://bluejeans.com/707186672815:45
EmilienMarxcruz: oops15:45
EmilienMarxcruz: when did it start?15:46
arxcruzEmilienM: 5 minutes ago15:46
EmilienMok15:46
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: WIP: Convert tags to when statements for Q major upgrade workflow  https://review.openstack.org/51090215:46
toured0ugal thansk15:46
*** salmankhan has joined #tripleo15:47
openstackgerritMerged openstack/tripleo-quickstart-extras master: Sudo fix overcloud-custom-tht-script.sh.j2  https://review.openstack.org/49901815:47
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing keystone_domain_config  https://review.openstack.org/52748515:47
openstackgerritMerged openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB  https://review.openstack.org/51350815:47
*** jtomasek has quit IRC15:47
*** brault has joined #tripleo15:49
*** udesale has joined #tripleo15:51
*** udesale has quit IRC15:51
openstackgerritSven Anderson proposed openstack/tripleo-quickstart master: TEST DON'T MERGE - Enabling EC2-API Tempest tests.  https://review.openstack.org/51513915:52
mwhahahad0ugal: yea so the problem is the fact that shows up as an error is miss leading15:53
mwhahahad0ugal: if it's expected it shouldn't be a giant ERROR15:53
d0ugalmwhahaha: yeah, I guess, that is just how it works in Mistral. So we might need to do some work there to improve things15:53
mwhahahad0ugal: yea it's a UX thing because it can be misleading to the end user who goes and looks for ERROR to find this and doesn't know that's how mistral works15:54
mwhahahaand starts debugging swift15:54
d0ugalmwhahaha: right15:54
d0ugalmwhahaha: I added an idea for a potential work around to the bug15:55
d0ugalcomment 915:55
mwhahahad0ugal: ok i'll refresh15:55
d0ugaltoure: ^ not sure if you want to work on it still15:55
d0ugalbbiab15:55
toured0ugal ack15:55
mwhahahaor maybe lower the exception to a warning for this one?15:57
* mwhahaha isn't sure how mistral actions wrap service stuff15:57
touremwhahaha I think that is fair as there are scenarios which warrant an Error15:58
mwhahahatrue15:58
*** udesale has joined #tripleo15:58
*** abregman has quit IRC15:58
mwhahahawe've been screwed by the container existence (or lack there of) stuff in swift before15:59
* mwhahaha points to heat 15:59
d0ugalmwhahaha: it just wraps the clients, so swiftclient raises an exception in this case15:59
mwhahahayea15:59
mwhahahai googled :D15:59
d0ugalah :)15:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260716:00
d0ugalThe problem is, there is no way to tell mistral "if this error happens, don't log it, I got it"16:00
d0ugalso it logs all errors, despite if it is handled or not16:00
*** bogdando has joined #tripleo16:00
d0ugalanyway, we can work around it and improve it in mistral later. toure if you don't have time to do the update I can tomorrow16:00
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Add the possibility to provide a custom UpgradeInitCommand.  https://review.openstack.org/52743516:01
d0ugalright, going for a run. bbiab really this time.16:01
toured0ugal I will place an update inthe bug16:01
toureenjoy the run16:01
*** dprince has quit IRC16:01
*** dprince has joined #tripleo16:01
*** dpawar has joined #tripleo16:01
*** udesale has quit IRC16:01
*** suuuper has quit IRC16:02
*** jtomasek has joined #tripleo16:02
*** dciabrin has quit IRC16:04
*** dsariel has quit IRC16:06
*** sc has quit IRC16:08
openstackgerritLuke Hinds proposed openstack/puppet-tripleo master: Implements AIDE Intrusion Detection System  https://review.openstack.org/48302516:08
*** dsariel has joined #tripleo16:09
openstackgerritMerged openstack/tripleo-quickstart-extras master: Enable mistral on the undercloud by default  https://review.openstack.org/52713216:10
openstackgerritMerged openstack/tripleo-common master: DPDK derive params network config validation  https://review.openstack.org/48836216:10
*** maeca has joined #tripleo16:10
*** maeca has quit IRC16:10
*** dsariel has quit IRC16:13
*** sshnaidm|ruck has quit IRC16:17
*** ebarrera has quit IRC16:18
*** shreshtha has quit IRC16:19
*** sshnaidm has joined #tripleo16:21
*** trown is now known as trown|brb16:21
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud  https://review.openstack.org/50819516:22
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia to scenario002 (containers only)  https://review.openstack.org/51833116:23
slagleweshay: fyi, https://bugs.launchpad.net/tripleo/+bug/173803816:24
openstackLaunchpad bug 1738038 in tripleo "ci: ovb jobs killed by timeout during overcloud-deploy do not have overcloud node logs" [High,Triaged]16:24
*** trown|brb is now known as trown16:26
*** dpawar has quit IRC16:27
*** dhill_ has quit IRC16:27
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756116:27
*** dhill_ has joined #tripleo16:28
*** tvignaud has quit IRC16:28
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data  https://review.openstack.org/52560316:29
*** dprince has quit IRC16:30
*** rbrady has quit IRC16:31
*** artom has quit IRC16:31
*** ukalifon has quit IRC16:32
*** moshele has joined #tripleo16:36
*** pdeore has quit IRC16:36
*** dparkes has quit IRC16:39
*** akane_ has quit IRC16:41
*** akane__ has quit IRC16:41
*** BryanS68 has joined #tripleo16:43
*** akane has quit IRC16:44
*** tosky has quit IRC16:48
*** moshele has quit IRC16:49
*** fragatina has joined #tripleo16:49
*** tongl has quit IRC16:49
*** bogdando has quit IRC16:51
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: add recreate pointer to ci readme  https://review.openstack.org/52752916:51
ansiwenmwhahaha: I'd like to try to land this still in queens, since it has been punted for ages: https://blueprints.launchpad.net/tripleo/+spec/tripleo-realtime16:55
*** pblaho has quit IRC16:55
openstackgerritSergii Golovatiuk proposed openstack/instack-undercloud master: Restore OVSIntPort interfaces after OVS restarts  https://review.openstack.org/52744816:56
ansiwenmwhahaha: however I depend on the ironic-ansible-driver which just merged two weeks ago and has still some "rough edges" as Dmitry said. Is it possible to do an best effort approach here?16:56
*** marios has quit IRC16:58
mwhahahaansiwen: it's something that would be off by default right?16:58
mwhahahaansiwen: does it require any intrusive changes?16:58
ansiwenmwhahaha: I'm not confident to say that with 100% confidence, but it is a new seperate compute-node role, that is only used, if realtime deployment is required. so yes, I think it is completely additional.17:00
ansiwenmwhahaha: and off by default.17:00
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Migrate to the new Mistral context class  https://review.openstack.org/50618617:01
*** absubram has joined #tripleo17:01
ansiwenmwhahaha: I would like to try to implement this until M3, because people are waiting for this since a long time apparently17:01
mwhahahaansiwen: ok i'll move it back, but let me know if it's going to slip17:01
ansiwenmwhahaha: sure, I'll keep you posted17:02
ansiwenmwhahaha: do I have to write a formal FFE application for that? (sorry, I'm always confused with the deadlines)17:02
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: dump out all the variables used  https://review.openstack.org/52613817:03
mwhahahaansiwen: so i'll update the BP with the details, it would be a good idea to write up the summary of this conversation and reply to my thread aroundit17:03
*** hjensas has quit IRC17:03
mwhahahaansiwen: basically, that it's a additive functionality that is off by default and should have minimal impact to existing functionality17:04
ansiwenmwhahaha: alright, thanks!17:04
*** brault has quit IRC17:04
*** absubram has quit IRC17:06
*** tvignaud has joined #tripleo17:07
*** jkilpatr has quit IRC17:07
ansiwenmwhahaha: with thread you mean email thread or on launchpad?17:08
*** absubram has joined #tripleo17:09
ansiwenmwhahaha: ok, email "[openstack-dev] [tripleo] Blueprints moved out to Rocky"... got it... :-)17:10
mwhahahayea that one17:12
*** tvignaud has quit IRC17:14
*** jpich has quit IRC17:15
openstackgerritMartin André proposed openstack/tripleo-docs master: Get rid of ugly FIXME  https://review.openstack.org/52774617:15
*** tvignaud has joined #tripleo17:17
*** tongl has joined #tripleo17:19
*** etingof has quit IRC17:21
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert bind IPs to hiera interpolation  https://review.openstack.org/52669217:21
*** iranzo has quit IRC17:22
*** thrash is now known as thrash|biab17:23
*** jkilpatr has joined #tripleo17:23
*** etingof has joined #tripleo17:24
*** jpena is now known as jpena|brb17:24
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756117:29
*** iranzo has joined #tripleo17:31
*** iranzo has quit IRC17:31
*** iranzo has joined #tripleo17:31
EmilienMslagle: thanks for your comment on https://review.openstack.org/#/c/526808/14/extraconfig/services/rhsm.yaml - can you look my question please?17:32
*** florianf has quit IRC17:33
*** raildo has quit IRC17:35
*** iranzo has quit IRC17:36
*** dsneddon has joined #tripleo17:36
*** jkilpatr has quit IRC17:38
*** dtantsur is now known as dtantsur|afk17:39
*** yprokule has quit IRC17:39
*** links has quit IRC17:40
*** absubram has quit IRC17:40
*** iranzo has joined #tripleo17:42
*** iranzo has joined #tripleo17:42
*** gfidente has quit IRC17:43
*** jpena|brb is now known as jpena17:43
*** raildo has joined #tripleo17:45
*** ebarrera has joined #tripleo17:45
*** rmascena has joined #tripleo17:46
*** holser has quit IRC17:50
*** raildo has quit IRC17:51
*** jkilpatr has joined #tripleo17:52
*** ebarrera_ has joined #tripleo17:54
*** mdnadeem_ has quit IRC17:54
*** abregman has joined #tripleo17:55
*** ecerquei_ has joined #tripleo17:59
*** lucasagomes is now known as lucas-afk18:00
*** hjensas has joined #tripleo18:00
*** hjensas has quit IRC18:00
*** hjensas has joined #tripleo18:00
*** ebarrera_ has quit IRC18:02
*** ecerquei has quit IRC18:02
*** derekh has quit IRC18:04
*** Goneri has quit IRC18:05
*** dsneddon has quit IRC18:08
Tengumwhahaha: hello! I finally got it right for the release note and other concerns - care to review those two so that we can get proper unit tests? :) https://review.openstack.org/#/c/526292/ https://review.openstack.org/#/c/526589/ thanks!18:10
rookaight fultonj so, watching the memory utilization18:10
rookwe are already at 5GB RSS18:10
rookfor just ansible18:10
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756118:10
rookthat is pretty concerning.18:11
rookbecause forks is so low :-/18:11
rookany of the ceph Ci jobs hit OOM?18:11
fultonjrook: no18:11
fultonji havent' seen ceph ci jobs oom18:11
rookinteresting...18:11
rookhow many compute and ceph nodes are in these jobs?18:12
fultonj118:12
rooklol18:12
rookalright18:12
fultonjit's ci18:12
*** rlandy is now known as rlandy|rover18:13
rooknoted.18:13
fultonjso this is a run with the fork count set to 5 which is the ceph-ansible default?18:13
mwhahahaTengu: sure18:13
fultonji had a conversation w/ dave and assume you're using the same system18:14
rookyup fultonj18:14
rooksame setup18:14
*** trown is now known as trown|lunch18:14
rooki sent you a link to the dashboard18:14
rookto monitor18:14
rookor see18:14
fultonjyes, i'm watching it18:14
fultonjnice dashboard18:14
*** jtomasek has quit IRC18:15
*** aditya_r has joined #tripleo18:17
*** myoung|rover is now known as myoung18:18
*** jfrancoa has quit IRC18:19
Tengumwhahaha: thanks! lemme know if you find something that doesn't suite the guidelines.18:20
Tenguapparently it's ok :)18:20
mwhahahayup18:21
*** dsneddon has joined #tripleo18:22
Tenguthank you :). Once it's merged, especially the one for haproxy, I'll be able to finish the basic auth support on haproxy endpoint.18:23
Tenguthat one will be useful when we want to proxy some other services behind haproxy, like a prometheus exporter :).18:24
*** chlong has joined #tripleo18:25
*** nyechiel has joined #tripleo18:26
*** aditya_ra has joined #tripleo18:38
openstackgerritCarol Bouchard proposed openstack/tripleo-heat-templates master: Latest Nexus Configuration Variables Updates  https://review.openstack.org/52750818:38
rooklol fultonj 8GB -- nuts.18:38
*** aditya_r has quit IRC18:38
*** abregman is now known as abregman|afk18:39
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756118:40
*** dprince has joined #tripleo18:41
EmilienMfultonj: good news, we probably fixed puppet-ceph/jewel gate, so we'll be able to land https://review.openstack.org/#/c/518325/ today.18:43
fultonjEmilienM: awesome, thanks18:43
*** Goneri has joined #tripleo18:43
*** abregman|afk is now known as abregman18:44
*** catintheroof has joined #tripleo18:44
rookfultonj: i wonder if it is due to these long running playbooks?18:44
rookallocating memory each execution of a play, and never reclaiming.18:45
Tenguerf -.-18:45
Tengumwhahaha: apparently: merge conflict on gate -.-18:45
rookI wonder if others have seen this with ceph-ansible fultonj18:45
fultonjrook: or with ansible.18:46
rookfultonj: when i say ceph-ansible, i really mean ansible, or the way ceph-ansible is structured.18:46
fultonji know bene used ceph-ansible in the scale lab to deploy big ceph clusters18:47
fultonjit's been around18:47
openstackgerritHarry Rybacki proposed openstack/tripleo-heat-templates stable/pike: Add missing keystone_domain_config  https://review.openstack.org/52775818:47
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52775918:47
*** ecerquei_ has quit IRC18:48
fultonji talked to him about this fork count in summer (looking for an old email)18:48
*** iranzo has quit IRC18:48
Tenguo_O wtf… no conflict when rebasing against master....18:48
rooki wonder if he even considered looking18:48
*** jpena is now known as jpena|off18:49
openstackgerritMehdi Abaakouk (sileht) proposed openstack/puppet-tripleo stable/pike: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52775918:49
openstackgerritMehdi Abaakouk (sileht) proposed openstack/puppet-tripleo stable/ocata: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52776018:49
*** Goneri has quit IRC18:50
fultonjrook: i am forwarding you and dave the thread18:50
*** tvignaud has quit IRC18:50
*** Goneri has joined #tripleo18:50
fultonj"practices tend to say we should have one fork for each machine"18:51
fultonjwhich is how we got here18:51
openstackgerritSteve Linabery proposed openstack/puppet-tripleo stable/ocata: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52776018:51
fultonj"best practices"18:51
*** rfolco has quit IRC18:51
rookfultonj: ok18:52
rookfultonj I am asking upstream ansible on how to instrument ansible a bit more18:52
rookmaybe we can identify something18:52
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756118:53
openstackgerritMerged openstack/tripleo-quickstart-extras master: Always use overcloudrc, it is now v3 by default  https://review.openstack.org/52339318:54
openstackgerritMerged openstack/instack-undercloud master: Remove usage of ironic::drivers::ipmi::retry_timeout  https://review.openstack.org/52521418:54
openstackgerritMerged openstack/puppet-tripleo master: Add support for switchdev mode in SR-IOV  https://review.openstack.org/50710018:54
*** dsneddon has quit IRC18:55
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/ocata: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52776018:57
*** aufi has quit IRC18:58
EmilienMSlower: hey, we still have the problem with upgrades on https://review.openstack.org/#/c/526151/ - any idea what to do?18:58
*** dougbtv_ has quit IRC19:02
*** dhill__ has joined #tripleo19:02
*** atoth has quit IRC19:03
*** dhill_ has quit IRC19:03
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756119:04
*** chlong has quit IRC19:06
rookfultonj: https://github.com/ansible/ansible/issues/3167319:08
fultonjansible-2.4.1.0-1.el7ae.noarch19:09
rookyup 2.4.1 has another bug19:09
rookhttps://github.com/ansible/ansible/issues/3285419:09
openstackgerritMerged openstack/tripleo-heat-templates master: Memory channels parameter default value  https://review.openstack.org/52335819:10
openstackgerritMerged openstack/tripleo-validations master: Explicitly set default to 0 for quiet argument in validate-files script  https://review.openstack.org/51338619:10
fultonjnice find19:10
*** trown|lunch is now known as trown19:10
*** trown is now known as trown|ruck19:12
*** dsneddon has joined #tripleo19:13
*** salmankhan has quit IRC19:14
*** artom has joined #tripleo19:14
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756119:15
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756119:16
*** chlong has joined #tripleo19:18
mwhahahaTengu: hmm odd oh well19:19
*** aditya_ra has quit IRC19:20
*** abregman is now known as abregman|afk19:20
openstackgerritMerged openstack/tripleo-quickstart-extras master: Make sure we don’t use delorean-current for release != master.  https://review.openstack.org/52683019:22
openstackgerritMerged openstack/tripleo-common master: Correct the container name confusion in the swift rings workflow  https://review.openstack.org/52646219:22
aleeEmilienM, https://review.openstack.org/#/c/526514/ please19:22
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756119:23
*** eck` is now known as eck`gone19:23
EmilienMalee: done19:23
aleeEmilienM, thanks19:24
*** ecerquei has joined #tripleo19:24
*** Goneri has quit IRC19:24
aleeEmilienM, mwhahaha https://review.openstack.org/527512 please19:25
*** absubram has joined #tripleo19:25
*** mgkwill_ is now known as mgkwill19:25
EmilienMalee: oh nice19:26
aleeEmilienM, yup19:26
*** openstackstatus has quit IRC19:27
openstackgerritMerged openstack/tripleo-heat-templates master: Set restrictive file permissions on Ceph keyrings for non-containerized deployment  https://review.openstack.org/50902019:28
openstackgerritMerged openstack/tripleo-upgrade master: Add the option to remove packages during upgrade  https://review.openstack.org/52743019:28
openstackgerritMerged openstack/tripleo-upgrade master: [UPDATES] Start minor update with controller nodes.  https://review.openstack.org/52743119:28
openstackgerritMerged openstack/tripleo-upgrade master: Add support for upgrading HCI environments  https://review.openstack.org/52743219:28
openstackgerritMerged openstack/tripleo-upgrade master: Assign new network and description attribute to Monitor role  https://review.openstack.org/52743319:28
openstackgerritMerged openstack/tripleo-upgrade master: Add the option to launch workload after composable upgrade step  https://review.openstack.org/52743419:28
openstackgerritMerged openstack/tripleo-heat-templates master: Add Novacontrol role  https://review.openstack.org/52650119:28
*** abregman|afk is now known as abregman19:29
*** morazi has quit IRC19:30
openstackgerritMehdi Abaakouk (sileht) proposed openstack/puppet-tripleo master: DNM: ceilometer: ensure gnocchi is started before running upgrade  https://review.openstack.org/52776819:31
*** abregman has quit IRC19:31
openstackgerritMehdi Abaakouk (sileht) proposed openstack/puppet-tripleo master: DNM: ceilometer: ensure gnocchi is started before running upgrade  https://review.openstack.org/52776819:33
aleeEmilienM, mwhahaha any idea why zuul hates me here?  https://review.openstack.org/52723419:33
EmilienMalee: what logs say?19:33
mwhahahajob ran long19:34
mwhahahatimeout19:34
mwhahahahttp://logs.openstack.org/34/527234/1/gate/tripleo-ci-centos-7-scenario002-multinode-oooq-container/0f2f5f8/job-output.txt.gz#_2017-12-13_16_26_30_68406219:34
EmilienMhttp://logs.openstack.org/34/527234/1/gate/tripleo-ci-centos-7-scenario002-multinode-oooq-container/0f2f5f8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz19:34
EmilienMtimeout19:34
EmilienMdamn he's faster.19:34
mwhahahaAND DON'T YOU FORGET IT19:34
EmilienMwell my link was better19:34
aleeEmilienM, mwhahaha thanks!  rechecking ..19:34
aleegood to know 143 = timeout19:34
EmilienMmwhahaha: can you review https://review.openstack.org/#/c/527561/ please?19:34
mwhahaha143 is a ran to long timeout19:34
mwhahaha137 is a zuul killed it timeout19:35
mwhahahawe have several timeouts in play19:35
mwhahahaso 143 was us hitting the --timeout 80 during overcloud deploy19:35
mwhahaha137 is when zuul comes along and says you've been running to long and kills it19:35
aleemwhahaha, good to know19:36
openstackgerritMehdi Abaakouk (sileht) proposed openstack/puppet-tripleo master: ceilometer: ensure gnocchi is started for upgrade  https://review.openstack.org/52776819:36
aleemwhahaha, EmilienM https://review.openstack.org/#/c/526784/ needs workflow please19:38
*** gbarros has joined #tripleo19:38
aleeEmilienM, thanks19:39
openstackgerritArx Cruz proposed openstack-infra/tripleo-ci master: Fix stackviz data  https://review.openstack.org/52560319:40
*** absubram has quit IRC19:41
*** fragatina has quit IRC19:43
*** fragatina has joined #tripleo19:43
*** nyechiel has quit IRC19:44
openstackgerritMichael Bayer proposed openstack/tripleo-quickstart-extras master: Add Nova max_concurrent_builds, rpc response timeout to undercloud conf  https://review.openstack.org/52771819:47
*** yamahata has joined #tripleo19:51
*** thrash|biab is now known as thrash19:56
*** moshele has joined #tripleo19:57
*** jkilpatr has quit IRC20:03
*** eck`gone is now known as eck`20:06
*** ecerquei has quit IRC20:09
*** morazi has joined #tripleo20:10
*** pkovar has quit IRC20:16
*** liverpooler has quit IRC20:17
hrybackihey all, question about how to overwrite what THT defaults `hosts` to here: https://github.com/openstack/tripleo-heat-templates/blob/master/hosts-config.yaml#L1520:17
hrybackiis passing in another environment e.g. https://paste.fedoraproject.org/paste/iANVDzTbAHwbp840GEHsdQ during the overcloud-deploy enough or am I missing something?20:18
hrybackidprince ^^20:21
*** rlandy|rover is now known as rlandy|rover|brb20:25
paramiteHey guys, is here anybody from tripleo-quickstart core group20:27
paramite?20:27
*** dparkes has joined #tripleo20:27
*** openstackstatus has joined #tripleo20:29
*** ChanServ sets mode: +v openstackstatus20:29
*** maeca has joined #tripleo20:30
openstackgerritSteve Baker proposed openstack/tripleo-common master: Move more prepare logic into kolla_builder  https://review.openstack.org/52657920:30
openstackgerritSteve Baker proposed openstack/tripleo-common master: Prepare action: extra arguments  https://review.openstack.org/52658020:30
*** gbarros has quit IRC20:31
*** yamahata has quit IRC20:32
*** radeks has joined #tripleo20:34
honzaoooq is stuck in gather facts, anyone seen that?20:38
*** jkilpatr has joined #tripleo20:39
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Move more prepare logic into kolla_builder  https://review.openstack.org/52657620:42
*** rasca has quit IRC20:43
*** rasca has joined #tripleo20:43
*** rlandy|rover|brb is now known as rlandy|rover20:45
rlandy|roverparamite: what do you need wrt  tripleo-quickstart?20:48
*** nkinder has joined #tripleo20:48
*** dhill__ has quit IRC20:49
*** jlabarre has quit IRC20:50
*** akrivoka has quit IRC20:52
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756120:53
*** Goneri has joined #tripleo20:54
*** dhill_ has joined #tripleo20:55
paramiterlandy|rover, oh hey, I have a problem. It used to generate /home/stack/network-environment.yaml file on undercloud, but the latest master version is not anymore and I cannot find a reason why.20:56
*** rmascena has quit IRC20:57
rlandy|roverparamite: where are you seeing this? on a job or a personal run? are you deploying with network-isolation? also, I'm checking recent changes in that playbook20:58
*** ansmith has quit IRC20:59
paramiterlandy|rover: pon my HW and yes, I suppose that "network_isolation: true" in my config means that I am deploying with network isolation21:00
rlandy|roverparamite: yes, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-config/tasks/main.yml#L15 is where the network-environment.yaml file is generated21:00
paramiteyes I know and I explicitly set undercloud_type to baremetal to true, but still no luck :/21:01
rlandy|roverparamite: ha - see line 2021:01
*** fragatina has quit IRC21:01
paramitechecking21:01
rlandy|roverwhen undercloud_type=baremetal, that step won't execute21:02
rlandy|roverthe question is - what is your undercloud21:02
rlandy|roveris it a virt undercloud and baremetal overcloud? or baremetal undercloud as well21:02
rlandy|roverif you are working with a baremetal undercloud,21:02
paramiteah damn, I missed "!"21:02
*** japestinho has quit IRC21:02
rlandy|roveryou need to define this variable:21:03
rlandy|roverhttps://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-config/tasks/main.yml#L3221:03
*** amoralej is now known as amoralej|off21:03
paramiterlandy|rover, but still even without explicitly stating undercloud_type I had no env file21:03
rlandy|roverparamite: ok - so I'll need logs to debug that21:03
paramiterlandy|rover, undercloud is a VM21:03
rlandy|roverif your undercloud is a vm,21:04
rlandy|roverthe undercloud_type=virtual21:04
paramiteok, let me run it without the parameter and I will provide you with logs21:04
rlandy|roverwhich is the default21:04
paramiteright21:04
rlandy|roverparamite: sure - pls make sure you run from a clean env21:04
rlandy|roverso we don't get confusion from previous runs and we can debug from there21:04
aleeEmilienM, mwhahaha I'm seeing this -- https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master/628/console21:04
aleeEmilienM, mwhahaha 19:42:02     resources.private_network: Request limit exceeded: You have reached the maximum stacks per tenant, 100. Please delete some stacks.21:05
paramiterlandy|rover, yup I use --clean --teardown all21:05
aleeEmilienM, mwhahaha this is on 3rd party CI for https://review.openstack.org/#/c/527234/21:06
paramiterlandy|rover, which logs exactly do you need?21:06
*** ProfessorDeGraw has joined #tripleo21:06
rlandy|roverparamite: well, I'd need to know how you kicked the quickstart run21:06
rlandy|roverare you using devmode?21:06
rlandy|roverand what parameters  you passed21:07
paramiterlandy|rover, nope21:07
rlandy|roverparamite: then we can compare to a hw run we have in CI - virt undercloud, baremetal overcloud and see what the difference is21:07
*** absubram has joined #tripleo21:08
rlandy|roverparamite: also, ansible should print our what happened: ie; was that step skipped or is there just no file21:08
rlandy|roverso anything you can provide is helpful21:08
paramiteack, will get you as much info as is possible when the run finishes21:10
*** dprince has quit IRC21:10
mwhahahaalee: sounds like rdo cloud problems, would check with the ci folks21:10
aleeweshay, ^^ ?21:10
*** dprince has joined #tripleo21:11
weshayalee, ya.. it's horked21:13
rlandy|roveralee: yep - issue with rdocloud tenant21:13
*** catintheroof has quit IRC21:15
aleeweshay, rlandy|rover  so -- you unhorking it ? :)21:15
*** catintheroof has joined #tripleo21:15
weshayalee, I can't fix rdo-cloud21:15
weshayalee, there is an outtage notification, although they are saying it21:16
weshay's clear now21:16
weshaybut it's not afaict21:16
weshaytrown|ruck, you are filing that lp on rdo-cloud ya?21:16
*** threestrands has joined #tripleo21:18
*** threestrands has quit IRC21:18
*** threestrands has joined #tripleo21:18
trown|ruckweshay: ya... when/if it fails21:19
trown|ruckweshay: https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/200/console is running21:19
*** catintheroof has quit IRC21:19
*** jcoufal has quit IRC21:26
*** radeks has quit IRC21:26
*** ProfessorDeGraw has quit IRC21:28
*** rhallisey has quit IRC21:33
*** moshele has quit IRC21:37
*** noslzzp has quit IRC21:41
*** artom has quit IRC21:48
*** colonwq has quit IRC21:51
*** colonwq has joined #tripleo21:52
*** trown|ruck is now known as trown|outtypewww21:56
*** pchavva has quit IRC21:57
*** fzdarsky has quit IRC21:57
*** apetrich has quit IRC21:58
*** apetrich has joined #tripleo21:59
*** rcernin has joined #tripleo22:00
*** ProfessorDeGraw has joined #tripleo22:00
openstackgerritMerged openstack/ansible-role-redhat-subscription master: Initial commit  https://review.openstack.org/52756122:01
*** fragatina has joined #tripleo22:06
*** rbowen has quit IRC22:08
openstackgerritAlex Schultz proposed openstack/tripleo-upgrade master: Fix missing attribute in upgrade Infrared plugin  https://review.openstack.org/52743722:18
openstackgerritAlex Schultz proposed openstack/tripleo-upgrade master: Use parameter to control the docker registry env file creation  https://review.openstack.org/52743822:18
*** BryanS68 has quit IRC22:18
*** BryanS68 has joined #tripleo22:19
*** dprince has quit IRC22:20
*** aputtur_ has quit IRC22:24
*** chlong has quit IRC22:27
*** rhallisey has joined #tripleo22:29
openstackgerritMatt Young proposed openstack/tripleo-quickstart master: remove --ansible-debug from BM jobs  https://review.openstack.org/52780122:35
*** tosky has joined #tripleo22:40
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Remove travis.yml  https://review.openstack.org/52780322:40
*** absubram has quit IRC22:43
*** ProfessorDeGraw has left #tripleo22:46
*** BryanS68 has quit IRC22:53
*** pmannidi has joined #tripleo22:54
*** jmelvin has quit IRC23:00
openstackgerritMerged openstack/ansible-role-redhat-subscription master: Remove travis.yml  https://review.openstack.org/52780323:05
*** eck` is now known as eck`gone23:08
*** ccamacho has quit IRC23:14
*** dxiri has joined #tripleo23:15
openstackgerritRyan Brady proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983223:20
openstackgerritRyan Brady proposed openstack/tripleo-common master: Adds UpdateRoles Workflow  https://review.openstack.org/51504523:20
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add "clean" tox target  https://review.openstack.org/52780623:21
*** ebarrera has quit IRC23:26
openstackgerritEmilien Macchi proposed openstack/ansible-role-redhat-subscription master: Support Red Hat Portal Activation Keys  https://review.openstack.org/52780723:28
*** absubram has joined #tripleo23:28
openstackgerritMerged openstack/puppet-tripleo master: Add unit tests for tripleo::firewall::service_rules  https://review.openstack.org/52658923:30
aleeEmilienM, mwhahaha I'm trying to figure out what the best option forward is for https://review.openstack.org/#/c/527136/23:31
aleeEmilienM, mwhahaha the issue can be seen here -- http://logs.openstack.org/36/527136/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/77035d1/logs/tempest.html.gz23:32
mwhahahafix it? :D23:32
* mwhahaha trolls23:32
EmilienMsounds like it fails when a VM is created without encryption23:33
aleeEmilienM, mwhahaha the problem is that in order to do the glance image signing test, you need to set nova to verify images23:33
aleeit fails when volumes are created from images that are not signed23:33
mwhahahasounds like a more fundamental problem in tempest23:34
mwhahahaor this setup in generall23:34
mwhahahayou can't have both23:34
aleewell when you have nova try to start a server with an unsigned image23:34
*** rlandy|rover is now known as rlandy|rover|bbl23:34
aleeright -- so there are a few ways to solve this perhaps ..23:34
alee1. fix the tempest tests that are failing to use signed images23:35
*** itlinux has joined #tripleo23:35
aleethats what we did in the volume encyption test in the basrbican_tempest_plugin23:35
alee2. remove the failing tests from this scenario23:35
*** dhill__ has joined #tripleo23:35
*** dhill_ has quit IRC23:35
mwhahaha123:35
alee(and put them somewhere else)23:36
mwhahahabecause what happens when a custmer if they enable this verification in their cloud23:36
mwhahahait seems like it needs to be exposed and properly configured in all tempest tests23:36
mwhahahathis is a problem for customers if they want this and to use tempest to validate their cloud23:36
mwhahahait sounds like you're saying if they enable encryption they can't use any of these other tests23:36
aleeyeah - it seems like we need some tempest conf value to check signature verification enabled23:37
aleemwhahaha, not encryptuiion -- signature verification23:37
mwhahahayea signature verification23:37
mwhahahaso that seems like it needs to be a top level config for tests23:38
mwhahahato know how to properly handle that23:38
mwhahahathe same tests should work for both cases (i would hope)23:38
aleemwhahaha, yeah - it seems like this needs to be solved at a fundamental tempest level23:39
*** tongl has quit IRC23:39
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Introduce RHSM service  https://review.openstack.org/52680823:40
*** tongl has joined #tripleo23:40
aleeEmilienM, mwhahaha  fwiw in https://review.openstack.org/#/c/524064/,  we see the volume and image signing tests pass .. http://logs.openstack.org/64/524064/5/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/b58a32c/logs/tempest.html.gz23:41
aleeEmilienM, mwhahaha guess I need to talk with some tempest guys tommorow ..23:42
mwhahahayea, the only other thing seemed to be a timeout23:43
mwhahahabut if that's because verification is causing problems then that explains that23:43
aleeyup23:43
*** dparkes has quit IRC23:48
openstackgerritMerged openstack/puppet-tripleo master: gnocchi: ensure upgrade run after swift setup  https://review.openstack.org/52770923:49
openstackgerritMerged openstack/tripleo-heat-templates master: Autogenerate the barbican simple crypto KEK  https://review.openstack.org/52751223:49
openstackgerritMerged openstack/tripleo-quickstart master: Change volume encryption test to use barbican_tempest test  https://review.openstack.org/52678423:49
beaglesfultonj, is it my imagination or did I see a bug report about running service workflow tasks on multinode CI?23:53
*** tongl has quit IRC23:53
*** tongl has joined #tripleo23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!