Thursday, 2017-12-07

*** ebarrera has quit IRC00:00
*** leitan has joined #tripleo00:00
*** leitan has quit IRC00:05
*** liverpooler has quit IRC00:06
EmilienMmwhahaha: looking now00:07
EmilienMmwhahaha: it's "normal"00:07
EmilienMmwhahaha: delorean didn't build the tipleo-common package in current yet I guess00:08
EmilienMmwhahaha: a recheck should work, let's see00:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps.j2: use ansible to bootstrap environment  https://review.openstack.org/52529100:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663400:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)00:10
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574300:19
*** ansmith has quit IRC00:25
*** dparkes has quit IRC00:26
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Save oooq generated files  https://review.openstack.org/51713600:34
*** ansmith has joined #tripleo00:38
*** itlinux has joined #tripleo00:39
*** tosky has quit IRC00:44
*** liverpooler has joined #tripleo00:54
*** ansmith has quit IRC01:05
*** rfolco has quit IRC01:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663401:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)01:10
*** ansmith has joined #tripleo01:10
*** itlinux has quit IRC01:19
*** rfolco has joined #tripleo01:20
*** cshastri has joined #tripleo01:31
*** psachin has joined #tripleo01:31
*** Sandy619 has joined #tripleo01:34
*** Sandy619 has quit IRC01:34
*** yamahata has joined #tripleo01:40
openstackgerritMerged openstack/tripleo-quickstart-extras master: Revert "Allow deleting all of docker cache"  https://review.openstack.org/52584901:42
*** itlinux has joined #tripleo01:45
openstackgerritMerged openstack/tripleo-quickstart-extras master: Prepend errors file with prefix for logstash index  https://review.openstack.org/52526801:58
*** leitan has joined #tripleo02:01
*** leitan has quit IRC02:05
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663402:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)02:10
*** ooolpbot has quit IRC02:10
*** tongl has quit IRC02:10
*** gvrangan has joined #tripleo02:10
*** ebarrera has joined #tripleo02:11
*** rcernin has quit IRC02:12
*** gvrangan has quit IRC02:17
*** thrash is now known as thrash|g0ne02:19
*** rcernin has joined #tripleo02:20
*** ebarrera has quit IRC02:23
*** yamahata has quit IRC02:41
*** fragatina has quit IRC02:42
*** fragatina has joined #tripleo02:43
*** fragatina has quit IRC02:47
*** fragatina has joined #tripleo02:48
EmilienMweshay: looking now02:50
*** fragatina has quit IRC02:50
EmilienMhttps://git.opendaylight.org/gerrit/integration/packaging/puppet-opendaylight02:51
EmilienMnot found02:51
EmilienMI can clone it02:52
EmilienMI guess it was a downtime on their side02:52
weshayEmilienM, thanks02:54
EmilienMweshay: let me know if it still occurs02:56
weshayyou go flying?02:56
EmilienMweshay: tomorrow :-)02:57
EmilienMweshay: I come back from gym02:57
EmilienMso I can kick your ass at PTG02:57
weshayI'll throw on some gloves and go toe to toe02:58
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Update Fedora defaults to 27  https://review.openstack.org/52168403:00
openstackgerritIan Wienand proposed openstack/diskimage-builder master: ironic-agent: don't remove make  https://review.openstack.org/52625703:00
*** fragatina has joined #tripleo03:00
EmilienMlol03:00
*** fragatina has quit IRC03:00
*** gvrangan has joined #tripleo03:04
*** gecong_ has joined #tripleo03:06
*** jwb has quit IRC03:07
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663403:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)03:10
*** ooolpbot has quit IRC03:10
*** itlinux has quit IRC03:10
*** ramishra has joined #tripleo03:10
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574303:10
*** zshi has joined #tripleo03:20
*** dhill_ has quit IRC03:29
*** dhill_ has joined #tripleo03:32
openstackgerritMerged openstack/tripleo-heat-templates master: Don't assume single sub_node in nic config  https://review.openstack.org/52322703:38
openstackgerritMerged openstack/instack-undercloud master: Remove -U from pip install  https://review.openstack.org/52489203:38
*** itlinux has joined #tripleo03:40
openstackgerritMerged openstack/instack-undercloud master: Enable the ansible deploy interface out of box  https://review.openstack.org/52256803:41
openstackgerritMerged openstack/tripleo-heat-templates master: Adding Cisco VTS ML2 mechanism driver service template  https://review.openstack.org/51067303:41
*** mdnadeem has joined #tripleo03:42
*** shreshtha has joined #tripleo03:44
*** shreshtha has quit IRC03:44
*** shreshtha has joined #tripleo03:44
*** threestrands has joined #tripleo03:52
*** threestrands has quit IRC03:52
*** threestrands has joined #tripleo03:52
*** mdnadeem has quit IRC03:53
*** psahoo has joined #tripleo03:54
*** leitan has joined #tripleo03:59
*** fpan has quit IRC04:00
*** gecong_ has quit IRC04:00
*** udesale has joined #tripleo04:01
*** ihrachys has quit IRC04:02
openstackgerritMerged openstack/puppet-tripleo master: Enable octavia certificate configuration  https://review.openstack.org/52608704:04
*** leitan has quit IRC04:04
*** pmannidi has quit IRC04:05
*** rlandy has quit IRC04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663404:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)04:10
*** pgadiya has joined #tripleo04:21
*** pmannidi has joined #tripleo04:22
*** ykarel|afk has joined #tripleo04:22
*** links has joined #tripleo04:25
*** moshele has joined #tripleo04:26
*** dpawar has joined #tripleo04:29
*** gbarros has quit IRC04:36
*** gvrangan has quit IRC04:38
*** pmannidi has quit IRC04:40
*** pdeore has joined #tripleo04:43
*** stendulker has joined #tripleo04:48
*** jaosorior has joined #tripleo04:49
*** moshele has quit IRC04:50
*** pdeore has quit IRC04:54
*** pdeore has joined #tripleo04:56
*** pmannidi has joined #tripleo04:57
*** jaganathan has joined #tripleo05:00
*** s_b_34343 has joined #tripleo05:06
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663405:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)05:10
*** ooolpbot has quit IRC05:10
*** itlinux has quit IRC05:10
*** janki has joined #tripleo05:14
*** moshele has joined #tripleo05:20
*** moshele has quit IRC05:21
*** numans has quit IRC05:23
*** tzumainn has quit IRC05:24
*** numans has joined #tripleo05:26
*** fragatina has joined #tripleo05:33
*** pdeore_ has joined #tripleo05:34
*** ykarel|afk has quit IRC05:35
*** ykarel|afk has joined #tripleo05:35
*** pdeore has quit IRC05:37
*** daidv has quit IRC05:42
*** daidv has joined #tripleo05:42
*** ykarel|afk is now known as ykarel05:51
Tenguhello there!05:52
Tengujaosorior: hello! apparently, I'm more or less right with the hiera thingy - at least, unit tests do also fail on zuul… there must be something fishy.05:52
jaosoriorI'm fine with it using the :: approach, would sure add mwhahaha to the review though05:53
Tenguof course. as it creates something different from the already-existing firewall stuff05:53
Tengubtw, that resource doesn't have unit test… so I couldn't check what was going on :(05:53
*** pdeore_ has quit IRC05:56
jaosoriorbummer :/05:56
Tengusoo. updating my review and adding mwhahaha as reviewer. Will put some comment as well.05:56
*** pdeore_ has joined #tripleo05:57
Tenguwill do one more test before that. just to be on the safe side.05:57
jaosoriorawesome05:58
jaosoriorthanks dude!05:58
*** shreshtha_ has joined #tripleo06:01
*** pdeore_ has quit IRC06:01
*** shreshtha_ has quit IRC06:01
*** shreshtha_ has joined #tripleo06:01
Tenguhmmm. thinking a bit. I might do the same kind of thing we actually made in our puppet-accounts module.06:03
*** moshele has joined #tripleo06:03
*** shreshtha has quit IRC06:03
Tenguit's a nice thing, allowing to pass either data to the define, or it will check if it exists in hiera.06:03
Tenguguess that would add some complexity in the code itself, but at least… we fall in a standard hiera usage and syntaxe.06:04
Tengu"." in hiera/yaml are hash separator, but in puppet, common separator is "::"06:04
Tengubut that would require a dedicated patch.06:04
Tenguso. I drop the modification I made in the service_endpoints and related unit test for now, jaosorior - so that I can create a dedicated review for that specific part. Else it will be a commit without "specific" purpose.06:05
Tengu(i.e. adding basic auth, but also doing a huge change in non-related code)06:05
jaosoriorsounds good to me06:06
*** fragatina has quit IRC06:06
jaosoriorI rather have smaller commits that go to the point06:06
Tengusame for me. better for understanding and review.06:07
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Update website from setup.cfg  https://review.openstack.org/52628806:10
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663406:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)06:10
*** mandre has quit IRC06:11
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: WIP: haproxy basic auth support  https://review.openstack.org/52549206:11
Tengujaosorior: cleaned my first review -^06:11
Tenguthat should make "my" unit tests pass.06:11
*** 07EAALF06 has joined #tripleo06:12
*** 07EAALF06 has quit IRC06:13
*** fragatina has joined #tripleo06:13
*** mandre has joined #tripleo06:15
*** skramaja has joined #tripleo06:23
openstackgerritMerged openstack/tripleo-ipsec master: Update website from setup.cfg  https://review.openstack.org/52628806:23
*** jaganathan has quit IRC06:23
*** pdeore has joined #tripleo06:24
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: Added unit test (induces syntax change for a currently unused resource)  https://review.openstack.org/52629206:25
Tengujaosorior: -^06:25
Tenguo_O can't add mwhahaha for a review… weird.06:26
Tenguok. had to add his full username - completion didn't want to show him.06:28
Tengujaosorior: I'm wondering what will happen if I add unit tests for the firewall thing… I think it will crash as well in the unit tests.06:29
jaosoriorperhaps06:29
Tenguwill make a cup of tea and check that assumption.06:30
*** kristaps_ has quit IRC06:31
*** ykarel is now known as ykarel|afk06:31
*** threestrands has quit IRC06:32
*** marios has joined #tripleo06:33
*** fragatina has quit IRC06:37
*** jaganathan has joined #tripleo06:37
*** shreshtha has joined #tripleo06:39
*** karthiks has quit IRC06:41
*** shreshtha_ has quit IRC06:42
*** rwsu has joined #tripleo06:44
Tengujaosorior: hmm. I see create_resources('tripleo::firewall::rule', $firewall_rules) on the puppet code for tripleo::firewall. Funny.06:45
Tenguah, sorry.06:46
Tenguwondering how that can work though… will do a unit test for that  $service_firewall_rules = hiera("tripleo.${underscore_name}.firewall_rules", {})06:47
*** radeks has joined #tripleo06:47
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Add a tag to all the role specific parameters  https://review.openstack.org/51723106:50
*** karthiks has joined #tripleo06:53
*** brault has quit IRC06:54
s_b_34343d06:56
s_b_34343d06:56
Tengubingo… unit also fails for the "firewall" thing…06:57
s_b_34343Hi all , having one query that suppose my openstack is deployed with 2 controller 1 compute 1 datanode   . and now i want add one more controller can we do this ?06:57
Tenguduh. who did push "." instead of the standard "::" in that hiera stuff? X(06:57
s_b_34343can we scale confuguration once aftre deployment06:58
Tengus_b_34343: hello. you can't add a new controller once it's deployed.06:58
jaosoriorTengu: damn06:58
s_b_34343Tengu: what about compute and block staograge06:58
jaosoriorTengu: well, that firewall thing has been used in TripleO for a very long time06:59
Tengus_b_34343: that's the only component that can't be changed. You can add compute and datanode without problem, but computes… nope, it's a fixed number. And it won't work with 2 controllers either, no quorum for the HA06:59
Tengujaosorior: yep. Just wondering *how* it works06:59
jaosorior*magic*06:59
Tengujaosorior: probably. But that's very uncool.06:59
Tengubecause we cannot push unit tests for that.06:59
Tenguso if anyone wants to change something, we will be blind :(.07:00
*** shreshtha has quit IRC07:00
jaosoriordamn, that's a bummer07:00
Tengu"oh, yeah, that should work, but we don't have any way to prove it, well, just merge it and cross fingers" ;).07:00
jaosoriorgood point07:00
Tengus_b_34343: btw, you can *replace* a failed controller (and any other kind of role).07:01
Tengujaosorior: I might send a mail to the ML in order to get some historic on that, shall I?07:01
s_b_34343ok but suppose 3 controller 2 compute and 1 datanode is there and i want to add one more datanodes . in this case againg i need to deploy openstack or only specific puppet for data node ?07:01
Tengujaosorior: I *thing* changing to the common syntaxe "::" shouldn't be that hard, I think there's only the tripleo-heat-templates repository to change… ?07:02
Tengus_b_34343: you will update the current install, and nothing should break07:02
s_b_34343how come07:02
s_b_34343i didint get this07:02
Tengus_b_34343: you update the numbers for the resource you want to change (datanode in your case), and you re-run the "deploy" command. Heat has the current stack state in its database, and will update only the required elements07:03
Tengus_b_34343: you might want to read a bit about how heat works - I don't know if you have any experience with amazon web services (AWS), but it's the same as "cloudformation" in that world.07:03
Tengus_b_34343: i.e. you describe your infrastructure in a stack, and you can update that stack07:04
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260707:04
*** karthiks has quit IRC07:04
s_b_34343Tengu : thanks will explore about heat . can you refere some documetns which i can refere for better understanding07:05
*** nyechiel has joined #tripleo07:06
s_b_34343Tengu: as you said compute cant add and it wont work with 2 controller . so you are saying that if 3 controller will be there then we and annd compute . is it something like that ?07:08
Tengus_b_34343: you create youre base with the final number of controllers (3 for HA, or any odd number in order to get a quorum for pacemaker). The other resources are more flexible, as you can add and remove them at will, following the right steps.07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663407:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)07:10
*** ooolpbot has quit IRC07:10
Tengus_b_34343: regarding doc, lemme check my bookmarks, I might have something.07:10
s_b_34343<Tengu> : which bookmarks ?07:11
*** rcernin has quit IRC07:11
s_b_34343i dont know anything07:11
*** pmannidi has quit IRC07:11
Tengus_b_34343: the one I have ;). but apparently I don't have links to the heat doc. A good starting point might be: https://wiki.openstack.org/wiki/Heat - it explains what heat is, and provides a few links.07:12
s_b_34343Tengu : thanks you so much .07:12
Tengus_b_34343: small remark though: you don't need to dig into heat in order to deploy tripleo - all is automated. Well, if there's a failure, then you'll need to use some "openstack stack" commands, of course ;).07:12
*** ccamacho has quit IRC07:13
*** agurenko has joined #tripleo07:13
s_b_34343ok some more doubts . during deployment whci logs i should refer07:13
Tengus_b_34343: and if you want a deeper insight of the tripleo deploy process, you might as well have a look at mistral, the openstack scheduler, but, as heat, you don't need to do anyting on that part as it's automated.07:14
Tengus_b_34343: you'll get the output in your terminal07:14
s_b_34343Tengu: like for containers and vip  , failover something like that07:14
Tengus_b_34343: ah, if you want to describe what's deployed, you'll need to call the "openstack" CLI07:15
s_b_34343after deployment is i'm trying some failover or suppose container is down then where should i check logs07:15
*** yprokule has joined #tripleo07:15
Tengus_b_34343: ah, those logs. hmm, in a container env, I'm not really sure (I'm still baremetal), you might want to check with another one ( jaosorior if you're available? -^^ )07:16
*** karthiks has joined #tripleo07:17
s_b_34343ok so for baremetal where can i check ?07:17
*** shreshtha has joined #tripleo07:18
Tenguyou'll have all the logs in /var/log/<service-name>. You will also want to check "pcs status" in order to see what pacemaker is doing.07:18
Tengus_b_34343: basically, pacemaker will show you what service is affected by the test you're doing - most probably the VIP will be moved (hence you can run "ip a" in order to check the status), and some services like galera (mysql cluster), redis and rabbitMQ will be impacted.07:19
*** holser has joined #tripleo07:22
jaosoriorfor containers, it would be in /var/log/containers/<service name>07:22
Tengujaosorior: and is there a pacemaker as well, or is the HA part managed with kubernetes?07:24
jaosoriork8s is not there yet07:25
jaosoriorso pacemaker logs are in the same place as always07:25
Tengucool07:25
jaosoriorI THINK  some of the services managed by pacemaker do have logs in /var/log/container07:25
jaosorior*containers07:25
Tengujaosorior: mainly pacemaker should manage service containers, there's only the VIP that's on the physical node… ?07:26
jaosoriorTengu: right, but some of the nodes handled by pacemaker use syslog, so you won't find files for those07:28
jaosoriorTengu: and yeah, only the VIPs should be on the physical node.07:28
Tengu:)07:28
TenguI think I more or less see how things are going for the containers.07:28
*** ykarel|afk is now known as ykarel07:30
Tengujaosorior: just sent an email in order to get some inputs for that weird non-standard syntax in hiera. hopefully we might converge to a better thing. standard is good. weird is bad.07:32
Tengu(at least in software dev ;))07:32
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix loop in config-download.yaml.j2 template  https://review.openstack.org/52315507:34
openstackgerritMerged openstack/tripleo-heat-templates master: deploy-steps.j2: use ansible to bootstrap environment  https://review.openstack.org/52529107:34
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Update capabilities-map.yaml to include latest storage environments  https://review.openstack.org/52607707:34
openstackgerritMerged openstack/puppet-tripleo master: Instance HA support  https://review.openstack.org/50692207:34
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params inputs default value update  https://review.openstack.org/52599007:35
jaosoriorbandini: instance HA merged :D need any more reviews?07:37
*** aditya_r has joined #tripleo07:37
Tengufunny. now that I dropped the unit-test for tripleo::haproxy::service_endpoints (and related change in that definition, as I can't test the change), it seems zuul is happy :).07:39
*** hjensas has joined #tripleo07:39
bandinijaosorior: \o/ you are made of awesome! the corresponding tht one would be grand https://review.openstack.org/#/c/506350/07:39
bandinijaosorior: let me know if you need reviews from me07:39
jaosoriorbandini: no reviews right now; but if you know how to properly package ansible roles for RDO, help would sure be useful07:40
bandinioh wow. no that is new territory for me. as in rpm packaging?07:41
*** jtomasek has joined #tripleo07:44
jaosoriorbandini: yep07:44
*** karthiks has quit IRC07:59
*** florianf has joined #tripleo08:01
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation  https://review.openstack.org/52621308:02
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663408:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)08:10
*** karthiks has joined #tripleo08:12
s_b_34343<Tengu> <jaosorior> : just wanted to know that only one vip get configure for controller ha ?08:12
s_b_34343and one more doubt regarding corosync , pacemaker and hsproxy ?08:13
s_b_34343how there three are connected to each other and how we are using them in trpleo08:14
Tengus_b_34343: the VIP is attached to only one controller, yes. pacemaker manages it and attach it to another controller server if the "master" is down for some reason.08:15
jaosoriors_b_34343: there is actually a VIP per-network usually (although not for all networks).08:15
Tenguhmm yep, "the VIP" is kind of unprecise :]08:15
*** ccamacho has joined #tripleo08:15
*** aditya_r has quit IRC08:15
*** tesseract has joined #tripleo08:15
jaosoriors_b_34343: you can see which networks are used by default and which of them have a VIP here: https://github.com/openstack/tripleo-heat-templates/blob/master/network_data.yaml08:16
s_b_34343after controller failover dose another controller will display that in therire interface list08:16
s_b_34343?08:16
*** bogdando has joined #tripleo08:16
jaosorioryes08:17
Tengus_b_34343: pacemaker will switch the VIPs to another controller, yes. and you'll be able to list the IPs using "ip addr ls"08:17
s_b_34343ok so this activity pacemaker is doing and what about corosync and haproxy08:17
Tengus_b_34343: haproxy is the loadbalancer.08:18
Tengus_b_34343: haproxy acts also as the endpoint for APIs (i.e. that's where the TLS certificate is installed in order to get TLS connections). it also acts as a load-balancer for the services, like galera (mysql cluster), web API and so on.08:19
Tengucorosync is a piece of software related to pacemaker.08:19
*** rcernin has joined #tripleo08:19
*** aufi has joined #tripleo08:19
*** iranzo has joined #tripleo08:20
*** ffiore has joined #tripleo08:22
*** mdnadeem has joined #tripleo08:22
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Persist role in a path discoverable by ansible  https://review.openstack.org/52631108:25
openstackgerritMerged openstack/tripleo-upgrade master: Setup tox  https://review.openstack.org/52567608:25
Tenguhmmmmm. the tripleo third party CI seems broken at some point…08:27
*** gkadam has joined #tripleo08:27
*** cylopez has joined #tripleo08:27
Tenguhttps://logs.rdoproject.org/92/525492/4/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-nv/Zcc9649929cd445e3a5b19f34eb7653c1/console.txt.gz#_2017-12-07_06_13_36_20408:28
*** cylopez has left #tripleo08:30
*** oidgar has joined #tripleo08:31
*** jpena|off is now known as jpena08:32
*** ffiore has quit IRC08:32
*** aditya_r has joined #tripleo08:34
openstackgerritMerged openstack/tripleo-upgrade master: Update .gitreview.  https://review.openstack.org/52414208:37
*** salmankhan has joined #tripleo08:38
*** ukalifon has joined #tripleo08:40
*** salmankhan has quit IRC08:42
openstackgerritMerged openstack/tripleo-ipsec master: Persist role in a path discoverable by ansible  https://review.openstack.org/52631108:45
*** aditya_r has quit IRC08:47
*** dpawar has quit IRC08:48
*** aditya_r has joined #tripleo08:48
*** mcornea has joined #tripleo08:57
*** jpich has joined #tripleo08:58
openstackgerritOr Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker  https://review.openstack.org/52608009:02
*** shardy has joined #tripleo09:03
*** dpawar has joined #tripleo09:03
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663409:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)09:10
*** ooolpbot has quit IRC09:10
*** aditya_r has quit IRC09:10
*** aditya_r has joined #tripleo09:10
chandankumarmwhahaha: arxcruz can you update this bug https://bugs.launchpad.net/os-testr/+bug/1733983 with the review09:13
openstackLaunchpad bug 1733983 in tripleo "Tempest reports 'missing Worker 1!'" [Medium,Triaged]09:13
*** gfidente has joined #tripleo09:15
*** gfidente has quit IRC09:15
*** gfidente has joined #tripleo09:15
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: SR-IOV agent: allow to configure agent extensions  https://review.openstack.org/52622209:18
jaganathangfidente, hi, please review https://review.openstack.org/#/c/523358/09:19
*** mrch has joined #tripleo09:21
s_b_34343<jaosorior> <Tengu> : thansk it was really helpful to understand these things09:21
Tengus_b_34343: happy to help :)09:22
s_b_34343:)09:22
openstackgerritSteven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config  https://review.openstack.org/52523609:23
openstackgerritSteven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config  https://review.openstack.org/52523609:26
openstackgerritGiulio Fidente proposed openstack/instack-undercloud stable/pike: Set nova dhcp_domain to empty string  https://review.openstack.org/52632309:26
*** moshele has quit IRC09:29
*** sshnaidm|afk is now known as sshnaidm|rover09:30
*** kbyrne has quit IRC09:31
*** kbyrne has joined #tripleo09:34
*** lucas-afk is now known as lucasagomes09:35
*** derekh has joined #tripleo09:36
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation  https://review.openstack.org/52621309:36
*** ykarel is now known as ykarel|lunch09:37
*** andreaf has quit IRC09:42
*** andreaf has joined #tripleo09:42
*** aditya_r has quit IRC09:43
*** aufi has quit IRC09:44
*** aufi has joined #tripleo09:44
*** athomas has joined #tripleo09:46
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation  https://review.openstack.org/52621309:47
*** sri_ has quit IRC09:51
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Save oooq generated files  https://review.openstack.org/51713609:51
*** hewbrocca_afk is now known as hewbrocca09:51
arxcruzchandankumar: which review ?09:52
chandankumararxcruz: there was a patch floating related to worker fix09:53
arxcruzchandankumar: which patch ?09:54
chandankumararxcruz: https://review.openstack.org/#/c/518575/ i think it is related to the above bug09:56
chandankumarwe were doing bug traiging on qa so asked09:57
arxcruzchandankumar: not sure if it's related... the worker is there, it just not... work...09:57
arxcruzchandankumar: but it's a valid patch09:57
Tengusmall question: why is openstack based on mariadb instead of postgresql? is it due to the pseudo-multi-master mode supported by mysql, or is there something else?09:57
arxcruzchandankumar: plus, from what I understood from https://bugs.launchpad.net/os-testr/+bug/1733983/comments/2 the bug is fixed in os-testr and stestr newest versions09:59
openstackLaunchpad bug 1733983 in tripleo "Tempest reports 'missing Worker 1!'" [Medium,Triaged]09:59
chandankumararxcruz: yup, in stestr is fixed09:59
*** ebarrera has joined #tripleo10:00
*** moshele has joined #tripleo10:00
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation  https://review.openstack.org/52621310:00
*** shardy has quit IRC10:02
*** shardy has joined #tripleo10:04
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: WIP: haproxy basic auth support  https://review.openstack.org/52549210:06
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663410:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)10:10
*** tosky has joined #tripleo10:11
*** salmankhan has joined #tripleo10:13
*** ebarrera has quit IRC10:16
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: [WIP] undercloud: set default_resource_class to 'baremetal'  https://review.openstack.org/52607810:19
*** paramite has joined #tripleo10:19
*** cshastri has quit IRC10:20
*** rcernin has quit IRC10:21
*** sri_ has joined #tripleo10:25
*** ffiore has joined #tripleo10:27
*** dsariel has quit IRC10:28
*** marios has quit IRC10:30
openstackgerritSanjay Upadhyay proposed openstack/tripleo-quickstart master: Fix default deploy where undercloud install scripts are not installed.  https://review.openstack.org/52633410:32
*** dtantsur|afk is now known as dtantsur10:32
openstackgerritCédric Jeanneret proposed openstack/puppet-tripleo master: Add unit test for tripleo::haproxy::service_endpoints  https://review.openstack.org/52629210:33
*** s_b_34343 has left #tripleo10:33
Tengubogdando: hello! just updated the commit message -^  :). Lemme know if this is better for you.10:33
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix puppet config volume for iscsid container  https://review.openstack.org/52418710:34
Tengubogdando: also, I sent a mail on the dev ML in order to find out why dots are used instead of semicolon for some cases - it's non-standard and creates issues. If you have some answers, it would be nice to have a look :)10:34
bogdandoI think those former ruby devs just love dots more than semicolons, Tengu10:36
Tengubogdando: hmm ok. we really should push semicolons instead, in order to be able to get proper unit tests :).10:36
bogdando+110:36
Tenguwithout them, we're blind whenever we need to do changes.10:36
bogdandomwhahaha: ^^10:36
Tengubogdando: Alex is in the review (I added him). Hopefully I'll be able to get some advices/points of view regarding that change, and push forward for a "small" refactoring that will "only" hit puppet-tripleo and tripleo-heat-templates (sed, my friend, I love you ;))10:38
*** pdeore has quit IRC10:38
TenguIF we can move to semicolons, I'll be able to provide a quick patch in order to get unit tests for the tripleo::firewall::service_rules as well.10:39
Tenguthat one will require some changes in the heat templates, but nothing really hard. AND I'm pretty sure we'd love to still get the "dot" support for backward compatibility :]10:39
Tenguwon't be that hard to do.10:39
Tengu… but it will be hard (if not impossible) to properly test the backward compatibility, of course -.-'10:40
shardyowalsh: Hi, stable/pike CI seems to be failing due to the password introduced in https://review.openstack.org/#/c/522848/10:40
shardyjust wondered if anyone was already looking into it?10:40
shardylogs.openstack.org/58/522558/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/f67f8a6/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_08_05_2710:40
shardyresources.ServiceChain: Property error: resources[21].properties: Property LibvirtTLSPassword not assigned10:41
owalshshardy: is tripleo-common up to date on the undercloud?10:41
shardyowalsh: it should be, but I'm just checking we've not broken something10:41
owalshshardy: should have it in the generated passwords https://review.openstack.org/52284610:43
shardyowalsh: yea, I see the backport, just trying to work out why it's suddenly broken10:43
*** pdeore has joined #tripleo10:44
dtantsurhey, can someone with +2 on validations check https://review.openstack.org/#/c/512375/ please? it's been around for a while already10:44
shardyopenstack-tripleo-common-7.6.6-0.20171207065611.c32dd61.el7.centos.noarch10:44
shardyhrm10:44
*** agurenko has quit IRC10:45
*** agurenko has joined #tripleo10:46
*** pgadiya has quit IRC10:47
shardyowalsh: Ok I think the patch just needs a rebase, sorry for the noise10:48
shardyramishra: ^^ can you rebase https://review.openstack.org/#/c/522558/ please?10:48
owalshshardy: ack, just about to say that :-)10:48
* shardy needs more coffee ;)10:48
*** daidv has quit IRC10:48
*** daidv has joined #tripleo10:49
*** mathiasb has joined #tripleo10:52
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Undercloud deploy: use docker-uc.yaml  https://review.openstack.org/52633710:53
*** s_b_34343 has joined #tripleo10:54
openstackgerritRabi Mishra proposed openstack/tripleo-common stable/pike: Raise stored HTTPError when fetching swift object  https://review.openstack.org/52255810:55
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry  https://review.openstack.org/52464410:56
*** jaganathan has quit IRC11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663411:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)11:10
*** jkilpatr has quit IRC11:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Move step 1 preparation to deploy-steps-tasks.yaml  https://review.openstack.org/52526011:15
*** marios has joined #tripleo11:15
sshnaidm|rovermandre, ping about https://review.rdoproject.org/r/#/c/10845/11:17
*** marios has quit IRC11:18
*** yprokule has quit IRC11:18
*** abishop has joined #tripleo11:18
*** marios has joined #tripleo11:18
*** yprokule has joined #tripleo11:18
*** stendulker has quit IRC11:20
*** yprokule has quit IRC11:23
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent  https://review.openstack.org/52516411:25
*** liverpooler has quit IRC11:25
*** dsariel has joined #tripleo11:27
*** udesale has quit IRC11:28
dtantsurcan someone please merge this small clean up? https://review.openstack.org/#/c/522825/11:32
dtantsurshardy: if you have a second ^^11:32
shardydtantsur: sure, will do - if you get a moment could you check https://review.openstack.org/#/c/521493/ & see if you can see why I've broken the build attempting to address your comments?11:34
shardydtantsur: my rst-foo has failed me, any pointers appreciated11:34
dtantsurshardy: looking11:34
*** akrivoka has joined #tripleo11:35
gfidented0ugal I think processutils is always returning string here https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/ansible.py#L219 right?11:36
gfidented0ugal so if I made ansible return json it won't be enough?11:36
shardydtantsur: lgtm but we also set it in the stackrc for accessing the undercloud services11:37
gfidented0ugal to make it consumable within the workflow11:37
d0ugalgfidente: correct, you need to parse the JSON, but that is easy.11:38
dtantsurshardy: right, and this is expect. tripleo undercloud is an application written against a specific API version.11:38
* d0ugal looks for an example11:38
gfidented0ugal try/except?11:38
gfidented0ugal I am thinking to add it11:38
dtantsurwhile overcloud is just a cloud, so we should allow users to pick a version11:38
gfidented0ugal unless you want to :D11:38
*** dpawar has quit IRC11:38
dtantsurshardy: left some comments about rst, sorry if I confused you previously. I can update the patch for you, if you want.11:39
d0ugalgfidente: well, you can pase the JSON in the workflow - to avoid changing everywhere the action is used11:39
gfidented0ugal ah in the workflow? how?11:39
shardydtantsur: thanks, if you have time feel free to push the changes, otherwise I'll do it this afternoon11:39
shardythanks for the help! :)11:39
gfidented0ugal some jinja filter?11:39
dtantsurshardy: lemme do it, I've written A LOT of documentation recently :)11:39
d0ugalgfidente: yeah, there is a jinja and yaql function in mistral11:40
shardydtantsur: hehe, thanks! :)11:40
d0ugalgfidente: json_parse, thrash|g0ne added it recently-ish.11:40
d0ugalgfidente: trying to find you an example but my internet is crawling11:40
*** janki has quit IRC11:40
gfidentejson_parse is the yaql version?11:40
*** janki has joined #tripleo11:40
d0ugalgfidente: it is in jinja2 and yaql - mistral adds it to both.11:41
openstackgerritMerged openstack/instack-undercloud master: Set nova dhcp_domain to empty string  https://review.openstack.org/52519311:41
gfidentehttps://github.com/openstack/mistral/blob/master/setup.cfg#L8811:41
gfidented0ugal it's not in pike!11:42
gfidentedamn11:42
d0ugalgfidente: nope, it isn't.11:42
d0ugalgfidente: the problem is, if you change it in the action you change it for everyone.11:43
gfidenteyeah11:43
d0ugalgfidente: what is it that you need to do? Why do you need to parse the JSON?11:43
gfidented0ugal ansible returns json I want to consume in the workflow11:43
gfidentetask().result.stdout.get(shit)11:43
gfidentejson_parse(task().result.stdout).get(shit) ?11:44
*** abregman is now known as abregman|mtg11:45
d0ugalgfidente: that would do it, but not in pike11:45
gfidentebackpoooooort11:45
gfidentelet me finish the changes in the workflow first11:45
gfidenteso you can review those11:45
*** salmankhan has quit IRC11:45
d0ugalgfidente: sure11:45
*** jkilpatr has joined #tripleo11:47
*** salmankhan has joined #tripleo11:49
*** dpawar has joined #tripleo11:51
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: WIP: wire up queens upgrade workflow  https://review.openstack.org/52600611:52
*** raildo has joined #tripleo11:52
openstackgerritDmitry Tantsur proposed openstack/tripleo-docs master: Add composable networks documentation  https://review.openstack.org/52149311:54
dtantsurshardy: ^^11:55
shardydtantsur: thanks!11:55
*** dparkes has joined #tripleo11:55
dtantsurnp11:55
*** ykarel|lunch is now known as ykarel11:59
dalvarezhi guys, anyone familiar with this error? http://paste.openstack.org/show/628357/12:03
dalvarezi have checked that "openstack baremetal node list" shows every node as 'available' and there's also no stack created12:03
*** agurenko has quit IRC12:03
shardydalvarez: Hi, I just hit the same error after upgrading my undercloud12:04
shardyd0ugal: ^^ hey any ideas?12:04
shardyseems to be coming from wf=tripleo.swift_rings_backup.v1.create_swift_rings_backup_container_plan, but that hasn't changed recently AFAICS12:04
openstackgerritMerged openstack/tripleo-common master: Pass the execution id to AnsibleAction  https://review.openstack.org/52461712:05
shardydalvarez: FWIW this is what got updated https://paste.fedoraproject.org/paste/8YygdPNWWXBizYC-0Jsh3g12:08
shardynot yet figured out what the root cause is12:08
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663412:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)12:10
*** ooolpbot has quit IRC12:10
openstackgerritMerged openstack/tripleo-common master: Concurrent upload container images  https://review.openstack.org/52205512:17
openstackgerritLee Yarwood proposed openstack/tripleo-specs master: WIP ffu: Spec update for M2  https://review.openstack.org/52635312:18
lyarwoodmarios, chem ^ FYI, spec update for FFU, WIP while I work on this today but reviews welcome12:19
*** ansmith has quit IRC12:19
chemlyarwood: ack, will look12:19
openstackgerritLee Yarwood proposed openstack/tripleo-specs master: WIP ffu: Spec update for M2  https://review.openstack.org/52635312:21
lyarwoodme-- one day, I'll submit a change without whitespace..12:21
*** thrash|g0ne is now known as thrash12:28
mariosack thanks lyarwood12:29
oidgarhi guys, I got an error while deploying overcloud containerized in controller step 1. the error related to gnocchi (Failed running docker-puppet.py for gnocchi) - pastebin: https://da.gd/x9xwV12:30
oidgaranyone familiar with this issue?12:31
*** dprince has joined #tripleo12:34
d0ugalshardy, dalvarez: I would need to see the executor log to know what is going on. It looks like tripleo.plan.create_container failed12:34
d0ugalthere is an error in the error-handling, so we don't see the real issue. I'll fix that now.12:34
*** pchavva has joined #tripleo12:35
s_b_34343<Tengu> <jaosorior> : wanted to know that how rabbitmq works using vip or how ?12:36
s_b_34343have checked /etc/haproxy/haproxy.cfg but in this there is not protocol added for raabitmq12:37
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Correct a task name in create_swift_rings_backup_container_plan  https://review.openstack.org/52635712:37
d0ugalshardy, dalvarez: ^ that should fix the error handling issue.12:38
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split playbooks  https://review.openstack.org/52525212:39
beaglesoidgar, you probably want to check with pradk - doesn't seem to be online yet12:40
*** jpena is now known as jpena|lunch12:40
Tengus_b_34343: not sure the rabbitmq is used through haproxy.12:40
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609012:40
jaosoriors_b_34343, Tengu: rabbitmq isn't used with HAproxy12:41
Tenguit's on a specific VIP right?12:41
jaosoriornope12:41
s_b_34343yes12:41
*** leitan has joined #tripleo12:41
s_b_34343oh ok12:41
jaosoriorTengu, s_b_34343: for rabbitmq we do have all the node FQDNs.12:41
Tenguah, ok.12:42
*** ramishra has quit IRC12:42
jaosoriorbut the node registration is handled by pacemaker12:42
jaosoriorso it's all done by the resource agent12:42
jaosoriorIIRC12:42
s_b_34343can we hande that with vip12:42
s_b_34343by any cghance12:42
jaosoriors_b_34343: not sure12:43
jpichjtomasek: There's a bunch of scripts that run in "post" jobs (after a patch has merged) to update the strings in Zanata - see e.g. https://github.com/openstack-infra/project-config/blob/605299/jenkins/scripts/common_translation_update.sh#L253 then it follows with https://github.com/openstack-infra/project-config/blob/605299/jenkins/scripts/upstream_translation_update.sh#L11512:44
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609012:44
*** anilvenkata has quit IRC12:44
jpichjtomasek: On the other side, a periodic job runs every morning to submit the translations back to the project12:44
jtomasekjpich: awesome, thanks12:45
jpichjtomasek: I wrote up the notes from my deep dive about that stuff at http://www.jpichon.net/blog/2017/07/tripleo-deep-dive-internationalisation-ui/ if you want more nitty gritty details, there's a link to the recording as well. Not sure how much has changed with the migration to zuul v3, the scripts seem to still exist in the same repo at least!12:45
*** pdeore has quit IRC12:47
*** lucasagomes is now known as lucas-hungry12:47
*** psahoo has quit IRC12:48
beaglesshardy, is there some kind of known issue with gnocchi deployment? oidgar is getting this             "Error: /Stage[main]/Gnocchi::Wsgi::Apache/Openstacklib::Wsgi::Apache[gnocchi_wsgi]/File[gnocchi_wsgi]: Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/lib/python2.7/site-packages/gnocchi/rest/app.wsgi",12:49
*** vpickard_ is now known as vpickard12:49
beaglesshardy, his fpaste for all of the results is https://paste.fedoraproject.org/paste/XfvZvYxQomWDqWXcvbRmEA12:50
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603012:50
beaglesshardy, there is an undefined "deploy_config_name" warning above it a few lines  - don't know if that's related at all12:50
d0ugalthrash: https://review.openstack.org/#/c/526357/ - quick patch to fix an error in a workflow if you have a moment.12:51
beaglesthough it must just be something that is happening in his environment otherwise the CI jobs would be blowing up too12:51
*** rhallisey has joined #tripleo12:51
openstackgerritAdriano Petrich proposed openstack/tripleo-quickstart-extras master: [WIP] Support running tripleo-common-tempest-plugin on an undercloud  https://review.openstack.org/52230012:53
*** psachin has quit IRC12:59
*** BryanS68 has joined #tripleo12:59
*** dsariel has quit IRC13:01
*** ykarel has quit IRC13:03
*** dparkes has quit IRC13:04
*** liverpooler has joined #tripleo13:05
*** yprokule has joined #tripleo13:06
fultonjwould anyone like to review https://review.openstack.org/#/c/520357 ?13:09
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DO NOT MERGE] Testing upgrade.  https://review.openstack.org/52340813:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663413:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)13:10
*** ooolpbot has quit IRC13:10
*** oidgar is now known as oidgar___13:10
jaosoriorfultonj: will review for beer13:10
fultonjjaosorior: you got it, i'll get you a pint in Dublin13:10
fultonj:)13:10
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: remove the heat upgrade steps for Q upgrade workflow  https://review.openstack.org/52601713:11
shardySo *that's* the trick to getting faster reviews around here :D13:11
dalvarezshardy, d0ugal thanks guys, looking into it now13:11
jaosoriorfultonj: it's bit confusing though, the original patch was reverted some days later https://review.openstack.org/#/c/503610/13:11
*** ykarel has joined #tripleo13:12
shardybeagles: looking, not aware of any issues but tbh I don't enable telemetry things for my local testing13:12
fultonjjaosorior: eek, my bad13:12
*** ansmith has joined #tripleo13:12
beagles shardy: heheh, I haven't in the last two weeks either. I think it might actually be caused by a stale overcloud image. Or's going to try rebuilding his and we'll go from there.13:12
jaosoriorfultonj: it apparently was reverted due to it missing some heat functionality. Is that functionality available in pike already?13:13
fultonjjaosorior: i doubt it13:13
fultonjjaosorior: sorry i will look into that13:13
jaosoriorno biggie13:13
fultonjjaosorior: good catch13:13
shardybeagles: yeah that would be the first thing to try13:13
shardyupdate undercloud & overcloud full then re-test13:14
*** oidgar___ has quit IRC13:14
shardyd0ugal: thanks for the patch, re-testing locally now13:14
* shardy wonders why CI isn't broken in the same way13:15
*** jlabarre has joined #tripleo13:15
*** janki has quit IRC13:15
d0ugalshardy: thanks, if you have the logs I can try and dig out the real error.13:17
shardyhttp://paste.openstack.org/show/628362/13:20
shardyd0ugal: I think that's where the problems started - did it pass CI because we're not testing validations?13:20
shardyValidating overcloud-swift-rings with pattern ^[a-zA-Z0-9-]+$ pattern_validator13:21
chandankumaralee: around?13:21
chandankumaralee: i have take a look at the barbican tempest changes13:21
thervechem, Re upgrade error, there is an obvious bug here: https://github.com/openstack/tripleo-common/blob/master/workbooks/swift_rings_backup.yaml#L7513:21
*** pkovar has joined #tripleo13:21
therveA different one than reported though13:21
d0ugalshardy: That error is usually expected.13:22
chandankumaralee: you need to add one config in tempest_extra_config service_avaailable.barbican: True13:22
chandankumarin order to invoke barbican tests13:22
shardytherve: think that is the same issue d0ugal and I are discussing?13:22
shardyhttps://review.openstack.org/#/c/526357/1/workbooks/swift_rings_backup.yaml13:22
therveAh maybe :)13:23
*** dpeacock has quit IRC13:23
* therve reads13:23
d0ugaltherve: https://review.openstack.org/52635713:23
sshnaidm|roverarxcruz, let's see if it happens again: https://bugs.launchpad.net/tripleo/+bug/173695013:23
openstackLaunchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [High,Triaged]13:23
therved0ugal, Yeah +1. chem was updating https://bugs.launchpad.net/tripleo/+bug/1725338 but it's not the same workflow at all13:23
openstackLaunchpad bug 1725338 in tripleo "update_nodes workflow doesn't report errors properly" [High,Triaged]13:23
*** ykarel has quit IRC13:24
*** dpeacock has joined #tripleo13:24
d0ugalRight13:25
*** tzumainn has joined #tripleo13:25
*** bfournie has quit IRC13:25
chemtherve: d0ugal maybe not the same workflow but exactly the same error "error=Unknown function "#property#result", data={}"13:25
*** bfournie has joined #tripleo13:25
thervechem, Sure, but that's a generic error13:25
d0ugalIt just means task() returns None13:26
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split playbooks  https://review.openstack.org/52525213:27
therveThat bug is actually probably fixed13:27
shardyHmm, well it's the error that gets displayed to the user via the CLI, so not all that informative13:27
*** athomas has quit IRC13:28
*** skramaja has quit IRC13:28
*** abregman|mtg is now known as abregman13:28
openstackgerritSven Anderson proposed openstack/tripleo-heat-templates master: Expose logs from nova_libvirt container  https://review.openstack.org/52229513:29
therveshardy, the expression is just before, that's where the meaningful part is13:29
therveNo that it's much better13:29
*** lucas-hungry is now known as lucasagomes13:29
shardyhttps://paste.fedoraproject.org/paste/CCbK0qPZyq~wSgMlbIV1GA13:29
shardyack, well those are the relevant logs I think13:29
*** bfournie has quit IRC13:30
therveCan not evaluate YAQL expression [expression=task(create_container_failed).result13:30
*** oidgar___ has joined #tripleo13:30
openstackgerritLuke Hinds proposed openstack/puppet-tripleo master: Implements AIDE Intrusion Detection System  https://review.openstack.org/48302513:31
shardyyeah so the patch from d0ugal should fix it I guess, re-testing now13:31
chemholser: so https://review.openstack.org/#/c/526357/1/workbooks/swift_rings_backup.yaml should fix the current upgrade error13:31
holserchem let me check13:32
therved0ugal, Couldn't we delete all the task(stuff).result by passing data explicitly?13:32
marioschem: do you mean this one https://logs.rdoproject.org/80/526080/5/openstack-check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-master/Zfa08883effa24240a994f0d522381af9/undercloud/home/jenkins/overcloud_upgrade_console.log.txt.gz#_2017-12-07_10_18_2613:32
thervemarios, Yes13:33
d0ugaltherve: yeah, by publishing? we could.13:33
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates master: Implements AIDE Intrusion Detection System  https://review.openstack.org/48302813:33
chemmarios: yes13:33
d0ugaltherve: but not sure I follow exactly13:33
therved0ugal, Well, always do task().result, never task(other).result13:33
*** rlandy has joined #tripleo13:33
d0ugaltherve: yup, that would be better I think.13:34
therveAs we don't have any validation that "other" actually run at the point of calling13:34
mariostherve: thanks. chem for pike it is valid but for master i've decided not to look into the errors/file bugs because it is running the wrong thing (i.e. until https://review.openstack.org/#/c/526006/)13:34
*** janki has joined #tripleo13:34
marioschem: does it make sense? so i guess you are referring to the pike upgrade job specifically?13:34
*** vpickard is now known as vpickard_13:34
holserchem - there is a bigger issue13:34
mariosholser: chem i didn't see the pike logs and didn't realise it is failing on the same thing (assuming you are indeed referring to the pike job here)13:35
*** brault has joined #tripleo13:36
thervechem, marios so yeah it shouldn't fix the issue, but you'll get the real error instead13:37
chemmarios: hum ... nope this is master-undercloud-pike-overcloud, so yes, it's not implementing the right workflow.13:37
thervecreate_container shouldn't be failing AFAIU13:37
chemtherve: right13:37
*** brault_ has joined #tripleo13:38
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Chanting sahara tempest plugin names  https://review.openstack.org/52638813:38
*** jkilpatr has quit IRC13:38
*** brault_ has quit IRC13:39
chemmarios: oki, so everything for master is there https://review.openstack.org/#/c/526006/ then,13:39
chemholser: what was the bigger issue ?13:39
marioschem: no, well the dependency is the implementation for the upgrade. that is just changing the upgrade script13:39
*** brault_ has joined #tripleo13:39
marioschem: but that is what we need to run on the gate-tripleo-ci-centos-7-containers-multinode-upgrades-master13:39
*** brault has quit IRC13:40
chemmarios: yeah, and currently it's badly red :)13:40
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Changing sahara tempest plugin names  https://review.openstack.org/52638813:40
shardyd0ugal: that gets past the original error, but now it fails with "A container with the name overcloud-swift-rings already exists"13:40
marioschem: unfortunately latest run failed on build-test-packages : Run DLRN i left a comment with pointers and trying a recheck13:41
therveshardy, Yeah that makes sense :)13:41
chemmarios: so all master upgrade jobs is the result from this review https://review.openstack.org/#/c/526006/ and the rest is currently irrelevent13:41
openstackgerritBogdan Dobrelya proposed openstack/puppet-tripleo master: Bind-mount iscsid IQN by its real host path  https://review.openstack.org/52639013:41
shardyhttp://paste.openstack.org/show/628364/ fwiw13:41
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix puppet config volume for iscsid in containers  https://review.openstack.org/52418713:41
marioschem: well for starters. I mean any error we see because we are running "openstack overcloud deploy -e major-upgrade-composable-docker.yaml ... " is irrelevant right now13:41
chemmarios: that's unfortunate that we don't have a always working upgrade path though13:42
marioschem: since we instead want to be running openstack overcloud upgrade --init-update --container-registry-file etc13:42
*** adarazs is now known as adarazs_brb13:43
marioschem: and as you know they are different things entirely, the new one doesn't apply any of the heat deployment steps "noop stack update" for the playbooks13:43
shardytherve, d0ugal: so it seems like the/an issue is we don't delete the overcloud-swift-rings or overcloud-config containers when we delete the plan13:43
*** agurenko has joined #tripleo13:43
*** agurenko has quit IRC13:43
marioschem: well yeah it is unfortunate that we are changing the workflow again. but in this particular case deployment will also move in a similar direction eventually with ansible-playbook13:44
marioschem: so the pike upgrade job will be doing a different thing to the master upgrade job13:44
therveshardy, Hum, do we delete the plan at that point?13:45
therveIt feels that update_deployment_plan should just be fixed13:45
chemmarios: oki, so master upgrade jobs is going to be broken for a while13:45
shardytherve: I did overcloud plan delete as this is a new deployment, where I'd previously only deleted the stack13:46
*** jpena|lunch is now known as jpena13:46
shardythe first thing I tried was cleaning out the plan, but it doesn't delete all plan-related things AFAICS13:46
therveWait hold, there is a check_container right there13:46
chemmarios: in the meantime fix o->p upgrade jobs and try to have https://review.openstack.org/#/c/526006/ green as soon as we can13:46
shardyopenstack container delete --recursive overcloud-swift-rings worked around it13:46
marioschem: ack i'd like to at least see this running for starters https://review.openstack.org/#/c/526006 so we can start to see the real errors for the ugprade path. I expect the first thing will be to remove most of the current upgrade_tasks (like stop/disable systemd things)13:47
marioschem: *master upgrade path i mean13:47
shardymarios: to clarify, when you say remove, you mean not use in the container upgrade case?13:48
mariosshardy: not use in the container to container right yes13:48
therveshardy, http://paste.openstack.org/show/628365/ ?13:48
shardyas we discussed yesterday, we still may have some users needing to do BM->container upgrades for Queens13:48
shardye.g I know Tengu is expecting to do that13:48
mariosshardy: ack so it would be removal of the tasks in docker/services which are about stopping systemd things13:48
shardymarios: ah, yeah makes sense, thanks for clarifying :)13:49
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745013:49
shardytherve: ah, yeah looks likely but I've deleted it now, will reproduce on my next debug iteration13:49
* shardy was trying to test a different thing before hitting this..13:50
mariosshardy: but do you mean BM Pike going to containers in Q. in which case they would still need the docker/services tasks for removing their systemd things13:50
mariosshardy: i.e. someone that is still on BM on their Pike deployment13:50
mariosshardy: in which case we can at least make sure they work in both cases with the appropriate conditionals13:50
shardymarios: yeah, we have some users of upstream builds that may expect that13:50
*** jkilpatr has joined #tripleo13:50
mariosshardy: i.e. do remove the systemd things if they are still things13:50
*** dsariel has joined #tripleo13:51
shardymarios: so we should make a decision about the status of support for baremetal for the Queens release, but make a best-effort to keep bm->container upgrade working until the deprecated bm stuff is removed13:51
shardymarios: ack, yeah I thought we mostly already had conditionals and/or the tasks would be no-ops in the case where things are already disabled13:51
shardyperhaps we could disable the validations by default13:51
shardyas those I expect are the main things that will cause problems?13:52
shardye.g the is service enabled validation tasks13:52
mariosshardy: hmm so that is a different job then ... i mean having pike baremetal going to Q.. as you know for the P cycle our QE was focused on the containers case13:53
shardymarios: I'm not saying it's something we necessarily have to keep in the CI test matrix, only that we should try to be sympathetic to the small subset of users it may impact, and make changes accordingly13:53
*** adarazs_brb is now known as adarazs13:53
mariosshardy: i mean we would need a job that starts with non containerized stable/pike and upgrades it to containerized master/Q using the new workflow13:54
mariosshardy: ack this is useful thanks. chem we should add that one to the list :D13:54
marioschem: we'll be done by christmas right13:54
marios:(13:54
holsermarios - we should have both jobs13:56
mariosholser: yeah indeed13:56
mariosholser: i was mostly commenting on how bad our current ci coverage is for the upgrades13:56
mariosholser: and we are all looking into different things right now and it will be a lot to get it all running13:57
holsermarios: I am with you... you have my vote13:57
*** bfournie has joined #tripleo13:58
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: WIP: Add support for providing Octavia cert data  https://review.openstack.org/52640413:58
chemmarios: holser so yeah, we have o->p, p->master and this is a bug, we should have pike to ocata13:58
chemmarios: holser I can make the patch quickly enough ...13:59
holsermarios, I would say it's not CI problem... there should be periodic jobs that run all possible scenarios weekly13:59
*** ihrachys has joined #tripleo13:59
holserotherwise, if we run these scenarios on every patch we'll run out of HW soon13:59
*** shreshtha has quit IRC14:00
mariosholser: ack and we are lucky that we can now run the upgrades jobs on rdo cloud since otherwise we would always timeout14:00
holsernightly or weekly testing for all set of possible scenarios14:00
chemI'm saying nonsense ...14:00
marioschem: you lost me at " we should have pike to ocata"14:01
chemmarios:^14:01
marioschem: downgrades? :D14:01
*** links has quit IRC14:01
chemmarios: oki, so nothing to do for current upgrade beside waiting that the workflow works somehow14:01
mariosholser: i.e. we couldn't even define 'proper' upgrades jobs, e.g. with the upgrade-non-controller.sh part for the Pike and earlier upgrades14:02
*** abhishekk has joined #tripleo14:02
holser:P14:02
mariosholser: we were runnign the upgrade14:02
mariosholser: but only the controller part for exmaple14:02
marioschem: well i am also trying to run it on my rdo box14:03
marioschem: which i should go and do instead of irc :D14:03
*** lblanchard has joined #tripleo14:03
chemmarios: using traas I think I should be able to have the env as well ... going to do that14:04
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Need to add openstack-selinux with OVS  https://review.openstack.org/52560814:04
chemmarios: anyway that's better than last cycle we have a review to look for14:04
marioschem: careful you're starting to sound optimistic there14:05
*** milan has joined #tripleo14:05
openstackgerritMerged openstack/tripleo-common master: Stop setting IRONIC_API_VERSION and OS_BAREMETAL_API_VERSION in overcloudrc  https://review.openstack.org/52282514:05
openstackgerritMerged openstack/tripleo-validations stable/pike: Validate library files for documentation string  https://review.openstack.org/52608514:05
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663414:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)14:10
milanfolks, I'd like to perform some clean-up steps in t-h-t for both a containerised and a regular service; I've managed to figure out how to do it for the container case https://review.openstack.org/#/c/523909/2/docker/services/ironic-inspector.yaml@224 but apparently I need to do it in both the cases14:11
milanwhere  do I do that?14:11
*** thrash is now known as thrash|biab14:12
*** shreshtha has joined #tripleo14:13
*** dbecker has joined #tripleo14:13
shardymilan: there's a puppet/services/ironic-inspector.yaml file, which you're already modifying in your patch14:14
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745014:15
milando I just add upgrade_tasks in outputs.role_data.value?14:15
milanshardy, ^14:15
shardymilan: you can probably move the upgrade_tasks there, and reference them in the docker template like config_settings14:15
*** jmelvin has joined #tripleo14:15
*** dsariel has quit IRC14:15
shardye.g like on line 6514:15
milanshardy, /me looks14:16
shardymilan: yes, you can move the entire upgrade_tasks block to the puppet template I think, as I don't see one there already?14:16
milanshardy, correct, there's none yet14:16
shardythen reference the data from IronicInspectorBase in the docker/services file14:16
milanshardy, thx, will do14:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: [WIP] Minor update testing for Pike on.  https://review.openstack.org/52640814:17
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745014:17
*** suuuper has joined #tripleo14:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: [WIP] minor overcloud update testing.  https://review.openstack.org/52640914:19
openstackgerritAna Krivokapic proposed openstack/tripleo-validations master: Enhance repo validation to check for unwanted enabled repos  https://review.openstack.org/51541214:21
*** dbecker has quit IRC14:22
*** dprince has quit IRC14:25
jistrflaper87: that NM stuff is funny. I managed to get the origin-node started after using what you added to the patch, and DNS/traffic worked fine, but suddenly i couldn't ssh there from undercloud, and i've closed the previous session, so i've effectively locked myself out of the openshift bootstrap node again... next try i'll set the passwords for virsh console again14:25
*** shreshtha has quit IRC14:26
*** Goneri has joined #tripleo14:26
*** dbecker has joined #tripleo14:26
flaper87jistr: oh, mmh, weird. Had the installation ended when you got locked out?14:26
flaper87jistr: did the script work just fine?14:27
flaper87it seems to work for me but wondering if you had to change something14:27
jistrflaper87: the script seemed to do the right thing, though i had to execute it manually. And then i tried to re-run the installer, which didn't get far and that's how i discovered the lockout.14:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations stable/ocata: Fix `when` statement in deployment image validation  https://review.openstack.org/52641214:27
flaper87jistr: mmh, it should run on every NM restart14:28
flaper87mmhh14:28
flaper87jistr: Ideally, we should move this script to openshift-ansible (or something similar) but till then, it should work14:28
flaper87:/14:28
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split multinode playbook  https://review.openstack.org/52641414:28
openstackgerritMilan Kováčik proposed openstack/tripleo-heat-templates master: Enable inspector dnsmasq dhcp filter  https://review.openstack.org/52390914:29
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split ovb playbook  https://review.openstack.org/52525214:30
milanhopefully my cargo-fu worked shardy dtantsur ^^14:30
*** dpawar has quit IRC14:31
*** dpawar has joined #tripleo14:31
flaper87jistr: did you check why it didn't run automagically?14:32
flaper87jistr: if you check /var/log/messages you should see it there, somewhere14:33
flaper87oh, mmh, it doesn't have executable perms14:34
flaper87>.>14:34
jistrflaper87: i'm trying again, and yes that's exactly what i noticed, i set it to 755 for this run :)14:34
flaper87silly me14:34
flaper87jistr: change the playbook, add 0744 instead of 064414:34
jistrbut i'm not 100% sure it's the cause, i didn't investigate / see any message that would point to it14:35
*** ramishra has joined #tripleo14:35
jistrflaper87: yea that's what i did14:35
flaper87jistr: it has to be 074414:35
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Deploy OpenShift using OOO on the overcloud  https://review.openstack.org/49447014:35
flaper87jistr: NM checks that no-one but root has write permissions on that script14:35
flaper87it has to be owned by root14:35
openstackgerritMerged openstack/tripleo-quickstart-extras master: Send ARA statistics to Graphite server  https://review.openstack.org/47988214:35
flaper87and, of course, executable14:35
flaper87jistr: ^14:35
flaper87jistr: just updated the patch14:35
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: [DO NOT MERGE] Just testing, nothing to see here  https://review.openstack.org/52110014:36
*** dpawar has quit IRC14:36
*** pkovar has quit IRC14:37
jistrflaper87: ack ok. 0755 is still not writable by others... i saw how the other scripts there were and i thought it was 755 but i don't have the output anymore14:39
jistrflaper87: anyway i'm deploying multimaster and had to add a variable, i'd push an update to the patch so that i don't have to keep stashing it locally if that's ok?14:40
flaper87jistr: I meant to say not-writable/executable but apparently it's just non-writable, which means 755 should be fine14:40
flaper87jistr: totes, feel free to push updates to the patch14:40
jistrcool thx14:40
shardyfultonj: Hey I think you had an issue yesterday with a missing undercloud install script w/oooq - I just hit the same14:44
shardylooks like https://review.openstack.org/#/c/526334 may be the fix14:44
fultonjshardy: thanks14:44
fultonjshardy: https://bugs.launchpad.net/tripleo/+bug/173685914:45
openstackLaunchpad bug 1736859 in tripleo "[oooq] undercloud-install.sh: No such file or directory" [Medium,In progress] - Assigned to Sanjay Upadhyay (saneax)14:45
fultonji filed ^14:45
fultonjand then workaround there fixed (-t all)14:45
shardyfultonj: ah, thanks, hadn't yet checked the bug :)14:45
fultonjshardy: looks like that's the fix though14:45
fultonjthanks14:45
shardyfultonj: cool, re-testing it now & will +2 after14:46
*** jmelvin has quit IRC14:48
*** BryanS68 has quit IRC14:48
*** aufi has quit IRC14:48
*** kbyrne has quit IRC14:48
*** dhill_ has quit IRC14:48
*** openstackgerrit has quit IRC14:48
*** sai has quit IRC14:48
*** sshnaidm|rover has quit IRC14:48
*** lyarwood has quit IRC14:48
*** mburned has quit IRC14:48
*** timothyb89 has quit IRC14:48
*** lifeless has quit IRC14:48
*** leifmadsen has quit IRC14:48
*** afazekas has quit IRC14:48
*** sc has quit IRC14:48
*** gkadam has quit IRC14:48
*** jtomasek has quit IRC14:48
*** alee has quit IRC14:48
*** verdurin has quit IRC14:48
*** tvignaud has quit IRC14:48
*** dciabrin has quit IRC14:48
*** mmethot has quit IRC14:48
*** rasca has quit IRC14:48
*** chandankumar has quit IRC14:48
*** mwhahaha has quit IRC14:48
*** fungi has quit IRC14:48
*** portdirect has quit IRC14:48
*** v1k0d3n has quit IRC14:48
*** mrch has quit IRC14:48
*** ChanServ has quit IRC14:48
*** pchavva has quit IRC14:48
*** raildo has quit IRC14:48
*** akrivoka has quit IRC14:48
*** florianf has quit IRC14:48
*** dsneddon has quit IRC14:48
*** rdopiera has quit IRC14:48
*** StevenK has quit IRC14:48
*** slagle has quit IRC14:48
*** dalvarez has quit IRC14:48
*** eck` has quit IRC14:48
*** therve has quit IRC14:48
*** lblanchard has quit IRC14:48
*** tzumainn has quit IRC14:48
*** salmankhan has quit IRC14:48
*** moshele has quit IRC14:48
*** safchain has quit IRC14:48
*** Vijayendra has quit IRC14:48
*** SlickNik has quit IRC14:48
*** stevebaker has quit IRC14:48
*** mfedosin has quit IRC14:48
*** japestinho has quit IRC14:48
*** larsks has quit IRC14:48
*** panda has quit IRC14:48
*** akrzos has quit IRC14:48
*** vpickard_ has quit IRC14:48
*** sdoran has quit IRC14:48
*** jpena has quit IRC14:48
*** rhallisey has quit IRC14:48
*** leitan has quit IRC14:48
*** sri_ has quit IRC14:48
*** paramite has quit IRC14:48
*** zshi has quit IRC14:48
*** nguyentrihai has quit IRC14:48
*** jrist has quit IRC14:48
*** dtrainor has quit IRC14:48
*** ianw has quit IRC14:48
*** adarazs has quit IRC14:48
*** suuuper has quit IRC14:48
*** brault_ has quit IRC14:48
*** jlabarre has quit IRC14:48
*** ansmith has quit IRC14:48
*** marios has quit IRC14:48
*** daidv has quit IRC14:48
*** holser has quit IRC14:48
*** radeks has quit IRC14:48
*** mandre has quit IRC14:48
*** rfolco has quit IRC14:48
*** hamzy has quit IRC14:48
*** mgkwill_ has quit IRC14:48
*** tbarron has quit IRC14:48
*** oanson has quit IRC14:48
*** dmacpher has quit IRC14:48
*** tristanC has quit IRC14:48
*** matbu has quit IRC14:48
*** trown has quit IRC14:48
*** jbadiapa has quit IRC14:48
*** Slower has quit IRC14:48
*** michchap has quit IRC14:48
*** tdasilva has quit IRC14:48
*** Ng has quit IRC14:48
*** mugsie has quit IRC14:48
*** vkmc has quit IRC14:48
*** melwitt has quit IRC14:48
*** dmanchad has quit IRC14:48
*** jkilpatr has quit IRC14:48
*** yprokule has quit IRC14:48
*** abishop has quit IRC14:48
*** milan has quit IRC14:48
*** ffiore has quit IRC14:48
*** jaosorior has quit IRC14:48
*** myoung|ruck has quit IRC14:48
*** toure has quit IRC14:48
*** sileht has quit IRC14:48
*** stee_3 has quit IRC14:48
*** bcafarel has quit IRC14:48
*** lennyb has quit IRC14:48
*** janki has quit IRC14:48
*** oidgar___ has quit IRC14:48
*** gfidente has quit IRC14:48
*** iranzo has quit IRC14:48
*** bogdando has quit IRC14:48
*** numans has quit IRC14:48
*** colonwq has quit IRC14:48
*** EmilienM has quit IRC14:48
*** migi has quit IRC14:48
*** tonyb has quit IRC14:48
*** markmc has quit IRC14:48
*** remix_tj has quit IRC14:48
*** thrash|biab has quit IRC14:48
*** cschwede has quit IRC14:48
*** ansiwen has quit IRC14:48
*** lhinds has quit IRC14:48
*** pabelanger has quit IRC14:48
*** beagles has quit IRC14:48
*** mathiasb has quit IRC14:48
*** mmethot has joined #tripleo14:49
*** dciabrin has joined #tripleo14:50
*** sdoran has joined #tripleo14:53
*** alee has joined #tripleo14:54
*** verdurin has joined #tripleo14:54
*** tvignaud has joined #tripleo14:54
*** rasca has joined #tripleo14:54
*** chandankumar has joined #tripleo14:54
*** mwhahaha has joined #tripleo14:54
*** fungi has joined #tripleo14:54
*** portdirect has joined #tripleo14:54
*** v1k0d3n has joined #tripleo14:54
*** barjavel.freenode.net sets mode: +ov mwhahaha mwhahaha14:54
*** pchavva has joined #tripleo14:54
*** raildo has joined #tripleo14:54
*** akrivoka has joined #tripleo14:54
*** florianf has joined #tripleo14:54
*** dsneddon has joined #tripleo14:54
*** rdopiera has joined #tripleo14:54
*** StevenK has joined #tripleo14:54
*** slagle has joined #tripleo14:54
*** eck` has joined #tripleo14:54
*** dalvarez has joined #tripleo14:54
*** therve has joined #tripleo14:54
*** d0ugal has quit IRC14:54
*** sc has joined #tripleo14:54
*** afazekas has joined #tripleo14:54
*** leifmadsen has joined #tripleo14:54
*** lifeless has joined #tripleo14:54
*** timothyb89 has joined #tripleo14:54
*** mburned has joined #tripleo14:54
*** lyarwood has joined #tripleo14:54
*** sshnaidm|rover has joined #tripleo14:54
*** sai has joined #tripleo14:54
*** openstackgerrit has joined #tripleo14:54
*** dhill_ has joined #tripleo14:54
*** BryanS68 has joined #tripleo14:54
*** suuuper has joined #tripleo14:54
*** milan has joined #tripleo14:54
*** lblanchard has joined #tripleo14:54
*** jkilpatr has joined #tripleo14:54
*** brault_ has joined #tripleo14:54
*** janki has joined #tripleo14:54
*** oidgar___ has joined #tripleo14:54
*** tzumainn has joined #tripleo14:54
*** jlabarre has joined #tripleo14:54
*** ansmith has joined #tripleo14:54
*** yprokule has joined #tripleo14:54
*** rhallisey has joined #tripleo14:54
*** salmankhan has joined #tripleo14:54
*** marios has joined #tripleo14:54
*** abishop has joined #tripleo14:54
*** mathiasb has joined #tripleo14:54
*** daidv has joined #tripleo14:54
*** ffiore has joined #tripleo14:54
*** sri_ has joined #tripleo14:54
*** paramite has joined #tripleo14:54
*** moshele has joined #tripleo14:54
*** gfidente has joined #tripleo14:54
*** iranzo has joined #tripleo14:54
*** bogdando has joined #tripleo14:54
*** holser has joined #tripleo14:54
*** radeks has joined #tripleo14:54
*** mandre has joined #tripleo14:54
*** numans has joined #tripleo14:54
*** jaosorior has joined #tripleo14:54
*** zshi has joined #tripleo14:54
*** rfolco has joined #tripleo14:54
*** safchain has joined #tripleo14:54
*** hamzy has joined #tripleo14:54
*** nguyentrihai has joined #tripleo14:54
*** Vijayendra has joined #tripleo14:54
*** mgkwill_ has joined #tripleo14:54
*** tbarron has joined #tripleo14:54
*** oanson has joined #tripleo14:54
*** dmacpher has joined #tripleo14:54
*** tristanC has joined #tripleo14:54
*** jrist has joined #tripleo14:54
*** SlickNik has joined #tripleo14:54
*** matbu has joined #tripleo14:54
*** colonwq has joined #tripleo14:54
*** dtrainor has joined #tripleo14:54
*** myoung|ruck has joined #tripleo14:54
*** trown has joined #tripleo14:54
*** jbadiapa has joined #tripleo14:54
*** ianw has joined #tripleo14:54
*** beagles has joined #tripleo14:54
*** adarazs has joined #tripleo14:54
*** EmilienM has joined #tripleo14:54
*** stevebaker has joined #tripleo14:54
*** migi has joined #tripleo14:54
*** mfedosin has joined #tripleo14:54
*** toure has joined #tripleo14:54
*** Slower has joined #tripleo14:54
*** japestinho has joined #tripleo14:54
*** pabelanger has joined #tripleo14:54
*** michchap has joined #tripleo14:54
*** larsks has joined #tripleo14:54
*** lennyb has joined #tripleo14:54
*** sileht has joined #tripleo14:54
*** tonyb has joined #tripleo14:54
*** panda has joined #tripleo14:54
*** akrzos has joined #tripleo14:54
*** tdasilva has joined #tripleo14:54
*** stee_3 has joined #tripleo14:54
*** vpickard_ has joined #tripleo14:54
*** jpena has joined #tripleo14:54
*** bcafarel has joined #tripleo14:54
*** markmc has joined #tripleo14:54
*** thrash|biab has joined #tripleo14:54
*** cschwede has joined #tripleo14:54
*** Ng has joined #tripleo14:54
*** mugsie has joined #tripleo14:54
*** vkmc has joined #tripleo14:54
*** ansiwen has joined #tripleo14:54
*** lhinds has joined #tripleo14:54
*** melwitt has joined #tripleo14:54
*** dmanchad has joined #tripleo14:54
*** barjavel.freenode.net sets mode: +vv EmilienM Ng14:54
*** tzumainn has quit IRC14:55
*** sdoran has quit IRC14:55
*** sdoran has joined #tripleo14:55
*** vpickard_ is now known as vpickard14:55
*** d0ugal has joined #tripleo14:55
*** tzumainn has joined #tripleo14:55
*** oidgar___ has quit IRC14:55
*** jkilpatr has quit IRC14:55
*** tzumainn has quit IRC14:55
*** tzumainn has joined #tripleo14:56
*** jkilpatr has joined #tripleo14:56
*** leseb has quit IRC14:56
*** pkovar has joined #tripleo14:56
*** florianf is now known as florianf|afk14:56
*** yamahata has joined #tripleo14:58
*** leseb has joined #tripleo14:59
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574314:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260715:00
*** abhishekk has quit IRC15:00
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574315:01
*** artom has quit IRC15:02
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574315:02
*** zaneb has quit IRC15:04
*** aufi has joined #tripleo15:05
*** zaneb has joined #tripleo15:05
*** dsariel has joined #tripleo15:06
openstackgerritMerged openstack-infra/tripleo-ci master: Send graphite stats from ARA  https://review.openstack.org/48012115:08
openstackgerritMerged openstack/tripleo-heat-templates master: Make CephPools override properties of other pools  https://review.openstack.org/52521315:08
openstackgerritMerged openstack/puppet-tripleo master: Add support for OVN Metadata Agent  https://review.openstack.org/50294015:08
*** jmelvin has joined #tripleo15:09
*** chlong has joined #tripleo15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647515:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663415:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,Triaged]15:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)15:10
*** s_b_34343 has quit IRC15:11
*** dbecker has quit IRC15:15
*** ramishra has quit IRC15:15
jaosoriormandre: soo... should we merge the barbican or would you prefer that line to be removed first?15:15
*** ChanServ has joined #tripleo15:16
*** barjavel.freenode.net sets mode: +o ChanServ15:16
*** myoung|ruck is now known as myoung|rover15:16
jaosoriormwhahaha: around?15:16
* mwhahaha hides15:16
jaosoriorlol15:17
mwhahahasup?15:17
*** ramishra has joined #tripleo15:17
jaosoriormwhahaha: hey, so, I'm working on the tripleo-ipsec packaging. And now we gotta figure out how will that be included in the undercloud... Was thinking I could just add it as a dependency for tripleo-common. That way we could make sure it's there.15:17
*** dprince has joined #tripleo15:17
*** jbadiapa has quit IRC15:17
mwhahahaehhh15:18
*** moshele has quit IRC15:18
jaosorioropen to suggestions though15:18
mwhahahaso the tripleo-ipsec is ansible roles right?15:19
*** dhill_ has quit IRC15:19
jaosorioryes15:19
jaosoriorit's just one ansible role.15:19
mwhahahalet me see what the tripleo-commond dependencies look like15:20
dmsimardmwhahaha, EmilienM, weshay: fyi sshnaidm|rover pinged infra about rh1 connection errors when installing packages, it's addressed now so please let us know if you see any new errors from now on. We'll need to plan a maintenance to increase the disk size of the VM hosting the mirror.15:20
*** d0ugal is now known as Guest2746015:20
*** kbyrne has joined #tripleo15:20
*** shreshtha has joined #tripleo15:20
*** janki has quit IRC15:21
*** gbarros has joined #tripleo15:21
mwhahahajaosorior: so at the moment i think instack-undercloud is the correct place to add that dep right now. that being said i guess tripleo-common would work as we have a dep on ansible there15:21
mwhahahahttps://github.com/rdo-packages/tripleo-common-distgit/blob/rpm-master/openstack-tripleo-common.spec#L4415:22
mwhahahajaosorior: so maybe it's a larger question of how we want to push ansible roles in general15:22
jaosoriormwhahaha: right, that's why I mentioned tripleo-common15:22
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574315:23
*** Guest27460 has quit IRC15:23
*** itlinux has joined #tripleo15:23
*** d0ugal has joined #tripleo15:23
*** d0ugal has quit IRC15:23
*** d0ugal has joined #tripleo15:23
shardyjaosorior: if you want your deploy_steps_tasks to work with the "classic" deploy method, e.g not config download (still the default so it works with the UI), it'll need to be in the overcloud-full image, not only on the undercloud I think?15:24
shardyI need to push a t-h-t patch to make that work, but I guess tripleo-common may be better from that perspective?15:24
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs  https://review.openstack.org/52643015:25
*** links has joined #tripleo15:25
jaosoriorshardy: not looking for it to work with the classic deploy15:25
jaosoriorshardy: having it be exclusive for the config-download method is fine for me.15:25
shardyjaosorior: Ok, so it's fine if it won't work via tripleo-ui15:25
openstackgerritGonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: configure-vbmc: get user id from ansible_user_id  https://review.openstack.org/52643115:25
*** dhill_ has joined #tripleo15:25
jaosoriorshardy: either way, it wouldn't work well with the classic download, since we do need the inventory to have all the nodes there.15:25
jaosoriorand the classic download uses "localhost" on each node, IIRC15:25
EmilienMdmsimard: ack, thx15:26
shardyjaosorior: yeah we run ansible on each node via localhost15:26
shardyjaosorior: Ok cool, just wanted to check as the not working with the UI was a bigger issue e.g for the octavia integration which has some similar interface requirements15:26
jaosoriorshardy: so that's problematic for the role.15:26
weshaydmsimard++15:28
weshaythanks15:28
*** tzumainn has quit IRC15:29
mwhahahajaosorior: actually is THT going to be the thing that leverages it?15:29
*** tzumainn has joined #tripleo15:29
jaosoriorshardy, mwhahaha: So, seems that the best option so far is tripleo-common.15:29
jaosoriormwhahaha: yes.15:29
mwhahahajaosorior: then it should be a dep of THT15:29
jaosoriormwhahaha: that works for me too.15:29
shardymwhahaha: well in the --config-download case, tripleo-common contains the workflow to run ansible via t-h-t15:30
shardybut yeah maybe the dep should be t-h-t15:30
jaosoriorack15:30
jaosorioractually, t-h-t does make sense, since it's what ends up calling it anyway15:30
*** jbadiapa has joined #tripleo15:31
*** ramishra has quit IRC15:31
jaosoriormwhahaha, shardy: thanks15:32
mandreEmilienM: do we have a magic way to generate HeatAuthEncryptionKey in https://review.openstack.org/#/c/526151/?15:33
*** ramishra has joined #tripleo15:34
*** yamahata has quit IRC15:35
shardymandre, EmilienM: added a comment as I'm unclear how that works on upgrade15:36
shardyit's essential that we don't change those values on upgrade, particularly the encryption key as there's no way to recover if the old value is lost15:36
shardyso I think for generating them to be useful, we need a workflow to extract the existing values from the heat stack15:37
shardythen, in a future release, we can potentially remove the heat resources15:37
d0ugaljaosorior: hey15:39
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add support for providing Octavia cert data  https://review.openstack.org/52640415:39
*** itlinux has quit IRC15:41
mandreshardy: isn't that case covered by https://review.openstack.org/#/c/526151/2/tripleo_common/utils/passwords.py@50?15:42
shardymandre: No, because the value is generated by a resource in the stack15:43
shardyso it's not in parameter_defaults15:43
mandreoh ok15:43
shardywe need to do a resource list and get the value from the stack directly15:43
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L72715:44
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo master: Add incoming storage driver param  https://review.openstack.org/52424015:44
shardymandre: probably doing a resource show on the DefaultPasswords resource is the easiest way15:44
EmilienMmandre, shardy: yeah I was worried about upgrades15:45
slaglejistr: have you seen any issues with running the enable-ssh-admin.sh script with ovb? i've been trying to get https://review.openstack.org/#/c/525331/ to pass15:45
EmilienMshardy: the resource will not be generated if it's already in the generated-password file, isn't?15:45
*** sshnaidm|rover is now known as sshnaidm|ruck15:46
slaglejistr: but ssh just hangs when running that script. i've added -vvv to the ssh command from the script, but it's not really showing what's wrong. http://logs.openstack.org/31/525331/5/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/f705a93/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz15:46
shardyEmilienM: No it's always created here https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L30415:47
shardyEmilienM: so I think passing a parameter will override the RandomString value15:47
EmilienMshardy: oh I see now why we need to extract the previous one15:47
shardyunless I'm missing something, that will be very bad for upgrades15:47
jistrslagle: yea i hit it yesterday locally, most likely it's waiting for ack on ssh fingerprint15:47
EmilienMshardy: we need to block it15:47
*** aufi has quit IRC15:48
jistrslagle: we either need to disable strict key checking, or ssh-keyscan15:48
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs  https://review.openstack.org/52643015:48
slaglejistr: yea, good point. seems likely15:48
slaglei'll try in my test patch15:48
jistrslagle: ack, thanks15:49
*** abregman is now known as abregman|mtg15:49
*** itlinux has joined #tripleo15:49
*** ramishra has quit IRC15:50
*** alee has quit IRC15:50
*** dparkes has joined #tripleo15:51
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: DO NOT MERGE - test  https://review.openstack.org/52613115:51
openstackgerritJames Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download  https://review.openstack.org/52533115:51
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Undercloud deploy: use docker-uc.yaml  https://review.openstack.org/52633715:52
*** salmankhan has quit IRC15:54
*** itlinux has quit IRC15:54
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Configure temporary URLs for Ironic Ansible deploy method  https://review.openstack.org/52643915:55
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52644015:56
*** dpawar has joined #tripleo15:56
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856715:56
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941915:56
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346315:56
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles  https://review.openstack.org/50983215:56
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow  https://review.openstack.org/51504515:56
*** links has quit IRC15:59
*** suuuper has quit IRC15:59
*** itlinux has joined #tripleo15:59
openstackgerritGonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: configure-vbmc: get user id from ansible_user_id  https://review.openstack.org/52643116:01
*** tosky has quit IRC16:03
*** itlinux has quit IRC16:04
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Deploy OpenShift using OOO on the overcloud  https://review.openstack.org/49447016:04
jistrflaper87: posted another tweak ^16:05
*** rhallisey has quit IRC16:06
flaper87jistr: danke, will get it while it is hot (and before zuul -1's it... or not)16:06
*** salmankhan has joined #tripleo16:06
* jistr retrying on latest now16:06
*** itlinux has joined #tripleo16:06
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test ci  https://review.openstack.org/52644316:08
*** jmelvin_ has joined #tripleo16:08
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: WIP Testing using ansible-playbook in place of quickstart.sh  https://review.openstack.org/52432016:08
*** pkovar has quit IRC16:09
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci master: Need to add openstack-selinux with OVS  https://review.openstack.org/52560816:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647516:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,Triaged]16:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)16:10
*** tosky has joined #tripleo16:10
*** jmelvin has quit IRC16:10
flaper87jistr: check whether it's setting the right permissions on the file for you16:12
flaper87it didn't seem to work for me :/16:12
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745016:13
*** dpawar has quit IRC16:15
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split multinode playbook  https://review.openstack.org/52641416:16
*** fzdarsky has joined #tripleo16:20
jistri'll know in a few mins...16:22
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation  https://review.openstack.org/52621316:23
jistrflaper87: yea the latest state got me 755 permissions on the file16:24
*** paramite has quit IRC16:25
*** oidgar has joined #tripleo16:25
jistrflaper87: just a guess -- if you apply the change locally without stack-update and config download, you need to edit external_deploy_steps_tasks.yaml, not openshift playbook.yaml. The playbook.yaml gets overwritten each time the deployment is executed. I got burned by this earlier.16:26
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Configure temporary URLs for Ironic Ansible deploy method  https://review.openstack.org/52643916:26
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Collect unbound ttl config file  https://review.openstack.org/52644716:27
sshnaidm|ruckdmsimard, ^^16:27
oidgarmwhahaha: hi Alex, we've updated our ansible code and split the role task files. can take a quick look on that and tell if you have some comments for now?16:27
sshnaidm|ruckdmsimard, let's collect it and we'll see16:27
mwhahahaoidgar: yea16:27
dmsimardsshnaidm|ruck: it's already collected... like all of /etc is collected16:27
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-common master: WIP ffu: Introduce Fast Forward Upgrade workbook  https://review.openstack.org/51931716:27
dmsimardsshnaidm|ruck: see the eavesdrop16:27
sshnaidm|ruckdmsimard, nope, we don't collect all /etc16:27
flaper87jistr: nah, I ahd destroyed the overcloud16:28
flaper87jistr: *shrugs*16:28
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add missing steps from tripleo-ci ovb playbook  https://review.openstack.org/52645116:28
dmsimardsshnaidm|ruck: oh, hrm16:28
openstackgerritAthlan-Guyot sofer proposed openstack/python-tripleoclient master: WIP ffu: Introduce Fast Forward Upgrade command and workflow  https://review.openstack.org/51931616:28
flaper87jistr: it seems to be moving forward16:28
dmsimardok.16:28
sshnaidm|ruckdmsimard, that's why I HATE whitelists16:28
dmsimardsshnaidm|ruck: I'm totally fine with whitelists :D16:28
flaper87jistr: btw, it's a public holiday here tomorrow. I wanted to move the NM bits (install and enable) to oooq. Would you like to help with that? OTherwise I'll do it on monday16:29
*** marios has quit IRC16:29
*** ukalifon has quit IRC16:30
*** dparkes has quit IRC16:30
mwhahahaoidgar: so the structure looks better but I still had questions about composable services as this implementation seems to make assumptions about where the services actually run16:30
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB  https://review.openstack.org/51350816:31
*** fzdarsky has quit IRC16:31
jistrflaper87: sure i can help with that. Thinking out loud -- normally something like this would go into the base image, but since this is specific to openshift which is not yet our production way of deploying, we probably want to hold off on image changes. Is there a direct benefit of moving it out of the openshift service though?16:32
openstackgerritJulie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs  https://review.openstack.org/52643016:33
*** dmsimard is now known as dmsimard|afk16:34
*** dsariel has quit IRC16:38
*** shreshtha has quit IRC16:38
mwhahahasdoran: is there a module to manage ifcfg files in ansible that isn't nmcli?16:39
*** alee has joined #tripleo16:39
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745016:39
*** ccamacho has quit IRC16:39
*** cshastri has joined #tripleo16:39
sdoranmwhahaha: `template`16:40
mwhahahameh16:41
jistrflaper87: so far i can see that 99-os-net-config-origin-dns.sh ran before 99-origin-dns.sh existed (so it failed), but if it's going to re-run again later it may still be fine16:42
*** bogdando has quit IRC16:43
* jistr 's deployment still in progress16:43
openstackgerritMerged openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout  https://review.openstack.org/52559416:43
sdoranmwhahaha: Looks like there is actually an `interfaces_files` module16:44
oidgarmwhahaha: actually the controller name is misleading as we pass the nodes that octavia lives inside from mistral so it is dynamic. it can be the controller nodes or the network nodes for example. we will change the name of it.16:44
sdoranMuch more better16:44
*** isq_ has joined #tripleo16:44
mwhahahasdoran: yea but lacks options of the actual files, like you can't set types and stuff. oh well16:44
mwhahahasdoran: was hoping for something other than template/manual ifups16:45
mwhahahaoidgar: ok perhaps we shouldn't use 'controller' then cause it's misleading16:45
sdoranDoes the module just need to be extended to add more options?16:45
oidgarmwhahaha: sure. will fix it right away16:46
EmilienMSlower: https://review.openstack.org/#/c/526151/ is stuck until we find a path for upgrades16:46
mwhahahasdoran: well we don't use network manager so nmcli wouldn't be correct for us to leverage right now. but the options from nmcli are valid for ifcfg files themselves. not completely sure16:46
*** yamahata__ has quit IRC16:46
mwhahahasdoran: i'm reviewing https://review.openstack.org/#/c/487450 for context16:47
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Fast Forward Upgrade tasks and playbooks  https://review.openstack.org/49922116:47
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: tripleo-packages repo management  https://review.openstack.org/51542916:47
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce keystone fast-forward upgrade tasks  https://review.openstack.org/51462116:48
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: DNM ffu: Workaround missing repo control when moving to Queens  https://review.openstack.org/51871916:48
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: DNM: ffu: Remove yum update from upgrade_tasks  https://review.openstack.org/52055916:48
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: Add param_defaults for FFU  https://review.openstack.org/52254816:49
shardydsneddon: Hey when you get time could you please review https://review.openstack.org/#/c/521493/ (first pass at composable networks documentation), thanks!16:49
dsneddonshardy, Yes, I have an unfinished review in progress, I'll wrap it up and publish the comments.16:49
weshaySlower, yo yo.. need anything?16:50
shardydsneddon: thanks!16:50
*** itlinux has quit IRC16:50
*** fzdarsky has joined #tripleo16:51
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Correct a task name in create_swift_rings_backup_container_plan  https://review.openstack.org/52635716:51
flaper87jistr: it re-runs again, NM is restarted multiple times throughout the deployment16:51
*** moshele has joined #tripleo16:51
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: scenrio002-container: ignore telemetry & barbican tests  https://review.openstack.org/52645916:51
flaper87jistr: overcloud-controller-0     : ok=809  changed=105  unreachable=0    failed=016:51
flaper87jistr: it worked for me, single node16:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests  https://review.openstack.org/52645916:52
flaper87jistr: but I don't seem to have access to the VM16:52
flaper87nice16:52
flaper87>.>16:52
d0ugalshardy, jpich: I added a bug ref for backporting: https://review.openstack.org/#/c/526357/ - I am going to look into shardy's comment in a follow up.16:52
*** itlinux has joined #tripleo16:53
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests  https://review.openstack.org/52645916:53
shardyd0ugal: sounds good, thanks!16:53
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745016:54
EmilienMeasy review: https://review.openstack.org/#/c/526152/16:54
*** fragatina has joined #tripleo16:54
jpichd0ugal: Cool, thanks! Yeah that sounds like a separate bug16:54
EmilienMweshay: should we review https://review.openstack.org/#/q/topic:fs035+status:open or not? if we're moving to RDO CI 100%16:54
jistrflaper87: yup same here re losing network access, though my openshift-ansible run didn't go to the end yet. It got stuck on "restart openvswitch" handler again.16:55
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Add major update implementation  https://review.openstack.org/52621316:55
weshaybah.. thanks for the reminder16:55
sdoranmwhahaha: That modules looks pretty flexible, actually. It has an `option` parameter that can take anything. So you should be able to set any option.16:55
mwhahahasdoran: hmm ok i'll have to test it out later16:56
jistrflaper87: what about the NM install + OOOQ? We could do it but presently i don't see a benefit...16:56
sdoranOnly trick thing would be `value` since that looks like it only accepts strings. Would have to do some work to make it take lists and format that properly in the generated file.16:56
EmilienMchem, sshnaidm|ruck, adarazs: wdyt about removing gate-tripleo-ci-centos-7-containers-multinode-upgrades-master from openstack-check pipeline in RDO CI and have it experimental only.16:56
*** fragatina has quit IRC16:56
EmilienMchem, sshnaidm|ruck, adarazs : AFIK the job doesn't pass and nobody checks it now16:56
EmilienMit's a waste of resources imho16:56
weshaytrown, panda easy review https://review.openstack.org/#/c/525747/16:56
*** fragatina has joined #tripleo16:57
*** nyechiel has quit IRC16:57
*** ffiore has quit IRC16:57
aleemwhahaha, EmilienM  -- https://review.openstack.org/#/c/523538/ please when yo get a chance16:57
*** yamahata has joined #tripleo16:57
chemEmilienM: we're checking it but we're implementing a new workflow so it's broken16:57
chemEmilienM: give me a sec16:58
chemEmilienM: this review implement the new workflow with the rigth depends-on https://review.openstack.org/#/c/526006/16:58
EmilienMalee: ok I'll review them16:59
mwhahahaoidgar:: see my comments on ps6416:59
aleeEmilienM, thanks16:59
chemEmilienM: and we're currently working on fixing the gate-tripleo-ci-centos-7-containers-multinode-upgrades-pike one16:59
mwhahahai'll check out the latest but some of these things need to get moved out of the ansible playbook16:59
weshaytrown, panda really... all of these https://review.openstack.org/#/q/topic:fs035+status:open17:00
EmilienMchem: I know you're working on it. My question is more "since it doesn't work *now*, should we continue to run the job in check?"17:00
EmilienMweshay: no need to merge them if we move to RDO CI only, but I'm not sure what's the timeline17:00
EmilienMmaybe in the meantime we can merge my stuff17:00
chemEmilienM: for master I agree, but can we keep pike ?17:00
EmilienMchem: yeah my proposal is for master17:00
EmilienMI mentionned gate-tripleo-ci-centos-7-containers-multinode-upgrades-master :-)17:01
weshayEmilienM, there is an outtage on monday, sshnaidm|ruck is going to run one more report on pass/fail rates and check the mirror servers17:01
trownweshay: maybe not paunch :P17:01
EmilienMweshay: ok17:01
EmilienMI need to look why all scenarios ran on https://review.openstack.org/#/c/525480/17:01
chemEmilienM: yeah, as they have the same underlying code I was wondering, that's all (still new to this game)17:02
chemEmilienM: so we will have to make a check experimental to have working on master17:02
EmilienMoh I found it, we run all scenarios when we touch  ^environments\/.*.yaml17:02
d0ugalshardy: it is failing because it is missing the -swift-rings at the end of the container name: https://github.com/openstack/tripleo-common/blob/master/workbooks/swift_rings_backup.yaml#L1817:02
d0ugalshardy: see line 2317:02
EmilienMchem: good17:02
EmilienMsshnaidm|ruck: can we make gate-tripleo-ci-centos-7-containers-multinode-upgrades-master experimental please? I can also send a patch probably17:02
d0ugalshardy: I am trying to figure out if line 39 and line 55 are intentional or also broken. Any ideas?17:03
shardyd0ugal: yeah therve said the same earlier - I ended up rebuilding my environment for other reasons so only just reproduced the original error17:03
*** radeks has quit IRC17:04
shardyd0ugal: you should see it if you deploy any overcloud, then run the deploy command again17:04
shardysince I updated this morning that breaks every time17:04
d0ugalshardy: k, I'll try that. thanks17:04
shardyd0ugal: got to drop for a while now but can re-test later or tomorrow if needed17:04
d0ugalshardy: thanks, I'll not be around much longer either :) so tomorrow seems more likely.17:05
shardyd0ugal: ack, np have a good evening17:05
EmilienMsshnaidm|ruck: I did it, see on #rdo17:05
EmilienMchem: https://review.rdoproject.org/r/1086517:05
*** shardy is now known as shardy_afk17:06
chemEmilienM: ack17:06
*** yamahata has quit IRC17:06
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent  https://review.openstack.org/52516417:07
openstackgerritDaniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent  https://review.openstack.org/52516417:07
dsneddonshardy_afk, Looks pretty good, you had fixed some things I had draft comments on in patchset 4.17:08
*** fzdarsky has quit IRC17:08
aleeEmilienM, is there a glance person I can poke to ask about the failure in https://review.openstack.org/#/c/524064/  ?17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647517:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663417:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)17:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)17:10
*** karthiks has quit IRC17:11
*** salmankhan has quit IRC17:11
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Add extra environment files for the update  https://review.openstack.org/52621417:11
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603017:12
EmilienMalee: on #openstack-glance?17:13
EmilienMalee: or flaper87 is your best bet here :D17:13
aleeflaper87, hey there17:13
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Correct the container name confusion in the swift rings workflow  https://review.openstack.org/52646217:14
*** dtantsur is now known as dtantsur|afk17:15
aleeflaper87, trying to get glance image signing test working on tripleo.  things seen to be mostly working - just one test failure17:15
*** gvrangan has joined #tripleo17:15
aleeflaper87, https://review.openstack.org/#/c/524064/17:16
aleeflaper87, http://logs.openstack.org/64/524064/2/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/69f3ad2/logs/17:16
sshnaidm|ruckEmilienM, why experimental? Isn't it going to be fixed soon?17:17
EmilienMsshnaidm|ruck: not afik17:17
sshnaidm|ruckEmilienM, ok17:18
*** hewbrocca is now known as hewbrocca_afk17:18
sshnaidm|ruckEmilienM, so let's move both pike and master jobs17:19
*** rhallisey has joined #tripleo17:21
*** cshastri has quit IRC17:23
*** milan has quit IRC17:23
*** jaganathan has joined #tripleo17:23
*** itlinux has quit IRC17:23
*** moshele has quit IRC17:24
*** rfolco is now known as rfolco|brb17:25
*** anilvenkata has joined #tripleo17:26
openstackgerritAna Krivokapic proposed openstack/tripleo-validations master: Add a validation to check for working DNS  https://review.openstack.org/52430417:26
*** sri_ has quit IRC17:28
EmilienMsshnaidm|ruck: no, pike is WIP by chem like he said, and he wants to keep the job in check17:29
*** jpich has quit IRC17:29
sshnaidm|ruckEmilienM, hmm.. WIP is usually in experimental17:30
EmilienMchem: any thoughts ^17:31
EmilienM?17:31
chemsshnaidm|ruck: well for master we won't have it working soon, but pike should work and we want to have it working asap17:31
sshnaidm|ruckchem, ok17:31
*** abregman|mtg is now known as abregman17:31
chemsshnaidm|ruck: thanks, if we don't have much progress on it soon, we'll revisit this choice ... hope we don't have to do that.17:32
*** ccamacho has joined #tripleo17:36
*** remix_tj has joined #tripleo17:37
*** ccamacho has quit IRC17:39
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52644017:39
*** brault_ has quit IRC17:39
aleeEmilienM, mwhahaha thanks -- also  https://review.openstack.org/523539 , https://review.openstack.org/525337 , https://review.openstack.org/525741 , https://review.openstack.org/525742  please -- when you get a chance :)17:40
*** brault has joined #tripleo17:40
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Remove dead code & variables  https://review.openstack.org/52615217:41
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Add major update implementation  https://review.openstack.org/52621317:41
EmilienMalee: good work here17:43
aleeEmilienM, thanks :)17:43
*** radeks has joined #tripleo17:43
*** cshastri has joined #tripleo17:44
*** brault has quit IRC17:45
*** s_b_34343 has joined #tripleo17:45
*** athomas has joined #tripleo17:46
*** jd_ has joined #tripleo17:46
jd_weshay: o/17:46
slagleshardy_afk: whenever you get a chance, could you have a look at https://review.openstack.org/#/c/524437/. i added the manual config-download steps as you requested17:46
weshayjd_, hey brotha.. just looking for some assistance on a telemetry tempest failure.. not sure what the root cause is17:46
jd_weshay: me neither17:47
jd_weshay: did you see my question about the missing log file?17:47
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603017:47
weshayjd_, nope17:47
*** salmankhan has joined #tripleo17:48
jd_weshay: check your mail then :)17:48
*** jpena is now known as jpena|off17:48
jd_weshay: though I see EmilienM have a "fix"17:48
jd_which is disabling the test in != master IIUC17:49
weshayEmilienM, I thought telemetry tempest was enabled in pike17:49
weshayya17:49
weshaythat's what I'm poking at now17:49
EmilienMweshay: not in scenario00217:49
EmilienMin scenario001 only17:49
weshayoh just 117:49
EmilienMyup17:49
weshayright17:49
weshayk17:49
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2  https://review.openstack.org/52363817:49
EmilienMI found the root cause, and I sent a patch to fix it17:49
EmilienMjd_, weshay : is it clear or I need to explain again?17:49
jd_I would not call that the root cause, but ok :)17:50
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603017:50
jd_I'm fine with that17:50
openstackgerritJames Slagle proposed openstack/tripleo-common master: Remove jq package install  https://review.openstack.org/52578117:50
*** holser has quit IRC17:50
EmilienMjd_: the root cause is "we don't deploy telemetry properly on scenario002 in stable/pike"17:50
*** radeks has quit IRC17:50
*** moshele has joined #tripleo17:51
EmilienMjd_: so instead of backporting the config into stable/pike, I proposed to not run the tests on scenario002, for this branch17:51
EmilienMjd_: we're not big fans of changing CI jobs in stable branches17:51
jd_EmilienM: yeah I understand – but that's why I use "" around fix and root case, not being fan is different of doing the right thing technically :)17:51
jd_but I'm ok with that, I know how it is :)17:52
*** ffiore has joined #tripleo17:52
*** lucasagomes is now known as lucas-afk17:52
*** rfolco|brb is now known as rfolco17:53
*** moshele has quit IRC17:53
*** holser has joined #tripleo17:53
*** s_b_34343 has quit IRC17:53
*** derekh has quit IRC17:54
*** holser has quit IRC17:57
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603017:59
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Passes NodeDataLookup to ceph-ansible workflow  https://review.openstack.org/52607318:00
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52644018:00
weshayEmilienM, /me trying to fix the yaml on your review18:03
openstackgerritDavid Peacock proposed openstack/tripleo-quickstart master: Clarify SSH server requirements prior to tripleo-quickstart deployment  https://review.openstack.org/52647118:04
EmilienMweshay: which review18:04
EmilienMweshay: the telemetry?18:04
weshayhttps://review.openstack.org/#/c/526459/3/config/general_config/featureset017.yml18:04
EmilienMweshay: go ahead ok18:04
openstackgerritMerged openstack/tripleo-docs master: Add composable networks documentation  https://review.openstack.org/52149318:06
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574318:06
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - test  https://review.openstack.org/52647218:07
*** bandini has quit IRC18:07
EmilienMsdoran: ^18:07
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/pike: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52647318:07
*** bandini has joined #tripleo18:07
*** mdnadeem has quit IRC18:08
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: DNM - test  https://review.openstack.org/52647218:08
EmilienMsdoran: ^ same review18:08
oidgarmwhahaha: do you know if we can notify an handler between roles?18:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647518:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663418:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)18:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)18:10
mwhahahaoidgar: i want to say yes but that's a question for sdoran18:10
oidgarsdoran: ^18:11
oidgarsdoran: any idea? :)18:11
sdoranSo what do you mean by "between roles"?18:11
sdoranUse `handlers/main.yml` from `role1` in tasks in `roles2`?18:11
*** anilvenkata has quit IRC18:11
*** tesseract has quit IRC18:13
sdoranOr just trigger handlers mid-play?18:15
oidgarsdoran: do you have an example how to do it?18:17
sdoranWhich one?18:17
oidgarsdoran: for use 'handlers/main.yml'18:17
oidgarsdoran: like how's the syntax should be18:18
sdoranSo sharing handlers across roles?18:18
sdoranAre both roles in the play?18:18
*** trown is now known as trown|lunch18:18
oidgarsdoran: no, there are 2 plays, each one of them refers to a different role18:18
slaglejistr: StrictHostKeyChecking=no did the trick. do you think it should do that by default?18:21
*** jaganathan has quit IRC18:22
*** ffiore has quit IRC18:22
*** yprokule has quit IRC18:23
*** athomas has quit IRC18:25
*** numans has quit IRC18:30
*** numans has joined #tripleo18:32
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests  https://review.openstack.org/52645918:34
openstackgerritDavid Peacock proposed openstack/tripleo-quickstart master: Clarify SSH server requirements prior to tripleo-quickstart deployment  https://review.openstack.org/52647118:34
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests  https://review.openstack.org/52645918:35
weshayEmilienM, I think this will do it https://review.openstack.org/#/c/526459/5/config/general_config/featureset017.yml18:35
*** dprince has quit IRC18:36
EmilienMweshay: thanks18:36
EmilienMweshay: you found it on stackoverflow?18:36
weshayEmilienM, I bought a devel in a far off country to do it for me18:38
*** fragatina has quit IRC18:38
*** salmankhan has quit IRC18:38
EmilienMlol18:38
*** moshele has joined #tripleo18:40
*** sshnaidm|ruck is now known as sshnaidm|off18:43
*** gvrangan has quit IRC18:45
*** s_b_34343 has joined #tripleo18:46
*** tosky has quit IRC18:47
*** artom has joined #tripleo18:48
EmilienMweshay, sshnaidm|off: thx for your help, the rdo ci config layout is now good in master, we have ovb-ha and ovb-ha-ipv618:50
EmilienMweshay, sshnaidm|off : wdyt if we stop running the 2 jobs in rh1 (just in master for now)?18:50
*** nyechiel has joined #tripleo18:50
EmilienMalso we need to find a way to get them on tripleo.org/cistatus.html18:51
weshayEmilienM, I'm fine w/ it if you are18:52
weshayEmilienM, however /me wonders what people think of moving sova into a tripleo repo18:52
weshayso we can converge on a status board18:52
*** jkilpatr has quit IRC18:52
EmilienMit's a different topic18:52
EmilienMbut ok18:52
*** itlinux has joined #tripleo18:53
EmilienMnot sure the repo place is really a blocker18:53
EmilienMdo we want to remove tripleo.org/cistatus.html in the future? I'm not sure18:54
*** shardy_afk has quit IRC18:54
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Don't run check-tripleo OVB jobs frm RH1 anymore  https://review.openstack.org/52648118:56
EmilienMweshay: this is what it takes to remove ovb jobs in THT for example ^18:56
weshayEmilienM, it takes blood, sweat, tears and keyboard18:57
weshayand a18:57
EmilienMlol18:58
EmilienMweshay: I'll update tripleo.org/cistatus.html to have jobs from rdo ci18:58
EmilienMweshay: what else before we switch?18:59
EmilienMweshay: I'm verifying logs work fine18:59
EmilienMweshay: I just found a new problem, https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-master-nv/4596/18:59
EmilienMfrom https://review.openstack.org/#/c/525746/18:59
EmilienMlogs aren't found19:00
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add reproducer script for OVB and multinode jobs  https://review.openstack.org/52574319:00
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: dump out all the variables used  https://review.openstack.org/52613819:01
weshayrlandy, new review up19:01
* rlandy looks19:01
openstackgerritDavid Peacock proposed openstack/tripleo-quickstart master: Clarify SSH server requirements prior to tripleo-quickstart deployment  https://review.openstack.org/52647119:01
EmilienMweshay: why when we go on https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-containers-multinode-upgrades-master/4021/19:02
EmilienMSUCCESS jobs logs are 40419:02
*** dprince has joined #tripleo19:02
* weshay looks19:03
*** chandankumar has quit IRC19:04
weshayhrm.. this was working19:04
weshay:(19:04
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745019:04
*** rhallisey has quit IRC19:05
*** fragatina has joined #tripleo19:06
weshayEmilienM, https://logs.rdoproject.org/09/523909/3/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zec34db91c51749e3b0bae6951aeb5b53/19:06
weshayEmilienM, we need to speak to dmsimard|afk I think to update gerrit settings to point the right logs19:06
rlandyweshay: left some nit-pick comments - looks better now - will +2 when we can see some test logs19:07
*** moshele has quit IRC19:07
openstackgerritMerged openstack/tripleo-quickstart-extras master: add keystone and neutron tempest plugins to default config  https://review.openstack.org/52565719:07
EmilienMweshay: I consider that as a blocker to make the switch19:08
openstackgerritMerged openstack/tripleo-heat-templates master: CI: Test multi-rbd backend for cinder in scenario001  https://review.openstack.org/51974919:08
EmilienMweshay: our users need to find logs easily like before19:08
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: dump out all the variables used  https://review.openstack.org/52613819:09
weshayrlandy, fixed.. thanks19:09
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52644019:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647519:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663419:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin)19:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)19:10
*** trown|lunch is now known as trown19:11
*** tosky has joined #tripleo19:12
*** rhallisey has joined #tripleo19:12
*** jkilpatr has joined #tripleo19:13
*** Goneri has quit IRC19:14
*** itlinux has quit IRC19:14
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/pike: Add modulepath option when applying puppet inside docker.  https://review.openstack.org/52647319:15
openstackgerritTom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible  https://review.openstack.org/51224019:16
*** oidgar has quit IRC19:17
*** itlinux has joined #tripleo19:18
*** jkilpatr has quit IRC19:18
*** jkilpatr has joined #tripleo19:19
*** s_b_34343 has quit IRC19:19
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add missing steps from tripleo-ci ovb playbook  https://review.openstack.org/52645119:24
*** nyechiel has quit IRC19:24
*** jbadiapa has quit IRC19:28
*** radeks has joined #tripleo19:29
*** bandini has quit IRC19:36
*** bandini has joined #tripleo19:38
*** iranzo has quit IRC19:47
*** abregman is now known as abregman|afk19:48
openstackgerritJames Slagle proposed openstack/tripleo-common master: Break up messages to avoid max message size  https://review.openstack.org/52649219:49
*** mcornea has quit IRC19:52
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use StrictHostKeyChecking=no in enable-ssh-admin.sh  https://review.openstack.org/52649419:54
openstackgerritJames Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download  https://review.openstack.org/52533119:55
*** moshele has joined #tripleo19:55
openstackgerritDavid Peacock proposed openstack/tripleo-quickstart master: Add ansible_facts_cache/ to .gitignore  https://review.openstack.org/52649719:56
*** brault has joined #tripleo19:58
*** tongl has joined #tripleo20:03
*** BryanS68 has quit IRC20:07
*** jkilpatr has quit IRC20:08
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB  https://review.openstack.org/51350820:10
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647520:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663420:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin)20:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)20:10
openstackgerritGabriel Szasz proposed openstack/tripleo-heat-templates master: Add Novacontrol role  https://review.openstack.org/52650120:13
*** nyechiel has joined #tripleo20:13
*** moshele has quit IRC20:16
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras master: Add disruption detector for Overcloud endpoint monitoring  https://review.openstack.org/52012620:18
*** jkilpatr has joined #tripleo20:24
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Add stack update role  https://review.openstack.org/52012520:27
*** oidgar has joined #tripleo20:29
*** jkilpatr has quit IRC20:32
*** BryanS68 has joined #tripleo20:37
*** dmellado has quit IRC20:37
*** itlinux has quit IRC20:40
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603020:40
*** stevebaker has quit IRC20:41
*** Goneri has joined #tripleo20:43
*** stevebaker has joined #tripleo20:44
*** moshele has joined #tripleo20:44
*** pchavva has quit IRC20:45
*** oidgar has quit IRC20:46
*** dmellado has joined #tripleo20:50
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible  https://review.openstack.org/52603020:50
*** cshastri has quit IRC20:53
mwhahahabeagles: do we want to merge the change with the ssh key path stuff https://review.openstack.org/#/c/526090/8/puppet/services/octavia-worker.yaml or do we want to pull that out20:54
beaglesmwhahaha, ah right yeah, I'll remove that. 1s20:56
*** dparkes has joined #tripleo20:56
openstackgerritRafael Folco proposed openstack/tripleo-quickstart master: DNM: test  https://review.openstack.org/52650920:58
*** itlinux has joined #tripleo20:59
*** rfolco is now known as rfolco|off21:01
*** pchavva has joined #tripleo21:01
openstackgerritIan Main proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers  https://review.openstack.org/51744521:01
*** akrivoka has quit IRC21:02
*** gfidente has quit IRC21:03
*** nyechiel has quit IRC21:05
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials  https://review.openstack.org/52606221:05
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters  https://review.openstack.org/52609021:05
*** holser has joined #tripleo21:05
beaglesmwhahaha, updated21:06
mwhahahak thanks21:06
*** jkilpatr has joined #tripleo21:06
mwhahahabeagles: don't for get to rebase https://review.openstack.org/#/c/52640421:07
beaglesmwhahaha, ack21:07
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add support for providing Octavia cert data  https://review.openstack.org/52640421:08
*** mburned is now known as mburned_out21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647521:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin)21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663421:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)21:10
*** chandankumar has joined #tripleo21:11
*** pchavva has quit IRC21:19
*** moshele has quit IRC21:23
openstackgerritMerged openstack/diskimage-builder master: ironic-agent: don't remove make  https://review.openstack.org/52625721:23
*** alee has quit IRC21:28
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Configure undercloud docker registry/mirror  https://review.openstack.org/52614721:28
*** nguyentrihai has quit IRC21:29
*** tongl has quit IRC21:29
*** tongl has joined #tripleo21:30
*** dmsimard|afk is now known as dmsimard21:30
*** mburned_out is now known as mburned21:30
*** florianf|afk has quit IRC21:30
*** radeks has quit IRC21:32
EmilienMmwhahaha: https://github.com/voxpupuli/puppet-rabbitmq/commit/0ec48b31d4ac2b0dda44ace71abc9b8b6f5f4c66 merged21:36
mwhahahak21:37
*** ansmith has quit IRC21:37
*** rlandy is now known as rlandy|mtg21:38
*** moshele has joined #tripleo21:41
EmilienMmwhahaha: I think I should update rdoinfo to bump rabbitmq module to this commit? so we import it at next zstream?21:41
mwhahahahow about we test in master first21:42
EmilienMsure thing21:42
*** chandankumar has quit IRC21:43
*** BryanS68 has quit IRC21:43
*** dhill_ has quit IRC21:43
*** raildo has quit IRC21:43
*** dsneddon has quit IRC21:43
*** rdopiera has quit IRC21:43
*** StevenK has quit IRC21:43
*** slagle has quit IRC21:43
*** dalvarez has quit IRC21:43
*** eck` has quit IRC21:43
*** therve has quit IRC21:43
*** bandini has quit IRC21:45
*** bandini has joined #tripleo21:48
*** chandankumar has joined #tripleo21:48
*** BryanS68 has joined #tripleo21:48
*** dhill_ has joined #tripleo21:48
*** raildo has joined #tripleo21:48
*** dsneddon has joined #tripleo21:48
*** rdopiera has joined #tripleo21:48
*** StevenK has joined #tripleo21:48
*** slagle has joined #tripleo21:48
*** eck` has joined #tripleo21:48
*** dalvarez has joined #tripleo21:48
*** therve has joined #tripleo21:48
*** openstackgerrit has quit IRC21:48
*** openstackgerrit has joined #tripleo21:53
openstackgerritMerged openstack/tripleo-quickstart master: collect logs: remove --ansible-debug  https://review.openstack.org/52355221:53
openstackgerritMerged openstack/tripleo-quickstart master: zuul: update OVB jobs  https://review.openstack.org/52574721:53
*** jkilpatr has quit IRC21:53
*** ffiore has joined #tripleo21:54
openstackgerritJames Slagle proposed openstack/tripleo-common master: Break up messages to avoid max message size  https://review.openstack.org/52649221:57
openstackgerritMerged openstack-infra/tripleo-ci master: cistatus.html: update OVB jobs  https://review.openstack.org/52575122:01
*** toure is now known as toure|gone22:01
*** rlandy|mtg is now known as rlandy22:02
*** threestrands has joined #tripleo22:04
*** threestrands has quit IRC22:04
*** threestrands has joined #tripleo22:04
*** chlong has quit IRC22:04
*** trown is now known as trown|outtypewww22:06
*** rcernin has joined #tripleo22:09
openstackgerritDan Prince proposed openstack/puppet-tripleo master: Remove INSECURE_REGISTRY from docker_registry.pp  https://review.openstack.org/52576122:09
*** rcernin has quit IRC22:09
*** rcernin has joined #tripleo22:09
*** holser has quit IRC22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647522:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663422:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin)22:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)22:10
weshayhttp://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/22:13
weshayhttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz22:13
weshaymyoung|rover, ^ two culprits for the gate reset22:13
weshayFYI22:14
*** ihrachys has quit IRC22:14
mwhahahaare those the ones from yesterday?22:15
mwhahahacause it's the error i saw about config download22:15
mwhahahahttp://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_21_59_3622:15
* mwhahaha checks timestamp22:15
mwhahahanope that's today22:15
weshayhttp://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_21_59_3622:15
weshaymwhahaha, I think we may have merged a bad patch22:16
weshay3rd time I've seen that today22:16
mwhahahaor something is buggy22:16
mwhahahacause it's not 100%22:16
weshayya22:16
weshaytrue true22:16
mwhahahahttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_21_23_3522:16
mwhahahaEmilienM, slagle: looks like a bug in config-download22:17
*** mburned is now known as mburned_out22:17
mwhahahaplz file an alert bug22:17
*** dprince has quit IRC22:19
weshaymwhahaha, k22:20
*** dmacpher has quit IRC22:20
*** alee has joined #tripleo22:20
weshayhttps://bugs.launchpad.net/tripleo/+bug/173704222:22
openstackLaunchpad bug 1737042 in tripleo "ERROR! the role 'tripleo-bootstrap' was not found in /var/lib/mistral roles path" [Critical,Triaged]22:22
weshaymyoung|rover, FYI ^22:23
*** weshay is now known as weshay|ruck22:23
*** mburned_out is now known as mburned22:23
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Enable docker-puppet.py for a single config_volume  https://review.openstack.org/52652622:25
slaglemwhahaha: WUT22:26
mwhahahaYOU HEARD ME22:27
mwhahahaTHE WORLD IS ON FIIIIIIRRRREEEE22:27
slagleneed to check the installed version of tripleo-common to see if it has EmilienM packaging change to include the role22:28
mwhahahawhen did that land?22:28
slagleweshay|ruck: mwhahaha : where do you see what dlrn repo was used?22:28
weshay|ruckhttp://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/logs/undercloud/etc/yum.repos.d/22:29
weshay|ruckbaseurl=http://mirror.iad.rax.openstack.org:8080/rdo/centos7/c8/cc/c8cceebf8e648ce46219026f926047491135a66e_fcf8d17922:29
*** bfournie has quit IRC22:30
mwhahahato include the role or just the role dir22:30
mwhahahai don't see a patch to include a role specifically22:30
mwhahahaoh there it is, https://review.openstack.org/#/c/525285/22:31
mwhahahaso tripleo-common isn't built all the time22:32
mwhahahaso we need a promotion to stop seeing these22:32
mwhahahathis is problemattic22:33
mwhahahawe should have moved the tripleo-bootstrap to it's own package22:34
mwhahahaand not shoved it in tripleo-common btw22:34
* mwhahaha slaps EmilienM's hand for dumping random crap in tripleo-common22:34
slagleweshay|ruck: mwhahaha : according to http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/var/log/host_info.txt.gz, openstack-tripleo-common-8.2.1-0.20171207204216.ad25b79.el7.centos.noarch is installed22:36
slagleweshay|ruck: mwhahaha : yet the repos in use are  http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/etc/yum.repos.d/delorean-current.repo.txt.gz and http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/etc/yum.repos.d/delorean.repo.txt.gz, neither of which contain that version of tripleo-common22:36
*** rcernin has quit IRC22:36
*** chandankumar has quit IRC22:36
*** BryanS68 has quit IRC22:36
*** dhill_ has quit IRC22:36
*** raildo has quit IRC22:36
*** dsneddon has quit IRC22:36
*** rdopiera has quit IRC22:36
*** StevenK has quit IRC22:36
*** slagle has quit IRC22:36
*** dalvarez has quit IRC22:36
*** eck` has quit IRC22:36
*** therve has quit IRC22:36
mwhahahaslagle: it might have been built in the change, let's look at the dlrn logs22:37
mwhahahacome back to me slagle!22:37
mwhahahastupid netsplits22:37
*** leifmadsen has quit IRC22:39
weshay|ruckwhere did he go?22:39
weshay|rucklolz22:39
mwhahahathe irc server he was on went poof22:40
mwhahahaanyway so it built a tripleo-common22:40
mwhahahabut i don't know what hash it was using cause i cant' find it in the git log22:40
mwhahahaoh the hash it has in the pkg name is a dlrn repo hash22:41
mwhahahathat's nto very helpful22:41
*** rcernin has joined #tripleo22:42
*** chandankumar has joined #tripleo22:42
*** BryanS68 has joined #tripleo22:42
*** dhill_ has joined #tripleo22:42
*** raildo has joined #tripleo22:42
*** dsneddon has joined #tripleo22:42
*** rdopiera has joined #tripleo22:42
*** StevenK has joined #tripleo22:42
*** slagle has joined #tripleo22:42
*** eck` has joined #tripleo22:42
*** dalvarez has joined #tripleo22:42
*** therve has joined #tripleo22:42
mwhahahaslagle: it got built, http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/delorean_logs/ad/25/ad25b79800da04f7af88a3a47f811cf07fb9d051_dev/rpmbuild.log.txt.gz22:42
*** leifmadsen has joined #tripleo22:42
*** leifmadsen has quit IRC22:42
*** leifmadsen has joined #tripleo22:42
openstackgerritJoe Talerico proposed openstack/puppet-tripleo master: HAProxy logging  https://review.openstack.org/49752422:43
weshay|ruckopenstack-tripleo-common.noarch 8.2.1-0.20171207204216.ad25b79.el7.centos22:43
mwhahahahow do you figure out what version of the code was used for that22:43
*** yamahata has joined #tripleo22:44
*** raildo has quit IRC22:44
slaglemwhahaha: oh, so it was unrelated tripleo-common patch in the same gate job22:44
mwhahahaoh so there was a tripleo-common patch in the gatequeue that might have been older than the one emilien merged22:45
mwhahahai hate it when it does that22:45
weshay|ruckmwhahaha, if it wasn't built on the fly.. it should be the latest in tripleo-common22:45
slaglei would have guessed that anything in zuul_changes gets rebased onto master22:45
slaglesince that's what you actually want to be testing22:45
mwhahahai'm not sure it actually does22:46
mwhahahalike it's supposed to22:46
mwhahahabut i don't know if dlrn does22:46
slagleotherwise...you aren't testing what's actually already been merged22:46
*** dhill_ has quit IRC22:46
slagleyea, possible bug in dlrn then22:46
slaglefor gate jobs22:46
mwhahahahttps://review.openstack.org/#/c/525337/ was the change in the gate22:47
*** dhill_ has joined #tripleo22:47
mwhahahawhich got -A'd too22:47
weshay|ruckhttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/delorean_logs/22:47
weshay|ruckhttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/delorean_logs/ad/25/ad25b79800da04f7af88a3a47f811cf07fb9d051_dev/build.log.txt.gz22:48
weshay|rucktripleo-common ^22:48
*** eck` is now known as eck`gone22:48
slaglebut no mention of tripleo-bootstrap22:48
slaglewhich merged last night22:49
weshay|ruckis this a rebase issue?22:49
weshay|ruckOH22:49
weshay|ruckya.. one would think delorean-current would override.. or this dlrn build should be on top of delorean-current22:50
weshay|ruckso.. ya. dlrn bug22:50
slaglei think dlrn ought to clone master, then rebase patch on top, then build from that22:50
mwhahahawell it should be rebased on top of current head22:50
openstackgerritMichael Turek proposed openstack/diskimage-builder master: Add iscsi-boot element  https://review.openstack.org/51149422:51
slagleyea sure22:51
*** BryanS68 has quit IRC22:52
mwhahahai commented on the bug22:53
mwhahahatrying to summarize this22:53
*** moshele has quit IRC22:54
mwhahahai think the gate might be ok unless we attempt to merge a tripleo-common patch that doesn't include the roles bits22:55
weshay|ruckhrm..22:56
weshay|ruckhttps://trunk.rdoproject.org/centos7-master/1e/30/1e302df86b58030a8e9bbae6e7a1a81d1d4c20c1_28eeb6c7/openstack-tripleo-common-8.2.1-0.20171207141352.21f271c.el7.centos.noarch.rpm22:56
weshay|ruckwas avail22:56
*** itlinux has quit IRC22:56
mwhahahaweshay|ruck: in the delorean.repo?22:56
mwhahahaweshay|ruck: it likely built tripleo-common with a patch that was in ZUUL_REFs22:56
weshay|ruckbaseurl=http://mirror.mtl01.inap.openstack.org:8080/rdo/centos7/1e/30/1e302df86b58030a8e9bbae6e7a1a81d1d4c20c1_28eeb6c722:57
weshay|ruckmwhahaha, ya... that sounds right.22:57
weshay|ruckit's been too long for me to know off the top of my head22:57
mwhahahahttps://review.openstack.org/#/c/525337/ needed a rebase22:57
openstackgerritMerged openstack/tripleo-heat-templates master: Set simple crypto plugin as global default for Barbican  https://review.openstack.org/52548022:58
openstackgerritMerged openstack/puppet-tripleo master: Add multiple backends for barbican  https://review.openstack.org/52353822:58
openstackgerritMerged openstack/tripleo-heat-templates master: Add parameters for Barbican keystone listener  https://review.openstack.org/52574122:58
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Added ability to generate kek for barbican simple crypto backend  https://review.openstack.org/52533722:58
*** pmannidi has joined #tripleo22:58
weshay|ruckZUUL_CHANGES=openstack/tripleo-quickstart:master:refs/changes/52/523552/2^openstack/tripleo-quickstart:master:refs/changes/47/525747/2^openstack-infra/tripleo-ci:master:refs/changes/51/525751/1^openstack/tripleo-heat-templates:master:refs/changes/80/525480/1^openstack/puppet-tripleo:master:refs/changes/38/523538/7^openstack/tripleo-heat-templates:master:refs/changes/41/525741/2^openstack/tripleo-heat-templates:master:refs/changes/42/522:58
weshay|ruck25742/2^openstack/tripleo-common:master:refs/changes/37/525337/3^openstack/tripleo-heat-templates:master:refs/changes/39/523539/622:58
weshay|ruckhttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_16_45_24057522:58
mwhahahaah crap it just reset the gate22:59
weshay|ruckheh22:59
weshay|ruckhttps://review.openstack.org/#/c/525337/22:59
weshay|rucksaw the same fail there22:59
weshay|ruckmwhahaha, ok.. so you just rebased22:59
weshay|ruckso in theory.. we should be ok now?22:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:00
mwhahahaunless someone merged somethign from tripleo-common that wasn't rebased in the last 24 hours23:00
mwhahahayea23:00
weshay|ruckmwhahaha, isn't possible to change the gerrit settings to automcatically rebase?23:00
mwhahahaweshay|ruck: it's not a gerrit thing, it's a dlrn thing23:00
weshay|ruckracist23:01
mwhahahaor do you mean go rebase all the patches23:01
* mwhahaha rebases weshay|ruck 23:01
weshay|rucklolz23:01
weshay|ruckmwhahaha, as owners of the gerrit repo I think, I'm not sure you change the settings w/ regards to automatic rebases23:02
weshay|ruckmaybe we don't have that access upstream23:02
mwhahahai don't think we do23:02
*** jmelvin_ has quit IRC23:03
*** chem has quit IRC23:05
mwhahahaweshay|ruck: wait we clone the change in build-test-packages23:08
mwhahahaso we should rebase and apply23:08
mwhahahaor copy the local stuff from zuul23:08
mwhahaha(ideally copy the local stuff from zuul cause they already do this)23:08
mwhahahaoh wait we do that23:10
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173647523:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173663423:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173704223:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin)23:10
openstackLaunchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin)23:10
openstackLaunchpad bug 1737042 in tripleo "ERROR! the role 'tripleo-bootstrap' was not found in /var/lib/mistral roles path" [Critical,Triaged]23:10
* weshay|ruck poking23:11
mwhahahahttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_40_43_43019623:11
mwhahahano we didn't23:11
mwhahahain this case we clonded it23:11
mwhahahahttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_40_52_89888623:11
mwhahahabecause it wasn't preped for us23:11
*** fpan has joined #tripleo23:12
* mwhahaha adds quickstart tag 23:13
*** dmacpher has joined #tripleo23:13
mwhahahanow i was under the impression that it should have copied it23:13
mwhahahai wonder if https://review.openstack.org/#/c/525265/ broke that23:14
mwhahahawhy do we always find the weird bugs when everyone is off for the day23:14
weshay|ruckoh23:15
weshay|ruckprepared by zuul cloner23:15
mwhahahaor are we looking in the wrong spot23:15
mwhahahaand we just never noticed until now23:15
mwhahahalike was this something that changed in v323:15
mwhahahabecause http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_13_25_253863 it was preped23:16
mwhahahahttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_15_02_85778923:16
mwhahahai don't think we look in the right spot for changes from other repos23:18
weshay|ruckpossible.. this is the quiets the gates have been.. for a nuanced issue like this23:18
mwhahahaeven though zuul cloner doesn't exist anymore in v3 (it's just a shim) we should either be using that or using the real paths for all these projects23:20
weshay|ruckwhat dir is zuul cloner dropping these into23:20
mwhahahahttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_15_02_61501523:21
mwhahahalooks like /var/lib/zuul/buildes/<hash>/work/src/...23:21
weshay|ruck\/var/lib/zuuul is new23:21
weshay|ruckafaict23:21
mwhahahai guess infra folks are the best to ask about how to go about touching this stuff23:21
mwhahahait might be exposed via ansible vars23:23
mwhahahait is23:24
mwhahahazuul.executor.src_root23:24
mwhahahathat's the src part23:24
mwhahahathen the zuul.projects[X].src_Dir23:25
mwhahahabut /home/zuul/src/git.o.o/openstack/foo is what paul says23:25
weshay|ruckwhere do you see that23:26
weshay|ruckwe are looking in /home/zuul23:26
weshay|ruckwe being ooq23:26
weshay|ruckdon't see it here http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/zuul-info/host-info.primary.yaml23:26
mwhahahait was looking in /opt/stack23:26
mwhahahahttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_40_50_68674123:27
mwhahahawe'r enot looking in /home/zuul/src23:27
weshay|ruckya.. just /home/zuul afaict23:27
mwhahahahttp://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_12_13_88708123:27
*** yamahata has quit IRC23:29
weshay|ruckmwhahaha, so if the roles tries to rebase and there's a conflict.. is it ok to fail?23:30
mwhahahait shouldn't have to rebase23:30
mwhahahabecause it should use the local copy in this instance23:30
weshay|ruckwell.. ya.. just thinking about both cases23:31
mwhahahayou'd probably want to fail23:31
mwhahahabecause that means a dependant change is no good23:31
mwhahahait would be in merge conflict or something23:31
mwhahahawould be better to fail with a giant error indicate merge conflict23:31
pabelangeris there a brief description of the issue you're working through?23:32
weshay|ruckhrm.. the ansible git module should "update" If no, do not retrieve new revisions from the origin repository23:32
weshay|ruckby default it's yes23:32
weshay|ruckpabelanger, I know right :)23:32
mwhahahapabelanger: we got a gate failure, due to packages being built by dlrn that were using older versions of code23:32
mwhahahapabelanger: because we weren't using the local zuul provided repo, and we just cloned the change down to build the package23:32
pabelangerokay, and dlrn is still trying to git clone things right?23:32
mwhahahapabelanger: it's quickstart doing the preping23:33
mwhahahabut yea23:33
pabelangeryah, I was just going to say that23:33
mwhahahawe're still using /opt/stack/new23:33
mwhahahato look for shit23:33
mwhahahaso the bug is we need to fixup the artg_repos_dir in quickstart to be correct23:33
mwhahahaand for quickstart in general to accept a patch but rebase it on top of current head if it has to build23:34
pabelangercool, yah. I think the fix is to also stop dlrn role from trying to git clone external git repos now.  zuulv3 will put everything in place in the right reference too.  But, I can see why you want to keep that for non zuul things23:34
*** lblanchard has quit IRC23:34
mwhahahahttps://github.com/openstack-infra/tripleo-ci/blob/bd485839781734fcd543321bd3312834ad6d5e8e/toci-quickstart/playbooks/multinode.yml#L4423:35
mwhahahawe're setting where to look for packages to the tripleo_root23:36
mwhahahaif i remember corectly somewhere we're actually copying stuff into the tripleo_root to build23:36
weshay|ruckhttps://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/playbooks/multinode.yml#L4423:36
mwhahahawhich is why primary packages get the local dir23:36
weshay|ruckartg_repos_dir: "{{ tripleo_root }}"23:36
mwhahahabut the ancillary ones get git cloned23:36
mwhahahaartg_repos_dir: /home/zuul/git.openstack.org/openstack23:37
pabelangerI also think you could avoid this git clone too: http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/build-test-packages/tasks/dlrn-build.yml#n58 but I think that is just to setup directory structure for DLRN23:37
mwhahahai think is the correct one23:37
*** liverpooler has quit IRC23:37
weshay|ruckmwhahaha, you putting in that change or shall I?23:37
mwhahahapabelanger: that's what we're hitting23:37
mwhahahaweshay|ruck: you can23:38
weshay|ruckk23:38
weshay|ruckmyoung|rover, FYI ^ if you weren't previously confused.. this one is fun23:38
weshay|ruck:)23:38
pabelangermwhahaha: yah, just trying to understand why it still git clones, from the local filesystem. I guess it is the way DLRN/data is created?  Couldn't you have DLRN lookinto /home/zuul/src/git.o.o/openstack now?23:39
mwhahahapabelanger: yea that's what we're fixing23:39
mwhahahapabelanger: because it should already have all of that23:39
pabelangerkk23:39
mwhahahapabelanger: the reason to keep that block is for running something locally with ZUUL_CHANGES to mock out the CI stuff23:39
pabelangerthen I think we are on same page :)23:39
mwhahahawhere we don't have zuul cloner to prep stuff or whatever23:39
mwhahahathe bug here is that we're 1) cloning stuff and 2) it's old and not rebased23:40
mwhahahawe shouldn't need to clone anything in ci that's local to openstack23:40
*** jkilpatr has joined #tripleo23:40
pabelangermwhahaha: right, just keep in mind ZUUL_CHANGES is v2 thing, and not native v3. We only have it right now due to legacy job reasons, so I'd not depend on it for much longer23:40
pabelangershould be able to get all the info via inventory an zuul.projects now23:41
pabelangernow I run away, good luck23:41
mwhahahayea all this stuff needs some <323:41
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: update zuul cloned repo directory for zuulv3  https://review.openstack.org/52654623:43
weshay|ruckpabelanger, thanks man23:43
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: update zuul cloned repo directory for zuulv3  https://review.openstack.org/52654623:44
*** ffiore has quit IRC23:48
*** ffiore has joined #tripleo23:50
*** bfournie has joined #tripleo23:52
*** ffiore has quit IRC23:53
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: DNM, update the regex used to copy cloned repos  https://review.openstack.org/52654723:53
*** threestrands has quit IRC23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!