*** ebarrera has quit IRC | 00:00 | |
*** leitan has joined #tripleo | 00:00 | |
*** leitan has quit IRC | 00:05 | |
*** liverpooler has quit IRC | 00:06 | |
EmilienM | mwhahaha: looking now | 00:07 |
---|---|---|
EmilienM | mwhahaha: it's "normal" | 00:07 |
EmilienM | mwhahaha: delorean didn't build the tipleo-common package in current yet I guess | 00:08 |
EmilienM | mwhahaha: a recheck should work, let's see | 00:08 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps.j2: use ansible to bootstrap environment https://review.openstack.org/525291 | 00:08 |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 00:10 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 00:19 |
*** ansmith has quit IRC | 00:25 | |
*** dparkes has quit IRC | 00:26 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Save oooq generated files https://review.openstack.org/517136 | 00:34 |
*** ansmith has joined #tripleo | 00:38 | |
*** itlinux has joined #tripleo | 00:39 | |
*** tosky has quit IRC | 00:44 | |
*** liverpooler has joined #tripleo | 00:54 | |
*** ansmith has quit IRC | 01:05 | |
*** rfolco has quit IRC | 01:08 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 01:10 |
*** ansmith has joined #tripleo | 01:10 | |
*** itlinux has quit IRC | 01:19 | |
*** rfolco has joined #tripleo | 01:20 | |
*** cshastri has joined #tripleo | 01:31 | |
*** psachin has joined #tripleo | 01:31 | |
*** Sandy619 has joined #tripleo | 01:34 | |
*** Sandy619 has quit IRC | 01:34 | |
*** yamahata has joined #tripleo | 01:40 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Revert "Allow deleting all of docker cache" https://review.openstack.org/525849 | 01:42 |
*** itlinux has joined #tripleo | 01:45 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Prepend errors file with prefix for logstash index https://review.openstack.org/525268 | 01:58 |
*** leitan has joined #tripleo | 02:01 | |
*** leitan has quit IRC | 02:05 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 02:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
*** tongl has quit IRC | 02:10 | |
*** gvrangan has joined #tripleo | 02:10 | |
*** ebarrera has joined #tripleo | 02:11 | |
*** rcernin has quit IRC | 02:12 | |
*** gvrangan has quit IRC | 02:17 | |
*** thrash is now known as thrash|g0ne | 02:19 | |
*** rcernin has joined #tripleo | 02:20 | |
*** ebarrera has quit IRC | 02:23 | |
*** yamahata has quit IRC | 02:41 | |
*** fragatina has quit IRC | 02:42 | |
*** fragatina has joined #tripleo | 02:43 | |
*** fragatina has quit IRC | 02:47 | |
*** fragatina has joined #tripleo | 02:48 | |
EmilienM | weshay: looking now | 02:50 |
*** fragatina has quit IRC | 02:50 | |
EmilienM | https://git.opendaylight.org/gerrit/integration/packaging/puppet-opendaylight | 02:51 |
EmilienM | not found | 02:51 |
EmilienM | I can clone it | 02:52 |
EmilienM | I guess it was a downtime on their side | 02:52 |
weshay | EmilienM, thanks | 02:54 |
EmilienM | weshay: let me know if it still occurs | 02:56 |
weshay | you go flying? | 02:56 |
EmilienM | weshay: tomorrow :-) | 02:57 |
EmilienM | weshay: I come back from gym | 02:57 |
EmilienM | so I can kick your ass at PTG | 02:57 |
weshay | I'll throw on some gloves and go toe to toe | 02:58 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update Fedora defaults to 27 https://review.openstack.org/521684 | 03:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: ironic-agent: don't remove make https://review.openstack.org/526257 | 03:00 |
*** fragatina has joined #tripleo | 03:00 | |
EmilienM | lol | 03:00 |
*** fragatina has quit IRC | 03:00 | |
*** gvrangan has joined #tripleo | 03:04 | |
*** gecong_ has joined #tripleo | 03:06 | |
*** jwb has quit IRC | 03:07 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 03:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
*** itlinux has quit IRC | 03:10 | |
*** ramishra has joined #tripleo | 03:10 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 03:10 |
*** zshi has joined #tripleo | 03:20 | |
*** dhill_ has quit IRC | 03:29 | |
*** dhill_ has joined #tripleo | 03:32 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Don't assume single sub_node in nic config https://review.openstack.org/523227 | 03:38 |
openstackgerrit | Merged openstack/instack-undercloud master: Remove -U from pip install https://review.openstack.org/524892 | 03:38 |
*** itlinux has joined #tripleo | 03:40 | |
openstackgerrit | Merged openstack/instack-undercloud master: Enable the ansible deploy interface out of box https://review.openstack.org/522568 | 03:41 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Adding Cisco VTS ML2 mechanism driver service template https://review.openstack.org/510673 | 03:41 |
*** mdnadeem has joined #tripleo | 03:42 | |
*** shreshtha has joined #tripleo | 03:44 | |
*** shreshtha has quit IRC | 03:44 | |
*** shreshtha has joined #tripleo | 03:44 | |
*** threestrands has joined #tripleo | 03:52 | |
*** threestrands has quit IRC | 03:52 | |
*** threestrands has joined #tripleo | 03:52 | |
*** mdnadeem has quit IRC | 03:53 | |
*** psahoo has joined #tripleo | 03:54 | |
*** leitan has joined #tripleo | 03:59 | |
*** fpan has quit IRC | 04:00 | |
*** gecong_ has quit IRC | 04:00 | |
*** udesale has joined #tripleo | 04:01 | |
*** ihrachys has quit IRC | 04:02 | |
openstackgerrit | Merged openstack/puppet-tripleo master: Enable octavia certificate configuration https://review.openstack.org/526087 | 04:04 |
*** leitan has quit IRC | 04:04 | |
*** pmannidi has quit IRC | 04:05 | |
*** rlandy has quit IRC | 04:09 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 04:10 |
*** pgadiya has joined #tripleo | 04:21 | |
*** pmannidi has joined #tripleo | 04:22 | |
*** ykarel|afk has joined #tripleo | 04:22 | |
*** links has joined #tripleo | 04:25 | |
*** moshele has joined #tripleo | 04:26 | |
*** dpawar has joined #tripleo | 04:29 | |
*** gbarros has quit IRC | 04:36 | |
*** gvrangan has quit IRC | 04:38 | |
*** pmannidi has quit IRC | 04:40 | |
*** pdeore has joined #tripleo | 04:43 | |
*** stendulker has joined #tripleo | 04:48 | |
*** jaosorior has joined #tripleo | 04:49 | |
*** moshele has quit IRC | 04:50 | |
*** pdeore has quit IRC | 04:54 | |
*** pdeore has joined #tripleo | 04:56 | |
*** pmannidi has joined #tripleo | 04:57 | |
*** jaganathan has joined #tripleo | 05:00 | |
*** s_b_34343 has joined #tripleo | 05:06 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 05:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
*** itlinux has quit IRC | 05:10 | |
*** janki has joined #tripleo | 05:14 | |
*** moshele has joined #tripleo | 05:20 | |
*** moshele has quit IRC | 05:21 | |
*** numans has quit IRC | 05:23 | |
*** tzumainn has quit IRC | 05:24 | |
*** numans has joined #tripleo | 05:26 | |
*** fragatina has joined #tripleo | 05:33 | |
*** pdeore_ has joined #tripleo | 05:34 | |
*** ykarel|afk has quit IRC | 05:35 | |
*** ykarel|afk has joined #tripleo | 05:35 | |
*** pdeore has quit IRC | 05:37 | |
*** daidv has quit IRC | 05:42 | |
*** daidv has joined #tripleo | 05:42 | |
*** ykarel|afk is now known as ykarel | 05:51 | |
Tengu | hello there! | 05:52 |
Tengu | jaosorior: hello! apparently, I'm more or less right with the hiera thingy - at least, unit tests do also fail on zuul… there must be something fishy. | 05:52 |
jaosorior | I'm fine with it using the :: approach, would sure add mwhahaha to the review though | 05:53 |
Tengu | of course. as it creates something different from the already-existing firewall stuff | 05:53 |
Tengu | btw, that resource doesn't have unit test… so I couldn't check what was going on :( | 05:53 |
*** pdeore_ has quit IRC | 05:56 | |
jaosorior | bummer :/ | 05:56 |
Tengu | soo. updating my review and adding mwhahaha as reviewer. Will put some comment as well. | 05:56 |
*** pdeore_ has joined #tripleo | 05:57 | |
Tengu | will do one more test before that. just to be on the safe side. | 05:57 |
jaosorior | awesome | 05:58 |
jaosorior | thanks dude! | 05:58 |
*** shreshtha_ has joined #tripleo | 06:01 | |
*** pdeore_ has quit IRC | 06:01 | |
*** shreshtha_ has quit IRC | 06:01 | |
*** shreshtha_ has joined #tripleo | 06:01 | |
Tengu | hmmm. thinking a bit. I might do the same kind of thing we actually made in our puppet-accounts module. | 06:03 |
*** moshele has joined #tripleo | 06:03 | |
*** shreshtha has quit IRC | 06:03 | |
Tengu | it's a nice thing, allowing to pass either data to the define, or it will check if it exists in hiera. | 06:03 |
Tengu | guess that would add some complexity in the code itself, but at least… we fall in a standard hiera usage and syntaxe. | 06:04 |
Tengu | "." in hiera/yaml are hash separator, but in puppet, common separator is "::" | 06:04 |
Tengu | but that would require a dedicated patch. | 06:04 |
Tengu | so. I drop the modification I made in the service_endpoints and related unit test for now, jaosorior - so that I can create a dedicated review for that specific part. Else it will be a commit without "specific" purpose. | 06:05 |
Tengu | (i.e. adding basic auth, but also doing a huge change in non-related code) | 06:05 |
jaosorior | sounds good to me | 06:06 |
*** fragatina has quit IRC | 06:06 | |
jaosorior | I rather have smaller commits that go to the point | 06:06 |
Tengu | same for me. better for understanding and review. | 06:07 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Update website from setup.cfg https://review.openstack.org/526288 | 06:10 |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 06:10 |
*** mandre has quit IRC | 06:11 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: WIP: haproxy basic auth support https://review.openstack.org/525492 | 06:11 |
Tengu | jaosorior: cleaned my first review -^ | 06:11 |
Tengu | that should make "my" unit tests pass. | 06:11 |
*** 07EAALF06 has joined #tripleo | 06:12 | |
*** 07EAALF06 has quit IRC | 06:13 | |
*** fragatina has joined #tripleo | 06:13 | |
*** mandre has joined #tripleo | 06:15 | |
*** skramaja has joined #tripleo | 06:23 | |
openstackgerrit | Merged openstack/tripleo-ipsec master: Update website from setup.cfg https://review.openstack.org/526288 | 06:23 |
*** jaganathan has quit IRC | 06:23 | |
*** pdeore has joined #tripleo | 06:24 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Added unit test (induces syntax change for a currently unused resource) https://review.openstack.org/526292 | 06:25 |
Tengu | jaosorior: -^ | 06:25 |
Tengu | o_O can't add mwhahaha for a review… weird. | 06:26 |
Tengu | ok. had to add his full username - completion didn't want to show him. | 06:28 |
Tengu | jaosorior: I'm wondering what will happen if I add unit tests for the firewall thing… I think it will crash as well in the unit tests. | 06:29 |
jaosorior | perhaps | 06:29 |
Tengu | will make a cup of tea and check that assumption. | 06:30 |
*** kristaps_ has quit IRC | 06:31 | |
*** ykarel is now known as ykarel|afk | 06:31 | |
*** threestrands has quit IRC | 06:32 | |
*** marios has joined #tripleo | 06:33 | |
*** fragatina has quit IRC | 06:37 | |
*** jaganathan has joined #tripleo | 06:37 | |
*** shreshtha has joined #tripleo | 06:39 | |
*** karthiks has quit IRC | 06:41 | |
*** shreshtha_ has quit IRC | 06:42 | |
*** rwsu has joined #tripleo | 06:44 | |
Tengu | jaosorior: hmm. I see create_resources('tripleo::firewall::rule', $firewall_rules) on the puppet code for tripleo::firewall. Funny. | 06:45 |
Tengu | ah, sorry. | 06:46 |
Tengu | wondering how that can work though… will do a unit test for that $service_firewall_rules = hiera("tripleo.${underscore_name}.firewall_rules", {}) | 06:47 |
*** radeks has joined #tripleo | 06:47 | |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Add a tag to all the role specific parameters https://review.openstack.org/517231 | 06:50 |
*** karthiks has joined #tripleo | 06:53 | |
*** brault has quit IRC | 06:54 | |
s_b_34343 | d | 06:56 |
s_b_34343 | d | 06:56 |
Tengu | bingo… unit also fails for the "firewall" thing… | 06:57 |
s_b_34343 | Hi all , having one query that suppose my openstack is deployed with 2 controller 1 compute 1 datanode . and now i want add one more controller can we do this ? | 06:57 |
Tengu | duh. who did push "." instead of the standard "::" in that hiera stuff? X( | 06:57 |
s_b_34343 | can we scale confuguration once aftre deployment | 06:58 |
Tengu | s_b_34343: hello. you can't add a new controller once it's deployed. | 06:58 |
jaosorior | Tengu: damn | 06:58 |
s_b_34343 | Tengu: what about compute and block staograge | 06:58 |
jaosorior | Tengu: well, that firewall thing has been used in TripleO for a very long time | 06:59 |
Tengu | s_b_34343: that's the only component that can't be changed. You can add compute and datanode without problem, but computes… nope, it's a fixed number. And it won't work with 2 controllers either, no quorum for the HA | 06:59 |
Tengu | jaosorior: yep. Just wondering *how* it works | 06:59 |
jaosorior | *magic* | 06:59 |
Tengu | jaosorior: probably. But that's very uncool. | 06:59 |
Tengu | because we cannot push unit tests for that. | 06:59 |
Tengu | so if anyone wants to change something, we will be blind :(. | 07:00 |
*** shreshtha has quit IRC | 07:00 | |
jaosorior | damn, that's a bummer | 07:00 |
Tengu | "oh, yeah, that should work, but we don't have any way to prove it, well, just merge it and cross fingers" ;). | 07:00 |
jaosorior | good point | 07:00 |
Tengu | s_b_34343: btw, you can *replace* a failed controller (and any other kind of role). | 07:01 |
Tengu | jaosorior: I might send a mail to the ML in order to get some historic on that, shall I? | 07:01 |
s_b_34343 | ok but suppose 3 controller 2 compute and 1 datanode is there and i want to add one more datanodes . in this case againg i need to deploy openstack or only specific puppet for data node ? | 07:01 |
Tengu | jaosorior: I *thing* changing to the common syntaxe "::" shouldn't be that hard, I think there's only the tripleo-heat-templates repository to change… ? | 07:02 |
Tengu | s_b_34343: you will update the current install, and nothing should break | 07:02 |
s_b_34343 | how come | 07:02 |
s_b_34343 | i didint get this | 07:02 |
Tengu | s_b_34343: you update the numbers for the resource you want to change (datanode in your case), and you re-run the "deploy" command. Heat has the current stack state in its database, and will update only the required elements | 07:03 |
Tengu | s_b_34343: you might want to read a bit about how heat works - I don't know if you have any experience with amazon web services (AWS), but it's the same as "cloudformation" in that world. | 07:03 |
Tengu | s_b_34343: i.e. you describe your infrastructure in a stack, and you can update that stack | 07:04 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 07:04 |
*** karthiks has quit IRC | 07:04 | |
s_b_34343 | Tengu : thanks will explore about heat . can you refere some documetns which i can refere for better understanding | 07:05 |
*** nyechiel has joined #tripleo | 07:06 | |
s_b_34343 | Tengu: as you said compute cant add and it wont work with 2 controller . so you are saying that if 3 controller will be there then we and annd compute . is it something like that ? | 07:08 |
Tengu | s_b_34343: you create youre base with the final number of controllers (3 for HA, or any odd number in order to get a quorum for pacemaker). The other resources are more flexible, as you can add and remove them at will, following the right steps. | 07:10 |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 07:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
Tengu | s_b_34343: regarding doc, lemme check my bookmarks, I might have something. | 07:10 |
s_b_34343 | <Tengu> : which bookmarks ? | 07:11 |
*** rcernin has quit IRC | 07:11 | |
s_b_34343 | i dont know anything | 07:11 |
*** pmannidi has quit IRC | 07:11 | |
Tengu | s_b_34343: the one I have ;). but apparently I don't have links to the heat doc. A good starting point might be: https://wiki.openstack.org/wiki/Heat - it explains what heat is, and provides a few links. | 07:12 |
s_b_34343 | Tengu : thanks you so much . | 07:12 |
Tengu | s_b_34343: small remark though: you don't need to dig into heat in order to deploy tripleo - all is automated. Well, if there's a failure, then you'll need to use some "openstack stack" commands, of course ;). | 07:12 |
*** ccamacho has quit IRC | 07:13 | |
*** agurenko has joined #tripleo | 07:13 | |
s_b_34343 | ok some more doubts . during deployment whci logs i should refer | 07:13 |
Tengu | s_b_34343: and if you want a deeper insight of the tripleo deploy process, you might as well have a look at mistral, the openstack scheduler, but, as heat, you don't need to do anyting on that part as it's automated. | 07:14 |
Tengu | s_b_34343: you'll get the output in your terminal | 07:14 |
s_b_34343 | Tengu: like for containers and vip , failover something like that | 07:14 |
Tengu | s_b_34343: ah, if you want to describe what's deployed, you'll need to call the "openstack" CLI | 07:15 |
s_b_34343 | after deployment is i'm trying some failover or suppose container is down then where should i check logs | 07:15 |
*** yprokule has joined #tripleo | 07:15 | |
Tengu | s_b_34343: ah, those logs. hmm, in a container env, I'm not really sure (I'm still baremetal), you might want to check with another one ( jaosorior if you're available? -^^ ) | 07:16 |
*** karthiks has joined #tripleo | 07:17 | |
s_b_34343 | ok so for baremetal where can i check ? | 07:17 |
*** shreshtha has joined #tripleo | 07:18 | |
Tengu | you'll have all the logs in /var/log/<service-name>. You will also want to check "pcs status" in order to see what pacemaker is doing. | 07:18 |
Tengu | s_b_34343: basically, pacemaker will show you what service is affected by the test you're doing - most probably the VIP will be moved (hence you can run "ip a" in order to check the status), and some services like galera (mysql cluster), redis and rabbitMQ will be impacted. | 07:19 |
*** holser has joined #tripleo | 07:22 | |
jaosorior | for containers, it would be in /var/log/containers/<service name> | 07:22 |
Tengu | jaosorior: and is there a pacemaker as well, or is the HA part managed with kubernetes? | 07:24 |
jaosorior | k8s is not there yet | 07:25 |
jaosorior | so pacemaker logs are in the same place as always | 07:25 |
Tengu | cool | 07:25 |
jaosorior | I THINK some of the services managed by pacemaker do have logs in /var/log/container | 07:25 |
jaosorior | *containers | 07:25 |
Tengu | jaosorior: mainly pacemaker should manage service containers, there's only the VIP that's on the physical node… ? | 07:26 |
jaosorior | Tengu: right, but some of the nodes handled by pacemaker use syslog, so you won't find files for those | 07:28 |
jaosorior | Tengu: and yeah, only the VIPs should be on the physical node. | 07:28 |
Tengu | :) | 07:28 |
Tengu | I think I more or less see how things are going for the containers. | 07:28 |
*** ykarel|afk is now known as ykarel | 07:30 | |
Tengu | jaosorior: just sent an email in order to get some inputs for that weird non-standard syntax in hiera. hopefully we might converge to a better thing. standard is good. weird is bad. | 07:32 |
Tengu | (at least in software dev ;)) | 07:32 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix loop in config-download.yaml.j2 template https://review.openstack.org/523155 | 07:34 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: deploy-steps.j2: use ansible to bootstrap environment https://review.openstack.org/525291 | 07:34 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Update capabilities-map.yaml to include latest storage environments https://review.openstack.org/526077 | 07:34 |
openstackgerrit | Merged openstack/puppet-tripleo master: Instance HA support https://review.openstack.org/506922 | 07:34 |
openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common master: DPDK derive params inputs default value update https://review.openstack.org/525990 | 07:35 |
jaosorior | bandini: instance HA merged :D need any more reviews? | 07:37 |
*** aditya_r has joined #tripleo | 07:37 | |
Tengu | funny. now that I dropped the unit-test for tripleo::haproxy::service_endpoints (and related change in that definition, as I can't test the change), it seems zuul is happy :). | 07:39 |
*** hjensas has joined #tripleo | 07:39 | |
bandini | jaosorior: \o/ you are made of awesome! the corresponding tht one would be grand https://review.openstack.org/#/c/506350/ | 07:39 |
bandini | jaosorior: let me know if you need reviews from me | 07:39 |
jaosorior | bandini: no reviews right now; but if you know how to properly package ansible roles for RDO, help would sure be useful | 07:40 |
bandini | oh wow. no that is new territory for me. as in rpm packaging? | 07:41 |
*** jtomasek has joined #tripleo | 07:44 | |
jaosorior | bandini: yep | 07:44 |
*** karthiks has quit IRC | 07:59 | |
*** florianf has joined #tripleo | 08:01 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation https://review.openstack.org/526213 | 08:02 |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 08:10 |
*** karthiks has joined #tripleo | 08:12 | |
s_b_34343 | <Tengu> <jaosorior> : just wanted to know that only one vip get configure for controller ha ? | 08:12 |
s_b_34343 | and one more doubt regarding corosync , pacemaker and hsproxy ? | 08:13 |
s_b_34343 | how there three are connected to each other and how we are using them in trpleo | 08:14 |
Tengu | s_b_34343: the VIP is attached to only one controller, yes. pacemaker manages it and attach it to another controller server if the "master" is down for some reason. | 08:15 |
jaosorior | s_b_34343: there is actually a VIP per-network usually (although not for all networks). | 08:15 |
Tengu | hmm yep, "the VIP" is kind of unprecise :] | 08:15 |
*** ccamacho has joined #tripleo | 08:15 | |
*** aditya_r has quit IRC | 08:15 | |
*** tesseract has joined #tripleo | 08:15 | |
jaosorior | s_b_34343: you can see which networks are used by default and which of them have a VIP here: https://github.com/openstack/tripleo-heat-templates/blob/master/network_data.yaml | 08:16 |
s_b_34343 | after controller failover dose another controller will display that in therire interface list | 08:16 |
s_b_34343 | ? | 08:16 |
*** bogdando has joined #tripleo | 08:16 | |
jaosorior | yes | 08:17 |
Tengu | s_b_34343: pacemaker will switch the VIPs to another controller, yes. and you'll be able to list the IPs using "ip addr ls" | 08:17 |
s_b_34343 | ok so this activity pacemaker is doing and what about corosync and haproxy | 08:17 |
Tengu | s_b_34343: haproxy is the loadbalancer. | 08:18 |
Tengu | s_b_34343: haproxy acts also as the endpoint for APIs (i.e. that's where the TLS certificate is installed in order to get TLS connections). it also acts as a load-balancer for the services, like galera (mysql cluster), web API and so on. | 08:19 |
Tengu | corosync is a piece of software related to pacemaker. | 08:19 |
*** rcernin has joined #tripleo | 08:19 | |
*** aufi has joined #tripleo | 08:19 | |
*** iranzo has joined #tripleo | 08:20 | |
*** ffiore has joined #tripleo | 08:22 | |
*** mdnadeem has joined #tripleo | 08:22 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-ipsec master: Persist role in a path discoverable by ansible https://review.openstack.org/526311 | 08:25 |
openstackgerrit | Merged openstack/tripleo-upgrade master: Setup tox https://review.openstack.org/525676 | 08:25 |
Tengu | hmmmmm. the tripleo third party CI seems broken at some point… | 08:27 |
*** gkadam has joined #tripleo | 08:27 | |
*** cylopez has joined #tripleo | 08:27 | |
Tengu | https://logs.rdoproject.org/92/525492/4/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-nv/Zcc9649929cd445e3a5b19f34eb7653c1/console.txt.gz#_2017-12-07_06_13_36_204 | 08:28 |
*** cylopez has left #tripleo | 08:30 | |
*** oidgar has joined #tripleo | 08:31 | |
*** jpena|off is now known as jpena | 08:32 | |
*** ffiore has quit IRC | 08:32 | |
*** aditya_r has joined #tripleo | 08:34 | |
openstackgerrit | Merged openstack/tripleo-upgrade master: Update .gitreview. https://review.openstack.org/524142 | 08:37 |
*** salmankhan has joined #tripleo | 08:38 | |
*** ukalifon has joined #tripleo | 08:40 | |
*** salmankhan has quit IRC | 08:42 | |
openstackgerrit | Merged openstack/tripleo-ipsec master: Persist role in a path discoverable by ansible https://review.openstack.org/526311 | 08:45 |
*** aditya_r has quit IRC | 08:47 | |
*** dpawar has quit IRC | 08:48 | |
*** aditya_r has joined #tripleo | 08:48 | |
*** mcornea has joined #tripleo | 08:57 | |
*** jpich has joined #tripleo | 08:58 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-heat-templates master: Add missing parameters to octavia worker https://review.openstack.org/526080 | 09:02 |
*** shardy has joined #tripleo | 09:03 | |
*** dpawar has joined #tripleo | 09:03 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 09:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
*** aditya_r has quit IRC | 09:10 | |
*** aditya_r has joined #tripleo | 09:10 | |
chandankumar | mwhahaha: arxcruz can you update this bug https://bugs.launchpad.net/os-testr/+bug/1733983 with the review | 09:13 |
openstack | Launchpad bug 1733983 in tripleo "Tempest reports 'missing Worker 1!'" [Medium,Triaged] | 09:13 |
*** gfidente has joined #tripleo | 09:15 | |
*** gfidente has quit IRC | 09:15 | |
*** gfidente has joined #tripleo | 09:15 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: SR-IOV agent: allow to configure agent extensions https://review.openstack.org/526222 | 09:18 |
jaganathan | gfidente, hi, please review https://review.openstack.org/#/c/523358/ | 09:19 |
*** mrch has joined #tripleo | 09:21 | |
s_b_34343 | <jaosorior> <Tengu> : thansk it was really helpful to understand these things | 09:21 |
Tengu | s_b_34343: happy to help :) | 09:22 |
s_b_34343 | :) | 09:22 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config https://review.openstack.org/525236 | 09:23 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-common master: Reduce the calls to heat when downloading config https://review.openstack.org/525236 | 09:26 |
openstackgerrit | Giulio Fidente proposed openstack/instack-undercloud stable/pike: Set nova dhcp_domain to empty string https://review.openstack.org/526323 | 09:26 |
*** moshele has quit IRC | 09:29 | |
*** sshnaidm|afk is now known as sshnaidm|rover | 09:30 | |
*** kbyrne has quit IRC | 09:31 | |
*** kbyrne has joined #tripleo | 09:34 | |
*** lucas-afk is now known as lucasagomes | 09:35 | |
*** derekh has joined #tripleo | 09:36 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation https://review.openstack.org/526213 | 09:36 |
*** ykarel is now known as ykarel|lunch | 09:37 | |
*** andreaf has quit IRC | 09:42 | |
*** andreaf has joined #tripleo | 09:42 | |
*** aditya_r has quit IRC | 09:43 | |
*** aufi has quit IRC | 09:44 | |
*** aufi has joined #tripleo | 09:44 | |
*** athomas has joined #tripleo | 09:46 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation https://review.openstack.org/526213 | 09:47 |
*** sri_ has quit IRC | 09:51 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Save oooq generated files https://review.openstack.org/517136 | 09:51 |
*** hewbrocca_afk is now known as hewbrocca | 09:51 | |
arxcruz | chandankumar: which review ? | 09:52 |
chandankumar | arxcruz: there was a patch floating related to worker fix | 09:53 |
arxcruz | chandankumar: which patch ? | 09:54 |
chandankumar | arxcruz: https://review.openstack.org/#/c/518575/ i think it is related to the above bug | 09:56 |
chandankumar | we were doing bug traiging on qa so asked | 09:57 |
arxcruz | chandankumar: not sure if it's related... the worker is there, it just not... work... | 09:57 |
arxcruz | chandankumar: but it's a valid patch | 09:57 |
Tengu | small question: why is openstack based on mariadb instead of postgresql? is it due to the pseudo-multi-master mode supported by mysql, or is there something else? | 09:57 |
arxcruz | chandankumar: plus, from what I understood from https://bugs.launchpad.net/os-testr/+bug/1733983/comments/2 the bug is fixed in os-testr and stestr newest versions | 09:59 |
openstack | Launchpad bug 1733983 in tripleo "Tempest reports 'missing Worker 1!'" [Medium,Triaged] | 09:59 |
chandankumar | arxcruz: yup, in stestr is fixed | 09:59 |
*** ebarrera has joined #tripleo | 10:00 | |
*** moshele has joined #tripleo | 10:00 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation https://review.openstack.org/526213 | 10:00 |
*** shardy has quit IRC | 10:02 | |
*** shardy has joined #tripleo | 10:04 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: WIP: haproxy basic auth support https://review.openstack.org/525492 | 10:06 |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 10:10 |
*** tosky has joined #tripleo | 10:11 | |
*** salmankhan has joined #tripleo | 10:13 | |
*** ebarrera has quit IRC | 10:16 | |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: [WIP] undercloud: set default_resource_class to 'baremetal' https://review.openstack.org/526078 | 10:19 |
*** paramite has joined #tripleo | 10:19 | |
*** cshastri has quit IRC | 10:20 | |
*** rcernin has quit IRC | 10:21 | |
*** sri_ has joined #tripleo | 10:25 | |
*** ffiore has joined #tripleo | 10:27 | |
*** dsariel has quit IRC | 10:28 | |
*** marios has quit IRC | 10:30 | |
openstackgerrit | Sanjay Upadhyay proposed openstack/tripleo-quickstart master: Fix default deploy where undercloud install scripts are not installed. https://review.openstack.org/526334 | 10:32 |
*** dtantsur|afk is now known as dtantsur | 10:32 | |
openstackgerrit | Cédric Jeanneret proposed openstack/puppet-tripleo master: Add unit test for tripleo::haproxy::service_endpoints https://review.openstack.org/526292 | 10:33 |
*** s_b_34343 has left #tripleo | 10:33 | |
Tengu | bogdando: hello! just updated the commit message -^ :). Lemme know if this is better for you. | 10:33 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix puppet config volume for iscsid container https://review.openstack.org/524187 | 10:34 |
Tengu | bogdando: also, I sent a mail on the dev ML in order to find out why dots are used instead of semicolon for some cases - it's non-standard and creates issues. If you have some answers, it would be nice to have a look :) | 10:34 |
bogdando | I think those former ruby devs just love dots more than semicolons, Tengu | 10:36 |
Tengu | bogdando: hmm ok. we really should push semicolons instead, in order to be able to get proper unit tests :). | 10:36 |
bogdando | +1 | 10:36 |
Tengu | without them, we're blind whenever we need to do changes. | 10:36 |
bogdando | mwhahaha: ^^ | 10:36 |
Tengu | bogdando: Alex is in the review (I added him). Hopefully I'll be able to get some advices/points of view regarding that change, and push forward for a "small" refactoring that will "only" hit puppet-tripleo and tripleo-heat-templates (sed, my friend, I love you ;)) | 10:38 |
*** pdeore has quit IRC | 10:38 | |
Tengu | IF we can move to semicolons, I'll be able to provide a quick patch in order to get unit tests for the tripleo::firewall::service_rules as well. | 10:39 |
Tengu | that one will require some changes in the heat templates, but nothing really hard. AND I'm pretty sure we'd love to still get the "dot" support for backward compatibility :] | 10:39 |
Tengu | won't be that hard to do. | 10:39 |
Tengu | … but it will be hard (if not impossible) to properly test the backward compatibility, of course -.-' | 10:40 |
shardy | owalsh: Hi, stable/pike CI seems to be failing due to the password introduced in https://review.openstack.org/#/c/522848/ | 10:40 |
shardy | just wondered if anyone was already looking into it? | 10:40 |
shardy | logs.openstack.org/58/522558/1/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/f67f8a6/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_08_05_27 | 10:40 |
shardy | resources.ServiceChain: Property error: resources[21].properties: Property LibvirtTLSPassword not assigned | 10:41 |
owalsh | shardy: is tripleo-common up to date on the undercloud? | 10:41 |
shardy | owalsh: it should be, but I'm just checking we've not broken something | 10:41 |
owalsh | shardy: should have it in the generated passwords https://review.openstack.org/522846 | 10:43 |
shardy | owalsh: yea, I see the backport, just trying to work out why it's suddenly broken | 10:43 |
*** pdeore has joined #tripleo | 10:44 | |
dtantsur | hey, can someone with +2 on validations check https://review.openstack.org/#/c/512375/ please? it's been around for a while already | 10:44 |
shardy | openstack-tripleo-common-7.6.6-0.20171207065611.c32dd61.el7.centos.noarch | 10:44 |
shardy | hrm | 10:44 |
*** agurenko has quit IRC | 10:45 | |
*** agurenko has joined #tripleo | 10:46 | |
*** pgadiya has quit IRC | 10:47 | |
shardy | owalsh: Ok I think the patch just needs a rebase, sorry for the noise | 10:48 |
shardy | ramishra: ^^ can you rebase https://review.openstack.org/#/c/522558/ please? | 10:48 |
owalsh | shardy: ack, just about to say that :-) | 10:48 |
* shardy needs more coffee ;) | 10:48 | |
*** daidv has quit IRC | 10:48 | |
*** daidv has joined #tripleo | 10:49 | |
*** mathiasb has joined #tripleo | 10:52 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Undercloud deploy: use docker-uc.yaml https://review.openstack.org/526337 | 10:53 |
*** s_b_34343 has joined #tripleo | 10:54 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common stable/pike: Raise stored HTTPError when fetching swift object https://review.openstack.org/522558 | 10:55 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Get rid of Undercloud* specific service entries in resource registry https://review.openstack.org/524644 | 10:56 |
*** jaganathan has quit IRC | 11:09 | |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 11:10 |
*** jkilpatr has quit IRC | 11:12 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move step 1 preparation to deploy-steps-tasks.yaml https://review.openstack.org/525260 | 11:15 |
*** marios has joined #tripleo | 11:15 | |
sshnaidm|rover | mandre, ping about https://review.rdoproject.org/r/#/c/10845/ | 11:17 |
*** marios has quit IRC | 11:18 | |
*** yprokule has quit IRC | 11:18 | |
*** abishop has joined #tripleo | 11:18 | |
*** marios has joined #tripleo | 11:18 | |
*** yprokule has joined #tripleo | 11:18 | |
*** stendulker has quit IRC | 11:20 | |
*** yprokule has quit IRC | 11:23 | |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent https://review.openstack.org/525164 | 11:25 |
*** liverpooler has quit IRC | 11:25 | |
*** dsariel has joined #tripleo | 11:27 | |
*** udesale has quit IRC | 11:28 | |
dtantsur | can someone please merge this small clean up? https://review.openstack.org/#/c/522825/ | 11:32 |
dtantsur | shardy: if you have a second ^^ | 11:32 |
shardy | dtantsur: sure, will do - if you get a moment could you check https://review.openstack.org/#/c/521493/ & see if you can see why I've broken the build attempting to address your comments? | 11:34 |
shardy | dtantsur: my rst-foo has failed me, any pointers appreciated | 11:34 |
dtantsur | shardy: looking | 11:34 |
*** akrivoka has joined #tripleo | 11:35 | |
gfidente | d0ugal I think processutils is always returning string here https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/ansible.py#L219 right? | 11:36 |
gfidente | d0ugal so if I made ansible return json it won't be enough? | 11:36 |
shardy | dtantsur: lgtm but we also set it in the stackrc for accessing the undercloud services | 11:37 |
gfidente | d0ugal to make it consumable within the workflow | 11:37 |
d0ugal | gfidente: correct, you need to parse the JSON, but that is easy. | 11:38 |
dtantsur | shardy: right, and this is expect. tripleo undercloud is an application written against a specific API version. | 11:38 |
* d0ugal looks for an example | 11:38 | |
gfidente | d0ugal try/except? | 11:38 |
gfidente | d0ugal I am thinking to add it | 11:38 |
dtantsur | while overcloud is just a cloud, so we should allow users to pick a version | 11:38 |
gfidente | d0ugal unless you want to :D | 11:38 |
*** dpawar has quit IRC | 11:38 | |
dtantsur | shardy: left some comments about rst, sorry if I confused you previously. I can update the patch for you, if you want. | 11:39 |
d0ugal | gfidente: well, you can pase the JSON in the workflow - to avoid changing everywhere the action is used | 11:39 |
gfidente | d0ugal ah in the workflow? how? | 11:39 |
shardy | dtantsur: thanks, if you have time feel free to push the changes, otherwise I'll do it this afternoon | 11:39 |
shardy | thanks for the help! :) | 11:39 |
gfidente | d0ugal some jinja filter? | 11:39 |
dtantsur | shardy: lemme do it, I've written A LOT of documentation recently :) | 11:39 |
d0ugal | gfidente: yeah, there is a jinja and yaql function in mistral | 11:40 |
shardy | dtantsur: hehe, thanks! :) | 11:40 |
d0ugal | gfidente: json_parse, thrash|g0ne added it recently-ish. | 11:40 |
d0ugal | gfidente: trying to find you an example but my internet is crawling | 11:40 |
*** janki has quit IRC | 11:40 | |
gfidente | json_parse is the yaql version? | 11:40 |
*** janki has joined #tripleo | 11:40 | |
d0ugal | gfidente: it is in jinja2 and yaql - mistral adds it to both. | 11:41 |
openstackgerrit | Merged openstack/instack-undercloud master: Set nova dhcp_domain to empty string https://review.openstack.org/525193 | 11:41 |
gfidente | https://github.com/openstack/mistral/blob/master/setup.cfg#L88 | 11:41 |
gfidente | d0ugal it's not in pike! | 11:42 |
gfidente | damn | 11:42 |
d0ugal | gfidente: nope, it isn't. | 11:42 |
d0ugal | gfidente: the problem is, if you change it in the action you change it for everyone. | 11:43 |
gfidente | yeah | 11:43 |
d0ugal | gfidente: what is it that you need to do? Why do you need to parse the JSON? | 11:43 |
gfidente | d0ugal ansible returns json I want to consume in the workflow | 11:43 |
gfidente | task().result.stdout.get(shit) | 11:43 |
gfidente | json_parse(task().result.stdout).get(shit) ? | 11:44 |
*** abregman is now known as abregman|mtg | 11:45 | |
d0ugal | gfidente: that would do it, but not in pike | 11:45 |
gfidente | backpoooooort | 11:45 |
gfidente | let me finish the changes in the workflow first | 11:45 |
gfidente | so you can review those | 11:45 |
*** salmankhan has quit IRC | 11:45 | |
d0ugal | gfidente: sure | 11:45 |
*** jkilpatr has joined #tripleo | 11:47 | |
*** salmankhan has joined #tripleo | 11:49 | |
*** dpawar has joined #tripleo | 11:51 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart-extras master: WIP: wire up queens upgrade workflow https://review.openstack.org/526006 | 11:52 |
*** raildo has joined #tripleo | 11:52 | |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: Add composable networks documentation https://review.openstack.org/521493 | 11:54 |
dtantsur | shardy: ^^ | 11:55 |
shardy | dtantsur: thanks! | 11:55 |
*** dparkes has joined #tripleo | 11:55 | |
dtantsur | np | 11:55 |
*** ykarel|lunch is now known as ykarel | 11:59 | |
dalvarez | hi guys, anyone familiar with this error? http://paste.openstack.org/show/628357/ | 12:03 |
dalvarez | i have checked that "openstack baremetal node list" shows every node as 'available' and there's also no stack created | 12:03 |
*** agurenko has quit IRC | 12:03 | |
shardy | dalvarez: Hi, I just hit the same error after upgrading my undercloud | 12:04 |
shardy | d0ugal: ^^ hey any ideas? | 12:04 |
shardy | seems to be coming from wf=tripleo.swift_rings_backup.v1.create_swift_rings_backup_container_plan, but that hasn't changed recently AFAICS | 12:04 |
openstackgerrit | Merged openstack/tripleo-common master: Pass the execution id to AnsibleAction https://review.openstack.org/524617 | 12:05 |
shardy | dalvarez: FWIW this is what got updated https://paste.fedoraproject.org/paste/8YygdPNWWXBizYC-0Jsh3g | 12:08 |
shardy | not yet figured out what the root cause is | 12:08 |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 12:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstackgerrit | Merged openstack/tripleo-common master: Concurrent upload container images https://review.openstack.org/522055 | 12:17 |
openstackgerrit | Lee Yarwood proposed openstack/tripleo-specs master: WIP ffu: Spec update for M2 https://review.openstack.org/526353 | 12:18 |
lyarwood | marios, chem ^ FYI, spec update for FFU, WIP while I work on this today but reviews welcome | 12:19 |
*** ansmith has quit IRC | 12:19 | |
chem | lyarwood: ack, will look | 12:19 |
openstackgerrit | Lee Yarwood proposed openstack/tripleo-specs master: WIP ffu: Spec update for M2 https://review.openstack.org/526353 | 12:21 |
lyarwood | me-- one day, I'll submit a change without whitespace.. | 12:21 |
*** thrash|g0ne is now known as thrash | 12:28 | |
marios | ack thanks lyarwood | 12:29 |
oidgar | hi guys, I got an error while deploying overcloud containerized in controller step 1. the error related to gnocchi (Failed running docker-puppet.py for gnocchi) - pastebin: https://da.gd/x9xwV | 12:30 |
oidgar | anyone familiar with this issue? | 12:31 |
*** dprince has joined #tripleo | 12:34 | |
d0ugal | shardy, dalvarez: I would need to see the executor log to know what is going on. It looks like tripleo.plan.create_container failed | 12:34 |
d0ugal | there is an error in the error-handling, so we don't see the real issue. I'll fix that now. | 12:34 |
*** pchavva has joined #tripleo | 12:35 | |
s_b_34343 | <Tengu> <jaosorior> : wanted to know that how rabbitmq works using vip or how ? | 12:36 |
s_b_34343 | have checked /etc/haproxy/haproxy.cfg but in this there is not protocol added for raabitmq | 12:37 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Correct a task name in create_swift_rings_backup_container_plan https://review.openstack.org/526357 | 12:37 |
d0ugal | shardy, dalvarez: ^ that should fix the error handling issue. | 12:38 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split playbooks https://review.openstack.org/525252 | 12:39 |
beagles | oidgar, you probably want to check with pradk - doesn't seem to be online yet | 12:40 |
*** jpena is now known as jpena|lunch | 12:40 | |
Tengu | s_b_34343: not sure the rabbitmq is used through haproxy. | 12:40 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 12:40 |
jaosorior | s_b_34343, Tengu: rabbitmq isn't used with HAproxy | 12:41 |
Tengu | it's on a specific VIP right? | 12:41 |
jaosorior | nope | 12:41 |
s_b_34343 | yes | 12:41 |
*** leitan has joined #tripleo | 12:41 | |
s_b_34343 | oh ok | 12:41 |
jaosorior | Tengu, s_b_34343: for rabbitmq we do have all the node FQDNs. | 12:41 |
Tengu | ah, ok. | 12:42 |
*** ramishra has quit IRC | 12:42 | |
jaosorior | but the node registration is handled by pacemaker | 12:42 |
jaosorior | so it's all done by the resource agent | 12:42 |
jaosorior | IIRC | 12:42 |
s_b_34343 | can we hande that with vip | 12:42 |
s_b_34343 | by any cghance | 12:42 |
jaosorior | s_b_34343: not sure | 12:43 |
jpich | jtomasek: There's a bunch of scripts that run in "post" jobs (after a patch has merged) to update the strings in Zanata - see e.g. https://github.com/openstack-infra/project-config/blob/605299/jenkins/scripts/common_translation_update.sh#L253 then it follows with https://github.com/openstack-infra/project-config/blob/605299/jenkins/scripts/upstream_translation_update.sh#L115 | 12:44 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 12:44 |
*** anilvenkata has quit IRC | 12:44 | |
jpich | jtomasek: On the other side, a periodic job runs every morning to submit the translations back to the project | 12:44 |
jtomasek | jpich: awesome, thanks | 12:45 |
jpich | jtomasek: I wrote up the notes from my deep dive about that stuff at http://www.jpichon.net/blog/2017/07/tripleo-deep-dive-internationalisation-ui/ if you want more nitty gritty details, there's a link to the recording as well. Not sure how much has changed with the migration to zuul v3, the scripts seem to still exist in the same repo at least! | 12:45 |
*** pdeore has quit IRC | 12:47 | |
*** lucasagomes is now known as lucas-hungry | 12:47 | |
*** psahoo has quit IRC | 12:48 | |
beagles | shardy, is there some kind of known issue with gnocchi deployment? oidgar is getting this "Error: /Stage[main]/Gnocchi::Wsgi::Apache/Openstacklib::Wsgi::Apache[gnocchi_wsgi]/File[gnocchi_wsgi]: Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/lib/python2.7/site-packages/gnocchi/rest/app.wsgi", | 12:49 |
*** vpickard_ is now known as vpickard | 12:49 | |
beagles | shardy, his fpaste for all of the results is https://paste.fedoraproject.org/paste/XfvZvYxQomWDqWXcvbRmEA | 12:50 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 12:50 |
beagles | shardy, there is an undefined "deploy_config_name" warning above it a few lines - don't know if that's related at all | 12:50 |
d0ugal | thrash: https://review.openstack.org/#/c/526357/ - quick patch to fix an error in a workflow if you have a moment. | 12:51 |
beagles | though it must just be something that is happening in his environment otherwise the CI jobs would be blowing up too | 12:51 |
*** rhallisey has joined #tripleo | 12:51 | |
openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart-extras master: [WIP] Support running tripleo-common-tempest-plugin on an undercloud https://review.openstack.org/522300 | 12:53 |
*** psachin has quit IRC | 12:59 | |
*** BryanS68 has joined #tripleo | 12:59 | |
*** dsariel has quit IRC | 13:01 | |
*** ykarel has quit IRC | 13:03 | |
*** dparkes has quit IRC | 13:04 | |
*** liverpooler has joined #tripleo | 13:05 | |
*** yprokule has joined #tripleo | 13:06 | |
fultonj | would anyone like to review https://review.openstack.org/#/c/520357 ? | 13:09 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-common stable/pike: [DO NOT MERGE] Testing upgrade. https://review.openstack.org/523408 | 13:09 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 13:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
*** oidgar is now known as oidgar___ | 13:10 | |
jaosorior | fultonj: will review for beer | 13:10 |
fultonj | jaosorior: you got it, i'll get you a pint in Dublin | 13:10 |
fultonj | :) | 13:10 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: WIP: remove the heat upgrade steps for Q upgrade workflow https://review.openstack.org/526017 | 13:11 |
shardy | So *that's* the trick to getting faster reviews around here :D | 13:11 |
dalvarez | shardy, d0ugal thanks guys, looking into it now | 13:11 |
jaosorior | fultonj: it's bit confusing though, the original patch was reverted some days later https://review.openstack.org/#/c/503610/ | 13:11 |
*** ykarel has joined #tripleo | 13:12 | |
shardy | beagles: looking, not aware of any issues but tbh I don't enable telemetry things for my local testing | 13:12 |
fultonj | jaosorior: eek, my bad | 13:12 |
*** ansmith has joined #tripleo | 13:12 | |
beagles | shardy: heheh, I haven't in the last two weeks either. I think it might actually be caused by a stale overcloud image. Or's going to try rebuilding his and we'll go from there. | 13:12 |
jaosorior | fultonj: it apparently was reverted due to it missing some heat functionality. Is that functionality available in pike already? | 13:13 |
fultonj | jaosorior: i doubt it | 13:13 |
fultonj | jaosorior: sorry i will look into that | 13:13 |
jaosorior | no biggie | 13:13 |
fultonj | jaosorior: good catch | 13:13 |
shardy | beagles: yeah that would be the first thing to try | 13:13 |
shardy | update undercloud & overcloud full then re-test | 13:14 |
*** oidgar___ has quit IRC | 13:14 | |
shardy | d0ugal: thanks for the patch, re-testing locally now | 13:14 |
* shardy wonders why CI isn't broken in the same way | 13:15 | |
*** jlabarre has joined #tripleo | 13:15 | |
*** janki has quit IRC | 13:15 | |
d0ugal | shardy: thanks, if you have the logs I can try and dig out the real error. | 13:17 |
shardy | http://paste.openstack.org/show/628362/ | 13:20 |
shardy | d0ugal: I think that's where the problems started - did it pass CI because we're not testing validations? | 13:20 |
shardy | Validating overcloud-swift-rings with pattern ^[a-zA-Z0-9-]+$ pattern_validator | 13:21 |
chandankumar | alee: around? | 13:21 |
chandankumar | alee: i have take a look at the barbican tempest changes | 13:21 |
therve | chem, Re upgrade error, there is an obvious bug here: https://github.com/openstack/tripleo-common/blob/master/workbooks/swift_rings_backup.yaml#L75 | 13:21 |
*** pkovar has joined #tripleo | 13:21 | |
therve | A different one than reported though | 13:21 |
d0ugal | shardy: That error is usually expected. | 13:22 |
chandankumar | alee: you need to add one config in tempest_extra_config service_avaailable.barbican: True | 13:22 |
chandankumar | in order to invoke barbican tests | 13:22 |
shardy | therve: think that is the same issue d0ugal and I are discussing? | 13:22 |
shardy | https://review.openstack.org/#/c/526357/1/workbooks/swift_rings_backup.yaml | 13:22 |
therve | Ah maybe :) | 13:23 |
*** dpeacock has quit IRC | 13:23 | |
* therve reads | 13:23 | |
d0ugal | therve: https://review.openstack.org/526357 | 13:23 |
sshnaidm|rover | arxcruz, let's see if it happens again: https://bugs.launchpad.net/tripleo/+bug/1736950 | 13:23 |
openstack | Launchpad bug 1736950 in tripleo "CI: mistral testmistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter fails in gate scenario003 containers" [High,Triaged] | 13:23 |
therve | d0ugal, Yeah +1. chem was updating https://bugs.launchpad.net/tripleo/+bug/1725338 but it's not the same workflow at all | 13:23 |
openstack | Launchpad bug 1725338 in tripleo "update_nodes workflow doesn't report errors properly" [High,Triaged] | 13:23 |
*** ykarel has quit IRC | 13:24 | |
*** dpeacock has joined #tripleo | 13:24 | |
d0ugal | Right | 13:25 |
*** tzumainn has joined #tripleo | 13:25 | |
*** bfournie has quit IRC | 13:25 | |
chem | therve: d0ugal maybe not the same workflow but exactly the same error "error=Unknown function "#property#result", data={}" | 13:25 |
*** bfournie has joined #tripleo | 13:25 | |
therve | chem, Sure, but that's a generic error | 13:25 |
d0ugal | It just means task() returns None | 13:26 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split playbooks https://review.openstack.org/525252 | 13:27 |
therve | That bug is actually probably fixed | 13:27 |
shardy | Hmm, well it's the error that gets displayed to the user via the CLI, so not all that informative | 13:27 |
*** athomas has quit IRC | 13:28 | |
*** skramaja has quit IRC | 13:28 | |
*** abregman|mtg is now known as abregman | 13:28 | |
openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates master: Expose logs from nova_libvirt container https://review.openstack.org/522295 | 13:29 |
therve | shardy, the expression is just before, that's where the meaningful part is | 13:29 |
therve | No that it's much better | 13:29 |
*** lucas-hungry is now known as lucasagomes | 13:29 | |
shardy | https://paste.fedoraproject.org/paste/CCbK0qPZyq~wSgMlbIV1GA | 13:29 |
shardy | ack, well those are the relevant logs I think | 13:29 |
*** bfournie has quit IRC | 13:30 | |
therve | Can not evaluate YAQL expression [expression=task(create_container_failed).result | 13:30 |
*** oidgar___ has joined #tripleo | 13:30 | |
openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: Implements AIDE Intrusion Detection System https://review.openstack.org/483025 | 13:31 |
shardy | yeah so the patch from d0ugal should fix it I guess, re-testing now | 13:31 |
chem | holser: so https://review.openstack.org/#/c/526357/1/workbooks/swift_rings_backup.yaml should fix the current upgrade error | 13:31 |
holser | chem let me check | 13:32 |
therve | d0ugal, Couldn't we delete all the task(stuff).result by passing data explicitly? | 13:32 |
marios | chem: do you mean this one https://logs.rdoproject.org/80/526080/5/openstack-check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-master/Zfa08883effa24240a994f0d522381af9/undercloud/home/jenkins/overcloud_upgrade_console.log.txt.gz#_2017-12-07_10_18_26 | 13:32 |
therve | marios, Yes | 13:33 |
d0ugal | therve: yeah, by publishing? we could. | 13:33 |
openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: Implements AIDE Intrusion Detection System https://review.openstack.org/483028 | 13:33 |
chem | marios: yes | 13:33 |
d0ugal | therve: but not sure I follow exactly | 13:33 |
therve | d0ugal, Well, always do task().result, never task(other).result | 13:33 |
*** rlandy has joined #tripleo | 13:33 | |
d0ugal | therve: yup, that would be better I think. | 13:34 |
therve | As we don't have any validation that "other" actually run at the point of calling | 13:34 |
marios | therve: thanks. chem for pike it is valid but for master i've decided not to look into the errors/file bugs because it is running the wrong thing (i.e. until https://review.openstack.org/#/c/526006/) | 13:34 |
*** janki has joined #tripleo | 13:34 | |
marios | chem: does it make sense? so i guess you are referring to the pike upgrade job specifically? | 13:34 |
*** vpickard is now known as vpickard_ | 13:34 | |
holser | chem - there is a bigger issue | 13:34 |
marios | holser: chem i didn't see the pike logs and didn't realise it is failing on the same thing (assuming you are indeed referring to the pike job here) | 13:35 |
*** brault has joined #tripleo | 13:36 | |
therve | chem, marios so yeah it shouldn't fix the issue, but you'll get the real error instead | 13:37 |
chem | marios: hum ... nope this is master-undercloud-pike-overcloud, so yes, it's not implementing the right workflow. | 13:37 |
therve | create_container shouldn't be failing AFAIU | 13:37 |
chem | therve: right | 13:37 |
*** brault_ has joined #tripleo | 13:38 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Chanting sahara tempest plugin names https://review.openstack.org/526388 | 13:38 |
*** jkilpatr has quit IRC | 13:38 | |
*** brault_ has quit IRC | 13:39 | |
chem | marios: oki, so everything for master is there https://review.openstack.org/#/c/526006/ then, | 13:39 |
chem | holser: what was the bigger issue ? | 13:39 |
marios | chem: no, well the dependency is the implementation for the upgrade. that is just changing the upgrade script | 13:39 |
*** brault_ has joined #tripleo | 13:39 | |
marios | chem: but that is what we need to run on the gate-tripleo-ci-centos-7-containers-multinode-upgrades-master | 13:39 |
*** brault has quit IRC | 13:40 | |
chem | marios: yeah, and currently it's badly red :) | 13:40 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Changing sahara tempest plugin names https://review.openstack.org/526388 | 13:40 |
shardy | d0ugal: that gets past the original error, but now it fails with "A container with the name overcloud-swift-rings already exists" | 13:40 |
marios | chem: unfortunately latest run failed on build-test-packages : Run DLRN i left a comment with pointers and trying a recheck | 13:41 |
therve | shardy, Yeah that makes sense :) | 13:41 |
chem | marios: so all master upgrade jobs is the result from this review https://review.openstack.org/#/c/526006/ and the rest is currently irrelevent | 13:41 |
openstackgerrit | Bogdan Dobrelya proposed openstack/puppet-tripleo master: Bind-mount iscsid IQN by its real host path https://review.openstack.org/526390 | 13:41 |
shardy | http://paste.openstack.org/show/628364/ fwiw | 13:41 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Fix puppet config volume for iscsid in containers https://review.openstack.org/524187 | 13:41 |
marios | chem: well for starters. I mean any error we see because we are running "openstack overcloud deploy -e major-upgrade-composable-docker.yaml ... " is irrelevant right now | 13:41 |
chem | marios: that's unfortunate that we don't have a always working upgrade path though | 13:42 |
marios | chem: since we instead want to be running openstack overcloud upgrade --init-update --container-registry-file etc | 13:42 |
*** adarazs is now known as adarazs_brb | 13:43 | |
marios | chem: and as you know they are different things entirely, the new one doesn't apply any of the heat deployment steps "noop stack update" for the playbooks | 13:43 |
shardy | therve, d0ugal: so it seems like the/an issue is we don't delete the overcloud-swift-rings or overcloud-config containers when we delete the plan | 13:43 |
*** agurenko has joined #tripleo | 13:43 | |
*** agurenko has quit IRC | 13:43 | |
marios | chem: well yeah it is unfortunate that we are changing the workflow again. but in this particular case deployment will also move in a similar direction eventually with ansible-playbook | 13:44 |
marios | chem: so the pike upgrade job will be doing a different thing to the master upgrade job | 13:44 |
therve | shardy, Hum, do we delete the plan at that point? | 13:45 |
therve | It feels that update_deployment_plan should just be fixed | 13:45 |
chem | marios: oki, so master upgrade jobs is going to be broken for a while | 13:45 |
shardy | therve: I did overcloud plan delete as this is a new deployment, where I'd previously only deleted the stack | 13:46 |
*** jpena|lunch is now known as jpena | 13:46 | |
shardy | the first thing I tried was cleaning out the plan, but it doesn't delete all plan-related things AFAICS | 13:46 |
therve | Wait hold, there is a check_container right there | 13:46 |
chem | marios: in the meantime fix o->p upgrade jobs and try to have https://review.openstack.org/#/c/526006/ green as soon as we can | 13:46 |
shardy | openstack container delete --recursive overcloud-swift-rings worked around it | 13:46 |
marios | chem: ack i'd like to at least see this running for starters https://review.openstack.org/#/c/526006 so we can start to see the real errors for the ugprade path. I expect the first thing will be to remove most of the current upgrade_tasks (like stop/disable systemd things) | 13:47 |
marios | chem: *master upgrade path i mean | 13:47 |
shardy | marios: to clarify, when you say remove, you mean not use in the container upgrade case? | 13:48 |
marios | shardy: not use in the container to container right yes | 13:48 |
therve | shardy, http://paste.openstack.org/show/628365/ ? | 13:48 |
shardy | as we discussed yesterday, we still may have some users needing to do BM->container upgrades for Queens | 13:48 |
shardy | e.g I know Tengu is expecting to do that | 13:48 |
marios | shardy: ack so it would be removal of the tasks in docker/services which are about stopping systemd things | 13:48 |
shardy | marios: ah, yeah makes sense, thanks for clarifying :) | 13:49 |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 13:49 |
shardy | therve: ah, yeah looks likely but I've deleted it now, will reproduce on my next debug iteration | 13:49 |
* shardy was trying to test a different thing before hitting this.. | 13:50 | |
marios | shardy: but do you mean BM Pike going to containers in Q. in which case they would still need the docker/services tasks for removing their systemd things | 13:50 |
marios | shardy: i.e. someone that is still on BM on their Pike deployment | 13:50 |
marios | shardy: in which case we can at least make sure they work in both cases with the appropriate conditionals | 13:50 |
shardy | marios: yeah, we have some users of upstream builds that may expect that | 13:50 |
*** jkilpatr has joined #tripleo | 13:50 | |
marios | shardy: i.e. do remove the systemd things if they are still things | 13:50 |
*** dsariel has joined #tripleo | 13:51 | |
shardy | marios: so we should make a decision about the status of support for baremetal for the Queens release, but make a best-effort to keep bm->container upgrade working until the deprecated bm stuff is removed | 13:51 |
shardy | marios: ack, yeah I thought we mostly already had conditionals and/or the tasks would be no-ops in the case where things are already disabled | 13:51 |
shardy | perhaps we could disable the validations by default | 13:51 |
shardy | as those I expect are the main things that will cause problems? | 13:52 |
shardy | e.g the is service enabled validation tasks | 13:52 |
marios | shardy: hmm so that is a different job then ... i mean having pike baremetal going to Q.. as you know for the P cycle our QE was focused on the containers case | 13:53 |
shardy | marios: I'm not saying it's something we necessarily have to keep in the CI test matrix, only that we should try to be sympathetic to the small subset of users it may impact, and make changes accordingly | 13:53 |
*** adarazs_brb is now known as adarazs | 13:53 | |
marios | shardy: i mean we would need a job that starts with non containerized stable/pike and upgrades it to containerized master/Q using the new workflow | 13:54 |
marios | shardy: ack this is useful thanks. chem we should add that one to the list :D | 13:54 |
marios | chem: we'll be done by christmas right | 13:54 |
marios | :( | 13:54 |
holser | marios - we should have both jobs | 13:56 |
marios | holser: yeah indeed | 13:56 |
marios | holser: i was mostly commenting on how bad our current ci coverage is for the upgrades | 13:56 |
marios | holser: and we are all looking into different things right now and it will be a lot to get it all running | 13:57 |
holser | marios: I am with you... you have my vote | 13:57 |
*** bfournie has joined #tripleo | 13:58 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: WIP: Add support for providing Octavia cert data https://review.openstack.org/526404 | 13:58 |
chem | marios: holser so yeah, we have o->p, p->master and this is a bug, we should have pike to ocata | 13:58 |
chem | marios: holser I can make the patch quickly enough ... | 13:59 |
holser | marios, I would say it's not CI problem... there should be periodic jobs that run all possible scenarios weekly | 13:59 |
*** ihrachys has joined #tripleo | 13:59 | |
holser | otherwise, if we run these scenarios on every patch we'll run out of HW soon | 13:59 |
*** shreshtha has quit IRC | 14:00 | |
marios | holser: ack and we are lucky that we can now run the upgrades jobs on rdo cloud since otherwise we would always timeout | 14:00 |
holser | nightly or weekly testing for all set of possible scenarios | 14:00 |
chem | I'm saying nonsense ... | 14:00 |
marios | chem: you lost me at " we should have pike to ocata" | 14:01 |
chem | marios:^ | 14:01 |
marios | chem: downgrades? :D | 14:01 |
*** links has quit IRC | 14:01 | |
chem | marios: oki, so nothing to do for current upgrade beside waiting that the workflow works somehow | 14:01 |
marios | holser: i.e. we couldn't even define 'proper' upgrades jobs, e.g. with the upgrade-non-controller.sh part for the Pike and earlier upgrades | 14:02 |
*** abhishekk has joined #tripleo | 14:02 | |
holser | :P | 14:02 |
marios | holser: we were runnign the upgrade | 14:02 |
marios | holser: but only the controller part for exmaple | 14:02 |
marios | chem: well i am also trying to run it on my rdo box | 14:03 |
marios | chem: which i should go and do instead of irc :D | 14:03 |
*** lblanchard has joined #tripleo | 14:03 | |
chem | marios: using traas I think I should be able to have the env as well ... going to do that | 14:04 |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Need to add openstack-selinux with OVS https://review.openstack.org/525608 | 14:04 |
chem | marios: anyway that's better than last cycle we have a review to look for | 14:04 |
marios | chem: careful you're starting to sound optimistic there | 14:05 |
*** milan has joined #tripleo | 14:05 | |
openstackgerrit | Merged openstack/tripleo-common master: Stop setting IRONIC_API_VERSION and OS_BAREMETAL_API_VERSION in overcloudrc https://review.openstack.org/522825 | 14:05 |
openstackgerrit | Merged openstack/tripleo-validations stable/pike: Validate library files for documentation string https://review.openstack.org/526085 | 14:05 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 14:10 |
milan | folks, I'd like to perform some clean-up steps in t-h-t for both a containerised and a regular service; I've managed to figure out how to do it for the container case https://review.openstack.org/#/c/523909/2/docker/services/ironic-inspector.yaml@224 but apparently I need to do it in both the cases | 14:11 |
milan | where do I do that? | 14:11 |
*** thrash is now known as thrash|biab | 14:12 | |
*** shreshtha has joined #tripleo | 14:13 | |
*** dbecker has joined #tripleo | 14:13 | |
shardy | milan: there's a puppet/services/ironic-inspector.yaml file, which you're already modifying in your patch | 14:14 |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 14:15 |
milan | do I just add upgrade_tasks in outputs.role_data.value? | 14:15 |
milan | shardy, ^ | 14:15 |
shardy | milan: you can probably move the upgrade_tasks there, and reference them in the docker template like config_settings | 14:15 |
*** jmelvin has joined #tripleo | 14:15 | |
*** dsariel has quit IRC | 14:15 | |
shardy | e.g like on line 65 | 14:15 |
milan | shardy, /me looks | 14:16 |
shardy | milan: yes, you can move the entire upgrade_tasks block to the puppet template I think, as I don't see one there already? | 14:16 |
milan | shardy, correct, there's none yet | 14:16 |
shardy | then reference the data from IronicInspectorBase in the docker/services file | 14:16 |
milan | shardy, thx, will do | 14:16 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: [WIP] Minor update testing for Pike on. https://review.openstack.org/526408 | 14:17 |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 14:17 |
*** suuuper has joined #tripleo | 14:18 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-quickstart master: [WIP] minor overcloud update testing. https://review.openstack.org/526409 | 14:19 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Enhance repo validation to check for unwanted enabled repos https://review.openstack.org/515412 | 14:21 |
*** dbecker has quit IRC | 14:22 | |
*** dprince has quit IRC | 14:25 | |
jistr | flaper87: that NM stuff is funny. I managed to get the origin-node started after using what you added to the patch, and DNS/traffic worked fine, but suddenly i couldn't ssh there from undercloud, and i've closed the previous session, so i've effectively locked myself out of the openshift bootstrap node again... next try i'll set the passwords for virsh console again | 14:25 |
*** shreshtha has quit IRC | 14:26 | |
*** Goneri has joined #tripleo | 14:26 | |
*** dbecker has joined #tripleo | 14:26 | |
flaper87 | jistr: oh, mmh, weird. Had the installation ended when you got locked out? | 14:26 |
flaper87 | jistr: did the script work just fine? | 14:27 |
flaper87 | it seems to work for me but wondering if you had to change something | 14:27 |
jistr | flaper87: the script seemed to do the right thing, though i had to execute it manually. And then i tried to re-run the installer, which didn't get far and that's how i discovered the lockout. | 14:27 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/ocata: Fix `when` statement in deployment image validation https://review.openstack.org/526412 | 14:27 |
flaper87 | jistr: mmh, it should run on every NM restart | 14:28 |
flaper87 | mmhh | 14:28 |
flaper87 | jistr: Ideally, we should move this script to openshift-ansible (or something similar) but till then, it should work | 14:28 |
flaper87 | :/ | 14:28 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split multinode playbook https://review.openstack.org/526414 | 14:28 |
openstackgerrit | Milan Kováčik proposed openstack/tripleo-heat-templates master: Enable inspector dnsmasq dhcp filter https://review.openstack.org/523909 | 14:29 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split ovb playbook https://review.openstack.org/525252 | 14:30 |
milan | hopefully my cargo-fu worked shardy dtantsur ^^ | 14:30 |
*** dpawar has quit IRC | 14:31 | |
*** dpawar has joined #tripleo | 14:31 | |
flaper87 | jistr: did you check why it didn't run automagically? | 14:32 |
flaper87 | jistr: if you check /var/log/messages you should see it there, somewhere | 14:33 |
flaper87 | oh, mmh, it doesn't have executable perms | 14:34 |
flaper87 | >.> | 14:34 |
jistr | flaper87: i'm trying again, and yes that's exactly what i noticed, i set it to 755 for this run :) | 14:34 |
flaper87 | silly me | 14:34 |
flaper87 | jistr: change the playbook, add 0744 instead of 0644 | 14:34 |
jistr | but i'm not 100% sure it's the cause, i didn't investigate / see any message that would point to it | 14:35 |
*** ramishra has joined #tripleo | 14:35 | |
jistr | flaper87: yea that's what i did | 14:35 |
flaper87 | jistr: it has to be 0744 | 14:35 |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: Deploy OpenShift using OOO on the overcloud https://review.openstack.org/494470 | 14:35 |
flaper87 | jistr: NM checks that no-one but root has write permissions on that script | 14:35 |
flaper87 | it has to be owned by root | 14:35 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Send ARA statistics to Graphite server https://review.openstack.org/479882 | 14:35 |
flaper87 | and, of course, executable | 14:35 |
flaper87 | jistr: ^ | 14:35 |
flaper87 | jistr: just updated the patch | 14:35 |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: [DO NOT MERGE] Just testing, nothing to see here https://review.openstack.org/521100 | 14:36 |
*** dpawar has quit IRC | 14:36 | |
*** pkovar has quit IRC | 14:37 | |
jistr | flaper87: ack ok. 0755 is still not writable by others... i saw how the other scripts there were and i thought it was 755 but i don't have the output anymore | 14:39 |
jistr | flaper87: anyway i'm deploying multimaster and had to add a variable, i'd push an update to the patch so that i don't have to keep stashing it locally if that's ok? | 14:40 |
flaper87 | jistr: I meant to say not-writable/executable but apparently it's just non-writable, which means 755 should be fine | 14:40 |
flaper87 | jistr: totes, feel free to push updates to the patch | 14:40 |
jistr | cool thx | 14:40 |
shardy | fultonj: Hey I think you had an issue yesterday with a missing undercloud install script w/oooq - I just hit the same | 14:44 |
shardy | looks like https://review.openstack.org/#/c/526334 may be the fix | 14:44 |
fultonj | shardy: thanks | 14:44 |
fultonj | shardy: https://bugs.launchpad.net/tripleo/+bug/1736859 | 14:45 |
openstack | Launchpad bug 1736859 in tripleo "[oooq] undercloud-install.sh: No such file or directory" [Medium,In progress] - Assigned to Sanjay Upadhyay (saneax) | 14:45 |
fultonj | i filed ^ | 14:45 |
fultonj | and then workaround there fixed (-t all) | 14:45 |
shardy | fultonj: ah, thanks, hadn't yet checked the bug :) | 14:45 |
fultonj | shardy: looks like that's the fix though | 14:45 |
fultonj | thanks | 14:45 |
shardy | fultonj: cool, re-testing it now & will +2 after | 14:46 |
*** jmelvin has quit IRC | 14:48 | |
*** BryanS68 has quit IRC | 14:48 | |
*** aufi has quit IRC | 14:48 | |
*** kbyrne has quit IRC | 14:48 | |
*** dhill_ has quit IRC | 14:48 | |
*** openstackgerrit has quit IRC | 14:48 | |
*** sai has quit IRC | 14:48 | |
*** sshnaidm|rover has quit IRC | 14:48 | |
*** lyarwood has quit IRC | 14:48 | |
*** mburned has quit IRC | 14:48 | |
*** timothyb89 has quit IRC | 14:48 | |
*** lifeless has quit IRC | 14:48 | |
*** leifmadsen has quit IRC | 14:48 | |
*** afazekas has quit IRC | 14:48 | |
*** sc has quit IRC | 14:48 | |
*** gkadam has quit IRC | 14:48 | |
*** jtomasek has quit IRC | 14:48 | |
*** alee has quit IRC | 14:48 | |
*** verdurin has quit IRC | 14:48 | |
*** tvignaud has quit IRC | 14:48 | |
*** dciabrin has quit IRC | 14:48 | |
*** mmethot has quit IRC | 14:48 | |
*** rasca has quit IRC | 14:48 | |
*** chandankumar has quit IRC | 14:48 | |
*** mwhahaha has quit IRC | 14:48 | |
*** fungi has quit IRC | 14:48 | |
*** portdirect has quit IRC | 14:48 | |
*** v1k0d3n has quit IRC | 14:48 | |
*** mrch has quit IRC | 14:48 | |
*** ChanServ has quit IRC | 14:48 | |
*** pchavva has quit IRC | 14:48 | |
*** raildo has quit IRC | 14:48 | |
*** akrivoka has quit IRC | 14:48 | |
*** florianf has quit IRC | 14:48 | |
*** dsneddon has quit IRC | 14:48 | |
*** rdopiera has quit IRC | 14:48 | |
*** StevenK has quit IRC | 14:48 | |
*** slagle has quit IRC | 14:48 | |
*** dalvarez has quit IRC | 14:48 | |
*** eck` has quit IRC | 14:48 | |
*** therve has quit IRC | 14:48 | |
*** lblanchard has quit IRC | 14:48 | |
*** tzumainn has quit IRC | 14:48 | |
*** salmankhan has quit IRC | 14:48 | |
*** moshele has quit IRC | 14:48 | |
*** safchain has quit IRC | 14:48 | |
*** Vijayendra has quit IRC | 14:48 | |
*** SlickNik has quit IRC | 14:48 | |
*** stevebaker has quit IRC | 14:48 | |
*** mfedosin has quit IRC | 14:48 | |
*** japestinho has quit IRC | 14:48 | |
*** larsks has quit IRC | 14:48 | |
*** panda has quit IRC | 14:48 | |
*** akrzos has quit IRC | 14:48 | |
*** vpickard_ has quit IRC | 14:48 | |
*** sdoran has quit IRC | 14:48 | |
*** jpena has quit IRC | 14:48 | |
*** rhallisey has quit IRC | 14:48 | |
*** leitan has quit IRC | 14:48 | |
*** sri_ has quit IRC | 14:48 | |
*** paramite has quit IRC | 14:48 | |
*** zshi has quit IRC | 14:48 | |
*** nguyentrihai has quit IRC | 14:48 | |
*** jrist has quit IRC | 14:48 | |
*** dtrainor has quit IRC | 14:48 | |
*** ianw has quit IRC | 14:48 | |
*** adarazs has quit IRC | 14:48 | |
*** suuuper has quit IRC | 14:48 | |
*** brault_ has quit IRC | 14:48 | |
*** jlabarre has quit IRC | 14:48 | |
*** ansmith has quit IRC | 14:48 | |
*** marios has quit IRC | 14:48 | |
*** daidv has quit IRC | 14:48 | |
*** holser has quit IRC | 14:48 | |
*** radeks has quit IRC | 14:48 | |
*** mandre has quit IRC | 14:48 | |
*** rfolco has quit IRC | 14:48 | |
*** hamzy has quit IRC | 14:48 | |
*** mgkwill_ has quit IRC | 14:48 | |
*** tbarron has quit IRC | 14:48 | |
*** oanson has quit IRC | 14:48 | |
*** dmacpher has quit IRC | 14:48 | |
*** tristanC has quit IRC | 14:48 | |
*** matbu has quit IRC | 14:48 | |
*** trown has quit IRC | 14:48 | |
*** jbadiapa has quit IRC | 14:48 | |
*** Slower has quit IRC | 14:48 | |
*** michchap has quit IRC | 14:48 | |
*** tdasilva has quit IRC | 14:48 | |
*** Ng has quit IRC | 14:48 | |
*** mugsie has quit IRC | 14:48 | |
*** vkmc has quit IRC | 14:48 | |
*** melwitt has quit IRC | 14:48 | |
*** dmanchad has quit IRC | 14:48 | |
*** jkilpatr has quit IRC | 14:48 | |
*** yprokule has quit IRC | 14:48 | |
*** abishop has quit IRC | 14:48 | |
*** milan has quit IRC | 14:48 | |
*** ffiore has quit IRC | 14:48 | |
*** jaosorior has quit IRC | 14:48 | |
*** myoung|ruck has quit IRC | 14:48 | |
*** toure has quit IRC | 14:48 | |
*** sileht has quit IRC | 14:48 | |
*** stee_3 has quit IRC | 14:48 | |
*** bcafarel has quit IRC | 14:48 | |
*** lennyb has quit IRC | 14:48 | |
*** janki has quit IRC | 14:48 | |
*** oidgar___ has quit IRC | 14:48 | |
*** gfidente has quit IRC | 14:48 | |
*** iranzo has quit IRC | 14:48 | |
*** bogdando has quit IRC | 14:48 | |
*** numans has quit IRC | 14:48 | |
*** colonwq has quit IRC | 14:48 | |
*** EmilienM has quit IRC | 14:48 | |
*** migi has quit IRC | 14:48 | |
*** tonyb has quit IRC | 14:48 | |
*** markmc has quit IRC | 14:48 | |
*** remix_tj has quit IRC | 14:48 | |
*** thrash|biab has quit IRC | 14:48 | |
*** cschwede has quit IRC | 14:48 | |
*** ansiwen has quit IRC | 14:48 | |
*** lhinds has quit IRC | 14:48 | |
*** pabelanger has quit IRC | 14:48 | |
*** beagles has quit IRC | 14:48 | |
*** mathiasb has quit IRC | 14:48 | |
*** mmethot has joined #tripleo | 14:49 | |
*** dciabrin has joined #tripleo | 14:50 | |
*** sdoran has joined #tripleo | 14:53 | |
*** alee has joined #tripleo | 14:54 | |
*** verdurin has joined #tripleo | 14:54 | |
*** tvignaud has joined #tripleo | 14:54 | |
*** rasca has joined #tripleo | 14:54 | |
*** chandankumar has joined #tripleo | 14:54 | |
*** mwhahaha has joined #tripleo | 14:54 | |
*** fungi has joined #tripleo | 14:54 | |
*** portdirect has joined #tripleo | 14:54 | |
*** v1k0d3n has joined #tripleo | 14:54 | |
*** barjavel.freenode.net sets mode: +ov mwhahaha mwhahaha | 14:54 | |
*** pchavva has joined #tripleo | 14:54 | |
*** raildo has joined #tripleo | 14:54 | |
*** akrivoka has joined #tripleo | 14:54 | |
*** florianf has joined #tripleo | 14:54 | |
*** dsneddon has joined #tripleo | 14:54 | |
*** rdopiera has joined #tripleo | 14:54 | |
*** StevenK has joined #tripleo | 14:54 | |
*** slagle has joined #tripleo | 14:54 | |
*** eck` has joined #tripleo | 14:54 | |
*** dalvarez has joined #tripleo | 14:54 | |
*** therve has joined #tripleo | 14:54 | |
*** d0ugal has quit IRC | 14:54 | |
*** sc has joined #tripleo | 14:54 | |
*** afazekas has joined #tripleo | 14:54 | |
*** leifmadsen has joined #tripleo | 14:54 | |
*** lifeless has joined #tripleo | 14:54 | |
*** timothyb89 has joined #tripleo | 14:54 | |
*** mburned has joined #tripleo | 14:54 | |
*** lyarwood has joined #tripleo | 14:54 | |
*** sshnaidm|rover has joined #tripleo | 14:54 | |
*** sai has joined #tripleo | 14:54 | |
*** openstackgerrit has joined #tripleo | 14:54 | |
*** dhill_ has joined #tripleo | 14:54 | |
*** BryanS68 has joined #tripleo | 14:54 | |
*** suuuper has joined #tripleo | 14:54 | |
*** milan has joined #tripleo | 14:54 | |
*** lblanchard has joined #tripleo | 14:54 | |
*** jkilpatr has joined #tripleo | 14:54 | |
*** brault_ has joined #tripleo | 14:54 | |
*** janki has joined #tripleo | 14:54 | |
*** oidgar___ has joined #tripleo | 14:54 | |
*** tzumainn has joined #tripleo | 14:54 | |
*** jlabarre has joined #tripleo | 14:54 | |
*** ansmith has joined #tripleo | 14:54 | |
*** yprokule has joined #tripleo | 14:54 | |
*** rhallisey has joined #tripleo | 14:54 | |
*** salmankhan has joined #tripleo | 14:54 | |
*** marios has joined #tripleo | 14:54 | |
*** abishop has joined #tripleo | 14:54 | |
*** mathiasb has joined #tripleo | 14:54 | |
*** daidv has joined #tripleo | 14:54 | |
*** ffiore has joined #tripleo | 14:54 | |
*** sri_ has joined #tripleo | 14:54 | |
*** paramite has joined #tripleo | 14:54 | |
*** moshele has joined #tripleo | 14:54 | |
*** gfidente has joined #tripleo | 14:54 | |
*** iranzo has joined #tripleo | 14:54 | |
*** bogdando has joined #tripleo | 14:54 | |
*** holser has joined #tripleo | 14:54 | |
*** radeks has joined #tripleo | 14:54 | |
*** mandre has joined #tripleo | 14:54 | |
*** numans has joined #tripleo | 14:54 | |
*** jaosorior has joined #tripleo | 14:54 | |
*** zshi has joined #tripleo | 14:54 | |
*** rfolco has joined #tripleo | 14:54 | |
*** safchain has joined #tripleo | 14:54 | |
*** hamzy has joined #tripleo | 14:54 | |
*** nguyentrihai has joined #tripleo | 14:54 | |
*** Vijayendra has joined #tripleo | 14:54 | |
*** mgkwill_ has joined #tripleo | 14:54 | |
*** tbarron has joined #tripleo | 14:54 | |
*** oanson has joined #tripleo | 14:54 | |
*** dmacpher has joined #tripleo | 14:54 | |
*** tristanC has joined #tripleo | 14:54 | |
*** jrist has joined #tripleo | 14:54 | |
*** SlickNik has joined #tripleo | 14:54 | |
*** matbu has joined #tripleo | 14:54 | |
*** colonwq has joined #tripleo | 14:54 | |
*** dtrainor has joined #tripleo | 14:54 | |
*** myoung|ruck has joined #tripleo | 14:54 | |
*** trown has joined #tripleo | 14:54 | |
*** jbadiapa has joined #tripleo | 14:54 | |
*** ianw has joined #tripleo | 14:54 | |
*** beagles has joined #tripleo | 14:54 | |
*** adarazs has joined #tripleo | 14:54 | |
*** EmilienM has joined #tripleo | 14:54 | |
*** stevebaker has joined #tripleo | 14:54 | |
*** migi has joined #tripleo | 14:54 | |
*** mfedosin has joined #tripleo | 14:54 | |
*** toure has joined #tripleo | 14:54 | |
*** Slower has joined #tripleo | 14:54 | |
*** japestinho has joined #tripleo | 14:54 | |
*** pabelanger has joined #tripleo | 14:54 | |
*** michchap has joined #tripleo | 14:54 | |
*** larsks has joined #tripleo | 14:54 | |
*** lennyb has joined #tripleo | 14:54 | |
*** sileht has joined #tripleo | 14:54 | |
*** tonyb has joined #tripleo | 14:54 | |
*** panda has joined #tripleo | 14:54 | |
*** akrzos has joined #tripleo | 14:54 | |
*** tdasilva has joined #tripleo | 14:54 | |
*** stee_3 has joined #tripleo | 14:54 | |
*** vpickard_ has joined #tripleo | 14:54 | |
*** jpena has joined #tripleo | 14:54 | |
*** bcafarel has joined #tripleo | 14:54 | |
*** markmc has joined #tripleo | 14:54 | |
*** thrash|biab has joined #tripleo | 14:54 | |
*** cschwede has joined #tripleo | 14:54 | |
*** Ng has joined #tripleo | 14:54 | |
*** mugsie has joined #tripleo | 14:54 | |
*** vkmc has joined #tripleo | 14:54 | |
*** ansiwen has joined #tripleo | 14:54 | |
*** lhinds has joined #tripleo | 14:54 | |
*** melwitt has joined #tripleo | 14:54 | |
*** dmanchad has joined #tripleo | 14:54 | |
*** barjavel.freenode.net sets mode: +vv EmilienM Ng | 14:54 | |
*** tzumainn has quit IRC | 14:55 | |
*** sdoran has quit IRC | 14:55 | |
*** sdoran has joined #tripleo | 14:55 | |
*** vpickard_ is now known as vpickard | 14:55 | |
*** d0ugal has joined #tripleo | 14:55 | |
*** tzumainn has joined #tripleo | 14:55 | |
*** oidgar___ has quit IRC | 14:55 | |
*** jkilpatr has quit IRC | 14:55 | |
*** tzumainn has quit IRC | 14:55 | |
*** tzumainn has joined #tripleo | 14:56 | |
*** jkilpatr has joined #tripleo | 14:56 | |
*** leseb has quit IRC | 14:56 | |
*** pkovar has joined #tripleo | 14:56 | |
*** florianf is now known as florianf|afk | 14:56 | |
*** yamahata has joined #tripleo | 14:58 | |
*** leseb has joined #tripleo | 14:59 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 14:59 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 15:00 |
*** abhishekk has quit IRC | 15:00 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 15:01 |
*** artom has quit IRC | 15:02 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 15:02 |
*** zaneb has quit IRC | 15:04 | |
*** aufi has joined #tripleo | 15:05 | |
*** zaneb has joined #tripleo | 15:05 | |
*** dsariel has joined #tripleo | 15:06 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Send graphite stats from ARA https://review.openstack.org/480121 | 15:08 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Make CephPools override properties of other pools https://review.openstack.org/525213 | 15:08 |
openstackgerrit | Merged openstack/puppet-tripleo master: Add support for OVN Metadata Agent https://review.openstack.org/502940 | 15:08 |
*** jmelvin has joined #tripleo | 15:09 | |
*** chlong has joined #tripleo | 15:10 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,Triaged] | 15:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 15:10 |
*** s_b_34343 has quit IRC | 15:11 | |
*** dbecker has quit IRC | 15:15 | |
*** ramishra has quit IRC | 15:15 | |
jaosorior | mandre: soo... should we merge the barbican or would you prefer that line to be removed first? | 15:15 |
*** ChanServ has joined #tripleo | 15:16 | |
*** barjavel.freenode.net sets mode: +o ChanServ | 15:16 | |
*** myoung|ruck is now known as myoung|rover | 15:16 | |
jaosorior | mwhahaha: around? | 15:16 |
* mwhahaha hides | 15:16 | |
jaosorior | lol | 15:17 |
mwhahaha | sup? | 15:17 |
*** ramishra has joined #tripleo | 15:17 | |
jaosorior | mwhahaha: hey, so, I'm working on the tripleo-ipsec packaging. And now we gotta figure out how will that be included in the undercloud... Was thinking I could just add it as a dependency for tripleo-common. That way we could make sure it's there. | 15:17 |
*** dprince has joined #tripleo | 15:17 | |
*** jbadiapa has quit IRC | 15:17 | |
mwhahaha | ehhh | 15:18 |
*** moshele has quit IRC | 15:18 | |
jaosorior | open to suggestions though | 15:18 |
mwhahaha | so the tripleo-ipsec is ansible roles right? | 15:19 |
*** dhill_ has quit IRC | 15:19 | |
jaosorior | yes | 15:19 |
jaosorior | it's just one ansible role. | 15:19 |
mwhahaha | let me see what the tripleo-commond dependencies look like | 15:20 |
dmsimard | mwhahaha, EmilienM, weshay: fyi sshnaidm|rover pinged infra about rh1 connection errors when installing packages, it's addressed now so please let us know if you see any new errors from now on. We'll need to plan a maintenance to increase the disk size of the VM hosting the mirror. | 15:20 |
*** d0ugal is now known as Guest27460 | 15:20 | |
*** kbyrne has joined #tripleo | 15:20 | |
*** shreshtha has joined #tripleo | 15:20 | |
*** janki has quit IRC | 15:21 | |
*** gbarros has joined #tripleo | 15:21 | |
mwhahaha | jaosorior: so at the moment i think instack-undercloud is the correct place to add that dep right now. that being said i guess tripleo-common would work as we have a dep on ansible there | 15:21 |
mwhahaha | https://github.com/rdo-packages/tripleo-common-distgit/blob/rpm-master/openstack-tripleo-common.spec#L44 | 15:22 |
mwhahaha | jaosorior: so maybe it's a larger question of how we want to push ansible roles in general | 15:22 |
jaosorior | mwhahaha: right, that's why I mentioned tripleo-common | 15:22 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 15:23 |
*** Guest27460 has quit IRC | 15:23 | |
*** itlinux has joined #tripleo | 15:23 | |
*** d0ugal has joined #tripleo | 15:23 | |
*** d0ugal has quit IRC | 15:23 | |
*** d0ugal has joined #tripleo | 15:23 | |
shardy | jaosorior: if you want your deploy_steps_tasks to work with the "classic" deploy method, e.g not config download (still the default so it works with the UI), it'll need to be in the overcloud-full image, not only on the undercloud I think? | 15:24 |
shardy | I need to push a t-h-t patch to make that work, but I guess tripleo-common may be better from that perspective? | 15:24 |
openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 15:25 |
*** links has joined #tripleo | 15:25 | |
jaosorior | shardy: not looking for it to work with the classic deploy | 15:25 |
jaosorior | shardy: having it be exclusive for the config-download method is fine for me. | 15:25 |
shardy | jaosorior: Ok, so it's fine if it won't work via tripleo-ui | 15:25 |
openstackgerrit | Gonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: configure-vbmc: get user id from ansible_user_id https://review.openstack.org/526431 | 15:25 |
*** dhill_ has joined #tripleo | 15:25 | |
jaosorior | shardy: either way, it wouldn't work well with the classic download, since we do need the inventory to have all the nodes there. | 15:25 |
jaosorior | and the classic download uses "localhost" on each node, IIRC | 15:25 |
EmilienM | dmsimard: ack, thx | 15:26 |
shardy | jaosorior: yeah we run ansible on each node via localhost | 15:26 |
shardy | jaosorior: Ok cool, just wanted to check as the not working with the UI was a bigger issue e.g for the octavia integration which has some similar interface requirements | 15:26 |
jaosorior | shardy: so that's problematic for the role. | 15:26 |
weshay | dmsimard++ | 15:28 |
weshay | thanks | 15:28 |
*** tzumainn has quit IRC | 15:29 | |
mwhahaha | jaosorior: actually is THT going to be the thing that leverages it? | 15:29 |
*** tzumainn has joined #tripleo | 15:29 | |
jaosorior | shardy, mwhahaha: So, seems that the best option so far is tripleo-common. | 15:29 |
jaosorior | mwhahaha: yes. | 15:29 |
mwhahaha | jaosorior: then it should be a dep of THT | 15:29 |
jaosorior | mwhahaha: that works for me too. | 15:29 |
shardy | mwhahaha: well in the --config-download case, tripleo-common contains the workflow to run ansible via t-h-t | 15:30 |
shardy | but yeah maybe the dep should be t-h-t | 15:30 |
jaosorior | ack | 15:30 |
jaosorior | actually, t-h-t does make sense, since it's what ends up calling it anyway | 15:30 |
*** jbadiapa has joined #tripleo | 15:31 | |
*** ramishra has quit IRC | 15:31 | |
jaosorior | mwhahaha, shardy: thanks | 15:32 |
mandre | EmilienM: do we have a magic way to generate HeatAuthEncryptionKey in https://review.openstack.org/#/c/526151/? | 15:33 |
*** ramishra has joined #tripleo | 15:34 | |
*** yamahata has quit IRC | 15:35 | |
shardy | mandre, EmilienM: added a comment as I'm unclear how that works on upgrade | 15:36 |
shardy | it's essential that we don't change those values on upgrade, particularly the encryption key as there's no way to recover if the old value is lost | 15:36 |
shardy | so I think for generating them to be useful, we need a workflow to extract the existing values from the heat stack | 15:37 |
shardy | then, in a future release, we can potentially remove the heat resources | 15:37 |
d0ugal | jaosorior: hey | 15:39 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for providing Octavia cert data https://review.openstack.org/526404 | 15:39 |
*** itlinux has quit IRC | 15:41 | |
mandre | shardy: isn't that case covered by https://review.openstack.org/#/c/526151/2/tripleo_common/utils/passwords.py@50? | 15:42 |
shardy | mandre: No, because the value is generated by a resource in the stack | 15:43 |
shardy | so it's not in parameter_defaults | 15:43 |
mandre | oh ok | 15:43 |
shardy | we need to do a resource list and get the value from the stack directly | 15:43 |
shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L727 | 15:44 |
openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Add incoming storage driver param https://review.openstack.org/524240 | 15:44 |
shardy | mandre: probably doing a resource show on the DefaultPasswords resource is the easiest way | 15:44 |
EmilienM | mandre, shardy: yeah I was worried about upgrades | 15:45 |
slagle | jistr: have you seen any issues with running the enable-ssh-admin.sh script with ovb? i've been trying to get https://review.openstack.org/#/c/525331/ to pass | 15:45 |
EmilienM | shardy: the resource will not be generated if it's already in the generated-password file, isn't? | 15:45 |
*** sshnaidm|rover is now known as sshnaidm|ruck | 15:46 | |
slagle | jistr: but ssh just hangs when running that script. i've added -vvv to the ssh command from the script, but it's not really showing what's wrong. http://logs.openstack.org/31/525331/5/check-tripleo/tripleo-ci-centos-7-ovb-ha-oooq/f705a93/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 15:46 |
shardy | EmilienM: No it's always created here https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L304 | 15:47 |
shardy | EmilienM: so I think passing a parameter will override the RandomString value | 15:47 |
EmilienM | shardy: oh I see now why we need to extract the previous one | 15:47 |
shardy | unless I'm missing something, that will be very bad for upgrades | 15:47 |
jistr | slagle: yea i hit it yesterday locally, most likely it's waiting for ack on ssh fingerprint | 15:47 |
EmilienM | shardy: we need to block it | 15:47 |
*** aufi has quit IRC | 15:48 | |
jistr | slagle: we either need to disable strict key checking, or ssh-keyscan | 15:48 |
openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 15:48 |
slagle | jistr: yea, good point. seems likely | 15:48 |
slagle | i'll try in my test patch | 15:48 |
jistr | slagle: ack, thanks | 15:49 |
*** abregman is now known as abregman|mtg | 15:49 | |
*** itlinux has joined #tripleo | 15:49 | |
*** ramishra has quit IRC | 15:50 | |
*** alee has quit IRC | 15:50 | |
*** dparkes has joined #tripleo | 15:51 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: DO NOT MERGE - test https://review.openstack.org/526131 | 15:51 |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download https://review.openstack.org/525331 | 15:51 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Undercloud deploy: use docker-uc.yaml https://review.openstack.org/526337 | 15:52 |
*** salmankhan has quit IRC | 15:54 | |
*** itlinux has quit IRC | 15:54 | |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Configure temporary URLs for Ironic Ansible deploy method https://review.openstack.org/526439 | 15:55 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker. https://review.openstack.org/526440 | 15:56 |
*** dpawar has joined #tripleo | 15:56 | |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data https://review.openstack.org/508567 | 15:56 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow https://review.openstack.org/509419 | 15:56 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow https://review.openstack.org/513463 | 15:56 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds Workflow to List Available Roles https://review.openstack.org/509832 | 15:56 |
openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Adds UpdateRoles Workflow https://review.openstack.org/515045 | 15:56 |
*** links has quit IRC | 15:59 | |
*** suuuper has quit IRC | 15:59 | |
*** itlinux has joined #tripleo | 15:59 | |
openstackgerrit | Gonéri Le Bouder proposed openstack/tripleo-quickstart-extras master: configure-vbmc: get user id from ansible_user_id https://review.openstack.org/526431 | 16:01 |
*** tosky has quit IRC | 16:03 | |
*** itlinux has quit IRC | 16:04 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Deploy OpenShift using OOO on the overcloud https://review.openstack.org/494470 | 16:04 |
jistr | flaper87: posted another tweak ^ | 16:05 |
*** rhallisey has quit IRC | 16:06 | |
flaper87 | jistr: danke, will get it while it is hot (and before zuul -1's it... or not) | 16:06 |
*** salmankhan has joined #tripleo | 16:06 | |
* jistr retrying on latest now | 16:06 | |
*** itlinux has joined #tripleo | 16:06 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test ci https://review.openstack.org/526443 | 16:08 |
*** jmelvin_ has joined #tripleo | 16:08 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: WIP Testing using ansible-playbook in place of quickstart.sh https://review.openstack.org/524320 | 16:08 |
*** pkovar has quit IRC | 16:09 | |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Need to add openstack-selinux with OVS https://review.openstack.org/525608 | 16:09 |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,Triaged] | 16:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 16:10 |
*** tosky has joined #tripleo | 16:10 | |
*** jmelvin has quit IRC | 16:10 | |
flaper87 | jistr: check whether it's setting the right permissions on the file for you | 16:12 |
flaper87 | it didn't seem to work for me :/ | 16:12 |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 16:13 |
*** dpawar has quit IRC | 16:15 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] split multinode playbook https://review.openstack.org/526414 | 16:16 |
*** fzdarsky has joined #tripleo | 16:20 | |
jistr | i'll know in a few mins... | 16:22 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Add major update implementation https://review.openstack.org/526213 | 16:23 |
jistr | flaper87: yea the latest state got me 755 permissions on the file | 16:24 |
*** paramite has quit IRC | 16:25 | |
*** oidgar has joined #tripleo | 16:25 | |
jistr | flaper87: just a guess -- if you apply the change locally without stack-update and config download, you need to edit external_deploy_steps_tasks.yaml, not openshift playbook.yaml. The playbook.yaml gets overwritten each time the deployment is executed. I got burned by this earlier. | 16:26 |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Configure temporary URLs for Ironic Ansible deploy method https://review.openstack.org/526439 | 16:26 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Collect unbound ttl config file https://review.openstack.org/526447 | 16:27 |
sshnaidm|ruck | dmsimard, ^^ | 16:27 |
oidgar | mwhahaha: hi Alex, we've updated our ansible code and split the role task files. can take a quick look on that and tell if you have some comments for now? | 16:27 |
sshnaidm|ruck | dmsimard, let's collect it and we'll see | 16:27 |
mwhahaha | oidgar: yea | 16:27 |
dmsimard | sshnaidm|ruck: it's already collected... like all of /etc is collected | 16:27 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-common master: WIP ffu: Introduce Fast Forward Upgrade workbook https://review.openstack.org/519317 | 16:27 |
dmsimard | sshnaidm|ruck: see the eavesdrop | 16:27 |
sshnaidm|ruck | dmsimard, nope, we don't collect all /etc | 16:27 |
flaper87 | jistr: nah, I ahd destroyed the overcloud | 16:28 |
flaper87 | jistr: *shrugs* | 16:28 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add missing steps from tripleo-ci ovb playbook https://review.openstack.org/526451 | 16:28 |
dmsimard | sshnaidm|ruck: oh, hrm | 16:28 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/python-tripleoclient master: WIP ffu: Introduce Fast Forward Upgrade command and workflow https://review.openstack.org/519316 | 16:28 |
flaper87 | jistr: it seems to be moving forward | 16:28 |
dmsimard | ok. | 16:28 |
sshnaidm|ruck | dmsimard, that's why I HATE whitelists | 16:28 |
dmsimard | sshnaidm|ruck: I'm totally fine with whitelists :D | 16:28 |
flaper87 | jistr: btw, it's a public holiday here tomorrow. I wanted to move the NM bits (install and enable) to oooq. Would you like to help with that? OTherwise I'll do it on monday | 16:29 |
*** marios has quit IRC | 16:29 | |
*** ukalifon has quit IRC | 16:30 | |
*** dparkes has quit IRC | 16:30 | |
mwhahaha | oidgar: so the structure looks better but I still had questions about composable services as this implementation seems to make assumptions about where the services actually run | 16:30 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB https://review.openstack.org/513508 | 16:31 |
*** fzdarsky has quit IRC | 16:31 | |
jistr | flaper87: sure i can help with that. Thinking out loud -- normally something like this would go into the base image, but since this is specific to openshift which is not yet our production way of deploying, we probably want to hold off on image changes. Is there a direct benefit of moving it out of the openshift service though? | 16:32 |
openstackgerrit | Julie Pichon proposed openstack/tripleo-ui master: Reenable the undercloud jobs https://review.openstack.org/526430 | 16:33 |
*** dmsimard is now known as dmsimard|afk | 16:34 | |
*** dsariel has quit IRC | 16:38 | |
*** shreshtha has quit IRC | 16:38 | |
mwhahaha | sdoran: is there a module to manage ifcfg files in ansible that isn't nmcli? | 16:39 |
*** alee has joined #tripleo | 16:39 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 16:39 |
*** ccamacho has quit IRC | 16:39 | |
*** cshastri has joined #tripleo | 16:39 | |
sdoran | mwhahaha: `template` | 16:40 |
mwhahaha | meh | 16:41 |
jistr | flaper87: so far i can see that 99-os-net-config-origin-dns.sh ran before 99-origin-dns.sh existed (so it failed), but if it's going to re-run again later it may still be fine | 16:42 |
*** bogdando has quit IRC | 16:43 | |
* jistr 's deployment still in progress | 16:43 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Creating a function that calls /usr/bin/timeout https://review.openstack.org/525594 | 16:43 |
sdoran | mwhahaha: Looks like there is actually an `interfaces_files` module | 16:44 |
oidgar | mwhahaha: actually the controller name is misleading as we pass the nodes that octavia lives inside from mistral so it is dynamic. it can be the controller nodes or the network nodes for example. we will change the name of it. | 16:44 |
sdoran | Much more better | 16:44 |
*** isq_ has joined #tripleo | 16:44 | |
mwhahaha | sdoran: yea but lacks options of the actual files, like you can't set types and stuff. oh well | 16:44 |
mwhahaha | sdoran: was hoping for something other than template/manual ifups | 16:45 |
mwhahaha | oidgar: ok perhaps we shouldn't use 'controller' then cause it's misleading | 16:45 |
sdoran | Does the module just need to be extended to add more options? | 16:45 |
oidgar | mwhahaha: sure. will fix it right away | 16:46 |
EmilienM | Slower: https://review.openstack.org/#/c/526151/ is stuck until we find a path for upgrades | 16:46 |
mwhahaha | sdoran: well we don't use network manager so nmcli wouldn't be correct for us to leverage right now. but the options from nmcli are valid for ifcfg files themselves. not completely sure | 16:46 |
*** yamahata__ has quit IRC | 16:46 | |
mwhahaha | sdoran: i'm reviewing https://review.openstack.org/#/c/487450 for context | 16:47 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Fast Forward Upgrade tasks and playbooks https://review.openstack.org/499221 | 16:47 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: tripleo-packages repo management https://review.openstack.org/515429 | 16:47 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce keystone fast-forward upgrade tasks https://review.openstack.org/514621 | 16:48 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: DNM ffu: Workaround missing repo control when moving to Queens https://review.openstack.org/518719 | 16:48 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: DNM: ffu: Remove yum update from upgrade_tasks https://review.openstack.org/520559 | 16:48 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP ffu: Add param_defaults for FFU https://review.openstack.org/522548 | 16:49 |
shardy | dsneddon: Hey when you get time could you please review https://review.openstack.org/#/c/521493/ (first pass at composable networks documentation), thanks! | 16:49 |
dsneddon | shardy, Yes, I have an unfinished review in progress, I'll wrap it up and publish the comments. | 16:49 |
weshay | Slower, yo yo.. need anything? | 16:50 |
shardy | dsneddon: thanks! | 16:50 |
*** itlinux has quit IRC | 16:50 | |
*** fzdarsky has joined #tripleo | 16:51 | |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Correct a task name in create_swift_rings_backup_container_plan https://review.openstack.org/526357 | 16:51 |
flaper87 | jistr: it re-runs again, NM is restarted multiple times throughout the deployment | 16:51 |
*** moshele has joined #tripleo | 16:51 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: scenrio002-container: ignore telemetry & barbican tests https://review.openstack.org/526459 | 16:51 |
flaper87 | jistr: overcloud-controller-0 : ok=809 changed=105 unreachable=0 failed=0 | 16:51 |
flaper87 | jistr: it worked for me, single node | 16:52 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests https://review.openstack.org/526459 | 16:52 |
flaper87 | jistr: but I don't seem to have access to the VM | 16:52 |
flaper87 | nice | 16:52 |
flaper87 | >.> | 16:52 |
d0ugal | shardy, jpich: I added a bug ref for backporting: https://review.openstack.org/#/c/526357/ - I am going to look into shardy's comment in a follow up. | 16:52 |
*** itlinux has joined #tripleo | 16:53 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests https://review.openstack.org/526459 | 16:53 |
shardy | d0ugal: sounds good, thanks! | 16:53 |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 16:54 |
EmilienM | easy review: https://review.openstack.org/#/c/526152/ | 16:54 |
*** fragatina has joined #tripleo | 16:54 | |
jpich | d0ugal: Cool, thanks! Yeah that sounds like a separate bug | 16:54 |
EmilienM | weshay: should we review https://review.openstack.org/#/q/topic:fs035+status:open or not? if we're moving to RDO CI 100% | 16:54 |
jistr | flaper87: yup same here re losing network access, though my openshift-ansible run didn't go to the end yet. It got stuck on "restart openvswitch" handler again. | 16:55 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Add major update implementation https://review.openstack.org/526213 | 16:55 |
weshay | bah.. thanks for the reminder | 16:55 |
sdoran | mwhahaha: That modules looks pretty flexible, actually. It has an `option` parameter that can take anything. So you should be able to set any option. | 16:55 |
mwhahaha | sdoran: hmm ok i'll have to test it out later | 16:56 |
jistr | flaper87: what about the NM install + OOOQ? We could do it but presently i don't see a benefit... | 16:56 |
sdoran | Only trick thing would be `value` since that looks like it only accepts strings. Would have to do some work to make it take lists and format that properly in the generated file. | 16:56 |
EmilienM | chem, sshnaidm|ruck, adarazs: wdyt about removing gate-tripleo-ci-centos-7-containers-multinode-upgrades-master from openstack-check pipeline in RDO CI and have it experimental only. | 16:56 |
*** fragatina has quit IRC | 16:56 | |
EmilienM | chem, sshnaidm|ruck, adarazs : AFIK the job doesn't pass and nobody checks it now | 16:56 |
EmilienM | it's a waste of resources imho | 16:56 |
weshay | trown, panda easy review https://review.openstack.org/#/c/525747/ | 16:56 |
*** fragatina has joined #tripleo | 16:57 | |
*** nyechiel has quit IRC | 16:57 | |
*** ffiore has quit IRC | 16:57 | |
alee | mwhahaha, EmilienM -- https://review.openstack.org/#/c/523538/ please when yo get a chance | 16:57 |
*** yamahata has joined #tripleo | 16:57 | |
chem | EmilienM: we're checking it but we're implementing a new workflow so it's broken | 16:57 |
chem | EmilienM: give me a sec | 16:58 |
chem | EmilienM: this review implement the new workflow with the rigth depends-on https://review.openstack.org/#/c/526006/ | 16:58 |
EmilienM | alee: ok I'll review them | 16:59 |
mwhahaha | oidgar:: see my comments on ps64 | 16:59 |
alee | EmilienM, thanks | 16:59 |
chem | EmilienM: and we're currently working on fixing the gate-tripleo-ci-centos-7-containers-multinode-upgrades-pike one | 16:59 |
mwhahaha | i'll check out the latest but some of these things need to get moved out of the ansible playbook | 16:59 |
weshay | trown, panda really... all of these https://review.openstack.org/#/q/topic:fs035+status:open | 17:00 |
EmilienM | chem: I know you're working on it. My question is more "since it doesn't work *now*, should we continue to run the job in check?" | 17:00 |
EmilienM | weshay: no need to merge them if we move to RDO CI only, but I'm not sure what's the timeline | 17:00 |
EmilienM | maybe in the meantime we can merge my stuff | 17:00 |
chem | EmilienM: for master I agree, but can we keep pike ? | 17:00 |
EmilienM | chem: yeah my proposal is for master | 17:00 |
EmilienM | I mentionned gate-tripleo-ci-centos-7-containers-multinode-upgrades-master :-) | 17:01 |
weshay | EmilienM, there is an outtage on monday, sshnaidm|ruck is going to run one more report on pass/fail rates and check the mirror servers | 17:01 |
trown | weshay: maybe not paunch :P | 17:01 |
EmilienM | weshay: ok | 17:01 |
EmilienM | I need to look why all scenarios ran on https://review.openstack.org/#/c/525480/ | 17:01 |
chem | EmilienM: yeah, as they have the same underlying code I was wondering, that's all (still new to this game) | 17:02 |
chem | EmilienM: so we will have to make a check experimental to have working on master | 17:02 |
EmilienM | oh I found it, we run all scenarios when we touch ^environments\/.*.yaml | 17:02 |
d0ugal | shardy: it is failing because it is missing the -swift-rings at the end of the container name: https://github.com/openstack/tripleo-common/blob/master/workbooks/swift_rings_backup.yaml#L18 | 17:02 |
d0ugal | shardy: see line 23 | 17:02 |
EmilienM | chem: good | 17:02 |
EmilienM | sshnaidm|ruck: can we make gate-tripleo-ci-centos-7-containers-multinode-upgrades-master experimental please? I can also send a patch probably | 17:02 |
d0ugal | shardy: I am trying to figure out if line 39 and line 55 are intentional or also broken. Any ideas? | 17:03 |
shardy | d0ugal: yeah therve said the same earlier - I ended up rebuilding my environment for other reasons so only just reproduced the original error | 17:03 |
*** radeks has quit IRC | 17:04 | |
shardy | d0ugal: you should see it if you deploy any overcloud, then run the deploy command again | 17:04 |
shardy | since I updated this morning that breaks every time | 17:04 |
d0ugal | shardy: k, I'll try that. thanks | 17:04 |
shardy | d0ugal: got to drop for a while now but can re-test later or tomorrow if needed | 17:04 |
d0ugal | shardy: thanks, I'll not be around much longer either :) so tomorrow seems more likely. | 17:05 |
shardy | d0ugal: ack, np have a good evening | 17:05 |
EmilienM | sshnaidm|ruck: I did it, see on #rdo | 17:05 |
EmilienM | chem: https://review.rdoproject.org/r/10865 | 17:05 |
*** shardy is now known as shardy_afk | 17:06 | |
chem | EmilienM: ack | 17:06 |
*** yamahata has quit IRC | 17:06 | |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent https://review.openstack.org/525164 | 17:07 |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Add support for containerized OVN Metadata Agent https://review.openstack.org/525164 | 17:07 |
dsneddon | shardy_afk, Looks pretty good, you had fixed some things I had draft comments on in patchset 4. | 17:08 |
*** fzdarsky has quit IRC | 17:08 | |
alee | EmilienM, is there a glance person I can poke to ask about the failure in https://review.openstack.org/#/c/524064/ ? | 17:09 |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 17:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 17:10 |
*** karthiks has quit IRC | 17:11 | |
*** salmankhan has quit IRC | 17:11 | |
openstackgerrit | mathieu bultel proposed openstack/tripleo-common master: Add extra environment files for the update https://review.openstack.org/526214 | 17:11 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 17:12 |
EmilienM | alee: on #openstack-glance? | 17:13 |
EmilienM | alee: or flaper87 is your best bet here :D | 17:13 |
alee | flaper87, hey there | 17:13 |
openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Correct the container name confusion in the swift rings workflow https://review.openstack.org/526462 | 17:14 |
*** dtantsur is now known as dtantsur|afk | 17:15 | |
alee | flaper87, trying to get glance image signing test working on tripleo. things seen to be mostly working - just one test failure | 17:15 |
*** gvrangan has joined #tripleo | 17:15 | |
alee | flaper87, https://review.openstack.org/#/c/524064/ | 17:16 |
alee | flaper87, http://logs.openstack.org/64/524064/2/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/69f3ad2/logs/ | 17:16 |
sshnaidm|ruck | EmilienM, why experimental? Isn't it going to be fixed soon? | 17:17 |
EmilienM | sshnaidm|ruck: not afik | 17:17 |
sshnaidm|ruck | EmilienM, ok | 17:18 |
*** hewbrocca is now known as hewbrocca_afk | 17:18 | |
sshnaidm|ruck | EmilienM, so let's move both pike and master jobs | 17:19 |
*** rhallisey has joined #tripleo | 17:21 | |
*** cshastri has quit IRC | 17:23 | |
*** milan has quit IRC | 17:23 | |
*** jaganathan has joined #tripleo | 17:23 | |
*** itlinux has quit IRC | 17:23 | |
*** moshele has quit IRC | 17:24 | |
*** rfolco is now known as rfolco|brb | 17:25 | |
*** anilvenkata has joined #tripleo | 17:26 | |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations master: Add a validation to check for working DNS https://review.openstack.org/524304 | 17:26 |
*** sri_ has quit IRC | 17:28 | |
EmilienM | sshnaidm|ruck: no, pike is WIP by chem like he said, and he wants to keep the job in check | 17:29 |
*** jpich has quit IRC | 17:29 | |
sshnaidm|ruck | EmilienM, hmm.. WIP is usually in experimental | 17:30 |
EmilienM | chem: any thoughts ^ | 17:31 |
EmilienM | ? | 17:31 |
chem | sshnaidm|ruck: well for master we won't have it working soon, but pike should work and we want to have it working asap | 17:31 |
sshnaidm|ruck | chem, ok | 17:31 |
*** abregman|mtg is now known as abregman | 17:31 | |
chem | sshnaidm|ruck: thanks, if we don't have much progress on it soon, we'll revisit this choice ... hope we don't have to do that. | 17:32 |
*** ccamacho has joined #tripleo | 17:36 | |
*** remix_tj has joined #tripleo | 17:37 | |
*** ccamacho has quit IRC | 17:39 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker. https://review.openstack.org/526440 | 17:39 |
*** brault_ has quit IRC | 17:39 | |
alee | EmilienM, mwhahaha thanks -- also https://review.openstack.org/523539 , https://review.openstack.org/525337 , https://review.openstack.org/525741 , https://review.openstack.org/525742 please -- when you get a chance :) | 17:40 |
*** brault has joined #tripleo | 17:40 | |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Remove dead code & variables https://review.openstack.org/526152 | 17:41 |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Add major update implementation https://review.openstack.org/526213 | 17:41 |
EmilienM | alee: good work here | 17:43 |
alee | EmilienM, thanks :) | 17:43 |
*** radeks has joined #tripleo | 17:43 | |
*** cshastri has joined #tripleo | 17:44 | |
*** brault has quit IRC | 17:45 | |
*** s_b_34343 has joined #tripleo | 17:45 | |
*** athomas has joined #tripleo | 17:46 | |
*** jd_ has joined #tripleo | 17:46 | |
jd_ | weshay: o/ | 17:46 |
slagle | shardy_afk: whenever you get a chance, could you have a look at https://review.openstack.org/#/c/524437/. i added the manual config-download steps as you requested | 17:46 |
weshay | jd_, hey brotha.. just looking for some assistance on a telemetry tempest failure.. not sure what the root cause is | 17:46 |
jd_ | weshay: me neither | 17:47 |
jd_ | weshay: did you see my question about the missing log file? | 17:47 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 17:47 |
weshay | jd_, nope | 17:47 |
*** salmankhan has joined #tripleo | 17:48 | |
jd_ | weshay: check your mail then :) | 17:48 |
*** jpena is now known as jpena|off | 17:48 | |
jd_ | weshay: though I see EmilienM have a "fix" | 17:48 |
jd_ | which is disabling the test in != master IIUC | 17:49 |
weshay | EmilienM, I thought telemetry tempest was enabled in pike | 17:49 |
weshay | ya | 17:49 |
weshay | that's what I'm poking at now | 17:49 |
EmilienM | weshay: not in scenario002 | 17:49 |
EmilienM | in scenario001 only | 17:49 |
weshay | oh just 1 | 17:49 |
EmilienM | yup | 17:49 |
weshay | right | 17:49 |
weshay | k | 17:49 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render NIC config templates with jinja2 https://review.openstack.org/523638 | 17:49 |
EmilienM | I found the root cause, and I sent a patch to fix it | 17:49 |
EmilienM | jd_, weshay : is it clear or I need to explain again? | 17:49 |
jd_ | I would not call that the root cause, but ok :) | 17:50 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 17:50 |
jd_ | I'm fine with that | 17:50 |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Remove jq package install https://review.openstack.org/525781 | 17:50 |
*** holser has quit IRC | 17:50 | |
EmilienM | jd_: the root cause is "we don't deploy telemetry properly on scenario002 in stable/pike" | 17:50 |
*** radeks has quit IRC | 17:50 | |
*** moshele has joined #tripleo | 17:51 | |
EmilienM | jd_: so instead of backporting the config into stable/pike, I proposed to not run the tests on scenario002, for this branch | 17:51 |
EmilienM | jd_: we're not big fans of changing CI jobs in stable branches | 17:51 |
jd_ | EmilienM: yeah I understand – but that's why I use "" around fix and root case, not being fan is different of doing the right thing technically :) | 17:51 |
jd_ | but I'm ok with that, I know how it is :) | 17:52 |
*** ffiore has joined #tripleo | 17:52 | |
*** lucasagomes is now known as lucas-afk | 17:52 | |
*** rfolco|brb is now known as rfolco | 17:53 | |
*** moshele has quit IRC | 17:53 | |
*** holser has joined #tripleo | 17:53 | |
*** s_b_34343 has quit IRC | 17:53 | |
*** derekh has quit IRC | 17:54 | |
*** holser has quit IRC | 17:57 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 17:59 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Passes NodeDataLookup to ceph-ansible workflow https://review.openstack.org/526073 | 18:00 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker. https://review.openstack.org/526440 | 18:00 |
weshay | EmilienM, /me trying to fix the yaml on your review | 18:03 |
openstackgerrit | David Peacock proposed openstack/tripleo-quickstart master: Clarify SSH server requirements prior to tripleo-quickstart deployment https://review.openstack.org/526471 | 18:04 |
EmilienM | weshay: which review | 18:04 |
EmilienM | weshay: the telemetry? | 18:04 |
weshay | https://review.openstack.org/#/c/526459/3/config/general_config/featureset017.yml | 18:04 |
EmilienM | weshay: go ahead ok | 18:04 |
openstackgerrit | Merged openstack/tripleo-docs master: Add composable networks documentation https://review.openstack.org/521493 | 18:06 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 18:06 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: DNM - test https://review.openstack.org/526472 | 18:07 |
*** bandini has quit IRC | 18:07 | |
EmilienM | sdoran: ^ | 18:07 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/pike: Add modulepath option when applying puppet inside docker. https://review.openstack.org/526473 | 18:07 |
*** bandini has joined #tripleo | 18:07 | |
*** mdnadeem has quit IRC | 18:08 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: DNM - test https://review.openstack.org/526472 | 18:08 |
EmilienM | sdoran: ^ same review | 18:08 |
oidgar | mwhahaha: do you know if we can notify an handler between roles? | 18:09 |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 18:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 18:10 |
mwhahaha | oidgar: i want to say yes but that's a question for sdoran | 18:10 |
oidgar | sdoran: ^ | 18:11 |
oidgar | sdoran: any idea? :) | 18:11 |
sdoran | So what do you mean by "between roles"? | 18:11 |
sdoran | Use `handlers/main.yml` from `role1` in tasks in `roles2`? | 18:11 |
*** anilvenkata has quit IRC | 18:11 | |
*** tesseract has quit IRC | 18:13 | |
sdoran | Or just trigger handlers mid-play? | 18:15 |
oidgar | sdoran: do you have an example how to do it? | 18:17 |
sdoran | Which one? | 18:17 |
oidgar | sdoran: for use 'handlers/main.yml' | 18:17 |
oidgar | sdoran: like how's the syntax should be | 18:18 |
sdoran | So sharing handlers across roles? | 18:18 |
sdoran | Are both roles in the play? | 18:18 |
*** trown is now known as trown|lunch | 18:18 | |
oidgar | sdoran: no, there are 2 plays, each one of them refers to a different role | 18:18 |
slagle | jistr: StrictHostKeyChecking=no did the trick. do you think it should do that by default? | 18:21 |
*** jaganathan has quit IRC | 18:22 | |
*** ffiore has quit IRC | 18:22 | |
*** yprokule has quit IRC | 18:23 | |
*** athomas has quit IRC | 18:25 | |
*** numans has quit IRC | 18:30 | |
*** numans has joined #tripleo | 18:32 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests https://review.openstack.org/526459 | 18:34 |
openstackgerrit | David Peacock proposed openstack/tripleo-quickstart master: Clarify SSH server requirements prior to tripleo-quickstart deployment https://review.openstack.org/526471 | 18:34 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: scenario002-container: ignore telemetry & barbican tests https://review.openstack.org/526459 | 18:35 |
weshay | EmilienM, I think this will do it https://review.openstack.org/#/c/526459/5/config/general_config/featureset017.yml | 18:35 |
*** dprince has quit IRC | 18:36 | |
EmilienM | weshay: thanks | 18:36 |
EmilienM | weshay: you found it on stackoverflow? | 18:36 |
weshay | EmilienM, I bought a devel in a far off country to do it for me | 18:38 |
*** fragatina has quit IRC | 18:38 | |
*** salmankhan has quit IRC | 18:38 | |
EmilienM | lol | 18:38 |
*** moshele has joined #tripleo | 18:40 | |
*** sshnaidm|ruck is now known as sshnaidm|off | 18:43 | |
*** gvrangan has quit IRC | 18:45 | |
*** s_b_34343 has joined #tripleo | 18:46 | |
*** tosky has quit IRC | 18:47 | |
*** artom has joined #tripleo | 18:48 | |
EmilienM | weshay, sshnaidm|off: thx for your help, the rdo ci config layout is now good in master, we have ovb-ha and ovb-ha-ipv6 | 18:50 |
EmilienM | weshay, sshnaidm|off : wdyt if we stop running the 2 jobs in rh1 (just in master for now)? | 18:50 |
*** nyechiel has joined #tripleo | 18:50 | |
EmilienM | also we need to find a way to get them on tripleo.org/cistatus.html | 18:51 |
weshay | EmilienM, I'm fine w/ it if you are | 18:52 |
weshay | EmilienM, however /me wonders what people think of moving sova into a tripleo repo | 18:52 |
weshay | so we can converge on a status board | 18:52 |
*** jkilpatr has quit IRC | 18:52 | |
EmilienM | it's a different topic | 18:52 |
EmilienM | but ok | 18:52 |
*** itlinux has joined #tripleo | 18:53 | |
EmilienM | not sure the repo place is really a blocker | 18:53 |
EmilienM | do we want to remove tripleo.org/cistatus.html in the future? I'm not sure | 18:54 |
*** shardy_afk has quit IRC | 18:54 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Don't run check-tripleo OVB jobs frm RH1 anymore https://review.openstack.org/526481 | 18:56 |
EmilienM | weshay: this is what it takes to remove ovb jobs in THT for example ^ | 18:56 |
weshay | EmilienM, it takes blood, sweat, tears and keyboard | 18:57 |
weshay | and a | 18:57 |
EmilienM | lol | 18:58 |
EmilienM | weshay: I'll update tripleo.org/cistatus.html to have jobs from rdo ci | 18:58 |
EmilienM | weshay: what else before we switch? | 18:59 |
EmilienM | weshay: I'm verifying logs work fine | 18:59 |
EmilienM | weshay: I just found a new problem, https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022-master-nv/4596/ | 18:59 |
EmilienM | from https://review.openstack.org/#/c/525746/ | 18:59 |
EmilienM | logs aren't found | 19:00 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add reproducer script for OVB and multinode jobs https://review.openstack.org/525743 | 19:00 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: dump out all the variables used https://review.openstack.org/526138 | 19:01 |
weshay | rlandy, new review up | 19:01 |
* rlandy looks | 19:01 | |
openstackgerrit | David Peacock proposed openstack/tripleo-quickstart master: Clarify SSH server requirements prior to tripleo-quickstart deployment https://review.openstack.org/526471 | 19:01 |
EmilienM | weshay: why when we go on https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-containers-multinode-upgrades-master/4021/ | 19:02 |
EmilienM | SUCCESS jobs logs are 404 | 19:02 |
*** dprince has joined #tripleo | 19:02 | |
* weshay looks | 19:03 | |
*** chandankumar has quit IRC | 19:04 | |
weshay | hrm.. this was working | 19:04 |
weshay | :( | 19:04 |
openstackgerrit | Or Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia https://review.openstack.org/487450 | 19:04 |
*** rhallisey has quit IRC | 19:05 | |
*** fragatina has joined #tripleo | 19:06 | |
weshay | EmilienM, https://logs.rdoproject.org/09/523909/3/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Zec34db91c51749e3b0bae6951aeb5b53/ | 19:06 |
weshay | EmilienM, we need to speak to dmsimard|afk I think to update gerrit settings to point the right logs | 19:06 |
rlandy | weshay: left some nit-pick comments - looks better now - will +2 when we can see some test logs | 19:07 |
*** moshele has quit IRC | 19:07 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: add keystone and neutron tempest plugins to default config https://review.openstack.org/525657 | 19:07 |
EmilienM | weshay: I consider that as a blocker to make the switch | 19:08 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: CI: Test multi-rbd backend for cinder in scenario001 https://review.openstack.org/519749 | 19:08 |
EmilienM | weshay: our users need to find logs easily like before | 19:08 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: dump out all the variables used https://review.openstack.org/526138 | 19:09 |
weshay | rlandy, fixed.. thanks | 19:09 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Add modulepath option when applying puppet inside docker. https://review.openstack.org/526440 | 19:09 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 19:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 19:10 |
*** trown|lunch is now known as trown | 19:11 | |
*** tosky has joined #tripleo | 19:12 | |
*** rhallisey has joined #tripleo | 19:12 | |
*** jkilpatr has joined #tripleo | 19:13 | |
*** Goneri has quit IRC | 19:14 | |
*** itlinux has quit IRC | 19:14 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/pike: Add modulepath option when applying puppet inside docker. https://review.openstack.org/526473 | 19:15 |
openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Pass storage nfs VIP to ceph-ansible https://review.openstack.org/512240 | 19:16 |
*** oidgar has quit IRC | 19:17 | |
*** itlinux has joined #tripleo | 19:18 | |
*** jkilpatr has quit IRC | 19:18 | |
*** jkilpatr has joined #tripleo | 19:19 | |
*** s_b_34343 has quit IRC | 19:19 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Add missing steps from tripleo-ci ovb playbook https://review.openstack.org/526451 | 19:24 |
*** nyechiel has quit IRC | 19:24 | |
*** jbadiapa has quit IRC | 19:28 | |
*** radeks has joined #tripleo | 19:29 | |
*** bandini has quit IRC | 19:36 | |
*** bandini has joined #tripleo | 19:38 | |
*** iranzo has quit IRC | 19:47 | |
*** abregman is now known as abregman|afk | 19:48 | |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Break up messages to avoid max message size https://review.openstack.org/526492 | 19:49 |
*** mcornea has quit IRC | 19:52 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Use StrictHostKeyChecking=no in enable-ssh-admin.sh https://review.openstack.org/526494 | 19:54 |
openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: DO NOT MERGE: test ovb-ha with config-download https://review.openstack.org/525331 | 19:55 |
*** moshele has joined #tripleo | 19:55 | |
openstackgerrit | David Peacock proposed openstack/tripleo-quickstart master: Add ansible_facts_cache/ to .gitignore https://review.openstack.org/526497 | 19:56 |
*** brault has joined #tripleo | 19:58 | |
*** tongl has joined #tripleo | 20:03 | |
*** BryanS68 has quit IRC | 20:07 | |
*** jkilpatr has quit IRC | 20:08 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Use playbook from tripleo-quickstart-extras for OVB https://review.openstack.org/513508 | 20:10 |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 20:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 20:10 |
openstackgerrit | Gabriel Szasz proposed openstack/tripleo-heat-templates master: Add Novacontrol role https://review.openstack.org/526501 | 20:13 |
*** nyechiel has joined #tripleo | 20:13 | |
*** moshele has quit IRC | 20:16 | |
openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: Add disruption detector for Overcloud endpoint monitoring https://review.openstack.org/520126 | 20:18 |
*** jkilpatr has joined #tripleo | 20:24 | |
openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Add stack update role https://review.openstack.org/520125 | 20:27 |
*** oidgar has joined #tripleo | 20:29 | |
*** jkilpatr has quit IRC | 20:32 | |
*** BryanS68 has joined #tripleo | 20:37 | |
*** dmellado has quit IRC | 20:37 | |
*** itlinux has quit IRC | 20:40 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 20:40 |
*** stevebaker has quit IRC | 20:41 | |
*** Goneri has joined #tripleo | 20:43 | |
*** stevebaker has joined #tripleo | 20:44 | |
*** moshele has joined #tripleo | 20:44 | |
*** pchavva has quit IRC | 20:45 | |
*** oidgar has quit IRC | 20:46 | |
*** dmellado has joined #tripleo | 20:50 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Consume NodeDataLookup in ceph-ansible https://review.openstack.org/526030 | 20:50 |
*** cshastri has quit IRC | 20:53 | |
mwhahaha | beagles: do we want to merge the change with the ssh key path stuff https://review.openstack.org/#/c/526090/8/puppet/services/octavia-worker.yaml or do we want to pull that out | 20:54 |
beagles | mwhahaha, ah right yeah, I'll remove that. 1s | 20:56 |
*** dparkes has joined #tripleo | 20:56 | |
openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart master: DNM: test https://review.openstack.org/526509 | 20:58 |
*** itlinux has joined #tripleo | 20:59 | |
*** rfolco is now known as rfolco|off | 21:01 | |
*** pchavva has joined #tripleo | 21:01 | |
openstackgerrit | Ian Main proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 21:01 |
*** akrivoka has quit IRC | 21:02 | |
*** gfidente has quit IRC | 21:03 | |
*** nyechiel has quit IRC | 21:05 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for Octavia service-to-service credentials https://review.openstack.org/526062 | 21:05 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add Octavia certificate parameters https://review.openstack.org/526090 | 21:05 |
*** holser has joined #tripleo | 21:05 | |
beagles | mwhahaha, updated | 21:06 |
mwhahaha | k thanks | 21:06 |
*** jkilpatr has joined #tripleo | 21:06 | |
mwhahaha | beagles: don't for get to rebase https://review.openstack.org/#/c/526404 | 21:07 |
beagles | mwhahaha, ack | 21:07 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Add support for providing Octavia cert data https://review.openstack.org/526404 | 21:08 |
*** mburned is now known as mburned_out | 21:10 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 21:10 |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 21:10 |
*** chandankumar has joined #tripleo | 21:11 | |
*** pchavva has quit IRC | 21:19 | |
*** moshele has quit IRC | 21:23 | |
openstackgerrit | Merged openstack/diskimage-builder master: ironic-agent: don't remove make https://review.openstack.org/526257 | 21:23 |
*** alee has quit IRC | 21:28 | |
openstackgerrit | Dan Prince proposed openstack/python-tripleoclient master: Configure undercloud docker registry/mirror https://review.openstack.org/526147 | 21:28 |
*** nguyentrihai has quit IRC | 21:29 | |
*** tongl has quit IRC | 21:29 | |
*** tongl has joined #tripleo | 21:30 | |
*** dmsimard|afk is now known as dmsimard | 21:30 | |
*** mburned_out is now known as mburned | 21:30 | |
*** florianf|afk has quit IRC | 21:30 | |
*** radeks has quit IRC | 21:32 | |
EmilienM | mwhahaha: https://github.com/voxpupuli/puppet-rabbitmq/commit/0ec48b31d4ac2b0dda44ace71abc9b8b6f5f4c66 merged | 21:36 |
mwhahaha | k | 21:37 |
*** ansmith has quit IRC | 21:37 | |
*** rlandy is now known as rlandy|mtg | 21:38 | |
*** moshele has joined #tripleo | 21:41 | |
EmilienM | mwhahaha: I think I should update rdoinfo to bump rabbitmq module to this commit? so we import it at next zstream? | 21:41 |
mwhahaha | how about we test in master first | 21:42 |
EmilienM | sure thing | 21:42 |
*** chandankumar has quit IRC | 21:43 | |
*** BryanS68 has quit IRC | 21:43 | |
*** dhill_ has quit IRC | 21:43 | |
*** raildo has quit IRC | 21:43 | |
*** dsneddon has quit IRC | 21:43 | |
*** rdopiera has quit IRC | 21:43 | |
*** StevenK has quit IRC | 21:43 | |
*** slagle has quit IRC | 21:43 | |
*** dalvarez has quit IRC | 21:43 | |
*** eck` has quit IRC | 21:43 | |
*** therve has quit IRC | 21:43 | |
*** bandini has quit IRC | 21:45 | |
*** bandini has joined #tripleo | 21:48 | |
*** chandankumar has joined #tripleo | 21:48 | |
*** BryanS68 has joined #tripleo | 21:48 | |
*** dhill_ has joined #tripleo | 21:48 | |
*** raildo has joined #tripleo | 21:48 | |
*** dsneddon has joined #tripleo | 21:48 | |
*** rdopiera has joined #tripleo | 21:48 | |
*** StevenK has joined #tripleo | 21:48 | |
*** slagle has joined #tripleo | 21:48 | |
*** eck` has joined #tripleo | 21:48 | |
*** dalvarez has joined #tripleo | 21:48 | |
*** therve has joined #tripleo | 21:48 | |
*** openstackgerrit has quit IRC | 21:48 | |
*** openstackgerrit has joined #tripleo | 21:53 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: collect logs: remove --ansible-debug https://review.openstack.org/523552 | 21:53 |
openstackgerrit | Merged openstack/tripleo-quickstart master: zuul: update OVB jobs https://review.openstack.org/525747 | 21:53 |
*** jkilpatr has quit IRC | 21:53 | |
*** ffiore has joined #tripleo | 21:54 | |
openstackgerrit | James Slagle proposed openstack/tripleo-common master: Break up messages to avoid max message size https://review.openstack.org/526492 | 21:57 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: cistatus.html: update OVB jobs https://review.openstack.org/525751 | 22:01 |
*** toure is now known as toure|gone | 22:01 | |
*** rlandy|mtg is now known as rlandy | 22:02 | |
*** threestrands has joined #tripleo | 22:04 | |
*** threestrands has quit IRC | 22:04 | |
*** threestrands has joined #tripleo | 22:04 | |
*** chlong has quit IRC | 22:04 | |
*** trown is now known as trown|outtypewww | 22:06 | |
*** rcernin has joined #tripleo | 22:09 | |
openstackgerrit | Dan Prince proposed openstack/puppet-tripleo master: Remove INSECURE_REGISTRY from docker_registry.pp https://review.openstack.org/525761 | 22:09 |
*** rcernin has quit IRC | 22:09 | |
*** rcernin has joined #tripleo | 22:09 | |
*** holser has quit IRC | 22:09 | |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 22:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 22:10 |
weshay | http://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/ | 22:13 |
weshay | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz | 22:13 |
weshay | myoung|rover, ^ two culprits for the gate reset | 22:13 |
weshay | FYI | 22:14 |
*** ihrachys has quit IRC | 22:14 | |
mwhahaha | are those the ones from yesterday? | 22:15 |
mwhahaha | cause it's the error i saw about config download | 22:15 |
mwhahaha | http://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_21_59_36 | 22:15 |
* mwhahaha checks timestamp | 22:15 | |
mwhahaha | nope that's today | 22:15 |
weshay | http://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_21_59_36 | 22:15 |
weshay | mwhahaha, I think we may have merged a bad patch | 22:16 |
weshay | 3rd time I've seen that today | 22:16 |
mwhahaha | or something is buggy | 22:16 |
mwhahaha | cause it's not 100% | 22:16 |
weshay | ya | 22:16 |
weshay | true true | 22:16 |
mwhahaha | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-07_21_23_35 | 22:16 |
mwhahaha | EmilienM, slagle: looks like a bug in config-download | 22:17 |
*** mburned is now known as mburned_out | 22:17 | |
mwhahaha | plz file an alert bug | 22:17 |
*** dprince has quit IRC | 22:19 | |
weshay | mwhahaha, k | 22:20 |
*** dmacpher has quit IRC | 22:20 | |
*** alee has joined #tripleo | 22:20 | |
weshay | https://bugs.launchpad.net/tripleo/+bug/1737042 | 22:22 |
openstack | Launchpad bug 1737042 in tripleo "ERROR! the role 'tripleo-bootstrap' was not found in /var/lib/mistral roles path" [Critical,Triaged] | 22:22 |
weshay | myoung|rover, FYI ^ | 22:23 |
*** weshay is now known as weshay|ruck | 22:23 | |
*** mburned_out is now known as mburned | 22:23 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Enable docker-puppet.py for a single config_volume https://review.openstack.org/526526 | 22:25 |
slagle | mwhahaha: WUT | 22:26 |
mwhahaha | YOU HEARD ME | 22:27 |
mwhahaha | THE WORLD IS ON FIIIIIIRRRREEEE | 22:27 |
slagle | need to check the installed version of tripleo-common to see if it has EmilienM packaging change to include the role | 22:28 |
mwhahaha | when did that land? | 22:28 |
slagle | weshay|ruck: mwhahaha : where do you see what dlrn repo was used? | 22:28 |
weshay|ruck | http://logs.openstack.org/37/525337/3/gate/tripleo-ci-centos-7-containers-multinode/c81c7b9/logs/undercloud/etc/yum.repos.d/ | 22:29 |
weshay|ruck | baseurl=http://mirror.iad.rax.openstack.org:8080/rdo/centos7/c8/cc/c8cceebf8e648ce46219026f926047491135a66e_fcf8d179 | 22:29 |
*** bfournie has quit IRC | 22:30 | |
mwhahaha | to include the role or just the role dir | 22:30 |
mwhahaha | i don't see a patch to include a role specifically | 22:30 |
mwhahaha | oh there it is, https://review.openstack.org/#/c/525285/ | 22:31 |
mwhahaha | so tripleo-common isn't built all the time | 22:32 |
mwhahaha | so we need a promotion to stop seeing these | 22:32 |
mwhahaha | this is problemattic | 22:33 |
mwhahaha | we should have moved the tripleo-bootstrap to it's own package | 22:34 |
mwhahaha | and not shoved it in tripleo-common btw | 22:34 |
* mwhahaha slaps EmilienM's hand for dumping random crap in tripleo-common | 22:34 | |
slagle | weshay|ruck: mwhahaha : according to http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/var/log/host_info.txt.gz, openstack-tripleo-common-8.2.1-0.20171207204216.ad25b79.el7.centos.noarch is installed | 22:36 |
slagle | weshay|ruck: mwhahaha : yet the repos in use are http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/etc/yum.repos.d/delorean-current.repo.txt.gz and http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/undercloud/etc/yum.repos.d/delorean.repo.txt.gz, neither of which contain that version of tripleo-common | 22:36 |
*** rcernin has quit IRC | 22:36 | |
*** chandankumar has quit IRC | 22:36 | |
*** BryanS68 has quit IRC | 22:36 | |
*** dhill_ has quit IRC | 22:36 | |
*** raildo has quit IRC | 22:36 | |
*** dsneddon has quit IRC | 22:36 | |
*** rdopiera has quit IRC | 22:36 | |
*** StevenK has quit IRC | 22:36 | |
*** slagle has quit IRC | 22:36 | |
*** dalvarez has quit IRC | 22:36 | |
*** eck` has quit IRC | 22:36 | |
*** therve has quit IRC | 22:36 | |
mwhahaha | slagle: it might have been built in the change, let's look at the dlrn logs | 22:37 |
mwhahaha | come back to me slagle! | 22:37 |
mwhahaha | stupid netsplits | 22:37 |
*** leifmadsen has quit IRC | 22:39 | |
weshay|ruck | where did he go? | 22:39 |
weshay|ruck | lolz | 22:39 |
mwhahaha | the irc server he was on went poof | 22:40 |
mwhahaha | anyway so it built a tripleo-common | 22:40 |
mwhahaha | but i don't know what hash it was using cause i cant' find it in the git log | 22:40 |
mwhahaha | oh the hash it has in the pkg name is a dlrn repo hash | 22:41 |
mwhahaha | that's nto very helpful | 22:41 |
*** rcernin has joined #tripleo | 22:42 | |
*** chandankumar has joined #tripleo | 22:42 | |
*** BryanS68 has joined #tripleo | 22:42 | |
*** dhill_ has joined #tripleo | 22:42 | |
*** raildo has joined #tripleo | 22:42 | |
*** dsneddon has joined #tripleo | 22:42 | |
*** rdopiera has joined #tripleo | 22:42 | |
*** StevenK has joined #tripleo | 22:42 | |
*** slagle has joined #tripleo | 22:42 | |
*** eck` has joined #tripleo | 22:42 | |
*** dalvarez has joined #tripleo | 22:42 | |
*** therve has joined #tripleo | 22:42 | |
mwhahaha | slagle: it got built, http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/delorean_logs/ad/25/ad25b79800da04f7af88a3a47f811cf07fb9d051_dev/rpmbuild.log.txt.gz | 22:42 |
*** leifmadsen has joined #tripleo | 22:42 | |
*** leifmadsen has quit IRC | 22:42 | |
*** leifmadsen has joined #tripleo | 22:42 | |
openstackgerrit | Joe Talerico proposed openstack/puppet-tripleo master: HAProxy logging https://review.openstack.org/497524 | 22:43 |
weshay|ruck | openstack-tripleo-common.noarch 8.2.1-0.20171207204216.ad25b79.el7.centos | 22:43 |
mwhahaha | how do you figure out what version of the code was used for that | 22:43 |
*** yamahata has joined #tripleo | 22:44 | |
*** raildo has quit IRC | 22:44 | |
slagle | mwhahaha: oh, so it was unrelated tripleo-common patch in the same gate job | 22:44 |
mwhahaha | oh so there was a tripleo-common patch in the gatequeue that might have been older than the one emilien merged | 22:45 |
mwhahaha | i hate it when it does that | 22:45 |
weshay|ruck | mwhahaha, if it wasn't built on the fly.. it should be the latest in tripleo-common | 22:45 |
slagle | i would have guessed that anything in zuul_changes gets rebased onto master | 22:45 |
slagle | since that's what you actually want to be testing | 22:45 |
mwhahaha | i'm not sure it actually does | 22:46 |
mwhahaha | like it's supposed to | 22:46 |
mwhahaha | but i don't know if dlrn does | 22:46 |
slagle | otherwise...you aren't testing what's actually already been merged | 22:46 |
*** dhill_ has quit IRC | 22:46 | |
slagle | yea, possible bug in dlrn then | 22:46 |
slagle | for gate jobs | 22:46 |
mwhahaha | https://review.openstack.org/#/c/525337/ was the change in the gate | 22:47 |
*** dhill_ has joined #tripleo | 22:47 | |
mwhahaha | which got -A'd too | 22:47 |
weshay|ruck | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/delorean_logs/ | 22:47 |
weshay|ruck | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/logs/delorean_logs/ad/25/ad25b79800da04f7af88a3a47f811cf07fb9d051_dev/build.log.txt.gz | 22:48 |
weshay|ruck | tripleo-common ^ | 22:48 |
*** eck` is now known as eck`gone | 22:48 | |
slagle | but no mention of tripleo-bootstrap | 22:48 |
slagle | which merged last night | 22:49 |
weshay|ruck | is this a rebase issue? | 22:49 |
weshay|ruck | OH | 22:49 |
weshay|ruck | ya.. one would think delorean-current would override.. or this dlrn build should be on top of delorean-current | 22:50 |
weshay|ruck | so.. ya. dlrn bug | 22:50 |
slagle | i think dlrn ought to clone master, then rebase patch on top, then build from that | 22:50 |
mwhahaha | well it should be rebased on top of current head | 22:50 |
openstackgerrit | Michael Turek proposed openstack/diskimage-builder master: Add iscsi-boot element https://review.openstack.org/511494 | 22:51 |
slagle | yea sure | 22:51 |
*** BryanS68 has quit IRC | 22:52 | |
mwhahaha | i commented on the bug | 22:53 |
mwhahaha | trying to summarize this | 22:53 |
*** moshele has quit IRC | 22:54 | |
mwhahaha | i think the gate might be ok unless we attempt to merge a tripleo-common patch that doesn't include the roles bits | 22:55 |
weshay|ruck | hrm.. | 22:56 |
weshay|ruck | https://trunk.rdoproject.org/centos7-master/1e/30/1e302df86b58030a8e9bbae6e7a1a81d1d4c20c1_28eeb6c7/openstack-tripleo-common-8.2.1-0.20171207141352.21f271c.el7.centos.noarch.rpm | 22:56 |
weshay|ruck | was avail | 22:56 |
*** itlinux has quit IRC | 22:56 | |
mwhahaha | weshay|ruck: in the delorean.repo? | 22:56 |
mwhahaha | weshay|ruck: it likely built tripleo-common with a patch that was in ZUUL_REFs | 22:56 |
weshay|ruck | baseurl=http://mirror.mtl01.inap.openstack.org:8080/rdo/centos7/1e/30/1e302df86b58030a8e9bbae6e7a1a81d1d4c20c1_28eeb6c7 | 22:57 |
weshay|ruck | mwhahaha, ya... that sounds right. | 22:57 |
weshay|ruck | it's been too long for me to know off the top of my head | 22:57 |
mwhahaha | https://review.openstack.org/#/c/525337/ needed a rebase | 22:57 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Set simple crypto plugin as global default for Barbican https://review.openstack.org/525480 | 22:58 |
openstackgerrit | Merged openstack/puppet-tripleo master: Add multiple backends for barbican https://review.openstack.org/523538 | 22:58 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add parameters for Barbican keystone listener https://review.openstack.org/525741 | 22:58 |
openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Added ability to generate kek for barbican simple crypto backend https://review.openstack.org/525337 | 22:58 |
*** pmannidi has joined #tripleo | 22:58 | |
weshay|ruck | ZUUL_CHANGES=openstack/tripleo-quickstart:master:refs/changes/52/523552/2^openstack/tripleo-quickstart:master:refs/changes/47/525747/2^openstack-infra/tripleo-ci:master:refs/changes/51/525751/1^openstack/tripleo-heat-templates:master:refs/changes/80/525480/1^openstack/puppet-tripleo:master:refs/changes/38/523538/7^openstack/tripleo-heat-templates:master:refs/changes/41/525741/2^openstack/tripleo-heat-templates:master:refs/changes/42/5 | 22:58 |
weshay|ruck | 25742/2^openstack/tripleo-common:master:refs/changes/37/525337/3^openstack/tripleo-heat-templates:master:refs/changes/39/523539/6 | 22:58 |
weshay|ruck | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_16_45_240575 | 22:58 |
mwhahaha | ah crap it just reset the gate | 22:59 |
weshay|ruck | heh | 22:59 |
weshay|ruck | https://review.openstack.org/#/c/525337/ | 22:59 |
weshay|ruck | saw the same fail there | 22:59 |
weshay|ruck | mwhahaha, ok.. so you just rebased | 22:59 |
weshay|ruck | so in theory.. we should be ok now? | 22:59 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 23:00 |
mwhahaha | unless someone merged somethign from tripleo-common that wasn't rebased in the last 24 hours | 23:00 |
mwhahaha | yea | 23:00 |
weshay|ruck | mwhahaha, isn't possible to change the gerrit settings to automcatically rebase? | 23:00 |
mwhahaha | weshay|ruck: it's not a gerrit thing, it's a dlrn thing | 23:00 |
weshay|ruck | racist | 23:01 |
mwhahaha | or do you mean go rebase all the patches | 23:01 |
* mwhahaha rebases weshay|ruck | 23:01 | |
weshay|ruck | lolz | 23:01 |
weshay|ruck | mwhahaha, as owners of the gerrit repo I think, I'm not sure you change the settings w/ regards to automatic rebases | 23:02 |
weshay|ruck | maybe we don't have that access upstream | 23:02 |
mwhahaha | i don't think we do | 23:02 |
*** jmelvin_ has quit IRC | 23:03 | |
*** chem has quit IRC | 23:05 | |
mwhahaha | weshay|ruck: wait we clone the change in build-test-packages | 23:08 |
mwhahaha | so we should rebase and apply | 23:08 |
mwhahaha | or copy the local stuff from zuul | 23:08 |
mwhahaha | (ideally copy the local stuff from zuul cause they already do this) | 23:08 |
mwhahaha | oh wait we do that | 23:10 |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736475 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1736634 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1737042 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1736475 in tripleo "Telemetry tempest tests fail due to Max retries exceeded with url: /nodata-gnocchi-threshold-resource" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 23:10 |
openstack | Launchpad bug 1736634 in tripleo "CI/oooq: some Ansible tasks run multiple times (causing job timeouts)" [Critical,Triaged] - Assigned to wes hayutin (weshayutin) | 23:10 |
openstack | Launchpad bug 1737042 in tripleo "ERROR! the role 'tripleo-bootstrap' was not found in /var/lib/mistral roles path" [Critical,Triaged] | 23:10 |
* weshay|ruck poking | 23:11 | |
mwhahaha | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_40_43_430196 | 23:11 |
mwhahaha | no we didn't | 23:11 |
mwhahaha | in this case we clonded it | 23:11 |
mwhahaha | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_40_52_898886 | 23:11 |
mwhahaha | because it wasn't preped for us | 23:11 |
*** fpan has joined #tripleo | 23:12 | |
* mwhahaha adds quickstart tag | 23:13 | |
*** dmacpher has joined #tripleo | 23:13 | |
mwhahaha | now i was under the impression that it should have copied it | 23:13 |
mwhahaha | i wonder if https://review.openstack.org/#/c/525265/ broke that | 23:14 |
mwhahaha | why do we always find the weird bugs when everyone is off for the day | 23:14 |
weshay|ruck | oh | 23:15 |
weshay|ruck | prepared by zuul cloner | 23:15 |
mwhahaha | or are we looking in the wrong spot | 23:15 |
mwhahaha | and we just never noticed until now | 23:15 |
mwhahaha | like was this something that changed in v3 | 23:15 |
mwhahaha | because http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_13_25_253863 it was preped | 23:16 |
mwhahaha | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_15_02_857789 | 23:16 |
mwhahaha | i don't think we look in the right spot for changes from other repos | 23:18 |
weshay|ruck | possible.. this is the quiets the gates have been.. for a nuanced issue like this | 23:18 |
mwhahaha | even though zuul cloner doesn't exist anymore in v3 (it's just a shim) we should either be using that or using the real paths for all these projects | 23:20 |
weshay|ruck | what dir is zuul cloner dropping these into | 23:20 |
mwhahaha | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_15_02_615015 | 23:21 |
mwhahaha | looks like /var/lib/zuul/buildes/<hash>/work/src/... | 23:21 |
weshay|ruck | \/var/lib/zuuul is new | 23:21 |
weshay|ruck | afaict | 23:21 |
mwhahaha | i guess infra folks are the best to ask about how to go about touching this stuff | 23:21 |
mwhahaha | it might be exposed via ansible vars | 23:23 |
mwhahaha | it is | 23:24 |
mwhahaha | zuul.executor.src_root | 23:24 |
mwhahaha | that's the src part | 23:24 |
mwhahaha | then the zuul.projects[X].src_Dir | 23:25 |
mwhahaha | but /home/zuul/src/git.o.o/openstack/foo is what paul says | 23:25 |
weshay|ruck | where do you see that | 23:26 |
weshay|ruck | we are looking in /home/zuul | 23:26 |
weshay|ruck | we being ooq | 23:26 |
weshay|ruck | don't see it here http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/zuul-info/host-info.primary.yaml | 23:26 |
mwhahaha | it was looking in /opt/stack | 23:26 |
mwhahaha | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_40_50_686741 | 23:27 |
mwhahaha | we'r enot looking in /home/zuul/src | 23:27 |
weshay|ruck | ya.. just /home/zuul afaict | 23:27 |
mwhahaha | http://logs.openstack.org/39/523539/6/gate/tripleo-ci-centos-7-containers-multinode/6cfadbc/job-output.txt.gz#_2017-12-07_20_12_13_887081 | 23:27 |
*** yamahata has quit IRC | 23:29 | |
weshay|ruck | mwhahaha, so if the roles tries to rebase and there's a conflict.. is it ok to fail? | 23:30 |
mwhahaha | it shouldn't have to rebase | 23:30 |
mwhahaha | because it should use the local copy in this instance | 23:30 |
weshay|ruck | well.. ya.. just thinking about both cases | 23:31 |
mwhahaha | you'd probably want to fail | 23:31 |
mwhahaha | because that means a dependant change is no good | 23:31 |
mwhahaha | it would be in merge conflict or something | 23:31 |
mwhahaha | would be better to fail with a giant error indicate merge conflict | 23:31 |
pabelanger | is there a brief description of the issue you're working through? | 23:32 |
weshay|ruck | hrm.. the ansible git module should "update" If no, do not retrieve new revisions from the origin repository | 23:32 |
weshay|ruck | by default it's yes | 23:32 |
weshay|ruck | pabelanger, I know right :) | 23:32 |
mwhahaha | pabelanger: we got a gate failure, due to packages being built by dlrn that were using older versions of code | 23:32 |
mwhahaha | pabelanger: because we weren't using the local zuul provided repo, and we just cloned the change down to build the package | 23:32 |
pabelanger | okay, and dlrn is still trying to git clone things right? | 23:32 |
mwhahaha | pabelanger: it's quickstart doing the preping | 23:33 |
mwhahaha | but yea | 23:33 |
pabelanger | yah, I was just going to say that | 23:33 |
mwhahaha | we're still using /opt/stack/new | 23:33 |
mwhahaha | to look for shit | 23:33 |
mwhahaha | so the bug is we need to fixup the artg_repos_dir in quickstart to be correct | 23:33 |
mwhahaha | and for quickstart in general to accept a patch but rebase it on top of current head if it has to build | 23:34 |
pabelanger | cool, yah. I think the fix is to also stop dlrn role from trying to git clone external git repos now. zuulv3 will put everything in place in the right reference too. But, I can see why you want to keep that for non zuul things | 23:34 |
*** lblanchard has quit IRC | 23:34 | |
mwhahaha | https://github.com/openstack-infra/tripleo-ci/blob/bd485839781734fcd543321bd3312834ad6d5e8e/toci-quickstart/playbooks/multinode.yml#L44 | 23:35 |
mwhahaha | we're setting where to look for packages to the tripleo_root | 23:36 |
mwhahaha | if i remember corectly somewhere we're actually copying stuff into the tripleo_root to build | 23:36 |
weshay|ruck | https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/playbooks/multinode.yml#L44 | 23:36 |
mwhahaha | which is why primary packages get the local dir | 23:36 |
weshay|ruck | artg_repos_dir: "{{ tripleo_root }}" | 23:36 |
mwhahaha | but the ancillary ones get git cloned | 23:36 |
mwhahaha | artg_repos_dir: /home/zuul/git.openstack.org/openstack | 23:37 |
pabelanger | I also think you could avoid this git clone too: http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/build-test-packages/tasks/dlrn-build.yml#n58 but I think that is just to setup directory structure for DLRN | 23:37 |
mwhahaha | i think is the correct one | 23:37 |
*** liverpooler has quit IRC | 23:37 | |
weshay|ruck | mwhahaha, you putting in that change or shall I? | 23:37 |
mwhahaha | pabelanger: that's what we're hitting | 23:37 |
mwhahaha | weshay|ruck: you can | 23:38 |
weshay|ruck | k | 23:38 |
weshay|ruck | myoung|rover, FYI ^ if you weren't previously confused.. this one is fun | 23:38 |
weshay|ruck | :) | 23:38 |
pabelanger | mwhahaha: yah, just trying to understand why it still git clones, from the local filesystem. I guess it is the way DLRN/data is created? Couldn't you have DLRN lookinto /home/zuul/src/git.o.o/openstack now? | 23:39 |
mwhahaha | pabelanger: yea that's what we're fixing | 23:39 |
mwhahaha | pabelanger: because it should already have all of that | 23:39 |
pabelanger | kk | 23:39 |
mwhahaha | pabelanger: the reason to keep that block is for running something locally with ZUUL_CHANGES to mock out the CI stuff | 23:39 |
pabelanger | then I think we are on same page :) | 23:39 |
mwhahaha | where we don't have zuul cloner to prep stuff or whatever | 23:39 |
mwhahaha | the bug here is that we're 1) cloning stuff and 2) it's old and not rebased | 23:40 |
mwhahaha | we shouldn't need to clone anything in ci that's local to openstack | 23:40 |
*** jkilpatr has joined #tripleo | 23:40 | |
pabelanger | mwhahaha: right, just keep in mind ZUUL_CHANGES is v2 thing, and not native v3. We only have it right now due to legacy job reasons, so I'd not depend on it for much longer | 23:40 |
pabelanger | should be able to get all the info via inventory an zuul.projects now | 23:41 |
pabelanger | now I run away, good luck | 23:41 |
mwhahaha | yea all this stuff needs some <3 | 23:41 |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: update zuul cloned repo directory for zuulv3 https://review.openstack.org/526546 | 23:43 |
weshay|ruck | pabelanger, thanks man | 23:43 |
openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: update zuul cloned repo directory for zuulv3 https://review.openstack.org/526546 | 23:44 |
*** ffiore has quit IRC | 23:48 | |
*** ffiore has joined #tripleo | 23:50 | |
*** bfournie has joined #tripleo | 23:52 | |
*** ffiore has quit IRC | 23:53 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: DNM, update the regex used to copy cloned repos https://review.openstack.org/526547 | 23:53 |
*** threestrands has quit IRC | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!