| EmilienM | dsneddon: I just sent an update on OOO ML about rabbitmq/ipv6 issue | 00:00 |
|---|---|---|
| EmilienM | it should be fixed by now. | 00:00 |
| *** xinwu has quit IRC | 00:00 | |
| dsneddon | EmilienM, Great news, thanks! | 00:02 |
| EmilienM | dsneddon: can you test again please? | 00:02 |
| dsneddon | EmilienM, Is everything merged to master, or do I need to cherry-pick a patch to test? | 00:02 |
| EmilienM | dsneddon: yeah : | 00:03 |
| EmilienM | * https://github.com/puppetlabs/puppetlabs-stdlib/pull/577 | 00:03 |
| EmilienM | * https://github.com/puppetlabs/puppetlabs-rabbitmq/pull/443 | 00:03 |
| EmilienM | and run puppet | 00:03 |
| EmilienM | curl should work now, please read commit messages to see what I did. | 00:03 |
| dsneddon | EmilienM, OK, I don't know how to pull patches from Github, though, so I'll have to figure that out | 00:04 |
| *** xinwu has joined #tripleo | 00:04 | |
| dsneddon | EmilienM, Wait, I'm confused. Both these patches say "merged to master". Are these not automatically picked up in new Delorean packages or not? | 00:06 |
| openstackgerrit | Merged openstack/diskimage-builder: Don't cache debootstrap rootfs by default https://review.openstack.org/280536 | 00:06 |
| *** xinwu has quit IRC | 00:07 | |
| *** xinwu has joined #tripleo | 00:07 | |
| EmilienM | dsneddon: sync are done manually in opm | 00:08 |
| EmilienM | delorean is not yet fully in place yet | 00:08 |
| dsneddon | EmilienM, So are there instructions for testing patches before they merge, or should I wait for OPM packages to be manually built? | 00:08 |
| EmilienM | jayg|g0n3 should build OPM master tomorrow | 00:09 |
| *** ianw has quit IRC | 00:10 | |
| *** thrash is now known as thrash|g0ne | 00:12 | |
| *** xinwu has quit IRC | 00:12 | |
| *** xinwu has joined #tripleo | 00:12 | |
| EmilienM | michchap: sounds like CI is broken I see your patch failing. https://review.openstack.org/#/c/292712/ | 00:20 |
| *** xinwu has quit IRC | 00:20 | |
| *** dmacpher has quit IRC | 00:21 | |
| EmilienM | looks like all is failing omg | 00:22 |
| *** openstack has joined #tripleo | 00:24 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add testing for the Gentoo element https://review.openstack.org/290894 | 00:34 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks https://review.openstack.org/291393 | 00:45 |
| *** afazekas has quit IRC | 00:53 | |
| *** afazekas has joined #tripleo | 00:59 | |
| *** shivrao has quit IRC | 01:06 | |
| *** david-lyle has joined #tripleo | 01:06 | |
| *** dmacpher has joined #tripleo | 01:11 | |
| *** afazekas has quit IRC | 01:25 | |
| *** afazekas has joined #tripleo | 01:28 | |
| *** ebalduf has quit IRC | 01:32 | |
| *** panda has quit IRC | 01:40 | |
| *** panda has joined #tripleo | 01:40 | |
| *** shivrao has joined #tripleo | 01:49 | |
| *** yamahata has joined #tripleo | 01:52 | |
| *** mannidi_ has joined #tripleo | 01:59 | |
| *** yamahata has quit IRC | 02:21 | |
| *** yamahata has joined #tripleo | 02:29 | |
| *** shivrao has quit IRC | 02:34 | |
| EmilienM | dsneddon: you around? re ipv6 | 02:34 |
| *** xinwu has joined #tripleo | 02:35 | |
| *** xinwu has quit IRC | 02:36 | |
| *** TSCHAK_ has joined #tripleo | 02:39 | |
| *** yamahata has quit IRC | 02:39 | |
| *** TSCHAK has quit IRC | 02:42 | |
| *** rhallisey has quit IRC | 02:45 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-docs: First documentation for Operational tools https://review.openstack.org/265271 | 02:55 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-docs: Extend the root device selection documentation https://review.openstack.org/290492 | 02:59 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Test Keystone hooks support - do not merge https://review.openstack.org/293203 | 02:59 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-docs: Extend the root device selection documentation https://review.openstack.org/290492 | 03:02 |
| *** shivrao has joined #tripleo | 03:04 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-docs: Add MidoNet documentation in advanced deployment https://review.openstack.org/270320 | 03:05 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/tripleo-docs: Docs for containerized compute node https://review.openstack.org/254743 | 03:08 |
| *** yuanying has quit IRC | 03:20 | |
| *** TSCHAK has joined #tripleo | 03:25 | |
| *** TSCHAK_ has quit IRC | 03:27 | |
| *** morazi has quit IRC | 03:32 | |
| *** xinwu has joined #tripleo | 03:38 | |
| ayoung | EmilienM, lets say I wanted to create multiple Rabbit users, say one per compute node, instead of having all services use the default. I would want to make a change here: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller.yaml#L1617 to add the additional users. | 03:39 |
| ayoung | EmilienM, https://github.com/puppetlabs/puppetlabs-rabbitmq#rabbitmq_user-1 seems to be...poorly written? | 03:40 |
| ayoung | wouildn't I use that to create a user? | 03:40 |
| ayoung | rabbitmq_user { 'overcloud-compute-0': | 03:41 |
| ayoung | admin => false, | 03:41 |
| ayoung | password => {get_input: overcloud-compute-0-password}, | 03:41 |
| ayoung | } | 03:41 |
| *** ayoung is now known as ayoung_Zzz__ | 04:01 | |
| *** yuanying has joined #tripleo | 04:07 | |
| *** links has joined #tripleo | 04:10 | |
| *** ayoung_Zzz__ has quit IRC | 04:12 | |
| *** TSCHAK_ has joined #tripleo | 04:24 | |
| *** TSCHAK has quit IRC | 04:27 | |
| *** akuznetsov has joined #tripleo | 04:35 | |
| *** mannidi_ has quit IRC | 04:38 | |
| *** akuznetsov has quit IRC | 04:40 | |
| *** masco has joined #tripleo | 04:41 | |
| *** akuznetsov has joined #tripleo | 05:05 | |
| *** yamahata has joined #tripleo | 05:07 | |
| *** Goneri has quit IRC | 05:25 | |
| *** oshvartz has quit IRC | 05:33 | |
| *** panda has quit IRC | 05:40 | |
| *** panda has joined #tripleo | 05:41 | |
| *** david-lyle has quit IRC | 05:45 | |
| *** david-lyle has joined #tripleo | 05:46 | |
| *** akuznetsov has quit IRC | 05:47 | |
| *** akuznetsov has joined #tripleo | 05:48 | |
| *** jdob has quit IRC | 05:50 | |
| *** tzumainn has quit IRC | 05:53 | |
| *** rwsu has quit IRC | 05:58 | |
| *** liverpooler has quit IRC | 05:59 | |
| *** ccamacho has quit IRC | 06:05 | |
| *** ccamacho has joined #tripleo | 06:08 | |
| *** aufi has joined #tripleo | 06:10 | |
| *** rwsu has joined #tripleo | 06:11 | |
| *** saneax_AFK is now known as saneax | 06:17 | |
| *** akuznetsov has quit IRC | 06:22 | |
| *** shivrao has quit IRC | 06:26 | |
| *** jtomasek has joined #tripleo | 06:36 | |
| *** shivrao has joined #tripleo | 06:36 | |
| *** dmacpher has quit IRC | 06:43 | |
| *** akuznetsov has joined #tripleo | 06:45 | |
| *** oshvartz has joined #tripleo | 06:56 | |
| *** shivrao_ has joined #tripleo | 07:02 | |
| *** shivrao has quit IRC | 07:05 | |
| *** shivrao_ is now known as shivrao | 07:05 | |
| *** tesseract has joined #tripleo | 07:16 | |
| *** tesseract is now known as Guest64967 | 07:17 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/puppet-tripleo: Fix typo https://review.openstack.org/293281 | 07:17 |
| *** jaosorior has joined #tripleo | 07:18 | |
| jaosorior | dsneddnon: Still awake? | 07:18 |
| *** jdob has joined #tripleo | 07:19 | |
| *** Guest64967 has quit IRC | 07:21 | |
| *** shivrao has quit IRC | 07:23 | |
| *** akuznetsov has quit IRC | 07:23 | |
| *** Marga_ has quit IRC | 07:25 | |
| *** leanderthal|afk is now known as leanderthal | 07:25 | |
| *** akuznetsov has joined #tripleo | 07:33 | |
| *** tesseract- has joined #tripleo | 07:35 | |
| *** akuznetsov has quit IRC | 07:37 | |
| *** dshulyak has joined #tripleo | 07:38 | |
| *** Marga_ has joined #tripleo | 07:38 | |
| *** Marga_ has quit IRC | 07:41 | |
| *** Marga_ has joined #tripleo | 07:41 | |
| *** Marga_ has quit IRC | 07:42 | |
| *** chlong has quit IRC | 07:42 | |
| *** Marga_ has joined #tripleo | 07:43 | |
| *** liverpooler has joined #tripleo | 07:49 | |
| *** bvandenh has joined #tripleo | 07:55 | |
| *** mkovacik has joined #tripleo | 07:57 | |
| *** jprovazn has joined #tripleo | 08:01 | |
| *** social has quit IRC | 08:04 | |
| *** liverpooler has quit IRC | 08:14 | |
| *** liverpooler has joined #tripleo | 08:14 | |
| *** paramite has joined #tripleo | 08:20 | |
| *** mikelk has joined #tripleo | 08:21 | |
| *** kbyrne has joined #tripleo | 08:22 | |
| *** Erming_ has quit IRC | 08:26 | |
| *** Erming_ has joined #tripleo | 08:27 | |
| *** yamahata has quit IRC | 08:33 | |
| *** akuznetsov has joined #tripleo | 08:34 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-docs: Deploy and Scale Swift https://review.openstack.org/293311 | 08:34 |
| *** olap has joined #tripleo | 08:37 | |
| *** akuznetsov has quit IRC | 08:38 | |
| *** jpena|off is now known as jpena | 08:50 | |
| *** ohamada has joined #tripleo | 08:58 | |
| *** nijaba has quit IRC | 09:05 | |
| *** social has joined #tripleo | 09:05 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/python-tripleoclient: Pass RabbitMQ's user and password from the client https://review.openstack.org/293327 | 09:07 |
| *** ifarkas has joined #tripleo | 09:07 | |
| *** mbound has joined #tripleo | 09:10 | |
| *** nijaba has joined #tripleo | 09:11 | |
| *** nijaba has quit IRC | 09:11 | |
| *** nijaba has joined #tripleo | 09:11 | |
| *** akuznetsov has joined #tripleo | 09:22 | |
| *** jistr has joined #tripleo | 09:24 | |
| *** xinwu has quit IRC | 09:32 | |
| *** derekh has joined #tripleo | 09:34 | |
| *** trown has joined #tripleo | 09:38 | |
| *** lucas-dinner is now known as lucasagomes | 09:38 | |
| *** panda has quit IRC | 09:40 | |
| *** panda has joined #tripleo | 09:41 | |
| *** akuznetsov has quit IRC | 09:41 | |
| jaosorior | jistr: as part of the update scripts is rabbitmq restarted too? | 09:41 |
| jistr | jaosorior: yeah on stack-update, currently rabbitmq should be restarted too | 09:42 |
| jaosorior | do I have to do something specific to do that? | 09:42 |
| *** dtantsur|afk is now known as dtantsur | 09:42 | |
| jaosorior | I tried changing the user and password for rabbitmq in my overcloud and it all went boom | 09:43 |
| jaosorior | had to restart rabbit manually from pacemaker | 09:43 |
| jaosorior | jistr ^^ | 09:45 |
| *** mannidi has joined #tripleo | 09:46 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove defaults for the RabbitMQ credentials https://review.openstack.org/293344 | 09:50 |
| *** openstackgerrit has quit IRC | 09:53 | |
| *** openstackgerrit_ is now known as openstackgerrit | 09:53 | |
| *** openstackgerrit has quit IRC | 09:53 | |
| *** openstackgerrit_ has joined #tripleo | 09:53 | |
| *** openstackgerrit_ is now known as openstackgerrit | 09:54 | |
| *** openstackgerrit_ has joined #tripleo | 09:55 | |
| *** openstackgerrit has quit IRC | 09:55 | |
| *** openstackgerrit has joined #tripleo | 09:56 | |
| *** paramite has quit IRC | 09:56 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/instack-undercloud: Use installed tempest version https://review.openstack.org/293101 | 10:05 |
| *** gfidente has joined #tripleo | 10:13 | |
| *** gfidente has quit IRC | 10:13 | |
| *** gfidente has joined #tripleo | 10:13 | |
| *** electrofelix has joined #tripleo | 10:15 | |
| *** rhallisey has joined #tripleo | 10:31 | |
| *** ohamada has quit IRC | 10:31 | |
| *** ohamada_ has joined #tripleo | 10:31 | |
| rasca | thrash|g0ne, jistr, using repos from tripleo.sh --repo-setup I was able to introspect the nodes, but as you can see from here http://pastebin.test.redhat.com/357108 for some reason the overcloud deploy script seems to not be able to use any of the introspected nodes, even if they have the tag "baremetal" | 10:34 |
| rasca | any suggestion? | 10:34 |
| chem | he, I've updated/fixed the patch from EmilienM to rabbitmq: https://github.com/puppetlabs/puppetlabs-rabbitmq/pull/444 | 10:38 |
| chem | this should work ok now | 10:39 |
| *** leanderthal has quit IRC | 10:39 | |
| *** mgould has joined #tripleo | 10:40 | |
| chem | jpena: if you still have this ipv6 env around could you test it with the above patch ? | 10:41 |
| jpena | cheM: i returned it an hour ago, but I can try go get a new one | 10:41 |
| jistr | rasca: dtantsur would you have any idea what could be wrong in rasca's case? it's strange that the state of the machines is `power on`... if they're not used, they should be `power off` i think. rasca are they still `power on` now? | 10:41 |
| chem | jpena: I'm going to try on a an simple rabbitmq host just to check | 10:42 |
| rasca | jistr, dtantsur yes, they are | 10:42 |
| rasca | jistr, dtantsur I can force off them if it helps | 10:42 |
| dtantsur | rasca, jistr, all nodes are in "manageable" state, something probably went wrong | 10:43 |
| dtantsur | rasca, are you sure that introspection has finished? | 10:43 |
| *** mannidi_ has joined #tripleo | 10:44 | |
| rasca | dtantsur, jistr since the output is this one http://pastebin.test.redhat.com/357112 even if it says completed, then I suppose as you are saying that something went wrong | 10:45 |
| *** akrivoka has joined #tripleo | 10:46 | |
| dtantsur | "Introspection didn't finish for nodes 018615be-c97b-4961-974b-eb4b74c94500,1adc844a-0f30-4f81-aa42-746f72f403ca,a3462a84-cb93-42b7-aad0-d01187a0dc15,f1a39823-c9b0-470a-8260-8e2cb855bdb2" | 10:46 |
| dtantsur | hmm hmm | 10:46 |
| *** mannidi has quit IRC | 10:48 | |
| *** paramite has joined #tripleo | 10:53 | |
| jaosorior | gfidente: Hey dude, got time to check this out? https://review.openstack.org/#/c/292799/ | 10:55 |
| rasca | dtantsur, I'm trying to run it again | 10:57 |
| rasca | just in case | 10:57 |
| derekh | adarazs: the manaul job I kicked off last night failed due to some error installing a crypto package , I'm kicking it off again | 10:59 |
| adarazs | derekh: thanks! | 10:59 |
| derekh | adarazs: send me a public key and I'll add it to the instance | 10:59 |
| adarazs | derekh: btw can you show me how you do this reproducing? | 10:59 |
| adarazs | derekh: https://github.com/adarazs.keys | 10:59 |
| derekh | adarazs: ssh fedora@66.187.229.58 | 11:00 |
| *** tosky has joined #tripleo | 11:01 | |
| derekh | adarazs: I can't should you as only 3 of us have that access to the cloud to do it | 11:01 |
| derekh | adarazs: sorry, use jenkins user | 11:02 |
| derekh | adarazs: not fedora | 11:02 |
| adarazs | derekh: just wanted to say it doesn't work :) | 11:02 |
| derekh | adarazs: then screen -x , switch to tab 3, thats where the ci command is running | 11:02 |
| derekh | adarazs: tab 4 is on the undercloud, but that only being set up at the moment, it should be an actual undercloud in 20 minutes or so | 11:03 |
| adarazs | derekh: ack, I'm there. thanks | 11:04 |
| derekh | No failed jobs since midnight, crazy http://tripleo.org/cistatus.html | 11:05 |
| chem | jpena: just in case I have updated the code to include all the functions so the patch from stdlib is not required (it brokes the standard case where you do not have puppetlab-stdlib > 4.11.0 - which doesn't exist yet) | 11:05 |
| jpena | chem: ack. Just to be sure, I should test this against master, right? | 11:07 |
| chem | jpena:yep | 11:07 |
| rasca | dtantsur, well I think introspection has got some problems | 11:08 |
| rasca | dtantsur, it takes too long to complete | 11:08 |
| dtantsur | rasca, maybe something here will help: http://docs.openstack.org/developer/ironic-inspector/troubleshooting.html#introspection-times-out | 11:09 |
| *** trown is now known as trown|relocate | 11:12 | |
| rasca | dtantsur, http://pastebin.test.redhat.com/357119 something seems broke here | 11:13 |
| rasca | dtantsur, note that with ospd7 or 8 introspection is working | 11:14 |
| *** openstackgerrit has quit IRC | 11:18 | |
| *** openstackgerrit has joined #tripleo | 11:18 | |
| chem | jpena: I think it won't works, the management service is listening on the ipv4 address the ip_node_address is not taken into account for management service | 11:18 |
| chem | jpena: the curl code is fixed, but the management service is still listening on a ipv4 address (as it has always did) | 11:19 |
| chem | EmilienM:^ | 11:19 |
| jpena | chem EmilienM: wasn't that fixed in RHEL? | 11:19 |
| chem | jpena: dunno, I'm using full upstream code here, do you have a pointer ? | 11:20 |
| chem | jpena:on a simple rabbitmq one node install | 11:20 |
| jpena | chem: let me check, I think it was something in the rabbitmq package itself | 11:20 |
| chem | jpena: that would be sweet :) | 11:22 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 11:22 |
| jpena | chem: https://bugzilla.redhat.com/show_bug.cgi?id=1299214 | 11:23 |
| openstack | bugzilla.redhat.com bug 1299214 in rabbitmq-server "Cannot deploy rabbit in an ipv6 environment" [Urgent,Closed: errata] - Assigned to jeckersb | 11:23 |
| chem | jpena: not sure, have to be tested, here the rabbitmq server is properly listening on ipv6 but it's only the management server, port 15672 which is still listening on ipv4 | 11:25 |
| jpena | chem: that was part of the problem. The management server didn't listen on ipv6, so the cluster didn't form | 11:25 |
| chem | jpena: oki, do you know where I can pull the right version of the rabbitmq server then ? | 11:26 |
| *** bvandenh has quit IRC | 11:34 | |
| *** weshay has joined #tripleo | 11:34 | |
| *** olap has quit IRC | 11:34 | |
| *** dtantsur is now known as dtantsur|brb | 11:34 | |
| *** olap has joined #tripleo | 11:36 | |
| *** dshulyak has quit IRC | 11:46 | |
| *** veteran has joined #tripleo | 11:49 | |
| tosky | on RDO Mitaka snapshot from last week I tried to run Sahara scenario tests with the demo tenant; Sahara uses heat, and demo seems to be configured properly, but then in the logs I see | 11:52 |
| tosky | Forbidden: You are not authorized to perform the requested action: identity:list_roles (HTTP 403) | 11:52 |
| tosky | full log: http://paste.openstack.org/show/490683/ | 11:52 |
| tosky | is it something that should have been set by TripleO? | 11:53 |
| EmilienM | derekh: failures are related to puppet or not? | 11:54 |
| EmilienM | derekh: we changed something in puppetlabs-rabbitmq | 11:54 |
| EmilienM | but should not break | 11:54 |
| derekh | EmilienM: which failures? | 11:54 |
| EmilienM | derekh: tripleo CI was failing last night but before my work on puppet rabbitmq | 11:55 |
| derekh | EmilienM: they were all failing trying to install python2-pyasn1 , don't know why but its ok again now | 11:56 |
| EmilienM | derekh: ok :) | 11:56 |
| EmilienM | sorry for noise | 11:56 |
| derekh | EmilienM: np | 11:56 |
| *** dtantsur|brb is now known as dtantsur | 12:01 | |
| adarazs | derekh: hm, so the run failed. what's weird is that the OS_AUTH_URL is not IPv6. I think that should be ipv6 on normal full ipv6 deployment. at least it was on ospd7, not sure how it was implemented in tripleo now. | 12:06 |
| *** jaosorior has quit IRC | 12:08 | |
| derekh | adarazs: are you able to confirm It actually tried to do a IPv6 installation, i.e. did a screw something up? | 12:09 |
| adarazs | derekh: looking. | 12:09 |
| adarazs | derekh: oh wait, never mind, that last printout was from the stackrc, that is supposed to have an IPv4 auth_url | 12:10 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Set default locale to image in ubuntu-minimal https://review.openstack.org/290789 | 12:10 |
| *** jaosorior has joined #tripleo | 12:11 | |
| adarazs | derekh: but the error seems to be "/tmp/tripleo-ci/scripts/deploy.sh: line 112: /home/stack/overcloudrc: No such file or directory" -- maybe creating the overcloudrc somehow fails when the addresses are ipv6, I'll look into the script. | 12:11 |
| adarazs | I'll just go out to grab some lunch before. | 12:11 |
| derekh | adarazs: I can't see logs for the puppet run, Keepalived_vrrp is going crazy on the overcloud controller and the logsd have rotaded out | 12:11 |
| *** adarazs is now known as adarazs_lunch | 12:11 | |
| derekh | adarazs_lunch: ok, don't worry about the overcloudrc error, this is the real error | 12:12 |
| derekh | Stack overcloud CREATE_FAILED | | 12:12 |
| derekh | the rest is what happen when the ci job tried to collect logs | 12:12 |
| adarazs_lunch | derekh: you're right. I assumed it will pass because it passed in the gate job | 12:12 |
| *** olap has quit IRC | 12:13 | |
| adarazs_lunch | derekh: hm, it died at step 2 with code 6, that's more consistent with the non-pacemaker job. which gate did you recreate? the nonha or the ceph? | 12:13 |
| derekh | adarazs_lunch: anyways grab lunch, I think what we need to find out is why Keepalived_vrrp is looping | 12:13 |
| adarazs_lunch | derekh: the ceph (where I didn't enable pacemaker) has a known bug with rabbitmq. | 12:14 |
| adarazs_lunch | the ha and nonha should be the ones to look at while EmilienM is trying to fix the puppet stuff for the non-pacemaker case | 12:14 |
| derekh | adarazs_lunch: ok, that was a ceph job, gonna kick of the nonha one | 12:15 |
| *** olap has joined #tripleo | 12:15 | |
| adarazs_lunch | derekh: thanks! | 12:15 |
| *** miles has joined #tripleo | 12:15 | |
| adarazs_lunch | bbiab | 12:15 |
| *** jayg|g0n3 is now known as jayg | 12:17 | |
| *** mgould has quit IRC | 12:18 | |
| openstackgerrit | Christopher Brown proposed openstack/os-net-config: Use interface operstate to determine nic status https://review.openstack.org/291243 | 12:19 |
| tosky | ifarkas: ping generated deployer-input file, who is writing it, or better, which component should I file a bug against if I need to extend the information written there? (Sahara plugin list) | 12:22 |
| ifarkas | tosky, tripleoclient | 12:23 |
| tosky | ifarkas: thanks | 12:23 |
| ifarkas | tosky, https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L127 | 12:24 |
| *** rain has joined #tripleo | 12:24 | |
| *** rain is now known as Guest97758 | 12:24 | |
| *** Guest97758 is now known as leanderthal | 12:24 | |
| tosky | ifarkas: I see that the values there are hardcoded, wouldn't it make sense to move it to a file? Or is it like that to allow future expansions with values that are dynamically computed? | 12:26 |
| *** rodrigods has quit IRC | 12:26 | |
| *** rodrigods has joined #tripleo | 12:26 | |
| *** thrash|g0ne is now known as thrash | 12:27 | |
| ifarkas | tosky, yeah, that's done this exactly for that reason. we might need to compute more stuff | 12:27 |
| *** colonwq has joined #tripleo | 12:28 | |
| *** pcaruana has quit IRC | 12:28 | |
| tosky | ifarkas: so, I'd like to have the set of default sahara plugins (which depends on the version) set there, but I'm not sure how to compute that; | 12:29 |
| tosky | ifarkas: given that the set is stable per-version, and the release is close, can I just submit a review with an hardcoded list? | 12:29 |
| ifarkas | tosky, yeah, I think the only thing you need to check is if sahara is enabled or not | 12:31 |
| ifarkas | but a hardcoded list if fine | 12:31 |
| tosky | ifarkas: but I don't need to do that, the autodiscovery takes care of it | 12:31 |
| ifarkas | tosky, the you don't need to touch the deployer-info file at all, right? | 12:32 |
| tosky | ifarkas: the autodiscovery doesn't cover that | 12:33 |
| tosky | ifarkas: let's put it this way: if that list of plugin is set, and sahara = False, the tests for Sahara are skipped anyway, so no harm | 12:33 |
| tosky | if the list is set, and sahara = True, the tests have the proper input | 12:33 |
| ifarkas | tosky, yeah, that makes sense | 12:34 |
| jaosorior | d0ugal: Are you around? | 12:34 |
| *** trown|relocate is now known as trown | 12:35 | |
| *** lucasagomes is now known as lucas-hungry | 12:35 | |
| d0ugal | jaosorior: Yup! | 12:39 |
| *** thrash has quit IRC | 12:40 | |
| *** rdopiera has joined #tripleo | 12:40 | |
| *** dshulyak has joined #tripleo | 12:43 | |
| *** ramishra has quit IRC | 12:43 | |
| *** rabi has joined #tripleo | 12:44 | |
| *** thrash has joined #tripleo | 12:44 | |
| *** thrash has joined #tripleo | 12:44 | |
| jaosorior | d0ugal: Hey dude, I remember you reviewing some python-tripleoclient code, got some time to check this out? https://review.openstack.org/#/c/293344/ | 12:44 |
| jaosorior | d0ugal: For a strange reason I cannot add you directly to a review :/ | 12:44 |
| *** adarazs_lunch is now known as adarazs | 12:44 | |
| d0ugal | jaosorior: My gerrit account is slightly broken, that hasn't worked for some time now. | 12:44 |
| d0ugal | but yeah, I can do a review now. | 12:44 |
| dtantsur | shadower, hi! please see my responses on https://review.openstack.org/#/c/291723/ | 12:45 |
| d0ugal | jaosorior: Have you seen the most recent comment? Sounds like there might be an issue with it? | 12:46 |
| *** rabi is now known as ramishra | 12:46 | |
| jaosorior | d0ugal: Hadn't seen it | 12:47 |
| d0ugal | jaosorior: Also, that is t-h-t not tripleoclient, I am less useful on that repo :) | 12:47 |
| d0ugal | jaosorior: Did you mean to link this one? https://review.openstack.org/#/c/293327/ | 12:47 |
| thrash | jaosorior: d0ugal that comment on the tht patch is probably because they did not have the tripleoclient patch | 12:48 |
| jaosorior | d0ugal: haha sorry, I meant to pass you the tripleoclient patch | 12:48 |
| *** dweaver has joined #tripleo | 12:48 | |
| jaosorior | thrash: And that is the case | 12:48 |
| d0ugal | jaosorior, thrash - k, I'll review https://review.openstack.org/#/c/293327/ | 12:48 |
| thrash | jaosorior: quick comment tho... I don't like the username being mixed in with the passwords. | 12:48 |
| jaosorior | thrash: I don't either, but it's the easier way I found to do it. Any other ideas? | 12:48 |
| thrash | jaosorior: for one thing, it's going to get generated as a long hash. | 12:49 |
| jaosorior | thrash: That's already the case for the rabbitmq userid of the undercloud | 12:49 |
| thrash | jaosorior: if it isn't specified already in the conf file. | 12:49 |
| thrash | jaosorior: is that really something that we want for the overcloud too? | 12:49 |
| *** masco has quit IRC | 12:50 | |
| d0ugal | If we renamed the password generation to random string generation it would make sense :) | 12:50 |
| jaosorior | thrash: I could add an option to specify the user for rabbitmq | 12:50 |
| *** pradk has joined #tripleo | 12:51 | |
| jaosorior | d0ugal: or random credential generation :P | 12:52 |
| d0ugal | heh, true | 12:52 |
| thrash | jaosorior: I may be out of bounds here, but I think a sane default for the user should be in the templates. | 12:52 |
| d0ugal | thrash: I think I agree, we want less in the CLI, not more. | 12:52 |
| thrash | I'm certainly ok with the password, as that's a security thing. | 12:53 |
| jaosorior | thrash, d0ugal: Would it be OK then if I leave the default user, but leave the password there? | 12:53 |
| *** Goneri has joined #tripleo | 12:53 | |
| jaosorior | alright | 12:53 |
| d0ugal | +1 | 12:53 |
| thrash | jaosorior: that's what I'm thinking. | 12:53 |
| *** jprovazn has quit IRC | 12:53 | |
| jaosorior | thrash, d0ugal: Alright, lets do that then | 12:53 |
| thrash | jaosorior: ack | 12:53 |
| thrash | d0ugal: https://review.openstack.org/#/c/288744/ ci passed. +2 it quick! | 12:53 |
| thrash | :D | 12:53 |
| thrash | d0ugal: and a backport: https://review.openstack.org/#/c/292471/ | 12:54 |
| *** jprovazn has joined #tripleo | 12:55 | |
| d0ugal | thrash: done :) | 12:55 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/python-tripleoclient: Pass RabbitMQ's password from the client https://review.openstack.org/293327 | 12:57 |
| shadower | dtantsur: I'll have a look | 12:57 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove default for the RabbitMQ password https://review.openstack.org/293344 | 12:58 |
| *** Goneri has quit IRC | 12:59 | |
| *** Goneri has joined #tripleo | 13:00 | |
| *** tzumainn has joined #tripleo | 13:00 | |
| *** tzumainn has quit IRC | 13:00 | |
| *** tzumainn has joined #tripleo | 13:01 | |
| *** dprince has joined #tripleo | 13:02 | |
| *** rcernin has joined #tripleo | 13:03 | |
| *** morazi has joined #tripleo | 13:03 | |
| *** rbrady has joined #tripleo | 13:06 | |
| adarazs | derekh: do you know why the job stopped here after --overcloud-deploy/ | 13:08 |
| adarazs | ? | 13:08 |
| derekh | Must be a problem with OVERCLOUD_DEPLOY_ARGS , one of the files might be missing | 13:09 |
| derekh | adarazs: ^ | 13:09 |
| openstackgerrit | Michele Baldessari proposed openstack/python-tripleoclient: Clarify error when a template is missing https://review.openstack.org/293143 | 13:10 |
| adarazs | derekh: that net-iso.yaml should be copied there by one of the scripts. I think deploy.sh | 13:10 |
| derekh | adarazs: checking on tasb 4 | 13:11 |
| adarazs | derekh: https://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack.sh#L68 this line should copy it | 13:12 |
| chem | EmilienM: the other patch to puppetlab-rabitmq required to have this stuff working https://github.com/puppetlabs/puppetlabs-rabbitmq/pull/445 | 13:14 |
| chem | jpena ^ | 13:14 |
| openstackgerrit | Merged openstack/python-tripleoclient: Add 'undercloud upgrade' command https://review.openstack.org/292471 | 13:15 |
| *** akuznetsov has joined #tripleo | 13:16 | |
| derekh | adarazs: that line is for another script, this is the line that copies the whole tripleo-ci repo into /tmp on the undercloud | 13:17 |
| derekh | adarazs: https://github.com/openstack-infra/tripleo-ci/blob/master/toci_instack.sh#L186 | 13:17 |
| *** morazi has quit IRC | 13:17 | |
| derekh | adarazs: I think the problem is that the patch us wrong | 13:17 |
| derekh | adarazs: should be /tmp/tripleo-ci/test-environments/net-iso.yaml | 13:17 |
| *** pino|work has quit IRC | 13:17 | |
| derekh | adarazs: will update and kick it off again | 13:18 |
| *** mannidi_ has quit IRC | 13:18 | |
| EmilienM | chem: ok, reviewing 445 first | 13:18 |
| *** jdob has quit IRC | 13:18 | |
| *** bvandenh has joined #tripleo | 13:19 | |
| *** jdob has joined #tripleo | 13:19 | |
| chem | EmilienM: ack | 13:19 |
| *** lblanchard has joined #tripleo | 13:19 | |
| adarazs | derekh: hmmm, yeah, this has been recently changed :/ | 13:19 |
| adarazs | derekh: it was the right path until a few days ago | 13:20 |
| adarazs | I'll update the change | 13:21 |
| derekh | adarazs: yup, ok its off again, bbiab | 13:21 |
| derekh | ok | 13:21 |
| chem | EmilienM: updated 444 | 13:22 |
| EmilienM | chem: 445 merged | 13:23 |
| *** pino|work has joined #tripleo | 13:23 | |
| chem | EmilienM: nice, reading erb with 3 levels of if is always a pleasure :) | 13:25 |
| EmilienM | chem: 444 merged | 13:25 |
| EmilienM | kicking a OOO job now to check if nothing broke | 13:25 |
| chem | EmilienM: checking in my little set up as well | 13:25 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: CI test - never merge https://review.openstack.org/293422 | 13:25 |
| *** lucas-hungry is now known as lucasagomes | 13:26 | |
| EmilienM | chem: triple checking in puppet openstack CI: https://review.openstack.org/#/c/293186/ | 13:26 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/293423 | 13:26 |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: WIP: Use IPv6 on the gate jobs a test https://review.openstack.org/289445 | 13:27 |
| chem | EmilienM: ack | 13:27 |
| EmilienM | adarazs: all rabbitmq patches are merged now | 13:27 |
| EmilienM | adarazs: let us know if you still hit the issue | 13:28 |
| adarazs | EmilienM: i just pushed a change to the CI job, so we'll probably test with those new changes. | 13:28 |
| EmilienM | excellent | 13:28 |
| adarazs | derekh: the -updates job is the same as the -ceph was before? | 13:29 |
| *** morazi has joined #tripleo | 13:30 | |
| *** jdob has quit IRC | 13:31 | |
| EmilienM | adarazs: it should be | 13:31 |
| *** jdob has joined #tripleo | 13:31 | |
| EmilienM | adarazs: but derekh can confirm | 13:31 |
| EmilienM | I'm aware there is some WIP to test ceph again | 13:32 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/268528 | 13:33 |
| adarazs | yeah, I'm trying to make sure that the changes to the ceph part are actually ran: https://review.openstack.org/#/c/289445/13/toci_gate_test.sh | 13:33 |
| chem | EmilienM: jpena on my little rabbitmq one node test, the rabbitmq_management server is listening on ipv6 and the curl command succeeded using latest git from puppetlab-rabbitmq and puppetlab-stdlib | 13:33 |
| adarazs | (line 54-57) | 13:33 |
| EmilienM | chem: !!! | 13:33 |
| jpena | chem: cool! What happened with the ports (15672 vs 25672)? | 13:33 |
| chem | jpena oki, that's the last unknown, I don't know what is listening on the 25672 | 13:34 |
| chem | jpena but the 15672 is the management server and it's listening on ::1 | 13:34 |
| chem | jpena (i specified ::1 for node_ip_address) | 13:34 |
| jpena | chem: ok, that's fine then I guess | 13:35 |
| *** d0ugal has quit IRC | 13:35 | |
| *** d0ugal has joined #tripleo | 13:35 | |
| *** MaxPC has joined #tripleo | 13:35 | |
| openstackgerrit | Michael Chapman proposed openstack/puppet-tripleo: Add neutron profiles https://review.openstack.org/293436 | 13:37 |
| michchap | EmilienM: ^ haven't done HA ones yet. | 13:37 |
| EmilienM | michchap: excellent. What is the progress on keystone? | 13:37 |
| michchap | EmilienM: I'm going to add param doc which should re-kick verify | 13:38 |
| EmilienM | michchap: other jobs are passing? | 13:38 |
| michchap | EmilienM: is tripleo CI OK now? | 13:39 |
| EmilienM | michchap: yeah should be, see ML | 13:39 |
| chem | jpena: the 25672 port seems to be related to clustering : grep this https://www.rabbitmq.com/clustering.html | 13:39 |
| EmilienM | michchap: and see http://tripleo.org/cistatus.html | 13:39 |
| michchap | EmilienM: ok. The first error on HA was because I messed up db sync but the second one I think was ci breakage | 13:40 |
| EmilienM | michchap: cool | 13:40 |
| EmilienM | michchap: I'll review it today. And follow-up with Glance, ok? | 13:40 |
| *** bvandenh has quit IRC | 13:40 | |
| *** panda has quit IRC | 13:40 | |
| michchap | EmilienM: yep, cheers | 13:40 |
| chem | jpena: hummm ... but now it's listening on ipv4 | 13:40 |
| chem | jpena: that's insane | 13:41 |
| *** panda has joined #tripleo | 13:41 | |
| jpena | chem: can you send me the bits you are testing, so we can check in parallel? | 13:41 |
| chem | jpena : I'm using this simple manifest http://fpaste.org/340904/81357281 | 13:42 |
| *** shardy has joined #tripleo | 13:42 | |
| chem | on a vm with the puppetlabs-rabbitmq and puppetlabs-stdlib comming from git everything else pulled from a puppet module install | 13:43 |
| jpena | chem: ok, let me give that a try | 13:43 |
| jaosorior | thrash: Just verified that the new changes worked in both ha and non-ha. Can you check again https://review.openstack.org/293344 https://review.openstack.org/293327 ? | 13:48 |
| jaosorior | d0ugal: Thanks for the review dude | 13:48 |
| thrash | jaosorior: sure thing. | 13:48 |
| d0ugal | jaosorior: np | 13:48 |
| jpena | chem: did you get voxpopuli/staging from puppet module install or git? | 13:48 |
| chem | jpena module install | 13:49 |
| *** athomas has quit IRC | 13:51 | |
| thrash | jaosorior: just a nit, but shouldn't the client change depend on the tht change, instead of the other way around? | 13:52 |
| thrash | d0ugal: what do you think? ^^ | 13:52 |
| openstackgerrit | Michael Chapman proposed openstack/puppet-tripleo: Add keystone and db sync profiles https://review.openstack.org/292712 | 13:52 |
| EmilienM | michchap: excellent work on https://review.openstack.org/#/c/293436 | 13:53 |
| jaosorior | thrash: the client change doesn't depend on the t-h-t change. As it can easily work without it. meaning, It'll just overwrite the default value into whatever's given | 13:53 |
| thrash | jaosorior: my thinking is that the tht change can be used without the client changes | 13:53 |
| jaosorior | thrash: On the other hand, the the t-h-t change cannot be used without the client change. Because it would fail saying that the password wasn't given | 13:54 |
| michchap | EmilienM: Thanks. HA is going to be painful I think | 13:54 |
| jpena | chem: I've tested that. About port 25672 listening on IPv4, I was missing RABBITMQ_SERVER_START_ARGS="-proto_dist inet6_tcp" in rabbitmq-env.conf, iirc that's something we can add to the manifest | 13:54 |
| * jpena goes for lunch, will be back in ~1h | 13:54 | |
| EmilienM | michchap: maybe with a deps.pp ? | 13:54 |
| *** jpena is now known as jpena|lunch | 13:54 | |
| thrash | jaosorior: i guess it just depends on how you view it. Obviously we both view it the opposite way. :D | 13:54 |
| jaosorior | lol | 13:54 |
| thrash | like I said, just a nit. :) | 13:54 |
| michchap | EmilienM: deps.pp? | 13:54 |
| EmilienM | chem: btw, I moved the dep from the fork to voxpopuli yesterday | 13:55 |
| chem | jpena ack, you mean in the upstream puppetlab-rabbitmq module, don't you ? | 13:55 |
| *** jprovazn has quit IRC | 13:55 | |
| jaosorior | thrash: Well, thing is, if the t-h-t change doesn't have the depends-on pointing to the client change, it will fail because the rabbitpassword no longer has a default (which is now given by the client) | 13:55 |
| chem | EmilienM: Yep, I've seen :) | 13:55 |
| thrash | jaosorior: good point. | 13:55 |
| EmilienM | michchap: something like in puppet-nova | 13:55 |
| EmilienM | michchap: https://github.com/openstack/puppet-nova/blob/master/manifests/deps.pp | 13:55 |
| thrash | jaosorior: carry on. | 13:55 |
| jaosorior | Actually ccamacho tried it, and had gotten an error when he tested it | 13:55 |
| chem | EmilienM: so you've seen the comment from jpena: we need to have RABBITMQ_SERVER_START_ARGS="-proto_dist inet6_tcp" for the cluster service to be listening on ipv6 | 13:56 |
| EmilienM | michchap: can be useful if you need deps for pacemaker | 13:56 |
| jaosorior | by the way, ccamacho, thanks for testing the changes, very well appreciated | 13:56 |
| *** athomas has joined #tripleo | 13:56 | |
| michchap | EmilienM: like an anchor set? | 13:56 |
| EmilienM | chem: yeah, don't we set it in tripleo alreaedy? | 13:56 |
| d0ugal | thrash, jaosorior - let's make them depend on each other :P | 13:56 |
| chem | EmilienM: jpena dunno | 13:56 |
| EmilienM | chem: but yeah it should be default in puppetlabs-rabbitmq | 13:56 |
| thrash | d0ugal: perfect! | 13:56 |
| * d0ugal isn't serious | 13:56 | |
| thrash | awww | 13:56 |
| jaosorior | d0ugal haha I actually needed something like that not too long ago | 13:56 |
| EmilienM | chem: https://github.com/openstack/tripleo-heat-templates/search?utf8=%E2%9C%93&q=inet6_tcp | 13:56 |
| chem | EmilienM: jpena how you do that ? (modifying a conf file hold by puppet ?) | 13:57 |
| jaosorior | I wonder if it's possible... | 13:57 |
| chem | EmilienM: thanks :) | 13:57 |
| EmilienM | michchap: yeah, maybe... but we first need feature parity | 13:57 |
| d0ugal | jaosorior: I don't think so | 13:57 |
| michchap | EmilienM: OK yep I get it. Wouldn't that already be provided by the neutron module though? | 13:57 |
| *** bvandenh has joined #tripleo | 13:57 | |
| jaosorior | would be a nice feature | 13:57 |
| michchap | EmilienM: I agree that's useful. | 13:57 |
| EmilienM | michchap: right but nothing about pacemaker. | 13:57 |
| EmilienM | michchap: well, that would be a future step | 13:57 |
| EmilienM | once all is moved under puppet-tripleo | 13:57 |
| michchap | EmilienM: gotcha, so we put some anchors in for pacemaker resources in the HA profiles | 13:57 |
| michchap | EmilienM: I like that idea | 13:58 |
| EmilienM | michchap: first step is to steal code from THT so we can manage puppet code on puppet-tripleo | 13:58 |
| d0ugal | jaosorior, thrash: http://docs.openstack.org/infra/manual/developers.html#cycles | 13:58 |
| * chem goes for lunch as well | 13:58 | |
| ccamacho | jaosorior, but after using the correct patch, the overcloud have deployed correctly, yw | 13:58 |
| thrash | d0ugal: haha | 13:59 |
| thrash | d0ugal: point being, it's actually happened. :P | 13:59 |
| *** jprovazn has joined #tripleo | 13:59 | |
| d0ugal | thrash: Yeah, seems so :) and probably killed CI when it did | 13:59 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Enable ceph and netiso for the nonha job https://review.openstack.org/293446 | 14:00 |
| jaosorior | thrash, d0ugal: Well, I will probably need something like that for this series: https://review.openstack.org/#/q/status:open+branch:master+topic:bug/1553222 doing without some circular dependency... or something is the sort is gonna be painful | 14:01 |
| thrash | jaosorior: yeah... good luck with that. :D | 14:01 |
| d0ugal | jaosorior: hah, good luck | 14:01 |
| * d0ugal walks slowly away | 14:01 | |
| * thrash backs away quickly | 14:01 | |
| jaosorior | hahaha | 14:02 |
| *** bvandenh has quit IRC | 14:04 | |
| *** mgagne has quit IRC | 14:07 | |
| *** mgagne has joined #tripleo | 14:07 | |
| derekh | EmilienM: adarazs: the upgrades job is currently just a nonha job with no introspection, this patch is intended to turn ceph on for non ha https://review.openstack.org/#/c/293051/1 | 14:09 |
| derekh | I see I got some typos to fix on that, fixing now | 14:09 |
| derekh | EmilienM: adarazs then there is another patch to turn upgrades on for the upgrades patch | 14:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: compute: include VIR_MIGRATE_TUNNELLED when doing VM shared storage https://review.openstack.org/293454 | 14:11 |
| *** absubram has joined #tripleo | 14:11 | |
| EmilienM | gfidente: ^ | 14:11 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Deploy ceph in the nonha job https://review.openstack.org/293051 | 14:11 |
| derekh | gfidente: ^ | 14:11 |
| adarazs | hm, okay. I need to change my patch to have a job that doesn't have pacemaker then. I added pacemaker to the nonha to test that better. but now I don't have anything to test the non-pacemaker case. | 14:11 |
| gfidente | derekh, hey I didn't see that thanks! | 14:11 |
| *** absubram_ has joined #tripleo | 14:12 | |
| derekh | gfidente: np | 14:12 |
| gfidente | derekh, so we don't enable netiso in nonha yet ? | 14:12 |
| derekh | gfidente: correct, should we? | 14:13 |
| *** absubram has quit IRC | 14:15 | |
| *** absubram_ is now known as absubram | 14:15 | |
| EmilienM | chem: https://review.openstack.org/#/c/293186/ | 14:15 |
| EmilienM | chem: the rabbitmq patches work for me | 14:16 |
| gfidente | derekh, I am not sure, you're thinking to use ha for pcmk(3)/netiso/v4 ; upgrades for pcmk(1)/ceph/netiso/v6 and nonha for non-pcmk/ceph ? | 14:22 |
| derekh | gfidente: looks like its heading that way, we should do up a matrix, things have been evolving a lot recently, a target would be nice | 14:25 |
| openstackgerrit | Michael Chapman proposed openstack/puppet-tripleo: Add keystone and db sync profiles https://review.openstack.org/292712 | 14:26 |
| gfidente | derekh, actually I'm +2 because I figured that having at least one job which does not use netiso is useful as it covers a lot of "code" in the templates which wouldn't be excercised | 14:28 |
| tosky | ifarkas: ok, I was wrong: the set of plugins _is_ configured in puppet (even if hardcoded for now), is there an easy way to retrieve it to have it dynamically set in deploy_input? | 14:29 |
| gfidente | adarazs, ^^ so I think our target job for ipv6 should probably be "upgrades" ? | 14:29 |
| tosky | ifarkas: and by configured (but not tunable right now) I mean this http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/puppet/controller.yaml#n1592 | 14:29 |
| adarazs | gfidente, derekh: where's "upgrades"? I don't see it defined here: https://review.openstack.org/#/c/293051/1/toci_gate_test.sh -- isn't it using a regular job like nonha? if yes, how do you use ipv6 in only that job? | 14:31 |
| gfidente | adarazs, you can add a case for it, like it happens for ha/nonha/containers | 14:32 |
| ifarkas | tosky, sorry, I don't know | 14:33 |
| tosky | ifarkas: np, who should I ask to? :) | 14:33 |
| *** ayoung has joined #tripleo | 14:33 | |
| derekh | adarazs: its not there yet, the upgrades job is running and just doing a normal nonha ci job, we should be adding it soon | 14:33 |
| adarazs | gfidente: case for it where? can you point me to the right part of the ci code? | 14:33 |
| adarazs | derekh: hm, okay. so the name of it is a lie. :) | 14:34 |
| gfidente | adarazs, an actual bash case I mean https://github.com/openstack-infra/tripleo-ci/blob/master/toci_gate_test.sh#L58 | 14:34 |
| derekh | adarazs: correct, thats what gfidente was doing here https://review.openstack.org/#/c/260466/10/toci_gate_test.sh | 14:34 |
| derekh | adarazs: but its not in yet | 14:34 |
| gfidente | adarazs, derekh actually let me update that too | 14:35 |
| adarazs | oh, things are moving fast :) | 14:35 |
| tosky | ryansb, zaneb: hello heat experts, I have an issue with Sahara and its Heat engine on RDO Mitaka (snapshot from last week): | 14:37 |
| ifarkas | tosky, maybe d0ugal or shardy ? | 14:38 |
| tosky | ifarkas: oki, thanks; after the other issue I have now | 14:38 |
| tosky | ryansb, zaneb: I tried to run Sahara scenario tests with the demo user/project; Sahara provisioning fails and in the heat logs I see: | 14:38 |
| ifarkas | ah, ok :-) | 14:38 |
| tosky | ryansb, zaneb: Forbidden: You are not authorized to perform the requested action: identity:list_roles (HTTP 403) http://paste.openstack.org/show/490683/ | 14:38 |
| tosky | ryansb, zaneb: is it something that should have been set by TripleO? | 14:39 |
| tosky | actually, it involves also keystone, so the question is also for ayoung ^^ | 14:39 |
| ryansb | the likelihood of that being a Heat problem isn't very high, looks like it's just surfacing the fact that your user can't do that action | 14:39 |
| *** saneax is now known as saneax_AFK | 14:40 | |
| *** absubram has quit IRC | 14:40 | |
| *** chem has quit IRC | 14:41 | |
| tosky | ryansb: what permission should the demo user have, apart from heat_stack_owner? | 14:41 |
| ayoung | tosky, look at the policy file on keystone | 14:42 |
| ayoung | it is in /etc/keystone/policy.json | 14:42 |
| * tosky looks | 14:43 | |
| *** absubram has joined #tripleo | 14:43 | |
| tosky | it is "identity:list_roles": "rule:admin_required", | 14:43 |
| ayoung | tosky, is that not unfortunate? | 14:43 |
| ayoung | is that not absurd? | 14:43 |
| ayoung | is that not the band of my exist....ok maybe overstating a little | 14:44 |
| tosky | probably - then I need to understand what changed compared to a liberty installation where it works | 14:44 |
| ayoung | tosky, but...what needs to list roles? | 14:44 |
| tosky | where the permissions are the same | 14:44 |
| ayoung | tosky, it was probably being performed by an admin user | 14:44 |
| tosky | ayoung: no, I run the tests from a "demo" user | 14:45 |
| tosky | I'm sure that didn't change | 14:45 |
| ayoung | maybe shardy can confirm, but I suspect now we are using trusts where before it was all done as the heat admin? | 14:45 |
| ayoung | tosky, it was not you | 14:45 |
| ayoung | it was, I suspect, what heat is using to set up delegation | 14:45 |
| ayoung | cuz nothing else changed | 14:45 |
| tosky | uh | 14:46 |
| ayoung | tosky, that rule for list_role goes back to Diablo | 14:46 |
| ayoung | tosky, how are you triggereing this error? what is the code path (in general terms)? | 14:48 |
| tosky | ayoung: I don't know that code too much (as QE, it's quite a black box), but let me check | 14:48 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Use --overcloud-update in the upgrades job https://review.openstack.org/260466 | 14:49 |
| adarazs | derekh: we got the expected "Service Unavailable (HTTP 503)" error in the test deploymet | 14:49 |
| tosky | I can tell you that Sahara uses Heat to orchestrate the creation of an Hadoop/Spark/Storm cluster | 14:49 |
| tosky | so it creates Heat stacks and passes them to Heat | 14:50 |
| *** veteran has quit IRC | 14:50 | |
| adarazs | derekh: the endpoints look okay... maybe we should check if there's anything sensible in the glance logs on the controller? | 14:51 |
| adarazs | derekh: though in the gate job there was nothiing | 14:51 |
| derekh | adarazs: yup, poking around now | 14:53 |
| tosky | ayoung: is there an easy way to set the old way of authorization (trusts) to see if it is the issue? | 14:54 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Remove default for the RabbitMQ password https://review.openstack.org/293344 | 14:54 |
| jaosorior | bnemec: Done ^^ | 14:54 |
| ayoung | tosky, yeah, it is a heat config issue. Let me see if I can find it | 14:55 |
| *** akuznetsov has quit IRC | 14:55 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Properly setup DNS for the container CI job https://review.openstack.org/293481 | 14:56 |
| derekh | adarazs: see me on tab4, image create worked | 14:56 |
| adarazs | derekh: I see. | 14:56 |
| *** jprovazn has quit IRC | 14:56 | |
| adarazs | derekh: okay, so really no idea why glance gives us 503 during the job | 14:56 |
| ayoung | tosky, http://hardysteven.blogspot.co.uk/2014/04/heat-auth-model-updates-part-1-trusts.html | 14:57 |
| ayoung | tosky, I think it is | 14:57 |
| ayoung | unset stack_user_domain_name | 14:57 |
| derekh | adarazs: looks like it might be the proxy | 14:58 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 14:58 |
| adarazs | derekh: hm, why is the job using a proxy? | 14:58 |
| adarazs | derekh: probably it can't proxy the ipv6 traffic | 14:58 |
| tosky | ayoung: it is already not set in /etc/heat/heat.conf on the controller | 14:58 |
| derekh | adarazs: for the IPv4 we set noproxy for the enpoints | 14:59 |
| derekh | adarazs: 2016-03-16 13:53:54.283 | ++ no_proxy=192.0.2.1,192.168.1.16,192.0.2.6 | 14:59 |
| derekh | adarazs: we need to do something similar I'd say | 14:59 |
| *** jpena|lunch is now known as jpena | 15:00 | |
| adarazs | derekh: ack. let me see where we set that in tripleoci and what are the endpoints... | 15:00 |
| jpena | chem: I'm back, give me a sec to read the history | 15:02 |
| derekh | adarazs: no_proxy is set in overcloudrc | 15:03 |
| derekh | adarazs: export no_proxy=192.0.2.1,192.168.1.214,2001:db8:fd00:1000::10 | 15:03 |
| derekh | adarazs: looks like it needs squar brackets around it | 15:04 |
| adarazs | derekh: toci_instack.sh:export no_proxy=192.0.2.1,$MY_IP | 15:04 |
| jpena | chem EmilienM: we're already setting the env variable in t-h-t: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/manifests/overcloud_controller.pp#L132-L135 | 15:04 |
| adarazs | derekh: oh, I see. | 15:04 |
| EmilienM | jpena: right, what I showed to Sofer already | 15:04 |
| EmilienM | derekh, adarazs: FYI our Puppet OpenStack CI running IPv6 with Tempest is working: https://review.openstack.org/287521 - we will need this patch in Tempest: https://review.openstack.org/293195 | 15:07 |
| openstackgerrit | Michael Chapman proposed openstack/puppet-tripleo: Add keystone and db sync profiles https://review.openstack.org/292712 | 15:08 |
| adarazs | EmilienM: ack | 15:08 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common: Create a test flavor for the pingtest VM https://review.openstack.org/289845 | 15:09 |
| *** yamahata has joined #tripleo | 15:15 | |
| *** david-lyle has quit IRC | 15:15 | |
| *** david-lyle has joined #tripleo | 15:15 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common: Use m1.small for ping test https://review.openstack.org/293494 | 15:15 |
| *** liverpooler has quit IRC | 15:17 | |
| openstackgerrit | Merged openstack/tripleo-common: Use m1.small for ping test https://review.openstack.org/291942 | 15:19 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-common: Create a test flavor for the pingtest VM https://review.openstack.org/289845 | 15:21 |
| adarazs | derekh: what creates the overcloudrc? | 15:21 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the demo flavour creation https://review.openstack.org/289838 | 15:21 |
| adarazs | derekh: I can't seem to find the part where we need to add the brackets | 15:21 |
| derekh | adarazs: probably python-tripleoclient, looking | 15:22 |
| adarazs | me too | 15:22 |
| *** mbound has quit IRC | 15:22 | |
| derekh | adarazs: http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/utils.py#n107 | 15:23 |
| adarazs | derekh: okay, so the overcloud_ip needs a bracket if it's ipv6 | 15:24 |
| derekh | adarazs: yup, I believe so | 15:25 |
| derekh | adarazs: this seems to work no_proxy=192.0.2.1,192.168.1.214,[2001:db8:fd00:1000::110] | 15:25 |
| adarazs | derekh: you mean ::10 at the end. | 15:26 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Remove unused scripts https://review.openstack.org/263881 | 15:26 |
| derekh | adarazs: yup, sorry, copy paste error | 15:26 |
| adarazs | derekh: wondering if somebody already wrote this "check if ipv6, bracket it if so" function in the python-tripleoclient. I'll look around. | 15:28 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Remove unused elements https://review.openstack.org/263882 | 15:28 |
| dtantsur | rebased ^^ | 15:28 |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Initial Integration of Mistral into TripleO https://review.openstack.org/282366 | 15:28 |
| derekh | adarazs: ok | 15:29 |
| *** acruz has joined #tripleo | 15:30 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Remove unused elements https://review.openstack.org/263882 | 15:31 |
| *** jprovazn has joined #tripleo | 15:31 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Remove ping test template from tripleo-common https://review.openstack.org/293508 | 15:31 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: endpoint_map: bump nova api from 2.0 to 2.1 https://review.openstack.org/293509 | 15:32 |
| *** jprovazn has quit IRC | 15:33 | |
| *** jprovazn has joined #tripleo | 15:33 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Use m1.small for ping test https://review.openstack.org/293511 | 15:34 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Boot from volume in ping test https://review.openstack.org/293512 | 15:34 |
| adarazs | derekh: so keystone endpoint-list gives 503 now, while glance image-list works :) | 15:34 |
| *** david-lyle_ has joined #tripleo | 15:34 | |
| *** david-lyle has quit IRC | 15:34 | |
| derekh | adarazs: keystone endpoint-list could be using once of the internel IP's | 15:36 |
| *** jaosorior has quit IRC | 15:36 | |
| adarazs | derekh: so we need to add even more IPs to the no_proxy list? | 15:37 |
| derekh | adarazs: http://192.0.2.6:35357/v2.0 is that right ? should it in an IPv6 IP address ? | 15:37 |
| derekh | adarazs: ya, its failing to connect to http://192.0.2.6:35357/v2.0/endpoints as its not in no_proxy | 15:39 |
| adarazs | I see. but I'm not sure if that's correct or not. let me check an OSPd7 IPv6 deployment and compare :) | 15:39 |
| dtantsur | could someone please merge https://review.openstack.org/291655 ? it blocks a lot of documentation work.. | 15:40 |
| *** bvandenh has joined #tripleo | 15:40 | |
| dtantsur | docs only, 1x +2 already | 15:40 |
| *** jroll has quit IRC | 15:41 | |
| *** jroll has joined #tripleo | 15:41 | |
| *** jroll has quit IRC | 15:41 | |
| *** jroll has joined #tripleo | 15:41 | |
| adarazs | derekh: seems like the only endpoint that's not ipv6 is the keystone admin_url. | 15:42 |
| adarazs | not sure why | 15:42 |
| derekh | adarazs: me neither | 15:42 |
| adarazs | derekh: I didn't alter anything from the default THT templates, so I'll look into what is not correct there. | 15:43 |
| derekh | adarazs: ok | 15:44 |
| openstackgerrit | Giulio Fidente proposed openstack/python-tripleoclient: Generate a password for Redis and pass it as deployment parameter https://review.openstack.org/293515 | 15:44 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Ensure access to Redis is password protected https://review.openstack.org/293521 | 15:48 |
| *** xinwu has joined #tripleo | 15:50 | |
| bnemec | gfidente: Any particular reason you didn't merge https://review.openstack.org/#/c/292489/ ? | 15:50 |
| gfidente | bnemec, hey EmilienM is checking with kashyap | 15:51 |
| EmilienM | yeah but got no review | 15:51 |
| gfidente | bnemec, also, so the pingtest template moved to tripleo-ci? | 15:51 |
| EmilienM | if we're sure, let's go ahead | 15:51 |
| bnemec | gfidente: Yeah, but the removal patch missed the template so it didn't merge conflict existing patches, unfortunately. | 15:51 |
| bnemec | I pushed a removal patch to rectify that. | 15:51 |
| gfidente | okay where is that so I +2 ? :) | 15:52 |
| bnemec | gfidente: https://review.openstack.org/293508 | 15:52 |
| gfidente | and did your change for m1.small land in tripleo-ci? | 15:52 |
| bnemec | gfidente: Not yet. That's https://review.openstack.org/293511 | 15:53 |
| gfidente | ok | 15:53 |
| gfidente | voted there too | 15:53 |
| gfidente | tks | 15:53 |
| bnemec | This tripleo.sh move has been the bane of my existence the past couple of days. :-) | 15:53 |
| bnemec | You don't realize how many CI patches you have open until they _all_ break at once. | 15:54 |
| *** bvandenh has quit IRC | 15:54 | |
| gfidente | yeah like https://review.openstack.org/#/c/289845/ :) | 15:54 |
| bnemec | gfidente: It gave me an excuse to flex my -2 muscles. :-) | 15:55 |
| adarazs | derekh: correction: even in OSPd7 we have the keystone admin_url as ipv4. probably there's a good reason for that. but it seems we should add it to the no_proxy list as well then along with the bracketed IPv6 address if we want to make sure that keystone commands work as well. | 15:55 |
| gfidente | bnemec, except if I knew I'd have -2 your too instead of merging it | 15:56 |
| bnemec | gfidente: Yeah, that actually would have been good. It didn't even occur to me that it was wrong until I saw that it had merged. | 15:56 |
| gfidente | it was me off for a couple of days actually so I missed the stuff moved into the other repo | 15:57 |
| *** tosky has quit IRC | 15:57 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Add Heat Capabilities Actions https://review.openstack.org/284460 | 15:57 |
| gfidente | wait I have my chance for a -2 too | 15:58 |
| *** tosky has joined #tripleo | 16:00 | |
| derekh | adarazs: yup, makes sense | 16:00 |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Create a test flavor for the pingtest VM https://review.openstack.org/293533 | 16:02 |
| openstackgerrit | Merged openstack/tripleo-docs: Don't repeat titles from the documents. Sphinx will add these. https://review.openstack.org/291655 | 16:04 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-common: Remove ping test template from tripleo-common https://review.openstack.org/293508 | 16:07 |
| *** dshulyak has quit IRC | 16:08 | |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: WIP: Use IPv6 on the gate jobs https://review.openstack.org/289445 | 16:10 |
| gfidente | slagle, we need to port https://review.openstack.org/#/c/292842/ to stable/liberty too right? | 16:10 |
| *** chem has joined #tripleo | 16:11 | |
| *** xinwu has quit IRC | 16:15 | |
| *** xinwu has joined #tripleo | 16:16 | |
| *** xinwu has quit IRC | 16:16 | |
| slagle | gfidente: we could, i dont know that we have to | 16:16 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: compute: use live_migration_tunnelled https://review.openstack.org/292489 | 16:20 |
| *** david-lyle_ is now known as david-lyle | 16:20 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: compute: include VIR_MIGRATE_TUNNELLED when doing VM shared storage https://review.openstack.org/293454 | 16:21 |
| *** rbrady has quit IRC | 16:21 | |
| *** shivrao has joined #tripleo | 16:24 | |
| *** ebalduf has joined #tripleo | 16:24 | |
| *** shivrao_ has joined #tripleo | 16:26 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Properly setup DNS for the all CI jobs https://review.openstack.org/293481 | 16:27 |
| rhallisey | derekh, ^ should address your comment | 16:27 |
| rhallisey | derekh, I think I'll get the job working today ^.^ | 16:28 |
| *** shivrao has quit IRC | 16:28 | |
| *** shivrao_ is now known as shivrao | 16:28 | |
| derekh | rhallisey: great ;-) | 16:28 |
| *** ramishra has quit IRC | 16:30 | |
| *** jdob has quit IRC | 16:31 | |
| *** ramishra has joined #tripleo | 16:32 | |
| *** xinwu has joined #tripleo | 16:34 | |
| *** trown is now known as trown|lunch | 16:36 | |
| *** shivrao has quit IRC | 16:38 | |
| *** links has quit IRC | 16:38 | |
| *** shivrao has joined #tripleo | 16:39 | |
| *** xinwu has quit IRC | 16:42 | |
| *** leanderthal is now known as leanderthal|afk | 16:43 | |
| thrash | if anybody has some time to take a look at the upgrade patchset in tripleo-common that would be awesome... starts here: https://review.openstack.org/#/c/288744/ | 16:45 |
| *** oshvartz has quit IRC | 16:45 | |
| *** athomas has quit IRC | 16:47 | |
| *** shivrao has quit IRC | 16:51 | |
| shadower | dtantsur: so I'm fine with https://review.openstack.org/#/c/291723/ but since I'm being removed from core, I should not give it a +2 or +A (and it already has a +1 from me) | 16:53 |
| *** athomas has joined #tripleo | 16:53 | |
| dtantsur | got it, thanks anyway! | 16:53 |
| dtantsur | not a couple more weeks hunting for the 2nd reviewer :D | 16:53 |
| shadower | hope it'll be sooner :-) | 16:54 |
| dtantsur | the first version of this patch appeared in the beginning of January, IIRC :) | 16:54 |
| shadower | ouch | 16:54 |
| shadower | altough I've seen worse | 16:55 |
| *** aufi has quit IRC | 16:55 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Remove unused scripts https://review.openstack.org/263881 | 17:01 |
| openstackgerrit | Miles Gould proposed openstack/tripleo-common: Return list of new nodes from register_all_nodes https://review.openstack.org/292860 | 17:02 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: Basic beaker one node test. https://review.openstack.org/281376 | 17:02 |
| *** ifarkas has quit IRC | 17:03 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient: Switch to using node utilities from tripleo-common https://review.openstack.org/291726 | 17:08 |
| openstackgerrit | Merged openstack/puppet-tripleo: Allow enabling authentication on haproxy.stats https://review.openstack.org/290896 | 17:09 |
| *** dshulyak has joined #tripleo | 17:09 | |
| EmilienM | bnemec: do we need backport in liberty? ^ | 17:10 |
| slagle | EmilienM: yes | 17:10 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Allow enabling authentication on haproxy.stats https://review.openstack.org/293581 | 17:10 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-pacemaker: Add a service provider. https://review.openstack.org/286124 | 17:10 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs: Extend the root device selection documentation https://review.openstack.org/290492 | 17:12 |
| *** rasca has quit IRC | 17:12 | |
| *** mikelk has quit IRC | 17:12 | |
| *** jistr has quit IRC | 17:12 | |
| *** rasca has joined #tripleo | 17:13 | |
| adarazs | folks, I have a question: when we do an ipv6 deployment, we end up with all ipv6 endpoints except keystone's admin_url, which i still IPv4 (not sure why). we add the public_url's ip address to the no_proxy variable in overcloudrc, should we add the KeystoneAdminVip to it too? | 17:15 |
| adarazs | derekh, dsneddon ^ | 17:16 |
| *** xinwu has joined #tripleo | 17:16 | |
| *** ohamada_ has quit IRC | 17:17 | |
| dsneddon | adarazs, The keystone admin VIP is on the control plane, which is IPv4-only. The keystone admin VIP is also on the Public VIP using IPv6, it just may not appear in the Keystone Catalog. | 17:18 |
| dsneddon | adarazs, Is it a problem for you that the Keystone admin VIP is IPv4? | 17:19 |
| adarazs | dsneddon: hm, so the problem is that when you do "keystone endpoint-list" it does this: | 17:20 |
| adarazs | DEBUG:keystoneclient.auth.identity.v2:Making authentication request to http://[2001:db8:fd00:1000::10]:5000/v2.0/tokens | 17:20 |
| adarazs | INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 2001:db8:fd00:1000::10 | 17:20 |
| adarazs | DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens HTTP/1.1" 200 1089 | 17:20 |
| adarazs | DEBUG:keystoneclient.session:REQ: curl -g -i -X GET http://192.0.2.6:35357/v2.0/endpoints -H "User-Agent: python-keystoneclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}a6b6acd7aaa7a5ae5abbec66b42c4808ca4bc5a4" | 17:20 |
| adarazs | dsneddon: so it asks on the IPv4 address... which, if not in the no_proxy list, won't work. | 17:20 |
| *** dtantsur is now known as dtantsur|afk | 17:20 | |
| dsneddon | adarazs, That sounds like a bug, can you file a BZ? | 17:20 |
| adarazs | dsneddon: bug in keystone client? | 17:21 |
| dsneddon | adarazs, Good question. I think this would actually be against rhel-osp-director, since we need to configure the no_proxy list in Director. | 17:21 |
| derekh | adarazs: dsneddon its probably a bug in tripleoclient, we probably need to add both to IP's to no_proxy in overcloudrc | 17:22 |
| adarazs | dsneddon: yeah, I'm there and I can make a change for it, I was just wondering if the expected thing is what keystone client does and we should add it to the no_proxy list, or not :) | 17:22 |
| adarazs | or it's a problem that the keystone client switches to the admin_url to get the endpoints... /me not sure how this is supposed to work... | 17:23 |
| adarazs | anyway, I'll create a bug for it to be sure. :) | 17:25 |
| *** trown|lunch is now known as trown | 17:25 | |
| bnemec | Yeah, this is an outstanding problem. You can have the same problem with all ipv4 net-iso if you're using a proxy. | 17:26 |
| bnemec | I've been meaning to fix it, but I keep getting distracted. | 17:26 |
| adarazs | bnemec: so should I add the admin vip to the no_proxy list? | 17:26 |
| bnemec | adarazs: I think so. | 17:27 |
| adarazs | okay. :) | 17:27 |
| adarazs | yay, /me fixes bugs in tripleo :) | 17:27 |
| adarazs | it has come to this. | 17:27 |
| rdopiera | adarazs: now you are responsible for that file | 17:28 |
| rdopiera | adarazs: all bugs in it are on you | 17:28 |
| adarazs | rdopiera: it's not too long at least :D | 17:28 |
| rdopiera | never fix bugs, they will think you know what you are doing | 17:29 |
| derekh | rdopiera: its not the file, its the whole repo he is responsible for | 17:30 |
| rdopiera | makes sense | 17:30 |
| *** paramite has quit IRC | 17:32 | |
| * adarazs is not sure what he's getting himself into. :) | 17:32 | |
| *** lucasagomes is now known as lucas-afk | 17:33 | |
| *** miles is now known as mgould | 17:34 | |
| *** jdob_lt has joined #tripleo | 17:36 | |
| *** panda has quit IRC | 17:40 | |
| *** paramite has joined #tripleo | 17:40 | |
| *** panda has joined #tripleo | 17:41 | |
| ayoung | what does openstack overcloud deploy --templates (with no additional values) do? | 17:48 |
| ayoung | I --templates [TEMPLATES] | 17:48 |
| ayoung | The directory containing the Heat templates to deploy | 17:48 |
| ayoung | but both quickstark and tripleo.sh both seem to pass it with no params | 17:49 |
| *** derekh has quit IRC | 17:50 | |
| ayoung | adarazs, keystoneclient.session:REQ: curl -g -i -X GET http://192.0.2.6:35357/v2.0/endpoints is based on the AUTH_URL environment variable used to get the token in the first place. From there on, it is using the service catalog | 17:51 |
| ayoung | adarazs, look in your overcloudrc file. Comment out the existing AUTH_URL and make it the IPv6 one, and it should work. | 17:52 |
| *** athomas has quit IRC | 17:52 | |
| adarazs | ayoung: it is the ipv6 one | 17:52 |
| adarazs | $ echo $OS_AUTH_URL | 17:52 |
| adarazs | http://[2001:db8:fd00:1000::10]:5000/v2.0 | 17:52 |
| ayoung | adarazs, with v2? | 17:52 |
| *** rcernin has quit IRC | 17:53 | |
| ayoung | adarazs, and the endpoint in the SC was IPv6? | 17:53 |
| adarazs | ayoung: it still started using the admin_url from the catalog. | 17:53 |
| ayoung | adarazs, oH...i MISREAD that | 17:53 |
| ayoung | adarazs, and what was the argument for putting the IPv4 address in there at all?? | 17:54 |
| ayoung | adarazs, the IPv6 address should be the admin_url, not the ip_v4 | 17:56 |
| adarazs | ayoung: we keep the control plane IPv4 and the keystone admin vip is on the control plane. I don't know why either decision was made in depth. something about IPMI not being ready for IPv6 i think. | 17:57 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Properly setup DNS for the all CI jobs https://review.openstack.org/293481 | 17:58 |
| ayoung | adarazs, OK, so, yeah, Keystone considers almost all operations as admin operations, and puts them on the Admin interface. With V3 (which is what we should be using) it should be a unified URL | 17:59 |
| ayoung | but that does not really solve your problem. | 17:59 |
| openstackgerrit | Attila Darazs proposed openstack/python-tripleoclient: Add bracket around v6 overcloud IP in no_proxy https://review.openstack.org/293626 | 17:59 |
| ayoung | We should be using DNS for this, not IP addresses | 17:59 |
| adarazs | ayoung: yup. but for now we're fighting with brackets :D | 18:00 |
| *** shivrao has joined #tripleo | 18:00 | |
| ayoung | adarazs, I understand, and I lovethat we are getting IPv6 support. | 18:00 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-puppet-elements: Add barbican-api-package to the overcloud. https://review.openstack.org/293628 | 18:08 |
| openstackgerrit | Ben Nemec proposed openstack/python-tripleoclient: Add password for HAProxy stats https://review.openstack.org/290905 | 18:10 |
| *** olap has quit IRC | 18:13 | |
| *** akuznetsov has joined #tripleo | 18:16 | |
| *** tesseract- has quit IRC | 18:19 | |
| *** mgould has quit IRC | 18:20 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Move ceilometer api to run under wsgi apache https://review.openstack.org/293642 | 18:34 |
| *** Marga_ has quit IRC | 18:40 | |
| *** jpena is now known as jpena|off | 18:41 | |
| *** electrofelix has quit IRC | 18:49 | |
| *** akuznetsov has quit IRC | 18:53 | |
| *** ebalduf has quit IRC | 18:53 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient: Generate a password for Redis and pass it as deployment parameter https://review.openstack.org/293515 | 18:57 |
| *** tosky has quit IRC | 19:09 | |
| *** acruz has quit IRC | 19:10 | |
| *** ayoung has quit IRC | 19:10 | |
| dsneddon | EmilienM, Do you think the IPv6 changes in OPM are packaged and ready to test again? | 19:15 |
| colonwq | EmilienM, for 289027 I am workiing on an other puppet-ceph patch it will need to depend on. That patch should remove the hated execs. | 19:15 |
| EmilienM | dsneddon: not sure jayg did a build today | 19:16 |
| EmilienM | colonwq: great. | 19:16 |
| *** ryansb has quit IRC | 19:18 | |
| *** ryansb has joined #tripleo | 19:21 | |
| *** ryansb has joined #tripleo | 19:21 | |
| jayg | EmilienM: we talking about master or liberty? and is this in rdo? | 19:25 |
| EmilienM | jayg: rdo, master | 19:25 |
| jayg | I was awaiting word all the patches you needed were in, so no | 19:25 |
| jayg | is everything there? I can sync now if so | 19:25 |
| *** akuznetsov has joined #tripleo | 19:31 | |
| *** yamahata has quit IRC | 19:34 | |
| *** rbrady has joined #tripleo | 19:35 | |
| *** Marga_ has joined #tripleo | 19:36 | |
| dsneddon | dprince, Any chance you can reveiew https://review.openstack.org/290224 and https://review.openstack.org/291420 today? I'm getting concerned about getting these downstream in time. | 19:36 |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Raise the mysql file limit https://review.openstack.org/293675 | 19:36 |
| slagle | EmilienM: go ahead man, laugh at my puppet ^ | 19:36 |
| EmilienM | I was waiting for that day | 19:37 |
| EmilienM | slagle: your code looks good, I'm checking in puppetlabs-mysql if we can't do it out of the box. I hate writting specific code in tripleo that could be in puppet modules | 19:38 |
| *** jdob_lt has quit IRC | 19:39 | |
| EmilienM | slagle: commented | 19:43 |
| slagle | EmilienM: can i use the -> operator directly in the value for notify? | 19:44 |
| slagle | or do i just need to add that as a new line? | 19:44 |
| EmilienM | slagle: it has to be a new line | 19:44 |
| slagle | ok | 19:45 |
| *** jdob_lt has joined #tripleo | 19:45 | |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Raise the mysql file limit https://review.openstack.org/293675 | 19:45 |
| EmilienM | slagle: please remind me to give you a Puppetlabs sticker in Austin. | 19:46 |
| slagle | i don't think they'll let me wear that to the devops session on bash scripts | 19:46 |
| EmilienM | lol | 19:46 |
| EmilienM | slagle: damn I forgot one thing in the review | 19:46 |
| *** ryansb has quit IRC | 19:47 | |
| EmilienM | slagle: commented again, should be fine after that. | 19:47 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use m1.small for ping test https://review.openstack.org/293511 | 19:47 |
| openstackgerrit | James Slagle proposed openstack/instack-undercloud: Raise the mysql file limit https://review.openstack.org/293675 | 19:48 |
| slagle | EmilienM: thanks | 19:48 |
| *** ryansb has joined #tripleo | 19:49 | |
| *** ryansb has joined #tripleo | 19:49 | |
| openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates: Don't have separate protocols/ports for Keystone v3 https://review.openstack.org/284265 | 19:50 |
| *** akuznetsov has quit IRC | 19:54 | |
| *** Goneri has quit IRC | 19:56 | |
| openstackgerrit | Attila Darazs proposed openstack/python-tripleoclient: Fix no_proxy list generation for overcloudrc https://review.openstack.org/293626 | 20:01 |
| EmilienM | slagle: can I push over? | 20:02 |
| EmilienM | some lint issues | 20:02 |
| slagle | EmilienM: sure | 20:02 |
| *** jcoufal has quit IRC | 20:03 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: Raise the mysql file limit https://review.openstack.org/293675 | 20:04 |
| *** ayoung has joined #tripleo | 20:11 | |
| colonwq | EmilienM, I have submitted 293693 for review, ridicule and making better. | 20:13 |
| openstackgerrit | Attila Darazs proposed openstack/python-tripleoclient: Fix no_proxy list generation for overcloudrc https://review.openstack.org/293626 | 20:14 |
| openstackgerrit | Michele Baldessari proposed openstack/python-tripleoclient: Clarify error when a template is missing https://review.openstack.org/293143 | 20:15 |
| *** penick has joined #tripleo | 20:18 | |
| *** paramite has quit IRC | 20:21 | |
| *** jprovazn has quit IRC | 20:23 | |
| openstackgerrit | Merged openstack/puppet-pacemaker: Basic beaker one node test. https://review.openstack.org/281376 | 20:24 |
| *** penick has quit IRC | 20:29 | |
| *** penick has joined #tripleo | 20:33 | |
| *** MaxPC has quit IRC | 20:42 | |
| EmilienM | dsneddon: opm should be updated in master | 20:43 |
| EmilienM | looking at delorean: http://trunk.rdoproject.org/centos7/report.html | 20:43 |
| *** jayg is now known as jayg|g0n3 | 20:46 | |
| openstackgerrit | Attila Darazs proposed openstack/python-tripleoclient: Fix no_proxy list generation for overcloudrc https://review.openstack.org/293626 | 20:47 |
| *** ianw has joined #tripleo | 20:49 | |
| *** ccamacho has quit IRC | 20:53 | |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: WIP: Use IPv6 on the gate jobs https://review.openstack.org/289445 | 20:55 |
| *** jdob_lt has quit IRC | 20:56 | |
| *** Goneri has joined #tripleo | 21:01 | |
| *** penick has quit IRC | 21:05 | |
| *** lblanchard has quit IRC | 21:08 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: endpoint_map: bump nova api from 2.0 to 2.1 https://review.openstack.org/293509 | 21:09 |
| *** shardy has quit IRC | 21:28 | |
| *** rdopiera has quit IRC | 21:28 | |
| *** dtantsur|afk has quit IRC | 21:31 | |
| *** pradk has quit IRC | 21:32 | |
| *** pino|work_ has joined #tripleo | 21:32 | |
| *** pino|work has quit IRC | 21:33 | |
| *** pblaho has quit IRC | 21:33 | |
| *** dprince has quit IRC | 21:34 | |
| *** pblaho has joined #tripleo | 21:34 | |
| *** colonwq has quit IRC | 21:34 | |
| *** pino|work has joined #tripleo | 21:36 | |
| *** pino|work_ has quit IRC | 21:37 | |
| *** dtantsur has joined #tripleo | 21:37 | |
| *** trown is now known as trown|outtypewww | 21:39 | |
| *** panda has quit IRC | 21:40 | |
| *** panda has joined #tripleo | 21:41 | |
| *** rbrady has quit IRC | 21:45 | |
| *** absubram has quit IRC | 21:49 | |
| *** absubram has joined #tripleo | 21:50 | |
| *** shivrao has quit IRC | 21:53 | |
| *** dshulyak has quit IRC | 21:54 | |
| *** shivrao has joined #tripleo | 21:56 | |
| *** shivrao has quit IRC | 22:00 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Generate a password for Redis and pass it as deployment parameter https://review.openstack.org/293515 | 22:06 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Manage keystone initialization directly in t-h-t manifests https://review.openstack.org/244162 | 22:12 |
| *** shivrao has joined #tripleo | 22:13 | |
| openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Hack to fix container gate https://review.openstack.org/293740 | 22:14 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/tripleo-ci: Allow the continer job to run again https://review.openstack.org/288915 | 22:16 |
| *** acruz has joined #tripleo | 22:17 | |
| bnemec | I think puppet-pacemaker just broke our ha job. :-( | 22:17 |
| bnemec | EmilienM: ^ | 22:18 |
| EmilienM | bnemec: https://review.openstack.org/#/c/281376/ ? | 22:19 |
| EmilienM | it was gate-tripleo-ci-f22-ha SUCCESS. | 22:19 |
| EmilienM | so I don't see how HA job can be broken | 22:19 |
| *** r-mibu has quit IRC | 22:20 | |
| bnemec | EmilienM: Hmm. I'm seeing Error: Duplicate declaration: User[hacluster] is already declared in file /var/lib/heat-config/heat-config-puppet/c0b26626-4e80-436e-9226-28a5fc8e78ca.pp:73; cannot redeclare at /etc/puppet/modules/pacemaker/manifests/corosync.pp:121 on node overcloud-controller-0.localdomain | 22:20 |
| *** r-mibu has joined #tripleo | 22:20 | |
| *** yamahata has joined #tripleo | 22:20 | |
| bnemec | Maybe there was a colliding change in heat-config-puppet? | 22:21 |
| bnemec | Or probably tht, I guess. | 22:21 |
| EmilienM | how to you explain gate-tripleo-ci-f22-ha passed? | 22:21 |
| EmilienM | we are gating the module on TripleO Job | 22:21 |
| bnemec | EmilienM: No idea. The hacluster user in tht was added almost a year ago: https://github.com/openstack/tripleo-heat-templates/commit/607ea9c8d30d752b01881e2ac913c712f0243272 | 22:22 |
| EmilienM | bnemec: I need to go, please email me if you need a revert and I'll do it. | 22:23 |
| bnemec | EmilienM: Will do, thanks | 22:23 |
| EmilienM | bnemec: I'll come back online later | 22:23 |
| EmilienM | so worst case I revert it from my phone if you email me | 22:23 |
| EmilienM | but I would like to know why CI job passed. | 22:24 |
| * EmilienM afk | 22:24 | |
| *** chlong has joined #tripleo | 22:32 | |
| *** penick has joined #tripleo | 22:34 | |
| *** penick has quit IRC | 22:36 | |
| *** penick has joined #tripleo | 22:40 | |
| *** yamahata has quit IRC | 22:48 | |
| *** TSCHAK has joined #tripleo | 22:49 | |
| *** ryansb has quit IRC | 22:49 | |
| openstackgerrit | Ben Nemec proposed openstack/puppet-pacemaker: Revert "Basic beaker one node test." https://review.openstack.org/293750 | 22:51 |
| *** gfidente has quit IRC | 22:51 | |
| *** TSCHAK_ has quit IRC | 22:52 | |
| *** ryansb has joined #tripleo | 22:52 | |
| *** ryansb has joined #tripleo | 22:52 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-common: Add ssh option host key checking to no for automation https://review.openstack.org/293751 | 22:56 |
| *** yamahata has joined #tripleo | 22:57 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1558304 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1558304 in tripleo "hacluster user conflict between t-h-t and puppet-pacemaker" [Critical,Triaged] | 23:10 |
| *** yamahata has quit IRC | 23:18 | |
| *** akrivoka has quit IRC | 23:41 | |
| *** chlong has quit IRC | 23:41 | |
| *** TSCHAK_ has joined #tripleo | 23:44 | |
| *** TSCHAK has quit IRC | 23:47 | |
| slagle | EmilienM: it's stable/liberty that it broke | 23:47 |
| slagle | EmilienM: oh, nm, looks like it's on master | 23:48 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Ensure access to Redis is password protected https://review.openstack.org/293521 | 23:50 |
| *** acruz has quit IRC | 23:51 | |
| *** dmacpher has joined #tripleo | 23:51 | |
| slagle | oh i see, bnemec tracked it down | 23:51 |
| *** penick has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!