*** dave-mccowan has quit IRC | 00:02 | |
*** olivierb- has quit IRC | 00:05 | |
*** DanyC has joined #openstack-ansible | 00:06 | |
*** poopcat has quit IRC | 00:08 | |
*** ivve has quit IRC | 00:08 | |
*** ggnel has quit IRC | 00:09 | |
*** DanyC_ has quit IRC | 00:09 | |
*** poopcat has joined #openstack-ansible | 00:10 | |
*** gyee has quit IRC | 00:11 | |
*** dave-mccowan has joined #openstack-ansible | 00:22 | |
*** vnogin has joined #openstack-ansible | 00:22 | |
*** cshen has joined #openstack-ansible | 00:26 | |
*** cshen has quit IRC | 00:30 | |
*** poopcat has quit IRC | 00:41 | |
*** gregoryo has joined #openstack-ansible | 00:42 | |
*** poopcat has joined #openstack-ansible | 00:42 | |
*** dave-mccowan has quit IRC | 00:55 | |
*** EmilienM has quit IRC | 01:02 | |
*** EmilienM has joined #openstack-ansible | 01:03 | |
*** dave-mccowan has joined #openstack-ansible | 01:46 | |
*** poopcat has quit IRC | 03:00 | |
*** coreywright has quit IRC | 03:03 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: Add scheduler filters when backends are defined https://review.openstack.org/588126 | 03:06 |
---|---|---|
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: Resolve cinder config deprecation warnings https://review.openstack.org/588127 | 03:10 |
cloudnull | kaiokmo excellent ! | 03:12 |
cloudnull | I guess it just needed a repo update? | 03:12 |
*** coreywright has joined #openstack-ansible | 03:20 | |
*** dave-mccowan has quit IRC | 03:33 | |
*** udesale has joined #openstack-ansible | 03:46 | |
*** dxiri has joined #openstack-ansible | 04:10 | |
*** Bhujay has joined #openstack-ansible | 04:38 | |
*** FrankZhang has quit IRC | 04:41 | |
*** mattinator has quit IRC | 04:43 | |
*** dxiri has quit IRC | 05:11 | |
*** coreywright has quit IRC | 05:20 | |
*** coreywright has joined #openstack-ansible | 05:24 | |
*** shyamb has joined #openstack-ansible | 05:36 | |
*** sm806 has quit IRC | 06:04 | |
*** skyscraper has quit IRC | 06:04 | |
*** udesale has quit IRC | 06:23 | |
openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible master: Use standard env variables for the AIO bootstrap https://review.openstack.org/577652 | 06:38 |
openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible stable/queens: Use standard env variables for the AIO bootstrap https://review.openstack.org/577653 | 06:40 |
*** cshen has joined #openstack-ansible | 06:45 | |
*** shyamb has quit IRC | 06:45 | |
*** shyamb has joined #openstack-ansible | 06:46 | |
*** shyamb has quit IRC | 06:59 | |
*** shyamb has joined #openstack-ansible | 06:59 | |
*** vnogin has quit IRC | 07:00 | |
*** vnogin has joined #openstack-ansible | 07:00 | |
*** vnogin has quit IRC | 07:07 | |
jrosser | this https://review.openstack.org/#/c/587932/ then https://review.openstack.org/#/c/587944/ if anyone has a moment | 07:11 |
jrosser | then we should be able to take a view on bionic role tests voting | 07:12 |
odyssey4me | o/ | 07:14 |
andymccr | bgmccollum: sorry i missed your ping yesterday! Yeah tht looks good, i thought about it a bit more, another alternative would be to have a free field so bootstrap_opts is just straight vars (x=y z=a) etc - and a free field "Additional_opts" or something similar, to allow a manual entry of anything that is needed after - but your way works. | 07:19 |
andymccr | i'll put a review on that | 07:19 |
andymccr | (if it hasnt already merged) | 07:19 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Reduce testing tech debt https://review.openstack.org/582668 | 07:22 |
odyssey4me | andymccr: could you review those two jrosser just mentioned please? they're quick and simple | 07:23 |
*** lkoranda has quit IRC | 07:23 | |
*** shyamb has quit IRC | 07:26 | |
*** shyamb has joined #openstack-ansible | 07:26 | |
*** lkoranda has joined #openstack-ansible | 07:31 | |
odyssey4me | or evrardjp when you're in | 07:31 |
*** tosky has joined #openstack-ansible | 07:33 | |
*** pmannidi has joined #openstack-ansible | 07:36 | |
*** canori01 has quit IRC | 07:38 | |
*** mattt has quit IRC | 07:38 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/582324 | 07:39 |
*** Tahvok has quit IRC | 07:45 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute image setup against octavia_service_setup_host https://review.openstack.org/588165 | 07:45 |
*** flaper87 has quit IRC | 07:46 | |
*** juhak has quit IRC | 07:46 | |
*** Tahvok has joined #openstack-ansible | 07:46 | |
*** juhak has joined #openstack-ansible | 07:46 | |
*** zerick has quit IRC | 07:46 | |
*** flaper87 has joined #openstack-ansible | 07:46 | |
*** juhak is now known as Guest70971 | 07:47 | |
*** zerick has joined #openstack-ansible | 07:47 | |
*** shyamb has quit IRC | 07:48 | |
evrardjp | haha the commit message jrosser | 07:52 |
evrardjp | oh it's odyssey4me | 07:52 |
evrardjp | my bad | 07:52 |
odyssey4me | :) | 07:52 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/582324 | 07:56 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute image setup against octavia_service_setup_host https://review.openstack.org/588165 | 07:56 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute flavor setup against octavia_service_setup_host https://review.openstack.org/588166 | 07:56 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/582324 | 07:58 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute image setup against octavia_service_setup_host https://review.openstack.org/588165 | 07:58 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute flavor setup against octavia_service_setup_host https://review.openstack.org/588166 | 07:58 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/582324 | 07:59 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute image setup against octavia_service_setup_host https://review.openstack.org/588165 | 07:59 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute flavor setup against octavia_service_setup_host https://review.openstack.org/588166 | 07:59 |
odyssey4me | sorry about the spam | 07:59 |
eumel8 | rofl | 08:04 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/582324 | 08:05 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute image setup against octavia_service_setup_host https://review.openstack.org/588165 | 08:05 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute flavor setup against octavia_service_setup_host https://review.openstack.org/588166 | 08:05 |
*** gregoryo has quit IRC | 08:06 | |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Revert "Use generic vars file for ubuntu" https://review.openstack.org/587932 | 08:11 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Add Rocky UCA for bionic https://review.openstack.org/587944 | 08:11 |
*** coreywright has quit IRC | 08:12 | |
*** coreywright has joined #openstack-ansible | 08:16 | |
*** gillesMo has joined #openstack-ansible | 08:20 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute network setup against octavia_service_setup_host https://review.openstack.org/588174 | 08:22 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Move role setup into service setup tasks https://review.openstack.org/588175 | 08:22 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute security group setup against octavia_service_setup_host https://review.openstack.org/588176 | 08:22 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Remove octavia_requires_pip_packages https://review.openstack.org/588177 | 08:22 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Remove octavia_requires_pip_packages https://review.openstack.org/588177 | 08:27 |
*** pmannidi has quit IRC | 08:28 | |
*** vnogin has joined #openstack-ansible | 08:32 | |
*** electrofelix has joined #openstack-ansible | 08:37 | |
*** shyamb has joined #openstack-ansible | 08:38 | |
*** vnogin has quit IRC | 08:43 | |
*** vnogin has joined #openstack-ansible | 08:45 | |
*** udesale has joined #openstack-ansible | 08:46 | |
*** jbadiapa has quit IRC | 08:47 | |
*** pcaruana has joined #openstack-ansible | 09:00 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: [TEST] bionic https://review.openstack.org/586635 | 09:01 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_aodh master: [TEST] bionic https://review.openstack.org/586654 | 09:01 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_barbican master: [TEST] bionic https://review.openstack.org/586655 | 09:02 |
openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible master: Use standard env variables for the AIO bootstrap https://review.openstack.org/577652 | 09:05 |
openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible stable/queens: Use standard env variables for the AIO bootstrap https://review.openstack.org/577653 | 09:10 |
*** Bhujay has quit IRC | 09:11 | |
*** shyamb has quit IRC | 09:19 | |
odyssey4me | evrardjp: well, I have bad news and good news | 09:24 |
*** shyamb has joined #openstack-ansible | 09:27 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Allow tags to be used for MQ tasks https://review.openstack.org/588190 | 09:40 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Prevent common MQ task set from synchronizing https://review.openstack.org/588191 | 09:41 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Allow tags to be used for MQ tasks https://review.openstack.org/588190 | 09:41 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Allow tags to be used for MQ tasks https://review.openstack.org/588190 | 09:44 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Allow tags to be used for MQ tasks https://review.openstack.org/588190 | 09:45 |
*** vollman has joined #openstack-ansible | 09:46 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ceilometer master: [TEST] bionic https://review.openstack.org/586656 | 09:49 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Allow tags to be used for MQ tasks https://review.openstack.org/588190 | 09:49 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_cinder master: [TEST] bionic https://review.openstack.org/586657 | 09:50 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_designate master: [TEST] bionic https://review.openstack.org/586658 | 09:50 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_glance master: [TEST] bionic https://review.openstack.org/586659 | 09:50 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: [TEST] bionic https://review.openstack.org/586660 | 09:51 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_heat master: [TEST] bionic https://review.openstack.org/586661 | 09:52 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_horizon master: [TEST] bionic https://review.openstack.org/586662 | 09:52 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ironic master: [TEST] bionic https://review.openstack.org/586663 | 09:53 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: [TEST] bionic https://review.openstack.org/586664 | 09:53 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_molteniron master: [TEST] bionic https://review.openstack.org/586665 | 09:53 |
*** vnogin has quit IRC | 09:53 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Allow tags to be used for MQ tasks https://review.openstack.org/588196 | 09:54 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: [TEST] bionic https://review.openstack.org/586666 | 09:54 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: [TEST] bionic https://review.openstack.org/586667 | 09:54 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_octavia master: [TEST] bionic https://review.openstack.org/586668 | 09:55 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_rally master: [TEST] bionic https://review.openstack.org/586669 | 09:55 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_sahara master: [TEST] bionic https://review.openstack.org/586670 | 09:55 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_swift master: [TEST] bionic https://review.openstack.org/586671 | 09:56 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tacker master: [TEST] bionic https://review.openstack.org/586672 | 09:56 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: [TEST] bionic https://review.openstack.org/586673 | 09:57 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_trove master: [TEST] bionic https://review.openstack.org/586674 | 09:57 |
*** vnogin has joined #openstack-ansible | 10:04 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: [TEST] bionic https://review.openstack.org/586635 | 10:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_aodh master: [TEST] bionic https://review.openstack.org/586654 | 10:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_barbican master: [TEST] bionic https://review.openstack.org/586655 | 10:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ceilometer master: [TEST] bionic https://review.openstack.org/586656 | 10:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_cinder master: [TEST] bionic https://review.openstack.org/586657 | 10:16 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_designate master: [TEST] bionic https://review.openstack.org/586658 | 10:16 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_glance master: [TEST] bionic https://review.openstack.org/586659 | 10:16 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: [TEST] bionic https://review.openstack.org/586660 | 10:16 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_heat master: [TEST] bionic https://review.openstack.org/586661 | 10:16 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_horizon master: [TEST] bionic https://review.openstack.org/586662 | 10:16 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ironic master: [TEST] bionic https://review.openstack.org/586663 | 10:16 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: [TEST] bionic https://review.openstack.org/586664 | 10:17 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_molteniron master: [TEST] bionic https://review.openstack.org/586665 | 10:17 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: [TEST] bionic https://review.openstack.org/586666 | 10:17 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: [TEST] bionic https://review.openstack.org/586667 | 10:17 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_rally master: [TEST] bionic https://review.openstack.org/586669 | 10:18 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_sahara master: [TEST] bionic https://review.openstack.org/586670 | 10:18 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_swift master: [TEST] bionic https://review.openstack.org/586671 | 10:18 |
*** shyamb has quit IRC | 10:18 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tacker master: [TEST] bionic https://review.openstack.org/586672 | 10:18 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: [TEST] bionic https://review.openstack.org/586673 | 10:18 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_trove master: [TEST] bionic https://review.openstack.org/586674 | 10:18 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute security group setup against octavia_service_setup_host https://review.openstack.org/588176 | 10:34 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Remove octavia_requires_pip_packages https://review.openstack.org/588177 | 10:38 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Allow tags to be used for MQ tasks https://review.openstack.org/588196 | 10:41 |
*** jamespage has quit IRC | 11:04 | |
*** fmccarthy has quit IRC | 11:04 | |
*** neith has quit IRC | 11:04 | |
*** viks_ has quit IRC | 11:04 | |
*** cshen has quit IRC | 11:08 | |
*** ansmith has quit IRC | 11:11 | |
*** priteau has joined #openstack-ansible | 11:18 | |
*** shyamb has joined #openstack-ansible | 11:23 | |
*** dave-mccowan has joined #openstack-ansible | 11:26 | |
*** udesale has quit IRC | 11:27 | |
*** canori01 has joined #openstack-ansible | 11:35 | |
*** cshen has joined #openstack-ansible | 11:46 | |
*** gillesMo has quit IRC | 12:08 | |
jrosser | a bunch of the bionic role tests have failed lxc cache prep all the same like this http://logs.openstack.org/54/586654/4/check/openstack-ansible-functional-ubuntu-bionic/510e8e4/logs/host/lxc-cache-prep-commands.log.txt.gz | 12:08 |
odyssey4me | jrosser: looks like the keys copied alright: http://logs.openstack.org/54/586654/4/check/openstack-ansible-functional-ubuntu-bionic/510e8e4/logs/ara-report/result/0a0a8ad5-a83a-4b7c-b071-30e3bb855d8d/ | 12:11 |
evrardjp | what's the bad news? | 12:11 |
evrardjp | odyssey4me: ^ | 12:11 |
odyssey4me | it generated fine: http://logs.openstack.org/54/586654/4/check/openstack-ansible-functional-ubuntu-bionic/510e8e4/logs/ara-report/# | 12:11 |
odyssey4me | and wrote to a file just fine: http://logs.openstack.org/54/586654/4/check/openstack-ansible-functional-ubuntu-bionic/510e8e4/logs/ara-report/result/4efc6710-5165-47c1-a4a7-823b95c765c2/ | 12:11 |
jrosser | oh hrrm i'm reading this a bit wrong then | 12:12 |
odyssey4me | evrardjp: the bad news - the mq setup tasks can't be used with tags, which is a pretty important use-case | 12:12 |
odyssey4me | the good news: I have a solution | 12:12 |
odyssey4me | the bad news: it's going to require patches to every role again | 12:12 |
odyssey4me | busy testing with https://review.openstack.org/588196 and https://review.openstack.org/588190 | 12:13 |
jrosser | odyssey4me: this is where i started digging http://logs.openstack.org/54/586654/4/check/openstack-ansible-functional-ubuntu-bionic/510e8e4/job-output.txt.gz#_2018-08-02_10_32_08_027982 | 12:13 |
odyssey4me | jrosser: yeah, maybe the output format is wrong with bionic? | 12:14 |
*** EmilienM has left #openstack-ansible | 12:21 | |
mgariepy | http://logs.openstack.org/54/586654/4/check/openstack-ansible-functional-ubuntu-bionic/510e8e4//logs/host/lxc-cache-prep-commands.log.txt.gz << gpg: can't connect to the agent.. | 12:23 |
*** shyamb has quit IRC | 12:26 | |
evrardjp | odyssey4me: I am reviewing this, with an extra idea, just a sec | 12:28 |
*** shyamb has joined #openstack-ansible | 12:29 | |
*** shyamb has quit IRC | 12:29 | |
*** shyamb has joined #openstack-ansible | 12:29 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server master: Revert "Use generic vars file for ubuntu" https://review.openstack.org/588230 | 12:31 |
odyssey4me | jrosser evrardjp given that most roles have bionic working now, should we change the role test to voting - then we can disable that per role where it's not working | 12:32 |
jrosser | this'll do it of folks think its time https://review.openstack.org/#/c/587478/ | 12:32 |
odyssey4me | jrosser: perhaps make that one depend on https://review.openstack.org/588230 | 12:33 |
odyssey4me | but yeah, I think it's time - otherwise I'll do more dumb patches which break it :p | 12:33 |
evrardjp | odyssey4me: don't forget that the plan is to sync mq_setup | 12:33 |
jrosser | odyssey4me: i'll add that | 12:33 |
odyssey4me | evrardjp: yes, but if we sync those changes now it'll break every role | 12:33 |
odyssey4me | that's why I did https://review.openstack.org/588191 | 12:34 |
odyssey4me | the roles all work as-is now, and I can change them all up to fix them to work with tags, then fix that sync file and rename it back | 12:34 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Change bionic to be voting https://review.openstack.org/587478 | 12:34 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Change bionic to be voting https://review.openstack.org/587478 | 12:34 |
evrardjp | odyssey4me: well, I am not sure to understand that last patch | 12:35 |
odyssey4me | evrardjp: looks like https://review.openstack.org/588196 worked - so if you're happy with the way that's done then I can release it for review and update the cinder one too | 12:35 |
evrardjp | https://review.openstack.org/#/c/588191/1 | 12:35 |
evrardjp | odyssey4me: because it syncs when a change is done in the tests repo | 12:35 |
odyssey4me | evrardjp: so if we rename that file, then the sync process will not find that file and do nothing anywhere | 12:35 |
*** ansmith has joined #openstack-ansible | 12:36 | |
evrardjp | agreed | 12:36 |
evrardjp | but the sync triggers on file change | 12:36 |
evrardjp | so if no change, no problem | 12:36 |
odyssey4me | the sync process checks for the existance of the file, then only syncs if it's present in the target repo | 12:36 |
evrardjp | :p | 12:36 |
evrardjp | agreed | 12:36 |
odyssey4me | so, rather than blocking all changes to the tests repo - I figured we rename the file instead to prevent any further changes to tests proposing changes to the os_* roles | 12:37 |
evrardjp | but I was talking about the trigger condition | 12:37 |
evrardjp | but why not work in tests, and see how it goes? | 12:37 |
odyssey4me | a rename of the file will not trigger a proposal to rename all the existing files of that name | 12:37 |
evrardjp | I agree | 12:37 |
evrardjp | I am just confused about why NOT working directly in tests repo | 12:37 |
evrardjp | it's meant for that | 12:37 |
odyssey4me | because a sync of that set of changes will break every single role | 12:38 |
odyssey4me | every role uses with_items, the new mechanism doesn't use with_items | 12:38 |
evrardjp | oh yeah the includes will change | 12:38 |
evrardjp | need* | 12:38 |
evrardjp | < dummy | 12:38 |
odyssey4me | so yeah, every role needs to be updated first, then we can change the tests repo | 12:38 |
evrardjp | or we break stuff | 12:39 |
evrardjp | it's fine | 12:39 |
odyssey4me | yep, and we broke enough stuff lately :p | 12:39 |
evrardjp | it will be faster | 12:39 |
odyssey4me | it's the price of progress ;) | 12:39 |
evrardjp | that's a lot of things | 12:39 |
evrardjp | for something that can just break and can be emergently fixed | 12:39 |
odyssey4me | yep, that's fine - I'll likely figure out how to script it - given all the roles now have a uniform structure it should be reasonably ok | 12:39 |
evrardjp | keep in mind it will break only when it's merged | 12:39 |
odyssey4me | well, yes - another approach could be to push patches to all repositories and hold the patches back, then merge them all in one go | 12:40 |
evrardjp | odyssey4me: yeah | 12:40 |
evrardjp | that's what I thought | 12:40 |
odyssey4me | I thought that'd just create review list noise. | 12:41 |
odyssey4me | Either approach is fine, although holding back patches also creates the possibility of merge conflicts while we wait for them all to be ready. | 12:41 |
odyssey4me | I'd prefer to merge as we go, because that also allows more testing to happen - but I'll take whatever your preference is. | 12:42 |
*** shyamb has quit IRC | 12:42 | |
*** shyamb has joined #openstack-ansible | 12:42 | |
evrardjp | nah it's fine I wanted to streamline the thing, and make it faster, not take too much mental energy for this | 12:45 |
evrardjp | but it's your patches :) | 12:45 |
odyssey4me | evrardjp: if you have suggestions to make it faster, please suggest - either patch on top or review comment | 12:49 |
odyssey4me | if it's just in the tests file, that'll be easy to modify later - but if it's not, then rather suggest now | 12:50 |
*** udesale has joined #openstack-ansible | 12:51 | |
evrardjp | I reviewed one of the two patches swift I think | 12:51 |
evrardjp | I had an idea but it doesn't work | 12:52 |
odyssey4me | ok, will get back to that in a bit - heading to a meeting now | 12:58 |
*** shyamb has quit IRC | 13:03 | |
*** vnogin has quit IRC | 13:10 | |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_keystone master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/584479 | 13:17 |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_cinder master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/582632 | 13:19 |
*** vnogin has joined #openstack-ansible | 13:24 | |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_neutron master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/583021 | 13:40 |
*** savvas` has joined #openstack-ansible | 13:50 | |
savvas` | cloudnull: http://paste.openstack.org/show/727142/ we spoke about this yesterday (savvas). Same issue on fresh install, all nodes now | 13:51 |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_nova master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/584450 | 13:52 |
*** DanyC has quit IRC | 13:59 | |
*** DanyC has joined #openstack-ansible | 14:00 | |
*** xteknoid has joined #openstack-ansible | 14:00 | |
xteknoid | hi. has anyone had an issue with the aio installation (queens) where instances dns lookups timeout? i have a full working openstack-ansible aio, bidirectional network access. Only problme is the ability to resolve dns in instances which just seems to hang / timeout | 14:02 |
*** DanyC has quit IRC | 14:04 | |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_heat master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/584513 | 14:07 |
*** spatel_ has joined #openstack-ansible | 14:10 | |
openstackgerrit | Jonathan Rosser proposed openstack/ansible-hardening master: Add bionic to galaxy_info metadata https://review.openstack.org/588254 | 14:13 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-apt_package_pinning stable/queens: Add bionic to galaxy_info metadata https://review.openstack.org/588255 | 14:13 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: Add bionic to galaxy_info metadata https://review.openstack.org/588256 | 14:13 |
jrosser | arrgh :( | 14:13 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-memcached_server master: Add bionic to galaxy_info metadata https://review.openstack.org/588257 | 14:13 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Add bionic to galaxy_info metadata https://review.openstack.org/588258 | 14:13 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_aodh master: Add bionic to galaxy_info metadata https://review.openstack.org/588259 | 14:13 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_barbican master: Add bionic to galaxy_info metadata https://review.openstack.org/588260 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ceilometer master: Add bionic to galaxy_info metadata https://review.openstack.org/588261 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_cinder master: Add bionic to galaxy_info metadata https://review.openstack.org/588262 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_designate master: Add bionic to galaxy_info metadata https://review.openstack.org/588263 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_glance master: Add bionic to galaxy_info metadata https://review.openstack.org/588264 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_gnocchi master: Add bionic to galaxy_info metadata https://review.openstack.org/588265 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_heat master: Add bionic to galaxy_info metadata https://review.openstack.org/588266 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_horizon master: Add bionic to galaxy_info metadata https://review.openstack.org/588267 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ironic master: Add bionic to galaxy_info metadata https://review.openstack.org/588268 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Add bionic to galaxy_info metadata https://review.openstack.org/588269 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Add bionic to galaxy_info metadata https://review.openstack.org/588270 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_molteniron master: Add bionic to galaxy_info metadata https://review.openstack.org/588271 | 14:14 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Add bionic to galaxy_info metadata https://review.openstack.org/588272 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: Add bionic to galaxy_info metadata https://review.openstack.org/588273 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Add bionic to galaxy_info metadata https://review.openstack.org/588274 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_rally master: Add bionic to galaxy_info metadata https://review.openstack.org/588275 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_sahara master: Add bionic to galaxy_info metadata https://review.openstack.org/588276 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_swift master: Add bionic to galaxy_info metadata https://review.openstack.org/588277 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tacker master: Add bionic to galaxy_info metadata https://review.openstack.org/588278 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Add bionic to galaxy_info metadata https://review.openstack.org/588279 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_trove master: Add bionic to galaxy_info metadata https://review.openstack.org/588280 | 14:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-rsyslog_client master: Add bionic to galaxy_info metadata https://review.openstack.org/588281 | 14:18 |
*** cshen has quit IRC | 14:19 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-rsyslog_server master: Add bionic to galaxy_info metadata https://review.openstack.org/588283 | 14:19 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-openstack_openrc master: Add bionic to galaxy_info metadata https://review.openstack.org/588284 | 14:19 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Add bionic to galaxy_info metadata https://review.openstack.org/588285 | 14:20 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_container_create master: Add bionic to galaxy_info metadata https://review.openstack.org/588287 | 14:20 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-galera_server master: Add bionic to galaxy_info metadata https://review.openstack.org/588289 | 14:20 |
odyssey4me | go jrosser go! | 14:23 |
jrosser | gross bash script time :) | 14:24 |
evrardjp | jrosser: haha | 14:25 |
evrardjp | jrosser: so they are all ready for voting? | 14:25 |
jrosser | evrardjp: will i'd have said they were | 14:26 |
jrosser | however theres a bunch now failing lxc cache prep which i've not been able to investigate yet | 14:26 |
evrardjp | let's make them independant of lxc then! :p | 14:27 |
*** biffi has quit IRC | 14:28 | |
odyssey4me | evrardjp: asked a question in https://review.openstack.org/#/c/588196/2 - if you can answer, then I'll revise | 14:28 |
odyssey4me | perfect, thanks evrardjp | 14:32 |
evrardjp | odyssey4me: please read my last comment | 14:34 |
evrardjp | for completeness :) | 14:34 |
evrardjp | not that it matters, you got things right in the first commit IMO. | 14:34 |
evrardjp | the rest is just bonus | 14:34 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-apt_package_pinning master: Add bionic to galaxy_info metadata https://review.openstack.org/588297 | 14:35 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: correct typo https://review.openstack.org/588301 | 14:43 |
odyssey4me | evrardjp: yep, will get to it a bit later again | 14:43 |
odyssey4me | cloudnull: FYI, you were right - tags don't work, so I've worked up a proposed fix which unfortunately will require patches to all repositories again... but it's scriptable | 14:44 |
cloudnull | buu... | 14:44 |
cloudnull | thats a bummer. | 14:44 |
cloudnull | but glad that its scriptable :) | 14:44 |
odyssey4me | meh, better to have caught it now than later | 14:44 |
cloudnull | hows it btw ? | 14:44 |
cloudnull | Rocky clouds are working BTW. my lab is now running the head of master. so progress :) | 14:45 |
savvas` | cloudnull: http://paste.openstack.org/show/727142/ we spoke about this yesterday (savvas). Same issue on fresh install, all nodes now | 14:46 |
savvas` | just wanted to provide you the additional feedback I owed you, what was it again that you wanted me to check / execute with blkid? | 14:48 |
cloudnull | can you run blkid -t PTTYPE=gpt /dev/loop0 | 14:49 |
cloudnull | what does that return ? | 14:49 |
cloudnull | that command is failing, id be curious if the it has any useful return information | 14:49 |
savvas` | no output | 14:51 |
savvas` | on none of them, all 3 nodes | 14:51 |
mgariepy | anyone has a playbook to shutdown the cluster ? | 14:52 |
*** tomtom002 has quit IRC | 14:56 | |
mnaser | morning everyone | 14:58 |
savvas` | morning | 14:59 |
*** vnogin has quit IRC | 15:02 | |
kaiokmo | morning | 15:04 |
cloudnull | mgariepy like a graceful power down ? | 15:07 |
*** FrankZhang has joined #openstack-ansible | 15:07 | |
cloudnull | I guess you could run `lxc-system-down stop-containers` then just poweroff the host ? | 15:08 |
cloudnull | savvas` what does `losetup -a` show ? | 15:08 |
savvas` | ./dev/loop0: [2049]:6816686 (/var/lib/machines.raw) | 15:09 |
savvas` | I think it is actually failing on the parted command | 15:09 |
savvas` | rather than the blkid | 15:09 |
savvas` | parted -s /dev/loop0 mklabel gpt | 15:09 |
savvas` | Error: Partition(s) on /dev/loop0 are being used. | 15:09 |
*** spatel_ has quit IRC | 15:09 | |
savvas` | when I unmount that, it'll go back to the fsyncing error we had last night | 15:10 |
savvas` | @cloudnull I am not sure how the loop device is otherwise used but I am almost certain that if I were to execute ceph-install.yml before running setup-infrastructure that I would probably not have this error, thoughts? | 15:12 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_openrc master: Add bionic to galaxy_info metadata https://review.openstack.org/588284 | 15:13 |
openstackgerrit | Merged openstack/openstack-ansible-os_molteniron master: Add bionic to galaxy_info metadata https://review.openstack.org/588271 | 15:13 |
bgmccollum | xteknoid did you set `neutron_dnsmasq_dns_servers` in your user_variables.yml? -- https://github.com/openstack/openstack-ansible-os_neutron/blob/stable/queens/defaults/main.yml#L337 | 15:13 |
cloudnull | savvas` that's the loop device for the containers, is there a loop device for the devices used by ceph? | 15:13 |
*** tomtom001 has joined #openstack-ansible | 15:14 | |
savvas` | well there are plenty available but the playbook seems to want to use loop0 | 15:14 |
cloudnull | yea thats odd. | 15:15 |
savvas` | and since it is executed after the tasks for setting up the containers, it crashes there | 15:15 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Add bionic to galaxy_info metadata https://review.openstack.org/588258 | 15:15 |
*** udesale has quit IRC | 15:15 | |
cloudnull | savvas` looks like that task is using the devices variable | 15:16 |
cloudnull | http://paste.openstack.org/show/727155/ | 15:16 |
cloudnull | from /etc/ansible/roles/ceph-ansible/roles/ceph-osd/tasks/check_gpt.yml | 15:17 |
mgariepy | cloudnull, yep gracefull | 15:17 |
cloudnull | is that lo device defined somewhere in your user_variables ? | 15:17 |
mgariepy | cloudnull, powered off the cluster, but galera didn't liked it. | 15:17 |
cloudnull | mgariepy maybe run something like `ansible -m shell -a 'systemctl stop neutron* nova* cinder* swift*; lxc-system-manager containers-stop; shutdown -P now' hosts` ? | 15:18 |
cloudnull | that would stop all of the process on the hosts. | 15:19 |
cloudnull | hault the containers gracefully | 15:19 |
cloudnull | then power down | 15:19 |
mgariepy | i did a shutdown on all the containers | 15:19 |
*** cshen has joined #openstack-ansible | 15:19 | |
mgariepy | but anyway. | 15:19 |
savvas` | don't think so cloudnull, the relevant bits pasted here: http://paste.openstack.org/show/727158/ | 15:21 |
openstackgerrit | Merged openstack/ansible-hardening master: Add bionic to galaxy_info metadata https://review.openstack.org/588254 | 15:22 |
cloudnull | savvas` I see devices is commented out. should that be defined ? | 15:22 |
cloudnull | with the actual devices your using for ceph ? | 15:23 |
savvas` | cloudnull: I had that before but on one of the test nodes the drives were misplaced so my ceph drive there is different, which lead me to turn on auto discovery | 15:23 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_almanach master: Add bionic to galaxy_info metadata https://review.openstack.org/588310 | 15:24 |
savvas` | I couldn't find the documentation on how to define the drives per node rather than in general | 15:24 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_congress master: Add bionic to galaxy_info metadata https://review.openstack.org/588311 | 15:24 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_masakari master: Add bionic to galaxy_info metadata https://review.openstack.org/588312 | 15:24 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_monasca master: Add bionic to galaxy_info metadata https://review.openstack.org/588313 | 15:24 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_searchlight master: Add bionic to galaxy_info metadata https://review.openstack.org/588314 | 15:24 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_watcher master: Add bionic to galaxy_info metadata https://review.openstack.org/588315 | 15:24 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_zaqar master: Add bionic to galaxy_info metadata https://review.openstack.org/588316 | 15:24 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_zun master: Add bionic to galaxy_info metadata https://review.openstack.org/588317 | 15:24 |
jrosser | mnaser: so much for patching with a script :) | 15:27 |
jrosser | let me just clean that all up.... | 15:27 |
cloudnull | savvas` I have my drives defined in the openstack_user_config under host vars. | 15:28 |
savvas` | similar to how I have it in user vars? | 15:28 |
savvas` | I'd like to think I tried that and it gave me an error | 15:28 |
cloudnull | https://gist.github.com/cloudnull/69bde16011d1ea94edf926252ea93933#file-openstack_user_config-yml-L115-L127 | 15:28 |
*** shyambiradar has joined #openstack-ansible | 15:30 | |
*** shyambiradar has quit IRC | 15:30 | |
*** shyambiradar has joined #openstack-ansible | 15:31 | |
savvas` | cloudnull: http://paste.openstack.org/show/727160/ now it skipped the task, probably because GPT labels were already on the drives, but the playbook completed successfully | 15:37 |
savvas` | so that solved it... So if you use osd_auto_discovery: true in your user_vars, this error I had turns up | 15:37 |
cloudnull | I wonder why ceph-ansible auto discovers the loop device? | 15:38 |
savvas` | http://paste.openstack.org/show/727161/ cluster seems healthy now | 15:38 |
cloudnull | cool! | 15:38 |
savvas` | very good question | 15:38 |
savvas` | lol, made no sense to me | 15:38 |
cloudnull | me neither, IMHO it should skip the loop device | 15:38 |
cloudnull | andymccr ^ | 15:38 |
cloudnull | but hey, I'm glad its fixed :) | 15:39 |
savvas` | yep me too, appreciate the help! | 15:39 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-apt_package_pinning master: List ubuntu releases in release order https://review.openstack.org/588297 | 15:41 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ceph_client master: List ubuntu releases in release order https://review.openstack.org/588256 | 15:42 |
openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: Fix config_template to work with Ansible 2.6 https://review.openstack.org/588322 | 15:42 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-memcached_server master: List ubuntu releases in release order https://review.openstack.org/588257 | 15:42 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-rsyslog_client master: List ubuntu releases in release order https://review.openstack.org/588281 | 15:43 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-rsyslog_server master: List ubuntu releases in release order https://review.openstack.org/588283 | 15:44 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: List ubuntu releases in release order https://review.openstack.org/588285 | 15:45 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-galera_server master: List ubnutu releases in release order https://review.openstack.org/588289 | 15:45 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-galera_server master: List ubuntu releases in release order https://review.openstack.org/588289 | 15:48 |
*** hamzy has quit IRC | 15:49 | |
*** shyambiradar has quit IRC | 15:54 | |
openstackgerrit | Logan V proposed openstack/openstack-ansible stable/queens: Update ceph galaxy cleanup for monolithic repo https://review.openstack.org/588324 | 15:56 |
*** DanyC has joined #openstack-ansible | 16:04 | |
*** cshen has quit IRC | 16:13 | |
*** spotz has quit IRC | 16:18 | |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_keystone master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/584479 | 16:25 |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_cinder master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/582632 | 16:27 |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_neutron master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/583021 | 16:29 |
* jrosser struggles to understand why this fails the check but not locally http://logs.openstack.org/07/586607/4/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/22b95de/logs/host/lxc-cache-prep-commands.log | 16:29 | |
*** gyee has joined #openstack-ansible | 16:35 | |
logan- | jrosser: https://stackoverflow.com/questions/46673717/gpg-cant-connect-to-the-agent-ipc-connect-call-failed maybe? | 16:39 |
logan- | seems unlikely that there'd be a gpg agent running on the gate nodes but who knows | 16:40 |
*** tosky has quit IRC | 16:41 | |
odyssey4me | well, that's being run inside the chroot | 16:45 |
logan- | maybe relevant: https://github.com/Microsoft/WSL/issues/3286 | 16:49 |
logan- | well maybe not actually | 16:50 |
jrosser | it works for me on a bionic virtualbox | 17:01 |
jrosser | but as the gate logs are a bit fubar i'm not actually sure if the same gpg stuff is installed | 17:02 |
openstackgerrit | Logan V proposed openstack/openstack-ansible-lxc_hosts master: Add verbose flag to container prep apt-key add https://review.openstack.org/588343 | 17:02 |
*** vnogin has joined #openstack-ansible | 17:02 | |
* jrosser runs for train - will look at this again later | 17:03 | |
*** vnogin has quit IRC | 17:07 | |
*** hamzy has joined #openstack-ansible | 17:11 | |
*** cshen has joined #openstack-ansible | 17:16 | |
mnaser | has anyone seen rsyslog spamming journals with this? | 17:23 |
mnaser | rsyslogd[705557]: action 'action 2' resumed (module 'builtin:omfile') [v8.24.0 try http://www.rsyslog.com/e/2359 ] | 17:23 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: Add target_helper to backend_defaults https://review.openstack.org/584604 | 17:34 |
cloudnull | mnaser i've not | 17:35 |
cloudnull | an upraded environment ? | 17:35 |
jrosser | can i download or recreate the infra bionic image somehow? | 17:38 |
jrosser | so i can test exactly the same environment here | 17:39 |
logan- | yes there is jrosser let me find hte link | 17:40 |
openstackgerrit | Jacob Wagner proposed openstack/openstack-ansible-ops master: Add ability to deploy Ceph into a Multinode AIO https://review.openstack.org/585003 | 17:42 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: correct typo https://review.openstack.org/588301 | 17:42 |
logan- | jrosser: https://nb01.openstack.org/images/ | 17:45 |
logan- | and https://nb02.openstack.org/images/ | 17:46 |
jrosser | logan-: ah excellent, looks loke some logs too so maybe a clue if anything has changed | 17:48 |
logan- | yep! | 17:48 |
jrosser | previously it got all the way to an inevitable tempest fail, so the lxc cache prep has worked in the last 24hrs or so | 17:50 |
logan- | yea agreed, we had jobs passing until a day or so ago | 17:55 |
*** poopcat has joined #openstack-ansible | 17:55 | |
jrosser | plus ive not seen anything obvious committed that would break this | 17:57 |
jrosser | perhaps theres something lurking in another broken ubuntu-18.04 -> ubuntu.yml | 17:57 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Cleanup duplcate keys https://review.openstack.org/588354 | 18:01 |
*** electrofelix has quit IRC | 18:02 | |
*** pathcl_ has quit IRC | 18:15 | |
bgmccollum | anyone been able to figure out whats going on with cinder in master? -- this is the tail of the cinder-scheduler.log...relevant? -- http://paste.openstack.org/show/727170/ | 18:28 |
bgmccollum | i know there was some shuffling of MQ setup in / out of roles... | 18:29 |
mnaser | cloudnull: thanks for pushing up that rebase on os_cinder | 18:30 |
cloudnull | bgmccollum is that an AIO ? | 18:31 |
bgmccollum | gate | 18:31 |
cloudnull | ok. | 18:32 |
bgmccollum | http://logs.openstack.org/29/587229/1/check/openstack-ansible-deploy-aio_basekit-opensuse-423/009c7fd/logs/openstack/aio1_cinder_api_container-f87e97b0/cinder/cinder-scheduler.log | 18:32 |
mgariepy | mnaser, i've seen something similar on a release upgrade from 14.04 > 16.04 | 18:32 |
mgariepy | but not spammy, only a couple entry per host. | 18:32 |
mgariepy | not osa managed. | 18:32 |
cloudnull | bgmccollum likely due to all of the MQ config movement | 18:32 |
cloudnull | ^ odyssey4me | 18:33 |
odyssey4me | bgmccollum: seen that and tried to figure it out with jrosser but haven't yet | 18:35 |
odyssey4me | I know with certainty that https://review.openstack.org/585504 works properly. | 18:35 |
odyssey4me | I've got a build up to work out how to turn off the one test that keeps failing for tempest so that we can merge patches again while we work the issue out. | 18:37 |
odyssey4me | Unless someone can pinpoint the issue. | 18:37 |
*** cshen has quit IRC | 18:37 | |
*** cshen has joined #openstack-ansible | 18:41 | |
jrosser | odyssey4me: gimme 30mins or so and i'll look at todays AIO and see if cinder started | 18:42 |
odyssey4me | cloudnull: could you take a peek at https://review.openstack.org/#/c/588196/2 and see if you have any further suggestions beyond what evrardjp has put into review | 18:42 |
odyssey4me | I've verified that both the tags implemented there work. | 18:42 |
odyssey4me | any cores, please review https://review.openstack.org/588230 to also unblock things | 18:48 |
mgariepy | odyssey4me, done. | 18:54 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Disable tempest.scenario.test_minimum_basic temporarily https://review.openstack.org/588360 | 18:55 |
odyssey4me | thanks mgariepy | 18:55 |
odyssey4me | logan- cloudnull mgariepy evrardjp I feel that after weeks of struggling, with many patches being held back, perhaps it's time to regroup and remove the blocker for now. See https://review.openstack.org/588360 | 18:56 |
odyssey4me | mnaser ^ | 18:56 |
odyssey4me | Perhaps we'll switch to using mnaser's suggestion of smoke tests, but we still need time to work out those failures too. | 18:56 |
odyssey4me | part of the motivation is because a ton of the patches waiting to merge resolve known issues - like broken gate log collection, and broken cinder mq config | 19:00 |
openstackgerrit | Byron McCollum proposed openstack/openstack-ansible master: Fix Bootstrap AIO Passing Multiple BOOTSTRAP_OPTS https://review.openstack.org/587229 | 19:01 |
jamesdenton | Before i go down some rabbit hole, does OSA provide any NUMA CPU Pinning tunables? | 19:02 |
odyssey4me | jamesdenton: typically we try to encourage using the config overrides where possible, rather than introduce new tunables | 19:04 |
*** vnogin has joined #openstack-ansible | 19:04 | |
odyssey4me | https://docs.openstack.org/openstack-ansible/latest/reference/configuration/using-overrides.html#overriding-openstack-configuration-defaults | 19:04 |
jamesdenton | ok fair enough. thank you | 19:05 |
odyssey4me | jamesdenton: *if* some sort of wiring of sensible default makes sense then we can either hard code it into the template with a conditional, or add tunables | 19:05 |
odyssey4me | but more vars makes things harder to figure out | 19:05 |
odyssey4me | that should have read wiring *or* sensible... | 19:06 |
jamesdenton | right, i got ya | 19:06 |
odyssey4me | config overrides actually override tunables anyway | 19:06 |
jamesdenton | thanks Jesse | 19:08 |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_nova master: Setup oslo.messaging extra packages for optional drivers https://review.openstack.org/584450 | 19:12 |
*** mgariepy has quit IRC | 19:14 | |
jrosser | odyssey4me: cinder-scheduler seems to be up | 19:14 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Add tempest test blacklist capability https://review.openstack.org/588362 | 19:15 |
odyssey4me | d34dh0r53: I think https://review.openstack.org/588362 may be useful to you. | 19:15 |
*** savvas has joined #openstack-ansible | 19:23 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Add tempest test blacklist capability https://review.openstack.org/588362 | 19:24 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Add tempest test blacklist capability https://review.openstack.org/588362 | 19:24 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Add tempest test blacklist capability https://review.openstack.org/588362 | 19:24 |
odyssey4me | sorry for the spam, changes method part way through and didn't back out properly | 19:25 |
jrosser | odyssey4me: this AIO fails swift though on [os_swift : Verify md5sum of builder files] | 19:25 |
odyssey4me | jrosser: that does happen from time to time, the thoughts on that is that it's due to resource contention - and it's not been consistent, so it's hard to truly figure out | 19:26 |
d34dh0r53 | odyssey4me: that looks perfect | 19:26 |
d34dh0r53 | jrosser: I've been hitting that as well, quite frequently lately | 19:26 |
odyssey4me | I'd like to discuss possibly reconfiguring the AIO to not bother with swift any more, and perhaps focus on NFS/Ceph as default tests instead. | 19:27 |
jrosser | odyssey4me: ok no problem - cinder looks good but tbh i'd like to run this again, i had a bit of a fight applying your patches (my own fault) so it didnt get a clean run at everything | 19:27 |
odyssey4me | d34dh0r53: orly? any consistency in it - or just transient? | 19:27 |
bgmccollum | jrosser can you check the cinder-scheduler.log for any errors? | 19:27 |
d34dh0r53 | odyssey4me: my current mnaio is running swift now, I'll let you know | 19:28 |
jrosser | bgmccollum: i think you posted the same errors that odyssey4me and i were looking into yesterday? | 19:28 |
d34dh0r53 | odyssey4me: it's been rather consistent for me (as long as ansible doesn't run out of memory first) | 19:28 |
bgmccollum | jrosser gotcha... | 19:28 |
jrosser | i don't have those in this build | 19:28 |
bgmccollum | is it this patch you were testing? -- https://review.openstack.org/#/c/585504/ | 19:29 |
jrosser | https://review.openstack.org/#/c/586607/ then https://review.openstack.org/#/c/585504/ then https://review.openstack.org/#/c/586226/ | 19:31 |
bgmccollum | 👍 | 19:31 |
openstackgerrit | Michael Vollman proposed openstack/ansible-config_template master: Compare dict vars to determine changed https://review.openstack.org/582532 | 19:32 |
savvas | any known issues with out of the box OA Queens deployment for live migration? (Nodes running Ubuntu, not CentOS) | 19:33 |
d34dh0r53 | odyssey4me: my latest MNAIO just passed, but it's RPC-O stable/queens, staring an OSA one now, I'll let you know | 19:33 |
openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Revert "Use generic vars file for ubuntu" https://review.openstack.org/588230 | 19:34 |
openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: List ubuntu releases in release order https://review.openstack.org/588257 | 19:43 |
openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client master: List ubuntu releases in release order https://review.openstack.org/588281 | 19:44 |
openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: List ubuntu releases in release order https://review.openstack.org/588283 | 19:44 |
openstackgerrit | Merged openstack/openstack-ansible-apt_package_pinning master: List ubuntu releases in release order https://review.openstack.org/588297 | 19:44 |
*** vollman has quit IRC | 19:45 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Allow tags to be used for MQ tasks https://review.openstack.org/588196 | 19:46 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Allow tags to be used for MQ tasks https://review.openstack.org/588190 | 19:49 |
*** vollman has joined #openstack-ansible | 19:50 | |
mnaser | odyssey4me: https://review.openstack.org/#/c/587508 fyi, be good if you +A that as you did most/alot of the work for the sync stuff! | 19:50 |
openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: List ubuntu releases in release order https://review.openstack.org/588256 | 19:50 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: List ubuntu releases in release order https://review.openstack.org/588285 | 19:50 |
odyssey4me | mnaser: haha lol | 19:53 |
odyssey4me | oh crap, that's going to cause proposal bot spam | 19:53 |
mnaser | odyssey4me: which is why i needed us to be sure that change was clean, haha | 19:54 |
mnaser | weekend is coming up soon | 19:54 |
mnaser | we can leverage an empty gate | 19:54 |
mnaser | :P | 19:54 |
odyssey4me | mnaser: well, discovered an important operator use-case which that didn't work with - so that whole file is going to change: https://review.openstack.org/588196 | 19:55 |
odyssey4me | that is, assuming everyone is ok with the new pattern | 19:55 |
*** savvas has quit IRC | 19:58 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [WIP] Engage afterburner during git-clone [1] https://review.openstack.org/588372 | 20:03 |
jrosser | odyssey4me: ^ i reckon you could get good mileage with that in the repo build too | 20:03 |
odyssey4me | afterburner :) | 20:04 |
odyssey4me | FYI that's not useful for the role clone in openstack-infra, but is perhaps outside | 20:05 |
odyssey4me | within infra, the repositories are already there - they just get updated | 20:05 |
jrosser | quite happy to have a sensible commit message if its useful :) | 20:07 |
jrosser | it takes really very long indeed during boostrap-ansible and repo stuff to clone the repos | 20:07 |
jrosser | we can probably take 10mins off the build time | 20:08 |
mnaser | https://review.openstack.org/#/c/584604/ | 20:09 |
jrosser | anyway i just throw that up becasue i'm out pretty much till next week and wanted people to get a look / comment | 20:09 |
mnaser | anyone has ideas on how to inject $PATH without messing too much things? | 20:09 |
jrosser | mnaser: in an ansible task? | 20:10 |
mnaser | i know we can add it to systemd env but the problem with it is that we might miss another path which is part of the default path and breaking something lse | 20:10 |
odyssey4me | jrosser: yeah, thanks for sharing it! | 20:10 |
mnaser | cause if we do indeed add it, we might have this weird situation that we missed a path | 20:10 |
mnaser | and i dont think $PATH expansion works in systemd unit files | 20:11 |
mnaser | https://unix.stackexchange.com/questions/347873/set-path-for-a-systemd-unit | 20:11 |
mnaser | wrapping in bash feels dirty | 20:11 |
mnaser | i cant think of another way than hardcoding /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin :< | 20:12 |
*** savvas has joined #openstack-ansible | 20:12 | |
odyssey4me | ok, I'm out for the night folks - chat to y'all tomorrow! | 20:13 |
jrosser | mnaser: https://www.freedesktop.org/software/systemd/man/systemd.exec.html#PassEnvironment= | 20:14 |
jrosser | is that the sort of thing? | 20:14 |
mnaser | hmm thats interesting | 20:15 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [WIP] Engage afterburner during git-clone https://review.openstack.org/588372 | 20:20 |
kaiokmo | mnaser: any thoughts here? http://logs.openstack.org/33/586933/3/gate/openstack-ansible-functional-ubuntu-bionic/49e1e4e/job-output.txt.gz#_2018-08-02_20_06_56_181834 | 20:24 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_cinder master: Add target_helper to backend_defaults https://review.openstack.org/584604 | 20:24 |
kaiokmo | I'm also facing this same fail here http://logs.openstack.org/32/586932/2/check/openstack-ansible-functional-ubuntu-bionic/e45ba51/job-output.txt.gz#_2018-08-02_14_59_12_062648 | 20:25 |
mnaser | kaiokmo: when you run into these things where you have to look is in the cache prep log | 20:25 |
mnaser | which you can find in logs/host/lxc-cache-prep-commands.log.txt.gz | 20:25 |
mnaser | in this case -- right here -- http://logs.openstack.org/33/586933/3/gate/openstack-ansible-functional-ubuntu-bionic/49e1e4e/logs/host/lxc-cache-prep-commands.log.txt.gz | 20:25 |
mnaser | gpg: can't connect to the agent: IPC connect call failed | 20:26 |
mnaser | so it looks like some sort of transient issue, but it looks like logan- proposed this to help make with visiblity on why it fails there | 20:27 |
mnaser | https://review.openstack.org/#/c/588343/ | 20:27 |
mnaser | kaiokmo: so i would recheck and cross my fingers, till we find out whats the cause of this | 20:27 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Switch to using project-templates https://review.openstack.org/588380 | 20:28 |
mnaser | yeah it's happening all over bionic | 20:28 |
jrosser | i've still not found why thats happening | 20:28 |
kaiokmo | ah, I see it now | 20:28 |
jrosser | if anyone fancies a dig then please do as i've got little time till next week now | 20:28 |
mnaser | jrosser: https://review.openstack.org/#/c/588343/ | 20:28 |
mnaser | i think that might start giving us some more help as to what gets added and what fails | 20:29 |
openstackgerrit | Merged openstack/openstack-ansible-os_zun master: Add bionic to galaxy_info metadata https://review.openstack.org/588317 | 20:29 |
kaiokmo | thanks mnaser | 20:29 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Add bionic to galaxy_info metadata https://review.openstack.org/588270 | 20:29 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_octavia master: Add bionic to galaxy_info metadata https://review.openstack.org/588274 | 20:30 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_searchlight master: Add bionic to galaxy_info metadata https://review.openstack.org/588314 | 20:33 |
logan- | jrosser: surprised to see bionic pass on https://review.openstack.org/588343 | 20:35 |
jrosser | logan-: yes its not every time | 20:35 |
logan- | Ah | 20:35 |
jrosser | i wonder if it installs and start gpg agent but it's all a bit racy | 20:35 |
jrosser | mnaser: i got a bunch of others here to add the CI https://review.openstack.org/#/q/topic:bionic-check+(status:open+OR+status:merged) | 20:36 |
jrosser | i've just added some depends-on to the bionic-meta reviews | 20:37 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_zaqar master: Add bionic to galaxy_info metadata https://review.openstack.org/588316 | 20:38 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_almanach master: Add bionic to galaxy_info metadata https://review.openstack.org/588310 | 20:39 |
*** ansmith has quit IRC | 20:39 | |
*** hamzy has quit IRC | 20:40 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_watcher master: Add bionic to galaxy_info metadata https://review.openstack.org/588315 | 20:43 |
*** vnogin has quit IRC | 20:45 | |
jrosser | logan-: if you look here http://zuul.openstack.org/builds.html and filter for openstack-ansible-functional-ubuntu-bionic you see what hit/missed | 20:46 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update index retention policy to ensure its an int https://review.openstack.org/588389 | 20:47 |
*** tosky has joined #openstack-ansible | 20:50 | |
*** savvas has quit IRC | 20:50 | |
d34dh0r53 | lol, java-isms | 20:51 |
jrosser | false = 5, sure, why not! | 20:53 |
d34dh0r53 | hah | 20:57 |
d34dh0r53 | well, it has 5 letters, so yeah, 5 let's go with that | 20:57 |
mnaser | you know what that reminds me of | 20:57 |
mnaser | https://www.destroyallsoftware.com/talks/wat | 20:57 |
d34dh0r53 | :) one of my favorite talks | 20:58 |
mnaser | i feel like i should do a 'wat' lightning talk but in openstack context | 20:58 |
*** vnogin has joined #openstack-ansible | 20:59 | |
*** priteau has quit IRC | 20:59 | |
openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Convert role to use a common systemd service role https://review.openstack.org/574817 | 21:08 |
openstackgerrit | Merged openstack/openstack-ansible stable/queens: Rename designate_galera_database_name https://review.openstack.org/587931 | 21:09 |
*** FrankZhang_ has joined #openstack-ansible | 21:16 | |
*** dcdamien has quit IRC | 21:17 | |
*** FrankZhang has quit IRC | 21:18 | |
*** FrankZhang_ has quit IRC | 21:22 | |
*** cshen has quit IRC | 21:23 | |
*** dmsimard has quit IRC | 21:24 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ironic master: Add bionic to galaxy_info metadata https://review.openstack.org/588268 | 21:25 |
*** vnogin has quit IRC | 21:26 | |
*** dmsimard has joined #openstack-ansible | 21:32 | |
*** ansmith has joined #openstack-ansible | 21:33 | |
*** vnogin has joined #openstack-ansible | 21:41 | |
*** vnogin has quit IRC | 22:08 | |
*** cshen has joined #openstack-ansible | 22:10 | |
*** cshen has quit IRC | 22:14 | |
*** vnogin has joined #openstack-ansible | 22:19 | |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-ops master: Deploy ELK in MNAIO https://review.openstack.org/586612 | 22:34 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Add route when required on the local table https://review.openstack.org/588406 | 22:39 |
cloudnull | d34dh0r53 jrosser :) | 22:40 |
*** lkoranda has quit IRC | 22:46 | |
*** lkoranda has joined #openstack-ansible | 22:49 | |
*** tosky has quit IRC | 22:59 | |
openstackgerrit | Merged openstack/openstack-ansible stable/queens: Replace default pip index check with upper constraints check https://review.openstack.org/587860 | 23:02 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!