ThiagoCMC | Hey guys, the following command/"TASK" is failing when with nspawn: "wget http://172.29.239.250:8181/os-releases/18.0.0/ubuntu-18.04-x86_64/requirements_absolute_requirements.txt", error: 503: Service Unavailable. | 00:02 |
---|---|---|
ThiagoCMC | Any idea? | 00:02 |
*** aredinger has joined #openstack-ansible | 00:03 | |
ThiagoCMC | TASK [Get list of repo packages] | 00:05 |
ThiagoCMC | Utility container | 00:05 |
ThiagoCMC | Only 1 of 3 failed! I don't think that it is a coincidence that it failed right on the same machine where the VIP is! Hmmm... | 00:06 |
*** aredinger has quit IRC | 00:07 | |
ThiagoCMC | I'll ignore this bug, since I have 2 more utility containers =P | 00:07 |
*** marst has quit IRC | 00:21 | |
*** mmercer has quit IRC | 00:37 | |
*** cshen has joined #openstack-ansible | 00:51 | |
*** fatdragon128 has joined #openstack-ansible | 00:56 | |
*** cshen has quit IRC | 00:56 | |
*** fatdragon has quit IRC | 00:56 | |
*** nsmeds_ has quit IRC | 00:57 | |
*** fatdragon128 has quit IRC | 00:58 | |
*** ansmith_ has joined #openstack-ansible | 01:02 | |
*** aredinger has joined #openstack-ansible | 01:03 | |
*** aredinger has quit IRC | 01:08 | |
*** lbragstad has quit IRC | 01:49 | |
*** lbragstad has joined #openstack-ansible | 01:49 | |
*** aredinger has joined #openstack-ansible | 02:03 | |
*** aredinger has quit IRC | 02:10 | |
*** adrianreza has joined #openstack-ansible | 02:31 | |
*** aredinger has joined #openstack-ansible | 02:35 | |
*** aredinger has quit IRC | 02:51 | |
*** cshen has joined #openstack-ansible | 02:52 | |
*** cshen has quit IRC | 02:57 | |
*** aredinger has joined #openstack-ansible | 03:03 | |
*** aredinger has quit IRC | 03:07 | |
*** aredinger has joined #openstack-ansible | 03:22 | |
*** aredinger has quit IRC | 03:27 | |
*** udesale has joined #openstack-ansible | 03:51 | |
*** aredinger has joined #openstack-ansible | 03:59 | |
*** aredinger has quit IRC | 04:07 | |
*** dave-mccowan has quit IRC | 04:14 | |
*** ThiagoCMC has quit IRC | 04:31 | |
*** aredinger has joined #openstack-ansible | 05:03 | |
*** aredinger has quit IRC | 05:07 | |
*** shyamb has joined #openstack-ansible | 05:25 | |
*** shyamb has quit IRC | 05:37 | |
*** shyamb has joined #openstack-ansible | 05:47 | |
*** cshen has joined #openstack-ansible | 05:50 | |
*** dw_ has joined #openstack-ansible | 05:50 | |
*** evrardjp_ has joined #openstack-ansible | 05:51 | |
*** irclogbot_0 has quit IRC | 05:55 | |
*** evrardjp has quit IRC | 05:55 | |
*** mattoliverau has quit IRC | 05:55 | |
*** bradm has quit IRC | 05:55 | |
*** chkumar|off has quit IRC | 05:55 | |
*** arbrandes1 has quit IRC | 05:55 | |
*** mpjetta has quit IRC | 05:55 | |
*** dw has quit IRC | 05:55 | |
*** arbrandes1 has joined #openstack-ansible | 06:02 | |
*** aredinger has joined #openstack-ansible | 06:03 | |
*** chandankumar has joined #openstack-ansible | 06:06 | |
*** aredinger has quit IRC | 06:07 | |
*** shyamb has quit IRC | 06:13 | |
*** faizy_ has joined #openstack-ansible | 06:20 | |
*** faizy98 has quit IRC | 06:24 | |
*** cshen has quit IRC | 06:28 | |
*** shyamb has joined #openstack-ansible | 06:31 | |
*** cshen has joined #openstack-ansible | 06:53 | |
*** aredinger has joined #openstack-ansible | 07:03 | |
*** aredinger has quit IRC | 07:07 | |
*** DanyC has joined #openstack-ansible | 07:18 | |
*** shardy has joined #openstack-ansible | 07:26 | |
*** shyamb has quit IRC | 07:28 | |
evrardjp_ | prometheanfire: read two lines above :) | 07:37 |
*** evrardjp_ is now known as evrardjp | 07:37 | |
*** shyamb has joined #openstack-ansible | 07:39 | |
*** vnogin has joined #openstack-ansible | 07:44 | |
*** tosky has joined #openstack-ansible | 07:46 | |
*** vnogin has quit IRC | 07:49 | |
*** DanyC has quit IRC | 07:53 | |
openstackgerrit | KimMinsik proposed openstack/openstack-ansible master: Aodh group vars has wrong admin and internal endpoint url https://review.openstack.org/613521 | 07:54 |
*** thuydang has joined #openstack-ansible | 07:55 | |
*** aredinger has joined #openstack-ansible | 08:03 | |
openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro https://review.openstack.org/591424 | 08:03 |
chandankumar | evrardjp: done :-) | 08:03 |
*** hamzaachi has joined #openstack-ansible | 08:03 | |
*** shyamb has quit IRC | 08:03 | |
*** thuydang has quit IRC | 08:07 | |
*** aredinger has quit IRC | 08:07 | |
*** thuydang has joined #openstack-ansible | 08:07 | |
*** vollman has quit IRC | 08:11 | |
*** DanyC has joined #openstack-ansible | 08:16 | |
openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro https://review.openstack.org/591424 | 08:18 |
openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro https://review.openstack.org/591424 | 08:19 |
*** thuydang has quit IRC | 08:23 | |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Use consistent apt options for upgrades https://review.openstack.org/613407 | 08:27 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/rocky: Use consistent apt options for upgrades https://review.openstack.org/613526 | 08:28 |
odyssey4me | cores, thanks to some upstream image shenanigans for ubuntu we'll need to get https://review.openstack.org/613526 into stable/rocky asap | 08:29 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/queens: Use consistent apt options for upgrades https://review.openstack.org/613527 | 08:31 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/pike: Use consistent apt options for upgrades https://review.openstack.org/613528 | 08:31 |
odyssey4me | well, make that https://review.openstack.org/#/q/Ic6689387a28539b7eb341d55a9db08f078e8e975 jrosser evrardjp hwoarang | 08:33 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_keystone master: [DNM] - Testing OBS Master https://review.openstack.org/570543 | 08:33 |
mbuil | it would be great if somebody could review: https://review.openstack.org/#/c/613104/, thanks :) | 08:33 |
hwoarang | checking | 08:33 |
hwoarang | odyssey4me: no problem it's not a huge change | 08:34 |
*** cshen has quit IRC | 08:35 | |
hwoarang | i wish i knew why leap15 is so much slower in zuul compared to 42.3 :/ | 08:36 |
eumel8 | odyssey4me: now we're ready for you: https://review.openstack.org/#/c/612510/ | 08:38 |
eumel8 | unfortunatelly the translated index pages will not shown yet. The fix is hopefully in https://review.openstack.org/#/c/613531/ | 08:40 |
odyssey4me | eumel8: ah, awesome :) | 08:41 |
odyssey4me | eumel8: does that doc job do doc8, or do we still need to do doc8 in our lint test? | 08:41 |
eumel8 | odyssey4me: it seems so: http://logs.openstack.org/10/612510/2/check/openstack-tox-docs/49b2fec/job-output.txt.gz#_2018-10-26_06_38_00_937681 | 08:44 |
odyssey4me | eumel8: ah, that's because we told it to: https://github.com/openstack/openstack-ansible/blob/master/tox.ini#L45 | 08:51 |
*** spatel has joined #openstack-ansible | 08:52 | |
*** spatel has quit IRC | 08:56 | |
*** cshen has joined #openstack-ansible | 08:59 | |
*** hamzaachi has quit IRC | 09:01 | |
*** aredinger has joined #openstack-ansible | 09:03 | |
*** shyamb has joined #openstack-ansible | 09:05 | |
*** aredinger has quit IRC | 09:08 | |
eumel8 | odyssey4me: ah, ok, got it. What I saw, the Zuul job simply calls tox -edocs and there is no doc8 extra. So it should be in tox.ini | 09:12 |
odyssey4me | eumel8: yeah, so we're good on that front for now | 09:17 |
eumel8 | :odyssey4me: yeah, I have one trivial proposal for doc fixes: https://review.openstack.org/#/c/602866/ Later we need a deeper look into build warnings. There are some more. | 09:20 |
evrardjp | eumel8: thanks! | 09:32 |
openstackgerrit | Damian Cikowski proposed openstack/openstack-ansible-os_cinder master: tasks: cinder_qos: Use the new OpenStack CLI client https://review.openstack.org/561218 | 09:43 |
*** shyamb has quit IRC | 09:43 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-openstack_hosts master: SUSE: Add system-user-nobody for Leap 15 https://review.openstack.org/613547 | 09:55 |
*** aredinger has joined #openstack-ansible | 09:55 | |
*** electrofelix has joined #openstack-ansible | 09:58 | |
*** aredinger has quit IRC | 09:59 | |
*** aredinger has joined #openstack-ansible | 10:03 | |
*** hamzaachi has joined #openstack-ansible | 10:03 | |
evrardjp | thanks hwoarang | 10:06 |
openstackgerrit | Merged openstack/openstack-ansible master: [trivial] docs: fix sphinx warnings unknown options https://review.openstack.org/602866 | 10:06 |
*** aredinger has quit IRC | 10:07 | |
*** shyamb has joined #openstack-ansible | 10:12 | |
*** shyamb has quit IRC | 10:24 | |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/rocky: Use consistent apt options for upgrades https://review.openstack.org/613526 | 10:34 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/pike: Use consistent apt options for upgrades https://review.openstack.org/613528 | 10:54 |
openstackgerrit | Merged openstack/openstack-ansible master: Example setup for gnocchi with ceph and redis https://review.openstack.org/582946 | 10:55 |
*** sum12 has quit IRC | 11:00 | |
openstackgerrit | Merged openstack/openstack-ansible-memcached_server stable/rocky: Change netcat to be a required package https://review.openstack.org/613290 | 11:00 |
openstackgerrit | Merged openstack/openstack-ansible-memcached_server stable/ocata: Change netcat to be a required package https://review.openstack.org/613293 | 11:00 |
openstackgerrit | Merged openstack/openstack-ansible-memcached_server stable/queens: Change netcat to be a required package https://review.openstack.org/613291 | 11:00 |
openstackgerrit | Merged openstack/openstack-ansible-memcached_server stable/pike: Change netcat to be a required package https://review.openstack.org/613292 | 11:00 |
*** sum12 has joined #openstack-ansible | 11:02 | |
*** aredinger has joined #openstack-ansible | 11:03 | |
*** aredinger has quit IRC | 11:07 | |
*** vnogin has joined #openstack-ansible | 11:08 | |
*** dave-mccowan has joined #openstack-ansible | 11:14 | |
*** shyamb has joined #openstack-ansible | 11:15 | |
*** tridde is now known as trident | 11:17 | |
*** vnogin has quit IRC | 11:25 | |
*** udesale has quit IRC | 11:28 | |
*** vnogin has joined #openstack-ansible | 11:32 | |
*** hamzaachi has quit IRC | 11:35 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Update lxc_hosts role SHA for apt failures https://review.openstack.org/613560 | 11:37 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Update repo_build role SHA for venv build fail fix https://review.openstack.org/613327 | 11:37 |
odyssey4me | evrardjp: FYI https://review.openstack.org/613560 and https://review.openstack.org/613327 must merge before we request a release for rocky, they're both release blockers | 11:38 |
*** ansmith_ has quit IRC | 11:39 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update lxc_hosts role SHA for apt failures https://review.openstack.org/613561 | 11:40 |
openstackgerrit | Merged openstack/openstack-ansible-os_magnum stable/queens: Use keystone_auth for credentials https://review.openstack.org/612193 | 11:45 |
openstackgerrit | Merged openstack/openstack-ansible-os_magnum stable/queens: Disable sending metrics for clusters https://review.openstack.org/612192 | 11:47 |
*** strobelight has joined #openstack-ansible | 11:48 | |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: SUSE: Fix version compare for OBS containers repository https://review.openstack.org/613334 | 12:00 |
*** aredinger has joined #openstack-ansible | 12:03 | |
*** aredinger has quit IRC | 12:07 | |
*** shyamb has quit IRC | 12:12 | |
*** strattao has joined #openstack-ansible | 12:16 | |
*** vnogin has quit IRC | 12:17 | |
*** strobelight_ has joined #openstack-ansible | 12:29 | |
*** strobelight is now known as Guest85353 | 12:29 | |
*** strobelight_ is now known as strobelight | 12:30 | |
*** Guest85353 has quit IRC | 12:32 | |
*** shyamb has joined #openstack-ansible | 12:34 | |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/ocata: Add memcache flushing handler on db migrations https://review.openstack.org/613325 | 12:45 |
*** hamzaachi has joined #openstack-ansible | 12:46 | |
*** shyamb has quit IRC | 12:47 | |
*** aredinger has joined #openstack-ansible | 12:47 | |
*** ansmith_ has joined #openstack-ansible | 12:59 | |
*** dave-mccowan has quit IRC | 13:00 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: test-log-collect: Improve rsync performance for log collection https://review.openstack.org/613573 | 13:01 |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/pike: Add memcache flushing handler on db migrations https://review.openstack.org/613323 | 13:06 |
openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Clean up a-r-r role for upgrade test removal https://review.openstack.org/613331 | 13:08 |
chandankumar | odyssey4me: mnaser https://review.openstack.org/#/c/591424/ distro support tempest patch is good to go | 13:10 |
chandankumar | odyssey4me: evrardjp thank you for all the help on this patch :-) | 13:11 |
odyssey4me | LGTM, thanks chandankumar :) | 13:11 |
chandankumar | \o/ | 13:12 |
chandankumar | thanks :-) | 13:12 |
chandankumar | odyssey4me: I think we can other projects use tempest plugins rpm and to run tests what you say? | 13:14 |
chandankumar | *can enable | 13:14 |
odyssey4me | chandankumar: by 'other projects' what do you mean? | 13:14 |
chandankumar | odyssey4me: I mean running cinder specific tempests if cinder is configured using rpm then running cinder tempest plugins tests from python-cinder-tests-tempest rpm package in ci job | 13:15 |
chandankumar | agaisnt os_cinder project | 13:15 |
odyssey4me | chandankumar: we already use the source builds for that in all OSA roles | 13:15 |
odyssey4me | chandankumar: also, once that merges - https://github.com/openstack/openstack-ansible-tests/blob/master/test-distro_install-vars.yml#L54 is already there, so all distro install tests will start to use the distro install instead immediately | 13:17 |
odyssey4me | chandankumar: I hope you're ready to get patching when things start breaking ;) | 13:17 |
chandankumar | odyssey4me: but we need to add the right package name for the same for example here https://github.com/openstack/openstack-ansible-os_cinder/blob/master/vars/redhat-7.yml | 13:18 |
*** spatel has joined #openstack-ansible | 13:19 | |
chandankumar | Ah it is removed from here https://github.com/openstack/openstack-ansible-os_cinder/blob/master/tests/os_cinder-overrides.yml | 13:19 |
chandankumar | odyssey4me: I can patch if things will break | 13:19 |
odyssey4me | chandankumar: so jrosser and I were discussing something around this yesterday | 13:20 |
odyssey4me | currently we have a bunch of the plugin repositories set here: https://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/main.yml | 13:20 |
odyssey4me | I suspect that we might need to revise things so that we have an easy way to enable installing plugins for services in the os_tempest role based on whatever's enabled | 13:22 |
odyssey4me | this will need to be done for source and distro builds | 13:22 |
chandankumar | odyssey4me: yup agree | 13:22 |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Clean up unused upgrade test tooling https://review.openstack.org/613332 | 13:23 |
odyssey4me | https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L149-L160 is there and could be extended and leveraged, although that's not particularly automatic | 13:23 |
odyssey4me | perhaps extending that and using them is a good start | 13:24 |
odyssey4me | then we can make it more automatic later | 13:24 |
openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/609450 | 13:24 |
chandankumar | odyssey4me: yes I will add to the list | 13:25 |
openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608967 | 13:25 |
odyssey4me | centralising everything into the tempest role makes it simpler to maintain - we'd be able to remove the plugin setting and test whitelist from all the roles and just let the tempest role figure it out | 13:25 |
openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608714 | 13:25 |
openstackgerrit | Merged openstack/openstack-ansible-os_aodh stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608715 | 13:26 |
openstackgerrit | Merged openstack/openstack-ansible-os_zaqar stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/609447 | 13:26 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/queens: Use consistent apt options for upgrades https://review.openstack.org/613527 | 13:27 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608966 | 13:27 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608713 | 13:28 |
openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Use distro_install project-template https://review.openstack.org/608431 | 13:28 |
openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608962 | 13:28 |
openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608712 | 13:30 |
openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608710 | 13:30 |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Add bionic py3 test and switch linters/integrated to bionic https://review.openstack.org/612672 | 13:30 |
openstackgerrit | Merged openstack/openstack-ansible-pip_install stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608711 | 13:30 |
openstackgerrit | Merged openstack/openstack-ansible-os_rally stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608965 | 13:30 |
openstackgerrit | Merged openstack/openstack-ansible-haproxy_server stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608716 | 13:31 |
openstackgerrit | Merged openstack/openstack-ansible-ceph_client stable/rocky: Replace Chinese punctuation with English punctuation https://review.openstack.org/608708 | 13:31 |
*** irclogbot_0 has joined #openstack-ansible | 13:31 | |
odyssey4me | hwoarang: if I read this right, the ansible_distribution_family for all versions is 'Suse', right? | 13:32 |
hwoarang | yes | 13:33 |
*** chandankumar is now known as chkumar|off | 13:33 | |
odyssey4me | hwoarang: thanks | 13:34 |
odyssey4me | hrm, that should've been ansible_os_family | 13:35 |
mnaser | some love to https://review.openstack.org/#/c/612678/2 would be nice :> | 13:36 |
mnaser | considering the role is broken for anything beyond an aio | 13:37 |
*** aredinger has quit IRC | 13:38 | |
*** spatel has quit IRC | 13:51 | |
*** aredinger has joined #openstack-ansible | 13:52 | |
mnaser | odyssey4me: are you doing work on the os_octavia role these days? | 13:56 |
*** DanyC_ has joined #openstack-ansible | 13:57 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Add default distro packages for wheel builds https://review.openstack.org/613585 | 13:58 |
odyssey4me | mnaser: I help out from time to time - mainly for things I broke. | 13:58 |
mnaser | odyssey4me: well you just broke something and im pushing up a patch :P | 14:00 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Add default distro packages for wheel builds https://review.openstack.org/613585 | 14:01 |
odyssey4me | mnaser: oh dear, I'm sorry :/ | 14:01 |
*** DanyC has quit IRC | 14:01 | |
odyssey4me | Breaking things is a sign of progress though. ;) | 14:01 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-os_octavia master: Use octavia_service_setup_host for getting facts https://review.openstack.org/613587 | 14:01 |
mnaser | odyssey4me: aha, no worries, it was a good fix! | 14:01 |
mnaser | odyssey4me: ^ | 14:01 |
mnaser | i didnt test that yet but seeing no delegation here and a "shade doesn't exist!!1!" error here | 14:02 |
odyssey4me | jrosser: so, as we discussed yesterday, there's definitely a need to cover at least a base set of packages for *all* roles when building wheels or installing directly from pip - https://review.openstack.org/613585 aims to cover that requirement | 14:02 |
odyssey4me | mnaser: hmm, on which task? it's supposed to either use the ansible runtime venv or the octavia venv | 14:02 |
mnaser | in https://review.openstack.org/613587 | 14:02 |
mnaser | it tries to get the facts which before it used to do in the mgmt and flavor task | 14:03 |
mnaser | which did it in the right venv or whatever but moved out the block which meant it went back to going to the server that didnt have shade | 14:03 |
odyssey4me | mnaser: look at line 92-93 | 14:03 |
odyssey4me | I suspect you forgot to rebuild your repo, and thus shade is missing in the octavia venv | 14:03 |
mnaser | oh it was readded? | 14:04 |
mnaser | is there any reason why we didnt want to maintain/run that locally? | 14:04 |
mnaser | similiar to all the others? | 14:04 |
odyssey4me | mnaser: https://github.com/openstack/openstack-ansible-os_octavia/commit/e0a69d0bda3f55fdaf1e4cdb40baffe3a638d201 | 14:04 |
mnaser | oh | 14:04 |
mnaser | i guess set_fact gets delegated too right | 14:04 |
odyssey4me | for some reason when using delegation the facts weren't on the target hosts | 14:04 |
mnaser | so we end up set_fact locally | 14:04 |
mnaser | ah ok | 14:05 |
mnaser | so you DIDNT break anything | 14:05 |
odyssey4me | originally I tried using localhost to get the facts, then use those but it didn't seem to work so I switched to adding shade to the venv instead | 14:05 |
mnaser | abandoned with an appropriate message | 14:05 |
odyssey4me | I was kinda under time pressure, so if there is a better way, I'm all ears - but that works as-is. | 14:05 |
odyssey4me | (I verified using a multi-node env) | 14:06 |
mnaser | i'm under the same so i can look into digging into the depths of the why some other time | 14:06 |
mnaser | yeah your fix makes sense | 14:06 |
mnaser | i didnt see the add shade to venv part | 14:06 |
odyssey4me | hwoarang evrardjp cloudnull I'd like your reviews for https://review.openstack.org/613585 too please. It's a key part of getting rid of repo-build for good. | 14:07 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Update lxc_hosts role SHA for apt failures https://review.openstack.org/613594 | 14:11 |
*** dave-mccowan has joined #openstack-ansible | 14:11 | |
*** spatel has joined #openstack-ansible | 14:14 | |
*** luksky has joined #openstack-ansible | 14:14 | |
*** dave-mccowan has quit IRC | 14:15 | |
*** vrobert has joined #openstack-ansible | 14:17 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-config_template master: Switch python3 test to bionic https://review.openstack.org/613595 | 14:18 |
*** spatel has quit IRC | 14:18 | |
vrobert | hello developers | 14:20 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins master: Switch python3 test to bionic and add it to gate https://review.openstack.org/613596 | 14:20 |
vrobert | I have a problem with ansible-hardening role, eating up all my 11GB memory because of dynamic includes in tasks/rhel7stig/main.yml | 14:22 |
*** cshen has quit IRC | 14:23 | |
odyssey4me | vrobert: that sounds a bit odd, given that we do all testing on 8GB RAM hosts | 14:23 |
vrobert | why are you using dynamic includes here: - include_tasks: accounts.yml - include_tasks: aide.yml - include_tasks: auditd.yml - include_tasks: auth.yml ... | 14:23 |
vrobert | ? | 14:23 |
vrobert | there are no loops or tags or vars around these lines | 14:24 |
*** cshen has joined #openstack-ansible | 14:24 | |
*** ThiagoCMC has joined #openstack-ansible | 14:24 | |
odyssey4me | vrobert: if there are no conditionals, then those can be converted into import_tasks instead - I think the person who did the patch didn't know the difference, so a patch would be welcome to fix that | 14:24 |
vrobert | when I changed to import_tasks the mem usage stayed 1.5GB | 14:24 |
odyssey4me | are you able to push up a patch for that? | 14:25 |
*** tosky has quit IRC | 14:25 | |
vrobert | Seems major convert includes wrong in this commit: https://github.com/openstack/ansible-hardening/commit/74c904247fb8ad69848db41408df0c812826915d | 14:25 |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Added support for installing tempest from distro https://review.openstack.org/591424 | 14:26 |
vrobert | at ansible 2.1 there was only include statement | 14:26 |
*** vnogin has joined #openstack-ansible | 14:26 | |
odyssey4me | I didn't realise the impact was that heavy. I think that means we're going to have to fix that across all OSA repositories. | 14:26 |
vrobert | yes. I am using osa 17.x.x branch | 14:27 |
vrobert | which is using ansible 2.4.4.0 | 14:27 |
vrobert | and I think this version affected these kinds of memory bug or mem balloning problem | 14:27 |
noonedeadpunk | I've stuck with rabbitmq... Once I do "systemctl stop/start rabbitmq-server" servers, openstack services gut stuck, and just do nothing. For example, nova-compute doesn't see conductor, while it's running (but probably don't recieve messages by rabbit). Once I run rabbitmq-setup.yml -e rabbitmq_upgrade=true - problem dissapears. | 14:27 |
vrobert | you can check it here: https://github.com/ansible/ansible/issues/30441 | 14:27 |
noonedeadpunk | And I don't fully understand the reason of this and what exactly fixes the problem | 14:28 |
*** tosky has joined #openstack-ansible | 14:29 | |
odyssey4me | vrobert: could you register a bug for it? we'd need to do a bunch of patches across a bunch of repositories, and backport them - so a bug reference would act as a good way to keep track of all of the changes | 14:30 |
logan- | vrobert: has a fix been backported to 2.4? maybe we can bump the 2.4 minor version to apply the fix | 14:30 |
vrobert | I tried to hack the bootstrap-ansible.sh script to use the latest 2.4.6 but didn't help. | 14:31 |
*** vollman has joined #openstack-ansible | 14:32 | |
vrobert | The only thing that helped for me when I changed the include_tasks to import_tasks. | 14:33 |
logan- | are you able to determine if this occurs on more recent ansible versions we use in rocky and master? | 14:34 |
odyssey4me | logan-: is that fix in stable-2.4 ? | 14:34 |
noonedeadpunk | and actually why stop/start of one rabbitmq instance inside cluster paralize work of the whole cluster | 14:34 |
logan- | odyssey4me: hunting that down now | 14:35 |
odyssey4me | vrobert: could you register a bug please, and state the performance impact - for Queens I think only the hardening role used that... but for rocky we have a bunch | 14:37 |
vrobert | thank you very much guys! | 14:37 |
vrobert | I think rocky is not affected because its using ansible v2.5 not v.2.4. I read that lot of mem problems fixed in 2.5... | 14:38 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Update ansible to 2.4.6 https://review.openstack.org/613599 | 14:38 |
vrobert | but I cant test it... | 14:38 |
odyssey4me | yeah, but I do think include vs import needs attention - so the bug would still be appreciated | 14:39 |
odyssey4me | using include rather than import breaks tag usage for any tags in the subtasks, which isn't good | 14:39 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/queens: Update ansible to 2.4.6 https://review.openstack.org/613600 | 14:40 |
logan- | the comments in the bug lead me to believe some fixes were backported to 2.4, but there are no PRs linked to the issue so its hard to track down individual commits | 14:41 |
logan- | the delta between 2.4.6 -> stable-2.4 does not appear to have anything performance related, so getting to 2.4.6 should catch any fixes that were bp | 14:42 |
vrobert | Guys I tested with 2.4.6 but the results were the same...:( | 14:43 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/pike: Update ansible to 2.3.4 https://review.openstack.org/613603 | 14:43 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update ansible to 2.3.4 https://review.openstack.org/613604 | 14:44 |
odyssey4me | logan-: that's assuming there was a useful fix at all, so ideally we should fix our things to do better | 14:44 |
logan- | yeah | 14:44 |
odyssey4me | vrobert: we'll do the fix, but need a bug | 14:44 |
vrobert | okay, sure | 14:45 |
vrobert | I will fill a bug report on this. | 14:45 |
odyssey4me | thanks vrobert | 14:51 |
cloudnull | mornings | 14:54 |
*** DanyC has joined #openstack-ansible | 14:55 | |
*** DanyC_ has quit IRC | 14:59 | |
ThiagoCMC | Morning! | 15:00 |
openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible master: Integrate Blazar with OpenStack Ansible https://review.openstack.org/549956 | 15:01 |
ThiagoCMC | BTW cloudnull, I tried nspawn, setup-hosts.yml works great! All containers have connectivity and etc (macvlan is awesome). But, setup-infrastructure.yml failed (at utility), I tried to ignore and proceed but, only problems later on... I'm giving up on it for a while. :-/ | 15:02 |
cloudnull | buuu. | 15:03 |
cloudnull | what were the issues with the utility container ? | 15:03 |
*** dave-mccowan has joined #openstack-ansible | 15:04 | |
spotz | morning | 15:08 |
*** dave-mccowan has quit IRC | 15:10 | |
vrobert | odyssey4me: Bug report has been filled: https://bugs.launchpad.net/openstack-ansible/+bug/1800169 | 15:10 |
openstack | Launchpad bug 1800169 in openstack-ansible "ansible-hardening role runs out of memory when running for ~60 nodes" [Undecided,New] | 15:10 |
*** cshen has quit IRC | 15:12 | |
odyssey4me | thank vrobert! | 15:14 |
cloudnull | odyssey4me done. | 15:15 |
odyssey4me | cloudnull: thanks - busy verifying adding lists vs union, and whether union takes multiple args | 15:15 |
cloudnull | ThiagoCMC - error: 503: Service Unavailable - seems like an issue with haproxy | 15:15 |
*** hamzaachi has quit IRC | 15:19 | |
*** ThiagoCMC has quit IRC | 15:20 | |
vrobert | No problem, thank you guys! | 15:22 |
odyssey4me | cloudnull: list1 | union(list2) | union(list3) = (list1 + list2 + list3) | unique ... but the second is perhaps a little easier to read? | 15:22 |
*** gyee has joined #openstack-ansible | 15:23 | |
cloudnull | ++ that works too | 15:23 |
*** vnogin has quit IRC | 15:25 | |
*** vrobert has quit IRC | 15:27 | |
*** ThiagoCMC has joined #openstack-ansible | 15:27 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Add default distro packages for wheel builds https://review.openstack.org/613585 | 15:27 |
ThiagoCMC | cloudnull, yeah, I thought about haproxy or it's backend (the repo_container) but, I'll just stick with LXC for now, it was fun to try nspawn! I learned a lot! :-) | 15:28 |
cloudnull | ThiagoCMC ++ | 15:28 |
ThiagoCMC | =) | 15:28 |
cloudnull | thanks foi giving it a go | 15:28 |
cloudnull | its still new and there are lots of rough edges | 15:28 |
cloudnull | so i greatly appreciate all the feedback and the willingness to give it a spin | 15:29 |
odyssey4me | jrosser: I wonder if pkgconf could replace pkg-config? Busy reading https://github.com/pkgconf/pkgconf#comparison-of-pkgconf-and-pkg-config-dependency-resolvers | 15:30 |
jrosser | i think setup.py for systemd-python specifically calls the pkgconf binary | 15:30 |
odyssey4me | hahaha https://github.com/pkgconf/pkgconf#pkg-config-symlink | 15:30 |
jrosser | oh thats sad | 15:31 |
*** fatdragon has joined #openstack-ansible | 15:31 | |
ThiagoCMC | cloudnull, I can give it more tries in a couple weeks! It would be great if you could access my lab to debug the playbook, I bet that we could fix those things quickly! I'm good in finding bugs! Lol | 15:32 |
ThiagoCMC | No rush... =) | 15:32 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia stable/rocky: Fix updating amphora images https://review.openstack.org/613315 | 15:34 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612935 | 15:36 |
*** cshen has joined #openstack-ansible | 15:37 | |
*** rgogunskiy has quit IRC | 15:45 | |
openstackgerrit | Merged openstack/openstack-ansible-os_watcher stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612899 | 15:48 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_cinder master: Add libpython2.7 as a required package. https://review.openstack.org/613375 | 15:52 |
openstackgerrit | Merged openstack/openstack-ansible-os_congress stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612927 | 15:59 |
*** DoberMann has joined #openstack-ansible | 16:01 | |
DoberMann | hi, i'm tring to do some cleanup in containers, and i did use cleanup-cinder.yml. but each time i use anothe cinder playbook the (generated) inventory adds back "cinder_scheduler" containers, with new ID of course | 16:03 |
DoberMann | what am i missing ? | 16:03 |
DoberMann | and of course playbook fails to gather facts on non-existant containers | 16:03 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_nova master: Add libpython2.7 as a required package https://review.openstack.org/613428 | 16:04 |
odyssey4me | DoberMann: not sure where you got cleanup-cinder from? but the approach is to remove it from openstack_user_config, then delete the containers using lxc-containers-destroy.yml, then to use inventory-manage.py to remove it from the inventory | 16:05 |
odyssey4me | man, we really need to add a doc entry for that in the operations guide - DoberMann could you register a bug for that? | 16:06 |
*** ThiagoCMC has quit IRC | 16:07 | |
*** vnogin has joined #openstack-ansible | 16:08 | |
DoberMann | odyssey4me: https://github.com/openstack/openstack-ansible/blob/stable/queens/scripts/upgrade-utilities/playbooks/cleanup-cinder.yml and it seems it does what you say (except from the openstack_user_config part) | 16:08 |
odyssey4me | DoberMann: yeah, that's specifically for an upgrade and is not for general purpose usage | 16:09 |
DoberMann | this is an upgrade | 16:09 |
odyssey4me | The reason it doesn't do the openstack_user_config bit is because you're not actually removing cinder from the env - just the containers which no longer need to exist because of the consolidation | 16:10 |
DoberMann | but i do have to "replay" some instal playbook | 16:10 |
odyssey4me | ok, I don't think that play is properly idempotent - I've not had much chance to go back and verify that... you may have to remove them by hand if it fails the first time | 16:11 |
odyssey4me | in that case it's just do the things in those steps without adjusting openstack_user_config | 16:11 |
odyssey4me | yeah, it'll fail on a second run because the container will likely be offline | 16:12 |
odyssey4me | I guess it could be made idempotent by doing some sort of connectivity check, then skipping those tasks - or perhaps doing some other sort of failure tolerance. | 16:13 |
*** vnogin has quit IRC | 16:13 | |
DoberMann | yes, but this is not problematic (unless it fails in the middle as it happened to me : had to manually execute removing from inventory part) | 16:13 |
DoberMann | odyssey4me: thx i've missed cinder_scheduler occurences in /etc/openstack_deploy/env.d/cinder.yml | 16:17 |
*** hamzaachi has joined #openstack-ansible | 16:20 | |
*** shardy has quit IRC | 16:20 | |
openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: Break out config files for each octavia service https://review.openstack.org/603228 | 16:24 |
odyssey4me | DoberMann: hmm, yes - if you have your own env.d files then they'll need adjusting | 16:29 |
DoberMann | they're not "my own" but must have come with openstack-ansible upgrade | 16:35 |
openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612930 | 16:35 |
DoberMann | i'm upgrading Liberty->Queens (and steps by Mitaka, Newton , Ocata and Pike for cinder/nova/haproxy when needed) | 16:36 |
odyssey4me | DoberMann: oh really? Ah yes - if you're coming from anything before newton then the process copies the in-tree ones over | 16:37 |
DoberMann | currently all in Queens on ubuntu 14.04 and rebuilding containers/venv in 16.04 | 16:37 |
odyssey4me | DoberMann: if you compare them all and they're the same, you can just empty the /etc/openstack_deploy/env.d folder | 16:37 |
DoberMann | so i need to reuse os-*install to deploy on brand new 16.04 containers | 16:38 |
*** nsmeds_ has joined #openstack-ansible | 16:40 | |
odyssey4me | DoberMann: to remind us that we should https://bugs.launchpad.net/openstack-ansible/+bug/1800185 | 16:41 |
openstack | Launchpad bug 1800185 in openstack-ansible "Upgrades from <Newton carry unnecessary user-space env.d files" [Undecided,New] | 16:41 |
odyssey4me | DoberMann: these are the notes by others who did the trusty->xenial conversion: https://etherpad.openstack.org/p/osa-newton-xenial-upgrade | 16:42 |
odyssey4me | DoberMann: wait, you're running queens on trusty? not sure how given that ISA doesn't support that | 16:43 |
*** nsmeds_ has quit IRC | 16:45 | |
DoberMann | all "old services on old containers" work in trusty, newly created containers are create in 16.04 ( unique cinder_api_ , ....) | 16:45 |
DoberMann | *created | 16:45 |
DoberMann | thxi'll follow this bug | 16:46 |
*** nsmeds_ has joined #openstack-ansible | 16:46 | |
*** rgogunskiy has joined #openstack-ansible | 16:46 | |
odyssey4me | DoberMann: heh, sounds like you're in for an exciting weekend :) | 16:46 |
odyssey4me | I know that mgariepy, antonym and cloudnull have been involved in marathon upgrade sessions. | 16:47 |
cloudnull | ^ always a good time :) | 16:47 |
DoberMann | it's not that hard, just long ;) | 16:47 |
*** luksky has quit IRC | 16:48 | |
*** DanyC_ has joined #openstack-ansible | 16:48 | |
DoberMann | the longuest part was to deal with (both with systemd) upstart init scripts | 16:48 |
cloudnull | yea its lots of watching bits fly by | 16:48 |
odyssey4me | I know that folks have been using https://github.com/openstack/openstack-ansible-ops/tree/master/leap-upgrades for that sort of thing - or borrowing concepts from it | 16:48 |
DoberMann | aka backport some newton files/templates/handlers | 16:48 |
odyssey4me | it's a terrible thing, but for a one-off it works well enough | 16:48 |
*** rgogunskiy has quit IRC | 16:50 | |
DoberMann | i'm currently working on dev/staging environments the real production migration will be later | 16:50 |
*** DanyC has quit IRC | 16:51 | |
DoberMann | upgrading one of the repo container in xenial firest, to build both 14.04 and 16.04 venvs | 16:51 |
DoberMann | *first | 16:51 |
odyssey4me | The approach in the leaps is pretty much - turn almost the whole control plane off, delete almost all containers (neutron agents stay up for L3), then run db migrations through each release and run any OSA upgrade things related to vars and such through each release, then finally build new containers then delete the last old ones once the L3 routers have moved over | 16:52 |
DoberMann | i'll try to rebuild nova liberty on 16.04 also to first migrate the compute nodes (avoiding libvirt version issue which is coming later) | 16:52 |
*** DanyC_ has quit IRC | 16:53 | |
DoberMann | i'm not that violent but it does minimize downtime my way | 16:53 |
*** DanyC has joined #openstack-ansible | 16:53 | |
*** hamzaachi has quit IRC | 16:54 | |
DoberMann | all queens version running in all containers, and then rolling upgrade 14.04->16.04 for all hosts/containers by deleting them one at a time | 16:54 |
odyssey4me | yep, that works best | 16:55 |
odyssey4me | the purpose of the leaps was really to jump from juno/kilo/liberty to newton in one shot, so downtime was made part of the expectation | 16:55 |
DoberMann | and also neutron migration to bare metal in advance | 16:55 |
odyssey4me | control-plane down time that is | 16:55 |
odyssey4me | ah yes, very good idea | 16:56 |
odyssey4me | sounds like you're doing all the right things! | 16:56 |
DoberMann | i hope so =) | 16:56 |
DoberMann | (and rabbitmq cluster migration in advance also to avoid breaking it by renaming hostnames) | 16:58 |
odyssey4me | cores - two release blocker fixess for rocky's next release are up - please review asap: https://review.openstack.org/613560 & https://review.openstack.org/613327 | 16:59 |
DoberMann | did not manage to avoid downtime with galera cluster though | 16:59 |
odyssey4me | DoberMann: well, we did just manage to find a bug in the pike galera builds which was causing havoc | 16:59 |
cloudnull | DoberMann im not sure if 14>16 upgrades have the same issue but 16>18 upgrade has broken venvs on compute hosts. wrote a simple bash function to rewire the venv allowing the services to restart post upgrade. https://gist.github.com/cloudnull/cb87440c8221104ed2b857e67289905f | 17:00 |
odyssey4me | you should be able to jump from newton to pike at least, maybe even straight to queens | 17:00 |
*** DanyC_ has joined #openstack-ansible | 17:00 | |
cloudnull | might be useful, if you have the same issue, and not already solved the problem elsewhere. | 17:00 |
DoberMann | odyssey4me: in fact only cinder has to be fully upgraded step by step, i jump some with nova | 17:00 |
cloudnull | odyssey4me newton > pike works, newton > queens did not (at least in test). | 17:01 |
DoberMann | and all other component are upgraded directly | 17:01 |
odyssey4me | DoberMann: also, for Keystone Ocata->Pike there's a need to flush the memcache cache or you'll get a bunch of errors, so https://review.openstack.org/#/q/Ibf8f3dd60d6f3c446a14dc8228fa005f12fcc840 will help there | 17:01 |
odyssey4me | cloudnull: I was suggesting newton->queens for galera_server only | 17:03 |
*** DanyC_ has quit IRC | 17:03 | |
*** DanyC has quit IRC | 17:03 | |
openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612911 | 17:03 |
odyssey4me | to make that work though, I think we had to shut down the two secondary nodes first so that only one was running... otherwise the galera upgrade resulted in comms failures due to the mixed versions | 17:04 |
openstackgerrit | Niko Smeds proposed openstack/openstack-ansible-galera_server master: Fix Galera self-signed SSL functionality https://review.openstack.org/613412 | 17:05 |
DoberMann | cloudnull: thx looks a lot like my 14.04 venv not working on 16.04 but i found the workaround by building venv for both 14.04 ane 16.04 version (upgrading one of the repo) | 17:05 |
DoberMann | have a nice WE, bye | 17:07 |
DoberMann | thx | 17:07 |
nsmeds_ | Question for y'all: submitted first PR, feedback was given, updated PR. Do I need to go back to feedback and click "Done" on all the comments or ? | 17:08 |
nsmeds_ | the comments no longer show up on the updated patch set | 17:08 |
openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612934 | 17:09 |
odyssey4me | nsmeds_: if you've done them, no worries - replying 'Done' is optional... if you took a different approach or did nothing, then better to reply on the comments related on the old patch set | 17:10 |
odyssey4me | ok folks, I'm out for the w/end - have a great one! | 17:11 |
nsmeds_ | ok, thanks =) | 17:11 |
odyssey4me | cores - before I go, I suspect that apt failure might hit the other branches too, so these would be advisable to merge soon: https://review.openstack.org/#/q/I7a50a64a4759865bceccc6ae02132663c328172b | 17:13 |
*** mmercer has joined #openstack-ansible | 17:14 | |
kaiokmo | odyssey4me: just a question: regarding https://bugs.launchpad.net/openstack-ansible/+bug/1800169 | 17:21 |
openstack | Launchpad bug 1800169 in openstack-ansible "ansible-hardening role runs out of memory when running for ~60 nodes" [Undecided,New] | 17:21 |
kaiokmo | how bad is to change from include to import? | 17:21 |
*** vakuznet has joined #openstack-ansible | 17:21 | |
logan- | kaiokmo: it will require some thinking if there is a when conditional on the include task. otherwise it should have little to no downside | 17:23 |
kaiokmo | logan-: ah, I see. | 17:25 |
*** electrofelix has quit IRC | 17:32 | |
*** lbragstad is now known as elbragstad | 17:37 | |
*** DanyC has joined #openstack-ansible | 17:49 | |
*** hamzaachi has joined #openstack-ansible | 18:05 | |
*** DanyC has quit IRC | 18:10 | |
*** medberry is now known as med_ | 18:31 | |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: SUSE: Add system-user-nobody for Leap 15 https://review.openstack.org/613547 | 18:51 |
openstackgerrit | Merged openstack/ansible-role-python_venv_build stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612937 | 19:06 |
*** nsmeds_ has quit IRC | 19:07 | |
*** noonedeadpunk has quit IRC | 19:08 | |
openstackgerrit | Merged openstack/openstack-ansible-os_rally stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612928 | 19:17 |
*** dave-mccowan has joined #openstack-ansible | 19:18 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: test-log-collect: Improve rsync performance for log collection https://review.openstack.org/613573 | 19:26 |
*** nsmeds_ has joined #openstack-ansible | 19:29 | |
*** cshen has quit IRC | 19:35 | |
openstackgerrit | Merged openstack/openstack-ansible-tests stable/rocky: Restart lxc-dnsmasq after clearing iptables rules https://review.openstack.org/613270 | 19:42 |
*** cshen has joined #openstack-ansible | 20:01 | |
*** ansmith_ has quit IRC | 20:12 | |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/queens: Add memcache flushing handler on db migrations https://review.openstack.org/612482 | 20:15 |
vakuznet | review please https://review.openstack.org/#/c/612011/ | 20:20 |
*** spatel has joined #openstack-ansible | 20:24 | |
*** hamzaachi has quit IRC | 20:36 | |
*** spatel has quit IRC | 20:39 | |
*** openstackstatus has quit IRC | 20:42 | |
*** openstack has joined #openstack-ansible | 20:46 | |
*** ChanServ sets mode: +o openstack | 20:46 | |
*** spatel has joined #openstack-ansible | 20:58 | |
*** spatel has quit IRC | 21:02 | |
*** jamesdenton has quit IRC | 21:11 | |
openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Cleanup nova distro package install lists https://review.openstack.org/612061 | 21:13 |
openstackgerrit | Merged openstack/openstack-ansible-os_monasca-agent stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612907 | 21:17 |
*** nsmeds_ is now known as nsmeds | 21:19 | |
*** nsmeds has quit IRC | 21:21 | |
*** nsmeds has joined #openstack-ansible | 21:25 | |
*** nsmeds has quit IRC | 21:25 | |
openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server stable/rocky: Set container_name as host_var in test inventory https://review.openstack.org/612931 | 21:26 |
*** jbadiapa has quit IRC | 21:34 | |
openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Stop arbitrary shutting down services https://review.openstack.org/606221 | 21:41 |
openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Convert role to use a common systemd service role https://review.openstack.org/606222 | 21:41 |
openstackgerrit | Antony Messerli proposed openstack/openstack-ansible master: Restart cinder-scheduler instead of reloading https://review.openstack.org/613694 | 21:44 |
jrosser | something is very broken here http://logs.openstack.org/60/613560/1/gate/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/20c50d8/logs/ara-report/ | 21:48 |
jrosser | it does bootstrap-aio *twice* | 21:48 |
* jrosser finished for today - anyone with time to look at that ^ please do | 21:49 | |
logan- | thats weird | 21:50 |
logan- | theres only 1 run of bootstrap-aio in the console log | 21:50 |
logan- | and the job ran successfully to completion | 21:50 |
*** strattao has quit IRC | 21:51 | |
*** cshen has quit IRC | 21:53 | |
jrosser | There are signs of deploy=upgrade, that’s the only clue I saw | 21:57 |
logan- | when you look at the zuul ara report it is even more wtf http://logs.openstack.org/60/613560/1/gate/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/20c50d8/ara-report/ | 21:57 |
logan- | the console log does not match up with the zuul ara at all | 21:58 |
*** cshen has joined #openstack-ansible | 21:59 | |
logan- | looking at the zuul log, you are right, the failed bootstrap-aio definitely ran AFTER the job in the console log.. all of the roles were already cloned: http://logs.openstack.org/60/613560/1/gate/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/20c50d8/ara-report/result/69dbd1c1-f0a4-4e90-9f21-141d03e2a509/ | 22:02 |
*** vakuznet has quit IRC | 22:04 | |
*** ansmith_ has joined #openstack-ansible | 22:16 | |
*** nsmeds has joined #openstack-ansible | 22:24 | |
*** cshen has quit IRC | 22:25 | |
openstackgerrit | Merged openstack/openstack-ansible master: Aodh group vars has wrong admin and internal endpoint url https://review.openstack.org/613521 | 22:44 |
*** cshen has joined #openstack-ansible | 22:50 | |
cloudnull | evenings :) | 23:00 |
*** pcaruana has quit IRC | 23:10 | |
*** gyee has quit IRC | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!