*** gyee has quit IRC | 00:08 | |
*** cjloader has joined #openstack-ansible | 00:13 | |
*** cjloader has quit IRC | 00:17 | |
*** jwitko has joined #openstack-ansible | 00:22 | |
cloudnull | Yes, I'd remove that variable once you cherry pick the commit. | 00:25 |
---|---|---|
*** jwitko_ has joined #openstack-ansible | 00:26 | |
*** jwitko_ has quit IRC | 00:27 | |
*** jwitko_ has joined #openstack-ansible | 00:27 | |
cloudnull | To pull the change in you can cd to the role and run git fetch https://git.openstack.org/openstack/openstack-ansible-lxc_hosts refs/changes/33/565933/2 && git cherry-pick FETCH_HEAD | 00:28 |
*** jwitko has quit IRC | 00:29 | |
*** weezS has joined #openstack-ansible | 00:36 | |
*** weezS has quit IRC | 00:37 | |
*** devx has quit IRC | 00:37 | |
*** jwitko_ has quit IRC | 00:40 | |
*** sawblade6 has quit IRC | 00:44 | |
*** sawblade6 has joined #openstack-ansible | 00:45 | |
*** cmart has joined #openstack-ansible | 01:07 | |
*** cjloader has joined #openstack-ansible | 01:15 | |
*** dxiri has joined #openstack-ansible | 01:17 | |
*** cjloader has quit IRC | 01:20 | |
*** dxiri has quit IRC | 01:22 | |
*** prometheanfire has joined #openstack-ansible | 01:23 | |
*** prometheanfire has quit IRC | 01:30 | |
*** prometheanfire has joined #openstack-ansible | 01:34 | |
*** prometheanfire has quit IRC | 01:40 | |
*** mmercer has quit IRC | 01:40 | |
openstackgerrit | Merged openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests https://review.openstack.org/567332 | 01:43 |
openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests https://review.openstack.org/567354 | 01:44 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/567330 | 01:44 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests https://review.openstack.org/567329 | 01:44 |
openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests https://review.openstack.org/567346 | 01:44 |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests https://review.openstack.org/567353 | 01:45 |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests https://review.openstack.org/567362 | 01:45 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/567334 | 01:45 |
openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests https://review.openstack.org/567326 | 01:45 |
openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests https://review.openstack.org/567343 | 01:45 |
openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/567331 | 01:45 |
openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests https://review.openstack.org/567348 | 01:45 |
openstackgerrit | Merged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests https://review.openstack.org/567324 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/567328 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests https://review.openstack.org/567368 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests https://review.openstack.org/567363 | 01:46 |
openstackgerrit | Merged openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests https://review.openstack.org/567378 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/567372 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/567370 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests https://review.openstack.org/567358 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests https://review.openstack.org/567371 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests https://review.openstack.org/567352 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests https://review.openstack.org/567366 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests https://review.openstack.org/567336 | 01:46 |
openstackgerrit | Merged openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests https://review.openstack.org/567364 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests https://review.openstack.org/567351 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests https://review.openstack.org/567360 | 01:47 |
openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests https://review.openstack.org/567375 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests https://review.openstack.org/567357 | 01:47 |
openstackgerrit | Merged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests https://review.openstack.org/567377 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests https://review.openstack.org/567340 | 01:47 |
*** prometheanfire has joined #openstack-ansible | 01:47 | |
openstackgerrit | Merged openstack/ansible-config_template master: Updated from OpenStack Ansible Tests https://review.openstack.org/567373 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests https://review.openstack.org/567344 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/567367 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/567327 | 01:47 |
openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests https://review.openstack.org/567325 | 01:48 |
openstackgerrit | Merged openstack/openstack-ansible-os_searchlight master: Updated from OpenStack Ansible Tests https://review.openstack.org/567359 | 01:48 |
openstackgerrit | Merged openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests https://review.openstack.org/567350 | 01:48 |
openstackgerrit | Merged openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests https://review.openstack.org/567365 | 01:48 |
openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests https://review.openstack.org/567341 | 01:48 |
openstackgerrit | Merged openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests https://review.openstack.org/567376 | 01:49 |
openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests https://review.openstack.org/567338 | 01:49 |
openstackgerrit | Merged openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests https://review.openstack.org/567356 | 01:49 |
openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests https://review.openstack.org/567337 | 01:49 |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests https://review.openstack.org/567349 | 01:49 |
openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests https://review.openstack.org/567361 | 01:49 |
openstackgerrit | Merged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests https://review.openstack.org/567374 | 01:50 |
openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests https://review.openstack.org/567345 | 01:50 |
openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests https://review.openstack.org/567339 | 01:50 |
openstackgerrit | Merged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests https://review.openstack.org/567342 | 01:50 |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests https://review.openstack.org/567347 | 01:50 |
openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests https://review.openstack.org/567355 | 01:50 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests https://review.openstack.org/567335 | 01:51 |
openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/567333 | 01:52 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add information about restoring inventory from backup https://review.openstack.org/566099 | 01:55 |
*** dangtrinhnt has joined #openstack-ansible | 01:58 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use ARA instead of profile_tasks callback https://review.openstack.org/546271 | 01:58 |
*** nicolasbock has quit IRC | 02:01 | |
*** kstev1 has joined #openstack-ansible | 02:02 | |
*** kstev has quit IRC | 02:04 | |
openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Update the outdated links https://review.openstack.org/566772 | 02:04 |
openstackgerrit | Merged openstack/openstack-ansible-os_monasca master: Trivial: Fix the pep8 warning https://review.openstack.org/566489 | 02:07 |
*** tinwood has quit IRC | 02:10 | |
*** cmart has quit IRC | 02:12 | |
*** tinwood has joined #openstack-ansible | 02:12 | |
*** cjloader has joined #openstack-ansible | 02:18 | |
*** cjloader has quit IRC | 02:23 | |
*** cmart has joined #openstack-ansible | 02:25 | |
*** dxiri has joined #openstack-ansible | 02:30 | |
*** wat89 has quit IRC | 02:30 | |
*** sawblade6 has quit IRC | 02:39 | |
*** KeithMnemonic has joined #openstack-ansible | 03:08 | |
*** cjloader has joined #openstack-ansible | 03:13 | |
*** cjloader has quit IRC | 03:18 | |
*** kstev1 is now known as kstev | 03:26 | |
*** dave-mccowan has quit IRC | 03:27 | |
*** dxiri has quit IRC | 03:34 | |
*** dxiri has joined #openstack-ansible | 03:34 | |
*** prometheanfire has quit IRC | 03:35 | |
*** jwitko_ has joined #openstack-ansible | 03:35 | |
*** prometheanfire has joined #openstack-ansible | 03:35 | |
openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Fix links to figures https://review.openstack.org/567251 | 03:37 |
*** jwitko__ has joined #openstack-ansible | 03:37 | |
openstackgerrit | Merged openstack/openstack-ansible master: Fix the appropriate kernel modules path https://review.openstack.org/565061 | 03:37 |
openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Clarify the testing page https://review.openstack.org/566227 | 03:37 |
*** dxiri has quit IRC | 03:39 | |
*** jwitko_ has quit IRC | 03:39 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Convert role to use a common systemd mount role https://review.openstack.org/552185 | 03:41 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd service role https://review.openstack.org/466179 | 03:41 |
*** jwitko__ has quit IRC | 03:42 | |
*** prometheanfire has quit IRC | 03:43 | |
*** prometheanfire has joined #openstack-ansible | 03:52 | |
*** weezS has joined #openstack-ansible | 03:59 | |
*** tasker has quit IRC | 04:00 | |
*** weezS has quit IRC | 04:03 | |
*** prometheanfire has quit IRC | 04:12 | |
*** prometheanfire has joined #openstack-ansible | 04:13 | |
*** kstev has quit IRC | 04:16 | |
*** mmercer has joined #openstack-ansible | 04:18 | |
*** udesale has joined #openstack-ansible | 04:27 | |
*** mmercer has quit IRC | 04:33 | |
*** hamzy has joined #openstack-ansible | 04:38 | |
*** mmercer has joined #openstack-ansible | 04:44 | |
*** vnogin has joined #openstack-ansible | 04:45 | |
*** vnogin has quit IRC | 04:49 | |
*** mhayden has quit IRC | 05:04 | |
*** mhayden has joined #openstack-ansible | 05:09 | |
*** KeithMnemonic has quit IRC | 05:09 | |
*** mmercer has quit IRC | 05:15 | |
*** cjloader has joined #openstack-ansible | 05:17 | |
*** cjloader has quit IRC | 05:22 | |
*** jmccrory has quit IRC | 05:28 | |
*** jmccrory has joined #openstack-ansible | 05:28 | |
*** rschulman has quit IRC | 05:58 | |
*** jhesketh has quit IRC | 05:58 | |
*** mhayden has quit IRC | 06:01 | |
jrosser | odyssey4me: i'm still missing something with the repo_build / pip, gimme a shout when you are around | 06:09 |
*** mhayden has joined #openstack-ansible | 06:16 | |
*** armaan has quit IRC | 06:20 | |
*** armaan has joined #openstack-ansible | 06:21 | |
*** radeks_ has joined #openstack-ansible | 06:27 | |
*** DanyC has joined #openstack-ansible | 06:33 | |
*** DanyC has quit IRC | 06:37 | |
*** pcaruana has joined #openstack-ansible | 06:51 | |
*** threestrands_ has quit IRC | 06:58 | |
*** arbrandes has quit IRC | 07:00 | |
*** arbrandes has joined #openstack-ansible | 07:01 | |
*** MrWatson has quit IRC | 07:10 | |
*** NostawRm has joined #openstack-ansible | 07:10 | |
*** mbuil has joined #openstack-ansible | 07:11 | |
odyssey4me | o/ | 07:11 |
odyssey4me | jrosser pre-coffee presence :) | 07:12 |
jrosser | think i need a coffee too :) | 07:20 |
jrosser | short story i wiped everything and started again | 07:20 |
jrosser | repo install now fails to install pip, so was after a sanity check | 07:21 |
*** armaan has quit IRC | 07:22 | |
*** armaan has joined #openstack-ansible | 07:22 | |
*** nsingh has quit IRC | 07:32 | |
odyssey4me | jrosser ok, so you did a fresh build and it failed | 07:36 |
odyssey4me | I know there's a failure because of the try/fail block here, but that shouldn't cause the playbook to fail: https://github.com/openstack/openstack-ansible-repo_server/commit/c75720f9208821855aac8d1a88d94c96114ed51b | 07:36 |
odyssey4me | I intend to revise that to ensure it doesn't fail on a fresh deployment, but haven't really had much time to work out a better option. | 07:37 |
*** tosky has joined #openstack-ansible | 07:37 | |
*** armaan has quit IRC | 07:44 | |
*** armaan has joined #openstack-ansible | 07:44 | |
jrosser | odyssey4me: let me just put some notes on an etherpad | 07:46 |
odyssey4me | jrosser good idea, thanks | 07:46 |
jrosser | https://etherpad.openstack.org/p/repo-pip | 07:47 |
jrosser | odyssey4me: yesterday i was seeing install pip take ages, so i put your 3 patches in place that we discussed and that was then fixed | 07:51 |
jrosser | howver at that point the repo install had already run, so the repo was available | 07:51 |
jrosser | having started from fresh it fails to install the repo | 07:52 |
*** mma has joined #openstack-ansible | 07:53 | |
jrosser | odyssey4me: looks like this is down to me not having wired my local pip mirror into the repo server nginx config | 08:05 |
*** rmart04 has joined #openstack-ansible | 08:05 | |
*** erolg has joined #openstack-ansible | 08:06 | |
*** DanyC has joined #openstack-ansible | 08:12 | |
*** DanyC has quit IRC | 08:17 | |
*** vnogin has joined #openstack-ansible | 08:23 | |
*** DanyC has joined #openstack-ansible | 08:27 | |
*** vnogin has quit IRC | 08:27 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: [Docs] Fix links to figures https://review.openstack.org/567511 | 08:28 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: [Docs] Clarify the testing page https://review.openstack.org/567512 | 08:28 |
*** rschulman has joined #openstack-ansible | 08:29 | |
*** jhesketh has joined #openstack-ansible | 08:29 | |
evrardjp | good morning jhesketh :) | 08:32 |
evrardjp | Ok I am off for today, it's a day off in Belgium! | 08:32 |
evrardjp | have a good day everyone | 08:33 |
*** rschulman has quit IRC | 08:36 | |
*** lbragstad[m] has quit IRC | 08:36 | |
*** keithmnemonic[m] has quit IRC | 08:36 | |
*** evrardjp[m] has quit IRC | 08:36 | |
*** jothibasu[m] has quit IRC | 08:36 | |
openstackgerrit | Robin Naundorf proposed openstack/openstack-ansible master: Fix spelling error and hypen https://review.openstack.org/567515 | 08:36 |
*** csmart has quit IRC | 08:41 | |
odyssey4me | jrosser sorry - was doing something else - looking at the etherpad now | 08:45 |
jrosser | odyssey4me: no worries | 08:46 |
osnaya | @evrardjp @cloudnull To cherry pick -> from /opt/openstack_ansible/playbooks folder -> when I run git fetch https://git.openstack.org/openstack/openstack-ansible-lxc_hosts refs/changes/33/565933/2 && git cherry-pick FETCH_HEAD ----> it errors out wtih error: could not apply e77c3a9... Fix lxc cache prep resolvers. resolve conflict | 08:46 |
odyssey4me | hmm, I see your pypi mirror has a prefix... I'm not sure that will work right without adjusting something else | 08:46 |
odyssey4me | osnaya you shouldn't have to cherry-pick anything if you're using the head of the stable branch | 08:47 |
*** chhagarw has joined #openstack-ansible | 08:47 | |
osnaya | @cloudnull @odyssey4m2 @evrardjp how do I resolve the configt | 08:47 |
*** jhesketh has quit IRC | 08:47 | |
odyssey4me | osnaya which branch/tag are you trying to deploy? | 08:47 |
*** udesale has quit IRC | 08:47 | |
*** udesale has joined #openstack-ansible | 08:47 | |
*** niraj_singh has joined #openstack-ansible | 08:48 | |
jrosser | odyssey4me: yes i was just looking at the nginx setup and was thinking the same | 08:48 |
odyssey4me | yeah, I'm leaning more and more to reverting this whole reverse proxy thing - it's causing too many headaches | 08:48 |
osnaya | I have 16.0.12.... and hitting an issue. the fix has gone in 16.0.13...., so I need to do workaround or fetch that commit | 08:49 |
odyssey4me | osnaya cd /opt/openstack-ansible; git fetch --all; git checkout origin/stable/pike; rm -rf /etc/ansible/roles/lxc_hosts; ./scripts/bootstrap-ansible.sh | 08:50 |
odyssey4me | that should get you to 16.0.13 as it stands now, and just work | 08:50 |
odyssey4me | jrosser alright, so the issue with the pypi mirror you have is the /root prefix - if it's possible to ditch that, then you'll likely be fine | 08:51 |
osnaya | @odyssey4me thanks, let me do that | 08:51 |
jrosser | odyssey4me: yes i think i should concentrate on fixing that - we knew it wasnt ideal | 08:51 |
odyssey4me | jrosser is that mirror an actual mirror, or some sort of caching service? | 08:52 |
jrosser | it's devpi | 08:52 |
jrosser | we had a caching proxy for ages but that all blew up when they re-organised the upstream pypi repos recently | 08:53 |
odyssey4me | ah yes, I looked at that - it seemed nice, but a little more complex than pypiserver | 08:53 |
jrosser | the underlying cdn is redirect-tastic and what we had couldnt deal with that, was simpler to drop devpi in | 08:53 |
*** vnogin has joined #openstack-ansible | 08:57 | |
*** vnogin has quit IRC | 09:01 | |
*** jhesketh has joined #openstack-ansible | 09:06 | |
*** vnogin has joined #openstack-ansible | 09:07 | |
openstackgerrit | Ferenc Cserepkei proposed openstack/openstack-ansible-os_monasca master: Non-ascii characters in files https://review.openstack.org/567527 | 09:10 |
*** gkadam has joined #openstack-ansible | 09:14 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: defaults: Allow uwsgi to autoload required plugins. https://review.openstack.org/567529 | 09:17 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: Add support for using distribution packages for OpenStack services https://review.openstack.org/567530 | 09:17 |
odyssey4me | jrosser hmm, on the one hand I think devpi looks really good as a complete solution, but on the other it's also a fairly complex system | 09:27 |
odyssey4me | I opted for pypiserver because it's super-simple - it does only one thing to replace the one function in the repo - provides a pypi-compatible index to install packages from. The replication we handle for other things using rsync/lsync, so we have to keep that so that function wasn't required from our pypiserver. | 09:28 |
jrosser | odyssey4me: yeah, it seems it doesnt have an obvious way of acting just as a proxy without introducing a wierd url | 09:28 |
odyssey4me | jrosser if you're using a web server in front of it, though, you could do URL rewrites | 09:29 |
*** keithmnemonic[m] has joined #openstack-ansible | 09:29 | |
*** vnogin has quit IRC | 09:29 | |
*** udesale has quit IRC | 09:31 | |
*** vnogin has joined #openstack-ansible | 09:32 | |
*** niraj_singh has quit IRC | 09:33 | |
*** niraj_singh has joined #openstack-ansible | 09:35 | |
*** radeks has joined #openstack-ansible | 09:38 | |
odyssey4me | jrosser hmm, I wonder if we should make https://github.com/openstack/openstack-ansible/blob/master/playbooks/common-tasks/set-pip-vars.yml#L111 set the value to repo_build_pip_default_index if it is set, but default to pypi... that might just resolve the issue | 09:40 |
odyssey4me | well, one of the issues | 09:40 |
jrosser | repo_build_pip_default_index doesnt really seem to do what the name implies currently | 09:43 |
odyssey4me | it should be the index that's used for building the wheels - is that not so? | 09:48 |
odyssey4me | it's distinguished from the index set to be used by pip for general operations | 09:48 |
jrosser | "# Optionally set this to change the default index from pypi to an alternative" | 09:48 |
odyssey4me | perhaps that comment needs clarification | 09:50 |
jrosser | to be fair, theres just lots of this | 09:50 |
jrosser | and it is in repo_build rather than repo_server | 09:50 |
odyssey4me | yep | 09:50 |
odyssey4me | I've added notes for things that could be fixed/improved to get this working better - I think both the options laid out are going to have to be done. | 09:51 |
odyssey4me | While trying to implement caching was perhaps a nice idea, the implementation didn't work out to be as stable as I'd hoped - and it's creating more headaches for offline installs, which it was meant to help - not hinder. | 09:51 |
*** vnogin has quit IRC | 09:52 | |
odyssey4me | If you'd like to take a crack at those, I'd be happy to review - otherwise I've set aside time this weekend to work on this stuff. I'm tied up today/tomorrow unfortunately, so I'm not going to be able to do much before the w/end. | 09:52 |
odyssey4me | feel free to add more notes of things like bad code comments or documentation, that way I have a nice hit list to work through | 09:53 |
jrosser | what i'll do first is get this devpi url sorted out, then roll the deploy again | 09:55 |
odyssey4me | let me understand this completely - where is it failing now? | 09:57 |
odyssey4me | ah, it's in the pip install in the repo container | 09:58 |
jrosser | thats right yes | 09:58 |
odyssey4me | ok, and it's hitting nginx right? | 09:58 |
odyssey4me | in the nginx log, can you see it trying to access your pypi mirror? | 09:58 |
jrosser | yes and thats when i realised it wasnt wired into our mirror properly | 09:58 |
jrosser | i think it's been happy accident that it worked for is before | 09:59 |
*** vnogin has joined #openstack-ansible | 09:59 | |
odyssey4me | and you have the repo_nginx_pypi_upstream set as per the entry I added to the etherpad? | 09:59 |
jrosser | i have now, but now nginx fails to start | 10:00 |
odyssey4me | oh really? that's odd | 10:01 |
jrosser | but i've not yet sanitised the url | 10:01 |
jrosser | let me work on that then get back to you | 10:01 |
odyssey4me | it must be host:port - no sub-url or anything else | 10:01 |
odyssey4me | the use of the sub-url is something pip needs to handle, not nginx | 10:01 |
jrosser | and it's implicitly /simple on the end? | 10:02 |
odyssey4me | nginx is simply reverse proxying - it receives a packet via HTTP and forwards it on... it doesn't understand the contents | 10:02 |
odyssey4me | so it's only host:port | 10:02 |
odyssey4me | no scheme either | 10:03 |
odyssey4me | the scheme and the rest of the URL is something pip cares about, and the pypi server cares about - nginx does not | 10:03 |
odyssey4me | nginx will listen on :80 and reverse proxy to whatever host and port you tell it to in repo_nginx_pypi_upstream | 10:04 |
odyssey4me | well, I think nginx is actually listening on :8080 - but that's kinda immaterial | 10:04 |
odyssey4me | does that make sense? | 10:06 |
jrosser | yes it does | 10:06 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: Add support for using distribution packages for OpenStack services https://review.openstack.org/567530 | 10:14 |
*** lbragstad[m] has joined #openstack-ansible | 10:23 | |
*** jothibasu[m] has joined #openstack-ansible | 10:23 | |
*** evrardjp[m] has joined #openstack-ansible | 10:23 | |
*** csmart has joined #openstack-ansible | 10:23 | |
*** rschulman has joined #openstack-ansible | 10:23 | |
*** udesale has joined #openstack-ansible | 10:27 | |
*** udesale has quit IRC | 10:28 | |
*** udesale has joined #openstack-ansible | 10:28 | |
hwoarang | oh centos is failing again on the lxc cache prep | 10:28 |
hwoarang | http://logs.openstack.org/29/567529/1/check/openstack-ansible-functional-centos-7/40c6365/logs/host/lxc-cache-prep-commands.log.txt.gz | 10:29 |
hwoarang | need to decipher that | 10:29 |
odyssey4me | error: Failed to initialize NSS library | 10:29 |
*** armaan has quit IRC | 10:29 | |
odyssey4me | https://bugzilla.redhat.com/show_bug.cgi?id=1476031 | 10:32 |
openstack | bugzilla.redhat.com bug 1476031 in nss-softokn "Failed to initialize NSS library" [Unspecified,Closed: duplicate] - Assigned to nss-nspr-maint | 10:32 |
*** armaan has joined #openstack-ansible | 10:32 | |
hwoarang | :/ | 10:32 |
odyssey4me | looks like it might be exactly the same issue, but with different package versions | 10:32 |
odyssey4me | hwoarang any chance you could take a peek at https://review.openstack.org/564841 and https://review.openstack.org/567285 - I'd like to port those back to reduce some of the confusion created by the data output from the py_pkgs lookup | 10:41 |
hwoarang | well look good to me | 10:42 |
odyssey4me | One more fix I'd like to get in later is to remove the ingestion of the doc/requirements.txt files, but I haven't had time to work that out yet. | 10:44 |
*** evin has quit IRC | 10:48 | |
*** nicolasbock has joined #openstack-ansible | 11:12 | |
odyssey4me | thanks hwoarang - I see that failed on centos too :/ | 11:13 |
hwoarang | yeah :( | 11:14 |
*** udesale_ has joined #openstack-ansible | 11:18 | |
*** udesale_ has quit IRC | 11:18 | |
*** udesale_ has joined #openstack-ansible | 11:18 | |
*** udesale_ has quit IRC | 11:18 | |
odyssey4me | hwoarang it looks to me like this is an upstream centos issue - the package indexes I'm looking at all have the version mismatch for the different nss packages | 11:18 |
odyssey4me | I guess we have a choice - wait, or mark all centos non-voting until the issue is fixed | 11:19 |
*** udesale_ has joined #openstack-ansible | 11:19 | |
hwoarang | i looked on the bugzilla but I couldn't find any references | 11:19 |
hwoarang | i mean centos bugzilla | 11:19 |
hwoarang | strange that noone noticed yet | 11:19 |
odyssey4me | maybe register a bug? | 11:19 |
hwoarang | i dont have an account and i want to postpone the need to create one :) | 11:21 |
odyssey4me | haha, same here :p | 11:21 |
*** udesale has quit IRC | 11:21 | |
hwoarang | i am wondering if this is fixed but the openstack mirrors are just outdated | 11:21 |
odyssey4me | maybe when mnaser wakes up or perhaps if mhayden is lurking they'd like to :p | 11:21 |
odyssey4me | it doesn't appear so - this is showing the same package version that's behind the other nss packages: https://pkgs.org/download/nss-util | 11:22 |
odyssey4me | nss-softokn, nss-softokn-freebl and nss-util are 0-2, but nss-tools, nss-sysinit and nss are 0-4 | 11:23 |
odyssey4me | hmm, looking at https://bugzilla.redhat.com/show_bug.cgi?id=1476031 perhaps that's not an issue... perhaps it's the major/minor versions that count | 11:25 |
openstack | bugzilla.redhat.com bug 1476031 in nss-softokn "Failed to initialize NSS library" [Unspecified,Closed: duplicate] - Assigned to nss-nspr-maint | 11:25 |
odyssey4me | these are all 3.34.0, which differs from that bug | 11:25 |
*** radeks has quit IRC | 11:35 | |
*** niraj_singh has quit IRC | 11:39 | |
hwoarang | odyssey4me: a fresh centos image looks good though. At least the 'yum install ca-certificates cronie epel-release gcc iproute iputils libffi-devel openssh-server openssl openssl-devel policycoreutils python2 python-devel rsync setup sudo systemd systemd-sysv systemd-networkd tar wget which yum-plugin-priorities yum-plugin-rpm-warm-cache yum-utils' does not trigger the problem | 11:44 |
hwoarang | strange | 11:44 |
odyssey4me | is that in a vagrant image or host? | 11:44 |
*** armaan has quit IRC | 11:44 | |
odyssey4me | perhaps the issue relates only to the OCI container image we download? | 11:44 |
odyssey4me | and perhaps it's therefore just a missing package of some sort | 11:45 |
*** armaan has joined #openstack-ansible | 11:45 | |
hwoarang | could be | 11:46 |
mnaser | Hi there | 11:48 |
hwoarang | i wonder if the all the dance we do in lxc_hosts for centos could cause hat | 11:48 |
hwoarang | *that | 11:48 |
mnaser | About to get into the office. I’ll dig I | 11:48 |
mnaser | In when I do | 11:49 |
hwoarang | because we record the transaction and we execute it later on | 11:49 |
hwoarang | i blame major for that :D | 11:50 |
*** bhujay has joined #openstack-ansible | 11:52 | |
*** radeks has joined #openstack-ansible | 11:58 | |
*** radeks has quit IRC | 12:03 | |
*** bradm has quit IRC | 12:04 | |
odyssey4me | yeah, apparently doing it with transactions is faster... at least that was the justification | 12:11 |
*** kaiokmo has quit IRC | 12:20 | |
*** radeks has joined #openstack-ansible | 12:21 | |
mnaser | ok | 12:23 |
mnaser | time to dig in | 12:23 |
mnaser | any job failure to look at? | 12:23 |
mnaser | (re centos7 | 12:24 |
mnaser | ok, caught uup, http://logs.openstack.org/29/567529/1/check/openstack-ansible-functional-centos-7/40c6365/logs/host/lxc-cache-prep-commands.log.txt.gz | 12:26 |
mnaser | strange, i dont see any changes inside the centos repos | 12:32 |
mnaser | http://mirror.centos.org/centos/7/os/x86_64/Packages/?C=M;O=D | 12:32 |
mnaser | looking by newly sorted we see not much change | 12:32 |
mnaser | centos7 image shipped on 20180508_02:16 | 12:34 |
mnaser | https://jenkins.linuxcontainers.org/job/lxc-template-centos/ | 12:37 |
mnaser | last image was aborted mid build for some reason | 12:37 |
mnaser | maybe we can wait and see when the new image builds | 12:38 |
*** evin has joined #openstack-ansible | 12:38 | |
*** sawblade6 has joined #openstack-ansible | 12:41 | |
*** throwsb1 has joined #openstack-ansible | 12:43 | |
cloudnull | Mornings | 12:52 |
mnaser | morning cloudnull | 12:56 |
cloudnull | hows it mnaser? | 12:57 |
mnaser | cloudnull: going good, trying to understand cache prep and why it's broken on centos :p | 12:57 |
mnaser | so i guess this thing is pretty much about being able to update all packages AND install the ones we need | 12:57 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use ARA instead of profile_tasks callback https://review.openstack.org/546271 | 12:58 |
hwoarang | mnaser: i dont think centos is using images from linux containers | 12:59 |
mnaser | hwoarang: oh? where is it pulling them from in that case? i thought it did :X | 12:59 |
hwoarang | mnaser: https://github.com/CentOS/sig-cloud-instance-images/raw/CentOS-7/docker/centos-7-docker.tar.xz | 12:59 |
hwoarang | see vars/redhat-7.yml | 12:59 |
mnaser | storing files on github | 13:00 |
cloudnull | the lxc cache prep ? | 13:00 |
hwoarang | cloudnull: since you are here... | 13:00 |
cloudnull | :D | 13:00 |
* cloudnull feels like he needs to run away | 13:00 | |
hwoarang | could you remind me why we've moved away from the linuxcontainers.org images as the default option? | 13:00 |
mgariepy | mnaser, https://bugzilla.redhat.com/show_bug.cgi?id=1477308 | 13:01 |
openstack | bugzilla.redhat.com bug 1477308 in nss-softokn "Installing new nss-softokn-freebl without updating nspr on a RHEL 7.3.0 system results in rpm and yum being non-functional" [Urgent,Closed: errata] - Assigned to dueno | 13:01 |
mgariepy | missing pkg ? | 13:01 |
cloudnull | hwoarang we moved to using smaller images. | 13:01 |
cloudnull | the lxc images were not being maintained very well and were growing in size | 13:01 |
hwoarang | oh i didn't know they were not maintained | 13:02 |
*** bhujay has quit IRC | 13:02 | |
mnaser | mgariepy: thats interesting, that's a different issue from the one reported | 13:02 |
cloudnull | its not that they dont have a CI system in place it just that theres not a lot of effort going on there. | 13:02 |
hwoarang | unfortunately for suse we will have to switch back to linuxcontainers soon because the current rootfs is going away | 13:03 |
cloudnull | with the new images we've made it so we should be able to pull any rootfs tarball and run with it | 13:03 |
hwoarang | i have an open bug with teh team to come up with an alternative rootfs | 13:03 |
mnaser | man this file just overall seems terrifying to look at :p | 13:03 |
mnaser | https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/prep-scripts/centos_7_prep.sh.j2 | 13:03 |
*** pcaruana|afk| has joined #openstack-ansible | 13:03 | |
*** NotPcaruana has joined #openstack-ansible | 13:04 | |
cloudnull | hwoarang the legacy capability should still all be there. | 13:04 |
hwoarang | yep | 13:04 |
hwoarang | thank god ;p | 13:04 |
cloudnull | if you have a new location for a rootfs to use we can change to that ? | 13:04 |
hwoarang | yep not sure if there will be a new one before the old one goes away | 13:05 |
cloudnull | does suse have something like ubuntu with a base rootfs ? | 13:05 |
hwoarang | no | 13:05 |
hwoarang | :( | 13:05 |
cloudnull | ok. | 13:05 |
cloudnull | I couldn't find one for cent either. | 13:05 |
mnaser | yeah looks like they don't either | 13:05 |
mnaser | is there a reason those packages are being installed in a shell script rather than ansible? | 13:06 |
cloudnull | mnaser: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/stable/queens/vars/redhat-7.yml#L48-L86 - a lot of that was ported over from here | 13:06 |
mnaser | so does that mean that shell file is unused? | 13:07 |
cloudnull | the packages are installed within a chroot | 13:07 |
hwoarang | no the shell script is on master | 13:07 |
hwoarang | branch | 13:07 |
mnaser | oh okay | 13:07 |
mnaser | yeah i just saw the release note | 13:07 |
mnaser | well | 13:08 |
mnaser | i know in yum you can run an install inside a chroot | 13:08 |
cloudnull | it used to create a shell script with that config block of old, not its just housed in a shell script | 13:08 |
mnaser | http://docs.ansible.com/ansible/latest/modules/yum_module.html 'installroot' | 13:08 |
cloudnull | if we could install those packages using ansible within the chroot it'd be better. | 13:08 |
openstackgerrit | Merged openstack/openstack-ansible-os_monasca master: Non-ascii characters in files https://review.openstack.org/567527 | 13:09 |
cloudnull | it'd be a bit divergent from the rest of the OS installs/setup but a lot better IMHO. | 13:09 |
mnaser | i'm looking for ways to do it in apt | 13:09 |
mnaser | the yum module can do it but trying to see how the apt one | 13:10 |
cloudnull | zypper has a similar functionality, is that exposed in the ansible module ? | 13:10 |
* cloudnull looking | 13:10 | |
mgariepy | with yum you can create a chroot directly, which is not quite possible with apt AFAIK | 13:10 |
hwoarang | you can use the extra dpkg opts i think | 13:10 |
hwoarang | same for zypper | 13:10 |
mnaser | "apt-get -o RootDir=/tmp/test_apt sets (almost) all paths to be in the different root. btw on a running system, if you copy /etc/apt, /usr/lib/apt, and mkdir -p usr/lib etc var/cache var/lib/dpkg var/lib/apt/lists/partial var/cache/apt/archives/partial and finally touch var/lib/dpkg/status, then apt is going to work in that root. It can even work as a non-root user if you add the option -o Debug::NoLocking=1. The | 13:11 |
mnaser | nolock option is necessary because I couldn't find a way to set the lock file inside the different root directory. – akostadinov" | 13:11 |
cloudnull | the zypper module has extra_args so we could make that go, i suspect | 13:11 |
hwoarang | we should yes | 13:11 |
mnaser | it doesnt look like apt has any options or something :\ | 13:11 |
hwoarang | mnaser: not even in dpkg_options ? | 13:12 |
hwoarang | you can pass whatever you want there | 13:12 |
mnaser | i didnt look into the dpkg level | 13:12 |
hwoarang | that's an option in the apt module | 13:12 |
mnaser | https://linux.die.net/man/1/dpkg --root | 13:13 |
mnaser | does anyone wanna hack on the apt one, i can take care of the yum one | 13:13 |
hwoarang | i think it's best to switch all 3 of them at once | 13:13 |
hwoarang | but i think right now we need to fix the centos7 failure first :/ | 13:14 |
hwoarang | otherwise we are not able to merge any new patches | 13:14 |
mnaser | hwoarang: ill push up a change for yum, lets watch CI | 13:15 |
mnaser | if it works, we can do the other two and move forward | 13:15 |
mnaser | (in the same patch) | 13:15 |
mnaser | once we know it works for a fact.. | 13:15 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 13:18 |
mnaser | if that doesn't break terribly ill do apt/zypper | 13:18 |
odyssey4me | hwoarang cloudnull mnaser FYI I have a working set of things to use diskimage-builder to replace our root cache prep for ubuntu so we don't need to download from anywhere, so I'm hoping to get a patch up soon to allow either download, or use dib... and make the dib usage the default. | 13:27 |
odyssey4me | and obviously I'll make it work for centos and opensuse too | 13:27 |
mnaser | odyssey4me: that's pretty exciting.. will hopefully get rid of the flakiness | 13:28 |
odyssey4me | yeah, I'm tired of the upstream changes affecting our stable builds... time we took control | 13:28 |
odyssey4me | our operators can then build the image in CI, and use the download option for deployments if they want to | 13:29 |
hwoarang | true but that adds about +10m to the deployment | 13:29 |
hwoarang | in the CI... | 13:29 |
odyssey4me | in my test, it was much less time - only 2-3 mins | 13:29 |
hwoarang | oh that's pretty good then | 13:29 |
odyssey4me | bear in mind that this is a very small container-only image | 13:29 |
odyssey4me | no kernel packages | 13:30 |
hwoarang | indeed | 13:30 |
mnaser | yay | 13:30 |
mnaser | so it updated the packages inside | 13:30 |
odyssey4me | the base I had it to without even optimising it more was around 50MB... and it might be possible to make it smaller... although the dump of extra packages we install into it takes it up to around 160M | 13:30 |
mnaser | something else was broken but yeah | 13:31 |
mnaser | http://logs.openstack.org/85/567585/1/check/openstack-ansible-functional-centos-7/3c2370b/logs/ara-report/ | 13:31 |
mnaser | hmm | 13:31 |
mnaser | http://logs.openstack.org/85/567585/1/check/openstack-ansible-functional-centos-7/3c2370b/logs/host/lxc-cache-prep-commands.log.txt.gz | 13:31 |
mnaser | its failing in 'yum clean all' | 13:31 |
mnaser | interestingly enough, it works ok when using installroot | 13:31 |
mnaser | so even if we work around this with installroot, it will probably break later. | 13:32 |
mnaser | (and at least we know it's not yum-complete-transaction) | 13:32 |
cloudnull | odyssey4me ++ that's very cool! | 13:33 |
*** NotPcaruana has quit IRC | 13:34 | |
*** pcaruana|afk| has quit IRC | 13:34 | |
openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Use UNIX socket instead of TCP socket https://review.openstack.org/559408 | 13:34 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Trivial: Fix the pep8 warning https://review.openstack.org/566830 | 13:35 |
mnaser | wait | 13:35 |
mnaser | centos 7.5 is out? | 13:35 |
cloudnull | yup | 13:35 |
cloudnull | i just saw that fly by my twitter feed | 13:35 |
mnaser | so that might the source of our issues | 13:36 |
mnaser | http://logs.openstack.org/85/567585/1/check/openstack-ansible-functional-centos-7/3c2370b/logs/ara-report/result/33618303-0067-4368-bf30-fedebfe4aacf/ | 13:36 |
mnaser | "Public key for acl-2.2.51-14.el7.x86_64.rpm is not installed" | 13:36 |
mnaser | ummm | 13:37 |
mnaser | is it possible because | 13:37 |
mnaser | we're doing the whole | 13:37 |
mnaser | copying mirrors into container thing | 13:37 |
mnaser | so we're running a 7.4 host with a 7.5 container | 13:37 |
mnaser | with 7.4 repos in it | 13:37 |
*** cjloader has joined #openstack-ansible | 13:38 | |
*** jwitko has joined #openstack-ansible | 13:43 | |
d34dh0r53 | mornings | 13:44 |
mnaser | o/ | 13:49 |
odyssey4me | mnaser oh dear, that would be a problem - is our container source not 7.4-specific? | 13:50 |
mnaser | odyssey4me: i think it is not 'pinned' to 7.4, it's just "7" | 13:50 |
mnaser | odyssey4me: so we get 7.4 and we're upgrading to 7.5 in lxc cache prep | 13:50 |
odyssey4me | *sigh* | 13:50 |
mnaser | i mean | 13:51 |
mnaser | we could yum update the host itself | 13:51 |
odyssey4me | I guess, then, that this is going to cause all the stable implementations to break too - because I think we're just doing '7' everywhere? | 13:51 |
mnaser | before we start anything heh | 13:51 |
mnaser | odyssey4me: not really, this is only broken because host version != container version i guess | 13:51 |
mnaser | so maybe we can add a check for that | 13:52 |
odyssey4me | ok, how about we confirm that - then look at options for our container source.. perhaps we need to switch back to using linuxcontainers for now | 13:52 |
mnaser | odyssey4me: i think the problem would still exist | 13:53 |
mnaser | we're still using a centos 7.4 container | 13:53 |
mnaser | but as part of cache prep, we upgrade containers to 7.5 | 13:53 |
odyssey4me | oh, why're we upgrading? | 13:53 |
odyssey4me | we should stop doing that | 13:53 |
mnaser | idk, cache prep does yum update | 13:53 |
odyssey4me | ah ok, that makes more sense as the cause | 13:54 |
odyssey4me | ok, so a quick fix to workaround the issue is to remove that - that'll unblock gates and give us time to figure out what we actually want to happen and to implement that | 13:54 |
hwoarang | but update != upgrade right? | 13:55 |
hwoarang | yum update is meant to remove installed packages no? | 13:55 |
odyssey4me | what we want to happen is kinda up to you mnaser, as the core who cares about the state of centos for OSA ;) | 13:55 |
hwoarang | *s/remove/update | 13:55 |
mnaser | i think it has to do a little bit with the whole repos being copied from the host | 13:55 |
mnaser | so some stuff is being updated while others aren't | 13:56 |
hwoarang | couldn't we detect the host centos version and use it to get an appropraite container image? | 13:56 |
hwoarang | assuming upstream provides images for 7.4 and 7.5? | 13:56 |
odyssey4me | well, we kinda had something like that before - and the script previously wiped all repo config from the container and put known config down | 13:56 |
mnaser | yeah but so the thing is | 13:57 |
mnaser | centos is now this rolling release thing | 13:57 |
mnaser | so your 7.4 image will become 7.5 when inevitebly something yum update's | 13:57 |
hwoarang | if it's rolling release what defines 7.4 and 7.5? | 13:57 |
* mnaser shrugs | 13:57 | |
mnaser | 7.4 and 7.5 isn't like ubuntu's 16.04 and 16.10 or so | 13:57 |
mnaser | its just a new set of packages | 13:58 |
hwoarang | so maybe that's automatically fixed tomorrow | 13:58 |
hwoarang | when infra builds new images based on 7.5 | 13:58 |
mnaser | but also maybe that breaks everything for our users too that might deploy on a centos 7.4 machine | 13:58 |
*** jwitko_ has joined #openstack-ansible | 13:58 | |
mnaser | so in order not to block productivity | 13:58 |
mnaser | i will set the c7 jobs to nv | 13:58 |
mnaser | and will work on this | 13:58 |
mnaser | whats the best place to switch them to nv? | 14:00 |
hwoarang | openstack-ansible-tests | 14:00 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Switch OSA functional tests to non-voting for CentOS 7 https://review.openstack.org/567594 | 14:01 |
mnaser | like this? ^ | 14:01 |
*** armaan has quit IRC | 14:01 | |
hwoarang | yep | 14:01 |
mgariepy | mnaser, -nv please :D | 14:02 |
*** armaan has joined #openstack-ansible | 14:02 | |
mnaser | mgariepy: wouldnt that mean i have to change all projects to use -nv? | 14:02 |
hwoarang | mgariepy: that will change the name of the job | 14:02 |
*** jwitko has quit IRC | 14:02 | |
mgariepy | hmm | 14:02 |
hwoarang | we need to keep the same name but make it non-voting | 14:03 |
mgariepy | ok | 14:03 |
mgariepy | sorry | 14:03 |
odyssey4me | yeah, don't bother doing -nv | 14:04 |
odyssey4me | thanks mnaser | 14:05 |
odyssey4me | let's see what tomorrow brings | 14:05 |
hwoarang | yeah it's an interesting situation | 14:05 |
odyssey4me | could we have some core votes for https://review.openstack.org/567159 please | 14:06 |
*** esberglu has joined #openstack-ansible | 14:09 | |
*** cjloader has quit IRC | 14:13 | |
mnaser | ok so please forgive me but does OSA copy the repos from the host into the containers? | 14:13 |
mnaser | i thought it did that but i cant find it | 14:13 |
*** cjloader has joined #openstack-ansible | 14:13 | |
odyssey4me | mnaser it does: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/vars/redhat-7.yml#L22-L30 | 14:13 |
mnaser | odyssey4me: ok, so that means that the repos outside the vm and inside the vm are matching. now i wonder if i do a yum update in a nodepool vm, if it will also break yum | 14:14 |
odyssey4me | it might do - I guess a patch could be pushed up to give that a go and see what happens | 14:15 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 14:15 |
mnaser | if that breaks it then either 7.5 is broken, 7.4 => 7.5 upgrades are broken or nodepool images have something weird in them | 14:16 |
*** dxiri has joined #openstack-ansible | 14:26 | |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 14:36 |
openstackgerrit | Ferenc Cserepkei proposed openstack/openstack-ansible-os_monasca stable/pike: Non-ascii characters in files https://review.openstack.org/567607 | 14:41 |
openstackgerrit | Ferenc Cserepkei proposed openstack/openstack-ansible-os_monasca stable/queens: Non-ascii characters in files https://review.openstack.org/567609 | 14:42 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 14:49 |
*** mma has quit IRC | 14:53 | |
mnaser | so doing a yum update inside the host says nothing to be updated, yet the container does update some stuff | 14:54 |
*** mma has joined #openstack-ansible | 14:54 | |
mnaser | today on things that don't make sense | 14:54 |
odyssey4me | perhaps the container image has some extra repo config or something in it which makes that happen? | 14:55 |
mgariepy | or the base image isn't up to date ? | 14:56 |
*** mma_ has joined #openstack-ansible | 14:57 | |
mnaser | mgariepy: right but running yum update should make us land in the final state? | 14:57 |
mnaser | final same state so to speak | 14:57 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Clean up docs and bootstrap script https://review.openstack.org/567614 | 14:58 |
*** chhagarw has quit IRC | 14:59 | |
*** mma has quit IRC | 15:00 | |
mgariepy | depending on what is installed i would assume that pkg should be updated. | 15:01 |
*** mma_ has quit IRC | 15:01 | |
*** weezS has joined #openstack-ansible | 15:02 | |
*** mma has joined #openstack-ansible | 15:02 | |
*** openstacking_123 has joined #openstack-ansible | 15:03 | |
*** mma has quit IRC | 15:06 | |
mnaser | surprise | 15:10 |
mnaser | the host is running c7.5 | 15:10 |
* mnaser sighs | 15:10 | |
odyssey4me | and the guest image is 7.4? | 15:10 |
mnaser | but being upgraded to 7.5 | 15:13 |
mnaser | then breaking | 15:13 |
*** kaiokmo has joined #openstack-ansible | 15:13 | |
mnaser | could it be something in upgrading 7.4 to 7.5 that is broken | 15:13 |
*** DanyC has quit IRC | 15:14 | |
*** mma has joined #openstack-ansible | 15:16 | |
*** armaan has quit IRC | 15:20 | |
*** armaan has joined #openstack-ansible | 15:20 | |
mnaser | so it looks like we're using the same iamges that are used in teh docker contaienrs | 15:23 |
mnaser | so im gonna try deploying a docker container, updating it, and seeing if it breaks. | 15:23 |
hwoarang | any brave soul around to give another +2 on https://review.openstack.org/#/c/562606/ ? | 15:24 |
*** NostawRm has quit IRC | 15:28 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Switch OSA functional tests to non-voting for CentOS 7 https://review.openstack.org/567594 | 15:28 |
*** NostawRm has joined #openstack-ansible | 15:28 | |
mnaser | hwoarang: lets hope it doesn't break everything but it seems ok | 15:29 |
mnaser | i'm wondering if the lxc 2.0 repos are breaking things | 15:29 |
hwoarang | thanks mnaser! | 15:29 |
*** spine55 has quit IRC | 15:33 | |
*** spine55 has joined #openstack-ansible | 15:33 | |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 15:39 |
cloudnull | mnaser I wonder if it'd be of use if we moved cent to using nspawn by default? That way we'd remove the COPR dep all together. | 15:41 |
mnaser | cloudnull: thats very tempting, but what about the migration path, is there one? | 15:41 |
mnaser | i support that | 15:41 |
cloudnull | the lxc and nspawn image formats are the same | 15:42 |
cloudnull | the containers would have to "restart" | 15:42 |
cloudnull | but it'd be doable | 15:42 |
cloudnull | maybe something to talk about at the summit? | 15:43 |
odyssey4me | cloudnull currently the nspawn integrated build is failing, and has been for weeks last I checked... perhaps it's best to get it working before jumping the gun | 15:44 |
odyssey4me | it'd be good to get that working, and get it voting - then get field testing for at least half a cycle before we think about changing the default | 15:45 |
cloudnull | its in the gate https://review.openstack.org/#/c/565961/ | 15:45 |
odyssey4me | there's still a lot of work to be done to get nspawn to be a first class option - tests across the repositories, etc | 15:45 |
cloudnull | and it looks like its working | 15:46 |
odyssey4me | ah, something recent must have fixed it - we should get that voting | 15:46 |
cloudnull | however i agree it still needs work. | 15:46 |
cloudnull | I just need more hours in the day to get at that | 15:47 |
cloudnull | :) | 15:47 |
odyssey4me | it also needs time for people to get familiar with it - right now you're the only guy, which is not a good thing... we need more people to get familiar with it | 15:47 |
*** vnogin has quit IRC | 15:48 | |
cloudnull | that's kinda of a chicken and egg problem :) | 15:48 |
cloudnull | folks can use it now. i'd LOVE the feedback | 15:49 |
*** openstacking_123 has quit IRC | 15:50 | |
cloudnull | maybe if we gave folks a reason, like forcing cent to use it, they'd get familiar with it :P | 15:51 |
odyssey4me | heh, yeah | 15:51 |
cloudnull | hahaha | 15:51 |
odyssey4me | it'd be nice if we got more tests using it before the next milestone so that we can release it for Rocky with some confidence | 15:52 |
odyssey4me | if we can do that, I'd like to flip the default next cycle | 15:52 |
cloudnull | ++ | 15:52 |
*** pcaruana has quit IRC | 15:52 | |
cloudnull | I need help in that arena. I sadly don't have a lot of time. | 15:53 |
cloudnull | I'm doing my best to try and keep up w/ reviews and push inflight things forward but I know im falling behind | 15:54 |
cloudnull | ... | 15:54 |
odyssey4me | understood, I'm also under a time crunch at the moment - hopefully another core can partner with you to get it to the finisih line | 15:54 |
cloudnull | ++ if folks are interested I'm happy to help them spin up | 15:55 |
jrosser | is there a nspawn zfs backend yet? | 15:56 |
*** openstacking_123 has joined #openstack-ansible | 15:58 | |
cloudnull | jrosser there is not . | 15:58 |
*** KeithMnemonic has joined #openstack-ansible | 15:58 | |
cloudnull | at least not one that im aware of | 15:58 |
cloudnull | jrosser https://github.com/systemd/systemd/issues/4272 | 15:59 |
jrosser | i guess nothing stops me making a bit of btrfs on top of zfs.... but yuk :) | 15:59 |
cloudnull | looks like the work has been done. | 15:59 |
cloudnull | its just a matter of getting it in | 15:59 |
cloudnull | nevermind that's just a feature request. | 16:00 |
*** rmart04 has quit IRC | 16:02 | |
mnaser | cloudnull: i am a bit short on time these days too unfortunately | 16:04 |
mnaser | i'd love to see nspawn but i don't want to promise to commit time where i don't have either | 16:04 |
* mnaser is still curious at how centos is breaking | 16:04 | |
mnaser | i've literally replaced all repos in a docker container with the same ones in that container and updated | 16:04 |
mnaser | and it didnt break | 16:04 |
mnaser | oh hmm | 16:07 |
mnaser | i wonder if our package pinning is messing things up | 16:07 |
*** gyee has joined #openstack-ansible | 16:13 | |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Remove distro package indexing from py_pkgs lookup https://review.openstack.org/564841 | 16:16 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/queens: Remove distro package indexing from py_pkgs lookup https://review.openstack.org/567629 | 16:17 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Remove distro package indexing from py_pkgs lookup https://review.openstack.org/567631 | 16:17 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Remove distro package indexing from py_pkgs lookup https://review.openstack.org/567632 | 16:18 |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Remove test-requirements files from py_pkgs lookup https://review.openstack.org/567285 | 16:18 |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Trivial: Fix the pep8 warning https://review.openstack.org/566834 | 16:18 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 16:19 |
*** ansmith has joined #openstack-ansible | 16:19 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/queens: Remove test-requirements files from py_pkgs lookup https://review.openstack.org/567633 | 16:20 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Remove test-requirements files from py_pkgs lookup https://review.openstack.org/567634 | 16:20 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Remove test-requirements files from py_pkgs lookup https://review.openstack.org/567635 | 16:20 |
odyssey4me | thanks cloudnull for supporting my war against confusion and unnecessary code :) | 16:21 |
odyssey4me | perhaps the cycle after next we can do the same with lxc ;) | 16:21 |
cloudnull | https://www.youtube.com/watch?v=amFRTRMBk1A | 16:21 |
odyssey4me | lol | 16:22 |
*** nicolasbock has quit IRC | 16:22 | |
*** nicolasbock has joined #openstack-ansible | 16:24 | |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_nova master: (WIP) Update to use oslo.messaging services for RPC and Notify https://review.openstack.org/558620 | 16:24 |
*** erolg has quit IRC | 16:26 | |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_heat master: (WIP) Update to use oslo.messaging service for RPC and Notify https://review.openstack.org/564030 | 16:33 |
jrosser | odyssey4me: seem to have devpi hooked up and working behind the repo server | 16:34 |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Prefer distribution packages for Tempest dependencies https://review.openstack.org/562606 | 16:34 |
odyssey4me | jrosser woot! | 16:35 |
*** pcaruana has joined #openstack-ansible | 16:36 | |
odyssey4me | looks like devpi uses a slightly different URL format then | 16:37 |
*** DanyC has joined #openstack-ansible | 16:38 | |
*** DanyC has quit IRC | 16:38 | |
*** DanyC has joined #openstack-ansible | 16:39 | |
jrosser | yes it does, so i had to fiddle the reverse proxy to make things appear just at /simple | 16:39 |
jrosser | and then adjust the nginx config to play nice with the content of what it returns | 16:40 |
odyssey4me | ok, so there needs to be that extra location, and perhaps also some sort of url rewrite to support devpi out of the box? | 16:41 |
jrosser | for osa stuff just the extra location | 16:41 |
*** openstacking_123 has quit IRC | 16:42 | |
jrosser | well hmm yeah i guess you could do it either way | 16:43 |
*** pcaruana has quit IRC | 16:44 | |
*** stuartgr has quit IRC | 16:45 | |
*** stuartgr has joined #openstack-ansible | 16:46 | |
*** openstacking_123 has joined #openstack-ansible | 16:48 | |
openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests https://review.openstack.org/565133 | 16:48 |
openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Convert role to use a common systemd service role https://review.openstack.org/558028 | 16:48 |
Taseer | evrardjp: Do I need to add the zuul.d to https://review.openstack.org/#/c/567112/ to trigger the testing pipelines ? | 16:48 |
mnaser | ok so it looks like all of nss is broken | 16:50 |
mnaser | rpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-Debug-7 /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-Testing-7 /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-7 => "error: Failed to initialize NSS library" | 16:50 |
mnaser | strace shows this | 16:51 |
mnaser | open("/proc/sys/crypto/fips_enabled", O_RDONLY) = -1 ENOENT (No such file or directory) | 16:51 |
mnaser | then error right after | 16:51 |
mnaser | maybe its expecting that to be there? | 16:51 |
odyssey4me | perhaps it's an selinux thing? | 16:52 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 16:52 |
odyssey4me | Taseer you shouldn't need it - no, perhaps the system jobs haven't been added/merged yet | 16:52 |
mnaser | odyssey4me: don't we do setenforce 0? | 16:53 |
jrosser | odyssey4me: i've stuck some examples of what devpi returns on that etherpad | 16:53 |
mnaser | in the gate anyawys | 16:53 |
mnaser | OR maybe because this thing is running in chroot | 16:53 |
mnaser | and the chroot is not properly setup. | 16:53 |
mnaser | things that are supposed to be there are missing | 16:53 |
Taseer | odyssey4me: can you please elaborate the system jobs ? which system jobs ? | 16:54 |
odyssey4me | mnaser yeah, a chroot is not a running system so it will miss some things - nor do we want it running | 16:54 |
mnaser | so maybe with the newer versions of yum or nss it expects certain things to be there that are not there | 16:55 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins master: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567646 | 16:56 |
mnaser | which would be nice meaning that it's a smaller fix | 16:56 |
odyssey4me | perhaps | 16:56 |
mnaser | open("/dev/urandom", O_RDONLY) = -1 ENOENT (No such file or directory) | 16:56 |
mnaser | i wonder if the fact that it cant get any randomness | 16:56 |
odyssey4me | cloudnull some MOAR cleanup :) https://review.openstack.org/567646 | 16:57 |
*** prometheanfire has quit IRC | 16:57 | |
*** prometheanfire has joined #openstack-ansible | 16:58 | |
odyssey4me | Taseer this needs to merge before the repo will have any tests: https://review.openstack.org/566542 | 17:00 |
Taseer | odyssey4me: ok thanks | 17:00 |
*** gkadam has quit IRC | 17:00 | |
cloudnull | anyone around want to go smash the ones that pass through https://review.openstack.org/#/q/topic:add_bionic_support+(status:open+OR+status:merged) | 17:01 |
odyssey4me | jrosser it looks like the first one came from pypiserver, and the second from devpi | 17:03 |
jrosser | yeah although i've just got antoher error | 17:03 |
mnaser | HA | 17:03 |
mnaser | I THINK I FOUND IT | 17:03 |
mnaser | https://bugzilla.mozilla.org/show_bug.cgi?id=889116#c20 | 17:03 |
openstack | Mozilla bug 889116 in Libraries "RNG_SystemRNG and RNG_FileUpdate should not fall back on rng_systemFromNoise on platforms with /dev/urandom" [Normal,Resolved: fixed] - Assigned to wtc | 17:03 |
mnaser | so it looks like newer releases of nss absolutely require a source of entropy | 17:04 |
mnaser | in running chroot, we have no /dev/urandom | 17:04 |
mnaser | so nss blows up | 17:04 |
cloudnull | :( | 17:04 |
odyssey4me | hmm, perhaps we could add a package? | 17:04 |
mnaser | i propose a bind mount of /dev/urandom in the cache prep stage | 17:04 |
mnaser | ..but i'm also open to other alternatives | 17:04 |
cloudnull | ++ | 17:04 |
mnaser | im not sure if that would work in a chroot'd environment though | 17:05 |
* mnaser thinks | 17:05 | |
odyssey4me | https://bugs.launchpad.net/ubuntu/+source/network-manager-openvpn/+bug/1618363/comments/2 | 17:05 |
openstack | Launchpad bug 1618363 in network-manager-openvpn (Ubuntu) "/dev/urandom not included in chroot, leads to crashes with static key" [High,Confirmed] | 17:05 |
mnaser | aha | 17:05 |
mnaser | good catch | 17:05 |
mnaser | ok let me try that | 17:05 |
jrosser | odyssey4me: what makes the repo sync work? | 17:05 |
cloudnull | mnaser you could add http://paste.openstack.org/show/720781/ to the setup script | 17:06 |
odyssey4me | jrosser the primary node should have both rsync and lsyncd - it pushes changes out using rsync to the other nodes | 17:06 |
cloudnull | oh odyssey4me beat me to it | 17:06 |
*** vakuznet has joined #openstack-ansible | 17:06 | |
mnaser | we'll have to clean up that after too | 17:06 |
cloudnull | adding that here https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/prep-scripts/_container_sys_setup.sh.j2 would make sure things like that are solved generally | 17:06 |
mnaser | just to make sure that it doesn't break something else later | 17:06 |
mnaser | or is it okay to leave them? | 17:07 |
cloudnull | they get mounted over | 17:07 |
mnaser | ah yes | 17:07 |
cloudnull | though maybe not a bad idea to clean up post cache prep? | 17:07 |
cloudnull | we could do something similar with a general include script | 17:08 |
cloudnull | at the end of the various distro setups | 17:08 |
odyssey4me | well, clean up is easy enough I guess - it hsould be possible to do within the prep script | 17:08 |
*** cjloader has quit IRC | 17:09 | |
cloudnull | it doesn't really matter... its not like those devices take space or would impact the runtime, so meh ... | 17:09 |
odyssey4me | ja | 17:09 |
mnaser | lets see if it works first | 17:10 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: WIP: Switch cached image packages to run with Ansible https://review.openstack.org/567585 | 17:10 |
*** udesale_ has quit IRC | 17:12 | |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Trivial: Fix the pep8 warning https://review.openstack.org/566833 | 17:17 |
odyssey4me | cloudnull looks like https://review.openstack.org/547158 needs to be updated and got to a working state asap | 17:17 |
odyssey4me | doesn't look like there are tests on https://review.openstack.org/#/projects/openstack/openstack-ansible-nspawn_hosts,dashboards/default either | 17:18 |
osnaya | @odyssey4me @cloudnull @evrardjp continued from earlier ...Ubuntu16.04 local is OSA 16.0.12.... git fetch --all (success). Upon running "git checkout origin/stable/pike" errors out with "error: you need to resolve your current index first"... Please advise | 17:20 |
odyssey4me | osnaya git reset --hard origin/stable/pike | 17:21 |
osnaya | ok | 17:21 |
odyssey4me | osnaya google can help you with git issues too ;) | 17:21 |
*** ianychoi_ has joined #openstack-ansible | 17:32 | |
openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Revise the role to properly cater to use-cases https://review.openstack.org/564778 | 17:33 |
*** niraj_singh has joined #openstack-ansible | 17:33 | |
*** ianychoi has quit IRC | 17:35 | |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567585 | 17:36 |
mnaser | odyssey4me, cloudnull ^ that is the fix, it worked, cleaned it up and removed the strace stuff | 17:36 |
d34dh0r53 | odyssey4me: ping | 17:36 |
mnaser | appreciate if you can have eyes on it so we can merge it and bring back c7 coverage | 17:36 |
odyssey4me | mnaser awesome - I'm wondering whether we should release note something about that... if you use centos, everything is broken unless you add these pre-steps and these post steps to the repo build (similar to the recent resolvconf issue release note | 17:37 |
odyssey4me | d34dh0r53 o/ | 17:37 |
mnaser | odyssey4me: i'm thinking we can backport this change all the way back and it shouldn't affect users too much? | 17:38 |
mnaser | let me see how backportable it is | 17:38 |
d34dh0r53 | odyssey4me: so on my MNAIO I'm seeing the repo server 404 problem and I think it's because of this https://github.com/openstack/openstack-ansible-repo_server/blame/9bee3a1b3485ea6ffa6e8118c69341deb617ae61/defaults/main.yml#L82 and https://github.com/openstack/openstack-ansible-repo_server/blame/9bee3a1b3485ea6ffa6e8118c69341deb617ae61/defaults/main.yml#L82 | 17:38 |
odyssey4me | mnaser that won't port exactly back, 'cos the structure and placement of the script has changed | 17:38 |
d34dh0r53 | odyssey4me: lsync can't sync the pools directory because it's root:root and lsync is running rsync as the nginix user | 17:38 |
odyssey4me | mnaser but this affects any new build, and given the code merges now - people may try to use centos from previous releases, so a reno really helps them understand what to do | 17:39 |
d34dh0r53 | I'm wondering what it will screw up if I remove https://github.com/openstack/openstack-ansible-repo_server/blob/master/tasks/repo_pre_install.yml#L110 | 17:39 |
vakuznet | have anyone seen "Failed to build libvirt-python" in ocata? i suspect because libvirt bumped to 3.9.0 in centos updates. | 17:39 |
SamYaple | vakuznet: ya, its pinned to libvirt-python 2.5.0 in upper constraints in ocata | 17:40 |
mnaser | odyssey4me: i can add a note, but i think it would also be beneficial to backport as well (even if the backport is specific) | 17:41 |
SamYaple | you need 3.x libvirt-python with 3.x libvirt (preferably matching versions) | 17:41 |
mnaser | cause of the structure changes | 17:41 |
odyssey4me | d34dh0r53 the pypiserver startup will create the dir I think... but another option would be to change that to set the user:group correctly | 17:41 |
odyssey4me | mnaser yes, of course - backport is a must | 17:41 |
jrosser | d34dh0r53: are you seeing repo sync failures? i just tan into something like that too | 17:42 |
d34dh0r53 | odyssey4me: it's set correctly earlier, so just removing that line works, I just want to make sure that is not needed for proper pypi server workings, I don't think it is | 17:42 |
odyssey4me | mnaser I'm just thinking the backport could also have a reno with it - at least to note the problem, and which release it's fixed in. | 17:42 |
vakuznet | libvirt-python==3.5.0 while ago | 17:42 |
odyssey4me | d34dh0r53 ah I see https://github.com/openstack/openstack-ansible-repo_server/blob/master/tasks/repo_pre_install.yml#L61 | 17:43 |
d34dh0r53 | jrosser: yes, one of the repo containers will have the files under /var/www/repo/pools, the others will have /var/www/repo/pools but it will be empty and owned root:root | 17:43 |
odyssey4me | d34dh0r53 the reason it's further down is because the folder was different once - so go for it, remove the root one | 17:43 |
d34dh0r53 | odyssey4me: sounds good, I'll file a bug and get a review up | 17:43 |
jrosser | d34dh0r53: cheers i'll check that | 17:43 |
odyssey4me | d34dh0r53 thanks for tracking it down! | 17:44 |
d34dh0r53 | jrosser: the fix for now is to just chown -R nginx:www-data /var/www/repo/pools on the two slave containers | 17:44 |
odyssey4me | and we now have an lsyncd expert in the house ;) | 17:44 |
d34dh0r53 | ROFL | 17:44 |
odyssey4me | d34dh0r53 no need for a bug, unless you insist - just push a review up :) | 17:44 |
d34dh0r53 | odyssey4me: will do | 17:45 |
odyssey4me | (with a good explanation in the commit, of course) | 17:47 |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-repo_server master: Fix permissions for lsync https://review.openstack.org/567657 | 17:49 |
odyssey4me | tyvm d34dh0r53 | 17:50 |
d34dh0r53 | np | 17:51 |
odyssey4me | jrosser ^ that should fix the repo sync | 17:51 |
odyssey4me | afk for a bit | 17:51 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add Bionic testing https://review.openstack.org/567034 | 17:57 |
*** radeks__ has joined #openstack-ansible | 17:57 | |
*** radeks_ has quit IRC | 17:58 | |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567585 | 17:59 |
mnaser | cloudnull, odyssey4me: added a release note | 17:59 |
mnaser | will appreciate the +2s back! | 17:59 |
odyssey4me | LGTM, thanks for that! | 18:00 |
*** radeks has quit IRC | 18:00 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add Bionic testing https://review.openstack.org/567034 | 18:00 |
odyssey4me | hmm, that may fail the reno build mnaser due to the : | 18:00 |
mnaser | oh um | 18:01 |
d34dh0r53 | cloudnull: mind looking at https://review.openstack.org/#/c/567657/ | 18:01 |
mnaser | let me try locally | 18:01 |
odyssey4me | mind if I edit it real quick? | 18:01 |
mnaser | odyssey4me: go for it | 18:01 |
mnaser | (but im running it locally too) | 18:01 |
cloudnull | d34dh0r53 done. | 18:02 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567585 | 18:02 |
cloudnull | we might need that back in queens, pike, etc | 18:02 |
cloudnull | idk though. nice catch d34dh0r53 | 18:02 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567585 | 18:02 |
d34dh0r53 | at least in queens | 18:02 |
odyssey4me | cloudnull d34dh0r53 just queens after master is merged | 18:02 |
odyssey4me | mnaser done - that should work | 18:03 |
*** armaan has quit IRC | 18:04 | |
*** electrofelix has quit IRC | 18:04 | |
odyssey4me | alright, afk for a bit - going for a walk to get a little sun | 18:04 |
*** armaan has joined #openstack-ansible | 18:04 | |
openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_monasca stable/pike: Fix extras/repo_packages poiting to master https://review.openstack.org/567664 | 18:07 |
*** masuberu has joined #openstack-ansible | 18:16 | |
*** masber has quit IRC | 18:19 | |
*** toddnni has quit IRC | 18:19 | |
*** gokhan has quit IRC | 18:19 | |
*** gokhan has joined #openstack-ansible | 18:20 | |
*** toddnni has joined #openstack-ansible | 18:22 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add Bionic testing https://review.openstack.org/567034 | 18:24 |
openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Fix permissions for lsync https://review.openstack.org/567657 | 18:35 |
*** KeithMnemonic has quit IRC | 18:36 | |
openstackgerrit | Merged openstack/openstack-ansible-os_cinder stable/pike: Do not log passwords https://review.openstack.org/562981 | 18:38 |
*** mbuil has quit IRC | 18:40 | |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-repo_server stable/queens: Fix permissions for lsync https://review.openstack.org/567668 | 18:43 |
d34dh0r53 | reviews much appreciated | 18:44 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Add resolved to the networkd setup https://review.openstack.org/567670 | 18:47 |
d34dh0r53 | ty odyssey4me and cloudnull | 18:52 |
odyssey4me | cloudnull looks like this one is good to go :) https://review.openstack.org/567646 | 18:55 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567585 | 18:55 |
odyssey4me | d34dh0r53 please review if you can | 18:55 |
cloudnull | odyssey4me done | 18:56 |
odyssey4me | mnaser backport https://review.openstack.org/567585 when you're ready! | 18:56 |
d34dh0r53 | odyssey4me: on it's way | 18:56 |
mnaser | oh cool | 18:56 |
mnaser | look at all those grenes | 18:56 |
mnaser | greens | 18:56 |
d34dh0r53 | much green such passing | 18:56 |
odyssey4me | I'm guessing you'll want to revert https://review.openstack.org/#/c/567594/ too now :) | 18:57 |
odyssey4me | d34dh0r53 cloudnull tyvm | 18:57 |
*** radeks__ has quit IRC | 18:58 | |
*** dkehn_ has joined #openstack-ansible | 18:58 | |
hwoarang | odyssey4me: could you give your blessing on https://review.openstack.org/#/c/566093/ ? :) | 18:59 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts stable/queens: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567671 | 18:59 |
mnaser | odyssey4me, cloudnull: wanna tell me if that's an ok way of backporting so i keep going backwards? | 19:00 |
odyssey4me | mnaser yep, perfectly good | 19:00 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Revert "Switch OSA functional tests to non-voting for CentOS 7" https://review.openstack.org/567673 | 19:00 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts stable/pike: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567674 | 19:01 |
openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts stable/ocata: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567675 | 19:01 |
odyssey4me | mnaser see point 1 in https://docs.openstack.org/openstack-ansible/latest/contributor/contribute.html#backporting :) | 19:01 |
mnaser | https://review.openstack.org/#/q/Iaf6b9cb1435591f28289493f480a7fe46789c551 + https://review.openstack.org/#/c/567673/ and we are back in action for centos 7 | 19:01 |
mgariepy | thanks a lot mnaser | 19:01 |
mnaser | odyssey4me: okay cool! | 19:02 |
mnaser | mgariepy: de rien! | 19:02 |
*** dkehn has quit IRC | 19:02 | |
mgariepy | i unfortunately don't have much time for that those days. | 19:02 |
odyssey4me | thanks for working that out mnaser - it's great to have more hands available to spread the load :) | 19:02 |
mnaser | :> | 19:03 |
mnaser | it would be nice to hack up a patch to do cache prep within ansible but that's a whole another thing :) | 19:03 |
mnaser | i was losing hope till i got the idea of using an strace | 19:03 |
cloudnull | mnaser ++ nicely done! | 19:05 |
odyssey4me | hwoarang now that the pattern is sorted, it's pretty plain sailing - great work! | 19:06 |
prometheanfire | evrardjp[m]: orly | 19:06 |
*** tosky has quit IRC | 19:07 | |
*** tosky has joined #openstack-ansible | 19:11 | |
odyssey4me | hwoarang mbuil it looks like the opendaylight role has non-production entries in its requirements.txt, rather than test-requirements.txt - any chance that could be changed so that the repo build doesn't need to build them? | 19:11 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-systemd_networkd master: Add resolved to the networkd setup https://review.openstack.org/567670 | 19:13 |
openstackgerrit | Robin Naundorf proposed openstack/openstack-ansible master: Fix spelling error and hypen https://review.openstack.org/567515 | 19:14 |
hwoarang | odyssey4me: thanks. nova and neutron and somewhat complex the rest is easy | 19:14 |
hwoarang | odyssey4me: no clue about opendaylight that would need mbuil or epalper | 19:15 |
hwoarang | will ping them tomorrow | 19:15 |
odyssey4me | d34dh0r53 FYI once https://review.openstack.org/567671 merges, the centos builds for queens will work again | 19:16 |
hwoarang | might worth adding that ^ fix to all distros | 19:17 |
hwoarang | so we could be proactive... | 19:17 |
hwoarang | but aaaaaaaaaaaaaaaanyway | 19:17 |
odyssey4me | hwoarang you reckon that may become a requirement at some point? | 19:18 |
hwoarang | i guess that since the packages are the same across distros, the requirement for /dev/* is probably the same | 19:18 |
odyssey4me | Fair point. mnaser could you do a follow up patch for other distributions? | 19:19 |
odyssey4me | Same patch, different reason - this time it's proactive, not reactive. :) | 19:19 |
mnaser | odyssey4me: i think the issue is more with yum rather than anything | 19:20 |
mnaser | but i can push up a change for other distros too for the backport | 19:20 |
mnaser | cause master is fixed for all all distros | 19:20 |
odyssey4me | Is it? Do all distributions have /dev now? | 19:20 |
odyssey4me | In the chroot I mean. | 19:20 |
mnaser | yes, in master, because i updated the "master" prep file | 19:20 |
mnaser | which is inserted for all distros | 19:21 |
mnaser | in the backports, not to potentially break other things, i limited it to centos only | 19:21 |
odyssey4me | oh, heh - didn't realise there was such a thing | 19:21 |
mnaser | neither did i, but thanks to cloudnull :) | 19:21 |
odyssey4me | fo' shizzle | 19:21 |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567646 | 19:23 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/queens: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567679 | 19:23 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567680 | 19:23 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567681 | 19:24 |
cloudnull | anyone want to give https://review.openstack.org/#/c/566099/ a nudge | 19:26 |
cloudnull | and https://review.openstack.org/#/c/566120/ | 19:26 |
cloudnull | also https://review.openstack.org/#/c/566360/ | 19:26 |
cloudnull | :P | 19:26 |
cloudnull | maybe https://review.openstack.org/#/c/557969/ & https://review.openstack.org/#/c/557970/ | 19:27 |
cloudnull | ok im done :) | 19:27 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/ocata: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567675 | 19:31 |
openstackgerrit | Merged openstack/openstack-ansible master: Fix spelling error and hypen https://review.openstack.org/567515 | 19:31 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/pike: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567674 | 19:33 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/queens: Setup /dev/random and /dev/urandom device in cache prep https://review.openstack.org/567671 | 19:33 |
*** openstacking_123 has quit IRC | 19:36 | |
*** openstacking_123 has joined #openstack-ansible | 19:37 | |
openstackgerrit | Merged openstack/openstack-ansible master: Add information about restoring inventory from backup https://review.openstack.org/566099 | 19:42 |
openstackgerrit | Merged openstack/openstack-ansible master: Provide an example for switch port configurations https://review.openstack.org/566120 | 19:42 |
openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Add support for using distribution packages for OpenStack services https://review.openstack.org/566093 | 19:49 |
*** prometheanfire has quit IRC | 19:52 | |
*** prometheanfire has joined #openstack-ansible | 19:53 | |
*** radeks__ has joined #openstack-ansible | 19:56 | |
openstackgerrit | Merged openstack/openstack-ansible-os_monasca stable/pike: Fix extras/repo_packages poiting to master https://review.openstack.org/567664 | 20:02 |
*** radeks_ has joined #openstack-ansible | 20:03 | |
*** prometheanfire has quit IRC | 20:04 | |
*** radeks__ has quit IRC | 20:06 | |
*** prometheanfire has joined #openstack-ansible | 20:06 | |
odyssey4me | mnaser wanna give https://review.openstack.org/#/q/I0d133804a91feae03e44047eede589c75806b2da a once-over too? | 20:10 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/queens: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567679 | 20:11 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/ocata: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567681 | 20:11 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/pike: Remove docs/requirements.txt from py_pkgs lookup output https://review.openstack.org/567680 | 20:11 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/ocata: Remove test-requirements files from py_pkgs lookup https://review.openstack.org/567635 | 20:11 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/queens: Remove test-requirements files from py_pkgs lookup https://review.openstack.org/567633 | 20:18 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/pike: Remove test-requirements files from py_pkgs lookup https://review.openstack.org/567634 | 20:18 |
*** armaan has quit IRC | 20:21 | |
*** armaan has joined #openstack-ansible | 20:22 | |
*** armaan has quit IRC | 20:27 | |
*** ansmith has quit IRC | 20:30 | |
*** radeks_ has quit IRC | 20:33 | |
*** mma has quit IRC | 20:38 | |
*** mma has joined #openstack-ansible | 20:39 | |
openstackgerrit | Merged openstack/openstack-ansible-repo_server stable/queens: Fix permissions for lsync https://review.openstack.org/567668 | 20:43 |
*** mma has quit IRC | 20:43 | |
*** sc68cal_ is now known as sc68cal | 20:44 | |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/queens: Remove distro package indexing from py_pkgs lookup https://review.openstack.org/567629 | 20:46 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/pike: Remove distro package indexing from py_pkgs lookup https://review.openstack.org/567631 | 20:46 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/ocata: Remove distro package indexing from py_pkgs lookup https://review.openstack.org/567632 | 20:46 |
*** vnogin has joined #openstack-ansible | 20:49 | |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Do not pip install keystoneclient on the host https://review.openstack.org/562607 | 20:49 |
*** mma has joined #openstack-ansible | 20:50 | |
*** vnogin has quit IRC | 20:53 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Use a common python build/install role for source-base deployment https://review.openstack.org/567692 | 21:04 |
*** jwitko has joined #openstack-ansible | 21:17 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Use a common python build/install role for source-base deployment https://review.openstack.org/567692 | 21:19 |
*** vakuznet has quit IRC | 21:19 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Use a common python build/install role for source-base deployment https://review.openstack.org/567692 | 21:20 |
*** jwitko_ has quit IRC | 21:21 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: tasks: Ensure /etc/keystone/credential-keys is created on time https://review.openstack.org/563667 | 21:21 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Add support for using distribution packages for OpenStack services https://review.openstack.org/560308 | 21:22 |
*** jwitko has quit IRC | 21:22 | |
*** ansmith has joined #openstack-ansible | 21:25 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy https://review.openstack.org/567693 | 21:30 |
*** openstacking_123 has quit IRC | 21:31 | |
mnaser | cloudnull: seeing you push things so i can borrow you for this? https://review.openstack.org/#/c/567673/ :D | 21:35 |
*** openstacking_123 has joined #openstack-ansible | 21:35 | |
*** openstacking_123 has quit IRC | 21:36 | |
cloudnull | mnaserlooking | 21:38 |
cloudnull | ** looking | 21:38 |
cloudnull | done. | 21:38 |
*** dave-mccowan has joined #openstack-ansible | 21:39 | |
openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Add support for using distribution packages for OpenStack services https://review.openstack.org/566315 | 21:42 |
*** openstacking_123 has joined #openstack-ansible | 21:47 | |
*** jwitko has joined #openstack-ansible | 21:47 | |
*** openstacking_123 has quit IRC | 21:59 | |
*** DanyC has quit IRC | 21:59 | |
*** ivve has quit IRC | 22:09 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy https://review.openstack.org/567693 | 22:11 |
*** esberglu has quit IRC | 22:19 | |
*** mma has quit IRC | 22:20 | |
*** mma has joined #openstack-ansible | 22:21 | |
*** mma has quit IRC | 22:25 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Revert "Switch OSA functional tests to non-voting for CentOS 7" https://review.openstack.org/567673 | 22:26 |
*** KeithMnemonic has joined #openstack-ansible | 22:31 | |
*** esberglu has joined #openstack-ansible | 22:33 | |
*** esberglu has quit IRC | 22:33 | |
*** throwsb1 has quit IRC | 22:35 | |
*** kaiokmo has quit IRC | 22:39 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy https://review.openstack.org/567693 | 22:40 |
*** nsingh has joined #openstack-ansible | 22:42 | |
*** KeithMnemonic has quit IRC | 22:42 | |
*** portante has quit IRC | 22:42 | |
*** KeithMnemonic has joined #openstack-ansible | 22:43 | |
*** jwitko has quit IRC | 22:44 | |
*** niraj_singh has quit IRC | 22:45 | |
*** nsingh has quit IRC | 22:46 | |
*** portante has joined #openstack-ansible | 22:46 | |
*** nsingh has joined #openstack-ansible | 22:48 | |
*** dhellmann has quit IRC | 22:49 | |
*** bradm has joined #openstack-ansible | 22:50 | |
*** nicolasbock has quit IRC | 22:50 | |
*** dhellmann has joined #openstack-ansible | 22:50 | |
*** nicolasbock has joined #openstack-ansible | 22:50 | |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: tasks: Ensure /etc/keystone/credential-keys is created on time https://review.openstack.org/563667 | 22:52 |
*** KeithMnemonic has quit IRC | 23:11 | |
*** KeithMnemonic has joined #openstack-ansible | 23:18 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Clean up docs and bootstrap script https://review.openstack.org/567614 | 23:30 |
*** KeithMnemonic has quit IRC | 23:34 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Tune down the collection intervals and default retention policy https://review.openstack.org/567693 | 23:38 |
*** kaiokmo has joined #openstack-ansible | 23:42 | |
*** weezS has quit IRC | 23:51 | |
*** vnogin has joined #openstack-ansible | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!