Friday, 2021-02-26

*** mrda has quit IRC00:07
*** tosky has quit IRC00:12
mgariepythanks jonher i already have this patch i did cherrypicked the last bump ;)00:24
*** ianychoi__ is now known as ianychoi00:34
*** aedan has quit IRC00:55
*** macz_ has quit IRC01:16
*** macz_ has joined #openstack-ansible01:17
*** macz_ has quit IRC01:22
*** jhesketh_ is now known as jhesketh01:49
*** poopcat1 is now known as poopcat03:05
*** maharg101 has joined #openstack-ansible03:37
*** rh-jlabarre has quit IRC03:42
*** maharg101 has quit IRC03:43
*** dmsimard has quit IRC04:08
*** dmsimard has joined #openstack-ansible04:09
*** evrardjp_ has quit IRC05:33
*** evrardjp has joined #openstack-ansible05:33
*** maharg101 has joined #openstack-ansible05:39
*** maharg101 has quit IRC05:44
*** miloa has joined #openstack-ansible07:16
*** miloa has quit IRC07:30
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible-os_adjutant master: Install mysql client libraries  https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/77760707:31
*** masterpe has joined #openstack-ansible07:42
masterpeDoing a upgrade to ussuri with our own apt mirrors I notice that, openstack_hosts/vars/ubuntu-18.04.yml uses apt_repo_url and openstack_hosts/vars/ubuntu-20.04.yml uca_apt_repo_url as a variable and why doesn't uses the same variable?07:42
*** andrewbonney has joined #openstack-ansible08:24
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_octavia master: Add variable to override keypair setup python interpreter  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/77255908:25
*** luksky has joined #openstack-ansible08:26
*** maharg101 has joined #openstack-ansible08:35
*** pto has joined #openstack-ansible08:41
openstackgerritDmitriy Rabotyagov proposed openstack/openstack-ansible stable/victoria: Bump SHAs for stable/victoria  https://review.opendev.org/c/openstack/openstack-ansible/+/77552108:51
*** shyamb has joined #openstack-ansible09:13
*** shyamb has quit IRC09:14
*** shyamb has joined #openstack-ansible09:14
openstackgerritAndrew Bonney proposed openstack/openstack-ansible master: Update setuptools to match version in upper-constraints  https://review.opendev.org/c/openstack/openstack-ansible/+/77773009:33
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_neutron master: Combined patch to unblock CI  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77523909:34
*** pto has quit IRC09:34
*** mubix has quit IRC09:37
*** mubix has joined #openstack-ansible09:37
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_octavia master: Move octaiva pip packages from constraints to requirements  https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/77229309:43
jrossermasterpe: that looks like an error in the vars/ubuntu-20.04.yml file, though if you note just above that line _package_repos: [] is set for focal, so it's not used anyway on 20.0409:53
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Correct the UCA repo location variable for ubuntu focal  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/77773409:57
*** klamath_atx has joined #openstack-ansible10:02
*** gshippey has joined #openstack-ansible10:13
*** shyamb has quit IRC10:14
*** mugsie_ is now known as mugsie10:16
*** shyamb has joined #openstack-ansible10:36
*** klamath_atx has quit IRC11:09
*** klamath_atx has joined #openstack-ansible11:21
*** tosky has joined #openstack-ansible11:25
*** ajg20 has quit IRC11:26
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/77696011:49
*** shyamb has quit IRC12:10
*** shyamb has joined #openstack-ansible12:26
*** shyamb has quit IRC12:33
openstackgerritMerged openstack/openstack-ansible-os_adjutant master: Use venv_tag  https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/77759712:47
openstackgerritMerged openstack/openstack-ansible-os_adjutant master: Use global service variables  https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/77759612:47
mgariepygood morning everyone.13:20
*** zigo has joined #openstack-ansible13:20
mgariepyjrosser, so I disabled 2 of the repo container in haproxy. i still have the same contaienr not deployning.13:25
openstackgerritMerged openstack/openstack-ansible master: Workaround nova bug  https://review.opendev.org/c/openstack/openstack-ansible/+/77760113:40
mgariepyhttp://paste.openstack.org/show/803037/14:01
mgariepywhy the : Skipping link: unsupported archive format: .04-x86_64: http://10.41.15.2:8181/os-releases/22.0.2.dev8/ubuntu-20.04-x86_64 (from -f)14:01
jrosserthat is very odd indeed14:06
mgariepyi did wipe and recreate the container14:08
jrosserit’s like pip is parsing the url and not liking the dot14:10
mgariepyle me regen a cleanish log i'll upload it whole..14:11
*** jpvlsmv has quit IRC14:16
openstackgerritGeorgina Shippey proposed openstack/openstack-ansible master: [WIP] Use the Mitogen connection method in OSA  https://review.opendev.org/c/openstack/openstack-ansible/+/59123614:17
mgariepyhttps://paste.ubuntu.com/p/MTyPWZnN86/14:17
mgariepy2k lines of pleasure.14:18
*** jpvlsmv has joined #openstack-ansible14:18
openstackgerritGeorgina Shippey proposed openstack/openstack-ansible master: [WIP] Use the Mitogen connection method in OSA  https://review.opendev.org/c/openstack/openstack-ansible/+/59123614:20
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-tests master: DNM: Pull constraint files from local path in CI  https://review.opendev.org/c/openstack/openstack-ansible-tests/+/77775314:22
mgariepyit finds the file in the repo but it seems to prefer the upstream one for ${REASON}14:23
*** ajg20 has joined #openstack-ansible14:51
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_neutron master: Combined patch to unblock CI  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/77523914:56
ajg20Any one have any advice to resolve this Openstack ansible AIO issue?15:02
ajg20fatal: [aio1_horizon_container-1804132b -> 172.29.236.100]: FAILED! => {"changed": false, "msg": "The `lxc` module is not importable. Check the requirements."}15:02
ajg20I am running15:03
ajg20sudo openstack-ansible /opt/openstack-ansible/playbooks/setup-hosts.yml15:03
mgariepyjrosser, for some reason, the first container gets a constraint that is 1471 in size. the 2 others gets a 212 one.15:03
mgariepywhich have the git url in so. that's probably the reason why it does with it do..15:03
jrossermgariepy: the git url should never be in the target host constraints15:09
jrosseronly on the build host15:09
mgariepyi know, something is wrong here.15:09
mgariepyhttps://github.com/openstack/ansible-role-python_venv_build/blob/stable/victoria/tasks/python_venv_install.yml#L85-L9815:10
*** tosky has quit IRC15:19
*** tosky has joined #openstack-ansible15:20
jrossermgariepy: it could also have tried (and succeeded) to do the build locally on the first host rather than use the repo server15:32
jrosserif somehow venv_build_host did not evaluate correctly (like stale facts cache?)15:33
*** macz_ has joined #openstack-ansible15:37
*** macz_ has quit IRC15:38
*** macz_ has joined #openstack-ansible15:39
mgariepyhaving kids around is not great for focussing on sstuff haha15:46
mgariepysomehow the constraints it's getting is the sources-constraint from the repo container.16:39
*** gyee has joined #openstack-ansible16:40
jrossermgariepy: the wheels that get built are indexed on the repo server and the constraints transferred to the target should come from here https://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/python_venv_wheel_build.yml#L159-L17316:41
mgariepyhttp://paste.openstack.org/show/803040/16:44
mgariepythis correspond to the source-constraints.txt16:45
mgariepyhm. is it possible that since the task is delegated only on the first host that the var is not accessible to the other hosts?16:47
jrosseri just checked a multinode lab here and none of the placement container venv constraints have the git url in them16:54
mgariepyon V ?16:54
jrosseryeah, and source-constraints file is only made on the host that does the build16:54
jrosserthis all points to it not knowing to build on the repo server16:55
*** strattao has joined #openstack-ansible16:55
jrosserwhich is decided by this https://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/python_venv_wheel_build.yml#L2416:55
jrosserperhaps throw in a debug just there to print venv_build_host16:56
mgariepy_constraints_file_slurp is not defined on the 2nd and 3rd nodes16:56
mgariepyonly on the first one..16:57
mgariepyha.17:00
mgariepyhmm..17:01
mgariepylol. :(17:01
mgariepyhttps://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/python_venv_wheel_build.yml#L171 < this is only registered on the first container.17:04
mgariepyhttps://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/python_venv_install.yml#L10517:05
jrosserbut that entire block should be delegated?17:06
mgariepyit is on the first node.17:06
jrosserso i think its still a good question why that doesnt happen for the 2nd/3rd17:10
mgariepyrunning a few mode debug ..17:10
mgariepyarf.. lol.17:11
mgariepydebug msg fail. then the host are dropped lol..17:12
jrosseryou should print venv_build_targets as well17:13
mgariepyvenv_build_host is set correct for all of them17:14
mgariepybut ghe gather bui;ld target facts is delegating to the repo server on the same host.17:15
mgariepyhttp://paste.openstack.org/show/803042/17:17
* jrosser looks at https://github.com/openstack/ansible-role-python_venv_build/commit/1060c112ac1d2d1816830e396e8354a2ab27104417:20
jrosserbut doesnt really understand why that would do that17:20
jrosseri wonder if import->include has broken the very imporant side effect that run_once has17:22
jrosserwhich is to apply facts (and likley registered vars) to all play hosts even though the tasks only run against one of them17:22
mgariepythe build is only delegated on the first host. therefore the _constraints_file_slurp is not defined on the otehr 2 nodes http://paste.openstack.org/show/803043/17:23
jrosserbut run_once in main.yml is important like i say17:23
jrosserset_fact and register behave differently with run_once: true17:23
*** maharg101 has quit IRC17:23
jrossertry reverting the change to main.yml from the commit i linked17:24
jrosseri'm suspicious of that because our V upgrade was done before that code was part of a release17:25
mgariepyi did took the last bump in osa17:27
mgariepyhttps://review.opendev.org/c/openstack/openstack-ansible/+/77552117:27
mgariepyPS 3..17:28
mgariepylol17:28
mgariepyreverting the patch fixes the issue.17:30
jrosser /o\ doh17:31
* jrosser -W's the sha bump patch17:33
jrosseryeah so run_once is a really useful construct, becasue set_fact + delegate_to + run_once: true  all combined end up setting the fact on all the play hosts even though the task only ran against the delegated host17:34
mgariepyi isually do run on a testbed first hahah17:36
mgariepynot that time and i got bitten haha17:36
mgariepyso we revert the main.yml to import_tasks then ?17:39
mgariepythanks again for your help jrosser17:42
jrosserwe should certainly revert (and backport the revert to V) of the changes to main.yml17:45
jrosserno worries for helping out :)17:45
jrosserdo you have a moment to make a patch for that?17:45
mgariepysure17:46
jrosserawesome thanks17:46
mgariepyi'll do it.17:46
mgariepywhile the remaining playbook are running :D17:46
mgariepyhaha17:46
mgariepyshould i revert the tag also ?17:49
openstackgerritMarc Gariépy proposed openstack/ansible-role-python_venv_build master: Import_tasks instead of include_tasks  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/77779817:53
openstackgerritMarc Gariépy proposed openstack/ansible-role-python_venv_build master: Import_tasks instead of include_tasks  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/77779817:56
*** andrewbonney has quit IRC18:15
*** spatel has joined #openstack-ansible18:36
*** BoogieMan has joined #openstack-ansible19:08
BoogieManHey everyone. I am trying to setup a dev environment on a hardware desktop (12 core, 32gb, nvme ssd) running fresh ubuntu 20.04 install, fully updated. I am following the guide on openstack docs, and I get through all the playbooks fine up until setup-openstack. I am consistently getting stuck at: os_keystone role, task: bootstrap admin and endpoint19:12
BoogieManI let it run all night. still hangin' out here. No errors, no timeouts, no retries. Checked the logs of the keystone lxc container. I see an error about a selfed signed cert for rabbit in the keystone service journal - could be related? or red herring?19:13
BoogieManRestarting the playbook hangs at the same point19:15
*** maharg101 has joined #openstack-ansible19:19
*** maharg101 has quit IRC19:24
*** jpvlsmv has quit IRC19:25
mgariepyAttributeError: module 'os_brick.initiator' has no attribute 'DRBD'19:29
mgariepythat's fun haha19:29
*** jpvlsmv has joined #openstack-ansible19:35
*** juanoterocas has joined #openstack-ansible20:08
mgariepythe override for a repo pinned to a tag in my user_var was working as expected, just that i was pointing to a Usuri repo and not a victoria one..20:15
*** luksky has quit IRC20:19
*** luksky has joined #openstack-ansible20:19
jrosserBoogieMan: it’s helpful if you can paste  some of the output up to the point it stops to paste.openstack.org20:19
BoogieManSure. I am doing a fresh run now. I will paste once it gets stuck.20:20
jrosserare you using the all-in-one?20:22
BoogieManCorrect20:22
jrosserand which branch did you use?20:22
BoogieManI've tried a couple. latest 22 and a couple of the latest 21.x. let me see what it is now20:23
BoogieManoriginal runs last night were 21.2.3 and 21.2.2 after .3 failed. now it's 22 rc120:24
BoogieManfollowing this guide: https://docs.openstack.org/openstack-ansible/victoria/user/aio/quickstart.html20:26
jrosseri woudnt recommend just switching tags to try to "find something that works"20:26
jrosserthere is an almost mechanised release every couple of weeks20:27
jrosseralso anything with an 'rc' is a release candidate, i.e a pre-release for a particular branch20:28
jrosserso i would recommend using 22.0.1 as the latest tag for victoria20:29
BoogieManYeah I am aware. I would not have tried it, if not for issues with a more stable version20:29
BoogieManok 22.0.1, thats def older than I was trying. I will try it, thanks!20:29
jrosserwell, it shouldnt be like that. the AIO config is what gets run as CI jobs dozens of times a day so it's well tested20:30
jrosserif theres something broken it's better we try to understand that and get it fixed20:30
BoogieManmy mistake, I was using latest doc not victoria. that is why I was getting much newer tags. I will try with stable/victoria now20:33
*** devtolu1__ has joined #openstack-ansible20:36
*** juanoterocas has quit IRC20:38
*** juanoterocas has joined #openstack-ansible20:40
*** devtolu1__ has quit IRC20:43
*** spatel has quit IRC21:10
*** gshippey has quit IRC21:52
*** ajg20 has quit IRC22:06
*** luksky has quit IRC22:33
*** luksky has joined #openstack-ansible22:45
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_horizon master: Use ansible_facts[] instead of fact variables  https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/77765122:53
*** juanoterocas has quit IRC22:59
*** luksky has quit IRC23:33

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!