| *** hamzy has joined #openstack-ansible | 00:22 | |
| *** markvoelker has joined #openstack-ansible | 00:34 | |
| *** markvoelker has quit IRC | 00:39 | |
| *** markvoelker has joined #openstack-ansible | 01:05 | |
| *** hwoarang has quit IRC | 01:12 | |
| *** hwoarang has joined #openstack-ansible | 01:14 | |
| *** markvoelker has quit IRC | 01:32 | |
| *** markvoelker has joined #openstack-ansible | 01:34 | |
| *** cmart has quit IRC | 01:37 | |
| *** cshen has joined #openstack-ansible | 01:46 | |
| *** cshen has quit IRC | 01:50 | |
| *** marst has joined #openstack-ansible | 01:54 | |
| *** BjoernT has joined #openstack-ansible | 02:40 | |
| *** markvoelker has quit IRC | 02:57 | |
| *** cshen has joined #openstack-ansible | 03:15 | |
| *** cshen has quit IRC | 03:20 | |
| *** BjoernT has quit IRC | 03:29 | |
| *** nicolasbock has quit IRC | 03:38 | |
| *** nicolasbock has joined #openstack-ansible | 03:39 | |
| *** nicolasbock has quit IRC | 03:45 | |
| *** udesale has joined #openstack-ansible | 03:50 | |
| *** chkumar246 is now known as chandankumar | 03:52 | |
| *** dave-mccowan has quit IRC | 04:30 | |
| *** marst has quit IRC | 04:39 | |
| *** priteau has joined #openstack-ansible | 04:42 | |
| *** marst has joined #openstack-ansible | 04:43 | |
| *** priteau has quit IRC | 04:47 | |
| *** marst has quit IRC | 05:03 | |
| *** cshen has joined #openstack-ansible | 05:15 | |
| *** cshen has quit IRC | 05:20 | |
| *** chhagarw has joined #openstack-ansible | 05:21 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Reuse tempest installed from git clone https://review.openstack.org/643404 | 05:47 |
|---|---|---|
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Set tempest concurrency to int only https://review.openstack.org/643423 | 05:48 |
| *** chandankumar has quit IRC | 05:58 | |
| *** aludwar has quit IRC | 06:14 | |
| *** aludwar has joined #openstack-ansible | 06:15 | |
| *** cshen has joined #openstack-ansible | 06:19 | |
| *** chandankumar has joined #openstack-ansible | 06:22 | |
| *** cshen has quit IRC | 06:23 | |
| *** ivve has joined #openstack-ansible | 06:27 | |
| *** DanyC has joined #openstack-ansible | 06:30 | |
| *** DanyC has quit IRC | 06:38 | |
| *** rgogunskiy has joined #openstack-ansible | 06:53 | |
| *** miloa has joined #openstack-ansible | 07:09 | |
| miloa | Morning | 07:10 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Reuse tempest installed from git clone https://review.openstack.org/643404 | 07:18 |
| *** DanyC has joined #openstack-ansible | 07:21 | |
| *** cshen has joined #openstack-ansible | 07:26 | |
| *** yolanda has joined #openstack-ansible | 07:30 | |
| *** fnpanic has joined #openstack-ansible | 07:34 | |
| fnpanic | good morning | 07:34 |
| *** pcaruana has joined #openstack-ansible | 07:36 | |
| *** priteau has joined #openstack-ansible | 07:40 | |
| *** kopecmartin|off is now known as kopecmartin | 07:57 | |
| *** DanyC has quit IRC | 08:03 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest stable/rocky: Reuse tempest installed from git clone https://review.openstack.org/643522 | 08:07 |
| *** luksky has joined #openstack-ansible | 08:09 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible stable/rocky: [DNM] tempest lxc debug https://review.openstack.org/643526 | 08:11 |
| masterpe | fnpanic: morning | 08:23 |
| *** pcaruana has quit IRC | 08:24 | |
| *** pcaruana|afk| has joined #openstack-ansible | 08:24 | |
| *** emine__ has joined #openstack-ansible | 08:26 | |
| *** markvoelker has joined #openstack-ansible | 08:27 | |
| CeeMac | morning | 08:51 |
| *** shyamb has joined #openstack-ansible | 08:52 | |
| *** shyamb has quit IRC | 09:08 | |
| *** hwoarang has quit IRC | 09:11 | |
| *** PTO has joined #openstack-ansible | 09:14 | |
| *** hwoarang has joined #openstack-ansible | 09:16 | |
| *** d3n14l has joined #openstack-ansible | 09:16 | |
| d3n14l | I am currently trying to connect my octavia containers to the lbaas-mgmt (vxlan self-sef service) network. But it looks like the lxc container is not speaking vxlan on its corresponding interface. Any hint or idea what I am doing wrong? | 09:18 |
| fnpanic | how does the provider networks look like in openstack_user_config? | 09:21 |
| fnpanic | d3n14l: i guess you are missing something in the config | 09:22 |
| *** logan- has quit IRC | 09:23 | |
| *** DanyC has joined #openstack-ansible | 09:25 | |
| d3n14l | https://pastebin.com/VyDxyzNV | 09:25 |
| d3n14l | I am suspecting "container_type: veth" is wrong, but I did not find any documentation which values are acceptable apart from "veth" | 09:26 |
| fnpanic | ok first, there is a very good explaination in stein to get an understanding of the veth | 09:27 |
| fnpanic | https://docs.openstack.org/openstack-ansible/latest/user/network-arch/example.html | 09:27 |
| *** logan- has joined #openstack-ansible | 09:27 | |
| *** DanyC has quit IRC | 09:29 | |
| fnpanic | second the container networking guide https://docs.openstack.org/openstack-ansible/latest/reference/architecture/container-networking.html | 09:29 |
| fnpanic | i am also not sure about the range of the br-vxlan "65536:65536" | 09:31 |
| fnpanic | please take a look at the settings reference for openstack user config | 09:33 |
| fnpanic | https://docs.openstack.org/openstack-ansible/latest/reference/inventory/openstack-user-config-reference.html#openstack-user-config-reference | 09:33 |
| d3n14l | I wanted to put it outside of the "normal" tunnel vxlan range. Here is the complete provider_network config : https://pastebin.com/gMELNihp | 09:33 |
| *** aedc has joined #openstack-ansible | 09:33 | |
| fnpanic | you are on rocky? | 09:34 |
| d3n14l | yes | 09:34 |
| fnpanic | upgraded or fresh? | 09:35 |
| d3n14l | upgraded. Started at ocata | 09:35 |
| fnpanic | ok then i am not sure but with rocky the neutron agents do not run in containers anymore | 09:36 |
| fnpanic | can you check? | 09:36 |
| d3n14l | Yes. We moved them to baremetal during the upgrade to rocky (i thnik) | 09:36 |
| fnpanic | ok | 09:36 |
| d3n14l | btw: the config ref only says: "Option: container_type (required, string) … Typically 'veth'." | 09:37 |
| fnpanic | yes | 09:38 |
| d3n14l | Is there any known configuration to let a lxc container talk to a vxlan network? Like octavia with the amphora VMs? | 09:39 |
| d3n14l | We need to move LBaaSv2 to Octavia before the upgrade to.Stein. | 09:39 |
| fnpanic | it should, because before rocky the neutron agents where in containers talking to br-vxlan | 09:40 |
| *** DanyC has joined #openstack-ansible | 09:41 | |
| d3n14l | But the ovs (in our case) also was inside of the lxc, right? So this was doing all the vxlan translations, or am I remembering that wrong? | 09:42 |
| fnpanic | mhhh not sure, we are running linuxbridges | 09:43 |
| d3n14l | Just found out, that this might not work… https://linuxcontainers.org/lxc/manpages/man5/lxc.container.conf.5.html The lxc network layer only provides veth, vlan, macvlan, and an already existing interface. | 09:55 |
| d3n14l | Even worse - the openstack-ansible lxc-container interface template only seems to support "veth" and "phys". :-( | 09:59 |
| *** d3n14l has quit IRC | 10:03 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest stable/rocky: Pin stestr to 2.3.0 for rocky https://review.openstack.org/643550 | 10:07 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible stable/rocky: [DNM] tempest lxc debug https://review.openstack.org/643526 | 10:08 |
| *** luksky has quit IRC | 10:09 | |
| *** shyamb has joined #openstack-ansible | 10:10 | |
| *** fnpanic has quit IRC | 10:12 | |
| *** cshen has quit IRC | 10:15 | |
| *** kaiokmo has quit IRC | 10:19 | |
| *** d3n14l has joined #openstack-ansible | 10:23 | |
| *** hamzaachi has joined #openstack-ansible | 10:23 | |
| *** fnpanic has joined #openstack-ansible | 10:33 | |
| *** cshen has joined #openstack-ansible | 10:43 | |
| *** hamzaachi has quit IRC | 10:43 | |
| *** nicolasbock has joined #openstack-ansible | 10:46 | |
| *** tsip has joined #openstack-ansible | 10:47 | |
| tsip | hello | 10:47 |
| tsip | i have a basic AIO running with no issues but i would like to add heat . Do ihave to just run the os-heat playbook ? | 10:48 |
| *** hamzaachi has joined #openstack-ansible | 10:48 | |
| *** shyamb has quit IRC | 10:50 | |
| odyssey4me | tsip depending on how you prepped the AIO, read through https://docs.openstack.org/openstack-ansible/latest/user/aio/quickstart.html#bootstrap-the-aio-configuration | 10:50 |
| odyssey4me | if you used the AIO bootstrap scripts, then it's a copy/paste of the aio config - then run the heat & horizon (for the horizon heat plugin) playbooks | 10:51 |
| odyssey4me | otherwise https://docs.openstack.org/project-deploy-guide/openstack-ansible/latest/configure.html#installing-additional-services | 10:52 |
| tsip | odyssey4me: i prepped AIO using the official docs . Is it safe to run bootstrap-aio again? | 10:52 |
| *** luksky has joined #openstack-ansible | 10:53 | |
| *** chhagarw has quit IRC | 10:53 | |
| fnpanic | hi. what is actually stored in the repo container? It is "only" a pip cache? | 10:56 |
| fnpanic | or also the git of the upstream openstack projects? | 10:56 |
| *** udesale has quit IRC | 10:56 | |
| *** udesale has joined #openstack-ansible | 10:57 | |
| fnpanic | the docs say "Ansible role that deploys a repository server for python packages, git sources and package caching for deb/rpm." | 10:57 |
| fnpanic | is this really the case? | 10:57 |
| odyssey4me | fnpanic from rocky onwards, the package caching is removed | 10:57 |
| fnpanic | ok | 10:57 |
| fnpanic | so only pip caching and upstream openstack git? | 10:57 |
| odyssey4me | but yes, it's git sources, python wheels and in older versions package caching, venv tarballs and some other files which help ensure that things are consistently deployed every time you run the playbooks | 10:58 |
| odyssey4me | it's not really pip caching - it's python wheels of pip packages... wheels are pre-compiled, making the deployment faster | 10:58 |
| fnpanic | ok got it | 10:58 |
| odyssey4me | most packages on pypi do not have wheels pre-compiled, so we do it in the repo build process | 10:59 |
| fnpanic | what about the package state? "latest" and "present"? | 10:59 |
| *** aedc has quit IRC | 11:02 | |
| fnpanic | is this meant when not using source builds of openstack? | 11:03 |
| fnpanic | because i though osa points to a specific commit when deploying | 11:04 |
| *** chhagarw has joined #openstack-ansible | 11:07 | |
| *** shyamb has joined #openstack-ansible | 11:07 | |
| *** ansmith_ has joined #openstack-ansible | 11:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_mistral stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky https://review.openstack.org/643433 | 11:10 |
| *** mkuf has quit IRC | 11:12 | |
| *** aedc has joined #openstack-ansible | 11:15 | |
| *** sm806 has quit IRC | 11:21 | |
| *** sm806 has joined #openstack-ansible | 11:21 | |
| *** tsip has quit IRC | 11:24 | |
| *** aedc has quit IRC | 11:25 | |
| *** d3n14l has quit IRC | 11:28 | |
| *** weshay is now known as weshay|rover | 11:31 | |
| *** tosky has joined #openstack-ansible | 11:43 | |
| *** hamzaachi has quit IRC | 11:51 | |
| odyssey4me | tsip no need to run it again - part of those docs describe copying the conf.d files, that'll be all you need to do | 11:54 |
| odyssey4me | fnpanic typically we have 'latest' to ensure that the installs use whatever the latest available package is for the given constraints - the constraints tell it the right version to use, and they're built from the git SHA for the openstack services themselves | 11:55 |
| odyssey4me | so if you have, say, glance pinned at sha abcd then the repo build process will build the glance wheel from the git source, resulting in glance version x.y.z and the constraints file would contain glance==x.y.z | 11:56 |
| odyssey4me | the /root/.pip/pip.conf file then ensures that the repo container is used exclusively for python package installs by setting the index to the repo container's pypiserver service | 11:57 |
| chandankumar | odyssey4me: Hello | 12:02 |
| odyssey4me | o/ chandankumar | 12:02 |
| chandankumar | odyssey4me: What is the best way to pin a pip package at particular version | 12:02 |
| chandankumar | in osa | 12:02 |
| chandankumar | to some context: https://review.openstack.org/#/c/643550/ | 12:03 |
| chandankumar | and testing here https://review.openstack.org/#/c/643526/ | 12:03 |
| chandankumar | currently os_tempest lxc distro job is broken due to stestr package update issue | 12:03 |
| odyssey4me | chandankumar we inherit from upper-constraints: https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L296 | 12:05 |
| chandankumar | odyssey4me: https://review.openstack.org/#/c/643550/1/defaults/main.yml@193 I am not sure this is the correct fix for this http://logs.openstack.org/42/642842/2/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/4286203/logs/ara-report/result/50784f1b-225b-4b17-b9d8-40725ba2a718/ | 12:05 |
| chandankumar | odyssey4me: but the problem is http://logs.openstack.org/42/642842/2/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/4286203/logs/ara-report/result/327941a1-0eb6-459f-9878-70c8a006b5ac/ | 12:06 |
| chandankumar | odyssey4me: when pip install os-testr/tempest is done for rocky the version is getting updated here to latest | 12:06 |
| chandankumar | odyssey4me: is there a way to avoid that? | 12:06 |
| chandankumar | stestr-2.3.1 stevedore-1.30.1 subprocess32-3.5.3 tempest-19.0.0 | 12:07 |
| odyssey4me | oh, this is for rocky? | 12:07 |
| chandankumar | odyssey4me: yes | 12:08 |
| odyssey4me | hmm, odd that I'm not seeing constraints being applied there | 12:09 |
| odyssey4me | oh, I think constraints were removed for os_tempest because tempest works differently and is not stable branched | 12:10 |
| odyssey4me | does https://review.openstack.org/#/c/643550/1 fix it? I think that may be the only way to actually fix it | 12:11 |
| odyssey4me | The other way would be to make tempest itself block the broken version in its requirements.txt | 12:12 |
| chandankumar | odyssey4me: http://logs.openstack.org/26/643526/2/check/openstack-ansible-deploy-aio_lxc-centos-7/cfd1365/logs/ara-report/result/a762efc0-c0cb-4537-ba88-16caa10084d9/ | 12:13 |
| chandankumar | while testing stestr patch I am hitting this | 12:13 |
| odyssey4me | ah, the integrated build *will* use upper constraints | 12:14 |
| odyssey4me | the role test will not | 12:14 |
| odyssey4me | confusing, I know - that's why we've been trying to move everything to use a single test system | 12:14 |
| chandankumar | http://logs.openstack.org/26/643526/2/check/openstack-ansible-deploy-aio_lxc-centos-7/cfd1365/job-output.txt.gz#_2019-03-15_11_06_46_806811 | 12:14 |
| chandankumar | odyssey4me: is there another way to workaround it currently? | 12:16 |
| odyssey4me | chandankumar I'm confused, venv builds were removed in rocky - so what's http://logs.openstack.org/26/643526/2/check/openstack-ansible-deploy-aio_lxc-centos-7/cfd1365/logs/ara-report/result/a762efc0-c0cb-4537-ba88-16caa10084d9/ from? | 12:16 |
| chandankumar | let me summarize it | 12:18 |
| odyssey4me | oh, apparently not - I see it's still there | 12:18 |
| odyssey4me | I must have been confused - ok. A summary of what's broken in OSA and how that leads back to tempest would be useful. | 12:19 |
| chandankumar | ok | 12:20 |
| chandankumar | https://review.openstack.org/#/c/642842/ on os_nova patch lxc_distro suse job started failing while tempest run http://logs.openstack.org/42/642842/2/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/4286203/logs/ara-report/result/50784f1b-225b-4b17-b9d8-40725ba2a718/ | 12:22 |
| *** mkuf has joined #openstack-ansible | 12:23 | |
| chandankumar | later on investigation we found that, a recent change in stestr https://github.com/mtreinish/stestr/commit/c93bc8165cc717249d5694c2fda7c8f070330e6c causes it | 12:23 |
| chandankumar | while digging down I found that tempest is installed from pip https://github.com/openstack/openstack-ansible-os_tempest/blob/stable/rocky/defaults/main.yml#L190 | 12:24 |
| chandankumar | which is pulling latest stestr version which is causing the issue | 12:24 |
| chandankumar | in order to fix it, I have proposed https://review.openstack.org/#/c/643550/ to pin stestr | 12:25 |
| chandankumar | on os_tempest rocky branch and testing here https://review.openstack.org/643526 to re-run the same job | 12:25 |
| *** markvoelker has quit IRC | 12:25 | |
| chandankumar | but in integrated build it also got broken | 12:25 |
| *** dcdamien has quit IRC | 12:26 | |
| chandankumar | odyssey4me: the tempest is fixed by two way: 1. lower the stestr version and install stestr from master | 12:26 |
| chandankumar | and == 2 | 12:26 |
| *** pcaruana has joined #openstack-ansible | 12:26 | |
| *** dcdamien has joined #openstack-ansible | 12:27 | |
| chandankumar | that's it | 12:27 |
| chandankumar | but the interesting thing is that for source it is working fine | 12:28 |
| *** pcaruana|afk| has quit IRC | 12:28 | |
| odyssey4me | chandankumar something odd is going on - there is no repo container in http://logs.openstack.org/42/642842/2/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/4286203/ | 12:29 |
| odyssey4me | there should be one here: http://logs.openstack.org/42/642842/2/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/4286203/logs/openstack/ | 12:29 |
| odyssey4me | without the repo container, it's not using the pre-build venv method and is instead just installing unconstrained | 12:31 |
| odyssey4me | oh, this is the distro install method - that's why | 12:32 |
| chandankumar | odyssey4me: yes, that;s why i am adding lxc_distro suse job | 12:33 |
| odyssey4me | ok, in the distro install method, there is no repo container because it's all supposed to come from packages... but it seems that's not happening here... let's see why | 12:34 |
| *** chhagarw has quit IRC | 12:34 | |
| chandankumar | for os_tempest installing from distro support is added in this release | 12:34 |
| odyssey4me | it looks like for rocky, the distro install method wasn't done for os_tempest | 12:34 |
| chandankumar | for os_tempest everything will be from pip | 12:34 |
| chandankumar | odyssey4me: will I backport that? | 12:34 |
| odyssey4me | well, that would be one avenue to look at - another would be to try and make it work... let me try and see why constraints aren't being applied | 12:35 |
| chandankumar | sure! | 12:35 |
| *** aedc has joined #openstack-ansible | 12:36 | |
| *** shyamb has quit IRC | 12:37 | |
| *** priteau has quit IRC | 12:38 | |
| *** shyamb has joined #openstack-ansible | 12:39 | |
| *** shyamb has quit IRC | 12:39 | |
| *** chhagarw has joined #openstack-ansible | 12:39 | |
| chandankumar | for master I have proposed these two fixes https://review.openstack.org/#/c/643404/ and https://review.openstack.org/#/c/643423/ please have a look when free! | 12:39 |
| *** mkuf has quit IRC | 12:39 | |
| *** shyamb has joined #openstack-ansible | 12:39 | |
| *** simon-AS559 has joined #openstack-ansible | 12:40 | |
| *** shyamb has quit IRC | 12:40 | |
| odyssey4me | chandankumar ok, I think I see where there's a gap to be plugged, let me put a test patch together to see if it works | 12:44 |
| odyssey4me | so currently stable/rocky is broken, right? | 12:44 |
| chandankumar | odyssey4me: yes | 12:44 |
| odyssey4me | ok, I'll submit a test patch directly to rocky to test my theory - if it works, could you submit the same to master? | 12:48 |
| odyssey4me | I'm going to be out for the afternoon/evening. | 12:48 |
| guilhermesp | mornings | 12:49 |
| guilhermesp | odyssey4me: mind given a workflow here? https://review.openstack.org/#/c/643449/ | 12:50 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Always set pip vars for tempest install https://review.openstack.org/643573 | 13:01 |
| odyssey4me | chandankumar ^ that should do the tric | 13:01 |
| odyssey4me | *trick | 13:01 |
| odyssey4me | ok, I'm out for the day - have a good day and weekend all | 13:06 |
| jamesdenton | Good morning, everyone. Quick question - I'm trying to rebase https://review.openstack.org/#/c/590810/ and getting some merge conflicts seen here http://paste.openstack.org/show/747860/. "Convert existing roles into galaxy roles" is the very first commit for os_neutron. | 13:11 |
| *** chhagarw has quit IRC | 13:11 | |
| *** chhagarw has joined #openstack-ansible | 13:11 | |
| *** mkuf has joined #openstack-ansible | 13:12 | |
| *** PTO has quit IRC | 13:15 | |
| jamesdenton | Alright, nevermind. The commit history was missing so I guess it went all the way back. | 13:18 |
| *** ivve has quit IRC | 13:18 | |
| *** chhagarw has quit IRC | 13:20 | |
| guilhermesp | odyssey4me: based on your review.. yeah I'm not sure actually if is it being used, but was defined here too https://github.com/openstack/openstack-ansible-os_mistral/blob/2407ccd6a713af6ceca739007d405306f84851ba/tasks/mistral_install.yml#L77 | 13:21 |
| guilhermesp | taking os_glance as an example, we see a use here https://github.com/openstack/openstack-ansible-os_glance/blob/9539f40f7c926f582ca49c9e725f721543bbed23/tasks/glance_install_source.yml#L49 but not in mistral | 13:21 |
| *** marst has joined #openstack-ansible | 13:21 | |
| guilhermesp | hum ok, seems that this is part of the new way to build the venvs I assume | 13:22 |
| guilhermesp | so needs to be removed in stable/rocky | 13:23 |
| *** hamzaachi has joined #openstack-ansible | 13:26 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_mistral stable/rocky: Port venv build of os_mistral to stable/rocky https://review.openstack.org/643449 | 13:26 |
| *** BjoernT has joined #openstack-ansible | 13:33 | |
| *** pcaruana has quit IRC | 13:36 | |
| cloudnull | mornings | 13:37 |
| jamesdenton | hey there cloudnull | 13:40 |
| *** marst has quit IRC | 13:42 | |
| guilhermesp | how's going cloudnull ? :) | 13:43 |
| *** hamzaachi has quit IRC | 13:47 | |
| *** hamzaachi has joined #openstack-ansible | 13:47 | |
| cloudnull | its going | 13:50 |
| * cloudnull still waking up | 13:50 | |
| jamesdenton | it's going. Need my second cup of coffee | 13:52 |
| cloudnull | jamesdenton chicken place today ? | 13:57 |
| jamesdenton | oh come on. | 13:57 |
| jamesdenton | how... could you do that. | 13:57 |
| cloudnull | if you start driving now you could get here for dinner ! | 13:57 |
| jamesdenton | DInner tomorrow :D | 13:58 |
| cloudnull | hahaha | 13:58 |
| mgariepy | if you both start driving you might be able to meet in the middle for dinner tonigh? | 13:58 |
| cloudnull | i was channeling my inner jamesdenton, asking for about lunch at 09:00 | 13:58 |
| cloudnull | mgariepy on my way ! | 13:59 |
| cloudnull | :P | 13:59 |
| mgariepy | haha | 13:59 |
| mgariepy | at least it's friday ! | 13:59 |
| jamesdenton | oh man i'm starving. and its 10:00 here. | 14:00 |
| cloudnull | haha | 14:00 |
| *** cmart has joined #openstack-ansible | 14:10 | |
| *** marst has joined #openstack-ansible | 14:13 | |
| *** nicolasbock has quit IRC | 14:15 | |
| *** nicolasbock has joined #openstack-ansible | 14:15 | |
| *** hamzaachi has quit IRC | 14:17 | |
| *** pcaruana has joined #openstack-ansible | 14:17 | |
| *** pcaruana|afk| has joined #openstack-ansible | 14:17 | |
| *** pcaruana|afk| has quit IRC | 14:17 | |
| *** hamzaachi has joined #openstack-ansible | 14:19 | |
| *** jhesketh_ has quit IRC | 14:20 | |
| *** hamzaachi has quit IRC | 14:20 | |
| *** hamzaachi has joined #openstack-ansible | 14:21 | |
| chandankumar | odyssey4me: was in a meeting, looking now | 14:40 |
| *** hamzaachi has quit IRC | 14:41 | |
| *** priteau has joined #openstack-ansible | 14:41 | |
| chandankumar | odyssey4me: http://logs.openstack.org/73/643573/1/check/openstack-ansible-deploy-aio_distro_lxc-opensuse-423/c015fad/job-output.txt.gz#_2019-03-15_14_17_53_508660 | 14:42 |
| chandankumar | odyssey4me: pip_install_upper_constraints' is undefined | 14:42 |
| *** hamzaachi has joined #openstack-ansible | 14:43 | |
| *** hamzaachi has quit IRC | 14:43 | |
| *** jhesketh_ has joined #openstack-ansible | 14:46 | |
| *** hamzaachi has joined #openstack-ansible | 14:46 | |
| *** jhesketh has quit IRC | 14:49 | |
| *** jhesketh has joined #openstack-ansible | 14:49 | |
| *** jhesketh_ has quit IRC | 14:51 | |
| *** jhesketh has quit IRC | 14:54 | |
| *** rgogunskiy has quit IRC | 14:54 | |
| *** jhesketh has joined #openstack-ansible | 15:03 | |
| *** cmart has quit IRC | 15:08 | |
| *** cmart has joined #openstack-ansible | 15:09 | |
| mnaser | has there been any investigation on the ceph jobs? | 15:19 |
| mnaser | logan-: perhaps you might have some cycles to look into it? | 15:19 |
| mnaser | oh looks like jrosser is on top of it anyways | 15:22 |
| mnaser | i say lets get it to non voting so we can merge code. | 15:22 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: zuul: move ceph jobs to non-voting https://review.openstack.org/643608 | 15:25 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: Revert "zuul: move ceph jobs to non-voting" https://review.openstack.org/643609 | 15:25 |
| mnaser | jrosser, logan-, cloudnull, odyssey4me ^ | 15:25 |
| cloudnull | mnaser it looks like the ceph repos are still busted? | 15:25 |
| mnaser | cloudnull: indeed, so i made a change to move them to non-voting, they're working on them (according to their irc channel) | 15:26 |
| mnaser | the revert change is so we keep track of it :) | 15:26 |
| cloudnull | I +2 'd both | 15:26 |
| cloudnull | hopefully they'll gate | 15:26 |
| cloudnull | :) | 15:26 |
| mnaser | ++ | 15:26 |
| cloudnull | how are things ? | 15:26 |
| mnaser | busy busy busy as usual | 15:26 |
| * mnaser is 3 days behind on his task list | 15:26 | |
| mnaser | <insert everything is fine with everything on fire photo> | 15:27 |
| * cloudnull knows the feeling | 15:27 | |
| mnaser | in ops its easy to have a plan | 15:27 |
| mnaser | which then some arbitrary thing goes on fire and that allllll goes to shit | 15:27 |
| mnaser | lol | 15:27 |
| cloudnull | https://fewzion.com.au/wp-content/uploads/2015/07/tyson.jpg | 15:28 |
| mnaser | like oh run ansible against a bunch of hosts and then a few of them specifically crash with the same kernel crash | 15:28 |
| openstackgerrit | Merged openstack/openstack-ansible-os_mistral master: Updated from OpenStack Ansible Tests https://review.openstack.org/639538 | 15:30 |
| cloudnull | nice work on the mistral things btw ! | 15:30 |
| openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: fix tox python3 overrides https://review.openstack.org/609973 | 15:30 |
| * cloudnull remembers he has a patch I need to submit to get manila working | 15:30 | |
| chandankumar | mnaser: regarding stestr tempest issue odyssey4me is working on a feasible solution we found some issue with distro issue | 15:32 |
| chandankumar | mnaser: https://review.openstack.org/#/c/643573/ | 15:32 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: fix tox python3 overrides https://review.openstack.org/609980 | 15:32 |
| chandankumar | mnaser: guilhermesp more info here https://github.com/mtreinish/stestr/issues/235 | 15:34 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ceph_client master: Add additional linked libs for cephfs https://review.openstack.org/643612 | 15:37 |
| *** cmart has quit IRC | 15:39 | |
| *** cmart has joined #openstack-ansible | 15:40 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_almanach master: fix tox python3 overrides https://review.openstack.org/609977 | 15:43 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_manila master: Update manila so that it works with cephfs https://review.openstack.org/643616 | 15:45 |
| jrosser | mnaser: ceph repo seems fixed now | 15:46 |
| logan- | nice | 15:48 |
| logan- | i was just gonna say both patches look fine. theres a thread on ceph-users ML and an upstream bug (http://tracker.ceph.com/issues/38763) so i figure get fixed soon and we can revert | 15:48 |
| logan- | agreed the repo works fine for me now | 15:51 |
| *** ygk_12345 has joined #openstack-ansible | 15:53 | |
| ygk_12345 | odyssey4me: Hi :) | 15:53 |
| ygk_12345 | odyssey4me: need some help with heat | 15:53 |
| *** chhagarw has joined #openstack-ansible | 15:54 | |
| *** cshen has quit IRC | 15:57 | |
| *** udesale has quit IRC | 15:59 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: fix tox python3 overrides https://review.openstack.org/609975 | 16:04 |
| *** simon-AS559 has quit IRC | 16:06 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_heat master: fix tox python3 overrides https://review.openstack.org/609976 | 16:06 |
| openstackgerrit | Merged openstack/openstack-ansible-os_mistral stable/rocky: Port venv build of os_mistral to stable/rocky https://review.openstack.org/643449 | 16:17 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: fix tox python3 overrides https://review.openstack.org/609979 | 16:20 |
| *** cmart has quit IRC | 16:21 | |
| ygk_12345 | odyssey4me: r u busy ? | 16:22 |
| *** kopecmartin is now known as kopecmartin|off | 16:22 | |
| *** gyee has joined #openstack-ansible | 16:23 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible stable/rocky: Add support to deploy mistral https://review.openstack.org/642614 | 16:27 |
| *** luksky has quit IRC | 16:35 | |
| *** miloa has quit IRC | 16:37 | |
| *** aedc has quit IRC | 16:44 | |
| *** cshen has joined #openstack-ansible | 16:49 | |
| *** ygk_12345 has quit IRC | 16:50 | |
| *** cshen has quit IRC | 17:00 | |
| *** luksky has joined #openstack-ansible | 17:26 | |
| *** priteau has quit IRC | 17:30 | |
| *** dcdamien has quit IRC | 17:38 | |
| *** cmart has joined #openstack-ansible | 17:54 | |
| *** DanyC has quit IRC | 18:00 | |
| *** priteau has joined #openstack-ansible | 18:00 | |
| *** DanyC has joined #openstack-ansible | 18:01 | |
| *** hamzaachi has quit IRC | 18:01 | |
| *** DanyC has quit IRC | 18:05 | |
| *** nurdie has joined #openstack-ansible | 18:11 | |
| *** chhagarw has quit IRC | 18:14 | |
| *** DanyC has joined #openstack-ansible | 18:18 | |
| *** DanyC has quit IRC | 18:22 | |
| guilhermesp | cores, could you take a look at this? it is blocking some of the suse jobs https://review.openstack.org/#/c/643423/2 | 18:35 |
| guilhermesp | for example https://review.openstack.org/#/c/642614/2 and https://review.openstack.org/#/c/642842/2 | 18:35 |
| *** gshippey has quit IRC | 18:37 | |
| cloudnull | guilhermesp +2 from me | 18:37 |
| guilhermesp | thank you man! | 18:38 |
| cloudnull | chandankumar mind having a look at that PR ? | 18:38 |
| cloudnull | or any other cores for that matter | 18:40 |
| mnaser | hello | 18:46 |
| guilhermesp | cloudnull mnaser once it merges https://review.openstack.org/#/c/643423/ I'd just explore you once again to give your review to the backport for stable/rocky. Thanks in advance :) | 18:51 |
| *** tosky has quit IRC | 18:53 | |
| *** cshen has joined #openstack-ansible | 18:56 | |
| *** cshen has quit IRC | 19:00 | |
| *** hamzaachi has joined #openstack-ansible | 19:09 | |
| openstackgerrit | Ilya Popov proposed openstack/openstack-ansible master: Fix connectivity between octavia and amphorae. https://review.openstack.org/643659 | 19:09 |
| *** hamzaachi has quit IRC | 19:10 | |
| *** hamzaachi has joined #openstack-ansible | 19:10 | |
| *** cshen has joined #openstack-ansible | 19:13 | |
| *** priteau has quit IRC | 19:13 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_manila master: Update manila so that it works with cephfs https://review.openstack.org/643616 | 19:17 |
| mnaser | spotz, d34dh0r53, evrardjp, odyssey4me, jrosser, cloudnull, logan-, mgariepy, hwoarang: http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003877.html | 19:19 |
| *** DanyC has joined #openstack-ansible | 19:21 | |
| *** DanyC has quit IRC | 19:24 | |
| *** cshen has quit IRC | 19:27 | |
| spotz | mnaser: replied | 19:29 |
| *** dave-mccowan has joined #openstack-ansible | 19:30 | |
| cloudnull | also replied | 19:34 |
| *** openstack has joined #openstack-ansible | 19:44 | |
| *** ChanServ sets mode: +o openstack | 19:44 | |
| *** nicolasbock has quit IRC | 19:45 | |
| *** nicolasbock has joined #openstack-ansible | 19:45 | |
| *** ivve has joined #openstack-ansible | 19:48 | |
| *** pcaruana has quit IRC | 19:59 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Set tempest concurrency to int only https://review.openstack.org/643423 | 20:13 |
| *** emine__ has quit IRC | 20:14 | |
| jrosser | i've seen this a bunch of times - 503 for keystone and i think also nova http://logs.openstack.org/97/643097/1/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/097258f/logs/openstack/aio1_utility_container-0f64e1ca/utility/stestr_results.html | 20:16 |
| jrosser | any clues anyone? | 20:16 |
| nicolasbock | I added cinder.yml to /etc of an existing AIO and ran os-cinder-install. The playbook gets stuck when it tries to install the cinder wheel in the cinder-api container. Do I need to update the repo server? And if, how? | 20:22 |
| *** ivve has quit IRC | 20:34 | |
| jrosser | nicolasbock: https://github.com/openstack/openstack-ansible/blob/master/playbooks/repo-build.yml <- that should do it | 20:35 |
| logan- | nicolasbock: openstack-ansible repo-build.yml -e repo_build_wheel_rebuild=yes | 20:39 |
| nicolasbock | Ok, thanks, I'll try that. I had done repo-build, but am still seeing `Could not find a version that satisfies the requirement cinder==13.0.0.0b4.dev41` although I can see the wheel on the repo server | 20:41 |
| nicolasbock | I'll try the extra var | 20:41 |
| *** mkuf_ has joined #openstack-ansible | 21:02 | |
| *** marst has quit IRC | 21:05 | |
| *** mkuf has quit IRC | 21:05 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: Adds DPDK support for Open vSwitch https://review.openstack.org/590810 | 21:19 |
| *** BjoernT has quit IRC | 21:23 | |
| *** cshen has joined #openstack-ansible | 21:23 | |
| *** DanyC has joined #openstack-ansible | 21:25 | |
| *** BjoernT has joined #openstack-ansible | 21:27 | |
| *** cshen has quit IRC | 21:28 | |
| *** DanyC has quit IRC | 21:29 | |
| mnaser | hey jrosser i've actually seen that a few times | 21:34 |
| mnaser | its weird because | 21:34 |
| mnaser | only _some_ tests fail | 21:34 |
| mnaser | so .. the identity service seems to be largely functioning | 21:35 |
| *** nurdie has quit IRC | 21:36 | |
| jrosser | mnaser: i was looking at the keystone journal - at the time the tempest test says 503 there is a lot of stuff going on | 21:39 |
| mnaser | jrosser: where did you find that | 21:39 |
| jrosser | i wonder if its just busy and doesnt keep haproxy happy that the service is still up | 21:40 |
| jrosser | you can see the haproxy 503 here http://logs.openstack.org/97/643097/1/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/097258f/logs/openstack/aio1-haproxy/haproxy.log.txt.gz#_Mar_15_19_42_27 | 21:42 |
| *** dcdamien has joined #openstack-ansible | 21:42 | |
| jrosser | and here is the keystone log from the same sort of time http://logs.openstack.org/97/643097/1/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/097258f/logs/openstack/aio1_keystone_container-58c949a3/keystone-wsgi-public.service.journal-19-43-29.log.txt.gz#_Mar_15_19_42_00 | 21:43 |
| *** hwoarang has quit IRC | 21:49 | |
| *** hamzaachi has quit IRC | 21:50 | |
| *** hwoarang has joined #openstack-ansible | 21:50 | |
| *** KeithMnemonic has quit IRC | 21:51 | |
| mnaser | ok jrosser `keystone_service-back/<NOSRV>` is a really good catch | 21:56 |
| jrosser | I’m not sure we log those haproxy service up/down events anywhere? | 22:00 |
| *** dcdamien has quit IRC | 22:15 | |
| *** BjoernT has quit IRC | 22:18 | |
| *** markvoelker has joined #openstack-ansible | 22:20 | |
| *** nurdie has joined #openstack-ansible | 22:22 | |
| *** markvoelker has quit IRC | 22:24 | |
| *** nurdie has quit IRC | 22:27 | |
| *** DanyC has joined #openstack-ansible | 22:39 | |
| *** markvoelker has joined #openstack-ansible | 22:51 | |
| *** mkuf_ has quit IRC | 23:01 | |
| *** cshen has joined #openstack-ansible | 23:24 | |
| *** cshen has quit IRC | 23:28 | |
| nicolasbock | logan-, jrosser, I tried the repo-build step and am a little further now. The error message I am getting from the cinder-api container is: Could not find a version that satisfies the requirement cinder==13.0.0.0b4.dev41. However, the wheel is in the pools directory on the repo server. | 23:36 |
| nicolasbock | I'll try to debug pip to see why it's not finding that wheel | 23:37 |
| *** DanyC has quit IRC | 23:50 | |
| *** cmart has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
