| openstackgerrit | Merged openstack-dev/devstack: Enable CDH and Spark plugin by default in Sahara https://review.openstack.org/159107 | 00:02 |
|---|---|---|
| *** e0ne has quit IRC | 00:02 | |
| openstackgerrit | Jamie Lennox proposed openstack/tempest: Make V3 authentication more strict https://review.openstack.org/159342 | 00:03 |
| phd2 | hey guys i am running into this issue | 00:05 |
| *** apevec has quit IRC | 00:05 | |
| phd2 | Traceback (most recent call last): | 00:05 |
| phd2 | File "tools/colorizer.py", line 48, in <module> | 00:05 |
| phd2 | import subunit | 00:05 |
| phd2 | ImportError: No module named subunit | 00:05 |
| phd2 | any idea why runtempest is causing this issue? | 00:05 |
| *** oomichi has joined #openstack-qa | 00:05 | |
| openstackgerrit | Chris Hoge proposed openstack/tempest: Add UUIDs to all tempest tests and gate check https://review.openstack.org/159633 | 00:05 |
| clarkb | phd2 how are you running tempest? iirc the current method is via tox which will install all deps to a virtualenv | 00:06 |
| phd2 | what is tox? | 00:07 |
| clarkb | it is a python environment manager for testing | 00:08 |
| phd2 | ok tryng it | 00:08 |
| phd2 | it is doing some i/o | 00:08 |
| phd2 | gneconfig installdeps is running | 00:08 |
| phd2 | ok | 00:08 |
| *** rodrigods is now known as rodrigod` | 00:08 | |
| phd2 | thanks giving that a run | 00:08 |
| *** rfolco has joined #openstack-qa | 00:08 | |
| *** rodrigod` is now known as rodrigods | 00:08 | |
| phd2 | tox -egenconfig was right on the overiew site | 00:09 |
| *** rodrigods has quit IRC | 00:09 | |
| phd2 | died becausse no ffi | 00:09 |
| phd2 | c/_cffi_backend.c:13:17: fatal error: ffi.h: No such file or directory | 00:09 |
| *** mahito has joined #openstack-qa | 00:09 | |
| clarkb | you will need libffi-dev I think | 00:09 |
| phd2 | yeah installing it | 00:09 |
| phd2 | .... | 00:09 |
| phd2 | running again | 00:10 |
| mtreinish | FatDarrel: I think most people run it from git, or from a tagged version in the git repo | 00:10 |
| phd2 | there are not tags on it | 00:11 |
| mtreinish | clarkb: fwiw, I think that colorizer script is still used with the run_tempest.sh script (like run_tests.sh in the projects but for tempest tests isntead of unit tests) | 00:11 |
| phd2 | This is all i see 1 | 00:11 |
| phd2 | 2 | 00:11 |
| phd2 | 3 | 00:11 |
| phd2 | diablo-eol | 00:11 |
| phd2 | essex-eol | 00:11 |
| phd2 | folsom-eol | 00:11 |
| phd2 | grizzly-eol | 00:11 |
| phd2 | havana-eol | 00:11 |
| mtreinish | phd2: yes those are the tags | 00:11 |
| phd2 | we are on juno so there is no juno release ehre | 00:11 |
| mtreinish | phd2: do a 'git show 3' | 00:12 |
| mtreinish | phd2: since the move to branchless tempest the "releases" are decoupled from the projects | 00:12 |
| mtreinish | so calling something juno or icehouse would be disingenuous | 00:13 |
| phd2 | ok so you are just by the auth version | 00:13 |
| phd2 | 3 is V3 right? | 00:13 |
| mtreinish | no, 3 is tempest-3 it's the 3rd milestone since the change in release cadence | 00:13 |
| mtreinish | if you run git show 3, it'll the tag msg will explain why it was tagged and which releases are supported | 00:14 |
| phd2 | i seee | 00:14 |
| phd2 | ok | 00:14 |
| phd2 | its a little strange but i get it | 00:14 |
| openstackgerrit | Al Miller proposed openstack-dev/devstack: Remove LBaaS support from devstack https://review.openstack.org/153079 | 00:15 |
| mtreinish | hogepodge: I was mostly concerned about the extra maint. headache around it. Especially as we move more stuff to tempest-lib and want to move the unit tests too. | 00:15 |
| mtreinish | hogepodge: I don't want people to have to worry about the decorator on something that we aren't tracking externally and has the potential to be moved into another repo | 00:16 |
| hogepodge | mtreinish: makes sense. I've removed the ids and fixed the tool in the latest patch set. | 00:17 |
| hogepodge | Looks like the gate is failing again. :-/ | 00:17 |
| *** yamamoto has joined #openstack-qa | 00:17 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/155360 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1311066 https://bugs.launchpad.net/bugs/1425310, gate-tempest-dsvm-postgres-full: unrecognized error | 00:17 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 00:17 |
| openstack | Launchpad bug 1425310 in Cinder "tgtadm: this access control rule does not exist - results in timeout waiting for volume to attach (stuck in detach) or detach" [High,Confirmed] | 00:17 |
| hogepodge | added the uuidgen tox target too, which is a really good idea | 00:18 |
| *** rodrigods has joined #openstack-qa | 00:19 | |
| mtreinish | hogepodge: hmm, recheck for now, we can look at debugging that failure later. Looks like it was on juno so not the highest prio right now | 00:19 |
| mtreinish | hogepodge: cool, thanks | 00:19 |
| openstackgerrit | Al Miller proposed openstack-dev/devstack: Remove LBaaS support from devstack https://review.openstack.org/153079 | 00:19 |
| *** david-lyle is now known as david-lyle_Afk | 00:22 | |
| *** david-lyle_Afk is now known as david-lyle_afk | 00:22 | |
| *** annashen has joined #openstack-qa | 00:22 | |
| phd2 | mtreinish: good news is I got the thing to install from git | 00:22 |
| phd2 | i had to do some apt-get installing but it all worked out | 00:23 |
| phd2 | now the question is | 00:23 |
| phd2 | how do i run it :) | 00:23 |
| mtreinish | phd2: well, you need to write a tempest.conf file to describe the cloud you're running it against | 00:24 |
| *** cody-somerville has quit IRC | 00:24 | |
| mtreinish | there's a sample config file in the repo under etc/tempest.conf | 00:24 |
| phd2 | mtreinish: that makes sense is there some documentation | 00:24 |
| phd2 | or just follow the sample file | 00:25 |
| phd2 | because I ahve a machine that has openstack installed | 00:25 |
| mtreinish | phd2: the sample has a description of all the options so it'll have the most exhaustive info | 00:25 |
| mtreinish | phd2: I also have the start of a config guide doc under review here: https://review.openstack.org/#/c/157935/ | 00:25 |
| mtreinish | http://docs-draft.openstack.org/35/157935/4/check/gate-tempest-docs/d28cba8//doc/build/html/configuration.html | 00:26 |
| mtreinish | but it's still missing most of the detail, it just covers how to configure auth and creds | 00:26 |
| phd2 | ok how do i launch it | 00:26 |
| phd2 | run tests.sh? | 00:26 |
| *** shashankhegde has joined #openstack-qa | 00:27 | |
| mtreinish | phd2: I would personally just run tox -efull, which use the tox python utility to run the tempest tests | 00:27 |
| mtreinish | run_tests.sh is for running tempest's unit tests | 00:27 |
| mtreinish | run_tempest.sh is the equiv version of that script for running the tempest tests | 00:27 |
| *** cburgess has quit IRC | 00:28 | |
| *** cnesa has quit IRC | 00:28 | |
| *** cnesa has joined #openstack-qa | 00:28 | |
| *** cburgess has joined #openstack-qa | 00:28 | |
| *** mattoliverau has quit IRC | 00:29 | |
| *** mattoliverau has joined #openstack-qa | 00:29 | |
| *** EmilienM|afk has quit IRC | 00:29 | |
| *** mwagner_lap has quit IRC | 00:29 | |
| mtreinish | phd2: could I ask you to write down all the steps your going through and the difficulties you're having and post it somewhere when you get everything working. | 00:29 |
| phd2 | yes I am going to do that | 00:30 |
| phd2 | and get it published and send it over | 00:30 |
| mtreinish | I think that would be very helpful to try and make things easier in the future | 00:30 |
| mtreinish | ok great | 00:30 |
| *** EmilienM has joined #openstack-qa | 00:30 | |
| phd2 | yeah it needs to be way easier | 00:30 |
| *** dmorita has joined #openstack-qa | 00:36 | |
| *** mahito has quit IRC | 00:41 | |
| *** mahito has joined #openstack-qa | 00:43 | |
| jogo | anyone else see issues with juno http://logs.openstack.org/47/159247/1/check/check-tempest-dsvm-full-juno/4f19a79/logs/screen-g-api.txt.gz#_2015-02-26_21_47_48_614 | 00:45 |
| jogo | morganfainberg: ^ any ideas | 00:45 |
| morganfainberg | jogo, looking | 00:46 |
| mtreinish | jogo: that happened really on, during devstack image upload | 00:47 |
| jogo | mtreinish: yeah, seen same issue on a bunch of patches of mine | 00:48 |
| jogo | that have juno tests | 00:48 |
| mtreinish | jogo: I was seeing a bunch of juno neutron failures earlier related to ipv6, but this is the first I've seen that one | 00:48 |
| morganfainberg | well i mean the token doesn't exist as far as keystone is aware: http://logs.openstack.org/47/159247/1/check/check-tempest-dsvm-full-juno/4f19a79/logs/apache/keystone.txt.gz#_2015-02-26_21_47_48_612691 | 00:49 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest: Add support for roles to credentials providers https://review.openstack.org/143159 | 00:49 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest: Switch swift tests to use cred_provider with roles https://review.openstack.org/158941 | 00:49 |
| *** mahito has quit IRC | 00:49 | |
| *** yamamoto has quit IRC | 00:49 | |
| openstackgerrit | Matthew Treinish proposed openstack-dev/devstack: Do Not Merge: Test test-accounts with roles https://review.openstack.org/158511 | 00:49 |
| morganfainberg | jogo, so at the very least middleware is doing what it's supposed to do | 00:49 |
| phd2 | hey gueys | 00:50 |
| phd2 | so i am getting this issue | 00:50 |
| mtreinish | jogo: but if it's happening that early it makes me think that something screwed up during the setup | 00:50 |
| jogo | mtreinish: yeah | 00:50 |
| phd2 | ./run_tempest.sh | 00:50 |
| phd2 | tools/with_venv.sh: line 4: subunit-2to1: command not found | 00:50 |
| phd2 | Traceback (most recent call last): | 00:50 |
| phd2 | 00:50 | |
| phd2 | any ideas? | 00:50 |
| *** hemna is now known as hemnafk | 00:51 | |
| mtreinish | phd2: that means the subunit package didn't get installed in your venv correctly. You can recreate the venv with the --force option | 00:51 |
| mtreinish | jogo: heh it also spent an hour downloading an image: http://logs.openstack.org/47/159247/1/check/check-tempest-dsvm-full-juno/4f19a79/logs/devstacklog.txt.gz#_2015-02-26_21_47_47_646 | 00:52 |
| morganfainberg | oh | 00:52 |
| morganfainberg | if it took an hour to download an image the token might have expired | 00:52 |
| mtreinish | oh, that's a good point | 00:53 |
| mtreinish | that's probably what it is :) | 00:53 |
| jogo | morganfainberg: lolz | 00:53 |
| jogo | what | 00:53 |
| *** annashen has quit IRC | 00:54 | |
| jogo | trove! | 00:54 |
| mtreinish | yeah that's a trove image | 00:54 |
| jogo | http://logs.openstack.org/47/159247/1/check/check-tempest-dsvm-full-juno/4f19a79/logs/devstacklog.txt.gz#_2015-02-26_20_46_04_484 | 00:54 |
| *** annashen has joined #openstack-qa | 00:54 | |
| *** yamamoto has joined #openstack-qa | 00:55 | |
| jogo | mtreinish: asking infra, maybe they know how we do it on master etc. | 00:55 |
| mtreinish | phd2: oh, also this might help, this is a tempest conf generated by devstack in the ci system: http://logs.openstack.org/73/157273/21/check/check-tempest-dsvm-full/80398e7/logs/tempest_conf.txt.gz | 00:56 |
| mtreinish | jogo: well it should be precached, but if the devstack changed landed after the nodepool image create it won't have been cached | 00:56 |
| mtreinish | we have this issue from time to time and people keep forgetting about the sync problem | 00:57 |
| mtreinish | jogo: or it could also be a bug somewhere | 00:57 |
| jogo | mtreinish: what change? | 00:57 |
| mtreinish | dunno, I assumed it was a new image added to devstack | 00:57 |
| mtreinish | no just checked the juno log there wasn't an image added | 00:58 |
| *** achanda has quit IRC | 00:58 | |
| *** annashen has quit IRC | 00:59 | |
| jogo | hmm maybe it was this If76f25dfe0f975faf1883f0a6d993c21b26e1b29 | 01:00 |
| jogo | changed the location | 01:00 |
| jogo | but that was 4 months ago ... | 01:01 |
| mtreinish | jogo: yeah I doubt that was it, I'm looking at the nodepool log now to see if there was anything weird there | 01:01 |
| *** Noice has quit IRC | 01:01 | |
| mtreinish | jogo: I'm thinking it was related to: https://review.openstack.org/#/c/159235/1 | 01:01 |
| *** dims has joined #openstack-qa | 01:01 | |
| mtreinish | because that's what nodepool uses to get the image list to know what to cache | 01:02 |
| jogo | its caching the new image | 01:02 |
| jogo | mtreinish: master uses http://tarballs.openstack.org/trove/images/ubuntu/mysql.qcow2 | 01:03 |
| jogo | stable uses http://tarballs.openstack.org/trove/images/ubuntu_mysql.qcow2/ubuntu_mysql.qcow2 | 01:03 |
| mtreinish | jogo: oh, backport If76f25dfe0f975faf1883f0a6d993c21b26e1b29 to juno then? | 01:03 |
| mtreinish | jogo: but it should run an image list on juno and cache the old one too | 01:04 |
| jamielennox | ianw: so i figured out the problem of https://review.openstack.org/#/c/156527/1 and it's a PITA | 01:05 |
| jogo | mtreinish: possibly seeing mage_list.sh failed | 01:06 |
| *** mahito has joined #openstack-qa | 01:06 | |
| phd2 | mtreinish: on another note | 01:06 |
| jamielennox | is there a reliable service restart anywhere in devstack, particularly for keystone? | 01:06 |
| phd2 | i got ./run_tests.sh to run and it gave some results back | 01:07 |
| mtreinish | jogo: yeah looking at the nodepool log it looks like it's failing | 01:08 |
| jogo | mtreinish: can't reproduce any failure locally though | 01:08 |
| *** Sukhdev_ has quit IRC | 01:08 | |
| mtreinish | jogo: http://paste.openstack.org/show/182766/ | 01:09 |
| jogo | hmm image isn't cached on new side either | 01:09 |
| *** bknudson has joined #openstack-qa | 01:10 | |
| mtreinish | clarkb: ^^^ shouldn't the image not be used if something fails? | 01:10 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 01:11 |
| phd2 | mtreinish: ok i don’t get this i ran run tests but it seems to have installed some sort of openstack shelll to run these tests how do I point it to my install? | 01:11 |
| *** yamamoto has quit IRC | 01:11 | |
| clarkb | mtreinish: yes | 01:11 |
| clarkb | mtreinish: are we sure its being used? | 01:11 |
| *** tsekiyam_ has joined #openstack-qa | 01:12 | |
| mtreinish | clarkb: it doesn't look like the images are being cached | 01:12 |
| phd2 | ok this tempest things is nto doing what it says it should be dong | 01:12 |
| jogo | mtreinish: possible unrelated issue check-tempest-dsvm-postgres-full-icehouse doesn't cache wget -c http://download.cirros-cloud.net/0.3.1/cirros-0.3.1-x86_64-uec.tar.gz -O /opt/stack/new/devstack/files/cirros-0.3.1-x86_64-uec.tar.gz | 01:13 |
| *** yamamoto has joined #openstack-qa | 01:14 | |
| jogo | mtreinish: it can't be my patch | 01:15 |
| jogo | that is https://review.openstack.org/#/c/159235/1 | 01:15 |
| jogo | failures started much earlier | 01:15 |
| jogo | message:" wget -c" AND tags:"devstacklog.txt" AND NOT message:"+ wget -c http://download.cirros-cloud.net/0.3.1/cirros-0.3.1-x86_64-uec.tar.gz -O /opt/stack/new/devstack/files/cirros-0.3.1-x86_64-uec.tar.gz" | 01:15 |
| *** tsekiyama has quit IRC | 01:16 | |
| *** tsekiyam_ has quit IRC | 01:16 | |
| phd2 | so how do you guys invoke good old tempest | 01:19 |
| jogo | tonyb: the nodepool logs aren't very useful there | 01:20 |
| clarkb | jogo: where? | 01:20 |
| *** erlon_away has quit IRC | 01:21 | |
| clarkb | I am looking at logs and that problem seems to only happen on the check image so far | 01:22 |
| clarkb | but I need to do more grepping | 01:22 |
| * tonyb assumes jogo didn't mean to poke me | 01:22 | |
| jogo | tonyb: my bad | 01:22 |
| jogo | clarkb: actually I think I found it | 01:22 |
| jogo | clarkb: we don't seem to fetch the image used in stable juno | 01:23 |
| jogo | only master | 01:23 |
| *** diegows has quit IRC | 01:24 | |
| jogo | where is tools/image_list.sh called from on the image building side ? | 01:25 |
| clarkb | jogo: which file specifically? (I want to grep for it to see if dib vs snapshot makes a difference | 01:25 |
| jogo | http://tarballs.openstack.org/trove/images/ubuntu_mysql.qcow2/ubuntu_mysql.qcow2 | 01:26 |
| jogo | is the stable/juno file | 01:26 |
| clarkb | jogo: https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/cache-devstack/extra-data.d/55-cache-devstack-repos#n153 there and https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/cache_devstack.py#n130 there | 01:26 |
| jogo | and http://tarballs.openstack.org/trove/images/ubuntu/mysql.qcow2 is the image on master | 01:26 |
| clarkb | appears to affect both types of builds | 01:26 |
| jogo | clarkb: I don't see anything in that code for checking stable branchs | 01:27 |
| clarkb | jogo: expand your horizons :) | 01:27 |
| mtreinish | clarkb: it does, it loops over all the brances | 01:27 |
| clarkb | line 99 | 01:28 |
| jogo | never mind | 01:28 |
| * jogo scrolls up | 01:28 | |
| mtreinish | s/clarkb/jogo | 01:28 |
| clarkb | jogo: can you test that devstack's tool works in juno? | 01:28 |
| clarkb | because if it returns not that image we don't cache that image | 01:28 |
| jogo | clarkb: yeah http://paste.openstack.org/show/182771 | 01:29 |
| jogo | from origin/stable/juno | 01:29 |
| *** shashankhegde has quit IRC | 01:29 | |
| jogo | bbiab, heading out for a run | 01:30 |
| *** ChuckC has quit IRC | 01:33 | |
| *** yamamoto has quit IRC | 01:33 | |
| *** marun has quit IRC | 01:33 | |
| mtreinish | clarkb, jogo: so it failed for me: http://paste.openstack.org/show/182772/ | 01:33 |
| jogo | mtreinish: well looks like we have our work cut out for us tomorrow. ... | 01:33 |
| mtreinish | which I think is the same thing I was seeing in the nodepool logs | 01:34 |
| jogo | distro not supported | 01:34 |
| mtreinish | oh, that might be because I'm done and just ran it on arch | 01:34 |
| mtreinish | s/done/dumb | 01:35 |
| clarkb | hehehe | 01:35 |
| clarkb | I don't see an distro_not_supported inthe image logs | 01:35 |
| mtreinish | clarkb: it was the other bits | 01:35 |
| mtreinish | clarkb: http://paste.openstack.org/show/182766/ | 01:35 |
| clarkb | I am about to run the calling script | 01:35 |
| jogo | similar but I see /opt/git/openstack-dev/devstack/stackrc:670:die, | 01:35 |
| jogo | in the nodepool logs | 01:35 |
| clarkb | mtreinish: I don't see that either :/ | 01:36 |
| clarkb | also devstack-precise-check is unused | 01:36 |
| clarkb | ya that log is from the 26th | 01:36 |
| clarkb | which is today | 01:36 |
| jogo | couldn't determine host ip | 01:36 |
| clarkb | why am I not seeing them | 01:36 |
| * jogo runs away | 01:36 | |
| mtreinish | clarkb: heh I downloaded the log from http://paste.openstack.org/show/182766/ and searched around in it to find that for the pastebin | 01:38 |
| clarkb | I don't think that is necessarily related, it only shows up on mages that that don't run the trove job | 01:38 |
| mtreinish | (it was too big and hanging firefox) | 01:38 |
| clarkb | I think the bigger issue is that we are listing images from devstack and not getting that particular image | 01:38 |
| mtreinish | wow I'm just full of fail tonight that was the wrong paste buffer for the link | 01:39 |
| mtreinish | clarkb: well are we sure the image list is working correctly? | 01:39 |
| *** ShaunR has left #openstack-qa | 01:40 | |
| clarkb | mtreinish: I think it mostly is | 01:42 |
| clarkb | mtreinish: it definitely derped on a handful of images in hpcloud-b1 for some reason though | 01:42 |
| clarkb | mtreinish: but none of those run the trove job so I don't think its related | 01:42 |
| clarkb | I just ran a modified version of teh script that queries image_list and didn't get that image | 01:43 |
| clarkb | modified it to skip downloads and just print the filename | 01:43 |
| clarkb | I think I may know why though | 01:43 |
| mtreinish | hmm, ok | 01:44 |
| clarkb | nope theory is bad, need to dig more | 01:45 |
| clarkb | it is very much not listing that image htough | 01:45 |
| *** yamamoto has joined #openstack-qa | 01:50 | |
| clarkb | mtreinish: it has to do with the git checkout, its not working right | 01:50 |
| clarkb | I manually checked out juno branch and everything gets juno images | 01:50 |
| clarkb | I should be able to fix this now that i know why it is failing | 01:50 |
| mtreinish | clarkb: yeah I just did the same (I had to spin up an ubuntu guest) | 01:51 |
| clarkb | oh hrm might be a perms thing in my local case | 01:52 |
| clarkb | which should be a problem during image builds let me see if its still broken with perms cleaned up | 01:52 |
| clarkb | ok that cleaned it up, so its possible there is a permissions issue during building | 01:53 |
| mtreinish | ok, I remember having to play a lot of games with that the last time I added something to a build script | 01:56 |
| mtreinish | so that makes sense to me :) | 01:56 |
| clarkb | I gave up and am just using dib directly | 01:57 |
| clarkb | :) | 01:57 |
| clarkb | looks like it may be permissions issues, at least my local build has them too | 01:57 |
| *** achanda has joined #openstack-qa | 01:58 | |
| clarkb | I think there is a good chance that we are unable to switch branches in those scripts due to permissions issues | 02:00 |
| mtreinish | ok, sure I could see that. Just want to sudo it? I'm sure that's safe :) | 02:01 |
| clarkb | first I am going to clear out my local dib cache and have it rebuild without any explicit sudo's and see if the permissions end up correct | 02:02 |
| *** mahito has quit IRC | 02:02 | |
| openstackgerrit | Jamie Lennox proposed openstack-dev/devstack: Create _member_ role in keystone bootstrap https://review.openstack.org/159690 | 02:02 |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/155512 failed gate-tempest-dsvm-neutron in the gate queue with an unrecognized error | 02:03 |
| clarkb | mtreinish: but IO locally is slow so this will take forever :) | 02:03 |
| mtreinish | clarkb: heh, no ssd? | 02:04 |
| clarkb | not mounted where I put images | 02:04 |
| clarkb | also comcast | 02:05 |
| clarkb | which recently got better which is nice | 02:05 |
| clarkb | but its still only ~80mbps down at best | 02:05 |
| mtreinish | clarkb: that's pretty good I pay for 75/75 from fios and ~80-90 is what it normally tops out at in either direction | 02:06 |
| clarkb | ya they doubled everyones downstream bw if you had docsis3 modem | 02:08 |
| clarkb | so it was much lower previously :) | 02:08 |
| clarkb | yup its a permissions thing I think | 02:10 |
| clarkb | I restarted my cache from scratch to avoid any derpage I may have done but the way it mounts in a tmp image filesystem root owns the devstack repo | 02:10 |
| mtreinish | yeah, that would do it | 02:10 |
| clarkb | so the image build is unable to switch branches | 02:10 |
| clarkb | I am not sure what the "correct" fix is yet, mordred probably knows | 02:11 |
| clarkb | but we should possibly consider sudoing there | 02:11 |
| mtreinish | clarkb: yeah dunno, I would think it's either we figure out how to not clone as root, chown before we run the script, or run the script as sudo | 02:12 |
| mtreinish | the last is probably the easies | 02:12 |
| clarkb | ya, I also need to check if this is an issue during snapshot builds | 02:12 |
| clarkb | looking into that now | 02:12 |
| clarkb | yup looks like it would be the same issue | 02:14 |
| clarkb | ugh | 02:14 |
| *** catohornet has quit IRC | 02:14 | |
| *** mahito has joined #openstack-qa | 02:15 | |
| jogo | so this never worked I guess ... | 02:16 |
| jogo | that explains why the icehouse image download as well | 02:16 |
| mtreinish | jogo: heh, it was definitely working at one point | 02:16 |
| jamielennox | ianw: https://review.openstack.org/159690 | 02:17 |
| * mtreinish calls it a night... | 02:18 | |
| clarkb | I am writing the simple fix to use sudo | 02:18 |
| *** mahito has quit IRC | 02:20 | |
| openstackrecheck | Console logs not available after 13:24s for gate-keystone-python27 159675,3,b7e99a7 | 02:20 |
| mordred | what | 02:21 |
| mordred | ? | 02:21 |
| mordred | I'm sure the correct fix is ... I don't know ruby? | 02:21 |
| mordred | clarkb, mtreinish | 02:21 |
| clarkb | mordred: exactly, I just pusehd the fix up https://review.openstack.org/159693 | 02:21 |
| mordred | sweet! | 02:21 |
| mordred | I win then | 02:21 |
| clarkb | ha | 02:21 |
| *** mahito has joined #openstack-qa | 02:23 | |
| *** rwsu is now known as rwsu-afk | 02:26 | |
| jogo | clarkb: thanks, | 02:30 |
| ianw | jamielennox: so this replaces https://review.openstack.org/#/c/156527/3 ? | 02:30 |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest: Fix response schema for compute aggregate API https://review.openstack.org/157194 | 02:39 |
| *** woodster_ has quit IRC | 02:40 | |
| *** gfidente has quit IRC | 02:46 | |
| jamielennox | ianw: right | 02:51 |
| *** yamamoto has quit IRC | 02:53 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/157273 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1311066 https://bugs.launchpad.net/bugs/1425310 | 02:54 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 02:54 |
| openstack | Launchpad bug 1425310 in Cinder "tgtadm: this access control rule does not exist - results in timeout waiting for volume to attach (stuck in detach) or detach" [High,Confirmed] | 02:54 |
| *** weshay has quit IRC | 02:56 | |
| *** dkranz has quit IRC | 02:58 | |
| *** yamamoto has joined #openstack-qa | 02:59 | |
| *** yamahata has quit IRC | 03:05 | |
| *** achanda has quit IRC | 03:05 | |
| *** mwagner_lap has joined #openstack-qa | 03:06 | |
| *** patrickeast has quit IRC | 03:07 | |
| *** achanda has joined #openstack-qa | 03:08 | |
| *** rfolco has quit IRC | 03:10 | |
| jamielennox | mtreinish, andreaf: either of you here? | 03:17 |
| openstackgerrit | Jamie Lennox proposed openstack/tempest: Make V3 authentication more strict https://review.openstack.org/159342 | 03:21 |
| openstackgerrit | Jamie Lennox proposed openstack/tempest: Create a new project for trusts tests https://review.openstack.org/158198 | 03:24 |
| *** jyuso1 has joined #openstack-qa | 03:26 | |
| *** phd2 has quit IRC | 03:26 | |
| *** FatDarrel has joined #openstack-qa | 03:27 | |
| *** FatDarrel has quit IRC | 03:28 | |
| *** jecarey has joined #openstack-qa | 03:34 | |
| openstackgerrit | Al Miller proposed openstack-dev/devstack: Remove LBaaS support from devstack https://review.openstack.org/153079 | 03:39 |
| *** sabeen has joined #openstack-qa | 03:40 | |
| *** achanda has quit IRC | 03:40 | |
| *** dims has quit IRC | 03:41 | |
| *** Poornima has joined #openstack-qa | 03:42 | |
| openstackgerrit | Al Miller proposed openstack-dev/devstack: Remove LBaaS support from devstack https://review.openstack.org/153079 | 03:43 |
| *** flwang1 has quit IRC | 03:54 | |
| *** annashen has joined #openstack-qa | 03:54 | |
| *** achanda has joined #openstack-qa | 03:59 | |
| *** annashen has quit IRC | 04:01 | |
| *** annashen has joined #openstack-qa | 04:02 | |
| *** annashen has quit IRC | 04:04 | |
| *** achanda has quit IRC | 04:07 | |
| *** annashen has joined #openstack-qa | 04:07 | |
| openstackrecheck | openstack/heat change: https://review.openstack.org/135835 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1373513 https://bugs.launchpad.net/bugs/1421895 https://bugs.launchpad.net/bugs/1376941 https://bugs.launchpad.net/bugs/1311066 https://bugs.launchpad.net/bugs/1352498 | 04:14 |
| openstack | Launchpad bug 1373513 in Cinder "Lvm hang during tempest tests" [Critical,In progress] - Assigned to John Griffith (john-griffith) | 04:14 |
| openstack | Launchpad bug 1421895 in Cinder "test_encrypted_cinder_volumes_luks fails with "Volume is still attached, detach volume first."" [High,Confirmed] | 04:14 |
| openstack | Launchpad bug 1352498 in Cinder "duplicate for #1376941 Tempest fails spectacularly with "VolumeType c39f18bf-2408-4377-98f6-ef2839d6f70e deletion failed, VolumeType in use."" [Undecided,New] | 04:14 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 04:14 |
| *** annashen has quit IRC | 04:20 | |
| *** Madan has joined #openstack-qa | 04:29 | |
| *** annashen has joined #openstack-qa | 04:29 | |
| *** BharatK has joined #openstack-qa | 04:34 | |
| openstackgerrit | Noboru Iwamatsu proposed openstack-dev/devstack: make stack.sh to handle proxy environment variables when installs epel-release package from epel-bootstrap repo. https://review.openstack.org/159710 | 04:39 |
| *** dims has joined #openstack-qa | 04:42 | |
| *** yfried has joined #openstack-qa | 04:43 | |
| *** yfried|afk has quit IRC | 04:43 | |
| *** annashen_ has joined #openstack-qa | 04:46 | |
| *** dims has quit IRC | 04:47 | |
| *** madhuri has quit IRC | 04:47 | |
| *** mrda is now known as mrda-away | 04:50 | |
| *** achanda has joined #openstack-qa | 04:55 | |
| *** annashen_ has quit IRC | 04:57 | |
| *** achanda has quit IRC | 04:59 | |
| *** annashen_ has joined #openstack-qa | 04:59 | |
| *** annashen has quit IRC | 05:00 | |
| *** sgordon is now known as steveg | 05:03 | |
| *** annashen_ has quit IRC | 05:04 | |
| *** coolsvap_ is now known as coolsvap | 05:08 | |
| *** achanda has joined #openstack-qa | 05:11 | |
| *** chandankumar has joined #openstack-qa | 05:13 | |
| openstackgerrit | Merged openstack-dev/devstack: Change config of keystone_authtoken in lib/ironic https://review.openstack.org/155360 | 05:18 |
| *** rushiagr_away is now known as rushiagr | 05:18 | |
| openstackgerrit | Jamie Lennox proposed openstack/tempest: Make V3 authentication more strict https://review.openstack.org/159342 | 05:19 |
| *** jecarey has quit IRC | 05:23 | |
| *** annashen has joined #openstack-qa | 05:24 | |
| *** achanda has quit IRC | 05:28 | |
| openstackrecheck | openstack/keystone change: https://review.openstack.org/155512 failed gate-tempest-dsvm-neutron in the gate queue with an unrecognized error | 05:32 |
| *** steveg is now known as sgordon | 05:47 | |
| *** annashen_ has joined #openstack-qa | 05:51 | |
| *** Krast has joined #openstack-qa | 05:52 | |
| *** annashen has quit IRC | 05:55 | |
| *** abhirc has quit IRC | 05:55 | |
| *** annashen has joined #openstack-qa | 05:56 | |
| hogepodge | These false negatives in the gate are truly maddening. | 05:57 |
| *** rushiagr is now known as rushiagr_away | 05:57 | |
| *** achanda has joined #openstack-qa | 05:59 | |
| *** annashen has quit IRC | 06:00 | |
| *** rushiagr_away is now known as rushiagr | 06:05 | |
| *** oomichi has quit IRC | 06:13 | |
| *** anshul has joined #openstack-qa | 06:23 | |
| openstackgerrit | Ken Chen proposed openstack-dev/devstack: Change use_floating_ips to true when neutron is not enabled https://review.openstack.org/159728 | 06:26 |
| *** melwitt has quit IRC | 06:29 | |
| *** dims has joined #openstack-qa | 06:31 | |
| *** dims has quit IRC | 06:36 | |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: Revert "Revert "Make neutron the default in devstack"" https://review.openstack.org/159216 | 06:37 |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: Support for single interface Neutron networking https://review.openstack.org/158424 | 06:37 |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: Set a default for OVS_PHYSICAL_BRIDGE https://review.openstack.org/159215 | 06:37 |
| *** SridharG has joined #openstack-qa | 06:41 | |
| *** chandankumar has quit IRC | 06:44 | |
| *** cnesa1 has joined #openstack-qa | 06:44 | |
| *** woodster_ has joined #openstack-qa | 06:44 | |
| *** cnesa has quit IRC | 06:46 | |
| *** annashen_ has quit IRC | 06:47 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/157273 failed because of: gate-tempest-dsvm-nova-v21-full: https://bugs.launchpad.net/bugs/1311066 https://bugs.launchpad.net/bugs/1344513 | 06:52 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 06:52 |
| openstack | Launchpad bug 1344513 in Cinder "test_cinder_encryption_type_list fails" [Undecided,New] | 06:52 |
| *** cnesa1 has quit IRC | 06:53 | |
| *** sabeen has quit IRC | 06:57 | |
| *** e0ne has joined #openstack-qa | 07:01 | |
| *** chandankumar has joined #openstack-qa | 07:02 | |
| *** BharatK has quit IRC | 07:02 | |
| *** neeti has joined #openstack-qa | 07:05 | |
| *** annashen has joined #openstack-qa | 07:12 | |
| *** pkoniszewski has joined #openstack-qa | 07:15 | |
| *** k4n0 has joined #openstack-qa | 07:15 | |
| *** SridharG has quit IRC | 07:19 | |
| *** annashen has quit IRC | 07:25 | |
| *** cnesa has joined #openstack-qa | 07:25 | |
| *** annashen has joined #openstack-qa | 07:26 | |
| *** annashen has quit IRC | 07:29 | |
| *** achanda has quit IRC | 07:38 | |
| *** BharatK has joined #openstack-qa | 07:39 | |
| *** achanda has joined #openstack-qa | 07:45 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest: Adding common header attributes in image header schema https://review.openstack.org/159008 | 07:49 |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest: Add 'servers_links' attribute in server list schema https://review.openstack.org/159037 | 07:50 |
| *** achanda has quit IRC | 07:50 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest: Add 'images_links' attribute in image list schema https://review.openstack.org/159044 | 07:50 |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest: Add 'fault' attributes in server schema https://review.openstack.org/159360 | 07:51 |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest: Block additionalProperties on Nova API tests https://review.openstack.org/156130 | 07:51 |
| *** dmellado has quit IRC | 07:52 | |
| *** dmellado has joined #openstack-qa | 07:54 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/155863 failed because of: gate-tempest-dsvm-neutron: https://bugs.launchpad.net/bugs/1311066 | 08:15 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 08:15 |
| *** e0ne has quit IRC | 08:16 | |
| *** yfried has quit IRC | 08:27 | |
| *** ChuckC has joined #openstack-qa | 08:27 | |
| *** gfidente has joined #openstack-qa | 08:29 | |
| *** gfidente has quit IRC | 08:29 | |
| *** gfidente has joined #openstack-qa | 08:29 | |
| *** mahito has quit IRC | 08:30 | |
| *** salv-orlando has joined #openstack-qa | 08:34 | |
| *** jlanoux has joined #openstack-qa | 08:39 | |
| *** ibiris_away is now known as ibiris | 08:39 | |
| *** nfedotov has joined #openstack-qa | 08:47 | |
| k4n0 | gmann, ping | 08:53 |
| gmann | k4n0: pong | 08:54 |
| k4n0 | gmann, apologies i couldnt finish up the get_server "fault" attribute issue | 08:55 |
| k4n0 | gmann, caught up with something | 08:55 |
| k4n0 | gmann, I am looking for more such unexpected attributes now | 08:55 |
| gmann | k4n0: no issue. i released a patch for that | 08:55 |
| gmann | k4n0: i think now there should not be any as all tests pass for V2 | 08:56 |
| *** mpaolino has joined #openstack-qa | 08:56 | |
| gmann | k4n0: for V2.1 we are fixing on nova side | 08:56 |
| k4n0 | gmann, ok so are we done for v2.0 ? | 08:56 |
| gmann | k4n0: yes. you can see all tests passing on 156130 :) | 08:57 |
| k4n0 | gmann, yep :) | 08:57 |
| k4n0 | gmann, let me know if any further work is required though | 08:57 |
| gmann | k4n0: thanks. Yes we might need help on rearranging schema files. | 08:57 |
| *** yamamoto has quit IRC | 08:58 | |
| gmann | k4n0: i need to put a spec for that and after that we can start together | 08:58 |
| k4n0 | gmann, great, lets do that | 08:58 |
| gmann | k4n0: after spec i will create a etherpad and we can start work in parallel | 08:59 |
| gmann | k4n0: ll let you know for that | 08:59 |
| k4n0 | gmann, ok, thanks | 08:59 |
| gmann | k4n0: np! | 08:59 |
| *** gmann has quit IRC | 09:00 | |
| openstackgerrit | Andrea Frittoli proposed openstack/tempest: Support v3 in credential providers and subclasses https://review.openstack.org/133029 | 09:00 |
| *** mpaolino has quit IRC | 09:00 | |
| *** mpaolino has joined #openstack-qa | 09:01 | |
| *** markus_z has joined #openstack-qa | 09:02 | |
| *** ajo has joined #openstack-qa | 09:03 | |
| *** gmann has joined #openstack-qa | 09:03 | |
| *** yamamoto has joined #openstack-qa | 09:03 | |
| *** jordanP has joined #openstack-qa | 09:06 | |
| *** ajo has quit IRC | 09:07 | |
| *** ajo has joined #openstack-qa | 09:10 | |
| *** woodster_ has quit IRC | 09:10 | |
| *** andreykurilin_ has joined #openstack-qa | 09:12 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 09:12 | |
| *** cnesa1 has joined #openstack-qa | 09:14 | |
| *** cnesa has quit IRC | 09:15 | |
| openstackgerrit | Merged openstack/tempest: Add UUIDs to tests with tools and checks https://review.openstack.org/157273 | 09:24 |
| *** chandankumar has quit IRC | 09:31 | |
| *** ibiris is now known as ibiris_away | 09:31 | |
| *** ihrachyshka has joined #openstack-qa | 09:34 | |
| *** chandankumar has joined #openstack-qa | 09:36 | |
| ymorkovn | Could some PPL take a look https://review.openstack.org/#/c/157817/ There is a patch for adding ddt to requirements.txt | 09:38 |
| *** tkammer has joined #openstack-qa | 09:39 | |
| *** flwang1 has joined #openstack-qa | 09:39 | |
| *** ibiris_away is now known as ibiris | 09:40 | |
| *** neeti has quit IRC | 09:45 | |
| *** neeti has joined #openstack-qa | 09:47 | |
| *** chandankumar has quit IRC | 09:52 | |
| *** dmorita has quit IRC | 09:52 | |
| *** SergeyLukjanov has quit IRC | 09:53 | |
| *** DinaBelova has quit IRC | 09:53 | |
| *** DinaBelova has joined #openstack-qa | 09:53 | |
| *** SergeyLukjanov has joined #openstack-qa | 09:55 | |
| *** svasheka has quit IRC | 09:55 | |
| *** ajayaa has joined #openstack-qa | 09:57 | |
| ajayaa | * Topic for #openstack-glance is: Discussion of OpenStack Glance | logs at http://eavesdrop.openstack.org/irclogs/%23openstack-glance/ | 09:57 |
| ajayaa | * Topic for #openstack-glance set by jeblair at Fri Jan 23 05:26:50 2015 | 09:57 |
| ajayaa | <ajayaa> Hi guys. I am trying to run tempest tests against just glance. I get problems in setUpClass itself for all the | 09:57 |
| ajayaa | Hi guys. I am trying to run tempest tests against just glance. I get problems in setUpClass itself for all the tests I am trying to run. I think all the conf parameters are right because I can run identity tests. Any idea on what is going wrong. | 09:57 |
| *** chandankumar has joined #openstack-qa | 10:05 | |
| openstackgerrit | git-harry proposed openstack/tempest: Start instances using fixed network when possible https://review.openstack.org/159776 | 10:11 |
| *** e0ne has joined #openstack-qa | 10:19 | |
| *** gfidente has quit IRC | 10:20 | |
| *** gfidente has joined #openstack-qa | 10:24 | |
| *** tochi has quit IRC | 10:29 | |
| *** neeti has quit IRC | 10:33 | |
| *** deepakcs has joined #openstack-qa | 10:36 | |
| deepakcs | Hi all, can someone look at http://lists.openstack.org/pipermail/openstack-dev/2015-February/057948.html and provide inputs ? | 10:37 |
| *** andreykurilin_ has quit IRC | 10:49 | |
| *** aix has joined #openstack-qa | 10:52 | |
| *** tosky has joined #openstack-qa | 10:57 | |
| *** annoyingspore has quit IRC | 11:07 | |
| *** pc_m has joined #openstack-qa | 11:09 | |
| deepakcs | Hi all, can someone look at http://lists.openstack.org/pipermail/openstack-dev/2015-February/057948.html and provide inputs ? | 11:28 |
| *** yamamoto has quit IRC | 11:29 | |
| *** coolsvap is now known as coolsvap_ | 11:30 | |
| *** mpaolino has quit IRC | 11:31 | |
| *** SridharG has joined #openstack-qa | 11:31 | |
| *** mpaolino has joined #openstack-qa | 11:31 | |
| *** e0ne has quit IRC | 11:33 | |
| *** deepakcs has quit IRC | 11:33 | |
| *** e0ne has joined #openstack-qa | 11:36 | |
| *** mpaolino has quit IRC | 11:36 | |
| *** mpaolino has joined #openstack-qa | 11:36 | |
| *** mpaolino has quit IRC | 11:38 | |
| *** mpaolino has joined #openstack-qa | 11:38 | |
| *** ylobankov has quit IRC | 11:39 | |
| *** mpaolino has quit IRC | 11:40 | |
| *** mpaolino has joined #openstack-qa | 11:41 | |
| *** SridharG has quit IRC | 11:44 | |
| *** diegows has joined #openstack-qa | 11:53 | |
| *** cdent has joined #openstack-qa | 11:57 | |
| *** aix has quit IRC | 12:00 | |
| *** coolsvap_ is now known as coolsvap | 12:02 | |
| *** afazekas has joined #openstack-qa | 12:04 | |
| *** dims has joined #openstack-qa | 12:04 | |
| *** e0ne is now known as e0ne_ | 12:04 | |
| *** ylobankov has joined #openstack-qa | 12:05 | |
| *** rfolco has joined #openstack-qa | 12:07 | |
| *** obutenko has joined #openstack-qa | 12:11 | |
| *** marrusl has quit IRC | 12:12 | |
| *** chandankumar_ has joined #openstack-qa | 12:12 | |
| *** SridharG has joined #openstack-qa | 12:12 | |
| *** yamamoto has joined #openstack-qa | 12:14 | |
| *** chandankumar has quit IRC | 12:15 | |
| *** Poornima has quit IRC | 12:16 | |
| *** cody-somerville has joined #openstack-qa | 12:16 | |
| *** marrusl has joined #openstack-qa | 12:20 | |
| *** amotoki has joined #openstack-qa | 12:21 | |
| *** aysyd has joined #openstack-qa | 12:23 | |
| *** SridharG has left #openstack-qa | 12:24 | |
| *** neeti has joined #openstack-qa | 12:32 | |
| *** ajayaa has quit IRC | 12:32 | |
| *** SridharG has joined #openstack-qa | 12:35 | |
| *** rushiagr is now known as rushiagr_away | 12:35 | |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/159633 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1357055 https://bugs.launchpad.net/bugs/1311066 | 12:40 |
| openstack | Launchpad bug 1357055 in tempest "Race to delete shared subnet in Tempest neutron full jobs" [Undecided,Confirmed] - Assigned to Salvatore Orlando (salvatore-orlando) | 12:40 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 12:40 |
| *** thgomes has joined #openstack-qa | 12:41 | |
| *** SridharG has left #openstack-qa | 12:41 | |
| *** mpaolino has quit IRC | 12:48 | |
| *** mpaolino has joined #openstack-qa | 12:48 | |
| *** mpaolino has quit IRC | 12:50 | |
| *** mpaolino has joined #openstack-qa | 12:50 | |
| *** eugene_bag2 has quit IRC | 12:51 | |
| *** weshay has joined #openstack-qa | 12:52 | |
| *** mpaolino has quit IRC | 12:55 | |
| *** aix has joined #openstack-qa | 12:55 | |
| *** mpaolino has joined #openstack-qa | 12:56 | |
| *** woodster_ has joined #openstack-qa | 12:56 | |
| *** mpaolino has quit IRC | 12:58 | |
| *** mpaolino has joined #openstack-qa | 12:58 | |
| *** e0ne_ is now known as e0ne | 12:59 | |
| *** rfolco has quit IRC | 13:04 | |
| *** Madan has quit IRC | 13:05 | |
| *** neeti has quit IRC | 13:06 | |
| pc_m | sdague: ping | 13:12 |
| openstackgerrit | Sean Dague proposed openstack/tempest: remove redundant negative flavor admin tests https://review.openstack.org/158852 | 13:14 |
| *** abhirc has joined #openstack-qa | 13:15 | |
| *** rfolco has joined #openstack-qa | 13:17 | |
| *** mpaolino has quit IRC | 13:19 | |
| *** mpaolino has joined #openstack-qa | 13:20 | |
| *** dims is now known as dimsum__ | 13:27 | |
| openstackgerrit | Nikolay Fedotov proposed openstack/tempest: Update test_create_show_delete_firewall test to make it test 'fwaas insertion mode' https://review.openstack.org/159831 | 13:28 |
| *** Ananci has joined #openstack-qa | 13:29 | |
| openstackgerrit | Sergey Reshetnyak proposed openstack-dev/devstack: Add data-processing service for Sahara https://review.openstack.org/135454 | 13:33 |
| *** eugene_bag has joined #openstack-qa | 13:46 | |
| openstackrecheck | openstack/trove change: https://review.openstack.org/138577 failed because of: gate-trove-functional-dsvm-mysql: https://bugs.launchpad.net/bugs/1311066 | 13:50 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 13:50 |
| *** Ananci has quit IRC | 13:50 | |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: Revert "Revert "Make neutron the default in devstack"" https://review.openstack.org/159216 | 13:51 |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: Support for single interface Neutron networking https://review.openstack.org/158424 | 13:51 |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: Set a default for OVS_PHYSICAL_BRIDGE https://review.openstack.org/159215 | 13:51 |
| *** eugene_bag1 has joined #openstack-qa | 13:52 | |
| *** eugene_bag has quit IRC | 13:52 | |
| *** abhirc has quit IRC | 13:53 | |
| *** eugene_bag has joined #openstack-qa | 13:55 | |
| *** eugene_bag1 has quit IRC | 13:56 | |
| *** mpaolino has quit IRC | 13:58 | |
| *** mpaolino has joined #openstack-qa | 13:58 | |
| *** eugene_bag has quit IRC | 14:00 | |
| *** mpaolino has quit IRC | 14:00 | |
| *** mpaolino has joined #openstack-qa | 14:00 | |
| *** abhirc has joined #openstack-qa | 14:02 | |
| *** abhirc has quit IRC | 14:04 | |
| *** rbak_ has quit IRC | 14:05 | |
| *** mtanino has quit IRC | 14:07 | |
| *** chandankumar_ has quit IRC | 14:11 | |
| *** itzikb has joined #openstack-qa | 14:12 | |
| *** malini has joined #openstack-qa | 14:18 | |
| *** rushiagr_away is now known as rushiagr | 14:18 | |
| *** amotoki has quit IRC | 14:24 | |
| *** mestery has quit IRC | 14:25 | |
| *** mriedem has joined #openstack-qa | 14:28 | |
| *** ibiris is now known as ibiris_away | 14:30 | |
| *** coolsvap is now known as coolsvap_ | 14:31 | |
| *** sabeen1 has joined #openstack-qa | 14:33 | |
| *** dimsum__ has quit IRC | 14:36 | |
| *** itzikb has quit IRC | 14:38 | |
| *** dims_ has joined #openstack-qa | 14:38 | |
| *** psedlak has quit IRC | 14:39 | |
| *** rushiagr is now known as rushiagr_away | 14:40 | |
| *** ibiris_away is now known as ibiris | 14:41 | |
| *** mestery has joined #openstack-qa | 14:41 | |
| *** bknudson has quit IRC | 14:42 | |
| *** e0ne has quit IRC | 14:42 | |
| mriedem | mestery: newish neutron gate bug https://bugs.launchpad.net/neutron/+bug/1426397 | 14:43 |
| openstack | Launchpad bug 1426397 in neutron "tempest.scenario.test_network_v6.TestGettingAddress.test_slaac_from_os intermittently fails with MismatchError" [Undecided,New] | 14:43 |
| mriedem | looks like it started around 2/25 | 14:43 |
| mestery | mriedem: Looking | 14:43 |
| *** e0ne has joined #openstack-qa | 14:43 | |
| *** psedlak has joined #openstack-qa | 14:44 | |
| mestery | mriedem: I've got HenryG looking at it to triage a bit | 14:45 |
| mriedem | thanks | 14:45 |
| *** sabeen1 has quit IRC | 14:47 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron ipv6 bug 1426397 https://review.openstack.org/159868 | 14:47 |
| openstack | bug 1426397 in neutron "tempest.scenario.test_network_v6.TestGettingAddress.test_slaac_from_os intermittently fails with MismatchError" [Undecided,New] https://launchpad.net/bugs/1426397 | 14:47 |
| *** dansmith is now known as superdan | 14:48 | |
| openstackrecheck | openstack/requirements change: https://review.openstack.org/144443 failed gate-tempest-dsvm-neutron, gate-tempest-dsvm-neutron-full in the gate queue with an unrecognized error | 14:49 |
| *** jecarey has joined #openstack-qa | 14:51 | |
| *** cody-somerville has quit IRC | 14:51 | |
| *** psedlak has quit IRC | 14:52 | |
| mriedem | mestery: HenryG: 887ca8e9f8df2df65bf4fef4338704c35fdb2545 | 14:52 |
| *** mtanino has joined #openstack-qa | 14:52 | |
| mestery | mriedem: Is that our culprit? | 14:53 |
| *** psedlak has joined #openstack-qa | 14:54 | |
| mriedem | mestery: well, ipv6 related and merged at the right time | 14:54 |
| mriedem | 2/25 | 14:54 |
| mestery | mriedem: ack | 14:54 |
| mriedem | the big neutron callbacks change had me looking but it doesn't look like anything merged yet which is using that | 14:54 |
| mestery | mriedem: Right, we only merged the infrastructure for that. | 14:54 |
| mestery | mriedem: And in fact, armax is traveling back from India, so I'll try to hold the patches off that use it until he's safely back in CA and can help debug any issues that arise ;) | 14:55 |
| *** thgomes has quit IRC | 14:55 | |
| *** Ananci has joined #openstack-qa | 14:56 | |
| *** mpaolino has quit IRC | 14:58 | |
| *** mpaolino has joined #openstack-qa | 14:58 | |
| *** e0ne is now known as e0ne_ | 15:01 | |
| *** mpaolino has quit IRC | 15:02 | |
| *** mpaolino has joined #openstack-qa | 15:03 | |
| mriedem | mtreinish: back atcha https://review.openstack.org/#/c/159868/ | 15:05 |
| mtreinish | that's a lot of ANDs | 15:05 |
| *** jhenner has quit IRC | 15:06 | |
| *** mpaolino has quit IRC | 15:06 | |
| *** mpaolino has joined #openstack-qa | 15:06 | |
| mtreinish | mriedem: it looks like just a juno issue, the master fails all look like grenade | 15:07 |
| *** thgomes has joined #openstack-qa | 15:08 | |
| mtreinish | nm, just didn't look far enough down | 15:08 |
| *** SridharG has joined #openstack-qa | 15:09 | |
| openstackgerrit | Markus Zoeller proposed openstack/tempest: Replaces hardcoded volume size by configured value https://review.openstack.org/159878 | 15:09 |
| *** yamamoto has quit IRC | 15:09 | |
| mtreinish | adam_g_out: is there a reason we don't run the ironic job with tenant isolation? | 15:11 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for neutron ipv6 bug 1426397 https://review.openstack.org/159868 | 15:12 |
| openstack | bug 1426397 in neutron "tempest.scenario.test_network_v6.TestGettingAddress.test_slaac_from_os intermittently fails with MismatchError" [Undecided,New] https://launchpad.net/bugs/1426397 - Assigned to Henry Gessau (gessau) | 15:12 |
| *** zz_jgrimm is now known as jgrimm | 15:12 | |
| mtreinish | andreaf: hmm, this is weird: http://logs.openstack.org/11/158511/14/check/check-tempest-dsvm-postgres-full/346ea1b/console.html#_2015-02-27_01_41_30_581 there should be plenty of admin creds allocated | 15:13 |
| mtreinish | just for sanity I doubled the number of admin in the accounts file | 15:13 |
| *** openstackrecheck has quit IRC | 15:14 | |
| *** openstackrecheck has joined #openstack-qa | 15:14 | |
| mtreinish | andreaf: I'm wondering if for sanity in debugging maybe we should log the test class name in the pseudo lock files so if we exhaust the list we print which tests are using all the creds | 15:14 |
| andreaf | mtreinish: sounds like a good idea | 15:15 |
| HenryG | mriedem: mestery: For bug #1426397 it looks like we just need to wait a little for the address to get auto-assigned before checking. | 15:15 |
| openstack | bug 1426397 in neutron "tempest.scenario.test_network_v6.TestGettingAddress.test_slaac_from_os intermittently fails with MismatchError" [Undecided,New] https://launchpad.net/bugs/1426397 - Assigned to Henry Gessau (gessau) | 15:15 |
| mtreinish | andreaf: fwiw, the regular full job passed on that run which is cool | 15:16 |
| mtreinish | HenryG: did the behavior change to make it async, or was it always async and just got bit slower? | 15:16 |
| andreaf | mtreinish: ah that's the postgres one - weird... | 15:17 |
| mtreinish | HenryG: sounds like the later, which would be a clear tempest bug then right? | 15:17 |
| HenryG | mtreinish: I think it was always async | 15:17 |
| mtreinish | HenryG: yeah that makes sense | 15:18 |
| HenryG | mtreinish: I am not sure how you sync with ipv6 auto-addressing? | 15:18 |
| mtreinish | oh, I didn't look at the test name just your comment :) | 15:18 |
| HenryG | mtreinish: The test prepares two servers. There is a delay in prepare_server due to "wait for status active". | 15:20 |
| HenryG | mtreinish: The address check on the first server succeeds because of the delay on the second server. | 15:21 |
| HenryG | mtreinish: Then the address check on the second server is too soon sometimes. | 15:21 |
| openstackgerrit | Waldemar Znoinski proposed openstack-dev/devstack: Set datapath to $OVS_DATAPATH_TYPE for br-ex, br-<phy> https://review.openstack.org/159885 | 15:21 |
| mtreinish | HenryG: sure so we probably should add a wait loop around the calls to ssh into the server and get the ip list | 15:22 |
| HenryG | mtreinish: yup | 15:22 |
| *** yamamoto has joined #openstack-qa | 15:23 | |
| *** ChuckC has quit IRC | 15:23 | |
| HenryG | mtreinish: shall I code that up? | 15:23 |
| mtreinish | HenryG: sure, go for it | 15:23 |
| mriedem | HenryG: hmm, should something be tied into neutron for the event callback to nova that VIFs are all setup and ready to go? | 15:24 |
| mriedem | so that the server wouldn't be active until that's done | 15:25 |
| mtreinish | mriedem: oh, that's a good point | 15:26 |
| mriedem | point is, we can fix these things in tempest to help us but it doesn't help production useres | 15:26 |
| *** thgomes has left #openstack-qa | 15:26 | |
| HenryG | mriedem: Possibly, but for ipv6 auto-addresses that is going to get rather complicated I think | 15:26 |
| HenryG | It's not neutron that assigns the addresses, it's the protocol itself | 15:27 |
| mriedem | how hard could it possible be? :) | 15:27 |
| mriedem | *possibly | 15:27 |
| mriedem | does neutron know when the addresses are assigned? | 15:27 |
| HenryG | mriedem: no | 15:27 |
| mriedem | there is no way to check? | 15:27 |
| mriedem | i mean, tempest is going to be waiting and checking it sounds like | 15:28 |
| mriedem | we can't put a loop check in tempest until the addr is assigned and hold off on the notification to nova until that's done (or we timeout) | 15:28 |
| *** yamamoto has quit IRC | 15:29 | |
| *** achanda has joined #openstack-qa | 15:31 | |
| openstackgerrit | Salvatore Orlando proposed openstack-dev/devstack: WIP: vmware-nsx: Vendor code split https://review.openstack.org/144312 | 15:31 |
| *** e0ne_ is now known as e0ne | 15:31 | |
| *** dane_leblanc has joined #openstack-qa | 15:35 | |
| *** dboik has joined #openstack-qa | 15:35 | |
| *** mpaolino has quit IRC | 15:36 | |
| *** mpaolino has joined #openstack-qa | 15:36 | |
| *** achanda has quit IRC | 15:36 | |
| mtreinish | sc68cal: ^^^ do you think this is something we can add with event callback? I don't know nearly enough about ipv6 to judge the mechanics involved | 15:36 |
| mtreinish | but I feel like it definitely feels like we shouldn't say something is ready/available until all the ips are assigned and useable | 15:37 |
| openstackgerrit | Andrea Frittoli proposed openstack/tempest: Support v3 in credential providers and subclasses https://review.openstack.org/133029 | 15:37 |
| *** abhirc has joined #openstack-qa | 15:39 | |
| HenryG | mriedem: mtreinish: Currently only the guest really knows when an auto-address has been assigned to it. | 15:39 |
| *** amotoki has joined #openstack-qa | 15:40 | |
| *** abhirc has quit IRC | 15:40 | |
| *** salv-orlando has quit IRC | 15:40 | |
| HenryG | mriedem: mtreinish: Neutron only sets up the parameters so the underlying protocol can do its thing. | 15:41 |
| *** malini has left #openstack-qa | 15:42 | |
| mtreinish | HenryG: so it's relying on an outside service to assign the address? Then how does it work in the gate? | 15:42 |
| HenryG | mriedem: mtreinish: auto-addresses are not like fixed IPs or dhcp-assigned IPs. | 15:42 |
| mriedem | same question as mtreinish - can't we essentially move the same test for connectivity that tempest is doing down into neutron? | 15:43 |
| mtreinish | mriedem: well I'm not sure neutron sshing into a guest is right either :) | 15:43 |
| openstackgerrit | Emily Hugenbruch proposed openstack/tempest: Split resource_setup for thirdparty tests https://review.openstack.org/159894 | 15:44 |
| HenryG | mriedem: mtreinish: neutron does not communicate with guests | 15:44 |
| mriedem | hmm | 15:45 |
| mriedem | is there something to do on the nova side then? | 15:45 |
| mtreinish | I'm reading https://tools.ietf.org/html/rfc4862 to learn | 15:45 |
| HenryG | mtreinish: oooooh :) | 15:46 |
| *** rushiagr_away is now known as rushiagr | 15:48 | |
| mestery | mtreinish: IETF drafts in #openstack-qa, awesome. :) | 15:49 |
| *** abhirc has joined #openstack-qa | 15:49 | |
| *** afazekas has quit IRC | 15:50 | |
| *** rbak has joined #openstack-qa | 15:51 | |
| *** tkammer has quit IRC | 15:51 | |
| *** bknudson has joined #openstack-qa | 15:52 | |
| mtreinish | HenryG: is the neutron router generating a RA? | 15:52 |
| *** bknudson has quit IRC | 15:53 | |
| dane_leblanc | The neutron router spins up an RADVD process in a tenant's neutron router namespace, and that generates RAs | 15:53 |
| mtreinish | dane_leblanc: ok, thanks | 15:54 |
| mtreinish | HenryG: so I see what your saying that there won't be a sure-fire way to ensure the address on the guest is set, because the burden is on the guest to set that correctly | 15:57 |
| mtreinish | but there is still possibly a syncronization problem with the callback. Maybe we could lock sending the callback for all done between RAs being sent or something to try and limit this race | 15:59 |
| mtreinish | (with my naivety about how neutron is sending anything to nova) | 15:59 |
| HenryG | mtreinish: even the sending of RAs is done by an outside service (radvd), so neutron does not know when that happens. | 16:00 |
| HenryG | I think we have a situation where we are depending on external services and tempest should just say that it expects the auto-address to be assigned within N seconds else somethign went wrong? | 16:01 |
| mtreinish | HenryG: but neutron is spinning that up right? Everything is dependent on an external service for the most part | 16:01 |
| sc68cal | mtreinish: reading scrollback | 16:02 |
| *** mpaolino has quit IRC | 16:04 | |
| *** ajo has quit IRC | 16:04 | |
| *** mpaolino has joined #openstack-qa | 16:04 | |
| openstackgerrit | Merged openstack/tempest: Add UUIDs to all tempest tests and gate check https://review.openstack.org/159633 | 16:05 |
| mtreinish | hogepodge: ^^^ | 16:05 |
| *** bknudson has joined #openstack-qa | 16:06 | |
| hogepodge | mtreinish: \o/ | 16:07 |
| hogepodge | I was nursing the first job through the gate last night. :-P | 16:07 |
| *** ajo has joined #openstack-qa | 16:08 | |
| mtreinish | hogepodge: yeah looks like there are a couple higher than avg. races right now, which makes trying to land tempest code interesting with ~20 jobs | 16:08 |
| HenryG | mtreinish: I think neutron could defer the callback until it knows it has done all its setting up. I suspect that it probably does so already though. We could go over it to make sure. | 16:09 |
| HenryG | mtreinish: Tempest still has to allow for a delay though, and I think to alleviate the gate we should get that in now-ish. | 16:10 |
| *** Noice has joined #openstack-qa | 16:10 | |
| HenryG | mtreinish: Doesn't tempest have a client on the guest? | 16:11 |
| mtreinish | HenryG: that's what the test does right now, it ssh's into the guest using the ipv4 address and then runs an ip addr (or ifconfig, or something else cirros doesn't have much) to check the addrs have been assigned | 16:12 |
| mriedem | HenryG: note that something changed in the last few days to trigger this race fail | 16:13 |
| mriedem | either in tempest or neutron | 16:13 |
| mtreinish | HenryG: we're probably only seeing this because it use ipv4 for the ssh, because if it was using v6 the ssh loop would retry until the guest is configured | 16:13 |
| *** pkoniszewski has quit IRC | 16:14 | |
| HenryG | mriedem: yeah, and how do we figure out what? :( | 16:15 |
| mriedem | HenryG: well, i was looking through commit history to 2/24 for both projects | 16:15 |
| mriedem | so i pointed out a couple of changes in the bug report | 16:15 |
| dboik | When the test ssh's in, can't the ip list be polled until the ipv6 address is present - up until a certain timeout? | 16:15 |
| * HenryG refreshes the bug page | 16:16 | |
| mriedem | HenryG: i'm not familiar enough with the neutron commits in the last 3 days to tell what might be causing issues | 16:16 |
| mriedem | so i'm hoping the neutron team can do that | 16:16 |
| mriedem | but logstash definitely shows this as a recent fail | 16:16 |
| *** ChuckC has joined #openstack-qa | 16:16 | |
| * HenryG looks through recent neutron commits ... | 16:17 | |
| mtreinish | dboik: yes that's the proposed solution right now, we're discussing if there is a way we can be smarter in the neutron->nova communication so we don't say the guest is ready for use until the auto address is done | 16:17 |
| *** FatDarrel has joined #openstack-qa | 16:17 | |
| *** ChuckC has quit IRC | 16:17 | |
| *** ChuckC has joined #openstack-qa | 16:17 | |
| *** FatDarrel is now known as phd2 | 16:18 | |
| phd2 | hey guys | 16:18 |
| dboik | mtreinish: The guest might send out a router solicitation and RADVD would respond with a router advertisement. In that case you could be pretty sure the auto-addressing is complete. | 16:19 |
| *** david-lyle_afk is now known as david-lyle | 16:19 | |
| *** ChuckC has quit IRC | 16:20 | |
| dboik | But you would have to listen on the router port for that, and I don't think you could count on receiving the solicitation if RADVD sends out the periodic RA first | 16:20 |
| *** ChuckC has joined #openstack-qa | 16:21 | |
| asselin | anyone getting this error stacking on master? "Routes is in an unsupported or invalid wheel" http://15.126.198.151/41/157441/5/check/3par-fc-driver-master-client-pip-eos10-dsvm/b2c0627/logs/devstacklog.txt.gz | 16:22 |
| mtreinish | dboik: well that's what I was saying it might be good if neutron didn't send a callback to nova until there was an RA sent after the guest/port is setup, etc.(assuming it doesn't already) It's not ever going to be 100% but I think that would be better than just telling nova all clear | 16:23 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/158340 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1283522 https://bugs.launchpad.net/bugs/1357055 https://bugs.launchpad.net/bugs/1311066 | 16:23 |
| openstack | Launchpad bug 1283522 in neutron "DB lock timeout errors with parallel operations" [Critical,Fix released] - Assigned to Kevin Benton (kevinbenton) | 16:23 |
| openstack | Launchpad bug 1357055 in tempest "Race to delete shared subnet in Tempest neutron full jobs" [Undecided,Confirmed] - Assigned to Salvatore Orlando (salvatore-orlando) | 16:23 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 16:23 |
| mtreinish | asselin: no, I can't say that I have | 16:23 |
| asselin | mtreinish, started around 7:15 AM PST this morning. | 16:24 |
| HenryG | mriedem: Do you know if any changes have been made to the cirros image recently? | 16:25 |
| mtreinish | asselin: well it pulls that wheel from your mirror, so the one on the mirror might be bad | 16:25 |
| HenryG | mriedem: Or its configuration? | 16:26 |
| mriedem | HenryG: i don't.. clarkb ^ | 16:26 |
| mtreinish | s/your/gozer | 16:26 |
| mtreinish | mriedem: there were changes up to bump the cirros version devstack pulls, but I don't think they've landed yet | 16:26 |
| mtreinish | they hadn't last night at least | 16:26 |
| *** tsekiyama has joined #openstack-qa | 16:26 | |
| mtreinish | mriedem: yeah looks like we didn't do it https://review.openstack.org/#/c/159429/ | 16:27 |
| *** mpaolino has quit IRC | 16:28 | |
| *** mpaolino has joined #openstack-qa | 16:28 | |
| *** zz_dimtruck is now known as dimtruck | 16:29 | |
| dtroyer | there is an issue with CirrOS 0.3.3 that prevents us from using it yet: https://bugs.launchpad.net/cirros/+bug/1408922 so that update is in hold until that is fixed one way or another | 16:29 |
| openstack | Launchpad bug 1408922 in CirrOS "busybox nc: persistent server (-ll) option lost" [Undecided,New] | 16:29 |
| *** yamamoto has joined #openstack-qa | 16:30 | |
| openstackgerrit | Al Miller proposed openstack-dev/devstack: Remove LBaaS support from devstack https://review.openstack.org/153079 | 16:31 |
| *** mpaolino has quit IRC | 16:32 | |
| *** mpaolino has joined #openstack-qa | 16:32 | |
| *** Matt2 has joined #openstack-qa | 16:32 | |
| *** markus_z has quit IRC | 16:35 | |
| *** yamamoto has quit IRC | 16:35 | |
| *** david-lyle is now known as david-lyle_Afk | 16:35 | |
| *** david-lyle_Afk is now known as david-lyle_afk | 16:35 | |
| openstackgerrit | Al Miller proposed openstack-dev/devstack: Remove LBaaS support from devstack https://review.openstack.org/153079 | 16:36 |
| dane_leblanc | mriedem: HenryG: Is it critical to find the commit that finally pushed us over the edge with this, given we were probably on the hairy edge with this race condition? | 16:37 |
| *** bnemec is now known as beekneemech | 16:37 | |
| openstackgerrit | Filip Hubík proposed openstack/tempest: Verify the capabilities of the domain administrator https://review.openstack.org/159915 | 16:38 |
| mriedem | dane_leblanc: probably not critical, usually good to know though if it's obvious | 16:38 |
| mriedem | i love a good hairy edge | 16:38 |
| dane_leblanc | mriedem: :) | 16:39 |
| sc68cal | mtreinish: yeah there isn't really a way for neutron to know when the instance configures the ipv6 stack | 16:39 |
| HenryG | mriedem: dane_leblanc brings up a good point. The issue was known before 3 days ago, it just happened much less. | 16:39 |
| *** rwsu-afk is now known as rwsu | 16:39 | |
| mriedem | that's fine, | 16:40 |
| mriedem | and we could fix in tempest with a wait | 16:40 |
| mriedem | i just kind of hate fixing things in tempest like that b/c then no one thinks of ways to make the actual code more robust | 16:40 |
| HenryG | mriedem: I'll open a bug for neutron to make a valiant attempt to improve the robustness. You can refer to it in a comment for the tempest wait loop? | 16:41 |
| *** mpaolino has quit IRC | 16:41 | |
| mriedem | HenryG: sure | 16:41 |
| mtreinish | sc68cal: sure, I'm just wondering if we can at least not send the all clear to nova when we know it's not possible that the ip has been configure on the guest (no RA was sent yet) | 16:41 |
| *** mpaolino has joined #openstack-qa | 16:42 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest: Log the names of the other isolated_creds on starvation https://review.openstack.org/159917 | 16:43 |
| dane_leblanc | mriedem: maybe dumb question but can we just use 'ssh -6' to check the server for V6-enabled servers? | 16:43 |
| mtreinish | andreaf: ^^^ | 16:43 |
| mtreinish | dane_leblanc: that would be the same as adding a wait loop | 16:43 |
| mtreinish | at least for this case | 16:43 |
| HenryG | Does the cirros ssh server support v6? | 16:43 |
| mtreinish | HenryG: I don't know | 16:44 |
| *** erlon_away has joined #openstack-qa | 16:44 | |
| asselin | mtreinish, thanks, confirmed it's an issue with a bad wheel on our mirror. | 16:44 |
| mtreinish | HenryG: I know it uses dropbear for the ssh server | 16:45 |
| asselin | mtreinish, FYI, it's related to this bug: https://bugs.launchpad.net/openstack-ci/+bug/1336719 | 16:46 |
| openstack | Launchpad bug 1336719 in OpenStack Core Infrastructure "Wheel 0.23.0 doesn't work with Routes package" [Undecided,Fix released] | 16:46 |
| andreaf | mtreinish: nice, you use the lock file to track who opened it :) | 16:46 |
| andreaf | mtreinish: I was planning on dropping name from Accounts as it was not used, but you just found a use for it | 16:47 |
| mtreinish | andreaf: hehe | 16:47 |
| *** anshul has quit IRC | 16:49 | |
| *** sabeen1 has joined #openstack-qa | 17:03 | |
| *** mpaolino has quit IRC | 17:06 | |
| asselin | mtreinish, can you look at this? re the route wheel issue: https://review.openstack.org/#/c/159925/ | 17:06 |
| *** mpaolino has joined #openstack-qa | 17:07 | |
| *** jlanoux has quit IRC | 17:07 | |
| asselin | sdague, dhellmann ^^ | 17:07 |
| *** phd2 has quit IRC | 17:08 | |
| *** Nic has joined #openstack-qa | 17:12 | |
| *** amotoki has quit IRC | 17:14 | |
| *** nfedotov has quit IRC | 17:19 | |
| HenryG | mtreinish: Which cirros image does the gate use? | 17:22 |
| mtreinish | HenryG: from the devstack logs: cirros-0.3.2-x86_64 | 17:24 |
| HenryG | mtreinish: Thanks. And FYI: https://bugs.launchpad.net/cirros/+bug/1366326 | 17:24 |
| openstack | Launchpad bug 1366326 in CirrOS "ipv6 support" [Medium,Confirmed] | 17:24 |
| *** jogo is now known as flashgordon | 17:25 | |
| mtreinish | HenryG: oh, look at that I have a comment on that bug :) | 17:25 |
| *** rushiagr is now known as rushiagr_away | 17:28 | |
| HenryG | mtreinish: mriedem: When a guest gets an IPv4 address from DHCP, we have the same non-deterministic delay between when neutron is done and the address is assigned to the guest. | 17:28 |
| *** SridharGaddam has joined #openstack-qa | 17:29 | |
| HenryG | mtreinish: mriedem: Today that is "resolved" by tempest using ssh to connect to the ipv4 address and relying on ssh's retries. | 17:30 |
| mtreinish | HenryG: sure, I think having the wait loop for the ipv6 addr in tempest is fine | 17:30 |
| HenryG | mtreinish: mriedem: So getting ssh v6 support in cirros is one way of gaining v4 parity. | 17:30 |
| mtreinish | but long term I think it's useful to think about this, because as a blind user of a cloud it's not good to say something is ready for use and not be useable | 17:30 |
| HenryG | mtreinish: Agreed, and I am still filing a bug for neutron to work towards that goal. | 17:31 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 17:34 | |
| *** SridharG has left #openstack-qa | 17:35 | |
| *** SridharG has joined #openstack-qa | 17:35 | |
| *** mlavalle has joined #openstack-qa | 17:35 | |
| *** e0ne has quit IRC | 17:39 | |
| *** mpaolino has quit IRC | 17:43 | |
| *** salv-orlando has joined #openstack-qa | 17:48 | |
| *** pkoniszewski has joined #openstack-qa | 17:52 | |
| *** patrickeast has joined #openstack-qa | 17:53 | |
| openstackgerrit | Paul Michali proposed openstack-dev/devstack: VPNaaS Support for StrongSwan driver. https://review.openstack.org/158741 | 17:53 |
| *** annashen has joined #openstack-qa | 17:59 | |
| *** ibiris is now known as ibiris_away | 18:02 | |
| *** jaypipes has joined #openstack-qa | 18:05 | |
| *** ChanServ sets mode: +o jaypipes | 18:05 | |
| openstackgerrit | Zengfa Gao proposed openstack/tempest: Add a test for network connectivity between two tenant networks https://review.openstack.org/152694 | 18:08 |
| *** marun has joined #openstack-qa | 18:09 | |
| *** achanda has joined #openstack-qa | 18:16 | |
| *** krtaylor has quit IRC | 18:16 | |
| *** achanda has quit IRC | 18:17 | |
| *** achanda has joined #openstack-qa | 18:17 | |
| *** cody-somerville has joined #openstack-qa | 18:18 | |
| *** dimtruck is now known as zz_dimtruck | 18:18 | |
| openstackgerrit | Nicolas Simonds proposed openstack/tempest: Allow tests to specify the console that RemoteClient writes to https://review.openstack.org/149048 | 18:22 |
| openstackgerrit | Nicolas Simonds proposed openstack-dev/devstack: Add the ability to install/enable Heat plugins https://review.openstack.org/149055 | 18:22 |
| *** e0ne has joined #openstack-qa | 18:24 | |
| *** e0ne is now known as e0ne_ | 18:24 | |
| *** jaypipes has quit IRC | 18:27 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack-dev/devstack: Add support for using IPA with iSCSI https://review.openstack.org/159178 | 18:27 |
| *** zz_dimtruck is now known as dimtruck | 18:28 | |
| *** krtaylor has joined #openstack-qa | 18:28 | |
| *** e0ne_ is now known as e0ne | 18:29 | |
| *** e0ne has quit IRC | 18:30 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack-dev/devstack: Add support for using IPA with iSCSI https://review.openstack.org/159178 | 18:31 |
| *** e0ne has joined #openstack-qa | 18:35 | |
| *** david-lyle_afk is now known as david-lyle | 18:35 | |
| *** jordanP has quit IRC | 18:36 | |
| ihrachyshka | sdague, https://review.openstack.org/159943 | 18:37 |
| *** erlon_away is now known as erlon | 18:37 | |
| *** e0ne is now known as e0ne_ | 18:40 | |
| *** e0ne_ is now known as e0ne | 18:41 | |
| *** jhutton has joined #openstack-qa | 18:43 | |
| *** Nic has quit IRC | 18:44 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/122240 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1283522 https://bugs.launchpad.net/bugs/1357055 https://bugs.launchpad.net/bugs/1311066 | 18:46 |
| openstack | Launchpad bug 1283522 in neutron "DB lock timeout errors with parallel operations" [Critical,Fix released] - Assigned to Kevin Benton (kevinbenton) | 18:46 |
| openstack | Launchpad bug 1357055 in tempest "Race to delete shared subnet in Tempest neutron full jobs" [Undecided,Confirmed] - Assigned to Salvatore Orlando (salvatore-orlando) | 18:46 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 18:46 |
| jhutton | Hi, does anyone know if master tempest still supports stable/icehouse? | 18:47 |
| *** jhenner has joined #openstack-qa | 18:48 | |
| mtreinish | jhutton: yes it does | 18:48 |
| jhutton | mtreinish: but if you look at master tempest's requirements in needs tempest-lib, which stable/icehouse devstack does not install | 18:49 |
| jhutton | *it needs | 18:50 |
| mtreinish | jhutton: devstack doesn't install any of tempest's requirements by default. To install tempest on an all-in-one devstack deploy you should use a venv (which both tox and run_tempest will create for you) | 18:51 |
| mtreinish | tempest's requirements conflict in several places with icehouse | 18:51 |
| mtreinish | jhutton: if you look at how the gate runs tempest against icehouse it does all of the operations in a tox venv | 18:52 |
| *** yamahata has joined #openstack-qa | 18:53 | |
| jhutton | mtreinish: that makes sense. i noticed in master devstack, this venv is created automatically. in stable/icehouse devstack, this needs to be done manually then. | 18:54 |
| *** cdent has quit IRC | 18:55 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest: Log the names of the other isolated_creds on starvation https://review.openstack.org/159917 | 18:55 |
| openstackgerrit | Zengfa Gao proposed openstack/tempest: Add API tests for Neutron subnetpool https://review.openstack.org/159644 | 18:56 |
| *** tosky has quit IRC | 18:56 | |
| mtreinish | jhutton: devstack only creates that venv if it uses something in tempest. On master it runs a console script which is packaged with tempest, verify-tempest-config, which is why it creates the venv. (also if you configure devstack to install tempest-lib from git it'll make one for that too) | 18:57 |
| mtreinish | jhutton: that script isn't run on the stable branches for devstack so the venv doesn't get created | 18:58 |
| mtreinish | fwiw, it actually creates a separate venv from the one for using verify-tempest-config then the one which would normally get used for running tests | 18:59 |
| jhutton | mtreinish: so basically i can run verify-tempest-config after a stable/icehouse stack.sh and tempest should be ready to go? | 19:03 |
| jhutton | with the venv created | 19:03 |
| jhutton | and tempest-lib installed | 19:03 |
| jhutton | nevermind, i read that wrong | 19:04 |
| jhutton | mtreinish: in stable/icehouse, even if you configure LIBS_FROM_GIT=tempest-lib, it doesnt install it. in the code, there is a function install_tempest_lib but it's not used anywhere. | 19:07 |
| *** melwitt has joined #openstack-qa | 19:08 | |
| mtreinish | jhutton: there is no install_tempest_lib function on stable icehouse devstack | 19:08 |
| mtreinish | jhutton: what exactly are you trying to do where you hitting an issue? | 19:09 |
| *** mriedem has quit IRC | 19:09 | |
| mtreinish | actuall I just checked, I guess we backported the install_tempest_lib function | 19:10 |
| *** BharatK has quit IRC | 19:10 | |
| mtreinish | jhutton: but there doesn't seem to be anything that call it on the icehouse branch | 19:11 |
| jhutton | mtreinish: i'm trying to use the latest stable/icehouse devstack with master tempest (i was using old versions of both before but looking to sync everything). i normally use testr and found that it doesnt work anymore. | 19:11 |
| jhutton | it's failing to import tempest-lib i guess | 19:12 |
| mtreinish | jhutton: ok, if you want to use testr manually just run tox -evenv -- $(testr command) | 19:12 |
| *** FatDarrel has joined #openstack-qa | 19:12 | |
| *** mriedem has joined #openstack-qa | 19:12 | |
| mtreinish | from the master tempest repo you have cloned | 19:12 |
| jhutton | i guess i could install tempest and tempest-lib into venv manually but just wanted to know if it was supposed to be automatically configured | 19:13 |
| mtreinish | jhutton: that'll be the simplest way to to handle it when running tempest on the same node on an all in one deployment | 19:13 |
| jhutton | mtreinish: thanks, didnt know about that | 19:13 |
| *** aix has quit IRC | 19:13 | |
| *** FatDarrel is now known as phd2 | 19:22 | |
| *** openstackgerrit has quit IRC | 19:24 | |
| *** openstackgerrit has joined #openstack-qa | 19:24 | |
| *** ajo has quit IRC | 19:25 | |
| *** ihrachyshka has quit IRC | 19:26 | |
| *** ajo has joined #openstack-qa | 19:27 | |
| *** jhenner has quit IRC | 19:28 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: WIP - Do not merge - Trying a different locale https://review.openstack.org/159960 | 19:30 |
| *** e0ne has quit IRC | 19:32 | |
| *** yamamoto has joined #openstack-qa | 19:33 | |
| *** cnesa1 has left #openstack-qa | 19:36 | |
| *** e0ne has joined #openstack-qa | 19:36 | |
| *** yamamoto has quit IRC | 19:37 | |
| *** jhenner has joined #openstack-qa | 19:38 | |
| mriedem | mtreinish: jgriffith: was looking at that nova rescue change and noted that nova's lvm is doing a volume_clear=zero by default, so we're waiting for that in every run - compare to cinder in the gate which does volume_clear=none | 19:42 |
| mriedem | not sure if that would help at all or not | 19:42 |
| mriedem | probably best to test and fix problems with the defaults though | 19:43 |
| *** Nic has joined #openstack-qa | 19:44 | |
| jgriffith | mriedem: yeah... about that :) | 19:44 |
| jgriffith | mriedem: base devstack install that I used doesn't even create the LV... | 19:45 |
| jgriffith | mriedem: appears to create a fresh qcow | 19:45 |
| jgriffith | but... | 19:45 |
| jgriffith | mriedem: in the casee of instances, IMHO secure_delete is probably good to leave anyway | 19:45 |
| jgriffith | mriedem: granted not needed in gate... but secure_delete on volumes was never a huge problem other than time | 19:46 |
| jgriffith | mriedem: snapshots are what can completely hose us | 19:46 |
| jgriffith | mriedem: I'm sure happy to look at that on the Nova side though if it's significant WRT gate times | 19:47 |
| mriedem | i don't know that it is, was just something i was thinking about | 19:47 |
| *** pkoniszewski has quit IRC | 19:47 | |
| jgriffith | mriedem: yeah, great point | 19:48 |
| *** jhenner has quit IRC | 19:48 | |
| openstackgerrit | vigneshvar proposed openstack-dev/devstack: Create _member_ role in keystone bootstrap https://review.openstack.org/159690 | 19:50 |
| jgriffith | mriedem: you guys are frikin killin me :) | 19:50 |
| *** ajo has quit IRC | 19:51 | |
| *** achanda has quit IRC | 19:53 | |
| *** ajo has joined #openstack-qa | 19:54 | |
| jgriffith | mriedem: hmmm.. that's annoying, running the test independently that assert_called_once works fine | 19:56 |
| openstackgerrit | Zengfa Gao proposed openstack/tempest: Add a test for network connectivity between two tenant networks https://review.openstack.org/152694 | 19:57 |
| jgriffith | mriedem: someobody's not cleaning something up | 19:57 |
| mriedem | jgriffith: yeah, the mock sleep must be getting interfered with another test | 19:57 |
| *** marun has quit IRC | 19:57 | |
| mriedem | let me look for stubs | 19:57 |
| jgriffith | mriedem: I'll just give it another name if I can't find the culprit | 19:57 |
| jgriffith | Oh... think I found it | 19:57 |
| pc_m | dtroyer: sdague: I updated the devstack commit and tested on ubuntu/fedora. Can you look at the review again please? https://review.openstack.org/#/c/158741/ | 19:58 |
| mriedem | jgriffith: searching for 'self.stubs.Set(time,' shows a few too | 19:58 |
| jgriffith | mriedem: I think it's one of the helper methods, they also have a mock_sleep the same as mine | 19:59 |
| *** marun has joined #openstack-qa | 20:02 | |
| *** ChuckC has quit IRC | 20:02 | |
| jgriffith | mriedem: hmm... troubled that I can't reproduce that, even running all the tests in that file | 20:03 |
| *** ajo has quit IRC | 20:03 | |
| *** ChuckC has joined #openstack-qa | 20:03 | |
| pc_m | marun: pping | 20:04 |
| *** ajo has joined #openstack-qa | 20:06 | |
| *** jhenner has joined #openstack-qa | 20:08 | |
| dtroyer | pc_m: +2 | 20:09 |
| pc_m | Thank you! | 20:09 |
| openstackrecheck | openstack/swift change: https://review.openstack.org/153617 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/1326813 | 20:09 |
| openstack | Launchpad bug 1326813 in OpenStack-Gate "Connectivity issues between hpcloud and rax cloud causing pip install from our mirrors to fail" [Low,Confirmed] | 20:09 |
| pc_m | dtroyer: I don't know if sdague is on at this time, but if not, if there are other DevStack cores that could look at this, I'd appreciate it. Want to get a new functional job running. | 20:10 |
| *** gfidente has quit IRC | 20:12 | |
| *** e0ne is now known as e0ne_ | 20:13 | |
| dtroyer | pc_m: it might be weekend for everyone else by now… sdague already +2 though | 20:14 |
| dtroyer | pc_m: so lets do it… | 20:15 |
| pc_m | Ah, I see you +A. Thanks! | 20:15 |
| *** ajo has quit IRC | 20:15 | |
| *** Nic has quit IRC | 20:16 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: WIP - Do not merge - Trying a different locale https://review.openstack.org/159960 | 20:16 |
| *** k4n0 has quit IRC | 20:16 | |
| *** Nic has joined #openstack-qa | 20:17 | |
| mriedem | jgriffith: sorry, just found another nasty gate issue with nova so looking at that quick | 20:19 |
| *** ajo has joined #openstack-qa | 20:19 | |
| *** achanda has joined #openstack-qa | 20:23 | |
| jgriffith | mriedem: no worries, I fixed it | 20:23 |
| jgriffith | mriedem: just adding the config option now | 20:23 |
| jgriffith | mriedem: making sure I didn't spell anything wrong :) | 20:24 |
| mriedem | fwiw i'm not sure a config option is required for this | 20:25 |
| mriedem | i wish we had a decent config option to reuse | 20:26 |
| *** e0ne_ is now known as e0ne | 20:26 | |
| mtreinish | jgriffith: heh, spelling doens't matter :) | 20:28 |
| *** achanda has quit IRC | 20:30 | |
| jgriffith | mtreinish: tell that to JB :) | 20:30 |
| *** e0ne has quit IRC | 20:31 | |
| *** ChuckC has quit IRC | 20:31 | |
| *** ChuckC has joined #openstack-qa | 20:32 | |
| *** carl_baldwin has joined #openstack-qa | 20:35 | |
| *** amuller has joined #openstack-qa | 20:35 | |
| *** e0ne has joined #openstack-qa | 20:35 | |
| openstackgerrit | Merged openstack-dev/devstack: Fix Ironic for Syslinux >= 5.00 https://review.openstack.org/158340 | 20:36 |
| *** amuller has left #openstack-qa | 20:37 | |
| openstackgerrit | Matthew Treinish proposed openstack-dev/devstack: Do Not Merge: Test test-accounts with roles https://review.openstack.org/158511 | 20:42 |
| *** e0ne has quit IRC | 20:44 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron DBDeadlock bug 1426543 https://review.openstack.org/159993 | 20:44 |
| openstack | bug 1426543 in OpenStack Compute (nova) "Spike in DBDeadlock errors in update_floatingip_statuses since 2/27" [Undecided,New] https://launchpad.net/bugs/1426543 | 20:44 |
| openstackgerrit | Henry Gessau proposed openstack/tempest: Allow time for ipv6 auto addresses to get assigned to guests https://review.openstack.org/159994 | 20:45 |
| mriedem | mtreinish: ^ | 20:45 |
| mriedem | https://review.openstack.org/#/c/159993/ | 20:45 |
| mtreinish | mriedem: ^^^ we log raw db failures inside of retry loops that seems weird | 20:45 |
| *** e0ne has joined #openstack-qa | 20:49 | |
| *** phd2 has quit IRC | 20:50 | |
| mtreinish | HenryG: I put some initial comments on 159994 | 20:50 |
| flashgordon | mtreinish: ever get to the bottom of the trove image not being cached? | 20:51 |
| mtreinish | flashgordon: yes clarkb fixed it | 20:51 |
| mtreinish | flashgordon: it was a permissions issue, the devstack repo was owned by root so we couldn't change branches | 20:51 |
| flashgordon | mtreinish: excellent I can now recheck some of my failed patches | 20:52 |
| mtreinish | flashgordon: I'm not sure it's taken effect on the latest nodepool build or not, you'll have to ask clarkb | 20:52 |
| clarkb | not yet | 20:53 |
| mtreinish | ok, that's what I figured | 20:53 |
| *** e0ne is now known as e0ne_ | 20:53 | |
| flashgordon | clarkb: ahh | 20:54 |
| flashgordon | oh it merged 2 hours ago I see | 20:54 |
| HenryG | mtreinish: thanks, I was hoping you would say no new config var :) | 20:57 |
| HenryG | mtreinish: did you hear Leonard Nimoy died :( | 20:57 |
| *** SridharG has quit IRC | 20:58 | |
| mtreinish | HenryG: yeah there are already too many timeout options, I don't think anyone ever plays with them either | 20:59 |
| mtreinish | if we had a flag for every different kind of timeout we'd have ~1000 options instead of just ~300 :) | 20:59 |
| openstackgerrit | Joe Gordon proposed openstack-dev/devstack: Remove debs for diablo volumes https://review.openstack.org/157189 | 20:59 |
| *** SridharG has joined #openstack-qa | 21:00 | |
| mtreinish | now think about the poor user trying to run against openstack.... | 21:00 |
| mtreinish | HenryG: yeah I did, it's sad :( | 21:00 |
| HenryG | mtreinish: Is 1s between ssh attempts too short? | 21:01 |
| *** jhenner has quit IRC | 21:02 | |
| mtreinish | HenryG: I'd just use one of the other config knobs like ping timeout. if we completely fall on our face trying to do the auto address the only thing that happens is we wait a little too long | 21:02 |
| *** jhenner1 has joined #openstack-qa | 21:02 | |
| mtreinish | HenryG: hard coding magic timeout numbers in the code is also not really good | 21:03 |
| *** SridharG has left #openstack-qa | 21:03 | |
| HenryG | mtreinish: Yeah, I got that, but I mean the last arg to call_until_true | 21:03 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for neutron DBDeadlock bug 1426543 https://review.openstack.org/159993 | 21:03 |
| openstack | bug 1426543 in OpenStack Compute (nova) "Spike in DBDeadlock errors in update_floatingip_statuses since 2/27" [Undecided,New] https://launchpad.net/bugs/1426543 | 21:03 |
| *** achanda has joined #openstack-qa | 21:03 | |
| mtreinish | HenryG: oh, for the interval, 1 sec is fine | 21:04 |
| HenryG | mtreinish: thanks | 21:04 |
| mtreinish | HenryG: for the normally ssh timeout we use an exponential backoff, but that's probably fine | 21:04 |
| mtreinish | not to use | 21:04 |
| mtreinish | HenryG: there is a build_interval config option you could use too | 21:05 |
| mtreinish | HenryG: but I'm not really concerned too much with the value for that | 21:05 |
| *** achanda has quit IRC | 21:05 | |
| *** ajo has quit IRC | 21:06 | |
| *** marun has quit IRC | 21:06 | |
| openstackgerrit | Henry Gessau proposed openstack/tempest: Allow time for ipv6 auto addresses to get assigned to guests https://review.openstack.org/159994 | 21:09 |
| flashgordon | mtreinish: https://review.openstack.org/#/c/155138/ tox -equeries | 21:10 |
| flashgordon | is now passing | 21:10 |
| *** achanda has joined #openstack-qa | 21:10 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/158741 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1311066 | 21:11 |
| openstack | Launchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed] | 21:11 |
| *** abhirc has quit IRC | 21:13 | |
| *** jhenner1 has quit IRC | 21:15 | |
| mtreinish | flashgordon: one issue with the top patch, you broke the separation of the patches by fixing a print from the first one | 21:15 |
| *** jhenner has joined #openstack-qa | 21:16 | |
| openstackgerrit | Sridhar Gaddam proposed openstack-dev/devstack: Fix curl issue when SERVICE_HOST is defined to IPv6 address https://review.openstack.org/158594 | 21:17 |
| openstackgerrit | Zengfa Gao proposed openstack/tempest: Add a test for network connectivity between two tenant networks https://review.openstack.org/152694 | 21:18 |
| flashgordon | mtreinish: meh, I can fix that if you like | 21:18 |
| *** e0ne_ is now known as e0ne | 21:19 | |
| mtreinish | flashgordon: if you went to the trouble of doing separate patches mine as well keep them separate :) | 21:20 |
| mtreinish | it would give me that little bit of joy I'm missing from a late fri afternoon | 21:20 |
| *** jhenner has quit IRC | 21:20 | |
| flashgordon | mtreinish: hehe I can relate | 21:22 |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Make test_queries runnable as gating test https://review.openstack.org/150186 | 21:22 |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Add launchpad test to test_queries https://review.openstack.org/155138 | 21:22 |
| *** fungi has quit IRC | 21:23 | |
| *** fungi has joined #openstack-qa | 21:25 | |
| *** openstackrecheck has quit IRC | 21:27 | |
| *** openstackrecheck has joined #openstack-qa | 21:27 | |
| openstackgerrit | Henry Gessau proposed openstack/tempest: Allow time for ipv6 auto addresses to get assigned to guests https://review.openstack.org/159994 | 21:27 |
| *** dustins has quit IRC | 21:28 | |
| openstackgerrit | Henry Gessau proposed openstack/tempest: Allow time for ipv6 auto addresses to get assigned to guests https://review.openstack.org/159994 | 21:28 |
| HenryG | apologies for the churn :( | 21:29 |
| mtreinish | HenryG: no worries, you clearly haven't seen my ~20 revisions over the past couple days on one series :) | 21:29 |
| mtreinish | even after all those revs it's still not ready either... | 21:30 |
| HenryG | mtreinish: I tried to figure out how to do without functools.partial, but failed :( | 21:30 |
| *** e0ne has quit IRC | 21:31 | |
| *** e0ne has joined #openstack-qa | 21:32 | |
| mtreinish | HenryG: heh, that's ok. It's just my own bias because I've seen things like: http://git.openstack.org/cgit/openstack-infra/subunit2sql/tree/subunit2sql/write_subunit.py#n60 and http://git.openstack.org/cgit/openstack/tempest-lib/tree/tempest_lib/cmd/subunit_trace.py#n252 | 21:32 |
| anteaya | sdague: you were the original author of the patch that introduced the default behaviour to the -nv job extention, which I am changing in this patch: https://review.openstack.org/#/c/159916/3 | 21:33 |
| mtreinish | which I just think is just an abuse of using partial and a terrible recommended interface for using something | 21:33 |
| anteaya | if you have an opinion | 21:33 |
| *** marun has joined #openstack-qa | 21:34 | |
| *** yamamoto has joined #openstack-qa | 21:35 | |
| HenryG | mtreinish: o_O | 21:35 |
| *** yamamoto has quit IRC | 21:39 | |
| *** SridharGaddam has quit IRC | 21:40 | |
| *** SridharG has joined #openstack-qa | 21:41 | |
| *** jhutton has quit IRC | 21:42 | |
| *** achanda has quit IRC | 21:43 | |
| *** bkopilov has quit IRC | 21:43 | |
| *** achanda has joined #openstack-qa | 21:44 | |
| *** dboik_ has joined #openstack-qa | 21:46 | |
| marun | pc_m: hi | 21:47 |
| pc_m | marun: hi | 21:47 |
| pc_m | I posted a Q on the neutron channel. | 21:47 |
| pc_m | Don't know if you saw it. | 21:48 |
| *** dboik has quit IRC | 21:48 | |
| mtreinish | HenryG: sry, 1 more nit to fix, after that I think I'm +2 | 21:49 |
| pc_m | 15:08 my time (East Coast) | 21:49 |
| *** dane_leblanc has quit IRC | 21:49 | |
| pc_m | marun: I can repost there, if you want. | 21:49 |
| HenryG | mtreinish: No, I think? | 21:50 |
| pc_m | (had pinged you on this channel inadvertently). | 21:50 |
| mtreinish | HenryG: oh, nope you're right I misread the code | 21:50 |
| HenryG | mtreinish: I don't put the list in 'result' in the loop. | 21:50 |
| marun | pc_m: no, it's not ready yet. I have a wip I haven't posted to refactor run_tox.sh in th project-config repo | 21:51 |
| *** aysyd has quit IRC | 21:51 | |
| *** cbader has quit IRC | 21:51 | |
| pc_m | marun: OK. Let me know the ID when you post, and I can add it as a depends-on for mine. | 21:51 |
| *** ajo has joined #openstack-qa | 21:52 | |
| pc_m | marun: BTW: My DevStack changes for strongswan are upstreamed. So review can proceed with https://review.openstack.org/#/c/158389/ | 21:52 |
| pc_m | marun: If you get some time, can you kindly review. | 21:53 |
| *** dims_ is now known as dimsum__ | 21:53 | |
| pc_m | plan is to use gate hook to select strongswan for devstack. | 21:53 |
| *** sabeen1 has quit IRC | 21:57 | |
| *** dane_leblanc has joined #openstack-qa | 21:58 | |
| *** SridharG has quit IRC | 22:08 | |
| *** naggappan has joined #openstack-qa | 22:09 | |
| openstackgerrit | Peter Stachowski proposed openstack-dev/devstack: Change the Guest Agent log_dir to /var/log/trove https://review.openstack.org/158135 | 22:10 |
| naggappan | Hi i just wanted to run only tempest.api.neutron test in tempest. I have provided public network ID and router ID. Also enabled in "api_extensions = all" in the tempest.conf but still it says 43 test ran and all are skip | 22:11 |
| mtreinish | naggappan: it should say why they were skipped in the logs somewhere | 22:12 |
| *** rfolco has quit IRC | 22:13 | |
| *** cody-somerville_ has joined #openstack-qa | 22:19 | |
| *** cody-somerville_ has quit IRC | 22:19 | |
| *** cody-somerville_ has joined #openstack-qa | 22:19 | |
| *** cody-somerville has quit IRC | 22:19 | |
| naggappan | mtreinish: This is what i see in the output http://paste.openstack.org/show/183209/ | 22:23 |
| *** jamielennox is now known as jamielennox|away | 22:23 | |
| mtreinish | naggappan: run testr last --subunit | .venv/bin/subunit-trace it should print the skip messge | 22:25 |
| mtreinish | naggappan: fwiw, we probably should switch the run_tempest script to not use the colorizer output filter anymore, if you wanted to push a patch to fix that | 22:27 |
| *** e0ne has quit IRC | 22:30 | |
| *** jamielennox|away is now known as jamielennox | 22:30 | |
| *** pc_m has quit IRC | 22:31 | |
| *** jamielennox is now known as jamielennox|away | 22:39 | |
| *** jamielennox|away is now known as jamielennox | 22:40 | |
| *** ajo has quit IRC | 22:42 | |
| *** Ananci has quit IRC | 22:42 | |
| naggappan | mtreinish testr last --subunit | .venv/bin/subunit-trace --> this says that subunit-trace not found. I created only .venv virtual environment not sure about that is that file subunit-trace is for and it is not present. | 22:44 |
| *** abhirc has joined #openstack-qa | 22:51 | |
| mtreinish | naggappan: it should be installed with tempest-lib, if you isntalled tempest-lib in the system site-packages you can drop the .venv/bin because it should be in your default path | 22:51 |
| mtreinish | I just assumed since you were using run_tempest you were using the venv it creates by default | 22:52 |
| naggappan | mterinish ok thanks i will try that. I am running tempest without virutal env -N option | 22:52 |
| mtreinish | naggappan: yep see that now in the pastebin | 22:52 |
| naggappan | Actually i am trying to run the test against real time openstack. and not on the devastate. | 22:52 |
| naggappan | so i find difficulty in configuring | 22:53 |
| mtreinish | naggappan: also looking at the traceback again you might want to check the neutron option in the service_available group | 22:53 |
| naggappan | mtreinish: grate i did not see that. looks like that is the issue. It was in false state | 22:54 |
| mtreinish | naggappan: fwiw, I'm working on starting a tempest configuration guide here: https://review.openstack.org/#/c/157935/ | 22:56 |
| mtreinish | if you have additional sections to add to it feel free to push a patch on top of that | 22:56 |
| mtreinish | it's just got the auth part in it for now, but the plan is to expand on it after it lands | 22:57 |
| naggappan | mtreinish : That's good. Once if everything works fine . I will put the missing information if if find any | 22:57 |
| naggappan | i will try for neutron then | 22:57 |
| *** abhirc has quit IRC | 22:58 | |
| *** FatDarrel has joined #openstack-qa | 23:00 | |
| *** flwang1 has quit IRC | 23:00 | |
| *** mriedem has quit IRC | 23:01 | |
| *** jgrimm is now known as zz_jgrimm | 23:01 | |
| *** jamielennox is now known as jamielennox|away | 23:06 | |
| *** andreykurilin_ has joined #openstack-qa | 23:12 | |
| *** jhenner has joined #openstack-qa | 23:13 | |
| flashgordon | mtreinish: I forgot how easy it is to scrape data on people from gerrit http://paste.openstack.org/show/183230 | 23:14 |
| mtreinish | flashgordon: heh, don't do that it shows how lazy I am with reviews :) | 23:14 |
| openstackgerrit | Jamie Lennox proposed openstack-dev/devstack: Create _member_ role in keystone bootstrap https://review.openstack.org/159690 | 23:14 |
| flashgordon | mtreinish: there is no where to hide | 23:15 |
| mtreinish | flashgordon: #13 is weird I don't think I left a comment on that patch | 23:16 |
| *** achanda has quit IRC | 23:16 | |
| flashgordon | Patch Set 10: Commit message was updated | 23:16 |
| mtreinish | the date doesn't match | 23:17 |
| mtreinish | that was on the 19th | 23:17 |
| flashgordon | hmm I think 'uploaded patch set 11' counts as a comment too | 23:18 |
| flashgordon | strange | 23:18 |
| *** dimtruck is now known as zz_dimtruck | 23:19 | |
| *** achanda has joined #openstack-qa | 23:20 | |
| openstackgerrit | Tong Liu proposed openstack/tempest: Fix ICMP code/type in security group rule test https://review.openstack.org/158928 | 23:26 |
| flashgordon | mtreinish: is this better http://paste.openstack.org/show/183233 | 23:26 |
| *** rbak has quit IRC | 23:27 | |
| mtreinish | flashgordon: yeah I think so | 23:28 |
| mtreinish | flashgordon: how are you doing multiple comments on the same patch? | 23:28 |
| flashgordon | mtreinish: most recent | 23:28 |
| mtreinish | flashgordon: ok, that's what it looked like, just wanted to check | 23:28 |
| flashgordon | mtreinish: see https://github.com/jogo/lastcomment | 23:28 |
| flashgordon | mtreinish: just run ./lastcomment.py -n 'Matthew Treinish' -c 20 | 23:29 |
| mtreinish | finally figured out the preseeding issues, it's caused by: https://storyboard.openstack.org/#!/story/2000096 | 23:30 |
| mtreinish | now I just need to figure out how to fix that bug | 23:30 |
| mtreinish | mordred: ^^^ you understand mysql any suggestions? | 23:31 |
| mtreinish | I think I recall asking you that before. and if memory serves your suggestion was to store the time < seconds in a separate field | 23:32 |
| mordred | yeah. just as an int or something | 23:33 |
| mordred | or, honestly, you could just store the whole thing as a bigint | 23:33 |
| mordred | and not as a timestamp | 23:33 |
| mtreinish | mordred: hmm, ok I'll give that a try | 23:33 |
| mordred | the only thing you get from a timestamp or datatime type is ability to do in-sql data math on things | 23:33 |
| mordred | and human readable output in the myql commandline client | 23:34 |
| mtreinish | mordred: yeah I'm not doing any of data math in sql just on the python side | 23:34 |
| mordred | yeah - just make it a bigint then | 23:34 |
| mtreinish | although the human readable in the command line is useful because that's how I've been getting at the data for the most part since I don't have a better client interface yet | 23:35 |
| mordred | I mean, you'll have to calculate the now() when you insert | 23:35 |
| mordred | you coudl also totally just do the subsecond stuff in another column | 23:35 |
| mtreinish | mordred: ok, well I'll figure something out. Thanks | 23:36 |
| *** dims_ has joined #openstack-qa | 23:37 | |
| *** dimsum__ has quit IRC | 23:38 | |
| *** dims_ has quit IRC | 23:39 | |
| *** dimsum__ has joined #openstack-qa | 23:39 | |
| *** dane_leblanc has quit IRC | 23:45 | |
| naggappan | Hi mirish: is there any way to configure not to run in parallel | 23:45 |
| openstackgerrit | Aishwarya Thangappa proposed openstack-dev/devstack: Added devstack-with-lbaas-v2 installation documentation https://review.openstack.org/158512 | 23:45 |
| *** zz_dimtruck is now known as dimtruck | 23:46 | |
| mtreinish | naggappan: heh, did you me mean? Yes you tell your test runner to not run in parallel (IIRC for run_tempest there is a concurrency flag) | 23:46 |
| mtreinish | which will pass the appropriate option to testr | 23:46 |
| naggappan | mtreinish : because is see lots of issues user are created and again the test fails stating that not able to create or update user roll . Like this http://paste.openstack.org/show/183239/ | 23:46 |
| naggappan | run_test always runs in parallel? | 23:48 |
| naggappan | i mean run_tempest always runs testr in parallel. Because i see that in the script | 23:48 |
| mtreinish | naggappan: that's a bug/config issue. You're trying to assign a role to a user which it has by default. it's unrelated to parallel | 23:49 |
| mtreinish | I have a fix up for that as part of a refactor in a bp, so it doesn't try to add that role automatically anymore | 23:50 |
| mtreinish | but until that lands you should be able to get around it by setting the operator_role option in the object_storage group in the tempest conf to None | 23:51 |
| *** hockeynut has quit IRC | 23:51 | |
| *** dboik has joined #openstack-qa | 23:51 | |
| mtreinish | https://review.openstack.org/#/c/158941/18/tempest/common/isolated_creds.py | 23:51 |
| *** hockeynut has joined #openstack-qa | 23:52 | |
| mtreinish | if setting None doesn't work for you, I can respin that out as a separate patch and land it as a bug fix | 23:52 |
| *** dboik_ has quit IRC | 23:54 | |
| *** dboik has quit IRC | 23:55 | |
| naggappan | Mtreinish: I am not using etc/account.yamal . This is what my identity configuration "http://paste.openstack.org/show/183240/" . I have also created a user roll as _member_ and specified it in the config | 23:55 |
| mtreinish | naggappan: 2 questions what is allow_tenant_isolation in the auth section, and what is the value of operator_role in the object_storage group | 23:58 |
| mtreinish | naggappan: based on your earlier traceback you have tenant_isolation enabled which is try to add whatever the operator_role option is set to to a user | 23:59 |
| mtreinish | but that user was already assigned that role (either because it was told to in a different option, or it gets that by default from keystone) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!