Wednesday, 2020-08-19

*** brinzhang0 has joined #openstack-qa00:09
*** brinzhang_ has quit IRC00:12
*** yamamoto has joined #openstack-qa00:17
*** slaweq has joined #openstack-qa00:39
*** slaweq has quit IRC00:45
*** slaweq has joined #openstack-qa00:48
*** yamamoto has quit IRC00:49
*** brinzhang0 has quit IRC00:51
*** slaweq has quit IRC00:53
*** slaweq has joined #openstack-qa01:02
*** yamamoto has joined #openstack-qa01:05
*** slaweq has quit IRC01:07
*** slaweq has joined #openstack-qa01:15
*** slaweq has quit IRC01:20
*** pots has quit IRC02:03
*** pots has joined #openstack-qa02:03
*** mmedvede has quit IRC02:04
*** timburke has quit IRC02:05
*** ricolin has quit IRC02:09
*** timburke has joined #openstack-qa02:11
*** mmedvede has joined #openstack-qa02:12
*** slaweq has joined #openstack-qa02:12
*** ricolin has joined #openstack-qa02:19
*** slaweq has quit IRC02:19
*** rcernin has quit IRC02:21
*** dave-mccowan has quit IRC02:44
*** slaweq has joined #openstack-qa02:46
*** slaweq has quit IRC02:51
*** rfolco has quit IRC02:54
*** andrebeltrami has quit IRC02:59
*** rcernin has joined #openstack-qa02:59
*** jcmdln has quit IRC03:29
*** vishalmanchanda has joined #openstack-qa03:30
*** yamamoto has quit IRC03:45
*** slaweq has joined #openstack-qa03:51
*** slaweq has quit IRC04:01
*** yamamoto has joined #openstack-qa04:02
*** rcernin has quit IRC04:14
*** rcernin has joined #openstack-qa04:21
*** raukadah is now known as chkumar|rover04:25
*** rh-jelabarre has quit IRC04:29
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-qa04:33
*** rcernin has quit IRC04:37
*** rishabhhpe has joined #openstack-qa04:46
*** rcernin has joined #openstack-qa04:46
*** abdysn has joined #openstack-qa05:00
*** rishabhhpe has quit IRC05:05
*** psahoo_ has joined #openstack-qa05:19
*** brinzhang has joined #openstack-qa05:42
*** gcheresh_ has joined #openstack-qa05:56
*** ramishra has joined #openstack-qa05:56
*** dmellado has quit IRC06:11
*** dmellado has joined #openstack-qa06:41
*** brinzhang_ has joined #openstack-qa06:56
*** brinzhang has quit IRC07:00
*** dmellado has quit IRC07:07
*** slaweq has joined #openstack-qa07:14
*** chaconpiza has joined #openstack-qa07:33
*** nightmare_unreal has joined #openstack-qa07:47
*** dmellado has joined #openstack-qa07:53
*** jpena|off is now known as jpena07:58
*** gfidente has joined #openstack-qa08:05
openstackgerritMerged opendev/elastic-recheck master: Bumped flake8  https://review.opendev.org/72932808:10
*** lucasagomes has joined #openstack-qa08:16
*** dtantsur|afk is now known as dtantsur08:16
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: Resolve unsafe yaml.load use  https://review.opendev.org/73038908:24
*** slaweq has quit IRC08:25
*** tosky has joined #openstack-qa08:28
*** TomStappaerts has quit IRC08:34
*** TomStappaerts has joined #openstack-qa08:34
*** brtknr has quit IRC08:36
openstackgerritMerged opendev/elastic-recheck master: Replace pep8 jobs with linters  https://review.opendev.org/73149708:37
*** brtknr has joined #openstack-qa08:38
*** brtknr has quit IRC08:42
*** brtknr has joined #openstack-qa08:43
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: Resolve unsafe yaml.load use  https://review.opendev.org/73038908:52
*** gfidente has quit IRC08:59
*** gfidente has joined #openstack-qa08:59
openstackgerritMerged openstack/devstack master: New get-devstack-os-environment role  https://review.opendev.org/74623509:01
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: WIP: Create elastic-recheck container image  https://review.opendev.org/72962309:02
*** artom has quit IRC09:27
*** slaweq has joined #openstack-qa09:29
*** ramishra has quit IRC09:41
*** rcernin has quit IRC09:43
Open10K8SHi team. I am facing cinder tempest fail with ceph backend. From the c-volume logs, I noticed qemu-img info command is failing. But I am not sure the reason surely. https://zuul.opendev.org/t/vexxhost/build/40eb66f010a740cda50b7f43bc2c1edb/log/docker/k8s_cinder-volume_cinder-volume-rxw6p_openstack_c8b7d1f2-95e8-4817-9c24-6119c0f057ac_0.txt#959-96909:44
*** ramishra has joined #openstack-qa09:44
Open10K8Sqemu-utils already installed. maybe oslo_concurrency.prlimit problem?09:44
Open10K8Shttps://zuul.opendev.org/t/vexxhost/build/40eb66f010a740cda50b7f43bc2c1edb/log/job-output.txt#3661309:46
toskyOpen10K8S: maybe an issue with that environment? Does the failing sudo command work if you invoke it directly?09:47
Open10K8Shmm... now it is running on container, and I am not sure if there is a way to run the same command09:48
Open10K8Sto produce the same env09:48
Open10K8Stosky: as you can see, it is saying like the conversion state file was missing09:49
*** rcernin has joined #openstack-qa09:49
toskyyou can run a shell inside the container and try09:53
toskyuhm, where do you see that error?09:54
toskyI see the stderr message after running that long command: 'python -m oslo_concurrency.prlimit: failed to execute sudo: [Errno 2] No such file or directory\n'09:55
toskyafter running:09:55
toskyCommand: /usr/local/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /var/lib/cinder/conversion/tmp5nh762mecinder-volume-rxw6p@ceph09:55
Open10K8Sbut there is not state file in the container :(09:57
Open10K8Stosky: I can use the image which was used at that ci, but can't reproduce the same scenario locally09:57
toskywe do have some ceph jobs running on the CI, and they seem to work09:57
Open10K8Syes, ofc, I am also passing with c-vol and scheduler on-premises09:59
toskyyou may compare the results09:59
Open10K8Stosky: that is on the container, so I wonder if i missed some packages or  configuration for the cinder10:00
toskyI don't rememeber if there are tripleo jobs which use the ceph container10:00
toskyI mean, which use cinder/ceph10:00
Open10K8Shttps://zuul.opendev.org/t/vexxhost/build/40eb66f010a740cda50b7f43bc2c1edb/log/controller/logs/etc/cinder/cinder_conf.txt10:01
Open10K8Stosky: this is the cinder.conf for that ci10:01
toskyif some file is missing, it may depend also on the configuration of the container10:01
*** artom has joined #openstack-qa10:02
*** yamamoto has quit IRC10:02
Open10K8Stosky: yeah, ofc. I am not sure what is missing on the container if it is10:02
Open10K8Shttps://review.opendev.org/#/c/746715/14/images/cinder/bindep.txt10:02
toskyI'm not sure how you deploy it, but it may be also a file or path which is not mounted properly; if you control the CI, can't you block some machine before the cleanup?10:03
Open10K8Stosky: ok, got your point. Thank you.10:04
toskyunfortunately I don't know too much that configuration part, when I deploy with containers I use tripleo and it manages to do it10:05
*** ramishra has quit IRC10:07
Open10K8Stosky: no problem :)10:08
Open10K8Sseems I am going more closely to the solution already10:08
*** ramishra has joined #openstack-qa10:08
*** yamamoto has joined #openstack-qa10:22
*** yamamoto has quit IRC10:26
*** yamamoto has joined #openstack-qa10:29
*** rcernin has quit IRC10:30
*** rcernin has joined #openstack-qa10:34
*** yamamoto has quit IRC10:41
*** yamamoto has joined #openstack-qa10:48
*** rcernin has quit IRC10:48
*** ramishra has quit IRC10:50
*** rcernin has joined #openstack-qa10:52
*** ramishra has joined #openstack-qa10:55
*** psahoo_ has quit IRC11:03
*** rcernin has quit IRC11:07
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: Enable configuration via environment variables  https://review.opendev.org/74689011:10
*** psahoo_ has joined #openstack-qa11:15
*** yamamoto has quit IRC11:20
*** yamamoto has joined #openstack-qa11:20
*** yamamoto has quit IRC11:21
*** rcernin has joined #openstack-qa11:21
*** psahoo_ has quit IRC11:23
*** yamamoto has joined #openstack-qa11:31
*** jpena is now known as jpena|lunch11:31
*** yamamoto has quit IRC11:36
*** psahoo_ has joined #openstack-qa11:38
*** raildo has joined #openstack-qa11:39
openstackgerritMerged openstack/grenade master: Explicitly enable ml2/ovs  https://review.opendev.org/73998711:48
*** rh-jelabarre has joined #openstack-qa11:58
openstackgerritMerged opendev/elastic-recheck master: Resolve unsafe yaml.load use  https://review.opendev.org/73038912:02
*** rfolco has joined #openstack-qa12:03
*** gfidente has quit IRC12:07
*** gfidente has joined #openstack-qa12:09
*** yamamoto has joined #openstack-qa12:15
*** yamamoto has quit IRC12:30
*** jpena|lunch is now known as jpena12:37
*** dave-mccowan has joined #openstack-qa12:38
*** rh-jelabarre has quit IRC12:41
*** rcernin has quit IRC12:46
*** rcernin has joined #openstack-qa12:48
*** psahoo_ has quit IRC12:59
*** nweinber has joined #openstack-qa12:59
*** paras333 has joined #openstack-qa13:00
*** psahoo_ has joined #openstack-qa13:01
*** rh-jelabarre has joined #openstack-qa13:02
*** psahoo_ has quit IRC13:08
*** psahoo_ has joined #openstack-qa13:11
*** TomStappaerts has quit IRC13:12
*** nweinber has quit IRC13:35
*** nweinber has joined #openstack-qa13:37
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: Enable configuration via environment variables  https://review.opendev.org/74689013:41
openstackgerritMartin Kopec proposed openstack/tempest master: Improve tempest-cleanup ansible role  https://review.opendev.org/74581413:44
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: Filter bugs shown in graphs based on regex  https://review.opendev.org/25763313:49
*** Liang__ has joined #openstack-qa13:59
*** Liang__ is now known as LiangFang14:00
*** gfidente has quit IRC14:03
openstackgerritMartin Kopec proposed openstack/tempest master: DNM - Testing resource leaks  https://review.opendev.org/74669014:03
*** gfidente has joined #openstack-qa14:12
*** abdysn has quit IRC14:15
*** yamamoto has joined #openstack-qa14:28
*** tkajinam has quit IRC14:33
*** rcernin has quit IRC14:37
*** slaweq has quit IRC14:38
*** slaweq has joined #openstack-qa14:40
*** slaweq has quit IRC14:48
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: WIP: Enable configuration via environment variables  https://review.opendev.org/74689014:49
*** gcheresh_ has quit IRC14:50
*** slaweq has joined #openstack-qa14:51
*** gfidente has quit IRC14:53
*** larainema has joined #openstack-qa15:04
*** psahoo_ has quit IRC15:11
*** chkumar|rover is now known as raukadah15:14
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: Enable configuration via environment variables  https://review.opendev.org/74689015:15
openstackgerritSorin Sbarnea (zbr) proposed opendev/elastic-recheck master: Enable configuration via environment variables  https://review.opendev.org/74689015:22
*** yamamoto has quit IRC15:28
*** brinzhang0 has joined #openstack-qa15:29
*** gfidente has joined #openstack-qa15:29
*** brinzhang_ has quit IRC15:32
*** LiangFang has quit IRC15:35
*** zbr has left #openstack-qa15:36
openstackgerritMerged openstack/openstack-health master: Fix typo in contributor guide  https://review.opendev.org/72219215:37
*** yamamoto has joined #openstack-qa15:58
*** lucasagomes has quit IRC16:01
*** jpena is now known as jpena|off16:07
*** vishakha has joined #openstack-qa16:17
*** gfidente is now known as gfidente|afk16:18
*** gfidente|afk has quit IRC16:23
*** gfidente has joined #openstack-qa16:25
*** yamamoto has quit IRC16:37
openstackgerritMartin Kopec proposed openstack/tempest master: Improve tempest-cleanup ansible role  https://review.opendev.org/74581416:40
openstackgerritMartin Kopec proposed openstack/tempest master: DNM - Testing resource leaks  https://review.opendev.org/74669016:41
*** gfidente has quit IRC16:48
*** dtantsur is now known as dtantsur|afk17:01
*** artom has quit IRC17:05
*** gfidente has joined #openstack-qa17:13
*** nightmare_unreal has quit IRC17:17
*** artom has joined #openstack-qa17:34
*** brinzhang_ has joined #openstack-qa17:47
*** brinzhang0 has quit IRC17:51
*** gfidente has quit IRC18:21
*** artom has quit IRC18:30
*** yamamoto has joined #openstack-qa18:36
mnaseri am seeing an almost near 100% failure rate of "ceph : Depends: ceph-mgr (= 12.2.13-0ubuntu0.18.04.2) but it is not going to be installed" :(18:39
*** vishalmanchanda has quit IRC18:49
*** yamamoto has quit IRC19:13
fricklermnaser: do you have a pointer to a log? might be an out of sync repo19:28
toskymnaser: oh, I've seen it from time to time too, as alternative to the missing glance-store or other packages from pypi19:33
mnaserfrickler: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_2de/747004/1/check/openstack-operator:functional/2dec0fa/job-output.txt19:49
*** chaconpiza has quit IRC19:53
mnasertosky, clarkb, fungi: if you're curious, when i troubleshooted this, i found the api that returns builds seemingly returning builds which are not ready yet20:10
mnaserhttps://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu/bionic&ref=nautilus&sha1=latest as of now returns "status": "building"20:10
mnaserso we should find a way to get a.. "already built" url or something to fix that plugin20:10
toskyvkmc: ^^20:10
*** artom has joined #openstack-qa20:11
mnaseradding status=ready20:12
clarkbmnaser: this is cephs' package build api?20:12
mnasergives me what i need20:12
mnaserclarkb: correct, i think we need to check for https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu/bionic&ref=nautilus&sha1=latest&status=ready instead20:12
mnaserrefering to https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L882-L91020:12
mnaserfyi i am referring to https://github.com/ceph/shaman20:13
mnaser"The status of the repo in chacra. Available values are: requested, queued, building, and ready."20:13
vkmcmnaser, o/20:13
vkmcmnaser, seems we need to add an extra filter to the request we are passing to shaman20:14
fungimakes sense20:14
openstackgerritMohammed Naser proposed openstack/devstack-plugin-ceph master: shaman: use 'ready' repo instead of any  https://review.opendev.org/74703020:15
mnaserclarkb, tosky, vkmc, fungi: ^ :)20:15
vkmcmnaser, thanks :)20:15
mnaserno problem!  all of our jobs use this so it hits us really often20:16
mnaseryeah we can't merge anything because this is constantly failing, so i'd appreciate reviews :\20:30
*** vishakha has quit IRC20:36
*** dustinc has quit IRC20:49
*** paras333 has quit IRC20:59
openstackgerritJames Parker proposed openstack/whitebox-tempest-plugin master: Pass hostname to NovaServiceManager  https://review.opendev.org/74660521:00
*** nweinber has quit IRC21:01
*** raildo has quit IRC21:01
*** paras333_ has joined #openstack-qa21:04
*** rfolco has quit IRC21:05
*** slaweq has quit IRC21:07
*** paras333_ has quit IRC21:09
*** yamamoto has joined #openstack-qa21:12
*** andrebeltrami has joined #openstack-qa21:31
*** yamamoto has quit IRC21:39
*** tosky has quit IRC21:47
openstackgerritMartin Kopec proposed openstack/tempest master: Improve tempest-cleanup ansible role  https://review.opendev.org/74581421:47
openstackgerritMartin Kopec proposed openstack/tempest master: DNM - Testing resource leaks  https://review.opendev.org/74669021:47
*** yamamoto has joined #openstack-qa22:06
*** yamamoto has quit IRC22:25
*** tkajinam has joined #openstack-qa22:58
*** rcernin has joined #openstack-qa22:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!