Wednesday, 2020-04-22

*** threestrands has joined #openstack-infra00:04
*** tetsuro has joined #openstack-infra00:05
*** cdearborn has quit IRC00:06
*** verdurin has quit IRC00:07
*** verdurin has joined #openstack-infra00:14
*** rlandy has quit IRC00:15
*** happyhemant has quit IRC00:35
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: cabal-test: add initial haskell job  https://review.opendev.org/72173500:55
*** gyee has quit IRC01:04
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: cabal-test: add initial haskell job  https://review.opendev.org/72173501:10
*** Goneri has quit IRC01:12
*** rh-jelabarre has quit IRC01:28
*** __ministry has joined #openstack-infra01:45
*** ociuhandu has joined #openstack-infra02:08
*** apetrich has quit IRC02:09
*** tinwood has quit IRC02:10
*** tinwood has joined #openstack-infra02:12
*** ociuhandu has quit IRC02:12
*** viks____ has joined #openstack-infra02:17
*** ricolin has joined #openstack-infra02:33
*** tetsuro has quit IRC03:02
*** tetsuro has joined #openstack-infra03:18
*** tetsuro has quit IRC03:19
*** psachin has joined #openstack-infra03:31
*** jtomasek has quit IRC03:33
*** jtomasek has joined #openstack-infra03:38
*** tetsuro has joined #openstack-infra03:57
*** yamamoto has quit IRC04:18
*** kevinz has quit IRC04:24
*** ykarel|away is now known as ykarel04:25
*** evrardjp has quit IRC04:35
*** evrardjp has joined #openstack-infra04:35
*** yamamoto has joined #openstack-infra04:37
*** ociuhandu has joined #openstack-infra04:50
*** ociuhandu has quit IRC04:55
*** rfolco has quit IRC05:09
*** bdodd has quit IRC05:10
*** bdodd has joined #openstack-infra05:13
*** bnemec has quit IRC05:22
*** rcernin has quit IRC05:24
*** ysandeep|away is now known as ysandeep05:34
*** lmiccini has joined #openstack-infra05:39
*** udesale has joined #openstack-infra05:39
*** ricolin has quit IRC05:51
*** ricolin has joined #openstack-infra05:53
*** ociuhandu has joined #openstack-infra05:59
*** rcernin has joined #openstack-infra06:09
openstackgerritMerged zuul/zuul-jobs master: helm-template: enable using values file  https://review.opendev.org/72136506:09
*** rcernin has quit IRC06:10
*** rcernin has joined #openstack-infra06:11
*** nightmare_unreal has joined #openstack-infra06:19
*** tetsuro has quit IRC06:21
*** dpawlik has joined #openstack-infra06:24
*** rcernin has quit IRC06:25
*** rcernin has joined #openstack-infra06:26
*** psachin has quit IRC06:26
*** tetsuro has joined #openstack-infra06:37
*** psachin has joined #openstack-infra06:44
*** dklyle has quit IRC06:50
*** threestrands has quit IRC06:53
*** threestrands has joined #openstack-infra06:54
*** threestrands has quit IRC06:55
*** threestrands has joined #openstack-infra06:55
*** threestrands has quit IRC06:56
*** threestrands has joined #openstack-infra06:56
*** threestrands has quit IRC06:58
*** threestrands has joined #openstack-infra06:58
*** slaweq has joined #openstack-infra06:58
*** threestrands has quit IRC06:59
*** threestrands has joined #openstack-infra06:59
*** threestrands has quit IRC07:01
*** threestrands has joined #openstack-infra07:01
*** threestrands has quit IRC07:02
*** slaweq has quit IRC07:02
*** threestrands has joined #openstack-infra07:02
*** tetsuro has quit IRC07:03
*** threestrands has quit IRC07:04
*** threestrands has joined #openstack-infra07:04
*** apetrich has joined #openstack-infra07:04
*** threestrands has quit IRC07:05
*** threestrands has joined #openstack-infra07:06
*** slaweq has joined #openstack-infra07:06
*** ricolin has quit IRC07:06
*** threestrands has quit IRC07:07
*** threestrands has joined #openstack-infra07:07
*** threestrands has quit IRC07:08
*** threestrands has joined #openstack-infra07:08
*** jcapitao has joined #openstack-infra07:09
*** threestrands has quit IRC07:10
*** threestrands has joined #openstack-infra07:10
*** tetsuro has joined #openstack-infra07:11
*** threestrands has quit IRC07:11
*** threestrands has joined #openstack-infra07:12
*** amoralej|off is now known as amoralej07:13
*** threestrands has quit IRC07:13
*** threestrands has joined #openstack-infra07:13
*** rcernin has quit IRC07:13
*** ricolin has joined #openstack-infra07:13
*** threestrands has quit IRC07:14
*** threestrands has joined #openstack-infra07:14
*** threestrands has quit IRC07:16
*** threestrands has joined #openstack-infra07:16
*** threestrands has quit IRC07:17
*** threestrands has joined #openstack-infra07:18
*** threestrands has quit IRC07:19
*** threestrands has joined #openstack-infra07:19
*** tetsuro has joined #openstack-infra07:20
*** threestrands has quit IRC07:20
*** threestrands has joined #openstack-infra07:21
*** threestrands has quit IRC07:22
*** threestrands has joined #openstack-infra07:22
*** threestrands has quit IRC07:23
*** threestrands has joined #openstack-infra07:24
*** rpittau|afk is now known as rpittau07:24
*** threestrands has quit IRC07:25
*** threestrands has joined #openstack-infra07:25
*** ralonsoh has joined #openstack-infra07:25
*** threestrands has quit IRC07:26
*** threestrands has joined #openstack-infra07:27
*** threestrands has quit IRC07:28
*** threestrands has joined #openstack-infra07:28
*** threestrands has quit IRC07:29
*** threestrands has joined #openstack-infra07:30
*** yolanda has joined #openstack-infra07:30
*** threestrands has quit IRC07:31
*** threestrands has joined #openstack-infra07:31
*** threestrands has quit IRC07:32
*** threestrands has joined #openstack-infra07:33
*** threestrands has quit IRC07:34
*** threestrands has joined #openstack-infra07:34
*** threestrands has quit IRC07:35
*** panda|ruck has quit IRC07:35
*** threestrands has joined #openstack-infra07:36
*** threestrands has quit IRC07:37
*** panda has joined #openstack-infra07:37
*** threestrands has joined #openstack-infra07:37
*** threestrands has quit IRC07:38
*** threestrands has joined #openstack-infra07:39
*** threestrands has quit IRC07:40
*** threestrands has joined #openstack-infra07:40
*** threestrands has quit IRC07:41
*** threestrands has joined #openstack-infra07:41
*** threestrands has quit IRC07:43
*** threestrands has joined #openstack-infra07:43
*** threestrands has quit IRC07:44
*** threestrands has joined #openstack-infra07:45
*** tosky has joined #openstack-infra07:45
*** threestrands has quit IRC07:46
*** threestrands has joined #openstack-infra07:46
*** threestrands has quit IRC07:47
*** xek has joined #openstack-infra07:47
*** threestrands has joined #openstack-infra07:47
*** threestrands has quit IRC07:49
*** threestrands has joined #openstack-infra07:49
*** threestrands has quit IRC07:50
*** threestrands has joined #openstack-infra07:51
*** threestrands has quit IRC07:52
*** threestrands has joined #openstack-infra07:52
*** threestrands has quit IRC07:53
*** threestrands has joined #openstack-infra07:54
*** threestrands has quit IRC07:55
*** threestrands has joined #openstack-infra07:55
*** jpena|off is now known as jpena07:55
*** threestrands has quit IRC07:56
*** threestrands has joined #openstack-infra07:57
*** ccamacho has joined #openstack-infra07:57
*** ociuhandu has quit IRC07:57
*** threestrands has quit IRC07:58
*** threestrands has joined #openstack-infra07:58
*** threestrands has quit IRC07:59
*** threestrands has joined #openstack-infra08:00
*** ociuhandu has joined #openstack-infra08:00
*** threestrands has quit IRC08:01
*** threestrands has joined #openstack-infra08:01
*** threestrands has quit IRC08:02
*** threestrands has joined #openstack-infra08:02
*** threestrands has quit IRC08:04
*** threestrands has joined #openstack-infra08:04
*** threestrands has quit IRC08:05
*** threestrands has joined #openstack-infra08:06
*** threestrands has quit IRC08:07
*** threestrands has joined #openstack-infra08:07
*** tetsuro_ has joined #openstack-infra08:08
openstackgerritSorin Sbarnea proposed openstack/project-config master: Enable promote to unarchive gz archives in addition to bz2  https://review.opendev.org/72165208:08
*** threestrands has quit IRC08:08
*** tetsuro has quit IRC08:11
*** tkajinam has quit IRC08:15
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: tox: run default envlist if tox_envlist is empty  https://review.opendev.org/72179008:22
*** roman_g has quit IRC08:23
*** tetsuro_ has quit IRC08:27
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: tox: Run all environments in tox_envlist  https://review.opendev.org/72179008:36
*** pkopec has joined #openstack-infra08:40
*** ysandeep is now known as ysandeep|lunch08:46
*** panda is now known as panda|ruck08:48
*** ociuhandu has quit IRC08:55
*** ociuhandu has joined #openstack-infra08:57
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: tox: Run all environments in tox_envlist  https://review.opendev.org/72179009:00
*** ociuhandu has quit IRC09:02
*** ysandeep|lunch is now known as ysandeep09:06
*** ykarel is now known as ykarel|lunch09:18
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: tox: update tox_envlist documentation  https://review.opendev.org/72179609:19
*** ricolin has quit IRC09:22
*** ricolin has joined #openstack-infra09:23
*** ricolin has quit IRC09:24
*** ricolin has joined #openstack-infra09:25
*** ricolin has quit IRC09:25
*** ricolin_ has joined #openstack-infra09:25
*** ricolin_ is now known as ricolin09:36
*** dtantsur|afk is now known as dtantsur09:42
*** ykarel|lunch is now known as ykarel09:45
*** ociuhandu has joined #openstack-infra09:48
*** evrardjp has quit IRC09:51
*** evrardjp has joined #openstack-infra09:51
*** ociuhandu has quit IRC09:51
*** ociuhandu has joined #openstack-infra09:52
*** matt_kosut has joined #openstack-infra09:55
*** matt_kosut has quit IRC09:55
*** yamamoto has quit IRC09:57
*** gfidente|afk is now known as gfidente10:05
*** hemna has quit IRC10:18
*** hemna has joined #openstack-infra10:19
*** takamatsu has joined #openstack-infra10:27
*** yamamoto has joined #openstack-infra10:34
*** priteau has joined #openstack-infra10:39
*** rpittau is now known as rpittau|bbl10:42
*** yamamoto has quit IRC10:44
*** jcapitao is now known as jcapitao_lunch10:45
*** yamamoto has joined #openstack-infra10:59
*** yamamoto has quit IRC11:03
*** roman_g has joined #openstack-infra11:15
*** yamamoto has joined #openstack-infra11:22
*** yamamoto has quit IRC11:25
*** yamamoto has joined #openstack-infra11:25
*** jpena is now known as jpena|lunch11:29
*** jtomasek_ has joined #openstack-infra11:36
*** jtomasek has quit IRC11:39
*** ociuhandu has quit IRC11:39
*** ysandeep is now known as ysandeep|brb11:46
*** rh-jelabarre has joined #openstack-infra11:48
*** rpittau|bbl is now known as rpittau11:50
*** rlandy has joined #openstack-infra12:08
*** amoralej is now known as amoralej|lunch12:11
*** jcapitao_lunch is now known as jcapitao12:15
*** yamamoto has quit IRC12:15
*** rfolco has joined #openstack-infra12:22
*** ociuhandu has joined #openstack-infra12:23
*** ociuhandu has quit IRC12:29
*** dayou has quit IRC12:29
*** ociuhandu has joined #openstack-infra12:29
*** dayou has joined #openstack-infra12:30
*** jpena|lunch is now known as jpena12:35
*** Goneri has joined #openstack-infra12:38
*** ysandeep|brb is now known as ysandeep12:41
*** yamamoto has joined #openstack-infra12:48
*** yamamoto has quit IRC12:56
*** ykarel is now known as ykarel|afk13:00
*** amoralej|lunch is now known as amoralej13:08
*** psachin has quit IRC13:14
*** udesale_ has joined #openstack-infra13:40
*** udesale has quit IRC13:42
*** yamamoto has joined #openstack-infra13:47
*** ykarel|afk is now known as ykarel13:51
*** zxiiro has joined #openstack-infra13:51
openstackgerritMerged openstack/project-config master: Retire i18n-specs repo  https://review.opendev.org/72171913:53
openstackgerritRoman Gorshunov proposed openstack/project-config master: Retire airship-in-a-bottle: end project gating  https://review.opendev.org/72197813:57
*** yamamoto has quit IRC13:58
*** yamamoto has joined #openstack-infra14:01
*** yamamoto has quit IRC14:01
*** yamamoto has joined #openstack-infra14:01
*** bnemec has joined #openstack-infra14:01
*** yamamoto has quit IRC14:02
*** yamamoto has joined #openstack-infra14:03
*** gshippey has joined #openstack-infra14:04
openstackgerritGhanshyam Mann proposed openstack/os-performance-tools master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72111414:09
openstackgerritGhanshyam Mann proposed openstack/hacking master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72110814:09
openstackgerritGhanshyam Mann proposed openstack/os-testr master: [ussuri][goal] Update contributor documentation  https://review.opendev.org/72111214:10
*** j0k3r has joined #openstack-infra14:29
*** j0k3r has quit IRC14:29
openstackgerritAndreas Jaeger proposed openstack/project-config master: Fix i18n-specs jobs  https://review.opendev.org/72198914:38
AJaegerconfig-core, I mistyped, could you review, please? ^14:38
*** factor has quit IRC14:45
openstackgerritRoman Gorshunov proposed openstack/project-config master: Retire airship-in-a-bottle: end project gating  https://review.opendev.org/72197814:48
*** ykarel is now known as ykarel|away14:57
openstackgerritMerged openstack/project-config master: Fix i18n-specs jobs  https://review.opendev.org/72198915:06
*** dklyle has joined #openstack-infra15:11
*** gyee has joined #openstack-infra15:11
AJaegerthanks, clarkb ! ^15:12
clarkbyou're welcome15:12
openstackgerritAndreas Jaeger proposed openstack/project-config master: Finish retiring i18n-specs  https://review.opendev.org/72172215:28
AJaegerconfig-core, a few reviews, please: https://review.opendev.org/#/c/718392/ https://review.opendev.org/721722 https://review.opendev.org/720641 https://review.opendev.org/72124815:50
*** pkopec has quit IRC15:58
*** pkopec has joined #openstack-infra15:58
*** __ministry has quit IRC16:00
*** __ministry has joined #openstack-infra16:02
*** ajitha has joined #openstack-infra16:03
*** rkukura has quit IRC16:08
ajithahi..we are running a Thirdparty CI.. we are planning to migrate to zuulv3.. currently we have zuulv2 with jenkins master and slaves. Can you suggest some documentation link regarding zuulv3 openstack CI for our reference??16:09
fungiajitha: openstack's ci isn't run like a third-party ci system, so it may not be much help to you16:10
ajithaok16:10
fungiopenstack uses the ci system in opendev.org16:10
fungiand while opendev does run everything transparently and in the open, it doesn't attempt to make its deployment and configuration of the software it runs reusable by others16:11
ajithaok.16:11
fungiso the best i can do is link you to https://zuul-ci.org/docs/ and https://opendev.org/opendev/system-config16:11
*** igordc has joined #openstack-infra16:12
ajithaThank you..16:12
*** noama has quit IRC16:13
fungiajitha: also there's a call for help for someone to write up what a zuul-v3 based third-party openstack ci reporting into opendev's code review system might look like: https://docs.opendev.org/opendev/infra-specs/latest/specs/zuulv3-3rd-party-ci.html16:14
ajithafungi : Thank you.16:17
ajithathis is yet to be done?? sorry i am new to the CI..16:17
ajithafungi : the link you sent last is yet to be assigned??16:18
fungiajitha: yes, that specification is guidance to anyone who wants to figure out a good way to deploy a third party ci system for openstack using zuul v3 and write documentation about how they did it16:18
ajithaok thanks16:19
fungiwhich is why i referred to it as a "call for help"16:19
ajithaok16:19
*** rkukura has joined #openstack-infra16:21
fungiajitha: unfortunately i've heard from at least a few people who set up zuul v3 as a third-party ci for various openstack projects, but none of them has written instructions on how they configured it16:24
ajithafungi : thanks for the help. its ok.16:25
*** ociuhandu has quit IRC16:27
*** udesale_ has quit IRC16:27
*** ociuhandu has joined #openstack-infra16:28
*** rpittau is now known as rpittau|afk16:29
zbrfungi: clarkb: can you help with bz2 stuff? https://review.opendev.org/#/q/topic:fix/bz2+(status:open+OR+status:merged)16:30
*** ociuhandu has quit IRC16:32
*** evrardjp has quit IRC16:35
*** evrardjp has joined #openstack-infra16:35
fungizbr: thanks! i've approved 721652 and 721706 so we'll want to keep an eye out for any disruption in promote pipeline docs jobs16:35
fungiif all's clear we can then revisit 71502816:36
zbrsuper16:36
*** eharney has quit IRC16:39
*** dpawlik has quit IRC16:40
*** dpawlik has joined #openstack-infra16:40
*** lmiccini has quit IRC16:45
*** dpawlik has quit IRC16:45
openstackgerritMerged openstack/project-config master: Enable promote to unarchive gz archives in addition to bz2  https://review.opendev.org/72165216:48
*** ociuhandu has joined #openstack-infra16:49
*** lbragstad has quit IRC16:51
*** lbragstad has joined #openstack-infra16:51
toskyajitha: (and fungi for reference) the Software Factory project has a guide on how to setup a system; they basically "pack" together zuul and other components so that they are easy to deploy16:51
toskyajitha: feel free to get in touch with them; here is the site and the "quickstart" doc: https://www.softwarefactory-project.io/docs/3.4/operator/quickstart.html16:51
toskyajitha: and here are the contacts https://www.softwarefactory-project.io/pages/contact.html16:52
ajithatosky : sure thanks. will check16:53
*** eharney has joined #openstack-infra16:53
*** yolanda has quit IRC16:54
*** dtantsur is now known as dtantsur|afk16:55
*** jcapitao has quit IRC17:02
*** __ministry has quit IRC17:04
*** eharney has quit IRC17:06
*** __ministry has joined #openstack-infra17:06
*** __ministry has quit IRC17:06
*** eharney has joined #openstack-infra17:08
*** jpena is now known as jpena|off17:12
*** priteau has quit IRC17:18
*** ociuhandu has quit IRC17:24
*** gfidente is now known as gfidente|afk17:33
*** jackedin has joined #openstack-infra17:50
*** ajitha has quit IRC17:54
*** cdearborn has joined #openstack-infra17:55
*** ralonsoh has quit IRC17:56
*** nightmare_unreal has quit IRC17:59
*** ociuhandu has joined #openstack-infra18:02
*** sshnaidm is now known as sshnaidm|afk18:04
*** ociuhandu has quit IRC18:38
*** ociuhandu has joined #openstack-infra18:44
*** ociuhandu has quit IRC18:48
*** ociuhandu has joined #openstack-infra18:48
*** amoralej is now known as amoralej|off18:49
noonedeadpunkinfra-cores, can I ask to force-merge that? https://review.opendev.org/#/c/722022/19:13
*** ociuhandu has quit IRC19:22
clarkbnoonedeadpunk: can you not fix the jobs?19:30
noonedeadpunkit's ocata....19:31
noonedeadpunkI'd actually rather drop this branch...19:31
clarkbnoonedeadpunk: well its weird we are trying to fix the jobs but then the jobs aren't fixed19:31
clarkbif you are saying its not possible to fix the jobs then lets not bother at all imo19:31
noonedeadpunkwe're not trying to fix the jobs - we're trying to remove errors from zuul openstack tenant19:32
clarkbI mean its a bit of both19:32
clarkbI think what I'm saying is you should delete the job entirely if you aren't going to make it function19:32
noonedeadpunkcasue by required projects zuul tries to pull dropped jobs19:32
*** ociuhandu has joined #openstack-infra19:33
zaroclarkb: you guys fully switched out puppet with sensible?19:38
zaroI mean ansible?19:38
fungistill in progress19:38
*** ociuhandu has quit IRC19:38
zarois that ansible to provision docker or the other way around?19:38
zaroor maybe both?19:38
clarkbzaro: ansible does provisioning of things often times containers (but not always)19:39
fungialso good to see you again, zaro!!!19:43
fungilong time no irc19:44
zaroyes, likewise!19:46
zarodoes ansible provision images as well?19:49
clarkbzaro: which images? but in general no. We use zuul jobs (which under the hood are ansible I guess) to run docker image builds using normal docker tools19:51
zarojust wondering how your setup works.  we've got ansible setting up images but not down to containers yet.19:51
clarkband the test nodes are still built with dib19:51
clarkbzaro: really all ansible is doing is executing docker commands19:51
zaroohh yeah, dib.  I still remember that :)19:52
zarowe use packer+ansible for building images19:53
*** ccamacho has quit IRC19:54
fungiwell, we're not using dib to create our container images19:54
fungijust the generic virtual machine images used by the ci system to run job payloads19:54
fungizuul jobs are building container images inside those virtual machines and publishing them19:55
fungithen we later reconsume the container images to deploy in production19:55
fungiwe've also got speculative registries for container images, so jobs can build test images which other jobs can use in dependencies19:56
openstackgerritJames E. Blair proposed openstack/project-config master: Revert "Move Ubuntu builds away from nb04"  https://review.opendev.org/72213419:56
fungiand worked out a "promote" pipeline workflow where the image we build and test in gate jobs is the same one which gets published if the change merges19:56
zaroahh, ok.  zuul sets up container images using stock OS VMs and it does that with ansible.19:58
clarkbzaro: yes roughly19:59
clarkbzaro: we also have full speculative gating of those container images19:59
clarkbzaro: we build them in the gate, publish them and test them. Then if the change merges we promote the published version to an accepted version19:59
clarkband all of that incorporates other inflight changes of related software (for example we test zuul and nodepool together speculatively in the gate premerge)20:00
*** Lucas_Gray has joined #openstack-infra20:09
*** Lucas_Gray has quit IRC20:12
*** jackedin has quit IRC20:13
*** ociuhandu has joined #openstack-infra20:17
*** ociuhandu has quit IRC20:28
*** gshippey has quit IRC20:31
*** xek has quit IRC20:34
*** ociuhandu has joined #openstack-infra21:00
zaroyeah, I remember all of Zuul's magic.  very cool stuff indeed!21:00
fungiwell, we added complimentary services which take advantage of that magic to allow speculative container registries21:08
*** ociuhandu has quit IRC21:10
*** rlandy is now known as rlandy|brb21:23
zarowow, speculative container registries fungi21:40
zarowondering if docker themselves have something like that?21:41
*** ociuhandu has joined #openstack-infra21:41
*** mihalis68_ has quit IRC21:42
*** pkopec has quit IRC21:43
*** pkopec has joined #openstack-infra21:44
*** mmethot_ has joined #openstack-infra21:44
*** tobiash has quit IRC21:45
*** eharney has quit IRC21:46
*** tobiash has joined #openstack-infra21:47
*** panda|ruck has quit IRC21:47
*** haleyb has quit IRC21:47
*** otherwiseguy has quit IRC21:47
*** mmethot has quit IRC21:48
*** eharney has joined #openstack-infra21:49
*** panda has joined #openstack-infra21:50
*** haleyb has joined #openstack-infra21:50
*** otherwiseguy has joined #openstack-infra21:51
*** ociuhandu has quit IRC21:52
*** ociuhandu has joined #openstack-infra21:52
*** pcrews has joined #openstack-infra21:55
*** ociuhandu has quit IRC21:57
*** slaweq has quit IRC21:58
funginope, corvus wound up writing registry proxy software from scratch because nothing which existed yet was suitable for the task21:59
fungialso we discovered that the dockerhub api is abysmal22:00
corvuszaro: oh hi! :)22:00
corvusi like s/ansible/sensible/  :)22:02
* fungi has an idea for a fork22:04
fungiif you like ansible, you'll *love" sensible!22:04
fungi("love" is a registered trademark of sensible corporation, llc. actual love not guaranteed)22:05
zarohaha, maybe you guys should add a global auto correct for that (ansible -> sensible) in this channel?22:17
*** rcernin has joined #openstack-infra22:31
*** auristor has quit IRC22:36
*** pkopec has quit IRC22:38
*** ociuhandu has joined #openstack-infra22:44
toskyclarkb, gmann (and smcginnis): I compared the logs from a legacy job which successfully had passed earlier today, and more recently started failing: http://paste.openstack.org/show/792573/22:48
toskyI haven't found any relevant change which could explain the different behavior; the list of pip packages is basically the same (just unrelated changes in cinder, keystone neutron and heat)22:49
*** tkajinam has joined #openstack-infra22:54
toskyand now it was reported on openstack-discuss@22:55
clarkbtosky: I believe there is supposed to be a loop in d-g where it installs all plugins into tempest?22:58
clarkbor maybe in devstack? do we have the logs from that showing what it is doing there?22:58
toskyclarkb: but nothing changed in devstack or devstack-gate today22:59
clarkbtosky: ya but maybe we can work backward from where it should be doing the work to figure out why it isn't22:59
toskyor at least nothing I could spot22:59
clarkboh I see this isn't a contiguous set of logs22:59
clarkbthis seems to be a python installation thing. Is it possible you made a plugin release and it doesn't isntall stuff anymore?23:00
clarkbor if installed from source a simple source update?23:00
toskythere is a link to the full log, but from a side-by-side comparison this is where they diverge23:00
*** ociuhandu has quit IRC23:01
toskythis happened also on a job on barbican-tempest-plugin23:01
toskyI don't know which project is affected by the issue reported on openstack-discuss@23:01
clarkbtosky: what repo does sahara_tempest_plugin.* originate in?23:04
toskyclarkb: sahara-tests23:05
toskyiirc there is a link to the review in that pastebin23:06
*** lbragstad has quit IRC23:06
toskyhere is the same failure in a barbican-tempest-plugin review: https://zuul.opendev.org/t/openstack/build/4737f55784634ba1b2ee412fa4ddc300/log/job-output.txt#301123:07
*** erbarr has joined #openstack-infra23:09
clarkbtosky: are they all failing in grenade23:10
toskyclarkb: no, the barbican-tempest-plugin job is not a grenade job; they are all legacy jobs23:10
clarkba quick scan of the sahara job I don't see sahara-tests getting installed into anything23:11
clarkbso now I'm trying to find where it should've been installed23:11
clarkboh I might be in the wrong log file /me switches23:11
erbarrtosky: thanks for the reply23:11
toskyerbarr: so, which job is yours?23:12
toskyI mean, which is the job where you see the failure23:12
clarkbthe way this is expected to work is that your plugin repo installs into a known path23:12
clarkbthat path is then filtered by the regex to ignore the other tempest tests23:12
erbarrtosky: dell ironic ci jobs23:12
clarkbI expect that it is somethign to do with the installation of the plugin tests that is failing so they never end up in a filterable location23:12
clarkbyup23:14
clarkbERROR: sahara-tests 0.9.2.dev4 has requirement jsonschema!=2.5.0,<3.0.0,>=2.0.0, but you'll have jsonschema 3.2.0 which is incompatible.23:14
clarkbhttps://zuul.opendev.org/t/openstack/build/cc60efee09c8404aa392f491c82a2a39/log/logs/grenade.sh.txt#3959923:14
clarkbthe install of the plugins is failing as I expected23:15
toskyuhm, but when did that change?23:15
clarkbyou are asking the wrong person for that23:15
clarkbopenstack/requirements history will probably tell you something about when and why though23:16
toskyright23:16
toskythanks! I don't see that specific error in the barbican-tempest-plugin job, but when the barbican-tempest-plugin is installed, the last tag of tempest is installed instead of the master version23:17
toskymaybe it's related23:17
clarkbagain I would look to where the installation happens23:18
clarkbthe error you are pointing out about the regex happens later and is a symptom of failed installations of the tests23:18
clarkb(so look at the installation step for more info)23:18
clarkbI guess the thing that kept all this in sync was remvoed when we allowed people to have more flexible ranges23:22
clarkbtosky: ^ in the old requirements system we would've automatically pushed chagnes to sahara-tests to get its requirements in line23:22
clarkbwhich made it nice and obvious what the next step was, btu I guess we stopped doing that when the ruleschanged23:22
toskybut shouldn't it then fail for all jobs? Non-legacy jobs (without devstack-gate) are working23:23
clarkbtosky: do any non legacy jobs use your tempest plugin?23:25
toskyclarkb: all the other jobs in the same review23:25
toskymaybe because that tempest workflow is a bit different in the new jobs23:25
clarkbtosky: also possible that the grenade job is usingdifferent constraints?23:26
clarkbhrm master has the <3,>2 requirements entry23:27
clarkbhttps://zuul.opendev.org/t/openstack/build/ed1964aa06b04f23aeed7f54d7ab2b24/log/controller/logs/devstacklog.txt#51790 you have the same error23:28
clarkbnow I'm really confused23:29
clarkbI guess that error isn't actually an error?23:29
*** auristor has joined #openstack-infra23:30
toskyI don't know; I will try to bump the requirement in sahara-tests and see if it fixes anything23:32
clarkbas a sanity check in tempest the all target and venv-tempest target share the same envdir=.tox/tempest23:32
toskyit is still not clear what is the error for barbican-tempest-client, where I haven't spotted errors (I checked all the devstack*.txt logs)23:33
*** ociuhandu has joined #openstack-infra23:33
*** lbragstad has joined #openstack-infra23:35
clarkbtosky: I notice that the regexes are of different expression types (for lack of better terms)23:37
clarkbtosky: the failing job just uses a simple set of terms. The succeeding one has an anchor and glob matches23:38
clarkbis it possible that regex matching itself is failing?23:38
toskyuhm23:38
clarkband maybe whatever testrunner is used updated?23:39
toskyfrom my notes they seems the same: http://paste.openstack.org/show/792573/23:39
toskyseem*23:39
clarkbtosky: https://zuul.opendev.org/t/openstack/build/ed1964aa06b04f23aeed7f54d7ab2b24/console#3/1/12/controller vs https://zuul.opendev.org/t/openstack/build/cc60efee09c8404aa392f491c82a2a39/log/job-output.txt#357723:40
toskyI compared the pip3-freeze.txt files for the passing and failing sahara-grenade jobs, and they are basically the same23:40
toskyoh, the native job23:41
clarkband apparently tempest is its own test runner now23:41
clarkbso now I'm wondering if tempest updated and broke/changed the --regex semantics23:41
toskyyes, but that's the same also on the legacy job, which runs tempest run23:41
clarkbtosky: are you sure? the legacy job is grenade23:42
clarkband it may install old tempest (from a tag since I think we are doing that for some branches now)23:43
clarkbwe can verify that in the job logs23:43
toskyit uninstalls tempest-23.0.1.dev143 (master) and installs tempest-23.0.023:44
clarkbok so it could be a difference between those two?23:45
clarkbthe working one should be master23:45
toskythere is one change that may explain the different behavior23:46
toskyuhm, no, it applies only to stable branches up to rocky: https://opendev.org/openstack/tempest/commit/56149024a0be5419093de1979051b73283d963d623:47
toskybut now I really need to go23:50
toskyclarkb: thanks for the help so far, at least I have a hint to solve the sahara-tests part (maybe; I sent a review)23:50
toskylet's see if something else comes out23:50
*** tosky has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!