Wednesday, 2017-10-25

*** slaweq has quit IRC00:00
fungiianw: i'm guessing it's something we need to update on the report comment template00:00
fungibut don't really know for sure. trying to get all these release project-template updates worked through currently00:00
ianwfungi: that's cool, i just didn't want to retrace already solved steps00:01
fungiyep, i think it's virgin ground00:01
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364500:02
ianwtonyb: i'm assuming jeblair is ok with the perms and took the liberty of adding it (can always fiddle it later).  want to try the abandon again?00:03
ianwjust so we can get this EOL out of the way00:03
tonybianw: thanks ... trying kolla again00:04
dhinesh_is there a nodepool/elements/puppet which can be used for CI setup?00:04
*** slaweq has joined #openstack-infra00:05
pabelangerdhinesh_: not any more, we've stopped using puppet on our images.00:05
pabelangerdhinesh_: you can look at git history for project-config to see how we did it00:05
tonybianw: that worked ... so I'll carry on with the rest of the projects00:05
*** trown is now known as trown|outtypewww00:05
Jeffrey4lwhat's the example url for the project public keys? "keys/<source>/<project>.pub"00:06
*** rtjure has joined #openstack-infra00:07
Jeffrey4lwhat's the example url for the project public keys? "keys/<source>/<project>.pub"00:07
*** andreas_s has joined #openstack-infra00:09
openstackgerritJeremy Stanley proposed openstack-infra/openstack-zuul-jobs master: Use a more thorough release for API servers  https://review.openstack.org/51485600:10
*** rtjure has quit IRC00:12
fungiJeffrey4l: you can use http://git.openstack.org/cgit/openstack-infra/zuul/tree/tools/encrypt_secret.py?h=feature/zuulv3 to handle it for you, but yes something like http://zuulv3.openstack.org/keys/gerrit/openstack/nova.pub00:13
Jeffrey4lgot. thanks a lot.00:13
fungiyou're welcome!00:14
dhinesh_pabelanger: ok, i am building an image for a CI setup, what are the essential elements for jenkins slave?00:14
openstackgerritMerged openstack-infra/system-config master: Add match for "-" in pipeline name  https://review.openstack.org/51459100:14
*** bobh has joined #openstack-infra00:15
pabelangerdhinesh_: we infact have an element called jenkins-slave: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/jenkins-slave you should be able to use that00:15
jeblairfungi, ianw: we're probably missing the pipeline config from zuulv2 which customized the 'build succeeded' messages.00:18
jeblairit's a config change, not a code change.00:18
fungijeblair: that sounds about right00:18
*** ijw has quit IRC00:18
fungiit was like some sort of format string, if memory serves00:18
ianwjeblair: yeah, i'm not so sure ... in the debugger now00:19
*** rcernin has joined #openstack-infra00:19
dhinesh_pabelanger: ok cool, and it can run it on top of any OS or is it specific to ubuntu?00:19
*** rtjure has joined #openstack-infra00:20
jeblairianw: we have it for gate, but not check00:20
jeblairianw: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/pipelines.yaml#n10100:20
jeblaircompare to http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n700:21
*** andreas_s has quit IRC00:22
*** rcernin has quit IRC00:23
ianw    success-message: Build succeeded (check pipeline). ?00:23
*** wolverineav has quit IRC00:23
jeblairyep.  also failure-message00:23
*** wolverineav has joined #openstack-infra00:24
*** rcernin has joined #openstack-infra00:24
*** rtjure has quit IRC00:24
openstackgerritJeremy Stanley proposed openstack-infra/project-config master: Use non-pypi for release instead of tarball-only  https://review.openstack.org/51486900:27
openstackgerritIan Wienand proposed openstack-infra/project-config master: Add success message for check pipeline  https://review.openstack.org/51487000:27
ianwjeblair: ^ like so?00:27
*** bobh has quit IRC00:28
openstackgerritMerged openstack-infra/storyboard master: Consolidate old database migrations  https://review.openstack.org/51037000:28
*** wolverineav has quit IRC00:29
*** thorst has joined #openstack-infra00:29
Zarahm so I'm finally catching up with some long-overdue storyboard reviews00:30
pabelangerdhinesh_: it should work for ubuntu, fedora-26, centos-7 and opensuse00:30
dhinesh_pabelanger: ok thanks00:31
*** andreas_s has joined #openstack-infra00:32
*** rtjure has joined #openstack-infra00:32
Zarajohnsom sent us a patch, https://review.openstack.org/#/c/506812/2  to update some docs, but he currently has to link to the github mirror for releases because he wants to link a specific section of the page and apparently that's not possible with the git.o.o link00:32
Zarawe'd prefer to use git.o.o and not github, so wondering if there are any solutions we've not considered.00:33
Zarawell, that's a bit of a garbled question but the comments on that patch should convey things more clearly than I am rn00:34
*** s-shiono has joined #openstack-infra00:36
fungiyou can link to a specific line in a file in cgit00:36
*** rtjure has quit IRC00:37
*** slaweq has quit IRC00:37
fungianyway, it looks like the real solution there is to ask the release team to start publishing their readme on docs.o.o or releases.o.o00:40
fungirather than abusing github's autorender of rst files00:41
fungii'll leave a comment on the change00:41
openstackgerritzhongshengping proposed openstack-infra/openstack-zuul-jobs master: Remove xenial beaker jobs from gate pipeline  https://review.openstack.org/51487200:42
*** rtjure has joined #openstack-infra00:42
*** thorst has quit IRC00:46
openstackgerritzhongshengping proposed openstack-infra/openstack-zuul-jobs master: Remove extra voting  https://review.openstack.org/51487500:47
*** rtjure has quit IRC00:47
*** slaweq has joined #openstack-infra00:49
*** andreas_s has quit IRC00:49
*** huanxie has joined #openstack-infra00:49
fungiZara: i've also asked the release team about getting the readme for that repo published in rendered form somewhere more durable00:50
fungiso maybe this will be solved soonish00:50
Zarafungi: thank you :) yeah, I wondered about linking to the line, but I thought that could be fragile since aiui it can only be done by line number and we'd want to identify it by heading00:50
ZaraI've also noticed that the webclient draft builds behave strangely under 'Zuul' vs 'Jenkins check'. (there are examples here: https://review.openstack.org/#/c/511247/ )00:51
Zaragate-storyboard-webclient-js-draft links to a storyboard-dev instance with the changes happily enough00:52
Zaralegacy-storyboard-webclient-js-draft links to a dev instance that throws lots of errors and doesn't load any of the content00:52
*** adisky_ has joined #openstack-infra00:52
*** rkukura has quit IRC00:52
ZaraI don't know what's going on since our error messages for that just say '-1'00:53
*** rtjure has joined #openstack-infra00:54
*** andreas_s has joined #openstack-infra00:54
*** mriedem has quit IRC00:56
*** bnemec has quit IRC00:58
*** cuongnv has joined #openstack-infra00:58
*** Nil_ has quit IRC00:58
*** rtjure has quit IRC00:59
*** andreas_s has quit IRC00:59
*** Nil_ has joined #openstack-infra00:59
*** bnemec has joined #openstack-infra00:59
*** Apoorva_ has joined #openstack-infra01:00
*** Sukhdev has quit IRC01:00
*** jpena|off has quit IRC01:00
*** LindaWang has joined #openstack-infra01:00
*** ihrachys has quit IRC01:01
*** Apoorva has quit IRC01:02
*** amoralej|off has quit IRC01:04
*** ltomasbo has quit IRC01:04
*** pvaneck has quit IRC01:04
fungiZara: i've basically checked out for the night, but i would definitely suggest explaining/linking that on the zuulv3-issues etherpad01:04
*** Apoorva_ has quit IRC01:04
fungiin case nobody happens along in the next few minutes to look at that01:04
*** rtjure has joined #openstack-infra01:05
*** ltomasbo has joined #openstack-infra01:06
*** jpena|off has joined #openstack-infra01:06
*** amoralej has joined #openstack-infra01:08
*** rtjure has quit IRC01:10
Zarasure, thanks :) I wasn't sure if it was a zuul thing or a sb thing given the jobs might've run at different times01:10
*** ijw has joined #openstack-infra01:11
*** jpena|off has quit IRC01:11
* Zara is tempted to make a story01:12
*** ltomasbo has quit IRC01:12
*** amoralej has quit IRC01:13
*** nhicher has quit IRC01:13
*** ansiwen[q] has quit IRC01:13
*** mriedem has joined #openstack-infra01:15
*** liujiong has joined #openstack-infra01:15
*** gyee has quit IRC01:17
tonybianw: FWIW I've done the newton EOL's it looks like there were a couple of issues with repos having bad .gitreview files/ gerrit remotes  I'll correct them after lunch and then move onto the old numeric releases01:18
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364501:18
*** ijw_ has joined #openstack-infra01:19
*** rtjure has joined #openstack-infra01:19
fungiZara: my understanding is that the draft job publishes a draft copy of the webclient to docs-draft, but those all connect back to a common api on the storyboard-dev server01:19
*** gk_ has quit IRC01:19
fungiso multiple parallel builds should never be a problem01:19
*** Qiming has quit IRC01:20
*** jamielennox has quit IRC01:20
*** ltomasbo has joined #openstack-infra01:20
*** slaweq has quit IRC01:20
*** jpena|off has joined #openstack-infra01:20
*** amoralej has joined #openstack-infra01:20
*** ijw has quit IRC01:20
fungimore likely the translated legacy job is just missing some necessary bit01:20
*** ansiwen[q] has joined #openstack-infra01:21
Zarayeah. I definitely haven't seen that issue before now-- just spent very little time investigating it so I didn't want to be too definite about it. I've added it to the etherpad.01:21
Zara'night! :)01:21
*** persia has quit IRC01:21
*** gus has quit IRC01:21
*** andreas_s has joined #openstack-infra01:21
*** gus has joined #openstack-infra01:22
*** persia has joined #openstack-infra01:22
*** gk_ has joined #openstack-infra01:22
*** jamielennox has joined #openstack-infra01:23
*** shu-mutou-AWAY has quit IRC01:23
*** rtjure has quit IRC01:23
*** nhicher has joined #openstack-infra01:25
*** sree has joined #openstack-infra01:27
*** Qiming has joined #openstack-infra01:28
*** mriedem has quit IRC01:28
*** rtjure has joined #openstack-infra01:28
*** salv-orlando has joined #openstack-infra01:28
*** slaweq has joined #openstack-infra01:29
gk_Hi everyone, our third-party cannot connect to gerrit since last saturday. Zuul raises this exception "SSHException: No existing session". I checked the public key set in gerrit and it is the same as in our server. Besides, I can connect to gerrit using the ssh command line but it failed with the paramiko client. Anyone has any ideas on how to fix it? Thanks in advance.01:29
*** thorst has joined #openstack-infra01:29
*** andreas_s has quit IRC01:30
*** andreas_s has joined #openstack-infra01:31
*** sree has quit IRC01:32
*** rcernin has quit IRC01:32
*** rcernin has joined #openstack-infra01:32
*** salv-orlando has quit IRC01:33
*** Qiming has quit IRC01:33
*** rcernin has quit IRC01:33
*** rtjure has quit IRC01:33
*** thorst has quit IRC01:34
*** Qiming has joined #openstack-infra01:35
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364501:37
*** psachin has joined #openstack-infra01:37
*** Qiming has quit IRC01:39
*** rtjure has joined #openstack-infra01:40
*** Qiming has joined #openstack-infra01:40
clarkbgk_: can you paste a full exception?01:41
fungito somewhere like paste.openstack.org (not directly into this channel)01:41
gk_clarkb: http://paste.openstack.org/show/624543/01:42
*** edmondsw has joined #openstack-infra01:43
clarkbgk_: appare tly this can happen if it cannot find a useable key file so it is looking for an ssh agent session01:44
clarkbdoes your key have a passphrase? or is the key missing?01:44
gk_clarkb: I don't have any passphrase and the key file is here01:45
*** rtjure has quit IRC01:45
clarkbmaybe double check the zuul daemon is running as the expected user?01:46
*** rlandy has quit IRC01:46
fungiyeah, lack of read permission (or too loose permission as well under some circumstances) can cause it to get skipped01:47
*** edmondsw has quit IRC01:47
gk_clarkb: The expected user is ok. About the permissions, I have read/write permission for this user.01:48
*** annp has joined #openstack-infra01:48
clarkbare the file contents a valid ssh private key?01:49
clarkbolder versions if paramiko may also need rsa and not support ecdsa or other newer keh types01:49
*** smatzek has joined #openstack-infra01:49
*** mat128 has quit IRC01:50
*** ijw_ has quit IRC01:50
*** wewe0901 has joined #openstack-infra01:51
gk_clarkb: -rw------- 1 zuul zuul 1679 Jun 14 20:37 /var/lib/zuul/ssh/id_rsa01:51
*** mat128 has joined #openstack-infra01:51
*** kiennt26 has joined #openstack-infra01:51
gk_clarkb: it is a rsa key type01:52
*** dhinesh_ has quit IRC01:52
*** esberglu has joined #openstack-infra01:52
*** mat128 has quit IRC01:53
clarkbgk_: should it be in /var/lib/zuul/.ssh ?01:53
*** kiennt26 has quit IRC01:53
*** rtjure has joined #openstack-infra01:53
*** kiennt26 has joined #openstack-infra01:54
gk_clarkb: in the zuul conf, it is set like this: sshkey=/var/lib/zuul/ssh/id_rsa01:54
*** smatzek has quit IRC01:54
*** rcernin has joined #openstack-infra01:55
gk_clarkb: by using this command line, I can connect successfully to gerrit: ssh -p 29418 disco.ci@review.openstack.org -i /var/lib/zuul/ssh/id_rsa01:55
*** esberglu has quit IRC01:57
*** hongbin has joined #openstack-infra01:57
*** andreas_s has quit IRC01:58
fungiit's the connection count01:58
*** rtjure has quit IRC01:58
clarkbfungi: ?01:59
fungigk_: the gerrit api believes it has 126 open connections from 113.196.154.24801:59
fungimany of which are from the disco.ci account01:59
fungiwe have a connlimit filter in place to reject new connections beyond 100 concurrent02:00
clarkbfungi: I wonder if they are all tcp connections made without getting ssh going due to this exception02:00
fungientirely possible02:00
fungii can close all open connections for that account and see what happens02:01
gk_fungi: ok we can try it02:01
fungiit'll take a few minutes for all the close-connection calls to complete02:02
*** slaweq has quit IRC02:02
fungilooks like this same ip address is also being shared by other accounts02:02
gk_fungi: ok please tell me when it is finished and I will start zuul to check if it happens again02:02
openstackgerritzhongshengping proposed openstack-infra/openstack-zuul-jobs master: Remove xenial beaker jobs from gate pipeline for puppet modules  https://review.openstack.org/51487202:02
*** andreas_s has joined #openstack-infra02:02
clarkbgk_: if that doesnt address it then we may want to see you zuul config and the zuul process details (ps -elf probably works well enpugh) so that we can see if it is running as the correct user and has correct args to the process02:03
fungigk_: go ahead and try again. there are no currently open connections for disco.ci though there are still 63 from that address for other accounts02:04
clarkbbut reading the traceback I wonder if keyfile is None02:04
*** slaweq has joined #openstack-infra02:04
fungii see 1 connection for disco.ci now02:05
fungimake that 202:05
gk_fungi: it seems ok now. I don't see the exception02:06
fungidoesn't seem to have increased past 2 connections yet02:06
*** gongysh has joined #openstack-infra02:06
fungiodds are there's something flaky about the network from which you're originating which is preventing proper socket shutdown02:07
*** andreas_s has quit IRC02:07
*** rtjure has joined #openstack-infra02:07
fungiand that causes stale sockets to accumulate until it reaches the point where we begin refusing any subsequent connections02:08
gk_fungi: ok, we have already asked the IT team to check the equipment and to change our network switch02:09
gk_fungi: maybe the root cause is in our equipment.02:10
*** bobh has joined #openstack-infra02:10
fungihaving worked in network engineering for very large environments for over a decade before i started doing this, i saw lots of examples of exactly what you're experiencing02:11
fungimostly chalked up to oversubscribed nat devices02:11
*** liujiong has quit IRC02:11
*** rtjure has quit IRC02:12
*** liujiong has joined #openstack-infra02:12
*** ltomasbo has quit IRC02:12
fungithough there are also plenty of other potential causes from a network device side, like flow-based routing gone awry or other load distribution schemes sometimes sending flows down inappropriate paths02:12
*** amoralej has quit IRC02:12
*** jpena|off has quit IRC02:12
*** yamamoto has joined #openstack-infra02:14
gk_fungi: ok thanks for your help and your advice. I will push our IT team to check it quickly02:14
fungior state-tracking filters unceremoniously dropping flows they see as stale using unbelievably short timeout settings02:14
gk_clarkb: thank you for help too02:14
*** bobh has quit IRC02:15
fungialso spontaneously rebooting firewalls can result in similar behavior02:15
fungiyou're welcome, gk_02:16
* fungi disappears for the night02:17
fungioh, and i'm not around much tomorrow though i'll check back in when i wake up and remind everyone02:17
*** rtjure has joined #openstack-infra02:18
tonybianw: okay It seems that 2 repos failed but I have corrected them.  I'll move onto the old numeric branches now02:18
*** smatzek has joined #openstack-infra02:18
ianwtonyb: ok ... how do they ave bad gitreviews?02:19
ianwno contribiutions?02:19
*** jhesketh_ is now known as jhesketh02:22
*** Qiming has quit IRC02:22
*** rtjure has quit IRC02:23
tonybianw: Yeah I guess so.  It's pretty common with the deb-* repos but I also hit openstack/bareon02:24
tonyboh bareon was my problem I had a stale gerrit remote from befoer: http://git.openstack.org/cgit/openstack/bareon/commit/.gitreview?h=newton-eol&id=e36577418f2deea7d140320c41085f7cc3d2386402:27
*** rtjure has joined #openstack-infra02:27
*** ltomasbo has joined #openstack-infra02:30
*** rtjure has quit IRC02:32
dmsimardHuh, is that new ? E741 ambiguous variable name 'l'02:33
dmsimardDon't remember getting that error on pep802:33
dmsimardDamn you pep8, it's because of you I put silly variable names in the first place02:34
*** andreas_s has joined #openstack-infra02:34
* dmsimard goes to watch some pep8 video by Raymond Hettinger02:34
tonybdmsimard: Yeah I'm preety sure it's new02:34
*** slaweq has quit IRC02:37
*** rtjure has joined #openstack-infra02:37
*** tpsilva has quit IRC02:39
*** smatzek has quit IRC02:41
*** smatzek has joined #openstack-infra02:41
*** smatzek has quit IRC02:42
*** rtjure has quit IRC02:42
*** slaweq has joined #openstack-infra02:42
*** smatzek has joined #openstack-infra02:42
*** andreas_s has quit IRC02:43
*** ramishra has joined #openstack-infra02:44
*** thorst has joined #openstack-infra02:46
*** smatzek has quit IRC02:46
*** stakeda has joined #openstack-infra02:47
*** rtjure has joined #openstack-infra02:48
*** cody-somerville has joined #openstack-infra02:48
*** cody-somerville has quit IRC02:48
*** cody-somerville has joined #openstack-infra02:48
*** thorst has quit IRC02:50
*** baoli has joined #openstack-infra02:50
*** Qiming has joined #openstack-infra02:52
*** rtjure has quit IRC02:53
pabelangerare we saying project-templates should be also in branches? Or should they stay in master branch?02:53
*** baoli has quit IRC02:55
*** Qiming has quit IRC02:56
*** gildub has joined #openstack-infra02:57
*** rtjure has joined #openstack-infra02:57
*** daidv has joined #openstack-infra02:59
*** dave-mccowan has quit IRC02:59
*** namnh has joined #openstack-infra02:59
openstackgerritKazunori Shinohara proposed openstack-infra/project-config master: Updated templates for heat-dashboard  https://review.openstack.org/51489503:02
*** rtjure has quit IRC03:02
*** Qiming has joined #openstack-infra03:04
*** iyamahat has joined #openstack-infra03:06
*** yamahata has quit IRC03:08
*** rtjure has joined #openstack-infra03:10
kazshHi team, could you someone review ^^^^^   thanks in advance.03:11
*** andreas_s has joined #openstack-infra03:11
*** benj__ has joined #openstack-infra03:13
*** iyamahat has quit IRC03:14
*** rtjure has quit IRC03:15
*** Qiming has quit IRC03:15
*** slaweq has quit IRC03:15
*** esberglu has joined #openstack-infra03:20
*** slaweq has joined #openstack-infra03:21
*** rtjure has joined #openstack-infra03:22
openstackgerritKazunori Shinohara proposed openstack-infra/project-config master: Updated templates for heat-dashboard  https://review.openstack.org/51489503:23
*** dhinesh has joined #openstack-infra03:23
*** andreas_s has quit IRC03:24
*** esberglu has quit IRC03:25
*** rtjure has quit IRC03:26
*** dhinesh has quit IRC03:27
*** dhinesh has joined #openstack-infra03:28
*** andreas_s has joined #openstack-infra03:29
*** fanzhang has quit IRC03:29
*** salv-orlando has joined #openstack-infra03:29
*** edmondsw has joined #openstack-infra03:31
*** gk_ has quit IRC03:32
*** rtjure has joined #openstack-infra03:32
*** andreas_s has quit IRC03:33
*** salv-orlando has quit IRC03:33
*** fanzhang has joined #openstack-infra03:34
*** edmondsw has quit IRC03:35
tonybianw: I'm done.  with the numeric removals too.03:36
*** rtjure has quit IRC03:37
tonybI'll generate a fresh report of all the stale things in about a month, and time permitting go to each prjects team with a list of (repo, branch) tuples and ask which ones can be dropped now and estimate the EOL date for the rest03:37
ianwtonyb: ok, both yourself & i are out of project bootstrappers again03:37
tonybianw: Thanks.03:38
ianwi think we made good progress :)  more documentation and now we just need to flip a bit03:38
tonybianw: FWIW I dropped a summary onto the mailing list.03:38
tonybianw: Yeah.  Should be much easier next time.03:38
tonybinfra-root: I did both EOL runs in a screen session with logging turned on so I can share the log if required03:39
jheskethtonyb, ianw: sorry I didn't notice you guys were doing this today, I would have been happy to help03:39
tonybjhesketh: np you did help by writing the eol_branch script :)03:40
tonybjhesketh: the hardening stuff is really nice03:40
jheskethtonyb: I've kept a copy of my screen sessions whenever I've ran the script (just locally) in case we ever discover any problems03:40
jheskethI also usually run it with -x03:40
jheskethyeah, it gets a little smarter each time :-)03:40
ianw"people can do the work, so machines have time to think" :)03:41
tonybjhesketh: Yeah I shoudl have done that ... next time.03:41
tonybjhesketh: I'll update my tools that nominate the repos to use -x also03:43
*** Qiming has joined #openstack-infra03:44
jhesketh-x is pretty ugly, but it's there if we ever need to debug some breakage03:44
*** rtjure has joined #openstack-infra03:45
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move to a common lock-file directory  https://review.openstack.org/51407903:49
*** rtjure has quit IRC03:50
*** andreas_s has joined #openstack-infra03:52
tonybjhesketh: Yeah it always is but as you say it helps a heap when debugging.03:54
*** slaweq has quit IRC03:55
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move to a common lock-file directory  https://review.openstack.org/51407903:55
*** rtjure has joined #openstack-infra03:56
*** Qiming has quit IRC04:00
*** hongbin has quit IRC04:00
*** andreas_s has quit IRC04:00
*** rtjure has quit IRC04:01
*** yamahata has joined #openstack-infra04:02
*** sree has joined #openstack-infra04:02
*** slaweq has joined #openstack-infra04:06
*** kiennt26 has quit IRC04:07
*** claudiub|2 has joined #openstack-infra04:08
*** rtjure has joined #openstack-infra04:08
*** Qiming has joined #openstack-infra04:08
*** rtjure has quit IRC04:12
*** ykarel|away has joined #openstack-infra04:16
*** esberglu has joined #openstack-infra04:16
*** rtjure has joined #openstack-infra04:18
openstackgerritCao Xuan Hoang proposed openstack-infra/project-config master: Add docs job for VPNaaS and VPNaaS dashboard  https://review.openstack.org/51490604:18
*** esberglu has quit IRC04:20
*** rcernin has quit IRC04:21
*** rtjure has quit IRC04:22
*** iyamahat has joined #openstack-infra04:23
*** rtjure has joined #openstack-infra04:27
*** coolsvap has joined #openstack-infra04:32
*** rtjure has quit IRC04:32
*** huanxie has quit IRC04:34
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364504:35
*** dhajare has joined #openstack-infra04:37
*** slaweq has quit IRC04:39
*** rtjure has joined #openstack-infra04:40
*** rcernin has joined #openstack-infra04:45
*** rtjure has quit IRC04:45
*** dhajare has quit IRC04:46
*** slaweq has joined #openstack-infra04:47
*** verdurin_ has joined #openstack-infra04:49
*** rtjure has joined #openstack-infra04:49
*** verdurin has quit IRC04:50
*** thorst has joined #openstack-infra04:51
*** rtjure has quit IRC04:54
*** udesale has joined #openstack-infra04:54
*** alex_xu has quit IRC04:56
*** thorst has quit IRC04:56
*** felipemonteiro_ has joined #openstack-infra04:57
*** mummer has joined #openstack-infra04:59
*** alex_xu has joined #openstack-infra04:59
*** rtjure has joined #openstack-infra04:59
*** mummer has quit IRC04:59
AJaegerianw: do you want to +2A the jenkins v2 removal? https://review.openstack.org/#/c/507180/04:59
*** felipemonteiro_ has quit IRC05:02
*** huanxie has joined #openstack-infra05:03
*** rtjure has quit IRC05:04
openstackgerritMerged openstack-infra/project-config master: Add success message for check pipeline  https://review.openstack.org/51487005:04
*** janki has joined #openstack-infra05:05
*** iyamahat has quit IRC05:06
*** ykarel|away has quit IRC05:06
*** jaosorior has quit IRC05:07
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Newton removal: zuul.d/jobs.yaml  https://review.openstack.org/51490905:07
*** iyamahat has joined #openstack-infra05:09
*** rtjure has joined #openstack-infra05:10
openstackgerritTomasz Trębski proposed openstack-infra/project-config master: Remove legacy job for monasca  https://review.openstack.org/51372205:11
*** LindaWang has quit IRC05:12
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Newton removal: Remove periodic-newton  https://review.openstack.org/51491005:12
*** LindaWang has joined #openstack-infra05:13
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Create job-output.txt together with JobDir  https://review.openstack.org/51461705:13
*** rtjure has quit IRC05:15
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Newton removal: Remove periodic-newton  https://review.openstack.org/51491105:15
*** dhajare has joined #openstack-infra05:15
openstackgerritRico Lin proposed openstack-infra/project-config master: Remove legacy jobs from heat  https://review.openstack.org/50919405:16
*** salv-orlando has joined #openstack-infra05:18
*** slaweq has quit IRC05:19
*** rtjure has joined #openstack-infra05:20
*** ykarel|away has joined #openstack-infra05:23
*** jaosorior has joined #openstack-infra05:23
*** rtjure has quit IRC05:24
*** slaweq has joined #openstack-infra05:26
AJaegerconfig-core, please review my newton cleanup changes https://review.openstack.org/#/q/status:open+topic:newton-eol05:26
*** rtjure has joined #openstack-infra05:30
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Newton removal: Remove some stable/newton  https://review.openstack.org/51491505:31
*** gongysh has quit IRC05:31
chandankumarAJaeger: please have a look https://review.openstack.org/#/c/514269/ i want to make this job failing05:32
*** armaan has joined #openstack-infra05:32
*** cloudnull has quit IRC05:32
*** eglute has quit IRC05:33
*** cshastri has joined #openstack-infra05:33
*** eglute has joined #openstack-infra05:34
AJaegerchandankumar: sorry, can't help this morning ;(05:34
*** cloudnull has joined #openstack-infra05:34
*** rtjure has quit IRC05:35
*** tushar has joined #openstack-infra05:35
*** xinliang has joined #openstack-infra05:36
*** rtjure has joined #openstack-infra05:40
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Newton EOl: Remove trove legacy jobs  https://review.openstack.org/51491605:41
ianwAJaeger: I dunno, is it ceremonial?05:43
openstackgerritYAMAMOTO Takashi proposed openstack-infra/project-config master: tap-as-a-service: Use -horizon variant of templates  https://review.openstack.org/51491705:43
AJaegerianw: we tagged yesterday, so I added my +2A now on top of yours ;)05:44
AJaegerI rebased so often that I didn't want to be the 2nd reviewer ;)05:44
AJaegerthanks, ianw05:44
ianwthe end of a era :)05:44
AJaegerianw: yeah - and thansk for the end of another one - the big branch cleanup...05:45
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Newton-EOL: Remove trove legacy jobs  https://review.openstack.org/51491805:47
*** cloudnull has quit IRC05:48
*** cloudnull has joined #openstack-infra05:50
openstackgerritMerged openstack-infra/project-config master: Remove zuul v2 and jjb content  https://review.openstack.org/50718005:55
openstackgerritMerged openstack-infra/project-config master: Run pep8 everywhere  https://review.openstack.org/51395305:55
*** slaweq has quit IRC05:59
*** gongysh has joined #openstack-infra06:00
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Document executor/merger stats  https://review.openstack.org/51434306:02
*** armaan_ has joined #openstack-infra06:03
*** esberglu has joined #openstack-infra06:03
*** umbarkar has joined #openstack-infra06:04
*** tushar has quit IRC06:04
*** armaan has quit IRC06:04
*** armaan has joined #openstack-infra06:05
*** armaan_ has quit IRC06:06
*** kiennt26 has joined #openstack-infra06:07
*** gongysh has quit IRC06:07
*** slaweq has joined #openstack-infra06:07
*** esberglu has quit IRC06:07
*** alex_xu has quit IRC06:09
*** andreas_s has joined #openstack-infra06:11
*** Qiming has quit IRC06:11
*** yolanda_ has joined #openstack-infra06:12
*** vsaienk0 has joined #openstack-infra06:12
*** bhavik1 has joined #openstack-infra06:13
*** gouthamr has quit IRC06:14
*** alex_xu has joined #openstack-infra06:15
*** jchhatbar has joined #openstack-infra06:27
*** iyamahat has quit IRC06:29
*** janki has quit IRC06:29
*** tosky has joined #openstack-infra06:36
*** pcaruana has joined #openstack-infra06:39
*** csomerville has joined #openstack-infra06:40
*** yolanda_ has quit IRC06:40
*** slaweq has quit IRC06:40
*** ykarel|away is now known as ykarel06:40
*** umbarkar has quit IRC06:40
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql master: Switch to use stestr completely  https://review.openstack.org/51493306:41
openstackgerritDirk Mueller proposed openstack-dev/hacking master: Transition to flake8 2.6.x  https://review.openstack.org/51493406:42
*** cody-somerville has quit IRC06:43
*** dhinesh has quit IRC06:43
*** salv-orlando has quit IRC06:44
*** salv-orlando has joined #openstack-infra06:45
AJaeger#status log zuul v2/jenkins config has been removed from project-config06:45
openstackstatusAJaeger: finished logging06:45
*** jchhatbar is now known as janki06:47
*** salv-orlando has quit IRC06:49
*** slaweq has joined #openstack-infra06:49
*** salv-orlando has joined #openstack-infra06:49
*** florianf has joined #openstack-infra06:52
*** thorst has joined #openstack-infra06:53
*** ralonsoh has joined #openstack-infra06:53
*** tesseract has joined #openstack-infra06:54
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql master: Switch to use stestr completely  https://review.openstack.org/51493306:55
*** thorst has quit IRC06:57
*** gcb has joined #openstack-infra07:00
*** pgadiya has joined #openstack-infra07:02
*** gildub has quit IRC07:03
*** rossella_s has joined #openstack-infra07:06
*** jtomasek has joined #openstack-infra07:09
*** armax has quit IRC07:09
*** spectr has joined #openstack-infra07:13
*** esberglu has joined #openstack-infra07:16
tonybIs there an API (or similar to find all the jobs and templates associated with a project (like used to be in layout.yaml)  In not I guess I need to process project-config/zuul.d and $project/.zuul.yaml $project/.zuul.d anywheer else?07:17
openstackgerritJens Harbott (frickler) proposed openstack-infra/infra-manual master: Clarify which jobs belong in the project block  https://review.openstack.org/51319707:17
tonybIIUC openstack-zuul-jobs and zull-jobs are the definitions but the list of the jobs run will come from ^^07:18
*** esberglu has quit IRC07:21
*** slaweq has quit IRC07:21
*** Qiming has joined #openstack-infra07:21
*** slaweq has joined #openstack-infra07:23
*** Qiming has quit IRC07:26
*** Hal has joined #openstack-infra07:28
*** Hal is now known as Guest9778507:28
*** gongysh has joined #openstack-infra07:30
AJaegertonyb: list of jobs is $project/.zuul.yaml, $project/zuul.yaml, $project/zuul.d/* $project/.zuul.d AFAIK plus the jobs defined in openstack-zuul-jobs, project-config and zuul-jobs. Each of these repos can define new jobs and use them07:31
AJaegertonyb: list of jobs that run in a repo comes from only two places: The repo itself and project-config.07:32
vsaienk0AJaeger: please add to your review queue https://review.openstack.org/#/c/514596/ - don't launch ironic-python-agent legacy jobs. We are pretty close in landing https://review.openstack.org/#/c/51338007:33
AJaegerSo, rereading your question: Add the two other in-tree places and you're fine ;)07:33
AJaegervsaienk0: LGTM. Please push a change for openstack-zuul-jobs to remove them as well.07:36
AJaegerbbl07:37
*** andreas_s has quit IRC07:38
*** andreas_s has joined #openstack-infra07:39
mtreinishinfra-root: is there a reason zuul hsan't merged this: https://review.openstack.org/#/c/491827/ we've tried a few rechecks and it comes back with a +2 from the gate07:41
mtreinishbut never merges07:41
vsaienk0AJaeger: thanks will prepare a patch07:42
*** yolanda_ has joined #openstack-infra07:42
*** yolanda_ is now known as yolanda07:43
*** Qiming has joined #openstack-infra07:43
*** andreas_s has quit IRC07:44
*** dhinesh has joined #openstack-infra07:44
*** amoralej has joined #openstack-infra07:45
*** jpena has joined #openstack-infra07:46
*** slaweq_ has joined #openstack-infra07:48
*** dhinesh has quit IRC07:48
*** ethfci has quit IRC07:50
AJaegermtreinish: I suggest to rebase and +2A again, the parent is outdated (orange mark).07:51
*** salv-orlando has quit IRC07:51
*** salv-orlando has joined #openstack-infra07:52
mtreinishAJaeger: well it's not a super important change, and if it's exposing a potential bug in zuul do you think there is value in leaving it as is until that's figured out?07:52
mtreinishbecause it should be a clean rebase so there shouldn't be a merge conflict so I'd expect everything to just work07:53
*** ykarel is now known as ykarel|lunch07:53
openstackgerritAndreas Jaeger proposed openstack-infra/subunit2sql master: Update python3 versions in tox.ini envlist  https://review.openstack.org/49182707:53
*** andreas_s has joined #openstack-infra07:53
*** esberglu has joined #openstack-infra07:53
*** esberglu has quit IRC07:54
*** Goneri has joined #openstack-infra07:54
*** esberglu has joined #openstack-infra07:54
*** esberglu has quit IRC07:54
*** gmann is now known as gmann_afk07:54
*** slaweq has quit IRC07:56
*** Qiming has quit IRC07:56
*** salv-orlando has quit IRC07:56
*** gcb has quit IRC07:57
*** armaan has quit IRC07:59
*** ethfci has joined #openstack-infra08:00
*** armaan has joined #openstack-infra08:00
*** ccamacho has joined #openstack-infra08:00
*** martinkopec has joined #openstack-infra08:01
*** slaweq has joined #openstack-infra08:02
*** salv-orlando has joined #openstack-infra08:05
*** slaweq has quit IRC08:06
*** amoralej has left #openstack-infra08:07
*** amoralej has joined #openstack-infra08:08
amoralejhi, we are having some issues in CI jobs which seems to be related to how repos in PROJECTS are cloned in CI nodes08:08
amoralejit seems git remote does not longer exist in those repos08:09
amoralejdoes it make sense?08:09
*** martinkopec has quit IRC08:09
*** Qiming has joined #openstack-infra08:09
*** martinkopec has joined #openstack-infra08:10
*** ralonsoh has quit IRC08:11
*** ralonsoh has joined #openstack-infra08:13
*** Qiming has quit IRC08:14
*** thorst has joined #openstack-infra08:14
*** dbecker has joined #openstack-infra08:18
*** danpawlik has quit IRC08:18
*** ralonsoh has quit IRC08:18
*** danpawlik has joined #openstack-infra08:18
*** danpawlik has quit IRC08:18
*** danpawlik has joined #openstack-infra08:19
*** thorst has quit IRC08:19
*** bhavik1 has quit IRC08:19
*** bcafarel has quit IRC08:20
AJaegermtreinish: this would be a gerrit issue AFAIK, let's see whether it merges now08:20
*** namnh_ has joined #openstack-infra08:21
AJaegeramoralej: yes, that's correct. How is that causing you a problem?08:21
AJaegerthe checked out tree should have all the branches you need08:21
*** apevec has joined #openstack-infra08:21
amoralejwe use output of "git remote -v" in some jobs to get the name of the upstream repo08:22
amoralejwhich we need to build packages on the fly08:22
amoralejso probably we need to find other way08:22
openstackgerritTomasz Trębski proposed openstack-infra/project-config master: Enable documentation building for monascaclient  https://review.openstack.org/51495408:23
*** namnh has quit IRC08:23
openstackgerritTomasz Trębski proposed openstack-infra/project-config master: Enable documentation building for monascaclient  https://review.openstack.org/51495408:24
apevecamoralej, what did I miss?08:24
apevecok, I see on eavesdrop, no replies yet08:25
amoralejapevec, so the problem is that with zuulv3, when repos are cloned in ci servers, the git remote doesn't exist08:25
openstackgerritYaguo Zhou proposed openstack-infra/subunit2sql master: Replace DbMigrationError with DBMigrationError  https://review.openstack.org/50085808:25
*** ralonsoh has joined #openstack-infra08:25
amoralejand we use it in DLRN08:25
amoralejto figure out the name of the upstream repo08:25
amoralejAJaeger just confirmed that08:25
apevecjpena, ^ where is that, any other ideas?08:25
amoralejAJaeger, is there any configuration that can be used to change that behavior ?08:26
amoralejwe may use directory name08:26
apevecamoralej, but the other thing is why those puppet-* co-gated with tripleoci change, I'd like to understand that08:26
apevechttp://zuulv3.openstack.org/ gate queue tripleo looks very bad08:26
*** s-shiono has quit IRC08:26
amoralejapevec, zuul "magically" relates revies in gate pipeline08:26
jpenaapevec: it's in https://github.com/softwarefactory-project/DLRN/blob/master/scripts/build_rpm.sh#L101-L10508:27
amoralejs/reviews/reviews/08:27
apevecit's not magic08:27
amoraleji never understood that relations08:27
apevecIIUC it is co-gated when sharing gate jobs08:27
apevecso let's first understand how all those projects ended up in tripleo gate queue08:27
jpenaapevec: git remote -v is used to find the project name for puppet modules08:28
amoralejapevec, anyway we need to fix the issue with git remote also08:28
apevecjpena, aah, special case for puppet08:28
AJaegerapevec: if you have shared queue (check queue: paremeter in project-config), you share a queue. Also, if you have common jobs you're gating on.08:28
AJaegerjpena, apevec, apevec, I cannot help much right now, best to wait for rest of the team to discuss later.08:29
apevecAJaeger, thanks, we need to fix dlrn first08:29
apevecjpena, let's use dirname instead of remote?08:30
AJaegeramoralej: best explain later your exact use case, we might have other means to support that...08:30
amoralejok, thanks AJaeger08:30
*** eumel8 has joined #openstack-infra08:31
fricklerAJaeger: requirements gate failure because it seems to be referring to the now removed zuul/layout.yaml : http://logs.openstack.org/02/511202/9/gate/legacy-requirements-tox-validate-projects/38f987d/job-output.txt.gz#_2017-10-25_06_59_00_64078808:31
*** tosky has quit IRC08:31
eumel8morning08:31
fricklerconfig-core: ^^ I guess I'll propose a revert until that gets fixed08:31
openstackgerritJens Harbott (frickler) proposed openstack-infra/project-config master: Revert "Remove zuul v2 and jjb content"  https://review.openstack.org/51495708:33
*** lucas-afk is now known as lucasagomes08:34
*** electrofelix has joined #openstack-infra08:34
*** slaweq has joined #openstack-infra08:36
*** kjackal_ has joined #openstack-infra08:37
AJaegerfrickler: can't we fix the job?08:37
ianwfrickler: urgh, is it hard to fix?08:37
fricklernot sure, it is used in requirements/openstack_requirements/project_config.py, will have to look at how to get this data otherwise08:38
*** Qiming has joined #openstack-infra08:39
AJaegerfrickler: that one is broken anyhow, since we do not touch layout.yaml anymore.08:40
AJaegerfrickler: So, either fix in requirements - or make non-voting.08:40
AJaegerprometheanfire, dirk, any suggestions? ^08:40
AJaegerfrickler: the file needs to parse zuul.d/projects.yaml instead08:42
*** dingyichen has quit IRC08:43
*** Qiming has quit IRC08:44
fricklero.k., so make the job non-voting for now and then make it work with zuul v3 config seems like a sane approach08:44
*** dhinesh has joined #openstack-infra08:45
*** derekh has joined #openstack-infra08:46
openstackgerritJens Harbott (frickler) proposed openstack-infra/project-config master: Make legacy-requirements-tox-validate-projects non-voting until fixed  https://review.openstack.org/51495808:49
*** dhinesh has quit IRC08:49
AJaegerprometheanfire, dirk, tonyb ^08:50
fricklerwoa, that revert has so many lint errors it would have needed a force-merge anyway it seems :-/08:51
*** namnh has joined #openstack-infra08:51
*** Qiming has joined #openstack-infra08:52
AJaegerfrickler: the pep8 change merged after it, we would need to merge that as well08:52
AJaegerwe didn't lint those files before08:52
*** namnh_ has quit IRC08:53
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Check that zuul.d/projects.yaml is sorted  https://review.openstack.org/51406108:53
AJaegertrivial linter test for review, please ^08:53
*** ykarel|lunch is now known as ykarel08:56
*** Qiming has quit IRC08:56
*** Qiming has joined #openstack-infra08:56
*** tosky has joined #openstack-infra08:57
*** yamahata has quit IRC08:58
*** gildub has joined #openstack-infra08:58
*** rcernin has quit IRC08:59
*** Qiming has quit IRC09:01
*** yamamoto has quit IRC09:05
*** slaweq has quit IRC09:09
openstackgerritMerged openstack-infra/project-config master: Make legacy-requirements-tox-validate-projects non-voting until fixed  https://review.openstack.org/51495809:10
*** yamamoto has joined #openstack-infra09:12
jd_howdy!09:13
*** Qiming has joined #openstack-infra09:15
*** jascott1 has quit IRC09:15
*** jascott1 has joined #openstack-infra09:15
jd_question about zuul v3: in https://review.openstack.org/#/c/512700/ I remove the jobs ceilometer-tox-py27-mongodb and others, but Zuul complains about not finding the playbook, which is weird since I don't want those tests to run and I wonder where they are still referenced09:15
*** armaan has quit IRC09:16
*** armaan has joined #openstack-infra09:16
*** armaan has quit IRC09:16
*** vsaienk0 has quit IRC09:16
*** Qiming has quit IRC09:19
*** jpena is now known as jpena|off09:20
*** sdague has joined #openstack-infra09:20
*** jascott1 has quit IRC09:20
*** vsaienk0 has joined #openstack-infra09:21
*** jpena|off is now known as jpena09:21
*** slaweq has joined #openstack-infra09:21
openstackgerritIan Wienand proposed openstack-infra/release-tools master: Add some notes on eol_branch.sh  https://review.openstack.org/51484609:22
ianwjd_: that's interesting and i bet due to the way the changes are stacked09:35
eumel8hello yolanda, infra-core! We're still looking forward for a merge to move on Zanata upgrade: https://review.openstack.org/#/c/506795/09:35
*** rcarrill1 is now known as rcarrillocruz09:48
*** yamamoto has quit IRC09:49
*** rpittau_ has quit IRC09:49
jd_ianw: hmmm anything I can do to "fix" it?09:50
*** e0ne has joined #openstack-infra09:53
*** slaweq has quit IRC09:55
*** rossella_s has quit IRC09:57
*** slaweq has joined #openstack-infra10:02
openstackgerritJens Harbott (frickler) proposed openstack-infra/project-config master: Revert "Make legacy-requirements-tox-validate-projects non-voting until fixed"  https://review.openstack.org/51500710:03
toskyAJaeger: question about migrating jobs in-tree: sahara-dashboards has 3 jobs to be migrated; 2 of them are failing in project-config (so they would require a fix) but I have a working version in-tree10:03
toskyAJaeger: can I migrate only those 2 jobs, leaving the 3rd one still as legacy in project-config for now (I'm aiming at a clear conversion), or should just fix the 2 jobs in project-config and then do the migration in one shot?10:04
toskythe question is more: which of the two would you approve and which would you -2? :D10:04
AJaegertosky: I would say, let's be pragmatic: REmove the jobs first in project-config, then merge the change for sahara-dashboard10:05
AJaegertosky: we prefer the other order so that you have full coverage on testing but in this case it'S not worth it IMHO10:05
AJaegerSo, go ahead migrate those two jobs for now, and let'S do the 3rd later...10:05
toskyack, thanks10:06
*** cuongnv has quit IRC10:06
toskyI think I already said that, but I'm trying in general to not import converted jobs but to directly rewrite them natively10:06
toskybut it's taking a while :)10:07
*** kiennt26 has quit IRC10:07
AJaegertosky: recommendation is to import and then convert - but your call ;)10:09
*** Qiming has joined #openstack-infra10:09
toskyI know, and I will be do if I can't do in time, but I hope to finish before other people even start :)10:10
toskyfor example, the tempest jobs are stuck on the reviews for devstack-tempest10:10
toskya job which publish some artefacts is blocked by the proposed change to the way publishing works10:10
AJaegertosky: best ask the rest of team later for help ...10:11
toskyyep, already did - and commented on bug on andreaf's patches10:11
toskyI just had a pass on the native v3 sahara-scenario job, and now I have a question about multinode jobs (I see the logs for all services on both nodes)10:12
toskywhich should not probably happen10:12
toskyso I'm waiting to catch people10:12
*** andreas_s has quit IRC10:13
*** liujiong has quit IRC10:13
AJaegerunderstood10:13
*** udesale has quit IRC10:13
openstackgerritLuigi Toscano proposed openstack-infra/project-config master: sahara-dashboard: remove the migrated unittests  https://review.openstack.org/51501510:21
*** annp has quit IRC10:24
*** LindaWang has quit IRC10:27
openstackgerritLuigi Toscano proposed openstack-infra/openstack-zuul-jobs master: sahara-dashboard: remove the migrated unittests  https://review.openstack.org/51501910:30
*** salv-orlando has quit IRC10:32
*** salv-orlando has joined #openstack-infra10:33
*** andreas_s has joined #openstack-infra10:34
*** ldnunes has joined #openstack-infra10:35
*** slaweq has quit IRC10:36
*** pcaruana has quit IRC10:37
*** sree has quit IRC10:38
ianwjd_: sorry, i'd probably bring it up with jeblair.  since both patches touch the jobs: maybe there's something funny going on10:38
*** sree has joined #openstack-infra10:38
*** namnh has quit IRC10:38
*** slaweq has joined #openstack-infra10:39
*** gmann_afk is now known as gmann10:40
*** pbourke has quit IRC10:40
*** pbourke has joined #openstack-infra10:42
*** sree has quit IRC10:43
openstackgerritMerged openstack-infra/tripleo-ci master: Do not rely on openstack-puppet-modules in Queens and beyond  https://review.openstack.org/51278310:43
*** andreas_s has quit IRC10:45
*** priteau has joined #openstack-infra10:45
*** boden has joined #openstack-infra10:48
*** tpsilva has joined #openstack-infra10:49
*** yamamoto has joined #openstack-infra10:49
*** andreas_s has joined #openstack-infra10:51
*** nicolasbock has joined #openstack-infra10:55
*** andreas_s has quit IRC10:55
*** andreas_s has joined #openstack-infra10:55
fricklercool, merging the patch to remove the failing test seems to have changed https://review.openstack.org/511202 back from failing to passing in the gate queue without resubmitting.10:55
*** ramishra has quit IRC11:00
*** yamamoto has quit IRC11:01
*** dtantsur|afk is now known as dtantsur11:01
*** armaan has joined #openstack-infra11:02
*** sree has joined #openstack-infra11:02
*** pgadiya has quit IRC11:02
*** ramishra has joined #openstack-infra11:02
openstackgerritMerged openstack-infra/subunit2sql master: Update python3 versions in tox.ini envlist  https://review.openstack.org/49182711:03
*** verdurin_ is now known as verdurin11:05
*** huanxie has quit IRC11:05
odyssey4meAre there any project-config cores available to review https://review.openstack.org/514592 please. The legacy jobs aren't working, so we'd like to get them cleared out.11:07
*** sree has quit IRC11:07
odyssey4meWell, some are working, some are not - but we have replacements in play already - either merged or proposed... so it's time to clean up.11:07
*** stakeda has quit IRC11:07
*** huanxie has joined #openstack-infra11:08
*** pgadiya has joined #openstack-infra11:10
*** slaweq has quit IRC11:11
*** jkilpatr has quit IRC11:11
*** gildub has quit IRC11:12
*** LindaWang has joined #openstack-infra11:12
*** yamamoto has joined #openstack-infra11:14
*** armaan has quit IRC11:17
*** armaan has joined #openstack-infra11:17
*** dbecker has quit IRC11:19
*** yolanda has quit IRC11:19
*** lucasagomes is now known as lucas-hungry11:20
*** bobh has joined #openstack-infra11:20
*** thorst has joined #openstack-infra11:21
*** bobh has quit IRC11:23
*** slaweq has joined #openstack-infra11:23
*** thorst has quit IRC11:26
AJaegerodyssey4me: +311:26
odyssey4methanks AJaeger11:28
*** smatzek has joined #openstack-infra11:28
odyssey4meheh, and ianw :)11:28
odyssey4meMOAR WORKFLOW!11:28
AJaegerodyssey4me: you'll get the revert merged automatically now ;)11:29
odyssey4meAJaeger I'm not sure what you mean? Which revert?11:30
openstackgerritMerged openstack-infra/project-config master: Remove remaining legacy openstack-ansible jobs  https://review.openstack.org/51459211:30
*** dave-mccowan has joined #openstack-infra11:31
*** rossella_s has joined #openstack-infra11:33
*** bobh has joined #openstack-infra11:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/openstack-zuul-jobs master: Remove remaining legacy openstack-ansible tests  https://review.openstack.org/51263511:40
*** Guest97785 has quit IRC11:41
*** mkolesni has joined #openstack-infra11:42
*** wolverineav has joined #openstack-infra11:43
*** pcaruana has joined #openstack-infra11:43
mkolesnihowdy, does anyone know why 'recheck' doesnt kill the currently running zuul job?11:43
mkolesnii have one thats definitely going to fail and issued 'recheck' on the change, but it didnt seem to do anything11:44
mkolesnii remember in the old zuul it used to work like this11:44
*** mat128 has joined #openstack-infra11:45
*** bobh has quit IRC11:45
AJaegerodyssey4me: that was a lame joke11:46
AJaegermkolesni: it never did, you misrembered11:46
AJaegermkolesni: if you want to stop testing, push a new change up11:46
mkolesniAJaeger, i dont need to push a new change11:47
mkolesniAJaeger, i need to redcheck the existing one since it failed on something sporadic and now its waiting for the job to time out11:47
mkolesni*recheck11:47
*** huanxie has quit IRC11:48
*** sileht has quit IRC11:50
*** huanxie has joined #openstack-infra11:50
AJaegermkolesni: And recheck only works once it's finished, so you have to kill it otherwise like with a new change.11:50
*** sileht has joined #openstack-infra11:50
*** bobh has joined #openstack-infra11:52
mkolesniAJaeger, ok so can we make it a feature then?11:54
AJaegermkolesni: I'm the wrong person to ask for that...11:55
*** jkilpatr has joined #openstack-infra11:55
apevecmkolesni, you can upload dummy change in the commit msg?11:56
mkolesniapevec, i have a tree of chains of other changes depending on this one11:57
prometheanfireAJaeger: bug I can point to?11:59
fungiinfra-root: config-core: anyone else who cares... i'm afk the majority of today but will try to catch up a bit remotely around 1500z and am hoping to be home by 2100z to help out with whatever needs fixing at that point12:00
*** pgadiya has quit IRC12:00
*** jpena is now known as jpena|lunch12:01
*** yamamoto has quit IRC12:02
*** apevec has quit IRC12:02
*** sree has joined #openstack-infra12:02
*** dprince has joined #openstack-infra12:03
*** pcaruana has quit IRC12:03
*** pcaruana has joined #openstack-infra12:04
*** masuberu has joined #openstack-infra12:06
*** mat128_ has joined #openstack-infra12:06
*** sree has quit IRC12:06
odyssey4mejeblair mordred when you're in, I'd like to follow up on what's going on in https://review.openstack.org/513706 where, for some reason, the newton branch is being used instead of the review patch12:08
*** thorst has joined #openstack-infra12:08
prometheanfirefrickler: was there a bug created for the requirements non-voting change?12:09
*** masber has quit IRC12:09
*** pgadiya has joined #openstack-infra12:09
*** mat128 has quit IRC12:10
*** smatzek has quit IRC12:13
*** smatzek has joined #openstack-infra12:14
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test containers update  https://review.openstack.org/51117512:16
AJaegerprometheanfire: I doubt it. frickler noticed that it fails since it reads a Zuul v2 file that we just removed, you need changing it for v3. frickler has a fix for requiremetns repo up, see the depends-on in https://review.openstack.org/51500712:18
*** smatzek has quit IRC12:18
openstackgerritVasyl Saienko proposed openstack-infra/openstack-zuul-jobs master: Cleanup ironic-python-agent legacy jobs  https://review.openstack.org/51503912:19
AJaegerprometheanfire: so, please review 515007 and https://review.openstack.org/#/c/515005/ - and let's fix 515007 so that the test works again12:19
AJaegerfungi, safe travels!12:19
*** pgadiya has quit IRC12:21
*** rosmaita has joined #openstack-infra12:22
*** hemna_ has joined #openstack-infra12:23
*** lucas-hungry is now known as lucasagomes12:24
*** thorst_ has joined #openstack-infra12:24
*** sbezverk has joined #openstack-infra12:26
*** thorst has quit IRC12:26
*** rlandy has joined #openstack-infra12:27
openstackgerritDirk Mueller proposed openstack-infra/zuul-jobs master: Remove pep8/pyflakes  https://review.openstack.org/51504112:27
*** yolanda has joined #openstack-infra12:27
*** kiennt26 has joined #openstack-infra12:27
*** slaweq has quit IRC12:28
prometheanfireAJaeger: ok, looking at those two12:28
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Do late decoding of log stream buffer  https://review.openstack.org/51504312:28
openstackgerritVasyl Saienko proposed openstack-infra/openstack-zuul-jobs master: Cleanup ironic-python-agent legacy jobs  https://review.openstack.org/51503912:30
*** huanxie has quit IRC12:30
*** esberglu has joined #openstack-infra12:31
AJaegerthanks, prometheanfire12:32
*** edmondsw has joined #openstack-infra12:32
*** slaweq has joined #openstack-infra12:33
prometheanfirethe error in 515005 looks odd to me, but looking12:35
*** pgadiya has joined #openstack-infra12:35
*** edmondsw has quit IRC12:37
*** edmondsw has joined #openstack-infra12:37
*** trown|outtypewww is now known as trown12:38
AJaegerprometheanfire: looks like frickler renamed a function but missed a place12:39
fricklerAJaeger: prometheanfire: yeah, just pushed a new PS12:39
*** bobh has quit IRC12:39
prometheanfirefrickler: thanks12:41
*** armaan has quit IRC12:41
*** armaan has joined #openstack-infra12:41
*** pgadiya has quit IRC12:41
*** vsaienk0 has quit IRC12:41
*** danpawlik has quit IRC12:42
andreaftosky: sorry, travelling this week so slow progress there12:42
*** markvoelker has joined #openstack-infra12:43
toskyandreaf: np! Apart from the post-failure, my biggest question is why I can't make my regex selector work (no jobs found)12:43
*** danpawlik has joined #openstack-infra12:43
toskybut let's see when you are back12:43
openstackgerritBlair Bethwaite proposed openstack-infra/irc-meetings master: Convert Scientific from Working Group to Special Interest Group  https://review.openstack.org/51504712:44
*** vsaienk0 has joined #openstack-infra12:44
*** dbecker has joined #openstack-infra12:47
*** udesale has joined #openstack-infra12:48
*** esberglu has quit IRC12:49
*** mriedem has joined #openstack-infra12:50
*** Hal has joined #openstack-infra12:51
*** Hal is now known as Guest1259912:51
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Add a generic stage-artifacts role  https://review.openstack.org/50923312:52
*** LindaWang has quit IRC12:52
*** lindycoder has joined #openstack-infra12:53
*** LindaWang has joined #openstack-infra12:53
*** pgadiya has joined #openstack-infra12:53
*** vsaienk0 has quit IRC12:54
andreafmordred, jeblair: starting to rework my staging role to match mordred proposal in http://lists.openstack.org/pipermail/openstack-infra/2017-October/005606.html ->  https://review.openstack.org/50923312:55
andreaflet me know what you think - I'd like to get the patch series done and start merging the patches on tempest side then12:55
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Fix manual publishing  https://review.openstack.org/51505012:55
AJaegerconfig-core, please review ^ - seems the only remaining one with the problem12:56
*** pgadiya has quit IRC12:56
AJaegeryolanda: ^12:58
dmsimardAJaeger: ah, the good old trailing slash (or lack thereof) with rsync.13:01
dmsimardStill manages to confuses me after all these years13:01
dmsimardJust like I always manage to screw up "ln -s" between source and target13:01
dmsimardmy brain is not wired properly to use these commands right :)13:02
prometheanfireyou aren't the only one13:02
prometheanfireEVERY time I use ln I get it backwards13:02
*** yamamoto has joined #openstack-infra13:02
AJaegerdmsimard: yeah ;( Thanks for review!13:03
*** baoli has joined #openstack-infra13:03
dmsimardprometheanfire: happy to know I'm not an anomaly13:03
dmsimardprometheanfire: I've had someone tell me, "but, it's easy, it's source first then target" .. but then, depending from the perspective you look at it, these words are interchangeable :/13:03
openstackgerritMerged openstack-infra/project-config master: sahara-dashboard: remove the migrated unittests  https://review.openstack.org/51501513:06
*** bexelbie has joined #openstack-infra13:06
*** slaweq has quit IRC13:06
AJaegerdmsimard, yolanda , frickler, please review my newton cleanup changes as well https://review.openstack.org/#/q/status:open+topic:newton-eol - and https://review.openstack.org/51505013:06
*** camunoz has joined #openstack-infra13:06
dmsimardAJaeger: I'm behind on reviews, will try to catch up asap13:07
*** jcoufal has joined #openstack-infra13:07
*** jpena|lunch is now known as jpena13:08
AJaegerdmsimard: thanks13:09
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Add a generic stage-artifacts role  https://review.openstack.org/50923313:09
*** mat128_ has quit IRC13:09
*** vsaienk0 has joined #openstack-infra13:09
*** esberglu has joined #openstack-infra13:09
yolandaAJaeger, taking a look, as time permits. I have been on meetings this and last week13:10
toskydo changes to project-config takes few minutes to be applied (it was ~20 in v2 iirc?) or are they now applied immediately because they are directly re-read?13:10
openstackgerritMerged openstack-infra/project-config master: tap-as-a-service: Use -horizon variant of templates  https://review.openstack.org/51491713:10
openstackgerritMerged openstack-infra/project-config master: Remove legacy ironic-python-agent jobs  https://review.openstack.org/51459613:10
AJaegeryolanda: thanks! Thankfully the team has grown as well, so if you have no time, go back to your meetings ;)13:11
yolandayes, is good to see new people joining and reviewing :)13:11
*** yamamoto has quit IRC13:12
*** slaweq has joined #openstack-infra13:12
yolandaAJaeger, about indentation on https://review.openstack.org/#/c/514526/2/roles/revoke-sudo/tasks/main.yaml , on tags13:14
yolandathat looks basd13:14
yolandabad13:14
yolandais that done with some purpose?13:15
*** camunoz has quit IRC13:15
EmilienMpabelanger: quick question - is there a parameter in zuul that could make tripleo patches in *gate*  not dependent each others, unless they are in Depends-On (in that case, yes make them dependent)13:15
*** ykarel has quit IRC13:15
*** ykarel has joined #openstack-infra13:15
AJaegeryolanda: I'm an ansible novice - how should it be done instead?13:16
yolanda2 spaces after tags13:16
AJaegeryolanda: feel free to -1 and educate me13:16
yolandahttps://review.openstack.org/#/c/514526/2/roles/version-from-git/tasks/main.yaml is fine, 2 spaces there13:16
AJaegeryolanda: got it, will udpate13:17
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Silence ansible-lint  https://review.openstack.org/51452613:17
*** bobh has joined #openstack-infra13:17
AJaegeryolanda: better?13:17
yolandaok wanted to be sure if that was some ansible trick of some sort :)13:18
EmilienMAJaeger: when you have time this week, could you please help me on https://review.openstack.org/#/q/status:open+topic:tripleo/migrate-to-zuulv3 ? this is not urgent at all, it can even wait next week.13:18
AJaegerEmilienM: hope others can help as well...13:19
*** armaan has quit IRC13:20
EmilienMright13:20
*** armaan has joined #openstack-infra13:20
openstackgerritMerged openstack-infra/infra-manual master: Clarify which jobs belong in the project block  https://review.openstack.org/51319713:23
*** eharney has joined #openstack-infra13:24
*** eumel8 has quit IRC13:24
*** huanxie has joined #openstack-infra13:25
openstackgerritMerged openstack-infra/project-config master: Remove legacy job for monasca  https://review.openstack.org/51372213:27
*** camunoz has joined #openstack-infra13:28
AJaegerEmilienM: very brief review: You should import the playbooks as well - see the documentation on https://docs.openstack.org/infra/manual/zuulv3.html#howto-update-legacy-jobs13:31
EmilienMAJaeger: ok, I'll take a second look13:31
*** armaan has quit IRC13:32
AJaegerEmilienM: and rename all the jobs13:32
EmilienMok13:33
openstackgerritMerged openstack-infra/project-config master: Remove nodepool legacy jobs from project  https://review.openstack.org/51479913:36
*** dbecker has quit IRC13:37
*** kiennt26 has quit IRC13:38
*** dhajare has quit IRC13:40
openstackgerritMerged openstack-infra/tripleo-ci master: Fix space character for bash command  https://review.openstack.org/51343513:40
*** dhajare has joined #openstack-infra13:42
EmilienMdmsimard: quick question - is there a parameter in zuul that could make tripleo patches in *gate*  not dependent each others, unless they are in Depends-On (in that case, yes make them dependent)13:42
dmsimardEmilienM: you mean for co-gating in the queue ?13:43
EmilienMdmsimard: yeah13:43
EmilienMwe want our gate to stop resetting when a patch fails on top13:43
EmilienMat least find a solution13:43
dmsimardEmilienM: I have no idea, that'd be a question for infra-root13:43
openstackgerritMerged openstack-infra/project-config master: Change osc-plugin-jobs to openstackclient-plugin-jobs  https://review.openstack.org/51484913:44
*** slaweq has quit IRC13:44
dmsimardI'm not very familiar with how queues and co-gating works in the first place13:44
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove Oslo.log legacy job  https://review.openstack.org/51138513:44
AJaegerEmilienM: see https://review.openstack.org/51322213:44
AJaegerand  https://review.openstack.org/512140 - that's part of creating the queue13:45
*** yamahata has joined #openstack-infra13:45
EmilienMAJaeger: ok so what I asked is to removed this queue, correct?13:45
EmilienMremove*13:45
AJaegerEmilienM:  https://review.openstack.org/51214013:45
AJaegerEmilienM: yes, revert those changes ;)13:45
EmilienMyou would accept it?13:45
dmsimardEmilienM: you do what you want, we review that it doesn't break anything :P13:45
AJaegerEmilienM: Let's ask pabelanger , please13:46
EmilienMok13:46
EmilienMI'll prepare the patch though13:46
AJaegerEmilienM: best discuss further with him13:46
EmilienMyep13:46
*** sshnaidm is now known as sshnaidm|mtg13:46
openstackgerritDean Troyer proposed openstack/os-client-config master: Consume the osc-functional-devstack-tips job  https://review.openstack.org/51484713:47
openstackgerritMerged openstack-infra/project-config master: Run linters job instead of py27  https://review.openstack.org/51461013:48
openstackgerritMerged openstack-infra/project-config master: Fix manual publishing  https://review.openstack.org/51505013:48
openstackgerritMerged openstack-infra/irc-meetings master: Convert Scientific from Working Group to Special Interest Group  https://review.openstack.org/51504713:48
*** dhajare has quit IRC13:48
*** slaweq has joined #openstack-infra13:48
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: Remove usage of 'tripleo' gate queue  https://review.openstack.org/51507013:49
*** sbezverk has quit IRC13:50
*** andreas_s has quit IRC13:50
*** gus has quit IRC13:51
*** andreas_s has joined #openstack-infra13:51
EmilienMpabelanger: when you're up, please take a look at https://review.openstack.org/#/c/51507013:51
*** gus has joined #openstack-infra13:51
*** smatzek has joined #openstack-infra13:52
*** gridinv has quit IRC13:52
*** iyamahat has joined #openstack-infra13:53
openstackgerritTin Lam proposed openstack-infra/project-config master: Remove legacy jobs  https://review.openstack.org/51507213:53
*** armax has joined #openstack-infra13:53
*** smatzek has quit IRC13:53
*** smatzek has joined #openstack-infra13:54
*** smatzek has quit IRC13:54
*** bexelbie has quit IRC13:54
*** smatzek has joined #openstack-infra13:55
haleybclarkb: follow-up question on graphite stats.  is there a difference between something in stats.zuul vs stats_counts.zuul ?  or is one preferred ?13:55
*** huanxie has quit IRC13:55
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: remove legacy panko jobs  https://review.openstack.org/51243013:55
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in Tooz  https://review.openstack.org/51329613:55
openstackgerritMerged openstack-infra/project-config master: remove some debugging for release git clone  https://review.openstack.org/51472913:55
openstackgerritMerged openstack-infra/project-config master: add neutron to vmware-nsx releasenotes jobs  https://review.openstack.org/51463013:55
openstackgerritMerged openstack-infra/project-config master: Remove legacy oslo.db job  https://review.openstack.org/51141413:55
vsaienk0AJaeger:  yolanda please add to your review queue https://review.openstack.org/#/c/515039/ cleanup legacy ironic-python-agent jobs13:55
*** sree has joined #openstack-infra13:55
*** yamahata has quit IRC13:55
*** jkilpatr has quit IRC13:56
*** huanxie has joined #openstack-infra13:56
AJaegerinfra-root, please remove http://files.openstack.org/docs/publish-docs/ - the directory and content is wrong, fixed now with just merged 51505013:57
*** gmann is now known as gmann_afk13:58
*** sree has quit IRC14:00
openstackgerritDean Troyer proposed openstack-infra/project-config master: Remove legacy-osc-dsvm-functional* jobs  https://review.openstack.org/51507514:01
*** eharney has quit IRC14:04
*** andreas_s has quit IRC14:05
*** hongbin has joined #openstack-infra14:08
*** yamahata has joined #openstack-infra14:08
*** slaweq_ has quit IRC14:09
*** andreas_s has joined #openstack-infra14:11
*** iyamahat has quit IRC14:11
openstackgerritTin Lam proposed openstack-infra/project-config master: Change documentation job for OpenStack-Helm  https://review.openstack.org/51508014:11
*** andreas_s has quit IRC14:17
openstackgerritDean Troyer proposed openstack-infra/openstack-zuul-jobs master: Remove osc-dsvm-functional* jobs  https://review.openstack.org/51508814:19
*** rossella_s has quit IRC14:19
*** dbecker has joined #openstack-infra14:20
*** rbrndt has joined #openstack-infra14:20
*** salv-orlando has quit IRC14:21
*** slaweq has quit IRC14:21
*** salv-orlando has joined #openstack-infra14:22
*** mat128 has joined #openstack-infra14:23
*** pblaho has quit IRC14:24
jeblairodyssey4me: a fix for that stable branch problem has merged, but we need to restart the scheduler.  i'm planning to do that now.14:24
*** yamahata has quit IRC14:25
*** salv-orlando has quit IRC14:26
odyssey4mejeblair ah ok, thanks ! which review was it? I'm curious14:26
*** udesale has quit IRC14:26
flaper87is there some documentation on how I can re-use the jobs defined in a different repo? Say repo A has a .zuul.yml file in it with some jobs defined and some ansible roles. Is there a way for project B to use those jobs/roles?14:27
jeblairodyssey4me: Id1266a5d553f88d9354b259d523821a707d4ac9814:27
AJaegerflaper87: the jobs: Just do it!14:28
*** huanxie has quit IRC14:28
jeblairflaper87: nothing special, just add them to your project dfn.  :)14:28
*** slaweq has joined #openstack-infra14:28
odyssey4mejeblair ah yeah - saw that one, awesome - let me know when zuul's been bounced14:28
toskyflaper87: yes: something like: https://git.openstack.org/cgit/openstack/sahara-tests/tree/.zuul.yaml?id=b68cc677422ee7da6fda2a7c722bffca66b1a7fe#n5814:28
odyssey4me(please)14:28
*** yolanda has quit IRC14:28
AJaegerflaper87: http://git.openstack.org/cgit/openstack/security-doc/tree/.zuul.yaml reuses what'S in http://git.openstack.org/cgit/openstack/openstack-manuals/tree/.zuul.yaml14:28
*** pblaho has joined #openstack-infra14:29
*** udesale has joined #openstack-infra14:30
*** coolsvap has quit IRC14:31
*** fanzhang__ has joined #openstack-infra14:31
*** fanzhang has quit IRC14:32
*** huanxie has joined #openstack-infra14:33
*** dhill_ has quit IRC14:33
*** andreas_s has joined #openstack-infra14:34
*** apevec has joined #openstack-infra14:38
*** apevec has quit IRC14:38
*** apevec has joined #openstack-infra14:38
*** dhill_ has joined #openstack-infra14:38
openstackgerritTrevor McCasland proposed openstack-infra/subunit2sql master: Add subunit2sql CLI option to use non_subunit_name  https://review.openstack.org/50719214:40
*** ykarel_ has joined #openstack-infra14:40
*** jaypipes has joined #openstack-infra14:40
*** ykarel has quit IRC14:41
*** gouthamr has joined #openstack-infra14:41
*** sree has joined #openstack-infra14:42
jeblairandreaf: cool!  i left some comments on 50923314:43
*** andreas_s has quit IRC14:44
*** david-lyle has quit IRC14:44
johnsomStill looking for a +A on https://review.openstack.org/513781 to cut out the duplicate legacy gates for octavia.  Thanks.14:44
*** slaweq_ has joined #openstack-infra14:45
AJaegerjohnsom: +314:45
*** andreas_s has joined #openstack-infra14:45
johnsomThank you!14:45
*** sree has quit IRC14:47
*** dbecker has quit IRC14:50
*** andreas_s has quit IRC14:50
AJaegerdmsimard: could you remove your -1 from https://review.openstack.org/#/c/513785 - the change is fine as is.14:51
*** andreas_s has joined #openstack-infra14:52
*** david-lyle has joined #openstack-infra14:53
dmsimardAJaeger: sure, I suppose the change is correct even though you can't use a depends-on against project-config14:54
*** felipemonteiro_ has joined #openstack-infra14:54
dmsimardI guess it has for effect to ensure the patch does not merge until the project-config patch is merged but it also prevents gate jobs from running because zuul considers it an error14:54
AJaegerdmsimard: you can use it - to block the merge. Our documentation recommends to do it since we have no better way ;(14:54
dmsimardAJaeger: btw I meant to ask, does 'needed-by' really work ?14:54
AJaegerin this case it would not merge anyhow since the removed jobs are used.14:54
AJaegerdmsimard: just as pointer - you can click on it and follow the link. So, purely documentation14:55
*** yamahata has joined #openstack-infra14:55
flaper87AJaeger: jeblair tosky thanks14:55
*** eharney has joined #openstack-infra14:55
dmsimardAJaeger: ok, so it doesn't effectively do a "reverse depends-on"14:56
*** sbezverk has joined #openstack-infra14:56
*** ramishra has quit IRC14:56
AJaegerdmsimard: indeed, it does not enforce any order14:57
*** felipemonteiro__ has joined #openstack-infra14:57
*** ykarel_ has quit IRC14:57
jeblairi'm restarting the scheduler now14:57
*** lewo has quit IRC14:59
*** ykarel_ has joined #openstack-infra14:59
*** lewo has joined #openstack-infra14:59
dmsimardEmilienM: btw ^ needed-by14:59
EmilienMdmsimard: ok, good to know. Thanks!15:00
pabelangerEmilienM: AJaeger: You can move tripleo jobs into non-shared queue, but if those projects share the same code, it will be dangerous and broken code could land.15:00
*** felipemonteiro_ has quit IRC15:01
jeblairthey probably shared a queue under v2, right?15:01
pabelanger1yes15:01
*** ykarel_ is now known as ykarel15:01
EmilienMyes we did15:01
*** slaweq has quit IRC15:01
EmilienMpabelanger: can you please give me an example of risk?15:01
EmilienMI'm a bit confused on the why, sorry15:01
*** slaweq has joined #openstack-infra15:01
*** andreas_s has quit IRC15:01
jeblairscheduler restarted, changes are being re-enqueued now15:02
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Add a generic stage-artifacts role  https://review.openstack.org/50923315:02
dmsimardEmilienM: if tripleo-quickstart clones something from tripleo-ci and there's no explicit depends-on, it'll be tested without in-flight tripleo-ci code and things could break after the fact15:02
dmsimard(for example)15:03
EmilienMok now I understand15:03
clarkbEmilienM: dmsimard no there isnt as gating implies dependency due to needing a serliazed set of git commits15:03
EmilienMtrown: ^ fyi, it's usefult o knnow that15:03
pabelangerright15:03
*** andreas_s has joined #openstack-infra15:03
pabelangerits first code that lands wins, and could break everything behind it15:03
*** cshastri has quit IRC15:04
*** huanxie has quit IRC15:04
trownonly if we dont do explicit depends-on?15:04
*** gongysh has quit IRC15:05
pabelangerTBH, your better leaving triplo queue and making all votes non-voting15:05
andreafjeblair: thanks for your review - I replied to your comments15:05
andreafjeblair: I'm at osseu so I just put up the patch, I did not really manage to test it yet - but https://review.openstack.org/#/c/509272 should verify it15:06
jeblairnote that if you *do* use a depends-on but don't share a queue, the changes have to merge serially, so it could slow things down significantly.15:06
*** efried has left #openstack-infra15:06
*** martinkopec has quit IRC15:06
*** eumel8 has joined #openstack-infra15:07
jeblair(you can't test+merge changes in parallel that don't share a queue because the order isn't guaranteed)15:07
trownwell merging serially is actually what we are looking for... because right now the queue is so large that we cant get parallel to work at all15:07
jeblairtrown: serially is exactly what it's already doing in that case15:07
trownim confused15:08
*** psachin has quit IRC15:08
jeblairthe algorithm is O(1) best case and O(n) worst.15:08
*** martinkopec has joined #openstack-infra15:09
EmilienMpabelanger: non voting?15:13
*** andreas_s has quit IRC15:13
*** andreas_s has joined #openstack-infra15:15
robcresswellIs there a suggested base job for Neutron plugins? Just running tox-driven tests and required-projects is currently requirements, neutronclient and neutron. Wondered if there was a base job that includes these, as they are fairly standard for Neutron plugins :)15:15
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add a Python release job for API services  https://review.openstack.org/51485515:15
odyssey4mejeblair I see zuul's been restarted - are we happy to go ahead and check whether our log patch is doing the right things now?15:15
jeblairodyssey4me: yep!15:15
pabelangerEmilienM: non-voting jobs are not run in gate, so they cannot be kicked out and gate reset if they fail15:16
jeblairrobcresswell: i think rather than a custom job, there's a project-template that adds those.15:16
*** dhinesh has joined #openstack-infra15:16
*** martinkopec has quit IRC15:16
AJaegerrobcresswell, jeblair : The project-template only add neutron (requiremetns is there by default). If all repos need neutronclient as well, we could add it15:17
* robcresswell needs to learn how the templates work15:17
robcresswellI'll go read some more before I waste time - but thanks for the pointers jeblair AJaeger15:18
*** jascott1 has joined #openstack-infra15:18
EmilienMpabelanger: I don't think we want non votig jobs at this stage15:18
AJaegerrobcresswell: template is defined in openstack-infra/openstack-zuul-jobs/zuul.d/project-templates.yaml15:18
*** dhinesh has quit IRC15:21
jeblairhttps://docs.openstack.org/infra/openstack-zuul-jobs/project-templates.html#project_template-openstack-python-jobs-neutron is what i was thinking of15:21
*** jascott1 has quit IRC15:22
AJaegerexactly15:23
pabelangerI keep forgetting about those docs :) They look awesome15:23
*** Apoorva has joined #openstack-infra15:25
openstackgerritMerged openstack-infra/project-config master: Removes migrated legacy-octavia-*  https://review.openstack.org/51378115:25
pabelangerAJaeger: looking at 514526, I don't see where you updated .zuul.yaml and added openstack-zuul-jobs-linters.15:26
*** huanxie has joined #openstack-infra15:26
AJaegerpabelanger: I didn't update .zuul.yaml yet...15:29
AJaegerpabelanger: indeed, that would have been the solution to get dependency working15:29
*** slaweq has quit IRC15:29
*** sree has joined #openstack-infra15:29
AJaegerpabelanger: do you want to merge 514526 as is? And then fix the other problems?15:29
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Add a generic stage-artifacts role  https://review.openstack.org/50923315:30
andreafjeblair: this version is tested, it should work fine ^^^15:30
* AJaeger signs of for the day15:31
*** hemna_ has quit IRC15:31
*** andreas_s has quit IRC15:31
*** thiagolib has quit IRC15:32
*** LindaWang has quit IRC15:32
openstackgerritMerged openstack-infra/project-config master: Newton removal: Remove some stable/newton  https://review.openstack.org/51491515:34
*** sree has quit IRC15:34
*** thorst_ has quit IRC15:34
*** thorst has joined #openstack-infra15:35
*** andreas_s has joined #openstack-infra15:37
pabelangerinfra-root: EmilienM I've enqueue 513701 into the gate pipeline to help tripleo with gate reset issue.  It seems ansible 2.4 might be part of the issue15:38
*** slaweq has joined #openstack-infra15:39
*** thorst has quit IRC15:39
EmilienMpabelanger: thank you15:39
*** LindaWang has joined #openstack-infra15:42
*** LindaWang has quit IRC15:42
jeblairpabelanger: ++15:43
*** slaweq has quit IRC15:44
*** vhosakot has joined #openstack-infra15:45
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Use non-pypi for release instead of tarball-only  https://review.openstack.org/51486915:45
*** andreas_s has quit IRC15:46
*** smatzek_ has joined #openstack-infra15:46
*** rkukura has joined #openstack-infra15:46
jeblairfungi, dhellmann, smcginnis: i updated fungi's patch to address comments: https://review.openstack.org/51485515:47
jeblairfungi: you have a sec to give that a once over?15:48
jeblairpabelanger: ^ you too?15:48
fungijeblair: lgtm, thanks!15:48
smcginnisjeblair: Thanks!15:49
*** apevec_ has joined #openstack-infra15:49
*** pcaruana has quit IRC15:49
*** smatzek has quit IRC15:49
dhellmannjeblair : lgtm15:49
openstackgerritMerged openstack-infra/project-config master: Newton removal: Remove periodic-newton  https://review.openstack.org/51491015:50
*** apevec has quit IRC15:50
*** apevec_ is now known as apevec15:50
*** yamahata has quit IRC15:51
pabelangerjeblair: fungi: lgtm +315:51
fungiawesome15:52
fungiokay, disappearing back into a black hole again15:52
fungii should hopefully be back online around 21:00z15:52
frickleris it possible to have ansible look for roles in a directory named other than "roles"? I'm facing a clash with chef using that directory for the same purpose in openstack-chef-repo15:53
openstackgerritMerged openstack-infra/project-config master: Newton removal: zuul.d/jobs.yaml  https://review.openstack.org/51490915:53
pabelangerfrickler: ANSIBLE_ROLES_PATH variable15:55
jeblairfrickler, pabelanger: is this in the context of zuul?15:55
pabelangerjeblair: I am assuming no15:55
jeblairfrickler: if you are writing a role that isn't going to be used by anything other than the playbooks in that repo, you can put the roles adjacent to the playbooks.15:56
jeblairpabelanger: i'm assuming yes, since it was asked here and not #ansible :)15:56
*** huanxie has quit IRC15:57
fricklerjeblair: pabelanger: yes, I'm starting to build a native v3 job for openstack-chef-repo15:58
pabelangerYah, so in that case ANSIBLE_ROLES_PATH will not work :)15:59
*** salv-orlando has joined #openstack-infra16:00
fricklerjeblair: so "adjacent to the playbooks" means within the playbooks directory? I'm already having a toplevel dir "roles" in that repo filled with chef roles and I don't want to put ansible roles into it to avoid confusion16:00
jeblairfrickler: right.  if you have 'playbooks/foo.yaml' use a role 'bar', it can be in 'playbooks/roles/bar/...'16:00
fricklerjeblair: o.k., that should do, thx16:01
*** coolsvap has joined #openstack-infra16:01
jeblairfrickler: basically, if the role is meant to be shared outside the repo, then zuul assumes it's constructed as an ansible role repo.  there's a bit more info on the rationale here: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/config.html#attr-job.roles16:02
openstackgerritMerged openstack-infra/project-config master: Add a Python release job for API services  https://review.openstack.org/51485516:02
*** jascott1 has joined #openstack-infra16:02
jeblairfrickler: but if you're not using it outside of that repo, none of that applies16:02
*** hashar has joined #openstack-infra16:03
*** ijw has joined #openstack-infra16:05
*** apevec has quit IRC16:05
*** huanxie has joined #openstack-infra16:05
fricklerjeblair: I'll define the job within the same repo, but that job is then to be used also from all the cookbook repos16:05
jeblairfrickler: that should still work fine -- that playbook will still have it's private roles accessible16:06
*** jascott1 has quit IRC16:07
*** andreas_s has joined #openstack-infra16:07
*** jascott1 has joined #openstack-infra16:08
*** lindycoder has quit IRC16:08
*** bhavik1 has joined #openstack-infra16:08
*** janki has quit IRC16:09
*** andreas_s has quit IRC16:12
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-puppet-beaker-rspec from gate  https://review.openstack.org/51512116:12
*** andreas_s has joined #openstack-infra16:13
*** panda|rover|off is now known as panda|ruck16:15
openstackgerritMerged openstack-infra/project-config master: Use non-pypi for release instead of tarball-only  https://review.openstack.org/51486916:15
*** Rockyg has joined #openstack-infra16:15
*** dhinesh has joined #openstack-infra16:17
*** jschlueter has joined #openstack-infra16:17
*** andreas_s has quit IRC16:18
*** kuchi has quit IRC16:19
*** andreas_s has joined #openstack-infra16:19
*** erlon has quit IRC16:20
*** dhinesh has quit IRC16:21
*** e0ne has quit IRC16:21
*** vsaienk0 has quit IRC16:21
openstackgerritDan Prince proposed openstack-infra/openstack-zuul-jobs master: Make tripleo undercloud-containers voting  https://review.openstack.org/51316316:23
*** ykarel has quit IRC16:23
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Create job-output.txt together with JobDir  https://review.openstack.org/51461716:24
*** kuchi has joined #openstack-infra16:24
*** tesseract has quit IRC16:25
*** iyamahat has joined #openstack-infra16:26
*** thorst has joined #openstack-infra16:27
jschlueterpabelanger: so to rephrase what I was saying ... it might be interesting to see if min queue size can be dropped below min-threshold if you get X queue resets in a row at min size ... where X is probably 10 times the queue size, but then it can grow as normal afterwards16:27
*** trown is now known as trown|lunch16:27
*** andreas_s has quit IRC16:28
pabelangerjschlueter: might be worth discussing it with jeblair16:29
*** armaan has joined #openstack-infra16:29
jeblairjschlueter, pabelanger: is dependent queue window size the topic?16:29
jschlueterone downside is that this could allow a patch which causes a flapping test to get through easier16:29
*** andreas_s has joined #openstack-infra16:30
jschlueterjeblair: yea16:30
jeblairclarkb: ping (clarkb wrote most of this code)16:30
jschlueterjust brainstorming on my side because of tripleo's current issue ...16:30
jeblairjschlueter: well, the changes are tested the same regardless of the window size16:30
jeblairjschlueter: a smaller window size basically just lets the system "waste" less resources on changes that are statistically unlikely to be used.16:31
jschlueteryep but queue resets can throw off being able to get a linch-pin patch to land16:31
*** erlon has joined #openstack-infra16:32
*** daidv has quit IRC16:32
pabelangerI think wasting of resources was one of the topics at PTG, we found that when tripleo gets into a high gate reset state, they do start consuming more resources16:32
jschlueterjust an idea ... queue min size => default size can grow when successful passes, and in bad cases (where many queue resets in a row) allow for it to shrink below min size a bit more to limit how much is tested together16:32
jeblairjschlueter: every change is individually tested, so once that linch-pin patch gets to the top, it has an opportunity to demonstrate that it works, regardless of what has come ahead of it or what's behind it.16:32
*** Goneri has quit IRC16:33
jeblairjschlueter: the window size grows when patches land, and shrinks when the gate resets.  the minimum is hand-tuned by the admins (us) so that we don't lose all parallelism, even when things get bad.  otherwise we would degrade to serial testing very quickly16:34
*** jpena is now known as jpena|brb16:34
jschlueteryep... but then also the flapping test can throw a monkey wrench in the works if the one out of 5 runs it fails is the one where that patch was top of the list16:34
jschlueterjeblair: yep16:34
jeblairjschlueter: right, but the window size won't have an effect on that16:34
jschlueterok tell me more...16:35
* jschlueter not seeing enough of the picture then16:35
jeblairjschlueter: the window size is how many changes behind the change currently at the head of the queue should also be tested.  basically, it's the degree of parellism.16:35
*** udesale has quit IRC16:35
jeblairjschlueter: but ultimately, the process works as if each patch was tested individually.16:36
jschlueterjeblair: ok how is the head of the queue picked?16:36
*** huanxie has quit IRC16:36
jeblairjschlueter: every patch becomes the head of the queue in series.  the order is determined by approval order of changes.16:36
jeblairjschlueter: this is not a batch system.  this is a serial system that operates in parallel for speed.16:36
jschlueterif I have patch queue size of 3 and pending patch set of 40 ...16:36
*** gyee has joined #openstack-infra16:37
jschlueterfirst in first tested?16:37
jeblairhere are the docs, btw... it has some examples that may be helpful: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/gating.html#project-gating16:37
jeblairjschlueter: yep16:37
jschlueterjeblair: ack thanks /me goes to read more16:37
*** lucasagomes is now known as lucas-afk16:38
openstackgerritMerged openstack-infra/zuul-jobs master: Silence ansible-lint  https://review.openstack.org/51452616:39
*** andreas_s has quit IRC16:39
clarkbjeblair: hi, currebtly getting a tooth checked out. ehats up?16:39
jschlueterand when a patch fails while in the check queue ... it get's dropped out and added to end of list or excluded? until external influnce?16:39
jeblairclarkb: not urgent; just wanted to bring this conversation to your attention if you're interested.  it can wait.  :)16:39
*** sshnaidm|mtg is now known as sshnaidm16:40
jschlueterjeblair: I see dropped from queue16:40
*** andreas_s has joined #openstack-infra16:40
jeblairjschlueter: the 'queue' aspect of check is less important.  all changes are treated independently there.  the order only matters in that zuul will assign nodes in the order changes arrive there.16:41
jeblairjschlueter: the gate pipeline is where most of this really comes into play.16:41
*** iyamahat has quit IRC16:43
*** iyamahat has joined #openstack-infra16:43
*** Goneri has joined #openstack-infra16:44
*** hashar is now known as hasharAway16:45
*** Swami has joined #openstack-infra16:48
*** andreas_s has quit IRC16:49
bodenhi.. I found for the vmware-nsx project’s release notes build we are getting an old version of reno and thus failing http://logs.openstack.org/10/513510/11/check/build-openstack-releasenotes/9487aeb/job-output.txt.gz#_2017-10-25_15_39_29_327289  I see neutrons is much newer in http://logs.openstack.org/83/511983/11/check/build-openstack-releasenotes/4b0910a/job-output.txt.gz#_2017-10-24_19_01_58_44634016:51
bodencould this be because we dont use the release-notes-jobs template for vmware-nsx?16:51
*** andreas_s has joined #openstack-infra16:51
*** claudiub|2 has quit IRC16:52
*** andreas_s has quit IRC16:55
jschlueterjeblair, pabelanger: thanks for the info ... will have to read what's there and think some more16:56
*** derekh has quit IRC16:56
*** ccamacho has left #openstack-infra16:57
*** ccamacho has quit IRC16:57
*** ralonsoh has quit IRC16:57
*** panda|ruck is now known as panda|ruck|bbl16:58
*** baoli has quit IRC16:58
jeblairjschlueter: you're welcome, thansk for reading!16:58
jeblairjschlueter: let me know if there's anything i can clarify16:59
openstackgerritboden proposed openstack-infra/project-config master: add neutron release notes job template to vmware-nsx  https://review.openstack.org/51513616:59
* jschlueter nods to jeblair 16:59
*** baoli has joined #openstack-infra16:59
jeblairboden: you think it's relying on neutron to bring in the updated version of reno?17:01
*** dtantsur is now known as dtantsur|afk17:01
bodenjeblair: I suspect thats part of the template, but frankly I’m not sure.. I was using the patch I just pushed to get some input17:02
jeblairboden: hrm, neutron has the same reno requirement.  i would expect upper-constraints to determine what gets installed.17:03
bodenjeblair: in that case I’m a bit clueless17:04
*** ijw has quit IRC17:04
*** dhinesh has joined #openstack-infra17:04
bodenlimping along just trying to get things back to running with our gate jobs :)17:04
jeblairboden: oh i don't think that's the version of reno17:04
bodenjeblair is it the version for release notes?17:05
bodento generate I mean17:05
jeblairboden: i think that's meant to be the version of vmware-nsx that reno is backtracking to...17:06
*** lindycoder has joined #openstack-infra17:06
bodenjeblair: ack that very well could be, but either way the failure in vmware-nsx never happened with zuul v2 and based on the error it “seems” to indicate something changed with builder17:06
jeblairdhellmann: ^ can you shed some light on http://logs.openstack.org/10/513510/11/check/build-openstack-releasenotes/9487aeb/job-output.txt.gz#_2017-10-25_15_39_29_327289  ?17:07
bodennothing changed with our release notes and they built with zuul v2 jobs17:07
*** ijw has joined #openstack-infra17:07
dhellmannjeblair , boden : looking17:07
*** camunoz has quit IRC17:08
*** rkukura has quit IRC17:08
AJaegerboden: this should not make any kind of change - and you use a template that publishes to docs.o.o so cannot be used by your repo17:08
dhellmannjeblair, boden : it looks like a mis-formatted release notes file. Does the build work locally ?17:08
*** ijw has quit IRC17:12
*** huanxie has joined #openstack-infra17:13
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add log streaming logging and exception handling  https://review.openstack.org/51381117:16
bodendhellmann: I guess not, tho I was under the impression it used to build.. what are other non-stadium projects doing W/R/T to release notes in the gate? nothing?17:16
bodenI’m wondering if we even need this job17:16
dhellmannboden : I'm not sure this is in any way related to the stadium-ness of the project. I'm running the build locally to see if I can identify the bad file, but I have to step out for a few minutes. I should be back in ~3017:17
*** hemna_ has joined #openstack-infra17:17
toskyjeblair: hi! Previously we used to define DEVSTACK_SUBNODE_CONFIG=" " for multinode jobs in order to run the full devstack only on the primary node; what should I do now for a multinode devstack job?17:17
*** rbrndt has quit IRC17:17
bodendhellmann: np: I see the file it’s unhappy about… I’m trying to understand if we even need a releasenotes job.. I guess I’ll have to dig into what that job does17:18
clarkbjschlueter: jeblair pabelanger the reason we kept a min queue size was we are basically always at the min queue size17:20
clarkbI'd expect that if we allowed it to drop to 1 we would spend a significant amount of time there (which maybe that is a good thing)17:21
*** smatzek_ is now known as smatzek17:21
pabelangerYah, 1 might be too low, but I could maybe see 10 in the case of tripleo17:23
clarkbalso keep in mind the jobs in that pipeline are expected to pass17:23
*** dmsimard is now known as dmsimard|afk17:23
clarkbso I think optimizing for the expectation that they won't is the wrong tactic17:24
pabelangerbut, would only result in less wasted resources i believe17:24
pabelangerclarkb: completely agree17:24
pabelangerfirst steps should be to make jobs less flappy, what ever is the cause of that is17:24
pabelangerwindow size changes, won't fix that17:24
clarkbdid fungi's tarball signing changes make it in?17:25
* clarkb goes looking17:25
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add project-template for functional tips jobs  https://review.openstack.org/51514317:28
*** vhosakot_ has joined #openstack-infra17:28
openstackgerritMonty Taylor proposed openstack/os-client-config master: Add shade-functional-tips jobs  https://review.openstack.org/51406717:29
clarkblooks like https://review.openstack.org/#/c/514856/2/zuul.d/project-templates.yaml is the last piece needed to fix tarball signing. I've rechecked it as it depends on a project-config change that merged17:29
*** vhosako__ has joined #openstack-infra17:29
*** bhavik1 has quit IRC17:29
*** camunoz has joined #openstack-infra17:30
openstackgerritboden proposed openstack-infra/project-config master: remove release notes jobs from vmware-nsx  https://review.openstack.org/51513617:30
*** bobh has quit IRC17:30
*** vhosakot has quit IRC17:30
clarkbcan I get a second config-core reviewer on 514856? it is queued into check which I think means it passes the syntax checking and all that config loading17:31
pabelangerlooking17:32
*** lindycoder_ has joined #openstack-infra17:32
clarkbwith that in we can knock an item off the issues etherpad17:32
bodenBTW AJaeger, we are still having some issues with the vmware-nsx stable branch builds… I added it to the issues needing triage (https://etherpad.openstack.org/p/zuulv3-issues) as I’m unsure how to proceed ATM17:32
*** lindycoder has quit IRC17:32
pabelangerclarkb: +317:33
*** vhosakot_ has quit IRC17:33
clarkbpabelanger: tyty17:33
clarkbjeblair: dhellmann: I'm going to remove the release py35 job irrelevant files issue from the issues with jobs list as we understand that problem and have a general plan for addressing it (so I think we can just address that generally rather than targeted fixing)17:33
mordredjeblair, clarkb, pabelanger, tonyb: I'm not 100% here ... but https://review.openstack.org/#/c/514058/ is worth looking at - it's a followup to the constraints patch from jeblair that landed and allows removing tox_install.sh from projects (although there is still another issue for neutron/horizon projects)17:34
*** trown|lunch is now known as trown17:34
mordredhttps://review.openstack.org/#/c/508061/ is a shade patch removing tox_install.sh for proving that it dtrt17:34
mordredit's also worth noting that it adds collecting the generated/edited requirements and constraints files into the logs: http://logs.openstack.org/61/508061/6/check/shade-tox-py35-tips/7eab935/shade/17:36
mordred(although we might want to change the name of the dir into which it goes)17:36
jeblairmordred: we're not running tox-siblings everywhere yet, right?17:37
openstackgerritMonty Taylor proposed openstack-infra/shade master: Avoid tox_install.sh for constraints support  https://review.openstack.org/50806117:38
mordredjeblair: I think we merged the patch to re-enable it17:38
jeblairoh, i thought we were waiting for the release to finish17:38
*** Goneri has quit IRC17:38
jeblairmordred: question on 51405817:38
clarkbjeblair: you wanted to discuss https://review.openstack.org/#/c/512408/ more, https://review.openstack.org/#/c/512653/ has been pushed as an alternative (this is the tox + sudo thing)17:38
mordredjeblair: yah - https://review.openstack.org/#/c/513199 was merged - there'sa comment fromyou on it saying it was safe to merge now17:39
mordredjeblair: looking17:39
*** rkukura has joined #openstack-infra17:39
openstackgerritTin Lam proposed openstack-infra/project-config master: Remove legacy jobs  https://review.openstack.org/51507217:40
*** rwsu has quit IRC17:40
*** lindycoder__ has joined #openstack-infra17:41
mordredjeblair: responded - but tl;dr for other folks, that's in support of https://review.openstack.org/#/c/508694/ - update to PTI about how we build docs17:41
jeblairmordred: oh wow, i misparsed a diff between ps4 and ps5.  i should not have merged https://review.openstack.org/51319917:42
mordredjeblair: I'll work on adding more general support for that when I get back from vacation if nobody has beaten me to it, but I figured might as well have this approach for siblings be aware of it17:42
jeblairer, approved.17:42
mordredjeblair: nod. should be easy enough to push up a fix to the defaults file if we want to re-disable - want me to make that patch real quick?17:43
jeblairi had not intended to re-enable that until after the release.  for some reason, i thought ps5 removed the re-enablement17:43
*** Goneri has joined #openstack-infra17:43
*** lindycoder_ has quit IRC17:44
*** huanxie has quit IRC17:44
jeblairmordred: yeah, that's probably the best solution so you can continue to work on this without making any surprises for the release team17:45
jeblairthough i do worry slightly that we might have grown an accidental dependence on it17:45
jeblair(if it works)17:46
mordredyah. I'm betting we'd have heard about it otherwise17:46
jeblairmordred: anyway, i think we should either hold off on your change or merge a disable-by-default patch first17:47
mordredjeblair: the new patch is testable via depends-on - perhaps we just find a bunch of representative projects and push up depends-on patches to it and e careful aboutlanding it17:47
jeblairmordred: sorry, after delaying the release by as much as we have, i'm *really* sensitive about doing anything else that might break things.  we're finally getting a handle on all the release jobs, we don't need to break any more.17:48
*** jpena|brb is now known as jpena17:48
mordredjeblair: and it's not urgent - it's in suport of being able to remove toxinstall.sh17:48
mordredjeblair: how about I mark it WIP for now17:49
jeblairmordred: wfm, thx17:49
*** Rockyg has quit IRC17:49
jeblairmordred: hopefully we'll be in the clear soon.17:49
mordredtonyb: if you get bored though - you may want to play with https://review.openstack.org/#/c/514058 via depends-on patches in the mean time17:49
*** tosky has quit IRC17:50
openstackgerritmelanie witt proposed openstack-infra/project-config master: Don't ignore nova/tests for the live-migration jobs  https://review.openstack.org/51515217:53
jeblairmordred: left one more comment on 51405817:53
mordredjeblair: oh. nice catch, thanks17:54
jschlueterclarkb: ack and then if a queue is constantly getting reset then that is an indicator of a flappy job somewhere17:54
AJaegerconfig-core, could I get a second +2A on https://review.openstack.org/514916 to remove some newton related jobs, please?17:54
openstackgerritmelanie witt proposed openstack-infra/project-config master: Don't ignore nova/tests for the live-migration jobs  https://review.openstack.org/51515217:55
*** salv-orlando has quit IRC17:55
*** salv-orlando has joined #openstack-infra17:56
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Have tox-siblings edit requirements files instead  https://review.openstack.org/51405817:56
*** electrofelix has quit IRC17:57
mriedemthis fixes a regression in the move to zuulv3 https://review.openstack.org/#/c/515152/ - pretty important for testing changes to the live-migration job itself which is run via a hook in the nova tree17:58
*** smatzek_ has joined #openstack-infra17:59
pabelangerinfra-root: do you mind looking at https://etherpad.openstack.org/p/zuulv2-removal for the next steps on zuulv2 removal of servers. We have 4 sections, delete, rebuild, build, rename. I'd like to start on delete this afternoon, if everybody is good18:00
*** salv-orlando has quit IRC18:00
pabelangerwe do have a question about nodepool.o.o / zookeeper future18:00
*** jascott1 has quit IRC18:01
*** smatzek has quit IRC18:02
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove ACLs for retired branches  https://review.openstack.org/51515318:03
*** e0ne has joined #openstack-infra18:03
*** jpena is now known as jpena|off18:06
*** Apoorva_ has joined #openstack-infra18:07
haleybclarkb: ping, have another question on graphite stats18:07
*** amoralej is now known as amoralej|off18:09
*** Apoorva has quit IRC18:10
clarkbhaleyb: ask away18:11
haleybclarkb: is there a difference between something in stats.zuul vs stats_counts.zuul ?  or is one preferred ?18:11
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug  https://review.openstack.org/51515718:13
*** baoli has quit IRC18:13
*** strigazi_ has joined #openstack-infra18:13
*** baoli has joined #openstack-infra18:13
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug  https://review.openstack.org/51515718:14
clarkbhaleyb: I think they have different data type18:15
*** strigazi has quit IRC18:16
clarkbstats_counts are counters and stats are gauges and timers?18:16
clarkbjeblair: ^ is that right?18:16
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Newton EOL: Remove some branch conditions  https://review.openstack.org/51516018:16
*** strigazi_ is now known as strigazi18:17
*** rbrndt has joined #openstack-infra18:17
haleybclarkb: if it's any help, our "old" grafana page used stats_counts, but i think yesterday i saw both as an answer to my question18:17
*** baoli has quit IRC18:18
*** slaweq has joined #openstack-infra18:19
haleybclarkb: by follow-up question is that what happens when a counter isn't there?  for example, existing page pulls a foo.FAILURE stat, but i don't see a .FAILURE for the new graphite entries18:19
clarkbhaleyb: I think we've always had both. You should use counts if you want raw incremented counters like how many failures are there aiui18:19
clarkbhaleyb: I think that implies there are no failures for that job (yet)18:19
openstackgerritMerged openstack-infra/project-config master: Newton EOl: Remove trove legacy jobs  https://review.openstack.org/51491618:20
openstackgerritMerged openstack-infra/project-config master: Don't ignore nova/tests for the live-migration jobs  https://review.openstack.org/51515218:20
haleybclarkb: thanks regarding stats_counts, will use that, and i guess i'm surprised of no failures, but could be18:20
*** Sukhdev has joined #openstack-infra18:21
*** tosky has joined #openstack-infra18:22
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Use a more thorough release for API servers  https://review.openstack.org/51485618:22
*** slaweq has quit IRC18:24
openstackgerritAnup Navare proposed openstack-infra/devstack-gate master: [Test] DNM Checking if tinyIPA builds with py3  https://review.openstack.org/50964118:25
*** Goneri has quit IRC18:25
clarkbhaleyb: you could cross reference against logstash maybe18:26
haleybclarkb: yeah, i might do that.  Perhaps these were always for gate jobs, which sometimes don't have as many failures18:27
inc0hey guys, so I'm fairly close to get publisher to work, jsut to confirm periodic pipelines will allow me to use secrets right?18:30
clarkbinc0: they should since the operate on merged code18:30
inc0is there any way for us to kick off periodic job before scheduled time just to see if it works?18:31
*** slaweq has joined #openstack-infra18:31
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove duplicate post-review key in pipelines  https://review.openstack.org/51516518:32
pabelangerclarkb: something I noticed in look at periodic pipeline^18:33
*** baoli has joined #openstack-infra18:33
clarkbinc0: I'm not sure if we can easily directly trigger periodic jobs18:34
clarkbjeblair: ^18:34
pabelangerclarkb: I had to enqueue them using zuul client in the past18:35
inc0yeah I'm just trying to figure out good workflow for developing gates with secrets18:35
inc0did you decide on this "allow secrets with one +2"?18:36
openstackgerritClark Boylan proposed openstack-infra/zuul feature/zuulv3: Support cgit urls on Gerrit connections  https://review.openstack.org/51516818:36
*** slaweq has quit IRC18:36
*** Goneri has joined #openstack-infra18:36
openstackgerritKrzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: [WIP] Allow autohold on specific changes  https://review.openstack.org/51516918:36
pabelangerinc0: not yet, but something we have discussed18:37
*** Sukhdev has quit IRC18:38
inc0another alternative would be to sed -i 's/<< contents of sectet >>/*redacted*/g18:38
inc0for all that jobs publishes at the end18:39
clarkbinc0: to be clear no gates (at least today) can use secrets18:39
inc0I know18:39
*** csomerville has quit IRC18:39
clarkbone thing you can do is run it locally using ansible18:39
*** csomerville has joined #openstack-infra18:39
clarkbthis won't check all the zuul specific things but should make you fairly confident in the playbooks/roles18:39
jeblaircatching up18:40
*** yolanda has joined #openstack-infra18:40
*** eharney has quit IRC18:40
inc0right, that's not ideal, but possible18:40
clarkbI think SamYaple developed them in post so they ran after merging18:41
clarkbyou could then move the job into periodic once happy with it18:41
clarkb(but depending on merge volume that could end up running a lot until you get there)18:41
jeblairhaleyb: agree with clarkb.  also, it's possible that zuulv3 stats are broken in some way, so do please investigate the lack of failures and let me know what you find.  a specific failed job that should have incremented a counter but didn't would be especially useful, for example.18:41
inc0well that still goes to merging untested code, but true it will give me feedback faster18:41
clarkbinc0: right by definition you can't get away from that18:42
clarkbbecause secrets cannot be used pre merge18:42
inc0yeah I know, I'm just thinking of some "fake" secret mechanism18:42
inc0I guess I can just add var: fake_secret and test on that18:43
pabelangeryou can mock your secrets today, but just adding them into vars section. Just don't use your real secret18:43
haleybjeblair: thanks, will do18:43
jeblairclarkb: i believe we should be able to enqueue a single project-branch into a periodic pipeline with 'zuul enqueue-ref'.  i have not tested that though.18:43
inc0right, but will allow me to test18:43
jeblairclarkb, inc0: you can use secrets in 'gate'.  just not check.18:44
*** rlandy is now known as rlandy|brb18:44
SamYapleclarkb: im doing them in post because i see no other way without actually adding a job that affects other projects gates18:44
jeblairthe key thing is pre-review is dangerous, not pre-merge per se18:44
openstackgerritBrian Haley proposed openstack-infra/project-config master: Fix neutron-failure-rate grafana dashboard  https://review.openstack.org/50929118:44
inc0SamYaple: what about periodic?18:44
*** catintheroof has joined #openstack-infra18:44
inc0I'll just mock it with vars and maybe even push to fake dockerhub account18:45
clarkbjeblair: I thought we weren't configured that way though?18:48
clarkbor did I misunderstand the talk of adding the run this pipeline after +2 thing18:48
jeblairclarkb: gate allows secrets (ie, has post-review: True)18:48
*** martinkopec has joined #openstack-infra18:48
jeblairclarkb: the run after +2 is more like check18:48
pabelangerjeblair: what reason would there be for a secret in gate? Since a job in check couldn't use the secret, it would never get a +2 from zuul to be enqueued into gate to run with secret. Unless job only ran in gate and not check18:49
*** wolverineav has quit IRC18:49
inc0so I think fake secret mock is acutally better - you're one mistake away from security breach18:49
clarkbjeblair: gotcha18:49
*** catintheroof has quit IRC18:49
inc0but consider this sed at the end of the gate too - just additional layer of protection18:49
*** wolverineav has joined #openstack-infra18:49
jeblairclarkb: it would be so you can run a job that uses secrets on a proposed change and examine the results before gating.  the +2 means you've verified it isn't a trojan change that exposes your secret.18:49
SamYapleinc0: i want to have new images more often than that for the purpose of gating18:50
*** wolverineav has quit IRC18:50
inc0allright, I'm fine with 24h18:50
haleybclarkb, jeblair: btw my infra change was ^^^ a few minutes ago, if you could take a look.  don't think i broke anything18:50
jeblairpabelanger: it would be for jobs that only run in gate and not check.  the pipeline i describe to clarkb above could improve that situation though.18:50
*** wolverineav has joined #openstack-infra18:50
*** catintheroof has joined #openstack-infra18:50
jeblairpabelanger: imagine for example if shade had a gate job that used mordred's cloud credentials to actually exercise public clouds.18:51
jeblairpabelanger: shade has lots of tests, so you'd be just as comfortable approving a change as you would be today, but you'd have the extra assurance that the gate would stop it from landing if it broke use with a certain public cloud.18:51
pabelangerjeblair: right, so it seems like something new we'd consider allowing. jobs only in gate. So far, I've always seen jobs both in check / gate or check only18:52
SamYapleinc0: right, kolla should be fine with 24h based on what you do. loci has different end goals18:52
openstackgerritClark Boylan proposed openstack-infra/zuul feature/zuulv3: Support cgit urls on Gerrit connections  https://review.openstack.org/51516818:52
SamYapleinc0: additionally, we will be building images on the release/tag pipelines so we have tagged images when, say, cinder tags a new version18:52
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Newton EOL: Remove some branch conditions  https://review.openstack.org/51516018:52
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Check that zuul.d/projects.yaml is sorted  https://review.openstack.org/51406118:55
*** salv-orlando has joined #openstack-infra18:55
inc0well here goes nothing, gate to push batch of images to fake account is out18:55
*** eharney has joined #openstack-infra18:55
jeblairAJaeger: wow!  zuul emitted a regex syntax error!  neat!  i've never seen that:  https://review.openstack.org/51516018:58
*** rbrndt has quit IRC19:00
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Newton EOL: Remove branches  https://review.openstack.org/51517719:03
*** rbrndt has joined #openstack-infra19:03
pabelangerjeblair: clarkb: I'm going to start deleting zl01-zl06 from rackspace and removal of DNS19:04
AJaegerjeblair: I was happy to see that ;)19:04
jeblairpabelanger: w00t!19:04
clarkbpabelanger: sounds good19:05
*** slaweq has joined #openstack-infra19:05
*** Apoorva_ has quit IRC19:06
*** Apoorva has joined #openstack-infra19:06
*** armax has quit IRC19:08
*** xarses has joined #openstack-infra19:08
*** trown is now known as trown|brb19:09
openstackgerritMerged openstack-infra/project-config master: Remove duplicate post-review key in pipelines  https://review.openstack.org/51516519:12
*** mummer has joined #openstack-infra19:16
EmilienMpabelanger: could we promote 513701 to gate for a last time please, just to give a last change to merge before we disable voting on the job19:19
*** trown|brb is now known as trown19:20
*** nikhil has joined #openstack-infra19:21
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Remove zuul-launcher support  https://review.openstack.org/51518119:21
pabelangerjeblair: clarkb:^ zuulv2-removal19:22
pabelangerEmilienM: why you know why it failed? I haven't looked at logs19:22
EmilienMpabelanger: it's an overcloud timeout, we might have a fix19:23
EmilienMpabelanger: https://review.openstack.org/#/c/515123/19:23
EmilienMpabelanger: but it's hard to debug when this problem happens19:23
pabelangerenqueued again19:25
EmilienMpabelanger: thx. If that fails again, then we'll disable voting19:25
pabelangeryah, sounds like there is a larger issue then the fix for 51370119:26
*** huanxie has joined #openstack-infra19:27
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Check that zuul.d/projects.yaml is sorted  https://review.openstack.org/51406119:30
pabelanger#status log zl01.o.o to zl06.o.o, zlstatic01.o.o have been deleted and DNS entries removed from rackspace.19:30
openstackstatuspabelanger: finished logging19:30
*** marst has joined #openstack-infra19:32
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Newton EOL: Remove periodic newton jobs  https://review.openstack.org/51518219:32
AJaegerone more periodic newton change - config-cores, please +2A ^19:32
*** salv-orlando has quit IRC19:33
*** salv-orlando has joined #openstack-infra19:35
*** iyamahat has quit IRC19:35
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Disable voting on 2 multinode tripleo jobs  https://review.openstack.org/51518319:35
EmilienMpabelanger: would that be enough to disable voting on these jobs? I didn't remove any job from gate, just disable voting. I'm sure I missed something19:36
pabelangerEmilienM: yes, you'll need to remove them from gate pipeline also, as they will still run19:37
pabelanger(and waste resources)19:37
*** vaidy has quit IRC19:37
*** isviridov_away has quit IRC19:37
*** rwsu has joined #openstack-infra19:38
EmilienMpabelanger: yeah ok let me find where again19:38
EmilienMin projcet-config ok19:38
pabelangerEmilienM: I've been trying not to use voting in job stanza, and just making changes in pipeline or template stanza. To limit files that get touched19:39
*** rlandy|brb is now known as rlandy19:40
*** armax has joined #openstack-infra19:42
EmilienMpabelanger: ok so I'll just patch projcet-config. Gotcha19:42
pabelanger++19:44
*** Goneri has quit IRC19:46
pabelangerAJaeger: clarkb: jeblair: what are our plans for infra-check? Think the pressure is off and we can move our projects that back into check now?19:47
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Create root ssh folder if not existing  https://review.openstack.org/51518519:48
*** coolsvap has quit IRC19:51
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test playbook with ansible debug  https://review.openstack.org/51515719:51
*** Goneri has joined #openstack-infra19:53
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: Disable voting on 2 multinode tripleo jobs  https://review.openstack.org/51518819:54
EmilienMpabelanger: ^ is it good?19:55
pabelangerlooking19:55
pabelanger+219:56
EmilienMwe'll see how it pass19:56
EmilienMthanks19:56
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test  https://review.openstack.org/51518919:58
*** huanxie has quit IRC19:58
*** Goneri has quit IRC20:01
EmilienMI swear to update my linkedin skills once we migrate tripleo to zuul v3 proper layout20:01
*** eharney has quit IRC20:01
*** iyamahat has joined #openstack-infra20:02
*** rbrndt has quit IRC20:04
*** edmondsw_ has joined #openstack-infra20:06
*** rbrndt has joined #openstack-infra20:06
EmilienMpabelanger: after some thoughts with tripleo folks, can we go ahead and land https://review.openstack.org/#/c/515188 please ? (just need approval)20:08
jeblairEmilienM: i'm looking at that one now20:09
*** edmondsw has quit IRC20:09
EmilienMthanks, very appreciated20:09
EmilienMjeblair: thx for the quick review20:11
jeblairnp20:12
jeblairpabelanger: i lean toward keeping infra-check for a bit longer.  project-config still sees a lot of churn.20:12
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Move test_model.test_job_inheritance_configloader  https://review.openstack.org/50949520:14
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove test_job_inheritance  https://review.openstack.org/50950920:14
pabelangerjeblair: wfm20:17
openstackgerritMerged openstack-infra/project-config master: Disable voting on 2 multinode tripleo jobs  https://review.openstack.org/51518820:19
*** smatzek_ has quit IRC20:21
*** rbrndt_ has joined #openstack-infra20:21
*** rbrndt has quit IRC20:22
*** smatzek has joined #openstack-infra20:22
*** ldnunes has quit IRC20:22
mriedemquestion about https://review.openstack.org/#/c/514685/20:24
mriedemit's been queued in the gate for 5.5 hours20:25
mriedempassed check a few times,20:25
mriedemdoes it need to be kicked out of the gate?20:25
pabelangermriedem: looks like the integrate queue has reset a few times today20:25
*** smatzek has quit IRC20:26
mriedempabelanger: so another recheck?20:27
*** thorst has quit IRC20:27
mriedemor should i +W again?20:27
*** e0ne_ has joined #openstack-infra20:27
pabelangermriedem: no, it is in gate pipeline, just behind 16 other patches20:28
pabelangerrecheck or +w won't help, in fact take it longer to merge20:28
mriedemok now i see it moving again20:28
pabelangerhttp://logs.openstack.org/83/500783/5/gate/openstack-tox-py35/69c885b/ failed for some reason, which is why the gate reset20:28
pabelangerso, should see why that is20:28
*** e0ne has quit IRC20:29
pabelangerlooks like requirements team has approve a few changes too, guess a busy day today20:30
jeblairyeah, the cinder test traceback here is interesting: http://logs.openstack.org/83/500783/5/gate/openstack-tox-py35/69c885b/job-output.txt.gz#_2017-10-25_19_31_02_40329420:30
dtroyerThe v3 devstack job in the devstack repo doesn't collect config files like v2 did, anyone know if that was intentional?  That seems like the right place to re-add it?20:30
mriedeminteresting as in super hard to read20:30
smcginnisjeblair: I've seen that before and I believe it was usually some kind of transient failure.20:31
jeblairdtroyer: it was not intentional!  yes we should re-add it.  i was going to start on some of that and then we switched and i became a firefighter.... let me see if i started anything...20:31
dtroyerjeblair: it looks like it should be easy enough for me to tackle if you haven't already20:32
jeblairdtroyer: looks like the little i have done landed in https://review.openstack.org/506744  (and did get copied over to devstack repo)20:34
jeblairdtroyer: also may be worth checking in with andreaf who was pursuing some general-purpose log collection routines20:34
jeblairdtroyer: https://review.openstack.org/509233 is related20:35
*** huanxie has joined #openstack-infra20:35
jeblairdtroyer: however -- those fancy new things should be upward compatible with anything we add now, so we don't need to wait for them.20:36
EmilienMpabelanger: is https://review.openstack.org/515204 enough to fix the zuul failure on https://review.openstack.org/#/c/515135 ?20:39
*** slaweq has quit IRC20:39
*** kjackal_ has quit IRC20:39
*** slaweq has joined #openstack-infra20:40
*** e0ne has joined #openstack-infra20:42
pabelangerEmilienM: no, I would read that as http://git.openstack.org/cgit/openstack/puppet-openstack-integration/tree/.zuul.yaml#n320 doesn't exist on stable/pike20:42
pabelangerzuul-executor couldn't find the playbook to run20:43
pabelangerI'm about to sit down for food, but can help when I return20:43
EmilienMpabelanger: shouldn'it failover on master?20:43
*** tristanC has quit IRC20:43
EmilienMmnaser: ^ you around?20:44
pabelangerEmilienM: no, depends on how your .zuul.yaml is setup. Does stable/pike have jobs defined too?20:44
*** slaweq has quit IRC20:44
EmilienMpabelanger: we have syntax on pike20:44
jeblairEmilienM: there was some confusion about this when we wrote the migration doc.  but i think what we need to do is to backport the jobs as well as playbooks to stable branches.20:44
EmilienMhttps://review.openstack.org/#/c/509202/20:45
jeblairEmilienM: it's a little extra work right now, but the next time we fork a stable branch from master, the right thing should just happen20:45
*** tristanC has joined #openstack-infra20:45
*** e0ne_ has quit IRC20:45
*** eumel8 has quit IRC20:46
*** spiffxp_ has joined #openstack-infra20:46
*** spiffxp has quit IRC20:46
pabelangeryah, I quick look shows the correct playbooks on pike. But I have to run now. I'll help after I eat20:47
EmilienMok thank you20:47
*** thorst has joined #openstack-infra20:48
*** thorst has quit IRC20:48
dtroyerjeblair: thanks.  I'm mostly after local.conf, was going to basically mimic the fetch-devstack-logs role20:48
jeblairEmilienM: where is puppet-openstack-syntax-4 defined?20:48
jeblairdtroyer: cool20:48
jeblairdtroyer: (or maybe just add to it?)20:49
*** thorst has joined #openstack-infra20:49
dtroyersure?  it isn't logs so I wasn't certain that would be kosher :)20:49
dtroyerbut it will go to the same place20:49
jeblairdtroyer: oh, fetch-devstack-log-dir copies everything in ~/logs back to the executor.  so you really just need something that copies local.conf into that location.20:50
dtroyerright20:51
*** masuberu has quit IRC20:51
jeblairyeah, that might best be added to a new role20:51
jeblairbut then you can throw any other log collection stuff in there20:51
tonybAJaeger: Thanks for confirming that re zuul job locations20:52
*** thorst has quit IRC20:53
EmilienMjeblair: in puppet-openstack-integration20:53
jeblairEmilienM: ah thanks.  found it.20:53
*** andreas_s has joined #openstack-infra20:54
*** edmondsw_ is now known as edmondsw20:55
*** yolanda has quit IRC20:56
*** sree has joined #openstack-infra20:58
tonybmordred: Thanks I have that open to look at but it keeps getting pre-empted :/20:58
*** rosmaita has quit IRC21:00
tonybmordred: bored? LOL but yeah I will play with it.  IIRC openstackclient was special with it constraints support so that'd be a good one.  There was another that had a bespoke solution ... Can't recall which though :/21:02
*** lindycoder__ has quit IRC21:02
EmilienMjeblair: I need to leave irc for a few hours but I'll catch-up - let me know what I should do or send a patch if you can. Thanks for your help anyway21:02
jeblairEmilienM: will do21:02
EmilienMthx again21:02
jeblairnp21:02
*** mummer has quit IRC21:02
*** sree has quit IRC21:03
*** andreas_s has quit IRC21:03
*** hemna_ has quit IRC21:03
*** mummer has joined #openstack-infra21:03
*** andreas_s has joined #openstack-infra21:05
*** huanxie has quit IRC21:06
*** hasharAway has quit IRC21:07
*** dmsimard|afk is now known as dmsimard21:08
dtroyerjeblair: simple config file role: https://review.openstack.org/51520921:09
*** andreas_s has quit IRC21:10
*** mummer has quit IRC21:10
*** andreas_s has joined #openstack-infra21:11
*** mat128 has quit IRC21:11
*** baoli has quit IRC21:13
*** mummer has joined #openstack-infra21:13
*** rcernin has joined #openstack-infra21:16
*** andreas_s has quit IRC21:16
openstackgerritIan Wienand proposed openstack-infra/project-config master: Move to dictionary list of projects zuul._projects (take 2)  https://review.openstack.org/51411721:16
*** andreas_s has joined #openstack-infra21:16
jeblairEmilienM, pabelanger: i think (though i'm not certain), that is a manifestation of one of the problems i described in http://lists.openstack.org/pipermail/openstack-infra/2017-October/005634.html21:17
jeblairEmilienM, pabelanger: i pushed up a patch to verify and reparented 515135 on it21:17
jeblairdtroyer: ++21:18
toskyjeblair: hi again: about my question on multinode devstack jobs without using devstack-gate...21:20
toskyhow do I make sure that a compute node is only a compute node without using DEVSTACK_SUBNODE_CONFIG=" "  ?21:21
*** dprince has quit IRC21:23
*** e0ne has quit IRC21:25
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364521:27
*** sbezverk has quit IRC21:27
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Newton EOL: Remove branches  https://review.openstack.org/51517721:29
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Newton-EOL: Remove trove legacy jobs  https://review.openstack.org/51491821:29
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove monasca legacy job  https://review.openstack.org/51425121:29
*** esberglu has quit IRC21:29
*** priteau has quit IRC21:30
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Cleanup ironic-python-agent legacy jobs  https://review.openstack.org/51503921:31
*** rosmaita has joined #openstack-infra21:33
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy nodepool job defs and playbooks  https://review.openstack.org/51432121:35
*** panda|ruck|bbl is now known as panda|ruck21:35
EmilienMjeblair: back21:35
EmilienMjeblair: ok thx, let's see21:35
EmilienMjeblair: do you want me to Depends-On your patch in my failing patch in puppet-tripleo?21:36
EmilienMoh you did21:36
EmilienMit's failing21:37
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Removes migrated legacy-octavia-*  https://review.openstack.org/51378521:38
*** boden has quit IRC21:38
jeblairtosky: i don't think we've done any multinode stuff with the new devstack jobs yet.  most or all of the pieces should be in place though -- the relevant roles should be in zuul-jobs or devstack repos.  i'd love to, though i can't help with that right now.  clarkb, pabelanger, dtroyer, and andreaf may be able to assist.  hopefully i can catch up later this week or next.21:42
*** jcoufal has quit IRC21:43
jeblairEmilienM: hrm, okay, i'm going to need to do some more intensive debugging then.  i'll WIP my poi change and remove the depends-on after i set all the executors to keep jobs.21:43
toskyjeblair: ack, thanks! I will recheck the open reviews and wait for some other hints21:43
*** esberglu has joined #openstack-infra21:43
clarkbjeblair: tosky ya we haven't gotten there but I imagine we'd supply a localrc for each of the nodes21:43
clarkband in the subnode(s) localrc you'd specify what services you want21:44
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: sahara-dashboard: remove the migrated unittests  https://review.openstack.org/51501921:44
jeblairinfra-root: i'm going to set 'keep' on all the executors21:44
EmilienMok21:44
jeblairEmilienM: done.  the next time it tries to run that job, i'll be able to inspect the git repo state it prepared21:45
EmilienMok21:45
*** iyamahat has quit IRC21:45
toskyclarkb: the basic idea is easy, but how to organize this configuration? Add a devstack_subnode: key indexed by the host/group with subkeys like devstack_localrc, devstack_services, etc?21:45
*** sree has joined #openstack-infra21:45
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Update README to reflect current status  https://review.openstack.org/51419521:46
*** andreas_s has quit IRC21:47
jeblairinfra-root: disabling keep21:47
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Run gerrit periodic on openstack/2.13 only  https://review.openstack.org/51412721:47
*** esberglu has quit IRC21:48
openstackgerritMerged openstack-infra/project-config master: Newton EOL: Remove some branch conditions  https://review.openstack.org/51516021:49
*** sree has quit IRC21:50
*** edmondsw has quit IRC21:51
*** wolverineav has quit IRC21:52
*** wolverineav has joined #openstack-infra21:52
*** andreas_s has joined #openstack-infra21:53
*** rwsu has quit IRC21:54
*** rwsu has joined #openstack-infra21:54
*** edmondsw has joined #openstack-infra21:56
*** sdague has quit IRC21:56
*** rwsu has quit IRC21:56
*** wolverineav has quit IRC21:57
*** andreas_s has quit IRC21:57
openstackgerritJeremy Stanley proposed openstack-infra/zuul feature/zuulv3: Default change and patchset to NULL in SQLReporter  https://review.openstack.org/51442321:58
*** marst has quit IRC21:58
*** owalsh has quit IRC22:00
*** owalsh has joined #openstack-infra22:00
*** kzaitsev_pi has quit IRC22:02
*** kzaitsev_pi has joined #openstack-infra22:04
*** edmondsw has quit IRC22:04
*** smatzek has joined #openstack-infra22:10
*** kzaitsev_pi has quit IRC22:11
EmilienMpabelanger: just a heads-up, https://review.openstack.org/513701 is merged which will help. We identified 2 other things that will stabilize our gate22:12
EmilienMjeblair: ^ as well22:12
EmilienMthank you folks, we have some good progress22:12
EmilienMwe also think that we have identified why we have so much timeouts, we did a patch and it's in gate now22:12
EmilienMwe'll see if that help over the next hours/days22:13
EmilienM(I found useful to share that with you, to see there is some little progress)22:13
*** kzaitsev_pi has joined #openstack-infra22:13
*** smatzek has quit IRC22:15
jeblairEmilienM: yay!22:15
jeblairEmilienM, pabelanger: i think i have identified the problem with the syntax-4 change22:15
jeblairer job22:15
EmilienMyay²22:15
jeblairEmilienM, pabelanger: briefly, there's a bug related to variants and inheritance on stable branches.  the variant of that job on the master branch is correctly picking up file matchers, but the variant on the stable branch is not.22:16
*** andreas_s has joined #openstack-infra22:17
jeblairEmilienM, pabelanger: the work i'm doing in that area should make this easy to fix when it's complete, but i don't think i can fix it in zuul before that work is complete.  i think having those fixes in production friday is a reasonable time estimate.22:18
*** catintheroof has quit IRC22:18
EmilienMjeblair: it's ok for me22:18
EmilienMjeblair: it's not critical for now to have my puppet-tripleo patches merged if we can fix it on Friday22:18
jeblairEmilienM, pabelanger: so the options i can think of are: a) wait until friday.  b) move tripleo configuration back into project-config (until friday).  c) copy a bunch of extra irrelevant-files matchers around to those jobs.22:19
EmilienMjeblair: a°22:19
EmilienMa)22:19
jeblairEmilienM: okay.  i think that would be best if we have time (everything else would be a temporary measure which just means more work)22:19
EmilienMyep22:19
jeblairi'll get back to to that now then.  thanks :)22:19
*** iyamahat has joined #openstack-infra22:20
EmilienMcool, thanks to *you*22:20
*** xinliang has quit IRC22:20
jeblairalso, thanks for pointing it out.  this is related, but it's also a new sub-case i didn't catch earlier.22:20
jeblair(i think i know how to add a test for it)22:21
EmilienMjeblair: I guess tripleo is here to make zuul even better :P even all our weirdness :)22:21
jeblairEmilienM: my hope is that the opposite will be true soon as well :)22:22
*** felipemonteiro__ has quit IRC22:24
*** andreas_s has quit IRC22:26
*** andreas_s has joined #openstack-infra22:28
*** iyamahat has quit IRC22:28
*** edmondsw has joined #openstack-infra22:28
*** edmondsw has quit IRC22:34
*** panda|ruck is now known as panda|ruck|off22:35
*** thorst has joined #openstack-infra22:35
tonybfrickler: Are you around?22:40
openstackgerritMerged openstack-infra/shade master: Add project-template for functional tips jobs  https://review.openstack.org/51514322:40
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364522:41
*** thorst has quit IRC22:42
*** felipemonteiro_ has joined #openstack-infra22:43
*** thorst has joined #openstack-infra22:43
*** andreas_s has quit IRC22:44
openstackgerritMerged openstack-infra/project-config master: Newton EOL: Remove periodic newton jobs  https://review.openstack.org/51518222:44
openstackgerritMerged openstack-infra/project-config master: Remove legacy jobs  https://review.openstack.org/51507222:44
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Copy Gerrit delay to GitHub driver  https://review.openstack.org/51522422:45
SpamapSjeblair: ^ copies over quite nicely I thik22:46
SpamapSthink even22:46
*** claudiub|2 has joined #openstack-infra22:46
*** thorst has quit IRC22:46
*** wolverineav has joined #openstack-infra22:48
*** martinkopec has quit IRC22:49
*** rbrndt_ has quit IRC22:50
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Add implied branch matchers on 'master'  https://review.openstack.org/51445922:51
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: experiment with late-binding inheritance  https://review.openstack.org/51135222:51
*** Sukhdev has joined #openstack-infra22:52
*** felipemonteiro_ has quit IRC22:53
jlvillalI've pushed two patches to openstack/ironic in the last 10 minutes, but 'openstackgerrit' did not announce either of them. Any ideas?22:55
jlvillalThis patch done twice: https://review.openstack.org/#/c/515225/22:56
*** tpsilva has quit IRC22:57
openstackgerritJeremy Stanley proposed openstack-infra/zuul feature/zuulv3: Default change and patchset to NULL in SQLReporter  https://review.openstack.org/51442322:58
ianwjlvillal: has it announced anything else?23:01
jlvillalianw: It did 30 minutes ago on a patch merging23:02
*** tosky has quit IRC23:02
jlvillalianw: And a few hours ago some proposed patches to openstack/ironic23:02
*** Sukhdev has quit IRC23:03
jlvillalianw: It just announced a merge23:03
*** xarses has quit IRC23:04
*** hongbin has quit IRC23:05
*** masuberu has joined #openstack-infra23:05
ianwit thinks it sent it23:05
ianwroot@review:/var/log/gerritbot# cat gerritbot.log | grep 515225 | grep Sending23:06
ianw2017-10-25 22:45:59,552 INFO gerritbot: Sending "John L. Villalovos proposed openstack/python-ironicclient master: Simplify logic for API version '1' and improve unit tests  https://review.openstack.org/515225" to #openstack-ironic23:06
ianw2017-10-25 22:55:05,400 INFO gerritbot: Sending "John L. Villalovos proposed openstack/python-ironicclient master: Simplify logic for API version '1' and improve unit tests  https://review.openstack.org/515225" to #openstack-ironic23:06
openstackgerritMerged openstack-infra/release-tools master: Add some notes on eol_branch.sh  https://review.openstack.org/51484623:06
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364523:07
*** andreas_s has joined #openstack-infra23:10
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/50364523:11
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: experiment with late-binding inheritance  https://review.openstack.org/51135223:13
*** vaidy has joined #openstack-infra23:14
*** isviridov_away has joined #openstack-infra23:14
jlvillalianw: Hmm. I never saw it on IRC23:15
clarkbit doesn't seem to be in the log either23:15
clarkbits possible that gerritbot was netsplit or effectively split?23:15
jlvillalianw: And I don't see it here: http://eavesdrop.openstack.org/irclogs/%23openstack-ironic/%23openstack-ironic.2017-10-25.log.html23:15
jlvillalI'll just assume it will start working again at some point :)23:15
jlvillalI'm going to push an update in a minute or so.23:16
jlvillalclarkb: netsplit sounds reasonable23:16
*** andreas_s has quit IRC23:21
*** gouthamr has quit IRC23:22
*** gouthamr has joined #openstack-infra23:22
*** andreas_s has joined #openstack-infra23:23
*** gridinv has joined #openstack-infra23:23
*** gmann_afk is now known as gmann23:25
dmsimardclarkb: hey, I'm curious.. how long does a typical log prune on logs.o.o take ? the massive find that deletes files and dirs.23:25
clarkbdmsimard: I think a few days23:25
dmsimardclarkb: oh, okay, I thought something was horribly wrong on our end -- I'm running a slightly modified version for the RDO logserver23:26
clarkbthat is why it only runs weekly23:26
dmsimardThe fact that it'd run daily would not hurt, right ? there's a lockfile23:26
*** yamahata has joined #openstack-infra23:27
clarkbya we could let the lock figure it out23:29
dmsimardI figured the file deletion was not necessary (and skip straight to directories) but then quickly understood why it was necessary :/23:29
jlvillalianw: clarkb: My latest push was announced. Thanks.23:31
*** andreas_s has quit IRC23:31
*** yamahata has quit IRC23:32
*** andreas_s has joined #openstack-infra23:33
openstackgerritMerged openstack-infra/project-config master: Remove ACLs for retired branches  https://review.openstack.org/51515323:35
openstackgerritMerged openstack-infra/project-config master: Change documentation job for OpenStack-Helm  https://review.openstack.org/51508023:36
pabelangerEmilienM: jeblair: great, glad we figured out the issue23:40
*** andreas_s has quit IRC23:43
openstackgerritK Jonathan Harker proposed openstack-infra/puppet-nodepool master: Make the secure.conf template configurable  https://review.openstack.org/51522823:43
openstackgerritMerged openstack-infra/project-config master: Check that zuul.d/projects.yaml is sorted  https://review.openstack.org/51406123:44
openstackgerritMerged openstack-infra/project-config master: remove release notes jobs from vmware-nsx  https://review.openstack.org/51513623:44
openstackgerritMerged openstack-infra/project-config master: avoid creating extra temporary directory in release job  https://review.openstack.org/51478723:44
openstackgerritMerged openstack-infra/project-config master: remove unused release-tools scripts  https://review.openstack.org/51481623:44
*** mriedem is now known as mriedem_away23:44
*** mriedem_away has quit IRC23:44
openstackgerritEric Kao proposed openstack-infra/irc-meetings master: Change Congress meeting time  https://review.openstack.org/51346723:45
*** andreas_s has joined #openstack-infra23:45
*** thorst has joined #openstack-infra23:45
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: experiment with late-binding inheritance  https://review.openstack.org/51135223:46
*** thorst has quit IRC23:46
*** andreas_s has quit IRC23:54
*** rlandy has quit IRC23:54
*** baoli has joined #openstack-infra23:57
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Add implied branch matchers on 'master'  https://review.openstack.org/51445923:58
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: experiment with late-binding inheritance  https://review.openstack.org/51135223:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!