Thursday, 2016-06-30

*** rfolco_ has joined #openstack-infra00:02
*** rfolco_ has quit IRC00:02
*** rfolco_ has joined #openstack-infra00:03
*** rfolco_ has quit IRC00:03
*** amotoki has joined #openstack-infra00:03
*** rfolco_ has joined #openstack-infra00:03
*** cody-somerville has joined #openstack-infra00:04
*** rfolco_ has quit IRC00:04
nibalizerseems like if it can go off without a hitch tonight, it can go off without a hitch tomorrow00:04
*** ddieterly has joined #openstack-infra00:05
*** thorst has joined #openstack-infra00:05
*** xarses has quit IRC00:06
fungiianw: yeah, i wouldn't want you to either ;)00:07
fungithat's never a pleasant experience when things are falling down around you and nobody else is around to help00:07
openstackgerritSpencer Krum proposed openstack-infra/vinz: First (hacky) poke at vinz  https://review.openstack.org/33189400:07
openstackgerritSpencer Krum proposed openstack-infra/vinz: Add Login button  https://review.openstack.org/33412400:07
*** amotoki has quit IRC00:08
nibalizerhurgleburgler: maybe now with passing tests00:08
hurgleburglernibalizer: \o/00:08
*** thorst has quit IRC00:12
*** pvaneck has quit IRC00:12
jheskethfungi: unfortunately I'm on leave today and tomorrow... I can be around for emergencies though :-)00:14
*** gongysh has joined #openstack-infra00:15
fungijhesketh: no! go be on leave and stop letting us pester you00:15
fungijhesketh: i don't want to get on your wife's bad side ;)00:15
*** thorst has joined #openstack-infra00:16
*** thorst has quit IRC00:17
fungihurgleburgler: nibalizer: so whatever's causing the c typeahead pause in gerrit doesn't seem to be related to a higher number of matches in the accounts full_name and preferred_email fields anyway00:17
hurgleburglerweird00:17
hurgleburglerand is only catches on 'C' :-/00:17
fungihurgleburgler: nibalizer: http://paste.openstack.org/show/524145/00:17
fungitwice as many matches for s00:18
*** sflanigan_afk has joined #openstack-infra00:18
funginext time zaro is around, let's show him that interesting behavior and see if he has any smart ideas00:18
pabelangeryay00:19
pabelangerwheel-mirror-ubuntu-xenial-amd64.slave.openstack.org online!00:20
pabelangerfirst xenial control plane server00:20
fungihurgleburgler: nibalizer: i also checked account_groups.name similarly (because the add reviewer typeahead also seems to be matching on group names)00:20
fungihurgleburgler: nibalizer: oh, though you know what... we have one really, really big group whose name starts with "c"00:21
*** sflanigan_afk is now known as sflanigan00:21
nibalizerwhat group is that?00:21
nibalizeris that cla-signed or something?00:21
fungi...i bet that's it00:21
nibalizerinb4 we rename it to unicode-poop-cla-signed00:22
fungiyep. the "CLA Accepted - ICLA" group00:22
fungii won't link the manage url for it in here because it's bringing my browser to a crawl00:23
*** rfolco_ has joined #openstack-infra00:23
*** rfolco_ has quit IRC00:23
*** rfolco__ has joined #openstack-infra00:23
*** rfolco__ has quit IRC00:23
*** cody-somerville has quit IRC00:24
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add wheel-mirror-ubuntu-xenial-amd64 to zlstatic  https://review.openstack.org/33572600:24
*** cody-somerville has joined #openstack-infra00:24
fungihurgleburgler: nibalizer: a count on account_group_members for that group_id says it contains 10702 members00:25
*** tphummel has quit IRC00:25
nibalizerim glad so many people want to contribute to openstack!00:25
nibalizerbut Im sad that they make our tool slow00:25
fungibut it comes with a free frogurt!00:26
*** Apoorva has joined #openstack-infra00:26
*** Sukhdev has quit IRC00:30
*** lvdongbing has joined #openstack-infra00:31
*** Apoorva has quit IRC00:31
fungihurgleburgler: nibalizer: i think that also explains why the same slowness doesn't affect typeahead in other fields like group membership or change queries00:33
fungii strongly suspect that the add reviewers box wants to expand group membership if you specify a group00:34
fungiso it's loading the entire group roster (maybe via javascript back to your browser even)00:34
*** Jeffrey4l has joined #openstack-infra00:36
*** jswarren has joined #openstack-infra00:37
*** baoli has joined #openstack-infra00:38
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add ubuntu-xenial-amd64 non-voting job for wheel-build  https://review.openstack.org/33573400:38
pabelangerand there is out xenial wheel-build job00:39
pabelangernon-voting for now00:39
*** baoli has quit IRC00:39
*** yamahata has quit IRC00:41
asselinmtreinish, we have our own fork, though I hope to get back in sync one day00:46
mtreinishasselin: I've been slowly reviewing your patches00:46
mtreinishheh, sry it's taken > 1yr00:47
*** Sukhdev has joined #openstack-infra00:47
openstackgerritYujun Zhang proposed openstack-infra/irc-meetings: Add agenda url for javascript-meeting  https://review.openstack.org/33573600:49
*** rwsu has quit IRC00:49
*** gyee has quit IRC00:50
*** julim has quit IRC00:52
*** ddieterly has quit IRC00:54
*** baoli has joined #openstack-infra00:56
*** baoli has quit IRC00:57
*** links has joined #openstack-infra00:57
*** julim has joined #openstack-infra00:58
*** woodster_ has quit IRC00:59
*** tqtran has quit IRC00:59
*** gongysh has quit IRC00:59
*** kzaitsev_mb has quit IRC01:03
*** mixos has joined #openstack-infra01:03
*** javeriak has quit IRC01:05
*** zhurong has joined #openstack-infra01:10
*** shashank_hegde has quit IRC01:10
*** Goneri has joined #openstack-infra01:13
*** zhurong has quit IRC01:16
*** zhurong has joined #openstack-infra01:16
*** piet has quit IRC01:16
*** greghaynes has quit IRC01:16
*** thorst has joined #openstack-infra01:17
*** rfolco__ has joined #openstack-infra01:17
*** rfolco__ has quit IRC01:18
openstackgerritIan Wienand proposed openstack/diskimage-builder: package-installs : add list to arch and "not-arch" list  https://review.openstack.org/33574801:21
*** asettle has joined #openstack-infra01:21
openstackgerritMerged openstack-infra/irc-meetings: Add agenda url for javascript-meeting  https://review.openstack.org/33573601:25
openstackgerritIan Wienand proposed openstack/diskimage-builder: package-installs : add list to arch and "not-arch" list  https://review.openstack.org/33574801:25
*** amotoki has joined #openstack-infra01:25
*** asettle has quit IRC01:25
*** thorst has quit IRC01:26
*** Goneri has quit IRC01:28
openstackgerritIan Wienand proposed openstack/diskimage-builder: package-installs : add list to arch and "not-arch" list  https://review.openstack.org/33574801:30
*** amotoki has quit IRC01:30
*** baoli has joined #openstack-infra01:30
*** greghaynes has joined #openstack-infra01:30
*** baoli has quit IRC01:31
*** thorst has joined #openstack-infra01:33
*** thorst has quit IRC01:33
*** thorst has joined #openstack-infra01:33
*** Apoorva has joined #openstack-infra01:34
*** Apoorva has quit IRC01:36
*** grassass has quit IRC01:36
*** thorst has quit IRC01:38
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477701:39
*** julim has quit IRC01:41
*** julim has joined #openstack-infra01:41
*** gongysh has joined #openstack-infra01:44
openstackgerritAdam Spiers proposed openstack-infra/project-config: Fix gerrit ACLs for openstack-resource-agents-specs  https://review.openstack.org/33576401:48
*** grassass has joined #openstack-infra01:48
*** Sukhdev has quit IRC01:50
*** ajmiller has quit IRC01:52
*** ajmiller has joined #openstack-infra01:54
*** baoli has joined #openstack-infra01:54
*** sdake has joined #openstack-infra01:54
*** rajinir has quit IRC01:54
*** yamahata has joined #openstack-infra01:55
*** baoli has quit IRC01:55
*** thorst has joined #openstack-infra01:56
*** thorst has quit IRC01:56
*** thorst has joined #openstack-infra01:57
*** zhurong has quit IRC02:00
*** zhurong has joined #openstack-infra02:00
*** kzaitsev_mb has joined #openstack-infra02:03
*** sdake has quit IRC02:04
*** PollyZ has joined #openstack-infra02:04
*** thorst has quit IRC02:05
*** markvoelker has quit IRC02:06
*** shuozhang has joined #openstack-infra02:08
*** Apoorva has joined #openstack-infra02:08
*** cody-somerville has quit IRC02:13
*** cody-somerville has joined #openstack-infra02:17
shuozhangHello,,,,                 has anyone configured nodepool using puppet?  Looks like the nodepool puppet files doesn't provide interface to configure some required configurations like, gearman-servers, but it is needed if you want to nodepool image-build, etc.  It is appreciated if someone can share me the template file and site.pp that can deploy a workable nodepool environment. It is a waste...02:24
shuozhang...of time to figure out the configurations one by one through debug the nodepool. Thanks!02:24
*** gongysh has quit IRC02:25
clarkbshuozhang: we use puppet to configure it. see the puppet-nodepool module and the openstackci modules02:25
*** yanyanhu has joined #openstack-infra02:27
*** sputnik13 has joined #openstack-infra02:31
shuozhangThanks, clarkb, I will look at them.      I was starting from openstack_project::nodepool_prod, and using the system-config project,      system-config/production/modules/openstack_project/templates/nodepool/nodepool.yaml.erb02:32
*** shashank_hegde has joined #openstack-infra02:32
*** jbernard has quit IRC02:33
clarkbthat is what we use though nodepool.yaml has moved to project-config02:34
*** xarses has joined #openstack-infra02:34
*** jraju has joined #openstack-infra02:34
*** links has quit IRC02:36
*** rfolco__ has joined #openstack-infra02:36
*** rfolco__ has quit IRC02:36
openstackgerritliyuanzhen proposed openstack/diskimage-builder: Fix the bug that "mktemp: failed to create directory"  https://review.openstack.org/33577502:36
*** julim has quit IRC02:37
shuozhangclarkb, how do you configure gearman-servers, if you are using system-config/production/modules/openstack_project/templates/nodepool/nodepool.yaml.erb too?02:38
*** shashank_hegde has quit IRC02:39
clarkbshuozhang: we use https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nodepool.yaml#n1902:40
*** PollyZ has quit IRC02:41
clarkbthe expectation is that different deployments have their own project configs and the modules use that02:41
shuozhanggearman-servers:02:41
shuozhang  - host: zuul.openstack.org         <-------- this is not configurable.02:41
*** baoli has joined #openstack-infra02:41
clarkbno, like I said you are expected to have your own project config repo with your own condigs02:42
clarkb*configs02:42
*** cody-somerville has quit IRC02:42
clarkbjjb config, nodepool image build scripts, and so on go in there too02:43
*** baoli has quit IRC02:45
shuozhangOk, but looks like gearman is a required configuration, because you want to build image by nodepool.  Why this is not changed in the git common?02:45
*** cody-somerville has joined #openstack-infra02:46
clarkbbecause the nodepool config tends to be highly site specific so as a whole you need to provide it02:46
clarkbwhat images, what targets, what gearman servers, clouds and so on02:46
*** reed has quit IRC02:46
*** Daisy has joined #openstack-infra02:47
*** reed has joined #openstack-infra02:47
*** PollyZ has joined #openstack-infra02:47
*** amotoki has joined #openstack-infra02:47
clarkbso rather than have complicated templates and parameterization we provide it verbatim from aite specific config repos02:47
*** yuanying has quit IRC02:50
*** amotoki has quit IRC02:51
*** karthikp_ has joined #openstack-infra02:55
*** coolsvap has joined #openstack-infra02:56
*** PollyZ has quit IRC02:59
shuozhangOk, so I need to customize it myself. My problem now, I only can know which configuration is missing when I use the nodepool commands but it doesn't response and then I debug the nodepool python files.  I was referring http://docs.openstack.org/infra/nodepool/configuration.html.  Any suggestion?02:59
*** harlowja_at_home has joined #openstack-infra03:00
*** thorst has joined #openstack-infra03:03
*** jraju has quit IRC03:03
*** PollyZ has joined #openstack-infra03:04
clarkbyou basically need all the sections in our config. Nodepool also has docs covering the config. http://docs.openstack.org/infra/nodepool/configuration.html03:05
*** markvoelker has joined #openstack-infra03:06
*** Daisy has quit IRC03:09
*** Daisy has joined #openstack-infra03:09
*** thorst has quit IRC03:10
shuozhangGot it, thank you!03:10
*** Daisy has quit IRC03:11
*** Daisy has joined #openstack-infra03:11
*** markvoelker has quit IRC03:11
*** shuozhang is now known as zshuo03:13
*** piet has joined #openstack-infra03:14
*** winggundamth has quit IRC03:15
*** sputnik13 has quit IRC03:15
*** Daisy has quit IRC03:16
*** winggundamth has joined #openstack-infra03:17
*** karthikp_ has quit IRC03:18
*** sree has joined #openstack-infra03:20
*** harlowja_at_home has quit IRC03:20
*** Nikolay_St has joined #openstack-infra03:22
*** harlowja_at_home has joined #openstack-infra03:22
*** ajmiller has quit IRC03:23
*** Apoorva has quit IRC03:23
*** ajmiller has joined #openstack-infra03:23
*** Daisy has joined #openstack-infra03:24
*** PollyZ has quit IRC03:24
*** PollyZ has joined #openstack-infra03:25
*** shashank_hegde has joined #openstack-infra03:32
*** amotoki has joined #openstack-infra03:36
*** zshuo has quit IRC03:37
*** piet has quit IRC03:37
*** zshuo has joined #openstack-infra03:37
*** karthikp_ has joined #openstack-infra03:38
*** shashank_hegde has quit IRC03:38
*** ajmiller has quit IRC03:40
*** ajmiller has joined #openstack-infra03:40
openstackgerritBrad Behle proposed openstack-infra/project-config: Make ovn-native-l3 check job voting  https://review.openstack.org/33562403:42
*** zz_dimtruck is now known as dimtruck03:42
*** PollyZ has quit IRC03:47
*** karthikp_ has quit IRC03:48
*** mriedem has quit IRC03:50
*** amotoki has quit IRC03:50
*** Apoorva has joined #openstack-infra03:51
*** PollyZ has joined #openstack-infra03:51
*** Ravikiran_K has joined #openstack-infra03:51
*** Daisy has quit IRC03:52
*** Daisy has joined #openstack-infra03:52
*** yuanying has joined #openstack-infra03:53
*** garyk1 has joined #openstack-infra03:54
*** Daisy_ has joined #openstack-infra03:55
*** Daisy has quit IRC03:55
*** karthikp_ has joined #openstack-infra03:56
*** tqtran has joined #openstack-infra03:56
*** PollyZ has quit IRC03:57
*** Daisy has joined #openstack-infra03:57
*** PollyZ has joined #openstack-infra03:57
*** _nadya_ has joined #openstack-infra03:57
*** amotoki has joined #openstack-infra03:58
*** tqtran has quit IRC04:00
*** Daisy has quit IRC04:01
*** Daisy_ has quit IRC04:01
*** Daisy has joined #openstack-infra04:01
*** markvoelker has joined #openstack-infra04:07
*** thorst has joined #openstack-infra04:08
*** markvoelker has quit IRC04:12
*** piet has joined #openstack-infra04:12
clarkbthe rax-ord xenial upload for ubuntu-xenial completed ~3 hours ago. We should be ready to try pypy jobs on xenial04:13
clarkbwill work on that tomorrow. And we have a wheel builder for it too. Much progress04:13
*** PollyZ has quit IRC04:13
*** PollyZ_ has joined #openstack-infra04:13
clarkbdon't see nayhting at http://mirror.dfw.rax.openstack.org/wheel/ for xenial yet though. WIll ahve to check on that as well04:13
clarkbpabelanger: this is exciting04:14
*** thorst has quit IRC04:15
*** PollyZ_ has quit IRC04:17
*** aeng has quit IRC04:17
*** PollyZ has joined #openstack-infra04:18
*** karthik__ has joined #openstack-infra04:18
*** amotoki has quit IRC04:18
*** karthikp_ has quit IRC04:20
*** _nadya_ has quit IRC04:23
*** shashank_hegde has joined #openstack-infra04:23
*** _nadya_ has joined #openstack-infra04:24
*** Sukhdev has joined #openstack-infra04:25
*** psachin has joined #openstack-infra04:25
*** Apoorva has quit IRC04:26
*** amotoki has joined #openstack-infra04:26
*** PollyZ has quit IRC04:27
*** _nadya_ has quit IRC04:28
*** ayoung has quit IRC04:29
*** javeriak has joined #openstack-infra04:30
*** harlowja_at_home has quit IRC04:30
*** PollyZ has joined #openstack-infra04:31
*** aeng has joined #openstack-infra04:34
openstackgerritliyuanzhen proposed openstack/diskimage-builder: Fix the bug that "mktemp: failed to create directory"  https://review.openstack.org/33577504:35
*** bhavik has joined #openstack-infra04:36
*** ajmiller has quit IRC04:39
*** ajmiller has joined #openstack-infra04:39
*** _nadya_ has joined #openstack-infra04:42
*** PollyZ has quit IRC04:48
*** sdake has joined #openstack-infra04:49
*** karthik__ has quit IRC04:49
*** karthikp_ has joined #openstack-infra04:50
*** piet has quit IRC04:50
*** Nikolay_St has quit IRC04:51
*** sdake_ has joined #openstack-infra04:51
*** yamamoto_ has joined #openstack-infra04:51
*** _nadya_ has quit IRC04:51
*** sputnik13 has joined #openstack-infra04:51
*** _nadya_ has joined #openstack-infra04:52
*** sdake_ has quit IRC04:53
*** Ravikiran_K has quit IRC04:54
*** sdake has quit IRC04:54
*** dimtruck is now known as zz_dimtruck04:54
*** xenogear has quit IRC04:55
*** _nadya_ has quit IRC04:56
openstackgerritMerged openstack/diskimage-builder: dmidecode does not exist for ppc64/ppc64el  https://review.openstack.org/33393205:00
*** salv-orlando has joined #openstack-infra05:00
*** zhurong has quit IRC05:02
*** salv-orl_ has quit IRC05:03
*** karthikp_ has quit IRC05:06
*** zhurong has joined #openstack-infra05:08
openstackgerritBrad Behle proposed openstack-infra/project-config: Add Networking OVN Data to Grafana  https://review.openstack.org/33579105:12
*** aeng has quit IRC05:13
*** thorst has joined #openstack-infra05:13
*** karthikp_ has joined #openstack-infra05:19
*** thorst has quit IRC05:21
*** savihou has quit IRC05:24
*** sdake has joined #openstack-infra05:24
*** karthikp_ has quit IRC05:25
*** karthikp_ has joined #openstack-infra05:25
*** aeng has joined #openstack-infra05:26
*** karthikp_ has quit IRC05:26
*** rcernin has joined #openstack-infra05:27
*** karthikp_ has joined #openstack-infra05:27
*** karthikp_ has quit IRC05:27
*** shashank_hegde has quit IRC05:29
*** karthikp_ has joined #openstack-infra05:30
*** karthikp_ has quit IRC05:30
*** pgadiya has joined #openstack-infra05:33
*** rcernin has quit IRC05:34
*** shahid__ has joined #openstack-infra05:34
*** sdake_ has joined #openstack-infra05:36
*** sdake has quit IRC05:37
*** sputnik13 has quit IRC05:38
*** roxanaghe has joined #openstack-infra05:40
*** Daisy has quit IRC05:41
*** Daisy has joined #openstack-infra05:41
*** rcarrillocruz has quit IRC05:46
*** tqtran has joined #openstack-infra05:46
*** Sukhdev has quit IRC05:47
*** bswartz has quit IRC05:47
*** sputnik13 has joined #openstack-infra05:48
*** roxanaghe has quit IRC05:49
*** yamamoto_ has quit IRC05:50
*** tqtran has quit IRC05:50
*** Daisy has quit IRC05:51
*** Daisy has joined #openstack-infra05:51
*** karthikp_ has joined #openstack-infra05:52
*** javeriak has quit IRC05:52
*** Daisy has quit IRC05:53
*** Daisy has joined #openstack-infra05:53
*** dtantsur|afk is now known as dtantsur05:55
*** Daisy has quit IRC05:58
AJaegerianw, jhesketh, https://review.openstack.org fixes the publishing job for infra documents (those that only publish at release). Could you review it, please? This was noted yesterday with bindep release where the content was not published to the root folder.05:58
ianwAJaeger: ^ sure, but what's the number? :)05:59
AJaegerToo early for me ;(05:59
AJaeger335620 is the number ;)05:59
*** karthikp_ has quit IRC05:59
AJaegerfull link - and double check: https://review.openstack.org/33562005:59
*** Daisy has joined #openstack-infra06:02
*** pradk has quit IRC06:03
*** Ravikiran_K has joined #openstack-infra06:08
*** eantyshev has left #openstack-infra06:08
*** harlowja_at_home has joined #openstack-infra06:08
*** savihou has joined #openstack-infra06:09
*** markvoelker has joined #openstack-infra06:09
*** rcernin has joined #openstack-infra06:09
openstackgerritliyuanzhen proposed openstack/diskimage-builder: Fix the bug that "mktemp: failed to create directory"  https://review.openstack.org/33577506:09
*** aeng has quit IRC06:10
*** javeriak has joined #openstack-infra06:11
openstackgerritAndreas Jaeger proposed openstack-infra/elastic-recheck: List system dependencies for running common tests  https://review.openstack.org/33580306:13
*** markvoelker has quit IRC06:13
*** cody-somerville has quit IRC06:13
*** karthikp_ has joined #openstack-infra06:14
openstackgerritAndreas Jaeger proposed openstack-infra/release-tools: List system dependencies for running common tests  https://review.openstack.org/33580406:15
*** javeriak_ has joined #openstack-infra06:15
*** javeriak has quit IRC06:16
openstackgerritAndreas Jaeger proposed openstack-infra/reviewday: List system dependencies for running common tests  https://review.openstack.org/33580506:16
*** rook- has quit IRC06:17
*** kzaitsev_mb has quit IRC06:18
*** karthikp_ has quit IRC06:18
*** andreas_s has joined #openstack-infra06:22
*** isaacb has joined #openstack-infra06:24
*** Nikolay_St has joined #openstack-infra06:28
*** shashank_hegde has joined #openstack-infra06:29
*** sdake_ has quit IRC06:30
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Revert "Add dbus-1 development libraries"  https://review.openstack.org/33580806:31
*** karthikp_ has joined #openstack-infra06:34
*** yamamoto_ has joined #openstack-infra06:35
*** pcaruana has joined #openstack-infra06:37
*** prometheanfire has quit IRC06:38
*** dizquierdo has joined #openstack-infra06:38
yolandagood morning06:39
*** karthikp_ has quit IRC06:39
*** harlowja_at_home has quit IRC06:39
AJaegergood morning, yolanda !06:40
AJaegeryolanda: if you have time for review, could you review https://review.openstack.org/#/q/status:open++branch:master+topic:bindep-keyring and  https://review.openstack.org/335620, please?06:41
*** hdaniel has joined #openstack-infra06:42
*** reduxio has joined #openstack-infra06:42
yolandahi AJaeger sure06:43
*** dtantsur is now known as dtantsur|brb06:43
yolandagive me half an hour and i'll review06:44
AJaegeryolanda: no urgency, take your time. Thanks06:46
*** karthikp_ has joined #openstack-infra06:46
*** ramishra has quit IRC06:46
*** ramishra has joined #openstack-infra06:48
*** shardy has joined #openstack-infra06:51
*** rdx_matt has joined #openstack-infra06:53
*** rdx_matt has quit IRC06:54
*** rdx_matt has joined #openstack-infra06:55
chem|offhi, is it possible to "recheck" the gate job ?06:55
*** chem|off is now known as chem06:55
*** prometheanfire has joined #openstack-infra06:55
*** amoralej|off is now known as amoralej06:55
AJaegerchem: yes - but it will go first through the check queue06:56
*** Daisy has quit IRC06:57
*** Daisy has joined #openstack-infra06:57
chemAJaeger: oki, so I just have to reply "recheck", it will goes through the check queue and then the gate queue and if successful, it will be merged, right ?06:57
AJaegeryes07:00
*** Daisy has quit IRC07:00
*** Daisy has joined #openstack-infra07:00
*** karthik__ has joined #openstack-infra07:04
*** asettle has joined #openstack-infra07:04
chemAJaeger: thanks07:04
*** javeriak_ has quit IRC07:05
*** karthikp_ has quit IRC07:05
*** zeih has joined #openstack-infra07:05
*** sorantis has joined #openstack-infra07:05
*** camunoz has quit IRC07:07
*** kdas_ has joined #openstack-infra07:09
*** markvoelker has joined #openstack-infra07:10
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard-webclient: Update other-requirements.txt  https://review.openstack.org/33582407:11
*** mixos has quit IRC07:11
*** thorst has joined #openstack-infra07:11
*** cschwede has joined #openstack-infra07:13
*** mixos has joined #openstack-infra07:14
*** markvoelker has quit IRC07:14
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard: Update other-requirements.txt  https://review.openstack.org/33582607:14
*** mixos has quit IRC07:15
*** ifarkas has joined #openstack-infra07:15
*** nmagnezi has joined #openstack-infra07:15
*** zeih has quit IRC07:15
*** tesseract- has joined #openstack-infra07:15
*** pilgrimstack has joined #openstack-infra07:17
*** thorst has quit IRC07:20
*** dtardivel has joined #openstack-infra07:20
*** shashank_hegde has quit IRC07:23
*** shashank_hegde has joined #openstack-infra07:23
*** kdas_ has quit IRC07:26
*** javeriak has joined #openstack-infra07:27
*** jlanoux has joined #openstack-infra07:30
*** jlanoux has quit IRC07:30
*** vincentll has joined #openstack-infra07:31
*** jlanoux has joined #openstack-infra07:31
*** asselin has quit IRC07:32
openstackgerritArtur Zarzycki proposed openstack-infra/project-config: Add new project Fuel CCP  https://review.openstack.org/33558407:32
*** asettle has quit IRC07:32
*** zz_dimtruck is now known as dimtruck07:37
*** jpich has joined #openstack-infra07:39
*** javeriak has quit IRC07:43
*** ccamacho|away is now known as ccamacho07:43
*** rcarrillocruz has joined #openstack-infra07:44
openstackgerritMerged openstack-infra/project-config: Fix doc publishing for infra  https://review.openstack.org/33562007:45
*** esikachev has joined #openstack-infra07:47
*** tqtran has joined #openstack-infra07:48
*** bhavik has quit IRC07:50
*** sputnik13 has quit IRC07:51
*** acoles_ is now known as acoles07:52
*** tqtran has quit IRC07:53
*** binbincong has quit IRC07:53
openstackgerritMasayuki Igawa proposed openstack/os-testr: Make subprocess outputs to text for Python 3  https://review.openstack.org/30321707:56
*** binbincong has joined #openstack-infra07:58
*** rdx_matt has quit IRC07:58
openstackgerritVladimir Kozhukalov proposed openstack-infra/project-config: Read only mode for fuel-upgrade project  https://review.openstack.org/33584107:58
*** zzzeek has quit IRC08:00
*** pilgrimstack1 has joined #openstack-infra08:00
*** pilgrimstack has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
openstackgerritMerged openstack-infra/project-config: Do not run gate-tempest job for neutron-lib doc changes  https://review.openstack.org/33526308:01
*** coolsvap is now known as coolsvap_08:02
*** derekh has joined #openstack-infra08:04
*** jlanoux_ has joined #openstack-infra08:05
*** pilgrimstack1 has quit IRC08:06
*** pilgrimstack has joined #openstack-infra08:06
openstackgerritMerged openstack-infra/project-config: neutron-fwaas-dsvm-tempest: Use devstack plugin on master  https://review.openstack.org/33541708:07
*** jlanoux has quit IRC08:08
*** gmann_ has quit IRC08:08
*** gmann has joined #openstack-infra08:09
*** markvoelker has joined #openstack-infra08:11
*** zeih has joined #openstack-infra08:12
*** eezhova has joined #openstack-infra08:14
openstackgerritMerged openstack-infra/puppet-pip: Fix openstack_pip provider to support old pip  https://review.openstack.org/33272508:15
*** kzaitsev_mb has joined #openstack-infra08:15
*** markvoelker has quit IRC08:15
*** joehuang has joined #openstack-infra08:15
*** jamielennox is now known as jamielennox|away08:16
*** thorst has joined #openstack-infra08:18
*** kzaitsev_mb has quit IRC08:20
*** joehuang has quit IRC08:22
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Update ironic-staging-drivers job  https://review.openstack.org/33584908:23
*** ci has joined #openstack-infra08:23
*** thorst has quit IRC08:25
*** Daisy has quit IRC08:27
*** Daisy has joined #openstack-infra08:28
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add support for OVB based CI  https://review.openstack.org/33478708:28
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Refactor common code for tripleo-ci  https://review.openstack.org/33562208:28
*** shashank_hegde has quit IRC08:29
*** lucas-afk is now known as lucasagomes08:30
*** mhickey has joined #openstack-infra08:32
*** Daisy has quit IRC08:32
*** aviau has quit IRC08:35
*** aviau has joined #openstack-infra08:35
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477708:35
*** asettle has joined #openstack-infra08:36
*** pradk has joined #openstack-infra08:37
*** Yaminikanth has joined #openstack-infra08:38
*** hashar has joined #openstack-infra08:40
*** electrofelix has joined #openstack-infra08:43
openstackgerritDerek Higgins proposed openstack-infra/project-config: Move the tripleo OVB job to the check-tripleo queue  https://review.openstack.org/33586208:44
*** ihrachys has joined #openstack-infra08:47
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add npm-run-lint,npm-run-test check and gate for senlin-dashboard  https://review.openstack.org/33586508:48
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add support for OVB based CI  https://review.openstack.org/33478708:51
ciexit08:52
*** ci has quit IRC08:54
*** bapalm has quit IRC08:57
*** yuanying_ has joined #openstack-infra08:58
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978908:58
*** TaylorHuang has joined #openstack-infra08:58
*** kdas_ has joined #openstack-infra08:58
*** ildikov_ has joined #openstack-infra08:59
*** markusry has joined #openstack-infra09:00
*** apuimedo_ has joined #openstack-infra09:00
*** gnuoy` has joined #openstack-infra09:00
*** bapalm has joined #openstack-infra09:00
*** mandre_ has joined #openstack-infra09:00
*** NikitaKonovalov2 has joined #openstack-infra09:01
openstackgerritVladimir Kozhukalov proposed openstack-infra/project-config: Fuel-mirror project is deprecated  https://review.openstack.org/33586809:01
*** vgridnev- has joined #openstack-infra09:01
*** zshuo_ has joined #openstack-infra09:01
*** migi_ has joined #openstack-infra09:02
*** TheJulia_ has joined #openstack-infra09:02
*** packet_sh_ has joined #openstack-infra09:02
*** bradm_ has joined #openstack-infra09:03
*** Kiall_ has joined #openstack-infra09:03
*** vsaienko1 has joined #openstack-infra09:04
*** senk_ has joined #openstack-infra09:04
*** ruhe2 has joined #openstack-infra09:04
*** alazarev_ has joined #openstack-infra09:04
*** purp_too has joined #openstack-infra09:04
*** abramley_ has joined #openstack-infra09:04
*** niska` has joined #openstack-infra09:04
*** igormarnat__ has joined #openstack-infra09:04
*** peterstac_ has joined #openstack-infra09:05
*** auggy_ has joined #openstack-infra09:05
*** alex_xu_ has joined #openstack-infra09:06
*** sfinucan_ has joined #openstack-infra09:07
*** afazekas_ has joined #openstack-infra09:07
*** leifmadsen_ has joined #openstack-infra09:07
*** coreyob_ has joined #openstack-infra09:08
*** yuanying has quit IRC09:08
*** zshuo has quit IRC09:08
*** gnuoy has quit IRC09:08
*** iurygregory has quit IRC09:08
*** ericksonsantos has quit IRC09:08
*** pahuang has quit IRC09:08
*** TaylorH has quit IRC09:08
*** alex_xu has quit IRC09:08
*** coreyob has quit IRC09:08
*** vgridnev has quit IRC09:08
*** sfinucan has quit IRC09:08
*** alazarev has quit IRC09:08
*** ruhe has quit IRC09:08
*** mandre has quit IRC09:08
*** TheJulia has quit IRC09:08
*** hughhalf has quit IRC09:08
*** afazekas has quit IRC09:08
*** peterstac has quit IRC09:08
*** senk has quit IRC09:08
*** Kiall has quit IRC09:08
*** j_king has quit IRC09:08
*** lmiccini has quit IRC09:08
*** vsaienko has quit IRC09:08
*** leifmadsen has quit IRC09:08
*** penguinolog has quit IRC09:08
*** apuimedo has quit IRC09:08
*** bradm has quit IRC09:08
*** igormarnat has quit IRC09:08
*** mordred has quit IRC09:08
*** NikitaKonovalov has quit IRC09:08
*** hparekh has quit IRC09:08
*** niska has quit IRC09:08
*** purp has quit IRC09:08
*** abramley has quit IRC09:08
*** auggy has quit IRC09:08
*** migi has quit IRC09:08
*** ildikov has quit IRC09:08
*** packet_sh has quit IRC09:08
*** dolphm has quit IRC09:08
*** bkero has quit IRC09:08
*** apuimedo_ is now known as apuimedo09:08
*** peterstac_ is now known as peterstac09:08
*** NikitaKonovalov2 is now known as NikitaKonovalov09:08
*** alazarev_ is now known as alazarev09:08
*** ruhe2 is now known as ruhe09:08
*** abramley_ is now known as abramley09:08
*** mandre_ is now known as mandre09:08
*** igormarnat__ is now known as igormarnat09:08
*** dolphm has joined #openstack-infra09:08
*** j_king has joined #openstack-infra09:09
*** ildikov_ is now known as ildikov09:09
*** hparekh has joined #openstack-infra09:09
*** auggy_ is now known as auggy09:10
*** hughhalf has joined #openstack-infra09:10
*** pahuang has joined #openstack-infra09:11
*** kzaitsev_mb has joined #openstack-infra09:12
*** mordred has joined #openstack-infra09:12
*** rdx_matt has joined #openstack-infra09:13
*** john-davidge has joined #openstack-infra09:13
*** lmiccini has joined #openstack-infra09:13
*** bkero has joined #openstack-infra09:14
*** ericksonsantos has joined #openstack-infra09:14
*** john-dav_ has joined #openstack-infra09:15
*** iurygregory has joined #openstack-infra09:15
*** Daisy has joined #openstack-infra09:16
*** javeriak has joined #openstack-infra09:17
*** john-davidge has quit IRC09:18
*** Daisy has quit IRC09:18
*** Daisy has joined #openstack-infra09:18
*** matrohon has joined #openstack-infra09:20
*** john-dav_ is now known as john-davidge09:21
*** baoli has joined #openstack-infra09:22
*** zeih has quit IRC09:24
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add javascript-jobs for senlin-dashboard  https://review.openstack.org/33586509:24
*** thorst has joined #openstack-infra09:24
*** baoli has quit IRC09:26
*** sputnik13 has joined #openstack-infra09:26
*** Daisy has quit IRC09:27
*** zeih has joined #openstack-infra09:27
*** Daisy has joined #openstack-infra09:27
*** thorst has quit IRC09:30
*** psanchez has joined #openstack-infra09:34
*** kzaitsev_mb has quit IRC09:34
*** zhurong has quit IRC09:35
*** AJaeger has quit IRC09:36
*** hdaniel has quit IRC09:37
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add support for OVB based CI  https://review.openstack.org/33478709:38
*** AJaeger has joined #openstack-infra09:39
*** AJaeger has quit IRC09:47
*** AJaeger has joined #openstack-infra09:47
*** dtantsur|brb is now known as dtantsur09:49
*** zeih has quit IRC09:49
*** sree has quit IRC09:50
*** breton has quit IRC09:52
*** Alekhya has joined #openstack-infra09:52
*** Alekhya has quit IRC09:53
apuimedoWhat's the procedure for getting openstackgerrit to report about other project repos in the IRC channel?10:00
*** tosky has joined #openstack-infra10:04
*** Yaminikanth has quit IRC10:05
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add support for OVB based CI  https://review.openstack.org/33478710:06
*** lvdongbing has quit IRC10:08
*** jargonmonk has joined #openstack-infra10:08
*** zshuo_ has quit IRC10:08
*** david-lyle has quit IRC10:09
*** david-lyle_ has joined #openstack-infra10:09
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add the OVB based job to the triple ci report  https://review.openstack.org/33591610:10
*** pilgrimstack has quit IRC10:12
*** _degorenko|afk is now known as degorenko10:12
*** rdx_matt_ has joined #openstack-infra10:13
*** rdx_matt has quit IRC10:16
*** esikachev has quit IRC10:16
*** linuxmaniac has quit IRC10:17
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978910:17
*** linuxmaniac has joined #openstack-infra10:19
*** flepied has quit IRC10:20
*** zeih has joined #openstack-infra10:20
*** yanyanhu has quit IRC10:21
*** javeriak has quit IRC10:27
*** thorst has joined #openstack-infra10:28
*** rdx_matt_ has quit IRC10:29
*** rdx_matt has joined #openstack-infra10:29
derekhJobs don't seem to be getting added to the check-tripleo queu in ZUUL, anybody got any idea why? e.g. https://review.openstack.org/#/c/335916/10:31
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add javascript-jobs for senlin-dashboard  https://review.openstack.org/33586510:32
openstackgerritMerged openstack-infra/tripleo-ci: Fix openstack-tripleo-common package name  https://review.openstack.org/33446710:33
fricklerapuimedo: submit a patch for project-config/gerritbot/channels.yaml10:34
apuimedothanks frickler!10:35
*** sorantis has quit IRC10:35
*** thorst has quit IRC10:35
*** eezhova has quit IRC10:38
*** kzaitsev_mb has joined #openstack-infra10:39
*** lewo has quit IRC10:40
*** javeriak has joined #openstack-infra10:40
*** lewo has joined #openstack-infra10:40
openstackgerritAntoni Segura Puimedon proposed openstack-infra/project-config: kuryr: add libnetwork and k8s to gerritbot  https://review.openstack.org/33592210:41
apuimedofrickler: ^^10:41
apuimedo:-)10:41
apuimedothanks again10:41
*** chem has quit IRC10:42
*** chem has joined #openstack-infra10:42
*** frickler has quit IRC10:43
*** Daisy has quit IRC10:43
*** _fortis has quit IRC10:43
*** Daisy has joined #openstack-infra10:43
*** toabctl has quit IRC10:44
*** sorantis has joined #openstack-infra10:44
*** idan_hefetz has joined #openstack-infra10:45
*** frickler has joined #openstack-infra10:45
*** elisha_r has joined #openstack-infra10:45
elisha_rhi. I'm having some difficulty with branch marking policy. Anyone here to help...?10:46
*** toabctl has joined #openstack-infra10:46
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add javascript-jobs for senlin-dashboard  https://review.openstack.org/33586510:46
*** toabctl has quit IRC10:47
AJaegerapuimedo: we have hit our limit of channels that gerritbot can support, so cannot add further channesl right now10:47
apuimedoAJaeger: understood. Can I leave the patch there or should I abandon it?10:47
AJaegerapuimedo: Ah, you just add notifications to an already existing channel - that is fine...10:48
apuimedo:D10:48
apuimedoglad to read that10:48
*** toabctl has joined #openstack-infra10:48
*** _fortis has joined #openstack-infra10:48
*** Daisy has quit IRC10:48
AJaegerapuimedo: misinterpreted your statement here - but looking at the patch, it deserves a +2 ;)10:48
*** javeriak has quit IRC10:50
*** nbloom has joined #openstack-infra10:50
apuimedothanks a lot AJaeger!10:51
*** nwkarsten has joined #openstack-infra10:57
*** dizquierdo has quit IRC10:59
*** salv-orl_ has joined #openstack-infra11:00
*** YorikSar has quit IRC11:01
*** jamespag` is now known as jamespge11:02
*** jamespge is now known as jamespage11:02
*** arxcruz has joined #openstack-infra11:03
*** YorikSar has joined #openstack-infra11:03
sshnaidmdoes anybody know what happens to queues in ZUUL or work on this right now?11:03
*** salv-orlando has quit IRC11:03
*** psachin has quit IRC11:04
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Add support for OVB based CI  https://review.openstack.org/33478711:04
*** salv-orl_ has quit IRC11:05
*** rook- has joined #openstack-infra11:06
*** psachin has joined #openstack-infra11:06
*** Ravikiran_K has quit IRC11:07
*** sree has joined #openstack-infra11:08
*** nwkarsten has quit IRC11:11
*** aderyugin has quit IRC11:11
*** weshay has joined #openstack-infra11:11
*** aderyugin has joined #openstack-infra11:12
*** sree has quit IRC11:12
*** javeriak has joined #openstack-infra11:13
*** bunting has quit IRC11:13
AJaegerfungi, the infra publish job has been merged. Could you reenque the bindep-infra-docs job so that bindep gets published again, please?11:14
*** nwkarsten has joined #openstack-infra11:14
*** claudiub has joined #openstack-infra11:15
*** bunting has joined #openstack-infra11:15
*** javeriak has quit IRC11:16
*** ddieterly has joined #openstack-infra11:17
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Consistent ERROR messages  https://review.openstack.org/33217311:17
*** nwkarsten has quit IRC11:19
*** rdx_matt has quit IRC11:21
*** Swanson has quit IRC11:21
*** Swanson has joined #openstack-infra11:21
*** rhallisey has joined #openstack-infra11:22
*** eezhova has joined #openstack-infra11:23
*** asselin has joined #openstack-infra11:23
openstackgerritJames Slagle proposed openstack-infra/project-config: Add TripleO 3-node job  https://review.openstack.org/32609511:23
*** kdas_ has quit IRC11:24
*** sputnik13 has quit IRC11:26
*** zeih has quit IRC11:28
*** YorikSar has quit IRC11:28
derekhJobs don't seem to be getting added to the check-tripleo queu in ZUUL, anybody got any idea why?11:29
*** YorikSar has joined #openstack-infra11:29
*** smcginnis has quit IRC11:30
*** zeih has joined #openstack-infra11:30
*** smcginnis has joined #openstack-infra11:30
*** ldnunes has joined #openstack-infra11:32
*** yamamoto_ has quit IRC11:33
*** hashar has quit IRC11:34
*** psachin has quit IRC11:35
*** ericksonsantos has quit IRC11:38
*** pilgrimstack has joined #openstack-infra11:39
*** ccamacho is now known as ccamacho|lunch11:39
openstackgerritIan Cordasco proposed openstack-dev/hacking: Clean up check signatures  https://review.openstack.org/33596511:41
*** hashar has joined #openstack-infra11:43
*** jed56 has quit IRC11:45
*** tqtran has joined #openstack-infra11:45
*** rfolco has joined #openstack-infra11:47
*** psachin has joined #openstack-infra11:48
*** tqtran has quit IRC11:48
*** links has joined #openstack-infra11:48
*** links has quit IRC11:48
*** elisha_r has quit IRC11:50
*** jargonmonk has quit IRC11:51
*** asettle has quit IRC11:51
*** thorst has joined #openstack-infra11:52
*** thorst has quit IRC11:53
*** thorst_ has joined #openstack-infra11:53
*** sdake has joined #openstack-infra11:55
*** asettle has joined #openstack-infra11:57
*** sdake_ has joined #openstack-infra11:57
*** jargonmonk has joined #openstack-infra11:58
*** eharney has quit IRC11:58
*** jcoufal has joined #openstack-infra11:59
*** ddieterly has quit IRC12:00
*** sdake has quit IRC12:01
*** lucasagomes is now known as lucas-hungry12:03
*** psilvad has joined #openstack-infra12:04
*** pilgrimstack has quit IRC12:05
*** coolsvap_ has quit IRC12:05
*** salv-orlando has joined #openstack-infra12:06
*** zeih_ has joined #openstack-infra12:06
*** zeih has quit IRC12:07
*** Qiming has quit IRC12:07
*** qadaemon has joined #openstack-infra12:08
*** qadaemon has quit IRC12:09
*** zeih has joined #openstack-infra12:10
*** Qiming has joined #openstack-infra12:10
*** zeih_ has quit IRC12:11
*** yamamoto has joined #openstack-infra12:12
*** pilgrimstack has joined #openstack-infra12:13
*** raildo-afk is now known as raildo12:13
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: pingtest/tenantvm_floatingip.yaml: connect vrouter before creating fip  https://review.openstack.org/33566312:13
*** markvoelker has joined #openstack-infra12:13
*** daemontool has joined #openstack-infra12:14
*** salv-orlando has quit IRC12:14
*** markvoelker has quit IRC12:14
*** markvoelker has joined #openstack-infra12:15
*** eharney has joined #openstack-infra12:15
openstackgerritMerged openstack-infra/tripleo-ci: pingtest/tenantvm_floatingip.yaml: connect vrouter before creating fip  https://review.openstack.org/33566312:16
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: pingtest: don't show error if no images needs to be cleaned-up  https://review.openstack.org/33565512:18
*** ociuhandu has joined #openstack-infra12:20
*** zeih_ has joined #openstack-infra12:20
*** ericksonsantos has joined #openstack-infra12:23
*** zeih has quit IRC12:23
*** baoli_ has joined #openstack-infra12:24
*** edmondsw has joined #openstack-infra12:25
*** kgiusti has joined #openstack-infra12:26
*** ericksonsantos has quit IRC12:26
*** bswartz has joined #openstack-infra12:26
*** kushal has joined #openstack-infra12:26
*** jargonmonk has quit IRC12:28
*** Ravikiran_K has joined #openstack-infra12:32
*** mdrabe has joined #openstack-infra12:32
*** rlandy has joined #openstack-infra12:33
*** zeih has joined #openstack-infra12:35
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Preparing multinode networking for Ironic  https://review.openstack.org/33598112:35
*** ddieterly has joined #openstack-infra12:35
*** rdx_matt has joined #openstack-infra12:35
*** TheJulia_ is now known as TheJulia12:35
*** ericksonsantos has joined #openstack-infra12:37
*** zeih has quit IRC12:37
*** zeih_ has quit IRC12:38
*** gordc has joined #openstack-infra12:39
*** zeih has joined #openstack-infra12:40
*** pilgrimstack has quit IRC12:41
*** pilgrimstack has joined #openstack-infra12:43
*** pradk has quit IRC12:43
*** salv-orlando has joined #openstack-infra12:43
derekhJobs don't seem to be getting added to the check-tripleo queu in ZUUL, anybody got any idea why?12:46
*** ccamacho|lunch is now known as ccamacho12:46
openstackgerritAlexander Evseev proposed openstack-infra/project-config: Disable DNSSEC on jenkins slaves  https://review.openstack.org/33598812:46
*** xyang1 has joined #openstack-infra12:47
*** piet has joined #openstack-infra12:52
yolandahi derekh , let me check zuul logs12:54
*** idan_hefetz has left #openstack-infra12:55
*** ddieterly has quit IRC12:55
*** amoralej is now known as amoralej|lunch12:56
*** mdrabe_ has joined #openstack-infra12:56
*** mdrabe has quit IRC12:56
*** thiagop has joined #openstack-infra12:56
openstackgerritRaildo Mascena proposed openstack-infra/project-config: Run Ceilometer functional tests in Identity v3-only  https://review.openstack.org/31507712:57
yolandaderekh, do you have a sample job?12:57
*** cshastri has joined #openstack-infra12:57
*** psachin has quit IRC12:57
derekhyolanda: thanks for looking, here is a sample https://review.openstack.org/#/c/335916/12:57
*** shahid__ has quit IRC12:57
*** rodrigods has quit IRC12:58
*** rodrigods has joined #openstack-infra12:58
*** zeih has quit IRC12:58
*** PollyZ has joined #openstack-infra12:59
*** makowals has joined #openstack-infra12:59
*** jed56 has joined #openstack-infra12:59
*** zeih has joined #openstack-infra13:00
yolandaderekh, that should be on your third party ci, right?13:00
yolandai see the successful noop in our zuul logs13:00
*** andymaier has joined #openstack-infra13:00
derekhyolanda: on http://status.openstack.org/zuul/  is should be in the check-tripleo queue13:00
derekhyolanda: *it should13:01
derekhyolanda: not 3rd party13:01
*** amotoki has quit IRC13:01
*** psilvad has quit IRC13:01
*** eezhova has quit IRC13:02
*** tpsilva has joined #openstack-infra13:03
yolandaderekh, from our logs, seems it's ignoring the check-tripleo jobs, but need to check why13:03
*** eezhova has joined #openstack-infra13:04
*** lucas-hungry is now known as lucasagomes13:06
derekhyolanda: ok13:06
*** yamamoto has quit IRC13:07
*** amotoki has joined #openstack-infra13:07
*** sdake has joined #openstack-infra13:10
*** pilgrimstack has quit IRC13:11
*** pgadiya has quit IRC13:12
*** rdx_matt has quit IRC13:13
*** sdake_ has quit IRC13:13
*** yamamoto has joined #openstack-infra13:13
*** trown|outtypewww is now known as trown13:13
*** psilvad has joined #openstack-infra13:13
*** rdx_matt has joined #openstack-infra13:13
*** dizquierdo has joined #openstack-infra13:16
yolandaderekh, going to check latest changes on project-config, the jobs in tripleo-check pipeline are not even triggered13:17
yolandai think it's ignoring them for some reason13:17
*** erlon has joined #openstack-infra13:18
yolandado you know when the problem started?13:18
* AJaeger checked but does not see anything obvious ;(13:19
*** zeih has quit IRC13:19
*** kzaitsev_mb has quit IRC13:19
*** psilvad has quit IRC13:19
*** woodster_ has joined #openstack-infra13:19
derekhyolanda: When I cam in about 5 hours ago, jobs were running but I suspect the problem started before that and the queue was just being cleared13:19
*** pilgrimstack has joined #openstack-infra13:20
*** matt-borland has joined #openstack-infra13:20
yolandai'm not seeing anything obvious at project-config , but zuul logs show that only noop-job and merge-check jobs are called13:20
*** bunting has quit IRC13:21
*** mriedem has joined #openstack-infra13:21
*** bunting has joined #openstack-infra13:22
*** flepied has joined #openstack-infra13:22
*** hdaniel has joined #openstack-infra13:24
*** jsavak has joined #openstack-infra13:24
*** yamamoto has quit IRC13:24
*** electrofelix has quit IRC13:25
*** yamamoto has joined #openstack-infra13:27
openstackgerritAlexey Morlang proposed openstack-infra/project-config: push force rights for fuel-plugin-scaleio  https://review.openstack.org/33601113:27
*** rdx_matt has quit IRC13:27
*** rdx_matt has joined #openstack-infra13:28
*** psilvad has joined #openstack-infra13:29
*** jbernard has joined #openstack-infra13:30
fungiis this affecting changes for all projects or just tripleo?13:32
stevemarfungi: can ya kick Guest_58577 in #openstack ? seems bot-ish13:32
stevemarfungi: spamming all kinds of stuff13:32
fungistevemar: done13:32
derekhfungi: I've only noticed tripleo projects not getting queued13:33
openstackgerritVladimir Kozhukalov proposed openstack-infra/project-config: Add fuel-core group to all Fuel projects.  https://review.openstack.org/33602013:33
stevemarfungi: thx!13:33
*** electrofelix has joined #openstack-infra13:34
yolandafungi, only tripleo. It's just skipping the jobs on that pipeline, but i can't see the reason13:34
yolandano suspicious change in project-config log13:34
fungii need to go do some yardwork before weather gets bad so i can't look too deep into zuul just yet, but is it possible the names of all the jobs for those pipelines aren't registered in gearman?13:35
*** yamamoto has quit IRC13:36
fungiahh, no a spot check indicates gate-tripleo-ci-centos-7-upgrades is registered13:36
*** javeriak has joined #openstack-infra13:36
fungiand has available workers too13:36
*** psachin has joined #openstack-infra13:36
*** ddieterly has joined #openstack-infra13:37
fungilast time i see that job name reported on a change is 10:27:56 utc13:37
fungiso ~3 hours ago13:37
*** njohnston has left #openstack-infra13:37
*** xenogear has joined #openstack-infra13:39
yolandayep, that's why i was thinking on some project-config change that landed but i cannot see anything that can be related and cause to ignore that jobs13:40
*** amoralej|lunch is now known as amoralej13:40
fungilayout.yaml was last updated on zuul.o.o at Jun 30 08:0913:40
*** nmagnezi has quit IRC13:41
*** isaacb has quit IRC13:41
pabelangermorning13:42
*** eezhova has quit IRC13:42
fungii wonder if that last change to it is to blame somehow? https://review.openstack.org/33526313:42
*** andymaier has quit IRC13:43
fungii don't see anything immediately wrong with it, but skip-if changes always worry me13:43
*** isaacb has joined #openstack-infra13:44
* AJaeger checked that one already - I share fungi's worry - but let'S double check the log...13:44
yolandabut not related with that tripleo-ci changes13:44
yolandaor doesn't look like13:44
pabelangerclarkb: we need to land a few patches to zuul first: https://review.openstack.org/335726 specifically13:44
*** edmondsw has quit IRC13:44
pabelangerI'll work on AFS bits this morning13:45
*** ricky3 has joined #openstack-infra13:45
ricky3hey folks13:45
*** zeih has joined #openstack-infra13:45
ricky3can't access my irc bouncer that runs at home13:45
*** esikachev has joined #openstack-infra13:45
ricky3in case anyone pings me about anything and i don't respond13:46
ricky3:/13:46
*** reduxio has quit IRC13:46
fungiricky3: you're rcarrillocruz i guess?13:46
ricky3ricky3 = rcarrillocruz13:46
ricky3yep13:46
fungiaha, thanks!13:46
*** yamamoto has joined #openstack-infra13:46
ricky3me thinks the dyndns broke or something, cos i see rcarrillocruz still on the channel13:46
AJaegernothing suspicious so far at http://logs.openstack.org/63/335263/3/gate/gate-project-config-layout/54ee21a/console.html#_2016-06-30_08_01_33_51132713:47
openstackgerritAlexander Evseev proposed openstack-infra/project-config: Fix trusted host for NODEPOOL_PYPI_HOST  https://review.openstack.org/33602313:48
*** ayoung has joined #openstack-infra13:48
*** eezhova has joined #openstack-infra13:48
*** r-mibu has quit IRC13:48
*** rdx_matt has quit IRC13:48
*** r-mibu has joined #openstack-infra13:48
*** rdx_matt has joined #openstack-infra13:49
*** psilvad has quit IRC13:49
*** kzaitsev_mb has joined #openstack-infra13:50
*** pradk has joined #openstack-infra13:52
*** krtaylor has joined #openstack-infra13:52
*** rbrndt_ has joined #openstack-infra13:52
yolandayes, i cannot see any change that landed today that can cause that issue13:52
yolandaskip-if in that change is limited to a project13:53
*** rdx_matt has quit IRC13:53
*** sputnik13 has joined #openstack-infra13:54
fricklerclarkb: does infra install python3.4 into xenial images? otherwise we need to amend all the py34 jobs and tox-envs to have a py35 variant first (or maybe setup a generic py3 variant, I would actually be in favor of that)13:54
openstackgerritAlexey Morlang proposed openstack-infra/project-config: push force rights for fuel-plugin-scaleio  https://review.openstack.org/33602813:55
*** zeih has quit IRC13:55
*** cshastri has quit IRC13:55
*** akshai has joined #openstack-infra13:57
sdakemorning folks13:57
AJaegerfrickler: https://review.openstack.org/33523013:58
AJaegerfrickler: So, as part of going to Xenial, we might need to do what you suggest13:58
*** vgridnev- has quit IRC13:59
*** vgridnev has joined #openstack-infra14:00
*** xarses has quit IRC14:00
fungiyeah, i expected we would run python35 jobs for master branches and optionally python34 on stable/mitaka and stable/liberty if desired14:00
fricklerAJaeger: so that confirms that there will be only python3.5 on xenial, right?14:00
AJaegeryes, that'S my understanding14:01
*** itisha has joined #openstack-infra14:01
*** inc0 has joined #openstack-infra14:01
fungifrickler: also normally projects shouldn't need anything special in tox.ini to support pyXX envs of any XX14:01
fungithe few projects that do funky workarounds in tox for py3k compat testing may need additions14:02
*** mixos has joined #openstack-infra14:02
fungibut i hope those are increasingly few now14:02
fricklerfungi: ah, I was assuming if there is something like "envlist = py27,py34", then I would need to add py35 to that list in order to run "tox -e py35"14:03
*** oferby has quit IRC14:04
fricklerfungi: but it seems that it works without that14:04
AJaegerfrickler: no, you don't. envlist is the default to use14:04
AJaegerfrickler: so, if you run "tox", it will run both py27 and py34.14:05
fungifrickler: yep. tox makes them magically. the list of envs you see in tox.envlist is just the default list of envs to fire (and in what order) if you just run `tox` without specifying an env14:05
*** grassass has quit IRC14:06
fungiour jobs don't rely on that at all, though feel free to add py35 there as a developer convenience14:06
AJaegerfungi, did you see my comment on re-enquing the bindep docs job? No need to do it now - just wanted to be sure that it's on your todo list for today...14:06
fungisome projects like to keep that list updated with the envs they expect should work by default14:06
fungiAJaeger: yeah, am going to do it in just a bit before i head outside14:06
AJaegerthanks, fungi14:07
*** grassass has joined #openstack-infra14:07
fricklerso would it make sense if I proposed like e.g. a gate-neutron-python35(-nv) job to run on xenial to see how that works out? should I start with an experimental job?14:07
*** sdake_ has joined #openstack-infra14:07
openstackgerritArtur Zarzycki proposed openstack-infra/project-config: Add new project Fuel CCP  https://review.openstack.org/33558414:08
fungifrickler: i think we're very close to mass-adding them for every project currently running python34 jobs14:09
*** yamamoto has quit IRC14:09
fungiclarkb and pabelanger have been wrapping up the final few todo items on having xenial ready for all projects14:10
fungiand determining how to do the job split between branches14:10
*** sdake has quit IRC14:11
fricklerfungi: o.k., I'm just wondering how many more issues like https://bugs.launchpad.net/neutron/+bug/1559191 may appear. so I don't think going from voting py34 to voting py35 in a single step is feasible14:11
openstackLaunchpad bug 1559191 in neutron "TestParseOneVlanRange fails in python3.5" [Low,In progress] - Assigned to Dr. Jens Rosenboom (j-rosenboom-j)14:11
pabelangerfungi: if you want to help 335726 land, I can finish up our wheel-builds this morning14:12
*** hongbin has joined #openstack-infra14:13
fungifrickler: there's a good chance we'll start them all out nonvoting and then switch the working ones over. i don't know exactly what clarkb was planning for the 3.5 roll-in14:13
*** amotoki has quit IRC14:13
*** sorantis has quit IRC14:14
*** rcernin has quit IRC14:14
*** yamamoto has joined #openstack-infra14:15
*** yamamoto has quit IRC14:16
clarkbre py35, I think initially we would test both py34 and py35 and ya make it non voting.14:17
clarkbfor many projects it will just work14:17
clarkbsince they only explicit py3 thing is the entry in the default envs list14:18
clarkbfrickler: ^14:18
*** javeriak has quit IRC14:18
*** eezhova has quit IRC14:18
openstackgerritAlexander Evseev proposed openstack-infra/project-config: Fix trusted host for NODEPOOL_PYPI_MIRROR  https://review.openstack.org/33602314:19
mtreinishclarkb: yeah in my experience everything works fine with py35. (I've been using it for a while locally) The only case where it doesn't is if the tests aren't fully working on py3 and they have an exclude list setup on the py34 job14:19
mtreinishso when you tox -epy35 it'll fail because it tries to run everything14:19
*** sdake_ is now known as sdake14:20
clarkbright14:20
fricklermtreinish: well there may be some subtle issues like the one I posted above14:20
fricklerclarkb: do you have a estimated time frame for when you would start py35 jobs? like days, weeks or months, rather?14:21
clarkbwe ran into a garbage collection bug in python3.4 on trusty too. its something we are familiar with deali g with. Yay python in gdb14:22
pabelangerfungi: clarkb: AFS bits are setup: http://mirror.dfw.rax.openstack.org/wheel/ubuntu-16.04-x86_64/14:22
clarkbfrickler: hopefully next week14:22
openstackgerritMiles Gould proposed openstack-infra/project-config: Skip non-doc checks for doc-only o3client patches  https://review.openstack.org/33604914:23
*** pt_15 has joined #openstack-infra14:23
openstackgerritMerged openstack-infra/system-config: Add wheel-mirror-ubuntu-xenial-amd64 to zlstatic  https://review.openstack.org/33572614:23
clarkbpabelanger: do you know why all the zl stuff goes in the zuul merger group?14:24
*** gouthamr has joined #openstack-infra14:24
*** zhurong has joined #openstack-infra14:25
pabelangerclarkb: in ansible?14:25
fungipublic hiera14:26
*** gouthamr_ has joined #openstack-infra14:26
*** zhurong has quit IRC14:26
*** edmondsw has joined #openstack-infra14:26
pabelangernot sure, jeblair would know more on that14:26
fungii'm guessing it was just quicker than setting up a separate hiera group14:26
pabelangerI think so14:26
fungiand they probably needed to share some bits14:26
fungimaybe in private hiera14:27
clarkbwell looking at the list none of that data should matter to the mergers14:27
fungiyeah, but in private hiera some of it might14:27
clarkbah gotcha14:27
*** gouthamr has quit IRC14:29
*** javeriak has joined #openstack-infra14:29
*** rcernin has joined #openstack-infra14:29
clarkbfrickler: reading that bug it is a straightforward fix too so that is reassuring14:31
*** jistr is now known as jistr|mtg14:31
*** zhurong has joined #openstack-infra14:31
*** inc0 has quit IRC14:31
fungiAJaeger: job retriggered, should show up under http://logs.openstack.org/64/64fe77cec12be3e9dd56ffa55ee98d6f0a3243f0/release/ once it finishes14:32
clarkbjust need to make a consistent error message instead of passing what appears to be stdlib stright through14:32
*** esikachev has quit IRC14:32
*** PollyZ has quit IRC14:33
AJaegerthanks, fungi. Will check...14:33
fungiclarkb: frickler: ahh, yep. once again someone assuming that error message strings are a stable interface14:33
*** krtaylor has quit IRC14:34
aarefievhi! Could somebody help. How I can get sudo privileges on tempest user? Test in tempest plugin need access to virsh.14:34
fungiaarefiev: for official tests in tempest i'm pretty sure they have a no-sudo policy14:35
fungiaarefiev: for a custom job you could modify /etc/sudoers to add it14:35
clarkbor use rootwrap14:36
AJaegerfungi, http://docs.openstack.org/infra/bindep/ is updated, worked fine... Thanks!14:36
fungiAJaeger: looks like it worked14:36
fungiyep!14:36
clarkbcurrent setup for most jobs is devsta k run has sudo, sets up rootwrap, then drops.full sudo afyer devstack amd relies on rootwrap14:36
fungiokay, i'm stepping out for about an hour. bbiab14:36
aarefievfungi: does it  documented somewhere about no sudo14:37
*** xarses has joined #openstack-infra14:37
aarefievclarkb: I thought about rootwrap, just didn't want have separate rootwrap for tempest14:37
*** PollyZ has joined #openstack-infra14:38
*** rossella_s has quit IRC14:39
*** yamamoto has joined #openstack-infra14:39
*** rossella_s has joined #openstack-infra14:39
*** mixos has quit IRC14:40
openstackgerritMerged openstack-infra/project-config: Move the tripleo OVB job to the check-tripleo queue  https://review.openstack.org/33586214:40
*** yamamoto_ has joined #openstack-infra14:40
*** yamamoto has quit IRC14:40
openstackgerritMiles Gould proposed openstack-infra/project-config: Skip non-doc checks for doc-only o3client patches  https://review.openstack.org/33604914:40
*** zhurong has quit IRC14:41
apuimedoHow do you manage the VM images for the test runs?14:43
apuimedodo you use something like packer?14:43
*** zeih has joined #openstack-infra14:43
*** charz has quit IRC14:43
clarkbapuimedo: nodepool builds images with diskimage-builder and uploads them once a day14:43
apuimedoclarkb: how do you handle the uploads? You change the backing image in glance?14:44
derekhclarkb: are those images publicly available for download?14:44
clarkbapuimedo: we upload/import via the glance api14:45
clarkbderekh: they are not but you can run dib locally14:45
*** Nikolay_St has quit IRC14:45
openstackgerritMerged openstack-dev/hacking: Clean up check signatures  https://review.openstack.org/33596514:45
derekhclarkb: ok14:45
openstackgerritMerged openstack-infra/project-config: Add ubuntu-xenial-amd64 non-voting job for wheel-build  https://review.openstack.org/33573414:45
*** tonytan4ever has joined #openstack-infra14:45
apuimedoclarkb: dib?14:45
clarkbderekh: project-config/tools/build-image.sh tries to reflect the elements in use to make that easy14:45
*** charz has joined #openstack-infra14:46
clarkbapuimedo: diskimage-builder == dib14:46
*** zhurong has joined #openstack-infra14:46
*** rcernin has quit IRC14:46
apuimedoclarkb: is nodepool the one that cleans up the older images in glance? How does the replacement work?14:46
openstackgerritSteve Martinelli proposed openstack-infra/project-config: update osc-check-plugin script  https://review.openstack.org/33606114:46
apuimedoI'm reading http://docs.openstack.org/infra/system-config/nodepool.html14:46
*** pcaruana has quit IRC14:46
clarkbderekh: we could probably try putting apache in front of where the images are located but they are not small. could impact our uploads since rax bw is updown cummulative irc14:47
*** jamesmcarthur has joined #openstack-infra14:47
clarkbapuimedo: it keeps the last image and the current image. when you make a new current image you delete the old last image14:47
*** flepied has quit IRC14:47
*** zhurong has quit IRC14:47
derekhclarkb: ok, thanks, will give building them a go14:47
clarkbapuimedo: its just uaing the glance api to essentiall do an add new, delete old14:48
apuimedoclarkb: and how does the updating of what constitutes the "current" image work?14:48
apuimedoyou rename them in glance?14:48
clarkbapuimedo: no we make a new image14:48
*** flepied has joined #openstack-infra14:48
*** jlanoux_ has quit IRC14:48
apuimedoclarkb: and how do you select them14:49
clarkbapuimedo: nodepool uses the current image when booting14:49
apuimedolet's say a test is setup to use "kuryr-foo"14:49
clarkbso it transitions as soon as its db updates14:49
*** dimtruck is now known as zz_dimtruck14:49
*** mixos has joined #openstack-infra14:49
apuimedowho updates to say kuryr-foo is not uuidA but uuidB14:50
*** karthik__ has joined #openstack-infra14:50
openstackgerritLiuqing Jing proposed openstack-infra/project-config: Add javascript-jobs for senlin-dashboard  https://review.openstack.org/33586514:50
apuimedoclarkb: sorry for the very basic questions about infra, I'm just trying to understand the platform we run on14:50
*** sputnik13 has quit IRC14:50
*** kushal has quit IRC14:50
*** david-lyle_ is now known as david-lyle14:51
*** flepied has quit IRC14:51
clarkbapuimedo: nodepool has image A and B. B is newer than A so it boots instamces off B. Then a day later new image isade and uploaded called C. Nodepool.deletes A because it previous or current. New instances are booted off of C14:51
*** rdx_matt has joined #openstack-infra14:52
*** flepied has joined #openstack-infra14:52
*** isaacb has quit IRC14:52
clarkbthen the next day D is made and B is deleted and so on14:52
*** zeih has quit IRC14:53
apuimedoclarkb: and keeping just two instances is hardcoded or is it configurable?14:53
clarkbThat is hardcoded. Really only one is necessary but we wamted a revert mechanism14:53
apuimedothat's sensible :-)14:54
*** hdaniel has quit IRC14:54
apuimedothanks a lot clarkb for the info14:54
*** sdake_ has joined #openstack-infra14:56
*** roaet has quit IRC14:56
*** esikachev has joined #openstack-infra14:57
*** mixos has quit IRC14:57
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add experimental wheel-build-ubuntu-xenial-amd64 job  https://review.openstack.org/33607014:57
pabelangerclarkb: fungi: yolanda: AJaeger: I'd like to add an experimental job for xenial wheel-build, to easier debug until they are voting ^14:58
clarkbfrickler: fungi you know, we could just add non voting py35 jobs to projects today :)14:58
*** sdake has quit IRC14:59
clarkbpabelanger: looking14:59
*** karthik__ has quit IRC14:59
*** javeriak has quit IRC14:59
*** rcernin has joined #openstack-infra14:59
*** akshai has quit IRC14:59
openstackgerritArtur Zarzycki proposed openstack-infra/project-config: Add new project Fuel CCP  https://review.openstack.org/33558415:00
clarkbI will let people consider new py35 jobs while I do yardwork15:00
*** akshai has joined #openstack-infra15:00
clarkbit turns out I can do a couple hours of yardwork everyday and feel like the weeds are winning15:01
*** gouthamr_ is now known as gouthamr15:01
*** esikachev has quit IRC15:02
*** krtaylor has joined #openstack-infra15:02
*** mat128 is now known as mat128|afk15:03
fricklerclarkb: I'd be +1 on that, although it is almost end of the day for me here ;)15:03
*** garyk1 has quit IRC15:03
*** armax_ has joined #openstack-infra15:08
*** dtantsur is now known as dtantsur|afk15:08
*** armax has quit IRC15:09
*** armax_ is now known as armax15:09
*** vhosakot has joined #openstack-infra15:09
*** sdake has joined #openstack-infra15:10
*** vincentll has quit IRC15:10
openstackgerritItzik Brown proposed openstack-infra/shade: Adding port_security_enabled to create_network  https://review.openstack.org/33608015:10
*** piet has quit IRC15:12
*** sdake_ has quit IRC15:13
*** isq_ has quit IRC15:13
*** nbloom has quit IRC15:16
*** psachin has quit IRC15:17
*** jlanoux has joined #openstack-infra15:17
*** jsavak has quit IRC15:17
*** Daisy has joined #openstack-infra15:17
derekhyolanda: AJaeger jobs seem to be running in check-tripleo again, did ye change something ?15:17
*** inc0 has joined #openstack-infra15:18
yolandanot me15:18
*** jsavak has joined #openstack-infra15:19
*** roaet has joined #openstack-infra15:19
*** rcernin has quit IRC15:19
*** bhavik has joined #openstack-infra15:21
*** Daisy has quit IRC15:21
*** armax has quit IRC15:22
openstackgerritMiles Gould proposed openstack-infra/project-config: Skip non-doc checks for tripleoclient docs patches  https://review.openstack.org/33604915:23
*** inc0 has quit IRC15:23
*** jistr|mtg is now known as jistr15:23
*** amitgandhinz has quit IRC15:23
*** amitgandhinz has joined #openstack-infra15:24
openstackgerritMerged openstack-infra/project-config: Add experimental wheel-build-ubuntu-xenial-amd64 job  https://review.openstack.org/33607015:24
*** esikachev has joined #openstack-infra15:26
*** karthik__ has joined #openstack-infra15:27
*** tesseract- has quit IRC15:27
*** kaisers has quit IRC15:29
*** savihou has quit IRC15:30
*** esikachev has quit IRC15:31
*** yujunz has joined #openstack-infra15:31
*** yujunz has quit IRC15:34
*** yujunz has joined #openstack-infra15:34
openstackgerritMerged openstack-infra/tripleo-ci: Prevent python from buffering stdout  https://review.openstack.org/32090515:35
*** yujunz has quit IRC15:41
*** inc0 has joined #openstack-infra15:41
*** tphummel has joined #openstack-infra15:41
*** kaisers has joined #openstack-infra15:44
*** eezhova has joined #openstack-infra15:44
*** eezhova has quit IRC15:45
*** Nikolay_St has joined #openstack-infra15:45
*** karthik__ has quit IRC15:46
*** bhavik has quit IRC15:46
*** piet has joined #openstack-infra15:46
sshnaidmyolanda, AJaeger when I submit recheck to my patch (331997, tripleo-ci repo) in tripleo, it appears in merge-check queue, although should be in check-tripleo. May it help to investigation..?15:48
*** eezhova has joined #openstack-infra15:48
Zara(ooh, I like this patch series! xD https://review.openstack.org/#/c/335908/ )15:48
*** harlowja_at_home has joined #openstack-infra15:48
derekhsshnaidm: have you tried it recently, things started queing again about 30 minutes ago15:49
sshnaidmderekh, right now tried it15:49
*** harlowja_at_home has quit IRC15:49
*** jordanP has joined #openstack-infra15:50
*** salv-orlando has quit IRC15:50
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Refactor base test classes inheritance for reuse  https://review.openstack.org/33609015:51
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Improve logger output for expanding templates  https://review.openstack.org/33609115:51
yolandasshnaidm, try again as derekh said15:51
*** abregman has joined #openstack-infra15:51
sshnaidmyolanda, tried 1 minute before15:51
openstackgerritAles Komarek proposed openstack-infra/project-config: Publish docs for opesntack-salt  https://review.openstack.org/33546615:51
yolandasshnaidm, what's your change number?15:51
derekhsshnaidm: its there now15:51
electrofelixcj: if you get a chance to test https://review.openstack.org/336091 with the JJB definitions that caused you problems to see if the output given is sufficiently clear that it would have been easy to track down that would be very useful15:52
cjhey there15:52
yolandaif no core has taken action on that, then my guess is that another change landed now, that caused zuul to reconfigure pipelines, and things started working again15:52
cjelectrofelix: I did look in to it, but I ended up just stripping things down to the bare minimum and adding new code.15:52
*** mixos has joined #openstack-infra15:52
cjbut it *did* help me find a missing end quote, so yes.  I would say merge it!15:53
pabelangeryolanda: I recently approved 33586215:53
*** jamesmcarthur has quit IRC15:53
yolandapabelanger, it may be that... i wonder what caused zuul to miss that tripleo pipeline on the last reconfig15:54
sshnaidmyolanda, changes: 316436, 331997  *seems* like it misses check-tripleo and goes to merge-check15:54
electrofelixcj: this one is a bit different to what you originally tried, since I added some work to make the format of what is displayed more like what would be in the job definitions15:54
cjoh?  Then I'll build that and run it.15:54
*** jamesmcarthur has joined #openstack-infra15:54
*** andreas_s has quit IRC15:56
sshnaidmyolanda, I look at web page, maybe it's not reliable15:56
yolandasshnaidm, i saw them on check-tripleo15:56
*** karthik__ has joined #openstack-infra15:56
sshnaidmyolanda, cool, the web-page may confuse though15:57
*** mixos has quit IRC15:57
yolandathey were on both merge-check and check-tripleo15:57
sshnaidmyolanda, ok.. and is it normal?15:58
pabelangerzuul is processing events, so taking time for jobs to show up15:59
cjelectrofelix: http://paste2.org/VJe3BM8W16:00
*** dims has quit IRC16:00
*** jordanP has quit IRC16:00
cj.yaml file: http://paste2.org/7pMBgIYg16:01
cjit expected to find a block closure but instead found a ?16:01
cjI can't understand what it's saying...16:01
cjexpected <block end>, but found '?'16:01
cjmaybe it doesn't like the newline between sections?16:02
cjwhat does a <block end> look like?16:02
cjbut I guess that's the YAML parser and not the JJB parser16:02
*** karthik__ has quit IRC16:04
*** karthik__ has joined #openstack-infra16:04
*** amitgandhinz has quit IRC16:04
*** hashar is now known as hasharAudio16:04
*** hasharAudio has quit IRC16:05
*** matrohon has quit IRC16:05
*** tonytan4ever has quit IRC16:06
*** dims has joined #openstack-infra16:06
*** amitgandhinz has joined #openstack-infra16:07
*** Jeffrey4l has quit IRC16:08
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: WIP: Complex priorities UI in stories  https://review.openstack.org/31266616:08
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Remove ovs-native period jobs from Neutron periodic pipeline  https://review.openstack.org/33609916:11
*** dizquierdo has quit IRC16:12
*** dizquierdo has joined #openstack-infra16:12
*** baoli_ has quit IRC16:12
*** baoli has joined #openstack-infra16:13
*** eezhova has quit IRC16:13
*** thorst_ has quit IRC16:13
*** zeih has joined #openstack-infra16:13
*** thorst_ has joined #openstack-infra16:14
*** PollyZ has quit IRC16:14
*** nwkarsten has joined #openstack-infra16:14
*** ifarkas has quit IRC16:14
*** thorst__ has joined #openstack-infra16:15
*** sdake_ has joined #openstack-infra16:15
*** piet has quit IRC16:17
*** migi_ is now known as migi16:17
*** karthik__ has quit IRC16:17
*** karthik__ has joined #openstack-infra16:18
*** thorst_ has quit IRC16:18
openstackgerritMerged openstack-infra/tripleo-ci: Make deploy validation errors/warnings fatal for CI  https://review.openstack.org/32088316:18
*** sdake has quit IRC16:18
*** zeih has quit IRC16:19
karthik__ianw: Hey..got a qucik question for you16:19
karthik__quick*16:19
*** shashank_hegde has joined #openstack-infra16:19
*** thorst__ has quit IRC16:20
*** PollyZ has joined #openstack-infra16:20
pabelanger#status log zlstatic01.o.o restart to pick up zuul.NodeWorker.wheel-mirror-ubuntu-xenial-amd64.slave.openstack.org16:22
openstackstatuspabelanger: finished logging16:22
*** sdake_ is now known as sdake16:23
pabelangerand wheel-build running on xenial16:23
pabelangertelnet://wheel-mirror-ubuntu-xenial-amd64.slave.openstack.org:808816:23
pabelangershould take about 45mins or so16:23
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: pingtest: don't show error if no images needs to be cleaned-up  https://review.openstack.org/33565516:24
*** tphummel has quit IRC16:24
*** karthik__ has quit IRC16:26
*** karthik__ has joined #openstack-infra16:26
*** armax has joined #openstack-infra16:28
*** sarob has joined #openstack-infra16:28
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add specs dir  https://review.openstack.org/33610916:29
*** piet has joined #openstack-infra16:30
*** trown is now known as trown|lunch16:30
*** sarob has quit IRC16:30
*** dizquierdo has quit IRC16:31
*** sarob has joined #openstack-infra16:31
*** yamamoto_ has quit IRC16:31
*** shashank_hegde has quit IRC16:34
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add undercloud idempotency test  https://review.openstack.org/27921816:34
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Run undercloud idempotency test on all jobs  https://review.openstack.org/33611216:34
*** baoli has quit IRC16:35
*** gyee has joined #openstack-infra16:36
*** jpich has quit IRC16:36
*** Nikolay_St has quit IRC16:36
*** ramishra has quit IRC16:37
*** kaisers has quit IRC16:37
*** baoli has joined #openstack-infra16:38
*** karthik__ has quit IRC16:41
*** zqfan has joined #openstack-infra16:41
*** javeriak has joined #openstack-infra16:41
*** karthik__ has joined #openstack-infra16:41
*** chem is now known as chem|off16:42
*** ddieterly is now known as ddieterly[away]16:42
*** baoli has quit IRC16:43
*** ddieterly[away] is now known as ddieterly16:45
pabelangertoo bad pip wheel doesn't support -j4, like make :)16:45
pabelangerparallel builds would make it faster16:46
dstufftpabelanger: on Python3 it does16:46
electrofelixcj: "  in "/usr/src/git/lf/gerrit.fd.io/ci-management/jjb/deb-dpdk/deb-dpdk.yaml", line 1, column 1 expected <block end>, but found '?'   in "/usr/src/git/lf/gerrit.fd.io/ci-management/jjb/deb-dpdk/deb-dpdk.yaml", line 10, column 1" points out the problem is on line 10 of the yaml file in the first character16:46
pabelangerdstufft: Oh, how so?16:46
*** mhickey has quit IRC16:47
dstufft(or to be specific, parallel builds is a concern of the build tool not of ``pip wheel`` itself, and in Python3 distutils added a feature that allows build parallelization)16:47
fungiyolanda: derekh: zuul's config has updated according to the status page (though more recently than you commented). i'll check the logs to see if it updated shortly before your comment as well16:47
pabelangerdstufft: nice, let me see if I can find the docs on that16:47
dstufftpabelanger: ``python setup.py build_ext -j4 bdist_wheel`` I think will do it16:48
electrofelixcj: you're missing '- ' in front of a job definition, which means it's mixing a dict notation inbetween list notation, so it can't parse it. At least in this case it's pointing you to the file, line and column causing the issue16:48
openstackgerritSean M. Collins proposed openstack-infra/project-config: [WIP] Make gate-grenade-dsvm-neutron-dvr-multinode voting  https://review.openstack.org/33611616:48
pabelangerdstufft: very cool. let me try that16:48
*** tphummel has joined #openstack-infra16:48
dstufftI think it only helps with C extensions fwiw16:48
pabelangerya16:49
pabelangerthat's what I would expect too16:49
derekhfungi: ok, thanks16:49
*** zz_dimtruck is now known as dimtruck16:49
openstackgerritLuigi Toscano proposed openstack-infra/project-config: Restructure Sahara CLI test job  https://review.openstack.org/33611816:49
dstuffteventually pip should just parallelize wheel builds itself (not by passing -j4, but by just building multiple wheels in parallel)16:49
fungiyolanda: derekh: reload times so far today (in utc)... 08:10:50, 15:10:30, 15:46:2116:49
dstufftbut nobody has implemented that yet :]16:50
*** mdrabe_ has quit IRC16:50
melwitthttp://status.openstack.org/elastic-recheck/ is looking odd right now, everything looks greyed out. is it because there are 0 fails for everything on the page?16:50
*** lucasagomes is now known as lucas-afk16:50
fungiyolanda: derekh: so i'm going to guess that somehow zuul ceased running jobs in check-tripleo after the 08:10:50 reload and then started again as of the 15:10:30 reload. you commented noticing it at 15:17 utc16:50
derekhfungi: 15:10 is about when I saw jobs getting queued again16:50
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Remove ovs-native period jobs from Neutron periodic pipeline  https://review.openstack.org/33609916:51
*** salv-orlando has joined #openstack-infra16:51
*** rwsu has joined #openstack-infra16:52
derekhfungi: yup, timings makes sense16:52
*** julim has joined #openstack-infra16:52
*** john-davidge has quit IRC16:53
fungithe changes which merged to project-config don't jump out at me as anything that would "fix" this, so i'm going to see if i can successfully diff the parsed layout from the debug log for each reload16:53
*** baoli has joined #openstack-infra16:54
*** nwkarsten has quit IRC16:55
*** salv-orl_ has joined #openstack-infra16:57
*** inc0 has quit IRC16:57
*** jvrbanac has left #openstack-infra16:57
*** inc0 has joined #openstack-infra16:57
*** salv-orlando has quit IRC16:58
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Remove ovs-native period jobs from Neutron periodic pipeline  https://review.openstack.org/33609916:59
*** asettle has quit IRC16:59
*** dimtruck is now known as zz_dimtruck16:59
*** daemontool_ has joined #openstack-infra17:01
openstackgerritSean M. Collins proposed openstack-infra/project-config: [WIP] Make gate-grenade-dsvm-neutron-dvr-multinode voting  https://review.openstack.org/33611617:01
*** sree has joined #openstack-infra17:01
*** piet has quit IRC17:01
*** salv-orl_ has quit IRC17:02
*** yamamoto has joined #openstack-infra17:02
*** derekh has quit IRC17:02
*** tkelsey has joined #openstack-infra17:02
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477717:02
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Refactor common code for tripleo-ci  https://review.openstack.org/33562217:02
*** daemontool has quit IRC17:04
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add support for OVB based CI  https://review.openstack.org/33478717:04
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Refactor common code for tripleo-ci  https://review.openstack.org/33562217:04
*** thorst_ has joined #openstack-infra17:05
*** sree has quit IRC17:05
*** yamamoto has quit IRC17:06
*** thorst_ has quit IRC17:07
*** thorst_ has joined #openstack-infra17:07
*** jlanoux has quit IRC17:09
pabelangerfungi: clarkb: and we have xenial wheels: http://mirror.dfw.rax.openstack.org/wheel/ubuntu-16.04-x86_64/17:10
clarkbyay17:10
clarkbI am just about done with morning chores. Will likely approve pypy switch and push up change for py3517:10
pabelangerjust waiting for python3 job to finish, then will remove experimental and make jobs voting17:10
pabelangercool17:10
pabelangerI have noticed ansible cannot ssh into wheel-mirror-ubuntu-xenial-amd64.slave.openstack.org properly, I think there is an sshd_config problem17:11
pabelangerwill debug that shortly17:11
*** jamesmcarthur has quit IRC17:12
karthik__Hi, everyone I have a question regarding the features.yaml  file in openstack/devstack-gate project17:12
karthik__I wanted to know how is it used by integration tests17:13
sshnaidmclarkb, hi, could you look at this in your time? https://review.openstack.org/#/c/334452/  thanks17:14
*** zeih has joined #openstack-infra17:16
*** kaisers has joined #openstack-infra17:17
cjthanks, electrofelix.  I guess I should read the yaml spec17:17
*** ihrachys has quit IRC17:18
karthik__What does the features section in features.yaml really say17:19
AJaegerteam, change 326095 adds a 3-node job in our default clouds - and then runs tripleo tests on it. Can we enable this and will this work? Syntax looks fine but I'd like some expert review on this project-config change17:20
*** ddieterly is now known as ddieterly[away]17:20
*** zeih has quit IRC17:20
*** degorenko is now known as _degorenko|afk17:21
*** markusry has quit IRC17:21
*** julim has quit IRC17:21
*** annegentle has joined #openstack-infra17:21
pabelangerAJaeger: it should work, but this is uncharted territory17:22
*** matt-borland has quit IRC17:23
*** PollyZ has quit IRC17:23
pabelangerAJaeger: good catch on the pipeline too17:24
pabelangerI missed that17:24
AJaegerpabelanger: wasn't completely sure on the pipeline - this setup confuses me. I expected tripleo jobs to run in tripleo cloud - and then I would have +2 it already ;)17:24
*** yamahata has quit IRC17:24
pabelangerAJaeger: right, they are working on making the tripleo jobs work on any cloud with this patch. Which, for me, is a step in the right directory17:25
pabelangererr17:25
pabelangerdirection*17:25
*** zzelle_ has joined #openstack-infra17:25
AJaegerclarkb, since you worked on the two-node setup, could you check 326095, please?17:26
*** savihou has joined #openstack-infra17:26
AJaegerpabelanger: ah - missed to learn about that bit17:26
*** karthik__ has quit IRC17:26
*** rdx_matt has quit IRC17:26
tbarroni've been doing some work to get devstack-plugin-ceph to work with systemd and was asked:17:26
prometheanfirepabelanger: :P17:27
tbarronwhen is gate planning on upgrading to xenial?17:27
*** rdx_matt has joined #openstack-infra17:27
tbarronrealized i didn't know the answer, so am asking here.17:27
*** kaisers has quit IRC17:27
tbarron(fwiw, my patch: https://review.openstack.org/#/c/332484/)17:28
AJaegertbarron: we have xenial images already, should be good for your job17:28
AJaegertbarron: you could define a special job that runs on xenial - or wait until we switch master to xenial17:29
pabelangertbarron: we're in the planning stages now for the migration17:29
*** salv-orlando has joined #openstack-infra17:29
AJaegerwe're currently discussing the next steps17:29
pabelanger++17:29
tbarronAJaeger: it runs fine for me on Xenial locally now and downstream i need to run against fedora-style systemd17:30
tbarronAJaeger: pabelanger: so it's not urgent for me to run against xenial upstream17:30
*** PollyZ has joined #openstack-infra17:30
* tbarron realizes it is urgent not to break trusty17:30
pabelangertbarron: we should have an experimental jobs for xenial17:31
pabelangertbarron: check experimental on your patch17:31
*** tonytan4ever has joined #openstack-infra17:31
tbarronpabelanger: will do, ty!17:31
*** rdx_matt has quit IRC17:32
AJaegerpabelanger: do you understand what nibalizer means with 332654? nibalizer, or do you want to answer my question on it?17:32
pabelangerAJaeger: not sure17:33
*** yamamoto has joined #openstack-infra17:34
*** salv-orlando has quit IRC17:34
AJaegerpabelanger: ok, then I'll set it to -1 to get a reaction...17:35
*** PollyZ has quit IRC17:35
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add specs dir  https://review.openstack.org/33610917:38
*** yamamoto has quit IRC17:39
*** trown|lunch is now known as trown17:40
*** tonytan4ever has quit IRC17:41
*** tkelsey has quit IRC17:41
*** arxcruz has quit IRC17:41
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add specs dir  https://review.openstack.org/33610917:41
*** tonytan4ever has joined #openstack-infra17:41
clarkbso many things to catch up on17:41
*** kaisers has joined #openstack-infra17:43
*** asettle has joined #openstack-infra17:43
* clarkb notes that our extensive skip if rules hardcode python3417:44
* fungi shakes fist at skip-if17:45
*** sdake has quit IRC17:45
*** tosky has quit IRC17:46
clarkbwow our rules have become incredibly complicated :/17:47
* clarkb hacks away at it17:47
*** asettle has quit IRC17:47
*** gyee has quit IRC17:48
*** esikachev has joined #openstack-infra17:48
*** zz_dimtruck is now known as dimtruck17:49
*** pvaneck has joined #openstack-infra17:50
*** javeriak has quit IRC17:51
clarkbI am going to run python35 where we run against python34. Then if things fail against stable branches they can either decide if they want to update their tox.ini, fix tests, or remove the python35 from that branch17:51
clarkbdoing this because I suspect that it will work in most cases17:51
*** SumitNaiksatam has joined #openstack-infra17:51
clarkbor is that just a terribly idea and we should restrict to >= newton?17:51
clarkbfungi: pabelanger ^ what do yo uthin?17:51
nibalizerAJaeger: will look17:52
clarkbactually I think I am just going to restrict it to >= newton since its easier17:52
fungii worry about e.g. stable/liberty unit tests not working on xenial in general (python35 or no)17:52
*** yamahata has joined #openstack-infra17:53
nibalizerAJaeger: responded17:54
*** electrofelix has quit IRC17:55
AJaegerok, understood now - +217:55
*** kzaitsev_mb has quit IRC17:55
*** Ravikiran_K has quit IRC17:57
*** salv-orlando has joined #openstack-infra17:57
*** dimtruck is now known as zz_dimtruck17:59
openstackgerritDiana Whitten proposed openstack-infra/vinz: Vinz, the web app  https://review.openstack.org/33614318:00
*** javeriak has joined #openstack-infra18:01
*** rdx_matt has joined #openstack-infra18:01
*** taron has left #openstack-infra18:02
*** zz_dimtruck is now known as dimtruck18:03
*** esikachev has quit IRC18:03
*** salv-orlando has quit IRC18:05
*** salv-orlando has joined #openstack-infra18:05
fungitaking a look as a cleansed diff of the zuul layout loading from its logs, when https://review.openstack.org/335263 was applied this was the change to the expanded match result http://paste.openstack.org/show/524314/18:05
*** rdx_matt has quit IRC18:06
fungithat looks very not at all correct to me18:07
AJaegerbut that should not hit the tripleo ones? Still strange...18:08
clarkbon the job registration front I notice that with python jobs we make a pypy and python34 job for everything even though most things don't use either18:09
AJaegerfungi, so it matched the BIG skip-if in line 999 I guess first - and now it has a specific skip-if18:09
clarkbwe can probably reduce our total job count by many hundred if we are explicit about when we want those jobs18:10
fungiAJaeger: oh! you're right, that's what it is18:10
AJaegerclarkb: yes, exactly. There are a few of these templates that define far more than used by most projects18:10
clarkbAJaeger: ya  Ithink we should try to clean that up since gearman registrations are problematic right now18:11
fungiAJaeger: and yeah, i can't find anything that changed between the 2016-06-29 18:43 reload and the 2016-06-30 08:10 reload that had anything to do with tripleo jobs or pipelines, though the reload at 2016-06-30 15:10 (when things seemed to start working again) did add some more tripleo jobs (corresponding to the change for them that merged to trigger that reload)18:11
clarkbI can likely work on that soon18:11
*** sarob has quit IRC18:11
*** PollyZ has joined #openstack-infra18:11
AJaegerclarkb: we can easily move pypy out of it for example18:12
*** ddieterly[away] is now known as ddieterly18:12
*** sarob has joined #openstack-infra18:12
clarkbAJaeger: and python34 in many cases18:12
AJaeger35 repos use pypy18:12
clarkband 200something use python-jobs18:13
AJaegerDo you want me to do a pypy change?18:13
*** e0ne has joined #openstack-infra18:13
clarkbAJaeger: sure18:13
AJaegerok, on it - you'll get something in less than an hour...18:13
*** Sukhdev has joined #openstack-infra18:15
*** Ravikiran_K has joined #openstack-infra18:16
*** rbrndt_ has quit IRC18:17
clarkbAJaeger: we will likely conflict with my python35 change but we can sort that out18:19
*** matt-borland has joined #openstack-infra18:20
*** mdrabe has joined #openstack-infra18:21
*** asselin_ has joined #openstack-infra18:21
AJaegerclarkb: ^18:22
AJaegertoo faster, change is uploading..18:22
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove pypy job from python-jobs  https://review.openstack.org/33615418:22
*** hashar has joined #openstack-infra18:22
*** amoralej is now known as amoralej|off18:24
*** asselin_ has quit IRC18:24
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove pypy job from python-jobs  https://review.openstack.org/33615418:25
*** Sukhdev has quit IRC18:28
*** bhavik has joined #openstack-infra18:30
*** karthik__ has joined #openstack-infra18:30
*** piet has joined #openstack-infra18:31
*** cody-somerville has joined #openstack-infra18:31
*** e0ne has quit IRC18:33
*** jsavak has quit IRC18:34
*** jsavak has joined #openstack-infra18:34
*** alexey-mr has joined #openstack-infra18:35
*** esberglu has joined #openstack-infra18:37
*** rossella_s has quit IRC18:39
*** rossella_s has joined #openstack-infra18:39
openstackgerritOpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/33367018:40
*** shardy has quit IRC18:41
*** karthik__ has quit IRC18:42
*** e0ne has joined #openstack-infra18:44
*** alexey-mr has quit IRC18:45
*** sarob has quit IRC18:45
*** bhavik has quit IRC18:45
*** Sukhdev has joined #openstack-infra18:47
*** adrian_otto has joined #openstack-infra18:47
*** dtardivel has quit IRC18:47
*** rbrndt_ has joined #openstack-infra18:47
adrian_ottoWe have noticed that the OVH servers run gate tests at half the speed of other clouds.18:47
adrian_ottofor example: http://logs.openstack.org/45/327445/3/check/gate-functional-dsvm-magnum-k8s/6505586/console.html18:47
adrian_ottoif I order a recheck, and it lands on another cloud, that same test will run in ~50 minutes.18:48
*** ociuhandu has quit IRC18:48
clarkbadrian_otto: our numbers indicate that ovh is on par with internap and bluebox18:48
clarkbwith rax and osic having an advantage18:48
*** alexey-mr has joined #openstack-infra18:48
*** sarob has joined #openstack-infra18:48
clarkbprobably owuld be helpful to have specific data poinst to track down why ovh might do a specific workload slower tha nthe others18:49
adrian_ottoit's the nested virtualization performance, mostly the I/O speed.18:49
adrian_ottohere is the same test run on internap, ran twice as fast:18:50
adrian_ottohttp://logs.openstack.org/83/333383/9/check/gate-functional-dsvm-magnum-k8s/7579fb2/console.html18:50
clarkbadrian_otto: I want to say ovh has nested virt enabled by default18:51
clarkbadrian_otto: maybe you are running into weirdness with that?18:51
clarkbmgagne: does internap have that enabled too?18:51
*** Sukhdev_ has joined #openstack-infra18:51
*** Sukhdev has quit IRC18:51
*** mdrabe has quit IRC18:51
mgagneclarkb: afaik, yes.18:51
*** mdrabe_ has joined #openstack-infra18:51
adrian_ottoso from my perspective, I see about 1/3 of our gates time out18:52
adrian_ottoand I order rechecks, and 2/3 of the time, they don;t land on OVG, and gates pass18:52
alexey-mrAJaeger: Review https://review.openstack.org/336028, project https://github.com/openstack/fuel-plugin-scaleio where is needed to: 1) Move tag v2.1.0 in master onto latest commit 9b8a987; 2) Move tag v2.0.0 in the branch fuel-package-v2 onto latest commit ec02cbb.   What should be done to make it happens?18:53
adrian_ottos/OVG/OVH/18:53
mgagneI know that we had some serious issues with older CPU generation (which we don't have in production) where the VM would just freeze/lock when nested VM are created.18:53
*** mdrabe_ has quit IRC18:53
fungii wonder if there's a way to tell qemu not to use nested virt acceleration syscalls even if the system claims to support it?18:53
adrian_ottoso in the cases where it repeatedly lands on OVH we are tie up that host for several hours multiple times18:53
clarkbfungi: there is, we do it in devstack/d-g18:53
*** e0ne has quit IRC18:54
*** mdrabe_ has joined #openstack-infra18:54
* fungi doesn't know much about how nested virt acceleration is implemented)18:54
*** e0ne_ has joined #openstack-infra18:54
clarkbadrian_otto: I would give ^ that a try to start just to rule it out18:54
adrian_ottoclarkb: ok, how can we do that?18:54
mgagne /sys/module/kvm_intel/parameters/nested -> Y18:54
*** mdrabe_ has quit IRC18:54
clarkbadrian_otto: you'd have to consult the documentation for your virtualizationtooling18:54
clarkbadrian_otto: if using nova there is a config option to tell it to use qemu rather than kvm, devstack can do tis18:55
*** mdrabe_ has joined #openstack-infra18:55
*** nwkarsten has joined #openstack-infra18:55
AJaegeralexey-mr: As I suggested in the review: Ask one of the admins here nicely for this.18:55
AJaegeralexey-mr: the problem is that this is not working as you expect.18:56
adrian_ottoOur nova instances come from the Nova Heat resource... so we would need to tweak our templates to make that work18:56
clarkbadrian_otto: I don't think so its not a user facing option, its a nova compute config so you set it at nova deployment time18:56
AJaegeralexey-mr: you cannot really move a tag, everybody that cloned the tag already will have the previous version AFAIK18:56
adrian_ottoclarkb and mgagne: ok, thanks for the tips18:57
clarkbfwiw we turn off nested virt across the board in devstack-gate because it does not work reliably18:57
*** kzaitsev_mb has joined #openstack-infra18:57
*** PollyZ has quit IRC18:57
clarkbour experience is that the VMs will just disappear18:57
clarkband never come bcak18:57
*** flepied has quit IRC18:57
*** karthik__ has joined #openstack-infra18:57
alexey-mrAJaeger: ok, let ask admin, how can I do it?18:57
*** mdrabe_ has quit IRC18:57
adrian_ottoclarkb: any chance you have a pointer to the source that you use to toggle that?18:57
AJaegeralexey-mr: just ask here ;)18:58
mgagneclarkb: FYI, our issues were with "Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz" We just don't do or schedule any nested virtualization on those anymore.18:58
fungialexey-mr: AJaeger is correct. tag deletions and replacements do not propagate via remote update. you just need to make a new tag with a higher release and move on18:58
*** mdrabe_ has joined #openstack-infra18:58
mgagnethose CPUs are/were used in our private/dev cloud18:58
AJaegeralexey-mr: why do you release at all from fuel-package-v2? That's very unusual for OpenStack...18:58
*** maishsk has joined #openstack-infra18:58
clarkbadrian_otto: we just set the devstack flag18:59
clarkbadrian_otto: are you using devstack or devstack-gate?18:59
AJaegerclarkb, I spoke on wrong channel: we seem to use 6512 jobs only, so 2500+ are extra declared.18:59
AJaeger402 of these are coverage jobs18:59
*** nwkarsten has quit IRC18:59
*** ianychoi has quit IRC19:00
*** shamail has joined #openstack-infra19:00
*** mdrabe_ has quit IRC19:00
*** mdrabe__ has joined #openstack-infra19:00
fungialexey-mr: also having the ability to push --force doesn't change the fact that git tags don't propagate via any mechanism other than push mirroring, so you have to assume people who have already cloned your repo have "incorrect" copies of that tag and base your further damage control on that19:01
fungier, i should say git tag deletions19:01
adrian_ottoclarkb: we use devstack19:01
fungior changes to existing git tags for that matter19:01
alexey-mrAJaeger: this is branch for previous fuel framework version which is not compatible with master.19:01
clarkbadrian_otto: LIBVIRT_TYPE=qemu19:02
*** PollyZ has joined #openstack-infra19:03
adrian_ottothanks clarkb19:03
*** rdx_matt has joined #openstack-infra19:03
fungialexey-mr: ignoring the tags, your other stated desire (to reset contents of branches) is harmful to anyone who has already cloned that repo since those updates won't be fast-forwardable. you should instead look into using merge commits (which we can set acls to allow you to push as long as you're careful to limit that permission to people with a _good_ grasp of git so they don't accidentally push19:04
fungimerge commits when they don't mean to)19:04
*** sarob has quit IRC19:05
*** yamamoto has joined #openstack-infra19:06
*** gordc has quit IRC19:07
*** PollyZ has quit IRC19:07
*** jsavak has quit IRC19:07
*** rdx_matt has quit IRC19:07
*** jsavak has joined #openstack-infra19:08
*** amitgandhinz has quit IRC19:08
*** amitgandhinz has joined #openstack-infra19:09
*** inc0 has quit IRC19:09
*** Nikolay_St has joined #openstack-infra19:10
AJaegerclarkb, http://paste.openstack.org/show/524321/ are the 2700+ jobs that are defined but not used in zuul19:11
*** dimtruck is now known as zz_dimtruck19:11
*** yamamoto has quit IRC19:11
*** ajmiller has quit IRC19:11
*** ajmiller has joined #openstack-infra19:12
*** javeriak has quit IRC19:12
fungiAJaeger: i guess that's ~25% of our defined jobs?19:12
fungigives us a lower bound on expectations anyway19:12
clarkbthats only 195019:13
clarkbI think paste cut you off19:13
clarkbI am still only about halfway through untangling what is necessary for python3519:13
alexey-mrfungi: thanks for clarifications, so the way is just increase version in make new tag?19:13
fungiyeah, paste truncates at a certain byte count (i forget how long exactly)19:13
*** bhavik has joined #openstack-infra19:14
*** amotoki has joined #openstack-infra19:14
fungialexey-mr: yes, you can safely add new tags for higher versions, but you can't effectively update existing tags. it's a limitation of git's distribution model19:14
fungitag deletion and replacement will propagate via push mirroring, but not via pull or remote update19:15
clarkbAJaeger: fungi we should also consider removing any job that hasn't past for a cycle19:15
*** jed56 has quit IRC19:15
clarkbs/past/passed/19:15
AJaegerfungi, clarkb any other way to share the file?19:17
*** zeih has joined #openstack-infra19:17
clarkbAJaeger: github gist, or pus ha change or do multiple pastes19:17
AJaegerwill put it somewhere after finishing a change...19:18
fungior xzip|base64|paste19:18
*** jsavak has quit IRC19:19
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Do not define unused periodic chef jobs  https://review.openstack.org/33626319:20
AJaegerone low hanging fruit: ^19:20
* clarkb has a realization19:21
AJaegerhttps://gist.github.com/ajaeger/e1a5298dc6185ffd96e37556e226009d19:21
clarkbif eg foo-python34 had a skip if and I edit it to also include foo-python35-nv that skip if match is going to overrule my voting: false?19:21
*** zeih has quit IRC19:22
AJaegerthe gist  is from a tree that has https://review.openstack.org/336154 (pypy cleanup) applied19:22
AJaegerclarkb: no, it should not.19:22
AJaegerskip-if and voting are different conditions19:22
clarkbAJaeger: I thought that we picked up the defaults though/19:23
clarkbseems like we used to run into this a lot but maybe I am misremembering19:23
AJaegerclarkb: we do not reset values either19:24
clarkbok so has to be an explicit override19:24
clarkbyay19:24
*** mdrabe__ has quit IRC19:25
*** tphummel has quit IRC19:26
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Don't try to get stack details if the stack doesn't exist  https://review.openstack.org/31933719:27
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished  https://review.openstack.org/29732819:27
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Stop piping yes to Heat  https://review.openstack.org/31773019:27
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job  https://review.openstack.org/29676519:27
*** inc0 has joined #openstack-infra19:28
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Do not define unused periodic chef jobs  https://review.openstack.org/33626319:28
*** jsavak has joined #openstack-infra19:30
*** PollyZ has joined #openstack-infra19:30
*** e0ne_ has quit IRC19:30
*** csomerville has joined #openstack-infra19:31
*** mdrabe has joined #openstack-infra19:32
karthik__Hi Guys, I am trying to setup multi-node grenade partial job for cinder19:32
karthik__I encountered the https://github.com/openstack-infra/devstack-gate/blob/master/features.yaml#L111 and realized I need to make some change here.19:33
*** bhunter71 has joined #openstack-infra19:33
karthik__To do above, I am using https://github.com/openstack-infra/devstack-gate/blob/master/features.yaml#L98-L103 as my example.19:33
karthik__Please could somebody tell what is exactly happening here(L98-L103)??19:33
*** cody-somerville has quit IRC19:34
*** alexey-mr has quit IRC19:34
*** Nikolay_St has quit IRC19:36
*** shamail has quit IRC19:36
*** tonytan4ever has quit IRC19:37
*** tqtran has joined #openstack-infra19:39
*** ajmiller_ has joined #openstack-infra19:41
clarkbdims: harlowja what is situation with tooz and the redis, memcached, postgres, and mysql tests? I thought we agreed in tokyo to remove those backends?19:42
clarkbdims: harlowja has that work happened? can we remove those jobs?19:42
*** jamesmcarthur has joined #openstack-infra19:43
clarkbkarthik__: it is specifying whichgroups of microservices t orun for the logical service19:43
*** ajmiller has quit IRC19:44
karthik__clarkb: so the logical service is neutron-adv19:46
*** daemontool_ has quit IRC19:46
clarkbyes, its the advances neutron services that provide more than just instance networking19:47
karthik__clarkb: so it picks q-lbaas & q-fwaas from github master and q-vpn from kilo??19:48
karthik__stable/kilo i.e19:48
clarkbAJaeger: fungi: the pypy switch to xenial should be ready if/when yo uare ready. I am still heads down in this python35 stuff if one of you want to appove it19:48
* AJaeger waves good bye19:48
clarkbkarthik__: no, it says if we are testing kilo then its only q-vpn, if we are testing master the nits lbaas and fwaas19:48
AJaegerfungi, ok, I'll approve and then sign off ;)19:49
*** psilvad has joined #openstack-infra19:49
fungiAJaeger: have a good evening19:50
*** tonytan4ever has joined #openstack-infra19:50
fungii'm cool with the pypy xenial switch in principal, though i haven't reviewed it19:50
*** bhavik has quit IRC19:50
fungiprinciple19:50
*** piet has quit IRC19:51
*** ddieterly is now known as ddieterly[away]19:53
clarkbAJaeger: look for this python35 change tomorrow, it is a fun one :)19:55
openstackgerritMerged openstack-infra/infra-specs: Update Artifact Signing details  https://review.openstack.org/33296819:56
*** asettle has joined #openstack-infra19:59
*** asettle has quit IRC19:59
*** jamesmcarthur has quit IRC19:59
*** dansmith is now known as unicorn_slayer19:59
clarkb 5 files changed, 1059 insertions(+), 247 deletions(-)20:00
fungiyikes20:00
*** inc0 has quit IRC20:01
openstackgerritMerged openstack-infra/infra-specs: Add wiki modernization spec  https://review.openstack.org/32845520:01
clarkbya... I probably should have split it up more20:01
openstackgerritBen Nemec proposed openstack/diskimage-builder: Generalize logic for skipping final image generation  https://review.openstack.org/33404220:01
*** ddieterly[away] is now known as ddieterly20:02
*** asselin_ has joined #openstack-infra20:02
openstackgerritMerged openstack-infra/project-config: Switch PyPy jobs to run on Xenial  https://review.openstack.org/33523820:03
openstackgerritMerged openstack-infra/bindep: Use current year for copyright  https://review.openstack.org/33561020:04
openstackgerritClark Boylan proposed openstack-infra/project-config: Add python35 jobs  https://review.openstack.org/33627220:04
clarkbfungi: ^ behold the fun20:04
*** shashank_hegde has joined #openstack-infra20:05
*** amitgandhinz has quit IRC20:05
clarkbfrickler: ^ for when you wake up tomorrow you may be interested i nthat20:05
*** PollyZ has quit IRC20:05
*** amitgandhinz has joined #openstack-infra20:05
*** tonytan4ever has quit IRC20:05
clarkbfungi: AJaeger I am going to say we probably shouldn't merge that until next week since its a long weekend for those of us in the USA20:06
*** tonytan4ever has joined #openstack-infra20:06
clarkband I can write up an email that explains the new tests and how to fix some common expected issues and how to transition to voting20:06
*** asselin has quit IRC20:06
fungiclarkb: i know i intend to make it a long weekend for me, at any rate20:07
openstackgerritMerged openstack-infra/project-config: Enable api-ref jobs in Sahara  https://review.openstack.org/31548020:07
clarkbfungi: same here, there will be barbeque and beer20:07
clarkbfungi: rumor has it there is this new beer called "America" sound sperfect for the 4th >_>20:07
*** ihrachys has joined #openstack-infra20:07
fungifish and sake here. probably not very american, but darned tasty nonetheless20:07
clarkbok time to review pypy cleanup change and all the other stuff I missed in scrollback when trying to unravel py3520:08
fungii ordered a case of that sake i like from sake one brewers in forest grove20:08
*** tqtran has quit IRC20:09
*** tqtran has joined #openstack-infra20:10
*** tonytan4ever has quit IRC20:12
*** HeOS has quit IRC20:13
*** Daisy has joined #openstack-infra20:13
*** tonytan4ever has joined #openstack-infra20:13
*** HeOS has joined #openstack-infra20:13
*** PollyZ has joined #openstack-infra20:13
openstackgerritMerged openstack-infra/system-config: Use an ordinal server naming pattern  https://review.openstack.org/32011520:14
*** tqtran has quit IRC20:15
*** bhunter71 has quit IRC20:15
*** unicorn_slayer is now known as dansmith20:15
*** tqtran has joined #openstack-infra20:15
fungiianw: you reviewed 310948 a couple days ago, and it's in need of council votes still. mind taking a peek to see if nibalizer's answers to your comments are sufficient for now? i expect he'll do a followup informal change to address a couple of nits clarkb pointed out on it anyway20:15
*** ams__ has joined #openstack-infra20:16
greghaynesfungi: sakeone?20:16
clarkbsshnaidm: reviewed, small suggestion that I think makes code easier to follow. I can aprobably be convinced to +2 as is if there was a reason for that20:16
greghaynesfungi: er, joy?20:17
clarkbheh the pypy change removes 486 jobs20:17
greghaynesfungi: I know theres some sake brewer out here20:17
clarkbmy guestimate was about right20:17
*** Daisy has quit IRC20:17
fungigreghaynes: yeah, their "g joy" genshu20:17
*** tonytan4ever has quit IRC20:17
greghaynesfungi: nice!20:17
clarkbfungi: I would drink more sake but it always gives me a hangover20:17
fungiit's hard to come by here, so i end up special ordering half a dozen 750ml bottles at a time20:17
*** tonytan4ever has joined #openstack-infra20:18
*** zeih has joined #openstack-infra20:18
*** PollyZ has quit IRC20:18
fungiclarkb: that's strange. i've noticed i can drink sake until i pass out and still not have a hangover the next day20:18
fungigranted, that takes a lot of sake, but still...20:18
mtreinishfungi: flashbacks from tokyo? :)20:19
fungimtreinish: i don't think i managed to obtain enough sake in tokyo to pass out20:19
greghaynesclarkb: maybe its just that crazy sake you brewed20:19
clarkbgreghaynes: no I only ever had a couple ounces of that stuff20:20
clarkbit never really became drinkable in bulk20:20
clarkbI should try again though20:20
openstackgerritlynxis lazus proposed openstack-infra/jenkins-job-builder: doc/definition.rst: add missing '/' into include path  https://review.openstack.org/33627420:20
openstackgerritlynxis lazus proposed openstack-infra/jenkins-job-builder: scm.py: correct indention to fix sphinx-docs warning  https://review.openstack.org/33627520:20
clarkbfungi: https://review.openstack.org/#/c/336154/2 will remove almost 500 jobs we don't use20:20
openstackgerritlynxis lazus proposed openstack-infra/jenkins-job-builder: docker-build-publish: add registry + server support  https://review.openstack.org/33627620:20
*** kzaitsev_mb has quit IRC20:20
fungiclarkb: i still need to try my hand at brewing some here. we should have a good climate for it, and i have a completely unused shed on the property that would likely be ideal20:21
clarkbfungi: it does conflict with my py35 change buts that fine since I think we can get the pypy one in today then python35 next week20:21
clarkbfungi: ya its not too hard, I just use the wrong type of rice (high quality table rice not polished)20:21
clarkbgreghaynes: fh steinbarts will sell you rice and mold from sake one20:22
clarkbgreghaynes: maybe we should try a batch with real ingredients20:22
mtreinishfungi: heh, I got a couple large bottles for free at the end of the HP party. They were just giving away what wasn't consumed20:22
greghaynesclarkb: hah, im up for it20:22
greghaynesclarkb: I don't know if I have a refined enough palette to tell good from bad sake though20:22
greghaynesclarkb: so we need to find someone who can tell us20:22
clarkbgreghaynes: ya... I think as long as it doens't taste like rotten fruit we are good20:23
fungiclarkb: i _want_ to make brown rice sake, but i will have to get good at polished rice sake first yeah20:23
*** zeih has quit IRC20:23
cineramaooh infra party20:23
*** kzaitsev_mb has joined #openstack-infra20:24
fungii think i've had pretty much every sake you gan get imported here in the states as well as all the nationally distributed domestics, so i could probably grade it for you but i don't expect to end up in the pacnw any time soon20:24
*** PollyZ has joined #openstack-infra20:24
greghayneshrmm, I wonder if its legal to ship that20:24
openstackgerritAles Komarek proposed openstack-infra/project-config: Publish docs for opesntack-salt  https://review.openstack.org/33546620:24
*** csomerville has quit IRC20:24
clarkbgreghaynes: not with usps, but if you don't tell ups or fedex its "fine"20:24
fungiheh20:25
*** tphummel has joined #openstack-infra20:25
*** annegentle has quit IRC20:25
*** gyee has joined #openstack-infra20:26
fungipypy job cleanup change has been approved20:26
*** ddieterly is now known as ddieterly[away]20:26
clarkbit is actually illegal to ship alcohol with usps20:26
*** sputnik13 has joined #openstack-infra20:27
clarkbbut only against policy for fedex/ups :)20:27
fungidid the zuul-launchers get restarted today? i'm not seeing any graphs on the e-r page20:27
clarkbfungi: I don't think they did. I am happy to work on that now if someone points me at the right way to do it20:27
fungipabelanger: did your playbook merge yet?20:27
openstackgerritMathieu Mitchell proposed openstack-infra/project-config: Bump VM memory for latest stable CoreOS IPA  https://review.openstack.org/33627820:27
*** kzaitsev_mb has quit IRC20:28
*** piet has joined #openstack-infra20:28
jokke_greghaynes: I think it's just matter of practise :P20:28
greghaynesjokke_: Yea, I really should pracice moe20:28
greghaynespractice, even20:29
fungipabelanger: oh, i guess it did!20:29
fungiclarkb: http://git.openstack.org/cgit/openstack-infra/system-config/tree/playbooks/restart_zuul_launchers.yaml20:29
openstackgerritMerged openstack-infra/puppet-nodepool: Conditionally install build-essential  https://review.openstack.org/32458020:29
jokke_indeed practice ;)20:29
*** Daisy has joined #openstack-infra20:29
clarkbfungi: does that wait for all jobs to finish on each one like the jenkins stuff used to do?20:30
fungiclarkb: yep20:30
*** coreycb has quit IRC20:31
*** coreycb has joined #openstack-infra20:31
fungiclarkb: there's been further discuasion about adding a transition around maybe 60 minutes to just ungracefully restart if jobs are still running (and those handful of jobs should get rescheduled by zuul automatically at that point)20:32
fungier, discussion20:32
clarkbcool I will fire that off in screen on puppetmaster20:32
fungibut right now it's just a graceful restart with a wait of slightly over 3 hours to be extra sure20:32
fungii'm not sure what happens if it reaches that 3h10m timeout in the play20:33
fungiwhether it continues with the next in sequence anyway or just ceases iterating20:33
*** Daisy has quit IRC20:34
fungibut pabelanger has used it successfully at least once already, probably more20:34
openstackgerritMathieu Mitchell proposed openstack-infra/project-config: Introduce experimental job to test TinyIPA with less RAM  https://review.openstack.org/32799420:35
*** shashank_hegde has quit IRC20:38
openstackgerritMerged openstack-infra/project-config: Remove pypy job from python-jobs  https://review.openstack.org/33615420:39
clarkbI think it stops entirely20:40
clarkbok that file isn't in /etc/ansible/playbooks20:41
clarkbI am guessing we don't install all our playbooks there20:41
* clarkb pulls system-config20:41
*** piet has quit IRC20:41
openstackgerritMerged openstack-infra/system-config: Remove jjb playbook  https://review.openstack.org/33143920:41
*** adrian_otto has quit IRC20:41
*** rcernin has joined #openstack-infra20:41
*** aeng has joined #openstack-infra20:42
*** bhavik has joined #openstack-infra20:42
*** adrian_otto has joined #openstack-infra20:42
*** kgiusti has left #openstack-infra20:43
*** ricky3 has left #openstack-infra20:44
*** shashank_hegde has joined #openstack-infra20:46
*** adrian_otto has quit IRC20:46
clarkbok that playbook is running now20:48
*** ddieterly[away] is now known as ddieterly20:48
karthik__clarkb: thanks... any idea what a primary and sub means when it comes to devstack-gate testing20:48
clarkbkarthik__: primary is the one attached to the testing machinery, then you have N subs that are not directly attached and are managed by the primary20:48
clarkbkarthik__: in our case we do one primary and one sub20:48
*** sree has joined #openstack-infra20:50
karthik__clarkb: so they managed by installing puppet on them?20:51
clarkbits arbitrary all nodepool does is setup ssh between them20:51
karthik__they sub nodes i mean20:51
clarkbthe existing grenade tests use grenade/devstack to manage them20:51
clarkbfatal: [zl03.openstack.org]: FAILED! => {"failed": true, "msg": "Failed to connect to the host via ssh."}20:55
clarkbwat20:55
*** sree has quit IRC20:55
clarkblooks like I will have to manually wait for that zuul launche rto stop then start it again?20:55
*** nwkarsten has joined #openstack-infra20:58
pabelangerfungi: yup, I've used it atleast 3 times20:59
pabelangerfungi: twice it has run overnight while I was asleep21:00
*** hrubi has quit IRC21:00
*** rfolco has quit IRC21:01
*** eharney has quit IRC21:01
*** hrubi has joined #openstack-infra21:01
clarkbpabelanger: ok it just failed on me see above21:01
clarkbnot sure if I should rerun it with a --limit to the remaining hosts21:02
* clarkb tries21:02
*** raildo is now known as raildo-afk21:02
pabelangerclarkb: where are you running the playbook from?21:02
*** nwkarsten has quit IRC21:02
clarkbpuppetmaster21:03
clarkbit died on the wait step21:03
pabelangerclarkb: if you internet connection is good, I'd recommend your local desktop21:03
clarkbso I will have to manually start zl03 when it stops21:03
clarkbpabelanger: why not puppetmaster?21:03
pabelangerclarkb: you shouldn't need to pin to puppetmaster. I've also have bad SSH attempts in general from our puppetmaster21:04
pabelangerI fine my personal internet connection better21:04
clarkbright, it just seems odd that you would recommend random consumer isp over host in the same datacenter21:04
openstackgerritPaul Belanger proposed openstack-infra/project-config: Revert "Add experimental wheel-build-ubuntu-xenial-amd64 job"  https://review.openstack.org/33628921:05
*** rdx_matt has joined #openstack-infra21:05
pabelangerpossible I got lucky, but both times is ran for 12+hours, I used my locally connection21:06
pabelangerwhen I ran on puppetmaster, I had to --limit my attempts21:06
clarkbits already limited to doing one host at a time21:06
pabelangerOh, ya, my runs didn't use --limit21:07
pabelangerI was happy when it ran 12 hours without an issue21:07
*** psilvad has quit IRC21:08
clarkbI have it rerunning against the remaineder will try to keep an eye on it and 0321:08
fungiworth noting, we _have_ observed network connectivity issues between instances in dfw (similar to ord) which don't exhibit over the internet from other providers to those rackspace regions21:08
clarkbhuh so it is possibly an in DC issue21:09
fungii have a feeling the host-to-host communication in those data centers is just blighted with something that doesn't impact their communication through their provider edge21:09
openstackgerritPaul Belanger proposed openstack-infra/project-config: Set wheel-build-ubuntu-xenial-amd64 voting  https://review.openstack.org/33629121:10
pabelangerpossible21:10
pabelangeralso, ^ makes our xenial wheel-builds voting21:10
fungibut so far i've been unable to successfully "trap" an instance exhibiting that behavior over any period of time such that i could point them at it. apparently giving them uuids of instances where we logged failed traceroutes and connections is insufficient for post mortem reconstruction21:11
clarkbvoting? you mean periodic?21:11
pabelangervoting21:11
pabelangerwe already have periodic and post jobs properly setup21:12
* clarkb doesn't know what voting is for21:12
pabelangerI just made them non-voting to start not to affect release process21:12
clarkbbut they don't run in check or gate right?21:12
pabelangerOh21:12
pabelangerya, that is true21:12
fungiwell, having jobs nonvoting in the release pipeline doesn't really impact anything regardless21:12
pabelangerso, non-voting never did anything in that case21:12
clarkbya I think its a noop21:12
pabelangerya, forgot about that21:13
*** rdx_matt has quit IRC21:13
fungiit might mark them as "non-voting" in the status display, but aside from that, no real effect21:13
pabelangerso, we can either merge that, to keep them the same, or just ignore it21:13
*** asselin__ has joined #openstack-infra21:13
clarkbI +2'd it I think its cleanre to not set a noop option21:13
fungiand i approved it for the same reason21:14
*** akshai has quit IRC21:16
*** esberglu has quit IRC21:16
*** asselin_ has quit IRC21:18
*** ddieterly is now known as ddieterly[away]21:18
*** zeih has joined #openstack-infra21:19
*** ldnunes has quit IRC21:19
clarkbfungi: random tidbit now that I am catching up on email. the offline when complete flag is actually not well named because it offlines on job start :) this avoids a race between job ending, node going offline, and new job starting21:20
*** ddieterly[away] is now known as ddieterly21:20
fungiclarkb: it does? the jenkins ui only showed it offline once the job completed21:21
fungiback when we had a jenkins that is21:21
clarkbya because it won't change the visible state until the job completes iirc but we se tthe flag on start21:21
clarkbits weird and has to do with order of ops to avoid races21:21
*** tonytan4ever has quit IRC21:21
fungii thought it got serialized in that thread, so the next operation after the job run operation returned control was to offline, and that prevented jenkins from ever being able to get a word in edgewise (because it was all in the same thread)21:23
fungibut i'll admit it's been a while since i (tried to) read the code for it21:23
*** zeih has quit IRC21:23
clarkbfungi: the problem is jenkins could start another job from a different thread iirc21:23
*** trown is now known as trown|outtypewww21:23
clarkbfungi: it may require you to also run jobs with jenkins' scheduler21:24
clarkbwhich we don't do21:24
fungiahh21:24
*** edmondsw has quit IRC21:24
*** ffrank has joined #openstack-infra21:24
fungiwell, at this point it's academic (for us) i guess21:24
fungii don't care enough about the nuance to go back and try to reread the source for it. so much java21:25
fungibut feel free to reply to my reply with a correction21:25
fungii'm mostly winding down my evening. after i go see if i can turn up any logstash entries with corrected job result fields21:26
*** Sukhdev_ has quit IRC21:26
*** bhavik has quit IRC21:28
*** otherwiseguy has quit IRC21:28
*** notmyname has quit IRC21:28
*** lucas-afk has quit IRC21:28
*** notmyname_ has joined #openstack-infra21:28
fungiyep!21:28
*** pkoniszewski_ has joined #openstack-infra21:28
*** lucasagomes has joined #openstack-infra21:28
*** notmyname_ is now known as notmyname21:29
*** pkoniszewski has quit IRC21:29
*** otherwiseguy has joined #openstack-infra21:29
fungihuh, build_status:SUCCESS returns a bunch of results starting around 15:15 utc21:30
fungier, 16:15 utc21:30
fungidid one of our zuul-launchers get started early?21:30
fungiall seem to be for zlstatic0121:30
clarkbtaht one was first and fast21:31
clarkbbut I did it at2000 ish21:31
*** Sukhdev has joined #openstack-infra21:31
fungiyeah. i wonder if it already got restarted earlier for some reason21:31
fungizeroing in on results from the time where those started showing up but not after your restart, they're all on zlstatic0121:32
*** Shalmazar has joined #openstack-infra21:33
*** ayoung has quit IRC21:34
*** yamahata has quit IRC21:34
*** Madasi has quit IRC21:34
*** Shalmazar is now known as Madasi21:34
fungipabelanger: you were logged into zlstatic01 from 14:44 - 16:22 today and used su a few times, so we're missing a good sudo audit trail... did you restart zuul-launcher there?21:35
fungioh, there it is. i'm just blind21:35
fungiJun 30 16:21:01 zlstatic01 sudo: pabelanger : TTY=pts/1 ; PWD=/home/pabelanger ; USER=root ; COMMAND=/usr/sbin/service zuul-launcher restart21:35
fungiso that explains the logs21:35
fungianyway, seems like that patch worked21:36
fungiwe've been running with it half the day21:36
clarkbcool and slowly we should get it everywhere21:37
*** camunoz has joined #openstack-infra21:37
pabelangerfungi: I did, I needed to do it for xenial wheel-build21:37
pabelangerfungi: I added an event to our status page about it too21:38
fungipabelanger: awesome--thanks!21:38
*** piet has joined #openstack-infra21:38
fungiindeed you did. i missed that as well21:38
fungianyway, think i'm going to go on silent running for the evening. i may be around if any emergencies crop up so feel free to try to raise me. tomorrow i intend to launch signing01.ci.openstack.org and prep for the static.o.o and zuul.o.o trusty upgrades21:39
clarkbI will finish up these restarts21:39
pabelangerI expect to be around pretty minimal tomorrow, but plan to check IRC every few hours21:39
clarkbI have to hand over keys tomorrow for old place but will be around otherwise21:40
fungipabelanger: you should be enjoying your holiday21:40
clarkbis ir canada day too?21:40
pabelangerYup21:40
pabelangerpraise be to the Queen21:41
clarkbI recommend a can of America21:41
fungireviews of 333529 and 333065 would help me on the artifact-signing if any infra reviewers get bored (pabelanger has already reviewed them--thanks!)21:41
*** HenryG_ has joined #openstack-infra21:41
fungiall glory to the hypnoqueen21:41
*** thorst_ has quit IRC21:42
fungimonday i'll celebrate the independence of my nation by watching our local municipalities blow up small parts of it21:42
harlowjaclarkb i'll get u back an answer on the tooz question soon :)21:43
clarkbharlowja: tyty21:43
bkerofungi: Think they'll set any parts of your municipality on fire this time?21:43
*** jroll|dupe has joined #openstack-infra21:44
*** jroll|dupe has quit IRC21:44
*** jroll|dupe has joined #openstack-infra21:44
clarkbwoo zl06 failed too21:44
*** rbrndt_ has quit IRC21:45
*** matt-borland has quit IRC21:45
*** rwsu has quit IRC21:45
*** thiagop has quit IRC21:45
*** iurygregory has quit IRC21:45
*** mordred has quit IRC21:45
*** bradm_ has quit IRC21:45
*** HenryG has quit IRC21:45
*** dulek has quit IRC21:45
*** mkoderer__ has quit IRC21:45
*** jroll has quit IRC21:45
*** ianw has quit IRC21:45
*** strigazi has quit IRC21:45
*** trown|outtypewww has quit IRC21:45
*** hogepodge has quit IRC21:45
*** hamzy has quit IRC21:45
*** mkoderer has quit IRC21:45
*** gothicmindfood has quit IRC21:45
*** jroll|dupe is now known as jroll21:45
clarkboh its asyncing21:45
clarkbwich we know is all kinds of broken21:45
clarkbmaybe we should have it do a synchronous wait?21:46
clarkbpabelanger: ^?21:46
fungibkero: nah, we leave that to the state department of transportation (apparently our most recent wildfire was started by a ncdot worker)21:46
pabelangerclarkb: we can try, but think it will still fail if unable to SSH between attempts21:46
*** yamahata has joined #openstack-infra21:47
clarkbpabelanger: it wil leither fail the first time or get connected, I don't think it ressh's like async21:47
pabelangerI'd actually like to have an option if we are polling or looping to ignore SSH failures and retry to poll / loop up until the actually timeout value. Then report a failure or not21:47
*** adrian_otto has joined #openstack-infra21:47
pabelangerclarkb: Hmm, I think the SSH connections still happen21:48
pabelanger_think_21:48
pabelangerwould need to check again21:48
*** mdrabe has quit IRC21:48
clarkbpabelanger: if thats the case then async is a noop here21:49
fungibkero: "accidental ignition resulted from a right-of-way maintenance operation"21:49
fungi15,453 acres21:49
bkerojesus21:49
bkerofungi: I wonder what caused it in less official terms21:50
fungi50% of it was in the wildlife refuge21:50
bkero"I was welding a rail shift lever on a REALLY hot day, and some sparks caused a fire."21:50
bkero:'(21:50
fungi" Officials say that dead grass or leaves can ignite when stones or other metal debris strike the mowing blades."21:50
fungihttp://www.witn.com/home/headlines/Us-264-closed-in-Hyde-County-due-to-forest-fire-376112551.html21:50
clarkbok trying no async on zl0121:50
bkeroThey were mowing a wildlife refuge?21:51
fungiclearing right of way for a highway apparently21:51
funginot sure if new construction or just mowing the sides of the existing highway21:51
clarkbpabelanger: "By default tasks in playbooks block, meaning the connections stay open until the task is done on each node." so would be surprised if wait_for doesn't do that21:51
greghaynesFor our zuul experts - we are trying to make use of $ZUUL_REF in a devstack plugn but it doesnt appear to be set. Is there some known obvious reason this shouldnt work? this is re: https://review.openstack.org/#/c/335680/2/devstack/plugin.sh21:51
clarkbbut not too surprised because ansible does funny things in inconsistent ways21:52
docaedofungi: if we had the flying cars we were promised years ago, we wouldn't need new highways damnit21:52
*** kzaitsev_mb has joined #openstack-infra21:52
clarkbgreghaynes: the env is sanitized when devstack is started21:52
greghaynesclarkb: argh21:52
clarkbgreghaynes: you hvae to presetup the repo for devstack21:52
clarkbthis is intentional21:52
fungigreghaynes: clarkb: also, that envvar is known to the jenkins user, but wouldn't i don't think convey to the stack user21:52
*** HenryG_ is now known as HenryG21:52
clarkbbasically devstack has a config and we configure it21:53
greghaynesclarkb: Yea, I can kind of grok why, but we actually do need that var. Is that plopped down on disk somewhere?21:53
clarkbwe don't pass through config for other things21:53
clarkbgreghaynes: why do you need it?21:53
clarkbd-g will check it out in every repo for you ahead of time21:53
greghaynesbecause we are building a dib image and that dib image uses source-repositories to grab the rpo21:53
greghaynesyea, so we can clone it out of the localfs21:53
clarkbya so just grab the preset repo21:53
greghaynesthat is an alternative21:53
clarkbits already handled for you21:53
*** sdake_ has joined #openstack-infra21:53
*** sdake_ has quit IRC21:53
*** sdake_ has joined #openstack-infra21:53
clarkbI don't think dib is special here21:54
clarkbevery source repo is configured for devstack by d-g when running under zuul21:54
fungiright, any projects which have a relevant zuul_ref available on the assigned merger will have it checked out for you in /opt/stack already, and those that don't will have the appropriate branch tips checked out instead21:54
greghaynessure, it just already has the machinery to do this too and its nice to exercise it21:54
clarkbgreghaynes: it shouldn't have that machinery though21:54
greghaynesIt exists for non zuul cases as well21:54
clarkbya you just use the devstack git clone21:55
clarkbthis isn't a special thing its solved and used all over the place21:55
greghaynesDo you know where on the local fs the repo gets plopped down?21:55
*** rvba has quit IRC21:55
fungigreghaynes: /opt/stack/new/reposhortname21:55
greghaynesawesome, thanks21:55
clarkbgreghaynes: /opt/stack/new in our case, there is a devstack var to use though21:55
greghaynesah21:55
openstackgerritKarthik Prabhu Vinod proposed openstack-infra/devstack-gate: Enabling Cinder multinode testing  https://review.openstack.org/32761921:56
clarkbbasically devstack knows how to do the simple case repo setp21:56
fungiright, you can configure it to be somewhere else if you want21:56
clarkbif a repo is already ther ethe ndevstack will noop21:56
zxiirocan someone remind me what happens if you workflow+1 then jenkins fails? does it reset workflow?21:56
clarkbzxiiro: it doesn't, jenkins/ci don't have voting rights on worfklow21:57
fungizxiiro: no, but in that case you can just leave a recheck comment if you need21:57
clarkbgreghaynes: look at how the nodepool devstack plugin works21:57
clarkbgreghaynes: since its the same thing there21:57
greghaynesah, ok21:57
fungizxiiro: basically it continues to be considered "approved" so anyone can leave a recheck comment to retry its jobs and give it another pass at the gate21:58
zxiiroah so how's it know to reattempt merge? I guess it also triggers on code-review+2 and verified+1 votes then?21:58
*** nwkarsten has joined #openstack-infra21:59
clarkbzxiiro: yes it checks submittable state on +222:00
fungiright, if it sees that there's a workflow +1 and a code-review +2 and no workflow -1 and no code-review -2 when the jenkins/zuul account leaves a verify +1 vote, i will enqueue into the gate pipeline22:01
fungiwell, and it also confirms that the change's dependencies (either direct git parent or depends-on entries in the commit message) are already enqueued22:02
*** nwkarsten has quit IRC22:04
*** acoles is now known as acoles_22:04
fungiand it has some logic to automatically enqueue dependencies if similar conditions are met on them22:05
fungiand dependents as well22:05
*** ddieterly is now known as ddieterly[away]22:05
*** mriedem has quit IRC22:07
*** kzaitsev_mb has quit IRC22:07
*** Ravikiran_K has quit IRC22:10
*** kien-ha has joined #openstack-infra22:16
*** julim has joined #openstack-infra22:16
*** piet has quit IRC22:16
*** Sukhdev_ has joined #openstack-infra22:16
*** Sukhdev has quit IRC22:16
*** thorst_ has joined #openstack-infra22:16
*** kzaitsev_mb has joined #openstack-infra22:17
*** rhallisey has quit IRC22:17
*** tpsilva has quit IRC22:18
zxiirothanks!22:19
clarkbso far the removed async is happy22:19
clarkbif this works for me I will push a change to the playbook22:19
*** zeih has joined #openstack-infra22:20
clarkbthere are 5 and 6 nodes in use on zl03 and zl06 respectively so hopeflly we get those restarted soon22:20
*** thorst_ has quit IRC22:20
*** thorst_ has joined #openstack-infra22:21
openstackgerritKen'ichi Ohmichi proposed openstack-infra/tripleo-ci: Use tempest.lib tenants_client  https://review.openstack.org/33630422:21
*** mordred has joined #openstack-infra22:22
*** derekh has joined #openstack-infra22:22
*** kzaitsev_mb has quit IRC22:24
*** zeih has quit IRC22:24
*** bhavik has joined #openstack-infra22:26
openstackgerritMerged openstack-infra/tripleo-ci: Refactor common code for tripleo-ci  https://review.openstack.org/33562222:28
openstackgerritMerged openstack-infra/tripleo-ci: Add support for OVB based CI  https://review.openstack.org/33478722:29
*** hashar has quit IRC22:29
*** thorst_ has quit IRC22:29
*** kzaitsev_mb has joined #openstack-infra22:33
*** sdake_ has quit IRC22:33
*** vhosakot has quit IRC22:34
*** pradk has quit IRC22:34
*** salv-orl_ has joined #openstack-infra22:34
*** salv-orlando has quit IRC22:35
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [WIP] Update to use quintupleo  https://review.openstack.org/33630922:35
*** ddieterly[away] is now known as ddieterly22:36
*** asselin__ has quit IRC22:37
*** jamielennox|away is now known as jamielennox22:37
*** rossella_s has quit IRC22:39
*** rossella_s has joined #openstack-infra22:39
*** karthik__ has quit IRC22:41
openstackgerritClark Boylan proposed openstack-infra/zuul: Make job registration with labels optional  https://review.openstack.org/33631122:41
mtreinishclarkb: did we apply the zuul launcher change? I'm still not seeing any hits on the e-r page22:43
clarkbmtreinish: it is getting applied now22:43
clarkbbut restarts are slow due to long running tests22:43
mtreinishclarkb: ok cool22:43
*** kzaitsev_mb has quit IRC22:43
*** bhavik has quit IRC22:45
openstackgerritBrad P. Crochet proposed openstack-infra/tripleo-ci: Use tripleo-build-images for CI  https://review.openstack.org/33631222:45
*** signed8bit has joined #openstack-infra22:50
*** kzaitsev_mb has joined #openstack-infra22:55
clarkbmtreinish: ok first zuul launcher is done22:56
clarkbtwo more in progress then I will start the remainder with my patched playbook as it seems to be working22:56
mtreinishclarkb: ok cool, thanks22:57
mtreinishhopefully e-r will start showing results soon22:57
mtreinishthe funny thing is openstack-health is showing e-r hits because it doesn't filter on status just to a build_uuid22:58
*** piet has joined #openstack-infra22:58
mordredclarkb: morning! how's things?22:58
mordredclarkb: I miss anything good?22:58
*** tqtran has quit IRC22:59
clarkbmordred: not a whole lot, we are trying to do spring cleaning in our jobs because apparently we are near our registration limit22:59
clarkbmordred: I also just wrote https://review.openstack.org/#/c/336311/1/zuul/launcher/ansiblelaunchserver.py as a hack around that23:00
mordredclarkb: like, near the gear registration limit?23:00
clarkbmordred: ya23:00
*** geekinutah has joined #openstack-infra23:00
mordredwow23:00
clarkbAJaeger: removed pypy from projects that don't run those jobs and cleaned up 500 jobs23:00
clarkbI have a patch up to add in python35 testing which will add a bunch23:01
clarkbcurrently restarting zuul launchers to pick up a build status format fix23:01
clarkbwhich should fix e-r23:01
*** ddieterly is now known as ddieterly[away]23:02
*** ddieterly[away] has quit IRC23:02
mordrednod23:02
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Add gate-tripleo-ci-centos-7-ovb-ha in list of jobs  https://review.openstack.org/33631423:03
clarkbmordred: on the zl restart front I have a questio nabout ansible behavior23:03
*** tqtran has joined #openstack-infra23:03
clarkbmordred: https://git.openstack.org/cgit/openstack-infra/system-config/tree/playbooks/restart_zuul_launchers.yaml#n13 uses async. when run from puppetmaster it regularly fails on unable to ssh23:03
clarkbmordred: I have removed the asnyc and its much happer. wait_for will use a single connection without a wait_for right?23:04
*** asettle has joined #openstack-infra23:04
clarkbanyways I think that I will try to keep pushing on the use xenial, python35 type work while I finish up houes things as I am able to page it in an out relatively easily23:04
clarkbunlike say all of the random zuul launcher work23:05
mordredclarkb: yah - I believe so? also - the fails, is that "it fails and logs it alot and moves on? or it fails and bails?"23:05
clarkbmordred: it fails and bails and makes clarkb sad23:05
mordredboo23:05
mordredare we running with my ansible patch?23:05
clarkbso I have a run of that against a single host if that works its getting rerun against the rest23:05
clarkbmordred: no this is puppetmaster to zuul launchers not zuul launchers to jobs23:05
mordredahhh. well, I donb't think my patch would affect this anyway - but it makes me think it's another way async could be made more resilient23:06
openstackgerritMerged openstack-infra/tripleo-ci: Add gate-tripleo-ci-centos-7-ovb-ha in list of jobs  https://review.openstack.org/33631423:06
mordredclarkb: I believe wait_for without the async should work great23:06
clarkbyes definitely, pabelanger was mentioning that it should just retry again until the timeout or some fail count threshold23:06
mordredagree23:06
mordredI wanna chat with the ansible core folks about timeouts in playbooks more generally23:07
mordredbut haven't had the chance yet23:07
*** tqtran_ has joined #openstack-infra23:07
clarkbI am hoping that after we celebrate murica day we can make some big progress on the xenial/python35 front23:07
clarkbwill be so nice when we don't have to juggle all the init systems23:07
mordred+100023:07
*** tqtran has quit IRC23:07
*** thorst_ has joined #openstack-infra23:08
mordredI mean, still not a fan of systemd -  but I'd rather _only_ systemd to systemd+upstart+sysvinit23:08
clarkbyes exactly23:08
*** amotoki has quit IRC23:08
clarkbI am still a bit grumpy about journald falling over on our git hosts23:08
*** thorst_ has quit IRC23:08
*** zzelle_ has quit IRC23:09
mordredclarkb: but what could possibly go wrong with binary logging at the system level???23:09
mtreinishjeblair: just hit another gertty traceback: http://paste.openstack.org/show/524345/ it wasn't fatal, but it brought up the error box next to the sync count23:09
clarkbmordred: well as we learned everything :)23:09
mtreinishand it wasn't the normal random connection timeout I normally see for that23:09
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Remove the containers job from the ci status page  https://review.openstack.org/33591623:09
*** thorst_ has joined #openstack-infra23:09
*** ayoung has joined #openstack-infra23:09
*** amotoki has joined #openstack-infra23:10
*** asettle has quit IRC23:10
clarkbmordred: unrelated, but can I say that the need for multiple params to use become is silly23:10
*** piet has quit IRC23:10
*** sdake has joined #openstack-infra23:11
*** sdake has quit IRC23:11
*** abregman has quit IRC23:11
*** karthik__ has joined #openstack-infra23:11
clarkbmordred: should just be 'become: root' done23:13
mordredclarkb: ++23:13
*** Sukhdev_ has quit IRC23:16
*** thorst_ has quit IRC23:18
*** Sukhdev has joined #openstack-infra23:18
clarkbwaiting for jobs to finish is like watching paint dry23:18
openstackgerritClark Boylan proposed openstack-infra/system-config: Do not use async with zl restarter playbook  https://review.openstack.org/33631723:18
clarkbmordred: ^23:18
*** mriedem has joined #openstack-infra23:18
mgagneI'm not familiar with code coverage in gate. Is it basically the same as unit tests but with coverage enabled and report published?23:20
*** zeih has joined #openstack-infra23:20
clarkbmgagne: yes23:21
*** jsavak has quit IRC23:21
mgagnewhy would a project run unit tests twice?23:21
clarkbmgagne: because unit tests have historically been too slow to run under coverage23:21
clarkbneutron used to take an hour without coverage23:21
*** markvoelker has quit IRC23:21
clarkbso we did it in the post queue ot track coverage as code merged but didn't do it upfront23:22
*** tqtran has joined #openstack-infra23:22
mgagneclarkb: right. I see that not all projects enable coverage. If it is enabled, why are they still running non-coverage jobs then?23:22
clarkbmgagne: are projects running it in check/gate?23:22
mgagnehttps://review.openstack.org/#/c/335644/23:23
clarkbI know of one or two that do but thats it23:23
mgagnefor example, magnum23:23
mgagnebut it's non-voting23:23
clarkbwe did it with nodepool to be explicit about if we were adding coverage as we added tests23:23
clarkbmgagne: for magnums case they could just run their normal unittests under coverage if they wanted and drop the coverage job23:24
*** tqtran_ has quit IRC23:24
mgagneclarkb: ok so no technical reasons outside "we didn't bother looking into it"23:24
clarkbya I don't think there is a good technical reason23:24
mgagneor some jobs are always enabled (like unit without coverage) unlike coverage which makes it difficult to opt-out of those jobs23:24
clarkbmgagne: right thats why my suggestion for projects that want to have coverage and a single unittest job would be to just get coverage on their normal unittest runs. Thats a tox config23:25
mgagnealright. I think that answers the question. thanks!23:25
*** zeih has quit IRC23:25
mgagneyou can go back to watching paint dry =)23:26
*** signed8bit is now known as signed8bit_Zzz23:26
*** tqtran_ has joined #openstack-infra23:27
*** ihrachys has quit IRC23:29
*** tqtran has quit IRC23:29
*** kzaitsev_mb has quit IRC23:30
*** yamahata has quit IRC23:36
*** baoli has quit IRC23:42
*** sputnik13 has quit IRC23:43
*** thorst_ has joined #openstack-infra23:44
*** amotoki has quit IRC23:44
clarkband now zl06 is done. just waiting on 01 to finish then I can start a playbook run for all of the remainder23:45
*** erlon has quit IRC23:46
*** derekh has quit IRC23:47
*** IlyaG has joined #openstack-infra23:53
*** thorst_ has quit IRC23:54
*** PollyZ has quit IRC23:54
*** kien-ha has quit IRC23:54
*** thorst_ has joined #openstack-infra23:55
*** tphummel has quit IRC23:56
*** hogepodge has joined #openstack-infra23:59
*** xarses has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!