Friday, 2017-02-10

*** baoli has quit IRC00:00
*** esikachev has joined #openstack-infra00:00
*** david-lyle_ has joined #openstack-infra00:00
*** tphummel has joined #openstack-infra00:03
clarkbcool I +2'd both changes. Don't really want ot babysit that while I am babysitting bup. Feel free to approve as you are able00:03
clarkboh second change might not have two +2s00:03
mordredclarkb: I'll approve tomorrow00:04
*** esikachev has quit IRC00:05
openstackgerritIan Wienand proposed openstack-infra/project-config master: Add -nv coverage jobs, convert existing non-voting tests  https://review.openstack.org/43178300:05
clarkbreview.o.o is still going fwiw00:05
*** EricGonczer_ has joined #openstack-infra00:05
*** EricGonczer_ has quit IRC00:07
openstackgerritIan Wienand proposed openstack-infra/project-config master: Add diskimage-builder coverage jobs  https://review.openstack.org/42165800:08
*** rbuzatu has joined #openstack-infra00:08
*** david-lyle has joined #openstack-infra00:09
openstackgerritMerged openstack-infra/tripleo-ci master: Use only RAMWeigher for rh1 scheduling  https://review.openstack.org/43163600:09
*** salv-orlando has quit IRC00:10
*** xarses has quit IRC00:10
mriedemis newton running on trusty or xenial now?00:13
clarkbxeniql00:14
openstackgerritBen Kero proposed openstack-infra/project-config master: Add experimental jobs for TripleO OOOQ Multinode scenario 2-4  https://review.openstack.org/43178600:14
mriedemok00:14
*** esikachev has joined #openstack-infra00:16
openstackgerritBen Kero proposed openstack-infra/project-config master: Add experimental jobs for TripleO OOOQ Multinode scenario 2-5  https://review.openstack.org/43178600:16
*** baoli has joined #openstack-infra00:17
*** maratoid_ has quit IRC00:19
*** gongysh has joined #openstack-infra00:19
*** dimtruck is now known as zz_dimtruck00:19
openstackgerritIan Wienand proposed openstack-infra/project-config master: Skip all dsvm jobs for diskimage-builder docs changes  https://review.openstack.org/43178900:20
*** david-lyle has quit IRC00:20
*** esikachev has quit IRC00:20
*** esikachev has joined #openstack-infra00:23
*** adrian_otto has joined #openstack-infra00:24
*** david-lyle_ has quit IRC00:25
*** yujunz has joined #openstack-infra00:26
*** baoli has quit IRC00:27
clarkbgoing to get back to restarting elasticsearch nodes to see if that will knock the failed shard initialization loose00:30
clarkbhave dont 05 06 and 07. Doing 04 now00:30
*** esikachev has quit IRC00:30
*** Julien-zte has joined #openstack-infra00:35
*** vhosakot has quit IRC00:36
*** mriedem has quit IRC00:39
*** wolverineav has quit IRC00:39
*** wolverineav has joined #openstack-infra00:40
*** apetrich has quit IRC00:42
*** rbuzatu has quit IRC00:42
*** apetrich has joined #openstack-infra00:42
*** wolverineav has quit IRC00:44
*** rajinir_ has quit IRC00:50
*** rhallisey has quit IRC00:53
*** baoli has joined #openstack-infra00:53
*** notmyname has quit IRC00:57
*** tphummel has quit IRC00:57
*** rlandy has quit IRC00:58
*** GregHouse has quit IRC00:59
*** apetrich has quit IRC01:00
*** notmyname has joined #openstack-infra01:01
*** wolverineav has joined #openstack-infra01:01
*** thorst_ has joined #openstack-infra01:03
harlowjaqq, i'm trying to share http://docs.openstack.org/infra/publications/ but most are 404ing just wanted to check if that's known?01:04
*** apetrich has joined #openstack-infra01:04
*** GregHouse has joined #openstack-infra01:05
clarkbI don't think its known. Best guess at a cause is the afs switchover though01:05
*** jamesdenton has joined #openstack-infra01:05
clarkbjeblair: AJaeger do we need marker files for ^ too? I am still not sure I fully grok how all that works01:05
*** thorst_ has quit IRC01:06
*** wolverineav has quit IRC01:06
*** jamielennox is now known as jamielennox|away01:07
clarkbharlowja: the https://git.openstack.org/cgit/openstack-infra/publications/ repo has the contents in the various branches if yo uneed them now01:07
harlowjaclarkb not needed immediatly01:07
* clarkb is cloning openstack-manuals to see if I can grok how the markers are supposed to work01:07
fungiharlowja: in the short term they should be findable through http://files.openstack.org/ until we recopy them too01:07
harlowjajust wanted to let folks know :)01:07
harlowjak01:07
*** sdague has quit IRC01:08
fungiharlowja: but yeah, had no clue we missed them in the docs site move. thanks for the heads up!01:08
harlowjanp01:08
clarkbhrm just browsing that repo I don't see markers in the source01:10
*** dave-mccowan has joined #openstack-infra01:11
*** Julien-zte has quit IRC01:11
*** wolverineav has joined #openstack-infra01:11
*** oomichi has quit IRC01:12
clarkbso we need the infra publications to leave a marker file?01:12
clarkbin the root of their docs?01:12
*** yuanying has quit IRC01:12
*** oomichi has joined #openstack-infra01:12
*** yuanying has joined #openstack-infra01:13
*** zhurong has joined #openstack-infra01:13
*** amotoki has joined #openstack-infra01:14
*** Julien-zte has joined #openstack-infra01:15
jeblairclarkb: jenkins/jobs/infra-publications.yaml is supposed to set markers for it01:16
*** wolverineav has quit IRC01:16
clarkbjeblair: so maybe they didn't get copied at all somehow?01:17
*** amotoki has quit IRC01:17
*** amotoki_ has joined #openstack-infra01:18
fungiit's likely we haven't merged a change for that repo since we added afs publishing01:18
jeblairyeah... my guess, absent other evidence, would be no initial copy.01:19
*** skelso has joined #openstack-infra01:19
jeblairor maybe no copy after some earlier accidental deletion, followed by no publication01:19
jeblairwe have built the index though01:19
jeblairand it has a root marker01:19
*** gongysh has quit IRC01:20
jeblairProject: openstack-infra/publications Ref: master Build: faabedfcaa6e4b34a04c6ea63449f3b9 Revision: 99c3029b1300a45a84d9edb8ef94e3e812256a6c01:20
*** ihrachys has joined #openstack-infra01:20
jeblairleads us to: http://logs.openstack.org/99/99c3029b1300a45a84d9edb8ef94e3e812256a6c/post/infra-publications-publish-index/faabedf/01:20
jeblairwhere it deleted all the presentations01:21
*** jamielennox|away is now known as jamielennox01:21
jeblairokay, so revised guess (now with evidence): the publications never got root markers manually added, and didn't get them auto-generated since they don't generally update.01:22
clarkbjeblair: do we delete subdirs if they don't have markers?01:22
jeblairclarkb: yep01:22
clarkbok the jobs don't put markers in any of the subdirs01:23
clarkbthey put tem at hte publications root if I am reading this properly01:23
clarkbdue to the remove-prefix: _out01:23
jeblairclarkb: i think that's right01:23
*** tqtran has quit IRC01:23
jeblairclarkb: oh, i think i see what you're saying01:24
clarkbbut I don't think we can easily share $NAME between the buildrs (its possible by writing an env file and sourcing that) so this might be tricky01:24
clarkbalternative could be to just commit markers into the repo directly01:25
jeblairclarkb: switch the order of those two builders?01:25
clarkbjeblair: oh or that and have second build mv the marker file from ../.root-marker01:25
clarkblooking at random branch in publications we'd also need one in https://git.openstack.org/cgit/openstack-infra/publications/tree/_static?h=better-together-puppet-and-ansible ? or is it just at that first level?01:26
jeblairclarkb: should just be at the first level01:26
*** liujiong has joined #openstack-infra01:26
clarkbgotcha01:26
*** yujunz has quit IRC01:27
clarkboh hey review.o.o finished with the bupping01:27
jeblairso yeah, move afs-docs-root-marker to before shell, and set docsrootdir to '.'01:27
jeblairi think that should do it01:27
jeblairi have to run now01:27
clarkbit won't show up in the * glob match but we can swap that out iwth find or ls or something01:27
clarkbI too need to go shop for a dinner01:28
jeblairor explicitly mv it01:28
*** Julien-zte has quit IRC01:28
* clarkb will throw up quick patch01:28
*** yujunz has joined #openstack-infra01:29
*** david-lyle_ has joined #openstack-infra01:30
*** yanyanhu has joined #openstack-infra01:31
*** wolverineav has joined #openstack-infra01:31
openstackgerritClark Boylan proposed openstack-infra/project-config master: Add doc root markers to infra publications  https://review.openstack.org/43179701:31
clarkbsomething like that maybe01:31
*** Julien-zte has joined #openstack-infra01:32
clarkbthen we can manually trigger the job for each branch name01:32
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder master: Use convert_mapping_to_xml for CAV plugin  https://review.openstack.org/43179801:32
*** wolverineav has quit IRC01:35
*** thorst_ has joined #openstack-infra01:37
openstackgerritJeremy Liu proposed openstack-infra/project-config master: Run cloudkitty-dsvm-install job on separated nodes  https://review.openstack.org/43158501:37
*** thorst_ has quit IRC01:38
openstackgerritAlan Pevec proposed openstack-infra/tripleo-ci master: DNM testing RDO dependency updates  https://review.openstack.org/42224401:39
*** rbuzatu has joined #openstack-infra01:40
*** Daisy has joined #openstack-infra01:41
*** wolverineav has joined #openstack-infra01:41
*** hamzy has joined #openstack-infra01:45
*** wolverineav has quit IRC01:45
*** ihrachys has quit IRC01:46
*** zz_dimtruck is now known as dimtruck01:47
*** esikachev has joined #openstack-infra01:48
openstackgerritAlan Pevec proposed openstack-infra/tripleo-ci master: DNM testing RDO dependency updates  https://review.openstack.org/42224401:50
*** yujunz is now known as yujunz[away]01:51
*** yujunz[away] is now known as yujunz01:51
*** hurgleburgler has quit IRC01:52
*** zhurong has quit IRC01:52
*** esikachev has quit IRC01:53
*** MasterOfBugs has quit IRC01:53
*** david-lyle_ has quit IRC01:55
*** Sukhdev has quit IRC01:56
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder master: Use convert_mapping_to_xml for CAV plugin  https://review.openstack.org/43179801:57
*** jamesdenton has quit IRC01:57
*** sree has quit IRC01:58
*** adrian_otto has quit IRC01:58
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder master: Use convert_mapping_to_xml for CAV plugin  https://review.openstack.org/43179802:01
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder master: Use convert_mapping_to_xml for CAV plugin  https://review.openstack.org/43179802:02
*** john-davidge has joined #openstack-infra02:03
*** john-davidge has quit IRC02:08
*** wolverineav has joined #openstack-infra02:10
*** esikachev has joined #openstack-infra02:11
*** Apoorva has quit IRC02:11
*** zhurong has joined #openstack-infra02:12
*** rbuzatu has quit IRC02:13
*** jamesdenton has joined #openstack-infra02:13
*** yujunz has quit IRC02:13
*** yujunz has joined #openstack-infra02:14
*** esikachev has quit IRC02:15
*** wolverineav has quit IRC02:15
SpamapShttp://docs.openstack.org/infra/publications/ci-automation/ <-- is there some reason this 404's? Did this get b0rken or moved somewhere?02:16
*** dingyichen has quit IRC02:23
*** winggundamth has joined #openstack-infra02:23
*** Daisy has quit IRC02:24
*** Daisy has joined #openstack-infra02:24
*** zhurong has quit IRC02:25
*** anilvenkata has joined #openstack-infra02:26
fungiSpamapS: fix in progress, harlowja just noticed we're missing those02:27
*** zhurong has joined #openstack-infra02:28
fungiSpamapS: you can find that one at http://files.openstack.org/docs-old/infra/publications/ci-automation/ in the meantime02:28
SpamapSfungi: I found it in the git repo ;)02:29
fungithat also works!02:29
*** esikachev has joined #openstack-infra02:29
*** wolverineav has joined #openstack-infra02:30
*** mriedem has joined #openstack-infra02:31
openstackgerritJimmy McCrory proposed openstack-infra/project-config master: Add stable/ocata branch for #openstack-ansible  https://review.openstack.org/43184202:33
*** esikachev has quit IRC02:34
openstackgerritSteve Lewis (stevelle) proposed openstack-infra/project-config master: OSA: Gerritbot follows stable/ocata  https://review.openstack.org/43184302:35
*** esikachev has joined #openstack-infra02:35
*** sflanigan is now known as sflanigan_afk02:35
*** wolverineav has quit IRC02:35
*** zhurong has quit IRC02:38
*** thorst_ has joined #openstack-infra02:38
*** baoli has quit IRC02:39
*** jamesdenton has quit IRC02:41
*** esikachev has quit IRC02:43
*** Daisy has quit IRC02:44
*** Daisy has joined #openstack-infra02:46
*** thorst_ has quit IRC02:48
*** Daisy has quit IRC02:48
*** thorst_ has joined #openstack-infra02:48
*** skelso has quit IRC02:50
*** knangia has quit IRC02:50
*** zhurong has joined #openstack-infra02:51
*** flepied has joined #openstack-infra02:51
*** john-davidge has joined #openstack-infra02:52
*** ijw has quit IRC02:52
*** dhinesh has quit IRC02:53
*** thorst_ has quit IRC02:53
*** harlowja has quit IRC02:53
*** claudiub has quit IRC02:54
*** sflanigan_afk is now known as sflanigan02:55
*** skinkitten has joined #openstack-infra02:55
*** john-davidge has quit IRC02:57
*** zhurong has quit IRC02:59
*** ramishra has joined #openstack-infra02:59
openstackgerritMatt Riedemann proposed openstack-infra/project-config master: Set LIVE_MIGRATE_BACK_AND_FORTH=True for grenade live-migration job  https://review.openstack.org/43184803:00
*** esikachev has joined #openstack-infra03:01
mriedempkoniszewski: you should abandon this now https://review.openstack.org/#/c/382456/03:01
*** rbuzatu has joined #openstack-infra03:03
*** ihrachys has joined #openstack-infra03:04
*** esikachev has quit IRC03:05
*** Daisy has joined #openstack-infra03:06
*** skelso has joined #openstack-infra03:06
*** apetrich has quit IRC03:07
*** esikachev has joined #openstack-infra03:08
*** amotoki_ has quit IRC03:08
*** thorst_ has joined #openstack-infra03:09
*** thorst_ has quit IRC03:09
*** skinkitten has quit IRC03:09
*** wolverineav has joined #openstack-infra03:09
*** skinkitten has joined #openstack-infra03:10
*** gongysh has joined #openstack-infra03:10
*** apetrich has joined #openstack-infra03:12
*** esikachev has quit IRC03:13
*** amotoki has joined #openstack-infra03:13
*** esikachev has joined #openstack-infra03:14
*** wolverineav has quit IRC03:14
*** Daisy has quit IRC03:24
*** esikachev has quit IRC03:24
*** dingyichen has joined #openstack-infra03:25
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs  https://review.openstack.org/42847603:25
*** nicolasbock has quit IRC03:28
*** sdake has quit IRC03:28
*** Daisy has joined #openstack-infra03:30
*** Daisy has quit IRC03:35
*** thorst_ has joined #openstack-infra03:35
*** thorst_ has quit IRC03:35
*** Daisy has joined #openstack-infra03:36
*** wolverineav has joined #openstack-infra03:39
*** mriedem has quit IRC03:39
*** Daisy has quit IRC03:41
*** timello has quit IRC03:42
*** dave-mccowan has quit IRC03:42
*** wolverineav has quit IRC03:44
*** xarses has joined #openstack-infra03:45
*** Daisy has joined #openstack-infra03:46
openstackgerritAlan Pevec proposed openstack-infra/tripleo-ci master: DNM testing RDO dependency updates  https://review.openstack.org/42224403:47
*** flepied has quit IRC03:48
*** links has joined #openstack-infra03:50
*** wolverineav has joined #openstack-infra03:50
*** wolverineav has quit IRC03:54
*** timello has joined #openstack-infra03:55
*** markvoelker has quit IRC03:56
*** dimtruck is now known as zz_dimtruck03:56
*** tuanluong has joined #openstack-infra03:56
*** markvoelker has joined #openstack-infra03:58
*** rbuzatu has quit IRC04:00
*** esikachev has joined #openstack-infra04:01
*** Julien-zte has quit IRC04:01
*** rbuzatu has joined #openstack-infra04:01
*** yujunz has quit IRC04:02
*** rbuzatu has quit IRC04:06
*** sdake has joined #openstack-infra04:07
*** Daisy has quit IRC04:07
*** hongbin_ has joined #openstack-infra04:08
*** rbuzatu has joined #openstack-infra04:08
*** nmathew has joined #openstack-infra04:09
*** esikachev has quit IRC04:09
*** wolverineav has joined #openstack-infra04:09
*** david-lyle has joined #openstack-infra04:12
*** Daisy has joined #openstack-infra04:13
*** psachin has joined #openstack-infra04:14
*** wolverineav has quit IRC04:14
*** Daisy has quit IRC04:17
*** rbuzatu has quit IRC04:18
*** hurgleburgler has joined #openstack-infra04:18
*** Daisy has joined #openstack-infra04:19
*** sree has joined #openstack-infra04:20
*** anilvenkata has quit IRC04:20
*** zz_dimtruck is now known as dimtruck04:20
*** xarses has quit IRC04:22
*** sree_ has joined #openstack-infra04:23
*** Daisy has quit IRC04:23
*** sree_ is now known as Guest6276804:24
*** sree has quit IRC04:24
*** shu-mutou has joined #openstack-infra04:27
*** skelso has quit IRC04:28
*** faizy has joined #openstack-infra04:28
*** wolverineav has joined #openstack-infra04:30
*** gouthamr has quit IRC04:33
*** wolverineav has quit IRC04:34
*** tuanluong has quit IRC04:35
*** tphummel has joined #openstack-infra04:36
*** rbuzatu has joined #openstack-infra04:38
*** cody-somerville has quit IRC04:39
*** amotoki has quit IRC04:42
*** rbuzatu has quit IRC04:43
openstackgerritTristan Cacqueray proposed openstack-infra/gerritbot master: Add _get_username method to discover username  https://review.openstack.org/31809604:45
openstackgerritTristan Cacqueray proposed openstack-infra/gerritbot master: Add change-created event type  https://review.openstack.org/28636604:45
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: Support swift logserver without Send-Temp-Url-Key  https://review.openstack.org/27033804:48
*** hongbin_ has quit IRC04:49
*** wolverineav has joined #openstack-infra04:49
*** wolverineav has quit IRC04:54
*** gouthamr has joined #openstack-infra04:55
*** gouthamr_ has joined #openstack-infra04:56
*** yamahata has quit IRC04:56
*** wolverineav has joined #openstack-infra04:59
*** gouthamr has quit IRC05:00
*** gluytium has quit IRC05:01
*** wolverineav has quit IRC05:04
*** gluytium has joined #openstack-infra05:04
*** eroux has joined #openstack-infra05:05
*** hichihara has joined #openstack-infra05:08
*** NikitaKonovalov has quit IRC05:08
*** wolverineav has joined #openstack-infra05:09
*** NikitaKonovalov has joined #openstack-infra05:10
openstackgerritAlan Pevec proposed openstack-infra/tripleo-ci master: DNM testing RDO dependency updates  https://review.openstack.org/42224405:12
*** rbuzatu has joined #openstack-infra05:12
*** wolverineav has quit IRC05:14
*** ihrachys has quit IRC05:16
*** amotoki has joined #openstack-infra05:22
*** amotoki has quit IRC05:24
*** amotoki has joined #openstack-infra05:25
*** skinkitten has quit IRC05:25
*** david-lyle has quit IRC05:27
*** wolverineav has joined #openstack-infra05:28
*** eroux has quit IRC05:30
openstackgerritMasayuki Igawa proposed openstack-infra/bugdaystats master: Introduce daily bug stats chart  https://review.openstack.org/37258105:32
*** eroux has joined #openstack-infra05:32
*** esikachev has joined #openstack-infra05:32
*** wolverineav has quit IRC05:33
*** thorst_ has joined #openstack-infra05:36
*** anilvenkata has joined #openstack-infra05:39
masayukiggmann, oomichi: ^^^^^ I think you are interested in this :)05:39
gmannmasayukig: nice, thanks for that.05:41
*** thorst_ has quit IRC05:41
*** hurgleburgler has quit IRC05:43
*** salv-orlando has joined #openstack-infra05:44
*** gildub has quit IRC05:45
gmannmasayukig: can we remove incomplete from there and include Critical bugs and High importance bugs05:46
openstackgerritOpenStack Proposal Bot proposed openstack-dev/hacking master: Updated from global requirements  https://review.openstack.org/43192105:46
openstackgerritOpenStack Proposal Bot proposed openstack-dev/pbr master: Updated from global requirements  https://review.openstack.org/43192205:46
gmannand critical in RED color05:47
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/43193505:48
*** yujunz has joined #openstack-infra05:48
mcardenjhesketh: I'm confused by a thing that gerrit does. The 'minus Verified' (is it good? Did it fail?) gets me evrery  time:  http://paste.openstack.org/show/598337/05:48
*** eroux has quit IRC05:48
*** salv-orlando has quit IRC05:50
masayukiggmann : sounds interesting, I'll try to :)05:51
*** gouthamr_ has quit IRC05:52
gmannmasayukig: thanks05:52
*** eroux has joined #openstack-infra05:53
*** Julien-zte has joined #openstack-infra05:54
*** Julien-zte has quit IRC05:55
*** Julien-zte has joined #openstack-infra05:55
*** yujunz is now known as yujunz[away]05:56
openstackgerritOpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements  https://review.openstack.org/43205705:57
*** wolverineav has joined #openstack-infra05:58
*** cody-somerville_ has joined #openstack-infra06:00
*** yujunz[away] has quit IRC06:01
*** wolverineav has quit IRC06:03
*** Julien-zte has quit IRC06:04
*** Julien-z_ has joined #openstack-infra06:04
*** nadya has joined #openstack-infra06:04
*** tqtran has joined #openstack-infra06:05
*** pgadiya has joined #openstack-infra06:06
*** drifterza has joined #openstack-infra06:06
*** nadya has quit IRC06:08
*** tqtran has quit IRC06:10
openstackgerritMasayuki Igawa proposed openstack-infra/bugdaystats master: Introduce daily bug stats chart  https://review.openstack.org/37258106:11
masayukiggmann : ^^^^^06:11
*** sflanigan is now known as sflanigan_afk06:12
*** eroux has quit IRC06:13
*** drifterza has quit IRC06:13
*** armax has quit IRC06:15
*** armax has joined #openstack-infra06:16
*** armax has quit IRC06:16
*** sflanigan_afk has quit IRC06:16
*** nadya has joined #openstack-infra06:19
*** saibarspeis has joined #openstack-infra06:20
*** saibarspeis has joined #openstack-infra06:20
*** rbuzatu has quit IRC06:21
*** bhavik1 has joined #openstack-infra06:26
*** wolverineav has joined #openstack-infra06:28
*** vsaienko has joined #openstack-infra06:28
*** pgadiya has quit IRC06:29
*** wolverineav has quit IRC06:32
*** bhavik1 has quit IRC06:35
*** Daisy has joined #openstack-infra06:36
clarkbmcarden: its removing any previous votes so that thr new results are seen06:37
clarkbmcarden: gerrit doesnt emit vote info if the vote doesnt change so its important to make sure we dont vote +2 on top of +206:37
clarkbI think that could prevent merging in some cases06:38
*** pgadiya has joined #openstack-infra06:40
*** Daisy has quit IRC06:41
jheskethmcarden: That's the verified vote being removed... so when a change enters the gate zuul removes the current +1 status as it reverifies it (ie, in the gate). Once it's sure, it leaves a +2 to indicate that it has been tested as part of a predictive merge... the +2 is done with a 'submit' which causes gerrit to do the immediate merge06:42
jheskethah, just say your response clarkb06:42
mcardenkk06:42
*** Daisy has joined #openstack-infra06:42
jheskethright, I think the event that comes back to zuul is incomplete if the vote hasn't changed06:43
jheskethactually, I wonder if we should query to make sure we have a complete picture.. zuul could probably do that but it'd be difficult to maintain state without a lot of extra queries06:43
*** adriant has quit IRC06:44
*** salv-orlando has joined #openstack-infra06:46
*** makowals has quit IRC06:46
*** Daisy has quit IRC06:47
*** makowals has joined #openstack-infra06:47
*** Daisy has joined #openstack-infra06:48
*** salv-orlando has quit IRC06:50
*** rkukura has quit IRC06:51
*** Daisy has quit IRC06:55
*** Daisy has joined #openstack-infra06:56
*** wolverineav has joined #openstack-infra06:58
*** mtanino has quit IRC07:00
*** sandanar has joined #openstack-infra07:00
*** Daisy has quit IRC07:01
*** salv-orlando has joined #openstack-infra07:02
*** markvoelker has quit IRC07:02
*** wolverineav has quit IRC07:02
*** markvoelker has joined #openstack-infra07:02
*** Daisy has joined #openstack-infra07:02
*** rcernin has joined #openstack-infra07:03
AJaegerclarkb: there should be a .root-marker in http://docs.openstack.org/infra/publications/07:04
*** andreas_s has joined #openstack-infra07:04
*** Julien-z_ has quit IRC07:05
AJaegerjhesketh, ianw, yolanda https://review.openstack.org/#/c/427868/ https://review.openstack.org/#/c/431148/ https://review.openstack.org/#/c/427874/ https://review.openstack.org/428372 https://review.openstack.org/#/c/428988/ https://review.openstack.org/#/c/429392/ https://review.openstack.org/429851 are ready now for merge - has somebody  time for these python-db changes, please?07:06
*** markvoelker has quit IRC07:06
AJaegerclarkb: your change for .root-marker looks fine to me.07:06
*** Daisy has quit IRC07:07
*** knangia has joined #openstack-infra07:09
*** Julien-zte has joined #openstack-infra07:10
*** ociuhandu has joined #openstack-infra07:11
*** rbuzatu has joined #openstack-infra07:14
*** ociuhandu has quit IRC07:16
*** drifterza has joined #openstack-infra07:16
*** vsaienko has quit IRC07:22
*** aeng has quit IRC07:23
clarkbAJaeger: yes there is a marker in publications/ but not publications/foo07:24
AJaegerclarkb: read full backscroll and understand issue now - your solution should work indeed.07:25
AJaegerI can also create a tarball of old content (with root-markers) to manually deploy instead of triggering all branches07:25
*** faizy has quit IRC07:28
*** Jeffrey4l__ has joined #openstack-infra07:29
AJaegerclarkb: but that tarball might include ancient branches that we don't want - so reviewing what we want might be an option as well...07:29
*** pcaruana has joined #openstack-infra07:30
*** Jeffrey4l_ has quit IRC07:30
AJaegerah, index.html contains the active entries - I'm on it...07:31
*** faizy has joined #openstack-infra07:31
*** makowals has quit IRC07:33
AJaegerclarkb, pabelanger: Missing infra publication will be once you wake up at http://users.suse.com/~aj/missing-v6.tar.xz . PLease deploy to docs folder. I added the root-marker files and included everything in the archived index file.07:34
*** Julien-zte has quit IRC07:34
*** Julien-zte has joined #openstack-infra07:35
*** tphummel has quit IRC07:36
*** wolverineav has joined #openstack-infra07:37
*** thorst_ has joined #openstack-infra07:37
*** mnaser has quit IRC07:41
*** wolverineav has quit IRC07:41
*** thorst_ has quit IRC07:42
*** rbuzatu has quit IRC07:42
*** afazekas has quit IRC07:43
*** rbuzatu has joined #openstack-infra07:43
*** makowals has joined #openstack-infra07:45
*** tuanluong has joined #openstack-infra07:45
yolandahi, good morning07:50
yolandaAJaeger, i'll take a look07:50
AJaegerthanks, yolanda and ianw07:50
AJaegermorning, yolanda07:50
*** matrohon has joined #openstack-infra07:52
*** yamamoto has quit IRC07:52
*** yamahata has joined #openstack-infra07:52
*** kjackal_ has joined #openstack-infra07:52
*** markus_z has joined #openstack-infra07:57
*** wolverineav has joined #openstack-infra07:57
*** Daisy has joined #openstack-infra08:00
openstackgerritMerged openstack-infra/project-config master: blazar: Use normal python jobs  https://review.openstack.org/42786808:00
openstackgerritMerged openstack-infra/project-config master: mistral: Change tox-db to tox jobs  https://review.openstack.org/43114808:00
*** wolverineav has quit IRC08:01
*** Julien-zte has quit IRC08:01
ianwAJaeger: i just did a basic sanity that the depends-on was good and looked like it got all the branches.  i guess that's all there is to do, you did all the hard work :)08:02
*** faizy_ has joined #openstack-infra08:02
*** markvoelker has joined #openstack-infra08:03
*** Julien-zte has joined #openstack-infra08:03
*** dizquierdo_afk has joined #openstack-infra08:04
*** sdake_ has joined #openstack-infra08:04
*** faizy has quit IRC08:05
*** faizy__ has joined #openstack-infra08:05
*** hichihara has quit IRC08:07
*** sdake has quit IRC08:07
*** Daisy has quit IRC08:08
*** markvoelker has quit IRC08:09
*** faizy_ has quit IRC08:09
*** Daisy has joined #openstack-infra08:09
*** faizy has joined #openstack-infra08:09
openstackgerritMerged openstack-infra/project-config master: fuel repos: Use normal python jobs  https://review.openstack.org/42837208:09
openstackgerritMerged openstack-infra/project-config master: glance: Use normal python jobs  https://review.openstack.org/42898808:10
openstackgerritMerged openstack-infra/project-config master: nova: Use normal python jobs  https://review.openstack.org/42939208:10
*** faizy__ has quit IRC08:12
*** kjackal_ has quit IRC08:12
openstackgerritMerged openstack-infra/project-config master: networking-sfc: Use normal python jobs  https://review.openstack.org/42985108:16
AJaegerianw:  thanks08:16
*** wolverineav has joined #openstack-infra08:17
*** Daisy has quit IRC08:19
*** aviau has quit IRC08:19
*** aviau has joined #openstack-infra08:19
*** wolverineav has quit IRC08:21
*** Jeffrey4l__ has quit IRC08:21
openstackgerritChaoyi Huang proposed openstack-infra/project-config master: Add test coverage job to Tricircle project  https://review.openstack.org/43216908:22
*** Jeffrey4l__ has joined #openstack-infra08:22
*** dizquierdo_afk has quit IRC08:22
*** yamahata has quit IRC08:24
*** florianf has joined #openstack-infra08:25
AJaegeryolanda: could you put https://review.openstack.org/#/c/427876/ also on your review queue, please?08:25
*** mptacekx has joined #openstack-infra08:28
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: cinder: Use normal python jobs  https://review.openstack.org/42863608:28
*** yamamoto has joined #openstack-infra08:28
AJaegeryolanda, ianw: and these two from dhellmann can go in as well, please https://review.openstack.org/#/c/427920 and https://review.openstack.org/#/c/427922 as well08:29
*** dimtruck is now known as zz_dimtruck08:30
*** yamamoto_ has joined #openstack-infra08:36
*** pahuang has quit IRC08:37
*** sdake_ has quit IRC08:37
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Rack/cerberus: Remove python-db jobs  https://review.openstack.org/43217508:38
*** jpich has joined #openstack-infra08:38
*** sdake has joined #openstack-infra08:39
*** yamamoto has quit IRC08:39
*** sdake has quit IRC08:40
*** Julien-zte has quit IRC08:40
*** Julien-zte has joined #openstack-infra08:41
*** Julien-z_ has joined #openstack-infra08:42
*** rossella_s has joined #openstack-infra08:44
*** Julien-zte has quit IRC08:45
*** wolverineav has joined #openstack-infra08:46
*** faizy has quit IRC08:46
*** faizy has joined #openstack-infra08:47
*** hashar has joined #openstack-infra08:47
*** jordanP has joined #openstack-infra08:48
*** wolverineav has quit IRC08:51
*** ralonsoh has joined #openstack-infra08:51
*** salv-orlando has quit IRC08:53
openstackgerritChaoyi Huang proposed openstack-infra/project-config master: Add test coverage job to Tricircle project  https://review.openstack.org/43216908:54
*** zzzeek has quit IRC09:00
*** pgadiya has quit IRC09:00
*** amotoki has quit IRC09:01
*** peterlisak has quit IRC09:01
*** onovy has quit IRC09:01
*** askb has quit IRC09:03
*** zzzeek has joined #openstack-infra09:03
*** joehuang has joined #openstack-infra09:05
*** wolverineav has joined #openstack-infra09:06
*** salv-orlando has joined #openstack-infra09:06
openstackgerritMerged openstack-infra/project-config master: sqlalchemy-migrate: Use normal python jobs  https://review.openstack.org/42787609:07
*** derekh has joined #openstack-infra09:07
joehuangAJaeger, hello, I tried to set coverage as non-voting test "tricircle-coverage-ubuntu-xenial-nv", but Verified-1, how to set a coverage job to be a non-voting job?09:08
joehuangthanks09:08
*** Julien-z_ has quit IRC09:08
*** rkukura has joined #openstack-infra09:08
*** yanyanhu has quit IRC09:08
*** zz_dimtruck is now known as dimtruck09:09
*** wolverineav has quit IRC09:10
*** bexelbie_ has joined #openstack-infra09:12
*** bexelbie_ is now known as bexelbie09:12
*** rbuzatu has quit IRC09:13
openstackgerritMerged openstack-infra/project-config master: add stable-compat jobs for tempest and devstack-gate vs. ocata  https://review.openstack.org/42792009:14
openstackgerritMerged openstack-infra/project-config master: add ocata series jobs to the stable-compat template  https://review.openstack.org/42792209:14
*** peterlisak has joined #openstack-infra09:14
ianwjoehuang: there's no nv coverage jobs atm, but i just submitted a change for that in https://review.openstack.org/#/c/431783/09:15
*** pgadiya has joined #openstack-infra09:16
*** onovy has joined #openstack-infra09:16
joehuanggreat, many thanks. So I will wait for a while to add nv coverage job.09:16
openstackgerritMerged openstack-infra/project-config master: Run cloudkitty-dsvm-install job on separated nodes  https://review.openstack.org/43158509:16
openstackgerritMerged openstack-infra/project-config master: Add doc root markers to infra publications  https://review.openstack.org/43179709:17
AJaegerjoehuang: build it on top of the other job as I said in my review comment09:17
AJaegerjoehuang: as ianw said ;)09:17
joehuangYes, thank you all!09:18
AJaegerjoehuang: you can stack changes easily09:18
openstackgerritMerged openstack-infra/project-config master: Add neutron projects to the neutron's gerrit bot  https://review.openstack.org/43125409:18
*** dimtruck is now known as zz_dimtruck09:18
joehuangwill do it later, currently busy in release09:19
openstackgerritMerged openstack-infra/project-config master: Allow Creation of Branches by Project Release Team  https://review.openstack.org/43171009:19
*** knangia has quit IRC09:20
openstackgerritMerged openstack-infra/project-config master: Rename placement job to nova-next  https://review.openstack.org/43170409:21
*** dizquierdo has joined #openstack-infra09:22
*** joehuang has left #openstack-infra09:22
*** claudiub has joined #openstack-infra09:23
*** yamamoto_ has quit IRC09:24
*** wolverineav has joined #openstack-infra09:25
*** martinkopec has joined #openstack-infra09:26
*** wolverineav has quit IRC09:30
*** slaweq_ has joined #openstack-infra09:30
*** denisra has joined #openstack-infra09:31
*** mhickey has joined #openstack-infra09:34
*** yamamoto has joined #openstack-infra09:35
*** wolverineav has joined #openstack-infra09:36
*** thorst_ has joined #openstack-infra09:38
*** lucas-afk is now known as lucasagomes09:38
*** wolverineav has quit IRC09:41
*** pjm6 has quit IRC09:41
*** faizy_ has joined #openstack-infra09:42
*** thorst_ has quit IRC09:43
*** yamamoto has quit IRC09:43
*** john-davidge has joined #openstack-infra09:44
*** salv-orlando has quit IRC09:45
*** faizy has quit IRC09:45
*** mhickey has quit IRC09:48
*** mhickey has joined #openstack-infra09:48
*** dingyichen has quit IRC09:52
*** dingyichen has joined #openstack-infra09:54
*** markvoelker has joined #openstack-infra10:03
*** dtardivel has joined #openstack-infra10:05
*** esikachev has quit IRC10:05
*** tqtran has joined #openstack-infra10:08
*** zz_dimtruck is now known as dimtruck10:09
*** mkoderer has joined #openstack-infra10:09
*** Guest99005 has quit IRC10:12
*** tqtran has quit IRC10:12
*** liujiong has quit IRC10:15
*** openstackgerrit has quit IRC10:18
*** dimtruck is now known as zz_dimtruck10:19
*** liusheng has quit IRC10:20
*** liusheng has joined #openstack-infra10:20
*** alex_xu has quit IRC10:21
*** alex_xu has joined #openstack-infra10:26
*** sambetts|afk is now known as sambetts10:30
*** winggundamth has quit IRC10:31
*** ldnunes has joined #openstack-infra10:33
*** maishsk has joined #openstack-infra10:34
*** ociuhandu has joined #openstack-infra10:35
*** tuanluong has quit IRC10:44
*** flepied has joined #openstack-infra10:45
*** chem has quit IRC10:49
*** esikachev has joined #openstack-infra10:51
*** sshnaidm|afk is now known as sshnaidm|off10:52
*** chem has joined #openstack-infra10:53
*** openstackgerrit has joined #openstack-infra10:54
openstackgerritAndy McCrae proposed openstack-infra/project-config master: Add gerritbot config for stable/ocata in OpenStack-Ansible  https://review.openstack.org/43224510:54
*** esikachev has quit IRC10:55
openstackgerritVasyl Saienko proposed openstack-infra/project-config master: Made ironic-multinode job voting  https://review.openstack.org/43224610:56
*** Julien-zte has joined #openstack-infra10:56
*** electrofelix has joined #openstack-infra10:56
*** rfolco has joined #openstack-infra10:57
*** esikachev has joined #openstack-infra10:58
*** Jeffrey4l__ has quit IRC11:00
*** Jeffrey4l__ has joined #openstack-infra11:01
*** esikachev has quit IRC11:03
*** nicolasbock has joined #openstack-infra11:05
*** dtantsur|afk is now known as dtantsur11:06
*** martinkopec has quit IRC11:07
*** zz_dimtruck is now known as dimtruck11:10
*** crinkle_ has joined #openstack-infra11:11
*** Hunner has quit IRC11:12
*** bmjen has quit IRC11:12
*** crinkle has quit IRC11:12
*** esikachev has joined #openstack-infra11:13
*** salv-orlando has joined #openstack-infra11:16
*** bmjen has joined #openstack-infra11:17
*** Hunner has joined #openstack-infra11:17
*** Hunner has quit IRC11:17
*** Hunner has joined #openstack-infra11:17
*** chem has quit IRC11:17
*** chem has joined #openstack-infra11:17
*** alex_xu has quit IRC11:18
*** esikachev has quit IRC11:19
*** faizy_ has quit IRC11:20
*** dimtruck is now known as zz_dimtruck11:20
*** salv-orlando has quit IRC11:20
*** alex_xu has joined #openstack-infra11:22
*** yamamoto has joined #openstack-infra11:25
*** yamamoto has quit IRC11:29
*** esikachev has joined #openstack-infra11:30
*** apetrich has quit IRC11:31
*** kjackal_ has joined #openstack-infra11:38
*** thorst_ has joined #openstack-infra11:39
*** jkilpatr has quit IRC11:42
*** thorst_ has quit IRC11:43
*** sdague has joined #openstack-infra11:46
*** tosky has joined #openstack-infra11:49
*** tesseract has joined #openstack-infra11:50
*** raildo has joined #openstack-infra11:52
*** drifterza has quit IRC11:54
*** vsaienko has joined #openstack-infra11:54
*** jkilpatr has joined #openstack-infra11:56
*** rossella_s has quit IRC12:02
*** panda|zZ is now known as panda12:04
*** dave-mccowan has joined #openstack-infra12:07
*** zz_dimtruck is now known as dimtruck12:11
mptacekxHi, has anyone some info when 7.3 centos cloud image will be available ? i still can't find it here http://cloud.centos.org/centos/7/images/ and It seems that also jenkins gate jobs are now not running on centos (probably it doesn't make sense with 7.2) correct ? thanks12:15
*** rhallisey has joined #openstack-infra12:16
*** salv-orlando has joined #openstack-infra12:17
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: testenv-client: add a default for ZUUL_CHANGE to the job identifier  https://review.openstack.org/43227812:18
*** hashar is now known as hasharLunch12:19
*** dimtruck is now known as zz_dimtruck12:20
*** salv-orlando has quit IRC12:21
*** salv-orlando has joined #openstack-infra12:25
*** Julien-zte has quit IRC12:26
jordanPguys, what's the status on these kind of error:12:28
jordanPUnable to establish connection to https://10.25.102.161:9696/v2.0/networks.json?id=f28d9b64-f01c-4d35-8169-596f73ce0962: (\'Connection aborted.\', BadStatusLine("\'\'",)12:28
jordanP? it still arises pretty often and I can't find the related launchpad bug report12:28
*** faizy_ has joined #openstack-infra12:31
*** dave-mccowan has quit IRC12:32
*** crinkle has joined #openstack-infra12:32
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config master: Add a new project Sushy  https://review.openstack.org/43228512:33
*** thorst_ has joined #openstack-infra12:33
*** dave-mccowan has joined #openstack-infra12:33
*** bmjen has quit IRC12:33
*** Hunner has quit IRC12:34
*** crinkle_ has quit IRC12:34
*** gongysh has quit IRC12:37
*** esikachev has quit IRC12:38
*** bmjen has joined #openstack-infra12:38
openstackgerritAlan Pevec proposed openstack-infra/tripleo-ci master: DNM testing RDO dependency updates  https://review.openstack.org/42224412:39
*** Hunner has joined #openstack-infra12:40
*** Hunner has quit IRC12:40
*** Hunner has joined #openstack-infra12:40
*** jamesdenton has joined #openstack-infra12:40
*** vsaienko has quit IRC12:40
*** saibarspeis has quit IRC12:41
*** saibarspeis has joined #openstack-infra12:42
*** jamesden_ has joined #openstack-infra12:45
*** markvoelker has quit IRC12:46
*** markvoelker has joined #openstack-infra12:46
*** jamesdenton has quit IRC12:46
*** hasharLunch is now known as hashar12:47
*** nadya has quit IRC12:51
*** jamesden_ has quit IRC12:52
*** ociuhandu has quit IRC12:56
*** faizy_ has quit IRC12:56
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config master: Add a new project Sushy  https://review.openstack.org/43228512:57
*** panda is now known as panda|afk12:58
*** vsaienko has joined #openstack-infra12:59
*** salv-orl_ has joined #openstack-infra12:59
*** salv-orlando has quit IRC13:02
*** ZZelle has joined #openstack-infra13:05
*** sdake has joined #openstack-infra13:06
*** ZZelle has quit IRC13:06
*** trown|outtypewww is now known as trown13:06
*** bexelbie- has joined #openstack-infra13:10
*** mtanino has joined #openstack-infra13:10
*** ZZelle_ has joined #openstack-infra13:11
*** Guest21681 has joined #openstack-infra13:11
*** zz_dimtruck is now known as dimtruck13:12
*** lucasagomes is now known as lucas-hungry13:12
sdaguejordanP: during the memory exhaustion debate those popped up13:14
*** zzelle__ has joined #openstack-infra13:14
*** Guest21681 has quit IRC13:14
*** zzelle__ has quit IRC13:14
sdaguethey feel to me like eventlet dropping a connection on the floor, but I don't know that anyone actually knows what is going on13:14
sdagueit is only happening against the neutron server as best I can tell though13:15
*** ZZelle__ has joined #openstack-infra13:16
*** ZZelle_ has quit IRC13:17
*** mkoderer has quit IRC13:17
*** faizy has joined #openstack-infra13:19
*** ZZelle__ has quit IRC13:20
*** ZZelle_ has joined #openstack-infra13:20
*** ZZelle_ has quit IRC13:20
*** ZZelle_ has joined #openstack-infra13:21
*** ZZelle_ is now known as Guest9007113:21
jordanPsdague, I am pretty sure it's a keepalive/connection reuse issue13:21
*** dimtruck is now known as zz_dimtruck13:21
jordanPagreed I've mostly seen it for the neutron server13:21
sdaguejordanP: could be, is there something specific in the way that neutronclient is using requests that would make that pop up?13:22
*** panda|afk is now known as panda13:23
*** ccamacho is now known as ccamacho|lunch13:23
jordanPI don't know, I was more thinking of an issue between eventlet wsgi server and apache213:23
jordanPapache2 has keepalive set to False but eventlet wsgi defaults to true13:23
jordanPI am talking about apache2 mod proxy here13:23
sdaguejordanP: so if it was apache -> eventlet, I would expect to see it more distributed across servers13:24
sdaguethe client keep alive should always override the server13:24
jordanPservers being services here  ?13:25
sdaguejordanP: yeh13:25
jordanPyeah, agreed. I'll spend a couple of hours now on it, see how it goes13:25
*** Guest90071 has quit IRC13:26
*** pgadiya has quit IRC13:26
*** ZZelle__ has joined #openstack-infra13:26
sdaguejordanP: well, could always set wsgi_keep_alive False across the board and see what happens13:27
sdagueTrue is actually I think a weird oslo.service default13:27
sdaguebecause it means the server is holding resources open way longer13:27
jordanP^^this, or add disablereuse=On on the Apache2 proxypass line13:27
*** florianf has quit IRC13:27
*** dizquierdo has quit IRC13:28
*** rlandy has joined #openstack-infra13:28
sdagueyeh, that is probably easier to get into the mix13:28
sdagueI'm actually really curious why keep alive true is default, I thought that general practice is to default that to false, especially if you don't have cooperative clients13:28
jordanPyes, this is really weird, mayeb I am wrong though13:29
jordanPhttps://github.com/openstack/oslo.service/blob/master/oslo_service/_options.py#L8213:29
*** ZZelle__ is now known as idalgo13:30
jordanPmaybe it's overriden by services (Neutron/Nova) but not sure13:30
*** idalgo is now known as zzelle_hello13:30
jordanPI am not that old, but keepalive has been a pain in every place I worked13:30
*** dprince has joined #openstack-infra13:32
sdaguewell, if you have a specific workflow and cooperative clients, it can be a win13:33
sdaguebut public REST API should not assume cooperative clients :)13:34
sdaguejordanP: I don't think we override it anywhere13:34
jordanPI don't either13:34
*** mtanino has quit IRC13:35
sdaguehumm... nova seems to have separate vars for all of this, but behavior is kind of the same13:36
*** florianf has joined #openstack-infra13:36
*** baoli has joined #openstack-infra13:37
sdagueso, yeh, if you've got a fix we could push on the apache proxy side in devstack that just force closes after every request that's probably the fastest way to figure out if it's related13:37
jordanPyeah but how are we going to be sure ? rechecking 20 times ?13:38
*** baoli has quit IRC13:39
*** baoli has joined #openstack-infra13:40
sdaguejordanP: honestly, for a change like that I'd just push it into testing, and see if the error goes away13:40
AJaegerproject-config-cores, could you review https://review.openstack.org/#/c/429208/ , please? This is python-db change for heat an dready now.13:40
sdaguepush up an ER rule for it13:40
sdagueeven if it's not a fail, and watch the graphs13:40
jordanPgood idea, lemme try to come up with a good ER rule for this, whether the fix actually does the trick or not, the ER is benefitial13:41
jordanPa basic message:"Unable to establish connection to https:/" already show 135 hits with 120 failures, seems good enough13:43
*** flepied has quit IRC13:44
*** gordc has joined #openstack-infra13:44
*** dtantsur is now known as dtantsur|brb13:45
*** EricGonczer_ has joined #openstack-infra13:45
*** Julien-zte has joined #openstack-infra13:47
*** mriedem has joined #openstack-infra13:50
*** zz_dimtruck is now known as dimtruck13:53
*** jcoufal has joined #openstack-infra13:53
*** links has quit IRC13:55
jordanPwe already have queries/1630664.yaml that seems good and is merged13:56
*** Guest62768 has quit IRC13:56
*** gouthamr has joined #openstack-infra13:56
jordanPhum interesting ! it's not only neutron ! Nova too13:58
jordanP(message:"ConnectFailure: Unable to establish connection to https://" AND message:":8774/v2.1/" AND tags:"screen-q-svc.txt") AND voting:113:58
* mordred loves ELK13:59
sdaguemordred: ++14:00
*** flepied has joined #openstack-infra14:01
*** ihrachys has joined #openstack-infra14:04
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: Force yum to do a full cache delete after repos configuration  https://review.openstack.org/43231814:04
*** Hunner has quit IRC14:05
*** ociuhandu has joined #openstack-infra14:06
*** vsaienko has quit IRC14:09
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: DNM testing RDO dependency updates  https://review.openstack.org/42224414:09
*** Hunner has joined #openstack-infra14:10
*** Hunner has quit IRC14:10
*** Hunner has joined #openstack-infra14:10
*** mdrabe has joined #openstack-infra14:10
*** skelso has joined #openstack-infra14:11
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node launching  https://review.openstack.org/43152314:11
fungi#status log Rackspace will be performing Cinder maintenance in DFW from 04:00 UTC Saturday through 10:00 Sunday (two windows scheduled)14:12
openstackstatusfungi: finished logging14:12
*** vsaienko has joined #openstack-infra14:12
*** wolverineav has joined #openstack-infra14:12
*** jamesdenton has joined #openstack-infra14:13
*** wolverin_ has joined #openstack-infra14:14
fungi#status log The afs02.dfw.openstack.org/main02 volume in Rackspace DFW is expected to become unreachable between 04:00-10:00 UTC Sunday and may require corrective action on afs02.dfw.o.o as a result14:14
openstackstatusfungi: finished logging14:14
fungiinfra-root: ^ heads up14:15
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node launching  https://review.openstack.org/43152314:15
openstackgerritAlfredo Moralejo proposed openstack-infra/tripleo-ci master: Force yum to do a full cache delete after repos configuration  https://review.openstack.org/43231814:16
*** jcoufal has quit IRC14:16
*** lucas-hungry is now known as lucasagomes14:17
*** wolverineav has quit IRC14:17
openstackgerritMatt Riedemann proposed openstack-infra/devstack-gate master: DNM: Set LIVE_MIGRATE_BACK_AND_FORTH to True in LM+grenade job  https://review.openstack.org/38245614:19
AJaegersmcginnis: thanks for review. the mitaka and newton changes still need to merge - could you help with those, please? https://review.openstack.org/#/q/If549e6f108ec6184a432d5050da4386efe794a4e,n,z14:20
*** jamesdenton has quit IRC14:23
*** sandanar has quit IRC14:24
*** jamesdenton has joined #openstack-infra14:25
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: DNM: Re-enable devstack test  https://review.openstack.org/43164914:27
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Update nodepool 'list' command  https://review.openstack.org/43164714:27
*** Shrews has quit IRC14:29
*** dansmith is now known as superdan14:29
*** florianf has quit IRC14:30
*** Shrews has joined #openstack-infra14:32
smcginnisAJaeger: looking now...14:32
AJaegerthanks, smcginnis14:32
*** ccamacho|lunch has left #openstack-infra14:33
AJaegerfungi, so docs team gave a go ahead on https only for docs.o.o and developer.o.o. Will you make a patch or is that easy and I should give it a try?14:33
*** hurgleburgler has joined #openstack-infra14:36
*** jaypipes is now known as leakypipes14:36
*** sdake_ has joined #openstack-infra14:36
*** rbuzatu has joined #openstack-infra14:37
*** fguillot has joined #openstack-infra14:38
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: tripleo: improve tacker service coverage  https://review.openstack.org/43232714:38
*** sdake has quit IRC14:39
fungiAJaeger: you bet, i'll hack it together now14:39
*** rfolco_ has joined #openstack-infra14:39
*** rfolco has quit IRC14:40
*** ccamacho has joined #openstack-infra14:40
*** jcoufal has joined #openstack-infra14:42
*** florianf has joined #openstack-infra14:42
*** rbuzatu has quit IRC14:42
*** apetrich has joined #openstack-infra14:42
*** wolverin_ has quit IRC14:44
*** rbuzatu has joined #openstack-infra14:44
*** nmathew has quit IRC14:44
*** wolverin_ has joined #openstack-infra14:44
AJaegerthanks, fungi14:45
*** maishsk has quit IRC14:46
*** mtanino has joined #openstack-infra14:47
openstackgerritJeremy Stanley proposed openstack-infra/system-config master: Redirect developer and docs from HTTP to HTTPS  https://review.openstack.org/43233414:48
fungiAJaeger: asettle: ^14:49
asettleTerrific! Thanks fungi :)14:49
funginp, always happy to see us implement these sorts of improvements14:49
AJaegergreat, thanks, fungi!14:50
asettleYou have my measly +1 !14:50
* fungi has been vaccinated against measles, so it's fine14:51
*** jcoufal has quit IRC14:51
*** skelso has quit IRC14:54
*** skelso has joined #openstack-infra14:54
*** jcoufal has joined #openstack-infra14:56
openstackgerritMatt Riedemann proposed openstack-infra/project-config master: Add ceph tempest dsvm job to devstack experimental  https://review.openstack.org/43234015:00
mriedemlyarwood: ^ would be good to test devstack changes against the ceph job15:00
openstackgerritMerged openstack-dev/hacking master: Updated from global requirements  https://review.openstack.org/43192115:01
lyarwoodmriedem: +1 I did wonder why there wasn't a ceph job for devstack when I was looking at the swap_volume issue, thanks15:01
*** tonytan4ever has joined #openstack-infra15:03
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637015:03
*** david-lyle has joined #openstack-infra15:03
smcginnisCould someone disable a CI account for me?15:04
smcginnisThe  Open-e-joviandss-ci account was emailed a month ago with issues that they have not addressed yet.15:04
smcginnisTheir CI setup is posting a "starting job" comment on every Cinder patch immediately.15:05
smcginnisThen very soon after reporting "Build succeeded" with a NOT_REGISTERED individual job result.15:05
AJaegersmcginnis: submit a fuel patch - I think I got 16 notifications including "we queue", and "starting" ;(15:05
*** spzala has joined #openstack-infra15:05
AJaegersmcginnis: still agree, let's block it15:05
smcginnisAJaeger: Fuel patch?15:05
smcginnisAJaeger: Oh - you submitted a fuel patch and got it. Now I got you. ;)15:06
AJaegerlike https://review.openstack.org/#/c/428369/15:06
AJaegersmcginnis: yes15:06
smcginnis:)15:06
* smcginnis drinks more coffee15:06
AJaegernote that the change above didn't had 16 - didn't bookmark that one15:07
smcginnisI emailed the contacts listed in the third party wiki January 9th with no response.15:07
*** andreas_s has quit IRC15:07
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: add periodic ocata jobs for tempest  https://review.openstack.org/42792815:08
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: add ocata bitrot jobs  https://review.openstack.org/42792715:08
*** dimtruck is now known as zz_dimtruck15:08
*** mptacekx has quit IRC15:09
*** dtantsur|brb is now known as dtantsur15:09
*** jcoufal_ has joined #openstack-infra15:10
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Remove test-environments/multinode_major_upgrade.yaml  https://review.openstack.org/42637515:11
*** jcoufal has quit IRC15:13
*** jcoufal__ has joined #openstack-infra15:13
*** faizy_ has joined #openstack-infra15:14
*** vsaienko has quit IRC15:16
*** jcoufal_ has quit IRC15:16
*** faizy has quit IRC15:17
fungismcginnis: i've set the "Open-E JovianDSS CI <open-e-joviandss-ci@open-e.com>" (22381) account in review.openstack.org to inactive and closed their two open connections to the api15:19
fungithey should cease commenting now15:19
*** mattmceuen has joined #openstack-infra15:20
*** dizquierdo has joined #openstack-infra15:21
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: undercloud upgrade: stop httpd  https://review.openstack.org/43234615:21
smcginnisfungi: Thank you!15:22
fungiany time!15:23
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add action plugins to restrict untrusted execution  https://review.openstack.org/42879815:23
*** Goneri has joined #openstack-infra15:25
*** saibarspeis has quit IRC15:25
*** dims_ has quit IRC15:28
*** rbrndt has joined #openstack-infra15:30
*** zz_dimtruck is now known as dimtruck15:30
*** tphummel has joined #openstack-infra15:32
*** ihrachys_ has joined #openstack-infra15:33
*** dims has joined #openstack-infra15:33
*** ihrachys has quit IRC15:35
openstackgerritMerged openstack-infra/project-config master: add ocata bitrot jobs  https://review.openstack.org/42792715:36
openstackgerritMerged openstack-infra/project-config master: add periodic ocata jobs for tempest  https://review.openstack.org/42792815:37
*** yolanda has quit IRC15:38
*** yolanda has joined #openstack-infra15:38
fungiheads up, i'm going to be afk most of the rest of today. taking some time off to visit an aquarium on another nearby island15:39
mordredfungi: enjoy!15:40
*** ralonsoh_ has joined #openstack-infra15:40
openstackgerritMerged openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs  https://review.openstack.org/42847615:41
*** aviau has quit IRC15:41
*** aviau has joined #openstack-infra15:41
*** nadya has joined #openstack-infra15:42
*** jcoufal has joined #openstack-infra15:42
pabelangerfungi: ack15:43
*** ralonsoh has quit IRC15:43
Zarafungi: nice!15:44
*** wolverin_ has quit IRC15:45
*** wolverineav has joined #openstack-infra15:45
*** jcoufal__ has quit IRC15:45
*** nadya has quit IRC15:46
*** mdrabe has quit IRC15:48
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add accessor method to pull URLs from the catalog  https://review.openstack.org/43235815:48
*** wolverin_ has joined #openstack-infra15:49
*** mhickey has quit IRC15:50
*** Goneri has quit IRC15:51
*** john-davidge has quit IRC15:51
*** john-davidge has joined #openstack-infra15:52
*** leakypipes has quit IRC15:52
openstackgerritAlan Pevec proposed openstack-infra/tripleo-ci master: DNM testing RDO dependency updates  https://review.openstack.org/42224415:52
*** wolverineav has quit IRC15:52
*** marst has quit IRC15:52
*** wolverin_ has quit IRC15:54
*** EricGonc_ has joined #openstack-infra15:54
*** rbuzatu has quit IRC15:54
*** cody-somerville has joined #openstack-infra15:54
*** mnaser has joined #openstack-infra15:55
*** mdrabe has joined #openstack-infra15:55
*** dims has quit IRC15:55
*** dims has joined #openstack-infra15:55
mnaserit's not possible at the moment for shade to send customer filters in list_servers() ?  we're interesting in something like all_projects=1 being sent in15:55
*** jcoufal_ has joined #openstack-infra15:55
*** csomerville has joined #openstack-infra15:56
*** dims is now known as Guest1240615:56
*** EricGonczer_ has quit IRC15:56
*** john-davidge has quit IRC15:56
*** bmjen has quit IRC15:56
pabelangerjeblair: mordred: getting a lot of bounced emails to the inaugust.com domain15:57
pabelangerhost inaugust.com [23.253.47.181]: 550-15.184.64.168 is listed in the Spamhaus DNSBL.15:57
pabelangerwanted to make sure you are aware of it15:57
*** ijw has joined #openstack-infra15:58
*** jcoufal has quit IRC15:59
*** cody-somerville has quit IRC16:00
*** adrian_otto has joined #openstack-infra16:00
*** Julien-zte has quit IRC16:01
*** bmjen has joined #openstack-infra16:01
*** marst has joined #openstack-infra16:02
*** Julien-zte has joined #openstack-infra16:02
*** Julien-zte has quit IRC16:02
*** rbuzatu has joined #openstack-infra16:03
fungi15.184.64.168 looks like an hp addy, maybe something in infra-cloud? missing a reverse dns entry though16:03
*** markus_z has quit IRC16:04
*** rbuzatu has quit IRC16:04
*** rbuzatu has joined #openstack-infra16:04
*** skelso has quit IRC16:05
*** rkukura_ has joined #openstack-infra16:05
*** Guest12406 has quit IRC16:05
*** skelso has joined #openstack-infra16:05
pabelangerthat was from infracloud, but I did get something from a logstash worker too16:05
pabelanger1 se16:05
*** rcernin has quit IRC16:06
*** rkukura has quit IRC16:06
*** rkukura_ is now known as rkukura16:06
fungiokay, heading out now. i may be back on for a bit after 22:00 utc or so16:06
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add request validation to user v2 test  https://review.openstack.org/43236616:06
pabelangerenjoy16:06
fungithanks!16:06
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: DNM: Re-enable devstack test  https://review.openstack.org/43164916:07
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Update nodepool 'list' command  https://review.openstack.org/43164716:07
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node launching  https://review.openstack.org/43152316:07
jeblairpabelanger: i'll request that ip for removal16:07
mordredmnaser: we have not implemented server-side filtering of list_servers content - at the moment it's all client side16:07
mordredmnaser: it would not be terribly difficult to add though16:07
mnasermordred: mmkay, im just trying to think how it can be done without breaking the api -- server side filtering isnt that big of a deal for me, but being able to send things like all_projects=116:08
mnaserfor example we cant get list of all instances in the cloud at the moment with shade :(16:08
mnaserbut it comes back to the same thing16:09
mordredmnaser: right - it would be the same mechanism really - we accept a dict of filters for all of our list/search calls16:09
mordredand in some cases when we know how, we pass some of those filters to the rest call16:09
*** acabot has quit IRC16:09
jeblairpabelanger, fungi: i find it interesting that the spamhaus PBL still has an entry for "HP Cloud"16:09
jeblairpabelanger, fungi: i guess that didn't make the "wind-down" procedure list.16:10
mordredmnaser: so in this case, it would simply be filters={'all_projects': True} or something - but that's  not going to work for you right now because we don't pass anything down to the rest layer for list_servers currently16:10
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: DNM: Re-enable devstack test  https://review.openstack.org/43164916:10
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Update nodepool 'list' command  https://review.openstack.org/43164716:10
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node launching  https://review.openstack.org/43152316:10
mordredmnaser: lemme poke at it for a sec and see how bad it gets :)16:10
jeblairpabelanger, fungi: it's removed now16:11
pabelangerjeblair: danke!16:11
jeblairpabelanger: thank you :)16:12
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Inherit playbooks and modify job variance  https://review.openstack.org/43048316:12
jeblairi got an email saying that there was a problem with a cloud database.  i have no idea which one.  but apparently it's better now.16:13
*** zzelle has joined #openstack-infra16:15
*** jcoufal has joined #openstack-infra16:16
*** armax has joined #openstack-infra16:18
*** jcoufal_ has quit IRC16:19
*** zzelle has quit IRC16:19
*** esikachev has joined #openstack-infra16:20
*** adrian_otto1 has joined #openstack-infra16:22
*** knangia has joined #openstack-infra16:22
*** hashar has quit IRC16:24
*** dims_ has joined #openstack-infra16:24
*** adrian_otto has quit IRC16:25
*** ihrachys has joined #openstack-infra16:26
*** adrian_otto1 has quit IRC16:27
*** adrian_otto has joined #openstack-infra16:28
*** ihrachys_ has quit IRC16:28
*** rajinir_ has joined #openstack-infra16:29
*** anilvenkata has quit IRC16:30
*** afazekas has joined #openstack-infra16:32
*** sree has joined #openstack-infra16:34
*** skelso has quit IRC16:35
*** gtmanfred is now known as excitebike16:35
*** excitebike is now known as dontcare16:35
*** skelso has joined #openstack-infra16:35
clarkbok starting the day with continued ES node restarts hoping that things will knock loose and recover without full cluster restart. Just did 0316:35
*** slaweq_ has quit IRC16:36
*** dontcare is now known as manfred16:36
*** manfred is now known as saltymanfred16:36
*** saltymanfred is now known as gtmanfred16:36
*** ihrachys has quit IRC16:36
*** ihrachys has joined #openstack-infra16:37
*** sekelso has joined #openstack-infra16:37
*** ldnunes has quit IRC16:38
*** ldnunes has joined #openstack-infra16:38
*** sree has quit IRC16:38
*** gtmanfred is now known as manfred16:39
*** manfred is now known as gtmanfred16:39
*** zzelle has joined #openstack-infra16:39
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: heat: Use normal python jobs  https://review.openstack.org/42920816:40
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add ocata periodic job to heat  https://review.openstack.org/43237716:40
*** jcoufal_ has joined #openstack-infra16:40
*** skelso has quit IRC16:40
AJaegerdhellmann: I think you missed one place ^16:41
AJaegerproject-config cores, could you review these two changes above, please?16:41
oomichimasayukig: thanks for https://review.openstack.org/37258116:41
*** gtmanfred is now known as manfred16:41
*** manfred is now known as gtmanfred16:41
*** tlian has joined #openstack-infra16:42
oomichipleia2: Morning :)  can you take a look at https://review.openstack.org/372581 again ?16:42
*** jcoufal has quit IRC16:43
*** jcoufal__ has joined #openstack-infra16:43
clarkbpabelanger: did lists backups run to completion?16:43
*** tesseract has quit IRC16:45
*** jcoufal_ has quit IRC16:45
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: cinder: Use normal python jobs  https://review.openstack.org/42863616:46
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add ocata periodic job to cinder  https://review.openstack.org/43238016:46
*** saibarspeis has joined #openstack-infra16:46
AJaegerdhellmann: and one more ^16:46
openstackgerritDan Radez proposed openstack-infra/tripleo-ci master: DO NOT MERGE: testing congress package  https://review.openstack.org/43099916:47
mriedemAJaeger: can you jump into the -nova channel quick?16:49
*** rhallisey has quit IRC16:49
clarkbAJaeger: looks like my change to infra publications merged, we should trigger those jobs for the different branches in order to populate the filesystem again?16:51
*** ggnel_t has quit IRC16:51
mriedemzigo: AJaeger: if you guys could respond to http://lists.openstack.org/pipermail/openstack-dev/2017-February/111902.html - we're trying to figure out if a minimum requirement of libvirt>=1.2.9 for pike would be ok in https://wiki.openstack.org/wiki/LibvirtDistroSupportMatrix - and then if 1.3.1 as a minimum would be ok for queens16:52
mriedemi wasn't sure about debian or suse/sles16:52
AJaegerFrom earlier: clarkb, pabelanger: Missing infra publication will be once you wake up at http://users.suse.com/~aj/missing-v6.tar.xz . PLease deploy to docs folder. I added the root-marker files and included everything in the archived index file.16:53
mriedemjamespage: ^ same for you about ubuntu and minimum libvirt16:53
mriedemfor pike16:53
*** pcaruana has quit IRC16:53
*** david-lyle has quit IRC16:53
*** kashyap has joined #openstack-infra16:54
clarkbAJaeger: oh cool. I was thinking of just triggering the build jobs to exercise them too, but that works as well16:54
*** florianf has quit IRC16:54
*** skinkitten has joined #openstack-infra16:56
pabelangerclarkb: let me check again16:57
pabelangermidx: creating from 5 files (19380212 objects).16:58
openstackgerritMonty Taylor proposed openstack-infra/shade master: Add all_projects parameter to list and search servers  https://review.openstack.org/43238216:58
pabelangerclarkb: is the last thing on the console16:58
mordredmnaser: maybe that ^^16:58
pabelangerecho $? is 016:58
clarkbpabelanger: that is weird, no summary like the one I pasted before?16:58
pabelangernothing16:59
clarkboh!16:59
mnaserill have a look at it later today, having a neutron surprise friday today :(16:59
clarkbits one of hte last precise hosts I wonder if bup is just different there16:59
clarkball the ones I got a summary on are trusty16:59
mordredmnaser: oh good. :(16:59
*** nadya has joined #openstack-infra16:59
pabelangerclarkb: ah, that would explain it16:59
*** nadya has quit IRC16:59
mordredmnaser: well - no rush. also - is that a thing you'll want plumbed into ansible? or are you using shade directly?16:59
*** tlian has quit IRC16:59
*** dtardivel has quit IRC17:00
mordred(I mean, I imagine it wants to show up in ansible - just not sure how quickly I should try to do that)17:00
mnasermordred: it would be nice to be in ansible, we have some tasks that we run sometimes on all instances (we filter them based on X critera)17:00
mnaseressentially, if its in ansible, we'll use it, if not, we'd write python scripts with shade directly17:00
mordredcool17:00
mordredI'll put that on my TDL17:01
*** rbuzatu has quit IRC17:02
*** bnemec is now known as beekneemech17:02
*** panda is now known as panda|off17:03
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: [WIP] Allocation a node from zookeeper  https://review.openstack.org/43238617:03
*** trown is now known as trown|lunch17:04
*** dave-mccowan has quit IRC17:05
*** harlowja has joined #openstack-infra17:05
*** yamahata has joined #openstack-infra17:05
*** harlowja has quit IRC17:05
*** harlowja has joined #openstack-infra17:05
AJaegerclarkb: will you update the infra publications content? pabelanger did it the last few times...17:06
*** matrohon has quit IRC17:06
*** ralonsoh_ has quit IRC17:07
pabelangerAJaeger: clarkb: Ah, I can do it if needed17:07
clarkbAJaeger: I can do it but I don't have local afs working on tumbleweed. Would have to do it via one of the afs servers17:07
clarkbpabelanger: ^ up to you. I did grab te tarball and looks like it can be unpacked at the root of the afs docs tree?17:08
*** Hal has joined #openstack-infra17:08
*** Hal is now known as Guest9877517:08
pabelangerclarkb: ya, I've been following the steps in https://etherpad.openstack.org/p/afs-docs17:08
pabelangerto get access to the keytab file17:08
*** Apoorva has joined #openstack-infra17:09
AJaegerclarkb, pabelanger : could you also review https://review.openstack.org/432377 https://review.openstack.org/429208 https://review.openstack.org/428636 and https://review.openstack.org/432380 , please? Last cinder patch is in gate - I'll +A when time is right later today17:09
*** florianf has joined #openstack-infra17:10
*** hashar has joined #openstack-infra17:10
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: trove: Use normal python jobs  https://review.openstack.org/42789517:11
*** EricGonc_ has quit IRC17:12
*** dfflanders has joined #openstack-infra17:12
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add trove periodic-ocata job  https://review.openstack.org/43238917:12
AJaegerdhellmann, pabelanger, clarkb , 432389 as well, please ^17:13
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: trove: Use normal python jobs  https://review.openstack.org/42789517:14
*** EricGonczer_ has joined #openstack-infra17:14
dhellmannAJaeger : did I miss some, then?17:15
AJaegerdhellmann: you missed in zuul/layout all that had perodic-db-newton - I'm fixing now...17:16
AJaegerHad to rebase all my changes that changed periodic-db ;)17:16
dhellmannAJaeger : ok, I need to update the instructions in process.rst for those, I guess17:16
AJaegerdhellmann: we get rid of periodic-db, so no need to doucment them17:16
*** psachin has quit IRC17:16
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Add 'hostname-format' to provider config section  https://review.openstack.org/42984117:16
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Unallocate new nodes if request is pulled  https://review.openstack.org/43045317:17
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: murano: Use normal python jobs  https://review.openstack.org/42905017:17
dhellmannAJaeger : how do you feel about a zuul job template with a name like periodic-3cycle-stable or something that makes this a smaller change in the future?17:17
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Add new Node ZK model attributes.  https://review.openstack.org/43099217:17
*** faizy_ has quit IRC17:17
*** mriedem is now known as mriedem_lunch17:17
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove 'template-' from image name format  https://review.openstack.org/43156417:17
*** inc0 has joined #openstack-infra17:17
*** john-davidge has joined #openstack-infra17:18
*** skinkitten has quit IRC17:18
*** kjackal_ has quit IRC17:18
dhellmannAJaeger : ok17:19
*** aarefiev is now known as aarefiev_afk17:19
*** rbuzatu has joined #openstack-infra17:19
AJaegerdhellmann: or periodic-all-stable ;) whatever. Yes, good idea.17:20
*** john-davidge has quit IRC17:20
dhellmannAJaeger : ok, I'll see about that17:20
AJaegerdhellmann: better wait until my changes are merged ;)17:20
*** john-davidge has joined #openstack-infra17:20
dhellmannAJaeger : yes, you are the Merge Conflict Master lately :-)17:21
AJaeger;)17:21
openstackgerritMerged openstack-infra/tripleo-ci master: testenv-client: add a default for ZUUL_CHANGE to the job identifier  https://review.openstack.org/43227817:21
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: murano: Use normal python jobs  https://review.openstack.org/42905017:21
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add murano periodic-ocata job  https://review.openstack.org/43239417:21
*** ihrachys has quit IRC17:24
*** skinkitten has joined #openstack-infra17:25
*** ihrachys has joined #openstack-infra17:25
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Sahara: Use normal python jobs  https://review.openstack.org/42926517:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: sahara: Add periodic ocata job  https://review.openstack.org/43239717:26
AJaegerpabelanger, clarkb, could you review  https://review.openstack.org/432394  and https://review.openstack.org/432397 , please? These add missing ocata jobs17:26
AJaegerdhellmann: best to double check everything once these are in...17:27
*** jaypipes has joined #openstack-infra17:28
*** david-lyle has joined #openstack-infra17:31
*** jpich has quit IRC17:32
*** mattmceuen has quit IRC17:33
*** jaypipes is now known as leakypipes17:34
*** automagically has quit IRC17:36
*** EricGonc_ has joined #openstack-infra17:36
*** EricGonczer_ has quit IRC17:37
*** dtantsur is now known as dtantsur|afk17:38
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Remove subnodes from nodepool  https://review.openstack.org/43240317:38
*** tosky has quit IRC17:40
*** derekh has quit IRC17:40
*** mattmceuen has joined #openstack-infra17:41
*** sambetts is now known as sambetts|afk17:44
*** sdague has quit IRC17:44
*** ihrachys has quit IRC17:46
*** EricGonc_ has quit IRC17:47
*** nadya has joined #openstack-infra17:47
*** ihrachys has joined #openstack-infra17:47
*** EricGonczer_ has joined #openstack-infra17:48
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update nodepool hold to use zookeeper  https://review.openstack.org/43175617:48
clarkbpabelanger: reading that therpad you basically run kadmin:  get_principal service/zuul-launcher@OPENSTACK.ORG then use k5start to run tar xJvf ?17:49
*** rhallisey has joined #openstack-infra17:49
*** jordanP has quit IRC17:51
*** EricGonc_ has joined #openstack-infra17:51
*** hashar has quit IRC17:52
*** EricGonczer_ has quit IRC17:53
pabelangerclarkb: Ya, I just run bash first, so I don't have to kadmin multiple times17:53
clarkbAJaeger: if you are still around can you confirm a sha1/md5sum/hashofsomesort on that tarball?17:54
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: [WIP] Allocation a node from zookeeper  https://review.openstack.org/43238617:55
*** wolverineav has joined #openstack-infra17:57
clarkbpabelanger: what writes the keytab to /tmp? I ran get_principal just fine17:58
*** skinkitten has quit IRC17:58
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Inherit playbooks and modify job variance  https://review.openstack.org/43048317:59
clarkboh get principal just lists attributes18:00
*** wolverineav has quit IRC18:02
*** tqtran has joined #openstack-infra18:03
*** jaosorior has joined #openstack-infra18:03
*** skelso has joined #openstack-infra18:03
AJaegerclarkb: c66b4dd0205bb202b681c188dfa012b724f0bdc86ad951b9232258b8bf3b45d9  missing-v6.tar.xz18:05
AJaegersha256 ^18:05
*** nadya has quit IRC18:05
clarkbAJaeger: thanks18:05
*** sekelso has quit IRC18:05
pabelangerclarkb: I am not sure, the instructions my be old.  ianw originally wrote them18:05
pabelangerclarkb: I think I used mirror.rax-iad for the tarball extract18:06
*** lucasagomes is now known as lucas-afk18:06
pabelangerlet me check history18:06
*** nadya has joined #openstack-infra18:06
clarkbpabelanger: ya looks like the tarball is in /tmp but not the keytab. I am now reading kerberos docs18:06
openstackgerritJohn L. Villalovos proposed openstack-infra/devstack-gate master: WIP/DNM: Testing grenade with Ironic multi-node job  https://review.openstack.org/43177718:08
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update nodepool hold to use zookeeper  https://review.openstack.org/43175618:08
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Implement nodepool 'list' command  https://review.openstack.org/43164718:08
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node launching  https://review.openstack.org/43152318:08
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add murano periodic-ocata job  https://review.openstack.org/43239418:10
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: murano: Use normal python jobs  https://review.openstack.org/42905018:10
AJaegerpabelanger: could you review https://review.openstack.org/#/c/432389/ again, please? ^18:10
AJaegerpabelanger: https://review.openstack.org/432394 is the one...18:11
*** adrian_otto has quit IRC18:11
*** salv-orl_ has quit IRC18:12
clarkbok infra publications are extracting and writing now18:13
clarkbthen I will figure out what to vos release and we should be set18:13
AJaegerfungi, clarkb, could I get a second pair of eyes on https://review.openstack.org/432394 https://review.openstack.org/#/c/432397/ https://review.openstack.org/#/c/432389/ https://review.openstack.org/#/c/432380/ https://review.openstack.org/#/c/428636/ https://review.openstack.org/#/c/429208/ https://review.openstack.org/#/c/432377/ - all small changes for python-db and missing ocata periodic jobs18:13
AJaeger, please?18:13
clarkbAJaeger: yup let me finish up these afs things first18:13
AJaegersure18:13
*** yolanda has quit IRC18:14
clarkbI think I have to do the vos release on whatever server normally releases docs so that I can properly grab the lock file? does that sound right?18:15
*** denisra has quit IRC18:15
*** sdague has joined #openstack-infra18:16
pabelangerOh, actually. I just let our crontab do it18:16
pabelangerbut usually ya, vos release18:16
*** yolanda has joined #openstack-infra18:16
clarkbdigging more it appears at least zlstatic01 does afs things (not sure about the others) does it use a lock of some sort or is this a case where waiting for it to do the next release is better becuase we lakc a lock?18:17
clarkbjeblair: ^ I think that may be deep in the zuul afs stuff18:17
*** chem has quit IRC18:19
*** ociuhandu has quit IRC18:19
clarkbits all extracted at this point so next release should publish it (not sure if that will be me or zuul)18:19
pabelangerclarkb: crontab will do the vos release18:20
clarkbhrm maybe its in jjb not zuul itself18:20
pabelangerI think on zlstatic0118:20
*** yamahata has quit IRC18:20
clarkbnot seeing it for either root or zuul crontab there18:20
* clarkb greps puppet more18:21
pabelangerhttps://review.openstack.org/#/c/400887/18:21
pabelangerclarkb: ^18:21
pabelangerwas the patch I think18:21
clarkbaha ok so its afsdb01 runningthe release every 5 minutes18:23
clarkbI guess I wait then18:23
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node launching  https://review.openstack.org/43152318:23
clarkbAJaeger: pabelanger looks like the previous publications are there now18:24
clarkbwhich is what was in the tarball18:24
clarkbbut the current publications are still missing (they weren't in the tarball)18:24
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update nodepool 'list' command  https://review.openstack.org/43164718:25
clarkbI think we can either artificially trigger the jenkins jobs for those branches or AJaeger can generate another fancy tarball18:26
*** mriedem_lunch is now known as mriedem18:27
AJaegerclarkb: if there's anything more recent, we need to retrigger18:27
AJaegerclarkb: I took a snapshot before we shutdown, so anything newer is not available18:27
clarkbah ok18:27
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Implement node launching  https://review.openstack.org/43152318:28
AJaegerclarkb: but check yourself in the afs mirror, it has all the content. There're older publications as well but I only copied what was in the index file18:29
AJaegeryou can also just copy over - and add the root-marker file directly18:29
jeblairretriggering will be a nice test anyway18:29
AJaegerindeed18:30
*** wolverineav has joined #openstack-infra18:30
*** ociuhandu has joined #openstack-infra18:31
*** bswartz has quit IRC18:32
*** wolverineav has quit IRC18:35
*** saibarspeis has quit IRC18:36
*** saibarspeis has joined #openstack-infra18:36
*** vsaienko has joined #openstack-infra18:37
*** Guest98775 has quit IRC18:38
*** saibarspeis has quit IRC18:38
*** saibarspeis has joined #openstack-infra18:38
*** wolverineav has joined #openstack-infra18:39
*** yamahata has joined #openstack-infra18:40
*** wolverineav has quit IRC18:40
*** MasterOfBugs has joined #openstack-infra18:40
*** wolverineav has joined #openstack-infra18:40
AJaegerteam, ianw proposed a change to use coverage-nv jobs, see https://review.openstack.org/431783 - has anybody comments on that?18:42
*** sdake_ has quit IRC18:48
*** dizquierdo has quit IRC18:48
openstackgerritMerged openstack-infra/tripleo-ci master: Force yum to do a full cache delete after repos configuration  https://review.openstack.org/43231818:48
*** tphummel has quit IRC18:52
openstackgerritKen'ichi Ohmichi proposed openstack-infra/project-config master: Skip unittests of cinder if not related to code  https://review.openstack.org/43242318:55
*** sdake has joined #openstack-infra18:57
*** skinkitten has joined #openstack-infra18:57
clarkbAJaeger: going to take a quick break then will be back to review that list of changes18:58
openstackgerritLucas Alvares Gomes proposed openstack-infra/project-config master: Add a new project Sushy  https://review.openstack.org/43228518:59
*** ricardoas has left #openstack-infra18:59
AJaegerclarkb: thanks. And I now notice which publications I forgot to add, will prepare another tarball...18:59
*** jaosorior has quit IRC19:00
*** tphummel has joined #openstack-infra19:00
clarkbok19:00
AJaegerclarkb: there's a link to "fetch_master" in index.html - that content does not exist. Not sure what's up with that one19:02
*** rbuzatu has quit IRC19:02
*** esikachev has quit IRC19:02
*** flepied has quit IRC19:04
*** jaosorior has joined #openstack-infra19:05
*** tphummel has quit IRC19:06
*** skelso has quit IRC19:06
AJaegerah, fetch_master is not anymore in published index file...19:07
*** flepied has joined #openstack-infra19:07
*** esikachev has joined #openstack-infra19:09
*** wolverin_ has joined #openstack-infra19:10
*** dharinic is now known as dharinic|lunch19:12
*** esikachev has quit IRC19:13
*** wolverin_ has quit IRC19:13
*** wolverineav has quit IRC19:14
*** esikachev has joined #openstack-infra19:14
*** wolverineav has joined #openstack-infra19:16
*** Sukhdev has joined #openstack-infra19:17
*** vsaienko has quit IRC19:18
*** esikachev has quit IRC19:18
*** trown|lunch is now known as trown|mtg19:19
*** trown|mtg is now known as trown19:19
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update waitForNodes() to support zookeeper  https://review.openstack.org/43242919:20
*** vsaienko has joined #openstack-infra19:21
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: WIP: Remove now unused db-jobs  https://review.openstack.org/43243019:21
*** florianf has quit IRC19:22
*** dfflanders has quit IRC19:22
*** saibarspeis has quit IRC19:23
AJaegerfungi, https://review.openstack.org/432175 removes the -db jobs from two dead repos - those haven't seen changes since ages. Any objections?19:23
pabelangerAJaeger: I think fungi is out for the rest of the day19:24
AJaegerpabelanger: ah ,thanks19:24
*** skelso has joined #openstack-infra19:25
*** sdake_ has joined #openstack-infra19:28
*** ihrachys_ has joined #openstack-infra19:31
*** esikachev has joined #openstack-infra19:32
*** sdake has quit IRC19:32
*** zzelle has quit IRC19:33
*** ihrachys has quit IRC19:33
*** electrofelix has quit IRC19:35
openstackgerritKen'ichi Ohmichi proposed openstack-infra/project-config master: Skip unittests of cinder if not related to code  https://review.openstack.org/43242319:36
*** ZZelle has joined #openstack-infra19:36
*** esikachev has quit IRC19:36
*** dfflanders has joined #openstack-infra19:37
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update waitForNode() to support zookeeper  https://review.openstack.org/43242919:38
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: fuel-ostf: Use normal python jobs  https://review.openstack.org/43168019:38
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: fuel-web: Use normal python jobs  https://review.openstack.org/43243619:38
*** ZZelle has quit IRC19:39
AJaegerclarkb, pabelanger: fuel-ostf is ready as well - could you put this on your review queues, please? https://review.openstack.org/43168019:39
*** ZZelle has joined #openstack-infra19:40
pabelangerdone19:40
*** pramodrj07 has joined #openstack-infra19:41
*** ZZelle has quit IRC19:41
*** Swami has joined #openstack-infra19:42
AJaegerthanks19:42
*** ZZelle has joined #openstack-infra19:42
*** esikachev has joined #openstack-infra19:42
*** skelso has quit IRC19:43
*** esikachev has quit IRC19:47
*** skinkitten_ has joined #openstack-infra19:48
*** rbrndt has quit IRC19:48
*** wolverin_ has joined #openstack-infra19:48
*** john-davidge has quit IRC19:49
*** skelso has joined #openstack-infra19:50
*** skelso has quit IRC19:51
*** wolverineav has quit IRC19:52
*** flepied has quit IRC19:56
*** hashar has joined #openstack-infra19:59
openstackgerritMerged openstack-infra/project-config master: fuel-ostf: Use normal python jobs  https://review.openstack.org/43168020:00
openstackgerritMerged openstack-infra/project-config master: sahara: Add periodic ocata job  https://review.openstack.org/43239720:01
openstackgerritMerged openstack-infra/project-config master: Add trove periodic-ocata job  https://review.openstack.org/43238920:01
*** dharinic|lunch is now known as dharinic20:01
*** scarab_ has joined #openstack-infra20:01
AJaegerclarkb: thanks for reviewing - is https://review.openstack.org/#/c/432394/ on your list as well?20:02
openstackgerritMerged openstack-infra/project-config master: cinder: Use normal python jobs  https://review.openstack.org/42863620:02
*** david-lyle has quit IRC20:03
*** dhinesh has joined #openstack-infra20:03
clarkbAJaeger: it is now :)20:03
clarkbAJaeger: do we need to update a release document somewhere with info on adding to zuul and jjb?20:04
AJaegerclarkb: dhellmann wasn't aware of the -db jobs. Those are getting obsolete - so, I expect we're fine.20:04
clarkbok20:05
AJaegerBut let's double check: dhellmann which document did you follow? I'd like to review it...20:05
openstackgerritMerged openstack-infra/project-config master: Add ocata periodic job to cinder  https://review.openstack.org/43238020:05
dhellmannAJaeger, clarkb: openstack/releases/PROCESS.rst links to some examples from previous cycles20:05
dhellmannAJaeger, clarkb : ideally we could put instructions somewhere the infra team can keep them up to date easily, and then PROCESS.rst would link to that20:05
openstackgerritMerged openstack-infra/project-config master: heat: Use normal python jobs  https://review.openstack.org/42920820:06
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update waitForNodes() to support zookeeper  https://review.openstack.org/43242920:07
AJaegerdhellmann: that document looks fine - and yeah, the db jobs screwed that up - shouldn't happen again ;)20:08
dhellmannAJaeger : famous last words ;-)20:09
AJaegeryeah ;)20:09
openstackgerritMerged openstack-infra/project-config master: Add ocata periodic job to heat  https://review.openstack.org/43237720:09
*** tphummel has joined #openstack-infra20:09
AJaegerclarkb: do you have any suggestion on how to handle dead repos: https://review.openstack.org/432175 removes the -db jobs from two dead repos - those haven't seen changes since ages.20:10
openstackgerritMerged openstack-infra/project-config master: Add murano periodic-ocata job  https://review.openstack.org/43239420:10
clarkbAJaeger: maybe also contact them and if we get no response we could retire them properly20:11
*** dave-mccowan has joined #openstack-infra20:12
AJaegerclarkb: I reached out already - got one reaction from cerberus core that they need some more time.20:12
clarkbAJaeger: ok20:12
AJaegerWill wait a few more days...20:12
AJaeger(need more time= a few days to declare it really dead)20:12
* AJaeger asked them to retire and offered help ;)20:12
*** ldnunes has quit IRC20:14
*** rbuzatu has joined #openstack-infra20:15
*** john-davidge has joined #openstack-infra20:15
*** esikachev has joined #openstack-infra20:16
*** Sukhdev has quit IRC20:17
*** adrian_otto has joined #openstack-infra20:17
*** rfolco_ has quit IRC20:20
*** john-davidge has quit IRC20:20
*** rfolco_ has joined #openstack-infra20:20
*** rfolco_ has quit IRC20:20
openstackgerritSean Dague proposed openstack-infra/devstack-gate master: support local.conf instead of localrc  https://review.openstack.org/32658520:24
AJaegerclarkb: loooking at https://review.openstack.org/#/c/431783/1/jenkins/jobs/python-jobs.yaml - we run the previous post coverage job now often in check. But the coverage job publishes to static. Should we create a normal gate job that does not publish to static in addition?20:24
clarkbAJaeger: we should always publish the coverage data I think20:25
clarkbAJaeger: its not really any different than the html unittest file20:25
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update waitForNodes() to support zookeeper  https://review.openstack.org/43242920:26
*** csomerville has quit IRC20:26
*** rbrndt has joined #openstack-infra20:27
AJaegerclarkb: I was confused - yes, indeed this is fine.20:27
*** rfolco_ has joined #openstack-infra20:29
*** rfolco_ has quit IRC20:29
*** john-davidge has joined #openstack-infra20:31
*** sdake_ has quit IRC20:31
sc`what are the memory limits for the gate jobs? to my uninitiated eyes, i'm not able to find such information20:32
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Re-enable test_dib_image_pause / test_dib_image_upload_pause  https://review.openstack.org/43244720:32
clarkbsc`: 8GB20:33
clarkbsc`: http://docs.openstack.org/infra/manual/testing.html20:33
*** nadya has quit IRC20:34
*** marst has quit IRC20:34
sc`clarkb: thanks. in theory, what would happen if there was a need for a higher memory limit, "lol nope" unless there's a big demand?20:35
*** john-davidge has quit IRC20:36
*** mandre is now known as mandre|away20:36
*** csomerville has joined #openstack-infra20:36
clarkbsc`: its come up before. The two major issues with doing that are it would impose higher memory requirments on local developer testing (to eg reproduce failures) and bumping largely means going to 16GB due to cloud flavors effectively halving our test resources20:37
clarkbsc`: suggestions for dealing with it have been use multinode jobs so share the memory demands and/or put software on a diet20:37
sc`mysql and rmq know not the word "diet" :D20:38
*** nadya has joined #openstack-infra20:38
sc`multinode may be the path forward...20:38
clarkbthere is tuning you can do to mysql but ya20:38
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746820:38
clarkbsc`: we run both of those in just about every tempest job though and while mysql isn't lightweight its openstack that could really ues a diet20:39
*** baoli has quit IRC20:40
sc`quite. i'm looking into what can be done to reduce the resource needs for the supporting services, but that's only a small part of the whole20:40
*** baoli has joined #openstack-infra20:40
sc`i have food for thought now. thanks clarkb20:42
*** nadya has quit IRC20:43
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update waitForNodes() to support zookeeper  https://review.openstack.org/43242920:43
sdaguesc` the real issue is the continuous memory growth on the python side. Getting a handle on that is going to be where all the wins are for overall memory use.20:44
mtreinishclarkb: heh, sql stuff ends up being a big chunk of the python memory too: http://blog.kortar.org/wp-content/uploads/2017/02/neutron_flame-3.svg20:44
mtreinishuse the search bar in the upper right for sql it's like 60% iirc20:45
sc`sdague: for sure. i'm abstracted a few layers, being on the deployment side of things20:45
sc`by the time it gets to me, it's already packaged20:45
clarkbmtreinish: I liked that requests was used in one place for a constant at the cost of 80MB :)20:45
sdaguemtreinish: ok, explain that graph20:45
mtreinishsdague: width is memory consumption and height is stack depth20:46
*** matrohon has joined #openstack-infra20:46
mtreinishsdague: http://www.brendangregg.com/flamegraphs.html20:47
mtreinishclarkb: hah, yeah20:48
*** rbuzatu has quit IRC20:48
mtreinishclarkb: but, it's "code deduplication" :)20:48
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update waitForNodes() to support zookeeper  https://review.openstack.org/43242920:48
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Update nodepool 'list' command  https://review.openstack.org/43164720:48
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: WIP: Implement node launching  https://review.openstack.org/43152320:48
sdaguemtreinish: yeh, ok, I guess I'm trying to get what it's saying, 2/3 of memory is inside the rpc server stack?20:48
sdagueum, I can guaruntee requests is used in more than one place20:49
clarkbsdague: in neutron supposedly it ws for a single constant20:49
clarkbthere was a change I saw go by that removed it20:49
clarkbsdague: its possible that $client is including it too and this is a net zero20:49
*** jcoufal__ has quit IRC20:49
sdagueclarkb: but it's used everywhere below that20:49
sdagueevery $fooclient & keystoneauth1 use it20:50
clarkbya20:50
mtreinishsdague: at least for that one neutron api worker20:50
mtreinishsdague: harlowja and I are still working on tuning our pytracemalloc usage to get it to cover all the workers20:50
openstackgerritPaul Belanger proposed openstack-infra/nodepool feature/zuulv3: Implement node launching  https://review.openstack.org/43152320:52
sdagueso, honestly, this doesn't make a ton of sense. Because it says oslo log helpers use 45% of memory20:52
sdaguethe way this weaves in and through package namespaces seems very odd20:53
*** ijw has quit IRC20:53
*** marst has joined #openstack-infra20:53
mtreinishsdague: I did a search on log and it only showed 18.8%20:53
AJaegerclarkb, I'm uploading http://users.suse.com/~aj/missing-v7.tar.xz.SH256 and http://users.suse.com/~aj/missing-v7.tar.xz files for the other publish files - don't know when the next cron run for publishing is. Or do you have a direct place for me to push these?20:53
*** baoli has quit IRC20:53
mtreinishsdague: there could definitely be a bug in my graph generation script. This is all still very much a wip/experiment20:54
sdagueoh, sorry, yeh 20%20:54
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748120:54
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748220:54
*** baoli has joined #openstack-infra20:54
sdaguemtreinish: well, it's not so much that there is a bug, it's that when you look at the call stacks, it's not clear it's a logical progression20:55
*** kjackal_ has joined #openstack-infra20:55
clarkbAJaeger: the cron runs every 5 minutes so I will just grab that and extract to afs like I did the last one20:55
AJaegerclarkb: I meant SUSE's cron job to push the files...20:56
clarkbAJaeger: oh20:56
clarkbAJaeger: sorry I can't help with that. As for direct push when I was at HP I had a swift container for htat but I don't currenlty have naything like that set up20:57
*** jcoufal has joined #openstack-infra20:57
AJaegerclarkb: so, please try again in an hour or so and I hope it's then there...20:57
clarkbAJaeger: ok will do, thanks20:57
mtreinishsdague: if you're curious I'm just using: http://paste.openstack.org/show/598459/ and passing it all the snapshots for a process from the tempest job on: https://review.openstack.org/#/c/429844/20:57
*** wolverin_ has quit IRC20:57
harlowjamtreinish ya, sorta working on it (not really full-time)20:58
mtreinishharlowja: I was playing a bit with it earlier today too (definitely not full-time either)20:58
harlowjacool20:58
mtreinishharlowja: I added a couple more calls to the helper to launch the thread20:58
*** wolverineav has joined #openstack-infra20:58
mtreinishdidn't work the way I expected :p20:58
harlowjalol20:59
mtreinishI got a bunch of snapshots for random neutron workers but not the ones I wanted20:59
clarkbmtreinish: what is collecting the pickles?20:59
clarkbI'm assuming the pickles loaded there are your snapshots?20:59
mtreinishclarkb: that patch I linked to before launches a thread which calls tracemalloc.snapshot() periodically and dumps it to disk21:00
clarkba21:00
clarkber ah21:00
mtreinishall the depends on in the review setup the job to run with py3 (since it's only in >=3.4) and so neutron is hard coded to call the function to launch the collection thread21:01
*** dimtruck is now known as zz_dimtruck21:02
sdaguemtreinish: I guess, it's just because it doesn't show objects / datastructures and counts, it's hard to really say what it means that this function at this line is using all this memory21:03
mtreinishsdague: harlowja added a object count json dump to the log output, Ijust havent looked at visualizing that data yet21:04
mtreinishif you look at the log dir there are object*json files21:04
*** wolverineav has quit IRC21:04
mtreinishthose have the raw object counts at each periodic snapshot21:04
sdagueit's just counts, doesn't specify size per it doesn't seem21:06
*** hurgleburgler has quit IRC21:06
*** wolverineav has joined #openstack-infra21:06
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add missing periodic ocata jobs  https://review.openstack.org/43245421:06
AJaegerclarkb, pabelanger, dhellmann: I reviewed now all periodic ocata jobs and founds these missing ^21:07
mtreinishsdague: err, yep looks that way. I'll look into how hard it would be to add size to the json21:08
mtreinishharlowja: ^^^ unless you know off the top of your head21:08
harlowjaya, its just counts21:08
harlowjacan u even get the size of an object in python ;)21:08
sdagueharlowja: i'm sort of surprised that it doesn't have a count of str21:08
*** fguillot has quit IRC21:08
harlowjamight be somewhere in there, ha21:08
AJaegerclarkb: files are synced now21:10
* AJaeger wishes everybody a great weekend21:10
AJaegerclarkb: http://users.suse.com/~aj/missing-v7.tar.xz.SHA256 and http://users.suse.com/~aj/missing-v7.tar.xz are ready21:11
sdagueharlowja: yeh, I don't know. I'm just trying to get from "here are piles of graphs and data" to "here is meaning" :)21:11
harlowja:)21:11
harlowjabigdata man21:11
harlowjalol21:11
*** wolverineav has quit IRC21:11
clarkbAJaeger: thanks21:11
mtreinishsdague: I see string._TemplateMetaclass and string.Template in one of the json files I looked at21:11
mtreinishsdague: heh, yeah I'm trying to get there too21:11
mtreinishthat flame graph was my first attempt21:11
sdaguemtreinish: right, but those aren't going to be actual strings hanging around.21:13
sdagueand knowing how many strings we define as constants, it makes me wonder if we're seeing any of that data in here at all21:13
sdagueand if not, then what else are we missing in this view21:14
*** jamesdenton has quit IRC21:14
mtreinishwe could very well be missing stuff. I still need to learn more about the tools we're using to grab the data to make sure we're using them correctly21:15
*** jamesdenton has joined #openstack-infra21:16
sdagueok, cool. Just be careful saying "the db is responsible for most of it", before we have any idea if any of this is reality, or noise. :)21:17
*** john-davidge has joined #openstack-infra21:17
mtreinishsdague: I was kinda joking before. I was using it as a segway to get people to look at stuff :)21:18
mtreinishit worked too21:18
*** wolverineav has joined #openstack-infra21:18
*** kjackal_ has quit IRC21:20
openstackgerritYolande Amate proposed openstack-infra/jenkins-job-builder master: Update EnvInject to make use of convert_mapping_to_xml  https://review.openstack.org/40880121:21
*** Sukhdev has joined #openstack-infra21:21
*** john-davidge has quit IRC21:22
*** wolverineav has quit IRC21:24
*** wolverineav has joined #openstack-infra21:24
*** erlon has quit IRC21:25
*** dprince has quit IRC21:27
*** sdake has joined #openstack-infra21:28
*** adrianofr_ has quit IRC21:29
*** wolverineav has quit IRC21:29
*** zz_dimtruck is now known as dimtruck21:30
*** wolverineav has joined #openstack-infra21:31
*** sdake has quit IRC21:32
*** ihrachys has joined #openstack-infra21:34
*** kgiusti has left #openstack-infra21:35
*** matrohon has quit IRC21:36
*** ihrachys_ has quit IRC21:36
*** nadya has joined #openstack-infra21:39
*** jcoufal has quit IRC21:41
*** wolverineav has quit IRC21:41
*** askb has joined #openstack-infra21:43
*** nadya has quit IRC21:44
*** salv-orlando has joined #openstack-infra21:45
*** rbuzatu has joined #openstack-infra21:48
*** jcoufal has joined #openstack-infra21:51
*** mattmceuen has quit IRC21:53
openstackgerritMorgan Fainberg proposed openstack-infra/shade master: Add request validation to user v2 test  https://review.openstack.org/43236621:53
openstackgerritMorgan Fainberg proposed openstack-infra/shade master: Convert test_users to requests_mock  https://review.openstack.org/43247221:54
*** csomerville has quit IRC21:54
openstackgerritJoshua White proposed openstack-infra/project-config master: Swift experimental multinode grenade job  https://review.openstack.org/41198221:54
*** gouthamr has quit IRC21:56
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ  https://review.openstack.org/42630721:57
*** vsaienko has quit IRC21:57
*** jcoufal_ has joined #openstack-infra21:59
*** fernnest has joined #openstack-infra22:00
*** fernnest_ has joined #openstack-infra22:00
*** fernnest_ has quit IRC22:01
*** fernnest has quit IRC22:01
*** rlandy has quit IRC22:01
*** jcoufal__ has joined #openstack-infra22:01
*** fernnest has joined #openstack-infra22:01
*** jcoufal has quit IRC22:02
*** skinkitten_ has quit IRC22:02
openstackgerritMerged openstack-infra/tripleo-ci master: undercloud upgrade: stop httpd  https://review.openstack.org/43234622:03
openstackgerritAntoine Musso proposed openstack-infra/zuul master: (WIP) mimic clone when directory exists  https://review.openstack.org/43247722:03
*** skinkitten has quit IRC22:03
*** jcoufal_ has quit IRC22:04
*** ijw has joined #openstack-infra22:04
openstackgerritAntoine Musso proposed openstack-infra/zuul master: (WIP) mimic clone when directory exists  https://review.openstack.org/43247722:06
*** jcoufal__ has quit IRC22:09
*** thorst_ has quit IRC22:09
clarkbianychoi: if you are around, when will ocata translating slow down?22:10
clarkbianychoi: wondering what sort of time frame we can think aobut doing zanata upgrades once dev is done and tested22:11
*** baoli has quit IRC22:11
openstackgerritYolande Amate proposed openstack-infra/jenkins-job-builder master: Update EnvInject to make use of convert_mapping_to_xml  https://review.openstack.org/40880122:11
*** ihrachys has quit IRC22:12
openstackgerritJoshua White proposed openstack-infra/devstack-gate master: Enable Swift multinode grenade testing  https://review.openstack.org/41198022:12
*** dave-mccowan has quit IRC22:12
*** jamesdenton has quit IRC22:13
ianychoiclarkb, hello! by next Tuesdays to Wednesday - ideally it would be by the end of week but since Ocata cycle is too short, having more extension for finalizing on Ocata translation would be needed I think.22:14
ianychoiclarkb, I think you would be so busy during PTG - especially Mon and Tue. How about your schedule on Wed-Fri?22:15
*** erikmwilson has quit IRC22:15
clarkbianychoi: its possible I will have time during wed-fri during ptg, but still need to complete upgrade on translate-dev first then have you all test it22:16
*** erikmwilson has joined #openstack-infra22:16
clarkbianychoi: thinking I can do that upgrade next week on the dev server as long as I can get reviews on the necessary puppet changes22:16
clarkbianychoi: then maybe after ptg we plan for production?22:16
*** erikmwilson has quit IRC22:16
clarkbharlowja: I should have the infra publications fixed in the next 5 minutes or so. If you are still around maybe you can see if what you wanted is there in 5 minutes?22:16
harlowjasweet22:17
harlowjaall of them :-P22:17
clarkbharlowja: tarball is extracting now then afs vos release will happen every 5 minutes22:17
ianychoiclarkb, yep that would be a so nice plan22:17
clarkbianychoi: ok, I will try to get the dev server done next week then22:17
*** john-davidge has joined #openstack-infra22:17
*** gyee has joined #openstack-infra22:18
*** trown is now known as trown|outtypewww22:19
clarkbharlowja: ok it finished extracting so the 2220 UTC vos release should push all the data out and get it served by web servers22:19
harlowjacools22:19
ianychoiclarkb, thanks a lot - during PTG it would be great if we also discuss translation checksite. I will more think about on it and ping to you with details22:20
clarkbianychoi: ok22:21
*** john-davidge has quit IRC22:22
*** rbuzatu has quit IRC22:22
*** spzala has quit IRC22:24
*** skinkitten has joined #openstack-infra22:28
*** thorst_ has joined #openstack-infra22:29
*** spzala has joined #openstack-infra22:29
*** skinkitten_ has joined #openstack-infra22:30
*** baoli has joined #openstack-infra22:31
*** thorst_ has quit IRC22:34
*** gordc has quit IRC22:37
*** Apoorva has quit IRC22:37
*** hashar has quit IRC22:38
*** hurgleburgler has joined #openstack-infra22:38
*** sree_ has joined #openstack-infra22:38
*** sree_ is now known as Guest5588522:39
*** scarab_ has quit IRC22:39
*** jcoufal has joined #openstack-infra22:39
*** scarab_ has joined #openstack-infra22:39
*** dfflanders has quit IRC22:40
openstackgerritMorgan Fainberg proposed openstack-infra/shade master: Move mock utilies into base  https://review.openstack.org/43248722:41
*** mdrabe has quit IRC22:41
*** jcoufal has quit IRC22:42
*** Guest55885 has quit IRC22:43
*** jtomasek has quit IRC22:43
*** scarab_ has quit IRC22:44
*** scarab_ has joined #openstack-infra22:45
*** scarab_ has quit IRC22:49
*** david-lyle has joined #openstack-infra22:55
*** jamielennox is now known as jamielennox|away22:58
*** Swami has quit IRC22:59
*** david-lyle has quit IRC23:04
*** nt has quit IRC23:06
*** ijw has quit IRC23:06
*** ijw has joined #openstack-infra23:07
*** Apoorva has joined #openstack-infra23:07
*** nt has joined #openstack-infra23:09
*** pradk has quit IRC23:10
*** jtomasek has joined #openstack-infra23:12
*** EricGonc_ has quit IRC23:13
*** EricGonczer_ has joined #openstack-infra23:15
*** jaosorior has quit IRC23:15
*** gouthamr has joined #openstack-infra23:21
*** marst has quit IRC23:22
*** dimtruck is now known as zz_dimtruck23:24
*** yamamoto has joined #openstack-infra23:27
*** rbuzatu has joined #openstack-infra23:29
*** jkilpatr has quit IRC23:30
*** yamamoto has quit IRC23:31
*** esikachev has quit IRC23:32
*** saibarspeis has joined #openstack-infra23:33
*** flepied has joined #openstack-infra23:39
*** nadya has joined #openstack-infra23:40
*** knangia has quit IRC23:40
*** Swami has joined #openstack-infra23:43
*** nadya has quit IRC23:44
openstackgerritMichael Johnson proposed openstack-infra/project-config master: Enable api-ref jobs for Octavia  https://review.openstack.org/43249323:46
*** adreznec has quit IRC23:47
*** adreznec has joined #openstack-infra23:47
*** cody-somerville_ has quit IRC23:48
clarkbok running out of steam for the week. Would appreciate it if people can review topic:zanata-upgrade in the near future so I can keep pushing on that work23:48
* clarkb should double check if that was the right topic according to the spec23:49
clarkber did I not do a spec for that clearly my brain is mush and I should weekend23:50
clarkb(I think we may have decided we didn't need a spec because it was thought ot be simple then it became not simple. I might have to write a postmortem spec023:50
*** jamielennox|away is now known as jamielennox23:50
openstackgerritMorgan Fainberg proposed openstack-infra/shade master: convert test_domain to use requests_mock  https://review.openstack.org/43249523:50
openstackgerritMorgan Fainberg proposed openstack-infra/shade master: convert test_domain to use requests_mock  https://review.openstack.org/43249523:51
jeblairi'm finding all kinds of fun facts as i write this zuul ptg guide -- 2300 lines of zuul.yaml are job regexes.23:53
jeblairbetween zuul and jjb, we have 56,044 lines of yaml.23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!