Wednesday, 2016-03-30

EmilienMI don't see the hiera packaging thing anymore, thanks to the roll back I guess00:01
sdakegetting a not registered error:
EmilienMthough NOT_REGISTERED on devstack-centos700:02
EmilienMsdake: zuul got restarted00:02
clarkbEmilienM: yes see scrollback00:02
clarkbsdake ^00:02
clarkbmnaser: if you are able can you update with the version of libvirt you use?00:02
openstackLaunchpad bug 1558807 in OpenStack Compute (nova) "Volume attached at different path than reported by nova/cinder when using config drive" [Undecided,Incomplete]00:02
pabelangerI am looking on nodepool to see if there is an error in the logs00:02
*** roxanaghe has joined #openstack-infra00:04
*** aeng has quit IRC00:04
*** eil397 has quit IRC00:04
*** harlowja has quit IRC00:05
pabelanger2016-03-30 00:04:47,114 DEBUG nodepool.NodePool:   Deficit: devstack-centos7: 0 (start: 0 min-ready: 2 ready: 2 capacity: 96)00:05
*** sflanigan has quit IRC00:05
*** camunoz has quit IRC00:05
pabelangercurrent 2 online00:05
pabelangerI think once they delete nodepool will start up again00:06
clarkbit is possible that we aren't reregistering jobs properly on reconnect to geamran?00:06
clarkbactuall I know00:06
timrcHey yo... which project is the summit website?00:06
pabelangeronce just came online in bluebox00:06
timrcI'd like to submit a fix to a bug on event pages.00:06
clarkbthe main run loop in the gearman plugin does both job running and job registration00:06
clarkbso noes rhtat are running jobs won't register jobs00:07
*** Sukhdev has quit IRC00:07
clarkbso we basically got stuck in lalaland without demand for a bit00:07
clarkbpabelanger: the one in bluebox should've registerd things,you can check against gearman directly00:07
timrcOh, I think.00:07
pabelangerya, it is working now00:07
* timrc clones00:07
clarkbtimrc: no00:07
clarkbtimrc: let me find the real repo00:07
clarkb(that should be the real repo bt we never got them to transition off of github)00:08
pabelangerclarkb: Right, I think we are in lala until the 2 in use deleted, then zuul detected it and created a new server00:08
pabelangerwhich reregistered00:08
*** roxanaghe has quit IRC00:08
pabelangerEmilienM: sdake: should be fixed now00:08
lifelessclarkb: yes, the mellanox NICs were 10Gbe00:08
clarkbtimrc: somewhere in there00:09
sdakethanks pabelanger00:09
clarkblifeless: thank you for confirming. crinkle so ya we seem to have lost our 10Gbe00:09
*** IlyaG has quit IRC00:09
lifelessclarkb: the second tranche of hardware was a different config though - the 120 or whatever machines that turned up about 2 years in00:09
timrcclarkb: Thanks, sir.00:10
clarkbpabelanger: pleia2 fungi the trick would be to stop zuul, delete all the used nodes in nodepool, wait for one of each variety t ocome up, then start zuul00:10
pabelangerclarkb: which makes sense00:10
lifelessclarkb: they were in fact a bunch of different configs from different early cloud roles00:10
*** Sukhdev has joined #openstack-infra00:10
crinkleclarkb: possibly they only checked useast, which i think was not mellanox00:10
clarkblifeless: gotcha, any idea if 10Gbe availability was at least constant?00:10
*** gokrokve has joined #openstack-infra00:10
lifelessclarkb: so, if you're examining some hardware from the big-bag-of-hardware, you'd need to know where/when it was obtained to see what it should have00:10
lifelessclarkb: no, a big chunk of that 120-odd batch of machines were swift nodes00:11
lifelessclarkb: lots of disk, low CPU/memory/network00:11
clarkbI see00:11
lifelessclarkb: also omg old ilo hardware version on those ones. made me want to cry :)00:12
*** ajmiller has quit IRC00:12
*** BobBall_ has joined #openstack-infra00:12
pabelangerfungi: ianw: clarkb: EmilienM: if we land 299031 tonight, I can kick off a ubuntu-trusty rebuild later this evening00:12
clarkbpabelanger: it should have my +2 unless a new patchset rolled in00:12
*** BobBall_ is now known as Guest473700:12
pabelangerclarkb: Yup, just rechecking because of NOT_REGISTERED00:12
clarkbpabelanger: it is trivial enough that I feel comfortable just approving it if we don't have other reviewers00:12
clarkbpabelanger: oh gotcha00:12
clarkbcrinkle: lifeless maybe that means we should just requiest 2x1gig and move on if there is a mix that doesn't include 10Gbe00:13
lifelessclarkb: the machines with 10G didn't have 2x1G00:13
clarkbwould the 10Gbe nics negotiate 1G?00:14
*** devkulkarni has quit IRC00:14
clarkbI assume so00:14
lifelessclarkb: they had a single 1G - and the iLO 1G, which isn't linux-usable00:14
lifelessclarkb: I don't know - for all I know, it was 10G fibre00:14
clarkbor was it fancy infinibandness that can't manage ethernet at 1gig?00:14
lifelessclarkb: no, its defintely not IB00:14
*** gokrokve has quit IRC00:15
*** BobBall has quit IRC00:15
lifelessclarkb: but the actual phys link could be anything - I never drilled down enough to know (or need to know)00:15
lifelessclarkb: (IB, as you know, has radically different semantics)00:15
lifelessso its true ethernet, can arp spoof, do NAT, run VM's on VLAN's etc.00:16
anteayapleia2: pabelanger nice work on the zuul restart00:16
*** IlyaG has joined #openstack-infra00:16
*** Guest4737 has quit IRC00:16
lifelessclarkb: what are you doing - planning the new home?00:16
*** ybathia has quit IRC00:16
clarkblifeless: yes they moved the hardware and said "no more 10Gbe"00:17
clarkband I went uh what00:17
*** BobBall has joined #openstack-infra00:17
clarkbbut sounds like that may be an east vs west difference and west isn't moved yet?00:17
*** Swami has quit IRC00:17
*** BobBall is now known as Guest2294100:17
clarkbanyways we may just have to put up with what we get00:18
*** aeng has joined #openstack-infra00:18
*** achanda has joined #openstack-infra00:18
*** SumitNaiksatam has quit IRC00:19
*** zul has quit IRC00:19
*** fawadkhaliq has quit IRC00:20
*** fawadkhaliq has joined #openstack-infra00:20
lifelessclarkb: I have no direct visibility; if you're running into walls getting answers let me know - but I handed all my contacts over to the folk doing the cloud a year or so back00:20
clarkbya crinkle is doing a great job, just trying to get a handle on what we expect to have and what we really have and how we can get sane networking out of it00:21
clarkbsounds like we might just have t oaim for mostly consistent over anything else00:21
lifelessSo, the machines that had 10G cards probably still do, unless the move orders specifically requested removal.00:22
lifelessSo you may be missing switches / wiring.00:22
lifelessOr you may be looking at the other dc's machines, which was - IIRC - east, and they were really all over the place.00:22
*** sdake has quit IRC00:22
crinklemy guess is the uswest machines still have the 10G cards and they only happened to look at the east machines00:23
clarkbif we continue to keep them separated we could go 10Gbe in west and 2x1G in east00:23
pabelangeranteaya: thanks, learned something new too00:23
lifelesscrinkle: plausible indeed; also remember that esast was something like 4 different machine configurations00:23
clarkbassuming there is proper switch gear for the 10Gbe in west00:23
*** mylu has quit IRC00:24
anteayapabelanger: awesome00:24
*** sdake has joined #openstack-infra00:24
anteaya'tis a good day then00:24
*** camunoz has joined #openstack-infra00:24
*** gokrokve has joined #openstack-infra00:24
*** fawadkhaliq has quit IRC00:24
*** achanda has quit IRC00:24
*** mylu has joined #openstack-infra00:25
timrcAccidentally typed "git mush" instead of "git push", I think git "git mush" should be an alias to git rebase with a squash.00:27
anteayawhat did it do?00:27
anteayaor the dogs could take off dragging the sleigh behind them00:28
*** nelsnels_ has quit IRC00:28
*** nelsnelson has joined #openstack-infra00:29
*** kzaitsev_mb has joined #openstack-infra00:29
*** IlyaG has quit IRC00:29
*** mylu has quit IRC00:30
*** baoli has joined #openstack-infra00:32
*** mylu has joined #openstack-infra00:32
anteayapabelanger: thank you for adding your xenial dib work to this etherpad:
anteayaI appreciate it00:34
anteayait helps me to keep track of large changes00:34
*** baoli_ has joined #openstack-infra00:34
*** sc68cal has quit IRC00:35
anteayaso waynr looking at where you put your jjb bits in the etherpad:
anteayawaynr: you put them in the section for items that are not in the infra track but which infra needs to know about00:36
*** mylu has quit IRC00:36
anteayawaynr: I don't think that is the best section for your proposal00:36
*** kzaitsev_mb has quit IRC00:36
anteayawaynr: I suggest moving it to a fishbowl session, based upon what I believe you want00:36
openstackgerritMerged openstack-infra/devstack-gate: Document prereqs/usage for reproduce script
*** mtanino_ has quit IRC00:37
*** mtanino__ is now known as mtanino_00:37
*** baoli has quit IRC00:38
anteayapabelanger: I'm uncertain as how setting any of the offered smitespam configurations will of any benefit to us:
anteayais there other documenation about giving it certain regexes?00:42
*** tiswanso_ has quit IRC00:42
*** gokrokve has quit IRC00:43
openstackgerritMichael Johnson proposed openstack-infra/devstack-gate: Add archiving of nova instance console logs
*** tiswanso has joined #openstack-infra00:43
*** mylu has joined #openstack-infra00:43
anteayatonyb: any thoughts on if the yaml2ical syntax will be accessible to the irc-meetings repo anytime soon?00:45
*** baoli_ has quit IRC00:45
*** mylu has quit IRC00:49
*** sputnik13 has quit IRC00:52
*** mylu has joined #openstack-infra00:53
*** harlowja has joined #openstack-infra00:54
pabelangeranteaya: not sure, I'll get back to you tomorrow once I look into it more00:54
*** mylu has quit IRC00:54
pabelangerclarkb: okay, so you are good with +A on 299031?00:55
*** mylu has joined #openstack-infra00:58
clarkbpabelanger: yes00:59
clarkbpabelanger: want me to approve it?00:59
*** sdake_ has joined #openstack-infra00:59
clarkbpabelanger: I went ahead and did it this way tomorrow mornings build will have the fix if you odn't get to it sooner01:00
*** mylu has quit IRC01:00
*** sdake has quit IRC01:02
openstackgerritSachi King proposed openstack-infra/git-review: Fix no_git_dir UnboundLocalError in except block
*** IlyaG has joined #openstack-infra01:04
anteayapabelanger: okay thanks01:04
anteayapabelanger: I'm offline for a good chunk of the morning, should be around mid-day01:04
anteayawe have had a lot of spam pdfs01:05
anteayadid smitespam ever catch any pdfs that you recall?01:05
*** baoli has joined #openstack-infra01:06
*** achanda has joined #openstack-infra01:06
openstackgerritMerged openstack-infra/system-config: Fix typo with xenial logic
*** zul_ has joined #openstack-infra01:08
*** zul_ is now known as zul01:08
*** Sukhdev has quit IRC01:08
*** IlyaG has quit IRC01:09
*** devkulkarni has joined #openstack-infra01:09
*** mylu has joined #openstack-infra01:09
*** baoli has quit IRC01:10
*** baoli has joined #openstack-infra01:11
*** baoli has quit IRC01:12
anteayaif multiple users edit a page mass delete may not catch all the pages01:13
anteayaI'm going to contributions first then opening mass delete in a separate tab, after that deletes, refresh contributions for that user and follow the chain of multiple edits from different users to find the straglers01:14
*** pvaneck has quit IRC01:17
pabelangerclarkb: thanks, starting image build now01:19
*** tqtran has quit IRC01:19
*** zhurong_ has joined #openstack-infra01:20
*** zz_dimtruck is now known as dimtruck01:23
anteayamass delete only seems to work on pdfs and files that user created, if a file was moved or edited by multiple users mass delete doesn't seem to catch it01:25
*** gtmanfred has quit IRC01:29
*** raginbajin has quit IRC01:30
*** weshay has quit IRC01:30
*** devkulkarni has quit IRC01:31
*** krotscheck_dcm has quit IRC01:31
*** mnaser has quit IRC01:31
*** devkulkarni has joined #openstack-infra01:31
*** raginbajin has joined #openstack-infra01:31
*** jklare has quit IRC01:31
*** gtmanfred has joined #openstack-infra01:31
*** psanchez has quit IRC01:32
*** kzaitsev_mb has joined #openstack-infra01:32
*** krotscheck has joined #openstack-infra01:33
*** jklare has joined #openstack-infra01:33
*** baoli has joined #openstack-infra01:34
openstackgerritliusheng proposed openstack/requirements: bump aodhclient upper-constraints
*** bdemers has joined #openstack-infra01:35
waynranteaya: cool, thanks for the feedback...ill rearrange now01:36
*** Jeffrey4l has joined #openstack-infra01:36
*** psanchez has joined #openstack-infra01:36
*** kzaitsev_mb has quit IRC01:38
*** mtanino has joined #openstack-infra01:39
*** sridhar_ram has quit IRC01:40
*** baoli has quit IRC01:41
anteayawaynr: great01:42
*** cody-somerville has quit IRC01:43
*** baoli has joined #openstack-infra01:43
*** mnaser has joined #openstack-infra01:45
*** gyee has quit IRC01:47
*** rakhmerov has quit IRC01:49
*** Daisy has joined #openstack-infra01:49
*** apoorvad has quit IRC01:50
*** baoli has quit IRC01:53
*** rakhmerov has joined #openstack-infra01:53
*** salv-orl_ has joined #openstack-infra01:55
*** amrith is now known as _amrith_01:56
*** salv-orl_ has quit IRC01:58
*** salv-orl_ has joined #openstack-infra01:58
*** salv-orlando has quit IRC01:59
*** dims has quit IRC01:59
*** thorst has joined #openstack-infra02:00
anteayadid we know the spammers were also uploading jpgs?02:00
*** cody-somerville has joined #openstack-infra02:01
*** cody-somerville has quit IRC02:01
*** cody-somerville has joined #openstack-infra02:01
*** mriedem has quit IRC02:02
*** tqtran has joined #openstack-infra02:03
*** dims has joined #openstack-infra02:04
*** salv-orl_ has quit IRC02:05
*** tqtran has quit IRC02:07
*** aeng has quit IRC02:10
*** mylu has quit IRC02:10
*** mylu has joined #openstack-infra02:11
*** EricGonczer_ has quit IRC02:12
*** ramishra has joined #openstack-infra02:13
*** Rocky_g has quit IRC02:14
*** mylu has quit IRC02:15
*** thorst has quit IRC02:17
*** julim has joined #openstack-infra02:18
*** hichihara has joined #openstack-infra02:21
*** mylu has joined #openstack-infra02:21
*** bpokorny has quit IRC02:21
*** aeng has joined #openstack-infra02:22
*** mylu has quit IRC02:26
*** mylu has joined #openstack-infra02:27
*** achanda has quit IRC02:27
*** tphummel has quit IRC02:30
*** achanda has joined #openstack-infra02:31
*** mylu has quit IRC02:33
*** yamahata has quit IRC02:34
*** kzaitsev_mb has joined #openstack-infra02:35
*** kzaitsev_mb has quit IRC02:40
*** Nakato_ is now known as Nakato02:44
*** devkulkarni has quit IRC02:45
*** sflanigan has joined #openstack-infra02:45
*** dims_ has joined #openstack-infra02:45
*** dims has quit IRC02:46
*** sputnik13 has joined #openstack-infra03:02
*** grassass has joined #openstack-infra03:03
*** sdake_ is now known as sdake03:07
*** roxanaghe has joined #openstack-infra03:07
*** torandu has quit IRC03:10
*** torandu has joined #openstack-infra03:11
*** roxanaghe has quit IRC03:12
*** bpokorny has joined #openstack-infra03:14
*** mylu has joined #openstack-infra03:16
*** Qiming has quit IRC03:17
*** sdake_ has joined #openstack-infra03:17
*** sdake has quit IRC03:20
*** yuanying has quit IRC03:22
*** bpokorny has quit IRC03:25
*** baoli has joined #openstack-infra03:28
tonybanteaya: Not certain.  I need to do a release of yaml2ical which is sort of hung up by the release ATM.03:30
*** yamahata has joined #openstack-infra03:31
*** baoli has quit IRC03:32
*** aeng has quit IRC03:34
*** sflanigan has quit IRC03:35
*** kzaitsev_mb has joined #openstack-infra03:36
*** Daisy has quit IRC03:37
*** Daisy has joined #openstack-infra03:37
openstackgerritSachi King proposed openstack-infra/zuul: Support post jobs by supporting rev checkout
*** Nikolay_St has joined #openstack-infra03:40
*** links has joined #openstack-infra03:40
*** yamada-h has joined #openstack-infra03:41
*** tiswanso has quit IRC03:42
*** Daisy has quit IRC03:42
*** kzaitsev_mb has quit IRC03:42
*** sflanigan has joined #openstack-infra03:47
*** sflanigan has joined #openstack-infra03:47
*** dimtruck is now known as zz_dimtruck03:50
*** ramishra has quit IRC03:50
*** aeng has joined #openstack-infra03:51
*** ramishra has joined #openstack-infra03:51
*** sputnik13_ has joined #openstack-infra03:54
anteayatonyb: yup, thanks03:55
tonybanteaya: I have a workaround I can do which is to "require" yaml2ical from git rather than pypi03:57
*** yamada-h has quit IRC03:57
tonybanteaya: if dhellmann and dims_ are swamped I'll do that rather then the release.03:58
anteayaoh as long as everyone is fine with that03:58
anteayagood idea03:58
*** torandu has quit IRC03:58
*** yamada-h has joined #openstack-infra03:59
*** torandu has joined #openstack-infra04:00
*** yamada-h_ has joined #openstack-infra04:01
*** sputnik13_ has quit IRC04:02
*** achanda has quit IRC04:03
*** Daisy has joined #openstack-infra04:05
*** yamada-h has quit IRC04:05
*** IlyaG has joined #openstack-infra04:06
*** akshai has quit IRC04:06
openstackgerritRabi Mishra proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished
*** Daisy has quit IRC04:09
*** IlyaG has quit IRC04:10
*** IlyaG has joined #openstack-infra04:10
*** maishsk has quit IRC04:12
*** nihilifer has quit IRC04:15
openstackgerritNisha Agarwal proposed openstack/diskimage-builder: Install proliantutils in IPA's virtualenv
*** nihilifer has joined #openstack-infra04:16
*** maishsk has joined #openstack-infra04:18
*** fawadkhaliq has joined #openstack-infra04:18
*** maishsk has quit IRC04:22
*** yuanying has joined #openstack-infra04:24
*** yfried has quit IRC04:28
*** harlowja_at_home has joined #openstack-infra04:33
*** rossella_s has quit IRC04:34
*** Daisy has joined #openstack-infra04:35
*** rossella_s has joined #openstack-infra04:35
*** markvoelker has joined #openstack-infra04:36
*** achanda has joined #openstack-infra04:37
*** kzaitsev_mb has joined #openstack-infra04:38
*** esker has joined #openstack-infra04:43
*** kzaitsev_mb has quit IRC04:44
*** resker has joined #openstack-infra04:47
*** erlon has quit IRC04:47
*** esker_ has joined #openstack-infra04:48
*** esker has quit IRC04:48
*** esker has joined #openstack-infra04:50
*** resker has quit IRC04:51
*** esker_ has quit IRC04:52
*** roxanaghe has joined #openstack-infra04:53
openstackgerritMerged openstack-infra/project-config: create api-ref publishing pipeline
*** esker has quit IRC04:55
*** yamada-h has joined #openstack-infra04:55
*** MarkAtwood has joined #openstack-infra04:56
*** yamada-h_ has quit IRC04:58
*** yamada-h has quit IRC05:02
*** esker has joined #openstack-infra05:04
*** resker has joined #openstack-infra05:05
*** esker_ has joined #openstack-infra05:06
*** yamada-h has joined #openstack-infra05:07
*** esker has quit IRC05:09
*** resker has quit IRC05:10
*** sputnik13_ has joined #openstack-infra05:10
*** esker has joined #openstack-infra05:11
*** esker_ has quit IRC05:11
*** yamada-h has quit IRC05:12
*** resker has joined #openstack-infra05:12
openstackgerritFredrik Medley proposed openstack-infra/zuul: Improve job dependencies using graph instead of tree
*** jaosorior has joined #openstack-infra05:14
*** esker has quit IRC05:16
*** resker has quit IRC05:17
*** sputnik13_ has quit IRC05:17
*** rlandy has quit IRC05:17
openstackgerritFredrik Medley proposed openstack-infra/zuul: Improve job dependencies using graph instead of tree
*** isaacb has joined #openstack-infra05:18
*** esker has joined #openstack-infra05:20
*** sdake_ has quit IRC05:20
*** mtanino has quit IRC05:21
*** resker has joined #openstack-infra05:22
*** roxanaghe has quit IRC05:22
*** matt6434 is now known as mattoliverau05:23
*** esker_ has joined #openstack-infra05:24
*** esker has quit IRC05:24
*** asselin has quit IRC05:24
*** esker has joined #openstack-infra05:25
*** Nikolay_St has quit IRC05:26
*** resker has quit IRC05:26
*** resker has joined #openstack-infra05:26
*** resker has quit IRC05:27
*** resker has joined #openstack-infra05:27
*** Sukhdev has joined #openstack-infra05:28
*** esker__ has joined #openstack-infra05:28
*** esker_ has quit IRC05:29
*** sdake has joined #openstack-infra05:29
*** esker has quit IRC05:30
*** resker has quit IRC05:32
*** esker__ has quit IRC05:33
*** abregman has joined #openstack-infra05:35
*** mylu has quit IRC05:38
*** kzaitsev_mb has joined #openstack-infra05:39
*** Sukhdev has quit IRC05:39
*** Daisy has quit IRC05:40
*** yamada-h has joined #openstack-infra05:40
*** esikachev has joined #openstack-infra05:40
*** sridhar_ram has joined #openstack-infra05:45
*** sputnik13net has joined #openstack-infra05:45
*** kzaitsev_mb has quit IRC05:45
*** isaacb has quit IRC05:46
*** esker has joined #openstack-infra05:46
*** sdake has quit IRC05:48
*** sputnik13 has quit IRC05:48
*** yfried has joined #openstack-infra05:51
*** sdake has joined #openstack-infra05:51
*** esker has quit IRC05:53
*** sridhar_ram1 has joined #openstack-infra05:55
*** sridhar_ram has quit IRC05:57
*** esikachev has quit IRC05:57
*** jerryz has quit IRC05:59
*** esker has joined #openstack-infra05:59
*** esikachev has joined #openstack-infra06:01
*** harlowja_at_home has quit IRC06:01
*** yamada-h has quit IRC06:03
*** esker has quit IRC06:04
*** camunoz has quit IRC06:04
*** esker has joined #openstack-infra06:05
*** esikachev has quit IRC06:08
*** Sukhdev has joined #openstack-infra06:09
*** esker has quit IRC06:09
*** Douhet has quit IRC06:10
*** markvoelker has quit IRC06:10
*** sputnik13 has joined #openstack-infra06:11
*** Douhet has joined #openstack-infra06:12
*** flepied1 is now known as flepied06:13
*** sridhar_ram1 is now known as sridhar_ram06:14
*** LaT0rtue has quit IRC06:15
*** akaszuba has joined #openstack-infra06:17
*** esikachev has joined #openstack-infra06:19
*** esker has joined #openstack-infra06:20
*** mikelk has joined #openstack-infra06:20
*** scheuran has joined #openstack-infra06:22
*** Nikolay_St has joined #openstack-infra06:24
*** esker has quit IRC06:25
*** rcernin has joined #openstack-infra06:26
*** LaT0rtue has joined #openstack-infra06:26
*** markvoelker has joined #openstack-infra06:26
*** Daisy has joined #openstack-infra06:29
*** esikachev has quit IRC06:30
*** aeng has quit IRC06:31
*** sflanigan has quit IRC06:32
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints
*** Daisy has quit IRC06:34
*** salv-orlando has joined #openstack-infra06:37
*** daemontool has joined #openstack-infra06:37
*** esker has joined #openstack-infra06:38
*** markvoelker has quit IRC06:39
*** kzaitsev_mb has joined #openstack-infra06:39
*** mrunge_ is now known as mrunge06:40
*** Daisy has joined #openstack-infra06:42
*** esker has quit IRC06:43
yolandagood morning06:43
*** flip214_ is now known as flip21406:44
*** flip214 has joined #openstack-infra06:44
*** aeng has joined #openstack-infra06:44
*** kzaitsev_mb has quit IRC06:45
*** sflanigan has joined #openstack-infra06:45
*** maishsk has joined #openstack-infra06:45
*** tesseract has joined #openstack-infra06:45
*** tesseract is now known as Guest2315706:46
*** jlanoux has joined #openstack-infra06:46
*** esker has joined #openstack-infra06:51
*** Thelo has joined #openstack-infra06:52
TheloHi all, in Nodepool which elements is supposed to create the jenkins user into the daily build?06:53
*** asettle has quit IRC06:53
*** esker has quit IRC06:56
abregmanThelo: hi. you mean this?:
*** nadya has joined #openstack-infra06:56
*** woodster_ has quit IRC06:57
*** zeih has joined #openstack-infra06:58
*** flepied has quit IRC06:58
*** eliqiao_ is now known as eliqiao06:58
*** LaT0rtue has quit IRC06:59
Theloabregman: perhaps, to do simple, when I run nodepool build-image  I find out that the jenkins user is not there and some of my elements refer to this user. From what I see here I just need to set up some environment variables?07:00
*** lezbar has joined #openstack-infra07:01
abregmanThelo: what elements do you see refer to this user?07:01
Theloabregman: for example :
*** jtomasek_ has joined #openstack-infra07:02
*** scheuran has quit IRC07:04
Theloabregman: then I get error like this ( I added the existing user to check whether jenkins is one of them)
abregmanhmm yes: chown: invalid user: 'jenkins:jenkins'07:06
*** shardy has joined #openstack-infra07:07
*** Sukhdev has quit IRC07:08
*** sridhar_ram has quit IRC07:09
*** arxcruz has joined #openstack-infra07:13
abregmanlooks like it assumes you have this user on the system07:14
*** nadya has quit IRC07:14
*** esker has joined #openstack-infra07:15
*** LaT0rtue has joined #openstack-infra07:15
*** yamahata has quit IRC07:16
*** yamahata has joined #openstack-infra07:17
*** matrohon has joined #openstack-infra07:17
*** scheuran has joined #openstack-infra07:18
*** esker has quit IRC07:20
Theloabregman: you mean the image I am building should have it by default07:22
*** yfried has quit IRC07:23
abregmanThelo: yes but that doesn't make sense07:23
*** fawadkhaliq has quit IRC07:24
*** Hal has joined #openstack-infra07:24
*** Hal is now known as Guest787707:25
*** esker has joined #openstack-infra07:27
*** ifarkas has joined #openstack-infra07:28
*** mrmartin has joined #openstack-infra07:28
*** ociuhandu has quit IRC07:30
*** daemontool has quit IRC07:30
*** fhubik has joined #openstack-infra07:31
*** permalac has joined #openstack-infra07:31
*** esker has quit IRC07:31
*** ybathia has joined #openstack-infra07:32
openstackgerritThomas Goirand proposed openstack-infra/project-config: Add a job to build openstack-pkg-tools
*** sputnik13 has quit IRC07:37
*** IlyaG has quit IRC07:37
*** sputnik13 has joined #openstack-infra07:37
*** kzaitsev_mb has joined #openstack-infra07:37
openstackgerritOleksandr Berezovskyi proposed openstack-infra/project-config: Add bareon-image-elements project
*** IlyaG has joined #openstack-infra07:38
*** elo has quit IRC07:38
*** elo has joined #openstack-infra07:38
*** markvoelker has joined #openstack-infra07:40
*** jed56 has joined #openstack-infra07:40
*** flepied has joined #openstack-infra07:41
*** ybathia has quit IRC07:41
*** daemontool has joined #openstack-infra07:41
*** hashar has joined #openstack-infra07:41
*** markvoelker has quit IRC07:45
*** esikachev has joined #openstack-infra07:47
*** LaT0rtue has quit IRC07:48
*** sdake_ has joined #openstack-infra07:49
*** nmagnezi has joined #openstack-infra07:49
*** sputnik13 has quit IRC07:49
*** dizquierdo has joined #openstack-infra07:50
*** sdake has quit IRC07:51
*** LaT0rtue has joined #openstack-infra07:54
DuncanTanteaya: and anybody else who might be interested / able to fix: pages on the wiki that are almost certainly spam (766 entries so far):
*** jtomasek has quit IRC07:58
*** salv-orlando has quit IRC07:58
*** esker has joined #openstack-infra07:59
trashSpamapS: Yeah, no problem. But how do we plan to solve this now? :)07:59
*** mkoderer__ has quit IRC08:00
*** yamada-h has joined #openstack-infra08:00
*** jordanP has joined #openstack-infra08:01
*** jtomasek_ has quit IRC08:01
*** mkoderer__ has joined #openstack-infra08:02
*** dkehn has quit IRC08:03
*** dkehn has joined #openstack-infra08:03
*** esker has quit IRC08:03
*** Nikolay_St has quit IRC08:03
DuncanTanteaya: And a second, smaller set - I had case sensitive searching by mistake:
openstackgerritOleksandr Berezovskyi proposed openstack-infra/project-config: Add bareon-image-elements project
*** esker has joined #openstack-infra08:05
*** Nikolay_St has joined #openstack-infra08:07
*** salv-orlando has joined #openstack-infra08:08
*** dizquierdo has quit IRC08:09
*** hashar has quit IRC08:09
*** tojuvone has quit IRC08:10
*** tojuvone has joined #openstack-infra08:10
*** esker has quit IRC08:10
*** hashar has joined #openstack-infra08:10
*** EricGonczer_ has joined #openstack-infra08:14
openstackgerritMerged openstack-infra/project-config: zuul_swift_upload add support for --verbose
*** jlanoux has quit IRC08:14
openstackgerritMerged openstack-infra/project-config: Conveyor focuses on cloning and migrating Openstack resources.
openstackgerritMerged openstack-infra/system-config: Remove 'Temporary for debugging glance' on jenkins slaves
openstackgerritMerged openstack-infra/project-config: Remove oslo.messaging from bandit integration
openstackgerritMerged openstack-infra/project-config: Add a periodic mitaka job for TripleO
*** _degorenko|afk is now known as degorenko08:18
*** sfinucan has joined #openstack-infra08:18
openstackgerritMerged openstack-infra/project-config: devstack-plugin-nfs: Make tempest non-voting
*** ihrachys has joined #openstack-infra08:20
*** tojuvone has quit IRC08:21
*** tojuvone has joined #openstack-infra08:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Rename openstack-ansible-ironic to openstack-ansible-os_ironic
*** EricGonczer_ has quit IRC08:21
*** yamahata has quit IRC08:22
*** esker has joined #openstack-infra08:22
*** achanda has quit IRC08:23
*** resker has joined #openstack-infra08:23
*** lucas-dinner is now known as lucasagomes08:23
*** zhurong_ has quit IRC08:23
*** jcoufal has joined #openstack-infra08:24
*** zhurong has joined #openstack-infra08:25
*** jistr has joined #openstack-infra08:25
*** LaT0rtue has quit IRC08:27
*** esker has quit IRC08:27
*** resker has quit IRC08:28
*** dgonzalez has quit IRC08:29
*** derekh has joined #openstack-infra08:29
*** earlephilhower has quit IRC08:30
openstackgerritMerged openstack-infra/tripleo-ci: Deploy ceph in the nonha job
*** sputnik13net has quit IRC08:35
*** dgonzalez has joined #openstack-infra08:35
*** sdake_ has quit IRC08:36
*** tojuvone has quit IRC08:37
*** tojuvone has joined #openstack-infra08:37
*** jlanoux has joined #openstack-infra08:41
*** markvoelker has joined #openstack-infra08:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Rename openstack-ansible-ironic to openstack-ansible-os_ironic
*** tosky has joined #openstack-infra08:46
odyssey4meAJaeger is there something specific I'm missing from ? I did follow that documentation, but it appears to be geared at infra-cores and not really project owners (I can't do things on the puppetmaster, for instance).08:46
*** markvoelker has quit IRC08:47
AJaegerodyssey4me: contains everything you can do.08:47
AJaegerWhere does it mention puppetmaster?08:47
odyssey4meAJaeger oops, I was reading :/08:48
*** ociuhandu has joined #openstack-infra08:48
AJaegerodyssey4me: That is internal documentation indeed ;)08:48
*** e0ne has joined #openstack-infra08:48
AJaegerYou really should follow the short section I gave on your review.08:48
AJaegerQuick check: Check topic and our tracking list "Upcoming Project Renames".08:49
AJaegerodyssey4me: best to reach out to fungi later today and ask him when to do this.08:49
AJaegerProject renames are really bad - a manual process that means downtime for whole of gerrit for at least an hour ;(08:50
*** Ramanjaneya has joined #openstack-infra08:50
*** Ramanjaneya has quit IRC08:50
*** Ramanjaneya_ has joined #openstack-infra08:50
AJaegerodyssey4me: for governance changes, follow best practice and say:08:50
mrmartinyolanda: morning, do you know who can help me from infra side to upgrade the groups-dev.o.o node from precise to trusty?08:50
mrmartinI'll add a patch for system-config's site.pp, but as I understand it is still a manual process.08:51
AJaegerNeeded-By: CHANGE-ID in the project-config one - so, Needed-By: I2ab80e4fdb413d469c7aa65e5f018b66cc203b7c08:51
*** flepied has quit IRC08:51
odyssey4meAJaeger yeah, just fixed up the topic and added the rename to the agenda08:52
odyssey4meoh needed-by? that's a new one :)08:52
*** Ramanjaneya has joined #openstack-infra08:52
yolandamrmartin, in that cases we setup a replacement node, with the new distro. Do you have data that needs to be migrated? or will be ok to have a new server?08:52
AJaegermrmartin: btw. I stopped the php removal for now, that's something for the future08:52
AJaegerodyssey4me: introduced at the same time as we introduced depends-on08:52
AJaegerodyssey4me: it'S just for documentation purposes - so, the backlink for depends-on08:53
mrmartinyolanda: nothing extra, as it is a dev node, we can rebuild it08:53
mrmartinwithout any consequences08:53
odyssey4meoh, I seem to have been doing it wrong the whole time08:53
odyssey4meok, will fix that up now08:53
yolandai can launch a replacement node for you08:53
mrmartinnext to the existing one, or replace it?08:54
AJaegerodyssey4me: not worth a -1 but I noticed it and therefore wanted to bring it up...08:54
yolandaa new one, with new ip addresses08:54
* AJaeger will be offline for a while now...08:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Rename openstack-ansible-ironic to openstack-ansible-os_ironic
yolandamrmartin, once it is ready and tested, the dns entry can be changed08:54
yolandais that ok for you?08:54
*** Ramanjaneya_ has quit IRC08:54
odyssey4meAJaeger thanks - I'll be doing it right from now on :)08:54
mrmartinthat's perfect08:54
*** AJaeger has quit IRC08:55
mrmartinwe need to approve those patches first:
*** lezbar has quit IRC08:55
mrmartinit is required for trusty compatibility08:55
yolandaah, then it will need an extra +208:55
openstackgerritMerged openstack-infra/system-config: Do not install sbcl
yolandamrmartin, i think the best is to wait for pabelanger to come online, he usually comes soon, and ask for review08:56
yolandathe i can setup the replacement node08:56
mrmartinok, I'll try to catch the guys later08:56
mrmartinawesome, thank you08:57
*** esker has joined #openstack-infra08:57
yolandalet's talk later then08:57
openstackgerritMerged openstack-infra/project-config: fuel-stats: use db setup for python jobs
*** esker has quit IRC09:01
*** achanda has joined #openstack-infra09:06
*** scheuran has quit IRC09:07
*** esker has joined #openstack-infra09:08
*** flepied has joined #openstack-infra09:08
openstackgerritMerged openstack-infra/project-config: Add release notes translation scripts
openstackgerritMerged openstack-infra/project-config: Run bindep on project-config only if needed
openstackgerritMerged openstack-infra/project-config: Remove sbcl from bindep-fallback.txt
*** tojuvone has quit IRC09:11
*** tojuvone has joined #openstack-infra09:11
*** rraja has joined #openstack-infra09:12
*** esker has quit IRC09:13
*** ramineni has quit IRC09:13
*** ramineni has joined #openstack-infra09:13
*** daemontool has quit IRC09:17
*** Ramanjaneya has quit IRC09:21
openstackgerritMerged openstack-infra/tripleo-ci: Use --overcloud-update in the upgrades job
openstackgerritJan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks
openstackgerritJan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent
openstackgerritJan Hruban proposed openstack-infra/zuul: Lower the log level in tests
openstackgerritJan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter
openstackgerritJan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose
openstackgerritJan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug.
openstackgerritJan Hruban proposed openstack-infra/zuul: support github pull reqeust labels
openstackgerritJan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events.
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github
openstackgerritJan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub
openstackgerritJan Hruban proposed openstack-infra/zuul: GitHub file matching support
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs
openstackgerritJan Hruban proposed openstack-infra/zuul: Log GitHub API rate limit
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow using webapp from connections
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow list values in template parameters.
*** scheuran has joined #openstack-infra09:22
openstackgerritJan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter.
*** hichihara has quit IRC09:23
*** mescanef has joined #openstack-infra09:23
*** esker has joined #openstack-infra09:24
*** yamada-h has quit IRC09:24
*** nadya has joined #openstack-infra09:25
openstackgerritMarton Kiss proposed openstack-infra/system-config: Upgrade groups-dev.o.o to trusty
openstackgerritAttila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 on the upgrades job
*** esker has quit IRC09:29
*** ramineni has quit IRC09:30
*** yaume has joined #openstack-infra09:31
*** markmcd1 has quit IRC09:34
*** lezbar has joined #openstack-infra09:35
*** esker has joined #openstack-infra09:36
*** maishsk has quit IRC09:37
*** Daisy has quit IRC09:37
*** resker has joined #openstack-infra09:38
*** Daisy has joined #openstack-infra09:38
*** lucasagomes has quit IRC09:38
openstackgerritMerged openstack-infra/project-config: Add job to test Nova with specific libvirt and kvm packages
*** esker_ has joined #openstack-infra09:39
*** markmcd has joined #openstack-infra09:39
*** maishsk has joined #openstack-infra09:39
*** maishsk has quit IRC09:39
*** dtantsur|afk is now known as dtantsur09:39
*** Daisy has quit IRC09:39
*** esker__ has joined #openstack-infra09:40
*** Daisy has joined #openstack-infra09:40
openstackgerritStéphane Albert proposed openstack/requirements: Fix use of a renamed itertools function in python3
*** esker___ has joined #openstack-infra09:41
*** esker has quit IRC09:41
*** maishsk has joined #openstack-infra09:42
*** resker has quit IRC09:42
*** resker has joined #openstack-infra09:43
*** esker_ has quit IRC09:43
*** lucasagomes has joined #openstack-infra09:43
*** markvoelker has joined #openstack-infra09:44
*** esker_ has joined #openstack-infra09:44
*** esker__ has quit IRC09:44
*** Daisy has quit IRC09:45
*** ramineni has joined #openstack-infra09:45
*** esker___ has quit IRC09:45
*** tojuvone has quit IRC09:46
*** tojuvone has joined #openstack-infra09:46
*** markmcd has quit IRC09:46
*** resker has quit IRC09:48
*** esker_ has quit IRC09:48
*** markmcd has joined #openstack-infra09:49
*** markvoelker has quit IRC09:49
*** arxcruz has quit IRC09:50
*** LaT0rtue has joined #openstack-infra09:51
*** arxcruz has joined #openstack-infra09:51
*** eliqiao has quit IRC09:52
*** eliqiao has joined #openstack-infra09:53
*** cdent has joined #openstack-infra09:53
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs
mescanefhello. have here anyone tried nodepool with Ironic?09:55
rcarrillocruzmescanef: what do you mean?09:55
rcarrillocruzrunning it against a cloud that has nova-ironic09:55
rcarrillocruznodepool doesn't have a 'plugin' system, where you can choose to boot vms vs bm vs containers09:56
*** esker has joined #openstack-infra09:56
mescanefrcarrillocruz: yes, Im looking for information if older nodepool version - 0.1.x - is compatibile with this setup09:56
rcarrillocruzwell, nodepool talks to nova09:56
mescanefor Ill need nodepool 0.2.x09:56
rcarrillocruzso the stuff you put underneath it09:56
rcarrillocruzit won't care09:56
rcarrillocruzi mean, you could even set up your cloud with nova-docker09:56
rcarrillocruznodepool would not even know09:56
rcarrillocruzas it just interfaces with nova for 'gimme a server'09:57
*** Jeffrey4l has quit IRC09:57
mescanefrcarrillocruz: oh, great, thanks09:57
rcarrillocruzmescanef: if you play with it, let us know, i'd be curious how it works for you09:58
rcarrillocruzas it was discussed this topic on yesterday's infra meeting09:58
*** Qiming has joined #openstack-infra09:58
yolandamescanef, yes please, i'm interested on that as well09:58
mescanefyeah there is a plan to run nodepool with ironic, we will see how it goes09:58
*** resker has joined #openstack-infra09:59
*** esker has quit IRC10:00
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs
*** resker has quit IRC10:03
*** chem has quit IRC10:08
*** esker has joined #openstack-infra10:09
*** chem has joined #openstack-infra10:10
*** resker has joined #openstack-infra10:10
*** resker has quit IRC10:11
*** resker has joined #openstack-infra10:11
*** flepied has quit IRC10:12
*** tojuvone has quit IRC10:13
*** tojuvone has joined #openstack-infra10:14
*** esker has quit IRC10:14
*** achanda has quit IRC10:14
*** tojuvone has quit IRC10:14
odyssey4meyolanda is there something I need to do in order for to merge? or is there something unrelated that's gone wrong?10:14
*** tojuvone has joined #openstack-infra10:15
odyssey4meit looks like the irc-access job is failing10:15
*** achanda has joined #openstack-infra10:16
*** resker has quit IRC10:16
*** sdague has joined #openstack-infra10:16
yolandalet me check10:17
yolandayep, that timeout in check and gate is not good10:19
*** zeih has quit IRC10:21
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: DO NOT REVIEW
yolandai rechecked and will hold the node used for it10:22
*** ams_ has joined #openstack-infra10:23
yolandai see another that hangs on midonet as well, there is something wrong there for sure10:24
krotscheckI've had another vexxhost node timeout during bindep. Anyone know what's going on?10:24
yolandakrotscheck,i'm debugging another timeout now, but i don't see that as related10:25
*** esker has joined #openstack-infra10:25
*** _amrith_ is now known as amrith10:26
*** flepied has joined #openstack-infra10:26
krotscheckyolanda: Rechecking is safe enough10:26
*** resker has joined #openstack-infra10:26
yolandayep, try a recheck, and if that continues i can take a look at logs. I have seen the queue very slow today10:26
*** achanda has quit IRC10:27
*** esker_ has joined #openstack-infra10:28
*** tojuvone has quit IRC10:28
*** tojuvone has joined #openstack-infra10:29
yolandaodyssey4me, check seems to be stopping on kolla10:30
*** esker has quit IRC10:30
*** resker has quit IRC10:31
*** esker_ has quit IRC10:32
*** maishsk has quit IRC10:32
*** chem has quit IRC10:35
*** esker has joined #openstack-infra10:40
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: Update wanted_ci_job to reflect current status of things
*** resker has joined #openstack-infra10:41
*** cdent has quit IRC10:41
*** esker_ has joined #openstack-infra10:42
*** esker__ has joined #openstack-infra10:43
*** rraja has quit IRC10:44
*** esker has quit IRC10:45
yolandaodyssey4me, i have the problem. There is a redirect from kolla to openstack-kolla. When i run the check on openstack-kolla, it works. So i'm going to propose a fix10:46
*** LaT0rtue has quit IRC10:46
*** resker has quit IRC10:46
*** esker_ has quit IRC10:47
odyssey4meyolanda great, thanks10:47
*** tojuvone has quit IRC10:48
*** tojuvone has joined #openstack-infra10:48
*** esker__ has quit IRC10:48
openstackgerrityolanda.robla proposed openstack-infra/project-config: Rename kolla channel in accessbot
yolandaAJaeger, odyssey4me ^10:49
*** zeih has joined #openstack-infra10:51
odyssey4methanks yolanda - hopefully that works10:51
yolandayes, i tested manually and worked10:51
openstackgerritvikram.choudhary proposed openstack-infra/project-config: Adding neutron-bgp as a part of neutron project.
*** sdague has quit IRC10:53
*** sdague has joined #openstack-infra10:53
yolandasdague, can you +2 ? needed to unlock gate for project-config10:56
*** daemontool has joined #openstack-infra10:57
yolandaat least going to send that, but then the proper rename of the channel in all bots needs to be done10:58
*** hashar has quit IRC10:58
yolandathe proper solution should be that the bot doesn't hang on redirects anyway...10:58
*** esker has joined #openstack-infra11:00
*** esikachev has quit IRC11:01
*** nadya has quit IRC11:02
*** esker has quit IRC11:05
*** dprince has joined #openstack-infra11:05
*** pblaho has joined #openstack-infra11:06
openstackgerritOleksandr Berezovskyi proposed openstack-infra/project-config: Add bareon-image-elements project
yolandasdague, so the change failed. Seems that this check is comparing the channels in accessbot and gerritbot, so i need to do a proper rename to fix it11:08
openstackgerrityolanda.robla proposed openstack-infra/project-config: Rename kolla channel in accessbot
*** maishsk has joined #openstack-infra11:11
*** tojuvone has quit IRC11:12
openstackgerritRyan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again
yolanda#status notice Gate on project-config is currently broken due to IRC tests. The problem has been detected and we are working to fix the issue as soon as possible.11:12
openstackstatusyolanda: sending notice11:12
*** tojuvone has joined #openstack-infra11:13
*** esikachev has joined #openstack-infra11:14
-openstackstatus- NOTICE: Gate on project-config is currently broken due to IRC tests. The problem has been detected and we are working to fix the issue as soon as possible.11:14
openstackstatusyolanda: finished sending notice11:15
*** dprince has quit IRC11:20
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Tempest for tripleo CI
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs
*** ramineni has quit IRC11:21
*** ericksonsantos has quit IRC11:21
*** esker has joined #openstack-infra11:24
yolandasdague, can you +2 again? it passed now11:24
*** resker has joined #openstack-infra11:25
*** rraja has joined #openstack-infra11:25
*** asselin has joined #openstack-infra11:26
yolandathx AJaeger as well11:26
*** devkulkarni has joined #openstack-infra11:27
*** esker_ has joined #openstack-infra11:27
*** achanda has joined #openstack-infra11:27
openstackgerritJulien Danjou proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config
*** esker__ has joined #openstack-infra11:28
*** cdent has joined #openstack-infra11:28
*** esker has quit IRC11:28
*** esker has joined #openstack-infra11:29
*** resker has quit IRC11:30
*** resker has joined #openstack-infra11:30
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Added validation to --overcloud-deploy option.
*** esker_ has quit IRC11:32
openstackgerritMerged openstack-infra/project-config: Rename kolla channel in accessbot
*** esker__ has quit IRC11:33
yolandanice! time for rechecks11:33
*** cj has quit IRC11:33
*** achanda has quit IRC11:33
*** esker has quit IRC11:34
*** resker has quit IRC11:34
*** placko_ has joined #openstack-infra11:35
*** permalac has quit IRC11:35
*** |-paul-| has joined #openstack-infra11:36
*** ramineni has joined #openstack-infra11:36
*** skolekonov|away is now known as skolekonov11:37
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic-staging-drivers-dsvm job
*** tojuvone has quit IRC11:41
*** esker has joined #openstack-infra11:41
*** tojuvone has joined #openstack-infra11:41
*** resker has joined #openstack-infra11:42
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs
*** LaT0rtue has joined #openstack-infra11:45
*** tojuvone has quit IRC11:45
*** ldnunes has joined #openstack-infra11:45
*** Daisy has joined #openstack-infra11:45
*** esker has quit IRC11:46
*** tojuvone has joined #openstack-infra11:46
*** markvoelker has joined #openstack-infra11:46
*** resker has quit IRC11:47
*** placko_ has quit IRC11:47
openstackgerritMerged openstack-infra/groups: Remove map panel title from home
*** openstackgerrit has quit IRC11:47
*** dprince has joined #openstack-infra11:47
*** openstackgerrit has joined #openstack-infra11:48
*** huzhj_ has joined #openstack-infra11:48
*** hashar has joined #openstack-infra11:48
*** esker has joined #openstack-infra11:50
*** tojuvone has quit IRC11:51
*** resker has joined #openstack-infra11:51
*** tojuvone has joined #openstack-infra11:51
*** thorst has joined #openstack-infra11:51
*** markvoelker has quit IRC11:51
*** tpsilva has joined #openstack-infra11:51
*** esker_ has joined #openstack-infra11:52
*** esker__ has joined #openstack-infra11:53
*** esker___ has joined #openstack-infra11:54
*** esker has quit IRC11:54
*** nadya has joined #openstack-infra11:55
*** tojuvone has quit IRC11:55
*** resker has quit IRC11:55
*** Daisy has quit IRC11:56
*** resker has joined #openstack-infra11:56
*** nadya has quit IRC11:56
*** tojuvone has joined #openstack-infra11:56
*** Daisy has joined #openstack-infra11:56
*** esker_ has quit IRC11:57
*** nadya has joined #openstack-infra11:57
*** esker__ has quit IRC11:57
*** esker___ has quit IRC11:58
*** Daisy has quit IRC12:01
*** resker has quit IRC12:01
*** placko_ has joined #openstack-infra12:03
openstackgerritMerged openstack-infra/project-config: Add Rally role to OpenStack-Ansible
*** |-paul-| has quit IRC12:06
*** weshay has joined #openstack-infra12:07
*** weshay has quit IRC12:08
*** weshay has joined #openstack-infra12:09
*** esker has joined #openstack-infra12:10
*** resker has joined #openstack-infra12:11
*** zeih has quit IRC12:12
*** esker_ has joined #openstack-infra12:12
*** Nikolay_St has quit IRC12:13
*** esker__ has joined #openstack-infra12:13
*** esker___ has joined #openstack-infra12:14
*** esker has quit IRC12:15
*** sfinucan has quit IRC12:15
*** resker has quit IRC12:15
*** esker_ has quit IRC12:17
*** david-lyle_ has joined #openstack-infra12:17
*** david-lyle has quit IRC12:17
*** LaT0rtue has quit IRC12:17
*** esker__ has quit IRC12:18
*** esker___ has quit IRC12:19
*** smarcet has joined #openstack-infra12:19
smarcetyolanda: morning12:19
smarcetyolanda: i am trying to update metadata.json here
smarcetyolanda: for puppetlabs-apache, but i found that here is tied to a commit sha1 not a version number12:20
smarcetso not sure how to reflect that on metadata.json12:21
*** pradk has quit IRC12:21
*** pradk has joined #openstack-infra12:21
smarcetyolanda : { "name": "puppetlabs/apache", "version_requirement": "b9f630a60811694916ecf8758103d4bca2ac6038" } ?12:21
*** erlon has joined #openstack-infra12:23
*** esker has joined #openstack-infra12:25
*** lucasagomes is now known as lucas-hungry12:25
*** kgiusti has joined #openstack-infra12:26
*** resker has joined #openstack-infra12:26
*** Guest15833 is now known as Vivek12:26
*** Vivek has quit IRC12:26
*** Vivek has joined #openstack-infra12:26
*** daemontool has quit IRC12:27
*** esker_ has joined #openstack-infra12:27
openstackgerritZara proposed openstack-infra/python-storyboardclient: Update to include links
*** esker__ has joined #openstack-infra12:28
*** salv-orl_ has joined #openstack-infra12:28
*** esker has quit IRC12:30
*** resker has quit IRC12:30
*** salv-orlando has quit IRC12:31
*** esker_ has quit IRC12:31
*** daemontool has joined #openstack-infra12:32
*** esker__ has quit IRC12:33
*** LaT0rtue has joined #openstack-infra12:33
*** openstackgerrit has quit IRC12:33
*** openstackgerrit has joined #openstack-infra12:33
*** devkulkarni has quit IRC12:34
*** rossella_s has quit IRC12:34
*** rossella_s has joined #openstack-infra12:35
openstackgerritMerged openstack-infra/project-config: Add a microversion-parse project
*** jaosorior has quit IRC12:38
*** aysyd has joined #openstack-infra12:39
*** jaosorior has joined #openstack-infra12:39
*** smarcet has quit IRC12:39
*** baoli has joined #openstack-infra12:39
*** baoli has quit IRC12:39
*** smarcet has joined #openstack-infra12:39
*** baoli has joined #openstack-infra12:39
*** zeih has joined #openstack-infra12:39
*** gordc has joined #openstack-infra12:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Retire openstack-ansible-os_swift_sync repository
*** aysyd has quit IRC12:43
*** amrith is now known as _amrith_12:44
*** aysyd has joined #openstack-infra12:44
openstackgerritDmitry Tantsur proposed openstack/requirements: Bump python-ironic-inspector-client to 1.5.0
*** EricGonczer_ has joined #openstack-infra12:44
*** huzhj has joined #openstack-infra12:44
dtantsurnot sure if requirements are unfrozen already ^^^12:44
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm
*** ayoung has quit IRC12:46
*** markvoelker has joined #openstack-infra12:47
*** huzhj_ has quit IRC12:47
*** e0ne has quit IRC12:48
*** esker has joined #openstack-infra12:49
*** resker has joined #openstack-infra12:50
*** esker_ has joined #openstack-infra12:51
*** markvoelker has quit IRC12:51
*** edmondsw has joined #openstack-infra12:52
*** huzhj_ has joined #openstack-infra12:53
*** baoli_ has joined #openstack-infra12:54
*** esker has quit IRC12:54
*** resker has quit IRC12:55
*** huzhj has quit IRC12:55
*** xyang1 has joined #openstack-infra12:55
*** esker_ has quit IRC12:56
*** eharney has joined #openstack-infra12:56
*** rlandy has joined #openstack-infra12:56
*** baoli has quit IRC12:57
*** amitgandhinz has joined #openstack-infra12:57
*** edmondsw has quit IRC12:58
*** zhurong has quit IRC13:01
*** dtardivel has joined #openstack-infra13:01
*** aysyd has quit IRC13:03
*** aysyd has joined #openstack-infra13:03
*** andymaier has joined #openstack-infra13:03
*** AJaeger has joined #openstack-infra13:03
*** esker has joined #openstack-infra13:04
AJaegerdims_: I commented on your u-c recommendation - as much as I love to have us ready for this, we're not.13:04
*** annegentle has joined #openstack-infra13:04
AJaegerinfra folks: I'm speaking about
*** placko_ has quit IRC13:05
*** resker has joined #openstack-infra13:05
*** esker_ has joined #openstack-infra13:06
dims_AJaeger : ack, we have to keep pushing hopefully in the right direction :)13:06
*** abregman is now known as abregman|mtg13:07
*** esker has quit IRC13:09
*** resker has quit IRC13:09
AJaegerdims_: that trove change is just broken, it will fail to publish tarballs, fail to publish documents ;(13:09
*** huzhj__ has joined #openstack-infra13:10
*** esker_ has quit IRC13:10
*** akshai has joined #openstack-infra13:10
AJaegerdims_: We first need to make u-c foolproof and working in all queues. Projects do not know what is invoked in post queue. Just see my comments on the trove change on what is wrong - I hope you educate and review all projects if you push them ;)13:11
*** cloudtrainme has joined #openstack-infra13:11
*** huzhj_ has quit IRC13:12
*** [1]Thelo has joined #openstack-infra13:16
*** _ari_ has joined #openstack-infra13:17
*** annegentle has quit IRC13:17
*** mescanef_ has joined #openstack-infra13:17
*** [HeOS] has joined #openstack-infra13:18
*** openstackgerrit has quit IRC13:18
*** placko_ has joined #openstack-infra13:18
*** openstackgerrit has joined #openstack-infra13:18
*** EricGonc_ has joined #openstack-infra13:18
*** nikhil_k has joined #openstack-infra13:18
*** mescanef has quit IRC13:19
*** Thelo has quit IRC13:19
*** [1]Thelo is now known as Thelo13:19
*** hrybacki has quit IRC13:19
AJaegerzuul cores, could you check Nakato's change for supporting constraints in the post queue, please? That's a major change in setting up the job.13:19
*** nikhil has quit IRC13:19
*** edwarnicke has quit IRC13:19
*** ams_ has quit IRC13:20
*** HeOS has quit IRC13:20
*** hrybacki has joined #openstack-infra13:21
*** EricGonczer_ has quit IRC13:21
*** edwarnicke has joined #openstack-infra13:21
*** tiswanso has joined #openstack-infra13:22
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add story_type_id to stories
*** esker has joined #openstack-infra13:24
*** ams_ has joined #openstack-infra13:24
*** doug-fis_ has quit IRC13:25
*** EricGonc_ has quit IRC13:26
*** tmorin has joined #openstack-infra13:28
tmorinhi everyone13:29
tmorinI'm refining a gate job and running into an issue: the OVS version on the node is very old (version 2.0.2)13:29
*** esker has quit IRC13:29
tmorinwhat can I do to have a more recent one13:29
*** links has quit IRC13:30
*** zhurong_ has joined #openstack-infra13:30
tmorin(adding a package in devstack/files could be a way, but I'd hope for something lighter)13:30
tmorindougwig: ^^ maybe you'd have an idea ?13:30
*** achanda has joined #openstack-infra13:30
*** akaszuba has quit IRC13:31
matrohonajo, ihrachys : ^13:31
*** doug-fish has joined #openstack-infra13:31
*** huzhj__ has quit IRC13:32
matrohonajo, ihrachys : I think that qos jobs require a up-to-date version of ovs, am I wrong?13:32
*** tonytan4ever has joined #openstack-infra13:32
ihrachysmatrohon: for qos we don't depend on anything that is not avail in gate13:32
*** esker has joined #openstack-infra13:33
ihrachysmatrohon: but you should look at how we install new ovs for functional job13:33
*** mriedem has joined #openstack-infra13:33
*** Daisy has joined #openstack-infra13:33
matrohonihrachys, that's probably in fullstack that I saw a newer version of ovs in use!13:33
ihrachysfunctional it is13:33
openstackgerritZara proposed openstack-infra/python-storyboardclient: Update Timeline
ihrachyswe use it for the new flow based firewall driver13:34
matrohonihrachys, great thanks!13:34
*** edmondsw has joined #openstack-infra13:34
*** devkulkarni has joined #openstack-infra13:34
*** salv-orl_ has quit IRC13:34
ihrachysmatrohon: and that's the lib for ovs compilation in neutron devstack plugin tree:
ihrachysmatrohon: there were plans to move it out of tree though13:35
AJaegerfungi, clarkb: Could either of you look later at rossella_s's change for reviewday, please? Question is how to install gerrit-dash-creator. See
tmorinihrachys: thanks a lot13:35
ihrachysmatrohon: you need to talk to jlibosva13:35
anteayaDuncanT: thank you, I work on deleting these lists13:35
*** doug-fish has quit IRC13:35
rossella_sAJaeger, thanks for raising this point :)13:36
*** lucas-hungry is now known as lucasagomes13:36
ihrachystmorin: my pleasure13:36
mordredclarkb: apparently the ceph jewel release, which is the next LTS, is in RC and is coming out in the next or two13:36
*** achanda has quit IRC13:36
mordredclarkb: is it worth considering skipping hammer and going straight to jewel?13:36
mordredsince it's an LTS, that would potentially reduce the churn we'd have in repos13:36
mordredotoh, I'm guessing hammer is what's out there now13:36
matrohontmorin, ihrachys : this means that we would better have some functional or fullstack tests rather than gate jobs to test bagpipe13:37
*** esker has quit IRC13:37
matrohontmorin, ihrachys : I think it would make sense13:37
tmorinmatrohon: I think that the functional test ihrachys is talking about are run in the gate, aren't they ?13:38
*** annegentle has joined #openstack-infra13:38
ihrachysmatrohon: you won't be able to run *integrated* job with your plugin enabled; but for other jobs that are not common to the whole openstack, you can also have your own ovs version.13:38
matrohontmorin, yep, non-voting last time I checked13:38
pabelangerEmilienM: we rolled new images last night, I take it you are not having the hiera issue now?13:38
ihrachysmatrohon: that said, I really suggest to consider lighter testing like functional or fullstack than pulling the whole stack with nova and friends if you don't really need it13:38
EmilienMpabelanger: not afik, will let you know if I see it13:39
ihrachystmorin: they are in check queue13:39
pabelangerEmilienM: Ya, I confirmed the correct version of puppet was installed before the upload13:39
anteayamordred: would that be next day or two, your sentence omitted a unit of time13:39
tmorinmatrohon, ihrachys: it seems to me that for us, simply adding our own trustry-compiled OVS-2.4 under ./devstack/files/debs/ would be good enough13:39
*** LaT0rtue has quit IRC13:39
EmilienMpabelanger: nice catch, thanks13:39
ihrachystmorin: so yes, in that sense they are also kinda 'gate'13:39
tmorinihrachys: yeah, ok13:40
mordredanteaya: haha13:40
ihrachystmorin: it may work for you. though then you need to maintain the package.13:40
AJaegeranteaya: year ;)13:40
mordredanteaya: week13:40
mordredanteaya: according to SamYaple13:40
anteayaAJaeger: that's a unit of time, indeed13:40
anteayamordred: week, that too is a unit of time13:40
tmorinihrachys: true,   versus using the OVS compilation sh routines in neutron/devstack  -- that's worth considering13:40
pabelangerAJaeger: fungi: So I talked with ianw, and think we are ready to roll out the centos-7 migration from devstack-centos713:42
pabelangerAJaeger: fungi: So, depending on what you think, we can likely start shortly13:42
*** annegentle has quit IRC13:43
AJaegerSeems like we have around 830 jobs on these nodes (local test is a week old)13:44
AJaegerpabelanger: can we start with one or two jobs?13:44
anteaya<-- not really here yet13:44
pabelangerAJaeger: Yup, we can start with a slow roll out13:44
pabelangerconfirming this are working, then ramp up13:45
openstackgerritLuigi Toscano proposed openstack-infra/project-config: [sahara-tests] create and merge, selectivly disable tests
mordredanteaya: me either13:45
AJaegerpabelanger: yeah...13:45
AJaegerpabelanger: we could start with projects that are already released for mitaka - or don't release - like windmill and puppet13:46
pabelangerAJaeger: Yup, that is a good idea13:47
AJaeger679 out of 829 jobs have puppet in the name13:47
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add experimental centos-7 puppet-apply
pabelangerokay, lets wait for fungi and also get some signoff from EmilienM13:47
EmilienMpabelanger: from what I can tell, this morning at 9am all was fine for our CI13:48
*** markvoelker has joined #openstack-infra13:48
EmilienMpabelanger: if nothing happens after, we're good13:48
pabelangerEmilienM: excellent! Just in time for us to do more CI changes :D13:48
AJaegerwhich leaves us with: cookbooks, ansible, packstack, kolla13:48
EmilienMpabelanger: go ahead!13:48
*** zeih has quit IRC13:48
AJaegerpabelanger: pick one area and go ahead. I'm happy not to be involved this time ;)13:49
pabelangerAJaeger: ack13:49
*** doug-fish has joined #openstack-infra13:50
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add repo_url and team_id
*** e0ne has joined #openstack-infra13:50
*** esker has joined #openstack-infra13:51
AJaegerpabelanger: the dependencies have merged, care to +A , please?13:51
AJaegerpabelanger: I can do that myself ;( Sorry, mixed up repository...13:52
*** doug-fis_ has joined #openstack-infra13:52
AJaegerpabelanger: needs +2A but is not urgent13:52
*** markvoelker has quit IRC13:52
*** mriedem is now known as mriedem_meeting13:54
pabelangerAJaeger: done and done13:55
*** doug-fish has quit IRC13:55
*** esker has quit IRC13:55
pabelangerodyssey4me: if you have a moment to read scroll back, we've looking at updating the ansible-roles-job to use centos-7 dib over devstack-centos7. Wanted to confirm you are okay with us starting on this?13:56
openstackgerritMerged openstack-infra/puppet-drupal: Support Apache 2.4
*** tqtran has joined #openstack-infra13:57
fungismarcet: pabelanger offered earlier this week to help switching puppet-openstackid over to using the puppetlabs apache module. he may still be willing to pitch in on 298699 if he's not too busy with other things13:57
smarcetfungi: i think that its almost done13:58
smarcetfungi: i just have some doubts on how to update metadata.json13:58
*** _amrith_ is now known as amrith13:58
smarcetfungi: its ok ?13:59
odyssey4mepabelanger yeah, no problem at all - the centos jobs are all nv for us at the moment13:59
smarcetfungi: bc the modules.env on config is tied to a commit sha not to a version #13:59
fungipabelanger: AJaeger: kicking off devstack-centos7 -> centos-7 seems fine to me. i expect impact to be even less than we say moving from devstack-trusty to ubuntu-trusty13:59
AJaegerpabelanger: if they are all -nv for ansible, that's one place to start, isn't it?13:59
*** scheuran has quit IRC13:59
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Reset network caches after network create/delete
*** Guest42028 has joined #openstack-infra14:00
odyssey4meAJaeger pabelanger yeah, it has no impact that would be a problem for OpenStack-Ansible14:00
pabelangerfungi: I think so too14:00
pabelangerAJaeger: odyssey4me: Ya, we can do -nv jobs first, which makes sense14:00
fungipabelanger: do you have a moment to weigh in on smarcet's metadata.json question for 298699?14:01
pabelangerfungi: sure14:01
fungiyou may have better context there since it's having to do with the apache puppet module migration14:01
fungii'm still trying to untangle a pile of other requests from overnight14:01
*** marcusvrn_ has joined #openstack-infra14:02
openstackgerritMerged openstack-infra/system-config: Add puppet-drush module to modules.env
smarcetpabelanger: hey i think that its mostly done , :)14:03
smarcetfungi: tnx !14:03
openstackgerritMerged openstack-infra/system-config: Remove libtidy install
openstackgerritMerged openstack-infra/project-config: Remove libtidy from bindep
pabelangersmarcet: fungi: we should really update our version of puppetlabs-apache to 1.8.0, since that was the release that includes our patch.  I'm just doing a diff now to see what else was included14:05
*** ramineni has quit IRC14:05
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Reset network caches after network create/delete
fungimrmartin: yolanda: i reviewed and approved the handful of changes needed to support upgrading to trusty. last of them should be merging momentarily14:05
mrmartinfungi: thank you, sounds exciting14:05
*** LaT0rtue has joined #openstack-infra14:05
*** knikolla has joined #openstack-infra14:05
fungii am also happy to boot the replacement server if yolanda is unavailable to do so for a while14:06
smarcetpabelanger: ok bc rite now on modules.env is tied to a commit sha114:06
*** Guest42028 has quit IRC14:07
*** EricGonczer_ has joined #openstack-infra14:08
Shrewsmordred: so, should we cut a bug fix shade release with this change, or do we want to try to get other things in with it?
pabelangersmarcet: right14:08
*** esker has joined #openstack-infra14:08
mordredShrews: I'd like to get the fixes needed for nodepool in too14:09
Shrewsmordred: ack14:09
mordredShrews: which I'm hoping to finish up in a few hours14:09
*** resker has joined #openstack-infra14:10
openstackgerritPaul Belanger proposed openstack-infra/system-config: Bump puppetlabs-apache to 1.8.1
pabelangersmarcet: fungi: I would suggest testing with ^14:11
*** e0ne has quit IRC14:11
pabelangeras that is the first release (and latest) to include or vhost::custom patch14:11
pabelangerI've included a diff to compare the changes that have landed14:12
*** esikachev has quit IRC14:12
*** sigmavirus24_awa is now known as sigmavirus2414:12
smarcetpabelanger: ok i would update metadata.json then14:13
*** esker has quit IRC14:13
*** chem has joined #openstack-infra14:13
pabelangersmarcet: yup, and also add a depends-on in your comment message for the patch above14:14
*** scheuran has joined #openstack-infra14:14
pabelangersmarcet: you can then use that version of puppetlabs-apache locally to test things work as expected14:14
*** resker has quit IRC14:14
smarcetwell i am using last one14:15
*** e0ne has joined #openstack-infra14:16
*** markvoelker has joined #openstack-infra14:16
*** zz_dimtruck is now known as dimtruck14:17
*** ajmiller has joined #openstack-infra14:19
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm
*** burgerk has joined #openstack-infra14:21
*** jaypipes has joined #openstack-infra14:21
*** eharney has quit IRC14:23
*** nmagnezi has quit IRC14:24
daemontoolAJaeger, ping14:24
*** Swami has joined #openstack-infra14:26
*** esikachev has joined #openstack-infra14:26
*** sohail_ has joined #openstack-infra14:28
*** links has joined #openstack-infra14:30
*** oanson has quit IRC14:32
*** jamesmcarthur has joined #openstack-infra14:34
*** armax_ has joined #openstack-infra14:36
openstackgerritPaul Belanger proposed openstack-infra/project-config: Move ansible-func non-voting to centos-7 dib
pabelangerAJaeger: odyssey4me: fungi: ^14:37
amrithAJaeger, yt?14:38
odyssey4mepabelanger LGTM, thanks for the heads-up14:38
*** armax has quit IRC14:39
*** armax_ is now known as armax14:39
*** EricGonczer_ has quit IRC14:40
*** abregman|mtg has quit IRC14:40
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add boards
*** cloudtrainme has quit IRC14:42
*** jsavak has joined #openstack-infra14:43
openstackgerritMarkus Zoeller (markus_z) proposed openstack-infra/project-config: fix testing job "tempest-dsvm-nova-libvirt-kvm-apr"
*** dizquierdo has joined #openstack-infra14:44
*** sdake has joined #openstack-infra14:44
*** hogepodge has quit IRC14:44
*** Sukhdev has joined #openstack-infra14:45
*** mriedem_meeting is now known as mriedem14:45
*** mtanino has joined #openstack-infra14:45
*** annegent_ has joined #openstack-infra14:46
*** markvoelker has quit IRC14:46
*** eharney has joined #openstack-infra14:47
*** links has quit IRC14:49
*** esker has joined #openstack-infra14:49
mrmartinyolanda: it was timed out and got -2 from Jenkins: what is the proper way to restart the job?14:50
*** dtantsur is now known as dtantsur|bbl14:52
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add worklists
jpmaxmanpabelanger: just curious why this apache module is a dependency for our patch to go through?14:53
fungijpmaxman: our (legacy) httpd module did not provide a mechanism for selecting the apache mpm and defaulted to whatever the distro selects instead (apache2-mpm-prefork package on ubuntu precise, for example)14:54
fungiwe've been underway with a peicemeal migration to the upstream puppetlabs apache module for a while14:55
*** MarkAtwood has quit IRC14:55
*** tmorin has left #openstack-infra14:55
*** cdent has quit IRC14:55
*** esker has quit IRC14:55
*** maishsk has quit IRC14:56
rcarrillocruzmordred: about to disconnect shortly14:56
rcarrillocruzwhich is explained in14:56
*** sdake_ has joined #openstack-infra14:56
rcarrillocruzlet me know what you think14:56
rcarrillocruzi plan on putting more enhancements, but the main functionality is there14:56
mordredrcarrillocruz: cool! I will look/read14:57
*** sdake has quit IRC14:57
rcarrillocruzone of the enhancements is the multi-region region resources on multi-region clouds.yaml clouds, but that needs fixing on ansible modules14:58
*** thiagop has joined #openstack-infra14:58
*** yamahata has joined #openstack-infra14:58
*** fedexo has joined #openstack-infra14:58
openstackgerritEric Harney proposed openstack-infra/project-config: Add NFS job to Cinder experimental
pabelangerjpmaxman: what fungi said14:59
yolandahi, i am back15:00
mordredrcarrillocruz: dude. I need to play with it in anger - but reading the example and the blog post - nicely done!15:00
*** jsavak has quit IRC15:01
*** annegent_ has quit IRC15:02
pabelangerfungi: clarkb: pleia2: Did we want to roll the dice on our ubuntu-xenial dib for nodepool? Even thought it is not stable yet?
pabelangergive people the change to start experimenting with it?15:02
jpmaxmanpabelanger fungi understood.  I just want to make sure we're not holding this up because we're seeing things that ideally should be upgraded but if they weren't upgraded the patch would still be fine.  In other words, should these things maybe be proposed as a separate patch and not as a dependency to this one?   In our tests, adding in the PHP5-FPM module15:03
jpmaxmanadjusted httpd to use the correct mpm15:03
pabelangerclarkb: Also, I did run devstack-gate on xenial, and found some issues.  Didn't actually get devstack running15:03
fungipabelanger: i'm not opposed to starting to build images for it. we should make it very clear to anyone who tries to configure jobs for it that it's experimental use only for now15:03
pabelangerfungi: agreed15:03
pabelangerfungi: and once we land it, I can restart nodepool-builder to pick it up15:04
fungijpmaxman: it can be split up into separate dependent patches in series for ease of reviewing. i'll leave it to pabelanger as to whether it's possible to move forward with the metadata.json pin to a git sha, but it sounds like it becomes far simpler with the latest puppetlabs module15:04
fungipabelanger: how many services do we have relying on that module at the moment?15:05
funginot many, right? i'd be fine pressing forward as long as it passes tests15:05
jpmaxmanfungi ok if it is simpler I'm all for it ;)15:05
pabelangerfungi: none right now. I have a nodepool patch up15:05
jpmaxmanI just want to make sure that it isn't a cascading change15:06
fungipabelanger: okay, in that case merging the update to a proper release version should be completely non-impacting15:06
*** jsavak has joined #openstack-infra15:06
*** roxanaghe has joined #openstack-infra15:06
pabelangerI figured openstackid could test it out, since they needed new functionality15:06
jpmaxmanwhen the objective is to get this patch in place to allow the server to handle more requests and not be crushed by load ;)15:06
fungijpmaxman: yep, i'm all for that15:06
*** esker has joined #openstack-infra15:07
fungiseeing what we can do to get this in place in a maintainable fashion asap15:07
jpmaxmanalso it's my understanding we're going to do this in dev first15:07
jpmaxmanI understand you have to see the bigger picture for these changes beyond just how it affects openstackid15:08
fungijpmaxman: correct, probably easiest given the significant size of the config management rework there to just temporarily disable puppet/ansible runs for production. it's a one-line patch to teh system-config repo which i'll go ahead and propose if someone else hasn't yet15:08
*** sdake has joined #openstack-infra15:08
jpmaxmanfungi: yes that would be great - thank you15:08
fungithen as soon as we see it work for, we can revert the disablement15:08
fungiand it will roll to produciton at that point15:08
fungior the version of that word which has some letters in a different order anyway ;)15:09
jpmaxmana prediction that production will produce15:10
*** sdake_ has quit IRC15:10
openstackgerritMerged openstack-infra/puppet-drupal: Refactor drush deployment
*** roxanaghe has quit IRC15:11
openstackgerritVictor Ryzhenkin proposed openstack-infra/project-config: Add murano non-voting job with glare backend
*** esker has quit IRC15:11
*** akaszuba has joined #openstack-infra15:11
openstackgerritPaul Belanger proposed openstack-infra/project-config: Move ansible-func non-voting to centos-7 dib
AJaegeramrith, I'll review your change now. daemontool, what's up?15:13
openstackgerritMonty Taylor proposed openstack-infra/shade: Support provider networks in public network detection
openstackgerritMonty Taylor proposed openstack-infra/shade: Mutex protect internal/external network detection
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Temporarily disable Puppet runs on
jpmaxmanok so if I understand correctly we're going to leave the patch as is, disable puppet/ansible production runs, then (hopefully) approve the patch so it goes to openstackid-dev.openstack.org15:15
fungismarcet: jpmaxman: pabelanger: ^ there's the disablement15:15
openstackgerritMerged openstack-infra/system-config: Bump puppetlabs-apache to 1.8.1
daemontoolAJaeger, all sorted thanks15:15
fungijpmaxman: right15:15
fungijpmaxman: and the upgrade to a proper release of the puppetlabs apache module is already winding its way to merging15:16
AJaegerdaemontool: great ;)15:16
yolandamrmartin, changes passed now, going to setup the replacement node15:16
jpmaxmanok cool - have to jump into a meeting, but will check back in an hour or so - appreciate it15:17
yolandamrmartin, you need groups-dev, right?15:17
fungijpmaxman: sure thing! i'm excited to see what this manages to scale to15:17
mrmartinyolanda, yes15:17
*** jsavak has quit IRC15:18
*** jsavak has joined #openstack-infra15:18
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add boards
openstackgerritMerged openstack-infra/subunit2sql: Add pypi and resource links to README.rst
*** Daisy_ has joined #openstack-infra15:21
*** mikelk has quit IRC15:21
*** Guest23157 has quit IRC15:21
*** sc68cal has joined #openstack-infra15:21
*** annegentle has joined #openstack-infra15:22
*** Daisy has quit IRC15:24
*** Daisy_ has quit IRC15:25
*** Sukhdev has quit IRC15:25
*** jamesmcarthur has quit IRC15:25
*** Sukhdev has joined #openstack-infra15:26
*** zeih has joined #openstack-infra15:26
openstackgerritsebastian marcet proposed openstack-infra/openstackid: OAuth2.0 app name edition
openstackgerritRyan Hallisey proposed openstack-infra/tripleo-ci: Use Fedora 23 atomic in container gate
*** LaT0rtue has quit IRC15:27
rcarrillocruzbbl folks15:27
*** annegentle has quit IRC15:28
*** markvoelker has joined #openstack-infra15:29
*** esikachev has quit IRC15:29
yolandaok, launch node running15:29
*** jamesmcarthur has joined #openstack-infra15:30
pabelangeryolanda: AJaeger: if you don't mind. first centos-7 migration15:30
*** devkulkarni has quit IRC15:31
openstackgerritMerged openstack-infra/project-config: fix testing job "tempest-dsvm-nova-libvirt-kvm-apr"
pabelangerfungi: Do you mind +A if you are happy with nodepool starting on ubuntu-xenial15:31
AJaegerpabelanger: just +2ed ;)15:31
*** devkulkarni has joined #openstack-infra15:31
AJaegerpabelanger: was just going to comment that this looks like a safe bet ;)15:32
*** cloudtrainme has joined #openstack-infra15:32
yolandaok approved15:32
*** woodster_ has joined #openstack-infra15:32
openstackgerritSteven Dake proposed openstack-infra/project-config: Change #kolla to point to #openstack-kolla
*** matrohon has quit IRC15:32
AJaegerpabelanger: we have min-ready: 2 for devstack-centos7 and 1 for centos7 - should we increase the value for centos7? 2 looks little for the number of tests  we will have (800+)15:33
*** achanda has joined #openstack-infra15:34
AJaegersdake: let's not do the eavesdrop change via gerrit, please ;)15:34
openstackgerritMerged openstack-infra/project-config: Remove gnome-doc-utils from bindep
pabelangerAJaeger: lets see how the patch works first, then we can look at swaping out the min-ready values15:34
*** yaume has quit IRC15:35
fungiAJaeger: eavesdrop change via gerrit... is that in reference to the accessbot wedge from this morning?15:35
AJaegerfungi, in reference to 29899915:35
*** Sukhdev has quit IRC15:35
*** yaume has joined #openstack-infra15:35
AJaegerfungi , the commit message contains " Please also move the eavesdrop logs. TIA :)"15:36
openstackgerritMerged openstack-infra/system-config: Temporarily disable Puppet runs on
*** sridhar_ram has joined #openstack-infra15:37
fungiAJaeger: oh, right. i'm not convinced there's any issue with having the old channel logs under the old channel name, but if they were moved it would require assistance from a root sysadmin on eavesdrop.openstack.org15:37
AJaegerfungi, agreed - and that's why it doesn't belong in the commit message...15:38
AJaegersdake: ^15:38
*** yamahata has quit IRC15:38
*** mrmartin has quit IRC15:38
*** achanda has quit IRC15:39
openstackgerritZara proposed openstack-infra/python-storyboardclient: Add repo_url and team_id
*** MarkAtwood has joined #openstack-infra15:39
AJaegerfungi, do you have time to look at rossella_s's for reviewday, please? How do we get gerrit-dash-board installed?15:40
*** jamesmcarthur has quit IRC15:41
amrithAJaeger, I've never ever looked at the output of post jobs. Where does one go for that?15:41
openstackgerritMerged openstack-infra/project-config: Move ansible-func non-voting to centos-7 dib
*** armax has quit IRC15:41
openstackgerritvikram.choudhary proposed openstack-infra/project-config: Adding neutron-bgp as a part of neutron project.
*** yolanda has quit IRC15:42
amrithis it to wait for the job on zuul and then look for it; that seems like the wrong way to me and google didn't give a better answer.15:42
*** asselin__ has joined #openstack-infra15:42
*** armax has joined #openstack-infra15:42
AJaegeramrith: grab the sha of a job, and then
amriththanks AJaeger15:42
openstackgerritSam Betts proposed openstack-infra/project-config: Add post job for building and uploading tinyipa
*** dprince has quit IRC15:43
*** jamesmcarthur has joined #openstack-infra15:43
AJaegeramrith: for current head:
*** smarcet has quit IRC15:43
*** dkehn has quit IRC15:43
*** dprince has joined #openstack-infra15:43
amrithgreat, looking through it now15:43
*** dkehn has joined #openstack-infra15:44
*** permalac has joined #openstack-infra15:44
openstackgerritMerged openstack-infra/project-config: Add ubuntu-xenial DIB to nodepool
* timrc can't figure out how is developed. I introduced the PR but rather than pulling it in and rebasing, it appears the fix was incorporated into an unrelated change that was merged (and not by PR) *shrug*15:45
*** asselin has quit IRC15:45
*** MarkAtwood has quit IRC15:45
*** piet has joined #openstack-infra15:46
*** flwang1 has quit IRC15:46
*** annegentle has joined #openstack-infra15:46
Zaraanteaya: so, it looks like I'm gonna be taking over the efforts to fiiiiinally hook up storyboard to gerrit, over the next couple of weeks. Do you have any pointers on where to start? (I'm asking you as I think you suggested pedro contact you about it, earlier)15:46
sdakeAJaeger i can change the commit message15:46
*** yolanda has joined #openstack-infra15:46
*** roxanaghe has joined #openstack-infra15:46
sdakeAJaeger however, i would really appreciate having the logs moved aorund15:46
sdakethe reason being people use the logs all the time15:47
*** kzaitsev_mb has quit IRC15:47
pabelangertimrc: Ya, not sure why its not done on review.o.o too15:47
sdakejeblair (I think) suggested adding a requestin the comit message to have the logs moved15:47
*** fhubik has quit IRC15:47
sdakebut I could be wrong15:47
sdakeor misunderstood him15:47
*** scheuran has quit IRC15:48
sdakeor imagining it all15:48
sdake18 hour day monday and tuesday, bit tired :)15:48
AJaegersdake: not every project-config reviewer is root, so you will not get a +2 from me on a change that  I cannot act on ;)15:49
*** arxcruz has quit IRC15:49
sdakeAJaeger ok i'll handle them serpately15:49
openstackgerritSteven Dake proposed openstack-infra/project-config: Change #kolla to point to #openstack-kolla
*** jamesmcarthur has quit IRC15:51
*** annegentle has quit IRC15:51
timrcpabelanger: Yeah... I wondered that too.15:51
*** cbader_ has quit IRC15:52
AJaegersdake: and see my comment on the commit message, it's now completely wrong...15:52
*** cbader has joined #openstack-infra15:52
openstackgerritMerged openstack-infra/openstackid: OAuth2.0 app name edition
*** nwkarsten has joined #openstack-infra15:53
*** obondarev has joined #openstack-infra15:53
*** abregman has joined #openstack-infra15:54
sdakeAJaeger i have no idea how that happened15:54
*** Sukhdev has joined #openstack-infra15:54
* sdake must be having an 8am day today :)15:54
bkero8AM? Where are you?15:55
bkeroOn a boat in the pacific?15:55
timrcpabelanger: The gerrit development workflow w/ gating, git review and gertty... can you get much better?  Also, there's something to be said for consistency.15:55
*** tosky has quit IRC15:55
AJaegersdake: the channel redirect broke our infra jobs, so yolanda merged a quick fix without seeing your change - and therefore now most of it is obsolete15:56
sdakerather 9am15:56
*** apoorvad has joined #openstack-infra15:56
sdakei nphonix15:56
*** imcsk8 is now known as imcsk8|afk15:56
sdakeAJaeger ok so all is good then?15:56
yolandayep, i asked in openstack-kolla channel, to confirm the channel rename, and sent a quick fix for it, because changes on project-config were not passing. Sorry if I missed some pending change about it15:56
sdakeAJaeger sorry - igeuss that the gerrit changes need to be depends_on for the actual rename15:56
sdakeplea2 setup those docs iirc or pointed them out15:57
sdakeyolanda i submitted changes15:57
sdakebut the gate was in a state of not owrking yesterday15:57
AJaegersdake: yeah, all is good now. We should have merged your change *directly* after you set up the redirect ;(15:57
*** jamesmcarthur has joined #openstack-infra15:57
AJaegerOr before ;)15:58
*** tosky has joined #openstack-infra15:58
*** kzaitsev_mb has joined #openstack-infra15:58
yolandayep, once the redirect was done, it caused that check to fail with timeout15:58
AJaegersdake: your change also removed notifications for some branches, this is somthing you still might want to do15:58
fungiwell, hopefully someone's also working on an accessbot patch to not hang indefinitely when it encounters that condition in the future15:58
*** gyee has joined #openstack-infra15:58
*** yaume has quit IRC15:59
*** maishsk has joined #openstack-infra15:59
*** ericksonsantos has joined #openstack-infra15:59
sdakeAJaeger those branches are gone now15:59
sdakebut I will fix that15:59
*** flwang1 has joined #openstack-infra15:59
obondarevhi there, could someone help me with the issue I have: people (and even myself) can't add me as a reviewer using my email Gerrit says "Oleg Bondarev <> does not identify a registered user or group" while I'm registered in fact15:59
sdakeAJaeger they wer edeleted, but i'll submit a patch for that15:59
fungiobondarev: that usually means you have more than one gerrit account fighting over the same e-mail address15:59
fungiobondarev: i'll look in the db and see what needs cleaning up16:00
obondarevfungi: great!16:00
*** yamahata has joined #openstack-infra16:00
*** rajinir has joined #openstack-infra16:00
obondarevfungi: thanks!16:00
yolandafungi i debugged the issue and that happens that irc library level. I saw where it fails but haven't started any work on it16:00
fungiobondarev: in fact, there are three active Oleg Bondarevs in gerrit, all with that preferred e-mail address16:01
obondarevfungi: I see, not sure how that happened16:02
*** salv-orlando has joined #openstack-infra16:02
*** sputnik13 has joined #openstack-infra16:02
fungiobondarev: usually happens if you authenticate through with different e-mail addresses16:02
obondarevfungi: can we leave just one account?16:03
*** Rockyg has joined #openstack-infra16:03
*** MarkAtwood has joined #openstack-infra16:03
fungiobondarev: i'm going to attempt to merge the additional openids into 5948 and then mark the 5949 and 5951 accounts inactive16:03
*** annegentle has joined #openstack-infra16:03
*** Guest7877 has quit IRC16:03
*** Qiming has quit IRC16:03
obondarevfungi: nice, thanks16:03
fungiobondarev: given the close proximity of the account ids, i have a feeling this happened right at the time you were first creating your account several years ago, and has been this way ever since16:03
*** zeih has quit IRC16:03
*** akaszuba has quit IRC16:03
obondarevfungi: I guess so yeah16:04
openstackgerritGraham Hayes proposed openstack/requirements: Bump UC for python-designateclient to 2.0.1
fungiobondarev: in fact, it looks like some cleanup may already have been done since 5949 and 5951 have no external ids, so i'm just going to mark those as inactive and it should solve the issue16:04
Zara(oh, also, more general question-- people where I work are looking at gitlab for some things; wondered if infra people considered it at any point and rejected it for reasons we should be aware of?)16:05
obondarevfungi: let's try16:05
*** annegentle has quit IRC16:05
*** jlanoux has quit IRC16:05
*** kzaitsev_mb has quit IRC16:05
*** jaosorior has quit IRC16:06
fungiZara: it was commercial only until fairly recently, now it's open core (they keep the good stuff for their paying customers)16:06
*** dtantsur|bbl is now known as dtantsur16:06
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Remove duplicate FakeServer class from unit tests
* AJaeger will be back later16:06
fungiobondarev: okay, the two duplicates have been set inactive and i've flushed gerrit's caches, so see if things are any better now16:06
*** zeih has joined #openstack-infra16:06
Zarafungi: ahhh, right. perhaps not a problem for my employer, then, though a pita if they later want me to integrate storyboard. \o/16:07
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Remove duplicate FakeServer class from unit tests
fungiZara: i don't know a whole lot more about it, other than they've recently started working with debian to get it packaged and for the debian community to maybe run a public instance of it (possibly as an alioth v2 sort of solution i think?)16:08
*** smarcet has joined #openstack-infra16:08
*** stevemar has quit IRC16:08
* Zara searches alioth16:09
Zarathanks :)16:09
obondarevfungi: solved! thank you very much!16:09
fungiZara: sorry, alioth is debian's current public collaborative source code management interface16:09
*** doug-fish has joined #openstack-infra16:10
Zarafungi: I found it, thanks! :)16:10
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Remove duplicate FakeServer class from unit tests
fungithey do more than source code management with it of course16:10
clarkbgitlab is basically github from a few years ago16:10
*** jistr has quit IRC16:10
clarkbwhich lacks in the code review department (github still does)16:10
*** dizquierdo has quit IRC16:11
fungiclarkb: well, the for-pay version might be up to github standards!16:11
bkeroTheir pay-for has some things that github doesn't16:11
bkerolike real hooks16:11
*** jamesmcarthur has quit IRC16:11
* fungi doesn't know how core their open core really is)16:11
*** cdent has joined #openstack-infra16:11
bkeroand ldap group sync16:11
*** salv-orlando has quit IRC16:11
*** doug-fis_ has quit IRC16:12
bkeroand multiple forks per user16:12
bkeroand per-path commit access16:12
bkeroand has a more complete API16:13
*** jamesmcarthur has joined #openstack-infra16:14
*** doug-fish has quit IRC16:14
pleia2good morning16:14
clarkbbut ya the reason we dont gitlab is largely the same reason we dont github. the functionality we want isnt there16:14
clarkbstateful code review with history16:15
*** sputnik13 has quit IRC16:15
bkeroWhy don't the merge requests meet the requirement of 'stateful code review with history'?16:16
fungiyolanda: now that has merged, are you okay with the state of ?16:16
*** fedexo has quit IRC16:16
*** jcoufal has quit IRC16:16
clarkbbecause rebases kill history and pull requests dont have state other than open or closed16:16
clarkbgerrit has arbitrary state matrixes that can be updated by humans and robots16:17
clarkbthis allows you to build the "at least two +2 code review, +2 from jenkins, and approval" setup16:17
*** daemontool has quit IRC16:18
bkeroI wonder if that could be done with labels.16:18
clarkbyou also dont get bisectable trees out of pull requests16:19
*** stevemar has joined #openstack-infra16:19
clarkbwhich is a nice feature of gating + gerrit16:19
fungiwell, you do depending on the pr policy of the project16:19
fungisome of them insist on using a rebase until it's right workflow in your pr16:19
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Fix test_get_server_ip unit test
clarkbfungi but there is no way of enforcing that because no state16:19
*** openstack has joined #openstack-infra17:04
*** mescanef_ has joined #openstack-infra17:05
*** esker has quit IRC17:06
*** esker has joined #openstack-infra17:06
clarkbpabelanger: it probably won't hurt to add in the xenial image builds now assuming we have enough disk space for them17:06
fungiclarkb: though we work around it terribly by putting a specific ip address from the round robin pool in eavesdrop's /etc/hosts file, which works until they decide to readdress or remove that server17:06
clarkbpabelanger: but I don't expect us to even remotely start to switch until devstack runs on it17:07
*** permalac has quit IRC17:07
*** eil397 has joined #openstack-infra17:07
clarkbfungi: oh right, fun17:07
*** annegentle has joined #openstack-infra17:07
*** jamesmcarthur has joined #openstack-infra17:07
zarosdague, jeblair : verify-status plugin to view test results in Gerrit.  I thought it might be a good time to check in for feedback:
*** MarkAtwood has quit IRC17:07
pabelangerclarkb: Yup, I agree with that.  Also, this was the first issue I found with d-g:
fungismarcet: jpmaxman: it looks like the updates are deployed to now but apache is refusing to start. i'm looking into its confusion now17:08
*** rkukura has quit IRC17:08
*** esker has quit IRC17:08
*** rkukura has joined #openstack-infra17:08
*** esker has joined #openstack-infra17:08
*** mescanef_ has quit IRC17:09
*** esker has quit IRC17:09
*** jtomasek_ has joined #openstack-infra17:09
*** lakshmiS has joined #openstack-infra17:09
clarkbpabelanger: +2 that is a simple one, does fixing that get devstack itself to run?17:09
*** kzaitsev_mb has quit IRC17:09
pabelangerclarkb: nope, that was the first issue17:09
lakshmiSone more review please -
pabelangerclarkb: but something was stopping ansible from launching devstack, but didn't figure it out last night17:10
*** fawadkhaliq has quit IRC17:10
clarkbpabelanger: as it is we are really close to our /opt space limits with our current images, deleting devstack-trusty would go a long way there I think17:10
clarkbpabelanger: maybe we delete devstack-trusty then add in xenial images?17:10
Zaraanteaya: okay :) I'll try to ping you early! :D17:10
pabelangerclarkb: sure, let me rebase 297942 and we can land that17:11
*** fawadkhaliq has joined #openstack-infra17:11
anteayaZara: sounds good, thank you17:11
*** gyee has quit IRC17:12
clarkbpabelanger: have the logs for where ansible failed?17:12
*** ihrachys has quit IRC17:12
*** esker has joined #openstack-infra17:12
*** jamesmcarthur has quit IRC17:12
pabelangerclarkb: not any more, I'll spin up another today17:12
Eva-iHello. I believe maximum line width in OpenStack is 79 characters. But why limit lines in Gerrit are not located at 79th character, but at 100th?17:12
*** jerryz has joined #openstack-infra17:13
*** jamesmcarthur has joined #openstack-infra17:13
smarcetfungi: ok17:13
smarcetwill take a look also17:13
*** abregman is now known as abregman|mtg17:13
*** MarkAtwood has joined #openstack-infra17:13
clarkbEva-i: they are independent concerns. One is a pep8 requirement which many projects enforce (but not all) and the other is a gerrit default ui setting17:14
fungismarcet: yeah, we're missing the file, i'm just hunting down what we need to add to get it17:14
*** MarkAtwood has quit IRC17:14
clarkbEva-i: you can change the setting in gerrit if you like17:14
clarkbEva-i: the little gear in the top right of the diff view lets you set that17:14
*** dtantsur is now known as dtantsur|afk17:16
Eva-iclarkb: oh, thank you!17:16
smarcetfungi: smarcet@openstackid-dev:~$ sudo a2enmod  proxy_fcgi17:16
smarcetModule proxy_fcgi already enabled17:16
clarkblakshmiS: don17:16
lakshmiSthanks clarkb!17:17
fungismarcet: right, but there's no /usr/lib/apache2/modules/ into server: /usr/lib/apache2/modules/ file on the system17:17
*** Kennan has quit IRC17:17
smarcetfungi:yeah i just saw it17:17
fungismarcet: er, no /usr/lib/apache2/modules/ file on the system17:17
*** jsavak has quit IRC17:18
openstackgerritPaul Belanger proposed openstack-infra/project-config: Remove devstack-trusty from nodepool
fungismarcet: looks like there is no mod_proxy_fcgi backported to apache 2.2, but i'm still confirming that17:18
*** skolekonov is now known as skolekonov|away17:18
pabelangerfungi: clarkb ^17:19
smarcetfungi: ok i think that is the problem17:19
fungismarcet: once we upgrade the server to ubuntu trusty we'll have it available, but wasn't planning to undertake that until after the summit17:20
*** sputnik13 has joined #openstack-infra17:20
smarcetok let me check on that17:20
*** cdent has quit IRC17:20
*** flepied has quit IRC17:21
smarcetfungi: i think that the only one thta is available is libapache2-mod-fastcgi17:21
smarceti will need to update the patch17:21
smarceti am afraid17:21
*** MarkAtwood has joined #openstack-infra17:21
openstackgerritMerged openstack-infra/puppet-releasestatus: Order of the classes parameters is refactored
rossella_sfungi, clarkb jeblair I've pushed a patch following your suggestions regarding using reviewday for the neutron dashboard, I'd appreciate if you could have a look. I still have a doubt, I need to use gerrit-dash-creator and it's probably not present on the host. Thanks!!
fungismarcet: agreed, that is definitely available for us to use17:22
smarcetfungi: ok on it17:23
*** Eva-i has left #openstack-infra17:23
*** mrmartin has joined #openstack-infra17:23
clarkbrossella_s: does reviewday have a requirements list? you could add the dash creator there if so17:23
*** sohail_ has quit IRC17:24
*** gyee has joined #openstack-infra17:24
*** degorenko is now known as _degorenko|afk17:25
clarkbpabelanger: did you manage to rebuild ubuntu-trusty yesterday? I don't see it in nodepool dib-image-list17:25
*** jamesmcarthur has quit IRC17:26
*** tosky has joined #openstack-infra17:26
rossella_sclarkb, gerrit-dash-creator is not available on pypi, would that work?17:26
*** tosky has quit IRC17:26
fungiclarkb: pabelanger: it's possible i redeleted it when i woke up, as i was still on the lookout for broken ubuntu-trusty images coming online in providers17:26
pabelanger fungi17:26
pabelangerfungi: clarkb Oh, ya I uploaded it yesterday17:27
fungiclarkb: pabelanger: though it should have been rebuilt in today's batch anyway17:27
pabelangerit will17:27
clarkbrossella_s: pip understands git urls too, that is less than ideal but should function17:27
clarkbpabelanger: hrm I don't see it17:27
*** jsavak has joined #openstack-infra17:27
clarkbpabelanger: the only non building image there is almost 2 days old17:27
*** electrofelix has quit IRC17:28
*** rlandy has quit IRC17:28
*** imcsk8|afk is now known as imcsk817:28
pabelangerclarkb: let me check17:28
rossella_sclarkb, thanks for the hint, I will try that! I learn new things every time I talk to you infra people, that's awesome :) thanks17:28
*** Goneri has quit IRC17:28
pabelangerclarkb: I guess fungi delete it?17:28
fungipabelanger: yeah, probably17:28
openstackgerritMerged openstack-infra/project-config: Change experimental to actual for searchlight
fungipabelanger: i thought nodepool had somehow respawned it before your fix landed17:28
*** rlandy has joined #openstack-infra17:29
anteayafungi: pabelanger pleia2 and anyone else who has spent some time looking at the wiki spam issue, I have some experiences and thoughts I'd like to discuss, when would be a good time?17:29
*** esker has quit IRC17:29
clarkbrossella_s: let me know if you need help with it, but pips docs should have the info you need for using them17:29
marcusvrn_asselin_: hi! I was researching some features to improve CI and I found this one:      It's actually stopped...there is something similar to this feature or the community don't think it's a good idea?17:30
*** ayoung has joined #openstack-infra17:30
rossella_sclarkb, very kind of you, thanks a lot!17:30
*** piet has quit IRC17:30
*** Kennan has joined #openstack-infra17:30
anteayafungi: you had said yesterday you don't want me to spend a lot of time deleting pages, so to that end, I would like to discuss options17:30
*** jtomasek_ has quit IRC17:31
AJaegerpabelanger: add libselinux-python to bindep-fallback17:31
asselin_marcusvrn_, hi, I stopped looking at that one. Seems the community is fine with it as a 'feature', but not sure where it is on the priority list with zuulv3.17:32
*** mrmartin has quit IRC17:32
*** jsavak has quit IRC17:32
asselin_marcusvrn_, you can take it over ifyou like.17:32
AJaegerjroll: might work on master but fail on stable ;(17:32
fungianteaya: i've not really been involved at all. i think it's mostly been pleia2 and pabelanger who worked on it thus far, and also some other wiki admins like fifieldt (who isn't in here)17:33
anteayafungi: fair enough17:33
*** jsavak has joined #openstack-infra17:33
*** salv-orlando has joined #openstack-infra17:33
AJaegerjroll: it really depends on setup, we had it failing - not generating tarballs for a release at all!17:33
anteayawell my assessment thus far is that mass delete and smitespam (including the documented configuration changes) don't come close to addressing the problem17:34
*** mescanef has joined #openstack-infra17:34
*** MarkAtwood has quit IRC17:34
fungianteaya: in terms of cleanup?17:34
marcusvrn_asselin_: nice! I'll investigate this feature and maybe I can try to do it...I think it can help some slow CIs...thanks!!17:34
clarkbmarcusvrn_: asselin_ that is probably a very small portion of your load though right?17:34
clarkbabandoned changes are not super common17:34
anteayaso other than going through page history and tracking individual contributors and manually deleting pages, I don't think we have a way of addressing the spam17:35
anteayamostly I"m saying something because you told me that is what you don't want17:35
asselin_clarkb, it wasn't really for abandoned, but for merged17:35
*** nikhil_k is now known as nikhil17:35
anteayaand I"m sharing that based on my experience yesterday, I think that is the only way17:35
clarkbasselin_: ah17:35
fungianteaya: the nuke feature seemed to work when i (briefly) tried it, but worth noting it continues to find matches for deleted pages since deletion is non-permanent17:36
asselin_clarkb, fixes the issue of a ci reporting results 2 days after it's merged....17:36
clarkbI read status: open and immediately associated with abandoned, I see the commit message is clear17:36
*** MarkAtwood has joined #openstack-infra17:36
anteayafungi: right mass delete is nuke (I believe)17:36
fungiyeah, same thing17:36
*** esker has joined #openstack-infra17:36
anteayafungi: however if I go to a contributor page, and open mass delete in a separate tab, and mass delete, then refresh the contributor page17:37
anteayamost contributors still have contributions17:37
marcusvrn_clarkb: asselin_ yep, this feature can save resources for patched not merged yet17:37
anteayasome of them still have over a hundred contributions17:37
*** cdent has joined #openstack-infra17:37
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: script to propose final releases for a series
fungii think pabelanger had mentioned something about identifying the list of accounts with no associated openid (which would indicate they came in through the brief mobile interface backdoor we accidentally opened when trying to solve the earlier compromised/malicious lp account spamming) and feeding that into the mass deletion routine17:37
anteayathe only way I have found is to mass delete to start (which as you say can continually delete pages it has found before to delete) then go through the contributions for a user one at a time17:38
openstackgerritMerged openstack-infra/puppet-pip: Order of the class parameters is refactored
anteayafungi: okay that's worth a shot17:38
*** tosky has joined #openstack-infra17:38
anteayapabelanger: any status update on using accounts with no associated openid and using mass delete?17:39
fungithuogh i suspect that's going to involve analyzing a database dump, and it still doesn't get us the ones which came in through launchpad17:39
anteayaalso if I understand mass delete that still won't remove pages that have been edited by mulitple people nor pages that have been moved17:39
anteayanor redirects17:39
pabelangeranteaya: not yet. We can run a database script to see what they are and start deleting them17:40
anteayaas mass delete just takes out files17:40
anteayahappy to help with that17:40
*** salv-orlando has quit IRC17:40
openstackgerritMichael Johnson proposed openstack-infra/devstack-gate: Add archiving of nova instance console logs
fungiright, we don't for example want to delete important pages simply because someone replaced the content in them with spam or moved them to a new title17:40
anteayawhat can I do?17:40
anteayafungi: to be honest I didn't see any of that last night17:40
anteayaall where new pages that I saw17:40
fungithat's good. i know pleia2 encountered it with the how to contribute page17:41
fungibut i don't know how widespread teh situation is in practice17:41
anteayaalso there is a search feature to find duplicate pages, except the search feature isn't tied to delete in anyway17:41
*** pvaneck has joined #openstack-infra17:41
anteayafungi: good to know pleia2's experience17:41
anteayaI deleted hundreds last night and didn't see any that were real pages that had been co-opted17:42
*** Goneri has joined #openstack-infra17:42
openstackgerritRyan Hallisey proposed openstack-infra/tripleo-ci: Allow the container job to run again
openstackgerritMerged openstack-infra/puppet-project_config: Order of the class parameters is refactored
*** sdake has quit IRC17:42
fungiwhen it's happened, they appear to first move the page to a new title and then replace the content on it in a subsequent update (sometimes using two separate accounts to do that)17:42
pleia2anteaya: I wrote about this on list a couple days ago17:42
anteayamostly I bring this up because I am work functional until about this time tomorrow and they getting ready to travel, then gone for a week17:42
anteayapleia2: I believe you, thank you17:43
pabelangeranteaya: Right, there might be some gotchas with the mass delete like you found. I haven't had time to look into them to see if we can fix it17:43
anteayafungi: awesome17:43
anteayawhat gotchas?17:43
anteayait deletes a whole lot of stuff, so I'd like to start with that if we can17:43
fungithe main page's talk subpage had that happen to it a couple times i kept cleaning up back when the spamming was at its worst17:43
pleia2anteaya: ^^ I outlined what happened there, so we need to watch out for that17:44
anteayaI'm not interested in perfect as I do believe manual cleanup will be necessary17:44
anteayapleia2: thanks17:44
fungibut since we likely don't care much about content in the talk subpages i wasn't too worried about outright deletion17:44
anteayafungi: :(17:44
pabelangerclarkb: fungi: so, ubuntu-xenial won't build until we restart nodepool pool. And we should be safe to delete devstack-trusty once we land 297942 too. So that will free up some HDD space17:44
anteayabasically I'm saying what we are doing right now isn't cleaning up the wiki17:44
anteayaand I'd really like to have a clean wiki17:44
fungipabelanger: restart the nodepool image builder daemon i assume you mean?17:44
clarkbpabelanger: ok, we should do things in that order to pick up the devstack-trusty removal when we pick up the xenial ad17:45
anteayaand willing to put my money where my mouth is17:45
clarkbfungi: oui17:45
*** esker has quit IRC17:45
pabelangerfungi: yes17:45
anteayaand will spend my time manually deleting unless I have something more effective to do17:45
anteayabecause manual deleting is proving effective17:45
fungianteaya: agreed, mass deletion by content pattern match seems like a more likely (if somewhat iterative) way to catch more of them17:45
*** e0ne has quit IRC17:45
*** esker has joined #openstack-infra17:45
anteayaI'm all for that17:45
anteayahow do I do it?17:46
clarkbfungi: pabelanger pleia2 other d-g cores would be a good one to get in to make the script more useful17:46
*** esker has quit IRC17:46
clarkbthat script is super handy we just need to smooth out the rough edges so it works in the general case17:46
fungiso if you see duplicative patterns across some of the spam pages you're finding, then feed that into the mass delete (as long as you can come up with a pattern which is unlikely to match legitimate content)17:46
pabelangerfungi: clarkb: do we need to do anything to zuul? becuase I see see we have 4 devstack-trusty nodes online17:46
*** esker has joined #openstack-infra17:46
*** esker has quit IRC17:47
anteayafungi: I've tried17:47
clarkbpabelanger: its possible those were straggler registrations in gearman creating demand?17:47
clarkbpabelanger: I can check gearman really quick17:47
anteayafeeding mass delete content doesn't result in me getting more pages to delete17:47
*** MarkAtwood has quit IRC17:47
anteayafungi: I tried that last night17:47
anteayasearch can find duplicates17:47
pabelangerclarkb: ack17:48
*** annegentle has quit IRC17:48
clarkbpabelanger: echo "status" | nc localhost 4730 | grep devstack-trusty on zuul says only the image-build job is registered so I think we are fine17:48
*** abregman|mtg is now known as abregman17:48
*** MarkAtwood has joined #openstack-infra17:48
anteayaif I go to a file of spam at the bottom it will say if there are duplicates17:48
*** jamesmcarthur has joined #openstack-infra17:48
pabelangerclarkb: okay, let me delete them and see what happens17:48
anteayaif I follow that I can get to a page where I can search on content and it gives me results on content17:48
anteayabut then I can't delete them as I have no function to do so17:48
fungianteaya: the other thing i'm still thinking we may want to do is stand up a second copy of the wiki somewhere not indexed by search engines, then have a root admin purge deleted pages from the production one semi-regularly until we whittle down the remaining spam content while still having the old version to refer back to if we discover we've accidentally purged something valuable17:48
pabelangerAJaeger: okay, will get a patch up17:48
anteayajust a list of pages I can delete manually if I open each one17:48
*** Sukhdev has quit IRC17:48
lakshmiSclarkb: zuul tests showing "NOT REGISTERED" for patch(298339).  gate-searchlight-python34-searchlight was added in  What does NOT REGISTERED mean?17:48
anteayafungi: I'm for that17:49
clarkblakshmiS: it means that zuul's gearman server doesn't know about that job yet, which can happen if zuul updates before jenkins updates17:49
fungianteaya: odd, the mass delete should be giving you a button for that. i'm checking now17:49
anteayafungi: as this is a big big big mess and I can't see the bottom17:49
*** cdent has quit IRC17:49
clarkblakshmiS: ansible should force jenkins to update first so this may indicate the job updates are currently broken17:49
*** fawadkhaliq has quit IRC17:49
anteayafungi: thanks, if there is a button and I haven't seen it I sure will use it if you can point it out to me17:49
*** annegentle has joined #openstack-infra17:50
anteayaI spend about 5 or 6 hours following page history and user contribs and deleting both mass and individual pages17:50
*** zul has quit IRC17:50
lakshmiSclarkb: so i guess that means it will eventually pickup the job next time patch runs again17:50
anteayaand it just keep looking bigger every time I opened a new page history17:50
*** piet has joined #openstack-infra17:50
fungianteaya: when i have the match list, at the top of it there's a "delete selected" button17:50
fungithe same button also appears at the bottom17:51
clarkblakshmiS: yes I would expect this to self correct shortly and if it does not I can do more digging into why jenkins isn't registering those jobs17:51
* anteaya goes to try to find the page with 'the match list' on it17:51
*** fawadkhaliq has joined #openstack-infra17:51
AJaegerjroll, fungi: I checked your tox.ini file, you're not using constraints at all.17:51
fungianteaya: for example, i searched on the pattern %turbotax%17:51
AJaegerjroll: see line 10 of
fungianteaya: under the mass delete special page17:52
*** Goneri has quit IRC17:52
AJaegerjroll: "pip install -U {opts} {packages}" - that's the ocmmand you use17:52
*** Goneri has joined #openstack-infra17:52
*** MarkAtwood has quit IRC17:52
AJaegerIt would fail with line 9 since there wouldn't be any upper-constraints file checked out.17:52
pabelangerclarkb: devstack-trusty nodes deleted, good so far17:53
AJaegerjroll: so, remove line 9, it's a nop ;)17:53
clarkbpabelanger: my only concern with is you will likely need to do manual cleanup since we didn't go to -1 first and use nodepool to remove the on disk files and glance uploads17:54
anteayafungi: okay thanks17:54
anteayafungi: did you delete those entries on your page?17:54
fungianteaya: no, i didn't17:54
fungifigured you could use them to test17:54
clarkbpabelanger: you may (I am not 100% sure) have to remove from the db directly then check the alien image lists and remove those and clean out /opt/nodepool_dib17:54
toskyAJaeger: oh, hi again - so, do you suggest to ask here about the required steps for ? I can do the first change (the group of reviewers) but not still sure about the other17:54
anteayafungi: okay thanks I found 8 entries17:54
anteayafungi: I've deleted them17:55
fungianteaya: i checked one of them at random and it was definitely not (yet) deleted but some of the others might have been17:55
pabelangerclarkb: I can do -1 first to be safe17:55
anteayafungi: do they still show up as needing to be deleted on your end?17:55
*** esikachev has joined #openstack-infra17:55
fungianteaya: yay! the one i was looking at as an example is definitely a deleted page now17:55
AJaegertosky: I'm not sure either ;) Let's ask...17:55
clarkbpabelanger: that may be simplest, -1 it, then use nodepool commands to delete the images17:55
clarkbpabelanger: then we can remove it from the yaml17:55
anteayafungi: great, so that works17:56
fungianteaya: as fifieldt pointed out in that infra ml thread though, deleted pages are still matched by the mass delete search since they're still pages17:56
toskyAJaeger: I'm always scared asking here, the channel is either completely silent or full throttle uber busy :)17:56
anteayafungi: I still like your idea of standing up a second wiki and migrating good content and users over17:56
fungianteaya: at least until we decide to do a purge, yeah17:56
AJaegerproject-config cores, tosky wants in 299407 run no jobs on a specific branch. Could I get some help on what's the best way to do this?17:56
anteayafungi: have we discussed when to purge?17:56
openstackgerritPaul Belanger proposed openstack-infra/project-config: Set devstack-trusty(-2-node) to min-ready -1
pabelangerclarkb: ^17:56
fungitosky: when the channel is not busy, that means that we are ;)17:56
pabelangerwill rebase a top of that17:56
clarkbpabelanger: basically nodepool image-delete, then nodepool dib-image-delete, make sure those are all gone, then remove the yaml configs17:57
*** jamesmcarthur has quit IRC17:57
clarkbpabelanger: approved17:57
toskythe idea behind that commit is described in the referenced email (based on some hints that I've got in the previous weeks here)17:57
fungianteaya: i didn't propose a timeline. i'm hesitant to volunteer to do the server build, it should probably be tackled by whoever's working on polishing up the puppet-mediawiki manifest to be more thoroughly redeployable17:57
anteayafungi: I'm at the point of wanting to put this on the etherpad as part of summit discussions17:58
openstackgerritPaul Belanger proposed openstack-infra/project-config: Remove devstack-trusty from nodepool
pabelangerand rebase17:58
anteayaso we can address it17:58
anteayafungi: and yes, I understand your position17:58
toskyanteaya, pabelanger: not sure it can help, but in we had spam issues with our wikis as well, and we asked some hints to mediawiki people - maybe they can help here as well17:59
anteayatosky: can you share what they told you?17:59
pabelangertosky: Always open to help, especially combating spam17:59
fungianteaya: i'd vote for a session on how to move forward fixing (well, really completing) that puppet module and discussing options and timelines for upgrading the server/software, installing additional mitigation solutions and cleaning up the remaining mess17:59
anteayaand we have mediawiki folks in channel17:59
toskyanteaya: let me ask around18:00
*** tiswanso has quit IRC18:00
fungitosky: yep, we have some mediawiki people in channel. step 1 is to get on a newer version of mediawiki, and step 0.5 is to get on a newer distro release so that we have a new enough php to run current mediawiki18:00
anteayafungi: I will add it to the etherpad, and am willing to chair the discussion, note I will be absent next week so will miss the meeting where slots are alocated18:00
*** e0ne has joined #openstack-infra18:00
toskyfungi: that helped too, the mediawiki version on wikis was two years old and upgrade was the first step18:01
*** tiswanso has joined #openstack-infra18:01
fungianteaya: feel free to throw some indication of vote by proxy into that etherpad, for sessions you would attend18:01
openstackgerritMerged openstack-infra/project-config: Make job networking-generic-switch-dsvm voting
anteayapabelanger: I'm not trying to take over for you with regards to the wiki and really appreciate all you have done here, but you are getting pulled off on other projects (that is what happens when you are effective) and I think this topic needs some completion18:02
anteayafungi: ah okay, I'll add my nick as my vote, so you don't have to guess18:02
fungitosky: part of the challenge is that the server was set up years ago by a mediawiki dev but he didn't find time to complete the configuraiton management for it, so it's not trivially redeployable (yet)18:02
*** cloudtrainme has quit IRC18:02
toskyfungi: that doesn't help, I see18:03
*** annegentle has quit IRC18:03
fungiright, so we're retrofitting config management by sort of reverse engineering what's there18:04
*** mriedem1 has joined #openstack-infra18:06
*** piet has quit IRC18:07
*** rraja has quit IRC18:07
*** Guest87573 has quit IRC18:07
*** jamesmcarthur has joined #openstack-infra18:07
*** mriedem has quit IRC18:07
*** piet has joined #openstack-infra18:07
*** daemontool has quit IRC18:07
*** stevemar has quit IRC18:08
*** stevemar has joined #openstack-infra18:09
anteayausing mass delete it is possible I am deleting files that already are deleted18:09
*** placko_ has quit IRC18:10
anteayaso I really have no actual way of knowing if I am making any progress or not in terms of how much spam remains in the wiki18:10
pabelangeranteaya: nope, feel free to drive. no issues here18:10
anteayapabelanger: well mostly trying to make space for the conversation18:10
anteayaI don't think I will be doing any of the standing up of the server bits18:10
anteayaand thanks for understanding18:10
*** piet has quit IRC18:11
*** mrmartin has joined #openstack-infra18:11
*** zul has joined #openstack-infra18:11
*** piet has joined #openstack-infra18:11
*** e0ne has quit IRC18:11
fungianteaya: yeah, other than maybe spot-checking a few in the list you get to see whether they're maybe already deleted, there's no direct indication that the matched pages in the list you get have been deleted already18:12
anteayait is possible I am just deleting the same files over and over18:12
anteayaokay thanks18:12
anteayaI appear to be breaking fresh ground18:13
*** mriedem1 has quit IRC18:13
*** mriedem has joined #openstack-infra18:13
openstackgerritMerged openstack-infra/puppet-phabricator: Order of the classes parameters is refactored
AJaegerso, has anybody a suggestion how to help tosky with 299407, please?18:15
clarkbAJaeger: tosky just push to master and rely on self testing of changes?18:16
clarkbI really don't want to have to delete these branches if I read the commit message correctly18:16
fungianteaya: the other thing i did on the ones i looked at was to check the page history and see when they were created/updated. luckily they seemed to be primarily from the blast in late february and none recent18:16
anteayaawesome thanks18:17
toskyclarkb: it would be just one branch; what I'm not sure is that it should be created by the person sending the set of commits to gerrit when he sends them, or if you should create it instead and then it can be used18:17
AJaegertosky: why not send single changes to master?18:18
anteayaI was checking page history a lot last night and didn't see any contibutors on the pages I was viewing that were non-spammers18:18
clarkboh this is for history retention18:18
clarkbya I think thats fine, the commit message made it sound like it would be ongoing18:18
toskyongoing? It's ongoing in the way that it will take few days before the changes to infra can be reverted18:19
toskythe time to do the pushes and so on (hopefully two days)18:19
toskyor do you mean something else by ongoing?18:19
*** roxanaghe has quit IRC18:19
fungi"indefinite" was probably a more appropriate word18:19
toskyI thought I underlined __temporary__ enough in the commit message18:20
clarkbyup fungi parsed correctly and picked a better word18:20
clarkbtosky: I read it as temporary orphan branches18:20
clarkbthat may repeat until whenver18:20
toskyno, no18:20
clarkbI grok now18:20
toskyso, should I restrict the set to release instead of core? The problem is that the set of release is just one iirc18:21
* tosky checks18:21
mriedemclarkb: when you get a sec, indexing is behind by 17 hours for logstash, but cluster status health says it's green
toskyyes, just one18:21
clarkbtosky: yes we typically like the group to be small18:21
toskyclarkb: well, then I could avoid that, as the one is SergeyLukjanov, who I guess could already create the branch18:22
*** fawadkhaliq has quit IRC18:22
toskythe group of sahara core is small enough anyway18:22
toskyfor the other issue with the set of jobs, I need at least one, but how can I easily do that? I used skip-if to skip all of them, I guess I need a more complex regexp then18:23
*** fawadkhaliq has joined #openstack-infra18:23
clarkbmriedem: looks like we may have idle workers for some reason18:23
mriedemfungi: did you ever figure out if the g-r sync bot was busted for stable/kilo?18:23
toskyor I would need to deactivate all the jobs one by one for that branch18:23
anteayafungi: I have made ammendments to
anteayafungi: if my edits are unclear, do let me know I will fix18:24
*** e0ne has joined #openstack-infra18:24
AJaegertosky: or deactivate all jobs temporarily on all branches?18:24
toskyAJaeger: all - but one ?18:25
*** sridhar_ram has quit IRC18:25
toskyI thought it was going to be more controversial18:25
openstackgerritMerged openstack-infra/puppet-puppet: Order of the class parameters is refactored
clarkblooks like recvfrom just hanging out? perhaps network disruptions that haven't been caught by the tcp stack?18:25
AJaegertosky: only noop-jobs and merge-check18:25
*** e0ne has quit IRC18:26
*** davidlenwell has quit IRC18:27
toskyAJaeger: if I combine that line with a new line which defines noop- for that specific branch, I guess it should minimize the impact18:27
*** jamesmcarthur has quit IRC18:27
*** SumitNaiksatam has joined #openstack-infra18:28
AJaegertosky: defining noop for a specific branch works but is tricky, I would temporarily remove everything.18:28
AJaegerAnd temporarily means: Propose a patch and the reversal of it (WIPed) at the same time ;)18:29
*** piet has quit IRC18:29
toskyAJaeger: uhm, I thought I could just copy the existing definition, but I get it18:30
clarkbmriedem: I have given them all a restart and we can watch them to see if this persists18:30
*** baoli_ has quit IRC18:30
* AJaeger has to step out a bit18:30
clarkbmriedem: from the logs what I see is that they were fetching form the log server days ago and never received more bytes18:30
toskyAJaeger: sure, thanks18:30
jesusaurclarkb: it also looks like kibana isn't returning any results at all18:30
clarkbmriedem: I should probably add a timeout to those requests18:30
clarkbjesusaur: is that because we havne't been indexing?18:30
jesusaurclarkb: ive been watching spinners spin for a few minutes18:30
*** e0ne has joined #openstack-infra18:31
clarkbthats odd18:31
jesusaurwhich likely means it isn't getting query results from elasticsearch18:31
clarkbit says we only have 5 nodes but we are green18:31
*** e0ne has quit IRC18:31
toskythe only thing I'm not sure is: if the "create" is assigned to one person, then that person should send all the reviews from the imported history to gerrit (or at least the first one), or can he just create the branch from gerrit interface and someone else send the reviews to gerrit?18:31
clarkbwhich makes me think we lost a node and just moved on18:31
*** abregman is now known as abregman|afk18:32
*** jamesmcarthur has joined #openstack-infra18:33
clarkbtosky: they can create the branch and someone else can push18:33
*** e0ne has joined #openstack-infra18:33
toskyclarkb: thanks!18:33
*** e0ne has quit IRC18:33
clarkbes03 was out to lunch18:33
clarkbI have restarted it18:33
*** tiswanso has quit IRC18:34
clarkblooks like it was unhappy about the size of timestamps18:34
*** sigmavirus24 is now known as sigmavirus24_awa18:34
*** davidlenwell has joined #openstack-infra18:34
*** tiswanso has joined #openstack-infra18:34
clarkbwe have a lot of unhappy indexes too and they don't appear to be getting deleted :/18:35
*** annegentle has joined #openstack-infra18:35
*** e0ne has joined #openstack-infra18:35
clarkbI will try manually running the cleanup cron entry18:35
*** piet has joined #openstack-infra18:35
*** sigmavirus24_awa is now known as sigmavirus2418:35
anteayafungi: I think we may need to discuss wiki purge as soon as possible, my search engine is finding pages that were deleted at the end of February18:35
*** kushal has quit IRC18:35
anteayafungi: so the bots seem to index deleted pages as well18:35
fungimriedem: thanks for the reminder. it got lost in the shuffle between meetings yesterday. i'm digging up logs for that job now18:35
*** cloudtrainme has joined #openstack-infra18:36
*** e0ne has quit IRC18:36
*** e0ne has joined #openstack-infra18:37
*** e0ne has quit IRC18:37
*** nwkarsten has joined #openstack-infra18:37
*** piet has quit IRC18:38
*** piet has joined #openstack-infra18:38
*** jamesmcarthur has quit IRC18:38
*** dizquierdo has joined #openstack-infra18:38
*** jcooley_ has joined #openstack-infra18:40
clarkbok it claims to be happier now after a manual curator run18:40
fungimriedem: less "broken" and more "not running at all" from what i can tell18:40
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Reset network caches after network create/delete
clarkbI think what happened was 03 was down long enough to have a bunch of stale indexes that had already been curated on the other hosts18:40
*** jamesmcarthur has joined #openstack-infra18:41
clarkbbut resurfaced once I restarted the service on 0318:41
fungimriedem: here's the jobs which ran in the post pipeline for the most recent requirements change merged on its stable/kilo branch:
fungimriedem: note that only the docs job for it actually ran18:41
clarkband hte reason we get no results back is we have too many timestamps to load into memory18:41
clarkbso it is "healthy" now but unable to perform queries18:42
fungimriedem: i'm going to hunt in zuul to see if maybe that index is shadowing jobs which got uploaded to swift instead18:42
clarkbI am going to manually delete an older index or two to free up memory on that front18:42
mriedemfungi: hmm yeah, error: invalid command 'build_sphinx'18:42
jesusaurclarkb: but the default kibana query should only look at the most recent index18:43
openstackgerritMerged openstack-infra/project-config: Set devstack-trusty(-2-node) to min-ready -1
jbernard_clarkb: re the ceph mirror patch, i shouldn't need to update any apt sources to fetch those packages, correct?18:43
*** jamesmcarthur has quit IRC18:43
*** jsavak has quit IRC18:43
mriedemfungi: oh right, less about the docs job, more that it was the only one18:43
anteayachannel ops topic in -meeting could use a refresh, thanks AJaeger18:43
clarkbjesusaur: ya but I think this hoses the esrver in general, at least in the psat we asw it get happy when we reduced the amount of data18:44
clarkbjbernard_: correct, but that part of the change hasn't been written yet. First step is just getting the mirror up, second step is updating our mirror ocnfigs on the jenkins slaves18:44
*** jsavak has joined #openstack-infra18:44
*** Sukhdev has joined #openstack-infra18:44
fungianteaya: thanks, taken care of18:44
jbernard_clarkb: i see. so the only plugin change needed is to /not/ update apt sources18:45
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Update Configuration for Precise
*** shardy has quit IRC18:45
clarkbjbernard_: well in your plugin I would do a test to see if the ceph-hammer sources.list.d file exists and if not write it out and update. If it does exist assume it is correct18:45
*** krotscheck is now known as krotscheck_dcm18:46
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Update Configuration for Precise
*** woodster_ has quit IRC18:47
fungismarcet: did you mean to checkin those .idea files? looks like that was an accident?18:47
jbernard_clarkb: got it, and the file name is 'debian-ceph-hammer', right?18:47
smarcetfungi: was accident , sorry18:47
clarkbok oldest index is deleted, I am tailing the logs to see if the timestamp memory issue returns18:47
smarcetfungi: should take care of precise issue18:47
clarkbjbernard_: that hasn't been settled on :) but I think anything like that under /etc/apt/sources.list.d/ will work18:48
clarkbjbernard_: if you go ahead and pick a name I can use that one18:48
fungismarcet: yep, was skimming and looks good18:48
jbernard_clarkb: awesome, thanks man18:48
anteayafungi: thanks18:48
*** jamesmcarthur has joined #openstack-infra18:49
clarkbjesusaur: and there are kibana results now18:49
*** piet has quit IRC18:50
clarkbjesusaur: you are right though and I don't fully understand the relation between these things, but basically removing old indexes reduces memory overhead which makes it happy18:50
*** piet has joined #openstack-infra18:50
*** jamesmcarthur has quit IRC18:50
jesusaurclarkb: so there are18:50
*** jsavak has quit IRC18:51
*** jsavak has joined #openstack-infra18:51
*** yamamoto has quit IRC18:53
anteayaI have zero way of tracking what effect using mass delete has, I have ended up going to contributor pages, as I did last night and deleting them (mass and one at a time) until none remain for that contributor18:53
anteayaat least it gives me a sense of working toward the goal of a clean wiki18:54
fungithanks for tackling it, anteaya18:54
*** jamesmcarthur has joined #openstack-infra18:54
fungipabelanger: do you have a moment to peek at 299577? smarcet's implementing some conditional logic to get different (similar) apache modules on precise vs trusty18:55
fungilooks good to me, but a second set of eyeballs would be welcome18:55
*** kushal has joined #openstack-infra18:55
*** piet has quit IRC18:56
*** roxanaghe has joined #openstack-infra18:56
*** sdake has joined #openstack-infra18:57
pabelangerfungi: comment left, LGTM18:57
*** piet has joined #openstack-infra18:58
*** MarkAtwood has joined #openstack-infra18:58
*** sc68cal has quit IRC18:58
fungithanks. i'll approve it once the check jobs come back +118:58
*** ociuhandu has quit IRC18:58
*** cloudtrainme has quit IRC19:00
fungimriedem: confirmed from zuul debug logs, that's the only post job it ran for that commit. so next suspicion is that we've somehow introduced a filter in the zuul layout causing it to skip the sync job19:01
clarkbpabelanger: devstack-trusty is set to -1 now, do you want to clean things up or should I work on that?19:01
clarkbpabelanger: I think it is just image-delete ing all the devstack-trusty images then dib-image-delete ing the dib images19:01
*** kzaitsev_mb has joined #openstack-infra19:02
*** salv-orlando has joined #openstack-infra19:03
*** tiswanso has quit IRC19:03
*** Rockyg has quit IRC19:03
AJaegerpropose-requirements-updates: branch master?19:04
fungimriedem: says you +1'd the change19:04
*** tiswanso has joined #openstack-infra19:04
mriedemfungi: ah gdi,19:05
mriedemfungi: that was intended only for upper-constraints bot proposals to the requirements repo19:05
*** baoli has joined #openstack-infra19:05
mriedemnot the g-r sync proposals to the !requirements repo19:05
mriedemdims_: ^19:05
fungimriedem: yeah, that change does not do the thing you wanted then19:06
mriedemfungi: i suppose we should just revert19:06
dims_mriedem : hang on19:06
mriedemi'd have to dig up what dhellmann did to turn that off for liberty19:06
*** jamesmcarthur has quit IRC19:06
clarkbpabelanger: I am about to have lunch but can pick that up after if it helps19:06
fungimriedem: dims_: we already only run the propose-requirements-constraints-master job in the periodic pipeline for openstack/requirements19:07
*** tiswanso_ has joined #openstack-infra19:07
*** tiswanso has quit IRC19:08
fungimriedem: dims_: the definition removed from jenkins/jobs/projects.yaml in that change was just cruft cleanup, so the only real effect of the change was to stop running the requirements sync to other projects for changes on any branches besides master19:08
*** EricGonczer_ has joined #openstack-infra19:09
fungimriedem: dims_: the thing you actually wanted (don't run constraints updates for stable branches) was already teh case19:09
dims_fungi : propose-requirements-constraints-master runs once every day, right?19:10
dims_fungi : propose-requirements-updates was on every merge (post job)19:10
fungidims_: right19:10
*** e0ne has joined #openstack-infra19:11
dims_fungi : guess, i added this as i mixed them up?
*** amitgandhinz has quit IRC19:11
fungidims_: it's possible that propose-requirements-updates also proposed constraints updates to the requirements project, but i'll have to look at the script19:11
dims_fungi : just dropping that is enough. right?19:11
*** mylu has quit IRC19:11
dims_ack am checking as well19:11
*** esikachev has quit IRC19:12
fungidims_: yeah, i think so, unless the job itself also does a constraints update in addition to reqs sync to all the projects19:12
*** tqtran has quit IRC19:12
*** tqtran has joined #openstack-infra19:12
*** jsavak has quit IRC19:13
*** e0ne has quit IRC19:13
*** MarkAtwood has quit IRC19:13
openstackgerritMerged openstack-infra/puppet-user: Order of the class parameters is refactored
openstackgerritMerged openstack-infra/puppet-yum: Order of the class parameters is refactored
*** mylu has joined #openstack-infra19:13
openstackgerritMerged openstack-infra/puppet-stackalytics: Order of the class parameters is refactored
openstackgerritMerged openstack-infra/puppet-redis: Order of the class parameters is refactored
*** EricGonczer_ has quit IRC19:13
lennybHi Infra, I've started to get exception from zuul ( I am working with master ).  #link
*** amitgandhinz has joined #openstack-infra19:14
*** jtomasek_ has joined #openstack-infra19:15
fungidims_: yeah, following the logic in the job definition and the script it calls, that job shouldn't br proposing constraints updates. which i believe is why we've generally recommended that requirements changes when proposed include constraints edits when necessary (for example, when capping/skipping latest release of a dep)19:15
*** esikachev has joined #openstack-infra19:15
dims_fungi : ack i'll propose a review to revert just then19:15
fungidims_: thanks. that should do it19:16
dims_good catch fungi : thanks19:16
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Update Configuration for Precise
fungidims_: well, mriedem deserves the credit for spotting it, i just did the detective work through logs and git history19:17
clarkblennyb: does check-nova run on merged refs?19:17
dims_mriedem : thanks!19:17
clarkblennyb: it looks like there is a mismatch between the chagne type you have provided and whatever is in the queue already19:17
smarcetfungi: i sent another update to its seems that failed to build19:17
fungismarcet: awesome--i was just digging into the failure log for that19:18
lennybclarkb: no, I was trying to rerun job that failed, and missed that this change was already merged.19:18
pabelangerclarkb: Ya, I can do that now19:19
smarcetfungi: i just saw a warning re: class scope,19:19
*** akshai has quit IRC19:19
lennybclarkb: thanks, I got your point.19:19
*** jsavak has joined #openstack-infra19:19
*** piet has quit IRC19:20
*** akshai has joined #openstack-infra19:20
*** piet has joined #openstack-infra19:21
fungismarcet: agreed, that looks like all there was. i'll approve once that job reruns19:21
*** devkulkarni has quit IRC19:21
smarcetfungi: roger thx !19:21
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: propose-requirements-updates should run on all branches
dims_mriedem : fungi : ^^19:21
*** jamesmcarthur has joined #openstack-infra19:22
mriedemdims_: what is the job that updates upper-constraints?19:22
mriedemoh propose-requirements-constraints-master19:22
*** achanda has quit IRC19:24
dims_mriedem : y both jobs run /usr/local/jenkins/slave_scripts/ with different params19:24
*** akshai has quit IRC19:24
*** gordc has quit IRC19:25
fungithe same proposal logic gets used for lots of different things, so we just have branching in there based on a command-line parameter19:25
*** ociuhandu has joined #openstack-infra19:26
*** jsavak has quit IRC19:26
*** EricGonczer_ has joined #openstack-infra19:27
*** jsavak has joined #openstack-infra19:27
*** fawadkhaliq has quit IRC19:28
*** fawadkhaliq has joined #openstack-infra19:28
*** EricGonczer_ has quit IRC19:30
*** akshai has joined #openstack-infra19:30
*** imcsk8 has quit IRC19:33
*** imcsk8 has joined #openstack-infra19:34
*** esker has joined #openstack-infra19:34
pabelangerclarkb: 29 images left to upload19:34
pabelangerclarkb: also deleted devstack-trusty too19:35
*** gyee has quit IRC19:35
*** resker has joined #openstack-infra19:36
*** esikache1 has joined #openstack-infra19:36
fungiwe seem to be a bit starved for devstack-centos7 nodes at the moment19:37
openstackgerritMerged openstack-infra/project-config: Adding networking-hpe project.
*** esikachev has quit IRC19:38
*** esker has quit IRC19:39
*** kuromagi has quit IRC19:39
pabelangerfungi: should have 2 online atm19:39
*** abregman|afk has quit IRC19:39
*** kuromagi has joined #openstack-infra19:39
*** resker has quit IRC19:41
*** mrmartin has quit IRC19:41
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add libselinux-python for ansible jobs
jrollAJaeger: LOL, oops, I missed that19:44
openstackgerritMatthew Edmonds proposed openstack/requirements: Update keystoneclient lower bound
*** Sukhdev has quit IRC19:44
fungipabelanger: yeah, jobs i was watching eventually got one19:45
*** dimtruck is now known as zz_dimtruck19:46
*** cburgess has quit IRC19:46
AJaegerjroll: that's one of the reasons why I warned about using it, there're too many subtile things that can go wrong ;)19:46
*** jamesmcarthur has quit IRC19:46
*** kgiusti has joined #openstack-infra19:47
*** cburgess has joined #openstack-infra19:47
*** baoli has quit IRC19:47
*** dtardivel has quit IRC19:48
jrollAJaeger: ya, fair enough :)19:48
*** esker has joined #openstack-infra19:48
*** baoli has joined #openstack-infra19:49
*** zz_dimtruck is now known as dimtruck19:49
*** baoli has quit IRC19:49
*** baoli has joined #openstack-infra19:50
*** devkulkarni has joined #openstack-infra19:50
*** achanda has joined #openstack-infra19:51
*** piet has quit IRC19:51
*** devkulkarni has quit IRC19:51
*** amitgandhinz has quit IRC19:51
*** abregman|afk has joined #openstack-infra19:51
*** amitgandhinz has joined #openstack-infra19:51
*** gordc has joined #openstack-infra19:52
*** devkulkarni has joined #openstack-infra19:52
*** esker has quit IRC19:53
*** rockyg has joined #openstack-infra19:53
*** yamamoto has joined #openstack-infra19:53
*** zeih_ has joined #openstack-infra19:54
*** fawadkhaliq has quit IRC19:55
*** angdraug has joined #openstack-infra19:55
openstackgerritMerged openstack-infra/puppet-openstackid: Update Configuration for Precise
openstackgerritPaul Belanger proposed openstack-infra/project-config: Move windmill to centos-7 dib
*** devkulkarni has quit IRC19:56
*** jamesmcarthur has joined #openstack-infra19:57
*** mrmartin has joined #openstack-infra19:58
*** zeih__ has joined #openstack-infra19:59
*** sdake_ has joined #openstack-infra20:00
*** zeih_ has quit IRC20:00
*** jtomasek_ has quit IRC20:00
*** abregman|afk has quit IRC20:01
*** mylu has quit IRC20:01
clarkbpabelanger: I think its safe to approve devstack trusty removal now so will review that change20:01
*** baoli has quit IRC20:01
*** |-paul-| has joined #openstack-infra20:01
*** cburgess has quit IRC20:01
*** piet has joined #openstack-infra20:02
*** kuromagi has quit IRC20:02
*** kuromagi has joined #openstack-infra20:02
pabelangerclarkb: great20:02
*** sdake has quit IRC20:02
*** annegentle has quit IRC20:03
*** Clint has quit IRC20:03
*** yamamoto has quit IRC20:03
*** cburgess has joined #openstack-infra20:04
*** fawadkhaliq has joined #openstack-infra20:05
*** kuromagi has quit IRC20:05
clarkbpabelanger: and it is approved20:05
*** cburgess has quit IRC20:05
*** kuromagi has joined #openstack-infra20:05
*** gibi has quit IRC20:07
*** gibi has joined #openstack-infra20:07
smarcetfungi: did puppet change applied to
*** cburgess has joined #openstack-infra20:08
fungismarcet: it should in the next few minutes. i'm tailing the syslog on the server so i can switch context to it once it shows up20:08
smarcetfungi: got ti20:09
*** Clint has joined #openstack-infra20:09
openstackgerritMerged openstack-infra/project-config: propose-requirements-updates should run on all branches
*** jamesmcarthur has quit IRC20:11
pabelangerclarkb: exciting20:11
*** angdraug has quit IRC20:12
pabelangerclarkb: Going to update the nodepool patch and use the CLI like you suggested for the image workers20:12
*** jamesmcarthur has joined #openstack-infra20:13
*** angdraug has joined #openstack-infra20:13
clarkbpabelanger: ok20:13
*** angdraug has quit IRC20:13
*** kzaitsev_mb has quit IRC20:13
*** kzaitsev_mb has joined #openstack-infra20:14
*** cburgess has quit IRC20:14
*** piet has quit IRC20:14
clarkbpabelanger: we are also down to 24 image uploads20:15
openstackgerritMerged openstack-infra/project-config: Remove devstack-trusty from nodepool
pabelanger#success migration from devstack-trusty to ubuntu-trusty complete!20:15
openstackstatuspabelanger: Added success to Success page20:15
pabelangerAJaeger: awesome work20:16
AJaegerpabelanger: awesome work ;)20:16
AJaegerpabelanger: great team work as usual, thanks!20:16
*** jamesmcarthur has quit IRC20:16
*** esker has joined #openstack-infra20:16
fungianybody happen to know, from way waaaaaay back, why some projects might still have feedparser in their test requirements? turns up a handful declaring it as a test requirement but none actually importing it20:17
*** cburgess has joined #openstack-infra20:19
clarkbfungi: does git log show when/why it was added?20:19
*** pleia2 has quit IRC20:19
clarkbfungi: if I had to guess though its a docs thing?20:20
*** pleia2 has joined #openstack-infra20:20
fungiclarkb: sort of... i did a git blame on sqlalchemy-migrate and turned up this gem:
clarkblike sphinx uses it to generate feeds for doc updates maybe?20:20
*** mylu has joined #openstack-infra20:20
fungi"Updated to OpenStack Build stuff."20:20
AJaegerit was in the initial import to requirements repository20:20
fungiyeah, and sqla-m is the oldest repo carrying it still20:21
*** annegentle has joined #openstack-infra20:21
fungilooks like it cargo-culted from something still older20:21
*** esker has quit IRC20:21
AJaegerfungi, will you send cleanup patches?20:21
pabelangersdague: do you mind reviewing: since you disabled fedora-2320:22
fungiAJaeger: if i figure out for sure it's unused. it's possible this is an optional dependency we don't import in our code but something else we use does magic when it's present20:22
clarkbya I am not finding anything more useful20:23
clarkbprobably is stale and can be removed?20:23
*** sridhar_ram has joined #openstack-infra20:23
fungiit was in nova's test-requirements as recently as last year20:23
*** nadya has joined #openstack-infra20:23
openstackgerritThomas Morin proposed openstack-infra/project-config: networking-bgpvpn dvsm job: add gate_hook
*** fawadkhaliq has quit IRC20:24
fungii think i'll do a little spelunking there20:24
*** fawadkhaliq has joined #openstack-infra20:25
sdaguepabelanger: do we have a recent log somewhere?20:25
sdaguepabelanger: ah, yep, in the commit message20:25
sdaguepabelanger: +A20:26
pabelangersdague: Ya, ianw did some logging20:26
pabelangersdague: thanks20:26
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Fix on external orders * added 412 validation * addded 404 validation
sdagueyep, great, it's in the hour ball park which is totally cool20:26
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use cached instack qcow image for all ci tests
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Pre install packages on the instack image
sdagueit was just the running to 3 hours that wasn't :)20:26
openstackgerritThomas Morin proposed openstack-infra/project-config: networking-bgpvpn dvsm job: add gate_hook
fungiclarkb: AJaeger: aha! "Use feedparser to parse the generated atom feeds in the tests for the versions resource."20:26
fungicirca 5 years ago20:26
openstackgerritMerged openstack-infra/openstackid-resources: Fix on external orders * added 412 validation * addded 404 validation
openstackgerritMerged openstack-infra/project-config: Remove deprecated branches from irc notification
sdaguefungi: just remember, if you ever need an openwrt image, you can get it out of the nova git tree20:27
*** zeih__ has quit IRC20:27
*** esikache1 has quit IRC20:27
AJaegerfungi, yeah, there's a lot of cruft. Like I found spidermonkey package requirements - and ceilometer is not using it for ages ...20:28
zigoAm I right that there's a $WORKPLACE in jenkins, which will be where the git repo is cloned?20:28
zigoie: $WORKPLACE vs $WORKSPACE ?20:28
zigofungi: AJaeger: ^20:28
clarkbzigo: it is WORKSPACE iirc and yes for non devstack jobs that is typically where the repo is cloned and checked out20:28
fungigenerally it will be /home/jenkins/workspace/<name_of_job>/20:29
clarkbany other takers on for the advancement of our new xenial overlords?20:29
fungiit's also the current working directory for the jobs unless something in your job changes its cwd20:30
zigoI thought that we had WORKPLACE= /home/jenkins/workspace/<name_of_job>/, but that's WORKSPACE ?20:30
* clarkb reviews some swift multinode20:30
fungizigo: i don't know what WORKPLACE is, but looks like a typo20:30
zigofungi: Ok, thanks for clearing my confusion ! :)20:30
* zigo ammends the commit20:31
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: ssh less
openstackgerritMerged openstack-infra/project-config: Retire openstack-ansible-os_swift_sync repository
openstackgerritThomas Goirand proposed openstack-infra/project-config: Add a job to build openstack-pkg-tools
*** angdraug has joined #openstack-infra20:32
*** sdake has joined #openstack-infra20:32
openstackgerritMerged openstack-infra/project-config: Re-activate Ubuntu beaker for puppet-pacemaker.
fungisdague: wow, 4.4mb20:33
AJaegerproject-config cores, can we merge two more changes, please? Gertty shows the total number of open changes for project-config and we're at 101 ;)20:33
*** sdake_ has quit IRC20:33
AJaegersdague: wow, thanks for sharing!20:34
sdaguefungi: yeh, I found it by running some commands looking for large files20:34
sdaguein the git history20:34
anteayaAJaeger: your magic number is 99?20:34
*** rossella_s has quit IRC20:34
*** rossella_s has joined #openstack-infra20:35
anteayawayne gretzky would be proud20:35
fungismarcet: pabelanger: new issue with the openstackid-dev changes... it's not creating /etc/apache2/sites-available/ (i'm looking now to see if i can spot the reason)20:36
AJaegeranteaya: going from 3 digits to 2 ;)20:36
AJaegeranteaya: 42 is the goal, isn't it? ;)20:36
fungiAJaeger: easier solution--switch to hexidecimal20:36
smarcetfungi: perhaps a parser error ?20:36
*** achanda has quit IRC20:37
fungismarcet: possibly, i'm still digging20:37
zigofungi: Using OpenWRT as the image that Nova spawns, instead of cirros? :P20:37
zigoSmart move.20:37
fungizigo: way back in the day, that's what it looks like they did, yes20:37
*** mylu has quit IRC20:37
anteayaAJaeger: is it?20:37
openstackgerritMerged openstack-infra/project-config: Revert "move fedora23 devstack to experimental"
AJaegerfungi: do you think jeblair would approve a switch to use hexadecimal numbers?20:37
anteayaAJaeger: I considered the answer20:37
anteayanever thought about it as the goal20:37
*** nadya has quit IRC20:38
clarkbsdague: for this enable swift services on subnode change, is there work on the devstack side to configure them proprely yet?20:38
AJaegeranteaya: there's no goal for number of open reviews - but having a not too long backlog is great. I think we're in a good position now if we filter out all the ones that jenkins doesn't like20:38
fungismarcet: we also got... Could not find command '/usr/sbin/php5enmod'20:38
clarkbsdague: are we able to see swift function in a 2 node cluster anywhere yet?20:38
*** devkulkarni has joined #openstack-infra20:38
smarcetok let me check o nthat20:38
*** MarkAtwood has joined #openstack-infra20:39
*** esikache1 has joined #openstack-infra20:39
notmynameclarkb: "...just a quick note on the rolling upgrade tests: I’m working on a local dual-node test env, based on sdague’s patches to use that approach, but it’s not done yet. i’ll continue working on that"20:39
anteayaAJaeger: no double digits are fine as the reason20:39
notmynameclarkb: that's from cschwede who's been out for a few days20:40
*** mylu has joined #openstack-infra20:40
notmynameclarkb: and we're going to bring it up in the swift meeting in 20 minutes20:40
anteayaand yes you do a wonderful job of keeping reviews in shape, thank you20:40
notmynameclarkb: summary is that it's still in progress, I expect good things soon, but it's not done yet20:40
anteayadougwig: can you work a review of into your schedule20:40
clarkbmostly trying to figure out if we can/should approve this devstack-gate change yet20:40
clarkbin other news anyone know what ansible return codes are?20:41
anteayadougwig: it is a networking-midonet patch20:41
pabelangerfungi: Hmm, do you have a puppet log of the provision?20:41
sdagueclarkb: I would hold on the devstack-gate change for now20:41
openstackgerritMerged openstack-infra/project-config: Add NFS job to Cinder experimental
clarkbsdague: ok20:41
fungipabelanger: sure, it's in syslog on openstackid-dev.openstack.org20:41
sdaguethere is a bit about coordinating the ring building between the nodes that needs sorting out20:41
AJaegeranteaya: it's not only me, others help a lot as well - especially yolanda20:42
sdaguesome basically wrongness with devstack not starting any services on the subnodes was fixed, and the d-g patch helped see that20:42
anteayaAJaeger: just confirming again 287415 is good to merge?20:42
anteayaAJaeger: she does too20:42
clarkbsdague: is it worth WIPing? from what I can tell that change doesn't appear to break the existing mutlinoe setup, but it doesn't really do anything other than make devstack run longer yet20:42
AJaegeranteaya: yes, it's now.20:42
fungipabelanger: i'm thinking it's because of this... (/Stage[main]/Openstackid/Apache::Vhost::Custom[]/Apache::Custom_config[]/Exec[syntax verification for]/returns) Invalid command 'MaxRequestWorkers', perhaps misspelled or defined by a module not included in the server configuration20:42
anteayaAJaeger: thanks20:42
AJaegeranteaya: thanks!20:42
notmynamesdague: does the ring-building need to be in that patch right now? or can we do that separately later?20:42
pabelangerfungi: Ya, I think we need to fixup the errors20:42
*** mylu has quit IRC20:43
sdaguenotmyname: it probably is worth getting sorted up front20:43
AJaeger99 open project-config changes - time to call it a day ;)20:43
* AJaeger waves good bye20:43
notmynamesdague: ok. I'm waiting to hear from cschwede on that20:43
fungipabelanger: unfortunately, i'm not immediately spotting where we're setting MaxRequestWorkers (is this something being set by the puppetlabs apache module?)20:43
*** esker has joined #openstack-infra20:43
sdaguebecause until that happens what we actually have is a swift cluster on the main node, and an orphan swift cluster on the subnode that doesn't do anything but take up space... I think20:43
fungiAJaeger: a great end to a great day!20:43
clarkbsdague: that is my understanding as well20:44
pabelangerfungi: yes:
pabelangerfungi: we want mpm right?20:45
anteayaAJaeger: enjoy your evening20:45
*** matrohon has joined #openstack-infra20:45
smarcetpabelanger:fungi : ok working on a fix thx !20:45
fungipabelanger: mpm_event yes20:45
fungipabelanger: we want to override that anyway with our own tuning parameters20:46
*** MarkAtwood has quit IRC20:46
fungioh, i see, that's what that is trying to do20:46
*** esikache1 has quit IRC20:47
fungipabelanger: and it's installing apache2-mpm-event successfully, but maybe MaxRequestWorkers is not part of apache 2.2?20:48
*** openstackgerrit has quit IRC20:48
*** openstackgerrit has joined #openstack-infra20:48
pabelangerfungi: possible, that is what I am googling20:48
fungiMaxRequestWorkers was called MaxClients before version 2.3.13. The old name is still supported.20:48
clarkbdougwig: comment on I like the change in general but would like that logging to be tightened up. Inline comment has details20:48
*** zeih_ has joined #openstack-infra20:48
rcarrillocruzyou beat me20:48
rcarrillocruzso yeah20:48
rcarrillocruzit's a version thing20:48
rcarrillocruzMaxRequestWorkers was called MaxClients before version 2.3.13. The old name is still supported.20:49
pabelangerfungi: smarcet: so, we should be using the apache::mpm class, shouldn't we?20:49
smarcetfungi:pabelanger: at any rate i think that i should use the facilities that module give to set up the tunning connections20:49
*** piet has joined #openstack-infra20:49
* rcarrillocruz goes back to his terminal session20:49
smarcetpabelanger: yes on it20:49
fungipabelanger: can we vendor in our own version of that file for now to avoid the error until a fix can be approved into puppetlabs apache?20:49
pabelangerfungi: right, there is also ::apache::mod::event too, for tuning20:49
pabelangerfungi: if that fails, we can patch upstream20:50
smarcetfungi:pabelanger: ok i will use ::apache::mod::event then20:50
pabelangersmarcet: Ya, you have a few choices20:50
*** mylu has joined #openstack-infra20:51
*** nadya has joined #openstack-infra20:51
*** mylu has quit IRC20:52
*** gordc has quit IRC20:53
clarkbdstufft: does pip install a pip2 and pip3 to the bin path when installed via the get pip url thing?20:53
clarkbI think that is a distroism20:54
*** mylu has joined #openstack-infra20:54
*** nadya has quit IRC20:54
*** stevemar has quit IRC20:55
fungiclarkb: i think the python upstream approach is python3 -m pip if you want something like a pip320:55
dstufftpip does currently install pip, pipX, and pipX.Y20:55
*** stevemar has joined #openstack-infra20:55
*** roxanaghe has quit IRC20:55
fungidstufft: for every version of the python interpreter on the system where you install it?20:56
clarkboh hey looks like it does20:56
dstufftfungi: no, for whatever version you're installing it for20:56
fungigot it20:56
dstufftI'm not sure what th elong term thing will be there20:56
fungiso if you want that behavior for multiple interpreters, you have to reinstall it multiple times20:56
dstufftthe current solution kind of sucks20:56
*** achanda has joined #openstack-infra20:56
clarkbin this case it should be sufficient20:56
dstufftit's not unusual for ``python2`` and ``pip2`` to point to different pythons20:57
dstufftwhich is crummy20:57
clarkbdstufft: that would happen if say you have a system python2.6 on centos6 but then sideload a pip + python2.7 elsewhere?20:57
*** achanda has quit IRC20:57
dstufftclarkb: yea, or on OSX if you have Python 2.x from the system and from homebrew20:58
*** achanda has joined #openstack-infra20:58
*** mylu has quit IRC20:58
dstufftpython -m pip works, and is more explicit but more typing so users tend to not be particularly happy about it20:58
dstufft(and it doesn't actually work on 2.6, you have to do python -m pip.__main__)20:59
*** Sukhdev has joined #openstack-infra20:59
*** matrohon has quit IRC20:59
fungigiven most of our pip usage is in the context of virtualenvs, it's less of an issue since you create the virtualenv with whatever interpreter you want used20:59
*** stevemar has quit IRC21:00
smarcetfungi:pabelanger: testing changes locally21:00
fungibut some places like devstack, it's still a problem21:00
smarceti will submit a patch :)21:00
fungismarcet: thanks! i'll be available to review and get it fast-tracked in21:00
openstackgerritMerged openstack-infra/project-config: Use ZUUL_REFNAME (2/2) for branch checking
clarkbfungi: it should be fine with devstack too because devstack never installs python from random places21:01
clarkbfungi: devstack should only use system pythons I think21:01
fungiclarkb: well, yes and no... devstack may have multiple python interpreters21:02
fungiand if you want to pip install something which is going to build extensions against the python3 headers...21:02
*** chem has quit IRC21:03
clarkbdevstack would have to be explicit there21:03
clarkbbut in that case pip3 should work21:03
fungiat least i assume 246017 is in service of people wanting to do py3k testing of things within devstack environments, though it doesn't really say21:03
fungiclarkb: pip3 will only exist if you explicitly install pip using python321:03
fungior at least that's the way i understood dstufft's explanation21:04
*** bpokorny has quit IRC21:04
*** sdague has quit IRC21:04
clarkbdevstack will need to be explicit21:04
openstackgerritPaul Belanger proposed openstack-infra/system-config: Sync nodepool-builder logging with latest changes
pabelangerfungi: clarkb: ^ ianw just reminded me about nodepool-builder logging21:04
*** _ari_ has quit IRC21:04
fungiclarkb: sure, but if devstack's going to be explicit anyway, it can just python -m pip instead of reinstalling pip multiple times21:04
fungier, python3 -m pip21:05
dougwigclarkb and anteaya: looking21:05
dougwigclarkb: np, agree, will respin21:06
fungiclarkb: or i suppose devstack can directly create the pip3 symlink21:06
clarkbfungi: I can remove my approval and you can -1 with comments to use pythonX -m pip for freeze listings instead21:06
clarkbpabelanger: +221:06
fungiwell, i thought you indicated that you found a /usr/bin/pip3 on a devstack machine, in which case i'm curious what created it21:06
ianwwow, that file is almost getting to the point you could manage it by hand21:06
*** roxanaghe has joined #openstack-infra21:07
clarkbfungi: I did not, as far as I know devstack isn't doing anyhting python3 yet21:07
clarkbfungi: I managed to get those bins created in local venvs21:07
*** amitgandhinz has quit IRC21:07
clarkbI went ahead and changed to a -121:08
fungiclarkb: yep, adding a comment now21:08
*** julim has quit IRC21:08
*** jsavak has quit IRC21:08
*** dprince has quit IRC21:09
*** amrith is now known as _amrith_21:10
clarkbianw: btw I have approved a change that conflicts with I figured the proper order was the change that fixes repreoduce then we can reduce the logging (since the assertion isn't quite correct given there is a big)21:10
clarkbianw: I am happy to rebase that for you if you like21:10
*** julim has joined #openstack-infra21:11
*** eil397 has quit IRC21:12
*** mylu has joined #openstack-infra21:13
*** thorst has quit IRC21:14
*** alkhodos has joined #openstack-infra21:14
*** thorst has joined #openstack-infra21:15
*** ldnunes has quit IRC21:15
*** zeih_ has quit IRC21:16
*** jsavak has joined #openstack-infra21:16
*** annegentle has quit IRC21:16
*** YorikSar has quit IRC21:16
ianwclarkb: sure ... well yeah, i just noticed it constantly in the logs where (usually) it's noise21:17
*** thorst_ has joined #openstack-infra21:17
*** YorikSar has joined #openstack-infra21:17
*** thorst has quit IRC21:19
ianw is another one for dib that would help signal:noise ratios on logs i seem to look at a lot (poke SpamapS :)21:19
*** mrmartin has quit IRC21:20
*** maishsk has quit IRC21:20
*** maishsk_ has joined #openstack-infra21:20
*** rfolco has quit IRC21:21
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations
*** _amrith_ is now known as amrith21:22
*** tqtran is now known as tqtran-afk21:22
*** thorst_ has quit IRC21:22
*** devkulkarni has quit IRC21:23
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Updated config for Precise
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work
smarcetfungi: i think that i got it
*** |-paul-| has quit IRC21:24
smarcetwaiting for jenkins review21:24
*** annegentle has joined #openstack-infra21:25
*** eharney has quit IRC21:26
*** asettle has joined #openstack-infra21:26
fungismarcet: awesome21:26
anteayajenkins can't review it can only verify21:27
fungithis is true. we leave teh reviewing to people21:27
*** jsavak has quit IRC21:27
*** jsavak has joined #openstack-infra21:28
anteayafungi: can you tell me the story of what would take place if we created a new wiki instance?21:28
*** Sukhdev has quit IRC21:29
anteayaI'm tired of deleting and could use a good story21:29
*** devkulkarni has joined #openstack-infra21:29
*** maishsk_ has quit IRC21:29
fungianteaya: well, we need the puppet-mediawiki module in a little more complete shape first21:29
anteayaspecifically how can we sanitize the data for a migration21:29
fungianteaya: then we use it do deploy a wiki-dev.o.o or similar21:29
*** maishsk has joined #openstack-infra21:30
*** annegentle has quit IRC21:30
anteayamakes sense so far21:30
fungiand copy a database backup from wiki.o.o to it and load it there21:30
anteayathat just moves the spam too, yeah?21:30
fungiand add a robots.txt that says "don't index anything on this site"21:30
anteayathat's the magic21:30
fungiso search engines won't be returning search results for that server21:30
fungithen we run the admin script to purge deleted articles on wiki.o.o21:31
fungiand if we discover any which should not have been deleted after that, we still have the ability for anyone in the community to find the content on the dev server and copy that content back into replacement pages on wiki.o.o21:31
anteayaoh we need the -dev server in place before we can run purge, hmmmm21:31
fungiwell, i called it -dev but it could be anything21:32
*** achanda has quit IRC21:32
anteayaokay, that makes sense21:32
anteayaright, the non-indexed, non-production server21:32
fungiwe should have a dev mediawiki deployment anyway so we can safely work through upgrades21:32
clarkbmtreinish: why isnt' in devstack?21:32
anteayaI'm fine if that is called -dev21:32
clarkbmtreinish: seems like that could be part of the tempest install in devstack instead andthen it would work without d-g21:32
mtreinishclarkb: because devstack doesn't run tempest21:32
clarkbno but it installs it21:33
mtreinishand it needs to go into the right tox venv (which depends on how we run tempest)21:33
anteayaso the puppet module to create the non-indexed server, doesn't have to deal with upgrading or anything, just a deployment of what we are running now, right?21:33
clarkband this is installing parts of tempest21:33
fungianteaya: i mean, we _could_ run the purge now and just hold onto the most recent backup prior to that indefinitely, but if someone figures out there's a page missing it's some time to get that loaded on another mediawiki server to be able to easily retrieve it21:33
fungianteaya: yeah, "just" a deployment of what we have in production already, except that the puppetry for that is (from what i've heard) nowhere near complete21:34
mtreinishclarkb: I've gotten a lot of pushback trying to play venv games with tox for tempest in devstack21:34
*** thorst has joined #openstack-infra21:34
clarkbmtreinish: hrm, I mean devstack exists to configure and install these things IMO this is where that goes21:34
anteayafungi: well just in terms of not upgrading, not just in terms of it should be easy for someone not me to accomplish21:35
clarkbdevstack gate shouldn't really need to know how to configure tempest or how to install it21:35
mtreinishlike right now it makes 2-3 separate venvs with tox depending on how things are setup. (venv, full, and possible job name)21:35
anteayafungi: is what we have deployed version wise on the wiki server documented anywhere I can view?21:35
mtreinishand when I've tried to consolidate that I got -1d21:35
mtreinishit was a while ago though21:35
fungismarcet: close, but puppet lint is complaining about => alignment on lines 224-231 of init.pp21:35
smarcetok checking on it21:36
fungismarcet: the only job that hasn't finished running yet is the ubuntu-trusty apply job, but the bare-precise apply job worked so that's probably going to pass too21:37
*** shashank_hegde has joined #openstack-infra21:37
mtreinishclarkb: as absurd as this statement is, devstack only installs tempest twice for configuring things. It actually doesn't install it for the case where we're running with a plugin (or any job besides full)21:37
mtreinishthat's the status quo21:37
fungianteaya: and the puppet-mediawiki module are the extent of the documentation we have on that deployment so far21:37
anteayafungi: this looks like it just pulls in master at the time it is executed:
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Updated config for Precise
fungianteaya: there's also this
*** thorst has quit IRC21:39
fungiwhich might be the missing piece of that puzzle for you21:39
anteayaah thank you21:39
anteayalook at that, version numbers21:39
fungieven git commit hashes!21:39
fungiwith links to their source tree21:40
fungiand the list of extensions installed and what versions they're all at21:41
anteayathe list of extentions seem daunting, in that I don't think their installation is puppeted21:41
fungiit's usefully thorough21:41
anteayait is indeed21:41
pabelangerclarkb: down to 14, going to step away for a bit. Do you mind landing 299627 and a nodepool-builder restart after image uploads?21:41
pabelangerI'll check back in a few hours21:41
clarkbmtreinish: also why does using a tempest plugin imply the all target? is that so that you can specify a regex?21:42
anteayafungi: if we went with the backup and purge route, do you think we could tell folks to wait until after summit to retrive their content?21:43
*** bpokorny has joined #openstack-infra21:43
*** esker has quit IRC21:43
pleia2there are a lot of extentions that ship by default but aren't enabled, you enable in the config, which we did get puppetized21:43
*** esker has joined #openstack-infra21:43
anteayaI'd like to help, but given what needs to be puppeted and my level of puppet knowledge I don't think I will get far enough before I leave tomorrow21:43
anteayapleia2: yay21:43
*** esker has quit IRC21:43
pleia2so we'd have to determine what has been added21:43
fungipabelanger: smarcet: even with 299636 i'm still concerned that having MaxRequestWorkers in is what's causing apache 2.2 to complain about an unrecognized directive21:43
anteayapleia2: right21:43
fungibut willing to give it a shot21:44
*** esker has joined #openstack-infra21:44
anteayapleia2: are you working on translation site things at the moment?21:44
anteayapleia2: or have you time to look at this with me?21:44
smarcetfungi: i think that puppet apache module take care of that , but we would see i guess21:44
anteayapleia2: my concern is starting something and then leaving for a week21:45
mtreinishclarkb: yeah, there are regexes on all the other jobs, so it's just to give it a clean slate to ensure whatever the test_ids end up being from the plugins will be run21:45
*** fawadkhaliq has quit IRC21:45
anteayapleia2: I don't want to leave you doing all the work21:45
*** piet has quit IRC21:45
pleia2anteaya: depends on what you need :) I don't know that I can make time right now for a deep dive of massive mediawiki understanding21:46
*** tiswanso_ has quit IRC21:46
clarkbnow to completely change the subject, I think dib may have regressed our grub configs21:46
clarkbwe appear to have a 10 second boot timeout21:47
clarkbbecause you know 10 seconds * 25k instances per day = money21:47
*** esker has quit IRC21:47
fungithat's ~3 servers worth of quota doing nothing but waiting for a keypress which will never come21:48
*** davidlenwell has quit IRC21:48
*** esker has joined #openstack-infra21:49
*** aysyd has quit IRC21:49
anteayapleia2: okay thanks, I understand21:49
*** Sukhdev has joined #openstack-infra21:50
pleia2anteaya: happy to schedule some debugging sessions, or if you need info from the production server21:51
pleia2just let me know21:51
*** fawadkhaliq has joined #openstack-infra21:52
anteayathanks, I don't think it is worth me bothering you until after I get back21:52
clarkbI see the issue21:52
anteayajust so sad to see the search engine results21:52
anteayawhich keep picking up deleted files21:52
clarkbwhen we removed the kernel boot parameter memory management stuff we also removed the grub timeout fixing21:52
clarkbI will add this back in21:53
fungiclarkb: d'oh!21:53
*** thiagop has quit IRC21:53
fungiwe were eager to get the memory hacks out of there i guess21:53
*** lakshmiS has quit IRC21:53
*** esker has quit IRC21:54
*** davidlenwell has joined #openstack-infra21:55
*** stevemar has joined #openstack-infra21:56
*** esker has joined #openstack-infra21:56
*** rockyg has quit IRC21:58
*** piet has joined #openstack-infra21:58
*** esker has quit IRC21:59
*** weshay has quit IRC21:59
*** esker has joined #openstack-infra21:59
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations
*** stevemar has quit IRC22:01
openstackgerritClark Boylan proposed openstack-infra/project-config: Add removal of grub boot timeouts back in
clarkbreviews for ^ should help us save 10 seconds per ubuntu-trusty boot :)22:02
clarkbnot sure what the default is on fedora or centos22:02
*** burgerk has quit IRC22:02
*** GonZo2000 has quit IRC22:03
*** esker has quit IRC22:04
*** jaypipes has quit IRC22:04
*** esker has joined #openstack-infra22:04
*** esker has quit IRC22:05
clarkbto write that change I reverted the removal of the memory management, removed the memory management, then renamed things to better reflect their purpose22:05
openstackgerritMerged openstack-infra/devstack-gate: Save PROJECTS form the job defintion for use in
*** GonZo2000 has joined #openstack-infra22:05
*** GonZo2000 has quit IRC22:05
*** GonZo2000 has joined #openstack-infra22:05
*** mylu has quit IRC22:06
*** pradk has quit IRC22:07
*** shashank_hegde has quit IRC22:07
*** amitgandhinz has joined #openstack-infra22:08
*** mylu has joined #openstack-infra22:08
*** moravec has quit IRC22:09
openstackgerritMerged openstack-infra/puppet-openstackid: Updated config for Precise
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Follow name_or_id pattern on domain operations
armaxhi fellas22:10
armaxI am looking at
armaxand the merge-check queue is a bit strange to my eyes22:11
armaxI see changes that are not yet merged in the list22:11
clarkbarmax: we check for the check queue too22:12
clarkbor rather22:12
clarkbthe way that works is it queues a job for unmerged things to make sure they can all merge after something else merges22:12
armaxclarkb: ack22:12
armaxoh right, I always saw the outcome on gerrit, but I never managed to get that live in zuul22:13
*** amitgandhinz has quit IRC22:13
armaxso the ‘noop’ job on each change does indeed do something?22:13
fungiit balloons and then deflates very quickly22:13
clarkbarmax: yes it takes advantage of zuul's built in merge before testing behavior to test if those can merge22:14
fungi"noop" is a special job in zuul which actually runs nothing after the merge commit is calculated, so that no actual worker node is expended22:14
armaxclarkb, fungi thanks for clearing that up for me22:14
clarkb /me works to figure that out22:15
fungibasically, it still requests the merge commit but never injects a gearman work request for any the subsequent job22:15
*** moravec has joined #openstack-infra22:16
*** shashank_hegde has joined #openstack-infra22:16
*** claudiub|2 has quit IRC22:16
*** jaypipes has joined #openstack-infra22:17
*** annegentle has joined #openstack-infra22:17
mtreinishnibalizer: did we ever sort out the cacti thing? I still don't see subunit-worker02.o.o on there22:18
clarkbgreghaynes: whats with that error I just linked above22:18
clarkbonly use #!/bin/bash for scripts22:18
clarkbit is a script22:18
*** jsavak has quit IRC22:18
clarkband the other finalise.d scripts in that dir do it too22:19
clarkbit means don't hvae the -xe22:19
openstackgerritMonty Taylor proposed openstack-infra/shade: Workaround multiple priate network ports
greghaynesclarkb: ah, ya22:19
greghaynesclarkb: that message could be more clear22:20
openstackgerritClark Boylan proposed openstack-infra/project-config: Add removal of grub boot timeouts back in
*** fawadkhaliq has quit IRC22:20
openstackgerritMonty Taylor proposed openstack-infra/shade: Workaround multiple private network ports
clarkbmordred: pirate network ports?22:20
clarkbmordred: like those used by bittorrent?22:20
* mordred walks the plank22:20
*** fawadkhaliq has joined #openstack-infra22:20
mordredclarkb: :)22:20
clarkbmordred: 293155 is the ceph mirror change and I think it is ready now, but would like your review before I remove the WIP22:21
*** mriedem has quit IRC22:21
clarkbmordred: since it is relatively complicated and has lots of moving parts of which you seem to grasp all of them22:21
mordredclarkb: I shall look22:21
mordredclarkb: did you see my ceph question?22:21
clarkbmordred: I don't think so?22:22
mordredclarkb: there is a new ceph LTS being released in a week or so22:22
mordredclarkb: the thing post hammer22:22
clarkboh ya I asked the nova people about that and kolla too and they said hammer is what they are using now22:23
clarkband in theory we can add the next release relatively easily once we have hammer in place22:23
clarkbwhich is where a lot of the recent churn on that change comes from22:23
clarkbthe realization that we need to be able to support >1 ceph repo for ubuntu/debian22:24
*** markvoelker has joined #openstack-infra22:24
openstackgerritMerged openstack-infra/shade: Support provider networks in public network detection
clarkbdown to 9 image uploads22:25
*** tpsilva has quit IRC22:27
*** sigmavirus24 is now known as sigmavirus24_awa22:27
*** EricGonczer_ has joined #openstack-infra22:27
*** dimtruck is now known as zz_dimtruck22:28
*** ajmiller has quit IRC22:28
*** tonytan4ever has quit IRC22:28
fungismarcet: pabelanger: yeah, so with that new change applied, puppet-openstackid (via puppetlabs apache module) is creating a /etc/apache2/mods-enabled/event.conf file which contains a line like "MaxRequestWorkers 250" and that's not a valid directive in apache 2.222:30
*** ajmiller has joined #openstack-infra22:30
*** mylu has quit IRC22:30
clarkbnow 7, we need a rocket launch countdown22:30
*** sshnaidm has quit IRC22:30
fungismarcet: pabelanger: which is what i suspected was going to happen since that file's format is hard-coded in the puppetlabs apache module, the only parts of it which are parameterized are the values22:31
smarcetfungi: ok so i think that we should overwrite it with our own file i guess22:32
*** mylu has joined #openstack-infra22:32
smarcetfungi: i will write another patch then22:32
smarcetfungi: sorry about the back and forwards22:33
*** amrith is now known as _amrith_22:33
fungismarcet: in the short term, yes that will be the most expedient solution. longer term we should get puppetlabs apache fixed to properly support mpm-event tuning on apache 2.222:33
openstackgerritLuigi Toscano proposed openstack-infra/project-config: [sahara-tests] create and merge, disable tests
openstackgerritLuigi Toscano proposed openstack-infra/project-config: WIP Revert "[sahara-tests] create and merge, disable tests"
*** gildub has joined #openstack-infra22:33
*** fawadkhaliq has quit IRC22:34
openstackgerritMerged openstack-infra/shade: Mutex protect internal/external network detection
openstackgerritMerged openstack-infra/shade: Reset network caches after network create/delete
openstackgerritMerged openstack-infra/shade: Remove duplicate FakeServer class from unit tests
*** tosky has quit IRC22:35
*** sshnaidm has joined #openstack-infra22:36
openstackgerritMerged openstack-infra/shade: Fix test_get_server_ip unit test
openstackgerritMerged openstack-infra/shade: Fix test_list_servers unit test
*** fawadkhaliq has joined #openstack-infra22:37
*** ZZelle has joined #openstack-infra22:37
*** ZZelle has quit IRC22:38
clarkbwoot grub timeout fix passes testing now22:39
*** eil397 has joined #openstack-infra22:40
*** gyee has joined #openstack-infra22:40
*** mylu has quit IRC22:41
fungiclarkb: was most of that logic cribbed from before we accidentally threw it out with the bathwater?22:41
*** ZZelle has joined #openstack-infra22:41
clarkbfungi: yup, I wrote that change by starting wit ha git revert, removing the memory management, then renaming things to be clearer22:41
clarkbwhich is why the hp copyright remains and all that22:41
clarkbI can hardly take credit for that as being new and novel22:42
pleia2clarkb: thumbs up22:42
*** devkulkarni has quit IRC22:42
fungiperfect--that's the answer i was hoping for ;)22:42
*** mylu has joined #openstack-infra22:43
openstackgerritMerged openstack-infra/devstack-gate: Log locale during setup_host
openstackgerritMerged openstack-infra/devstack-gate: Remove deletion of ~/workspace-cache
fungiwould have been useful for the commit message to mention a sha you retrieved it from, but provenance questions for that will almost certainly never come up22:43
*** akshai has quit IRC22:44
*** jiggalator has joined #openstack-infra22:44
openstackgerritMerged openstack-infra/devstack-gate: Allow to pass TEMPEST_OS_TEST_TIMEOUT from the job
*** netsin has quit IRC22:44
pabelangerfungi: smarcet: if you get me the syntax I can get a PR up for puppetlabs-apache22:44
pabelangerfungi: guess we don't want to move to ubuntu-trusty?22:45
fungipabelanger: well, according to MaxClients works in 2.2 and 2.4, but you may want to make it conditional in case it's removed in later apache releases in favor of MaxRequestWorkers22:46
clarkbI can amend it if you want22:46
fungipabelanger: we _do_ want to move to ubuntu-trusty, but not a couple weeks before the summit22:46
*** sdake has quit IRC22:46
*** sdake has joined #openstack-infra22:46
fungipabelanger: and also it would be useful in general i think if puppetlabs apache had better apache 2.2 support22:46
clarkbsince its approved I will just leave a comment in gerrit22:47
fungiclarkb: yeah, i didn't really need the amend, which is why i +2'd anyway22:47
fungipretty sure most of us will know to just dig back in git log -p22:47
clarkb4 image uploads22:48
*** edmondsw has quit IRC22:48
fungipabelanger: however, helping smarcet work around this by vendoring an apache 2.2 compliant version of that file in and avoiding having puppetlabs apache create it for us would be appreciated. he'll likely have a patch up shortly for that22:49
smarcetfungi:pabelanger; also i think that mpm event is not supported on apache 2.222:49
*** knikolla has quit IRC22:49
openstackgerritMerged openstack-infra/project-config: Add removal of grub boot timeouts back in
*** netsin has joined #openstack-infra22:49
smarcetfungi: pabelanger : apache 2.2 only supports fork and worker22:49
fungismarcet: i think it must be. there's an apache2-mpm-event package installed on the server22:49
smarcetfungi: oh ok22:50
fungiit's this one
smarcetfungi: ok cool just double checking :) thx22:51
pabelangerfungi: smarcet:
pabelangerwill add tests later22:51
pabelangerbut that should work22:51
smarcetpabelanger: oh cool tnx a lot22:52
smarceti guess that we should set the module.env to a commit again ?22:53
pabelangerfungi: do you mind +A
pabelangersmarcet: or have fungi test it locally first22:53
pabelangersmarcet: once we get testings and documentation, we can push on puppetlabs to land it22:54
smarcetfungi: should wait on pabelanger patch? or should go ahead and do the patch  meanwhile ?22:55
fungipabelanger: i don't have a suitable local test env set up for that22:55
fungismarcet: it probably makes sense to go ahead with a workaround in the short term, since there's no guarantee how quickly puppetlabs will approve that fix22:56
smarcetfungi: gotcha22:56
anteayahey armax22:56
*** esker has joined #openstack-infra22:56
anteayadid you realize you said hi fellas?22:56
smarcetfungi: pabelanger; thx guys! really aprecciate all your help :)22:56
*** stevemar has joined #openstack-infra22:56
*** tqtran-afk is now known as tqtran22:57
*** markvoelker has quit IRC22:57
fungismarcet: i appreciate yours too. we don't want the server collapsing under load at the summit22:57
armaxanteaya: hi22:57
anteayadid you really intend to only address the men in channel when you asked your question earlier?22:58
anteayathat doesn't seem likeyou22:58
armaxanteaya: um, I geniunely did not know that fellas was masculine22:59
anteayaoh my22:59
anteayaI don't know what to say22:59
*** Jeffrey4l has joined #openstack-infra22:59
*** piet has quit IRC22:59
jpmaxmanfungi: smarcet any reason why we aren't on latest Apache?22:59
smarcetjpmaxman: bc ubuntu version 12.0423:00
armaxanteaya: sorry, I learned something new today23:00
openstackgerritMerged openstack-infra/system-config: Sync nodepool-builder logging with latest changes
anteayaarmax: yeah, me too23:00
anteayaarmax: thank you23:00
armaxanteaya: you learned that I don’t know how to speak English? :)23:00
armaxanteaya: that’s not new!23:00
fungijpmaxman: we're on the version of apache supported by the version of ubuntu which was current at the time the server was built. we've since (with help from smarcet, mrmartin, pabelanger and others) gotten the deployment automation for openstackid in shape to deploy on a newer ubuntu release23:00
*** esker has quit IRC23:00
anteayano I learned that some folks may not understand what gender inclusive salutations are23:01
jpmaxmanCool so we are going to just move to 14.04?23:01
*** stevemar has quit IRC23:01
fungijpmaxman: but at this point i'm hesitant to assume it will work great on a new distro release this close to the summit23:01
clarkbpabelanger: 2 image uploads remain23:01
fungijpmaxman: yes, after the summit i really want to upgrade and to 14.0423:02
jpmaxmanI personally don't feel like Ubuntu version is a high risk for this app23:02
jpmaxmansmarcet: correct me if you feel differently23:03
*** annegentle has quit IRC23:03
*** ams_ has quit IRC23:03
jpmaxmanBut php version is really biggest thing23:03
clarkbI think the risk is more in the php version apache version redis version and so forth all changing23:03
*** thorst has joined #openstack-infra23:03
*** mylu has quit IRC23:03
pabelangerclarkb: almost23:03
*** mylu has joined #openstack-infra23:04
fungijpmaxman: smarcet: i can try to redeploy on ubuntu 14.04 now if you want to go that route, i'm just worried about it being an even bigger rathole to climb out of23:04
smarcetclarkb:jpmaxman: i am running locally on apache 15.04 and works ok23:04
jpmaxmanDidn't we run our tests on trusty?23:04
smarcetjpmanxman yes its works fine23:05
smarcetand yes we ran the test on 15.0423:05
smarcetfungi: let me know what u want to do, bc we should add the php5enmod thing again on 15.0423:05
smarcetor 14.0423:05
clarkbbtw 15.04 is no longer supported23:06
fungii'm booting one now. should have it up in a few minutes, computer gods willing23:06
clarkbso uh don't use it23:06
*** jaypipes has quit IRC23:06
jpmaxmanPersonally I feel more comfortable with going to 1404 than all the work around on 120423:06
armaxanteaya: right, erroneously thought fellas was synonym with friends, which I know applies to both :)23:06
jpmaxmanThink he meant 140423:06
armaxanteaya: I’ll be more careful next time23:07
mordredclarkb: I +2'd your change, although I left a comment about a whitespace change which confused me23:07
mordredclarkb: I do not want to block you on a whitespace change though23:07
jpmaxmanMy vote is move to trusty23:07
smarcetfungi: i think that u should specify redis version , bc redis config, on node configuration23:07
clarkbmordred: ok it is entirely possible something else will break and it needs an update anyways23:07
fungismarcet: jpmaxman: mind if i delete the current openstackid-dev server first? looks like we're pushing the limits of our quota in that tenant23:07
mordredclarkb: yah23:07
*** knikolla has joined #openstack-infra23:07
smarcetfungi : by default is set to 12.04 default version23:07
anteayaarmax: ah rriends, friends is a great word23:07
fungismarcet: oh, in system-config?23:08
anteayaarmax: I was mostly surprised23:08
*** sridhar_ram has quit IRC23:08
smarcety think so23:08
armaxanteaya: I even thought fellow was not masculine23:08
armaxanteaya: I stand corrected23:08
anteayaarmax: as all your other behaviour is very gender inclusive23:08
clarkbarmax: as a job title it may not be23:08
clarkbarmax: english is just that confusing :)23:08
anteayaarmax: ah okay, cool23:09
armaxclarkb: I see23:09
smarcetfungi: here
armaxclarkb: that’s the source of my confusion then23:09
anteayaright fellow can be a job title23:09
armaxand it applies to both?23:09
anteayagood question23:09
armaxanteaya: I must admit, on this front, I love Italian23:09
*** andymaier has quit IRC23:09
anteayaI haven't met any female fellows23:09
smarcetfungi :  $redis_version23:09
fungismarcet: need to set $redis_version to what for 14.04?23:09
anteayabut I think that is more indicative of the state of the industry than lack of a bility to apply an appropriate job title23:10
*** amitgandhinz has joined #openstack-infra23:10
smarcetfungi: checking23:10
anteayaarmax: what would it be in italian?23:10
anteayamaybe italian is better23:10
armaxfellow is23:10
armaxeither compagno or compagna23:10
armaxthe suffix of the word tells you the gender23:10
anteayais there one that means both men and women?23:11
armaxcompagne is feminine plural23:11
smarcetfungi i think that 2.8.x but double checking23:11
smarcetfungi : just a sec  :)23:11
armaxcompagni is masculine plural23:11
openstackgerritMateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Refactor, moved mysql part out of init.pp
anteayaplural inclusive?23:11
anteayaitalian does sound better23:11
openstackgerritMateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Refactor, moved mysql part out of init.pp
smarcetfungi: from here should be 2.8.x23:12
*** fawadkhaliq has quit IRC23:12
armaxcompagnie is friendships23:12
armaxthough it also means companies23:12
smarcetfungi: but checking on a 14.04 machine23:12
armaxso, yes to some degree Italian can be confusing without context just as much as any other language23:12
anteayaI like the friendships bit23:12
anteayaand find it interesting the word also means companies23:13
anteayathanks for the Italian lesson23:13
anteayaI appreciate it23:13
smarcetfungi: also i think that we should re add the  exec { 'enable_php5-mbcrypt': thing for 14.0423:13
*** shashank_hegde has quit IRC23:13
armaxanteaya: thank you for making me learn a new bit of English!23:14
*** fawadkhaliq has joined #openstack-infra23:14
*** sridhar_ram has joined #openstack-infra23:14
*** amitgandhinz has quit IRC23:14
anteayahappy to help :)23:14
*** sridhar_ram has quit IRC23:14
*** Jeffrey4l_ has joined #openstack-infra23:15
*** nwkarsten has quit IRC23:16
*** Jeffrey4l has quit IRC23:16
pabelangersmarcet: fungi: right, I found that issue when testing ubuntu-trusty:
*** nwkarsten has joined #openstack-infra23:16
smarcetsmarcet@ubuntu:~$ sudo redis-server -v23:16
smarcet[sudo] password for smarcet:23:16
smarcetRedis server v=2.8.4 sha=00000000:0 malloc=jemalloc-3.4.1 bits=64 build=a44a05d76f06a5d923:16
*** [1]Thelo has joined #openstack-infra23:16
fungismarcet: yeah, confirmed on trusty the redis-server package is 2.8.423:16
smarcetfungi : redis version is 2.8.423:17
pabelangerbut never fixes it properly23:17
clarkbpabelanger: not to put more balls into your juggling system but did you rerun devstack on xenial to capture the errors?23:17
smarcetfungi: will re add the php5-enmod thing for mbcrypt on a new patch23:17
pabelangerclarkb: Give me a sec, I think I have it23:17
*** shashank_hegde has joined #openstack-infra23:17
*** mylu has quit IRC23:17
clarkbI don't currently have enough ram to spin up a local test of my own23:17
fungismarcet: okay, i'll also go ahead and do the system-config patch to bump openstackid-dev to redis 2.8.423:18
clarkbI should probably upgrade my vm machine to 16GB of ram and expense it23:18
openstackgerritsebastian marcet proposed openstack-infra/puppet-openstackid: Readded php5enmod mbcrypt for trusty
*** Thelo has quit IRC23:18
*** [1]Thelo is now known as Thelo23:18
clarkbor get a nuc23:18
* clarkb checks out memory limits on new nucs23:19
*** devkulkarni has joined #openstack-infra23:19
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Declare redis 2.8.4 on openstackid-dev
*** devkulkarni has quit IRC23:20
fungismarcet: jpmaxman: ^ there's the redis version bump for the dev server23:20
*** mylu has joined #openstack-infra23:20
clarkbthis might be a thing23:20
*** nwkarsten has quit IRC23:20
fungiclarkb: yeah, i should consider replacing my gigabyte brix workstations. i've reached the 3-year "you can expense a new work computer" mark23:21
*** mylu has quit IRC23:21
fungimine are a scant 16gb, so 32 would be niiice23:22
clarkball of my machines are currently 8GB23:22
clarkbone because the intel chipset won't do more, another because 8GB died on me and I had to underclock the other 8GB to keep it running, and the last one because I never bought more23:22
pleia2mine are 16gb as well, have been playing with the idea of 64 in the system that can take it (the others max out at 16)23:22
fungiyeah, you should... do something about that23:23
*** mylu has joined #openstack-infra23:23
fungiright, the brix models i got a few years back only go up to 16gb23:23
bkero8GB SODIMMs are on the market now23:23
fungiso definitely need new hardware23:23
bkeroErr, 16GB23:23
bkeroThey're pretty damn expensive though23:23
clarkbbkero: if only this x240 could use that23:23
*** salv-orl_ has joined #openstack-infra23:24
*** annegentle has joined #openstack-infra23:24
pleia2my primary desktop is an i7 from 2009, likely needs a refresh anyway ;)23:24
clarkbpleia2: mine too23:24
bkeroclarkb: Yeah. :( Broadwells can upgrade thoug.h23:24
pabelangerclarkb: running now23:24
clarkbI actually have a nehalem i7 floating around somewhere too23:24
fungithough i've gotten used to the haswell displayport multiplexing support23:24
bkeroI did the desktop upgrade a few months ago. Went from a Nehalem i7 (2008) to a Skylake i7. Now things are pretty snappy. :)23:24
*** knikolla has quit IRC23:25
*** jamesmcarthur has joined #openstack-infra23:25
pleia2bkero: nice :)23:25
clarkbbkero: the memory bw on nehalem is still higher right?23:25
clarkbgood for space heating and databases23:25
fungiwonder if i can use this same displayport hub on a modern nuc23:25
bkeroclarkb: Triple channel vs double channel. The speed of the DDR4 is faster though.23:25
openstackgerritJames E. Blair proposed openstack-infra/shade: Cache ports like servers
openstackgerritJames E. Blair proposed openstack-infra/shade: Remove conditional blocking on server list
bkeroclarkb: the memory bandwidth on either is hilariously high though. Although if you really want memory bandwidth some sandy bridge chipsets supported quad-channel.23:26
*** salv-orlando has quit IRC23:26
*** mylu has quit IRC23:27
*** jiggalator has quit IRC23:27
pabelangerclarkb: sudo: /usr/sbin/ntpdate: command not found23:27
pabelangerguess I should fix that too23:27
*** sridhar_ram has joined #openstack-infra23:27
clarkbpabelanger: ya we need that because sometimes cloud instances boot in the past or the future23:28
fungipabelanger: centos-minimal a little too minimal?23:28
clarkband not by a few seconds or minutes but by hours23:28
*** mylu has joined #openstack-infra23:28
*** annegentle has quit IRC23:28
pabelangerfungi: xenial-minimal23:28
clarkbfungi: I think this is xenial23:28
fungiright, can _not_ trust system time at boot in clouds23:28
fungigot it. ntpdate may be deprecated in favor of something new shiny now too23:29
*** _amrith_ is now known as amrith23:29
pabelangerYa, could be23:29
clarkbthere is still an ntpdate package though23:29
clarkbso simple thing may be to keep using it?23:29
fungino objection from me23:29
*** LaT0rtue has quit IRC23:30
clarkbor alternatively use the ne wthings on trusty/centos/fedora if they exist there too23:30
fungijust found the same23:30
clarkbntpd -g ?23:31
*** Jeffrey4l__ has joined #openstack-infra23:32
pabelangerIt did this yesterday, appears to be hung at:23:32
pabelangerSetting up python-yaml (3.11-3build1) ...23:32
pabelangerwill give it some time23:32
clarkbI think we want ntpd -gq23:32
*** Jeffrey4l__ is now known as Jeffrey4l23:32
fungiyeah, looks like has caught up with a feature of openntpd on openbsd23:33
*** Jeffrey4l_ has quit IRC23:33
funginamely, the ability to go ahead and force the system time to jump when first starting the daemon23:33
fungirather than trying to slowly slew it even right after starting23:33
*** annegentle has joined #openstack-infra23:34
clarkbI will whip up a patch really quick and we can see how it does on all the things23:35
fungiwe could ntpd -g followed by ntp-wait23:35
*** zz_dimtruck is now known as dimtruck23:35
*** dizquierdo has quit IRC23:36
clarkbis ntpd -gq not going to be synchronous?23:36
fungier, i guess just make sure ntpd is running and then ntp-wait23:36
fungintp-wait should tell us whether time is accurate23:37
jpmaxmanfungi: smarcet so are we all set moving forward with trusty? Sorry I would have chimed in on this earlier. Hope we didn't waste too much time23:37
clarkbfungi: I think the problem is we have to force it to make the big jump which it won't be default in all cases23:37
clarkbfungi: which is where ntpd -gq comes in23:37
openstackgerritMerged openstack-infra/devstack-gate: TRIVIAL: Fix some misspellings
openstackgerritMerged openstack-infra/devstack-gate: Added env variable for subnode conf for multinode
smarcetfungi: ready to review23:38
fungijpmaxman: smarcet: well, it's an experiment next. but i need to free up some quota to boot the replacement openstackid-dev (which could be done by deleting the current one)23:38
*** annegentle has quit IRC23:38
jpmaxmanI think it is OK. smarcet you agree?23:39
fungijpmaxman: smarcet: upgrading to trusty, as far as current challenges go, only solves the puppetlabs apache module having an apache 2.2 noncompliant directive in its config23:39
openstackgerritMerged openstack-infra/devstack-gate: Log deprecations in horizon and keystone
fungijpmaxman: smarcet: just making sure you don't have any data on that server you need preserved before i blow it away23:39
smarcetfungi: np from my side23:40
smarcetjpmaxman : i concord23:40
pabelangerYa, something is going on with apt-get, just stuck on python-yaml23:40
clarkbhrm looks like ntp on ubuntu uses -g by default23:40
jpmaxmanFlight of the conchord?23:40
clarkbso maybe the wait is sufficient23:40
pabelangerand the console appears to be locked23:41
*** jamesmcarthur has quit IRC23:41
fungismarcet: on 299665, as i mentioned a few patches back when you first had that, it's going to run "/usr/sbin/php5enmod mcrypt" every time we reapply puppet on the server because there's nothing to say when it should be run. it's okay for now but we should fix that soon with a subscribe to the package or something23:41
clarkbpabelanger: I thought we had corrected that, are you using
clarkbpabelanger: its waiting for user input probably23:42
*** gildub has quit IRC23:42
fungismarcet: can you +1 299667 if it matches what you were expecting?23:42
smarcetfungi: i think that is subscribed to package23:42
*** angdraug has quit IRC23:43
smarcetfungi:  Package['php5-fpm'],23:43
smarcetfungi: oh sorry i see23:43
pabelangerclarkb: no, I follow the directions on devstack-gate readme23:44
smarcetfungi : done23:44
pabelangernew VM23:44
fungismarcet: yeah, it declares it as a dependency, but doesn't only run it under specific circumstances, which we'll eventually want to clean up23:44
smarcetfungi: got it :)(23:44
fungismarcet: would also be possible to have that exec test for presence of whatever symlink that command would normally create23:45
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use ntp-wait instead of ntpdate to set time
fungian onlyif or something23:45
jeblairpabelanger, clarkb: oh yeah, that sort of changed under us.  it is waiting for input (sigttin i think).  it's fixed with an exec, which as clarkb says does23:45
*** achanda has joined #openstack-infra23:45
*** Jeffrey4l_ has joined #openstack-infra23:45
pabelangerjeblair: Ah... where does live?23:46
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Remove unused functions
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Pass extended network information in to occ/shade
*** Jeffrey4l has quit IRC23:46
clarkbexec 0</dev/null23:46
jeblairpabelanger: it's created by devstack-gate runs, by devstack-gate.  i'm late to the party, whatcha doin?23:46
*** shashank_hegde has quit IRC23:47
jeblairclarkb: that's the one23:47
jeblairhook stdin to dev/null23:47
clarkbpabelanger: you can find in the logs of devstack-gate run jobs23:48
clarkbpabelanger: oh thinking about more23:49
clarkbpabelanger: we likely need that if else to be "uses journald else stop start"23:49
openstackgerritMerged openstack-infra/puppet-openstackid: Readded php5enmod mbcrypt for trusty
clarkbbecause in theory xenial like fedora uses journald too and can just do the timestamp trick23:49
*** aysyd has joined #openstack-infra23:50
*** roxanaghe has quit IRC23:50
*** annegentle has joined #openstack-infra23:51
jeblairpabelanger: oh you're manually devstack-gating on xenial?23:51
clarkbjeblair: ya23:51
*** SumitNaiksatam has quit IRC23:51
jeblaircool.  i highly recommend just running a from a recent passing gate job23:51
pabelangerso that's how you get it23:51
jeblairthis way you have a a fixed baseline23:52
openstackgerritMerged openstack-infra/system-config: Declare redis 2.8.4 on openstackid-dev
clarkbcentos7 should also journalctl and we may not do syslog properly there right now23:52
clarkbI will take a stab at making this a bit better23:52
*** mylu has quit IRC23:52
fungismarcet: jpmaxman: okay, the needed changes are merged, so i'm going to delete the current openstackid-dev to free up quota, then build a replacement23:52
smarcetfungi: oki doki23:53
*** shashank_hegde has joined #openstack-infra23:54
*** amrith is now known as _amrith_23:54
pabelangerjeblair: clarkb: okay, using as my baseline (rsyslog patch) on xenial23:55
*** tqtran has quit IRC23:55
pabelangerTIL how devstack-gate works23:55
*** yarkot has joined #openstack-infra23:55
*** ajmiller has quit IRC23:56
pabelangerclarkb: 0 images uploading23:56
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use journald when it is present
pabelangerclarkb: did you want to restart or me?23:57
clarkbpabelanger: ^ I think that is a possible alternative to 29899823:57
mordredclarkb: heya - got a sec to help us with a few nodepool-shade patches?23:57
clarkbpabelanger: I can get it if you like23:57
pabelangerclarkb: go for it23:57
*** stevemar has joined #openstack-infra23:57
*** mylu has joined #openstack-infra23:57
clarkbpabelanger: all done23:58
pabelangerclarkb: okay, will try and test depending on the current results23:58
*** Qiming has joined #openstack-infra23:59
clarkbpabelanger: we have a stale xenial build that I am trying to delete but it may need a db cleanup :/23:59
pabelangerclarkb: Hmm, ubuntu-xenial is currently building however/23:59
mordredclarkb: jeblair are sitting in the same room hacking on the issues we had in prod a couple of days ago - we're pretty sure those will clear it up23:59
mordreds/jeblair/jeblair and I/23:59

Generated by 2.14.0 by Marius Gedminas - find it at!