*** IlyaG has joined #openstack-infra | 00:00 | |
*** davideagnello has joined #openstack-infra | 00:01 | |
Clint | jeblair: trying to diff change 298389 makes gertty asplode | 00:02 |
---|---|---|
*** IlyaG has quit IRC | 00:02 | |
*** EricGonczer_ has quit IRC | 00:02 | |
*** sputnik13 has joined #openstack-infra | 00:03 | |
openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Move OpenStack-Salt team meeting https://review.openstack.org/298335 | 00:03 |
openstackgerrit | Merged openstack-infra/irc-meetings: Update DefCore Meeting description https://review.openstack.org/298416 | 00:03 |
*** sflanigan has joined #openstack-infra | 00:06 | |
*** Qiming has quit IRC | 00:06 | |
openstackgerrit | Merged openstack-infra/irc-meetings: Move OpenStack-Salt team meeting https://review.openstack.org/298335 | 00:07 |
*** mylu has joined #openstack-infra | 00:07 | |
*** resker has joined #openstack-infra | 00:08 | |
*** mylu has quit IRC | 00:08 | |
*** mylu has joined #openstack-infra | 00:09 | |
openstackgerrit | KATO Tomoyuki proposed openstack-infra/project-config: Add release notes translation scripts https://review.openstack.org/297045 | 00:10 |
openstackgerrit | Sachi King proposed openstack-infra/git-review: Fix no_git_dir UnboundLocalError in except block https://review.openstack.org/298473 | 00:10 |
*** IlyaG has joined #openstack-infra | 00:10 | |
*** lucasagomes has quit IRC | 00:10 | |
*** ociuhandu has quit IRC | 00:10 | |
*** asettle has joined #openstack-infra | 00:10 | |
*** lucasagomes has joined #openstack-infra | 00:11 | |
*** fawadkhaliq has quit IRC | 00:12 | |
*** esker has quit IRC | 00:12 | |
*** ociuhandu has joined #openstack-infra | 00:12 | |
*** fawadkhaliq has joined #openstack-infra | 00:13 | |
*** IlyaG has quit IRC | 00:13 | |
*** davideag_ has joined #openstack-infra | 00:15 | |
*** davideagnello has quit IRC | 00:15 | |
*** tphummel has quit IRC | 00:16 | |
*** harlowja has quit IRC | 00:16 | |
*** chuck_ has joined #openstack-infra | 00:17 | |
*** kzaitsev_mb has joined #openstack-infra | 00:17 | |
*** SumitNaiksatam has quit IRC | 00:19 | |
openstackgerrit | Clint Adams proposed openstack-infra/project-config: Add periodic job to autogenerate tempest plugins list https://review.openstack.org/291517 | 00:19 |
openstackgerrit | Clint Adams proposed openstack-infra/project-config: Add periodic job to autogenerate grenade plugins list https://review.openstack.org/291514 | 00:19 |
*** maishsk_ has joined #openstack-infra | 00:23 | |
*** amitgandhinz has joined #openstack-infra | 00:23 | |
*** maishsk has quit IRC | 00:23 | |
*** maishsk_ is now known as maishsk | 00:23 | |
*** sarob has joined #openstack-infra | 00:23 | |
*** salv-orlando has joined #openstack-infra | 00:24 | |
*** kzaitsev_mb has quit IRC | 00:24 | |
*** IlyaG has joined #openstack-infra | 00:26 | |
*** gyee has quit IRC | 00:26 | |
*** sridhar_ram has quit IRC | 00:27 | |
*** LaT0rtue has quit IRC | 00:28 | |
*** piet has joined #openstack-infra | 00:28 | |
*** salv-orlando has quit IRC | 00:28 | |
*** mtanino_ has joined #openstack-infra | 00:29 | |
*** mtanino has quit IRC | 00:31 | |
*** sputnik13 has quit IRC | 00:34 | |
*** IlyaG has quit IRC | 00:35 | |
*** sdake_ has joined #openstack-infra | 00:35 | |
*** amitgandhinz has quit IRC | 00:36 | |
*** roxanaghe has quit IRC | 00:37 | |
*** sdake has quit IRC | 00:38 | |
*** sarob has quit IRC | 00:40 | |
*** angdraug has quit IRC | 00:40 | |
*** fawadkhaliq has quit IRC | 00:40 | |
*** fawadkhaliq has joined #openstack-infra | 00:40 | |
*** achanda has joined #openstack-infra | 00:41 | |
*** roxanaghe has joined #openstack-infra | 00:42 | |
*** apoorvad has quit IRC | 00:43 | |
*** Sukhdev has quit IRC | 00:44 | |
*** Swami has quit IRC | 00:44 | |
*** zeih has joined #openstack-infra | 00:45 | |
*** tiswanso has joined #openstack-infra | 00:45 | |
*** tiswanso has quit IRC | 00:46 | |
*** achanda has quit IRC | 00:46 | |
*** sdake_ has quit IRC | 00:47 | |
*** tiswanso has joined #openstack-infra | 00:47 | |
*** esker has joined #openstack-infra | 00:47 | |
*** sdake has joined #openstack-infra | 00:47 | |
*** armax has left #openstack-infra | 00:48 | |
*** zeih has quit IRC | 00:49 | |
*** akshai has joined #openstack-infra | 00:50 | |
*** tphummel has joined #openstack-infra | 00:50 | |
*** resker has quit IRC | 00:51 | |
*** harlowja has joined #openstack-infra | 00:51 | |
*** Sukhdev has joined #openstack-infra | 00:51 | |
*** roxanaghe has quit IRC | 00:52 | |
*** asettle has quit IRC | 00:54 | |
*** tphummel has quit IRC | 00:54 | |
*** _amrith_ is now known as amrith | 00:57 | |
*** akshai_ has joined #openstack-infra | 00:58 | |
*** NobodyCam has joined #openstack-infra | 00:58 | |
*** eliqiao has quit IRC | 00:59 | |
*** LaT0rtue has joined #openstack-infra | 00:59 | |
*** eliqiao has joined #openstack-infra | 01:00 | |
*** achanda has joined #openstack-infra | 01:01 | |
*** akshai has quit IRC | 01:01 | |
*** fawadkhaliq has quit IRC | 01:02 | |
*** asettle has joined #openstack-infra | 01:04 | |
*** rkukura has quit IRC | 01:05 | |
*** Liuqing has joined #openstack-infra | 01:06 | |
*** fawadkhaliq has joined #openstack-infra | 01:07 | |
*** pvaneck has quit IRC | 01:07 | |
*** asettle has quit IRC | 01:08 | |
mordred | dougwig: I don't konw if anyone followed up with you - but I would expect nodepool to do the right thing WRT your provider network with the shade patch | 01:12 |
mordred | dougwig: I'd love to debug what's going wrong with you there | 01:12 |
mordred | dougwig: whenver is convenient for you | 01:12 |
*** mriedem has quit IRC | 01:13 | |
mordred | dougwig: the easiest way to start that is for you to just run "shade-inventory --list --yaml" as a user who has access to your clouds.yaml file and send me the output so I can see what your network config looks like that we have not taken in to account | 01:13 |
*** tqtran has quit IRC | 01:14 | |
*** fawadkhaliq has quit IRC | 01:14 | |
*** esker has quit IRC | 01:14 | |
*** SumitNaiksatam has joined #openstack-infra | 01:15 | |
*** Liuqing has quit IRC | 01:15 | |
*** Qiming has joined #openstack-infra | 01:15 | |
*** armax has joined #openstack-infra | 01:16 | |
*** armax has left #openstack-infra | 01:17 | |
openstackgerrit | amrith proposed openstack/requirements: Blacklist Routes 2.3 https://review.openstack.org/298482 | 01:18 |
*** chuck_ is now known as zu | 01:18 | |
*** zu is now known as zul | 01:18 | |
amrith | hi folks, could I get some help with https://review.openstack.org/298482 | 01:18 |
amrith | I'd sent email earlier today to the ML about this issue; it impacts Trove and Neutron at least (as far as I know). | 01:19 |
amrith | this is breaking Trove in mitaka and master, and I assume liberty as well. | 01:19 |
amrith | could I get some help getting this merged, and also some help from someone who knows more about this than me to undertand why there are two consecutive lines for Routes in g-r.txt | 01:20 |
mordred | amrith: they are for different python versions | 01:20 |
mordred | one of them applies to python 2.7 | 01:20 |
amrith | ok | 01:20 |
mordred | one applies to versions of python that are not | 01:20 |
amrith | sorry, missed the ! | 01:20 |
amrith | ok, I'll resubmt to block this for both | 01:21 |
mordred | cool | 01:21 |
mordred | I'm going to -1 the patch just to record the reason | 01:21 |
amrith | yes plz | 01:21 |
*** kzaitsev_mb has joined #openstack-infra | 01:21 | |
mordred | (also, I get so little stackalytics credit for -1s because I always just talk to people in IRC :) ) | 01:21 |
openstackgerrit | amrith proposed openstack/requirements: Blacklist Routes 2.3 https://review.openstack.org/298482 | 01:22 |
amrith | mordred, did I beat you to it ? | 01:22 |
mordred | nope! I got it in :) | 01:22 |
*** ddieterly has joined #openstack-infra | 01:22 | |
*** asettle has joined #openstack-infra | 01:23 | |
amrith | thx mordred I pushed one up for both, and I will go find my glasses. | 01:24 |
mordred | amrith: cool. +2 from me | 01:24 |
*** Sukhdev has quit IRC | 01:25 | |
openstackgerrit | feipeng proposed openstack/requirements: Add crc16 lib to requirments https://review.openstack.org/298485 | 01:25 |
amrith | thx mordred will push for other stable's as well | 01:26 |
*** efoley_ has quit IRC | 01:26 | |
*** ybathia has quit IRC | 01:26 | |
*** kzaitsev_mb has quit IRC | 01:26 | |
*** EricGonczer_ has joined #openstack-infra | 01:28 | |
*** jamielennox|away is now known as jamielennox | 01:29 | |
*** LaT0rtue has quit IRC | 01:32 | |
anteaya | mordred: I know stackalytics gives no credit for irc discussions | 01:33 |
*** amitgandhinz has joined #openstack-infra | 01:33 | |
mordred | anteaya: it's sad | 01:33 |
mordred | anteaya: I'd win that one for sure ;) | 01:33 |
anteaya | pleia2: thanks, I underestimated the water flow so at this point don't think I'll get sleep until it slows down | 01:33 |
anteaya | mordred: you would indeed | 01:33 |
pleia2 | anteaya: that's unfortunate | 01:33 |
anteaya | pleia2: on the bright side I hope that means it is over faster | 01:33 |
pleia2 | anteaya: hopefully! | 01:34 |
anteaya | pleia2: it's typical | 01:34 |
pleia2 | spring in canada, eh? | 01:34 |
anteaya | I had just thought I missed it this year | 01:34 |
anteaya | and my house | 01:34 |
anteaya | and where the plow piles the snow | 01:34 |
anteaya | until I clear the driveway myself this is where the person who plows the drive will put it | 01:34 |
*** aspiers has quit IRC | 01:35 | |
pleia2 | heh | 01:35 |
anteaya | so I'm not surprised, I have my routine well oiled, it is just how much rest I get between freshening all the towels | 01:36 |
*** jamesmcarthur has joined #openstack-infra | 01:36 | |
amrith | mordred, would you take a look at https://review.openstack.org/298486 and https://review.openstack.org/298488 as well, I'll go to openstack-stable and see if I can get them reviewed there as well. | 01:37 |
dougwig | mordred: sure thing. | 01:39 |
*** aspiers has joined #openstack-infra | 01:40 | |
openstackgerrit | feipeng proposed openstack/requirements: Add crc16 lib to requirments https://review.openstack.org/298485 | 01:41 |
*** mtanino_ has quit IRC | 01:43 | |
*** tphummel has joined #openstack-infra | 01:45 | |
dougwig | mordred: sent you a couple of private gists. let me know what else i can do. when i walked through shade's code, the check for whether the newly spawned instance had a "public" ip was failing, hence it trying for a floating ip. | 01:46 |
*** amitgandhinz has quit IRC | 01:46 | |
dougwig | mordred: (specifically, in shade, the call to get_server_public_ip was returning non-true.) | 01:48 |
dougwig | mordred: i stopped looking at that point and did the revert, but i can fire it back up if needed. | 01:48 |
*** rkukura has joined #openstack-infra | 01:50 | |
*** Liuqing has joined #openstack-infra | 01:51 | |
*** roxanaghe has joined #openstack-infra | 01:53 | |
*** EricGonczer_ has quit IRC | 01:55 | |
*** jamesmcarthur has quit IRC | 01:56 | |
*** edmondsw has quit IRC | 01:56 | |
*** woodster_ has quit IRC | 01:57 | |
*** roxanaghe has quit IRC | 01:58 | |
*** amrith is now known as _amrith_ | 01:59 | |
*** harlowja has quit IRC | 01:59 | |
*** piet has quit IRC | 01:59 | |
*** thorst has quit IRC | 01:59 | |
*** yamahata has quit IRC | 02:05 | |
*** sbalukoff has quit IRC | 02:05 | |
*** jamesmcarthur has joined #openstack-infra | 02:07 | |
*** LaT0rtue has joined #openstack-infra | 02:09 | |
*** tqtran has joined #openstack-infra | 02:12 | |
*** ddieterly is now known as ddieterly[away] | 02:15 | |
*** tqtran has quit IRC | 02:17 | |
*** jamesmcarthur has quit IRC | 02:18 | |
*** jamesmcarthur has joined #openstack-infra | 02:19 | |
*** ddieterly[away] is now known as ddieterly | 02:20 | |
*** jamesmcarthur has quit IRC | 02:21 | |
*** ddieterly is now known as ddieterly[away] | 02:21 | |
*** kzaitsev_mb has joined #openstack-infra | 02:22 | |
*** ddieterly[away] is now known as ddieterly | 02:23 | |
*** ddieterly is now known as ddieterly[away] | 02:23 | |
*** zhurong has joined #openstack-infra | 02:25 | |
*** kzaitsev_mb has quit IRC | 02:28 | |
openstackgerrit | Jane.zhang proposed openstack/diskimage-builder: Set tgtd not auto-start on OS boot time. https://review.openstack.org/297548 | 02:31 |
sdake | any idea what is going on with this gte job here; https://jenkins04.openstack.org/job/gate-kolla-dsvm-build-ubuntu-source/544/console | 02:37 |
sdake | is it running ansible-playbook, or is it doing something else? | 02:37 |
*** baoli has quit IRC | 02:40 | |
*** baoli has joined #openstack-infra | 02:40 | |
*** amitgandhinz has joined #openstack-infra | 02:43 | |
*** lifeless has quit IRC | 02:43 | |
*** lifeless has joined #openstack-infra | 02:44 | |
openstackgerrit | Komei Shimamura proposed openstack/requirements: Update global-requirements.txt for python-kafka version https://review.openstack.org/297995 | 02:45 |
*** zeih has joined #openstack-infra | 02:46 | |
sdake | is vexxhost.ca a new hosting provider for our gates? | 02:47 |
sdake | I don't seem to recall seeing it previously | 02:47 |
*** harlowja has joined #openstack-infra | 02:47 | |
*** burgerk has joined #openstack-infra | 02:48 | |
*** armax has joined #openstack-infra | 02:49 | |
clarkb | its about a month old | 02:49 |
sdake | clarkb does that link above look odd to you? | 02:49 |
sdake | its like stuck in ansible or something | 02:50 |
sdake | not really sure what to make of it | 02:50 |
clarkb | maybe ansible is slow? | 02:50 |
sdake | it would have kicked out output by now | 02:50 |
*** zeih has quit IRC | 02:50 | |
sdake | that job takes about 20 seconds to run not 45 minutes | 02:50 |
clarkb | unless something went wrong | 02:50 |
sdake | perhaps the nodepool inf owe use is not the same output a the rest of the gates | 02:51 |
clarkb | not sure what that playbook does | 02:51 |
clarkb | iirc infras use of ansible is all explicit commands to aif debugging and readability | 02:51 |
*** mtanino has joined #openstack-infra | 02:51 | |
*** harlowja has quit IRC | 02:52 | |
sdake | https://github.com/openstack/kolla/blob/master/tools/setup_nodes.yml | 02:52 |
sdake | clarkb if it becomes a problem i'll debug and provide output | 02:53 |
sdake | this is the first time i've seen it thus far | 02:53 |
sdake | and i check every timed out job | 02:53 |
*** kdas_ has quit IRC | 02:54 | |
*** LaT0rtue has quit IRC | 02:54 | |
clarkb | could be ssh could be file copies I dunno impossible to tell | 02:54 |
*** yamahata has joined #openstack-infra | 02:55 | |
*** amitgandhinz has quit IRC | 02:56 | |
clarkb | its possible somethibg disrupted jenkins' connection and jenkins hasnt noticed | 02:56 |
sdake | we use nsible to ssh copy a file the setup script | 02:57 |
sdake | for the distro type | 02:57 |
openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Don't use neutron with centos7-minimal https://review.openstack.org/298503 | 02:57 |
*** _amrith_ is now known as amrith | 02:59 | |
*** zhurong has quit IRC | 02:59 | |
*** binbincong has quit IRC | 02:59 | |
*** baoli has quit IRC | 03:00 | |
*** baoli has joined #openstack-infra | 03:01 | |
*** zhurong has joined #openstack-infra | 03:01 | |
*** IlyaG has joined #openstack-infra | 03:02 | |
*** rlandy has quit IRC | 03:02 | |
*** gildub has quit IRC | 03:03 | |
*** fedexo has joined #openstack-infra | 03:03 | |
*** erlon has quit IRC | 03:07 | |
krotscheck | vexxhost nodes are just... slow, ye? | 03:07 |
clarkb | no they should be roughly on par with the others | 03:09 |
clarkb | there is a spread though | 03:09 |
openstackgerrit | feipeng proposed openstack/requirements: Add crc16 lib to requirments https://review.openstack.org/298485 | 03:10 |
*** tqtran has joined #openstack-infra | 03:13 | |
*** links has joined #openstack-infra | 03:13 | |
*** yamamoto has joined #openstack-infra | 03:14 | |
*** IlyaG has quit IRC | 03:15 | |
*** harlowja_at_home has quit IRC | 03:15 | |
*** Qiming has quit IRC | 03:16 | |
*** Qiming has joined #openstack-infra | 03:17 | |
*** tqtran has quit IRC | 03:17 | |
*** baoli has quit IRC | 03:20 | |
*** rfolco_ has quit IRC | 03:21 | |
*** sbalukoff has joined #openstack-infra | 03:23 | |
*** ddieterly[away] has quit IRC | 03:23 | |
*** kzaitsev_mb has joined #openstack-infra | 03:25 | |
*** harlowja has joined #openstack-infra | 03:29 | |
*** eliqiao has quit IRC | 03:29 | |
*** bpokorny has joined #openstack-infra | 03:29 | |
*** jamesmcarthur has joined #openstack-infra | 03:30 | |
*** kzaitsev_mb has quit IRC | 03:30 | |
openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Enable gate-networking-midonet-v2-rally-dsvm-nv for liberty https://review.openstack.org/298510 | 03:31 |
krotscheck | We just had a build timeout on bindep, and previous runs on vexxhost nodes have been unexpectedly slow. | 03:32 |
krotscheck | http://logs.openstack.org/40/298440/6/check/gate-searchlight-ui-npm-run-test/40d2bd0/console.html | 03:32 |
krotscheck | 40 minutes to run bindep seems wrong | 03:32 |
*** fedexo has quit IRC | 03:34 | |
*** achanda has quit IRC | 03:38 | |
*** tiswanso has quit IRC | 03:40 | |
openstackgerrit | Tony Breeds proposed openstack-infra/elastic-recheck: Add Query for 1563157 https://review.openstack.org/298512 | 03:40 |
Nakato | So, I just fat-fingered a +W button instead of the reply button in gerrit, is there a way to stop the merge? https://review.openstack.org/#/c/296061/ | 03:42 |
Nakato | lifeless: ^ | 03:42 |
*** LaT0rtue has joined #openstack-infra | 03:42 | |
*** jerryz has quit IRC | 03:43 | |
*** armax has quit IRC | 03:44 | |
*** ayoung has quit IRC | 03:46 | |
jeblair | Nakato: just remove the +w vote | 03:47 |
Nakato | jeblair: Thanks. I'll be murdering that button from the UI now. | 03:48 |
*** achanda has joined #openstack-infra | 03:48 | |
*** ramishra has quit IRC | 03:49 | |
jeblair | Clint: in what way does 298389 break gertty? noting that gertty does not display permissions, i see an empty diff, as expected. is there something else wrong, or is it just the lack of permissions display? | 03:49 |
*** zhurong has quit IRC | 03:50 | |
*** Sukhdev has joined #openstack-infra | 03:51 | |
*** ramishra has joined #openstack-infra | 03:51 | |
*** amitgandhinz has joined #openstack-infra | 03:53 | |
*** NobodyCam has quit IRC | 03:54 | |
Clint | jeblair: if i hit 'd' it goes boom with KeyError: "Blob or Tree named 'Unknown File' not found" | 03:58 |
*** asettle has quit IRC | 03:58 | |
jeblair | Clint: git master? | 03:58 |
lifeless | Nakato: yes | 03:59 |
lifeless | Nakato: as jeblair says | 03:59 |
*** thorst has joined #openstack-infra | 04:00 | |
Clint | jeblair: well, apparently not. sorry | 04:00 |
*** roxanaghe has joined #openstack-infra | 04:00 | |
jeblair | Clint: whew; cause that was sounding awful familiar :) | 04:00 |
Clint | \o/ | 04:01 |
Nakato | Button murdered now too. - $('button[title="Apply score with one click"]').remove() | 04:01 |
*** oanson has joined #openstack-infra | 04:02 | |
*** dimtruck is now known as zz_dimtruck | 04:03 | |
*** achanda has quit IRC | 04:04 | |
*** harlowja has quit IRC | 04:06 | |
*** amitgandhinz has quit IRC | 04:06 | |
*** harlowja has joined #openstack-infra | 04:09 | |
*** thorst has quit IRC | 04:09 | |
*** jcooley_ has joined #openstack-infra | 04:11 | |
openstackgerrit | Tony Breeds proposed openstack-infra/devstack-gate: Log locale during setup_host https://review.openstack.org/298521 | 04:11 |
*** LaT0rtue has quit IRC | 04:15 | |
*** jamesmcarthur has quit IRC | 04:15 | |
*** piet has joined #openstack-infra | 04:16 | |
*** IlyaG has joined #openstack-infra | 04:16 | |
*** salv-orlando has joined #openstack-infra | 04:16 | |
*** gildub has joined #openstack-infra | 04:17 | |
*** NobodyCam has joined #openstack-infra | 04:18 | |
*** fawadkhaliq has joined #openstack-infra | 04:20 | |
*** fawadk has joined #openstack-infra | 04:21 | |
openstackgerrit | Craige McWhirter proposed openstack-infra/infra-specs: Updated my IRC nick. https://review.openstack.org/298523 | 04:21 |
*** IlyaG has quit IRC | 04:21 | |
*** fawadkhaliq has quit IRC | 04:25 | |
*** kzaitsev_mb has joined #openstack-infra | 04:26 | |
*** salv-orlando has quit IRC | 04:28 | |
*** akshai_ has quit IRC | 04:29 | |
openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Revert "move fedora23 devstack to experimental" https://review.openstack.org/298525 | 04:30 |
*** maishsk has quit IRC | 04:31 | |
*** kzaitsev_mb has quit IRC | 04:31 | |
*** maishsk has joined #openstack-infra | 04:42 | |
*** abregman has joined #openstack-infra | 04:42 | |
*** LaT0rtue has joined #openstack-infra | 04:42 | |
openstackgerrit | Merged openstack/requirements: Cap Routes < 2.3 https://review.openstack.org/298458 | 04:43 |
*** bpokorny has quit IRC | 04:45 | |
*** mylu has quit IRC | 04:46 | |
*** zeih has joined #openstack-infra | 04:46 | |
*** yamamoto has quit IRC | 04:47 | |
*** mylu has joined #openstack-infra | 04:47 | |
*** vgridnev has joined #openstack-infra | 04:48 | |
*** maishsk has quit IRC | 04:48 | |
*** zeih has quit IRC | 04:52 | |
*** asselin has quit IRC | 04:52 | |
*** fawadk has quit IRC | 05:00 | |
*** roxanaghe has quit IRC | 05:02 | |
*** amitgandhinz has joined #openstack-infra | 05:03 | |
*** mylu has quit IRC | 05:03 | |
*** zhurong has joined #openstack-infra | 05:03 | |
*** roxanaghe has joined #openstack-infra | 05:05 | |
*** thorst has joined #openstack-infra | 05:06 | |
*** pcaruana has quit IRC | 05:09 | |
*** achanda has joined #openstack-infra | 05:12 | |
*** asettle has joined #openstack-infra | 05:12 | |
*** thorst has quit IRC | 05:14 | |
*** LaT0rtue has quit IRC | 05:16 | |
*** amitgandhinz has quit IRC | 05:16 | |
*** Nikolay_St has quit IRC | 05:16 | |
*** yamamoto has joined #openstack-infra | 05:17 | |
*** mylu has joined #openstack-infra | 05:27 | |
*** kzaitsev_mb has joined #openstack-infra | 05:28 | |
*** ybathia has joined #openstack-infra | 05:28 | |
*** baoli has joined #openstack-infra | 05:32 | |
*** piet has quit IRC | 05:32 | |
*** kzaitsev_mb has quit IRC | 05:33 | |
*** roxanaghe has quit IRC | 05:35 | |
*** baoli has quit IRC | 05:36 | |
*** zhurong has quit IRC | 05:38 | |
*** fawadkhaliq has joined #openstack-infra | 05:38 | |
*** asettle has quit IRC | 05:39 | |
*** sputnik13 has joined #openstack-infra | 05:44 | |
*** nadya has joined #openstack-infra | 05:44 | |
*** burgerk has quit IRC | 05:44 | |
*** zhurong has joined #openstack-infra | 05:44 | |
*** burgerk has joined #openstack-infra | 05:44 | |
*** sputnik13 has quit IRC | 05:48 | |
*** zhurong has quit IRC | 05:49 | |
*** ybathia has quit IRC | 05:50 | |
*** sdake_ has joined #openstack-infra | 05:50 | |
*** sdake has quit IRC | 05:52 | |
*** zhurong has joined #openstack-infra | 05:52 | |
*** yamamoto has quit IRC | 05:53 | |
*** Guest79255 has quit IRC | 05:53 | |
*** tphummel has quit IRC | 05:53 | |
*** asettle has joined #openstack-infra | 05:54 | |
*** burgerk_ has joined #openstack-infra | 05:56 | |
*** burgerk has quit IRC | 05:56 | |
openstackgerrit | Merged openstack-infra/project-config: remove sahara-bandit job https://review.openstack.org/297271 | 05:57 |
*** oanson has quit IRC | 05:57 | |
*** Sukhdev has quit IRC | 05:57 | |
*** asettle has quit IRC | 05:59 | |
*** thorst has joined #openstack-infra | 06:01 | |
AJaeger | Nakato: I feel that we should murder that button globally... Patches welcome ;) | 06:04 |
openstackgerrit | Thomas Herve proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config https://review.openstack.org/296061 | 06:05 |
*** zeih has joined #openstack-infra | 06:05 | |
*** yamamoto has joined #openstack-infra | 06:06 | |
*** salv-orlando has joined #openstack-infra | 06:07 | |
*** jaosorior has joined #openstack-infra | 06:08 | |
*** kushal has joined #openstack-infra | 06:08 | |
*** skraynev has quit IRC | 06:08 | |
*** thorst has quit IRC | 06:09 | |
*** skraynev has joined #openstack-infra | 06:09 | |
*** zeih has quit IRC | 06:10 | |
*** mylu has quit IRC | 06:11 | |
*** yolanda has quit IRC | 06:12 | |
*** amitgandhinz has joined #openstack-infra | 06:12 | |
*** cody-somerville has quit IRC | 06:14 | |
*** cody-somerville has joined #openstack-infra | 06:15 | |
*** cody-somerville has quit IRC | 06:15 | |
*** cody-somerville has joined #openstack-infra | 06:15 | |
*** vgridnev has quit IRC | 06:15 | |
*** ramineni has joined #openstack-infra | 06:15 | |
*** burgerk_ has quit IRC | 06:16 | |
*** salv-orlando has quit IRC | 06:16 | |
*** Nikolay_St has joined #openstack-infra | 06:18 | |
*** yolanda has joined #openstack-infra | 06:19 | |
*** tesseract has joined #openstack-infra | 06:19 | |
*** harlowja has quit IRC | 06:19 | |
*** tesseract is now known as Guest58782 | 06:19 | |
*** vgridnev has joined #openstack-infra | 06:20 | |
*** LaT0rtue has joined #openstack-infra | 06:20 | |
*** markvoelker has joined #openstack-infra | 06:22 | |
*** nadya has quit IRC | 06:22 | |
*** markvoelker_ has joined #openstack-infra | 06:23 | |
*** skraynev has quit IRC | 06:26 | |
*** amitgandhinz has quit IRC | 06:26 | |
*** vgridnev has quit IRC | 06:26 | |
*** vgridnev has joined #openstack-infra | 06:27 | |
*** skraynev has joined #openstack-infra | 06:27 | |
*** markvoelker has quit IRC | 06:27 | |
*** MarkAtwood has joined #openstack-infra | 06:27 | |
*** kzaitsev_mb has joined #openstack-infra | 06:29 | |
*** maishsk has joined #openstack-infra | 06:30 | |
*** binbincong has joined #openstack-infra | 06:30 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/298548 | 06:31 |
*** zhurong has quit IRC | 06:31 | |
*** harlowja has joined #openstack-infra | 06:32 | |
yolanda | good morning, back from holiday | 06:34 |
*** zhurong has joined #openstack-infra | 06:34 | |
*** kzaitsev_mb has quit IRC | 06:34 | |
AJaeger | yolanda: good morning. HAve you had a great holiday? | 06:35 |
yolanda | AJaeger, yest, mostly at home but is always great to spend time with the family. How about you? | 06:36 |
openstackgerrit | Thomas Herve proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config https://review.openstack.org/296061 | 06:36 |
*** roxanaghe has joined #openstack-infra | 06:36 | |
*** scheuran has joined #openstack-infra | 06:38 | |
AJaeger | yolanda: similar to yours ;) | 06:39 |
AJaeger | together with some unexpected sunshine it was great ;) | 06:40 |
yolanda | it was a bit rainy here yesterday | 06:41 |
*** roxanaghe has quit IRC | 06:41 | |
*** nmagnezi has joined #openstack-infra | 06:43 | |
*** markvoelker_ has quit IRC | 06:43 | |
*** markvoelker has joined #openstack-infra | 06:44 | |
*** lmiccini has quit IRC | 06:46 | |
*** cgross- has quit IRC | 06:46 | |
*** mkoderer has quit IRC | 06:46 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/288849 | 06:46 |
*** cgross has joined #openstack-infra | 06:48 | |
*** mkoderer has joined #openstack-infra | 06:49 | |
*** fawadkhaliq has quit IRC | 06:49 | |
*** jtomasek has joined #openstack-infra | 06:50 | |
*** lmiccini has joined #openstack-infra | 06:50 | |
*** flepied has joined #openstack-infra | 06:51 | |
ramineni | yolanda: could you please review https://review.openstack.org/#/c/296380/ | 06:51 |
ramineni | yolanda: its needed by a patch which should go to mitaka, so it would be great if you could have alook at it | 06:52 |
yolanda | hi ramineni . Yes, i'll start with the review queue in a while | 06:52 |
ramineni | yolanda: sure, thanks a lot | 06:52 |
*** LaT0rtue has quit IRC | 06:53 | |
*** GheRiver1 has quit IRC | 06:55 | |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/298548 | 06:55 |
openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Allow to pass TEMPEST_OS_TEST_TIMEOUT from the job https://review.openstack.org/298446 | 06:56 |
*** GheRiver1 has joined #openstack-infra | 06:57 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Set ZUUL_REFNAME for propose-devstack-plugins https://review.openstack.org/298564 | 06:59 |
*** gnuoy_ has joined #openstack-infra | 06:59 | |
AJaeger | yolanda: the change above is needed to fix the job - and is related to https://review.openstack.org/#/c/287415 . Reviews are welcome but not urgent ;) Thanks! | 06:59 |
*** arxcruz has joined #openstack-infra | 07:01 | |
*** GheRivero has quit IRC | 07:03 | |
*** GheRiver1 is now known as GheRivero | 07:05 | |
*** LaT0rtue has joined #openstack-infra | 07:06 | |
*** thorst has joined #openstack-infra | 07:06 | |
*** GheRivero has quit IRC | 07:06 | |
openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Increase OS_TEST_TIMEOUT for ironic-multitenant https://review.openstack.org/298569 | 07:06 |
openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Increase OS_TEST_TIMEOUT for ironic-multitenant https://review.openstack.org/298569 | 07:07 |
*** Hal has joined #openstack-infra | 07:07 | |
*** GheRivero has joined #openstack-infra | 07:07 | |
*** Hal is now known as Guest38332 | 07:07 | |
*** dtardivel has joined #openstack-infra | 07:08 | |
*** gnuoy_ has quit IRC | 07:09 | |
*** samuelBartel has joined #openstack-infra | 07:10 | |
*** eliqiao has joined #openstack-infra | 07:12 | |
*** mrmartin has joined #openstack-infra | 07:12 | |
*** markvoelker has quit IRC | 07:12 | |
*** vgridnev has quit IRC | 07:13 | |
*** thorst has quit IRC | 07:13 | |
*** tqtran has joined #openstack-infra | 07:14 | |
*** shardy has joined #openstack-infra | 07:14 | |
*** vgridnev has joined #openstack-infra | 07:18 | |
*** tqtran has quit IRC | 07:18 | |
*** maishsk has quit IRC | 07:19 | |
*** jordanP has joined #openstack-infra | 07:21 | |
openstackgerrit | Merged openstack-infra/infra-manual: Document other-requirements https://review.openstack.org/298281 | 07:22 |
*** amitgandhinz has joined #openstack-infra | 07:22 | |
*** GheRivero has quit IRC | 07:22 | |
*** sdake_ has quit IRC | 07:22 | |
*** esikachev has joined #openstack-infra | 07:23 | |
*** sputnik13 has joined #openstack-infra | 07:24 | |
*** sshnaidm has quit IRC | 07:25 | |
*** sdake has joined #openstack-infra | 07:25 | |
*** salv-orlando has joined #openstack-infra | 07:25 | |
openstackgerrit | Merged openstack-infra/project-config: Enable Murano service as part of congress job https://review.openstack.org/296380 | 07:25 |
*** sputnik13_ has joined #openstack-infra | 07:27 | |
*** jlanoux has joined #openstack-infra | 07:28 | |
openstackgerrit | Merged openstack-infra/project-config: Update build-image.sh for new images, add EXTRA_ELEMENTS https://review.openstack.org/298463 | 07:29 |
*** GheRivero has joined #openstack-infra | 07:30 | |
openstackgerrit | Merged openstack-infra/project-config: [new project] Create a OpenStack related project "daisycloud-core" https://review.openstack.org/296117 | 07:30 |
*** kzaitsev_mb has joined #openstack-infra | 07:31 | |
*** maishsk has joined #openstack-infra | 07:31 | |
*** amitgandhinz has quit IRC | 07:36 | |
*** kzaitsev_mb has quit IRC | 07:36 | |
*** dmellado|off is now known as dmellado | 07:36 | |
*** rcernin has joined #openstack-infra | 07:36 | |
openstackgerrit | Merged openstack-infra/system-config: Remove unused nspr dependency https://review.openstack.org/298319 | 07:37 |
*** zhurong has quit IRC | 07:37 | |
*** yuanying has quit IRC | 07:38 | |
*** zhurong has joined #openstack-infra | 07:38 | |
*** achanda has quit IRC | 07:39 | |
openstackgerrit | Merged openstack-infra/puppet-jenkins: Add support for ubuntu xenial https://review.openstack.org/297974 | 07:39 |
openstackgerrit | Merged openstack-infra/system-config: Remove old pypi vhost template https://review.openstack.org/297224 | 07:39 |
*** LaT0rtue has quit IRC | 07:39 | |
*** yuanying has joined #openstack-infra | 07:41 | |
*** camunoz has quit IRC | 07:41 | |
*** matrohon has joined #openstack-infra | 07:43 | |
*** lezbar has joined #openstack-infra | 07:43 | |
*** achanda has joined #openstack-infra | 07:44 | |
*** ifarkas has joined #openstack-infra | 07:46 | |
*** sputnik13net has joined #openstack-infra | 07:46 | |
*** bauwser is now known as bauzas | 07:47 | |
cody-somerville | jeblair: mordred: clarkb: Apparently git now supports cloning using rsync. Is that something that would be useful to us? | 07:47 |
*** _degorenko|afk is now known as degorenko | 07:48 | |
*** pcaruana has joined #openstack-infra | 07:48 | |
*** GheRivero has quit IRC | 07:49 | |
*** GheRivero has joined #openstack-infra | 07:49 | |
*** daemontool has joined #openstack-infra | 07:50 | |
*** sputnik13 has quit IRC | 07:50 | |
AJaeger | yolanda: please review also https://review.openstack.org/#/c/298307/ | 07:52 |
AJaeger | And thanks a lot for going throught all these! | 07:53 |
*** zeih has joined #openstack-infra | 07:54 | |
yolanda | sure, no problme | 07:55 |
*** gnuoy_ has joined #openstack-infra | 07:57 | |
openstackgerrit | Merged openstack-infra/shade: Support InsecureRequestWarning == None https://review.openstack.org/297791 | 07:57 |
*** GheRivero has quit IRC | 07:57 | |
*** gnuoy__ has joined #openstack-infra | 07:57 | |
*** GheRivero has joined #openstack-infra | 07:57 | |
jd__ | AJaeger: turns out that sbcl is now too old I guess for cl-openstack-client to work, we'll have to wait for the new LTS probably with a new sbcl that brings ASDF 3 | 07:57 |
*** daemontool_ has joined #openstack-infra | 07:58 | |
AJaeger | jd__: so, should I remove my depends-on on https://review.openstack.org/#/c/298229/ ? And leave https://review.openstack.org/#/c/298226/ open? | 08:00 |
AJaeger | jd__: I don't want to install sbcl on each and every job like we do right now... | 08:01 |
*** daemontool has quit IRC | 08:02 | |
*** gnuoy_ has quit IRC | 08:02 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove sbcl from bindep-fallback.txt https://review.openstack.org/298229 | 08:03 |
AJaeger | jd__: removed depends on ^, a +1 from you would be appreciated. | 08:03 |
*** gnuoy__ has quit IRC | 08:03 | |
openstackgerrit | Merged openstack-infra/system-config: Add support for Ubuntu Xenial https://review.openstack.org/297964 | 08:03 |
sputnik13_ | anyone having issues with diskimage-builder generated images? I'm trying to generate a fresh ubuntu image and it keeps dropping in to grub rather than booting | 08:04 |
sputnik13_ | just running disk-image-create vm ubuntu | 08:04 |
*** achanda has quit IRC | 08:06 | |
*** akaszuba has joined #openstack-infra | 08:07 | |
openstackgerrit | Merged openstack-infra/project-config: Set ZUUL_REFNAME for propose-devstack-plugins https://review.openstack.org/298564 | 08:07 |
*** achanda has joined #openstack-infra | 08:07 | |
openstackgerrit | Merged openstack-infra/project-config: Make gate-sahara-tests-python34 job voting https://review.openstack.org/298304 | 08:08 |
openstackgerrit | Merged openstack-infra/project-config: Set gate-bindep-fallback-debian-jessie voting https://review.openstack.org/297980 | 08:08 |
anteaya | yolanda: for the infra meeting today, do you feel like adding an agenda item to update folks on your progress with the new gerrit node? | 08:08 |
openstackgerrit | Merged openstack-infra/project-config: Remove libnspr4-dev and nspr-devel https://review.openstack.org/298321 | 08:09 |
yolanda | anteaya, so i have no progress on it, because i was told nothing was needed. The node is created, puppet running, but everything is disabled until the migration date | 08:09 |
openstackgerrit | Merged openstack-infra/project-config: Move `keystone-coverage-db` job to check queue https://review.openstack.org/297351 | 08:09 |
anteaya | yolanda: okay great, so is that no, you don't want to add an item? | 08:09 |
anteaya | because April 11th is coming up and someone has to have some sort of plan for the migration | 08:09 |
*** LaT0rtue has joined #openstack-infra | 08:10 | |
anteaya | so if that isn't you, and it doesn't have to be, I'd like to know who it is | 08:10 |
*** nadya has joined #openstack-infra | 08:10 | |
yolanda | ok what i can do is add that item, and confirm that the intention is to do the volume change, start gerrit, etc... on the same maintenance day | 08:10 |
anteaya | great thank you | 08:10 |
AJaeger | yolanda: and then discuss open points. | 08:10 |
AJaeger | thanks! | 08:10 |
*** thorst has joined #openstack-infra | 08:11 | |
*** derekh has joined #openstack-infra | 08:11 | |
*** kzaitsev_mb has joined #openstack-infra | 08:11 | |
yolanda | np | 08:12 |
*** markvoelker has joined #openstack-infra | 08:13 | |
openstackgerrit | Merged openstack-infra/project-config: Remove experimental-openstackci-beaker-ubuntu-trusty https://review.openstack.org/297431 | 08:14 |
*** tojuvone has quit IRC | 08:15 | |
anteaya | going offline again, talk to you later | 08:15 |
yolanda | anteaya, bye | 08:15 |
*** tojuvone has joined #openstack-infra | 08:15 | |
jd__ | AJaeger: yep, looks good | 08:15 |
jd__ | AJaeger: it'll merge… at some points when sbcl can be updated I guess :] | 08:16 |
jd__ | it's not like the project is uber-active anyway | 08:16 |
*** dizquierdo has joined #openstack-infra | 08:16 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Run bindep on project-config only if needed https://review.openstack.org/297809 | 08:16 |
*** achanda has quit IRC | 08:16 | |
*** kzaitsev_mb has quit IRC | 08:17 | |
AJaeger | thanks, jd__ . Could you +1 https://review.openstack.org/#/c/298229/ as well, please? | 08:17 |
*** markvoelker has quit IRC | 08:17 | |
AJaeger | anteaya: good night! | 08:17 |
AJaeger | anteaya: hope your flooding is under control again! | 08:18 |
*** thorst has quit IRC | 08:18 | |
*** snikitin has joined #openstack-infra | 08:21 | |
*** rossella_s has joined #openstack-infra | 08:21 | |
*** hashar has joined #openstack-infra | 08:22 | |
openstackgerrit | Merged openstack-infra/project-config: Add experimental centos-7 to windmill https://review.openstack.org/297800 | 08:22 |
*** elo has quit IRC | 08:23 | |
*** elo has joined #openstack-infra | 08:23 | |
*** jistr has joined #openstack-infra | 08:23 | |
*** YorikSar_ is now known as YorikSar | 08:23 | |
*** ogelbukh_ is now known as ogelbukh | 08:24 | |
*** mtanino has quit IRC | 08:24 | |
*** roxanaghe has joined #openstack-infra | 08:24 | |
*** mtanino has joined #openstack-infra | 08:25 | |
snikitin | etoews: Hi, Everett! Can I ask you to review this API-WG patch? https://review.openstack.org/#/c/276709/ It has a lot of +1 (even from Michael McCune) but it's not approved yet :( | 08:25 |
*** pc_m has quit IRC | 08:25 | |
jtomasek | Hi, can anyone please help with the phantomjs issue we're hitting here https://review.openstack.org/#/c/295882/ ? | 08:25 |
openstackgerrit | Merged openstack-infra/project-config: set stable/mitaka permissions for senlin projects https://review.openstack.org/297721 | 08:25 |
openstackgerrit | Merged openstack-infra/project-config: remove pypi publishing jobs for cloudkitty https://review.openstack.org/298307 | 08:25 |
*** dims has quit IRC | 08:26 | |
jtomasek | the error is here: http://logs.openstack.org/82/295882/1/check/gate-tripleo-ui-npm-run-test/ad951b5/console.html.gz#_2016-03-24_14_47_34_406 | 08:26 |
jtomasek | it seems like this issue: https://github.com/Medium/phantomjs/issues/430#issuecomment-167747026 | 08:26 |
*** asettle has joined #openstack-infra | 08:26 | |
*** nijaba has quit IRC | 08:26 | |
*** pc_m has joined #openstack-infra | 08:26 | |
*** tojuvone has quit IRC | 08:27 | |
*** nijaba has joined #openstack-infra | 08:27 | |
*** tojuvone has joined #openstack-infra | 08:27 | |
*** yamahata has quit IRC | 08:27 | |
*** dkehn has quit IRC | 08:27 | |
*** dkehn has joined #openstack-infra | 08:28 | |
mrmartin | hi | 08:28 |
*** yamahata has joined #openstack-infra | 08:28 | |
mrmartin | yolanda, you need to approve this one also: https://review.openstack.org/#/c/295208/ to make this work: https://review.openstack.org/#/c/295231/ | 08:29 |
*** roxanaghe has quit IRC | 08:29 | |
yolanda | oh, this only has my +2 | 08:29 |
AJaeger | yolanda: what do you think of https://review.openstack.org/274701 ? That is too late for translators for mitaka but would be great to have in to get it up soonish so that they can use it. | 08:29 |
yolanda | mrmatin, it will need to wait then | 08:29 |
AJaeger | mrmartin: Good morning! does that mean we do not use php5-cli anymore? | 08:30 |
yolanda | AJaeger i was just looking at it now,i defered to the last because it was complex | 08:30 |
AJaeger | yolanda: ;) Thanks! | 08:30 |
mrmartin | AJaeger: I think both groups.o.o and openstackid is using php5-cli | 08:31 |
mrmartin | and openstackid also needs php5-mcrypt | 08:31 |
*** salv-orlando has quit IRC | 08:31 | |
*** dims has joined #openstack-infra | 08:31 | |
mrmartin | so we are using it | 08:31 |
AJaeger | mrmartin: the question is: For running or for testing with Jenkins? | 08:32 |
mrmartin | for building the dist tarballs | 08:32 |
*** amitgandhinz has joined #openstack-infra | 08:32 | |
mrmartin | groups is using drush, and openstackid is using composer, both tool depends on php5-cli | 08:33 |
*** tojuvone has quit IRC | 08:33 | |
*** tojuvone has joined #openstack-infra | 08:33 | |
*** maishsk has quit IRC | 08:34 | |
AJaeger | strange, gate-openstackid-unittests does not install php5-cli currently | 08:34 |
AJaeger | mrmartin: I'll -1 now https://review.openstack.org/#/c/298407/ - and let's work on getting this solved properly. | 08:34 |
*** lyz has quit IRC | 08:35 | |
*** lyz has joined #openstack-infra | 08:35 | |
mrmartin | ok. | 08:35 |
AJaeger | mrmartin: thanks for that extra information! | 08:35 |
*** tojuvone has quit IRC | 08:36 | |
*** tojuvone has joined #openstack-infra | 08:36 | |
*** maishsk has joined #openstack-infra | 08:37 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/groups: Add other-requirements.txt https://review.openstack.org/298600 | 08:41 |
AJaeger | mrmartin: here's a very minimal file ^, let's see whether the tests work ;) | 08:41 |
*** daemontool_ has quit IRC | 08:43 | |
*** LaT0rtue has quit IRC | 08:43 | |
*** daemontool_ has joined #openstack-infra | 08:43 | |
*** sshnaidm has joined #openstack-infra | 08:45 | |
openstackgerrit | Merged openstack-infra/project-config: Add octavia experimental tempest job https://review.openstack.org/284875 | 08:45 |
*** kzaitsev_mb has joined #openstack-infra | 08:45 | |
*** IlyaG has joined #openstack-infra | 08:46 | |
*** amitgandhinz has quit IRC | 08:46 | |
*** IlyaG has quit IRC | 08:50 | |
*** LaT0rtue has joined #openstack-infra | 08:52 | |
*** sambetts has quit IRC | 08:55 | |
*** sputnik13_ has quit IRC | 08:55 | |
matrohon | yolanda, hi | 08:55 |
*** sputnik13 has joined #openstack-infra | 08:55 | |
matrohon | yolanda, whose approval from neutron do you need for https://review.openstack.org/#/c/258522/4? | 08:56 |
*** sputnik13 has quit IRC | 08:56 | |
rcarrillocruz | matrohon: https://wiki.openstack.org/wiki/CrossProjectLiaisons | 08:57 |
yolanda | what rcarrillocruz said ^ | 08:57 |
matrohon | yolanda, rcarrillocruz : ok thanks. net-bgpvpn is a release-independent project, so I'm not sure that ihrachyshka will be able to vouch for this change | 08:59 |
rcarrillocruz | matrohon: you want to check this section instead | 08:59 |
rcarrillocruz | https://wiki.openstack.org/wiki/CrossProjectLiaisons#Infra | 08:59 |
rcarrillocruz | ihar is on oslo section | 09:00 |
matrohon | rcarrillocruz, yep, I meant mestery, armax or dougwig | 09:00 |
matrohon | rcarrillocruz, sorry :) | 09:00 |
rcarrillocruz | np | 09:00 |
matrohon | rcarrillocruz, yolanda, I'll ping them when they'll be awake | 09:01 |
yolanda | matrohon, i normally wait for that +1 from neutron liaisons for all networking projects | 09:01 |
matrohon | yolanda, ack | 09:01 |
yolanda | yours is not related to neutron? | 09:01 |
*** tojuvone has quit IRC | 09:02 | |
matrohon | yolanda, it's in the neutron stadium, under the governance of neutron's PTL, but none of the neutron core are part of net-bgpvpn... | 09:03 |
*** tojuvone has joined #openstack-infra | 09:03 | |
yolanda | if it's under governance of neutron, we need to wait for that +1 | 09:03 |
*** tojuvone has quit IRC | 09:03 | |
matrohon | yolanda, ack, np | 09:03 |
*** tojuvone has joined #openstack-infra | 09:03 | |
*** zhurong has quit IRC | 09:06 | |
*** tosky has joined #openstack-infra | 09:06 | |
*** tojuvone has quit IRC | 09:07 | |
*** tojuvone has joined #openstack-infra | 09:07 | |
*** sileht has quit IRC | 09:07 | |
*** rm_work has quit IRC | 09:08 | |
*** mgagne has quit IRC | 09:08 | |
*** khappone_ has joined #openstack-infra | 09:09 | |
AJaeger | matrohon: We have a very simple rule - if it's under governance of neutron's PTL, it needs neutron infra liason +1 - as requested by the neutron PTL for all such changes. | 09:09 |
*** jbryce has quit IRC | 09:10 | |
*** dtroyer has quit IRC | 09:10 | |
vgridnev | Hi, folks. Is there something that should be done so that "Closes-bug" statement will take affect for fix in particular project? | 09:11 |
*** mjb has quit IRC | 09:11 | |
*** khappone has quit IRC | 09:11 | |
*** comstud has quit IRC | 09:11 | |
*** greghaynes has quit IRC | 09:12 | |
vgridnev | We have some issues with sahara-tests repo and appropriate launchpad project associated with that | 09:12 |
AJaeger | vgridnev: your project needs to be setup correctly ;) | 09:12 |
*** sileht has joined #openstack-infra | 09:12 | |
AJaeger | vgridnev: show me a bug URL and a patch and then I'll double check | 09:12 |
vgridnev | 1 min | 09:12 |
openstackgerrit | Merged openstack-infra/release-tools: improve check_library_constraints.sh to edit the constraints file https://review.openstack.org/298398 | 09:13 |
vgridnev | for example: https://review.openstack.org/#/c/297757/ and https://bugs.launchpad.net/sahara-tests/+bug/1558994 | 09:13 |
openstack | Launchpad bug 1558994 in OpenStack Data Processing ("Sahara") sahara-tests "Default variables for edp.yaml and credentials.yaml not applied" [Undecided,In progress] - Assigned to Evgeny Sikachev (esikachev) | 09:13 |
vgridnev | AJaeger, ^^ | 09:13 |
*** jbryce has joined #openstack-infra | 09:13 | |
*** dtroyer has joined #openstack-infra | 09:13 | |
*** comstud has joined #openstack-infra | 09:13 | |
*** rm_work has joined #openstack-infra | 09:13 | |
*** mjb has joined #openstack-infra | 09:14 | |
*** mgagne has joined #openstack-infra | 09:14 | |
*** mgagne is now known as Guest68910 | 09:14 | |
AJaeger | vgridnev: ah, that alone is enough information ;) | 09:14 |
*** greghaynes has joined #openstack-infra | 09:14 | |
AJaeger | vgridnev: you configured in http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/projects.yaml#n3391 with the groups line that bugs are in bugs.launchpad.net/sahara/ not in sahara-tests | 09:14 |
*** tojuvone has quit IRC | 09:15 | |
AJaeger | And so sahara-tests changes only close bugs reported agains "sahara" project | 09:15 |
*** tojuvone has joined #openstack-infra | 09:15 | |
vgridnev | cool, I've got it | 09:15 |
vgridnev | Thanks! | 09:15 |
AJaeger | vgridnev: so, consider what you as team want and change either launchpad setup or the setting in project-config | 09:16 |
*** thorst has joined #openstack-infra | 09:16 | |
*** achanda has joined #openstack-infra | 09:17 | |
*** e0ne has joined #openstack-infra | 09:18 | |
*** tojuvone has quit IRC | 09:18 | |
*** tojuvone has joined #openstack-infra | 09:18 | |
openstackgerrit | Koteswara Rao Kelam proposed openstack-infra/project-config: Adding networking-hpe project. https://review.openstack.org/295775 | 09:20 |
openstackgerrit | Evgeny Sikachev proposed openstack-infra/project-config: Add sahara-tests to sahara-tests group https://review.openstack.org/298614 | 09:20 |
esikachev | AJaeger: ^^ | 09:20 |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Change gerrit acl for shotgun project https://review.openstack.org/298615 | 09:20 |
*** salv-orlando has joined #openstack-infra | 09:20 | |
openstackgerrit | Markus Zoeller (markus_z) proposed openstack-infra/project-config: Add job to test Nova with specific libvirt and kvm packages https://review.openstack.org/289255 | 09:21 |
*** tojuvone has quit IRC | 09:21 | |
*** achanda has quit IRC | 09:21 | |
*** tojuvone has joined #openstack-infra | 09:21 | |
*** thorst has quit IRC | 09:24 | |
*** asettle has quit IRC | 09:27 | |
*** dtantsur|afk is now known as dtantsur | 09:29 | |
*** zeih has quit IRC | 09:30 | |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Change gerrit acl for shotgun project https://review.openstack.org/298615 | 09:34 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: ssh less https://review.openstack.org/295973 | 09:35 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Don't execute the output from wait_for https://review.openstack.org/295297 | 09:37 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add support for mitaka jobs https://review.openstack.org/298370 | 09:38 |
*** lifeless has quit IRC | 09:39 | |
*** lifeless has joined #openstack-infra | 09:40 | |
openstackgerrit | Koteswara Rao Kelam proposed openstack-infra/project-config: Adding networking-hpe project. https://review.openstack.org/295775 | 09:41 |
*** amitgandhinz has joined #openstack-infra | 09:42 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 09:43 |
*** tojuvone has quit IRC | 09:43 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/system-config: Do not install sbcl https://review.openstack.org/298627 | 09:43 |
*** tojuvone has joined #openstack-infra | 09:43 | |
*** Liuqing has quit IRC | 09:47 | |
*** zeih has joined #openstack-infra | 09:50 | |
*** kushal has quit IRC | 09:52 | |
*** asettle has joined #openstack-infra | 09:52 | |
openstackgerrit | Merged openstack-infra/project-config: Add sahara-tests to sahara-tests group https://review.openstack.org/298614 | 09:53 |
*** oanson has joined #openstack-infra | 09:54 | |
*** daemontool_ has quit IRC | 09:55 | |
*** tojuvone has quit IRC | 09:55 | |
*** daemontool_ has joined #openstack-infra | 09:55 | |
*** amitgandhinz has quit IRC | 09:56 | |
*** tojuvone has joined #openstack-infra | 09:56 | |
*** daemontool_ has quit IRC | 09:56 | |
*** daemontool_ has joined #openstack-infra | 09:56 | |
*** tojuvone has quit IRC | 09:57 | |
*** asettle has quit IRC | 09:57 | |
*** tojuvone has joined #openstack-infra | 09:57 | |
*** salv-orlando has quit IRC | 09:57 | |
*** cdent has joined #openstack-infra | 09:57 | |
*** gildub has quit IRC | 09:58 | |
*** LaT0rtue has quit IRC | 09:58 | |
*** tojuvone has quit IRC | 09:58 | |
*** tojuvone has joined #openstack-infra | 09:58 | |
*** hichihara has quit IRC | 10:04 | |
*** yamada-h has joined #openstack-infra | 10:06 | |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 10:08 |
*** salv-orlando has joined #openstack-infra | 10:10 | |
*** sdake has quit IRC | 10:10 | |
kozhukalov | AJaeger: when you said "And I suggest to change the order of the depends-on" in this review https://review.openstack.org/#/c/298615, did you mean that in governance patch it should be 'needed-by' tag and in infra patch it should 'depends-on'? | 10:11 |
*** placko has joined #openstack-infra | 10:12 | |
*** roxanaghe has joined #openstack-infra | 10:12 | |
*** pblaho has joined #openstack-infra | 10:14 | |
trash | SpamapS: hi, again for https://review.openstack.org/#/c/280178/13 - the current version does not work at all - can you verify that? I can reproduce the error locally. | 10:14 |
*** markvoelker has joined #openstack-infra | 10:14 | |
*** tqtran has joined #openstack-infra | 10:15 | |
*** roxanaghe has quit IRC | 10:17 | |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 10:18 |
*** tqtran has quit IRC | 10:20 | |
*** markvoelker has quit IRC | 10:20 | |
*** thorst has joined #openstack-infra | 10:21 | |
*** Qiming has quit IRC | 10:24 | |
*** eliqiao_ has joined #openstack-infra | 10:24 | |
*** tojuvone has quit IRC | 10:26 | |
*** tojuvone has joined #openstack-infra | 10:27 | |
*** Liuqing has joined #openstack-infra | 10:27 | |
*** eliqiao has quit IRC | 10:27 | |
*** thorst has quit IRC | 10:29 | |
*** esikachev has quit IRC | 10:30 | |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 10:31 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: (WIP) Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 10:31 |
AJaeger | kozhukalov: correct | 10:32 |
kozhukalov | AJaeger: thanks, will update | 10:32 |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 10:35 |
*** tojuvone has quit IRC | 10:36 | |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 network isolation on the ha job https://review.openstack.org/289445 | 10:36 |
*** tojuvone has joined #openstack-infra | 10:36 | |
*** flaper87 has quit IRC | 10:36 | |
*** flaper87 has joined #openstack-infra | 10:36 | |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 10:36 |
*** sputnik13net has quit IRC | 10:41 | |
*** LaT0rtue has joined #openstack-infra | 10:44 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/project-config: Re-activate Ubuntu beaker for puppet-pacemaker. https://review.openstack.org/298650 | 10:45 |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 and pacemaker on the upgrades job https://review.openstack.org/289445 | 10:46 |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 10:47 |
openstackgerrit | Sergey Kraynev proposed openstack/requirements: Bump up upper-constraint for heatclient https://review.openstack.org/298655 | 10:48 |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 10:49 |
*** achanda has joined #openstack-infra | 10:50 | |
*** amitgandhinz has joined #openstack-infra | 10:52 | |
*** ihrachys has joined #openstack-infra | 10:53 | |
*** mescanef has joined #openstack-infra | 10:53 | |
*** tojuvone has quit IRC | 10:53 | |
*** tojuvone has joined #openstack-infra | 10:53 | |
*** kushal has joined #openstack-infra | 10:54 | |
*** yamamoto has quit IRC | 10:54 | |
*** achanda has quit IRC | 10:55 | |
*** yamamoto has joined #openstack-infra | 10:55 | |
*** Liuqing has quit IRC | 10:56 | |
*** asettle has joined #openstack-infra | 10:56 | |
*** asettle has quit IRC | 10:56 | |
*** nadya has quit IRC | 10:56 | |
*** ociuhandu has quit IRC | 10:57 | |
*** esikachev has joined #openstack-infra | 10:57 | |
*** tojuvone has quit IRC | 10:58 | |
*** tojuvone has joined #openstack-infra | 10:58 | |
*** skraynev has quit IRC | 10:59 | |
*** lucasagomes is now known as lucas-hungry | 11:00 | |
*** skraynev has joined #openstack-infra | 11:01 | |
*** amitgandhinz has quit IRC | 11:05 | |
*** yamamoto has quit IRC | 11:07 | |
*** yamada-h has quit IRC | 11:07 | |
*** tojuvone has quit IRC | 11:07 | |
*** tojuvone has joined #openstack-infra | 11:07 | |
*** jcooley_ has quit IRC | 11:08 | |
*** sdague has joined #openstack-infra | 11:12 | |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: (WIP) Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 11:13 |
*** zeih has quit IRC | 11:15 | |
*** markvoelker has joined #openstack-infra | 11:16 | |
*** yamamoto has joined #openstack-infra | 11:18 | |
*** Qiming has joined #openstack-infra | 11:18 | |
*** markvoelker has quit IRC | 11:21 | |
*** |-paul-| has joined #openstack-infra | 11:22 | |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 11:23 |
*** yamamoto has quit IRC | 11:23 | |
kozhukalov | AJaeger: seems it does not work this way. once I put 'depends-on' tag to the infra patch, i immediately get 'Verified | 11:26 |
kozhukalov | -1 Jenkins' | 11:26 |
*** tpsilva has joined #openstack-infra | 11:26 | |
*** ociuhandu has joined #openstack-infra | 11:26 | |
openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 11:27 |
AJaeger | kozhukalov: wait until the governance change has been submitted and recheck after 2 mins... | 11:27 |
AJaeger | kozhukalov: let me check... | 11:28 |
AJaeger | kozhukalov: patch set 8 succeeded... | 11:28 |
kozhukalov | AJaeger: yes, but that was without tags at all | 11:29 |
AJaeger | kozhukalov: let me edit and double check... | 11:29 |
kozhukalov | AJaeger: i removed tags in both patches, then waited until they are green, then put 'depends-on' tag into infra patch and got '-1' from jenkins | 11:29 |
AJaeger | kozhukalov: governance change has a depends-on, it needs to be needed-by on that one | 11:30 |
AJaeger | kozhukalov: strange, let me try to reproduce... | 11:30 |
*** gordc has joined #openstack-infra | 11:30 | |
kozhukalov | AJaeger: i added this depends-on tag to governance patch just 1 min ago, it was after i got '-1' | 11:30 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 11:31 |
*** kushal has quit IRC | 11:31 | |
*** smarcet has joined #openstack-infra | 11:32 | |
*** dprince has joined #openstack-infra | 11:32 | |
AJaeger | kozhukalov: 298615,11 is currently building - see status.openstack.org/zuul Let's wait for it to finish... | 11:33 |
AJaeger | kozhukalov: this looks all fine right now AFAIU | 11:33 |
kozhukalov | AJaeger: ok, let's wait, but i see -1 from jenkins there | 11:34 |
*** kushal has joined #openstack-infra | 11:35 | |
*** Liuqing has joined #openstack-infra | 11:35 | |
kozhukalov | AJaeger: is it going to become +1 once tests have successfully passed? | 11:35 |
AJaeger | kozhukalov: I hope ;) | 11:36 |
*** yamada-h has joined #openstack-infra | 11:38 | |
*** sc68cal has joined #openstack-infra | 11:41 | |
*** nadya has joined #openstack-infra | 11:41 | |
frickler | did anything change regarding the log-publisher target recently? it worked here http://logs.openstack.org/39/291939/47/check/gate-ubuntu-trusty-openstack-chef-repo-chef-rake-integration-nv/9e3d032/ and failed a couple of hours later http://logs.openstack.org/39/291939/49/check/gate-ubuntu-trusty-openstack-chef-repo-chef-rake-integration-nv/1769625/ and has stayed in the latter state since then | 11:42 |
*** asselin has joined #openstack-infra | 11:42 | |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: (WIP) Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 11:42 |
*** yamada-h has quit IRC | 11:42 | |
AJaeger | kozhukalov: I think the -1 came from a previous edit of yours and was copied over. Now it'S a +1 and everything fine... | 11:42 |
*** huzhj_ has joined #openstack-infra | 11:43 | |
*** thorst has joined #openstack-infra | 11:44 | |
*** thorst has quit IRC | 11:45 | |
*** thorst has joined #openstack-infra | 11:45 | |
*** tojuvone has quit IRC | 11:47 | |
*** tojuvone has joined #openstack-infra | 11:47 | |
jroll | mordred: could you recommend a public cloud that is somewhat inexpensive, easy to sign up for, and accepts qcow2 images? :) | 11:48 |
*** thorst has quit IRC | 11:51 | |
*** ldnunes has joined #openstack-infra | 11:52 | |
*** mrmartin has quit IRC | 11:52 | |
openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Allow to pass TEMPEST_OS_TEST_TIMEOUT from the job https://review.openstack.org/298446 | 11:53 |
*** weshay has joined #openstack-infra | 11:53 | |
*** burgerk_ has joined #openstack-infra | 11:54 | |
*** ddieterly has joined #openstack-infra | 11:55 | |
*** flepied has quit IRC | 11:55 | |
*** asettle has joined #openstack-infra | 11:56 | |
openstackgerrit | Koteswara Rao Kelam proposed openstack-infra/project-config: Adding networking-hpe project. https://review.openstack.org/295775 | 11:56 |
openstackgerrit | James Slagle proposed openstack-infra/project-config: Add a periodic mitaka job for TripleO https://review.openstack.org/298369 | 11:59 |
*** bdemers has quit IRC | 12:00 | |
*** vikram_ has joined #openstack-infra | 12:00 | |
*** thorst has joined #openstack-infra | 12:01 | |
*** roxanaghe has joined #openstack-infra | 12:01 | |
vikram_ | Hi all | 12:01 |
vikram_ | Can someone plz help me in understanding the jerkin failure for https://review.openstack.org/#/c/268727/3 | 12:01 |
vikram_ | can't find the logs archieved | 12:01 |
*** amitgandhinz has joined #openstack-infra | 12:02 | |
openstackgerrit | James Slagle proposed openstack-infra/project-config: Add notifications for TripleO stable/mitaka https://review.openstack.org/298689 | 12:02 |
*** aysyd has joined #openstack-infra | 12:03 | |
AJaeger | vikram_: some the log upload failed. Best to recheck the build | 12:04 |
*** roxanaghe has quit IRC | 12:05 | |
vikram_ | AJaeger: Ok.. What tox cmd will "gate-governance-docs" check? I can check locally | 12:05 |
*** vgridnev has quit IRC | 12:05 | |
*** dizquierdo has quit IRC | 12:06 | |
openstackgerrit | Sergey Kraynev proposed openstack/requirements: Bump up upper-constraint for heatclient https://review.openstack.org/298655 | 12:06 |
AJaeger | vikram_: run "tox -e docs" or "python setup.py build_sphinx" | 12:06 |
vikram_ | AJaeger: Ok.. | 12:07 |
vikram_ | AJaeger: Thanks for your help | 12:07 |
*** rfolco_ has joined #openstack-infra | 12:07 | |
openstackgerrit | Thomas Herve proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config https://review.openstack.org/296061 | 12:07 |
*** EricGonczer_ has joined #openstack-infra | 12:08 | |
*** ddieterly is now known as ddieterly[away] | 12:08 | |
*** flepied has joined #openstack-infra | 12:08 | |
*** jcooley_ has joined #openstack-infra | 12:09 | |
*** salv-orlando has quit IRC | 12:09 | |
*** kgiusti has joined #openstack-infra | 12:09 | |
*** EricGonczer_ has quit IRC | 12:10 | |
*** placko has quit IRC | 12:11 | |
*** jcooley_ has quit IRC | 12:13 | |
*** oanson has quit IRC | 12:14 | |
*** vsaienko has quit IRC | 12:15 | |
*** amitgandhinz has quit IRC | 12:15 | |
openstackgerrit | Rodrigo Duarte proposed openstack-infra/project-config: Enable non-voting keystone tempest plugin tests https://review.openstack.org/298696 | 12:16 |
*** salv-orlando has joined #openstack-infra | 12:17 | |
*** markvoelker has joined #openstack-infra | 12:17 | |
*** rfolco_ has quit IRC | 12:20 | |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 12:20 |
openstackgerrit | vikram.choudhary proposed openstack-infra/project-config: Adding neutron-bgp as a part of neutron project. https://review.openstack.org/268726 | 12:21 |
kozhukalov | AJaeger: ok, nice, it is green now, but i put WF-1 until we have a consensus in ML thread. Thanks very much. | 12:21 |
*** rfolco has joined #openstack-infra | 12:22 | |
*** markvoelker has quit IRC | 12:22 | |
AJaeger | kozhukalov: sure, go ahead... | 12:23 |
*** pradk has joined #openstack-infra | 12:24 | |
*** oanson has joined #openstack-infra | 12:26 | |
*** mrmartin has joined #openstack-infra | 12:29 | |
jroll | mordred: I wound up going with ovh, having trouble with getting into the api, wondering if you have any tips or if I should hit support | 12:31 |
zigo | AJaeger: Hi! Do you have a few minutes to discuss the deb packaging patch I'm trying to push? | 12:31 |
*** isaacb has joined #openstack-infra | 12:32 | |
AJaeger | zigo: a few minutes, yes. | 12:34 |
zigo | AJaeger: Ok, I'll try to be quick. | 12:34 |
zigo | AJaeger: In your review here: https://review.openstack.org/#/c/294022/ | 12:34 |
zigo | you're saying that you'd like us to take care of the scripts, within a package. | 12:34 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 12:34 |
zigo | Well, I'd like to do that, but I can't, since there's no hosted package (yet) by infra. | 12:34 |
AJaeger | zigo: That'S a suggestion which I think will benefit all of us - so you can have a much faster turnaround for this ;) | 12:35 |
zigo | AJaeger: So, to bootstrap the process, I thought having the scripts hosted *temporarily* on infra, so that deb-openstack-pkg-tools can be build, then published. | 12:35 |
zigo | AJaeger: THEN, when we got that ready, move the scripts to openstack-pkg-tools, and use them to build all packages. | 12:35 |
zigo | Isn't this a good plan? | 12:35 |
zigo | Or should I do otherwise? | 12:35 |
zigo | AJaeger: It has always been my intention the way you suggested, but the issue is boostraping the process. | 12:36 |
AJaeger | zigo: Especially in the bootstrap phase you need fast turnaround ;) | 12:36 |
AJaeger | and I cannot review your scripts properly so won't be able to help with those | 12:36 |
zigo | In other words: how can I build openstack-pkg-tools if it needs itself ... | 12:36 |
igorbelikov | zigo: you could still build/publish deb-openstack-pkg-tools if the scripts will be hosted in that repo) | 12:36 |
AJaeger | zigo: that's the wrong idea. | 12:36 |
*** ddieterly[away] is now known as ddieterly | 12:36 | |
AJaeger | igorbelikov is right. You can just publish a script with pypi if you want | 12:37 |
AJaeger | Or you can add it to your repo and make a source checkout | 12:37 |
zigo | AJaeger: openstack-pkg-tools isn't just a tool for building, it's also a build-dependency of all OpenStack packages. | 12:37 |
zigo | AJaeger: I would like to avoid having a special case for building openstack-pkg-tools itself. | 12:37 |
zigo | AJaeger: Having a tox.ini isn't an option (as upstream sources have one themselves, and I don't want to overwrite it...) | 12:38 |
*** jaosorior has quit IRC | 12:38 | |
*** huzhj has joined #openstack-infra | 12:38 | |
AJaeger | TAke a step back. I'm not talking about openstack-pkg-tools, I'm talking about your scripts that you currently push, they can leave everywhere ;) | 12:38 |
*** jaosorior has joined #openstack-infra | 12:39 | |
*** yamamoto has joined #openstack-infra | 12:39 | |
zigo | AJaeger: So my plan was: 1/ get openstack-pkg-tools to build with the scripts I sent against infra | 12:39 |
zigo | 2/ get the package to be published on the OpenStack infra deb repo | 12:39 |
zigo | 3/ change the build process to use the scripts from the openstack-pkg-tools .deb instead of the scripts from infra | 12:39 |
zigo | 4/ re-use that for all other packages | 12:39 |
zigo | AJaeger: Do you see another way to bootstrap things? | 12:40 |
AJaeger | zigo: I hate cyclic dependencies ;) | 12:40 |
*** xyang1 has joined #openstack-infra | 12:40 | |
zigo | Yup... | 12:40 |
*** dmellado is now known as dmellado|lunch | 12:40 | |
zigo | It's *bad*. | 12:40 |
zigo | But I don't see how we could do otherwise. | 12:40 |
igorbelikov | zigo: just change 1/ to 'get openstack-pkg-tools to build with the scripts hosted in openstack-pkg-tools or anywhere else' | 12:40 |
AJaeger | I'm not sure we want an OpenStack Infra deb repo - but that'S a different discussion. | 12:40 |
zigo | igorbelikov: How then? | 12:40 |
*** degorenko is now known as _degorenko|afk | 12:41 | |
*** huzhj_ has quit IRC | 12:41 | |
zigo | AJaeger: Others (like mordred, pabelanger and fungi) agreed already that having a deb repo is the way to go. | 12:41 |
zigo | And they already have one for other stuff anyways. | 12:41 |
igorbelikov | zigo: maybe it’s worth bringing the repo question to the infra meeting today? | 12:41 |
zigo | igorbelikov: Of course! | 12:42 |
zigo | igorbelikov: Will you be at the meeting? | 12:42 |
igorbelikov | zigo: yep | 12:42 |
*** jaosorior has quit IRC | 12:42 | |
zigo | igorbelikov: Unfortunately, it's not a good time for me, it's dinner time for the kids, and I have to be there... :( | 12:42 |
zigo | igorbelikov: Please be our voice then. | 12:42 |
*** jaosorior has joined #openstack-infra | 12:43 | |
smarcet | fungi: morning, https://review.openstack.org/#/c/298699/ is the proposal to change openstackid config from mpm prefork to mpm events | 12:44 |
*** lucas-hungry is now known as lucasagomes | 12:44 | |
smarcet | fungi: after reviewed, could we only apply to dev and disabled production just for testing ? | 12:44 |
AJaeger | zigo: perhaps it helps if you write some kind of design document or spec on what you want. | 12:46 |
*** rlandy has joined #openstack-infra | 12:46 | |
AJaeger | zigo: please note: I'm not holding up your change, I'm just offering suggestions on my limited understanding of what you want to achieve | 12:46 |
AJaeger | design document can be a spec as well | 12:46 |
*** baoli has joined #openstack-infra | 12:46 | |
*** sfinucan has joined #openstack-infra | 12:48 | |
*** baoli_ has joined #openstack-infra | 12:48 | |
*** |-paul-| has quit IRC | 12:50 | |
*** baoli has quit IRC | 12:51 | |
huzhj | Hi all, | 12:52 |
huzhj | I encountered an issue when doing http://docs.openstack.org/infra/manual/creators.html#preparing-a-new-git-repository-using-cookiecutter | 12:52 |
huzhj | I have a new project called "daisycloud-core", so I deal with cookiecutter as the following: | 12:52 |
huzhj | 1. $git clone https://git.openstack.org/openstack/daisycloud-core | 12:52 |
huzhj | Here it create directory in pwd named "daisycloud-core" | 12:52 |
huzhj | 2. $pip install cookiecutter | 12:52 |
huzhj | 3. $cookiecutter https://git.openstack.org/openstack-dev/cookiecutter | 12:52 |
*** annegentle has joined #openstack-infra | 12:52 | |
huzhj | ... | 12:52 |
huzhj | module_name [replace with the name of the python module]: daisycloud-core | 12:52 |
huzhj | repo_group [openstack]: | 12:52 |
huzhj | repo_name [replace with the name for the git repo]: daisycloud-core | 12:52 |
huzhj | launchpad_project [replace with the name of the project on launchpad]: daisycloud-core | 12:52 |
huzhj | project_short_description [OpenStack Boilerplate contains all the boilerplate you need to create an OpenStack package.]: ... | 12:52 |
huzhj | Error: "daisycloud-core" directory already exists | 12:52 |
huzhj | See, at the end of step 3, it complain Error: "daisycloud-core" directory already exists, becasue we have already created that directory in step 1. | 12:52 |
huzhj | So, I do not quite understand why it told me to do like this. May be the description is wrong? Or I misunderstood it? | 12:52 |
*** achanda has joined #openstack-infra | 12:52 | |
*** amitgandhinz has joined #openstack-infra | 12:52 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on deleted member https://review.openstack.org/298731 | 12:53 |
*** julim has joined #openstack-infra | 12:54 | |
*** amitgandhinz has quit IRC | 12:57 | |
*** infra-red has joined #openstack-infra | 12:58 | |
*** achanda has quit IRC | 12:58 | |
*** LaT0rtue has quit IRC | 13:00 | |
*** krtaylor has quit IRC | 13:00 | |
*** LaT0rtue has joined #openstack-infra | 13:01 | |
*** dprince has quit IRC | 13:01 | |
*** links has quit IRC | 13:02 | |
*** huzhj_ has joined #openstack-infra | 13:02 | |
*** dprince has joined #openstack-infra | 13:03 | |
openstackgerrit | KATO Tomoyuki proposed openstack-infra/project-config: Add release notes translation scripts https://review.openstack.org/297045 | 13:04 |
*** ddieterly is now known as ddieterly[away] | 13:04 | |
zigo | AJaeger: Your help is very much appreciated, thanks. | 13:05 |
zigo | AJaeger: It's been my plan to write a spec indeed, but I had no time to do so, so far. | 13:05 |
*** ddieterly[away] is now known as ddieterly | 13:05 | |
zigo | AJaeger: I don't think I'll have time before the meeting tonight. | 13:05 |
*** ddieterly is now known as ddieterly[away] | 13:05 | |
*** huzhj has quit IRC | 13:06 | |
*** piet has joined #openstack-infra | 13:07 | |
*** tojuvone has quit IRC | 13:07 | |
*** tojuvone has joined #openstack-infra | 13:07 | |
*** huzhj_ has quit IRC | 13:07 | |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 13:08 |
*** huzhj_ has joined #openstack-infra | 13:08 | |
*** edmondsw has joined #openstack-infra | 13:09 | |
*** ayoung has joined #openstack-infra | 13:09 | |
*** zeih has joined #openstack-infra | 13:10 | |
*** kushal has quit IRC | 13:12 | |
*** huzhj__ has joined #openstack-infra | 13:12 | |
*** tiswanso has joined #openstack-infra | 13:12 | |
*** kushal has joined #openstack-infra | 13:12 | |
*** tiswanso has quit IRC | 13:13 | |
*** tiswanso has joined #openstack-infra | 13:14 | |
*** krtaylor has joined #openstack-infra | 13:14 | |
*** kushal has joined #openstack-infra | 13:14 | |
*** huzhj_ has quit IRC | 13:15 | |
*** markvoelker has joined #openstack-infra | 13:18 | |
*** huzhj_ has joined #openstack-infra | 13:21 | |
*** markvoelker has quit IRC | 13:22 | |
openstackgerrit | Merged openstack-infra/openstackid: Fix on deleted member https://review.openstack.org/298731 | 13:23 |
*** markvoelker has joined #openstack-infra | 13:23 | |
*** claudiub has joined #openstack-infra | 13:24 | |
openstackgerrit | Marton Kiss proposed openstack-infra/puppet-drupal: Support Apache 2.4 https://review.openstack.org/298742 | 13:24 |
*** huzhj__ has quit IRC | 13:25 | |
*** tojuvone has quit IRC | 13:25 | |
*** tojuvone has joined #openstack-infra | 13:25 | |
*** kushal has quit IRC | 13:25 | |
*** tojuvone has quit IRC | 13:25 | |
*** tojuvone has joined #openstack-infra | 13:26 | |
*** zeih has quit IRC | 13:26 | |
zigo | AJaeger: How do I get a new debian/mitaka branch created on the remote at ssh://thomas-goirand@review.openstack.org:29418/openstack/deb-openstack-pkg-tools.git ? | 13:28 |
*** mrmartin has quit IRC | 13:28 | |
*** markvoelker_ has joined #openstack-infra | 13:28 | |
*** jsavak has joined #openstack-infra | 13:30 | |
*** mylu has joined #openstack-infra | 13:30 | |
openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Make job networking-generic-switch-dsvm voting https://review.openstack.org/297218 | 13:31 |
*** mriedem has joined #openstack-infra | 13:32 | |
openstackgerrit | Igor Belikov proposed openstack-infra/project-config: Add create option to deb-openstack-pkg-tools ACL https://review.openstack.org/298746 | 13:32 |
*** markvoelker has quit IRC | 13:32 | |
*** woodster_ has joined #openstack-infra | 13:32 | |
igorbelikov | zigo: this ^^ should help | 13:32 |
*** mylu has quit IRC | 13:32 | |
*** amitgandhinz has joined #openstack-infra | 13:32 | |
*** mylu has joined #openstack-infra | 13:32 | |
zigo | Oh ! | 13:32 |
zigo | igorbelikov: Thanks a lot. | 13:34 |
*** amrith is now known as _amrith_ | 13:35 | |
*** bdemers has joined #openstack-infra | 13:35 | |
pabelanger | morning | 13:36 |
yolanda | hi | 13:38 |
pabelanger | yolanda: thanks for the merges, testing ubuntu-xenial dib again now | 13:39 |
*** mrmartin has joined #openstack-infra | 13:39 | |
yolanda | pabelanger, nice, the changes made sense | 13:40 |
rcarrillocruz | heya paul | 13:41 |
*** diana_clarke has quit IRC | 13:44 | |
*** pradk has quit IRC | 13:45 | |
*** pradk has joined #openstack-infra | 13:45 | |
*** yamahata has quit IRC | 13:45 | |
*** yamahata has joined #openstack-infra | 13:45 | |
*** roxanaghe has joined #openstack-infra | 13:49 | |
*** mtanino has quit IRC | 13:49 | |
*** asettle has quit IRC | 13:49 | |
*** mylu has quit IRC | 13:50 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Rally role to OpenStack-Ansible https://review.openstack.org/298754 | 13:51 |
*** tonytan4ever has joined #openstack-infra | 13:51 | |
*** roxanaghe has quit IRC | 13:53 | |
isaacb | ianw: here? | 13:54 |
*** asettle has joined #openstack-infra | 13:55 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Add Rally role to OpenStack-Ansible https://review.openstack.org/298754 | 13:56 |
*** burgerk_ has quit IRC | 13:56 | |
SpamapS | trash: I see that it already merged, but anyway, thanks so much for the great change, and for working hard in the face of my unit test pedantry. :) | 13:57 |
*** akshai has joined #openstack-infra | 13:57 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 13:57 | |
*** mylu has joined #openstack-infra | 13:58 | |
*** akshai_ has joined #openstack-infra | 13:59 | |
*** mkoderer__ has quit IRC | 13:59 | |
*** andrewbogott has joined #openstack-infra | 13:59 | |
*** asettle has quit IRC | 14:00 | |
*** bdemers has quit IRC | 14:00 | |
AJaeger | zigo: AFAIK via https://review.openstack.org/#/admin/projects/openstack/deb-openstack-pkg-tools,branches if the ACLs are setup properly | 14:01 |
*** amotoki has joined #openstack-infra | 14:01 | |
AJaeger | zigo: you need create permissions - and those are not setup for it | 14:01 |
AJaeger | igorbelikov: ah, you're fast. Thanks! | 14:01 |
zigo | :) | 14:01 |
zigo | Yeah. | 14:01 |
zigo | AJaeger: Can you review his patch? | 14:01 |
*** IlyaG has joined #openstack-infra | 14:01 | |
andrewbogott | I could use a hand with an improperly failing tempest test. Had a few thoughts about what might have been wrong but now I'm out of ideas :( Here's the output: http://logs.openstack.org/02/298002/4/check/gate-tempest-dsvm-neutron-src-django_openstack_auth/8375bb0/ | 14:02 |
AJaeger | zigo: sure, later ;) | 14:02 |
*** regXboi has joined #openstack-infra | 14:02 | |
*** akshai has quit IRC | 14:02 | |
*** Liuqing has quit IRC | 14:02 | |
*** mkoderer__ has joined #openstack-infra | 14:02 | |
*** piet has quit IRC | 14:03 | |
*** tojuvone has quit IRC | 14:03 | |
*** tojuvone has joined #openstack-infra | 14:03 | |
*** _ari_ has joined #openstack-infra | 14:03 | |
*** ddieterly has joined #openstack-infra | 14:04 | |
*** ddieterly has quit IRC | 14:04 | |
*** daemontool_ is now known as daemontool | 14:06 | |
isaacb | clarkb: here? | 14:06 |
*** IlyaG has quit IRC | 14:06 | |
*** hichihara has joined #openstack-infra | 14:08 | |
*** rbrndt_ has joined #openstack-infra | 14:10 | |
*** jcooley_ has joined #openstack-infra | 14:10 | |
*** zz_dimtruck is now known as dimtruck | 14:10 | |
*** eharney has joined #openstack-infra | 14:13 | |
*** Goneri has joined #openstack-infra | 14:14 | |
*** jcooley_ has quit IRC | 14:15 | |
AJaeger | pabelanger: thanks for your reviews. Could you review https://review.openstack.org/298627 as well, please? That sbcl removal from system-config | 14:15 |
*** markvoelker_ has quit IRC | 14:15 | |
pabelanger | AJaeger: done | 14:16 |
AJaeger | thanks, pabelanger ! | 14:16 |
pabelanger | AJaeger: fungi: So, I wonder it we should first convert system-config (jenkins.pp) to use bindep. Then we avoid the multi project patches | 14:17 |
*** tqtran has joined #openstack-infra | 14:17 | |
fungi | pabelanger: we basically already did. now that we're not building bare-.* systems we should be able to strip a lot of that down | 14:18 |
AJaeger | keep in mind the proposal slaves, I doubt that they use install-distro-packages ;) | 14:19 |
pabelanger | Ya, I noticed when I did the wheel-mirror is was using that code | 14:20 |
pabelanger | oh, and we still have bare-precise too :( | 14:20 |
pabelanger | Oh, I remember | 14:21 |
AJaeger | fungi, pabelanger: Also, I think we have maven on ubuntu-trusty - how is that getting added? | 14:21 |
pabelanger | fungi: so, if I want to stand up a new puppetdb.o.o with ubuntu-trusty, ansible will know it is a 2nd server right? And we won't break the original? | 14:21 |
*** dmellado|lunch is now known as dmellado | 14:21 | |
*** tqtran has quit IRC | 14:21 | |
AJaeger | Also, looking at openstack-infra/groups which according to mrmartin needs php5-cli: The tests do not install distro packages, so do we have php5-cli on the nodes? Or will the tests work without? | 14:22 |
openstackgerrit | Igor Belikov proposed openstack-infra/project-config: Add create option to deb-openstack-pkg-tools ACL https://review.openstack.org/298746 | 14:22 |
pabelanger | AJaeger: I suspect we'll need some dependencies in puppet, but a lot from bindep-fallback could be removed | 14:22 |
AJaeger | pabelanger: yolanda had some fun with ansible when she set up the second gerrit. Best talk with here. | 14:22 |
AJaeger | pabelanger: so far my approach has been: Remove piece by piece everywhere where possible. | 14:23 |
mrmartin | AJaeger: openstackid also depends on php5-cli | 14:23 |
yolanda | well yes, we were hitting a bug with ansible inventory, bug this was fixed | 14:23 |
*** burgerk has joined #openstack-infra | 14:23 | |
fungi | oh, right, bare-precise workers still. so no we can't easily trim down the package lists in puppet but it's probably safer to let them diverge if infra puppet testing is the only consumer of bare-trusty now | 14:23 |
pabelanger | AJaeger: Right, I guess we keep down that path for now. | 14:23 |
*** kushal has joined #openstack-infra | 14:23 | |
fungi | as for long-lived workers, the list of packages they need for their jobs can probably be trimmed substantially | 14:24 |
AJaeger | mrmartin: same problem - yes, openstackid uses bare-precise for testing | 14:24 |
pabelanger | Why doesn't nodepool manage long lived workers? It is because we want them pinned to jenkins.o.o and nodepool cannot do that? | 14:24 |
*** _amrith_ is now known as amrith | 14:24 | |
fungi | pabelanger: it's not a feature we implemented in nodepool, but it's on the roadmap with zuul v3 | 14:25 |
AJaeger | fungi, so what shall we do with php5-cli? REmove it from bindep since it'S only needed for groups and openstackci which run on bare-precise? | 14:25 |
fungi | but the new model would be to rebuild and replace them periodically to get them updated since we wouldn't be able to update them through puppet any longer | 14:26 |
openstackgerrit | Eric Harney proposed openstack-infra/project-config: devstack-plugin-nfs: Make tempest non-voting https://review.openstack.org/298774 | 14:27 |
*** sdake has joined #openstack-infra | 14:27 | |
fungi | AJaeger: there's not much urgency in trimming down the bindep fallback list. and once those servers get upgraded to run on trusty (hopefully soon after the summit) we'll need to be able to test them on ubuntu-trusty workers | 14:28 |
pabelanger | Ya, I want to see if I can do puppetdb.o.o replacement this week. Should be straightforward to do | 14:29 |
pabelanger | no migration, already confirmed it works | 14:29 |
*** sdake_ has joined #openstack-infra | 14:30 | |
clarkb | isaacb: usually not for another hour or so | 14:30 |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: (WIP) Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 14:30 |
fungi | pabelanger: you worked on puppet-httpd quite a bit. do you happen to know how to get it to switch the apache2 mpm in use? needed by 298699 | 14:30 |
AJaeger | fungi: but shouldn't we give them a other-requirements file once we move to newer images? | 14:31 |
openstackgerrit | Rossella Sblendido proposed openstack-infra/reviewday: Add a link for Neutron Gerrit dashboard https://review.openstack.org/298779 | 14:32 |
*** sdake has quit IRC | 14:32 | |
pabelanger | fungi: I suspect we need to migrate to puppetlabs-apache to do that | 14:32 |
AJaeger | fungi, I know there's no urgency, it just involves many steps and thus I'd like to go through it one by one... | 14:32 |
pabelanger | since it include apache::mpm class | 14:32 |
*** achanda has joined #openstack-infra | 14:33 | |
*** ZZelle has joined #openstack-infra | 14:33 | |
pabelanger | fungi: is an example of the migration: https://review.openstack.org/#/c/205596/ | 14:33 |
pabelanger | that is for nodepool | 14:33 |
pabelanger | puppet-nodepool | 14:33 |
pabelanger | I could add code to puppet-openstackid today if needed | 14:33 |
*** mtanino has joined #openstack-infra | 14:34 | |
smarcet | fungi:AJaeger: httpd module works as expected i tested locally and when install php5-fpm also install apache2.4 with pmp events | 14:34 |
fungi | AJaeger: we can, i'm just worried about losing track of what things we're installing with puppet on bare-precise that we need to remember to add when switching to ubuntu-trusty | 14:35 |
fungi | smarcet: right, what i'm discussing with pabelanger is how to get it to actually use apache2-mpm-event rather than apache2-mpm-prefork (which seems to be the default for the puppet-httpd module) | 14:35 |
*** MarkAtwood has quit IRC | 14:35 | |
AJaeger | fungi: yes, that's a challenge. Ok, I'll keep that in mind and will not work on those now that I realized the situation. | 14:36 |
*** sdake_ is now known as sdake | 14:37 | |
anteaya | AJaeger: thanks it is, it was like someone turned the tap off at midnight, so I got some sleep after all | 14:37 |
openstackgerrit | Marton Kiss proposed openstack-infra/groups: Remove map panel title from home https://review.openstack.org/298782 | 14:37 |
AJaeger | anteaya: great! | 14:37 |
*** doug-fish has joined #openstack-infra | 14:38 | |
anteaya | thanks, I think so too | 14:38 |
*** kushal has quit IRC | 14:39 | |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: (WIP) Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 14:40 |
AJaeger | zaro, fungi: I noticed that we have for gerrit only a single job in check and gate and only run this on specific branches. So, a change against master like https://review.openstack.org/#/c/298346/ will never merge. Do we need to run gate-gerrit-buck on other branches as well? | 14:40 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Re-allow list of networks for FIP assignment https://review.openstack.org/298789 | 14:41 |
*** Nikolay_St has quit IRC | 14:43 | |
*** piet has joined #openstack-infra | 14:44 | |
*** andymaier has joined #openstack-infra | 14:45 | |
openstackgerrit | Merged openstack-infra/project-config: Add notifications for TripleO stable/mitaka https://review.openstack.org/298689 | 14:47 |
*** cloudtrainme has joined #openstack-infra | 14:48 | |
*** mrmartin has quit IRC | 14:49 | |
*** mrmartin has joined #openstack-infra | 14:49 | |
*** roxanaghe has joined #openstack-infra | 14:49 | |
fungi | AJaeger: oh, yep, we've never actually used that branch | 14:50 |
*** kozhukalov has quit IRC | 14:51 | |
*** kozhukalov has joined #openstack-infra | 14:51 | |
fungi | AJaeger: we should probably consider fixing up the master branch to just have a readme saying to look at the other branches | 14:52 |
AJaeger | fungi: Ah... | 14:52 |
openstackgerrit | Tom Cocozzello proposed openstack-infra/project-config: Keystone Experimental patch_cover gate job https://review.openstack.org/296808 | 14:52 |
*** isaacb has quit IRC | 14:52 | |
*** bdemers has joined #openstack-infra | 14:53 | |
*** jaypipes has joined #openstack-infra | 14:53 | |
*** tosky has quit IRC | 14:53 | |
*** mrmartin has quit IRC | 14:54 | |
*** _degorenko|afk is now known as degorenko | 14:54 | |
*** roxanaghe has quit IRC | 14:54 | |
anteaya | EmilienM: I'm so glad for the conclusion to the conversation on https://review.openstack.org/#/c/297864 | 14:55 |
anteaya | I agree, skipping jobs just leads to confusion | 14:55 |
anteaya | I know I'm confused by it | 14:55 |
EmilienM | anteaya: me too | 14:55 |
*** maishsk has quit IRC | 14:55 | |
EmilienM | in a meeting atm but I want to re-add the skip-if one day | 14:56 |
* AJaeger will be back later... | 14:56 | |
*** EricGonczer_ has joined #openstack-infra | 14:56 | |
*** tosky has joined #openstack-infra | 14:57 | |
openstackgerrit | Alexander Kislitsky proposed openstack-infra/project-config: fuel-stats: use db setup for python jobs https://review.openstack.org/298800 | 14:57 |
anteaya | EmilienM: sorry to bother you in the meeting | 14:58 |
*** Douhet has quit IRC | 14:58 | |
*** mylu has quit IRC | 14:58 | |
anteaya | if we are counting votes, I'm of the same opinion expressed by fungi and clarkb | 14:58 |
EmilienM | anteaya: no worries | 14:58 |
anteaya | if the test is important enough to exist, it should run | 14:58 |
*** mylu has joined #openstack-infra | 14:59 | |
*** Douhet has joined #openstack-infra | 14:59 | |
EmilienM | anteaya: if we can find a skip-if rule that would work for sure, and we don't touch it much, I would be happy | 14:59 |
EmilienM | it makes CI faster and also save nodepool resources | 14:59 |
*** dizquierdo has joined #openstack-infra | 14:59 | |
*** cloudtrainme has quit IRC | 14:59 | |
anteaya | I think the provisions you put on the skip-if regex is the problem | 14:59 |
*** mylu_ has joined #openstack-infra | 15:00 | |
*** cloudtrainme has joined #openstack-infra | 15:01 | |
*** mylu has quit IRC | 15:01 | |
*** knikolla has joined #openstack-infra | 15:01 | |
pabelanger | So, looking at system-config, do we actually use ptrace on our jenkins slaves? | 15:02 |
pabelanger | http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_common.pp#n73 | 15:02 |
pabelanger | a temporary solutions | 15:02 |
pabelanger | which looks to be since 2012 | 15:02 |
*** pblaho has quit IRC | 15:05 | |
dhellmann | fungi : I need to recreate the stable/mitaka branch for openstack/manila-ui :-( | 15:06 |
dhellmann | fungi : can you delete the current branch, please? | 15:06 |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Remove 'Temporary for debugging glance' on jenkins slaves https://review.openstack.org/298806 | 15:06 |
dhellmann | fungi : it only has the .gitreview update and the g-r sync on it right now | 15:06 |
*** openstackgerrit has quit IRC | 15:06 | |
pabelanger | okay, added patch^. With The logic that projects can use JJB today | 15:06 |
*** openstackgerrit has joined #openstack-infra | 15:06 | |
dhellmann | fungi : and there are no open reviews | 15:07 |
*** amotoki has quit IRC | 15:08 | |
*** jcooley_ has joined #openstack-infra | 15:11 | |
openstackgerrit | yolanda.robla proposed openstack-infra/shade: (WIP) Use keystoneauth1.betamax for shade mocks https://review.openstack.org/298647 | 15:12 |
fungi | dhellmann: okay, will do shortly | 15:13 |
dhellmann | fungi : ty | 15:14 |
*** claudiub|2 has joined #openstack-infra | 15:15 | |
*** jcooley_ has quit IRC | 15:16 | |
*** baoli has joined #openstack-infra | 15:16 | |
*** kushal has joined #openstack-infra | 15:16 | |
*** baoli_ has quit IRC | 15:16 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Use instack-qcow2 from cache if available and appropriate https://review.openstack.org/285259 | 15:17 |
*** claudiub has quit IRC | 15:18 | |
*** arxcruz has quit IRC | 15:19 | |
*** baoli_ has joined #openstack-infra | 15:20 | |
*** ociuhandu_ has joined #openstack-infra | 15:20 | |
*** salv-orl_ has joined #openstack-infra | 15:21 | |
*** ociuhandu has quit IRC | 15:21 | |
*** ociuhandu_ is now known as ociuhandu | 15:21 | |
*** claudiub|2 has quit IRC | 15:22 | |
*** baoli has quit IRC | 15:23 | |
*** gordc has quit IRC | 15:23 | |
*** claudiub|2 has joined #openstack-infra | 15:24 | |
*** salv-orlando has quit IRC | 15:24 | |
*** infra-red has quit IRC | 15:26 | |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Deploy ceph in the nonha job https://review.openstack.org/293051 | 15:26 |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 on the upgrades job https://review.openstack.org/289445 | 15:26 |
*** isaacb has joined #openstack-infra | 15:26 | |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use --overcloud-update in the upgrades job https://review.openstack.org/260466 | 15:26 |
*** rcernin has quit IRC | 15:27 | |
dansmith | clarkb: hey, the latest patchset on this: https://review.openstack.org/#/c/293155/ has failed job, but I don't know enough to know if it's related or not | 15:28 |
clarkb | dansmith: I probably failed at puppet, will dig into it | 15:29 |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Deploy ceph in the nonha job https://review.openstack.org/293051 | 15:29 |
dansmith | clarkb: okay, once that is worked out, is that good to go or is it blocked on anything else? | 15:29 |
clarkb | I need to make an afs volume | 15:30 |
clarkb | and "mount" it to the correct location | 15:30 |
*** Swami has joined #openstack-infra | 15:30 | |
dansmith | clarkb: okay is that an involved process? | 15:30 |
dansmith | clarkb: just trying to get some idea of how long until we can get this voting again | 15:31 |
clarkb | I have no idea. never done it before | 15:31 |
dansmith | heh, okay | 15:31 |
dansmith | clarkb: can we make mordred do it? | 15:31 |
clarkb | but pabelanger got the centos wheel mirror volume up in a day so hopefully not bad | 15:31 |
dansmith | okay | 15:31 |
dansmith | can we make pabelanger do it? :D | 15:31 |
mordred | it's easy | 15:32 |
*** links has joined #openstack-infra | 15:32 | |
mordred | but I'm in board meeting all day today | 15:32 |
mordred | so don't block on me | 15:32 |
*** bdemers has quit IRC | 15:32 | |
pabelanger | Ya, I can help | 15:32 |
*** jcooley_ has joined #openstack-infra | 15:33 | |
clarkb | ok pabelanger maybe in an hour or so after lunch/breakfast we can sort it out! | 15:33 |
clarkb | er | 15:33 |
clarkb | ? | 15:33 |
*** bdemers has joined #openstack-infra | 15:33 | |
pabelanger | clarkb: WFM | 15:33 |
dansmith | clarkb: pabelanger thanks dudes | 15:33 |
*** amitgandhinz has quit IRC | 15:33 | |
fungi | today it's clarkb's turn to mix up sentence punctuation | 15:35 |
* fungi ceremoniously passes the trophy along | 15:35 | |
clarkb | I accept this trophy¡ | 15:36 |
anteaya | I consider that yoda speak | 15:37 |
anteaya | and picture anyone using it sporting green ears | 15:37 |
*** gyee has joined #openstack-infra | 15:41 | |
*** harlowja has quit IRC | 15:41 | |
anteaya | so zuul restart | 15:42 |
anteaya | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=394&rra_id=all | 15:42 |
anteaya | it is heavily into swap | 15:42 |
anteaya | any infra-root have any thoughts on that? | 15:42 |
*** jamesmcarthur has joined #openstack-infra | 15:42 | |
*** huzhj__ has joined #openstack-infra | 15:43 | |
*** piet has quit IRC | 15:43 | |
*** derekh has quit IRC | 15:44 | |
fungi | anteaya: jeblair was working on disentangling the suspect changes to try a manual revert of one along with a restart and see if it identified the source of te leak. on a positive note, the paging doesn't seem to be adversely impacting cpu/load http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2064&rra_id=all | 15:44 |
*** piet has joined #openstack-infra | 15:44 | |
fungi | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2063&rra_id=all | 15:44 |
*** yamahata has quit IRC | 15:44 | |
anteaya | fungi: oh good, thanks | 15:44 |
fungi | but we do need to get it sorted before we exhaust virtual memory | 15:44 |
anteaya | I'll wait to hear from jeblair | 15:45 |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use --overcloud-update in the upgrades job https://review.openstack.org/260466 | 15:45 |
*** nmagnezi has quit IRC | 15:45 | |
fungi | er, those were the wrong graphs | 15:45 |
fungi | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=389&rra_id=all | 15:45 |
*** gordc has joined #openstack-infra | 15:46 | |
*** angdraug has joined #openstack-infra | 15:46 | |
fungi | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=388&rra_id=all | 15:46 |
fungi | anyway, steady state even after paging began | 15:46 |
*** GheRivero has quit IRC | 15:46 | |
*** GheRivero has joined #openstack-infra | 15:46 | |
*** huzhj_ has quit IRC | 15:46 | |
fungi | from the current rate of growth in memory utilization, i estimate we have roughly a week before we exhaust all available virtual memory | 15:47 |
anteaya | okay thanks | 15:47 |
*** amitgandhinz has joined #openstack-infra | 15:47 | |
*** dprince has quit IRC | 15:47 | |
*** dprince has joined #openstack-infra | 15:47 | |
anteaya | glad to have that estimate as an outside perameter | 15:47 |
anteaya | perhaps I am mis-interpretting swap | 15:48 |
anteaya | it is my understanding that usage of swap is indicative of a decrease in performance | 15:48 |
*** roxanagh_ has joined #openstack-infra | 15:50 | |
*** huzhj_ has joined #openstack-infra | 15:50 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Tempest for tripleo CI https://review.openstack.org/295844 | 15:51 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with non-HA jobs https://review.openstack.org/297038 | 15:51 |
*** dtantsur is now known as dtantsur|afk | 15:53 | |
*** armax has joined #openstack-infra | 15:54 | |
openstackgerrit | Dean Troyer proposed openstack/requirements: Bump python-openstackclient to 2.2.1 in u-c https://review.openstack.org/298841 | 15:54 |
*** huzhj__ has quit IRC | 15:54 | |
*** roxanagh_ has quit IRC | 15:55 | |
*** kushal has quit IRC | 15:55 | |
*** isaacb has quit IRC | 15:57 | |
fungi | anteaya: it's an indicator that the system has run out of ram to allocate more memory, and so is starting to move some memory allocations to disk. if it's not accessing those allocations regularly, then it may not impact performance at all | 15:58 |
*** ilyashakhat has joined #openstack-infra | 15:58 | |
*** hashar has quit IRC | 15:59 | |
*** gokrokve has joined #openstack-infra | 15:59 | |
*** samuelBartel has quit IRC | 16:00 | |
*** ilyashakhat__ has joined #openstack-infra | 16:01 | |
anteaya | ah, thank you for clearing up my mis-understanding | 16:01 |
*** Qiming has quit IRC | 16:03 | |
*** esker has joined #openstack-infra | 16:03 | |
*** Guest58782 has quit IRC | 16:03 | |
*** links has quit IRC | 16:04 | |
*** vikram_ has quit IRC | 16:05 | |
*** jlanoux has quit IRC | 16:06 | |
*** jtomasek has quit IRC | 16:07 | |
*** maishsk has joined #openstack-infra | 16:08 | |
mriedem | anyone know if there is a problem with the g-r sync bot being busted on kilo? | 16:08 |
fungi | mriedem: the job being run in the post pipeline might have been broken by something on that branch. i'll take a look | 16:09 |
*** LaT0rtue_ has joined #openstack-infra | 16:10 | |
*** scheuran has quit IRC | 16:11 | |
*** hichihara has quit IRC | 16:11 | |
*** baoli has joined #openstack-infra | 16:12 | |
*** LaT0rtue has quit IRC | 16:12 | |
*** matrohon has quit IRC | 16:12 | |
*** esker has quit IRC | 16:13 | |
*** mylu_ has quit IRC | 16:13 | |
*** bdemers has quit IRC | 16:13 | |
anteaya | does a channel op have time to refresh the channel topic in -meeting? | 16:13 |
*** mylu has joined #openstack-infra | 16:13 | |
*** baoli__ has joined #openstack-infra | 16:13 | |
*** esker has joined #openstack-infra | 16:13 | |
*** kzaitsev_mb has quit IRC | 16:13 | |
*** jistr has quit IRC | 16:14 | |
*** maishsk_ has joined #openstack-infra | 16:14 | |
*** GheRivero has quit IRC | 16:14 | |
*** baoli_ has quit IRC | 16:14 | |
*** bdemers has joined #openstack-infra | 16:15 | |
*** maishsk has quit IRC | 16:15 | |
*** maishsk_ is now known as maishsk | 16:15 | |
*** bdemers has quit IRC | 16:16 | |
*** baoli has quit IRC | 16:16 | |
*** GheRivero has joined #openstack-infra | 16:16 | |
*** bdemers has joined #openstack-infra | 16:17 | |
*** yamahata has joined #openstack-infra | 16:19 | |
*** ilyashakhat__ has quit IRC | 16:21 | |
fungi | anteaya: done--thanks for spotting | 16:23 |
*** flepied1 has joined #openstack-infra | 16:23 | |
*** IlyaG has joined #openstack-infra | 16:23 | |
*** eil397 has joined #openstack-infra | 16:24 | |
pleia2 | good morning | 16:24 |
anteaya | fungi: thank you | 16:24 |
anteaya | morning pleia2 | 16:24 |
*** kzaitsev_mb has joined #openstack-infra | 16:24 | |
abregman | good morning pleia2 | 16:25 |
anteaya | abregman: hello there | 16:25 |
abregman | anteaya: hello :) | 16:25 |
fungi | dhellmann: i've deleted the errant stable/mitaka branch from openstack/manila-ui as requested (head was 850a6130bc754229fce22c76f0ca288e54f53240) | 16:25 |
anteaya | abregman: I've been thinking about you, how are you doing? | 16:25 |
*** cloudtrainme has quit IRC | 16:25 | |
*** flepied has quit IRC | 16:25 | |
clarkb | pabelanger: ok back from breakfast | 16:25 |
clarkb | I will start looking at why thta patch failed first so it can get tested again soon | 16:25 |
pabelanger | clarkb: ack | 16:26 |
*** dizquierdo has quit IRC | 16:26 | |
*** jsavak has quit IRC | 16:26 | |
anteaya | clarkb: looks to me like puppet failures as you say, looks like cloning or dependency issues | 16:26 |
*** maishsk has quit IRC | 16:26 | |
*** Nikolay_St has joined #openstack-infra | 16:27 | |
abregman | anteaya: well..it's complicated :). I think you were right about infra-ansible. not much activity there :|. currently I'm just looking on infra projects to implement in our internal environment...I'm still not able to find practical small tasks in infra projects to work on. | 16:27 |
abregman | anteaya: thanks for asking | 16:27 |
clarkb | Error: Parameter key_id failed on Gnupg_key[Ceph Archive]: Invalid key id d41d8cd98f00b204e9800998ecf8427e what makes it invalid | 16:28 |
*** nadya has quit IRC | 16:28 | |
clarkb | maybe it only wants the last 16 'digits' | 16:28 |
*** harlowja has joined #openstack-infra | 16:29 | |
*** ilyashakhat__ has joined #openstack-infra | 16:29 | |
anteaya | abregman: have you spent any more time reading backscroll? | 16:29 |
*** jsavak has joined #openstack-infra | 16:29 | |
zaro | morning | 16:29 |
anteaya | abregman: having a big picture concept really does help the small choices | 16:29 |
*** derekh has joined #openstack-infra | 16:29 | |
fungi | clarkb: is this still that gowhatsit/pgp puppet module? it sounds like a security nightmare | 16:29 |
anteaya | abregman: even though some folks don't believe it is worth the time | 16:29 |
huzhj_ | Hi, anyone know how to login https://openstackid.org/accounts/user/login with ubuntuID? I want to login and make myself a fundation member | 16:29 |
*** ilyashakhat__ has quit IRC | 16:29 | |
anteaya | morning zaro | 16:29 |
abregman | anteaya: you think I should keep reading backscroll? every day? | 16:30 |
anteaya | abregman: yes | 16:30 |
*** tphummel has joined #openstack-infra | 16:30 | |
*** lezbar has quit IRC | 16:30 | |
*** tqtran has joined #openstack-infra | 16:30 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add ubuntu-xenial DIB to nodepool https://review.openstack.org/297981 | 16:30 |
anteaya | abregman: you ask really good questions when you read the backscroll | 16:30 |
fungi | huzhj_: it's a completely separate account you need to create. you can't log into it with an ubuntuid | 16:30 |
pabelanger | and like that, ubuntu-xenial dibs are working ^ | 16:30 |
*** arxcruz has joined #openstack-infra | 16:30 | |
anteaya | abregman: you don't have to do the exercise of writing everying down and prioritizing | 16:31 |
pabelanger | just booted it locally and things seem to work as expected | 16:31 |
*** yamamoto has quit IRC | 16:31 | |
clarkb | fungi: its https://github.com/n1tr0g/golja-gnupg | 16:31 |
anteaya | abregman: that was an exercise so I could give you feedback on how you were reading things, and I think you have good instincts | 16:31 |
clarkb | fungi: I am just reusing what reprepro already uses | 16:31 |
huzhj_ | thanks fungi. I currenlty encountered this problem: https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ with my ubuntuID | 16:31 |
*** e0ne has quit IRC | 16:31 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Apt mirror for ceph hammer release https://review.openstack.org/293155 | 16:31 |
clarkb | lets see if ^ does any better | 16:32 |
fungi | clarkb: got it. i'm sorry i either missed reviewing that implementation in the reprepro module or neglected to make my objection to the golja-gnupg terribleness strong/lasting enough | 16:32 |
abregman | anteaya: I guess I can try keeping doing that...at least until my number of questions per day will be very little | 16:32 |
*** ramishra has quit IRC | 16:32 | |
abregman | anteaya: I'll do it. thank you again. :) | 16:32 |
fungi | huzhj_: please read and follow http://docs.openstack.org/infra/manual/developers.html#account-setup | 16:33 |
huzhj_ | fungi: Thanks. | 16:33 |
anteaya | abregman: you only learn if you are willing to ask questions | 16:33 |
anteaya | abregman: and you are asking very good ones | 16:33 |
anteaya | everyone wants to jump to the tangibleness of a patch, but often can land in a hole and not realize it | 16:34 |
*** mylu has quit IRC | 16:34 | |
*** jaypipes has quit IRC | 16:34 | |
*** mylu has joined #openstack-infra | 16:34 | |
anteaya | get the big picture, it is of far more value to both you and the rest of infra if you do | 16:34 |
*** rossella_s has quit IRC | 16:34 | |
anteaya | even if you can't justify it to yourself at the moment | 16:34 |
*** mylu has quit IRC | 16:34 | |
*** sshnaidm has quit IRC | 16:34 | |
*** mylu has joined #openstack-infra | 16:34 | |
*** mylu has quit IRC | 16:35 | |
*** rossella_s has joined #openstack-infra | 16:35 | |
*** GheRivero has quit IRC | 16:36 | |
abregman | anteaya: I have a feeling you are right. someone already told you are a good motivator? :) | 16:36 |
DuncanT | Hi, I'm doing a bit of scripting against the wiki, and I've found we have a*lot* of spam pages. Is anybody interested in a list so that they can be pruned? We're currently boosting the pagerank of a bunch of scammers | 16:37 |
*** achanda has quit IRC | 16:37 | |
*** ihrachys has quit IRC | 16:37 | |
*** armax has quit IRC | 16:37 | |
anteaya | abregman: ha ha ha | 16:38 |
Guest68910 | DuncanT: I think infra is already aware as there is a very lengthy thread about the subject on the list: http://lists.openstack.org/pipermail/openstack-infra/2016-March/004038.html | 16:38 |
*** Guest68910 is now known as mgagne | 16:38 | |
fungi | DuncanT: absolutely. we've got a discussion going for a while on the openstack-infra@lists.openstack.org ml about ongoing cleanup and long-term plans to mitigate | 16:38 |
DuncanT | I can't promise an exhaustive list, but I can give one of entries I've confirmed are highly likely spam (example: https://wiki.openstack.org/wiki/1-888-361-3731_Gmail_Customer_service_number_Helpline_Number) | 16:38 |
*** SumitNaiksatam has quit IRC | 16:38 | |
*** mgagne has quit IRC | 16:38 | |
*** mgagne has joined #openstack-infra | 16:38 | |
anteaya | abregman: the problem is that is it is tough, since you have to spend time in mental places where you don't feel comfortable, the trick is to keep doing that and get information so you do feel comfortable, not stay in old habits to avoid the discomfort | 16:39 |
fungi | i suspect that missed the 1-800 filter by being 1-888 | 16:39 |
*** huzhj_ has quit IRC | 16:39 | |
DuncanT | There's a bunch of 1800 pages, 1844, etc | 16:40 |
openstackgerrit | Andrey Nikitin proposed openstack-infra/puppet-gerrit: Order of the classes parameters is refactored https://review.openstack.org/294728 | 16:40 |
anteaya | I wonder if we can regex on 1-8xx | 16:40 |
*** cloudtrainme has joined #openstack-infra | 16:40 | |
DuncanT | fungi: I'll email you a list when I have it if that's useful? I don't fancy scripting page deletion myself at the moment | 16:41 |
pabelanger | DuncanT: fungi: Agreed, if you can follow up on the infra ML, that would be great | 16:41 |
bkero | Why not just regex on a 10 digit number starting with 1 and having 2 optional dashes? | 16:41 |
fungi | DuncanT: the wiki also keeps their history even after deletion, so depending on how you're searching you may also turn up already deleted pages (though that's one we definitely haven't nuked yet) | 16:41 |
*** derekh has quit IRC | 16:41 | |
pabelanger | I should also note, we haven't have any new spam in about 2 weeks | 16:41 |
pabelanger | I haven't had to block any new accounts | 16:41 |
pabelanger | well | 16:41 |
pabelanger | existing accounts | 16:41 |
DuncanT | fungi: There are things like https://wiki.openstack.org/wiki/AMERICAN_aIRlINES_1%5E800%5E611%5E0092_rESERVAtiONS_nUMBER,_aMERICAN_aIRLINES too that are moderately hard to regex | 16:41 |
anteaya | pabelanger: what is the status of the wiki, as DuncanT we still seem to have lots of spam | 16:41 |
fungi | DuncanT: pabelanger did some mass deletions via regular expression/globbing match not long ago so maybe helping him improve the matches he used would be the best benefit | 16:42 |
anteaya | pabelanger: is the conversation progressing or should we discuss it at the meeting today? | 16:42 |
fungi | but yeah, some things just aren't safe to do broad matching on | 16:42 |
pabelanger | anteaya: DuncanT: We have SmiteSpam installed but likely need to tweak our spam settings to get the outstanding pages | 16:42 |
anteaya | so how many existing pages of spam do we have? | 16:42 |
DuncanT | pabelanger: Do you regex against the content or just the title? | 16:42 |
*** LaT0rtue has joined #openstack-infra | 16:42 | |
anteaya | what is the current health status of the wiki? | 16:42 |
pabelanger | DuncanT: we use the defaults for SmiteSpam | 16:43 |
*** LaT0rtue_ has quit IRC | 16:43 | |
DuncanT | anteaya: About 100 pages I've spotted so far | 16:43 |
pabelanger | and Nuke | 16:43 |
anteaya | DuncanT: thanks | 16:43 |
anteaya | how can someone delete those pages | 16:43 |
anteaya | I had offered before and I'll offer again | 16:43 |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: update tag ACLs for all official projects https://review.openstack.org/298866 | 16:43 |
AJaeger | anteaya: do you see any reason to keep these files around in project-config? https://review.openstack.org/298410 I don't... | 16:43 |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci: Use IPv6 on the upgrades job https://review.openstack.org/289445 | 16:43 |
anteaya | AJaeger: looking | 16:43 |
*** armax has joined #openstack-infra | 16:44 | |
anteaya | AJaeger: that was added in the first place for historical reasons | 16:44 |
pabelanger | DuncanT: are you using a mediawiki extension to delete the spam? | 16:44 |
anteaya | it was never added in the belief that it would be used a second time | 16:44 |
*** jerryz has joined #openstack-infra | 16:44 | |
DuncanT | pabelanger: No, I'm writing some scraping software, and stumbled across the spam | 16:45 |
AJaeger | anteaya: so, time to remove it, isn't it? | 16:45 |
*** sfinucan has quit IRC | 16:45 | |
*** Guest38332 has quit IRC | 16:45 | |
anteaya | AJaeger: what harm is it causing? | 16:45 |
anteaya | I think it is useful for being a reference for a large operation we performed in the past | 16:46 |
AJaeger | anteaya: I saw already a patch for it ;/ | 16:46 |
AJaeger | (a patch that wanted to change stuff there) | 16:46 |
anteaya | care to share that patch? | 16:46 |
*** robcresswell is now known as grand-poobah-of- | 16:47 | |
* AJaeger didn't bookmark it ;( | 16:47 | |
DuncanT | anteaya: pabelanger: I'm up to a few hundred probable spam items now | 16:47 |
*** grand-poobah-of- is now known as robcresswell | 16:47 | |
anteaya | DuncanT: I believe you, thanks for sharing your experience | 16:47 |
*** annegentle has quit IRC | 16:47 | |
AJaeger | for me it's just cruft that we don't need - and for reference we have the history. | 16:47 |
anteaya | I wish I could do something useful to help you and despite my attempts to try I don't see how I can | 16:47 |
*** jordanP has quit IRC | 16:47 | |
pabelanger | DuncanT: if we can add them to https://www.mediawiki.org/wiki/Extension:SpamBlacklist then we can delete them using an update script | 16:47 |
*** ifarkas has quit IRC | 16:48 | |
*** pcaruana has quit IRC | 16:48 | |
pabelanger | I just haven't looked into the syntax for it yet | 16:48 |
*** jaypipes has joined #openstack-infra | 16:48 | |
anteaya | AJaeger: well delete it then, my response would be just -2 the patch that tries to change it | 16:48 |
clarkb | pabelanger: apt-get is compiling afs client kernel modules for me currently | 16:49 |
pabelanger | DuncanT: which should be this page: https://wiki.openstack.org/wiki/MediaWiki:Spam-blacklist | 16:49 |
*** jtomasek has joined #openstack-infra | 16:49 | |
fungi | anteaya: would you mind if i added you to the wiki bureaucrat group? i wouldn't want you spending a lot of time deleting pages when we can get better matches in our existing filters/batching but for one-off things that slip through, more hands helping with cleanup there would be helpful | 16:49 |
clarkb | I think I have a kerberos user and admin user already but don't know that it is part of the afs managemtn yet | 16:49 |
pabelanger | or https://wiki.openstack.org/wiki/Spam_blacklist | 16:50 |
pabelanger | clarkb: ack | 16:50 |
clarkb | will sort tht out as soon as my lap is no longer a space heater | 16:50 |
*** asselin_ has joined #openstack-infra | 16:50 | |
AJaeger | anteaya: I was looking for a reason to keep that besides "for historic" - and yes, I gave -1 to that change and can't find it anymore... | 16:51 |
DuncanT | pabelanger: That only seems to cover links though, not free text - a lot of this spam is phone number spam, with no links - probably to get around that sort of blacklist | 16:51 |
anteaya | fungi: I'd be delighted to be added to the wiki bureaucrat group, thank you | 16:51 |
pabelanger | DuncanT: I think it does wiki page titles too | 16:51 |
pabelanger | DuncanT: but haven't tested it yet | 16:52 |
anteaya | fungi: I'd be grateful to be able to delete spam | 16:52 |
pabelanger | anteaya: +1 | 16:52 |
anteaya | AJaeger: okay, my only reason to keep it is historic | 16:52 |
*** sridhar_ram has joined #openstack-infra | 16:52 | |
DuncanT | pabelanger: I'll create a list of page titles, and put it on pastebin - that should let somebody have a crack at cleanup. I'll try to generate some regex too | 16:53 |
pabelanger | DuncanT: WFM | 16:53 |
*** piet has quit IRC | 16:53 | |
*** GheRivero has joined #openstack-infra | 16:53 | |
DuncanT | pabelanger: If somebody notices my scripting is hitting the wiki too hard, please shout. Should be reasonably gentle though | 16:54 |
fungi | DuncanT: i seriously doubt it would be worse than the search engine crawlers, spambots trying to hammer their way in, et cetera | 16:54 |
DuncanT | fungi: It shouldn't be, no - I was mostly being polite. I'm running from behind a fairly terrible ADSL line after all | 16:55 |
*** armax_ has joined #openstack-infra | 16:55 | |
*** abregman has quit IRC | 16:55 | |
anteaya | DuncanT: thank you for being polite :) | 16:55 |
*** erlon has joined #openstack-infra | 16:56 | |
anteaya | and for sharing your findings | 16:56 |
*** jcooley_ has quit IRC | 16:56 | |
*** armax has quit IRC | 16:56 | |
*** armax_ is now known as armax | 16:56 | |
fungi | anteaya: you're an admin/bureaucrat on the wiki now, so can help with various advanced tasks at your convenience | 16:58 |
*** harlowja_ has joined #openstack-infra | 16:58 | |
*** dimtruck is now known as zz_dimtruck | 16:58 | |
fungi | DuncanT: is there any other kind of adsl line? | 16:58 |
*** jcooley_ has joined #openstack-infra | 16:58 | |
DuncanT | fungi: There are many less-terrible-than-this ADSL lines. In fact there are less-terrible-than-this pieces of wet string.... | 16:59 |
anteaya | fungi: thanks, I'll take a look and read any guides I find about doing the right things | 16:59 |
DuncanT | (to be fair, you can put a gigabit down a hundred metres of wet string if you don't mind making every radio spectrum user in the area cry) | 16:59 |
*** harlowja has quit IRC | 17:00 | |
fungi | (and possibly drawing the wrath of the fcc in the process) | 17:00 |
DuncanT | fungi: Indeed | 17:00 |
*** mgagne_ has joined #openstack-infra | 17:06 | |
*** tpsilva has quit IRC | 17:07 | |
*** dtroyer has quit IRC | 17:07 | |
*** zhiyan has quit IRC | 17:07 | |
*** zz_dimtruck has quit IRC | 17:07 | |
*** kambiz has quit IRC | 17:07 | |
*** betherly has quit IRC | 17:07 | |
*** ryanpetrello has quit IRC | 17:07 | |
*** vaidy_ril has quit IRC | 17:07 | |
*** isviridov_away has quit IRC | 17:07 | |
*** rguillebert has quit IRC | 17:07 | |
*** igormarnat has quit IRC | 17:07 | |
*** fmccrthy has quit IRC | 17:07 | |
*** thomasem has quit IRC | 17:07 | |
*** dham1 has quit IRC | 17:07 | |
*** igorbelikov has quit IRC | 17:07 | |
*** skath_ has quit IRC | 17:07 | |
*** sweston has quit IRC | 17:07 | |
*** warpc has quit IRC | 17:07 | |
*** dougwig has quit IRC | 17:07 | |
*** monester has quit IRC | 17:07 | |
*** baoli__ has quit IRC | 17:07 | |
*** jamesmcarthur has quit IRC | 17:07 | |
*** mtanino has quit IRC | 17:07 | |
*** teran has quit IRC | 17:07 | |
*** dmsimard has quit IRC | 17:07 | |
*** vkramskikh has quit IRC | 17:07 | |
*** blogan has quit IRC | 17:07 | |
*** gsilvis has quit IRC | 17:07 | |
*** zaro has quit IRC | 17:07 | |
*** docaedo has quit IRC | 17:07 | |
*** melwitt has quit IRC | 17:07 | |
*** edwarnicke has quit IRC | 17:07 | |
*** mkwiek has quit IRC | 17:07 | |
*** sballe_ has quit IRC | 17:07 | |
*** tpeoples has quit IRC | 17:07 | |
*** adam_g has quit IRC | 17:07 | |
*** jasondotstar has quit IRC | 17:07 | |
*** akshai_ has quit IRC | 17:07 | |
*** aysyd has quit IRC | 17:07 | |
*** mjb has quit IRC | 17:07 | |
*** mgagne has quit IRC | 17:07 | |
*** comstud has quit IRC | 17:07 | |
*** cody-somerville has quit IRC | 17:07 | |
*** rkukura has quit IRC | 17:07 | |
*** cj has quit IRC | 17:07 | |
*** vtapia has quit IRC | 17:07 | |
*** briancline has quit IRC | 17:07 | |
*** hockeynut has quit IRC | 17:07 | |
*** dhellmann has quit IRC | 17:07 | |
*** zzzeek has quit IRC | 17:07 | |
*** verdurin has quit IRC | 17:07 | |
*** darrenc has quit IRC | 17:07 | |
*** sigmavirus24 has quit IRC | 17:07 | |
*** eglute has quit IRC | 17:07 | |
*** kuromagi has quit IRC | 17:07 | |
*** lewo has quit IRC | 17:07 | |
*** gus has quit IRC | 17:07 | |
*** mika has quit IRC | 17:07 | |
*** markmcclain has quit IRC | 17:07 | |
*** Nakato has quit IRC | 17:07 | |
*** cloudnull has quit IRC | 17:07 | |
*** flip214 has quit IRC | 17:07 | |
*** bastelfreak has quit IRC | 17:07 | |
*** mhu has quit IRC | 17:07 | |
*** craige has quit IRC | 17:07 | |
*** tbarron has quit IRC | 17:07 | |
*** jamielennox has quit IRC | 17:07 | |
*** vkmc has quit IRC | 17:07 | |
*** xgerman has quit IRC | 17:07 | |
*** fungi has quit IRC | 17:07 | |
*** rbradfor has quit IRC | 17:07 | |
*** Anticimex has quit IRC | 17:07 | |
*** tosky has quit IRC | 17:07 | |
*** mcarden has quit IRC | 17:07 | |
*** phschwartz has quit IRC | 17:07 | |
*** mfisch has quit IRC | 17:07 | |
*** d34dh0r53 has quit IRC | 17:07 | |
*** mmedvede has quit IRC | 17:07 | |
*** tbarron has joined #openstack-infra | 17:07 | |
*** eglute has joined #openstack-infra | 17:07 | |
*** zz_dimtruck has joined #openstack-infra | 17:07 | |
*** dtroyer has joined #openstack-infra | 17:07 | |
*** comstud has joined #openstack-infra | 17:07 | |
*** zz_dimtruck is now known as dimtruck | 17:07 | |
*** d34dh0r53 has joined #openstack-infra | 17:07 | |
*** kuromagi has joined #openstack-infra | 17:07 | |
*** sdake_ has joined #openstack-infra | 17:07 | |
pabelanger | fungi: clarkb: initial thoughts on moving sysctl calls to ptrace to JJB tempaltes? https://review.openstack.org/#/c/298806/ | 17:07 |
*** rkukura_ has joined #openstack-infra | 17:07 | |
*** gyee has quit IRC | 17:07 | |
*** baoli has joined #openstack-infra | 17:07 | |
*** akshai has joined #openstack-infra | 17:07 | |
*** mtanino_ has joined #openstack-infra | 17:07 | |
*** Swami_ has joined #openstack-infra | 17:07 | |
*** sdake has quit IRC | 17:07 | |
*** jamesmcarthur_ has joined #openstack-infra | 17:07 | |
*** tosky_ has joined #openstack-infra | 17:07 | |
*** aysyd_ has joined #openstack-infra | 17:07 | |
*** Nakato_ has joined #openstack-infra | 17:07 | |
*** mcarden_ has joined #openstack-infra | 17:07 | |
*** mikap has joined #openstack-infra | 17:07 | |
*** kambiz_ has joined #openstack-infra | 17:07 | |
*** flip214_ has joined #openstack-infra | 17:07 | |
*** phschwartz_ has joined #openstack-infra | 17:07 | |
*** hockeynut_afk has joined #openstack-infra | 17:07 | |
*** dmsimard1 has joined #openstack-infra | 17:07 | |
*** vtapia_ has joined #openstack-infra | 17:07 | |
*** gsilvis_ has joined #openstack-infra | 17:07 | |
*** ryanpetrello_ has joined #openstack-infra | 17:07 | |
*** markmcclain1 has joined #openstack-infra | 17:07 | |
*** briancli1e has joined #openstack-infra | 17:07 | |
*** cody-somerville_ has joined #openstack-infra | 17:07 | |
*** Anticime1 has joined #openstack-infra | 17:07 | |
*** cj__ has joined #openstack-infra | 17:07 | |
*** thomasem_ has joined #openstack-infra | 17:07 | |
*** Swami_ has quit IRC | 17:07 | |
*** kambiz_ is now known as kambiz | 17:07 | |
*** kinrui has joined #openstack-infra | 17:07 | |
*** jamesmcarthur_ is now known as jamesmcarthur | 17:07 | |
*** markmcclain1 is now known as markmcclain | 17:07 | |
*** rkukura_ is now known as rkukura | 17:07 | |
*** ryanpetrello_ is now known as ryanpetrello | 17:07 | |
*** adam_g` has joined #openstack-infra | 17:07 | |
*** dhellmann has joined #openstack-infra | 17:07 | |
*** mikap is now known as mika | 17:07 | |
*** mjb has joined #openstack-infra | 17:07 | |
*** hockeynut_afk is now known as hockeynut | 17:07 | |
*** kinrui is now known as fungi | 17:07 | |
*** mgagne_ has quit IRC | 17:07 | |
*** mgagne_ has joined #openstack-infra | 17:07 | |
*** craige has joined #openstack-infra | 17:08 | |
clarkb | pabelanger: is that bug still open? maybe if it hasn't had any updates in a couple years we just remove the things? and if glance wants them bakc they have sudo and can write them | 17:08 |
clarkb | I am utterly failing at kerberos | 17:08 |
clarkb | to kadmin.local do I need to be root on the kdc? | 17:08 |
clarkb | and whtas with the silly :s? | 17:08 |
*** melwitt has joined #openstack-infra | 17:08 | |
*** aysyd_ is now known as aysyd | 17:08 | |
*** _sigmavirus24 has joined #openstack-infra | 17:08 | |
*** Guest28049 has joined #openstack-infra | 17:08 | |
*** lewo has joined #openstack-infra | 17:08 | |
*** zaro has joined #openstack-infra | 17:08 | |
*** blogan has joined #openstack-infra | 17:08 | |
*** rbradfor has joined #openstack-infra | 17:08 | |
*** vkramskikh has joined #openstack-infra | 17:08 | |
*** igormarnat has joined #openstack-infra | 17:08 | |
*** cloudnull has joined #openstack-infra | 17:08 | |
*** jasondotstar has joined #openstack-infra | 17:08 | |
*** mriedem has quit IRC | 17:08 | |
anteaya | how long should the smitespam page take to load? | 17:08 |
*** adam_g` is now known as adam_g | 17:08 | |
*** darrenc has joined #openstack-infra | 17:08 | |
*** bastelfreak has joined #openstack-infra | 17:08 | |
*** verdurin has joined #openstack-infra | 17:08 | |
*** adam_g has quit IRC | 17:08 | |
*** adam_g has joined #openstack-infra | 17:08 | |
*** zzzeek has joined #openstack-infra | 17:08 | |
*** gus has joined #openstack-infra | 17:09 | |
*** apoorvad has joined #openstack-infra | 17:09 | |
clarkb | I just want to run listprincs to see if I have a principal or not | 17:09 |
pabelanger | clarkb: it was eventually merged. I don't think we ever removed the hack. But I agree, now that people have sudo on the slaves, it makes more sense to let projects enable it if needed | 17:09 |
*** vkmc has joined #openstack-infra | 17:09 | |
pabelanger | clarkb: yes, you need root for kadmin.local | 17:09 |
*** lucasagomes is now known as lucas-dinner | 17:09 | |
*** jaypipes has quit IRC | 17:11 | |
*** SumitNaiksatam has joined #openstack-infra | 17:11 | |
clarkb | pabelanger: that attempts to auth with a password | 17:11 |
anteaya | it finally loaded | 17:12 |
clarkb | oh maybe I misread the output | 17:12 |
clarkb | this is a prompt? it ignored my command line request? woo | 17:12 |
*** isviridov_away has joined #openstack-infra | 17:12 | |
*** jamielennox has joined #openstack-infra | 17:12 | |
clarkb | ok I do not have a principal I sewar I had added one | 17:13 |
* clarkb works on adding these things | 17:13 | |
pabelanger | cool | 17:13 |
*** yamamoto has joined #openstack-infra | 17:14 | |
*** daemontool has quit IRC | 17:14 | |
*** _sigmavirus24 is now known as sigmavirus24 | 17:14 | |
*** sigmavirus24 has joined #openstack-infra | 17:14 | |
clarkb | I am on kdc01 do I need to make sure I am on the master vs slave? | 17:14 |
anteaya | I found a new page that is spam, not a previous page that was taken over, I am about to click Actions > Delete in my wikipage options | 17:14 |
anteaya | stop me if I should be doing something different than Actions > Delete | 17:14 |
*** cody-somerville_ has quit IRC | 17:14 | |
*** mriedem has joined #openstack-infra | 17:15 | |
*** vaidy has joined #openstack-infra | 17:15 | |
*** cody-somerville has joined #openstack-infra | 17:15 | |
fungi | sounds right to me | 17:15 |
anteaya | thank you | 17:15 |
fungi | keep in mind deletes can be undone (at least until we decide whether to purge them) | 17:15 |
*** mgagne_ is now known as mgagne | 17:15 | |
* anteaya proceeds | 17:15 | |
*** tiswanso has quit IRC | 17:15 | |
anteaya | ah thanks, I didn't know that | 17:15 |
pabelanger | clarkb: I believe I used kdc01 | 17:16 |
clarkb | docs don't say I need to check so just using 01 | 17:16 |
anteaya | I'm putting vandalism as the reason for deleting | 17:16 |
anteaya | should I click watch this page? | 17:16 |
*** tiswanso has joined #openstack-infra | 17:17 | |
*** monester has joined #openstack-infra | 17:17 | |
*** rguillebert has joined #openstack-infra | 17:17 | |
*** fmccrthy has joined #openstack-infra | 17:17 | |
* anteaya checks "watch this page" | 17:17 | |
*** MarkAtwood has joined #openstack-infra | 17:17 | |
*** igorbelikov has joined #openstack-infra | 17:17 | |
*** zhiyan has joined #openstack-infra | 17:17 | |
*** tpsilva has joined #openstack-infra | 17:17 | |
pabelanger | clarkb: I then use afsdb01 for my pts / bos commands | 17:17 |
*** betherly has joined #openstack-infra | 17:18 | |
*** EricGonczer_ has quit IRC | 17:18 | |
*** xgerman has joined #openstack-infra | 17:18 | |
clarkb | I guess I could run all these commands locally on ^ and use -localauth too ? | 17:18 |
*** mkwiek has joined #openstack-infra | 17:19 | |
*** tpeoples has joined #openstack-infra | 17:19 | |
*** dham1 has joined #openstack-infra | 17:19 | |
*** teran has joined #openstack-infra | 17:19 | |
pabelanger | yup | 17:19 |
*** skath_ has joined #openstack-infra | 17:19 | |
*** ajmiller has joined #openstack-infra | 17:20 | |
clarkb | pabelanger: does http://docs.openstack.org/infra/system-config/afs.html#adding-a-user work if your user isn't already added? eg do I need to use -localauth for that regardless? | 17:20 |
clarkb | or is that more of a just map uids to usernames step? | 17:20 |
*** harlowja has joined #openstack-infra | 17:20 | |
*** warpc has joined #openstack-infra | 17:21 | |
clarkb | anyways /me attemps such things in a moment | 17:21 |
*** sweston has joined #openstack-infra | 17:21 | |
pabelanger | clarkb: Right, you need to use -localauth regardless because you are creating the user | 17:21 |
pabelanger | if I created your user, I don't need it | 17:21 |
*** sballe_ has joined #openstack-infra | 17:21 | |
pabelanger | IIRC | 17:21 |
*** dmsimard1 is now known as dmsimard | 17:21 | |
*** dougwig has joined #openstack-infra | 17:21 | |
*** ilyashakhat has quit IRC | 17:21 | |
clarkb | ya | 17:21 |
*** igorbelikov has quit IRC | 17:22 | |
*** sballe_ has quit IRC | 17:22 | |
*** edwarnicke has joined #openstack-infra | 17:22 | |
*** harlowja_ has quit IRC | 17:22 | |
clarkb | pabelanger: as root again? | 17:22 |
pabelanger | clarkb: yes | 17:23 |
*** igorbelikov has joined #openstack-infra | 17:23 | |
*** sballe_ has joined #openstack-infra | 17:23 | |
*** ajmiller_ has joined #openstack-infra | 17:24 | |
*** sshnaidm has joined #openstack-infra | 17:26 | |
*** ajmiller has quit IRC | 17:27 | |
*** esikachev has quit IRC | 17:28 | |
anteaya | they are also using tildes between numbers not just hyphens | 17:28 |
*** EricGonczer_ has joined #openstack-infra | 17:28 | |
*** Daviey has joined #openstack-infra | 17:29 | |
*** amrith is now known as _amrith_ | 17:29 | |
pabelanger | anteaya: so what I tend to do, is once you find an account that is spamming I go to their contrib page. EG: https://wiki.openstack.org/wiki/Special:Contributions/Andoralifs | 17:29 |
anteaya | thanks | 17:30 |
anteaya | I'll do that as well | 17:30 |
pabelanger | anteaya: then I click block, then do a mass delete too | 17:30 |
*** docaedo_ has joined #openstack-infra | 17:30 | |
pabelanger | which should get all their pages they ever created | 17:30 |
anteaya | awesome, much simpler than page at a time | 17:30 |
anteaya | thank you | 17:30 |
*** docaedo_ is now known as docaedo | 17:30 | |
anteaya | can I assume all pdfs are deleted? | 17:31 |
anteaya | duckduckgo is returning a lot of hits on pdfs | 17:31 |
*** mmedvede has joined #openstack-infra | 17:31 | |
*** eharney has quit IRC | 17:32 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: create api-ref publishing pipeline https://review.openstack.org/298888 | 17:32 |
sdague | AJaeger: if you are still around ^^^ | 17:32 |
pabelanger | anteaya: For the most part. I've checked 1 or 2 in the past. But all likely spam | 17:32 |
AJaeger | sdague: again around ;) | 17:33 |
*** sdake has joined #openstack-infra | 17:33 | |
*** achanda has joined #openstack-infra | 17:33 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support provider networks in public network detection https://review.openstack.org/298890 | 17:33 |
*** sdake_ has quit IRC | 17:34 | |
sdague | AJaeger: my motivation is getting a thing which will build docs draft in check | 17:35 |
sdague | and we'll figure out the full publish story later | 17:35 |
*** amitgandhinz has quit IRC | 17:35 | |
AJaeger | sdague: besides the swapped non-voting - see comments, it looks fine. | 17:36 |
*** amitgandhinz has joined #openstack-infra | 17:36 | |
AJaeger | sdague: I have a review to trade in ;) https://review.openstack.org/#/c/298316/ | 17:36 |
*** eil397 has quit IRC | 17:37 | |
*** dimtruck is now known as zz_dimtruck | 17:37 | |
anteaya | pabelanger: right, so my question is can I assume the pdfs that show up in my search engine results are already deleted? | 17:38 |
sdague | AJaeger: apparently the first one is non-voting | 17:38 |
*** roxanaghe has joined #openstack-infra | 17:38 | |
pabelanger | anteaya: Hmm, not sure about that. I never used a search engine to find spam | 17:39 |
AJaeger | sdague: you made the post job non-voting, I think you want the gate check non-voting | 17:39 |
*** gokrokve has quit IRC | 17:39 | |
AJaeger | sdague: you're right, the first is non-voting already | 17:39 |
sdague | AJaeger: right | 17:39 |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: create api-ref publishing pipeline https://review.openstack.org/298888 | 17:39 |
sdague | I fixed the second one | 17:39 |
AJaeger | sdague: thanks! Then I'll +2... | 17:39 |
sdague | anyone else want to take a look here? | 17:40 |
sdague | https://review.openstack.org/#/c/298888 | 17:40 |
*** cdent has quit IRC | 17:40 | |
*** pvaneck has joined #openstack-infra | 17:40 | |
sdague | huh, ceilo used spider monkey? | 17:40 |
AJaeger | sdague: ages ago... | 17:41 |
*** cdent has joined #openstack-infra | 17:41 | |
AJaeger | sdague: thanks | 17:41 |
*** ajmiller has joined #openstack-infra | 17:41 | |
*** akaszuba has quit IRC | 17:41 | |
anteaya | pabelanger: so the wiki still has pdfs that are not deleted? | 17:42 |
*** ajmiller_ has quit IRC | 17:42 | |
anteaya | I had thought you implimented a tool early on that removed pdfs | 17:42 |
anteaya | did I mis-understand? | 17:42 |
*** smarcet has quit IRC | 17:43 | |
*** MarkAtwood has quit IRC | 17:43 | |
pabelanger | anteaya: no, we just disabled pdf uploads. And we also installed SmiteSpam | 17:43 |
*** Hal has joined #openstack-infra | 17:43 | |
*** roxanaghe has quit IRC | 17:43 | |
anteaya | ah okay so still plenty of spam pdfs floating around then is my conclusion | 17:43 |
anteaya | thanks | 17:44 |
pabelanger | But SmiteSpam will need to be tweaked via configuration to catch the current spam that exists | 17:44 |
*** smarcet has joined #openstack-infra | 17:44 | |
*** Hal is now known as Guest506 | 17:44 | |
anteaya | yeah, it has found a lot of pages that aren't spam | 17:44 |
anteaya | where aer smitespams settings? | 17:44 |
anteaya | are | 17:44 |
*** kushal has joined #openstack-infra | 17:45 | |
AJaeger | fungi, we could soon remove gnome-doc-tools from bindep-fallback - but still need it on proposal slaves for those three repos that need it for DocBook XML translation extraction. Shall I remove it from the list while keeping it in system-config so that we setup the slave properly? Or do you prefer to wait? | 17:45 |
*** esikachev has joined #openstack-infra | 17:46 | |
*** Nikolay_St has quit IRC | 17:46 | |
clarkb | pabelanger: ok I think I am all done configuring my user creds | 17:46 |
clarkb | pabelanger: when you created your volume you did so as your admin user against the dfw fileserver? | 17:47 |
*** e0ne has joined #openstack-infra | 17:47 | |
*** nelsnels_ has joined #openstack-infra | 17:48 | |
*** nelsnelson has quit IRC | 17:48 | |
*** annegentle has joined #openstack-infra | 17:48 | |
clarkb | looks like my puppet change is still failing, I wonder if that gpg module is trying to contact a keyserver about that key | 17:48 |
clarkb | and its not in any keyserver so fails \o/ | 17:48 |
*** Guest506 has quit IRC | 17:48 | |
*** andymaier has quit IRC | 17:49 | |
pabelanger | clarkb: Yup, admin user | 17:49 |
anteaya | <-- lunch | 17:50 |
*** rlandy has quit IRC | 17:50 | |
*** bpokorny has joined #openstack-infra | 17:52 | |
*** bpokorny has quit IRC | 17:52 | |
*** Sukhdev has joined #openstack-infra | 17:52 | |
*** bpokorny has joined #openstack-infra | 17:53 | |
*** tosky_ has quit IRC | 17:53 | |
fungi | AJaeger: if you're sure that one's safe to remove, feel free to propose a patch. i'm just unconvinced that we really need to bother cleaning up the bindep fallback list as it's an incentive to projects to provide their own other-requirements.txt files | 17:53 |
*** esikachev has quit IRC | 17:54 | |
pabelanger | clarkb: I used afsdb01 to create the volumes too, as unprivileged but kerberos admin | 17:54 |
fungi | we're going to cache most packages jobs need anyway, so removing a few packages from the default list to install will at most shave a few seconds off jobs | 17:55 |
AJaeger | you mean, we should add some more cruft to it? ;) | 17:55 |
fungi | AJaeger: we could add a sleep 300 to it and impose a 5-minute runtime penalty (not really!) | 17:55 |
AJaeger | fungi: ok. Will finish what I started and then let projects do it... | 17:56 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 17:56 |
AJaeger | fungi: for gnome-doc-tools I just did that - adding other-requirements to all doc repos ;) | 17:56 |
*** jamesmcarthur has quit IRC | 17:57 | |
*** sdake has quit IRC | 17:57 | |
openstackgerrit | Zara proposed openstack-infra/python-storyboardclient: Update Docs https://review.openstack.org/298910 | 17:57 |
*** e0ne has quit IRC | 17:58 | |
*** kzaitsev_mb has quit IRC | 17:59 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Don't execute the output from wait_for https://review.openstack.org/295297 | 17:59 |
*** asettle has joined #openstack-infra | 18:00 | |
*** cloudtrainme has quit IRC | 18:02 | |
*** pcaruana has joined #openstack-infra | 18:02 | |
*** sdake has joined #openstack-infra | 18:02 | |
* rcarrillocruz just realized infra meeting is in an hour | 18:03 | |
* Clint nods. | 18:04 | |
anteaya | rcarrillocruz: time change on the weekend apparently, eh? | 18:04 |
rcarrillocruz | exactly | 18:04 |
rcarrillocruz | /facepalm | 18:05 |
*** arxcruz has quit IRC | 18:05 | |
rcarrillocruz | back in a bit | 18:05 |
*** degorenko is now known as _degorenko|afk | 18:06 | |
anteaya | so here is the inclusion of the smitespam extention in puppet-mediawiki: http://git.openstack.org/cgit/openstack-infra/puppet-mediawiki/commit/templates/Settings.php.erb?id=933853e0306a8fc8a8b9276b7bbed00db25f19ef any one have any thoughts on where I can find its configuration? | 18:06 |
anteaya | so far I'm not seeing anything with smitespam in the message in system-config | 18:06 |
dansmith | does anyone think that 40 minutes for running devstack on an ovh node is out of reasonable bounds? https://jenkins05.openstack.org/job/gate-tempest-dsvm-full/31250/console | 18:07 |
*** sdake has quit IRC | 18:08 | |
*** sdake_ has joined #openstack-infra | 18:08 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove libtidy from bindep https://review.openstack.org/298913 | 18:08 |
*** dtardivel has quit IRC | 18:08 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/system-config: Remove libtidy install https://review.openstack.org/298914 | 18:08 |
mordred | dansmith: just for devstack, not for tempest? | 18:08 |
*** dizquierdo has joined #openstack-infra | 18:08 | |
dansmith | I don't think it's anything to do with my code, because it's happening on two separate jobs (postgres and mysql) | 18:08 |
dansmith | mordred: I think that's what the console is telling me, right? | 18:08 |
*** EricGonczer_ has quit IRC | 18:08 | |
*** hashar has joined #openstack-infra | 18:09 | |
anteaya | dansmith: that is my interpretation of 'this should take 10 or 15 minutes' | 18:09 |
*** asettle has quit IRC | 18:10 | |
dansmith | anteaya: heh, yeah, that's my read | 18:10 |
dansmith | and it does't say "except for dansmith" | 18:11 |
anteaya | dansmith: we should fix the logs | 18:11 |
dansmith | anteaya: well, sdague said 10-15 minutes is right | 18:12 |
dansmith | which is why I'm asking | 18:12 |
openstackgerrit | Michael Johnson proposed openstack-infra/devstack-gate: Add archiving of nova instance console logs https://review.openstack.org/298915 | 18:12 |
anteaya | yup | 18:12 |
anteaya | somewhere in backscroll mnaser had a mention of wondering if folks were having issues on ovh and mentioning new hardware was expected at his location | 18:12 |
sdague | more than double that is definitely of concern | 18:12 |
anteaya | but those were the extent of the details I read in backscroll | 18:12 |
openstackgerrit | Dean Troyer proposed openstack/requirements: Bump python-openstackclient to 2.3.0 in u-c https://review.openstack.org/298841 | 18:13 |
*** e0ne has joined #openstack-infra | 18:13 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove gnome-doc-utils from bindep https://review.openstack.org/298917 | 18:13 |
fungi | anteaya: presumably vexxhost not ovh? | 18:14 |
*** Douhet has quit IRC | 18:14 | |
anteaya | ah true | 18:14 |
anteaya | sorry I'm mashing them together | 18:14 |
anteaya | sorry vexxhost | 18:14 |
anteaya | yeah this is the first information I have of an issue with ovh | 18:15 |
*** Douhet has joined #openstack-infra | 18:15 | |
*** sputnik13 has joined #openstack-infra | 18:15 | |
*** piet has joined #openstack-infra | 18:16 | |
*** MarkAtwood has joined #openstack-infra | 18:17 | |
fungi | interesting. a node i held in nodepool yesterday became unreachable today (in osic), but nodepool still thinks it's held | 18:17 |
fungi | can't even ping it | 18:17 |
*** jaosorior has quit IRC | 18:18 | |
anteaya | what criteria is nodepool using to consider it held? | 18:18 |
fungi | nova list claims the instance is still running | 18:18 |
anteaya | ah | 18:18 |
*** _amrith_ is now known as amrith | 18:19 | |
fungi | anteaya: nodepool relies on an entry in its database for node state (building, ready, used, delete, hold) | 18:19 |
anteaya | ah so if another entry doens't update the database, the old entry is it | 18:19 |
dansmith | sdague: fungi: so is there any reason to wait for this test to timeout.. for forensics or something? otherwise I'll push something up to restart it so I can move on | 18:19 |
anteaya | dansmith: I see nothing to be gained by making you watch the thing go round | 18:19 |
sdague | dansmith: if you have a different patch to test, I'd just push it | 18:20 |
dansmith | anteaya: okay, just didn't know if someone wanted to jump on the box and look | 18:20 |
dansmith | sdague: ack | 18:20 |
sdague | dansmith: any possibility that you made nova-manage go into an infinite loop? | 18:20 |
dansmith | sdague: I don't think so | 18:20 |
anteaya | dansmith: yup, thanks for giving us the opportunity | 18:20 |
sdague | trying to do it's upgrades | 18:20 |
dansmith | sdague: and it is postgres only, but the mysql job hung the same way | 18:20 |
dansmith | sdague: if it runs on another host and hangs again, we'll know I guess | 18:20 |
dansmith | sdague: ohhhh | 18:21 |
dansmith | you know what | 18:21 |
dansmith | I bet I did, lol | 18:21 |
sdague | dansmith: :) | 18:21 |
*** zz_dimtruck is now known as dimtruck | 18:21 | |
sdague | do I win a cookie | 18:21 |
dansmith | I spent twenty minutes trying to prove I didn't | 18:21 |
*** jamesmcarthur has joined #openstack-infra | 18:21 | |
*** eharney has joined #openstack-infra | 18:21 | |
dansmith | but then you asked again and I just realized I bet I did | 18:21 |
fungi | beer cookies | 18:21 |
fungi | i bet beer would make a good substitute for some of the water and sugar in certain cookie recipes. new project for next weekend | 18:22 |
anteaya | you can already use beer in bread | 18:22 |
dansmith | I hereby retract my complaint and all the bad words I said to my monitor | 18:22 |
anteaya | I think it would make great cookies | 18:22 |
anteaya | well you didn't type them | 18:22 |
fungi | anteaya: can and _do_ | 18:22 |
anteaya | points for that | 18:22 |
jeblair | i'm briefly online; anything urgently need my attention? | 18:22 |
anteaya | jeblair: how is the unwinding zuul so it may be restarted work coming along? | 18:23 |
fungi | jeblair: how far did you get with figuring out which patch you wanted to untangle in zuul to revert in a restart>? | 18:23 |
AJaeger | fungi, I'm through my bindep-fallback cleanup for now, all patches send. | 18:23 |
fungi | rough estimate is that we'll run out of swap in a week (though the server seems to be humming along without significant impact from the additional paging for now) | 18:23 |
*** baoli has quit IRC | 18:24 | |
*** jamesmcarthur has quit IRC | 18:24 | |
*** cj__ is now known as cj | 18:24 | |
fungi | jeblair: nothing extra urgent that i know of though | 18:24 |
*** jamesmcarthur has joined #openstack-infra | 18:25 | |
*** e0ne has quit IRC | 18:25 | |
fungi | my held osic node showed nothing odd on the nova console-log, but returned to usability after a nova reboot call | 18:25 |
fungi | curious how it managed to wedge itself as i wasn't really running anything on it overnight | 18:26 |
*** IlyaG has quit IRC | 18:27 | |
fungi | nothing looks out of sorts in its syslog | 18:28 |
*** EricGonczer_ has joined #openstack-infra | 18:28 | |
fungi | it was continuing to log mundane stuff up to the point where i rebooted | 18:28 |
jeblair | fungi, anteaya: ah, zuul has a gate blockage; Nakato_ fixed it here: https://review.openstack.org/#/c/296180/ | 18:30 |
jeblair | so i'll approve that | 18:31 |
*** jsavak has quit IRC | 18:31 | |
*** Sukhdev has quit IRC | 18:31 | |
fungi | yep, lgtm. thanks@ | 18:31 |
jeblair | fungi, anteaya: however, that's the only test failure on my change, so i think it's safe to actually deploy in production | 18:31 |
*** jsavak has joined #openstack-infra | 18:32 | |
fungi | jeblair: awesome, so we just need a volunteer to temporarily disable puppet for zuul.o.o, install the patched version, then do the usual restart and reenqueue step (coordinating with release management to make sure we don't catch them unawares in the middle of running release jobs) | 18:32 |
jeblair | fungi, anteaya: which is this one: https://review.openstack.org/#/c/298308/ | 18:32 |
jeblair | fungi: probably don't really need to stop puppet | 18:33 |
fungi | just be... quick ;) | 18:33 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Mutex protect internal/external network detection https://review.openstack.org/298927 | 18:33 |
fungi | i guess as long as the patch, upgrade, restart fit between puppet runs, should be fine | 18:33 |
*** abregman has joined #openstack-infra | 18:34 | |
*** cdent has quit IRC | 18:34 | |
fungi | pabelanger: you had previously offered to go through a zuul restart. when would be convenient for you? i can make sure i'm around to assist | 18:34 |
anteaya | jeblair: I support this direction, thank you | 18:34 |
*** kushal has quit IRC | 18:35 | |
pabelanger | fungi: sure, I don't mind helping. If needed | 18:36 |
jeblair | fungi: puppet won't try to reinstall zuul unless a change lands | 18:36 |
jeblair | (since it's driven by vcsrepo updates) | 18:36 |
*** piet has quit IRC | 18:36 | |
fungi | jeblair: yep, i was considering if the patch was checked out in /opt/zuul on the server, but i suppose it's safer to not do that | 18:36 |
anteaya | dhellman has a patch in the gate he would like to get merged if he can please | 18:37 |
*** piet has joined #openstack-infra | 18:37 | |
dhellmann | anteaya : there's one change in our gate right now that I've been waiting for ages to get merged, so I'd like to let that one in if we can. after that, I can wait for a restart before tagging the release. | 18:37 |
fungi | especially since if you don't put it back puppet-vcsrepo may fail to pull new commits into it | 18:37 |
dhellmann | anteaya :it looks like we're just a few minutes from it merging | 18:37 |
*** e0ne has joined #openstack-infra | 18:37 | |
*** kushal has joined #openstack-infra | 18:37 | |
anteaya | dhellmann: awesome, thanks for saying so | 18:38 |
dhellmann | anteaya : thanks for asking :-) | 18:38 |
anteaya | is that the only patch in process at the moment? | 18:38 |
anteaya | dhellmann: of course :) | 18:38 |
fungi | dhellmann: well, we wouldn't probably do a restart until after the infra meeting, which is starting in a few minutes | 18:38 |
anteaya | given it is a non-emergency restart | 18:38 |
jeblair | fungi: oh, yeah, i usually check out in ~corvus | 18:39 |
dhellmann | anteaya, fungi : my patch landed | 18:39 |
anteaya | dhellmann: yay | 18:39 |
jeblair | fungi: then "sudo pip install ." | 18:39 |
*** austin81 has joined #openstack-infra | 18:39 | |
dhellmann | ok, if you're going to wait a while I'll go ahead and tag the release | 18:39 |
anteaya | dhellmann: how long does tagging usually take? | 18:39 |
*** eil397 has joined #openstack-infra | 18:40 | |
dhellmann | anteaya : just a few minutes, much less than the length of your meeting | 18:40 |
anteaya | dhellmann: yup, makes sense then | 18:40 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 18:40 |
fungi | note that we really only care about the release pipeline jobs up to the point where the release announcements are sent. the wheel builder/release jobs are fine to lose from the release pipeline since they'll just get rerun soon thereafter anyway | 18:40 |
*** achanda has quit IRC | 18:40 | |
openstackgerrit | Merged openstack-infra/zuul: Fix test for new WebOb https://review.openstack.org/296180 | 18:41 |
*** cloudtrainme has joined #openstack-infra | 18:41 | |
anteaya | fungi: so for instance the ironic-ui patch in the release pipeline, it is finished all jobs with the exception of two wheel jobs | 18:42 |
cloudnull | fungi: -- re: osic node held but not reachable -- jthorne and I just got done dealing with an issue today where rabbitmq had a nice freaked out session. while its resolved now, its likely your node was impacted. | 18:42 |
anteaya | so the wheel jobs will just get run later? | 18:43 |
cloudnull | was just reading and saw your osic post and figured i'd mention it here. | 18:43 |
fungi | cloudnull: thanks! luckily it wasn't doing anything important at all (i was actually about to delete it), i just got curious | 18:43 |
*** angdraug has quit IRC | 18:44 | |
AJaeger | anteaya: wheel jobs are run also in periodic pipeline every day | 18:44 |
anteaya | ah, awesome, thank you | 18:44 |
fungi | but it's possible some of our job workers might have died mid-job so i'll keep an eye out for related issues on that front (luckily zuul just restarts the job in most cases like that) | 18:44 |
openstackgerrit | Eric Harney proposed openstack-infra/project-config: devstack-plugin-nfs: Make tempest non-voting https://review.openstack.org/298774 | 18:45 |
anteaya | thank you | 18:45 |
cloudnull | ++ let me know if i can help -- or if it happens again | 18:45 |
fungi | cloudnull: will do--thanks again! | 18:45 |
AJaeger | anteaya: the periodic pipeline covers any pypi releases. We run it as part of release pipeline for *our* releases to have the wheels directly instead of waiting for next periodic job | 18:45 |
cloudnull | anytime -- sorry for the disruption | 18:45 |
*** david-lyle has quit IRC | 18:45 | |
fungi | anteaya: yeah, we run those immediately after any release to speed up the availability of wheels in our mirror for them, but it's not critical and it gets rerun completely anytime something is released, in addition to periodically even if nothing is released | 18:46 |
*** david-lyle has joined #openstack-infra | 18:46 | |
dhellmann | fungi , AJaeger : I suspect that the announce job is installing way more packages than it really needs to do the work. IIRC you're looking at optimizations in other jobs, too? Let me know if I can help with analysis there. | 18:47 |
*** jaypipes has joined #openstack-infra | 18:47 | |
*** ilyashakhat has joined #openstack-infra | 18:47 | |
dhellmann | fungi , anteaya : ok, the announce job is done. I'll hold off on any other release work until you give the all-clear that the restart is done. | 18:47 |
anteaya | dhellmann: thanks | 18:48 |
fungi | dhellmann: it's likely not worth optimizing that one job unless it really spends a lot of time installing packages. it shouldn't really be downloading any since we pre-cache them on disk | 18:48 |
dhellmann | fungi : I'd have to look, but I wouldn't be surprised to find that it spends more than 50% of its time installing things | 18:48 |
anteaya | AJaeger: fungi thank you, I appreciate the explaination | 18:48 |
dhellmann | the announce script itself runs pretty quickly | 18:48 |
*** achanda has joined #openstack-infra | 18:49 | |
dhellmann | (it doesn't do much) | 18:49 |
fungi | cody-somerville: woah! us west gear made it to texas finally? excellent news! | 18:49 |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Add migration to move attrs and tags into columns https://review.openstack.org/298069 | 18:51 |
AJaeger | dhellmann: see http://docs.openstack.org/infra/manual/drivers.html#package-requirements on what you can do - but it's IMHO not worth for that job | 18:51 |
openstackgerrit | Eric Harney proposed openstack-infra/project-config: devstack-plugin-nfs: Make tempest non-voting https://review.openstack.org/298774 | 18:51 |
dhellmann | AJaeger, fungi : ok, if it's not going to buy much I won't worry about it | 18:51 |
*** phschwartz_ is now known as phschwartz | 18:51 | |
*** ilyashakhat has quit IRC | 18:51 | |
AJaeger | dhellmann: looking at https://jenkins02.openstack.org/job/ironic-ui-announce-release/1/consoleFull, package install starts at 17:19:07 and finishes at 17:20:30 | 18:53 |
AJaeger | job start at 17:18:59, finishes at 17:21:10, so 2:11 minutes runtime, package install takes 1:23 mins | 18:53 |
dhellmann | AJaeger : yeah, that's not worth worrying about. | 18:54 |
fungi | also there would need to be some customization to do special package installation (or lack tehreof) for that job since it runs for multiple repos and our usual tuning is something the projects themselves would add/modify locally in their repos | 18:54 |
*** tiswanso has quit IRC | 18:55 | |
*** tiswanso has joined #openstack-infra | 18:55 | |
anteaya | igorbelikov: hi, there seem to be two agenda items in this week's meeting agenda about baremetal in nodepool: https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Weekly_Project_Infrastructure_team_meeting | 18:56 |
anteaya | igorbelikov: did you want to maybe select one of them? | 18:56 |
*** piet has quit IRC | 18:57 | |
*** jaypipes_ has joined #openstack-infra | 18:57 | |
igorbelikov | anteaya: hi, I removed the second one | 18:57 |
*** maishsk has joined #openstack-infra | 18:57 | |
igorbelikov | it was posted as a sub-item in previous week agenda, don’t know why it got this way:) | 18:57 |
anteaya | igorbelikov: thanks | 18:57 |
anteaya | igorbelikov: thanks for the clean up :) | 18:58 |
*** angdraug has joined #openstack-infra | 18:58 | |
*** e0ne has quit IRC | 18:59 | |
openstackgerrit | Merged openstack-infra/infra-specs: Add Nodepool Zookeeper spec https://review.openstack.org/278777 | 18:59 |
pleia2 | meeting time once keystone finishes up | 19:00 |
pleia2 | there we go | 19:00 |
*** Guest28049 is now known as mfisch | 19:01 | |
openstackgerrit | Merged openstack/os-testr: Add pypi download + version badges into README.rst https://review.openstack.org/298102 | 19:01 |
*** sdake_ is now known as sdake | 19:01 | |
openstackgerrit | Merged openstack-infra/infra-specs: Deploy-Stackviz spec https://review.openstack.org/287373 | 19:01 |
*** mfisch is now known as Guest82454 | 19:01 | |
*** Guest82454 has quit IRC | 19:02 | |
*** Guest82454 has joined #openstack-infra | 19:02 | |
*** Guest82454 is now known as mfisch | 19:03 | |
*** eil397 has quit IRC | 19:03 | |
*** e0ne has joined #openstack-infra | 19:03 | |
*** e0ne has quit IRC | 19:03 | |
openstackgerrit | Merged openstack/os-testr: py26/py33 are no longer supported by Infra's CI https://review.openstack.org/261692 | 19:04 |
*** e0ne has joined #openstack-infra | 19:04 | |
openstackgerrit | Merged openstack/os-testr: remove python 3.3 trove classifier https://review.openstack.org/264521 | 19:04 |
*** eil397 has joined #openstack-infra | 19:05 | |
anteaya | waynr: you mentioned putting jjb things on https://etherpad.openstack.org/p/infra-newton-summit-planning on the mailing list | 19:05 |
*** eil397 has quit IRC | 19:06 | |
*** eil397 has joined #openstack-infra | 19:06 | |
anteaya | waynr: don't delay we will be discussing slots next infra meeting | 19:06 |
*** e0ne has quit IRC | 19:07 | |
*** krotscheck is now known as krotscheck_dcm | 19:07 | |
*** jaypipes_ has quit IRC | 19:08 | |
*** ilyashakhat has joined #openstack-infra | 19:08 | |
*** doug-fis_ has joined #openstack-infra | 19:10 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Increase heat rpc_response_timeout in the overcloud https://review.openstack.org/298941 | 19:12 |
*** doug-fish has quit IRC | 19:12 | |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 19:12 |
cbader_ | anteaya, is there a document that describes how to remove a provider from the nodepool list so I can move it to another commonci server to balance loads? | 19:13 |
*** akscram has quit IRC | 19:14 | |
anteaya | well if we wanted to remove a provider from our nodepool we first would set min_servers to -1 in our nodepool.yaml | 19:14 |
anteaya | so no images were created on that host provider | 19:14 |
anteaya | and then we would remove the entry in nodepool.yaml in project-config | 19:14 |
cbader_ | anteaya, I have done that but it is still building images when I delete them | 19:14 |
anteaya | well you have to look into why it is doing that | 19:15 |
*** akscram has joined #openstack-infra | 19:15 | |
anteaya | setting min_servers to -1 in our nodepool.yaml prevents images being created on hosts for our system | 19:15 |
cbader_ | anteaya, thank you for the information, I will look into more why mine is behaving strange | 19:15 |
*** ilyashakhat has quit IRC | 19:15 | |
*** kzaitsev_mb has joined #openstack-infra | 19:16 | |
anteaya | you are welcome to post a build log or stacktrack to a paste service and share it in here if that is helpful for you | 19:16 |
cbader_ | anteaya, I will scrub the logs to see why it is happening and will post if I find something thank you. | 19:17 |
anteaya | welcome | 19:17 |
*** ociuhandu has quit IRC | 19:21 | |
*** salv-orlando has joined #openstack-infra | 19:22 | |
*** ericksonsantos has quit IRC | 19:23 | |
*** salv-orl_ has quit IRC | 19:24 | |
*** dizquierdo has quit IRC | 19:25 | |
cloudnull | hi infra folks -- one of the users of the osic cluster is about to do a very large VM spinnup, 600+ at the same time, this is what made rabbitmq freak out before. | 19:26 |
*** roxanaghe has joined #openstack-infra | 19:26 | |
cloudnull | we'll be monitoring the cluster closely this go and working with the user to ensure they're not causing another rabbitmq freak out session but I wanted to let you all know. | 19:27 |
angdraug | pabelanger: (taking this out of the meeting) bookwar will be in Austin, can you loop her into the tripleo/ironic/nodepool discussion? | 19:27 |
*** shardy is now known as shardy_afk | 19:28 | |
openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Add migration to move attrs and tags into columns https://review.openstack.org/298069 | 19:28 |
pabelanger | angdraug: sure | 19:28 |
*** EricGonc_ has joined #openstack-infra | 19:29 | |
fungi | cloudnull: thanks for the heads up | 19:30 |
*** EricGonczer_ has quit IRC | 19:30 | |
*** roxanaghe has quit IRC | 19:31 | |
*** salv-orl_ has joined #openstack-infra | 19:32 | |
*** jsavak has quit IRC | 19:32 | |
*** mylu has joined #openstack-infra | 19:32 | |
*** mylu has quit IRC | 19:33 | |
*** salv-orlando has quit IRC | 19:35 | |
*** MarkAtwood has quit IRC | 19:35 | |
anteaya | I wonder what the rabbitmq threshold is for freakout? apparently less than 600 nodes | 19:37 |
dims | cloudnull : i'll be interested in the outcome :) rabbitmq/oslo.messaging if we can do stuff to fix things | 19:38 |
*** daemontool has joined #openstack-infra | 19:38 | |
*** YorikSar has quit IRC | 19:38 | |
cloudnull | ++ dims will let you know | 19:38 |
dims | thanks cloudnull | 19:38 |
cloudnull | so far i think its a matter of proper tuning of the elang vm rather than tweaks we can make in oslo/the services | 19:39 |
cloudnull | but ill find out more soon | 19:39 |
dims | cloudnull : ack. odyssey4me pointed me to the last set of tunings made | 19:41 |
*** mylu has joined #openstack-infra | 19:44 | |
*** YorikSar has joined #openstack-infra | 19:45 | |
*** nadya has joined #openstack-infra | 19:51 | |
*** cdent has joined #openstack-infra | 19:52 | |
bkero | Is the dstat log build artifact set up as a system service and then copied into the place where it's picked up as an artifact? I can't find much about it from project-config. | 19:53 |
clarkb | bkero: it runs as a "devstack" service not a system service | 19:54 |
*** burgerk has quit IRC | 19:54 | |
bkero | ah | 19:54 |
openstackgerrit | Michael Johnson proposed openstack-infra/devstack-gate: Add archiving of nova instance console logs https://review.openstack.org/298915 | 19:54 |
clarkb | bkero: basically devstack does semi init duties and keeps track of pids and sets up log files | 19:54 |
bkero | I see | 19:54 |
clarkb | bkero: if you look in devstack you sould be able to find out how it is configured | 19:54 |
bkero | I'm trying to get dstat-like logs to debug downstream ci | 19:54 |
bkero | I might just dstat > /tmp/dstat.log 2>&1, then kill it at the end and drop dstat.log into a place where it's picked up as a build artifact | 19:55 |
*** sdake_ has joined #openstack-infra | 19:55 | |
clarkb | thats basically what evstack does I think | 19:55 |
*** Rockyg has joined #openstack-infra | 19:55 | |
bkero | I think it probably dumps a timestamp on it | 19:55 |
*** eil397 has quit IRC | 19:56 | |
*** ociuhandu has joined #openstack-infra | 19:57 | |
*** cdent has quit IRC | 19:57 | |
*** sdake has quit IRC | 19:58 | |
*** cdent has joined #openstack-infra | 19:58 | |
*** rbrndt_ has quit IRC | 19:59 | |
cody-somerville | fungi: indeed! | 20:00 |
openstackgerrit | Jamie Lennox proposed openstack-infra/project-config: Run the v3 only job in glance https://review.openstack.org/293199 | 20:00 |
*** EricGonc_ has quit IRC | 20:01 | |
*** bdemers has quit IRC | 20:01 | |
AJaeger | pabelanger: could you review https://review.openstack.org/#/c/245297/ , please? You had a question on it and thus I'm waiting with approving... | 20:02 |
pleia2 | fungi: I should have brought up my agenda item much (like, weeks) sooner | 20:02 |
*** gokrokve has joined #openstack-infra | 20:02 | |
*** sdake_ is now known as sdake | 20:02 | |
pabelanger | AJaeger: sure | 20:02 |
anteaya | pleia2: looks like the module patch has some reviews | 20:02 |
*** abregman has quit IRC | 20:02 | |
pleia2 | with release next week, the checksite ceases to be valuable this cycle | 20:02 |
clarkb | puppet people http://logs.openstack.org/55/293155/5/check/gate-infra-puppet-apply-ubuntu-trusty/43fc2fd/console.html#_2016-03-29_16_56_08_864 compared to https://review.openstack.org/#/c/293155/5/modules/openstack_project/manifests/mirror_update.pp makes no sense because I do have a key_content parameter. looking at | 20:02 |
pleia2 | anteaya: yes, finally :) | 20:02 |
clarkb | https://github.com/n1tr0g/golja-gnupg/blob/1.2.2/lib/puppet/provider/gnupg_key/gnupg.rb I can't figure out that error message | 20:02 |
anteaya | pabelanger: do you know where the config for smitespam is? I can't seem to find it | 20:02 |
clarkb | anyone willing to help me debug that? | 20:02 |
pleia2 | anteaya: I had mostly been working on it myself on the infra side | 20:03 |
pabelanger | AJaeger: will +2 but not confident on +A sorry | 20:03 |
anteaya | pleia2: yup, I know it | 20:03 |
*** salv-orlando has joined #openstack-infra | 20:03 | |
fungi | bkero: clarkb: i thought there was a devstack "screen" log for its dstat service | 20:03 |
AJaeger | pleia2: it still can be used for proof-reading, and changes go into next stable release. | 20:03 |
clarkb | fungi: yes but we don't use "screen" :) | 20:03 |
AJaeger | pleia2: but having it early for newton would be nice as well ;) | 20:03 |
clarkb | fungi: it basically acts like an init system its good fun | 20:03 |
pleia2 | AJaeger: yeah, and getting it stabalized + proper error checking for rebuilds will take time anyway | 20:03 |
AJaeger | pleia2: indeed. | 20:04 |
clarkb | fungi: to reproduce the git review thing I have version 1.25.0 | 20:04 |
AJaeger | pleia2: yolanda reviewed this morning and had quite a few comments... | 20:04 |
pleia2 | AJaeger: right now it has essentally no provisions for when devstack-goes-wrong | 20:04 |
*** maishsk has quit IRC | 20:04 | |
pleia2 | AJaeger: yeah, I was thankful for some more eyes on it, thanks yolanda :) | 20:04 |
fungi | clarkb: yeah, i can try to repro in a bit if you don't have time | 20:04 |
*** maishsk has joined #openstack-infra | 20:05 | |
ianw | bkero : enable_service dstat | 20:05 |
yolanda | it was a nice job, just some missing nits | 20:05 |
clarkb | fungi: and I got the number wrong by transposing a couple digits and it mated two repos together | 20:05 |
bkero | ianw: where's that defined? devstack? | 20:05 |
clarkb | fungi: mostly trying to unravel puppet to figure out this gnupg_key error | 20:05 |
fungi | clarkb: wow, that is really strange | 20:05 |
*** salv-orl_ has quit IRC | 20:05 | |
AJaeger | any other nodepool expert that wants to chime in on greghaynes's change to install from source: https://review.openstack.org/#/c/245297/ , please? | 20:05 |
zigo | fungi: Could you please grant me ACLs to create new branches in deb-openstack-pkg-tools? https://review.openstack.org/#/c/298746/ | 20:06 |
zigo | I need it go further on the packaging stuff ... | 20:06 |
ianw | bkero: yes, it should probably be part of your default services. i.e. already there | 20:06 |
clarkb | the best part is the error is telling me I have much to learn | 20:07 |
clarkb | except the error makes no sense | 20:07 |
*** Goneri has quit IRC | 20:07 | |
bkero | ianw: I'm doing this on rdo-manager virthosts. It's not going to be there. :) | 20:07 |
anteaya | clarkb: what does it want you to learn about? | 20:07 |
fungi | zigo: approved, though any of the project-config-core reviewers can approve those | 20:08 |
zigo | fungi: Thanks. | 20:08 |
clarkb | anteaya: Error: Validation of Gnupg_key[Ceph Archive] failed: You need to specify at least one of key_source, key_server, key_content, much to learn, you still have | 20:08 |
anteaya | wow | 20:08 |
pabelanger | anteaya: we'll need to patch puppet-mediawiki to add it | 20:08 |
anteaya | pabelanger: oh okay that would explain why I couldn't find it | 20:08 |
clarkb | but i have key_content right there | 20:08 |
*** gokrokve has quit IRC | 20:08 | |
anteaya | clarkb: what an odd error message | 20:08 |
clarkb | maybe it didn't find the entry in hiera? | 20:08 |
anteaya | pabelanger: have you ever come across any documentation about what the config should look like? | 20:09 |
pabelanger | anteaya: https://www.mediawiki.org/wiki/Extension:SmiteSpam | 20:10 |
anteaya | thanks | 20:10 |
*** rbrndt_ has joined #openstack-infra | 20:12 | |
*** esker has quit IRC | 20:12 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Apt mirror for ceph hammer release https://review.openstack.org/293155 | 20:12 |
clarkb | hopefully that was it | 20:12 |
*** esker has joined #openstack-infra | 20:13 | |
mmedvede | pabelanger: have you already try to run d-g on xenial? | 20:13 |
*** jsavak has joined #openstack-infra | 20:13 | |
*** Sukhdev has joined #openstack-infra | 20:13 | |
pabelanger | mmedvede: not yet. Mostly focused on getting our CI tooling working first | 20:13 |
mmedvede | pabelanger: I am asking because I found a problem with lvm on it | 20:13 |
clarkb | fungi: I will work on reproducing the git review issue now that I pusehd latest 293155 patchset up | 20:14 |
mmedvede | pabelanger: so tempest was failing with volume snapshot tests timing out | 20:14 |
openstackgerrit | Merged openstack-infra/project-config: Add create option to deb-openstack-pkg-tools ACL https://review.openstack.org/298746 | 20:14 |
mmedvede | pabelanger: ok. So then fyi: https://bugs.launchpad.net/ubuntu/+source/lvm2/+bug/1561228 | 20:14 |
openstack | Launchpad bug 1561228 in lvm2 (Ubuntu) "dmevent can not open shared object file libdevmapper-event-lvm2snapshot.so leads to lvcreate/lvremove being slow" [Undecided,New] | 20:14 |
pabelanger | mmedvede: sure, going to try d-g today, if possible | 20:15 |
mgagne | is logs.o.o a host running apache and proxying requests to swift when needed? my question is: what about huge file? is it working well? | 20:15 |
clarkb | fungi: zaro jeblair http://paste.openstack.org/show/492356/ that look broken to you? | 20:15 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 20:15 |
clarkb | mgagne: yes it proxies to swift for some files, many files are on disk though. It mostly works. The biggest issues we have had are that swift doesn't track mod times for the fake dir things | 20:16 |
mmedvede | pabelanger: do you mind me following up with you later this week on how your d-g test went? | 20:16 |
jeblair | clarkb: that looks weird. that does not happen for me. | 20:16 |
mgagne | right, I don't care much about modtime. I'm looking to upload binary to Swift and was looking at swift support in Zuul for that | 20:17 |
pabelanger | mmedvede: sure | 20:17 |
clarkb | huh I just tried the git review -d thing again and it worked, not sure which exact change I used when it broke | 20:17 |
fungi | clarkb: i'm starting to think your computer has it in for you | 20:17 |
jesusaur | clarkb: your paste looks like you may have hit a race condition, a change merged 2 min ago according to https://review.openstack.org/gitweb?p=openstack-infra/project-config.git;a=summary and your sha is HEAD~1 | 20:18 |
clarkb | fungi: its possible I was also sleep deprived and misunderstanding the output of git reivew | 20:18 |
fungi | clarkb: i ran the same git clone from your paste and it definitely did not try to checkout e86217d when it finished | 20:18 |
clarkb | jesusaur: fun | 20:18 |
*** zeih has joined #openstack-infra | 20:19 | |
*** ericksonsantos has joined #openstack-infra | 20:19 | |
clarkb | anyways I can no longer reproduce the git review -d thing so I was probably high or half alseep | 20:19 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 20:19 |
fungi | interesting. yeah i wonder if git clone gets confused if head moves while it's cloning | 20:19 |
waynr | anteaya: thanks for the reminder, i'll add a note now...$dayjob has been crazy | 20:20 |
*** imcsk8 is now known as imcsk8|afk | 20:20 | |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 20:21 |
*** achanda has quit IRC | 20:21 | |
anteaya | waynr: yup, it just came up at today's meeting that next week we start deciding slots | 20:21 |
anteaya | waynr: so get on the board | 20:21 |
anteaya | :) | 20:21 |
zaro | clarkb: that git clone worked fine for me as well. | 20:21 |
clarkb | jeblair: mordred pabelanger reading http://docs.openstack.org/infra/system-config/afs.html#creating-a-volume I think I want to use afs01.dfw for the rw volume because that is where the reprepro mirror server is. Also how does one check that the server hsa enough space? df ? or some afs thing? | 20:21 |
clarkb | zaro: ya Ithink jesusaur may be onto something, clones racing HEAD updates | 20:21 |
pabelanger | clarkb: I was able to use afsdb01 IIRC | 20:23 |
pabelanger | but you need to use /afs/.openstack/... | 20:23 |
pabelanger | for RW | 20:23 |
clarkb | /dev/mapper/main-vicepa 985G 349G 636G 36% /vicepa | 20:23 |
jeblair | clarkb: yes, dfw is probably best for now for that reason. | 20:23 |
*** |-paul-| has joined #openstack-infra | 20:23 | |
clarkb | pabelanger: on the mkmount step? is there a docs update to fix the docs? | 20:24 |
jeblair | clarkb: and yes, that works; also some afs commands will give you the same info (as partition % used) | 20:24 |
jeblair | clarkb, pabelanger: i think clarkb was saying that he should locate the volume on afs01.dfw. pabelanger is saying he could run the commands from afs01db. | 20:24 |
pabelanger | clarkb: right, the fs mkmount command should use /afs/.openstack.org for RW. I had a patch locally for it, I don't think I pushed it up | 20:25 |
jeblair | (both things are correct, just wanted to make sure you weren'tt talking past each other) | 20:25 |
clarkb | gotcha | 20:25 |
zaro | fungi: maybe something to keep on eye on for next time a git repo is unaccesible, https://mail.google.com/mail/u/0/#inbox/153bf62a41f784a9 | 20:26 |
*** eil397 has joined #openstack-infra | 20:26 | |
clarkb | ok last question hopfeully, how do I list the volume names so that I use something similar to what is already in place? | 20:26 |
zaro | it does seem to correlate to when the cron job runs repack. | 20:26 |
*** mcarden_ is now known as mcarden | 20:26 | |
*** bdemers has joined #openstack-infra | 20:26 | |
*** EricGonczer_ has joined #openstack-infra | 20:28 | |
fungi | zaro: wow, to read that i need a google account | 20:29 |
fungi | zaro: is it a mailing list archive or something? | 20:29 |
zaro | oops. wrong link. | 20:29 |
*** gokrokve has joined #openstack-infra | 20:29 | |
zaro | fungi: that was a copy/paste fail, here's the correct one https://groups.google.com/d/msg/repo-discuss/g2W-m12fwPs/EEsR3H5MEAAJ | 20:30 |
*** jtomasek_ has joined #openstack-infra | 20:30 | |
*** eil397 has quit IRC | 20:30 | |
*** eil397 has joined #openstack-infra | 20:30 | |
clarkb | jeblair: mordred pabelanger is listvldb's mirror.ubuntu mirror.pyi etc showing me the names of the volumes or is that just a path? | 20:31 |
fungi | zaro: thanks! i seem to be able to read that just fome | 20:31 |
fungi | er, fine | 20:31 |
anteaya | I like fome | 20:31 |
pabelanger | clarkb: name of volume | 20:31 |
fungi | anteaya: i do too sometimes | 20:31 |
anteaya | ha ha ha | 20:31 |
clarkb | pabelanger: so in this case I want to call it mirror.deb.ceph? | 20:31 |
*** jtomasek_ has quit IRC | 20:32 | |
*** kgiusti has left #openstack-infra | 20:32 | |
*** gyee has joined #openstack-infra | 20:32 | |
waynr | anteaya: okay, I have updated the etherpad let me know if any further clarification is required--I'll make a note to myself to attend next week's infra meeting | 20:32 |
fungi | zaro: the other missing detail is that the supposedly missing commit was still right there on disk, gerrit had just decided it wasn't for some reason | 20:32 |
*** annegentle has quit IRC | 20:32 | |
*** Rocky_g has joined #openstack-infra | 20:32 | |
*** bdemers_ has joined #openstack-infra | 20:33 | |
*** annegentle has joined #openstack-infra | 20:33 | |
anteaya | waynr: yes be here at next week's infra meeting, I will not be here | 20:33 |
pabelanger | clarkb: you create volume first, then use mkmount on the volume | 20:33 |
*** sridhar_ram1 has joined #openstack-infra | 20:33 | |
anteaya | waynr: but folks with questions probably won't ask them prior to the meeting | 20:33 |
clarkb | pabelanger: yup, I am just trying to think that we might have a deb mirror and a rpm and so on | 20:33 |
*** sridhar_ram has quit IRC | 20:33 | |
clarkb | pabelanger: so the name would be mirror.deb.cpeh ? | 20:33 |
jeblair | clarkb: name of volume | 20:33 |
fungi | zaro: but logged into gerrit locally in i could git show that sha just fine in the appropriate repo under ~gerrit2/review_site/git/ | 20:33 |
anteaya | waynr: so your attendance is helpful in you getting some sort of slot | 20:33 |
waynr | cool | 20:33 |
_ody | Been seening sporadic git clone issues today. http://logs.openstack.org/57/296557/24/check/gate-puppet-openstack-integration-3-scenario001-tempest-ubuntu-trusty/c74c92b/console.html#_2016-03-29_19_43_19_232 showing about 5 minutes a repo. | 20:33 |
clarkb | then the path could be /afs/.openstack.org/mirror/deb/ceph | 20:34 |
waynr | thanks again for the heads up! | 20:34 |
*** gokrokve has quit IRC | 20:34 | |
pabelanger | clarkb: so, what will the debian volume look like when we bring it (if) online | 20:34 |
jeblair | clarkb: do we need deb? | 20:34 |
clarkb | jeblair: if we decide to have an rpm mirror at some point? | 20:34 |
jeblair | (we have mirror/ubuntu) | 20:35 |
jeblair | (so i would expect mirror/fedora; mirror/debian; mirror/ceph) | 20:35 |
clarkb | jeblair: is it safe to write into mirror/ubuntu if not mirroring ubuntu?? | 20:35 |
clarkb | oh I see | 20:35 |
clarkb | hrm | 20:35 |
anteaya | waynr: welcome | 20:35 |
clarkb | jeblair: so you are saying flip it around, mirror/ceph/deb ? | 20:35 |
jeblair | clarkb: i think i see where're you are coming from | 20:35 |
jeblair | yeah, maybe? | 20:36 |
*** bdemers has quit IRC | 20:36 | |
*** Rockyg has quit IRC | 20:36 | |
jeblair | mirror/thing-being-mirrored/format(if needed) ? | 20:36 |
fungi | or mirror/debian-ceph? | 20:36 |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: create api-ref publishing pipeline https://review.openstack.org/298888 | 20:36 |
jeblair | fungi: or that | 20:36 |
fungi | keeping our package mirrors at a consistent hierarchy depth is appealing, if perhaps not entirely necessary | 20:37 |
clarkb | ya I can do it that way | 20:37 |
*** sigmavirus24 is now known as sigmavirus24_awa | 20:37 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 20:37 | |
fungi | might make certain types of globbing across trees easier in the future for example | 20:37 |
fungi | but i'll admit it leans toward bikeshedding or premature optimization so i don't feel strongly either way | 20:37 |
clarkb | well I just don't want to have to unravel a bunch of stuff in a week | 20:38 |
*** baoli has joined #openstack-infra | 20:39 | |
ericksonsantos | Hi, everyone! Does someone know if there is a problem with tests I use a library that doesn't follow PEP8 guidelines inside OpenStack? | 20:39 |
ericksonsantos | For example, suppose I want to use a library, called A, inside a driver in one service, but there's a class named 'xpto' which isn't in CapWords convention, as suggested by PEP8 guidelines. So, if I create an instance of xpto inside the OpenStack driver, the PEP8 tests will crash? | 20:39 |
ericksonsantos | sorry if it is a dumb question. | 20:40 |
mgagne | when using Zuul templates, can a list be used as a variable so it expands all the job names? | 20:40 |
clarkb | ericksonsantos: no shouldnt be a problem | 20:40 |
clarkb | its even more complicated because ceph does a different repo per release | 20:41 |
ericksonsantos | clarkb, thank you! | 20:41 |
clarkb | so I think we want mirror.debian-ceph-hammer as the volume name and approximate path | 20:42 |
fungi | clarkb: wow, that's some extra crazy to deal with | 20:42 |
*** asettle has joined #openstack-infra | 20:43 | |
*** tiswanso_ has joined #openstack-infra | 20:43 | |
clarkb | hrm | 20:43 |
*** baoli_ has joined #openstack-infra | 20:43 | |
clarkb | would we need a different reprepro config for each of them? | 20:43 |
pabelanger | clarkb: keep in mind there is a char limit on volume names | 20:45 |
*** baoli has quit IRC | 20:45 | |
*** tiswanso has quit IRC | 20:45 | |
pabelanger | 24 I think | 20:45 |
jeblair | 22 | 20:46 |
pabelanger | right | 20:46 |
clarkb | ya each ceph release has a different repo | 20:47 |
clarkb | so I think we would want a different reprepro setup for each | 20:47 |
clarkb | which means I need to reorg this mirror change a bit to be more explicit | 20:47 |
jeblair | clarkb: i think so... mordred ^ sound right? | 20:47 |
clarkb | and we will probably want a different volume for each and different mount path, fun | 20:47 |
sdague | for the ceph mirror the ubuntu side of this is really the blocker from the nova team side, that's the job that will likely be voting | 20:47 |
*** pradk_ has joined #openstack-infra | 20:48 | |
sdague | so it's fine to punt the rpm issue until later | 20:48 |
clarkb | sdague: ya its not even the rpm issue | 20:48 |
*** gokrokve has joined #openstack-infra | 20:48 | |
*** pradk has quit IRC | 20:48 | |
clarkb | sdague: each ceph release has a different ubunt repo | 20:48 |
sdague | ah, ok | 20:48 |
clarkb | so we hav eto solve this generally regardless | 20:48 |
sdague | right | 20:48 |
mordred | yah. I agree with teh above | 20:49 |
mordred | that said - we don't necessarily have to do more than one AFS volume | 20:49 |
pabelanger | fungi: just stepping away for a few minutes, let me know how you would like to proceed with zuul.o.o | 20:49 |
mordred | we could put all of the ceph repos on one volume and release at the same time | 20:49 |
mordred | or we might not want to do that | 20:49 |
mordred | we shoudl design it | 20:49 |
jeblair | mordred, clarkb: the volume boundary shuold correspond to the build unit | 20:49 |
*** pradk has joined #openstack-infra | 20:49 | |
mordred | kk | 20:49 |
openstackgerrit | Merged openstack-infra/project-config: Don't use neutron with centos7-minimal https://review.openstack.org/298503 | 20:50 |
jeblair | so if we're going to run a bunch of reprerpros together, we can do them in one volume, but if we want them to be separate (parallel-ish?) then separate volumes | 20:50 |
jeblair | because the release-to-read-only-volume action is at the volume level | 20:50 |
mordred | yah | 20:50 |
fungi | pabelanger: sure, can work through it as soon as you're back. was mostly trying to follow the tc meeting, and cross-project specs meeting up next | 20:51 |
*** jamesmcarthur has quit IRC | 20:51 | |
*** kzaitsev_mb has quit IRC | 20:51 | |
*** kzaitsev_mb has joined #openstack-infra | 20:51 | |
*** rlandy has joined #openstack-infra | 20:52 | |
clarkb | right they should be separate in this case because hammer may update separately from whatever is after hammer | 20:52 |
*** pradk_ has quit IRC | 20:52 | |
*** imcsk8|afk is now known as imcsk8 | 20:53 | |
*** Goneri has joined #openstack-infra | 20:53 | |
clarkb | and mirror.debian-ceph-hammer is too long | 20:54 |
clarkb | mirror.deb.hammer ? | 20:54 |
clarkb | or are .'s implicit /s? | 20:54 |
*** ayoung has quit IRC | 20:54 | |
*** pradk_ has joined #openstack-infra | 20:54 | |
*** pradk_ has quit IRC | 20:54 | |
pabelanger | I used . when I created the centos wheel volume | 20:56 |
pabelanger | fungi: okay, back | 20:56 |
clarkb | pabelanger: jeblair is there a similar tiny limit to path names? | 20:57 |
*** shardy_afk has quit IRC | 20:57 | |
*** pradk has quit IRC | 20:57 | |
jeblair | clarkb: nope | 20:57 |
clarkb | ok I think mirror/debian-ceph-hammer for the path and mirror.deb-hammer for the volume name | 20:58 |
clarkb | but first let me push up the reprepro reconfigurations to make sure I am not crazy | 20:58 |
openstackgerrit | Matt Riedemann proposed openstack/requirements: Bump upper-constraint for python-novaclient to 3.4.0 https://review.openstack.org/298979 | 20:59 |
*** Sukhdev has quit IRC | 21:01 | |
*** jaypipes has quit IRC | 21:02 | |
*** Sukhdev has joined #openstack-infra | 21:03 | |
smarcet | fungi: hey i am trying to understand the error here https://review.openstack.org/#/c/298699/ but it seems that is not related to puppet syntax o_0 | 21:03 |
fungi | mordred: heads up (ptl!), i added zigo to the deb-packaging-release group so that he can create release branches in openstack/deb-openstack-pkg-tools | 21:03 |
mordred | fungi: great | 21:05 |
* fungi follows protocol | 21:05 | |
lifeless | dims: how long till mitaka is 'shipped' ? | 21:05 |
lifeless | dims: also, relatedly, wsgi scripts in wheels is broken in pbr and mitaka kindof needs that ... | 21:06 |
fungi | smarcet: the errors i see look related "Error: Failed to parse template openstackid/vhost.erb..." | 21:06 |
dims | lifeless : 4-8 APR (https://etherpad.openstack.org/p/mitaka-release-tracking) | 21:06 |
fungi | smarcet: "Could not find value for 'docroot' at /etc/p | 21:06 |
lifeless | lets ask ttx and dhellmann their thoughts | 21:06 |
fungi | uppet/modules/openstackid/templates/vhost.erb:39" | 21:06 |
fungi | oops, stray newline | 21:06 |
smarcet | fungi: oh ok i will take a look then | 21:06 |
jeblair | smarcet: | 21:06 |
smarcet | thx :0 | 21:06 |
jeblair | Detail: Could not find value for 'docroot' at /etc/puppet/modules/openstackid/templates/vhost.erb:39 | 21:06 |
zigo | mordred: How do I set a branch as default? | 21:06 |
jeblair | smarcet: ah fungi beat me to it | 21:07 |
smarcet | jeblair:fungi: its weird bc that part already exist on former version | 21:07 |
zigo | I mean, how do I get HEAD to point at debian/mitaka for example? | 21:07 |
clarkb | zigo: you don't | 21:07 |
zigo | clarkb: ?!? | 21:07 |
*** sridhar_ram1 has quit IRC | 21:07 | |
fungi | zigo: head stays as master, you checkout whichever branch you want after cloning if it's not master | 21:08 |
zigo | clarkb: It's not possible to issue something like git symbolic-ref ? | 21:08 |
zigo | k | 21:08 |
clarkb | yes beacue gerrit (and git in general) does not replicate that on pushes | 21:08 |
zigo | Well, it got debian/liberty as HEAD. | 21:08 |
clarkb | so we avoid doing it entirely | 21:08 |
clarkb | it just causes problems for little benefit when checkout foo is easy | 21:08 |
*** cloudtrainme has quit IRC | 21:09 | |
fungi | zigo: if the repo which was imported had a non-master HEAD then that may have confused the import process | 21:09 |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Apt mirror for ceph hammer release https://review.openstack.org/293155 | 21:09 |
zigo | fungi: This is the case indeed. | 21:09 |
fungi | it definitely breaks if master doesn't exist, but there may be a corner case there if it imports a repo with a non-master HEAD while master also exists | 21:09 |
*** nadya has quit IRC | 21:09 | |
zigo | fungi: I don't use "master", because that's what upstream uses... | 21:09 |
dhellmann | fungi , anteaya : was zuul restarted? is it safe to cut releases or should i wait? | 21:09 |
*** pradk has joined #openstack-infra | 21:09 | |
jeblair | smarcet: http://logs.openstack.org/99/298699/9/check/gate-infra-puppet-apply-ubuntu-trusty/0469cd6/puppetapplytest43.final.out is the easiest place to see the error | 21:09 |
*** sridhar_ram has joined #openstack-infra | 21:10 | |
zigo | fungi: There shouldn't be any master branch at all in fact. | 21:10 |
clarkb | mordred: jeblair pabelanger ^ reviewing that for afs + reprepro sanity would likely be a good idea. the gnupg_key resource is still mad about my key for some reason but I can work on that separately | 21:10 |
smarcet | jeblair: roger thx | 21:10 |
fungi | dhellmann: sorry, been absorbed in meetings. i was going to walk pabelanger through it when he gets back in a few | 21:10 |
dhellmann | fungi : np, that's why I was checking :-) | 21:10 |
dhellmann | fungi : these will keep until morning, so I'm just going to wait | 21:10 |
ttx | lifeless: it's "shipped" on April 7 | 21:11 |
pabelanger | fungi: back now, when you are ready | 21:11 |
ttx | until then we may still update one thing or another | 21:11 |
ttx | although less and less likely | 21:11 |
*** richm has joined #openstack-infra | 21:11 | |
pleia2 | fungi: btw, I could use a once through myself if this can be a group zuul restart | 21:11 |
*** esikachev has joined #openstack-infra | 21:11 | |
lifeless | ttx: we're considering a pbr release | 21:11 |
fungi | pleia2: pabelanger: may be easiest then if we share a screen session as root. i'll start one | 21:12 |
ttx | lifeless: post-release ? | 21:12 |
lifeless | ttx: now | 21:12 |
*** edmondsw has quit IRC | 21:12 | |
ttx | to do what ? | 21:12 |
lifeless | http://logs.openstack.org/84/298484/1/check/gate-releases-tox-list-changes/d8e9106/console.html#_2016-03-29_01_28_48_365 | 21:12 |
*** ybathia has joined #openstack-infra | 21:12 | |
fungi | pleia2: pabelanger: ssh zuul; sudo su -; screen -x | 21:12 |
richm | hello - this question isn't directly related to openstack infra, it relates to jenkins job builder + github plugin | 21:13 |
*** eil397 has quit IRC | 21:13 | |
pleia2 | fungi: thanks | 21:13 |
*** eil397 has joined #openstack-infra | 21:13 | |
pabelanger | pleia2: fungi: connected | 21:13 |
fungi | i offered to start the screen session because my screen is likely the smallest of all of us ;) | 21:13 |
lifeless | key changes - wsgi_scripts in wheels and dealing with older versions of setuptools | 21:13 |
fungi | tmux handles that far better, but this will work for now | 21:13 |
richm | the jjb section for the github plugin is pretty much useless - http://docs.openstack.org/infra/jenkins-job-builder/triggers.html#triggers.github | 21:13 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 21:14 |
ttx | lifeless: any reason why we'd need to have that pre-release rather than postrelease ? | 21:14 |
lifeless | hmmm, I think there's another key change missing. | 21:14 |
pabelanger | fungi: pleia2: I am fine to monitor this time around in screen | 21:14 |
richm | how can I find out how to use the github plugin with jjb? | 21:14 |
lifeless | ttx: mitaka introduced the wsgi_scripts thing didn't it? I figured it probably requires it ;) | 21:14 |
pleia2 | fungi: 80x24 forever | 21:14 |
*** Sukhdev has quit IRC | 21:14 | |
fungi | pabelanger: pleia2: i'll let one of you drive. so we're all on the same page, the plan is this... | 21:15 |
fungi | pabelanger: pleia2: we want to restart zuul with this change manually patched in place https://review.openstack.org/298308 | 21:15 |
ttx | lifeless: well, it's a bit late for that imho | 21:16 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Wait for mysql cluster in HA job https://review.openstack.org/298986 | 21:16 |
dhellmann | lifeless : we should move the pbr release discussion to #openstack-release | 21:16 |
ttx | R-1 week is not the best moment to roll an openstack-wide dep like pbr | 21:16 |
*** ldnunes has quit IRC | 21:16 | |
lifeless | k | 21:16 |
fungi | pabelanger: pleia2: basic process... make a private clone of zuul, checkout or cherry-pick that change (i don't know if the repo has moved since it was proposed), then pip install that directory | 21:16 |
pabelanger | fungi: sure, did you want to drive pleia2 or me? | 21:16 |
pleia2 | pabelanger: go for it | 21:16 |
pabelanger | kk | 21:17 |
pleia2 | I'm pretty comfortable with manually applying changes like this | 21:17 |
pabelanger | pleia2: fungi: any special place to clone? | 21:17 |
jeblair | richm: follow the link to "GitHub Plugin" at https://wiki.jenkins-ci.org/display/JENKINS/GitHub+Plugin to find out what those options mean | 21:17 |
pleia2 | pabelanger: can just do it in home | 21:18 |
fungi | pabelanger: pleia2: once we've got that installed, we'll see if the queue looks ripe for a dump and restart or if we should wait a minute or two for something to land | 21:18 |
jeblair | richm: we don't try to fully document the plugins themselves, just what yaml to use to get the configuration options in the jenkins gui | 21:18 |
*** smarcet has quit IRC | 21:18 | |
richm | jeblair: so is there some way I can go to Configure in the gui, and configure it there, then dump the yaml for that configuration? | 21:19 |
*** dprince has quit IRC | 21:19 | |
jeblair | richm: if you look at the resulting xml in jenkins, you can probably get close. i don't think there's a reverse-jjb though. | 21:19 |
pabelanger | fungi: pleia2: that the right syntax for pip? | 21:19 |
*** devkulkarni has joined #openstack-infra | 21:20 | |
richm | jeblair: how can I look at the resulting xml? | 21:20 |
fungi | pabelanger: pleia2: yeah, the only thing to merge to zuul since that change was created was a minor fix to some tests, so irrelevant for this situation anyway | 21:20 |
fungi | pabelanger: not -e | 21:20 |
fungi | also you didn't need to cd .. | 21:20 |
jeblair | richm: look on disk in jenkins | 21:20 |
fungi | you can just `pip install .` to install the pwd | 21:20 |
pabelanger | fungi: pleia2: okay, ready to run the command? | 21:20 |
pleia2 | pabelanger: yep | 21:21 |
*** baoli_ has quit IRC | 21:21 | |
clarkb | jeblair: I think arch specifics are handled by reprepro/apt see http://download.ceph.com/debian/dists/trusty/ | 21:21 |
*** esikachev has quit IRC | 21:21 | |
*** achanda has joined #openstack-infra | 21:21 | |
pabelanger | pleia2: fungi guess we need pip -U ? | 21:21 |
*** baoli has joined #openstack-infra | 21:21 | |
pabelanger | pip install -U | 21:22 |
jeblair | clarkb: yeah, i vaguely meant our "distro-ceph" release-release combo | 21:22 |
fungi | pabelanger: yeah, sorry, add -U | 21:22 |
jeblair | clarkb: basically i'm just saying "do we want to put all the ceph stuff under one directory so that mirror/ stays cleanish" | 21:22 |
clarkb | jeblair: gotcha | 21:23 |
jeblair | clarkb: i do not have a strong opinion | 21:23 |
*** eil397 has quit IRC | 21:23 | |
*** smarcet has joined #openstack-infra | 21:23 | |
pabelanger | fungi: pleia2: better | 21:23 |
pleia2 | pabelanger: cool, looks good | 21:23 |
clarkb | I can think about that more whne I figure out why puppet is still being braindead with the gpg key | 21:23 |
richm | jeblair: ok - thanks - do you know of an example of using a jenkins github plugin to trigger a job based on a github merge or tag push event? | 21:23 |
jeblair | richm: no, i don't use github | 21:23 |
*** IlyaG has joined #openstack-infra | 21:24 | |
clarkb | http://logs.openstack.org/55/293155/7/check/gate-infra-puppet-apply-ubuntu-trusty/3c09819/console.html#_2016-03-29_21_18_33_322 does not look like a public key, if I load the key directly using pyyaml and compare to the actual contents from ceph it looks correct... time to dig more | 21:24 |
devkulkarni | Hi infra team, solum's devstack gate is currently failing.. I want to chat/brainstorm with someone in this regard.. is this the right channel for that? | 21:24 |
fungi | pabelanger: pleia2: there's a slew of changes about to land in the gate pipeline, so maybe give that a sec before we go further | 21:26 |
pleia2 | fungi: are you just looking at the zuul status page for this? | 21:26 |
sdake | anyone know how i fin the channel owner in irc? | 21:26 |
pleia2 | sdake: /msg chanserv info #channel | 21:26 |
clarkb | devkulkarni: yes this is usually a decent place to start at least | 21:26 |
fungi | pleia2: correct | 21:26 |
devkulkarni | clarkb: thanks | 21:26 |
sdake | fin/find | 21:27 |
*** mtanino__ has joined #openstack-infra | 21:27 | |
*** achanda has quit IRC | 21:27 | |
richm | jeblair: thanks | 21:27 |
sdake | jeblair looks like you were thinkingahead with openstack-kolla | 21:28 |
*** baoli has quit IRC | 21:28 | |
jeblair | sdake: once you find them, you can fin them, i guess, if it's legal in your jurisdiction... | 21:28 |
jeblair | sdake: oh please don't fin me! | 21:28 |
*** julim has quit IRC | 21:28 | |
sdake | finish tem ? :) | 21:28 |
*** baoli has joined #openstack-infra | 21:28 | |
*** zeih has quit IRC | 21:28 | |
sdake | jeblair what i the magic incantation to make #kolla point to #openstack-kolla | 21:28 |
*** eil397 has joined #openstack-infra | 21:28 | |
jeblair | mortal kombat | 21:29 |
sdake | jeblair or could you do that for me? :) | 21:29 |
jeblair | sdake: oh pleia2 knows how to do that... i think maybe she documented it.... | 21:29 |
pleia2 | http://docs.openstack.org/infra/system-config/irc.html#renaming-an-irc-channel | 21:29 |
clarkb | nibalizer: jeblair the puppet apply test doesn't seem to use the built in hiera file. Is that something that we have done work to do? | 21:29 |
sdake | i am not in the group for openstack-kolla | 21:29 |
*** ybathia has quit IRC | 21:29 | |
clarkb | er jesusaur not jeblair | 21:29 |
jeblair | pleia2: yep! found it! | 21:30 |
*** ybathia has joined #openstack-infra | 21:30 | |
*** ybathia has quit IRC | 21:30 | |
nibalizer | built in? | 21:30 |
nibalizer | the locla hiera? it should be using | 21:30 |
clarkb | nibalizer: system-config/hiera/common.yaml | 21:30 |
clarkb | nibalizer: it is not using it | 21:30 |
nibalizer | ya | 21:30 |
nibalizer | hrm | 21:30 |
nibalizer | you're getting the errror on the elasticsearch nodes? | 21:30 |
jeblair | sdake, pleia2: i will follow those instructions now for #kolla -> #openstack-kolla | 21:30 |
clarkb | nibalizer: that works fine, but there are seds for all hiera lookups | 21:30 |
devkulkarni | clarkb: this is the gate failure log: http://logs.openstack.org/44/296644/2/check/gate-solum-devstack-dsvm/c6207b4/console.html#_2016-03-28_15_57_38_886 .. I have tried couple of things to fix the issue (this bug comment has the details: https://bugs.launchpad.net/solum/+bug/1563019) .. I want to know what would be the correct solution to address the gate failure | 21:31 |
sdake | jeblair thanks if there is anythign you need let me know | 21:31 |
clarkb | nibalizer: see tools/apply-test.sh | 21:31 |
openstack | Launchpad bug 1563019 in Solum "devstack-gate-failure-due-to-screen-n-dhcp-log-not-found" [Critical,New] - Assigned to Devdatta Kulkarni (devdatta-kulkarni) | 21:31 |
*** richm has left #openstack-infra | 21:31 | |
sdake | i dont hve permissions to #kolla either | 21:31 |
sdake | because i don't know my damn freenode pwd | 21:31 |
clarkb | nibalizer: anyways it seems that that is why my change is failing on the gpg key | 21:31 |
*** eharney has quit IRC | 21:31 | |
nibalizer | clarkb: change number? | 21:31 |
clarkb | nibalizer: 293155 | 21:31 |
clarkb | devkulkarni: /home/jenkins/workspace/gate-solum-devstack-dsvm/logs/screen-n-dhcp.txt does not exist | 21:32 |
clarkb | devkulkarni: so we need to work backward from there and figure out why | 21:32 |
*** thorst has quit IRC | 21:33 | |
*** dimtruck is now known as zz_dimtruck | 21:33 | |
pabelanger | clarkb: nibalizer: I started on 239783 but need to loop back to it for intree testing of hiera | 21:33 |
*** EricGonczer_ has quit IRC | 21:33 | |
*** thorst has joined #openstack-infra | 21:33 | |
pabelanger | but requires we add testing hiera data into system-config | 21:33 |
*** _ari_ has quit IRC | 21:34 | |
pabelanger | fungi: pleia2: brb | 21:34 |
pleia2 | sdake: if you want to retrieve your password, can do it via: /msg nickserv help sendpass | 21:34 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 21:34 |
nibalizer | clarkb: ah so your analysis is correct | 21:35 |
nibalizer | the seds futz it up | 21:35 |
*** sdake_ has joined #openstack-infra | 21:35 | |
nibalizer | its like we need a way of marking some hiera calls so they don't get sed'd (when we intend for local hiera to be used) | 21:35 |
*** cloudtrainme has joined #openstack-infra | 21:35 | |
pabelanger | fungi: pleia2: back | 21:36 |
openstackgerrit | Rodrigo Duarte proposed openstack-infra/project-config: Enable non-voting keystone tempest plugin tests https://review.openstack.org/298696 | 21:36 |
pleia2 | pabelanger: this watched pot is not boiling ;) | 21:36 |
clarkb | nibalizer: I would append dummy key values to common.yaml | 21:36 |
* pleia2 continues to wait for the queue | 21:36 | |
clarkb | nibalizer: basically if not in common.yaml add it | 21:36 |
fungi | pabelanger: pleia2: these couple of jobs are definitely running slow for some reason. if that top one fails we'll just go ahead with the restart | 21:36 |
pleia2 | fungi: nods | 21:36 |
clarkb | devkulkarni: in http://logs.openstack.org/44/296644/2/check/gate-solum-devstack-dsvm/c6207b4/logs/devstack-gate-cleanup-host.txt you can see it says that file doesn't exist either | 21:37 |
nibalizer | clarkb: thats dangerous | 21:37 |
nibalizer | it's like having the defaults | 21:37 |
devkulkarni | clarkb: right.. so couple of things .. 1) the issue seems to have started happening only recently. for instance, if you check this log, which is from a merged patch, http://logs.openstack.org/40/293640/6/check/gate-solum-devstack-dsvm/dd0b1f5/logs/, notice that screen-n-dhcp.txt.gz is an empty file. 2) in our code, we are not doing anything related to n-dhcp. in fact, to resolve this issue, I explicitly tried add | 21:37 |
nibalizer | if we screw up our private hiera we'll put dummy values in to sensitive things | 21:37 |
clarkb | devkulkarni: are you running devstack? if so I think devstack is repsonsible for that | 21:37 |
clarkb | nibalizer: you only do it in the test run | 21:38 |
*** zeih has joined #openstack-infra | 21:38 | |
*** thorst has quit IRC | 21:38 | |
clarkb | nibalizer: basically instead of running that sed in the test run you run a update common.yaml for testing step | 21:38 |
nibalizer | ya | 21:38 |
*** sdake has quit IRC | 21:38 | |
*** amitgandhinz has quit IRC | 21:38 | |
nibalizer | basically cat fake.yml >> common.yaml in the apply test? | 21:38 |
devkulkarni | clarkb: yes, this is from the devstack gate log | 21:39 |
clarkb | devkulkarni: in this case I think that there is a symlink because apparently we only copy the symlinks | 21:40 |
*** cody-somerville has quit IRC | 21:40 | |
clarkb | devkulkarni: but whatever is pointed to either does not exist or does not hae permissions allowing us to read it | 21:40 |
*** dizquierdo has joined #openstack-infra | 21:40 | |
*** bdemers_ has quit IRC | 21:40 | |
devkulkarni | clarkb: I see. | 21:40 |
jeblair | pleia2: should i kick everyone from the old channel once that's done? (cc: sdake_ ) | 21:41 |
devkulkarni | clarkb: the part of the code where this is happening is probably devstack/lib/nova https://github.com/openstack-dev/devstack/blob/master/lib/nova#L630 | 21:41 |
sdake_ | jeblair if its not too much trobule you might say "hey I'm kicking you from the hannel, please rejoin immidately and things willbe back to normal | 21:42 |
sdake_ | or use your own words | 21:42 |
sdake_ | whatever makes sense | 21:42 |
*** dizquierdo has quit IRC | 21:42 | |
sdake_ | i dont have voice int he channel so i can't say anything atm | 21:42 |
pleia2 | jeblair: sometimes I nickname: everyone a message to avoid an immediate kick and wait a day, but that's kind of a preference thing | 21:42 |
*** dizquierdo has joined #openstack-infra | 21:42 | |
sdake_ | pleia2 knows best practice here it sounds like | 21:42 |
*** esker has quit IRC | 21:43 | |
sdake_ | but ya we need people in one channel soon ;) | 21:43 |
clarkb | devkulkarni: https://github.com/openstack-dev/devstack/blob/master/lib/nova#L638 is what we are relying on working there | 21:43 |
*** knikolla has quit IRC | 21:43 | |
*** fawadkhaliq has joined #openstack-infra | 21:44 | |
clarkb | devkulkarni: and the symlink does seem to be repsent otherwise we couldn't copy it at all with our find | 21:44 |
jeblair | pleia2, sdake_: ok, i'll Nick: msg everyone for now | 21:44 |
clarkb | devkulkarni: I think the target side may be unreadable | 21:44 |
jeblair | then maybe tomorrow kick them | 21:44 |
*** regXboi has quit IRC | 21:45 | |
clarkb | devkulkarni: if you use http://logs.openstack.org/44/296644/2/check/gate-solum-devstack-dsvm/c6207b4/logs/reproduce.sh you should be able to inspect it locally | 21:45 |
devkulkarni | clarkb: probably you are right. the link target is probably unreadable. any ideas/suggestions on where/what to fix? | 21:45 |
devkulkarni | clarkb: ah I see | 21:45 |
clarkb | devkulkarni: the fix should be in devstack | 21:46 |
clarkb | if it ws readable in the past it should remian redable | 21:46 |
fungi | pabelanger: pleia2: i'm definitely going to look into this job once it finishes. i've logged onto the worker and ps says it's been on "apt-get install rabbitmq-server" for over 40 minutes | 21:46 |
devkulkarni | clarkb: makes sense | 21:46 |
devkulkarni | clarkb: I will try to reproduce it and see if that is the issue | 21:47 |
fungi | pabelanger: pleia2: i wonder if apt-get on (some?) vexxhost nodes is super slow | 21:47 |
pabelanger | fungi: pleia2 | 21:47 |
pabelanger | err | 21:47 |
pabelanger | fungi: pleia2: I have seen that before, slowness | 21:47 |
pabelanger | on vexxhost | 21:47 |
*** sigmavirus24 is now known as sigmavirus24_awa | 21:47 | |
devkulkarni | clarkb: I can run reproduce.sh and that will setup the devstack gate env, right? or are there any other steps that I need to do? | 21:48 |
fungi | mnaser: seeing very slow (disk i think) performance on c0f3c475-70b0-473e-8551-cfb3bb590f5b right now | 21:48 |
*** ayoung has joined #openstack-infra | 21:48 | |
*** mylu has quit IRC | 21:49 | |
*** |-paul-| has quit IRC | 21:49 | |
fungi | might be network. strace on the pid shows a select poll loop going on | 21:49 |
*** mylu has joined #openstack-infra | 21:50 | |
pabelanger | clarkb: first issue with devstack-gate: http://paste.openstack.org/show/492367/ from setup-host.txt | 21:50 |
clarkb | devkulkarni I think there was a change to add some prereqs to the comments of the scrpt but not sure if that has merged yet | 21:52 |
clarkb | you will need virtualenv and a couple of libs I think | 21:52 |
clarkb | devkulkarni: https://review.openstack.org/#/c/294308/ | 21:53 |
devkulkarni | clarkb: I see .. let me start and see how far I can go | 21:53 |
clarkb | devkulkarni: I will get that reviewed now | 21:53 |
*** xyang1 has quit IRC | 21:54 | |
clarkb | nibalizer: is fixing the hiera situation something you are willing wanting to work on or should I start poking at that? | 21:54 |
fungi | interesting... anyone know why we never added an aaaa record for mirror.ca-ymq-1.vexxhost.openstack.org? | 21:54 |
openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Apache MPM events + php5 fpm https://review.openstack.org/298699 | 21:54 |
devkulkarni | clarkb: cool.. once that patch merges I will initiate a reproduce run on my side | 21:55 |
devkulkarni | clarkb: I see that you have pushed it along | 21:55 |
*** smarcet has quit IRC | 21:55 | |
clarkb | devkulkarni: well that patch merging won't affect yours | 21:55 |
clarkb | devkulkarni: since yours is done and written | 21:55 |
clarkb | devkulkarni: but you can refer to the contents of that patch to see what you need | 21:55 |
devkulkarni | clarkb: ah I see | 21:55 |
devkulkarni | clarkb: ok, will do that | 21:55 |
*** zeih has quit IRC | 21:55 | |
*** cody-somerville has joined #openstack-infra | 21:56 | |
clarkb | fungi: because it didn't have ipv6 when we created it | 21:56 |
*** austin81 has quit IRC | 21:56 | |
fungi | clarkb: oh, right, that got added a couple days after | 21:56 |
openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Add a job to build Debian packages https://review.openstack.org/294022 | 21:58 |
sdake_ | jeblair sorry for ninja dropping this on you | 21:58 |
sdake_ | you could have waited if you needed to ;) | 21:58 |
devkulkarni | clarkb: ok.. looks like the patch is documenting the dependencies that are required. should be straightforward to install those. | 21:58 |
fungi | it eventually moved on to apt-get install apache2 libapache2-mod-wsgi | 21:58 |
*** achanda has joined #openstack-infra | 21:58 | |
devkulkarni | clarkb: thanks for the pointer | 21:58 |
fungi | not seeing any packet loss | 21:58 |
nibalizer | clarkb: either way | 21:59 |
clarkb | and now we have dns record limits iirc | 21:59 |
clarkb | which we probably should sort out | 21:59 |
nibalizer | its like a few line of code i think | 21:59 |
fungi | clarkb: yeah, i'm thinking we should add a subdomain zone for ic.openstack.org | 21:59 |
*** jsavak has quit IRC | 21:59 | |
fungi | i'm pretty sure it's all the infracloud nodes which popped us over the limit | 21:59 |
fungi | or close to anyway | 21:59 |
nibalizer | most of that stuff can be deleted because ita gettong redone ya? | 22:00 |
clarkb | nibalizer: not sure what you mean | 22:00 |
jeblair | sdake_: no prob, was actually a good time :) | 22:00 |
clarkb | oh thats infracloud not test stuff | 22:00 |
*** mriedem has quit IRC | 22:00 | |
clarkb | the streams crossed | 22:00 |
*** fawadkhaliq has quit IRC | 22:01 | |
clarkb | nibalizer: ya Ithink I see a simple ish way of doing this will work on a quick patch to see | 22:01 |
openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Add a job to build openstack-pkg-tools https://review.openstack.org/294022 | 22:01 |
*** gokrokve has quit IRC | 22:01 | |
fungi | nibalizer: yeah, that's my thought. we delete all the existing *.ic.openstack.org records and then add them in a ic.openstack.org zone when we recreate them after we get the new ip addresses | 22:01 |
*** Sukhdev has joined #openstack-infra | 22:01 | |
zigo | pabelanger: AJaeger: Does it look more like what you'd expect? | 22:01 |
openstackgerrit | Paul Belanger proposed openstack-infra/devstack-gate: Use service to stop / start rsyslog https://review.openstack.org/298998 | 22:01 |
*** kzaitsev_mb has quit IRC | 22:02 | |
*** fawadkhaliq has joined #openstack-infra | 22:02 | |
openstackgerrit | Steven Dake proposed openstack-infra/project-config: Change #kolla to point to point to #openstack-kolla https://review.openstack.org/298999 | 22:02 |
*** thorst has joined #openstack-infra | 22:02 | |
zigo | pabelanger: AJaeger: I still have the issue that the repo isn't using master, but debian/mitaka, so I don't know how to get this checkout correctly before the build. | 22:02 |
*** gokrokve has joined #openstack-infra | 22:02 | |
*** esker has joined #openstack-infra | 22:02 | |
zigo | pabelanger: AJaeger: Writing "git checkout" within the shell script doesn't look like the way to go... | 22:03 |
*** austin81 has joined #openstack-infra | 22:04 | |
*** cdent has quit IRC | 22:05 | |
*** daemontool has quit IRC | 22:05 | |
*** thorst has quit IRC | 22:07 | |
*** tpsilva has quit IRC | 22:07 | |
*** gokrokve has quit IRC | 22:07 | |
*** gokrokve has joined #openstack-infra | 22:07 | |
*** achanda has quit IRC | 22:07 | |
openstackgerrit | Steven Dake proposed openstack-infra/project-config: Change #kolla to point to #openstack-kolla https://review.openstack.org/298999 | 22:08 |
jeblair | fungi: ++ ic dns | 22:09 |
fungi | jeblair: still feels like a terrible workaround for an arbitrary limitation in rackspace's dns service | 22:09 |
*** cloudtrainme has quit IRC | 22:09 | |
fungi | but it's what we've got (for now at least) | 22:10 |
craige | o/ | 22:10 |
jeblair | fungi: ya, probably worth raising it with rax, but hey, if we ran our adns we'd probably zone it anyway :) | 22:10 |
*** ybathia has joined #openstack-infra | 22:11 | |
fungi | if we wanted a separate mechanism updating records in it, maybe (or we might delegate the subdomain to something in/on infracloud itself?) but there's nothing wrong with long zonefiles per se | 22:12 |
clarkb | nibalizer: the thing that makes this really ugly is the many hiera files :( | 22:12 |
clarkb | nibalizer: because a key could be defined for one host over in a group file but not for another | 22:12 |
*** mylu has quit IRC | 22:12 | |
clarkb | nibalizer: and we in theory should test with that split properly in place | 22:12 |
*** markvoelker has joined #openstack-infra | 22:13 | |
clarkb | I think I will just do what pabelanger suggests and write the contents to a file and use that as the key_source instead | 22:14 |
clarkb | much simpler for what I need right now | 22:14 |
pabelanger | that what I did in https://review.openstack.org/#/c/295560/ | 22:14 |
jeblair | fungi: (though in the brave new world of signed dns, there can be minor disadvantages) | 22:15 |
*** annegentle has quit IRC | 22:15 | |
*** roxanaghe has joined #openstack-infra | 22:15 | |
*** fawadkhaliq has quit IRC | 22:15 | |
*** fawadkhaliq has joined #openstack-infra | 22:16 | |
fungi | yeah, the re-signing on update takes longer | 22:16 |
*** annegentle has joined #openstack-infra | 22:16 | |
fungi | though i've not seen that happen in practice, i also haven't tried to host a 1k record zonefile with signing | 22:16 |
jeblair | me neither | 22:17 |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Apt mirror for ceph hammer release https://review.openstack.org/293155 | 22:18 |
clarkb | pabelanger: ^ that look right? | 22:18 |
fungi | now this job is on "apt-get install libguestfs0" | 22:18 |
*** mylu has joined #openstack-infra | 22:19 | |
fungi | i have a feeling it's going to hit the timeout | 22:19 |
*** aysyd has quit IRC | 22:19 | |
clarkb | pabelanger: jeblair I am going to wip that just to let mordred look it over once he has a chance since mordred did much of the initial reprepro work | 22:19 |
nibalizer | clarkb: ya i think a file full of fakes is the way to go | 22:19 |
*** roxanaghe has quit IRC | 22:19 | |
clarkb | and if he is happy with it I can go ahead and make and mount the volume | 22:19 |
clarkb | nibalizer: you mean don't dynamically generate it just write it out upfront? | 22:20 |
*** mylu has quit IRC | 22:20 | |
nibalizer | clarkb: ya | 22:20 |
nibalizer | i mean what would you dynamicall generate it from? the private data? | 22:20 |
*** IlyaG has quit IRC | 22:20 | |
clarkb | nibalizer: the same way we do it today | 22:20 |
*** markvoelker has quit IRC | 22:20 | |
nibalizer | i don't know what that means | 22:21 |
clarkb | except that we have an extra dimension if writing it to real hiera files | 22:21 |
*** markvoelker has joined #openstack-infra | 22:21 | |
clarkb | nibalizer: in tools/apply-test.sh we modify every hiera line so that it does not do a hiera lookup, those modications use dfeault data or make up a default if there isn't one | 22:21 |
*** IlyaG has joined #openstack-infra | 22:21 | |
nibalizer | ya | 22:21 |
nibalizer | i thought you were going to make a file that had keys for everything | 22:22 |
clarkb | so you could do that dynamically, the problem is there is an extra dimension when you go to real hiera files since individual hosts can have their own files | 22:22 |
nibalizer | with dummy data | 22:22 |
*** markvoelker_ has joined #openstack-infra | 22:22 | |
clarkb | no I was going to do the dynamic thing until I relaised its a pita | 22:22 |
clarkb | then I just updated my change to work around this problem wit hour testing | 22:22 |
nibalizer | heh | 22:22 |
nibalizer | turned off some validation or so? | 22:22 |
clarkb | because I could spend the rest of the day fixing the tests or the next 5 minutes getting my change to pass | 22:23 |
clarkb | nibalizer: load the data from file instead of hiera | 22:23 |
devkulkarni | clarkb: tried running reproduce.sh. it failed. this is the content of /opt/stack/logs/devstacklog.txt.gz http://paste.openstack.org/show/492369/ | 22:23 |
pabelanger | fungi: pleia2: getting pulled away from computer by family. I'll pass the torch to pleia2 for a while to drive. | 22:24 |
pabelanger | fungi: pleia2: continue with out me, and will come back shortly | 22:24 |
pleia2 | pabelanger: noted, I need to leave in 35 minutes to take a kitty to the vet | 22:25 |
pleia2 | fungi, pabelanger: I think the next step is restarting zuul, which should be pretty straight forward? | 22:25 |
*** markvoelker has quit IRC | 22:26 | |
clarkb | devkulkarni: is your job doing something funny and cloning solum out of band? | 22:26 |
*** sdake has joined #openstack-infra | 22:26 | |
clarkb | devkulkarni: that might actually be a bug in reproduce.sh | 22:27 |
clarkb | devkulkarni: you can likely work around that by adding the PROJECTS= declarations from your jenkins job | 22:27 |
devkulkarni | clarkb: as in adding PROJECTS=solum in reproduce.sh? | 22:28 |
*** sdake_ has quit IRC | 22:28 | |
EmilienM | fungi: yesterday, I released the puppet modules and for some reasons (a stupid mistake in my script...), I failed for one module (puppet-aodh). How bad is it to delete an tag? | 22:28 |
devkulkarni | clarkb: we are not doing out of band cloning .. but looking through our code to be sure | 22:28 |
*** austin81 has left #openstack-infra | 22:28 | |
EmilienM | if it's too bad I can create a second tag. | 22:29 |
fungi | pleia2: pabelanger: yep, it's just exporting the current list of changes from the check and gate pipelines (we have a convenience script for that) and then restarting zuul, waiting for less common node types to reregister in gearman, then reenqueuing everything for check/gate | 22:29 |
openstackgerrit | Steven Dake proposed openstack-infra/system-config: Move statusbot and eavesdrop bot for kolla https://review.openstack.org/299009 | 22:29 |
openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Add PROJECTS var to reproduce.sh https://review.openstack.org/299010 | 22:29 |
clarkb | devkulkarni: ^ I think for the future that will fix it | 22:30 |
fungi | EmilienM: consider tags mostly undeletable (and certainly not reusable) | 22:30 |
clarkb | devkulkarni: no, the issue is that PROJECTS was not ending up in the reproduce.sh script see 299010 | 22:30 |
clarkb | jeblair: 299010 will probably interest you | 22:30 |
devkulkarni | clarkb: looking | 22:30 |
EmilienM | fungi: ok; i'll push another tag then. | 22:30 |
fungi | EmilienM: tag deletion doesn't propagate on remote update, nor does replacement by a new tag | 22:30 |
fungi | so it can lead to some ugly side effects | 22:30 |
openstackgerrit | John L. Villalovos proposed openstack-infra/project-config: Ironic uses grenade plugin. Setup GRENADE_PLUGINRC https://review.openstack.org/299011 | 22:31 |
EmilienM | fungi: ok... my mistake... | 22:31 |
clarkb | pabelanger: did your docs update for the afs rw path get pushed? | 22:31 |
*** mylu has joined #openstack-infra | 22:33 | |
*** tonytan4ever has quit IRC | 22:33 | |
jeblair | clarkb: yes! though the conflict-with has pointed me at https://review.openstack.org/280027 ; see the comment i left on yours | 22:34 |
*** mylu has quit IRC | 22:34 | |
EmilienM | fungi: I pushed 8.0.1 ... | 22:34 |
*** annegentle has quit IRC | 22:35 | |
clarkb | jeblair: I don't think that is necessary we already dedup | 22:35 |
clarkb | but this is a little cleaner | 22:36 |
clarkb | I will go ahead and abandon mine | 22:36 |
jeblair | clarkb: oh, we dedup $PROJECTS? | 22:36 |
clarkb | jeblair: yup | 22:37 |
jeblair | the only thing i don't like about tonyb's change is that it treats $PROJECTS very specially | 22:37 |
clarkb | was the only way to sanely start removing entries from PROJECTS | 22:37 |
jeblair | clarkb: ok | 22:37 |
pabelanger | pleia2: fungi back | 22:37 |
pabelanger | clarkb: no, I can push it up in a few | 22:37 |
pabelanger | clarkb: unless you want to | 22:37 |
tonyb | jeblair: I assume were talkign aboiut my save PROJECTS thing in devstack-gate? | 22:38 |
jeblair | yeah | 22:38 |
clarkb | pabelanger: no you should, just waiting for it :) | 22:38 |
tonyb | jeblair: I agree we're treating is specially but AFIOCT it's the only option | 22:38 |
tonyb | jeblair: there are lots of things the reproduce misses which makes it annoying | 22:39 |
clarkb | does that var need to be declared like the others? | 22:39 |
tonyb | jeblair: do you have an alternate idea I can look at implementing? | 22:39 |
jeblair | tonyb: well, it would be nice if it were easy to add the missing vars | 22:39 |
*** markvoelker_ has quit IRC | 22:39 | |
jeblair | tonyb: if every one is this complicated, that's :( | 22:39 |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Document read-write afs volumes https://review.openstack.org/299013 | 22:40 |
pabelanger | clarkb: ^ | 22:40 |
jeblair | (also, maybe once we remove projects from $PROJECTS we can rename it to DEVSTACK_GATE_PROJECTS) | 22:40 |
jeblair | then we can drop the specialness | 22:40 |
clarkb | jeblair: do you remember why declare -x was used over straight up export? | 22:40 |
tonyb | jeblair: I agree. I guess I was doing the simple things first and then trying to abstract it later once we can see a pattern | 22:41 |
jeblair | tonyb: wfm for now | 22:41 |
jeblair | clarkb: nope | 22:41 |
jeblair | clarkb: (probably because i started by typing "export" and saving the output) | 22:41 |
*** mylu has joined #openstack-infra | 22:41 | |
anteaya | sorry for disappearing, meetings, then phone call then dinner, now I want to take a walk while I can, back later | 22:42 |
mgagne | zaro: are there any plan to publish latest scp plugin to update center? | 22:42 |
clarkb | mgagne: I think we did | 22:42 |
tonyb | jeblair: renaming PROJECTS could work. | 22:42 |
mgagne | clarkb: I unfortunately think not, still 1.8 | 22:42 |
clarkb | mgagne: ok well we did their stupid rule stuff and pushed a new tag Ithought | 22:43 |
clarkb | oh that was for a differnet plugin | 22:43 |
clarkb | zmq plugin is the one we did | 22:43 |
mgagne | I don't see any tag https://github.com/jenkinsci/scp-plugin/ | 22:43 |
clarkb | tonyb: does that work without exporting like the other vars? | 22:44 |
*** annegentle has joined #openstack-infra | 22:44 | |
*** fawadkhaliq has quit IRC | 22:44 | |
*** fawadkhaliq has joined #openstack-infra | 22:44 | |
*** annegentle has quit IRC | 22:45 | |
tonyb | clarkb: it'd still be a special case. | 22:45 |
clarkb | tonyb: yes I know | 22:45 |
clarkb | also I think you may need quotes | 22:46 |
*** fawadkhaliq has quit IRC | 22:46 | |
clarkb | since there will be spaces in that list | 22:46 |
clarkb | tonyb: commented | 22:47 |
tonyb | clarkb: thanks. I'll fix them. | 22:48 |
*** esker has quit IRC | 22:48 | |
*** baoli has quit IRC | 22:51 | |
*** hashar has quit IRC | 22:51 | |
*** gordc has quit IRC | 22:51 | |
*** Sukhdev has quit IRC | 22:51 | |
*** nadya has joined #openstack-infra | 22:51 | |
pabelanger | fungi: look like the job just failed and was kicked out of the gate | 22:52 |
*** fawadkhaliq has joined #openstack-infra | 22:52 | |
openstackgerrit | Merged openstack-infra/project-config: Run the v3 only job in glance https://review.openstack.org/293199 | 22:52 |
fungi | pabelanger: awesome, yeah, it reported the timeout to the change | 22:52 |
pleia2 | poor changes, but yay for us | 22:52 |
pleia2 | (kind of, timeout is not so yay) | 22:53 |
pabelanger | right | 22:53 |
pabelanger | but yay for us | 22:53 |
*** sdague has quit IRC | 22:53 | |
pleia2 | looks like fungi queued up the script? | 22:53 |
fungi | yep, so let's move on with the restart steps. i didn't expect to wait anywhere near that long, but i'll make good use of the logs since the job reported | 22:53 |
clarkb | http://logs.openstack.org/55/293155/8/check/gate-infra-puppet-apply-ubuntu-trusty/372e007/console.html | 22:53 |
fungi | that script queued up there will save a copy of the check pipeline as a script that can be used to reenqueue it all | 22:53 |
openstackgerrit | Tony Breeds proposed openstack-infra/devstack-gate: Save PROJECTS form the job defintion for use in reproduce.sh https://review.openstack.org/280027 | 22:53 |
clarkb | if it isn't one thing it is another :) | 22:54 |
clarkb | downcase is used in our puppet conf erb | 22:54 |
clarkb | but apparently is not available on our internap trusty nodes? | 22:54 |
fungi | pabelanger: pleia2: we'll in rapid succession do that and the gate pipeline similarly, then ungracefully stop and start zuul | 22:54 |
clarkb | nibalizer: ^ any idea what is going on with that? | 22:54 |
*** jcooley_ has quit IRC | 22:54 | |
pabelanger | Opps | 22:54 |
pabelanger | fungi: pleia2: sorry, dropped | 22:54 |
nibalizer | what | 22:55 |
clarkb | nibalizer: http://logs.openstack.org/55/293155/8/check/gate-infra-puppet-apply-ubuntu-trusty/372e007/console.html | 22:55 |
nibalizer | just like downcase($foo) | 22:55 |
fungi | pabelanger: pleia2: i'll let one of you punch enter on that script and then do similarly for gate > gate.sh | 22:55 |
clarkb | oh its because fqdn is undefined | 22:55 |
clarkb | woo | 22:55 |
pabelanger | fungi: pleia2 go for it | 22:55 |
nibalizer | i think you called downcase on a variable that isn't defined | 22:55 |
clarkb | so it tries to downcase a nil var | 22:55 |
*** nadya has quit IRC | 22:56 | |
fungi | pabelanger: pleia2: and then service zuul stop and check the process list to make sure it's dead dead and the service zuul start again | 22:56 |
clarkb | nibalizer: ya its because fqdn fact isn't working | 22:56 |
pleia2 | fungi, pabelanger, ok, on it | 22:56 |
* clarkb wonders if glean changed again | 22:56 | |
pleia2 | fungi: right? | 22:56 |
fungi | pleia2: yep | 22:56 |
fungi | probably need to give that zombie a few secs | 22:57 |
pleia2 | yep, there it goes | 22:57 |
fungi | yeah, looks good | 22:57 |
fungi | no need to sudo since we're already in an interactive root shell, but that's fine | 22:57 |
pabelanger | :) | 22:57 |
pleia2 | muscle memory :) | 22:57 |
EmilienM | we have a new funny error in Puppet CI: http://logs.openstack.org/03/298903/1/gate/gate-puppet-ceilometer-puppet-beaker-rspec-ubuntu-trusty/b37eea0/console.html#_2016-03-29_22_05_42_191 | 22:57 |
*** esker has joined #openstack-infra | 22:57 | |
EmilienM | E: Unable to locate package hiera (ubuntu) | 22:58 |
pleia2 | fungi: anything to do before we run our scripts? | 22:58 |
*** kzaitsev_mb has joined #openstack-infra | 22:58 | |
clarkb | EmilienM: I think that is because hiera is built into puppet now/ | 22:58 |
clarkb | EmilienM: maybe they killed the package I dunno | 22:58 |
EmilienM | clarkb: in puppet4, not in 3 | 22:58 |
clarkb | ah | 22:58 |
EmilienM | and trusty ships 3 | 22:58 |
EmilienM | well, afik. | 22:58 |
pabelanger | pleia2: fungi: all that is left is to enqueue at this point I take it? | 22:59 |
*** eil397 has quit IRC | 23:00 | |
pleia2 | I think so | 23:00 |
clarkb | EmilienM: apt-cache search hiera doesn't show a hiera | 23:00 |
fungi | pleia2: pabelanger: yeah, let's make sure we've got uncommon node types registered in gearman | 23:00 |
clarkb | there is a ruby-hiera | 23:00 |
*** dizquierdo has quit IRC | 23:00 | |
pleia2 | fungi: oh right, where do we look for that? | 23:00 |
fungi | pleia2: pabelanger: otherwise a lot of these changes could get kicked back with NOT_REGISTERED for jobs needing them | 23:00 |
dansmith | did something just happen? | 23:01 |
dansmith | everything dumped out of the check queue | 23:01 |
pabelanger | dansmith: yes | 23:01 |
EmilienM | clarkb: It's weird, it worked a few hours ago, on the same cloud (ovh) http://logs.openstack.org/23/298923/1/gate/gate-puppet-oslo-puppet-beaker-rspec-ubuntu-trusty/0f02cac/console.html#_2016-03-29_20_27_02_186 | 23:01 |
*** rbrndt_ has quit IRC | 23:01 | |
pabelanger | dansmith: we are reloading zuul | 23:01 |
fungi | dansmith: we're restarting zuul. will be reenquing it all in moments | 23:01 |
dansmith | okay | 23:01 |
fungi | we waited for a gate reset to lessen the loss of throughput | 23:02 |
clarkb | EmilienM: maybe they repos have been cleaned up? I am just using my local machine there is no hiera package in trusty | 23:02 |
clarkb | EmilienM: the puppetlabs repos may have a hiera package but we have ripped those out for a long time t oavoid hitting them on every apt-get update | 23:02 |
EmilienM | clarkb: can we tell to apt-get to not fail in jenkins jobs if the package is not present? | 23:02 |
clarkb | EmilienM: I think its better to only list the things you intend to install | 23:02 |
*** kzaitsev_mb has quit IRC | 23:02 | |
clarkb | yum has this behavior and it makes me wnat to never use yum :) | 23:02 |
pabelanger | clarkb: EmilienM: http://apt.puppetlabs.com/pool/trusty/main/h/hiera/ still exists | 23:02 |
clarkb | pabelanger: ya I don't think we are using the puppetlabs repo in that job though at least not that early on | 23:03 |
EmilienM | pabelanger, clarkb: the problem is not in puppetlabs repo | 23:03 |
fungi | pleia2: pabelanger: yeah, looks like we've got all the ones i can think of showing up, so we should be all set | 23:03 |
EmilienM | the problem is in the macro that tries to cleanup the node | 23:03 |
pabelanger | clarkb: EmilienM: Ah | 23:03 |
pleia2 | fungi: great | 23:03 |
EmilienM | http://logs.openstack.org/03/298903/1/gate/gate-puppet-ceilometer-puppet-beaker-rspec-ubuntu-trusty/b37eea0/console.html#_2016-03-29_22_05_42_089 | 23:03 |
EmilienM | we run that: sudo apt-get remove -y --purge facter puppet puppet-common hiera | 23:03 |
EmilienM | on every nodes | 23:03 |
EmilienM | and now it starts to fail | 23:03 |
pleia2 | fungi: gate or check first? | 23:04 |
clarkb | EmilienM: that probably means that with new images there is no longer a hiera package to clean up? | 23:04 |
fungi | pleia2: pabelanger: so we enqueue gate first then check, that way we don't have to wait for zuul to hand jobs to all the check pipeline before the reenqueued gate jobs get some | 23:04 |
* pleia2 big red button | 23:04 | |
fungi | yep | 23:04 |
clarkb | so the fqdn fact doesn't work if hostname -f doesnt return something with '.'s in it | 23:05 |
clarkb | it is the dumbest thing in the world | 23:05 |
*** mescanef has quit IRC | 23:05 | |
clarkb | but thats the situation on our test nodes now due to glean? | 23:05 |
fungi | big red openstack-shaped button | 23:05 |
*** Sukhdev has joined #openstack-infra | 23:05 | |
pleia2 | this is strangely satisfying | 23:05 |
EmilienM | clarkb: http://git.openstack.org/cgit/openstack-infra/project-config/commit/?id=4ff660c4eee680c12e40b9c38216749fc3d46af4 | 23:05 |
EmilienM | clarkb: I'm going to revert that. | 23:06 |
clarkb | EmilienM: please dont | 23:06 |
EmilienM | oki | 23:06 |
clarkb | EmilienM: at least not until we confirm that that is what we should do | 23:06 |
EmilienM | clarkb: I ran a stupid recheck to see if it's consistent... | 23:06 |
clarkb | EmilienM: we should figure out if hiera is actually no longer a package or just no longer getting installed or maybe something else is purging it | 23:07 |
*** cloudtrainme has joined #openstack-infra | 23:07 | |
*** gokrokve has quit IRC | 23:07 | |
devkulkarni | clarkb: ran reproduce.sh. seeing same problem as gate. here is the list of log files http://paste.openstack.org/show/492375/ notice that the n-dhcp target (n-dhcp.log.2016-03-29-223710) does not exist | 23:07 |
clarkb | devkulkarni: neat! so ya thats definitely a devstack bug | 23:07 |
dansmith | the reason I noticed the dump was I was waiting to recheck something that hit the vexxhost hang. so, thanks @infra for doing it for me :P | 23:07 |
clarkb | devkulkarni: if the target doesn't exist it shouldn't create a symlink | 23:08 |
EmilienM | clarkb: it seems like it's not hiera but ruby-hiera in trusty http://packages.ubuntu.com/trusty/ruby-hiera | 23:08 |
fungi | dansmith: yep, courtesy recheck without reporting a failure for you ;) | 23:08 |
dansmith | fungi: awesome new feature | 23:08 |
clarkb | EmilienM: yup, but our image builds should be using the puppetlabs repo that pabelanger linked to I think | 23:08 |
clarkb | EmilienM: then at the end of the build we remove that repo | 23:08 |
pabelanger | clarkb: EmilienM: hiera was installed as of yesterday dibs: http://nodepool.openstack.org/dib.ubuntu-trusty.log.2016-03-28_17 | 23:08 |
clarkb | but even with the repo removed apt-get should know how to uninstall a package | 23:09 |
fungi | dansmith: i'm also looking at a grenade job that hit a timeout in vexxhost. looks like apt-get install was running crazily slow | 23:09 |
EmilienM | pabelanger: oh, I wasn't aware puppet / hiera stuff was installed from puppetlabs repos. | 23:09 |
pabelanger | clarkb: EmilienM missing from today: http://nodepool.openstack.org/dib.ubuntu-trusty.log | 23:09 |
dansmith | fungi: yeah | 23:09 |
clarkb | pabelanger: neat, I wonder if that was a change upstream? | 23:09 |
clarkb | like maybe it is no longer a dep? | 23:09 |
EmilienM | nice shot pabelanger | 23:09 |
EmilienM | clarkb: /me digging changelogs in packaging. | 23:09 |
pabelanger | possible | 23:09 |
EmilienM | _ody: fyi ^ | 23:10 |
*** cloudtrainme has quit IRC | 23:10 | |
devkulkarni | clarkb: cool. so the fix will probably somewhere between 630-640 of https://github.com/openstack-dev/devstack/blob/master/lib/nova ? | 23:10 |
EmilienM | clarkb: don't you have the error in infra jobs? | 23:10 |
clarkb | devkulkarni: possibly, I am not super familiar with devstack | 23:10 |
clarkb | EmilienM: no | 23:10 |
clarkb | EmilienM: we don't purge hiera | 23:10 |
devkulkarni | clarkb: ok.. do you know which channel do the devstack folks hang out generally? | 23:11 |
clarkb | devkulkarni: #openstack-qa | 23:11 |
*** Qiming has joined #openstack-infra | 23:11 | |
devkulkarni | clarkb: thanks | 23:11 |
*** esker has quit IRC | 23:11 | |
fungi | clarkb: EmilienM: i've been out of the loop dealing with some other stuff. where's an example failure log for this package removal issue? | 23:12 |
EmilienM | fungi: http://logs.openstack.org/03/298903/1/gate/gate-puppet-ceilometer-puppet-beaker-rspec-ubuntu-trusty/b37eea0/console.html#_2016-03-29_22_05_42_191 | 23:12 |
EmilienM | and it's consistent, I see the failure in every trusty jobs, since a few minutes | 23:13 |
clarkb | EmilienM: its likely that our image uploads are completting and switching over to todays build which does not have that package | 23:13 |
fungi | EmilienM: thanks | 23:13 |
clarkb | and may also explain why my job just started to fail on fqdn things | 23:13 |
EmilienM | clarkb: at least we have an updated image :-) | 23:13 |
clarkb | assuming things cut over and picked up new behavior | 23:13 |
*** EricGonczer_ has joined #openstack-infra | 23:14 | |
fungi | we can pretty easily delete those images and fall back to the previous ones as a short-term relief while we figure out what needs fixing | 23:15 |
pleia2 | fungi, pabelanger: need to rush off to the vet with my little critter | 23:15 |
clarkb | hostname -f on internap says localhost | 23:15 |
clarkb | and its /etc/hosts is different than ovh/rax | 23:15 |
fungi | pleia2: thanks! looks like we're just waiting for the check reenqueue to complete, so that was teh final step anyway | 23:15 |
mgagne | clarkb: aren't you guys building your own image? | 23:15 |
pabelanger | EmilienM: clarkb: fungi: we did land 297964 this morning. I wonder if this is a side affect | 23:16 |
pleia2 | fungi: yep, seems so | 23:16 |
pabelanger | EmilienM: clarkb: fungi which adds xenial support | 23:16 |
*** achanda has joined #openstack-infra | 23:17 | |
clarkb | mgagne: yes its likely our image that is broken not anything in the cloud | 23:17 |
*** fawadkhaliq has quit IRC | 23:18 | |
mgagne | clarkb: what can I do to help you? | 23:18 |
pabelanger | EmilienM: clarkb: fungi: Yup, something doesn't look right. We are no longer downloading puppetlabs-release-trusty.deb | 23:18 |
fungi | pabelanger: yeah, i suspect a subtle logic error there rather than changes to the package repo (i just checked it, timestamps are old) | 23:18 |
mgagne | clarkb: ok, I thought you mentioned my name ^^' | 23:19 |
clarkb | pabelanger: does < work that way? | 23:19 |
fungi | we really should set -x that script... do we really not? | 23:19 |
*** fawadkhaliq has joined #openstack-infra | 23:20 | |
pabelanger | clarkb: I thought it did | 23:20 |
pabelanger | confirming | 23:20 |
EmilienM | pabelanger: yes, it seems like we don't install the deb anymore :( | 23:20 |
*** EricGonczer_ has quit IRC | 23:20 | |
fungi | okay, any objection to me rolling back nodepool images while we work on fixing? | 23:21 |
fungi | pabelanger: pleia2: jeblair: btw, the check changes finished reenqueuing, so other than keeping an eye on zuul status and cacti graphs, this restart is done | 23:21 |
EmilienM | clarkb, pabelanger: I'm also wondering if the < works | 23:22 |
*** fawadkhaliq has quit IRC | 23:22 | |
pabelanger | Ugh | 23:23 |
pabelanger | typo in my script | 23:23 |
EmilienM | we should maybe use if (versioncmp($::operatingsystemmajrelease, '16') < 0) { | 23:24 |
clarkb | on ovh-gra1 the hostname has novalocal appended to it but internap does not | 23:24 |
clarkb | I wonder if that makes glean behave differently, it is the same glean version in both cases | 23:24 |
pabelanger | sigh | 23:24 |
clarkb | oh wait, dhcp can assign the hostname info too | 23:24 |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Fix typo with xenial logic https://review.openstack.org/299031 | 23:24 |
pabelanger | ^ | 23:24 |
clarkb | maybe we are fighting dhcpd | 23:24 |
fungi | you can unconfigure that in dhclient | 23:24 |
pabelanger | guess we need bashae | 23:25 |
*** jtomasek has quit IRC | 23:25 | |
pabelanger | bashate* | 23:25 |
fungi | rather, you can configure dhclient to ignore it | 23:25 |
mgagne | clarkb: we don't have DHCP enabled and override the dhcp_domain in Nova with an empty string. | 23:25 |
EmilienM | pabelanger: nice shot ! | 23:25 |
clarkb | man command not found | 23:25 |
* clarkb is ready to kill these "minimal" images | 23:25 | |
EmilienM | pabelanger: I was also wondering about the fact test for operatingsystem | 23:25 |
EmilienM | but that's fine | 23:25 |
clarkb | mgagne: ah, so we are configuring with glean in internap as well? | 23:26 |
clarkb | I can confirm in /tec/network/ | 23:26 |
fungi | pabelanger: i'm back to wondering why that script isn't set -x so we can see what it's doing in the image builds | 23:26 |
mgagne | clarkb: don't know the details | 23:26 |
clarkb | ah yup its static | 23:26 |
pabelanger | fungi: I can add it on follow up\ | 23:26 |
pabelanger | and -e too | 23:26 |
fungi | pabelanger: -e may be a lot more problematic | 23:27 |
EmilienM | did we roll back the ubuntu-trusty image yet? | 23:27 |
fungi | EmilienM: i'm working on it now | 23:27 |
*** kzaitsev_mb has joined #openstack-infra | 23:28 | |
clarkb | option domain-name "local" is coming from dhcp on ovh | 23:28 |
*** ZZelle has quit IRC | 23:28 | |
*** mylu has quit IRC | 23:28 | |
Clint | yuck | 23:28 |
clarkb | I bet this is enough to make the differnet behaviors happen | 23:28 |
clarkb | but facter fqdn returns nothing in both cases so may not actually explain why puppet is unhappy | 23:29 |
EmilienM | clarkb: cat /etc/hostname ? | 23:29 |
clarkb | EmilienM: the hostname is the hostname in both cases, does not include a domain | 23:29 |
clarkb | and facter won't give you an fqdn of hostname, | 23:29 |
clarkb | er hostname. | 23:29 |
fungi | okay, the ones which had uploaded so far today (internap-nyj01, osic-cloud1, ovh-gra1, rax-ord, vexxhost-ca-ymq-1) have been deleted | 23:30 |
fungi | i'll keep an eye out for any more popping into ready state this evening | 23:30 |
clarkb | I wonder if that is related to the fqdn madness | 23:31 |
clarkb | like maybe different versions of facter behaving differently | 23:31 |
*** ybathia has quit IRC | 23:31 | |
*** eil397 has joined #openstack-infra | 23:32 | |
clarkb | 1.7.5 v 2.4.6 | 23:32 |
clarkb | what do you know | 23:32 |
clarkb | I bet thats it | 23:32 |
fungi | i don't think there are any more ubuntu-trusty images that are going to try to upload (i don't see any more in a building state, and i also did a dib-image-delete of the original for them) | 23:32 |
*** EricGonczer_ has joined #openstack-infra | 23:32 | |
clarkb | mordred: rcarrillocruz greghaynes for the record glean appears to write different /etc/hosts in the directly static configured interface case vs the dhcp case. Guessing that dhcp races it to writing the file out | 23:32 |
*** gokrokve has joined #openstack-infra | 23:33 | |
*** kzaitsev_mb has quit IRC | 23:33 | |
clarkb | lets see if I can get my change to work on a recheck | 23:33 |
*** angdraug has quit IRC | 23:34 | |
*** gokrokve has quit IRC | 23:37 | |
fungi | clarkb: in dhclient.conf i suspect we want: supersede hostname "$OUR_THING"; | 23:37 |
fungi | er, host-name | 23:38 |
openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Activate debugging for install_puppet.sh https://review.openstack.org/299034 | 23:38 |
pabelanger | fungi: okay, just -x for now ^ | 23:38 |
clarkb | fungi: Iam going to leave that up to glean to sort out, imo it shouldn't be doing that and instead it should make /etc/hosts look like what dhcpds will write | 23:38 |
fungi | clarkb: should probably also do the same for domain-name too | 23:38 |
*** jtomasek has joined #openstack-infra | 23:39 | |
fungi | clarkb: i would assert that we don't actually want dhclient modifying our host-name and domain-name on these machines, but i could be wrong | 23:39 |
clarkb | there is definitely a tug of war going on between how much glean should be involved in | 23:39 |
clarkb | I personally don't like glean being involved in much because it constantly breaks | 23:40 |
fungi | though instructing dhclient to set them to what we want seems like a reasonable solution | 23:40 |
clarkb | whereas dhclient and dhcpcd have both worked for many years for me | 23:40 |
fungi | unfortunately, i don't know how we'd rely on dhclient to set these values on the system in environments where there's no dhcpd to query | 23:41 |
*** fawadkhaliq has joined #openstack-infra | 23:41 | |
*** ybathia has joined #openstack-infra | 23:41 | |
*** gokrokve has joined #openstack-infra | 23:41 | |
clarkb | right, it is an unfortunate bit of design for some clouds | 23:42 |
clarkb | and glean exists for a raisin. But we still don't have a good answer for rabbitmq + glean I don't think | 23:42 |
fungi | rabbit stew | 23:42 |
JayF | We just saw a host of downstream failures around this change: https://github.com/bbangert/routes/pull/65 in a neutron dependency. Thought I'd let you all know in case you see some craziness there. cc+thanks morgabra + clif_h | 23:43 |
* fungi should have said hasenpfeffer | 23:43 | |
*** sdake has quit IRC | 23:43 | |
JayF | Although I guess with upper-constraints, that should shelter openstack ci from the change, assuming we get the upstream author to restore his compatibility :) | 23:44 |
*** sdake has joined #openstack-infra | 23:44 | |
clarkb | JayF: and assuming contraints is tested against something that covers that | 23:44 |
clarkb | JayF: but generally it works | 23:44 |
*** sdake has quit IRC | 23:44 | |
*** sdake has joined #openstack-infra | 23:44 | |
JayF | clarkb: well figured I'd put that link in some IRC logs and minds in case something blows up related to it here :) | 23:44 |
morgabra | also https://review.openstack.org/#/c/298855/ | 23:45 |
fungi | clarkb: well, changes have also been submitted to global requirements to skip 2.3 | 23:45 |
clarkb | devstack-centos7 nodes unregistered | 23:46 |
clarkb | presumably after zuul restart | 23:46 |
*** camunoz has joined #openstack-infra | 23:49 | |
pabelanger | Just noticed that too | 23:49 |
* clarkb thinks it is a sign | 23:50 | |
*** torandu has quit IRC | 23:50 | |
clarkb | first gpg problems, then fqdn problems, now gearman problems | 23:50 |
ianw | i was just running some experimental tests to ensure centos-7 == devstack-centos7 ... but yeah ... then everything exploded | 23:51 |
pabelanger | just cleaned up 18 leaked ips from bluebox | 23:52 |
pabelanger | checking osic now | 23:52 |
*** torandu has joined #openstack-infra | 23:52 | |
clarkb | crinkle: fwiw I thought the mellanox cards were capable of running infiniband or 10Gbe and we had 10Gbe gbic things in them | 23:52 |
clarkb | crinkle: which is why tripleo suffered through using mellanox over the non mellanox options (to get better throughput over the available 1gig interfaces) | 23:53 |
clarkb | greghaynes: SpamapS lifeless ^ you may be able to correct me though | 23:53 |
crinkle | yeah they would know better than me | 23:53 |
clarkb | thankfully the kernel issues on mellanox cards seem to be mostly sorted out now but for a long time there were issues aiui | 23:53 |
crinkle | they're still a big pain | 23:54 |
clarkb | and I think 1x10Gbe is > 2x1gig even if we hvae to jump through hoops for neutron | 23:54 |
crinkle | not kernel issues but they make ironic booting take forever | 23:54 |
*** yamada-h has joined #openstack-infra | 23:54 | |
*** mriedem has joined #openstack-infra | 23:55 | |
*** gokrokve has quit IRC | 23:55 | |
*** achanda has quit IRC | 23:56 | |
*** mylu has joined #openstack-infra | 23:58 | |
*** yamada-h has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!