Monday, 2014-07-21

*** otter768 has quit IRC00:03
*** penguinRaider__ has quit IRC00:04
*** otter768 has joined #openstack-infra00:10
*** chuckC has quit IRC00:14
*** daya_k has joined #openstack-infra00:16
*** zul has quit IRC00:20
*** zul has joined #openstack-infra00:24
*** marun has quit IRC00:25
*** shashankhegde has quit IRC00:26
*** msabramo1 has quit IRC00:27
*** toddmorey has joined #openstack-infra00:28
*** unicell has joined #openstack-infra00:34
*** daya_k has quit IRC00:39
*** toddmorey has quit IRC00:43
*** toddmorey has joined #openstack-infra00:46
*** msabramo has joined #openstack-infra00:56
*** yamamoto_ has joined #openstack-infra00:59
*** yamamoto has quit IRC01:02
*** toddmorey has quit IRC01:07
*** xianghui has quit IRC01:07
*** toddmorey has joined #openstack-infra01:07
*** shashankhegde has joined #openstack-infra01:09
*** xianghui has joined #openstack-infra01:12
*** toddmorey has quit IRC01:14
*** yamamoto_ has quit IRC01:17
*** yamamoto has joined #openstack-infra01:18
*** liusheng has joined #openstack-infra01:19
*** rainya has joined #openstack-infra01:24
*** rkukura has quit IRC01:28
*** msabramo has quit IRC01:29
*** pcrews has joined #openstack-infra01:29
*** dims__ has joined #openstack-infra01:30
*** yaguang has joined #openstack-infra01:40
*** mestery has joined #openstack-infra01:42
*** pcrews has quit IRC01:43
*** dkranz has joined #openstack-infra01:46
*** renlt has joined #openstack-infra01:49
*** pcrews has joined #openstack-infra01:51
*** rainya has quit IRC01:53
*** Sukhdev has joined #openstack-infra01:55
*** rainya has joined #openstack-infra01:56
*** chuckC has joined #openstack-infra02:00
*** renlt has quit IRC02:11
*** daya_k has joined #openstack-infra02:20
*** harlowja_at_home has joined #openstack-infra02:20
*** harlowja_at_home has quit IRC02:22
*** otherwiseguy has quit IRC02:23
*** jp_at_hp has joined #openstack-infra02:23
*** daya_k has quit IRC02:25
*** wenlock has joined #openstack-infra02:27
*** yaguang has quit IRC02:27
*** yaguang has joined #openstack-infra02:28
*** pcrews has quit IRC02:28
*** yamamoto has quit IRC02:38
*** daya_k has joined #openstack-infra02:40
*** chuckC has quit IRC02:42
*** bdpayne has joined #openstack-infra02:44
*** jp_at_hp has quit IRC02:46
*** yamamoto has joined #openstack-infra02:47
*** jp_at_hp has joined #openstack-infra02:49
*** daya_k has quit IRC02:51
*** dkranz has quit IRC03:01
*** yamamoto has quit IRC03:08
*** dims__ has quit IRC03:09
*** yamamoto has joined #openstack-infra03:15
*** bdpayne has quit IRC03:19
* corvus is in portland03:20
*** chuckC has joined #openstack-infra03:27
*** chuckC has quit IRC03:30
clarkbI am freezing on an amtrak train03:33
jesusaurusyeah, they tend to get cold after sunset03:33
*** dims__ has joined #openstack-infra03:35
clarkbit is a nice sunset... its july though not january03:37
*** dims__ has quit IRC03:40
*** otter768 has quit IRC03:42
*** penguinRaider has joined #openstack-infra03:43
*** sasik_ has joined #openstack-infra03:44
*** yamamoto has quit IRC03:45
sasik_Hi All, I am working for 3rd party ci and the dvsm-tempest-full job if failing because of; sudo mysql -uroot -psecretmysql -h127.0.0.1 -e 'GRANT ALL PRIVILEGES ON *.* TO '\''root'\''@'\''%'\'' identified by '\''secretmysql'\'';' ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) and the content of hosts is;$ cat /etc/hosts03:49
sasik_127.0.0.1       localhost ibm-openstack3-ci03:49
sasik_9.122.123.159   ibm-openstack3-ci.in.ibm.com    ibm-openstack3-ci03:49
sasik_I googled a bit, but could not find a proper solution. can some one please help on this03:49
*** praneshp has joined #openstack-infra03:49
*** sasik_ has left #openstack-infra03:50
*** rkukura has joined #openstack-infra03:51
clarkbif sasik_ comes back issue may be that devstack gate isnt intended to be reused on nodes03:51
clarkband different secrets has broken an upgrade path for dg on nodes03:51
*** sasik_ has joined #openstack-infra03:53
clarkbsasik_ if you reuse nodes a recent change to devstack gate probably broke you03:54
clarkbdg uses distinct passwords for all the things now03:54
jesusaurusclarkb: when did that change?03:54
clarkband if mysql was initially configured with old password it may not work now03:54
clarkbjesusaurus: last week?03:55
jesusaurusgood to know03:55
*** Sukhdev has quit IRC03:55
*** craigbr has joined #openstack-infra03:55
sasik_oh, ok, can you please help on how to solve this ?03:57
*** craigbr has quit IRC03:59
*** yamamoto has joined #openstack-infra04:00
mattoliverauHey all from Abu Dhabi, josh and I are about 1/3 of the way home.04:00
sasik_clarkb: can you please help the work around for this problem04:00
clarkbyou will need to update passwords probably04:04
clarkbI am off my train now and trying to get home so not much help04:04
*** penguinRaider__ has joined #openstack-infra04:04
sasik_clarkb: thanks, will connect with you later, mean will will ask others for help04:05
*** timrc is now known as timrc-afk04:05
*** arnaud has joined #openstack-infra04:05
*** penguinRaider has quit IRC04:08
sasik_Hi All, I am bit new to the devstack gate, can you please help on clarkb's solution "you will need to update passwords probably"04:09
*** msabramo has joined #openstack-infra04:11
*** yamamoto has quit IRC04:11
*** [HACKING-TWITTER has joined #openstack-infra04:11
*** penguinRaider has joined #openstack-infra04:16
*** penguinRaider__ has quit IRC04:18
*** rkukura has quit IRC04:21
*** penguinRaider__ has joined #openstack-infra04:30
*** wenlock has quit IRC04:31
*** Nobodycam_afk is now known as NobodyCam04:33
*** msabramo has quit IRC04:33
*** penguinRaider has quit IRC04:33
*** dims__ has joined #openstack-infra04:36
*** msabramo has joined #openstack-infra04:40
*** dims__ has quit IRC04:40
*** penguinRaider__ has quit IRC04:40
*** yamamoto has joined #openstack-infra04:41
*** yamamoto_ has joined #openstack-infra04:43
*** yamamoto has quit IRC04:43
*** chuckC has joined #openstack-infra04:48
*** chandankumar has joined #openstack-infra04:50
*** yamamoto_ has quit IRC04:52
*** jp_at_hp has quit IRC04:52
*** msabramo has quit IRC04:52
*** wenlock has joined #openstack-infra04:54
*** ildikov has quit IRC04:55
*** jp_at_hp has joined #openstack-infra04:57
*** yamamoto has joined #openstack-infra04:58
*** craigbr has joined #openstack-infra05:00
*** harlowja_at_home has joined #openstack-infra05:04
*** chandankumar has quit IRC05:12
*** harlowja_at_home has quit IRC05:13
*** [HACKING-TWITTER has quit IRC05:15
*** Longgeek has joined #openstack-infra05:15
*** [HACKING-TWITTER has joined #openstack-infra05:18
*** wenlock has quit IRC05:20
*** praneshp_ has joined #openstack-infra05:21
*** rkukura has joined #openstack-infra05:22
*** praneshp has quit IRC05:23
*** praneshp_ is now known as praneshp05:23
*** sasik_ has quit IRC05:24
*** craigbr has quit IRC05:25
*** sasik_ has joined #openstack-infra05:25
*** shashankhegde has quit IRC05:26
*** [HACKING-TWITTER has quit IRC05:28
*** stevemar has quit IRC05:29
*** jp_at_hp has quit IRC05:33
*** asettle has quit IRC05:35
*** [HACKING-TWITTER has joined #openstack-infra05:36
*** asettle has joined #openstack-infra05:36
*** dims__ has joined #openstack-infra05:37
*** yixuanzhang has joined #openstack-infra05:37
*** [HACKING-TWITTER has joined #openstack-infra05:38
*** dims__ has quit IRC05:42
*** [HACKING-TWITTER has joined #openstack-infra05:42
*** yfried has joined #openstack-infra05:43
*** timrc-afk is now known as timrc05:44
*** [HACKING-TWITTER has joined #openstack-infra05:45
*** jp_at_hp has joined #openstack-infra05:45
*** flaper87|afk is now known as flaper8705:46
*** [HACKING-TWITTER has joined #openstack-infra05:47
*** yfried has quit IRC05:48
*** yfried has joined #openstack-infra05:49
yixuanzhangHi, I meet an issue for the CI , after I run the jenkins job dsvm-tempest-full with the full test, most of the memory of the slave node was used. when I check the process with command "top", it was found there are many nova-api ,nova-conductor, that caused the large memory usage. Does anybody meet the same issue ?05:50
*** timrc is now known as timrc-afk05:53
*** p5ntangle has joined #openstack-infra05:57
*** tnurlygayanov has quit IRC05:59
*** tnurlygayanov has joined #openstack-infra06:01
*** dtantsur|afk is now known as dtantsur06:02
*** yixuanzhang1 has joined #openstack-infra06:02
*** yixuanzhang has quit IRC06:04
*** _nadya_ has joined #openstack-infra06:04
*** Azher has joined #openstack-infra06:06
anteayamattoliverau: yay!06:06
*** ildikov has joined #openstack-infra06:07
*** yfried_ has joined #openstack-infra06:07
anteayayixuanzhang1: I don't know what is causing your issue. Have you considered attending the third-party meeting? https://wiki.openstack.org/wiki/Meetings/ThirdParty06:08
anteayayixuanzhang1: many other administrators of third-party ci systems attend that meeting and someone may be able to help you06:08
*** harlowja_at_home has joined #openstack-infra06:10
*** yfried has quit IRC06:11
anteayaclarkb: re: 2014-07-20T20:49:35  <clarkb> at this point all CI systems except for "Jenkins" should have "CI" in their name iirc -- actually not yet, that is what we are moving towards, but that isn't the case at present06:11
anteayathe new accounts yes, the older ones are all over the place still, hoping to clean that up soon06:12
*** flaper87 is now known as flaper87|afk06:12
*** k4n0 has joined #openstack-infra06:16
*** praneshp has quit IRC06:17
*** cnesa has quit IRC06:17
*** penguinRaider__ has joined #openstack-infra06:19
*** Ryan_Lane has joined #openstack-infra06:22
*** _nadya_ has quit IRC06:22
*** bdpayne has joined #openstack-infra06:28
*** jp_at_hp has quit IRC06:31
*** penguinRaider__ has quit IRC06:31
*** e0ne has joined #openstack-infra06:31
*** Ryan_Lane has quit IRC06:32
*** penguinRaider__ has joined #openstack-infra06:32
*** afazekas has joined #openstack-infra06:34
*** chandankumar has joined #openstack-infra06:34
*** dkehnx has quit IRC06:35
*** dkehnx has joined #openstack-infra06:35
*** dims__ has joined #openstack-infra06:37
*** yixuanzhang1 has quit IRC06:38
*** yixuanzhang has joined #openstack-infra06:38
*** pcrews has joined #openstack-infra06:39
*** e0ne has quit IRC06:41
*** jp_at_hp has joined #openstack-infra06:41
*** dims__ has quit IRC06:42
*** pcrews has quit IRC06:44
*** e0ne has joined #openstack-infra06:45
*** e0ne has quit IRC06:47
*** yixuanzhang1 has joined #openstack-infra06:49
*** yixuanzhang has quit IRC06:49
*** e0ne has joined #openstack-infra06:52
*** yixuanzhang1 has quit IRC06:53
*** e0ne has quit IRC06:53
*** nati_ueno has joined #openstack-infra06:54
*** yolanda has quit IRC06:56
*** e0ne has joined #openstack-infra06:58
*** _nadya_ has joined #openstack-infra06:59
*** e0ne has quit IRC07:00
*** yolanda has joined #openstack-infra07:01
*** _nadya_ has quit IRC07:04
*** e0ne has joined #openstack-infra07:04
bmwiedemannanteaya: hope you enjoyed your trip to Heidelberg. looking forward to join the meeting this evening07:06
*** andreykurilin has joined #openstack-infra07:07
*** rkukura has quit IRC07:07
*** e0ne has quit IRC07:10
*** Evgeny has quit IRC07:11
anteayabmwiedemann: hi there07:13
anteayaI haven't gotten to Heidelberg yet07:13
bmwiedemann:-)07:13
bmwiedemannOh, I thought, you would be there on Saturday07:13
anteayawas planning to go Saturday but richard had told his child we were going to castle Frankenstein07:13
anteayaso we went to castle Frankenstein07:13
anteayawe have a good day07:13
anteayaI'm looking at the weather and seeing if I can go today07:14
anteayarainy so far07:14
bmwiedemannbut less hot in exchange07:14
anteayathat is true07:14
bmwiedemannthere is no such thing as "perfect"07:15
anteayaand less touristy since it is not a weekend07:15
anteayawell there is, but it is really hard to come by07:15
anteayaand it doesn't tend to last07:15
bmwiedemannit is just an illusion, that can be destroyed by someone telling you about some aspect that could be even better07:16
anteayaopen question for whoever is up first, how do I get make-index to actually make and index page in my local branch of the publications repo?07:16
anteayaI have a title on my readme and a branch name and they both match, what am I missing07:16
anteayabmwiedemann: actually no, that is just true most of the time07:17
*** Evgeny has joined #openstack-infra07:17
*** penguinRaider__ has quit IRC07:18
*** bogdando has quit IRC07:20
*** bdpayne has quit IRC07:20
*** Ryan_Lane has joined #openstack-infra07:22
*** rkukura has joined #openstack-infra07:22
*** nati_ueno has quit IRC07:23
* anteaya afk07:25
*** Longgeek has quit IRC07:26
*** Longgeek has joined #openstack-infra07:28
*** _nadya_ has joined #openstack-infra07:29
*** luqas has joined #openstack-infra07:30
*** jgallard has joined #openstack-infra07:31
*** luqas has quit IRC07:32
*** luqas has joined #openstack-infra07:32
*** jlibosva has joined #openstack-infra07:32
*** chandankumar has quit IRC07:33
*** yamamoto has quit IRC07:33
*** yamamoto_ has joined #openstack-infra07:33
*** ihrachyshka has joined #openstack-infra07:34
*** berendt has joined #openstack-infra07:35
*** jamielennox is now known as jamielennox|away07:36
enikanorov__hi folks07:37
enikanorov__msqld is killed due to out of memory error in some jobs - is it a known issue?07:37
*** dims__ has joined #openstack-infra07:38
*** jistr has joined #openstack-infra07:38
*** ihrachyshka has quit IRC07:39
*** ihrachyshka has joined #openstack-infra07:39
*** pblaho has joined #openstack-infra07:39
*** dims__ has quit IRC07:43
*** Hal has joined #openstack-infra07:46
*** Hal is now known as Guest5771207:46
*** e0ne has joined #openstack-infra07:47
*** arnaud has quit IRC07:47
*** Ryan_Lane has quit IRC07:48
*** vponomaryov has joined #openstack-infra07:54
*** IvanBerezovskiy has joined #openstack-infra07:55
*** jlibosva has quit IRC08:00
*** _nadya_ has quit IRC08:00
*** jlibosva has joined #openstack-infra08:02
*** _nadya_ has joined #openstack-infra08:03
*** harlowja_at_home has quit IRC08:04
*** rakhmerov has quit IRC08:04
*** jedimike has joined #openstack-infra08:05
*** katyafervent has quit IRC08:05
*** mattymo has quit IRC08:06
*** dguerri is now known as _dguerri08:12
*** mrda is now known as mrda-away08:14
*** rakhmerov has joined #openstack-infra08:14
*** isviridov is now known as isviridov|vacati08:14
*** gargola_ has quit IRC08:15
*** katyafervent has joined #openstack-infra08:15
*** _dguerri is now known as dguerri08:16
*** dguerri is now known as _dguerri08:16
*** _dguerri is now known as dguerri08:16
*** dguerri is now known as _dguerri08:16
*** _dguerri is now known as dguerri08:16
*** jp_at_hp has quit IRC08:18
*** gargola_ has joined #openstack-infra08:18
*** jp_at_hp has joined #openstack-infra08:18
*** jp_at_hp has quit IRC08:19
*** jp_at_hp has joined #openstack-infra08:19
*** mattymo has joined #openstack-infra08:19
sasik_Hi I am working for CI, i am seeing the following error during install_slave.sh; Could not find class ntp for ibm-openstac1-ci.in.ibm.com at /home/openstack/os-ext-testing/puppet/modules/os_ext_testing/manifests/base.pp:12 on node ibm-openstac1-ci.in.ibm.com08:20
sasik_And it breaks over here, can some one please help on this08:21
sasik_The base operating system is redhat6.508:21
*** _nadya_ has quit IRC08:23
*** oanufriev has joined #openstack-infra08:23
ihrachyshkahey. is it possible to remove a patch from gate once it's there?08:24
*** pbelanyi has joined #openstack-infra08:24
*** andreykurilin has quit IRC08:24
afazekasihrachyshka: You can set it to work in progress08:24
*** yixuanzhang has joined #openstack-infra08:24
*** oanufriev has quit IRC08:25
*** zz_johnthetubagu is now known as johnthetubaguy08:29
*** _nadya_ has joined #openstack-infra08:30
*** chandankumar has joined #openstack-infra08:32
*** jlibosva has quit IRC08:37
*** daya_k has joined #openstack-infra08:38
*** yamamoto_ has quit IRC08:39
*** dims__ has joined #openstack-infra08:39
*** dims__ has quit IRC08:43
*** cnesa has joined #openstack-infra08:46
*** rlandy has joined #openstack-infra08:48
*** jdsn_ has joined #openstack-infra08:49
*** jdsn_ is now known as jdsn08:50
*** jlibosva has joined #openstack-infra08:50
*** ihrachyshka has quit IRC08:51
*** ihrachyshka_ has joined #openstack-infra08:51
*** hashar has joined #openstack-infra08:51
*** p5ntangle has quit IRC08:53
*** p5ntangle has joined #openstack-infra08:54
*** ihrachyshka_ has quit IRC08:55
*** dguerri is now known as _dguerri08:56
*** Azher has quit IRC09:00
*** _dguerri is now known as dguerri09:03
*** rainya has quit IRC09:03
*** yamamoto has joined #openstack-infra09:07
cnesahi guys09:08
cnesawe are experiencing some failures in our last jenkins runs due to a neutron error09:09
*** yixuanzhang has quit IRC09:10
*** rainya has joined #openstack-infra09:10
*** ihrachyshka has joined #openstack-infra09:11
cnesait happens when we are trying to run devstack, here is the failure from the devstack log http://paste.openstack.org/show/87369/, is there a similar known issue over the CIs ?09:12
*** cnesa has quit IRC09:17
*** yixuanzhang has joined #openstack-infra09:18
*** rainya has quit IRC09:22
*** afazekas has quit IRC09:23
*** dguerri is now known as _dguerri09:25
*** pelix has joined #openstack-infra09:26
*** _dguerri is now known as dguerri09:29
*** oanufriev has joined #openstack-infra09:30
*** cnesa has joined #openstack-infra09:33
*** afazekas has joined #openstack-infra09:35
*** tnurlygayanov has quit IRC09:37
*** ihrachyshka has quit IRC09:37
yolandamonty, jeblair, sent a version of nodepool-dib that works and passes all tests09:38
yolandahowever, i'm testing now with other distros, such as debian or hLinux, and i find i need to add some custom DIB_* flags there09:38
yolandaany sugestions on how can we enable that on nodepool? i was thinking in adding a flags option to the diskimages yaml section09:39
yolandamordred, not monty ^ :)09:39
*** _nadya_ has quit IRC09:43
*** oanufriev has quit IRC09:44
cnesahi folks09:45
*** chandankumar has quit IRC09:46
*** yamamoto has quit IRC09:46
cnesadevstack is failing -log here -> http://paste.openstack.org/show/87369/- due to a neutron error -log here -> http://paste.openstack.org/show/87380/ - is it a known issue?09:50
cnesait's causing failures on some jenkins jobs on our CI ?09:51
*** rkukura_ has joined #openstack-infra09:51
*** rkukura has quit IRC09:51
*** rkukura_ is now known as rkukura09:51
*** enikanorov__ has quit IRC09:52
*** tnurlygayanov has joined #openstack-infra09:53
*** jgallard has quit IRC09:57
*** afazekas has quit IRC10:00
*** dguerri is now known as _dguerri10:02
*** _dguerri is now known as dguerri10:02
*** yamamoto has joined #openstack-infra10:05
*** chandankumar has joined #openstack-infra10:10
*** yamamoto has quit IRC10:10
*** chandankumar has quit IRC10:11
*** chandankumar has joined #openstack-infra10:11
*** afazekas has joined #openstack-infra10:13
*** che-arne has joined #openstack-infra10:21
*** unicell has quit IRC10:25
*** pcm_ has joined #openstack-infra10:26
*** ihrachyshka has joined #openstack-infra10:27
*** pcm_ has quit IRC10:27
*** pcm_ has joined #openstack-infra10:28
*** p5ntangle has quit IRC10:30
*** p5ntangle has joined #openstack-infra10:31
*** yamamoto has joined #openstack-infra10:36
*** Guest57712 has quit IRC10:37
*** hashar has quit IRC10:38
*** dims__ has joined #openstack-infra10:40
*** yamamoto has quit IRC10:41
jedimikereading http://docs.openstack.org/developer/heat/getting_started/on_devstack.html - does it mean that heat-cfntools is needed for heat to work on a node, or just that it needs one image with heat-cfntools to run the heat service?10:41
*** dims__ has quit IRC10:45
*** mkoderer has joined #openstack-infra10:47
*** sasik_1 has joined #openstack-infra10:48
*** sasik_ has quit IRC10:48
*** sasik_ has joined #openstack-infra10:51
*** sasik_1 has quit IRC10:54
*** yaguang has quit IRC10:54
*** p5ntangle has quit IRC10:59
*** che-arne has quit IRC11:00
*** p5ntangle has joined #openstack-infra11:03
*** yamamoto has joined #openstack-infra11:05
*** hashar has joined #openstack-infra11:07
*** ociuhandu has joined #openstack-infra11:08
*** yamamoto has quit IRC11:10
*** sasik_1 has joined #openstack-infra11:13
*** sasik_ has quit IRC11:14
sdaguejedimike: a cfntools head image is only needed for some of the more advanced heat provisioning11:16
sdaguebasic resource creation works without it11:16
jedimikesdague, ok, so if I wanted to use cfn-signal, the node I was provisioning would need to have cfntools?11:18
sdagueyeh11:19
jedimikegotcha, thanks11:21
*** daya_k has quit IRC11:24
*** dguerri is now known as _dguerri11:26
*** jp_at_hp has quit IRC11:26
*** jp_at_hp has joined #openstack-infra11:27
*** sasik_ has joined #openstack-infra11:28
*** mwagner_lap has quit IRC11:29
mugsieopenstackgerrit bot seems to have disappeared - can someone give it a kick?11:30
*** lukego has joined #openstack-infra11:30
*** saper_ is now known as saper11:31
*** sasik_1 has quit IRC11:31
*** denis_makogon has joined #openstack-infra11:32
*** _nadya_ has joined #openstack-infra11:32
*** freyes has joined #openstack-infra11:34
*** luqas has quit IRC11:37
ianwsdague: can i get a status update on https://review.openstack.org/#/c/104438/ (Revert "demote f20 to experimental")11:39
*** luqas has joined #openstack-infra11:39
*** dims__ has joined #openstack-infra11:41
*** mbacchi has joined #openstack-infra11:41
*** luqas has quit IRC11:41
*** yamamoto has joined #openstack-infra11:43
sdagueianw: clarkb said the zuul changes were active now, so it's probably fine.11:44
*** dims__ has quit IRC11:46
*** sasik_1 has joined #openstack-infra11:47
*** chuckC has quit IRC11:47
*** yamamoto has quit IRC11:48
*** che-arne has joined #openstack-infra11:48
*** sasik_ has quit IRC11:49
*** unicell has joined #openstack-infra11:49
*** dims__ has joined #openstack-infra11:50
*** jp_at_hp has quit IRC12:01
*** andreaf has joined #openstack-infra12:04
*** doug-fish has joined #openstack-infra12:08
ianwsdague: rebased, please double check as my eyes are  bit tired :)12:09
*** weshay has joined #openstack-infra12:10
*** HenryG_afk is now known as HenryG12:12
*** ArxCruz has joined #openstack-infra12:12
*** Guest57712 has joined #openstack-infra12:12
*** yixuanzhang has quit IRC12:13
*** rfolco has joined #openstack-infra12:14
*** praneshp has joined #openstack-infra12:16
*** p5ntangle has quit IRC12:17
*** p5ntangl_ has joined #openstack-infra12:19
*** yamamoto has joined #openstack-infra12:19
*** matrohon has joined #openstack-infra12:20
*** jgallard has joined #openstack-infra12:21
*** pdmars has joined #openstack-infra12:21
*** dencaval has joined #openstack-infra12:25
*** luqas has joined #openstack-infra12:25
*** sasik_1 has left #openstack-infra12:26
*** k4n0 has quit IRC12:28
*** praneshp has quit IRC12:28
*** e0ne has quit IRC12:32
*** aysyd has joined #openstack-infra12:34
*** derekh_ has joined #openstack-infra12:37
*** radez_g0n3 is now known as radez12:40
*** p5ntangl_ has quit IRC12:40
*** yamamoto has quit IRC12:45
*** dkranz has joined #openstack-infra12:48
*** che-arne has quit IRC12:49
*** dims__ has quit IRC12:50
*** dims__ has joined #openstack-infra12:50
*** e0ne_ has joined #openstack-infra12:50
*** yamamoto has joined #openstack-infra12:51
*** craigbr has joined #openstack-infra12:51
*** craigbr has quit IRC12:51
*** julim has joined #openstack-infra12:52
*** ihrachyshka has quit IRC12:53
*** ihrachyshka has joined #openstack-infra12:53
*** mfer has joined #openstack-infra12:54
*** berendt has quit IRC12:54
*** stevemar has joined #openstack-infra12:54
*** _nadya_ has quit IRC12:57
*** jp_at_hp has joined #openstack-infra12:58
*** p5ntangle has joined #openstack-infra12:59
*** p5ntangle has quit IRC13:00
*** otherwiseguy has joined #openstack-infra13:01
*** mflobo has joined #openstack-infra13:01
*** eharney has joined #openstack-infra13:02
*** ArxCruz has quit IRC13:04
*** ArxCruz has joined #openstack-infra13:05
*** lttrl has joined #openstack-infra13:05
*** jcoufal has joined #openstack-infra13:07
*** dims has joined #openstack-infra13:08
*** _nadya_ has joined #openstack-infra13:08
*** craigbr has joined #openstack-infra13:09
*** dims__ has quit IRC13:09
*** bcrochet has quit IRC13:11
*** craigbr has quit IRC13:11
*** craigbr has joined #openstack-infra13:12
*** bcrochet has joined #openstack-infra13:13
*** craigbr has quit IRC13:14
*** bknudson has joined #openstack-infra13:17
*** praneshp has joined #openstack-infra13:19
dhellmanngood morning, all13:19
dhellmannmordred: could the new py26 nodes be missing argparse somehow? http://logs.openstack.org/92/106592/3/check/gate-oslo.messaging-python26/1c731d8/console.html13:20
*** craigbr has joined #openstack-infra13:20
mordreduhm ... that should get pipd13:21
StevenKAnd I don't see argparse in requirements.txt13:22
*** craigbr has quit IRC13:22
dhellmannStevenK: it's there for oslo.config13:22
StevenKRight13:22
dhellmannpbr has special handling to ignore installing argparse as a dependency on py27, though this is 2613:23
dhellmannI guess we don't save the tox logs?13:24
*** homeless has joined #openstack-infra13:26
dhellmannmordred: hmm, it's failing for me locally, too, so I don't think it's anything to do with the node13:27
mordredwell, that's good at least13:28
mordredI'm about to take off ... will look as soon as I'm in the air13:29
dhellmannsafe travels13:29
*** mflobo has quit IRC13:29
*** mriedem has joined #openstack-infra13:30
dhellmannmordred: the oslo.config alpha wheel being used doesn't depend on argparse, possibly because it's being built on a 2.7 server where pbr filters out that dependency?13:32
mordredahhhhh13:32
mordredOK. so, that's a good catch13:33
* dhellmann hasn't had enough caffeine to know how to fix that yet13:33
*** mwagner_lap has joined #openstack-infra13:33
mordreddhellmann: I have an idea ...13:33
*** ildikov has quit IRC13:34
dhellmannI wonder if this is affecting any other jobs13:34
mordreddhellmann: we didn't think this was going to WORK did we? :)13:35
dhellmannhar har13:35
*** rustlebee is now known as russellb13:36
*** dhellmann is now known as dhellmann_13:41
*** dmsimard_away is now known as dmsimard13:43
*** p5ntangle has joined #openstack-infra13:43
*** otherwiseguy has quit IRC13:44
*** adalbas has joined #openstack-infra13:52
*** sballe has joined #openstack-infra13:54
*** p5ntangle has quit IRC13:54
*** armax has joined #openstack-infra13:55
*** signed8bit has joined #openstack-infra13:56
*** berendt has joined #openstack-infra13:57
clarkbanteaya: thanks good to know14:00
*** daya_k has joined #openstack-infra14:00
clarkbdhellman mordred dont you just add argparse to the reqs list?14:00
clarkbor is wheel generation messing that up?14:01
*** dustins has joined #openstack-infra14:02
*** ildikov has joined #openstack-infra14:03
*** nelsnelson has joined #openstack-infra14:05
anteayaclarkb: np14:06
anteayasdague: have you seen this post yet? it might be an interesting point of introduction to some of what was discussed at the meetup: http://lists.openstack.org/pipermail/openstack-dev/2014-July/040755.html14:13
*** KimJ has joined #openstack-infra14:14
anteayathis line in particular caught my eye: Why do we test individual changes in the gate? The purpose is to find errors *in the change under test*.14:14
anteayasince that was rather a paradigm shifting point of discussion14:15
*** gargola_ has quit IRC14:15
anteayakeeping in mind this poster is the same poster that wants to hammer away at recheck until bugs make it in: http://lists.openstack.org/pipermail/openstack-dev/2014-July/040560.html14:15
*** hashar is now known as hasharMeeting14:16
*** gargola has joined #openstack-infra14:16
*** jp_at_hp1 has joined #openstack-infra14:19
*** jgrimm has joined #openstack-infra14:21
*** _nadya_ has quit IRC14:21
*** jp_at_hp has quit IRC14:21
*** zz_gondoi is now known as gondoi14:21
*** _nadya_ has joined #openstack-infra14:23
*** vhoward has joined #openstack-infra14:23
*** betsy has quit IRC14:23
*** ihrachyshka has quit IRC14:25
anteayaso I still am uncertain how to create a new index page in a new local branch of the publications repo14:29
anteayaI need to start making slides for my talk at pyconau14:29
*** ArxCruz has quit IRC14:29
anteayaI created a new branch and have a readme file and the names match14:30
anteayabut I still get the default index page generated14:30
*** dhellmann_ is now known as dhellmann14:30
*** pradk has joined #openstack-infra14:30
*** alexpilotti has joined #openstack-infra14:30
dhellmannclarkb: it's in the requirements list but wheel generation is messed up, probably because pbr filters out argparse and some other modules that are needed for 2.6 but present in the stdlib in 2.714:30
*** otherwiseguy has joined #openstack-infra14:31
*** che-arne has joined #openstack-infra14:31
*** yfried_ has quit IRC14:32
*** yfried_ has joined #openstack-infra14:32
anteayaotherwiseguy: hey there14:32
anteayaotherwiseguy: what are you working on atm?14:32
* anteaya gestures at all the infra loveliness14:32
*** rwsu has joined #openstack-infra14:32
mordreddhellmann: ok. workaround almost done14:33
dhellmannmordred: is it a pbr fix?14:33
mordreddhellmann: nope14:33
mordredit's even better14:33
anteayamordred: do you know anything about creating a new index file in a new branch of the publications repo?14:34
mordreddhellmann: I just made a library. https://pypi.python.org/pypi/argparse-safe14:34
* dhellmann holds onto his hat for mordred's fix14:34
*** Longgeek has quit IRC14:34
dhellmannmordred: holy hacks, batman14:34
*** ArxCruz has joined #openstack-infra14:34
* anteaya pictures dhellmann clutching a hat and giggles softly14:35
otherwiseguyanteaya: right now working on rewriting neutron's ovs_lib to use ovsdb directly instead of calling ovs-vsctl: https://review.openstack.org/#/c/106183/3/specs/juno/vsctl-to-ovsdb.rst14:35
dhellmannmordred: so, change global-requirements and then the oslo.config requirements?14:35
mordreddhellmann: that argparse is still broken is LUDICROUOS14:36
mordreddhellmann: https://review.openstack.org/10838314:36
dhellmannmordred: I'll +2a that when the tests finish, since oslo is largely blocked14:36
anteayaotherwiseguy: goodness you have some work to do, and it looks like worthy work to do14:36
anteayaotherwiseguy: I'll wait then and try again, I'll get you in here :D14:36
*** wenlock has joined #openstack-infra14:36
*** dkranz has quit IRC14:36
otherwiseguyanteaya: :-D14:36
anteayaotherwiseguy: happy ovsdb14:37
*** alexpilotti has quit IRC14:38
mordreddhellmann: awesome. actually ...14:38
mordreddhellmann: argparse itself may have been fixed ...14:38
dhellmannoh?14:38
mordreddhellmann: I just tried "pip install argparse" on a 2.7 machine14:38
mordredand it did not fail fatally14:38
dhellmannso we could just stop filtering in pbr?14:38
mordredmaybe? let me try that a little bit more strongly in a virtualenv real quick14:39
*** _nadya_ has quit IRC14:39
dhellmannI assumed the problem was with pip/setuptools, not argparse itself14:39
mordredI'd LOVE that14:39
*** ArxCruz has quit IRC14:39
mordrednope - it was an argparse bug14:39
mordredargparse's setup.py failed hard on 2.714:39
*** Evgeny has joined #openstack-infra14:39
mordredor something14:40
dhellmannah14:40
* mordred double checking14:40
dhellmannI thought it was the fact that we'd get 2 copies installed (one in lib/python2.7 and one in lib/python2.7/site-packages14:40
*** james_li has joined #openstack-infra14:40
anteayaI'm looking at the amount of effort in creating metadata and packaging for what amounts to 2 lines of code (well 3 if you count the declaration)14:41
*** ArxCruz has joined #openstack-infra14:41
mordreddhellmann: the above ^^ works for me in terms of installing oslo.config into a virtualenv14:42
mordredgah14:42
mordredhttps://review.openstack.org/10838714:42
mordreddhellmann: the above ^^ works for me in terms of installing oslo.config into a virtualenv14:42
*** datsun180b has joined #openstack-infra14:43
dhellmannmordred: "breaks things" is sorta vague -- I'll file a bug to track this properly14:43
HenryGWhat is the bot thingy that posts gerrit changes to the IRC channels? It doesn't seem to be working for the neutron repos.14:44
mordredHenryG: I believe we lost it to a netsplit. I'll get it in a sec14:44
*** marun has joined #openstack-infra14:44
HenryGmordred: Thanks! No rush.14:45
dhellmannmordred: https://bugs.launchpad.net/pbr/+bug/134635714:45
uvirtbotLaunchpad bug 1346357 in pbr "argparse not installed with alpha wheel of oslo.config" [Undecided,New]14:45
* dhellmann goes to find the bug reference syntax to update the commit message on mordred's patch14:46
*** vhoward has left #openstack-infra14:46
mordreddhellmann: I got it14:46
anteayaHenryG: the name is openstackgerrit, for future reference14:46
anteaya2014-07-20T06:43:02  *** openstackgerrit has quit IRC14:46
anteayagone since yesterday14:47
HenryGanteaya: That is too obvious ;)14:47
mordreddhellmann: updated14:47
anteayaof course14:47
dhellmannmordred: cool, thanks14:47
anteayawe need to be more cryptic14:47
*** thedodd has joined #openstack-infra14:49
*** katyafervent is now known as katyafervent_awa14:49
dhellmannmordred: we'll need a new version of pbr and a new version of oslo.config. anything else?14:49
*** daya_k has quit IRC14:50
*** rfolco has quit IRC14:50
mordreddhellmann: that should do it14:50
*** dkranz has joined #openstack-infra14:50
dhellmannmordred: ok, I can push all of that through today as jobs pass14:50
dhellmannmordred: thanks for the quick turn-around on this one :-)14:50
*** rfolco has joined #openstack-infra14:51
dhellmannmordred: could you +2A https://review.openstack.org/#/c/108030/ so we can debug failures like http://logs.openstack.org/11/107911/2/check/gate-oslo.messaging-docs/feef154/console.html.gz14:52
*** doddstack has joined #openstack-infra14:52
*** thedodd has quit IRC14:54
anteayajedimike: don't be afraid to use your -114:55
*** hogepodge has joined #openstack-infra14:55
*** morganfainberg_Z is now known as morganfainberg14:56
*** rfolco has quit IRC14:56
mordreddhellmann: my pleasure! glad this one was more simpler than the others14:56
*** yamamoto has quit IRC14:57
mordreddhellmann: testing others ... ordereddict also seems to install fine ... any idea what the problems were with these?14:57
dhellmannmordred: I really think we thought they would fail because they were already present. Maybe a pip or setuptools in the mean time has fixed that?14:58
mordreddhellmann: it's entirely possibel that pip/setuptols have fixed it14:58
mordredall three work for me now on 2.714:58
mordredI wonder if we shouldnt just remove the whole BROKEN_ON_27 section14:59
dhellmannmordred: or maybe version detection was somehow wrong and it couldn't tell whether the version installed was good enough compared to the version we wanted14:59
*** terryw has joined #openstack-infra14:59
*** katyafervent_awa is now known as katyafervent14:59
dhellmannmordred: yeah, if it works, let's remove them all14:59
krotscheckStoryBoard meeting in #openstack-meeting-314:59
*** otherwiseguy has quit IRC14:59
dhellmannmordred: unless you want to track down someone who remembers why it was put in?14:59
*** rainya has joined #openstack-infra14:59
mordreddhellmann: oh - btw - pbr is going to fail because I didn't remove the unittest that tests for that. one sec15:00
*** rainya has quit IRC15:00
*** zns has joined #openstack-infra15:00
*** chandankumar has quit IRC15:00
*** rainya has joined #openstack-infra15:00
*** alexpilotti has joined #openstack-infra15:01
*** openstackgerrit has joined #openstack-infra15:03
*** andreykurilin has joined #openstack-infra15:04
*** che-arne has quit IRC15:05
dhellmannmordred: ok, I'll watch for those pbr tests to pass and then merge both changes15:05
dhellmannmordred: when you have a sec, please look over https://review.openstack.org/#/c/108030/ -- it's blocking oslo.messaging 1.3.1 which is blocking ceilometer15:05
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Adds addtional details for browsable logs for third party ci  https://review.openstack.org/10122715:06
*** signed8bit has quit IRC15:06
*** alexpilotti has quit IRC15:06
*** ildikov has quit IRC15:08
*** rfolco has joined #openstack-infra15:08
*** david-lyle has joined #openstack-infra15:08
mordreddhellmann: +A15:09
dhellmannmordred: thanks15:09
*** Evgeny has quit IRC15:09
*** Evgeny has joined #openstack-infra15:09
*** nelsnelson has quit IRC15:09
*** pcm_ has quit IRC15:11
*** signed8bit has joined #openstack-infra15:12
*** p5ntangle has joined #openstack-infra15:14
*** yamamoto has joined #openstack-infra15:15
*** nelsnelson has joined #openstack-infra15:16
*** hasharMeeting has quit IRC15:17
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Adds Third Party CI account request directions  https://review.openstack.org/10101315:19
*** dmellado has joined #openstack-infra15:19
*** p5ntangl_ has joined #openstack-infra15:20
*** gyee has joined #openstack-infra15:20
openstackgerritAnita Kuno proposed a change to openstack-infra/config: Edtis Third Party CI account request directions  https://review.openstack.org/10101315:20
*** betsy has joined #openstack-infra15:21
*** p5ntangl_ has quit IRC15:21
*** romcheg2 has joined #openstack-infra15:22
*** p5ntangle has quit IRC15:23
romcheg2Hi guys!15:23
romcheg2I'm trying to run grenade but it fails installing icehouse devstack.15:23
anteayahi romcheg215:23
*** eharney has quit IRC15:24
anteayado you have a stacktrace?15:24
romcheg2python-openstackclient fails with openstackclient.shell Exception raised: six>=1.6.015:24
anteayalet's peek at a stacktrace15:24
*** bnemec has joined #openstack-infra15:25
romcheg2It all seems to work as usual before this: http://paste.openstack.org/show/87428/15:25
*** p5ntangle has joined #openstack-infra15:26
romcheg2I tried to run openstackclient manually but got the same exception.15:26
openstackgerritA change was merged to openstack-infra/config: Show pip freeze output for all docs jobs  https://review.openstack.org/10803015:26
romcheg2And I'm not familiar enough with stable releases :(15:26
*** p5ntangle has quit IRC15:27
*** pcm_ has joined #openstack-infra15:27
*** pcm_ has quit IRC15:28
*** pcm_ has joined #openstack-infra15:29
*** rainya has quit IRC15:29
*** andreykurilin has quit IRC15:29
anteayathat is a fairly short stacktrace15:29
anteayais that the whole thing?15:29
*** dkranz has quit IRC15:30
*** rcarrill` has joined #openstack-infra15:30
romcheg2anteaya: No, it's pretty long. This shows the reason while it fails15:30
*** rcarrill` is now known as rcarrillocruz15:30
morganfainberganteaya, you might know this, but is there any magic i need to add to make the LP bot comment on / update / fix bugs and BPs when code is submitted? I didn't see anything specific in config, but i might just be missing it.15:30
romcheg2*why15:30
morganfainberganteaya, no rush, whenever you have a moment to answer.15:31
*** mfer has quit IRC15:31
anteayaromcheg2: well then you have the same information that i have15:31
rcarrillocruzmorganfainberg: that's done with the gerrit hooks and jeepyb update_bug/update_blueprint scripts15:31
cnesahi folks15:31
rcarrillocruzwhat are you doing? deploying a local gerrit server?15:31
anteayaromcheg2: something about the six version15:31
cnesadevstack is failing -log here -> http://paste.openstack.org/show/87369/- due to a neutron error -log here -> http://paste.openstack.org/show/87380/ - is it a known issue?15:31
morganfainbergrcarrillocruz, no i am trying to verify keystonemiddleware is getting updates15:32
anteayaromcheg2: but I don't know if the mirror is unavailable, or if the version is not available on the mirror15:32
morganfainbergrcarrillocruz, i'll make a fake bug report and 2x check today, but i think it's missing them.15:32
*** rainya has joined #openstack-infra15:32
anteayamorganfainberg: yes in the commit message wikipage on external references15:32
romcheg2anteaya: Yes, but how to fix that, that is the question :)15:32
cnesait causes all of our jenkins jobs to fail15:32
morganfainberganteaya, ok. i'll poke around to see if we're missing something. thanks15:33
anteayamorganfainberg: https://wiki.openstack.org/wiki/GitCommitMessages#Including_external_references15:33
anteayamorganfainberg: now you have to have this in the first patchset for lp to pick it up15:33
morganfainberganteaya, right, and i *think* it's not updating the bugs even when we have those15:33
rcarrillocruzwhat i usually do is to put some echo statements  in the gerrit hook to /tmp/params.txt before the update-bug.py script is called15:33
anteayamorganfainberg: okay then that is a problem with the hooks15:33
*** mfer has joined #openstack-infra15:33
anteayaI think they are in config somewhere15:33
rcarrillocruzthat way i know what's going on, cos jeepyb is not very verbose in logging15:34
morganfainberganteaya, i'll 2x check, we don't have much traffic in middleware, so i'll verify with a contrived example15:34
*** moted has joined #openstack-infra15:34
anteayaI saw them not long ago but I can't remember what they were called to grep them, or in what file I saw them15:34
anteayamorganfainberg: sorry :(15:34
morganfainbergrcarrillocruz, I'd be able to do that if I was deploying something local, but this is for the o.o gerrit/jenkins15:34
*** jistr has quit IRC15:35
morganfainbergrcarrillocruz, anteaya , thanks i'll figure it out.15:35
morganfainberg:)15:35
anteayaromcheg2: well I dno't know why it failed, like I said, so I don't know how to fix it15:35
rcarrillocruzyeah, you need some root folks to look into it15:35
anteayaromcheg2: I will take a look at the full stacktrace if you have one available15:35
*** craigbr has joined #openstack-infra15:35
* rcarrillocruz thinks we should log params passed to the hooks to troubleshoot this issues15:36
morganfainbergrcarrillocruz, likely it's a config issue, just have't been able to figure out *what* config issue.15:36
anteayacnesa: hello15:36
anteayacnesa: you are asking about your third party ci system, correct?15:36
krtaylorhey anteaya, Do you want to take the third-party meeting chair today?15:37
anteayakrtaylor: I can if you need me to, I'm kinda still on my time off15:37
anteayaoffically15:37
anteayaI was just getting some stuff updated15:38
anteayaand it had been raining outside15:38
krtayloranteaya, oh, ok, np - you vacation like I do  :)15:38
*** yfried_ has quit IRC15:38
anteayakrtaylor: you are doing a great job, you are welcome to continuing chairing15:38
anteayakrtaylor: yeah, I do15:38
anteaya:D15:38
krtayloranteaya, I *think* we are having a cinder update like neutron did last week, need to verify with jungleboyj15:39
rcarrillocruzkrtaylor: hi, it's the first 3rd party meeting i'll attend. Do you have some etherpad or wiki page with the agenda topics to be covered for today?15:39
krtaylorrcarrillocruz, yes, but it needs to be updated, doing that now15:40
anteayakrtaylor: awesome, great work!!15:40
*** signed8bit has quit IRC15:40
krtaylorrcarrillocruz, https://wiki.openstack.org/wiki/Meetings/ThirdParty15:40
romcheg2anteaya: http://xsnippet.org/360068/ paste.openstack.org didn't allow me to paste everything15:40
morganfainberganteaya, unrelated, you have a good infra-meetup? I assume you're back now? (if so, welcome back)15:40
rcarrillocruzthanks15:40
anteayakrtaylor: I have wanted that for a while, thanks for pulling that together15:40
*** emagana has joined #openstack-infra15:40
anteayakrtaylor: and I have updated some of these patches: https://review.openstack.org/#/q/status:open+project:openstack-infra/config+branch:master+topic:third-party,n,z15:40
*** signed8bit has joined #openstack-infra15:40
krtayloranteaya, if work will allow I'll review them today15:41
anteayamorganfainberg: had a great time, still in frankfurt15:41
anteayamorganfainberg: took today off (ha ha ha)15:41
anteayamorganfainberg: but it was raining and new folks will be attending the third party meeting today15:41
anteayawanted to be there15:41
anteayakrtaylor: kk, thanks, would be good if you were at least aware of the new patches15:42
anteayakrtaylor: it might come up at the meeting15:42
*** dkranz has joined #openstack-infra15:42
morganfainbergahaha15:43
*** ihrachyshka has joined #openstack-infra15:43
krtayloranteaya, I am SO frustrated with my email, I missed some important third-party threads *completely*15:43
morganfainbergi can tell you're taking the day off >.>15:43
morganfainberg<.<15:43
morganfainbergnice15:43
anteayakrtaylor: what is happening with your email?15:43
anteayamorganfainberg: ha ha, yeah15:43
krtayloranteaya, I am working to switch to a different account/reader15:43
morganfainberganteaya, well have a great day there!15:43
anteayakrtaylor: good idea15:43
morganfainbergsend some rain to SoCal15:43
morganfainbergwhile you're at it15:43
krtayloranteaya, my filtering is crap15:43
anteayamorganfainberg: thanks15:43
anteayamorganfainberg: will do my best15:43
anteayakrtaylor: :(15:44
*** romcheg2 has quit IRC15:44
* krtaylor glares at notes15:44
anteayaI don't use filtering well15:44
anteayanothing to do with my email client, this is all my fault15:44
cnesaanteaya, correct. Is the HyperV CI for neutron15:47
openstackgerritDenis M. proposed a change to openstack-infra/config: Added job for trove functional tests with heat support enabled  https://review.openstack.org/10060115:47
openstackgerritDenis M. proposed a change to openstack-infra/config: Refactoring Trove gates jobs  https://review.openstack.org/10841115:47
*** afazekas has quit IRC15:47
anteayaokay so hyperv has been active for a while, which answers my first question "have you had success with your ci in the past?"15:47
anteayawhen you started seeing this, can you correlate the errors with any changes internally?15:48
cnesaanteaya15:49
cnesaanteaya yep everything was working fine until this patch merged today https://github.com/openstack/neutron/commit/b3202c3283597de031572e0ede082237487d811015:49
cnesaanteaya it's an issue in the logging subsystem for the ml2 plugin15:50
anteayacnesa: okay well your system passed it on patch 21 and failed on patch 2515:51
*** kmartin has joined #openstack-infra15:52
anteayacnesa: so this is a situation where you go to the ptl of neutron and the owner of the patch and ask 1) why was a patch that broke you merged and 2) what can you do to help fix things now15:52
anteayaif the approver was anyone other than the ptl I would suggest you include them as well15:53
anteayacnesa: this is now a neutron issue and not a third party ci issue15:53
anteayathis is the point of third party ci, build failed because teh code would break you15:54
*** Guest32427 is now known as mfisch15:54
anteayawe haven't had many reliable situations that I have witnessed in teh past so this is new territory here15:54
cnesaanteaya yes, here is the failure http://64.119.130.115/71904/25/devstack_logs/screen-q-svc.log.gz but since we are not voting it didn't matter :)15:54
*** doddstack has quit IRC15:54
*** mfisch is now known as Guest6083115:54
anteayaso this is a process of learning and communication for all concerned15:54
anteayacnesa: you can't vote on the gate15:55
*** mestery has quit IRC15:55
*** Evgeny has quit IRC15:55
cnesaanteaya yes I know, but since I didn't manage to contact yet the original author I wondered if you guys saw it already15:55
anteayacnesa: what you can do as a developer is pay attention to patches that break hyperv and review them, as a developer15:55
anteayacnesa: I personally have not15:55
anteayabut since I have been afk lately and am still technically on a vacation day, I'm a bad sample15:56
*** vermarah_ has joined #openstack-infra15:56
pleia2morning15:56
anteayamorning pleia215:56
anteayahow are you feeling?15:57
pleia2doing ok, enjoying germany? :)15:57
anteayavery much so15:57
anteayatoday I have mostly slept15:57
anteayathe weekend was lovely15:57
pleia2great15:57
anteayathe australians make wonderful travel companions15:57
anteayaI recommend them15:57
pleia2hehe15:58
anteayaso I have a comment back to you on your comment on one of my patches, the targeting blueprints for infra-manual15:58
*** e0ne_ has quit IRC15:59
pleia2already re-reviewed15:59
pleia2(actually been awake for a while now, just less social :))16:00
anteayapleia2: thanks16:00
*** Guest60831 has quit IRC16:01
anteayapleia2: yeah, I hear that16:01
anteayaif I was living here rather than just visiting I could get so much done during the day16:01
anteayahowever if I got stuck I would be stuck for several hours16:01
pleia2when no one is around? :)16:01
anteayayeah :D16:01
anteayapleia2: hey you would know this16:01
anteayathe publications repo16:01
anteayaI am creating slides for my next talk16:02
* pleia2 nods16:02
anteayaI have cloned the repo, made a new branch and have a readme with a title that is the same as the local branch16:02
*** arnaud has joined #openstack-infra16:02
anteayatitle here since it is not the name of the file16:02
openstackgerritJustin Shepherd proposed a change to openstack-infra/config: New Chef repo for Specs  https://review.openstack.org/10783316:02
anteayaand when I run make-index I just get the default index page16:02
anteayaI am expecting one entitled the name of my branch16:03
anteayawhat I am doing wrong?16:03
*** nati_ueno has joined #openstack-infra16:03
anteayado I have the wrong expectation perhaps16:03
pleia2I've never used the make-index file locally, I don't know that it is supposed to work16:03
anteayaah16:03
*** rkukura has quit IRC16:03
anteayahow do you create a new index file for a new set of slides?16:04
openstackgerritJustin Shepherd proposed a change to openstack-infra/config: New Chef repo for Specs  https://review.openstack.org/10783316:04
anteayajust copy/paste from an existing one?16:04
*** dmellado has quit IRC16:04
pleia2you just edit the index.html that is already there16:04
anteayaah okay16:04
anteayaI was trying to make it hard16:04
*** jaypipes has joined #openstack-infra16:04
*** arnaud has quit IRC16:04
pleia2yeah, it's simple16:04
*** IvanBerezovskiy has left #openstack-infra16:04
anteayaI'll stop trying so hard16:04
pleia2all the magic happens once it's committed16:04
anteayaah16:05
anteayagood to know16:05
*** rkukura has joined #openstack-infra16:05
*** pblaho has quit IRC16:05
cnesaanteaya I announced the issue on the neutron channel and I received no answer, can you please tell who's in charge of the neutron CI testing 'cause nobody answered on the neutron channel and all patches are failing16:06
*** msabramo has joined #openstack-infra16:06
*** rainya has quit IRC16:06
*** rkukura_ has joined #openstack-infra16:06
*** chandankumar has joined #openstack-infra16:07
*** dmellado has joined #openstack-infra16:07
*** thedodd has joined #openstack-infra16:09
anteayacnesa: did you ask for mestry?16:09
Kiallfungi / mordred etc - could you re-review the Designate gerrit ACL change? Needs to land before russellb / ttx can do our release... https://review.openstack.org/#/c/107688/16:09
anteayacnesa: and the owner of that change?16:09
*** rkukura has quit IRC16:09
*** rkukura_ is now known as rkukura16:09
anteayacnesa: you will notice there is currently a discussion going on in the channel, involving at least 4 people16:10
krotscheckDoes groups.openstack.org have a gerrit project? I’m seeing openstack-infra/groups, but I’m not certain if that’s the right one.16:10
anteayacnesa: this is a normal and expected use of the channel16:10
*** yfried_ has joined #openstack-infra16:10
*** yamahata has joined #openstack-infra16:10
*** rainya has joined #openstack-infra16:10
anteayacnesa: I suggest that after that discussion has concluded asking again and naming mestery by name16:11
anteayacnesa: if you interrupt a discussion going on in an irc channel, the liklihood people will continue to focus on their discussion is high16:12
anteayacnesa: you can also add an agenda item to the neutron weekly meeting16:12
anteayathat meeting takes place today16:12
anteayakrotscheck: I'm going with that is a reed question16:13
anteayakrotscheck: I don't entirely understand what is happening there16:13
*** cody-somerville has joined #openstack-infra16:13
*** cody-somerville has quit IRC16:13
*** cody-somerville has joined #openstack-infra16:13
clarkbI think thst is the repo16:14
*** luqas has quit IRC16:14
*** marcoemorais has joined #openstack-infra16:14
clarkbphp thing iirc?16:14
* krotscheck doesn’t know, just wants to give reed an instruction manual on how to add it to StoryBoard.16:14
pleia2yeah, that's the repo16:14
krotscheckActually.16:14
krotscheckHrm.16:14
krotscheckSo, “Adding a project to storyboard” feels like somethign I want in general Infra config. Where would I put that?16:15
krotscheckSorry16:15
krotscheck*general Infra documentation16:15
anteayacnesa: and if all patches are failing, I do suggest you disable your system until this is addressed16:15
clarkbprobably the infra manual16:15
pleia2krotscheck: I think we should create a new storyboard page in our docs16:15
anteayacnesa: if someone complains, I will need to suggest more strongly16:15
*** rcarrill` has joined #openstack-infra16:15
*** dmellado has left #openstack-infra16:16
*** dmellado has quit IRC16:16
anteayaI like the idea of putting it in the infra manual16:16
pleia2krotscheck: so in config, a doc/source/storyboard.rst16:16
*** shashankhegde has joined #openstack-infra16:16
anteayain the developer guide16:16
*** dmellado has joined #openstack-infra16:16
anteayaKiall: so you want to create a new group, designate-specs-core, is that accurate?16:16
anteayaKiall: or is re-naming the -milestone group to specs-core going to work?16:17
KiallWell, that just happens to be part of the sync with other openstack/* repos :)16:17
*** rcarrillocruz has quit IRC16:17
*** markmcclain has joined #openstack-infra16:17
KiallThe main thing is dropping the exclusiveGroupPermissions on the openstack/designate repos [access "refs/heads/proposed/*"]16:18
anteayanope you keep that group16:18
*** eharney has joined #openstack-infra16:18
Kialli.e. allowing the release folks to do their thing16:18
anteayaand you don't have a designate-ptl gerrit group yet16:18
KiallYes, The jeepyb manage-projects script will auto-create any groups that don't exist yet..16:18
anteayaKiall: only some repos, some spec repos just use core16:19
*** chandankumar has quit IRC16:19
anteayaso if the only reason for creating the specs group is because everyone else has one, might I suggest the use of designate-core for that permission16:19
KiallI synced up to match nova/glance - and noticed they were 100% identical bar s/nova/glance/, so stopped looking at the others :)16:19
*** berendt has quit IRC16:19
krtayloranteaya, could you come say a few words the third-party meeting about third-party things that happened at the mid-cycle?16:20
krtayloranteaya, no pressure, it could be next week when you are "back"16:20
anteayakrtaylor: sure16:20
anteayanp, I'll be there today16:21
krtayloranteaya, great thx16:21
cnesaanteaya we contacted the author, the fix is on the way. One question: This happened in a debug message, do you keep debug on the jenkins CI?16:21
anteayaKiall: yeah there is much cargo culting in the acls, hence my questions for clarification16:21
openstackgerritA change was merged to openstack/requirements: Revert oslo.messaging 1.4.0.0a3 and oslo.config 1.4.0.0a2  https://review.openstack.org/10805516:22
anteayacnesa: we keep all the jenkins logs16:22
anteayacnesa: they are linked in the comment on the patch16:22
anteayaKiall: let's ensure you have the acls that meet your needs, and not someone else's16:23
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/config: Edits Third Party CI account request directions  https://review.openstack.org/10101316:23
cnesaanteaya sure, we do the same, just wondering if you have debug = true, as it looks like no other CI failed for this issue16:23
pleia2anteaya: ^^ fixed your commit message title via the gerrit interface16:23
*** dmellado has left #openstack-infra16:23
cnesaanteaya teh issue was in a LOG.debug() line16:24
anteayapleia2: okay will look in a second16:24
pleia2just changed "Edtis" to "Edits"16:24
anteayacnesa: I'm not following you, but grepping for debug = true in devstack, devstack_gate and tempest would be where I would start to answer your question16:24
anteayapleia2: ah, yes thank you16:25
*** nati_ueno has quit IRC16:25
*** mugsie has quit IRC16:25
pcm_anteaya: ping16:26
*** romcheg1 has joined #openstack-infra16:26
anteayapcm_: hello16:26
*** mugsie has joined #openstack-infra16:26
pcm_anteaya: Hi! I have a patch that passed Jenkins, I replied to a comment and it re-ran Jenkins and failed.16:27
anteayaKiall: help me understand what you are doing that lines 6-17 are necessary: https://review.openstack.org/#/c/107688/4/modules/openstack_project/files/gerrit/acls/openstack/python-designateclient.config16:27
pcm_I looked at the log and I don't see the error when googling bugs.launchpad.net16:27
*** ArxCruz has quit IRC16:28
pcm_anteaya: I did a "recheck nobug". Is that the right way to have it recheck? Is there something I should do to better find if this is a known failure?16:28
anteayapcm_: yes, if there is any activity on the account and the last successful jenkins run is more than 48 hours, that triggers jenkins to run again16:28
anteayapcm_: let's see the patch?16:28
pcm_https://review.openstack.org/#/c/107473/16:28
*** ArxCruz has joined #openstack-infra16:29
*** jedimike has quit IRC16:29
openstackgerritDenis M. proposed a change to openstack-infra/config: Refactoring Trove gates jobs  https://review.openstack.org/10841116:31
openstackgerritDenis M. proposed a change to openstack-infra/config: Added job for trove functional tests with heat support enabled  https://review.openstack.org/10060116:31
mugsieanteaya: for a proposed/* branch Release Managers, or the designate-milestone should be able to +2, +W, or abandon changes16:32
pcm_anteaya: I couldn't seem to match it to a known bug.16:32
mugsie(re ps: 107688)16:32
anteayaclarkb: what level of importance is fatal: Couldn't find remote ref refs/zuul/master/Zcc6d001cd37e4fadbe767227e59de01016:33
mugsiebut the designate-core permissions should not work on those changes16:33
*** chandankumar has joined #openstack-infra16:33
*** atiwari has joined #openstack-infra16:33
anteayaclarkb: does this *mean* fatal?16:33
anteayapcm_: yes I am looking16:33
pcm_anteaya: thanks!16:34
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Added groups.openstack.org to StoryBoard  https://review.openstack.org/10842816:34
anteayamugsie: do you need those permissions on the designateclient?16:35
anteayais your client going to follow the branch model?16:35
anteayaor are you going to tag and release as need be (this is what most other projects do)16:36
*** shashankhegde has quit IRC16:36
mugsieanteaya: huh - I miss read the file name.... I have no idea why we would need it for the client16:36
anteayamugsie: great16:37
*** packet has joined #openstack-infra16:37
mugsie(i saw those perms and assumed it was designate)16:37
anteayaI look forward to your new patch16:37
mugsiethat said Kiall may have a reason I havent thought of16:37
anteayamugsie: true, let me know when you find out16:38
*** markmcclain has quit IRC16:38
mugsiethat said anteaya - I just checked a few of the other clients (glance, heat, neutron and nova), and they all have them16:39
mugsieis there a reason that they need them? or is that just a copy and paste fail that got out of hand?16:39
anteayaright, cargo culting is something I am addressing16:39
anteayaI don't know16:39
anteayaI haven't gotten to cleaning that up yet16:39
*** chandankumar has quit IRC16:39
anteayajust got finished with oslo not long ago16:39
*** pcrews has joined #openstack-infra16:40
*** cody-somerville has quit IRC16:40
*** romcheg2 has joined #openstack-infra16:41
*** markmcclain has joined #openstack-infra16:42
clarkbanteaya no it may be missing for some projects on some jobs16:42
*** romcheg1 has quit IRC16:43
anteayaclarkb: kk, thanks16:43
anteayaclarkb: still trying to find the part that failed the build16:43
anteayaclarkb: how is oscon and beer16:44
anteayapcm_: I restarted with `recheck no bug`16:44
anteayapcm_: you need the whitespace between no and bug16:44
anteayapcm_: and thanks for asking16:44
anteaya:D16:44
*** mriedem has quit IRC16:45
*** david-lyle has quit IRC16:46
pcm_anteaya: Ah... so I had the syntax wrong. Thanks!16:46
anteayanp, you inclination to find the root issue is something I encourage16:46
pcm_anteaya: Does it make sense to do that? I didn't seem to find anything that matched.16:46
anteayathank you16:46
anteayapcm_: I can't find the reason the build failed either16:47
anteayapcm_: this is perplexing16:47
pcm_anteaya: OK. Wasn't sure if I was missing something. Thanks for the help. I'll see what the recheck does.16:47
*** rkukura has quit IRC16:48
anteayapcm_: let me know if it fails again16:49
anteayawe could have hit a derp or something bigger, I'm not sure16:49
pcm_anteaya: Will let you know if it fails.16:50
*** e0ne has joined #openstack-infra16:50
pcm_anteaya: derp?16:50
*** terryw has quit IRC16:51
Kiallanteaya: sorry, was AFK16:51
*** annegent_ has joined #openstack-infra16:51
anteayapcm_: http://www.urbandictionary.com/define.php?term=derp16:51
*** cinerama` has joined #openstack-infra16:52
anteayapcm_: a system derp is an unrepeatable undefined action16:52
*** david-lyle has joined #openstack-infra16:52
anteayaso it might break once, for reasons we never find out, and never again16:52
anteayaKiall: np16:52
Kiallanteaya: re L6-17 of https://review.openstack.org/#/c/107688/4/modules/openstack_project/files/gerrit/acls/openstack/python-designateclient.config - without those, we inherit the defaults from All Projects, which is no good for us, as we're incubated and the "Release Managers" group won't handle that part16:53
pcm_anteaya: Ah, never heard that one.16:53
anteayaKiall: ah okay, that makes sense16:53
Kiallanteaya: those were added after fungi told me to add them ;)16:53
*** chandankumar has joined #openstack-infra16:53
*** virmitio has joined #openstack-infra16:54
*** romcheg1 has joined #openstack-infra16:54
anteayaKiall: that is fine, I'm glad you are able to tell me about the reason16:54
anteayathank you16:54
anteayaand now mugsie knows too16:54
*** jgallard has quit IRC16:54
*** romcheg2 has quit IRC16:55
*** alexpilotti has joined #openstack-infra16:55
*** arnaud has joined #openstack-infra16:55
*** e0ne has quit IRC16:56
*** markwash has joined #openstack-infra16:56
*** arnaud has quit IRC16:57
*** Ryan_Lane has joined #openstack-infra16:58
*** luqas has joined #openstack-infra16:58
*** Evgeny has joined #openstack-infra16:59
*** ZZelle has joined #openstack-infra17:00
*** alexpilotti has quit IRC17:01
*** Guest57712 has quit IRC17:01
*** alexpilotti has joined #openstack-infra17:01
*** mkoderer has quit IRC17:02
fungiKiall: well, specifically after i suggested you should correct them (i never tell anyone to do anything)17:03
Kiall:D17:03
anteayafungi: how is the oscon?17:03
fungianteaya: osconerific17:04
anteayafungi: glad to hear it17:04
fungialso, still somewhat early and partially uncoffied17:04
anteayaah17:04
fungiuncoffeed?17:05
anteayacoffee before beer17:05
anteayauncertain17:05
anteayaI've never tried to make that a word17:05
fungii don't know why i bother to correct my own spelling on words i invent17:05
anteayaI like an i in there but it is reminisent of coffin17:05
anteayaso maybe sans i17:05
anteayafungi: it is fun17:05
* fungi will take a peek at Kiall's acl17:05
*** arnaud has joined #openstack-infra17:06
*** jaypipes has quit IRC17:06
anteayagreat, cause I am tired and still uncertain here17:06
Kiallfungi: don't spose you want to peek @ https://review.openstack.org/#/c/108200/ too ? ;')17:06
anteayafungi: why would there not be a designate-ptl group yet?17:06
pabelangerGreetings!17:06
anteayakrtaylor: going to take a walk around before the meeting, back in a while17:07
anteayapabelanger: greetings17:07
* anteaya afk17:07
fungianteaya: no clue... i'm not sure what's going on with anything yet, so just starting to check on things17:07
Kiallanteaya: jeepyb will auto-create the groups as it's applying the permissions, https://github.com/openstack-infra/jeepyb/blob/master/jeepyb/cmd/manage_projects.py#L212-22017:07
*** annegent_ has quit IRC17:07
pabelangerHaving an issue with nodepool slaves, jobs are getting completed but for some reason nodepool is not destroying the node.  I don't believe anything in my configuration has changed recently, any suggestions where I could start looking>17:07
*** nati_ueno has joined #openstack-infra17:08
*** moted has quit IRC17:08
*** cnesa has quit IRC17:09
openstackgerritJustin Shepherd proposed a change to openstack-infra/config: New Chef repo for Specs  https://review.openstack.org/10783317:09
*** cody-somerville has joined #openstack-infra17:09
*** cody-somerville has joined #openstack-infra17:09
pabelangerI think zuul is not properly sending out the event to gearman17:10
*** arnaud has quit IRC17:11
zaromgagne: ping17:11
mgagnezaro: pong17:11
*** harlowja_away is now known as harlowja17:12
zarohave time for quick review?17:12
mgagnezaro: sure17:12
*** shashankhegde has joined #openstack-infra17:12
zaromgagne: https://review.openstack.org/#/c/106119/ AND https://review.openstack.org/#/c/106121/17:12
*** jlibosva has quit IRC17:12
zaromgagne: want to make another python-jenkins release because last one was broken.17:12
*** ChuckC has joined #openstack-infra17:13
*** jaypipes has joined #openstack-infra17:13
*** mriedem has joined #openstack-infra17:14
*** mriedem has quit IRC17:15
*** james_li has quit IRC17:15
*** mriedem has joined #openstack-infra17:17
*** SumitNaiksatam has quit IRC17:18
yolandajeblair, mordred, do you have a chance to review nodepool-dib job? just finished this weekend, and I've been doing some testing with it, it's working fine17:18
jogosweston: ping re: checking if a 3rd party system is working or not17:19
*** flaviof_zzz is now known as flaviof17:19
*** jerryz has joined #openstack-infra17:19
swestonjogo: hello17:19
zaromgagne: thanks for the review :)17:20
mgagnezaro: np, let me know if there is anything else I should look at17:20
jogosweston: so I skimmed a bit of the backlog, what are you trying to accomplish?17:20
*** arnaud has joined #openstack-infra17:22
*** mriedem has quit IRC17:22
*** mriedem has joined #openstack-infra17:23
*** rkukura has joined #openstack-infra17:23
*** mmaglana has joined #openstack-infra17:23
*** zns has quit IRC17:23
clarkbpleia2: I am reviewing the d-g readme change now. comments on that section you called out in particular17:24
*** ihrachyshka has quit IRC17:25
pleia2clarkb: thank you17:25
fungipabelanger: shouldn't the gearman plugin on your jenkins master be the one identifying whether nodes are supposed to be in used or delete state?17:26
swestonjogo:  ok.  so I am trying to figure out how to determine programmatically if a build result is valid based on comparisons with other build systems.17:26
fungipabelanger: though you do need zuul to send the offline when complete parameter to jenkins for a job so that the plugin knows to do that...17:27
*** eharney has quit IRC17:27
fungipabelanger: you should be able to see whether it did by looking at the parameters for a job run in your jenkins webui17:27
jogosweston: we use status.openstack.org/elastic-recheck/ upstream for that17:27
clarkbpleia2: done17:28
jogosweston: but for 3rd party CI there are a few low hanging fruit issues to deal with first I think17:28
jogosweston: I.E. make sure the third party CI is actually running something useful17:28
*** eharney has joined #openstack-infra17:28
jogosweston: and make sure it votes on most things that it should17:28
swestonjogo:  ah.  ok.  please share!!17:29
*** arnaud has quit IRC17:29
pleia2clarkb: this is very helpful, thanks :)17:29
*** arnaud has joined #openstack-infra17:29
*** oanufriev has joined #openstack-infra17:29
swestonjogo: ok17:29
jogosweston: jhesketh had some graphs that plot if a system is voting or not17:30
fungijogo: sweston: one suggestion which seemed reasonable was to upload a canary patch to a project and set it wip with a "do not merge" commit message, but don't make any substantive changes to the source and then compare test results from the various ci systems17:30
clarkbdims: you around? looking at the d-g change to grab apache error logs17:30
clarkbdims: I am on board with that but the change itself doesn't seem to have grabbed an error log so I am not sure it is working17:30
clarkbdims: shouldn't apache touch an empty error.log at the very least?17:30
jogofungi: there are plenty of patches up that shouldn't change the outcome of any CI systems that we don't need extra patches to test that17:31
pleia2clarkb, fungi - while you're here, thoughts on adding my ssh key to the tranlate-dev server? we'll need it upgraded to pootle 2.6 when it finally lands (it's in RC now, should happen any day now) and I can help out with that17:31
openstackgerritpritesh proposed a change to openstack-dev/hacking: Add hacking check for editor configuration in source files  https://review.openstack.org/10196917:31
clarkbpleia2: I would be ok with it17:31
*** zns has joined #openstack-infra17:31
jogosweston fungi: typos, comments etc17:31
fungipleia2: seems like a perfectly reasonable request17:31
clarkbpleia2: I can ask morderd and jeblair when we have a second to talk about random things too17:31
pleia2clarkb: perfect, thanks again17:31
fungijogo: right, then the task would become to identify one or more of those17:31
fungijogo: and/or recheck it a few times for better sample size17:32
*** zns has quit IRC17:32
jogofungi: so for the low hanging fruit case of making sure the 3rd party system is doing something useful we don't even need that.17:32
jogofungi: but agreed17:32
*** zns has joined #openstack-infra17:32
*** mestery has joined #openstack-infra17:33
*** cnesa has joined #openstack-infra17:33
*** mestery has quit IRC17:33
jogofungi sweston: jhesketh and crew apporached this by graphing the +1/-1/no-vote rates for all systems17:33
fungijogo: determining whether it fails when it should succeed is fairly easy doing that, however determining how to make various ci systems fail would be harder17:33
jogoand that gave some nice rough approximations of how well things work17:33
clarkbfungi: so tox 1.7.2 is a thing17:34
*** mestery has joined #openstack-infra17:34
clarkbfungi: if I get a few minutes to test it with projects I may propose we switch this week17:34
fungijogo: i suppose upload a change with invalid syntax in a fairly central file that basically any job would need to import to be considered a reasonable test of anything at all?17:34
pabelangerfungi, I think the issue is related to the node not getting toggled into the USED state17:34
clarkbfungi: biggest concern being we are all not really working this week?17:34
*** arnaud has quit IRC17:34
jogofungi: yeah, although you can look at job run times too for this17:35
fungiclarkb: yep, i think it got released just before we headed to de, or maybe just after we arrived, and your fix ended up being included even though it wasn't a 1.8.x release number17:35
jogofungi: if jenkins takes x time, but third party takes 1/10th of x to do the same thing something is wrong17:35
swestonjogo: this is all in the elastic recheck project?17:35
openstackgerritKiall Mac Innes proposed a change to openstack-infra/config: Sync Designate ACLs  https://review.openstack.org/10768817:35
*** afazekas has joined #openstack-infra17:35
fungiclarkb: and yeah, i want to work this week, but for values of work which probably don't include staring at irc constantly in case something falls apart17:35
fungijogo: it still depends a lot on what that ci is testing. why should turbo-hipster, for example, take >10% as long as a devstack run to validate migrations?17:36
fungijogo: i guess "do the same thing" is what i wonder how we're identifying17:37
*** craigbr has quit IRC17:37
swestonjogo:  yes, but there might be exceptions to that case, i.e some systems may not be running all tests.17:37
*** zns has quit IRC17:37
*** SumitNaiksatam has joined #openstack-infra17:38
jogosweston fungi: example neutron patch https://review.openstack.org/#/c/106608/17:38
jogosweston: I think as a first pass, detecting when a 3rd party system stops voting17:38
jogois very helpful17:38
jogoor when it starts voting all -1s17:38
pabelangerGoing to sync to the latest nodepool and try again17:39
fungifor the trivial case where you assume each ci us running devstack+tempest and validating with some particular out-of-tree driver/backend or alternative platform, then your plan is probably viable17:39
jogosweston fungi: as we do all this stuff to look at jenkins results and detect if you hit a known bug or not. But for 3rd party we don't even have the same reliability as openstack infra CI17:39
*** thedodd has quit IRC17:40
fungijogo: sweston: anteaya: perhaps the third-party documentation for each individual ci should mention how to validate that it's operating within expected parameters (run-time, log sizes, something) since that will vary between systems depending on what they are designed to do?17:40
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/config: Add Elizabeth K. Joseph to users manifest  https://review.openstack.org/10845117:40
swestonfungi: agreed.  it's in the un-trivial cases where things get interesting17:40
jogofungi: interesting idea, I don't think we can do log sizes as those can change a lot. but approximate run time, and log names is a good idea17:41
fungie.g. how to identify if it let go of a dead-man switch and is now reporting nonsense (particularly the "no longer running anything substantive" case)17:42
krtaylorfungi, that is the approach that we (powerkvm)are taking17:42
*** zns has joined #openstack-infra17:42
*** arnaud has joined #openstack-infra17:42
jogosweston: we are bad at the trivial issues right now. so we should solve those first17:42
swestonjogo, fungi, anteaya: what about specifying which tests should be run as part of the build job?17:42
jogosweston: AFAIK those are documented already.17:42
*** dprince has joined #openstack-infra17:42
krtaylorsweston, that would be a good requirements discussion17:42
*** rkukura has quit IRC17:42
fungisweston: maybe. anything which can be used as a simple data point so that a spot-check will identify whether it's still doing what is intended17:43
jogosweston: for starters I think detecting when something stops voting is a great start17:43
swestonjogo: understood.17:43
fungijogo: good point. a missing-in-action audit17:43
*** johnthetubaguy is now known as zz_johnthetubagu17:43
jogofungi: yup17:43
krtaylorjogo, sweston, that would be hard for a system skipping tests that have already failed another CI system17:43
*** hogepodge has quit IRC17:44
*** daya_k has joined #openstack-infra17:44
jogokrtaylor: systems do that? If so that can be factored in pretty easily17:44
openstackgerritArmando Migliaccio proposed a change to openstack-infra/devstack-gate: Adds DVR related env variable to devstack-vm-gate.sh  https://review.openstack.org/10690117:44
krtaylorjogo, its an approach that we are considering to reduce resources17:44
*** gangil has joined #openstack-infra17:44
*** arnaud has quit IRC17:44
jogoahh anyway its easy enough to factor that in17:44
openstackgerritArmando Migliaccio proposed a change to openstack-infra/config: Add experimental job Neutron DVR testing on single node  https://review.openstack.org/10690217:45
gangilHi, Does anyone here know if jenkins gerrit-trigger plugin supports add multiple review board hooks? I have two different gerrit hosts which I need to keep track for patch submissions.17:45
fungijogo: krtaylor: right, we could always only count changes where openstack jenkins voted +1 and the third-party never voted after some timeout17:45
gangils/add/adding17:46
*** garyh has joined #openstack-infra17:46
jogofungi: yup17:46
jogokrtaylor: have you talked to jhesketh or jaypipes about this? I know they both have similar interests17:46
* jogo steps out to find food17:47
krtaylorjogo, when I can, it would have been great to have been at the mid-cycle17:47
fungigangil: you may not find a lot of answers about gerrit-trigger-plugin here, since openstack hasn't used it in its project infrastructure for years17:47
gangilfungi: so how do the jobs get triggered when we submit patches upstream?17:48
fungigangil: http://ci.openstack.org/zuul/17:48
openstackgerritKiall Mac Innes proposed a change to openstack-infra/config: Sync Designate ACLs  https://review.openstack.org/10768817:49
fungigangil: it was written initially as a replacement for gerrit-trigger-plugin since the latter didn't support things our project needed17:50
gangilfungi: thanks! I will take a look17:50
*** arnaud has joined #openstack-infra17:50
fungifrom a fundamental design level (such that just contributing patches to the plugin wouldn't have been sane)17:50
*** e0ne has joined #openstack-infra17:51
swestonjogo: krtaylor, fungi:  this is a good discussion!! What is your recommendation for the next steps?17:51
fungigangil: http://ci.openstack.org/zuul.html documents some details on how we run it four our use case, though other people have also written plenty of blog posts on it too17:51
fungigangil: and http://docs.openstack.org/infra/publications/zuul/ is a great slide presentation on how it fits together with our other systems and what it does17:52
fungisweston: next steps would be to data-mine gerrit comment history via its api and look for patterns17:53
gangilfungi: that looks helpful :)17:53
*** arnaud has quit IRC17:53
openstackgerritElizabeth K. Joseph proposed a change to openstack-infra/config: Add Elizabeth K. Joseph to users manifest  https://review.openstack.org/10845117:54
*** annegent_ has joined #openstack-infra17:54
swestonfungi: ok.  where should this code be created?17:54
*** arnaud has joined #openstack-infra17:54
krtaylorsweston, let's discuss in next meeting (5 mins), bring it up in the open discussion?17:55
openstackgerritA change was merged to openstack-dev/pbr: Stop filtering out argparse  https://review.openstack.org/10838717:55
fungisweston: i don't know that i would start by writing a project. probably doing some ad-hoc analysis on various query results would be the intermediate step before making a new project out of something like that (or deciding what existing project any related code would be a fit for)17:55
*** rainya has quit IRC17:56
fungisweston: if the operators of the third-party ci systems collaborated on analyzing statistics around this (since the data is accessible to everyone anyway), i think some self-policing there would be pretty awesome17:56
krtayloryes, exactly17:56
swestonfungi: ok17:56
*** rainya has joined #openstack-infra17:57
* fungi will start trying to remember to refer to them as the "third-party ci community"17:57
*** rcarrillocruz has joined #openstack-infra17:57
*** e0ne has quit IRC17:58
fungibecause it's more helpful to think of them in that light rather than as a disconnected bunch of operators17:58
*** thedodd has joined #openstack-infra17:58
bmwiedemannfungi: sometimes we are also a connected lot ;-)17:58
fungibmwiedemann: exactly!17:59
*** rcarrill` has quit IRC17:59
swestonfungi: :-)17:59
fungianyway, happy meeting18:00
*** rainya has quit IRC18:00
* fungi tries to oscon a little18:00
swestonfungi: thank you, so much, for your thoughts on this.18:00
*** arnaud has quit IRC18:00
*** annegent_ has quit IRC18:00
*** marcoemorais has quit IRC18:01
*** marcoemorais has joined #openstack-infra18:01
*** marcoemorais has quit IRC18:02
openstackgerritA change was merged to openstack-dev/pbr: Remove all 2.7 filtering  https://review.openstack.org/10839618:02
swestonkrtaylor, jogo: thank you, as well.18:02
*** marcoemorais has joined #openstack-infra18:02
pabelangerfungi, Hmm, I think my zmq on nodepool is not connected. Any easy way to check from nodepool if things are working?18:02
*** james_li has joined #openstack-infra18:03
*** otherwiseguy has joined #openstack-infra18:04
*** afazekas has quit IRC18:04
devanandaare py26 jobs failing everyone right now?18:04
*** annegent_ has joined #openstack-infra18:05
*** rainya has joined #openstack-infra18:05
devanandagetting "No package 'libffi' found" in a lot of (if not all) our py26 jobs today18:05
clarkbdevananda: woo I think mordred broke it18:08
clarkbor more specifically yum18:08
devanandaclarkb: i thought he fixed that, like, yesterday?18:08
devanandaor did the fix break us18:08
*** signed8bit is now known as signed8bit_ZZZzz18:08
clarkbdevananda: no idea18:08
*** rainya has quit IRC18:09
mordredthat should have been fixed18:09
*** emagana_ has joined #openstack-infra18:10
pabelangerokay, so something with libzmq was funky.  I purged it from the system and restarted, looks like nodepool is getting events again18:10
pabelangerre-testing now18:10
devanandaclarkb: looks like it's affecting everything today18:11
mordredOSSUM18:11
devanandamordred: http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiTm8gcGFja2FnZSAnbGliZmZpJyBmb3VuZFwiIEFORCB0YWdzOmNvbnNvbGUiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6ImN1c3RvbSIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJmcm9tIjoiMjAxNC0wNy0yMVQwMDowMDowMCswMDowMCIsInRvIjoiMjAxNC0wNy0yMVQxODowOTo0NCswMDowMCIsInVzZXJfaW50ZXJ2YWwiOiIwIn0sInN0YW1wIjoxNDA1OTY2MjUwMTQ4LCJtb2RlIjoic2NvcmUiLCJhbmFseXplX2ZpZWxkIjoiYnVpbGRfbmFtZSJ918:11
*** emagana has quit IRC18:12
clarkbwe really need to encourage linking a query string rather than a url :)18:12
clarkbdevananda: I would not be surprised18:13
clarkbdevananda: my understanding of the issue last week was making me think we should stop using broken operating systems18:13
devanandaclarkb: yea. I keep forgetting how long those URLs are18:13
devanandamessage:"No package 'libffi' found" AND tags:console AND build_name:"gate-nova-python26"18:13
mordredthanks18:13
*** amcrn has joined #openstack-infra18:13
*** hogepodge has joined #openstack-infra18:14
*** ildikov has joined #openstack-infra18:15
*** rcarrill` has joined #openstack-infra18:17
*** arnaud has joined #openstack-infra18:19
*** tsg has joined #openstack-infra18:19
*** timrc-afk is now known as timrc18:20
*** dkehn_ has joined #openstack-infra18:20
*** rcarrillocruz has quit IRC18:20
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Added documentation for StoryBoard  https://review.openstack.org/10846018:22
krotscheckpleia2: ^^18:22
*** dkehnx has quit IRC18:23
mordreddevananda: ok. so ...18:23
pleia2krotscheck: yay18:23
krotscheckAbout time, too.18:23
clarkbsdague: ok I kicked logstash18:23
clarkbsdague: looks like elasticsearch and logstash can both fall over in different and exciting ways18:24
pleia2krotscheck: pinkie pie :D18:24
clarkbsdague: maybe we should rewrite the whole thing in go18:24
krotscheckpleia2: I am innocent. I was attacked by a pony that held me at gunpoint.18:24
devanandamordred: yes?18:24
pleia2hehe18:24
pleia2krotscheck: I'm no one to judge, I have a whole herd of ponies on my desk18:24
krotscheckpleia2: I was thinking of introducing the pinkie-pie launcher as the popup image for a catastrophic error.18:25
pleia2haha18:25
*** arnaud has quit IRC18:26
devanandaponies with guns? what is the world coming to?18:27
*** rcarrillocruz has joined #openstack-infra18:27
mordreddevananda: its the yum problem I was fighting all last week18:27
*** harlowja has quit IRC18:27
pleia2devananda: I'm sure he meant sparkley magic18:28
*** thedodd has quit IRC18:28
*** ArxCruz has quit IRC18:28
devanandamordred: great. what should we do to land things?18:28
*** rcarrill` has quit IRC18:29
*** signed8bit_ZZZzz is now known as signed8bit18:29
mordreddevananda: working on it18:29
*** andreykurilin has joined #openstack-infra18:29
*** hashar has joined #openstack-infra18:30
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Fix upstream_translation_update_manuals  https://review.openstack.org/10846418:32
dhellmannmordred: https://review.openstack.org/#/c/108030/ merged but the job looks the same, is this a case of needing to wait for the build server image(s) to be updated?18:33
*** marcoemorais has quit IRC18:33
*** marcoemorais has joined #openstack-infra18:33
*** ArxCruz has joined #openstack-infra18:33
*** harlowja has joined #openstack-infra18:35
*** arnaud has joined #openstack-infra18:36
*** arnaud has quit IRC18:37
*** markmc has joined #openstack-infra18:38
*** jgrimm has quit IRC18:38
*** arnaud has joined #openstack-infra18:39
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Hack an install of libffi-devel because yum sucks  https://review.openstack.org/10846618:42
mordredclarkb: ^^18:42
*** arnaud has quit IRC18:42
sdagueclarkb: nice :)18:42
sdagueor rust, that seems to be the new hipsterness18:42
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Hack an install of libffi-devel because yum sucks  https://review.openstack.org/10846618:43
*** eharney has quit IRC18:43
morganfainbergmordred, hah @ the 'cause yum sucks' bit18:46
*** e0ne has joined #openstack-infra18:47
morganfainbergsdague, are you ok with a delay until late week for the update to exclude fedora from the apache sleep restart stuff? I want to spend some time confirming fedora remains unaffected - but if it's a bit touchy i can add that logic sooner18:47
mordreddevananda: ^^ the patch from me above should fix you18:47
sdaguemorganfainberg: sure, honestly, I'm not under a rush on that one. I mostly wanted to land the gate fix18:47
morganfainbergsdague, i am suspicious that it'll also be broken - because init scripts suck at it.18:47
*** marcoemorais has quit IRC18:48
morganfainbergsdague, ++ yeah18:48
sdagueand ianw really didn't want fedora exclude18:48
*** bnemec has quit IRC18:48
sdagueI think it's cool for ianw to do the follow on patch18:48
morganfainbergsdague, i don't want gate broken again :)18:48
pabelangerany idea why zuul would look for: 2014-07-21 18:47:08,438 DEBUG zuul.Gearman: Function set_description:jenkins-01-prod.kickstand-project.org is not registered ?  looks like a malformed gearman event18:48
*** marcoemorais has joined #openstack-infra18:48
morganfainbergif ianw wants to i wont stop him, but if i'm doing it, i'll spend some more time on it18:48
devanandasdague: poke re: my email about deprecation of baremetal. just want to make sure it's on your radar :)18:48
*** bnemec has joined #openstack-infra18:49
sdaguedevananda: honestly, my radar is pretty overwhelmed at the moment. If there is a specific thing you need from me, you should ask18:50
devanandasdague: we need to have a discussion about upgrade testing of nova-bm -> ironic and what your expectations are18:51
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Project Group member DELETE and PUT method have better results  https://review.openstack.org/10650718:51
*** mestery has quit IRC18:51
devanandasdague: because grenade is, IMNSHO, totally unrealistic, as it will require taht someone go implement a bunch of things specifically to enable tempest and devstack-gate support for nova-bm *just so we can delete it*18:51
devanandasdague: much longer explanation is in my email18:52
*** chandankumar has quit IRC18:52
*** berendt has joined #openstack-infra18:53
*** berendt has quit IRC18:53
*** chandankumar has joined #openstack-infra18:53
*** craigbr has joined #openstack-infra18:54
*** _nadya_ has joined #openstack-infra18:55
*** rkukura has joined #openstack-infra18:56
*** arnaud has joined #openstack-infra18:56
*** mestery_ has joined #openstack-infra18:56
*** mestery_ has quit IRC18:57
*** mestery has joined #openstack-infra18:57
*** romcheg1 has left #openstack-infra18:57
*** arnaud has quit IRC18:58
*** mrda-away is now known as mrda18:58
rcarrillocruzfolks, is there a way for the gerrit manifest to use http, and not https? i'd like to avoid creating ssl certificates for a local installation...18:59
*** denis_makogon has quit IRC18:59
clarkbrcarrillocruz: you can use snake oil certs18:59
clarkbrcarrillocruz: its super easy and is what review-dev does18:59
*** eharney has joined #openstack-infra19:01
anteayakrotscheck: good meeting19:01
anteayakrtaylor: ^^19:01
anteayasorry krotscheck tab complete fail19:01
krotscheckwomp womp19:02
*** thedodd has joined #openstack-infra19:02
*** signed8bit has quit IRC19:02
sdaguedevananda: well I remain a bit frustrated that upgrade got left to the last minute, but I actually agree that given what ironic & bm are they aren't really testable usefully in our infrastructure19:03
*** smcginnis has joined #openstack-infra19:03
*** signed8bit has joined #openstack-infra19:03
rcarrillocruzah, let me check it out. thx clarkb :-)19:03
smcginnisanteaya: Have a second for a 3rd party CI account question?19:03
anteayasmcginnis: ask away19:03
smcginnisanteaya: I think it would be good to update the instructions for requesting one to start with.19:04
anteayasmcginnis: have you seen the current patches?19:04
smcginnisanteaya: Didn't realize that request was going to a mailing list that I should be subscribed to.19:04
anteayasmcginnis: https://review.openstack.org/#/q/status:open+project:openstack-infra/config+branch:master+topic:third-party,n,z19:04
smcginnisWas waiting for an email response.19:04
anteayasmcginnis: please review the patches19:05
anteayaif one of the patches in review doesn't cover your use case, do offer a patch19:05
smcginnisIt would be really useful for new people to reference that here: http://ci.openstack.org/third_party.html#requesting-a-service-account19:06
anteayagreat, there is a patch up for that section19:06
smcginnisJust reading that as the instructions for how to get started, there's no indication that there is a mailing list to subscribe to and patches to revie.19:06
smcginnis*review19:06
openstackgerritDolph Mathews proposed a change to openstack-infra/elastic-recheck: add query for cinder encryption-type-list failure  https://review.openstack.org/10847219:07
smcginnisanteaya: Just suggestions to make it easier for people new to the project that want to get involved.19:07
openstackgerritA change was merged to openstack-infra/config: Hack an install of libffi-devel because yum sucks  https://review.openstack.org/10846619:07
*** cody-somerville has quit IRC19:07
smcginnisanteaya: Anyway, my main question - since I wasn't subscribed I didn't get your response. What's the best way to reply to it now that I know about it. Online view doesn't appear to allow replying.19:08
anteayasmcginnis: yes, I am hearing you and I think you have good ideas, please offer a review19:08
smcginnisanteaya: Will do!19:08
anteayasmcginnis: which post are we discussing?19:08
smcginnisanteaya: Can I just answer your follow on questions from my request here?19:09
anteayasmcginnis: which post are we discussing?19:09
smcginnisThat might help. ;)19:09
smcginnishttp://lists.openstack.org/pipermail/openstack-infra/2014-July/001586.html19:09
smcginnisYou had asked for more details on the service account request.19:09
anteayasmcginnis: are you now subscribed to the infra mailing list?19:10
devanandasdague: I share your frustration, except that I proposed the spec to Nova (based on my recollection our conversation) ~6weeks ago, and it didn't get any feedback, even though our team went and implemented the upgrade path and proposed those tools to Nova (which also didn't get reviewed)19:10
smcginnisanteaya: Just subscribed now.19:10
anteayasmcginnis: did you confirm your subscription with your email yet?19:11
devanandasdague: i'm glad to hear you agree, and i'm curious how you think we can move forward on this19:11
anteayasmcginnis: you will get an email sent to you and you need to confirm19:11
*** _nadya_ has quit IRC19:11
smcginnisanteaya: Just confirmed.19:11
*** otherwiseguy has quit IRC19:11
anteayasmcginnis: I will reply again and you should get the email19:11
smcginnisanteaya: Perfect, thank for your help!19:12
*** otherwiseguy has joined #openstack-infra19:12
jogosweston: I look forward to seeing what you find19:12
anteayasmcginnis: emailed19:12
anteayasmcginnis: np19:12
*** afazekas has joined #openstack-infra19:12
anteayasmcginnis: thanks for letting me know your situation19:12
*** nati_uen_ has joined #openstack-infra19:12
anteayasmcginnis: let me know if you fail to get that within 10 minutes19:13
*** nati_ueno has quit IRC19:13
smcginnisanteaya: sounds good19:13
swestonjogo: yes, should be a fascinating study.  I will be sure to provide updates as frequently as possible.19:13
anteayajogo: I didn't read all the backscroll but if you are willing to help sweston et al with the third-party stats, that is awesome19:13
anteayathank you both19:13
* anteaya does a happy dance19:14
*** _nadya_ has joined #openstack-infra19:14
swestonanteaya: :-D19:14
anteaya:D19:14
jogoanteaya sweston: I am happy to help a little, mainly in the form of feedback etc.19:15
anteayajogo: feedback is good19:15
anteayajogo: thank you19:15
*** timrc is now known as timrc-afk19:15
jogoanteaya sweston: I think a really rough version would be when was the last time CI system X voted?19:15
anteayajogo: that would be an easy metric to gather19:16
anteayaand might net something useful19:16
*** enikanorov_ has joined #openstack-infra19:16
swestonjogo, anteaya: yes, the plan is to start off simple19:16
swestonjogo, anteaya: after something rudimentary is working, then we can start iterations.19:17
*** dustins has quit IRC19:17
anteayasounds good19:17
harlowjaqq, whats the progress of having ubuntu14 on the testing nodes?19:17
anteayathen tracking when the last test run happened would be a good place to start19:18
anteayavery non-contriversial19:18
anteayaI hope19:18
*** mwagner_lap has quit IRC19:18
anteayaharlowja: trusty is running our tempest tests19:18
anteayaharlowja: did you have a specific job you were asking about?19:18
mmaglanahi. i have a question about gerrit. is there a way to integrate it with travis-ci?19:19
swestonanteaya: yes, I think a line in the sand would be easy to draw here.  it shouldn't take x amount of time to complete tests19:19
harlowjaanteaya not really specific, i guess, just there is a newer version of zookeeper that i know comes on trusty, and was wondering if there is anything special that needs to be done to use trusty19:19
pabelangerYa, for what ever reason, I am not getting the build complete events from zuul into nodepool19:19
anteayammaglana: what is the use case for using travis-ci?19:19
pabelangerI see: Done adding complete event for build: <Build f5cb32b7b4c7408d95b6575ce0d30aef of gate-fastdraw-coverage> in zuul, but nothing in nodepool.19:20
fungimmaglana: you probably want to ask in #gerrit. google gerrit is not written by the openstack community (though we do have some people who work in both communities)19:20
pabelangerso, I need to enable more logging in gearman to see why that is19:20
anteayammaglana: from what I understand travis-ci tests public changes, if you are testing public changes would you consider adding them to the gate?19:20
anteayaharlowja: right, well we are using trusty19:20
*** afazekas has quit IRC19:21
harlowjaanteaya cool, so thats good news, anteaya for all python2.7 jobs (3.x also?)19:21
anteayaharlowja: and it's availablity for a given project's tests is based upon the config file19:21
pabelangeror, actually zmq19:21
fungimmaglana: anteaya: i guess my assumption was the question was about running your own gerrit, not about the review.openstack.org server19:21
harlowjaanteaya hmmmm whats the specific config that needs to be applied?19:21
anteayaharlowja: well I know we can for 2.7 and I think we are, we can't for 3.x because trusty comes with 3.4 and we use 3.319:21
mmaglanaanteaya: hi. i wanted to use the existing build process for aviator since it uses multiple versions of ruby. also, down the line, i'm going to have to create a build matrix which includes V2 and V3 versions of keystone for auth.19:21
mmaglanahttps://travis-ci.org/aviator/aviator19:22
* jogo looks for a gerrit API to get user history19:22
*** luqas has quit IRC19:22
jogozaro: ^19:22
*** lukego has quit IRC19:22
anteayammaglana: so is this your own gerrit? or openstack's?19:22
* anteaya looks up the config for harlowja19:23
mmaglanaanteaya: fungi: openstack's19:23
harlowjaanteaya thx much19:23
*** _nadya_ has quit IRC19:23
*** tsg has quit IRC19:23
fungiharlowja: we (soon) plan to start migrating projects from running jobs for 3.3 to 3.419:24
* fungi is lagging from broken oscon wifi19:24
harlowjafungi nice nice19:25
anteayaharlowja: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/projects.yaml19:25
*** lukego has joined #openstack-infra19:25
fungimmaglana: yeah, we've taken a pretty hard line that we're not integrating our infra with other job runners outside our control19:25
anteayabare-trusty is the node name19:25
harlowjaah, 'bare-precise || bare-trusty'19:26
harlowjacool19:26
anteayaharlowja: that's the one19:26
mmaglanafungi: i see.19:26
harlowjawhats this || stuff ;)19:26
harlowjathats not very pythonic19:26
harlowjalol19:26
fungimmaglana: though you're free to request a third-party ci service account and put together something which listens to our gerrit event stream and triggers things to run in travis19:26
anteayaharlowja: so if something doesn't have that line and should run on trusty, we can patch the file19:26
*** achanda has joined #openstack-infra19:26
harlowjacool, anteaya will bump up taskflow to do the special bare-precise || bare-trusty thing19:27
fungiharlowja: i believe the || is a jenkinsism for multiple labels19:27
* fungi goes back to being offline19:27
anteayaharlowja: ping me on that patch and I will review19:27
harlowjathx19:27
mmaglanafungi: thanks. i look into that.19:28
harlowjaanteaya seems like taskflow already has ''bare-precise || bare-trusty'' woot, guess someone applied trusty to most of them19:29
*** ArxCruz has quit IRC19:30
*** hdd has quit IRC19:30
anteayaharlowja: looks like you are good to go19:33
harlowja:)19:33
*** Guest57712 has joined #openstack-infra19:34
*** lukego has quit IRC19:35
*** ildikov_ has joined #openstack-infra19:35
daya_ksweston: ready whenever you are. i have posted the files at http://paste.openstack.org/show/87382/ thanks!19:35
*** ArxCruz has joined #openstack-infra19:37
*** ildikov has quit IRC19:38
*** achanda has quit IRC19:38
*** Guest57712 has quit IRC19:38
*** Guest57712 has joined #openstack-infra19:39
swestondaya_k: yup.  Will get back to you in a few hours19:39
daya_ksweston: ok, might be offline, so pls email19:39
swestondaya_k: will do19:39
*** smcginnis has left #openstack-infra19:39
daya_kthanks19:39
*** eharney has quit IRC19:40
*** msabramo has quit IRC19:42
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add query for bug 1331453  https://review.openstack.org/10847919:42
uvirtbotLaunchpad bug 1331453 in ceilometer "Alarm coordinator tests sporadically failed" [Critical,In progress] https://launchpad.net/bugs/133145319:42
*** maxbit has joined #openstack-infra19:42
dhellmannwhat's the nodepool image build schedule? there's a daily job, right? or is it more often?19:43
*** lukego has joined #openstack-infra19:44
*** dustins has joined #openstack-infra19:44
*** rkukura has quit IRC19:45
anteayadhellmann: daily job19:45
anteayamorning sometime eu time19:45
anteaya6 utc?19:45
anteayaclarkb or fungi would know for sure, I'm guessing19:45
anteayadhellmann: it can be manually kicked when needed19:46
anteayadhellmann: do you have a need for a new image build?19:46
*** ArxCruz has quit IRC19:47
*** rcarrill` has joined #openstack-infra19:47
dhellmannanteaya: yeah, trying to debug a doc build failure in stable jobs with this change to the build script: https://review.openstack.org/#/c/108030/19:47
pabelangerclarkb, how can I determine if jenkins is sending out zeromq events for jobs?  I have the setting enabled in the global settings, but unsure if they are actually being sent19:48
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add translation jobs for oslo.utils  https://review.openstack.org/10848219:48
anteayadhellmann: ah stable jobs might be different anyway19:49
anteayadhellmann: I don't know what the image build schedule is for stable jobs19:50
*** rcarrillocruz has quit IRC19:50
dhellmannanteaya: ok, I didn't think the doc build server was any different, but I could be wrong19:51
anteayaoh for the doc build server19:51
anteayaI mis-read, sorry19:51
anteayaI'm assuming the same schedule as others19:52
anteayaif I'm wrong please someone let me know19:52
*** lukego has quit IRC19:53
dhellmannanteaya: no worries; I'll give it a while and try rechecking19:53
anteayakk19:53
*** ZZelle_ has quit IRC19:55
*** ZZelle_ has joined #openstack-infra19:56
*** chandankumar has quit IRC19:56
*** ArxCruz has joined #openstack-infra19:58
*** _david_ has joined #openstack-infra19:59
*** achanda has joined #openstack-infra20:02
_david_zaro, What do you mean by "[...] to allow groups to manage accounts. Maybe something similar to 'Create Account', except it would be 'Modify  Account.", in https://code.google.com/p/gerrit/issues/detail?id=2786 ?20:02
*** cody-somerville has joined #openstack-infra20:02
anteayahi _david_ I might be able to help here20:03
anteaya_david_: we have a large and growing gerrit group for third party ci20:03
anteayaI tend to be a point person for that group20:03
_david_anteaya, OKay ;-)20:04
anteayaI have no gerrit permissions other than registered user20:04
anteayaright now I can create accounts when I am granted that permission20:04
_david_which permission?20:04
anteayabut I also need to be able to add keys, edit email addresses and change names on the third party ci accounts20:05
anteayathe permission to create accounts for thrid party ci gerrit group20:05
clarkbpabelanger: you can connect a zmq sub socket to the port20:05
clarkbpabelanger: and just dump the data, it is all text20:05
corvus_david_: actually, i think that bug report is not accurate...20:05
anteayathat permissions exists in the code, I don't have it attached my name yet, is what I am saying20:05
*** ildikov has joined #openstack-infra20:06
*** dtantsur is now known as dtantsur|afk20:06
corvus_david_: what we actually want is just a "modify account" permission.20:06
corvus_david_: like "create account"20:06
corvusanteaya: we don't need it limited to a group20:06
anteayacorvus: okay20:06
*** chris has joined #openstack-infra20:07
*** chris is now known as hdd20:07
_david_corvus, Actually you are talking about a new feature: "Allow to create and modify non-interactive accounts"20:07
*** changbl has quit IRC20:07
*** virmitio has quit IRC20:07
*** achanda has quit IRC20:07
_david_corvus, As i pointed out in the mail thread and bug report: it is already there and is name is serviceuser plugin20:08
_david_And the ACL is called "Create Service User" and is provided by this plugin20:08
corvus_david_: https://review.openstack.org/Documentation/cmd-create-account.html20:08
*** grantbow has quit IRC20:08
corvus_david_: that command says "20:09
corvusCaller must be a member of the privileged Administrators group, or have been granted the Create Account global capability.20:09
*** grantbow has joined #openstack-infra20:09
corvus_david_: https://review.openstack.org/Documentation/cmd-set-account.html20:09
*** ildikov_ has quit IRC20:09
corvus_david_: but that one says "20:09
corvusCaller must be a member of the privileged Administrators group.20:09
corvus_david_: i think we just need a similar capability for the 'set account' command20:09
*** ArxCruz has quit IRC20:10
*** ildikov has quit IRC20:10
pabelangerclarkb, thanks20:11
openstackgerritStephanie Miller proposed a change to openstack-infra/gitdm: Add stephane to HP.  https://review.openstack.org/10848620:12
_david_corvus, You mean it would be sufficient for you now on 2.8 release and you would stick to SSH command? And we could switch to serviceuser plugin once you've updated to 2.9?20:12
*** timrc-afk is now known as timrc20:12
*** otherwiseguy has quit IRC20:12
corvus_david_: what does the serviceuser plugin do?20:12
*** cinerama has joined #openstack-infra20:12
corvus_david_: is it replacing the create/set account commands?20:13
*** tsg has joined #openstack-infra20:13
funzoIs anyone with +2 for the config repo available to review https://review.openstack.org/#/c/107794/20:13
_david_corvus, it allows an arbitrary group that was granted Create Serviceuser Capability, that is provided by this plugin create and modify non-interactive accounts and all this with really really nice GWT UI (full screen, 100% intergrated in Gerit core UI)20:14
corvus_david_: that sounds like it would work for this use case.  does it have a command line api too?20:15
_david_corvus, the fundamental difference between serviceuser plugin and set command is: the former is operating only on non-interactive users and the latter is operating on all users20:15
*** signed8bit is now known as signed8bit_ZZZzz20:16
corvus_david_: yeah.  i still think it makes sense to have the set-users command also have a capability -- it would be nice to have people be able to help users fix their accounts without giving them full admin access.20:16
_david_corvus, the change to add it is trivial20:17
mordredfunzo: -1'd - you deleted too many things ... comments inline20:17
*** signed8bit_ZZZzz is now known as signed8bit20:17
*** ArxCruz has joined #openstack-infra20:17
corvus_david_: yeah, i figured it would be20:17
mordredfunzo: but exciting!20:17
shardyHi all, can anyone help - re approving and reverify don't seem to trigger zuul to pick up this patch:20:18
shardyhttps://review.openstack.org/#/c/107456/20:18
funzomordred: i'll take a look, thx20:18
funzomordred: ok, no prob. will add those settings back.20:19
*** e0ne has quit IRC20:19
anteayashardy: it is in the check queue now20:19
_david_corvus, i wonder if we should create a plugin, that would provide an alternative capability and would fork set-account command, protect it with this new plugin-owned capability and delegate to the original REST endpoint for now? Until the change 1/ is accepted and 2/ it's released?20:19
shardyanteaya: great, thanks! :)20:20
_david_Another approach would be just to backport the change to stable-2.8 branch.20:20
*** virmitio has joined #openstack-infra20:20
anteayashardy: np, the gate jobs never reported back, odd20:20
anteayashardy: but the lack of the +1 from the check jobs (which gets removed when gate jobs start) prevented it from getting picked up by +A or reverify20:21
anteayashardy: so I'm sending it back through check to start the process20:21
*** signed8bit has quit IRC20:21
mordredfunzo: lemme know when you've got it and I'll relook20:21
*** rcarrill` has quit IRC20:21
*** signed8bit has joined #openstack-infra20:22
funzomordred: will do, making the changes now20:22
shardyanteaya: Sounds good, thanks for the help20:22
anteayashardy: np, may it merge20:22
anteayaokay I am going offline20:23
*** rcarrillocruz has joined #openstack-infra20:23
anteayaand will probably be offline for most/all of tomorrow20:23
*** e0ne has joined #openstack-infra20:23
anteayacontinued happy oscon for those osconing20:23
funzomordred: do you know the reason the cp command is there for ./safe-devstack-vm-gate-wrap.sh ?20:23
clarkbfunzo: it has to do with the reexec stuff iirc. you want it20:24
_david_corvus, Working on "Modify User Account" global capability now, will upload it in a few minutes ...20:24
ZZelleHi, one question about zuul20:24
corvus_david_: neato!  thanks!  <-- zaro20:24
funzoclarkb: ok, thx20:24
clarkbZZelle: go for it20:25
ZZelleiiuc, before running tests, zuul merges tested change with associated branch?20:25
*** unicell has quit IRC20:25
clarkbZZelle: yup20:25
clarkband that resulting merge is the ref that is actually tested20:26
ZZellewhich give you a reference like refs/zuul/master/Z2c1bdf452e2b4824955f7e4f131dacb420:26
clarkbyup20:26
ZZelleclarkb, is it pushed somewhere (the typical usecase is 3th party CI)20:26
ZZelle?20:26
openstackgerritimain proposed a change to openstack-infra/config: Move gate configuration to nova-docker.  https://review.openstack.org/10779420:27
clarkbZZelle: no, its hosted by the merger and you can fetch it from there20:27
clarkbZZelle: in our case nodes like zm01.openstack.org20:27
ZZelleclarkb, it seems must external CIs test the change not the change merges with associated branch20:27
*** otherwiseguy has joined #openstack-infra20:27
*** nati_uen_ has quit IRC20:28
ZZelleclarkb, arff20:28
clarkbZZelle: I think some people are doing it thatway20:28
clarkbthere was a thread about it on the ml20:28
funzomordred: ok, that review was updated20:28
*** nati_ueno has joined #openstack-infra20:28
*** amitpp has joined #openstack-infra20:29
fungidhellmann: if nobody's answered yet, nodepool kicks image updates off at 1400 utc daily, and they generally all complete by 153020:29
*** amitpp has quit IRC20:29
*** salv-orlando has joined #openstack-infra20:30
ZZelleclarkb, i will ask kevinbenton which has the same need20:31
*** ociuhandu has quit IRC20:32
*** arnaud has joined #openstack-infra20:33
*** terryw has joined #openstack-infra20:34
sdagueclarkb: https://review.openstack.org/107719 finally managed to merge! :)20:34
sdaguenow you can have less rage quitting :)20:34
*** rlandy has quit IRC20:34
clarkbhurray20:35
clarkbI don't have to give up on computers20:35
fungithere are always new reasons for teh ragequits20:35
*** msabramo has joined #openstack-infra20:35
*** msabramo1 has joined #openstack-infra20:36
*** msabramo has quit IRC20:36
*** otherwiseguy has quit IRC20:36
*** maxbit has quit IRC20:37
*** e0ne has quit IRC20:37
*** terryw has quit IRC20:38
*** maxbit has joined #openstack-infra20:39
*** e0ne has joined #openstack-infra20:42
*** zns_ has joined #openstack-infra20:45
*** alexpilotti has quit IRC20:45
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Added documentation for StoryBoard  https://review.openstack.org/10846020:46
*** jgrimm has joined #openstack-infra20:46
*** zns has quit IRC20:48
*** daya_k has quit IRC20:49
*** otherwiseguy has joined #openstack-infra20:49
kevinbentonZZelle: hey20:51
*** obondarev has joined #openstack-infra20:51
ZZellekevinbenton, hi20:51
ZZellekevinbenton, did you choose a strategy to test (with your CI) changes merged with their associated branch?20:52
*** maxbit has quit IRC20:53
kevinbentonZZelle: no, i had just sent another question to the email list today that looks basically the same as what you just said above20:53
ZZellekevinbenton, ok, if you find a valuable strategy, i will be interested and kyle also20:54
*** e0ne has quit IRC20:57
dhellmannfungi: ok, so once daily? it looks like I'll have to wait until tomorrow to retry that patch20:57
dhellmannfungi: I remembered the 1530, but wasn't sure if it was from "the next time will be" or if it was "every day at"20:57
kevinbentonZZelle: this is the thread. http://lists.openstack.org/pipermail/openstack-dev/2014-July/040795.html20:58
*** amotoki has joined #openstack-infra21:00
*** e0ne has joined #openstack-infra21:01
*** changbl has joined #openstack-infra21:01
*** zns_ has quit IRC21:01
ZZellekevinbenton, i asked clar_kb, it seems refs/zuul/... are internal references21:02
clarkbZZelle: they aren't internal21:02
clarkbthey are externally exposed and tests pull from them21:03
*** zns has joined #openstack-infra21:03
ZZelleclarkb, i mean they are published through APIs?21:03
clarkbZZelle: via git21:03
ZZellenot21:03
*** otherwiseguy has quit IRC21:03
*** arnaud__ has joined #openstack-infra21:04
clarkbif you run a zuul every job is told what its ref is21:04
*** otherwiseguy has joined #openstack-infra21:04
clarkbif you don't run a zuul you can do the git merge in your tests21:04
*** arnaud has quit IRC21:06
*** arnaud has joined #openstack-infra21:06
ZZelleclarkb, ok21:07
*** otherwiseguy has quit IRC21:07
*** otherwiseguy has joined #openstack-infra21:08
*** rcarrill` has joined #openstack-infra21:08
*** Sukhdev has joined #openstack-infra21:08
*** chuckC_ has joined #openstack-infra21:08
*** rkukura has joined #openstack-infra21:08
*** jdahlin_ has joined #openstack-infra21:08
*** alexpilotti has joined #openstack-infra21:09
*** rcarrillocruz has quit IRC21:10
*** e0ne has quit IRC21:10
*** zz_dimtruck is now known as dimtruck21:11
kevinbentonclarkb: where can we find that correlation between a patchset and it’s zuul ref?21:12
clarkbkevinbenton: for upstream its listed in the job logs21:12
clarkbeach job says I am checking out refs/zuul/foo21:12
*** otherwiseguy has quit IRC21:14
kevinbentonclarkb: so is the url to a job log constructed in a predictable fashion?21:16
*** gondoi is now known as zz_gondoi21:16
clarkbkevinbenton: yup, let me get you a link to that21:17
clarkbhttps://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/zuul/openstack_functions.py#n1821:18
*** rcarrillocruz has joined #openstack-infra21:18
clarkbjhesketh: when you get off of airplanes let me know and we can plan a time to restart the apache service on static.o.o21:18
* zaro back from lunch. looks like i missed the visit from _david_ :(21:19
*** arnaud has quit IRC21:19
*** arnaud__ has quit IRC21:19
clarkbjhesketh: though we may need to review and approve any outstanding os loganalyze changes that we want before that21:19
clarkbjhesketh: but that should get us real close to working swift log uploads21:19
*** rcarrill` has quit IRC21:19
_david_zaro, well corvus explained me, what you are actually trying to achieve, so here we go: https://gerrit-review.googlesource.com/5874821:20
kevinbentonclarkb: thanks. so will I then have to wait for the jobs to finish before these logs become available?21:20
zarojogo: what do you mean user history?  do you mean history of comments/reviews?21:20
clarkbkevinbenton: yes? I think I am not sure why that matters21:20
clarkbkevinbenton: are you trying to use upstreams refs?21:20
clarkbkevinbenton: you should be constructing your own refs21:20
clarkbwith zuul or other tools21:20
zaro_david_: cool, thanks a bunch!21:21
_david_zaro, Do you need it on stable-2.8? Should i backport it?21:21
*** nati_ueno has quit IRC21:21
kevinbentonclarkb: yes, i wanted to use upstream refs so I could test the same thing as the openstack CI without requiring an extra tool21:21
clarkbkevinbenton: so that isn't part of the api we expose, I would not test things that way21:22
clarkbkevinbenton: third party testing's interface is the gerrit stream. from that you can construct refs to use21:22
zaro_david_: we would really appreciate it :)21:22
*** freyes_ has joined #openstack-infra21:23
_david_zaro, n. p. working on it just now21:23
zaroanteaya: _david_ is your hero.21:23
*** nati_uen_ has joined #openstack-infra21:23
*** otherwiseguy has joined #openstack-infra21:23
_david_zaro, anteaya , actually your truly hero is corvus , hw managed to explain what you need ;-)21:24
zaro_david_: will review shortly.21:24
kevinbentonclarkb: yes, i can construct them manually but the ‘construct’ part is what I was hoping to avoid because that’s an extra step in the build process and I wanted to keep it as simple as possible21:24
morganfainbergclarkb, sdague, would it be reasonable to put the requirements gate job into it's own queue, since post it merging it would need the proposal bot updating the requirements for each project21:25
kevinbentonclarkb: building them myself also doesn’t guaruntee I’m testing with precisely the same HEAD as openstack does if the timing between when my calculation happens and openstacks is off (due to high load, etc)21:26
clarkbmorganfainberg: no, we actually test with those requirements21:26
clarkbmorganfainberg: so ideally it would be in the same pipeline21:26
morganfainbergclarkb, really? subsequent patches install those requirements?21:26
clarkbkevinbenton: correct, but I think in general that is fine21:26
*** dimtruck is now known as zz_dimtruck21:26
morganfainbergclarkb, i though that required a proposal bot update21:26
clarkbmorganfainberg: yup beacuse devstack syncs global requirements into all projects21:26
clarkbmorganfainberg: so for integration testing you are tested with global requirements regardelss of what your requirements.txt says21:26
*** Guest57712 has quit IRC21:26
kevinbentonclarkb: can you be pursuaded to expose that ref somewhere? :-)21:27
*** freyes_ has quit IRC21:27
*** annegent_ has quit IRC21:27
*** erw has joined #openstack-infra21:27
erwweird looping failures… https://jenkins07.openstack.org/job/check-nova-docker-dsvm-f20/21:27
clarkbkevinbenton: I think you will need to talk to jeblair21:27
*** arnaud__ has joined #openstack-infra21:27
erwlast 6 hours, it just runs, fails, and gets automatically restarted??21:28
*** arnaud has joined #openstack-infra21:28
clarkbkevinbenton: I prefer the current setup. it is much more flexible and doesn't make too many assumptions21:28
*** wenlock_ has joined #openstack-infra21:28
sdaguemorganfainberg: yeh, what clarkb said21:28
clarkberw: that particular error message is probably interpretted by zuul as a jenkins failure so it tries again21:28
clarkberw: looks like a network borkage?21:28
sdaguewe can't trust projects to land req changes fast enough, so we just force them for the sake of testing21:29
kevinbentonclarkb: well this wouldn’t really change anything would it? It would just give place to say “this is the ref that is being tested”21:29
sdaguethat was actually the original reason for g-r21:29
clarkberw: going to guess that devstack there is breaking networking?21:29
clarkbkevinbenton: except there are valid reasons to not test that ref21:29
morganfainbergclarkb, sdague, hm. that seems to introduce some chicken/egg issues but sure. ok i think that means i'll try and figure out what we can do to make the integration test better it's grown to > 1.5 hrs for 60%21:29
clarkbkevinbenton: in any case it would be good subject for jeblair discussion21:29
erwclarkb: hmm. someone did just change our gate script. bleh21:29
morganfainbergclarkb, sdague, any failure in requirements is a brutal gate reset. i think i have some ideas. that is based on the pbr/tools/integration.sh right?21:30
sdaguemorganfainberg: yeh, well step one would be to move that job into requirements repo21:30
sdaguebeing in the pbr repo is weird21:30
kevinbentonclarkb: oh, what would be an example of not wanting to test that?21:30
zarocan someone tell me how i can get to the logs for my build again?  is it http://logs.openstack.org/<git sha>  ?21:30
morganfainbergsdague, yeah that was my 1st thought :)21:31
kevinbentonclarkb: I’ll ping jeblair when online21:31
clarkbkevinbenton: if you are a third party testing with a local git tree21:31
morganfainbergsdague, ok in either case.21:31
clarkbkevinbenton: you wouldn't want upstream refs because it wouldn't include your stuff21:31
clarkbkevinbenton: so you would construct a ref merged into local tree21:31
*** markwash has quit IRC21:31
morganfainbergsdague, i'll see if i can help this some21:31
sdaguemorganfainberg: great21:31
*** changbl has quit IRC21:32
openstackgerritGregory Haynes proposed a change to openstack-infra/config: Add job for tripleo-overcloud-HA  https://review.openstack.org/10746821:32
clarkbkevinbenton: there are also valid reasons for your use case21:32
clarkbkevinbenton: so ya something to talk about when we have a bit more of a quorum21:32
kevinbentonclarkb: i’m testing neutron upstream code. there is no local stuff21:33
clarkbzaro: depends. you want post job logs?21:33
*** mestery has quit IRC21:33
*** otherwiseguy has quit IRC21:33
zaroclarkb: the log for a release pipeline, http://git.openstack.org/cgit/stackforge/python-jenkins/tag/?h=3.0-fixes&id=0.3.321:33
clarkbzaro: http://logs.openstack.org/firsttwoofsha1/entiresha121:34
greghaynesHello infrapeoples, can I get a +A on https://review.openstack.org/#/c/107468/21:35
* greghaynes googley eyes clarkb21:35
zaroclarkb: thanks.21:35
*** chuckC_ has quit IRC21:35
clarkbgreghaynes: so that change doesn't run the test anywhere. you will want to look in openstack-infra/config/modules/openstack_project/files/zuul/layout.yaml21:36
*** annegent_ has joined #openstack-infra21:36
clarkbgreghaynes: basically you added a job and also need to tell zuul to run that job21:36
morganfainbergsdague, clarkb, for moving integration.sh, do we want to try and keep history on that script?21:36
greghaynesclarkb: silly details21:36
morganfainbergsdague, clarkb, or is it sufficient to just fork-lift (i can keep history, but it takes a merge commit and some branch pushes to gerrit)21:36
clarkbmorganfainberg: I am ok with not having all the history21:36
erwclarkb: if we submit a new patchset, does it kill existing jenkins jobs? That is, this long-running-broken job won’t chicken/egg us, will it?21:36
clarkbmorganfainberg: mostly because running git filter branch is a pita21:37
morganfainbergclarkb, yes it is. but i got reasonably good at it :P21:37
clarkberw: ya that should kick it out and start jobs with new patchset21:37
*** dkranz has quit IRC21:37
morganfainbergclarkb, much easier w/o needing to do it21:37
erwclarkb: thanks.21:37
sdaguemorganfainberg: yeh, history isn't important to me21:37
zaroclarkb: invalid command 'bidst_wheel'?  http://logs.openstack.org/90/90b7ef732dcc813bf0a83301a8b21d65767dda64/post/python-jenkins-branch-tarball/1f6d7ec/console.html21:37
clarkbzaro: should be 'bdist_wheel'21:37
sdaguejust put a comment in the first commit of where it came from, so we can track it back if we need to21:37
*** dizquierdo has joined #openstack-infra21:38
zaroclarkb: that's my typo.  it's bdist_wheel.21:38
*** pcm_ has quit IRC21:38
zaroclarkb: do you need to add something to setup.py for wheel?21:38
clarkbzaro: no you should'nt21:38
clarkbzaro: you can always test it locally though21:38
zaroclarkb: it says the same thing when i run it on my local laptop.  don't know what's needed to make it work though.21:39
clarkbzaro: tox -evenv -- python setup.py bdist_wheel21:40
*** freyes_ has joined #openstack-infra21:40
clarkbyou may need to install the wheel package for that?21:40
*** dustins has quit IRC21:40
*** ociuhandu has joined #openstack-infra21:41
_david_zaro, now on stable-2.8: https://gerrit-review.googlesource.com/5874921:41
openstackgerritMorgan Fainberg proposed a change to openstack/requirements: Copy pbr/tools/integration.sh to the requirements repo  https://review.openstack.org/10850421:42
zaroclarkb: actually it's 'ERROR:   venv: commands failed'.  missing the command in tox.ini?21:42
clarkbzaro: you might not have the testenv:venv thing in tox.ini then?21:43
openstackgerritGregory Haynes proposed a change to openstack-infra/config: Add job for tripleo-overcloud-HA  https://review.openstack.org/10746821:43
openstackgerritA change was merged to openstack/requirements: Update retrying to 1.2.2  https://review.openstack.org/10742321:43
clarkbgreghaynes: do you need that to be non voting as well?21:45
greghaynesclarkb: yes21:45
clarkbgreghaynes: oh I see, the voting: false goes in layout.yaml not the jjb yaml21:45
greghaynesah21:46
clarkbI can leave inline comments if it will help21:46
*** signed8bit has quit IRC21:46
zaroclarkb: 'testenv:venv' is in tox.ini. i installed wheel from pip21:46
greghaynesclarkb: That would be win!21:46
zaroclarkb: still fails to build bdist_wheel though21:47
*** mfer has quit IRC21:47
openstackgerritMorgan Fainberg proposed a change to openstack-infra/config: Update job requirements integration test location  https://review.openstack.org/10850821:47
clarkbzaro: I am not sure then21:47
*** zns has quit IRC21:50
sdagueclarkb: this can probably land - https://review.openstack.org/#/c/104438/21:50
greghaynesclarkb: oh, I think I see, you just add it to the jobs: block?21:50
clarkbgreghaynes: done21:51
clarkbgreghaynes: see comment and yes21:51
*** markmc has quit IRC21:51
*** luqas has joined #openstack-infra21:52
*** signed8bit has joined #openstack-infra21:52
openstackgerritGregory Haynes proposed a change to openstack-infra/config: Add job for tripleo-overcloud-HA  https://review.openstack.org/10746821:52
jogozaro: user, so when was the last time reviewer(or third party CI rig) x voted21:52
*** cnesa has quit IRC21:52
*** armax has quit IRC21:53
*** wenlock_ has quit IRC21:55
*** dprince has quit IRC21:56
*** obondarev has quit IRC21:57
zarojogo: i think you can just do a query to get that info.21:57
*** ChuckC has quit IRC21:58
clarkbgreghaynes: that looks correct +121:58
clarkber +221:58
*** otherwiseguy has joined #openstack-infra21:58
*** annegent_ has quit IRC21:59
*** hashar has quit IRC22:00
openstackgerritA change was merged to openstack-infra/elastic-recheck: Remove query for ssh timeout bug 1298472  https://review.openstack.org/10783922:00
uvirtbotLaunchpad bug 1298472 in nova "SSHTimeout in tempest trying to verify that computes are actually functioning" [Critical,Fix committed] https://launchpad.net/bugs/129847222:00
*** derekh_ has quit IRC22:01
*** cinerama has quit IRC22:01
*** hogepodge has quit IRC22:01
*** dims has quit IRC22:01
*** rwsu has quit IRC22:02
zarojogo: i think change detail REST api may work as well: https://gerrit-review.googlesource.com/Documentation/rest-api-changes.html#get-change-detail22:03
*** bnemec has quit IRC22:03
*** markwash has joined #openstack-infra22:03
*** oomichi has joined #openstack-infra22:04
*** oomichi has quit IRC22:05
*** _david_ has quit IRC22:05
jogozaro: I don't want per change22:05
jogoI want over all changes22:05
*** craigbr has quit IRC22:06
*** ZZelle has quit IRC22:06
zarojogo: how about the query then?22:06
*** jp_at_hp1 has quit IRC22:06
openstackgerritA change was merged to openstack-infra/gitdm: Add automated CI emails to be skipped in metrics  https://review.openstack.org/10708622:06
openstackgerritA change was merged to openstack-infra/gitdm: Tidy the do-it script to conform to bash8  https://review.openstack.org/10708822:07
*** julim has quit IRC22:07
*** sarob has quit IRC22:07
jogozaro: not sure what query to use for that22:07
jogoI could get a list of all reviews where the person reviewed, but don't know how to sort unless I do pastprocessing22:08
jogowhich is fine, but was hoping there was a magic answer22:08
*** vladan has quit IRC22:08
*** homeless has quit IRC22:08
jogosweston: ^22:08
*** gmurphy has quit IRC22:09
*** homeless has joined #openstack-infra22:09
*** yamamoto has quit IRC22:10
zarojogo: there is a 'reviewer' label22:10
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Fixed notifications.  https://review.openstack.org/10851322:11
jogozaro: is there way to sort the results in the query itself?22:11
*** homeless_ has joined #openstack-infra22:12
*** vladan has joined #openstack-infra22:12
jogozaro: I am trying to answer the question: when was the last time vmware CI voted22:12
zarojogo: unfortunately not :(  one of my biggest gripes.22:12
sdaguejogo: you need post processing for that22:12
jogozaro sdague: thats what I thought, should be easy enough to do22:12
jogosweston: ping22:13
*** markwash has quit IRC22:14
*** homeless has quit IRC22:14
swestonjogo: pong22:15
openstackgerritClark Boylan proposed a change to openstack-infra/config: Tox fixed the openstack breaking bug use latest  https://review.openstack.org/10851522:16
clarkbthat is going to be WIP'd but yta I think we can do that soonish22:16
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Added subscription API  https://review.openstack.org/10851622:16
clarkbalso I need to do more trusty moves...22:17
*** ZZelle has joined #openstack-infra22:17
*** emagana_ has quit IRC22:17
jogosweston: see backlog I think you can fairly easily get a list of the last time something voted22:17
swestonjogo: yes, reading ...22:17
*** emagana has joined #openstack-infra22:18
*** MarkAtwood has joined #openstack-infra22:18
jogosweston: use rest API to get member list of https://review.openstack.org/#/admin/groups/91,members22:18
jogowrite query to get list of patches a member reviewed on22:18
jogopost-process results to find most recent review by 3rd party22:18
zaroi get an error that says "invalid command 'bdist_wheel'".  I have know idea why i'm getting this and google wasn't much help.   Anybody able to help me with that?22:19
*** Ryan_Lane has quit IRC22:19
*** Ryan_Lane has joined #openstack-infra22:19
swestonjogo: hmmm.  thinking ...22:19
*** james_li has quit IRC22:19
*** bknudson has quit IRC22:20
jogozaro: local box?22:20
jogo'pip install wheel'22:20
*** emagana_ has joined #openstack-infra22:20
jogomaybe22:20
zarojogo: yes local and on build slave.  i tried manually installing wheel, but still get same error.22:21
zarocould it be a new version of wheel?22:22
*** emagana has quit IRC22:22
*** annegent_ has joined #openstack-infra22:22
jogozaro: don't know thats the extent of my pip wheel knowledge22:23
swestonjogo: ah nice.  default sort order is by most recent first :-)22:23
zarohmm. new version was released on 2014-07-06. so pretty recent22:23
jogosweston: for the REST API?22:24
jogosweston: so AFAIK vmware CI is down22:24
*** luqas has quit IRC22:24
jogoas a test22:24
*** alexpilotti has quit IRC22:24
*** packet has quit IRC22:25
swestonjogo: for a gerrit query, assuming the REST api follows the same convention22:25
jogosweston: because a query on review.openstack.org sorts by most recently updated change, not most recently commented on by reviewer X22:25
jogounless my query was bad22:25
*** tsg has quit IRC22:25
*** jcoufal has quit IRC22:25
swestonjogo: argh, you are right22:26
jogosweston: thats something easy to fix by processing the data afterwards22:26
swestonjogo: would be better to collect this info on submission of the data, rather than the other way around.  but this will work for now22:27
jogosweston: yeah you can hook into the gerrit stream, but doing a few rest calls + some sorting has less room for fail22:27
*** dims has joined #openstack-infra22:28
swestonjogo: ok, will spend some time on it.  Thank you for the additional advice, very nice :-)22:29
*** jgrimm has quit IRC22:31
*** mwagner_lap has joined #openstack-infra22:31
jogosweston: cool, I look forward to seeing the results. you can probably do this with some javascript and make this a neat static page22:32
*** dims has quit IRC22:32
*** virmitio has quit IRC22:33
swestonjogo: kk22:33
*** SumitNaiksatam has quit IRC22:34
*** markwash has joined #openstack-infra22:34
*** tsg has joined #openstack-infra22:36
openstackgerritpritesh proposed a change to openstack-dev/hacking: Add hacking check for editor configuration in source files  https://review.openstack.org/10196922:36
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Subscription  https://review.openstack.org/10400422:37
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Added subscription API  https://review.openstack.org/10851622:40
*** doug-fish has left #openstack-infra22:41
*** thedodd has quit IRC22:41
*** yamamoto has joined #openstack-infra22:41
*** datsun180b has quit IRC22:42
*** stevemar has quit IRC22:44
*** zns has joined #openstack-infra22:44
ianwjhesketh : if you could restore your +2 on the rebase for https://review.openstack.org/#/c/104438/ (Revert "demote f20 to experimental") that would be great22:45
*** changbl has joined #openstack-infra22:46
*** yamamoto has quit IRC22:46
*** dizquierdo has quit IRC22:46
*** pdmars has quit IRC22:46
*** otherwiseguy has quit IRC22:47
*** markmc has joined #openstack-infra22:47
*** pdmars has joined #openstack-infra22:47
*** SumitNaiksatam has joined #openstack-infra22:49
*** andreykurilin has quit IRC22:49
*** annegent_ has quit IRC22:49
*** craigbr has joined #openstack-infra22:49
jogoanyone else having issues with logs.openstack.org22:50
clarkbjogo: not me, what issues?22:50
jogohttp://logs.openstack.org/76/107076/2/check/gate-nova-pep8/74913bf22:50
jogono response22:50
jogofor me22:50
clarkbhrm22:51
clarkbdid apache restart?22:51
jogouh oh22:51
*** armax has joined #openstack-infra22:52
*** pdmars has quit IRC22:52
*** aysyd has quit IRC22:52
clarkbno22:52
clarkbits been going since the 17th which is when I last kicked it I think22:52
sdagueclarkb: it's seemed slow for me today22:52
*** weshay has quit IRC22:52
sdagueany chance on seeing top on it to figure out if it's going a little bonkers?22:52
clarkboh ya that its22:53
clarkb11522:53
clarkbis the load22:53
* clarkb figures this out22:53
clarkbI wonder if this is the volume issue again22:54
clarkbthere is tons of uploads going on too22:54
*** MarkAtwood has quit IRC22:54
*** MarkAtwood has joined #openstack-infra22:55
clarkbwe dont' appear to have run out of disk22:55
clarkbiops don't seem to have peaked according to static22:55
clarkber cacti22:56
pleia2tcp connections seem a bit higher than usual22:56
clarkbhttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=137&rra_id=all is pretty telling thouh22:56
clarkbpleia2: they may be piling up due to IO issues22:56
pleia2yeah22:56
sdagueclarkb: only on local volumes, or swift access as well?22:57
clarkbsdague: I don't think we are hitting swift for anything22:57
*** dmsimard is now known as dmsimard_away22:58
clarkbsdague: except that it will fall back on that huh22:58
*** nati_uen_ has quit IRC22:58
*** rainya has joined #openstack-infra22:58
clarkbload is falling now though22:59
*** nati_uen_ has joined #openstack-infra22:59
clarkbI didn't change anything22:59
sdaguehttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=140&rra_id=all23:00
clarkbhttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=713&rra_id=all that dip23:00
clarkbwhat is dm-023:00
*** homeless has joined #openstack-infra23:02
*** armax has quit IRC23:04
*** yamahata has quit IRC23:04
*** homeless_ has quit IRC23:04
*** yamamoto has joined #openstack-infra23:05
*** arnaud has quit IRC23:06
*** Alexandra_ has joined #openstack-infra23:06
*** markmcclain has quit IRC23:06
*** arnaud has joined #openstack-infra23:06
*** freyes_ has quit IRC23:06
*** Sukhdev has quit IRC23:08
*** sarob has joined #openstack-infra23:09
*** yamamoto has quit IRC23:10
sarobi really need to get https://review.openstack.org/#/c/107453/ merged, so congress-specs repo can work23:11
*** otherwiseguy has joined #openstack-infra23:11
sarobbrother spare a review?23:12
*** nati_uen_ has quit IRC23:12
*** nati_ueno has joined #openstack-infra23:13
*** arnaud has quit IRC23:13
*** arnaud__ has quit IRC23:13
*** emagana_ has quit IRC23:15
*** emagana has joined #openstack-infra23:16
*** arnaud__ has joined #openstack-infra23:16
*** arnaud has joined #openstack-infra23:16
*** markmc has quit IRC23:17
*** gmurphy has joined #openstack-infra23:17
*** rainya has quit IRC23:18
*** Evgeny has quit IRC23:18
*** otherwiseguy has quit IRC23:19
*** otherwiseguy has joined #openstack-infra23:19
*** tusharsg has joined #openstack-infra23:20
*** annegent_ has joined #openstack-infra23:20
*** emagana has quit IRC23:20
*** nightfly has quit IRC23:20
*** marcoemorais has quit IRC23:20
*** tsg has quit IRC23:21
*** marcoemorais has joined #openstack-infra23:21
swestonclarkb: dm-0 is the Linux raid driver for mirroring.  Are you doing software raid  ?23:21
*** Alexandra_ has quit IRC23:21
*** marcoemorais has quit IRC23:21
*** marcoemorais has joined #openstack-infra23:21
ianwsdague: any thoughts on https://review.openstack.org/#/c/107073/ (Add $NOVA_VNC_ENABLED to force VNC on)?  i think one more required flag to get multi-node testing is not a good idea23:22
clarkbsweston: no I didn't think so which is why it was weird that it showed up23:23
clarkbsweston: but I have been distracted23:23
*** armax has joined #openstack-infra23:23
*** david-lyle has quit IRC23:24
swestonclarkb: I know the feeling, hehe23:24
*** markwash has quit IRC23:25
*** signed8bit is now known as signed8bit_ZZZzz23:25
*** annegent_ has quit IRC23:26
*** annegent_ has joined #openstack-infra23:27
*** betsy has quit IRC23:28
*** bknudson has joined #openstack-infra23:28
*** dims has joined #openstack-infra23:28
*** pradk has quit IRC23:29
*** KimJ has quit IRC23:29
*** ZZelle has quit IRC23:30
*** emagana has joined #openstack-infra23:31
*** craigbr has quit IRC23:31
*** dims has quit IRC23:33
*** homeless has quit IRC23:36
*** jamielennox|away is now known as jamielennox23:36
*** arnaud has quit IRC23:36
*** craigbr has joined #openstack-infra23:36
*** arnaud has joined #openstack-infra23:36
*** wenlock has quit IRC23:37
*** chuckC has joined #openstack-infra23:39
*** annegent_ has quit IRC23:39
*** jaypipes has quit IRC23:40
*** garyh has left #openstack-infra23:42
*** yamamoto has joined #openstack-infra23:43
*** yamamoto has quit IRC23:48
openstackgerritA change was merged to openstack/requirements: Drop flake8 2.1.0  https://review.openstack.org/10300623:51
*** amalagon_ has quit IRC23:52
*** atiwari has quit IRC23:52
*** salv-orlando has quit IRC23:52
openstackgerritOpenStack Proposal Bot proposed a change to openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/10853123:54
*** jaypipes has joined #openstack-infra23:54
*** armax has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!