Tuesday, 2016-11-01

*** rbuzatu has joined #openstack-infra00:02
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: lib: common-functions: Fix tmpfs umounting  https://review.openstack.org/39200200:09
*** tphummel has quit IRC00:13
*** xarses_ has joined #openstack-infra00:17
*** xarses has quit IRC00:18
*** watersoul has quit IRC00:18
*** watersoul_ has joined #openstack-infra00:19
*** sflanigan has quit IRC00:20
*** sigmavirus has quit IRC00:20
*** dims_ has quit IRC00:20
*** sflanigan has joined #openstack-infra00:21
*** sflanigan has joined #openstack-infra00:21
*** Mmike has quit IRC00:21
*** Mmike has joined #openstack-infra00:21
*** _sigmavirus24 has joined #openstack-infra00:24
*** gmann_ has joined #openstack-infra00:26
*** dims has joined #openstack-infra00:31
*** gmann_ has quit IRC00:33
*** verdurin has quit IRC00:49
*** akshai has quit IRC00:51
*** knangia has quit IRC00:52
*** yaume_ has joined #openstack-infra00:55
*** yaume has quit IRC00:56
*** gmann_ has joined #openstack-infra00:56
*** verdurin has joined #openstack-infra00:56
*** rvasilets___ has quit IRC00:58
*** f4_ has joined #openstack-infra01:05
*** cody-somerville has joined #openstack-infra01:05
*** dave-mccowan has joined #openstack-infra01:09
*** chlong has quit IRC01:09
*** f4_ has quit IRC01:10
*** thorst has joined #openstack-infra01:10
*** f4_ has joined #openstack-infra01:11
*** f4_ has quit IRC01:11
*** f4_ has joined #openstack-infra01:12
*** f4_ has quit IRC01:12
*** f4_ has joined #openstack-infra01:12
*** f4_ has quit IRC01:12
*** f4_ has joined #openstack-infra01:12
*** f4_ has quit IRC01:12
*** f4_ has joined #openstack-infra01:13
*** f4_ has quit IRC01:13
*** Apoorva has quit IRC01:14
*** Apoorva has joined #openstack-infra01:15
*** thorst has quit IRC01:15
*** thorst has joined #openstack-infra01:16
*** rlandy has quit IRC01:17
*** mtanino has quit IRC01:17
*** Daisy has joined #openstack-infra01:19
*** Apoorva has quit IRC01:19
*** vtapia_ has quit IRC01:21
*** vtapia_ has joined #openstack-infra01:23
*** thorst has quit IRC01:24
*** kjackal_ has joined #openstack-infra01:28
*** zhurong has joined #openstack-infra01:31
*** vtapia_ has quit IRC01:31
*** kjackal_ has quit IRC01:32
*** aeng has quit IRC01:34
*** Daisy has quit IRC01:34
*** vtapia_ has joined #openstack-infra01:36
*** yanyanhu has joined #openstack-infra01:37
*** kiran-r has joined #openstack-infra01:37
*** tphummel has joined #openstack-infra01:39
openstackgerritMerged openstack/diskimage-builder: Don't set tracing in environment files  https://review.openstack.org/38897201:42
*** tphummel has quit IRC01:45
*** Daisy has joined #openstack-infra01:50
*** aeng has joined #openstack-infra01:51
*** zhurong has quit IRC01:51
openstackgerritMerged openstack/diskimage-builder: Don't log datestamp by default in functional tests  https://review.openstack.org/39012601:55
*** madhu_ak has quit IRC02:00
*** psilvad has joined #openstack-infra02:00
*** yaume_ has quit IRC02:00
*** madhu_ak has joined #openstack-infra02:02
*** mtanino has joined #openstack-infra02:05
*** gongysh has joined #openstack-infra02:06
*** zhurong has joined #openstack-infra02:11
*** aeng has quit IRC02:17
*** thorst has joined #openstack-infra02:23
*** gouthamr has joined #openstack-infra02:23
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Disable translation/doc publishing for projects formerly in neutron group  https://review.openstack.org/39201202:24
*** rbuzatu has quit IRC02:28
*** thorst has quit IRC02:30
*** aeng has joined #openstack-infra02:30
openstackgerritJohn Hua proposed openstack-infra/project-config: Shorten image list  https://review.openstack.org/37715902:33
*** gmann__ has joined #openstack-infra02:36
*** gmann_ has quit IRC02:39
*** ramishra has joined #openstack-infra02:40
*** gmann___ has joined #openstack-infra02:45
*** madhu_ak has quit IRC02:45
*** gmann__ has quit IRC02:45
*** gmann___ is now known as gmann__02:45
*** madhu_ak has joined #openstack-infra02:47
*** yuanying has quit IRC02:47
*** yuanying has joined #openstack-infra02:48
*** madhu_ak has quit IRC02:48
*** madhu_ak has joined #openstack-infra02:49
*** madhu_ak has quit IRC02:50
*** tuanluong has joined #openstack-infra02:51
*** yuanying has quit IRC02:52
*** dave-mccowan has quit IRC02:53
*** madhu_ak has joined #openstack-infra02:54
*** gouthamr has quit IRC02:54
*** madhu_ak has quit IRC02:55
*** madhu_ak has joined #openstack-infra02:59
*** rbuzatu has joined #openstack-infra03:00
*** eharney has quit IRC03:00
*** madhu_ak has quit IRC03:01
*** amotoki has quit IRC03:01
*** Daisy has quit IRC03:03
*** madhu_ak has joined #openstack-infra03:04
openstackgerritMerged openstack-infra/system-config: Remove reference to non-existing page  https://review.openstack.org/39160303:05
*** Daisy has joined #openstack-infra03:07
*** armax has quit IRC03:09
*** Daisy has quit IRC03:10
*** Daisy has joined #openstack-infra03:10
*** rbuzatu has quit IRC03:12
*** armax has joined #openstack-infra03:19
*** rbuzatu has joined #openstack-infra03:20
*** dimtruck is now known as zz_dimtruck03:20
*** Jeffrey4l has joined #openstack-infra03:21
*** ramishra has quit IRC03:21
*** mtanino has quit IRC03:22
*** rbuzatu has quit IRC03:23
*** rbuzatu has joined #openstack-infra03:24
*** gongysh has quit IRC03:24
*** rbuzatu_ has joined #openstack-infra03:26
*** rbuzatu__ has joined #openstack-infra03:27
*** thorst has joined #openstack-infra03:28
*** rbuzatu has quit IRC03:29
*** rbuzatu_ has quit IRC03:30
*** zz_dimtruck is now known as dimtruck03:32
*** psilvad has quit IRC03:32
*** thorst has quit IRC03:35
*** gongysh has joined #openstack-infra03:37
*** tphummel has joined #openstack-infra03:39
*** vikrant has joined #openstack-infra03:40
*** tphummel has quit IRC03:49
*** links has joined #openstack-infra03:52
*** gongysh has quit IRC03:53
*** aneliubin has joined #openstack-infra03:56
*** armax has quit IRC03:58
*** Daisy has quit IRC03:58
*** Daisy has joined #openstack-infra04:05
*** ramishra has joined #openstack-infra04:06
*** Daisy has quit IRC04:09
*** Daisy has joined #openstack-infra04:11
*** mtanino has joined #openstack-infra04:12
*** Daisy has quit IRC04:16
*** Daisy has joined #openstack-infra04:17
*** gmann_ has joined #openstack-infra04:19
*** Daisy has quit IRC04:22
*** Daisy has joined #openstack-infra04:23
*** Daisy has quit IRC04:28
*** Daisy has joined #openstack-infra04:29
*** admcleod1 has joined #openstack-infra04:32
*** thorst has joined #openstack-infra04:32
*** admcleod- has quit IRC04:33
*** Daisy has quit IRC04:34
*** Daisy has joined #openstack-infra04:35
*** thorst has quit IRC04:40
*** Daisy has quit IRC04:40
*** Daisy has joined #openstack-infra04:42
*** dimtruck is now known as zz_dimtruck04:42
*** yuanying has joined #openstack-infra04:42
*** fandi has joined #openstack-infra04:46
*** Daisy has quit IRC04:46
*** Daisy has joined #openstack-infra04:48
*** gmann__ has quit IRC04:52
*** netsin has quit IRC04:54
*** Daisy has quit IRC04:55
*** Daisy has joined #openstack-infra04:56
*** kiran-r has quit IRC04:56
*** yuanying has quit IRC04:57
*** mdrabe has quit IRC04:57
*** yuanying has joined #openstack-infra04:58
*** drifterza has joined #openstack-infra04:59
*** drifterza has quit IRC04:59
*** drifterza has joined #openstack-infra04:59
*** Daisy has quit IRC05:00
*** Daisy has joined #openstack-infra05:00
*** yuanying has quit IRC05:08
*** yuanying has joined #openstack-infra05:12
openstackgerritNoam Angel proposed openstack/diskimage-builder: add support for SUSE in dhcp-all-interfaces  https://review.openstack.org/39177205:15
*** yuanying has quit IRC05:28
*** askb has quit IRC05:29
*** yuanying has joined #openstack-infra05:32
*** yuanying has quit IRC05:36
*** yuanying has joined #openstack-infra05:36
*** thorst has joined #openstack-infra05:38
*** kiran-r has joined #openstack-infra05:44
*** fandi has quit IRC05:44
*** adriant has quit IRC05:44
*** thorst has quit IRC05:45
*** HeOS has joined #openstack-infra05:47
*** mtanino has quit IRC05:56
*** Ravikiran_K has joined #openstack-infra05:59
*** ramishra_ has joined #openstack-infra06:00
*** flepied1 has quit IRC06:01
*** ramishra has quit IRC06:02
*** yuanying has quit IRC06:11
*** HeOS has quit IRC06:14
*** mtanino has joined #openstack-infra06:15
*** Kevin_Zheng has joined #openstack-infra06:16
*** yuanying has joined #openstack-infra06:19
*** mtanino has quit IRC06:19
*** kiran-r has quit IRC06:20
*** fandi has joined #openstack-infra06:24
*** zhurong has quit IRC06:28
*** rcernin has joined #openstack-infra06:29
*** florianf has joined #openstack-infra06:30
*** florianf has quit IRC06:31
*** zhurong has joined #openstack-infra06:31
*** florianf has joined #openstack-infra06:31
*** kiran-r has joined #openstack-infra06:31
AJaegercloudnull: could you comment on https://review.openstack.org/#/c/392006, please?06:36
*** Mmike has quit IRC06:37
*** Mmike has joined #openstack-infra06:37
*** allanice001 has joined #openstack-infra06:38
*** yuanying has quit IRC06:40
*** thorst has joined #openstack-infra06:42
*** thorst has quit IRC06:49
*** yuanying has joined #openstack-infra06:57
*** yuanying has quit IRC07:02
*** nherciu has joined #openstack-infra07:02
*** florianf has quit IRC07:03
*** oanson has joined #openstack-infra07:06
openstackgerritMerged openstack/diskimage-builder: Changed the home-page of diskimage-builder in setup.cfg  https://review.openstack.org/39149607:11
*** kiran-r has quit IRC07:12
*** florianf has joined #openstack-infra07:12
*** jtomasek_ has joined #openstack-infra07:16
*** tesseract has joined #openstack-infra07:21
*** tesseract is now known as Guest1438107:21
*** esikachev has joined #openstack-infra07:25
*** yuval has joined #openstack-infra07:28
*** yuanying has joined #openstack-infra07:29
*** noama has joined #openstack-infra07:31
*** noama has left #openstack-infra07:36
*** jtomasek_ has quit IRC07:36
*** yamahata has quit IRC07:40
*** gmann_ has quit IRC07:43
*** thorst has joined #openstack-infra07:47
*** yuanying has quit IRC07:48
*** jklare_ has quit IRC07:50
*** yuanying has joined #openstack-infra07:50
*** jklare has joined #openstack-infra07:50
*** Naeil has joined #openstack-infra07:51
*** thorst has quit IRC07:55
*** yuanying has quit IRC07:57
*** zzzeek has quit IRC08:00
*** yuanying has joined #openstack-infra08:00
*** ssbarnea has joined #openstack-infra08:01
*** zzzeek has joined #openstack-infra08:01
*** ssbarnea has quit IRC08:05
*** yuanying_ has joined #openstack-infra08:07
*** nmagnezi has joined #openstack-infra08:08
*** yuanying has quit IRC08:08
*** ssbarnea has joined #openstack-infra08:10
*** chandankumar has joined #openstack-infra08:12
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/39206508:14
*** ssbarnea_ has joined #openstack-infra08:15
*** ssbarnea has quit IRC08:15
*** flepied has joined #openstack-infra08:17
*** ssbarnea_ has quit IRC08:22
*** florianf has quit IRC08:24
*** ccamacho has quit IRC08:24
*** ssbarnea has joined #openstack-infra08:25
*** ssbarnea has quit IRC08:28
*** jtomasek_ has joined #openstack-infra08:34
*** florianf has joined #openstack-infra08:38
*** lucas-afk is now known as lucasagomes08:40
AJaegerinfra-root https://github.com/openstack/boartty is empty - but http://git.openstack.org/cgit/openstack/boartty is fine. Could anybody check the github setup for boartty, please?08:48
*** camunoz has quit IRC08:49
*** HeOS has joined #openstack-infra08:50
openstackgerritMerged openstack-infra/project-config: networking-bagpipe: add tempest, cover, python3 and periodic jobs  https://review.openstack.org/38544508:51
openstackgerritMerged openstack-infra/project-config: Add nimble functional test job  https://review.openstack.org/38639908:52
*** thorst has joined #openstack-infra08:52
*** thorst has quit IRC09:00
*** flepied has quit IRC09:09
openstackgerritMerged openstack-infra/project-config: nova-lxd: Update configuration  https://review.openstack.org/38884609:10
openstackgerritMerged openstack-infra/project-config: Switch security role checks to voting  https://review.openstack.org/39194209:12
openstackgerritMerged openstack-infra/project-config: Add TLS CA server experimental job for TripleO CI  https://review.openstack.org/39174509:13
*** jaosorior has joined #openstack-infra09:15
*** Naeil has quit IRC09:17
*** rbuzatu__ has quit IRC09:18
*** jpich has joined #openstack-infra09:18
*** Daisy has quit IRC09:18
*** rbuzatu has joined #openstack-infra09:19
*** Daisy has joined #openstack-infra09:19
*** rbuzatu_ has joined #openstack-infra09:20
*** rbuzatu has quit IRC09:23
*** kairat has joined #openstack-infra09:25
*** dtantsur|afk is now known as dtantsur09:26
*** kairat has left #openstack-infra09:27
*** kairat has joined #openstack-infra09:27
*** panda|Zz is now known as panda|pto|PH09:28
*** Naeil has joined #openstack-infra09:30
*** abregman has joined #openstack-infra09:30
*** john-davidge has joined #openstack-infra09:32
*** Daisy_ has joined #openstack-infra09:33
*** derekh has joined #openstack-infra09:35
*** Daisy has quit IRC09:37
*** e0ne has joined #openstack-infra09:38
*** yanyanhu has quit IRC09:39
yolandahi AJaeger , to your rescue :)09:40
*** vponomaryov has joined #openstack-infra09:41
*** Daisy_ has quit IRC09:42
yolandafixed09:42
*** mdbooth_ is now known as mdbooth09:43
*** yuanying_ has quit IRC09:44
*** yuanying has joined #openstack-infra09:44
*** jaosorior has quit IRC09:48
*** Daisy has joined #openstack-infra09:48
*** Daisy has quit IRC09:48
*** Daisy has joined #openstack-infra09:48
*** jaosorior has joined #openstack-infra09:48
AJaegeryolanda: thanks!09:49
AJaegeryolanda: could you review https://review.openstack.org/391952 and https://review.openstack.org/#/c/391342/  and https://review.openstack.org/#/c/388206/ as well - not urgent, as time permits - , please?09:51
frickleris anyone else getting random emails from storyboard despite having notification emails disabled?09:51
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/39206509:54
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173809:57
*** Daisy has quit IRC09:57
*** thorst has joined #openstack-infra09:58
kairatpuppet infra folks, could you please look at https://review.openstack.org/#/c/359029/?09:58
*** dootniz is now known as kragniz09:59
*** tuanluong has quit IRC10:00
*** rtheis has joined #openstack-infra10:00
kairatyolanda, clarkb, mordred , pabelanger, mordred Could you please look at ^?10:00
*** zhurong has quit IRC10:01
kairatApp catalog team also need https://review.openstack.org/#/c/382971/ to be reviewed after this patch10:01
kairatSo we can test app catalog staging instance10:02
*** thorst has quit IRC10:04
*** Daisy has joined #openstack-infra10:08
openstackgerritMerged openstack-infra/project-config: Remove non-voting horizon jobs from gate queue  https://review.openstack.org/39134210:11
*** ssbarnea has joined #openstack-infra10:12
*** sambetts|afk is now known as sambetts10:12
*** Daisy has quit IRC10:13
openstackgerritNoam Angel proposed openstack/diskimage-builder: add support for SUSE in dhcp-all-interfaces  https://review.openstack.org/39177210:16
*** neiljerram has joined #openstack-infra10:17
neiljerramGood morning!  Is anyone else seeing CI failing with 'ImportError: No module named vine.five' ?10:17
*** shardy has joined #openstack-infra10:18
yolandahi neiljerram , i'm seeing that on bifrost for example. The problem comes with kombu version 4.0.010:18
*** ldnunes has joined #openstack-infra10:18
yolandai solved it using upper constraints from requirements files10:19
kairatneiljerram, I see it on glance gates10:19
kairatneiljerram, https://review.openstack.org/#/c/391859/10:19
neiljerramyolanda, thanks. is that an openstack-wide solution, or are per-project fixes needed?10:20
yolandaupper-requirements from openstack/requirements cap kombu version to 3.x.x so if you follow it, you won't hit that problem10:20
yolandaif you are not using upper requirements, i guess you'd need to fix your requirements per project10:20
neiljerramyolanda, thank you - I was aware of this as an area that I don't fully understand yet. Sounds like now would be an excellent time to remedy that!10:22
*** lVathan[m] has quit IRC10:23
kairatyolanda, may I ask your help app-catalog staging patches https://review.openstack.org/#/c/382971/ and https://review.openstack.org/#/c/359029/?10:23
yolandakairat, not really working today but i'd try to get some time10:24
kairatyolanda, big thanks!10:24
kairatsorry for disturbing10:24
yolandanp10:24
*** chandankumar has quit IRC10:28
*** chandankumar has joined #openstack-infra10:28
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Use parameter_merge_strategies for multinode env  https://review.openstack.org/38461810:32
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173810:32
*** rodrigods has quit IRC10:37
*** rodrigods has joined #openstack-infra10:37
*** Ravikiran_K has quit IRC10:37
*** nicolasbock has joined #openstack-infra10:39
openstackgerritMerged openstack-infra/puppet-apps_site: Glare support for app-catalog  https://review.openstack.org/35902910:40
*** rfolco has joined #openstack-infra10:41
*** mmedvede has quit IRC10:41
*** john-dav_ has joined #openstack-infra10:41
*** john-davidge has quit IRC10:41
*** chandankumar has quit IRC10:43
*** chandankumar has joined #openstack-infra10:43
*** Daisy has joined #openstack-infra10:46
*** Daisy has quit IRC10:50
*** ianychoi has joined #openstack-infra10:50
*** yuanying has quit IRC10:56
*** dprince has joined #openstack-infra10:56
*** chlong has joined #openstack-infra10:57
*** jkilpatr has quit IRC10:57
*** electrofelix has joined #openstack-infra11:01
*** bexelbie has quit IRC11:01
*** thorst has joined #openstack-infra11:02
*** mattfarina has quit IRC11:02
*** mattfarina has joined #openstack-infra11:02
*** bexelbie has joined #openstack-infra11:08
*** thorst has quit IRC11:09
*** Daisy has joined #openstack-infra11:10
*** madhu_ak has quit IRC11:11
*** ihrachys has joined #openstack-infra11:14
*** Daisy has quit IRC11:14
*** Daisy has joined #openstack-infra11:23
*** lVathan[m] has joined #openstack-infra11:23
*** psilvad has joined #openstack-infra11:24
*** ociuhandu has joined #openstack-infra11:25
*** Daisy has quit IRC11:28
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173811:28
*** gouthamr has joined #openstack-infra11:30
*** mmedvede has joined #openstack-infra11:34
*** jkilpatr has joined #openstack-infra11:34
*** pradk has joined #openstack-infra11:35
nibalizerjeblair: I was working with bkero on the upgrade of that at summit11:35
nibalizerturning it off if it's not working is fine, I'd rather work on the new one than repair the old anyway11:36
*** Daisy has joined #openstack-infra11:37
*** Daisy has quit IRC11:41
*** gordc has joined #openstack-infra11:43
*** thorst has joined #openstack-infra11:45
tdurakovhi folks11:45
*** tpsilva has joined #openstack-infra11:45
*** gildub has quit IRC11:46
*** EricGonczer_ has joined #openstack-infra11:47
*** amotoki has joined #openstack-infra11:47
tdurakovwho could help me with infra ci? https://review.openstack.org/#/c/389582/ - jenkins marks gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial as a post-failure,  while I couldn't find any issue: http://logs.openstack.org/82/389582/26/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/975c897/console.html11:48
*** EricGonc_ has joined #openstack-infra11:51
*** EricGonczer_ has quit IRC11:52
*** EricGonc_ has quit IRC11:52
*** dizquierdo has joined #openstack-infra11:53
*** EricGonczer_ has joined #openstack-infra11:55
openstackgerritRyan Beisner proposed openstack-infra/project-config: Add nova-compute-proxy charm  https://review.openstack.org/39178011:56
*** e0ne has quit IRC12:00
*** drifterza has quit IRC12:03
*** erlon is now known as erlon-airlong12:03
*** Daisy has joined #openstack-infra12:06
nibalizerbkero: i got it to store a report!12:09
*** Daisy has quit IRC12:10
*** chandankumar has quit IRC12:10
*** _sigmavirus24 is now known as sigmavirus12:12
*** sigmavirus has joined #openstack-infra12:12
openstackgerritMonty Taylor proposed openstack-infra/shade: Add unit test to show herd protection in action  https://review.openstack.org/39212012:12
mordrednibalizer: woot!12:12
*** kgiusti has joined #openstack-infra12:13
*** lucasagomes is now known as lucas-hungry12:16
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge  https://review.openstack.org/39212412:18
clarkbtdurakov: if you look in the ansible logs for the job it appears that the log copy from test instance into tmpdir on the zuul launcher fails because the dest dir does not exist12:18
clarkbI dont know what creates that tmp dest dir12:18
clarkbactually it might be the source that is wrong12:20
clarkbthr path on that is really interesting, its /foo/[user@ipv6]:/bar12:21
*** furlongm has joined #openstack-infra12:21
tdurakovclarkb: is it something wrong with the post-gate-hook, or some else?12:22
clarkbmordred: ^possibly a synchronize module bug?12:22
*** kairat has left #openstack-infra12:22
clarkbtdurakov: http://logs.openstack.org/82/389582/26/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/975c897/_zuul_ansible/post_playbook12:22
clarkbtdurakov: whichgets logged to http://logs.openstack.org/82/389582/26/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/975c897/_zuul_ansible/ansible_log.txt12:22
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173812:23
*** jkilpatr_ has joined #openstack-infra12:23
*** jkilpatr has quit IRC12:24
tdurakovclarkb: yes, thanks, but still not clear what causes it12:24
mordredclarkb: oh goodie12:24
clarkbya I canttell which of the two tasks there is the one failing12:24
clarkbthe shell or the synchronize12:24
clarkbmaybe zuulshould name them?12:24
*** Daisy has joined #openstack-infra12:25
mordredclarkb: I'm pretty sure it's synchonize that's failing12:25
mordred2016-11-01 10:44:43,260 p=8111 u=zuul |  FAILED - RETRYING: TASK: synchronize (3 retries left).12:25
mordredright?12:25
clarkbthe shelltask does have weird whitespace in thecommand which may break the paths as interpreted by rsync? but I amon aphone so weird whitespace may bephone being silly12:25
nibalizernew puppetboard looks so much better too12:25
clarkbmordred: ya but if you look atthe shelljust below the command is very similar12:26
mordredclarkb: hrm12:26
clarkbthe difference is whoch step of copy12:26
clarkbfirst is slaveto zl second is zlto static12:26
clarkbmordred: I think it is the synchronize12:27
*** Daisy has quit IRC12:30
*** abregman has quit IRC12:30
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4  https://review.openstack.org/37120912:33
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4  https://review.openstack.org/37120912:33
clarkba dig -x shouod sort out which step it is but ephone12:33
*** mdrabe has joined #openstack-infra12:34
tdurakovclarkb: anything I could help with?12:35
tdurakovI mean this issue12:35
*** jcoufal has joined #openstack-infra12:36
openstackgerritMonty Taylor proposed openstack-infra/zuul: Add names to post-playbook tasks for debugging  https://review.openstack.org/39213412:36
mordredclarkb: ^^ there's a patch to add names so we can debug easier next time12:36
pabelangermorning12:37
clarkbtdurakov: I dont think so, this appears to be an ansible bug12:37
clarkbits using a funny source for the rsync and that isnt on the filesystem12:37
tdurakovclarkb: acked, any workarounds on this?12:37
*** edmondsw has joined #openstack-infra12:38
tdurakovclarkb: I'm extending post-hook for voting job, so, don't want to break its stability12:38
clarkbtdurakov: I have no idea why it is happening so dont know of any. is this failure consistent on that job?12:38
*** Daisy has joined #openstack-infra12:38
*** akshai has joined #openstack-infra12:38
clarkbI dont think this is something your post hook can affect12:39
tdurakovclarkb: it fails from time to time12:39
tdurakovnot to often12:39
tdurakovat the same time this job and hook works in nova for a half a year or so, and no issues I heard about12:40
*** vikrant has quit IRC12:40
tdurakovclarkb: to clarify, this hook run tempest live-migration tests several time, each time changing backend/shared storage, so the chain I've working on installs ceph on devstack12:41
*** rlandy has joined #openstack-infra12:41
clarkbyes that cannot affect how ansible runs rsync to copy the logs at least it shouldnt12:42
tdurakovclarkb hope so, could you please ping me in case of any updates about this ansible bug? will try to recheck that several times12:42
*** Daisy has quit IRC12:43
*** mdrabe has quit IRC12:43
arxcruzclarkb: hey, do you mind to review one very small (2 lines) change in devstack-gate for me? :D12:43
pabelangerEmilienM: did you start your local gem mirror yet?  Want to confirm what the total size is12:44
arxcruzclarkb: https://review.openstack.org/#/c/391870/12:44
*** Ravikiran_K has joined #openstack-infra12:44
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Replace sphinxcontrib-programoutput reference  https://review.openstack.org/39198312:44
*** chandankumar has joined #openstack-infra12:44
*** kairat has joined #openstack-infra12:45
tdurakovclarkb: same hook, non-voting job: http://logs.openstack.org/82/389582/26/check/gate-grenade-dsvm-multinode-live-migration-nv/d5a6f51/console.html#_2016-11-01_10_57_01_96005912:45
tdurakovcould that be useful?12:45
EmilienMpabelanger: no, I'm doing it now12:45
kairatinfra-cores, could you please look at https://review.openstack.org/#/c/382971/12:45
*** dave-mccowan has joined #openstack-infra12:46
kairatit has got 2 +2 from infra-cores but need +A12:46
bkeronibalizer: nice, so we just need to massage the format a bit12:48
EmilienMpabelanger: Fetching 867673 gems (in progress)12:48
bkeroare you still tailing logs and modifying that json file?12:48
pabelangerEmilienM: great, thanks12:48
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Replace sphinxcontrib-programoutput reference  https://review.openstack.org/39198312:49
AJaegerproject-config cores, could you review https://review.openstack.org/391954 and https://review.openstack.org/391952 for better AFS docs publishing, please?12:49
EmilienMpabelanger: do you remember how many GB it was supposed?12:49
openstackgerritMerged openstack/diskimage-builder: Remove RedHat grub workaround install  https://review.openstack.org/38858012:49
EmilienMpabelanger: my ISP limits me to 500GB/month I think12:49
nibalizerbkero: so the format is now correct in our specimen json blob12:50
nibalizerwe need to make that blob of ruby emit it12:50
electrofelixfyi for anyone fixing the problem with sphinxcontrib-programoutput 'git+git://github.com/lunaryorn/sphinxcontrib-programoutput.git@0.8' will cause commands such as 'python setup.py --version' to fail, using '-e git+git://github.com/lunaryorn/sphinxcontrib-programoutput.git@0.8#egg=sphinxcontrib-programoutput' seems to result in both usage of 'python setup.py ..' and tox calling of '-r test-requirements' doing the right thing12:50
*** ssbarnea has quit IRC12:51
*** abregman has joined #openstack-infra12:51
pabelangerclarkb: mordred: jeblair: calebb: zaro: I believe everybody knows, but sphinxcontrib-programoutput was deleted from the tubes yesterday breaking nodepool / zuul along with it.  Best replacement so far is sphinxcontrib-autorun but doesn't look to support python3 (yet). Suggestions on how to move forward? I can work on adding python3 support to sphinxcontrib-autorun if we want to go that direction12:52
pabelangerhttps://review.openstack.org/#/c/391861/ review in question12:52
*** zhurong has joined #openstack-infra12:53
bkeronibalizer: cool12:53
*** jheroux has joined #openstack-infra12:53
*** ramishra_ has quit IRC12:53
*** ssbarnea has joined #openstack-infra12:53
electrofelixzxiiro waynr zaro: updated the sphinxcontrib-programoutput fix for JJB https://review.openstack.org/#/c/391983/12:54
*** kairat has left #openstack-infra12:54
zxiiroelectrofelix: thanks I was just looking at it12:54
pabelangerelectrofelix: zxiiro: I'm just talking about that now.  IMO, we shouldn't fetch it from github but now replace it12:54
*** amotoki has quit IRC12:54
nibalizerbkero: https://github.com/puppetlabs/puppetdb/blob/master/puppet/lib/puppet/reports/puppetdb.rb is probably what we adapt12:54
pabelangerelectrofelix: zxiiro:see https://review.openstack.org/#/c/391861/ for more info12:55
bkeronibalizer: oh nice12:55
electrofelixpabelanger: I think we can replace it as soon as autorun works for py3 right?12:55
mordredpabelanger: wait - what?12:56
*** derekh has quit IRC12:56
pabelangerelectrofelix: Or we use another solution. Depending on github.com doesn't seem to be the best coarse right now12:56
mordredpabelanger: why was it deleted from the tubes?12:56
pabelangermordred: that is the 1000 dollar question12:56
electrofelixin the mean time if anyone wants to submit code https://review.openstack.org/#/c/391983/ means that can continue for JJB until the path forward is determined12:56
pabelangerno body knows12:56
pabelangerit was unmaintained, so author must have just rm -rf12:56
bkeronibalizer: Let me do my meeting and I'll see about massaging the code to emit something like that.12:57
electrofelixbtw, since it's BSD, couldn't openstack fork it and reload it up?12:57
mordredyah. I was just going to suggest that12:57
*** tlian has joined #openstack-infra12:57
pabelangersure, if we want to do that12:57
*** amotoki has joined #openstack-infra12:57
pabelangerhttps://github.com/lunaryorn/sphinxcontrib-programoutput/issues/10 is upstream issue12:57
electrofelixpabelanger: IMHO the fixes to use github are really just to provide breathing space to allow infra propose a path forward with time to think12:59
pabelangermordred: do you want me to nab the sphinxcontrib-programoutput namespace on pypi? Or fork into another name12:59
mordredI was just about to nab it myself :)12:59
mordrednabbed12:59
pabelangercool12:59
pabelangerelectrofelix: I'd like to come up with a plan moving forward before we start working around the issue13:00
jeblairmmm.  zombie projects.13:00
zxiirosad that it was removed. They should have at least tried to find a new maintainer13:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Adjust functional test filter for OpenStack-Ansible  https://review.openstack.org/38923213:00
zxiiroleave it open for a new maintainer i mean13:01
*** Daisy has joined #openstack-infra13:01
jeblairotoh, they seem to have found a new maintainer fast.13:02
pabelangerfastest way, break everything, see who fixes it13:02
clarkbjeblair: see tdurakov's issue in scrollback, I think you worked on the rsync stuff a lot and maybe that is familiar to you13:02
zxiirohmm that's true too13:02
mordredjeblair: neat! well, in the mean time, I have re-uploaded the wheels that existed on pypi before thye were removed13:04
mordredbecause yay for local wheel cache13:04
pabelangeryay13:04
mordredjeblair: where did you see that they have a new maintainer?13:04
electrofelixmordred: I'm guessing he meant you13:05
electrofelixor rather openstack ;)13:05
mordredah. :)13:05
mordredanybody happen to have a source tarball of sphinxcontrib-programoutput v 0.8 laying around in their cache anywhere?13:06
mordredthe only thing I had locally was the wheels13:06
pabelangerchecking13:06
*** ramishra has joined #openstack-infra13:06
*** Daisy has quit IRC13:07
electrofelixmordred: I appear to13:08
*** xyang1 has joined #openstack-infra13:08
jeblairmordred: yeah, i thought you were going to fork it into gerrit13:08
mordredjeblair: I can do that as a next step if we decide that's a thing we want to do13:08
pabelangergoing to update upstream issue to let people know what has happened13:08
mordredpabelanger: already done13:08
pabelangerexcellent13:09
pabelangerjust seen that13:09
mordredfor now I figured re-uploading the previously exisitng artifacts at least unbreaks the internet without committing us to ongoing maint13:09
jeblairmordred: yeah, so i guess we either take over programoutput or contribute a fix to autorun.13:09
pabelangermordred: https://pypi.python.org/packages/source/s/sphinxcontrib-programoutput/sphinxcontrib-programoutput-0.8.tar.gz appears to still live13:09
mordredjeblair: yah13:09
pabelangerper issue13:09
mordredpabelanger: oh - neat!13:10
*** abregman_ has joined #openstack-infra13:10
mordredpabelanger, electrofelix: turns out I can't re-upload the source tarball13:10
mordredbecause it already exists there with that name13:11
jeblairclarkb, mordred, tdurakov: i agree i have no idea how that command was constructed but it looks suspeciously like a synchronize module bug.  it does seem to be the third task in the block section of the post playbook.13:11
mordreduploading a source tarball will have to wait on a decision on whether or not to produce new releases13:11
*** rhallisey has joined #openstack-infra13:13
*** kairat has joined #openstack-infra13:14
*** abregman has quit IRC13:14
*** links has quit IRC13:14
pabelangerlooks like our pypi mirror has sphinxcontrib-programoutput again13:14
mordredpabelanger: woot!13:16
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128613:16
*** furlongm has quit IRC13:17
*** lucas-hungry is now known as lucasagomes13:18
*** ianychoi has quit IRC13:18
*** Daisy has joined #openstack-infra13:20
zxiiroelectrofelix: waynr: For JJB 2.0, we're so close to closing it off. Anything we need to  do to ensure the effort isn't dying off?13:21
zxiiroelectrofelix: waynr: I'm asking because I'd also like to see a new release sooner rather than later.13:21
*** mdrabe has joined #openstack-infra13:22
jeblairclarkb, mordred, tdurakov: i think i can reproduce the synchronize issue locally.13:22
jeblair"/tmp/tmpWZW_sJ/ansible/[zuul@fe80::5054:ff:fe9d:20a1%eth3]:/home/jenkins/workspace/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/"  <-- that looks similarly weird, right?13:23
clarkbjeblair: yes I think that is the source of the problem, the prefix on the path13:23
*** allanice001 has quit IRC13:23
*** e0ne has joined #openstack-infra13:23
jeblair(the eth3 thing is me -- i needed it in order to use ipv6 in my test environment)13:23
*** Daisy has quit IRC13:24
*** EricGonczer_ has quit IRC13:25
*** yuval has quit IRC13:25
*** EricGonczer_ has joined #openstack-infra13:26
clarkbmordred: ty for the change to name the tasks, I think it will also help people reading the ansible logs/playbooks generally understand what is going on13:27
clarkbwhich then in turn aids debugging so yay13:27
*** Ravikiran_K has quit IRC13:27
clarkbjeblair: is it specifically related to using ipv6?13:29
clarkbthat would make the bug curiouser :)13:29
jeblairclarkb: nope, just switched to v4 and still doing it13:29
clarkbarxcruz: reviewed13:30
*** mriedem has joined #openstack-infra13:30
openstackgerritMerged openstack-infra/zuul: Add names to post-playbook tasks for debugging  https://review.openstack.org/39213413:30
*** baoli has joined #openstack-infra13:30
*** EricGonczer_ has quit IRC13:30
openstackgerritThomas Morin proposed openstack-infra/project-config: networking-bgpvpn: correct wrong gate_hook definition  https://review.openstack.org/39216113:31
*** Daisy has joined #openstack-infra13:31
jeblairclarkb: removing the two '--include' options from rsync changes the behavior13:31
*** EricGonczer_ has joined #openstack-infra13:31
*** yuanying has joined #openstack-infra13:32
jeblairclarkb: wait, that's not quite right13:32
jeblairclarkb: nm -- i just got cross-eyed reading the raw json output13:34
clarkbjson will do that13:34
arxcruzclarkb: thanks :) I'll take a look13:35
*** Daisy has quit IRC13:35
*** amotoki has quit IRC13:35
jeblairclarkb, mordred, pabelanger: it work if i remove the retry loop13:38
beisnerhi AJaeger - thx for the review.  fixed up the needed-by on https://review.openstack.org/#/c/39178013:38
openstackgerritNeil Jerram proposed openstack-infra/project-config: Add 'check-requirements' for networking-calico  https://review.openstack.org/39216813:40
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173813:40
clarkbjeblair: weird, does it happen 100% of the time with the retry loop? if so odd that more jobs don't fail13:41
jeblairclarkb: agreed, so i'm wolking on another theory -- i'm changing the src path name too.  i'm thinking retryloop+srcpath might be the trigger13:41
*** Naeil has quit IRC13:42
jeblairwolking/working13:42
*** EricGonczer_ has quit IRC13:45
openstackgerritYuriy Taraday proposed openstack-infra/project-config: Add cross-repo job for fuel-ccp* projects  https://review.openstack.org/39216913:45
*** EricGonczer_ has joined #openstack-infra13:47
jeblairclarkb, mordred, pabelanger: OH!  the command is *correct* the first time ansible runs it.  but subsequent retries prepend the garbage to the beginning of the src13:47
clarkbjeblair: aha13:47
jeblairand only the last command/error gets logged13:49
jeblair(i had to turn on -vvv to see the earlier, correct, version of the command)13:49
clarkbso the first error may juist be due to internets13:49
clarkband then subsequent attempts fail13:49
clarkbdue to this bug13:49
jeblairyes, or an actual error like the directory not existing13:49
jeblair(depending on whether this happens consistently or intermittently)13:50
electrofelixzxiiro: do we want to make a push this friday and the 18th to close out on remaining tasks/reviews?13:50
*** amotoki has joined #openstack-infra13:51
zxiiroelectrofelix: this week is no good for me. but I definitely can starting next week.13:52
electrofelixso 11th and 25th?13:52
zxiiroelectrofelix: +1 sounds good to me13:52
*** esikachev has quit IRC13:53
*** eharney has joined #openstack-infra13:53
*** puiterwijk has quit IRC13:54
jeblairoh, i just ran this with ansible devel, and it pprinted the json13:55
jeblairthat is *extremely* helpful13:55
jeblairbug is still present13:55
*** puiterwijk has joined #openstack-infra13:55
*** chem has quit IRC13:56
openstackgerritNoam Angel proposed openstack/diskimage-builder: add support for ubuntu and InfiniBand indhcp-all-interfaces  https://review.openstack.org/39177213:56
openstackgerritNoam Angel proposed openstack/diskimage-builder: add element cloud-init-allow-password-authentication  https://review.openstack.org/39176513:56
openstackgerritNoam Angel proposed openstack/diskimage-builder: redhat-common add option to select networking service NetworkManager/network  https://review.openstack.org/39217013:56
*** derekh has joined #openstack-infra13:57
*** bin_ has joined #openstack-infra13:59
*** yuanying has quit IRC14:01
*** dave-mccowan has quit IRC14:02
*** amotoki has quit IRC14:02
openstackgerritNoam Angel proposed openstack/diskimage-builder: redhat-common add option to select networking service NetworkManager/network  https://review.openstack.org/39217014:03
*** oanson has quit IRC14:05
*** moravec has joined #openstack-infra14:06
jeblairokay14:07
jeblairso i just filled out a bug report for ansible14:07
*** drifterza has joined #openstack-infra14:07
jeblairbut i can't click the submit button14:07
Shrewsthat's a cool feature14:07
*** ihrachys has quit IRC14:08
*** caowei has joined #openstack-infra14:09
mrhillsmanAJaeger replied14:09
*** hamzy has quit IRC14:09
jeblairhere is the text for posterity: http://paste.openstack.org/show/587552/14:09
Shrewsjeblair: btw, ansible 2.2 just released14:09
jeblairit took me 15 minutes to write that14:09
*** ihrachys has joined #openstack-infra14:10
jeblairi'm going to go over to #ansible-devel and hand them the pastebin link, i guess.14:10
clarkbthis affects older ansible I think14:10
clarkbbut good to kow 2.2 is out now14:10
*** Naeil has joined #openstack-infra14:10
jeblairShrews, clarkb: i tested with 2.1 and tip of devel14:10
Shrews*nod*. just spreading the word14:11
clarkbI haev a change I need to clean up which can make use of 2.2 as well so doing thatn ow14:11
mordredjeblair: yah - the 2.2 pprinting of the json is possibly the best new ansible feature14:12
mrhillsmanhey infra team14:12
mrhillsmanneed to pull osic cloud814:12
mrhillsmanhttps://review.openstack.org/#/c/39200614:12
*** mtanino has joined #openstack-infra14:13
clarkbmrhillsman: reviewing now14:13
mrhillsmanhopefully the bump in cloud1 gives us some love in spite of having to pull cloud8 :)14:13
*** caowei has quit IRC14:13
mriedempabelanger: how are you feeling about this now? https://review.openstack.org/#/c/351269/ it just came back on my radar14:13
*** kiran-r has joined #openstack-infra14:14
kairatinfra-team, could you please review https://review.openstack.org/#/c/382971/ ?14:14
mrhillsmanclarkb i am not sure if jobs are running there or what more is needed to ensure we can offline cloud8 without any issues14:14
*** zz_dimtruck is now known as dimtruck14:14
mrhillsmanjust let us know when14:14
*** jordanP has joined #openstack-infra14:15
clarkbmrhillsman: a graceful shutdown is basically that, then wait for grafana to show 0 used instances in that cloud14:15
clarkbmrhillsman: we won't stop jobs on that cloud but they should end up cycling out over the near future and no new ones should be started there14:15
pabelangermriedem: Lets confirm with jeblair cc 35126914:15
mrhillsmanok great, will keep an eye on it14:16
pabelangermrhillsman: clarkb: looks like 8 nodes online right now14:16
mrhillsmancool, no rush, we will leave it be until all things clear14:17
*** jordanP has quit IRC14:17
mrhillsmanthanks for all y'all do :)14:17
mrhillsmangreat presentations at the summit!14:17
jeblairclarkb, mordred, pabelanger, tdurakov: https://github.com/ansible/ansible/issues/1828114:17
clarkbmordred: I have rechecked https://review.openstack.org/#/c/381278/3 which should work now that ansible 2.2.0.0 exists. Would be great to get that in soonish if it does work as it greatly simplifies the multinode logic14:18
openstackgerritMonty Taylor proposed openstack-infra/shade: Add strict mode for trimming out non-API data  https://review.openstack.org/38818414:18
mordredShrews: ^^ fixed your comment and added tests to show it14:18
mordredclarkb: awesome.14:18
openstackgerritMerged openstack-infra/project-config: Disble osic-cloud8  https://review.openstack.org/39200614:18
mordredclarkb: I shall do a little dance when it successes14:19
openstackgerritNoam Angel proposed openstack/diskimage-builder: simplify ARCH param for rhel/centos param can be x86_64 and amd64  https://review.openstack.org/39217614:20
Shrewsmordred: i look forward to being strict14:20
pabelangerjeblair: ack, anybody working on patch?14:20
fungimrhillsman: out of curiosity, is this the first rebuild iteration now that you've collected initial performance data?14:21
jeblairpabelanger: not that i'm aware of14:21
pabelangerjeblair: okay, I can see what is needed14:21
fungimrhillsman: i know you were talking about periodically blowing away and rebuilding this one for tuning14:21
jeblairpabelanger: i'm going to move on to AJaeger's thing from yesterday now14:21
pabelangerack14:21
*** zhurong has quit IRC14:21
mrhillsmanfungi unfortunately we have to remove it entirely at this time14:22
mrhillsmanhence my mention of the bump in resources in cloud1 hopefully easing that pain14:22
fungimrhillsman: oh, that's unfortunate indeed. i guess we should clean up the remaining configuration for it once it's done winding down14:22
mrhillsmanunfortunate indeed for us both :(14:23
mrhillsmanwe have to reallocate the boxes entirely14:23
*** fandi has quit IRC14:24
*** edtubill has joined #openstack-infra14:24
*** Naeil has quit IRC14:25
*** zhurong has joined #openstack-infra14:25
*** caowei has joined #openstack-infra14:25
*** mriedem is now known as mriedem_meeting14:26
cloudnullAJaeger: I'm not 100% sure on why cloud8 needs to be deactivated. mrhillsman and/or raddaoui | inc0 would need to comment on that.14:28
*** esikachev has joined #openstack-infra14:29
*** zhurong has quit IRC14:30
*** e0ne has quit IRC14:30
*** jkilpatr_ has quit IRC14:31
*** mriedem_meeting has quit IRC14:32
*** kiran-r has quit IRC14:33
mrhillsman09:23:57       mrhillsman | we have to reallocate the boxes entirely14:33
*** mriedem has joined #openstack-infra14:33
mrhillsmancloudnull AJaeger ^14:34
*** rbrndt has joined #openstack-infra14:34
*** Naeil has joined #openstack-infra14:37
jeblairmordred: i'm trying to get output from the rsync command in the post playbook14:38
jeblairmorderd: could it be that the new command module is preventing us from seeing stdout/stderr of commands that are run in the pre and post playbooks?  if so, shouldn't they show up in the console log for the job?14:38
jeblairmordred: basically i don't see output in either place....14:38
*** jkilpatr has joined #openstack-infra14:40
cloudnullmrhillsman: sorry, i should've scrolled further down .14:41
*** lykinsbd has joined #openstack-infra14:41
cloudnullwas just reading scrollback.14:41
tdurakovjeblair, thank you14:42
*** e0ne has joined #openstack-infra14:42
mrhillsmanhehe, no worries cloudnull14:43
*** john-dav_ is now known as john-davidge14:43
*** moravec has quit IRC14:43
*** esikachev has quit IRC14:46
jeblairmordred: answering my own questions: a) yes, the zuul command module does prevent us from seeing the stdout/stderr of post playbooks in the ansible log.14:47
*** dave-mccowan has joined #openstack-infra14:48
jeblairmordred: b) the output from pre and post playbooks *does* go to the console log file -- however, it's the console log file *on the zuul launcher* since, of course, those commands are running locally14:48
jeblairmordred: our zuul launchers have large '/tmp/console.html' files on them which are growing without bound14:48
jeblairmordred: so i think we've discovered a couple more problems with this14:49
*** marst has quit IRC14:49
jeblairmordred: i think maybe the solution could be to run pre/post playbooks with a version of the ansible.cfg file *without* the local library modifications.14:49
*** hurgleburgler has joined #openstack-infra14:49
openstackgerritNeil Jerram proposed openstack-infra/project-config: Run Tempest DSVM test as check for all networking-calico patches  https://review.openstack.org/39218414:50
*** kgalanov has quit IRC14:54
mordredjeblair: yes. I think that's a great idea14:55
mordredjeblair: I can make that patch14:55
mordredjeblair: unless you already are14:55
jeblairmordred: i'm most of the way through it, but i just recalled that we were counting on ansible's behavior of using "CWD/ansible.cfg" for the config file14:56
*** yuval has joined #openstack-infra14:56
jeblairmordred: is there a way to specify the config file?14:57
*** marst has joined #openstack-infra14:57
waynrzxiiro: sorry man, i've just been so busy trying to keep from falling behind at $dayjob it's hard to want to have anything more to do at all with jenkins when i'm not at work14:57
*** yuval has left #openstack-infra14:57
jeblairmordred: i guess use ANSIBLE_CONFIG env var?14:57
waynralso, it'd probably be easier to have this discussion over email14:57
*** thcipriani|afk is now known as thcipriani14:58
waynrbecause i have to leave for work now14:58
mordredjeblair: yes. that seems to be the best way14:58
waynrbut i agree, it would be nice to tie off the 2.0 work14:58
waynrand get a release out14:58
*** agordeev has quit IRC14:59
*** amotoki has joined #openstack-infra14:59
*** knangia has joined #openstack-infra14:59
mordredjeblair: we could also make 2 different execution dirs - one for pre/post and one for playbook if the env var becomes unwieldy15:00
zxiirowaynr: electrofelix: sounds reasonable to me. Let's take up any loose ends on the mailing list so that we have tracking.15:00
jeblairmordred: i'd like to avoid that (i think it will be unweildy when debugging), i think the env var will be fine...however...15:00
*** dave-mccowan has quit IRC15:00
jeblairmordred: the pre playbook wants to run zuul_log / zuul_console15:01
jeblairmordred: so it *does* need the library15:01
mordredjeblair: perhaps 2 library dirs, one iwth log/console - one with command - and for playbooks we add both to the library search path and for pre/post we only add the zuul one?15:02
jeblairmordred: yeah, i think maybe we'll have to do that -- since post also wants zuul_log15:02
mordredyah15:02
jeblairi will resume this after breakfast :)15:02
mordredso - the library with zuul_log is the "safe" one since it's just added modules, and the one with command is the one that overrides core behavior15:02
mordredjeblair: I hear breakfast is important15:03
*** EricGonc_ has joined #openstack-infra15:06
*** EricGonczer_ has quit IRC15:07
mrhillsmanclarkb you all have not starting pulling osic-cloud8 entirely right?15:09
openstackgerritIvan Kolodyazhny proposed openstack-infra/project-config: Increase volume group size for cinderclient-dsvm-functional job  https://review.openstack.org/39219215:09
mrhillsmanif max-servers is kept to 0 and no jobs run, if we can leave it like that for now15:09
pabelangerwe'll still try to upload images because of a bug in nodepool15:10
pabelangerI should try to fix that this week15:10
mrhillsmanthat's perfectly ok15:10
mrhillsmanpabelanger images being uploaded are ok, if doing that will keep things updated15:11
*** Julien-zte has joined #openstack-infra15:11
pabelangermrhillsman: cool15:12
pabelangerthen we don't need any other changes right now15:12
mrhillsmangood deal15:12
*** dave-mccowan has joined #openstack-infra15:12
*** doffm_ is now known as doffm15:15
*** ssbarnea has quit IRC15:15
*** ianychoi has joined #openstack-infra15:15
*** dimtruck is now known as zz_dimtruck15:16
*** ssbarnea has joined #openstack-infra15:16
*** zz_dimtruck is now known as dimtruck15:17
*** ramishra has quit IRC15:17
*** yamahata has joined #openstack-infra15:19
*** ramishra has joined #openstack-infra15:19
*** caowei has quit IRC15:20
*** chandankumar has quit IRC15:23
*** armax has joined #openstack-infra15:23
*** Locust has joined #openstack-infra15:26
*** saibarspeis has joined #openstack-infra15:28
*** Julien-zte has quit IRC15:28
*** armax has quit IRC15:28
*** Julien-zte has joined #openstack-infra15:28
*** Julien-zte has quit IRC15:29
*** Julien-zte has joined #openstack-infra15:29
*** Julien-zte has quit IRC15:29
*** nmagnezi has quit IRC15:30
*** Julien-zte has joined #openstack-infra15:30
SotKfrickler: that sounds like a bug (re: storyboard emails), I assume they are only notifying you about things you've subscribed to and not totally random?15:30
*** Julien-zte has quit IRC15:30
*** Julien-zte has joined #openstack-infra15:30
*** Julien-zte has quit IRC15:31
*** Julien-zte has joined #openstack-infra15:31
*** Julien-zte has quit IRC15:32
*** Julien-zte has joined #openstack-infra15:32
*** Julien-zte has quit IRC15:33
*** Julien-zte has joined #openstack-infra15:33
*** Julien-zte has quit IRC15:33
*** Julien-zte has joined #openstack-infra15:34
*** Julien-zte has quit IRC15:34
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Use six.iteritems() for py3  https://review.openstack.org/39220315:35
*** kiran-r has joined #openstack-infra15:35
LocustHello, I have a problem with CI, it looks like it is buned from official gerrit15:35
*** Julien-zte has joined #openstack-infra15:35
*** Julien-zte has quit IRC15:35
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173815:35
Locustwho I should tolk to solve this problem?15:35
clarkbLocust: what is the CI account?15:37
Locusthello can anybody enable open-e-joviandss-ci account?15:43
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add extra debugging for AFS rsync  https://review.openstack.org/39220615:43
openstackgerritJames E. Blair proposed openstack-infra/zuul: Use separate library directories for pre and post  https://review.openstack.org/39220715:43
jeblairclarkb, mordred, pabelanger, AJaeger: ^15:44
AJaegerproject-config cores, could you review https://review.openstack.org/391954 and https://review.openstack.org/391952 for better AFS docs publishing, please?15:44
AJaegerthanks, jeblair !15:44
*** john-davidge has quit IRC15:44
*** pcaruana has joined #openstack-infra15:44
jeblairclarkb, mordred, pabelanger, AJaeger: i think with all 3 of those changes in, we should be ready for a restart15:44
*** adrian_otto has joined #openstack-infra15:45
clarkbjeblair: which is the third?15:46
clarkbLocust: and it will no longer comment on projects that don't want the comments?15:46
jeblairclarkb: mordred's change (it's the parent of my 1st change)15:46
*** Hal has quit IRC15:47
Locustclarkb: yes15:47
openstackgerritZhenguo Niu proposed openstack-infra/project-config: Add nimbleclient to PROJECTS in functional job  https://review.openstack.org/39220815:47
*** esikachev has joined #openstack-infra15:48
AJaegerteam, https://review.openstack.org/#/c/392192/1/jenkins/jobs/cinder.yaml sets DEVSTACK_LOCAL_CONFIG="VOLUME_BACKING_FILE_SIZE=24G" to increase volume size from 10 to 24 G - will that work?15:50
*** Guest14381 has quit IRC15:51
*** sdake has joined #openstack-infra15:52
*** esikachev has quit IRC15:53
*** akshai has quit IRC15:54
clarkbAJaeger: it will probably have a sad time on our 80GB of disk test instances15:54
AJaegerclarkb: that's what I feared ;(15:54
*** mriedem1 has joined #openstack-infra15:54
*** mriedem has quit IRC15:54
clarkbmy suggestion would be to reduce the size of the volumes in functional testing instead of increasing the size of the backend store15:54
* clarkb looks to see if our logs capture disk usage15:54
*** ssbarnea_ has joined #openstack-infra15:54
AJaegerclarkb: thanks. Will you comment on the review?15:55
*** ssbarnea has quit IRC15:55
*** akshai has joined #openstack-infra15:55
clarkbya let me get more numbers btu I can leave a comment15:55
clarkbdoesn't look like dstat captures disk usage15:56
clarkbit does capture reads and writes but not resting usage15:58
clarkboh there is a plugin we can enable to get that data /me starts there15:58
*** annegentle has joined #openstack-infra15:58
AJaegerclarkb: or just hold a node and check?15:58
clarkbAJaeger: ya I can do that too, though my preference is to do it in a way that does not require root :)15:59
*** esikachev has joined #openstack-infra15:59
*** allanice001 has joined #openstack-infra15:59
clarkbAJaeger: https://review.openstack.org/392214 should give us the data16:02
*** Hal has joined #openstack-infra16:04
mordredjeblair: looks excellent16:04
*** hamzy has joined #openstack-infra16:04
openstackgerritJulie Pichon proposed openstack-infra/project-config: Add undercloud job to tripleo-ui and puppet-tripleo  https://review.openstack.org/39221516:04
*** allanice001 has quit IRC16:04
AJaegerclarkb: Yeah, your approach is better. Thanks16:05
*** allanice001 has joined #openstack-infra16:05
openstackgerritMerged openstack-infra/zuul: Add extra debugging for AFS rsync  https://review.openstack.org/39220616:05
*** rcernin has quit IRC16:06
openstackgerritMerged openstack-infra/zuul: Use separate library directories for pre and post  https://review.openstack.org/39220716:06
AJaegerclarkb, mordred, could you review https://review.openstack.org/391954 and https://review.openstack.org/391952 for better AFS docs publishing, please?16:07
*** pcaruana has quit IRC16:07
clarkbLocust: I have enabled the account16:07
*** mriedem1 is now known as mriedem16:08
Locustclarkb: Thank you!16:08
*** peterlisak has quit IRC16:08
*** tdurakov has quit IRC16:09
*** allanice001 has quit IRC16:10
jeblairAJaeger: i wonder if we should look into making some 'docs' builder macros that include the root marker...16:10
*** peterlisak has joined #openstack-infra16:10
jeblairAJaeger: so rather than "npm-run: docs" and "afs-docs-root-marker" its simply "npm-docs" which includes "npm-run: docs" and "afs-docs-root-marker"16:11
*** tdurakov has joined #openstack-infra16:11
*** mdrabe has quit IRC16:12
*** chandankumar has joined #openstack-infra16:13
mordredWARNING:cinderclient.api_versions:Version 1 is deprecated, use alternative version 2 instead.16:13
mordredthat goes into my list of annoying warnings now16:13
*** akshai has quit IRC16:13
AJaegerjeblair: that's just these two job-templates AFAIU, so then I'm not sure it's really beneficial. If you would find a way to change all the afs-docs-root-marker places, I would love it ;)16:13
mordredturns out, as a user, I may not have any power over whether my cloud provides a versoin of the volume api other than 116:14
mordredso warning _me_ about it is just noice16:14
mordrednoise16:14
clarkbmordred: we seem to get a lot of "punish user" for things outside their control16:15
mordredyah16:15
clarkbthe urllib3 insecure certs warning for example16:15
mordredyup16:15
openstackgerritMerged openstack-infra/project-config: Add root-marker for Javascript projects  https://review.openstack.org/39195216:15
clarkbmordred: https://review.openstack.org/#/c/381278/3 works now with multinode too :)16:15
mordred"the remote service that is outside of your control has certs that do not have metadata that we believe they should have! you should hear about it every time you talk to that service, even though as a user you have no control over the situation!!!!"16:16
mordredclarkb: woot!16:16
*** akshai has joined #openstack-infra16:17
AJaegerteam, https://review.openstack.org/391043 adds developer-beta.openstack.org to system-config. Could an infra-root approve and create the DNS entry for that site (not for developer.o.o yet!), please?16:17
*** jaosorior has quit IRC16:17
AJaegerbbl16:18
fungimordred: i wonder if it could try to detect the presence of volume v2 and only warn the user if they're hitting v1 on a provider where v2 is available?16:18
mordredfungi: shade could for sure16:19
clarkbfungi: I think it already does fallback from v2 to v1 (due to how the volume endpoints are listed inteh catalog) so that should be doable16:19
fricklerSotK: ah, thx for the hint. the stories looked random to me at first, but I had in fact (some long time ago) starred the corresponding project. also, once I reload the profile/preferences page, it shows me that I have in fact enabled notification emails. looking at it immediately after login seems to show it off, which got me confused16:19
mordredclarkb: it does not, however, do fallback- if you don't explicitly request v1 on clouds that only have v1, you get a 'no volumev2 endpoint found' error16:19
mordredclarkb: (I know this because it just happened to me)16:20
fungiclarkb: yeah, that's even better. then no need to warn except maybe logging it (at info or even just debug level)16:20
clarkbmordred: ah16:20
smcginnismordred: On the other hand, volumev1 has been deprecated for a _very_ long time, so maybe if a user calls up their provider and asks "what's up with this error" they might finally update. ;)16:21
*** mdrabe has joined #openstack-infra16:21
clarkbsmcginnis: in my experience at least that feedback usually gets ignored. Same thing asking rackspace to update their cert to make urllib3 happy16:22
smcginnisclarkb: True.16:22
fungithough you may get a fanatically supportive suggestion to add 2>/dev/null16:22
clarkbone time I asked for dnssec...16:23
smcginnis:)16:23
fungi"this one time, in a support ticket..."16:24
*** ssbarnea_ has quit IRC16:24
mordredsmcginnis: yah - in this case, the provide is "rackspace" - who one might imagine would be at least aware of the long time deprecation :(16:25
mordredalso - same as what clarkb said with urllib316:25
mordredsmcginnis: last time I checked, over 50% of the public clouds only had volumev1 - that was a few months ago though - so I can run another check a little later today16:26
clarkbI am likely going to disappear after meeting today to vote and pick up groceries. Also jet lag so bad this time around I don't understand it16:26
*** moravec has joined #openstack-infra16:26
*** ssbarnea has joined #openstack-infra16:27
persiaclarkb: Barcelona is positioned on the edge of a timezone, which means the usual timezone adjustment doesn't match the observed solar day well.  You've also just made a DST transition, although you may not have noticed, which compounds the effects.16:28
fungii'm attempting to focus on specs/governance reviews and meeting prep today (and trying to find time to compose summit session summaries), so not expecting to be of much use to anyone otherwise16:28
smcginnismordred: That would be interesting to know.16:28
smcginnismordred: According to the original plan, following deprecation, v1 should have been removed I think in Liberty.16:28
fungipersia: i think usa dst ends next weekend?16:28
fungithough i would not be surprised to discover i'm wrong16:29
clarkbya no dst for us yet. I got on a plane the morning before EU switched16:29
mordredsmcginnis: state of the world currently as of last time I checked is recorded here http://docs.openstack.org/developer/os-client-config/vendor-support.html16:29
persiafungi: Yes, but CEST->CET happened last weekend, during the time many were travelling, which helps confuse jetlag response.16:29
fungiaha16:29
mordredsmcginnis: searching for "Volume API Version is 1" will get you info on what I currently know16:29
clarkbAJaeger: http://logs.openstack.org/14/392214/1/check/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-nv/768938e/logs/screen-dstat.txt.gz the dstat change seems to work, now we just need to get logs from a job more closely related to cinder things16:29
mordredsmcginnis: but this is the reason that I keep arguing with people that while removing support in the _Server_ is fine, removing support in the client libs is ... well, not really a thing that we should actually ever do16:30
mordredregardless of deprecation policy16:30
fungimordred: though at some point it becomes best effort, once the implementation has been ripped from the last supported branch of the service, since we have no way to test interactions other than old mocks16:31
smcginnismordred: Fair point. Not sure how else to get the visibility out there to make sure these providers get pressure to update.16:31
smcginnismordred: Thanks for the link. That helps a lot.16:31
smcginnismordred: Might have to spend a little time dropping some emails to some of these.16:31
mordredsmcginnis: sure nuff! I'll make another pass in a little bit and make sure the list is up to date16:31
clarkbAJaeger: that job doesn't seem to have cinder enabled so its not a great example but does at least show the dstat stuff works16:32
mordredalthough I do not have an account on switch - they tend to submit patches for themselves16:32
*** armax has joined #openstack-infra16:32
clarkbmordred: smcginnis you can always do the "hey according to oscc you don't support volume v2. Insert reasons to support v2 and please update socc if the info is wrong" thing16:33
*** Apoorva has joined #openstack-infra16:34
*** oanson has joined #openstack-infra16:34
*** ssbarnea has quit IRC16:34
smcginnisclarkb: +116:34
*** ssbarnea has joined #openstack-infra16:35
*** HeOS has quit IRC16:37
*** armax has quit IRC16:37
openstackgerritMonty Taylor proposed openstack-infra/shade: Add strict mode for trimming out non-API data  https://review.openstack.org/38818416:37
mordredclarkb: ++16:37
AJaegerclarkb: how much space is free at the end? Otherwise we need to depends-on a dummy change. Perhaps smcginnis can help with figuring this out - smcginnis, see https://review.openstack.org/392192; we wonder whether there's enough space left on our disks.16:39
clarkbAJaeger: on that job there was plenty but it doesn't enable cinder (or many other services), we should wait for the normal job run to see16:39
AJaegerok16:39
*** ssbarnea has quit IRC16:40
*** ssbarnea_ has joined #openstack-infra16:40
SotKfrickler: hm, I'd guess some weird caching led to the box not updating, I'll have a play around to see if I can reproduce it myself16:41
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Switch nova to run neutron grenade multinode jobs  https://review.openstack.org/39223216:42
*** moravec has quit IRC16:42
*** armax has joined #openstack-infra16:43
*** markvoelker has quit IRC16:44
*** rbuzatu has joined #openstack-infra16:44
clarkbAJaeger: http://logs.openstack.org/14/392214/1/check/gate-tempest-dsvm-full-ubuntu-xenial/e1c71ff/logs/screen-dstat.txt.gz based on that our osic nodes have ~31GB free for normal tempest runs16:45
clarkbosic nodes get 92GB of disk iirc16:45
clarkb92 - 80 = 12, 31-12 = 19. So we have roughly 19GB of space there. Bumping the cinder backend to 24GB will need another 14GB which is getting close to 19GB16:46
*** markvoelker has joined #openstack-infra16:46
*** rbuzatu_ has quit IRC16:47
*** ssbarnea_ has quit IRC16:48
*** ssbarnea has joined #openstack-infra16:48
smcginnisclarkb, AJaeger: I need to find out more about why we would need the additional space.16:50
cloudnullclarkb: do you need more storage out of those VMs?16:50
cloudnullbecause I can change the flavor if needed.16:51
clarkbcloudnull: no osic is already bigger than some of our other clouds16:51
fungicloudnull: osic isn't so much the issue. other providers give us less16:51
clarkband we have to play to least common denominator there16:51
cloudnullah. ok. makes sense.16:51
cloudnullwould it be helpful if I lowered the flavor's storage to bring it more inline with others?16:52
clarkbthat might help shake out any corner cases where we do need more than 80GB, but I don't think we need it16:53
clarkb(having more disk is nice as fs performance can degrade as you try to fit stuff into smaller buckets)16:53
*** e0ne has quit IRC16:54
*** Naeil has quit IRC16:54
openstackgerritwes hayutin proposed openstack-infra/project-config: Create tripleo-quickstart-extras project  https://review.openstack.org/39120916:55
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173816:58
*** e0ne has joined #openstack-infra16:59
*** akshai has quit IRC16:59
*** jpich has quit IRC17:01
*** saibarspeis has quit IRC17:02
*** saibarsp_ has joined #openstack-infra17:02
*** sdake_ has joined #openstack-infra17:02
*** e0ne has quit IRC17:03
*** sdake has quit IRC17:04
*** e0ne has joined #openstack-infra17:09
*** harlowja has joined #openstack-infra17:11
*** Pramod has joined #openstack-infra17:16
*** dizquierdo has quit IRC17:16
*** baoli has quit IRC17:17
*** Locust has quit IRC17:18
*** derekh has quit IRC17:18
*** artmr has joined #openstack-infra17:22
*** priteau has joined #openstack-infra17:23
*** edtubill has quit IRC17:24
*** esikachev has quit IRC17:26
*** zz_ja is now known as zz_zz_ja17:27
*** akshai has joined #openstack-infra17:29
openstackgerritChing Sun proposed openstack-infra/project-config: Add Networking SFC Data to Grafana  https://review.openstack.org/38608117:30
*** ralonsoh has joined #openstack-infra17:30
*** e0ne has quit IRC17:34
*** Goneri has joined #openstack-infra17:36
*** rbrndt has quit IRC17:38
openstackgerritgreghaynes proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225317:40
greghaynesclarkb: ^ I think that may work17:40
AJaegersmcginnis: can't you make smaller volumes instead of increasing that value?17:41
clarkbgreghaynes: and busybox is no longer required because we don't do much in that chroot?17:42
greghaynesclarkb: oh, I should add that back to the later install17:43
clarkbalso pep8 failed17:43
greghaynesclarkb: I was going with the thining of 'use debootstrap for as little as possible' because we can hit the same updates issue with any package17:43
clarkbya17:44
smcginnisAJaeger: I need to discuss with Ivan. I'm actually not sure what prompted that patch.17:44
clarkbits most noticeable with kernel beacuse the packages are large, but any package could do that17:44
*** shardy has quit IRC17:44
*** oanson has quit IRC17:48
*** armax has quit IRC17:49
*** sree has joined #openstack-infra17:50
*** moravec has joined #openstack-infra17:50
clarkbgreghaynes: also http://logs.openstack.org/53/392253/1/check/gate-dib-dsvm-functests-ubuntu-trusty/6c33924/console.html#_2016-11-01_17_48_14_35739517:52
*** krtaylor has quit IRC17:52
clarkbgreghaynes: maybe you have to give it --include='' ?17:52
greghaynesclarkb: huh, that must be a change in recent debootstrap, for me it works17:53
greghaynesclarkb: I rm'ed the arg now so we'll see if that works17:53
clarkbthe xenial job is still going which would support that17:53
*** rbuzatu has quit IRC17:53
openstackgerritgreghaynes proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225317:53
*** jtomasek_ has quit IRC17:53
*** akshai has quit IRC17:55
*** sree_ has joined #openstack-infra18:00
*** sree_ is now known as Guest3633218:00
*** ralonsoh has quit IRC18:00
*** sree has quit IRC18:01
*** rbuzatu has joined #openstack-infra18:03
*** rbuzatu has quit IRC18:03
*** nherciu has quit IRC18:04
*** rbuzatu has joined #openstack-infra18:04
*** edtubill has joined #openstack-infra18:04
mordredgreghaynes: ++ to minimize the bits that debootstrap does18:05
*** saibarsp_ has quit IRC18:05
*** sree has joined #openstack-infra18:05
*** Guest36332 has quit IRC18:05
clarkbgreghaynes: http://logs.openstack.org/53/392253/2/check/gate-dib-dsvm-functests-ubuntu-trusty/828d08c/console.html#_2016-11-01_18_02_03_930966 looks lioke now you have to reorder some things to make sure that python is available first :)18:05
*** TomazVieira has joined #openstack-infra18:05
*** ssbarnea has quit IRC18:06
*** saibarspeis has joined #openstack-infra18:06
openstackgerritgreghaynes proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225318:07
*** rbuzatu_ has joined #openstack-infra18:07
*** rbuzatu_ has quit IRC18:08
*** sdake has joined #openstack-infra18:08
*** Jeffrey4l has quit IRC18:08
*** rbuzatu_ has joined #openstack-infra18:08
*** rbuzatu has quit IRC18:09
*** lucasagomes is now known as lucas-afk18:09
*** ssbarnea has joined #openstack-infra18:10
*** sdake_ has quit IRC18:11
openstackgerritwes hayutin proposed openstack-infra/project-config: use zuul-git-prep for tripleo-quickstart builder  https://review.openstack.org/39226118:11
*** ssbarnea has quit IRC18:11
*** dtantsur is now known as dtantsur|afk18:13
*** ssbarnea has joined #openstack-infra18:13
*** ssbarnea has quit IRC18:14
*** akshai has joined #openstack-infra18:15
AJaegerIs there any project-config core that could review https://review.openstack.org/391954 to enhance the AFS root-marker for docs publishing, please?18:18
*** ssbarnea has joined #openstack-infra18:20
AJaegerthanks, pleia2 !18:21
pleia2I'm not really here! ;)18:21
*** moravec has quit IRC18:22
*** ihrachys has quit IRC18:23
*** baoli has joined #openstack-infra18:23
clarkbgreghaynes: http://logs.openstack.org/53/392253/3/check/gate-dib-dsvm-functests-ubuntu-trusty/e0f0302/console.html#_2016-11-01_18_15_17_848615 looks closer but its not finding the package repos?18:24
*** abregman_ has quit IRC18:24
*** baoli_ has joined #openstack-infra18:24
openstackgerritMerged openstack-infra/project-config: Add ZUUL_NEWREV to root-marker  https://review.openstack.org/39195418:25
*** mriedem has quit IRC18:26
*** mriedem has joined #openstack-infra18:26
*** moravec has joined #openstack-infra18:26
*** Daisy has joined #openstack-infra18:27
clarkbI don't see anything initially wrong with the script though18:27
fungipleia2: you could certainly do a better job of not being here18:27
clarkbyou've just shifted it to running outside of the chroot so there are explicit path and chroots into the chroot18:27
openstackgerritMerged openstack-infra/project-config: Remove Cinder GlusterFS volume driver jobs  https://review.openstack.org/37705918:28
fungizaro: did you want to put 388190 (Gerrit upgrade) up for a formal council vote this week?18:29
*** baoli has quit IRC18:29
*** baoli_ has quit IRC18:29
mgagnefungi: My ex-boss told me you asked about me at the summit. Sorry, I wasn't present (for reasons outside my control) =)18:29
fungimgagne: yep, sorry we couldn't hang out! hope everything is okay on your end18:30
mgagnemuch better now I would say ;)18:31
mgagnelet me know if I can do anything18:31
*** Daisy has quit IRC18:31
*** rbrndt has joined #openstack-infra18:31
fungimgagne: will do. we're always happy to have your help18:31
clarkbgreghaynes: reading that job's console log valid source listings seem to make it in there18:31
fungijeblair: are you ready to put 386281 (Zuul v3: Add section on secrets) up for council vote this week? were your inline comments supposed to include a workflow -1 or were those to inform a follow-on patch?18:33
fungis/patch/change/18:33
*** adam_g has joined #openstack-infra18:34
greghaynesclarkb: hrmmmm18:34
greghaynesclarkb: yea I think I need to poke at debian-minimal locally18:34
*** baoli has joined #openstack-infra18:35
*** sambetts is now known as sambetts|afk18:35
mordredgreghaynes: not important - but I think you may have mistyped elements/dpkg/root.d/50-trip-dpkg (should be elements/dpkg/root.d/50-trim-dpkg)18:36
greghaynesmordred: aha, yep18:36
electrofelixwonder if anyone is happy to comment on some reviews I've had for git-review https://review.openstack.org/312885 & https://review.openstack.org/31205618:37
*** Daisy has joined #openstack-infra18:38
electrofelixwaynr: when you get a chance for JJB wonder if you might review https://review.openstack.org/63580 I know it's not required for V2.0, but it has been hanging around for quite some time ...18:38
*** rbuzatu has joined #openstack-infra18:38
electrofelixbe nice to avoid the 3 year anniversary for that change18:39
*** rbuzatu_ has quit IRC18:41
*** Daisy has quit IRC18:42
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add ability to tune neutron configuration in rally job  https://review.openstack.org/39226718:42
clarkbgreghaynes: do you maybe need to have a conf file that includes all of the things in that .d/ dir?18:42
clarkbgreghaynes: guessing that earlier setup process laid all of that down on the fs but now its more minimal and maybe doesnt? (don't have a debuntu handy to check really quickyl though)18:43
*** ssbarnea has quit IRC18:43
*** ssbarnea has joined #openstack-infra18:45
*** armax has joined #openstack-infra18:47
Zarayay, just saw boartty patch! (on holiday this week, so just popping in) am excited for that, thanks! :)18:47
*** armax has quit IRC18:47
Zara(jeblair^)18:47
*** Rockyg has joined #openstack-infra18:49
*** ssbarnea_ has joined #openstack-infra18:49
*** krtaylor has joined #openstack-infra18:49
*** ssbarnea has quit IRC18:52
*** sree has quit IRC18:52
*** rbuzatu has quit IRC18:53
*** sree has joined #openstack-infra18:54
*** annegentle has quit IRC18:54
*** annegentle has joined #openstack-infra18:55
jheskethMorning18:57
*** adrian_otto has quit IRC18:58
*** sree has quit IRC18:58
*** chandankumar has quit IRC19:00
*** moravec has quit IRC19:00
AJaegermorning, jhesketh !19:00
AJaegerfungi, is now the infra team meeting?19:01
fungibah!19:01
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:01
* AJaeger was confused with DST change ;)19:02
openstackgerritMerged openstack-infra/tripleo-ci: Undercloud upgrade for mitaka and newton  https://review.openstack.org/38128619:02
fungii was just confused because i get sidetracked and live in a constant state of confusion19:02
fungii have no actual excuse19:02
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: remove openstack/common reference from flake8  https://review.openstack.org/39228119:04
*** Daisy has joined #openstack-infra19:05
*** aneliubin has quit IRC19:06
*** Goneri has quit IRC19:06
*** mriedem has quit IRC19:07
*** electrofelix has quit IRC19:07
*** moravec has joined #openstack-infra19:08
*** esikachev has joined #openstack-infra19:09
*** strigazi is now known as strigazi_AFK19:09
*** artmr has quit IRC19:09
*** Daisy has quit IRC19:09
*** ociuhandu has quit IRC19:10
*** dave-mccowan has quit IRC19:11
*** ssbarnea has joined #openstack-infra19:14
*** ssbarnea has quit IRC19:15
*** ssbarnea_ has quit IRC19:18
harlowjaqq, http://status.openstack.org/openstack-health/#/?groupKey=build_name&resolutionKey=hour&searchProject=-with-oslo maybe dead? sorta just spins there forever :-P19:18
harlowjaif someone gets some time to look at :)19:19
harlowja' Unable to load this page! An API error occurred. ' is what happens after some time19:19
*** Pramod has quit IRC19:20
*** armax has joined #openstack-infra19:22
*** moravec has quit IRC19:22
*** bnemec has joined #openstack-infra19:28
*** mriedem has joined #openstack-infra19:28
jeblairfungi: i should have wip'd it.  i claim summit exhaustion.  i will update all the zuul specs patches this week in prep for opening voting next week.19:28
* SotK grumbles about DST19:28
fungijeblair: no worries, i figured it was something like that!19:28
*** dave-mccowan has joined #openstack-infra19:31
*** ociuhandu has joined #openstack-infra19:32
*** kiran-r has quit IRC19:37
*** mriedem has quit IRC19:38
*** mtreinish has quit IRC19:40
*** rcernin has joined #openstack-infra19:41
*** mriedem has joined #openstack-infra19:43
AJaegerarmax: regarding https://review.openstack.org/392168: First project-config needs to merge, than requirements.19:43
armaxah19:43
armaxok19:43
*** mtreinish has joined #openstack-infra19:43
armaxit seems backward but ok19:44
*** saibarspeis has quit IRC19:44
AJaegerarmax: that's how the requirements team insists on - that way they can verify that the job runs.19:44
*** saibarspeis has joined #openstack-infra19:44
armaxsure I don’t mind either way19:45
AJaegerarmax: could you review https://review.openstack.org/#/c/389723/ and https://review.openstack.org/#/c/385208/ as well, please?19:45
armaxI just pointed out that I didn’t see the other patch and I wanted to make neil aware19:45
armaxAJaeger: they are on my stack19:45
AJaegerarmax: hope https://review.openstack.org/#/c/377299/ is on your stack as well ;)19:46
AJaegerarmax: Yeah, that other change should come indeed.19:46
armaxAJaeger: I can only review so fast19:46
*** bin_ has quit IRC19:47
*** baoli has quit IRC19:47
*** baoli_ has joined #openstack-infra19:47
AJaegerarmax: I know - just wanted to point out those that have already two +2s and are waiting... You've pushed your team to do a lot of work. Great to have this consistency but many have to catch up...19:47
armaxAJaeger: btw, I think njohnston kindly volunteered to provide oversight on these patches19:47
armaxAJaeger: you should consider him a liasion as much as any other neutron little helper19:48
AJaegerarmax: could you add him to https://wiki.openstack.org/wiki/CrossProjectLiaisons#Infra , please?19:48
armaxAJaeger: yes, it’s on my stack :)19:48
AJaegerarmax: happy to have his help!19:48
AJaegerarmax: ;)19:48
AJaegerarmax: thanks19:49
armaxAJaeger: sure thing19:49
AJaegerarmax: I know, last week was busy and you're starting to catch up;)19:49
armaxAJaeger: I am always behind19:49
armaxconstantly19:49
armaxAJaeger: btw it looks we also capture the infra liasion here: http://docs.openstack.org/developer/neutron/policies/neutron-teams.html#core-review-hierarchy19:50
armaxthat doc needs a refresh anyhoo19:50
AJaegerJust add a link from there to the wiki ;)19:51
*** baoli has joined #openstack-infra19:51
*** baoli_ has quit IRC19:52
openstackgerritgreghaynes proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225319:54
greghaynesclarkb: ^ was a silly bug19:54
clarkboh ha19:54
*** Goneri has joined #openstack-infra19:57
*** moravec has joined #openstack-infra19:57
*** eharney_ has joined #openstack-infra19:58
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Disable translation/doc publishing for projects formerly in neutron group  https://review.openstack.org/39201219:58
*** mmedvede has quit IRC19:58
AJaegerzigo: the debian design etherpads are not listed at https://wiki.openstack.org/wiki/Design_Summit/Ocata/Etherpads . Could you add them, please?19:58
openstackgerritgreghaynes proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225320:00
*** adrian_otto has joined #openstack-infra20:00
openstackgerritgreghaynes proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225320:00
*** eharney has quit IRC20:00
*** rfolco has quit IRC20:01
AJaegerteam, this hack in project-config is not needed anymore for release note translation https://review.openstack.org/386106 - could I get a second review, please?20:02
*** drifterza has quit IRC20:02
bkerojeblair: re: the bot refactor. It needs some testing, but the concept should be usable for us.20:03
AJaegerbkero: it doesn't pass the testsuite ;(20:03
*** psilvad has quit IRC20:04
bkeroAJaeger: yeah, I think there was a parameter misnaming, nick/name.20:04
*** baoli has quit IRC20:04
AJaegerbkero: could you update and fix it, please?20:04
*** baoli has joined #openstack-infra20:05
bkeroAJaeger: I can, although it's going to require a manual cutover since I didn't ensure => absent for the old style of config files.20:05
*** hashar has joined #openstack-infra20:05
AJaegerbkero: best to figure this out with some of the puppet experts here - please discuss how to do this properly.20:06
*** florianf has quit IRC20:06
clarkbgreghaynes: pep8 is still failing on that change20:07
*** kiran-r has joined #openstack-infra20:07
greghaynesderp20:07
greghaynesoh its just pointing out the gun I aimed at my food20:07
openstackgerritMerged openstack-infra/project-config: grafana: Add periodic-networking-midonet-python27-newton  https://review.openstack.org/37729920:08
greghaynesfoot, rather20:08
mtreinishgreghaynes: heh, I just assumed you were hunting20:08
AJaegerteam, pabelanger has a change up to remove obsolete nodepool scripts from project-config - I don't agree with the -1 given there. Would appreciate some more reviews on this, please: https://review.openstack.org/33149420:09
greghaynesmtreinish: thats just how we do things over here in Oregon20:09
*** mriedem has quit IRC20:12
*** dprince has quit IRC20:12
openstackgerritNoam Angel proposed openstack/diskimage-builder: add element cloud-init-allow-password-authentication  https://review.openstack.org/39176520:13
*** mriedem has joined #openstack-infra20:13
pabelangerinfra-root: EOD for me, post conference cold is doing me in. Will update for tomorrow if I continue to be offline20:15
AJaegerpabelanger: is https://review.openstack.org/337821 still on your stack of things to do?20:15
AJaegerpabelanger: Get well soon! And ignore 337821 for now.20:15
pabelangerAJaeger: it is, I think we can loop back to it end of week20:15
fungithanks for the heads up pabelanger. wishing you a speedy recovery (for completely selfish reasons!)20:15
openstackgerritNoam Angel proposed openstack/diskimage-builder: add support for ubuntu and InfiniBand indhcp-all-interfaces  https://review.openstack.org/39177220:18
pleia2pabelanger: ugh, feel better, I'm in the same boat (was hoping it was just in-an-airplane sniffles, but I'm quite unwell today)20:18
AJaegerpleia2: hope you get well soon!20:18
bkeroAs am I. Con funk. :(20:19
openstackgerritNoam Angel proposed openstack/diskimage-builder: add support for SUSE in dhcp-all-interfaces  https://review.openstack.org/39177220:19
*** gouthamr has quit IRC20:19
*** baoli has quit IRC20:20
*** moravec has quit IRC20:20
openstackgerritgreghaynes proposed openstack/diskimage-builder: Perform package install outside of debootstrap  https://review.openstack.org/39225320:21
*** baoli has joined #openstack-infra20:21
*** rbuzatu has joined #openstack-infra20:21
*** rbuzatu has quit IRC20:21
*** rbuzatu has joined #openstack-infra20:22
*** yamahata has quit IRC20:22
AJaegermordred: is https://review.openstack.org/315632 still needed - or do you want to abandon it?20:23
openstackgerritNoam Angel proposed openstack/diskimage-builder: simplify ARCH param for rhel/centos param can be x86_64 and amd64  https://review.openstack.org/39217620:23
mordredAJaeger: I think we're fine20:23
*** kgiusti has left #openstack-infra20:23
AJaegerthanks, mordred . What about https://review.openstack.org/#/c/166547/ ?20:24
*** rbuzatu has quit IRC20:26
*** askb has joined #openstack-infra20:27
*** rtheis has quit IRC20:29
*** baoli has quit IRC20:30
*** baoli_ has joined #openstack-infra20:30
openstackgerritNoam Angel proposed openstack/diskimage-builder: simplify ARCH param for rhel/centos param can be x86_64 and amd64  https://review.openstack.org/39217620:34
*** priteau has quit IRC20:34
*** YorikSar has joined #openstack-infra20:34
openstackgerritBen Kero proposed openstack-infra/puppet-gerritbot: Refactor bot into defined types to allow multiple bots  https://review.openstack.org/35558820:35
openstackgerritNoam Angel proposed openstack/diskimage-builder: redhat-common add option to select networking service NetworkManager/network  https://review.openstack.org/39217020:35
bkeroAJaeger: ^20:35
*** priteau has joined #openstack-infra20:35
AJaegerthanks, bkero !20:36
YorikSarAJaeger: Hello. Please revisit change https://review.openstack.org/39216920:36
bkeroAJaeger: Instead of making a dep on system-config for change I added the parameter and had it throw a warning that it's a noop, and what to do instead.20:36
YorikSarAJaeger: I think your points are valid, but not in this case.20:37
YorikSarAJaeger: (or I don't get smth)20:37
AJaegerbkero: ok - I'm not a puppet expert, let's see what others think20:38
bkeroAJaeger: bonus points if you can poke them :)20:38
*** baoli has joined #openstack-infra20:39
*** priteau has quit IRC20:39
AJaegerYorikSar: I commented again. Please read. I don't see a reason to change my -1. What are you not getting?20:39
AJaegerbkero: http://logs.openstack.org/88/355588/4/check/gate-infra-puppet-apply-ubuntu-trusty/1e9512b/ fails20:40
*** rhallisey has quit IRC20:40
AJaegerbkero: once it passes tests, please ask here for review - I think jeblair is interested to see it land20:40
*** baoli_ has quit IRC20:40
*** jkilpatr has quit IRC20:41
YorikSarAJaeger: About voting, I've set them to "voting: false" below in layout.yaml... Isn't that enough?20:42
AJaegerYorikSar: let me double check...20:42
YorikSarAJaeger: For job part I don't quite get. If I don't add this job to any project, it won't get created, right?20:42
*** r1chardj0n3s_afk is now known as r1chardj0n3s20:43
AJaegerYorikSar: I missed that voting false - commenting20:43
*** baoli has quit IRC20:43
AJaegerYorikSar: A job-template needs instantiation and thus adding to projects.yaml. A pure job not. You define a job.20:43
YorikSarAJaeger: Ah, got it! Thanks.20:44
*** adriant has joined #openstack-infra20:45
*** ldnunes has quit IRC20:46
openstackgerritBen Kero proposed openstack-infra/puppet-gerritbot: Refactor bot into defined types to allow multiple bots  https://review.openstack.org/35558820:47
openstackgerritYuriy Taraday proposed openstack-infra/project-config: Add cross-repo job for fuel-ccp* projects  https://review.openstack.org/39216920:47
openstackgerritYuriy Taraday proposed openstack-infra/project-config: Add cross-repo job for fuel-ccp* projects  https://review.openstack.org/39216920:47
YorikSarAJaeger: Fixed both of your comments ^20:48
AJaegerYorikSar: thanks. will review later this week as time permits20:49
* AJaeger waves good night20:49
YorikSarAJaeger: Thanks a lot, good night!20:49
*** esikachev has quit IRC20:50
*** csmart has quit IRC20:51
*** csmart has joined #openstack-infra20:51
*** baoli has joined #openstack-infra20:53
openstackgerritBen Kero proposed openstack-infra/puppet-gerritbot: Refactor bot into defined types to allow multiple bots  https://review.openstack.org/35558820:53
*** dfflanders has joined #openstack-infra20:54
*** baoli_ has joined #openstack-infra20:54
*** e0ne has joined #openstack-infra20:55
*** rbrndt has quit IRC20:57
*** baoli has quit IRC20:58
*** priteau has joined #openstack-infra20:59
openstackgerritBen Swartzlander proposed openstack-infra/project-config: Add manila-test-image project  https://review.openstack.org/39230721:01
ianwpabelanger: hmm, today's centos failure is a new one on me -> http://nodepool.openstack.org/dib.centos-7.log ... maybe just mirror download issues, but odd21:02
*** mmedvede has joined #openstack-infra21:03
openstackgerritBen Kero proposed openstack-infra/puppet-gerritbot: Refactor bot into defined types to allow multiple bots  https://review.openstack.org/35558821:03
*** annegentle has quit IRC21:06
*** edtubill has quit IRC21:07
bkeroAJaeger: Yay, passed tests now.21:08
*** kiran-r has quit IRC21:09
*** fguillot has quit IRC21:09
*** matrohon has joined #openstack-infra21:11
*** Goneri has quit IRC21:14
*** Rockyg has quit IRC21:14
*** ihrachys has joined #openstack-infra21:14
*** thorst has quit IRC21:16
*** rbuzatu has joined #openstack-infra21:23
*** e0ne_ has joined #openstack-infra21:25
greghaynesclarkb: ianw woo much CI passage https://review.openstack.org/#/c/392253/21:25
greghaynesitd be nice to confirm but I think thatl save a few hundred megs per image for infra21:25
clarkbhow small of an image does it make?21:25
* greghaynes runs a build21:26
clarkbI think we were up to almost 500mb for just old ubuntu-minimal + simple-init + vm21:26
greghaynes500mb raw or qcow2?21:26
clarkbqcow221:26
clarkb2GB ish for raw21:26
*** e0ne has quit IRC21:27
clarkbya my test glean qcow2s were ~550MB21:27
*** sdake has quit IRC21:27
clarkb2.4GB virtual size21:27
*** abregman has joined #openstack-infra21:29
*** annegentle has joined #openstack-infra21:31
greghaynesclarkb: 272M    image.qcow221:31
greghaynesclarkb: for ubuntu-minimal vm simple-init21:31
greghaynesso ~230M21:32
*** e0ne_ has quit IRC21:34
greghaynesoh, 550M you said, so 280M21:34
*** jheroux has quit IRC21:35
*** adrian_otto has quit IRC21:36
*** krtaylor has quit IRC21:37
clarkbwell 550M on the test glean images I had which may have a little more21:37
clarkbbut ya sounds pretty significant21:37
clarkb~2x21:37
greghaynesthat about lines up with what I expected, actually21:37
*** maratoid_ has joined #openstack-infra21:38
*** maratoid_ has quit IRC21:40
*** maratoid_ has joined #openstack-infra21:41
*** isq has joined #openstack-infra21:41
*** thorst has joined #openstack-infra21:43
*** dimtruck is now known as zz_dimtruck21:44
*** zz_dimtruck is now known as dimtruck21:45
mordredgreghaynes: wow - we trimmed 250M just with the changes to install packages out of debootstrap?21:46
mordredgreghaynes: that's AWESOME21:46
*** rbuzatu has quit IRC21:46
*** eharney_ has quit IRC21:47
*** thorst has quit IRC21:47
*** kaisers has quit IRC21:48
*** PsionTheory has joined #openstack-infra21:48
*** abregman has quit IRC21:49
*** kaisers has joined #openstack-infra21:50
greghaynesyep! we were installing a ton of extra kernel modules that debootstrap was pulling in (becuase you cant opt out of recommends) * 2 kernel versions21:51
cloudnullthat is awesome !21:51
*** jcoufal has quit IRC21:52
*** mdrabe has quit IRC21:53
*** Rockyg has joined #openstack-infra21:54
*** camunoz has joined #openstack-infra21:54
*** aviau has quit IRC21:55
*** aviau has joined #openstack-infra21:55
*** jkilpatr has joined #openstack-infra21:55
mordredgreghaynes: I love it when additional sanity also brings real value21:55
openstackgerritJames E. Blair proposed openstack/gertty: Handle ReadTimeout  https://review.openstack.org/39232221:56
*** xyang1 has quit IRC21:57
*** Daisy has joined #openstack-infra21:58
*** Douhet has quit IRC22:00
*** annegentle has quit IRC22:00
*** Douhet has joined #openstack-infra22:01
*** matrohon has quit IRC22:01
*** Daisy has quit IRC22:03
*** annegentle has joined #openstack-infra22:03
*** PsionTheory has quit IRC22:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Add strict mode for trimming out non-API data  https://review.openstack.org/38818422:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Add unit tests for image and flavor normalization  https://review.openstack.org/39232322:04
openstackgerritMonty Taylor proposed openstack-infra/shade: Depend on normalization in list_flavors  https://review.openstack.org/39232422:04
*** tpsilva has quit IRC22:04
mordredShrews: ^^ ok - it turns out that's how far down the rabbit hole I had to go to adequately respond to your review22:05
mordredShrews: thank you - it was clearly an excellent question22:05
*** akshai has quit IRC22:05
*** hrubi has quit IRC22:05
*** priteau has quit IRC22:06
*** marst has quit IRC22:10
*** hrubi has joined #openstack-infra22:10
*** gildub has joined #openstack-infra22:13
*** mriedem is now known as mriedem_away22:13
*** gordc has quit IRC22:18
openstackgerritMerged openstack/diskimage-builder: elements: simple-init: Remove SUSE interfaces  https://review.openstack.org/38815822:20
*** annegentle has quit IRC22:24
*** edmondsw has quit IRC22:24
*** baoli_ has quit IRC22:24
*** baoli has joined #openstack-infra22:25
*** mriedem_away has quit IRC22:27
*** ihrachys has quit IRC22:28
*** rcernin has quit IRC22:31
*** yamahata has joined #openstack-infra22:32
*** baoli has quit IRC22:33
*** baoli has joined #openstack-infra22:33
*** jkilpatr has quit IRC22:40
*** jkilpatr has joined #openstack-infra22:40
*** Rockyg has quit IRC22:42
ianwclarkb: hmmm, maybe you can't restrict the filesystems it monitors.  that sort of sucks22:45
*** hashar has quit IRC22:45
ianwalso, why aren't trusty jobs running against devstack?22:47
*** aeng has quit IRC22:49
*** panda|pto|PH is now known as panda|Zz22:51
*** EricGonc_ has quit IRC22:51
*** baoli_ has joined #openstack-infra22:53
ianwahh, i thought we had more trusty on master, all good22:53
*** EricGonczer_ has joined #openstack-infra22:54
*** baoli has quit IRC22:56
*** baoli has joined #openstack-infra23:01
*** baoli_ has quit IRC23:01
*** aeng has joined #openstack-infra23:01
*** thorst has joined #openstack-infra23:03
*** lykinsbd has quit IRC23:06
*** baoli has quit IRC23:07
*** cody-somerville has quit IRC23:08
*** mriedem has joined #openstack-infra23:11
*** rbuzatu has joined #openstack-infra23:13
*** rbuzatu has quit IRC23:23
ianwtfw you wish you rather never looked at code that is now going to annoy the heck out of you...23:23
*** aeng has quit IRC23:25
*** kiran-r has joined #openstack-infra23:34
*** yuanying has joined #openstack-infra23:37
*** aeng has joined #openstack-infra23:38
*** gouthamr has joined #openstack-infra23:46
*** thcipriani is now known as thcipriani|afk23:53
*** dingyichen has joined #openstack-infra23:53
mordredianw: oh. yah. tf for sure23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!