Tuesday, 2016-04-12

*** Swami has quit IRC00:02
EmilienMpabelanger: just for the record, libfactor not found on centos7/dib images http://logs.openstack.org/57/296557/35/experimental/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/48f4aa7/console.html#_2016-04-11_23_09_41_03900:02
*** jamesmcarthur has joined #openstack-infra00:04
clarkbEmilienM: is that a puppet 4 thing? we dn't use puppet 4 on centos so that isn't surprising00:04
EmilienMclarkb: yes it is puppet4 stuff00:05
clarkbEmilienM: then you probably need to install it as part of your job00:05
EmilienMclarkb: ok!00:06
clarkb(maybe that means there is a broken dep somewhere in the packages?)00:06
clarkbeg facter should depend on libfacter or someting00:06
EmilienMI haven't investigated at all yet but I'll tomorrow00:06
EmilienMand let you know what I did00:06
EmilienM_ody: did you have thoughts on that?00:06
*** fawadkhaliq has quit IRC00:07
*** fawadkhaliq has joined #openstack-infra00:08
tonybjlvillal: I saw that I'll get that merged today00:08
tonybjlvillal: I have to page in the context00:08
jlvillaltonyb: Thanks :)00:08
*** mixos has quit IRC00:11
_odyIt is one package. There is nothing but puppet-agent that provides libfacter.00:12
_odyThat last puppet-agent release was March 24th and the job stopped work on April 5th.00:13
clarkbmaybe old job was using stale puppet3 install?00:19
_odyclarkb: Can I get access to a nodepool instance or the image that deployed? I'd like to just hammer out why it broke so I can get it off my brain.00:19
*** gyee has quit IRC00:20
clarkbqcow2 work?00:20
clarkbI don't see a libfacter in the puppet-agent pacakge fwiw00:21
*** jamesmcarthur has quit IRC00:22
*** _amrith_ is now known as amrith00:22
clarkb_ody: http://nodepool.openstack.org/centos-7.qcow2 sha1sum in a moment00:23
*** x00350071 has quit IRC00:23
clarkb_ody: 68c0bdcd6b6f282994584e8f674b96b29a8cc5d4  centos-7.qcow200:23
*** x00350071 has joined #openstack-infra00:24
_odythanks, downloading00:24
*** sridhar_ram has quit IRC00:24
*** sridhar_ram has joined #openstack-infra00:26
*** sridhar_ram has quit IRC00:26
*** mtanino_ has joined #openstack-infra00:26
*** mtanino has quit IRC00:27
*** BobBall_ has joined #openstack-infra00:27
*** BobBall_ is now known as Guest2907400:27
*** fawadkhaliq has quit IRC00:28
*** jcooley has quit IRC00:29
*** fawadkhaliq has joined #openstack-infra00:29
*** BobBall has quit IRC00:30
*** jamesmcarthur has joined #openstack-infra00:33
*** markvoelker has joined #openstack-infra00:35
openstackgerritMerged openstack-infra/infra-ansible: Reworked setup_env.sh to support Debian & Darwin/OSX  https://review.openstack.org/29165800:35
*** keedya has quit IRC00:37
*** Qiming has quit IRC00:38
*** ddutta has quit IRC00:38
clarkb_ody: that image should use config drive to write ssh authorized keys for the root user00:39
clarkbor you can edit it directly if yo uwant to just force your key in00:39
*** jamesmcarthur has quit IRC00:39
*** fawadkhaliq has quit IRC00:40
*** apoorvad has quit IRC00:40
*** jamesmcarthur has joined #openstack-infra00:40
*** markvoelker has quit IRC00:41
*** xarses has joined #openstack-infra00:44
*** FallenPegasus has joined #openstack-infra00:46
openstackgerritMerged openstack-infra/puppet-elasticsearch: Make total_shards_per_node configurable  https://review.openstack.org/29190100:47
*** baoli has joined #openstack-infra00:48
openstackgerritMerged openstack-infra/puppet-grafyaml: Order of the class parameters is refactored  https://review.openstack.org/29514300:49
*** zhurong has joined #openstack-infra00:53
*** jamesmcarthur has quit IRC00:54
*** baoli has quit IRC00:54
*** tiswanso has joined #openstack-infra00:54
*** amrith is now known as _amrith_00:55
*** rockyg has quit IRC00:55
*** _amrith_ is now known as amrith00:57
_odyclarkb: nodepool image user name?00:58
clarkb_ody: if you use config drive root00:58
clarkbit will setup root ssh keys with glean iirc00:59
_odyhmm.  Ok.00:59
_odyActually the first time I used configdrive in our environment.  I'll just have to hack on it a bit.01:00
clarkbyou can also mount it and add an arbitrary user01:00
clarkbthen boot the updated image01:00
clarkb_ody: fwiw config drive is much preferable to meta data server in our experience (as long as you don't need live migration because you can't live migrate if booted with config drive)01:00
clarkbit is far more reliable01:00
*** tiswanso has quit IRC01:02
*** sdake_ has joined #openstack-infra01:02
*** tiswanso has joined #openstack-infra01:02
*** sdake has quit IRC01:02
*** ddieterly has joined #openstack-infra01:03
*** zhurong has quit IRC01:03
openstackgerritRyota MIBU proposed openstack-infra/project-config: [telemetry] enable ceilo/aodh tempest plugin tests  https://review.openstack.org/30392101:06
*** zhurong has joined #openstack-infra01:08
*** sdake_ is now known as sdake01:08
*** pvaneck has quit IRC01:09
*** akshai has joined #openstack-infra01:09
*** akshai_ has joined #openstack-infra01:10
*** bpokorny has quit IRC01:12
*** shashank_hegde has quit IRC01:12
*** akshai has quit IRC01:14
*** flwang1 has joined #openstack-infra01:16
*** thorst has quit IRC01:16
flwang1AJaeger: hi there  would you mind revisiting this https://review.openstack.org/#/c/302487/ ?01:16
*** sridhar_ram has joined #openstack-infra01:16
*** thorst has joined #openstack-infra01:17
*** zz_dimtruck is now known as dimtruck01:17
*** sridhar_ram1 has joined #openstack-infra01:17
*** tphummel has quit IRC01:18
*** nadya has joined #openstack-infra01:20
*** sridhar_ram has quit IRC01:21
*** jamesmcarthur has joined #openstack-infra01:22
*** kzaitsev_mb has quit IRC01:24
openstackgerritMerged openstack-infra/puppet-kibana: Order of the classes parameters is refactored  https://review.openstack.org/29517401:24
*** Jeffrey4l__ has joined #openstack-infra01:24
*** thorst has quit IRC01:25
*** tphummel has joined #openstack-infra01:26
*** nadya has quit IRC01:26
*** jamesmcarthur has quit IRC01:27
*** jamesmcarthur has joined #openstack-infra01:32
openstackgerritIan Wienand proposed openstack-infra/glean: [WIP] Add selinux context manager for writing files  https://review.openstack.org/30435701:33
*** Qiming has joined #openstack-infra01:34
clarkb_ody: any luck?01:34
*** baoli has joined #openstack-infra01:34
*** jamesmcarthur has quit IRC01:36
prometheanfireianw: that's good because we might be able to generate stage4 selinux images soon for consumption in dib01:36
ianwprometheanfire: what's "stage4"?01:38
prometheanfireit's gentoo parlance for a semi-configured tarball01:40
prometheanfireall that dib needs to do is finish configuring and make it bootable01:40
*** jamesmcarthur has joined #openstack-infra01:40
prometheanfirestage3 is unconfigured system tarball, 1/2 are unused in the general public but we use them for system bootstraping01:41
kevinbentonttx: hey, can you lift your -1 on https://review.openstack.org/#/c/299023/ ?01:43
openstackgerritMerged openstack/requirements: Update to os-brick 1.3.0  https://review.openstack.org/30278601:45
*** woodster_ has quit IRC01:47
*** jamesmcarthur has quit IRC01:47
ianwprometheanfire: ok; i'm not sure i like wrapping like this, but i'm not sure i see any other possibilities.  building some test images with it now01:47
*** mylu has quit IRC01:47
*** mylu has joined #openstack-infra01:49
openstackgerritMerged openstack-infra/puppet-infracloud: Fix apache failure  https://review.openstack.org/28876301:49
prometheanfireianw: ya, programatic access in selinux without custom policies can be 'fun'01:51
prometheanfirealso, having the binary doesn't mean selinux is enabled01:51
ianwyeah, but i think it doesn't hurt to run restorecon on it anyway01:52
ianwat least i tried with it disabled and it still returned 001:52
prometheanfirethat might be better01:52
prometheanfireok then01:52
ianwand it would then be right if you turned it back on01:52
*** tphummel has quit IRC01:55
openstackgerritKenji Ishii proposed openstack/requirements: Bump django-openstack-auth to 2.2.0  https://review.openstack.org/30436101:55
*** asettle has quit IRC01:57
*** salv-orlando has joined #openstack-infra01:58
*** kengo_sakai has joined #openstack-infra01:59
*** yamahata has quit IRC02:00
*** mtanino_ has quit IRC02:02
*** yamamot__ has joined #openstack-infra02:04
*** asettle has joined #openstack-infra02:05
*** cburgess has quit IRC02:05
*** bookwar has quit IRC02:05
openstackgerritMerged openstack-infra/irc-meetings: Require new yaml2ical  https://review.openstack.org/30377402:06
*** bapalm has quit IRC02:06
*** bookwar has joined #openstack-infra02:06
*** cburgess has joined #openstack-infra02:07
*** salv-orlando has quit IRC02:07
*** baoli has quit IRC02:09
*** baoli_ has joined #openstack-infra02:09
*** yuanying has quit IRC02:12
*** mattymo has quit IRC02:12
*** yuanying has joined #openstack-infra02:12
*** bapalm has joined #openstack-infra02:13
*** tristanC has quit IRC02:13
*** Swanson has quit IRC02:13
*** tristanC has joined #openstack-infra02:14
*** akshai_ has quit IRC02:14
*** LinuxJedi has quit IRC02:14
*** SergeyLukjanov has quit IRC02:14
*** ddieterly is now known as ddieterly[away]02:14
*** julim has joined #openstack-infra02:15
*** baoli_ has quit IRC02:15
*** jamesmcarthur has joined #openstack-infra02:15
*** mattymo has joined #openstack-infra02:16
*** SergeyLukjanov has joined #openstack-infra02:17
*** mylu has quit IRC02:18
*** Swanson has joined #openstack-infra02:19
*** Jeffrey4l__ has quit IRC02:20
*** thorst has joined #openstack-infra02:23
*** LinuxJedi has joined #openstack-infra02:28
*** thorst has quit IRC02:30
*** jcooley has joined #openstack-infra02:31
*** mylu has joined #openstack-infra02:33
*** bpokorny has joined #openstack-infra02:33
*** Jeffrey4l__ has joined #openstack-infra02:33
*** mhayden has left #openstack-infra02:34
*** jcooley has quit IRC02:36
*** markvoelker has joined #openstack-infra02:37
openstackgerritMerged openstack-infra/puppet-pip: Fix pip executable path for RH  https://review.openstack.org/30243102:41
openstackgerritDong Ma proposed openstack-infra/subunit2sql: Fix get_test_metadata to use test_id  https://review.openstack.org/30392802:41
openstackgerritMerged openstack-infra/puppet-pip: Add new pip provider to use pypi mirrors  https://review.openstack.org/30239602:41
*** markvoelker has quit IRC02:42
*** Jeffrey4l__ has quit IRC02:45
*** jamesmcarthur has quit IRC02:46
*** shashank_hegde has joined #openstack-infra02:48
*** jamesmcarthur has joined #openstack-infra02:49
*** yuanying has quit IRC02:52
*** jamesmcarthur has quit IRC02:54
*** sputnik13 has joined #openstack-infra02:54
*** sputnik13 has quit IRC02:56
*** bpokorny has quit IRC02:57
*** flepied has quit IRC02:58
*** flepied has joined #openstack-infra02:59
*** sputnik13 has joined #openstack-infra02:59
*** zeih_ has joined #openstack-infra03:00
*** sputnik13 has quit IRC03:00
*** asettle has quit IRC03:01
*** mylu has quit IRC03:02
*** x00350071 is now known as xiangxinyong03:02
*** mylu has joined #openstack-infra03:02
*** xyang1 has quit IRC03:03
*** zeih has quit IRC03:03
*** furlongm has quit IRC03:07
*** esikachev has joined #openstack-infra03:10
*** yamamot__ has quit IRC03:10
*** sdake_ has joined #openstack-infra03:12
*** mylu has quit IRC03:12
openstackgerritDonovan Jones proposed openstack-infra/shade: Use private_v4 for the interface_ip when public_v4 is not present  https://review.openstack.org/30437003:12
*** ddieterly[away] has quit IRC03:15
*** esikachev has quit IRC03:15
*** sdake has quit IRC03:15
openstackgerritMerged openstack-infra/irc-meetings: Use a boostrap grid to list all the meetings  https://review.openstack.org/24152203:16
*** sdake has joined #openstack-infra03:18
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Exploit the new batch_meetings function  https://review.openstack.org/27546103:18
*** mylu has joined #openstack-infra03:19
*** links has joined #openstack-infra03:20
*** sdake_ has quit IRC03:20
openstackgerritMerged openstack-infra/irc-meetings: Skip some meeting dates: third-party-meeting  https://review.openstack.org/29682503:26
*** thorst has joined #openstack-infra03:28
*** mylu has quit IRC03:29
*** mylu has joined #openstack-infra03:31
*** jcooley has joined #openstack-infra03:32
*** asettle has joined #openstack-infra03:33
*** thorst has quit IRC03:34
*** jcooley has quit IRC03:37
*** asettle has quit IRC03:38
*** salv-orlando has joined #openstack-infra03:38
openstackgerritMasayuki Igawa proposed openstack/os-testr: Decode bytes to str for Python 3  https://review.openstack.org/30321703:41
*** jamesmcarthur has joined #openstack-infra03:42
*** dimtruck is now known as zz_dimtruck03:44
*** Guest36911 has joined #openstack-infra03:44
*** tiswanso has quit IRC03:45
Guest36911hi guys, this repo seems to have some issues? https://review.openstack.org/p/openstack/automaton03:45
Guest36911git clone will get an empty repo03:45
*** furlongm has joined #openstack-infra03:45
*** mylu has quit IRC03:48
*** mylu has joined #openstack-infra03:49
clarkbGuest36911: I think we may need to trigger replication, you can clone from https://git.openstack.org/openstack/automaton until that is reolved03:49
*** achanda has joined #openstack-infra03:49
*** yuanying has joined #openstack-infra03:50
*** salv-orlando has quit IRC03:51
Guest36911thanks, it makes the CIs failing03:54
*** ddutta has joined #openstack-infra03:56
*** binbincong has quit IRC03:57
*** treaki__ has joined #openstack-infra03:57
*** asettle has joined #openstack-infra03:58
*** jamespage has quit IRC04:00
*** gnuoy has quit IRC04:00
*** dchen has joined #openstack-infra04:00
*** gnuoy has joined #openstack-infra04:00
*** jamespage has joined #openstack-infra04:00
*** treaki_ has quit IRC04:01
*** yamahata has joined #openstack-infra04:02
*** sflanigan has quit IRC04:03
*** yamamot__ has joined #openstack-infra04:04
*** achanda has quit IRC04:05
*** jamesmcarthur has quit IRC04:08
openstackgerritMasayuki Igawa proposed openstack/os-testr: Add version option for ostestr and subunit-trace  https://review.openstack.org/30095204:10
*** zz_dimtruck is now known as dimtruck04:14
openstackgerritYAMAMOTO Takashi proposed openstack-infra/irc-meetings: Change Tap as a service meeting time  https://review.openstack.org/30438304:14
*** sflanigan has joined #openstack-infra04:15
*** sflanigan has joined #openstack-infra04:15
*** binbincong has joined #openstack-infra04:15
*** oanson has joined #openstack-infra04:15
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Correct times for skipped third-party meetings  https://review.openstack.org/30438404:15
*** dimtruck is now known as zz_dimtruck04:23
openstackgerritMerged openstack-infra/subunit2sql: Fix get_test_metadata to use test_id  https://review.openstack.org/30392804:26
*** shashank_hegde has quit IRC04:30
*** roxanagh_ has joined #openstack-infra04:31
openstackgerritMerged openstack-infra/subunit2sql: Add stdout to indicate expiring runs operations  https://review.openstack.org/27314104:32
*** thorst has joined #openstack-infra04:33
*** jcooley has joined #openstack-infra04:33
*** jamesmcarthur has joined #openstack-infra04:37
*** jcooley has quit IRC04:37
*** markvoelker has joined #openstack-infra04:38
*** thorst has quit IRC04:40
*** mylu has quit IRC04:42
*** shashank_hegde has joined #openstack-infra04:42
*** kengo_sakai_mba has joined #openstack-infra04:42
*** markvoelker has quit IRC04:42
*** zz_dimtruck is now known as dimtruck04:44
*** kengo_sakai_mba has quit IRC04:48
*** shashank_hegde has quit IRC04:49
*** zhurong has quit IRC04:50
*** salv-orlando has joined #openstack-infra04:51
*** Guest36911 has quit IRC04:53
*** sridhar_ram1 has quit IRC04:55
*** dimtruck is now known as zz_dimtruck04:55
*** armax has quit IRC04:57
*** zhurong has joined #openstack-infra04:57
*** fedexo has joined #openstack-infra04:57
_odypabelanger and clarkb: "yum reinstall glibc glibc-common" fixes facter04:57
_odyKnow anything that might be deleting gconv-modules or messing around with locale-archive?04:58
clarkb_ody: its bootstrapping the distro install from scratch may just be neglecting to include such things from the start05:01
*** flwang1 has quit IRC05:02
*** salv-orlando has quit IRC05:03
*** flepied has quit IRC05:03
*** rossella_s has quit IRC05:03
_odyits glibc...don't you just get it all?05:03
*** rossella_s has joined #openstack-infra05:03
prometheanfirelol, I just updated glibc05:03
clarkbyes I would be surpised to not have glibc05:04
clarkbbut locale and gconv maybe not05:04
_odyclarkb: Both files are part of the glibc and glibc-common packages.05:04
prometheanfirewell, I'm hoping to eventually get musl builds into DIB05:04
prometheanfirebut one step at a time05:04
clarkb_ody: ianw is the best perosn to ask, I dont knowuch about the dirty details on bootstrapping centos705:05
ianw_ody: heh, yeah i'm just working on that05:05
ianwyes we wipe out the locales during image build05:05
ianwwhich is a bad idea05:05
_odyianw: Cool! It has had some of our expiremental tests dead in the water since the 5th and pabelanger has been trying to track down what has been going on.05:06
ianwi think i've got a fix, just getting it together05:06
prometheanfireeselect locale set en_US.utf8; locale-gen05:06
prometheanfirethat's the gentoo fix05:06
*** zz_dimtruck is now known as dimtruck05:06
ianw_ody: you can probably switch back to devstack-centos7 nodes if it's holding you up05:07
_odyEmilienM: ^05:07
ianwi'll need to test this, get it into dib, get a dib release, and rebuild images before it will help, which is going to take a few days05:07
_odyianw: Ok. Thanks. Good to know.  I'll check with what EmilienM wants to do tomorrow then find a work around.05:08
*** zhurong has quit IRC05:09
*** esikachev has joined #openstack-infra05:11
*** jamesmcarthur has quit IRC05:11
*** hichihara has quit IRC05:12
*** cody-somerville has joined #openstack-infra05:13
*** esikachev has quit IRC05:15
*** FallenPegasus has quit IRC05:16
*** flepied has joined #openstack-infra05:16
*** dimtruck is now known as zz_dimtruck05:16
*** cody-somerville has quit IRC05:17
greghaynesianw: _ody is this on -minimal or not?05:19
clarkbit is05:19
clarkbwe switched away from the non minimal and thats when it broke05:20
greghaynesI tracked down a thing the other day which I think was a result of us installing glibc from outside the chroot (so the glibc localegen doesnt work)05:20
ianwgreghaynes: yes, yum-minimal/pre-install.d/03-yum-cleanup in particular strips the locales05:20
*** roxanagh_ has quit IRC05:20
* greghaynes wont ask why05:21
ianwbecause it's huge.  what we want to do is just clear out the unneeded stuff05:21
greghaynesheh, not having the locale files for the locale you have set tends to not work out well05:21
*** vgridnev has joined #openstack-infra05:22
*** sflanigan_ has joined #openstack-infra05:22
*** hdd has joined #openstack-infra05:22
ianwunsurprisingly, systemd is somehow involved too, writing out /etc/locale.conf05:23
*** sflanigan has quit IRC05:23
*** sflanigan_ is now known as sflanigan05:23
ianwhaven't quite cracked that nut yet05:23
*** dchen has quit IRC05:23
*** asettle has quit IRC05:27
*** sflanigan has quit IRC05:27
*** sflanigan has joined #openstack-infra05:27
*** sflanigan has joined #openstack-infra05:27
ianwgus: eh, that file is something to do with systemd-firstboot05:30
*** tphummel has joined #openstack-infra05:30
*** asettle has joined #openstack-infra05:30
ianwi think it's important just for the profile.d logic05:30
*** shashank_hegde has joined #openstack-infra05:31
ianwso, maybe jenkins an non-login shells don't notice?05:32
*** mestery has quit IRC05:32
*** jcooley has joined #openstack-infra05:34
fungitry LC_ALL=lennart.UTF-805:34
fungithough fedora 23 ought to have C.UTF-8 available (no idea whether gentoo does as well)05:35
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal: strip locale archive to en_* locales  https://review.openstack.org/30439905:35
*** dchen has joined #openstack-infra05:36
ianwgreghaynes: ^ really WIP, but it's what everyone else does basically.05:36
fungiwould be nice to confirm that doesn't also toss the C.UTF-8 fallback05:38
*** thorst has joined #openstack-infra05:38
*** mestery has joined #openstack-infra05:38
*** shashank_hegde has quit IRC05:38
*** jcooley has quit IRC05:38
*** markvoelker has joined #openstack-infra05:38
ianwbash-4.2# locale -a05:39
fungiat least on new enough fedora which have it available (centos 7 does not)05:39
fungihrm, should also have a C.UTF-8 in addition to just C05:39
ianwthis is centos705:40
*** mestery has quit IRC05:40
clarkbhow big are the locales in total? maybe just leave them in for simplicity?05:41
ianwi don't think C.UTF-8 was even in f23?05:41
ianwclarkb: i think about 50mb05:41
fungioh, maybe that's f24 and later05:41
clarkbianw that doesnt seem bad and should compress well05:41
fungiso yeah, not on f23 after all05:42
*** nadya has joined #openstack-infra05:42
fungii thought f21 or f22 added it as an installable locale, but yeah looks like f24 will be the minimum to have it built into to glibc05:43
*** mestery has joined #openstack-infra05:43
*** markvoelker has quit IRC05:43
ianwclarkb: i dunno ... comes back to the discussions we always seem to have in "what is minimal"?  for a docker image that's probably like 10-15%05:44
clarkbI mean glibc is pretty minimal...05:44
clarkband if upstream says thus us part of it then so be it05:44
ianwclarkb: well, most smaller things don't ship all the locales.  you can read through that bug i linked in there which is where it's ended up having rpm flags to just install some locales with glibc-common05:45
*** thorst has quit IRC05:45
ianwbut yum-minimal should just do i manually to remain common between fedora & centos05:45
clarkbI probably dont want to knoow why iy would be a special flag to the package manager instead of separate packages05:47
*** fawadkhaliq has joined #openstack-infra05:49
ianwclarkb: because it's one big file that's mmaped, i'm not sure how you'd do it with packages05:50
clarkbianw couldnt you have different one big file.depending on the package installed?05:51
*** gildub has joined #openstack-infra05:53
*** dchen has quit IRC05:53
ianwyou could maybe have each package regenerate things.  then you'd have hundreds of packages.  i dunno, feel free to take it up in the bug :)05:53
openstackgerritFathi Boudra proposed openstack-infra/jenkins-job-builder: builders: add 'publish over ssh' support as a build step  https://review.openstack.org/9843705:55
*** salv-orlando has joined #openstack-infra05:56
*** fedexo has quit IRC05:57
*** abregman has joined #openstack-infra05:59
clarkblooks like debian does the inverse of centos? by default you get almost none but can build more or as an alternative can install the all paclage with everything prebuily05:59
*** nadya has quit IRC06:00
*** oanson has quit IRC06:01
*** infra-red has joined #openstack-infra06:01
ianwi don't know why, but interactive login on a centos-minial still picks up en_US06:02
ianwoh, doh, i bet ssh sends that over06:02
* ianw now wonders why i'm not en_AU06:03
greghaynesclarkb: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/debootstrap/package-installs.yaml#n406:03
clarkbgreghaynes: ya locales is the "minimal" package06:04
clarkbso you dont need hundreds of packages you need two06:04
*** vgridnev has quit IRC06:04
clarkblocales-all appears to be what centos is doing the equivalent of06:05
ianwand dpkg-reconfigure to present the list of locales to generate06:05
*** zz_dimtruck is now known as dimtruck06:07
clarkbya I guess the difference is you dont delete anyything that way06:08
clarkbyou only add what you want06:08
clarkbor optionally request the whole lot06:08
*** shashank_hegde has joined #openstack-infra06:12
*** vgridnev has joined #openstack-infra06:15
AJaegerclarkb, I see a NOT_REGISTERED for the translation job - is the proposal slave down?06:17
*** dimtruck is now known as zz_dimtruck06:17
AJaegerclarkb: do you still have time to check this or should I look for another infra-root?06:17
openstackgerritMerged openstack-infra/puppet-infracloud: Add functional tests  https://review.openstack.org/28884006:18
jheskethAJaeger, clarkb: I'm around if you'd like me to look06:19
AJaegerjhesketh: the proposal slave seems offline06:20
AJaegerand not registered at nodepool - I see everywhere "NOT_REGISTERED" for jobs that should run on it06:21
AJaegerlooking at https://jenkins.openstack.org/ I see that "master" is offline but proposal is idle06:21
AJaegerSo, not sure what exactly is broken ;(06:21
AJaegerjhesketh: It's very late for clarkb, so if you could look, it would be great!06:22
jheskethssh'ing to the slave is fine06:22
jheskethand shows jenkins slave running06:22
*** achanda has joined #openstack-infra06:23
jheskethI think the master offline is normal06:24
*** tesseract has joined #openstack-infra06:24
*** tesseract is now known as Guest1511506:24
*** zeih_ has quit IRC06:25
*** tphummel has quit IRC06:25
*** tphummel has joined #openstack-infra06:26
*** fawadkhaliq has quit IRC06:26
*** mylu has joined #openstack-infra06:27
*** fawadkhaliq has joined #openstack-infra06:29
jheskethhmm, gearman's status isn't giving me anything (at all), but it seems to be running okay06:29
jheskethoh no, I just wasn't patient enough06:29
openstackgerritIan Wienand proposed openstack/diskimage-builder: yum-minimal: strip locale archive to en_* locales  https://review.openstack.org/30439906:31
*** mylu has quit IRC06:32
jheskethit looks like none of jenkins.o.o jobs are registered06:32
jheskethI may need to restart that host06:32
*** scheuran has joined #openstack-infra06:33
*** jcooley has joined #openstack-infra06:35
AJaegerfungi had to delete the workspace of the proposal slave yesterday, might be he took it out somehow and didn't add it back?06:35
*** flepied has quit IRC06:35
jheskethhmm okay06:36
* jhesketh looks06:36
*** jcooley has quit IRC06:36
*** jcooley has joined #openstack-infra06:36
yolandagood morning06:40
AJaegermorning, yolanda !06:40
yolandahow is infra? there are problems with jenkins?06:40
AJaegeryolanda: FYI: jhesketh is currently looking why we have NOT_REGISTERED with proposal slave jobs06:41
AJaegersee scrollback of last 30 mins for details.06:41
AJaegeryolanda: everything else looks fine from what I can see.06:41
AJaegeryolanda: thanks for the new gerrit ;)06:41
*** infra-red has quit IRC06:41
yolandanice, is gerrit super performing now? :)06:41
*** zhurong has joined #openstack-infra06:42
yolandaAJaeger, the maintenance was nice, everything was good documented and we didn't hit many problems, just a problem with file ownership06:42
*** thorst has joined #openstack-infra06:43
AJaegerglad to hear, yolanda06:44
*** akaszuba has joined #openstack-infra06:47
jheskethAJaeger: couldn't see anything wrong with it but disconnected the slave and reconnected it and it appears that the jobs are in gearman06:49
jheskethAJaeger: do you have a change you can re-trigger?06:49
*** thorst has quit IRC06:51
AJaegerjhesketh: I could merge a docs change - or you could (similar to https://gist.github.com/dims/3f0d83cb6d2f0cd6751b9f92896b4fea ) retrigger todays periodic change for horizon. I would prefer to retrigger that one since I've been waiting for it ;)06:51
AJaegerCan you retrigger? Otherwise, I'll find a simple change to approve...06:51
jheskethAJaeger: will retrigger06:52
jheskethone sec, I need to reconnect the other slaves as they appear to be missing their jobs06:52
*** salv-orlando has quit IRC06:54
*** Hal has joined #openstack-infra06:54
*** nadya has joined #openstack-infra06:54
*** Hal is now known as Guest559306:55
jheskethAJaeger: queued06:56
jheskethAJaeger: it's currently doing a neutron-upstream-translation-update which I think is progress06:56
jheskeththere's a lot of failures in the periodic queue that makes me uncomfortable though06:56
AJaegerjhesketh: Yeah!06:56
AJaegerjhesketh: Do you mean all these NOT_REGISTERED in the periodic queue?06:57
jheskethso it's queued which is better than not_registered, but it hasn't started yet06:57
jheskethAJaeger: no, there are failures too06:57
AJaegerdims: your periodic jobs are failing, example: https://jenkins07.openstack.org/job/periodic-neutron-py27-with-oslo-master/20/console06:58
AJaegerjhesketh: indeed, didn't see them before (20 mins ago those were still green)06:58
*** kengo_sakai_mba has joined #openstack-infra06:58
jheskethAJaeger: there we, the periodic ones are picked up06:59
AJaegerjhesketh: thanks for getting the slave running again, I see neutron finished and horizon now in the queue06:59
jheskether horizon06:59
AJaegerbut horizon failed ;(06:59
AJaegerand that looks strange:07:00
AJaeger"CalledProcessError: Command '(['git', 'log', '--simplify-by-decoration', '--pretty="%d"', 'origin/stable/liberty'],)' returned non-zero exit status 128"07:00
*** asettle has quit IRC07:00
jheskethyeah, just looking at that myself07:00
*** jcooley has quit IRC07:01
AJaegerthis works locally - and worked for neutron07:01
jheskethAJaeger: 128 is a connection error.. maybe it's jsut bad luck07:01
jheskethAJaeger: the mitaka change passed..any objections to me just retrying ti?07:02
AJaegerjhesketh: go ahead...07:03
AJaegerjhesketh: just a proposal job07:03
AJaegerjhesketh: but what is strange, see https://review.openstack.org/#/c/303695/ - the mitaka change has "cannot merge"07:03
* jhesketh waits for zuul to finish reporting it first07:03
jheskethAJaeger: hmm, that is... I gave it the ref for the head of master07:04
* jhesketh tries again07:05
AJaegerjhesketh: Otherwise let's wait until tomorrow when the jobs will run again...07:06
AJaegerhttps://jenkins.openstack.org/job/horizon-propose-translation-update/205/console same error ;(07:06
AJaegerjhesketh: can you run on the proposal slave the command manually?07:07
AJaegerthe workspace is not deleted...07:07
*** zz_dimtruck is now known as dimtruck07:08
*** fhubik has joined #openstack-infra07:08
AJaegersame problem with mitaka  - not mergeable. Let's wait for tomorrow.07:09
AJaegerBut I'm curious about the git problem07:09
AJaegerhttps://jenkins05.openstack.org/job/mistral-releasenotes/21/console fails the same way ;(07:10
AJaegerSomething is broken with the release notes generation ;(07:10
*** kushal has quit IRC07:11
*** nadya has quit IRC07:12
openstackgerritMerged openstack-infra/project-config: Add release note publishing to glance_store  https://review.openstack.org/30396207:12
jheskethAJaeger: http://paste.openstack.org/show/493719/07:13
*** ifarkas has joined #openstack-infra07:13
jheskethAJaeger: http://paste.openstack.org/show/493720/07:13
*** mikelk has joined #openstack-infra07:13
ttxkevinbenton: oops, done.07:14
AJaegerjhesketh: OOps. How can that happen? ;(07:14
AJaegerWhat happened to the branch? It's there on my local system07:14
jheskethAJaeger: the origin is gerrit, so maybe its mirrors are missing branches or something07:14
* jhesketh is looking07:14
kevinbentonttx: thx07:14
*** salv-orlando has joined #openstack-infra07:15
*** infra-red has joined #openstack-infra07:16
openstackgerritMerged openstack-infra/project-config: Add Tempest gate job for Zaqar  https://review.openstack.org/30248707:16
AJaegerjhesketh: neutron release notes publishing worked, so that one is fine.07:16
jheskethAJaeger: so the branch appears to be on the gerrit server.. .I'm currently cloning from gerrit (rather than git.o.o) to see what it has but it's very slow07:17
AJaegerjhesketh: see also in backscroll the problem with automaton - or directly: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/latest.log.html#t2016-04-12T03:45:2107:19
*** jaosorior has joined #openstack-infra07:19
*** dimtruck is now known as zz_dimtruck07:19
*** clsacramento has quit IRC07:19
jheskethAJaeger: http://paste.openstack.org/show/493721/ doesn't look right07:20
AJaegerjhesketh, yolanda: Is that a problem with the new gerrit?07:20
*** vincentll has joined #openstack-infra07:20
jheskethmy guess is yes07:20
yolandagerrit not replicating?07:21
AJaegeryolanda: we miss some branches and references on gerrit.o.o07:21
openstackgerritMerged openstack-infra/project-config: copy_puppet_logs: copy audit.log if it does exist  https://review.openstack.org/30433407:21
openstackgerritMerged openstack-infra/puppet-openstackci: Force *.css files to text/css  https://review.openstack.org/30347507:21
*** clsacramento has joined #openstack-infra07:22
jheskethyolanda: specifically on gerrit's /p/ path07:22
yolandajhesketh, so do you think it can be problem with local replication?07:23
yolandai don't think anything was missing when we moved the server, because the volumes and the database were preserved...07:23
jheskethyolanda: looks like it... I don't see the right refs in the local /opt/lib/git07:24
yolandajhesketh, have you tried forcing a replication? i can do07:24
*** sdake_ has joined #openstack-infra07:24
jheskethyolanda: any way for gerrit to retrigger replication or do an audit of its replication?07:24
yolandayep, let me retrigger07:24
jheskethbecause otherwise it appears to only replicate when it knows about new refs07:24
jheskethyolanda: cool, thanks07:24
jheskethyolanda: for future reference, how do I do it?07:24
jhesketh(I'll let you do it now though)07:25
*** shashank_hegde has quit IRC07:25
yolandasomething like ssh -p 29419 user@localhost replication start --all07:25
yolandaand it can be filtered by mirror as well07:26
yolandaalso a --wait flag can be passed so you can get the results of the replication on console07:26
*** sdake has quit IRC07:26
jheskethyolanda: cool, thanks07:27
jheskethyolanda: so you have that running now?07:27
*** sdake has joined #openstack-infra07:27
*** shashank_hegde has joined #openstack-infra07:27
yolandaso far looks good, replicating to local and remote mirrors07:27
jheskethcool, let me know when it's done horizon please07:28
jheskethinterestingly my clone from gerrit failed http://paste.openstack.org/show/493722/07:28
jheskethI wonder if the repo is broken somehow07:28
* jhesketh waits for the replication instead07:28
yolandajhesketh, i've had that on downstream sometimes. What i did is remove the directory totally, and trigger replication for that again, but let's wait for full replication to end07:29
AJaegerjhesketh: Try mistral as well07:30
*** asettle has joined #openstack-infra07:30
*** sdake_ has quit IRC07:30
AJaegerand automaton once the replication is done..07:30
jheskethAJaeger: I only see master on review.o.o07:30
AJaegerjhesketh: which project?07:31
AJaegerhttps://review.openstack.org/#/admin/projects/openstack/mistral,branches has more...07:31
jheskethAJaeger: mistral07:32
jheskethAJaeger: that's not the local replication though07:32
jheskethwhich is served from /p/07:32
AJaegerjhesketh: Ah! So, local replication looks wrong for mistral in that case ;(07:32
jheskethAJaeger: looks like the branches are there now for mistral and horizon07:32
jheskethyolanda: looks like the replication trigger is working - thanks :-)07:32
yolandagoing to try running manage-projects as well, i have a feeling that something is not good07:33
*** thorst has joined #openstack-infra07:33
*** esikachev has joined #openstack-infra07:33
jheskethAJaeger: shall we retry those jobs?07:33
AJaegerjhesketh: yes, let's do that...07:33
*** mrmartin has joined #openstack-infra07:34
AJaegerhttps://jenkins03.openstack.org/job/sahara-releasenotes/42/console failed the same way07:34
AJaegerhttps://jenkins01.openstack.org/job/python-saharaclient-releasenotes/5/console also07:34
*** salv-orl_ has joined #openstack-infra07:34
*** asettle has quit IRC07:34
AJaegerthat might have run before the replication...07:35
jheskethAJaeger: right, and it may not have reached sahara at that point07:36
jheskethAJaeger: horizon periodic running07:36
*** vgridnev has quit IRC07:36
AJaegeris replication finished now?07:36
*** nmagnezi has joined #openstack-infra07:36
yolandano, still running07:36
yolandait doesn't replicate in any specific order07:37
*** salv-orlando has quit IRC07:37
*** arxcruz has joined #openstack-infra07:38
*** nihilifer has quit IRC07:38
jheskethright there's also the risk that horizon isn't completely done07:38
AJaegeryeah, horizon worked!07:39
*** nadya has joined #openstack-infra07:39
*** markvoelker has joined #openstack-infra07:39
AJaegerhttps://jenkins.openstack.org/job/horizon-propose-translation-update/206/console looks good07:40
*** thorst has quit IRC07:40
jheskethyep, just saw that too :-)07:41
AJaegerSo, one question: Why did replication not work before? Anything we need to fix so that it works automatically?07:41
*** jamielennox is now known as jamielennox|away07:42
yolandaAJaeger, i saw gerrit replicating yesterday, when we did the server move07:42
yolandai don't know what caused to don't replicate properly07:42
yolandait was performing ok, without any errors07:43
*** markvoelker has quit IRC07:44
AJaegerCan you check in a few hours again whether it's working fine, please?07:44
*** shashank_hegde has quit IRC07:46
*** tosky has joined #openstack-infra07:46
*** jaosorior has quit IRC07:47
*** jaosorior has joined #openstack-infra07:48
*** shardy has joined #openstack-infra07:48
*** placko has joined #openstack-infra07:49
*** e0ne has joined #openstack-infra07:49
*** daemontool_ has joined #openstack-infra07:50
*** flepied has joined #openstack-infra07:51
openstackgerritMerged openstack-infra/project-config: [sahara] configure publist-to-pypi jobs for sahara-tests  https://review.openstack.org/30412107:51
*** ociuhandu has quit IRC07:51
*** daemontool has quit IRC07:53
*** zeih has joined #openstack-infra07:54
*** kzaitsev_mb has joined #openstack-infra07:55
openstackgerritMerged openstack-infra/project-config: cleaning up python3 jobs for sahara-tests  https://review.openstack.org/30413007:56
AJaegerthanks, yolanda and jhesketh !07:58
jheskethno worries07:58
jheskethsorry I couldn't tell you why it was broken07:58
yolandareplication finished now07:59
yolandaseems it had lots of work to do07:59
yolandai'm also running manage projects, that seems to be very busy07:59
*** yaume has joined #openstack-infra07:59
openstackgerritMerged openstack-infra/project-config: Refactor releasenote branch condition  https://review.openstack.org/30411608:01
anteayattx: on the newton release schedule, there seems to be a hiatus during the election proceedings: http://releases.openstack.org/newton/schedule.html08:01
*** fawadkhaliq has quit IRC08:01
anteayattx: R-3 is an empty week between ptl self-nomination and ptl eleection08:01
anteayattx: is that intentional?08:02
ttxanteaya: hmm, no08:03
openstackgerrityolanda.robla proposed openstack-infra/shade: WIP: Add shade call to get flavor access list  https://review.openstack.org/30417108:03
ttxanteaya: actually there is no empty week there08:04
*** e0ne has quit IRC08:04
ttxN cycle PTLs self-nomination on R-308:04
ttxN cycle PTLs election on R-208:04
anteayaO cycle08:04
ttxThe empty cell is just a continuation of the "Hard StringFreeze" line08:05
*** dtardivel has joined #openstack-infra08:05
ttxYes you're right08:05
anteayaoh okay good08:05
ttxShould be R-3 not R-408:06
ttxI already have a change in the pipe08:06
ttxI'll fix that too08:06
anteayathanks so much08:06
openstackgerritMerged openstack-infra/project-config: Retire openstack-ansible-os_swift_sync repository  https://review.openstack.org/30404908:06
ttxThanks for spotting that08:07
anteayattx: sure, was looking at it yesterday when mriedem_away used it for his mid-cycle email reference08:07
*** gildub has quit IRC08:07
openstackgerrityolanda.robla proposed openstack-infra/shade: WIP: Add shade call to get flavor access list  https://review.openstack.org/30417108:08
*** infra-red has quit IRC08:09
*** zz_dimtruck is now known as dimtruck08:11
*** infra-red has joined #openstack-infra08:12
*** gildub has joined #openstack-infra08:12
ttxanteaya: https://review.openstack.org/30444008:14
* anteaya reviews08:15
anteayattx: I haven't reviewed the charter lately, I'm trusting you that these are the correct weeks08:17
anteayattx: thanks for fixing the blank08:17
ttxIt's based on summit week currently08:20
*** dimtruck is now known as zz_dimtruck08:20
ttxand we have the same gap between release and summit in Barcelona and Austin08:20
ttxso same R-x weeks08:20
anteayaand post Barcelona is the goal for the event split?08:21
anteayaso after the large parts of the event split are figured out, we need to take a look at the ramifications for elections08:24
anteayaand how to address timing and so on08:25
*** jistr has joined #openstack-infra08:25
anteayaand I'm back to bed again08:26
*** jordanP has joined #openstack-infra08:26
ttxyes, plan is to split after Barcelona08:26
*** jcoufal has joined #openstack-infra08:28
*** yamahata has quit IRC08:28
*** mylu has joined #openstack-infra08:28
AJaegerg'night, anteaya !08:29
*** kzaitsev_mb has quit IRC08:29
*** hichihara has joined #openstack-infra08:30
*** mylu has quit IRC08:32
*** e0ne has joined #openstack-infra08:33
*** kushal has joined #openstack-infra08:37
*** thorst has joined #openstack-infra08:39
*** tphummel has quit IRC08:39
*** derekh has joined #openstack-infra08:40
*** infra-red has quit IRC08:41
*** dizquierdo has joined #openstack-infra08:41
*** binbincong has quit IRC08:41
*** markusz is now known as markus_z08:41
*** sshnaidm has quit IRC08:42
*** dtantsur|afk is now known as dtantsur08:42
*** dingyichen has quit IRC08:44
*** thorst has quit IRC08:45
*** gildub has quit IRC08:47
*** infra-red has joined #openstack-infra08:50
*** kengo_sakai_mba has quit IRC08:50
openstackgerrityolanda.robla proposed openstack-infra/shade: WIP: Add shade call to get flavor access list  https://review.openstack.org/30417108:52
*** infra-red has quit IRC08:54
*** infra-red has joined #openstack-infra08:54
*** vgridnev has joined #openstack-infra08:55
*** abregman_ has joined #openstack-infra08:57
*** abregman has quit IRC08:57
*** abregman_ is now known as abregman08:57
*** amotoki has joined #openstack-infra08:59
*** tojuvone has quit IRC08:59
*** tojuvone has joined #openstack-infra09:00
*** dims has quit IRC09:04
*** julim has quit IRC09:04
*** dims has joined #openstack-infra09:05
*** julim has joined #openstack-infra09:05
*** matrohon has joined #openstack-infra09:10
*** zz_dimtruck is now known as dimtruck09:11
*** thorst has joined #openstack-infra09:12
openstackgerritChristian Schwede proposed openstack-infra/devstack-gate: Make subnode IPs known to all Swift hosts  https://review.openstack.org/30446509:16
*** openstackgerrit has quit IRC09:17
*** openstackgerrit has joined #openstack-infra09:17
*** asettle has joined #openstack-infra09:18
*** esikachev has quit IRC09:21
*** dimtruck is now known as zz_dimtruck09:21
*** cdent has joined #openstack-infra09:21
*** zhurong has quit IRC09:23
*** asettle has quit IRC09:23
openstackgerritChristian Schwede proposed openstack-infra/devstack-gate: Make subnode IPs known to all Swift hosts  https://review.openstack.org/30446509:24
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic cleaning job  https://review.openstack.org/30447309:24
*** kzaitsev_mb has joined #openstack-infra09:27
*** _degorenko|afk is now known as degorenko09:28
*** e0ne has quit IRC09:29
*** thorst has quit IRC09:29
*** sambetts|afk is now known as sambetts|afk]09:30
*** sambetts|afk] is now known as sambetts09:30
*** e0ne has joined #openstack-infra09:31
*** mrmartin has quit IRC09:33
*** shu-mutou is now known as shu-mutou-AFK09:35
openstackgerrityolanda.robla proposed openstack-infra/shade: Add shade call to get flavor access list  https://review.openstack.org/30417109:38
openstackgerritChristian Schwede proposed openstack-infra/devstack-gate: Make subnode IPs known to all Swift hosts  https://review.openstack.org/30446509:38
*** markvoelker has joined #openstack-infra09:40
*** esikachev has joined #openstack-infra09:41
*** sshnaidm has joined #openstack-infra09:42
*** markvoelker has quit IRC09:45
*** claudiub has joined #openstack-infra09:46
*** kzaitsev_mb has quit IRC09:47
*** sdague has joined #openstack-infra09:50
*** kengo_sakai_mba has joined #openstack-infra09:50
*** kzaitsev_mb has joined #openstack-infra09:51
*** shardy has quit IRC09:52
openstackgerrityolanda.robla proposed openstack-infra/shade: Add shade call to get flavor access list  https://review.openstack.org/30417109:52
dimsAJaeger : thanks for the heads up about the periodic neutron job with oslo master failing09:55
dimsAJaeger : looks like the requirements constraint job that we were poking yesterday did not even run! http://logs.openstack.org/periodic/propose-requirements-constraints-master/?C=M;O=A09:56
*** oanson has joined #openstack-infra09:56
*** openstackstatus has quit IRC09:57
*** openstack has joined #openstack-infra09:59
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translations: Enabling syncing again  https://review.openstack.org/30449410:01
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translations: Temporarily stop master sync for python projects  https://review.openstack.org/30449310:01
*** shardy has joined #openstack-infra10:02
openstackgerritVitaly Kramskikh proposed openstack-infra/project-config: Make npm-lint job for fuel-ui voting again  https://review.openstack.org/30449510:02
openstackgerritVitaly Kramskikh proposed openstack-infra/project-config: Make npm-lint job for fuel-ui voting again  https://review.openstack.org/30449510:02
*** jcoufal has quit IRC10:03
*** ociuhandu has joined #openstack-infra10:06
*** salv-orl_ has quit IRC10:06
*** achanda has quit IRC10:08
*** mrmartin has joined #openstack-infra10:09
*** sdake has quit IRC10:11
*** zz_dimtruck is now known as dimtruck10:12
*** vgridnev has quit IRC10:14
*** Qiming has quit IRC10:14
*** salv-orlando has joined #openstack-infra10:15
*** vgridnev has joined #openstack-infra10:15
markus_zin #openstack-meeting-4 the bot didn't work10:15
*** jaosorior has quit IRC10:21
*** jaosorior has joined #openstack-infra10:22
*** dimtruck is now known as zz_dimtruck10:22
*** zul has quit IRC10:23
*** jed56 has quit IRC10:23
*** yamamot__ has quit IRC10:25
*** jlanoux has joined #openstack-infra10:27
*** Guest29074 is now known as BobBall10:31
openstackgerritMerged openstack-infra/irc-meetings: Correct times for skipped third-party meetings  https://review.openstack.org/30438410:31
Zaraone of our managers is using his laptop screen as a tray for his tea.10:32
*** cdent has quit IRC10:34
openstackgerritChristian Schwede proposed openstack-infra/project-config: Enable gate-grenade-dsvm-multinode for Swift  https://review.openstack.org/30450510:34
*** amrith is now known as _amrith_10:36
*** achanda has joined #openstack-infra10:38
*** mrmartin has quit IRC10:39
*** zul has joined #openstack-infra10:39
*** jlanoux_ has joined #openstack-infra10:40
*** cdent has joined #openstack-infra10:41
*** jlanoux has quit IRC10:43
*** achanda has quit IRC10:47
*** salv-orlando has quit IRC10:48
*** salv-orlando has joined #openstack-infra10:48
dimsjhesketh : yolanda : one of you please requeue the requirements periodic job? fungi shared the command he used yesterday (https://gist.github.com/dims/3f0d83cb6d2f0cd6751b9f92896b4fea)10:49
jheskethdims: sure thing10:49
*** ihrachys has joined #openstack-infra10:50
dimsthanks jhesketh !10:50
jheskethdims: shall I just enqueue the head sha?10:50
jheskethnevermind, it is10:51
*** cdent has left #openstack-infra10:51
jheskethdims: done10:52
*** salv-orlando has quit IRC10:53
*** daemontool_ has quit IRC10:54
*** daemontool has joined #openstack-infra10:54
*** kengo_sakai_mba has joined #openstack-infra10:55
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/30451610:57
*** asettle has joined #openstack-infra10:59
*** asettle has quit IRC10:59
dimsthanks jhesketh11:00
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translations: Enabling syncing again  https://review.openstack.org/30449411:06
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translations: Temporarily stop master sync for python projects  https://review.openstack.org/30449311:06
*** vgridnev has quit IRC11:07
*** jcoufal has joined #openstack-infra11:07
*** achanda has joined #openstack-infra11:08
*** ramishra has joined #openstack-infra11:11
*** achanda has quit IRC11:12
*** zz_dimtruck is now known as dimtruck11:13
dimsjhesketh : i bet bandersnatch is busted again babel 2.3.3 is not there in our mirror) http://mirror.bhs1.ovh.openstack.org/pypi/simple/babel/ vs https://pypi.python.org/pypi/Babel11:14
*** ramishra_ has joined #openstack-infra11:14
dimsfungi : ^^11:15
jheskethdims: hmm will take a look11:15
krotscheckDoes the docs-draft site get cleaned out every so often?11:17
jheskethdims: looks like it's stuck doing a particular package again..11:18
cschwedesdague: Hi! I continued testing & working on Swift multinode tests, and submitted three patches today11:18
cschwedesdague: first one is patch 304465 to make the node IPs known to all swift nodes11:19
*** yamamoto has joined #openstack-infra11:19
cschwedesdague: second one uses that info and creates consistent rings on all nodes: https://review.openstack.org/#/c/304468/11:19
cschwedesdague: please let me know if this makes sense to you11:20
jheskethit's not clear why it gets stuck, but it won't move on until the blocking package is synced.. I'll unblock it manually11:20
sdaguecschwede: ok, cool, I'll take a look once I get through this chunk of code I've got in my head11:21
cschwedesdague: great, thx!11:21
*** tpsilva has joined #openstack-infra11:21
*** ramishra_ has quit IRC11:22
*** ramishra_ has joined #openstack-infra11:22
*** Qiming has joined #openstack-infra11:22
*** dimtruck is now known as zz_dimtruck11:23
*** ramishra_ has quit IRC11:23
*** ramishra_ has joined #openstack-infra11:27
*** jaypipes has joined #openstack-infra11:28
*** sbelous has quit IRC11:29
*** e0ne has quit IRC11:30
*** yamamoto has quit IRC11:31
openstackgerritHenry Gessau proposed openstack-infra/project-config: Fix neutron unit test job names in grafana dashboard  https://review.openstack.org/30453111:32
jheskethdims: should  be there now11:33
*** hashar has joined #openstack-infra11:33
*** yamamoto has joined #openstack-infra11:34
openstackgerritMateusz Matuszkowiak proposed openstack-infra/project-config: Added new repos for fuel plugins  https://review.openstack.org/30108011:34
*** yamamoto has quit IRC11:38
*** doug-fish has joined #openstack-infra11:39
AJaegerdims: the proposal slave was down and did not run a single job ;(11:40
AJaegerdims: if needed, we need a manual trigger again.11:40
AJaegerdims: but the proposal slave is working again, jhesketh and yolanda had to fix a few issues earlier today11:41
*** markvoelker has joined #openstack-infra11:41
*** hashar has quit IRC11:41
jheskethAJaeger: the mirror was stuck due to failing to sync a 3rd party library.. .I'm trying to debug why now11:42
AJaegerjhesketh: one of these days? ;( Thanks!11:42
dimsjhesketh : thanks!11:42
dimsAJaeger : yep, gotcha.11:43
dimsthanks jhesketh and yolanda !11:43
AJaegerproject-config cores, could you review https://review.openstack.org/304493  ? I've marked WIP to merge this once I need it.11:43
*** markvoelker has quit IRC11:45
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Updated karma dependencies  https://review.openstack.org/30453511:46
*** ldnunes has joined #openstack-infra11:47
*** yamamoto has joined #openstack-infra11:47
*** yamamoto has quit IRC11:48
*** Goneri has quit IRC11:49
*** vgridnev has joined #openstack-infra11:50
*** mrmartin has joined #openstack-infra11:52
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed grunt:eslint in favor of just running eslint  https://review.openstack.org/30453911:52
*** ddieterly has joined #openstack-infra11:53
*** asettle has joined #openstack-infra11:53
*** rfolco has joined #openstack-infra11:53
*** kzaitsev_mb has quit IRC11:57
AJaegerproject config cores, https://review.openstack.org/302854 is ready to merge - it's a revert of a change to disable npm testing. Please review11:58
*** asettle has quit IRC12:04
*** dprince has joined #openstack-infra12:04
*** openstack has quit IRC12:04
*** openstack has joined #openstack-infra12:06
*** kgiusti has joined #openstack-infra12:08
*** kengo_sakai_mba has quit IRC12:08
*** ddieterly is now known as ddieterly[away]12:10
*** aysyd has joined #openstack-infra12:12
*** pfallenop has quit IRC12:12
*** markvoelker has joined #openstack-infra12:12
*** ramishra_ has quit IRC12:12
*** zz_dimtruck is now known as dimtruck12:14
*** ramishra_ has joined #openstack-infra12:14
*** tlbr has quit IRC12:14
*** ramishra_ has quit IRC12:14
*** gordc has joined #openstack-infra12:15
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed ineffective grunt target  https://review.openstack.org/30455412:15
*** tlbr has joined #openstack-infra12:15
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed grunt test-unit in favor of just running karma  https://review.openstack.org/30455512:15
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Updated README  https://review.openstack.org/30455612:15
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed explicit references to node_modules/.bin  https://review.openstack.org/30455712:15
*** yamamoto has joined #openstack-infra12:15
*** bdemers has quit IRC12:16
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Removing previously created resourses in pingtest  https://review.openstack.org/30456012:17
*** kengo_sakai has quit IRC12:19
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Renamed karma-test.conf.js  https://review.openstack.org/30456212:19
*** ramishra_ has joined #openstack-infra12:19
*** kengo_sakai_mba has joined #openstack-infra12:20
*** dimtruck is now known as zz_dimtruck12:23
*** kengo_sakai_mba has quit IRC12:24
*** rodrigods has quit IRC12:24
*** rodrigods has joined #openstack-infra12:24
pabelanger_ody: ianw: Ya, I knew reinstall glibc-common worked, but not that we deleted locales12:24
*** baoli has joined #openstack-infra12:26
*** jamielennox|away is now known as jamielennox12:26
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed grunt-bower  https://review.openstack.org/30456512:26
*** ramishra has quit IRC12:26
*** dizquierdo has quit IRC12:27
pabelangerjust found ianw review: https://review.openstack.org/#/c/30439912:29
*** kzaitsev_mb has joined #openstack-infra12:29
*** ramishra_ has quit IRC12:30
pabelangerNot sure how we should proceed, we have a few project jobs that are failing related to locale missing.  puppet and packstack for example.12:31
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor default_network for interface_ip  https://review.openstack.org/30456912:31
pabelangerShould we roll back to devstack-centos7, have the project implement a patch them self or merge and release a new diskimage-builder?12:31
*** thorst has joined #openstack-infra12:32
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Removing previously created resourses in pingtest  https://review.openstack.org/30456012:32
*** ramishra has joined #openstack-infra12:33
openstackgerritEyal proposed openstack-infra/devstack-gate: support py3  https://review.openstack.org/30457212:34
EmilienMianw, pabelanger: https://review.openstack.org/30457112:34
*** ramishra_ has joined #openstack-infra12:35
*** yamamoto has quit IRC12:36
*** thorst has quit IRC12:36
*** e0ne has joined #openstack-infra12:36
*** cbader has quit IRC12:37
*** thorst has joined #openstack-infra12:37
*** cbader has joined #openstack-infra12:37
*** erlon has joined #openstack-infra12:38
*** yamamoto has joined #openstack-infra12:38
*** ramishra_ has quit IRC12:38
*** burgerk has joined #openstack-infra12:38
*** salv-orlando has joined #openstack-infra12:39
openstackgerritMonty Taylor proposed openstack-infra/shade: Consume floating_ip_source config value  https://review.openstack.org/30457712:39
*** ddieterly[away] has quit IRC12:39
*** ramishra_ has joined #openstack-infra12:40
*** abregman has quit IRC12:41
*** thorst has quit IRC12:41
*** tlbr has quit IRC12:43
*** keedya has joined #openstack-infra12:43
*** baoli_ has joined #openstack-infra12:43
*** tlbr has joined #openstack-infra12:43
*** kengo_sakai_mba has joined #openstack-infra12:44
*** matt-borland has joined #openstack-infra12:45
*** baoli has quit IRC12:46
*** kengo_sakai_mba has quit IRC12:46
*** kengo_sakai_mba has joined #openstack-infra12:47
*** regXboi has joined #openstack-infra12:48
openstackgerritSam Thursfield proposed openstack-infra/gear: Allow setting a timeout for Client.waitForServer()  https://review.openstack.org/18426512:49
*** pradk has joined #openstack-infra12:50
EmilienMpabelanger: I would like to install setroubleshoot and setools on centos7 images. Should I patch dib or carry this packages in puppet-openstack-integration?12:51
*** jamesmcarthur has joined #openstack-infra12:51
pabelangerEmilienM: or adding it to other-requirements.txt and have bindep install it12:52
pabelangerEmilienM: but ya, starting in your project is going to be the first step12:52
*** maishsk has quit IRC12:52
*** links has quit IRC12:52
openstackgerritNoam Bloom proposed openstack-infra/project-config: Vitrage-New-Jenkins-Job  https://review.openstack.org/30458812:53
*** tlbr has quit IRC12:54
*** abregman has joined #openstack-infra12:54
EmilienMpabelanger: ok I'll use bindep12:54
openstackgerritMerged openstack-infra/irc-meetings: Exploit the new batch_meetings function  https://review.openstack.org/27546112:54
*** jamesmcarthur has quit IRC12:55
*** _amrith_ is now known as amrith12:56
*** gsilvis_ is now known as gsilvis12:59
*** _ari_ has joined #openstack-infra13:00
*** rossella_s has quit IRC13:03
*** Goneri has joined #openstack-infra13:03
*** rossella_s has joined #openstack-infra13:03
*** ramishra_ has quit IRC13:03
EmilienMpabelanger: wait, but our puppet jobs do not use openstack/requirements13:03
openstackgerritIhar Hrachyshka proposed openstack-infra/release-tools: Added tool to scan project repo for new bug fixes in master  https://review.openstack.org/29642013:03
EmilienMpabelanger: so iiuc, we will never install packages in other-requirements.txtt13:04
openstackgerritMerged openstack-infra/storyboard-webclient: Updated karma dependencies  https://review.openstack.org/30453513:04
*** yamahata has joined #openstack-infra13:04
openstackgerritIhar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs of specified importance  https://review.openstack.org/29642113:05
*** zz_dimtruck is now known as dimtruck13:05
openstackgerritIhar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs with specific tag  https://review.openstack.org/29645413:05
EmilienMpabelanger: and we don't run tox, except for reno jobs13:06
AJaegerEmilienM: other-requirements.txt is installed by infra!13:06
AJaegerEmilienM: the install-distro macro takes care of it, let me grab a link...13:06
*** obondarev has quit IRC13:07
AJaegerEmilienM: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/puppet-module-jobs.yaml#n913:07
AJaegerinstall-distro-packages installs the global bindep-fallback packages unless the repository contains a other-requirements.txt file.13:07
openstackgerritPedro Alvarez Piedehierro proposed openstack-infra/storyboard-webclient: Add story status to the Story detail template  https://review.openstack.org/30349913:08
*** mriedem_away is now known as mriedem13:08
AJaegerJust add a file and test it, EmilienM13:08
*** tlbr has joined #openstack-infra13:08
openstackgerritPedro Alvarez Piedehierro proposed openstack-infra/storyboard-webclient: Remove redundant 'code'  https://review.openstack.org/30108613:08
*** obondarev has joined #openstack-infra13:08
EmilienMAJaeger: ok so I can patch jenkins/data/bindep-fallback.txt with the packages I need, right?13:09
AJaegerEmilienM: that is the global list.13:09
*** ramishra_ has joined #openstack-infra13:09
EmilienMwe need selinux tools for all puppet CI jobs13:09
AJaegerEmilienM: copy that file to other-requirements.txt in one repository, and test that way that your jobs now work...13:10
AJaegerThen you have two options: Adding the extra files to bindep-fallback - or adding other-requirements to all puppet repos13:10
EmilienMAJaeger: yeah, I got it but I'm not sure we want to patch all our repos, we have nearly 30 repos...13:10
AJaegerEmilienM: WE have 1000 repositories and 970 don't need these extra packages ;)13:11
*** dtantsur is now known as dtantsur|mtg13:11
AJaegerEmilienM: let's do the exercise and test that your package list works - on a single repository.13:11
*** jamesmcarthur has joined #openstack-infra13:12
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor default_network for interface_ip  https://review.openstack.org/30456913:12
openstackgerritMonty Taylor proposed openstack-infra/shade: Consume floating_ip_source config value  https://review.openstack.org/30457713:12
AJaegerAnd then let's discuss further with pabelanger and others.13:12
*** ramishra_ has quit IRC13:12
*** ayoung has quit IRC13:12
EmilienMAJaeger: done: https://review.openstack.org/30434513:13
AJaegerEmilienM: I fear that list is too small, it replaces bindep-fallback...13:14
EmilienMAJaeger: but another way, much simpler is to patch one script in one of our repos, that will install the 2 packages and it will work for all our repos13:14
EmilienMAJaeger: that means we have to maintain the list?13:14
*** ramishra_ has joined #openstack-infra13:14
AJaegerEmilienM: Yes - and document that way to your users what is really needed to install puppet.13:15
AJaegerEmilienM: See also https://www.technovelty.org/openstack/image-building-in-openstack-ci.html for the big picture13:15
AJaeger"Specifying Dependencies" is the section13:16
EmilienMwe won't maintain other-requirements.txt file for our 30 (and more in the future) repositories13:16
EmilienMuntil now, we moved a lot of things in some common repositories to make our life easier13:16
*** ramishra_ has quit IRC13:16
AJaegerEmilienM: since I'm not a puppet expert, let's continue this discussion with fungi and pabelanger ...13:16
pabelangerand back13:16
pabelangerjust catching up on backscroll13:16
EmilienMAJaeger: I would rather patch: https://github.com/openstack/puppet-openstack-integration/blob/master/run_tests.sh#L7913:17
EmilienMand install here the 2 packages we need13:17
pabelangerRight, you don't need tox for other-requirements.txt, we have a JJB script that will call bindep13:17
EmilienMit's the short path13:17
AJaegerpabelanger: could you push these two on your review queue, please? https://review.openstack.org/304493 and  https://review.openstack.org/302854 .13:18
*** mtanino has joined #openstack-infra13:18
pabelangerEmilienM: you can update run_tests.sh, but you are still maintaining the packages locally in your project.  How does that differ from using other-requirements.tst?13:18
pabelangerAJaeger: sure13:18
EmilienMpabelanger: the diff is maintening the same file in at least 30 repositories13:19
*** doug-fish has quit IRC13:19
EmilienMpabelanger: during the last months, we moved common bits from our puppet modules to one or 2 repos (libraries), we want to continue that way I guess13:19
AJaegerEmilienM: yes, that's a specific option to do it for puppet - other-requirements works everywhere13:19
pabelangerEmilienM: right, but I suspect it will actually be an empty file. Since you want to manage dependencies with puppet13:20
*** nadya has quit IRC13:20
EmilienMwell, I'm asking to install setools and setroubleshoot13:20
EmilienMthey are not specific to Puppet13:20
*** xyang1 has joined #openstack-infra13:20
*** ramishra_ has joined #openstack-infra13:20
*** jamesmcarthur has quit IRC13:21
pabelangerI haven't looked, but if you have a common library why not have it install them?13:21
EmilienMpabelanger: that's what I'm doing, but you and AJaeger were suggesting me to use bindep13:22
*** sbelous has joined #openstack-infra13:22
*** tiswanso has joined #openstack-infra13:22
pabelangerRight, bindep is the choice for infra moving forward, but you are not forced to use it.13:22
pabelangerIn fact, you likely want to add an empty other-requirements.txt to your modules, so you don't get the files from bindep-fallback.txt installed by default13:23
*** tlbr has quit IRC13:23
pabelangersince you want to manage them in puppet, to ensure your modules don't miss a dependency13:23
openstackgerritIhar Hrachyshka proposed openstack-infra/release-tools: Add tool that annotates bug numbers with details from LP  https://review.openstack.org/29647013:23
openstackgerritIhar Hrachyshka proposed openstack-infra/release-tools: Add tool that annotates bug numbers with details from LP  https://review.openstack.org/29647013:24
*** tlbr has joined #openstack-infra13:24
*** ramishra_ has quit IRC13:25
AJaegerpabelanger: good idea - an empty other-requirements with just a comment "Puppet does it for us ;)", and then the common file that EmilienM showed us13:26
openstackgerritIhar Hrachyshka proposed openstack-infra/release-tools: Add tool that annotates bug numbers with details from LP  https://review.openstack.org/29647013:26
*** ramishra_ has joined #openstack-infra13:26
*** doug-fish has joined #openstack-infra13:27
*** sbelous has quit IRC13:28
*** mylu has joined #openstack-infra13:29
*** mtanino has quit IRC13:30
*** jsavak has joined #openstack-infra13:32
*** sbelous has joined #openstack-infra13:34
*** edmondsw has joined #openstack-infra13:34
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Resolve worklist filters in boards  https://review.openstack.org/30462213:36
*** links has joined #openstack-infra13:36
*** amrith is now known as _amrith_13:37
*** tonytan4ever has joined #openstack-infra13:37
dimsheads up : going to release pbr 1.9.0 !13:37
*** mylu has quit IRC13:37
*** ramishra_ has quit IRC13:37
*** mylu has joined #openstack-infra13:38
*** rfolco has quit IRC13:39
mordreddims: woot!13:39
dimsmordred : here's a quote from our fearless leader :) "[08:48:51]  <ttx>that might break the world, but today is a good day to do it"13:40
mordreddims: as always, he's a wise wise man13:40
*** asettle has joined #openstack-infra13:42
*** knikolla has joined #openstack-infra13:42
openstackgerritMerged openstack-infra/storyboard-webclient: Remove redundant 'code'  https://review.openstack.org/30108613:42
*** ddieterly has joined #openstack-infra13:42
openstackgerritGraham Hayes proposed openstack-infra/project-config: Create 'Review-Priority' for designate repos  https://review.openstack.org/29525313:43
*** ramishra_ has joined #openstack-infra13:43
*** eharney has joined #openstack-infra13:44
*** asettle has quit IRC13:46
*** zhurong has joined #openstack-infra13:47
*** dizquierdo has joined #openstack-infra13:47
*** thiagop has joined #openstack-infra13:47
*** akshai has joined #openstack-infra13:48
*** amitgandhinz has joined #openstack-infra13:49
*** ramishra_ has quit IRC13:49
*** bdemers has joined #openstack-infra13:50
*** ramishra_ has joined #openstack-infra13:50
AJaegerdims: ok, we redirect all blame to ttx ;)13:52
dimsAJaeger : that's the plan of action :)13:52
AJaegerdims: where should credits go? ;)13:52
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Removing previously created resources in pingtest  https://review.openstack.org/30456013:53
dimsAJaeger : nakato would get the kudos :) (and lifeless)13:53
pabelangerianw: when you have time today, want to float the idea of disabling epel7 in system-config, and having projects explicitly enabling it. Now that we are on bindep, I don't actually think we install anything from epel during out bootstrap process13:53
*** rfolco has joined #openstack-infra13:54
*** ramishra_ has quit IRC13:56
clarkbpabelanger: centos-minimal depends on epel for dkms13:56
clarkbpabelanger: if you remove it then the image builds will fail13:56
*** ramishra_ has joined #openstack-infra13:56
pabelangerclarkb: did we fix that in diskimage-builder yet?13:57
pabelangerbut you are correct13:57
clarkbI dont think so13:57
clarkbdefinitely unreleased if fixed13:57
pabelangerlast I tested centos-minimal is actually broken because of missing depends on base. I worked around it locally13:58
mordredpabelanger: IIRC we don't depend on base on purpose13:58
pabelanger /me nods13:59
mordredor, rather, nothing depends on base, dib adds it to the deps list for you, but the recommended way to use -minimal is with the flag that tells dib to not use base which is "-n"13:59
mordredbase is terribly named13:59
mordredand assumes that you're using cloud-init13:59
*** bdemers has quit IRC13:59
pabelangerI think greghaynes suggest moving dkms out into its own element to properly fix the dependency issue14:00
mordredthat would be swell14:00
*** bdemers has joined #openstack-infra14:01
*** hdd has quit IRC14:01
clarkbmordred note that isnt how nodepool builds images (and shouldn't, ideally element selection is controllable without special flags)14:03
*** mriedem is now known as mriedem_meeting14:03
clarkbsince in theory nodepool doesnt care if you use cloud init or gentoo14:04
*** abregman has quit IRC14:05
clarkbit should be able to pass list of elements to dib and get functioning image14:05
fungiAJaeger: jhesketh: i'm pretty sure the proposal slave workspace cleanup should have no impact whatsoever on gearman job registration. likely those jobs were never reregistered by jenkins.o.o after the zuul restart. for jobs run by single-use workers i know they tend to get registered when we add a new worker of the associated type, but for jenkins.o.o which has only long-lived workers i'm not sure14:05
fungihow the gearman plugin gets triggered to do that spontaneously (or what could have caused that not to happen yesterday)14:05
*** ramishra_ has quit IRC14:06
*** bdemers has quit IRC14:06
mordredclarkb: so - ' ideally element selection is controllable without special flags' is a thing I completely agree with14:06
mordredclarkb: but dib has a special element it injects helpfully for you14:06
jheskethfungi: basically I disconnected the worker and reconnected it and the jobs registered with zuul14:06
mordredit's _always_ been the 'right' way to use the minimal elements to have the base element removed14:07
jheskethfungi: before that the slaves were "connected" to jenkins, but not taking any jobs14:07
mordredif we're building with it then something is weird14:07
mordredor, I'm out of date and maybe greghaynes fixed the issue14:07
*** ramishra_ has joined #openstack-infra14:07
jheskethfungi: actually, that may not be true... it may have taken jobs but because they weren't registered with zuul it never got any14:07
mordredclarkb: ok. you're right. ignore moe14:08
*** links has quit IRC14:08
mordredclarkb: the assumption in base that you have cloud-init has been fixed14:08
*** bkeller` has joined #openstack-infra14:09
*** woodster_ has joined #openstack-infra14:10
*** thorst_ has joined #openstack-infra14:10
*** mtanino has joined #openstack-infra14:10
*** ssancheztrujillo has joined #openstack-infra14:11
*** ramishra_ has quit IRC14:11
*** pfallenop has joined #openstack-infra14:11
*** ramishra_ has joined #openstack-infra14:12
*** oanson has quit IRC14:13
Zarais there anything it'd be helpful for the storyboard team to do in advance of the bugsquash?14:14
*** bkeller` has quit IRC14:14
clarkbmordred oh good14:14
clarkbnodepool never grew a set -n feature so elemets being sane is semi required14:15
*** bkeller` has joined #openstack-infra14:15
*** ramishra_ has quit IRC14:15
fungikrotscheck: docs-draft content (more than 3 weeks old) is deleted by a periodic cronjob http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/log_archive_maintenance.sh#n1114:15
*** doug-fish has quit IRC14:16
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Removing previously created resources in pingtest and --skip-pingtest-cleanup option  https://review.openstack.org/30456014:16
*** rbrndt has joined #openstack-infra14:16
krotscheckfungi: Gotcha.14:17
*** ramishra_ has joined #openstack-infra14:17
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Removing previously created resources in pingtest and --skip-pingtest-cleanup option  https://review.openstack.org/30456014:17
samueldmqjeblair: thanks for your review on patch 264398, just replied your comment14:17
*** sigmavirus24_awa is now known as sigmavirus2414:18
*** burgerk has quit IRC14:18
fungiAJaeger: pabelanger: EmilienM: another solution rather than adding an empty other-requirements.txt file is to simply not use the install-distro-packages macro in the job definitions for those repos14:19
openstackgerritPaul Belanger proposed openstack-infra/system-config: Initial commit for RPM afs mirror  https://review.openstack.org/28952014:20
openstackgerritMerged openstack-infra/project-config: Fix experimental magnum image build  https://review.openstack.org/30179114:20
EmilienMfungi: right, I'll investigate if we actually need it or not14:20
pabelangerfungi: only thought about that, it could make maintaining JJB more tricky since it wouldn't be consistent14:20
pabelangerWon't mind a few reviews on ^ too. Should be what is needed to start doing centos7 mirror for AFS14:21
fungipabelanger: we have lots of jobs that don't use that macro14:21
fungifor example, everything using devstack14:22
openstackgerrityolanda.robla proposed openstack-infra/shade: Add shade call to get flavor access list  https://review.openstack.org/30417114:22
pabelangerright, I always though the goal was to convert devstack to use bindep one day14:22
pabelangeror simply parse each projects other-requirements.txt files14:22
fungipabelanger: yeah that's something i've considered proposing, but i don't expect it to use the install-distro-packages job macro14:23
clarkbit would do that in devstack itself likely14:23
clarkbreplace the files/apt stuff14:23
fungibasically there's a lot of logic duplicated between how devstack does its package handling and how bindep does it. also the model is not dissimilar so the patch would likely just be a lot of condensing and deleting14:24
fungicould actually just pipe the distro-specific package lists through a sed call to add the corresponding platform tags and pipe the result into bindep's stdin and then pass the output as package manager command line arguments14:25
openstackgerritPaul Belanger proposed openstack-infra/system-config: Initial commit for RPM afs mirror  https://review.openstack.org/28952014:25
fungicould be as simple as a few lines of additional script as an initial shim14:25
fungiand then you could have piecemeal changes to incrementally switch the package lists over to one combined list14:26
pabelangerkrotscheck: clarkb: since ^ conflicts with npm and ceph mirrors, any preference on order?14:26
fungior just do it all in one shot. i have no idea how long those reviews would linger and how merge-conflict-prone they would be14:26
*** nbloom has joined #openstack-infra14:28
*** ramishra_ has quit IRC14:28
krotscheckpabelanger, clarkb: I'm biased. Let fungi make the decision.14:28
*** ramishra_ has joined #openstack-infra14:28
*** nbloom has left #openstack-infra14:29
openstackgerritMichael Krotscheck proposed openstack-infra/storyboard-webclient: Removed grunt:eslint in favor of just running eslint  https://review.openstack.org/30453914:29
fungimarkus_z: yeah, it looks like freenode had a lot of netsplits going on around 10:00 utc but things seem to have stabilized since then. sorry about that14:29
*** sigmavirus24 is now known as sigmavirus24_awa14:29
*** nmagnezi has quit IRC14:29
fungikrotscheck: pabelanger: which one is further along (which has the chance of being implemented sooner)?14:29
markus_zfungi: OK, just wanted to let you know. Is there a way to create the log afterwards?14:30
fungii know that's probably tough to gauge14:30
pabelangerfungi: I'd say krotscheck, since hes had a few more reviews14:30
*** sigmavirus24_awa is now known as sigmavirus2414:30
fungimarkus_z: of you have a copy from your client history, you can send it to the openstack-infra@lists.openstack.org mailing list and someone can copy that to the server14:30
krotscheckMy only concern is that npm things are notoriously volatile, so mine will likely require some churn14:31
markus_zfungi: ah, no, that's too much overhead I guess. I was a very short meeting, but thanks for that!14:31
*** sdake has joined #openstack-infra14:32
*** ddieterly is now known as ddieterly[away]14:32
*** bdemers has joined #openstack-infra14:32
fungimarkus_z: sure, if you have this happen in the future and there are critical things you want published from the missing meeting log, it's always an option14:32
*** ssancheztrujillo has quit IRC14:33
fungikrotscheck: pabelanger: can we just review them both in parallel and then whichever lands second will just have to rebase when the time comes? or is that going to be problematic?14:33
pabelangereither for rpm to land, since I can to do the work14:33
pabelangerI think nibalizer offer to help krotscheck land npms14:34
*** kengo_sakai_mba has quit IRC14:34
fungiyeah, i love that new gerrit and gertty show you other changes which conflict with yours, but worry that it's unnecessarily impacting people's workflows and causing them to serialize things prematurely14:34
krotscheckI've waited since november, and shaved the unified mirror yak. A few more rebases won't matter.14:35
fungiaside from using it to spot duplicated changes, people ought to be able to mostly ignore the conflicting changes list14:35
yolandafungi pabelanger, have you seen any replication problems on gerrit? i had to launch manually this morning14:36
*** ssancheztrujillo has joined #openstack-infra14:36
pabelangeryolanda: I haven't noticed yet14:36
fungiyolanda: i saw that in scrollback. still wondering how the replication got interrupted14:37
fungibut thanks for spotting/fixing14:37
openstackgerritKiall Mac Innes proposed openstack-infra/project-config: Add tempest variations of Designate DSVM jobs  https://review.openstack.org/30467714:37
fungii think clarkb had also suggested it after i fell asleep14:37
yolandai didn't see that interrupted, actually i was monitoring gerrit queue yesterday night, and i saw more than 7000 tasks on replication, until they went to 014:37
*** bdemers has quit IRC14:38
*** agentle is now known as annegentle14:38
*** annegentle is now known as Guest3575914:39
openstackgerritMerged openstack-infra/project-config: Revert "Switch npm-lint to non-voting for fuel-ui"  https://review.openstack.org/30285414:39
*** tongli has joined #openstack-infra14:40
*** ddieterly[away] is now known as ddieterly14:40
AJaegerproject config cores, I need to do some changes to the way we setup translations to enable translation of release notes. First step is https://review.openstack.org/#/c/304493/ - another +2 would be great, please.14:40
*** kushal has quit IRC14:41
* AJaeger will be offline for two hours now and then do all the manual steps if possible...14:41
*** nmagnezi has joined #openstack-infra14:42
clarkbfungi yolanda ya openstack/automaton had no content on gerrit local mirror apparently14:42
AJaegerclarkb: should be fixed now with the replication that yolanda did. Isn't it?14:43
fungiclarkb: i wonder if it was created while replication was underway and gerrit didn't get around to it14:43
yolandafungi but we had another cases, not for new projects. There were problems in horizon as well14:43
clarkbAJaeger: ya that should be the fix14:43
fungilooks like it's showing up on our mirrors now http://git.openstack.org/cgit/openstack/automaton/14:43
AJaegerwe had horizon without stable/liberty and mistral with only master branch as well ;(14:44
yolandai was monitoring the replication this morning and everything looked fine now14:44
fungiwere most of the failures trying to fetch from the local /p mirror on review.openstack.org or from git.openstack.org?14:44
*** kzaitsev_mb has quit IRC14:45
fungi(aside from teh missing openstack/automaton)14:45
AJaegerfungi, automaton was created 11 months ago14:45
*** zhurong has quit IRC14:45
krotschecknibalizer: Mornin!14:45
krotschecknibalizer: Wanna land a mirror? ;)14:45
fungiAJaeger: weird, that totally should have been on git.openstack.org then14:45
AJaegeryeah ;(14:45
fungithe only mirror which had to re-replicate from scratch was the local one on review.openstack.org14:46
AJaegerfungi: we saw a couple of releasenotes jobs failing - when scanning stable branches14:46
yolandafungi, also something is not good with manage-projects14:46
nibalizerkrotscheck:appy to help14:46
nibalizerlink to the thing?14:46
openstackgerritMerged openstack-infra/project-config: Create tripleo-quickstart subteam  https://review.openstack.org/30414514:46
yolandalast entry i see in logs is from 5 hours ago, and that's because i ran it manually14:46
nibalizeri'm not super comfortable with the mirrors and afs yet so i'll be learning as I go14:46
fungidefinitely want to dig deeper on this, because we had discussed the possibility of being able to drop the /p mirror from gerrit entirely14:46
yolandait hadn't run since yesterday, when we moved the server14:46
clarkbfungi: it was on git.o.o14:46
clarkbonly /p/ local mirror was affected aiui14:46
*** mylu has quit IRC14:47
*** ramishra_ has quit IRC14:47
*** zeih has quit IRC14:47
*** dizquierdo_ has joined #openstack-infra14:47
fungii didn't realize we still had such a deep dependence on it, if that's what was causing all those failures14:47
krotschecknibalizer: https://review.openstack.org/#/q/status:open+branch:master+topic:npm14:47
fungithat's why i wasn't worried about us prepopulating the local mirror and just letting gerrit recreate it14:47
krotschecknibalizer: We start with this one: https://review.openstack.org/#/c/235617/14:48
*** tiswanso has quit IRC14:48
*** tdurakov has joined #openstack-infra14:48
krotschecknibalizer: Note, this will require the creation of the afs principal and credentials14:48
*** ramishra_ has joined #openstack-infra14:48
*** tiswanso has joined #openstack-infra14:48
openstackgerritMerged openstack-infra/project-config: Fix neutron unit test job names in grafana dashboard  https://review.openstack.org/30453114:48
openstackgerritNoam Bloom proposed openstack-infra/project-config: Adding more tests to Vitrage Gate; adding a new job for running tempests tests under experimental pipeline  https://review.openstack.org/30458814:48
tdurakovclarkb: could you share details how to enable xenial for experimental job?14:49
*** pfallenop has quit IRC14:49
*** bdemers has joined #openstack-infra14:49
AJaegertdurakov: see I683d9e1fe518e653611a9c9b615b2095e7fa42e014:49
AJaegertdurakov:  https://review.openstack.org/30294914:49
openstackgerritMerged openstack-infra/project-config: Added new repos for fuel plugins  https://review.openstack.org/30108014:50
tdurakovAJaeger: thank you!14:50
AJaegertdurakov: that'S one way of doing it ;)14:50
fungilooks like gerrit-git-prep.sh still has fallback logic to use review.openstack.org/p14:50
*** moravec has quit IRC14:50
*** dizquierdo has quit IRC14:50
*** nadya has joined #openstack-infra14:50
*** burgerk has joined #openstack-infra14:50
*** ichukhnakov has joined #openstack-infra14:51
AJaegerinteresting was that I saw this in post jobs.14:51
prometheanfireis https://git.openstack.org/openstack/refstack-client suposed to be blank?14:51
AJaegerNot a single user showed up and complained (with exception of automaton)14:51
*** sdake_ has joined #openstack-infra14:51
fungilooks like if there's no $ZUUL_NEWREV it'll use gerrit? http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/gerrit-git-prep.sh14:51
AJaegerprometheanfire: try https://git.openstack.org/cgit/openstack/refstack-client14:51
*** moravec has joined #openstack-infra14:52
*** kzaitsev_mb has joined #openstack-infra14:52
*** dimtruck is now known as zz_dimtruck14:52
tdurakovAJaeger: is it possible to enable if I need multinode env ?14:52
*** ramishra_ has quit IRC14:53
AJaegerpabelanger: do we have multinode xenial set up already? ^14:53
fungiif memory serves, this was to deal with the possibility of longer replication delays to the git server farm. i wonder if that's still a risk or if we should just be going directly to jgit if we're that worried about replication14:53
openstackgerritMerged openstack-infra/puppet-unattended_upgrades: Indentation of the class parameter is refactored  https://review.openstack.org/29537814:53
fungialso, the zuul v3 push model solves this much more nicely, so maybe i'll stop caring for now14:54
*** nadya has quit IRC14:54
jeblairnibalizer, krotscheck: before 235617 lands, log into mirror-update, grab the lock file for that cronjob in screen, wait for 235617 to land, then run the npm mirror step from the cron job manually (but not the vos release) in screen.  when that is done, log into afs01.dfw and manually run vos release with the '-localauth' flag, also in screen.  when that is done, release the lock file.14:55
clarkbtdurakov: AJaeger we dont have multinode xenial yet but that is a simple nodepool.chamge to add14:55
*** nadya has joined #openstack-infra14:55
*** sdake has quit IRC14:55
*** ichukhnakov has quit IRC14:55
pabelangerAJaeger: no14:55
*** zeih has joined #openstack-infra14:55
*** ivc_ has joined #openstack-infra14:55
clarkbtdurakov: AJaeger basically just have to add the label to nodepool reusing the xenial images, plenty of examples in nodepool config currently14:55
jeblairnibalizer, krotscheck: (this is because both the initial sync and the initial vos release are likely to take much longer than the timeouts in the cron job, and possibly longer than the ticket lifetime validity for vos release)14:56
krotscheckjeblair: Doesn't the run time out after 2 minutes 30 seconds?14:56
pabelangerclarkb: tdurakov AJaeger: I need to spend some time today getting devstack-gate passing on xenial. Currently failing on mirror failures because backports and updates are empty14:56
clarkbpabelanger: oh fun14:56
pabelangerclarkb: Ya, just need to figure out the syntax to have devstack skip apt failures14:57
jeblairkrotscheck: 30 minutes14:57
krotscheckjeblair: Got it. So still too large a thing.14:58
jeblairkrotscheck: how long does an initial npm mirror sync take?14:59
krotscheckjeblair: Depends on how often it errors. It's 200+ GB14:59
*** mylu has joined #openstack-infra14:59
pabelangerthat's going to take a few days to sync between rax14:59
*** bkeller` has quit IRC14:59
krotscheckjeblair: If we have a terabit network, yay.14:59
* krotscheck would like a terabit network15:00
pabelanger14mbps was peak for xenial clone15:00
tdurakovAJaeger: where can I get multinode setup script? https://github.com/openstack-infra/project-config/blob/fa2c0df256647f762335aeb0f67f6719f2bcbb33/nodepool/nodepool.yaml#L6115:01
krotscheckjeblair, pabelanger: So, maybe wait until friday, then let it sync over the weekend?15:01
*** kengo_sakai_mba has joined #openstack-infra15:01
jeblairpabelanger: yeah, so probably ~1.5-2 days15:01
jeblairkrotscheck: no need to wait15:01
*** thorst_ has quit IRC15:02
pabelangerI forgot screen the first time, so I had run vos release twice.15:02
krotscheckAlrightey. nibalizer, I'm going to add all the things that jeblair said and add them to the ticket.15:02
*** angdraug has joined #openstack-infra15:02
*** bkeller` has joined #openstack-infra15:02
openstackgerritMerged openstack-infra/project-config: Translations: Temporarily stop master sync for python projects  https://review.openstack.org/30449315:03
openstackgerritMerged openstack-infra/puppet-mailman: Placement of the class parameter is refactored  https://review.openstack.org/29518115:03
*** ramishra_ has joined #openstack-infra15:04
openstackgerritPaul Belanger proposed openstack-infra/devstack-gate: Test commit  https://review.openstack.org/30303215:05
*** kengo_sakai_mba has quit IRC15:05
*** ramishra_ has quit IRC15:05
*** bdemers has quit IRC15:06
*** hichihara has quit IRC15:06
*** bdemers has joined #openstack-infra15:07
*** arxcruz has quit IRC15:08
*** afazekas has quit IRC15:09
*** ramishra_ has joined #openstack-infra15:09
*** afazekas has joined #openstack-infra15:09
*** zeih has quit IRC15:09
*** akaszuba has quit IRC15:10
*** sdake has joined #openstack-infra15:12
*** zeih has joined #openstack-infra15:13
*** ssancheztrujillo has quit IRC15:14
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Optimze entity events  https://review.openstack.org/30469015:15
openstackgerritAkihiro Motoki proposed openstack/requirements: Bump neutronclient to 4.2.0  https://review.openstack.org/30469115:15
*** Sukhdev has joined #openstack-infra15:15
*** mylu has quit IRC15:16
*** sdake_ has quit IRC15:16
*** mylu has joined #openstack-infra15:16
*** ddieterly has quit IRC15:16
openstackgerritMerged openstack-infra/openstackid-resources: Optimze entity events  https://review.openstack.org/30469015:16
*** openstackgerrit has quit IRC15:18
*** openstackgerrit has joined #openstack-infra15:18
*** doug-fish has joined #openstack-infra15:19
*** yamahata has quit IRC15:19
*** ayoung has joined #openstack-infra15:20
*** sc68cal has joined #openstack-infra15:20
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Fix archiving worklists  https://review.openstack.org/30469415:20
*** yamamoto has quit IRC15:21
*** yamamoto has joined #openstack-infra15:22
*** baoli_ has quit IRC15:22
*** salv-orlando has quit IRC15:22
*** jamesmcarthur has joined #openstack-infra15:23
*** doug-fish has quit IRC15:24
*** Sukhdev has quit IRC15:24
*** jaosorior has quit IRC15:24
*** achanda has joined #openstack-infra15:25
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Make it possible to remove filters when creating a new worklist  https://review.openstack.org/30470015:25
*** jamesmcarthur has quit IRC15:25
*** ramishra_ has quit IRC15:26
*** baoli_ has joined #openstack-infra15:26
*** kushal has joined #openstack-infra15:26
openstackgerritPaul Belanger proposed openstack-infra/devstack-gate: Test commit  https://review.openstack.org/30303215:26
*** armax has joined #openstack-infra15:28
*** asettle has joined #openstack-infra15:30
*** placko has quit IRC15:30
*** infra-red has quit IRC15:31
*** ramishra_ has joined #openstack-infra15:32
*** zz_dimtruck is now known as dimtruck15:33
*** logan- has quit IRC15:34
*** asettle has quit IRC15:35
openstackgerrityolanda.robla proposed openstack-infra/project-config: Fix path for magnum dependencies script  https://review.openstack.org/30470615:35
*** ramishra_ has quit IRC15:35
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Actually test stack-update to new tht  https://review.openstack.org/30470715:36
*** ddieterly has joined #openstack-infra15:36
openstackgerritKiall Mac Innes proposed openstack-infra/project-config: Add tempest variations of Designate DSVM jobs  https://review.openstack.org/30467715:36
openstackgerrityolanda.robla proposed openstack-infra/shade: Add shade call to get flavor access list  https://review.openstack.org/30417115:37
*** yarkot_ has joined #openstack-infra15:38
*** achanda has quit IRC15:38
*** jamesmcarthur has joined #openstack-infra15:38
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Actually test stack-update to new tht  https://review.openstack.org/30470715:39
*** logan- has joined #openstack-infra15:40
*** sdake_ has joined #openstack-infra15:41
*** tiswanso has quit IRC15:42
*** doug-fish has joined #openstack-infra15:42
*** dimtruck is now known as zz_dimtruck15:43
*** tiswanso has joined #openstack-infra15:43
*** tiswanso has quit IRC15:43
*** sdake has quit IRC15:43
*** fesp has joined #openstack-infra15:43
*** mikelk has quit IRC15:43
*** tiswanso has joined #openstack-infra15:44
pleia2good morning15:44
Zaraevening! :D15:45
*** fesp has quit IRC15:45
*** zeih has quit IRC15:45
*** doug-fish has quit IRC15:46
*** ramishra_ has joined #openstack-infra15:46
*** matrohon has quit IRC15:47
*** bpokorny has joined #openstack-infra15:48
*** salv-orlando has joined #openstack-infra15:48
*** mriedem_meeting is now known as mriedem15:49
*** zeih has joined #openstack-infra15:50
*** ramishra_ has quit IRC15:50
*** ddutta has quit IRC15:50
*** yamamoto has quit IRC15:51
*** vincentll has quit IRC15:51
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add support for Designate zones  https://review.openstack.org/30277015:51
*** ddieterly is now known as ddieterly[away]15:51
*** esikachev has quit IRC15:52
*** doug-fish has joined #openstack-infra15:52
anteayamorning pleia215:53
*** doug-fis_ has joined #openstack-infra15:54
*** jcoufal has quit IRC15:54
*** dtantsur|mtg is now known as dtantsur|afk15:54
*** zz_dimtruck is now known as dimtruck15:55
*** fawadkhaliq has joined #openstack-infra15:55
*** ddieterly[away] is now known as ddieterly15:55
*** sdake has joined #openstack-infra15:55
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/project-config: Enable designate on shade dsvm jobs  https://review.openstack.org/30472115:55
*** sdake_ has quit IRC15:55
*** nadya has quit IRC15:55
*** gongysh has joined #openstack-infra15:56
openstackgerritPaul Belanger proposed openstack-infra/system-config: Remove dependency on think_slave for wheel mirrors  https://review.openstack.org/30304715:56
pabelangerJust testing ^ locally now, so far wheels will still build15:57
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add support for Designate zones  https://review.openstack.org/30277015:57
pabelangerone step closer to remove thick_slave.pp15:57
rcarrillocruzmordred, Shrews: ^ the initial designate zones support on shade, with the corresponding dependency on project-config that enables designate on dsvm jobs15:57
*** ramishra_ has joined #openstack-infra15:58
*** doug-fish has quit IRC15:58
*** ifarkas has quit IRC15:58
*** sridhar_ram has joined #openstack-infra15:59
*** lucasagomes is now known as lucas-brno15:59
*** gyee has joined #openstack-infra16:00
trownhola infraers could I get added to https://review.openstack.org/#/admin/groups/1355,members as part of https://review.openstack.org/30414516:00
trownright now there are no members so no way to add members16:01
nibalizertrown: done16:01
*** esker has joined #openstack-infra16:01
*** MarkAtwood has joined #openstack-infra16:01
*** jsavak has quit IRC16:02
rcarrillocruznibalizer: heya, mind reviewing https://review.openstack.org/#/c/239810/ ? been around for a while, and looking for stuff to work on ...16:02
*** doug-fish has joined #openstack-infra16:02
*** yamamoto has joined #openstack-infra16:02
*** jsavak has joined #openstack-infra16:02
*** lezbar has joined #openstack-infra16:02
anteayamorning zaro16:03
mordredrcarrillocruz: NEAT!16:03
*** doug-fish has quit IRC16:03
*** doug-fish has joined #openstack-infra16:04
*** nmagnezi has quit IRC16:04
*** doug-fish has quit IRC16:04
zarorcarrillocruz: seriously, not busy enought?16:05
Shrewsrcarrillocruz: is designate not in the features matrix of devstack-gate?16:05
*** doug-fish has joined #openstack-infra16:05
rcarrillocruzmatrix as in 'DEVSTACK_ENABLE_DESIGNATE' ?16:05
*** doug-fis_ has quit IRC16:05
Shrewsrcarrillocruz: hrm, it's not16:05
Shrewsrcarrillocruz: yeah16:05
rcarrillocruzi just copy-pasta the designate.yaml stuff on our side16:05
Shrewsor DEVSTACK_GATE_DESIGNATE, rather16:05
crinklenibalizer: if you're on a review kick want to look at https://review.openstack.org/#/c/268349/ ? puppet-gerrit beaker tests have been failing for months without it16:06
* rcarrillocruz goes check what features matrix looks like on code16:06
*** vgridnev has quit IRC16:06
rcarrillocruzzaro: hah :D16:06
*** ddutta has joined #openstack-infra16:06
nibalizercrinkle: haha ok16:07
crinklenibalizer: ty16:07
*** zeih has quit IRC16:07
*** scheuran has quit IRC16:08
yolandahi crinkle, about 299661, the idea was to do the change in small steps. First having the nodepool::mysql class, then do the next changes for system-config. Actually this nodepool::mysql is harmless, will do nothing, until we don't start interacting with it, so that's why it's the first change. Then Mateusz will add more changes to manage database and configure that properly. But that will come on next steps16:08
zarorcarrillocruz: just the baby alone..:)16:08
rcarrillocruzzaro: lol, tell me about it, have to leave home to get 'work' done16:09
crinkleyolanda: i know it's harmless but it also can't be used effectively without additional changes in the nodepool module, system-config can't just start using it16:09
*** doug-fish has quit IRC16:09
*** gongysh has quit IRC16:09
yolandayep, i know and any change is trying to use it that way16:09
*** fawadkhaliq has quit IRC16:09
*** gongysh has joined #openstack-infra16:10
yolandawe just follow same pattern as other modules, add a ::mysql class, then update system-config to properly consume it16:10
*** gongysh has quit IRC16:10
*** lakshmiS has joined #openstack-infra16:10
yolandacrinkle, the idea is to do on baby steps, additional changes for puppet-nodepool need to be set as well16:11
*** bkeller^ has joined #openstack-infra16:11
crinkleyolanda: okay, i just didn't see that middle step when you explained it, and i still think that step could be combined in the add ::mysql class step16:12
*** bkeller` has quit IRC16:12
*** bkeller^ is now known as bkeller`16:12
*** asselin has quit IRC16:12
*** esker has quit IRC16:12
crinkleyolanda: i'll remove my -1 and i'll revisit when the other nodepool changes and system-config change is proposed16:13
*** ramishra_ has quit IRC16:13
*** fawadkhaliq has joined #openstack-infra16:13
*** ramishra_ has joined #openstack-infra16:14
*** fernnest has joined #openstack-infra16:16
*** shashank_hegde has joined #openstack-infra16:16
*** tphummel has joined #openstack-infra16:18
*** dimtruck is now known as zz_dimtruck16:19
*** asselin has joined #openstack-infra16:19
*** brucet has joined #openstack-infra16:19
*** dizquierdo_ has quit IRC16:20
*** derekh has quit IRC16:20
*** coreyob has quit IRC16:20
*** Qiming has quit IRC16:22
pleia2reno is a pretty cool thing16:22
*** dalgaaf has joined #openstack-infra16:22
pleia2never actually used it until just now16:22
fungidhellmann writes cool stuff16:22
pleia2yeah :)16:22
* rcarrillocruz is a proud user of virtualenvwrapper16:23
anteayapleia2: what did you use it on?16:23
pleia2anteaya: puppet-nova16:23
*** ramishra has quit IRC16:23
clarkbthe hardest part of using reno is remembering to add info when you write changes16:24
*** alex_xu_ has quit IRC16:24
openstackgerritMerged openstack-infra/lodgeit: Remove extraneous trailing slashes from link URLs  https://review.openstack.org/26598916:24
anteayapleia2: nice16:24
*** achanda has joined #openstack-infra16:25
pleia2clarkb: yeah, I wouldn't have if it wasn't pointed out to me by a reviewer16:25
*** BigWillie has joined #openstack-infra16:25
openstackgerritMerged openstack-infra/lodgeit: Add a .mailmap file  https://review.openstack.org/28512416:25
pleia2though if I were working on more projects that used it I'd likely set up a commit hook in git to remind me16:26
fungithough you can also add info afterward in a separate change16:26
fungiand i think the intent is that not every single change needs release notes, only significant behavior changes16:26
pleia2imagine my surprise in mitaka when I learned nova now needs two databases (guess who didn't read the nova release notes o/)16:27
fungiif you add release notes on every change, then it becomes no better than scraping commit logs16:27
*** sc68cal has quit IRC16:27
*** esikachev has joined #openstack-infra16:27
clarkbfungi ya, I just know because I backfilled occ release notes after they added reno16:28
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/shade: [WIP] Just testing a python-keystoneclient change  https://review.openstack.org/30476116:30
*** achanda has quit IRC16:30
*** alex_xu has joined #openstack-infra16:30
* rcarrillocruz just realized missed adding reno notes on the shade designate change16:31
*** jlanoux_ has quit IRC16:32
*** tphummel has quit IRC16:33
*** ramishra_ has quit IRC16:33
*** gongysh has joined #openstack-infra16:33
*** gongysh has quit IRC16:33
*** sshnaidm has quit IRC16:33
*** mylu has quit IRC16:34
*** cdent has joined #openstack-infra16:34
jeblairrcarrillocruz: it's never too late!16:34
*** coreyob has joined #openstack-infra16:34
zarofungi: any chance you can help move this forward, i think it will help reviewing: https://review.openstack.org/#/c/260324/16:34
jeblairpleia2: nova what now?16:35
nibalizerpleia2: double database all the way16:35
jeblairtwo whats?16:35
*** shashank_hegde has quit IRC16:36
pleia2computer things16:36
* jeblair reads the release notes16:36
*** jethrosun_ has joined #openstack-infra16:37
pleia2it now has a separate nova and nova_api database, the latter was added in liberty but became required in mitaka16:37
jeblairwhat would be really cool would be an explanation of *why* it needs two16:37
clarkbjeblair ++16:37
zarofungi: it won't have any effect until we rev gerrit version anyway.16:37
jeblair(as a sysadmin, i have just been told to voodoo, and don't know how to set up, say, appropriate security contexts or performance characteristics for the second db)16:38
*** kzaitsev_mb has quit IRC16:38
pleia2I'm sure there's a discussion somewhere, but I haven't read it, discussion would have likely happened in the liberty cycle some time16:38
jeblair[what? you put your api db in the same timezone as your not-api-db?  everyone knows not to do that!]16:39
clarkbthere is likely a spec16:39
jethrosun_Hello, my patch(change#300710) to fix bug #1558754 is at the status of "Needs workflow", could someone take a look and also give a review? Thx16:39
openstackbug 1558754 in OpenStack Object Storage (swift) "remove devices before min-part-hours requires --force" [Undecided,Fix released] https://launchpad.net/bugs/1558754 - Assigned to Jethro Sun (shwsun)16:39
fungilack of reasons in release notes is what keeps the #openstack-nova channel in business! ;)16:39
jeblairfungi: good point, we wouldn't want this to be easy16:40
anteayajethrosun_: that is a patch to the swift repository16:41
fungijethrosun_: did you mean to ask that in a different channel?16:41
anteayajethrosun_: I suggest you join the #openstack-swift channel and chat with folks there16:42
jethrosun_Aha, thx16:42
anteayayou are welcome16:42
*** apoorvad has joined #openstack-infra16:42
rossella_sfungi clarkb, jeblair hi! I'd really appreciate if you could have a look again at https://review.openstack.org/#/c/301255/ and https://review.openstack.org/#/c/298779/ . Neutron devs would appreciate to get this online. thanks a lot!16:42
fungijethrosun_: for future reference, there is a list of openstack irc channels at https://wiki.openstack.org/wiki/IRC16:42
jethrosun_Really helpful, I am a newbie and just start to contribute.16:44
anteayajethrosun_: welcome16:44
brucetHello everyone. Is this the place I go if I am having trouble with tools?16:44
clarkbnew db is part of cells v216:44
anteayabrucet: what tool?16:44
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add ubuntu xenial wheel mirror  https://review.openstack.org/30478216:44
brucetgit review16:44
anteayabrucet: this is the place16:44
anteayabrucet: do share your story16:44
brucetHere's what I keep getting:16:44
brucetgit review16:45
brucetThe branch 'master' does not exist on the given remote 'gerrit'. If16:45
brucetthese changes are intended to start a new branch, re-run with the '-R'16:45
brucetoption enabled.16:45
jeblairclarkb: ah, thanks.  i was looking at specs and not finding it.  i was looking for things like 'database' though.16:45
fungibrucet: what repo are you trying to submit a review on?16:45
clarkbwas added in kilo16:45
clarkbbut made unoptional in mitaka16:45
*** jethrosun_ has quit IRC16:45
nibalizeryolanda: haha hi516:45
nibalizersuper added to the group :P16:45
*** sambetts is now known as sambetts|afk16:45
yolandaoh i was faster :)16:46
*** doug-fish has joined #openstack-infra16:46
brucetIs that what you want?16:46
pleia2nibalizer, yolanda - I love the ones from Mateusz, they always include the review link and are the committer, so not much work is needed to verify :)16:47
*** akshai has quit IRC16:47
*** kzaitsev_mb has joined #openstack-infra16:47
brucet<fungi> remote.origin.url=http://github.com/openstack/tacker.git16:47
anteayabrucet: we use git.openstack.org for all our repos, github is just a mirror, we don't accept patches on github16:47
anteayabrucet: http://git.openstack.org/cgit/openstack/tacker/16:47
*** dprince has quit IRC16:47
*** pfallenop has joined #openstack-infra16:47
fungibrucet: yeah, looks like openstack/tacker has a master branch16:47
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add ubuntu xenial wheel mirror  https://review.openstack.org/30478216:47
fungibrucet: interesting that git review thinks gerrit doesn't have one for it16:48
clarkbwhat does git remote -v say ? also git review -v?16:48
fungibrucet: try getting more output by running `git review -v`16:48
fungiand putting the details on http://paste.openstack.org/ and let us know the url16:48
openstackgerritMerged openstack-infra/project-config: Fix path for magnum dependencies script  https://review.openstack.org/30470616:50
brucet<fungi> http://paste.openstack.org/show/493833/16:50
*** fawadkhaliq has quit IRC16:50
fungibrucet: yeah, clarkb's suggestion to run `git remote -v` will be helpful in this case16:51
fungisince i have a feeling your "gerrit" remote isn't pointing to where it should16:51
*** Sukhdev has joined #openstack-infra16:52
*** ddutta has quit IRC16:52
funginormally git review should add a gerrit remote for you automatically, but if you added your own gerrit remote some other way then that could explain it16:52
*** akshai has joined #openstack-infra16:52
*** fawadkhaliq has joined #openstack-infra16:53
*** bpokorny has quit IRC16:53
brucet<fungi> http://paste.openstack.org/show/493834/16:53
*** ramishra has joined #openstack-infra16:54
*** ramishra has quit IRC16:54
openstackgerritMerged openstack-infra/puppet-reviewday: Run pip install to install the dependencies  https://review.openstack.org/30125516:54
fungiclarkb: you've played around with gerrit's push via https before, right? does that look correct to you?16:54
*** Guest15115 has quit IRC16:55
anteayaI just submitted a dummy patch to tacker successfully: http://paste.openstack.org/show/493835/16:55
brucetOK. This is my first commit. I've tried to follow all the docs. I don't know what's wrong.16:57
*** trown is now known as trown|lunch16:57
*** Guest5593 has quit IRC16:58
fungibrucet: it's possible this is a combination of incomplete account setup and vague error handling on https pushes16:58
*** salv-orlando has quit IRC16:58
brucetWhich account are you talking about?16:59
fungibrucet: did you follow the instructions at http://docs.openstack.org/infra/manual/developers.html#account-setup to create your foundation member and launchpad accounts with similar e-mail addresses, then agree to the icla in gerrit and submit contact information with it?16:59
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Do Not Merge: Test stack-update  https://review.openstack.org/30478716:59
anteayahere is my remote -v: http://paste.openstack.org/show/493836/16:59
anteayabrucet: you have openstack.org port at 44317:00
anteayamine is at 2941817:00
*** tiswanso has quit IRC17:00
fungianteaya: yeah, he's trying to do https pushes instead of ssh over 29418, possibly due to egress filtering on his originating network17:00
brucetNo. I just copied what someone else was doing17:00
*** flepied has quit IRC17:00
brucetI tried 29418 and it did the same thing17:01
fungibrucet: by "the same thing" you mean "it didn't work" or "it provided exactly the same error messages"?17:01
brucetI did the account setup a while ago.17:01
brucetI can go through it again....17:01
*** jamesmcarthur has quit IRC17:02
brucetIsn't there some kind of trace facility to show what went wrong?17:02
brucet<fungi> yes17:02
brucet<fungi> extactly the same error messages17:02
fungibrucet: given that i'm not confident in gerrit's and git-review's error reporting for push over https, let's rewind this to the default ssh push remote17:03
*** akshai has quit IRC17:03
brucetyou want me to try 29418 with SSL?17:03
*** rossella_s has quit IRC17:03
brucetSo try 29418 with SSL then17:03
*** akshai has joined #openstack-infra17:03
*** rossella_s has joined #openstack-infra17:03
fungirun `git remote remove gerrit`17:03
fungiand then `git review` again17:04
*** ramishra has joined #openstack-infra17:04
*** sambetts|afk has quit IRC17:04
*** tiswanso has joined #openstack-infra17:04
fungithat should readd default gerrit pull/push remotes based on the .gitreview file17:04
openstackgerritVictor Morales proposed openstack-infra/elastic-recheck: Add query for neutron bug 1567668  https://review.openstack.org/30478917:05
openstackbug 1567668 in neutron "Functional job sometimes hits global 2 hour limit and fails" [High,In progress] https://launchpad.net/bugs/1567668 - Assigned to Jakub Libosvar (libosvar)17:05
fungiit will assume your local username is the same as your gerrit username, but if it's not (or if it gets an error back and so thinks it's different) it will prompt you to specify a gerrit username17:05
*** sambetts has joined #openstack-infra17:06
*** ramishra has quit IRC17:06
*** fhubik has quit IRC17:07
*** ggillies has quit IRC17:08
openstackgerritMerged openstack-infra/puppet-gerrit: Add logic to use use available mysql module  https://review.openstack.org/26834917:09
*** ramishra has joined #openstack-infra17:09
brucetWhat do you mean by my "localusername"??17:10
brucetYes it did ask me to specify my gerrit username17:10
*** ggillies has joined #openstack-infra17:10
*** doug-fish has quit IRC17:10
brucet<fungi> What do you mean by my "localusername"??17:10
*** doug-fish has joined #openstack-infra17:11
brucet<fungi> should we just talk directly?17:11
fungibrucet: by default it assumes your gerrit username is identical to the contents of $USER in your environment17:11
brucetOh. It's not17:12
fungiwhich is fine then, that's why it asks you what your username in gerrit is17:12
*** esikachev has quit IRC17:13
*** doug-fish has quit IRC17:13
fungibrucet: the username you tell it should match what you see listed as your username at https://review.openstack.org/#/settings/17:14
KiallHey guys, any project-config core's about for a review? https://review.openstack.org/#/c/304677/ adds some new experimental jobs to Designate to make use of it's new tempest plugin.17:14
*** zz_dimtruck is now known as dimtruck17:15
fungibrucet: also, it looks like openstack/tacker requires a signed contributor license agreement, so make sure you see it saying you've agreed to the ICLA at https://review.openstack.org/#/settings/agreements17:15
*** jistr has quit IRC17:15
brucetGot the license agreement17:15
fungibrucet: and the ICLA requires contact information, so check that https://review.openstack.org/#/settings/contact has bold text saying "Contact information last updated on <some date>"17:16
*** bpokorny has joined #openstack-infra17:16
*** mriedem has left #openstack-infra17:17
brucet<fungi> It has full name and registered email17:17
*** mriedem has joined #openstack-infra17:17
*** jordanP has quit IRC17:17
*** cdent has left #openstack-infra17:17
toskyKiall: out of curiosity (as I need to do the same for Sahara), did you check/know/consider https://review.openstack.org/#/c/297446/ ?17:17
brucetDoes not say "Contact information last updated on <some date>"17:17
*** ramishra has quit IRC17:17
*** ddieterly is now known as ddieterly[away]17:18
fungibrucet: do you see bold text between " Once saved, you will be unable to retrieve previously stored contact details." and the Mailing Address field?17:18
brucetI need to register a mailing address?????17:19
fungithat's where the "Contact information last updated on <some date>" appears for me, so likely you have not filed contact information17:19
*** piet has joined #openstack-infra17:19
*** Sukhdev has quit IRC17:19
brucetDidn't know I had to17:19
fungibrucet: you can put anything in that field, we're just abusing gerrit's contact information api to ping the openstack foundation site with your preferred e-mail address so it can link up to your foundation member account17:19
brucetIt won't accept my contact info anyways17:20
fungibrucet: right, the foundation member account you created needs to have the same primary e-mail address as your preferred e-mail address in gerrit for this to work17:20
*** andymaier has joined #openstack-infra17:20
Kialltosky: I've seen that, but as we're a devstack plugin too.. we handle the install there anyway, we could add that DSG flag too, but I don't believe it will make any proctical difference17:20
fungibrucet: revisit the second paragraph of http://docs.openstack.org/infra/manual/developers.html#account-setup and double-check that's stuff you've done17:21
*** degorenko is now known as _degorenko|afk17:21
openstackgerritMateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Added nodepool::mysql class  https://review.openstack.org/29966117:21
toskyKiall: sahara has a devstack plugin too, but for sahara, not for sahara-tests; did you write a devstack plugin for designate-tempest-plugin?17:22
Kialltosky: Near as I can tell, that has been writtin to allow for installing master of $tempest-plugin-repo when you have, say, stable/liberty of the service installed. Designate chose to use a entirely separate, branchless, repo for the tempest plugin, so that piece doesn't benifit us.17:22
*** vgridnev has joined #openstack-infra17:22
*** doug-fish has joined #openstack-infra17:22
Kiallthe designate repo has a devstack plugin that installs designate, our Horizon plugin, our Tempest plugin, our client etc17:22
*** tphummel has joined #openstack-infra17:23
toskyuhm, I see17:23
KiallAlso, we can't just use the standard DSVM job templates, as we need multiple variations to exercise the different backends we support.. So.. Lots of things lining up to just handle that ourselves :)17:24
*** salv-orlando has joined #openstack-infra17:24
toskyKiall: but then, from the jobs point of view, as designate-tempest-plugin is installed by the devstack plugin in designate, you just need to add it to PROJECTS in the jjb and that's it?17:24
toskyKiall: and how does it work when you want to test changes to designate-tempest-plugin itself? It is handled by the devstack plugin?17:25
toskyI guess I should clone that repo17:26
KiallYep, but our old jobs did things like `export DEVSTACK_GATE_TEMPEST_NOTESTS=1`, which meant that tempest would be installed, but not executed (as we needed the tempest.conf for our tempest-lib based tests). And.. We need different jobs for our previous releases, as they don't have a plugin...17:26
asselinKiall, clarkb dstufft regarding this issue: https://bitbucket.org/pypa/bandersnatch/issues/61/bandersnatch-deleting-packages do you see any reason not to make the files immutable to work around that bug?17:26
Kiallasselin: is that.. Ramy?17:27
*** Sukhdev has joined #openstack-infra17:27
asselinKiall, yes, hi :)17:27
*** doug-fish has quit IRC17:27
KiallAh.. Was wondering why you asked me! Must have seen my JIRA comment from earlier? hah :)17:28
*** _amrith_ is now known as amrith17:28
*** davideag_ has quit IRC17:28
Kialltosky: yes, the same jobs are used against designate and the designate-tempest-plugin repos, cloning both etc.17:28
asselinyeah...and you're chatting, so I thought I'd include you. we were looking at this a bit yesterday17:28
*** ramishra has joined #openstack-infra17:29
openstackgerritMateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Added nodepool::mysql class  https://review.openstack.org/29966117:29
*** davidlenwell has quit IRC17:29
*** sshnaidm has joined #openstack-infra17:30
toskyKiall: so it's the devstack plugin which applies the patch that need to be tested?17:30
Kialltosky: We went with a separate repo for the tempest plugin, as backporting tests sounded fragile, and gave no guarantees about cross-release compatibility - since you can change the code and tests in 1 patch.. And.. openstack/designate's requirements will "pin" when we ship releases.. at some point, we're bound to hit issues that installing the plugin from openstack/designate's master branch has conflicting requirements with openstack/17:31
Kialldesignate's stable/foo branch.. So, we decided on a new repo.17:31
*** lakshmiS has quit IRC17:31
KiallNo, the Jenkins jobs and devstack-gate stuff get all the repos cloned down at the right branches / patchsets, before the plugin starts running17:32
*** mrmartin has quit IRC17:32
*** davideagnello has joined #openstack-infra17:32
toskyKiall: you don't have to convince me about the branchless thing, we did the same in Sahara :)17:32
toskyKiall: but I was interested in the technical details17:32
KiallAh, well - you must be the only other project doing that! We couldn't find any other examples :)17:33
Kiall(or - sahara-tests wasn't an obvious repo name for me :))17:33
KiallLooks like it was the latter ;)17:34
*** achanda has joined #openstack-infra17:34
*** flepied has joined #openstack-infra17:35
toskyKiall: we didn't migrate the tempest tests yet, there were "only" scenario tests, that's why17:36
*** davidlenwell has joined #openstack-infra17:36
*** salv-orl_ has joined #openstack-infra17:37
toskyand the migration is ongoing (code merged, enabled on the Sahara CI, but not yet in the gates, so the code is still also in Tempest)17:37
*** ramishra has quit IRC17:37
*** shashank_hegde has joined #openstack-infra17:38
*** rfolco has quit IRC17:38
*** rfolco has joined #openstack-infra17:39
KiallAh - So I wasn't just blind :)17:39
*** doug-fish has joined #openstack-infra17:39
*** salv-orlando has quit IRC17:39
*** angdraug has quit IRC17:40
*** sdake_ has joined #openstack-infra17:40
*** lakshmiS has joined #openstack-infra17:40
*** pfallenop has quit IRC17:41
*** lakshmiS_ has joined #openstack-infra17:41
*** esikachev has joined #openstack-infra17:43
*** sdake has quit IRC17:43
*** ramishra has joined #openstack-infra17:43
*** mriedem1 has joined #openstack-infra17:44
*** amrith is now known as _amrith_17:44
*** mriedem has quit IRC17:44
*** lakshmiS has quit IRC17:45
*** jaosorior has joined #openstack-infra17:45
*** flwang1 has joined #openstack-infra17:45
*** vgridnev has quit IRC17:46
*** shardy has quit IRC17:47
*** tricksters has joined #openstack-infra17:48
*** ramishra has quit IRC17:48
*** mriedem1 is now known as mriedem17:49
*** tricksters is now known as elopez17:49
*** ramishra has joined #openstack-infra17:49
*** andymaier has quit IRC17:50
*** ybathia has joined #openstack-infra17:51
*** eric_lopez has quit IRC17:52
*** sdake has joined #openstack-infra17:54
*** Swami has joined #openstack-infra17:54
*** pvaneck has joined #openstack-infra17:54
*** jsavak has quit IRC17:55
*** sigmavirus24 is now known as sigmavirus24_awa17:55
*** BigWillie has quit IRC17:56
*** sdake_ has quit IRC17:57
*** BigWillie has joined #openstack-infra17:57
*** cody-somerville has joined #openstack-infra17:57
*** cody-somerville has quit IRC17:57
*** cody-somerville has joined #openstack-infra17:57
*** trown|lunch is now known as trown17:57
*** yarkot_ has quit IRC17:57
*** ramishra has quit IRC17:59
*** jaosorior has quit IRC17:59
*** ramishra has joined #openstack-infra18:00
*** chem has quit IRC18:02
*** kengo_sakai_mba has joined #openstack-infra18:02
*** austin81 has joined #openstack-infra18:02
*** Nisha has joined #openstack-infra18:03
*** vaidy has quit IRC18:03
*** vaidy has joined #openstack-infra18:04
*** bkeller` has quit IRC18:05
*** oanson has joined #openstack-infra18:06
*** kzaitsev_mb has quit IRC18:06
*** kengo_sakai_mba has quit IRC18:07
*** jsavak has joined #openstack-infra18:07
*** bkeller` has joined #openstack-infra18:08
*** ramishra has quit IRC18:09
*** ramishra has joined #openstack-infra18:10
anteayafungi: can we have a minute to discuss the rename patch in today's meeting?18:12
anteayafungi: can you work it in or should I put something on the agenda?18:12
pleia2I would put it on the agenda18:12
anteayafungi: I learned more about odyssey4me's expected timing on that patch18:12
*** sigmavirus24_awa is now known as sigmavirus2418:12
anteayapleia2: sounds good18:12
fungiyep, agenda18:13
fungii'm about to start cleaning it up from last week, but i'll make sure not to conflict with new additions18:13
anteayaat the end of it?18:13
*** infra-red has joined #openstack-infra18:13
fungiadd it to the end of the general topics before open discussion18:13
*** Sukhdev has quit IRC18:14
anteayaI put it at the end18:14
anteayagreat thank you18:14
*** jamesmcarthur has joined #openstack-infra18:14
*** ybathia has quit IRC18:14
*** ramishra has quit IRC18:16
Nishaanteaya, I am here18:16
rcarrillocruzmoving back home18:16
rcarrillocruzbefore meeting18:16
anteayaNisha: wonderful, welcome18:17
anteayarcarrillocruz: safe travels18:17
*** ramishra has joined #openstack-infra18:17
Nishaanyone seen this error and know how to resolve this "Slave went offline during the build"18:17
anteayaNisha: one of the best things you can do for yourself is read the channel logs: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/18:17
prometheanfirecan anyone edit the design summit / newton etherpads wiki?18:18
anteayaNisha: what did I say about context?18:18
*** ramishra has quit IRC18:18
*** ddieterly[away] has quit IRC18:18
anteayaNisha: if you read the channel logs regularly you will see what issues others have with their third party ci systems18:18
Nishaanteaya, i am looking into the logs ...was just asking a quick info if anyone has any insight on this kind of error18:18
anteayaNisha: I asked you to make it clear when you ask a question that you are asking about your third party ci system, not our testing system18:19
prometheanfireyes, neat18:19
anteayaprometheanfire: do you mean this page: https://wiki.openstack.org/wiki/Design_Summit/Newton/Etherpads18:19
prometheanfireya, already updated the OSA one18:20
Nishaanteaya, oh. Ye sthis kind of error is seen in our third party CI for iLO drivers18:20
anteayaprometheanfire: yes anyone has permissions to edit that page, usually this page is just a list of etherpads that correspond to sessions that are in the design summit schedule18:20
*** angdraug has joined #openstack-infra18:20
prometheanfireya, that's what I added https://etherpad.openstack.org/p/openstack-ansible-newton-summit18:21
anteayaNisha: great, be sure to tell people that every time you ask a question18:21
anteayaprometheanfire: wonderful, then yes you are fine18:21
Nishaanteaya, sure18:21
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Filter nonexistent groups in who-approves.py  https://review.openstack.org/29259418:21
anteayaNisha: thank you18:21
anteayaNisha: are you familiar with using a paste service?18:22
*** oanson has quit IRC18:22
Nishaanteaya, yeah18:22
*** achanda has quit IRC18:23
anteayagreat, so if you ask a question about an error we usually can't do much with it unless it is accompanied with a build log or stack trace18:23
*** ramishra has joined #openstack-infra18:23
anteayaso when you find your build log or stack trace that proceeds and includes your error, please put it in a paste and link the paste in channel18:23
Nishaanteaya, http://paste.openstack.org/show/493848/18:23
*** ihrachys has quit IRC18:23
*** kukacz has quit IRC18:24
anteayaNisha: that is much more useful18:24
anteayathank you18:24
Nishaanteaya, :)18:24
*** infra-red has quit IRC18:24
*** infra-red has joined #openstack-infra18:25
*** ajmiller_ has joined #openstack-infra18:25
anteayaNisha: stay in channel it might be a while before some has a moment to look at your paste18:25
anteayaI'm going to get something to eat prior to the -infra meeting18:25
*** ajmiller has quit IRC18:26
pabelangerNisha: anteaya: Is it possible you are using nodepool to manage your jenkins slave?18:26
*** salv-orl_ has quit IRC18:26
Nishapabelanger, No18:26
Nishapabelanger, could you explain node pool?18:26
*** salv-orlando has joined #openstack-infra18:27
pabelangerNisha: Nodepool is a system for launching single use test nodes for jenkins: http://docs.openstack.org/infra/nodepool/18:27
*** ajmiller_ has quit IRC18:27
pabelangerdepending on how you setup 3rd party CI, you might have configured it18:27
*** ajmiller has joined #openstack-infra18:27
*** ramishra has quit IRC18:28
Nishapabelanger, No we dont use18:28
*** ramishra has joined #openstack-infra18:28
pabelangerNisha: How is your jenkins slave setup?18:29
pabelangerlooking at the pastebin that error to me would mean the far end slave went down18:30
pabelangermaybe SSH connection or actual node18:30
Nishapabelanger, i didnt setup that myself. so i dont know jenkins so well...but i have the steps which were used to configure the slave18:30
*** baoli_ has quit IRC18:30
pabelangerNisha: Ya, looking at the backtrace I think your network went down between your jenkins master and jenkins slave18:31
pabelangereither because of a network blip or the slave was rebooted18:31
*** salv-orlando has quit IRC18:31
*** jsavak has quit IRC18:31
Nishapabelanger, but thats just devstack running at that time.18:32
Nishaso i am not sure what can cause the network to go down18:32
Nishaand it happens at any point of time18:32
*** jsavak has joined #openstack-infra18:32
*** brucet has quit IRC18:32
Nishaif this issue is not there then the gate setup using this slave works fine18:33
pabelangerNisha: are you able to SSH into your jenkins slave?18:34
Nishasometimes even this kind of trace is seen http://paste.openstack.org/show/493855/18:34
Nishaafter this error sometimes yes and sometimes No18:34
Nishausually just restarting the zuul, and jenkins service helps18:35
*** sigmavirus24 is now known as sigmavirus24_awa18:35
Nishabut in worst case i have to restart the jenkinsmaster18:35
*** sigmavirus24_awa is now known as sigmavirus2418:35
NishaSometimes it just fails at Loading plugin monitoring18:36
NishaSEVERE: Failed Loading plugin monitoring18:37
Nishajava.io.IOException: Failed to initialize18:37
pabelangerquick google shows https://issues.jenkins-ci.org/browse/JENKINS-32441 for the last error18:37
pabelangerpossible issue with the plugin18:37
AJaegerproject-config cores, I'm nearly finished with translation changes and thus ready to reenable syncing. Reviews of https://review.openstack.org/#/c/304494/ are welcome. I'll remove WIP once I'm done... Thanks!18:37
*** fawadkhaliq has quit IRC18:38
*** brucet has joined #openstack-infra18:38
*** fawadkhaliq has joined #openstack-infra18:38
*** ramishra has quit IRC18:39
openstackgerritMerged openstack-infra/puppet-gerrit: Allow puppet to configure Gerrit's download protocols  https://review.openstack.org/30059618:39
*** ramishra has joined #openstack-infra18:39
*** infra-re_ has joined #openstack-infra18:42
*** fawadkhaliq has quit IRC18:43
*** ybathia has joined #openstack-infra18:43
*** fawadkhaliq has joined #openstack-infra18:43
Nishapabelanger, now http://paste.openstack.org/show/493859/ No idea why its stuck again18:44
*** tiswanso has quit IRC18:44
anteayaNisha: when someone shares some useful information with you, it is considered courteous to say thank you18:45
*** daemontool has quit IRC18:45
anteayapabelanger: thank you for helping, Paul18:45
*** mrmartin has joined #openstack-infra18:45
anteayaNisha: it is your job to get your system working, not ours, we will help to the best of your ability be be mindful of where the responsibility lies18:45
Nishaanteaya, yeah. Thanks pabelanger18:45
NishaThanks anteaya18:46
NishaI will see18:46
*** infra-red has quit IRC18:46
*** yarkot_ has joined #openstack-infra18:46
anteayawork with that and then come back when you need to18:46
*** Sukhdev has joined #openstack-infra18:46
pabelangerNisha: I'll take jenkins out of the picture. See what happens if you SSH into the slave and run the test manually.18:47
pabelangerNisha: only thing I can think of, is something in Jenkins is not reacting well to your remove slave18:47
pabelangerbut I do not know why18:47
*** Sukhdev has quit IRC18:47
pabelangerNisha: anteaya: np18:47
*** ybathia has quit IRC18:47
*** rfolco_ has joined #openstack-infra18:48
Nishapabelanger, yeah thanks. I missed the link you gave earlier...was working on CI to see if can make that working :)18:48
*** Sukhdev has joined #openstack-infra18:48
NishaJust now saw the link...will see if we have something similar18:48
Nishapabelanger, i am facing this manually, right now.18:49
*** ramishra has quit IRC18:49
*** Sukhdev has quit IRC18:49
*** ramishra has joined #openstack-infra18:50
*** rfolco has quit IRC18:50
*** avarner has quit IRC18:51
*** oanson has joined #openstack-infra18:52
openstackgerritMerged openstack-infra/puppet-mailman: Add apache 2.4 support  https://review.openstack.org/28491318:52
*** fawadkhaliq has quit IRC18:52
*** ramishra has quit IRC18:54
*** ramishra has joined #openstack-infra18:54
*** fawadkhaliq has joined #openstack-infra18:54
*** ramishra has quit IRC18:54
*** keedya has quit IRC18:55
*** Nisha has quit IRC18:55
*** bpokorny_ has joined #openstack-infra18:57
*** bpokorny_ has quit IRC18:57
*** fawadkhaliq has quit IRC18:58
*** bpokorny_ has joined #openstack-infra18:58
*** fawadkhaliq has joined #openstack-infra18:59
*** placko has joined #openstack-infra18:59
*** ddieterly has joined #openstack-infra19:00
*** fawadkhaliq has quit IRC19:00
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:00
openstackgerrityolanda.robla proposed openstack-infra/project-config: Fix target for magnum image builds  https://review.openstack.org/30481919:00
*** chem has joined #openstack-infra19:01
*** fawadkhaliq has joined #openstack-infra19:01
*** esikachev has quit IRC19:01
*** tiswanso has joined #openstack-infra19:01
*** bpokorny has quit IRC19:01
*** avarner has joined #openstack-infra19:04
*** yuanying has quit IRC19:04
*** jamesmcarthur has quit IRC19:04
*** achanda has joined #openstack-infra19:05
*** hdd has joined #openstack-infra19:05
*** achanda has quit IRC19:05
openstackgerritMerged openstack-infra/puppet-mailman: Add missing cgid module  https://review.openstack.org/28491719:05
*** dprince has joined #openstack-infra19:06
*** ramishra has joined #openstack-infra19:06
*** infra-red has joined #openstack-infra19:07
*** jamesmcarthur has joined #openstack-infra19:09
*** infra-re_ has quit IRC19:09
*** Sukhdev has joined #openstack-infra19:10
*** ramishra has quit IRC19:11
*** mrmartin has quit IRC19:11
*** piet has quit IRC19:12
*** ramishra has joined #openstack-infra19:13
*** akaszuba has joined #openstack-infra19:15
*** coreyob has quit IRC19:15
*** mylu has joined #openstack-infra19:16
*** bpokorny_ has quit IRC19:16
*** fawadkhaliq has quit IRC19:20
*** yamahata has joined #openstack-infra19:20
*** fawadkhaliq has joined #openstack-infra19:20
*** ramishra has quit IRC19:21
*** coreyob has joined #openstack-infra19:21
*** flepied has quit IRC19:21
*** vgridnev has joined #openstack-infra19:21
*** ramishra has joined #openstack-infra19:22
*** placko has quit IRC19:23
*** mylu has quit IRC19:24
*** gyee has quit IRC19:24
*** mylu has joined #openstack-infra19:26
*** gyee has joined #openstack-infra19:26
*** mylu has quit IRC19:26
*** gyee has quit IRC19:31
*** ramishra has quit IRC19:31
*** ramishra has joined #openstack-infra19:31
*** doug-fish has quit IRC19:33
*** mylu has joined #openstack-infra19:33
*** flwang1 has quit IRC19:34
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/shade: [WIP] Test with a python-keystoneclient change from git/gerrit  https://review.openstack.org/30483319:34
*** doug-fis_ has joined #openstack-infra19:35
dimsmordred : last 2 times python-keystoneclient broke shade, it was in the functional tests...right?19:35
dimsmordred : logs went away, so guessing19:35
mordreddims: yah19:35
mordreddims: to be fair to keystoneclient- the last time it broke us it was actually our fault19:35
*** brucet has quit IRC19:35
mordreddims: and it was actually neutron19:35
mordredbut yes19:35
*** doug-fis_ has quit IRC19:36
*** mylu has quit IRC19:36
*** doug-fis_ has joined #openstack-infra19:36
*** doug-fis_ has quit IRC19:36
*** mylu has joined #openstack-infra19:36
dimsmordred : ack. i was told that this change https://review.openstack.org/#/c/293048/ broke shade tests twice19:36
*** doug-fis_ has joined #openstack-infra19:36
*** ociuhandu has quit IRC19:37
*** dtardivel has quit IRC19:38
*** doug-fish has joined #openstack-infra19:38
*** esker has joined #openstack-infra19:38
*** ybathia has joined #openstack-infra19:39
*** mrmartin has joined #openstack-infra19:40
*** pfallenop has joined #openstack-infra19:40
*** ybathia has quit IRC19:40
*** doug-fis_ has quit IRC19:41
*** ramishra has quit IRC19:41
*** oanson has quit IRC19:41
*** hdd has quit IRC19:41
*** ramishra has joined #openstack-infra19:42
*** doug-fish has quit IRC19:42
*** sc68cal has joined #openstack-infra19:44
*** sc68cal is now known as Guest4887319:44
*** ramishra has quit IRC19:45
*** Sukhdev has quit IRC19:45
*** ramishra has joined #openstack-infra19:47
*** brucet has joined #openstack-infra19:47
openstackgerritBrant Knudson proposed openstack/requirements: Fix update to support extras  https://review.openstack.org/30483719:48
openstackgerritMerged openstack-infra/project-config: Fix target for magnum image builds  https://review.openstack.org/30481919:48
*** e0ne has quit IRC19:48
*** daemontool has joined #openstack-infra19:50
*** sigmavirus24 is now known as sigmavirus24_awa19:50
*** ybathia has joined #openstack-infra19:50
*** ociuhandu has joined #openstack-infra19:52
*** flepied has joined #openstack-infra19:53
*** Guest48873 has quit IRC19:54
*** claudiub|2 has joined #openstack-infra19:54
*** mylu has quit IRC19:54
*** salv-orlando has joined #openstack-infra19:55
*** esker has quit IRC19:55
*** yarkot_ has quit IRC19:55
*** mylu has joined #openstack-infra19:55
*** esker has joined #openstack-infra19:56
*** ramishra has quit IRC19:56
*** doug-fish has joined #openstack-infra19:56
*** cdent has joined #openstack-infra19:56
*** claudiub has quit IRC19:56
*** ramishra has joined #openstack-infra19:57
*** Goneri has quit IRC19:57
*** sc68cal_ has joined #openstack-infra19:57
*** claudiub|2 has quit IRC19:58
*** salv-orlando has quit IRC19:59
*** brucet has quit IRC19:59
*** brucet has joined #openstack-infra19:59
dmsimardianw: It looks like we agreed to use a JJB macro for the swap config for the time being. What do you feel would be a good macro name ? swap-config ?20:00
*** asettle has joined #openstack-infra20:00
*** Guest35759 is now known as annegentle20:00
EmilienMreview request: https://review.openstack.org/#/c/297469/ publish puppet-aodh in tarball (more modules will come later if accepted) - pabelanger, AJaeger: could we sort this out?20:00
*** tiswanso has quit IRC20:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Search subnets for gateway_ip to discover NAT dest  https://review.openstack.org/30059820:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor default_network for interface_ip  https://review.openstack.org/30456920:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Consume floating_ip_source config value  https://review.openstack.org/30457720:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Refactor guts of _find_interesting_networks  https://review.openstack.org/30173820:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Add nat_destination filter to floating IP creation  https://review.openstack.org/30210420:00
openstackgerritMonty Taylor proposed openstack-infra/shade: Allow passing nat_destination to get_active_server  https://review.openstack.org/30385120:00
*** tqtran has joined #openstack-infra20:00
mordredShrews, jeblair: I believe I have taken care of your concerns20:01
*** annegentle is now known as Guest2606620:01
AJaegerpabelanger: you have a -1 on it...20:01
*** Guest26066 is now known as agentle20:01
*** mylu has quit IRC20:01
*** tongli has quit IRC20:01
AJaegerproject-config cores, I'm finished with manual translation changes and thus ready to reenable syncing. Reviews of https://review.openstack.org/#/c/304494/ are welcome. Thanks!20:01
pabelangerAJaeger: EmilienM Ya, I think we can approve that today20:01
Shrewsmordred: ALL of my concerns in life??? because that would be swell.20:01
*** jsavak has quit IRC20:01
EmilienMfungi: puppet group does not have a very busy schedule like you have in infra, if you need a room, we can try to consolidate our sessions and maybe release one for infra20:01
pabelangerfungi: are you fine with 297469 +A today?20:02
jeblairmordred: like "take care of them?"20:02
fungiEmilienM: let's see how the schedule plays out, though i want to make sure i don't overlap our puppet-relevant sessions with anything you've got so we can maximize cross-pollination for puppeteers20:02
mordredjeblair: yes20:02
*** mylu has joined #openstack-infra20:02
mordredShrews: yes20:02
*** jheroux has joined #openstack-infra20:03
EmilienMfungi: https://www.openstack.org/summit/austin-2016/summit-schedule/global-search?t=Puppet%20OpenStack%3A20:03
ianwdmsimard: yeah, just something that has "swap" in it :)  add-swap-space?   something like that20:03
*** tiswanso has joined #openstack-infra20:04
anteayalike moustateers20:04
anteayabut for puppets20:04
EmilienMfungi: we can give you a work session if you want20:04
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/shade: [WIP] Test with a python-keystoneclient change from git/gerrit  https://review.openstack.org/30483320:04
*** jsavak has joined #openstack-infra20:04
*** keedya has joined #openstack-infra20:04
*** asettle has quit IRC20:05
fungiEmilienM: i think we ended up with the number of work sessions we need, but thanks for the offer--i'll keep it in mind as i'm assembling this20:05
ianwbuild failed -> fatal: remote error: access denied or repository not exported: /openstack/networking-huawei.git20:05
ianwdidn't that happen yesterday too?20:05
*** sigmavirus24_awa is now known as sigmavirus2420:05
ianwhang on, same timestamp in logs, nodepool logs maybe not updating20:06
AJaegerianw: https://review.openstack.org/302120 yes, yesterday20:06
ianwhttp://nodepool.openstack.org/ <- yeah, no logs for 12th20:06
nibalizerpabelanger: ohai20:06
fungiianw: hopefully that was cleared up once the git mirror sync finished after the maintenance (it took longer than expected to rebuild the local mirror and may have delayed initial replication for any new repos added during that time)20:07
nibalizerso https://review.openstack.org/#/c/303206/ is basicaly there20:07
pabelangernibalizer: o/20:07
nibalizerbut it fails on f23 because puppet 4 or something20:07
ianwfungi: yeah, sorry, my build checker flagged it, but really the problem is there's no new logs for it to see :)20:07
nibalizerand im just thinking 'why do we have f23 running? why does it have puppet4? I don't care'20:07
*** jbernard_ has quit IRC20:07
fungiianw: which... also clearly a problem20:07
*** mylu has quit IRC20:07
pabelangernibalizer: we have fedora-23 devstack jobs, experimental IIRC20:08
*** jbernard1 has joined #openstack-infra20:08
pabelangerso, we need to test on fedora-2320:08
*** mylu has joined #openstack-infra20:09
fungiEmilienM: pabelanger: i wonder if 297469 should add a test for setup.py? though i'll propose that as a followup20:09
pabelangeras for puppet 4, that is what the OS defaulted too. Since it shipped the puppet 4 package20:09
*** nadya has joined #openstack-infra20:09
pabelangernibalizer: I can debug it locally if you want20:09
EmilienMfungi: https://github.com/openstack/puppet-nova/blob/master/setup.py20:10
* EmilienM runs20:10
fungipabelanger: yeah, aside from the fact that kolla and ansible are, i guess, still going through release process, this is as good a time as any20:10
fungiEmilienM: oh, oww20:10
EmilienMfungi: because of reno20:10
EmilienM"we are OpenStack" :-)20:11
*** ramishra has quit IRC20:11
*** piet has joined #openstack-infra20:11
*** apoorvad has quit IRC20:11
fungiEmilienM: which means maybe we need a better way of telling what's being packaged in which ways20:11
*** jsavak has quit IRC20:11
*** fawadkhaliq has quit IRC20:11
*** fawadkhaliq has joined #openstack-infra20:12
pabelangerEmilienM: fungi: great, +A20:12
EmilienMfungi: my patch is testing metadata.json which is specific to Puppet20:12
EmilienMpabelanger: thx20:12
*** mylu has quit IRC20:12
nibalizerpabelanger: everything else runs puppet 320:12
*** jsavak has joined #openstack-infra20:12
*** ramishra has joined #openstack-infra20:12
fungiwe could parameterize this script to kate an optional cli argument, or we could have wrapper scripts that inject the right build process and call them from different job templates... but i guess this is okay until we have a third type or things get more complicated for other reasons (like python projects adding a file called metadata.json)20:12
nibalizerthe f23 puppet4 isn't 'just works' either20:13
*** Rockyg has joined #openstack-infra20:13
pabelangernibalizer: If people want to override the default packages in Fedora for puppet, I won't block it.  We did spend a lot of effort making our puppet modules work with puppet420:13
pabelangerjust seems odd to explicitly downgrade to puppet 320:13
*** brucet has quit IRC20:13
nibalizerpabelanger: i don't think thats really true, i think we ran some linters and changed some stuff20:13
*** mylu has joined #openstack-infra20:14
pabelangernibalizer: no, ianw and I spent a while fixing our manifests for puppet 420:14
pabelangereven fixing puppet 4 for systemd20:14
pabelangerIf we want to downgrade, I don't have an issue20:14
nibalizerso can you look at why the hiera backend isn't getting loaded in fedora23/puppet 420:15
nibalizerim honestly looking at that exception and just have no energy20:15
pabelangerI'll fire up a node tomorrow morning20:15
pabelangerand see what is going on20:15
austin81project-config cores, infra cores, When y'all get a minute, would you mind looking over https://review.openstack.org/#/c/279317/ for me? Thanks!20:15
nibalizeris the exact issue20:15
*** dimtruck is now known as zz_dimtruck20:19
openstackgerritMerged openstack-infra/project-config: publish puppet-aodh in tarball for master  https://review.openstack.org/29746920:19
*** hdd has joined #openstack-infra20:20
*** mylu has quit IRC20:21
pabelangernibalizer: a quick look at trusty show: http://logs.openstack.org/06/303206/3/check/gate-infra-puppet-apply-ubuntu-trusty/fbede4e/console.html#_2016-04-08_17_13_41_44220:22
pabelangerbut hiera works it seems20:22
EmilienMso now https://review.openstack.org/#/c/297469/ is merged, how can I publish a tarball? do we need to land a patch in puppet-aodh?20:22
pabelangernibalizer: I don't think it is working correct, is it? Shouldn't the data being returned = garbage?20:23
AJaegerEmilienM: yes20:23
EmilienMAJaeger: thx20:23
AJaegerEmilienM: after each merge of a change for puppet-aodh, a tarball will be generated20:23
EmilienMI'll test it and add more modules if it works fine.20:23
*** ramishra has quit IRC20:24
nibalizerpabelanger: well20:24
nibalizeri think it is20:24
nibalizerbut maybe that line isn't working20:24
*** ramishra has joined #openstack-infra20:24
nibalizeri think the issue is that when you're using pluginsync to grab a hiera backend, and you use the hiera command line utility, it doesn't know how to find those backeends20:26
*** ramishra has quit IRC20:26
*** hdd has quit IRC20:26
* AJaeger calls it a day now and leaves with a friendly review suggestion on https://review.openstack.org/#/c/304494 , please20:26
*** kgiusti has left #openstack-infra20:26
anteayaAJaeger: enjoy your evening20:26
AJaegerthanks, anteaya20:27
*** ybathia has quit IRC20:27
rcarrillocruznibalizer: not sure if you know about it, but randomly came across this yesterday20:28
rcarrillocruzneat to debug hiera things20:28
*** Hal has joined #openstack-infra20:29
openstackgerritSpencer Krum proposed openstack-infra/system-config: Use the garbage backend in the apply test  https://review.openstack.org/30320620:29
nibalizerpabelanger: lets see what that kicks out20:29
*** Hal is now known as Guest1419220:29
*** ramishra has joined #openstack-infra20:29
nibalizerrcarrillocruz: neat20:30
nibalizerbinford is good people20:30
pabelangernibalizer: sure20:31
*** kzaitsev_mb has joined #openstack-infra20:31
pabelangernibalizer: either way, I have some cycles tomorrow to work on it too20:31
*** mylu has joined #openstack-infra20:31
*** sridhar_ram1 has joined #openstack-infra20:31
*** sridhar_ram has quit IRC20:32
*** hdd has joined #openstack-infra20:33
*** mylu has quit IRC20:33
*** esker has quit IRC20:33
*** apoorvad has joined #openstack-infra20:34
*** esker has joined #openstack-infra20:34
*** yarkot_ has joined #openstack-infra20:35
*** mylu has joined #openstack-infra20:36
*** baoli has joined #openstack-infra20:39
*** bpokorny has joined #openstack-infra20:39
*** zz_dimtruck is now known as dimtruck20:40
*** mylu has quit IRC20:40
*** ybathia has joined #openstack-infra20:40
openstackgerritMerged openstack-infra/shade: Consume config values for NAT destination  https://review.openstack.org/30059220:41
*** salv-orlando has joined #openstack-infra20:41
*** ramishra has quit IRC20:41
*** ramishra has joined #openstack-infra20:42
*** mrmartin has quit IRC20:42
nibalizerinfra-root taking the hiera lock20:43
mordrednibalizer: ++20:43
fungithanks nibalizer20:43
*** dprince has quit IRC20:43
*** Swami has quit IRC20:43
nibalizerme peers at things20:44
nibalizer.....how does this even work...20:44
*** esker has quit IRC20:44
fungijeblair: the infra cloud resources topic came out of tc brainstorming on what they should ask the board about/for. it wasn't initiated on our end20:45
nibalizerok im picking it up now20:45
jeblairfungi, mordred: yeah, i was just really surprised20:45
*** mylu has joined #openstack-infra20:47
mordredjeblair: I was trying to steer it away from "let's talk to the board about needing more resources" to "let's educate folks about how we're actually doing" - I may have done that poorly20:47
*** gyee has joined #openstack-infra20:47
*** BigWillie has quit IRC20:48
jeblairmordred, fungi: okay, that sounds like a reasonable thing for where i think we're at20:48
jeblairknowledge is good20:48
*** claudiub has joined #openstack-infra20:48
*** akaszuba has quit IRC20:48
jeblairi wasn't lurking and was a little worried we were going to the board with a request or something20:49
jeblair(i mean, beyond our usual "give us more" :)20:49
jeblair(always be asking)20:49
mordredyah. we can alway suse more20:49
nibalizermordred: i c what you did there20:50
mordrednibalizer: I try to give AJaeger the love whenever I can20:50
*** dimtruck is now known as zz_dimtruck20:50
jeblairmordred: i'm happy to help out, and if we can flesh this out and figure out soon if i need to catch an earlier flight and sleep on a bench, that'd be good.  :)20:50
nibalizerinfra-root hiera lock release20:51
*** mylu has quit IRC20:51
*** salv-orlando has quit IRC20:51
*** e0ne has joined #openstack-infra20:52
*** salv-orlando has joined #openstack-infra20:52
anteayajeblair: I think there still might be a few rooms for $600 apiece20:52
mordrednibalizer: human powered chat-ops20:52
fungijeblair: heidi proved in tokyo that if you keep trying to sleep on the lobby sofa, hotel staff will find you a room20:53
fungithough maybe that's japanese hotel staff, not texan hotel staff20:53
*** nadya has quit IRC20:53
fungithey may point you at the stables instead20:53
anteayaor the homeless shelter20:53
*** zz_dimtruck is now known as dimtruck20:54
*** sputnik13 has joined #openstack-infra20:56
*** fernnest has quit IRC20:56
*** ramishra has quit IRC20:56
*** doug-fish has quit IRC20:58
*** doug-fish has joined #openstack-infra20:59
*** bpokorny_ has joined #openstack-infra21:00
*** asettle has joined #openstack-infra21:00
*** _ari_ has quit IRC21:00
*** doug-fis_ has joined #openstack-infra21:01
*** aysyd has quit IRC21:01
*** Swami has joined #openstack-infra21:01
*** rfolco_ has quit IRC21:01
*** mylu has joined #openstack-infra21:02
*** fawadkhaliq has quit IRC21:03
*** baoli has quit IRC21:03
*** rossella_s has quit IRC21:03
*** doug-fish has quit IRC21:03
*** bpokorny has quit IRC21:03
*** denisra_ has joined #openstack-infra21:03
nibalizerok i have the npm-mirror lock held in a screen on the mirror-update server21:03
*** mylu has quit IRC21:03
nibalizerso im now gonna land 23561721:03
*** kengo_sakai_mba has joined #openstack-infra21:03
*** fawadkhaliq has joined #openstack-infra21:03
*** rossella_s has joined #openstack-infra21:04
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add final success/failure message to ping test  https://review.openstack.org/30486421:04
*** denisra has quit IRC21:05
*** jsavak has quit IRC21:05
mordredanteaya: you have assumed the existence of a homeless shelter21:05
*** sridhar_ram1 has quit IRC21:05
anteayaI saw it21:05
*** mylu has joined #openstack-infra21:05
*** ramishra has joined #openstack-infra21:05
*** sdake has quit IRC21:05
anteayawest of 6th21:05
anteayathey were all hanging out on the street corner in front of it21:05
*** jsavak has joined #openstack-infra21:05
anteayaI was afraid to stop for the pedestrian signals21:06
anteayasince when I did they all targeted me and started my way21:06
anteayaso I jaywalked21:06
mordredanteaya: are you sure that wasn't a bus station?21:06
fungior the most popular bbq in austin instead?21:07
anteayadoes the bus station look like a homeless shelter?21:07
mordredfungi: that's east of 3521:07
mordredanteaya: most times in the US, yes21:07
anteayaif yes, it might have been the bus station21:07
anteayaI just, I can't even...21:07
mordredanteaya: I mean, unless you saw the words "homeless shelter"21:07
*** sridhar_ram has joined #openstack-infra21:07
mordredit was either a bus station or it was a temporary labor place21:07
* anteaya checks the googles21:07
fungialso in many parts of the usa, bus stations double as homeless shelters21:08
*** kengo_sakai_mba has quit IRC21:08
*** moravec has quit IRC21:08
fungias do public libraries21:08
ttxbut you refer to them as "bus stations"21:08
mordredso - in many ways, anteaya could have been completely correct21:08
mordred"go to the homeless shelter" - "but I don't have a bus ticket"21:08
*** burgerk has quit IRC21:08
*** sdake has joined #openstack-infra21:08
fungipublic transportation is in a sad state here21:08
ttxAlso if my experience of american movies is correct, those bus stations are only open late at night21:08
*** mylu has quit IRC21:09
*** cdent has quit IRC21:09
mordredttx: yes. this is accurate21:09
anteayait was the salvation army on nachess street21:09
*** mylu has joined #openstack-infra21:09
mordredah. I missed salvation army as an option. good. there might have actually been some shelter there!21:09
fungioh, that could also have been a "soup kitchen" i suppose21:10
anteayathere were a whole lot of people hanging around the outside21:10
fungialso sometimes that describes starbucks21:10
*** divyah_ has joined #openstack-infra21:10
openstackgerritMerged openstack-infra/system-config: Added NPM Mirror to mirror_update  https://review.openstack.org/23561721:10
fungithe huddled masses trying to eek out a few bps of free wifi bandwidth21:10
ttxor McDonalds21:10
*** jsavak has quit IRC21:11
*** julim has quit IRC21:11
anteayaand when I stopped for the pedestrian signals at red river between 8th and 7th they became very interested in me21:11
*** sdague has quit IRC21:11
*** mylu has quit IRC21:11
anteayainterested in a way that made me very uncomfortable very fast21:11
*** trown is now known as trown|outtypewww21:11
fungianteaya: i think they assumed you were canadian by the way you blindly obeyed pedestrian traffic laws rather than boldly walking into oncoming traffic21:11
*** fernnest has joined #openstack-infra21:11
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/shade: [WIP] Test with a python-keystoneclient change from git/gerrit  https://review.openstack.org/30483321:12
anteayafungi: I then walked into oncoming traffic21:12
anteayagiven those options21:12
fungithat showed 'em21:12
anteayait was unnerving21:12
*** ivc_ has quit IRC21:12
openstackgerritSpencer Krum proposed openstack-infra/system-config: Use the garbage backend in the apply test  https://review.openstack.org/30320621:13
*** ddutta has joined #openstack-infra21:13
divyah_Hi, i had some question regarding testr .. is this the right channel?21:13
*** ssancheztrujillo has joined #openstack-infra21:14
*** dimtruck is now known as zz_dimtruck21:14
anteayadivyah_: yes21:15
nibalizer10 oom-killers on ansible-playbook so far today21:15
*** ldnunes has quit IRC21:15
clarkbnibalizer: do we know what is needing that much memory?21:15
anteayanibalizer: popular21:15
clarkbnibalizer: in theory it shouldn't really need any at all except for a small overhead per ssh connection21:15
divyah_anteaya: great thanks21:15
nibalizerclarkb: :shrug: in syslog you can see a picture of the memory usage21:16
nibalizerright before the oomkill21:16
nibalizermumble mumble templating takes memory mumble?21:16
divyah_i am trying to run tempest tests in netron-lbaas repo ... when i run something like this testr  run neutron_lbaas.tests.tempest.v2.api.test_listeners_non_admin.ListenersTestJSON21:16
anteayadivyah_: welcome21:16
divyah_i see that the tests run .. and it says Ran 42 tests in 46.514s (+16.047s) PASSED (id=29)21:16
divyah_but i do not see any output21:16
*** ramishra has quit IRC21:17
anteayadivyah_: this is running locally?21:17
divyah_anteaya: yes i am on a ubuntu vm locally21:17
fungidivyah_: testr has a local database containing individual test results and any subunit data streamed from them21:17
fungidivyah_: testr --help should, i think, give you information on other commands you can use to analyze the results21:18
divyah_fungi: can we redirect the results to a log file instead of database?21:18
*** fawadkhaliq has quit IRC21:18
fungiusually it assumes that jobs passing is what you want, and so doesn't give you additional details on stdout unless there are failures21:18
*** fawadkhaliq has joined #openstack-infra21:18
*** mylu has joined #openstack-infra21:18
fungidivyah_: the data is not entirely loggable since subunit streams can contain 8-bit data21:19
*** ivc_ has joined #openstack-infra21:19
fungidivyah_: are you just wanting to see individual test names with "PASSED" after them?21:19
*** esker has joined #openstack-infra21:20
openstackgerritPaul Belanger proposed openstack-infra/system-config: Initial commit for RPM afs mirror  https://review.openstack.org/28952021:20
openstackgerritEric Harney proposed openstack-infra/reviewday: Add os-brick  https://review.openstack.org/30487021:20
*** ramishra has joined #openstack-infra21:20
*** esker has quit IRC21:20
*** e0ne has quit IRC21:20
*** sputnik13 has quit IRC21:20
divyah_fungi: i would like to see something like this http://logs.openstack.org/60/258560/5/check/gate-neutron-lbaasv2-dsvm-member/8c241cd/logs/testr_results.html21:21
*** xyang1 has quit IRC21:21
divyah_fungi: i would like to generate the log file and then convert to html using subunit2html21:21
*** xyang1 has joined #openstack-infra21:21
*** maishsk has joined #openstack-infra21:21
*** asettle has quit IRC21:22
divyah_typically on tempest rep i do this by running testr run --subunit --load-list=list.txt21:22
divyah_but for some reason testr run --subunit just comes out without running any tests21:22
*** |-paul-| has joined #openstack-infra21:22
mtreinishdivyah_: I think you're just looking for subunit-trace right? you want console output of things as they run?21:22
*** jheroux has quit IRC21:22
*** flwang1 has joined #openstack-infra21:23
divyah_mtreinish: yes some trace which can be later converted to html page similar to this http://logs.openstack.org/60/258560/5/check/gate-neutron-lbaasv2-dsvm-member/8c241cd/logs/testr_results.html21:23
clarkbpleia2: anteaya for my bug day participatio nI think I will be limited to the afternoon PDT21:24
mtreinishdivyah_: you use the subunit output to generate that file, and subunit-trace also uses the subunit data to generate console text21:24
*** infra-red has quit IRC21:24
*** esker has joined #openstack-infra21:24
*** ssancheztrujillo has quit IRC21:24
fungidivyah_: it's not something i've reverse engineered before, so i'll defer to mtreinish and the #openstack-qa denizens, but you may want to look at .testr.conf for relevant default overrides, and also the ostestr wrapper does some nifty things21:24
divyah_mtreinish: testr run --subunit --load-list=test-lists.txt does not run any tests in neutron-lbaas repo21:25
*** e0ne has joined #openstack-infra21:25
divyah_how can i debug more21:25
*** vilobhmm11 has joined #openstack-infra21:25
divyah_fungi: thanks for the inputs ...21:25
anteayaclarkb: I understand21:25
anteayaclarkb: you had home things today and healthy baby things tomorrow21:25
pleia2clarkb: that's fine, I figure most folks will be in and out21:25
mtreinishfungi: heh, the big thing ostestr does for most people is pipe it through subunit-trace by default :)21:26
anteayaclarkb: healthy baby!21:26
anteayaclarkb: how did home things go?21:26
pleia2I have a lunch meeting at 1 pacific, so I'll be popping out for a bit in the afternoon21:26
divyah_mtreinish: i think i am looking to get the subunit-trace ..21:26
anteayapleia2: cool21:26
fungimtreinish: yeah, i thought that was how you were getting logs like divyah_ was pointing to21:26
*** ssancheztrujillo has joined #openstack-infra21:26
vilobhmm11anteaya, fungi : how do i enable logging for a newly created irc group chat21:26
fungiclarkb: fwiw, i have a feeling my participation in the bug day will be limited to answering questions/providing guidance on triaging via irc21:27
clarkbanteaya: home things went well, may finally be getting into a home (still a long way to go though)21:27
*** ivc_ has quit IRC21:27
vilobhmm11clarkb : ^^21:27
anteayavilobhmm11: http://docs.openstack.org/infra/system-config/irc.html21:27
clarkbvilobhmm11: you have to add the meetbot to your channel via the hiera file in openstack-infra/system-config21:27
anteayaclarkb: yay home!21:27
*** e0ne has quit IRC21:27
ianwfungi / pabelanger : so is nodepool building images and just not logging, or did something go wrong?21:27
anteayaclarkb: I hope it is a good home21:27
fungivilobhmm11: start with http://docs.openstack.org/infra/system-config/irc.html#access21:28
anteayaand the seller's decide to be sane21:28
fungivilobhmm11: or just the whole page as anteaya linked21:28
mtreinishdivyah_: load list requires a list of the exact tests you want to run. I'm not exactly sure what you're looking for21:28
*** matt-borland has quit IRC21:28
pabelangerianw: fungi: I noticed that snapshots were logged to debug.log recently.  I haven't looked why21:28
anteayafungi: for me it is always a toss up to link to the whole page or just a section21:29
pabelangererr: bare-precise and devstack-centos721:29
*** kzaitsev_mb has quit IRC21:29
divyah_mtreinish: sorry for not being clear ... all i am looking for is subunit test logs so that later i can convert to html21:29
openstackgerritSpencer Krum proposed openstack-infra/system-config: Put uri_rewrite and data_dir in variables  https://review.openstack.org/30487621:29
fungiianw: pabelanger: dib-image-list shows a bunch building21:29
divyah_mtreinish: can we convert the tox outputs to html??21:29
clarkbfungi: ianw pabelanger I just restarte dthe builder to get those running fwiw21:30
*** kus has joined #openstack-infra21:30
clarkbfungi: ianw pabelanger I think it too got detached from gearman things21:30
nibalizerinfra-root can I have a quick turnaround on 304876 please, the npm mirror script doesn't have some values it needs21:30
mtreinishdivyah_: testr last --subunit will output to STDOUT the subunit stream from the last run testr did21:30
*** kzaitsev_mb has joined #openstack-infra21:30
*** hdd has quit IRC21:30
clarkbdivyah_: you can, we even have a script to do it21:30
mtreinishthat's more or less what we use to generate testr_results.html in gate jobs21:30
clarkbdivyah_: it is run on the unittests by default for free and logged ot the log server21:30
pabelangerclarkb: fungi: ianw: I also noticed our dib logs are bigger now, did we enabled debugs by default?21:31
pleia2nibalizer: what is $npm_keytab ?21:31
*** ddieterly is now known as ddieterly[away]21:31
clarkbnibalizer: that change is broken21:31
fungiclarkb: aha, hung nodepool image build worker 'splains it. thanks21:31
clarkbnibalizer: missing ' on npm_keytab21:31
nibalizerrespinning sorry21:31
pleia2nibalizer: I think you maybe didn't mean to remove the '21:31
nibalizerya my editor is too smart for me21:31
divyah_clarkb: i am running this locally .. i see the output in text on stdout21:31
*** ddutta has quit IRC21:31
divyah_mtreinish: i tried testr last --subunit and see the following error21:32
clarkbnibalizer: but I also don't understand how this change changes anything?21:32
divyah_testr --last stdout Traceback (most recent call last):   File "/usr/local/bin/testr", line 26, in <module>     sys.exit(run_argv(sys.argv, sys.stdin, sys.stdout, sys.stderr))   File "/usr/local/lib/python2.7/dist-packages/testrepository/commands/__init__.py", line 184, in run_argv     cmdclass = _find_command(cmd_name)   File "/usr/local/lib/python2.7/dist-packages/testrepository/commands/__init__.py", line 53, in _find_comm21:32
openstackgerritSpencer Krum proposed openstack-infra/system-config: Put uri_rewrite and data_dir in variables  https://review.openstack.org/30487621:32
nibalizerclarkb: there is a template elsewhere in mirror_update that needs access to those variablees21:32
clarkbnibalizer: ah21:32
nibalizeri think probably in the history of the changee the template moved out of npm_mirror and into mirror_update21:32
anteayadivyah_: maybe use a paste service next time?21:32
nibalizerthe line in the script right now is : CMD_ARGS="-d  -o  --blobstore afs-blob-store"21:32
nibalizerwhere -d and -o were supposed to have arguments21:33
mtreinishdivyah_: yeah that got truncated use paste.openstack.org to pastebin the full traceback21:33
divyah_mtreinish: anteaya sorry here is the trace http://paste.openstack.org/show/493875/21:33
mtreinishdivyah_: how did you install testr?21:33
anteayadivyah_: thank you, just having two conversations in channel about commands, traceback can get confusing21:33
mordredShrews, jeblair: uhm ...21:34
divyah_mtreinish: i just ran tox and that installed testr i think i did not install manually21:34
* jeblair hides21:34
ianwpabelanger: that's a bug21:34
mordredShrews, jeblair: https://review.openstack.org/#/c/304577/ failed tests21:34
mordredbut passes locally21:34
mordredjeblair: mind helping me figure out wtf?21:35
pabelangerianw: Ah21:35
jeblairmordred: it didn't just fail tests a little, did it?21:35
mordredjeblair: NEVERMIND21:35
ianwpabelanger: https://review.openstack.org/#/c/302509/ <- this stack needs to make it into dib to fix up things21:35
mordredjeblair: I am bad at gerrit21:35
divyah_anteaya: sorry i am new to this .. please suggest should i be asking over email?21:35
mordredjeblair: or, rather, I cannot comprehend the patch stack there21:35
*** ssancheztrujillo has quit IRC21:35
nibalizerthanks clarkb pleia2 jeblair21:36
mordredjeblair: so, thanks for the help!21:36
openstackgerritVilobh Meshram proposed openstack-infra/system-config: Add logging for openstack-quota  https://review.openstack.org/30487921:36
*** kzaitsev_mb has quit IRC21:36
jeblairmordred: here's a handy key: http://paste.openstack.org/show/493876/21:36
*** BobBall_ has joined #openstack-infra21:37
clarkbchecking on gerrit melody we have spiked to 17GB21:37
clarkbnew rams are already helping21:37
pabelangerianw: okay21:37
pleia2clarkb: yay21:37
vilobhmm11anteaya, clarkb, fungi : https://review.openstack.org/#/c/304879/21:37
*** BobBall_ is now known as Guest3026121:37
mtreinishdivyah_: right, so you probably need to install outside the tox venv or run it from inside the tox venv21:37
clarkbit has very steadily increased the average since coming up on the new server too21:37
*** flwang1 has quit IRC21:37
*** amitgandhinz has quit IRC21:38
divyah_mtreinish: do you mean i should install testr on that system again? when i search for testr i see the following installed: http://paste.openstack.org/show/493878/21:39
*** moravec has joined #openstack-infra21:39
*** BobBall has quit IRC21:39
*** mriedem has quit IRC21:40
*** amitgandhinz has joined #openstack-infra21:40
anteayaclarkb: yay new RAMs21:41
mordredjeblair: tahnks!21:41
*** Guest30261 has quit IRC21:42
*** BobBall has joined #openstack-infra21:42
*** amitgandhinz has quit IRC21:42
*** BobBall is now known as Guest1424321:42
*** ramishra has quit IRC21:42
pleia2vilobhmm11: you'll need to register #openstack-quota and do some configuration before we can add any bots to it, see: http://docs.openstack.org/infra/system-config/irc.html (in addition to my comment in the change)21:42
*** bpokorny_ has quit IRC21:44
*** bpokorny has joined #openstack-infra21:44
*** dizquierdo has joined #openstack-infra21:44
*** Swami_ has joined #openstack-infra21:45
divyah_mtreinish: tried installing the testr again outside the venv but still the same problem testr run --subunit --load-list=list.txt doesnt seem to run anything and doesn;t give any error either21:46
*** ayoung has quit IRC21:46
*** eharney has quit IRC21:47
*** kzaitsev_mb has joined #openstack-infra21:47
*** vgridnev has quit IRC21:47
*** piet has quit IRC21:47
mtreinishdivyah_: if there is no output then that likely means your test list is bad21:47
mtreinishwhat happens if you don't have the load list parameter21:47
*** piet has joined #openstack-infra21:47
*** ramishra has joined #openstack-infra21:48
*** Swami has quit IRC21:49
*** julim has joined #openstack-infra21:49
divyah_mtreinish: oh ok ... i ran without giving the load-list and now it is running the tests and spitting out output on stdout21:50
*** knikolla has quit IRC21:50
divyah_mtreinish: thanks so much .. i will see what am i missing in the testlist21:50
*** ZZelle_ has joined #openstack-infra21:50
*** asettle has joined #openstack-infra21:51
openstackgerritVilobh Meshram proposed openstack-infra/project-config: Add openstack-quota to accessbot  https://review.openstack.org/30488221:51
vilobhmm11pleia2 : sure changes on the way :)21:51
vilobhmm11pleia2 : ^^21:51
openstackgerritVilobh Meshram proposed openstack-infra/system-config: Add logging for openstack-quota  https://review.openstack.org/30487921:52
*** sdake_ has joined #openstack-infra21:53
*** mylu has quit IRC21:53
*** sdake has quit IRC21:54
*** tiswanso has quit IRC21:55
*** asettle has quit IRC21:55
*** asettle has joined #openstack-infra21:55
*** ddieterly[away] is now known as ddieterly21:56
clarkbjenkins01 and 03 and maybe 06 are all thread leaking21:56
clarkbI am going to kick off the ansible playbook on 01 and 0321:57
*** moravec has quit IRC21:57
anteayaclarkb: :(21:57
*** ramishra has quit IRC21:57
clarkbas soon as I remember how to limit a playbook to specific hosts is it --limit?21:57
openstackgerritMerged openstack-infra/system-config: Put uri_rewrite and data_dir in variables  https://review.openstack.org/30487621:57
*** ramishra has joined #openstack-infra21:58
nibalizeryayyy i merged21:58
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor default_network for interface_ip  https://review.openstack.org/30456921:58
openstackgerritMonty Taylor proposed openstack-infra/shade: Consume floating_ip_source config value  https://review.openstack.org/30457721:58
*** ybathia has quit IRC21:59
divyah_mtreinish: sorry to bother you again ... i am looking at the lists file, and for testing i just have one test in the file, which i took from subunit result but if i pass the load-list it just comes out .. any idea what is missing? http://paste.openstack.org/show/493879/21:59
clarkbok started against 0121:59
*** jamesmcarthur has quit IRC22:00
*** salv-orlando has quit IRC22:00
*** salv-orlando has joined #openstack-infra22:01
*** IlyaG has joined #openstack-infra22:01
*** flwang1 has joined #openstack-infra22:01
*** kzaitsev_mb has quit IRC22:01
*** bdemers has quit IRC22:01
anteayaclarkb: was it --limit?22:02
*** ybathia has joined #openstack-infra22:02
*** mylu has joined #openstack-infra22:04
*** sdake has joined #openstack-infra22:04
*** sdake_ has quit IRC22:06
*** kzaitsev_mb has joined #openstack-infra22:06
jeblairmordred: did a rebase weirdness happen to https://review.openstack.org/303851 ? it looks like it has a bunch of stuff about ports in it now that looks similar to another change i have seen.22:07
*** gordc has quit IRC22:07
mordredjeblair: uhm22:07
*** akshai has quit IRC22:07
mordredjeblair: yes22:08
jeblairmordred: nb i approved everything above that change22:09
mordredjeblair: I'm guessing I did a commit --amend when I should have done a rebase --continue at one point22:09
jeblairi love git22:09
divyah_mtreinish: is it mandatory to give test-ids in the test-list file? and who generates this id ? i don't see id in the test file22:09
*** piet has quit IRC22:10
nibalizerkrotscheck: jeblair its mirroring, i think22:11
nibalizernpm is downloaading Reston a lot22:11
*** matrohon has joined #openstack-infra22:11
*** angdraug has quit IRC22:11
*** knikolla has joined #openstack-infra22:11
*** kzaitsev_mb has quit IRC22:11
*** mylu has quit IRC22:12
mtreinishdivyah_: I'm not familiar with the test suite you're trying to run. But, the test_id is just how the runner identifies the test. In the normal case it's just the python path to the callable for the test22:12
openstackgerritRodrigo Duarte proposed openstack-infra/project-config: Enable non-voting keystone tempest plugin tests  https://review.openstack.org/29869622:12
mtreinishit should be the same as the output from testr list-tests22:13
*** mylu has joined #openstack-infra22:13
nibalizerhttp://paste.openstack.org/show/493880/ quality softwaree22:13
mtreinishbut using load-list is very finicky, because if you don't get the test_id exactly it just won't run it22:13
nibalizerkrotscheck: is that expected?22:13
jeblairnibalizer, krotscheck: oh *that's* why the archive is so large ;)22:14
*** doug-fis_ has quit IRC22:14
divyah_mtreinish: thanks .. got it ... i was missiong the type of the test after the callable path ... now it is running .. thanks so much22:15
*** fawadkhaliq has quit IRC22:16
*** fawadkhaliq has joined #openstack-infra22:16
*** Guest14192 has quit IRC22:17
*** tpsilva has quit IRC22:17
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor default_network for interface_ip  https://review.openstack.org/30456922:18
openstackgerritMonty Taylor proposed openstack-infra/shade: WIP Start stamping the has_service debug messages  https://review.openstack.org/30385322:18
openstackgerritMonty Taylor proposed openstack-infra/shade: Consume floating_ip_source config value  https://review.openstack.org/30457722:18
openstackgerritMonty Taylor proposed openstack-infra/shade: Refactor the port search logic  https://review.openstack.org/30385222:18
openstackgerritMonty Taylor proposed openstack-infra/shade: Allow passing nat_destination to get_active_server  https://review.openstack.org/30385122:18
mordredjeblair: wow. that was fun22:18
*** ramishra has quit IRC22:19
mordredjeblair: on - wait - I think I missed one thing22:20
*** ramishra has joined #openstack-infra22:20
jeblairmordred: the accidental removal in 303851?22:20
jeblair(of 'if not nat_network'?)22:21
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor default_network for interface_ip  https://review.openstack.org/30456922:22
openstackgerritMonty Taylor proposed openstack-infra/shade: WIP Start stamping the has_service debug messages  https://review.openstack.org/30385322:22
openstackgerritMonty Taylor proposed openstack-infra/shade: Consume floating_ip_source config value  https://review.openstack.org/30457722:22
openstackgerritMonty Taylor proposed openstack-infra/shade: Refactor the port search logic  https://review.openstack.org/30385222:22
mordredjeblair: thereyago22:22
jeblairmordred: i don't see an 851 update?22:23
*** sigmavirus24 is now known as sigmavirus24_awa22:23
*** ybathia has quit IRC22:23
*** Sukhdev_ has joined #openstack-infra22:23
*** sigmavirus24_awa is now known as sigmavirus2422:24
*** aspiers has quit IRC22:24
mordredjeblair: oh! we were talking about 2 different things22:24
jeblairmordred: i left a -1 on 851 if you want to get specific22:25
*** tonytan4ever has quit IRC22:25
nibalizerso I have a hard time believing that this software works22:25
nibalizerkrotscheck: jeblair any thoughts?22:25
jeblairnibalizer: i have no experience with the actual software22:25
*** sdake has quit IRC22:25
*** ramishra has quit IRC22:25
*** aspiers has joined #openstack-infra22:25
*** derekh has joined #openstack-infra22:25
jeblairnibalizer: maybe check that it's actually writing those out to the right place?22:26
jeblairnibalizer: (maybe the afs-blob-store isn't working and that's confusing it?)22:26
*** ybathia has joined #openstack-infra22:26
nibalizerthere are no files under /afs/.openstack.org/mirror/npm/22:26
jeblairnibalizer: /afs/.openstack.org/mirror/npm looks empty to me22:26
*** regXboi has quit IRC22:27
jeblairnibalizer: ah, i don't think it has access22:27
*** kzaitsev_mb has joined #openstack-infra22:27
jeblairfs la /afs/.openstack.org/mirror/npm22:27
*** matrohon has quit IRC22:27
jeblair  system:administrators rlidwka22:27
jeblair  system:anyuser rl22:27
jeblaironly those ^22:27
*** ramishra has joined #openstack-infra22:28
nibalizerso i need to give service/npm permissions there?22:28
jeblairnibalizer: yeah, but do it by creating a group, giving the group perms, and adding service/npm to the group22:28
nibalizerill look at how the others are setup22:28
nibalizerall this stuff runs as root22:28
jeblairnibalizer: (you *could* do it for the individual user, but group changes are easier than acl changes if we need to change something in the future)22:28
openstackgerritMonty Taylor proposed openstack-infra/shade: Honor default_network for interface_ip  https://review.openstack.org/30456922:28
openstackgerritMonty Taylor proposed openstack-infra/shade: WIP Start stamping the has_service debug messages  https://review.openstack.org/30385322:28
openstackgerritMonty Taylor proposed openstack-infra/shade: Consume floating_ip_source config value  https://review.openstack.org/30457722:28
openstackgerritMonty Taylor proposed openstack-infra/shade: Refactor the port search logic  https://review.openstack.org/30385222:28
openstackgerritMonty Taylor proposed openstack-infra/shade: Allow passing nat_destination to get_active_server  https://review.openstack.org/30385122:28
*** sputnik13 has joined #openstack-infra22:28
nibalizerthere is some attempts in the puppet manifests to put these cronjobs on individual users kindof22:29
nibalizerbut it uses the variable $user which is just the user that puppet runs as22:29
jeblairnibalizer: whoops.  we should change that.   afs doesn't care who you run as (only what tokens you have), but running as root is bad for host security.22:29
nibalizermirror-npm user or so?22:30
clarkbI think that is how reprepro runs22:30
mordredit doesn't have to run as root22:30
mordredif things are runnign as root, it's really only to be able to read the keytab22:30
mordredwhich obviously can be given group perms22:30
*** johnsom has joined #openstack-infra22:30
jeblairnibalizer: yep22:31
jeblairwe do have the single keytab for the vos release which they all need access to22:31
*** ayoung has joined #openstack-infra22:31
jeblairso if we do run the crons as users, we'll need to make sure they share a group with access to that22:31
*** gordc has joined #openstack-infra22:32
nibalizerwell we can experiment with npm and look at moving the others later22:32
jeblairalso, someday we should re-do the vos releases, but probably in zuulv3.  because that keytab is an admin user which means they all technically have access to a cred that has admin perms for the cell.22:32
*** pfallenop has quit IRC22:32
*** ramishra has quit IRC22:33
*** derekh has quit IRC22:33
openstackgerritMerged openstack-infra/shade: Search subnets for gateway_ip to discover NAT dest  https://review.openstack.org/30059822:33
openstackgerritMerged openstack-infra/shade: Refactor guts of _find_interesting_networks  https://review.openstack.org/30173822:34
openstackgerritMerged openstack-infra/shade: Add nat_destination filter to floating IP creation  https://review.openstack.org/30210422:34
*** ramishra has joined #openstack-infra22:34
*** sigmavirus24 is now known as sigmavirus24_awa22:34
*** ramishra has quit IRC22:35
mordredwoot. the queue is clearing22:35
jeblairmordred: +2 on that and the one after; didn't approve in case Shrews wants a second look22:37
johnsomclarkb Ping22:37
clarkbjohnsom: pong?22:37
mordredjeblair: yah - I just poked him to see if he was around22:37
johnsomclarkb I was wondering if you had more questions on https://review.openstack.org/#/c/298915/22:37
clarkbjohnsom: I think we should use the existing tempest stuff still22:38
clarkbjohnsom: you don't need to use ssh to call the function that dumps the logs22:38
*** ramishra has joined #openstack-infra22:39
johnsomI'm trying to catch nova console logs for any instance that is stuck and still running after the tests complete.  I would hate to have to go through every neutron job and add that22:40
johnsomtempest should be cleaning those instances up / or they think they are cleaning them up22:40
clarkbjohnsom: at the very least seeing the change work would be nice but it only functions if things don't work so hard toget that22:40
clarkbbut also you don't have to go through every neutron job and add it22:41
clarkbyou just add it to the base test clss and done22:41
clarkbwhich is how tempest does it iirc22:41
johnsomDo you have an example you can point me to?22:41
clarkbI don't typically deal with tempest but I am sure I can find it if given a few minutes22:42
*** austin81 has left #openstack-infra22:42
johnsomOk, thanks!  I don't deal with tempest either, which is why I'm looking for a pointer22:42
*** gordc has quit IRC22:44
jlvillalIs there anyway on the Wiki to prove you can be trusted a bit more and not get asked a question on every change you make?22:44
*** |-paul-| has quit IRC22:45
*** kzaitsev_mb has quit IRC22:45
*** ddieterly is now known as ddieterly[away]22:45
*** sputnik13 has quit IRC22:45
fungijlvillal: yep, help us finish up the deployment automation for it so we can upgrade to newer operating system and mediawiki release for access to better plugins22:45
johnsomHa, wouldn't that be nice.  I update the wiki at least twice a week22:45
*** ddieterly[away] has quit IRC22:45
jlvillalfungi: :)22:45
johnsomMore than once, I have clicked save and forgot about that question only to find the agenda didn't get posted....22:46
clarkbjohnsom: found it, link in a moment22:46
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: (WIP) Upgrade to mitaka  https://review.openstack.org/30488822:46
fungijlvillal: unfortunately we have to make things inconvenient enough to stop the spammers from continuing, but at the expense of also making things inconvenient for everyone else. we've got a slot to work through some details at the summit in a couple weeks22:47
clarkbjohnsom: https://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/manager.py#n37222:47
jlvillalfungi: Totally understand. Thanks22:47
Shrewsjeblair: I +2'd the things22:48
mordredShrews: \o/22:48
mordredjeblair: also, the two at the end of the stack in front of the WIP change are ready now22:49
*** kzaitsev_mb has joined #openstack-infra22:50
*** mylu has quit IRC22:50
krotschecknibalizer, jeblair: Sorry, I shifted into daycare mode at 2PM. I can pay a little attention, but not much.22:50
krotscheckWhat's the status?22:50
jeblairkrotscheck: nibalizer is fixing up some perms problems we think might be the cause of strange behavior from the mirror program22:50
krotscheckGot it.22:50
krotscheckHe's due for a nap in the next hour or so, so I'll be more reliable when that happens.22:51
*** mylu has joined #openstack-infra22:52
*** ramishra has quit IRC22:52
*** ramishra has joined #openstack-infra22:53
*** Sukhdev_ has quit IRC22:53
fungikrotscheck: aren't you due for a nap too?22:54
krotscheckfungi: Well, I've been up since 3.22:54
*** xyang1 has quit IRC22:54
krotscheckSo... maybe?22:54
*** Sukhdev_ has joined #openstack-infra22:54
anteayaI'm due for a nap22:54
anteayaI love naps22:54
*** dingyichen has joined #openstack-infra22:55
*** denisra_ has quit IRC22:56
jlvillalanteaya: +2!!!22:56
* jlvillal is sad that his wife doesn't like naps22:56
*** mriedem has joined #openstack-infra22:57
anteayahow can you not like naps22:57
anteayaI can't, I don't even22:57
clarkbI don't nap I always feel worse after22:57
fungiif i try to nap i wake up 8 hours later22:58
*** dalgaaf has quit IRC22:58
anteayaha ha ha22:59
anteayathe 8 hour nap23:00
anteayaI've done that23:00
*** mylu has quit IRC23:01
jeblairi tried to nap through the tc meeting today but mordred woke me up23:01
*** mylu has joined #openstack-infra23:01
anteayaI saw that23:01
fungihe's alarming like that23:01
* mordred hands jeblair a bowl that used to have bbq in it23:01
anteayahe promised you would do things23:01
* jeblair licks the bowl23:01
*** edmondsw has quit IRC23:01
*** bknudson has left #openstack-infra23:02
*** kzaitsev_mb has quit IRC23:02
nibalizermordred: seriously thoguh you've lived in texas how long23:02
nibalizerhow much bbq are you doing23:02
fungiyou can freebase it there23:02
mordrednibalizer: so much23:02
anteayatotally unrelated to anything, I think this is my new favourite video: https://www.youtube.com/watch?v=vruy2GRUsV8#t=m0s223:03
mordrednibalizer: I made a 7 pound pork shoulder on Sunday23:03
fungior even get intravenous injections23:03
openstackgerritSpencer Krum proposed openstack-infra/system-config: Create unprivileged user to run npm mirroring  https://review.openstack.org/30489123:03
*** ams_ has quit IRC23:03
*** treaki__ has quit IRC23:03
*** rbrndt has quit IRC23:03
*** mtanino has quit IRC23:03
jeblairnibalizer: do you want to keep going with it running as root for now?23:04
nibalizerjeblair: i just proposed 304891 which would let it run as mirror-npm23:05
nibalizeri think i'd rather get it done correctly23:05
jeblairnibalizer: yeah -- i just mean that is separate from the afs perms thing, so if you want to keep pushing on the initial sync, you can do so before landing that23:05
Shrewsmordred: speak truthily... best bbq... nc or tx?23:06
openstackgerritMerged openstack/requirements: Downgrade docker-py from 1.8.0 to 1.7.2  https://review.openstack.org/30429623:06
clarkbmordred: what did you smoke it on?23:07
*** ramishra has quit IRC23:07
*** salv-orlando has quit IRC23:08
*** ramishra has joined #openstack-infra23:08
*** jamielennox is now known as jamielennox|away23:09
*** ybathia has quit IRC23:10
*** Sukhdev_ has quit IRC23:10
*** Sukhdev_ has joined #openstack-infra23:11
*** kzaitsev_mb has joined #openstack-infra23:12
mordredclarkb: I cheated. the smoker isn't up and going yet - so I did oven with liquid hickory23:12
mordredShrews: totally different23:13
*** ybathia has joined #openstack-infra23:13
mordredShrews: next time you come visit me in dallas, I'm going to take you somewhere that'll knock your socks off23:13
*** bknudson has joined #openstack-infra23:13
*** jamielennox|away is now known as jamielennox23:13
fungimordred: liquid smoke? sounds blasphemous23:13
clarkbmordred: amazon can next day you a smoker23:13
*** fawadkhaliq has quit IRC23:13
clarkbmordred: and the wood too23:13
anteayaI can send you wood23:14
mordredclarkb: yah, no, that's fine - we have those right next door... we've been prioritizing which items we get when with the new house23:14
*** fawadkhaliq has joined #openstack-infra23:14
mordredas I'm sure you can imagine, there are ... _many_ things we have space for now23:14
fungiafter all, it's texas23:14
*** brucet has joined #openstack-infra23:14
clarkbmordred: ya but if you next day it then someone drops it off at your door23:14
mordredwe may have a washer and dryer by saturday though! (if the delivery people can find us)23:15
clarkband you don't need that pickup you haven't bought yet23:15
clarkb(or maybe yo uare pickup'd)23:15
*** dizquierdo has quit IRC23:15
mordredwe have so far avoided need of it!23:15
anteayamordred: yay clean clothes23:15
*** denisra has joined #openstack-infra23:15
mordredwe did have to hire a dude with apickup to clear the giant pile of tree limbs we'd trimmed though23:15
mordredturns out you can do that very nicely with your brand new sawzall23:15
anteayawhat kind of trees do you have?23:15
mordredthe ones we we trimming out blight from are red tipped photinias23:16
* anteaya pictures mordred wearing eye protection when using his sawzall23:16
mordredthey are actually bad trees to have here23:16
*** akshai has joined #openstack-infra23:16
mordredand were planted too close together23:16
mordredalthough the effect the people created of a nice wall of hedge trees is lovely23:16
mordredwe're starting our way to having a yard of actual native stuff23:17
mordredbut it'll take a while to get to those23:17
anteayawhat are you planting?23:17
*** akshai_ has joined #openstack-infra23:17
* mordred hands keyboard to sandy ... nope - couch too far away, gives up23:18
*** yuanying has joined #openstack-infra23:18
*** sdake has joined #openstack-infra23:18
*** thiagop has quit IRC23:19
anteayayou need texas furniture obviously23:19
*** ramishra has quit IRC23:19
brucetYou guys having a meeting??23:19
anteayaI'm not a guy23:20
anteayaand we are just talking23:20
*** ramishra has joined #openstack-infra23:20
brucetYou people23:20
anteayais there something we can help you with?23:20
brucetI'm still having problems with git review23:20
brucetI tried the sandbox. Nada23:20
brucetI assume there is something wrong with my tool chain but I can't figure out what it is23:21
fungibrucet: how far did you get? were you able to get gerrit to acknowledge that you submitted contact info?23:21
anteayawhat steps have you taken since we last spoke?23:21
*** akshai has quit IRC23:21
brucetI forgot about the contact info23:21
brucetLet me go back to that23:21
fungii probably got wrapped up in other things, but last i saw you were making sure your foundation membership had the same primary e-mail address as your gerrit preferred e-mail address so you could submit contact info in gerrit23:22
anteayaI think fungi shared this link last: http://docs.openstack.org/infra/manual/developers.html#getting-started23:22
anteayabrucet: did you get a chance to read that over?23:22
clarkbjenkins01 is done23:22
clarkbgonna start 03 now23:22
anteayaclarkb: yay!23:22
brucetYup about getting started23:22
brucetWent through that23:22
anteayabrucet: and all the memberships and accounts23:22
fungiactually i specifically linked the account creation subsection, but yes23:22
anteayaand the emails matching on gerrit and the foundation membership23:23
anteayafungi: ah sorry23:23
brucetOK. But when I try to store my contact info, I get "Cannot store contact info"23:23
*** kzaitsev_mb has quit IRC23:24
anteayabrucet: right, does your gerrit email match your openstack foundation membership email?23:24
anteayaand are you a  Foundation Member (not Community Member)23:24
*** ramishra has quit IRC23:24
fungibrucet: that either means your e-mail addresses don't match, or that your www.openstack.org account is community member rather than foundation member23:24
brucetYou I am a community member23:25
brucetDo I need to be foundation member??23:25
fungi(or in very rare cases, that the member system callback api is down/broken)23:25
anteayabrucet: yes23:25
brucetAnd what's the difference23:25
*** ybathia has quit IRC23:25
fungibrucet: http://docs.openstack.org/infra/manual/developers.html#account-setup "Your member level needs to be Foundation Member (not Community Member)."23:25
*** ramishra has joined #openstack-infra23:25
brucetLet me try that23:26
fungibrucet: community member just means you've created an account there, foundation member means you've joined the openstack foundation as an individual member23:26
brucetThat was easy23:27
anteayawhat takes place on the 4th of july weekend for americans that you basically need a week off before as well as a week off afterward?23:29
openstackgerritMerged openstack-infra/shade: Allow passing nat_destination to get_active_server  https://review.openstack.org/30385123:29
fungihoping we can make all of this way easier in coming months while still keeping corporate lawyers at hundreds of companies happy23:29
clarkbanteaya: we drink a lot of beer and eat hot dogs23:29
anteayanoone wants to schedule an event the week before or after and I don't understand why23:29
anteayaclarkb: for 2 straight weeks?23:29
clarkbanteaya: I think the issue is more that it makes travel hard, people go camping on either end etc23:29
*** akshai_ has quit IRC23:30
anteayaI don't understand why you need such a big window23:30
clarkbanteaya: it is a popular camping bookend23:30
anteayaall these events are in the states23:30
clarkbanteaya: so you do a week on either side depending on your personal schedule23:30
anteayait isn't like they are in europe or anything23:30
fungianteaya: it takes a week to prepare the liver, and then a week to deal with the hangover? no idea really23:30
clarkbits the camping23:30
anteayafungi: that is my only conclusion23:30
clarkbyou can midcycle if your family has you miles from a toilet23:30
anteayathe only person I know is a camper is dansmith23:31
anteayanoone else mentions camping at all23:31
anteayamiles from a toilet is camping23:31
clarkbas a non american american I don't get it either fwiw23:31
anteayathat is the definition23:31
anteayaclarkb: okay thanks for trying though23:31
fungii used to go camping all the time. but now i own a house. would be a pity not to spend time in it when i'm paying for it23:31
anteayayou get point from me on that23:31
anteayafungi: see that is what I figure everyone else is feeling23:32
*** sridhar_ram has quit IRC23:32
dansmithpooping in the woods is just an experience you have to "feel" to understand23:32
openstackgerritMerged openstack-infra/shade: Refactor the port search logic  https://review.openstack.org/30385223:32
fungihaving grown up in the middle of nowhere in the nc mountains, i am well aware23:32
fungibut camping was sort of a ho-hum experience. it was what everyone who visited wanted to do23:33
anteayadansmith: exactly23:33
fungior how we got away from adults when i was young enough not to be one23:33
*** tosky has quit IRC23:34
clarkbnational independence is a big deal in many countries though23:34
*** Qiming has joined #openstack-infra23:35
anteayait is one day23:35
anteayaCanada celebrates in one day23:35
clarkbya but in muricas case kids are out of school so you take the long weekend and do stuff23:35
clarkbvisit family, camping, etc23:35
fungito quote the simpsons, "Celebrate the independence of your nation by blowing up a small part of it."23:35
jeblairclarkb: where's the old nodepool server?23:35
clarkbjeblair: deleted23:35
anteayaI still don't understand the two week window but I'll stop now23:35
jeblairdid anyone save an image?23:35
clarkbjeblair: since rax doesn't have a temporarily turn this server off option23:36
clarkbjeblair: yes23:36
clarkbthere is a snapshot called nodepool-something-or-other23:36
fungiclarkb had forethought to keep a snapshot23:36
*** kzaitsev_mb has joined #openstack-infra23:36
jeblairclarkb: thanks!23:36
fungiwhat did we almost lose?23:36
jeblair(also, really they don't have a poweroff?)23:36
jeblairfungi: logs from the past 2 weeks23:36
clarkbjeblair: not that I could find all of those extensions where rejected by the api23:36
fungijeblair: ahh, yep, that would have been useful to have23:36
clarkbjeblair: nova supports it but rax doesn't deploy those bits of the api23:36
*** yuanying has quit IRC23:36
jeblairwhich i can process to get the numbers that mordred has me on the hook for :)23:37
fungiyou can sudo halt the vm too23:37
clarkbfungi: but only if yo ucan ssh in :)23:37
fungiyeah, that23:37
*** kengo_sakai_mba has joined #openstack-infra23:37
*** ZZelle_ has quit IRC23:37
fungialso it might get rebooted into service by "helpful" provider23:37
brucetfungi: Same problem23:38
*** rfolco_ has joined #openstack-infra23:38
fungijeblair: if you do try to boot an instance from it, you'll likely need recovery mode since there's no ssh host key any longer23:38
fungibrucet: same problem as in gerrit still says it can't store contact information?23:38
brucetNo that's fixed23:38
clarkbjeblair: or download it locally if that is an option and ninja fix the keys23:39
brucetNow I think there's some env variables I need set23:39
*** sridhar_ram has joined #openstack-infra23:39
anteayabrucet: what is the error you are seeing?23:39
brucetCan't contact gerrit23:39
jeblairclarkb, fungi: i'm booting one now, we'll see how it goes :)23:39
nibalizerevery time i try to afs23:39
clarkbjeblair: oh actually it should just work because cloud init will make new keys since the instance id changed23:39
*** xarses_ has joined #openstack-infra23:39
jeblairclarkb: also, rax claims to have set the root password23:39
jeblairnibalizer: anything i can do to help?23:40
fungibrucet: added your ssh public key at https://review.openstack.org/#/settings/ssh-keys ?23:40
nibalizerjeblair: nah i jenst gotta derp with it23:40
clarkbI also haven't deleted the old volume so you can attach that if you need it (but its all ephemeral data so you probably don't)23:40
*** lakshmiS_ has quit IRC23:40
*** xarses_ has quit IRC23:40
brucetIt's using http auth instead of SSH23:40
*** lakshmiS has joined #openstack-infra23:40
*** xarses_ has joined #openstack-infra23:40
jeblairclarkb: yeah, everything i need should be on /23:40
fungibrucet: again? i thought you removed your gerrit remote and reran git review to recreate it with defaults?23:41
jeblairi'm thinking now might be a good time to start using afs homedirs23:41
nibalizerjeblair: how do i get pts listentries to use my ticket?23:41
nibalizeri have a ticket in klist23:41
jeblairnibalizer: aklog to get a token23:41
brucetgit review is supposed to create defaults??23:42
jeblairnibalizer: (then you will have 2 entries in klist, your tgt and your service ticket (== token))23:42
brucetNot sure its doing taht23:42
brucetwhat's the command to look at your gerrit variables?23:42
zarojeblair: was wondering if i could get quick feeback on verify-status plugin23:42
fungibrucet: test the connection/auth with `ssh -p 29418 fungi@review.openstack.org gerrit version` and make sure it's returning "gerrit version 2.11.4-11-ga14450f"23:43
*** xarses has quit IRC23:43
zarojeblair: this is the visualization that i think may work https://imgur.com/yZLjHTe23:43
fungibrucet: but with your username instead of "fungi" obviously23:43
*** lakshmiS has left #openstack-infra23:44
brucetkeys are no good now23:44
brucetThey were good earlier23:44
brucetI'll try setting them again23:45
fungibrucet: git review relies on having working pull/push remotes in .git/config (autocreated from settings it finds in the repo's .gitreview file), and also optionally from a [gitreview] section in your ~/.gitconfig23:45
fungibrucet: working git remotes named "gerrit" specifically23:46
EmilienMI randomly found something weird in logs, I'm not sure it's relevant, but just in case:23:46
EmilienMglean.sh[6579]: IOError: [Errno 2] No such file or directory: '/sys/class/net/ovs/system/addr_assign_type'23:46
brucetLet me recreate the ssh keys and try again23:46
jeblairzaro: and separately, there's a URL associated with each (assume the name is a link to it); also, i think you left off 'name' from your column list, though it's obviously there in the image23:46
jeblairzaro: and separately, there's a URL associated with each (assume the name is a link to it)? also, i think you left off 'name' from your column list, though it's obviously there in the image23:47
*** asettle has quit IRC23:47
jeblairzaro: (sorry, that was meant to be a question)23:47
fungibrucet: normally if there are no git remotes in the local repo's .git/config file then git review will attempt to create them for you (after testing connectivity with the username it prompts you for, assuming the contents of $USER aren't successfully authenticating as a gerrit username)23:47
*** andreww has joined #openstack-infra23:47
*** kzaitsev_mb has quit IRC23:47
zarojeblair: yes, it's mean to work similar to how it is on review.o.o so yeah link on the job name to the logs23:48
zarojeblair: i had also planned to setup config param to show/hide either condenced or more info23:49
jeblairzaro: i think that's got all the info.  we might want to tweak the formatting (maybe voting should be after duration, and columns should align or something), but generally, that looks good.23:49
*** sdake has quit IRC23:50
brucetssh -p 29418 brucetcisco@review.openstack.org gerrit version23:50
brucetAgent admitted failure to sign using the key.23:50
brucetPermission denied (publickey).23:50
*** rfolco_ has quit IRC23:50
*** xarses_ has quit IRC23:50
brucetNew public key does not work for me23:50
jeblairzaro: (also, there are questions to deal with like how to sort the full info -- probably by reporter then category, or maybe by reporter then timestamp)23:50
jeblairzaro: but that's easy to tweak later too23:51
brucetOne step forward. Two steps back23:52
zarojeblair: wow, i thought you would have more issues with it :)  cool, it's just about complete except for the little tweeks then.23:53
*** tqtran has quit IRC23:53
fungibrucet: that error means you're using an ssh agent and haven't done ssh-add23:54
*** baoli has joined #openstack-infra23:54
brucetWhere's the docs talling about ssh-add?23:54
*** yarkot_ has quit IRC23:55
clarkbbrucet: there should be a man page for it. `man ssh-add`23:55
brucetMan is right. Now it works23:55
brucetMagic incantations everywhere23:56
jeblairclarkb, fungi: my server has booted; it was waiting for the missing volumes to come online; i used the console to skip that, logged in as root, and stopped the nodepool processes23:56
zarojeblair: thanks for the feedback23:56
brucetOK. 1 step forward 1 step back23:56
brucetI'm gonna try again tomorrow23:57
jeblairclarkb, fungi: on the real nodepool server, i don't see anything funny with images, so i don't think the temp server mucked it up.23:57
brucetAm I the only person having this kind of trouble?23:57
anteayabrucet: are you using linux?23:57
clarkbjeblair: I wouldn't it expect it to, we already leak images like a sieve23:57
clarkbjeblair: next shade release should hopeflly address a few of those leaks23:58
brucetWhat time do you guys get going in the morning??23:58
fungibrucet: i think generally most people manage to muddle through (we have several thousand developers committing to over a thousand git repos with these tools/systems) but we do still get a fairly steady stream of questions23:58
anteayabrucet: yes perhaps read up on ssh-add and come back to this tomorrow23:58
anteayabrucet: I'm not a guy23:58
mordredjeblair: ++ to afs homedirs23:59
anteayabrucet: folks work all hours as we are located all over the globe23:59
brucetI already did ssh-add23:59
*** elopez has quit IRC23:59
brucetNow I'm on the next problem23:59
brucetssh works now23:59
anteayawhat is the next problem23:59
*** ramishra has quit IRC23:59
jeblairclarkb, fungi: old-nodepool at with ssh keys23:59
fungibrucet: if you need to take a break, there are people around in here pretty much around the clock23:59
brucetgot review thinks I am using http auth23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!