Thursday, 2016-11-24

ianwi'm fscking and remounting00:00
ianwthis time logs, doc-drafts & tarballs are all ro00:01
*** jerryz has joined #openstack-infra00:02
*** claudiub|2 has joined #openstack-infra00:02
*** wolverineav has joined #openstack-infra00:03
*** rbuzatu has joined #openstack-infra00:03
*** wolverineav has quit IRC00:03
*** gordc has quit IRC00:04
*** claudiub|2 has quit IRC00:06
ianwok tarballs is back00:07
*** jascott1 has quit IRC00:07
ianwdocs-draft & logs fscking00:07
jeblairoy logs00:08
jeblairianw: i'll send the status for you00:08
*** jascott1 has joined #openstack-infra00:08
ianwjeblair: running a root screen session with the fscks00:08
jeblair#status alert Due to a problem with the cinder volume backing the log server, jobs are failing with POST_FAILURE.  Please avoid issuing 'recheck' commands until the issue is resolved.00:08
openstackstatusjeblair: sending alert00:08
*** zz_dimtruck is now known as dimtruck00:09
jeblairrcarrillocruz: yeah, that was roughly what i had in mind; i will have to look closer at it later00:09
*** Douhet has quit IRC00:10
*** Douhet has joined #openstack-infra00:11
-openstackstatus- NOTICE: Due to a problem with the cinder volume backing the log server, jobs are failing with POST_FAILURE. Please avoid issuing 'recheck' commands until the issue is resolved.00:11
*** ChanServ changes topic to "Due to a problem with the cinder volume backing the log server, jobs are failing with POST_FAILURE. Please avoid issuing 'recheck' commands until the issue is resolved."00:11
*** jascott1 has quit IRC00:11
tlianResubmitting "recheck" still failed with "POST_FAILURE". Does anybody know what's going on?00:13
jeblairtlian: yes, the same failed again; recovery is in progress.00:14
*** jascott1 has joined #openstack-infra00:15
*** jkilpatr_ has quit IRC00:15
jeblairianw: i'm guessing the racker earlier just jiggled the drive00:15
*** s-shiono has joined #openstack-infra00:15
ianwyeah, you gotta blow on the connector before you stick it back in!  clearly didn't have a NES growing up00:16
jeblair++00:16
*** wolverineav has joined #openstack-infra00:17
*** sdake_ has joined #openstack-infra00:18
*** ianychoi has quit IRC00:19
ianwok docs back online00:20
*** jamesdenton has joined #openstack-infra00:21
ianwi think logstash is really killing apache looking for non existant logs on static00:21
*** sdake has quit IRC00:21
ianw15% done on logs check00:21
jeblairnb01.openstack.org exists now.  i have not added the cinder volume yet or done anything else needed before starting up the builder.00:21
*** wolverineav has quit IRC00:22
*** wolverineav has joined #openstack-infra00:22
pabelangerYay00:23
openstackgerritPaul Belanger proposed openstack-infra/project-config: Create experimental kolla-publish-image-jobs  https://review.openstack.org/40146200:24
*** Julien-zte has joined #openstack-infra00:26
*** mmandel has joined #openstack-infra00:27
*** hongbin has quit IRC00:27
tlian@jeblair: thanks for the update00:27
*** wolverineav has quit IRC00:27
*** mmandel has quit IRC00:31
*** wolverineav has joined #openstack-infra00:32
*** Julien-zte has quit IRC00:37
*** wolverineav has quit IRC00:37
*** rbuzatu has quit IRC00:37
*** annegentle has quit IRC00:39
*** shashank_hegde has quit IRC00:39
*** Julien-zte has joined #openstack-infra00:39
*** Julien-zte has joined #openstack-infra00:40
*** wolverineav has joined #openstack-infra00:42
*** jamesdenton has quit IRC00:46
*** s-shiono has quit IRC00:46
*** jamesdenton has joined #openstack-infra00:48
*** wolverineav has quit IRC00:48
*** wolverineav has joined #openstack-infra00:48
*** Julien-zte has quit IRC00:48
*** Julien-zte has joined #openstack-infra00:50
*** wolverineav has quit IRC00:50
*** wolverineav has joined #openstack-infra00:51
ianwok, at about 25% on logs00:51
*** yolanda has joined #openstack-infra00:51
*** wolverineav has quit IRC00:53
*** Julien-zte has quit IRC00:53
*** jamesdenton has quit IRC00:54
*** Julien-zte has joined #openstack-infra00:55
*** ijw has quit IRC00:55
*** wolverineav has joined #openstack-infra00:58
*** wolverin_ has joined #openstack-infra00:59
*** gildub has joined #openstack-infra00:59
*** Sukhdev has quit IRC00:59
*** tojuvone has quit IRC01:02
*** wolverineav has quit IRC01:03
*** tqtran has quit IRC01:03
*** wolverin_ has quit IRC01:04
*** _ody has quit IRC01:08
*** kaisers has quit IRC01:09
*** Julien-zte has quit IRC01:12
*** Julien-zte has joined #openstack-infra01:13
*** _ody has joined #openstack-infra01:15
*** ijw has joined #openstack-infra01:16
*** dimtruck is now known as zz_dimtruck01:18
*** wolverineav has joined #openstack-infra01:19
*** wolverineav has quit IRC01:20
*** ijw has quit IRC01:20
*** ijw has joined #openstack-infra01:21
openstackgerritMerged openstack-infra/tripleo-ci: Don't pass deprecated validation param to overcloud deploy  https://review.openstack.org/39797201:21
*** rbuzatu has joined #openstack-infra01:24
*** kaisers has joined #openstack-infra01:25
*** rbuzatu has quit IRC01:29
*** wolverineav has joined #openstack-infra01:29
*** ijw has quit IRC01:31
*** wolverin_ has joined #openstack-infra01:31
*** thorst_ has joined #openstack-infra01:32
*** wolverineav has quit IRC01:34
*** thorst_ has quit IRC01:34
*** yanyanhu has joined #openstack-infra01:34
*** zhurong has joined #openstack-infra01:34
*** thorst_ has joined #openstack-infra01:34
*** wolverin_ has quit IRC01:35
*** wolverineav has joined #openstack-infra01:37
*** shashank_hegde has joined #openstack-infra01:38
*** aeng has quit IRC01:39
*** wolverineav has quit IRC01:41
*** kaisers1 has joined #openstack-infra01:43
*** thorst_ has quit IRC01:43
*** kaisers has quit IRC01:44
*** wolverineav has joined #openstack-infra01:47
*** wolverineav has quit IRC01:48
*** wolverineav has joined #openstack-infra01:49
*** wolverin_ has joined #openstack-infra01:50
*** sshnaidm is now known as sshnaidm|away01:52
*** zz_dimtruck is now known as dimtruck01:52
*** wolverineav has quit IRC01:53
*** wolverin_ has quit IRC01:55
*** Goneri has quit IRC01:56
*** wolverineav has joined #openstack-infra01:58
*** Julien-zte has quit IRC01:59
*** Julien-zte has joined #openstack-infra01:59
ianwhmmm, nodepool has acquired a bunch of old loopback mounts01:59
ianwi think this is getting things mighty confused as /dev is mounted in the chroot02:00
ianwalmost 75% on logs!  it's a big old fs02:01
*** wolverineav has quit IRC02:03
jeblairthe best part is it's so slow you can't see the spinning cursor move.  the spinning cursor needs its own spinning cursor.02:03
*** wolverineav has joined #openstack-infra02:03
ianwthat i think explains why fedora builds are trying to install ubuntu kernels02:04
ianwi'm going to stop the builder and try and clean all this up02:05
*** wolverin_ has joined #openstack-infra02:07
*** wolverineav has quit IRC02:08
*** wolverin_ has quit IRC02:12
*** hongbin has joined #openstack-infra02:13
*** waynr has joined #openstack-infra02:15
*** wolverineav has joined #openstack-infra02:17
*** wolverineav has quit IRC02:19
*** adriant has quit IRC02:20
*** wolverineav has joined #openstack-infra02:22
*** sdake_ has quit IRC02:25
*** rbuzatu has joined #openstack-infra02:26
*** wolverineav has quit IRC02:26
*** adriant has joined #openstack-infra02:26
*** wolverineav has joined #openstack-infra02:26
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add ianw to statusbot nicks  https://review.openstack.org/40182902:27
*** thorst_ has joined #openstack-infra02:28
*** waynr has left #openstack-infra02:28
jeblairwe should merge that after we status ok... i don't want to disrupt the bot while it's in the alert state02:29
ianw78.2% for all those waiting for an exciting fsck update02:30
*** wolverineav has quit IRC02:31
*** thorst_ has quit IRC02:35
*** wolverineav has joined #openstack-infra02:36
*** wolverin_ has joined #openstack-infra02:39
*** wolverineav has quit IRC02:41
*** wolverin_ has quit IRC02:42
*** wolverineav has joined #openstack-infra02:42
*** wolverineav has quit IRC02:47
*** wolverineav has joined #openstack-infra02:49
*** wolverineav has quit IRC02:51
*** yamahata has quit IRC02:53
*** thorst_ has joined #openstack-infra02:53
*** yolanda has quit IRC02:54
*** tuanluong has joined #openstack-infra02:57
*** wolverineav has joined #openstack-infra02:57
*** yolanda has joined #openstack-infra02:57
*** thorst_ has quit IRC02:58
*** rbuzatu has quit IRC02:59
*** wolverineav has quit IRC03:01
*** wolverineav has joined #openstack-infra03:02
*** zhurong has quit IRC03:03
*** zhurong_ has joined #openstack-infra03:03
*** Julien-zte has quit IRC03:06
*** Julien-zte has joined #openstack-infra03:07
*** Julien-zte has quit IRC03:10
*** Julien-zte has joined #openstack-infra03:11
*** aeng has joined #openstack-infra03:11
*** Julien-zte has quit IRC03:11
*** Julien-zte has joined #openstack-infra03:12
*** wolverineav has quit IRC03:13
*** rossella_s has quit IRC03:13
*** wolverineav has joined #openstack-infra03:13
*** knangia has quit IRC03:13
*** Julien-zte has quit IRC03:17
*** Julien-zte has joined #openstack-infra03:18
*** wolverineav has quit IRC03:18
jeblair86.2%03:21
*** yamamoto_ has joined #openstack-infra03:22
*** wolverineav has joined #openstack-infra03:23
*** jerryz has quit IRC03:24
*** allanice001 has joined #openstack-infra03:24
*** thorst_ has joined #openstack-infra03:24
*** wolverineav has quit IRC03:31
*** rlandy|bbl is now known as rlandy03:32
*** thorst_ has quit IRC03:32
*** EricGonc_ has quit IRC03:36
*** rlandy has quit IRC03:36
*** wolverineav has joined #openstack-infra03:36
*** wolverineav has quit IRC03:40
*** wolverineav has joined #openstack-infra03:46
*** gildub has quit IRC03:48
*** EmilienM has quit IRC03:50
*** timello has quit IRC03:51
*** wolverineav has quit IRC03:51
*** tlian has quit IRC03:51
*** njohnston has quit IRC03:51
*** wolverineav has joined #openstack-infra03:52
*** njohnston has joined #openstack-infra03:52
*** EmilienM has joined #openstack-infra03:53
*** rbuzatu has joined #openstack-infra03:56
*** wolverineav has quit IRC03:56
*** timello has joined #openstack-infra03:57
*** newmember has joined #openstack-infra04:01
*** wolverineav has joined #openstack-infra04:02
*** psachin has joined #openstack-infra04:02
*** wolverineav has quit IRC04:06
*** ssbarnea_ has quit IRC04:07
*** wolverineav has joined #openstack-infra04:12
*** wolverin_ has joined #openstack-infra04:19
ianwwell, deleting all those loop devices did stop odd kernels being chosen for f24 builds, but hasn't solved the problem :(04:20
*** wolverineav has quit IRC04:21
*** wolverin_ has quit IRC04:23
*** wolverineav has joined #openstack-infra04:24
*** bhunter71 has quit IRC04:25
*** wolverineav has quit IRC04:25
*** ssbarnea has joined #openstack-infra04:25
*** yamahata has joined #openstack-infra04:26
*** mmandel has joined #openstack-infra04:27
*** rbuzatu has quit IRC04:29
*** mmandel has quit IRC04:32
*** flwang1 has quit IRC04:32
*** wolverineav has joined #openstack-infra04:34
*** Julien-zte has quit IRC04:38
*** wolverineav has quit IRC04:38
*** Julien-zte has joined #openstack-infra04:39
*** baoli has joined #openstack-infra04:41
*** ianychoi has joined #openstack-infra04:42
*** wolverineav has joined #openstack-infra04:44
*** sdake has joined #openstack-infra04:44
jeblair89.9%04:44
*** sdake has quit IRC04:44
jeblair93.9%04:45
jeblairit's like the opposite of the usual progress bar04:45
*** links has joined #openstack-infra04:45
jeblairspeeds up at the end04:46
ianwyep, almost done i think04:46
ianwat least it found something04:46
jeblairianw: i'll leave the remount to you but i'll check in one more time before i head to bed to send the status ok04:48
ianwjeblair: np! thanks, and happy thanksgiving04:48
*** wolverineav has quit IRC04:48
*** dimtruck is now known as zz_dimtruck04:49
*** armax has quit IRC04:50
*** wolverineav has joined #openstack-infra04:54
*** snarwade has joined #openstack-infra04:54
*** wolverin_ has joined #openstack-infra04:55
ianwjeblair: ok, we should be back04:58
*** wolverineav has quit IRC04:58
*** wolverin_ has quit IRC05:04
*** baoli has quit IRC05:05
*** hichihara has joined #openstack-infra05:10
*** wolverineav has joined #openstack-infra05:11
*** wolverineav has quit IRC05:11
*** Julien-z_ has joined #openstack-infra05:18
*** Julien-zte has quit IRC05:20
*** vikrant has joined #openstack-infra05:24
*** anilvenkata has joined #openstack-infra05:24
*** rbuzatu has joined #openstack-infra05:26
*** wolverineav has joined #openstack-infra05:31
jeblair#status ok The affected filesystems on the log server are repaired.  Please leave 'recheck' comments on any changes which failed with POST_FAILURE.05:34
openstackstatusjeblair: sending ok05:34
jeblairianw: thanks :)05:34
*** wolverineav has quit IRC05:35
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"05:37
-openstackstatus- NOTICE: The affected filesystems on the log server are repaired. Please leave 'recheck' comments on any changes which failed with POST_FAILURE.05:37
*** adriant has quit IRC05:38
*** wolverineav has joined #openstack-infra05:43
*** wolverineav has quit IRC05:51
*** wolverineav has joined #openstack-infra05:57
*** rbuzatu has quit IRC06:00
*** wolverineav has quit IRC06:02
*** flaper87 has joined #openstack-infra06:03
*** flaper87 is now known as Guest6050706:03
*** nadya has joined #openstack-infra06:03
*** nadya has quit IRC06:03
*** wolverineav has joined #openstack-infra06:04
*** toabctl has quit IRC06:06
*** hurgleburgler has quit IRC06:07
*** wolverineav has quit IRC06:09
*** esikachev has joined #openstack-infra06:10
*** hichihara has quit IRC06:11
*** hongbin has quit IRC06:12
*** Julien-z_ has quit IRC06:15
*** Julien-zte has joined #openstack-infra06:16
*** Julien-zte has quit IRC06:17
*** Julien-zte has joined #openstack-infra06:17
openstackgerritMasayuki Igawa proposed openstack/gertty: Make size column configurable a graph  https://review.openstack.org/38095006:18
*** Guest60507 has quit IRC06:21
*** tojuvone has joined #openstack-infra06:23
*** wolverineav has joined #openstack-infra06:24
*** nadya has joined #openstack-infra06:27
*** abregman has joined #openstack-infra06:28
*** wolverineav has quit IRC06:29
*** toabctl has joined #openstack-infra06:34
*** toabctl has quit IRC06:34
*** toabctl has joined #openstack-infra06:34
*** senk has joined #openstack-infra06:35
*** wolverineav has joined #openstack-infra06:35
*** toabctl has quit IRC06:35
*** ad_rien_ has joined #openstack-infra06:39
*** wolverineav has quit IRC06:39
*** toabctl has joined #openstack-infra06:40
*** ad_rien_ has quit IRC06:43
*** wolverineav has joined #openstack-infra06:45
masuberuhi06:47
*** wolverineav has quit IRC06:49
*** aeng has quit IRC06:52
AJaegerjeblair, amrith: The check for zuul pipeline is correct. It caught exactly one of the situations it should catch: A project getting retired with wrong ACLs. The ACL entry was added but with an old acl-config in, it did not work. The check tests for read-only projects and skips them.06:54
*** Julien-zte has quit IRC06:54
*** Julien-zte has joined #openstack-infra06:55
*** senk has quit IRC06:55
*** allanice001 has quit IRC06:56
*** oanson has joined #openstack-infra06:57
*** rbuzatu has joined #openstack-infra06:57
*** wolverineav has joined #openstack-infra06:59
*** drifterza has joined #openstack-infra07:00
*** tqtran has joined #openstack-infra07:01
*** Julien-zte has quit IRC07:01
*** Julien-zte has joined #openstack-infra07:02
*** yuval has joined #openstack-infra07:02
*** wolverineav has quit IRC07:04
*** tqtran has quit IRC07:05
*** baoli has joined #openstack-infra07:06
*** Julien-zte has quit IRC07:06
*** Julien-zte has joined #openstack-infra07:07
*** Julien-zte has quit IRC07:07
*** Julien-zte has joined #openstack-infra07:08
*** flaper87 has joined #openstack-infra07:10
*** wolverineav has joined #openstack-infra07:10
*** baoli has quit IRC07:10
*** anilvenkata is now known as anilvenkata_lunc07:13
openstackgerritZhenguo Niu proposed openstack-infra/project-config: Export VIRT_DRIVER in Nimble tempest job  https://review.openstack.org/40188607:15
*** Julien-zte has quit IRC07:16
*** Julien-zte has joined #openstack-infra07:17
*** Julien-zte has joined #openstack-infra07:17
*** yamamoto_ has quit IRC07:18
*** wolverineav has quit IRC07:18
*** tesseract has joined #openstack-infra07:18
*** tesseract is now known as Guest1349107:19
*** pgadiya has joined #openstack-infra07:21
*** wolverineav has joined #openstack-infra07:21
*** rcernin has joined #openstack-infra07:21
*** aviau has quit IRC07:24
*** toabctl has quit IRC07:24
*** aviau has joined #openstack-infra07:24
*** wolverineav has quit IRC07:25
*** isaacb has joined #openstack-infra07:25
*** toabctl has joined #openstack-infra07:26
*** Guest2 has joined #openstack-infra07:26
*** flaper87 has quit IRC07:28
*** rbuzatu has quit IRC07:30
*** flwang1 has joined #openstack-infra07:31
*** ad_rien_1 has joined #openstack-infra07:31
*** garyk1 has joined #openstack-infra07:32
garyk1ttx: AJaeger: fungi: are any of you guys around?07:33
*** florianf has joined #openstack-infra07:34
*** nherciu has joined #openstack-infra07:38
*** makowals has joined #openstack-infra07:38
*** Julien-zte has quit IRC07:39
*** Julien-zte has joined #openstack-infra07:40
*** wolverineav has joined #openstack-infra07:41
*** Julien-zte has quit IRC07:42
*** saibarspeis has joined #openstack-infra07:42
*** Julien-zte has joined #openstack-infra07:43
* AJaeger is07:45
AJaegermorning, garyk107:45
*** wolverineav has quit IRC07:46
*** rbuzatu has joined #openstack-infra07:46
garyk1AJaeger: hi, wonder if you could help or advise. there is a prjoject networking-l2gw. this does not have a stable/newton tag. i would like to add one, but i am not on the release team. the release team is not really working in the project anymore....07:47
*** Julien-zte has quit IRC07:47
garyk1any idea how we can add people to release team so that we can create the tag?07:47
*** Julien-zte has joined #openstack-infra07:47
AJaegergaryk1: just one word: It's not a tag, it's a branch!07:48
AJaegergaryk1: the release team creates those branches - based on tags.07:48
AJaegergaryk1: Let me check the config of l2gw07:48
garyk1AJaeger: thanks07:49
garyk1sorry my mix up with branch and tag07:49
AJaegerYes, we switched recently from release team to networking-l2gw-release07:50
*** jascott1 has quit IRC07:50
AJaegergaryk1: Did you check the config of networking-l2gw to see who's part of the release team?07:50
*** Julien-zte has quit IRC07:51
*** Julien-zte has joined #openstack-infra07:51
*** Julien-zte has quit IRC07:51
AJaegerGo to https://review.openstack.org/#/admin/projects/openstack/networking-l2gw,access - and click on the group. So, both of them are not reachable anymore?07:52
*** Julien-zte has joined #openstack-infra07:52
garyk1AJaeger: maruti has left07:53
garyk1sukdev is still around but unable to reach him07:53
AJaeger;(07:53
*** chandankumar has joined #openstack-infra07:53
garyk1my guess is that he will beout till at least next week monday07:54
AJaegerThen you need an infra-root to add you to that group.07:54
*** allanice001 has joined #openstack-infra07:54
*** wolverineav has joined #openstack-infra07:54
garyk1ok, thanks. any idea where i can see a list of those people to try and reach out to them07:54
AJaegerAnd then you should create first a tag and then branch from there.07:54
garyk1AJaeger: understood. thanks!07:54
AJaegergaryk1: infra-root is the magical word to call out for them. If nobody answers, everybody is out ;)07:54
*** dtardivel has joined #openstack-infra07:54
AJaegergaryk1: neither ttx nor me can help here.07:55
garyk1:)07:55
*** Julien-zte has quit IRC07:55
garyk1i always thought that you guys had the keys to the kingdom07:55
AJaegerhope one of them reads backscroll and does this...07:55
*** shashank_hegde has quit IRC07:56
AJaegergaryk1: for me it's only do a small fifedom not the whole kingdom - and that fifedom is large enough for me ;)07:56
AJaegerbbl07:56
*** Julien-zte has joined #openstack-infra07:57
openstackgerritTomasz TrÄ™bski proposed openstack-infra/project-config: Monasca Gate Setup for ORM+PostgreSQL  https://review.openstack.org/36661707:57
*** yamamoto_ has joined #openstack-infra07:58
*** wolverineav has quit IRC07:58
*** hashar has joined #openstack-infra08:02
*** wolverineav has joined #openstack-infra08:02
*** ccamacho has joined #openstack-infra08:02
ianwAJaeger: what's up?08:02
ianwoh, yeah i don't think i'm a gerrit admin either08:03
ianwjhesketh might be the best bet08:04
*** wolverineav has quit IRC08:06
AJaegerianw: you're not? I guess you are but just don't know it yet ;) But then let somebody tutor you first ... Thanks for speaking up.08:07
*** sflanigan has quit IRC08:09
*** Julien-zte has quit IRC08:09
*** senk has joined #openstack-infra08:10
*** gouthamr has joined #openstack-infra08:11
*** wolverineav has joined #openstack-infra08:12
*** drifterza has quit IRC08:13
*** drifterza has joined #openstack-infra08:13
*** jaosorior has joined #openstack-infra08:13
jheskethAJaeger: I'm out at dinner at the moment sorry. Is it urgent otherwise I'll look tonight08:15
*** Guest2 has quit IRC08:15
*** ralonsoh has joined #openstack-infra08:19
*** anilvenkata_lunc has quit IRC08:20
*** jpena|off is now known as jpena08:20
*** wolverineav has quit IRC08:24
*** abregman has quit IRC08:26
*** matrohon has joined #openstack-infra08:26
*** jpich has joined #openstack-infra08:28
*** nmagnezi has joined #openstack-infra08:28
*** rossella_s has joined #openstack-infra08:33
migiAJaeger: hey, got question around tox_install.sh08:36
*** wolverineav has joined #openstack-infra08:37
openstackgerritMasayuki Igawa proposed openstack-infra/project-config: Make os-testr py35 job to voting  https://review.openstack.org/40191308:37
*** abregman has joined #openstack-infra08:38
*** wolverineav has quit IRC08:42
*** weshay has quit IRC08:43
*** amoralej|off is now known as amoralej08:44
*** flaper87 has joined #openstack-infra08:45
*** flaper87 has quit IRC08:46
*** dtantsur|afk is now known as dtantsur08:48
*** weshay has joined #openstack-infra08:49
*** betherly has quit IRC08:49
*** flaper87 has joined #openstack-infra08:50
*** wolverineav has joined #openstack-infra08:50
*** jascott1 has joined #openstack-infra08:50
*** bkero is now known as bkero-holiday08:51
openstackgerritTung Doan proposed openstack-infra/project-config: Tacker-Xenial  https://review.openstack.org/40130608:52
*** wolverineav has quit IRC08:55
*** nherciu_ has joined #openstack-infra08:55
*** jascott1 has quit IRC08:55
*** gmann_ has joined #openstack-infra08:57
*** nherciu has quit IRC08:58
*** nadya has quit IRC08:58
*** lucas-afk is now known as lucasagomes08:58
*** gmann_ has quit IRC08:58
*** zzzeek has quit IRC09:00
*** wolverineav has joined #openstack-infra09:01
*** saibarspeis has quit IRC09:01
*** zzzeek has joined #openstack-infra09:01
*** dingyichen has quit IRC09:01
*** saibarspeis has joined #openstack-infra09:03
*** zhurong_ has quit IRC09:03
*** abregman has quit IRC09:04
*** saibarspeis has quit IRC09:05
*** yamahata has quit IRC09:05
*** baoli has joined #openstack-infra09:07
*** wolverineav has quit IRC09:08
*** abregman has joined #openstack-infra09:09
*** saibarspeis has joined #openstack-infra09:14
*** andymaier has joined #openstack-infra09:14
*** ihrachys has joined #openstack-infra09:16
*** baoli has quit IRC09:17
*** newmember has quit IRC09:18
*** wolverineav has joined #openstack-infra09:19
*** asettle has joined #openstack-infra09:24
*** saibarspeis has quit IRC09:24
*** asettle has quit IRC09:26
*** nadya has joined #openstack-infra09:27
*** asettle has joined #openstack-infra09:27
openstackgerritMatt Jarvis proposed openstack-infra/irc-meetings: Add meeting for public cloud working group  https://review.openstack.org/40193009:28
*** wolverineav has quit IRC09:28
*** e0ne has joined #openstack-infra09:29
*** ihrachys has quit IRC09:30
*** saibarspeis has joined #openstack-infra09:31
*** saibarspeis has quit IRC09:33
*** wolverineav has joined #openstack-infra09:33
*** john-davidge has joined #openstack-infra09:33
*** rbuzatu has quit IRC09:33
*** saibarspeis has joined #openstack-infra09:34
*** rbuzatu has joined #openstack-infra09:34
*** dizquierdo has joined #openstack-infra09:37
*** wolverineav has quit IRC09:38
*** acoles_ is now known as acoles09:38
*** andymaier has quit IRC09:40
*** chandankumar_ has joined #openstack-infra09:42
*** tpsilva has joined #openstack-infra09:42
openstackgerritMathieu Rohon proposed openstack-infra/project-config: Make net-bgpvpn jobs run on trusty for mitaka and older  https://review.openstack.org/39711109:43
*** chandankumar has quit IRC09:44
*** wolverineav has joined #openstack-infra09:46
openstackgerritMerged openstack-infra/project-config: Run tools/test-setup.sh for unittests  https://review.openstack.org/39910509:46
*** dizquierdo has quit IRC09:46
*** electrofelix has joined #openstack-infra09:48
*** mhickey has joined #openstack-infra09:48
*** chandankumar_ is now known as chandankumar09:49
*** wolverineav has quit IRC09:50
*** sshnaidm|away is now known as sshnaidm09:54
*** andymaier has joined #openstack-infra09:54
*** wolverineav has joined #openstack-infra09:56
*** wolverineav has quit IRC10:01
*** flepied has joined #openstack-infra10:01
*** ralonsoh_ has joined #openstack-infra10:03
*** tovin07 has quit IRC10:03
*** ralonsoh has quit IRC10:06
*** wolverineav has joined #openstack-infra10:06
*** tuanluong has quit IRC10:08
*** markus_z has joined #openstack-infra10:10
*** isaacb has quit IRC10:10
*** wolverineav has quit IRC10:11
*** ad_rien_1 has quit IRC10:11
*** jascott1 has joined #openstack-infra10:12
markus_zCan someone add me as core to the new project "nova-dpm" please? I'll manage the rest with my co-workers who started this project. core group: https://review.openstack.org/#/admin/groups/1632,members release group: https://review.openstack.org/#/admin/groups/1633,members10:14
*** lucasagomes is now known as lucas-relocate10:15
*** jascott1 has quit IRC10:19
*** ihrachys has joined #openstack-infra10:22
*** derekh has joined #openstack-infra10:23
*** wolverineav has joined #openstack-infra10:23
*** derekh has quit IRC10:23
*** bkero-holiday is now known as bkero10:24
*** yanyanhu has quit IRC10:24
*** NBziouech has joined #openstack-infra10:27
*** wolverineav has quit IRC10:28
*** e0ne has quit IRC10:28
*** wolverineav has joined #openstack-infra10:29
*** arxcruz has quit IRC10:30
*** mhickey has quit IRC10:32
*** wolverineav has quit IRC10:37
*** sambetts|afk is now known as sambetts10:38
*** rbuzatu has quit IRC10:38
*** rbuzatu has joined #openstack-infra10:39
*** wolverineav has joined #openstack-infra10:39
*** flaper87 has quit IRC10:41
*** flaper87 has joined #openstack-infra10:41
*** arxcruz has joined #openstack-infra10:43
*** derekh has joined #openstack-infra10:43
*** ldnunes has joined #openstack-infra10:43
*** isaacb has joined #openstack-infra10:45
*** rbuzatu has quit IRC10:45
*** rbuzatu_ has joined #openstack-infra10:45
*** wolverineav has quit IRC10:46
AJaegerjhesketh: not that urgent - would be nice to be done today AFAIU. Hope you enjoyed dinner!10:48
AJaegermigi: please just ask10:49
migiAJaeger: just saw there are number of modules that are using different BRANCH_NAME in this script, but I am going through all of them and proposing changes into stable/newton10:49
migiAJaeger: but after that I think there could be better way of syncinc up this script with one from openstackclient10:50
migiAJaeger: I am wondering why this can't be specified in tox.ini and passed to the wrapper script as argument10:51
migiAJaeger: thoughts?10:51
*** katkapilatova has joined #openstack-infra10:51
openstackgerritMathieu Rohon proposed openstack-infra/project-config: Make net-bgpvpn jobs run on trusty for mitaka and older  https://review.openstack.org/39711110:52
*** Jeffrey4l has quit IRC10:52
*** nadya has quit IRC10:57
*** e0ne has joined #openstack-infra10:58
*** lucas-relocate is now known as lucasagomes11:00
AJaegermigi: I didn't write those scripts, just fixed them ;)11:01
migiAJaeger: ah ok thought you wrote them as you commited to few projects :)11:01
*** wolverineav has joined #openstack-infra11:01
AJaegermigi: But as I documented in one of the reviews: the tox.ini file update was scheduled to be done by the release team. Best talk next week to dhellmann about this.11:02
migiok11:02
AJaegermigi: I copied some over to help fix problems when I was asked for it ;)11:02
migisame here11:02
AJaegerI guess the shell update was not on dhellmann's radar. But discuss with him.11:03
*** tosky has joined #openstack-infra11:03
migiAJaeger: will do, thanks11:04
*** ralonsoh__ has joined #openstack-infra11:04
*** Jeffrey4l has joined #openstack-infra11:04
AJaegermigi: they have already scripts that update .gitreview, I expected that those handle tox.ini as well but if not, discuss with him and rest of team.11:04
AJaegermigi: Thanks for fixing these!11:04
*** Jeffrey4l has quit IRC11:05
*** Jeffrey4l has joined #openstack-infra11:06
*** wolverineav has quit IRC11:06
*** Jeffrey4l has quit IRC11:07
*** ralonsoh_ has quit IRC11:07
*** Jeffrey4l has joined #openstack-infra11:07
openstackgerritMathieu Rohon proposed openstack-infra/project-config: Make net-bgpvpn jobs run on trusty for mitaka and older  https://review.openstack.org/39711111:09
*** baoli has joined #openstack-infra11:14
*** rbuzatu has joined #openstack-infra11:14
*** yolanda has quit IRC11:16
*** rbuzatu__ has joined #openstack-infra11:17
*** rbuzatu_ has quit IRC11:18
*** rbuzatu has quit IRC11:19
*** baoli has quit IRC11:20
openstackgerritMerged openstack-infra/irc-meetings: Remove third-party-ci working group meeting  https://review.openstack.org/40135211:21
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Ansibly fix_etc_hosts  https://review.openstack.org/40197511:23
*** ociuhandu has quit IRC11:24
ihrachysis there some infra issue with log server?11:25
openstackgerritOfer Ben-Yacov proposed openstack-infra/project-config: Create experimental jobs for networking-l2gw  https://review.openstack.org/39772011:25
ihrachysI see docs jobs in POST_FAILURE and http://logs.openstack.org/28/357528/10/gate/gate-neutron-docs-ubuntu-xenial/f1d4abf/_zuul_ansible/ansible_log.txt in log dir11:26
ihrachysand also I spotted today some recent logstash hits that miss actual logs on the server11:26
*** zhurong has joined #openstack-infra11:32
*** acoles has left #openstack-infra11:34
*** jascott1 has joined #openstack-infra11:36
*** nicolasbock has joined #openstack-infra11:38
*** links has quit IRC11:39
*** jascott1 has quit IRC11:40
*** dizquierdo has joined #openstack-infra11:42
ianwihrachys: we had problems with cinder volumes attached to the log server today (where today means my day in australia :)11:44
ianwihrachys: i just double checked static.openstack.org and it's still ok, all volumes mounted.  so you'll just want a recheck on failed job11:45
ianwi'm out, happy thanksgiving to those who give thanks11:46
openstackgerritKATO Tomoyuki proposed openstack-infra/irc-meetings: Remove HA Guide speciality team meeting  https://review.openstack.org/40198811:46
mrtenioHave a Happy Thanksgiving, ianw.11:47
*** maishsk has joined #openstack-infra11:48
openstackgerritMarkos Chandras proposed openstack/diskimage-builder: elements: Drop unneeded DIB_INIT_SYSTEM usage  https://review.openstack.org/40199111:49
*** dtantsur is now known as dtantsur|brb11:49
ihrachysianw: thanks, and THANKS ;)11:50
*** dtantsur|brb is now known as dtantsur11:50
*** dtardivel has quit IRC11:54
*** links has joined #openstack-infra11:54
*** wolverineav has joined #openstack-infra11:59
*** smarcet has joined #openstack-infra12:01
openstackgerritTung Doan proposed openstack-infra/project-config: Tacker-Xenial  https://review.openstack.org/40130612:01
*** yolanda has joined #openstack-infra12:02
*** wolverineav has quit IRC12:04
*** wolverineav has joined #openstack-infra12:05
*** jpena is now known as jpena|lunch12:07
*** rbuzatu__ has quit IRC12:08
*** rbuzatu has joined #openstack-infra12:09
*** rbuzatu has quit IRC12:09
*** rbuzatu has joined #openstack-infra12:09
*** wolverineav has quit IRC12:10
*** ldnunes has quit IRC12:13
*** ldnunes has joined #openstack-infra12:14
*** ociuhandu has joined #openstack-infra12:15
*** dtantsur is now known as dtantsur|brb12:18
markus_zAJaeger: Can you maybe add me to https://review.openstack.org/#/admin/groups/1632,members ? My co-worker who started that project is sick atm.12:18
rcarrillocruzmarkus_z: what's your email address12:19
*** wolverineav has joined #openstack-infra12:19
markus_zrcarrillocruz: It's mzoeller@linux.vnet.ibm.com12:19
rcarrillocruzdone12:20
markus_zrcarrillocruz: Awesome, thanks a lot!12:20
rcarrillocruznp12:20
*** smarcet_ has joined #openstack-infra12:22
*** wolverineav has quit IRC12:24
markus_zrcarrillocruz: Apologies, would you add me to https://review.openstack.org/#/admin/groups/1633,members too? That's the "release" group I forgot.12:24
rcarrillocruzsure, done12:25
markus_zThanks again! :)12:25
openstackgerritMerged openstack-infra/tripleo-ci: Full quickstart gate run on OVB  https://review.openstack.org/38109412:25
*** NBziouech has quit IRC12:26
*** amoralej is now known as amoralej|lunch12:29
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: WIP TLS everywhere job  https://review.openstack.org/39173812:31
*** wolverineav has joined #openstack-infra12:32
*** smarcet_ has quit IRC12:32
*** smarcet_ has joined #openstack-infra12:33
*** lucasagomes is now known as lucas-hungry12:35
*** wolverineav has quit IRC12:37
*** ccamacho is now known as ccamacho|lunch12:40
*** dtantsur|brb is now known as dtantsur12:42
*** dizquierdo has quit IRC12:44
*** allanice001 has quit IRC12:48
*** kun_huang has left #openstack-infra12:49
*** snarwade has quit IRC12:50
*** wolverineav has joined #openstack-infra12:50
*** panda|zZ is now known as panda12:52
*** wolverineav has quit IRC12:55
drifterzais there any problems with the check gates ?12:58
drifterzajobs are queued for 50mins so far.12:59
markus_zdrifterza: I assume so too, yes. The grafana dashboard shows a flat line of nodes in use and the zuul job queue rises http://grafana.openstack.org/dashboard/db/zuul-status12:59
*** wolverineav has joined #openstack-infra13:00
*** jpena|lunch is now known as jpena13:00
markus_zSomething happened at around 12:10 UTC13:00
drifterzayeah weird13:02
*** nmagnezi has quit IRC13:03
*** abregman has quit IRC13:04
markus_zI have absolutely no idea how to debug and resolve such things :-/13:04
*** tqtran has joined #openstack-infra13:04
markus_zThe folks in the US are probably not available for the rest of this week. Today's Thanksgiving.13:04
*** esikachev has quit IRC13:06
*** maishsk has quit IRC13:08
*** tqtran has quit IRC13:09
*** wolverineav has quit IRC13:09
*** maishsk has joined #openstack-infra13:10
*** yolanda has quit IRC13:13
*** lucas-hungry is now known as lucasagomes13:13
*** links has quit IRC13:14
openstackgerritMatt Jarvis proposed openstack-infra/irc-meetings: Add meeting for public cloud working group  https://review.openstack.org/40193013:16
*** isaacb has quit IRC13:17
*** maishsk has quit IRC13:24
*** maishsk has joined #openstack-infra13:25
*** nadya has joined #openstack-infra13:25
*** maishsk has quit IRC13:26
AJaegerinfra-root, zuul or nodepool is broken. Looks like new job are started and neither jobs are build.13:29
*** wolverineav has joined #openstack-infra13:29
AJaegerdrifterza, markus_z thanks for reporting. I cannot help, just ask around. Worst case: Let's celebrate Thanksgiving even if we're not in America ;)13:30
drifterzahehe oh right its that day13:31
*** rossella_s has quit IRC13:31
*** rossella_s has joined #openstack-infra13:32
*** pgadiya has quit IRC13:32
AJaegerWhat to announce? "OpenStack CI has taken a Thanksgiving break; no new jobs are currently launched. We're currently hoping for a friendly admin to come out of Thanksgiving and fix the system." ?13:34
*** esikachev has joined #openstack-infra13:34
markus_zwell, it's on point, isn't it?13:34
drifterza+213:34
drifterza:)13:34
Zaramaybe include a cat pic13:34
markus_zah turkey pic maybe ;)13:34
AJaegerHas anybody ASCII art?13:35
* AJaeger talks about IRC announcements ;)13:35
Zaracould make one on here: http://asciiflow.com/13:35
*** wolverineav has quit IRC13:35
AJaegerZara: drawing? Me? Better not ;)13:35
*** smarcet_ has left #openstack-infra13:36
AJaegerZara: thanks for suggestion13:36
* AJaeger does an announcement - that's all I can do13:36
Zara:)13:36
*** dtardivel has joined #openstack-infra13:36
AJaeger#status notice OpenStack CI has taken a Thanksgiving break; no new jobs are currently launched. We're currently hoping for a friendly admin to come out of Thanksgiving and fix the system.13:37
openstackstatusAJaeger: sending notice13:37
*** newmember has joined #openstack-infra13:37
drifterzanice13:37
drifterzaI like that13:37
*** jascott1 has joined #openstack-infra13:38
AJaegerbbl13:38
-openstackstatus- NOTICE: OpenStack CI has taken a Thanksgiving break; no new jobs are currently launched. We're currently hoping for a friendly admin to come out of Thanksgiving and fix the system.13:38
*** yamamoto_ has quit IRC13:38
amrithAJaeger, I guess something is gumming up the works13:39
amrithmaybe a couple of rechecks will help :)13:39
openstackstatusAJaeger: finished sending notice13:40
*** thorst_ has joined #openstack-infra13:41
*** allanice001 has joined #openstack-infra13:42
pabelangermorning13:42
*** jascott1 has quit IRC13:42
AJaegeramrith: no, rechecks won't help13:43
amrith:)13:43
AJaegerpabelanger: morning - did you see my noticed above?13:43
pabelangerAJaeger: yes, looking now13:43
pabelangerI currently cannot SSH into nodepool13:43
AJaegeramrith: do you now know what to do for your repo retirement?13:43
AJaegerpabelanger: Is Canada celebrating this week as well?13:44
pabelangerAJaeger: nope, we do thanksgiving a month ago13:44
AJaegerGreat, then I feel less guilty and should have written the notice a bit differently ;)13:45
pabelangerhttp://nodepool.openstack.org/ is online13:45
pabelangerbut I cannot SSH13:45
*** wolverineav has joined #openstack-infra13:45
amrithYes AJaeger13:46
amrithI'm just testing the change13:46
amrithadding back two lines in gerrit/projects.yaml13:46
AJaeger;)13:46
pabelangerianw: Do you still have an open SSH connection to nodepool?13:46
amrithi.e. removing the acl line13:46
amrithwill fix the doc to have a sentence about "if you have a gerrit/projects.yaml entry because you used an ACL file other than named for the project, do this "13:47
AJaegerpabelanger: yeah, last change on nodepool was 12:11 - same time that grafana shows flat curves.13:47
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Run scenario001 on puppet-panko  https://review.openstack.org/40204913:47
amrithI see why I got into the pickle; I used the trove.config for trove-image-builder13:47
amrithand that is not "the norm"13:47
AJaegeramrith: yep, that was the missing piece13:47
*** ccamacho|lunch is now known as ccamacho13:48
amrithnow, I have these two changes. one for project-config and one for infra-manual. Do you want me to hold off on pushing them up till your issues with the gate are addressed or is the log jam big enough that two more toothpicks won't make a material difference?13:48
AJaegeramrith: just push them out and then wait ;)13:48
amrithok, no worries. running tox now13:49
amrithwill be 10-15m13:49
*** wolverineav has quit IRC13:50
AJaegerpabelanger: I expect ianw to be asleep13:50
pabelangeryup13:51
pabelangerinfra-root: does anybody have an active connection to nodepool.o.o13:51
pabelangerit is no longer responding13:51
pabelangerhowever networking appears to be still online13:51
AJaegerany remotes root exploits you can use? ;)13:51
pabelangerI can try the remote console in rackspace13:52
*** saibarsp_ has joined #openstack-infra13:52
*** saibarspeis has quit IRC13:52
*** thorst_ has quit IRC13:54
*** thorst_ has joined #openstack-infra13:55
*** wolverineav has joined #openstack-infra13:55
*** dizquierdo has joined #openstack-infra13:56
pabelangerokay, I have console access13:57
pabelangerbut no password13:57
pabelangerI do see:13:57
openstackgerritamrith proposed openstack-infra/project-config: Get rid of the trove-image-builder project  https://review.openstack.org/39868913:57
pabelangerBuffer I/O error on device loop3p1, logical block <number>13:57
*** nadya has quit IRC13:58
pabelangerI should be able to soft-reboot the system13:58
*** charlledaniel has joined #openstack-infra13:59
*** gordc has joined #openstack-infra13:59
AJaegerhope it comes up - might need file system check?13:59
charlledanielGood Morning OpenStack. Does anyone know any admin from https://review.openstack.org? I have two accounts there and I wanted to delete one of them, but I don't know how.13:59
*** wolverineav has quit IRC14:00
AJaegercharlledaniel: this is possible but could you come back next week? Most admins are on Thanksgiving vacation this week...14:00
*** ramishra has quit IRC14:00
*** amoralej|lunch is now known as amoralej14:00
openstackgerritamrith proposed openstack-infra/infra-manual: update the drivers.rst for project retirement steps  https://review.openstack.org/40145914:01
amrithAJaeger, please see ^^14:01
amriththat's what I think I had to do ...14:01
*** ramishra has joined #openstack-infra14:02
pabelangerAJaeger: okay, rebooting14:03
amrithAJaeger, Canada did their thanksgiving thing last week.14:03
amrithso Canadians should be around today, eh?14:03
pabelangerMonday, October 914:03
*** yolanda has joined #openstack-infra14:03
pabelangerk14:03
*** oanson has quit IRC14:03
pabelangerssh is back14:03
*** Goneri has joined #openstack-infra14:04
amrithpabelanger, that was their thanksgiving?14:04
*** thorst_ has quit IRC14:04
amrithoh, thought it was last week14:04
amrithnm14:04
*** nadya has joined #openstack-infra14:04
amrithhmm, october 9th was a sunday.14:04
amrithding ding ding ding ... monday, october 10th was Canadian Thanksgiving this year.14:05
amrithmore coffee14:05
*** smarcet has quit IRC14:06
*** zhurong has quit IRC14:06
*** isviridov_away has quit IRC14:06
*** vaidy has quit IRC14:07
pabelangeryes14:07
*** nadya has quit IRC14:08
* amrith looks at delivering coffee to pabelanger 14:08
amrithwhat kind would you like? I have home brew, arabica beans, light roast.14:09
pabelangerokay, going to first clean up all the used nodes in nodepool14:11
garyk1ttx: any ideas who is infra-root?14:12
pabelanger<14:12
pabelangerbut busy fixing nodepool.o.o14:12
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK: periodic jobs  https://review.openstack.org/35921514:12
*** wolverineav has joined #openstack-infra14:12
*** Jeffrey4l has quit IRC14:13
*** john-davidge has quit IRC14:14
*** boogibugs has joined #openstack-infra14:14
*** john-davidge has joined #openstack-infra14:15
*** lVathan[m] has quit IRC14:15
*** M-docaedo_vector has quit IRC14:15
*** rods has quit IRC14:16
*** andymaier has quit IRC14:17
*** Jeffrey4l has joined #openstack-infra14:17
*** hurgleburgler has joined #openstack-infra14:17
pabelangerinfra-root: I am going to bring nodepooo.o.o back online. Looking at the logs, it appears something related to image builds for Fedora-24 might have been the cause14:17
pabelangerI can see ianw was doing some cleanup on the system about 30mins before SSH failed14:17
pabelangerHowever, to unblock the gate, I'll start nodepool and we can review the logs this morning14:18
*** Jeffrey4l has quit IRC14:18
*** Jeffrey4l has joined #openstack-infra14:18
*** EricGonczer_ has joined #openstack-infra14:19
*** john-davidge has quit IRC14:20
*** yamamoto has joined #openstack-infra14:21
*** hongbin has joined #openstack-infra14:21
*** wolverineav has quit IRC14:22
*** yamamoto_ has joined #openstack-infra14:22
*** fguillot has joined #openstack-infra14:23
*** jamesdenton has joined #openstack-infra14:23
pabelangerAJaeger: nodes coming back online now14:24
*** wolverineav has joined #openstack-infra14:25
*** abregman has joined #openstack-infra14:25
*** isaacb has joined #openstack-infra14:25
*** yamamoto has quit IRC14:25
charlledanielOk AJaeger , thank you14:28
*** jamesdenton has quit IRC14:28
*** vikrant has quit IRC14:29
*** wolverineav has quit IRC14:29
openstackgerritMerged openstack-infra/project-config: [Manila] Fix new gate-manila-ui-dsvm-nv job  https://review.openstack.org/40125714:32
*** rlandy has joined #openstack-infra14:33
*** wolverineav has joined #openstack-infra14:33
*** jamesdenton has joined #openstack-infra14:33
*** M-docaedo_vector has joined #openstack-infra14:33
*** ldnunes has quit IRC14:34
*** esikache1 has joined #openstack-infra14:34
openstackgerritMerged openstack-infra/project-config: Use xenial as default node for gate-tempest-dsvm-neutron-src-neutron-lib  https://review.openstack.org/39740114:34
*** ldnunes has joined #openstack-infra14:35
openstackgerritMerged openstack-infra/project-config: Fix OpenStack-Ansible xenial gate jobs  https://review.openstack.org/40118414:35
openstackgerritMerged openstack-infra/project-config: Export VIRT_DRIVER in Nimble tempest job  https://review.openstack.org/40188614:35
openstackgerritMerged openstack-infra/project-config: Add a amqp1 job for Heat  https://review.openstack.org/40079914:35
openstackgerritMerged openstack-infra/project-config: Add specs repository for CloudKitty  https://review.openstack.org/40130514:35
markus_zpabelanger: Awesome, thanks! Looks like the gate processes changes again.14:35
*** ldnunes has quit IRC14:35
openstackgerritMerged openstack-infra/project-config: [sahara] finish transitioning scenario jobs to xenial  https://review.openstack.org/40081414:35
openstackgerritMerged openstack-infra/project-config: neutron-fwaas: Consume gate hook for tempest plugin jobs  https://review.openstack.org/40074514:35
openstackgerritMerged openstack-infra/project-config: [rally] improvements of devstack-rally-gate jobs  https://review.openstack.org/40138914:36
*** ociuhandu has quit IRC14:36
*** esikachev has quit IRC14:36
*** ldnunes has joined #openstack-infra14:36
*** markvoelker has joined #openstack-infra14:36
*** yamamoto_ has quit IRC14:37
*** jamesdenton has quit IRC14:38
*** _nick has quit IRC14:38
*** jaosorior has quit IRC14:38
*** jcoufal has joined #openstack-infra14:38
*** katkapilatova has left #openstack-infra14:40
*** thorst_ has joined #openstack-infra14:40
*** katkapilatova has joined #openstack-infra14:40
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Add playbook to create BASE folder  https://review.openstack.org/40207814:42
*** yamamoto has joined #openstack-infra14:42
*** ftersin has joined #openstack-infra14:43
AJaegerpabelanger: thanks!14:44
AJaegerpabelanger: let me notice again...14:44
drifterzapabelanger, legend ;)14:44
pabelangeroff to get some coffee and breakfast14:45
*** andymaier has joined #openstack-infra14:46
AJaeger#status notice OpenStack CI is processing jobs again. Thanks to the Canadian admin "team" that had their Thanksgiving holiday already ;) Jobs are all enqueued, no need to recheck.14:46
openstackstatusAJaeger: sending notice14:46
*** andymaier has quit IRC14:46
*** wolverineav has quit IRC14:47
-openstackstatus- NOTICE: OpenStack CI is processing jobs again. Thanks to the Canadian admin "team" that had their Thanksgiving holiday already ;) Jobs are all enqueued, no need to recheck.14:47
*** thorst_ has quit IRC14:47
mdboothpabelanger: Thank you!14:48
Zarathanks, pabelanger! (and AJaeger for sending the notice)14:49
openstackstatusAJaeger: finished sending notice14:49
*** lVathan[m] has joined #openstack-infra14:49
*** bhunter71 has joined #openstack-infra14:50
EmilienMpabelanger: canadian rocks! :)14:50
*** yankcrime has joined #openstack-infra14:50
*** ociuhandu has joined #openstack-infra14:52
gordcpabelanger: good job recognising real thanksgiving14:53
*** wolverineav has joined #openstack-infra14:53
*** isviridov_away has joined #openstack-infra14:54
*** yamamoto has quit IRC14:54
*** vaidy has joined #openstack-infra14:55
*** sshnaidm is now known as sshnaidm|afk14:57
*** wolverineav has quit IRC14:58
*** jascott1 has joined #openstack-infra14:59
*** hongbin has quit IRC15:00
pabelanger:)15:01
*** thorst_ has joined #openstack-infra15:02
*** jamesdenton has joined #openstack-infra15:03
*** openstackgerrit has quit IRC15:03
*** yamamoto has joined #openstack-infra15:03
*** jascott1 has quit IRC15:04
*** openstackgerrit has joined #openstack-infra15:04
EmilienMpabelanger: do you have time to talk about gem mirror?15:04
*** yamamoto has quit IRC15:05
*** wolverineav has joined #openstack-infra15:06
*** thorst_ has quit IRC15:07
*** lezbar has quit IRC15:07
*** ftersin has left #openstack-infra15:09
pabelangerEmilienM: we can, but currently blocked on adding more HDD space for AFS.15:09
*** lezbar has joined #openstack-infra15:10
*** jamesdenton has quit IRC15:10
EmilienMpabelanger: ok, we can see it later. Maybe tomorrow?15:10
pabelangerI was going to loop back to that on monday / tuesday of next week15:10
*** yamamoto has joined #openstack-infra15:10
EmilienMok no prob15:10
pabelangerEmilienM: I'll need some support from fungi15:10
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: WIP - Deploy TripleO with Puppet 4  https://review.openstack.org/37120915:10
EmilienMpabelanger: no prob. Ping me when you need my help15:11
*** wolverineav has quit IRC15:12
pabelangerEmilienM: ack15:13
pabelangernice15:13
EmilienMthx15:13
pabelangerwe have 1241 nodes in use rightn ow15:13
pabelangerzl05 is managing 205 jobs15:14
AJaegerwow15:14
pabelangerya, that is the first time I have seen that15:14
pabelanger205 that is15:14
*** wolverineav has joined #openstack-infra15:15
pabelangerload average: 66.29, 63.58, 40.9715:15
pabelangerthat is zl05 :)15:15
*** Hal1 has quit IRC15:20
*** nadya has joined #openstack-infra15:20
openstackgerritMerged openstack-infra/project-config: Move JJB include scripts to subdir  https://review.openstack.org/39974715:22
openstackgerritMerged openstack-infra/project-config: Refactor run-deploy-guide.sh  https://review.openstack.org/39975315:23
openstackgerritOksana Voshchana proposed openstack-infra/devstack-gate: TEST for multinode grenade devstack  https://review.openstack.org/39667915:27
*** wolverineav has quit IRC15:30
*** Jeffrey4l has quit IRC15:30
AJaegerpabelanger: regarding your kolla changes and http://lists.openstack.org/pipermail/openstack-dev/2016-November/107784.html - there still some open reviews to move this forward. Would appreciate review of the concept and of changes, please15:30
AJaegerpabelanger: I just +2ed your change, we can indeed refactor later.15:30
*** Jeffrey4l has joined #openstack-infra15:30
pabelangerAJaeger: sure, let me look15:31
*** yamamoto has quit IRC15:31
*** Jeffrey4l has quit IRC15:32
AJaegerpabelanger: I'll go home now, will be back online later - in case you have questions or comments.15:32
pabelangerack15:32
*** Jeffrey4l has joined #openstack-infra15:32
pabelangerthanks again for the help this morning15:32
*** abregman has quit IRC15:34
*** garyk1 has quit IRC15:34
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Add start_fresh_logging playbook/role  https://review.openstack.org/40210315:36
*** esikache1 has quit IRC15:37
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Add playbook to create BASE folder  https://review.openstack.org/40207815:37
*** Jeffrey4l has quit IRC15:37
*** katkapilatova has left #openstack-infra15:37
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Add start_fresh_logging playbook/role  https://review.openstack.org/40210315:38
openstackgerritMerged openstack-infra/project-config: Create experimental kolla-publish-image-jobs  https://review.openstack.org/40146215:39
*** hongbin has joined #openstack-infra15:40
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Ansibly BASE folder creation  https://review.openstack.org/40210715:42
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Add Panko to scenario001  https://review.openstack.org/40129915:44
*** saibarsp_ has quit IRC15:46
*** saibarspeis has joined #openstack-infra15:46
*** jlibosva has joined #openstack-infra15:47
*** wolverineav has joined #openstack-infra15:48
jlibosvaclarkb: hi, we have successful xenial runs on both master and newton on fullstack and functional jobs, can you please have a look at https://review.openstack.org/#/c/397873/5 ?15:48
jlibosvaso we trigger them more often to catch possible intermittent failures before replacing trusty for good15:49
*** Jeffrey4l has joined #openstack-infra15:49
amrithjeblair, ?15:51
*** saibarspeis has quit IRC15:51
amrithDriver's is possessive. You do want Drivers, yes?15:51
*** links has joined #openstack-infra15:52
*** gouthamr has quit IRC15:52
*** links has quit IRC15:52
jeblairamrith: Driver's is what is intended and what's used in all the guides -- i left a comment on the first patchset too.  it's the manual for a project driver.15:53
*** saibarspeis has joined #openstack-infra15:53
jeblairamrith: cf https://docs.python.org/devguide/ https://msdn.microsoft.com/en-us/library/bb425862.aspx https://developer.chrome.com/extensions/devguide15:55
jeblairamrith: sorry if my first comment wasn't clear about that15:55
*** nadya has quit IRC15:55
*** lennyb has quit IRC15:56
*** yuval has quit IRC15:56
*** Hal has joined #openstack-infra15:57
*** smarcet has joined #openstack-infra15:57
*** Hal is now known as Guest8777015:57
*** saibarsp_ has joined #openstack-infra15:58
*** salv-orlando has joined #openstack-infra15:58
*** wolverineav has quit IRC15:59
*** jkilpatr has joined #openstack-infra16:00
amrithok, sounds good. I was going to change all of them (was half way through doing that). let me find you the counter-reference. bb shortly16:00
*** jascott1 has joined #openstack-infra16:00
*** saibarspeis has quit IRC16:02
*** oanson has joined #openstack-infra16:04
*** jascott1 has quit IRC16:05
*** wolverineav has joined #openstack-infra16:05
*** snarwade has joined #openstack-infra16:07
openstackgerritGabriele Cerami proposed openstack-infra/project-config: tripleo-quickstart: Alter default -extras req file to use zuul fetched repo  https://review.openstack.org/40212316:10
*** yamamoto has joined #openstack-infra16:12
*** senk has quit IRC16:13
*** yamamoto has quit IRC16:13
*** wolverineav has quit IRC16:14
openstackgerritamrith proposed openstack-infra/infra-manual: update the drivers.rst for project retirement steps  https://review.openstack.org/40145916:15
amrithjeblair, splitting the commits; new commit will fix more of these with a full reference to why.16:15
*** jamesdenton has joined #openstack-infra16:15
jeblairamrith: i'm very likely to -2 that16:16
amriththat is fine too16:17
jeblairok.  just didn't want to waste your time.  :)  thanks for the patches.16:18
*** ssbarnea has quit IRC16:18
*** ssbarnea has joined #openstack-infra16:19
*** jamesdenton has quit IRC16:19
*** Guest13491 has quit IRC16:19
*** rcernin has quit IRC16:20
openstackgerritGabriele Cerami proposed openstack-infra/project-config: tripleo-quickstart: Alter default -extras req file to use zuul fetched repo  https://review.openstack.org/40212316:21
*** yamamoto has joined #openstack-infra16:21
*** jascott1 has joined #openstack-infra16:21
*** wolverineav has joined #openstack-infra16:21
*** yamamoto has quit IRC16:22
*** Guest87770 has quit IRC16:23
*** sdake has joined #openstack-infra16:24
*** jascott1 has quit IRC16:26
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Consume TripleO CI scenarios envs from THT  https://review.openstack.org/40213116:28
*** baoli has joined #openstack-infra16:28
*** EricGonczer_ has quit IRC16:30
*** ssbarnea has quit IRC16:31
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Update TripleO scenario layout for file matching  https://review.openstack.org/40213316:31
*** ssbarnea has joined #openstack-infra16:32
*** Hal has joined #openstack-infra16:32
*** Hal is now known as Guest3282116:32
*** hashar has quit IRC16:32
*** Guest32821 has quit IRC16:33
openstackgerritGabriele Cerami proposed openstack-infra/project-config: tripleo-quickstart: Alter default -extras req file to use zuul fetched repo  https://review.openstack.org/40212316:34
*** drifterza has quit IRC16:34
*** nadya has joined #openstack-infra16:35
*** yamamoto has joined #openstack-infra16:36
openstackgerritMathieu Rohon proposed openstack-infra/project-config: Make net-bgpvpn jobs run on trusty for mitaka and older  https://review.openstack.org/39711116:37
*** esikache1 has joined #openstack-infra16:37
*** saibarsp_ has quit IRC16:39
*** rfolco has joined #openstack-infra16:40
*** oanson has quit IRC16:43
*** wolverineav has quit IRC16:46
*** two_tired has joined #openstack-infra16:50
*** armax has joined #openstack-infra16:50
*** matrohon has quit IRC16:55
*** charlledaniel has left #openstack-infra16:56
*** zz_dimtruck is now known as dimtruck16:57
*** asettle has quit IRC16:59
*** isaacb has quit IRC16:59
*** two_tired has quit IRC17:01
*** smarcet has quit IRC17:02
*** panda is now known as panda|bbl17:03
*** wolverineav has joined #openstack-infra17:03
*** megm has quit IRC17:05
*** tqtran has joined #openstack-infra17:06
AJaegerjlibosva: you need neutron infra liason +1 on the change as well.17:06
*** megm has joined #openstack-infra17:07
*** dtantsur is now known as dtantsur|afk17:07
jlibosvaAJaeger: I'm afraid all our liaisons are in the US having fun on Thanksgiving :(17:07
*** tosky has quit IRC17:09
*** wolverineav has quit IRC17:10
*** tqtran has quit IRC17:10
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: update the drivers.rst for project retirement steps  https://review.openstack.org/40145917:11
*** allanice001 has quit IRC17:11
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: update the drivers.rst for project retirement steps  https://review.openstack.org/40145917:12
*** sdake has quit IRC17:12
AJaegerjlibosva: armax is reviewing at least, perhaps you can ask him to review 397873?17:13
*** sshnaidm|afk is now known as sshnaidm|away17:13
jlibosvaAJaeger: Thanks, he's also sending reverts of patches that just got merged :-P17:14
jlibosvaarmax: if you're here, pretty please https://review.openstack.org/#/c/397873/17:14
AJaegerOoops ;(17:14
*** nadya has quit IRC17:15
*** markus_z has quit IRC17:16
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: update the drivers.rst for project retirement steps  https://review.openstack.org/40145917:21
AJaegeramrith, jeblair: Fixed wrong rendering and typos ^17:22
*** jascott1 has joined #openstack-infra17:24
openstackgerritMerged openstack-infra/irc-meetings: Add meeting for public cloud working group  https://review.openstack.org/40193017:24
*** e0ne has quit IRC17:24
*** Hal has joined #openstack-infra17:25
*** bhunter71 has quit IRC17:25
*** Hal is now known as Guest1481217:25
*** oanson has joined #openstack-infra17:27
openstackgerritZhenguo Niu proposed openstack-infra/project-config: Add Ironic related projects to Nimble tempest gate  https://review.openstack.org/40216417:28
*** jascott1 has quit IRC17:28
*** derekh has quit IRC17:28
*** wolverineav has joined #openstack-infra17:30
*** rossella_s has quit IRC17:30
*** lucasagomes is now known as lucas-afk17:31
*** rossella_s has joined #openstack-infra17:31
*** jpich has quit IRC17:31
*** oanson has quit IRC17:32
*** sdake has joined #openstack-infra17:32
*** isaacb has joined #openstack-infra17:35
*** wolverineav has quit IRC17:35
*** flepied has quit IRC17:35
*** matrohon has joined #openstack-infra17:35
*** esikache1 has quit IRC17:36
*** Guest14812 has quit IRC17:37
*** yamamoto has quit IRC17:38
*** dizquierdo has quit IRC17:38
*** jordanP has joined #openstack-infra17:39
*** bhunter71 has joined #openstack-infra17:40
*** senk has joined #openstack-infra17:41
*** smarcet has joined #openstack-infra17:41
*** smarcet has quit IRC17:42
*** jtomasek has quit IRC17:42
*** smarcet has joined #openstack-infra17:43
*** wolverineav has joined #openstack-infra17:44
*** jtomasek has joined #openstack-infra17:45
*** senk has quit IRC17:47
*** jordanP has quit IRC17:48
*** wolverineav has quit IRC17:49
*** jordanP has joined #openstack-infra17:49
*** sambetts is now known as sambetts|afk17:50
amrithjeblair, pabelanger could I get one of you to please bless https://review.openstack.org/398689 which retires a gonzo repository17:51
*** wolverineav has joined #openstack-infra17:52
*** chandankumar has quit IRC17:54
*** drifterza has joined #openstack-infra17:57
*** tosky has joined #openstack-infra17:58
*** jlibosva has quit IRC18:02
*** wolverineav has quit IRC18:02
openstackgerritamrith proposed openstack-infra/project-config: eliminate the trove and trove-integration build-image jobs  https://review.openstack.org/40217518:02
*** ralonsoh__ has quit IRC18:04
*** matrohon has quit IRC18:04
*** psachin has quit IRC18:07
*** rbuzatu_ has joined #openstack-infra18:08
*** smarcet has quit IRC18:09
*** hurgleburgler has quit IRC18:10
*** nadya has joined #openstack-infra18:11
*** rbuzatu has quit IRC18:12
*** isaacb has quit IRC18:14
openstackgerritamrith proposed openstack-infra/project-config: rename gate-trove-scenario-functional jobs  https://review.openstack.org/40217918:14
openstackgerritamrith proposed openstack-infra/project-config: rename gate-trove-scenario-functional jobs  https://review.openstack.org/40217918:17
mdboothHave we discussed failing fast for CI lately?18:18
*** rossella_s has quit IRC18:18
* mdbooth has a POST_FAILURE against 1 job in the gate, and now has to wait until everything else succeeds so I can recheck before going home :(18:18
mdboothIt would be great if it just got booted out as soon as any job failed.18:19
amrithmdbooth, yes but not in the context of wanting to go home early on a holiday :)18:19
mdboothamrith: That's normally the context which matters most :)18:19
amrithyou don't have to wait to recheck; you submit a patch set with a commit message change.18:20
mdboothHold that, I've been reprieved18:20
mdboothamrith: That's evil. I don't do that.18:20
*** newmember has quit IRC18:20
amrithlike add an extra line like 'the time has come the walrus said ...'18:20
amrithI do18:20
mdboothAlthough I was aware of it.18:20
*** nadya has quit IRC18:20
amrithoh, so you know about me?18:20
mdboothHehe18:20
mdboothThe other problem is that it would lose the +2 +W18:21
mdboothReprieve, something ahead of it failed and it was requeued18:21
mdboothThe gate looks a bit sad, actually18:21
mdboothStill having problems?18:21
amrithah, that's a different problem. and I hope you get out early18:21
*** baoli has quit IRC18:23
*** smarcet has joined #openstack-infra18:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci: Consume TripleO CI scenarios envs from THT  https://review.openstack.org/40213118:25
*** baoli has joined #openstack-infra18:26
amrithAJaeger, I'm making a bunch of changes to the trove CI and as you'd requested in the past, I'm breaking things into small commits. hope that makes the review smoother.18:27
*** jpena is now known as jpena|off18:27
amrithAJaeger, see https://review.openstack.org/402175 and https://review.openstack.org/402179 as samples18:27
amrithAJaeger, but I'm stacking them. would you confirm that this is the preferred approach.18:27
*** smarcet has quit IRC18:28
pabelangermdbooth: https://review.openstack.org/#/c/129255/18:29
*** flepied has joined #openstack-infra18:29
*** flepied1 has joined #openstack-infra18:29
pabelangermdbooth: we tend to let all jobs run to finish, as to expose more possible failures.18:29
*** salv-orl_ has joined #openstack-infra18:30
*** baoli has quit IRC18:31
*** baoli has joined #openstack-infra18:32
*** salv-orlando has quit IRC18:32
*** flepied has quit IRC18:33
*** electrofelix has quit IRC18:33
mgagnepabelanger: I like the suggested idea of failing fast. If someone *really* needing this feature right now, he could use the job dependency system already in place. But you can easily end up with a long chain and losing the benefit of running job in parallel. Also there is no way to "group" jobs in step so fast jobs (in step 1) needs to run (and all pass) before going to step 2 where longer and costly jobs are run.18:34
*** EricGonczer_ has joined #openstack-infra18:34
mgagneWe do have jobs in our private CI where ~100 VMs are spawn. Failing fast because of a syntax error would be great and save us lot of resources.18:35
AJaegeramrith: that looks fine. pabelanger do you want to +2A 402179 and 402175, please? Those are small cleanups...18:35
pabelangermgagne: yes, that is how the spec came to light I believe, to save CI resources. I think with zuulv3, it would be a great time to revisit it. And see how we could properly implement it18:37
mgagne=)18:39
*** gouthamr has joined #openstack-infra18:40
*** wolverineav has joined #openstack-infra18:44
*** amoralej is now known as amoralej|off18:47
*** senk has joined #openstack-infra18:48
*** wolverineav has quit IRC18:49
*** wolverineav has joined #openstack-infra18:50
*** baoli has quit IRC18:51
*** rods has joined #openstack-infra18:51
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Setup ELEMENTS_PATH depending on dib version  https://review.openstack.org/40219718:53
AJaegerEmilienM: could you review 398642, please?18:54
*** florianf has quit IRC18:54
*** yamahata has joined #openstack-infra18:54
*** dtardivel has quit IRC18:54
*** wolverineav has quit IRC18:55
amriththx AJaeger18:57
*** Jeffrey4l has quit IRC18:58
*** ihrachys has quit IRC19:02
*** wolverineav has joined #openstack-infra19:04
*** florianf has joined #openstack-infra19:05
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Enable consuming packages for a feature branch  https://review.openstack.org/39956219:08
*** jascott1 has joined #openstack-infra19:09
*** wolverineav has quit IRC19:09
openstackgerritMiles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package  https://review.openstack.org/34421419:11
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Enable consuming packages for a feature branch  https://review.openstack.org/39956219:13
*** jascott1 has quit IRC19:13
*** drifterza has quit IRC19:14
openstackgerritMiles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package  https://review.openstack.org/34421419:17
*** hashar has joined #openstack-infra19:17
*** senk has quit IRC19:18
*** Goneri has quit IRC19:19
*** mtanino has joined #openstack-infra19:20
*** wolverineav has joined #openstack-infra19:22
*** jordanP has quit IRC19:26
*** wolverineav has quit IRC19:27
*** salv-orl_ has quit IRC19:27
*** yamahata has quit IRC19:27
*** e0ne has joined #openstack-infra19:32
*** Hal has joined #openstack-infra19:33
*** Hal is now known as Guest1995219:33
*** dkehn_ has quit IRC19:38
*** dkehn_ has joined #openstack-infra19:38
*** mtanino has quit IRC19:38
*** jordanP has joined #openstack-infra19:40
*** dkehn has quit IRC19:40
*** esikache1 has joined #openstack-infra19:41
*** matrohon has joined #openstack-infra19:41
*** dkehn has joined #openstack-infra19:41
*** aspiers has quit IRC19:42
*** dkehn__ has joined #openstack-infra19:42
openstackgerritPaul Belanger proposed openstack-infra/project-config: Clean up ansible-(dsvm-)role-jobs  https://review.openstack.org/40220219:43
openstackgerritPaul Belanger proposed openstack-infra/project-config: Switch all ansible-role-nodepool jobs voting  https://review.openstack.org/40220319:43
*** flwang1 has quit IRC19:43
*** dkehn_ has quit IRC19:44
*** florianf has quit IRC19:46
*** jordanP has quit IRC19:46
*** wolverineav has joined #openstack-infra19:48
*** matrohon has quit IRC19:51
*** wolverineav has quit IRC19:55
*** amoralej|off is now known as amoralej19:56
*** gouthamr has quit IRC19:57
*** gordc has quit IRC19:57
*** rfolco has quit IRC19:59
*** oanson has joined #openstack-infra20:01
*** matrohon has joined #openstack-infra20:07
*** srobert has joined #openstack-infra20:07
*** tqtran has joined #openstack-infra20:07
*** oanson has quit IRC20:09
*** raildo has quit IRC20:10
*** tqtran has quit IRC20:12
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Ansibly the start of fresh logging  https://review.openstack.org/40220820:13
*** ldnunes has quit IRC20:15
*** Goneri has joined #openstack-infra20:19
*** wolverineav has joined #openstack-infra20:20
*** e0ne has quit IRC20:20
openstackgerritPaul Belanger proposed openstack-infra/project-config: Clean up ansible-(dsvm-)role-jobs  https://review.openstack.org/40220220:22
*** raildo has joined #openstack-infra20:22
*** wolverineav has quit IRC20:24
AJaegerpabelanger: have you had time to dig into http://lists.openstack.org/pipermail/openstack-dev/2016-November/107784.html and have any questions? Otherwise I'll sign off for today...20:25
pabelangerAJaeger: sadly, not today.20:28
pabelangerI'll make some time for tomorrow20:28
*** srobert has quit IRC20:29
*** raildo has quit IRC20:29
AJaegerpabelanger: enjoy your day.20:31
*** gordc has joined #openstack-infra20:31
AJaegerno problem...20:31
* AJaeger waves good night20:32
*** panda|bbl is now known as panda20:32
openstackgerritGabriele Cerami proposed openstack-infra/project-config: tripleo-quickstart: Alter default -extras req file to use zuul fetched repo  https://review.openstack.org/40212320:33
*** yamamoto has joined #openstack-infra20:39
*** rbuzatu_ has quit IRC20:41
*** rbuzatu has joined #openstack-infra20:42
*** yamamoto has quit IRC20:43
*** asettle has joined #openstack-infra20:48
*** CrashOverride has joined #openstack-infra20:50
*** asettle has quit IRC20:50
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Enable consuming packages for a feature branch  https://review.openstack.org/39956220:55
*** gouthamr has joined #openstack-infra20:57
*** wolverineav has joined #openstack-infra20:57
*** wolverineav has quit IRC21:02
*** jascott1 has joined #openstack-infra21:10
*** wolverineav has joined #openstack-infra21:12
*** EricGonc_ has joined #openstack-infra21:13
*** yolanda has quit IRC21:13
*** armax has quit IRC21:14
*** aspiers has joined #openstack-infra21:14
*** jascott1 has quit IRC21:15
*** EricGonczer_ has quit IRC21:15
*** hashar has quit IRC21:16
*** wolverineav has quit IRC21:17
*** adriant has joined #openstack-infra21:17
*** wolverineav has joined #openstack-infra21:18
*** CrashOverride has quit IRC21:20
*** nicolasbock has quit IRC21:20
*** armax has joined #openstack-infra21:21
*** wolverineav has quit IRC21:26
*** esikache1 has quit IRC21:27
openstackgerritMerged openstack-infra/project-config: Create repo for Interop Challenge assets  https://review.openstack.org/39853321:29
jheskethMorning21:32
openstackgerritPeter Stachowski proposed openstack-infra/project-config: [trove] Have scenario tests run in two steps  https://review.openstack.org/40222121:35
*** nherciu_ has quit IRC21:36
*** CrashOverride has joined #openstack-infra21:41
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Enable consuming packages for a feature branch  https://review.openstack.org/39956221:42
ianwpabelanger: oh dear ... what happened?21:43
*** ssbarnea has quit IRC21:43
pabelangerianw: not sure, something killed the ssh daemon.21:44
pabelangerianw: it wasn't much longer after you started poking the system for mounts I think21:44
pabelanger12:30 UTC is when nodepool stopped working21:44
pabelangerand console reported I/O issues21:44
pabelangerwe did have a fedora-24 build going at that time21:44
pabelangerI wonder if something is leaking out21:45
ianwpabelanger: that was about 1pm my time21:46
ianwhmm, after that fedora-24 build completed, i spent a fair bit of time fiddling and getting it uploaded to osic for testing21:46
*** gouthamr has quit IRC21:46
ianwand there hasn't been a dib release since21:47
pabelanger12:11 UTC is when nodepool stopped launching nodes21:47
*** EricGonc_ has quit IRC21:48
ianwpabelanger: that would be about 10pm my time?21:48
ianwso quite a bit after that fiddling21:49
*** amoralej is now known as amoralej|off21:49
pabelangerNov 24 11:20:42 nodepool kernel: [20012754.414181] Buffer I/O error on device loop1p1, logical block 369918421:50
pabelangerare example kernel messages in syslog21:50
pabelangeraround the time you ran os-prober ?21:50
*** ssbarnea has joined #openstack-infra21:54
*** fguillot has quit IRC21:54
*** jamesdenton has joined #openstack-infra21:57
*** yolanda has joined #openstack-infra22:00
ianwhmm, i didn't run os-prober22:05
ianwto my knowledge :)22:05
*** srobert has joined #openstack-infra22:06
openstackgerritPeter Stachowski proposed openstack-infra/project-config: [trove] Have scenario tests run in two steps  https://review.openstack.org/40222122:07
openstackgerritStephane Robert proposed openstack-infra/project-config: New CI service  -  Virtual PDU  https://review.openstack.org/40222322:07
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/devstack-gate: Add playbook to create BASE folder  https://review.openstack.org/40207822:09
*** matrohon has quit IRC22:12
*** caowei has joined #openstack-infra22:14
*** tpsilva has quit IRC22:15
ianwthe audit logs where i cleared out the mounts started at -> Nov 24 02:06:27 nodepool sudo: nodepool : TTY=pts/16 ; PWD=/opt ; USER=root ; COMMAND=/sbin/losetup -d /dev/loop022:19
*** admcleod_ has joined #openstack-infra22:24
*** admcleod has quit IRC22:25
*** jcoufal has quit IRC22:27
openstackgerritPaul Belanger proposed openstack-infra/project-config: Remove centos-7 windmill voting gate  https://review.openstack.org/40223022:28
*** jamesdenton has quit IRC22:29
openstackgerritStephane Robert proposed openstack-infra/project-config: New CI service  -  Virtual PDU  https://review.openstack.org/40222322:32
*** flwang1 has joined #openstack-infra22:32
openstackgerrityolanda.robla proposed openstack-infra/tripleo-ci: Enable consuming packages for a feature branch  https://review.openstack.org/39956222:34
*** CrashOverride has quit IRC22:35
*** salv-orlando has joined #openstack-infra22:39
*** CrashOverride has joined #openstack-infra22:41
*** rbuzatu_ has joined #openstack-infra22:42
*** jamesdenton has joined #openstack-infra22:42
EmilienMAJaeger: ack22:43
*** rbuzatu__ has joined #openstack-infra22:45
*** rbuzatu has quit IRC22:46
EmilienMAJaeger: +122:46
*** jamesdenton has quit IRC22:46
*** jascott1 has joined #openstack-infra22:47
*** rbuzatu_ has quit IRC22:48
*** CrashOverride has quit IRC22:48
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: logging: extract journal to compressed text file, before gathering  https://review.openstack.org/40081722:49
openstackgerritOpenStack Proposal Bot proposed openstack-dev/pbr: Updated from global requirements  https://review.openstack.org/40223422:49
*** jascott1 has quit IRC22:51
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci: logging: extract journal to compressed text file, before gathering  https://review.openstack.org/40081722:53
*** gordc has quit IRC22:56
openstackgerritamrith proposed openstack-infra/project-config: specify an ubuntu-xenial job for trove client (non-voting)  https://review.openstack.org/40223722:57
*** wolverineav has joined #openstack-infra22:57
*** ihrachys has joined #openstack-infra22:59
*** wolverineav has quit IRC23:02
*** jascott1 has joined #openstack-infra23:09
*** wolverineav has joined #openstack-infra23:10
*** salv-orlando has quit IRC23:13
*** jascott1 has quit IRC23:14
openstackgerritamrith proposed openstack-infra/project-config: specify node type in gate-trove-scenario-dsvm- jobs  https://review.openstack.org/40223923:19
*** wolverineav has quit IRC23:20
*** krtaylor has quit IRC23:21
ianwlifeless: always a great day when i'm pulling apart a log entry that says "Author: Robert Collins <rbtcollins@hp.com>  2013-02-14 09:16:00" :)23:24
*** caowei has quit IRC23:26
*** armax has quit IRC23:31
*** armax has joined #openstack-infra23:32
*** krtaylor has joined #openstack-infra23:34
*** rlandy has quit IRC23:38
tonybis the public IP of git.openstack.org a load balancer?  I'm seeing stnage git RPC errors on git clone but re-running the clone "just works" so my lay guess was that there is a sick slave in the pool23:43
mnasertonyb looks like it23:45
mnaserhttp://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n58423:45
tonybmnaser: Ahh cool.  I shoudl have thought to look there23:46
tonyband of course now all the git clones are just working23:46
mnaser#justcloudthings23:47
tonyb:)23:48
* tonyb ups his "is it just me" threashold from 15 to 20 mins ;P23:49
*** wolverineav has joined #openstack-infra23:49
*** denisra_ has joined #openstack-infra23:53
*** wolverineav has quit IRC23:54
*** denisra has quit IRC23:56
*** sflanigan has joined #openstack-infra23:57
ianwtonyb: yep23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!