Friday, 2016-04-22

pabelangermtreinish: we should see why beaker jobs are not catching it.  I suspect it has to do with bindep already caching the packages00:02
pabelangertoo late for me to look at that tonight00:02
*** mylu has quit IRC00:04
*** mylu has joined #openstack-infra00:04
openstackgerritMatthew Treinish proposed openstack-infra/puppet-openstack_health: Add another missing lxml dep
mtreinishpabelanger, fungi, clarkb: ^^^00:05
*** annegentle has joined #openstack-infra00:05
*** EricGonczer_ has joined #openstack-infra00:06
*** tphummel has quit IRC00:07
*** armax has joined #openstack-infra00:07
*** jamielennox is now known as jamielennox|away00:07
*** Na3iL has quit IRC00:09
*** ybathia has quit IRC00:09
*** bpokorny has quit IRC00:11
waynrzxiiro: looking now00:12
*** yamahata_ has quit IRC00:14
pabelangerfungi: clarkb: I am not sure how to fix the periodic job for puppet-openstack-integration. I suspect something happened with all the nodepool restarts. It's been idle for 18+ hours00:16
clarkbpabelanger: I dunno either, we have centos7 nodes available?00:17
pabelangerclarkb: yup, they are launching, but zuul is not asking demand for it any more00:17
*** yamamoto_ has joined #openstack-infra00:17
fungibuild:periodic-puppet-openstack-integration-4-scenario003-tempest-centos-7:centos-7     0       0       500:17
fungiso sayeth gearman status00:18
clarkbhuh so zuul and geard don't agree00:18
*** markvoelker has joined #openstack-infra00:19
pabelangerDeficit: centos-7: 0 (start: 6 min-ready: 1 ready: 7 capacity: 583)00:19
pabelangerfrom nodepool00:19
pabelangershould be at least 100:19
*** dalgaaf has quit IRC00:19
pabelangerfor periodic00:19
fungi2016-04-21 07:04:25,646 DEBUG zuul.IndependentPipelineManager: Adding build <Build 048761442e3641ce95d961697fef5d2b of periodic-puppet-openstack-integration-4-scenario003-tempest-centos-7 on <Worker Unknown>> of job periodic-puppet-openstack-integration-4-scenario003-tempest-centos-7 to item <QueueItem 0x7fcbce6d9a90 for <NullChange for openstack/puppet-openstack-integration> in periodic>00:20
pabelangercould you use to dump periodic?00:20
fungithat's the last job entry for it in zuul's debug.log00:21
*** xarses has quit IRC00:21
*** madhu_ak has quit IRC00:22
*** yamamoto_ has quit IRC00:22
openstackgerritMerged openstack/diskimage-builder: dhcp-all-interfaces depends on dhcp
openstackgerritMerged openstack/diskimage-builder: dhcp-all-interfaces depends on dib-init-system
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add some output to dib-lint
*** tqtran has quit IRC00:23
pabelangerzuul-changes seems to only work for trigger gerrit00:23
pabelangeroh well00:24
pabelangerclarkb: 5 images left00:24
*** yamamoto_ has joined #openstack-infra00:24
ianwjeblair: what happened to showing the log output after the job had finished?  did that not work our?00:26
ianwsorry, i mean the zuul link to the job on the status page, if that wasn't clear00:27
*** EricGonczer_ has quit IRC00:27
*** asettle has quit IRC00:27
*** asettle has joined #openstack-infra00:27
openstackgerritIan Wienand proposed openstack/diskimage-builder: Use generic "dhcp-client" name
fungiianw: 307891 and 307892 are still under review00:30
*** yamamoto_ has quit IRC00:30
fungijhesketh had a concern with the first, and the second depends on it00:30
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: add zuul_runner module
fungiand then we need a zuul restart00:31
jeblairoh, let me fix that real quick, then maybe we can merge and restart overnight/tomorrow00:32
ianwok, it's always more complicated than you think :)00:32
jeblairi think *everything* is complicated00:33
*** gongysh has joined #openstack-infra00:34
*** tphummel has joined #openstack-infra00:34
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Fix typo error in Neutron Grafana dashboard
jeblairwe are unable to log at that point, so i don't think i can make the change jhesketh suggested.  the typical zuul approach would be to propogate that exception and bomb, expecting the operator to fix the configuration.00:35
fungiwhich i think is what the current code will do, yes?00:35
*** dimtruck is now known as zz_dimtruck00:35
fungiin that case i'm on board00:36
fungiwe may not be able to wait for jhesketh to lift his -1 if he's already in transit (which i would expect given the distance he has to travel)00:37
jeblairlooks like i still need to check out possible test errors00:37
fungii would interpret it as a +2 in light of explanation why it was invalid00:37
fungitests.test_scheduler.TestScheduler.test_timer failed, which seems odd given the nature of teh change00:38
*** Goneri has quit IRC00:38
fungioh, i see the traceback for it i think00:39
*** pvaneck has quit IRC00:39
jeblairit is in fact the thing jhesketh was warning about :)00:39
fungioh, in fact that may have been the impetus for his comment00:40
jeblairi think we probably actually hit and log that exception for null changes today, but we just don't care because they are not reported00:40
fungigiven the job results posted half a day before he reviewed it00:41
*** yamamoto_ has joined #openstack-infra00:41
*** sdague has quit IRC00:44
ianwTIL : JSON can be valid YAML ,but YAML can not be valid JSON00:44
jeblairianw: i think it's stronger than that -- i think json *is* valid yaml00:45
clarkbthat is where the rails vulnerabilities of a few yaers ago came from00:45
clarkbthey used yaml to parse all json so you could craft sneaky json that loaded ruby objects00:45
jeblairianw: (corollary: yaml *is not necessarily* valid json)00:45
ianwwell, how about invalid json can be valid yaml00:46
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Remove publisher site for vendor specific networking-* projects
ianwat any rate, this check is not good ->
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add report URL to status.json
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Remove publisher site for vendor specific networking-* projects
jeblairianw, fungi: ^ that implements jhesketh's suggestion to the best of our current abilities :)00:48
*** xarses has joined #openstack-infra00:50
openstackgerritMerged openstack-infra/puppet-openstack_health: Add another missing lxml dep
ianw"sudo: no tty present and no askpass program specified" ->
ianwseems odd00:51
*** mtanino has quit IRC00:51
clarkbianw: ya theory on that was broken image, did that run in rax?00:51
clarkbianw: mtreinish ran into similar ealier and it was using an ancient version of the intsall pacakges script00:52
ianw ubuntu-trusty-ovh-bhs1-45367200:52
clarkbfungi: ^ there goes that theory00:52
fungiin that case we have something else going on00:52
ianwbuild-date -> 2016-04-20 16:5600:52
ianwsudoers not there correctly?00:55
fungiyou can see it happening early in
fungilots of commands skipped there because sudo failed and is not set -e00:56
fungii'll hold an ubuntu-trusty image there and see00:57
*** gongysh has quit IRC00:58
fungijenkins ALL=(ALL) NOPASSWD:ALL01:00
fungithat's in /etc/sudoers.d/jenkins-sudo on an ubuntu-trusty host in ovh-bhs101:00
*** apoorvad has quit IRC01:00
*** tphummel has quit IRC01:01
fungisame on another one i just checked there which has only been in use for 5 minutes, so must be pretty recent01:02
fungiubuntu hasn't changed their sudo package for trusty for 8 months01:03
*** rossella_s has quit IRC01:03
fungiso it's not a new sudo we've suddenly picked up01:03
clarkbnot logged in as jenkins?01:04
clarkb(I have no idea how that could happen)01:04
*** rossella_s has joined #openstack-infra01:04
*** kjorgensen has quit IRC01:04
*** zhurong has joined #openstack-infra01:08
*** kjorgensen has joined #openstack-infra01:09
*** kjorgensen has quit IRC01:09
*** kjorgensen has joined #openstack-infra01:10
*** kjorgensen has quit IRC01:14
*** MarkAtwood has quit IRC01:15
*** Qiming has joined #openstack-infra01:15
*** kengo_sakai has joined #openstack-infra01:15
*** zz_dimtruck is now known as dimtruck01:16
*** yamamoto_ has quit IRC01:18
*** gongysh has joined #openstack-infra01:19
*** SumitNaiksatam has joined #openstack-infra01:23
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add some output to dib-lint
openstackgerritIan Wienand proposed openstack/diskimage-builder: Split YAML & JSON parsing
ianwanother rax one
*** sridhar_ram has quit IRC01:30
openstackgerritIan Wienand proposed openstack/diskimage-builder: Use generic "dhcp-client" name
*** yuanying has joined #openstack-infra01:34
*** yamamoto_ has joined #openstack-infra01:35
jheskethjeblair: thanks for that fix, I've +2'd it01:36
jheskethjeblair: also I'd like to see get in at some point as it is currently stopping us from getting results01:37
jheskethif you have a job that depends on another job (such as, if the xstatic-check-version fails then xstatic-angular-bootstrap-tarball-experimental is never ran, however when the reporter goes to send back the results it tries to put together a url for the xstatic-angular-bootstrap-tarball-experimental job but fails as the build object01:38
jheskethisn't there01:38
*** asettle has quit IRC01:39
*** asettle has joined #openstack-infra01:39
*** jamielennox|away is now known as jamielennox01:44
*** keedya_ has joined #openstack-infra01:44
*** megm has quit IRC01:44
*** megm has joined #openstack-infra01:46
*** nikhil has quit IRC01:49
*** nikhil has joined #openstack-infra01:49
*** aeng has quit IRC01:58
pleia2hehe, yak
*** kjorgensen has joined #openstack-infra02:02
bkeroyakety yakety yakety...02:02
mtreinishpleia2, jhesketh, clarkb, fungi: I'm seeing occasional 500's on health.o.o with the rss stuff (yay it finally applied)02:02
mtreinishif you get a sec could you check the logs02:02
mtreinishI'm pretty sure I missed something obvious, so a stack trace will help02:03
jheskethmtreinish: can do02:03
mtreinishmordred: something you might like: :)02:04
mtreinishjhesketh: cool, thanks02:06
*** kjorgensen has quit IRC02:06
*** yamahata has joined #openstack-infra02:07
*** yamamoto_ has quit IRC02:07
mtreinishjhesketh: is there are good place on health.o.o to store archived rss xml files? Like does it have an ephemeral drive mounted or something?02:08
jheskethI don't know how it has been set up, but it appears to have a decent volume on /opt (which I assume is a cinder volume)02:09
*** dimtruck is now known as zz_dimtruck02:09
*** yamamoto_ has joined #openstack-infra02:10
mtreinishjhesketh: ok that works for me, I'll make a dir on /opt and tell it to store things there02:10
jheskethmtreinish: openstack-health is cloned to /opt/openstack-health02:10
jheskethnot sure if it is ran from there or just checked out (I suspect it's installed to the system dist-packages)02:10
jheskethyou can probably tell from the puppet modules02:10
*** weshay_food has quit IRC02:11
*** lakshmiS has quit IRC02:11
mtreinishjhesketh: for right now it's install in a venv in /opt/openstack-health/.venv (it's on my todo list to change that to be a system isntall)02:12
jheskethah cool02:12
*** mylu has quit IRC02:14
*** kengo_sakai has quit IRC02:15
*** sdake has joined #openstack-infra02:16
*** hichihara has joined #openstack-infra02:16
*** amotoki has joined #openstack-infra02:18
*** nwkarsten has joined #openstack-infra02:19
*** mylu has joined #openstack-infra02:19
*** sdake has quit IRC02:20
*** sdake has joined #openstack-infra02:20
*** yamahata has quit IRC02:21
*** amotoki has quit IRC02:23
mordredpleia2: has sabdfl ever indicated what's gonna happen after z?02:25
mtreinishjhesketh: ok, found the bug I don't think we need the temp dir created after all02:25
*** zz_dimtruck is now known as dimtruck02:25
mtreinishmordred: it goes back to 'A' right?02:25
mtreinishwell except I don't think there was ever an A02:26
*** sdake_ has joined #openstack-infra02:26
lifelessFirst collision already happened.02:26
lifelessWarty Warthog was the first release02:26
lifelessWily was the second W02:26
*** mriedem has quit IRC02:28
*** sdake has quit IRC02:29
*** amrith is now known as _amrith_02:30
*** jamielennox is now known as jamielennox|away02:32
openstackgerritGerard Braad proposed openstack-infra/system-config: Propose new admin for the Chinese mailinglist
openstackgerritGerard Braad proposed openstack-infra/system-config: Propose new admin for the Chinese mailinglist
*** markvoelker has quit IRC02:35
mtreinishmordred: what's openstack gonna do when it get's to 'z'? :)02:38
*** amotoki has joined #openstack-infra02:39
mgagnemtreinish: hopefully it will be the next character in the ASCII table: [02:41
mtreinishmgagne: heh, I like it. I think we can make that work :)02:42
*** mylu has quit IRC02:44
*** gyee has quit IRC02:48
*** mylu has joined #openstack-infra02:49
*** amotoki has quit IRC02:50
*** yuanying has quit IRC02:50
*** fedexo has joined #openstack-infra02:52
*** mtanino has joined #openstack-infra02:52
*** amotoki has joined #openstack-infra02:58
prometheanfireso... bindep core review? 30749302:59
prometheanfirefungi: ^ :P03:00
*** mtanino has quit IRC03:01
*** persia has quit IRC03:02
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Run df to see status of undercloud storage
*** mylu has quit IRC03:06
openstackgerritMerged openstack/diskimage-builder: Use generic "dhcp-client" name
*** ajmiller has joined #openstack-infra03:09
*** ajmiller_ has joined #openstack-infra03:10
*** mrmartin has joined #openstack-infra03:11
*** mylu has joined #openstack-infra03:12
*** ajmiller has quit IRC03:13
lifelessprometheanfire: reviewed03:14
prometheanfirelifeless: and replied03:15
prometheanfireneed to find where to add testing, but the commit message states why / was added03:15
lifelessprometheanfire: so the same name in different categories contains different things?03:16
prometheanfirescreen is another example03:16
prometheanfireapp-vim/screen -      Description:         vim plugin: simulate a split shell with screen or tmux03:17
prometheanfirethe normal one we all know is app-misc/screen03:17
prometheanfirelifeless: looks like I just need an entry in test_parser_patterns in
*** amotoki has quit IRC03:18
*** cburgess has quit IRC03:19
openstackgerritIan Wienand proposed openstack/diskimage-builder: [WIP] use virt-sysprep to cleanup images
*** cburgess has joined #openstack-infra03:20
*** mrmartin has quit IRC03:21
*** yamamoto_ has quit IRC03:22
*** yamamoto_ has joined #openstack-infra03:23
openstackgerritMatthew Thode proposed openstack-infra/bindep: Add Gentoo support to bindep
prometheanfirelifeless: ^03:25
prometheanfirethanks for the feedback :D03:25
*** yamamoto_ has quit IRC03:26
lifelessman chrome is such a memory hog03:27
prometheanfirelifeless: I've just started using gertty and love it :P03:28
*** morgan has quit IRC03:28
*** rkukura has joined #openstack-infra03:29
*** psachin has joined #openstack-infra03:32
*** persia has joined #openstack-infra03:32
*** aeng has joined #openstack-infra03:32
*** notmorgan has joined #openstack-infra03:34
*** notmorgan has quit IRC03:34
*** notmorgan has joined #openstack-infra03:34
*** markvoelker has joined #openstack-infra03:36
*** yamamoto_ has joined #openstack-infra03:36
*** woodster_ has quit IRC03:38
*** gongysh has quit IRC03:39
*** gongysh has joined #openstack-infra03:40
*** asettle has quit IRC03:40
*** gongysh has quit IRC03:41
*** markvoelker has quit IRC03:41
stevemaris there any documentation for switching your email address with openstack/gerrit/mailing list/stackalytics?03:41
*** amotoki has joined #openstack-infra03:42
*** asettle has joined #openstack-infra03:42
prometheanfiredunno, but in gerrit you add one and switch to it as your 'primary'03:43
notmorganstevemar: it's not hard03:44
stevemarnotmorgan: back to notmorgan eh :)03:44
*** notmorgan is now known as morgan03:44
morganstevemar: restarted my bouncer.03:45
stevemarnotmorgan: yeah, i figured, was just hoping it was documented somewhere so i wouldn't have to guess03:45
*** davideagnello has quit IRC03:45
prometheanfiremorgan: is it all controled by what you select in identies (gerrit)?03:45
*** kzaitsev_mb has joined #openstack-infra03:45
prometheanfirewell, is separate, so is actual openstack.org03:45
morganprometheanfire: ok so - basically you need to add an email in gerrit: settings -> contact info03:46
prometheanfireso three logins for openstack total I think03:46
morganprometheanfire: then you add a patch to stakalytics repo to add the new email as an alias03:46
prometheanfireya, I should probably do that03:46
morganprometheanfire: and you may want to also update launchpad.03:46
clarkbprometheanfire: 2. what is the third?03:46
prometheanfireb.o.o r.o.o and o.o03:46
* morgan also rememember something about needing to change things in openstackid and gitdm03:47
prometheanfirebugs reviews and root domain03:47
clarkbbugs and reviews use the same acoou t03:47
clarkbubuntu/launchpad openid03:47
prometheanfirewell, 2 then03:47
prometheanfiremorgan: this isn't for me03:48
morganprometheanfire: ah.03:48
*** yuanying has joined #openstack-infra03:48
clarkbstevemar: the biggest gotcha is if you change it in launchpad you will likely get a new openid03:48
clarkbthis will creatr a new user in review.o.o. if that happens let us know and we can collapse the old and new account03:49
*** yamamoto_ has quit IRC03:49
morganclarkb: i donn't think i ran into that issue before.03:50
morganclarkb: and i've chanted commit emails a couple times. as long as you keep your same login name in LP it should be "ok" iirc.03:50
clarkbmorgan: it doesnt se to happen for everyone03:50
morganclarkb: it's when people signup for a new account i think it breaks03:50
clarkbI am not completely sure why it happens03:50
morganvs just add new email, then delete old email.03:51
* morgan shrugs.03:51
*** julim has quit IRC03:51
clarkbI use a single email addr everywhere that is associated with me and never change it03:51
*** yuanying_ has joined #openstack-infra03:51
morgansame now..03:51
clarkbso not the best person to ask but I do help cleanup when openid gets unhappy03:52
morganwell i'm looking to move from gmail to non-gmail, but meh03:52
morgani don't want to have to change email addrs03:52
*** amotoki has quit IRC03:53
*** amotoki has joined #openstack-infra03:53
*** yuanying has quit IRC03:53
*** mylu has quit IRC03:54
stevemarclarkb: thanks for the tip!03:55
stevemarchanging mailing list was super easy03:55
*** mylu has joined #openstack-infra03:56
*** nelsnels_ has quit IRC03:57
*** dtantsur|afk has quit IRC03:59
*** AJaeger has quit IRC04:00
*** AJaeger has joined #openstack-infra04:00
*** nelsnelson has joined #openstack-infra04:02
*** mylu has quit IRC04:02
*** mylu has joined #openstack-infra04:02
*** dtantsur has joined #openstack-infra04:03
*** e0ne has joined #openstack-infra04:07
*** thorst has quit IRC04:08
*** thorst has joined #openstack-infra04:08
*** dahoo has quit IRC04:09
*** nelsnelson has quit IRC04:10
*** nelsnelson has joined #openstack-infra04:10
*** mylu has quit IRC04:12
*** hdd has quit IRC04:14
*** aarefiev has quit IRC04:16
*** thorst has quit IRC04:16
*** aarefiev has joined #openstack-infra04:16
*** rlandy has quit IRC04:18
openstackgerritIan Wienand proposed openstack/diskimage-builder: [WIP] use virt-sysprep to cleanup images
*** nwkarsten has quit IRC04:24
*** esker has joined #openstack-infra04:25
*** nwkarsten has joined #openstack-infra04:25
*** nwkarsten has quit IRC04:29
*** kzaitsev_mb has quit IRC04:30
*** e0ne has quit IRC04:30
*** yamamoto_ has joined #openstack-infra04:32
*** kzaitsev_mb has joined #openstack-infra04:35
*** gildub has joined #openstack-infra04:36
stevemari feel silly for not doing this ages ago04:36
*** markvoelker has joined #openstack-infra04:37
*** yamahata has joined #openstack-infra04:39
*** kzaitsev_mb has quit IRC04:41
*** asettle has quit IRC04:41
*** markvoelker has quit IRC04:42
*** vhosakot has quit IRC04:46
*** asettle has joined #openstack-infra04:51
*** asettle has quit IRC04:55
*** Nikolay_St has quit IRC05:02
*** dimtruck is now known as zz_dimtruck05:04
*** rcernin has joined #openstack-infra05:04
*** esker has quit IRC05:06
*** jaosorior has joined #openstack-infra05:12
*** mylu has joined #openstack-infra05:12
*** mylu has quit IRC05:14
*** mylu has joined #openstack-infra05:14
*** thorst has joined #openstack-infra05:15
*** ajmiller_ has quit IRC05:15
*** dtantsur has quit IRC05:18
*** mylu has quit IRC05:18
*** thorst has quit IRC05:22
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove translations for vendor specific networking-* projects
*** tlian has quit IRC05:24
*** esker has joined #openstack-infra05:26
*** amit213 has quit IRC05:27
*** amit213 has joined #openstack-infra05:27
*** jaosorior has quit IRC05:27
*** mylu has joined #openstack-infra05:28
*** mylu has quit IRC05:29
*** salv-orlando has joined #openstack-infra05:29
*** gmann has quit IRC05:30
*** esker has quit IRC05:31
*** salv-orl_ has quit IRC05:32
*** salv-orlando has quit IRC05:34
*** gmann has joined #openstack-infra05:35
*** dtantsur has joined #openstack-infra05:36
*** hparekh has quit IRC05:37
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove publisher site for vendor specific networking-* projects
masayukighi, what's happing in the gate right now? I can see many "UNSTABLE" jobs .05:47
AJaegermasayukig: no idea right now ;( Any infra-root around?05:49
AJaegermasayukig: I need to wait for testing to finish to check log files05:50
AJaegerSo, if you have a log file, please tell me05:50
*** mylu has joined #openstack-infra05:51
masayukigAJaeger: I don't have log files of UNSTABLEs, unfortunately.. like this
AJaegerSame here ;(
*** mylu has quit IRC05:52
AJaegerinfra-root, could you check these, please?05:52
AJaegermasayukig: we need to wait for yolanda or jhesketh to show up and help05:53
masayukigAJaeger: yup. I guess most of the infra people are sleeping or heading to Austin, though..05:53
masayukigAJaeger: Thanks, anyway :)05:54
AJaegermasayukig: yes, agreed05:56
*** bbroad has joined #openstack-infra05:56
*** jtomasek has joined #openstack-infra05:57
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Neutron Stadium: Remove extra openstack-server-release-jobs
*** gongysh has joined #openstack-infra05:57
*** mylu has joined #openstack-infra05:58
*** camunoz has quit IRC05:59
*** persia has quit IRC06:00
jheskethAJaeger, masayukig: I'm around.. just taking a look06:00
AJaegerthanks, jhesketh06:01
masayukigjhesketh: Thanks, great :)06:01
* jhesketh makes no promises06:01
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: designate-tempest-plugin: Remove server-release-job
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml
masayukigheh, no one can do it06:03
*** dtantsur has quit IRC06:04
*** maishsk has joined #openstack-infra06:04
*** tlbr has quit IRC06:05
*** tlbr has joined #openstack-infra06:05
*** esker has joined #openstack-infra06:07
*** sdake_ is now known as sdake06:08
*** dtantsur has joined #openstack-infra06:08
*** ianw has quit IRC06:10
*** maishsk has quit IRC06:11
*** zeih has joined #openstack-infra06:11
*** persia has joined #openstack-infra06:11
*** maishsk has joined #openstack-infra06:12
*** esker has quit IRC06:12
*** che-arne has joined #openstack-infra06:15
*** david-lyle has quit IRC06:16
*** bbroad is now known as bumpus06:19
*** thorst has joined #openstack-infra06:20
*** amotoki has quit IRC06:22
tonybAhh I see the 'UNSTABLE' thing is under control thanks jhesketh06:23
jhesketherr, not so much under control as under investigation06:23
* tonyb will ignore the periodic-stable failures06:23
*** fernnest_ has quit IRC06:23
tonybjhesketh: same same :D06:23
jheskethwell I'm not really having any luck debugging06:24
*** che-arne has quit IRC06:24
*** thorst has quit IRC06:27
*** maishsk has quit IRC06:27
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints
*** amotoki has joined #openstack-infra06:28
*** salv-orlando has joined #openstack-infra06:30
AJaegertonyb, would be great if you could approve later open stable/mitaka translations to have an empty queue, please!06:31
tonybAJaeger:*+topic:zanata/translations ?06:33
*** mikelk has joined #openstack-infra06:33
*** zeih has quit IRC06:34
tonybAJaeger: I can certainly do the nova one, the rest I'd like buy-in form the approriate PTL before jumping in.06:35
*** sdake has quit IRC06:35
AJaegertonyb: understood - thanks06:36
tonybAJaeger: but I can ask that thing at the summit / on the list06:36
AJaegerjhesketh: is any specific cloud unstable - or a specific jenkins?06:37
jheskethnope, seems to be across multiple clouds and jenkins'06:38
AJaegertonyb: no need to personally ask everybody, a mail is one way. I just wanted to have the list short before the summit - especially as we had some breakage with babel which lead to fixes in our scripts - and now everything is green again.06:39
AJaegerjhesketh: ;(06:39
tonybAJaeger: ok.06:40
*** sdake has joined #openstack-infra06:42
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml
*** tesseract has joined #openstack-infra06:43
*** tesseract is now known as Guest8301606:43
*** salv-orlando has quit IRC06:45
*** zeih has joined #openstack-infra06:45
*** zeih has quit IRC06:46
*** scheuran has joined #openstack-infra06:46
*** zeih has joined #openstack-infra06:46
*** sdake has quit IRC06:46
jheskethbascially job results are failing to upload to the log server... why that is is unclear06:47
jheskethand it's quite intermittent06:47
*** Guest83016 has quit IRC06:48
*** esker has joined #openstack-infra06:49
*** ramishra has quit IRC06:52
*** esker has quit IRC06:53
*** ramishra has joined #openstack-infra06:54
AJaegerthat's strange ;(06:54
AJaegerdo we have any networking problems to the log server?06:54
*** gongysh has quit IRC06:56
jheskeththat was my thoughts, but I can't see any06:57
*** oanson has joined #openstack-infra06:57
jheskethfirewall looks correct and I'm not getting packet loss from my connection06:57
AJaegerstrange, doc and pep8 seem to succeed but python27 fails06:59
* jhesketh is probably missing something obvious06:59
AJaegerthat's what I see in a few places07:00
AJaegercan you look at jenkins for a log file and see what gets reported?07:00
AJaegerMeaning: Grab the console log before it gets pushed to logs.o.o?07:01
*** cody-somerville has quit IRC07:01
AJaegeror did you do this already and that was your comment above?07:01
AJaegerhave to leave now...07:01
*** tesseract- has joined #openstack-infra07:02
jheskethAJaeger: yeah, basically the logs are just saying it failed to upload to static and then marks it as unstable07:05
jheskethoh, the logs are mounted read-only07:05
jheskeththat's probably it07:05
jheskethnow to figure out why :-s07:06
AJaegerbroken file system?07:07
jheskethmost likely07:08
*** vincentll has joined #openstack-infra07:09
*** netsin has quit IRC07:09
*** mylu has quit IRC07:10
*** nadya has joined #openstack-infra07:12
*** fedexo has quit IRC07:15
*** oanson has quit IRC07:16
*** Nikolay_St has joined #openstack-infra07:17
*** esikachev has joined #openstack-infra07:18
*** arxcruz has joined #openstack-infra07:19
*** matrohon has joined #openstack-infra07:21
*** bumpus is now known as saucybood07:22
*** maishsk has joined #openstack-infra07:23
*** maishsk has quit IRC07:24
*** ianw has joined #openstack-infra07:24
*** thorst has joined #openstack-infra07:24
*** amotoki has quit IRC07:24
*** ifarkas has joined #openstack-infra07:25
*** bauzas is now known as bauwser07:26
*** oanson has joined #openstack-infra07:26
jhesketh#status alert Logs are failing to be uploaded causing jobs to be marked as UNSTABLE. We are working on repairing the log filesystem and will update when ready. Please do not recheck before then.07:26
openstackstatusjhesketh: sending alert07:26
*** salv-orlando has joined #openstack-infra07:28
-openstackstatus- NOTICE: Logs are failing to be uploaded causing jobs to be marked as UNSTABLE. We are working on repairing the log filesystem and will update when ready. Please do not recheck before then.07:29
*** ChanServ changes topic to "Logs are failing to be uploaded causing jobs to be marked as UNSTABLE. We are working on repairing the log filesystem and will update when ready. Please do not recheck before then."07:29
yolandagood morning07:29
yolandajhesketh, what's up? disk damage?07:30
jheskethyolanda: a corrupt filesystem on the logs volume... I'm doing a dry run fsck at the moment07:31
jheskethyolanda: will probably need to run it properly and then remount07:31
*** thorst has quit IRC07:31
jheskethbut I don't know how damaged it is or isn't yet07:31
openstackstatusjhesketh: finished sending alert07:32
*** jaosorior has joined #openstack-infra07:32
*** furlongm_ has joined #openstack-infra07:32
*** furlongm has quit IRC07:33
*** jlanoux has joined #openstack-infra07:33
*** nadya has quit IRC07:37
jheskethyolanda: have you recovered the log server before?07:37
yolandajhesketh, not the log one but i did with static07:38
* jhesketh nods07:38
yolandawhat i did: unmount, fsck, mount07:38
*** vincentfrancoise has joined #openstack-infra07:42
*** zhurong has quit IRC07:43
*** nadya has joined #openstack-infra07:43
*** zhurong has joined #openstack-infra07:43
*** nadya has quit IRC07:45
*** aeng has quit IRC07:48
*** oanson has quit IRC07:52
*** lucas-dinner is now known as lucasagomes07:55
*** shardy has joined #openstack-infra07:55
openstackgerritMerged openstack-infra/project-config: Support multi backends for Zaqar tempest job
*** vincentfrancoise has left #openstack-infra07:57
*** hichihara has quit IRC07:57
openstackgerritSimon Pasquier proposed openstack-infra/project-config: Add openstack/stacklight-integration-tests project
*** zzzeek has quit IRC08:00
*** gildub has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** dizquierdo has joined #openstack-infra08:01
*** amotoki has joined #openstack-infra08:02
openstackgerritMerged openstack-infra/project-config: Fix typo error in Neutron Grafana dashboard
*** salv-orlando has quit IRC08:06
*** jlanoux_ has joined #openstack-infra08:14
*** ihrachys has joined #openstack-infra08:16
*** jlanoux has quit IRC08:18
*** huazhihao has joined #openstack-infra08:21
AJaegerjhesketh, yolanda: If you unmount, any new logs will be written on the root file system - remember to move that away/delete to not fill the root file system before mounting again...08:21
yolandaah, good catch, i remember that it happened to us last time08:22
*** mhickey has joined #openstack-infra08:22
jheskethAJaeger: yep, I checked befoer hand and there's plenty of space for the logs there in the mean time... will just have to juggle them into place when fsck is done08:23
*** ihrachys has quit IRC08:23
jheskethgood news is that it'll unblock jobs08:23
jhesketh(or at least should)08:24
*** ihrachys has joined #openstack-infra08:24
*** ihrachys has quit IRC08:24
AJaegerjhesketh: yes, it should - but let's not recheck yet;)08:25
*** jordanP has joined #openstack-infra08:26
jheskethyeah I'm not clearing the message for a bit08:26
jheskethhopefully that'll also explain why some logs will be missing08:26
*** imcsk8 is now known as imcsk8|zZz08:27
*** Kennan has quit IRC08:28
*** ankit_ag has joined #openstack-infra08:28
*** jistr has joined #openstack-infra08:28
*** thorst has joined #openstack-infra08:29
*** kushal has joined #openstack-infra08:33
*** Kennan has joined #openstack-infra08:33
*** thorst has quit IRC08:36
*** kjorgensen has joined #openstack-infra08:37
openstackgerrityolanda.robla proposed openstack-infra/shade: Add initial setup for magnum in shade
*** kjorgensen has quit IRC08:41
*** huazhihao has quit IRC08:45
*** derekh has joined #openstack-infra08:46
*** nadya has joined #openstack-infra08:47
*** ihrachys has joined #openstack-infra08:48
*** persia has quit IRC08:48
*** persia has joined #openstack-infra08:53
matttaware you folks are busy wranging logs, but can someone help me get access to a running instance once the dust has settled?08:56
*** amotoki has quit IRC08:57
*** amotoki has joined #openstack-infra08:58
*** persia has quit IRC08:58
*** electrofelix has joined #openstack-infra09:05
*** esker has joined #openstack-infra09:09
*** schipiga has joined #openstack-infra09:11
*** persia has joined #openstack-infra09:12
openstackgerritMerged openstack-infra/system-config: Replace the packstack-dev channel by rdo
*** dizquierdo has quit IRC09:14
*** esker has quit IRC09:14
*** arxcruz has quit IRC09:16
*** ankit_ag has quit IRC09:20
*** openstackstatus has quit IRC09:24
*** openstackstatus has joined #openstack-infra09:25
*** ChanServ sets mode: +v openstackstatus09:25
*** schipiga has quit IRC09:25
*** david-lyle has joined #openstack-infra09:28
*** HeOS has joined #openstack-infra09:28
*** furlongm_ has quit IRC09:28
*** amotoki has quit IRC09:28
*** nadya has quit IRC09:29
*** furlongm has joined #openstack-infra09:29
*** esker has joined #openstack-infra09:30
openstackgerritDaniel Berrange proposed openstack-infra/project-config: Add release-notes job for os-vif
*** esker has quit IRC09:35
*** jaosorior is now known as jaosorior_lunch09:35
*** thorst has joined #openstack-infra09:36
*** tosky has joined #openstack-infra09:40
*** thorst has quit IRC09:42
ihrachysAJaeger: are you on the acl patch for networking-*, or I can respin?09:44
jheskethFYI logs are repaired and back in place... just going to let zuul settle and jenkins upload more results etc before removing the status09:46
AJaegerihrachys: go ahead, please!09:49
openstackgerritNiall Bunting proposed openstack-infra/project-config: Glance_store swift functional tests
*** Na3iL has joined #openstack-infra09:51
openstackgerritCarlos Camacho proposed openstack-infra/tripleo-ci: Finished: Update deprecated commands in (Old heat * calls)
*** zhurong has quit IRC09:53
*** shardy has quit IRC09:54
*** megm has quit IRC09:57
*** arxcruz has joined #openstack-infra09:57
*** ianw has quit IRC09:58
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Update Gerrit ACLs for vendor specific networking-* projects
ihrachysAJaeger: ^ that should make it09:58
*** megm has joined #openstack-infra09:58
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove publisher site for vendor specific networking-* projects
*** flepied1 has joined #openstack-infra09:59
AJaegerihrachys: it does indeed - thanks. yolanda want to review 303039 again?10:00
openstackgerritMerged openstack-infra/project-config: Add remaining pipelines to zuul-status dashboard
*** flepied has quit IRC10:03
openstackgerritAliaksandr Buhayeu proposed openstack-infra/jenkins-job-builder: Clarify exception message for missed trigger properties
openstackgerrityolanda.robla proposed openstack-infra/shade: WIP: Add baymodel list call for shade+magnum
*** esker has joined #openstack-infra10:11
openstackgerritMerged openstack-dev/pbr: Update Preversioning explanation to avoid double that
*** esker has quit IRC10:16
openstackgerritMerged openstack-infra/project-config: Update Gerrit ACLs for vendor specific networking-* projects
*** jaosorior_lunch is now known as jaosorior10:19
*** krotscheck_dcm is now known as krotscheck10:19
*** fhubik has joined #openstack-infra10:20
*** amotoki has joined #openstack-infra10:22
openstackgerritMerged openstack-infra/project-config: Add openstack/stacklight-integration-tests project
*** ianw has joined #openstack-infra10:31
*** kushal has quit IRC10:31
*** esker has joined #openstack-infra10:32
*** _amrith_ is now known as amrith10:32
*** salv-orlando has joined #openstack-infra10:33
*** acabot has quit IRC10:34
AJaegerarmax: could you double check, please? If you're happy, I can +2A. Please also review and
*** hdd has joined #openstack-infra10:35
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Fix Q_PLUGIN_EXTRA_CONF_PATH for generic switch
*** esker has quit IRC10:37
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Fix Q_PLUGIN_EXTRA_CONF_PATH for ironic-multitenant job
*** dizquierdo has joined #openstack-infra10:38
*** thorst has joined #openstack-infra10:40
*** rodrigods has quit IRC10:40
*** rodrigods has joined #openstack-infra10:40
*** sdague has joined #openstack-infra10:42
*** _degorenko|afk is now known as degorenko_10:43
*** thorst has quit IRC10:46
*** thorst has joined #openstack-infra10:46
*** amotoki has quit IRC10:47
jheskethyolanda: I think zuul/jenkins have been behaving long enough now.. happy for me to lift the alert?10:47
yolandajhesketh, yes, everything looks fine10:48
*** yamamoto_ has quit IRC10:48
jhesketh#status ok Log server has been repaired and jobs are stable again. If necessary please recheck changes that have 'UNSTABLE' results.10:49
openstackstatusjhesketh: sending ok10:49
*** salv-orlando has quit IRC10:50
*** mikelk has quit IRC10:51
-openstackstatus- NOTICE: Log server has been repaired and jobs are stable again. If necessary please recheck changes that have 'UNSTABLE' results.10:51
AJaegerthanks, jhesketh !10:52
*** asselin__ has joined #openstack-infra10:53
*** jaosorior has quit IRC10:54
openstackstatusjhesketh: finished sending ok10:54
*** jaosorior has joined #openstack-infra10:55
*** jaosorior has quit IRC10:55
*** jlanoux_ has quit IRC10:56
*** jaosorior has joined #openstack-infra10:56
*** jlanoux has joined #openstack-infra10:56
*** asselin_ has quit IRC10:57
openstackgerritMerged openstack-infra/project-config: [Rally] Fix job for Manila project
*** rhallisey has joined #openstack-infra11:01
openstackgerritMerged openstack-infra/project-config: Add openstack/monasca-analytics project
*** lucasagomes is now known as lucas-hungry11:05
*** rvba` is now known as rvba11:07
*** sdague has quit IRC11:11
*** sdague has joined #openstack-infra11:13
*** amotoki has joined #openstack-infra11:13
*** esker has joined #openstack-infra11:14
odyssey4meAJaeger a general question - is it possible for a repo to have two groups marked as cores?11:16
AJaegerodyssey4me: two ways for that:11:16
AJaeger1) Have one group and have it include these two groups11:17
AJaeger2) Do it like some of the dashboard one,s let me give you an example11:17
AJaegergerrit/acls/openstack/trove-dashboard.config is an example11:17
*** ianw has quit IRC11:18
*** esker has quit IRC11:19
*** Qiming has quit IRC11:20
odyssey4meAJaeger ah great, thanks - we're discussing this option at the summit so I'm just getting prepped for the options11:20
*** amotoki has quit IRC11:20
*** thorst has quit IRC11:21
*** Qiming has joined #openstack-infra11:21
*** thorst has joined #openstack-infra11:22
*** ldnunes has joined #openstack-infra11:22
*** salv-orlando has joined #openstack-infra11:23
*** zhurong_ has joined #openstack-infra11:23
*** baoli has joined #openstack-infra11:23
*** hdd has quit IRC11:25
*** baoli has quit IRC11:28
*** gordc has joined #openstack-infra11:28
*** baoli has joined #openstack-infra11:29
*** thorst has quit IRC11:30
*** baoli_ has joined #openstack-infra11:30
*** Jeffrey4l has joined #openstack-infra11:31
*** salv-orlando has quit IRC11:33
*** EricGonczer_ has joined #openstack-infra11:34
openstackgerritMerged openstack-infra/project-config: Don't skip expensive jobs for Inspector tempest tests
*** baoli has quit IRC11:35
*** EricGonczer_ has quit IRC11:35
*** gildub has joined #openstack-infra11:36
*** ankit_ag has joined #openstack-infra11:38
openstackgerritMerged openstack-infra/project-config: Add release-notes job for os-vif
*** markvoelker has joined #openstack-infra11:42
*** Qiming_ has joined #openstack-infra11:46
*** thorst has joined #openstack-infra11:47
*** markvoelker has quit IRC11:47
*** Qiming has quit IRC11:48
*** burgerk has joined #openstack-infra11:49
*** ianw has joined #openstack-infra11:52
*** esker has joined #openstack-infra11:55
*** arxcruz has quit IRC11:56
*** weshay has joined #openstack-infra11:57
*** esker has quit IRC12:00
*** |-paul-| has joined #openstack-infra12:00
zeihAJaeger: ping12:02
AJaegerzeih: please no naked pings, just speak up - and if I'm not around, somebody else might be able to help...12:02
zeihAJaeger: sure. thx. I have a question regarding gate-grenade-dsvm-heat failure on
*** kaisers has quit IRC12:03
AJaegernot sure that I can help with  those details but shoot ;)12:04
zeihWhere can I find associated patches for the root cause of the problem this tests fail12:04
*** kaisers has joined #openstack-infra12:04
AJaegerwhat do you mean with "associated patches for the root cause"?12:05
AJaegerzeih: In general #openstack-qa is the better channel for debugging such test like grenade.12:06
zeihoh, cool. thx. I will have a look12:06
*** flwang has quit IRC12:07
AJaegerzeih: grenade is in it's own repo, openstack-dev/grenade. And the heat tests are configured in openstack-infra/project-config - directory jenkins/jobs12:07
zeihAJaeger: thx I will have a look12:08
*** lucas-hungry is now known as lucasagomes12:08
*** psilvad has joined #openstack-infra12:10
*** asettle has joined #openstack-infra12:12
*** nadya has joined #openstack-infra12:12
*** asettle has quit IRC12:13
*** alex_xu has quit IRC12:13
*** kzaitsev_mb has joined #openstack-infra12:13
*** aysyd has joined #openstack-infra12:14
openstackgerritMerged openstack-infra/project-config: ACL: allow to create branches for gce-api project
*** maishsk has joined #openstack-infra12:15
*** burgerk has quit IRC12:15
*** arxcruz has joined #openstack-infra12:15
*** alex_xu has joined #openstack-infra12:16
*** esker has joined #openstack-infra12:16
*** esikachev has quit IRC12:18
*** EricGonczer_ has joined #openstack-infra12:19
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Fix building (make) in 'doc' directory
openstackgerritLucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: SCM repo: add ignore-changes option
*** kzaitsev_mb has quit IRC12:20
*** esker has quit IRC12:21
*** esikachev has joined #openstack-infra12:21
*** psilvad has quit IRC12:21
*** psilvad_ has joined #openstack-infra12:21
*** psilvad_ is now known as psilvad12:21
*** Na3iL has quit IRC12:24
EmilienMfungi: hi, all master/stable tarballs are created - thanks again! /me working on tags now12:26
*** kzaitsev_mb has joined #openstack-infra12:26
*** psilvad has quit IRC12:26
*** pradk_ has joined #openstack-infra12:27
*** Kiall has quit IRC12:28
*** ankit_ag has quit IRC12:28
*** markvoelker has joined #openstack-infra12:28
*** Kiall has joined #openstack-infra12:28
AJaegersdague: could you review and , please? Both "Fix Q_PLUGIN_EXTRA_CONF_PATH"12:28
AJaegerEmilienM: let's celebrate:12:29
*** salv-orlando has joined #openstack-infra12:29
*** Goneri has joined #openstack-infra12:29
AJaeger#success Tarballs for current tip of branches for puppet projects are now available, example:
openstackstatusAJaeger: Added success to Success page12:29
*** andymaier has joined #openstack-infra12:31
EmilienMI never think about using this bot :-)12:31
AJaeger#success now has an regularly updated Gerrit review dashboard link for Neutron that takes priorities and bug status (thanks rossella_s !)12:31
openstackstatusAJaeger: Added success to Success page12:31
AJaegerEmilienM: I often forget it as well, so two at once now ;)12:31
sdagueAJaeger: +212:32
openstackgerritSergey Kraynev proposed openstack-infra/project-config: Add murano-open-paas project to openstack
AJaegerthanks, sdague ! Then let me +2A.12:32
*** hdd has joined #openstack-infra12:32
*** amrith is now known as _amrith_12:33
AJaegerthose were the only two places using it in project-config12:33
rossella_sAJaeger, didn't know about this success tag12:34
*** |-paul-| has quit IRC12:34
*** kzaitsev_mb has quit IRC12:34
*** inc0 has joined #openstack-infra12:35
*** flwang has joined #openstack-infra12:35
*** matt-borland has joined #openstack-infra12:36
*** Na3iL has joined #openstack-infra12:38
*** saucybood has quit IRC12:39
*** mtanino has joined #openstack-infra12:39
*** EricGonc_ has joined #openstack-infra12:40
*** doug-fish has joined #openstack-infra12:41
*** julim has joined #openstack-infra12:42
*** EricGonczer_ has quit IRC12:43
*** mpaolino has joined #openstack-infra12:43
openstackgerritMerged openstack-infra/project-config: Fix Q_PLUGIN_EXTRA_CONF_PATH for ironic-multitenant job
openstackgerritMerged openstack-infra/project-config: Fix Q_PLUGIN_EXTRA_CONF_PATH for generic switch
*** alaski is now known as lascii12:46
mpaolinoHello All, I would need my user to be added to the core and release groups of my (just created) project:
mpaolinois there anyone available to do so?12:47
mpaolinom-paolino is the user, if needed12:47
*** psilvad has joined #openstack-infra12:47
*** trown|outtypewww is now known as trown12:47
*** tlian has joined #openstack-infra12:50
*** salv-orlando has quit IRC12:51
*** Goneri has quit IRC12:51
*** alex_xu has quit IRC12:51
*** annegentle has quit IRC12:53
*** annegentle has joined #openstack-infra12:54
*** alex_xu has joined #openstack-infra12:54
*** zhurong_ has quit IRC12:54
*** Goneri has joined #openstack-infra12:55
*** zhurong has joined #openstack-infra12:55
*** psachin has quit IRC12:56
*** jaosorior has quit IRC12:58
*** esker has joined #openstack-infra12:58
*** maishsk has quit IRC12:59
*** pradk_ has quit IRC13:02
*** esker has quit IRC13:03
*** rossella_s has quit IRC13:04
*** rossella_s has joined #openstack-infra13:04
*** Goneri has quit IRC13:06
*** yamamoto has joined #openstack-infra13:08
openstackgerritEmilien Macchi proposed openstack-infra/project-config: jjb/puppet: add missing deps on Red Hat systems
openstackgerritThanh Ha proposed openstack-infra/jenkins-job-builder: Fix CFP configuration for >=2.10.0
*** annegentle has quit IRC13:09
*** esker has joined #openstack-infra13:10
zxiiroelectrofelix: Totally missed that print statement, it's fixed now. Can you re-review? ^13:10
*** doug-fish has quit IRC13:12
*** doug-fish has joined #openstack-infra13:13
*** matrohon has quit IRC13:14
pabelangerAJaeger: yolanda: now that diskimage-builder 1.15.0 is released, we should land
pabelangerAJaeger: yolanda: I confirmed setfiles worked last night13:15
openstackgerritMerged openstack-infra/jenkins-job-builder: Clarify exception message for missed trigger properties
pabelangerdiskimage-builder==1.15.0 on nodepool.o.o too13:15
*** akerr_ has joined #openstack-infra13:16
akerr_anyone else noticing instability with RackSpace's mirrors for Trusty packages today?13:16
electrofelixzxiiro: done :)13:16
zxiiroelectrofelix: thanks!13:17
*** esker has quit IRC13:18
openstackgerritMerged openstack-infra/jenkins-job-builder: Fix building (make) in 'doc' directory
AJaegerrossella_s: lists all of them - a nice way to celebrate and share13:19
*** Goneri has joined #openstack-infra13:19
AJaegerpabelanger: so, safe to merge now? Then I'll +2A13:20
AJaegerpabelanger: done13:20
pabelangerAJaeger: Yup! I'll be monitoring too13:21
pabelangerAJaeger: 309393 when you have a second. bindep related13:21
AJaegera second? Sure...13:21
AJaegerpabelanger: that one looks ok as temporary step IMHO - what do you think?13:22
pabelangerAJaeger: the last sentence in the commit message is confusing.  It seems EmilienM doesn't want bindep on some puppet modules13:23
AJaegerpabelanger: Ah, let's ask him...13:24
*** zhurong has quit IRC13:24
pabelangerAJaeger: maybe next week we can have a quick chat with fungi to see how our JJB templates should look for the future.  For me, now that we have bindep running, we'd remove this logic from JJB into other-requirements.txt13:26
*** zhurong has joined #openstack-infra13:26
AJaegerpabelanger: yes, we should do that.13:27
EmilienMpabelanger: some puppet-modules (puppet-trove for example) don't want bindep default packages13:27
EmilienMpabelanger: for some reasons...13:27
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: builders: update cmake to match CMake plugin versions 2.x
EmilienMpabelanger: so we add the empty other-requirements.txt file, but now lint jobs fail13:27
pabelangerEmilienM: meaning they want an empty other-requirements.txt file?13:27
EmilienMpabelanger: my patch makes consistent the dependencies when installing puppet deps13:27
EmilienMif you look
*** mhickey has quit IRC13:28
EmilienML329, you see the same deps13:28
EmilienMoh btw13:28
EmilienMI noticed, I dupplicated some13:28
pabelangerEmilienM: Right, moving forward I'd like to see us remove a lot of that logic from JJB. And into each project to manage13:28
AJaegerpabelanger: on another note: I see that we do the initially planned lightning talks together at . Are you going to use slides for this?13:29
pabelangerbut currently bindep only installs, not removes13:29
*** terrylhowe has joined #openstack-infra13:29
openstackgerritEmilien Macchi proposed openstack-infra/project-config: jjb/puppet: add missing deps on Red Hat systems
EmilienMAJaeger: sorry, I had to update ^ it's even simplier now13:29
*** _amrith_ is now known as amrith13:29
pabelangerAJaeger: Ya, seen that last night.  I think I'm going to do something with 3-5 slides, mostly showing the syntax13:29
openstackgerritMerged openstack-infra/project-config: Let dib fix selinux policy for us
*** akerr_ has left #openstack-infra13:30
* AJaeger will prepare slides now (first draft ;)13:31
pabelangerEmilienM: AJaeger: So, I think we can land that but I think moving forward we want to revisit having apt-get / yum install foo in JJB. Especially if the project have bindep13:31
terrylhoweWith Jenkins Job Builder is there a way to insert arbitrary xml?  I want to use a quay trigger to fire a job and the code obviously doesn’t support that and I don’t see a generic job trigger13:31
EmilienMpabelanger: I agree with that13:31
EmilienMterrylhowe: not afik13:31
AJaegerpabelanger: I fully agree - let's talk with fungi on that and create a plan of attack ;)13:32
*** zz_dimtruck is now known as dimtruck13:32
terrylhowethx EmilienM13:32
pabelangerAJaeger: EmilienM: +213:32
*** nwkarsten has joined #openstack-infra13:32
EmilienMAJaeger, pabelanger: big +1, I'll be happy to help in this effort13:32
AJaegerEmilienM: we will need you for that one ;) Thanks!13:33
zxiirowaynr: zaro: can either of you review this patch again? it only needs one more vote to merge
pabelangerEmilienM: I'd also want to better understand why puppet-trove wants just an empty other-requirements.txt13:33
EmilienMpabelanger: tl;dr; trove does not support mariadb1013:33
pabelangerEmilienM: on another note, how the publishing of tarballs doing13:33
EmilienMpabelanger: they brought the support in Mitaka, not in Liberty13:34
EmilienMpabelanger: so puppet-trove CI in stalbe/liberty is failing13:34
*** aimeeU has joined #openstack-infra13:34
zxiiroelectrofelix: so that self.registry thing is really handy but how do you call it from inside of a function definition for a module? I couldn't find any global way to call it13:34
pabelangerEmilienM: going to look at log files13:34
EmilienMpabelanger: so I needed to drop bindeps default deps (that install mariadb10 instead of 5.5) so puppet-trove CI is green for liberty13:34
EmilienMpabelanger: let me save you time13:34
EmilienMand show you13:34
EmilienMwith mariadb1013:35
EmilienMyou can ask vkmc13:35
EmilienMtrove in liberty needs mariadb 5.5, (at least on RDO packaging) - so we needed to stop installing 10 with bindep13:36
EmilienMby adding the other-requirements.txt file, our lint jobs started to fail, this is why I did
EmilienMnow you have full background13:36
pabelangerEmilienM: why not copy bindep-fallback.txt into other-requirements.txt and just drop mariadb support as another other.  As you see, bindep-fallback has zlib-devel already13:37
pabelangeruntil you can properly trim other-requirements.txt13:37
*** kgiusti has joined #openstack-infra13:37
EmilienMyes, I could also have done that. I think we need a bindep file for Puppet jobs13:38
EmilienMand drop yum/apt from JJB13:38
EmilienMI can work on it during Newton13:38
*** esker has joined #openstack-infra13:38
pabelangersure, lets sync up in Austin, make sure we have a plan in place.  I'm happy to help with puppet modules and bindep13:39
*** annegentle has joined #openstack-infra13:39
*** nikhil_ has joined #openstack-infra13:40
*** nikhil_ is now known as Guest501513:40
*** Guest5015 is now known as nikhil_k13:40
electrofelixzxiiro: parser.registry.... ;)13:41
*** degorenko has joined #openstack-infra13:41
zxiirohuh really?13:42
zxiirowhy didn't i think of that hah13:42
AJaegerpabelanger: thanks for approving these networking changes - but in general we wait for one of the neutron infra liasons to +1 - so armax, dougwig, or mestery .13:42
*** mhickey has joined #openstack-infra13:42
*** esker has quit IRC13:43
AJaegerpabelanger: do you want to remove your +A again and give them a chance to comment on 309266 and 309263?13:43
pabelangerAJaeger: I can13:44
*** annegentle has quit IRC13:44
*** cody-somerville has joined #openstack-infra13:44
*** mtanino has quit IRC13:44
AJaegerpabelanger: I just gave a WIP ;)13:45
fungiokay, i'm around for a bit now. is the fire with logs.o.o filesystem corruption under control or is help still needed?13:45
pabelangerAJaeger: thanks13:45
openstackgerritMonty Taylor proposed openstack-infra/zuul: Use reno for release notes
fungilooks like it's mounted again13:45
AJaegerfungi: the Australian fire brigade rescued us - under supervision of the all-female Spanish team ;)13:45
openstackgerritMonty Taylor proposed openstack-infra/zuul: Use reno for release notes
fungiAJaeger: it's like the sysadmin olympics in here, i tell you13:46
AJaegerfungi, are you going to hand out medals to these two? ;)13:46
fungijhesketh: yolanda: thanks for getting that under control! any guess what triggered it this time?13:46
* fungi is pawing through dmesg too13:47
mordredfungi: I blame tiny monkies13:47
fungi[Fri Apr 22 05:13:19 2016] end_request: I/O error, dev xvde, sector 177500018413:47
*** schipiga has joined #openstack-infra13:47
schipigaHi all! We have some troubles with horizon testing infrastructure. Right now jenkins build is failed due to "apache2: unrecognized service": I tried to fix that with deletion line to restart apache2 (because at this moment apache2 isn't installed), but after that my build was failed again by timeout http://logs.openstack.org13:47
schipiga/32/309332/1/check/gate-horizon-dsvm-integration/490d104/console.html#_2016-04-22_12_06_40_633. Horizon tests waited something (what exactly I don't know because traceback is absent due timeout) and didn't find it. I don't know how to detect a problem. May be some problems with devstack and infra?13:47
fungibetting we had another iscsi disconnect like we experienced a few days ago, but this one wasn't recoverable13:48
jheskethfungi: only what's in dmesg sorry13:48
*** dansmith is now known as superdan13:48
fungisimilar timeframe. wonder if there was network maintenance going on in dfw13:48
fungior water in the tubes13:49
* fungi sends rackspace some extra towels to dry texas off13:49
funginothing too obvious on status.rackspace.com13:50
*** degorenko has quit IRC13:50
*** mriedem has joined #openstack-infra13:50
fungioh, wait... Cloud Block Storage | Planned Emergency | Starting Wednesday, April 20th, 2016 to April 26th, 201613:51
fungihrm, though dfw isn't supposed to happen until next week13:51
*** kushal has joined #openstack-infra13:51
jheskethfungi: just a heads up that zuul is running out of memory rapidly13:51
*** degorenko has joined #openstack-infra13:51
fungijhesketh: yeah, i think we were planning to restart it again today for the status.json patches anyway13:52
fungibut thanks for the reminder13:52
jheskethfungi: yep, just a reminder13:52
jheskethfungi: we had applied previously that seemed to fix the problem... jeblair was going to make sure that was applied again on the next restart (or merge it first)13:52
jhesketh(it got restarted without it at some point)13:52
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: grafana: added a dashboard with periodic jobs for neutron
*** mhickey has quit IRC13:53
*** salv-orlando has joined #openstack-infra13:54
jheskethanyway, I have to get up in 4.5 hours for my flight, so I should head off13:55
fungihave we seen any more recurrences of the "it looks like sudo is disabled on jobs that shouldn't have sudo disabled" issue from before i fell asleep?13:55
AJaegerjhesketh: safe travels!13:55
fungii got to wondering if maybe we have a job which revokes sudo somehow matching a name regex for the jobs that run on non-single-use workers13:56
fungijhesketh: see you there!13:56
fungithanks again13:56
fungii should be able to prove/disprove that theory by backtracking examples in the zuul logs13:57
jheskethAJaeger: thanks :-)13:58
jheskethfungi: looking forward to it!13:58
jheskethnight all13:58
*** oanson has joined #openstack-infra13:59
*** mriedem has quit IRC14:00
*** mriedem has joined #openstack-infra14:01
*** zul has quit IRC14:01
*** chuck__ has joined #openstack-infra14:01
*** degorenko_ has quit IRC14:02
*** pcrews_ has joined #openstack-infra14:02
*** pcrews_ has quit IRC14:02
*** degorenko_ has joined #openstack-infra14:03
*** degorenko_ has quit IRC14:03
*** pcrews has joined #openstack-infra14:03
*** sigmavirus24_awa is now known as sigmavirus2414:03
electrofelixzxiiro: I think would be a good idea to land, along with another patch I have to tidy up the urls.14:04
*** _prad_ has joined #openstack-infra14:04
*** _prad_ is now known as prad_14:04
*** mhickey has joined #openstack-infra14:06
*** degorenko_ has joined #openstack-infra14:06
openstackgerritMerged openstack-infra/jenkins-job-builder: Fix CFP configuration for >=2.10.0
*** degorenko_ has quit IRC14:07
*** e0ne has joined #openstack-infra14:07
zxiiroelectrofelix: looking14:07
openstackgerritMerged openstack-infra/project-config: designate-tempest-plugin: Remove server-release-job
*** sdake has joined #openstack-infra14:09
*** sdake_ has joined #openstack-infra14:10
prometheanfiresambetts|afk: I'm on irc, but if you know a nova config I could test with (most nova limits to one IP) I can test the gentoo stuff for glean14:11
*** xyang1 has joined #openstack-infra14:11
*** oanson has quit IRC14:11
electrofelixzxiiro: just spotted jenkins has changed url with a redirect14:12
*** esker has joined #openstack-infra14:13
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Update Urls for redirects and broken
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Convert remaining Jenkins wiki URLs to sphinx roles
*** sdake has quit IRC14:13
*** ramishra has quit IRC14:14
*** xarses has quit IRC14:14
*** EricGonc_ has quit IRC14:15
zxiiroseems everyone wants a .io these days14:15
electrofelixyeap, what about the good old days when we had to decide between .net or .org :p14:16
fungidecide? there were pretty strict guidelines as to which you qualified for14:17
*** EricGonczer_ has joined #openstack-infra14:17
fungigranted, they didn't really enforce them very well14:17
prometheanfirezxiiro: I don't :P14:17
prometheanfireI do try to get a .org,net,com for each domain I own though14:18
*** andymaier has quit IRC14:18
*** rbrndt has joined #openstack-infra14:18
*** ajmiller has joined #openstack-infra14:19
fungithe early notion of tlds made some (in retrospect) silly assumptions about who would connect services to the internet14:19
prometheanfiresambetts|afk: actually, I don't even know how to test glean with a single vlan per interface :|14:20
prometheanfiresambetts|afk: my best test right now is that you haven't broken the general use case I guess :P14:20
openstackgerritMerged openstack-infra/project-config: jjb/puppet: add missing deps on Red Hat systems
prometheanfirefungi: have time for bindep?
fungiprometheanfire: not yet, though i saw lifeless had a chance to look it over earlier14:22
prometheanfireya, was mising a test for the '/' that's been fixed and he +2'd it :D14:22
fungistill trying to make sure i'm on top of embargoed vulnerability reports and last-minute prep for travel, but will try to get ti it here shortly14:23
*** mtanino has joined #openstack-infra14:23
fungiwant to make sure i don't go dark on anything important heading into conference mode14:24
prometheanfireya, I know that's rushing up at us14:24
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Skip gate-rally-dsvm-neutron-neutron in kilo
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Clean up cached objects after use
*** denisra has quit IRC14:25
*** denisra has joined #openstack-infra14:25
prometheanfireproject-config uses bindep from git master right?14:25
*** MarkAtwood has joined #openstack-infra14:26
*** abregman has joined #openstack-infra14:26
*** annegentle has joined #openstack-infra14:27
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: add zuul_runner module
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Disable gate-tempest-dsvm-neutron-multinode-full for kilo
dmsimardWe recently setup the bots on #rdo through but logs aren't showing up on eavesdrop. Did I miss something ?14:28
*** mixos has joined #openstack-infra14:28
openstackgerritMerged openstack-infra/zuul: Add report URL to status.json
*** Nikolay_St has quit IRC14:29
*** Qiming_ has quit IRC14:29
*** doug-fis_ has joined #openstack-infra14:30
dmsimardfungi: ah, it's meetbot, then ?14:31
AJaegerdmsimard: you only setup statusbot, not meetbot14:31
dmsimardI thought that was for, you know, meetings14:31
fungidmsimard: yes, the meetbot is also our channel logger14:31
AJaegerdmsimard: correct - meetbot does loggings14:31
dmsimardok, I'll add it, thanks14:31
fungimaybe our documentation could use some additional clarification around that14:31
*** nwkarsten has quit IRC14:32
dmsimardfungi: well to be fair it's here:
dmsimardso my bad14:32
*** nwkarsten has joined #openstack-infra14:33
*** doug-fish has quit IRC14:33
*** annegentle has quit IRC14:33
fungiperhaps we could use a bolder font ;)14:33
dmsimardWell, I don't know. Maybe an explicit(er?) how-to on how to add channels to the openstack-infra bots14:35
dmsimardThat page mostly describes what the different IRC services do I think14:35
AJaegerWE could add something t othe Infra manual - Creator's guide. dmsimard, want to propose an addition?14:36
dmsimardwell, the hiera files are even linked, I'll be damned14:36
openstackgerritMerged openstack-infra/shade: Add support for Designate zones
*** gildub has quit IRC14:37
*** nwkarsten has quit IRC14:37
*** newjersey has joined #openstack-infra14:37
openstackgerritDavid Moreau Simard proposed openstack-infra/system-config: Add #rdo to meetbot channels
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support
*** salv-orlando has quit IRC14:40
*** xarses has joined #openstack-infra14:41
EmilienMok so I'm trying to re-use {name}-tarball job template for puppet jobs, so we can have tarballs for every tag14:42
fungii'm honestly surprised we kept on top of that in the documentation. it only very recently moved from our manifest into public hiera14:42
EmilienMsomething I don't understand yet is how python projects have the right name, is it some magic with tox when generating the tarball?14:42
EmilienMright name: project-tag.tar.gz14:42
*** zhurong has quit IRC14:43
AJaegerEmilienM: python setup.sdist creates project.tar.gz14:43
fungiEmilienM: i think they declare it in or indirectly via pbr from setup.cfg14:43
AJaegerEmilienM: and the wrapper in jenkins/jobs/python-jobs moves that to project-TAG.tar.gz14:43
fungiso, yes, what AJaeger said. python packaging has its own metadata and tarball generation mechanisms we rely on14:43
AJaegeryes, setup.cfg contains the name14:43
EmilienMAJaeger: I haven't found the magic that rename it, except for -branch-tarbal14:44
fungiEmilienM: though you could probably infer it from $ZUUL_PROJECT instead14:44
fungiand $ZUUL_REFNAME14:44
AJaegerEmilienM: ah, you're speaking tags now - let me chec kthat...14:45
fungior if there's some puppet module metadata in the repo, fish it out of there14:45
EmilienMyeah, I can see where tarballs are renames for branches14:45
*** flepied has joined #openstack-infra14:45
fungiyeah, tags appear in $ZUUL_REFNAME14:45
*** cody-somerville has quit IRC14:45
fungii believe they show up like /refs/tags/1.2.314:45
fungier, refs/tags/1.2.314:45
*** zhurong has joined #openstack-infra14:46
EmilienMwait, tags appear in ZUUL_REFNAME ??14:46
EmilienMI'm more than confused now14:46
AJaegerEmilienM: python sdist creates already "repo-TAG.tar.gz14:46
* EmilienM trying to figure out if I need some logic in jenkins/scripts/run-tarball.sh14:47
*** mylu has joined #openstack-infra14:47
AJaegerpbr can derive the name/version AFAIK from git, so does the right thing. Higher magic ;)14:47
fungiEmilienM: for a job triggered by a change merging, zuul will provide the branch name in $ZUUL_REFNAME but if the job is triggered by a tag push then the tag shows up in $ZUUL_REFNAME instead14:48
EmilienMI got it now14:48
EmilienMso I guess I  have to do... nothing and wait for a next release14:48
EmilienM(except adding -tarball jobs)14:48
jeblairReleased volume mirror.npm successfully14:48
jeblairreal    97m38.169s14:48
jeblairkrotscheck: ^14:48
fungiwe don't rely on those zuul envvars for the python tarball jobs because python is obtaining that info in other ways (from setup.cfg and the git repo via pbr most of the time) but non-python projects can rely on those envvars instead if they need to14:49
jeblairkrotscheck: kicking it again now.14:49
*** flepied1 has quit IRC14:49
EmilienMfungi: would it be possible to do like yesterday, to triggent -tarball jobs so we can have tarballs with tags?14:49
EmilienMfungi: after I send a patch to add -tarball jobs of course14:49
fungiEmilienM: yeah, i can trigger one so you can be sure it's working correctly14:49
*** sdake_ has quit IRC14:50
fungiassuming i haven't disappeared to pack and do pre-travel errands14:50
EmilienMnice, thanks14:50
*** skraynev has quit IRC14:51
openstackgerritChris Denneen proposed openstack-infra/jenkins-job-builder: Updated the Build Updater Builder
*** skraynev has joined #openstack-infra14:52
*** ifarkas has quit IRC14:52
openstackgerritChris Denneen proposed openstack-infra/jenkins-job-builder: Add BuildNameUpdater to Builders
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: add -tarball jobs to pre-release and release queues
EmilienMfungi: ^ ready for review14:54
*** abregman is now known as abregman|afk14:55
fungiyolanda: any objection to me doing a #status ok now?14:56
fungilooks like maybe that's what was intended instead of the #status notice14:56
yolandafungi, please do... i was thinking jhesketh already did, sorry14:56
yolandabut yes, was done as a notice14:57
openstackgerritChris Denneen proposed openstack-infra/jenkins-job-builder: Add BuildNameUpdater to Builders
fungi#status ok Log server was repaired as of 10:50 UTC and jobs have been stable since. If necessary, please recheck changes that have 'UNSTABLE' results.14:57
openstackstatusfungi: sending ok14:57
openstackgerritMateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Added nodepool::mysql class
fungii went ahead and approved 309442 since there are no meetings going on at the moment14:58
*** ihrachys has quit IRC14:59
*** agentlew has joined #openstack-infra14:59
*** agentlew is now known as weirdintheatx15:00
-openstackstatus- NOTICE: Log server was repaired as of 10:50 UTC and jobs have been stable since. If necessary, please recheck changes that have 'UNSTABLE' results.15:00
*** esikachev has quit IRC15:00
fungijeblair: 307892 should be safe to approve even if we haven't restarted zuul yet, it looks like? the additions seem to be guarded by conditionals for non-null values anyway15:00
EmilienMfungi: I already prepare the commands:
*** mixos has quit IRC15:01
EmilienMerr, I need to drop the -branch15:01
*** esikachev has joined #openstack-infra15:02
openstackstatusfungi: finished sending ok15:03
openstackgerritMerged openstack-infra/system-config: Add #rdo to meetbot channels
jeblairfungi: i'm not sure what javascript does if it's undefined -- probably just returns null?15:04
*** prad_ has quit IRC15:06
dtantsurfolks, if the jobs are fine now, maybe you could update the topics of all channels?15:06
fungihuh, statusbot seems to be treating the ok as a notice and not fixing channel topics?15:06
fungii wonder if it got restarted15:06
*** zhurong has quit IRC15:07
* fungi sighs at people not remembering not to approve statusbot channel additions while we're in a status alert condition15:07
jeblairinfra-root: ^ don't do that15:08
jeblairAJaeger: ^15:08
fungijeblair: do you happen to have a convenient script handy to clean up channel topics based on scraping the statusbot log?15:08
*** zeih has quit IRC15:08
*** nikhil has quit IRC15:08
jeblairfungi: no, i grep and then emacs the result15:08
*** anteaya has joined #openstack-infra15:09
*** tesseract- has quit IRC15:09
jeblairfungi: i can take care of it15:09
pabelangerjeblair: fungi good to know, I didn't know that15:10
jeblairlow-hanging-fruit: have statusbot save things to disk.15:10
*** sdake has joined #openstack-infra15:10
*** mhickey has quit IRC15:10
fungijeblair: thanks, i'm not sure i have anything handy to pipe hundreds of chanserv commands into irc with. how do you wind up doing that bit? just paste in your client with a delay configured?15:11
*** vhosakot has joined #openstack-infra15:11
fungior small wrapper around the python irc module?15:11
*** nadya has quit IRC15:11
fungijeblair: also, just to confirm, you're okay with me deleting the temporary jeblair-nodepool instance, right?15:12
AJaegerjeblair: oops, sorry ;(15:12
*** piet has joined #openstack-infra15:12
fungii have the delete queued up, just wanted to be sure15:12
jeblairfungi: the delete?15:13
*** bnemec is now known as beekneemech15:13
jeblairfungi: i usually just manually paste 5 at a time.15:13
fungijeblair: also, just to confirm, you're okay with me deleting the temporary jeblair-nodepool instance, right?15:13
fungi(that delete is queued up in my console waiting for confirmation)15:14
jeblairfungi: oh missed that15:14
jeblairfungi: yes15:14
fungicool, done, thanks!15:14
jeblairfungi: you can delete jeblair-nodepool15:14
fungii'm also considering snapshotting the rootfs for the old review.o.o and then deleting that instance since it will free up a solid 30gb of quota15:15
*** newjersey has quit IRC15:17
*** yamamoto has quit IRC15:17
*** yamamoto has joined #openstack-infra15:17
*** mpaolino has quit IRC15:18
*** tonytan4ever has joined #openstack-infra15:18
*** sdake_ has joined #openstack-infra15:19
*** sdake has quit IRC15:19
*** newjersey has joined #openstack-infra15:21
clarkbI am mostly not here today. Need to help prep for week away from home.15:22
clarkbfungi I like that idea15:22
clarkbthe only reason to keep the host is the IP but it has been long enpugh for that15:23
*** newjersey has joined #openstack-infra15:23
*** ChanServ changes topic to ":Discussion of OpenStack Developer and Community Infrastructure | docs | bugs | source | channel logs"15:23
fungioh, also on the two sudo-related job failures we saw last night, i went digging in zuul's logs and it seems like the workers that ran those only ever ran one job apiece so it doesn't seem to be a failure to offline them15:23
fungiback to stumped15:24
*** jaypipes is now known as leakypipes15:24
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs | bugs | source | channel logs"15:25
*** jordanP has quit IRC15:25
*** abregman|afk is now known as abregman15:25
*** openstack has joined #openstack-infra15:27
pabelangerfungi: cool, thanks for the update15:27
*** amotoki has joined #openstack-infra15:27
*** imcsk8|zZz is now known as imcsk815:28
AJaegerthanks, jeblair !15:28
*** mpaolino has joined #openstack-infra15:30
*** mylu has joined #openstack-infra15:30
*** abregman is now known as abregman|afk15:31
*** Jeffrey4l has quit IRC15:33
*** ddieterly has joined #openstack-infra15:34
*** ddieterly is now known as ddieterly[away]15:34
openstackgerritDarragh Bailey proposed openstack-infra/git-review: Refactor Isolated Env to use in unit tests
electrofelixanyone around to look at an earlier git-review patch?
openstackgerritNathan Reller proposed openstack-infra/project-config: Add KMIP Experiment Check to Barbican
pabelangerfixfiles run after unbound elements15:36
pabelangeralso, logs are 2.5M again15:36
electrofelixfixes the tests which break on my machine due to the max pid value exceeding the assumed limit in the existing codebase, which was used for generating the ip addresses15:36
pabelangerI'd also like to know why is empty15:37
electrofelixwaynr zaro: if you get a chance I think and should be merged15:39
*** rfolco has joined #openstack-infra15:39
electrofelixremaining issues with linkchecking will require a new release of sphinx to fix15:39
anteayaclarkb: I hope your packing and preparations go well15:40
*** amotoki has quit IRC15:40
*** mylu has quit IRC15:41
*** yamamoto has quit IRC15:41
AJaegerarmax: can you review as well, please?15:41
*** yamamoto has joined #openstack-infra15:41
*** yamamoto has quit IRC15:41
armaxAJaeger: those are still in the list of neutron deliverable15:42
armaxAJaeger: that’s why I didn’t remove that yet15:42
armaxAJaeger: it as not been a negligence on my part15:42
armaxAJaeger: it doesn’t feel right15:42
*** dizquierdo has quit IRC15:42
AJaegerarmax: having *both* server-release and publish-to-pypi is wrong! Decide which ones you want ;)15:42
*** yamahata has quit IRC15:43
AJaegerarmax: That's independent of neutron stadium or not15:43
armaxAJaeger: yes, let me read through15:43
armaxAJaeger: I am clearly confused15:43
*** mylu has joined #openstack-infra15:43
armaxAJaeger: so this has nothing to do with teh stadium15:43
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Remove puppetlabs-concat pin
AJaegerarmax: nothing with the stadium changes - just repos in it ;)15:43
armaxAJaeger: it’s an error in configuration15:43
armaxso please change commit header and topic15:44
AJaegerarmax: sorry if I confused you. Yes, an error in configuration15:44
pabelangerEmilienM: just +A 309453. I can run your script once jenkins has been updated15:44
armaxAJaeger: I don’t want to associate the two15:44
EmilienMpabelanger: you rocks15:44
*** yamamoto has joined #openstack-infra15:44
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Neutron repos: Remove extra openstack-server-release-jobs
AJaegerarmax: better? ^15:45
* armax looks15:45
waynrzxiiro, electrofelix please be careful not to rely on the parser directly in JJB modules--removing it is one of the major refactors I made in the 2.x patches:
armaxAJaeger: ye15:45
EmilienMpabelanger: so I thought the commands would be
EmilienMpabelanger: but I have a doubt about the pipeline15:45
waynrit's fine to use the registry, just not anything else on the parser object15:45
EmilienMpabelanger: maybe I should s/post/release/ ?15:46
armaxAJaeger: how did that go undetected for some time is beyond me :)15:46
openstackgerritMerged openstack-infra/jenkins-job-builder: Update Urls for redirects and broken
AJaegerarmax: release team added mailiing list announce jobs to *both* templates - and then noticed that announcement went out twice ;)15:46
openstackgerritMerged openstack-infra/jenkins-job-builder: Convert remaining Jenkins wiki URLs to sphinx roles
armaxAJaeger: I see15:47
AJaegerarmax: now there's a check in release testing for this15:47
armaxAJaeger: cool15:47
*** esikachev has quit IRC15:47
AJaegerpabelanger: care to +2 again? I just changed commit message...15:47
openstackgerritMerged openstack-infra/project-config: Remove translations for vendor specific networking-* projects
*** mylu has quit IRC15:49
mordredEmilienM: post is on every merge. release is on tags15:49
*** Nikolay_St has joined #openstack-infra15:50
zxiirowaynr: good to know thanks15:50
EmilienMmordred, pabelanger: ok so I need to update the snippet15:50
EmilienMto use release pipeline15:50
*** mylu has joined #openstack-infra15:50
AJaegerarmax: do you have time to review ihrachys' and as well, please?15:51
openstackgerritTravis Tripp proposed openstack-infra/project-config: Add release notes jobs for searchlight CI
openstackgerritMerged openstack-infra/project-config: puppet: add -tarball jobs to pre-release and release queues
armaxAJaeger: yes, bear with me15:52
AJaegerarmax: take your time ;) Just saw the patches myself...15:52
EmilienMpabelanger: new snippet
pabelangerEmilienM: sure, I'll test with puppet-aodh first15:53
EmilienMmordred, pabelanger: stupid question, I hope the job won't try to create a tag, right?15:53
*** apoorvad has joined #openstack-infra15:53
pabelangerEmilienM: need to look at the job15:53
mordredEmilienM: no, release pipeline jobs run in reaction to a tag15:53
EmilienMmordred: ok, cool thanks for confirming15:54
*** rfolco has quit IRC15:55
*** ddieterly[away] is now known as ddieterly15:55
*** amotoki has joined #openstack-infra15:55
mpaolinoHello guys, I created a new project in openstack (the git repo is ready as far as I can tell)15:56
*** binbincong has quit IRC15:56
*** bpokorny has joined #openstack-infra15:56
mpaolinoand now I need to get added as a member of these groups
*** vincentll has quit IRC15:56
mpaolinois there anyone around that can do that for me?15:56
* mpaolino is looking for admins15:57
*** Goneri has quit IRC15:57
*** scheuran has quit IRC15:58
*** binbincong has joined #openstack-infra15:58
*** arxcruz has quit IRC16:00
openstackgerrityolanda.robla proposed openstack-infra/project-config: Add more experimental jobs to shade+magnum
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Allow lists of boards and worklists to be paged
openstackgerritRyo Tagami proposed openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration
*** lakshmiS has joined #openstack-infra16:01
openstackgerritAdam Coldrick proposed openstack-infra/storyboard: Allow lists of boards and worklists to be paged
AJaegeryolanda: what fun with all those magnum+shade changes ;(16:02
fungimpaolino: i was about to try, but you seem to have multiple gerrit accounts so it won't allow me to select one to add to those groups. we'll need an infra-root admin to have time to work with you to combine/clean up that situation first16:02
fungii would, but i'm about to dash out and run some errands. i might be able to find time to help with it later today though16:02
mpaolinofungi, ok thanks16:02
* fungi -> afk for an hour or so16:03
*** jlanoux has quit IRC16:03
*** jistr has quit IRC16:04
*** salv-orlando has joined #openstack-infra16:05
anteayafungi: enjoy errands16:05
*** salv-orlando has quit IRC16:05
krotscheckjeblair: Thanks :)16:05
krotscheckAlso, finally pssed :)16:06
*** salv-orlando has joined #openstack-infra16:06
*** salv-orlando has quit IRC16:06
*** abregman|afk has quit IRC16:06
*** mpaolino has quit IRC16:06
*** davideagnello has joined #openstack-infra16:06
*** salv-orlando has joined #openstack-infra16:06
*** pblaho has quit IRC16:06
*** sdake_ has quit IRC16:07
*** bbroad has joined #openstack-infra16:08
*** flepied1 has joined #openstack-infra16:08
*** flepied has quit IRC16:08
electrofelixwaynr: but you are making access to the registry available otherwise right?16:09
electrofelixfor plugin info?16:09
*** bbroad is now known as saucybood16:09
*** Guest83836 has quit IRC16:10
*** rfolco has joined #openstack-infra16:11
electrofelixwaynr: just checking, and that's exactly what you're doing, so any usage we're adding is just to get to the plugin info, which will just require a change from using parser.registery.get_plugin_info() to registery.get_plugin_info()16:11
AJaegerarmax: one more question: I updated your change - could you check it, please?16:12
*** doug-fis_ has quit IRC16:13
*** kjorgensen has joined #openstack-infra16:15
*** pradk has quit IRC16:16
*** yamahata has joined #openstack-infra16:16
*** tonytan4_ has joined #openstack-infra16:16
*** tphummel has joined #openstack-infra16:16
*** doug-fis_ has joined #openstack-infra16:17
*** rfolco has quit IRC16:17
*** elo has quit IRC16:18
*** elo has joined #openstack-infra16:18
*** armax has quit IRC16:18
jeblairReleased volume mirror.npm successfully16:19
jeblairreal    21m13.753s16:19
jeblairkrotscheck: ^16:19
*** armax has joined #openstack-infra16:19
krotscheckjeblair: So we're basically synchronized!16:19
*** tosky has quit IRC16:19
krotscheckMore or less ;)16:19
*** rcernin has quit IRC16:19
jeblairkrotscheck: i'd say so16:19
*** tonytan4ever has quit IRC16:19
jeblairkicking it again now16:20
krotscheckjeblair: Ok, I'm going to go run a series of patches that warm up the slave scripts, while we wait for to land.16:20
krotscheck(You can do that manually though if you want to)16:20
krotscheckWarm up the slave mirrors I mean16:21
*** nwkarsten has quit IRC16:21
krotscheckUgh, sorry, two things.16:21
krotscheckI will go warm up the caches.16:21
*** nwkarsten has joined #openstack-infra16:21
krotscheckYou could manually do what that patch does to make sure it works - i.e. `npm install -g openstack-registry-hooks@1.0.1`, and then run the command in
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstackci: Use our custom pip provider for keyring package
*** tonytan4ever has joined #openstack-infra16:22
*** schipiga has quit IRC16:23
*** cschwede has quit IRC16:23
*** tonytan4_ has quit IRC16:23
mordredkrotscheck: all hail the new npm mirrors!!!16:24
krotscheckmordred: \o/16:25
krotscheckThough, looks like there's some hiccups.16:25
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstackci: Use our custom pip provider for keyring package
krotscheckNPM is having a hard time resolving packages with versions like shelljs-0.0.1alpha1.tgz16:26
*** nwkarsten has quit IRC16:26
krotscheckAsk me why someone's depending on an alpha version16:26
mordredkrotscheck: because they hate bunnies16:26
*** doug-fis_ has quit IRC16:27
krotscheckmordred: Aaaahhh so this is a thing->
mordredkrotscheck: ah - at least there is a fix16:29
krotscheckmordred: Yes. Well, I hope. It may be a manual editing of some of the packages.16:30
mordredkrotscheck: sounds like we should make sure we've updated our registry-static, then clear our caches then potentially run a script to sanitize existing things?16:30
*** pradk has joined #openstack-infra16:30
krotscheckmordred: It shouldn't happen going forward.16:30
mordredlucky us that we built ours right before this :)16:30
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: Add streaming console support
*** roxanaghe has joined #openstack-infra16:31
*** madhu_ak has joined #openstack-infra16:31
*** piet has quit IRC16:34
*** tlbr has quit IRC16:35
*** tlbr has joined #openstack-infra16:36
*** esker has quit IRC16:39
*** gyee has joined #openstack-infra16:39
*** piet has joined #openstack-infra16:39
*** esker has joined #openstack-infra16:39
*** nikhil has joined #openstack-infra16:40
openstackgerritMerged openstack-infra/project-config: Disable gate-tempest-dsvm-neutron-multinode-full for kilo
*** cschwede has joined #openstack-infra16:43
*** esikachev has joined #openstack-infra16:43
*** derekh has quit IRC16:43
*** abregman|afk has joined #openstack-infra16:47
*** gordc has quit IRC16:48
*** abregman|afk has quit IRC16:49
*** abregman|afk has joined #openstack-infra16:49
*** saucybood has quit IRC16:54
krotscheckmordred: Apparently not, version2.2.0 is the most recent version16:55
krotscheckI think it fixed things with 0.0.0-[a-z]+, but not with 0.0.0-[a-z0-9] things16:55
krotscheckmordred: I'm building a full list of impacted packages, but find on afs is slow.16:55
mordredkrotscheck: yah. also, it's a very big volume16:55
krotscheckmordred: That too.16:56
*** bpokorny has quit IRC16:57
openstackgerritMatthew J Black proposed openstack-infra/project-config: Added archiving of puppet run log.
*** sridhar_ram has joined #openstack-infra17:00
*** mjblack has joined #openstack-infra17:00
electrofelixzxiiro waynr zaro: how do you feel about abandoning the patches for JJB where they have been superseded? I'm planning to start going through and rebasing  anything with touch ups where it's a minor tweak required and was going to abandon anything I come across that is definitely already done through another patch17:01
odyssey4meI'm not sure if this is intentional, but it would appear that generate-constraints has not run for Liberty since Dec 13? Well, that's when the last commit from the generator job merged.17:01
odyssey4meIs that supposed to be the case? If so, why is that?17:01
*** e0ne has quit IRC17:02
*** degorenko is now known as _degorenko|afk17:03
*** lucasagomes is now known as lucas-dinner17:03
clarkbodyssey4me: the stable team has decided not to update constraints on stable branches17:03
*** rossella_s has quit IRC17:04
openstackgerritMadhusudhan Kandadai proposed openstack-infra/project-config: Add Barbican and client to Octavia PROJECTS
zxiiroelectrofelix: +1 if it's already implemented we should abandon it. or if there's a better patch elsewhere17:04
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Add trigger for RabbitMQ trigger module
*** rossella_s has joined #openstack-infra17:04
*** pvaneck has joined #openstack-infra17:05
odyssey4meclarkb ah, so in-effect the upper-constraints act as a freeze unless there is a specific reason to change the constraint, and that's done by a human17:05
*** fhubik has quit IRC17:05
openstackgerritRichard Theis proposed openstack-infra/project-config: Add neutronclient to osc-plugin-jobs
clarkbodyssey4me: yup17:06
*** nadya has joined #openstack-infra17:06
odyssey4meclarkb ah ok, that does make some sense - thanks17:07
*** dahoo has joined #openstack-infra17:08
*** amotoki has quit IRC17:09
*** johnny_ has joined #openstack-infra17:09
yolandaAJaeger, so about magnum+shade, it will need more investigation. The experimental job i created passed properly, but seems it's causing some failures, maybe timeouts, but cannot tell. So we talked about adding more coverage on the experimental jobs and set the tests thee for some time before moving to check and gate17:09
electrofelixzxiiro: any idea why we didn't merge ?17:10
yolandathe errors on the tests were a bit random, and not related to magnum plugin, at least on first sight. But maybe they caused some timeouts17:10
*** pvaneck has quit IRC17:10
*** pvaneck has joined #openstack-infra17:11
*** rkukura_ has joined #openstack-infra17:11
electrofelixzxiiro: think should be good to merge17:11
electrofelixgoing to approve it's dependency17:11
zxiiroelectrofelix no, you mentioned another patch but forgot to link it so I don't have any insight17:11
electrofelixzxiiro: I'm using the newer view so I see it appear automatically as a 'Related Change'17:12
electrofelixsorry about that, I'll have to remember to explicitly link patches.17:12
*** ddieterly is now known as ddieterly[away]17:12
*** bexelbie has quit IRC17:12
electrofelixzxiiro: was the subsequent patch17:12
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: support ftp publisher
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: run shell builders defined in JJB
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: support zuul stop commands
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: register jobs from JJB
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add ansible launch server
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: send ZMQ start/complete events
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: add zuul_runner module
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: Add streaming console support
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: run ansible
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: support job timeouts
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: support scp publisher
*** rkukura has quit IRC17:13
*** bmjen has quit IRC17:13
*** rkukura_ is now known as rkukura17:13
jeblairclarkb, fungi, mordred: ^ that stack is ready.17:13
*** sflanigan has quit IRC17:13
*** bodepd_ has quit IRC17:13
*** mikal has quit IRC17:13
*** mattoliverau has quit IRC17:13
fungiinfra-root: i've powered down and snapshotted the former review.o.o (2001:4800:7818:102:be76:4eff:fe05:9b12, as "old-30gb-review-server" and then deleted the instance. i also deleted the unused cinder volume we intentionally left behind during the migration to the new server17:14
*** matt6434 has joined #openstack-infra17:14
openstackgerritJames E. Blair proposed openstack-infra/zuul: Ansible launcher: add streaming console support
*** mrunge has quit IRC17:14
fungii _believe_ that's all the pending cleanup from the maintenance17:14
*** mikal has joined #openstack-infra17:15
fungijeblair: i for one welcome our new jenkinsless overlords17:15
electrofelixzxiiro: think might be good to go, bit of an oldie that one ;)17:15
jeblairclarkb, fungi, mordred: in general, i think it implements all of the features we need.  i've tested it with some basic configuration, and the last patch adds *telnet based* streaming log support :)17:16
fungia proper protocol17:16
*** ddieterly[away] is now known as ddieterly17:16
electrofelixwaynr: if you get a chance I think and are ok to land.17:16
jeblairso "nc worker 8080|grep something" works :)17:16
funginone of this gopher^H^H^H^H^H^Hhypertext nonsense17:16
jeblairer 808817:17
fungiis it 8-bit safe? ;)17:17
jeblairi think it's 64-bit safe17:17
EmilienMI'm still seing some error about puppet rpm,
*** SumitNaiksatam has quit IRC17:18
EmilienMis centos-7-rax-iad up to date?17:18
*** niska has quit IRC17:18
EmilienMwell, it's happening on stable/liberty branch, maybe I'm missing a backport somewhere17:19
*** bmjen has joined #openstack-infra17:19
*** dtantsur is now known as dtantsur|afk17:19
openstackgerritMerged openstack-infra/project-config: Add more experimental jobs to shade+magnum
*** mrunge has joined #openstack-infra17:19
*** niska has joined #openstack-infra17:19
*** bexelbie has joined #openstack-infra17:20
pabelangerEmilienM: yes, new images were uploaded last night17:20
EmilienMmhh ok, I'm investigating then17:20
AJaegerarmax: I cannot separate the changes, the macro removal in jenkins/jobs/projects.yaml means that I need to do this together.17:20
*** nadya has quit IRC17:20
*** sflanigan has joined #openstack-infra17:20
armaxAJaeger: ok17:20
*** HeOS has quit IRC17:20
*** keedya has quit IRC17:20
AJaegerarmax: sorry, misread your comment - will update17:21
armaxAJaeger: how long does it take for the ACL change to take effect17:21
armaxAJaeger: slight different topic17:21
EmilienMpabelanger: did you already trigger puppet-aodh-tarball job?17:21
AJaegerarmax: when did it merge?17:21
pabelangerEmilienM: no, I am manually updating JJB17:21
armax6-8 hours ago17:21
AJaegerarmax: you can always check directly in review.openstack.org17:21
EmilienMpabelanger: oh ok17:22
*** keedya has joined #openstack-infra17:22
AJaegerarmax: then it should be effective - if not, it's a bug ;)17:22
*** mylu has quit IRC17:22
krotscheckmordred: Ah, I think it's a rewrite problem.17:22
*** bodepd has joined #openstack-infra17:22
openstackgerritIan Cordasco proposed openstack/requirements: Allow hacking 0.11 to be used
armaxAJaeger: no I was curious if it was immediate, or if there’s a a bit of a lg17:22
armaxAJaeger: I can see the ACLs have actually changed17:23
armaxright now I mean17:23
waynrelectrofelix: +1 on abandoning superceded patches17:24
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove publisher site for vendor specific networking-* projects
*** amotoki has joined #openstack-infra17:24
AJaegerarmax: for most things we have a lack of puppet run - and puppet runs every 30mins, so my rule of thumb is: 1h after merge any project-config change is active17:25
armaxAJaeger: ack, thanks17:25
AJaegerarmax: fixed 308033, please double check again17:25
armaxAJaeger: thanks!17:25
*** tonytan4ever has quit IRC17:25
fungiif mpaolino comes back, i've glimpsed their gerrit account details in the db and it's not clear to me how to unwind the duplication. both have contact info filed on dates, different usernames, et cetera17:26
fungisome compromise will likely be involved17:26
openstackgerritMerged openstack-infra/jenkins-job-builder: Tidy up True/False and use better exceptions
fungithere are ssh keys for both accounts too17:27
*** lezbar__ has quit IRC17:27
*** lezbar has joined #openstack-infra17:28
*** amotoki has quit IRC17:28
*** mylu has joined #openstack-infra17:29
*** kzaitsev_mb has joined #openstack-infra17:29
AJaegerpabelanger, yolanda : Could you review again, please? That's armax' change that I updated...17:29
*** mylu has quit IRC17:31
*** mylu has joined #openstack-infra17:32
*** lezbar has quit IRC17:32
*** armax has left #openstack-infra17:32
anteayafungi: ack17:33
electrofelixwaynr: ack :-)17:34
*** r-mibu has quit IRC17:34
*** mylu has quit IRC17:34
*** r-mibu has joined #openstack-infra17:34
*** bbroad has joined #openstack-infra17:37
*** chuck__ is now known as zul17:37
AJaegerany other project-config core around that can review - the Neutron Stadium Redux, please? That way we should have all the changes in for this before the summit...17:37
*** esikachev has quit IRC17:38
fungiinfra-root: while looking through cinder volumes we have in rackspace, i see several unattached ones i'm pretty sure are cruft left behind from server replacements. i'd like to delete them if someone can confirm:,,
*** ybathia has joined #openstack-infra17:38
jeblairfungi: those both seem reasonable to delete to me17:39
fungii recall discussing the nodepool ssd volume with clarkb and am 99% sure it can go. i expect the ones are from the old pypi mirror servers we deleted too17:39
fungialso that one was pypi.ord not i blame finger memory17:39
jeblairor, all 3 even17:39
*** bpokorny has joined #openstack-infra17:40
fungioh, there's one more17:40
openstackgerritMerged openstack-infra/project-config: Neutron repos: Remove extra openstack-server-release-jobs
nibalizerfungi: i wondered the same then when I was creating new cinder volumes17:40 is unattached17:40
nibalizeri can't see how deleting an unattached volume would pose any problem17:41
fungiwas there a plan to add a fileserver in iad which never got completed?17:41
*** Swami has joined #openstack-infra17:41
fungidfw and ord have two each which are attached, so not sure what the deal was with this unattached one in iad17:41
openstackgerritTravis Tripp proposed openstack-infra/project-config: Remove openstack-server-release-jobs from searchlight-ui
nibalizerclarkb: we're now initializing 2 shards17:43
nibalizerso its getting worse not better :/17:43
*** tqtran has joined #openstack-infra17:43
*** ddieterly is now known as ddieterly[away]17:43
funginibalizer: though the logstash job queue isn't backed up at least17:43
*** ybathia has quit IRC17:44
anteayafungi: I am not aware of any discussion around a plan to add a fileserver in iad17:45
AJaegerthanks, anteaya for reviewing and interpreting my english ;)17:46
anteayayou're welcome :)17:46
*** nwkarsten has joined #openstack-infra17:47
*** nwkarsten has quit IRC17:47
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: cloudkitty-dashboard: Remove extra openstack-server-release-jobs
*** nwkarsten has joined #openstack-infra17:48
*** mriedem1 has joined #openstack-infra17:49
*** pkoniszewski_ has joined #openstack-infra17:49
*** pkoniszewski has quit IRC17:49
*** mriedem has quit IRC17:51
*** megm has quit IRC17:52
*** pkoniszewski_ is now known as pkoniszewski17:52
openstackgerritMerged openstack-infra/project-config: Remove publisher site for vendor specific networking-* projects
*** aimeeU has quit IRC17:53
openstackgerritEmilien Macchi proposed openstack-infra/project-config: puppet: add missing builder for lint jobs
openstackgerritMadhusudhan Kandadai proposed openstack-infra/project-config: Add Barbican and client to Octavia PROJECTS
EmilienMAJaeger, pabelanger: I missed that one, required to install dependencies for puppet-lint jobs ^17:54
jeblairfungi: re iad, that must be the case. mordred ?17:55
jeblairfungi: we certainly don't have a fs there now.17:55
*** sputnik13 has joined #openstack-infra17:55
*** sdake has joined #openstack-infra17:56
*** megm has joined #openstack-infra17:56
EmilienMpabelanger: did you run something alreadu? We now have - it seems wrong to me, we're missing the tag, isn't?17:56
pabelangerEmilienM: Ya, I just ran it, looking at logs17:58
*** ybathia has joined #openstack-infra17:58
*** ddieterly[away] is now known as ddieterly18:00
*** sridhar_ram has quit IRC18:01
pabelangerEmilienM: I re-ran it since i didn't see in on status.o.o/zuul18:01
EmilienMpabelanger: I updated the paste, I missed puppet-keystone when fungi did the branches and master
*** armax has joined #openstack-infra18:01
EmilienMpabelanger: ok18:01
pabelangerEmilienM: first run18:02
EmilienMdang, a typo again18:02
EmilienMlet's use etherpad18:02
*** sridhar_ram has joined #openstack-infra18:02
pabelangerEmilienM: refresh18:03
pabelangerEmilienM: worked that time18:03
pabelangerEmilienM: I suspect it was using an old JJB template18:03
EmilienMpabelanger: do you have permissions to rm puppet-aodh-tarball.tar.gz file?18:03
pabelangerwill wait until all masters are updated18:03
pabelangerEmilienM: yes, I can18:04
*** lezbar has joined #openstack-infra18:04
pabelangerEmilienM: removed18:04
*** mylu has joined #openstack-infra18:04
pabelangerwaiting on jenkins01 / jenkins0218:05
pabelangerthen I can run the script18:05
EmilienMpabelanger: the etherpad looks good to me now18:05
*** ybathia has quit IRC18:06
pabelangerEmilienM: okay, will use that18:06
anteayaclarkb: thank you for updating:
*** MarkAtwood has quit IRC18:10
*** doug-fish has joined #openstack-infra18:10
*** alex_xu has quit IRC18:12
*** pcrews has quit IRC18:14
*** trown is now known as trown|lunch18:15
*** alex_xu has joined #openstack-infra18:15
*** SlickNik has quit IRC18:16
*** spiffxp_ has joined #openstack-infra18:17
*** spiffxp has quit IRC18:17
*** SlickNik has joined #openstack-infra18:17
*** pcrews has joined #openstack-infra18:17
*** vipuls has joined #openstack-infra18:18
*** vipul has quit IRC18:18
*** larainema has quit IRC18:19
krotscheckmordred: Wanna see something funny?
AJaegerjust had a git timeout on rax-iad ;(18:19
fungiAJaeger: yep, we're seeing proportionally more in ord than dfw or iad since turning it back on though, even when accounting for relative quotas in those regions18:21
fungii'm in the process of putting together a set of new examples with instance uuids and logs showing broken traceroutes for the rackspace noc18:22
anteayaI reached the part in backscroll where you notice zuul is still memory leaky, fungi:
mordredkrotscheck: nice18:22
anteayalooks like we started into swap 18 hours ago18:22
mordredkrotscheck: I mean, funny is a word18:22
krotscheckmordred: So that's our problem.18:22
anteayahave we discussed a zuul restart plan yet?18:23
mordredkrotscheck: I'm not sure it's the word I'd use here - but it's a word :)18:23
fungianteaya: yep, it's not currently running with anything patched out so it's expected to be leaking memory again18:23
*** sridhar_ram has quit IRC18:23
krotscheckmordred: We're mirroring the thing we're supposed to mirror, but it turns out the thing we're mirroring is wrong.18:23
AJaegerfungi, do you wnat the log?18:23
fungiAJaeger: nah, logstash has it18:23
krotscheckmordred: Yeah.... waiting on some response from npm.18:23
mordredkrotscheck: what's a skimdb?18:23
AJaegerfungi: Ah, ok! Then I'll just recheck ;)18:23
fungianteaya: i was about to propose a zuul restart once the post and check-tripleo pipelines clear out a little18:23
anteayafungi: ah okay, so do we have a path forward? restart, let it continue in swap, something else?18:23
anteayafungi: ah thank you, good idea18:24
krotscheckmordred: They've deprecated their "Couchdb with all the attachments". skimdb is their "Couchdb with pointers to their packages on CDN"18:24
fungianteaya: though more so that we have the status.json patch in place to be able to go forward with linking job results on the logserver18:24
mordredkrotscheck: ah18:24
anteayafungi: I don't entirely parse you last statement, but I believe it has something to do with the logging issues that had been the channel topic earlier18:25
fungianteaya: the fact that right now the zuul status page is linking to unreachable console logs on jenkins masters we've firewalled off from teh internet18:25
fungianteaya: a change merged to link completed jobs to the logserver instead18:26
anteayaoh wonderful18:26
anteayayay whoever made that happen18:26
AJaegerfungi: I think it's not linking to jenkins anymore - but the new links are still a great idea ;918:26
krotscheckmordred: So we've got two options. mirror the master registry instead, which will basically mean starting over.18:26
krotscheckmordred: Or wait for npm to fix things.18:27
krotscheckassuming they fix things18:27
fungiwell, actually the change that merged is including the data needed to link to the logserver, but there's a separate change waiting to be merged that acrually creates the links18:27
mordredkrotscheck: if we mirror the master register, we can't use any of the ... oh, remirroring would mean couchdb woldn't it?18:27
fungithe latter change is pending a zuul restart with the former though18:27
mordredlike, that's the reason it would be a do-over18:28
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Add a "list" subcommand
krotscheckmordred: naah. We'd blow away the /mirror/npm/-/ directory, update the config, but I'm not certain the mirroring package will check for existing files before downloading new ones.18:29
mordredkrotscheck: seems prudent to wait a bit for a fix :)18:30
krotscheckmordred: I agree.18:30
krotscheckmordred: I'll see if I can get a "yes/no" from npm in a reasonable time.18:30
AJaegersdake: is your -1 still valid on ?18:34
AJaegerpabelanger: I suggest you self-approve 301320 if you have time and sdake is happy..18:35
pabelangerAJaeger: Yup, just waiting on kolla to finish up. Won't be publishing until +1 from sdake18:36
sdakepabelanger your good to go18:37
sdakeletme review18:37
sdakewe just tagged 2.0.018:37
sdakeso we can handle some breakage in our repos18:37
pabelangersdake: thanks! I'll start on it in the next few hours18:37
sdakei've got a bug id for you to use18:37
pabelangergoing to finishing puppet tarballs for EmilienM first18:38
*** ayoung has quit IRC18:38
sdakeoh this isn't for our repo18:38
sdakedidn't you need to make changes for tox.ini?18:38
sdakelet me review then and i'll ack :)18:38
pabelangerit should all work once we migrate18:38
pabelangerand will confirm it does18:38
sdakeif not its not the end of th eworld18:38
sdakewe can fix it over the next weeke or two18:39
sdakei expect the core team to go into hibernation for 2-3 weeks :)18:39
pabelangerYa, I don't want to leave it in a broken state. That said, confident we tested things well18:39
anteayaAJaeger: I just wanted to say thank you for:
anteayaAJaeger: I appreciate it18:41
*** ddieterly is now known as ddieterly[away]18:42
*** lezbar has quit IRC18:42
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Add `browse` command
jeblairReleased volume mirror.npm successfully18:44
jeblairreal    2m5.404s18:44
jeblairReleased volume mirror.npm successfully18:44
jeblairreal    2m5.404s18:44
jeblairkrotscheck: ^18:44
jeblairreally really caught up now :)18:44
pleia2I'm mostly out today, packing and running pre-travel errands18:46
pleia2pabelanger: but feel free to ping if you toss up another presentation revision18:46
*** dstanek has quit IRC18:46
pabelangerpleia2: Yup, I plan to finish it up this evening18:47
*** dstanek has joined #openstack-infra18:47
docaedopleia2 pabelanger: I have some notes on a few things but haven't had major changes, figured I could save my little stuff 'till Sunday18:47
jeblairfungi: i approved 281166, which is the (theoretical) memory leak fix.  so we can just restart onto head if it merges first.18:47
pabelangerjeblair: pleia2: for your lighting talks how many pages are you using for your presentations?18:47
pabelangerdocaedo: ack18:48
fungijeblair: oh, i missed that one. sounds good. i agree with holding off with a restart until that lands18:48
jeblairpabelanger: i was planning on doing a live demo18:48
openstackgerritChris St. Pierre proposed openstack/python-jenkins: Fetch all builds from a job
jeblairfungi: it's the thing we ran with manually cherry-picked for a while18:48
pabelangerjeblair: k18:48
jeblairfungi: (it's not actually a revert, it's a sort-of-fix)18:48
fungijeblair: got it. thanks18:48
*** flepied has joined #openstack-infra18:48
pleia2oh gosh, I forgot about the lightning talk, thingee asked me about it weeks ago but I didn't hear anything back18:49
*** flepied1 has quit IRC18:49
pleia2but I'm just going to bring up status.o.o and click on things "this is this, this is that"18:49
sdakepabelanger acked that change18:49
fungipleia2: something to write on the plane ;)18:49
* fungi guesses sfo->aus is quick18:49
sdakeAJaeger i assume yu llooked it over to make sure the syntax was correct  - there were changes in our our actions were run which I don't totally understand18:49
pabelangerpleia2: Ya, me neither I checked and seen the updated list18:49
pabelangersdake: thanks18:49
pleia2pabelanger: haha, well then!18:50
*** larainema has joined #openstack-infra18:50
openstackgerritMerged openstack-infra/zuul: Don't reload connections on HUP
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Convert jclouds example to unit test
*** kgalanov has quit IRC18:54
*** fmccrthy has quit IRC18:54
*** jaranovich has quit IRC18:54
*** auggy has quit IRC18:54
*** kozhukalov has quit IRC18:54
AJaegersdake: the syntax looks fine. I expect that pabelanger is around once this merges - if we nevertheless break everything, we should be able to revert quickly.18:54
*** zz_ja has quit IRC18:54
sdakeor fix in case of tox needed changes to our repo18:54
*** zxiiro has quit IRC18:55
*** Nikolay_St has quit IRC18:55
AJaegerpleia2, pabelanger : Looking at that summit schedule, I need to change my name or look for my female twin ;)18:55
sdakeAJaeger coool thx18:56
*** jpmaxman_ has joined #openstack-infra18:56
pleia2AJaeger: doh :)18:56
*** IlyaG has joined #openstack-infra18:56
*** kgalanov has joined #openstack-infra18:57
*** fmccrthy has joined #openstack-infra18:57
*** jpmaxman has quit IRC18:57
*** jpmaxman_ is now known as jpmaxman18:57
*** jaranovich has joined #openstack-infra18:58
*** mylu has quit IRC18:58
fungisomeone left out an s?18:58
*** mriedem1 is now known as mriedem18:59
AJaegerfungi, yeah...18:59
*** auggy has joined #openstack-infra18:59
*** IlyaG has quit IRC19:00
* AJaeger will still show up ;)19:00
fungia wig can be provided if necessary19:00
*** sdake_ has joined #openstack-infra19:00
*** zz_ja has joined #openstack-infra19:00
*** kozhukalov has joined #openstack-infra19:01
*** madhu_ak has quit IRC19:02
*** doug-fish has quit IRC19:02
*** sdake has quit IRC19:03
*** inc0 has quit IRC19:03
anteayaAJaeger: you are double booked?19:03
*** inc0 has joined #openstack-infra19:04
*** mylu has joined #openstack-infra19:04
*** zxiiro has joined #openstack-infra19:05
krotscheckjeblair: Awesome. Did you see my conversation with mordred?19:05
krotscheckjeblair: We may have been mirroring the wrong thing.19:05
krotscheckNote, we were mirroring the thing they told us to mirror.19:06
*** bpokorny has quit IRC19:06
krotscheckBut, well, it was the wrong thing.19:06
*** lezbar has joined #openstack-infra19:06
AJaegeranteaya: no, not double booked, just misspelled ;)19:06
anteayamisspelled is an easier recovery19:06
AJaegeryeah, something I can ignore ;)19:07
*** newjersey has quit IRC19:08
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Refactor delete_jobs
anteayaAJaeger: or embrace19:09
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Refactor delete_jobs
*** lezbar has quit IRC19:09
*** eil397 has joined #openstack-infra19:09
anteayafungi: ack
AJaegeranteaya: let's see whether I get an inspiration to embrace it ;)19:10
anteayalisten to some Prince, or the late artist formerly known as19:11
anteayahe seemed to figure out how to be comfy with it19:11
*** piet has quit IRC19:11
mtreinishfungi, pabelanger: looks like everything is finally working:
anteayamtreinish: yay19:12
*** kzaitsev_mb has quit IRC19:13
mtreinishnow to setup the proxy from status.o.o/openstack-health19:13
*** piet has joined #openstack-infra19:14
jeblairkrotscheck: oh, neat.19:14
krotscheckjeblair: IKR19:15
*** inc0 has quit IRC19:17
*** inc0 has joined #openstack-infra19:18
*** Sukhdev has joined #openstack-infra19:18
waynrelectrofelix: you mentioned yesterday, but I already gave that +219:19
*** madhu_ak has joined #openstack-infra19:20
electrofelixwaynr: oops, sorry, must have meant to ask Thanh19:20
electrofelixI think the only question on that one was really whether we're happy with the option naming in the conf file.19:20
*** doug-fish has joined #openstack-infra19:21
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Translations: Publish pot files to tarballs.o.o
*** inc0 has quit IRC19:21
*** zz_ja has quit IRC19:21
waynralso adds to my conviction that YAML is the wrong thing to be using for defining jenkins jobs19:22
*** doug-fish has quit IRC19:22
*** doug-fish has joined #openstack-infra19:22
waynrbut since we are stuck with YAML I guess something like this is necessary19:23
clarkbwhat would you use instead?19:23
zxiiroelectrofelix: looking now19:24
fungiwaynr: out of curiosity, how would it be handled when editing raw xml?19:24
fungijust wondering what other representations out there are superior19:24
*** inc0 has joined #openstack-infra19:24
EmilienMpabelanger: I see puppet-keystone post job did not create the tarball, have you seen logs already?19:24
*** zz_ja has joined #openstack-infra19:24
clarkbbtw you don't need special magic to do what electrofelix wants in yaml19:24
EmilienMoh I found them
clarkbpretty sure I had to explain to someone once how to do a large list of things19:25
clarkbbut its been a while19:25
EmilienMpabelanger: sounds related to puppet-keystone/metadata.json19:25
waynrfungi: the obvious way to represent jenkins configuration to me is using Python code:
*** piet has quit IRC19:25
clarkbelectrofelix: waynr ya just us ea literal string...19:25
clarkbI don't think that feature is necesary19:25
fungi<value>OptionA,OptionB,OptionC</value> looks easy enough to represent in yaml19:25
electrofelixclarkb: there is a python 2 compatible way within yaml to reference the string module, but not with python 319:25
clarkbelectrofelix: one second19:26
clarkbelectrofelix: it is in yaml itself so python shouldn't matter19:26
fungi(taken from the example xml included in the change)19:26
clarkbelectrofelix: I do not htink we should merge that change19:26
jeblairthis seems user hostile.  the point of jjb is to make this easy for users.  that means lists of things should be yaml lists, and jenkins jobs modules should translate them into the format necessary.19:26
electrofelixI don't think there is a yaml way to join a list of items to return a string19:26
openstackgerritMerged openstack-infra/tripleo-ci: Clean up cached objects after use
clarkbelectrofelix: there sort of is, I am writing it up right now19:27
*** sridhar_ram has joined #openstack-infra19:27
fungiyou can use wrapped string values19:27
fungiyeah, that19:27
*** trown|lunch is now known as trown19:28
electrofelixclarkb: does that leave spaces19:28
electrofelixas well?19:28
clarkbelectrofelix: it replaces the newlines with a single space iirc19:28
electrofelixyeah, thats a problem19:28
electrofelixneeds to be no spaces19:28
clarkbthen use a real list19:28
fungii thought there was a yaml construct to wrap without spaces19:28
jeblairelectrofelix: what's wrong with having input be a list and then translate it in the jjb module?19:29
electrofelixyou need ever jjb module to do the same and support multiple delimiters depending on what the plugin supports.19:29
waynrtranslating the list in the jjb module is how we have done it in the past19:29
clarkbya but your users shouldn't have to know how the plugin works19:29
clarkbthat is jjb's job19:29
jeblairelectrofelix: right, the delimeter is specific to the plugin, which is why that's the right place to put that19:30
zxiiroelectrofelix: looks good to me. Should I workflow +1 it or did you want to keep discussing it?19:30
jeblairmoreover, they specifically shouldn't need to know the delimeter the plugin uses for its on-disk representation of the job19:30
electrofelixexcept there is usually multiple choice depending19:30
zxiiroelectrofelix: gave my +2 already19:30
electrofelixi.e. you have 2 or 3 delimiters19:30
jeblairelectrofelix: how would a user choose?19:30
pabelangerEmilienM: back, going to be starting shortly19:30
EmilienMI'm debugging19:31
*** zz_ja has quit IRC19:31
clarkbjeblair: there is an example in the change, you basically have to know the crazy syntax, I don't like it at all19:31
*** mylu has quit IRC19:31
clarkbyaml can represent lists, we should use them19:31
pabelangerEmilienM: okay, issue with keystone I guess19:31
electrofelixthey couldn't unless the module had a special option, where as you can use the yaml tag and say, if you really, really want to split the string into a list instead of leaving it as a string, then you can do it19:31
EmilienMpabelanger: yeah but I don't find what in metadata.json19:32
pabelangerEmilienM: could have been an old JJB template19:32
jeblairelectrofelix: i don't understand why a plugin can't just pick, say "," and do ','.join(list) on the yaml list passed as input19:32
clarkbyes confirmed it replaces newlines with a single space19:32
EmilienMpabelanger: no, I reproduced locally19:32
pabelangerEmilienM: okay19:33
EmilienMcrinkle: have you already seen that error?
electrofelixjeblair: sometimes items use ',' as valid input which is why they need to switch to spaces19:33
pabelangerEmilienM: holding off for now19:33
*** zz_ja has joined #openstack-infra19:33
EmilienMpabelanger: sure, ttyl19:33
electrofelixso the list is reall '1,2,3 4,5,6 7,8,9' where 1,2,3 is an item19:34
EmilienMsomething is messing up in
jeblairelectrofelix: then that plugin could just always use spaces, right?  or if it needs to decide, the module could know that and perform the selection automatically?19:34
jeblairelectrofelix: yeah, so the user could express that clearly in yaml with ['1,2,3', '4,5,6'] and the jjb module could ' '.join(that)19:34
electrofelixand then the inverse can also be true ['1 2 3', '3 4 5'] where it should be joined on a comma19:35
electrofelixfor the same plugin19:35
electrofelixhence two delimiters19:35
*** Goneri has joined #openstack-infra19:36
fungiseems like a dysfunctional plugin. how does it know whether you're providing space-delimited lists containing commas, or comma-delimited lists containing spaces?19:36
jeblairelectrofelix: i'm having a hard time putting myself in the position of the person who would author that jenkins plugin in the first place.  but nonetheless, that's still an algorithmic thing we could have the program do for the user.19:36
*** mylu has joined #openstack-infra19:36
jeblairfungi: that exactly.19:36
*** burgerk has joined #openstack-infra19:36
openstackgerritMark Vanderwiel proposed openstack-infra/project-config: Enable lbaasv2 jobs into check and gate queues
*** sputnik13 has quit IRC19:37
waynrdon't underestimate how shitty jenkins plugins can be19:37
electrofelixthe problem isnt' the author of the plugin, it's what's necessarily valid inputs because people select weird naming schemes19:37
electrofelixgiving an alternative delimiter is easier than supporting data escaping in most cases19:37
openstackgerritMerged openstack-infra/project-config: Migrate kolla jobs to centos-7 dib
jeblairokay.  either way, it's something a jjb module can do without too much trouble.  and if there is more than one such plugin (oy!) then we can make a helper function for plugins like "pick_good_delimiter(list, ', ;_!')"19:38
*** sdake_ is now known as sdake19:38
clarkbI am mostly impressed that jenkins isn't using xml properly there19:39
*** sputnik13 has joined #openstack-infra19:39
jeblairclarkb: this surprises me too19:39
jeblairclarkb: usually, it's not shy about using as much xml as it needs to19:39
jeblairand then some19:39
electrofelixIn any case this was to deal with not having to write code that supports both strings or lists as input where the code was originally a string (where the user manually selected the delimiter anyway), where some users discovered they had ended up with very long wrapped input in their job because they had longer sets of data.19:39
*** nadya has joined #openstack-infra19:41
crinkleEmilienM: it's mad about , needs to be openstack/oslo not openstack/puppet-oslo19:41
jeblairelectrofelix: ah, yeah, i have a helper function i use sometimes that's a simple "return a list of one element if its a string, or a list if it's a list" for that case.  if we wanted to get really clever, we can actually put that into a voluptuos validator19:41
jeblair(they can mutate the data)19:41
openstackgerritJoão Vale proposed openstack-infra/jenkins-job-builder: Add Promoted Build parameter.
EmilienMcrinkle: damn19:41
jeblairelectrofelix: this way i treat it as a list in all cases in the program, but users still have the flexibility to say "things: foo" or "things: [foo, bar]"19:41
*** dstanek has quit IRC19:42
*** ddieterly[away] has quit IRC19:42
*** dstanek has joined #openstack-infra19:42
*** inc0 has quit IRC19:42
pabelangercrinkle: good eye19:42
jeblairelectrofelix: grafyaml is an excellent example of mutating yaml on validation, btw.19:42
jeblair(with voluptuous)19:43
jeblairwe didn't really do much of that before then19:43
*** inc0 has joined #openstack-infra19:43
*** Ng has quit IRC19:43
*** Ng has joined #openstack-infra19:43
*** dstanek has quit IRC19:43
jeblairanyway, i have to run, sorry19:43
mtreinishfungi: if you get a sec can you pastebin a chunk of the access log for status.o.o/openstack-health? I want to see what exactly I need to to get the proxying setup19:44
pabelangermtreinish: just seen rss, nice19:44
*** dstanek has joined #openstack-infra19:44
electrofelixjeblair: personally I'd prefer if we had something like jinja2 for the yaml parsing so if you needed this sort of stuff, it's off with you19:44
waynrelectrofelix: uses jinja2 for template strings ;)19:45
clarkbI think the issue with jinja2 here is it still expects the user to know how to transform the data19:45
EmilienMmtreinish: rss is awesome19:46
fungiwhich is basically implementation details leaking into user-facing interfaces19:46
clarkbfor user supplied information that is necesarily supplied that is fine. But for format this into the silly format the plugin accepts that should be something the user never thinks about19:46
electrofelixclarkb: The jenkins plugins in these cases expect the user pick a delimiter of their choice, so you're pretty much stuck supporting that19:46
clarkbelectrofelix: jjb can do that...19:46
mtreinishEmilienM, pabelanger: cool, glad you like it19:47
clarkbas jeblair said19:47
fungimtreinish: what ip address are you coming from? i'll filter it down to that19:47
AJaegerwhy is every project using constraints breaking their post jobs? is another example ;(19:47
mtreinishfungi: well I've been hitting it with some requests, according to google my ip here at the coffee shop is:
clarkbmaybe we should just let them be broken until the zuul change merges19:48
clarkbAJaeger: ^19:48
electrofelixclarkb: expect we need to go in and modify the code to apply and then still have to ask the user what's the correct delimiter19:48
clarkbelectrofelix: you don't have to ask the user for the correct delimiter19:48
clarkbelectrofelix: you could supply one that works for the user, which is how I would expect jjb to abstract hte plugin for me19:48
*** zz_ja has quit IRC19:48
electrofelixso you let them work out how to escape it correctly where they have your chosen delimiter as a valid non delimiter?19:49
AJaegerclarkb: is Nakato's change ready now ?19:49
fungimtreinish: recent access log entries for that address
clarkbor you pick a delimiter that won't conflict19:49
clarkbAJaeger: I +2'd ity19:49
AJaegerclarkb: wow.19:49
electrofelixclarkb: that requires precognition19:49
clarkbit has tests and appears to take ref mappings19:49
AJaegerOnce that is in, do we need to change our post job jenkins definition somehow? Or will it magically work?19:49
clarkbelectrofelix: the data is static19:50
clarkbelectrofelix: you can programmtically compute a valid delimiter19:50
mtreinishfungi: that's status.o.o? or health.o.o?19:50
fungimtreinish: health19:50
fungiwas that what you wanted?19:50
*** sputnik13 has quit IRC19:50
mtreinishI was looking for status, to see what apache is getting so we can perform the transform on the url19:51
fungimtreinish: nevermind--i misread19:51
fungicoming up19:51
electrofelixclarkb: so just assume the user didn't make a mistake in other words?19:51
mtreinishfungi: cool, thanks19:51
EmilienMpabelanger: ok so puppet-heat & puppet-keystone are affected by this metadata.json error. I sent patches to fix it. But the rest is fine.19:51
clarkbelectrofelix: not sure I follow, JJB must assume the config provided to it is correct19:51
clarkbotherwise it cannot function19:51
pabelangerEmilienM: okay, do you want to comment then out on etherpad? I can start with the others19:51
EmilienMpabelanger: I'm commenting19:52
pabelangerEmilienM: ack19:52
*** zz_ja has joined #openstack-infra19:52
electrofelixand it still results in needing to go in and modify anywhere this can occur in JJB codebase for it to support it in each case19:52
EmilienMpabelanger: done19:52
*** sputnik13 has joined #openstack-infra19:52
*** amrith is now known as _amrith_19:53
EmilienMit was only puppet-keystone on master19:53
clarkbelectrofelix: yes but this is why jjb exists, to take that knowledge requirement and recurrence out of the users hands and turn it into a program that makes using jenkins easier19:53
EmilienM does not have master tarball yet, but will have once my fix is merged19:53
EmilienMsame for keystone19:53
EmilienMso we can go ahead with the other commands19:53
mtreinishfungi: heh, ok19:54
fungimtreinish: want all your hits to status.o.o?19:54
mtreinishso I guess proxing isn't gonna work. All the magic is happening in the browser/js19:54
fungii was filtering for thise including "openstack-health"19:54
mtreinishfungi: there were other hits? (I haven't been paying attention to what I was clicking in the browser)19:55
fungimtreinish: you hit /zuul and /common.js19:55
AJaegerjhesketh: good morning. Shouldn't you be on your way to the airport? ;)19:55
mtreinishfungi: ah, ok that makes sense19:55
fungimtreinish: so not really, no19:55
jheskethAJaeger: already at the airport ;-)19:56
mtreinishfungi: I guess I'll abandon my proxy patch since it never will work19:56
mtreinishwell as I was intending. I guess we could still setup a proxy from status.o.o19:57
AJaegerpabelanger: was kolla the last project with devstack-centos7?19:57
fungimtreinish: yeah, sounds like you need the js to make additional api calls or something19:57
mtreinishit just won't be an exact match to the url in the browser with /rss appended19:57
mtreinishbut I'm not sure it's worth the effort at that point19:58
mtreinishI was just trying to avoid having people subscribe to health.o.o urls in their rss readers19:58
mtreinishbecause that's not normally an endpoint they hit directly19:59
fungiwe could construct some sort of proxy pattern from status.o.o to it if that makes more sense19:59
pabelangerAJaeger: Yup, just infra now19:59
pabelangerAJaeger: will cut us over once kolla is good19:59
fungimtreinish: but going straight to health.o.o may also be more efficient20:00
mtreinishyeah, I'm thinking we probably should just do that and add links to the js/html in the frontend code20:00
fungimtreinish: considered just having query pages embed a hyperlink for an rss subscribe url?20:00
*** inc0 has quit IRC20:00
fungier, what you just said ;)20:00
pabelangerEmilienM: okay, starting20:00
EmilienMcool :)20:00
*** IlyaG has joined #openstack-infra20:00
*** ddieterly has joined #openstack-infra20:00
*** inc0 has joined #openstack-infra20:01
mtreinishfungi: which I think is essentially this:
*** ddieterly is now known as ddieterly[away]20:01
mtreinishwhich you can see in action:
fungipretty much20:02
mtreinishohh look little rss icons20:02
AJaegerpabelanger: once everything is fine, please use #success20:02
pabelangerAJaeger: ++20:02
*** sputnik13 has quit IRC20:02
* AJaeger waves good-bye for today and looks forward to travel on sunday to Austin...20:02
EmilienMpabelanger: I don't see it (yet?) in zuul20:02
EmilienMAJaeger: have a safe trip!20:03
pabelangerEmilienM: need to check with fungi why they are not displayed by status.o.o/zuul20:03
*** bpokorny has joined #openstack-infra20:03
*** abitha has joined #openstack-infra20:04
*** Na3iL has quit IRC20:04
fungiEmilienM: pabelanger: they what?20:04
pabelangerfungi: running
pabelangerfungi: doesn't appear to display the refs on status.o.o/zuul20:05
anteayajhesketh: safe travels20:05
anteayaAJaeger: good night, safe travels to you too20:05
AJaegerthanks, anteaya and EmilienM !20:06
*** IlyaG has quit IRC20:06
jheskethanteaya: thanks20:06
anteayaAJaeger: :)20:06
openstackgerritEmilien Macchi proposed openstack-infra/project-config: grab openvswitch logs
anteayajhesketh: what airport are you at? hobart?20:06
fungipabelanger: it won't. you injected work requests directly into the gearman queue, bypassing zuul's scheduler, so it doesn't have status info for them20:06
jheskethanteaya: yep, just beginning my journey20:06
EmilienMpabelanger: cool (-:20:07
pabelangerfungi: Ah, didn't know that20:07
anteayajhesketh: so from there to sydney?20:07
anteayajhesketh: then LA?20:07
jheskethyep, then DFW then Austin20:07
anteayayay dfw20:07
anteayahow long is your layover in sydney?20:07
fungipabelanger: enqueue or enqueue-ref do show refs in the zuul status, but they also run all listed jobs for those rather than just a specific job20:07
jhesketh4.5 hours20:08
anteayajhesketh: there is a really great candy shop in dfw20:08
anteayajhesketh: ew20:08
*** nadya has quit IRC20:08
anteayahopefully the dfw to aus layover is shorter20:08
jheskethI get into austin at 16:16... so over 25 hours travel20:08
anteayaboy are you going to smell great20:08
jheskethyeah dfw isn't as bad20:08
anteayayeah, I like that airport20:09
jheskethI promise to not make anybody smell me20:09
anteayaI like the floor murals20:09
pabelangerfungi: thanks20:09
anteayajhesketh: you are so kind20:09
jheskethI can't promise it won't happen by accident... but that's what lounge showers are for20:09
EmilienMI have a last request for project-config reviewers, to (finally) make work again the lint jobs on stable/liberty
anteayajhesketh: I'm operating on the belief you will have found a shower prior to me hugging you20:09
jheskethanteaya: I shall warn you if not ;-)20:09
anteayajhesketh: does dfw have a shower?20:09
anteayajhesketh: ah thank you20:09
openstackgerritMark Vanderwiel proposed openstack-infra/project-config: Enable lbaasv2 jobs into check and gate queues
anteayaand I'll help you find one20:10
fungii hear you can just step outside and texas will shower you for free right now20:10
jheskethanteaya: not sure, I havne't been there.. I might not have access anyway due to partner programmes etc... but should be able to check into the hotel straight away and freshen up there20:10
*** nadya has joined #openstack-infra20:10
jheskethanteaya: are you in Austin yet? if not, when do you travel?20:10
*** bbroad has quit IRC20:11
anteayaI travel tomorrow20:11
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: adding support for the xcode builder plugin
anteayaI should arrive late Saturday night20:11
anteayaI am at home now, I went to a spa yerterday20:11
anteayasince i couldn't go to germany for a week, I went and had a steam instead20:11
anteayait was very nice20:11
jheskethanteaya: excellent :-)20:12
jheskethanteaya: you were going to Germany?20:12
anteayayes I was going to munich the first week of april20:12
fungirumor has it later in the week, you can just step outside and texas will steam you for free20:12
anteayathen my basement took on water20:12
pabelangerEmilienM: issue with puppet-aodh?
anteayafungi: perfect20:13
pabelangerEmilienM: or is openstack-aodh right?20:13
anteayafungi: I bought rubber boots yesterday so should be all set20:13
EmilienMpabelanger: it's puppet-aodh20:13
jheskethanteaya: oh no! I hope your baesment has since dried out20:13
fungii may live dangerously and leave the hip waders at home20:13
pabelangerEmilienM: see tarball name20:13
EmilienMpabelanger: it reminds me an error when doing the 8.0.0 release20:14
anteayajhesketh: my basement has since dried out, thank you :)20:14
*** IlyaG has joined #openstack-infra20:14
anteayajhesketh: it was just timing20:14
EmilienMpabelanger: I had to redo a tag for it, I did 8.0.1, let me recall the context20:14
anteayafungi: you risk taker you20:14
jheskethanteaya: yeah my basement never floods when I want it to20:14
anteayaI like a good pair of hip wader20:14
anteayajhesketh: ha ha ha20:14
anteayajhesketh: come to Canada!20:14
pabelangerEmilienM: okay, add the commands in a new context at the end of eitherpad20:15
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Add support for docker builder plugin
jheskethanteaya: where it only floods on demand?20:15
anteayawith on demand being defined as spring20:15
fungistill getting used to living somewhere that i have no basement, but a ground floor that is built to be flooded on a semi-regular basis20:16
pabelangerEmilienM: openstack-ceilometer-7.0.0.tar.gz too:
pabelangerEmilienM: possible the metadata.json name field is not correct?20:17
anteayafungi: what changes do you have to make to your routine20:17
anteayafungi: or more just a mental shift?20:17
jheskethfungi: that just means you don't have to go so far to get to your pool20:17
anteayathe downstairs pool20:17
EmilienMpabelanger: name is same in metadata.json20:18
fungianteaya: we've had to figure out where to park our cars within walking distance of the house so that they're above the flood line when storms come through, but other than that just remembering to move humidity-sensitive stuff upstairs20:18
EmilienMpabelanger: /me finding logs20:18
pabelangerEmilienM: is puppet-aodh, but 8.0.0 is openstack-aodh20:18
pabelangerEmilienM: so that looks to be the issue20:18
EmilienMpabelanger: but ceilometer is good,
EmilienMjenkins/scripts/ renames the tarball20:19
EmilienM mv pkg/*.tar.gz dist/$MODULE_NAME.tar.gz20:19
EmilienMoh I know why20:20
*** mylu has quit IRC20:20
anteayafungi: where do you party your cars? are they somewhere on the property?20:20
pabelangerEmilienM: don't see that20:20
EmilienMjenkins/scripts/ L2120:20
EmilienMwe grep s/-branch-tarball20:20
EmilienMbut now we have tarball jobs20:20
fungianteaya: one of christine's coworkers lives on a higher part of the island and lets us park in her driveway when floods are predicted20:20
EmilienMpabelanger: I guess we can report all commands for -tarball jobs for later20:21
anteayafungi: oh isn't that nice20:21
fungionly a couple kilometers walk from here20:21
*** Na3iL has joined #openstack-infra20:21
anteayafungi: that's not bad20:21
funginot at all20:21
jheskethwelp, time to board... see ya'll soon! :-)20:21
anteayafungi: I'm guessing she is a popular person on the island20:21
anteayajhesketh: safe travels, see you soon20:21
*** mylu has joined #openstack-infra20:21
EmilienMpabelanger: I'm working on a patch now, but I guess this task will be postponed20:22
openstackgerritChris Denneen proposed openstack-infra/jenkins-job-builder: Add BuildNameUpdater to Builders
*** Na3iL has quit IRC20:24
*** Na3iL has joined #openstack-infra20:25
pabelangerEmilienM: you'll need to do (-branch)?-tarball for your sed20:25
pabelangerEmilienM: since you have both puppet-adoh-tarball and puppet-adoh-branch-tarball20:26
EmilienMright, I missed it20:26
pabelangerEmilienM: Ya, we'll have to do this at the summit, since we need new images now20:26
EmilienMpabelanger: sed "s/(-tarball$\|-branch-tarball$\)// is good?20:26
*** Na3iL has quit IRC20:26
* EmilienM testing it20:26
*** Na3iL has joined #openstack-infra20:27
pabelangerEmilienM: I like mine better :)20:27
*** Na3iL has quit IRC20:27
EmilienMtil :)20:27
*** Na3iL has joined #openstack-infra20:28
openstackgerritJoão Vale proposed openstack-infra/jenkins-job-builder: Fix Generic Artifactory repository key selection options.
*** ddieterly[away] is now known as ddieterly20:28
fungipabelanger: has --refname 7.0.0 been working for you? i think zuul ends up passing the parameter with a format more like refs/tags/7.0.020:29
openstackgerritEmilien Macchi proposed openstack-infra/project-config: run-tarball/puppet: fix module name for -tarball jobs
*** mylu has quit IRC20:30
EmilienMpabelanger: done ^20:30
*** mylu has joined #openstack-infra20:30
pabelangerfungi: I think so, I've been using the syntax that EmilienM provided20:32
*** lennyb has quit IRC20:32
EmilienMpabelanger: can I unstrikethrough the commands where build failed? and ask for a cleanup on tarballs.o.o ? we'll catch-up that later, maybe during summit otherwise after.20:33
fungiahh, i expect EmilienM was copying from my post pipeline example and guessed on the refname format for tags20:33
pabelangerEmilienM: +2. Even tested20:34
pabelangerEmilienM: sure20:34
*** inc0 has quit IRC20:35
pabelangerEmilienM: tarballs removed20:35
EmilienMack, thanks20:35
*** mylu has quit IRC20:37
*** bpokorny has quit IRC20:37
*** bpokorny has joined #openstack-infra20:38
openstackgerritMerged openstack-infra/jenkins-job-builder: Take parameter order from yaml in trigger_parameterized_builds
*** bpokorny has quit IRC20:38
*** gyee has quit IRC20:39
*** lennyb has joined #openstack-infra20:39
*** sputnik13 has joined #openstack-infra20:41
madhu_akcan I have another core to review this patch: ? Thanks!20:46
*** newjersey has joined #openstack-infra20:48
*** newjersey has quit IRC20:48
*** newjersey has joined #openstack-infra20:49
openstackgerritMerged openstack-infra/project-config: puppet: add missing builder for lint jobs
*** mylu has joined #openstack-infra20:50
*** lucas-dinner has quit IRC20:51
*** gyee has joined #openstack-infra20:52
krotscheckAnyone want to review some NPM mirror patches? :)
*** Na3iL has quit IRC20:57
*** lucasagomes has joined #openstack-infra20:58
*** ddieterly is now known as ddieterly[away]20:58
*** ddieterly[away] is now known as ddieterly21:00
*** ybathia has joined #openstack-infra21:00
*** yamahata has quit IRC21:01
*** ddieterly is now known as ddieterly[away]21:01
*** ddieterly[away] is now known as ddieterly21:01
*** newjersey has quit IRC21:01
*** matt-borland has quit IRC21:02
*** sridhar_ram1 has joined #openstack-infra21:02
*** thorst has quit IRC21:03
*** rossella_s has quit IRC21:04
*** rossella_s has joined #openstack-infra21:04
openstackgerritMerged openstack-infra/jenkins-job-builder: Be able to handle Slack Plugin 2.0 configuration
openstackgerritStephen Gordon proposed openstack-infra/project-config: Add #openstack-kubernetes to accessbot
*** trown is now known as trown|outtypewww21:05
*** sridhar_ram has quit IRC21:05
*** davideagnello has quit IRC21:06
*** thorst has joined #openstack-infra21:07
*** IlyaG has quit IRC21:08
gsilvisI'm trying to submit a spec to gerrit, and I can't log in succesfully.  My username is 'gsilvis' and 'git review -s' gives the following error:   Exception: Could not connect to gerrit at ssh://
pabelangerNice, kolla migrated to centos-721:09
*** lakshmiS has quit IRC21:10
*** sputnik13 has quit IRC21:11
*** IlyaG has joined #openstack-infra21:11
gsilvissorry, figured it out---turns out I hadn't signed the CLA21:12
*** sputnik13 has joined #openstack-infra21:12
*** thorst has quit IRC21:12
pabelangerany infra-root care to +A ? We're the last team using devstack-centos721:13
anteayagsilvis: you might enjoy reading:
fungigsilvis: is the account setup instructions we usually point people at, for future reference21:14
fungipabelanger: in fact, any project-config core reviewer could approve 303473, not just infra-root/infra-core21:14
gsilvisanteaya, fungi: thanks for the link21:15
pabelangerfungi: doh, I keep messing that up21:15
anteayagsilvis: welcome21:15
*** psilvad has quit IRC21:16
pabelangerproject-config-core, see 303473 too ^21:16
anteayagsilvis: also next week is our summit, so things will be pretty quiet regarding reviews and so in in gerrit for next week21:16
anteayagsilvis: expect a bit of a lull21:16
fungiunless you're in austin, and then expect a world of crazy21:16
gsilvisanteaya: Understood---I'll be there myself :)21:16
anteayaoh wonderful21:17
anteayamakes it easier then :)21:17
*** ldnunes has quit IRC21:17
*** _amrith_ is now known as amrith21:19
*** nadya has quit IRC21:19
openstackgerritMerged openstack-infra/project-config: Migrate infra off devstack-centos7
pabelangerwill confirm JJB updates21:23
pabelangerthen maybe set min-ready to 021:23
nibalizerpabelanger: cool21:25
pabelangerfungi: are you okay with 306330? increasing centos-7 min-ready to 321:25
pabelangernibalizer: next stop ubuntu-xenial21:25
*** madhu_ak_ has joined #openstack-infra21:25
*** madhu_ak has quit IRC21:25
nibalizerhaha yes21:25
*** qb_ has joined #openstack-infra21:28
*** sridhar_ram1 has quit IRC21:29
*** bauwser is now known as bauzas21:30
*** thorst has joined #openstack-infra21:30
*** amitgandhinz has quit IRC21:30
*** ddieterly is now known as ddieterly[away]21:31
*** sridhar_ram has joined #openstack-infra21:32
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added clean exit hooks to npm registry script
*** ddieterly[away] is now known as ddieterly21:32
krotscheckjeblair, mordred: Ok, I have confirmed that rerunning the indexer from zero won't download everything again, it'll only pull the index.json files and compare the shasums where necessary. ^^ patch was updated to use a new version of the hooks, which add a new sanitizer that fixes the version issue.21:33
krotscheckAlso, I strongly recommend we get approved and landed, so there's more oversight on the codebase :)21:34
*** lascii is now known as alaski21:34
*** thorst has quit IRC21:35
morgangooooooo gertty... gooooooo sync before i need to go to the airport21:35
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Add js-openstack-registry-hooks (openstack-registry-hooks) to openstack-infra
*** julim has quit IRC21:36
*** matt-borland has joined #openstack-infra21:36
*** ddieterly is now known as ddieterly[away]21:37
*** cbader has quit IRC21:37
*** thorst has joined #openstack-infra21:37
anteayamorgan: :)21:37
morgananteaya: you know the feeling!21:37
openstackgerritDarragh Bailey proposed openstack/python-jenkins: Allow to wait for jenkins to enter normal operation
anteayamorgan: it has been a while, but yes, I do know the feeling21:39
anteayamorgan: and safe travels21:39
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Allow to wait for jenkins to start up
morgananteaya: thanks!21:39
morgani have... ~8hrs befor my flight21:40
morganbut you know how last minute things start feeling :)21:40
*** baoli_ has quit IRC21:40
anteayaI'm avoiding them this time21:40
morgananteaya: hehe21:40
anteayaI don't need white socks this trip21:40
anteayaI don't need any white towels in my closet before I depart21:41
krotscheckWhite.... socks?21:41
anteayameaning I don't need to launder my whites tonight21:41
anteayathat is the last load sitting in the laundry room21:41
anteayaI'll skip it21:41
krotscheckAhhhh. Laundry. Right.21:41
morgankrotscheck: it's like what colour the socks should be... except they aren't anymore because dirt.21:41
krotscheckI... should see if I actually have clothing that isn't covered in baby vomit.21:42
morgankrotscheck: if you buy those light-coloured things.21:42
anteayaI'm tired of feeling stressed at the last minute, I have a flight and a place to stay21:42
krotscheckFair warning: If you see a suspicious yellow stain on a shirt of mine, don't touch it.21:42
anteayaand my schedule on a tomboy note21:42
anteayaI'm not going to worry about much else21:42
anteayakrotscheck: thanks, I would have been tempted otherwise21:43
krotscheckanteaya: I'm nothing if not helpful :)21:43
anteayayou are that21:43
anteayaor not that as they case may be21:43
krotscheckSafe travels this weekend, everyone. See y'all sunday!21:44
anteayakrotscheck: yep, thanks and to you too21:44
*** mriedem has quit IRC21:44
*** salv-orl_ has joined #openstack-infra21:44
*** whyhiannabelle has joined #openstack-infra21:45
*** mriedem has joined #openstack-infra21:46
*** salv-orlando has quit IRC21:47
electrofelixwaynr zxiiro: I think I've cleaned up a few and closed out some stale reviews that have been lying around, going to call it a day.21:51
*** mriedem has quit IRC21:51
zxiiroelectrofelix: great work, and thanks!21:51
zxiiroelectrofelix: I'll try to get a few more reviews in tomorrow if I can21:52
electrofelixthere's about 46 old reviews left before we're pretty much current21:53
jeblairfungi, clarkb: what's the zuul restart status?21:53
electrofelixI'm sure a bunch of those are stale and already implemented21:53
*** IlyaG has quit IRC21:54
*** electrofelix has quit IRC21:54
jeblairps says it has not been restarted21:54
jeblairlooks like latest master has been installed21:54
clarkbjeblair: sorry I havne't been able to do proper work today. Backups, packing, cleaning, child caring21:54
jeblairso i will restart it now.21:54
*** yamahata has joined #openstack-infra21:55
jeblairclarkb: no prob, i just got back myself and wanted to make sure i wasn't stepping on toes21:55
*** aysyd has quit IRC21:55
fungijeblair: i was about to check back and see if it had calmed down, so ++21:56
jeblairrestarted; re-enqueing21:56
anteayaso this is with just master branch code now on zuul?21:57
jeblairanteaya: yep21:57
anteayathank you21:57
fungilooks like the (presumed) leak fix made it onto the server21:57
jeblairanteaya: i merged the change that we (hope) fixes the leak.21:57
anteayajeblair: yay!21:57
*** IlyaG has joined #openstack-infra21:57
jeblairanteaya: even if it doesn't we haven't lost much with that change, so it seems reasonable for now at least21:58
fungiahh, i'll switch my draft +3 of 307892 to just +2 then21:58
anteayajeblair: yes, thank you21:58
fungiwas waiting until i knew we had workers reregistered21:58
openstackgerritMichael Krotscheck proposed openstack-infra/system-config: Added clean exit hooks to npm registry script
anteayathe short period of time zuul was running with 281166 in place appeared to at least not spike memory usage21:59
*** nwkarsten has quit IRC21:59
fungispeaking of workers/jobs registered, looks like 309503,1 got reenqueued before zuul knew about any of its jobs22:00
*** ddieterly[away] is now known as ddieterly22:00
fungispeaking of which, we need to delete all nodes from nodepool since gearman got flushed?22:01
*** gyee has quit IRC22:01
jeblairi'll re-re-enqueue it22:01
*** ddieterly has quit IRC22:01
anteayaannnnnd ubuntu came out with a firefox update just before summit, yay, I'll reboot/reload things and play with some etherpads to test it22:02
*** anteaya has quit IRC22:02
*** anteaya has joined #openstack-infra22:05
*** mancdaz has quit IRC22:06
*** EricGonczer_ has quit IRC22:07
anteayaff 45.0.2, I can open an existing etherpad, I can create and etherpad and edit it22:07
*** mancdaz has joined #openstack-infra22:08
*** EricGonczer_ has joined #openstack-infra22:08
fungigood deal22:08
mordredclarkb, fungi: have y'all been cleaning fips on osic/bluebox at all today?22:10
anteayafungi: all I need to know for right now22:10
fungimordred: i have not22:10
clarkbI have not22:10
anteayawasn't yesterday fip day?22:10
mordredit was22:11
fungiit seems to have remained under control anyway22:11
mordredI basically didn't do much with it today22:11
mordredand my script just said this:22:11
mordredCleaned 8 FIPs from osic-cloud122:11
mordredCleaned 5 FIPs from bluebox-sjc122:11
mordredso that's not great - but not terrible22:11
fungiway better than it was22:11
fungiand we have better debugging to guess where the others came from?22:11
mordredand within the tolerances that the fip cleaner addition to nodepool should be able to easily handle22:11
mordredfungi: you'd think22:12
mordredfungi: but no, there are still mysteries22:12
fungithe spice of life22:12
*** psilvad has joined #openstack-infra22:12
* mordred looks around for Paul22:12
*** roxanagh_ has joined #openstack-infra22:13
*** roxanaghe has quit IRC22:14
*** vhosakot has quit IRC22:15
*** matt-borland has quit IRC22:16
*** sdake has quit IRC22:17
openstackgerritMerged openstack-infra/system-config: Zuul status: Link to logs.o.o on completed builds
*** EricGonczer_ has quit IRC22:19
fungiooh, the summit map for the hilton shows our infra sessions are all right next to grab-n-go lunch, convenient!22:23
*** sigmavirus24 is now known as sigmavirus24_awa22:23
*** whyhiannabelle has quit IRC22:24
anteayafungi: somebody likes us22:24
*** piet has joined #openstack-infra22:25
mtreinishfungi: is the fungilaptop all set for showing off in austin?22:25
anteayaare you able to take orders?22:26
clarkbthere is also proper lunch in the hilton too22:26
fungimtreinish: no, i'm still fiddling with it. i think i want a different sbc. i may bring it if i can get an appropriate display resolution compiled into the kernel this evening after i pack22:26
anteayaclarkb: yay proper lunch22:27
fungithe radxa rock, for all its promise, is hamstrung by choosing an soc that supported android well but never upstreamed any support to the mainline kernel22:27
fungiso for example i'm stuck using limux 3.0.x kernel sources, hdmi resolution is set at kernel compile time in the driver (because it expects to be in a device like a phone or tablet with a fixed display) et cetera22:28
mtreinishfungi: unfortunately that's the case with alot of arm socs. They target the largest potential user base22:29
fungithe soc manufacturer (rockchip), after some pressuring about their blatant gpl violations, did publish their modified kernel sources, but it's an absolute mess and very little of it is upstreamable22:29
mtreinishthey also often always require running a very out of date kernel fork too22:30
mtreinishfungi: heh, yeah that's pretty par for the course :(22:30
*** mylu has quit IRC22:30
*** amitgandhinz has joined #openstack-infra22:31
*** mylu has joined #openstack-infra22:31
fungithere's a mostly working 3.4 kernel floating around for it. and people hacking constantly on getting stuff mainlined (they've got a ticklist of stuff they've knocked out in every mainlike kernel release for a couple years now) but it's still not very usable with even linux 4.7 except for very limited headless purposes22:31
*** mylu has quit IRC22:32
fungiso anyway, i'm trying to get their hacked-up "rabian" debian derivative tweaked to operate the display i'm using, but with limited success so far22:32
mtreinishfungi: I went to this talk at linuxcon japan last year:
mtreinishit covered alot of the issues with this space22:33
*** ybathia has quit IRC22:34
mtreinishit included some numbers on the number of modifications the soc and phone manufacturers make22:35
*** amitgandhinz has quit IRC22:36
*** xarses has quit IRC22:36
fungithose are some big numbers22:37
*** ddieterly has joined #openstack-infra22:37
*** ddieterly is now known as ddieterly[away]22:37
mtreinishfungi: heh, rabian makes it sound like it has rabies22:37
*** ddieterly[away] is now known as ddieterly22:37
fungimtreinish: i think it may22:37
funginot trusting my keys on it22:38
morgani wonder if this push towards a SOC-like architecture intel has been making is in response to these things with ARM22:38
morganor if it's just "sanity" to do the SOC-like setup22:38
clarkbit has to do with footprint for power22:38
morganclarkb: that too22:38
*** xyang1 has quit IRC22:39
* morgan is typing on a Core-M based laptop atm22:39
*** davideagnello has joined #openstack-infra22:39
*** markvoelker has quit IRC22:39
mtreinishmorgan: not the new x1?22:39
*** imcsk8 has quit IRC22:39
openstackgerritMerged openstack-infra/shade: Add public helper method for cleaning floating ips
fungiactually, one key cause i don't see mentioned in that slide deck: hardware design22:40
morganmtreinish: nah, X1 is at home atm.22:40
morganmtreinish: it's in the process of syncing gertty22:40
morganand other things22:40
morganalso... i don't have my home VPN configured on it. so i was going to try to vpn here22:41
morganbut unfortunately i upgraded to 16.04 at home..22:41
morganannnnnd the openvpn server didn't start back up22:41
fungithe soc is often developed in a vacuum or at least without taking the operating system's capabilities into account, which then results in massive amount of work to reengineer kernel space/drivers to fit the device. i suspect a better balance could be struck there22:42
morganfungi: true.22:42
*** sdake has joined #openstack-infra22:42
fungie.g., some of your non-performance-critical implementation could emulate other devices on the market already well-supported mainline22:43
*** mylu has joined #openstack-infra22:43
*** piet has quit IRC22:43
*** piet has joined #openstack-infra22:44
fungienough so that that existing drivers could be used directly or with only minor generalization patched in22:44
fungimtreinish: what's funny is that presentation looks like ~80% applicable to openstack's downstream development teams as well22:45
mtreinishfungi: hehe, yeah. I was thinking about that when I was sitting there listening to it22:46
mtreinishthat and my first job working on some nfsv4 client features which was mostly for an internal product builds (I did try to upstream, but with little success)22:48
*** |-paul-| has joined #openstack-infra22:49
fungiwhen i first started getting involved in free software, i watched interactions between established developers on the projects i was interested in, sometimes for years, before starting to try to submit patches22:49
fungibut as a result, had very positive experiences when i went in with a good sense of community norms22:50
*** vhosakot has joined #openstack-infra22:51
fungigranted the wheels weren't nearly so greased back then22:51
*** ddieterly is now known as ddieterly[away]22:52
*** johnny_ has quit IRC22:53
pabelangerfungi: so, when we land do we need to restart anything? Or will puppet take care of things22:54
*** sputnik13 has quit IRC22:54
pabelangerI can never remember when we set min-ready to 022:54
fungipabelanger: well, the commit message is slightly wrong now i take it? but yeah22:55
*** ddieterly[away] is now known as ddieterly22:55
pabelangerfungi: That is true, let me update22:55
*** sputnik13 has joined #openstack-infra22:56
fungiand once we no longer have any nodes of that type, we can remove it from the config (will still need an image worker restart at that point and probably manual alien image cleanup)22:56
openstackgerritPaul Belanger proposed openstack-infra/project-config: Set min-ready for devstack-centos7 to 0
pabelangerfungi: okay22:57
*** burgerk has quit IRC22:57
pabelangerlook like nodepool finished all uploads for today22:57
*** e0ne has joined #openstack-infra22:58
*** rbrndt has quit IRC22:59
ianwyay, can read the nodepool logs again too22:59
*** kmartin has quit IRC23:00
pabelangerianw: any idea why is empty?23:00
fungialso if you force reload the zuul status page, you'll be able to see links to logs for completed jobs now23:00
pabelangerfungi: Nice!23:01
ianwfungi: cool, thanks!  makes it a lot easier when you're working on fixing a short job23:02
fungipabelanger: ianw: the patches (and the restart) were jeblair's work23:02
ianwpabelanger: hmm, no ... assume the output isn't going into the main logs? we may have a key mismatch in loggers/config somewhere23:02
fungibut i agree, works great!23:03
*** ams_ has quit IRC23:03
pabelangerianw: I see them in debug.log23:03
jeblairoh whew!  :)23:03
pabelangerianw: 2016-04-22 14:15:59,583 INFO + TEMPEST_DIR=/opt/git/openstack/tempest23:03
pabelangerianw: as an example23:04
*** sdague has quit IRC23:06
*** Swami has quit IRC23:06
*** ddieterly is now known as ddieterly[away]23:06
*** xarses has joined #openstack-infra23:06
ianwpabelanger: well, you'd think that would match ->
pabelangerianw: Ya, that's what I am looking at now. Seems to be right23:07
pabelangerianw: I see the issue23:08
ianwmissing logger?23:08
pabelanger2016-04-22 14:15:59,592 INFO + sudo mv /tmp/image-hostname.txt /etc/image-hostname.txt23:09
pabelangerit is INFO23:09
pabelangernot debug23:09
*** mtanino has quit IRC23:09
*** markvoelker has joined #openstack-infra23:09
*** Na3iL has joined #openstack-infra23:10
openstackgerritMerged openstack/os-testr: Add version option for ostestr and subunit-trace
ianwyeah, so i wonder if we should just up the level in the logger config to WARNING?23:11
pabelangerianw: or convert it to DEBUG23:12
pabelangerianw: looking at source now23:12
*** e0ne has quit IRC23:13
ianwmaybe we considered upping that level and didn't incase something important leaked into the public logs.  so long ago, i can't remember :)23:13
pabelangerianw: ya, we cannot convert it to debug, it is in SSHClient23:13
pabelangerianw: so, guess we should up our handler23:13
ianwahh, that explains it for snapshot images23:14
ianwi think it makes sense to up the handlers23:14
*** ddieterly[away] is now known as ddieterly23:14
ianwi'll leave it to you, i'm currently smoking some bacon :)23:14
pabelangerianw: NICE23:15
openstackgerritMerged openstack-infra/project-config: Set min-ready for devstack-centos7 to 0
ianwlive shot ->
*** baoli has joined #openstack-infra23:19
*** ybathia has joined #openstack-infra23:19
*** matt6434 is now known as mattoliverau23:19
*** baoli_ has joined #openstack-infra23:20
pabelangerianw: very cool23:20
*** psilvad has quit IRC23:21
*** lakshmiS has joined #openstack-infra23:22
*** ddieterly has quit IRC23:23
openstackgerritPaul Belanger proposed openstack-infra/project-config: Remove devstack-centos7 from nodepool
pabelangerianw: ^ \o/23:23
*** baoli has quit IRC23:24
pabelangerand with that AFK for a bit, need to run some errands23:24
*** ybathia has quit IRC23:27
*** ybathia has joined #openstack-infra23:29
*** cody-somerville has joined #openstack-infra23:32
*** amitgandhinz has joined #openstack-infra23:32
*** weirdintheatx has quit IRC23:35
*** ybathia has quit IRC23:35
*** amitgandhinz has quit IRC23:37
*** IlyaG has quit IRC23:40
*** sridhar_ram1 has joined #openstack-infra23:47
*** eil397 has left #openstack-infra23:49
*** sridhar_ram has quit IRC23:49
*** ajmiller has quit IRC23:52
*** madhu_ak_ has quit IRC23:54
*** nikhil has quit IRC23:58
*** nikhil_k is now known as nikhil23:58
*** mylu has quit IRC23:59

Generated by 2.14.0 by Marius Gedminas - find it at!