| *** FallenPegasus has joined #openstack-infra | 00:00 | |
| *** unicell has quit IRC | 00:02 | |
| *** unicell has joined #openstack-infra | 00:02 | |
| *** bnemec has joined #openstack-infra | 00:03 | |
| *** sharikap_ has quit IRC | 00:03 | |
| clarkb | fungi: should I write that change really quickly or are you doing it? | 00:04 |
|---|---|---|
| clarkb | I think I have just wrapped up paperwork | 00:04 |
| *** geoffarn_ has quit IRC | 00:04 | |
| *** geoffarnold has joined #openstack-infra | 00:06 | |
| fungi | clarkb: not urgent. i've not really had great luck testing proposed changes to modules outside of openstack_project using a dev env. still haven't figured out why but i'll give it another shot | 00:06 |
| *** zz_dimtruck is now known as dimtruck | 00:06 | |
| clarkb | fungi: you can use mine if you like just to get new view on it | 00:06 |
| clarkb | fungi: but what you do is put the etherpad module in /etc/puppet/environments/clarkb/modules/etherpad (path is something like that) then update system-config in /opt/puppet/environment/clarkb (again whatever that path is) | 00:07 |
| fungi | that's what i've done with mine in the past. will give it another shot | 00:08 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate https://review.openstack.org/214748 | 00:09 |
| *** geoffarnold has quit IRC | 00:10 | |
| *** bnemec has quit IRC | 00:10 | |
| *** achanda has quit IRC | 00:11 | |
| *** flepied has joined #openstack-infra | 00:18 | |
| fungi | looks like 214795 merged while i was at dinner, but puppet agent --test --noop isn't reflecting it yet | 00:19 |
| fungi | clarkb: ^ guesses? | 00:19 |
| fungi | are we failing to update the openstack_project module, or am i just testing incorrectly? | 00:20 |
| *** armax has quit IRC | 00:20 | |
| *** ybathia has quit IRC | 00:20 | |
| openstackgerrit | Sahdev Zala proposed openstack-infra/project-config: Add new repository for stand-alone TOSCA Parser https://review.openstack.org/211204 | 00:21 |
| fungi | er, i guess it's the project_config module | 00:21 |
| *** unicell has left #openstack-infra | 00:21 | |
| docaedo | Anyone here know who would be the best person for me to chat at about the ask.openstack backend? | 00:21 |
| fungi | last update to /etc/puppet/modules/project_config on our puppetmaster seems to be a week old | 00:22 |
| *** armax has joined #openstack-infra | 00:22 | |
| fungi | that can't be right | 00:22 |
| *** unicell has joined #openstack-infra | 00:22 | |
| fungi | docaedo: what part of the backend? | 00:22 |
| fungi | docaedo: if memory serves, it's postgres and redis | 00:22 |
| fungi | docaedo: or do you mean the software which implements the ask.openstack.org service? | 00:23 |
| docaedo | fungi: am thinking about it for app catalog - it basically already has much of what we want in the future, and I'm wondering if there's value to trying to re-purpose those bits rather than start over | 00:23 |
| *** minwang2 has quit IRC | 00:23 | |
| fungi | docaedo: no idea, the q&a forum software is called "askbot" | 00:24 |
| *** armax has quit IRC | 00:24 | |
| docaedo | fungi: specifically stuff like voting and feedback - think of each question as an asset in the app catalog (so not perfect analog, but not far off) | 00:24 |
| clarkb | fungi noop wont pull project co fig updates | 00:24 |
| docaedo | fungi: I saw that, it seems to be something you have to pay for, but maybe OpenStack gets to use it for free because OpenStack is awesome? | 00:24 |
| clarkb | fungi its th big gap woth noop and project config | 00:24 |
| fungi | docaedo: it's free software | 00:25 |
| clarkb | its open source you can host yourself | 00:25 |
| *** eantyshev has quit IRC | 00:25 | |
| *** bnemec has joined #openstack-infra | 00:25 | |
| docaedo | ah thanks! ok I thought I'd seen something about buying/paying | 00:25 |
| fungi | docaedo: https://github.com/ASKBOT | 00:25 |
| fungi | clarkb: aha, okay i'll just give it a go for realz thn | 00:26 |
| timrc | crinkle, Doh, I introduced a bug :) | 00:26 |
| docaedo | you folks have any off-the-cuff opinions of the idea? I'm trying hard not to re-invent the wheel for building up some app catalog stuff (and especially thinking about re-using things we already use elsewhere) | 00:26 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/puppet-cgit: Do not execute selinux commands if policy disabled https://review.openstack.org/214667 | 00:26 |
| crinkle | timrc: oh noes :( | 00:26 |
| fungi | docaedo: i really don't know how decomposable it is, but from what little i know of the source i expect it's fairly monolithic | 00:27 |
| timrc | crinkle, I s/enabled/enforcing/ | 00:27 |
| timrc | :) | 00:27 |
| fungi | clarkb: good call. actual non-noop run didn't revert our fix | 00:27 |
| fungi | puppet on zuul is back to enabled again | 00:28 |
| *** asettle has quit IRC | 00:28 | |
| *** dannywil_ has quit IRC | 00:28 | |
| docaedo | fungi: thanks - I'll poke around a little bit, might end up just looking to use django to do something simple in the end | 00:28 |
| *** salv-orl_ has quit IRC | 00:29 | |
| *** dims has joined #openstack-infra | 00:30 | |
| *** bnemec has quit IRC | 00:30 | |
| fungi | docaedo: it might be a great example, but my gut says it won't be reusable without copying/forking | 00:31 |
| clarkb | its also a pita to deploy | 00:31 |
| fungi | docaedo: however mrmartin can give you a more informed evaluation when he's around (emea timezones) | 00:31 |
| *** gyee has quit IRC | 00:33 | |
| docaedo | fungi: thanks | 00:33 |
| docaedo | clarkb: well .. that's not exciting to hear that it's a pita :) Expect me to chat at you about deploying stuff for app catalog before we head off in any specific direction | 00:34 |
| clarkb | I was the origibal attempt at deploying askbot way back when and I eventually came back and said no because it didnt work | 00:35 |
| clarkb | had somethibg to do with internationalization support in django being busted | 00:35 |
| *** pvaneck has quit IRC | 00:35 | |
| fungi | also at the time we wanted it to support mysql (it basically still doesn't but we gave up on that point) | 00:37 |
| *** hdd has quit IRC | 00:37 | |
| *** thorst has joined #openstack-infra | 00:38 | |
| *** spzala has quit IRC | 00:41 | |
| *** milligana1 has joined #openstack-infra | 00:41 | |
| *** pcrews has joined #openstack-infra | 00:41 | |
| *** milligana has quit IRC | 00:43 | |
| *** FallenPegasus has quit IRC | 00:43 | |
| *** bnemec has joined #openstack-infra | 00:44 | |
| *** mriedem has joined #openstack-infra | 00:45 | |
| fungi | clarkb: new etherpad-dev attempt at 2001:4800:7819:104:be76:4eff:fe04:c137 23.253.110.71 | 00:46 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 00:46 | |
| fungi | i launched it with my dev env and the etherpad_lite module patched with your change plus a change to openstack_project to pass that parameter into the module | 00:46 |
| *** wenlock has joined #openstack-infra | 00:46 | |
| fungi | but dpkg -l doesn't show the package installed | 00:47 |
| dstufft | fungi: what's it use, postgresql? | 00:47 |
| clarkb | fungi: aptitude show ya that | 00:47 |
| clarkb | dstufft: yes and solr for search iirc | 00:47 |
| *** tiswanso has joined #openstack-infra | 00:48 | |
| clarkb | the problem at the time was niether postgres nor mysql worked | 00:48 |
| fungi | clarkb: aha... | 00:48 |
| *** achanda has joined #openstack-infra | 00:48 | |
| clarkb | because django did some funny lazy loading of translations which was broken | 00:48 |
| fungi | Error: Execution of '/usr/bin/git checkout --force system' returned 1: error: pathspec 'system' did not match any file(s) known to git. | 00:48 |
| *** nadya has joined #openstack-infra | 00:48 | |
| clarkb | fungi: my if is wrong then somehow | 00:48 |
| clarkb | will look in a moment | 00:48 |
| fungi | clarkb: it may still not be finding my copy of the etherpad_lite module too | 00:49 |
| *** tsekiyam_ has joined #openstack-infra | 00:49 | |
| fungi | i've got it cloned and patched at /etc/puppet/environments/fungi/modules/etherpad_lite on the puppetmaster | 00:50 |
| clarkb | fungi: under environments should be a file with a module path listing in it | 00:50 |
| clarkb | fungi: make sure that in that listing your path above comes before /etc/puppet/modules | 00:50 |
| *** tiswanso has quit IRC | 00:50 | |
| fungi | yep, /etc/puppet/environments/fungi/environment.conf says modulepath = /etc/puppet/environments/fungi/modules:/opt/system-config/fungi/modules:modules:$basemodulepath | 00:51 |
| clarkb | I think I need a $ on that var | 00:51 |
| *** tiswanso has joined #openstack-infra | 00:51 | |
| *** xyang1 has quit IRC | 00:51 | |
| fungi | looking | 00:52 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install https://review.openstack.org/214821 | 00:52 |
| clarkb | see if thats better | 00:52 |
| fungi | oh, indeed the conditional is missing a $ | 00:52 |
| *** tsekiyama has quit IRC | 00:53 | |
| *** nadya has quit IRC | 00:53 | |
| *** mtanino has quit IRC | 00:53 | |
| *** tsekiyam_ has quit IRC | 00:53 | |
| fungi | launching another now with that latest patchset | 00:54 |
| *** jeadr has quit IRC | 00:55 | |
| *** jeadr has joined #openstack-infra | 00:56 | |
| fungi | clarkb: works! 2001:4800:7817:103:be76:4eff:fe05:c92b 23.253.119.227 | 01:03 |
| fungi | i still need to work out the apache config updates to work with 2.4, but i'll save that for tomorrow | 01:03 |
| fungi | and tomorrow | 01:03 |
| fungi | and tomorrow | 01:04 |
| fungi | creeps in this petty pace from day to day | 01:04 |
| *** asettle has joined #openstack-infra | 01:05 | |
| *** alexsyip has quit IRC | 01:05 | |
| *** chen12 has joined #openstack-infra | 01:06 | |
| *** FallenPegasus has joined #openstack-infra | 01:06 | |
| *** baoli has joined #openstack-infra | 01:07 | |
| clarkb | fungi: hrm I think we may also need npm | 01:08 |
| *** glauco_ has joined #openstack-infra | 01:08 | |
| clarkb | since thats a separate oackage but part of the source build | 01:09 |
| fungi | oh, true | 01:09 |
| clarkb | I do need to call it a day though feel free to update my change if you like | 01:09 |
| *** thorst has quit IRC | 01:10 | |
| fungi | i will likely poke at it on the morrow, should we be blessed with minimal infrastructure breakage | 01:10 |
| *** Shrews has quit IRC | 01:11 | |
| *** regXboi has quit IRC | 01:11 | |
| *** Shrews has joined #openstack-infra | 01:11 | |
| *** baoli has quit IRC | 01:12 | |
| *** yamamoto has joined #openstack-infra | 01:12 | |
| *** glauco_ has quit IRC | 01:13 | |
| fungi | in the meantime, i will evening | 01:16 |
| *** wenlock has quit IRC | 01:17 | |
| *** sdake_ has joined #openstack-infra | 01:21 | |
| ianw | dstufft: so i think maybe the packages could help out more -> https://bugzilla.redhat.com/show_bug.cgi?id=1255206 ... interested to see if it gets any response | 01:23 |
| openstack | bugzilla.redhat.com bug 1255206 in python-cffi "Consider adding installed-files.txt during build" [Unspecified,New] - Assigned to npmccallum | 01:23 |
| *** sdake has quit IRC | 01:25 | |
| *** dims has quit IRC | 01:25 | |
| *** moravec has joined #openstack-infra | 01:26 | |
| *** hdd has joined #openstack-infra | 01:27 | |
| *** moravec has quit IRC | 01:30 | |
| *** sthillma has quit IRC | 01:33 | |
| *** Yanyanhu has joined #openstack-infra | 01:34 | |
| *** rick_chen has joined #openstack-infra | 01:37 | |
| *** Yanyanhu has quit IRC | 01:39 | |
| *** yamamoto has quit IRC | 01:40 | |
| *** Yanyan has joined #openstack-infra | 01:41 | |
| *** rick_chen has quit IRC | 01:41 | |
| *** jyuso1 has joined #openstack-infra | 01:41 | |
| *** woodster_ has quit IRC | 01:49 | |
| *** boris-42 has quit IRC | 01:50 | |
| *** dimtruck is now known as zz_dimtruck | 01:50 | |
| *** shashank_hegde has quit IRC | 01:52 | |
| *** ajmiller has joined #openstack-infra | 01:59 | |
| *** ajmiller_ has joined #openstack-infra | 02:02 | |
| *** ajmiller has quit IRC | 02:05 | |
| *** baoli has joined #openstack-infra | 02:08 | |
| *** bpokorny has quit IRC | 02:10 | |
| *** sridhar_ram1 has quit IRC | 02:10 | |
| *** jerryz has quit IRC | 02:10 | |
| *** baoli has quit IRC | 02:12 | |
| *** dims has joined #openstack-infra | 02:21 | |
| chen12 | do we have a infra core now ? can anyone help me review/merge https://review.openstack.org/#/c/213010/ | 02:22 |
| chen12 | ? | 02:22 |
| *** unicell has quit IRC | 02:25 | |
| *** sthillma has joined #openstack-infra | 02:29 | |
| *** dims has quit IRC | 02:29 | |
| *** dims has joined #openstack-infra | 02:30 | |
| *** otter768 has quit IRC | 02:30 | |
| *** sthillma_ has joined #openstack-infra | 02:33 | |
| *** dims has quit IRC | 02:34 | |
| *** sthillma has quit IRC | 02:35 | |
| *** sthillma_ is now known as sthillma | 02:35 | |
| *** yamamoto has joined #openstack-infra | 02:40 | |
| *** mriedem has quit IRC | 02:44 | |
| *** salv-orlando has joined #openstack-infra | 02:44 | |
| *** markvoelker has quit IRC | 02:46 | |
| *** ivar-laz_ has joined #openstack-infra | 02:46 | |
| *** ivar-lazzaro has quit IRC | 02:49 | |
| *** ivar-laz_ has quit IRC | 02:50 | |
| *** salv-orlando has quit IRC | 02:51 | |
| *** yamahata has quit IRC | 02:53 | |
| *** salv-orlando has joined #openstack-infra | 02:55 | |
| *** salv-orlando has quit IRC | 03:02 | |
| *** otter768 has joined #openstack-infra | 03:02 | |
| *** gildub has quit IRC | 03:07 | |
| *** glauco has joined #openstack-infra | 03:09 | |
| *** shashank_hegde has joined #openstack-infra | 03:12 | |
| *** otter768 has quit IRC | 03:13 | |
| *** armax has joined #openstack-infra | 03:15 | |
| *** glauco has quit IRC | 03:15 | |
| *** baoli has joined #openstack-infra | 03:23 | |
| *** jerryz has joined #openstack-infra | 03:27 | |
| *** baoli has quit IRC | 03:28 | |
| *** Kennan2 is now known as Kennan | 03:36 | |
| *** sabeen1 has joined #openstack-infra | 03:46 | |
| *** markvoelker has joined #openstack-infra | 03:46 | |
| *** gildub has joined #openstack-infra | 03:46 | |
| *** aukhan has joined #openstack-infra | 03:49 | |
| *** markvoelker has quit IRC | 03:51 | |
| *** pal has joined #openstack-infra | 03:55 | |
| ruagair | Not sure what TZ you're right now lifeless but if you're about I dropped a comment in this story for you: https://storyboard.openstack.org/#!/story/1234444 | 03:56 |
| lifeless | ruagair: sure | 03:59 |
| ruagair | I was also wondering if it was still relevent. | 03:59 |
| *** tlian2 has quit IRC | 03:59 | |
| lifeless | I have no idea :) | 04:04 |
| *** tiswanso has quit IRC | 04:05 | |
| *** achanda has quit IRC | 04:05 | |
| ruagair | The story was from 2013, last update for "gating" for example was Jan 14. Might be worth a re-read and see if it's still intimidating? Still lacks a simple example though, as you mention. | 04:08 |
| lifeless | ruagair: I think you should read it and see if its intimidating | 04:08 |
| lifeless | ruagair: :) | 04:09 |
| ruagair | I am mot of the way through. | 04:09 |
| ruagair | s/mot/most/ | 04:09 |
| *** skylerberg has joined #openstack-infra | 04:10 | |
| lifeless | ruagair: I'm not super interested in the bug: it was a defect I observed and the project lead agreed on, so I filed the bug and moved on. | 04:13 |
| lifeless | ruagair: if you think the bug | 04:13 |
| lifeless | ruagair: is gone due to improvements, cool. | 04:13 |
| ruagair | OK. | 04:14 |
| lifeless | ruagair: if not, fixing it is great:) | 04:14 |
| ruagair | Thanks for taking a look at it. I'll keep reading and submit patches if/where I think appropriate. | 04:15 |
| *** minwang2 has joined #openstack-infra | 04:17 | |
| *** ayoung has quit IRC | 04:20 | |
| *** baoli has joined #openstack-infra | 04:24 | |
| *** pal has quit IRC | 04:27 | |
| *** minwang2 has quit IRC | 04:28 | |
| *** baoli has quit IRC | 04:29 | |
| *** unicell has joined #openstack-infra | 04:30 | |
| *** fawadkhaliq has joined #openstack-infra | 04:32 | |
| *** salv-orlando has joined #openstack-infra | 04:32 | |
| jamielennox | doing tox -e py27 on keystone at the moment and watching pip quickly grow to using 100% of /tmp | 04:34 |
| *** salv-orlando has quit IRC | 04:35 | |
| *** hdd has quit IRC | 04:36 | |
| openstackgerrit | Paul Van Eck proposed openstack-infra/puppet-refstack: Remove virtualenv and install RefStack on system https://review.openstack.org/214950 | 04:37 |
| *** Sukhdev has joined #openstack-infra | 04:43 | |
| ianw | /usr/bin/python /usr/bin/yum install -y fail2ban sysstat traceroute lsof apg strace telnet screen tcpdump ntp postfix vim-enhanced bind-utils jwhois mailx tmpwatch cyrus-sasl-lib cyrus-sasl-md5 cyrus-sasl-plain yum-cron rackspace-monitoring-agent | 04:45 |
| ianw | ^ is this a few feature of RAX? maybe i just never noticed it before | 04:45 |
| *** darrenc is now known as darrenc_afk | 04:46 | |
| *** yuanying has joined #openstack-infra | 04:46 | |
| *** salv-orlando has joined #openstack-infra | 04:47 | |
| *** Sukhdev has quit IRC | 04:47 | |
| openstackgerrit | Merged openstack-infra/project-config: nova-powervm: Enable python3 job https://review.openstack.org/213312 | 04:48 |
| *** skylerberg has quit IRC | 04:48 | |
| *** nadya has joined #openstack-infra | 04:50 | |
| *** shashank_hegde has quit IRC | 04:50 | |
| *** salv-orlando has quit IRC | 04:51 | |
| *** nadya has quit IRC | 04:54 | |
| *** erikwilson has joined #openstack-infra | 04:56 | |
| *** Sree has joined #openstack-infra | 04:58 | |
| *** Sukhdev has joined #openstack-infra | 04:58 | |
| *** erikwilson has quit IRC | 05:01 | |
| *** ajmiller_ has quit IRC | 05:02 | |
| *** zul has quit IRC | 05:04 | |
| *** FallenPegasus has quit IRC | 05:05 | |
| *** Sree has quit IRC | 05:06 | |
| *** darrenc_afk is now known as darrenc | 05:06 | |
| *** sdake has joined #openstack-infra | 05:07 | |
| *** achanda has joined #openstack-infra | 05:07 | |
| *** afazekas has joined #openstack-infra | 05:08 | |
| *** sabeen1 has quit IRC | 05:09 | |
| *** sdake_ has quit IRC | 05:11 | |
| *** glauco has joined #openstack-infra | 05:13 | |
| *** otter768 has joined #openstack-infra | 05:14 | |
| *** afazekas has quit IRC | 05:15 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet https://review.openstack.org/205097 | 05:17 |
| timrc | zaro, ^^ I updated to send back the node labels of the node returned by build.getBuiltOn() | 05:17 |
| *** glauco has quit IRC | 05:18 | |
| timrc | My I now go another 10 years without looking at Java. | 05:18 |
| timrc | May* | 05:18 |
| *** kiran-r has joined #openstack-infra | 05:18 | |
| *** otter768 has quit IRC | 05:19 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Allow for git base override https://review.openstack.org/151034 | 05:25 |
| *** Sukhdev has quit IRC | 05:26 | |
| *** amotoki has quit IRC | 05:39 | |
| *** geoffarnold has joined #openstack-infra | 05:39 | |
| *** larainema has joined #openstack-infra | 05:40 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Switch locale marker to locale_with_underscore https://review.openstack.org/214955 | 05:42 |
| *** geoffarnold has quit IRC | 05:43 | |
| *** geoffarnold has joined #openstack-infra | 05:43 | |
| *** geoffarnold is now known as geoffarnoldX | 05:45 | |
| *** jeadr has quit IRC | 05:49 | |
| *** nadya has joined #openstack-infra | 05:51 | |
| *** jeadre has joined #openstack-infra | 05:52 | |
| *** vernhart is now known as vern | 05:52 | |
| *** hdd has joined #openstack-infra | 05:53 | |
| *** klagid has quit IRC | 05:54 | |
| *** nadya has quit IRC | 05:55 | |
| *** pal has joined #openstack-infra | 05:57 | |
| *** kiran-r has quit IRC | 05:59 | |
| *** mrmartin has joined #openstack-infra | 05:59 | |
| *** armax has quit IRC | 06:00 | |
| *** zeih has joined #openstack-infra | 06:01 | |
| *** unicell1 has joined #openstack-infra | 06:04 | |
| *** BharatK has joined #openstack-infra | 06:05 | |
| *** salv-orlando has joined #openstack-infra | 06:05 | |
| *** unicell has quit IRC | 06:05 | |
| *** zeih has quit IRC | 06:06 | |
| *** asettle has quit IRC | 06:09 | |
| *** amotoki has joined #openstack-infra | 06:09 | |
| *** hdd has quit IRC | 06:12 | |
| *** salv-orlando has quit IRC | 06:16 | |
| *** vlaza has joined #openstack-infra | 06:21 | |
| *** afazekas has joined #openstack-infra | 06:21 | |
| *** shashank_hegde has joined #openstack-infra | 06:21 | |
| *** pal has quit IRC | 06:23 | |
| *** pal has joined #openstack-infra | 06:27 | |
| *** Sree has joined #openstack-infra | 06:27 | |
| *** jerryz has quit IRC | 06:28 | |
| *** matbu has quit IRC | 06:30 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/214971 | 06:31 |
| *** matbu has joined #openstack-infra | 06:32 | |
| *** salv-orlando has joined #openstack-infra | 06:32 | |
| *** Sree has quit IRC | 06:33 | |
| *** skylerberg has joined #openstack-infra | 06:37 | |
| *** afazekas has quit IRC | 06:37 | |
| *** cody-somerville has joined #openstack-infra | 06:38 | |
| BharatK | ianw, ping | 06:43 |
| *** vlaza has quit IRC | 06:44 | |
| *** fawadkhaliq has quit IRC | 06:45 | |
| SpamapS | " Located server and updated location. Node has no power and needs motherboard replacement." | 06:45 |
| SpamapS | well that's reassuring | 06:45 |
| SpamapS | doh | 06:45 |
| TheJulia | That. is. awesome. | 06:46 |
| *** vlaza has joined #openstack-infra | 06:46 | |
| SpamapS | thats about the 4th box that has had such a catastrophic failure (out of 40) | 06:51 |
| SpamapS | 3 years old.. doesn't seem like boxes should die so readily. :-P | 06:51 |
| SpamapS | but.. he managed to resurrect the other two, so \o/ | 06:51 |
| *** scheuran has joined #openstack-infra | 06:52 | |
| *** AJaeger has quit IRC | 06:53 | |
| *** hyakuhei has joined #openstack-infra | 06:56 | |
| SpamapS | greghaynes: so, FYI, 10.10.16.20 == dead | 06:56 |
| SpamapS | greghaynes: the other two are back | 06:56 |
| *** erikwilson has joined #openstack-infra | 06:56 | |
| SpamapS | greghaynes: I'm struggling to find a source of truth though. I've been editting machine-information-tab.txt but thats not what you used right? | 06:57 |
| *** achanda has quit IRC | 07:00 | |
| *** dtantsur|afk is now known as dtantsur | 07:01 | |
| *** erikwilson has quit IRC | 07:01 | |
| *** peristeri has joined #openstack-infra | 07:03 | |
| *** mpopow has quit IRC | 07:05 | |
| *** marekd_404 is now known as marekd | 07:08 | |
| *** jtomasek has joined #openstack-infra | 07:09 | |
| *** fawadkhaliq has joined #openstack-infra | 07:09 | |
| *** jeadre has quit IRC | 07:13 | |
| *** jeadre has joined #openstack-infra | 07:14 | |
| openstackgerrit | Merged openstack/requirements: Bump cryptography version for Nova Bug 1481084 https://review.openstack.org/214136 | 07:14 |
| openstack | bug 1481084 in OpenStack Compute (nova) "Keypair creation fails when ssh public key comment contains spaces" [Undecided,In progress] https://launchpad.net/bugs/1481084 - Assigned to Davanum Srinivas (DIMS) (dims-v) | 07:14 |
| openstackgerrit | Merged openstack/requirements: Add networking-ofagent to projects.txt https://review.openstack.org/210773 | 07:15 |
| *** glauco_ has joined #openstack-infra | 07:15 | |
| *** otter768 has joined #openstack-infra | 07:15 | |
| openstackgerrit | Merged openstack-infra/puppet-cgit: Add cgit::ssh class to manage git over ssh https://review.openstack.org/179113 | 07:16 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jenkins: Add creation of user in jjb https://review.openstack.org/211145 | 07:17 |
| *** claudiub has joined #openstack-infra | 07:19 | |
| *** otter768 has quit IRC | 07:19 | |
| *** yamamoto has quit IRC | 07:19 | |
| *** glauco_ has quit IRC | 07:20 | |
| BharatK | clarkb, ping | 07:22 |
| *** shardy has joined #openstack-infra | 07:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Move experimental scenario gate jobs for Sahara to non-voting check https://review.openstack.org/214653 | 07:24 |
| BharatK | Hi All, | 07:24 |
| BharatK | I am creating a job in which Neutron is enabled. | 07:25 |
| *** hyakuhei has quit IRC | 07:25 | |
| BharatK | Then, is it mandatory to have 'neutron' in the job name? | 07:25 |
| BharatK | For more details: https://review.openstack.org/#/c/214065/2/jenkins/jobs/manila.yaml | 07:25 |
| openstackgerrit | Merged openstack-infra/puppet-unbound: Fix target path for regular git clone during tests https://review.openstack.org/214886 | 07:30 |
| *** arxcruz has joined #openstack-infra | 07:32 | |
| *** pal has quit IRC | 07:32 | |
| *** sanjayu_ has joined #openstack-infra | 07:33 | |
| openstackgerrit | Merged openstack-infra/puppet-ssh: Fix target path for regular git clone during tests https://review.openstack.org/214877 | 07:33 |
| *** hyakuhei has joined #openstack-infra | 07:34 | |
| openstackgerrit | vikram.choudhary proposed openstack-infra/project-config: Add #openstack-onos to gerritbot https://review.openstack.org/214996 | 07:35 |
| openstackgerrit | Merged openstack-infra/puppet-redis: Fix target path for regular git clone during tests https://review.openstack.org/214872 | 07:36 |
| openstackgerrit | Merged openstack-infra/puppet-ssl_cert_check: Fix target path for regular git clone during tests https://review.openstack.org/214878 | 07:36 |
| openstackgerrit | Merged openstack-infra/puppet-sudoers: Fix target path for regular git clone during tests https://review.openstack.org/214882 | 07:36 |
| *** hyakuhei has quit IRC | 07:36 | |
| *** sanjayu has quit IRC | 07:36 | |
| openstackgerrit | Merged openstack-infra/puppet-statusbot: Fix target path for regular git clone during tests https://review.openstack.org/214879 | 07:37 |
| openstackgerrit | Merged openstack-infra/puppet-zanata: Fix target path for regular git clone during tests https://review.openstack.org/214891 | 07:37 |
| *** sshnaidm has joined #openstack-infra | 07:38 | |
| *** fhubik has joined #openstack-infra | 07:40 | |
| *** salv-orlando has quit IRC | 07:40 | |
| *** yamamoto has joined #openstack-infra | 07:40 | |
| *** nadya has joined #openstack-infra | 07:40 | |
| *** jcoufal has joined #openstack-infra | 07:41 | |
| openstackgerrit | Craige McWhirter proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install https://review.openstack.org/214821 | 07:41 |
| *** skylerberg has quit IRC | 07:41 | |
| *** sthillma has quit IRC | 07:42 | |
| openstackgerrit | Merged openstack-infra/puppet-tmpreaper: Fix target path for regular git clone during tests https://review.openstack.org/214883 | 07:44 |
| openstackgerrit | Merged openstack-infra/puppet-user: Fix target path for regular git clone during tests https://review.openstack.org/214887 | 07:44 |
| *** fhubik is now known as fhubik_brb | 07:44 | |
| *** skylerberg has joined #openstack-infra | 07:45 | |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Fix target path for regular git clone during tests https://review.openstack.org/214881 | 07:45 |
| *** nadya has quit IRC | 07:45 | |
| openstackgerrit | Merged openstack-infra/puppet-yum: Fix target path for regular git clone during tests https://review.openstack.org/214890 | 07:45 |
| *** markvoelker has joined #openstack-infra | 07:48 | |
| *** fedexo has quit IRC | 07:48 | |
| openstackgerrit | Merged openstack-infra/puppet-unattended_upgrades: Fix target path for regular git clone during tests https://review.openstack.org/214885 | 07:51 |
| openstackgerrit | Merged openstack-infra/puppet-mailman: Fix target path for regular git clone during tests https://review.openstack.org/214857 | 07:51 |
| *** camunoz has quit IRC | 07:51 | |
| openstackgerrit | Merged openstack-infra/puppet-kerberos: Fix target path for regular git clone during tests https://review.openstack.org/214851 | 07:52 |
| openstackgerrit | Merged openstack-infra/puppet-jenkins: Fix target path for regular git clone during tests https://review.openstack.org/214554 | 07:53 |
| *** markvoelker has quit IRC | 07:53 | |
| *** markus_z has joined #openstack-infra | 07:53 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul: Fix target path for regular git clone during tests https://review.openstack.org/214553 | 07:54 |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Fix target path for regular git clone during tests https://review.openstack.org/214549 | 07:54 |
| *** skylerberg has quit IRC | 07:54 | |
| *** salv-orlando has joined #openstack-infra | 07:55 | |
| *** ihrachyshka has joined #openstack-infra | 07:58 | |
| *** fhubik_brb is now known as fhubik | 07:59 | |
| *** fhubik is now known as fhubik_brb | 08:00 | |
| *** yamahata has joined #openstack-infra | 08:00 | |
| *** fhubik_brb is now known as fhubik | 08:02 | |
| *** hyakuhei has joined #openstack-infra | 08:03 | |
| fbo | nibalizer, hi thanks for spreading that patch on all repos :) where can I read that script explode.sh if I need it for future patches ? | 08:05 |
| *** derekh has joined #openstack-infra | 08:08 | |
| *** hyakuhei has quit IRC | 08:09 | |
| *** sridhar_ram has joined #openstack-infra | 08:11 | |
| *** dizquierdo has joined #openstack-infra | 08:14 | |
| *** sridhar_ram has quit IRC | 08:15 | |
| *** devvesa has joined #openstack-infra | 08:16 | |
| nibalizer | fbo: http://paste.openstack.org/show/422581/ | 08:16 |
| *** sflanigan has quit IRC | 08:17 | |
| *** zeih has joined #openstack-infra | 08:17 | |
| *** afazekas has joined #openstack-infra | 08:18 | |
| *** megm has joined #openstack-infra | 08:19 | |
| *** asettle has joined #openstack-infra | 08:19 | |
| fbo | it is like an ad-hoc script you just wrote for that specific case :) | 08:22 |
| *** fawadkhaliq has quit IRC | 08:23 | |
| fbo | I should do the same for putting +1 on all reviews but I'm not sure that's really safe to automate the reviews :p | 08:24 |
| *** asettle has quit IRC | 08:24 | |
| *** mrunge has joined #openstack-infra | 08:24 | |
| *** fawadkhaliq has joined #openstack-infra | 08:26 | |
| *** gildub has quit IRC | 08:26 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups: Refactor bleed margins of bootstrap theme https://review.openstack.org/214672 | 08:26 |
| *** jistr has joined #openstack-infra | 08:28 | |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed openstack/requirements: Cap oslo.db to less than 2.4 https://review.openstack.org/215009 | 08:29 |
| *** fhubik is now known as fhubik_brb | 08:29 | |
| *** romcheg has joined #openstack-infra | 08:30 | |
| *** romcheg has left #openstack-infra | 08:31 | |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed openstack/requirements: Cap oslo.db to less than 2.4 https://review.openstack.org/215009 | 08:32 |
| *** fhubik_brb is now known as fhubik | 08:33 | |
| openstackgerrit | Nicko Glayre proposed openstack-infra/jenkins-job-builder: Stash publisher's credentials configuration https://review.openstack.org/212004 | 08:34 |
| *** pal has joined #openstack-infra | 08:37 | |
| *** nadya has joined #openstack-infra | 08:40 | |
| *** shashank_hegde has quit IRC | 08:41 | |
| *** jeadre has quit IRC | 08:42 | |
| *** jeadre has joined #openstack-infra | 08:43 | |
| openstackgerrit | Merged openstack-infra/askbot-theme: Refactor css and font links to https https://review.openstack.org/211664 | 08:43 |
| *** scheuran has quit IRC | 08:44 | |
| *** zeih has quit IRC | 08:48 | |
| *** dingyichen has quit IRC | 08:49 | |
| *** zeih has joined #openstack-infra | 08:50 | |
| *** rossella_s has joined #openstack-infra | 08:52 | |
| *** dtantsur is now known as dtantsur|brb | 08:55 | |
| *** spiffxp has quit IRC | 08:58 | |
| *** markus_z has quit IRC | 08:59 | |
| *** spiffxp has joined #openstack-infra | 09:00 | |
| *** spiffxp is now known as Guest74668 | 09:00 | |
| *** yamamoto has quit IRC | 09:04 | |
| *** 7GHAAZ22K has joined #openstack-infra | 09:04 | |
| *** ociuhandu has quit IRC | 09:07 | |
| *** fawadkhaliq has quit IRC | 09:08 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [WIP] Remove heat pin https://review.openstack.org/214348 | 09:09 |
| *** eantyshev has joined #openstack-infra | 09:10 | |
| *** lucasagomes has joined #openstack-infra | 09:12 | |
| openstackgerrit | svasheka proposed openstack-infra/project-config: In order to copy screenshots after horizon integration tests, we need to make adjustment to horizon job. https://review.openstack.org/#/c/194646/14 https://review.openstack.org/215026 | 09:12 |
| openstackgerrit | svasheka proposed openstack-infra/project-config: In order to copy screenshots after horizon integration tests,we need to make adjustment to horizon job. https://review.openstack.org/#/c/194646/14 https://review.openstack.org/215026 | 09:13 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/devstack-gate: Support CloudLinux in devstack-gate https://review.openstack.org/215029 | 09:14 |
| openstackgerrit | svasheka proposed openstack-infra/project-config: In order to copy screenshots after horizon integration tests, we need to make adjustment to horizon job. https://review.openstack.org/#/c/194646/14 https://review.openstack.org/215026 | 09:15 |
| *** otter768 has joined #openstack-infra | 09:16 | |
| *** sdake_ has joined #openstack-infra | 09:18 | |
| *** markus_z has joined #openstack-infra | 09:18 | |
| *** jistr has quit IRC | 09:19 | |
| *** unicell1 has quit IRC | 09:20 | |
| *** otter768 has quit IRC | 09:20 | |
| *** jistr has joined #openstack-infra | 09:20 | |
| *** sdake has quit IRC | 09:21 | |
| *** unicell has joined #openstack-infra | 09:23 | |
| *** pelix has joined #openstack-infra | 09:25 | |
| *** fhubik is now known as fhubik_brb | 09:28 | |
| *** gaurangt has joined #openstack-infra | 09:28 | |
| *** nadya has quit IRC | 09:30 | |
| *** yamahata has quit IRC | 09:32 | |
| *** openkarma has joined #openstack-infra | 09:37 | |
| *** openkarma has quit IRC | 09:38 | |
| *** fhubik_brb is now known as fhubik | 09:38 | |
| *** nadya has joined #openstack-infra | 09:38 | |
| *** openkarma has joined #openstack-infra | 09:44 | |
| *** fhubik is now known as fhubik_brb | 09:44 | |
| *** markvoelker has joined #openstack-infra | 09:49 | |
| *** markvoelker has quit IRC | 09:54 | |
| *** dims has joined #openstack-infra | 09:56 | |
| *** fawadkhaliq has joined #openstack-infra | 09:58 | |
| *** fhubik_brb is now known as fhubik | 09:59 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 10:02 |
| *** Kennan2 has joined #openstack-infra | 10:03 | |
| *** matbu has quit IRC | 10:03 | |
| *** matbu has joined #openstack-infra | 10:04 | |
| *** Kennan has quit IRC | 10:04 | |
| *** Yanyan has quit IRC | 10:05 | |
| *** ociuhandu has joined #openstack-infra | 10:06 | |
| *** amotoki has quit IRC | 10:08 | |
| *** dtantsur|brb is now known as dtantsur | 10:09 | |
| *** fawadkhaliq has quit IRC | 10:13 | |
| *** bharath_ has joined #openstack-infra | 10:13 | |
| openstackgerrit | Gary Duan proposed openstack/diskimage-builder: Contains the directory name of sys and proc when creating ramdisk for ironic-agent https://review.openstack.org/215052 | 10:14 |
| *** markus_z has quit IRC | 10:15 | |
| *** sdake_ is now known as sdake | 10:15 | |
| openstackgerrit | Nicko Glayre proposed openstack-infra/jenkins-job-builder: Stash publisher's credentials configuration https://review.openstack.org/212004 | 10:20 |
| *** zeih has quit IRC | 10:23 | |
| *** 7GHAAZ22K has quit IRC | 10:25 | |
| *** glauco_ has joined #openstack-infra | 10:32 | |
| *** yolanda has quit IRC | 10:35 | |
| openstackgerrit | Gary Duan proposed openstack/diskimage-builder: Contains the directory name of /sys and /proc when creating ramdisk for ironic python agent https://review.openstack.org/215060 | 10:36 |
| *** glauco_ has quit IRC | 10:38 | |
| *** fawadkhaliq has joined #openstack-infra | 10:38 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 10:40 |
| *** yolanda has joined #openstack-infra | 10:45 | |
| *** shardy_ has joined #openstack-infra | 10:48 | |
| *** shardy has quit IRC | 10:48 | |
| *** yolanda has quit IRC | 10:50 | |
| *** zeih has joined #openstack-infra | 10:50 | |
| openstackgerrit | Merged openstack/requirements: Bump oslo.db to version 2.4 https://review.openstack.org/214536 | 10:52 |
| *** shardy_ has quit IRC | 10:53 | |
| *** yolanda has joined #openstack-infra | 10:53 | |
| *** shardy has joined #openstack-infra | 10:54 | |
| *** AJaeger has joined #openstack-infra | 10:54 | |
| *** unicell1 has joined #openstack-infra | 10:57 | |
| *** unicell has quit IRC | 10:58 | |
| openstackgerrit | Nicko Glayre proposed openstack-infra/jenkins-job-builder: Stash publisher's credentials configuration https://review.openstack.org/212004 | 10:58 |
| *** erikwilson has joined #openstack-infra | 10:58 | |
| *** mwagner_lap has quit IRC | 11:01 | |
| *** erikwilson has quit IRC | 11:03 | |
| *** unicell1 has quit IRC | 11:04 | |
| *** aukhan has quit IRC | 11:04 | |
| *** unicell has joined #openstack-infra | 11:04 | |
| *** shardy_ has joined #openstack-infra | 11:06 | |
| *** shardy has quit IRC | 11:08 | |
| *** shardy_ has quit IRC | 11:11 | |
| *** shardy has joined #openstack-infra | 11:12 | |
| *** unicell has quit IRC | 11:13 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 11:13 |
| *** unicell has joined #openstack-infra | 11:13 | |
| *** yamamoto_ has joined #openstack-infra | 11:14 | |
| *** dims has quit IRC | 11:15 | |
| *** dims has joined #openstack-infra | 11:16 | |
| *** otter768 has joined #openstack-infra | 11:17 | |
| *** dims has quit IRC | 11:20 | |
| *** otter768 has quit IRC | 11:22 | |
| *** gaurangt has left #openstack-infra | 11:24 | |
| *** baoli has joined #openstack-infra | 11:25 | |
| openstackgerrit | Merged openstack-infra/groups: Refactor bleed margins of bootstrap theme https://review.openstack.org/214672 | 11:25 |
| *** pc_m has joined #openstack-infra | 11:28 | |
| *** baoli has quit IRC | 11:30 | |
| *** markus_z has joined #openstack-infra | 11:30 | |
| *** scheuran has joined #openstack-infra | 11:32 | |
| *** pal has quit IRC | 11:33 | |
| *** dims has joined #openstack-infra | 11:33 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/diskimage-builder: Fixes config drive creation failure in UEFI boot mode https://review.openstack.org/215095 | 11:34 |
| *** dprince has joined #openstack-infra | 11:35 | |
| *** markvoelker has joined #openstack-infra | 11:35 | |
| *** lucasagomes is now known as lucas-hungry | 11:37 | |
| *** BharatK has quit IRC | 11:37 | |
| *** pal has joined #openstack-infra | 11:39 | |
| *** markvoelker has quit IRC | 11:40 | |
| *** ldnunes has joined #openstack-infra | 11:42 | |
| *** thorst has joined #openstack-infra | 11:43 | |
| *** yamamoto_ has quit IRC | 11:44 | |
| *** gordc has joined #openstack-infra | 11:45 | |
| *** salv-orlando has quit IRC | 11:45 | |
| *** samueldmq has joined #openstack-infra | 11:46 | |
| *** afazekas has quit IRC | 11:46 | |
| *** hyakuhei has joined #openstack-infra | 11:47 | |
| *** dansmith has quit IRC | 11:47 | |
| *** dizquierdo has quit IRC | 11:47 | |
| *** dansmith has joined #openstack-infra | 11:48 | |
| *** dansmith is now known as Guest95328 | 11:48 | |
| *** woodster_ has joined #openstack-infra | 11:48 | |
| *** arxcruz has quit IRC | 11:56 | |
| *** bdemers has quit IRC | 11:59 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Change heat pin to a temprevert https://review.openstack.org/214348 | 12:01 |
| *** hyakuhei has quit IRC | 12:01 | |
| *** hyakuhei has joined #openstack-infra | 12:01 | |
| *** arxcruz has joined #openstack-infra | 12:01 | |
| openstackgerrit | Merged openstack-infra/nodepool: Fix exception formatter in instance delete https://review.openstack.org/213290 | 12:03 |
| *** derekh is now known as derekh_afk | 12:03 | |
| markus_z | A 2nd +2 would be nice: https://review.openstack.org/#/c/210481/ Should be helpful for the upcoming bugfixing phase | 12:07 |
| *** bswartz has quit IRC | 12:08 | |
| openstackgerrit | Merged openstack-infra/nodepool: Fix schema validator to allow specifying a gearman port https://review.openstack.org/212577 | 12:08 |
| *** salv-orlando has joined #openstack-infra | 12:11 | |
| *** bharath_ has quit IRC | 12:13 | |
| *** gildub has joined #openstack-infra | 12:15 | |
| *** sdake has quit IRC | 12:17 | |
| *** shardy_ has joined #openstack-infra | 12:19 | |
| *** erlon has joined #openstack-infra | 12:19 | |
| *** glauco_ has joined #openstack-infra | 12:20 | |
| *** hyakuhei has quit IRC | 12:20 | |
| *** shardy has quit IRC | 12:20 | |
| *** asettle has joined #openstack-infra | 12:22 | |
| *** doug-fish has joined #openstack-infra | 12:23 | |
| *** dkranz has quit IRC | 12:23 | |
| *** pal has quit IRC | 12:23 | |
| *** asettle has quit IRC | 12:23 | |
| *** fawadkhaliq has quit IRC | 12:24 | |
| *** aysyd has joined #openstack-infra | 12:24 | |
| *** shardy_ has quit IRC | 12:24 | |
| openstackgerrit | svasheka proposed openstack-infra/project-config: In order to copy screenshots after horizon integration tests, we need to make adjustment to horizon job. https://review.openstack.org/#/c/194646/14 https://review.openstack.org/215026 | 12:25 |
| *** shardy has joined #openstack-infra | 12:25 | |
| *** glauco_ has quit IRC | 12:27 | |
| openstackgerrit | svasheka proposed openstack-infra/project-config: Add copy-screenshots publisher https://review.openstack.org/215026 | 12:28 |
| *** hyakuhei has joined #openstack-infra | 12:29 | |
| *** ociuhandu_ has joined #openstack-infra | 12:32 | |
| *** ociuhandu has quit IRC | 12:33 | |
| *** ociuhandu_ is now known as ociuhandu | 12:33 | |
| *** unicell1 has joined #openstack-infra | 12:34 | |
| *** unicell has quit IRC | 12:34 | |
| *** glauco_ has joined #openstack-infra | 12:35 | |
| *** signed8bit has joined #openstack-infra | 12:36 | |
| *** cburroughs has joined #openstack-infra | 12:37 | |
| *** mwagner_lap has joined #openstack-infra | 12:37 | |
| *** flaviosr has joined #openstack-infra | 12:38 | |
| *** markvoelker has joined #openstack-infra | 12:39 | |
| *** thiagop has joined #openstack-infra | 12:41 | |
| openstackgerrit | svasheka proposed openstack-infra/project-config: Add copy-screenshots publisher https://review.openstack.org/215026 | 12:41 |
| *** hyakuhei has quit IRC | 12:42 | |
| *** mriedem has joined #openstack-infra | 12:42 | |
| *** hyakuhei has joined #openstack-infra | 12:42 | |
| *** tlian has joined #openstack-infra | 12:43 | |
| *** yamamoto has joined #openstack-infra | 12:44 | |
| openstackgerrit | svasheka proposed openstack-infra/project-config: Add copy-screenshots publisher https://review.openstack.org/215026 | 12:45 |
| *** chlong has joined #openstack-infra | 12:46 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Bump timeout for ironic-inspector job to usual 2 hours https://review.openstack.org/215121 | 12:46 |
| *** dtantsur is now known as dtantsur|brb | 12:47 | |
| *** lucas-hungry is now known as lucasagomes | 12:48 | |
| *** dtantsur|brb is now known as dtantsur|mtg | 12:48 | |
| *** mriedem has quit IRC | 12:49 | |
| *** yamamoto has quit IRC | 12:49 | |
| *** annegentle has joined #openstack-infra | 12:50 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Make ironic-inspector-dsvm voting on ironic-inspector https://review.openstack.org/209050 | 12:50 |
| *** mriedem has joined #openstack-infra | 12:51 | |
| *** cbader has quit IRC | 12:51 | |
| *** yamamoto has joined #openstack-infra | 12:51 | |
| *** yamamoto has quit IRC | 12:51 | |
| *** yamamoto has joined #openstack-infra | 12:52 | |
| *** yamamoto has quit IRC | 12:52 | |
| *** hyakuhei has quit IRC | 12:52 | |
| *** yamamoto has joined #openstack-infra | 12:52 | |
| *** jistr is now known as jistr|mtg | 12:53 | |
| *** hyakuhei has joined #openstack-infra | 12:55 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 12:55 | |
| *** bswartz has joined #openstack-infra | 12:57 | |
| *** fhubik has quit IRC | 12:58 | |
| *** erikwilson has joined #openstack-infra | 12:59 | |
| *** pc_m has quit IRC | 12:59 | |
| *** pc_m has joined #openstack-infra | 12:59 | |
| *** chlong has quit IRC | 13:00 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 13:00 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/requirements: block oslo.middleware 2.6.0 https://review.openstack.org/215124 | 13:01 |
| sileht | dhellmann, ^ | 13:02 |
| openstackgerrit | Merged openstack-infra/reviewday: Make the review list sortable by review type https://review.openstack.org/210481 | 13:03 |
| openstackgerrit | Merged openstack-infra/nodepool: Support SIGINT to gracefully stop nodepoold https://review.openstack.org/206562 | 13:03 |
| *** amitgandhinz has joined #openstack-infra | 13:03 | |
| *** flaviosr has quit IRC | 13:03 | |
| *** fhubik has joined #openstack-infra | 13:04 | |
| *** erikwilson has quit IRC | 13:04 | |
| *** chlong has joined #openstack-infra | 13:04 | |
| openstackgerrit | Nicko Glayre proposed openstack-infra/jenkins-job-builder: Customized pollscm trigger https://review.openstack.org/211993 | 13:05 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 13:05 |
| dhellmann | sileht: +2a | 13:05 |
| *** jyuso1 has quit IRC | 13:08 | |
| *** jswarren has quit IRC | 13:08 | |
| *** jyuso1 has joined #openstack-infra | 13:09 | |
| *** fhubik has quit IRC | 13:09 | |
| *** erikwilson has joined #openstack-infra | 13:11 | |
| mriedem | i feel like the logstash job queue has been bonkers for about a week | 13:14 |
| mriedem | we haven't been able to get logstash hits for any new gate bugs really | 13:14 |
| mriedem | like https://bugs.launchpad.net/neutron/+bug/1485969 | 13:14 |
| openstack | Launchpad bug 1485969 in neutron "test_dualnet_multi_prefix_dhcpv6_stateless failed due to "RuntimeError: Set changed size during iteration" in quota code" [Undecided,In progress] - Assigned to Ihar Hrachyshka (ihar-hrachyshka) | 13:14 |
| *** wenlock has joined #openstack-infra | 13:14 | |
| mriedem | i do'nt know how bad that is right now | 13:14 |
| *** dizquierdo has joined #openstack-infra | 13:15 | |
| *** rfolco has joined #openstack-infra | 13:15 | |
| clarkb | mriedem there is a bug in os-loganalyze and we are indexing html not txt logs | 13:15 |
| *** hyakuhei has quit IRC | 13:15 | |
| clarkb | once the fix for that merges we should get back to normal | 13:15 |
| mriedem | whew | 13:16 |
| *** pc_m_ has joined #openstack-infra | 13:16 | |
| *** alivigni has joined #openstack-infra | 13:17 | |
| *** otter768 has joined #openstack-infra | 13:18 | |
| *** krtaylor has quit IRC | 13:18 | |
| *** pc_m has quit IRC | 13:20 | |
| *** bdemers has joined #openstack-infra | 13:21 | |
| *** jswarren has joined #openstack-infra | 13:21 | |
| *** otter768 has quit IRC | 13:23 | |
| *** jyuso1 has quit IRC | 13:23 | |
| *** ayoung has joined #openstack-infra | 13:24 | |
| *** fawadkhaliq has joined #openstack-infra | 13:24 | |
| *** xyang1 has joined #openstack-infra | 13:25 | |
| *** fawadkhaliq has quit IRC | 13:28 | |
| openstackgerrit | ewitter proposed openstack-infra/git-review: Autotopic: read from configuration file . https://review.openstack.org/214895 | 13:28 |
| *** jamielennox is now known as jamielennox|away | 13:30 | |
| *** zul has joined #openstack-infra | 13:30 | |
| *** krtaylor has joined #openstack-infra | 13:31 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install https://review.openstack.org/214821 | 13:32 |
| fungi | clarkb: ^ that gets us much closer, now deployed at 2001:4800:7817:103:be76:4eff:fe05:98d4 23.253.124.152 | 13:32 |
| fungi | still need to massage the apache vhost config though | 13:33 |
| *** bcourt has quit IRC | 13:33 | |
| clarkb | fungi the symlink should require the nodejs package | 13:34 |
| clarkb | to avoid temporary dangling symlink | 13:34 |
| fungi | can do that i suppose | 13:35 |
| *** dims_ has joined #openstack-infra | 13:35 | |
| clarkb | I wouldnt respin for that though, would wait for apache things | 13:36 |
| *** prad_ has joined #openstack-infra | 13:36 | |
| fungi | also the apache situation is weird. if i manually update puppet on the server after deploying, the config errors are absent :/ | 13:36 |
| fungi | suggests a race in our puppetry | 13:36 |
| clarkb | my guess is with mod enablement | 13:36 |
| fungi | specifically, it's complaining that RewriteEngine is unrecognized. i bet we're not enabling mod_rewrite early enough | 13:37 |
| *** eharney has joined #openstack-infra | 13:37 | |
| clarkb | :) | 13:37 |
| openstackgerrit | Glauco Oliveira proposed openstack-infra/puppet-gerrit: Implementing a set of acceptance tests for puppet-gerrit. https://review.openstack.org/214725 | 13:37 |
| *** dkranz has joined #openstack-infra | 13:37 | |
| fungi | hrm, also it's complaining the connection tuning config snippet isn't getting installed on the initial pass. we may need that to happen after apache is installed so the destination path will exist | 13:38 |
| fungi | either that or puppet the parent directories | 13:39 |
| *** dims has quit IRC | 13:39 | |
| *** tiswanso has joined #openstack-infra | 13:40 | |
| openstackgerrit | Matthias Runge proposed openstack-infra/project-config: Switch Django-1.8 test to voting https://review.openstack.org/214561 | 13:41 |
| *** geoffarnoldX is now known as geoffarnold | 13:42 | |
| *** amitgandhinz has quit IRC | 13:42 | |
| *** gildub has quit IRC | 13:44 | |
| *** dims_ has quit IRC | 13:44 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 13:44 |
| *** vadimk_ has joined #openstack-infra | 13:45 | |
| *** dims has joined #openstack-infra | 13:46 | |
| *** julim has joined #openstack-infra | 13:46 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 13:46 | |
| *** prad_ is now known as pradk | 13:47 | |
| *** fawadkhaliq has joined #openstack-infra | 13:48 | |
| *** bcourt has joined #openstack-infra | 13:48 | |
| *** pal has joined #openstack-infra | 13:48 | |
| *** amitgandhinz has joined #openstack-infra | 13:48 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 13:49 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 13:50 | |
| *** xyang1 has quit IRC | 13:52 | |
| *** atuvenie has joined #openstack-infra | 13:54 | |
| *** pal has quit IRC | 13:56 | |
| *** regXboi has joined #openstack-infra | 13:56 | |
| *** pal has joined #openstack-infra | 13:57 | |
| *** larainema has quit IRC | 13:58 | |
| *** tvanderwiel has joined #openstack-infra | 13:58 | |
| *** tvanderwiel has quit IRC | 13:58 | |
| *** xyang1 has joined #openstack-infra | 13:59 | |
| *** skraynev has quit IRC | 13:59 | |
| *** skraynev has joined #openstack-infra | 14:00 | |
| *** Guest95328 is now known as dansmith | 14:00 | |
| svasheka | guys does somebody knows a way to get notification on particullar job failure throughout all patches? | 14:02 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:03 | |
| *** warpc__ has joined #openstack-infra | 14:04 | |
| *** signed8bit_ZZZzz has quit IRC | 14:06 | |
| EmilienM | svasheka: logstash can help | 14:07 |
| *** afazekas has joined #openstack-infra | 14:07 | |
| svasheka | EmilienM, can you please be more specific? | 14:08 |
| EmilienM | sure | 14:08 |
| *** jistr|mtg is now known as jistr | 14:08 | |
| *** fhubik has joined #openstack-infra | 14:09 | |
| EmilienM | svasheka: a sec | 14:09 |
| EmilienM | svasheka: http://goo.gl/ABEk7D | 14:10 |
| EmilienM | svasheka: this is an example with a QUERY that contains an error message | 14:10 |
| *** dtantsur|mtg is now known as dtantsur | 14:10 | |
| *** bcourt has quit IRC | 14:10 | |
| *** geoffarnold has quit IRC | 14:10 | |
| EmilienM | there is a RSS link so you can follow new failures for all jobs | 14:11 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 14:13 |
| *** ajmiller has joined #openstack-infra | 14:13 | |
| *** signed8bit has joined #openstack-infra | 14:14 | |
| *** kgiusti has joined #openstack-infra | 14:14 | |
| *** kiran-r has joined #openstack-infra | 14:14 | |
| *** kiran-r has quit IRC | 14:15 | |
| *** doug-fish has quit IRC | 14:16 | |
| *** doug-fish has joined #openstack-infra | 14:16 | |
| *** dtantsur is now known as dtantsur|mtg | 14:17 | |
| svasheka | EmilienM, thanks | 14:17 |
| *** zul has quit IRC | 14:17 | |
| *** mtanino has joined #openstack-infra | 14:17 | |
| *** yamamoto has quit IRC | 14:17 | |
| EmilienM | svasheka: hope it helps! | 14:17 |
| *** yamamoto has joined #openstack-infra | 14:19 | |
| *** yamamoto has quit IRC | 14:19 | |
| *** yamamoto has joined #openstack-infra | 14:19 | |
| *** lucasagomes is now known as lucas-afk | 14:21 | |
| *** cdent has joined #openstack-infra | 14:21 | |
| *** bcourt has joined #openstack-infra | 14:22 | |
| *** vlaza has left #openstack-infra | 14:26 | |
| *** pal_ has joined #openstack-infra | 14:27 | |
| *** pal has quit IRC | 14:27 | |
| *** glauco_ has quit IRC | 14:29 | |
| *** FallenPegasus has joined #openstack-infra | 14:33 | |
| *** fawadkhaliq has quit IRC | 14:33 | |
| *** doug-fish has quit IRC | 14:33 | |
| *** doug-fish has joined #openstack-infra | 14:33 | |
| *** mpopow has joined #openstack-infra | 14:34 | |
| *** tonytan4ever has joined #openstack-infra | 14:36 | |
| *** mpopow has quit IRC | 14:37 | |
| *** doug-fish has quit IRC | 14:38 | |
| *** cbader has joined #openstack-infra | 14:39 | |
| *** amitgandhinz has quit IRC | 14:39 | |
| *** amitgandhinz has joined #openstack-infra | 14:40 | |
| *** zeih has quit IRC | 14:40 | |
| *** geoffarnold has joined #openstack-infra | 14:40 | |
| *** samueldmq has quit IRC | 14:40 | |
| clarkb | now I know what its like when we mob a place during conferences | 14:41 |
| clarkb | my breakfast currebtly interrupted by some large group of conference goers | 14:41 |
| *** tsekiyama has joined #openstack-infra | 14:41 | |
| *** sabeen has joined #openstack-infra | 14:42 | |
| *** ddieterly has joined #openstack-infra | 14:42 | |
| fungi | take no prisoners | 14:43 |
| *** peristeri has quit IRC | 14:43 | |
| *** signed8bit has quit IRC | 14:43 | |
| *** zeih has joined #openstack-infra | 14:43 | |
| clarkb | I wonder how hard it will be to do that in tokyo | 14:44 |
| *** signed8bit has joined #openstack-infra | 14:44 | |
| *** glauco has joined #openstack-infra | 14:44 | |
| *** sabeen3 has joined #openstack-infra | 14:45 | |
| *** sabeen has quit IRC | 14:47 | |
| *** bpokorny has joined #openstack-infra | 14:47 | |
| *** zeih has quit IRC | 14:48 | |
| *** mpopow has joined #openstack-infra | 14:48 | |
| *** pal_ has quit IRC | 14:48 | |
| *** mpopow has quit IRC | 14:48 | |
| jeblair | we should all cross an intersection at the same time | 14:49 |
| *** zz_dimtruck is now known as dimtruck | 14:49 | |
| *** derekh_afk is now known as derekh | 14:50 | |
| *** minwang2 has joined #openstack-infra | 14:53 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install https://review.openstack.org/214821 | 14:53 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Fix races in httpd install and config https://review.openstack.org/215169 | 14:53 |
| *** shardy_ has joined #openstack-infra | 14:53 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/requirements: block oslo.middleware 2.6.0 https://review.openstack.org/215124 | 14:53 |
| fungi | still testing that ^ | 14:53 |
| pabelanger | fungi: clarkb: jeblair: I was hoping you'd be able to help me figure out the best way to get an experimental multinode job going. My first thought, was to see about adding something into the openstack-dev/sandbox, a simple 1 subnode gate. | 14:54 |
| clarkb | I wonder if puppet sorted alphabetically in the past so when it was called "apache" it just worked but now that it is httpd we lose | 14:54 |
| *** shardy has quit IRC | 14:54 | |
| jeblair | clarkb: oh good notion | 14:54 |
| clarkb | pabelanger we have a few at this point if you want to look at prior art | 14:54 |
| *** signed8bit has quit IRC | 14:55 | |
| clarkb | pabelanger greo for multinode to find them but most of the magic is in devstack gate | 14:55 |
| fungi | clarkb: well, this could also be lingering/unnoticed since it was already "eventually consistent" (just needed more than one puppet run to get there) | 14:55 |
| *** signed8bit has joined #openstack-infra | 14:55 | |
| *** ashleighfarnham has quit IRC | 14:56 | |
| clarkb | I want to say we saw it with another module after the httpd switch though | 14:56 |
| pabelanger | clarkb: Ya, I was thinking of adding my code into devstack repo just to get access to the multi-node stuff. The stuff I want to work on is the ansible launcher I have running locally. Even, do some initial prep work for zuulv3 spec | 14:56 |
| *** annegentle has quit IRC | 14:58 | |
| *** shardy_ has quit IRC | 14:58 | |
| *** dkranz has quit IRC | 14:58 | |
| *** annegentle has joined #openstack-infra | 14:58 | |
| *** arxcruz has quit IRC | 14:59 | |
| jgriffith | I'm interested in adding a new gate item to Cinder, have the layout in project-config, but don't recall the steps to provide the actual tox instruction to run it. Anybody have a minute to point me in the right direction? | 14:59 |
| clarkb | fungi it was openstackci and its beaker test | 14:59 |
| *** shardy has joined #openstack-infra | 14:59 | |
| fungi | clarkb: aha, seems likely in that case | 14:59 |
| pabelanger | clarkb: so, how do we -infra see people wanting to add multi-node support into a project working? Would each project create an experimental job into their own namespace, or some sort of sandbox to simply see nodepool subnodes work | 14:59 |
| jgriffith | FWIW I'm moving the genconfig out of the pep8 heading in tox and into it's own test-case (non-voting) | 14:59 |
| *** dangers_away is now known as dangers | 15:00 | |
| *** austin81 has joined #openstack-infra | 15:00 | |
| clarkb | pabelanger I wouldnt use the sandbox repo since it isnt meant for real work, I would run the job against the appropriate projwct. also you shouldnt need multinode to test an ansible job runner fwiw | 15:01 |
| clarkb | jgriffith in project-config under jenkins/jobs you want to add the job. | 15:01 |
| jgriffith | clarkb: thanks! | 15:01 |
| clarkb | jgriffith there should already be a run tox template that you can pass a tox env name to to run that | 15:02 |
| *** zul has joined #openstack-infra | 15:02 | |
| jgriffith | clarkb: yup, found it, thank you | 15:02 |
| pabelanger | clarkb: I guess I could loop back ansible launcher, but that was the initial setup. | 15:02 |
| clarkb | pabelanger ya either ssh localhost or use ansibles local "connwction" which is really just a fork I think | 15:03 |
| fungi | clarkb: should i just drop the absent file resource at https://review.openstack.org/#/c/214821/5/manifests/init.pp or is there a good way to make this so we can switch back and forth without manually deleting things? | 15:03 |
| clarkb | that way you start simple and work out bugs before worrying about the more complex case | 15:03 |
| pabelanger | clarkb: Ya, I was mostly doing this in parallel. See what is needed to get multinode experimental going, since that will take the code some time to get merged | 15:04 |
| *** fhubik has quit IRC | 15:04 | |
| clarkb | fungi is the usr local path hardcoded? maybe we can rely on PATH to fibd it for usm | 15:04 |
| pabelanger | clarkb: could you see me experimental job for multi-nodes into system-config, or would that be out of the question? | 15:05 |
| clarkb | fungi then it can be in either location without pupoet caring | 15:05 |
| clarkb | pabelanger honestly I would want a single node job first | 15:05 |
| fungi | clarkb: it's not hard-coded, no. mostly just wondering if the nodejs source install will freak when it attempts to overwrite that symlink with an executable | 15:05 |
| *** glauco has quit IRC | 15:05 | |
| *** fawadkhaliq has joined #openstack-infra | 15:06 | |
| clarkb | fungi I think it will freak if we go source => package => source on the same host | 15:06 |
| fungi | what about just package => source? will it sanely replace that symlink? | 15:06 |
| fungi | i suppose i can test that | 15:07 |
| *** erikwilson has quit IRC | 15:07 | |
| openstackgerrit | Alexander Tivelkov proposed openstack/requirements: Bump yaql to version 1.0 https://review.openstack.org/215182 | 15:07 |
| *** erikwilson has joined #openstack-infra | 15:07 | |
| *** signed8bit has quit IRC | 15:08 | |
| *** kushal has joined #openstack-infra | 15:08 | |
| clarkb | pabelanger: what we have seen with multinode jobs is that everyone wants them until they have them then they get neglected because its hard | 15:08 |
| clarkb | pabelanger: so IMO its good to have a solid single node test before bothering with the extra complexity | 15:08 |
| clarkb | especially since in this case I don't think there is anything multinode would test that single node cant test | 15:09 |
| odyssey4me | fungi I see that the ubuntu-trusty image doesn't have growroot, so while disk 1 is 80gb, and the partition is 80gb, it's root file system is only 14gb | 15:09 |
| clarkb | odyssey4me: that should be fixed real soon now | 15:09 |
| *** erikwilson has quit IRC | 15:09 | |
| fungi | odyssey4me: i believe greghaynes was working on that | 15:09 |
| *** pal has joined #openstack-infra | 15:09 | |
| clarkb | yup greghaynes has a change to dib to fix that | 15:09 |
| clarkb | so once that is merged and released we will get new images with properly sized filesystems | 15:10 |
| fungi | we just have to not rely on cloud-init or its initramfs magic to do that, since it drags in all sorts of distro packages of python modules | 15:10 |
| *** dizquierdo has quit IRC | 15:10 | |
| clarkb | and the existing package to do it is broken | 15:10 |
| clarkb | so its all sorts of fun | 15:10 |
| pabelanger | clarkb: Right, that's why I was looking into some sort of experimental sandbox for multi-node. Some place off in the corner where people could really play with it to get a better understanding how it works. Since, the process will be noisy to start | 15:10 |
| odyssey4me | ah awesome - do you have the review for that handy? I'd like to track it | 15:11 |
| *** ihrachyshka has quit IRC | 15:11 | |
| clarkb | pabelanger: I guess I don't understand the motivation then. Are you wanting to test an asnible job runner? do that on a single node. If you want to explore the multinode setup play with the existing jobs | 15:11 |
| fungi | anyway, slightly further now. no puppet errors with that patch series and seems to function 2001:4800:7815:102:be76:4eff:fe04:a65d 23.253.89.133 https://etherpad-dev.openstack.org/p/things if anyone wants to help test | 15:11 |
| clarkb | pabelanger: if you push changes to d-g you can very easily manipulate the multinode test envs | 15:11 |
| *** AJaeger has quit IRC | 15:12 | |
| clarkb | fungi: let me update my resolv.conf | 15:12 |
| *** dprince has quit IRC | 15:12 | |
| clarkb | er /etc/hosts | 15:12 |
| *** amitgandhinz has quit IRC | 15:12 | |
| fungi | looks like the vhost config itself was already basically apache 2.4 ready | 15:13 |
| pabelanger | clarkb: Right, d-g is the only place right now. And going to look into it, just afraid of the potential noise my patchset will cause. Either way, thanks I'll look into those 2 things | 15:13 |
| *** f1ller is now known as filler | 15:14 | |
| clarkb | pabelanger: the problem with using sandbox is people push all kinds of junk there and I don't think its appropriate to go run complex test scenarios based off of that | 15:14 |
| *** dkranz has joined #openstack-infra | 15:14 | |
| clarkb | pabelanger: its a gerrit sandbox not a jenkins sandbox. Maybe we need a jenkins sandbox too | 15:14 |
| pabelanger | clarkb: Ya, the only other place I've done work with multinode, is local setups. | 15:14 |
| *** hodos has joined #openstack-infra | 15:14 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Pull instack in upstream tripleo https://review.openstack.org/215186 | 15:16 |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Pull instack into upstream tripleo https://review.openstack.org/215186 | 15:17 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Allow system nodejs install https://review.openstack.org/214821 | 15:17 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-etherpad_lite: Fix races in httpd install and config https://review.openstack.org/215169 | 15:17 |
| fungi | okay, that's got the /usr/local/bin/node symlink removal taken back out | 15:18 |
| *** mpopow has joined #openstack-infra | 15:18 | |
| * timrc looks at gearman-plugin and frowns. | 15:19 | |
| *** otter768 has joined #openstack-infra | 15:19 | |
| *** eharney has quit IRC | 15:19 | |
| *** stevemar has joined #openstack-infra | 15:21 | |
| *** dannywilson has joined #openstack-infra | 15:21 | |
| *** BharatK has joined #openstack-infra | 15:21 | |
| *** jistr is now known as jistr|mtg | 15:22 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: ceilometer: increase timeout of integration job https://review.openstack.org/215190 | 15:22 |
| *** otter768 has quit IRC | 15:23 | |
| *** mpopow has quit IRC | 15:23 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 15:24 |
| *** FallenPegasus has quit IRC | 15:24 | |
| *** pal has quit IRC | 15:24 | |
| odyssey4me | clarkb fungi I take it this is the review that's pending for growroot? https://review.openstack.org/206636 | 15:24 |
| *** pal has joined #openstack-infra | 15:24 | |
| clarkb | odyssey4me: that looks correct | 15:25 |
| BharatK | clarkb, Regarding the patch https://review.openstack.org/#/c/214065/ | 15:25 |
| fungi | also i think there's some related cleanup needed (proposed?) in the simple-init element to stop installing the cloud-utils package | 15:25 |
| BharatK | clarkb, In our job definition we enabled Neutron. So is that mandatory to have 'neutron' in the job name? | 15:26 |
| clarkb | BharatK: no | 15:26 |
| *** hdd has joined #openstack-infra | 15:26 | |
| BharatK | clarkb, Thanks. https://review.openstack.org/#/c/214065/ please review this patch when you have time. | 15:26 |
| clarkb | at least I haven't cared about that, it is handy where we do both neutron and nova net but things are slowly moving away from nova net | 15:26 |
| BharatK | clarkb, Oh okay. | 15:27 |
| *** samueldmq has joined #openstack-infra | 15:28 | |
| *** scheuran has quit IRC | 15:28 | |
| clarkb | jeblair: fungi pleia2 https://review.openstack.org/#/c/214692/1 is the fix for the current logstash index all the html situation | 15:29 |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Tripleo CI reshuffle https://review.openstack.org/205479 | 15:29 |
| clarkb | reviews there would be helpful | 15:29 |
| *** sshnaidm has quit IRC | 15:31 | |
| *** Swami has joined #openstack-infra | 15:31 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: ceilometer: increase timeout of integration job https://review.openstack.org/215190 | 15:32 |
| *** zul has quit IRC | 15:33 | |
| *** kushal has quit IRC | 15:33 | |
| *** kushal has joined #openstack-infra | 15:33 | |
| *** kushal has quit IRC | 15:33 | |
| *** kushal has joined #openstack-infra | 15:33 | |
| openstackgerrit | Merged openstack-infra/os-loganalyze: Only provide html if client supports it https://review.openstack.org/214692 | 15:34 |
| *** pal has quit IRC | 15:35 | |
| *** r-daneel has joined #openstack-infra | 15:36 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-jenkins: Set jenkins key with more generic name https://review.openstack.org/215197 | 15:37 |
| *** geoffarnold has quit IRC | 15:41 | |
| *** armax has joined #openstack-infra | 15:44 | |
| openstackgerrit | Augustina Ragwitz proposed openstack-infra/nodepool: Overall documentation improvements focused on setup and testing https://review.openstack.org/214319 | 15:46 |
| *** mriedem is now known as mriedem_away | 15:46 | |
| *** mwagner_lap has quit IRC | 15:50 | |
| therve | clarkb, Logs problem seems fixed \o/ | 15:50 |
| *** angdraug has joined #openstack-infra | 15:51 | |
| clarkb | therve: yup looks good from here too | 15:51 |
| clarkb | need to give the indexrs time to catch up so there is likely a delay until elasticsearch sees it | 15:52 |
| clarkb | but we ar eon track to working again | 15:52 |
| * therve nods | 15:52 | |
| *** salv-orlando has quit IRC | 15:52 | |
| fungi | welp, i accidentally tested deploying that puppet-etherpad_lite stack without system node and it also worked correctly, albeit took an extra 20+ minutes to install | 15:52 |
| *** doug-fish has joined #openstack-infra | 15:52 | |
| fungi | rather, accidentally tested on trusty | 15:52 |
| clarkb | thats reassuring that it works ) | 15:52 |
| fungi | doing again without system node on precise to make sure that's not going to get broken | 15:52 |
| *** hyakuhei has joined #openstack-infra | 15:53 | |
| *** hogepodge has quit IRC | 15:53 | |
| fungi | when it comes time to replace etherpad-dev, i assume we'll want to test a db import as well | 15:54 |
| *** btully has joined #openstack-infra | 15:54 | |
| *** sergmelikyan has joined #openstack-infra | 15:54 | |
| fungi | oh, wait, it's using trove yeah? | 15:54 |
| clarkb | fungi: its running a trove db so we just point a tthe correct db | 15:54 |
| *** ftersin_ has joined #openstack-infra | 15:54 | |
| *** ftersin_ has left #openstack-infra | 15:54 | |
| fungi | i'm sort of surprised pointing two etherpad-dev servers at one trove db isn't wreaking havoc here | 15:55 |
| clarkb | fungi: it should be fine as long as you use different pads | 15:55 |
| *** kgiusti has quit IRC | 15:55 | |
| clarkb | thats how you can load balance servers | 15:55 |
| *** flepied has quit IRC | 15:55 | |
| *** devvesa has quit IRC | 15:56 | |
| jeblair | the pad dispatch is the tricky part, and of course, makes that very unlikely to be useful to us (since we have a habit of focusing on a small number of pads at once) | 15:56 |
| *** armax has quit IRC | 15:56 | |
| clarkb | yup | 15:56 |
| *** notnownikki has quit IRC | 15:57 | |
| *** glauco has joined #openstack-infra | 15:57 | |
| *** eharney has joined #openstack-infra | 15:59 | |
| *** salv-orlando has joined #openstack-infra | 15:59 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Pull instack into upstream tripleo https://review.openstack.org/215186 | 15:59 |
| *** btully has quit IRC | 16:00 | |
| *** ddieterly has quit IRC | 16:01 | |
| *** ihrachyshka has joined #openstack-infra | 16:02 | |
| *** unicell has joined #openstack-infra | 16:03 | |
| *** unicell1 has quit IRC | 16:05 | |
| *** hyakuhei has quit IRC | 16:05 | |
| *** skolekonov has joined #openstack-infra | 16:05 | |
| fungi | okay, i've tested deploying the current state of that 215169 puppet-etherpad_lite stack (without system nodejs set) on precise and seems to be working so should be safe to approve 2001:4800:7817:101:be76:4eff:fe05:f13a 23.253.111.14 https://etherpad-dev.openstack.org/p/ZIOvayInPk | 16:05 |
| *** hyakuhei has joined #openstack-infra | 16:06 | |
| *** sdake has joined #openstack-infra | 16:06 | |
| *** esker has quit IRC | 16:07 | |
| *** yamahata has joined #openstack-infra | 16:09 | |
| clayton | Getting "We're sorry, we hit a bug!" from mailman when attempting to subscribe to openstack-infra. Is that a known issue? | 16:09 |
| *** jistr|mtg is now known as jistr | 16:10 | |
| fungi | clayton: via smtp to the request alias or http post? | 16:10 |
| clayton | http post | 16:10 |
| fungi | first i've heard of that error regardless | 16:11 |
| *** ashleighfarnham has joined #openstack-infra | 16:11 | |
| clayton | I'll try via replying to the confirmation | 16:11 |
| fungi | checking the error log now for details | 16:11 |
| fungi | IOError: [Errno 28] No space left on device | 16:12 |
| clayton | heh, that'd do it | 16:12 |
| timrc | Doh. | 16:12 |
| fungi | looks like /run/lock has filled up | 16:12 |
| *** ihrachyshka has quit IRC | 16:13 | |
| *** klagid has joined #openstack-infra | 16:13 | |
| *** klagid has quit IRC | 16:14 | |
| *** hyakuhei has quit IRC | 16:15 | |
| *** minwang2 has quit IRC | 16:16 | |
| SpamapS | mordred: FYI, gearman-interface is gone from Debian. :-P | 16:17 |
| fungi | okay, i just deleted all files in /run/lock/mailman greater than an hour old. clayton see if you still get an error | 16:17 |
| *** hyakuhei has joined #openstack-infra | 16:17 | |
| clayton | worked, thanks. | 16:17 |
| *** krtaylor has quit IRC | 16:18 | |
| *** dkranz has quit IRC | 16:18 | |
| fungi | it looks like this may be lingering fallout from the subscribe flood a couple days ago | 16:18 |
| fungi | ahh, nope, the flood has resumed | 16:18 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Publish project team guide https://review.openstack.org/215222 | 16:19 |
| *** flepied has joined #openstack-infra | 16:19 | |
| jeblair | ttx, annegentle: ^ | 16:19 |
| annegentle | jeblair: sweet! Will look | 16:19 |
| greghaynes | SpamapS: hey, you highlighted me on some things while I was in transit last night | 16:20 |
| greghaynes | SpamapS: did they get sorted? | 16:20 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet https://review.openstack.org/205097 | 16:20 |
| *** kiran-r has joined #openstack-infra | 16:20 | |
| greghaynes | SpamapS: The source of truth is the machine-information. For some of the info that isnt in there (like cpu / mem) and for double checking against the hardware we can talk to the ansible playbooks in the playbooks dir is used | 16:21 |
| clarkb | fungi: any thoughts on working around the flood? I am around to help if you need it | 16:21 |
| fungi | nigelb: you're probably asleep now, but it looks like our subscriber flood friends have returned. they're probably hitting you too | 16:21 |
| *** hyakuhei has quit IRC | 16:22 | |
| *** rlandy has quit IRC | 16:22 | |
| *** hogepodge has joined #openstack-infra | 16:23 | |
| fungi | clarkb: it caught me as i started eating lunch, but nigelb worked around it on his listserv with http://dpaste.com/2E0EXMX | 16:23 |
| jeblair | clarkb, fungi: how can i catch up on the mm problem? | 16:23 |
| clarkb | jeblair: basically a botnet appears to be using public mailman servers to perform reflection attacks against an email address | 16:23 |
| fungi | jeblair: someone using all the mailman servers they can find to flood some poor gmail account holder's inbox with subscription request confirmation messages via the http post subscribe interface | 16:23 |
| clarkb | jeblair: we can't effectively block the sources as they are well distributed so need to either turn off subscriptions globally or for the single user as above | 16:24 |
| SpamapS | greghaynes: highlights were talking about the JIRA tickets. | 16:24 |
| greghaynes | SpamapS: ah, ok. \O/ for some fixed hardware | 16:24 |
| SpamapS | greghaynes: basically, 2 of the boxes are fixed (box firmware updated). The other one has a bad motherboard. | 16:24 |
| jeblair | fungi, clarkb: got it. i think we should probably run ban_user then, yeah? | 16:24 |
| *** zul has joined #openstack-infra | 16:24 | |
| fungi | jeblair: run it on who? | 16:25 |
| *** ihrachyshka has joined #openstack-infra | 16:25 | |
| jeblair | fungi: on our lists? | 16:25 |
| openstackgerrit | Douglas Mendizábal proposed openstack-infra/project-config: Add check-requirements to castellan https://review.openstack.org/215225 | 16:25 |
| SpamapS | greghaynes: so I want to somehow mark the bad motherboard one in our source of truth as "don't pull this in anymore" | 16:25 |
| fungi | jeblair: the e-mail addresses are randomized suffixes | 16:25 |
| *** rossella_s has quit IRC | 16:25 | |
| clarkb | right sorry its a single email addr with a bunch of +suffixes | 16:25 |
| jeblair | fungi: right, so nigelb's fix is to add a regex ban for all the lists, right? so that the http post does not result in an email | 16:25 |
| *** rossella_s has joined #openstack-infra | 16:26 | |
| fungi | i just ran this to clear the deferrals from our exim queue for that recipient pattern: sudo exim4 -bp|grep -B1 'kemo\.mart'|grep '@lists\.openstack\.org'|cut -c11-26|xargs sudo exim4 -Mrm | 16:26 |
| SpamapS | greghaynes: really feels like we just need our own DB for machines.. even if we do end up duplicating their internal one.. | 16:26 |
| fungi | jeblair: oh, i see what you're saying, yes. we need to ban by regular expression match on the recipient address | 16:26 |
| SpamapS | Does anybody have any experience with open source CMDB's? | 16:27 |
| jeblair | fungi: a) are we agreed that is a good course of action and we should take it; b) has that been done? c) shall i do it? | 16:27 |
| jeblair | clarkb: ^? | 16:27 |
| *** mriedem_away is now known as mriedem | 16:27 | |
| clarkb | jeblair: a yes b no c sure | 16:27 |
| clarkb | jeblair: I would like to be clue batted on what you did when its done too | 16:27 |
| *** geoffarnold has joined #openstack-infra | 16:27 | |
| *** oomichi has joined #openstack-infra | 16:28 | |
| SpamapS | greghaynes: or.. maybe we could just check machine-information into a private git tree that we just have on our boxes? | 16:28 |
| *** mwagner_lap has joined #openstack-infra | 16:28 | |
| greghaynes | SpamapS: ok, so I lied about the source of truth | 16:28 |
| greghaynes | SpamapS: one sec | 16:29 |
| greghaynes | SpamapS: check out machine-information-tab.yaml on .3 | 16:29 |
| *** dkranz has joined #openstack-infra | 16:30 | |
| *** sdake_ has joined #openstack-infra | 16:30 | |
| *** salv-orlando has quit IRC | 16:30 | |
| openstackgerrit | Dmitry Tyzhnenko proposed openstack-infra/git-review: Add reviewers by group alias on upload https://review.openstack.org/195043 | 16:30 |
| *** _kiran_ has joined #openstack-infra | 16:30 | |
| greghaynes | SpamapS: thats what it double checks against | 16:30 |
| *** kiran-r has quit IRC | 16:31 | |
| greghaynes | SpamapS: then I had an inventory file which had all the hosts, and ran get_macs playbook in playbooks dir | 16:31 |
| *** hyakuhei has joined #openstack-infra | 16:31 | |
| *** pradk has quit IRC | 16:31 | |
| openstackgerrit | Grant Murphy proposed openstack-infra/jeepyb: Make SMTP connection configurable https://review.openstack.org/214733 | 16:31 |
| greghaynes | its pretty un-ideal, so ++ on just makng an inventory db | 16:31 |
| openstackgerrit | Douglas Mendizábal proposed openstack/requirements: Add Castellan to global requirements https://review.openstack.org/184874 | 16:31 |
| fungi | jeblair: clarkb: it's the only solution i've seen anyone say they've used in this circumstance, other than manually hacking the mailman cgi to disable http post subscribes entirely | 16:31 |
| greghaynes | SpamapS: I was thinking wed just convert that inventory dir into an inventory db of some kind and go from there | 16:32 |
| pleia2 | good morning | 16:32 |
| jeblair | clarkb, fungi: on it | 16:33 |
| *** ams__ has joined #openstack-infra | 16:33 | |
| *** doug-fish has quit IRC | 16:33 | |
| *** doug-fish has joined #openstack-infra | 16:33 | |
| *** sdake has quit IRC | 16:33 | |
| fungi | since the attacks are coming from a very wide variety (thousands) of ip addresses, both v4 and v6, and the subscription addresses vary on a suffix, i'm not sure what other avenues are open to us | 16:34 |
| *** julim has quit IRC | 16:34 | |
| *** hdd has quit IRC | 16:34 | |
| *** ivar-lazzaro has joined #openstack-infra | 16:34 | |
| *** hyakuhei has quit IRC | 16:34 | |
| *** lucas-afk is now known as lucasagomes | 16:34 | |
| *** rlandy has joined #openstack-infra | 16:34 | |
| *** sdake_ is now known as sdake | 16:34 | |
| *** hyakuhei has joined #openstack-infra | 16:35 | |
| *** kushal has quit IRC | 16:36 | |
| *** dtantsur|mtg is now known as dtantsur|afk | 16:37 | |
| greghaynes | SpamapS: So how about we kill the machine-information-*, and use the inventory dir as the source of truth? for those notes we have in the margin of machine-information-tab we can just use yaml comments | 16:37 |
| *** fawadk has joined #openstack-infra | 16:37 | |
| greghaynes | and then from there if we want to inventory db we can do that at some point | 16:37 |
| *** fawadkhaliq has quit IRC | 16:37 | |
| *** kushal has joined #openstack-infra | 16:37 | |
| *** geoffarnold has quit IRC | 16:37 | |
| *** puranamr has joined #openstack-infra | 16:38 | |
| *** dprince has joined #openstack-infra | 16:39 | |
| SpamapS | greghaynes: I'm fine with that. There's more useful information there than anywhere else. | 16:41 |
| *** nadya has quit IRC | 16:42 | |
| jeblair | fungi: i think when the lockfile dir filled up, we ended up with some stuck lockfiles | 16:42 |
| *** armax has joined #openstack-infra | 16:43 | |
| mriedem | hrm | 16:44 |
| *** pvaneck has joined #openstack-infra | 16:44 | |
| mriedem | something changed with displaying subunit logs for tox runs in the browser http://logs.openstack.org/25/214925/1/check/gate-nova-python27/0f43aac/testrepository.subunit.gz | 16:45 |
| mriedem | is that intentional? | 16:45 |
| *** shardy has quit IRC | 16:45 | |
| *** ivar-laz_ has joined #openstack-infra | 16:45 | |
| jeblair | fungi: i cleaned them up | 16:45 |
| fungi | jeblair: thanks | 16:45 |
| jeblair | fungi, clarkb: script finished; documenting now | 16:45 |
| *** jistr has quit IRC | 16:46 | |
| *** pradk has joined #openstack-infra | 16:46 | |
| *** ivar-lazzaro has quit IRC | 16:46 | |
| openstackgerrit | Merged openstack/requirements: Add networking-ofagent to projects.txt https://review.openstack.org/210772 | 16:48 |
| *** mrmartin has quit IRC | 16:48 | |
| *** unicell has quit IRC | 16:48 | |
| *** Kennan2 has quit IRC | 16:50 | |
| fungi | okay, lunch wrapped up now. logs indicate this attack resumed yesterday at 11:54 utc | 16:51 |
| fungi | so unlike last time, it's been running for over 24 hours this time around | 16:53 |
| *** minwang2 has joined #openstack-infra | 16:53 | |
| odyssey4me | fungi clarkb so we discovered the issue with our builds failing in hpcloud, finally | 16:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add documentation on scripting mailman actions https://review.openstack.org/215237 | 16:53 |
| *** flepied has quit IRC | 16:53 | |
| jeblair | clarkb, fungi: ^ what i did | 16:53 |
| *** atuvenie has quit IRC | 16:53 | |
| clarkb | odyssey4me: what is the problem? | 16:53 |
| *** btully has joined #openstack-infra | 16:54 | |
| odyssey4me | nothing to do with resource issues, everything to do with a missing package which we were assuming to be there: https://review.openstack.org/215093 | 16:54 |
| odyssey4me | cinder appears to require it now for liberty | 16:54 |
| odyssey4me | kilo does not | 16:54 |
| jeblair | nigelb: thanks for the ban script; i altered it to add lock calls, you may want to look at https://review.openstack.org/215237 | 16:54 |
| clarkb | jeblair: and that works for the various suffixes? How do the new ones get added? | 16:55 |
| odyssey4me | cinder-volume requires the libxslt1.1 library | 16:55 |
| jeblair | clarkb: oh, sorry i ran it with nigelb's regex: "^kemo.mart.*@gmail.com" | 16:55 |
| odyssey4me | for the lvm backend at least | 16:55 |
| clarkb | jeblair: oh I see the ban list takes a regex | 16:55 |
| * jeblair updates change | 16:56 | |
| fungi | jeblair: clarkb: heh, i was just about to ask the same question | 16:56 |
| fungi | so anyway, with an added note that regular expressions work there, lgtm | 16:56 |
| *** dizquierdo has joined #openstack-infra | 16:56 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add documentation on scripting mailman actions https://review.openstack.org/215237 | 16:57 |
| jeblair | done | 16:57 |
| *** armax has quit IRC | 16:57 | |
| *** spzala has joined #openstack-infra | 16:57 | |
| *** kgiusti has joined #openstack-infra | 16:57 | |
| SpamapS | greghaynes: so, what you're suggesting is that we edit the files in the inventory directory directly. Will your ansible stuff preserve edits? | 16:58 |
| jeblair | clarkb, fungi: also if you just run "withlist" it will print out a bunch of documentation on how to use it | 16:58 |
| greghaynes | SpamapS: It wont. but that can be fixed | 16:58 |
| greghaynes | SpamapS: but yes, I think we should do that | 16:58 |
| SpamapS | greghaynes: also I just had a thought which is maybe we should make the erb+hiera the source of truth? | 16:58 |
| greghaynes | SpamapS: Also, that dir is a git repo - I just git commit whenever the inventory is at a state I think is useful | 16:59 |
| *** derekh has quit IRC | 17:00 | |
| greghaynes | SpamapS: hrm, unsure... im not too familiar with that | 17:00 |
| SpamapS | greghaynes: well my thinking is that it allows us to maintain all but the passwords in a public DB | 17:01 |
| greghaynes | SpamapS: Yea, actually, definitely lets do that | 17:01 |
| crinkle | ++ | 17:01 |
| SpamapS | greghaynes: but at the same time.. I'm not sure the git review process is appropriate for maintaining a DB | 17:01 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Upgrade etherpad-dev to Ubuntu Trusty https://review.openstack.org/215243 | 17:02 |
| *** armax has joined #openstack-infra | 17:02 | |
| SpamapS | since the DB needs to reflect reality as closely as possible to be useful. | 17:02 |
| * SpamapS is just thinking out loud | 17:02 | |
| greghaynes | SpamapS: I dont think we should be changing it much though? | 17:02 |
| SpamapS | greghaynes: boxes will go down... and be replaced. | 17:02 |
| *** afazekas has quit IRC | 17:02 | |
| SpamapS | greghaynes: and we won't be able to respond until we land the patch. | 17:03 |
| SpamapS | that seems backwards. | 17:03 |
| SpamapS | in fact that makes me think the erb is backwards too.. and we should maintain it as a data source | 17:03 |
| greghaynes | SpamapS: I imagine itd be similar to the current infra workflow, you could do that, or you can do the ssh in, disable puppet, edit some things by hand | 17:03 |
| openstackgerrit | Tim Hinrichs proposed openstack-infra/project-config: Enable gating on tempest tests for Congress https://review.openstack.org/215245 | 17:03 |
| greghaynes | and land patch in parallel | 17:03 |
| *** vahidh has joined #openstack-infra | 17:04 | |
| crinkle | everything we do goes through public review, this shouldn't be an exception | 17:04 |
| *** cody-somerville has quit IRC | 17:04 | |
| *** tsekiyama has quit IRC | 17:04 | |
| SpamapS | greghaynes: true, I'm too inexperienced in how infra does things to speak to how wierd it would be. | 17:04 |
| SpamapS | or weird | 17:04 |
| SpamapS | OK, I'm convinced. :) | 17:04 |
| greghaynes | SpamapS: Yea, I don't think itd be especially wierd, infra is used to doing review as part of fixing things | 17:05 |
| *** achanda has joined #openstack-infra | 17:05 | |
| SpamapS | yeah, I actually love it. It just seems too good to be true. ;-) | 17:05 |
| fungi | also used to having some rather database-like things in our git repositories | 17:05 |
| *** Kennan has joined #openstack-infra | 17:05 | |
| *** skylerberg has joined #openstack-infra | 17:06 | |
| *** jcoufal has quit IRC | 17:06 | |
| fungi | as long as they're editable text, wfm | 17:06 |
| SpamapS | editable JSON + erb for passwords, with stable-sorted keys. | 17:06 |
| SpamapS | I did some tests and anything other than renaming a box produces useful diffs. | 17:07 |
| SpamapS | renaming a box moves the whole record. | 17:07 |
| *** kushal has quit IRC | 17:07 | |
| SpamapS | because sorting. :-P | 17:07 |
| *** markus_z has quit IRC | 17:08 | |
| *** mrmartin has joined #openstack-infra | 17:09 | |
| *** dahoo has joined #openstack-infra | 17:10 | |
| *** dahoo is now known as jerryz | 17:10 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Upgrade etherpad to Ubuntu Trusty https://review.openstack.org/215249 | 17:11 |
| krotscheck | Is there an openstack python api project template somewhere? | 17:11 |
| *** dizquierdo has quit IRC | 17:12 | |
| *** dizquierdo has joined #openstack-infra | 17:12 | |
| fungi | krotscheck: if you mean something more than openstack-dev/cookiecutter then not to my knowledge | 17:12 |
| krotscheck | Woot | 17:13 |
| *** sergmelikyan has quit IRC | 17:13 | |
| *** dimtruck is now known as zz_dimtruck | 17:13 | |
| *** sergmelikyan has joined #openstack-infra | 17:13 | |
| fungi | krotscheck: i don't know that there's much api server specific about it, but it's not specialized like the cookiecutter we have for oslo libs at least | 17:14 |
| *** Kennan has quit IRC | 17:14 | |
| krotscheck | fungi: No worries. I'm just curious whether there's a thing for python already. The JS world has a similar tool called yeoman that could perform this task, I just want to make sure that we don't duplicate work | 17:14 |
| *** sergmelikyan has quit IRC | 17:15 | |
| krotscheck | i.e. tyring to figure out if I should do a cookiecutter thing or a yeoman thing for the JS CTI example. | 17:15 |
| *** sergmelikyan has joined #openstack-infra | 17:15 | |
| *** ivar-la__ has joined #openstack-infra | 17:16 | |
| *** unicell has joined #openstack-infra | 17:16 | |
| clarkb | jeblair: can you read my response to Clayton and make sure I am just not missing anything that was ocvered in person that I should be aware of? | 17:17 |
| *** oomichi has quit IRC | 17:17 | |
| *** ivar-laz_ has quit IRC | 17:17 | |
| jeblair | clarkb: ack | 17:18 |
| sdake | hey folks, I've noticed alot of merge conflicts on the kolla repo which I dont think are really merge conflicts | 17:19 |
| sdake | the latest example is: https://review.openstack.org/#/c/213958/ | 17:19 |
| asselin_ | clarkb, can we get this merged? https://review.openstack.org/#/c/214399/ | 17:19 |
| sdake | my team is really starting to complain about it | 17:19 |
| jeblair | clarkb: have you sent it? | 17:19 |
| *** zz_dimtruck is now known as dimtruck | 17:19 | |
| clarkb | jeblair: yes | 17:20 |
| clarkb | jeblair: mailman may just be slow | 17:20 |
| *** otter768 has joined #openstack-infra | 17:20 | |
| *** Kennan has joined #openstack-infra | 17:20 | |
| sdake | is jenkins doing something different with merging that results in merge conflicts when the existing files are not touched? | 17:20 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Bump oslo.db to 2.4.1 for backward compat fixes https://review.openstack.org/215255 | 17:20 |
| clarkb | asselin_: ya let me review it | 17:20 |
| *** julim has joined #openstack-infra | 17:20 | |
| *** fdegir has quit IRC | 17:21 | |
| clarkb | sdake: the bird comment sayin git can't be merged is gerrit saying that. Gerrit uses jgit to merge which is a bit more rudimentary than your C git client | 17:21 |
| sdake | imo a merge conflict should not happen if the files in the patch only touch files not modified from last patchsets | 17:21 |
| *** dolphm has left #openstack-infra | 17:21 | |
| clarkb | sdake: then in the jobs we do our best mimic jgit behavior with C git | 17:21 |
| jeblair | clarkb: clayton is talking about their local testing (ie, he is a downstream nodepool user) | 17:21 |
| clarkb | jeblair: correct but he is saying lets make these change sto affect upstream tests | 17:21 |
| clarkb | jeblair: they want to take their downstream tests which already work and run them upstream | 17:22 |
| clarkb | jeblair: whihc they can do today | 17:22 |
| jeblair | clarkb: no, he wants to stop carrying patches | 17:22 |
| jeblair | to nodepool | 17:22 |
| clarkb | jeblair: also why can't they do it the same way we do it? | 17:22 |
| sdake | clarkb ok i'll blame it on jgit then, thanks :) | 17:22 |
| *** geoffarnold has joined #openstack-infra | 17:22 | |
| clarkb | sdake: and in particular that is complaining about path conflicts, that change deletes some file sI bet another change merged that updated those files | 17:22 |
| clarkb | sdake: its jgits way of telling you that you should be careful and ACK it | 17:22 |
| sdake | clarkb thanks - so likely to always happen with deletes - that is helpful | 17:23 |
| *** doug-fish has quit IRC | 17:23 | |
| clarkb | jeblair: ok "wanting to do the same thing as part of our multi-node integration test that we use as a gate for deployments" confused me | 17:23 |
| clarkb | jeblair: I will respond now that I read it better | 17:24 |
| *** doug-fish has joined #openstack-infra | 17:24 | |
| jeblair | clarkb: ah, yeah, i can see that. we've been very successful at getting people to adopt our terminology, eh? :) | 17:24 |
| *** Kennan has quit IRC | 17:24 | |
| *** otter768 has quit IRC | 17:24 | |
| jeblair | clarkb: but yeah, i think he's just saying "for our downstream dev, we turn of port security, and we want to do the same thing for our downstream deployment testing" | 17:25 |
| clarkb | yup rerepsonded | 17:25 |
| sdake | clarkb thanks for the help- got the folks calmed down a bit ;) | 17:26 |
| jeblair | clarkb: (i do think "hey, can you do the same thing we're doing upstream cause maybe we can join forces?" is a good question, though if the answer is "no because $goodreason", i think we probably still want to not get in the way of their being a nodepool user. | 17:26 |
| *** signed8bit has joined #openstack-infra | 17:26 | |
| *** achanda has quit IRC | 17:27 | |
| *** oomichi has joined #openstack-infra | 17:28 | |
| clarkb | jeblair: my concern with just making changes to nodepool is we alreay have a hard enough time testing them and making sure nodepool works. If we can accomplish the goal using softare that already exists and tested thats a big win | 17:29 |
| *** mrmartin has quit IRC | 17:29 | |
| clarkb | speaking of time to go review that nodepool chnage for asselin_ | 17:30 |
| *** ihrachyshka has quit IRC | 17:31 | |
| clarkb | asselin_: approved | 17:31 |
| openstackgerrit | Alexander Tivelkov proposed openstack/requirements: Bump yaql to version 1.0 https://review.openstack.org/215182 | 17:32 |
| asselin_ | clarkb, thanks | 17:32 |
| clarkb | I had reviewed it previously just needed to catch up on it | 17:32 |
| jeblair | clarkb: yep; Clayton is expecting to write tests for this :) | 17:32 |
| clarkb | and it makes the dsvm test pass again so yay | 17:32 |
| asselin_ | clarkb, yeah! :) | 17:32 |
| jeblair | clarkb: i kind of like the 'extension point' approach actually | 17:32 |
| jeblair | should be minimal code in nodepool itself | 17:33 |
| clarkb | jeblair: ya especially if its mor ethan just port security | 17:33 |
| clarkb | jeblair: though stevedore makes things slow whihc may impact the nodepool commands | 17:33 |
| clarkb | can work through that | 17:33 |
| *** amitgandhinz has joined #openstack-infra | 17:33 | |
| SpamapS | greghaynes: ok, so I'm wondering also if the 'gh' format needs to be evaluated against the ironic discovery project. | 17:34 |
| clarkb | (also people should totally test upstream) | 17:34 |
| *** yamahata has quit IRC | 17:34 | |
| clarkb | (we solve these problems for you :) ) | 17:34 |
| SpamapS | greghaynes: but that's something we can do later. :) | 17:34 |
| *** smccully has joined #openstack-infra | 17:34 | |
| *** doug-fish has quit IRC | 17:35 | |
| *** doug-fish has joined #openstack-infra | 17:35 | |
| SpamapS | greghaynes: so, my current plan is to bring up a different box than the current bastion as baremetal00.. then if it looks good.. reclaim the bastion. | 17:36 |
| *** ashleigh_ has joined #openstack-infra | 17:36 | |
| *** yamamoto has quit IRC | 17:36 | |
| SpamapS | greghaynes: I've backed up /home/shared except *.qcow2* and *.img | 17:36 |
| SpamapS | greghaynes: anything else I should try to preserve from there? | 17:36 |
| *** oomichi has quit IRC | 17:36 | |
| *** geoffarnold has quit IRC | 17:38 | |
| *** ashleighfarnham has quit IRC | 17:38 | |
| openstackgerrit | Merged openstack-infra/nodepool: Add support for project-name parameter https://review.openstack.org/214399 | 17:38 |
| *** austin81 has quit IRC | 17:40 | |
| *** fdegir has joined #openstack-infra | 17:40 | |
| *** Kennan has joined #openstack-infra | 17:40 | |
| *** fdegir has quit IRC | 17:41 | |
| *** fdegir has joined #openstack-infra | 17:41 | |
| *** sergmelikyan has quit IRC | 17:41 | |
| *** salv-orlando has joined #openstack-infra | 17:42 | |
| *** nadya has joined #openstack-infra | 17:43 | |
| *** oomichi has joined #openstack-infra | 17:43 | |
| *** stevemar has quit IRC | 17:44 | |
| *** sergmelikyan has joined #openstack-infra | 17:44 | |
| mmmpork | i have a nodepool question, in the docs there's a statement that says all logging is to stdout by default | 17:44 |
| mmmpork | i looked through the configs and stuff, and maybe i missed it, but is there anyway at the config level to specify an alternate logging output? | 17:45 |
| mmmpork | or do you just have to do it yourself when you run nodepoold | 17:45 |
| clarkb | mmmpork: you have to supply a python logging config file | 17:45 |
| clarkb | mmmpork: with that you can do all sorts of fun | 17:45 |
| *** stevemar has joined #openstack-infra | 17:46 | |
| *** salv-orlando has quit IRC | 17:46 | |
| mmmpork | ah ok, where/how do you supply that info? again, sorry if this is obvious ;) | 17:46 |
| *** krtaylor has joined #openstack-infra | 17:47 | |
| clarkb | mmmpork: nodepoold -l | 17:47 |
| *** nadya has quit IRC | 17:47 | |
| clarkb | which takes a path to the file with the config | 17:47 |
| mmmpork | ok cool. in the docs i'm editing, i wanted to add something to that statement about the logging to indicate how you should have it go anywhere else besides stdout ;) | 17:48 |
| clarkb | mmmpork: also greghaynes and I area at grendels hacking if yo uwant to sit and do this in person | 17:48 |
| *** sridhar_ram has joined #openstack-infra | 17:48 | |
| mmmpork | i'm in seattle at openstack day! | 17:48 |
| *** pradk has quit IRC | 17:48 | |
| *** bharath has joined #openstack-infra | 17:48 | |
| clarkb | mmmpork: though we may relocate for noms soon | 17:48 |
| clarkb | ah ok | 17:48 |
| *** SumitNaiksatam has joined #openstack-infra | 17:48 | |
| mmmpork | i'm going to be at the lucky lab this evening though :) | 17:48 |
| clarkb | I will be at home by then ebabies | 17:48 |
| mmmpork | ahh right :D | 17:49 |
| mmmpork | well thanks for the invite :) definitely another time! | 17:49 |
| *** prad_ has joined #openstack-infra | 17:49 | |
| mmmpork | also i've uploaded my wip review with the TODOs for the items i'm editing | 17:50 |
| mmmpork | "uploaded" posted.. whatever | 17:50 |
| *** _kiran_ has quit IRC | 17:50 | |
| *** pelix has quit IRC | 17:50 | |
| fungi | sent, pushed, submitted... pick your verb | 17:51 |
| fungi | we're easy here | 17:51 |
| mmmpork | ha, well it's not officially submitted since it's wip, i just didn't want to lose my work in case my laptop craps on me | 17:51 |
| mmmpork | er dies on me | 17:51 |
| fungi | we all use gerrit as ephemeral storage for work in progress anyway. that's why we have a work in progress workflow vote | 17:52 |
| mmmpork | yeah i figured ;) | 17:52 |
| pleia2 | yep, I do that all the time | 17:52 |
| fungi | not only do i not keep half-finished local changes, i have a script i run regularly to delete all non-remote-tracking branches from my local repos | 17:53 |
| mmmpork | git review garbage collecting :) | 17:53 |
| *** ybathia has joined #openstack-infra | 17:53 | |
| fungi | helps keep me in the habit of remembering to push my work to review.o.o, whatever state it's in | 17:53 |
| fungi | and to always retrieve my work from review.o.o when i resume, in case someone else has improved it for me in the interim | 17:54 |
| mmmpork | haha.. you could tie it in to that service where if you don't do a thing it donates to a cause you don't want to donate to | 17:55 |
| *** achanda has joined #openstack-infra | 17:55 | |
| clarkb | mmmpork: how is openstack seattle? where are they hosting it? | 17:55 |
| *** sinval has quit IRC | 17:55 | |
| mmmpork | it's meh, mostly operators | 17:55 |
| clarkb | I have been to seattle once since Imoved >_> | 17:55 |
| *** sthillma has joined #openstack-infra | 17:56 | |
| *** tsekiyama has joined #openstack-infra | 17:56 | |
| mmmpork | i'm here for context and to meet morgan_2549 and see other openstack folks :) | 17:56 |
| * morgan_2549 hides | 17:56 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 17:56 | |
| * morgan_2549 crawls | 17:56 | |
| mmmpork | clarkb i was in the same place... this is my first time back since i moved almost 4 years ago | 17:56 |
| morgan_2549 | Back under a rock | 17:56 |
| *** pc_m_ has quit IRC | 17:57 | |
| * mmmpork says in sauron voice " I SEE YOUUU " | 17:57 | |
| *** pc_m has joined #openstack-infra | 17:57 | |
| SpamapS | mmmpork: you don't like operators? ;) | 17:57 |
| mmmpork | i do :) | 17:57 |
| *** sergmelikyan has quit IRC | 17:57 | |
| *** oomichi has quit IRC | 17:58 | |
| *** puranamr has quit IRC | 17:58 | |
| mmmpork | sorry, that might have come off odd! | 17:58 |
| mmmpork | i just meant it's not much development level stuff, so for me it's meh :) | 17:58 |
| *** pc_m has quit IRC | 17:58 | |
| fungi | they're tasty with bbq sauce? | 17:58 |
| *** puranamr has joined #openstack-infra | 17:59 | |
| clarkb | fungi: not in the NW we don't do BBQ | 17:59 |
| mmmpork | we do korean bbq | 17:59 |
| mmmpork | and hawaiian bbq | 17:59 |
| mmmpork | :D | 17:59 |
| clarkb | up here they are tasty drenched in IPA | 17:59 |
| fungi | you might make an exception for operators though | 17:59 |
| *** pc_m has joined #openstack-infra | 17:59 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate https://review.openstack.org/214748 | 17:59 |
| krotscheck | clarkb: I beg to differ. | 17:59 |
| clarkb | mriedem: how are things doing e-r wise now? we should be fixed with the html thing | 18:00 |
| *** gyee has joined #openstack-infra | 18:00 | |
| clarkb | krotscheck: I dunno I try BBQ here occasionally but always go back to just making it myself | 18:00 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: FwaaS meeting: Add an APAC friendly time alternate https://review.openstack.org/214748 | 18:00 |
| mriedem | clarkb: looks like indexing is getting caught up | 18:00 |
| krotscheck | clarkb: Most of what I see here is hawaiian inspired whole-animal roasts. | 18:00 |
| mriedem | i'll poke on some logstash queries in a bit | 18:00 |
| *** gyee has quit IRC | 18:00 | |
| krotscheck | At least, that's the style of BBQ frequent here. | 18:00 |
| timrc | clarkb, I had some brisket at Tilt. It was pretty good. | 18:00 |
| timrc | A lot better than I expected it to be. | 18:00 |
| *** puranamr has quit IRC | 18:00 | |
| krotscheck | The "regional variant" as it were. | 18:00 |
| clarkb | timrc: that was brave | 18:01 |
| krotscheck | Purists might scoff. | 18:01 |
| krotscheck | In the meantime, I will eat. | 18:01 |
| mmmpork | there's a really good place in SODO | 18:01 |
| krotscheck | hom. | 18:01 |
| krotscheck | nom | 18:01 |
| clarkb | krotscheck: kahlua pork is good | 18:01 |
| mmmpork | a couple of really good places in SODO actually | 18:01 |
| *** hyakuhei has quit IRC | 18:01 | |
| * mmmpork knows her pork ;D | 18:01 | |
| timrc | clarkb, Well here in Austin... now that it's mostly Californians we have more terrible BBQ than good BBQ :) | 18:01 |
| jesusaurus | yeah, willie's taste of soul in sodo is amazing | 18:02 |
| krotscheck | On a work related note, I need a +2 to get a matching set with ajaeger's :) https://review.openstack.org/#/c/214381/ | 18:02 |
| timrc | clarkb, Franklin will probably be pretty crazy during the next Summit in Austin, but if we can, we should go. | 18:02 |
| * krotscheck fully acknowledges that BBQ Trumps WOrk | 18:02 | |
| *** gyee has joined #openstack-infra | 18:03 | |
| krotscheck | timrc: Stay a date late/show a day early | 18:03 |
| timrc | krotscheck, There will be a line regardless, only the POTUS had the power to cut in line... so you do need to block off at least a couple hours. Sort of stupid to wait in line that long with no guarantee of food, until you actually get it :) | 18:04 |
| openstackgerrit | Stan Lagun proposed openstack/requirements: Bump yaql to version 1.0 https://review.openstack.org/215182 | 18:04 |
| *** prad_ is now known as pradk | 18:04 | |
| *** dizquierdo has quit IRC | 18:04 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 18:06 | |
| *** tiswanso has quit IRC | 18:06 | |
| *** puranamr has joined #openstack-infra | 18:06 | |
| *** bdemers has quit IRC | 18:07 | |
| clarkb | timrc: I bet the waiting is less than doing it yourself | 18:08 |
| openstackgerrit | Merged openstack-infra/system-config: Add documentation on scripting mailman actions https://review.openstack.org/215237 | 18:08 |
| *** nadya has joined #openstack-infra | 18:08 | |
| timrc | clarkb, True. | 18:08 |
| clarkb | timrc: but I can do other things like brew beer or drink or play video games when I do it myself so thats not a clear win | 18:09 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/system-config: Add bifrost inventory management procedures https://review.openstack.org/214279 | 18:09 |
| timrc | clarkb, Indeed. Do you cheat with a bbq guru? Makes it even easier to go off and do those things... my green egg does not stabilize well below 225... but not nearly as bad as a traditional smoker. | 18:10 |
| timrc | I'm thinking about getting one of those gurus to adjust air flow and control temperature in the dome. | 18:10 |
| clarkb | timrc: I have a smokey mountain now, it sits at about 210 for 8 hours without messing wit hit | 18:10 |
| timrc | clarkb, Wow nice. | 18:10 |
| *** pc_m has quit IRC | 18:10 | |
| clarkb | granted that was done on a warm day | 18:10 |
| timrc | clarkb, Does it have an oblong shape? | 18:10 |
| clarkb | may be harder as the weather cools | 18:10 |
| clarkb | ya its like a green egg | 18:10 |
| *** yfried|afk has joined #openstack-infra | 18:11 | |
| timrc | I sort of thing the circular design of a green egg is not efficient for brisket and ribs like the Primo. | 18:11 |
| timrc | think* | 18:11 |
| *** pc_m has joined #openstack-infra | 18:11 | |
| *** bapalm has quit IRC | 18:11 | |
| timrc | space-efficient that is. | 18:11 |
| *** tiswanso has joined #openstack-infra | 18:11 | |
| *** bdemers has joined #openstack-infra | 18:11 | |
| clarkb | its not, I can do about 4 briskets on mine if necessary but with the price of brisket that hasn't happened yet | 18:11 |
| clarkb | we pay almost $6/lb up here its sad | 18:11 |
| *** minwang2 has quit IRC | 18:12 | |
| timrc | clarkb, Yikes. | 18:12 |
| mmmpork | i've been wanting to try this - http://www.amazon.com/dp/B007ZKUVPC/ | 18:12 |
| openstackgerrit | Douglas Mendizábal proposed openstack-infra/project-config: Update python-barbicanclient acls https://review.openstack.org/215269 | 18:12 |
| clarkb | timrc: granted thats localy grown usda choice blah blah so not like I was looking for cheapest cow | 18:12 |
| mmmpork | a stove top smoker, seems good for small spaces as long as you can open a window | 18:12 |
| *** arxcruz has joined #openstack-infra | 18:14 | |
| *** bapalm has joined #openstack-infra | 18:14 | |
| timrc | clarkb, I think I pay about $5/lb. I have neighbors that buy whole cows together and split 'em up. Whenever that happens we usually have a party. Lot's of people in the hood are BBQ enthusiasts. | 18:14 |
| *** angdraug has quit IRC | 18:14 | |
| clarkb | mmmpork: also if your landlord doesn't mind the house perpetually smelling of brisket | 18:14 |
| mmmpork | hey you know, some people like potpurri and those little plug ins that take the cartridges... | 18:15 |
| mmmpork | i like my house to smell like brisket! | 18:15 |
| *** chen12 has quit IRC | 18:16 | |
| *** chen12 has joined #openstack-infra | 18:16 | |
| *** mrunge has quit IRC | 18:16 | |
| *** mrunge has joined #openstack-infra | 18:17 | |
| timrc | lol | 18:17 |
| *** armax has quit IRC | 18:18 | |
| timrc | mmmpork, maybe it's time to /nick mmmbrisket? | 18:18 |
| mmmpork | ha | 18:19 |
| clarkb | ok back to work :) https://jenkins03.openstack.org/job/gate-dsvm-nodepool-nv/10/console that should if all goe swell build a dib image and boot it against devstack | 18:19 |
| clarkb | which we can then use to test greghaynes gearman image builder uploaders with | 18:19 |
| *** ayoung has quit IRC | 18:23 | |
| *** sthillma_ has joined #openstack-infra | 18:23 | |
| *** sabeen3 has left #openstack-infra | 18:24 | |
| *** sabeen1 has joined #openstack-infra | 18:24 | |
| *** achanda has quit IRC | 18:24 | |
| *** oomichi has joined #openstack-infra | 18:25 | |
| *** sthillma has quit IRC | 18:25 | |
| SpamapS | greghaynes: FYI, old bastion moved to 15.184.52.200 | 18:25 |
| openstackgerrit | Tim Hinrichs proposed openstack-infra/project-config: Enable gating on tempest tests for Congress https://review.openstack.org/215245 | 18:25 |
| greghaynes | SpamapS: ok | 18:25 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Add dib deletion test https://review.openstack.org/215275 | 18:26 |
| greghaynes | clarkb: ^ | 18:26 |
| *** sthillma has joined #openstack-infra | 18:26 | |
| *** pc_m has quit IRC | 18:27 | |
| *** fawadk has quit IRC | 18:27 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 18:27 | |
| *** pc_m has joined #openstack-infra | 18:27 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 18:28 | |
| *** sthillma_ has quit IRC | 18:28 | |
| annegentle | can anyone debug planet.openstack.org to see why two posts are showing up with September 2015 dates? I'm looking at it from a post side (for rackspace blog, the 2nd one) but wondered if anyone knows the engine well. | 18:28 |
| *** geoffarnold has joined #openstack-infra | 18:28 | |
| *** tonytan4ever has quit IRC | 18:29 | |
| fungi | annegentle: that usually happens when someone modifies a post and the url changes | 18:29 |
| fungi | for example, adjusting the title | 18:29 |
| annegentle | fungi: yeah, for the rackspace one it seems like it's a content problem, and I can fix that. | 18:29 |
| fungi | usually i can just delete the extra and reindex it | 18:30 |
| *** tiswanso has quit IRC | 18:32 | |
| *** kiran-r has joined #openstack-infra | 18:33 | |
| *** sergmelikyan has joined #openstack-infra | 18:34 | |
| *** pc_m_ has joined #openstack-infra | 18:34 | |
| *** Sukhdev has joined #openstack-infra | 18:34 | |
| fungi | having trouble tracking down the cached copy of that aptira one | 18:35 |
| fungi | aha, found. for some reason it was titleless | 18:36 |
| *** hyakuhei has joined #openstack-infra | 18:36 | |
| fungi | according to my command history, i often have to remove posts from the aptira blog | 18:37 |
| *** yamamoto has joined #openstack-infra | 18:37 | |
| * SpamapS just remembered he was going to try and boot a GPT-only image w/ ironic | 18:38 | |
| *** pc_m has quit IRC | 18:38 | |
| *** davideagnello has quit IRC | 18:38 | |
| *** austin81 has joined #openstack-infra | 18:38 | |
| *** davideagnello has joined #openstack-infra | 18:39 | |
| *** angdraug has joined #openstack-infra | 18:39 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 18:39 | |
| *** hyakuhei has quit IRC | 18:39 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 18:41 | |
| *** abdelwas_ has joined #openstack-infra | 18:41 | |
| *** yamamoto has quit IRC | 18:42 | |
| *** lucasagomes is now known as lucas-dinner | 18:43 | |
| fungi | annegentle: look better now? | 18:44 |
| *** dannywilson has quit IRC | 18:44 | |
| annegentle | yeah fungi -- what did you do on your side? I fixed the one post I could fix. | 18:44 |
| fungi | annegentle: i deleted the cached copies for the articles which claimed to be from september and then reindexed it | 18:45 |
| annegentle | fungi: nice thanks | 18:45 |
| fungi | though i see that the aptira blog still has that post claiming to be from next month. it may pop back in again | 18:45 |
| fungi | not sure who to contact for these things | 18:45 |
| *** dannywilson has joined #openstack-infra | 18:46 | |
| *** davidlenwell has quit IRC | 18:50 | |
| *** davideag_ has joined #openstack-infra | 18:50 | |
| *** davidlenwell has joined #openstack-infra | 18:51 | |
| *** davideagnello has quit IRC | 18:52 | |
| *** kiran-r has quit IRC | 18:53 | |
| *** oomichi has quit IRC | 18:53 | |
| *** thiagop is now known as thiagop_afk | 18:54 | |
| *** afazekas has joined #openstack-infra | 18:55 | |
| pleia2 | woo, no more meetings/calls this week \o/ | 18:57 |
| pleia2 | (not an invitation) | 18:58 |
| *** ociuhandu has quit IRC | 18:58 | |
| *** davidlenwell has quit IRC | 18:58 | |
| *** puranamr has quit IRC | 18:58 | |
| *** davidlenwell has joined #openstack-infra | 18:59 | |
| *** geoffarnold has quit IRC | 19:00 | |
| *** flepied has joined #openstack-infra | 19:00 | |
| fungi | congrats! | 19:01 |
| regXboi | is there a tempest knowledgeable entity around? | 19:01 |
| fungi | regXboi: more likely in #openstack-qa but what's the q? | 19:01 |
| regXboi | fungi: I'll head over there - a commit has removed tempest.conf.sample and broken devstack | 19:02 |
| *** afazekas has quit IRC | 19:03 | |
| fungi | ahh, yep. the devstack-knowledgeable folk also aggregate there, so better venue all around | 19:03 |
| regXboi | fungi: ok - hopefully this gets sorted out before it starts impacting infra | 19:03 |
| *** dannywilson has quit IRC | 19:04 | |
| fungi | regXboi: well, if that change merged successfully then it's possible it won't impact our ci, since tempest changes are tested with devstack | 19:04 |
| regXboi | fungi: yeah I hoping that is the case | 19:05 |
| *** dannywilson has joined #openstack-infra | 19:05 | |
| * regXboi just updated his devstack repo and is trying over :) | 19:05 | |
| *** tiswanso has joined #openstack-infra | 19:07 | |
| *** achanda has joined #openstack-infra | 19:08 | |
| *** dkranz has quit IRC | 19:09 | |
| *** dannywilson has quit IRC | 19:10 | |
| *** dannywilson has joined #openstack-infra | 19:10 | |
| mordred | SpamapS: gpt? | 19:13 |
| *** sergmelikyan has quit IRC | 19:13 | |
| *** sergmelikyan has joined #openstack-infra | 19:15 | |
| *** btully has quit IRC | 19:16 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/zuul: Add option to ignore ref-updated events emitted by branch deletions https://review.openstack.org/178833 | 19:17 |
| *** pal has joined #openstack-infra | 19:19 | |
| *** oomichi has joined #openstack-infra | 19:21 | |
| *** pc_m_ has quit IRC | 19:21 | |
| *** sergmelikyan has quit IRC | 19:22 | |
| *** bdemers has quit IRC | 19:23 | |
| *** zul has quit IRC | 19:23 | |
| *** tiswanso has quit IRC | 19:23 | |
| *** sergmelikyan has joined #openstack-infra | 19:24 | |
| *** dims_ has joined #openstack-infra | 19:26 | |
| *** sergmelikyan has quit IRC | 19:27 | |
| *** ivar-lazzaro has joined #openstack-infra | 19:27 | |
| *** sergmelikyan has joined #openstack-infra | 19:27 | |
| *** hdd has joined #openstack-infra | 19:27 | |
| *** bdemers has joined #openstack-infra | 19:27 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 19:27 | |
| *** woodster_ has quit IRC | 19:27 | |
| *** ttx has quit IRC | 19:27 | |
| *** GheRivero has quit IRC | 19:27 | |
| *** jamielennox|away has quit IRC | 19:27 | |
| *** GheRivero has joined #openstack-infra | 19:27 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 19:28 | |
| *** dims has quit IRC | 19:28 | |
| *** DuncanT has quit IRC | 19:28 | |
| *** adam_g has quit IRC | 19:28 | |
| *** electrical has quit IRC | 19:28 | |
| *** oomichi has quit IRC | 19:28 | |
| *** davidlenwell has quit IRC | 19:28 | |
| *** ivar-la__ has quit IRC | 19:28 | |
| *** r-daneel has quit IRC | 19:28 | |
| *** otherwiseguy has quit IRC | 19:28 | |
| *** dguitarbite has quit IRC | 19:28 | |
| *** asahlin has quit IRC | 19:28 | |
| *** isviridov_away has quit IRC | 19:28 | |
| *** serverascode has quit IRC | 19:28 | |
| *** ryanpetrello has quit IRC | 19:28 | |
| *** tiswanso has joined #openstack-infra | 19:28 | |
| *** asahlin has joined #openstack-infra | 19:30 | |
| *** pal has quit IRC | 19:30 | |
| *** davidlenwell has joined #openstack-infra | 19:31 | |
| *** woodster_ has joined #openstack-infra | 19:31 | |
| *** btully has joined #openstack-infra | 19:31 | |
| *** DuncanT has joined #openstack-infra | 19:31 | |
| *** serverascode has joined #openstack-infra | 19:32 | |
| *** rm_work is now known as rm_work|away | 19:32 | |
| *** ayoung has joined #openstack-infra | 19:32 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 19:32 | |
| *** ttx has joined #openstack-infra | 19:33 | |
| *** achanda has quit IRC | 19:34 | |
| *** isviridov_away has joined #openstack-infra | 19:34 | |
| *** electrical has joined #openstack-infra | 19:34 | |
| *** Ng has quit IRC | 19:34 | |
| *** flepied has quit IRC | 19:34 | |
| *** adam_g has joined #openstack-infra | 19:36 | |
| *** adam_g has quit IRC | 19:36 | |
| *** adam_g has joined #openstack-infra | 19:36 | |
| *** ryanpetrello has joined #openstack-infra | 19:36 | |
| *** Ng has joined #openstack-infra | 19:36 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 19:36 | |
| *** alexsyip has joined #openstack-infra | 19:36 | |
| *** mmmpork has quit IRC | 19:36 | |
| SpamapS | mordred: the special partition table that lets grub read > 1TB root filesystems. | 19:36 |
| *** jtrovo has joined #openstack-infra | 19:37 | |
| jeblair | oh look, i'm connected via my new dsl service! | 19:37 |
| jeblair | the bad news is that 1 of the 2 lines is down | 19:38 |
| pleia2 | woo, halfway there | 19:38 |
| fungi | so it's not ethernet, just eithernet | 19:38 |
| pleia2 | har | 19:38 |
| jeblair | the good news is that the single line that is working appears to carry as much traffic as my current service | 19:38 |
| *** puranamr has joined #openstack-infra | 19:38 | |
| *** ams__ has quit IRC | 19:39 | |
| *** ivar-lazzaro has quit IRC | 19:39 | |
| jeblair | so i might actually end up with decent speeds, if the telco can find another working pair :) | 19:39 |
| *** darrenc has quit IRC | 19:39 | |
| *** vern has quit IRC | 19:39 | |
| SpamapS | AT&T has been dragging their feet bringing U-Verse to the neighborhood here | 19:40 |
| SpamapS | so TWC is the only game in town > 2Mbit | 19:40 |
| SpamapS | except 4G | 19:40 |
| *** vern has joined #openstack-infra | 19:40 | |
| *** darrenc has joined #openstack-infra | 19:40 | |
| *** dguitarbite has joined #openstack-infra | 19:41 | |
| *** salv-orlando has joined #openstack-infra | 19:41 | |
| *** mrunge has quit IRC | 19:41 | |
| jeblair | SpamapS: i use sonic.net, which is a clec out of santa rosa using att's wires, but also is stringing their own fiber. they're highly clueful (you can call up tech support and talk dsl tuning parameters with them. apparently they have done some expanding into the la region. | 19:42 |
| *** sergmelikyan has quit IRC | 19:42 | |
| jeblair | they have not installed any fiber around here yet, so i'm still on bonded dsl | 19:43 |
| jeblair | also, they have bonded dsl :) | 19:43 |
| *** r-daneel has joined #openstack-infra | 19:44 | |
| *** sergmelikyan has joined #openstack-infra | 19:44 | |
| *** j^2 has quit IRC | 19:45 | |
| *** mmmpork has joined #openstack-infra | 19:45 | |
| *** otherwiseguy has joined #openstack-infra | 19:45 | |
| SpamapS | Our version of that is DSL Extreme | 19:45 |
| *** j^2 has joined #openstack-infra | 19:46 | |
| SpamapS | And they can get me 4Mbit, but not at any decent price. | 19:46 |
| SpamapS | TWC is actually really good.. and I don't know how I could live w/o 30Mbit anymore. ;) | 19:46 |
| *** esker has joined #openstack-infra | 19:46 | |
| *** flepied has joined #openstack-infra | 19:47 | |
| *** pvaneck has quit IRC | 19:47 | |
| *** armax has joined #openstack-infra | 19:47 | |
| *** esker has quit IRC | 19:47 | |
| *** FallenPegasus has joined #openstack-infra | 19:47 | |
| *** jamielennox|away has joined #openstack-infra | 19:47 | |
| *** sergmelikyan has quit IRC | 19:47 | |
| *** esker has joined #openstack-infra | 19:47 | |
| *** jamielennox|away is now known as jamielennox | 19:47 | |
| fungi | the only option out here is between a wired provider who can't tell their anterior from their posterior, and wireless | 19:48 |
| openstackgerrit | Andreas Jaeger proposed openstack/requirements: Revert "Drop PuLP from g-r" https://review.openstack.org/215306 | 19:48 |
| *** flepied1 has joined #openstack-infra | 19:49 | |
| *** glauco__ has joined #openstack-infra | 19:50 | |
| *** glauco has quit IRC | 19:50 | |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet https://review.openstack.org/205097 | 19:52 |
| *** ryanpetrello has quit IRC | 19:52 | |
| *** sergmelikyan has joined #openstack-infra | 19:53 | |
| *** flepied has quit IRC | 19:53 | |
| *** resker has joined #openstack-infra | 19:53 | |
| *** ajmiller has quit IRC | 19:53 | |
| *** glauco__ has quit IRC | 19:54 | |
| *** ryanpetrello has joined #openstack-infra | 19:55 | |
| *** glauco has joined #openstack-infra | 19:56 | |
| *** resker has quit IRC | 19:56 | |
| *** doug-fis_ has joined #openstack-infra | 19:56 | |
| *** resker has joined #openstack-infra | 19:57 | |
| *** esker has quit IRC | 19:57 | |
| *** sergmelikyan has quit IRC | 19:58 | |
| *** sergmelikyan has joined #openstack-infra | 19:59 | |
| *** doug-fish has quit IRC | 19:59 | |
| *** doug-fish has joined #openstack-infra | 20:00 | |
| *** puranamr has quit IRC | 20:00 | |
| *** doug-fis_ has quit IRC | 20:01 | |
| austin81 | Hi all, timothyb89 and I are trying to get some visualization software pushed upstream for devstack-tempest runs. We think this tool will have a wide variety of uses across OS and would love any and all feedback/criticism/hatemail. The project is still in its infancy, but we would like to know if we are on the right track with functionality/scope. Thanks! Links to follow | 20:02 |
| austin81 | Git: https://github.com/timothyb89/stackviz POC devstack-gate patch: http://logs.openstack.org/07/212207/4/check/gate-tempest-dsvm-full/5a812af/logs/stackviz | 20:02 |
| austin81 | Server-side demo: http://15.126.244.104:8000/ | 20:02 |
| austin81 | ^ link to an upstream view we are working on. The individual run views in the static site will be utilized in helping analyze aggregate test results from subunit2sql DB | 20:03 |
| *** erikwilson has joined #openstack-infra | 20:03 | |
| fungi | austin81: timothyb89: neato. are you using the current public subunit2sql query account? | 20:04 |
| *** annegentle has quit IRC | 20:04 | |
| *** resker has quit IRC | 20:04 | |
| austin81 | fungi: yep! creds hardcoded into the project and all | 20:04 |
| fungi | heh | 20:04 |
| *** annegentle has joined #openstack-infra | 20:04 | |
| timothyb89 | Also, the parent patch of that logs.openstack.org link: https://review.openstack.org/#/c/212207/ | 20:04 |
| *** glauco has quit IRC | 20:05 | |
| fungi | austin81: timothyb89: i'm trying to query a nova change of mine but not seeing any stats. how recent is the data there? | 20:07 |
| *** sridhar_ram1 has joined #openstack-infra | 20:07 | |
| *** sridhar_ram has quit IRC | 20:08 | |
| austin81 | subunit2sql should be updated continuously, but only has merged changes. The plan is to add a view for gerrit api calls as well so un-merged changes can be queried as well | 20:08 |
| fungi | oh, got it | 20:08 |
| fungi | yeah, i was querying an open change. i'll test with merged ones | 20:08 |
| *** cdent has quit IRC | 20:09 | |
| *** sridhar_ram1 is now known as sridhar_ram | 20:09 | |
| *** sputnik13 has joined #openstack-infra | 20:09 | |
| clarkb | I'm on a phone so maybe this is expected but when looking at resource usage it tells me nothing about what is happening at the time eg what tests | 20:09 |
| clarkb | I think without that it will be hard to fix performance problems | 20:10 |
| fungi | clarkb: on the timeline view?> | 20:10 |
| clarkb | ya | 20:10 |
| fungi | i get details when i hover | 20:10 |
| clarkb | I see cpu net disk ram which is great but what is hapoebing | 20:10 |
| clarkb | ah ok so likely a phone issue then | 20:10 |
| timothyb89 | clarkb: that shows on mouse hover, though it should also work on mobile ... if not that should be fixed :) | 20:11 |
| sdake | would someone who knows mind sharing with me how tripleo tests multinode deployment - i.e. IIUC tripleo has their own gating hardware inside RHT that is integrated with the infra gate | 20:11 |
| fungi | the info box fills up with name, class, module, status, tags and duration details | 20:11 |
| fungi | sdake: they have a bastion model with a fixed number of bastions (and associated precreated networks) which act as jenkins slaves | 20:12 |
| fungi | sdake: at least that was the model last i saw details. no idea how much of that may have changed since | 20:12 |
| clarkb | note if tyou dont need baremetal that setup is a bit overkill | 20:13 |
| *** puranamr has joined #openstack-infra | 20:13 | |
| sdake | fungi typing define bastion into google doesn't seem to help :) | 20:13 |
| clarkb | fungi thats it excspt we boot the bastions dynamically via nova | 20:13 |
| sdake | clarkb i'd be satisified with vms | 20:13 |
| sdake | but we only get 1 vm | 20:13 |
| sdake | with 8gb ram | 20:13 |
| clarkb | sdake you can gave 2... | 20:13 |
| *** achanda has joined #openstack-infra | 20:13 | |
| timothyb89 | clarkb: not super obvious, but tapping onanywhere on the upper view will show the current timestamp, and tapping any test box will show details in the info box down below | 20:13 |
| * clarkb should write an enail to the dev list "we have multinode testing kthxbai" | 20:13 | |
| sdake | clarkb that would be fantastic ;) | 20:14 |
| sdake | clarkb I dont think anyone really knows that | 20:14 |
| fungi | sdake: a bastion is a "stronghold" but in computer systems administration terms it's a (usually somewhat locked-down/secured/audited) system which you use as the only means of connecting to other systems | 20:14 |
| clarkb | sdake it runs on everg nova patch its out there | 20:14 |
| clarkb | nova neutron devstack etc | 20:14 |
| sdake | clarkb i'll check out project-config for nova thanks | 20:14 |
| sdake | is there an upper limit on vms? | 20:15 |
| clarkb | right now its 2 | 20:15 |
| sdake | bummer | 20:15 |
| clarkb | none of the tests work reliably with that number so Inhavent worked to increase it | 20:15 |
| fungi | sdake: our current multinode solution is not variable-node, it's a fixed node count per type | 20:15 |
| sdake | any chance we can get an override? | 20:15 |
| clarkb | need working cloyds at 2 first | 20:15 |
| clarkb | sdake if you can make nova and neutron work with two nodes first :) | 20:15 |
| sdake | clarkb agree we can focus on two node deploy functioanl tests | 20:15 |
| sdake | i dont know if i can make nova and neutron gates work - that code is so way over my head ;) | 20:16 |
| clarkb | sdake you software depends on it | 20:16 |
| sdake | i spent 7 days learning how ips are assigned in nova - mindblowing | 20:16 |
| clarkb | so whether or not you can do it it is a prerequisite | 20:16 |
| sdake | nova wfm in 3 node setup along with neutron with kolla on bare metal | 20:16 |
| sdake | but this is using ansible to deploy the thing :) | 20:17 |
| clarkb | the deploymebt doesnt matter | 20:17 |
| fungi | sdake: you'll appreciate the devstack-gate implementation. it uses ansible to run stack.sh on the subnodes | 20:17 |
| clarkb | networking is broken with nova net and neutron in subtle ways that makes the fail rate higher on two nodes | 20:17 |
| clarkb | ip assignment is part of the problem ;) | 20:18 |
| clarkb | there appears to be a race between booting a node and telling dnsmasq what ip to give it | 20:18 |
| clarkb | then your nova boot fails | 20:18 |
| sdake | ya that ip assignment code is squirly | 20:18 |
| clarkb | thats one of the issues at least | 20:18 |
| sdake | it literally gets set in over 50 places | 20:18 |
| *** sthillma has quit IRC | 20:18 | |
| *** achanda has quit IRC | 20:19 | |
| sdake | ok so lets assume I get deployment working with 2 vms | 20:19 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/gearman-plugin: Send node label with data status packet https://review.openstack.org/205097 | 20:19 |
| *** glauco has joined #openstack-infra | 20:19 | |
| sdake | could we get more vms after? | 20:19 |
| clarkb | sdake it us technically possible yes | 20:19 |
| fungi | the current model scales to an arbitrary number of nodes, but we have to set the node count for a given multinode label | 20:20 |
| clarkb | nodepool can do up to N node clusters where N is max VMs as set by min(provider quotas) also ^ | 20:20 |
| *** sergmelikyan has quit IRC | 20:21 | |
| *** ams__ has joined #openstack-infra | 20:21 | |
| *** glauco has quit IRC | 20:21 | |
| fungi | so you would, for example, use a 5-node worker for a particular job, not define the number of subnodes within the job | 20:21 |
| sdake | would N=5 be out of the question? | 20:21 |
| clarkb | sdake judgibg how 2 nodes is going, yes I just dont see anyone getting it reliable | 20:22 |
| clarkb | maybe we try it for lols but there isnt enough effort behind this to get that big a cloud working any time soon | 20:22 |
| sdake | clarkb keep in mind I want to test deployment not if the deployment works | 20:22 |
| sdake | that testing if the deployment works is phase 3 ;) | 20:22 |
| clarkb | you dont need 5 nodes for that | 20:22 |
| sdake | 3 control 1 compute 1 network node | 20:23 |
| sdake | and possibly a storage node as well | 20:23 |
| clarkb | why couldnt you all in one if ansible returning 0 is the goal? | 20:23 |
| sdake | because multinode deployment an all in one are subtly different - they use different inventory files | 20:23 |
| clarkb | (I love that ansible has sane return codes btw) | 20:24 |
| sdake | yar ansible rocks | 20:24 |
| sdake | only 50 hours of experience and already productive with it | 20:24 |
| fungi | (also not implemented in ruby!) | 20:24 |
| sdake | zomg ruby DIAF | 20:24 |
| * fungi feels like a language snob for saying that, but whatever | 20:24 | |
| clarkb | sdake I guess determining if controller deploys and determining if compute deploy etc are one node things to me | 20:25 |
| *** glauco has joined #openstack-infra | 20:25 | |
| sdake | fungi its ok everyone that understands computer science things ruby is evil :) | 20:25 |
| clarkb | and until you have tests of the deployment you dont need all 5 togetger | 20:25 |
| sdake | agree our first step is an all in one gate | 20:25 |
| *** rossella_s has quit IRC | 20:25 | |
| sdake | just thinking ahead | 20:25 |
| *** rossella_s has joined #openstack-infra | 20:25 | |
| *** glauco has quit IRC | 20:26 | |
| sdake | getting an aio gate to run will be a big challenge | 20:26 |
| greghaynes | clarkb: for some reason our nodepool delete snap_image sets the snap_image.state = DELETE then a few lines below deletes the snap_image... | 20:26 |
| clarkb | also I should note I am probably over skeptical because everyone said we needed multinode testing then we finally add it and now no one is actually inyerested in fixing bugs | 20:26 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Add dib deletion test https://review.openstack.org/215275 | 20:26 |
| clarkb | so very much want to encourage starting small and making incremental steps to where people are confortable rather than spending effort jumping way beyond that immediatwly | 20:26 |
| sdake | clarkb most people that understand a project (like nova) and project-config to any degree are drinking from a firehose atm :) | 20:26 |
| *** BharatK has quit IRC | 20:27 | |
| sdake | clarkb i totally agree with incremental | 20:27 |
| clarkb | sdake that doesnt invalidate my concerb | 20:27 |
| fungi | 1. "we should test with multiple nodes!" 2. "look we have multiple nodes..." 3. "our software is so broken with multiple nodes :/" | 20:27 |
| sdake | clarkb ya just an observation on why its not being done :) | 20:27 |
| sdake | from personal experience | 20:27 |
| clarkb | greghaynes because sometimes openstack doesnt actually delete | 20:27 |
| fungi | firehose tastes goooood | 20:27 |
| clarkb | greghaynes so if the first delete fails the periodic cleanup "cron" will try try again | 20:28 |
| sdake | clarkb i do want to get to a basic dead chicken test with AIO gating as well | 20:28 |
| *** warpc__ has quit IRC | 20:28 | |
| sdake | so its not just testing deployment, but that is where i'm going to start (small) | 20:28 |
| *** skylerberg has left #openstack-infra | 20:29 | |
| sdake | ultimately i want an AIO deploy that nova boots and tests vm is in active state, and verifies vm obtains dhcp | 20:29 |
| greghaynes | clarkb: 'doesnt actually delete' seems suspicious, I think its just happening not instantly | 20:29 |
| sdake | but from there i want to go multinode | 20:30 |
| sdake | so it sounds like we can go multinode - so thanks for the info :) | 20:30 |
| clarkb | I would do all in one tgen two node with controller + compute and go from thetr | 20:30 |
| clarkb | grrghayjes nope sometimes nova returns 200 but doesnt do the action | 20:31 |
| *** e0ne has joined #openstack-infra | 20:31 | |
| sdake | sounds good clarkb | 20:31 |
| greghaynes | clarkb: that was an impressive name typo | 20:31 |
| clarkb | greghaynes so you leak otherwise | 20:31 |
| clarkb | grr! | 20:31 |
| sdake | so 1 node, 2 nodes, then we can beg for more vms once our gate jobs are stable ;) | 20:31 |
| greghaynes | clarkb: oh, im talking about much more simple | 20:31 |
| greghaynes | clarkb: just the nodedb models | 20:31 |
| sdake | atm our image building job isn't even stable | 20:31 |
| * sdake sadfaces | 20:31 | |
| clarkb | sdake ya :) and I bet you we learn a lot just starting there | 20:31 |
| *** achanda has joined #openstack-infra | 20:32 | |
| sdake | clarkb samyaple wants to do docker in docker testing on 1 vm to look like multiple host oses, but I don't think it will techncally work correctly because of libvirt interactions with systemd | 20:33 |
| sdake | plus the fact that /run is host bindmounted :( | 20:33 |
| openstackgerrit | Michael Krotscheck proposed openstack/requirements: Updated oslo middleware to 2.6.1 https://review.openstack.org/215320 | 20:33 |
| krotscheck | dum dee dum | 20:34 |
| *** Sukhdev has quit IRC | 20:34 | |
| *** glauco has joined #openstack-infra | 20:35 | |
| dims_ | krotscheck: you may want to rebase that on top of https://review.openstack.org/#/c/215124/ | 20:35 |
| *** glauco has quit IRC | 20:35 | |
| mriedem | clarkb: we seem to have lost logstash again | 20:37 |
| openstackgerrit | Michael Krotscheck proposed openstack/requirements: Updated oslo middleware to 2.6.1 https://review.openstack.org/215320 | 20:37 |
| krotscheck | Done | 20:37 |
| krotscheck | dims_: Done | 20:37 |
| *** signed8bit is now known as signed8bit_ZZZzz | 20:37 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron bug 1485969 https://review.openstack.org/215321 | 20:38 |
| openstack | bug 1485969 in neutron "test_dualnet_multi_prefix_dhcpv6_stateless failed due to "RuntimeError: Set changed size during iteration" in quota code" [Undecided,In progress] https://launchpad.net/bugs/1485969 - Assigned to Ihar Hrachyshka (ihar-hrachyshka) | 20:38 |
| *** zul has joined #openstack-infra | 20:39 | |
| *** sergmelikyan has joined #openstack-infra | 20:39 | |
| *** glauco has joined #openstack-infra | 20:40 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:40 | |
| *** glauco has quit IRC | 20:41 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 20:41 | |
| *** boris-42 has joined #openstack-infra | 20:41 | |
| clarkb | mriedem can you expand on that? | 20:42 |
| clarkb | we indexibg html? or? | 20:42 |
| *** jtomasek has quit IRC | 20:42 | |
| mriedem | i had a query that worked awhile back, then hit refresh and now getting an error on kibana | 20:42 |
| mriedem | http://goo.gl/OhK7k6 | 20:43 |
| Swanson | If zuul is no longer showing my queues what have I screwed up? Jenkins is running. Gearman is supposedly running. | 20:43 |
| *** glauco_ has joined #openstack-infra | 20:44 | |
| *** FallenPegasus has quit IRC | 20:44 | |
| *** glauco_ has quit IRC | 20:45 | |
| vipul | infra runs a pypi mirror right? Is there generally a delay in the sync to upstream pypi? | 20:46 |
| *** glauco has joined #openstack-infra | 20:46 | |
| fungi | Swanson: what do you mean "showing"? (status.json, logs...) | 20:47 |
| fungi | vipul: under normal circumstances, 5 minutes | 20:47 |
| *** glauco has quit IRC | 20:47 | |
| fungi | rather, up to 5 minutes | 20:47 |
| *** geoffarnold has joined #openstack-infra | 20:47 | |
| *** puranamr has quit IRC | 20:47 | |
| vipul | fungi: ok i'll try to recheck.. maybe just a timing thing | 20:48 |
| fungi | but sometimes there are issues with the mirroring software (bandersnatch), or with pypi's event serialization, or with the fastly cdn in front of pypi.python.org (negatively-)caching things it shouldn't | 20:48 |
| fungi | vipul: have an example? i can check | 20:48 |
| vipul | fungi: http://logs.openstack.org/96/211696/9/check/gate-cue-integration-dsvm-rabbitmq/35662f9/logs/pip-freeze.txt.gz | 20:48 |
| vipul | this run should have used oslo.db 2.4.1 | 20:48 |
| Swanson | fungi: Oh, hey. If I wait long enough I get a status.json: Proxy Error. I should have three (sample) headers at the top. check, silent and something else. I get nothing. Doesn't even show the last time it was updated anymore. | 20:49 |
| Swanson | fungi: Not sure what changed to break it. | 20:49 |
| fungi | Swanson: sounds like the zuul daemon isn't running | 20:49 |
| fungi | or is hung somehow | 20:49 |
| vipul | which tox was actually able to donwload, since unit tests to this patch passed | 20:49 |
| *** armax has quit IRC | 20:49 | |
| vipul | fungi: but dsvm-gate still continues to fetch older version | 20:49 |
| *** bswartz has quit IRC | 20:50 | |
| Swanson | fungi: I agree. server zuul status shows it is running. /var/run/zuul shows no pid. | 20:50 |
| *** nadya has quit IRC | 20:50 | |
| *** smoser has quit IRC | 20:50 | |
| fungi | vipul: the job is using our upper constraints file http://git.openstack.org/cgit/openstack/requirements/tree/upper-constraints.txt#n185 | 20:50 |
| *** glauco has joined #openstack-infra | 20:50 | |
| vipul | oh.. | 20:51 |
| vipul | we should update that | 20:51 |
| fungi | vipul: the point of that mechanism is to keep us from using new releases of libraries until we've run some integration tests to determine whether increasing the constraint pin will break | 20:51 |
| *** glauco has quit IRC | 20:51 | |
| *** hodos has quit IRC | 20:51 | |
| clarkb | mriedem: I will know more as soon as firefox determines it is no longer on vacation | 20:52 |
| vipul | Ok makes sense.. there were a couple of bugs that broke Cue and i believe Magnum in 2.4.0 | 20:52 |
| vipul | which is why 2.4.1 came out quickly | 20:52 |
| *** geoffarnold has quit IRC | 20:52 | |
| fungi | vipul: a change is proposed automatically to bump it each day, but a manual change to it can be proposed if needed | 20:52 |
| clarkb | and it can only merge if it actually works | 20:53 |
| vipul | fungi: i shall submit a patch then | 20:53 |
| clarkb | so its also possible that there is a backup behind a broken dep and that would be a case where a manual patch may help | 20:53 |
| fungi | vipul: today's change seems to want to increase cffi, nose-exclude and pysqlite, one of which is breaking the integration tests which ran against it https://review.openstack.org/214971 | 20:53 |
| clarkb | mriedem: I think its an issue of the search span | 20:54 |
| clarkb | mriedem: it comes back fine with a shorter search term, likely the older indexes are poluted with so much html crap that we are not very performant searching them | 20:55 |
| *** regXboi has quit IRC | 20:55 | |
| fungi | vipul: looks like dims has already proposed https://review.openstack.org/215255 | 20:55 |
| vipul | fungi: was about to paste the same link | 20:55 |
| vipul | can that be merged to unblock us? | 20:55 |
| fungi | vipul: if you can find a second +2 for it | 20:56 |
| clarkb | fungi: updates to upper constraints rae single +2 you can approve | 20:56 |
| clarkb | oh except global reqs is changed | 20:56 |
| clarkb | ya you need second +2 for that | 20:56 |
| clarkb | give me a moment | 20:56 |
| vipul | clarkb: you can do it! | 20:57 |
| *** alivigni has quit IRC | 20:57 | |
| *** achanda has quit IRC | 20:57 | |
| *** achanda_ has joined #openstack-infra | 20:57 | |
| clarkb | fungi: now we wait and see how long it takes us to make upper constraints work again | 20:58 |
| *** e0ne has quit IRC | 20:58 | |
| clarkb | (this ws my biggest concern with the system, what is time to fixing of broken) | 20:58 |
| clarkb | greghaynes: https://jenkins03.openstack.org/job/gate-dsvm-nodepool-nv/10/console that made a dib image \o/ but we didn't have a ready node off of it yet I bet the timeout is too short after the 9 minute build | 20:59 |
| fungi | clarkb: yeah, it's a pretty effective mechanism to avoid breaking us. however unless someone digs into the failures, we'll just forever be constraining to older than available versions of all our deps | 20:59 |
| clarkb | greghaynes: reading logs now to see | 20:59 |
| fungi | and the incentive to look into it is much less since it's no longer preventing anyone from getting other work done instead | 20:59 |
| clarkb | fungi: yup and potentially vulnerable to security bugs and other bugs too | 20:59 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Add dib deletion test https://review.openstack.org/215275 | 20:59 |
| vipul | shouldn't the automated patch do one dependency at a time? | 20:59 |
| *** glauco has joined #openstack-infra | 20:59 | |
| vipul | i bet only one of those 3 propsed changes are actually breaking things | 21:00 |
| fungi | vipul: possible enhancement, but for now it's semi-trivial to bisect the list | 21:00 |
| *** dannywil_ has joined #openstack-infra | 21:00 | |
| *** geoffarnold has joined #openstack-infra | 21:00 | |
| clarkb | the problem with one per patch is what order do you use? | 21:01 |
| clarkb | it doesn't really fix the issue of blocking all the things | 21:01 |
| mriedem | clarkb: ah yeah, 24h back works for me in kibana | 21:01 |
| fungi | i'll propose three changes now and see which ones go asplodey | 21:01 |
| *** sthillma has joined #openstack-infra | 21:01 | |
| *** ivar-lazzaro has joined #openstack-infra | 21:02 | |
| openstackgerrit | Jeremy Stanley proposed openstack/requirements: Test increasing cffi constraint https://review.openstack.org/215331 | 21:03 |
| clarkb | should we take bets? | 21:03 |
| *** dannywilson has quit IRC | 21:03 | |
| clarkb | my money is on ^ | 21:03 |
| fungi | yeah, also why i pushed it first | 21:03 |
| *** sthillma has quit IRC | 21:04 | |
| openstackgerrit | Jeremy Stanley proposed openstack/requirements: Test increasing nose-exclude constraint https://review.openstack.org/215333 | 21:04 |
| *** sthillma has joined #openstack-infra | 21:04 | |
| openstackgerrit | Jeremy Stanley proposed openstack/requirements: Test increasing pysqlite constraint https://review.openstack.org/215334 | 21:05 |
| *** FallenPegasus has joined #openstack-infra | 21:05 | |
| *** tiswanso has quit IRC | 21:05 | |
| *** aysyd has quit IRC | 21:06 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 21:06 |
| fungi | it almost insta-failed, so we should have an answer pretty quickly | 21:07 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too. https://review.openstack.org/211754 | 21:08 |
| clarkb | greghaynes: ^ almost there I think needed to make the /etc/nodepool dir in addition to installing sshd | 21:08 |
| *** gondoi is now known as zz_gondoi | 21:10 | |
| *** yamahata has joined #openstack-infra | 21:10 | |
| *** regXboi has joined #openstack-infra | 21:11 | |
| greghaynes | I like how this incorporates 3 different package specification systems | 21:12 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-accessbot: Basic acceptance tests https://review.openstack.org/206438 | 21:12 |
| greghaynes | devstack, dib's package-installs, and we could put a bindep file in there | 21:12 |
| *** rm_work|away is now known as rm_work | 21:13 | |
| fungi | greghaynes: once bindep is more ubiquitous, i want to work on switching devstack's package lists over to using it | 21:13 |
| *** austin81 has left #openstack-infra | 21:13 | |
| *** ldnunes has quit IRC | 21:13 | |
| clarkb | greghaynes: why do something only one way when you can do it all the ways! | 21:14 |
| greghaynes | Thatd be awesome | 21:14 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman https://review.openstack.org/198114 | 21:15 |
| clarkb | greghaynes: if I can get that working I will update the job to run a script out of nodepool itself for the test then we can make it do more specific checks rather than grep something exists | 21:15 |
| pabelanger | clarkb: do you know of any jobs that are using ansible today to do loop back ssh? First try into the gate rejected the connection because fatal: [localhost] => SSH Error: Permission denied (publickey). | 21:15 |
| greghaynes | nice, made a test for ^, verified it was broken in test, and now it passes | 21:15 |
| *** hdd has quit IRC | 21:15 | |
| fungi | clarkb: oho! i see the problem. cffi 1.2.0 apparently existed very briefly, then got replaced by 1.2.0-1 and 1.2.1 | 21:16 |
| *** sergmelikyan has quit IRC | 21:16 | |
| *** dprince has quit IRC | 21:16 | |
| clarkb | pabelanger: all devstack-gate runs use the local connection ansible setting | 21:16 |
| clarkb | fungi: nice | 21:16 |
| pabelanger | clarkb: thanks | 21:16 |
| fungi | clarkb: 1.2.0 was deleted or never sync'd | 21:16 |
| fungi | i'll know from the bandersnatch logs in a bit | 21:16 |
| clarkb | pabelanger: for actual ssh to localhost thats how the puppet beakre jobs work (not ansible but same idea) | 21:16 |
| *** jeadre has quit IRC | 21:16 | |
| *** thorst has quit IRC | 21:16 | |
| fungi | pabelanger: worst case you can ssh-keygen and then append the resulting public key to the authorized_keys file for the same user (presumably jenkins) | 21:17 |
| *** derekh has joined #openstack-infra | 21:17 | |
| pabelanger | fungi: Ha, I was just thinking that :) | 21:17 |
| clarkb | fungi: thats what the beaker jobs do but I would just start iwth ansibles local connection thing first | 21:17 |
| fungi | oh, sure | 21:17 |
| *** flepied1 has quit IRC | 21:18 | |
| fungi | use the mock "connection" first if you can, obviously | 21:18 |
| *** zul has quit IRC | 21:18 | |
| *** erlon has quit IRC | 21:18 | |
| pabelanger | Yup, testing that now | 21:19 |
| pabelanger | thanks | 21:19 |
| *** annegentle has quit IRC | 21:20 | |
| fungi | clarkb: bingo! 2015-08-19 14:15:02,687 INFO: Removing deleted file /srv/static/mirror/web/packages/source/c/cffi/cffi-1.2.0.tar.gz | 21:20 |
| *** annegentle has joined #openstack-infra | 21:20 | |
| clarkb | fungi: that'll do it | 21:21 |
| clarkb | so I guess we just wait for tomorrow | 21:21 |
| *** eharney has quit IRC | 21:21 | |
| *** cburroughs has quit IRC | 21:22 | |
| *** FallenPegasus has quit IRC | 21:22 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for neutron bug 1485969 https://review.openstack.org/215321 | 21:23 |
| openstack | bug 1485969 in neutron "test_dualnet_multi_prefix_dhcpv6_stateless failed due to "RuntimeError: Set changed size during iteration" in quota code" [Undecided,In progress] https://launchpad.net/bugs/1485969 - Assigned to Ihar Hrachyshka (ihar-hrachyshka) | 21:23 |
| fungi | yep | 21:23 |
| *** rfolco has quit IRC | 21:23 | |
| fungi | as suspected, the cffi bump failed out quickly across the board, the others are still running | 21:24 |
| *** erikmwilson_ has joined #openstack-infra | 21:25 | |
| *** ayoung has quit IRC | 21:25 | |
| *** krtaylor has quit IRC | 21:26 | |
| *** armax has joined #openstack-infra | 21:26 | |
| *** amitgandhinz has quit IRC | 21:28 | |
| *** thiagop_afk has quit IRC | 21:28 | |
| *** stevemar has quit IRC | 21:28 | |
| *** erikwilson has quit IRC | 21:29 | |
| *** dguerri` is now known as dguerri | 21:30 | |
| *** hdd has joined #openstack-infra | 21:31 | |
| *** dguerri is now known as dguerri` | 21:31 | |
| *** dkranz has joined #openstack-infra | 21:32 | |
| pabelanger | fungi: clarkb: thanks, worked as expected in the gate | 21:33 |
| *** kgiusti has quit IRC | 21:33 | |
| pabelanger | really eagar to see what the zuulv3 playbooks will look like. | 21:34 |
| *** lucas-dinner has quit IRC | 21:34 | |
| pabelanger | wrote a quick zuul-cloner task to ensure my repo is cloned over ssh (localhost) properly, vs using copy task | 21:34 |
| pabelanger | worked as expected | 21:35 |
| jeblair | fungi, clarkb, SpamapS: woohoo! connectivity re-established: 22/2.6 | 21:35 |
| *** bdemers has quit IRC | 21:35 | |
| jeblair | the previous owners had a strange idea of how to deal with telco wiring... | 21:36 |
| jeblair | they ran a nice new cat5 cable, cut it, and then spliced two pairs together. | 21:36 |
| clarkb | pabelanger: I expect they will look like zuul-cloner && run script with conditional logic inside | 21:36 |
| clarkb | pabelanger: similar to how we use it with d-g simply because do things like if foo then bar else baz or for X in Y is clunky and weird in ansible | 21:37 |
| clarkb | its doable but hard to read | 21:37 |
| clarkb | jeblair: uh | 21:37 |
| pabelanger | clarkb: Right. Thats what my first pass did. playbook for zuul cloner, then use shell task to run bash script per normal. | 21:38 |
| clarkb | pabelanger: yup then probably a playbook that does file copy in an ansibly way | 21:38 |
| pabelanger | Going to play around with moving some of bash script into ansible, but I figure it is going to be a fine line of what goes where | 21:38 |
| clarkb | er not playbook a task? whatever the individual bits are called | 21:38 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:38 | |
| jeblair | clarkb: exactly. in related news, i have box of jacks, 1000ft of cable, and a patch panel delivered from monoprice sitting in front of me. :) | 21:38 |
| clarkb | pabelanger: ya we tried it with d-g and the problem you run into is its very hard to follow control flow at least for me | 21:38 |
| pabelanger | clarkb: Ya, for now I created zuul-playbooks in my repo, which setups the workspaces like jenkins does today. Once we get zuulv3 going, I can bomb that directory. My project specific code will live in playbooks like the spec suggests | 21:40 |
| *** dannywil_ has quit IRC | 21:40 | |
| *** abdelwas_ has quit IRC | 21:40 | |
| clarkb | oh and hte other funky thing is logging | 21:41 |
| clarkb | because apparently thats a for pay add on | 21:41 |
| clarkb | so by pushing execution into shell you can get sane logging | 21:41 |
| *** smoser has joined #openstack-infra | 21:41 | |
| *** doug-fish has quit IRC | 21:42 | |
| pabelanger | Ya, I am looking at that now. Ugly blob of data in jenkins console. fun times | 21:42 |
| *** doug-fish has joined #openstack-infra | 21:42 | |
| clarkb | I think we will likely end up writing an ansible module/plugin/something to fix its logging whihc shouldn't be too bad since the python logging module is in stdlib | 21:42 |
| clarkb | it just doesn't exist today | 21:42 |
| *** annegentle has quit IRC | 21:42 | |
| pabelanger | right | 21:43 |
| *** hdd has quit IRC | 21:45 | |
| *** doug-fish has quit IRC | 21:46 | |
| fungi | jeblair: congrats! i need to use the existing phone lines in our plenum as pull strings to run cat-5. that's when i run out of more pressing things to fix | 21:48 |
| *** FallenPegasus has joined #openstack-infra | 21:48 | |
| *** bapalm has quit IRC | 21:49 | |
| jeblair | and now i'm on my new block of 8 static ip addresses! | 21:50 |
| fungi | slick | 21:51 |
| *** ybathia has quit IRC | 21:51 | |
| fungi | enjoy your /29 | 21:51 |
| fungi | how much ipv6 do they provide you? | 21:51 |
| fungi | /48? /56? | 21:51 |
| nibalizer | how many internets? | 21:51 |
| fungi | all. all the internets | 21:52 |
| *** bapalm has joined #openstack-infra | 21:52 | |
| nibalizer | hehe | 21:52 |
| nibalizer | well a /64 is an internet of internets right? | 21:52 |
| nibalizer | is the joke I was going for | 21:52 |
| * nibalizer will head back to reviews | 21:53 | |
| clarkb | jeblair: you can run a 6 node cloud for us | 21:54 |
| fungi | an internet of internets, yes. and a /48 is 1.5 internets of internets | 21:54 |
| fungi | er, internet^1.5 of internets | 21:54 |
| jeblair | fungi: i'm actually not sure; they've been a bit behind on ipv6, so i have an he.net tunnel at home. but this is new equipment, they might have something now. | 21:54 |
| *** dannywilson has joined #openstack-infra | 21:54 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 21:54 | |
| *** signed8bit has quit IRC | 21:55 | |
| clarkb | jeblair: for when nodepool writes to /etc/nodepool it does that as the test user so we need to give it perms to do those writes? | 21:56 |
| * clarkb greps | 21:56 | |
| fungi | it's hard to not find modern network equipment, even consumer/cpe, without v6 support | 21:56 |
| *** bapalm has quit IRC | 21:57 | |
| * fungi has confused himself with compound negatives now | 21:57 | |
| clarkb | I still get a bunch of loss thorugh seattle on comcast ipv6 | 21:57 |
| jeblair | clarkb: yeah, so we made /etc/nodepool world writable | 21:57 |
| *** sergmelikyan has joined #openstack-infra | 21:57 | |
| fungi | well, yes. the provider's implementation may be lacking, but missing support in the hardware/embedded os is usually not the reason | 21:58 |
| clarkb | yup see that now chmod 777 | 21:58 |
| fungi | we had a discussion around the 777 perms at the time, as i recall, and concluded that it was the simplest solution since we can't predict the account | 21:59 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too. https://review.openstack.org/211754 | 21:59 |
| clarkb | this is so close | 21:59 |
| fungi | what's the run duration like? | 22:00 |
| clarkb | fungi: it still ~20 minutes for devstack then wait 15 minutes for things before cheking | 22:01 |
| *** geoffarnold has quit IRC | 22:01 | |
| clarkb | I think that may be just long enough but want to move the wait and check into nodepool itself so we don't have toupdate the job just for that | 22:01 |
| clarkb | one thing at a time | 22:01 |
| fungi | i guess dib is also going to add some flakiness there with network interaction for package retrieval | 22:02 |
| *** geoffarnold has joined #openstack-infra | 22:02 | |
| clarkb | ya but should be minimal the package list is small there | 22:02 |
| *** bapalm has joined #openstack-infra | 22:03 | |
| fungi | we could add the set to the list of packages to cache on our workers and then you could copy that into dib's cache to prime it | 22:03 |
| clarkb | yup thta would be one option too | 22:03 |
| *** sergmelikyan has quit IRC | 22:04 | |
| *** w_ has joined #openstack-infra | 22:05 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 22:05 |
| nigelb | jeblair / fungi - thanks for the ping! Looks like my naios plugin worked! :) | 22:05 |
| *** claudiub has quit IRC | 22:05 | |
| nigelb | though, it didn't give me any other side effects since the ban is still in place and seems to be holding up. | 22:05 |
| *** bapalm has quit IRC | 22:08 | |
| openstackgerrit | lifeless proposed openstack/requirements: Revert "Drop PuLP from g-r" https://review.openstack.org/215306 | 22:08 |
| *** olaph has quit IRC | 22:09 | |
| fungi | nigelb: yep, this time it came to our attention because our server mounts /var/run/lock on a very tiny tmpfs and /var/run/lock/mailman filled it up with lockfiles from the subscribe requests | 22:09 |
| nigelb | ouch | 22:09 |
| fungi | so people stopped being able to subscribe to mailing lists (which probably also limited the attack somewhat beyond that point) | 22:10 |
| nigelb | ha! I really feel bad for the poor guy that owns that email. | 22:10 |
| *** camunoz has joined #openstack-infra | 22:11 | |
| pleia2 | nigelb: nicely done | 22:11 |
| *** rlucio has joined #openstack-infra | 22:11 | |
| nigelb | ^_^ | 22:12 |
| *** w_ has quit IRC | 22:13 | |
| *** doug-fish has joined #openstack-infra | 22:14 | |
| *** bapalm has joined #openstack-infra | 22:14 | |
| *** w_ has joined #openstack-infra | 22:15 | |
| *** oomichi has joined #openstack-infra | 22:17 | |
| *** krtaylor has joined #openstack-infra | 22:18 | |
| *** doug-fish has quit IRC | 22:18 | |
| *** bapalm has quit IRC | 22:19 | |
| *** ayoung has joined #openstack-infra | 22:19 | |
| *** annegentle has joined #openstack-infra | 22:20 | |
| *** ybathia has joined #openstack-infra | 22:24 | |
| *** chlong has quit IRC | 22:25 | |
| *** zul has joined #openstack-infra | 22:26 | |
| *** oomichi has quit IRC | 22:26 | |
| fungi | does 202210 crash gertty for anyone besides me? (tested both latest release and master branch tip) | 22:27 |
| fungi | urwid.listbox.ListBoxError: Invalid offset_inset: -2, only 1 rows in target! | 22:27 |
| fungi | wondering if it's at all related to my terminal size | 22:28 |
| fungi | going to try some other font sizes to confirm | 22:28 |
| *** bapalm has joined #openstack-infra | 22:29 | |
| fungi | ooh, new pip/virtualenv today | 22:31 |
| clarkb | which are not contraints protected | 22:32 |
| jesusaurus | fungi: its not crashing gertty for me | 22:32 |
| *** thorst has joined #openstack-infra | 22:32 | |
| fungi | new pip includes a fix for crashing on unwriteable wheel cache dir | 22:32 |
| *** annegentle has quit IRC | 22:33 | |
| *** tlian has quit IRC | 22:33 | |
| fungi | also a possible fix for the cffi issue on fedora | 22:33 |
| *** annegentle has joined #openstack-infra | 22:33 | |
| fungi | (where the .so was getting left behind when switching between distro packages and pip-installed packages) | 22:34 |
| *** bapalm has quit IRC | 22:34 | |
| *** mriedem is now known as mriedem_away | 22:35 | |
| *** bapalm has joined #openstack-infra | 22:35 | |
| jhesketh | Morning | 22:36 |
| clarkb | good morning | 22:36 |
| *** tlian has joined #openstack-infra | 22:36 | |
| *** annegentle has quit IRC | 22:38 | |
| *** xyang1 has quit IRC | 22:38 | |
| *** ams__ has quit IRC | 22:39 | |
| *** rfolco has joined #openstack-infra | 22:39 | |
| *** ashleigh_ has quit IRC | 22:40 | |
| *** glauco has quit IRC | 22:42 | |
| fungi | interesting, so i confirm i can crash gertty the same way on another machine with the same terminal geometry (80x24) but if in increase the terminal by a row (80x25) it's fine | 22:42 |
| *** jtrovo has quit IRC | 22:43 | |
| *** bapalm has quit IRC | 22:43 | |
| *** bapalm has joined #openstack-infra | 22:43 | |
| fungi | that change crashes it with an 80x23 terminal as well | 22:44 |
| fungi | i have a feeling it's being triggered by that one especially large review comment | 22:45 |
| *** wenlock has quit IRC | 22:45 | |
| fungi | and scrolling down to it in an 80x24 or smaller terminal triggers the bug, but in an 80x25 or larger does not | 22:45 |
| openstackgerrit | Tyler Cipriani proposed openstack-infra/jenkins-job-builder: adding support for android emulator https://review.openstack.org/146990 | 22:47 |
| *** EricGonczer_ has joined #openstack-infra | 22:48 | |
| *** bapalm has quit IRC | 22:48 | |
| *** dannywilson has quit IRC | 22:48 | |
| *** btully has quit IRC | 22:49 | |
| *** bapalm has joined #openstack-infra | 22:51 | |
| *** rkukura has quit IRC | 22:52 | |
| *** thorst has quit IRC | 22:55 | |
| *** EricGonczer_ has quit IRC | 22:55 | |
| jeblair | fungi: yeah, i think there is a lingering bug (or bugs) related to that. :/ | 22:56 |
| *** dannywilson has joined #openstack-infra | 22:57 | |
| fungi | i'm in the process of filling one in | 22:57 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch overcloud-f21-nonha to instack https://review.openstack.org/185151 | 22:57 |
| fungi | since it's a little deeper in urwid than i can grok for the moment | 22:57 |
| openstackgerrit | Mikhail S Medvedev proposed openstack-infra/puppet-project_config: Allow specifying repo ref as a class parameter https://review.openstack.org/184353 | 22:57 |
| *** sabeen1 has quit IRC | 22:59 | |
| pleia2 | StevenK: ping me when you're about? want to get caught up on zanata status so I can follow up with Daisy and figure out what to focus on next week | 23:00 |
| pleia2 | StevenK: I'm around all evening here, so whenever you're awake, no rush | 23:00 |
| *** rm_work is now known as rm_work|away | 23:01 | |
| *** rkukura has joined #openstack-infra | 23:01 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Move nodepool test checks into nodepool https://review.openstack.org/215373 | 23:02 |
| *** sridhar_ram has quit IRC | 23:02 | |
| *** sridhar_ram has joined #openstack-infra | 23:02 | |
| * SpamapS wrestles with hash and erb, battling hiera, and puppet .. a statement that in any other context would probably be cause for an intervention.. | 23:02 | |
| sdake | fungi around for a quick question - someone trying to write a commit and their launchpad id doesn't match their gerrit id | 23:02 |
| *** sergmelikyan has joined #openstack-infra | 23:03 | |
| *** asettle has joined #openstack-infra | 23:03 | |
| *** ayoung has quit IRC | 23:03 | |
| sdake | shouldn't launchpad id match the gerrit review id? | 23:03 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run the post nodepool deploy checks from nodepool https://review.openstack.org/215374 | 23:03 |
| clarkb | pleia2: fungi ^ those two changes should be ready and give us even better nodepool testing | 23:04 |
| derekh | Hi, I sent 2 mails to the dev list earlier and neither has appeared, I'm told there may have been mailman problems, should I resend the mails? | 23:04 |
| clarkb | sdake: you mean username? | 23:04 |
| clarkb | sdake: there is nothing that requires the usernames match | 23:04 |
| sdake | clarkb yup | 23:04 |
| sdake | where does the username come from? | 23:04 |
| clarkb | sdake: you can set it in gerrit | 23:04 |
| clarkb | derekh: we have been used as a ddos vector via subscription reuests. I suppose its possible gmail really hates us now or something | 23:05 |
| jlvillal | Is there a status page on Zuul? I see the status that gate jobs are taking about 8+ hours at the moment. Just curious if there was a page that says why. It seems slower than usual, but maybe that is my imagination. | 23:05 |
| openstackgerrit | Tyler Cipriani proposed openstack-infra/jenkins-job-builder: adding support for android emulator https://review.openstack.org/146990 | 23:05 |
| clarkb | derekh: do the emails show up in the archive on lists.openstack.org/ | 23:05 |
| *** achanda_ has quit IRC | 23:05 | |
| sdake | clarkb how do you chnge the username? | 23:05 |
| clarkb | jlvillal: http://status.openstack.org/zuul you mean? | 23:05 |
| clarkb | sdake: you don't | 23:05 |
| derekh | clarkb: nope, their not there either | 23:05 |
| EmilienM | can someone +A https://review.openstack.org/#/c/214655/ please ? thanks :) | 23:06 |
| sdake | clarkb the fundamental issue is he does git review and it fails | 23:06 |
| sdake | so I thought to fix he could get his username nad launchpad id in sync | 23:06 |
| jlvillal | clarkb: Not really, that just tells me it is taking a long time. I was hoping there was a reason for it. Unless the only reason is that there are a lot of jobs. I was thinking maybe there were some build servers out of action or something like that. | 23:06 |
| jlvillal | Maybe it is just too many jobs. | 23:06 |
| *** dangers is now known as dangers_away | 23:07 | |
| clarkb | sdake: that won't fix it, confirm the username at https://review.openstack.org/#/settings/ then do git config gitreview.username whatevertheusernameis then rerun git review -s | 23:07 |
| clarkb | jlvillal: usually the reason is tests failed a lot reseting things and losing progress + many jobs to run | 23:07 |
| clarkb | jlvillal: the graph at the bottom of the page that shows you an hourly job rate is often a good indicator to see if we are keeping up anywhere in the 600-1k range is normal | 23:07 |
| *** FallenPegasus has quit IRC | 23:08 | |
| jlvillal | clarkb: Thanks. So no infrastructure reasons around it, which is good :) | 23:08 |
| clarkb | jlvillal: not that I know of | 23:08 |
| SpamapS | greghaynes: hah, they replaced the motherboard on the bad box so fast, I never had time to remove it from inventory. ;) | 23:09 |
| sdake | clarkb he tried that, says "could not connect to gerrit" | 23:09 |
| clarkb | derekh: I am no mail guru (jeblair is the person to try) but I suppose its possible that people refuse to deliver to us? or that delivery failed and will need to be retried again | 23:09 |
| sdake | then asks for a gerrit username, he types in "DuaneD" | 23:09 |
| clarkb | sdake: is that the username that shows on the page I linked? | 23:10 |
| *** FallenPegasus has joined #openstack-infra | 23:10 | |
| clarkb | sdake: and are ssh keys set p for that account? | 23:10 |
| sdake | ssh keys are setup - he set them about 1 hr ago | 23:10 |
| sdake | let me have him check the link | 23:10 |
| clarkb | sdake: can you try ssh -p29418 DuaneD@review.openstack.org gerrit ls-projects ? | 23:11 |
| clarkb | if that fails add some -vvv and see where it fails | 23:11 |
| sdake | settings page for him says username "DuaneD" | 23:11 |
| derekh | clarkb: ok, thanks, I didn't get any failures emails (yet), I'll retry one of them now and see if its working now | 23:11 |
| clarkb | if that succeeds check `git remote -v` and make sure the uri for gerrit looks good, maybe even paste it in here | 23:11 |
| sdake | clarkb that listed out a bunch of projects | 23:12 |
| clarkb | sdake: ok so that worked, next check the git remote v | 23:12 |
| clarkb | er -v | 23:12 |
| SpamapS | Silly puppet question: If I use the hiera commandline tool and it produces the value I expect, is there something that might cause the same hiera query in site.pp to not find the key? | 23:12 |
| derekh | clarkb: my resend has appeared so I guess whatever the problems was has worked itself out | 23:13 |
| clarkb | SpamapS: not that I am aware of, the hiera config is all in that yaml file so should be the same for puppet or commandline hiera tool | 23:13 |
| sdake | fetch and pushes for the repos clarkb | 23:13 |
| clarkb | sdake: yes what do they say? | 23:13 |
| clarkb | specifically for the remote named gerrit | 23:14 |
| sdake | clarkb origin http:/github.com/stackforge/kolla (fetch) | 23:14 |
| sdake | origin http://github.com/stackforge/kolla (push) | 23:14 |
| pleia2 | clarkb: I think that patch depends on https://review.openstack.org/#/c/215373/ ? made a note accordingly | 23:14 |
| fungi | sdake: latest (1.25.0) git-review or older? | 23:14 |
| sdake | clarkb there is no gerrit remote | 23:14 |
| pleia2 | (got confused when I searched my loco repos and couldn't find check_devstack_plugin.sh) | 23:14 |
| clarkb | pleia2: its all non voting so order isn't really required | 23:14 |
| clarkb | pleia2: either way should be fine | 23:15 |
| clarkb | sdake: ok so no preexisting remote is confusing git review | 23:15 |
| pleia2 | clarkb: just made it a little tricky to review | 23:15 |
| *** kutija has quit IRC | 23:15 | |
| clarkb | pleia2: ah I see | 23:15 |
| *** kzaitsev_mb has quit IRC | 23:15 | |
| *** regXboi has quit IRC | 23:15 | |
| fungi | sdake: some older git-review versions got confused by cla/contact info related errors in gerrit's response to the test push, and would mistakenly complain the credentials were wrong | 23:15 |
| fungi | sdake: 1.25.0 should spit out the correct error in that case though | 23:16 |
| *** achanda has joined #openstack-infra | 23:16 | |
| fungi | or rather, should properly pass through the error it's getting from gerrit | 23:16 |
| SpamapS | clarkb: must be something different, in --debug mode I see it only looking for the 'common' data source, even though in hiera.yaml I added a 'baremetal' datasource. | 23:16 |
| sdake | clarkb any way to fix the remotes? | 23:17 |
| fungi | sdake: he was saying the remotes are the problem | 23:17 |
| sdake | fungi trying to find the git-review version hi | 23:17 |
| fungi | er, aren't | 23:17 |
| clarkb | sdake: see fungi's suggestion | 23:17 |
| fungi | aren't the problem | 23:17 |
| sdake | clarkb will do | 23:17 |
| SpamapS | clarkb: http://docs.puppetlabs.com/hiera/latest/configuring.html says it uses /etc/puppetlabs/code/hiera.yaml | 23:17 |
| fungi | sdake: git review --version | 23:17 |
| clarkb | SpamapS: uh ours is /etc/puppet/hiera.yaml iirc | 23:18 |
| SpamapS | clarkb: http://docs.puppetlabs.com/hiera/1/configuring.html ahh, right | 23:18 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:18 | |
| SpamapS | clarkb: but, the cli uses /etc/hiera.yaml | 23:18 |
| clarkb | SpamapS: hahahaha | 23:19 |
| *** dannywilson has quit IRC | 23:19 | |
| SpamapS | which is sort of like.. >:| | 23:19 |
| clarkb | right because hiera the tool isn't puppet specific | 23:19 |
| clarkb | I seem to recall hitting this before now and being grumpy | 23:19 |
| SpamapS | I'm more >:| because why, puppet, don't you just default to _the one the system provides_ :-P | 23:19 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run the post nodepool deploy checks from nodepool https://review.openstack.org/215374 | 23:20 |
| clarkb | pleia2: updated | 23:20 |
| clarkb | we almost have full functional testing of two primary jobs of nodepool | 23:22 |
| clarkb | I might be a little excited | 23:22 |
| sdake | fungi he is now running git review 1.25.0 | 23:23 |
| sdake | "We don't know where your gerrit is. Please manually create a remote | 23:24 |
| *** kzaitsev_mb has joined #openstack-infra | 23:24 | |
| clarkb | sdake: ok, that implies your .gitreview is broken | 23:24 |
| fungi | sdake: that's after running `git review -s` | 23:24 |
| fungi | ? | 23:24 |
| sdake | fungi yes | 23:24 |
| clarkb | I am going to guess there is some file somewhere saying using a different host/port/etc | 23:25 |
| clarkb | probably in order to get through a proxy | 23:25 |
| fungi | sdake: were there any errors prior to that message? can you put them on paste.openstack.org? | 23:25 |
| clarkb | proably rerun with git review -v -s | 23:25 |
| clarkb | to get the full trace if pasting stuff | 23:25 |
| sdake | fungi yup one moment | 23:25 |
| pleia2 | clarkb: I'm excited too, looking good \o/ | 23:26 |
| *** dingyichen has joined #openstack-infra | 23:26 | |
| *** sridhar_ram has quit IRC | 23:26 | |
| *** r-daneel has quit IRC | 23:27 | |
| *** sridhar_ram has joined #openstack-infra | 23:28 | |
| *** dannywilson has joined #openstack-infra | 23:30 | |
| * fungi has to disappear again for a few minutes, maybe longer... bbiaw | 23:30 | |
| *** otter768 has joined #openstack-infra | 23:30 | |
| *** dimtruck is now known as zz_dimtruck | 23:33 | |
| *** ddecapit has joined #openstack-infra | 23:33 | |
| sdake | fungi/clarkb here is the paste of git review of a fresh repo checkout http://paste.openstack.org/show/423032/ | 23:34 |
| sdake | looks like its trying to use his credentials rather then the ones specified with that gitreview operation earlier | 23:34 |
| *** manjeet_ has joined #openstack-infra | 23:34 | |
| manjeet_ | Hi everyone i have question does cidr value works for no_proxy parameter or it should be always list of ips? | 23:35 |
| clarkb | sdake its a git config op not git review | 23:35 |
| clarkb | double check ~/.gitconfig | 23:36 |
| *** regXboi has joined #openstack-infra | 23:37 | |
| asselin_ | manjeet_, you need to use full ips | 23:37 |
| asselin_ | no cidr | 23:37 |
| sdake | clarkb looks like there is no git review crudini stuff | 23:37 |
| sdake | ratheri ni stuff | 23:37 |
| *** ayoung has joined #openstack-infra | 23:37 | |
| sdake | what should the format be? | 23:37 |
| sdake | [gitreview] | 23:37 |
| clarkb | ok so run the comand I posted before | 23:37 |
| manjeet_ | ok | 23:37 |
| sdake | name = DuaneD? | 23:37 |
| sdake | clarkb he ran it twice, no effect | 23:38 |
| clarkb | username | 23:38 |
| clarkb | oh sorry need a --global too | 23:38 |
| clarkb | but yes as you pasted but use username not name | 23:39 |
| openstackgerrit | Tyler Cipriani proposed openstack-infra/jenkins-job-builder: adding support for android emulator https://review.openstack.org/146990 | 23:39 |
| *** thcipriani is now known as thcipriani|afk | 23:40 | |
| sdake | ok progress clarkb :) | 23:40 |
| sdake | says icla requires contact information | 23:40 |
| sdake | so I think we are in business :) | 23:40 |
| sdake | clarkb super a+ for the extra hep :) | 23:41 |
| *** sridhar_ram has quit IRC | 23:41 | |
| sdake | fungi clarkb ++ :) | 23:41 |
| *** sridhar_ram has joined #openstack-infra | 23:42 | |
| *** glauco_ has joined #openstack-infra | 23:42 | |
| *** ddieterly has joined #openstack-infra | 23:43 | |
| *** kzaitsev_mb has quit IRC | 23:43 | |
| *** geoffarnold has quit IRC | 23:43 | |
| *** angdraug has quit IRC | 23:45 | |
| *** salv-orlando has quit IRC | 23:46 | |
| *** ddecapit has quit IRC | 23:46 | |
| *** glauco_ has quit IRC | 23:47 | |
| *** Swami has quit IRC | 23:48 | |
| *** gildub has joined #openstack-infra | 23:55 | |
| SpamapS | well... | 23:55 |
| SpamapS | the template makes a valid bifrost json | 23:56 |
| SpamapS | but I seem to have mixed up hostnames<->ipmi passwords | 23:56 |
| *** FallenPegasus has quit IRC | 23:56 | |
| *** dannywilson has quit IRC | 23:56 | |
| SpamapS | seems like it might be better to use the ipmi address as the ipmi password key rather than the hostname which may change | 23:56 |
| * SpamapS goes cross eyed and takes a break from staring at it | 23:56 | |
| mmmpork | SpamapS: better be careful or your face might get stuck like that | 23:58 |
| *** sergmelikyan has quit IRC | 23:59 | |
| *** SumitNaiksatam has quit IRC | 23:59 | |
| *** ybathia has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!