| *** akshai has quit IRC | 00:01 | |
| *** openstackgerrit has quit IRC | 00:01 | |
| *** tsekiyama has quit IRC | 00:01 | |
| *** openstackgerrit has joined #openstack-infra | 00:01 | |
| openstackgerrit | Clark Boylan proposed stackforge/python-jenkins: Handle depth errors in get_running_builds https://review.openstack.org/232253 | 00:02 |
|---|---|---|
| openstackgerrit | Merged openstack-infra/project-config: Promote gate-project-config-grafyaml to gate pipeline https://review.openstack.org/231446 | 00:02 |
| *** tsekiyama has joined #openstack-infra | 00:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Update row names for zuul status dashboard https://review.openstack.org/231442 | 00:03 |
| asselin_ | is gerrit ok? Trying to review a change and it's very very slow | 00:03 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Add release team repos to projects.txt https://review.openstack.org/232280 | 00:03 |
| clarkb | asselin_: its db backup time | 00:03 |
| *** lawrancejing has quit IRC | 00:03 | |
| *** yamamoto has quit IRC | 00:05 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-jenkins: Cleanup deprecated exception checking https://review.openstack.org/232281 | 00:07 |
| *** rkukura_ has joined #openstack-infra | 00:07 | |
| *** yamamoto has joined #openstack-infra | 00:10 | |
| *** rkukura has quit IRC | 00:10 | |
| *** rkukura_ is now known as rkukura | 00:10 | |
| *** sdake_ has joined #openstack-infra | 00:11 | |
| *** sdake has quit IRC | 00:11 | |
| openstackgerrit | Merged openstack-infra/project-config: Run npm upload job on relase slave https://review.openstack.org/232264 | 00:14 |
| *** tsekiyam_ has joined #openstack-infra | 00:17 | |
| *** Ala has quit IRC | 00:17 | |
| *** skylerberg has quit IRC | 00:18 | |
| *** wenlock has quit IRC | 00:19 | |
| *** wenlock_ has quit IRC | 00:19 | |
| *** tsekiyama has quit IRC | 00:20 | |
| *** achanda has quit IRC | 00:21 | |
| *** tsekiyam_ has quit IRC | 00:21 | |
| *** DinaBelova has quit IRC | 00:21 | |
| *** SergeyLukjanov has quit IRC | 00:21 | |
| *** NikitaKonovalov has quit IRC | 00:21 | |
| *** mtanino has quit IRC | 00:22 | |
| *** spredzy has quit IRC | 00:22 | |
| *** spredzy has joined #openstack-infra | 00:23 | |
| *** freerunner has quit IRC | 00:23 | |
| *** d0ugal has quit IRC | 00:24 | |
| *** btully has quit IRC | 00:25 | |
| *** achanda has joined #openstack-infra | 00:26 | |
| *** NikitaKonovalov has joined #openstack-infra | 00:28 | |
| *** freerunner has joined #openstack-infra | 00:28 | |
| *** Kennan_Vacation has joined #openstack-infra | 00:29 | |
| *** akshai has joined #openstack-infra | 00:29 | |
| *** SergeyLukjanov has joined #openstack-infra | 00:29 | |
| *** DinaBelova has joined #openstack-infra | 00:29 | |
| *** d0ugal has joined #openstack-infra | 00:30 | |
| *** d0ugal is now known as Guest74554 | 00:30 | |
| *** achanda has quit IRC | 00:31 | |
| *** akshai_ has quit IRC | 00:31 | |
| openstackgerrit | Merged openstack/requirements: Update constraints for openstack-doc-tools 0.31.0 https://review.openstack.org/231840 | 00:31 |
| *** baoli_ has quit IRC | 00:32 | |
| *** pvaneck has quit IRC | 00:32 | |
| *** baoli has joined #openstack-infra | 00:32 | |
| *** stevemar_ has joined #openstack-infra | 00:34 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add dib-lint job for nodepool elements https://review.openstack.org/232276 | 00:35 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: diskimage-builder element cleanups for dib-lint https://review.openstack.org/229730 | 00:35 |
| *** achanda has joined #openstack-infra | 00:36 | |
| anteaya | clarkb: I get e.message is deprecated, how do I confirm str(e) is a good choice? 232281 | 00:36 |
| lifeless | oh wow | 00:36 |
| lifeless | didn't http://logs.openstack.org/periodic/propose-requirements-constraints-master/ used to have timestamps ? | 00:37 |
| anteaya | clarkb: oh I guess it is just str() | 00:37 |
| anteaya | clarkb: sorry silly question | 00:37 |
| *** achanda has quit IRC | 00:37 | |
| *** glauco has quit IRC | 00:38 | |
| anteaya | lifeless: we merged a changed for swift indices | 00:38 |
| lifeless | anteaya: so this is deliberate, or transitional ? | 00:39 |
| anteaya | lifeless: I didn't know to check that page, so I didn't when asked if I had any objections to the change | 00:39 |
| clarkb | I pushed a revert too for the file size thing but I guess it hasnt gone in | 00:39 |
| *** ajmiller has quit IRC | 00:39 | |
| anteaya | moving to swift is deliberate | 00:39 |
| anteaya | removing valuable information is a bug | 00:39 |
| lifeless | anteaya: gotchya | 00:39 |
| clarkb | can trivially add timestamps in the same manner | 00:39 |
| clarkb | but not today | 00:39 |
| lifeless | clarkb: does your revert inclu.. cool, thanks | 00:39 |
| anteaya | so thank you for telling us we need to check the periodic index next time | 00:39 |
| lifeless | clarkb: I was looking to see if the constraints job is having issues | 00:40 |
| lifeless | since I don't recall seeing an update from it for a few days | 00:40 |
| *** achanda has joined #openstack-infra | 00:40 | |
| *** woodster_ has joined #openstack-infra | 00:40 | |
| *** Sukhdev_ has quit IRC | 00:41 | |
| clarkb | the revert will fix then we can update changes to do the right thing | 00:42 |
| *** glauco has joined #openstack-infra | 00:43 | |
| *** harlowja has quit IRC | 00:44 | |
| *** lykinsbd has quit IRC | 00:45 | |
| *** skylerberg has joined #openstack-infra | 00:47 | |
| *** glauco has quit IRC | 00:48 | |
| *** glauco has joined #openstack-infra | 00:48 | |
| *** rkukura has quit IRC | 00:48 | |
| *** Zhongjun has joined #openstack-infra | 00:49 | |
| *** glauco__ has joined #openstack-infra | 00:50 | |
| *** glauco has quit IRC | 00:50 | |
| *** tlian2 has quit IRC | 00:50 | |
| *** rlandy has quit IRC | 00:50 | |
| lifeless | clarkb: cool | 00:52 |
| *** 6A4AAONDK has joined #openstack-infra | 00:55 | |
| *** glauco__ has quit IRC | 00:58 | |
| *** harlowja has joined #openstack-infra | 00:59 | |
| *** ddieterly has joined #openstack-infra | 01:00 | |
| *** dims has quit IRC | 01:00 | |
| *** Swami has quit IRC | 01:02 | |
| *** tlian has joined #openstack-infra | 01:06 | |
| *** fedexo has joined #openstack-infra | 01:08 | |
| *** docaedo is now known as docaedo_nope | 01:12 | |
| *** weshay_xchat has joined #openstack-infra | 01:12 | |
| *** weshay_xchat is now known as weshay | 01:12 | |
| *** akshai_ has joined #openstack-infra | 01:12 | |
| *** docaedo_nope is now known as docaedo | 01:13 | |
| *** alexsyip_ has quit IRC | 01:13 | |
| *** burgerk has joined #openstack-infra | 01:15 | |
| *** akshai has quit IRC | 01:15 | |
| *** gordc has joined #openstack-infra | 01:16 | |
| *** larainema has joined #openstack-infra | 01:17 | |
| *** gildub has quit IRC | 01:17 | |
| *** [HeOS] has quit IRC | 01:18 | |
| *** HeOS has joined #openstack-infra | 01:18 | |
| *** dkranz has quit IRC | 01:19 | |
| *** tiswanso has joined #openstack-infra | 01:22 | |
| *** ivar-laz_ has joined #openstack-infra | 01:24 | |
| *** tiswanso has quit IRC | 01:26 | |
| *** ivar-lazzaro has quit IRC | 01:28 | |
| *** baoli has quit IRC | 01:28 | |
| *** ybathia has quit IRC | 01:29 | |
| *** ivar-laz_ has quit IRC | 01:29 | |
| *** aeng has quit IRC | 01:29 | |
| *** lawrancejing has joined #openstack-infra | 01:30 | |
| *** HeOS has quit IRC | 01:32 | |
| *** lawrancejing has quit IRC | 01:33 | |
| *** skylerberg has quit IRC | 01:34 | |
| *** claudiub has quit IRC | 01:36 | |
| *** HeOS has joined #openstack-infra | 01:37 | |
| *** btully has joined #openstack-infra | 01:40 | |
| *** shashank_hegde has quit IRC | 01:40 | |
| *** nelsnels_ has quit IRC | 01:43 | |
| *** nelsnelson has joined #openstack-infra | 01:44 | |
| *** btully has quit IRC | 01:45 | |
| *** rguillebert has quit IRC | 01:48 | |
| *** weshay has quit IRC | 01:48 | |
| *** asettle is now known as asettle-afk | 01:50 | |
| *** gildub has joined #openstack-infra | 01:52 | |
| yamamoto | anyone using gerrit-dash-creator and firefox? | 01:54 |
| *** stevemar_ has quit IRC | 01:54 | |
| *** stevemar_ has joined #openstack-infra | 01:55 | |
| *** zhenguo_ has joined #openstack-infra | 01:58 | |
| *** zhenguo_ is now known as zhenguo | 01:58 | |
| *** tiswanso has joined #openstack-infra | 01:59 | |
| *** baoli has joined #openstack-infra | 02:01 | |
| *** tiswanso_ has joined #openstack-infra | 02:01 | |
| *** jyuso1 has joined #openstack-infra | 02:01 | |
| *** doug-fish has joined #openstack-infra | 02:01 | |
| *** tiswanso has quit IRC | 02:04 | |
| *** doug-fish has quit IRC | 02:06 | |
| *** Kennan_Vacation is now known as Kennan | 02:08 | |
| *** unicell has quit IRC | 02:08 | |
| *** yamamoto has quit IRC | 02:09 | |
| *** wenlock has joined #openstack-infra | 02:12 | |
| openstackgerrit | Wayne Okuma proposed openstack-infra/project-config: Glance metadata definition i18n support needed https://review.openstack.org/232304 | 02:14 |
| *** sdake_ is now known as sdake | 02:15 | |
| *** 6A4AAONDK has quit IRC | 02:15 | |
| *** geoffarnoldX is now known as geoffarnold | 02:18 | |
| *** markvoelker has joined #openstack-infra | 02:20 | |
| *** asettle-afk has quit IRC | 02:21 | |
| *** markvoelker_ has joined #openstack-infra | 02:23 | |
| *** wenlock has quit IRC | 02:23 | |
| *** markvoelker has quit IRC | 02:25 | |
| *** baoli has quit IRC | 02:29 | |
| *** sdake has quit IRC | 02:30 | |
| *** ildikov has quit IRC | 02:33 | |
| *** tlian has quit IRC | 02:37 | |
| * tchaypo tries again to find the way of reporting bugs on www.openstack.org | 02:37 | |
| *** dra_ has quit IRC | 02:38 | |
| anteaya | tchaypo: https://launchpad.net/openstack-org | 02:38 |
| *** dra_ has joined #openstack-infra | 02:38 | |
| tchaypo | thanks @anteaya | 02:39 |
| tchaypo | Did I miss somethi9ng on the site that’s meant to push me there? | 02:39 |
| anteaya | tchaypo: welcome | 02:40 |
| anteaya | doubt it | 02:40 |
| anteaya | I knew to look for it | 02:40 |
| *** spzala has joined #openstack-infra | 02:40 | |
| clarkb | I think the git repo on github may link to it? not 100% sure of that | 02:40 |
| anteaya | as far as I know there is nothing on the openstack.org website that points to that launchpad account for bugs | 02:40 |
| *** spzala has quit IRC | 02:40 | |
| clarkb | but I don't think www.openstack.org has a link to it (it does have a separate contact us form though) | 02:40 |
| tchaypo | there’s a git repo? and it’s on github, not gerrit? | 02:42 |
| clarkb | yes and yes :/ | 02:43 |
| clarkb | well its in gerrit too but its out of date because they never switched to it | 02:43 |
| tchaypo | https://bugs.launchpad.net/openstack-org/+bug/1503952 | 02:43 |
| openstack | Launchpad bug 1503952 in openstack-org ""About the summit" page reports visitor numbers from EURPOE" [Undecided,New] | 02:43 |
| Clint | sad | 02:43 |
| anteaya | yes | 02:44 |
| anteaya | it makes us very sad | 02:44 |
| tchaypo | https://code.launchpad.net/openstack-org also makes me sad | 02:44 |
| *** markvoelker has joined #openstack-infra | 02:44 | |
| * anteaya is sad | 02:45 | |
| clarkb | do any of the openstack projects have that set properly? | 02:45 |
| clarkb | nova looks wonky | 02:45 |
| anteaya | tchaypo: thanks for filing the bug | 02:46 |
| tchaypo | It’s a trivial fix, I’d send a pull request, but I can’t find the repo on github | 02:46 |
| *** baoli has joined #openstack-infra | 02:46 | |
| clarkb | tchaypo: well that content is likely in the cms stuff | 02:47 |
| clarkb | but let me find the repo and you can double check | 02:47 |
| *** burgerk has quit IRC | 02:47 | |
| clarkb | tchaypo: https://github.com/OpenStackweb/openstack-org | 02:47 |
| *** markvoelker_ has quit IRC | 02:47 | |
| openstackgerrit | Craige McWhirter proposed openstack-infra/infra-specs: Updated Assignee https://review.openstack.org/232309 | 02:48 |
| *** ildikov has joined #openstack-infra | 02:48 | |
| ruagair | The above change is just me updating the assignee for the Phabricator / Maniphest spec. Seeking reviews :-) | 02:50 |
| *** madong_ has joined #openstack-infra | 02:50 | |
| *** larainema has quit IRC | 02:53 | |
| *** ildikov has quit IRC | 02:54 | |
| *** Daisy has joined #openstack-infra | 02:55 | |
| *** wenlock has joined #openstack-infra | 02:56 | |
| *** dramalho has joined #openstack-infra | 02:56 | |
| *** yamamoto has joined #openstack-infra | 02:58 | |
| *** gordc has quit IRC | 02:59 | |
| *** sheeprine has quit IRC | 02:59 | |
| *** dramalho has quit IRC | 03:00 | |
| *** sheeprine has joined #openstack-infra | 03:01 | |
| *** sdake has joined #openstack-infra | 03:02 | |
| *** shashank_hegde has joined #openstack-infra | 03:06 | |
| *** darrenc is now known as darrenc_afk | 03:08 | |
| openstackgerrit | Clint Adams proposed openstack-infra/puppet-lodgeit: Let Apache know where to serve robots.txt from https://review.openstack.org/231685 | 03:09 |
| *** tristanC has quit IRC | 03:10 | |
| *** akshai_ has quit IRC | 03:10 | |
| *** tristanC has joined #openstack-infra | 03:12 | |
| *** shashank_hegde has quit IRC | 03:13 | |
| *** otter768_ has quit IRC | 03:15 | |
| *** otter768 has joined #openstack-infra | 03:15 | |
| *** rfolco__ has quit IRC | 03:15 | |
| *** asettle has joined #openstack-infra | 03:16 | |
| *** tiswanso_ has quit IRC | 03:16 | |
| *** geoffarnold is now known as geoffarnoldX | 03:20 | |
| *** markvoelker has quit IRC | 03:25 | |
| *** Daisy has quit IRC | 03:26 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/yaml2ical: Add support for skipping/excluding meetings https://review.openstack.org/232312 | 03:27 |
| *** Daisy has joined #openstack-infra | 03:27 | |
| *** Sukhdev has joined #openstack-infra | 03:27 | |
| tonyb | anteaya: ^^ | 03:27 |
| tonyb | anteaya: if that merges we can release a new yaml2ical with your required alterations. | 03:27 |
| *** Daisy has quit IRC | 03:31 | |
| *** BharatK has joined #openstack-infra | 03:31 | |
| anteaya | yay | 03:33 |
| *** doronshai has joined #openstack-infra | 03:33 | |
| *** darrenc_afk is now known as darrenc | 03:34 | |
| *** BharatK has quit IRC | 03:37 | |
| *** markvoelker has joined #openstack-infra | 03:38 | |
| anteaya | tonyb: two nits, looks great | 03:39 |
| anteaya | tonyb: thank you | 03:39 |
| *** lykinsbd has joined #openstack-infra | 03:39 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/system-config: Move translate.openstack.org to Zanata 3.7.2 https://review.openstack.org/232313 | 03:40 |
| *** btully has joined #openstack-infra | 03:42 | |
| *** unicell has joined #openstack-infra | 03:44 | |
| *** markvoelker has quit IRC | 03:44 | |
| *** markvoelker has joined #openstack-infra | 03:47 | |
| *** amotoki has joined #openstack-infra | 03:48 | |
| *** markvoelker_ has joined #openstack-infra | 03:49 | |
| *** baoli has quit IRC | 03:49 | |
| *** otter768 has quit IRC | 03:50 | |
| *** BharatK has joined #openstack-infra | 03:51 | |
| *** otter768 has joined #openstack-infra | 03:51 | |
| *** markvoelker_ has quit IRC | 03:52 | |
| *** markvoelker has quit IRC | 03:52 | |
| *** Sree has joined #openstack-infra | 03:54 | |
| *** fawadkhaliq has joined #openstack-infra | 03:55 | |
| *** zz_dimtruck is now known as dimtruck | 03:58 | |
| *** ddieterly has quit IRC | 03:58 | |
| *** madong_ has quit IRC | 04:02 | |
| *** larainema has joined #openstack-infra | 04:03 | |
| *** lykinsbd_ has joined #openstack-infra | 04:04 | |
| *** shashank_hegde has joined #openstack-infra | 04:04 | |
| *** dahoo has quit IRC | 04:05 | |
| *** markvoelker has joined #openstack-infra | 04:05 | |
| *** lykinsbd has quit IRC | 04:05 | |
| *** Sukhdev has quit IRC | 04:07 | |
| *** Clint has quit IRC | 04:07 | |
| *** lawrancejing has joined #openstack-infra | 04:07 | |
| *** Clint has joined #openstack-infra | 04:07 | |
| *** bharathm has quit IRC | 04:09 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/yaml2ical: Add support for skipping/excluding meetings https://review.openstack.org/232312 | 04:09 |
| *** shashank_hegde has quit IRC | 04:09 | |
| *** dimtruck is now known as zz_dimtruck | 04:09 | |
| *** dims has joined #openstack-infra | 04:10 | |
| *** markvoelker has quit IRC | 04:10 | |
| *** achanda has quit IRC | 04:11 | |
| *** vivekd has joined #openstack-infra | 04:14 | |
| *** doronshai has quit IRC | 04:16 | |
| *** Zhongjun has quit IRC | 04:17 | |
| *** harlowja_at_home has joined #openstack-infra | 04:20 | |
| *** sharikapongubala has joined #openstack-infra | 04:21 | |
| *** markvoelker has joined #openstack-infra | 04:22 | |
| *** pcrews has quit IRC | 04:24 | |
| *** pcrews has joined #openstack-infra | 04:27 | |
| *** markvoelker has quit IRC | 04:27 | |
| *** doronshai has joined #openstack-infra | 04:30 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/yaml2ical: Clarify KeyError() in Schedule.__init__() https://review.openstack.org/232321 | 04:30 |
| openstackgerrit | Tony Breeds proposed openstack-infra/yaml2ical: Clarify ValueError() in Schedule.__init__() https://review.openstack.org/232322 | 04:30 |
| *** armax has quit IRC | 04:33 | |
| *** markvoelker has joined #openstack-infra | 04:37 | |
| *** markvoelker has quit IRC | 04:43 | |
| *** markvoelker has joined #openstack-infra | 04:44 | |
| *** unicell1 has joined #openstack-infra | 04:44 | |
| *** unicell has quit IRC | 04:44 | |
| *** shashank_hegde has joined #openstack-infra | 04:45 | |
| *** morgan has quit IRC | 04:47 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/puppet-zanata: Switch the checksum type to SHA-1 https://review.openstack.org/232324 | 04:48 |
| *** harlowja_at_home has quit IRC | 04:49 | |
| *** morgan has joined #openstack-infra | 04:50 | |
| *** BharatK has quit IRC | 04:50 | |
| *** doronshai has quit IRC | 04:53 | |
| *** markvoelker has quit IRC | 04:53 | |
| *** shashank_hegde has quit IRC | 04:57 | |
| *** ddieterly has joined #openstack-infra | 04:59 | |
| *** achanda has joined #openstack-infra | 04:59 | |
| ruagair | Is infra DNS managed via gerrit? If so which repo? If not, what process do I follow? | 05:00 |
| *** Sree has quit IRC | 05:01 | |
| *** markvoelker has joined #openstack-infra | 05:03 | |
| *** ddieterly has quit IRC | 05:04 | |
| *** pvaneck has joined #openstack-infra | 05:06 | |
| clarkb | its not, its manual becausd its weird rax dns. basic process is when a host is booted we add dns records for it | 05:07 |
| *** geoffarnoldX has quit IRC | 05:07 | |
| clarkb | ruagair what are you looking to do? | 05:07 |
| ruagair | I'm trying to understand and then apply the process to modify a DNS record, specifically for phabricator.openstack.org | 05:08 |
| *** markvoelker has quit IRC | 05:08 | |
| * ruagair is wading through doco at present but haven't come across a succinct answer, yet. | 05:09 | |
| *** beisner has quit IRC | 05:09 | |
| clarkb | what sort of modification? | 05:09 |
| ruagair | change of IP. | 05:09 |
| ruagair | From mordred's old IP to mine. | 05:09 |
| clarkb | usually we would onlu do that when we boot a replacement VM | 05:09 |
| clarkb | we would not point it to random VM | 05:09 |
| ruagair | Ah, then that's th ebiger process I need to understand :-D | 05:10 |
| ruagair | I'm replacing the VM that was lost with my own. | 05:10 |
| clarkb | so we use puppet to configure machines. starts in system-config/manifests/site.pp. you want to add config for $host, it can then be booted and puppeted | 05:11 |
| clarkb | assuming that succeeds we can update dns (at least thats typical process) | 05:11 |
| ruagair | EXcellent. THanks. That will get me on my way. | 05:11 |
| ruagair | +1 clarkb | 05:11 |
| *** aukhan has joined #openstack-infra | 05:12 | |
| *** beisner has joined #openstack-infra | 05:13 | |
| tchaypo | clarkb: do we have docs for this? | 05:15 |
| ruagair | http://docs.openstack.org/infra/system-config/sysadmin.html#launching-new-servers <- tchaypo | 05:16 |
| ruagair | Best I've found so far. | 05:16 |
| tchaypo | or do we typically just rely on people getting hand-holding the first time through? | 05:16 |
| clarkb | http://docs.openstack.org/infra/system-config/sysadmin.html#adding-a-new-server | 05:16 |
| ruagair | Interstingly, phabricator.o.o does not appear to have been in full openstack puppet control. | 05:16 |
| ruagair | Thanks clarkb | 05:16 |
| tchaypo | if mordred was still experimenting with it, it was probably something he hadn’t completed yet | 05:17 |
| ruagair | I'll treat this as *new* and o from there. | 05:17 |
| tchaypo | i *think* that putting the system completely under puppet control would revoke rdoot access for everyone except the infra-root team | 05:17 |
| tchaypo | which probably isn’t what you want when you’re still tinkering | 05:18 |
| *** markvoelker has joined #openstack-infra | 05:18 | |
| ruagair | No. that would exclude me. | 05:18 |
| * tchaypo has never done this | 05:19 | |
| * tchaypo is speculating | 05:19 | |
| ruagair | I'll leave the DNS and puppet control for later and a second VM I'll dedicate to prod. | 05:19 |
| stevemar_ | a lot of 'python3-all-dev' failures going on in -requirements | 05:19 |
| stevemar_ | where there are broken packages | 05:19 |
| *** hdd has quit IRC | 05:22 | |
| *** markvoelker has quit IRC | 05:22 | |
| stevemar_ | http://logs.openstack.org/69/232069/1/gate/gate-requirements-integration-dsvm/582dcfb/console.html#_2015-10-08_03_49_54_633 | 05:23 |
| stevemar_ | seen this a few times now ^ | 05:23 |
| StevenK | ... Yay | 05:24 |
| *** flepied1 has quit IRC | 05:29 | |
| *** shashank_hegde has joined #openstack-infra | 05:30 | |
| *** markvoelker has joined #openstack-infra | 05:32 | |
| *** matbu has quit IRC | 05:32 | |
| StevenK | stevemar_: I can't reproduce that on a clean trusty machine, I suspect the dib images need refreshing | 05:33 |
| stevemar_ | StevenK: yeah, it's definitely intermittent, just a heads up | 05:33 |
| *** rkukura has joined #openstack-infra | 05:34 | |
| *** matbu has joined #openstack-infra | 05:34 | |
| *** deepakcs has joined #openstack-infra | 05:35 | |
| StevenK | us.archive.ubuntu.com is a round-robin, maybe one of the machines is out of date, but ugh at the thought of debugging that | 05:35 |
| *** shashank_hegde has quit IRC | 05:36 | |
| *** bharathm has joined #openstack-infra | 05:36 | |
| *** markvoelker has quit IRC | 05:37 | |
| *** yfried_ has quit IRC | 05:38 | |
| *** rkukura has quit IRC | 05:38 | |
| *** wenlock has quit IRC | 05:39 | |
| *** sputnik13 has joined #openstack-infra | 05:39 | |
| *** sabeen1 has quit IRC | 05:41 | |
| *** sputnik13 has quit IRC | 05:46 | |
| *** sputnik13 has joined #openstack-infra | 05:47 | |
| *** markvoelker has joined #openstack-infra | 05:47 | |
| *** mrmartin has joined #openstack-infra | 05:47 | |
| *** larainema has quit IRC | 05:49 | |
| *** larainema has joined #openstack-infra | 05:49 | |
| *** markvoelker has quit IRC | 05:52 | |
| *** larainema has quit IRC | 05:52 | |
| *** larainema has joined #openstack-infra | 05:53 | |
| *** BharatK has joined #openstack-infra | 05:53 | |
| *** kaisers has quit IRC | 05:53 | |
| *** matbu has quit IRC | 05:54 | |
| *** matbu has joined #openstack-infra | 05:54 | |
| *** ddieterly has joined #openstack-infra | 06:00 | |
| *** markvoelker has joined #openstack-infra | 06:02 | |
| *** doronshai has joined #openstack-infra | 06:05 | |
| *** ddieterly has quit IRC | 06:05 | |
| *** rossella_s has quit IRC | 06:06 | |
| *** rossella_s has joined #openstack-infra | 06:06 | |
| *** vivekd has quit IRC | 06:07 | |
| *** asmigala has joined #openstack-infra | 06:07 | |
| *** markvoelker has quit IRC | 06:08 | |
| *** larainema has quit IRC | 06:08 | |
| *** larainema has joined #openstack-infra | 06:09 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/232349 | 06:10 |
| *** larainema has quit IRC | 06:10 | |
| *** larainema has joined #openstack-infra | 06:10 | |
| *** fedexo has quit IRC | 06:10 | |
| stevemar_ | StevenK: that's why you infra folks get the big bucks! | 06:12 |
| stevemar_ | debug the stuff i don't wanna | 06:12 |
| *** kaisers has joined #openstack-infra | 06:15 | |
| *** lawrancejing has quit IRC | 06:16 | |
| *** nadya has joined #openstack-infra | 06:16 | |
| *** lawrancejing has joined #openstack-infra | 06:18 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/231327 | 06:18 |
| *** vivekd has joined #openstack-infra | 06:20 | |
| *** lawrancejing has quit IRC | 06:21 | |
| *** doronshai has quit IRC | 06:22 | |
| *** BharatK has quit IRC | 06:24 | |
| *** doug-fish has joined #openstack-infra | 06:25 | |
| *** mrmartin has quit IRC | 06:25 | |
| *** scheuran has joined #openstack-infra | 06:28 | |
| *** rkukura has joined #openstack-infra | 06:28 | |
| *** doug-fish has quit IRC | 06:29 | |
| *** btully has quit IRC | 06:30 | |
| SpamapS | http://logs.openstack.org/68/232268/3/check/gate-grenade-dsvm-partial-ncpu/50bb211/console.html#_2015-10-08_00_15_07_849 | 06:31 |
| SpamapS | "Hash sum mismatch" -- thats an intermittent failure right? | 06:31 |
| *** rkukura has quit IRC | 06:33 | |
| *** lawrancejing has joined #openstack-infra | 06:33 | |
| *** BharatK has joined #openstack-infra | 06:33 | |
| *** j^2 has quit IRC | 06:33 | |
| *** Ng has quit IRC | 06:34 | |
| *** lawrancejing has quit IRC | 06:34 | |
| *** Ng has joined #openstack-infra | 06:38 | |
| *** abregman has joined #openstack-infra | 06:40 | |
| *** andreykurilin has quit IRC | 06:42 | |
| *** flepied has joined #openstack-infra | 06:42 | |
| *** yfried_ has joined #openstack-infra | 06:42 | |
| *** j^2 has joined #openstack-infra | 06:43 | |
| *** flepied has quit IRC | 06:43 | |
| *** flepied has joined #openstack-infra | 06:43 | |
| *** andreykurilin has joined #openstack-infra | 06:43 | |
| *** markvoelker has joined #openstack-infra | 06:46 | |
| *** yfried__ has joined #openstack-infra | 06:46 | |
| *** yfried_ has quit IRC | 06:47 | |
| *** jcoufal has joined #openstack-infra | 06:49 | |
| *** gildub has quit IRC | 06:50 | |
| *** peristeri has joined #openstack-infra | 06:50 | |
| *** markvoelker has quit IRC | 06:50 | |
| *** yfried__ is now known as yfried|afk | 06:57 | |
| ttx | SpamapS: according to above analysis, there is a corrupted mirror in us.archive.ubuntu.com | 06:58 |
| *** mrmartin has joined #openstack-infra | 06:59 | |
| SpamapS | ttx: there's a tiny window where you can catch one new set of metadata from one of them, and then the old metadata from another | 06:59 |
| *** markvoelker has joined #openstack-infra | 06:59 | |
| SpamapS | ttx: they've bent over backwards to work around things by using tricks like expires times that line up exactly with archive refreshes, but there's still a 1s window. | 07:00 |
| ttx | SpamapS: looks more like a 3 hour window so far | 07:00 |
| SpamapS | ttx: good news is Debian "next" will have this fixed. | 07:00 |
| *** kushal has joined #openstack-infra | 07:00 | |
| SpamapS | ttx: any caches involved? | 07:01 |
| SpamapS | ttx: or maybe the mirrors really are b0rk | 07:01 |
| *** ddieterly has joined #openstack-infra | 07:01 | |
| ttx | stevemar posted several occurences of http://logs.openstack.org/69/232069/1/gate/gate-requirements-integration-dsvm/582dcfb/console.html#_2015-10-08_03_49_54_633 | 07:01 |
| ttx | which point to bork / partial mirror updates | 07:02 |
| ttx | also we had issues with us.archive.ubuntu.com all day yesterday. Lousy bandwidth, random missing packages | 07:02 |
| SpamapS | did /joinbuuuumer | 07:02 |
| ttx | Fought all day to get the last fixes in RC2s, mostly to no avail | 07:03 |
| ttx | and looks like it will be the same day today | 07:03 |
| SpamapS | did anyone notify the ubuntu archive ops? | 07:03 |
| ttx | I have no idea | 07:03 |
| ttx | haven't been following -infra closely. Too busy clicking the recheck button | 07:04 |
| *** markvoelker has quit IRC | 07:04 | |
| *** tmorin has joined #openstack-infra | 07:05 | |
| *** lawrancejing has joined #openstack-infra | 07:05 | |
| *** ddieterly has quit IRC | 07:06 | |
| *** Sree has joined #openstack-infra | 07:06 | |
| *** btully has joined #openstack-infra | 07:06 | |
| *** Sree has quit IRC | 07:06 | |
| yolanda | morning | 07:07 |
| *** Sree has joined #openstack-infra | 07:07 | |
| *** Sree has quit IRC | 07:09 | |
| * SpamapS pings in #canonical-sysadmin | 07:09 | |
| *** kushal has quit IRC | 07:10 | |
| *** Sree has joined #openstack-infra | 07:10 | |
| *** btully has quit IRC | 07:11 | |
| *** yfried|afk is now known as yfried__ | 07:11 | |
| *** yamahata has joined #openstack-infra | 07:11 | |
| *** kushal has joined #openstack-infra | 07:11 | |
| StevenK | SpamapS: Nice, hash sum mismatch :-/ | 07:12 |
| *** jlanoux has joined #openstack-infra | 07:13 | |
| *** matrohon has joined #openstack-infra | 07:13 | |
| SpamapS | StevenK: yeah, thing is, I use that mirror, and not getting it | 07:14 |
| *** markvoelker has joined #openstack-infra | 07:14 | |
| SpamapS | and checking the files.. not finding the mismatch | 07:14 |
| *** stevemar_ has quit IRC | 07:14 | |
| StevenK | SpamapS: us.archive.ubuntu.com is a round robin | 07:14 |
| *** stevemar_ has joined #openstack-infra | 07:14 | |
| SpamapS | ohhh no its real | 07:15 |
| *** arxcruz has joined #openstack-infra | 07:15 | |
| *** Daisy has joined #openstack-infra | 07:16 | |
| *** jlanoux_ has joined #openstack-infra | 07:17 | |
| *** stevemar_ has quit IRC | 07:18 | |
| *** markvoelker has quit IRC | 07:18 | |
| *** jlanoux has quit IRC | 07:19 | |
| SpamapS | ttx: good call. real issue. http://paste.ubuntu.com/12712599/ | 07:19 |
| ttx | ew | 07:20 |
| SpamapS | ttx: canonical sysadmins looking into it | 07:20 |
| *** fawadkhaliq has quit IRC | 07:20 | |
| ttx | if that helps we got like 16kb/s max on some mirrors yesterday. | 07:20 |
| ttx | that triggered a slew of job timeouts | 07:20 |
| ttx | maybe unrelated | 07:21 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack-infra/project-config: Conditionally skip some heat gate jobs https://review.openstack.org/232375 | 07:21 |
| *** rkukura has joined #openstack-infra | 07:22 | |
| *** bharathm has quit IRC | 07:23 | |
| *** Guest74554 is now known as d0ugal | 07:23 | |
| *** shardy has joined #openstack-infra | 07:23 | |
| *** d0ugal has quit IRC | 07:23 | |
| *** d0ugal has joined #openstack-infra | 07:23 | |
| *** mrmartin has quit IRC | 07:24 | |
| abregman | hi everyone. I want to add 'recheck' in my own gerrit system. any idea how I'm doing it? | 07:24 |
| *** ifarkas has joined #openstack-infra | 07:25 | |
| yolanda | if abregman, it's a matter of adding this trigger to zuul. Look inside project-config, for zuul/layout.yaml to get an idea | 07:26 |
| ttx | maybe abregman is not using zuul though | 07:26 |
| yolanda | ttx good point | 07:26 |
| SpamapS | ttx: n/m, those were 404's .. duh | 07:27 |
| ttx | abregman: the trigger is captured by zuul (which is watching Gerrit) which resubmits the the job to Gerrit | 07:27 |
| *** ParsectiX has joined #openstack-infra | 07:27 | |
| SpamapS | ttx: there was apparently an rsync issue earlier but it is resolved | 07:27 |
| *** Daisy has quit IRC | 07:27 | |
| SpamapS | ttx: so retries should work | 07:27 |
| ttx | SpamapS: that's good news | 07:27 |
| SpamapS | ttx: so retries should work | 07:27 |
| *** rkukura has quit IRC | 07:27 | |
| *** Daisy has joined #openstack-infra | 07:27 | |
| SpamapS | stupid up arrow | 07:28 |
| *** Daisy has quit IRC | 07:28 | |
| *** markvoelker has joined #openstack-infra | 07:28 | |
| *** jlanoux has joined #openstack-infra | 07:28 | |
| *** Daisy has joined #openstack-infra | 07:28 | |
| *** tmorin has left #openstack-infra | 07:30 | |
| *** jlanoux_ has quit IRC | 07:31 | |
| abregman | ttx, yolanda: yup..not using zuul =( | 07:32 |
| abregman | ttx, yolanda: is it possible doing it using only jenkins and gerrit? | 07:33 |
| yolanda | then i guess it will depend on the system you use... basically you need to listen to gerrit stream events, and check if there is a comment with the expression you need, and trigger some action depending on that | 07:33 |
| *** markvoelker has quit IRC | 07:33 | |
| ttx | abregman: probably, but the code is not written :) | 07:33 |
| abregman | oh boy.. | 07:34 |
| *** Daisy has quit IRC | 07:34 | |
| abregman | ttx, yolanda: thanks for the help =) | 07:34 |
| yolanda | anytime, sorry to don't have a better answer | 07:34 |
| *** kiran-r has joined #openstack-infra | 07:35 | |
| *** Daisy has joined #openstack-infra | 07:35 | |
| *** vlaza has joined #openstack-infra | 07:35 | |
| *** luqas has joined #openstack-infra | 07:38 | |
| *** asettle has quit IRC | 07:38 | |
| *** woodster_ has quit IRC | 07:39 | |
| *** yfried has joined #openstack-infra | 07:39 | |
| *** Daisy has quit IRC | 07:39 | |
| *** yfried__ has quit IRC | 07:40 | |
| *** Hal has joined #openstack-infra | 07:40 | |
| *** yfried_ has joined #openstack-infra | 07:41 | |
| *** nadya has quit IRC | 07:42 | |
| *** luqas has quit IRC | 07:42 | |
| *** markvoelker has joined #openstack-infra | 07:43 | |
| *** ildikov has joined #openstack-infra | 07:43 | |
| openstackgerrit | Merged openstack-infra/puppet-statusbot: Enable #success feature from statusbot https://review.openstack.org/224768 | 07:43 |
| *** fawadkhaliq has joined #openstack-infra | 07:44 | |
| *** yfried has quit IRC | 07:44 | |
| *** dtantsur|afk is now known as dtantsur | 07:46 | |
| *** openstackstatus has quit IRC | 07:47 | |
| *** markvoelker has quit IRC | 07:48 | |
| *** Hal has quit IRC | 07:48 | |
| *** openstackstatus has joined #openstack-infra | 07:48 | |
| *** ChanServ sets mode: +v openstackstatus | 07:48 | |
| *** Hal has joined #openstack-infra | 07:49 | |
| *** Hal has quit IRC | 07:49 | |
| *** larainema has quit IRC | 07:50 | |
| *** Hal has joined #openstack-infra | 07:50 | |
| *** Daisy has joined #openstack-infra | 07:50 | |
| *** Hal has quit IRC | 07:51 | |
| *** vivekd has quit IRC | 07:51 | |
| *** Hal has joined #openstack-infra | 07:52 | |
| *** ihrachys has joined #openstack-infra | 07:55 | |
| *** scheuran has quit IRC | 07:57 | |
| *** markvoelker has joined #openstack-infra | 07:58 | |
| *** Sree_ has joined #openstack-infra | 07:59 | |
| *** lawrancejing has quit IRC | 07:59 | |
| *** yfried__ has joined #openstack-infra | 07:59 | |
| *** persia has quit IRC | 07:59 | |
| *** Sree_ is now known as Guest30537 | 08:00 | |
| *** lawrancejing has joined #openstack-infra | 08:00 | |
| *** persia has joined #openstack-infra | 08:00 | |
| *** AJaeger has joined #openstack-infra | 08:02 | |
| *** markvoelker has quit IRC | 08:02 | |
| *** ddieterly has joined #openstack-infra | 08:02 | |
| *** yfried_ has quit IRC | 08:03 | |
| *** Sree has quit IRC | 08:03 | |
| AJaeger | StevenK: are you around? | 08:04 |
| StevenK | AJaeger: Sort of | 08:04 |
| StevenK | AJaeger: The settings of projects in Zanata isn't reachable via the REST API, I discovered today. I thought they were exported. | 08:05 |
| AJaeger | I'm trying to push up translations manually since we changed the api-quick-start | 08:05 |
| AJaeger | I get lots of "[WARN] Skipping file ./api-quick-start/source/locale/es/LC_MESSAGES/api-quickstart.po; no locale entry found from project config" | 08:05 |
| *** derekh has joined #openstack-infra | 08:05 | |
| AJaeger | I run: /tmp/zanata-cli-3.7.4/bin/zanata-cli push --push-type trans --excludes 'api-guide/**,api-ref-guides/**,api-ref/**' | 08:06 |
| AJaeger | Any ideas what's wrong here? | 08:06 |
| *** Daisy has quit IRC | 08:06 | |
| StevenK | AJaeger: That sounds like it can't match the .po files based on your rules, can you paste your zanata.xml file? | 08:06 |
| *** ddieterly has quit IRC | 08:06 | |
| *** Daisy has joined #openstack-infra | 08:07 | |
| *** sergmelikyan has joined #openstack-infra | 08:07 | |
| *** Daisy has quit IRC | 08:07 | |
| *** achanda has quit IRC | 08:07 | |
| *** Daisy has joined #openstack-infra | 08:07 | |
| AJaeger | http://paste.openstack.org/show/475695/ - I just downloaded it from the server | 08:07 |
| AJaeger | Should I better generate it ? | 08:08 |
| *** shardy_ has joined #openstack-infra | 08:08 | |
| *** rguillebert has joined #openstack-infra | 08:08 | |
| StevenK | AJaeger: Yes, you need to use create-zanata-xml.py for the right project. Let me get you one | 08:09 |
| *** dingyichen has quit IRC | 08:09 | |
| *** unicell1 has quit IRC | 08:09 | |
| *** shardy has quit IRC | 08:10 | |
| AJaeger | project is api-site - let me create it... | 08:10 |
| StevenK | AJaeger: But you need to call it like the scripts do | 08:10 |
| AJaeger | I do ;) | 08:11 |
| AJaeger | Just pasting setup_manuals into my shell and invoking it ;) | 08:12 |
| AJaeger | Thanks | 08:12 |
| StevenK | AJaeger: Exactly what I do | 08:12 |
| *** achanda has joined #openstack-infra | 08:13 | |
| AJaeger | zanata.xml looks quite different now ;) | 08:13 |
| *** shardy_ has quit IRC | 08:13 | |
| *** unicell has joined #openstack-infra | 08:13 | |
| odyssey4me | AJaeger it seems that we may have broken our docs merge with https://review.openstack.org/231980 - zuul now seems to be ignoring https://review.openstack.org/211747 and https://review.openstack.org/231888 - any suggestions to fix it up? | 08:13 |
| openstackgerrit | David Pursehouse proposed openstack-infra/lodgeit: Fix title on homepage https://review.openstack.org/232404 | 08:14 |
| openstackgerrit | David Pursehouse proposed openstack-infra/lodgeit: Fix header in help screen https://review.openstack.org/232405 | 08:14 |
| *** shardy has joined #openstack-infra | 08:14 | |
| *** achanda has quit IRC | 08:15 | |
| *** Daisy has quit IRC | 08:16 | |
| *** Daisy has joined #openstack-infra | 08:16 | |
| *** Daisy has quit IRC | 08:16 | |
| AJaeger | odyssey4me: I don't have time to debug this now - If you want to revert 231980 I can fast approve it... | 08:17 |
| *** rkukura has joined #openstack-infra | 08:17 | |
| AJaeger | sorry ;( | 08:17 |
| odyssey4me | thanks AJaeger will do so | 08:17 |
| *** Daisy has joined #openstack-infra | 08:17 | |
| AJaeger | odyssey4me: wait, I have an idea - let me check... | 08:17 |
| *** HeOS has quit IRC | 08:18 | |
| *** sflanigan has quit IRC | 08:18 | |
| AJaeger | odyssey4me: your regex is for sure broken - either fix it or revert. | 08:19 |
| odyssey4me | AJaeger so i tested the regex in a bash regex tester - is it meant to be python or bash? | 08:20 |
| AJaeger | StevenK: I used copying of translations instead to readd translations to api-quick-start - that worked as well... | 08:21 |
| *** rkukura has quit IRC | 08:21 | |
| *** notnownikki has joined #openstack-infra | 08:22 | |
| AJaeger | odyssey4me: A regex is what the docu says. Since zuul is written in python... | 08:23 |
| odyssey4me | AJaeger great, will see if I can fix it quickly | 08:23 |
| *** markus_z has joined #openstack-infra | 08:24 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Revert "Skip all jobs except docs for docs only changes" https://review.openstack.org/232410 | 08:25 |
| *** Daisy has quit IRC | 08:25 | |
| odyssey4me | AJaeger ^ is the revert - I'll submit a new review once I figure out the right regex | 08:25 |
| *** Guest30537 has quit IRC | 08:26 | |
| *** Daisy has joined #openstack-infra | 08:26 | |
| *** pvaneck has quit IRC | 08:26 | |
| *** Sree has joined #openstack-infra | 08:26 | |
| *** markvoelker has joined #openstack-infra | 08:26 | |
| *** sergmelikyan has quit IRC | 08:27 | |
| AJaeger | odyssey4me: +2A | 08:28 |
| odyssey4me | thanks AJaeger :) | 08:28 |
| AJaeger | odyssey4me: I'm sorry for not catching this during review. | 08:28 |
| *** Daisy has quit IRC | 08:30 | |
| *** markvoelker has quit IRC | 08:31 | |
| ianw | oh, i thought that looked right too... | 08:32 |
| odyssey4me | ianw yeah, it's odd - I'm testing using a python regex test and it doesn't seem to work | 08:33 |
| odyssey4me | it works for bash, but the negative lookahead seems to fail for python | 08:33 |
| *** lawrancejing has quit IRC | 08:34 | |
| *** lawrancejing has joined #openstack-infra | 08:35 | |
| *** Sree has quit IRC | 08:35 | |
| *** Sree has joined #openstack-infra | 08:36 | |
| *** MarkAtwood has joined #openstack-infra | 08:37 | |
| *** markvoelker has joined #openstack-infra | 08:40 | |
| *** jistr has joined #openstack-infra | 08:40 | |
| openstackgerrit | Merged openstack/requirements: Bump upper constraints for keystoneclient and keystonemiddleware https://review.openstack.org/232069 | 08:41 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Skip all jobs except docs for docs only changes" https://review.openstack.org/232410 | 08:41 |
| *** nadya has joined #openstack-infra | 08:42 | |
| *** sergmelikyan has joined #openstack-infra | 08:44 | |
| *** markvoelker has quit IRC | 08:46 | |
| *** Hal has quit IRC | 08:46 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Skip all jobs except docs for docs only changes https://review.openstack.org/232417 | 08:46 |
| *** AJaeger has quit IRC | 08:47 | |
| *** nadya has quit IRC | 08:47 | |
| odyssey4me | AJaeger ianw ^ that seems to work - I was missing the wildcard before the end to allow the other jobs to still match | 08:47 |
| *** hashar has joined #openstack-infra | 08:47 | |
| *** rlandy has joined #openstack-infra | 08:48 | |
| odyssey4me | the wildcard before the negative lookup made all job names match | 08:48 |
| *** Hal has joined #openstack-infra | 08:49 | |
| *** Hal has quit IRC | 08:49 | |
| *** markvoelker has joined #openstack-infra | 08:55 | |
| *** nadya has joined #openstack-infra | 08:56 | |
| *** markvoelker has quit IRC | 08:59 | |
| *** devvesa has joined #openstack-infra | 09:02 | |
| *** ddieterly has joined #openstack-infra | 09:03 | |
| *** markvoelker has joined #openstack-infra | 09:03 | |
| *** Sree has quit IRC | 09:03 | |
| *** Sree has joined #openstack-infra | 09:04 | |
| *** Zhongjun has joined #openstack-infra | 09:06 | |
| *** marzif has joined #openstack-infra | 09:07 | |
| *** ddieterly has quit IRC | 09:08 | |
| *** markvoelker has quit IRC | 09:08 | |
| *** yfried__ is now known as yfried|afk | 09:08 | |
| *** markvoelker has joined #openstack-infra | 09:10 | |
| openstackgerrit | Merged openstack-infra/project-config: Skip all jobs except docs for docs only changes https://review.openstack.org/232417 | 09:11 |
| *** rkukura has joined #openstack-infra | 09:11 | |
| *** pelix has joined #openstack-infra | 09:11 | |
| *** HeOS has joined #openstack-infra | 09:13 | |
| *** fawadkhaliq has quit IRC | 09:13 | |
| *** ociuhandu has joined #openstack-infra | 09:15 | |
| *** markvoelker has quit IRC | 09:15 | |
| *** rkukura has quit IRC | 09:15 | |
| *** tlian has joined #openstack-infra | 09:16 | |
| *** achanda has joined #openstack-infra | 09:16 | |
| *** sharikapongubala has quit IRC | 09:17 | |
| *** Volundr has joined #openstack-infra | 09:17 | |
| *** whoops has quit IRC | 09:18 | |
| *** ZZelle has joined #openstack-infra | 09:19 | |
| *** achanda has quit IRC | 09:21 | |
| *** e0ne has joined #openstack-infra | 09:23 | |
| *** hichihara has quit IRC | 09:28 | |
| *** deepakcs has left #openstack-infra | 09:28 | |
| *** vivekd has joined #openstack-infra | 09:30 | |
| *** hashar has quit IRC | 09:31 | |
| *** hashar_ has joined #openstack-infra | 09:31 | |
| *** dtantsur is now known as dtantsur|brb | 09:36 | |
| *** MarkAtwood has quit IRC | 09:38 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Add jobs for the openstack-ansible-security repository https://review.openstack.org/232015 | 09:39 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Add jobs for the openstack-ansible-security repository https://review.openstack.org/232015 | 09:40 |
| *** markvoelker has joined #openstack-infra | 09:40 | |
| openstackgerrit | Ekaterina Chernova proposed openstack/requirements: Add sphinx_rtd_theme to enhance doc gate jobs https://review.openstack.org/231073 | 09:44 |
| *** lawrancejing has quit IRC | 09:44 | |
| openstackgerrit | Ekaterina Chernova proposed openstack/requirements: Add sphinx_rtd_theme to enhance doc gate jobs https://review.openstack.org/231073 | 09:45 |
| *** markvoelker has quit IRC | 09:45 | |
| *** BobBall has joined #openstack-infra | 09:48 | |
| *** BobBall is now known as Guest79848 | 09:49 | |
| *** Guest4559 has quit IRC | 09:52 | |
| openstackgerrit | Derek Higgins proposed openstack/diskimage-builder: Avoid transcending /proc with find https://review.openstack.org/230448 | 09:54 |
| *** markvoelker has joined #openstack-infra | 09:55 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a dashboard page for boards and worklists https://review.openstack.org/231973 | 09:57 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a page to view a worklist https://review.openstack.org/232003 | 09:57 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add buttons for creating new boards and worklists https://review.openstack.org/231972 | 09:57 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a page to view a board https://review.openstack.org/231971 | 09:57 |
| *** markvoelker has quit IRC | 09:59 | |
| *** Guest79848 is now known as GnomeKing | 10:03 | |
| *** GnomeKing is now known as Bob_Ball | 10:03 | |
| *** ddieterly has joined #openstack-infra | 10:04 | |
| *** markvoelker has joined #openstack-infra | 10:04 | |
| *** rkukura has joined #openstack-infra | 10:05 | |
| *** sputnik13 has quit IRC | 10:05 | |
| *** rossella_s has quit IRC | 10:06 | |
| *** rossella_s has joined #openstack-infra | 10:07 | |
| *** ddieterly has quit IRC | 10:08 | |
| *** markvoelker has quit IRC | 10:09 | |
| *** rkukura has quit IRC | 10:09 | |
| *** marzif has quit IRC | 10:10 | |
| *** lawrancejing has joined #openstack-infra | 10:12 | |
| *** fawadkhaliq has joined #openstack-infra | 10:13 | |
| *** fawadkhaliq has quit IRC | 10:18 | |
| *** markvoelker has joined #openstack-infra | 10:19 | |
| *** yfried|afk is now known as yfried__ | 10:21 | |
| *** markvoelker has quit IRC | 10:24 | |
| *** yamamoto has quit IRC | 10:24 | |
| *** shardy_ has joined #openstack-infra | 10:25 | |
| *** shardy has quit IRC | 10:25 | |
| *** persia has quit IRC | 10:26 | |
| *** persia has joined #openstack-infra | 10:27 | |
| *** cody-somerville has quit IRC | 10:27 | |
| *** cdent has joined #openstack-infra | 10:30 | |
| *** shardy_ has quit IRC | 10:30 | |
| *** shardy has joined #openstack-infra | 10:31 | |
| *** asselin__ has joined #openstack-infra | 10:33 | |
| *** markvoelker has joined #openstack-infra | 10:33 | |
| *** asselin_ has quit IRC | 10:34 | |
| *** pc_m has joined #openstack-infra | 10:38 | |
| *** markvoelker has quit IRC | 10:38 | |
| *** pfallenop has quit IRC | 10:39 | |
| *** sdake has quit IRC | 10:41 | |
| *** trown|outttypeww is now known as trown | 10:42 | |
| *** fawadkhaliq has joined #openstack-infra | 10:45 | |
| *** dtantsur|brb is now known as dtantsur | 10:45 | |
| *** markvoelker has joined #openstack-infra | 10:47 | |
| *** kiranr has joined #openstack-infra | 10:49 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/232349 | 10:50 |
| *** kiran-r has quit IRC | 10:51 | |
| *** Sree has quit IRC | 10:53 | |
| *** markvoelker has quit IRC | 10:55 | |
| *** rkukura has joined #openstack-infra | 10:59 | |
| *** pfallenop has joined #openstack-infra | 10:59 | |
| *** aukhan has quit IRC | 11:02 | |
| *** markvoelker has joined #openstack-infra | 11:02 | |
| *** rkukura has quit IRC | 11:04 | |
| *** ddieterly has joined #openstack-infra | 11:04 | |
| *** hashar_ has quit IRC | 11:05 | |
| *** ddieterly has quit IRC | 11:09 | |
| *** markvoelker has quit IRC | 11:12 | |
| *** yfried__ is now known as yfried|afk | 11:13 | |
| openstackgerrit | Derek Higgins proposed openstack/diskimage-builder: Avoid transcending /proc with find https://review.openstack.org/230448 | 11:16 |
| *** yamamoto has joined #openstack-infra | 11:17 | |
| *** Zhongjun has quit IRC | 11:17 | |
| *** markvoelker has joined #openstack-infra | 11:17 | |
| *** achanda has joined #openstack-infra | 11:19 | |
| *** markvoelker has quit IRC | 11:24 | |
| *** achanda has quit IRC | 11:26 | |
| *** yfried|afk is now known as yfried__ | 11:27 | |
| *** yamamoto has quit IRC | 11:28 | |
| *** Ala has joined #openstack-infra | 11:31 | |
| *** jcoufal_ has joined #openstack-infra | 11:32 | |
| *** markvoelker has joined #openstack-infra | 11:32 | |
| *** pfallenop has quit IRC | 11:34 | |
| *** jcoufal has quit IRC | 11:34 | |
| *** markvoelker has quit IRC | 11:36 | |
| *** marzif has joined #openstack-infra | 11:37 | |
| *** thiagop has joined #openstack-infra | 11:39 | |
| *** Daisy has joined #openstack-infra | 11:40 | |
| *** ldnunes has joined #openstack-infra | 11:40 | |
| *** jcoufal has joined #openstack-infra | 11:40 | |
| *** pfallenop has joined #openstack-infra | 11:41 | |
| *** yfried__ is now known as yfried|afk | 11:42 | |
| *** jcoufal_ has quit IRC | 11:42 | |
| *** yfried|afk is now known as yfried__ | 11:44 | |
| *** sergmelikyan has quit IRC | 11:44 | |
| *** tobiash has joined #openstack-infra | 11:44 | |
| *** amuller has joined #openstack-infra | 11:44 | |
| *** burgerk has joined #openstack-infra | 11:45 | |
| *** jcoufal has quit IRC | 11:46 | |
| *** markvoelker has joined #openstack-infra | 11:47 | |
| *** jcoufal has joined #openstack-infra | 11:47 | |
| *** flepied has quit IRC | 11:47 | |
| *** weshay_xchat has joined #openstack-infra | 11:47 | |
| *** flepied1 has joined #openstack-infra | 11:47 | |
| *** thorst has joined #openstack-infra | 11:48 | |
| *** markvoelker has quit IRC | 11:51 | |
| *** flepied1 has quit IRC | 11:52 | |
| *** baoli has joined #openstack-infra | 11:53 | |
| *** rkukura has joined #openstack-infra | 11:53 | |
| *** sergmelikyan has joined #openstack-infra | 11:55 | |
| *** markvoelker has joined #openstack-infra | 11:57 | |
| *** cloudtrainme has joined #openstack-infra | 11:58 | |
| *** yamamoto has joined #openstack-infra | 11:58 | |
| *** rkukura has quit IRC | 11:58 | |
| *** kushal has quit IRC | 11:59 | |
| *** kushal has joined #openstack-infra | 12:00 | |
| *** markvoelker has quit IRC | 12:01 | |
| *** yamamoto has quit IRC | 12:02 | |
| *** ildikov has quit IRC | 12:03 | |
| *** markvoelker has joined #openstack-infra | 12:03 | |
| *** ddieterly has joined #openstack-infra | 12:05 | |
| *** claudiub has joined #openstack-infra | 12:06 | |
| *** rfolco__ has joined #openstack-infra | 12:07 | |
| *** kgiusti has joined #openstack-infra | 12:07 | |
| *** markvoelker has quit IRC | 12:08 | |
| *** ddieterly has quit IRC | 12:09 | |
| *** flepied has joined #openstack-infra | 12:09 | |
| *** jyuso1 has quit IRC | 12:10 | |
| *** yamamoto has joined #openstack-infra | 12:10 | |
| *** markvoelker has joined #openstack-infra | 12:12 | |
| openstackgerrit | Clint Adams proposed openstack-infra/puppet-lodgeit: Let Apache know where to serve robots.txt from https://review.openstack.org/231685 | 12:12 |
| *** markvoelker has quit IRC | 12:16 | |
| *** ddieterly has joined #openstack-infra | 12:17 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add methods to update internal router interfaces https://review.openstack.org/232236 | 12:18 |
| *** weshay_xchat is now known as weshay | 12:19 | |
| *** yfried__ is now known as yfried|afk | 12:19 | |
| *** Daisy has quit IRC | 12:21 | |
| *** Daisy has joined #openstack-infra | 12:22 | |
| *** gordc has joined #openstack-infra | 12:22 | |
| *** yfried|afk is now known as yfried__ | 12:23 | |
| pabelanger | morning | 12:24 |
| yolanda | hi | 12:25 |
| openstackgerrit | Flavio Percoco proposed openstack/requirements: requests 2.8.0 broke some gates https://review.openstack.org/232503 | 12:26 |
| *** dramalho has joined #openstack-infra | 12:27 | |
| *** dprince has joined #openstack-infra | 12:28 | |
| *** amotoki has quit IRC | 12:29 | |
| *** cloudtrainme has quit IRC | 12:30 | |
| *** aysyd has joined #openstack-infra | 12:30 | |
| *** bswartz has quit IRC | 12:31 | |
| *** dramalho has quit IRC | 12:31 | |
| *** stevemar_ has joined #openstack-infra | 12:31 | |
| *** thiagop is now known as thiagop-away | 12:32 | |
| *** thiagop-away is now known as thiagop-afk | 12:34 | |
| *** rfolco__ has quit IRC | 12:34 | |
| *** stevemar_ has quit IRC | 12:34 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: [WIP] Do not merge https://review.openstack.org/232508 | 12:35 |
| *** zz_dimtruck is now known as dimtruck | 12:35 | |
| *** ryanpetrello has quit IRC | 12:35 | |
| *** sergmelikyan has quit IRC | 12:36 | |
| *** edmondsw has joined #openstack-infra | 12:38 | |
| *** rfolco__ has joined #openstack-infra | 12:38 | |
| *** jklare has quit IRC | 12:38 | |
| *** jklare has joined #openstack-infra | 12:39 | |
| *** doug-fish has joined #openstack-infra | 12:39 | |
| *** _afazekas has joined #openstack-infra | 12:39 | |
| *** _afazekas has quit IRC | 12:40 | |
| *** ryanpetrello has joined #openstack-infra | 12:41 | |
| *** markvoelker has joined #openstack-infra | 12:41 | |
| *** doug-fish has quit IRC | 12:41 | |
| *** cody-somerville has joined #openstack-infra | 12:41 | |
| *** doug-fish has joined #openstack-infra | 12:41 | |
| *** julim has joined #openstack-infra | 12:42 | |
| *** ddieterly has quit IRC | 12:42 | |
| *** asettle has joined #openstack-infra | 12:42 | |
| mordred | fungi, jhesketh: I thnk this is maybe a swift log upload problem? : http://logs.openstack.org/46/232146/1/check/gate-shade-python27/ce93a3c/testr_results.html.gz | 12:44 |
| *** sergmelikyan has joined #openstack-infra | 12:45 | |
| mordred | Shrews: I'm doing a recheck on the two working shade keystone patches | 12:45 |
| mordred | Shrews: to see if it still works with keystone v3 | 12:45 |
| *** markvoelker has quit IRC | 12:45 | |
| *** markvoelker has joined #openstack-infra | 12:46 | |
| Shrews | mordred: ack | 12:46 |
| *** rfolco_ has joined #openstack-infra | 12:47 | |
| *** rkukura has joined #openstack-infra | 12:47 | |
| *** ildikov has joined #openstack-infra | 12:48 | |
| mordred | Shrews: and I'm trying to figure out how to be explicit about keystone API versions in our dsvm runs | 12:48 |
| *** rfolco_ has quit IRC | 12:49 | |
| openstackgerrit | Isaac Beckman proposed openstack-infra/devstack-gate: Multinode interfaces on singlenode n-net create once https://review.openstack.org/232513 | 12:49 |
| *** markvoelker has quit IRC | 12:49 | |
| *** markvoelker has joined #openstack-infra | 12:49 | |
| *** rfolco_ has joined #openstack-infra | 12:49 | |
| *** rfolco__ has quit IRC | 12:49 | |
| *** markvoelker has quit IRC | 12:50 | |
| *** markvoelker has joined #openstack-infra | 12:50 | |
| *** sambetts has quit IRC | 12:51 | |
| *** sambetts has joined #openstack-infra | 12:52 | |
| mordred | Shrews: ok. it looks like devstack is currently deploying both keystone v2 and v3 | 12:52 |
| *** rkukura has quit IRC | 12:52 | |
| Shrews | mordred: i would be interested in knowing that too. let me know what you find out | 12:52 |
| mordred | Shrews: so for testing, I believe we should just be able to set identity_api_version=3 or identity_api_version=2 in our cloud config | 12:53 |
| Shrews | mordred: is there an override for that value? i assume clouds.yaml takes precedence over env var | 12:54 |
| mordred | Shrews: well, you can always pass kwargs which override clouds.yaml | 12:54 |
| Shrews | mordred: eww | 12:55 |
| mordred | Shrews: should be self.cloud = openstack_cloud(cloud='devstack-admin', identity_api_version='2.0') for any tests where we want to test v2 ... | 12:56 |
| Shrews | mordred: yeah... eww. | 12:57 |
| mordred | sorry | 12:57 |
| Shrews | mordred: trying to image the process of testing both versions | 12:57 |
| mordred | Shrews: lemme send you quick patch - I has idea | 12:57 |
| Shrews | mordred: ideally we'd have 2 gate jobs, one testing each version, as you suggested last nighta | 12:58 |
| *** Daisy has quit IRC | 12:58 | |
| *** boris-42 has quit IRC | 12:58 | |
| Shrews | if we keep a single job, then that will complicate our functional tests | 12:59 |
| mordred | yah. that is true | 12:59 |
| Shrews | thus my 'eww' | 12:59 |
| *** sergmelikyan has quit IRC | 12:59 | |
| mordred | the main reason I'm poking in that direction is that there is not an option in devstack to disable v3 | 12:59 |
| mordred | only one to disable v2 | 12:59 |
| mordred | and that one is labeled "experimental" | 12:59 |
| Shrews | mordred: that's fine. we just need an override for the value written to clouds.yaml, right? | 13:00 |
| mordred | o. good point | 13:00 |
| *** Daisy has joined #openstack-infra | 13:00 | |
| *** Daisy has quit IRC | 13:00 | |
| mordred | we can have a second job that has the same devstack run and just modifies clouds.yaml | 13:00 |
| mordred | nod | 13:00 |
| Shrews | mordred: yep | 13:00 |
| mordred | gotcha. brill. | 13:00 |
| *** Daisy has joined #openstack-infra | 13:00 | |
| mordred | Shrews: k. I'll get that going | 13:00 |
| mordred | Shrews: I vote we align on v3 param names rather than v2 since we made the project vs. tenant plunge already too | 13:01 |
| Shrews | mordred: ++, though i'm not familiar enough with names that have changed | 13:02 |
| mordred | Shrews: me neither. but I think anything currently failing tests is likely due to parameter name changes | 13:02 |
| Shrews | yay | 13:02 |
| *** Daisy has quit IRC | 13:02 | |
| mordred | Shrews: 'lucky' for us, this should only be biting us on your new keystone crud patches | 13:03 |
| *** rfolco__ has joined #openstack-infra | 13:03 | |
| *** Daisy has joined #openstack-infra | 13:03 | |
| Shrews | mordred: i don't think that's true. it's affecting other reviews not dependent on those | 13:03 |
| *** bswartz has joined #openstack-infra | 13:04 | |
| Shrews | oh, maybe not | 13:04 |
| mordred | yeah. I tink those just suck for other reasons | 13:04 |
| Shrews | thought i saw that somewhere else. good, then | 13:04 |
| yolanda | mordred, is that a bad time to ask for https://review.openstack.org/#/c/189762/ ? nodepool secure.conf | 13:05 |
| yolanda | with the amount of changes on nodepool, that keeps delaying | 13:05 |
| *** rfolco__ has quit IRC | 13:05 | |
| SergeyLukjanov | fungi, yolanda, jhesketh - re last infra meeting - I've been traveling, just returned home tonight, I can do some stuff in EMEA time zone for less americentric windows | 13:05 |
| *** rfolco_ has quit IRC | 13:05 | |
| SergeyLukjanov | should be still in Russia at this time frame | 13:06 |
| *** Daisy has quit IRC | 13:08 | |
| *** doug-fis_ has joined #openstack-infra | 13:08 | |
| *** Sree has joined #openstack-infra | 13:08 | |
| *** jaypipes has joined #openstack-infra | 13:08 | |
| *** afazekas_ has joined #openstack-infra | 13:09 | |
| *** Daisy has joined #openstack-infra | 13:10 | |
| yolanda | SergeyLukjanov, great, more people in EMEA :) | 13:11 |
| *** markvoelker_ has joined #openstack-infra | 13:11 | |
| *** doug-fish has quit IRC | 13:11 | |
| *** ddieterly has joined #openstack-infra | 13:12 | |
| *** markvoelker has quit IRC | 13:12 | |
| *** ddieterly has joined #openstack-infra | 13:12 | |
| *** ddieterly has quit IRC | 13:14 | |
| *** shardy_ has joined #openstack-infra | 13:14 | |
| *** dimtruck is now known as zz_dimtruck | 13:14 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add a shade functional test for keystone v2 https://review.openstack.org/232525 | 13:15 |
| *** ddieterly has joined #openstack-infra | 13:15 | |
| *** shardy has quit IRC | 13:15 | |
| *** ddieterly has quit IRC | 13:16 | |
| *** zeih has joined #openstack-infra | 13:16 | |
| mordred | Shrews: ^^ | 13:16 |
| *** ddieterly has joined #openstack-infra | 13:16 | |
| mordred | SergeyLukjanov, yolanda: ^^ ? :) | 13:17 |
| *** rfolco__ has joined #openstack-infra | 13:17 | |
| yolanda | mordred, i trade for secure.conf review :) | 13:17 |
| yolanda | looking | 13:18 |
| *** cody-somerville has quit IRC | 13:18 | |
| SergeyLukjanov | mordred lgtm, but do you really want to start with a voting job in gate? :0 | 13:19 |
| *** shardy_ has quit IRC | 13:19 | |
| *** alivigni has joined #openstack-infra | 13:19 | |
| yolanda | mm, yes, non voting at first test? you trust it! | 13:19 |
| yolanda | also, why a keystone2 test and not a keystone3 test here? is that covered in other jobs? | 13:20 |
| *** shardy has joined #openstack-infra | 13:20 | |
| mordred | keystone3 is the new default | 13:20 |
| mordred | so this is just a test to make sure keystone2 still works | 13:20 |
| *** marzif has quit IRC | 13:20 | |
| *** glauco has joined #openstack-infra | 13:20 | |
| yolanda | mm ok | 13:21 |
| mordred | could do non-voting - but I'm crazy - what do you think Shrews ? | 13:21 |
| mordred | yolanda: where is the secure.conf review? | 13:21 |
| mordred | SergeyLukjanov: welcome back to Russia! | 13:21 |
| Shrews | mordred: well, we definitely want it voting at some point | 13:22 |
| yolanda | mordred, https://review.openstack.org/189762 | 13:22 |
| SergeyLukjanov | mordred, yeah, welcome back to the jetlag :) | 13:22 |
| *** tiswanso has joined #openstack-infra | 13:22 | |
| *** marzif has joined #openstack-infra | 13:22 | |
| Shrews | mordred: might as well make it voting now since we've been testing ok against v2 | 13:22 |
| *** btully has joined #openstack-infra | 13:22 | |
| mordred | SergeyLukjanov: jetlag FTW \o/ | 13:22 |
| *** markvoelker_ has quit IRC | 13:23 | |
| mordred | yolanda: holycrap that's a big patch | 13:23 |
| *** kiranr has quit IRC | 13:23 | |
| yolanda | mordred, i know... and lots of iterations | 13:24 |
| *** achanda has joined #openstack-infra | 13:24 | |
| yolanda | we tried landing a pair of times but we always had to do rebases , because nodepool has been changing so much | 13:24 |
| yolanda | it's a blocker for the puppet-openstackci work | 13:24 |
| *** pradk has joined #openstack-infra | 13:24 | |
| mordred | yolanda: ok. then I'll ask questions here and not on review | 13:25 |
| yolanda | sure, ask whatever you need :) | 13:25 |
| fungi | there's been complaints previously about adding non-voting jobs unless they're already expected to succeed. if they're expected to succeed you might as well make them voting. if they're not expected to succeed then put them in the experimental pipeline | 13:25 |
| fungi | if they're expected to succeed but you're trying to limit risk, then non-voting might be a reasonable middle-ground though | 13:26 |
| yolanda | fungi, what's reason for that policy? save nodes? | 13:26 |
| mordred | yolanda: SO ... I have one concern so far ... which is that we've got a race condition in being able to land this | 13:26 |
| fungi | yolanda: apparently it confuses contributors | 13:26 |
| *** achanda has quit IRC | 13:27 | |
| mordred | yolanda: since the location of the secure.conf file is a command line option and not a new option in the nodepool.yaml file | 13:27 |
| fungi | they see a job, even non-voting, failing and think they've submitted an incorrect change | 13:27 |
| *** achanda has joined #openstack-infra | 13:27 | |
| mordred | yolanda: it means that although we've landed the change to write the secure.conf file | 13:27 |
| mordred | yolanda: we still need an update to the nodepool init script | 13:27 |
| yolanda | mordred, it landed several time ago | 13:27 |
| yolanda | it was managed by puppet | 13:27 |
| *** achanda has quit IRC | 13:27 | |
| *** zeih has quit IRC | 13:27 | |
| yolanda | the secure.conf file is present on nodepool in production | 13:28 |
| mordred | right. that's great - I'm talking about init script that needs to pass the parameter now | 13:28 |
| *** glauco___ has joined #openstack-infra | 13:28 | |
| mordred | we either need to land a patch that accepts the parameter but ignores it for now, then a patch to init script, then the main patch - or something else more clever | 13:29 |
| mordred | you see what I mean? | 13:29 |
| yolanda | i'm looking at the code and try to understand | 13:29 |
| *** regXboi has joined #openstack-infra | 13:29 | |
| *** vivekd_ has joined #openstack-infra | 13:30 | |
| *** vivekd has quit IRC | 13:31 | |
| *** vivekd_ is now known as vivekd | 13:31 | |
| *** glauco has quit IRC | 13:31 | |
| *** burgerk has quit IRC | 13:31 | |
| *** xyang1 has joined #openstack-infra | 13:32 | |
| yolanda | so mordred, it defaults to a path that is existing, command line has a reasonable default. Why the /etc/init.d script should be affected? | 13:32 |
| mordred | yolanda: OH. duh | 13:32 |
| mordred | yolanda: thank you - I'm still coffeeing | 13:32 |
| mordred | yolanda: my brain was confused because the devstack plugin added the argument | 13:32 |
| yolanda | ah maybe not needed on devstack? i haven't worked this part so much | 13:33 |
| *** mriedem has joined #openstack-infra | 13:33 | |
| mordred | nah. that's fine | 13:34 |
| yolanda | mordred, well, i think that we just try to follow conventions on devstack. As the nodepool.yaml argument was there, also add the secure.conf | 13:34 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add get/list/search methods for identity roles https://review.openstack.org/231618 | 13:35 |
| *** cloudtrainme has joined #openstack-infra | 13:35 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Test a update in trunk repository version https://review.openstack.org/229789 | 13:35 |
| *** akshai has joined #openstack-infra | 13:35 | |
| mordred | yolanda: yup | 13:36 |
| mordred | yolanda: looks good to me - I'd like to get jeblair to look at it when he wakes up | 13:37 |
| yolanda | cool, i'd love to land this, this is kind of blocker for downstream as well | 13:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use keystone v3 service type argument https://review.openstack.org/232530 | 13:37 |
| yolanda | and ...hmm... i have tons of small patches for puppet stuff , if you are bored :) | 13:37 |
| mordred | Shrews: ^^ I think that's a fix for the service type stuff | 13:37 |
| *** markvoelker has joined #openstack-infra | 13:38 | |
| Shrews | mordred: awesome. still trying to figure out why some reviews pass and others do not | 13:38 |
| mordred | Shrews: nod | 13:39 |
| mordred | Shrews: also, I have a hunch that we're going to need to do this todo: | 13:39 |
| mordred | # ToDo: support v3 api (dguerri) | 13:39 |
| Shrews | mordred: because i find this disturbing | 13:39 |
| mordred | Shrews: yah | 13:39 |
| *** yamamoto has quit IRC | 13:41 | |
| *** marzif has quit IRC | 13:41 | |
| mordred | Shrews: you know what's fun about endpoints in v2 vs. v3? in v2 it's create_endpoint(public_url, internal_url, admin_url) - in v3 it's create_endpoint(url, type=public) create_endpoint(url, type=internal) create_endpoint(url, type=admin) | 13:41 |
| Shrews | mordred: oh! do we still have some dsvm notes out there running only v2? | 13:41 |
| Shrews | s/notes/nodes/ | 13:41 |
| mordred | Shrews: shouldn't be | 13:41 |
| mordred | Shrews: all of the tests shoudl be running with tip of devstack | 13:41 |
| *** marzif has joined #openstack-infra | 13:41 | |
| *** rkukura has joined #openstack-infra | 13:41 | |
| mordred | that's part of the zuul checkout at the top of the test | 13:41 |
| openstackgerrit | Antoine Cabot proposed openstack-infra/irc-meetings: add Watcher team meeting https://review.openstack.org/232532 | 13:42 |
| *** afazekas_ has quit IRC | 13:42 | |
| *** cody-somerville has joined #openstack-infra | 13:42 | |
| *** boris-42 has joined #openstack-infra | 13:43 | |
| *** markvoelker has quit IRC | 13:43 | |
| *** zz_dimtruck is now known as dimtruck | 13:44 | |
| *** markvoelker has joined #openstack-infra | 13:45 | |
| *** cloudtrainme has quit IRC | 13:46 | |
| *** rkukura has quit IRC | 13:46 | |
| Shrews | mordred: http://logs.openstack.org/18/231618/1/check/gate-shade-dsvm-functional-neutron/2fa86fc/logs/devstacklog.txt.gz#_2015-10-06_18_35_27_943 | 13:47 |
| Shrews | compared to http://logs.openstack.org/36/232236/2/check/gate-shade-dsvm-functional-neutron/ce63fe3/logs/devstacklog.txt.gz#_2015-10-08_12_48_32_188 | 13:48 |
| Shrews | mordred: one is setting version 2.0, the other 3 | 13:48 |
| clarkb | both v2 and v3 should be enabled iirc | 13:49 |
| Shrews | mordred: i cannot explain that if both are using devstack HEAD | 13:49 |
| *** rfolco__ has quit IRC | 13:49 | |
| clarkb | Shrews it allows both I thought | 13:49 |
| mordred | clarkb: yah. but the question is "what does it give us for auth_url" | 13:49 |
| mordred | clarkb: we do not _ask_ for anything, so what it supports is, as of right now, not the issue | 13:50 |
| *** rfolco has joined #openstack-infra | 13:50 | |
| mordred | clarkb: the issue is what it tells us to use by default | 13:50 |
| *** markvoelker has quit IRC | 13:50 | |
| clarkb | oh | 13:50 |
| *** cloudtrainme has joined #openstack-infra | 13:50 | |
| *** yamamoto has joined #openstack-infra | 13:50 | |
| mordred | we consume the "devstack" clouds from clouds.yaml | 13:50 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:50 | |
| mordred | it seems that in some runs, that clouds.yaml is being created with a v2 url | 13:50 |
| mordred | and in some runs it is being created with a v3 url | 13:50 |
| mordred | which is disturbing, because I'd expect the devstacks to be the same | 13:51 |
| mordred | Shrews: oh - well, yeah - the first url you passed me was from 2 days ago | 13:51 |
| mordred | Shrews: that was before the devstack change landed | 13:51 |
| *** dramalho has joined #openstack-infra | 13:51 | |
| mordred | Shrews: the second url is from today, which is after the devstack change landed | 13:52 |
| Shrews | gah, i thought that was the latest | 13:52 |
| Shrews | but i'm not seeing the latest on https://review.openstack.org/#/c/231618/ | 13:52 |
| mordred | Shrews: now, here's the fun question - does the http://127.0.0.1:35357 url work for v2 API or do we need to append /v2 | 13:52 |
| mordred | Shrews: it hasn't run yet - https://jenkins07.openstack.org/job/gate-shade-dsvm-functional-neutron/86/console | 13:53 |
| mordred | Shrews: it's still running devstack | 13:53 |
| *** markvoelker has joined #openstack-infra | 13:53 | |
| Shrews | mordred: i just rebased it. that's the same one you rechecked a few minutes ago and it passed | 13:54 |
| mordred | Shrews: I do not see those jobs | 13:54 |
| Shrews | nor do i | 13:54 |
| mordred | Shrews: I'm going to hold the neutron node for the current run of that | 13:54 |
| *** dzamboni has joined #openstack-infra | 13:55 | |
| *** dramalho has quit IRC | 13:55 | |
| *** dramalho has joined #openstack-infra | 13:57 | |
| mordred | Shrews: is your ssh key from launchpad valid? | 13:57 |
| Shrews | mordred: yes | 13:57 |
| *** markvoelker has quit IRC | 13:58 | |
| mordred | Shrews: k. I added your key to a user named "shrews" on 15.126.142.225 | 13:58 |
| mordred | Shrews: it's still running devstack and whatnot | 13:58 |
| mordred | but when that job finishes, the node is there for us to poke around on and find out what's actually up | 13:58 |
| *** fawadkhaliq has quit IRC | 13:58 | |
| *** sergmelikyan has joined #openstack-infra | 13:59 | |
| *** dramalho has quit IRC | 13:59 | |
| *** marzif has quit IRC | 14:00 | |
| *** mpaolino has joined #openstack-infra | 14:00 | |
| mordred | Shrews: 'stack' user is the one to look for for clouds.yaml | 14:01 |
| *** burgerk has joined #openstack-infra | 14:01 | |
| *** marzif has joined #openstack-infra | 14:01 | |
| clarkb | the nodepool job had trouble with os client config too but I now think that is because devstack writes the file after we start nodepool | 14:01 |
| clarkb | should be in /opt/stack/new | 14:01 |
| mordred | clarkb: hrm. we start nodepool before devstack is done? | 14:01 |
| clarkb | ya because it is a devstack plugin | 14:02 |
| mordred | clarkb: (also, I may have fixed that- I moved where clouds.yaml gets written to much earlier in devstack now) | 14:02 |
| *** marzif has quit IRC | 14:02 | |
| mordred | clarkb: now it gets written right after keystone is set up | 14:02 |
| clarkb | ok there is a change to recheck to test | 14:02 |
| mordred | cool | 14:02 |
| *** _afazekas has joined #openstack-infra | 14:03 | |
| mordred | I'd love to get use testing that codepath in our nodepool test | 14:03 |
| *** _afazekas has quit IRC | 14:03 | |
| * mordred loves that the password for the non-admin demo user is "secretadmin" | 14:03 | |
| Shrews | mordred: it's actually written to the 'jenkins' users home, but i found it | 14:03 |
| mordred | what? | 14:04 |
| clarkb | the cloud name is devstack ya? | 14:04 |
| clarkb | uh | 14:04 |
| mordred | Shrews: ah - it gets copied | 14:04 |
| mordred | clarkb: yes. | 14:04 |
| mordred | clarkb: devstack is the non-admin cloud name | 14:04 |
| mordred | clarkb: devstack-admin is the admin one | 14:04 |
| clarkb | is it also in stack's home? | 14:04 |
| mordred | it's in both | 14:04 |
| clarkb | ok good | 14:04 |
| mordred | we should probably just put it in /etc/openstack world readable | 14:05 |
| mordred | rather than home dirs | 14:05 |
| *** markvoelker has joined #openstack-infra | 14:06 | |
| *** sergmelikyan has quit IRC | 14:06 | |
| *** rossella_s has quit IRC | 14:06 | |
| *** rossella_s has joined #openstack-infra | 14:06 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Catch early devstack output into logfile https://review.openstack.org/199851 | 14:08 |
| *** markvoelker_ has joined #openstack-infra | 14:08 | |
| *** dizquierdo has joined #openstack-infra | 14:09 | |
| *** vlaza has quit IRC | 14:09 | |
| *** dkranz has joined #openstack-infra | 14:09 | |
| *** cody-somerville has quit IRC | 14:10 | |
| eantyshev | clarkb: Hello! Can we continue discussing zuul change https://review.openstack.org/207094 ? I didn't quite understand you last words about separate pipelines... | 14:10 |
| *** markvoelker has quit IRC | 14:11 | |
| *** dramalho has joined #openstack-infra | 14:14 | |
| clarkb | eantyshev I need to reread it and got distracted | 14:15 |
| clarkb | my concern was that independent pipelines are modified adding in the projects rather than just ignoring them | 14:15 |
| *** asettle has quit IRC | 14:16 | |
| clarkb | line 1804 of the scheduler. why do that? | 14:16 |
| clarkb | also not sure what the debug log is trying to tell us | 14:17 |
| openstackgerrit | Merged openstack-infra/project-config: Add a shade functional test for keystone v2 https://review.openstack.org/232525 | 14:18 |
| clarkb | couldnt you continue to return the old value and ignore the "foreign" projects? | 14:19 |
| eantyshev | clarkb: we do what it takes: dynamically create projects (special ones, 'foreign', their changes are not enqueued, unless others depend on them) | 14:19 |
| *** thiagop-afk is now known as thiagop | 14:20 | |
| clarkb | right so why create an unnecessary change queue? | 14:20 |
| eantyshev | clarkb: we cannot ignore, their changes are enqueued if we want to test CRD | 14:20 |
| clarkb | but isnt this working around CRD? | 14:21 |
| *** leifmadsen has joined #openstack-infra | 14:21 | |
| clarkb | if you want CRD add the project to layout.yaml | 14:21 |
| *** russellb_ has joined #openstack-infra | 14:21 | |
| *** jtomasek has quit IRC | 14:21 | |
| eantyshev | clarkb: idea here is that my third-party CI layout cannot predict every possible CRD projects | 14:21 |
| clarkb | yes it can... | 14:22 |
| clarkb | you can get a complete project list from gerrit or you can just see what is in upstream layout.yaml | 14:22 |
| *** glauco has joined #openstack-infra | 14:23 | |
| eantyshev | clarkb: of course, there's a finite list of them, but this wouldn't look very pretty... | 14:23 |
| eantyshev | clarkb: having hundreds of 'dummy' projects in layout | 14:23 |
| *** russellb_ is now known as russellb | 14:24 | |
| *** russellb has joined #openstack-infra | 14:24 | |
| clarkb | but anyways back to line 1804, so you need a valid queue in the pipeline otherwise CRD doesnt work. Why doesnt the dependent pipeline manager need the same sort of work around? | 14:24 |
| *** Piet has joined #openstack-infra | 14:25 | |
| *** glauco___ has quit IRC | 14:26 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Fix quoting issue in shade keystone2 job https://review.openstack.org/232562 | 14:26 |
| andreykurilin | hi all! Does anybody know what is happened with jobs results(html reports become unreadable, example : http://logs.openstack.org/73/231473/2/check/gate-nova-python34/77b4b4b/testr_results.html.gz ) ? | 14:27 |
| *** dramalho has quit IRC | 14:27 | |
| *** spzala has joined #openstack-infra | 14:27 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use keystone v3 service type argument https://review.openstack.org/232530 | 14:28 |
| mordred | Shrews: there's the whoops | 14:28 |
| fungi | andreykurilin: mordred pointed that out earlier today | 14:28 |
| eantyshev | clarkb: dependent pipeline manager creates queues for every defined project, and combines them | 14:28 |
| *** stevemar_ has joined #openstack-infra | 14:28 | |
| *** achanda has joined #openstack-infra | 14:28 | |
| fungi | andreykurilin: mordred: i too suspect a regression in os-loganalyze | 14:29 |
| mordred | clarkb: did you see that? | 14:29 |
| fungi | looks like it's not serving that file up as html | 14:29 |
| clarkb | eantyshev yes but for CRD we need them for undefined projects | 14:29 |
| mordred | clarkb: ^^ ? (I know you were doing os-loganalyze) | 14:29 |
| *** sdake has joined #openstack-infra | 14:29 | |
| clarkb | fungi mordred its likely broken html detection in os loganaylse | 14:30 |
| clarkb | my revert should make it go away | 14:30 |
| mordred | clarkb: has that not landed yet? | 14:30 |
| fungi | clarkb: where was the revert? | 14:30 |
| clarkb | revert is in puppet-openstackci | 14:30 |
| *** mtanino has joined #openstack-infra | 14:31 | |
| mordred | clarkb: +3 | 14:31 |
| *** wenlock has joined #openstack-infra | 14:31 | |
| *** wenlock1 has joined #openstack-infra | 14:31 | |
| fungi | i guess it's doubly approved now | 14:32 |
| fungi | i added some extra notes as to what else was still missing that we'd noticed | 14:32 |
| pelix | alivigni: re https://review.openstack.org/#/c/229100/11//COMMIT_MSG you should just describe the intent of the patch rather than the changes you made due to review, as the commit should make sense to anyone cloning the repo directly. | 14:33 |
| pelix | at the moment that message only makes sense if you also look at the review history | 14:33 |
| clarkb | eantyshev or am I mistaken with how dependent pipeline managers? | 14:33 |
| clarkb | er how they function. the get queue in there should return None for undefined projects | 14:34 |
| clarkb | which should -1 dependent change could not merge iirc | 14:34 |
| *** Sree has quit IRC | 14:34 | |
| clarkb | which may be desireable I suppose | 14:35 |
| *** jtomasek has joined #openstack-infra | 14:35 | |
| eantyshev | clarkb: I study my testcase for your question, to not mislead you | 14:35 |
| *** rkukura has joined #openstack-infra | 14:35 | |
| *** markvoelker_ has quit IRC | 14:35 | |
| *** e0ne has quit IRC | 14:37 | |
| *** achanda has quit IRC | 14:38 | |
| clarkb | eantyshev I think the question boils down to does the assertion starting at line 3738 make sense in the context of CRD | 14:38 |
| *** cody-somerville has joined #openstack-infra | 14:38 | |
| clarkb | and I am not sure they do given how we treat independent pipelines | 14:39 |
| eantyshev | clarkb: it cannot enqueue CRD when it is open (like you noted), but when CRD is merged, there is no need to enqueue it, and dependent pipeline proceeds with tests | 14:39 |
| clarkb | (remember whether or not a pipeline is independent or dependent is not directly related to if it is gating or not) | 14:40 |
| clarkb | right but the assertion for independent pipelines is it should enqueue the crd | 14:40 |
| *** rkukura has quit IRC | 14:40 | |
| *** tonytan4ever has joined #openstack-infra | 14:40 | |
| clarkb | and if viewed without a check vs gate perspective does thst make sense? I am not sure yet, still thinking through it | 14:41 |
| *** kfarr has joined #openstack-infra | 14:42 | |
| eantyshev | clarkb: you are right in that I considered dependent == gating pipeline | 14:42 |
| *** vmb_out is now known as vmbrasseur | 14:43 | |
| mordred | sdague: heya - you around? | 14:43 |
| sdague | mordred: yes | 14:43 |
| mordred | sdague: yay! | 14:43 |
| *** Sree has joined #openstack-infra | 14:43 | |
| sdague | what's up? | 14:43 |
| mordred | sdague: I was just looking at a keystonev2/v3 thing in devstack | 14:44 |
| sdague | ok | 14:44 |
| mordred | but while looking at it, I wound up looking at the keystone catalog in devstack | 14:44 |
| clarkb | eantyshev that behavior does make sense for gating | 14:44 |
| sdague | sure | 14:44 |
| mordred | which has a cinder and a cinderv2 service type entry | 14:44 |
| sdague | yep | 14:44 |
| mordred | sdague: is that a bug or the plan? | 14:44 |
| sdague | it's the current state of the world | 14:44 |
| sdague | and changing it breaks everything right now | 14:45 |
| mordred | neat. | 14:45 |
| sdague | which is part of trying to figure out how to get from where we are, to where we want to be | 14:45 |
| andreykurilin | fungi, mordred, clarkb: thanks! now I'm happy that reports will displayed as expected:) | 14:45 |
| mordred | ok. cool, that's why I was pinging you - I figured since you were engaging on the cinder v2 topic you'd have a good head on what was going on there | 14:45 |
| sdague | mordred: https://github.com/openstack/nova/blob/251e09ab69e5dd1ba2c917175bb408c708843f6e/nova/volume/cinder.py#L40-L44 | 14:45 |
| sdague | for instance | 14:46 |
| clarkb | eantyshev the simple thing is to make CRD following configurable | 14:46 |
| sdague | that's how nova currently knows to hit cinder v2 | 14:46 |
| clarkb | eantyshev then you can enable on a per pipeline basis | 14:46 |
| mordred | wow. that's awesome | 14:46 |
| *** Swami has joined #openstack-infra | 14:46 | |
| mordred | sdague: currently, shade does not know anything about service types called "cinderv2" - and I'd rather not teach it about them if it's merely a temporary state of the world | 14:47 |
| openstackgerrit | Merged openstack-infra/project-config: Fix quoting issue in shade keystone2 job https://review.openstack.org/232562 | 14:47 |
| clarkb | eantyshev I would get jeblairs input it may be fine as is too | 14:47 |
| eantyshev | clarkb: but this is how dependent pipeline operates now | 14:47 |
| sdague | mordred: well, it's the state of the world, we do have to figure out how to get us to a better world in a migratable way without everyone needing a flag day | 14:47 |
| clarkb | eantyshev yes and same for check | 14:47 |
| mordred | sdague: kk | 14:47 |
| clarkb | eantyshev but we are changing check/independentpipelinemanager | 14:47 |
| sdague | which is part of the point of the session, we'll have a prelim plan, and then need help closing some bits on it | 14:48 |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Revert "Handle all requests through os-loganalyze" https://review.openstack.org/232170 | 14:48 |
| krotscheck | Mornin' everyone | 14:48 |
| eantyshev | clarkb: I meant that I didn't change dependent pipeline operation | 14:48 |
| clarkb | eantyshev yes thats my concern :) if we need to change one then the behavior of the other needs to be considered as well | 14:49 |
| clarkb | otherwise we may land a half of a feature | 14:49 |
| *** dramalho has joined #openstack-infra | 14:49 | |
| *** sridhar_ram has joined #openstack-infra | 14:49 | |
| sambetts | yolanda: Hey, can I get added to the core team for cisco-ironic-contrib now its merged? https://review.openstack.org/#/c/229060 | 14:50 |
| clarkb | mordred sdague that almost sounds like the catalog needs version awareness | 14:50 |
| krotscheck | Any core able to re-enqueue a job for me? "sudo zuul enqueue-ref --trigger gerrit --pipeline release --project openstack/eslint-config-openstack --ref refs/tags/1.2.3 --newrev 35393b1fa54188d54d3d8a5956b49b40df1aa281" | 14:50 |
| *** dra_ is now known as denisra | 14:50 | |
| * krotscheck hopes that's the last one | 14:50 | |
| *** armax has joined #openstack-infra | 14:51 | |
| *** DericHorn-HP has joined #openstack-infra | 14:53 | |
| yolanda | hi sambetts, looking | 14:53 |
| openstackgerrit | Merged openstack-infra/irc-meetings: add Watcher team meeting https://review.openstack.org/232532 | 14:54 |
| *** mtreinish has quit IRC | 14:54 | |
| *** dramalho has quit IRC | 14:54 | |
| *** mtreinish has joined #openstack-infra | 14:54 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use tripleo.sh to build packages https://review.openstack.org/229425 | 14:55 |
| *** markvoelker has joined #openstack-infra | 14:55 | |
| eantyshev | clarkb: agreed, I did only the minimal check for 'foreign' projects entering dependent pipeline. But to continue, I need more specific guidance. I use the fork of zuul with that patch in my CI, to not get crashes on reconfiguration and to be able to test CRDs, so there's no hurry for me | 14:56 |
| alivigni | pelix# ok | 14:56 |
| clarkb | eantyshev I would see what jeblair thinks he should be around soon | 14:56 |
| *** dramalho has joined #openstack-infra | 14:57 | |
| *** dramalho has quit IRC | 14:57 | |
| *** e0ne has joined #openstack-infra | 14:57 | |
| *** dramalho has joined #openstack-infra | 14:57 | |
| *** dguitarbite has quit IRC | 14:58 | |
| *** angdraug has joined #openstack-infra | 14:59 | |
| *** iraw- has quit IRC | 14:59 | |
| *** fawadkhaliq has joined #openstack-infra | 14:59 | |
| *** achanda has joined #openstack-infra | 14:59 | |
| yolanda | sambetts, added. Do you need to be on release group as well? | 14:59 |
| sambetts | yolanda: Yes please :) | 15:00 |
| *** annegentle has joined #openstack-infra | 15:00 | |
| *** sabeen1 has joined #openstack-infra | 15:00 | |
| *** spzala has quit IRC | 15:00 | |
| *** tiswanso has quit IRC | 15:01 | |
| yolanda | done | 15:01 |
| *** Zhongjun has joined #openstack-infra | 15:01 | |
| sambetts | yolanda: Thanks :D | 15:02 |
| *** achanda has quit IRC | 15:02 | |
| *** tiswanso has joined #openstack-infra | 15:02 | |
| *** dramalho has quit IRC | 15:02 | |
| *** arxcruz has quit IRC | 15:03 | |
| *** fawadkhaliq has quit IRC | 15:04 | |
| *** hemnafk is now known as hemna | 15:04 | |
| *** sridhar_ram has quit IRC | 15:04 | |
| *** spzala has joined #openstack-infra | 15:05 | |
| *** marzif has joined #openstack-infra | 15:06 | |
| *** dramalho has joined #openstack-infra | 15:08 | |
| *** dkranz has quit IRC | 15:09 | |
| mriedem | jhesketh: yolanda: the dependent change for this is merged, you each have a +2 on it, can we get it approved? https://review.openstack.org/#/c/224172/ | 15:09 |
| mriedem | i'd like to use that in elastic-recheck | 15:09 |
| yolanda | mriedem, i didn't approve because i wanted to have more feedback...clarkb, fungi, can you take a look? | 15:11 |
| openstackgerrit | Brad P. Crochet proposed openstack/requirements: Add ipaddress>=1.0.14 to global-requirements.txt https://review.openstack.org/232589 | 15:11 |
| *** peristeri has quit IRC | 15:12 | |
| *** sabeen1 has quit IRC | 15:12 | |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder: Implements: additions for OS3 plugin entry points in builders and scm https://review.openstack.org/229100 | 15:12 |
| fungi | mriedem: looks like that's safe to merge and will just default to "UNKNOWN" for now until we get a zuul restart | 15:13 |
| alivigni | pelix# ok changes made can I get your approval I will work on the common method later today | 15:13 |
| alivigni | zaro# can I get another ack since I updated the commit message | 15:13 |
| yolanda | fungi thx | 15:14 |
| fungi | mriedem: there was an associated change to the gearman plugin for jenkins as well, right? | 15:14 |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder: Implements: additions for OS3 plugin entry points in builders and scm https://review.openstack.org/229100 | 15:14 |
| mriedem | fungi: yeah https://review.openstack.org/#/c/224162/ | 15:14 |
| mriedem | via depends-on | 15:14 |
| fungi | mriedem: that's the zuul one | 15:14 |
| clarkb | fungi no need in jenkins all job params are passed in the zmq event | 15:14 |
| *** abregman has quit IRC | 15:15 | |
| krotscheck | fungi, clarkb: Morning! Clark's latest change to the release scripts merged, could one of you re-enqeue that build so I can debug anything that happens next? sudo zuul enqueue-ref --trigger gerrit --pipeline release --project openstack/eslint-config-openstack --ref refs/tags/1.2.3 --newrev 35393b1fa54188d54d3d8a5956b49b40df1aa281 | 15:16 |
| fungi | clarkb: oh! right, that's just when zuul needs to know things only jenkins is normally aware of, like in https://review.openstack.org/205097 | 15:16 |
| *** eharney has quit IRC | 15:16 | |
| *** rkukura has joined #openstack-infra | 15:16 | |
| fungi | krotscheck: doing it now. sorry for abandoning you last night but glad to see you made progress in scrollback | 15:16 |
| *** ihrachys has quit IRC | 15:16 | |
| *** Ala has quit IRC | 15:17 | |
| krotscheck | fungi: No worries, I know you have a life :) | 15:17 |
| fungi | i really don't | 15:17 |
| *** timrc- has joined #openstack-infra | 15:18 | |
| krotscheck | fungi: Don't you live on an amazingly bucolic island? | 15:18 |
| *** dramalho has quit IRC | 15:18 | |
| krotscheck | danke! | 15:19 |
| fungi | krotscheck: yep, with wireless internet access that currently reaches the end of my dock | 15:19 |
| *** dramalho has joined #openstack-infra | 15:19 | |
| krotscheck | fungi: I'd call that a life :) | 15:19 |
| fungi | so i can sit out there, look at the water, and continue having no life | 15:19 |
| krotscheck | fungi: Though why you're not fishing _right now_ I don't know. | 15:19 |
| *** flepied has quit IRC | 15:19 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Implements: additions for OS3 plugin entry points in builders and scm https://review.openstack.org/229100 | 15:19 |
| anteaya | fungi: I like your version of no life | 15:19 |
| krotscheck | Actually, you might be. | 15:19 |
| fungi | krotscheck: i haven't constructed the line-of-sight relays i need to reach out into the sound | 15:19 |
| krotscheck | Yep. I'm with anteaya | 15:19 |
| fungi | makes it hard to openstack from the boat reliably | 15:20 |
| fungi | oh, and also, no boat yet | 15:20 |
| anteaya | so when someone emails you personally but clearly should be mailing the list (infra in this case) do you usually email back personally inviting them to email the list (with instructions) or do you reply and cc the list? | 15:20 |
| krotscheck | anteaya: Btw, do you play computer games at all? I came across one recently that I think would be right up your alley. | 15:20 |
| fungi | though i guess i could openstack and fish off the end of my dock | 15:20 |
| krotscheck | fungi: I recommend proposing a new project called OpenFish | 15:21 |
| *** sputnik13 has joined #openstack-infra | 15:21 | |
| *** sabeen has joined #openstack-infra | 15:21 | |
| anteaya | krotscheck: I have in the past, my two noteable ones were space invaders (not really computer, more arcade) and runescape which I played for about 4 or 5 years | 15:21 |
| anteaya | krotscheck: ha ha ha | 15:21 |
| krotscheck | anteaya: It's an Iñupiat folk talke converted into a game. | 15:21 |
| krotscheck | *tale | 15:22 |
| anteaya | krotscheck: wow | 15:22 |
| fungi | anteaya: it depends on the context of the e-mail. sometimes i e-mail them back with an answer and encourage them to e-mail the list with their request in teh future (briefly explaining why that's helpful), or if the request is benign enough i reply to the ml and cc the original author | 15:22 |
| anteaya | sounds worthy of a look | 15:22 |
| openstackgerrit | Lenny Verkhovsky proposed openstack/os-testr: Adding support for combining more than 1 subunit file into single html https://review.openstack.org/231439 | 15:22 |
| *** david-ly_ has joined #openstack-infra | 15:22 | |
| krotscheck | anteaya: Yeah, the "unlocks" as you proceed through the game are interviews with tribal natives about their history. it's SUPER cool. | 15:22 |
| *** bpokorny has joined #openstack-infra | 15:22 | |
| anteaya | fungi: feels benign he is just asking for a review of his patch | 15:22 |
| *** david-lyle has quit IRC | 15:23 | |
| krotscheck | anteaya: http://neveralonegame.com/ | 15:23 |
| anteaya | krotscheck: interesting | 15:23 |
| *** david-ly_ is now known as david-lyle | 15:24 | |
| anteaya | it has a few awards | 15:26 |
| fungi | anteaya: yep, that was one i would have replied to the ml with as wel | 15:26 |
| fungi | l | 15:26 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Corrected Typo in Filename https://review.openstack.org/232606 | 15:27 |
| *** asselin__ has quit IRC | 15:27 | |
| krotscheck | fungi, anteaya: Silly typo that made it through review ^^ | 15:28 |
| fungi | krotscheck: ^ once more with feeling, eh? | 15:28 |
| * krotscheck breaks out into a dance routine. | 15:28 | |
| anteaya | fungi: oh good, thank you | 15:28 |
| krotscheck | fungi: Oh believe me, I've got ALL the feelings. | 15:28 |
| *** kushal has quit IRC | 15:28 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Cap urllib3 <=1.10.4 so it's synced up with requests 2.7.0 https://review.openstack.org/213310 | 15:29 |
| mriedem | dims: flaper87: ^ updated | 15:29 |
| fungi | krotscheck: if you'll give me a heads up once that's approved and makes it onto the release server, i'll enqueue teh tag yet still again | 15:29 |
| krotscheck | fungi: Roger wilco. | 15:29 |
| krotscheck | anteaya, fungi: Much obliged for the +2A :) | 15:30 |
| anteaya | fungi: I approved it | 15:30 |
| anteaya | krotscheck: welcome | 15:30 |
| anteaya | I had context | 15:30 |
| anteaya | everything is so much easier with context | 15:30 |
| *** dizquierdo has quit IRC | 15:30 | |
| *** amotoki has joined #openstack-infra | 15:31 | |
| fungi | yeah, we use .tar.gz instead of .tgz on our tarballs, but that's an easy one to accidentally overlook in review | 15:31 |
| *** sabeen3 has joined #openstack-infra | 15:31 | |
| *** bhunter71 has joined #openstack-infra | 15:32 | |
| *** lawrancejing has quit IRC | 15:32 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for reqs job bug 1504185 https://review.openstack.org/232612 | 15:32 |
| openstack | bug 1504185 in OpenStack-Gate "gate-requirements-integration-dsvm fails to install python3-all-dev" [Undecided,New] https://launchpad.net/bugs/1504185 | 15:32 |
| *** sabeen has quit IRC | 15:32 | |
| *** doug-fis_ is now known as doug-fish | 15:33 | |
| anteaya | speaking of never alone | 15:34 |
| anteaya | I have a cluster of deer mowing my lawn | 15:34 |
| anteaya | 3 that I can see | 15:34 |
| *** yfried__ has quit IRC | 15:34 | |
| *** ParsectiX has quit IRC | 15:34 | |
| krotscheck | anteaya: Cheaper than the neighbor's kid ;) | 15:34 |
| dims | mriedem: ack | 15:35 |
| *** dramalho has quit IRC | 15:35 | |
| openstackgerrit | Merged openstack-infra/puppet-log_processor: Process ZUUL_VOTING parameter https://review.openstack.org/224172 | 15:35 |
| anteaya | krotscheck: yes, and far less noisy | 15:36 |
| *** tonytan4ever has quit IRC | 15:37 | |
| krotscheck | anteaya: Plus, free fertilizer! | 15:37 |
| anteaya | all the benefits | 15:37 |
| openstackgerrit | Merged openstack-infra/project-config: Enable constraints proposals for liberty https://review.openstack.org/231748 | 15:39 |
| *** kushal has joined #openstack-infra | 15:40 | |
| *** harlowja_at_home has joined #openstack-infra | 15:42 | |
| *** dkranz has joined #openstack-infra | 15:43 | |
| annegentle | is there anything special about a patch merging and then getting a dependent patch in? I've got https://review.openstack.org/#/c/230186/ and rebased against the dependency, but now I get back (change 226253 closed)... hm. what do I do next? | 15:45 |
| annegentle | My change depends on 226253 | 15:45 |
| *** eharney has joined #openstack-infra | 15:46 | |
| Clint | annegentle: you haven't actually rebased against the patch that went in | 15:46 |
| *** dims has quit IRC | 15:46 | |
| *** gyee has joined #openstack-infra | 15:46 | |
| openstackgerrit | Lenny Verkhovsky proposed openstack/os-testr: Adding support for combining more than 1 subunit file into single html https://review.openstack.org/231439 | 15:46 |
| Clint | annegentle: in theory the rebase button on the web page should dtrt | 15:47 |
| annegentle | Clint: ok, nice | 15:47 |
| annegentle | Clint: can I also do git rebase -i <gitlogsha>? | 15:47 |
| Clint | yep | 15:47 |
| annegentle | Clint: or is it technical master I'm rebasing against now? | 15:47 |
| annegentle | (technically) | 15:47 |
| Clint | i'd rebase against master | 15:47 |
| annegentle | Clint: check | 15:48 |
| annegentle | Clint: when I rebase at this point, do I pick both changes, or do pick/squash? | 15:49 |
| Clint | annegentle: drop the 226253 one from the list | 15:49 |
| annegentle | Clint: I think I have to squash the one that's already merged | 15:49 |
| Clint | just delete that line | 15:49 |
| annegentle | Clint: ok, or delete it? squash or delete? | 15:49 |
| annegentle | Clint: got it | 15:50 |
| *** harlowja_at_home has quit IRC | 15:50 | |
| annegentle | Clint: thanks, that was it | 15:51 |
| * Clint nods. | 15:51 | |
| *** ashleighfarnham has joined #openstack-infra | 15:52 | |
| *** fawadkhaliq has joined #openstack-infra | 15:52 | |
| *** adpaolucci has joined #openstack-infra | 15:56 | |
| *** vivekd has quit IRC | 15:57 | |
| *** dims has joined #openstack-infra | 15:57 | |
| *** dims_ has joined #openstack-infra | 15:59 | |
| *** sridhar_ram has joined #openstack-infra | 15:59 | |
| *** sergmelikyan has joined #openstack-infra | 15:59 | |
| *** timrc- has quit IRC | 16:00 | |
| openstackgerrit | Jonathan Lebon proposed openstack-infra/jenkins-job-builder: builder.py: fix potential race condition https://review.openstack.org/232626 | 16:02 |
| *** dims has quit IRC | 16:02 | |
| *** AJaeger has joined #openstack-infra | 16:02 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for reqs job bug 1504185 https://review.openstack.org/232612 | 16:04 |
| openstack | bug 1504185 in OpenStack-Gate "gate-requirements-integration-dsvm fails to install python3-all-dev" [Undecided,Confirmed] https://launchpad.net/bugs/1504185 | 16:04 |
| openstackgerrit | Brad P. Crochet proposed openstack/requirements: Add ipaddress>=1.0.14 to global-requirements.txt https://review.openstack.org/232589 | 16:04 |
| *** tsekiyama has joined #openstack-infra | 16:04 | |
| *** e0ne has quit IRC | 16:05 | |
| *** dimtruck is now known as zz_dimtruck | 16:05 | |
| *** shashank_hegde has joined #openstack-infra | 16:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Corrected Typo in Filename https://review.openstack.org/232606 | 16:05 |
| *** marzif has quit IRC | 16:08 | |
| *** marzif has joined #openstack-infra | 16:08 | |
| *** mpaolino has quit IRC | 16:09 | |
| *** hdd has joined #openstack-infra | 16:10 | |
| fungi | jeblair: because of bug 1504185 we may want to avoid aborting image updates again today | 16:11 |
| openstack | bug 1504185 in OpenStack-Gate "gate-requirements-integration-dsvm fails to install python3-all-dev" [Undecided,Confirmed] https://launchpad.net/bugs/1504185 | 16:11 |
| jeblair | fungi: thanks; shouldn't be necessary | 16:11 |
| * anteaya is afk for a bit | 16:12 | |
| *** mudassirlatif has joined #openstack-infra | 16:12 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a dashboard page for boards and worklists https://review.openstack.org/231973 | 16:13 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add buttons for creating new boards and worklists https://review.openstack.org/231972 | 16:13 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a page to view a board https://review.openstack.org/231971 | 16:13 |
| *** yfried__ has joined #openstack-infra | 16:14 | |
| *** unicell has quit IRC | 16:15 | |
| *** BharatK has quit IRC | 16:16 | |
| *** HeOS has quit IRC | 16:17 | |
| *** matrohon has quit IRC | 16:17 | |
| *** ifarkas has quit IRC | 16:18 | |
| *** amuller is now known as amuller_afk | 16:18 | |
| *** Swami has quit IRC | 16:18 | |
| *** dramalho has joined #openstack-infra | 16:18 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Standardize builders docstrings and remove '\' https://review.openstack.org/232640 | 16:19 |
| *** kfarr has quit IRC | 16:19 | |
| krotscheck | fungi: project-config has been syncted onto jenkins | 16:19 |
| *** fedexo has joined #openstack-infra | 16:20 | |
| *** rkukura has quit IRC | 16:20 | |
| *** w_ has joined #openstack-infra | 16:20 | |
| *** olaph has quit IRC | 16:21 | |
| *** EricGonczer_ has joined #openstack-infra | 16:21 | |
| zaro | morning | 16:21 |
| *** notnownikki has quit IRC | 16:22 | |
| bltavares | morning zaro (: | 16:22 |
| *** dramalho has quit IRC | 16:23 | |
| *** flepied has joined #openstack-infra | 16:24 | |
| fungi | krotscheck: zuul's dealing with an event/result queue pileup at the moment, but as soon as it works through that the jobs should run | 16:24 |
| mordred | jeblair, clarkb, fungi, Shrews: just in case you're interested - I just updated this: https://wiki.openstack.org/wiki/API_Working_Group/Current_Design/Service_Catalog with an entry for every public cloud I have an account on | 16:25 |
| krotscheck | fungi: Thanks! | 16:25 |
| clarkb | mordred you should post the double compute records from rax | 16:25 |
| *** ajmiller has joined #openstack-infra | 16:25 | |
| clarkb | mordred since that causes all the problems | 16:25 |
| *** jsavak has joined #openstack-infra | 16:25 | |
| *** jlanoux has quit IRC | 16:26 | |
| fungi | clarkb: i _think_ that's going away next week though | 16:26 |
| mordred | clarkb: I should indeed | 16:26 |
| fungi | clarkb: at least if the loud warnings in their request tracker and dashboard are to be believed, after next week there will be no more legacy non-nova instances | 16:26 |
| *** geoffarnold has joined #openstack-infra | 16:27 | |
| fungi | and so, presumably, no need for the additional compute entry | 16:27 |
| clarkb | fungi oh right its tied to legacy compute | 16:27 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a dashboard page for boards and worklists https://review.openstack.org/231973 | 16:27 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add buttons for creating new boards and worklists https://review.openstack.org/231972 | 16:27 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a page to view a board https://review.openstack.org/231971 | 16:27 |
| *** kiran-r has joined #openstack-infra | 16:27 | |
| *** w__ has joined #openstack-infra | 16:27 | |
| *** geoffarn_ has joined #openstack-infra | 16:29 | |
| *** fedexo has quit IRC | 16:29 | |
| *** dramalho has joined #openstack-infra | 16:29 | |
| *** vkmc is now known as vkmc-afk | 16:29 | |
| *** dramalho has quit IRC | 16:30 | |
| *** w_ has quit IRC | 16:31 | |
| anteaya | took an ill neighbour a gift to find her in distress, just came home to get some things, can't leave her like this, no idea when I will be back, healing prayers and wishes welcome, thank you | 16:31 |
| clarkb | mordred I wait for the day where the catalog is not needed because https://cloud.foo.org/identity/ and image/ and compute/ are all you need to know | 16:32 |
| *** geoffarnold has quit IRC | 16:32 | |
| openstackgerrit | Merged openstack/diskimage-builder: Avoid transcending /proc with find https://review.openstack.org/230448 | 16:32 |
| *** jsavak has quit IRC | 16:35 | |
| *** gangil has joined #openstack-infra | 16:35 | |
| sdague | clarkb: that assumes you only have one region and nothing is federated, right? | 16:35 |
| mordred | yah. that's what I was just about to say | 16:35 |
| pleia2 | anteaya: good luck | 16:35 |
| *** jsavak has joined #openstack-infra | 16:35 | |
| mordred | the catalog still provides infos | 16:35 |
| gangil | can someone +2 this https://review.openstack.org/#/c/226598 | 16:36 |
| pleia2 | I came in from a CoffeeOps gathering, it's weird to do techie events in the morning pre-work | 16:36 |
| clarkb | sdague mordrd regiom should be a param to that | 16:36 |
| pleia2 | +just | 16:36 |
| alivigni | zaro# one more +2 and I think it gets submitted right | 16:36 |
| sdague | clarkb: how do you know which regions exist? | 16:36 |
| sdague | there is still a discovery bit | 16:36 |
| anteaya | pleia2: thank you | 16:36 |
| clarkb | sdague you could ask for that but you dont need a giant catalog thing that doesnt actually give you info | 16:36 |
| clarkb | sdague the problem is today I have to set everything anyways | 16:37 |
| sdague | clarkb: right, which we're trying to standardize so you don't | 16:37 |
| clarkb | region, catalog entry name, version, endpoint | 16:37 |
| sdague | what exists today is terribad | 16:38 |
| clarkb | ok so my idea is based on catalog noy being useful | 16:38 |
| clarkb | if we make it useful then its less of aproblem | 16:38 |
| *** jistr has quit IRC | 16:38 | |
| sdague | right, that's the goal, and to put it on a path that we can incrementally add usefullness / ease of use in a versioned way down the road | 16:38 |
| clarkb | sdague and standardization isnt all that is needed | 16:38 |
| clarkb | we need a way to handle api versions and mulyiple entries of overlapping endpoints | 16:39 |
| sdague | clarkb: yep... you've seen our giant etherpad right :) | 16:39 |
| *** ociuhandu has quit IRC | 16:39 | |
| clarkb | no | 16:39 |
| sdague | this is going to be a process | 16:39 |
| sdague | and I need to update the spec with latest notes and feedback | 16:39 |
| *** EricGonczer_ has quit IRC | 16:40 | |
| fungi | krotscheck: yay? http://logs.openstack.org/35/35393b1fa54188d54d3d8a5956b49b40df1aa281/release/eslint-config-openstack-npm-upload/48b8515/console.html | 16:41 |
| *** jsavak has quit IRC | 16:41 | |
| krotscheck | fungi: https://www.npmjs.com/package/eslint-config-openstack | 16:41 |
| fungi | yay indeed! | 16:41 |
| krotscheck | fungi: WOOOO! | 16:41 |
| fungi | now you can go wild releasing all the (npm) things! | 16:42 |
| krotscheck | fungi: Next up: npm-publish-to-xstatic! | 16:42 |
| krotscheck | Wait. | 16:42 |
| krotscheck | No, bad | 16:42 |
| krotscheck | fungi, anteaya, clarkb: Thanks for all your help over the last couple of days! | 16:42 |
| *** alexsyip has joined #openstack-infra | 16:43 | |
| fungi | krotscheck: thinking of how this might relate to http://specs.openstack.org/openstack-infra/infra-specs/specs/artifact-signing.html does npm support uploading/publishing detached signatures of releases too? | 16:44 |
| clarkb | sdague though I do wonder if we need to reapproach the problem from the perspective of the user rather than trying to hammer what we have into shape | 16:44 |
| zaro | alivigni: i think pelix may be waiting for you to push up your ffollow on patch | 16:44 |
| *** yamamoto has quit IRC | 16:44 | |
| sdague | clarkb: if you would like to take this over, be my guess. :) | 16:45 |
| sdague | guest | 16:45 |
| alivigni | zaro# he already did a +2 so I assumed it could go in | 16:45 |
| sdague | I've been kind of puttering through exactly that for the last few months | 16:45 |
| clarkb | no not trying to derail any current work. fixing catalog is good regardless | 16:45 |
| alivigni | zaro# also I assume I can do this on the same topic branch as a new commit | 16:45 |
| *** sergmelikyan has quit IRC | 16:46 | |
| zaro | pelix: yes, you can do it now. no need to wait | 16:46 |
| zaro | opps, that was for you alivigni ^ | 16:46 |
| zaro | pelix: any reason alivigni's change was not approved? | 16:46 |
| *** zul has quit IRC | 16:47 | |
| pelix | zaro: spotted that the commit message would be confusing outside of gerrit | 16:47 |
| pelix | you'd need the review context to make sense of it | 16:48 |
| zaro | pelix: but you gave it a +2 | 16:49 |
| pelix | there was a fix put up, and it didn't quite flow properly so I tweaked it rather than ask for another fix | 16:49 |
| pelix | zaro: so I could just +A it as well? | 16:49 |
| *** dramalho has joined #openstack-infra | 16:49 | |
| pelix | without waiting for you? | 16:49 |
| openstackgerrit | Jonathan Lebon proposed openstack-infra/jenkins-job-builder: builder.py: fix potential race condition https://review.openstack.org/232626 | 16:49 |
| zaro | i think we are talking about different things, i'm referring to https://review.openstack.org/#/c/229100/ | 16:50 |
| *** yamamoto has joined #openstack-infra | 16:50 | |
| *** yamamoto has quit IRC | 16:50 | |
| zaro | ohh opps, i didn't notice there was a new patch. | 16:50 |
| *** ayoung is now known as ayoung-afk | 16:50 | |
| pelix | that's the same one, :) | 16:50 |
| *** Swami has joined #openstack-infra | 16:50 | |
| zaro | sorry about that. alivigni approved :) | 16:51 |
| pelix | zaro: I don't mind approving without other CR's if it's something trivial like the commit message, just unsure about the etiquette | 16:51 |
| *** austin81 has joined #openstack-infra | 16:52 | |
| alivigni | zaro# pelix thanks! | 16:52 |
| *** amuller_afk is now known as amuller | 16:53 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Implements: additions for OS3 plugin entry points in builders and scm https://review.openstack.org/229100 | 16:53 |
| zaro | pelix: have you ever done any hacking on gerrit? | 16:53 |
| *** jsavak has joined #openstack-infra | 16:54 | |
| *** DericHorn-HP has quit IRC | 16:54 | |
| zaro | i've noticed you on their ML a few times. | 16:54 |
| *** vkmc-afk is now known as vkmc | 16:54 | |
| *** jcoufal has quit IRC | 16:54 | |
| asselin | hi, i'm playing around with elastic recheck but log files are empty. http://paste.openstack.org/show/475760/ | 16:55 |
| *** derekh has quit IRC | 16:55 | |
| pelix | zaro: only a few minor tweaks, I did see your email, and I'd like to help, just overloaded at the moment | 16:55 |
| *** cloudtrainme has quit IRC | 16:56 | |
| *** rkukura has joined #openstack-infra | 16:56 | |
| krotscheck | fungi: There's actually been a lot of discussion about that, with the response from npm being "As soon as it's profitable we'll so something about it" | 16:57 |
| zaro | pelix: so at least you've familiarized yourself buck :) | 16:57 |
| clarkb | krotscheck so after a prominent package gets owned without anyone notciing for weeks | 16:58 |
| krotscheck | fungi: Given that I've yet to see any package repository be a source of profit (maven, pip, etc), I translate that to "As soon as we run out of venture capital and contribute our project to the Node/Linux foundation" | 16:58 |
| *** jsavak has quit IRC | 16:58 | |
| *** zul has joined #openstack-infra | 16:58 | |
| *** jsavak has joined #openstack-infra | 16:58 | |
| krotscheck | Or what clarkb said. | 16:58 |
| pelix | that's a very strong definition of my experience with buck so far | 16:59 |
| *** ihrachys has joined #openstack-infra | 16:59 | |
| fungi | krotscheck: clarkb: heh, then i'll just ignore it for purposes of that spec implementation for the time being | 16:59 |
| *** abregman has joined #openstack-infra | 17:00 | |
| krotscheck | fungi: Support so far is restricted to signed git tags. | 17:00 |
| krotscheck | fungi: Can we at least sign our tarballs? | 17:00 |
| fungi | krotscheck: that's the plan, mostly just wondering if npm has somewhere to upload those signatures once we do. we can of course be content to host the signatures only on tarballs.o.o though until they do | 17:01 |
| *** claudiub has quit IRC | 17:02 | |
| krotscheck | dstufft has words on how effective that is. | 17:03 |
| *** cloudtrainme has joined #openstack-infra | 17:03 | |
| *** nadya has quit IRC | 17:03 | |
| dstufft | signed tarballs are pretty much only useful for like... Debian | 17:04 |
| *** trown is now known as trown|lunch | 17:04 | |
| dstufft | at least in Python :D | 17:04 |
| krotscheck | fungi: One last request. Do you think it's feasible to go in as the jenkins user for the release slave and run `npm owner remove krotscheck` so only openstackci can publish? | 17:05 |
| krotscheck | fungi: Or do we want to keep a failsafe because skynet? | 17:06 |
| fungi | krotscheck: it's likely fine as is (many of our pypi registrations have multiple owner accounts only one of which is our ci) | 17:07 |
| krotscheck | fungi: Works for me. | 17:07 |
| *** notnownikki has joined #openstack-infra | 17:09 | |
| *** mudassirlatif has quit IRC | 17:09 | |
| fungi | and yeah, the reason for uploading signatures is mostly for the benefit of downstream distro packagers who want to consume tarballs instead of git tags (that's where most of the requests have come from) | 17:09 |
| *** abitha has joined #openstack-infra | 17:09 | |
| *** jsavak has quit IRC | 17:09 | |
| *** jsavak has joined #openstack-infra | 17:10 | |
| *** kushal has quit IRC | 17:10 | |
| *** thiagop is now known as thiagop-afk | 17:11 | |
| *** mriedem has quit IRC | 17:11 | |
| *** w__ is now known as olaph | 17:11 | |
| armax | hi, question on test coverage results: I can see that coverage jobs are executed post-merge | 17:12 |
| *** afazekas_ has joined #openstack-infra | 17:12 | |
| armax | for a number of projects: how can I access easily the coverage results? | 17:12 |
| *** tsekiyama has quit IRC | 17:12 | |
| armax | when I look here: https://jenkins.openstack.org/view/All/job/neutron-coverage/ | 17:13 |
| armax | I don’t see much going on | 17:13 |
| clarkb | armax http://logs.openstack.org/first2ofsha1/sha1 except we just reverted the change to make that work well due to other problems | 17:13 |
| *** _david_ has joined #openstack-infra | 17:13 | |
| * armax looks | 17:13 | |
| armax | thanks clarkb | 17:13 |
| clarkb | I will have to keep working on the fixes today | 17:13 |
| armax | I was aware of that trick | 17:13 |
| armax | it’s that the only one? | 17:14 |
| *** dtantsur is now known as dtantsur|afk | 17:14 | |
| clarkb | there is another coverage aggregator thing that showed up recently buy I forget where it is | 17:14 |
| clarkb | let me dig | 17:14 |
| armax | clarkb: right, I was wondering if there was a landing page of some sort | 17:14 |
| *** dims has joined #openstack-infra | 17:15 | |
| clarkb | there is one but I dont have the url handy | 17:15 |
| *** bharathm has joined #openstack-infra | 17:15 | |
| armax | clarkb: ok don’t worry | 17:15 |
| armax | clarkb: I am satisfied there is one :) | 17:15 |
| clarkb | rbradfor: ^ | 17:15 |
| armax | clarkb: I’ll keep on poking and if I find the answer I’ll let you know | 17:16 |
| rbradfor | clarkb, https://review.openstack.org/#/c/221494/ prototype at http://demo.ronaldbradford.com/cover/ | 17:16 |
| *** _david_ has quit IRC | 17:16 | |
| openstackgerrit | Dan Smith proposed openstack-infra/project-config: Add oslo.versionedobjects src job to nova experimental https://review.openstack.org/232672 | 17:16 |
| rbradfor | armax, ^^ | 17:17 |
| * armax looks | 17:17 | |
| *** kushal has joined #openstack-infra | 17:17 | |
| dansmith | clarkb (or someone else): How hard would it be to let us do "recheck experimental $job" to only run that one job from the experimental group? | 17:17 |
| armax | rbradfor: that’s exactly what I was looking for | 17:17 |
| armax | rbradfor: super | 17:18 |
| *** dims has quit IRC | 17:18 | |
| rbradfor | armax, Would appreciate a +1 on spec so we can get this moving! | 17:18 |
| clarkb | dansmith it would be a fairly large change to how zuul prpcesses comments | 17:18 |
| armax | rbradfor: totally | 17:18 |
| dansmith | clarkb: okay, bummer | 17:18 |
| armax | rbradfor: where do you envision this be made available on? | 17:18 |
| armax | like on http://status.openstack.org/ ? | 17:19 |
| *** dims_ has quit IRC | 17:19 | |
| rbradfor | armax, I include both "check" and "post" gates to get more projects listed. Adding this to zuul would be nice, but it has an impact for projects when job takes a long time to run. | 17:19 |
| *** shashank_hegde has quit IRC | 17:19 | |
| clarkb | dansmith right now its match string per pipeline (check/gate/experimental) and trigger jobs belonging to the pipeline | 17:19 |
| *** fawadkhaliq has quit IRC | 17:19 | |
| dansmith | clarkb: okay | 17:19 |
| rbradfor | armax, at the discression of infra team, honestly, it can sit at logs.openstack.org/cover for example. | 17:19 |
| gangil | I was wondering how does CI test patches which are dependent on other patches still in review? For ex: if A is dependent on B, (A -> B) if I just go git fetch A and git cherry-pick FETCH_HEAD it would fail since B is not in my local repo. Does gerrit have any call which fetches dependent commit(s) as well while testing A in this case? | 17:20 |
| *** achanda has joined #openstack-infra | 17:20 | |
| *** mriedem has joined #openstack-infra | 17:20 | |
| armax | rbradfor: ok, sounds good I’ll watch this one, I am very interested in it | 17:20 |
| rbradfor | armax, me too! I'd like to get the capturing of stats for graphing of coverage over time after we get past this first step. | 17:21 |
| fungi | rbradfor: armax: yeah, i envision it as a "smart" index to the coverage results really, so hosting it on logs.o.o makes sense to me anyway | 17:21 |
| rbradfor | fungi: I'd appreciate any feedback on https://review.openstack.org/#/c/221494/ given there is a peek in interest. | 17:22 |
| armax | fungi: logs.openstack.org has no user friendly home page | 17:22 |
| fungi | armax: agreed | 17:22 |
| armax | fungi: but I would imagine it wouldn’t be hard to make one | 17:22 |
| JayF | win 26 | 17:23 |
| JayF | whoops, sorry | 17:23 |
| rbradfor | I just need a directory, it has a static index file, and a json file that is pushed from the batch process. | 17:23 |
| armax | fungi: btw, I noticed the test results in html are not rendering well anymore | 17:23 |
| armax | fungi: I am sure you guys are aware? | 17:23 |
| *** yamahata has quit IRC | 17:23 | |
| rbradfor | armax, I raised this some weeks ago, since coverage 4.0 was launched. | 17:23 |
| fungi | armax: that should be fixed nowish? clarkb reverted the recent change that had that side effect | 17:24 |
| clarkb | gangil no gerrit doesnt have that, we use zuul to configure the refs properly | 17:24 |
| armax | fungi: let me check, I haven’t seen during the last couple of hours | 17:24 |
| *** yamahata has joined #openstack-infra | 17:24 | |
| rbradfor | armax, actually, it's a lot better now, at least it's viewable. | 17:24 |
| clarkb | rbradfor two separate issues :/ | 17:24 |
| *** tonytan4ever has joined #openstack-infra | 17:24 | |
| clarkb | the coverage4.0 one is still fixed | 17:24 |
| clarkb | the testr results html isnt | 17:25 |
| fungi | armax: yeah when we tried switching to putting all downloads through os-loganalyze this week we discovered that at least the testr results files were not getting correctly detected by it as html and got served as text instead | 17:25 |
| *** dramalho has quit IRC | 17:25 | |
| armax | fungi: ya, looks good now | 17:25 |
| armax | fungi: thanks | 17:25 |
| rbradfor | clarkb, is something purposefully adding </span><span class='NONE' to each line. Happy to look if you can point to any post-processing step that is doing this. | 17:25 |
| *** ybathia has joined #openstack-infra | 17:26 | |
| armax | fungi: I imagined there was something like this going on | 17:26 |
| clarkb | rbradfor yes os-loganalyze does. if it recognizes the log format it does timestamp linking and color coding and filtering | 17:26 |
| *** dramalho has joined #openstack-infra | 17:27 | |
| fungi | rbradfor: the post-processing is actually happening on-the-fly when the request hits the server | 17:27 |
| clarkb | rbradfor if you eant the original text remove html from the acceptible result types or there is aparam ypu can pass | 17:27 |
| fungi | as an inline filter | 17:27 |
| *** shashank_hegde has joined #openstack-infra | 17:28 | |
| clarkb | it is this same thing that breaks html rendering for results because it wraps it in <pre> tags when it doesnt realize its hl that should be passed straight through | 17:28 |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder: Made a common helper function - convert_mapping_to_xml https://review.openstack.org/232679 | 17:29 |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder: Made a common helper function - convert_mapping_to_xml https://review.openstack.org/232680 | 17:29 |
| clarkb | really we need smarter pass through rules I will look at that today | 17:30 |
| *** geoffarn_ is now known as geoffarnoldX | 17:31 | |
| clarkb | and we need file sizes and timestamps in the indexes | 17:31 |
| clarkb | changes are up for the file sizes | 17:31 |
| *** baoli has quit IRC | 17:32 | |
| alivigni | zaro# I don;t know what happened but apparently I created two changes with all the annoying rebasing https://review.openstack.org/232679, https://review.openstack.org/2326780 | 17:32 |
| *** baoli has joined #openstack-infra | 17:34 | |
| clarkb | fungi: checkout the motd on static | 17:35 |
| fungi | clarkb: craziness | 17:35 |
| *** marzif has quit IRC | 17:35 | |
| fungi | clarkb: something tells me unattended-upgrades went a little crazy | 17:36 |
| *** ihrachys has quit IRC | 17:36 | |
| mordred | 0 updates are security updates. | 17:36 |
| mordred | 0 updates are security updates. | 17:36 |
| mordred | 0 updates are security updates. | 17:36 |
| mordred | it's important | 17:36 |
| mordred | 0 updates are security updates. | 17:36 |
| mordred | guys. guys. GUYS. 0 updates are security updates. | 17:37 |
| fungi | noted | 17:37 |
| *** markus_z has quit IRC | 17:39 | |
| *** abregman has quit IRC | 17:39 | |
| *** asmigala has quit IRC | 17:39 | |
| yolanda | fungi, jeblair, could you have some eyes on https://review.openstack.org/#/c/189762/ ? that's for nodepool secure.conf change | 17:39 |
| *** ivar-lazzaro has joined #openstack-infra | 17:40 | |
| yolanda | i'd like to land it as soon as possible, as it blocks some work on openstack ci, and downstream.... | 17:40 |
| *** geoffarnoldX is now known as geoffarn_ | 17:40 | |
| *** e0ne has joined #openstack-infra | 17:40 | |
| asselin | fungi, jeblair after that patch lands, we can work on moving nodepool.yaml.erb from system-config to nodepool.yaml in project-config. Tasty carrot, right? :) | 17:41 |
| *** dramalho has quit IRC | 17:41 | |
| AJaeger | fungi, https://review.openstack.org/#/c/229730/5 - diskimage-builder element lint cleanup looks fine to me now. Do you want to review it as well? | 17:41 |
| fungi | clarkb: oh, that reminds me, i can do a puppet change to swap in the new sni/san cert for static.o.o i added to hiera last week | 17:41 |
| jeblair | yolanda: yep. fungi has requested that we let the image builds complete today before restarting nodepool | 17:41 |
| *** ivar-lazzaro has quit IRC | 17:41 | |
| *** ashleighfarnham has quit IRC | 17:41 | |
| *** ivar-laz_ has joined #openstack-infra | 17:41 | |
| jeblair | yolanda: we can land that change, we just need to make sure not to restart until they have updated | 17:41 |
| AJaeger | fungi: you had some comments previously on it and I think they are addressed | 17:41 |
| *** ihrachys has joined #openstack-infra | 17:41 | |
| yolanda | jeblair, if you have a +2, i can land tomorrow morning if you prefer | 17:41 |
| *** ivar-laz_ has quit IRC | 17:42 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-openstackci: Match file conditions to apache rewrite rules https://review.openstack.org/232687 | 17:42 |
| *** ivar-lazzaro has joined #openstack-infra | 17:42 | |
| clarkb | rbradfor: fungi armax ^ thats the partial fix for when we want os-loganalyze to do index generation again | 17:43 |
| jeblair | yolanda: my guess is that they will be finished in about 1-2 hours, so we can do it then, or you could do it before ... 14:00, i think? | 17:43 |
| clarkb | now to write the change to add timestamps | 17:43 |
| fungi | AJaeger: ianw: yep, i like where 229730 is going now | 17:43 |
| * armax looks | 17:43 | |
| jeblair | yolanda: yes, 1400 is when they start | 17:43 |
| *** yfried__ is now known as yfried|afk | 17:43 | |
| yolanda | jeblair, if you have a chance today please do it, or if not, i can do it tomorrow morning for sure | 17:43 |
| jeblair | yolanda: ok. will let you know if it happens. | 17:44 |
| fungi | (well, 14:14 actually) | 17:44 |
| rbradfor | clarkb, thanks, that would make life my easier using commit log rather then zuul status. | 17:44 |
| AJaeger | fungi: glad to hear, is it time to +2A - or do you want to schedule it for later? | 17:44 |
| yolanda | thanks! | 17:44 |
| fungi | AJaeger: i'm still skimming | 17:44 |
| AJaeger | fungi: sorry, didn't want to rush you ;) | 17:44 |
| clarkb | rbradfor: ya the indexing is very close, it was mostly working yesterday :) just a few minor details need addressing | 17:44 |
| *** dramalho has joined #openstack-infra | 17:44 | |
| rbradfor | clarkb, that's great work. | 17:45 |
| *** yfried|afk is now known as yfried__ | 17:45 | |
| rbradfor | clarkb, does this mean only for logs going forward, or will there be any reprocessing of historical directories. | 17:45 |
| jeblair | yolanda: +3 | 17:45 |
| clarkb | rbradfor: it will be for all the logs, since its generated on the fly we don't need to reprocess either | 17:46 |
| yolanda | thx, it is a need for testing here, without hardcoded jenkins masters.. so it will be very helpful | 17:46 |
| *** sergmelikyan has joined #openstack-infra | 17:46 | |
| clarkb | its possible we will want to get smart about caching the index files too since they don't really change much | 17:46 |
| *** SumitNaiksatam has joined #openstack-infra | 17:47 | |
| *** pvaneck has joined #openstack-infra | 17:47 | |
| *** dramalho has quit IRC | 17:48 | |
| *** trown|lunch is now known as trown | 17:48 | |
| *** skylerberg has joined #openstack-infra | 17:48 | |
| *** EricGonczer_ has joined #openstack-infra | 17:48 | |
| *** fawadkhaliq has joined #openstack-infra | 17:48 | |
| asselin | jeblair, thanks, that unblocks a lot of patches! I'll start them up again. | 17:48 |
| *** yamamoto has joined #openstack-infra | 17:51 | |
| openstackgerrit | Merged openstack-infra/nodepool: Update nodepool to use secure.conf file https://review.openstack.org/189762 | 17:51 |
| *** Daisy has quit IRC | 17:52 | |
| openstackgerrit | Merged openstack-infra/project-config: diskimage-builder element cleanups for dib-lint https://review.openstack.org/229730 | 17:52 |
| *** sergmelikyan has quit IRC | 17:52 | |
| *** dramalho has joined #openstack-infra | 17:52 | |
| *** Daisy has joined #openstack-infra | 17:52 | |
| *** jian5397 has joined #openstack-infra | 17:54 | |
| *** yamamoto has quit IRC | 17:55 | |
| *** dramalho has quit IRC | 17:56 | |
| openstackgerrit | James Slagle proposed openstack/requirements: Add ipaddress to global-requirements.txt https://review.openstack.org/232694 | 17:57 |
| *** Daisy has quit IRC | 17:58 | |
| *** Sukhdev has joined #openstack-infra | 17:58 | |
| *** jsavak has quit IRC | 17:59 | |
| *** dramalho has joined #openstack-infra | 18:01 | |
| *** dramalho has quit IRC | 18:02 | |
| dansmith | there are lots of open reviews on project-config.. if I have one I want, should I ask for review or just wait? | 18:02 |
| *** sergmelikyan has joined #openstack-infra | 18:02 | |
| *** sridhar_ram1 has joined #openstack-infra | 18:03 | |
| *** dahoo has joined #openstack-infra | 18:03 | |
| *** sridhar_ram has quit IRC | 18:04 | |
| *** ddieterly has quit IRC | 18:04 | |
| *** dramalho has joined #openstack-infra | 18:05 | |
| *** skylerberg has quit IRC | 18:05 | |
| *** yfried__ is now known as yfried|afk | 18:06 | |
| *** kiran-r has quit IRC | 18:06 | |
| fungi | dansmith: likely both? ;) | 18:06 |
| *** rossella_s has quit IRC | 18:06 | |
| dansmith | fungi: ask and wait? I can do that :) | 18:06 |
| fungi | dansmith: luckily project-config has more core reviewers than most of our repos | 18:06 |
| dansmith | cool | 18:06 |
| *** DericHorn-HP has joined #openstack-infra | 18:06 | |
| * dansmith clears his throat | 18:06 | |
| *** _david_ has joined #openstack-infra | 18:07 | |
| *** rossella_s has joined #openstack-infra | 18:07 | |
| dansmith | Hey all, this is a trivial new job add I'd like so I can test some stuff without having to trigger oslo releases: https://review.openstack.org/232672 | 18:07 |
| fungi | hard to get more trivial than a one-line change | 18:08 |
| *** dims has joined #openstack-infra | 18:09 | |
| dansmith | yeah! | 18:09 |
| AJaeger | dansmith: happy testing! | 18:10 |
| dansmith | thanks! | 18:10 |
| *** zeih has joined #openstack-infra | 18:11 | |
| *** tsekiyama has joined #openstack-infra | 18:13 | |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder: Made a common helper function - convert_mapping_to_xml https://review.openstack.org/232680 | 18:14 |
| *** ociuhandu has joined #openstack-infra | 18:15 | |
| *** ihrachys has quit IRC | 18:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Add oslo.versionedobjects src job to nova experimental https://review.openstack.org/232672 | 18:18 |
| *** tsekiyama has quit IRC | 18:18 | |
| openstackgerrit | Merged openstack-infra/project-config: Add dib-lint job for nodepool elements https://review.openstack.org/232276 | 18:19 |
| *** zz_dimtruck is now known as dimtruck | 18:20 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: VPNaaS: Template based functional jobs https://review.openstack.org/232702 | 18:24 |
| pvaneck | fungi: Hey, just an update. Did some packet analyzing on the refstack server and found that it was sometimes not getting a syn-ack back from openstackid until after eight syns were sent: http://paste.openstack.org/show/475675/ | 18:25 |
| pc_m | dougwig: armax: ^^ Given the issues with neutronclient, I'm revising the approach for the VPN functional job. Can you look at this and comment. | 18:25 |
| pvaneck | Also, noticed it was using ipv6. Not entirely sure why ipv6 was having issues, but making ipv4 take precedence over ipv6 on the server seemed to have gotten rid of all the hang ups, since now the tcp handshake uses ipv4. | 18:26 |
| openstackgerrit | Merged openstack-infra/lodgeit: Fix title on homepage https://review.openstack.org/232404 | 18:26 |
| * armax adds it to the pile | 18:26 | |
| *** amotoki has quit IRC | 18:26 | |
| fungi | pvaneck: interesting. i was only sniffing for the ipv4 address of refstack.net because you don't have an aaaa in dns for it | 18:27 |
| fungi | pvaneck: it's possible, i suppose, that we have something misconfigured for ipv6 at the openstackid.org end, i'll check that hypothesis | 18:28 |
| *** devvesa has quit IRC | 18:28 | |
| fungi | pvaneck: ultimately, it would be good to get ipv6 working because that _ought_ to be the default (use ipv6 when you can, fall back to ipv4 when you can't) | 18:28 |
| *** pelix has quit IRC | 18:28 | |
| *** spzala has quit IRC | 18:29 | |
| *** tsekiyama has joined #openstack-infra | 18:30 | |
| *** yfried|afk is now known as yfried__ | 18:30 | |
| *** tsekiyama has quit IRC | 18:30 | |
| pvaneck | fungi: heh, yeah. ipv6 did work on occassion, but couldnt find much online regarding this issue with ipv6 | 18:31 |
| *** kdas_ has joined #openstack-infra | 18:31 | |
| *** tsekiyama has joined #openstack-infra | 18:31 | |
| *** kdas_ has quit IRC | 18:32 | |
| alivigni | zaro# is this ok https://review.openstack.org/232680 | 18:33 |
| *** ddieterly has joined #openstack-infra | 18:33 | |
| _david_ | zaro, Confirmed: I'm able to reproduce pack file corruption... investigating. | 18:35 |
| *** kushal has quit IRC | 18:35 | |
| *** ildikov has quit IRC | 18:36 | |
| fungi | pvaneck: when you `ping6 openstackid.org` from refstack.net do you get any packet loss? | 18:37 |
| fungi | pvaneck: on this end it's just a bog standard linux kernel running apache, with a dual-stack configuration on eth0 | 18:38 |
| *** ZZelle_ has joined #openstack-infra | 18:38 | |
| fungi | apache is listening on :::443, and `ip6tables -L` says 443 is allowed from everywhere | 18:39 |
| pvaneck | fungi: 100% packet loss trying to ping6 openstackid.org | 18:40 |
| openstackgerrit | Merged openstack-infra/puppet-lodgeit: Let Apache know where to serve robots.txt from https://review.openstack.org/231685 | 18:41 |
| pleia2 | ^^ may break paste.o.o, I'm watching it | 18:41 |
| *** geoffarn_ is now known as geoffarnoldX | 18:41 | |
| * Clint holds breath. | 18:41 | |
| pleia2 | next puppet run in 6 minuts | 18:42 |
| pleia2 | minutes too | 18:42 |
| Clint | woot | 18:42 |
| fungi | pvaneck: in that case, can you stick a `traceroute6 openstackid.org` on http://paste.openstack.org/ and let me know the url? | 18:42 |
| *** Hal has joined #openstack-infra | 18:43 | |
| fungi | pvaneck: also `ip -6 ad sh` and `ip -6 ro sh` would help | 18:43 |
| *** doug-fish has quit IRC | 18:43 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Add Juju Charms for OpenStack https://review.openstack.org/232705 | 18:44 |
| *** e0ne has quit IRC | 18:44 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: Add Juju Charms for OpenStack https://review.openstack.org/232705 | 18:45 |
| *** skylerberg has joined #openstack-infra | 18:46 | |
| *** nadya has joined #openstack-infra | 18:48 | |
| *** sergmelikyan has quit IRC | 18:48 | |
| *** flepied1 has joined #openstack-infra | 18:49 | |
| pleia2 | Clint: we didn't break paste! | 18:49 |
| pleia2 | Clint: and http://paste.openstack.org/robots.txt | 18:49 |
| pvaneck | fungi: http://paste.openstack.org/show/475777/ | 18:49 |
| pleia2 | I'm so happy :D | 18:49 |
| *** e0ne has joined #openstack-infra | 18:49 | |
| pleia2 | Clint: nice work | 18:49 |
| *** matrohon has joined #openstack-infra | 18:49 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/os-loganalyze: Report object sizes from swift when writing index https://review.openstack.org/232195 | 18:49 |
| openstackgerrit | Clark Boylan proposed openstack-infra/os-loganalyze: Print file sizes in indexes for on disk files https://review.openstack.org/232194 | 18:49 |
| openstackgerrit | Clark Boylan proposed openstack-infra/os-loganalyze: Add mtime to generated indexes https://review.openstack.org/232708 | 18:49 |
| fungi | Clint: thanks! now to wait and see if performance improves over time | 18:49 |
| clarkb | ok that should cover all the things, though I haven't tested it beyond what the unittests do | 18:50 |
| *** ayoung-afk is now known as ayoung | 18:50 | |
| fungi | pvaneck: interesting... looks like you're getting to the penultimate hop. when i do the same i see !X responses from openstackid.org as the next and final hop | 18:51 |
| fungi | pvaneck: can you try `traceroute6 -I openstackid.org` as well? (you'll probably need to sudo it) | 18:52 |
| pvaneck | fungi: sure | 18:52 |
| fungi | pvaneck: i'm suspecting an asymmetrical routing situation with an issue on the return route | 18:52 |
| fungi | checking that hypothesis now | 18:53 |
| *** flepied has quit IRC | 18:53 | |
| *** spzala has joined #openstack-infra | 18:53 | |
| clarkb | sdague: rbradfor lifeless the stack that starts with https://review.openstack.org/#/c/232133/2 should fix the variety of problems we ran into with the os-loganalyzed indexes | 18:54 |
| clarkb | I think you were the folks that expressed interest in that | 18:54 |
| pvaneck | fungi: traceroute6 doesnt seem to like the -I option. saying it is invalid | 18:54 |
| Clint | pleia2: woot! | 18:54 |
| fungi | pvaneck: interesting. on my systems -I tells it to use icmp instead of udp | 18:54 |
| fungi | pvaneck: ahh, yep, older traceroute6 is missing that option | 18:55 |
| clarkb | fungi: traceroute6 utility, iputils-s20121221 is my version and missing it | 18:55 |
| jlvillal | How long does it take from uploading a patch with a 'Closes-Bug' line until the Launchpad bug gets updated? https://review.openstack.org/#/c/232257/ Just wondering why it isn't get updated as I thought it should. | 18:56 |
| clarkb | mtr -6 should work though | 18:56 |
| clarkb | its icmp by default -u to make it icmp | 18:56 |
| clarkb | er -u to udp | 18:56 |
| *** yfried__ is now known as yfried|afk | 18:57 | |
| lifeless | clarkb: I was complaining about the missing timestamps :) | 18:57 |
| lifeless | clarkb: I've the stack open and will see about reviews for you, fwiw, later | 18:57 |
| *** yfried|afk is now known as yfried__ | 18:57 | |
| clarkb | lifeless: thanks the last change in the stack adds timestamps if you want to skip to that one | 18:58 |
| fungi | clarkb: oho! my traceroute6 executable is, in a round-about way, a symlink to /usr/bin/traceroute.db provided by the traceroute package | 18:58 |
| clarkb | jlvillal: if you don't put the bug info on the first patchset we don't update the bug until merging. This is to avoid spamming lp | 18:58 |
| *** sergmelikyan has joined #openstack-infra | 18:58 | |
| jlvillal | clarkb: Ah! Thanks | 18:58 |
| clarkb | jlvillal: that appears to be what happeend on that change. When the fix merges it should update | 18:58 |
| *** jian5397 has quit IRC | 18:58 | |
| jlvillal | clarkb: Yes that is what happened. | 18:59 |
| *** abregman has joined #openstack-infra | 18:59 | |
| jlvillal | dprince: You might be interested in: https://review.openstack.org/232257 | 18:59 |
| *** zeih has quit IRC | 18:59 | |
| dprince | jlvillal: nice, thanks for working on this | 19:01 |
| jlvillal | dprince: It was fun, if frustrating at times... ;) | 19:01 |
| *** sridhar_ram1 has quit IRC | 19:01 | |
| *** wenlock has quit IRC | 19:02 | |
| dprince | jlvillal: would be nice to get this into IPA too | 19:02 |
| dprince | jlvillal: hit some issues there as well | 19:02 |
| *** annegentle has quit IRC | 19:02 | |
| jlvillal | dprince: Okay. I'll put it on my TODO list :) | 19:03 |
| *** sambetts has quit IRC | 19:04 | |
| *** sridhar_ram has joined #openstack-infra | 19:04 | |
| *** DericHorn-HP has quit IRC | 19:04 | |
| *** dramalho has quit IRC | 19:04 | |
| *** jian5397 has joined #openstack-infra | 19:04 | |
| dprince | jlvillal: probably wise to vet the patch in ironic first, then go for IPA... so no rush | 19:05 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman https://review.openstack.org/195175 | 19:05 |
| *** bltavares has quit IRC | 19:05 | |
| *** ZZelle_ has quit IRC | 19:06 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman https://review.openstack.org/197722 | 19:06 |
| *** sambetts has joined #openstack-infra | 19:06 | |
| *** ZZelle_ has joined #openstack-infra | 19:06 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Add dib deletion test https://review.openstack.org/215275 | 19:06 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman https://review.openstack.org/198114 | 19:06 |
| *** abregman has quit IRC | 19:08 | |
| *** bharathm has quit IRC | 19:08 | |
| *** unicell has joined #openstack-infra | 19:10 | |
| *** dramalho has joined #openstack-infra | 19:11 | |
| *** AJaeger has quit IRC | 19:12 | |
| *** wenlock1 has quit IRC | 19:12 | |
| pvaneck | fungi: so it does look like there is packet loss on the way: http://paste.openstack.org/show/475779/ | 19:12 |
| jlvillal | I'm seeing some time-outs occurring on a few gate jobs recently.... http://logs.openstack.org/38/232338/1/gate/gate-ironic-python-agent-python34/88110d8/console.html & http://logs.openstack.org/04/232704/1/check/gate-nova-python34/474e56d/console.html | 19:12 |
| fungi | pvaneck: that's not unusual. it's frequently not actually packet loss, just some routers rate-limiting their icmp responses | 19:13 |
| *** bltavares has joined #openstack-infra | 19:13 | |
| fungi | pvaneck: though the fact that you got some replies back from openstackid.org when you used --tcp makes this more interesting | 19:14 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Move nodepool config loading into module https://review.openstack.org/231592 | 19:14 |
| fungi | pvaneck: i'm starting to think there's something weird going on between rackspace and dreamhost over ipv6 | 19:14 |
| *** samueldmq- has joined #openstack-infra | 19:16 | |
| _david_ | zaro, I was able to proof, that WindowCursor.inflate() was called simultaneously from two different threads. You were right! | 19:16 |
| fungi | pvaneck: fwiw, doing mtr back from the openstackid.org end i don't get past border7-bbnet2.wdc002.pnap.net (2600:c08:0:102:0:2:1:7) | 19:17 |
| *** geoffarnoldX has quit IRC | 19:17 | |
| *** dramalho has quit IRC | 19:18 | |
| fungi | pvaneck: ahh, and it is asymmetric | 19:18 |
| clarkb | oh hrm git doesn't preserve mtime | 19:18 |
| *** angdraug has quit IRC | 19:18 | |
| * clarkb will need to work on those tests then | 19:18 | |
| *** tsekiyama has quit IRC | 19:18 | |
| *** tsekiyama has joined #openstack-infra | 19:20 | |
| fungi | pvaneck: from rackspace to dreamhost i seem to be hopping through equinix, then hurricane electric, then qwest/centurylink, then internap | 19:21 |
| pvaneck | fungi: hmm | 19:24 |
| pvaneck | a more detailed report is http://paste.openstack.org/show/475784/ | 19:24 |
| fungi | pvaneck: and i can't seem to get responses past the first hop into internap | 19:24 |
| fungi | wow, who the heck is zayo.com?!? | 19:25 |
| fungi | looks like abovenet | 19:26 |
| *** tqtran_ has joined #openstack-infra | 19:26 | |
| *** mfalatic has quit IRC | 19:26 | |
| pvaneck | fungi: can make another push for infra hosting with https://review.openstack.org/#/c/231176/ merged ;) | 19:26 |
| fungi | pvaneck: yeah, this problem will entirely go away when that happens | 19:27 |
| fungi | so maybe best to chalk this up to broken ipv6 on the return route through internap and stop wasting time on it | 19:27 |
| pvaneck | +1 | 19:27 |
| *** samueldmq- has quit IRC | 19:28 | |
| fungi | pvaneck: lgtm. did the system-config change get updated to take advantage of that yet? | 19:28 |
| *** baoli has quit IRC | 19:29 | |
| fungi | pvaneck: if so, i think it's probably gtg too, i just need to create the trove db and stick the hostname/password for that in hiera | 19:29 |
| pvaneck | fungi, still need to do that | 19:29 |
| fungi | lmk, i'll get to work on the trove piece in the meantime | 19:30 |
| pvaneck | "refstack_mysql_host" is the expected key? | 19:30 |
| pvaneck | along with refstack_mysql_user and refstack_mysql_password? | 19:30 |
| *** armax has quit IRC | 19:30 | |
| fungi | pvaneck: if that's what you put in system-config's manifests/site.pp then sure. i'm flexible | 19:31 |
| pvaneck | fungi: hah okay. i'll get on that | 19:31 |
| pvaneck | thanks | 19:31 |
| fungi | pvaneck: you bet. and just so you don't think i was being picky with that request, this is to make it easier for us to replace the server without significant downtime and without having to copy database dumps around | 19:32 |
| fungi | so much better if it's implemented up front to avoid a costly migration down the road | 19:32 |
| pvaneck | fungi: sure, I understand and agree :) | 19:33 |
| openstackgerrit | James Page proposed openstack-infra/project-config: Add Juju Charms for OpenStack https://review.openstack.org/232705 | 19:33 |
| fungi | we've got just about all our mysql-using services switched over to this model now, and any that haven't yet are considered buggy | 19:34 |
| *** baoli has joined #openstack-infra | 19:34 | |
| fungi | rackspace dashboard organizational O.o of the day: why is dns grouped under networking, but databases are not grouped under storage? | 19:35 |
| mordred | fungi: because | 19:35 |
| fungi | mordred: i strongly suspect you are correct | 19:35 |
| mordred | fungi: the teams that implemented those things have managers who do not get along with each other | 19:35 |
| jeblair | clarkb, fungi, mordred: my local nodepool is getting "authentication required" errors from ovh, as is novaclient from puppetmaster | 19:35 |
| jeblair | clarkb, fungi, mordred: nodepool.o.o still seems to be puttering along... | 19:36 |
| fungi | jeblair: did they maybe shut down out account? | 19:36 |
| mordred | jeblair: I was just about to ask if you were getting that - I was trying to get a server dict from ovh and failing | 19:36 |
| fungi | er, our | 19:36 |
| fungi | mordred: same account? | 19:36 |
| mordred | jeblair: so, that is to say "I concur" | 19:36 |
| mordred | fungi: yup | 19:36 |
| jeblair | oh, actually nodepool.o.o looks like it's getting 500 errors (not mentioning authentication) | 19:37 |
| *** samueldmq- has joined #openstack-infra | 19:38 | |
| *** dprince has quit IRC | 19:38 | |
| *** SumitNaiksatam has quit IRC | 19:38 | |
| jeblair | fungi: maybe? after all, we just keep making api calls that produce servers that go into error state :) | 19:38 |
| jeblair | i'll mention this on the email thread... | 19:38 |
| *** SumitNaiksatam has joined #openstack-infra | 19:38 | |
| *** samueldmq- has quit IRC | 19:38 | |
| mordred | clouds['cloud.name'] = True | 19:39 |
| mordred | that probably is not going to set the cloud.name key in the clouds dict to true | 19:39 |
| Clint | cloudcloud | 19:39 |
| fungi | jeblair: yeah, perhaps they have decided we're conducting a denial of service attack against them ;) | 19:39 |
| jeblair | mordred: nice. | 19:39 |
| jeblair | fungi: i mean, we are. at their request :) | 19:39 |
| _david_ | zaro, Bingo: I've found the problem, and i fully understand now what going on | 19:39 |
| clarkb | _david_ woot | 19:39 |
| fungi | yo dawg, i herd you like clouds so we put a cloud in your cloud so you can cloud while you cloud? | 19:40 |
| _david_ | clarkb, Yepp, zaro did a great job, with reproducing the problem. After i was able to reproduce it, i needed around 30 min. to track it down | 19:40 |
| *** jsavak has joined #openstack-infra | 19:40 | |
| mordred | fungi: I couldn't have said it better myself | 19:40 |
| mordred | ooh! is this the gerrit jgit problem? | 19:41 |
| mordred | or a different problem? | 19:41 |
| fungi | _david_: are you saying we might eventually be able to upgrade our gerrit? ;) | 19:41 |
| mordred | this is the most exciting thing ever | 19:41 |
| * mordred hands zaro and _david_ a giant pile of fluffy bunnies who have eaten almost no meth | 19:41 | |
| _david_ | fungi, mordred from now that's only a matter of minutes, hours or days, i guess Thanks zaro !!! | 19:41 |
| *** e0ne has quit IRC | 19:42 | |
| fungi | interesting. rackspace trove now lets you choose between mysql, percona and mariadb | 19:42 |
| mtreinish | fungi: I think those were always the choices | 19:42 |
| fungi | mtreinish: oh, earlier it was just mysql (and only 5.1 at that) | 19:43 |
| fungi | pvaneck: how big do you expect the refstack database to get? | 19:43 |
| _david_ | zaro, Here is the bug in gerrit code: https://github.com/gerrit-review/gerrit/blob/master/gerrit-server/src/main/java/com/google/gerrit/server/patch/PatchListLoader.java#L226-L227 | 19:43 |
| mtreinish | fungi: I remember when we deployed the subunit2sql server we had a brief discussion about mysql vs mariadb | 19:43 |
| fungi | pvaneck: i want to make sure we size this with sufficient headroom for future growth too | 19:43 |
| fungi | mtreinish: yeah, but that was not terribly long ago | 19:44 |
| openstackgerrit | Merged openstack-infra/puppet-refstack: Add mysql_host param to refstack class https://review.openstack.org/231176 | 19:44 |
| mtreinish | heh, fair enough. It hasn't quite been a year | 19:44 |
| *** ashleighfarnham has joined #openstack-infra | 19:44 | |
| Clint | _david_: so jgit isn't buggy? | 19:45 |
| *** jsavak has quit IRC | 19:45 | |
| _david_ | Future.cancel() does *not* guarantee, that the thread was ended. That depends on many factors. So the line 227 will re-invoke the same WindowCursor inflater method for the same pack again! | 19:45 |
| *** sambetts has quit IRC | 19:46 | |
| *** nadya has quit IRC | 19:46 | |
| _david_ | Clint, that's correct. The bug is in Gerrit | 19:46 |
| Clint | cool | 19:46 |
| *** jsavak has joined #openstack-infra | 19:46 | |
| _david_ | WindowCursror is not thread safe per definition , so that's inherently wrong to use the same WindowCursor from two different threads, and that's what's happens here | 19:47 |
| *** bharathm has joined #openstack-infra | 19:47 | |
| *** hashar has joined #openstack-infra | 19:47 | |
| openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: Make gate-tempest-dsvm-networking-ovn voting https://review.openstack.org/223866 | 19:48 |
| *** tsekiyama has quit IRC | 19:48 | |
| _david_ | And here is the proof: http://paste.openstack.org/show/475785 | 19:48 |
| *** tsekiyama has joined #openstack-infra | 19:49 | |
| fungi | git diff | 19:49 |
| fungi | hah | 19:49 |
| fungi | been a while since i've done that | 19:49 |
| Clint | _david_: so are you submitting a fix? | 19:49 |
| pvaneck | fungi: hmm, well currently, the database isnt even 50Mb in size | 19:50 |
| fungi | pvaneck: i've made a 5gb database instance for now | 19:50 |
| pvaneck | fungi: plenty thanks | 19:50 |
| *** dramalho has joined #openstack-infra | 19:50 | |
| fungi | pvaneck: we can revisit resizing it later if needed | 19:50 |
| fungi | pvaneck: built and hiera keys added now | 19:51 |
| *** wenlock has joined #openstack-infra | 19:51 | |
| fungi | hopefully come time for the summit refstack.openstack.org will be able to make a big splash | 19:51 |
| pvaneck | fungi: alright, working on updating the system-config patch | 19:51 |
| *** baoli has quit IRC | 19:51 | |
| pvaneck | fungi: hopefully :) | 19:52 |
| pvaneck | fungi: foundation owns the refstack.net domain, correct? | 19:52 |
| *** baoli has joined #openstack-infra | 19:52 | |
| *** sambetts has joined #openstack-infra | 19:52 | |
| *** bltavares has quit IRC | 19:52 | |
| _david_ | Clint, I will have to think how to address it. The best way would be to fix the MeyrsDiff endless loop, to not mess around with thread interruptibility issues | 19:52 |
| fungi | pvaneck: no, looks like davidlenwell still controls that domain | 19:52 |
| *** bltavares has joined #openstack-infra | 19:53 | |
| *** baoli has quit IRC | 19:53 | |
| fungi | pvaneck: the foundation has control of refstack.ORG but it's doubtful we would use it for anything | 19:54 |
| pvaneck | ah | 19:54 |
| *** cdent has quit IRC | 19:54 | |
| *** ajmiller has quit IRC | 19:54 | |
| davidlenwell | I can transfer the .net domain anytime | 19:55 |
| fungi | we'd much prefer keeping services we manage under the openstack.org domain unless there's a very good technical reason why that shouldn't be done (for example cross-domain browser security concerns pushed us to use openstackid.org for our idp) | 19:55 |
| davidlenwell | yeah .. I think thats fine | 19:55 |
| davidlenwell | I only registered it because piston was holding the other domain hostage and not being responsive | 19:56 |
| *** pc_m has quit IRC | 19:56 | |
| openstackgerrit | Ari proposed openstack-infra/jenkins-job-builder: Made a common helper function - convert_mapping_to_xml https://review.openstack.org/232727 | 19:57 |
| *** dprince has joined #openstack-infra | 19:57 | |
| fungi | we can set up a redirect, but that gets weird for https since we'd need a cert for it (and if we put it on static.o.o with our other legacy redirects then i'll need to replace a rather costly san/sni cert there to add another domain name to the mix) | 19:57 |
| *** sergmelikyan has quit IRC | 19:58 | |
| fungi | that is, adding a san for refstack.net to the static.o.o cert | 19:58 |
| fungi | we've of course already got a valid cert issued for refstack.openstack.org | 19:58 |
| *** jian5397 has quit IRC | 19:58 | |
| *** tqtran_ is now known as tqtran | 19:58 | |
| fungi | though if we need to, it's not the end of the world. i'll just expense it | 19:59 |
| pvaneck | can just have a message on refstack.net saying "We've moved...", and just stop it from accepting anymore uploads | 20:00 |
| *** unicell has quit IRC | 20:01 | |
| fungi | pvaneck: also did you want me to import a database dump from refstack.net once you're ready to go live with refstack.openstack.org, or just start with a clean slate? | 20:01 |
| pvaneck | i'll have a sqldump ready | 20:02 |
| fungi | pvaneck: okay, sounds good. once you're ready with that let me know how i should retrieve/receive it (is there any sensitive data in it?) | 20:02 |
| *** tonytan4ever has quit IRC | 20:03 | |
| *** jsavak has quit IRC | 20:03 | |
| pvaneck | fungi: sure. file size should be relatively small, and nothing really sensitive | 20:03 |
| *** jsavak has joined #openstack-infra | 20:04 | |
| fungi | that makes it a lot easier | 20:04 |
| *** alivigni has quit IRC | 20:04 | |
| *** notnownikki has quit IRC | 20:06 | |
| *** kgiusti has left #openstack-infra | 20:07 | |
| *** burgerk has quit IRC | 20:08 | |
| *** tsekiyama has quit IRC | 20:08 | |
| *** annegentle has joined #openstack-infra | 20:09 | |
| *** tonytan4ever has joined #openstack-infra | 20:09 | |
| *** tsekiyama has joined #openstack-infra | 20:09 | |
| _david_ | zaro, Check my WindowCursor instrumentation code, only 32 lines ;-) https://git.eclipse.org/r/#/c/57583/2/org.eclipse.jgit/src/org/eclipse/jgit/internal/storage/file/WindowCursor.java | 20:10 |
| *** tsekiyama has quit IRC | 20:10 | |
| *** rlandy has quit IRC | 20:11 | |
| *** jsavak has quit IRC | 20:11 | |
| *** bswartz has quit IRC | 20:11 | |
| *** tsekiyama has joined #openstack-infra | 20:11 | |
| *** tsekiyama has quit IRC | 20:12 | |
| *** yamahata has quit IRC | 20:12 | |
| *** glauco has quit IRC | 20:13 | |
| *** tsekiyama has joined #openstack-infra | 20:14 | |
| *** Sukhdev has quit IRC | 20:14 | |
| *** tsekiyama has quit IRC | 20:15 | |
| *** yfried__ is now known as yfried|afk | 20:15 | |
| jeblair | fungi, clarkb, mordred, pleia2: has anyone walked yolanda and nibalizer through the sekrit puppetmaster stuff yet? | 20:16 |
| mordred | jeblair: I have not | 20:16 |
| *** sdake has quit IRC | 20:17 | |
| *** tsekiyama has joined #openstack-infra | 20:18 | |
| *** jian5397 has joined #openstack-infra | 20:19 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/os-loganalyze: Add mtime to generated indexes https://review.openstack.org/232708 | 20:19 |
| clarkb | jeblair: I have not | 20:19 |
| fungi | not i, do you have time to do that? | 20:19 |
| pleia2 | I haven't either | 20:20 |
| mtreinish | fungi: if you get a sec can you take a look at: https://review.openstack.org/232187 that's the fix for the expire command issue from yesterday | 20:20 |
| mtreinish | (well I think it was yesterday, it might have been earlier in the week) | 20:20 |
| *** Sukhdev has joined #openstack-infra | 20:20 | |
| jeblair | fungi: yes, though i doubt yolanda does right now, but maybe we can catch up tomorrow morning. nibalizer: we should try to sync up on that at your convenience. | 20:20 |
| *** jsavak has joined #openstack-infra | 20:20 | |
| *** dramalho has quit IRC | 20:20 | |
| *** bltavares has quit IRC | 20:21 | |
| *** adpaolucci has quit IRC | 20:21 | |
| *** MarkAtwood has joined #openstack-infra | 20:21 | |
| _david_ | Clint, zaro, clarkb, mordred I've just fixed a pack file corruption bug in gerrit, will upload the patch in a moment | 20:22 |
| *** yfried|afk is now known as yfried__ | 20:22 | |
| *** sdake has joined #openstack-infra | 20:23 | |
| *** dramalho has joined #openstack-infra | 20:23 | |
| mordred | \o/ | 20:24 |
| *** jsavak has quit IRC | 20:24 | |
| *** jsavak has joined #openstack-infra | 20:25 | |
| harlowja | something u guys might find interesting, https://gist.github.com/harlowja/baedb7e97f3e2e847737 (made from https://review.openstack.org/#/c/232729/ ) | 20:26 |
| harlowja | ^ the openstack universe! | 20:26 |
| harlowja | (in svg format, ha) | 20:26 |
| hashar | harlowja: you can try generating nice graphs with http://gephi.github.io/ (open source Java apps to deal with graphs) | 20:27 |
| *** tsekiyama has quit IRC | 20:28 | |
| harlowja | i just use http://graphviz.org/ :-P | 20:28 |
| *** tsekiyama has joined #openstack-infra | 20:28 | |
| hashar | harlowja: something I used for the Zuul doc is http://blockdiag.com/ which is pure python and has sphinx integration | 20:28 |
| hashar | not sure whether it will match your use case though | 20:29 |
| *** timrc2 has joined #openstack-infra | 20:29 | |
| hashar | one sure thing, it is a good idea! | 20:29 |
| harlowja | cool | 20:29 |
| harlowja | https://gist.github.com/harlowja/7a0f9669e86619e632c3 | 20:29 |
| harlowja | ^ infra universe | 20:29 |
| harlowja | anyway, sorta interesting | 20:29 |
| openstackgerrit | James Slagle proposed openstack/requirements: Add ipaddress to global-requirements.txt https://review.openstack.org/232694 | 20:30 |
| *** tiswanso has quit IRC | 20:30 | |
| clarkb | jhesketh: when you wake, curious what your thoughts on https://review.openstack.org/#/c/232133/2 that stack are | 20:30 |
| *** yamahata has joined #openstack-infra | 20:31 | |
| *** dkranz has quit IRC | 20:32 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: [WIP] Replace oslo_config dependency with argparse https://review.openstack.org/232741 | 20:33 |
| *** kfarr has joined #openstack-infra | 20:33 | |
| jeblair | clarkb, fungi, greghaynes: theory: dib image upload times are long because of python thread starvation | 20:33 |
| clarkb | jeblair: even though we only do one upload at a time? | 20:33 |
| jeblair | clarkb, fungi, greghaynes: they usually take hours; i uploaded images to ovh in about 20 minutes yesterday when i did them from the command line | 20:33 |
| openstackgerrit | James Slagle proposed openstack/requirements: Add ipaddress to global-requirements.txt https://review.openstack.org/232694 | 20:33 |
| clarkb | jhesketh: also https://review.openstack.org/#/c/232687/1 is related | 20:34 |
| jeblair | clarkb: yep -- we see thread starvation issues just in nodepool itself -- when it has 1k threads building nodes, the main thread goes for long periods without running | 20:34 |
| *** dprince has quit IRC | 20:34 | |
| clarkb | ifthats the case then greghaynes' gearman workers should be a priority | 20:34 |
| jeblair | clarkb: so if we've got python code actually doing network data pushes, it's probably occasionally not being scheduled | 20:35 |
| clarkb | (that said when I run rax uploads from the command line they take >1hour so it won't fix rax I don't think) | 20:35 |
| jeblair | clarkb: i think the changes already are a priority :) | 20:35 |
| *** MarkAtwo_ has joined #openstack-infra | 20:35 | |
| greghaynes | hrm. I think some tcpdumping could confirm that theory | 20:35 |
| *** dramalho has quit IRC | 20:35 | |
| *** bltavares has joined #openstack-infra | 20:35 | |
| jeblair | clarkb: (and someday we'll need horizontally scalable launchers too, but maybe that can wait for z3) | 20:35 |
| jeblair | clarkb: current rax uploads are at 1 hour 41 minutes and counting | 20:36 |
| *** burgerk has joined #openstack-infra | 20:36 | |
| jeblair | clarkb: so even your rax experience may not discredit the theory | 20:36 |
| *** tsekiyama has quit IRC | 20:36 | |
| *** tsekiyama has joined #openstack-infra | 20:37 | |
| greghaynes | Seeing if the remote end sets window size to 0 or if we just cant push data fast enough | 20:37 |
| greghaynes | er, seeing that might be useful | 20:37 |
| jeblair | greghaynes: yeah | 20:37 |
| clarkb | greghaynes: the fail in http://logs.openstack.org/75/195175/23/check/gate-nodepool-python27/9816781/console.html appears to be beacuse the image builder is failing and must go away? | 20:38 |
| *** MarkAtwood has quit IRC | 20:38 | |
| *** yamahata has quit IRC | 20:39 | |
| greghaynes | clarkb: I think stop is being called twice | 20:39 |
| greghaynes | clarkb: hunting down why now | 20:39 |
| clarkb | ah | 20:39 |
| openstackgerrit | Paul Van Eck proposed openstack-infra/system-config: Add a refstack.openstack.org server https://review.openstack.org/198869 | 20:40 |
| pvaneck | fungi ^^ | 20:41 |
| _david_ | zaro, Here is the fix: https://gerrit-review.googlesource.com/71341 | 20:41 |
| *** skylerberg has quit IRC | 20:41 | |
| clarkb | _david_: I don't really ahve a say but that seems like a really good backport candidate too | 20:41 |
| _david_ | clarkb, *lol* | 20:42 |
| clarkb | _david_: well every single gerrit out there is just waiting to get DoSed :) | 20:42 |
| clarkb | well >2.8 | 20:42 |
| sdague | clarkb: thanks, I went through the stack, looks good to me | 20:42 |
| _david_ | zaro, Can you apply that guy and confirm that it fixed the problem on gerrit-dev.o.o? | 20:42 |
| clarkb | sdague: I think we can safely merge those changes then update logs-dev vhost to test in prod as well | 20:42 |
| clarkb | sdague: once thats done I will solicit feedback from the audience | 20:43 |
| *** SumitNaiksatam has quit IRC | 20:43 | |
| sdague | clarkb: ok, I pushed +A on the first patch, but I'm the only reviewer on the rest | 20:43 |
| *** edmondsw has quit IRC | 20:43 | |
| sdague | they are pretty straight forward though | 20:43 |
| clarkb | sdague: cool, hopefully when jhesketh wakes he can get through the others | 20:43 |
| nibalizer | jeblair: today and tomorrow are not great for that because I am at puppetconf | 20:43 |
| nibalizer | but I want to be trained | 20:44 |
| _david_ | clarkb, DoSed? | 20:44 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Use SNI/SAN on static.openstack.org https://review.openstack.org/232748 | 20:44 |
| openstackgerrit | Merged openstack-infra/os-loganalyze: Dedup index entries https://review.openstack.org/232133 | 20:45 |
| greghaynes | clarkb: Yea, that is definitely what is going on, no idea what merged to cause that | 20:45 |
| *** MarkAtwo_ has quit IRC | 20:45 | |
| *** timrc2 has quit IRC | 20:45 | |
| zaro | _david_: looking | 20:45 |
| clarkb | _david_: Denial of Service. if you push a sufficiently hard to diff patch it will cause gerrit to trip over that and invalidate the pack file. Then that project is no longer useable until the next gerrit restart | 20:45 |
| mordred | jeblair: I have received our shiny new cloud from bluebox | 20:46 |
| mordred | clarkb, fungi, pleia2, nibalizer, SergeyLukjanov, yolanda, jhesketh: ^^ | 20:46 |
| *** timrc1 has joined #openstack-infra | 20:46 | |
| fungi | i for one welcome our new blue-tinted overlords | 20:46 |
| *** glauco has joined #openstack-infra | 20:46 | |
| clarkb | mordred: so we need another floating ip detection patch? :P Cool | 20:46 |
| pleia2 | neat | 20:46 |
| clarkb | mordred: please tell me it doesn't use another image format | 20:46 |
| greghaynes | mordred: ! | 20:47 |
| fungi | clarkb: gif. they only support gif | 20:47 |
| clarkb | fungi: not the new png? | 20:47 |
| * fungi challenges you to pronunciate it correctly | 20:47 | |
| *** yamahata has joined #openstack-infra | 20:47 | |
| zaro | _david_: that seems similar to my proposed jgit fix? | 20:47 |
| mordred | clarkb: nope. | 20:48 |
| clarkb | mordred: yay! qcow2? | 20:48 |
| zaro | _david_: will give it a try | 20:48 |
| timrc1 | I do not MacOSX so good. Need to do something about this. | 20:49 |
| mordred | clarkb: yup | 20:49 |
| _david_ | Zara, Yep, but done in Gerrit, either way it's fixed | 20:49 |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: [WIP] Replace oslo_config dependency with argparse https://review.openstack.org/232741 | 20:49 |
| _david_ | Zara, I meant zaro sorry | 20:49 |
| fungi | pvaneck: i'm taking 198869 for a spin with a puppet dev env now | 20:49 |
| pabelanger | removing oslo_config from grafyaml took longer then expected. | 20:49 |
| clarkb | timrc1: there is a solution to this problem | 20:49 |
| pabelanger | timrc1: hammer? | 20:50 |
| *** MarkAtwood has joined #openstack-infra | 20:50 | |
| clarkb | timrc1: sudo dd if=/tmp/$linuxdistro.img of=/dev/sda | 20:50 |
| clarkb | or whatever OSX refers to its disks as | 20:50 |
| fungi | timrc1: you should use the new version of mac os x. it's called linux (or freebsd, or...) | 20:50 |
| timrc1 | fungi: Oh tell me more! | 20:50 |
| timrc1 | Could have been worse. I could have been given a Thinkpad with pre-install Windows. | 20:51 |
| mordred | clarkb: I'm sure it's /device/bouncyball/lookasqurrel\open apple/7 | 20:51 |
| timrc1 | mordred: lol | 20:51 |
| mordred | timrc1: why do you not have a thinkpad with linux on it? | 20:51 |
| timrc1 | mordred: I guess Macbooks with IBM's suite of Lotus-awesomesauce is standard issue? | 20:52 |
| timrc1 | At least at Bluebox. | 20:52 |
| *** jsavak has quit IRC | 20:52 | |
| *** jsavak has joined #openstack-infra | 20:53 | |
| fungi | pvaneck: got a ram sizing estimate for refstack.o.o? 2gb? 4gb? | 20:53 |
| greghaynes | clarkb: so looks like what changed is that nodepool.stop is now called twice during tests. Added some defensiveness in builder code so its not a problem, but yea... | 20:54 |
| *** regXboi has quit IRC | 20:54 | |
| fungi | i'm dry running it with 2gb | 20:54 |
| *** jsavak has quit IRC | 20:54 | |
| clarkb | greghaynes: thats ... odd | 20:55 |
| *** jsavak has joined #openstack-infra | 20:55 | |
| *** Daisy has joined #openstack-infra | 20:55 | |
| asselin | jeblair, has nodepool been restarted? looking for status good/bad? | 20:55 |
| greghaynes | clarkb: yea, its not obvious why. looks like the useNodepool method got moved up the inheritence tree, but that shouldnt be an issue. | 20:55 |
| clarkb | greghaynes: there are two add cleanups for it | 20:55 |
| clarkb | greghaynes: let me dig a bit more I can probably fix | 20:55 |
| clarkb | greghaynes: its just in that one test | 20:56 |
| clarkb | greghaynes: patch in a moment | 20:56 |
| greghaynes | oh | 20:56 |
| nibalizer | mordred: oh nice | 20:56 |
| greghaynes | clarkb: is it my code? if so I have outstanding stuffs | 20:57 |
| greghaynes | oh derp, I see | 20:57 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Stop nodepool once in tests https://review.openstack.org/232751 | 20:57 |
| greghaynes | sweet, easy enough | 20:58 |
| *** thorst has quit IRC | 20:58 | |
| *** MarkAtwood has quit IRC | 20:58 | |
| *** ig0r_ has joined #openstack-infra | 20:58 | |
| *** Daisy has quit IRC | 20:59 | |
| pvaneck | fungi: sorry, was afk, but yet 2gb is what we currently use and we've had no issues with memory | 20:59 |
| *** skylerberg has joined #openstack-infra | 21:00 | |
| *** ildikov has joined #openstack-infra | 21:00 | |
| *** kfarr has quit IRC | 21:00 | |
| jeblair | asselin: not yet, still waiting on image uploads (that's what prompted the conversation around 20:33) | 21:01 |
| jeblair | nibalizer: cool, ping me (or one of the others) whenever you're ready | 21:01 |
| jeblair | mordred: we are awash in clouds! | 21:01 |
| *** dramalho has joined #openstack-infra | 21:01 | |
| *** spzala has quit IRC | 21:02 | |
| fungi | pvaneck: applied with no errors, ip addresses are 2001:4800:7817:104:be76:4eff:fe05:5588 23.253.253.87 | 21:03 |
| *** ig0r_ has quit IRC | 21:03 | |
| jeblair | mordred: do you want me to drive adding bluebox to nodepool too? | 21:04 |
| *** Hal has quit IRC | 21:04 | |
| *** ig0r_ has joined #openstack-infra | 21:05 | |
| Clint | _david_: \o/ | 21:05 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman https://review.openstack.org/195175 | 21:05 |
| *** trown is now known as trown|outttypeww | 21:05 | |
| _david_ | Clint, The fix was already +1 by one of maintainers ,-) | 21:05 |
| mordred | jeblair: eventually | 21:05 |
| mordred | jeblair: right now I'm still poking at it | 21:06 |
| fungi | i've not been paying close attention to scrollback... looks like we've somehow merged a change to the nodepool config which the validation job dislikes? http://logs.openstack.org/69/198869/10/check/gate-system-config-nodepool/1b80dd9/console.html | 21:06 |
| *** rfolco has quit IRC | 21:06 | |
| jeblair | mordred: ack; let me know -- i think that this will parallelize well | 21:06 |
| fungi | something to do with the jenkins api key | 21:07 |
| jeblair | mordred: because everything i do takes 4 hours, but doing it twice will still take 4 hours | 21:07 |
| jeblair | fungi: yeah, we merged the secure.conf change | 21:07 |
| fungi | oh | 21:07 |
| jeblair | fungi: i grok the change, i can chase that down. | 21:07 |
| fungi | thanks! | 21:07 |
| *** HeOS has joined #openstack-infra | 21:07 | |
| zaro | _david_: still testing, but not looking good so far | 21:07 |
| _david_ | zaro, ;-( | 21:08 |
| jeblair | fungi, clarkb: i think we were over-zealous with validation -- it would have been okay to leave those config bits in there. | 21:08 |
| *** Sukhdev has quit IRC | 21:09 | |
| *** aysyd has quit IRC | 21:09 | |
| zaro | _david_: cherry picked your single change onto my previous build and was able to repro. | 21:09 |
| *** jsavak has quit IRC | 21:09 | |
| jeblair | fungi, clarkb: our choices are: temporarily loosen validation in nodepool, or remove those bits from our config. if we do the second, and we decide to revert the secure.conf change, we'll need to revert system-config first. which we might have to do manually. | 21:09 |
| zaro | _david_: now trying checkout from your branch to see if that repos. | 21:10 |
| *** jian5397 has quit IRC | 21:10 | |
| *** ig0r_ has quit IRC | 21:10 | |
| clarkb | jeblair: seems like easiest thing to do is allow the config to exist as is for a bit | 21:10 |
| jeblair | clarkb: i lean that way | 21:10 |
| zaro | _david_: i was able to replicate the entire review-dev.o.o on my local machine so i'm testing there. | 21:10 |
| zaro | _david_: testing with master, so yeah i upgraded review-dev locally | 21:11 |
| fungi | jeblair: clarkb: pro option #1 as well | 21:11 |
| *** julim has quit IRC | 21:11 | |
| fungi | we may not be the only nodepool users validating our configuration, after all | 21:12 |
| _david_ | zaro, i can only repeat: that patch fixed it for me, with your reproducer. | 21:12 |
| _david_ | zaro, 720 o.o log html files. | 21:12 |
| *** tsekiyama has quit IRC | 21:14 | |
| zaro | _david_: so you were able to repro with that data? | 21:14 |
| _david_ | zaro, Sure, that why i was able to track it down. | 21:15 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman https://review.openstack.org/195175 | 21:15 |
| _david_ | zaro, With ,my patch applied i'm not able t reproduce it any more. (timeout= 5ms) | 21:15 |
| zaro | _david_: do you know why your initial data did not repro that? | 21:15 |
| *** tsekiyama has joined #openstack-infra | 21:15 | |
| _david_ | zaro, yes | 21:16 |
| zaro | _david_: ok, i made a mistake while applying the new war. trying again.. | 21:16 |
| _david_ | zaro, the size of the pack wasn't big enough | 21:16 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Permit obsolete jenkins/mysql options in config https://review.openstack.org/232759 | 21:16 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Revert "Permit obsolete jenkins/mysql options in config" https://review.openstack.org/232760 | 21:16 |
| jeblair | clarkb, fungi: ^ instapprove the first and i'll wip the second should fix the prob | 21:16 |
| *** f1ller is now known as filler | 21:16 | |
| _david_ | zaro, I'm very confident, that this patch fixes the problem. | 21:16 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman https://review.openstack.org/197722 | 21:17 |
| clarkb | jeblair: +2 I will let fungi take a look too | 21:17 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Add dib deletion test https://review.openstack.org/215275 | 21:17 |
| fungi | yep, reviewing now | 21:17 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman https://review.openstack.org/198114 | 21:17 |
| _david_ | zaro, it's late here, please, let me know what your results are, or vote on the change. Thank you again for the reproducer, the most hard part in fixing a bug, it's create a repro. You are the hero here. | 21:18 |
| *** _david_ has quit IRC | 21:18 | |
| *** nikhil has joined #openstack-infra | 21:18 | |
| zaro | clarkb: just verified, it works, _david_ fixed! | 21:19 |
| *** ldnunes has quit IRC | 21:20 | |
| fungi | zaro: right on! let's plan for a gerrit upgrade very soon after the summit | 21:21 |
| fungi | zaro: was that our only known blocker? | 21:21 |
| zaro | fungi: i believe so. | 21:21 |
| fungi | ecstatic | 21:21 |
| *** ayoung has quit IRC | 21:21 | |
| zaro | it's on master, but can easily be back ported to 2.10 | 21:21 |
| zaro | although i no longer think 2.10 is the gerrit we should upgrade to. | 21:22 |
| *** MarkAtwood has joined #openstack-infra | 21:22 | |
| fungi | no, i agree, at this point we should be looking at whatever their latest stable is and suck up the additional differences | 21:22 |
| clarkb | is 2.11 out already? didn't it kill the old change screen? | 21:22 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Move nodepool config loading into module https://review.openstack.org/231592 | 21:23 |
| zaro | yep, even with a few point releases | 21:23 |
| zaro | yep, old screen is gone | 21:23 |
| fungi | i guess we should test-drive it on review-dev sooner rather than later | 21:23 |
| fungi | and see how terribad we think the new change screen is now | 21:23 |
| fungi | i care a lot less than i used to now that i can gertty | 21:24 |
| zaro | fungi: i can make that happen pretty quickly. i've already got review-dev replicated locally with Gerrit master | 21:24 |
| fungi | but getting a lot of our more prolific non-infra devs to try it out and give us feedback/hatemail would help | 21:24 |
| zaro | agreed. i'm just saying i've already got it done. mostly | 21:25 |
| clarkb | zaro: review-dev is 2.10.6 | 21:25 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config: Correct location of clouds.yaml https://review.openstack.org/232765 | 21:25 |
| Shrews | mordred: ^^^^ | 21:25 |
| *** unicell has joined #openstack-infra | 21:25 | |
| clarkb | zaro: also I totally just clicked on one of the test changes and the proect doesn't seem to be broken | 21:26 |
| zaro | clarkb: yeah, it's because i updated with my jgit fix. | 21:26 |
| zaro | the one spearce says was voodoo! | 21:27 |
| *** fawadkhaliq has quit IRC | 21:27 | |
| zaro | fungi, clarkb : so should we move review-dev.o.o to Gerrit 2.11? | 21:27 |
| *** sdake has quit IRC | 21:28 | |
| fungi | zaro: i'm in favor of that. at this point i think we need to see if we can stand it and solicit some opinions from the broader community | 21:28 |
| clarkb | sounds like a plan to me | 21:28 |
| *** MarkAtwood has quit IRC | 21:28 | |
| fungi | and if it's particularly contentious, that may sway the decision to have a round-table discussion about it at the summit too | 21:28 |
| *** tchavez has joined #openstack-infra | 21:29 | |
| *** tchavez has quit IRC | 21:29 | |
| zaro | cool. should be done by end of today along with _david_'s fix. | 21:29 |
| fungi | because if there are just a few vocal detractors who will give up the old change screen when we pry it from their cold, dead hands, then we can point them at the empty repo for vinz and tell them to have at it | 21:29 |
| clarkb | I mean Ican be vocal but I will get by on gertty | 21:29 |
| *** spzala has joined #openstack-infra | 21:30 | |
| clarkb | (I have been using webui almost exclusively now that I have twins) | 21:30 |
| fungi | oh, ouch | 21:30 |
| fungi | you need a chording keyboard! | 21:30 |
| clarkb | or an extra pair of arms and hands | 21:30 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 21:30 |
| *** Swami_ has joined #openstack-infra | 21:30 | |
| clarkb | like the futurama chef | 21:30 |
| clarkb | BAM! | 21:30 |
| *** Swami has quit IRC | 21:30 | |
| fungi | i can mail you my open hardware pcb, a baggie of parts and instructions on where to get the gpl-licensed firmware (or burn an initial load onto the microcontroller for you) | 21:31 |
| *** burgerk has quit IRC | 21:31 | |
| *** eharney has quit IRC | 21:31 | |
| fungi | the firmware embeds a usb programmer you can alternate boot it into for later updates | 21:32 |
| fungi | then all you need is a few months of getting used to one-handed typing | 21:32 |
| fungi | for v2, i need to bootstrap a 3d printer and finish the ergonomic housing i've been designing | 21:33 |
| *** MarkAtwood has joined #openstack-infra | 21:34 | |
| *** jsavak has joined #openstack-infra | 21:35 | |
| *** tonytan4ever has quit IRC | 21:36 | |
| *** timrc_ has joined #openstack-infra | 21:36 | |
| mtreinish | fungi: I can't use the new screen, I'm having a hard time using any of the alternatives | 21:36 |
| mtreinish | I still feel the most productive with the old screen | 21:37 |
| *** hashar has quit IRC | 21:37 | |
| fungi | mtreinish: well, it's worth trying it in 2.11.latest and seeing if it's improved | 21:37 |
| mtreinish | fungi: I think it's just because it's different, it doesn't matter if it's better or not :) | 21:37 |
| fungi | which is why zaro's working on getting review-dev updated to that | 21:37 |
| clarkb | well I think its objectively worse | 21:38 |
| mtreinish | clarkb: I agree | 21:38 |
| fungi | it probably is | 21:38 |
| *** EricGonczer_ has quit IRC | 21:39 | |
| fungi | however, is it worse enough that we're willing to forego the non-webui improvements in 2.11? no idea | 21:39 |
| *** jsavak has quit IRC | 21:39 | |
| clarkb | right and for me I think the non ui improvements are worth it | 21:39 |
| clarkb | the merge checking will simplify zuul tremendously | 21:39 |
| fungi | also there are several new api features which will be excellent to have | 21:39 |
| *** jsavak has joined #openstack-infra | 21:39 | |
| fungi | and others i want which i'm pretty certain will never be backported to 2.10 | 21:40 |
| *** bltavares has quit IRC | 21:41 | |
| mtreinish | clarkb, fungi: unrelated: http://208.94.241.194:8080/#/ is the dasboard in its current state if you're interested | 21:41 |
| zaro | i can confirm that it wont get backported | 21:41 |
| clarkb | mtreinish: thats just gate ya? | 21:41 |
| fungi | pvaneck: hogepodge: i've ssh'd into that test deployment of refstack.o.o but am not seeing anything listening. was this supposed to have apache or something? i guess i can reverse engineer it from the puppet module to see what i should expect there | 21:41 |
| mtreinish | fungi: and before you mention it again the graphs are still drawing between point missing data | 21:41 |
| mtreinish | clarkb: yeah, just gate it's querying the subunit2sql db | 21:42 |
| mtreinish | so we're limited to whats in there right now | 21:42 |
| fungi | pvaneck: hogepodge: nevermind! i just realized i made a mistake when i deployed it. new one on the way now | 21:42 |
| hogepodge | fungi: I keep promising to look at the deployment code but failing. :-( | 21:42 |
| pvaneck | fungi: haha, hopefully take two works | 21:42 |
| clarkb | mtreinish: I would sort the crescent moons by fail % | 21:42 |
| clarkb | mtreinish: to push them up in front of people | 21:43 |
| *** bltavares has joined #openstack-infra | 21:43 | |
| *** luqas has joined #openstack-infra | 21:43 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:43 | |
| fungi | pvaneck: hogepodge: i forgot to pass our launch script an --environment option so it used the normal (without that patch) production code to deploy the server, thus it was basically empty | 21:43 |
| hogepodge | fungi: a truly enlightened server | 21:44 |
| fungi | it was one with everything | 21:44 |
| fungi | and nothing | 21:44 |
| fungi | (mostly the latter) | 21:44 |
| mtreinish | clarkb: if you have any other items throw them up on: https://etherpad.openstack.org/p/openstack-health-tracking | 21:45 |
| *** thorst has joined #openstack-infra | 21:45 | |
| *** mriedem has quit IRC | 21:45 | |
| mtreinish | I've got enough of a web in my head of whats going on we probably need to start writing it down | 21:45 |
| clarkb | mtreinish: can do | 21:46 |
| *** weshay has quit IRC | 21:47 | |
| clarkb | mtreinish: instead of line graphs does it make sense to do bar graphs on an interval? | 21:48 |
| clarkb | mtreinish: that will make missing data less troublesome | 21:48 |
| *** Sukhdev has joined #openstack-infra | 21:48 | |
| *** timrc_ has quit IRC | 21:49 | |
| clarkb | http://208.94.241.194:8080/#/project/openstack%252Ftaskflow for that graph in particular | 21:49 |
| mtreinish | clarkb: yeah that might make it easier | 21:49 |
| clarkb | I think it would be clearer as an hourly bar graph with pass fail side by side | 21:49 |
| mtreinish | I think there is an easy graph type to use in nvd3 for that | 21:49 |
| fungi | or bar graph with over/under if you prefer | 21:49 |
| fungi | though that's fancy, so might not be easy | 21:50 |
| *** timrc__ has joined #openstack-infra | 21:50 | |
| *** timrc__ is now known as timrc_ | 21:50 | |
| mtreinish | fungi: http://nvd3-community.github.io/nvd3/ | 21:50 |
| fungi | but over/under tends to be very readable if you have only two values | 21:50 |
| mtreinish | like that? | 21:50 |
| *** dramalho has quit IRC | 21:51 | |
| mtreinish | fungi: actually probably closer to: http://nvd3-community.github.io/nvd3/ | 21:51 |
| fungi | yeah, i think you think those urls go to a specific graph example? | 21:51 |
| fungi | which type(s) are you referring to there? | 21:51 |
| clarkb | the historical bar chart is what I would use but modify it to have negative Y be fails and positive be pass | 21:52 |
| mtreinish | d'oh | 21:52 |
| mtreinish | the 2nd time was multibarchart | 21:53 |
| fungi | and it would probably offset them if you did two values, so still might not look quite right | 21:53 |
| *** dramalho has joined #openstack-infra | 21:53 | |
| mtreinish | and the first time was historicalbarchart | 21:53 |
| openstackgerrit | Merged stackforge/python-jenkins: Handle depth errors in get_running_builds https://review.openstack.org/232253 | 21:53 |
| clarkb | but multibarchart2 would also be good | 21:53 |
| fungi | unless you could convince it to "overlap" the bars similar to the stacked one | 21:53 |
| fungi | oh, that's true. just do two bar graphs, make the fails inverted value and multi-chart them | 21:53 |
| mtreinish | fungi: sounds like multibarchart2 | 21:53 |
| *** yfried__ is now known as yfried|afk | 21:54 | |
| clarkb | ya that one would be good too | 21:54 |
| fungi | similar, yeah, and invert the non-stackable | 21:54 |
| fungi | i bet that would work out great | 21:54 |
| openstackgerrit | gordon chung proposed openstack-infra/project-config: fix ceilometerclient gate https://review.openstack.org/232797 | 21:54 |
| *** gordc has quit IRC | 21:55 | |
| mtreinish | fungi: patches welcome :) | 21:55 |
| fungi | mtreinish: if i patch it, i'll be submitting integration for https://github.com/tehmaze/diagram ;) | 21:55 |
| clarkb | I think technically we have two sets of time series data | 21:56 |
| clarkb | the problem is its too noisy | 21:56 |
| *** xyang1 has quit IRC | 21:56 | |
| mtreinish | fungi: hah, I would definitely accept patches to subunit2sql-graph to use that | 21:56 |
| *** wenlock has quit IRC | 21:57 | |
| *** dramalho has quit IRC | 21:57 | |
| *** glauco has quit IRC | 21:58 | |
| *** glauco_ has joined #openstack-infra | 21:59 | |
| fungi | pvaneck: hogepodge: see my latest comment on 198869 for what seems to be a working deployment now | 22:00 |
| clarkb | mtreinish: is every refresh a live pull from DB? | 22:00 |
| mtreinish | clarkb: for right now yes | 22:00 |
| jeblair | mtreinish: have i recorded what's keeping you from using gertty? | 22:00 |
| mtreinish | we're going to need to add caching to the rest api | 22:00 |
| mtreinish | jeblair: I use gertty, its just something about it I don't find my reviews as thorough when I use it | 22:01 |
| pvaneck | fungi: thanks! appears that everything is working now | 22:01 |
| *** yfried|afk is now known as yfried__ | 22:01 | |
| clarkb | mtreinish: can probably just have $webserver do it for you too since it should all be deterministic and sane paths ya? | 22:01 |
| mtreinish | clarkb: yeah, that should work | 22:01 |
| *** glauco_ has quit IRC | 22:01 | |
| jeblair | mtreinish: oh ok. you could try reviewing different things :) | 22:02 |
| mtreinish | jeblair: yeah I've been using gertty to go through faster reviews like tempest-lib migration patches | 22:02 |
| fungi | pvaneck: cool, as soon as 232759 merges we'll have system-config unstuck so we can recheck that failing job, then it's just a matter of finding a second sucker^H^H^H^H^H^Hsystem-config core reviewer to approve | 22:02 |
| *** dzamboni has quit IRC | 22:03 | |
| *** timrc1 has quit IRC | 22:03 | |
| fungi | and then i can deploy a fresh one for real and work on getting the db dump imported | 22:03 |
| mtreinish | clarkb: fwiw, we're probably going to deploy the rest api under apache | 22:03 |
| mtreinish | just because the puppet is easier to copy and paste from elsewhere | 22:04 |
| *** matrohon has quit IRC | 22:04 | |
| clarkb | mtreinish: ya apache should be able to manage caching then | 22:04 |
| clarkb | mtreinish: then you don't have to do a bunch of that in python which is a pita | 22:04 |
| ruagair | minor edit for the maniphest spec, fungi, if you hav a moment: https://review.openstack.org/#/c/232309/1 | 22:05 |
| pvaneck | fungi: sounds good. I'll need some time to work with catherineD to determine when she wants the dump to be taken and what refstack.net should do during/before the transition | 22:06 |
| *** niedbalski_ has quit IRC | 22:06 | |
| *** rossella_s has quit IRC | 22:06 | |
| *** timrc_ has quit IRC | 22:06 | |
| *** rossella_s has joined #openstack-infra | 22:06 | |
| *** thiagop-afk is now known as thiagop | 22:06 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat https://review.openstack.org/232800 | 22:07 |
| fungi | ruagair: mind adding your irc nick to that line? then i'll be happy to approve it | 22:07 |
| fungi | makes it easier for people to figure out who to talk to | 22:07 |
| ruagair | Oh, the assigneee line fungi/ | 22:07 |
| fungi | (though our template says that's supposed to be "launchpad-id" i think we've been doing irc nicks mostly) | 22:08 |
| fungi | ruagair: yep | 22:08 |
| *** niedbalski has joined #openstack-infra | 22:08 | |
| *** timrc1 has joined #openstack-infra | 22:08 | |
| pleia2 | hehe, spirit guide | 22:08 |
| ruagair | I'm in the process of switching my IRC nick to my launchpad ID. I can use both. | 22:09 |
| *** timrc_ has joined #openstack-infra | 22:09 | |
| ruagair | \o/ glad someone liked that. Thanks pleia2 :-) | 22:09 |
| * fungi imagines mordred as homer's coyote spirit animal | 22:09 | |
| mtreinish | ooh I like this one: http://208.94.241.194:8080/#/project/openstack%252Fpython-swiftclient | 22:09 |
| pleia2 | lol | 22:09 |
| clarkb | mtreinish: ya it was graphs like that that led to my bar graph suggestion | 22:09 |
| *** austin81 has left #openstack-infra | 22:11 | |
| *** timrc1 has left #openstack-infra | 22:12 | |
| *** tsekiyam_ has joined #openstack-infra | 22:13 | |
| *** tsekiyama has quit IRC | 22:14 | |
| harlowja | qq, and might be documented somewhere, but coverage jobs run on gate merge right, trying to remember the secret info here so dims may know also :-P | 22:14 |
| lifeless | mtreinish: thats brilliant | 22:14 |
| jroll | harlowja: yeah, look at the post sections in project-config | 22:14 |
| harlowja | dims i knew it ! | 22:14 |
| harlowja | jroll its published to a secret place right, lol | 22:15 |
| jroll | harlowja: I mean, it's totally configurable per project :P | 22:15 |
| jroll | yeah | 22:15 |
| dims | duh! | 22:15 |
| harlowja | secret! | 22:15 |
| openstackgerrit | Craige McWhirter proposed openstack-infra/infra-specs: Updated Assignee https://review.openstack.org/232309 | 22:15 |
| jroll | harlowja: have you seen https://review.openstack.org/#/c/221494/ | 22:15 |
| harlowja | ah, nice | 22:15 |
| fungi | we're very overt with our secrets here | 22:17 |
| *** pradk has quit IRC | 22:17 | |
| fungi | openstack: we're terrible at keeping secrets | 22:18 |
| *** geoffarnold has joined #openstack-infra | 22:18 | |
| harlowja | lol | 22:18 |
| harlowja | ya, i'm just trying to remember where they get published, ha | 22:19 |
| harlowja | like for example https://review.openstack.org/#/c/231043/ | 22:19 |
| harlowja | pretty sure oslo.messaging has coverage job enabled | 22:19 |
| fungi | harlowja: http://logs.openstack.org/XX/YYYY where XX is the first two digits of the (merge!) commit sha and YYYY is the full sha | 22:20 |
| harlowja | right | 22:20 |
| harlowja | top secret, lol | 22:20 |
| fungi | rbradfor is making it even less secret, and giving us some analytical trending too | 22:20 |
| harlowja | :) | 22:20 |
| harlowja | dims ^^ | 22:20 |
| fungi | harlowja: dims: https://review.openstack.org/221494 is his proposed spec | 22:21 |
| dims | aha. thanks fungi jroll harlowja | 22:21 |
| harlowja | :) | 22:21 |
| *** skylerberg has quit IRC | 22:21 | |
| *** inteq has joined #openstack-infra | 22:22 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-gerrit: Make the canonicalweburl rewrite rule optional https://review.openstack.org/232801 | 22:23 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 22:25 |
| *** aysyd has joined #openstack-infra | 22:26 | |
| clarkb | harlowja: dims and http://demo.ronaldbradford.com/cover/ is the demo | 22:26 |
| * clarkb wonders why everyone cares about coverage all of a sudden | 22:26 | |
| harlowja | lol | 22:26 |
| clarkb | there was prbably a hacker news article about DO178B and how code coverage keeps you safe in your airplanes | 22:26 |
| harlowja | 110% coverage or u are all fired | 22:27 |
| harlowja | lol | 22:27 |
| lifeless | clarkb: rbradfor has picked it as a thing to shift the dial on | 22:27 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance https://review.openstack.org/232135 | 22:27 |
| lifeless | clarkb: thats all I know | 22:27 |
| clarkb | harlowja: well 100% or you don't fly but ya | 22:27 |
| dims | clarkb: nice! | 22:27 |
| mtreinish | man, tempest is winning the coverage wars 30% :) | 22:27 |
| lifeless | 100% tells you very little about the test suite :) | 22:27 |
| clarkb | harlowja: and if its critical to plane function thats condition coverage too | 22:27 |
| harlowja | cover all the things | 22:28 |
| clarkb | lifeless: sure I am just telling you what the faa requires for software to run on an airplane | 22:28 |
| lifeless | (since Python coverage is line based, not branch based) | 22:28 |
| lifeless | clarkb: oh interesting | 22:28 |
| lifeless | clarkb: but yeah, afl 4 eva | 22:28 |
| clarkb | lifeless: in a former life I wrote software that ran on airplanes | 22:28 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders can be run on their own https://review.openstack.org/232251 | 22:28 |
| mtreinish | lifeless: I thought there was an option to have coverage do it branched based | 22:28 |
| lifeless | clarkb: nice; control plane or passenger side? | 22:28 |
| clarkb | oh and the compiler had to meet the same requirements which meant we used some ancient ARM compiler | 22:29 |
| clarkb | lifeless: radio so semi control plane | 22:29 |
| fungi | i have flown on some of clarkb's airplanes and not died. hooray for science! | 22:29 |
| lifeless | mtreinish: oh, 3.5 looks like it added stuff | 22:30 |
| lifeless | mtreinish: ah no | 22:31 |
| lifeless | mtreinish: so the underlying problem is that the single step hook in CPython is line based | 22:31 |
| lifeless | mtreinish: looks to me like coverage is inferring backwards but a complex condition | 22:32 |
| mtreinish | lifeless: https://coverage.readthedocs.org/en/latest/branch.html?highlight=branch#how-it-works | 22:32 |
| lifeless | like (foo or bar) won't show < 100% if bar.__nonzero__ isn't actually ever evaluated | 22:32 |
| lifeless | mtreinish: yes, exactly | 22:33 |
| mtreinish | lifeless: ah ok | 22:33 |
| *** amuller has quit IRC | 22:33 | |
| *** ddieterly has quit IRC | 22:33 | |
| *** skylerberg has joined #openstack-infra | 22:34 | |
| lifeless | mtreinish: so consider that a TypeError might be thrown in bar in my (foo or bar) example | 22:34 |
| lifeless | mtreinish: so if (quux and (foo or bar)): - quux False -> skips, quux True and foo True executes | 22:35 |
| openstackgerrit | Merged openstack-infra/nodepool: Permit obsolete jenkins/mysql options in config https://review.openstack.org/232759 | 22:35 |
| *** angdraug has joined #openstack-infra | 22:35 | |
| lifeless | and coverage won't flag that quux True and foo False never happened, leading to bar never evaluated | 22:36 |
| openstackgerrit | Merged openstack-infra/infra-specs: Updated Assignee https://review.openstack.org/232309 | 22:36 |
| mtreinish | lifeless: ah ok | 22:37 |
| *** mriedem has joined #openstack-infra | 22:37 | |
| *** thorst has quit IRC | 22:37 | |
| clarkb | http://logs.openstack.org/76/230276/3/check/barbican-coverage/8b48019/cover vs http://logs.openstack.org/76/230276/3/check/barbican-coverage/8b48019/cover/ not sure how best to handle that | 22:38 |
| jeblair | clarkb: can you explain what i'm seeing there? :) | 22:39 |
| clarkb | jeblair: the js and css fails to load without the trailing / because it looks relative to 8b48019. with the / it looks relative to cover | 22:40 |
| clarkb | jeblair: the files are under cover/ | 22:40 |
| jeblair | clarkb: aha, thanks | 22:40 |
| anteaya | krotscheck: welcome, glad you got what you needed | 22:40 |
| jeblair | clarkb: where did the link http://logs.openstack.org/76/230276/3/check/barbican-coverage/8b48019/cover come from | 22:40 |
| jeblair | ? | 22:40 |
| *** MarkAtwood has quit IRC | 22:40 | |
| clarkb | jeblair: it was from rbradfor's demo cover thing | 22:40 |
| lifeless | clarkb: centralise the css and jss so its not duplicated? | 22:41 |
| jeblair | clarkb: can you point me at that? i missed that. | 22:41 |
| jeblair | clarkb: and was that served by osla or apache? | 22:41 |
| clarkb | jeblair: http://demo.ronaldbradford.com/cover/ | 22:41 |
| clarkb | lifeless: that may be more work than its worth and would mean running coverage jobs differently in jenkins than on your laptop | 22:42 |
| lifeless | clarkb: or teaching the coverage wrapper about the context | 22:42 |
| lifeless | clarkb: we're going to need to change that anyhow | 22:42 |
| clarkb | I wonder if the coverage templates will accept a different content path | 22:42 |
| jeblair | clarkb: was that osla or apache? | 22:42 |
| clarkb | jeblair: osla | 22:43 |
| jeblair | clarkb: then i think the answer to your question is to have osla redirect to URL+/ when serving an implied index.html or directory listing. | 22:43 |
| *** armax has joined #openstack-infra | 22:44 | |
| clarkb | jeblair: just 302 it? | 22:44 |
| clarkb | that should work | 22:44 |
| jeblair | clarkb: yeah, that's the correct thing to do in that case | 22:44 |
| lifeless | 301 prob | 22:44 |
| jeblair | lifeless: yeah 301 | 22:44 |
| greghaynes | clarkb: nodopool-dsvm is broken? | 22:45 |
| jeblair | clarkb: it's pretty common to have apache configs add missing /s for directories too; don't recall if we had that enabled for logs.o.o | 22:45 |
| clarkb | greghaynes: I don't think so | 22:45 |
| clarkb | it wasn't yesterday | 22:45 |
| greghaynes | ok, ill dig | 22:46 |
| greghaynes | http://logs.openstack.org/75/195175/25/check/gate-dsvm-nodepool/e86ec36/logs/screen-nodepool.txt.gz | 22:46 |
| jeblair | clarkb, rbradfor, lifeless: and also the index page should add a / so people don't hit the redirect :) | 22:46 |
| fungi | speaking of logs.o.o, if 232748 works then we can add https for logs, specs, governance, tarballs, et cetera | 22:46 |
| clarkb | OpenStackCloudException: Error getting compute endpoint: Cannot use v2 authentication with domain scope (Inner Exception: Discovery of client versions failed.) looks like broken oscc? | 22:46 |
| greghaynes | yea | 22:47 |
| greghaynes | (score another win for the dsvm test) | 22:47 |
| clarkb | jeblair: worth noting that the index at http://logs.openstack.org/76/230276/3/check/barbican-coverage/8b48019/ which is generated by the job itself properly appends / | 22:48 |
| jeblair | clarkb: ++ | 22:48 |
| jeblair | clarkb, greghaynes: oscc hasn't had a release, has it? what's broken? | 22:49 |
| clarkb | jeblair: and https://review.openstack.org/#/c/232687/ should further fix the js and things | 22:50 |
| *** niedbalski has quit IRC | 22:50 | |
| clarkb | jeblair: shade can't auth to devsatck because it says that we are talking to keystonev2 with a domain scope which is wrong | 22:50 |
| clarkb | jeblair: I believe it is oscc's job to know how to do that properly but I suppose it may also be shade | 22:50 |
| clarkb | greghaynes: does the shade src job pass? | 22:51 |
| clarkb | nope and same error | 22:51 |
| *** asettle has joined #openstack-infra | 22:51 | |
| *** cloudtrainme has quit IRC | 22:51 | |
| jeblair | clarkb: re osla -- don't we htmlify service logs? | 22:51 |
| *** jsavak has quit IRC | 22:51 | |
| jeblair | eg the nova log | 22:52 |
| clarkb | jeblair: we do, thats what the .txt(.gz)? rule is for | 22:52 |
| *** niedbalski has joined #openstack-infra | 22:52 | |
| *** jsavak has joined #openstack-infra | 22:52 | |
| jeblair | clarkb: oh got it. console is the only already html that we htmlify :) | 22:52 |
| clarkb | jeblair: you can compare against what the current vhost does in apache to see how we htmlify | 22:52 |
| clarkb | jeblair: yup | 22:52 |
| anteaya | Clint: I see all the current robots.txt patches merged, does paste.o.o have an intact robots.txt file? | 22:52 |
| clarkb | jeblair: and we aren't properly passing through html that is already htmled | 22:53 |
| clarkb | jeblair: I think quick fix is do 1:1 behavior then we can debug that later | 22:53 |
| greghaynes | jeblair: havent dug to deep yet, but looks like its when oscc is initializing the clients | 22:53 |
| greghaynes | jeblair: http://logs.openstack.org/75/195175/25/check/gate-dsvm-nodepool/e86ec36/logs/screen-nodepool.txt.gz is the log | 22:53 |
| greghaynes | first tacos, though | 22:53 |
| clarkb | greghaynes: so I think the issue is v3 is enabled in keystone now and shade is trying to v3 against the v2 endpoint | 22:53 |
| clarkb | mordred: how does shade pick a keystone version if we aren't using clouds.yaml? | 22:54 |
| clarkb | http://logs.openstack.org/14/208114/4/check/gate-dsvm-nodepool/609d05b/console.html seems to mostly work and it uses occ | 22:55 |
| clarkb | it fails because the test commands do not use occ :/ | 22:55 |
| greghaynes | huh? | 22:56 |
| clarkb | let me update that and at least we can move forward but I think shade needs to be smarter | 22:56 |
| clarkb | greghaynes: the problem appears to be that nodepool.yaml says use a v2 keystone endpoint but shade chooses to use v3 against it | 22:56 |
| greghaynes | yea, what do you mean about test commands do not use oscc? | 22:56 |
| clarkb | greghaynes: if we use a clouds.yaml then shade and keystone end up on the same page | 22:56 |
| *** ociuhandu has quit IRC | 22:57 | |
| clarkb | greghaynes: the nodepool list and image-list commands are run by a different user without a clouds.yaml | 22:57 |
| clarkb | s/oscc/clouds.yaml/ | 22:57 |
| greghaynes | oh, its a config problem | 22:57 |
| greghaynes | yea | 22:57 |
| clarkb | well this should work against keystone v2 without a clouds.yaml | 22:57 |
| clarkb | and I have a hunch this may not work against v2 even with a clouds.yaml | 22:57 |
| anteaya | fungi: well I would characterize your comment differently: fungi they see a job, even non-voting, failing and think they've submitted an incorrect change | 22:58 |
| greghaynes | Thers also the issue that clearly some kind of backwards compat was broken | 22:58 |
| anteaya | fungi: I would characterize it as if they see a job failing they look at the log (as requested) and expect to see errors they can decipher | 22:58 |
| anteaya | fungi: context: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-10-08.log.html#t2015-10-08T13:27:26 | 22:59 |
| mordred | clarkb: keystoneauth1 does detection based on parameters | 22:59 |
| *** timrc_ has quit IRC | 22:59 | |
| *** timrc_ has joined #openstack-infra | 23:00 | |
| *** nelsnelson has quit IRC | 23:00 | |
| clarkb | greghaynes: yes thats what I mean, shade should work with v2 if given a v2 endpoint | 23:00 |
| clarkb | maybe interrogate the endpoint for version info if it doesn't know otherwise? I dunno | 23:00 |
| Clint | anteaya: yes, you can see it at http://paste.openstack.org/robots.txt | 23:01 |
| clarkb | mordred: that implies shade is passing parameters it doesn't understand? | 23:01 |
| anteaya | Clint: how wonderful, thank you | 23:02 |
| *** gordc has joined #openstack-infra | 23:02 | |
| anteaya | Clint: and so I can | 23:02 |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Match file conditions to apache rewrite rules https://review.openstack.org/232687 | 23:02 |
| Clint | anteaya: now we get to wait and see if it has the desired effect | 23:02 |
| *** ociuhandu has joined #openstack-infra | 23:02 | |
| anteaya | Clint: yes, how long do you predict we will need to wait? | 23:03 |
| mordred | clarkb: yes. auth parameters are 100% passthrough | 23:04 |
| mordred | clarkb: the logic to go from a set of auth parameters to a working auth plugin is contained in keystoneauth1 | 23:04 |
| mordred | clarkb: is there a problem I should look in to? | 23:05 |
| clarkb | mordred: yes http://logs.openstack.org/75/195175/25/check/gate-dsvm-nodepool/e86ec36/logs/screen-nodepool.txt.gz | 23:05 |
| mordred | thanks | 23:05 |
| *** gordc has quit IRC | 23:05 | |
| clarkb | mordred: nodepool no longer works against keystone v2 because shade speaks v3 to it | 23:05 |
| *** Daisy has joined #openstack-infra | 23:05 | |
| mordred | clarkb: so - devstack is currently deploying v3 keystone | 23:06 |
| clarkb | and v2 | 23:06 |
| mordred | clarkb: and putting v3 info into the clouds.yaml | 23:06 |
| clarkb | but we don't use clouds.yaml | 23:06 |
| Clint | anteaya: not sure and i'd rather not speak to any spammers to ask | 23:06 |
| mordred | ok. so, then autodetection is breaking | 23:06 |
| anteaya | Clint: that makes sense to me | 23:06 |
| anteaya | Clint: hopefully we should see a difference next week | 23:07 |
| mordred | clarkb: I will need to dig in to a node and figure out where it's falling over | 23:07 |
| mordred | clarkb: there is nothing about shade that should be explicity doing anything with v3 or trying to use it in any way | 23:07 |
| mordred | clarkb: and I verified earlier in a dsvm node that without v3 auth params auth against v2 worked | 23:07 |
| mordred | clarkb: so - give me just a few and I'll dig in and let you know what broke | 23:08 |
| greghaynes | mordred: ty | 23:08 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Use OCC cloud specifier in devstack plugin https://review.openstack.org/208114 | 23:08 |
| clarkb | mordred: ^ that is the as of yet unmerged change to use clouds.yaml | 23:08 |
| *** reed_ has joined #openstack-infra | 23:09 | |
| *** hemna is now known as hemnafk | 23:09 | |
| *** Daisy has quit IRC | 23:10 | |
| *** timrc__ has joined #openstack-infra | 23:10 | |
| greghaynes | Also, since people were mentioning wanting nodepool builders today - https://review.openstack.org/#/q/status:open+project:openstack-infra/nodepool+branch:master+topic:nodepool-workers,n,z | 23:10 |
| greghaynes | just waiting on reviews | 23:11 |
| *** Ryan_Lane has left #openstack-infra | 23:11 | |
| *** akshai has quit IRC | 23:11 | |
| calebb | does shade support creating volume snapshots? I cant find any docs on it | 23:11 |
| clarkb | greghaynes: and tests to pass :P | 23:11 |
| *** jsavak has quit IRC | 23:11 | |
| *** timrc__ has quit IRC | 23:11 | |
| *** timrc_ has quit IRC | 23:11 | |
| greghaynes | clarkb: yea, its just the dsvm ones not passing ATM but in theory that should get fixed... | 23:11 |
| *** timrc_ has joined #openstack-infra | 23:11 | |
| clarkb | calebb: it may not, I don't think that is an oepration we use | 23:12 |
| calebb | ok | 23:13 |
| *** spzala has quit IRC | 23:13 | |
| mtreinish | calebb: I don't think it is, I was looking for that the other day too | 23:16 |
| clarkb | just reading the api docs on it looks like you probabl don't want to snapshot an attached volume | 23:16 |
| clarkb | which is probably why we don't use it | 23:16 |
| openstackgerrit | lifeless proposed openstack/requirements: Revise rules on upper bounds. https://review.openstack.org/222349 | 23:16 |
| clarkb | that and I wonder how well snapshotting 12 1TB volumes that make up one logical filesystem will work | 23:17 |
| calebb | hehe | 23:17 |
| clarkb | thingee: ^ any idea how that will work out? | 23:17 |
| lifeless | dims: / mriedem: - requests and requirements | 23:21 |
| lifeless | I've -1'd the requests cap patch, but I want to make sure that you guys are clear about why and what we need to do to fix ti | 23:21 |
| dims | lifeless: ack. mriedem has the pen on that review. so will wait for him | 23:23 |
| * dims back in a bit | 23:23 | |
| mriedem | ugh | 23:23 |
| dims | :) | 23:23 |
| *** dims has quit IRC | 23:23 | |
| mriedem | so upper-constraints should be 2.7.0 and we cap urllib3? | 23:23 |
| mriedem | idk, it's a clusterf*ck | 23:23 |
| mriedem | as the commit message explains | 23:24 |
| mriedem | basically i think we should pin both | 23:24 |
| mriedem | since requests forks urllib3 at a specific version | 23:24 |
| lifeless | mriedem: upper-constraints is already pinned | 23:24 |
| mriedem | lifeless: it's wrong for urllib3 | 23:24 |
| lifeless | mriedem: ok, so lets step back | 23:24 |
| lifeless | mriedem: how did upper-constraints get invalid? | 23:24 |
| mriedem | requests 2.7.0 contains urllib3 1.10.4 and won't work with 1.11 | 23:24 |
| *** EricGonczer_ has joined #openstack-infra | 23:24 | |
| lifeless | mriedem: what gate jobs fail with this situation | 23:25 |
| mriedem | https://bugs.launchpad.net/ospurge/+bug/1503768 | 23:25 |
| openstack | Launchpad bug 1476770 in python-glanceclient "duplicate for #1503768 _translate_from_glance fails with "AttributeError: id" in grenade" [Undecided,New] | 23:25 |
| *** reed_ has quit IRC | 23:25 | |
| mriedem | is what flaper87 was trying to fix | 23:25 |
| lifeless | mriedem: thats a bug | 23:26 |
| mriedem | let me see if i can find the glance job that's hitting it | 23:26 |
| lifeless | mriedem: what tests could we run to reproduce this error in the gate? | 23:26 |
| mriedem | so it's failing on glanceclient unit tests | 23:26 |
| *** thiagop has quit IRC | 23:26 | |
| lifeless | AIUI requests bundles urllib3 | 23:27 |
| lifeless | are we using urllib3 directly and passing that into requests? | 23:27 |
| *** sridhar_ram has quit IRC | 23:27 | |
| lifeless | or something crazy like that? | 23:27 |
| *** sabeen3 has quit IRC | 23:27 | |
| mriedem | requests bundles urllib3, correct | 23:28 |
| mriedem | but there is a thing here too where we have requests installed from the distro | 23:28 |
| lifeless | sure | 23:29 |
| clarkb | mriedem: but we don't allow system packages in the venvs | 23:29 |
| lifeless | but thats the distros job to keep their versions consistent | 23:29 |
| mriedem | however | 23:29 |
| lifeless | mriedem: distros are deliberately breaking the API contracts of these bundled packages, we *can't* fix that | 23:29 |
| mriedem | some distros rip that bundled urllib3 out of requests and just make it depend on their own package of urllib3 | 23:29 |
| mriedem | the last i checked into this was july https://bugs.launchpad.net/glance/+bug/1476770/comments/6 | 23:30 |
| openstack | Launchpad bug 1476770 in python-glanceclient "_translate_from_glance fails with "AttributeError: id" in grenade" [Undecided,New] | 23:30 |
| mriedem | clarkb: do all projects not allow site packages in their venvs? | 23:30 |
| mriedem | that's controlled via tox.ini right? | 23:30 |
| mriedem | anyway, packagers are also taking cues for supported dependency versions in g-r | 23:31 |
| lifeless | mriedem: even if they do,I don't understand how it causes failures | 23:31 |
| *** dimtruck is now known as zz_dimtruck | 23:31 | |
| lifeless | mriedem: right, so !=2.8.0 is an entirely legitimate statement for us to make | 23:31 |
| mriedem | but that's also saying that requests 2.8.1 is ok with urllib3 1.10.4 | 23:32 |
| mriedem | which it's not | 23:32 |
| lifeless | mriedem: no its not | 23:32 |
| lifeless | mriedem: because requests is bundled | 23:32 |
| lifeless | mriedem: or | 23:32 |
| clarkb | mriedem: they should not we removed that and if they do it is a bug | 23:32 |
| lifeless | mriedem: requests is distro controlled | 23:32 |
| mriedem | the other case that came up yesterday was jlk was saying they install each service in a venv, so nova is installed separately, and they fail in ways that we don't see in the gate b/c we do a full system single-node install | 23:32 |
| lifeless | mriedem: I had that experience in tripleo too, and would like to help but its really separate from this AFAICT | 23:33 |
| mriedem | so why is urllib3 in g-r to begin with? | 23:33 |
| mriedem | b/c oslo.vmware uses it i gues | 23:33 |
| mriedem | rather than just requests | 23:33 |
| lifeless | so I think the fix is to remove urllib3 | 23:34 |
| lifeless | and use requests | 23:34 |
| mriedem | that's an option for sure | 23:34 |
| lifeless | and IF we need urllib3 always get it from the requests bundled version | 23:34 |
| mriedem | would require updating oslo.vmware | 23:34 |
| lifeless | since we need all our deps to be coinstallable | 23:34 |
| lifeless | though that said | 23:34 |
| lifeless | I still don't understand - oh perhaps I do | 23:34 |
| lifeless | distro *broken requests* + urllib3 -> fail | 23:35 |
| lifeless | so, tell me about requests 2.8.0 | 23:35 |
| *** tsekiyam_ has quit IRC | 23:35 | |
| lifeless | mriedem: is it broken because of this urllib3 thing, or is it broken in some other way ? | 23:35 |
| mriedem | some other way | 23:35 |
| lifeless | ok | 23:35 |
| mriedem | there was an issue reported upstream for that which is closed | 23:35 |
| jeblair | clarkb, fungi, mordred, yolanda: i'm going to restart nodepool now | 23:35 |
| mriedem | so i expect a requests 2.8.1 soon | 23:36 |
| mriedem | http://goo.gl/n7wk0H | 23:36 |
| mriedem | also appears to be dropping off | 23:36 |
| mriedem | i have to take a 10 min break here to whip up some sandwiches for me and the daughter | 23:36 |
| mriedem | she demands to be fed | 23:37 |
| *** mtanino has quit IRC | 23:37 | |
| lifeless | mriedem: ok | 23:37 |
| jeblair | clarkb, fungi, mordred, yolanda: it seems to be working as expected after restarting | 23:37 |
| mordred | mriedem: we should also make sure folks who are installing in venvs like they do also use the constraints stuff in g-r | 23:39 |
| *** nelsnelson has joined #openstack-infra | 23:40 | |
| lifeless | mordred: that won't actually fix the specific distro-broken requests case | 23:40 |
| *** dims has joined #openstack-infra | 23:40 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Actually use the values provided in the conf file https://review.openstack.org/232813 | 23:40 |
| lifeless | mordred: because they might have that version of requests in distro, and then end up using that | 23:40 |
| lifeless | mordred: and the distro brain damage breaks it | 23:41 |
| *** hichihara has joined #openstack-infra | 23:41 | |
| mriedem | mordred: the upper-constraints? | 23:41 |
| lifeless | mriedem: upper-constraints.txts lists the known-good things we've tested with | 23:42 |
| mriedem | yeah | 23:42 |
| lifeless | mriedem: global-requirements.txt lists the ranges of things we might work with | 23:42 |
| mriedem | so are we talking about capping urllib3 at 1.10.4 in upper-constraints then or removing urllib3 from g-r altogether? | 23:43 |
| mriedem | because every time this comes up i want to rip my eyes out | 23:43 |
| lifeless | mriedem: so, I want to decouple the problems | 23:43 |
| lifeless | mriedem: 2.8.0 is a clear and present issue. Lets fix that. Its trivial. | 23:44 |
| *** lyz_ has quit IRC | 23:44 | |
| *** lyz_ has joined #openstack-infra | 23:44 | |
| lifeless | mriedem: urllib3 - I want to figure out how to blacklist pip considering the requests from the distros | 23:44 |
| *** timrc_ has quit IRC | 23:44 | |
| mriedem | so, if requests is capped at 2.7.0 in upper-constraints why were all of the glanceclient test jobs failing? | 23:44 |
| *** lyz_ is now known as lyz | 23:44 | |
| mriedem | does upper-constraints only apply to dsvm jobs? | 23:44 |
| lifeless | mriedem: because having mismatched versions and using them independently is *not a problem* | 23:44 |
| *** timrc_ has joined #openstack-infra | 23:44 | |
| lifeless | mriedem: we have patches in flight to enable constraints on unit test jobs | 23:44 |
| lifeless | mriedem: https://review.openstack.org/#/c/228315/ + | 23:45 |
| lifeless | mriedem: https://review.openstack.org/#/c/228343/ | 23:45 |
| lifeless | mriedem: for neutron, for instance. (the first stage, -constraints at all, is already there | 23:46 |
| mriedem | oh right, i remember seeing that in nova | 23:46 |
| lifeless | so, let me run a tl;dr past you | 23:46 |
| *** Swami_ has quit IRC | 23:46 | |
| mriedem | i somehow feel that kind of lies about requirements.txt in the project | 23:46 |
| lifeless | - requests doesn't support arbitrary mixes of urllib *so they vendor it* | 23:47 |
| *** timrc_ has quit IRC | 23:47 | |
| lifeless | - distros unvendor it which makes the dependencies of requests *wrong* | 23:47 |
| *** timrc_ has joined #openstack-infra | 23:47 | |
| lifeless | - we use requests in some place and urllib3 in others, indepedently, and thats ok | 23:47 |
| lifeless | - the problem occurs when a distro-fiddled requests is used with a pip-upgraded urllib3 | 23:47 |
| mriedem | yup, that's what we have in https://bugs.launchpad.net/glance/+bug/1476770/comments/6 | 23:48 |
| openstack | Launchpad bug 1476770 in python-glanceclient "_translate_from_glance fails with "AttributeError: id" in grenade" [Undecided,New] | 23:48 |
| mriedem | requests from trusty, urllib3 updated via oslo.vmware uncapped dependency | 23:48 |
| lifeless | yup | 23:48 |
| clarkb | sweet https://review.openstack.org/#/c/208114/ passes now | 23:49 |
| mordred | clarkb: can you +3 this please: https://review.openstack.org/#/c/232765/ | 23:49 |
| lifeless | mriedem: I suspect the thing is that our min urllib3 is > trusty's packaged one | 23:49 |
| clarkb | so we could go with that in parallel to debugging the v3 vs v2 thing | 23:49 |
| mordred | clarkb: OH! | 23:49 |
| mordred | I see the bug | 23:49 |
| mordred | in the other thing | 23:49 |
| mordred | (you patch shows it) | 23:49 |
| mordred | '$KEYSTONE_AUTH_URI/v$IDENTITY_API_VERSION' | 23:49 |
| mordred | the new v3 deployment does not deploy a /vX thing | 23:50 |
| mordred | so that auth_url is not a valid auth url | 23:50 |
| clarkb | mordred: except that wrote out v2 | 23:50 |
| lifeless | mriedem: bingo | 23:50 |
| mordred | right | 23:50 |
| clarkb | mordred: which is valid | 23:50 |
| lifeless | mordred: python-urllib3 | 1.7.1-1build1 | trusty | source, all | 23:50 |
| lifeless | bah | 23:50 |
| lifeless | mriedem: python-urllib3 | 1.7.1-1build1 | trusty | source, all | 23:50 |
| *** yfried__ is now known as yfried|afk | 23:50 | |
| clarkb | mordred: it spoke to us and said you are talking v3 here | 23:50 |
| lifeless | mriedem: and our minimum is urllib3>=1.8.3 | 23:50 |
| openstackgerrit | Kevin Carter proposed openstack/requirements: Set jsonrpclib != 0.1.4 https://review.openstack.org/232815 | 23:50 |
| clarkb | mordred: no I do not think 232765 should merge, shade's hook deals with taht file and should continue to do so IMO | 23:50 |
| clarkb | mordred: ya that file doesn't exist at that point | 23:51 |
| mriedem | lifeless: i'm following so far | 23:51 |
| mordred | clarkb: where do you think the editing should happen then? | 23:51 |
| lifeless | mriedem: but | 23:51 |
| lifeless | mriedem: I don't understand why requests wasn't also upgraded | 23:51 |
| lifeless | mriedem: requests>=2.5.2 | 23:51 |
| openstackgerrit | Augustina Ragwitz proposed openstack/diskimage-builder: Update rhel7 element readme https://review.openstack.org/222351 | 23:51 |
| clarkb | mordred: shade/tests/functional/hooks/post_test_hook.sh | 23:51 |
| lifeless | mriedem: python-requests | 2.2.1-1 | trusty | all | 23:51 |
| mordred | clarkb: how would that hook know to edit? | 23:52 |
| lifeless | mriedem: our min python version is also newer than trusty | 23:52 |
| lifeless | mriedem: I guess - perhaps the cloud archive is in use ? | 23:52 |
| mriedem | pip freeze should show the newer versions | 23:52 |
| mordred | clarkb: do you tink we should set an env var in the keystone2 job that shade/tests/functional/hooks/post_test_hook.sh consumes? | 23:52 |
| *** harlowja has quit IRC | 23:52 | |
| clarkb | mordred: commented, so the first thing is that file does not exist when sed runs so it cannot ever work | 23:52 |
| clarkb | mordred: can you explain to me what ou are trying to accomplish? | 23:52 |
| *** harlowja has joined #openstack-infra | 23:52 | |
| openstackgerrit | Augustina Ragwitz proposed openstack/diskimage-builder: Update apt-preferences element README from free text to table formatting https://review.openstack.org/232211 | 23:52 |
| mordred | clarkb: we want to have a versoin of the functional test that runs keystone v2 | 23:53 |
| openstackgerrit | Steve Kowalik proposed openstack-infra/system-config: Move translate.openstack.org to Zanata 3.7.2 https://review.openstack.org/232313 | 23:53 |
| mordred | clarkb: devstack runs both | 23:53 |
| lifeless | mriedem: sure, though right now its the valid 2.8.0 thing | 23:53 |
| mordred | clarkb: but clouds.yaml has entries for v3 auth | 23:53 |
| clarkb | mordred: gotcha, for that I would set an env var that the post hook picks up | 23:53 |
| lifeless | mriedem: do we have any current examples of urllib3 issues? | 23:53 |
| mordred | clarkb: ok. I will do that | 23:53 |
| mriedem | lifeless: yeah sec | 23:53 |
| clarkb | mordred: so in this case SHADE_USE_KEYSTONE_V2 in the hook | 23:53 |
| mriedem | lifeless: http://logs.openstack.org/58/227858/2/gate/gate-python-glanceclient-python26/4cd59e3/ | 23:53 |
| clarkb | mordred: then the .sh that is actually the hook can switch on that | 23:53 |
| mriedem | lifeless: that's a bad example | 23:54 |
| mordred | Shrews: you want to modify your patch to remove the sed scripts and instead set SHADE_USE_KEYSTONE_V2=1 in the job? | 23:54 |
| lifeless | sigmavirus24_awa: what version of requests matched urllib 1.8.3 ? | 23:54 |
| Shrews | mordred: oh, heh, clarkb is totally right. that file won't exist until devstack runs. doh | 23:54 |
| mriedem | since glanceclient doesn't require urllib3 | 23:54 |
| Shrews | mordred: ack | 23:54 |
| clarkb | mordred: for the v2 vs v3 in nodepool thing, IDENTITY_API_VERSION is 2 in that devstack run. I can show you in a sec | 23:54 |
| mordred | Shrews: then we can move the sed logic into the shade repo | 23:54 |
| *** dramalho has joined #openstack-infra | 23:54 | |
| mordred | clarkb: don't bother. I'm with you | 23:54 |
| clarkb | mordred: http://logs.openstack.org/75/195175/25/check/gate-dsvm-nodepool/e86ec36/logs/etc/nodepool/nodepool.yaml.txt.gz ah ok | 23:55 |
| openstackgerrit | Augustina Ragwitz proposed openstack/diskimage-builder: Update apt-preferences element README from free text to table formatting https://review.openstack.org/232211 | 23:55 |
| mriedem | lifeless: from what i can tell, urllib3 in requests was a 'dev' version until requests 2.6.0 when it was 1.10.2 | 23:55 |
| *** dingyichen has joined #openstack-infra | 23:55 | |
| mordred | clarkb: for now, I would like to just land the clouds.yaml change | 23:56 |
| openstackgerrit | Augustina Ragwitz proposed openstack/diskimage-builder: Update rhel7 element readme https://review.openstack.org/222351 | 23:56 |
| *** abitha has quit IRC | 23:56 | |
| mordred | clarkb: which I have +2'd | 23:57 |
| mordred | clarkb: because I want to root-cause the other thing (it's VERY weird) and I also want to eat dinner | 23:57 |
| clarkb | mordred: that works for me | 23:57 |
| openstackgerrit | Augustina Ragwitz proposed openstack/diskimage-builder: Update apt-conf elements README from free text to table formatting https://review.openstack.org/231770 | 23:57 |
| *** thorst has joined #openstack-infra | 23:58 | |
| mordred | maybe jhesketh or pleia2 will +3 https://review.openstack.org/#/c/208114/5 for us ... | 23:58 |
| lifeless | mriedem: thats a 2.8.0 run | 23:58 |
| lifeless | keystoneclient==1.7.2,python-mimeparse==0.1.4,python-subunit==1.1.0,pytz==2015.6,repoze.lru==0.6,requests==2.8.0,requests- | 23:58 |
| pleia2 | I'll have a look | 23:58 |
| lifeless | mriedem: ^ | 23:58 |
| lifeless | http://logs.openstack.org/58/227858/2/gate/gate-python-glanceclient-python26/4cd59e3/console.html#_2015-10-07_23_16_05_353 | 23:58 |
| mriedem | lifeless: yeah | 23:59 |
| mriedem | urllib3 isn't in there on it's own | 23:59 |
| lifeless | ok | 23:59 |
| *** thorst has quit IRC | 23:59 | |
| mriedem | it would be in a devstack run b/c glance requires oslo.vmware and oslo.vmware requires urllib3 | 23:59 |
| lifeless | mriedem: but 2.8.0 is independently broken AIUI | 23:59 |
| *** dramalho has quit IRC | 23:59 | |
| mriedem | only in the glanceclient unit tests b/c it doesn't use upper-constraints | 23:59 |
| openstackgerrit | Augustina Ragwitz proposed openstack/diskimage-builder: Update rhel7 element readme https://review.openstack.org/222351 | 23:59 |
| mriedem | not broken in dsvm jobs b/c of upper-constraints on requests at 2.7.0 | 23:59 |
| lifeless | mriedem: but in devstack we don't install the system requests do we? | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!