| *** arnaud has joined #openstack-infra | 00:00 | |
| *** arnaud__ has joined #openstack-infra | 00:01 | |
| *** sparkycollier has joined #openstack-infra | 00:01 | |
| *** salv-orlando has quit IRC | 00:02 | |
| *** atiwari has quit IRC | 00:02 | |
| *** MarkAtwood has quit IRC | 00:03 | |
| *** itoperatorguy89 has joined #openstack-infra | 00:05 | |
| *** itoperatorguy has quit IRC | 00:06 | |
| *** vermarah_ has quit IRC | 00:08 | |
| *** chuckC has joined #openstack-infra | 00:09 | |
| *** SumitNaiksatam_ has joined #openstack-infra | 00:09 | |
| *** sweston has quit IRC | 00:10 | |
| *** wenlock has quit IRC | 00:11 | |
| *** SumitNaiksatam has quit IRC | 00:11 | |
| *** SumitNaiksatam_ is now known as SumitNaiksatam | 00:11 | |
| *** sparkycollier has quit IRC | 00:12 | |
| *** sweston has joined #openstack-infra | 00:12 | |
| *** derekh_ has joined #openstack-infra | 00:12 | |
| *** dprince has joined #openstack-infra | 00:15 | |
| *** dkliban_afk is now known as dkliban | 00:17 | |
| *** xianghui has joined #openstack-infra | 00:19 | |
| *** zehicle_at_dell has quit IRC | 00:19 | |
| *** lcheng has quit IRC | 00:20 | |
| *** SumitNaiksatam has quit IRC | 00:26 | |
| *** otherwiseguy has quit IRC | 00:27 | |
| *** otherwiseguy has joined #openstack-infra | 00:27 | |
| *** homeless_ has joined #openstack-infra | 00:37 | |
| *** homeless has quit IRC | 00:37 | |
| *** timrc is now known as timrc-afk | 00:38 | |
| *** otherwiseguy has quit IRC | 00:39 | |
| *** terryw has joined #openstack-infra | 00:39 | |
| *** marcoemorais has quit IRC | 00:40 | |
| *** ArxCruz has joined #openstack-infra | 00:40 | |
| *** unicell has joined #openstack-infra | 00:40 | |
| *** xianghui has quit IRC | 00:40 | |
| openstackgerrit | Ian Wienand proposed a change to openstack-infra/devstack-gate: Move PATH set earlier https://review.openstack.org/108869 | 00:41 |
|---|---|---|
| *** marcoemorais has joined #openstack-infra | 00:41 | |
| *** homeless_ has quit IRC | 00:42 | |
| bodepd | does zuul require libxml and libxslt dev headers to compile? | 00:42 |
| *** mmaglana has quit IRC | 00:43 | |
| *** dims_ has quit IRC | 00:44 | |
| mordred | hrm. python-jenkins might | 00:45 |
| *** homeless has joined #openstack-infra | 00:46 | |
| *** cody-somerville has quit IRC | 00:47 | |
| mordred | bodepd: nope. not python-jenkins .. I'd have to look further to see if one of the deps does | 00:47 |
| *** jaypipes has quit IRC | 00:50 | |
| mordred | bodepd: nope. not required | 00:50 |
| mordred | bodepd: c compiler is required - that's about it | 00:51 |
| *** yamamoto has quit IRC | 00:52 | |
| mordred | oh - wait - one more thing ... python-dev ... lemme give you a full list in just a sec | 00:52 |
| *** adalbas has quit IRC | 00:52 | |
| *** xianghui has joined #openstack-infra | 00:53 | |
| mordred | bodepd: python-dev and build-essential in a base ubuntu is all I needed to install | 00:53 |
| jogo | 133 patches merged in openstack/openstack today | 00:59 |
| jogo | not bad | 00:59 |
| *** bknudson has joined #openstack-infra | 01:01 | |
| *** crc32 has quit IRC | 01:01 | |
| *** mriedem has joined #openstack-infra | 01:02 | |
| *** adalbas has joined #openstack-infra | 01:03 | |
| *** moted has quit IRC | 01:04 | |
| *** crc32 has joined #openstack-infra | 01:06 | |
| *** crc32 has quit IRC | 01:07 | |
| *** dims_ has joined #openstack-infra | 01:09 | |
| *** cpallares has joined #openstack-infra | 01:11 | |
| *** rainya has quit IRC | 01:13 | |
| *** krtaylor has quit IRC | 01:13 | |
| *** rainya has joined #openstack-infra | 01:14 | |
| *** ramashri has quit IRC | 01:18 | |
| *** shashankhegde has quit IRC | 01:18 | |
| *** oomichi has quit IRC | 01:20 | |
| *** yamamoto_ has joined #openstack-infra | 01:22 | |
| *** mriedem has quit IRC | 01:23 | |
| *** krtaylor has joined #openstack-infra | 01:23 | |
| *** mriedem has joined #openstack-infra | 01:24 | |
| *** yamamoto_ has quit IRC | 01:27 | |
| *** m1dev has quit IRC | 01:27 | |
| *** m1dev has joined #openstack-infra | 01:28 | |
| *** spiffxp has quit IRC | 01:29 | |
| *** spiffxp has joined #openstack-infra | 01:30 | |
| *** yaguang has joined #openstack-infra | 01:30 | |
| *** kevinbenton has quit IRC | 01:33 | |
| *** kevinbenton has joined #openstack-infra | 01:33 | |
| *** oanufriev has quit IRC | 01:33 | |
| *** oanufriev has joined #openstack-infra | 01:34 | |
| *** gema_ has quit IRC | 01:34 | |
| *** itoperatorguy89 has quit IRC | 01:34 | |
| *** gema has joined #openstack-infra | 01:34 | |
| *** james_li has joined #openstack-infra | 01:36 | |
| *** Ryan_Lane has quit IRC | 01:36 | |
| *** itoperatorguy has joined #openstack-infra | 01:36 | |
| *** itoperatorguy has quit IRC | 01:37 | |
| *** marcoemorais has quit IRC | 01:39 | |
| *** yamamoto_ has joined #openstack-infra | 01:41 | |
| *** yamahata has joined #openstack-infra | 01:43 | |
| *** morganfainberg has quit IRC | 01:47 | |
| *** morganfainberg has joined #openstack-infra | 01:47 | |
| *** morganfainberg is now known as captainmorgan | 01:49 | |
| *** morganfainberg_Z has joined #openstack-infra | 01:49 | |
| *** morganfainberg_Z is now known as morganfainberg | 01:50 | |
| *** yamamoto_ has quit IRC | 01:50 | |
| *** nosnos has joined #openstack-infra | 01:50 | |
| *** morganfainberg is now known as captainmorgan | 01:50 | |
| *** gangil has joined #openstack-infra | 01:52 | |
| *** baohua has joined #openstack-infra | 01:53 | |
| *** Sukhdev has joined #openstack-infra | 01:57 | |
| *** captainmorgan is now known as morganfainberg | 01:58 | |
| *** camunoz has joined #openstack-infra | 02:01 | |
| *** timrc-afk is now known as timrc | 02:05 | |
| *** dprince has quit IRC | 02:10 | |
| *** ramashri has joined #openstack-infra | 02:11 | |
| *** jcoufal has quit IRC | 02:13 | |
| *** ramashri has quit IRC | 02:15 | |
| *** ramashri has joined #openstack-infra | 02:16 | |
| *** yamamoto_ has joined #openstack-infra | 02:16 | |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for nova test_cidr_repr bug 1330763 https://review.openstack.org/108878 | 02:16 |
| uvirtbot | Launchpad bug 1330763 in nova "PostgrestSQLOpportunisticFixture fails with no attribute named _details" [Medium,Triaged] https://launchpad.net/bugs/1330763 | 02:16 |
| *** Sukhdev has quit IRC | 02:17 | |
| *** Sukhdev has joined #openstack-infra | 02:17 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for nova test_cidr_repr bug 1330763 https://review.openstack.org/108878 | 02:21 |
| uvirtbot | Launchpad bug 1330763 in nova "PostgrestSQLOpportunisticFixture fails with no attribute named _details" [Medium,Triaged] https://launchpad.net/bugs/1330763 | 02:21 |
| *** Sukhdev has quit IRC | 02:21 | |
| *** changbl has joined #openstack-infra | 02:24 | |
| *** baohua has quit IRC | 02:30 | |
| *** baohua has joined #openstack-infra | 02:31 | |
| *** amotoki has joined #openstack-infra | 02:38 | |
| *** mmaglana has joined #openstack-infra | 02:40 | |
| *** adalbas has quit IRC | 02:41 | |
| *** james_li has quit IRC | 02:42 | |
| *** wenlock has joined #openstack-infra | 02:43 | |
| *** mriedem has quit IRC | 02:46 | |
| *** ramashri has quit IRC | 02:48 | |
| *** liusheng has joined #openstack-infra | 02:55 | |
| *** talluri has joined #openstack-infra | 02:59 | |
| *** mmaglana has quit IRC | 03:00 | |
| *** gyee has quit IRC | 03:02 | |
| *** rainya has quit IRC | 03:08 | |
| *** homeless has quit IRC | 03:11 | |
| *** arnaud__ has quit IRC | 03:13 | |
| *** arnaud has quit IRC | 03:13 | |
| *** cpallares has quit IRC | 03:13 | |
| *** arnaud has joined #openstack-infra | 03:14 | |
| *** arnaud__ has joined #openstack-infra | 03:14 | |
| *** arnaud has quit IRC | 03:14 | |
| *** mriedem has joined #openstack-infra | 03:15 | |
| *** harlowja is now known as harlowja_away | 03:15 | |
| *** arnaud__ has quit IRC | 03:18 | |
| *** dims_ has quit IRC | 03:19 | |
| *** yfried_ has joined #openstack-infra | 03:25 | |
| *** nati_ueno has joined #openstack-infra | 03:25 | |
| *** talluri has quit IRC | 03:25 | |
| *** mriedem has quit IRC | 03:25 | |
| *** talluri has joined #openstack-infra | 03:26 | |
| *** nosnos has quit IRC | 03:29 | |
| *** nosnos has joined #openstack-infra | 03:29 | |
| *** talluri has quit IRC | 03:31 | |
| *** nosnos has quit IRC | 03:33 | |
| *** talluri has joined #openstack-infra | 03:34 | |
| *** camunoz has quit IRC | 03:38 | |
| *** talluri has quit IRC | 03:44 | |
| *** talluri has joined #openstack-infra | 03:46 | |
| *** dims_ has joined #openstack-infra | 03:46 | |
| *** praneshp has quit IRC | 03:47 | |
| *** james_li has joined #openstack-infra | 03:48 | |
| *** camunoz has joined #openstack-infra | 03:51 | |
| *** dims_ has quit IRC | 03:51 | |
| *** wenlock has quit IRC | 03:54 | |
| *** wenlock has joined #openstack-infra | 03:56 | |
| *** timrc is now known as timrc-afk | 03:57 | |
| *** dkliban is now known as dkliban_afk | 04:02 | |
| *** flaviof_zzz is now known as flaviof | 04:02 | |
| *** arnaud has joined #openstack-infra | 04:07 | |
| *** eharney has quit IRC | 04:09 | |
| *** garyh has quit IRC | 04:09 | |
| *** rainya has joined #openstack-infra | 04:10 | |
| *** talluri has quit IRC | 04:10 | |
| *** talluri has joined #openstack-infra | 04:11 | |
| *** lcheng has joined #openstack-infra | 04:13 | |
| *** nosnos has joined #openstack-infra | 04:14 | |
| *** garyh has joined #openstack-infra | 04:14 | |
| *** talluri has quit IRC | 04:15 | |
| *** praneshp has joined #openstack-infra | 04:17 | |
| *** camunoz has quit IRC | 04:19 | |
| *** Longgeek has joined #openstack-infra | 04:19 | |
| *** HenryG is now known as HenryG_afk | 04:19 | |
| *** Longgeek has quit IRC | 04:19 | |
| *** oomichi has joined #openstack-infra | 04:19 | |
| *** flaviof is now known as flaviof_zzz | 04:20 | |
| *** sasik_ has joined #openstack-infra | 04:20 | |
| *** cdub has quit IRC | 04:20 | |
| *** yfried_ has quit IRC | 04:25 | |
| *** talluri has joined #openstack-infra | 04:25 | |
| *** Longgeek has joined #openstack-infra | 04:26 | |
| *** james_li has quit IRC | 04:27 | |
| *** rainya has quit IRC | 04:28 | |
| *** Longgeek has quit IRC | 04:29 | |
| *** Longgeek has joined #openstack-infra | 04:29 | |
| *** wenlock has quit IRC | 04:30 | |
| *** camunoz has joined #openstack-infra | 04:30 | |
| *** armax has left #openstack-infra | 04:32 | |
| *** lcheng has quit IRC | 04:33 | |
| *** praneshp_ has joined #openstack-infra | 04:34 | |
| *** Longgeek has quit IRC | 04:34 | |
| *** Longgeek has joined #openstack-infra | 04:36 | |
| *** praneshp has quit IRC | 04:37 | |
| *** praneshp_ is now known as praneshp | 04:37 | |
| *** talluri has quit IRC | 04:40 | |
| *** talluri has joined #openstack-infra | 04:40 | |
| *** talluri has quit IRC | 04:45 | |
| *** Longgeek_ has joined #openstack-infra | 04:45 | |
| *** msabramo has joined #openstack-infra | 04:47 | |
| *** melwitt has quit IRC | 04:48 | |
| *** rainya has joined #openstack-infra | 04:48 | |
| *** Longgeek has quit IRC | 04:48 | |
| *** jpeeler has quit IRC | 04:52 | |
| *** msabramo has quit IRC | 04:58 | |
| *** ildikov has quit IRC | 04:59 | |
| *** MarkAtwood has joined #openstack-infra | 05:05 | |
| *** changbl has quit IRC | 05:07 | |
| *** jpeeler has joined #openstack-infra | 05:10 | |
| *** camunoz has quit IRC | 05:11 | |
| *** camunoz has joined #openstack-infra | 05:11 | |
| nibalizer | bodepd: i usually need to install those headers to build nokogiri | 05:14 |
| nibalizer | not related to your problem likely | 05:14 |
| *** chandankumar has joined #openstack-infra | 05:18 | |
| *** chandankumar_ has joined #openstack-infra | 05:20 | |
| *** msabramo has joined #openstack-infra | 05:21 | |
| *** rlandy has joined #openstack-infra | 05:21 | |
| *** chandankumar has quit IRC | 05:22 | |
| *** terryw has quit IRC | 05:22 | |
| *** melwitt has joined #openstack-infra | 05:23 | |
| *** sabeen1 has joined #openstack-infra | 05:23 | |
| *** melwitt has quit IRC | 05:23 | |
| *** sabeen has quit IRC | 05:25 | |
| *** andreykurilin has joined #openstack-infra | 05:27 | |
| *** ciypro|afk has quit IRC | 05:28 | |
| *** chandankumar_ is now known as chandankumar | 05:28 | |
| *** harlowja_at_home has joined #openstack-infra | 05:30 | |
| *** derekh_ has quit IRC | 05:31 | |
| *** msabramo has quit IRC | 05:33 | |
| *** k4n0 has joined #openstack-infra | 05:33 | |
| *** harlowja_still_a has joined #openstack-infra | 05:33 | |
| *** pcrews has quit IRC | 05:34 | |
| *** nosnos has quit IRC | 05:35 | |
| *** harlowja_at_home has quit IRC | 05:36 | |
| *** nosnos has joined #openstack-infra | 05:36 | |
| *** e0ne has joined #openstack-infra | 05:36 | |
| *** jdahlin_ has quit IRC | 05:37 | |
| *** e0ne has quit IRC | 05:40 | |
| *** nosnos has quit IRC | 05:41 | |
| *** e0ne has joined #openstack-infra | 05:44 | |
| *** naggappan has joined #openstack-infra | 05:45 | |
| *** arnaud has quit IRC | 05:46 | |
| *** afazekas has quit IRC | 05:47 | |
| *** e0ne has quit IRC | 05:48 | |
| *** amitpp has joined #openstack-infra | 05:49 | |
| *** amitpp has quit IRC | 05:49 | |
| *** dims has joined #openstack-infra | 05:50 | |
| *** e0ne has joined #openstack-infra | 05:52 | |
| *** e0ne has quit IRC | 05:54 | |
| *** dims has quit IRC | 05:55 | |
| *** harlowja_still_a has quit IRC | 05:57 | |
| *** harlowja_at_home has joined #openstack-infra | 05:57 | |
| *** camunoz has quit IRC | 05:57 | |
| *** camunoz has joined #openstack-infra | 05:58 | |
| *** MarkAtwood has quit IRC | 05:58 | |
| *** e0ne has joined #openstack-infra | 05:58 | |
| *** nosnos has joined #openstack-infra | 05:59 | |
| *** e0ne has quit IRC | 06:01 | |
| *** harlowja_at_home has quit IRC | 06:12 | |
| *** andreykurilin has quit IRC | 06:13 | |
| *** e0ne has joined #openstack-infra | 06:13 | |
| *** ildikov has joined #openstack-infra | 06:13 | |
| *** e0ne has quit IRC | 06:15 | |
| *** lukego has joined #openstack-infra | 06:15 | |
| *** ociuhandu has quit IRC | 06:16 | |
| *** ociuhandu_ has joined #openstack-infra | 06:17 | |
| openstackgerrit | ChingWei Chang proposed a change to openstack-infra/config: Prepared for new project puppet-n1k-vsm, 2nd round amended, with conflicts resolved https://review.openstack.org/102662 | 06:17 |
| *** e0ne has joined #openstack-infra | 06:19 | |
| *** e0ne has quit IRC | 06:20 | |
| *** p5ntangle has joined #openstack-infra | 06:22 | |
| *** e0ne has joined #openstack-infra | 06:24 | |
| *** afazekas has joined #openstack-infra | 06:26 | |
| openstackgerrit | David Pursehouse proposed a change to openstack-infra/jenkins-job-builder: SCM: rename `self` arguments to `parser` https://review.openstack.org/106942 | 06:26 |
| *** salv-orlando has joined #openstack-infra | 06:27 | |
| *** p5ntangle has quit IRC | 06:29 | |
| *** e0ne has quit IRC | 06:32 | |
| *** rainya has quit IRC | 06:33 | |
| *** ociuhandu_ has quit IRC | 06:34 | |
| *** _nadya_ has joined #openstack-infra | 06:35 | |
| *** e0ne has joined #openstack-infra | 06:35 | |
| *** daya_k has quit IRC | 06:36 | |
| *** e0ne has quit IRC | 06:38 | |
| *** e0ne has joined #openstack-infra | 06:42 | |
| *** e0ne has quit IRC | 06:45 | |
| *** IvanBerezovskiy has joined #openstack-infra | 06:46 | |
| *** yfried_ has joined #openstack-infra | 06:47 | |
| *** e0ne has joined #openstack-infra | 06:49 | |
| *** e0ne has quit IRC | 06:51 | |
| *** e0ne has joined #openstack-infra | 06:55 | |
| *** alexandra has joined #openstack-infra | 06:57 | |
| *** lukego has quit IRC | 06:57 | |
| *** asettle has quit IRC | 06:59 | |
| *** alexandra is now known as asettle | 06:59 | |
| *** e0ne has quit IRC | 07:00 | |
| *** lukego has joined #openstack-infra | 07:03 | |
| *** lukego has quit IRC | 07:04 | |
| *** lukego has joined #openstack-infra | 07:06 | |
| *** luqas has joined #openstack-infra | 07:07 | |
| *** camunoz is now known as camunoz_gone | 07:07 | |
| *** jistr has joined #openstack-infra | 07:19 | |
| *** eglynn has joined #openstack-infra | 07:19 | |
| *** dizquierdo has joined #openstack-infra | 07:30 | |
| *** Guest13108 has joined #openstack-infra | 07:40 | |
| bmwiedemann | fungi: good morning. one thing I wondered about: why did you need sudo to re-trigger the failed jenkins job for post tarball publishing? | 07:41 |
| *** _nadya_ has quit IRC | 07:42 | |
| *** e0ne has joined #openstack-infra | 07:44 | |
| *** ArxCruz has quit IRC | 07:48 | |
| *** laxity has joined #openstack-infra | 07:48 | |
| *** dims has joined #openstack-infra | 07:53 | |
| openstackgerrit | Bernhard M. Wiedemann proposed a change to openstack-infra/config: Use review.openstack.org in examples https://review.openstack.org/107655 | 07:53 |
| *** eglynn is now known as eglynn-afk | 07:56 | |
| *** dims has quit IRC | 07:58 | |
| *** lcheng has joined #openstack-infra | 08:01 | |
| *** gangil has quit IRC | 08:04 | |
| *** skolekonov has joined #openstack-infra | 08:04 | |
| bodepd | mordred: I was seeing a compile failure for the Exec. I fixed it by adding those deps, but also by setting a dep on some other packages | 08:07 |
| bodepd | Exec[install-zuul] | 08:07 |
| bodepd | mordred: too bad I missed you in pdx | 08:07 |
| *** jedimike has joined #openstack-infra | 08:08 | |
| *** eglynn-afk has quit IRC | 08:09 | |
| *** sasik_ has left #openstack-infra | 08:13 | |
| *** mrda is now known as mrda-away | 08:14 | |
| *** daya_k has joined #openstack-infra | 08:22 | |
| *** yamamoto_ has quit IRC | 08:23 | |
| *** ihrachyshka has joined #openstack-infra | 08:26 | |
| *** che-arne has joined #openstack-infra | 08:26 | |
| *** andreaf has quit IRC | 08:29 | |
| *** salv-orlando has quit IRC | 08:29 | |
| *** andreaf has joined #openstack-infra | 08:30 | |
| *** andreaf_ has joined #openstack-infra | 08:30 | |
| *** lcheng has quit IRC | 08:30 | |
| *** ihrachyshka has quit IRC | 08:30 | |
| *** ihrachyshka has joined #openstack-infra | 08:31 | |
| *** lcheng has joined #openstack-infra | 08:31 | |
| *** jlibosva has joined #openstack-infra | 08:31 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 08:34 | |
| *** bauzas has joined #openstack-infra | 08:36 | |
| *** p5ntangle has joined #openstack-infra | 08:39 | |
| *** p5ntangle has quit IRC | 08:39 | |
| *** p5ntangle has joined #openstack-infra | 08:39 | |
| *** praneshp has quit IRC | 08:41 | |
| *** andreaf_ has quit IRC | 08:41 | |
| *** dizquierdo has quit IRC | 08:41 | |
| *** dizquierdo has joined #openstack-infra | 08:42 | |
| *** ociuhandu_ has joined #openstack-infra | 08:46 | |
| *** alexpilotti_ has joined #openstack-infra | 08:47 | |
| *** andreykurilin has joined #openstack-infra | 08:48 | |
| openstackgerrit | yolanda.robla proposed a change to openstack-infra/nodepool: Build images using diskimage-builder https://review.openstack.org/46482 | 08:48 |
| *** alexpilotti has quit IRC | 08:48 | |
| *** alexpilotti_ is now known as alexpilotti | 08:48 | |
| *** yamamoto_ has joined #openstack-infra | 08:49 | |
| *** lcheng has quit IRC | 08:49 | |
| *** dims has joined #openstack-infra | 08:53 | |
| *** dims has quit IRC | 08:58 | |
| *** yamamoto_ has quit IRC | 08:58 | |
| *** p5ntangle has quit IRC | 09:00 | |
| *** andreykurilin has quit IRC | 09:01 | |
| *** hashar has joined #openstack-infra | 09:01 | |
| *** eglynn-afk has joined #openstack-infra | 09:01 | |
| *** pelix has joined #openstack-infra | 09:01 | |
| *** p5ntangle has joined #openstack-infra | 09:04 | |
| *** dtantsur|afk is now known as dtantsur | 09:04 | |
| *** denis_makogon has joined #openstack-infra | 09:05 | |
| *** yamamoto_ has joined #openstack-infra | 09:05 | |
| *** nati_ueno has quit IRC | 09:10 | |
| *** che-arne has quit IRC | 09:13 | |
| *** yamamoto_ has quit IRC | 09:14 | |
| *** pblaho has joined #openstack-infra | 09:15 | |
| *** p5ntangl_ has joined #openstack-infra | 09:19 | |
| *** p5ntangle has quit IRC | 09:20 | |
| *** rlandy has quit IRC | 09:25 | |
| *** jyuso has quit IRC | 09:28 | |
| *** oomichi has quit IRC | 09:29 | |
| *** tiantian has joined #openstack-infra | 09:31 | |
| tiantian | hi, It seems that my patch(105110) blocks the gate jobs, see http://status.openstack.org/zuul/, the gate-tempest-dsvm-postgres-full job, there is no result long time, what should I do? or just wait? | 09:32 |
| *** qba73 has joined #openstack-infra | 09:34 | |
| *** berendt has joined #openstack-infra | 09:35 | |
| tiantian | hi, It seems that my patch(105110) blocks the gate jobs, see http://status.openstack.org/zuul/, the gate-tempest-dsvm-postgres-full job, there is no result long time, what should I do? or just wait? | 09:37 |
| *** Evgeny has quit IRC | 09:37 | |
| *** oanufriev has quit IRC | 09:37 | |
| *** cristov_macbook has joined #openstack-infra | 09:39 | |
| *** cristov_macbook has quit IRC | 09:39 | |
| *** cristov_macbook has joined #openstack-infra | 09:41 | |
| *** cristov_macbook has quit IRC | 09:41 | |
| *** qba73 has quit IRC | 09:42 | |
| *** qba73 has joined #openstack-infra | 09:44 | |
| *** yamamoto has joined #openstack-infra | 09:44 | |
| *** cristov_macbook has joined #openstack-infra | 09:45 | |
| *** cristov_macbook has quit IRC | 09:45 | |
| *** cristov_macbook has joined #openstack-infra | 09:46 | |
| *** cristov_macbook has quit IRC | 09:47 | |
| *** cristov_macbook has joined #openstack-infra | 09:49 | |
| *** amotoki has quit IRC | 09:49 | |
| *** cristov_macbook has quit IRC | 09:49 | |
| *** yamamoto has quit IRC | 09:50 | |
| *** cristov_macbook has joined #openstack-infra | 09:52 | |
| *** cristov_macbook has quit IRC | 09:52 | |
| *** unicell has quit IRC | 09:56 | |
| *** che-arne has joined #openstack-infra | 09:58 | |
| *** lukego has quit IRC | 09:59 | |
| *** jgallard has joined #openstack-infra | 10:09 | |
| *** nosnos has quit IRC | 10:09 | |
| sdague | SergeyLukjanov: you about? | 10:12 |
| sdague | it looks like jenkins05 is dead | 10:12 |
| sdague | or jhesketh | 10:12 |
| *** _nadya_ has joined #openstack-infra | 10:14 | |
| *** jgallard has quit IRC | 10:14 | |
| *** salv-orlando has joined #openstack-infra | 10:17 | |
| *** dizquierdo has quit IRC | 10:20 | |
| rcarrillocruz | hey folks | 10:21 |
| rcarrillocruz | in regards to specs | 10:21 |
| rcarrillocruz | should I open a launchpad blueprint or should I start a Storyboard story , prior to pushing the spec to infra-specs? | 10:21 |
| rcarrillocruz | https://wiki.openstack.org/wiki/Blueprints#Spec_.2B_Blueprints_lifecycle | 10:21 |
| *** qba73 has quit IRC | 10:22 | |
| rcarrillocruz | it says there i should open it in launchpad, but i think i was told at some point i'd rather open it in storyboard (the template.rst also points to go with Storyboard) | 10:22 |
| *** yaguang has quit IRC | 10:26 | |
| *** pcm_ has joined #openstack-infra | 10:28 | |
| *** jlibosva has quit IRC | 10:29 | |
| *** flaper87 has quit IRC | 10:29 | |
| *** pcm_ has quit IRC | 10:29 | |
| *** roeyc has joined #openstack-infra | 10:29 | |
| *** roeyc has left #openstack-infra | 10:29 | |
| *** pbelanyi has quit IRC | 10:29 | |
| *** afazekas has quit IRC | 10:29 | |
| *** pblaho has quit IRC | 10:29 | |
| *** jistr has quit IRC | 10:29 | |
| *** dtantsur has quit IRC | 10:30 | |
| *** ihrachyshka has quit IRC | 10:30 | |
| *** pcm_ has joined #openstack-infra | 10:30 | |
| *** pblaho has joined #openstack-infra | 10:30 | |
| *** andreykurilin has joined #openstack-infra | 10:31 | |
| *** yamamoto has joined #openstack-infra | 10:33 | |
| *** andreykurilin has quit IRC | 10:35 | |
| *** flaper87|afk has joined #openstack-infra | 10:37 | |
| *** dtantsur has joined #openstack-infra | 10:37 | |
| *** flaper87|afk is now known as flaper87 | 10:37 | |
| *** ihrachyshka has joined #openstack-infra | 10:37 | |
| *** jlibosva has joined #openstack-infra | 10:37 | |
| *** pbelanyi has joined #openstack-infra | 10:37 | |
| *** jistr has joined #openstack-infra | 10:38 | |
| *** yamamoto has quit IRC | 10:38 | |
| *** afazekas has joined #openstack-infra | 10:38 | |
| *** yamahata has quit IRC | 10:39 | |
| *** ihrachyshka has quit IRC | 10:39 | |
| *** hashar is now known as hasharLunch | 10:40 | |
| *** Guest13108 has quit IRC | 10:45 | |
| *** dims has joined #openstack-infra | 10:45 | |
| *** p5ntangle has joined #openstack-infra | 10:45 | |
| *** p5ntangl_ has quit IRC | 10:46 | |
| *** nimrodsun has joined #openstack-infra | 10:46 | |
| *** berendt has quit IRC | 10:48 | |
| *** p5ntangl_ has joined #openstack-infra | 10:48 | |
| *** chuckC has quit IRC | 10:48 | |
| *** p5ntangle has quit IRC | 10:51 | |
| *** hasharLunch has quit IRC | 10:51 | |
| *** jedimike has quit IRC | 10:52 | |
| *** p5ntangl_ has quit IRC | 10:54 | |
| *** p5ntangle has joined #openstack-infra | 10:55 | |
| *** jedimike has joined #openstack-infra | 10:56 | |
| *** rcarrill` has joined #openstack-infra | 10:56 | |
| *** p5ntangle has quit IRC | 10:56 | |
| *** rcarrillocruz has quit IRC | 10:57 | |
| *** p5ntangle has joined #openstack-infra | 10:57 | |
| *** p5ntangl_ has joined #openstack-infra | 11:02 | |
| *** p5ntangl_ has quit IRC | 11:03 | |
| *** p5ntangl_ has joined #openstack-infra | 11:04 | |
| *** e0ne has quit IRC | 11:04 | |
| *** hashar has joined #openstack-infra | 11:05 | |
| *** p5ntangle has quit IRC | 11:05 | |
| *** yamamoto has joined #openstack-infra | 11:06 | |
| jhesketh | sdague: yep, I'm around | 11:06 |
| jhesketh | but I have no root/access to anything | 11:06 |
| sdague | do you have the ability to shoot jenkins05 in the head? | 11:06 |
| sdague | ok | 11:06 |
| sdague | any non root way to pull it out of rotation? | 11:06 |
| *** p5ntangl_ has quit IRC | 11:08 | |
| *** p5ntangle has joined #openstack-infra | 11:09 | |
| jhesketh | afaik jenkins is connected to gearman by hand | 11:09 |
| jhesketh | so I'd need to be able to log in | 11:09 |
| *** yamamoto has quit IRC | 11:11 | |
| jhesketh | sdague: I'm not able to connect to jenkins05 so it shouldn't accept any more jobs | 11:12 |
| *** chuckC has joined #openstack-infra | 11:12 | |
| sdague | ok, so if I kick things that are stuck, it won't get scheduled to? | 11:12 |
| *** p5ntangle has quit IRC | 11:13 | |
| *** p5ntangle has joined #openstack-infra | 11:14 | |
| sdague | well, giving it a shot anyway | 11:14 |
| *** e0ne has joined #openstack-infra | 11:15 | |
| *** p5ntangle has quit IRC | 11:17 | |
| *** p5ntangle has joined #openstack-infra | 11:18 | |
| *** p5ntangle has quit IRC | 11:18 | |
| *** cnesa has joined #openstack-infra | 11:18 | |
| *** p5ntangle has joined #openstack-infra | 11:19 | |
| *** p5ntangle has quit IRC | 11:21 | |
| *** p5ntangle has joined #openstack-infra | 11:22 | |
| *** cnesa has quit IRC | 11:23 | |
| *** jamielennox is now known as jamielennox|away | 11:26 | |
| *** p5ntangle has quit IRC | 11:26 | |
| *** eglynn has joined #openstack-infra | 11:26 | |
| *** p5ntangle has joined #openstack-infra | 11:27 | |
| *** chuckC has quit IRC | 11:27 | |
| *** ihrachyshka has joined #openstack-infra | 11:30 | |
| *** eglynn-afk has quit IRC | 11:31 | |
| *** lukego has joined #openstack-infra | 11:34 | |
| *** lukego has quit IRC | 11:34 | |
| *** p5ntangle has quit IRC | 11:36 | |
| *** alexpilotti has quit IRC | 11:37 | |
| *** p5ntangle has joined #openstack-infra | 11:37 | |
| *** dkliban_afk is now known as dkliban | 11:41 | |
| *** ChuckC has joined #openstack-infra | 11:41 | |
| *** jcoufal has joined #openstack-infra | 11:43 | |
| *** yamamoto has joined #openstack-infra | 11:45 | |
| jhesketh | sdague: it shouldn't, but I'm unsure what's actually going on | 11:46 |
| *** adalbas has joined #openstack-infra | 11:46 | |
| *** p5ntangle has quit IRC | 11:47 | |
| *** chandankumar has quit IRC | 11:47 | |
| *** p5ntangle has joined #openstack-infra | 11:47 | |
| AJaeger | jhesketh, SergeyLukjanov : Could you review and approve https://review.openstack.org/108464 once you're finished with firefighting, please? | 11:47 |
| *** eglynn has quit IRC | 11:47 | |
| *** chandankumar has joined #openstack-infra | 11:49 | |
| *** p5ntangle has quit IRC | 11:49 | |
| *** p5ntangle has joined #openstack-infra | 11:50 | |
| *** yamamoto has quit IRC | 11:50 | |
| *** p5ntangle has quit IRC | 11:50 | |
| *** p5ntangle has joined #openstack-infra | 11:50 | |
| *** yamahata has joined #openstack-infra | 11:52 | |
| bauzas | hi folks, I got 2 questions for you | 11:52 |
| bauzas | turbo-hipster seems to be in a bad shape, because it has a false positive on https://review.openstack.org/82778 , and 'recheck migrations' haven't yet done | 11:53 |
| bauzas | so I'm wondering how I can help | 11:53 |
| bauzas | and how I can check if turbo-hipster noticed it has to review again a patch | 11:53 |
| *** p5ntangl_ has joined #openstack-infra | 11:53 | |
| *** unicell has joined #openstack-infra | 11:54 | |
| *** p5ntangl_ has quit IRC | 11:54 | |
| bauzas | jhesketh: ^ ? | 11:54 |
| *** p5ntangl_ has joined #openstack-infra | 11:55 | |
| *** mbacchi has joined #openstack-infra | 11:55 | |
| *** p5ntangle has quit IRC | 11:56 | |
| jhesketh | bauzas: Thanks, I'll take a look | 11:56 |
| bauzas | jhesketh: do you need help ? | 11:56 |
| jhesketh | I don't think so, but thanks | 11:56 |
| bauzas | jhesketh: sure | 11:56 |
| jhesketh | it seems like our zuul is failing to listen to gerrit which is why it missed the recheck | 11:57 |
| bauzas | jhesketh: oh right | 11:57 |
| *** p5ntangl_ has quit IRC | 11:57 | |
| bauzas | jhesketh: any chances to see the zuul pipeline from your CI ? | 11:57 |
| jhesketh | bauzas: http://zuul.rcbops.com/ | 11:57 |
| bauzas | jhesketh: so I could give you a first troubleshoot diagnostic next time | 11:57 |
| *** yamamoto has joined #openstack-infra | 11:57 | |
| bauzas | jhesketh: cool thank | 11:57 |
| *** p5ntangle has joined #openstack-infra | 11:58 | |
| jhesketh | there's a bit of a backlog | 11:58 |
| bauzas | jhesketh: yeah | 11:58 |
| *** p5ntangle has quit IRC | 11:58 | |
| jhesketh | it's re-doing the ones it missed first | 11:58 |
| * bauzas is bookmarking now | 11:58 | |
| *** p5ntangle has joined #openstack-infra | 11:58 | |
| bauzas | on a separate topic, I'm trying to do a custom dashboard with a long URI | 11:59 |
| bauzas | (Gerrit dashboard) | 11:59 |
| *** cnesa has joined #openstack-infra | 11:59 | |
| bauzas | it returns me an HTTP 414 | 11:59 |
| *** leifmadsen has quit IRC | 11:59 | |
| bauzas | so I'm wondering how we can increase this limit | 11:59 |
| bauzas | sdague: ^? | 11:59 |
| bauzas | sdague: nfv.russellbryant.net | 12:00 |
| bauzas | oops | 12:00 |
| bauzas | http://nfv.russellbryant.net | 12:00 |
| *** p5ntangl_ has joined #openstack-infra | 12:00 | |
| bauzas | Gerrit doesn't accept POST request to /dashboard | 12:00 |
| *** mwagner_lap has joined #openstack-infra | 12:01 | |
| sdague | bauzas: you don't | 12:02 |
| bauzas | sdague: ok, then I change my question into : how can I set a custom dashboard with a long list of IDs ? :-) | 12:03 |
| sdague | bauzas: honestly, you don't, that's a terrible way to do this | 12:03 |
| *** eglynn has joined #openstack-infra | 12:03 | |
| bauzas | sdague: because we need to track NFV blueprints | 12:03 |
| bauzas | sdague: so we scratch from a wiki a list of bps, then get the review IDs | 12:04 |
| *** p5ntangle has quit IRC | 12:04 | |
| bauzas | sdague: so I'm just wondering how to achieve this, because the NFV subteam is working on nova, neutron and cinder | 12:04 |
| *** leifmadsen has joined #openstack-infra | 12:04 | |
| *** p5ntangl_ has quit IRC | 12:04 | |
| sdague | I'd say make everyone use a reasonable gerrit topic for their reviews | 12:05 |
| *** p5ntangle has joined #openstack-infra | 12:05 | |
| *** dims has quit IRC | 12:05 | |
| bauzas | sdague: sounds reasonable but everyone is *not* reasonable :-) | 12:05 |
| *** k4n0 has quit IRC | 12:05 | |
| sdague | then their reviews get missed :) | 12:05 |
| bauzas | sdague: we have some new contributors here | 12:05 |
| sdague | sure | 12:05 |
| sdague | but this solution of iterating over all the reviews isn't going to work | 12:06 |
| sdague | as you've seen | 12:06 |
| bauzas | sdague: and sometimes the commit message is containing the word 'blueprint' so that sucks the topic name | 12:06 |
| sdague | bauzas: right, so train them to do it right | 12:06 |
| sdague | because if they don't, their reviews will get missed | 12:06 |
| bauzas | sdague: it was my first intention :-) | 12:06 |
| sdague | it seems like enough incentive for people to do the right thing | 12:06 |
| bauzas | sdague: well, makes sense, will speak about that on our next meeting today | 12:07 |
| bauzas | sdague: but I'm unsure it will reduce dramatically the URI length, as 1 BP == 1 patch atm | 12:07 |
| sdague | bauzas: really? | 12:08 |
| *** jgallard has joined #openstack-infra | 12:08 | |
| sdague | that seems like entirely the wrong granularity | 12:08 |
| bauzas | sdague: yeah that sucks, you know | 12:08 |
| sdague | how many blueprints do you think you are going to land in the next 4 weeks? | 12:08 |
| *** Guest13108 has joined #openstack-infra | 12:08 | |
| bauzas | that's the goal of the dashboard we do :) | 12:08 |
| bauzas | sdague: https://wiki.openstack.org/wiki/Teams/NFV#Active_Blueprints | 12:09 |
| bauzas | sdague: but I agree, now the Spec freeze arrived, there are a few less blueprints to track | 12:09 |
| *** p5ntangl_ has joined #openstack-infra | 12:10 | |
| bauzas | sdague: anyway, thanks for the help, will need to open a discussion in the nfv meeting :) | 12:10 |
| * bauzas needs to teach, teach, teach :) | 12:10 | |
| *** p5ntangl_ has joined #openstack-infra | 12:10 | |
| sdague | so are you trying to use this for a status dashboard, or actually for real time review todo list? | 12:11 |
| sdague | because if the later, I'd actually not do it this way at all | 12:11 |
| bauzas | sdague: can I say both ? :) | 12:12 |
| sdague | they are different use cases though, gerrit's a pretty terrible status ui | 12:12 |
| *** p5ntangle has quit IRC | 12:12 | |
| bauzas | sdague: we have PMs who track the status | 12:12 |
| sdague | right, so build a dashboard for that | 12:13 |
| sdague | not a gerrit one | 12:13 |
| bauzas | sdague: but we also have reviewers (like me) who check this dashboard | 12:13 |
| *** rfolco has joined #openstack-infra | 12:13 | |
| *** p5ntangl_ has quit IRC | 12:13 | |
| sdague | yeh, so my suggestion is to contribute to reviewday to provide you that view - http://status.openstack.org/reviews/ | 12:14 |
| *** pdmars has joined #openstack-infra | 12:14 | |
| *** pdmars has quit IRC | 12:14 | |
| *** p5ntangle has joined #openstack-infra | 12:14 | |
| * bauzas checking... | 12:14 | |
| *** hashar has quit IRC | 12:14 | |
| *** pdmars has joined #openstack-infra | 12:14 | |
| bauzas | sdague: that sounds a good alternative, but not that precise as we only have one query per project IIUC | 12:15 |
| bauzas | sdague: we liked custom dashboard for the possibility to segregate queries | 12:16 |
| bauzas | sdague: like WIPs, need second +2, etc. | 12:16 |
| bauzas | sdague: but anyway, will contribute to it, yes | 12:16 |
| sdague | sure, the point is you can do that in an offline way as well | 12:16 |
| bauzas | sdague: because that's anotherview | 12:17 |
| sdague | because as you've seen, you can't do what you want to do with gerrit js | 12:17 |
| bauzas | ok, will RTFM reviewday then :) | 12:17 |
| bauzas | yeah, sounds cool indeed | 12:17 |
| bauzas | sdague: thanks for the proposal | 12:17 |
| *** p5ntangle has quit IRC | 12:18 | |
| *** jgallard has quit IRC | 12:19 | |
| *** jgallard has joined #openstack-infra | 12:19 | |
| *** p5ntangle has joined #openstack-infra | 12:21 | |
| *** p5ntangle has quit IRC | 12:21 | |
| *** p5ntangle has joined #openstack-infra | 12:22 | |
| *** doug-fish has joined #openstack-infra | 12:23 | |
| *** _nadya_ has quit IRC | 12:25 | |
| *** berendt has joined #openstack-infra | 12:25 | |
| *** dkranz has joined #openstack-infra | 12:25 | |
| *** rlandy has joined #openstack-infra | 12:26 | |
| *** yamahata has quit IRC | 12:26 | |
| *** dims has joined #openstack-infra | 12:27 | |
| *** yamahata has joined #openstack-infra | 12:28 | |
| *** liusheng has quit IRC | 12:28 | |
| *** p5ntangl_ has joined #openstack-infra | 12:29 | |
| *** aysyd has joined #openstack-infra | 12:31 | |
| *** p5ntangle has quit IRC | 12:32 | |
| openstackgerrit | Carl Loa Odin proposed a change to openstack-infra/jenkins-job-builder: Extend trigger_builds functionality https://review.openstack.org/91051 | 12:33 |
| *** p5ntangl_ has quit IRC | 12:34 | |
| *** xianghui has quit IRC | 12:36 | |
| *** heyongli has joined #openstack-infra | 12:37 | |
| denis_makogon | Hello, guys, could someone from core team review https://review.openstack.org/#/c/103172/ and hit the last +2 if it's possible | 12:37 |
| *** e0ne has quit IRC | 12:37 | |
| *** luqas has quit IRC | 12:38 | |
| *** hashar has joined #openstack-infra | 12:38 | |
| denis_makogon | same thing for two dependent patchsets (parent https://review.openstack.org/#/c/100601), this patchsets are needed by Trove to allow heat-based integration testing, thanks | 12:39 |
| *** leifmadsen has quit IRC | 12:43 | |
| *** leifmadsen has joined #openstack-infra | 12:43 | |
| *** dmsimard_away is now known as dmsimard | 12:44 | |
| *** ildikov has quit IRC | 12:44 | |
| *** dkliban is now known as dkliban_brb | 12:47 | |
| *** heyongli has quit IRC | 12:48 | |
| *** alexpilotti has joined #openstack-infra | 12:49 | |
| *** luqas has joined #openstack-infra | 12:50 | |
| *** e0ne has joined #openstack-infra | 12:50 | |
| *** ArxCruz has joined #openstack-infra | 12:52 | |
| *** _nadya_ has joined #openstack-infra | 12:53 | |
| *** bnemec has joined #openstack-infra | 12:54 | |
| openstackgerrit | Alexei Kornienko proposed a change to openstack/requirements: Unbind version of pyzmq https://review.openstack.org/106497 | 12:57 |
| *** _nadya_ has quit IRC | 12:57 | |
| *** lcheng has joined #openstack-infra | 12:59 | |
| *** julim has joined #openstack-infra | 13:00 | |
| *** dprince has joined #openstack-infra | 13:01 | |
| *** rwsu has joined #openstack-infra | 13:01 | |
| *** baohua has quit IRC | 13:01 | |
| *** yamahata has quit IRC | 13:01 | |
| *** yamahata has joined #openstack-infra | 13:02 | |
| *** yfried_ has quit IRC | 13:02 | |
| openstackgerrit | afazekas proposed a change to openstack-infra/devstack-gate: multi node-dg-setup-poc https://review.openstack.org/106043 | 13:03 |
| *** ArxCruz has quit IRC | 13:05 | |
| *** jcoufal has quit IRC | 13:05 | |
| *** ArxCruz has joined #openstack-infra | 13:06 | |
| *** dims has quit IRC | 13:07 | |
| *** salv-orlando has quit IRC | 13:08 | |
| *** derekh_ has joined #openstack-infra | 13:08 | |
| *** sabeen1 has quit IRC | 13:11 | |
| *** flaviof_zzz is now known as flaviof | 13:11 | |
| *** sabeen has joined #openstack-infra | 13:11 | |
| *** LinuxJedi has joined #openstack-infra | 13:12 | |
| LinuxJedi | hey guys, who owns ci-backup-hp-az1.openstack.org and ci-backup-rs-ord.openstack.org? | 13:13 |
| *** eharney has joined #openstack-infra | 13:15 | |
| *** IvanBerezovskiy has left #openstack-infra | 13:16 | |
| *** jcoufal has joined #openstack-infra | 13:16 | |
| *** dkliban_brb is now known as dkliban | 13:16 | |
| *** bknudson has quit IRC | 13:17 | |
| *** mfer has joined #openstack-infra | 13:18 | |
| *** lcheng has quit IRC | 13:20 | |
| *** berendt has quit IRC | 13:20 | |
| *** HenryG_afk is now known as HenryG | 13:24 | |
| *** sasik_ has joined #openstack-infra | 13:25 | |
| sileht | hi, I have an issue some gate jobs changes blocked since 8 hours now, because jenkins05.openstack.org is unreachable, any idea about that ? | 13:26 |
| *** sasik_ has left #openstack-infra | 13:26 | |
| *** Guest13108 has quit IRC | 13:27 | |
| sileht | sdague, ? | 13:27 |
| *** afazekas has quit IRC | 13:27 | |
| *** xianghui has joined #openstack-infra | 13:29 | |
| sileht | ceilometer 99905,7 in the checks queue for example | 13:30 |
| sileht | fungi, ? | 13:31 |
| *** talluri has joined #openstack-infra | 13:31 | |
| *** Hal has joined #openstack-infra | 13:31 | |
| *** Hal is now known as Guest96252 | 13:31 | |
| greghaynes | Hello infra-ites, back again to request a quick review on https://review.openstack.org/#/c/107468/ so we can add a tripleo experimental job | 13:36 |
| *** _nadya_ has joined #openstack-infra | 13:37 | |
| *** dims has joined #openstack-infra | 13:37 | |
| eglynn | dumb, question is the gating job for https://review.openstack.org/99905 somehow stuck? | 13:40 |
| eglynn | ... status reported in http://status.openstack.org/zuul/ has been the similarly on the cusp of completion literally for hours now | 13:41 |
| *** rcarrillocruz has joined #openstack-infra | 13:41 | |
| eglynn | ... extra-dumb comma-placement above | 13:41 |
| openstackgerrit | Chris Dent proposed a change to openstack-infra/elastic-recheck: e-r query for intermittent failure in glance tests https://review.openstack.org/108993 | 13:41 |
| mmitchell | eglynn: sileht mentioned an issue with that exact review number | 13:42 |
| *** rcarrill` has quit IRC | 13:42 | |
| *** bknudson has joined #openstack-infra | 13:42 | |
| mmitchell | eglynn: apparently jenkins05 looks down | 13:42 |
| eglynn | mmitchell: /me reads back ... was there a resolution? | 13:43 |
| *** afazekas has joined #openstack-infra | 13:43 | |
| mmitchell | that was mentioned ~15m ago | 13:43 |
| mmitchell | jenkins05 still looks down for me | 13:43 |
| * eglynn wonders is it possible to bounce jenkins05 and restart the stuck jobs? | 13:43 | |
| mmitchell | http://www.downforeveryoneorjustme.com/jenkins05.openstack.org | 13:43 |
| eglynn | mmitchell: haha, downforeveryoneorjustme.com ... I love it :) | 13:44 |
| *** armax has joined #openstack-infra | 13:44 | |
| eglynn | fungi: would it possible to bounce jenkins05 and restart the stuck gating jobs? | 13:44 |
| *** cdub has joined #openstack-infra | 13:45 | |
| *** jp_at_hp has joined #openstack-infra | 13:46 | |
| *** mriedem has joined #openstack-infra | 13:46 | |
| *** changbl has joined #openstack-infra | 13:47 | |
| *** _nadya_ has quit IRC | 13:50 | |
| ArxCruz | jhesketh: hey, need your help with zuul swift plugin :) when you're have time let me know :) | 13:51 |
| *** homeless has joined #openstack-infra | 13:53 | |
| *** otherwiseguy has joined #openstack-infra | 13:53 | |
| *** nati_ueno has joined #openstack-infra | 13:53 | |
| *** wenlock has joined #openstack-infra | 13:55 | |
| *** ChuckC has quit IRC | 13:55 | |
| *** rcarrill` has joined #openstack-infra | 13:55 | |
| *** markmcclain has joined #openstack-infra | 13:56 | |
| *** rcarrillocruz has quit IRC | 13:57 | |
| *** jaypipes has joined #openstack-infra | 13:57 | |
| *** eharney has quit IRC | 14:00 | |
| *** chandankumar_ has joined #openstack-infra | 14:01 | |
| *** otherwiseguy has quit IRC | 14:02 | |
| *** eharney has joined #openstack-infra | 14:03 | |
| *** chandankumar has quit IRC | 14:04 | |
| *** baohua has joined #openstack-infra | 14:04 | |
| *** amalagon has joined #openstack-infra | 14:04 | |
| *** chandankumar_ has quit IRC | 14:04 | |
| *** esker has joined #openstack-infra | 14:04 | |
| *** ildikov has joined #openstack-infra | 14:05 | |
| *** cpallares has joined #openstack-infra | 14:05 | |
| *** baohua has quit IRC | 14:06 | |
| *** chandankumar has joined #openstack-infra | 14:06 | |
| *** baohua has joined #openstack-infra | 14:07 | |
| *** afazekas has quit IRC | 14:09 | |
| *** salv-orlando has joined #openstack-infra | 14:11 | |
| *** dustins has joined #openstack-infra | 14:13 | |
| gilliard | 1 | 14:13 |
| anteaya | lucasagomes: did anyone get looking at http://tarballs.openstack.org/nova/nova-master.tar.gz for you? | 14:14 |
| *** wenlock has quit IRC | 14:14 | |
| anteaya | mkoderer: usually I email them and cc the infra mailing list for archival purposes, and yes ci systems are allowed on comment per patchset so starting jobs is not allowed for third party ci systems | 14:15 |
| openstackgerrit | Nicholas Randon proposed a change to openstack-infra/config: Add firewall traffic on port 27410 to 27510. https://review.openstack.org/108737 | 14:15 |
| anteaya | mattoliverau: glad you are back, I got back last night just trying to wade through to catch up | 14:15 |
| *** tiantian has quit IRC | 14:16 | |
| *** betsy has quit IRC | 14:16 | |
| *** baohua has quit IRC | 14:16 | |
| anteaya | _david_: corvus is always my hero | 14:16 |
| *** smcginnis has joined #openstack-infra | 14:16 | |
| *** _nadya_ has joined #openstack-infra | 14:17 | |
| anteaya | so does this mean I can do the things now? | 14:17 |
| rcarrill` | anteaya: hello there, hope you had a good return from Germany :-). i'm working on an infra spec. Should I create a Launchpad blueprint related to it or a Storyboard story? I find contradictory information between https://wiki.openstack.org/wiki/Blueprints#Spec_.2B_Blueprints_lifecycle and the template.rst file on infra-specs repo... | 14:17 |
| *** rcarrill` is now known as rcarrillocruz | 14:17 | |
| anteaya | okay so I am back, I got in last night | 14:17 |
| anteaya | I put a rib out of place on Monday and am getting it fixed in about 5 hours so I don't have to be in pain much longer but I will be away this afternoon for that appointment | 14:18 |
| rcarrillocruz | what? | 14:18 |
| rcarrillocruz | how come? | 14:18 |
| zaro | morning, vacation time. | 14:18 |
| openstackgerrit | A change was merged to openstack/requirements: Explicitly states the keystonemiddleware version https://review.openstack.org/107467 | 14:18 |
| rcarrillocruz | morning zaro | 14:19 |
| anteaya | rcarrillocruz: create the spec and put it on gerrit, then follow comments about what to do next | 14:19 |
| *** otherwiseguy has joined #openstack-infra | 14:19 | |
| anteaya | if someone whats you to do something on storyboard or launchpad they will tell you, so then do that and then fix the contradictory docs | 14:19 |
| zaro | anteaya: how was hiedalberg? | 14:19 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/devstack-gate: Gather Apache2 error log https://review.openstack.org/107129 | 14:19 |
| anteaya | rcarrillocruz: sound doable? | 14:19 |
| rcarrillocruz | but the template expects a link to a blueprint. | 14:20 |
| rcarrillocruz | anyway | 14:20 |
| rcarrillocruz | i'll go with launchpad blueprint | 14:20 |
| anteaya | zaro: happy vacation | 14:20 |
| rcarrillocruz | if i get a comment on that | 14:20 |
| rcarrillocruz | i will create a story and copy paste stuff from LP blueprint | 14:20 |
| anteaya | zaro: never made it | 14:20 |
| *** lpaduano has left #openstack-infra | 14:20 | |
| anteaya | did castle frankenstein and then frankfurt | 14:20 |
| anteaya | monday rained and I slept all day, yay sleep | 14:20 |
| rcarrillocruz | how you did that to your rib? you fell off to the ground or something? | 14:21 |
| *** e0ne has quit IRC | 14:21 | |
| anteaya | rcarrillocruz: nope, I stretched and felt it move, haven't been able to put it back myself yet | 14:21 |
| *** dkehn_ has joined #openstack-infra | 14:21 | |
| rcarrillocruz | eugh | 14:22 |
| *** eglynn is now known as eglynn-call | 14:22 | |
| rcarrillocruz | get better :/ | 14:22 |
| anteaya | it happens, this is why I have regular osetopath appointments | 14:22 |
| anteaya | to keep my back aligned | 14:22 |
| anteaya | when I was doing yoga all the time I could fix it myself if anything like this happened | 14:23 |
| anteaya | but I am not doing yoga right now | 14:23 |
| anteaya | too busy | 14:23 |
| openstackgerrit | Salvatore Orlando proposed a change to openstack-infra/config: Make neutron full job voting (neutron gate only) https://review.openstack.org/88289 | 14:23 |
| *** salv-orlando has quit IRC | 14:23 | |
| *** e0ne has joined #openstack-infra | 14:24 | |
| rcarrillocruz | yoga is magic for the back. i have back and shoulder issues again , haven't done yoga for a month | 14:24 |
| mkoderer | anteaya: so no heidelberg ... how was castle frankenstein? | 14:24 |
| anteaya | sileht, eglynn-call, mmitchell wow, jenkins05 has disappeared: http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=115 | 14:24 |
| *** dkehnx has quit IRC | 14:25 | |
| eglynn-call | anteaya: can we get it bounced and the stalled jobs restarted? | 14:25 |
| anteaya | mkoderer: yeah couldn't fit it in, :( I wanted to though, so next time :) | 14:25 |
| anteaya | mkoderer: castle frankenstein was great, we had a wonderful time | 14:25 |
| anteaya | rcarrillocruz: yep, sounds like we both need to get back to it | 14:26 |
| anteaya | eglynn-call: well I don't know what you mean by bounced, but submitting a new patchset to the patch restarts jobs | 14:26 |
| anteaya | so you might try editing the commit message | 14:26 |
| eglynn-call | anteaya: I mean restarting the ill jenkins node | 14:27 |
| *** afazekas has joined #openstack-infra | 14:27 | |
| anteaya | well since I don't have root access, my best suggestion is submit a new patchset which will start new jobs | 14:28 |
| *** dkehn_ is now known as dkehnx | 14:29 | |
| marun | jeblair: We're having new trouble with the functional job, a change that adds MySQL-python can't find mysql. | 14:30 |
| anteaya | LinuxJedi: hi well anything within the openstack.org domain name is either the foundation or infra, and given the name backup in there would go with infra, is there a reason you ask? | 14:31 |
| marun | jeblair: I'm starting to wonder if the user invoking tox for the neutron-dsvm-functional job should be 'stack', since it seems to have trouble accessing dependencies that should have been installed by devstack and doesn't seem to have the same sudo privileges. | 14:31 |
| *** pdmars_ has joined #openstack-infra | 14:31 | |
| *** signed8bit has joined #openstack-infra | 14:32 | |
| *** rcarrill` has joined #openstack-infra | 14:32 | |
| marun | jeblair: Or is there something in the gate post-devstack that changes the environment? Would there be another place to invoke a devstack-dependant tox env other than post test hook? | 14:33 |
| *** pdmars has quit IRC | 14:34 | |
| * anteaya has skimmed backscroll, let me know if there was something important I missed | 14:34 | |
| *** rcarrillocruz has quit IRC | 14:34 | |
| *** naggappan has quit IRC | 14:34 | |
| openstackgerrit | chandan kumar proposed a change to openstack/requirements: Added amqplib==1.0.2 package to the global-requirements https://review.openstack.org/107653 | 14:35 |
| *** david-lyle has joined #openstack-infra | 14:36 | |
| *** wenlock has joined #openstack-infra | 14:37 | |
| LinuxJedi | anteaya: because whoever runs the software on it can't do SMTP right :) | 14:37 |
| LinuxJedi | anteaya: it is mailing me (and I haven't been CI for 2 years now) and it is trying to do SMTP from HP Cloud which is DNSBL'd so I'm getting bounces | 14:38 |
| *** jgrimm has joined #openstack-infra | 14:38 | |
| *** datsun180b has joined #openstack-infra | 14:39 | |
| Slower | any core infra guys want to do a review of https://review.openstack.org/#/c/108849/ ? | 14:41 |
| Slower | we would like to get the CI jobs for docker working but are generally frustrated and blocked right now | 14:42 |
| *** talluri has quit IRC | 14:42 | |
| *** talluri has joined #openstack-infra | 14:42 | |
| funzo | mordred: do you have a minute to look at ^? | 14:43 |
| funzo | or fungi? | 14:43 |
| Slower | ah | 14:43 |
| *** vhoward has left #openstack-infra | 14:46 | |
| *** thedodd has joined #openstack-infra | 14:48 | |
| *** chandankumar_ has joined #openstack-infra | 14:51 | |
| *** krotscheck has quit IRC | 14:52 | |
| *** ramashri has joined #openstack-infra | 14:54 | |
| *** jaypipes has quit IRC | 14:54 | |
| *** krotscheck has joined #openstack-infra | 14:55 | |
| *** chandankumar has quit IRC | 14:55 | |
| *** nati_ueno has quit IRC | 14:56 | |
| *** james_li has joined #openstack-infra | 14:56 | |
| *** nati_ueno has joined #openstack-infra | 14:56 | |
| *** talluri has quit IRC | 14:56 | |
| *** betsy has joined #openstack-infra | 14:58 | |
| *** rcarrillocruz has joined #openstack-infra | 14:58 | |
| funzo | ianw: I think the bridge setup for eth0 looks ok, at least it's similar to what I have in my VM | 14:58 |
| *** jaypipes has joined #openstack-infra | 14:59 | |
| funzo | ianw: do you know what ip address sshd is bound to? | 14:59 |
| *** sparkycollier has joined #openstack-infra | 14:59 | |
| *** rcarrill` has quit IRC | 14:59 | |
| funzo | ianw: i'm assuming iptables is supposed to NAT requests to the 10.x addresses if that's what's being assigned to eth0 | 15:00 |
| *** bcrochet has quit IRC | 15:04 | |
| fungi | jenkins05 is indeed offline/unreachable. i'm trying to get to it from the rackspace webui now, though that's also not terribly workable from the wifi here | 15:04 |
| *** atiwari has joined #openstack-infra | 15:05 | |
| *** cody-somerville has joined #openstack-infra | 15:05 | |
| openstackgerrit | A change was merged to openstack-infra/config: Change nova docker tests to run in the main Ubuntu image. https://review.openstack.org/108849 | 15:05 |
| fungi | LinuxJedi: i removed you from the root alias on ci-backup-rs-ord but ci-backup-hp-az1 has been out of puppet updates for so long it doesn't even have my ssh key on it | 15:06 |
| *** bcrochet has joined #openstack-infra | 15:06 | |
| LinuxJedi | fungi: cool, you might want to remove Monty from the HP one too, since his mail server is just bouncing mail from it due to the DNSBL | 15:06 |
| *** dizquierdo has joined #openstack-infra | 15:07 | |
| fungi | lovely | 15:07 |
| *** sballe has joined #openstack-infra | 15:08 | |
| fungi | huh, jenkins05 is perfectly responsive from the console (though since i don't think we have any backdoor password auth for it, i can't really troubleshoot the lack of network from that end | 15:09 |
| fungi | i'm just going to give it a graceful restart through the provider | 15:09 |
| *** radez_g0n3 is now known as radez | 15:10 | |
| fungi | jenkins service on it is starting now | 15:10 |
| *** dkranz has quit IRC | 15:11 | |
| devananda | i'm probably doing someting wrong with logstash again -- is there a reason it isn't indexing gate-tempest-dsvm-virtual-ironic logs/screen-n-sched.txt? | 15:12 |
| *** Sukhdev has joined #openstack-infra | 15:12 | |
| *** prad has joined #openstack-infra | 15:12 | |
| devananda | or is my syntax wrong here: build_name:"gate-tempest-dsvm-virtual-ironic" AND filename:"screen-n-sch.txt" AND "Filter ComputeCapabilitiesFilter returned" | 15:13 |
| clarkb | filename includes relative path prefix iirc | 15:14 |
| Slower | thanks for the reviews guys! | 15:15 |
| clarkb | you should use tags:blah instead | 15:15 |
| *** ihrachyshka has quit IRC | 15:15 | |
| devananda | clarkb: what's the tag for that file? | 15:15 |
| clarkb | what you already have | 15:16 |
| devananda | so even if I remove filename, it still doesn't find anything | 15:16 |
| devananda | and that message should be in every run of the job | 15:16 |
| clarkb | we are behind currently | 15:17 |
| clarkb | so if its recent it may not show | 15:18 |
| fungi | so... nothing at all helpful in the jenkins05 logs. it didn't even seem to notice it's network ceased operating from what i can tell--just stopped getting any new connections from anywhere | 15:21 |
| devananda | clarkb: ah, logstash excludes DEBUG lines, ya? | 15:21 |
| *** eglynn-call is now known as eglynn | 15:21 | |
| *** e0ne has quit IRC | 15:21 | |
| *** timrc-afk is now known as timrc | 15:23 | |
| *** salv-orlando has joined #openstack-infra | 15:24 | |
| *** signed8bit has quit IRC | 15:25 | |
| *** afazekas has quit IRC | 15:27 | |
| *** otherwiseguy has quit IRC | 15:27 | |
| *** dkranz has joined #openstack-infra | 15:27 | |
| fungi | yeah, we don't load debug lines into it because it would just fall over from the sheer volume | 15:28 |
| *** sparkycollier has quit IRC | 15:28 | |
| *** pcrews has joined #openstack-infra | 15:28 | |
| clarkb | yup | 15:28 |
| *** jlibosva has quit IRC | 15:28 | |
| *** pcm__ has joined #openstack-infra | 15:29 | |
| yolanda | sdague, clarkb, i filed a patch yesterday to use bundler package instead of ruby-bundler, when you have a chance please can you take a look? | 15:29 |
| yolanda | it blocks me a bit for nodepool testing | 15:29 |
| *** jgallard has quit IRC | 15:30 | |
| *** pcm___ has joined #openstack-infra | 15:30 | |
| *** signed8bit has joined #openstack-infra | 15:31 | |
| openstackgerrit | Daniel Shirley proposed a change to openstack-infra/jenkins-job-builder: Added support for JClouds Blobstore https://review.openstack.org/107515 | 15:31 |
| *** pcm_ has quit IRC | 15:31 | |
| *** dustins has quit IRC | 15:32 | |
| *** skolekonov has quit IRC | 15:33 | |
| *** dustins has joined #openstack-infra | 15:34 | |
| *** pcm__ has quit IRC | 15:34 | |
| *** xianghuihui has joined #openstack-infra | 15:34 | |
| *** xianghui has quit IRC | 15:36 | |
| dhellmann | jeblair, fungi, clarkb, mordred : do you have time to look at the cross-project unit test stuff again this week? https://review.openstack.org/#/c/85487/9 we've apparently introduced a breaking change into an unreleased version of oslo.db and I think these tests would have caught it | 15:37 |
| *** nati_ueno has quit IRC | 15:44 | |
| *** packet has joined #openstack-infra | 15:44 | |
| *** nati_ueno has joined #openstack-infra | 15:45 | |
| *** otherwiseguy has joined #openstack-infra | 15:45 | |
| *** msabramo has joined #openstack-infra | 15:47 | |
| *** asselin has joined #openstack-infra | 15:49 | |
| *** nati_ueno has quit IRC | 15:49 | |
| *** gangil has joined #openstack-infra | 15:49 | |
| *** marcoemorais has joined #openstack-infra | 15:50 | |
| *** ChuckC has joined #openstack-infra | 15:52 | |
| *** vermarah_ has joined #openstack-infra | 15:53 | |
| *** emagana has joined #openstack-infra | 15:55 | |
| *** signed8bit has quit IRC | 15:57 | |
| *** signed8bit has joined #openstack-infra | 15:58 | |
| *** gyee has joined #openstack-infra | 15:58 | |
| *** emagana has quit IRC | 15:59 | |
| *** smcginnis has left #openstack-infra | 15:59 | |
| *** emagana has joined #openstack-infra | 16:00 | |
| *** e0ne has joined #openstack-infra | 16:01 | |
| *** hogepodge has joined #openstack-infra | 16:02 | |
| *** sparkycollier has joined #openstack-infra | 16:03 | |
| *** camunoz has joined #openstack-infra | 16:04 | |
| *** ianw has quit IRC | 16:04 | |
| *** ianw has joined #openstack-infra | 16:05 | |
| *** dtantsur is now known as dtantsur|afk | 16:06 | |
| *** camunoz_gone has quit IRC | 16:08 | |
| *** packet has quit IRC | 16:08 | |
| *** packet has joined #openstack-infra | 16:10 | |
| *** daya_k has quit IRC | 16:11 | |
| *** hemna has joined #openstack-infra | 16:12 | |
| *** chandankumar_ has quit IRC | 16:13 | |
| openstackgerrit | Arx Cruz proposed a change to openstack-infra/config: Adding auth_version option to zuul.conf https://review.openstack.org/109030 | 16:14 |
| *** xianghuihui has quit IRC | 16:16 | |
| *** dkranz has quit IRC | 16:16 | |
| *** otherwiseguy has quit IRC | 16:20 | |
| *** otherwiseguy has joined #openstack-infra | 16:20 | |
| *** pdmars has joined #openstack-infra | 16:23 | |
| zaro | anteaya: good news, changes you need to modify user accounts has merged on upstream gerrit. | 16:24 |
| *** pdmars_ has quit IRC | 16:24 | |
| *** _nadya_ has quit IRC | 16:24 | |
| *** afazekas has joined #openstack-infra | 16:24 | |
| *** rkukura has joined #openstack-infra | 16:25 | |
| *** SumitNaiksatam has joined #openstack-infra | 16:25 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Show usage of job-group https://review.openstack.org/106601 | 16:27 |
| *** dkranz has joined #openstack-infra | 16:28 | |
| *** arnaud has joined #openstack-infra | 16:29 | |
| *** yfried_ has joined #openstack-infra | 16:30 | |
| rcarrillocruz | zaro: that's quite big thing :-) | 16:30 |
| *** salv-orlando has quit IRC | 16:31 | |
| devananda | jeblair: clarkb: care to look at our proposal to make ironic jobs report as third-party CI again? https://review.openstack.org/#/c/97411/ | 16:31 |
| *** _nadya_ has joined #openstack-infra | 16:31 | |
| *** yfried_ has quit IRC | 16:31 | |
| *** yfried_ has joined #openstack-infra | 16:32 | |
| devananda | nova landed a patch this mornign which broke both ironic and tripleo's gates ... they're saying that ^ would have helped them | 16:32 |
| *** sparkycollier has quit IRC | 16:32 | |
| *** salv-orlando has joined #openstack-infra | 16:32 | |
| anteaya | zaro: woohooo!! | 16:32 |
| anteaya | zaro: how long until we have access to them? | 16:32 |
| anteaya | zaro: and how can I help? | 16:32 |
| *** msabramo has quit IRC | 16:36 | |
| *** Guest96252 has quit IRC | 16:37 | |
| ryanpetrello | erm | 16:37 |
| ryanpetrello | is this…normal? http://screens.objects.dreamhost.com/07-23-2014-12-37-42.png | 16:38 |
| *** krtaylor has quit IRC | 16:38 | |
| *** salv-orlando_ has joined #openstack-infra | 16:42 | |
| *** salv-orlando_ has quit IRC | 16:42 | |
| anteaya | ryanpetrello: what part are you asking about? | 16:43 |
| anteaya | the fact that gate-pecan-tox job is red? | 16:43 |
| *** salv-orlando has quit IRC | 16:44 | |
| ryanpetrello | the fact that it was running for 22 hours :) | 16:45 |
| anteaya | ryanpetrello: jenkins05 disappeared | 16:45 |
| ryanpetrello | and that pecan-tox-scaffolds-26 just got stuck in queued | 16:45 |
| anteaya | so if a jenkins disappeared then yes, this is expected behaviour | 16:45 |
| ryanpetrello | looks like fungi pushed a patchset to restart it for me | 16:45 |
| anteaya | right | 16:45 |
| anteaya | submitting a new patchset is the fix | 16:45 |
| anteaya | now I haven't read the backscroll to learn if we know why jenkins05 was unreachable | 16:46 |
| dims | bunch of pypi related failures in the gate :( | 16:46 |
| anteaya | dims got a url for a log and stacktrace? | 16:47 |
| dims | https://jenkins06.openstack.org/job/gate-heat-pep8/1772/console | 16:47 |
| dims | http://logs.openstack.org/51/107351/2/gate/gate-tempest-dsvm-neutron/6ccb478/logs/devstacklog.txt.gz | 16:47 |
| anteaya | thanks | 16:47 |
| dims | http://logs.openstack.org/94/108594/1/gate/gate-tempest-dsvm-large-ops/65c661d/logs/devstacklog.txt.gz | 16:47 |
| dims | just saw that bunch | 16:47 |
| *** hashar has quit IRC | 16:49 | |
| *** luqas has quit IRC | 16:49 | |
| *** eglynn is now known as eglynn-afk | 16:49 | |
| anteaya | I confirm, choking on three different downloads from pypi.o.o | 16:49 |
| anteaya | fungi, clarkb, jeblair ^^ pypi.o.o is having issues | 16:50 |
| * fungi checks his network performance traps | 16:50 | |
| anteaya | 16:22, 16:40 and 16:45 timestamps so recent behaviour | 16:50 |
| ArxCruz | anteaya: jeblair fungi any chance to take a look at https://review.openstack.org/#/c/109030/ ? | 16:51 |
| ArxCruz | ;D | 16:51 |
| *** yjiang5 has joined #openstack-infra | 16:51 | |
| *** Ryan_Lane has joined #openstack-infra | 16:51 | |
| anteaya | ArxCruz: they are all at oscon, probably not going to do much on zuul.conf while they are away | 16:52 |
| ArxCruz | :'( | 16:52 |
| *** afazekas is now known as _afazekas | 16:52 | |
| anteaya | yeah | 16:52 |
| *** turul_ has joined #openstack-infra | 16:52 | |
| anteaya | well we do have to do face time with each other some times | 16:52 |
| *** turul_ is now known as afazekas | 16:52 | |
| ArxCruz | well, I guess I need to do my workarounds internally | 16:52 |
| ArxCruz | anteaya: sure, I understand :) | 16:53 |
| anteaya | ArxCruz: yeah, if you have that option, it would be good to take that today | 16:53 |
| ArxCruz | yup :) | 16:53 |
| anteaya | and then work on getting eyes on it next week | 16:53 |
| *** _nadya_ has quit IRC | 16:53 | |
| *** amcrn has joined #openstack-infra | 16:53 | |
| anteaya | fungi: I am also looking at our test nodes graph | 16:53 |
| *** hogepodge has quit IRC | 16:54 | |
| *** salv-orlando has joined #openstack-infra | 16:54 | |
| anteaya | our our in use nodes are getting sqeezed out | 16:54 |
| anteaya | did our quota drop somewhere? | 16:54 |
| garyh | Can someone tell me what are the minimum chef cookbook spec files required for StackForge rubocop and maybe a good example of what needs to be in them? | 16:54 |
| *** jcoufal has quit IRC | 16:54 | |
| *** jcoufal has joined #openstack-infra | 16:55 | |
| anteaya | garyh: ah, I have no idea how to answer your question | 16:55 |
| anteaya | perhaps find a rubocop contributor? | 16:55 |
| garyh | anteaya Ok | 16:56 |
| *** jcoufal has quit IRC | 16:56 | |
| fungi | my wget loops seem to be far more resilient than pip is... the most recent burp i see reaching pypi.openstack.org from my held nodes in various providers is 06:51 utc today, so about 12 hours ago | 16:56 |
| *** jcoufal has joined #openstack-infra | 16:57 | |
| fungi | relatively non-recent | 16:57 |
| anteaya | hmmmmmm | 16:57 |
| *** dkliban is now known as dkliban_lunch | 16:58 | |
| *** Sukhdev has quit IRC | 16:58 | |
| *** bnemec has quit IRC | 16:58 | |
| *** marcoemorais has quit IRC | 17:00 | |
| zaro | anteaya: we will need to merge those upstream changes into our 2.8 fork of gerrit and then upgrade. | 17:00 |
| *** andreykurilin has joined #openstack-infra | 17:00 | |
| *** krtaylor has joined #openstack-infra | 17:01 | |
| *** gokrokve has joined #openstack-infra | 17:01 | |
| zaro | anteaya: i'm waiting for our mirror to pickup the upstream changes then will do the merge to our fork. | 17:01 |
| zaro | anteaya: once it merges on our fork then you'll need to convince infra-core to upgrade gerrit :) | 17:02 |
| *** bnemec has joined #openstack-infra | 17:02 | |
| *** marcoemorais has joined #openstack-infra | 17:02 | |
| *** jedimike has quit IRC | 17:03 | |
| *** james_li has quit IRC | 17:04 | |
| *** rcarrill` has joined #openstack-infra | 17:06 | |
| *** homeless has quit IRC | 17:06 | |
| *** salv-orlando has quit IRC | 17:06 | |
| *** hogepodge has joined #openstack-infra | 17:07 | |
| *** jistr has quit IRC | 17:07 | |
| *** Evgeny has joined #openstack-infra | 17:07 | |
| *** homeless has joined #openstack-infra | 17:08 | |
| *** yamahata has quit IRC | 17:08 | |
| *** rcarrillocruz has quit IRC | 17:08 | |
| openstackgerrit | afazekas proposed a change to openstack-infra/devstack-gate: Debug 'Cannot allocate memory' https://review.openstack.org/109043 | 17:09 |
| openstackgerrit | Elizabeth K. Joseph proposed a change to openstack-infra/infra-manual: Add Working with Bugs section to Dev guide https://review.openstack.org/107741 | 17:09 |
| zaro | anteaya: you should probably review to make sure you have everthing you need in this command: https://gerrit-review.googlesource.com/#/c/58748/5/Documentation/cmd-set-account.txt | 17:10 |
| *** pblaho has quit IRC | 17:12 | |
| *** jgrimm has quit IRC | 17:12 | |
| *** gokrokve has quit IRC | 17:12 | |
| *** gokrokve has joined #openstack-infra | 17:13 | |
| *** james_li has joined #openstack-infra | 17:13 | |
| *** mwagner_lap has quit IRC | 17:14 | |
| *** praneshp has joined #openstack-infra | 17:16 | |
| *** gokrokve has quit IRC | 17:17 | |
| * anteaya reviews | 17:17 | |
| *** whoops has joined #openstack-infra | 17:17 | |
| *** luqas has joined #openstack-infra | 17:18 | |
| anteaya | zaro: that is just a documentation change yeah? | 17:18 |
| *** SumitNaiksatam has quit IRC | 17:19 | |
| *** mriedem has quit IRC | 17:20 | |
| *** harlowja_away is now known as harlowja | 17:20 | |
| anteaya | zaro: do I need to be able to make changes to http password? | 17:21 |
| anteaya | maybe I do, but if I don't I don't know that | 17:22 |
| anteaya | s/but if I don't I don't know that/but if I do I don't know that | 17:23 |
| vermarah_ | I'm trying to set up comment rechecks with Zuul on a third party CI system. As a first test I add a line "-event: comment-added" to the trigger section of my layout.yaml and then added a comment to a patch I had uploaded earlier. This caused Jenkins to repeatedly test my patch, inform me that it suceeded, and then start testing again. This went on until I killed zuul and jenkins. Any idea why zuul would make jenkins loop like that? | 17:23 |
| *** bnemec has quit IRC | 17:23 | |
| *** lcheng has joined #openstack-infra | 17:24 | |
| zaro | anteaya: you probably don't need to change http password, but it's available. the http password allows users to use the gerrit REST api which i don't think 3rd party need. | 17:25 |
| zaro | anteaya: if you go up to change number in URL then you'll see the complete change and review. | 17:26 |
| openstackgerrit | Nicholas Randon proposed a change to openstack-infra/config: Add firewall traffic on port 27410 to 27510. https://review.openstack.org/108737 | 17:26 |
| anteaya | zaro: awesome, I have to run away now for my back fixing appointment, I will be back later | 17:26 |
| anteaya | zaro: I'll have a poke around the patch | 17:27 |
| anteaya | and yay | 17:27 |
| zaro | anteaya: argh! i just noticed that the change is missing a set preferred email command. i'll add that now. | 17:27 |
| anteaya | zaro: good eye | 17:27 |
| anteaya | okay afk | 17:28 |
| *** dizquierdo has quit IRC | 17:28 | |
| *** zehicle_at_dell has joined #openstack-infra | 17:30 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:31 | |
| *** shashankhegde has joined #openstack-infra | 17:32 | |
| *** gokrokve has joined #openstack-infra | 17:34 | |
| *** mriedem has joined #openstack-infra | 17:34 | |
| *** zehicle_at_dell has quit IRC | 17:36 | |
| *** nati_ueno has joined #openstack-infra | 17:38 | |
| *** pelix has quit IRC | 17:39 | |
| *** lcheng has quit IRC | 17:39 | |
| *** e0ne has quit IRC | 17:41 | |
| *** laxity has quit IRC | 17:41 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 17:41 | |
| *** laxity has joined #openstack-infra | 17:42 | |
| *** _nadya_ has joined #openstack-infra | 17:42 | |
| *** signed8bit has quit IRC | 17:42 | |
| *** ramashri has quit IRC | 17:42 | |
| krotscheck | Does “InterpreterNotFound: python2.6” ring a bell with anyone? | 17:42 |
| *** dkliban_lunch is now known as dkliban | 17:42 | |
| *** markmc has joined #openstack-infra | 17:44 | |
| *** Sukhdev has joined #openstack-infra | 17:44 | |
| *** emagana has quit IRC | 17:45 | |
| *** emagana has joined #openstack-infra | 17:45 | |
| *** signed8bit has joined #openstack-infra | 17:46 | |
| *** timrc is now known as timrc-afk | 17:46 | |
| krotscheck | mordred: We’re using trove for storyboard, no? | 17:47 |
| *** marcoemorais has quit IRC | 17:47 | |
| *** ramashri has joined #openstack-infra | 17:48 | |
| clarkb | krotscheck that is an infrequent hard to debug error. fungi has change up to get more logs and hopefully sort it out | 17:48 |
| clarkb | yes trove is used | 17:48 |
| krotscheck | kk | 17:48 |
| krotscheck | thanks | 17:48 |
| krotscheck | How’s portland? | 17:48 |
| clarkb | I am actually on bus to seattle right now | 17:49 |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/config: Make zuul, gerrit, and recheckwatch storyboard-aware https://review.openstack.org/105895 | 17:49 |
| *** Sukhdev has quit IRC | 17:49 | |
| *** marcoemorais has joined #openstack-infra | 17:49 | |
| clarkb | but portland was wet | 17:49 |
| *** emagana has quit IRC | 17:49 | |
| ttx | Portland is wet, I confirm | 17:49 |
| clarkb | I get to spend an afternoon in seattle to get things done then drive back to portland | 17:50 |
| *** sballe has quit IRC | 17:50 | |
| clarkb | I may drop into office to get expense report envelopes | 17:50 |
| *** homeless has quit IRC | 17:50 | |
| *** homeless has joined #openstack-infra | 17:51 | |
| *** msabramo has joined #openstack-infra | 17:52 | |
| *** _nadya_ has quit IRC | 17:53 | |
| *** sabari1 has joined #openstack-infra | 17:54 | |
| *** sabari1 has left #openstack-infra | 17:54 | |
| *** lcheng has joined #openstack-infra | 17:54 | |
| *** freyes has joined #openstack-infra | 17:54 | |
| *** freyes_ has joined #openstack-infra | 17:55 | |
| *** bdpayne has joined #openstack-infra | 17:55 | |
| *** pcm___ has quit IRC | 17:56 | |
| *** emagana has joined #openstack-infra | 17:56 | |
| greghaynes | clarkb: I have one... | 17:57 |
| greghaynes | if you need | 17:57 |
| clarkb | its ok its right there I can get a stack | 17:57 |
| *** yamamoto has quit IRC | 17:58 | |
| openstackgerrit | ChingWei Chang proposed a change to openstack-infra/config: Prepared for new project puppet-n1k-vsm - Replaced puppet-n1k-vsm with gate-{name}-puppet-lint https://review.openstack.org/102662 | 17:58 |
| *** freyes has quit IRC | 17:59 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard: Project Group member DELETE and PUT method have better results https://review.openstack.org/106507 | 18:00 |
| *** nati_ueno has quit IRC | 18:00 | |
| openstackgerrit | Anne Gentle proposed a change to openstack-infra/config: Changes the ACL for clouddocs-maven-plugin to openstack-doc-core https://review.openstack.org/106923 | 18:00 |
| krotscheck | clarkb: Seriously? Going into the office for one day? | 18:00 |
| *** nati_ueno has joined #openstack-infra | 18:00 | |
| clarkb | more like 15 minutes :) | 18:01 |
| krotscheck | clarkb: Well, say hi to Ish__ while you’re there :) | 18:01 |
| *** cody-somerville has quit IRC | 18:01 | |
| *** sparkycollier has joined #openstack-infra | 18:01 | |
| *** nati_ueno has quit IRC | 18:01 | |
| *** nati_ueno has joined #openstack-infra | 18:02 | |
| sdague | clarkb / fungi: if someone could look at nodepool atm, it looks like we're piling up dead nodes, which might be related to jenkins05 dying. | 18:02 |
| *** tongli has joined #openstack-infra | 18:02 | |
| *** sparkycollier has quit IRC | 18:03 | |
| *** bnemec has joined #openstack-infra | 18:03 | |
| tongli | hello, there has been a new channel opend for OpenStack Monitoring project. | 18:04 |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/config: Run tripleo overcloud ci on heat https://review.openstack.org/109057 | 18:04 |
| tongli | I would like to use eavesdrop to log the conversations. wonder if anyone can help. | 18:04 |
| tongli | the new channel name is #openstack-monasca. | 18:04 |
| *** shayneburgess has joined #openstack-infra | 18:05 | |
| *** Evgeny has quit IRC | 18:05 | |
| *** nati_ueno has quit IRC | 18:05 | |
| *** zehicle_at_dell has joined #openstack-infra | 18:05 | |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/config: Run tripleo overcloud ci on heat https://review.openstack.org/109057 | 18:05 |
| *** nati_ueno has joined #openstack-infra | 18:05 | |
| *** pcm___ has joined #openstack-infra | 18:05 | |
| *** arnaud has quit IRC | 18:06 | |
| *** camunoz_ has joined #openstack-infra | 18:06 | |
| *** ianw has quit IRC | 18:06 | |
| *** camunoz__ has joined #openstack-infra | 18:07 | |
| *** ianw has joined #openstack-infra | 18:07 | |
| *** ianw has quit IRC | 18:07 | |
| *** ianw has joined #openstack-infra | 18:07 | |
| *** arnaud has joined #openstack-infra | 18:07 | |
| *** ianw has quit IRC | 18:08 | |
| *** ianw has joined #openstack-infra | 18:08 | |
| *** jamielennox|away has quit IRC | 18:08 | |
| *** ianw has quit IRC | 18:08 | |
| *** Alexei_987 has joined #openstack-infra | 18:09 | |
| *** pblaho has joined #openstack-infra | 18:09 | |
| *** ianw has joined #openstack-infra | 18:09 | |
| fungi | sdague: yeah, i cleared the defunct ready nodes a little but ago, and am trying to clear the building nodes but those have row locks on them in the db at the moment | 18:09 |
| *** camunoz has quit IRC | 18:09 | |
| krotscheck | Poking through jeepyb to see how easy it is to add the creation of projects-without repos. Anyone have an opinion on whether it should be a top level config option like “use-storyboard” or something under options: - no-git-repo? | 18:09 |
| krotscheck | (This is in reference to getting ux onto storyboard) | 18:10 |
| *** camunoz has joined #openstack-infra | 18:10 | |
| *** dkliban has quit IRC | 18:10 | |
| *** camunoz_ has quit IRC | 18:10 | |
| *** portante has quit IRC | 18:10 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for tempest unit test race bug 1347096 https://review.openstack.org/108846 | 18:11 |
| uvirtbot | Launchpad bug 1347096 in tempest "TestServerWaiters fails with: ConfigFilesNotFoundError: Failed to read some config files: /etc/tempest/tempest.conf" [High,Fix released] https://launchpad.net/bugs/1347096 | 18:11 |
| *** dkliban has joined #openstack-infra | 18:11 | |
| *** camunoz__ has quit IRC | 18:11 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 18:11 | |
| *** eharney has quit IRC | 18:11 | |
| *** jamielenz has joined #openstack-infra | 18:12 | |
| *** camunoz_ has joined #openstack-infra | 18:13 | |
| *** portante has joined #openstack-infra | 18:13 | |
| *** hogepodge has quit IRC | 18:13 | |
| *** ianw has quit IRC | 18:13 | |
| *** pblaho has quit IRC | 18:13 | |
| *** camunoz__ has joined #openstack-infra | 18:14 | |
| *** jamielennox|away has joined #openstack-infra | 18:15 | |
| *** jamielenz has quit IRC | 18:16 | |
| *** radez has quit IRC | 18:16 | |
| *** dkliban has quit IRC | 18:16 | |
| *** camunoz has quit IRC | 18:16 | |
| *** dkranz has quit IRC | 18:16 | |
| *** jamielenz has joined #openstack-infra | 18:17 | |
| *** arnaud has quit IRC | 18:17 | |
| *** camunoz has joined #openstack-infra | 18:17 | |
| *** flaviof is now known as flaviof_zzz | 18:17 | |
| *** rwsu_ has joined #openstack-infra | 18:17 | |
| *** dprince_ has joined #openstack-infra | 18:17 | |
| *** bnemec has quit IRC | 18:17 | |
| *** camunoz_ has quit IRC | 18:17 | |
| *** bcrochet has quit IRC | 18:17 | |
| *** msabramo has quit IRC | 18:18 | |
| *** camunoz__ has quit IRC | 18:18 | |
| *** ianw has joined #openstack-infra | 18:18 | |
| *** dkliban has joined #openstack-infra | 18:19 | |
| *** melwitt has joined #openstack-infra | 18:19 | |
| *** camunoz_ has joined #openstack-infra | 18:19 | |
| *** ianw has quit IRC | 18:19 | |
| *** jamielennox|away has quit IRC | 18:19 | |
| *** jamielennox|away has joined #openstack-infra | 18:20 | |
| *** julim has quit IRC | 18:20 | |
| *** ianw has joined #openstack-infra | 18:20 | |
| *** jcoufal has quit IRC | 18:20 | |
| *** dprince has quit IRC | 18:20 | |
| *** portante has quit IRC | 18:20 | |
| *** rwsu has quit IRC | 18:21 | |
| *** ChuckC has quit IRC | 18:21 | |
| *** ianw has quit IRC | 18:21 | |
| *** derekh_ has quit IRC | 18:21 | |
| *** jamielenz has quit IRC | 18:21 | |
| *** ianw has joined #openstack-infra | 18:22 | |
| *** jcoufal has joined #openstack-infra | 18:22 | |
| *** ianw has quit IRC | 18:22 | |
| *** ChuckC has joined #openstack-infra | 18:22 | |
| openstackgerrit | Chris Dent proposed a change to openstack-infra/elastic-recheck: e-r query for intermittent failure in glance tests https://review.openstack.org/108993 | 18:23 |
| *** camunoz has quit IRC | 18:23 | |
| *** bcrochet has joined #openstack-infra | 18:23 | |
| *** dkliban has quit IRC | 18:23 | |
| *** julim has joined #openstack-infra | 18:23 | |
| *** ianw has joined #openstack-infra | 18:23 | |
| *** eharney has joined #openstack-infra | 18:23 | |
| *** camunoz has joined #openstack-infra | 18:23 | |
| *** dkliban has joined #openstack-infra | 18:23 | |
| *** camunoz_ has quit IRC | 18:23 | |
| *** jamielenz has joined #openstack-infra | 18:24 | |
| *** portante has joined #openstack-infra | 18:24 | |
| *** jamielennox|away has quit IRC | 18:24 | |
| *** radez_g0n3 has joined #openstack-infra | 18:25 | |
| *** radez_g0n3 is now known as radez | 18:25 | |
| *** jamielennox|away has joined #openstack-infra | 18:27 | |
| *** camunoz_ has joined #openstack-infra | 18:27 | |
| *** camunoz has quit IRC | 18:27 | |
| *** ianw has quit IRC | 18:27 | |
| *** ianw has joined #openstack-infra | 18:27 | |
| fungi | hrm... think i'm just going to stop nodepool, mark all the ready/building nodes as delete and fire it back up | 18:28 |
| *** xianghui has joined #openstack-infra | 18:28 | |
| fungi | it'll be a lot faster overall | 18:28 |
| *** derekh_ has joined #openstack-infra | 18:28 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/jeepyb: Added "use_gerrit" flag parsing. https://review.openstack.org/109069 | 18:29 |
| *** jamielenz has quit IRC | 18:30 | |
| gangil | Hi, I am a registered user on gerrit and have added my ssh public keys. But when I am trying to stream the events it fails saying “Permission Denied (Public Key)”. I have double checked the public key is associated with my gerrit account. I am using the command gangil@gangil-openstack:~/.ssh$ ssh -p 29418 -i id_rsa review.openstack.org gerrit stream-events | 18:31 |
| *** signed8bit_ZZZzz is now known as signed8bit | 18:31 | |
| *** nati_ueno has quit IRC | 18:31 | |
| krotscheck | clarkb: Does that make sense ^ ? | 18:31 |
| *** nati_ueno has joined #openstack-infra | 18:31 | |
| *** jamielennox|away has quit IRC | 18:31 | |
| *** jamielenz has joined #openstack-infra | 18:31 | |
| gangil | Can anyone please help me with that? | 18:31 |
| *** camunoz_ has quit IRC | 18:31 | |
| *** hashar has joined #openstack-infra | 18:31 | |
| jeblair | fungi: when you start nodepool, it automatically marks building nodes as delete; if you want to mark ready as such you'd need to do that manually | 18:32 |
| *** msabramo has joined #openstack-infra | 18:32 | |
| jeblair | fungi: (i'm not sure you need to mark ready nodes as delete) | 18:32 |
| fungi | jeblair: oh, right, forgot it's done that for a while. good deal | 18:33 |
| fungi | gangil: does https://review.openstack.org/#/settings/ say your gerrit username is gangil? | 18:33 |
| gangil | fungi: no | 18:34 |
| gangil | can I specify username as well? | 18:34 |
| *** jgrimm has joined #openstack-infra | 18:34 | |
| * gangil checks the docs | 18:34 | |
| openstackgerrit | afazekas proposed a change to openstack-infra/devstack-gate: multi node-dg-setup-poc https://review.openstack.org/106043 | 18:35 |
| sdague | fungi: I think there is a deeper issue, there are a bunch of jobs that have a queued item that haven't made progress for hours. | 18:35 |
| sdague | and the check queue at 220 patches, is never a good sign | 18:35 |
| *** timrc-afk is now known as timrc | 18:35 | |
| *** nati_ueno has quit IRC | 18:35 | |
| fungi | gangil: yes, do 'ssh -p 29418 -i id_rsa myusername@review.openstack.org gerrit stream-events' (replacing myusername with your actual gerrit username) | 18:35 |
| *** nati_ueno has joined #openstack-infra | 18:36 | |
| *** flaviof_zzz is now known as flaviof | 18:36 | |
| gangil | fungi: thanks that worked smoothly! :) | 18:37 |
| *** Evgeny has joined #openstack-infra | 18:39 | |
| *** markmc has quit IRC | 18:39 | |
| clarkb | krotscheck I think it should be a nogerrit or nogit option | 18:40 |
| clarkb | then you can use storybosrd in the normal way | 18:40 |
| krotscheck | clarkb: Well, I was trying to match the storyboard flag nomenclature: use-storyboard | 18:41 |
| *** mkoderer_bot has joined #openstack-infra | 18:42 | |
| *** nati_ueno has quit IRC | 18:42 | |
| *** nati_ueno has joined #openstack-infra | 18:42 | |
| *** stevemar has joined #openstack-infra | 18:44 | |
| *** cdub has quit IRC | 18:44 | |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file https://review.openstack.org/105930 | 18:45 |
| *** dkranz has joined #openstack-infra | 18:48 | |
| *** shayneburgess has left #openstack-infra | 18:48 | |
| *** _nadya_ has joined #openstack-infra | 18:52 | |
| *** hogepodge has joined #openstack-infra | 18:54 | |
| *** zehicle_at_dell has quit IRC | 18:55 | |
| *** esker has quit IRC | 18:56 | |
| *** oanufriev has joined #openstack-infra | 18:57 | |
| *** signed8bit has quit IRC | 18:57 | |
| *** signed8bit has joined #openstack-infra | 18:58 | |
| *** homeless has quit IRC | 18:59 | |
| *** homeless has joined #openstack-infra | 18:59 | |
| oanufriev | hi. is everithing OK in infra? seems like tasks are deadlocked | 18:59 |
| oanufriev | http://status.openstack.org/zuul/ | 18:59 |
| *** rwsu_ is now known as rwsu | 19:01 | |
| *** hogepodge has quit IRC | 19:01 | |
| jeblair | fungi, clarkb: the graph says we have 2k nodes | 19:01 |
| jeblair | that seems unlikely | 19:01 |
| fungi | jeblair: yeah, i too think that is odd | 19:02 |
| *** crc32 has joined #openstack-infra | 19:02 | |
| *** arnaud has joined #openstack-infra | 19:02 | |
| *** arnaud__ has joined #openstack-infra | 19:02 | |
| *** dkehn_ has joined #openstack-infra | 19:02 | |
| fungi | 'sudo nodepool list|grep -c building' says 1361 | 19:03 |
| openstackgerrit | Elizabeth K. Joseph proposed a change to openstack-infra/config: Add documentation for adding logging bot to channel https://review.openstack.org/109078 | 19:03 |
| *** crc32 has quit IRC | 19:03 | |
| *** crc32 has joined #openstack-infra | 19:04 | |
| *** james_li has quit IRC | 19:04 | |
| jeblair | most of those seem to be in hpcloud-b5 | 19:05 |
| fungi | it does indeed. checking logs to see if something is breaking there | 19:05 |
| *** dkehnx has quit IRC | 19:05 | |
| *** signed8bit has quit IRC | 19:06 | |
| *** melwitt has quit IRC | 19:06 | |
| *** julim_ has joined #openstack-infra | 19:06 | |
| *** signed8bit has joined #openstack-infra | 19:07 | |
| *** signed8bit has quit IRC | 19:08 | |
| *** rfolco has quit IRC | 19:08 | |
| *** signed8bit has joined #openstack-infra | 19:08 | |
| mordred | jeblair, fungi: if you guys are hitting nodepool - I may have a couple of things held - I do not need any of them | 19:08 |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/jeepyb: Added "no-gerrit" option. https://review.openstack.org/109069 | 19:08 |
| mordred | you don't need to clean up after me - but if they're in your way, you don't need to care about them | 19:08 |
| *** julim has quit IRC | 19:08 | |
| msabramo | I know Monty is at OSCon; anyone else? hashar? zaro? | 19:09 |
| krotscheck | clarkb: better? ^^ | 19:09 |
| mordred | msabramo: I am _not_ at OSCon actually | 19:09 |
| hashar | msabramo: I am not | 19:09 |
| msabramo | mordred: I thought I saw that you were giving a talk? | 19:09 |
| hashar | msabramo: next conf will be openstack summit in Paris in Nov 2014 (iirc) | 19:09 |
| mordred | msabramo: I had to bail on it- life happened :( | 19:09 |
| *** zehicle_at_dell has joined #openstack-infra | 19:10 | |
| jeblair | 2014-07-23 18:52:19,311 DEBUG nodepool.NodePool: <AllocationGrant of 234 of devstack-trusty from hpcloud-b5> | 19:10 |
| jeblair | 2014-07-23 18:52:49,188 DEBUG nodepool.NodePool: <AllocationGrant of 445 of devstack-trusty from hpcloud-b5> | 19:10 |
| jeblair | fungi, mordred, ianw: ^ that should not happen -- hpcloud-b5 has max-servers set to 100 | 19:10 |
| mordred | jeblair: ooh. wow | 19:10 |
| msabramo | hashar: Yeah, that's cool that's it in Paris; doubt I'll make it b/c of conference budget; maybe Alex Conrad might go (though he is in Paris now actually) | 19:10 |
| fungi | jeblair: yep, just confirmed it from the config | 19:11 |
| msabramo | mordred: Bummer, sorry to hear that. Was going to swing by that talk. | 19:11 |
| fungi | msabramo: i'm at oscon, currently hacking and semi-watching an hp helion presentation | 19:11 |
| jeblair | i'm at oscon with ttx in a talk about design workflow | 19:12 |
| msabramo | is there an openstack tribe table at lunch? | 19:12 |
| msabramo | I've been going to the Pythonista one mostly | 19:13 |
| jeblair | ianw, fungi, mordred: so i think we have an allocator bug. i'm not really in a position to debug it now. | 19:13 |
| jeblair | i'm not sure what's going to happen with those 1k+ nodes | 19:13 |
| fungi | jeblair: i'm hoping it calms down in a few minutes but... :/ | 19:13 |
| jeblair | it kind of look like hpcloud is trying to build them. it might fail | 19:13 |
| *** otherwiseguy has quit IRC | 19:13 | |
| fungi | hpcloud might fall over | 19:13 |
| jeblair | yeah, i kinda thought we had a quota | 19:14 |
| * fungi is similarly surprised by this | 19:14 | |
| fungi | on the other hand, all pending jobs might get workers really, really soon | 19:14 |
| *** jcoufal has quit IRC | 19:15 | |
| fungi | or our jenkins masters might just asplode | 19:15 |
| mordred | jeblair: me either. I'll try to start reading it | 19:15 |
| mordred | does it have to do with the fake regions in hp we're using? | 19:15 |
| *** jcoufal has joined #openstack-infra | 19:15 | |
| mordred | I mean, hpcloud-b5 doesn't have a quota - hp does | 19:15 |
| fungi | should we consider reverting recent allocator improvements? | 19:15 |
| mordred | and it's 500 | 19:15 |
| mordred | (or 600) | 19:16 |
| jeblair | mordred: right, but b5 has a limit in nodepool and it's 100 | 19:16 |
| *** rcarrillocruz has joined #openstack-infra | 19:16 | |
| jeblair | mordred: so yeah | 19:16 |
| mordred | jeblair: totes. I was just responding to the quota thing. but yeah | 19:16 |
| jeblair | mordred: i would expect that an allocator bug could cause b5 to request more than 100 | 19:16 |
| *** jcoufal has quit IRC | 19:16 | |
| mordred | jeblair: yes | 19:16 |
| jeblair | mordred: that's bug #1 | 19:16 |
| fungi | msabramo: i've been doing ether the open cloud or community leaders tribe table | 19:17 |
| uvirtbot | jeblair: Error: Could not parse data returned by Launchpad: HTTP Error 503: Service Unavailable | 19:17 |
| mordred | sorry. I agree with you. I may be being unclear | 19:17 |
| *** shashankhegde has quit IRC | 19:17 | |
| *** jcoufal has joined #openstack-infra | 19:17 | |
| jeblair | mordred: thing #2 is that since it requested more than 600 and hp hasn't barfed yet, the hp quota situation is weird | 19:17 |
| jeblair | mordred: but that's not a nodepool problem :) | 19:17 |
| mordred | nope! | 19:17 |
| jeblair | 19:17 < jeblair> mordred: thing #2 is that since it requested more than 600 and hp hasn't barfed yet, the hp quota situation is weird | 19:17 |
| jeblair | 19:17 < jeblair> mordred: but that's not a nodepool problem :) | 19:17 |
| jeblair | oops | 19:17 |
| *** rcarrill` has quit IRC | 19:18 | |
| * fungi is going to try to find food and then rejoin the firefight from the dining area | 19:18 | |
| *** rwsu has quit IRC | 19:18 | |
| *** arnaud__ has quit IRC | 19:19 | |
| *** arnaud has quit IRC | 19:19 | |
| *** msabramo has quit IRC | 19:19 | |
| *** alexpilotti has quit IRC | 19:19 | |
| *** rfolco has joined #openstack-infra | 19:20 | |
| *** luqas has quit IRC | 19:20 | |
| *** _nadya_ has quit IRC | 19:22 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Added UX team to StoryBoard https://review.openstack.org/96549 | 19:24 |
| krotscheck | jeblair: mind if I rebase/fix your storyboard timeline message consistency patch? | 19:25 |
| *** dkehn_ is now known as dkehnx | 19:26 | |
| jesusaurus | how much disk does a bandersnatch mirror need? | 19:26 |
| *** e0ne has joined #openstack-infra | 19:26 | |
| greghaynes | jesusaurus: ~100G I think | 19:27 |
| StevenK | jesusaurus: ALL THE DISK | 19:28 |
| *** ociuhandu_ has quit IRC | 19:28 | |
| krotscheck | jeblair: Just the merge conflict. I like the messaging and want it in :) | 19:29 |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file https://review.openstack.org/105930 | 19:29 |
| *** rcarrill` has joined #openstack-infra | 19:30 | |
| *** rcarrillocruz has quit IRC | 19:31 | |
| *** nati_ueno has quit IRC | 19:31 | |
| openstackgerrit | Fausto Marzi proposed a change to openstack-infra/config: Added freezer project to stackforge https://review.openstack.org/108856 | 19:31 |
| *** rwsu has joined #openstack-infra | 19:32 | |
| *** nati_ueno has joined #openstack-infra | 19:32 | |
| *** fausto has joined #openstack-infra | 19:33 | |
| *** mestery has quit IRC | 19:34 | |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file https://review.openstack.org/105930 | 19:34 |
| *** mestery has joined #openstack-infra | 19:34 | |
| *** bnemec has joined #openstack-infra | 19:35 | |
| *** Evgeny has quit IRC | 19:35 | |
| openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Make timeline messages more consistent https://review.openstack.org/107297 | 19:35 |
| *** nati_ueno has quit IRC | 19:36 | |
| *** Sukhdev has joined #openstack-infra | 19:37 | |
| jesusaurus | greghaynes: StevenK: good to know | 19:38 |
| *** ramashri has quit IRC | 19:38 | |
| krotscheck | Turns out that was just a rebase. | 19:38 |
| krotscheck | Moving on.... | 19:38 |
| *** adalbas has quit IRC | 19:38 | |
| *** emagana has quit IRC | 19:40 | |
| *** otherwiseguy has joined #openstack-infra | 19:40 | |
| *** emagana has joined #openstack-infra | 19:41 | |
| *** Sukhdev has quit IRC | 19:44 | |
| *** Sukhdev has joined #openstack-infra | 19:44 | |
| *** emagana has quit IRC | 19:45 | |
| *** james_li has joined #openstack-infra | 19:48 | |
| openstackgerrit | Vitaliy Lotorev proposed a change to openstack-infra/jenkins-job-builder: add include/exclude regions/users in svn scm (doc and tests) https://review.openstack.org/108152 | 19:49 |
| *** markmc has joined #openstack-infra | 19:51 | |
| jogo | so I have a dumb question | 19:52 |
| jogo | I am trying to pull https://review.openstack.org:443/changes/98885 in jquery on a web page | 19:52 |
| jogo | and I get XMLHttpRequest cannot load https://review.openstack.org/changes/98885. No 'Access-Control-Allow-Origin' header is present on the requested resource. Origin 'null' is therefore not allowed access. | 19:52 |
| openstackgerrit | Vitaliy Lotorev proposed a change to openstack-infra/jenkins-job-builder: add include/exclude regions/users in svn scm (doc and tests) https://review.openstack.org/108152 | 19:53 |
| jogo | krotscheck: ^ | 19:53 |
| krotscheck | jogo: CORS! | 19:53 |
| jogo | krotscheck: I know enoug to know that is part of it, but don't know what it means or how to fix it | 19:54 |
| krotscheck | jogo: It’s not a dumb question at all. Basically, to prevent cross-browser scary javascript things, the browser sandboxes pretty much any javascript to the domain it was loaded from. That sandboxing is done per port, host, and protocol. | 19:55 |
| *** ZZelle_ has quit IRC | 19:56 | |
| krotscheck | CORS is a specification that allows a domain (in this case review.openstack.org) to pick which domains are allowed to break that sandbox. | 19:56 |
| *** ZZelle_ has joined #openstack-infra | 19:56 | |
| krotscheck | That communication is done via a preflight request (look for an OPTIONS) that includes a bunch of Access headers. | 19:56 |
| krotscheck | Anyway. | 19:57 |
| *** zehicle_at_dell has quit IRC | 19:57 | |
| krotscheck | There are really only two good options to fix it. The first is to see whether gerrit has cors support somewhere (I don’t know if it does). The second is to proxy all requests through your server using something like mod_proxy. | 19:57 |
| *** ociuhandu has joined #openstack-infra | 19:58 | |
| *** bauzas has quit IRC | 19:58 | |
| sdague | jogo: the point is to specifically prevent people from jumping domains with inline code execution, because it's a terrible security vulnerability :) | 19:58 |
| jogo | sdague krotscheck: I was going to make elastic-recheck status page query gerrit for patch status | 19:59 |
| sdague | yeh, don't do that in jquery | 19:59 |
| sdague | that should be a batch offline operation | 19:59 |
| jogo | sdague: that isn't nearly as fun | 19:59 |
| krotscheck | Is gerrit a java war? | 19:59 |
| jogo | zaro: ^ | 19:59 |
| *** arnaud has joined #openstack-infra | 19:59 | |
| jogo | krotscheck: correct | 19:59 |
| krotscheck | Oh. | 19:59 |
| sdague | jogo: it's way better to debug | 19:59 |
| krotscheck | That’s easier then. | 19:59 |
| krotscheck | Sec, lemme find an example. | 20:00 |
| *** lcheng has quit IRC | 20:00 | |
| sdague | jogo: seriously, don't go down this path | 20:00 |
| jogo | sdague: I'll do the bach thing, but wanna see if I can get this working if krotscheck has an answer | 20:00 |
| *** cpallares has quit IRC | 20:01 | |
| sdague | ok, just realize I'm going to -2 this approach, the page load time is already unacceptable for the ER page, and going off and real time hitting gerrit with a ton of rest requests isn't something we should do | 20:01 |
| *** lcheng has joined #openstack-infra | 20:01 | |
| * krotscheck shrugs. | 20:02 | |
| krotscheck | I believe that newer versions of tomcat come with a CORS servlet filter that you just have to enable & configure. | 20:02 |
| krotscheck | But if sdague is just going to -2 that then there’s no real point. | 20:02 |
| krotscheck | Plus I don’t really know how gerrit is deployed, I’m still sifting through those manifests. | 20:03 |
| * jogo has his javascript dreams crushed by reality | 20:04 | |
| jogo | good thing I don't really like javascript | 20:04 |
| *** e0ne has quit IRC | 20:05 | |
| krotscheck | You speak heresy. | 20:05 |
| krotscheck | :) | 20:05 |
| *** james_li has quit IRC | 20:05 | |
| sdague | jogo: also - https://review.openstack.org/#/q/status:open+project:openstack-infra/elastic-recheck+branch:master+topic:erchanges,n,z | 20:05 |
| sdague | which is what I think we agreed to in darmstadt | 20:06 |
| *** flaviof is now known as flaviof_zzz | 20:06 | |
| jogo | sdague: yeah will take a look this afternoon | 20:06 |
| jogo | generating the list of open patches for each bug for the e-r page | 20:06 |
| *** dustins has quit IRC | 20:07 | |
| *** Muz_ has joined #openstack-infra | 20:07 | |
| jogo | sdague: should I supress merged patches or show them all? | 20:08 |
| *** mwagner_lap has joined #openstack-infra | 20:08 | |
| jogo | I am thinking supress | 20:08 |
| *** dkliban is now known as dkliban_brb | 20:08 | |
| sdague | definitely supress | 20:09 |
| russellb | what's going on with the number of jobs? http://status.openstack.org/zuul/ | 20:09 |
| russellb | just normal afternoon busyness? | 20:09 |
| *** e0ne has joined #openstack-infra | 20:09 | |
| sdague | russellb: no, something's on fire. Last I knew fungi and possibly jeblair were looking at it | 20:10 |
| *** bauzas has joined #openstack-infra | 20:10 | |
| russellb | sdague: oh ok | 20:10 |
| russellb | thought something didn't look right | 20:10 |
| annegentle | jogo: got a mo for a question about devstack and nova development? Kinda a n00b thing tho | 20:10 |
| annegentle | jogo: and all about being able to get sphinx to build | 20:11 |
| annegentle | ah I can ask in #openstack-dev | 20:11 |
| *** ramashri has joined #openstack-infra | 20:12 | |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Fix and update query for bug 1295808 https://review.openstack.org/109103 | 20:13 |
| uvirtbot | Launchpad bug 1295808 in tempest "paramiko EOFError in test_security_groups_basic_ops" [Undecided,New] https://launchpad.net/bugs/1295808 | 20:13 |
| *** homeless has quit IRC | 20:15 | |
| *** homeless has joined #openstack-infra | 20:16 | |
| *** james_li has joined #openstack-infra | 20:17 | |
| *** emagana has joined #openstack-infra | 20:17 | |
| *** melwitt has joined #openstack-infra | 20:18 | |
| *** ZZelle has joined #openstack-infra | 20:18 | |
| *** shashankhegde has joined #openstack-infra | 20:18 | |
| russellb | fungi: jeblair if you guys could keep me in the loop on gate status, i'd much appreciate it. i'm working on wrapping up juno-2 tags and such for tomorrow's release. thanks for your work on things! | 20:20 |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: add query for cinder encryption-type-list failure https://review.openstack.org/108472 | 20:21 |
| *** timrc is now known as timrc-afk | 20:21 | |
| *** gokrokve has quit IRC | 20:23 | |
| openstackgerrit | litong01 proposed a change to openstack-infra/config: add channel #openstack-monasca to eavesdrop log server https://review.openstack.org/109109 | 20:23 |
| *** julim_ has quit IRC | 20:24 | |
| *** radez is now known as radez_g0n3 | 20:25 | |
| *** dprince_ has quit IRC | 20:25 | |
| *** cody-somerville has joined #openstack-infra | 20:26 | |
| *** ChuckC has quit IRC | 20:26 | |
| *** ramashri has quit IRC | 20:26 | |
| *** grantbow has quit IRC | 20:28 | |
| *** hogepodge has joined #openstack-infra | 20:28 | |
| *** dmsimard is now known as dmsimard_away | 20:28 | |
| *** e0ne has quit IRC | 20:29 | |
| *** grantbow has joined #openstack-infra | 20:29 | |
| *** zz_dimtruck is now known as dimtruck | 20:29 | |
| *** jp_at_hp has quit IRC | 20:30 | |
| *** derekh_ has quit IRC | 20:30 | |
| clarkb | russellb just looking at the zuul status page indicates the gate is moving | 20:31 |
| *** rwsu has quit IRC | 20:32 | |
| clarkb | so assuming fire is put out we should be good? | 20:32 |
| * clarkb goea back to crazy travel things | 20:32 | |
| *** rcarrillocruz has joined #openstack-infra | 20:33 | |
| *** hogepodge has quit IRC | 20:33 | |
| russellb | clarkb: job queue shows a very low number running ... so thought maybe new stuff wasn't getting launched? | 20:33 |
| *** ramashri has joined #openstack-infra | 20:33 | |
| * jeblair is back | 20:33 | |
| *** bnemec has quit IRC | 20:33 | |
| *** e0ne has joined #openstack-infra | 20:33 | |
| fungi | russellb: yep, still poking now that i've lunched | 20:34 |
| jeblair | so... most of the lines are still pointing up and to the right rather than down | 20:34 |
| russellb | fungi: lunch is good! | 20:34 |
| * fungi repaints this as the nodepool load test | 20:34 | |
| *** rcarrill` has quit IRC | 20:34 | |
| russellb | ha | 20:35 |
| jeblair | i just suggested verbally to fungi that we restart nodepool again and see if it does the same thing a second time | 20:35 |
| jeblair | if it does, we revert the allocator change and try a third time | 20:35 |
| jeblair | then we can narrow in on whether this is a new or latent bug | 20:35 |
| jeblair | fungi is restarting | 20:36 |
| asselin | hi, I'm trying to test my 3rd party ci system. It's working with sanbox, but not cinder. http://paste.openstack.org/show/87835/ | 20:37 |
| jeblair | #status alert nodepool is unable to build test nodes so check and gate tests are delayed | 20:39 |
| openstackstatus | jeblair: sending alert | 20:39 |
| *** dkliban_brb is now known as dkliban | 20:39 | |
| *** rlandy has quit IRC | 20:39 | |
| openstackgerrit | David Lenwell proposed a change to openstack-infra/infra-manual: Add an introduction paragraph to the developer guide https://review.openstack.org/107024 | 20:40 |
| -openstackstatus- NOTICE: nodepool is unable to build test nodes so check and gate tests are delayed | 20:40 | |
| *** ChanServ changes topic to "nodepool is unable to build test nodes so check and gate tests are delayed" | 20:40 | |
| *** chuckC has joined #openstack-infra | 20:41 | |
| *** gokrokve has joined #openstack-infra | 20:41 | |
| openstackstatus | jeblair: finished sending alert | 20:42 |
| *** signed8bit is now known as signed8bit_ZZZzz | 20:42 | |
| *** jcoufal has quit IRC | 20:44 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 20:44 | |
| *** msabramo has joined #openstack-infra | 20:44 | |
| *** rkukura has quit IRC | 20:44 | |
| *** mmaglana has joined #openstack-infra | 20:48 | |
| *** julim has joined #openstack-infra | 20:49 | |
| *** eharney has quit IRC | 20:50 | |
| *** lcheng has quit IRC | 20:51 | |
| *** stevemar has quit IRC | 20:53 | |
| *** lcheng has joined #openstack-infra | 20:53 | |
| *** Longgeek_ has quit IRC | 20:54 | |
| *** gokrokve has quit IRC | 20:56 | |
| *** e0ne has quit IRC | 20:56 | |
| *** krtaylor has quit IRC | 20:57 | |
| *** Evgeny has joined #openstack-infra | 20:57 | |
| *** mrda-away is now known as mrda | 20:57 | |
| *** zehicle_at_dell has joined #openstack-infra | 20:57 | |
| *** mwagner_lap has quit IRC | 20:58 | |
| *** eglynn-afk has quit IRC | 21:00 | |
| *** julim has quit IRC | 21:00 | |
| *** aysyd has quit IRC | 21:00 | |
| *** flaviof_zzz is now known as flaviof | 21:02 | |
| *** eglynn-afk has joined #openstack-infra | 21:04 | |
| *** eharney has joined #openstack-infra | 21:05 | |
| *** dimtruck is now known as zz_dimtruck | 21:07 | |
| *** zz_dimtruck is now known as dimtruck | 21:07 | |
| *** zehicle_at_dell has quit IRC | 21:07 | |
| *** laxity has quit IRC | 21:08 | |
| *** laxity has joined #openstack-infra | 21:08 | |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/config: Move some jenkinsuser bits to openstack_project https://review.openstack.org/106884 | 21:08 |
| *** gokrokve has joined #openstack-infra | 21:10 | |
| hemna | is there a reason why a cinder core member doesn't have +2/+3 in cinder-specs ? | 21:10 |
| hemna | there are a couple cinder core members that don't have +2 in cinder-specs | 21:10 |
| *** rkukura has joined #openstack-infra | 21:11 | |
| jeblair | so it looks like nodepool did the same thing again | 21:11 |
| jesusaurus | what happened? | 21:12 |
| *** zehicle_at_dell has joined #openstack-infra | 21:12 | |
| jeblair | jesusaurus: it's trying to allocate 1500 nodes from hpcluod | 21:14 |
| fungi | all in our hpcloud-b5 network specifically | 21:14 |
| jeblair | we're restarting it now with the recent allocator change reverted | 21:14 |
| jeblair | to see if it's related to that | 21:14 |
| *** marcoemorais has quit IRC | 21:14 | |
| jesusaurus | oh well thats not going to fit... | 21:15 |
| jeblair | it's a bit much | 21:15 |
| fungi | hemna: https://review.openstack.org/#/admin/projects/openstack/cinder-specs,access indicates there's a cinder-specs-core group https://review.openstack.org/#/admin/groups/344,members which looks like a subset of cinder-core | 21:15 |
| hemna | fungi, ok thanks. I'll have to bug my PTL then :) | 21:16 |
| fungi | hemna: indeed | 21:16 |
| *** arnaud has quit IRC | 21:16 | |
| *** marcoemorais has joined #openstack-infra | 21:16 | |
| *** dimtruck is now known as zz_dimtruck | 21:16 | |
| *** AJaeger has quit IRC | 21:17 | |
| *** zehicle_at_dell has quit IRC | 21:19 | |
| *** arnaud has joined #openstack-infra | 21:19 | |
| *** arnaud__ has joined #openstack-infra | 21:19 | |
| *** rfolco has quit IRC | 21:19 | |
| *** dkranz has quit IRC | 21:19 | |
| emagana | Hi Folks! | 21:21 |
| emagana | One quick question on swap allocation on the Infra compute hosts | 21:21 |
| emagana | Do you allocate any swap at all on the compute hosts? | 21:21 |
| emagana | KVM are single process that won't be beneficial from the swap but I was wondering if there any use case that I am missing | 21:22 |
| *** terryw has joined #openstack-infra | 21:22 | |
| *** otherwiseguy has quit IRC | 21:22 | |
| *** andreykurilin has quit IRC | 21:23 | |
| fungi | emagana: what do you mean by "the Infra compute hosts"? | 21:23 |
| *** mfer has quit IRC | 21:23 | |
| *** andreykurilin has joined #openstack-infra | 21:23 | |
| fungi | emagana: talking about the long-running instances on which we host community infrastructure services? | 21:23 |
| fungi | emagana: or are you talking about worker instances where continuous integration test jobs run? | 21:24 |
| emagana | fungi: Yes, those ones | 21:25 |
| emagana | fungi: My understanding is that every patch is tested in a self-contained environment run by devstack | 21:26 |
| emagana | fungi: SO, basically the host server of those VMs only have KVM processes | 21:26 |
| *** adalbas has joined #openstack-infra | 21:26 | |
| fungi | emagana: yes, those self-contained environments are nova instances we obtain from public cloud providers | 21:26 |
| emagana | fungi: Then, is Swap really used on those host servers? | 21:27 |
| *** msabramo has quit IRC | 21:27 | |
| fungi | emagana: where is kvm coming into this? | 21:27 |
| *** msabramo has joined #openstack-infra | 21:27 | |
| *** markmcclain1 has joined #openstack-infra | 21:27 | |
| emagana | because KVM is the hypervisor, right? | 21:27 |
| fungi | emagana: for example, rackspace is running xen, not kvm | 21:27 |
| emagana | fungi: I did not know that | 21:27 |
| fungi | emagana: there are all sorts of hypervisors... the world is not all kvm ;) | 21:27 |
| *** fausto has quit IRC | 21:28 | |
| *** markmcclain has quit IRC | 21:28 | |
| *** hogepodge has joined #openstack-infra | 21:28 | |
| emagana | fungi: ok, forget about the specific hypervisor, what I am trying to find out is I need to allocate swap in my cloud | 21:28 |
| emagana | fungi: in my compute nodes | 21:28 |
| openstackgerrit | Walter A. Boring IV (hemna) proposed a change to openstack-infra/config: Turn on tests for cinder-specs patches https://review.openstack.org/109127 | 21:28 |
| fungi | emagana: we do allocate swap on our long-running servers, mainly to provide somewhat of a lifeboat in oom events, but i'd have to look at one of the job workers to see if we do the same there | 21:29 |
| emagana | fungi: oom ? | 21:29 |
| clarkb | fungi we do in d-g | 21:30 |
| clarkb | emagana out ofemory | 21:30 |
| fungi | emagana: out-of-memory | 21:30 |
| *** eglynn has joined #openstack-infra | 21:30 | |
| emagana | fungi: got it.. | 21:30 |
| clarkb | but ya its a safety net | 21:30 |
| emagana | clarkb: That makes sense.. | 21:30 |
| fungi | emagana: at which point the kernel fires up an oom killer to try and salvage what it can while cutting the most memory-hungry process | 21:30 |
| *** eglynn-afk has quit IRC | 21:30 | |
| *** sballe has joined #openstack-infra | 21:31 | |
| emagana | fungi: what happen if that process is a running VM | 21:31 |
| clarkb | we should still use cgroups on test processes | 21:31 |
| openstackgerrit | litong01 proposed a change to openstack-infra/config: connect irc channel openstack-monasca with monasca gerrit patch sets https://review.openstack.org/109129 | 21:31 |
| clarkb | so its safety fr the OS? | 21:31 |
| *** msabramo has quit IRC | 21:31 | |
| clarkb | I bet qemu doesnt land in that cgroup though | 21:31 |
| *** andreykurilin has quit IRC | 21:32 | |
| *** timrc-afk is now known as timrc | 21:32 | |
| *** nati_ueno has joined #openstack-infra | 21:33 | |
| *** nati_ueno has quit IRC | 21:34 | |
| *** nati_ueno has joined #openstack-infra | 21:34 | |
| emagana | fungi: sorry for the linux course here... :-) | 21:34 |
| *** tongli has quit IRC | 21:35 | |
| *** jdahlin_ has joined #openstack-infra | 21:36 | |
| *** shashankhegde has quit IRC | 21:37 | |
| fungi | emagana: yeah, not entirely sure what the behavior is, but if the qemu process gets picked by the kernel's oom killer i would expect it to ungracefully stop the instance associated with it | 21:38 |
| emagana | fungi: better to loose one that the entire host :-) | 21:38 |
| * fungi nods | 21:38 | |
| *** markmcclain1 has quit IRC | 21:38 | |
| *** arnaud__ has quit IRC | 21:39 | |
| *** arnaud has quit IRC | 21:39 | |
| clarkb | use the cgroups for great good | 21:39 |
| fungi | yeah, because i remember the time before the oom killer, when you just got a nice friendly kernel panic | 21:39 |
| *** AJaeger has joined #openstack-infra | 21:39 | |
| *** AJaeger has joined #openstack-infra | 21:39 | |
| clarkb | you can set memory and swap thesholds with soft and hard values | 21:39 |
| *** unicell has quit IRC | 21:40 | |
| *** cody-somerville has quit IRC | 21:41 | |
| fungi | i *think* we set swappiness to 0 so that stuff doesn't get automatically paged out to make room for more buffer/cache but i could be just thinking of my personal instances instead | 21:42 |
| *** pfallenop has quit IRC | 21:43 | |
| *** dkehn_ has joined #openstack-infra | 21:43 | |
| *** pfallenop has joined #openstack-infra | 21:44 | |
| *** Sukhdev has quit IRC | 21:44 | |
| *** ianw has quit IRC | 21:44 | |
| *** ianw has joined #openstack-infra | 21:44 | |
| *** gokrokve has quit IRC | 21:46 | |
| *** dkehnx has quit IRC | 21:46 | |
| *** betsy has quit IRC | 21:47 | |
| *** gokrokve has joined #openstack-infra | 21:47 | |
| *** andreykurilin has joined #openstack-infra | 21:48 | |
| *** hashar has quit IRC | 21:50 | |
| ianw | jeblair / sdague / clarkb : can you take a peek at https://review.openstack.org/#/c/103458/ (Initial RHEL7/Centos7 support) ; it's been around for a while | 21:50 |
| jeblair | ianw: did you see the problem we were looking at earlier? | 21:51 |
| *** gokrokve has quit IRC | 21:52 | |
| *** dkehn_ is now known as dkehnx | 21:52 | |
| *** rkukura has quit IRC | 21:53 | |
| *** gokrokve has joined #openstack-infra | 21:53 | |
| *** dkliban is now known as dkliban_afk | 21:53 | |
| jeblair | the allocator has run several times now and does not appear to be exceeding quota | 21:54 |
| *** Longgeek has joined #openstack-infra | 21:54 | |
| jeblair | so i think that change was the problem | 21:54 |
| *** cnesa has quit IRC | 21:54 | |
| jeblair | ianw: i believe the recent allocator change has a bug | 21:55 |
| jeblair | ianw: we observed that if we restart nodepool with a very high request load, the allocator will exceed the configured quota for the last-defined provider after the first pass through the loop | 21:56 |
| *** eharney has quit IRC | 21:56 | |
| *** mriedem has quit IRC | 21:57 | |
| fungi | ianw: | 21:57 |
| fungi | http://graphite.openstack.org/render/?from=-6hours&height=500&until=now&width=900&bgcolor=ffffff&fgcolor=000000&areaMode=stacked&target=color(alias(sumSeries(stats.gauges.nodepool.target.building),%20%27Building%27),%20%27ffbf52%27)&target=color(alias(sumSeries(stats.gauges.nodepool.target.ready),%20%27Available%27),%20%2700c868%27)&target=color(alias(sumSeries(stats.gauges.nodepool.target.used),%20% | 21:57 |
| fungi | 27In%20Use%27),%20%276464ff%27)&target=color(alias(sumSeries(stats.gauges.nodepool.target.delete),%20%27Deleting%27),%20%27c864ff%27)&title=Test%20Nodes | 21:57 |
| fungi | wow, that was a crazylong url, sorry | 21:57 |
| *** pcm___ has quit IRC | 21:58 | |
| *** Longgeek has quit IRC | 21:58 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/nodepool: Revert "Track last allocations to ensure forward-progress" https://review.openstack.org/109132 | 22:00 |
| jeblair | that change is in production on nodepool already ^ | 22:00 |
| *** nati_ueno has quit IRC | 22:00 | |
| *** nati_ueno has joined #openstack-infra | 22:01 | |
| *** zehicle_at_dell has joined #openstack-infra | 22:01 | |
| jeblair | sdague: ^ fyi | 22:01 |
| jeblair | mordred, clarkb, SergeyLukjanov, jhesketh: ^ | 22:02 |
| jeblair | #status alert zuul is working through a backlog of jobs due to an earlier problem with nodepool | 22:04 |
| openstackstatus | jeblair: sending alert | 22:04 |
| *** dizquierdo has joined #openstack-infra | 22:04 | |
| jeblair | russellb: ^ update | 22:04 |
| *** yamamoto has joined #openstack-infra | 22:04 | |
| ianw | hmm, sorry my irc proxy died overnight | 22:05 |
| *** jswarren has quit IRC | 22:05 | |
| jeblair | ianw: for full context you may want to see http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2014-07-23.log | 22:05 |
| -openstackstatus- NOTICE: zuul is working through a backlog of jobs due to an earlier problem with nodepool | 22:06 | |
| *** ChanServ changes topic to "zuul is working through a backlog of jobs due to an earlier problem with nodepool" | 22:06 | |
| ianw | hmm, well the most useful thing would be a test-case to reproduce that issue i guess | 22:07 |
| fungi | ianw: that would be wonderful | 22:07 |
| openstackstatus | jeblair: finished sending alert | 22:08 |
| *** emagana has quit IRC | 22:08 | |
| mattoliverau | Morning | 22:08 |
| *** emagana has joined #openstack-infra | 22:08 | |
| *** alexandra_ has joined #openstack-infra | 22:10 | |
| jeblair | mattoliverau: good morning | 22:10 |
| asselin | hi, hope this is a better time to ask: I'm trying to test my 3rd party ci system. It's working with sanbox, but not cinder. http://paste.openstack.org/show/87835/ Any ideas/tips to debug? | 22:10 |
| jeblair | and yay, the red line is now moving down and to the right | 22:10 |
| *** freyes_ has quit IRC | 22:12 | |
| *** asettle has quit IRC | 22:12 | |
| *** mbacchi has quit IRC | 22:12 | |
| *** andreykurilin has quit IRC | 22:12 | |
| *** emagana has quit IRC | 22:13 | |
| jeblair | asselin: cd /var/lib/zuul/git/openstack/cinder | 22:14 |
| jeblair | asselin: git remote -v | 22:14 |
| jeblair | asselin: and paste that output please | 22:14 |
| *** sballe has quit IRC | 22:14 | |
| mattoliverau | How is everyone? Back into the swing of things again? I see there was more nodepool issues, never any rest for infra :( | 22:14 |
| *** salv-orlando has joined #openstack-infra | 22:14 | |
| asselin | jeblair, thanks...pointing to wrong remote | 22:15 |
| mordred | wow. well, I guess I picked the wrong day to be completely unavailable in an all-day meeting | 22:15 |
| jeblair | mordred: have you ever picked the right day for that? :) | 22:16 |
| fungi | asselin: did the cinder project approve having your account moved from the test group to the voting group? what's the name of the account? | 22:16 |
| jhesketh | Morning | 22:16 |
| jeblair | mattoliverau: fungi and i are at oscon; clarkb is on a train :) | 22:16 |
| *** zehicle_at_dell has quit IRC | 22:16 | |
| asselin | jeblair, another question: http://paste.openstack.org/show/87845/ gitdb is not in the requirements.txt for zuul. Am I supposed to install that manually? | 22:16 |
| jeblair | jhesketh: morning | 22:16 |
| jhesketh | ArxCruz: pong (re zuul-swift-plugin) | 22:17 |
| fungi | mattoliverau: i have a (kawaiinot) tee shirt which says "if there is no rest for the wicked, then coffee is the drink of the damned" | 22:17 |
| ArxCruz | jhesketh: hey | 22:17 |
| jeblair | asselin: i think gitpython should install it | 22:17 |
| ArxCruz | jhesketh: I think I figure out how it works | 22:17 |
| ArxCruz | very clever btw | 22:17 |
| ArxCruz | you're da man :) | 22:17 |
| *** alexandra_ is now known as asettle | 22:17 | |
| asselin | fungi, no, not that I know of. I should still be in the 'test' group and not voting. | 22:17 |
| mattoliverau | fungi: lol awesome, I need one :) | 22:17 |
| jhesketh | ArxCruz: okay cool :-) | 22:17 |
| *** arnaud has joined #openstack-infra | 22:18 | |
| *** arnaud__ has joined #openstack-infra | 22:18 | |
| fungi | asselin: oh, i see, you're getting git fetch errors spewed from the zuul merger | 22:18 |
| asselin | fungi, yes, I had a different remote from a different test setup. Fixing it now. | 22:19 |
| *** yamamoto has quit IRC | 22:19 | |
| fungi | asselin: oh, great. thanks | 22:19 |
| *** eglynn_ has joined #openstack-infra | 22:21 | |
| *** eglynn has quit IRC | 22:22 | |
| *** jgrimm has quit IRC | 22:22 | |
| *** Longgeek has joined #openstack-infra | 22:24 | |
| *** sballe has joined #openstack-infra | 22:24 | |
| *** markmc has quit IRC | 22:25 | |
| *** nelsnelson has quit IRC | 22:25 | |
| mordred | jeblair: nope. all of the days are the wrong days | 22:25 |
| *** wenlock has quit IRC | 22:25 | |
| *** homeless has quit IRC | 22:26 | |
| *** homeless has joined #openstack-infra | 22:26 | |
| openstackgerrit | Walter A. Boring IV (hemna) proposed a change to openstack-infra/config: Turn on tests for cinder-specs patches https://review.openstack.org/109127 | 22:27 |
| *** dims has quit IRC | 22:29 | |
| *** Longgeek has quit IRC | 22:29 | |
| *** eglynn_ has quit IRC | 22:31 | |
| *** bauzas has quit IRC | 22:32 | |
| *** doug-fish has left #openstack-infra | 22:32 | |
| *** dims has joined #openstack-infra | 22:33 | |
| *** emagana has joined #openstack-infra | 22:35 | |
| *** cnesa has joined #openstack-infra | 22:36 | |
| *** datsun180b has quit IRC | 22:36 | |
| *** hogepodge has quit IRC | 22:36 | |
| *** thedodd has quit IRC | 22:38 | |
| *** lcheng has quit IRC | 22:39 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/subunit2sql: Bump oslo.config version https://review.openstack.org/109140 | 22:39 |
| *** cnesa has quit IRC | 22:40 | |
| *** rkukura has joined #openstack-infra | 22:43 | |
| *** dims has quit IRC | 22:43 | |
| dougwig | hi infra, devstack-gate-vm recommends 2GB of ram; i've got a vm with 4gb which uses all of it and is quite slow; have the minimums changed? | 22:43 |
| pleia2 | dougwig: where is that recommendation? I think it might be out-dated | 22:43 |
| pleia2 | 8G should do it | 22:44 |
| dougwig | it was on a wiki somewhere, which i have lost. ok, that's quite a bit different. :) | 22:45 |
| pleia2 | ok, if you manage to find the link it would be helpful so we can update it :) | 22:46 |
| dougwig | let me go update my jenkins setup and get a job running, and then i'll look. | 22:46 |
| fungi | dougwig: the readme in the devstack-gate git repo should hopefully mention a larger number | 22:49 |
| *** yamamoto has joined #openstack-infra | 22:50 | |
| pleia2 | fungi: speaking of which, if you're bored :) https://review.openstack.org/#/c/107427/ | 22:50 |
| fungi | pleia2: bookmarked! | 22:51 |
| *** prad has quit IRC | 22:52 | |
| openstackgerrit | Matthew Treinish proposed a change to openstack-infra/subunit2sql: Bump oslo.config version https://review.openstack.org/109140 | 22:53 |
| *** yamamoto has quit IRC | 22:54 | |
| dougwig | readme says 4, recommends 8. i'd wager i was looking at some blog or something, because i can't find an official reference. | 22:55 |
| *** dizquierdo has quit IRC | 22:55 | |
| pleia2 | dougwig: ok, thanks for looking | 22:55 |
| *** whoops has quit IRC | 22:56 | |
| *** rkukura has quit IRC | 22:57 | |
| *** shashankhegde has joined #openstack-infra | 23:00 | |
| *** bknudson has quit IRC | 23:02 | |
| openstackgerrit | Joe Gordon proposed a change to openstack-infra/elastic-recheck: Add open reviews to elastic-recheck status page https://review.openstack.org/109144 | 23:04 |
| *** sballe has quit IRC | 23:04 | |
| *** pdmars has quit IRC | 23:05 | |
| *** pdmars has joined #openstack-infra | 23:05 | |
| *** pdmars has quit IRC | 23:10 | |
| *** nati_ueno has quit IRC | 23:11 | |
| *** hemna is now known as hemna_ | 23:11 | |
| *** emagana has quit IRC | 23:11 | |
| *** emagana has joined #openstack-infra | 23:12 | |
| *** rkukura has joined #openstack-infra | 23:12 | |
| fungi | dougwig: we test it with 8, so it's possible it could stop being terribly usable in 4 | 23:12 |
| *** emagana_ has joined #openstack-infra | 23:13 | |
| *** emagana has quit IRC | 23:13 | |
| dougwig | i'm trying with 4 now; will let you know. | 23:13 |
| *** cody-somerville has joined #openstack-infra | 23:13 | |
| pleia2 | thanks | 23:13 |
| *** rkukura has quit IRC | 23:13 | |
| *** david-lyle has quit IRC | 23:14 | |
| *** arnaud__ has quit IRC | 23:14 | |
| *** arnaud has quit IRC | 23:14 | |
| *** zehicle_at_dell has joined #openstack-infra | 23:15 | |
| *** LinuxJedi has quit IRC | 23:16 | |
| *** yamamoto has joined #openstack-infra | 23:16 | |
| *** nati_ueno has joined #openstack-infra | 23:17 | |
| *** homeless has quit IRC | 23:17 | |
| *** homeless has joined #openstack-infra | 23:18 | |
| *** jamielenz is now known as jamielennox | 23:20 | |
| *** signed8bit has quit IRC | 23:20 | |
| *** LinuxJedi has joined #openstack-infra | 23:21 | |
| *** yamamoto has quit IRC | 23:21 | |
| *** arnaud has joined #openstack-infra | 23:22 | |
| *** arnaud__ has joined #openstack-infra | 23:22 | |
| *** james_li has quit IRC | 23:28 | |
| *** praneshp has quit IRC | 23:32 | |
| *** wenlock has joined #openstack-infra | 23:35 | |
| *** packet has quit IRC | 23:36 | |
| *** dims has joined #openstack-infra | 23:38 | |
| *** shashankhegde has quit IRC | 23:39 | |
| dougwig | pleia2: 4 works reasonably well. it's steady state using about 300mb of swap, so if you've got a VM with no swap, you need to plumb in a swapfile, which is less than ideal i/o. but it's not godawful failure and pain like 2. | 23:39 |
| *** rcarrill` has joined #openstack-infra | 23:40 | |
| *** rcarrillocruz has quit IRC | 23:41 | |
| *** dims has quit IRC | 23:43 | |
| *** nati_ueno has quit IRC | 23:46 | |
| *** emagana_ has quit IRC | 23:46 | |
| ianw | jeblair: i can get some crazy behaviour from the allocator if i pass in negative available | 23:47 |
| *** emagana has joined #openstack-infra | 23:47 | |
| ianw | e.g. | 23:47 |
| ianw | n_provider = count_nodes_and_subnodes(provider.name) | 23:47 |
| ianw | available = provider_max - n_provider | 23:47 |
| ianw | ap = allocation.AllocationProvider(provider.name, available) | 23:47 |
| ianw | if that works out negative | 23:47 |
| ianw | any thoughts on how that might happen? | 23:47 |
| *** che-arne|2 has joined #openstack-infra | 23:49 | |
| *** yjiang5 has quit IRC | 23:49 | |
| *** emagana has quit IRC | 23:51 | |
| *** che-arne has quit IRC | 23:51 | |
| *** gokrokve has quit IRC | 23:51 | |
| *** rkukura has joined #openstack-infra | 23:54 | |
| *** cnesa has joined #openstack-infra | 23:54 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for bug 1347122 https://review.openstack.org/108823 | 23:56 |
| uvirtbot | Launchpad bug 1347122 in tempest "TestServerWaiters.test_wait_for_server_status_extra_timeout races" [Medium,Fix released] https://launchpad.net/bugs/1347122 | 23:56 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: add query for cinder encryption-type-list failure https://review.openstack.org/108472 | 23:58 |
| *** zehicle_at_dell has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
