| *** netsin has joined #openstack-infra | 00:04 | |
| *** salv-orlando has joined #openstack-infra | 00:09 | |
| *** kzaitsev_mb has quit IRC | 00:09 | |
| *** mtanino has joined #openstack-infra | 00:10 | |
| *** salv-orlando has quit IRC | 00:14 | |
| *** amitgandhinz has joined #openstack-infra | 00:18 | |
| *** _d34dh0r53_ is now known as d34dh0r53 | 00:18 | |
| *** markvoelker_ has quit IRC | 00:18 | |
| *** gildub has quit IRC | 00:19 | |
| *** claudiub has quit IRC | 00:24 | |
| *** gildub has joined #openstack-infra | 00:29 | |
| *** gildub_ has joined #openstack-infra | 00:32 | |
| *** gildub has quit IRC | 00:35 | |
| *** gdubreui has joined #openstack-infra | 00:36 | |
| *** gildub_ has quit IRC | 00:37 | |
| *** EricGonczer_ has quit IRC | 00:48 | |
| *** thorst has joined #openstack-infra | 00:50 | |
| *** thorst has quit IRC | 00:52 | |
| *** amitgandhinz has quit IRC | 00:52 | |
| *** hongbin has joined #openstack-infra | 00:52 | |
| *** mtanino has quit IRC | 00:53 | |
| *** kaisers_ has joined #openstack-infra | 01:02 | |
| *** kaisers_ has quit IRC | 01:07 | |
| *** zz_dimtruck is now known as dimtruck | 01:08 | |
| *** salv-orlando has joined #openstack-infra | 01:10 | |
| *** zhurong has joined #openstack-infra | 01:14 | |
| *** salv-orlando has quit IRC | 01:15 | |
| openstackgerrit | Liping Mao proposed openstack-infra/project-config: Add kuryr to PROJECTS https://review.openstack.org/387109 | 01:18 |
|---|---|---|
| *** csomerville has joined #openstack-infra | 01:19 | |
| *** yanyanhu has joined #openstack-infra | 01:21 | |
| *** cody-somerville has quit IRC | 01:22 | |
| *** tiswanso has joined #openstack-infra | 01:30 | |
| prometheanfire | pabelanger: ping? it looks like gentoolkit was already in pkg-map https://review.openstack.org/#/c/386244/ | 01:32 |
| *** gildub_ has joined #openstack-infra | 01:34 | |
| *** cardeois has joined #openstack-infra | 01:35 | |
| *** gdubreui has quit IRC | 01:35 | |
| *** gdubreui has joined #openstack-infra | 01:36 | |
| *** jcoufal has quit IRC | 01:38 | |
| *** rhallisey has quit IRC | 01:38 | |
| openstackgerrit | Matthew Thode proposed openstack-infra/project-config: Add Gentoo support to nodepool https://review.openstack.org/387114 | 01:38 |
| *** gildub_ has quit IRC | 01:39 | |
| prometheanfire | pabelanger: ^ moved it to the correct location | 01:40 |
| *** hongbin_ has joined #openstack-infra | 01:44 | |
| *** hongbin has quit IRC | 01:46 | |
| *** amitgandhinz has joined #openstack-infra | 01:48 | |
| *** hongbin has joined #openstack-infra | 01:50 | |
| *** tuanluong has joined #openstack-infra | 01:51 | |
| *** thorst has joined #openstack-infra | 01:51 | |
| *** hongbin_ has quit IRC | 01:52 | |
| *** dimtruck is now known as zz_dimtruck | 01:52 | |
| *** gdubreui has quit IRC | 01:53 | |
| *** gildub has joined #openstack-infra | 01:53 | |
| *** thorst has quit IRC | 01:54 | |
| *** thorst has joined #openstack-infra | 01:55 | |
| *** EricGonczer_ has joined #openstack-infra | 02:00 | |
| *** thorst has quit IRC | 02:03 | |
| *** salv-orlando has joined #openstack-infra | 02:11 | |
| *** salv-orlando has quit IRC | 02:16 | |
| *** sdake_ has quit IRC | 02:18 | |
| *** amitgandhinz has quit IRC | 02:23 | |
| *** EricGonczer_ has quit IRC | 02:28 | |
| *** Sukhdev has joined #openstack-infra | 02:28 | |
| *** tiswanso has quit IRC | 02:35 | |
| *** baoli has quit IRC | 02:35 | |
| *** kaisers_ has joined #openstack-infra | 02:52 | |
| *** tiswanso has joined #openstack-infra | 02:55 | |
| *** kaisers_ has quit IRC | 02:56 | |
| *** jamesdenton has joined #openstack-infra | 03:02 | |
| *** thorst has joined #openstack-infra | 03:03 | |
| *** thorst has quit IRC | 03:08 | |
| *** cardeois has quit IRC | 03:09 | |
| *** tiswanso has quit IRC | 03:10 | |
| *** tiswanso has joined #openstack-infra | 03:10 | |
| openstackgerrit | James E. Blair proposed openstack-infra/storyboard: Add updated_since to stories api https://review.openstack.org/387128 | 03:11 |
| *** sdake has joined #openstack-infra | 03:12 | |
| *** hongbin has quit IRC | 03:13 | |
| *** jbernard_ is now known as jbernard | 03:16 | |
| *** vikrant has joined #openstack-infra | 03:17 | |
| *** amitgandhinz has joined #openstack-infra | 03:19 | |
| *** baoli has joined #openstack-infra | 03:28 | |
| *** chlong has joined #openstack-infra | 03:30 | |
| *** tiswanso has quit IRC | 03:32 | |
| *** winggundamth has joined #openstack-infra | 03:33 | |
| *** baoli has quit IRC | 03:41 | |
| *** Ravikiran_K has joined #openstack-infra | 03:42 | |
| *** psachin has joined #openstack-infra | 03:49 | |
| *** dave-mccowan has quit IRC | 03:51 | |
| *** amitgandhinz has quit IRC | 03:53 | |
| *** wewe0901 has joined #openstack-infra | 03:56 | |
| *** gongysh has joined #openstack-infra | 04:02 | |
| *** arxcruz has quit IRC | 04:06 | |
| *** thorst has joined #openstack-infra | 04:06 | |
| *** cshastri has joined #openstack-infra | 04:12 | |
| *** salv-orlando has joined #openstack-infra | 04:13 | |
| *** thorst has quit IRC | 04:13 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Run zuul launcher on zuul-dev.o.o https://review.openstack.org/386746 | 04:16 |
| *** salv-orlando has quit IRC | 04:17 | |
| *** kashyap` has joined #openstack-infra | 04:20 | |
| *** kashyap has quit IRC | 04:20 | |
| *** snarwade has quit IRC | 04:20 | |
| *** psachin has quit IRC | 04:20 | |
| *** vicky has joined #openstack-infra | 04:20 | |
| *** snarwade has joined #openstack-infra | 04:20 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Fix unbound rc.local generation https://review.openstack.org/387150 | 04:21 |
| *** yamamoto has quit IRC | 04:22 | |
| ianw | clarkb: ^ when you're around ... i believe this to be the root-cause of our osic centos & fedora failures (http://people.redhat.com/~iwienand/output.html) | 04:23 |
| *** vikrant has quit IRC | 04:23 | |
| *** cshastri has quit IRC | 04:23 | |
| *** kashyap` has quit IRC | 04:24 | |
| *** apetrich has quit IRC | 04:26 | |
| *** kashyap has joined #openstack-infra | 04:29 | |
| *** apetrich has joined #openstack-infra | 04:33 | |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder: Update cucumber-testresult plugin https://review.openstack.org/369818 | 04:34 |
| *** adriant has quit IRC | 04:34 | |
| *** psachin_ has joined #openstack-infra | 04:38 | |
| *** kaisers_ has joined #openstack-infra | 04:40 | |
| *** kaisers_ has quit IRC | 04:45 | |
| *** askb has quit IRC | 04:46 | |
| *** askb has joined #openstack-infra | 04:47 | |
| *** amitgandhinz has joined #openstack-infra | 04:50 | |
| *** salv-orlando has joined #openstack-infra | 05:02 | |
| *** thorst has joined #openstack-infra | 05:11 | |
| *** bhavik1 has joined #openstack-infra | 05:15 | |
| *** arxcruz has joined #openstack-infra | 05:17 | |
| openstackgerrit | James E. Blair proposed openstack-infra/storyboard: Update story.updated_at when tasks are updated https://review.openstack.org/387163 | 05:17 |
| *** gsilvis has quit IRC | 05:17 | |
| *** thorst has quit IRC | 05:18 | |
| *** sree has joined #openstack-infra | 05:20 | |
| *** sree has joined #openstack-infra | 05:21 | |
| *** yamamoto has joined #openstack-infra | 05:21 | |
| *** chandankumar has joined #openstack-infra | 05:22 | |
| *** sdake has quit IRC | 05:23 | |
| *** amitgandhinz has quit IRC | 05:24 | |
| *** apetrich has quit IRC | 05:27 | |
| *** apetrich has joined #openstack-infra | 05:28 | |
| *** qwertyco has joined #openstack-infra | 05:29 | |
| *** sdake has joined #openstack-infra | 05:33 | |
| *** askb has quit IRC | 05:33 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Run zuul launcher on zuul-dev.o.o https://review.openstack.org/386746 | 05:33 |
| *** gsilvis has joined #openstack-infra | 05:35 | |
| *** kaisers_ has joined #openstack-infra | 05:39 | |
| *** mfedosin has joined #openstack-infra | 05:40 | |
| *** kaisers_ has quit IRC | 05:43 | |
| *** kaisers_ has joined #openstack-infra | 05:43 | |
| *** sdake has quit IRC | 05:44 | |
| *** jaosorior has joined #openstack-infra | 05:48 | |
| *** salv-orlando has quit IRC | 05:51 | |
| *** vicky has quit IRC | 05:53 | |
| *** vicky has joined #openstack-infra | 05:54 | |
| *** psachin_ has quit IRC | 05:57 | |
| *** pgadiya has joined #openstack-infra | 05:58 | |
| *** hurgleburgler has quit IRC | 05:58 | |
| *** florianf has joined #openstack-infra | 05:59 | |
| *** acabot has quit IRC | 06:03 | |
| *** rcernin has joined #openstack-infra | 06:06 | |
| *** ramishra has joined #openstack-infra | 06:09 | |
| *** Hal has quit IRC | 06:11 | |
| *** Ravikiran_K has quit IRC | 06:14 | |
| *** thorst has joined #openstack-infra | 06:15 | |
| *** nadya has joined #openstack-infra | 06:18 | |
| *** coolsvap has joined #openstack-infra | 06:20 | |
| *** amitgandhinz has joined #openstack-infra | 06:20 | |
| *** nherciu has joined #openstack-infra | 06:22 | |
| *** thorst has quit IRC | 06:24 | |
| *** Ravikiran_K has joined #openstack-infra | 06:25 | |
| *** andreas_s has joined #openstack-infra | 06:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Add kuryr to PROJECTS https://review.openstack.org/387109 | 06:26 |
| *** camunoz has quit IRC | 06:27 | |
| *** jtomasek_ has joined #openstack-infra | 06:31 | |
| *** nadya has quit IRC | 06:31 | |
| *** LiYuenan has joined #openstack-infra | 06:36 | |
| *** Jeffrey4l has quit IRC | 06:45 | |
| *** jtomasek_ has quit IRC | 06:47 | |
| *** gildub has quit IRC | 06:47 | |
| *** Naeil has joined #openstack-infra | 06:49 | |
| *** salv-orlando has joined #openstack-infra | 06:52 | |
| *** e0ne has joined #openstack-infra | 06:53 | |
| *** amitgandhinz has quit IRC | 06:54 | |
| *** StevenK has quit IRC | 06:55 | |
| *** salv-orlando has quit IRC | 06:56 | |
| *** Jeffrey4l has joined #openstack-infra | 07:00 | |
| *** Sukhdev has quit IRC | 07:01 | |
| *** Hal has joined #openstack-infra | 07:02 | |
| *** tesseract has joined #openstack-infra | 07:03 | |
| *** tesseract is now known as Guest21077 | 07:04 | |
| *** tmorin has joined #openstack-infra | 07:04 | |
| *** narayrak has joined #openstack-infra | 07:05 | |
| *** narayrak has quit IRC | 07:06 | |
| *** narayrak has joined #openstack-infra | 07:06 | |
| *** tnovacik has joined #openstack-infra | 07:07 | |
| yolanda | good morning | 07:09 |
| AJaeger | morning, yolanda ! | 07:13 |
| *** salv-orlando has joined #openstack-infra | 07:15 | |
| *** amoralej|off is now known as amoralej | 07:16 | |
| *** ihrachys has joined #openstack-infra | 07:18 | |
| openstackgerrit | Merged openstack-infra/project-config: Add a more complete selection of jobs to the election repo https://review.openstack.org/384252 | 07:21 |
| openstackgerrit | Merged openstack-infra/project-config: Add newton branch to Kolla irc notifications https://review.openstack.org/387073 | 07:21 |
| *** thorst has joined #openstack-infra | 07:21 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable py35 voting for syntribos project https://review.openstack.org/386969 | 07:23 |
| *** e0ne has quit IRC | 07:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Request for add new project masakari-monitors https://review.openstack.org/386453 | 07:23 |
| openstackgerrit | Merged openstack-infra/project-config: Request for add new project python-masakariclient https://review.openstack.org/386401 | 07:23 |
| openstackgerrit | Merged openstack-infra/project-config: puppet: enable integration testing for puppet-ec2api https://review.openstack.org/386712 | 07:24 |
| *** matrohon has joined #openstack-infra | 07:24 | |
| openstackgerrit | Merged openstack-infra/project-config: nova-lxd: Run the full tempest tesuite https://review.openstack.org/386707 | 07:24 |
| openstackgerrit | Merged openstack-infra/project-config: Let windmill setup ssh and bindep https://review.openstack.org/386711 | 07:25 |
| openstackgerrit | Merged openstack-infra/project-config: Murano Firstapp: Setup constraints as well https://review.openstack.org/386721 | 07:25 |
| *** zhurong has quit IRC | 07:26 | |
| *** LiYuenan has left #openstack-infra | 07:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Promote CentOS-7 job to voting for OSA os_neutron https://review.openstack.org/386651 | 07:27 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Add periodic jobs for networking-bagpipe https://review.openstack.org/387209 | 07:28 |
| *** thorst has quit IRC | 07:28 | |
| *** dizquierdo has joined #openstack-infra | 07:31 | |
| openstackgerrit | Merged openstack-infra/project-config: Switch ansible-role-virtualenv jobs voting https://review.openstack.org/386658 | 07:31 |
| *** jpena|off is now known as jpena | 07:31 | |
| openstackgerrit | Merged openstack-infra/project-config: Extend job time for coverage comparisons https://review.openstack.org/385515 | 07:33 |
| *** openstackgerrit has quit IRC | 07:34 | |
| *** openstackgerrit has joined #openstack-infra | 07:34 | |
| *** tmorin has quit IRC | 07:34 | |
| *** jpich has joined #openstack-infra | 07:35 | |
| *** flepied1 has quit IRC | 07:36 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Add periodic jobs for networking-bagpipe https://review.openstack.org/387209 | 07:37 |
| *** sree has quit IRC | 07:38 | |
| *** drifterza has joined #openstack-infra | 07:39 | |
| *** dtantsur|afk is now known as dtantsur | 07:42 | |
| *** berendt has joined #openstack-infra | 07:42 | |
| *** amotoki has joined #openstack-infra | 07:46 | |
| *** shardy has joined #openstack-infra | 07:46 | |
| *** yaume has joined #openstack-infra | 07:48 | |
| *** slaweq has joined #openstack-infra | 07:49 | |
| *** bradm has quit IRC | 07:51 | |
| *** amitgandhinz has joined #openstack-infra | 07:51 | |
| *** bradm has joined #openstack-infra | 07:51 | |
| *** nadya has joined #openstack-infra | 07:51 | |
| *** yaume_ has joined #openstack-infra | 07:51 | |
| *** StevenK has joined #openstack-infra | 07:52 | |
| *** slaweq__ has quit IRC | 07:53 | |
| *** rvba has quit IRC | 07:54 | |
| *** yaume has quit IRC | 07:55 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** jordanP has joined #openstack-infra | 08:03 | |
| *** yaume has joined #openstack-infra | 08:04 | |
| *** yaume_ has quit IRC | 08:07 | |
| *** qwertyco has quit IRC | 08:10 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Allow to parameterize mysql connections https://review.openstack.org/387234 | 08:12 |
| *** pilgrimstack has joined #openstack-infra | 08:13 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Pick infracloud mysql connections value from hiera https://review.openstack.org/387242 | 08:16 |
| *** dizquierdo has quit IRC | 08:21 | |
| *** e0ne has joined #openstack-infra | 08:24 | |
| *** amitgandhinz has quit IRC | 08:25 | |
| *** thorst has joined #openstack-infra | 08:26 | |
| *** electrofelix has joined #openstack-infra | 08:26 | |
| *** john-davidge has joined #openstack-infra | 08:28 | |
| *** rcarrill1 is now known as rcarrillocruz | 08:29 | |
| *** john-davidge has quit IRC | 08:31 | |
| *** john-dav_ has joined #openstack-infra | 08:31 | |
| *** HeOS has joined #openstack-infra | 08:32 | |
| *** ralonsoh has joined #openstack-infra | 08:32 | |
| *** osh has joined #openstack-infra | 08:33 | |
| *** thorst has quit IRC | 08:33 | |
| *** john-dav_ is now known as john-davidge | 08:35 | |
| *** Naeil has quit IRC | 08:35 | |
| osh | hi! is there anyone who can help to create a job for gathering documentation? | 08:36 |
| *** gentoo_ has quit IRC | 08:37 | |
| *** lezbar has joined #openstack-infra | 08:38 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bagpipe: add tempest, periodic and cover jobs https://review.openstack.org/387209 | 08:39 |
| *** dingyichen has quit IRC | 08:39 | |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Allow to parameterize mysql connections https://review.openstack.org/387234 | 08:40 |
| *** acabot has joined #openstack-infra | 08:41 | |
| *** vponomaryov has joined #openstack-infra | 08:41 | |
| *** dtardivel has joined #openstack-infra | 08:42 | |
| *** yaume has quit IRC | 08:50 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bgpvpn: add a coverage job https://review.openstack.org/387267 | 08:50 |
| *** chem has joined #openstack-infra | 08:51 | |
| *** ccamacho has joined #openstack-infra | 08:51 | |
| *** kaisers_ has quit IRC | 08:52 | |
| *** yaume has joined #openstack-infra | 08:53 | |
| *** chem has quit IRC | 08:54 | |
| *** chem has joined #openstack-infra | 08:54 | |
| *** sree has joined #openstack-infra | 08:55 | |
| *** claudiub has joined #openstack-infra | 08:55 | |
| *** derekh has joined #openstack-infra | 08:59 | |
| *** jschwarz is now known as jschwarz|ooo | 08:59 | |
| *** yaume_ has joined #openstack-infra | 09:00 | |
| openstackgerrit | Merged openstack-dev/cookiecutter: Sync latest requirements.txt https://review.openstack.org/385915 | 09:01 |
| *** yaume has quit IRC | 09:03 | |
| *** mhickey has joined #openstack-infra | 09:05 | |
| openstackgerrit | Merged openstack-infra/system-config: Pick infracloud mysql connections value from hiera https://review.openstack.org/387242 | 09:08 |
| *** pcaruana has joined #openstack-infra | 09:08 | |
| *** flepied has joined #openstack-infra | 09:12 | |
| *** kaisers_ has joined #openstack-infra | 09:15 | |
| openstackgerrit | James Page proposed openstack-infra/project-config: gerritbot: Update repos and branches for charms https://review.openstack.org/387291 | 09:17 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bgpvpn: add a coverage job https://review.openstack.org/387267 | 09:19 |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bagpipe: add tempest, periodic and cover jobs https://review.openstack.org/385445 | 09:20 |
| *** amitgandhinz has joined #openstack-infra | 09:21 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:25 | |
| *** chlong has quit IRC | 09:26 | |
| rcarrillocruz | sigh | 09:26 |
| *** salv-orlando has quit IRC | 09:26 | |
| rcarrillocruz | with so much CI capacity | 09:26 |
| rcarrillocruz | and the low CI load these days | 09:26 |
| rcarrillocruz | i have yet to see a job launched in infracloud chocolate, which only has 10 max-servers for now | 09:27 |
| rcarrillocruz | such a nice 'problem' to have btw... | 09:27 |
| Zara | :) | 09:27 |
| openstackgerrit | James Page proposed openstack-infra/project-config: gerritbot: Update repos and branches for charms https://review.openstack.org/387291 | 09:28 |
| yolanda | rcarrillocruz, that's a nice problem :) | 09:29 |
| rcarrillocruz | :D | 09:29 |
| yolanda | it's really cool how fast changes pass these days | 09:29 |
| *** bhavik1 has quit IRC | 09:29 | |
| *** thorst has joined #openstack-infra | 09:31 | |
| *** thorst has quit IRC | 09:38 | |
| *** askb has joined #openstack-infra | 09:39 | |
| *** jaosorior has quit IRC | 09:41 | |
| *** jaosorior has joined #openstack-infra | 09:42 | |
| openstackgerrit | Bob Ball proposed openstack-infra/project-config: Add os-xenapi project. https://review.openstack.org/386528 | 09:42 |
| AJaeger | osh: what do you need? | 09:44 |
| AJaeger | rcarrillocruz: seemed like pleia2 had the same "nice" problem with citycloud if I interpret backscroll correctly | 09:45 |
| rcarrillocruz | heh, MOAR CLOUDS | 09:45 |
| *** tosky has joined #openstack-infra | 09:47 | |
| *** esikachev has joined #openstack-infra | 09:51 | |
| *** dizquierdo has joined #openstack-infra | 09:53 | |
| *** erlon has joined #openstack-infra | 09:53 | |
| *** amitgandhinz has quit IRC | 09:55 | |
| *** tkelsey has joined #openstack-infra | 09:57 | |
| *** esikache1 has joined #openstack-infra | 09:57 | |
| *** sree has quit IRC | 10:00 | |
| *** esikache1 has quit IRC | 10:00 | |
| *** esikachev has quit IRC | 10:00 | |
| *** esikache1 has joined #openstack-infra | 10:02 | |
| *** gongysh has quit IRC | 10:02 | |
| *** eliqiao has quit IRC | 10:02 | |
| *** flepied has quit IRC | 10:07 | |
| *** panda_ is now known as panda | 10:10 | |
| *** yanyanhu has quit IRC | 10:13 | |
| *** esikache1 has quit IRC | 10:16 | |
| *** esikachev has joined #openstack-infra | 10:16 | |
| *** ldnunes has joined #openstack-infra | 10:21 | |
| *** nherciu has quit IRC | 10:22 | |
| *** flepied has joined #openstack-infra | 10:22 | |
| *** nherciu has joined #openstack-infra | 10:23 | |
| *** yaume has joined #openstack-infra | 10:24 | |
| *** salv-orlando has joined #openstack-infra | 10:27 | |
| *** yaume_ has quit IRC | 10:27 | |
| *** salv-orlando has quit IRC | 10:31 | |
| *** TomazVieira has joined #openstack-infra | 10:36 | |
| *** yolanda has quit IRC | 10:36 | |
| *** thorst has joined #openstack-infra | 10:36 | |
| TomazVieira | Hello, everyone. Is this the channel where people discuss devstack? | 10:36 |
| *** gnuoy` is now known as gnuoy | 10:37 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/387344 | 10:38 |
| *** sdake has joined #openstack-infra | 10:40 | |
| *** berendt has quit IRC | 10:40 | |
| *** mmedvede has quit IRC | 10:41 | |
| frickler | TomazVieira: for discussing how to use devstack, #openstack should be fine, regarding development of devstack there is #openstack-qa | 10:42 |
| *** thorst has quit IRC | 10:43 | |
| *** yolanda has joined #openstack-infra | 10:44 | |
| TomazVieira | Great. *-qa it is, then. Thank you o/ | 10:44 |
| *** rhallisey has joined #openstack-infra | 10:47 | |
| *** rhallisey has quit IRC | 10:51 | |
| *** amitgandhinz has joined #openstack-infra | 10:52 | |
| *** tuanluong has quit IRC | 10:53 | |
| *** rhallisey has joined #openstack-infra | 10:53 | |
| *** mmedvede has joined #openstack-infra | 10:55 | |
| *** salv-orlando has joined #openstack-infra | 10:57 | |
| *** nadya has quit IRC | 10:58 | |
| *** Hal has quit IRC | 11:00 | |
| *** florianf has quit IRC | 11:01 | |
| *** salv-orlando has quit IRC | 11:02 | |
| *** derekjhyang has quit IRC | 11:10 | |
| *** jianghuaw-m has joined #openstack-infra | 11:12 | |
| *** jianghuaw-m has quit IRC | 11:12 | |
| *** florianf has joined #openstack-infra | 11:12 | |
| *** askb has quit IRC | 11:13 | |
| *** Hal has joined #openstack-infra | 11:16 | |
| *** yaume_ has joined #openstack-infra | 11:18 | |
| *** rtheis has joined #openstack-infra | 11:19 | |
| *** yaume has quit IRC | 11:19 | |
| *** jkilpatr has joined #openstack-infra | 11:20 | |
| *** salv-orlando has joined #openstack-infra | 11:21 | |
| *** _degorenko|afk is now known as degorenko | 11:22 | |
| *** salv-orl_ has joined #openstack-infra | 11:25 | |
| *** EricGonczer_ has joined #openstack-infra | 11:26 | |
| *** amitgandhinz has quit IRC | 11:26 | |
| *** salv-orlando has quit IRC | 11:28 | |
| *** salv-orl_ has quit IRC | 11:29 | |
| *** sree has joined #openstack-infra | 11:30 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Move job running into own class https://review.openstack.org/385964 | 11:30 |
| *** dave-mccowan has joined #openstack-infra | 11:30 | |
| *** EricGonczer_ has quit IRC | 11:31 | |
| *** matbu is now known as matbu|brb | 11:31 | |
| *** nadya has joined #openstack-infra | 11:32 | |
| *** berendt has joined #openstack-infra | 11:33 | |
| *** chem has quit IRC | 11:34 | |
| *** admcleod_ has quit IRC | 11:34 | |
| *** admcleod- has joined #openstack-infra | 11:35 | |
| *** nadya has quit IRC | 11:37 | |
| *** chem has joined #openstack-infra | 11:38 | |
| *** salv-orlando has joined #openstack-infra | 11:39 | |
| *** thorst has joined #openstack-infra | 11:42 | |
| *** dprince has joined #openstack-infra | 11:43 | |
| *** salv-orlando has quit IRC | 11:44 | |
| *** thorst_ has joined #openstack-infra | 11:45 | |
| *** thorst has quit IRC | 11:49 | |
| *** nicolasbock has joined #openstack-infra | 11:51 | |
| nicolasbock | Hi, I am trying to update my contact information on gerrit | 11:51 |
| nicolasbock | when I click on 'save changes' I get an error | 11:52 |
| nicolasbock | server error | 11:52 |
| nicolasbock | cannot store contact information | 11:52 |
| openstackgerrit | amrith proposed openstack-infra/project-config: Create new trove CI jobs https://review.openstack.org/387386 | 11:52 |
| *** nadya has joined #openstack-infra | 11:53 | |
| *** chem has quit IRC | 11:57 | |
| *** chem has joined #openstack-infra | 11:57 | |
| *** panda is now known as panda|afk | 11:58 | |
| *** dalgaaf has joined #openstack-infra | 11:59 | |
| *** jianghuaw-m has joined #openstack-infra | 11:59 | |
| *** jianghuaw-m has quit IRC | 12:00 | |
| *** EricGonczer_ has joined #openstack-infra | 12:02 | |
| *** edmondsw has joined #openstack-infra | 12:06 | |
| *** jcoufal has joined #openstack-infra | 12:08 | |
| *** pgadiya has quit IRC | 12:10 | |
| *** amoralej is now known as amoralej|lunch | 12:11 | |
| *** raildo has joined #openstack-infra | 12:11 | |
| *** sdague has joined #openstack-infra | 12:14 | |
| *** kgiusti has joined #openstack-infra | 12:15 | |
| *** vicky has quit IRC | 12:16 | |
| *** coolsvap has quit IRC | 12:18 | |
| *** wfoster has quit IRC | 12:19 | |
| *** sai has quit IRC | 12:19 | |
| *** kgiusti has quit IRC | 12:20 | |
| *** rook_ has quit IRC | 12:20 | |
| *** kgiusti has joined #openstack-infra | 12:20 | |
| *** Guest23990 is now known as zigo | 12:21 | |
| *** amitgandhinz has joined #openstack-infra | 12:23 | |
| *** wfoster has joined #openstack-infra | 12:25 | |
| *** rook has joined #openstack-infra | 12:26 | |
| *** rook is now known as Guest40693 | 12:26 | |
| *** sai has joined #openstack-infra | 12:27 | |
| *** dtantsur is now known as dtantsur|mtg | 12:30 | |
| openstackgerrit | Brad P. Crochet proposed openstack-infra/tripleo-ci: Use yaml files for building images for CI https://review.openstack.org/336312 | 12:32 |
| erlon | guys, is anyone having problems with nova policy.json not being found? | 12:34 |
| *** zhurong has joined #openstack-infra | 12:35 | |
| *** moravec has quit IRC | 12:37 | |
| *** kaisers_ has quit IRC | 12:41 | |
| *** sileht has quit IRC | 12:42 | |
| *** kaisers_ has joined #openstack-infra | 12:42 | |
| *** trown is now known as trown|brb | 12:43 | |
| *** matbu|brb is now known as matbu | 12:43 | |
| timello | hey there, how can I debug openstack health app... I'm struggling to find whats going on with our internal installation... It says "Unable to load this page! An API error occured". I can call the API directly... but something is wrong in the frondend | 12:43 |
| *** baoli has joined #openstack-infra | 12:46 | |
| timello | gulp dev does not give much output | 12:46 |
| *** kaisers_ has quit IRC | 12:47 | |
| *** hurgleburgler has joined #openstack-infra | 12:47 | |
| *** bauwser is now known as bauzas | 12:48 | |
| *** sileht has joined #openstack-infra | 12:49 | |
| *** srobert has joined #openstack-infra | 12:49 | |
| *** jpena is now known as jpena|lunch | 12:50 | |
| *** psachin` has joined #openstack-infra | 12:51 | |
| *** beefboymatface is now known as olaph | 12:54 | |
| *** zhurong has quit IRC | 12:55 | |
| *** xyang1 has joined #openstack-infra | 12:55 | |
| *** strigazi1AFK has joined #openstack-infra | 12:55 | |
| *** zhurong has joined #openstack-infra | 12:56 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: networking-bagpipe: add tempest, periodic and cover jobs https://review.openstack.org/385445 | 12:56 |
| *** amitgandhinz has quit IRC | 12:57 | |
| *** yamamoto has quit IRC | 12:58 | |
| *** strigazi_AFK has quit IRC | 12:58 | |
| *** tiswanso has joined #openstack-infra | 12:59 | |
| *** tiswanso has quit IRC | 12:59 | |
| *** tiswanso has joined #openstack-infra | 13:00 | |
| *** Goneri has joined #openstack-infra | 13:02 | |
| frickler | nicolasbock: https://ask.openstack.org/en/question/56720/cannot-store-contact-information-when-updating-info-in-openstack-gerrit/ may be helpful | 13:04 |
| *** EricGonczer_ has quit IRC | 13:08 | |
| *** kzaitsev_mb has quit IRC | 13:08 | |
| *** ramishra has quit IRC | 13:08 | |
| *** kzaitsev_mb has joined #openstack-infra | 13:08 | |
| *** SotK_ is now known as SotK | 13:11 | |
| *** trown|brb is now known as trown | 13:14 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Remove setting of OS_IMAGE_API_VERSION for newton and above https://review.openstack.org/387421 | 13:15 |
| *** pcaruana has quit IRC | 13:18 | |
| *** csomerville has quit IRC | 13:18 | |
| *** cody-somerville has joined #openstack-infra | 13:19 | |
| openstackgerrit | Merged openstack-infra/shade: Implement create/get/list/delete volume backups https://review.openstack.org/383769 | 13:19 |
| nicolasbock | frickler, thanks for the link | 13:20 |
| *** flepied has quit IRC | 13:20 | |
| nicolasbock | frickler, I am already a foundation member | 13:20 |
| nicolasbock | is there anything else I need to set?? | 13:21 |
| *** amitgandhinz has joined #openstack-infra | 13:21 | |
| *** matt-borland has joined #openstack-infra | 13:22 | |
| *** ociuhandu has joined #openstack-infra | 13:25 | |
| *** flepied has joined #openstack-infra | 13:26 | |
| *** amitgandhinz has quit IRC | 13:27 | |
| *** amitgandhinz has joined #openstack-infra | 13:27 | |
| frickler | nicolasbock: did you verify that you are using exactly the same email address for foundation and gerrit? | 13:28 |
| *** panda|afk is now known as panda | 13:28 | |
| *** eharney has joined #openstack-infra | 13:28 | |
| *** makowals_ has joined #openstack-infra | 13:31 | |
| openstackgerrit | Marc Koderer proposed openstack-infra/project-config: Move barbican-postgres to non-voting gate https://review.openstack.org/385448 | 13:31 |
| *** esikachev has quit IRC | 13:32 | |
| *** makowals has quit IRC | 13:32 | |
| *** mkarpin has joined #openstack-infra | 13:36 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on location image url if image has no any physical image set send image_url to null https://review.openstack.org/387434 | 13:36 |
| openstackgerrit | Merged openstack-infra/shade: Move normalize_neutron_floating_ips to _normalize https://review.openstack.org/382400 | 13:36 |
| nicolasbock | frickler, yes, that did it | 13:37 |
| nicolasbock | frickler, I had used me secondary email in gerrit' | 13:37 |
| *** moravec has joined #openstack-infra | 13:38 | |
| mkarpin | Hello! I have a Third Party CI and I heard we need to disable "Starting %pipeline.name jobs" message sending to Gerrit, Did anybody do the same? how to do this properly in Zuul? | 13:39 |
| asselin__ | mkarpin, removet eh start section in zuul layout | 13:39 |
| asselin__ | see project-config-example repo for an example | 13:39 |
| mkarpin | asselin__ thank you! | 13:40 |
| asselin__ | mkarpin, http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/zuul/layout.yaml | 13:40 |
| pabelanger | rcarrillocruz: we can likely bump infracloud-chocolate to 100 to get something to build there | 13:41 |
| *** trown is now known as trown|brb | 13:41 | |
| rcarrillocruz | ++ | 13:41 |
| mkarpin | asselin__ understood now, thanks again! | 13:41 |
| rcarrillocruz | pabelanger: while i have you online here, mind reviewing https://review.openstack.org/#/c/386556/ pls | 13:41 |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on location image url if image has no any physical image set send image_url to null https://review.openstack.org/387434 | 13:42 |
| *** yamamoto has joined #openstack-infra | 13:42 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Add missing restart flag to mysql https://review.openstack.org/387439 | 13:42 |
| openstackgerrit | Markos Chandras proposed openstack/diskimage-builder: lib: Drop shebang from library scripts https://review.openstack.org/387440 | 13:43 |
| openstackgerrit | Markos Chandras proposed openstack/diskimage-builder: elements: Drop executable bits from environment files https://review.openstack.org/387441 | 13:43 |
| rcarrillocruz | thx | 13:44 |
| *** moravec has quit IRC | 13:45 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid: Fix on PHP 503 error updated pm.max_children from 200 to 300 to avoid 503 http error. https://review.openstack.org/387442 | 13:45 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Fix file extension for nodepool-citycloud.yaml https://review.openstack.org/387443 | 13:45 |
| pabelanger | rcarrillocruz: yolanda: ^ fixes grafana.o.o for citycloud | 13:45 |
| *** pblaho has joined #openstack-infra | 13:47 | |
| *** cardeois has joined #openstack-infra | 13:50 | |
| *** smarcet has joined #openstack-infra | 13:50 | |
| cloudnull | mornings | 13:50 |
| *** coreycb` is now known as coreycb | 13:51 | |
| timrc | Hihi. I feel like I'm missing something... is it enough to specify a pbr version in my setup.py and not have it installed on the system or in a virtualenv? My 'python setup.py install' seems happy even though I don't have pbr explicitly installed. | 13:53 |
| *** inc0 has joined #openstack-infra | 13:54 | |
| *** makowals_ has quit IRC | 13:54 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Put default password values on openstackci/openstackjenkins params https://review.openstack.org/387448 | 13:54 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Add missing restart flag to mysql https://review.openstack.org/387439 | 13:55 |
| rcarrillocruz | pabelanger, yolanda : ^, we have unused params on the controller from when we put puppetry to create openstackci/openstackjenkins tenants, we don't need that anymore since we create them with the launcher | 13:56 |
| *** jamesden_ has joined #openstack-infra | 13:56 | |
| *** moravec has joined #openstack-infra | 13:57 | |
| *** dizquierdo has quit IRC | 13:57 | |
| *** xarses has quit IRC | 13:58 | |
| *** makowals has joined #openstack-infra | 13:59 | |
| rcarrillocruz | thx | 13:59 |
| openstackgerrit | Merged openstack-infra/project-config: Fix file extension for nodepool-citycloud.yaml https://review.openstack.org/387443 | 14:01 |
| *** dtantsur|mtg is now known as dtantsur | 14:01 | |
| *** esikachev has joined #openstack-infra | 14:01 | |
| *** jpena|lunch is now known as jpena | 14:03 | |
| *** amoralej|lunch is now known as amoralej | 14:03 | |
| *** hogepodge has quit IRC | 14:04 | |
| *** krtaylor has quit IRC | 14:04 | |
| *** sree has quit IRC | 14:07 | |
| *** esikachev has quit IRC | 14:07 | |
| timrc | Ahhh it installed / caches in .eggs in the project root dir re: pbr | 14:07 |
| AJaeger | freerunner: see mkarpin's question above | 14:07 |
| *** sree has joined #openstack-infra | 14:08 | |
| openstackgerrit | Merged openstack-infra/system-config: Put default password values on openstackci/openstackjenkins params https://review.openstack.org/387448 | 14:08 |
| *** hongbin has joined #openstack-infra | 14:08 | |
| AJaeger | pabelanger: could you put https://review.openstack.org/378532 - the SUSE glean support again on your review list, please? Or should I ping others? | 14:09 |
| *** sc68cal_ is now known as sc68cal | 14:10 | |
| *** GordonTX has joined #openstack-infra | 14:10 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Remove unused openstackci/openstackjenkins password params from controllers https://review.openstack.org/387461 | 14:11 |
| *** trown|brb is now known as trown | 14:11 | |
| *** mtanino has joined #openstack-infra | 14:12 | |
| *** burgerk has joined #openstack-infra | 14:12 | |
| *** sree has quit IRC | 14:12 | |
| mkarpin | AJaeger we with freerunner are working on the same third party CI )) | 14:13 |
| mkarpin | I am fixing it now) | 14:13 |
| *** Goneri has quit IRC | 14:14 | |
| *** rbrndt has joined #openstack-infra | 14:14 | |
| *** Goneri has joined #openstack-infra | 14:15 | |
| *** GordonTX has quit IRC | 14:17 | |
| prometheanfire | pabelanger: need to spin up a ubuntu VM to run the build-images.sh bit | 14:18 |
| *** smarcet has quit IRC | 14:18 | |
| *** lucasagomes is now known as lucas-hungry | 14:18 | |
| AJaeger | mkarpin: great, thanks! (the timing hinted at that but I wasn't completely sure ;) | 14:18 |
| *** EricGonczer_ has joined #openstack-infra | 14:19 | |
| *** marst has joined #openstack-infra | 14:20 | |
| *** EricGonczer_ has quit IRC | 14:21 | |
| *** amitgandhinz has quit IRC | 14:22 | |
| *** amitgandhinz has joined #openstack-infra | 14:23 | |
| *** jkilpatr has quit IRC | 14:24 | |
| *** drifterza has quit IRC | 14:25 | |
| *** coolsvap has joined #openstack-infra | 14:25 | |
| *** jamesden_ has quit IRC | 14:27 | |
| *** EricGonczer_ has joined #openstack-infra | 14:29 | |
| *** mfisch` is now known as mfisch | 14:30 | |
| *** mfisch is now known as Guest56218 | 14:30 | |
| *** moravec has quit IRC | 14:32 | |
| *** kaisers_ has joined #openstack-infra | 14:32 | |
| *** eharney has quit IRC | 14:33 | |
| *** srobert has quit IRC | 14:33 | |
| *** esikachev has joined #openstack-infra | 14:33 | |
| *** moravec has joined #openstack-infra | 14:33 | |
| *** moravec has quit IRC | 14:35 | |
| pabelanger | prometheanfire: ack | 14:35 |
| prometheanfire | pabelanger: I've added it to my todo though, so, eventually... | 14:35 |
| prometheanfire | building on 16.04 now right? | 14:36 |
| pabelanger | still on trusty | 14:36 |
| prometheanfire | k | 14:36 |
| *** kaisers_ has quit IRC | 14:36 | |
| *** moravec has joined #openstack-infra | 14:37 | |
| pabelanger | AJaeger: left a comment, no -1 | 14:39 |
| *** jamesden_ has joined #openstack-infra | 14:44 | |
| rcarrillocruz | yolanda , pabelanger : follow-up change for tenant passwords cleanup on controller https://review.openstack.org/#/c/387461/ | 14:44 |
| AJaeger | pabelanger: thanks. Let's see what hwoarang answers... | 14:45 |
| hwoarang | i am going to add a comment to gerrit | 14:45 |
| AJaeger | pabelanger: was your suggestion to change "if 'bond_links' in interface:" -> "if 'bond_links' in interface and _is_suse():" ? | 14:47 |
| *** yaume has joined #openstack-infra | 14:48 | |
| *** lykinsbd has joined #openstack-infra | 14:48 | |
| *** dprince has quit IRC | 14:49 | |
| *** dmsimard is now known as dmsimard|afk | 14:49 | |
| jeblair | AJaeger: the only directory in ~jenkins on proposal right now is solum-dashboard-upstream-translation-update | 14:49 |
| *** tnovacik has quit IRC | 14:49 | |
| jeblair | er ~jenkins/workspace | 14:49 |
| pabelanger | AJaeger: right, if it doesn't apply to Fedora / CentOS, lets just skip bond_links logic | 14:50 |
| pabelanger | but I am not sure | 14:50 |
| *** yaume_ has quit IRC | 14:51 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Return empty dict from getBuilds/getUploads https://review.openstack.org/387507 | 14:51 |
| AJaeger | jeblair: ok. WE still have the same problem ;( | 14:52 |
| *** EricGonczer_ has quit IRC | 14:52 | |
| *** gordc has joined #openstack-infra | 14:53 | |
| *** mriedem has joined #openstack-infra | 14:53 | |
| jeblair | AJaeger: did you say it was failing for projects that only have one branch? | 14:55 |
| *** xarses has joined #openstack-infra | 14:55 | |
| *** gouthamr has joined #openstack-infra | 14:55 | |
| AJaeger | This is failing for projects that have at least master and stable/newton | 14:55 |
| *** knangia has joined #openstack-infra | 14:56 | |
| AJaeger | https://review.openstack.org/#/q/status:open+topic:zanata/translations,n,z shows all open changes - | 14:56 |
| *** jimbaker` is now known as jimbaker | 14:56 | |
| *** moravec has quit IRC | 14:56 | |
| AJaeger | Right now 8 merge conflicts | 14:56 |
| *** lykinsbd has quit IRC | 14:57 | |
| szaher | I've a patch that should be merged in python-freezerclient, the status is "Submitted, Merge Pending" and the patch is not merged yet. any idea what might be the problem ? | 14:58 |
| szaher | https://review.openstack.org/#/c/386065/ | 14:58 |
| *** lucas-hungry is now known as lucasagomes | 14:58 | |
| *** jimbaker has quit IRC | 14:58 | |
| *** jimbaker has joined #openstack-infra | 14:58 | |
| openstackgerrit | chandanc proposed openstack-infra/project-config: Add multinode CI for neutron-fwaas project. https://review.openstack.org/386933 | 14:58 |
| *** rkukura has quit IRC | 14:59 | |
| *** yamamoto has quit IRC | 14:59 | |
| AJaeger | szaher: check https://review.openstack.org/#/q/project:openstack/python-freezerclient - there are a few... | 14:59 |
| *** yamamoto has joined #openstack-infra | 15:00 | |
| AJaeger | https://review.openstack.org/#/c/377281/ is the problem, it has a merge conflict. Rebase that one and it should sort out ... | 15:00 |
| szaher | AJaeger: Thanks | 15:00 |
| jeblair | AJaeger: in several of those cases, it is failing for all of the branches that it ran, so that seems to discount a theory involving it working only the first time it ran in a workspace. | 15:00 |
| jeblair | (ooh, you know what would be neat? if the proposal bot left a comment on changes that it proposed with a link to the build log that generated that proposal) | 15:01 |
| *** pots has joined #openstack-infra | 15:02 | |
| *** moravec has joined #openstack-infra | 15:02 | |
| *** jkilpatr has joined #openstack-infra | 15:02 | |
| jeblair | AJaeger: oh, the different branch translations don't share a workspace directory anyway do they? because they have different job names | 15:03 |
| *** pcaruana has joined #openstack-infra | 15:03 | |
| AJaeger | jeblair: correct, they have different workspaces | 15:03 |
| AJaeger | jeblair: neat idea ;) | 15:03 |
| *** lcastell has quit IRC | 15:03 | |
| jeblair | then that seems very unlikely to be related to the problem, aside from the fact that it makes post-hoc investigation difficult. | 15:04 |
| AJaeger | jeblair: regarding log files, I go via http://status.openstack.org/openstack-health/#/g/build_queue/post?groupKey=build_queue&searchJob=translation&duration=P1D, select the job I want to look at and then select the latest. | 15:04 |
| szaher | AJaeger: Is this one Ok https://review.openstack.org/#/c/386094/ ? | 15:04 |
| *** lcastell has joined #openstack-infra | 15:04 | |
| AJaeger | szaher: I'll review later... | 15:04 |
| szaher | AJaeger: Thanks | 15:04 |
| *** narayrak has quit IRC | 15:05 | |
| AJaeger | jeblair: mmh, I can easily add a link line with buildlogs to the review. Just wondering how to do it... | 15:05 |
| hwoarang | AJaeger: pabelanger: i have explained what's the deal with that 'if' statement. but if you still want me to change that then I will do it. | 15:05 |
| AJaeger | jeblair: wrong link for periodic jobs: http://status.openstack.org/openstack-health/#/g/build_queue/periodic?groupKey=build_queue&searchJob=translation | 15:06 |
| jeblair | AJaeger: https://review.openstack.org/Documentation/cmd-review.html | 15:06 |
| *** csomerville has joined #openstack-infra | 15:06 | |
| jeblair | AJaeger: http://logs.openstack.org/periodic/sahara-dashboard-propose-translation-update/?C=M;O=D | 15:08 |
| *** knikolla_ has quit IRC | 15:09 | |
| jeblair | AJaeger: i was going to ask a question about that, but figured it out. nevermind. | 15:09 |
| *** SergK_ has quit IRC | 15:10 | |
| *** cody-somerville has quit IRC | 15:10 | |
| *** lykinsbd has joined #openstack-infra | 15:11 | |
| *** knikolla has joined #openstack-infra | 15:12 | |
| *** SergK has joined #openstack-infra | 15:12 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add logpath for translation jobs https://review.openstack.org/387525 | 15:13 |
| AJaeger | jeblair: I was thinking along these lines ^ | 15:13 |
| AJaeger | great that the ansible playbook shows all variables passed ;) | 15:13 |
| jeblair | AJaeger: we could do that, but that url will expire not too long afterwords, which makes me wonder if we should be putting it in the commit message (which is for all time) | 15:14 |
| AJaeger | we could leave that in for the next few days and revert again? | 15:14 |
| AJaeger | jeblair: have to leave now, will be back online in two hours or so. | 15:15 |
| jeblair | AJaeger: oh, well, i was thinking it would be generally useful and we'd keep it around | 15:15 |
| *** sdake has joined #openstack-infra | 15:15 | |
| AJaeger | jeblair, I'm open for suggestions ;) | 15:16 |
| *** lykinsbd has quit IRC | 15:16 | |
| AJaeger | with your comment on the volatile nature of the URL (after 60 days?), I retracted... | 15:16 |
| *** esikachev has quit IRC | 15:16 | |
| AJaeger | bbl | 15:16 |
| jeblair | AJaeger: i was thinking we could add it as a review comment... but if people are okay having temporary urls in the commit message i'm fine with it. :) | 15:17 |
| *** amitgandhinz has quit IRC | 15:20 | |
| *** chandankumar has quit IRC | 15:21 | |
| *** zhurong has quit IRC | 15:22 | |
| rm_work | Does Matthew Thode hang out in this channel? Or, does anyone know his IRC nick? | 15:22 |
| pleia2 | rm_work: that would be prometheanfire | 15:23 |
| rm_work | awesome thanks | 15:23 |
| rm_work | wanted to ask him for his thoughts on https://review.openstack.org/#/c/386790/ | 15:24 |
| rm_work | prometheanfire: ^^ | 15:24 |
| rm_work | prometheanfire: i honestly thought this one would be pretty straightforward, but I guess nothing ever is :P | 15:25 |
| rm_work | curious about what concerns you have, so if I draft something to the ML I can address them in a first pass | 15:25 |
| *** mkarpin has left #openstack-infra | 15:25 | |
| *** rcernin has quit IRC | 15:26 | |
| prometheanfire | rm_work: best talk in #openstack-requirements but the short of it is that openstack services have somewhat united around mod_wsgi (apache) but a more general discussion about which wsgi implimentations openstack 'supports' would be useful | 15:28 |
| rm_work | ah, ok | 15:28 |
| rm_work | didn't know that channel existed | 15:29 |
| prometheanfire | I use uwsgi for instance (but don't hold anything against gunicorn or mod_wsgi) | 15:29 |
| rm_work | the short of it for us is that we need SOMETHING for our amphora-image for octavia (a service VM, should be minimal, definitely don't want apache running) and it is for an internal only API | 15:29 |
| rm_work | gunicorn integrates nicely *inside* python | 15:30 |
| prometheanfire | rm_work: I know octavia :P major is sitting behind me | 15:30 |
| rm_work | heh | 15:30 |
| rm_work | personally I have a hard time even buying that the amphora-image should be subject to g-r at all | 15:30 |
| rm_work | but I'm trying to play nice | 15:30 |
| *** amitgandhinz has joined #openstack-infra | 15:32 | |
| prometheanfire | rm_work: I think it's fine to add it, probably, but would still like an email to the list to bring up wsgi impls for discussion | 15:32 |
| rm_work | i mean, I am perfectly happy to just add uwsgi to the list as well | 15:32 |
| rm_work | i don't think we should limit to just gunicorn by any means | 15:32 |
| rm_work | so i'm not sure what the point of a discussion of wsgi impls is | 15:33 |
| rm_work | do we need to PICK one? | 15:33 |
| rm_work | I guess maybe that's the discussion | 15:33 |
| prometheanfire | I don't think we do, but someone may thing we do | 15:33 |
| rm_work | i'm not sure i see the point of inviting a ML bikeshed on something this trivial because "someone somewhere might object" -- can't we just get input from key stakeholders (ie, the team responsible for reviewing these patches), and if someone *actually* objects, move to discussion? >_> | 15:35 |
| prometheanfire | rm_work: I am on the team responsible for reviewing the patches, and I can bring it up on wednesday's meeting | 15:36 |
| rm_work | ok | 15:36 |
| prometheanfire | it's at something like 12:00UTC | 15:36 |
| prometheanfire | 7AM US central | 15:37 |
| rm_work | hmm k | 15:37 |
| rm_work | i'm JST so that works for me, nice late evening :P | 15:37 |
| *** krtaylor has joined #openstack-infra | 15:37 | |
| prometheanfire | ya, our ptl is in .au | 15:37 |
| prometheanfire | shouldn't you be in bed? | 15:37 |
| rm_work | eh, I stay up to talk to our team in the US | 15:38 |
| prometheanfire | :D | 15:38 |
| rm_work | at least for a couple hours when I can | 15:38 |
| *** jkilpatr has quit IRC | 15:40 | |
| *** harlowja_at_home has joined #openstack-infra | 15:41 | |
| openstackgerrit | Merged openstack-infra/glean: Fix SUSE based network configuration https://review.openstack.org/378532 | 15:42 |
| greghaynes | prometheanfire: I think uwsgi is pretty widely used for openstack as well (I was unaware folks use mod_wsgi) | 15:42 |
| *** smarcet has joined #openstack-infra | 15:43 | |
| openstackgerrit | Chuck Short proposed openstack-infra/project-config: nova-lxd: Allow regex to blacklist tempest tests https://review.openstack.org/387100 | 15:43 |
| greghaynes | I thought that in devstack keystone used uwsgi with apache proxying... | 15:44 |
| hwoarang | pabelanger: thanks for merging the suse/network stuff | 15:44 |
| prometheanfire | greghaynes: no clue, I thought keystone used mod_wsgi because using uwsgi prevented the federation stuff from working | 15:45 |
| prometheanfire | dolphm: ping | 15:45 |
| *** jistr is now known as jistr|biab | 15:46 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Update checkstyle plugin https://review.openstack.org/370592 | 15:46 |
| greghaynes | ah looks like devstack says it supports both (via KEYSTONE_DEPLOY) but we set that to mod_wsgi in gate | 15:49 |
| greghaynes | possibly because of what youre saying | 15:50 |
| prometheanfire | wonder how many people run mod_wsgi vs uwsgi vs gunicorn | 15:50 |
| *** drifterza has joined #openstack-infra | 15:50 | |
| prometheanfire | it's not even that all openstack services have migrated to wsgi (which makes me sad) | 15:50 |
| greghaynes | right | 15:50 |
| jeblair | AJaeger, clarkb: i think z-c is pulling from the mergers, which, since this is a periodic job, won't necessarily have an updated copy of the repo | 15:51 |
| *** berendt has quit IRC | 15:52 | |
| *** david-lyle_ has joined #openstack-infra | 15:52 | |
| *** david-lyle has quit IRC | 15:53 | |
| *** hogepodge has joined #openstack-infra | 15:53 | |
| pabelanger | mgagne: morning, looks like we have some lingering nodes in mtl01 in the delete state. Have a moment to help clean them up? | 15:53 |
| *** jkilpatr has joined #openstack-infra | 15:54 | |
| *** esikachev has joined #openstack-infra | 15:55 | |
| *** sdake_ has joined #openstack-infra | 15:55 | |
| *** sdake has quit IRC | 15:58 | |
| rm_work | does anyone know offhand if uwsgi has like, an API and supports running from within python code, similar to line 84 of https://review.openstack.org/#/c/386758/10/octavia/cmd/agent.py | 15:58 |
| * rm_work is trying to look it up now | 15:58 | |
| *** mandre has quit IRC | 15:59 | |
| *** rkukura has joined #openstack-infra | 15:59 | |
| *** weshay is now known as weshay_brb | 16:00 | |
| *** smarcet has quit IRC | 16:01 | |
| rm_work | also was tempted to propose watchdog to g-r as well, curious if we already have something that accomplishes the same? https://pypi.python.org/pypi/watchdog | 16:01 |
| clarkb | rm_work: https://uwsgi-docs.readthedocs.io/en/latest/PythonModule.html | 16:02 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Run zuul launcher on zuul-dev.o.o https://review.openstack.org/386746 | 16:02 |
| clarkb | jeblair: so we need to unset the env var for the merger? | 16:02 |
| rm_work | clarkb: thanks, was having a bad time with my google-fu | 16:02 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Switch ironic-multitenancy job to xenial https://review.openstack.org/387545 | 16:04 |
| *** sree has joined #openstack-infra | 16:05 | |
| *** Guest56218 is now known as mfisch | 16:06 | |
| *** mfisch is now known as Guest8770 | 16:06 | |
| *** andreas_s has quit IRC | 16:06 | |
| *** armax has joined #openstack-infra | 16:07 | |
| rm_work | man, they are right when they say that uwsgi python module is horribly documented T_T I have no idea how i'd be able to start a server with that, and most of the methods that seem like they could be interesting have literally nothing for docs lol | 16:07 |
| anteaya | if folks are asking about how to use nodepool with ironic, wznoinsk shared his experience in the third party meeting earlier today: http://eavesdrop.openstack.org/meetings/third_party/2016/third_party.2016-10-17-15.00.log.html | 16:08 |
| anteaya | the ssh timing needs to be reconfigured for bare metal | 16:08 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update checkstyle plugin https://review.openstack.org/370592 | 16:08 |
| *** eharney has joined #openstack-infra | 16:10 | |
| *** rcernin has joined #openstack-infra | 16:10 | |
| *** Guest8770 is now known as mfisch | 16:10 | |
| *** mfisch has quit IRC | 16:10 | |
| *** mfisch has joined #openstack-infra | 16:10 | |
| *** lykinsbd has joined #openstack-infra | 16:12 | |
| *** moravec has quit IRC | 16:14 | |
| *** dprince has joined #openstack-infra | 16:14 | |
| mordred | jeblair: oh - that makes a good amount of sense | 16:15 |
| *** mandre has joined #openstack-infra | 16:15 | |
| *** lykinsbd has quit IRC | 16:16 | |
| *** nadya has quit IRC | 16:16 | |
| *** moravec has joined #openstack-infra | 16:18 | |
| *** jpich has quit IRC | 16:18 | |
| *** yaume has quit IRC | 16:19 | |
| *** vhosakot has joined #openstack-infra | 16:20 | |
| *** kaisers_ has joined #openstack-infra | 16:21 | |
| *** claudiub has quit IRC | 16:21 | |
| clarkb | rcarrillocruz: pleia2 maybe we can cut back on osoc temporarily to see the smaller clouds work or we can generate some artificial load to push us over our quotas | 16:21 |
| *** jistr|biab is now known as jistr | 16:22 | |
| *** matrohon has quit IRC | 16:22 | |
| *** gyee has joined #openstack-infra | 16:22 | |
| *** lykinsbd has joined #openstack-infra | 16:23 | |
| *** amitgandhinz has quit IRC | 16:23 | |
| anteaya | mass recheck? | 16:24 |
| *** david-lyle_ is now known as david-lyle | 16:24 | |
| clarkb | or enqueue | 16:24 |
| *** drifterza has quit IRC | 16:25 | |
| *** sree has quit IRC | 16:25 | |
| openstackgerrit | Merged openstack-dev/pbr: Fix handling of old git log output https://review.openstack.org/339392 | 16:25 |
| *** kaisers_ has quit IRC | 16:26 | |
| vsaienk0 | infra please review https://review.openstack.org/#/c/387545/ switch ironic multitenant job to xenial, I'm not sure about https://review.openstack.org/#/c/387545/1/jenkins/jobs/projects.yaml@5562 but without introducing new job zuul test complains that ironic-multitenant-ubuntu-xenial is not found | 16:26 |
| *** yaume has joined #openstack-infra | 16:26 | |
| *** jtomasek has quit IRC | 16:28 | |
| *** dprince has quit IRC | 16:28 | |
| *** dmsimard|afk is now known as dmsimard | 16:28 | |
| *** dprince has joined #openstack-infra | 16:29 | |
| *** pilgrimstack has quit IRC | 16:29 | |
| anteaya | vsaienk0: have you been running this job in xenial before and seen that it works? | 16:32 |
| anteaya | it looks like you are just adding it for the first time now in this patch | 16:32 |
| *** njohnston_ is now known as njohnston | 16:33 | |
| rcarrillocruz | clarkb: speaking of which | 16:33 |
| rcarrillocruz | http://logs.openstack.org/56/386556/5/gate/gate-ansible-role-cloud-launcher-dsvm-ansible-func-centos-7/43ba0c8/console.html | 16:33 |
| vsaienk0 | anteaya: I've verified it locally, currently ironic-multitenant job is voting and run on trusty http://logs.openstack.org/76/382476/4/check/gate-tempest-dsvm-ironic-multitenant-network/4b1ccb9/ | 16:33 |
| rcarrillocruz | getting consistent net issues on osic | 16:33 |
| mgagne | pabelanger: hi! what can I do for you? | 16:34 |
| pabelanger | anteaya: wznoinsk: interesting, we've done some recent changes to ssh in diskimage-builder and glean. Along with making nodepool more forgiving for SSH connection failures. Would be interested to learn more about the bare metal changes needed for systemd | 16:34 |
| rcarrillocruz | you aware of it? | 16:34 |
| *** abregman has joined #openstack-infra | 16:34 | |
| pabelanger | mgagne: hi! I've noticed some nodes in mtl01 in a delete state for an extended amount of time | 16:34 |
| mgagne | checking | 16:35 |
| *** mhickey has quit IRC | 16:35 | |
| rcarrillocruz | pabelanger: ^, you've seen net issues on osic lately? | 16:35 |
| cloudnull | rcarrillocruz: is that potentially related to ianw's PR earlier? | 16:35 |
| cloudnull | [08:37] <openstackgerrit> [04:25:31] Ian Wienand proposed openstack-infra/project-config: Fix unbound rc.local generation https://review.openstack.org/387150 | 16:35 |
| rcarrillocruz | hmm, let me see | 16:35 |
| pabelanger | rcarrillocruz: not recently, but I haven't been looking either | 16:36 |
| cloudnull | rcarrillocruz: ianw noted earlier -- [08:37] <ianw> [04:27:22] clarkb: ^ when you're around ... i believe this to be the root-cause of our osic centos & fedora failures (http://people.redhat.com/~iwienand/output.html) | 16:36 |
| openstackgerrit | chandanc proposed openstack-infra/project-config: Add multinode CI for neutron-fwaas project. https://review.openstack.org/386933 | 16:36 |
| anteaya | vsaienk0: okay | 16:36 |
| anteaya | vsaienk0: I'm going to suggest the trust job stay voting and the xenial job is non voting and is removed from the gate queue for ironic | 16:36 |
| rcarrillocruz | AHA | 16:37 |
| anteaya | vsaienk0: for the jobs in nova's experimental queue, they don't have to be non voting | 16:37 |
| *** esikachev has quit IRC | 16:37 | |
| mgagne | pabelanger: do you authorize me to delete the stuck instances? | 16:37 |
| anteaya | pabelanger: thanks, yes I agree would be good to learn more | 16:37 |
| cloudnull | rcarrillocruz: if you suspect there's something else going i'd be happy to have a look | 16:37 |
| anteaya | vsaienk0: does that make sense to you? | 16:38 |
| *** yaume has quit IRC | 16:38 | |
| wznoinsk | pabelanger: nodepool says http://pasteboard.co/g6X2YXzSN.png , manual ssh tries at the same time as the nodepool issue http://pasteboard.co/g6XAhe9Fb.png | 16:38 |
| pabelanger | mgagne: go for it | 16:38 |
| vsaienk0 | anteaya: ok, I'll update the patch | 16:38 |
| *** bauzas has quit IRC | 16:39 | |
| anteaya | vsaienk0: okay thanks | 16:39 |
| vsaienk0 | anteaya: thanks! | 16:39 |
| anteaya | thank you | 16:39 |
| *** jkilpatr has quit IRC | 16:39 | |
| *** makowals has quit IRC | 16:39 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Run zuul launcher on zuul-dev.o.o https://review.openstack.org/386746 | 16:39 |
| *** ihrachys has quit IRC | 16:40 | |
| rcarrillocruz | cloudnull: lolks like it, cos trusty tests of my change was also run on osic, but worked | 16:40 |
| rcarrillocruz | did not on centos | 16:40 |
| pabelanger | wznoinsk: getting 404 back from urls | 16:40 |
| rcarrillocruz | thx for linking that! | 16:40 |
| *** makowals has joined #openstack-infra | 16:40 | |
| *** esikachev has joined #openstack-infra | 16:41 | |
| *** moravec has quit IRC | 16:41 | |
| cloudnull | thanks ianw for figuring it out :) | 16:42 |
| rcarrillocruz | ++ | 16:42 |
| anteaya | pabelanger: they resolve for me | 16:43 |
| pabelanger | anteaya: thanks, just came back too | 16:43 |
| *** trown is now known as trown|lunch | 16:43 | |
| *** abregman is now known as abregman|afk | 16:43 | |
| anteaya | awesome | 16:43 |
| pabelanger | wznoinsk: http://git.openstack.org/cgit/openstack-infra/nodepool/commit/?id=aebd030a329261246d96102f2e7a75f47e8d1812 should address your nodepool exception. Give nodepool the ability to retry again. | 16:44 |
| *** derekh has quit IRC | 16:44 | |
| pabelanger | wznoinsk: not sure about the 2nd issue, I haven't see that before. Which OS is this? | 16:44 |
| wznoinsk | pabelanger: yes, it looks like it should solve my issue | 16:44 |
| *** moravec has joined #openstack-infra | 16:44 | |
| wznoinsk | pabelanger: there's only one issue, two screenshots from nodepool/user point of view each | 16:44 |
| *** Hal has quit IRC | 16:45 | |
| wznoinsk | pabelanger: my downstream ci is over 6 months old, not upgrading for now | 16:45 |
| pabelanger | ack | 16:46 |
| *** bauzas has joined #openstack-infra | 16:46 | |
| *** markvoelker has joined #openstack-infra | 16:46 | |
| *** Rockyg has joined #openstack-infra | 16:46 | |
| *** jheroux has joined #openstack-infra | 16:47 | |
| *** weshay_brb is now known as weshay | 16:47 | |
| *** Apoorva has joined #openstack-infra | 16:48 | |
| *** markvoelker_ has joined #openstack-infra | 16:49 | |
| *** Goneri has quit IRC | 16:49 | |
| mgagne | pabelanger: instances are getting deleted now. I suspect an AMQP session got dropped somewhere and nova-compute service had to be restarted. | 16:50 |
| *** kzaitsev_mb has quit IRC | 16:51 | |
| mgagne | I see a bunch in errors, will fix those too if you don't mind. | 16:51 |
| *** kzaitsev_mb has joined #openstack-infra | 16:51 | |
| *** markvoelker has quit IRC | 16:51 | |
| *** lykinsbd has quit IRC | 16:52 | |
| *** jkilpatr has joined #openstack-infra | 16:53 | |
| *** drifterza has joined #openstack-infra | 16:53 | |
| pabelanger | mgagne: great, thanks | 16:54 |
| pabelanger | mgagne: So, nyj01 can be removed from nodepool right? | 16:54 |
| mgagne | pabelanger: yes, was thinking about that. | 16:54 |
| *** amitgandhinz has joined #openstack-infra | 16:55 | |
| mgagne | pabelanger: there is little chance for it to come back | 16:55 |
| *** harlowja_at_home has quit IRC | 16:55 | |
| pabelanger | mgagne: okay, cool. I'll clean up our configs | 16:55 |
| mgagne | +1 | 16:55 |
| *** jaosorior has quit IRC | 16:57 | |
| *** amoralej is now known as amoralej|off | 16:57 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Remove internap-nyj01 from nodepool https://review.openstack.org/387566 | 16:58 |
| *** drifterza has quit IRC | 16:58 | |
| *** flepied has quit IRC | 16:59 | |
| *** kgiusti has quit IRC | 17:00 | |
| *** amitgandhinz has quit IRC | 17:02 | |
| *** beekneemech has quit IRC | 17:02 | |
| *** amitgandhinz has joined #openstack-infra | 17:03 | |
| *** electrofelix has quit IRC | 17:03 | |
| *** jtomasek has joined #openstack-infra | 17:04 | |
| jeblair | clarkb, mordred: yeah, unsetting ZUUL_URL would work, but i'm going to take a look at having the cloner deal with that automatically | 17:04 |
| *** ralonsoh has quit IRC | 17:05 | |
| *** jaosorior has joined #openstack-infra | 17:06 | |
| jeblair | clarkb, mordred: (good news is, i think this is already taken care of in v3 (the launcher/merger knows to update all of the repos used by a job, and we're going to have jobs specify additional repos; so in this case, the propose job would include the repo that's triggering the job as well as openstack/requirements. both would be updated by the launcher/merger) | 17:06 |
| *** jtomasek has quit IRC | 17:06 | |
| *** jtomasek has joined #openstack-infra | 17:06 | |
| *** jordanP has quit IRC | 17:06 | |
| *** bnemec has joined #openstack-infra | 17:07 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove internap-nyj01 from nodepool https://review.openstack.org/387566 | 17:08 |
| clarkb | pabelanger: re dib build slowness and git repo cache, what do you think about either manually running the cleanup or removing the cache entirely now to speed thigns up? | 17:08 |
| pabelanger | clarkb: either works for me. I did https://review.openstack.org/#/c/386951/ over the weekend, if you wanted to check too | 17:09 |
| clarkb | pabelanger: the only thing is I am not sure if that is safe during a repo cache update. I suppose if it isn't and we corrupt the cache we just delete the whole thing | 17:11 |
| pabelanger | Ya, not sure either | 17:12 |
| *** tiswanso has quit IRC | 17:12 | |
| clarkb | pabelanger: reviewed | 17:12 |
| pabelanger | I figure at the summit we can hack on fixing it properly in diskimage-builder | 17:13 |
| *** tiswanso has joined #openstack-infra | 17:13 | |
| clarkb | ya the more I think about it the less I am worried. Git is really good about making sure it updates things safely and even if it doesn't its a cache we can safely delete | 17:13 |
| *** sdake has joined #openstack-infra | 17:14 | |
| *** tosky has quit IRC | 17:15 | |
| *** moravec has quit IRC | 17:15 | |
| *** sdake_ has quit IRC | 17:17 | |
| *** claudiub has joined #openstack-infra | 17:18 | |
| *** cardeois_ has joined #openstack-infra | 17:18 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Preform housekeeping on git repos cloned by DIB https://review.openstack.org/386951 | 17:20 |
| *** srobert has joined #openstack-infra | 17:20 | |
| *** cardeois has quit IRC | 17:20 | |
| *** tqtran has joined #openstack-infra | 17:21 | |
| rm_work | anyone know if iniuncomment is necessary in devstack plugins if you're also doing an iniset immediately after? or, is that when it is *explicitly necessary*? seems like the set would DO the uncomment? | 17:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Move kazooclient in to a fixture https://review.openstack.org/387577 | 17:22 |
| *** jpena is now known as jpena|off | 17:23 | |
| *** cardeois has joined #openstack-infra | 17:23 | |
| mordred | greghaynes: ^^ don't you want the setUp and cleanup methods to be non-private? | 17:23 |
| clarkb | ianw: cloudnull rcarrillocruz looks like frickler has comments on the centos/fedora fix for localrc probably need to switch on is redhat or not | 17:23 |
| *** psachin` has quit IRC | 17:24 | |
| *** dizquierdo has joined #openstack-infra | 17:25 | |
| greghaynes | mordred: I think _setUp is fixture.Fixture magic and the cleanup is registerd as a callback in setUp so I think it should work | 17:25 |
| *** cardeois_ has quit IRC | 17:25 | |
| greghaynes | mordred: _setUp being magic so you dont have to super().setUp() | 17:25 |
| mordred | greghaynes: if it is, I strongly suggest we not use it | 17:25 |
| openstackgerrit | Louis Fourie proposed openstack-infra/project-config: Add Networking SFC Data to Grafana https://review.openstack.org/386081 | 17:25 |
| mordred | since _setUp by definition is a private method and can't be part of an API | 17:26 |
| clarkb | you should use setUp if I understand fixtures api correctly | 17:26 |
| greghaynes | mordred: its private but its calling down an inheritence chain, so its actually prootected | 17:26 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 17:26 |
| greghaynes | which isnt really a python thing | 17:26 |
| greghaynes | clarkb: oh? the docs use _setUp | 17:26 |
| clarkb | really? | 17:27 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: [WIP]: Add janitor thread https://review.openstack.org/387583 | 17:27 |
| mordred | greghaynes: oh wow. what? | 17:27 |
| greghaynes | https://pypi.python.org/pypi/fixtures | 17:27 |
| clarkb | maybe I have it inverted | 17:27 |
| mordred | greghaynes: ok. so, I see we're already doing that | 17:27 |
| mordred | so meh | 17:27 |
| *** piet_ has joined #openstack-infra | 17:27 | |
| greghaynes | Yea, in another language this would be a virtual void protected :p | 17:27 |
| mordred | but ... I would like to go on record as saying I **__HATE__** using that as an API and think documenting it as one is terrible | 17:27 |
| mordred | but I will ignore that hatred moving forward | 17:28 |
| rm_work | interesting: "The examples above used _setUp rather than setUp because the base class implementation of setUp acts to reduce the chance of leaking external resources if an error is raised from _setUp. Specifically, setUp contains a try:/except: block which catches all exceptions, captures any registered detail objects, and calls self.cleanUp before propagating the error. As long as you take care to register any cleanups before | 17:28 |
| rm_work | calling the code that may fail, this will cause them to be cleaned up." | 17:28 |
| clarkb | ok the docs explain why. its for error handling of the setUp itself | 17:28 |
| mordred | shrug don't care | 17:28 |
| clarkb | and yes I think fixtures should've inverted that but they may be stuck with an existing api defined in stdlib somewhere | 17:28 |
| mordred | stll use a non-private method for hte thing humans are supposed to touch | 17:28 |
| pleia2 | btw, was notified that my job is among those in HPE's workforce reduction today, am pretty distracted | 17:29 |
| mordred | pleia2: :( | 17:29 |
| clarkb | and its private to the child class not overriding anything in the parent | 17:29 |
| pabelanger | :( indeed | 17:29 |
| jeblair | pleia2: i'm sorry to hear that | 17:29 |
| *** rbrndt has quit IRC | 17:29 | |
| pleia2 | and leads that would help me stay on this team beyond next week are appreciated, of course :) | 17:29 |
| *** Swami has joined #openstack-infra | 17:29 | |
| anteaya | pleia2: hope you will stay | 17:31 |
| *** tiswanso has quit IRC | 17:31 | |
| *** trown|lunch is now known as trown | 17:31 | |
| AJaeger | jeblair: review comment - now I get it. Let me check your suggestion again... | 17:31 |
| pleia2 | anteaya: me too, infra is kinda an important thing to OpenStack, and I love it here | 17:31 |
| anteaya | I love having you here | 17:31 |
| *** tiswanso has joined #openstack-infra | 17:31 | |
| AJaeger | jeblair: from the mergers? Oohh. How can we fix that? | 17:32 |
| dmsimard | dstufft: just saw the news, sorry :( | 17:33 |
| jeblair | AJaeger: i'll let you know | 17:33 |
| *** oanson has joined #openstack-infra | 17:34 | |
| * AJaeger hugs pleia2 | 17:35 | |
| * pleia2 hugs AJaeger | 17:35 | |
| AJaeger | pleia2: this is really sad ;( | 17:35 |
| AJaeger | thanks a lot jeblair for figuring this out. This could indeed explain the mystery. | 17:36 |
| *** moravec has joined #openstack-infra | 17:36 | |
| *** Hal has joined #openstack-infra | 17:37 | |
| *** amitgandhinz has quit IRC | 17:37 | |
| dmsimard | pleia2: oh no, you too ? :( | 17:37 |
| *** amitgandhinz has joined #openstack-infra | 17:37 | |
| pleia2 | dmsimard: yeah :\ | 17:38 |
| Zara | pleai2: just saw backscroll, :( | 17:39 |
| *** flepied has joined #openstack-infra | 17:40 | |
| *** osh has quit IRC | 17:40 | |
| *** moravec has quit IRC | 17:41 | |
| *** jaosorior has quit IRC | 17:41 | |
| *** jaosorior has joined #openstack-infra | 17:42 | |
| *** lVathan[m] has quit IRC | 17:42 | |
| *** dprince has quit IRC | 17:42 | |
| *** dave-mccowan has quit IRC | 17:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable Python 3 jobs for networking-calico https://review.openstack.org/386097 | 17:42 |
| *** nadya has joined #openstack-infra | 17:43 | |
| *** dprince has joined #openstack-infra | 17:43 | |
| *** dave-mccowan has joined #openstack-infra | 17:43 | |
| *** moravec has joined #openstack-infra | 17:45 | |
| *** berendt has joined #openstack-infra | 17:46 | |
| *** spzala has joined #openstack-infra | 17:46 | |
| *** Goneri has joined #openstack-infra | 17:46 | |
| *** degorenko is now known as degorenko|afk | 17:46 | |
| *** nadya has quit IRC | 17:47 | |
| *** mriedem has quit IRC | 17:47 | |
| dstufft | dmsimard: thanks :) and yea, I think mine and pleia2's entire team got cut :/ | 17:48 |
| openstackgerrit | Merged openstack-infra/project-config: Create tasks for functional tests of networking-bgpvpn https://review.openstack.org/385868 | 17:48 |
| openstackgerrit | gordon chung proposed openstack-infra/project-config: start panko before ceilometer https://review.openstack.org/387588 | 17:49 |
| anteaya | dstufft: I hope you find a new employer soon | 17:49 |
| *** tkelsey has quit IRC | 17:49 | |
| *** e0ne has quit IRC | 17:49 | |
| *** moravec has quit IRC | 17:50 | |
| *** nadya has joined #openstack-infra | 17:50 | |
| *** jaosorior has quit IRC | 17:51 | |
| *** moravec has joined #openstack-infra | 17:51 | |
| *** mriedem has joined #openstack-infra | 17:52 | |
| *** sdake has quit IRC | 17:52 | |
| *** sdake has joined #openstack-infra | 17:52 | |
| AJaeger | dstufft: Sorry to hear ;( | 17:53 |
| *** M-docaedo_vector has joined #openstack-infra | 17:55 | |
| *** moravec has quit IRC | 17:56 | |
| prometheanfire | pabelanger: testing now, we'll see if I installed all the deps needed to run the test or not :D | 17:58 |
| *** Sukhdev has joined #openstack-infra | 17:58 | |
| *** lVathan[m] has joined #openstack-infra | 17:59 | |
| *** ociuhandu has quit IRC | 17:59 | |
| *** john-davidge has quit IRC | 18:00 | |
| *** john-davidge has joined #openstack-infra | 18:00 | |
| *** sambetts is now known as sambetts|afk | 18:01 | |
| *** dtantsur is now known as dtantsur|afk | 18:02 | |
| *** markvoelker_ has quit IRC | 18:03 | |
| openstackgerrit | Merged openstack-infra/project-config: start panko before ceilometer https://review.openstack.org/387588 | 18:04 |
| *** lykinsbd has joined #openstack-infra | 18:04 | |
| *** rbrndt has joined #openstack-infra | 18:05 | |
| *** esikachev has quit IRC | 18:05 | |
| clarkb | pabelanger: do you know if os-collect-config, os-refresh-config, os-net-config, and os-cloud-config are still in use by tripleo? they are still in the devstack-gate PROJECTS default list but not sure if actually used anywhere | 18:07 |
| pabelanger | clarkb: I'd have to ask the team | 18:07 |
| pabelanger | EmilienM: ^do you know? | 18:07 |
| clarkb | also I'd like to remove tripleo-ci from that list by default and add it back into the tripleo jobs explicitly (slowly trying to trim the list to reduce job runtimes) | 18:08 |
| *** moravec has joined #openstack-infra | 18:08 | |
| clarkb | so far have done this for grenade and the python clients | 18:08 |
| pabelanger | Ya, I think that would be okay | 18:08 |
| *** kaisers_ has joined #openstack-infra | 18:10 | |
| *** vsaienko has joined #openstack-infra | 18:11 | |
| *** vhosakot has quit IRC | 18:11 | |
| vsaienko | clarkb: you've reviewed https://review.openstack.org/#/c/364830/ recently, the patch passed ironic multinode CI https://review.openstack.org/#/c/368173/ gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ssh-tinyipa-multinode-nvSUCCESS in 57m 56s (non-voting) | 18:12 |
| *** moravec has quit IRC | 18:12 | |
| vsaienko | clarkb: could you please help to merge that change? | 18:12 |
| clarkb | vsaienko: yes I will try to take a look again | 18:13 |
| openstackgerrit | Louis Fourie proposed openstack-infra/project-config: Add releasenotes jobs for networking-sfc https://review.openstack.org/387595 | 18:13 |
| openstackgerrit | chandanc proposed openstack-infra/project-config: Add multinode CI for neutron-fwaas project. https://review.openstack.org/386933 | 18:13 |
| vsaienko | clarkb, thank you, if you have a time please review other patches in the chain https://review.openstack.org/#/c/352790 | 18:13 |
| clarkb | EmilienM: pabelanger looks like there is also triple-incubator, tripleo-heat-templates, and tripleo-image-elements. Can we identify which are still used, remove the others, and move the still used ones into the tripleo jobs explicitly? | 18:14 |
| *** kaisers_ has quit IRC | 18:14 | |
| amrith | AJaeger, yt? would like to ask about your comments on https://review.openstack.org/#/c/387386/1/zuul/layout.yaml@2981 | 18:15 |
| *** rhallisey has quit IRC | 18:16 | |
| *** moravec has joined #openstack-infra | 18:16 | |
| *** kzaitsev_mb has quit IRC | 18:17 | |
| AJaeger | amrith: I'm here. For new jobs on master, we use xenial - could you update your job for that. | 18:17 |
| amrith | AJaeger, these jobs were always there; I just changed the name | 18:17 |
| amrith | and they are going away in days | 18:17 |
| amrith | once we get the new jobs to work correctly | 18:17 |
| pabelanger | clarkb: sure, I'll let EmilienM comment, but I can help with that | 18:18 |
| AJaeger | amrith: let me reread your change... | 18:18 |
| amrith | ok | 18:18 |
| amrith | these jobs used to be called gate-trove-scenario-functional-dsvm-* | 18:18 |
| amrith | I added the word "legacy" in the middle | 18:18 |
| *** shardy is now known as shardy_afk | 18:19 | |
| asselin__ | Zara, do you work on storyboard? any idea what could be the cause of this? http://logs.openstack.org/12/385112/3/check/gate-elastic-recheck-python27-ubuntu-xenial/c48d0a7/console.html.gz#_2016-10-15_00_50_22_210999 | 18:19 |
| AJaeger | amrith: you're confusing me;) you now duplicate the jobs. Why not run the new jobs on xenial? | 18:19 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Allow zuul launcher and scheduler on the same host https://review.openstack.org/386745 | 18:20 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Run zuul launcher on zuul-dev.o.o https://review.openstack.org/386746 | 18:20 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 18:20 |
| amrith | ok, the new jobs are called gate-trove-scenario-functional-dsvm-* and you want those on xenial? currently I don't know that any of the trove jobs runs on xenial. | 18:20 |
| amrith | and getting to xenial is something we're working on | 18:21 |
| amrith | along with guests, images,... | 18:21 |
| AJaeger | amrith: you have some jobs on xenial already | 18:21 |
| amrith | yes, pep, docs, py27 ... | 18:22 |
| amrith | not functional and scenario tests | 18:22 |
| Zara | asselin__: o.O I haven't seen that before, hmm | 18:22 |
| amrith | see (for example) https://review.openstack.org/#/c/387528/ | 18:22 |
| AJaeger | also, gate-trove-integration-buildimage-{datastore} and gate-trove-buildimage-{datastore} is exactly the same job. Why not just rename? | 18:22 |
| amrith | they are not the same job | 18:22 |
| amrith | one is against the trove integration repository | 18:23 |
| amrith | and one is against the trove repository | 18:23 |
| *** jcoufal has quit IRC | 18:23 | |
| *** cschwede|mtg is now known as cschwede | 18:23 | |
| amrith | see line 47 vs 17 of trove.yaml | 18:23 |
| *** HeOS has quit IRC | 18:23 | |
| amrith | the point of this change is to get rid of trove-integration | 18:23 |
| amrith | and this is a step in that direction. | 18:24 |
| amrith | the trove-integration jobs will live on for two more cycles | 18:24 |
| amrith | as legacy jobs for newton, mitaka | 18:24 |
| amrith | for Ocata onwards we won't use those jobs | 18:24 |
| AJaeger | amrith: let me remove my -1 and hope others can review. I can't concentrate on this right now. What you say sounds fine but the change is too large for me to grasp at this time. | 18:24 |
| *** vsaienko has quit IRC | 18:25 | |
| amrith | ok, when you get a chance please take a look at https://review.openstack.org/#/c/373153/ | 18:25 |
| *** vsaienko has joined #openstack-infra | 18:26 | |
| Zara | asselin__: I woner if it might be to do with the python client currently reusing oslo code, so that things are clashing? | 18:26 |
| AJaeger | amrith: sometime the next days... - best add the link to the review. Sorry, not anymore tonight. | 18:26 |
| amrith | it is in the review (in the commit message) | 18:26 |
| amrith | listed as reference [1] | 18:26 |
| *** gsilvis has left #openstack-infra | 18:26 | |
| asselin__ | Zara, can you elaborate? there's copy of oslo code in storyboard that conflicts with what is pip installed? | 18:26 |
| AJaeger | amrith: you see I'm too tired ;) | 18:26 |
| amrith | no worries | 18:27 |
| amrith | it is a painful change, I agree | 18:27 |
| amrith | I'll put the -nv's on | 18:27 |
| AJaeger | amrith: consider splitting it up | 18:27 |
| AJaeger | or ask others that are fully awake ;) | 18:27 |
| amrith | ok, am not sure how I'd split it but let me think about that too. | 18:28 |
| *** yamahata has joined #openstack-infra | 18:28 | |
| *** nadya has quit IRC | 18:28 | |
| Zara | asselin__: the python-storyboardclient replicates some oslo code so there might be a conflict there, but I don't know for sure. (the story about it is at: https://storyboard.openstack.org/#!/story/2000707 ) | 18:29 |
| *** Guest21077 has quit IRC | 18:29 | |
| sdake | fungi ping re atc passes for contributors | 18:29 |
| *** bjolo__ has joined #openstack-infra | 18:30 | |
| anteaya | sdake: he is away until tomorrow | 18:30 |
| sdake | was sept 20th after the atc pass cutoff for operators contributing code to big tent projects? | 18:30 |
| amrith | AJaeger, does a job suffix of -nv make a job non-voting by default? | 18:30 |
| Zara | asselin__: and I see the error raised is mentioned here http://docs.openstack.org/developer/oslo.config/api/oslo.config.cfg.html but I haven't worked much with oslo yet, | 18:30 |
| sdake | anteaya do you know the answer perhaps? - I think its a foundation question | 18:30 |
| anteaya | the deadline would be the same for any contributor, operator or not | 18:30 |
| sdake | anteaya right - when is that ? :) | 18:30 |
| AJaeger | amrith: yes | 18:30 |
| anteaya | I don't know what the deadline was, I don't think it was published | 18:30 |
| amrith | aha! thanks ... | 18:31 |
| AJaeger | amrith: we have a global regex for that | 18:31 |
| sdake | anteaya cool thanks | 18:31 |
| sdake | i'll poke around | 18:31 |
| anteaya | sdake: at this point I think you need to contact someone on the foundation staff | 18:31 |
| sdake | anteaya roger | 18:31 |
| asselin__ | Zara, I tried tracing it, but didn't find anything.... | 18:31 |
| *** dprince has quit IRC | 18:32 | |
| *** nadya has joined #openstack-infra | 18:32 | |
| *** dprince has joined #openstack-infra | 18:32 | |
| *** Sukhdev has quit IRC | 18:32 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Reorganize PROJECTS list to show repos to remove https://review.openstack.org/387614 | 18:34 |
| clarkb | pabelanger: EmilienM ^ fwiw thats a general change. Not picking on tripleo but figured that might be a quick and easy place to start | 18:34 |
| *** e0ne has joined #openstack-infra | 18:35 | |
| asselin__ | Zara, actually, i can reproduce locally on command line only, but didn't succeed to actually debug it to trace it. Tests pass fine outside of tox -e py27... | 18:35 |
| *** lykinsbd has quit IRC | 18:36 | |
| vsaienko | project-config team: what devstack-jobs group defines? https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L2344 | 18:37 |
| Zara | :/ | 18:41 |
| *** mriedem has quit IRC | 18:41 | |
| anteaya | thunder here, going offline until it clears | 18:42 |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Rename rsc to valence https://review.openstack.org/381332 | 18:42 |
| *** Hal has quit IRC | 18:42 | |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Change pep8 to voting for rsc https://review.openstack.org/387618 | 18:42 |
| *** nadya has quit IRC | 18:42 | |
| jeblair | clarkb, AJaeger, mordred: i think this needs to be fixed in zuul-cloner (the fix should not be to remove zuul_url). i think it may also be affecting pre-merge jobs in some rare cases. but i think we can fix both. i'm working on a change. | 18:42 |
| clarkb | vsaienko: it started as the default list of jobs that we wanted to keep testing on stable branches, but now we have our own groups for that | 18:42 |
| clarkb | jeblair: ok | 18:42 |
| *** annegentle has joined #openstack-infra | 18:42 | |
| clarkb | vsaienko: its a cheap way to get your job created at this point since we already instantiate devstack-jobs | 18:43 |
| jeblair | (mostly, i'm working on *tests* for a change :) | 18:43 |
| *** mriedem has joined #openstack-infra | 18:43 | |
| *** jkilpatr has quit IRC | 18:43 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Switch ironic-multitenancy job to xenial https://review.openstack.org/387545 | 18:43 |
| openstackgerrit | gordon chung proposed openstack-infra/project-config: fix panko initialisation https://review.openstack.org/387620 | 18:44 |
| *** dtardivel has quit IRC | 18:44 | |
| vsaienko | clarkb: what is the preferred place to instantiate a job? i.e. if we already define it in projects.yaml there is no need to reinstantiate it under devstack-jobs right? | 18:44 |
| clarkb | vsaienko: correct. I think for jobs that apply only to a project or a small colelction of projects (eg ironic ipa etc) the best place is on the project itself | 18:45 |
| clarkb | if the job is intended to be used in many projects like the neutron tempest test for example it should go in that group | 18:45 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 18:45 |
| vsaienko | clarkb: I'm switching multitenant job to xenial and looks like keeping job under devstack-gatse jobs group is a duplication https://review.openstack.org/#/c/387545 | 18:46 |
| clarkb | yes ironic has a bunch of jobs there, they don't necessarily hurt but we should probably try to clean that up. Maybe have an ironic-integration-job group (basically what you already have in the matrix on ironic iirc) | 18:47 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add build log location to translation proposal https://review.openstack.org/387622 | 18:47 |
| AJaeger | jeblair: is this what you envisoned? I tested locally the ssh command | 18:48 |
| *** ihrachys has joined #openstack-infra | 18:48 | |
| AJaeger | thanks, jeblair | 18:48 |
| flaper87 | Hey all: Do you think it'd be possible for us to host http://shields.io/ somewhere? I'm asking in the context of http://lists.openstack.org/pipermail/openstack-dev/2016-October/105562.html | 18:49 |
| *** rhallisey has joined #openstack-infra | 18:49 | |
| flaper87 | I think it could be expanded to show other badges too | 18:49 |
| *** kaisers_ has joined #openstack-infra | 18:50 | |
| flaper87 | I've written a small patch to add support for openstack to this service but I think it might not make much sense for them to have openstack governane specific things in their repo | 18:50 |
| EmilienM | clarkb, pabelanger: back /me looking | 18:51 |
| flaper87 | The service is supposed to be a "very simple nodejs app" (TM) (add here all the problems it might cause) | 18:51 |
| EmilienM | clarkb: yes we use them in tripleo (os-*-config) | 18:51 |
| *** vsaienko has quit IRC | 18:51 | |
| *** lykinsbd has joined #openstack-infra | 18:51 | |
| *** vsaienko has joined #openstack-infra | 18:53 | |
| vsaienko | dtantsur, jroll please review: switch ironic-multitenant job to xenial https://review.openstack.org/#/c/387545/ | 18:54 |
| pabelanger | flaper87: Assuming the code is open source friendly, we should be able to host it, the requirements look pretty minimal. I'd suggest adding a topic to our meeting tomorrow to get some eyes on it. | 18:54 |
| pabelanger | flaper87: obviously, we'd need to write puppet modules to deploy it in openstack-infra | 18:54 |
| flaper87 | pabelanger: ok, do you have an etherpad for the meeting topics ? | 18:55 |
| pabelanger | https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting | 18:56 |
| flaper87 | Thank you | 18:56 |
| *** jkilpatr has joined #openstack-infra | 18:56 | |
| pabelanger | sure, np | 18:56 |
| *** bauzas has quit IRC | 18:56 | |
| *** nherciu has quit IRC | 18:56 | |
| flaper87 | now I just need to remember that I've to be there | 18:58 |
| *** rajinir has joined #openstack-infra | 18:58 | |
| *** Sukhdev has joined #openstack-infra | 18:59 | |
| *** pblaho has quit IRC | 19:00 | |
| *** cardeois_ has joined #openstack-infra | 19:01 | |
| Zara | asselin__: I've had a look around at the code and the traceback in the logs but haven't pinned it down to anything specific; I've got as far as 'a 'verbose' option must be registered over here: https://git.openstack.org/cgit/openstack-infra/python-storyboardclient/tree/storyboardclient/openstack/common/log.py#n173 and then a duplicate option is picked up over here: https://github.com/openstack/oslo.c | 19:01 |
| Zara | onfig/blob/master/oslo_config/cfg.py#L690 ... which may just be repeating what you alreay know. | 19:01 |
| Zara | hah, nice linebreak | 19:01 |
| Zara | https://github.com/openstack/oslo.config/blob/master/oslo_config/cfg.py#L690 | 19:01 |
| *** dizquierdo has quit IRC | 19:02 | |
| Zara | (sorry to link to github; it was the first thing to come up in a search and I'm about to head off for the night) | 19:02 |
| saper | nice linebreak indeed :) | 19:02 |
| Zara | :) | 19:02 |
| asselin__ | Zara, ok yeah, but I couldn't figure out how it could already by registered. anyway, if your EOD, I see what i can find. Might ping you ealier my day next time. | 19:03 |
| *** med_` is now known as medberry | 19:03 | |
| *** medberry has joined #openstack-infra | 19:03 | |
| * clarkb wonders why you need a service to host a few pngs. cant you just stick a png behind a webserver? | 19:03 | |
| Zara | asselin__: sure, I wish I could be more help! | 19:04 |
| *** cardeois has quit IRC | 19:04 | |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Change pep8 to voting for rsc https://review.openstack.org/387618 | 19:05 |
| *** e0ne has quit IRC | 19:05 | |
| *** burgerk has quit IRC | 19:05 | |
| *** thiagolib has joined #openstack-infra | 19:05 | |
| *** e0ne has joined #openstack-infra | 19:05 | |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack-infra/devstack-gate: Pass ".*" to the regex of Tempest https://review.openstack.org/387640 | 19:06 |
| *** ihrachys has quit IRC | 19:09 | |
| *** makowals has quit IRC | 19:10 | |
| *** annegentle has quit IRC | 19:10 | |
| *** EricGonczer_ has joined #openstack-infra | 19:11 | |
| *** makowals has joined #openstack-infra | 19:11 | |
| *** tiswanso has quit IRC | 19:11 | |
| *** jkilpatr has quit IRC | 19:11 | |
| *** jkilpatr has joined #openstack-infra | 19:12 | |
| *** tiswanso has joined #openstack-infra | 19:12 | |
| *** vsaienko has quit IRC | 19:13 | |
| *** yamahata has quit IRC | 19:14 | |
| *** srobert has quit IRC | 19:15 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Add Grafana for networking-bagpipe https://review.openstack.org/385337 | 19:17 |
| *** berendt has quit IRC | 19:17 | |
| pabelanger | clarkb: I approved 386951 so we can run git gc before tomorrows builds | 19:18 |
| clarkb | pabelanger: ok | 19:18 |
| *** ihrachys has joined #openstack-infra | 19:19 | |
| AJaeger | do we want to try the Gentoo support in nodepool again? https://review.openstack.org/387114 | 19:19 |
| pabelanger | AJaeger: I'd like to see some build logs first | 19:20 |
| pabelanger | I think prometheanfire is working on that now | 19:21 |
| AJaeger | pabelanger: great - thanks for the info | 19:21 |
| openstackgerrit | Merged openstack-infra/system-config: Preform housekeeping on git repos cloned by DIB https://review.openstack.org/386951 | 19:22 |
| *** kzaitsev_mb has joined #openstack-infra | 19:23 | |
| prometheanfire | hi? | 19:23 |
| prometheanfire | AJaeger: ya, I'm running the test buld now | 19:23 |
| prometheanfire | finished caching the repos a couple of min ago... | 19:23 |
| *** pilgrimstack has joined #openstack-infra | 19:23 | |
| *** lykinsbd has quit IRC | 19:24 | |
| *** Guest40693 is now known as rook | 19:25 | |
| *** csomerville has quit IRC | 19:25 | |
| *** sdake_ has joined #openstack-infra | 19:26 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: add a --cycle-based option to list-repos https://review.openstack.org/387649 | 19:27 |
| *** sdake has quit IRC | 19:27 | |
| *** Ravikiran_K has quit IRC | 19:28 | |
| *** ihrachys has quit IRC | 19:29 | |
| *** lykinsbd has joined #openstack-infra | 19:29 | |
| *** annegentle has joined #openstack-infra | 19:29 | |
| *** ianychoi has quit IRC | 19:29 | |
| *** vsaienko has joined #openstack-infra | 19:31 | |
| *** abregman|afk is now known as abregman | 19:32 | |
| *** vsaienko has quit IRC | 19:34 | |
| *** ccamacho has quit IRC | 19:34 | |
| asselin__ | Zara, FYI I found a clue: http://paste.openstack.org/show/586020/ which google blames: http://docs.openstack.org/developer/subunit2sql/_modules/subunit2sql/db/api.html | 19:34 |
| *** jcoufal has joined #openstack-infra | 19:34 | |
| *** vsaienko has joined #openstack-infra | 19:35 | |
| *** gyee has quit IRC | 19:37 | |
| *** amitgandhinz has quit IRC | 19:37 | |
| *** lykinsbd has quit IRC | 19:37 | |
| *** esikachev has joined #openstack-infra | 19:38 | |
| *** kzaitsev_mb has quit IRC | 19:38 | |
| *** cody-somerville has joined #openstack-infra | 19:42 | |
| *** cody-somerville has joined #openstack-infra | 19:42 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on missing url on image locations now images without urls are not sent on collections. https://review.openstack.org/387653 | 19:43 |
| *** lucasagomes is now known as lucas-afk | 19:43 | |
| *** tkelsey has joined #openstack-infra | 19:46 | |
| *** jkilpatr_ has joined #openstack-infra | 19:47 | |
| *** piet_ has quit IRC | 19:47 | |
| *** moravec has quit IRC | 19:48 | |
| *** gentoo_ has joined #openstack-infra | 19:48 | |
| *** jkilpatr has quit IRC | 19:49 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on missing url on image locations now images without urls are not sent on collections. https://review.openstack.org/387653 | 19:49 |
| prometheanfire | AJaeger: pabelanger got this error, I don't think it's my fault https://gist.github.com/prometheanfire/86587213bdf44514c77d0d05481adde6 | 19:50 |
| *** tkelsey has quit IRC | 19:50 | |
| *** ccamacho has joined #openstack-infra | 19:51 | |
| prometheanfire | I think it passed the pkg-map issue by that point | 19:51 |
| AJaeger | prometheanfire, pabelanger : https://review.openstack.org/386785 comes to mind | 19:51 |
| *** yamahata has joined #openstack-infra | 19:52 | |
| *** john-davidge has quit IRC | 19:53 | |
| prometheanfire | lol | 19:53 |
| *** jkilpatr_ has quit IRC | 19:54 | |
| *** askb has joined #openstack-infra | 19:55 | |
| *** Apoorva has quit IRC | 19:56 | |
| *** Sukhdev has quit IRC | 19:56 | |
| *** amitgandhinz has joined #openstack-infra | 19:57 | |
| *** csomerville has joined #openstack-infra | 19:58 | |
| *** spzala has quit IRC | 19:58 | |
| *** spzala has joined #openstack-infra | 19:59 | |
| *** spzala has quit IRC | 19:59 | |
| *** spzala has joined #openstack-infra | 19:59 | |
| *** amitgandhinz has quit IRC | 20:00 | |
| *** amitgandhinz has joined #openstack-infra | 20:00 | |
| *** mfisch has quit IRC | 20:00 | |
| *** medberry has quit IRC | 20:00 | |
| *** yamahata has quit IRC | 20:00 | |
| *** nadya has joined #openstack-infra | 20:00 | |
| *** med_ has joined #openstack-infra | 20:00 | |
| *** nadya has quit IRC | 20:00 | |
| *** mfisch has joined #openstack-infra | 20:00 | |
| AJaeger | let's merge it... | 20:00 |
| *** mfisch has quit IRC | 20:01 | |
| *** mfisch has joined #openstack-infra | 20:01 | |
| *** med_ is now known as Guest62846 | 20:01 | |
| *** cody-somerville has quit IRC | 20:02 | |
| *** tqtran has quit IRC | 20:02 | |
| *** bauzas has joined #openstack-infra | 20:02 | |
| *** trown is now known as trown|afk | 20:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Fail build-image if public key is not present https://review.openstack.org/386785 | 20:05 |
| *** mfedosin has quit IRC | 20:07 | |
| *** jkilpatr_ has joined #openstack-infra | 20:08 | |
| *** cardeois_ has quit IRC | 20:08 | |
| *** cardeois has joined #openstack-infra | 20:09 | |
| pabelanger | AJaeger: Thanks | 20:10 |
| *** john-davidge has joined #openstack-infra | 20:10 | |
| *** john-davidge has quit IRC | 20:10 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: [WIP]: Add janitor thread https://review.openstack.org/387583 | 20:10 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: [WIP]: Add janitor thread https://review.openstack.org/387583 | 20:15 |
| *** vsaienko has quit IRC | 20:16 | |
| *** ldnunes has quit IRC | 20:18 | |
| *** mhickey has joined #openstack-infra | 20:18 | |
| *** matrohon has joined #openstack-infra | 20:18 | |
| *** lykinsbd has joined #openstack-infra | 20:21 | |
| *** Sukhdev has joined #openstack-infra | 20:22 | |
| *** mhickey has quit IRC | 20:22 | |
| *** mhickey has joined #openstack-infra | 20:23 | |
| *** hichihara has joined #openstack-infra | 20:24 | |
| *** cardeois has quit IRC | 20:25 | |
| *** pcaruana has quit IRC | 20:25 | |
| *** oanson has quit IRC | 20:26 | |
| *** amitgandhinz has quit IRC | 20:28 | |
| *** trown|afk is now known as trown | 20:28 | |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/system-config: Add entercloudsuite cloud https://review.openstack.org/387668 | 20:28 |
| *** Apoorva has joined #openstack-infra | 20:28 | |
| *** e0ne has quit IRC | 20:29 | |
| *** yamahata has joined #openstack-infra | 20:30 | |
| openstackgerrit | Eric Brown proposed openstack-infra/project-config: Enable py35 voting on passing keystone projects https://review.openstack.org/387670 | 20:30 |
| *** mriedem has quit IRC | 20:30 | |
| vinaypotluri | Hi.. I'm trying to login to my ubuntu one account at https://login.staging.ubuntu.com/ to create a test project but i get an error saying that there is no account associated with my email address | 20:32 |
| vinaypotluri | should i create a different account for creating projects on openstack or for staging.ubuntu.com ? | 20:33 |
| *** tqtran has joined #openstack-infra | 20:33 | |
| clarkb | vinaypotluri: we don't use login.staging.ubuntu.com as far as I know. We use the actula servers | 20:33 |
| clarkb | vinaypotluri: it might help if you back up and explain what you are trying to do | 20:34 |
| *** markvoelker has joined #openstack-infra | 20:34 | |
| *** jkilpatr_ has quit IRC | 20:34 | |
| *** baoli has quit IRC | 20:35 | |
| vinaypotluri | i followed the documentation and went to https://launchpad.net/projects/+new to register for a new project. I saw an option to create a test project which points me to staging.launchpad.net | 20:36 |
| *** piet_ has joined #openstack-infra | 20:36 | |
| clarkb | vinaypotluri: gotcha, I don't think a launchpad test project is what you want unless you explicitly want to test launchpad's unreleased features | 20:37 |
| *** markvoelker_ has joined #openstack-infra | 20:37 | |
| vinaypotluri | im trying to create an official project for syntribos project and set it up on lanchpad and get started http://docs.openstack.org/infra/manual/creators.html | 20:37 |
| vinaypotluri | ok | 20:37 |
| *** mhickey has quit IRC | 20:40 | |
| *** markvoelker has quit IRC | 20:41 | |
| *** esikachev has quit IRC | 20:44 | |
| *** eharney has quit IRC | 20:46 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Make bug name, type, and url explicit https://review.openstack.org/375113 | 20:49 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: WIP: Add StoryBoard integration for graph commands https://review.openstack.org/385112 | 20:49 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Add Jira integration for graph commands https://review.openstack.org/385217 | 20:49 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Refactor launchpad code into bug_tracker https://review.openstack.org/385199 | 20:49 |
| *** esikachev has joined #openstack-infra | 20:50 | |
| *** matrohon has quit IRC | 20:50 | |
| asselin__ | mtreinish, Zara FYI, I was able to hack my way around the subunit2sql/python-storyboardclient conflict ^^ https://review.openstack.org/385112 | 20:50 |
| *** adriant has joined #openstack-infra | 20:51 | |
| *** yamahata has quit IRC | 20:55 | |
| *** dizquierdo has joined #openstack-infra | 20:55 | |
| *** trown is now known as trown|outtypewww | 20:55 | |
| clarkb | does anyone know how keystone auth is supposed to work with eg horizon where you just provide useranme password, when keystonev2 is not used? | 20:55 |
| *** yamahata has joined #openstack-infra | 20:55 | |
| clarkb | asking because I wonder if we can further simplify os-client-config to not need a half dozen auth args | 20:55 |
| *** camunoz has joined #openstack-infra | 20:56 | |
| clarkb | mordred: ^ maybe you know? | 20:56 |
| *** jkilpatr has joined #openstack-infra | 20:56 | |
| *** cardeois has joined #openstack-infra | 20:57 | |
| *** pilgrimstack has quit IRC | 20:57 | |
| stevemar | clarkb: if you setup horizon to use v3 you'll have a third field, domain | 20:58 |
| david-lyle | clarkb: I'm not sure I understand the question | 20:58 |
| clarkb | stevemar: gah ok | 20:59 |
| clarkb | stevemar: I was hoping you wouldn't say that | 20:59 |
| david-lyle | we hide the domain field if only one domain | 20:59 |
| clarkb | gotcha | 20:59 |
| *** esikachev has quit IRC | 20:59 | |
| david-lyle | but pass in the value from our config | 20:59 |
| stevemar | clarkb: and horizon doesn't bother asking for project stuff, it authenticates with an unscoped token and calls a proejct listing, and gets a token on the first project it gets back | 20:59 |
| clarkb | my expereince with the command line tools is i have to provide username, userdomain, project domain, project, and password | 21:00 |
| stevemar | clarkb: once you add in user domain name + project name + project domain name; well there is your half dozen | 21:00 |
| clarkb | ya | 21:00 |
| mordred | clarkb: this is a reason I made clouds.yaml | 21:00 |
| clarkb | mordred: yes the problem is that its still ridiculously complicated to get right | 21:01 |
| mordred | clarkb: also, if you have project_id and user_id you do not need domain settings for them. only when you want to refer to user or project by name | 21:01 |
| mordred | clarkb: indeed | 21:01 |
| clarkb | mordred: so while its good to have info like where my endpoint is and what auth api to use and so on behind the scenes you still ahve to sort out what all these things are | 21:01 |
| *** krtaylor has quit IRC | 21:01 | |
| mordred | clarkb: I made it as simple as I could | 21:01 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Refactor run-tox-with-oslo-master.sh https://review.openstack.org/387681 | 21:01 |
| clarkb | and so I was wondering how horizon got away with just username + password | 21:01 |
| mordred | at one point we were going to have a nice "please add these creds that I got from an openrc file to clouds.yaml" utility - but it's unfinished | 21:02 |
| clarkb | and wondering if we can do that by default maybe in oscc | 21:02 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Refactor run-tox-with-oslo-master.sh https://review.openstack.org/387681 | 21:03 |
| mordred | clarkb: maybe - but I think it actually makes it more complex and confusing - you need to operate in the context of a project for most non-superuser activities | 21:03 |
| *** vsaienko has joined #openstack-infra | 21:03 | |
| mordred | clarkb: with horizon, they also give you a dropdown in the UI so you can change project once you're logged in | 21:03 |
| clarkb | mordred: ya but you also always haev a default project right? | 21:03 |
| mordred | no | 21:03 |
| mordred | that's not a thing | 21:03 |
| clarkb | oh I thought that was a thing | 21:03 |
| mordred | nope | 21:03 |
| david-lyle | long ago, no longer | 21:04 |
| david-lyle | horizon puts the last project you scoped to in a cookie and attempts scope to that project | 21:04 |
| mordred | clarkb: in any case, I recommend putting the creds into a clouds.yaml once and always referring to it by name after that, as you are right, the number of things you have to get set at the start is way too much typing | 21:05 |
| mordred | and then we should get around to finishing the "please make me a new clouds.yaml entry" ... and that would could totally do some project list introspection and prompt you for things and whantot | 21:05 |
| *** florianf has quit IRC | 21:06 | |
| mordred | also - I did not realize that a normal user could get a project list - so I've learned something useful today - thanks stevemar and david-lyle | 21:06 |
| *** dizquierdo has quit IRC | 21:06 | |
| *** raildo has quit IRC | 21:08 | |
| clarkb | it would also probably help if we explained to people running clouds that the domain and project info is pretty important | 21:08 |
| clarkb | seems like half the time we spend is digging through apis or hoping horizon exists to get that info | 21:09 |
| *** jcoufal has quit IRC | 21:09 | |
| clarkb | but if you can retreive that info like horizon does then probably just a utility to get it while still using v3 api without the info would be good | 21:09 |
| mordred | clarkb: yah. couldn't agree more | 21:10 |
| *** edmondsw has quit IRC | 21:10 | |
| *** shamail has joined #openstack-infra | 21:10 | |
| *** nicolasbock has quit IRC | 21:10 | |
| mordred | clarkb: it's amazing how hard "track down my login credentials for this cloud" is | 21:10 |
| mordred | clarkb: it's mostly fine for the folks who run horizon - you can go to download the openrc file and then look inside of it | 21:10 |
| prometheanfire | AJaeger: pabelanger tested good here https://review.openstack.org/#/c/387114 | 21:10 |
| mordred | and it'll have everything but your password | 21:10 |
| clarkb | mordred: except 99% of the time its a keystone v2 openrc | 21:11 |
| mordred | for the folks who have done their own thing - man it's 'fun' | 21:11 |
| clarkb | so doesn't actually have any of the info you need to make v3 work | 21:11 |
| mordred | clarkb: that's fine. if that cloud is a keystone v2 cloud you do not need domain | 21:11 |
| clarkb | I know but I want to use v3 | 21:11 |
| mordred | nod. and agree | 21:11 |
| openstackgerrit | Merged openstack-infra/storyboard: Add users/self API https://review.openstack.org/386963 | 21:11 |
| mordred | I haven't yet experienced a cloud iwth an openrc from horizon that did not have domain info in the openrc | 21:12 |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/system-config: Add entercloudsuite cloud https://review.openstack.org/387668 | 21:12 |
| clarkb | mordred: I just found one :) entercloud does not have it | 21:12 |
| david-lyle | clarkb: horizon has download for v2.0 and v3 | 21:12 |
| *** Rockyg has quit IRC | 21:12 | |
| mordred | clarkb: awesome. and the domain there is something other than default ? | 21:12 |
| *** Rockyg has joined #openstack-infra | 21:12 | |
| vsaienko | devstack-gate team: please help to merge 3 patches in the cain starting from https://review.openstack.org/#/c/364830/ ironic multinode enablement. The patches passed ironic multinode CI https://review.openstack.org/#/c/368173/ and are blockers for ironic part. | 21:12 |
| clarkb | mordred: no its default but that isn't communicated anywhere | 21:13 |
| david-lyle | depending on the age of horizon I guess | 21:13 |
| clarkb | david-lyle: also random user thing, its annoying that api access thing are under compute rather than under some global heading | 21:13 |
| clarkb | or even under identity | 21:13 |
| stevemar | david-lyle: ++, i've seen the "download v2" and "download v3" RC file options for a while | 21:13 |
| stevemar | clarkb: true that | 21:13 |
| clarkb | ok so maybe just need a newer horizon then this magically gets nicer | 21:13 |
| stevemar | i always get confused looking for that | 21:13 |
| mordred | clarkb: oh, piddle. my entercloudsuite creds don't work anymore | 21:14 |
| mordred | I should get that fixed | 21:14 |
| david-lyle | stevemar: I keep meaning to make that more accessible | 21:14 |
| *** Rocky_g has joined #openstack-infra | 21:14 | |
| *** Rocky_g has quit IRC | 21:14 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Create new trove CI jobs https://review.openstack.org/387386 | 21:15 |
| stevemar | david-lyle: is there a bug filed for it? | 21:15 |
| david-lyle | no, it's tied up in a larger bp | 21:15 |
| stevemar | mordred + clarkb iirc zetta.io has been using non-default domains for a while | 21:15 |
| stevemar | david-lyle: extract it out :P | 21:15 |
| david-lyle | fair enough | 21:16 |
| stevemar | it seems rather isolated | 21:16 |
| stevemar | *shrugs* | 21:16 |
| mordred | stevemar: yah. same with unitedstack and citycloud | 21:16 |
| david-lyle | stevemar: I agree | 21:16 |
| *** thorst_ has quit IRC | 21:17 | |
| *** dprince has quit IRC | 21:17 | |
| *** spzala has quit IRC | 21:18 | |
| *** r-mibu has quit IRC | 21:19 | |
| *** r-mibu has joined #openstack-infra | 21:19 | |
| *** spzala has joined #openstack-infra | 21:19 | |
| *** thorst_ has joined #openstack-infra | 21:19 | |
| *** HeOS has joined #openstack-infra | 21:23 | |
| *** thorst_ has quit IRC | 21:23 | |
| jhesketh | Morning | 21:24 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 21:24 |
| *** jamesden_ has quit IRC | 21:24 | |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Refactor run-tox-with-oslo-master.sh https://review.openstack.org/387681 | 21:24 |
| clarkb | mordred: can has review on https://review.openstack.org/387668 | 21:30 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Refactor run-tox-with-oslo-master.sh https://review.openstack.org/387681 | 21:30 |
| anteaya | morning jhesketh | 21:32 |
| *** ianychoi has joined #openstack-infra | 21:33 | |
| *** ccneill has joined #openstack-infra | 21:37 | |
| ccneill | hi all, was hoping I could discuss this CR with someone(s) from the core infra team? https://review.openstack.org/#/c/386879/ | 21:38 |
| ccneill | it's a patch to add syntribos to this list of OpenStack projects, next to another OSSP project (bandit): http://docs.openstack.org/developer/openstack-projects.html | 21:38 |
| clarkb | ccneill: that is a patch to the openstack manuals repository so the docs team is repsonsible for it | 21:38 |
| ccneill | ah, thanks | 21:38 |
| ccneill | will see if I can track someone down on #openstack-docs | 21:39 |
| *** shamail has left #openstack-infra | 21:40 | |
| *** smarcet has joined #openstack-infra | 21:41 | |
| smarcet | fungi: afternoon, when u get some time, please review https://review.openstack.org/#/c/387442/ thx ! | 21:41 |
| *** rtheis has quit IRC | 21:41 | |
| *** ccneill has left #openstack-infra | 21:42 | |
| clarkb | smarcet: fungi is out until tomorrow but that change looks fine to me | 21:42 |
| *** jheroux has quit IRC | 21:42 | |
| *** abregman is now known as abregman|afl | 21:42 | |
| smarcet | clarkb: oh ok | 21:42 |
| *** abregman|afl is now known as abregman|afk | 21:42 | |
| smarcet | clarkb: i am just incressing a little the pool of max worker proccess | 21:42 |
| smarcet | clarkb: thx! | 21:43 |
| *** shardy_afk has quit IRC | 21:44 | |
| jeblair | clarkb, rcarrillocruz: cacti still seems to be dead. is someone working on that? | 21:44 |
| clarkb | jeblair: as far as I know rcarrillocruz is still working on it? | 21:45 |
| jeblair | i noticed this as i tried to review smarcet's change | 21:45 |
| jeblair | can we roll back? | 21:45 |
| *** amitgandhinz has joined #openstack-infra | 21:46 | |
| clarkb | rolling back won't help aiui because the old server is also unworking | 21:46 |
| rcarrillocruz | jeblair: the cacti server was not working days before the migration | 21:46 |
| clarkb | (this is what prompted moving to the new server, we were swapping and presumption was that this was impacting our ability to handle things there) | 21:46 |
| rcarrillocruz | i looked at it but dunno how to progress things, logs don't show stuff useful debug info | 21:46 |
| jeblair | rcarrillocruz: have you given up on it? | 21:47 |
| rcarrillocruz | except something sql related that clarkb spotted | 21:47 |
| rcarrillocruz | i'd appreciate more eyes on it, haven't been able to figure out what is | 21:48 |
| mordred | clarkb: oh - you know - we could put project_domain_id and user_domain_id into the entercloudsuite vendor entry in occ ... I'll test that the dict merging works properly | 21:48 |
| jeblair | i think this is *critical* to operations. so if there is a problem with it that can't be resolved in, say, 24 hours, i'd like us to wave the distress flag and get people working on it | 21:49 |
| *** kaisers_ has quit IRC | 21:49 | |
| jeblair | rcarrillocruz, clarkb: what do you know about the problem so far? | 21:50 |
| rcarrillocruz | jeblair: servers do send snmp stuff to cacti, but cacti is not graphing out stuff | 21:51 |
| rcarrillocruz | let me pull the thing clarkb and I spotted the other day | 21:51 |
| rcarrillocruz | sec | 21:51 |
| jeblair | rcarrillocruz: is the old server still around? | 21:51 |
| rcarrillocruz | it is | 21:52 |
| jeblair | what's the ip? | 21:52 |
| vinaypotluri | clarkb: I wanted to create a sub-project for syntribos which is a subproject of OSSP. In this link is there a way I can do it or should I just create a completely new one. Do you have any pointers on doing this ? | 21:52 |
| rcarrillocruz | sec | 21:53 |
| clarkb | vinaypotluri: I don't think launchpad has a true concept of subprojects. Nor does gerrit. You'll want to create a new projecti n both cases | 21:53 |
| *** Swami_ has joined #openstack-infra | 21:53 | |
| clarkb | vinaypotluri: being a subproject is purely an organizational thing at the openstack level | 21:53 |
| openstackgerrit | Merged openstack-infra/puppet-openstackid: Fix on PHP 503 error updated pm.max_children from 200 to 300 to avoid 503 http error. https://review.openstack.org/387442 | 21:53 |
| vinaypotluri | clarkb got it | 21:53 |
| rcarrillocruz | 104.239.135.208 | 21:54 |
| jeblair | ssh: connect to host 104.239.135.208 port 22: Connection refused | 21:54 |
| rcarrillocruz | yep, i rebooted the server for the volume detach | 21:55 |
| rcarrillocruz | in order to copy the bits to the new server i had to do a nova rescue on it | 21:55 |
| jeblair | rcarrillocruz: what was the version of cacti on the old server? | 21:56 |
| *** esikachev has joined #openstack-infra | 21:56 | |
| *** Swami has quit IRC | 21:56 | |
| openstackgerrit | Merged openstack-infra/system-config: Add entercloudsuite cloud https://review.openstack.org/387668 | 21:57 |
| rcarrillocruz | not sure, i can nova rescue it and check | 21:57 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 21:57 |
| *** tkelsey has joined #openstack-infra | 21:57 | |
| jeblair | rcarrillocruz: when you started it up on the new server, did it perform a db migration? were there any errors from that? | 21:57 |
| *** amitgandhinz has quit IRC | 21:58 | |
| rcarrillocruz | so here's the thing | 21:58 |
| *** xyang1 has quit IRC | 21:58 | |
| rcarrillocruz | i created the new VM | 21:58 |
| rcarrillocruz | attached the volume | 21:58 |
| rcarrillocruz | ran puppet | 21:58 |
| rcarrillocruz | then enter the UI | 21:58 |
| rcarrillocruz | and the UI prompted me for the wizard to bring up a new Cacti | 21:59 |
| rcarrillocruz | so I nuked all mysql bits | 21:59 |
| rcarrillocruz | /var/lib/mysql | 21:59 |
| rcarrillocruz | copied over stuff from old server to it | 21:59 |
| rcarrillocruz | plus /etc/cacti/debian | 21:59 |
| rcarrillocruz | which regardless | 21:59 |
| *** Swami_ has quit IRC | 21:59 | |
| rcarrillocruz | was pointing to a Trove instance | 21:59 |
| rcarrillocruz | it looks as the cacti server initially had a local DB | 22:00 |
| rcarrillocruz | and eventually it was migrated to Trove | 22:00 |
| rcarrillocruz | i asked around but nobody seemed to know the story behind that | 22:00 |
| *** esikachev has quit IRC | 22:01 | |
| amrith | rcarrillocruz, is it a trove question that you have? just saw the word mentioned; please ping me if I can be of any help | 22:01 |
| rcarrillocruz | jeblair: this is what the cacti server uses for DB (from /etc/cacti/debian.php) : | 22:01 |
| rcarrillocruz | 7d7792ec5155c144d033e3b0bb1e01884815bffa.rackspaceclouddb.com | 22:01 |
| *** inc0 has quit IRC | 22:01 | |
| *** tkelsey has quit IRC | 22:02 | |
| rcarrillocruz | jeblair: this is the only suspicious error I see on the cacti server http://paste.openstack.org/show/586044/ | 22:02 |
| jeblair | rcarrillocruz: yeah, that makes me wonder about database migrations. it would be useful to know the old version | 22:02 |
| rcarrillocruz | i can nova rescue it | 22:02 |
| rcarrillocruz | sec | 22:02 |
| *** hichihara has quit IRC | 22:03 | |
| *** amitgandhinz has joined #openstack-infra | 22:03 | |
| *** marst has quit IRC | 22:05 | |
| *** rcernin has quit IRC | 22:06 | |
| *** madhuvishy has quit IRC | 22:06 | |
| *** madhuvishy has joined #openstack-infra | 22:07 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Combine ZKTestCase with DBTestCase https://review.openstack.org/383962 | 22:08 |
| *** amitgandhinz has quit IRC | 22:08 | |
| *** amitgandhinz has joined #openstack-infra | 22:09 | |
| *** weshay is now known as weshay_bbiab | 22:09 | |
| rcarrillocruz | so | 22:09 |
| rcarrillocruz | rescued server | 22:09 |
| rcarrillocruz | mount hard drive on /mnt (as rescue boots on a ramdisk) | 22:10 |
| rcarrillocruz | and /mnt/var/lib/apt/status shows: | 22:10 |
| rcarrillocruz | erm /mnt/var/lib/dpkg/status shows: | 22:10 |
| rcarrillocruz | http://paste.openstack.org/show/586049/ | 22:11 |
| rcarrillocruz | which is the same on the new cacti | 22:12 |
| rcarrillocruz | http://paste.openstack.org/show/586050/ | 22:12 |
| rcarrillocruz | fwiw, cacti stopped working weeks before the migration | 22:12 |
| rcarrillocruz | so issue occurred before that, which might explain why we see the same issue on the new cacti: UI loads up, shows servers and all but no graphed data | 22:13 |
| rcarrillocruz | jeblair, clarkb : ^ | 22:13 |
| jeblair | rcarrillocruz: i see the data ending on october 6 | 22:14 |
| *** larainema has quit IRC | 22:14 | |
| rcarrillocruz | yeah, the migration happened on Thursday 13th | 22:15 |
| jeblair | do the log files on the old server have the same sql error? | 22:15 |
| *** larainema has joined #openstack-infra | 22:15 | |
| rcarrillocruz | yeah | 22:16 |
| rcarrillocruz | http://paste.openstack.org/show/586051/ | 22:16 |
| rcarrillocruz | however, note the date | 22:16 |
| rcarrillocruz | way before | 22:16 |
| rcarrillocruz | i believe that error message might be a red herring | 22:17 |
| *** matt-borland has quit IRC | 22:17 | |
| jeblair | yeah could eb | 22:17 |
| mordred | "graph_tree_id= " | 22:17 |
| *** spzala has quit IRC | 22:17 | |
| mordred | in the middle of that | 22:17 |
| mordred | makes that a pretty broken sql query | 22:17 |
| *** smarcet has quit IRC | 22:17 | |
| mordred | of course, the error message is talking about a SQL Cell, so who knows | 22:18 |
| jeblair | mordred: yeah, i haven't found a 'graph_tree_id' with an empty value yet... but i just may not have found it | 22:18 |
| rcarrillocruz | fwiw, also running the create_graphs.sh script (the one the manifest puts on the crontab) runs completely | 22:18 |
| mordred | jeblair: I particularly like: AND order_key LIKE '%' | 22:18 |
| rcarrillocruz | takes a while | 22:18 |
| rcarrillocruz | but finishes, without something pointing to a problem | 22:19 |
| *** EricGonczer_ has quit IRC | 22:19 | |
| *** gyee has joined #openstack-infra | 22:19 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:19 | |
| rcarrillocruz | amrith: thx, missed your message earlier, looks like it's not a trove per-se problem | 22:20 |
| *** vsaienko has quit IRC | 22:20 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 22:22 |
| *** john-davidge has joined #openstack-infra | 22:22 | |
| *** gouthamr has quit IRC | 22:23 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Initial support for ansible-playbook https://review.openstack.org/385608 | 22:23 |
| *** gentoo_ has quit IRC | 22:23 | |
| jeblair | the rrd files have timestamps of either oct 6 or 13 | 22:24 |
| *** marst has joined #openstack-infra | 22:24 | |
| *** gentoo_ has joined #openstack-infra | 22:24 | |
| *** gentoo_ has quit IRC | 22:24 | |
| *** gentoo_ has joined #openstack-infra | 22:24 | |
| *** gentoo_ has quit IRC | 22:24 | |
| *** gentoo_ has joined #openstack-infra | 22:25 | |
| *** gentoo_ has quit IRC | 22:25 | |
| jeblair | the directory is writable. running queries in debug mode seems to work. so it seems like it's not writing data to the rrd files. | 22:25 |
| ianw | did we know about this dib build error today? -> error: Unable to append to /opt/dib_cache/source-repositories/deb_aodh_bc17bf0f0c25c5ce0b752ceafeb6518604f7fd58/.git/logs/refs/heads/master: Permission denied | 22:25 |
| *** gentoo_ has joined #openstack-infra | 22:25 | |
| *** gentoo_ has quit IRC | 22:25 | |
| *** gentoo_ has joined #openstack-infra | 22:26 | |
| *** gentoo_ has quit IRC | 22:26 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 22:26 |
| rcarrillocruz | yeah, that makes sense, i remember the other day running the create_graphs.sh script multiple times and it reported no rrd files being uipdated | 22:26 |
| pabelanger | ianw: that was me | 22:26 |
| rcarrillocruz | let me re-run it so i can paste it here | 22:26 |
| pabelanger | ianw: I've fixed it | 22:26 |
| *** amitgandhinz has quit IRC | 22:26 | |
| jeblair | rcarrillocruz: that's not necessary | 22:26 |
| jeblair | rcarrillocruz: that just updates cacti to create new devices, data sources, and graphs | 22:26 |
| jeblair | they all seem to be there | 22:26 |
| *** john-davidge has quit IRC | 22:27 | |
| *** sdake_ has quit IRC | 22:27 | |
| pabelanger | ianw: https://review.openstack.org/#/c/386951/ is what we landed today | 22:27 |
| jeblair | the poller is reponsible for performing snmp get calls and adding info to rrdtool | 22:27 |
| pabelanger | ianw: the permission denied was me manually testing it | 22:27 |
| rcarrillocruz | ok | 22:28 |
| anteaya | if there is a channel op with a moment, the topic in #openstack-meeting could use a refresh | 22:28 |
| pabelanger | sure, I can try | 22:29 |
| *** asselin__ has quit IRC | 22:29 | |
| pleia2 | sorry, took care of it | 22:30 |
| *** sdake has joined #openstack-infra | 22:30 | |
| pleia2 | pabelanger: for future reference, can just /msg chanserv topic #openstack-meeting OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings | 22:30 |
| *** EricGonczer_ has joined #openstack-infra | 22:30 | |
| *** Swami has joined #openstack-infra | 22:31 | |
| anteaya | pabelanger: pleia2 thank you | 22:32 |
| pabelanger | pleia2: ah, cool. I was trying to figure out what it was before | 22:32 |
| pabelanger | thanks | 22:33 |
| *** lykinsbd has quit IRC | 22:33 | |
| *** cardeois has quit IRC | 22:33 | |
| jeblair | mordred: i don't think cell is a typo, i think that's part of a data structure it builds for displaying the tree | 22:34 |
| mordred | jeblair: ahhhh | 22:34 |
| mordred | jeblair: ok. that makes sense | 22:34 |
| *** Swami_ has joined #openstack-infra | 22:36 | |
| *** gordc has quit IRC | 22:36 | |
| ianw | pabelanger: cool, i'll go back to init.d archaeology then :) | 22:38 |
| *** marst has quit IRC | 22:38 | |
| *** Swami has quit IRC | 22:39 | |
| *** sdake_ has joined #openstack-infra | 22:40 | |
| *** rbrndt has quit IRC | 22:41 | |
| jeblair | rcarrillocruz, mordred: create_graphs.sh was trying to add hosts to the 'Infra Cloud Vanilla' tree, but there was only 'Infra Cloud West'. i renamed the tree in cacti. | 22:42 |
| rcarrillocruz | eugh | 22:43 |
| *** panda is now known as panda|Zz | 22:43 | |
| *** sdake has quit IRC | 22:44 | |
| jeblair | rcarrillocruz: i can reproduce the snmp timeouts from the hosts that show up in the log file with manual snmp commands | 22:45 |
| jeblair | rcarrillocruz: picking a couple of those at random suggest that they haven't reloaded their firewalls | 22:46 |
| *** marst has joined #openstack-infra | 22:46 | |
| jeblair | rcarrillocruz: can you use ansible to run an iptables restart across all of our hosts? | 22:46 |
| rcarrillocruz | i assume we have no pattern to run against, rihgt? cos i'm seens 'snmp walk timeouts against infracloud, mirrors, puppetdb, etc | 22:47 |
| rcarrillocruz | when you mean all you mean *all*, right? | 22:47 |
| jeblair | rcarrillocruz: yep. my guess is that it's only working for the hosts that happen to have restarted their firewalls... and yes -- all hosts. | 22:47 |
| clarkb | I think the service has a different name on centos though | 22:47 |
| clarkb | so keep thati n mind when you do service restarts | 22:47 |
| rcarrillocruz | yeah, thinking on the variance per host | 22:48 |
| rcarrillocruz | i think i can pull per ansible_distribution with facts | 22:48 |
| rcarrillocruz | sec | 22:48 |
| clarkb | rcarrillocruz: git*.openstack.org are the only centos hosts iirc | 22:48 |
| jeblair | pbr | 22:49 |
| clarkb | rcarrillocruz: so you could also just glob on the limit | 22:49 |
| jeblair | er | 22:49 |
| jeblair | pbx | 22:49 |
| *** annegentle has quit IRC | 22:49 | |
| jeblair | or did we change that? | 22:49 |
| clarkb | jeblair: no pbx should be ubuntu now after we updated it | 22:49 |
| jeblair | yeah, so just git | 22:49 |
| clarkb | (centos6 had packages but centos7 didn't and in that time ubuntu had grown pacakges so we just switched to ubuntu) | 22:49 |
| *** Swami__ has joined #openstack-infra | 22:52 | |
| rcarrillocruz | on it | 22:52 |
| rcarrillocruz | http://paste.openstack.org/show/586057/ | 22:52 |
| rcarrillocruz | hmm, so on ubuntu is iptables-persistent it seems | 22:53 |
| *** marst has quit IRC | 22:53 | |
| clarkb | rcarrillocruz: yes that sounds right | 22:53 |
| *** asselin__ has joined #openstack-infra | 22:54 | |
| *** gildub has joined #openstack-infra | 22:55 | |
| *** Swami_ has quit IRC | 22:55 | |
| *** esikachev has joined #openstack-infra | 22:57 | |
| rcarrillocruz | done | 22:57 |
| rcarrillocruz | so i teed the iptabels-persistent restart on puppetmater to /tmp/iptables_restart_ubuntu.out | 22:57 |
| rcarrillocruz | jeblair: can you retry the snmp commands as you have it on your bash history and see if you timeout again | 22:58 |
| rcarrillocruz | ? | 22:58 |
| jeblair | rcarrillocruz: still doesn't work: snmpwalk -v2c -c public lists.openstack.org '.1.3.6.1.2.1.1.3.0' | 22:59 |
| rcarrillocruz | well | 22:59 |
| rcarrillocruz | give me a sec | 22:59 |
| rcarrillocruz | cos some hosts could not be ssh'd in | 22:59 |
| rcarrillocruz | let me see if lists is one of them | 22:59 |
| *** gouthamr has joined #openstack-infra | 22:59 | |
| rcarrillocruz | "msg": "Failed to connect to the host via ssh.", | 23:00 |
| rcarrillocruz | :-) | 23:00 |
| rcarrillocruz | probably key was not accepted or something , sec | 23:00 |
| rcarrillocruz | huh, i can't connect to that machine from puppetmater at all | 23:01 |
| *** markvoelker_ has quit IRC | 23:01 | |
| rcarrillocruz | seems to timeout | 23:01 |
| jeblair | i can locally | 23:01 |
| jeblair | rcarrillocruz: try both v4 and v6 addr? | 23:01 |
| *** esikachev has quit IRC | 23:01 | |
| rcarrillocruz | yeah, weird, i can from my laptop, cannot from puppetmaster... i'll try v4 | 23:02 |
| rcarrillocruz | ipv4 worked | 23:02 |
| rcarrillocruz | can you try now? | 23:02 |
| jeblair | rcarrillocruz: still no, but i wonder if it's using v6 | 23:03 |
| rcarrillocruz | :/ | 23:03 |
| jeblair | i will try snmp with both | 23:03 |
| jeblair | nope | 23:04 |
| rcarrillocruz | sigh | 23:04 |
| *** zz_dimtruck is now known as dimtruck | 23:04 | |
| jeblair | rcarrillocruz: i can connect to lists.o.o from puppetmaster over v6 | 23:05 |
| clarkb | does iptables show only the old rules maybe? | 23:05 |
| rcarrillocruz | jeblair: when i couldn't i was sshing with name | 23:05 |
| clarkb | sudo iptables -L -n and ip6tables -L -n should show you the rules | 23:05 |
| jeblair | yes, i'm pretty sure iptables has not been restarted on the host | 23:06 |
| rcarrillocruz | i did minutes ago? http://paste.openstack.org/show/586059/ | 23:07 |
| clarkb | maybe the on disk rules haven't been updated either? | 23:07 |
| jeblair | ACCEPT udp -- 104.239.135.208 0.0.0.0/0 udp dpt:161 | 23:07 |
| jeblair | that's the old ip | 23:07 |
| rcarrillocruz | yeah | 23:07 |
| rcarrillocruz | 206 is the new one | 23:07 |
| jeblair | oh yeah, the rules on disk are broken | 23:08 |
| jeblair | -A openstack-INPUT -m udp -p udp --dport 161 -s 104.239.135.208 -j ACCEPT | 23:08 |
| rcarrillocruz | exactly | 23:08 |
| rcarrillocruz | -A openstack-INPUT -m udp -p udp --dport 161 -s 104.239.135.208 -j ACCEPT | 23:08 |
| jeblair | i think puppet is broken on that host | 23:08 |
| rcarrillocruz | eugh | 23:08 |
| rcarrillocruz | so my hunch is | 23:08 |
| rcarrillocruz | as ansible could not connect to this server | 23:08 |
| rcarrillocruz | it never got on disk puppet updates | 23:08 |
| rcarrillocruz | thus old iptables | 23:08 |
| jeblair | compute008 is also not responding | 23:09 |
| *** dalgaaf has quit IRC | 23:09 | |
| jeblair | 016 and 025 | 23:09 |
| rcarrillocruz | there may be non-functional, i can check that tomorrow by doing a cross-check | 23:10 |
| rcarrillocruz | i'm worried that we can run ansible commands against a bunch of control plane servers | 23:10 |
| rcarrillocruz | cos that means, they haven't got system-config updtes | 23:10 |
| jeblair | yeah, not good | 23:10 |
| *** baoli has joined #openstack-infra | 23:10 | |
| rcarrillocruz | like the iptables change | 23:10 |
| *** sdague has quit IRC | 23:10 | |
| rcarrillocruz | jeblair: i'm running remote_puppet_else on lists.openstack.org | 23:12 |
| rcarrillocruz | then let's try your snmp test again | 23:12 |
| rcarrillocruz | 'should' work as getting the new iptables conf | 23:13 |
| rcarrillocruz | eughhhh | 23:13 |
| rcarrillocruz | puppet failures | 23:13 |
| rcarrillocruz | it doesn't converge | 23:13 |
| rcarrillocruz | pasting | 23:13 |
| *** kgiusti has joined #openstack-infra | 23:13 | |
| rcarrillocruz | (from lists.openstack.org syslog) | 23:13 |
| *** kgiusti has left #openstack-infra | 23:14 | |
| rcarrillocruz | http://paste.openstack.org/show/586060/ | 23:14 |
| *** baoli has quit IRC | 23:15 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Add a nodepool to zuul-dev.o.o https://review.openstack.org/387579 | 23:16 |
| jeblair | rcarrillocruz: i don't know what that is | 23:17 |
| jeblair | infra-root: ^ | 23:17 |
| mordred | looking | 23:18 |
| rcarrillocruz | i'm not sure if related, but recently puppet-pacemaker was added to modules.env | 23:18 |
| rcarrillocruz | cos i frankly doubt lists.openstack.org use pacemaker | 23:18 |
| jeblair | why? | 23:18 |
| rcarrillocruz | it must be some issue with puppet loading all the modules it finds available on /etc/puppet/modules | 23:19 |
| mordred | in support of "add ability for folks re-using infra-cloud puppet to have HA" | 23:19 |
| rcarrillocruz | yeah, commit c6c192a49df6a473e0bbc9535293f305dd551b1f | 23:19 |
| rcarrillocruz | that was discussed in mid cycle | 23:19 |
| rcarrillocruz | looks like the module version may be broken? | 23:20 |
| pabelanger | lists.o.o is still precise too, IIRC | 23:20 |
| mordred | perhaps we should revert that for now, since it's breaking production things | 23:20 |
| pabelanger | so, likely older version of ruby | 23:20 |
| clarkb | if puppet can't load its providers it will fail to run | 23:20 |
| mordred | yah. | 23:20 |
| clarkb | and that is what appears to be happening there, module has providers in there that break the main process | 23:20 |
| rcarrillocruz | yeah , i vote for revert | 23:21 |
| clarkb | also was that the module that wouldn't work on precise so we were only going to add it to infracloud's module list? | 23:21 |
| clarkb | I want to say it couldn't merge due to the precise job | 23:21 |
| clarkb | so curious how it got past that and then broke | 23:21 |
| jeblair | that change is really broken | 23:21 |
| mordred | yah - I'd like to know how that commit got past the gate | 23:21 |
| jeblair | that basically hacks around the testing infrastructure | 23:22 |
| jeblair | mordred: ^ | 23:22 |
| jeblair | +# TODO - Yolanda: temporary hack, do not install pacemaker if we are running on precise | 23:22 |
| jeblair | +# This needs to be removed when we stop gating on precise on puppet-apply | 23:22 |
| jeblair | i mean, it says it right there | 23:22 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Revert "As initial step to deploy with HA, start using pacemaker module" https://review.openstack.org/387714 | 23:22 |
| jeblair | that code runs on the puppetmaster | 23:22 |
| jeblair | so that prevents it from being installed only on the precise apply test | 23:22 |
| jeblair | it doesn't prevent it from being installed on the puppetmaster and copied to all our hosts | 23:23 |
| mordred | yes. I agree with that assessment | 23:23 |
| clarkb | ok good that we understand how it does/doesn't work | 23:23 |
| clarkb | so ya revert is my vote for now | 23:23 |
| rcarrillocruz | i pushed ^ | 23:23 |
| *** jianghuaw-m has joined #openstack-infra | 23:24 | |
| clarkb | we will likely need to manually remove the module | 23:24 |
| *** jianghuaw-m has quit IRC | 23:24 | |
| clarkb | I don't think our module installer will remove things that go away | 23:24 |
| mordred | I can do that | 23:24 |
| mordred | done | 23:24 |
| clarkb | I have +2'd change figured I would let jeblair review before approval happens ( since he was debugging) | 23:24 |
| jeblair | mordred: you may need to do that after it lands | 23:24 |
| jeblair | clarkb: please just approve | 23:24 |
| clarkb | ok | 23:24 |
| clarkb | thats done | 23:25 |
| mordred | jeblair: yah. I'll up-arrow-enter if need be | 23:25 |
| jeblair | that's still several layers removed from what i'm debugging | 23:25 |
| jeblair | i have stopped apache on cacti01 | 23:26 |
| rcarrillocruz | so,when we fix all this, i wonder if we could have a look at ARA or whatever to have a dashboard of our control plane ansible runs. Per the commit of that puppet-pacemaker thing, it means puppet has not run in a long time | 23:26 |
| *** amitgandhinz has joined #openstack-infra | 23:27 | |
| rcarrillocruz | we really should have a panel to red flag ansible not running on servers | 23:27 |
| clarkb | rcarrillocruz: in theory that is supposed to be puppetboard but its been broken for a while (though nibalizer recently pciekd up work to upgrade puppetboard iirc) | 23:27 |
| clarkb | rcarrillocruz: ansible did run there fwiw, puppet is what failed | 23:27 |
| clarkb | if I am understanding the error message correclty | 23:27 |
| mordred | I will second that we need _something_ - I do not have specific opinions on what that something should be at this point | 23:27 |
| rcarrillocruz | yeah, but it would have caught the stderr of the ansible run | 23:28 |
| rcarrillocruz | anyway, i agree, we need something to warn 'stuff not running on server foo' | 23:28 |
| clarkb | mordred: ya. I guess I should rephrase. I do not want to run two services that don't work to solve this problem :) | 23:28 |
| clarkb | we should run one and have it function | 23:28 |
| mordred | clarkb: yes. I totally agree with that | 23:28 |
| mordred | and whichever one service that is is the approach that I vote for | 23:28 |
| rcarrillocruz | also | 23:29 |
| jeblair | i'm rebuilding cacti's poller cache. it takes a while since we have 58952 data sources. | 23:29 |
| rcarrillocruz | many servers we don't have that problem, of ansible-puppet failing | 23:29 |
| rcarrillocruz | so iptables change landed | 23:29 |
| *** Apoorva has quit IRC | 23:29 | |
| rcarrillocruz | but iptables was not resttarted | 23:30 |
| rcarrillocruz | that's a puppet class bug to me | 23:30 |
| rcarrillocruz | somewhere it needs a subscribe/refresh | 23:30 |
| *** Apoorva has joined #openstack-infra | 23:30 | |
| *** jamesden_ has joined #openstack-infra | 23:30 | |
| *** amotoki has quit IRC | 23:31 | |
| *** jamesde__ has joined #openstack-infra | 23:32 | |
| *** Apoorva has quit IRC | 23:34 | |
| *** jamesden_ has quit IRC | 23:35 | |
| openstackgerrit | Merged openstack-infra/system-config: Revert "As initial step to deploy with HA, start using pacemaker module" https://review.openstack.org/387714 | 23:35 |
| *** rajinir has quit IRC | 23:36 | |
| *** Sukhdev has quit IRC | 23:36 | |
| rcarrillocruz | mordred: what did you run to remove the pacemaker module from nodes? | 23:38 |
| mordred | rcarrillocruz: I only removed it from puppetmaster | 23:38 |
| clarkb | rcarrillocruz: I think you can just rm the dir in /etc/puppet/modules | 23:38 |
| *** kaisers_ has joined #openstack-infra | 23:38 | |
| rcarrillocruz | i kicked ansible-puppet and got the same failure, had to manually remove the /etc/puppet/modules/pacemaker folder from lists.openstack.org | 23:38 |
| mordred | gotcha. so we may need to do that everywhere then | 23:38 |
| jeblair | rcarrillocruz: when is the first time "Maximum runtime of 298 seconds exceeded. Exiting" shows up in the cacti log on the old server? | 23:38 |
| clarkb | oh if our rsync doesn't delete ya | 23:38 |
| rcarrillocruz | ++ | 23:38 |
| rcarrillocruz | jeblair: sec, let me grep | 23:39 |
| mordred | rcarrillocruz: I can do that so you can work with jeblair on the next things | 23:39 |
| mordred | ansible '*' -m shell -a 'rm -rf /etc/puppet/modules/pacemaker' | 23:39 |
| *** mriedem has joined #openstack-infra | 23:39 | |
| rcarrillocruz | jeblair: cacti.log:10/09/2016 06:44:59 AM - POLLER: Poller[0] Maximum runtime of 298 seconds exceeded. Exiting. | 23:40 |
| mordred | does that look good to people? | 23:40 |
| rcarrillocruz | yeah | 23:40 |
| jeblair | rcarrillocruz: does the log go back further than than? | 23:40 |
| jeblair | mordred: yep | 23:40 |
| rcarrillocruz | so, the puppet just ran fine on lists.openstack.org | 23:40 |
| rcarrillocruz | converged | 23:40 |
| *** chlong has joined #openstack-infra | 23:40 | |
| rcarrillocruz | we may want to do a remote_puppet_else when mordred runs ^ | 23:41 |
| jeblair | i'm suspecting that we may have either too many hosts or too many failures for our current poller configuration. it's possible that if we eliminate the failures, it will run within the timeout. it's also possible that we have too many hosts and even with no failures it would take too long. i think if it takes too long, the poller doesn't update the rrd files (i think it does that at the end) | 23:41 |
| rcarrillocruz | jeblair: it goes further | 23:41 |
| rcarrillocruz | let me paste the latest | 23:41 |
| jeblair | rcarrillocruz: sorry, i meant older | 23:41 |
| jeblair | rcarrillocruz: what's the oldest date in the log | 23:41 |
| mordred | that's running | 23:41 |
| rcarrillocruz | cacti.log:10/09/2016 10:40:00 AM - POLLER: Poller[0] Maximum runtime of 298 seconds exceeded. Exiting. | 23:41 |
| rcarrillocruz | same day, but later | 23:41 |
| jeblair | rcarrillocruz: does the log go *earlier* than 10/09? | 23:42 |
| rcarrillocruz | ah, the oldest is the one i pasted | 23:42 |
| rcarrillocruz | earlier | 23:42 |
| jeblair | right, but are there *any* log entries older than 10/09? | 23:42 |
| rcarrillocruz | nope | 23:42 |
| *** kaisers_ has quit IRC | 23:42 | |
| jeblair | okay so that doesn't tell us much, we'll have to assume that 10/06 is when that started | 23:43 |
| rcarrillocruz | well | 23:43 |
| rcarrillocruz | i'm lying | 23:43 |
| rcarrillocruz | i was grepping | 23:43 |
| rcarrillocruz | and just getting results from cacti.log | 23:43 |
| *** amotoki has joined #openstack-infra | 23:44 | |
| rcarrillocruz | there are earlier 'maximum runtime blah' on cacti.log.*.gz | 23:44 |
| mordred | ok. module removal done | 23:44 |
| jeblair | rcarrillocruz: what's the earliest? | 23:44 |
| mordred | I shall now run remote_puppet_else | 23:44 |
| rcarrillocruz | 05/25/2016 *any* logging | 23:45 |
| rcarrillocruz | you need earliest for 'Maximum runtime' ? | 23:45 |
| jeblair | yep | 23:45 |
| rcarrillocruz | oh | 23:46 |
| rcarrillocruz | zgrep | 23:46 |
| mordred | running remote_puppet_else | 23:46 |
| rcarrillocruz | :D | 23:46 |
| rcarrillocruz | sec | 23:46 |
| *** sdake has joined #openstack-infra | 23:46 | |
| jeblair | oh neat. apache started again. does puppet autostart it? | 23:46 |
| mordred | The authenticity of host '2001:4800:7818:101:be76:4eff:fe04:4820 (2001:4800:7818:101:be76:4eff:fe04:4820)' can't be established. | 23:46 |
| jeblair | (i hope that doesn't corrupt what i'm doing) | 23:46 |
| mordred | jeblair: I aborted the run - but the run has not gotten to running puppet | 23:47 |
| mordred | jeblair: would you like me to add cacti to the emergency file ? | 23:47 |
| rcarrillocruz | jeblair, zgrep still ongoing... | 23:47 |
| mordred | oh. it's in the emergency file already | 23:48 |
| mordred | jeblair: I do not know what would have caused apache to autostart | 23:48 |
| jeblair | huh. | 23:48 |
| mordred | s/autostart/start/ | 23:48 |
| jeblair | well, i disabled the poller before i started this anyway, so hopefully is okay | 23:48 |
| *** xarses has quit IRC | 23:49 | |
| jeblair | i'm going to increase the number of poller processes it runs; it should be able to parallelize a bit. | 23:49 |
| * mordred is going to hold off on running remote_puppet_else for now just in case | 23:49 | |
| jeblair | 1 -> 4 | 23:49 |
| nibalizer | clarkb: part of the issue is those uuid hosts | 23:49 |
| jeblair | the rebuild is finished | 23:49 |
| nibalizer | so id like a better andible openstack inventory | 23:50 |
| *** sdake_ has quit IRC | 23:50 | |
| nibalizer | but puppetboard totally shows you when hosts havent run in a while, they show up as unreported | 23:50 |
| jeblair | mordred: all clear from me | 23:50 |
| *** Apoorva has joined #openstack-infra | 23:51 | |
| rcarrillocruz | jeblair: earliest 'maximum runtime' log | 23:51 |
| rcarrillocruz | 09/18/2016 06:35:33 AM - POLLER: Poller[0] Maximum runtime of 298 seconds exceeded. Exiting. | 23:51 |
| *** Goneri has quit IRC | 23:53 | |
| *** tiswanso has quit IRC | 23:53 | |
| jeblair | i will manually update the iptables rules on wiki-upgrade-test (aka wiki.o.o) | 23:54 |
| jeblair | since it's still disabled in puppet | 23:54 |
| rcarrillocruz | neat, now cacti UI shows vanilla hosts under vanilla tree | 23:55 |
| jeblair | cool, if we remove them from the main tree they should stay gone | 23:55 |
| clarkb | jeblair: how does one toggle that parallelization parameter? | 23:56 |
| clarkb | is it a row in the settings table? | 23:56 |
| jeblair | clarkb: http://cacti.openstack.org/cacti/settings.php?tab=poller | 23:56 |
| *** esikachev has joined #openstack-infra | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
