| *** dingyichen has joined #openstack-infra | 00:00 | |
| ianw | jeblair: yeah, i don't seem to be able to ... also seeing a lot of "2017-08-23 10:02:13,183 Offline due to: ('Connection aborted.', BadStatusLine("''",))" | 00:02 |
|---|---|---|
| *** aeng has quit IRC | 00:03 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add release-openstack-python to openstack-dev/sandbox https://review.openstack.org/496447 | 00:04 |
| pabelanger | jeblair: mordred: ^ if you don't mind. project-config change for release pipeline on openstack-dev/sandbox | 00:04 |
| *** gildub has quit IRC | 00:07 | |
| *** yamamoto_ has joined #openstack-infra | 00:15 | |
| *** efried has quit IRC | 00:15 | |
| *** dmellado has quit IRC | 00:15 | |
| *** aeng has joined #openstack-infra | 00:16 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Make bootstrap copying a playbook https://review.openstack.org/495928 | 00:17 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Move logdir relocation to a playbook https://review.openstack.org/495929 | 00:17 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Move logdir relocation to a playbook https://review.openstack.org/495929 | 00:18 |
| *** signed8bit_Zzz is now known as signed8b_ | 00:18 | |
| *** signed8b_ has quit IRC | 00:18 | |
| *** signed8bit has joined #openstack-infra | 00:19 | |
| *** dmellado has joined #openstack-infra | 00:19 | |
| *** yamamoto_ has quit IRC | 00:20 | |
| *** mattmceuen has joined #openstack-infra | 00:22 | |
| *** jamesmcarthur has joined #openstack-infra | 00:23 | |
| *** efried has joined #openstack-infra | 00:25 | |
| *** dave-mccowan has joined #openstack-infra | 00:25 | |
| *** makowals has quit IRC | 00:30 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add release-openstack-python to openstack-dev/sandbox https://review.openstack.org/496447 | 00:34 |
| openstackgerrit | Merged openstack-infra/puppet-reviewday master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495636 | 00:36 |
| openstackgerrit | Merged openstack-infra/puppet-project_config master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495631 | 00:37 |
| openstackgerrit | Merged openstack-infra/puppet-redis master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495634 | 00:37 |
| openstackgerrit | Merged openstack-infra/puppet-releasestatus master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495635 | 00:37 |
| openstackgerrit | Merged openstack-infra/puppet-puppet master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495633 | 00:37 |
| *** aeng has quit IRC | 00:38 | |
| *** signed8bit is now known as signed8bit_Zzz | 00:39 | |
| openstackgerrit | Merged openstack-infra/puppet-ptgbot master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495632 | 00:40 |
| openstackgerrit | Merged openstack-infra/puppet-planet master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495630 | 00:40 |
| openstackgerrit | Merged openstack-infra/puppet-mediawiki master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495615 | 00:40 |
| openstackgerrit | Merged openstack-infra/puppet-phabricator master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495628 | 00:42 |
| openstackgerrit | Merged openstack-infra/puppet-os_client_config master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495625 | 00:42 |
| openstackgerrit | Merged openstack-infra/puppet-pgsql_backup master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495627 | 00:42 |
| openstackgerrit | Merged openstack-infra/puppet-mysql_backup master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495619 | 00:42 |
| openstackgerrit | Merged openstack-infra/puppet-openafs master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495622 | 00:42 |
| openstackgerrit | Merged openstack-infra/puppet-mailman master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495614 | 00:42 |
| *** makowals has joined #openstack-infra | 00:43 | |
| *** gildub has joined #openstack-infra | 00:44 | |
| *** dave-mccowan has quit IRC | 00:44 | |
| *** aeng has joined #openstack-infra | 00:44 | |
| openstackgerrit | Merged openstack-infra/puppet-bandersnatch master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495580 | 00:47 |
| openstackgerrit | Merged openstack-infra/puppet-kerberos master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495607 | 00:47 |
| openstackgerrit | Merged openstack-infra/puppet-odsreg master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495621 | 00:47 |
| openstackgerrit | Merged openstack-infra/puppet-mqtt_statsd master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495618 | 00:47 |
| openstackgerrit | Merged openstack-infra/puppet-openstackid master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495624 | 00:47 |
| openstackgerrit | Merged openstack-infra/puppet-nodepool master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495620 | 00:47 |
| openstackgerrit | Merged openstack-infra/puppet-lpmqtt master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495613 | 00:47 |
| openstackgerrit | Merged openstack-infra/puppet-mosquitto master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495617 | 00:47 |
| *** yamahata has quit IRC | 00:47 | |
| *** iyamahat has quit IRC | 00:48 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Build tarballs / wheels for release-openstack-python https://review.openstack.org/496450 | 00:49 |
| *** mriedem1 has joined #openstack-infra | 00:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Build tarballs / wheels for release-openstack-python https://review.openstack.org/496450 | 00:51 |
| *** MasterOfBugs has quit IRC | 00:51 | |
| openstackgerrit | Merged openstack-infra/puppet-logstash master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495612 | 00:51 |
| *** mriedem has quit IRC | 00:51 | |
| pabelanger | jeblair: mordred: ^updates needed for release-openstack-python jobs | 00:51 |
| *** makowals has quit IRC | 00:53 | |
| *** vhosakot has quit IRC | 00:56 | |
| *** cshastri has joined #openstack-infra | 00:57 | |
| *** zhurong has joined #openstack-infra | 00:58 | |
| *** dave-mccowan has joined #openstack-infra | 01:00 | |
| *** gmann has quit IRC | 01:00 | |
| *** gmann has joined #openstack-infra | 01:01 | |
| *** priteau has joined #openstack-infra | 01:03 | |
| *** efried has quit IRC | 01:03 | |
| *** funzo has joined #openstack-infra | 01:04 | |
| *** makowals has joined #openstack-infra | 01:06 | |
| *** priteau has quit IRC | 01:07 | |
| *** spligak has quit IRC | 01:08 | |
| *** funzo has quit IRC | 01:08 | |
| *** Swami has quit IRC | 01:09 | |
| *** mriedem1 is now known as mriedem | 01:10 | |
| *** signed8bit_Zzz is now known as signed8bit | 01:10 | |
| *** signed8bit is now known as signed8bit_Zzz | 01:11 | |
| *** efried has joined #openstack-infra | 01:13 | |
| mriedem | clarkb: since the conductor split thing in devstack in pike, this would be needed to get logs indexed for anything in conductor https://review.openstack.org/#/c/491955/ | 01:14 |
| *** dave-mccowan has quit IRC | 01:14 | |
| *** dougwig has quit IRC | 01:16 | |
| *** yamamoto_ has joined #openstack-infra | 01:16 | |
| *** mattmceuen has quit IRC | 01:18 | |
| *** dave-mccowan has joined #openstack-infra | 01:18 | |
| *** aeng has quit IRC | 01:18 | |
| *** aeng has joined #openstack-infra | 01:19 | |
| *** mriedem has quit IRC | 01:20 | |
| clarkb | ok I'll take a look after dinner | 01:20 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Remove/migrate Fedora 25 jobs https://review.openstack.org/496456 | 01:23 |
| *** ijw has joined #openstack-infra | 01:23 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul-jobs master: Role to copy the build ssh key to other users https://review.openstack.org/496413 | 01:23 |
| *** ijw has quit IRC | 01:23 | |
| *** yamamoto_ has quit IRC | 01:23 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 01:25 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Remove Fedora 25 nodepool builds https://review.openstack.org/496457 | 01:27 |
| *** jamesmcarthur has quit IRC | 01:27 | |
| *** dave-mccowan has quit IRC | 01:27 | |
| *** dave-mccowan has joined #openstack-infra | 01:29 | |
| *** makowals has quit IRC | 01:30 | |
| *** csomerville has quit IRC | 01:31 | |
| *** csomerville has joined #openstack-infra | 01:31 | |
| *** LindaWang has joined #openstack-infra | 01:33 | |
| *** dave-mccowan has quit IRC | 01:38 | |
| *** s-shiono has joined #openstack-infra | 01:45 | |
| *** cuongnv has joined #openstack-infra | 01:45 | |
| *** feisky has joined #openstack-infra | 01:46 | |
| *** signed8bit_Zzz is now known as signed8bit | 01:46 | |
| *** signed8bit has quit IRC | 01:47 | |
| *** ramishra has joined #openstack-infra | 01:48 | |
| *** dave-mccowan has joined #openstack-infra | 01:50 | |
| *** thorst_afk has quit IRC | 01:53 | |
| *** makowals has joined #openstack-infra | 01:53 | |
| *** gouthamr has joined #openstack-infra | 01:55 | |
| *** Apoorva_ has quit IRC | 01:59 | |
| *** hongbin has joined #openstack-infra | 02:01 | |
| *** ramishra has quit IRC | 02:02 | |
| *** skelso has joined #openstack-infra | 02:02 | |
| *** makowals has quit IRC | 02:03 | |
| *** ramishra has joined #openstack-infra | 02:05 | |
| *** gildub has quit IRC | 02:11 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Zuul v3: add a simple devstack job https://review.openstack.org/496330 | 02:17 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Zuul v3: move local.conf writing to a role https://review.openstack.org/496393 | 02:18 |
| *** yamamoto has joined #openstack-infra | 02:19 | |
| *** yamamoto has quit IRC | 02:25 | |
| *** esberglu has joined #openstack-infra | 02:25 | |
| *** jamesmcarthur has joined #openstack-infra | 02:28 | |
| *** liujiong has joined #openstack-infra | 02:28 | |
| *** makowals has joined #openstack-infra | 02:29 | |
| *** esberglu has quit IRC | 02:29 | |
| *** weshay is now known as weshay_PTO_AM | 02:37 | |
| *** jamesmcarthur has quit IRC | 02:38 | |
| *** xinliang has joined #openstack-infra | 02:44 | |
| *** xinliang has quit IRC | 02:44 | |
| *** xinliang has joined #openstack-infra | 02:44 | |
| *** sree has joined #openstack-infra | 02:45 | |
| *** sree has quit IRC | 02:49 | |
| *** thorst_afk has joined #openstack-infra | 02:56 | |
| *** thorst_afk has quit IRC | 02:56 | |
| *** zhurong has quit IRC | 02:58 | |
| tonyb | clarkb: I'm flattered that you think I'l know the rigth thing to do there. I'm reading up on the tls-proxy code to understand what happens on pike (and ocata?) if we remove it | 03:00 |
| clarkb | I think just pike but would have to double check | 03:01 |
| *** priteau has joined #openstack-infra | 03:03 | |
| *** spligak has joined #openstack-infra | 03:04 | |
| *** funzo has joined #openstack-infra | 03:04 | |
| *** dave-mccowan has quit IRC | 03:05 | |
| tonyb | clarkb: http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/features.yaml#n289 ? or am I off track? | 03:07 |
| *** priteau has quit IRC | 03:08 | |
| *** funzo has quit IRC | 03:09 | |
| clarkb | yup thats it so in ocata | 03:11 |
| clarkb | problem is it didnt work for all service at the time so trying to figure out if we want to sort out all the exceptions or just test it on master instead | 03:11 |
| tonyb | clarkb: I get confused when I look at the feature matrix. so tls-proxy is off by default. Adding DEVSTACK_GATE_TLSPROXY=1 (on ocata, pike and master) will turn it on and you're proposing reucing that set to master (and laters queens, rocky etc?)? | 03:16 |
| *** hongbin has quit IRC | 03:18 | |
| *** yamamoto has joined #openstack-infra | 03:21 | |
| *** yamamoto has quit IRC | 03:27 | |
| *** nicolasbock has quit IRC | 03:27 | |
| clarkb | ya | 03:29 |
| clarkb | tonyb because projects like ironic and swift wont work on ocata or pike | 03:29 |
| clarkb | ironic is ready on master/queens and swift needs some more work | 03:29 |
| tonyb | So the way for services that *do* want it is to add it to ENABLED_SERVIICES ? | 03:29 |
| clarkb | in the ironic example they check the branch and if new enough sent devstack gate tlsproxy =1 | 03:30 |
| clarkb | which works but is an extra layer of checking. I'm fine going that route if it makes stable more comfortable | 03:31 |
| tonyb | clarkb: I'm trying to work out if it's just my fear of change that wants to leave tings as it is or if it's a more reasonable it'll break things response ;P | 03:32 |
| *** skelso has quit IRC | 03:33 | |
| clarkb | there definitely is some risk. I think likeliest problem is regressing tls/proxy support in older branches inadverdebtly | 03:34 |
| clarkb | more so than lack of tlsproxy breaking somehow | 03:34 |
| tonyb | Yeah. I'd liek to think that backports are unlikely to regress TLS support but it certainly is possible | 03:35 |
| *** dhajare has joined #openstack-infra | 03:37 | |
| *** gildub has joined #openstack-infra | 03:38 | |
| * notmyname is wondering if there was something that was supposed to be done and wasn't | 03:38 | |
| tonyb | clarkb: So IIUC just having the (tls-proxy) services running isn't enough to actually use it we need to se USE_SSL in the devstack config? | 03:39 |
| *** csomerville has quit IRC | 03:39 | |
| clarkb | notmyname: not really more just slow progress on cleaning up all the bits so things like swift functional tests will work with tlsproxy | 03:39 |
| *** cody-somerville has joined #openstack-infra | 03:40 | |
| *** cody-somerville has joined #openstack-infra | 03:40 | |
| notmyname | clarkb: is this something that needs to be done Right Now (tm) or is this something that's more on the "talk at the PTG" timeframe? | 03:40 |
| clarkb | tonyb: use ssl is terminating ssl in python iirc. I want to say its om the deprecation blovk and will be removed at some point | 03:40 |
| clarkb | notmyname: not right now. Its been going on for last six months or so | 03:40 |
| notmyname | kk | 03:40 |
| clarkb | clayg pokes at it occasionally | 03:40 |
| notmyname | boom! right there at the bottom https://etherpad.openstack.org/p/swift-ptg-queens | 03:42 |
| notmyname | ;-) | 03:42 |
| *** skelso has joined #openstack-infra | 03:43 | |
| *** udesale has joined #openstack-infra | 03:43 | |
| *** cloudnull has quit IRC | 03:43 | |
| clarkb | tonyb: we can be conservative and just special case things until we catch up everywhere | 03:44 |
| *** tinwood has quit IRC | 03:44 | |
| *** tinwood_ has joined #openstack-infra | 03:44 | |
| tonyb | notmyname: ;P | 03:45 |
| *** rlandy has quit IRC | 03:45 | |
| *** cloudnull has joined #openstack-infra | 03:47 | |
| *** esberglu has joined #openstack-infra | 03:49 | |
| *** esberglu has quit IRC | 03:54 | |
| tonyb | clarkb: I don't like adding cruft and special cases (like we'd need in that ironic review) but IIUC correctly we're defauling using SSL (via tls-proxy) for most (all?) endpoints on ocata, pike and master. Reducing that set to master seems like a step in the wrong direction. | 03:54 |
| tonyb | so doing something like if [[ "stable/newton stable/ocata stable/pike" =~ $ZUUL_BRANCH ]] if that ironic change and later in a swift job seems okay to me? | 03:56 |
| *** bhavik1 has joined #openstack-infra | 03:56 | |
| clarkb | ya that should be doable | 03:56 |
| *** links has joined #openstack-infra | 03:57 | |
| *** thorst_afk has joined #openstack-infra | 03:57 | |
| *** yamamoto has joined #openstack-infra | 03:59 | |
| *** armax has quit IRC | 04:00 | |
| *** ijw has joined #openstack-infra | 04:00 | |
| *** armax has joined #openstack-infra | 04:00 | |
| *** armax has quit IRC | 04:01 | |
| *** armax has joined #openstack-infra | 04:01 | |
| *** armax has quit IRC | 04:02 | |
| *** armax has joined #openstack-infra | 04:02 | |
| *** thorst_afk has quit IRC | 04:02 | |
| *** armax has quit IRC | 04:02 | |
| *** markvoelker has quit IRC | 04:03 | |
| *** armax has joined #openstack-infra | 04:03 | |
| *** armax has quit IRC | 04:03 | |
| *** ijw has quit IRC | 04:05 | |
| *** funzo has joined #openstack-infra | 04:05 | |
| *** funzo has quit IRC | 04:10 | |
| *** ykarel has joined #openstack-infra | 04:17 | |
| clayg | I got turned on to tls testing black at the last ptg | 04:28 |
| *** yamamoto has quit IRC | 04:34 | |
| *** yamamoto has joined #openstack-infra | 04:35 | |
| *** claudiub has joined #openstack-infra | 04:36 | |
| *** yamamoto has quit IRC | 04:38 | |
| *** sree has joined #openstack-infra | 04:39 | |
| *** bhavik1 has quit IRC | 04:39 | |
| *** makowals has quit IRC | 04:42 | |
| *** pgadiya has joined #openstack-infra | 04:50 | |
| *** makowals has joined #openstack-infra | 04:51 | |
| *** makowals has quit IRC | 04:57 | |
| *** pgadiya has quit IRC | 04:58 | |
| *** pbourke has quit IRC | 04:58 | |
| *** thorst_afk has joined #openstack-infra | 04:58 | |
| *** pbourke has joined #openstack-infra | 05:00 | |
| *** jtomasek_ has joined #openstack-infra | 05:01 | |
| *** makowals has joined #openstack-infra | 05:02 | |
| *** kukacz has quit IRC | 05:02 | |
| *** njohnston has quit IRC | 05:02 | |
| *** luzC has quit IRC | 05:02 | |
| *** jtomasek has quit IRC | 05:02 | |
| *** namnh has quit IRC | 05:02 | |
| *** zhenguo has quit IRC | 05:02 | |
| *** mrhillsman has quit IRC | 05:02 | |
| *** ltomasbo has quit IRC | 05:02 | |
| *** Jeffrey4l has quit IRC | 05:02 | |
| *** dims has quit IRC | 05:02 | |
| *** sflanigan has quit IRC | 05:02 | |
| *** aspiers has quit IRC | 05:02 | |
| *** sdake has quit IRC | 05:02 | |
| *** jpena|off has quit IRC | 05:02 | |
| *** jamespage has quit IRC | 05:02 | |
| *** jbryce has quit IRC | 05:02 | |
| *** mordred has quit IRC | 05:02 | |
| *** afazekas has quit IRC | 05:02 | |
| *** adam_g has quit IRC | 05:02 | |
| *** eglute has quit IRC | 05:02 | |
| *** d34dh0r53 has quit IRC | 05:02 | |
| *** dhellmann has quit IRC | 05:02 | |
| *** hogepodge has quit IRC | 05:02 | |
| *** madhuvishy has quit IRC | 05:02 | |
| *** dirk has quit IRC | 05:02 | |
| *** ildikov has quit IRC | 05:02 | |
| *** tommylikehu has quit IRC | 05:02 | |
| *** geekinutah has quit IRC | 05:02 | |
| *** verdurin has quit IRC | 05:02 | |
| *** sulo has quit IRC | 05:02 | |
| *** evgenyl has quit IRC | 05:02 | |
| *** kencjohnston_ has quit IRC | 05:02 | |
| *** andrewbogott has quit IRC | 05:02 | |
| *** rguillebert has quit IRC | 05:02 | |
| *** zul has quit IRC | 05:02 | |
| *** sweston has quit IRC | 05:02 | |
| *** petems has quit IRC | 05:02 | |
| *** ltomasbo has joined #openstack-infra | 05:02 | |
| *** namnh has joined #openstack-infra | 05:02 | |
| *** zhenguo has joined #openstack-infra | 05:02 | |
| *** mrhillsman has joined #openstack-infra | 05:02 | |
| *** dirk has joined #openstack-infra | 05:02 | |
| *** sflanigan has joined #openstack-infra | 05:02 | |
| *** sflanigan has quit IRC | 05:02 | |
| *** sflanigan has joined #openstack-infra | 05:02 | |
| *** aspiers has joined #openstack-infra | 05:02 | |
| *** hogepodge has joined #openstack-infra | 05:02 | |
| *** afazekas has joined #openstack-infra | 05:02 | |
| *** tommylikehu has joined #openstack-infra | 05:02 | |
| *** ildikov has joined #openstack-infra | 05:02 | |
| *** evgenyl has joined #openstack-infra | 05:02 | |
| *** rguillebert has joined #openstack-infra | 05:02 | |
| *** sweston has joined #openstack-infra | 05:02 | |
| *** jamespage has joined #openstack-infra | 05:02 | |
| *** thorst_afk has quit IRC | 05:02 | |
| *** dhellmann has joined #openstack-infra | 05:03 | |
| *** sulo has joined #openstack-infra | 05:03 | |
| *** andrewbogott has joined #openstack-infra | 05:03 | |
| *** Jeffrey4l has joined #openstack-infra | 05:03 | |
| *** verdurin has joined #openstack-infra | 05:03 | |
| *** sdake has joined #openstack-infra | 05:03 | |
| *** sdake has quit IRC | 05:03 | |
| *** sdake has joined #openstack-infra | 05:03 | |
| *** geekinutah has joined #openstack-infra | 05:03 | |
| *** mordred has joined #openstack-infra | 05:03 | |
| *** petems has joined #openstack-infra | 05:03 | |
| *** madhuvishy has joined #openstack-infra | 05:03 | |
| *** jcook has quit IRC | 05:04 | |
| *** luzC has joined #openstack-infra | 05:04 | |
| *** iyamahat has joined #openstack-infra | 05:04 | |
| *** d34dh0r53 has joined #openstack-infra | 05:04 | |
| *** eglute has joined #openstack-infra | 05:04 | |
| *** priteau has joined #openstack-infra | 05:04 | |
| *** kencjohnston has joined #openstack-infra | 05:04 | |
| *** adam_g has joined #openstack-infra | 05:04 | |
| *** jpena|off has joined #openstack-infra | 05:04 | |
| *** njohnston has joined #openstack-infra | 05:04 | |
| *** dims has joined #openstack-infra | 05:04 | |
| *** kukacz has joined #openstack-infra | 05:06 | |
| *** trown|outtypewww has quit IRC | 05:06 | |
| *** rook has quit IRC | 05:06 | |
| *** trown has joined #openstack-infra | 05:06 | |
| *** jcook has joined #openstack-infra | 05:07 | |
| *** priteau has quit IRC | 05:09 | |
| *** kzaitsev_pi has joined #openstack-infra | 05:11 | |
| *** rook has joined #openstack-infra | 05:12 | |
| *** rook is now known as Guest91464 | 05:12 | |
| *** cuongnv has quit IRC | 05:13 | |
| *** cuongnv has joined #openstack-infra | 05:15 | |
| *** priteau has joined #openstack-infra | 05:21 | |
| *** michaelxin has quit IRC | 05:22 | |
| *** mrodden has quit IRC | 05:23 | |
| *** kjackal has joined #openstack-infra | 05:24 | |
| *** mat128 has joined #openstack-infra | 05:24 | |
| *** csomerville has joined #openstack-infra | 05:25 | |
| *** mrodden has joined #openstack-infra | 05:25 | |
| *** michaelxin has joined #openstack-infra | 05:27 | |
| *** mat128 has quit IRC | 05:28 | |
| *** cody-somerville has quit IRC | 05:29 | |
| *** zhurong has joined #openstack-infra | 05:32 | |
| *** masber has quit IRC | 05:34 | |
| *** amotoki has joined #openstack-infra | 05:34 | |
| *** baoli has joined #openstack-infra | 05:36 | |
| *** umbarkar has quit IRC | 05:37 | |
| *** oomichi has quit IRC | 05:37 | |
| *** esberglu has joined #openstack-infra | 05:37 | |
| *** yamamoto has joined #openstack-infra | 05:38 | |
| *** oomichi has joined #openstack-infra | 05:39 | |
| *** esberglu has quit IRC | 05:42 | |
| *** yamamoto has quit IRC | 05:44 | |
| *** baoli_ has joined #openstack-infra | 05:49 | |
| *** baoli has quit IRC | 05:52 | |
| *** baoli has joined #openstack-infra | 05:55 | |
| *** kjackal has quit IRC | 05:56 | |
| *** baoli_ has quit IRC | 05:58 | |
| *** priteau has quit IRC | 05:59 | |
| *** csomerville has quit IRC | 05:59 | |
| *** thorst_afk has joined #openstack-infra | 05:59 | |
| *** aviau has quit IRC | 05:59 | |
| *** csomerville has joined #openstack-infra | 05:59 | |
| *** aviau has joined #openstack-infra | 05:59 | |
| *** baoli has quit IRC | 06:02 | |
| *** baoli has joined #openstack-infra | 06:03 | |
| *** sree has quit IRC | 06:03 | |
| *** markvoelker has joined #openstack-infra | 06:04 | |
| *** sree has joined #openstack-infra | 06:04 | |
| *** thorst_afk has quit IRC | 06:04 | |
| *** coolsvap has joined #openstack-infra | 06:05 | |
| *** funzo has joined #openstack-infra | 06:06 | |
| *** slaweq has joined #openstack-infra | 06:08 | |
| *** sree has quit IRC | 06:08 | |
| *** funzo has quit IRC | 06:10 | |
| *** slaweq has quit IRC | 06:12 | |
| *** shardy has joined #openstack-infra | 06:13 | |
| *** kornicameister has joined #openstack-infra | 06:13 | |
| *** LindaWang1 has joined #openstack-infra | 06:15 | |
| *** iyamahat_ has joined #openstack-infra | 06:15 | |
| *** iyamahat has quit IRC | 06:16 | |
| *** rcernin has joined #openstack-infra | 06:16 | |
| *** LindaWang has quit IRC | 06:18 | |
| *** LindaWang1 is now known as LindaWang | 06:18 | |
| *** LindaWang has quit IRC | 06:18 | |
| *** isaacb has joined #openstack-infra | 06:19 | |
| *** aeng has quit IRC | 06:20 | |
| *** jlvillal has quit IRC | 06:21 | |
| *** jlvillal has joined #openstack-infra | 06:21 | |
| *** kevinbenton has quit IRC | 06:22 | |
| *** LindaWang has joined #openstack-infra | 06:23 | |
| *** kevinbenton has joined #openstack-infra | 06:24 | |
| *** baoli has quit IRC | 06:28 | |
| *** sree has joined #openstack-infra | 06:29 | |
| *** sree has quit IRC | 06:30 | |
| *** ykarel_ has joined #openstack-infra | 06:30 | |
| *** masber has joined #openstack-infra | 06:32 | |
| *** ykarel has quit IRC | 06:33 | |
| *** ramishra has quit IRC | 06:35 | |
| *** cody-somerville has joined #openstack-infra | 06:36 | |
| *** cody-somerville has joined #openstack-infra | 06:36 | |
| *** csomerville has quit IRC | 06:36 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: OSA: Add periodic pike jobs https://review.openstack.org/496510 | 06:37 |
| *** ramishra has joined #openstack-infra | 06:37 | |
| *** jamesmcarthur has joined #openstack-infra | 06:37 | |
| *** markvoelker has quit IRC | 06:38 | |
| AJaeger | ianw, yolanda, could you put https://review.openstack.org/496142 on your review queue, please? | 06:40 |
| *** yamamoto has joined #openstack-infra | 06:40 | |
| *** eroux has joined #openstack-infra | 06:41 | |
| *** jamesmcarthur has quit IRC | 06:43 | |
| *** baoli has joined #openstack-infra | 06:45 | |
| *** yamamoto has quit IRC | 06:46 | |
| *** gouthamr has quit IRC | 06:47 | |
| *** baoli has quit IRC | 06:49 | |
| *** baoli has joined #openstack-infra | 06:51 | |
| *** gildub has quit IRC | 06:52 | |
| *** baoli has quit IRC | 06:55 | |
| *** yamamoto has joined #openstack-infra | 06:55 | |
| *** kjackal has joined #openstack-infra | 06:56 | |
| *** eroux has quit IRC | 06:58 | |
| *** shardy has quit IRC | 06:58 | |
| *** martinkopec has joined #openstack-infra | 06:59 | |
| *** shardy has joined #openstack-infra | 07:00 | |
| *** jbryce has joined #openstack-infra | 07:00 | |
| *** thorst_afk has joined #openstack-infra | 07:00 | |
| *** zul has joined #openstack-infra | 07:00 | |
| *** jpich has joined #openstack-infra | 07:04 | |
| *** thorst_afk has quit IRC | 07:05 | |
| *** florianf has joined #openstack-infra | 07:10 | |
| *** ykarel__ has joined #openstack-infra | 07:11 | |
| *** pcaruana has joined #openstack-infra | 07:11 | |
| *** isaacb has quit IRC | 07:13 | |
| *** ykarel_ has quit IRC | 07:13 | |
| *** tesseract-RH has joined #openstack-infra | 07:17 | |
| *** aviau has quit IRC | 07:19 | |
| *** aviau has joined #openstack-infra | 07:19 | |
| *** isaacb has joined #openstack-infra | 07:22 | |
| *** iyamahat_ has quit IRC | 07:23 | |
| *** esberglu has joined #openstack-infra | 07:26 | |
| *** markus_z has joined #openstack-infra | 07:27 | |
| *** baoli has joined #openstack-infra | 07:28 | |
| *** jpena|off is now known as jpena | 07:29 | |
| openstackgerrit | Merged openstack-infra/project-config master: Update site_logs to use logs.o.o DNS https://review.openstack.org/496389 | 07:30 |
| *** esberglu has quit IRC | 07:30 | |
| openstackgerrit | Merged openstack-infra/project-config master: OSA: Add periodic pike jobs https://review.openstack.org/496510 | 07:31 |
| *** baoli has quit IRC | 07:32 | |
| *** ykarel__ is now known as ykarel | 07:34 | |
| *** iyamahat_ has joined #openstack-infra | 07:34 | |
| openstackgerrit | Merged openstack-infra/project-config master: Register solum-tempest-plugin jobs https://review.openstack.org/494064 | 07:35 |
| *** markvoelker has joined #openstack-infra | 07:35 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove/migrate Fedora 25 jobs https://review.openstack.org/496456 | 07:36 |
| openstackgerrit | Merged openstack-infra/project-config master: Cleanup some devstack experimental jobs https://review.openstack.org/496103 | 07:36 |
| openstackgerrit | Merged openstack-infra/project-config master: OSA: Add non-voting galera_server upgrade scenario test https://review.openstack.org/496326 | 07:38 |
| openstackgerrit | Merged openstack-infra/project-config master: Fix amqp1 non-voting job failures https://review.openstack.org/496244 | 07:38 |
| openstackgerrit | Merged openstack-infra/project-config master: OSA: Only try to copy file if if exists https://review.openstack.org/496191 | 07:40 |
| openstackgerrit | Merged openstack-infra/project-config master: Trigger TripleO scenario001 and 004 on Mistral workflow changes https://review.openstack.org/496245 | 07:40 |
| openstackgerrit | Merged openstack-infra/project-config master: Move neutron multinode job to check pipeline https://review.openstack.org/492797 | 07:40 |
| openstackgerrit | Merged openstack-infra/project-config master: Dragonflow check: Add dragonflow-kuryr and OSA-dragonflow jobs https://review.openstack.org/494388 | 07:40 |
| *** iyamahat_ has quit IRC | 07:41 | |
| *** amoralej|off is now known as amoralej | 07:46 | |
| openstackgerrit | Merged openstack-infra/puppet-ansible master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495420 | 07:49 |
| openstackgerrit | Merged openstack-infra/puppet-ethercalc master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495589 | 07:50 |
| openstackgerrit | Merged openstack-infra/puppet-simpleproxy master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495637 | 07:51 |
| openstackgerrit | Merged openstack-infra/puppet-stackalytics master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495641 | 07:51 |
| openstackgerrit | Merged openstack-infra/puppet-translation_checksite master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495647 | 07:53 |
| openstackgerrit | Merged openstack-infra/puppet-iptables master: Depend on helper gem for spec_helper_acceptance https://review.openstack.org/495604 | 07:53 |
| *** egonzalez has joined #openstack-infra | 08:00 | |
| *** thorst_afk has joined #openstack-infra | 08:01 | |
| *** jamesmcarthur has joined #openstack-infra | 08:02 | |
| *** openstackgerrit has quit IRC | 08:03 | |
| *** thorst_afk has quit IRC | 08:05 | |
| *** jamesmcarthur has quit IRC | 08:06 | |
| *** funzo has joined #openstack-infra | 08:07 | |
| *** derekh has joined #openstack-infra | 08:07 | |
| *** markvoelker has quit IRC | 08:08 | |
| *** funzo has quit IRC | 08:11 | |
| *** lucas-afk is now known as lucasagomes | 08:18 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 08:19 | |
| *** openstackgerrit has joined #openstack-infra | 08:32 | |
| openstackgerrit | Stephen Finucane proposed openstack-infra/project-config master: Add os-traits to gerritbot https://review.openstack.org/496546 | 08:32 |
| *** slaweq has joined #openstack-infra | 08:32 | |
| *** yamamoto has quit IRC | 08:35 | |
| *** dosaboy has joined #openstack-infra | 08:38 | |
| *** gixxer1k has joined #openstack-infra | 08:44 | |
| openstackgerrit | Merged openstack-infra/project-config master: Cleanup log translations https://review.openstack.org/496142 | 08:45 |
| *** spotz has quit IRC | 08:46 | |
| *** njohnston has quit IRC | 08:47 | |
| *** njohnston has joined #openstack-infra | 08:47 | |
| *** SotK has quit IRC | 08:48 | |
| *** spotz has joined #openstack-infra | 08:49 | |
| *** SotK has joined #openstack-infra | 08:49 | |
| *** rguillebert has quit IRC | 08:51 | |
| *** sweston has quit IRC | 08:51 | |
| *** jamespage has quit IRC | 08:51 | |
| *** mrhillsman has quit IRC | 08:51 | |
| *** dham1 has quit IRC | 08:51 | |
| *** fdegir has quit IRC | 08:51 | |
| *** fmccrthy has quit IRC | 08:51 | |
| *** rwsu has joined #openstack-infra | 08:51 | |
| *** zhenguo has quit IRC | 08:52 | |
| *** fmccrthy has joined #openstack-infra | 08:52 | |
| *** rguillebert has joined #openstack-infra | 08:52 | |
| *** sweston has joined #openstack-infra | 08:52 | |
| *** jamespage has joined #openstack-infra | 08:52 | |
| *** mrhillsman has joined #openstack-infra | 08:52 | |
| *** fdegir has joined #openstack-infra | 08:52 | |
| *** dham1 has joined #openstack-infra | 08:52 | |
| *** zhenguo has joined #openstack-infra | 08:52 | |
| *** alexchadin has joined #openstack-infra | 08:53 | |
| *** tinwood_ is now known as tinwood | 08:55 | |
| *** sree has joined #openstack-infra | 08:58 | |
| *** yamamoto has joined #openstack-infra | 08:59 | |
| *** electrofelix has joined #openstack-infra | 09:00 | |
| *** thorst_afk has joined #openstack-infra | 09:02 | |
| *** tuanluong has joined #openstack-infra | 09:04 | |
| *** tosky has joined #openstack-infra | 09:04 | |
| *** dingyichen has quit IRC | 09:05 | |
| *** markvoelker has joined #openstack-infra | 09:06 | |
| *** thorst_afk has quit IRC | 09:06 | |
| *** e0ne has joined #openstack-infra | 09:07 | |
| *** esberglu has joined #openstack-infra | 09:14 | |
| *** ihrachys_ has joined #openstack-infra | 09:15 | |
| *** sdake has quit IRC | 09:15 | |
| *** dham1 has quit IRC | 09:16 | |
| *** fdegir has quit IRC | 09:16 | |
| *** sdake has joined #openstack-infra | 09:16 | |
| *** sdake is now known as Guest28943 | 09:16 | |
| *** dham1 has joined #openstack-infra | 09:17 | |
| *** fdegir has joined #openstack-infra | 09:17 | |
| *** kjackal has quit IRC | 09:17 | |
| *** ihrachys has quit IRC | 09:17 | |
| *** kjackal has joined #openstack-infra | 09:17 | |
| *** esberglu has quit IRC | 09:18 | |
| *** sambetts|afk is now known as sambetts | 09:20 | |
| *** SzabolcsT has joined #openstack-infra | 09:22 | |
| *** kjackal has quit IRC | 09:37 | |
| *** kjackal has joined #openstack-infra | 09:38 | |
| *** markvoelker has quit IRC | 09:39 | |
| *** sshnaidm|off is now known as sshnaidm | 09:42 | |
| *** tuanluong has quit IRC | 09:48 | |
| *** ociuhandu has joined #openstack-infra | 09:54 | |
| *** LindaWang has quit IRC | 09:58 | |
| *** ykarel_ has joined #openstack-infra | 09:58 | |
| *** ykarel has quit IRC | 10:01 | |
| *** cuongnv has quit IRC | 10:01 | |
| *** thorst_afk has joined #openstack-infra | 10:02 | |
| *** feisky has quit IRC | 10:06 | |
| *** thorst_afk has quit IRC | 10:07 | |
| *** funzo has joined #openstack-infra | 10:07 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: OSA: Make galera_server upgrade jobs voting https://review.openstack.org/496595 | 10:08 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set DNS for rh1 cloud before installation https://review.openstack.org/496596 | 10:08 |
| sshnaidm | pabelanger, ^^ seems like unbound cache doesn't have mirror.centos.org | 10:09 |
| *** ykarel__ has joined #openstack-infra | 10:10 | |
| *** liujiong has quit IRC | 10:10 | |
| sshnaidm | cores, do we have problem with DNS servers? http://logs.openstack.org/51/496351/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/e2faae7/console.html#_2017-08-23_05_35_11_089882 | 10:11 |
| *** nicolasbock has joined #openstack-infra | 10:12 | |
| *** funzo has quit IRC | 10:12 | |
| *** ykarel_ has quit IRC | 10:12 | |
| *** s-shiono has quit IRC | 10:13 | |
| *** stakeda has quit IRC | 10:16 | |
| *** gixxer1k has quit IRC | 10:16 | |
| *** nicolasbock has quit IRC | 10:16 | |
| *** pblaho has joined #openstack-infra | 10:16 | |
| *** gixxer1k has joined #openstack-infra | 10:16 | |
| sshnaidm | can anybody from europe timezone to see what happens? http://logs.openstack.org/96/496596/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/557c641/console.html#_2017-08-23_10_10_03_486030 | 10:17 |
| *** nicolasbock has joined #openstack-infra | 10:28 | |
| *** ykarel__ is now known as ykarel | 10:29 | |
| *** dtantsur|afk is now known as dtantsur | 10:30 | |
| *** kjackal has quit IRC | 10:30 | |
| *** alexchadin has quit IRC | 10:31 | |
| *** udesale has quit IRC | 10:31 | |
| *** markvoelker has joined #openstack-infra | 10:36 | |
| *** skelso has quit IRC | 10:38 | |
| *** Guest91464 is now known as rook | 10:39 | |
| *** jkilpatr has quit IRC | 10:42 | |
| *** cshastri has quit IRC | 10:42 | |
| *** isaacb has quit IRC | 10:44 | |
| *** _jbadiapa has joined #openstack-infra | 10:46 | |
| *** jbadiapa_ has quit IRC | 10:48 | |
| *** zhurong has quit IRC | 10:49 | |
| *** shardy has quit IRC | 11:01 | |
| *** esberglu has joined #openstack-infra | 11:02 | |
| *** thorst_afk has joined #openstack-infra | 11:03 | |
| *** florianf has quit IRC | 11:06 | |
| *** pgadiya has joined #openstack-infra | 11:06 | |
| *** esberglu has quit IRC | 11:06 | |
| *** pgadiya has quit IRC | 11:07 | |
| *** thorst_afk has quit IRC | 11:08 | |
| *** markvoelker has quit IRC | 11:09 | |
| *** LindaWang has joined #openstack-infra | 11:10 | |
| *** yamamoto has quit IRC | 11:11 | |
| *** gixxer1k has quit IRC | 11:18 | |
| *** gixxer1k has joined #openstack-infra | 11:18 | |
| *** yamamoto has joined #openstack-infra | 11:18 | |
| *** jkilpatr has joined #openstack-infra | 11:20 | |
| *** florianf has joined #openstack-infra | 11:21 | |
| *** pgadiya has joined #openstack-infra | 11:23 | |
| *** sree has quit IRC | 11:29 | |
| *** baoli has joined #openstack-infra | 11:29 | |
| *** sree has joined #openstack-infra | 11:29 | |
| *** pgadiya has quit IRC | 11:32 | |
| *** sree has quit IRC | 11:33 | |
| *** baoli has quit IRC | 11:34 | |
| *** yamamoto has quit IRC | 11:36 | |
| *** mat128 has joined #openstack-infra | 11:37 | |
| *** kjackal has joined #openstack-infra | 11:40 | |
| *** yamamoto has joined #openstack-infra | 11:40 | |
| *** wolverineav has joined #openstack-infra | 11:43 | |
| *** pgadiya has joined #openstack-infra | 11:45 | |
| *** sree has joined #openstack-infra | 11:46 | |
| *** gildub has joined #openstack-infra | 11:46 | |
| *** _jbadiapa has quit IRC | 11:54 | |
| *** gixxer1k has quit IRC | 11:55 | |
| *** gixxer1k has joined #openstack-infra | 11:56 | |
| *** ldnunes has joined #openstack-infra | 11:57 | |
| *** admcleod has joined #openstack-infra | 11:57 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Install build private key too https://review.openstack.org/494302 | 11:58 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add known_hosts generation for multiple nodes https://review.openstack.org/494700 | 12:00 |
| *** pgadiya has quit IRC | 12:01 | |
| *** lucasagomes is now known as lucas-hungry | 12:01 | |
| *** bobh has joined #openstack-infra | 12:02 | |
| sshnaidm | pabelanger, please ping me when you're around, all ovb jobs fail, seems like infra issues with dns | 12:03 |
| *** thorst_afk has joined #openstack-infra | 12:03 | |
| *** bobh has quit IRC | 12:03 | |
| *** dprince has joined #openstack-infra | 12:04 | |
| *** jpena is now known as jpena|lunch | 12:04 | |
| *** funzo has joined #openstack-infra | 12:05 | |
| *** markvoelker has joined #openstack-infra | 12:07 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Sign artifacts before we release them https://review.openstack.org/496428 | 12:07 |
| mordred | pabelanger: ^^ rebased the sign-artifacts patch on top of your release-openstack-python patch | 12:07 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Release extra-args from multinode environment settings https://review.openstack.org/496676 | 12:09 |
| *** funzo has quit IRC | 12:09 | |
| *** _jbadiapa has joined #openstack-infra | 12:10 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Re-enable test_delayed_repo_init https://review.openstack.org/493659 | 12:10 |
| *** gixxer1k has quit IRC | 12:10 | |
| *** kmARC has quit IRC | 12:11 | |
| *** pblaho1 has joined #openstack-infra | 12:12 | |
| *** kencjohnston has quit IRC | 12:12 | |
| *** ildikov has quit IRC | 12:12 | |
| *** beisner has quit IRC | 12:12 | |
| *** ggherdov- has quit IRC | 12:12 | |
| *** blznblzn2 has quit IRC | 12:13 | |
| *** knikolla has quit IRC | 12:13 | |
| *** kmARC has joined #openstack-infra | 12:14 | |
| *** kencjohnston has joined #openstack-infra | 12:14 | |
| *** beisner has joined #openstack-infra | 12:14 | |
| *** ildikov has joined #openstack-infra | 12:14 | |
| *** blznblzn2 has joined #openstack-infra | 12:15 | |
| *** knikolla has joined #openstack-infra | 12:15 | |
| *** pblaho has quit IRC | 12:18 | |
| *** pblaho1 has quit IRC | 12:18 | |
| *** pblaho has joined #openstack-infra | 12:18 | |
| *** mat128 has quit IRC | 12:19 | |
| *** jcoufal has joined #openstack-infra | 12:19 | |
| *** markvoelker has quit IRC | 12:19 | |
| *** markvoelker has joined #openstack-infra | 12:20 | |
| pabelanger | sshnaidm: left comment. But you shouldn't be hitting mirror.centos.org directly. It should be using regional AFS mirrors | 12:20 |
| sshnaidm | pabelanger, we have jobs failing yet before tripleo code starts | 12:22 |
| sshnaidm | pabelanger, please see my links above | 12:22 |
| *** dtroyer has quit IRC | 12:23 | |
| pabelanger | sshnaidm: yes, if setup to use unbound, then tripleo-test-cloud-rh1 likely couldn't reach opendns or google for forwarding requests | 12:23 |
| pabelanger | sshnaidm: this is likley a networking issue in the cloud | 12:23 |
| *** dutsmoc has quit IRC | 12:23 | |
| pabelanger | but there is also issue with the jobs | 12:24 |
| pabelanger | not related to DNS, but they should not be installing from mirror.centos.org | 12:24 |
| sshnaidm | pabelanger, let's talk about infra issues right now | 12:24 |
| sshnaidm | pabelanger, this issue is directly related to dns issue | 12:24 |
| sshnaidm | pabelanger, as I see in job, the dns is 127.0.0.1, so it should use unbound too | 12:25 |
| sshnaidm | pabelanger, could it be that unbound cache doesn't have mirror.rh1? | 12:25 |
| pabelanger | not likely | 12:26 |
| sshnaidm | pabelanger, http://logs.openstack.org/96/496596/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/557c641/console.html#_2017-08-23_10_10_03_486030 | 12:26 |
| *** bhavik1 has joined #openstack-infra | 12:26 | |
| pabelanger | unbound didn't have that DNS cached, so it forwarded to opendns and google | 12:26 |
| pabelanger | which then failed | 12:26 |
| pabelanger | somebody need to look at the network routing in the cloud | 12:27 |
| sshnaidm | pabelanger, I can look, but I don't think anything was changed there | 12:27 |
| sshnaidm | pabelanger, the problem could happen just in middle of undercloud installation | 12:27 |
| pabelanger | not likely | 12:28 |
| pabelanger | http://logs.openstack.org/51/496351/2/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/e2faae7/console.html#_2017-08-23_05_35_11_089882 | 12:28 |
| pabelanger | that to me means a networking issue in the cloud | 12:28 |
| *** comstud has joined #openstack-infra | 12:28 | |
| pabelanger | I'd check and see if the data centre had an outage | 12:28 |
| pabelanger | or with network ops team | 12:29 |
| pabelanger | jobs are working now? | 12:29 |
| sshnaidm | pabelanger, but "git.openstack.org" must be in unbound cache... | 12:29 |
| pabelanger | no | 12:30 |
| pabelanger | these is a new instance | 12:30 |
| pabelanger | each job run, the unbound cache would need to be initialize | 12:30 |
| sshnaidm | pabelanger, jobs are starting, but I don't see anything passed | 12:31 |
| *** rlandy has joined #openstack-infra | 12:31 | |
| sshnaidm | pabelanger, what does mean "initalize"? | 12:31 |
| *** Julien-zte has joined #openstack-infra | 12:32 | |
| *** markvoelker has quit IRC | 12:32 | |
| *** dtroyer has joined #openstack-infra | 12:32 | |
| *** Julien-zte has quit IRC | 12:33 | |
| pabelanger | sshnaidm: remember, these nodes are destroyed at the end of there runs. Whe they start from fresh, they are fresh VMs, so nothing is cached, not even DNS. So, it is possible for git.o.o not to be known to the instance | 12:33 |
| *** Julien-zte has joined #openstack-infra | 12:34 | |
| *** markvoelker has joined #openstack-infra | 12:34 | |
| sshnaidm | pabelanger, hmm.. I was sure the unbound cache is pre-populated there, this how I understood your explanations.. | 12:35 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/496690 | 12:35 |
| sshnaidm | pabelanger, I thought the cache just injected when building the image | 12:35 |
| pabelanger | no | 12:36 |
| pabelanger | we only try to prime it from nodepool ready-script | 12:36 |
| pabelanger | we ping git.o.o and google.com to make sure DNS has been setup | 12:36 |
| pabelanger | but, looking at nodepool logs, I can see failures this morning in tripleo-test-cloud-rh1 | 12:36 |
| pabelanger | http://paste.openstack.org/show/619171/ | 12:37 |
| sshnaidm | pabelanger, could it be rate-limiting from google dns? But you say we have opendns too.. | 12:40 |
| sshnaidm | derekh, hi, sorry for disturbing, do you know maybe - how can we know about network issues of rh1 cloud datacenter..? | 12:41 |
| pabelanger | sshnaidm: possible, but I think networking failure is more likely | 12:41 |
| pabelanger | sshnaidm: I would also expect to use to more wide spread DNS issues if related to rate limiting | 12:42 |
| sshnaidm | pabelanger, it happened in rdo cloud only before.. maybe they limit by network masks.. | 12:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove zuul 2.5 specific files https://review.openstack.org/496693 | 12:47 |
| *** SzabolcsT has quit IRC | 12:48 | |
| *** udesale has joined #openstack-infra | 12:48 | |
| *** esberglu has joined #openstack-infra | 12:48 | |
| pabelanger | sshnaidm: lets have you check networking first | 12:49 |
| sshnaidm | pabelanger, it would be great to check it live from machines.. but you block it: https://review.openstack.org/#/c/363630/ :) | 12:51 |
| sshnaidm | pabelanger, I can resolve in rh1 cloud, don't see issues.. | 12:53 |
| sshnaidm | pabelanger, ping, trace works, resolving too.. everything seems ok | 12:54 |
| *** shardy has joined #openstack-infra | 12:55 | |
| pabelanger | sshnaidm: right, intermitant networking issue in the data centre is my guess | 12:55 |
| pabelanger | You need to follow up with the network ops to confirm | 12:55 |
| sshnaidm | pabelanger, no idea who are them.. | 12:56 |
| pabelanger | from what I see, RDO cloud also had problems this morning. And I believe both RDOcloud and tripleo-test-cloud-rh1 are in same data centre | 12:56 |
| sshnaidm | need to wait for Ben Nemec | 12:56 |
| sshnaidm | pabelanger, how do you see that? | 12:56 |
| pabelanger | #rdo | 12:58 |
| pabelanger | they are having DNS issues also | 12:58 |
| *** eharney has joined #openstack-infra | 13:00 | |
| *** mriedem has joined #openstack-infra | 13:01 | |
| *** lucas-hungry is now known as lucasagomes | 13:03 | |
| *** bobh has joined #openstack-infra | 13:05 | |
| *** gixxer1k has joined #openstack-infra | 13:06 | |
| *** kgiusti has joined #openstack-infra | 13:08 | |
| *** bhavik1 has quit IRC | 13:09 | |
| *** jpena|lunch is now known as jpena | 13:10 | |
| *** florianf has quit IRC | 13:16 | |
| *** signed8bit has joined #openstack-infra | 13:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add keepalive=on for proxypass connection https://review.openstack.org/496704 | 13:18 |
| pabelanger | clarkb: ianw ^ttl did help, but seeing more 502 bad gateway from buildlogs this morning | 13:18 |
| *** florianf has joined #openstack-infra | 13:21 | |
| derekh | sshnaidm: sorry was having a sambo, still need to know or did you get sorted? | 13:22 |
| *** makowals_ has joined #openstack-infra | 13:23 | |
| *** makowals has quit IRC | 13:25 | |
| *** amoralej is now known as amoralej|lunch | 13:27 | |
| fungi | derekh: i think the question is whether there are local network problems impacting both the tripleo and rdo clouds, attempting to explain the dns resolution errors seen in both environments today | 13:34 |
| *** sree has quit IRC | 13:35 | |
| derekh | fungi: ok, let me see if I can find out | 13:35 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Zuul v3: add role to set up base dir https://review.openstack.org/496412 | 13:36 |
| *** sree has joined #openstack-infra | 13:36 | |
| electrofelix | noticed in trying to configure the irc-meetings to note use of openstack-jjb for future meetings that it is rejected | 13:36 |
| *** david-lyle has quit IRC | 13:36 | |
| electrofelix | is it intended that even with dedicated rooms for projects that teams should continue to use the common irc meeting rooms? | 13:36 |
| fungi | electrofelix: the check job for it may need to be altered now that the tc is in the process of declaring it acceptable for team meetings to happen outside the shared meeting channels | 13:37 |
| fungi | electrofelix: https://review.openstack.org/485117 hasn't passed yet, but i think consensus there is inevitable once the wording is polished | 13:38 |
| *** links has quit IRC | 13:38 | |
| *** sree has quit IRC | 13:40 | |
| pabelanger | derekh: fungi: thanks, ya. All signs point to a networking issue local to those clouds | 13:44 |
| pabelanger | confirmation would help | 13:45 |
| derekh | pabelanger: I'm sending a mail, will CC you | 13:45 |
| *** skelso has joined #openstack-infra | 13:46 | |
| *** gouthamr has joined #openstack-infra | 13:46 | |
| pabelanger | derekh: great, thanks | 13:48 |
| *** gouthamr has quit IRC | 13:49 | |
| *** alexchadin has joined #openstack-infra | 13:49 | |
| *** gouthamr has joined #openstack-infra | 13:50 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add ironic-inspector to the undercloud-containers job https://review.openstack.org/476130 | 13:51 |
| *** mat128 has joined #openstack-infra | 13:52 | |
| *** mat128 has quit IRC | 13:53 | |
| *** camunoz has joined #openstack-infra | 13:55 | |
| *** ijw has joined #openstack-infra | 13:55 | |
| *** dave-mccowan has joined #openstack-infra | 13:57 | |
| *** Goneri has joined #openstack-infra | 13:57 | |
| *** hongbin has joined #openstack-infra | 13:57 | |
| *** mat128 has joined #openstack-infra | 13:57 | |
| *** alexchad_ has joined #openstack-infra | 14:04 | |
| *** camunoz has quit IRC | 14:04 | |
| *** alexchadin has quit IRC | 14:04 | |
| *** camunoz has joined #openstack-infra | 14:05 | |
| *** alexchad_ is now known as alexchadin | 14:05 | |
| *** hamzy has quit IRC | 14:05 | |
| *** florianf has quit IRC | 14:06 | |
| *** udesale has quit IRC | 14:08 | |
| *** florianf has joined #openstack-infra | 14:08 | |
| *** florianf has quit IRC | 14:08 | |
| *** marst has joined #openstack-infra | 14:09 | |
| *** sshnaidm is now known as sshnaidm|afk | 14:09 | |
| *** david-lyle has joined #openstack-infra | 14:10 | |
| *** armax has joined #openstack-infra | 14:11 | |
| *** ggherdov- has joined #openstack-infra | 14:11 | |
| *** amoralej|lunch is now known as amoralej | 14:12 | |
| *** udesale has joined #openstack-infra | 14:15 | |
| *** ykarel has quit IRC | 14:17 | |
| *** rbrndt has joined #openstack-infra | 14:18 | |
| *** gixxer1k has quit IRC | 14:19 | |
| *** florianf has joined #openstack-infra | 14:20 | |
| openstackgerrit | anusree proposed openstack-infra/project-config master: Add nodejs4-jobs for designate-dashboard https://review.openstack.org/496724 | 14:24 |
| *** coolsvap has quit IRC | 14:25 | |
| mriedem | pabelanger: was it you asking me about being able to update keypairs awhile back? https://review.openstack.org/#/c/375221/ | 14:26 |
| *** makowals_ has quit IRC | 14:26 | |
| mriedem | if ^ solves the need for infra it would be good to get some review on that design spec | 14:26 |
| mriedem | from an api user pov | 14:27 |
| pabelanger | mriedem: Ya, we use them in nodepool now. | 14:27 |
| pabelanger | I'll take a look here in a bit | 14:27 |
| pabelanger | thanks | 14:28 |
| *** udesale has quit IRC | 14:31 | |
| *** udesale__ has joined #openstack-infra | 14:31 | |
| *** baoli has joined #openstack-infra | 14:32 | |
| *** baoli has quit IRC | 14:33 | |
| *** trown is now known as trown|brb | 14:41 | |
| *** Julien-zte has quit IRC | 14:41 | |
| *** Julien-zte has joined #openstack-infra | 14:42 | |
| *** hamzy has joined #openstack-infra | 14:43 | |
| *** jamesmcarthur has joined #openstack-infra | 14:46 | |
| *** ykarel has joined #openstack-infra | 14:47 | |
| *** slaweq has quit IRC | 14:50 | |
| *** trown|brb is now known as trown | 14:50 | |
| *** dhajare has quit IRC | 14:52 | |
| *** lihi has quit IRC | 14:52 | |
| *** dimak has quit IRC | 14:52 | |
| *** oanson has quit IRC | 14:53 | |
| *** lihi has joined #openstack-infra | 14:54 | |
| *** oanson has joined #openstack-infra | 14:54 | |
| *** dimak has joined #openstack-infra | 14:54 | |
| *** markus_z has quit IRC | 14:55 | |
| *** bobh has quit IRC | 14:56 | |
| *** xarses has joined #openstack-infra | 14:59 | |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add roles related to log dirs https://review.openstack.org/496422 | 15:00 |
| *** alexchadin has quit IRC | 15:00 | |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add test playbook https://review.openstack.org/496442 | 15:01 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add .zuul.yaml https://review.openstack.org/496788 | 15:04 |
| jeblair | AJaeger: ^ maybe *that* is the change we should merge to master :) | 15:04 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Add fetch-python-sdist-output role https://review.openstack.org/496789 | 15:05 |
| *** sekelso has joined #openstack-infra | 15:06 | |
| *** sshnaidm|afk is now known as sshnaidm | 15:06 | |
| *** skelso has quit IRC | 15:06 | |
| AJaeger | jeblair: thanks! So, once that is in, should I recheck mine - or abandon? | 15:08 |
| jeblair | AJaeger: let's go with abandon so we don't make more work for when we merge branches | 15:09 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Release extra-args from multinode environment settings https://review.openstack.org/496676 | 15:09 |
| *** yamamoto has quit IRC | 15:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Build tarballs / wheels for release-openstack-python https://review.openstack.org/496450 | 15:09 |
| *** Apoorva has joined #openstack-infra | 15:11 | |
| *** makowals has joined #openstack-infra | 15:12 | |
| *** srobert has joined #openstack-infra | 15:13 | |
| AJaeger | jeblair: abandoned | 15:13 |
| *** udesale__ has quit IRC | 15:15 | |
| *** jamesmcarthur has quit IRC | 15:16 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Replace tempest DVR HA job by grenade DVR for devstack-gate https://review.openstack.org/496797 | 15:20 |
| AJaeger | jeblair: strange py27 failure for your change | 15:20 |
| *** makowals has quit IRC | 15:20 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Replace tempest DVR HA job by grenade DVR for devstack-gate https://review.openstack.org/496797 | 15:21 |
| dmsimard | clarkb: ^ | 15:21 |
| *** yamamoto has joined #openstack-infra | 15:21 | |
| *** jamesmcarthur has joined #openstack-infra | 15:22 | |
| *** sekelso has quit IRC | 15:28 | |
| *** sree has joined #openstack-infra | 15:32 | |
| *** yamamoto has quit IRC | 15:32 | |
| *** yamamoto has joined #openstack-infra | 15:33 | |
| jeblair | AJaeger: maybe a race; i'll recheck | 15:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add test playbook https://review.openstack.org/496442 | 15:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add roles related to log dirs https://review.openstack.org/496422 | 15:35 |
| *** LindaWang has quit IRC | 15:37 | |
| *** jamesmcarthur has quit IRC | 15:38 | |
| *** evrardjp has quit IRC | 15:41 | |
| *** evrardjp has joined #openstack-infra | 15:41 | |
| *** sekelso has joined #openstack-infra | 15:44 | |
| *** eharney has quit IRC | 15:46 | |
| *** jamesmcarthur has joined #openstack-infra | 15:50 | |
| pabelanger | AJaeger: mordred: care to +3 https://review.openstack.org/496450/ should allow us to start testing uploads to testpypi | 15:50 |
| *** ihrachys_ is now known as ihrachys | 15:51 | |
| *** Rockyg has joined #openstack-infra | 15:53 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add .zuul.yaml https://review.openstack.org/496788 | 15:54 |
| *** vhosakot has joined #openstack-infra | 15:55 | |
| *** sree has quit IRC | 15:55 | |
| *** bobh has joined #openstack-infra | 15:56 | |
| *** xyang1 has joined #openstack-infra | 15:57 | |
| *** yamamoto has quit IRC | 15:57 | |
| *** sree has joined #openstack-infra | 15:58 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Only depend-on open changes https://review.openstack.org/496808 | 15:58 |
| *** Guest28943 is now known as sdake | 16:00 | |
| *** sdake has joined #openstack-infra | 16:00 | |
| mordred | pabelanger: done | 16:00 |
| pabelanger | mordred: thanks | 16:00 |
| pabelanger | mordred: mind getting the depends on too: https://review.openstack.org/496789/ | 16:01 |
| *** bobh has quit IRC | 16:01 | |
| mordred | pabelanger: done | 16:01 |
| *** florianf_ has joined #openstack-infra | 16:01 | |
| *** kjackal has quit IRC | 16:01 | |
| *** florianf has quit IRC | 16:02 | |
| *** sree has quit IRC | 16:02 | |
| clarkb | dmsimard: 2017-08-23 15:47:42.983141 | FAILURE: Job gate-grenade-dsvm-neutron-dvr-multinode-ubuntu-xenial-nv not defined | 16:03 |
| *** eharney has joined #openstack-infra | 16:03 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Replace tempest DVR HA job by grenade DVR for devstack-gate https://review.openstack.org/496797 | 16:03 |
| dmsimard | clarkb: already fixed :P | 16:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: The play object is at self._play not self.play https://review.openstack.org/496810 | 16:03 |
| dmsimard | ^ | 16:03 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add fetch-python-sdist-output role https://review.openstack.org/496789 | 16:03 |
| *** funzo has joined #openstack-infra | 16:07 | |
| *** jkilpatr has quit IRC | 16:08 | |
| *** Rocky_g has joined #openstack-infra | 16:11 | |
| *** funzo has quit IRC | 16:11 | |
| *** markvoelker_ has joined #openstack-infra | 16:11 | |
| *** Adri2000 has quit IRC | 16:11 | |
| *** Adri2000 has joined #openstack-infra | 16:12 | |
| *** Adri2000 has quit IRC | 16:12 | |
| *** Adri2000 has joined #openstack-infra | 16:12 | |
| *** Rockyg has quit IRC | 16:13 | |
| *** markvoelker has quit IRC | 16:13 | |
| *** dhajare has joined #openstack-infra | 16:16 | |
| *** coolsvap has joined #openstack-infra | 16:16 | |
| *** florianf_ is now known as florianf | 16:16 | |
| *** shardy has quit IRC | 16:16 | |
| openstackgerrit | Merged openstack-infra/project-config master: Build tarballs / wheels for release-openstack-python https://review.openstack.org/496450 | 16:21 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: The play object is at self._play not self.play https://review.openstack.org/496810 | 16:22 |
| openstackgerrit | Merged openstack/os-client-config master: Updated from global requirements https://review.openstack.org/494865 | 16:22 |
| clarkb | fungi: did you see that tcpdump seems to show that infracloud switches are acting like switches again? Haven't seen anything from HPE about it though so unsure if that self corrected (possibly because we stopped booting fewer instances there and consequently have fewer mac addrs to track) or if they changed something | 16:23 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add a test to verify basic console output https://review.openstack.org/496824 | 16:23 |
| *** weshay_PTO_AM is now known as weshay | 16:25 | |
| *** ykarel has quit IRC | 16:26 | |
| *** dave-mccowan has quit IRC | 16:26 | |
| *** dtantsur is now known as dtantsur|afk | 16:29 | |
| *** rcernin has quit IRC | 16:29 | |
| *** jbernard has quit IRC | 16:29 | |
| *** ijw has quit IRC | 16:30 | |
| *** srobert has quit IRC | 16:31 | |
| *** e0ne has quit IRC | 16:32 | |
| clarkb | hwoarang: dirk AJaeger I've confirmed the dlv fix is in place on our suse images. Are you seeing jobs run on suse pass more reliably now? | 16:33 |
| *** jbernard has joined #openstack-infra | 16:35 | |
| *** mat128 has quit IRC | 16:35 | |
| *** ykarel has joined #openstack-infra | 16:38 | |
| *** sree has joined #openstack-infra | 16:40 | |
| *** sambetts is now known as sambetts|afk | 16:42 | |
| *** jpich has quit IRC | 16:48 | |
| openstackgerrit | wes hayutin proposed openstack-infra/project-config master: add containers-scenario003 to tqe check and gate https://review.openstack.org/496830 | 16:49 |
| dmsimard | pabelanger, AJaeger: in case you have time for a quick project-config review to help land zuul v3 stuff: https://review.openstack.org/#/c/496797/ | 16:50 |
| *** dhajare has quit IRC | 16:51 | |
| *** sbezverk has quit IRC | 16:52 | |
| *** jkilpatr has joined #openstack-infra | 16:53 | |
| openstackgerrit | wes hayutin proposed openstack-infra/project-config master: add upgrade job to check and gate tqe changes https://review.openstack.org/496831 | 16:53 |
| *** jamesmcarthur has quit IRC | 16:54 | |
| *** egonzalez has quit IRC | 16:54 | |
| *** signed8bit is now known as signed8bit_Zzz | 16:54 | |
| *** jamesmcarthur has joined #openstack-infra | 16:55 | |
| *** sree has quit IRC | 16:56 | |
| *** jcoufal has quit IRC | 16:56 | |
| *** sree has joined #openstack-infra | 16:56 | |
| *** trown is now known as trown|lunch | 16:56 | |
| *** signed8bit_Zzz is now known as signed8bit | 16:58 | |
| *** pvaneck has joined #openstack-infra | 16:59 | |
| *** sree has quit IRC | 17:01 | |
| *** dhajare has joined #openstack-infra | 17:03 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Service List https://review.openstack.org/482195 | 17:05 |
| *** lucasagomes is now known as lucas-afk | 17:07 | |
| *** Swami has joined #openstack-infra | 17:08 | |
| *** pcaruana has quit IRC | 17:08 | |
| *** ijw has joined #openstack-infra | 17:08 | |
| *** derekh has quit IRC | 17:10 | |
| *** andrewbogott has quit IRC | 17:11 | |
| *** andrewbogott has joined #openstack-infra | 17:11 | |
| *** tesseract-RH has quit IRC | 17:12 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add a test to verify basic console output https://review.openstack.org/496824 | 17:13 |
| *** dave-mccowan has joined #openstack-infra | 17:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add a test to verify basic console output https://review.openstack.org/496824 | 17:15 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Ensure post-run playbooks are ordered correctly https://review.openstack.org/496833 | 17:16 |
| *** Rocky_g has quit IRC | 17:21 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Only depend-on open changes https://review.openstack.org/496808 | 17:22 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Service Update https://review.openstack.org/482196 | 17:23 |
| *** mriedem has quit IRC | 17:23 | |
| *** makowals has joined #openstack-infra | 17:29 | |
| *** bobh has joined #openstack-infra | 17:29 | |
| *** jokke_ has joined #openstack-infra | 17:30 | |
| *** mat128 has joined #openstack-infra | 17:31 | |
| *** vhosakot has quit IRC | 17:32 | |
| *** vhosakot has joined #openstack-infra | 17:33 | |
| *** jpena is now known as jpena|off | 17:33 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Service Delete https://review.openstack.org/482197 | 17:34 |
| *** mat128 has quit IRC | 17:34 | |
| *** rcernin has joined #openstack-infra | 17:34 | |
| electrofelix | fungi: missed your response earlier (irc client didn't notify me...) about allowing teams to use their own rooms, thanks I'll note that on the review | 17:35 |
| *** ykarel has quit IRC | 17:37 | |
| *** tosky has quit IRC | 17:37 | |
| *** liusheng has quit IRC | 17:37 | |
| AJaeger | clarkb: hope hwoarang is around to check - I didn't look. Thanks for telling us | 17:37 |
| *** alex_xu has quit IRC | 17:37 | |
| AJaeger | jeblair, great! aspiers, https://docs.openstack.org/infra/zuul/ is updated! | 17:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Only depend-on open changes https://review.openstack.org/496808 | 17:37 |
| aspiers | AJaeger: woohoo :) | 17:38 |
| *** liusheng has joined #openstack-infra | 17:38 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Ensure post-run playbooks are ordered correctly https://review.openstack.org/496833 | 17:38 |
| jeblair | AJaeger, aspiers: thanks! | 17:39 |
| AJaeger | dmsimard: +3 | 17:39 |
| *** electrofelix has quit IRC | 17:40 | |
| hwoarang | clarkb: it failed a few times today | 17:41 |
| *** mriedem has joined #openstack-infra | 17:41 | |
| AJaeger | pabelanger: is it safe to remove fedora-25 images now? See https://review.openstack.org/496457 | 17:41 |
| hwoarang | but maybe the new image was not deployed yet | 17:41 |
| clarkb | hwoarang: ya I didn't check when the image updated across all the clouds | 17:42 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Only depend-on open changes https://review.openstack.org/496808 | 17:42 |
| clarkb | hwoarang: but I expect things should be happy nowish | 17:42 |
| AJaeger | hwoarang: do you have a recent run and can check that? | 17:42 |
| *** alex_xu has joined #openstack-infra | 17:42 | |
| pabelanger | AJaeger: we should set min-ready: -1 first. | 17:43 |
| *** ldnunes has quit IRC | 17:44 | |
| hwoarang | AJaeger: not within the last 10 hours | 17:44 |
| hwoarang | but i can trigger a few jobs | 17:44 |
| *** slaweq has joined #openstack-infra | 17:44 | |
| hwoarang | AJaeger: clarkb: actually http://logs.openstack.org/99/496199/1/experimental/gate-openstack-ansible-pip_install-ansible-func-opensuse-423-nv/9b5f612/console.html#_2017-08-22_12_48_56_699956 | 17:44 |
| *** jascott1 has quit IRC | 17:45 | |
| hwoarang | not so long ago... | 17:45 |
| AJaeger | pabelanger: do you want to do the job or shall I? | 17:45 |
| AJaeger | pabelanger: it's at 0 right now... | 17:45 |
| hwoarang | same ubound errors: http://logs.openstack.org/99/496199/1/experimental/gate-openstack-ansible-pip_install-ansible-func-opensuse-423-nv/9b5f612/logs/host/unbound.log.txt.gz | 17:45 |
| pabelanger | AJaeger: 1 sec | 17:45 |
| pabelanger | AJaeger: k, I manually delete it | 17:45 |
| hwoarang | clarkb: i am going to re-trigger that job | 17:45 |
| *** jcoufal has joined #openstack-infra | 17:46 | |
| *** lathiat has quit IRC | 17:46 | |
| *** trown|lunch is now known as trown | 17:46 | |
| clarkb | hwoarang: ok, also that error doesn't look like a dns issue? it says invalid metadata at the url | 17:46 |
| pabelanger | AJaeger: +2, ready when you are | 17:46 |
| AJaeger | pabelanger: then I'll +2A... | 17:46 |
| clarkb | hwoarang: looking the range on the image update is ~5 hours ago all the way up to 11 hours ago or so | 17:46 |
| clarkb | depending on the cloud region | 17:47 |
| AJaeger | pabelanger: thansk | 17:47 |
| pabelanger | AJaeger: thank yoU! | 17:47 |
| hwoarang | clarkb: aha ok then. then we may know more tomorrow | 17:48 |
| AJaeger | clarkb: could you give some advise on https://review.openstack.org/495742 - should we merge my change? Please read amrith's comment | 17:48 |
| *** slaweq has quit IRC | 17:49 | |
| openstackgerrit | Merged openstack-infra/project-config master: Replace tempest DVR HA job by grenade DVR for devstack-gate https://review.openstack.org/496797 | 17:49 |
| AJaeger | hwoarang: your experimental job passed ;) | 17:49 |
| hwoarang | that's a good sign | 17:50 |
| *** gixxer1k has joined #openstack-infra | 17:51 | |
| clarkb | AJaeger: I think our general "policy" has been that if people are actively working to fix them then check is fine but otherwise experimental is prefered | 17:51 |
| clarkb | and we've applied that to more than just trove | 17:51 |
| AJaeger | hwoarang, clarkb no problems: http://logs.openstack.org/99/496199/1/experimental/gate-openstack-ansible-pip_install-ansible-func-opensuse-423-nv/755a748/logs/host/unbound.log.txt.gz | 17:51 |
| *** gixxer1k has quit IRC | 17:51 | |
| clarkb | AJaeger: hwoarang yay | 17:51 |
| AJaeger | clarkb: and I see no active work - just hope ;) | 17:51 |
| clarkb | AJaeger: ya so I think that is ok | 17:52 |
| clarkb | and amrith has +1'd so I will go ahead and approve (will leave what I said above on the change too) | 17:52 |
| hwoarang | good good | 17:52 |
| AJaeger | clarkb: good, thanks | 17:52 |
| *** dhajare has quit IRC | 17:52 | |
| AJaeger | clarkb: now if trove would have a stable test suite, I would care less. But getting something in takes ages since the base is soo instable ;( | 17:53 |
| *** vhosakot has quit IRC | 17:54 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove Fedora 25 nodepool builds https://review.openstack.org/496457 | 17:55 |
| *** vhosakot has joined #openstack-infra | 17:55 | |
| *** ldnunes has joined #openstack-infra | 17:56 | |
| fungi | clarkb: i missed that about the infracloud switching. did the background noise traffic on the interface graphs in cacti also show an abrupt stop recently? | 17:56 |
| *** pblaho has quit IRC | 17:57 | |
| *** gouthamr has quit IRC | 17:57 | |
| clarkb | fungi: I haven't checked cacti, but should. I just ran tcpdump and stopped seeing packets for other hosts on baremetal00 | 17:57 |
| pabelanger | AJaeger: mind a review on 496830. It will help tripleo | 17:57 |
| AJaeger | pabelanger: then we need EmilienM to +1 first | 17:58 |
| pabelanger | AJaeger: Oh, maybe mwhahaha can^ | 17:58 |
| *** tosky has joined #openstack-infra | 17:58 | |
| AJaeger | EmilienM, is the only one in the list for TripleO - and he really wants to review. | 17:59 |
| pabelanger | AJaeger: okay, wfm | 17:59 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add a test to verify basic console output https://review.openstack.org/496824 | 17:59 |
| clarkb | fungi: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4995&rra_id=all looks like there is some drop off but not definitive | 17:59 |
| *** gouthamr has joined #openstack-infra | 17:59 | |
| *** iyamahat has joined #openstack-infra | 18:00 | |
| jeblair | clarkb: are we fully migrated to puppet-log_processor now? | 18:00 |
| AJaeger | pabelanger: is EmilienM out? Then I'll take a proxy as well - worst case we have to revert ;) | 18:00 |
| *** e0ne has joined #openstack-infra | 18:00 | |
| clarkb | jeblair: yes puppet-log_processor is what sets up the logstash daemons and gearman workers and all that as far as I know | 18:00 |
| pabelanger | AJaeger: ya, I think he is PTO. I suggest mwhahaha as he is incoming PTL | 18:00 |
| jeblair | clarkb: cool thx | 18:00 |
| mwhahaha | i +1 | 18:01 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Move network overlay configuration to Ansible playbooks https://review.openstack.org/435933 | 18:01 |
| clarkb | er I guess we have puppet-logstash for logstash daemon, so thats just the gearman side of things but ya | 18:01 |
| AJaeger | pabelanger, mwhahaha, EmilienM - will do. | 18:01 |
| *** jamesmcarthur has quit IRC | 18:01 | |
| jeblair | clarkb: yeah, i was referring to our previously dual-homed python scripts | 18:01 |
| AJaeger | mwhahaha: please discuss with EmilienM https://wiki.openstack.org/wiki/CrossProjectLiaisons#Infra | 18:01 |
| clarkb | jeblair: ya there is a second home for them which is the proper python package but we ran into problems transitioning and now have skewed | 18:01 |
| clarkb | fixing that would be a good item to crank out one week | 18:02 |
| AJaeger | pabelanger: +3 | 18:02 |
| pabelanger | AJaeger: great, thanks | 18:02 |
| *** martinkopec has quit IRC | 18:03 | |
| AJaeger | there're a few more changes for tripleo in the queue that wait for EmilienM's review. mwhahaha how long is EmilienM out? Do you want to go over the project-config changes or wait for him? | 18:03 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Add containers periodic test https://review.openstack.org/475747 | 18:04 |
| *** dhajare has joined #openstack-infra | 18:05 | |
| *** spligak_ has joined #openstack-infra | 18:06 | |
| openstackgerrit | Merged openstack-infra/project-config master: Stop running broken trove tests https://review.openstack.org/495742 | 18:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Allow zuul executors to contact logstash gearman https://review.openstack.org/496836 | 18:07 |
| *** spligak has quit IRC | 18:07 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/496690 | 18:07 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove zuul 2.5 specific files https://review.openstack.org/496693 | 18:07 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Only depend-on open changes https://review.openstack.org/496808 | 18:07 |
| *** funzo has joined #openstack-infra | 18:07 | |
| *** rmcall has joined #openstack-infra | 18:09 | |
| openstackgerrit | Merged openstack-infra/project-config master: add containers-scenario003 to tqe check and gate https://review.openstack.org/496830 | 18:11 |
| *** funzo has quit IRC | 18:12 | |
| *** e0ne has quit IRC | 18:13 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Sign artifacts before we release them https://review.openstack.org/496428 | 18:15 |
| *** yamahata has joined #openstack-infra | 18:16 | |
| jeblair | clarkb: https://review.openstack.org/496836 would be a good one to go ahead and get into the pipeline | 18:18 |
| *** apetrich has quit IRC | 18:18 | |
| clarkb | jeblair: I've +2'd it. We might want to use a different list of hosts for gearman but for now that works (since zuul doesn't need to talk to elasticsearch directly) | 18:20 |
| *** apetrich has joined #openstack-infra | 18:20 | |
| *** e0ne has joined #openstack-infra | 18:22 | |
| *** coolsvap has quit IRC | 18:25 | |
| *** makowals has quit IRC | 18:31 | |
| *** e0ne has quit IRC | 18:33 | |
| *** jcoufal has quit IRC | 18:36 | |
| *** jcoufal has joined #openstack-infra | 18:38 | |
| *** e0ne has joined #openstack-infra | 18:40 | |
| dirk | clarkb: what was the dib failure? I am on timeoff this week. According to grafana.o.o it seems to be better again | 18:42 |
| *** dhajare has quit IRC | 18:42 | |
| clarkb | dirk: was related to how unbound works on suse by default. We pushed an update to the unbound.conf to correct it and I think hwoarang was going to or did submit a bug with suse about it too | 18:43 |
| clarkb | dirk: basically suse uses an option that is recommended to not be used by unbound so we turned it off | 18:43 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Create pypi_twine_executable https://review.openstack.org/496843 | 18:44 |
| dirk | clarkb: ah. Is that reported as a bug report for opensuse? We might not have a good reason for using an option that isn't recommended .. 😃 | 18:45 |
| *** slaweq has joined #openstack-infra | 18:45 | |
| *** rcernin has quit IRC | 18:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Set pypi_twine_executable for upload-pypi role https://review.openstack.org/496844 | 18:47 |
| *** jascott1 has joined #openstack-infra | 18:48 | |
| pabelanger | mordred: ^ fixes for pathing issue to twine | 18:48 |
| *** slaweq has quit IRC | 18:51 | |
| *** jtomasek_ has quit IRC | 18:52 | |
| clarkb | pabelanger: is .local a magical venv that is sourced for jobs? | 18:55 |
| clarkb | or is that what the --uesr does? if so TIL | 18:56 |
| pabelanger | ya, --user is ~/.local | 18:56 |
| clarkb | neat I should probably do that locally | 18:56 |
| *** shardy has joined #openstack-infra | 18:57 | |
| *** jamesmcarthur has joined #openstack-infra | 18:59 | |
| *** spligak_ has quit IRC | 18:59 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Re-enable test_merge_conflict_reports https://review.openstack.org/468670 | 19:00 |
| pabelanger | clarkb: did you see 496704? Adds keepalive=on for proxypass connection. buildlogs.centos issue returned this morning | 19:02 |
| *** camunoz has quit IRC | 19:02 | |
| pabelanger | clarkb: I think if this doesn't work, we can try disablereuse just for build logs to disable connection pooling | 19:02 |
| clarkb | I didnt | 19:03 |
| clarkb | Will take a look shortly | 19:03 |
| *** sekelso has quit IRC | 19:03 | |
| *** tobiash has quit IRC | 19:04 | |
| *** sekelso has joined #openstack-infra | 19:04 | |
| pabelanger | clarkb: 375221 is interesting too | 19:05 |
| pabelanger | clarkb: relates to nodepool infra-root-keys | 19:05 |
| *** rmcall has quit IRC | 19:07 | |
| jeblair | pabelanger: that's only if we issue the 'rebuild' command? | 19:08 |
| pabelanger | jeblair: ya, looks like it. I think we'd want to explain our use case | 19:09 |
| *** tobiash has joined #openstack-infra | 19:11 | |
| *** ijw has quit IRC | 19:13 | |
| hwoarang | clarkb: dirk: https://bugzilla.opensuse.org/show_bug.cgi?id=1055060 | 19:16 |
| openstack | bugzilla.opensuse.org bug 1055060 in Basesystem "unbound: consider dropping "dlv-anchor-file" from the configuration file" [Normal,New] - Assigned to bnc-team-screening | 19:16 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Zuul v3: add roles related to log dirs https://review.openstack.org/496422 | 19:17 |
| *** camunoz has joined #openstack-infra | 19:18 | |
| *** srobert has joined #openstack-infra | 19:19 | |
| *** mat128 has joined #openstack-infra | 19:20 | |
| *** ijw has joined #openstack-infra | 19:21 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Create pypi_twine_executable https://review.openstack.org/496843 | 19:22 |
| openstackgerrit | Merged openstack-infra/shade master: De-client-ify Service List https://review.openstack.org/482195 | 19:23 |
| *** ijw has quit IRC | 19:28 | |
| clarkb | pabelanger: I've +2'd just note that you may also need to tweak kernel params (also is apache case sensitive for On vs on?) | 19:28 |
| pabelanger | clarkb: k, I don't think it is case sensitive, there does seem to interchange the uses | 19:29 |
| *** ijw has joined #openstack-infra | 19:29 | |
| pabelanger | one param is On, another on | 19:30 |
| *** kjackal has joined #openstack-infra | 19:31 | |
| clarkb | pabelanger: re the nova spec I'm not sure if that will much for us. We don't rebuild and even if we did I assume we wouldn't rebuild indefinitely so eventually (within some reasonable time frame) the nodes would all switch over to new key data? | 19:33 |
| clarkb | that said I think that nova probably should update key data on rebuilds | 19:33 |
| *** baoli has joined #openstack-infra | 19:34 | |
| *** camunoz has quit IRC | 19:37 | |
| *** slaweq has joined #openstack-infra | 19:38 | |
| *** camunoz has joined #openstack-infra | 19:38 | |
| *** baoli has quit IRC | 19:38 | |
| *** olaph1 has joined #openstack-infra | 19:41 | |
| *** olaph has quit IRC | 19:41 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: import whereto program https://review.openstack.org/496856 | 19:42 |
| * fungi is waiting for us to also add "whither" and "wherefore" projects | 19:56 | |
| fungi | maybe "whence" too | 19:57 |
| dhellmann | oh, whence would have been a good name for this one | 19:57 |
| fungi | there's still time! ;) | 19:58 |
| dhellmann | I've already done all of the setup on pypi and launchpad, so blah | 19:58 |
| dhellmann | fungi : you should have suggested that name 2 hrs ago! ;-) | 19:58 |
| fungi | yep. we can always use that for the next one | 19:58 |
| fungi | too bad i was hiking 2 hours ago | 19:59 |
| fungi | er, i mean, not too bad. hiking good | 19:59 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: import whereto program https://review.openstack.org/496856 | 19:59 |
| dhellmann | fungi : yes, that's a much better use of time than thinking up names for projects | 19:59 |
| fungi | i'm afraid i must concur | 20:00 |
| *** shardy has quit IRC | 20:00 | |
| *** jamesmcarthur has quit IRC | 20:00 | |
| *** jascott1 has quit IRC | 20:02 | |
| clarkb | pabelanger: thinkin about the apache woes a bit more, it would be nice to see backend logs if possible because we don't seem to see this affecting other jobs that just use normal centos right? implying it isn't a problem normally for yum fetching from rdo or centos proper? | 20:02 |
| clarkb | pabelanger: centos prope rwill be via afs so may not be affected but we use rdo too and that is proxied right? | 20:04 |
| clarkb | hrm though I guess devstack may not use the rdo proxy | 20:04 |
| *** kjackal has quit IRC | 20:04 | |
| *** funzo has joined #openstack-infra | 20:05 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: import whereto program https://review.openstack.org/496856 | 20:06 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Role to copy the build ssh key to other users https://review.openstack.org/496413 | 20:06 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add support for gzipping static ARA reports https://review.openstack.org/495551 | 20:07 |
| *** funzo has quit IRC | 20:10 | |
| *** rmcall has joined #openstack-infra | 20:12 | |
| openstackgerrit | wes hayutin proposed openstack-infra/project-config master: ensure tripleo scenario003 checks trigger on changes https://review.openstack.org/496862 | 20:13 |
| *** Goneri has quit IRC | 20:15 | |
| dirk | clarkb: hwoarang: thanks | 20:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Set pypi_twine_executable for upload-pypi role https://review.openstack.org/496844 | 20:19 |
| pabelanger | clarkb: jeblair: ^better logic to find twine | 20:19 |
| *** jascott1 has joined #openstack-infra | 20:22 | |
| *** jkilpatr has quit IRC | 20:22 | |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: Add the default set of devstack projects https://review.openstack.org/496864 | 20:23 |
| jeblair | clarkb: that's the list above-the-fold from the current devstack-gate script -- that still look correct or do you want to try any changes to that? | 20:23 |
| clarkb | jeblair: manilla-ui can probably go away too but is complicated due to how it interacts iwth horizon iirc | 20:24 |
| *** sekelso has quit IRC | 20:25 | |
| jeblair | clarkb: yeah, horizen django_openstack_auth, and manilla-ui are in a conditional group in the script; i have to take the superset here | 20:25 |
| *** dprince has quit IRC | 20:26 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add ensure-twine role that upload-pypi depends on https://review.openstack.org/496872 | 20:31 |
| *** vhosakot has quit IRC | 20:35 | |
| *** rcernin has joined #openstack-infra | 20:35 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add ensure-twine role https://review.openstack.org/496872 | 20:36 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Use ensure-twine role to ensure twine exists https://review.openstack.org/496873 | 20:36 |
| mordred | jeblair, clarkb: isn't horizon turned off by default in devstack now? | 20:37 |
| mordred | I thought folks disabled that recently to reduce memory pressure on normal nova/neutron jobs | 20:37 |
| clarkb | it is in testing but not devstack itself | 20:38 |
| clarkb | and my rough rule was I'd keep devstack defaults to avoid complaints | 20:38 |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add start-fresh logging role https://review.openstack.org/496909 | 20:39 |
| clarkb | but we can trim that more if we want | 20:39 |
| robcresswell | Removing Horizon from devstack defaults? :( | 20:39 |
| * robcresswell reads scrollback | 20:39 | |
| mordred | clarkb: yah - I agree with the approach of following devstack defaults | 20:39 |
| mordred | robcresswell: mostly was trying to sort out if it had been removed from defaults already, but it seems not | 20:40 |
| robcresswell | mordred: Ah, gotcha. | 20:40 |
| *** eharney has quit IRC | 20:40 | |
| *** aeng has joined #openstack-infra | 20:41 | |
| mordred | robcresswell: we're workingon devstack-gate jobs for zuul v3: https://review.openstack.org/496864 - it's a good time to double-check things :) | 20:43 |
| *** kgiusti has left #openstack-infra | 20:43 | |
| *** jcoufal has quit IRC | 20:43 | |
| robcresswell | mordred: Definitely makes sense to remove as much of the Horizon stuff as possible I'd expect from gate defaults. | 20:44 |
| robcresswell | I'll comment :) | 20:44 |
| jeblair | also lol the error from zuul :) | 20:45 |
| jeblair | so, i reckon we're going to have to turn zuulv3 on for a bunch of openstack projects... please don't tell anyone. :) | 20:46 |
| mordred | jeblair: ++ | 20:47 |
| jeblair | robcresswell: if the only jobs that are going to use those are ones that explicitly test horizon (eg gate-devstack-horizon-somethingorother) then yeah, i think it's safe to remove those | 20:47 |
| *** kjackal has joined #openstack-infra | 20:48 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Don't create a gzipped folder: recursively gzip ARA contents https://review.openstack.org/496916 | 20:48 |
| jeblair | robcresswell, mordred, clarkb: really i think what should be in that list are just the projects involved in every devstack job | 20:48 |
| robcresswell | jeblair: Yeah, my other question was going to be about ceilometer? I thought that was all deprecated | 20:49 |
| openstackgerrit | John Trowbridge proposed openstack-infra/project-config master: Revert "Revert "Change job type for 3nodes job to move to oooq runner"" https://review.openstack.org/495853 | 20:50 |
| clarkb | robcresswell: ya I think the list may have grown some cruft | 20:51 |
| clarkb | though ceilomter is enabled ina bunch of jobs I thought | 20:52 |
| *** e0ne has quit IRC | 20:52 | |
| robcresswell | clarkb: You're the brains here, I'm just the idiot tourist :) | 20:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add the base set of devstack projects to Zuul v3 https://review.openstack.org/496919 | 20:53 |
| jeblair | clarkb: if it's not used in all jobs, then maybe it's one we can also drop from base and just add it back in jobs that inherit | 20:53 |
| jeblair | mordred, clarkb: i do have a trick up my sleeve for adding all those projects without getting ahead of ourselves ^ 496919 | 20:54 |
| openstackgerrit | Ramamani Yeleswarapu proposed openstack-infra/devstack-gate master: [TESTING][DO NOT MERGE] Testing TLS in Ironic jobs https://review.openstack.org/492661 | 20:57 |
| *** masber has quit IRC | 20:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add the base set of devstack projects to Zuul v3 https://review.openstack.org/496919 | 20:57 |
| *** gouthamr has quit IRC | 20:58 | |
| jeblair | infra-root: i'm going to force-merge 496916 which has wedged zuulv3 | 20:58 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add option to build $RELEASE version of containers images https://review.openstack.org/496920 | 20:58 |
| jeblair | er, well, cause/effect are reversed there but you get the idea | 20:58 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Don't create a gzipped folder: recursively gzip ARA contents https://review.openstack.org/496916 | 20:59 |
| *** dave-mccowan has quit IRC | 21:00 | |
| *** trown is now known as trown|outtypewww | 21:01 | |
| *** pvaneck has quit IRC | 21:03 | |
| *** srobert has quit IRC | 21:10 | |
| mordred | jeblair: ++ | 21:10 |
| mordred | (to both trick up sleeve and force-merge) | 21:10 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Create pypi_twine_executable https://review.openstack.org/496843 | 21:11 |
| *** sekelso has joined #openstack-infra | 21:12 | |
| *** ldnunes has quit IRC | 21:13 | |
| *** vhosakot has joined #openstack-infra | 21:19 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: base-test: Disable facts for logs.o.o https://review.openstack.org/496924 | 21:20 |
| openstackgerrit | Merged openstack-infra/project-config master: Set pypi_twine_executable for upload-pypi role https://review.openstack.org/496844 | 21:22 |
| clarkb | fungi: have you heard anything from ovh? | 21:22 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Make it possible to browse for multiple tags simultaneously https://review.openstack.org/455026 | 21:23 |
| *** mat128 has quit IRC | 21:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Document list of configuration items for include/exclude https://review.openstack.org/496928 | 21:25 |
| *** camunoz has quit IRC | 21:25 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add ensure-twine role https://review.openstack.org/496872 | 21:27 |
| *** thorst_afk has quit IRC | 21:27 | |
| *** sree has joined #openstack-infra | 21:27 | |
| *** thorst_afk has joined #openstack-infra | 21:28 | |
| fungi | clarkb: i've seen no reply from j-d, nor any further followup to the support ticket after the one stating he was on holiday for a couple weeks | 21:28 |
| openstackgerrit | Merged openstack-infra/project-config master: Add the base set of devstack projects to Zuul v3 https://review.openstack.org/496919 | 21:29 |
| *** jkilpatr has joined #openstack-infra | 21:29 | |
| openstackgerrit | Merged openstack-infra/system-config master: Allow zuul executors to contact logstash gearman https://review.openstack.org/496836 | 21:31 |
| *** sree has quit IRC | 21:32 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Move fix_disk_layout to an Ansible role in setup_host https://review.openstack.org/496935 | 21:32 |
| *** thorst_afk has quit IRC | 21:32 | |
| *** vhosakot has quit IRC | 21:32 | |
| *** vhosakot has joined #openstack-infra | 21:32 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use ensure-twine role to ensure twine exists https://review.openstack.org/496873 | 21:35 |
| *** gouthamr has joined #openstack-infra | 21:36 | |
| *** askb has joined #openstack-infra | 21:38 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/shade master: Fix cleaning of Cinder volumes in functional tests https://review.openstack.org/496939 | 21:39 |
| openstackgerrit | Merged openstack-infra/storyboard master: Add a configurable fallback URL for emails https://review.openstack.org/454263 | 21:41 |
| *** sekelso has quit IRC | 21:41 | |
| *** jklare has quit IRC | 21:44 | |
| *** aviau has quit IRC | 21:48 | |
| *** aviau has joined #openstack-infra | 21:51 | |
| *** jklare has joined #openstack-infra | 21:51 | |
| *** slaweq has quit IRC | 21:51 | |
| *** ijw has quit IRC | 21:53 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Refactor ensure-twine https://review.openstack.org/496945 | 21:56 |
| *** ijw has joined #openstack-infra | 21:56 | |
| *** xyang1 has quit IRC | 21:58 | |
| *** jamesmcarthur has joined #openstack-infra | 22:00 | |
| *** thorst_afk has joined #openstack-infra | 22:02 | |
| *** armax has quit IRC | 22:03 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add multinode base job https://review.openstack.org/496948 | 22:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Remove base playbooks https://review.openstack.org/496949 | 22:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/devstack-gate master: Use multinode base job for devstack base job https://review.openstack.org/496951 | 22:05 |
| *** ijw has quit IRC | 22:07 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Add a no-op job to test that the 'base' parent job works https://review.openstack.org/496952 | 22:08 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Add a no-op job to test that the 'base' parent job works https://review.openstack.org/496952 | 22:13 |
| *** jamesmcarthur has quit IRC | 22:14 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Zuul v3: add test playbook https://review.openstack.org/496442 | 22:14 |
| *** ihrachys has quit IRC | 22:18 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add multinode base job https://review.openstack.org/496948 | 22:20 |
| *** ijw has joined #openstack-infra | 22:20 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Squelch ara initializing message from log https://review.openstack.org/496955 | 22:20 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Remove base playbooks https://review.openstack.org/496949 | 22:20 |
| *** bobh has quit IRC | 22:21 | |
| *** thorst_afk has quit IRC | 22:21 | |
| *** thorst_afk has joined #openstack-infra | 22:21 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Refactor ensure-twine https://review.openstack.org/496945 | 22:24 |
| *** thorst_afk has quit IRC | 22:25 | |
| *** rlandy is now known as rlandy|bbl | 22:28 | |
| *** vhosakot has quit IRC | 22:29 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove excess debugging from playbook prep https://review.openstack.org/496956 | 22:29 |
| *** vhosakot has joined #openstack-infra | 22:29 | |
| *** vhosakot_ has joined #openstack-infra | 22:32 | |
| *** vhosakot has quit IRC | 22:34 | |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: put repos into $BASE/new https://review.openstack.org/496958 | 22:35 |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: create stack and tempest users https://review.openstack.org/496959 | 22:35 |
| *** marst has quit IRC | 22:36 | |
| *** wolverineav has quit IRC | 22:36 | |
| *** wolverineav has joined #openstack-infra | 22:37 | |
| jeblair | fungi, clarkb: when were we expecting jd back? (did we have a date?) | 22:39 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Squelch ara initializing message from log https://review.openstack.org/496955 | 22:39 |
| *** kjackal has quit IRC | 22:41 | |
| *** Swami has quit IRC | 22:41 | |
| *** wolverineav has quit IRC | 22:41 | |
| clarkb | I thought I heard this week, but fungi had that info iirc | 22:41 |
| *** thorst_afk has joined #openstack-infra | 22:42 | |
| *** thorst_afk has quit IRC | 22:42 | |
| gouthamr | hey folks, anyone know why a series of changes may not be ending up on the "check" pipeline? Ex: https://review.openstack.org/#/c/493331/ - The change is on top of HEAD, and "recheck"ed a bunch of times.. | 22:44 |
| gouthamr | ^ other related patches suffer the same fate: https://review.openstack.org/#/q/topic:doc-migration+project:openstack/manila+status:open | 22:45 |
| clarkb | gouthamr: looking | 22:45 |
| gouthamr | thank you clarkb | 22:45 |
| *** rbrndt has quit IRC | 22:47 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove excess debugging from playbook prep https://review.openstack.org/496956 | 22:48 |
| *** claudiub has quit IRC | 22:49 | |
| clarkb | gouthamr: the change itself appears fine. Depends on is merged and the parent is in gerrit and not out of date. My current guess is that you have skip if rules in the zuul layout that result in no jobs needing to be run for that change | 22:49 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Add a job to test emit-ara-html https://review.openstack.org/496952 | 22:49 |
| *** jamesmcarthur has joined #openstack-infra | 22:50 | |
| gouthamr | clarkb: oh... strange, we didn't modify project-config ourselves since Aug 19 (last patchset for that change that had jenkins +1) .. i'll take a look.. | 22:51 |
| clarkb | gouthamr: did the files change between patchsets? | 22:52 |
| clarkb | skip ifs are based on the files in the patchset | 22:53 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Add a job to test emit-ara-html https://review.openstack.org/496952 | 22:53 |
| *** csomerville has joined #openstack-infra | 22:54 | |
| gouthamr | clarkb: no new files were added, existing files were modified, one thing new was a "Needed-By" annotation in the commit message between the patches | 22:54 |
| *** jamesmcarthur has quit IRC | 22:55 | |
| *** sbezverk has joined #openstack-infra | 22:56 | |
| *** armax has joined #openstack-infra | 22:56 | |
| jeblair | Exception: Dependency cycle detected: 493663 in [u'493663'] | 22:56 |
| jeblair | gouthamr, clarkb: ^ that change seems related | 22:57 |
| jeblair | so there's a cycle somewhere in that network of changes | 22:57 |
| *** dave-mccowan has joined #openstack-infra | 22:57 | |
| *** cody-somerville has quit IRC | 22:57 | |
| jeblair | gouthamr: zuul ignores Needed-By, but it will still find those relationships by performing its own reverse queries | 22:57 |
| clarkb | ah | 22:58 |
| gouthamr | jeblair: ohh, that makes sense! each of those patches references a common base change as a change that it "Depends-On" | 22:59 |
| gouthamr | jeblair: can fix that part and try! :) | 22:59 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Add a job to test emit-ara-html https://review.openstack.org/496952 | 22:59 |
| *** csomerville has quit IRC | 23:00 | |
| *** signed8bit is now known as signed8bit_Zzz | 23:00 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Add a job to test emit-ara-html https://review.openstack.org/496952 | 23:01 |
| *** xarses has quit IRC | 23:02 | |
| jeblair | gouthamr: 493663 has a depends-on header that points to itself | 23:02 |
| clarkb | also you might consider using git's built in dag over depends-on for all these manilla change deps (that way git will force you to avoid loops) | 23:03 |
| gouthamr | jeblair: ouch, nice catch! | 23:04 |
| jeblair | infra-root: puppet run all is broken | 23:05 |
| jeblair | infra-root: 2017-08-23 23:00:08,460 p=17550 u=root | ERROR! Attempted to execute "/etc/ansible/hosts/openstack" as inventory script: Inventory script (/etc/ansible/hosts/openstack) had an execution error: Traceback (most recent call last): | 23:05 |
| jeblair | infra-root: keystoneauth1.exceptions.discovery.DiscoveryFailure: Could not determine a suitable URL for the plugin | 23:05 |
| gouthamr | clarkb: true, we started adding those breadcrumbs more for the reviewers' convenience because the new Gerrit interface isn't as intuitive in showing you the dag like the older one | 23:05 |
| clarkb | jeblair: does it say which cloud it broke on? | 23:06 |
| jeblair | nope | 23:06 |
| clarkb | ok /me tries `openstack catalog list` in a loop against all the clouds | 23:07 |
| jeblair | first error at 2017-08-23 16:46:33,413 | 23:07 |
| clarkb | infracloud vanilla looks like candidate (scanning to see if there are others) | 23:08 |
| gouthamr | jeblair clarkb: much thanks! fixed the issue now i think, 'rething being built fine now! | 23:09 |
| jeblair | gouthamr: you're welcome | 23:09 |
| clarkb | jeblair: ya I think it is infracloud vanilla | 23:09 |
| clarkb | apache is listening on port 5000 | 23:10 |
| jeblair | traffic there seems to have trailed off significantly | 23:10 |
| jeblair | clarkb: controller00? | 23:11 |
| clarkb | jeblair: ya | 23:11 |
| clarkb | jeblair: if you run `openstack --os-cloud openstackci-infracloud-vanilla catalog list` you'll get the error | 23:11 |
| clarkb | I'm going to run with --debug now and see if it gives any more info | 23:11 |
| clarkb | (did osc just release?) | 23:11 |
| clarkb | or keystoneauth? | 23:11 |
| *** vhosakot_ has quit IRC | 23:12 | |
| clarkb | no thats not it my venv does it too | 23:12 |
| jeblair | firefox says: The certificate expired on August 23, 2017, 6:26 AM. The current time is August 23, 2017, 4:12 PM. | 23:13 |
| clarkb | that is a really weird error message to get for that error | 23:14 |
| clarkb | --insecure works so that must be it | 23:14 |
| jeblair | clarkb: inasmuch as it doesn't say "hey the certificate expired" yeah, i agree :) | 23:14 |
| clarkb | or ssl failed | 23:15 |
| clarkb | because it totally seems to pass data back and forth including the api version | 23:15 |
| clarkb | whcih I wouldn't expect if ssl can't be set up in the first place | 23:15 |
| jeblair | unfortunately, since we don't have any operational docs on infra-cloud, i don't know how to go about fixing this | 23:16 |
| clarkb | its not using a snakeoil cert | 23:16 |
| clarkb | (in which case I'd just regen that) | 23:16 |
| jeblair | i heard someone say we had a ca or something | 23:16 |
| jeblair | #status log infracloud-vanilla is offline due to the keystone certificate expiring. this has also broken puppet-run-all on puppetmaster. | 23:17 |
| openstackstatus | jeblair: finished logging | 23:17 |
| clarkb | the contents of the file are set by hiera | 23:18 |
| jeblair | clarkb: chocolate has 1 month remaining | 23:18 |
| *** signed8bit_Zzz is now known as signed8bit | 23:19 | |
| clarkb | my hunch is that the ca if there is one lives on baremetal00 | 23:20 |
| pabelanger | oh | 23:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: create stack and tempest users https://review.openstack.org/496959 | 23:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: put repos into $BASE/new https://review.openstack.org/496958 | 23:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add start-fresh logging role https://review.openstack.org/496909 | 23:22 |
| clarkb | I'm digging around on that host now | 23:22 |
| pabelanger | jeblair: clarkb: do you need me to do anything? | 23:23 |
| clarkb | pabelanger: do you know where the certs for infracloud come from? if not helping to look into that would be good | 23:23 |
| pabelanger | ya, 1 sec | 23:23 |
| *** srobert has joined #openstack-infra | 23:24 | |
| pabelanger | clarkb: I think it is via puppet-infracloud module | 23:24 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Add a job to test emit-ara-html https://review.openstack.org/496952 | 23:24 |
| *** tosky has quit IRC | 23:25 | |
| pabelanger | infracloud_vanilla_ssl_cert_file_contents and infracloud_chocolate_ssl_cert_file_contents in hiera | 23:26 |
| *** srobert has quit IRC | 23:26 | |
| clarkb | pabelanger: right but did we use a ca to generate them? I'm guessing yes so that all the openstack services can trust each other | 23:26 |
| pabelanger | clarkb: no, they are selfsigned I think | 23:26 |
| clarkb | (though that is possible using self signed/snakeoilcerts too) | 23:26 |
| pabelanger | clarkb: snakeoil should be good in this case | 23:27 |
| clarkb | ya if I am reading s_client output properly I think that is correct | 23:28 |
| *** sree has joined #openstack-infra | 23:29 | |
| pabelanger | The certificate expired on August 23, 2017 at 9:26 AM. The current time is August 23, 2017 at 7:29 PM. | 23:29 |
| * clarkb goes to find if controll00.vanilla.ic.openstack.org has a snakeoil cert we can use | 23:29 | |
| pabelanger | that is what firefox is telling me | 23:29 |
| clarkb | ya | 23:29 |
| *** hongbin has quit IRC | 23:29 | |
| clarkb | and its certificate chain appears to be itself | 23:30 |
| *** eranrom_ has quit IRC | 23:30 | |
| pabelanger | ya, snakeoil.pem and controller00.vanilla.ic.openstack.org-keystone.pem are different | 23:31 |
| *** lennyb has quit IRC | 23:31 | |
| clarkb | in /etc/ssl/certs on vanilla there is a openstack_infra_ca.pem | 23:31 |
| clarkb | implying that we do have a ca somewhere /me goes looking again | 23:32 |
| *** lathiat has joined #openstack-infra | 23:32 | |
| pabelanger | notAfter=Aug 21 08:41:33 2026 GMT | 23:33 |
| pabelanger | is when snakeoil expires | 23:33 |
| * tonyb waves a lathiat .... long time no see | 23:33 | |
| *** sree has quit IRC | 23:33 | |
| clarkb | though the openssl.cnf implies no ca as its still set up for demo ca | 23:34 |
| *** baoli has joined #openstack-infra | 23:34 | |
| clarkb | ok openstack_infra_ca appears to be the self signed cert. So I think that is just there to be confusing | 23:36 |
| * clarkb wonders where that name comes from | 23:37 | |
| clarkb | it comes from puppet-infracloud | 23:38 |
| *** baoli has quit IRC | 23:39 | |
| clarkb | pabelanger: so ya I agree everything I see says self signed. Do we want to just go ahead with snakeoil because it is easy to regenerate and makes it clear that it is indeed self signed and all that? | 23:39 |
| clarkb | I guess step 0 in that is replacing content in hiera | 23:39 |
| clarkb | or we can generate a new self signed cert if we want a shorter expiration period | 23:39 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Handle Branches from Launchpad in Migration https://review.openstack.org/437469 | 23:40 |
| *** stakeda has joined #openstack-infra | 23:40 | |
| *** lennyb has joined #openstack-infra | 23:41 | |
| clarkb | I'm trying to find the openssl config used to generate the existing one | 23:43 |
| *** thorst_afk has joined #openstack-infra | 23:43 | |
| pabelanger | clarkb: I'm fine with snakeoil | 23:44 |
| *** eranrom has joined #openstack-infra | 23:44 | |
| clarkb | pabelanger: does snakeoil have the right common name? that would be the only thing to check I guess | 23:44 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Add a job to test emit-ara-html https://review.openstack.org/496952 | 23:45 |
| pabelanger | clarkb: I haven't checked | 23:46 |
| pabelanger | so, that might be a reason to regenerate | 23:46 |
| clarkb | Subject: CN=controller00.vanilla.ic.openstack.org | 23:47 |
| *** ijw has quit IRC | 23:47 | |
| clarkb | that looks good to me so ya I think we are good to use this key | 23:47 |
| clarkb | and I don't see any alt names on the old cert | 23:48 |
| *** thorst_afk has quit IRC | 23:48 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Adds Migration Documentation https://review.openstack.org/496439 | 23:49 |
| pabelanger | cool | 23:50 |
| *** dougwig has joined #openstack-infra | 23:50 | |
| *** dave-mccowan has quit IRC | 23:50 | |
| clarkb | looks like cert is in public hiera so I'll get a change up for that and once that is approved we'll have to update private hiera for the key | 23:51 |
| *** jascott1 has quit IRC | 23:52 | |
| *** jamesmcarthur has joined #openstack-infra | 23:52 | |
| *** jascott1 has joined #openstack-infra | 23:52 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Update infracloud-vanilla public ssl cert https://review.openstack.org/496964 | 23:56 |
| *** jamesmcarthur has quit IRC | 23:56 | |
| *** jascott1 has quit IRC | 23:57 | |
| clarkb | fungi: I'm not too terribly concerned with the length of time that cert is valid for because we explicitly use the same cert to trust itself in our clouds.yaml file. This means that if it were compromised we'd just rotate it out and we'd no longer trust the compromised key. But maybe I'm missing something we should be more careful about? | 23:57 |
| *** signed8bit is now known as signed8bit_Zzz | 23:57 | |
| clarkb | (I think if there were more users than us or this was a public service then we'd care more) | 23:57 |
| *** ijw has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!