*** mhickey has quit IRC | 00:02 | |
*** s-shiono has joined #openstack-infra | 00:02 | |
*** rbrndt has quit IRC | 00:03 | |
*** wolverineav has joined #openstack-infra | 00:03 | |
*** wolverineav has quit IRC | 00:08 | |
*** armax has quit IRC | 00:08 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Allow nodepool-release to push merge commits https://review.openstack.org/400452 | 00:10 |
---|---|---|
*** jhesketh has left #openstack-infra | 00:10 | |
*** jhesketh has joined #openstack-infra | 00:10 | |
jhesketh | jeblair: ^ | 00:10 |
openstackgerrit | Merged openstack-infra/irc-meetings: Add meeting for policy https://review.openstack.org/398500 | 00:13 |
openstackgerrit | Merged openstack-infra/irc-meetings: Add agenda link to Zuul meeting https://review.openstack.org/399796 | 00:16 |
*** onovy has quit IRC | 00:16 | |
*** peterlisak has quit IRC | 00:18 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Merge branch 'master' into workingv3 https://review.openstack.org/389470 | 00:18 |
openstackgerrit | Merged openstack-infra/irc-meetings: Change time for the FWaaS team meeting. https://review.openstack.org/393793 | 00:21 |
*** armax has joined #openstack-infra | 00:22 | |
*** EricGonczer_ has joined #openstack-infra | 00:22 | |
*** mmandel has joined #openstack-infra | 00:25 | |
*** jgriffith has quit IRC | 00:25 | |
*** jgriffith has joined #openstack-infra | 00:26 | |
*** gmann has quit IRC | 00:28 | |
*** gmann has joined #openstack-infra | 00:28 | |
*** mmandel has quit IRC | 00:29 | |
openstackgerrit | Merged openstack-infra/project-config: Allow nodepool-release to push merge commits https://review.openstack.org/400452 | 00:29 |
*** armax has quit IRC | 00:30 | |
*** jgriffith has quit IRC | 00:30 | |
*** rbuzatu has joined #openstack-infra | 00:32 | |
*** wolverineav has joined #openstack-infra | 00:32 | |
*** lcastell has quit IRC | 00:32 | |
*** jgriffith has joined #openstack-infra | 00:33 | |
*** armax has joined #openstack-infra | 00:36 | |
*** mtan_____ has joined #openstack-infra | 00:36 | |
*** rbuzatu has quit IRC | 00:36 | |
*** jgriffith has quit IRC | 00:36 | |
*** wolverineav has quit IRC | 00:37 | |
*** mtanino has quit IRC | 00:37 | |
*** dimtruck is now known as zz_dimtruck | 00:39 | |
*** lcastell has joined #openstack-infra | 00:39 | |
*** hongbin has quit IRC | 00:43 | |
*** mriedem has joined #openstack-infra | 00:45 | |
*** mdrabe has quit IRC | 00:45 | |
openstackgerrit | Adam Gandelman proposed openstack-infra/zuul: Re-enable test_success_pattern as test_success_url https://review.openstack.org/400455 | 00:46 |
*** peterlisak has joined #openstack-infra | 00:50 | |
*** onovy has joined #openstack-infra | 00:50 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul: Correct logic problem with job trees https://review.openstack.org/400456 | 00:53 |
*** thorst has joined #openstack-infra | 00:54 | |
*** EricGonczer_ has quit IRC | 00:55 | |
zigo | fungi: When they started os-api-ref, I've noticed the non-free files, and wrote about it on the list. Then I've been told that it would never be used but for publishing the docs on openstack.org. Later on, everyone included the lib, and now we really do have a bug. :P | 00:56 |
* zigo continues reading the backlog. | 00:56 | |
jeblair | pabelanger, mordred, jhesketh, ianw: "topic:nodepool-zuulv3" patches to puppet-nodepool lgtm. i'm about to eod, but if someone who can keep an eye wants to approve them before i wake up tomorrow, that would be swell. | 00:58 |
*** thorst has quit IRC | 00:59 | |
jeblair | then next step is to make a change to create 'nodepool-builder01.o.o' (!) | 01:00 |
*** Julien-zte has joined #openstack-infra | 01:00 | |
ianw | jeblair: ok, looks like they shouldn't modify the status quo... | 01:01 |
jeblair | ianw: yeah, that's the intent | 01:01 |
ianw | jeblair: if you want to approve them, i will keep an eye on nodepool to make sure it's still running | 01:01 |
jhesketh | jeblair: yep, I've +w'd them | 01:02 |
jhesketh | ianw: sorry, went off to read them before I saw your comments | 01:02 |
jhesketh | but I'm around to watch too | 01:02 |
*** Julien-zte has quit IRC | 01:02 | |
zigo | fungi: Believe me, by-hand managing merge conflict as the upstream changes for non-free files is really what we want to do for Debian. | 01:03 |
*** Julien-zte has joined #openstack-infra | 01:04 | |
openstackgerrit | Merged openstack-infra/puppet-nodepool: include ::diskimage_builder in builder.pp too https://review.openstack.org/356484 | 01:06 |
*** Julien-zte has quit IRC | 01:08 | |
*** Julien-zte has joined #openstack-infra | 01:08 | |
*** armax has quit IRC | 01:08 | |
*** Julien-zte has quit IRC | 01:08 | |
*** Julien-zte has joined #openstack-infra | 01:09 | |
*** armax has joined #openstack-infra | 01:09 | |
*** Julien-zte has quit IRC | 01:09 | |
*** Julien-zte has joined #openstack-infra | 01:10 | |
openstackgerrit | Merged openstack-infra/puppet-nodepool: Add option not to install nodepool-builder from init.pp https://review.openstack.org/399742 | 01:10 |
*** pvaneck has quit IRC | 01:11 | |
*** Swami has quit IRC | 01:12 | |
ianw | https://review.openstack.org/400311 makes me wish i was teaching operating systems again. some nice "why do you think this happens" questions to analyse :) | 01:12 |
*** tuanluong has joined #openstack-infra | 01:15 | |
*** Julien-zte has quit IRC | 01:16 | |
*** newmember has quit IRC | 01:17 | |
*** Julien-zte has joined #openstack-infra | 01:17 | |
*** EricGonczer_ has joined #openstack-infra | 01:19 | |
*** rfolco has joined #openstack-infra | 01:21 | |
*** Julien-zte has quit IRC | 01:21 | |
*** Julien-z_ has joined #openstack-infra | 01:22 | |
*** Sukhdev has quit IRC | 01:23 | |
openstackgerrit | Merged openstack-infra/shade: Add docstring for create_image_snapshot https://review.openstack.org/400446 | 01:26 |
*** EricGonczer_ has quit IRC | 01:28 | |
*** dave-mccowan has joined #openstack-infra | 01:30 | |
*** yanyanhu has joined #openstack-infra | 01:32 | |
*** zhurong has joined #openstack-infra | 01:41 | |
*** Apoorva has quit IRC | 01:41 | |
*** zz_dimtruck is now known as dimtruck | 01:41 | |
openstackgerrit | Bob Ball proposed openstack-infra/project-config: Use custom group to release os-xenapi https://review.openstack.org/400153 | 01:42 |
fungi | zigo: yep, it sounds un-fun and the sourceless font and js inclusions sound like things we should solve together as a community. i'm personally disappointed that as an upstream we have non-dfsg-free files in git repos for official openstack deliverables | 01:43 |
openstackgerrit | Michael Johnson proposed openstack-infra/project-config: Consolidate neutron-lbaas API tests https://review.openstack.org/386245 | 01:49 |
*** jgriffith has joined #openstack-infra | 01:49 | |
sc68cal | ianw: hmmmmmmmmmmmm :) | 01:50 |
mriedem | wow we might need to think about skipping some tests http://status.openstack.org//elastic-recheck/index.html#1642111 | 01:50 |
mriedem | smcginnis: has anyone from cinder been looking into ^? | 01:51 |
mriedem | that's by far the top gate faliure | 01:51 |
mriedem | *failure | 01:51 |
*** mtanino has joined #openstack-infra | 01:56 | |
*** mtan_____ has quit IRC | 01:57 | |
*** wolverineav has joined #openstack-infra | 02:01 | |
openstackgerrit | Rui Zang proposed openstack-infra/project-config: Set DEVSTACK_GATE_REMOVE_STACK_SUDO=0 for networking-odl fullstack https://review.openstack.org/400281 | 02:01 |
*** mtanino has quit IRC | 02:04 | |
*** wolverineav has quit IRC | 02:06 | |
*** dave-mccowan has quit IRC | 02:07 | |
*** jogo has quit IRC | 02:07 | |
*** gongysh has joined #openstack-infra | 02:08 | |
*** hongbin has joined #openstack-infra | 02:09 | |
*** sdake has joined #openstack-infra | 02:10 | |
*** wolverineav has joined #openstack-infra | 02:11 | |
*** jgriffith has quit IRC | 02:12 | |
*** sdake_ has quit IRC | 02:13 | |
*** derekjhyang has joined #openstack-infra | 02:13 | |
*** armax has quit IRC | 02:14 | |
mriedem | this is the workaround for now https://review.openstack.org/#/c/400465/ | 02:15 |
mriedem | it's the thinly provisioned lvm volumes that's causing the random snapshot failure | 02:15 |
mriedem | Nov 15 22:06:36 ubuntu-xenial-osic-cloud1-s3700-5383810 kernel: device-mapper: table: 252:4: thin: Unable to activate thin device while pool is suspended | 02:15 |
mriedem | Nov 15 22:06:36 ubuntu-xenial-osic-cloud1-s3700-5383810 kernel: device-mapper: ioctl: error adding target to table | 02:15 |
mriedem | do we have any devstack cores around? https://review.openstack.org/#/c/400465/ | 02:16 |
*** wolverineav has quit IRC | 02:16 | |
mriedem | mtreinish: ^ | 02:16 |
mriedem | 200+ failures in the check/gate in the last 10 days due to that | 02:16 |
mriedem | sc68cal: ^ | 02:17 |
*** tiswanso has joined #openstack-infra | 02:18 | |
sc68cal | mriedem: ok let's rip it back out then | 02:18 |
*** tiswanso has quit IRC | 02:18 | |
mriedem | at first i thought it was an lvm2 package update in xenial but we're using the latest version which is from april | 02:18 |
mriedem | so it's not that | 02:18 |
mriedem | syslog told the tale | 02:18 |
*** tiswanso has joined #openstack-infra | 02:18 | |
*** tdasilva has quit IRC | 02:19 | |
sc68cal | mriedem: +2'd | 02:20 |
*** armax has joined #openstack-infra | 02:20 | |
mriedem | thanks | 02:20 |
*** armax has quit IRC | 02:21 | |
*** wolverineav has joined #openstack-infra | 02:21 | |
*** tdasilva has joined #openstack-infra | 02:21 | |
*** wolverineav has quit IRC | 02:25 | |
*** hrubi has quit IRC | 02:35 | |
*** tqtran has quit IRC | 02:36 | |
pabelanger | jeblair: ianw: mordred: jhesketh: We still have a little more work to do before we can launch nodepool-builder01.o.o (nb01.o.o?) need to create a common.pp file for shared bits | 02:36 |
*** Alagar has joined #openstack-infra | 02:37 | |
*** hrubi has joined #openstack-infra | 02:39 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Correct signing key export instructions https://review.openstack.org/400469 | 02:40 |
*** s-shiono_ has joined #openstack-infra | 02:41 | |
*** s-shiono has quit IRC | 02:45 | |
openstackgerrit | Michael Johnson proposed openstack-infra/project-config: Consolidate neutron-lbaas API tests https://review.openstack.org/386245 | 02:45 |
*** hrubi has quit IRC | 02:48 | |
*** yamamoto_ has joined #openstack-infra | 02:48 | |
*** tjones has quit IRC | 02:49 | |
*** wolverineav has joined #openstack-infra | 02:50 | |
*** hrubi has joined #openstack-infra | 02:50 | |
openstackgerrit | Tuan Luong-Anh proposed openstack-infra/gear: Replace assertEquals with assertEqual https://review.openstack.org/400472 | 02:51 |
*** Jeffrey4l has joined #openstack-infra | 02:53 | |
*** wolverineav has quit IRC | 02:55 | |
fungi | adarazs: sorry for the delay. i've pushed the two branches from https://github.com/adarazs/tripleo-quickstart-extras into the openstack/tripleo-quickstart-extras repo in review.openstack.org, and see them matching on our git farm now: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras | 02:55 |
*** yamamoto_ has quit IRC | 02:57 | |
*** yamamoto_ has joined #openstack-infra | 03:00 | |
*** kaisers has quit IRC | 03:01 | |
openstackgerrit | Jeffrey Zhang proposed openstack-infra/project-config: Install docker-engine by using builder in kolla and kolla-ansible https://review.openstack.org/400474 | 03:04 |
*** zhurong has quit IRC | 03:05 | |
*** zhurong has joined #openstack-infra | 03:06 | |
cloudnull | evenings | 03:06 |
*** sdake has quit IRC | 03:07 | |
*** rfolco has quit IRC | 03:08 | |
*** wolverineav has joined #openstack-infra | 03:10 | |
*** tnovacik has joined #openstack-infra | 03:12 | |
Alagar | Iam trying to integrate openstack with xen | 03:12 |
Alagar | i have installed openstack using devstack script top of xen hypervisor, in this open stack as a virtual machine. | 03:12 |
Alagar | when i create instance in openstack, the instance should create in xen hypervisor. but its not happening. | 03:12 |
Alagar | Some one could you please guide me please | 03:12 |
*** kaisers has joined #openstack-infra | 03:14 | |
*** tnovacik has quit IRC | 03:14 | |
*** jogo has joined #openstack-infra | 03:15 | |
*** jogo has quit IRC | 03:15 | |
*** jogo has joined #openstack-infra | 03:15 | |
*** wolverineav has quit IRC | 03:15 | |
*** jogo has quit IRC | 03:20 | |
*** wolverineav has joined #openstack-infra | 03:20 | |
*** knangia has quit IRC | 03:23 | |
*** wolverineav has quit IRC | 03:25 | |
EmilienM | ianw: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/stackviz/install.d/89-prepare-stackviz | 03:26 |
EmilienM | if the npm is not found, script won't fail. | 03:27 |
ianw | ah, well, yeah | 03:27 |
ianw | no wonder nobody has looked at it :) | 03:27 |
EmilienM | ianw: i'm failing to reproduce tonight but if nobody takes it, i'll try later this week or so | 03:27 |
EmilienM | it sounds like a packaging thing in centos | 03:27 |
EmilienM | I could deploy npm on my fedora | 03:27 |
ianw | EmilienM: yeah, not sure ... we've got at least one problem with grub and fedora builds atm which i'm looking at, and possibly another with centos & service enablement. | 03:29 |
timothyb89 | EmilienM, ianw: it might be related to this workaround: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/stackviz/pkg-map#n5 | 03:29 |
*** wolverineav has joined #openstack-infra | 03:30 | |
*** vikrant has joined #openstack-infra | 03:31 | |
*** yamahata has quit IRC | 03:32 | |
fungi | Alagar: you may have misunderstood the topic of this channel. it's not for discussion of running an infrastructure that uses openstack, it's for running the infrastructure that enables the development of openstack (code review system, continuous integration and testing toolchain, mailing lists, wiki server, irc bots, et cetera) | 03:34 |
*** isviridov_away has quit IRC | 03:34 | |
*** wolverineav has quit IRC | 03:34 | |
fungi | Alagar: you're probably looking for #openstack (general discussion about running and using openstack) or #openstack-dev (discussion of developing openstack) | 03:35 |
*** snarwade has joined #openstack-infra | 03:35 | |
*** jgriffith has joined #openstack-infra | 03:35 | |
jeblair | i just typed 'rmkdir'. i'm not sure what i expected my shell to do. | 03:36 |
*** jgriffith has quit IRC | 03:36 | |
fungi | that should be a no-op | 03:37 |
clarkb | or maybe it deletes recursively to give you an empty dir? | 03:37 |
clarkb | just like new! | 03:37 |
fungi | rmkdir(1) atomically create a directory and then remove it again | 03:38 |
fungi | [implementation: symlink to /bin/true] | 03:38 |
*** armax has joined #openstack-infra | 03:39 | |
jeblair | fungi: but if you reverse the order of the arguments, it does the opposite. | 03:39 |
fungi | now my brain hurts | 03:39 |
fungi | perhaps that will still work if you run the system clock in reverse | 03:39 |
*** wolverineav has joined #openstack-infra | 03:40 | |
jeblair | fungi: is that why your workstation is up on blocks? | 03:40 |
* fungi sighs at excellent 80s film reference | 03:41 | |
*** mriedem has quit IRC | 03:41 | |
* clarkb feels a woosh go by | 03:42 | |
fungi | bueller? | 03:42 |
jeblair | clarkb: http://www.imdb.com/title/tt0091042/ | 03:42 |
clarkb | was the car on cinder blocks? | 03:43 |
jeblair | it might have been jacks? | 03:43 |
fungi | one of those | 03:43 |
fungi | until it wasn't, suddenly | 03:43 |
clarkb | even then I wouldn't have gotten it :) | 03:43 |
*** mmandel has joined #openstack-infra | 03:43 | |
jeblair | then it was on trees, iirc | 03:44 |
fungi | more or less, yes | 03:44 |
*** wolverineav has quit IRC | 03:44 | |
*** hichihara has joined #openstack-infra | 03:45 | |
* fungi calls it a night and does things which involve more pie and less computer | 03:45 | |
clarkb | I don't have pie | 03:45 |
jeblair | clarkb: :( | 03:45 |
fungi | i didn't until a few minutes ago when i moved it to a cooling rack | 03:46 |
clarkb | I did find my second bottle of hawaiian moonshine though | 03:46 |
fungi | that sounds at least as good | 03:46 |
clarkb | so now I need tropical fruit drink makings for thursday | 03:46 |
*** psachin has joined #openstack-infra | 03:47 | |
*** mmandel has quit IRC | 03:47 | |
openstackgerrit | Chaoyi Huang proposed openstack-infra/project-config: Update jobs in Tricircle project https://review.openstack.org/400493 | 03:49 |
*** wolverineav has joined #openstack-infra | 03:49 | |
*** hongbin has quit IRC | 03:51 | |
*** tjones has joined #openstack-infra | 03:52 | |
*** Odd_Bloke has quit IRC | 03:53 | |
*** gongysh has quit IRC | 03:54 | |
*** wolverineav has quit IRC | 03:54 | |
*** isviridov_away has joined #openstack-infra | 03:54 | |
*** hongbin has joined #openstack-infra | 03:55 | |
*** Odd_Bloke has joined #openstack-infra | 03:56 | |
*** wolverineav has joined #openstack-infra | 03:59 | |
*** esikache1 has joined #openstack-infra | 04:04 | |
*** wolverineav has quit IRC | 04:04 | |
*** thorst has joined #openstack-infra | 04:06 | |
*** links has joined #openstack-infra | 04:08 | |
*** esikache1 has quit IRC | 04:08 | |
*** rbuzatu has joined #openstack-infra | 04:08 | |
*** wolverineav has joined #openstack-infra | 04:09 | |
*** gildub has joined #openstack-infra | 04:11 | |
*** sdake has joined #openstack-infra | 04:13 | |
*** rbuzatu has quit IRC | 04:13 | |
*** hongbin has quit IRC | 04:13 | |
*** wolverineav has quit IRC | 04:14 | |
*** sdake_ has joined #openstack-infra | 04:14 | |
*** yamamoto_ has quit IRC | 04:17 | |
*** sdake has quit IRC | 04:18 | |
*** tiswanso has quit IRC | 04:18 | |
*** wolverineav has joined #openstack-infra | 04:19 | |
*** ijw has quit IRC | 04:20 | |
*** wolverineav has quit IRC | 04:23 | |
*** adriant has quit IRC | 04:24 | |
*** gongysh has joined #openstack-infra | 04:24 | |
*** yamamoto_ has joined #openstack-infra | 04:25 | |
*** yamamoto_ has quit IRC | 04:27 | |
*** wolverineav has joined #openstack-infra | 04:29 | |
*** inc0 has quit IRC | 04:29 | |
*** kong has quit IRC | 04:30 | |
*** alexey_weyl has joined #openstack-infra | 04:31 | |
alexey_weyl | Hi, | 04:31 |
*** yamamoto_ has joined #openstack-infra | 04:32 | |
alexey_weyl | Can you please approve this change: https://review.openstack.org/#/c/400243/4 | 04:33 |
*** Alagar has quit IRC | 04:33 | |
*** wolverineav has quit IRC | 04:33 | |
*** rlandy has quit IRC | 04:33 | |
*** Alagar has joined #openstack-infra | 04:33 | |
*** tqtran has joined #openstack-infra | 04:34 | |
*** yamamoto_ has quit IRC | 04:34 | |
*** alexey_weyl has quit IRC | 04:34 | |
*** flwang1 has quit IRC | 04:37 | |
*** wolverineav has joined #openstack-infra | 04:39 | |
*** tlian has quit IRC | 04:40 | |
openstackgerrit | Merged openstack-infra/project-config: Change node to xenial. https://review.openstack.org/400243 | 04:40 |
*** wolverineav has quit IRC | 04:43 | |
*** drifterza has quit IRC | 04:44 | |
openstackgerrit | Tuan Luong-Anh proposed openstack/diskimage-builder: Replace six.iteritems() with .items() https://review.openstack.org/400514 | 04:48 |
*** wolverineav has joined #openstack-infra | 04:48 | |
*** wolverineav has quit IRC | 04:53 | |
*** Sukhdev has joined #openstack-infra | 04:57 | |
*** wolverineav has joined #openstack-infra | 04:58 | |
*** drifterza has joined #openstack-infra | 05:01 | |
*** yamamoto_ has joined #openstack-infra | 05:02 | |
*** wolverineav has quit IRC | 05:03 | |
*** yamamoto_ has quit IRC | 05:03 | |
*** Alagar has quit IRC | 05:04 | |
*** Alagar has joined #openstack-infra | 05:06 | |
*** thorst has quit IRC | 05:08 | |
*** yamamoto_ has joined #openstack-infra | 05:09 | |
openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Revise ACLs for networking-[onos|l2gw] projects https://review.openstack.org/399798 | 05:18 |
*** yamamoto_ has quit IRC | 05:21 | |
*** sandanar has joined #openstack-infra | 05:24 | |
*** sdake_ has quit IRC | 05:24 | |
*** sdake has joined #openstack-infra | 05:26 | |
*** wolverineav has joined #openstack-infra | 05:28 | |
*** sdake has quit IRC | 05:30 | |
*** dkehn__ has joined #openstack-infra | 05:31 | |
*** wolverineav has quit IRC | 05:32 | |
openstackgerrit | Hoolio Wobbits proposed openstack-infra/shade: Added documentation for delete_image() https://review.openstack.org/400519 | 05:33 |
Jeffrey4l | i got POST_FAILURE, see the jobs is killed when timeout, so the log is not collected. is there any way to collect console.log when timeout? https://review.openstack.org/#/c/400488/1 | 05:33 |
*** dkehn_ has quit IRC | 05:33 | |
*** dkehn_ has joined #openstack-infra | 05:37 | |
*** dkehn__ has quit IRC | 05:38 | |
*** hurgleburgler has quit IRC | 05:39 | |
*** winggundamth has quit IRC | 05:40 | |
*** winggundamth has joined #openstack-infra | 05:41 | |
*** mmandel has joined #openstack-infra | 05:44 | |
openstackgerrit | Hoolio Wobbits proposed openstack-infra/shade: Added documentation for delete_image() https://review.openstack.org/400519 | 05:44 |
openstackgerrit | Hoolio Wobbits proposed openstack-infra/shade: Added documentation for delete_image() https://review.openstack.org/400519 | 05:46 |
*** mmandel has quit IRC | 05:49 | |
openstackgerrit | Hoolio Wobbits proposed openstack-infra/shade: Added documentation for delete_image() https://review.openstack.org/400519 | 05:51 |
*** ad_rien_ has joined #openstack-infra | 05:52 | |
*** ad_rien_ has quit IRC | 05:52 | |
*** ad_rien_ has joined #openstack-infra | 05:52 | |
hoolio | ah yes, look at all that. soz guys | 05:53 |
*** rbuzatu has joined #openstack-infra | 05:57 | |
*** senk has joined #openstack-infra | 05:59 | |
*** Julien-zte has joined #openstack-infra | 05:59 | |
*** Julien-z_ has quit IRC | 06:00 | |
*** thorst has joined #openstack-infra | 06:00 | |
*** rbuzatu has quit IRC | 06:01 | |
*** ad_rien_ has joined #openstack-infra | 06:02 | |
*** yamamoto_ has joined #openstack-infra | 06:02 | |
*** claudiub has joined #openstack-infra | 06:03 | |
*** esikache1 has joined #openstack-infra | 06:04 | |
*** ad_rien_ has quit IRC | 06:06 | |
*** drifterza has quit IRC | 06:07 | |
*** thorst has quit IRC | 06:08 | |
*** esikache1 has quit IRC | 06:09 | |
*** jaosorior has joined #openstack-infra | 06:17 | |
frickler | Jeffrey4l: I think disabling v6 on your testing node is a bad idea, lots of them only have v6 as external connectivity these days. if you remove external connectivity, there's no chance to get anything back from that node | 06:20 |
*** abregman has joined #openstack-infra | 06:23 | |
Jeffrey4l | frickler, got. i will try to enable ipv6 and check whether it will collect the logs. | 06:25 |
*** chandankumar has joined #openstack-infra | 06:31 | |
*** pgadiya has joined #openstack-infra | 06:32 | |
clarkb | frickler: Jeffrey4l correct, disabling ipv6 will break your tests | 06:33 |
clarkb | also fallocate will be slightly faster than dd for the swapfile but can only be used reliably on ext fses | 06:34 |
Jeffrey4l | roger. thanks. | 06:36 |
*** yamahata has joined #openstack-infra | 06:39 | |
openstackgerrit | Tuan Luong-Anh proposed openstack/diskimage-builder: Replace six.iteritems() with .items() https://review.openstack.org/400514 | 06:43 |
openstackgerrit | Renat Akhmerov proposed openstack-infra/project-config: Add mistral gate for mysql unit tests https://review.openstack.org/400535 | 06:45 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/400536 | 06:46 |
*** jaosorior has quit IRC | 06:49 | |
*** jaosorior has joined #openstack-infra | 06:49 | |
*** oanson has joined #openstack-infra | 06:51 | |
*** senk has quit IRC | 06:52 | |
*** thorst has joined #openstack-infra | 06:56 | |
*** wolverineav has joined #openstack-infra | 06:56 | |
*** fandi has joined #openstack-infra | 07:00 | |
*** esikache1 has joined #openstack-infra | 07:00 | |
*** NBziouech has quit IRC | 07:01 | |
*** wolverineav has quit IRC | 07:01 | |
*** flepied has joined #openstack-infra | 07:02 | |
openstackgerrit | liusheng proposed openstack-infra/project-config: Enable Nimble tempest plugin test https://review.openstack.org/400539 | 07:03 |
*** rfolco has joined #openstack-infra | 07:04 | |
*** thorst has quit IRC | 07:04 | |
*** yuval has joined #openstack-infra | 07:04 | |
*** rfolco has quit IRC | 07:04 | |
openstackgerrit | Merged openstack-infra/project-config: n8g-bgpvpn and n8g-bagpipe fixes for grafana jobs https://review.openstack.org/398485 | 07:04 |
*** nherciu has joined #openstack-infra | 07:06 | |
*** wolverineav has joined #openstack-infra | 07:06 | |
*** tjones has quit IRC | 07:10 | |
*** wolverineav has quit IRC | 07:11 | |
*** hashar has joined #openstack-infra | 07:12 | |
*** rbuzatu_ has joined #openstack-infra | 07:13 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Catch errors in DIB_INIT_SYSTEM export https://review.openstack.org/400542 | 07:14 |
openstackgerrit | Renat Akhmerov proposed openstack-infra/project-config: Add mistral gate for mysql unit tests https://review.openstack.org/400535 | 07:20 |
openstackgerrit | Ian Wienand proposed openstack-infra/puppet-diskimage_builder: Revert "Add a use_git flag" https://review.openstack.org/400545 | 07:23 |
*** drifterza has joined #openstack-infra | 07:28 | |
AJaeger | ianw: could you review https://review.openstack.org/399105, https://review.openstack.org/399079, and https://review.openstack.org/399667 for project-config, please? | 07:28 |
*** senk has joined #openstack-infra | 07:30 | |
*** jtomasek has joined #openstack-infra | 07:32 | |
*** sdake has joined #openstack-infra | 07:33 | |
*** tovin07 has quit IRC | 07:33 | |
*** sdake_ has joined #openstack-infra | 07:34 | |
ianw | AJaeger: i'm not sure way if we want to do that, you don't just call it as part of the tox command? | 07:34 |
ianw | maybe we've dropped sudo by that point i guess | 07:35 |
*** ad_rien_ has joined #openstack-infra | 07:35 | |
*** ad_rien_ has quit IRC | 07:35 | |
*** tovin07_ has joined #openstack-infra | 07:36 | |
AJaeger | ianw: it's before the revoke-sudo call, so should work at this place | 07:37 |
*** sdake has quit IRC | 07:38 | |
ianw | AJaeger: what i mean is, that the primary reason for *not* just doing this as part of the tox command is that we have root at this point? | 07:38 |
AJaeger | We had some discussion last week about this - with fungi and jeblair . But if you have concerns. | 07:38 |
*** chandankumar has quit IRC | 07:38 | |
ianw | not really, just trying to understand when you'd put something in there, and when not | 07:38 |
AJaeger | The point is we can remove the unneeded db setup - and similar setup for searchlight | 07:39 |
AJaeger | Let me get a quote from fungi on this one ;) | 07:39 |
*** chandankumar has joined #openstack-infra | 07:39 | |
AJaeger | ianw: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-11-17.log.html#t2016-11-17T15:09:36 | 07:41 |
openstackgerrit | liusheng proposed openstack-infra/project-config: Enable Nimble tempest plugin test https://review.openstack.org/400539 | 07:41 |
AJaeger | So, basically, the goal is to get rid of the specific db setup and move that to the repos. | 07:41 |
AJaeger | For example, we have a nodepool bindep.txt addition that adds postgres and mysql - but the project only needs mysql. So, if we move this over, we can setup only postgres and don't need to setup mysql - and have it properly documented what is needed. | 07:42 |
*** jtomasek has quit IRC | 07:44 | |
*** jtomasek_ has joined #openstack-infra | 07:44 | |
ianw | AJaeger: ok, my thought was more "why can't tox just run this" but I think, as i say, i've realised that we've dropped root by the time we run tox, so it can't do this setup | 07:44 |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/400566 | 07:44 |
AJaeger | ianw: YEs, exactly. We cannot run this as part of tox without root. | 07:45 |
*** senk has quit IRC | 07:48 | |
*** daemontool has joined #openstack-infra | 07:48 | |
*** saibarspeis has joined #openstack-infra | 07:51 | |
*** fandi__ has joined #openstack-infra | 07:51 | |
*** thorst has joined #openstack-infra | 07:51 | |
*** ralonsoh has joined #openstack-infra | 07:51 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/nodepool: Add tools/test-setup.sh https://review.openstack.org/399079 | 07:52 |
AJaeger | ianw: better? ^ | 07:52 |
*** armax has quit IRC | 07:52 | |
*** senk has joined #openstack-infra | 07:53 | |
*** fandi has quit IRC | 07:55 | |
*** pcaruana has joined #openstack-infra | 07:56 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/nodepool: Add tools/test-setup.sh https://review.openstack.org/399177 | 07:56 |
*** matrohon has joined #openstack-infra | 07:57 | |
*** berendt has joined #openstack-infra | 07:57 | |
*** thorst has quit IRC | 07:58 | |
*** esikache1 has quit IRC | 07:59 | |
*** esikachev has joined #openstack-infra | 07:59 | |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/400566 | 08:01 |
*** Sukhdev has quit IRC | 08:06 | |
*** pgadiya has quit IRC | 08:09 | |
*** gouthamr has joined #openstack-infra | 08:12 | |
openstackgerrit | Masayuki Igawa proposed openstack/gertty: [WIP] Make size column configurable a graph https://review.openstack.org/380950 | 08:14 |
*** rcernin_ has joined #openstack-infra | 08:14 | |
*** flepied has quit IRC | 08:16 | |
*** florianf has joined #openstack-infra | 08:19 | |
*** arxcruz has joined #openstack-infra | 08:20 | |
BobBall | Just asking because I don't see any discussion on it - are people aware that the gate is blocked? | 08:26 |
BobBall | oh... maybe it's not | 08:27 |
*** ssbarnea has joined #openstack-infra | 08:29 | |
*** ad_rien_ has joined #openstack-infra | 08:29 | |
*** dingyichen has quit IRC | 08:31 | |
*** Hal has joined #openstack-infra | 08:35 | |
*** Hal is now known as Guest98237 | 08:35 | |
*** mmandel has joined #openstack-infra | 08:35 | |
*** daemontool has quit IRC | 08:37 | |
*** tqtran has quit IRC | 08:38 | |
*** mmandel has quit IRC | 08:40 | |
*** rbuzatu_ has quit IRC | 08:40 | |
*** amoralej|off is now known as amoralej | 08:40 | |
*** thorst has joined #openstack-infra | 08:40 | |
*** jpena|off is now known as jpena | 08:41 | |
openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Update fedora-atomic build job to 24 https://review.openstack.org/400598 | 08:43 |
*** hogepodge has quit IRC | 08:45 | |
*** nmagnezi has joined #openstack-infra | 08:45 | |
*** thorst has quit IRC | 08:48 | |
*** s-shiono_ has quit IRC | 08:52 | |
*** sdake_ is now known as sdake | 08:52 | |
*** ad_rien_ has quit IRC | 08:55 | |
*** ad_rien_ has joined #openstack-infra | 08:56 | |
openstackgerrit | liusheng proposed openstack-infra/project-config: Enable Nimble tempest plugin test https://review.openstack.org/400539 | 08:56 |
*** jpich has joined #openstack-infra | 08:57 | |
*** sdake has quit IRC | 08:57 | |
*** rossella__ has joined #openstack-infra | 08:57 | |
*** flepied has joined #openstack-infra | 08:58 | |
*** pgadiya has joined #openstack-infra | 09:00 | |
*** zzzeek has quit IRC | 09:00 | |
*** zzzeek has joined #openstack-infra | 09:01 | |
*** martinkopec has joined #openstack-infra | 09:04 | |
*** panda|zZ is now known as panda | 09:04 | |
*** gongysh has quit IRC | 09:05 | |
openstackgerrit | Michal Dulko proposed openstack-infra/project-config: Set Cinder multinode grenade on master to xenial https://review.openstack.org/394496 | 09:06 |
openstackgerrit | Pascal Mazon proposed openstack-infra/project-config: Add 6WIND Virtual Accelerator Charm https://review.openstack.org/400621 | 09:07 |
*** NBziouech has joined #openstack-infra | 09:09 | |
*** pgadiya has quit IRC | 09:11 | |
openstackgerrit | Michal Dulko proposed openstack-infra/project-config: Set Cinder multinode grenade on master to xenial https://review.openstack.org/394496 | 09:14 |
*** isaacb has joined #openstack-infra | 09:14 | |
*** dmanchad has quit IRC | 09:15 | |
*** tpsilva has joined #openstack-infra | 09:16 | |
*** dmanchad has joined #openstack-infra | 09:16 | |
*** dtantsur|afk is now known as dtantsur | 09:18 | |
*** mhickey has joined #openstack-infra | 09:21 | |
openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config: [magnum] Update fedora-atomic build job to 24 https://review.openstack.org/400598 | 09:22 |
*** gildub has quit IRC | 09:22 | |
*** mmoster_ has joined #openstack-infra | 09:25 | |
*** pgadiya has joined #openstack-infra | 09:26 | |
*** Julien-zte has quit IRC | 09:27 | |
*** rcarrillocruz has quit IRC | 09:29 | |
*** lucas-afk is now known as lucasagomes | 09:31 | |
*** rossella__ has quit IRC | 09:31 | |
*** rossella__ has joined #openstack-infra | 09:31 | |
*** mmoster_ has quit IRC | 09:32 | |
*** ricky1 has joined #openstack-infra | 09:33 | |
*** ricky1 is now known as rcarrillocruz | 09:33 | |
openstackgerrit | Noam Angel proposed openstack/diskimage-builder: add option to configure cloud-init to allow password authentication https://review.openstack.org/391765 | 09:34 |
*** rbuzatu has joined #openstack-infra | 09:34 | |
*** tqtran has joined #openstack-infra | 09:35 | |
*** derekh has joined #openstack-infra | 09:36 | |
*** pblaho has quit IRC | 09:38 | |
openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Check the status of the stack deployed instead of the return code https://review.openstack.org/400644 | 09:40 |
*** tqtran has quit IRC | 09:40 | |
openstackgerrit | Michal Dulko proposed openstack-infra/project-config: Set Cinder multinode grenade on master to xenial https://review.openstack.org/394496 | 09:40 |
*** asettle has joined #openstack-infra | 09:40 | |
*** asettle has quit IRC | 09:41 | |
*** asettle__ has joined #openstack-infra | 09:41 | |
*** asettle__ is now known as asettle | 09:42 | |
*** dizquierdo has joined #openstack-infra | 09:43 | |
*** ad_rien_ has quit IRC | 09:43 | |
*** rbuzatu has quit IRC | 09:44 | |
*** rbuzatu has joined #openstack-infra | 09:45 | |
*** ccamacho has joined #openstack-infra | 09:45 | |
*** ad_rien_ has joined #openstack-infra | 09:46 | |
*** electrofelix has joined #openstack-infra | 09:47 | |
*** tovin07_ has quit IRC | 09:48 | |
*** thorst has joined #openstack-infra | 09:50 | |
*** ihrachys has joined #openstack-infra | 09:50 | |
*** tuanluong has quit IRC | 09:56 | |
openstackgerrit | Jakub Libosvar proposed openstack-infra/project-config: grafana: In Neutron dashboard split Xenial and Trusty graphs https://review.openstack.org/400654 | 09:56 |
*** pblaho has joined #openstack-infra | 09:56 | |
*** thorst has quit IRC | 09:58 | |
openstackgerrit | Michal Dulko proposed openstack-infra/project-config: Add cinder job with zeromq and multibackend https://review.openstack.org/400658 | 10:01 |
*** baoli has quit IRC | 10:02 | |
*** yanyanhu has quit IRC | 10:03 | |
*** zhurong has quit IRC | 10:03 | |
*** sambetts|afk is now known as sambetts | 10:05 | |
*** esikachev has quit IRC | 10:05 | |
openstackgerrit | Erlon R. Cruz proposed openstack-infra/devstack-gate: [DO NOT MERGE] Testing gate job https://review.openstack.org/396592 | 10:07 |
openstackgerrit | Pascal Mazon proposed openstack-infra/project-config: Add 6WIND Virtual Accelerator Charm https://review.openstack.org/400621 | 10:08 |
openstackgerrit | Markos Chandras proposed openstack/diskimage-builder: elements: Add new openssh-server element https://review.openstack.org/389171 | 10:08 |
openstackgerrit | Pascal Mazon proposed openstack-infra/project-config: Add 6WIND Virtual Accelerator Charm https://review.openstack.org/400621 | 10:10 |
*** kzaitsev_mb has joined #openstack-infra | 10:11 | |
*** berendt has quit IRC | 10:16 | |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] scenario jobs: jobs modifications https://review.openstack.org/399623 | 10:19 |
*** thiagolib has joined #openstack-infra | 10:22 | |
wznoinsk | hi infra, would someone have a moment to weigh in on https://review.openstack.org/#/c/394476/ ? | 10:24 |
*** fandi__ has quit IRC | 10:26 | |
*** rkukura_ has joined #openstack-infra | 10:26 | |
openstackgerrit | Pascal Mazon proposed openstack-infra/project-config: Add 6WIND Virtual Accelerator Charm https://review.openstack.org/400621 | 10:26 |
*** rkukura has quit IRC | 10:30 | |
*** rkukura_ is now known as rkukura | 10:30 | |
*** e0ne has joined #openstack-infra | 10:30 | |
*** tosky has joined #openstack-infra | 10:32 | |
*** ldnunes has joined #openstack-infra | 10:32 | |
*** yolanda has quit IRC | 10:35 | |
openstackgerrit | Renat Akhmerov proposed openstack-infra/project-config: Add mistral gate for mysql unit tests https://review.openstack.org/400535 | 10:35 |
*** yolanda has joined #openstack-infra | 10:38 | |
openstackgerrit | Julia Varlamova proposed openstack-infra/devstack-gate: Add MULTI_KEYSTONE flag and new roles https://review.openstack.org/394895 | 10:39 |
*** ad_rien_ has quit IRC | 10:42 | |
*** mmandel has joined #openstack-infra | 10:44 | |
*** ad_rien_ has joined #openstack-infra | 10:44 | |
openstackgerrit | Julia Varlamova proposed openstack-infra/devstack-gate: Add MULTI_KEYSTONE flag and new roles https://review.openstack.org/394895 | 10:45 |
*** jtomasek_ is now known as jtomasek | 10:45 | |
*** thorst has joined #openstack-infra | 10:46 | |
*** mmandel has quit IRC | 10:48 | |
*** gouthamr has quit IRC | 10:49 | |
openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Output additional info when exceptions occur https://review.openstack.org/309735 | 10:49 |
*** jlibosva has joined #openstack-infra | 10:49 | |
*** ad_rien_ has quit IRC | 10:50 | |
*** gnuoy has quit IRC | 10:51 | |
*** ad_rien_ has joined #openstack-infra | 10:51 | |
*** gnuoy has joined #openstack-infra | 10:52 | |
*** saibarspeis has quit IRC | 10:52 | |
*** thorst has quit IRC | 10:53 | |
jlibosva | AJaeger: hi, do you know a person that could help us with http://logs.openstack.org/41/396641/5/check/gate-grenade-dsvm-neutron-dvr-multinode-ubuntu-trusty/f723242/logs/grenade.sh.txt.gz#_2016-11-22_10_05_23_404 ? | 10:53 |
jlibosva | or is there already any issue tracker we could follow? | 10:53 |
jlibosva | I only reported bug on Neutron but it sounds more like an infra issue | 10:53 |
*** dizquierdo has quit IRC | 10:54 | |
openstackgerrit | Pascal Mazon proposed openstack-infra/project-config: Add 6WIND Virtual Accelerator Charm https://review.openstack.org/400621 | 10:54 |
AJaeger | jlibosva: We had some problems the last days with ssh set up in our images. Perhaps pabelanger has an idea later on this. Otherwise no idea | 10:54 |
jlibosva | :-/ | 10:55 |
jlibosva | it's specific to grenade multinode setups | 10:55 |
*** shardy has joined #openstack-infra | 10:55 | |
AJaeger | jlibosva: The #openstack-qa channel is always an option for these... | 10:56 |
jlibosva | AJaeger: ok, I'll try to complain there :) Thanks | 10:56 |
AJaeger | jlibosva: otherwise, please come back once the US and Canada is awake | 10:57 |
jlibosva | AJaeger: ack | 10:57 |
openstackgerrit | Michal Dulko proposed openstack-infra/project-config: Set Cinder multinode grenade on master to xenial https://review.openstack.org/394496 | 10:58 |
*** ad_rien_ has quit IRC | 10:59 | |
*** jascott1 has quit IRC | 10:59 | |
*** ad_rien_ has joined #openstack-infra | 11:02 | |
ihrachys | AJaeger: do we have a way to bump a patch in merge gate? | 11:11 |
ihrachys | AJaeger: https://review.openstack.org/400183 will take another 6h or so before landing | 11:11 |
ihrachys | would be cool to get it at the top | 11:11 |
ihrachys | and I believe it is the reason for the long queue | 11:12 |
*** yamahata has quit IRC | 11:14 | |
*** psilvad has joined #openstack-infra | 11:16 | |
*** ccamacho has left #openstack-infra | 11:17 | |
*** ccamacho has quit IRC | 11:17 | |
AJaeger | ihrachys: an admin can do that - but none is around right now. fungi, pabelanger, once you wake up, could you help ihrachys, please? ^ | 11:18 |
*** ccamacho has joined #openstack-infra | 11:20 | |
*** psilvad has quit IRC | 11:20 | |
*** saibarspeis has joined #openstack-infra | 11:20 | |
*** psilvad has joined #openstack-infra | 11:21 | |
*** martinkopec has quit IRC | 11:22 | |
*** martinkopec has joined #openstack-infra | 11:22 | |
*** ccamacho has quit IRC | 11:26 | |
*** ccamacho has joined #openstack-infra | 11:31 | |
*** Goneri has quit IRC | 11:38 | |
*** mmoster_ has joined #openstack-infra | 11:41 | |
*** dizquierdo has joined #openstack-infra | 11:41 | |
*** thorst has joined #openstack-infra | 11:43 | |
*** rtheis has joined #openstack-infra | 11:45 | |
*** rcarrillocruz has quit IRC | 11:46 | |
*** rcarrillocruz has joined #openstack-infra | 11:46 | |
*** thorst has quit IRC | 11:48 | |
*** mmoster_ has quit IRC | 11:48 | |
*** nicolasbock has joined #openstack-infra | 11:49 | |
*** jkilpatr has quit IRC | 12:03 | |
*** jkilpatr has joined #openstack-infra | 12:03 | |
*** kzaitsev_mb has quit IRC | 12:07 | |
*** wolverineav has joined #openstack-infra | 12:16 | |
*** tesseract has joined #openstack-infra | 12:19 | |
*** tesseract is now known as Guest3787 | 12:19 | |
openstackgerrit | Julia Varlamova proposed openstack-infra/devstack-gate: Add MULTI_KEYSTONE flag and new roles https://review.openstack.org/394895 | 12:21 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Full quickstart gate run on OVB https://review.openstack.org/381094 | 12:23 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: Test quickstart experimental job https://review.openstack.org/397609 | 12:23 |
*** kzaitsev_mb has joined #openstack-infra | 12:27 | |
*** ccamacho is now known as ccamacho|lunch | 12:28 | |
*** ad_rien_ has quit IRC | 12:29 | |
*** gouthamr has joined #openstack-infra | 12:30 | |
*** nexusz99 has joined #openstack-infra | 12:30 | |
*** nexusz99 has quit IRC | 12:31 | |
*** ad_rien_ has joined #openstack-infra | 12:32 | |
openstackgerrit | Alexandra Settle proposed openstack-infra/project-config: Add Install Guide Jobs to Designate https://review.openstack.org/341671 | 12:33 |
*** wolverineav has quit IRC | 12:34 | |
*** dtantsur is now known as dtantsur|brb | 12:35 | |
*** thorst has joined #openstack-infra | 12:38 | |
*** wolverineav has joined #openstack-infra | 12:38 | |
amrith | AJaeger, g'afternoon. | 12:40 |
openstackgerrit | Rob Cresswell proposed openstack-infra/project-config: Remove duplicated Horizon test runs https://review.openstack.org/400084 | 12:41 |
*** wolverineav has quit IRC | 12:43 | |
*** rhallisey has joined #openstack-infra | 12:43 | |
*** wolverineav has joined #openstack-infra | 12:44 | |
*** thorst has quit IRC | 12:45 | |
robcresswell | AJaeger: Any suggestions on a sensible way to modify a test command for a single branch? Referring to https://review.openstack.org/#/c/399868/ I was just going to add a new job called "selenium-legacy" (or similar) with the old command for newton/mitaka, and then just use the current job for ocata and future. | 12:45 |
openstackgerrit | Merged openstack-infra/project-config: Use custom group to release os-xenapi https://review.openstack.org/400153 | 12:46 |
openstackgerrit | Merged openstack-infra/project-config: [sahara] scenario jobs: jobs modifications https://review.openstack.org/399623 | 12:47 |
openstackgerrit | Merged openstack-infra/project-config: Add cinder job with zeromq and multibackend https://review.openstack.org/400658 | 12:47 |
ihrachys | fungi: pabelanger: another gate fix we may need to bump in gate is https://review.openstack.org/#/c/400465/ the bug just bumped the patch blocking bad heatclient out of gate | 12:47 |
openstackgerrit | Merged openstack-infra/project-config: make python3.5 voting for oslo.middleware https://review.openstack.org/400438 | 12:48 |
openstackgerrit | Merged openstack-infra/project-config: Make oslo.messaging amqp1 driver non-voting https://review.openstack.org/400430 | 12:48 |
*** wolverineav has quit IRC | 12:49 | |
openstackgerrit | Merged openstack-infra/project-config: add non-voting functional tests job for networking-odl https://review.openstack.org/394476 | 12:49 |
openstackgerrit | Merged openstack-infra/project-config: Promote Monasca tempest tests on ubuntu-xenial https://review.openstack.org/399044 | 12:49 |
*** mmoster_ has joined #openstack-infra | 12:50 | |
*** dprince has joined #openstack-infra | 12:53 | |
openstackgerrit | Rob Cresswell proposed openstack-infra/project-config: Update Horizons selenium-headless test https://review.openstack.org/399868 | 12:57 |
*** abregman is now known as abregman|mtg | 12:57 | |
wznoinsk | yolanda, thanks | 12:58 |
openstackgerrit | Zhenguo Niu proposed openstack-infra/project-config: Enable Nimble tempest plugin test https://review.openstack.org/400539 | 12:58 |
*** saibarspeis has quit IRC | 12:58 | |
*** claudiub|2 has joined #openstack-infra | 12:58 | |
*** yolanda has quit IRC | 12:58 | |
*** lucasagomes is now known as lucas-hungry | 12:59 | |
*** sdake has joined #openstack-infra | 12:59 | |
*** pgadiya has quit IRC | 13:00 | |
*** claudiub has quit IRC | 13:01 | |
*** abregman|mtg has quit IRC | 13:02 | |
*** zhurong has joined #openstack-infra | 13:02 | |
*** wolverineav has joined #openstack-infra | 13:03 | |
*** dave-mccowan has joined #openstack-infra | 13:04 | |
*** sdake_ has joined #openstack-infra | 13:04 | |
*** bhunter71 has joined #openstack-infra | 13:05 | |
*** amoralej is now known as amoralej|lunch | 13:06 | |
*** sdake has quit IRC | 13:07 | |
*** wolverineav has quit IRC | 13:07 | |
*** trown|afk is now known as trown | 13:07 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/devstack-gate: Find and delete broken symlinks in logs https://review.openstack.org/400742 | 13:08 |
bhunter71 | what OS is nodepool currently? Has any prod host moved to xenial? Its there still some sort of puppetboard up, or another way to see this data? thanks!! | 13:08 |
*** denisra_ has joined #openstack-infra | 13:08 | |
*** dizquierdo has quit IRC | 13:10 | |
openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: neutron-fwaas: Consume gate hook for tempest plugin jobs https://review.openstack.org/400745 | 13:10 |
*** Julien-zte has joined #openstack-infra | 13:11 | |
*** wolverineav has joined #openstack-infra | 13:12 | |
*** denisra has quit IRC | 13:12 | |
*** dizquierdo has joined #openstack-infra | 13:12 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT REVIEW: Test timeout https://review.openstack.org/393415 | 13:13 |
*** wolverineav has quit IRC | 13:16 | |
*** wolverineav has joined #openstack-infra | 13:17 | |
openstackgerrit | Rodrigo Duarte proposed openstack-infra/project-config: Enable keystone-saml2-federation service https://review.openstack.org/400750 | 13:22 |
openstackgerrit | mathieu bultel proposed openstack-infra/project-config: Add mitaka and newton UC and full upgrade jobs https://review.openstack.org/400317 | 13:23 |
*** wolverineav has quit IRC | 13:23 | |
*** ggnel_t has joined #openstack-infra | 13:26 | |
*** esikachev has joined #openstack-infra | 13:27 | |
*** tlian has joined #openstack-infra | 13:28 | |
*** ociuhandu has quit IRC | 13:30 | |
*** jcoufal has joined #openstack-infra | 13:30 | |
*** zul has quit IRC | 13:30 | |
*** rossella__ has quit IRC | 13:30 | |
*** tojuvone has joined #openstack-infra | 13:31 | |
*** rossella__ has joined #openstack-infra | 13:31 | |
*** yamamoto_ has quit IRC | 13:31 | |
*** rlandy has joined #openstack-infra | 13:32 | |
*** gordc has joined #openstack-infra | 13:32 | |
*** jeckersb is now known as jeckersb_gone | 13:33 | |
*** zul has joined #openstack-infra | 13:33 | |
njohnston | Hello infra! I have a change to an IRC meeting that has merged - https://review.openstack.org/393793 - but the eavesdrop meeting entry has not changed - http://eavesdrop.openstack.org/#Firewall_as_a_Service_(FWaaS)_Team_Meeting - nor has the .ics file | 13:34 |
*** fguillot has joined #openstack-infra | 13:35 | |
*** mdrabe has joined #openstack-infra | 13:35 | |
*** thorst has joined #openstack-infra | 13:36 | |
*** chlong has joined #openstack-infra | 13:36 | |
*** tqtran has joined #openstack-infra | 13:36 | |
*** adarazs is now known as adarazs_lunch | 13:38 | |
*** wolverineav has joined #openstack-infra | 13:39 | |
*** tqtran has quit IRC | 13:41 | |
*** thorst has quit IRC | 13:42 | |
openstackgerrit | Merged openstack-infra/shade: Allow server to be snapshot to be name, id or dict https://review.openstack.org/400447 | 13:47 |
*** wolverineav has quit IRC | 13:47 | |
*** dizquierdo has quit IRC | 13:50 | |
*** wolverineav has joined #openstack-infra | 13:51 | |
*** jpena is now known as jpena|lunch | 13:51 | |
pabelanger | morning | 13:52 |
pabelanger | will be online intermittently this morning, attending OpenStackDayca in Montreal | 13:53 |
*** jgriffith has joined #openstack-infra | 13:53 | |
*** thethorongil has joined #openstack-infra | 13:55 | |
*** thorst has joined #openstack-infra | 13:55 | |
*** ad_rien_1 has joined #openstack-infra | 13:55 | |
*** ad_rien_ has quit IRC | 13:56 | |
*** lucas-hungry is now known as lucasagomes | 13:56 | |
*** wolverineav has quit IRC | 13:56 | |
*** hurgleburgler has joined #openstack-infra | 13:57 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK: periodic jobs https://review.openstack.org/359215 | 13:58 |
*** gongysh has joined #openstack-infra | 13:58 | |
openstackgerrit | Merged openstack-infra/shade: Add an e to the word therefore https://review.openstack.org/400450 | 13:59 |
*** ramishra has quit IRC | 13:59 | |
*** ad_rien_1 has quit IRC | 13:59 | |
*** ad_rien_ has joined #openstack-infra | 14:00 | |
*** wolverineav has joined #openstack-infra | 14:00 | |
*** ricardoas has quit IRC | 14:01 | |
*** ramishra has joined #openstack-infra | 14:01 | |
*** ricardoas has joined #openstack-infra | 14:03 | |
*** sree has joined #openstack-infra | 14:03 | |
*** ccamacho|lunch is now known as ccamacho | 14:03 | |
*** adarazs_lunch is now known as adarazs | 14:03 | |
*** jeckersb_gone is now known as jeckersb | 14:04 | |
*** wolverineav has quit IRC | 14:06 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Full quickstart gate run on OVB https://review.openstack.org/381094 | 14:07 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: Test quickstart experimental job https://review.openstack.org/397609 | 14:07 |
*** hurgleburgler has quit IRC | 14:07 | |
openstackgerrit | Tung Doan proposed openstack-infra/project-config: Tacker changes to xenial node https://review.openstack.org/400780 | 14:09 |
*** thorst has quit IRC | 14:09 | |
*** Goneri has joined #openstack-infra | 14:10 | |
*** zul has quit IRC | 14:10 | |
*** thorst has joined #openstack-infra | 14:10 | |
*** wolverineav has joined #openstack-infra | 14:11 | |
*** baoli has joined #openstack-infra | 14:12 | |
*** abregman has joined #openstack-infra | 14:12 | |
openstackgerrit | Sorin Sbârnea proposed openstack-infra/jenkins-job-builder: Removed some deprecation warnings and enabled py35 on tox. https://review.openstack.org/399994 | 14:12 |
*** matt-borland has joined #openstack-infra | 14:13 | |
*** daemontool has joined #openstack-infra | 14:13 | |
*** sree has quit IRC | 14:13 | |
*** zul has joined #openstack-infra | 14:14 | |
openstackgerrit | Rob Cresswell proposed openstack-infra/project-config: Update Horizons selenium-headless test https://review.openstack.org/399868 | 14:14 |
*** alex_xu has quit IRC | 14:14 | |
*** jordanP has joined #openstack-infra | 14:14 | |
fungi | ihrachys: AJaeger: taking a look at that requirements fix now | 14:16 |
*** yamamoto has joined #openstack-infra | 14:16 | |
*** wolverineav has quit IRC | 14:16 | |
*** yolanda has joined #openstack-infra | 14:17 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Re-enable test_hold test https://review.openstack.org/399758 | 14:17 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Enable test_delete / test_delete_now tests https://review.openstack.org/399734 | 14:17 |
fungi | ihrachys: any feel for whether the devstack revert or the requirements cap should go before the other? i can push them both into the gate and up to the front since they're approved already | 14:18 |
*** mriedem has joined #openstack-infra | 14:18 | |
*** alex_xu has joined #openstack-infra | 14:18 | |
*** amoralej|lunch is now known as amoralej | 14:18 | |
fungi | looks like devstack change is probably better to put first as it's impacting more than just rally-based jobs | 14:19 |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: fix regex issue for job https://review.openstack.org/400784 | 14:19 |
*** thorst has quit IRC | 14:19 | |
*** nmagnezi has quit IRC | 14:20 | |
*** zhurong has quit IRC | 14:21 | |
fungi | ihrachys: 400465,1 (devstack) is now in the gate at the front and 400183,2 (requirements) is immediately behind it | 14:22 |
ihrachys | fungi: I think devstack then reqs since reqs patch failed because of devstack | 14:23 |
ihrachys | fungi: cool, thanks a lot | 14:23 |
*** ad_rien_ has quit IRC | 14:23 | |
fungi | both have workers assigned for all jobs now, eta if neither fails is ~1hr | 14:23 |
*** sree has joined #openstack-infra | 14:25 | |
*** thorst has joined #openstack-infra | 14:26 | |
*** thorst has quit IRC | 14:27 | |
*** ad_rien_ has joined #openstack-infra | 14:28 | |
*** thorst has joined #openstack-infra | 14:28 | |
*** daemontool has quit IRC | 14:28 | |
*** wolverineav has joined #openstack-infra | 14:29 | |
fungi | #status log rebooted ask.openstack.org for a kernel update | 14:29 |
openstackstatus | fungi: finished logging | 14:29 |
*** tiswanso has joined #openstack-infra | 14:29 | |
*** vikrant has quit IRC | 14:29 | |
*** gouthamr has quit IRC | 14:30 | |
*** jeckersb is now known as jeckersb_gone | 14:31 | |
*** ad_rien_ has quit IRC | 14:32 | |
*** florianf has quit IRC | 14:32 | |
*** gouthamr has joined #openstack-infra | 14:32 | |
*** thorst has quit IRC | 14:33 | |
*** ad_rien_ has joined #openstack-infra | 14:33 | |
*** Julien-zte has quit IRC | 14:34 | |
*** jordanP has quit IRC | 14:35 | |
*** florianf has joined #openstack-infra | 14:35 | |
*** thethorongil has quit IRC | 14:35 | |
*** ad_rien_1 has joined #openstack-infra | 14:35 | |
*** Julien-zte has joined #openstack-infra | 14:36 | |
*** Julien-zte has quit IRC | 14:36 | |
*** yolanda has quit IRC | 14:36 | |
*** Julien-zte has joined #openstack-infra | 14:36 | |
*** Julien-zte has quit IRC | 14:37 | |
*** wolverineav has quit IRC | 14:37 | |
*** jeckersb_gone is now known as jeckersb | 14:37 | |
*** Julien-zte has joined #openstack-infra | 14:37 | |
*** Julien-zte has quit IRC | 14:37 | |
*** ad_rien_ has quit IRC | 14:37 | |
*** Julien-zte has joined #openstack-infra | 14:38 | |
*** Julien-zte has quit IRC | 14:38 | |
*** Julien-zte has joined #openstack-infra | 14:39 | |
*** Julien-zte has quit IRC | 14:39 | |
*** Julien-zte has joined #openstack-infra | 14:39 | |
*** Julien-zte has quit IRC | 14:40 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for libvirt crash corrupt memory bug 1643911 https://review.openstack.org/400798 | 14:40 |
openstack | bug 1643911 in OpenStack Compute (nova) "libvirt randomly crashes on xenial nodes with "*** Error in `/usr/sbin/libvirtd': malloc(): memory corruption:"" [Medium,Confirmed] https://launchpad.net/bugs/1643911 | 14:40 |
*** daemontool has joined #openstack-infra | 14:41 | |
*** denisra_ is now known as denisra | 14:41 | |
openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Add a amqp1 job for Heat https://review.openstack.org/400799 | 14:41 |
*** hongbin has joined #openstack-infra | 14:42 | |
*** yolanda has joined #openstack-infra | 14:43 | |
*** jamesdenton has joined #openstack-infra | 14:45 | |
*** nadya has joined #openstack-infra | 14:47 | |
rcarrillocruz | hey folks, i won't attend today's infra meeting. My wife won't be around by the time and I'll be taking care of my son for dinner/bath/playing/moarplaying/spongebobswatching/etc | 14:48 |
mordred | rcarrillocruz: yay spongebob | 14:49 |
*** jaosorior has quit IRC | 14:49 | |
*** jaosorior has joined #openstack-infra | 14:50 | |
jeblair | rcarrillocruz: hey, i took a quick look at the d-g changes -- do you think you can switch it to use each new play as you add it? | 14:51 |
*** jaosorior has quit IRC | 14:51 | |
*** jaosorior has joined #openstack-infra | 14:51 | |
rcarrillocruz | you mean one play per role invocation, then have an upper playbook that calls them? | 14:51 |
mtreinish | is anyone else having trouble with the lp auth for gerrit? | 14:52 |
*** wolverineav has joined #openstack-infra | 14:52 | |
fungi | i lp auth'd to ask.o.o a few minutes ago successfully, but am afraid to log out of review.o.o now :/ | 14:52 |
rcarrillocruz | jeblair: ^ | 14:52 |
jeblair | rcarrillocruz: some of the roles happen one after another, so those can share a playbook | 14:53 |
mtreinish | fungi: hmm, I'm seeing: http://i.imgur.com/OeNkytr.png | 14:53 |
*** vincentll has joined #openstack-infra | 14:53 | |
*** kashyap has joined #openstack-infra | 14:53 | |
jeblair | rcarrillocruz: (and we might start out with more playbooks than we need, and combine them over time) | 14:53 |
*** mmandel has joined #openstack-infra | 14:53 | |
jeblair | rcarrillocruz: but mostly, i just wondered if we can go ahead and start using the roles as we add them (and remove the code they are replacing) | 14:53 |
fungi | mtreinish: that's usually what we get when login.launchpad.net is offline/broken | 14:53 |
kashyap | clarkb: Hiya, when you get a moment, would be possible to run libvirtd under valgrind in the Gate? | 14:53 |
jeblair | mtreinish, fungi: lp auth to gerrit wfm | 14:54 |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for libvirt crash corrupt memory bug 1643911 https://review.openstack.org/400798 | 14:54 |
kashyap | Trying to debug a memory corruption issue w/ a libvirt dev, they're asking if it's possible to run it under valgrind | 14:54 |
*** vincentll has quit IRC | 14:54 | |
openstack | bug 1643911 in OpenStack Compute (nova) "libvirt randomly crashes on xenial nodes with "*** Error in `/usr/sbin/libvirtd': malloc(): memory corruption:"" [Medium,Confirmed] https://launchpad.net/bugs/1643911 | 14:54 |
rcarrillocruz | jeblair: i have a change that is 'setup_host' that is a playbook that calls the other changes that define the roles : https://review.openstack.org/#/c/391519/3/playbooks/setup_host.yaml . You mean something like that ? | 14:54 |
kashyap | ^ Heh, it's the above one | 14:54 |
stevemar | sitting here with mtreinish wondering what the heck he has to log into | 14:54 |
jeblair | rcarrillocruz: ah, i didn't see that one | 14:54 |
rcarrillocruz | yes, it's wip'd | 14:55 |
cloudnull | mornings | 14:55 |
rcarrillocruz | that's probably why | 14:55 |
mtreinish | fungi, jeblair: maybe it's something with the network here at the openstack day ca venue | 14:55 |
mtreinish | stevemar hit the same thing when he tried it | 14:55 |
fungi | mtreinish: oh, exciting | 14:55 |
stevemar | (with an incognito session) | 14:55 |
mtreinish | pabelanger: ^^^ are you able to log in? | 14:55 |
fungi | mtreinish: my guess is that you're all behind a common overload nat and tripped a sanity check on max http requests from one address to lp sso | 14:56 |
*** isaacb has quit IRC | 14:56 | |
*** wolverineav has quit IRC | 14:56 | |
jeblair | rcarrillocruz: what i want to see is the roles actually running in the jobs | 14:56 |
fungi | especially given the spam problems we see from accounts coming from there, i would not be surprised if they're pretty draconian about it | 14:56 |
fungi | mtreinish: can probably request whitelisting of the nat address in #launchpad | 14:57 |
jeblair | rcarrillocruz: if we can do it one at a time, that would make those changes easier to use | 14:57 |
jeblair | rcarrillocruz: er, easier to review | 14:57 |
mtreinish | fungi: meh, it's a good excuse to not do tc reviews for the meeting I can't make today :) | 14:58 |
mtreinish | fungi: or I can just login into my machines at home and use gertty | 14:58 |
fungi | mtreinish: gertty should still work fine, though i'm sure that's not the answer you want to hear ;) | 14:58 |
jeblair | yeah, i was going to do mtreinish a favor and *not* mention gertty, for once ;) | 14:58 |
*** szaher has quit IRC | 14:58 | |
fungi | indeed, gertty should even work fine from the conf net since it doesn't depend on openid | 14:59 |
rcarrillocruz | so, let's say the 'fix_etc_hosts', would adding an actual playbook calling the 'fix_etc_hosts' role to the change do what you ask? | 14:59 |
mtreinish | sigh, yeah it's still working :) | 14:59 |
jeblair | rcarrillocruz: yes, and ideally, remove the old bash code | 14:59 |
rcarrillocruz | then in the upper setup_host, instead of having 'roles' invocations, we would include playbooks that tehmselves invoke roles | 14:59 |
mtreinish | but it's been a while, so the sync is slow | 14:59 |
rcarrillocruz | jeblair: ++ sure, i'll amend | 14:59 |
jeblair | rcarrillocruz: cool, thanks! | 15:00 |
*** bin_ has joined #openstack-infra | 15:01 | |
openstackgerrit | Merged openstack-infra/nodepool: Add tools/test-setup.sh https://review.openstack.org/399079 | 15:02 |
*** szaher has joined #openstack-infra | 15:02 | |
*** jlibosva has quit IRC | 15:03 | |
*** dnikishov has joined #openstack-infra | 15:03 | |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder: Dummy change to test feature/v2 branch https://review.openstack.org/400810 | 15:03 |
*** jpena|lunch is now known as jpena | 15:03 | |
*** wolverineav has joined #openstack-infra | 15:04 | |
*** hichihara has quit IRC | 15:04 | |
dnikishov | hello folks, I've got a couple of changes, which have +2 CR and +2 W, however, they haven't been picked up by zuul's gate jobs | 15:04 |
dnikishov | is there anything I can do about that? | 15:04 |
fungi | dnikishov: do they have dependencies that aren't in the gate/merged yet? | 15:04 |
*** claudiub has joined #openstack-infra | 15:05 | |
fungi | dnikishov: or did you set workflow +1 before there were any code review +2 votes, then added cr +2 afterward? | 15:05 |
dnikishov | no, they don't seem to have these | 15:05 |
dnikishov | the changes I need help with are: https://review.openstack.org/368738 https://review.openstack.org/368780 | 15:05 |
fungi | dnikishov: a link to one of the changes in question would help | 15:05 |
fungi | dnikishov: another cause could be that zuul isn't configured to run any jobs for those changes | 15:05 |
*** Julien-zte has joined #openstack-infra | 15:06 | |
*** claudiub|2 has quit IRC | 15:07 | |
*** rbrndt has joined #openstack-infra | 15:08 | |
*** dtantsur|brb is now known as dtantsur | 15:10 | |
*** hongbin has quit IRC | 15:10 | |
*** yolanda has quit IRC | 15:12 | |
*** wolverineav has quit IRC | 15:13 | |
kashyap | clarkb: Okay, disregard my question above, as Gate jobs would take ages to complete when running libvirtd under valgrind. (Would only be useful if we can come up with a reproducer) CC: mriedem | 15:13 |
mordred | rcarrillocruz, jeblair: yah - I agree. it'll make it easier for me to review that the ansible is doing the right thing if I see the shell it's replacing :) | 15:15 |
*** thorst has joined #openstack-infra | 15:17 | |
dnikishov | fungi: it seems like workflow +1 happened after the first CR +2 | 15:17 |
fungi | dnikishov: 368780 depends on a merged change that's marked as "not current" so i wonder if gerrit considers it non-mergeable | 15:18 |
*** ad_rien_1 has quit IRC | 15:19 | |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: finish transitioning scenario jobs to xenial https://review.openstack.org/400814 | 15:19 |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] finish transitioning scenario jobs to xenial https://review.openstack.org/400814 | 15:20 |
*** wolverineav has joined #openstack-infra | 15:20 | |
*** tjones has joined #openstack-infra | 15:21 | |
*** thorst has quit IRC | 15:21 | |
*** thorst has joined #openstack-infra | 15:22 | |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] finish transitioning scenario jobs to xenial https://review.openstack.org/400814 | 15:22 |
*** sree has quit IRC | 15:22 | |
dnikishov | fungi: right, thanks | 15:22 |
fungi | dnikishov: yeah, it says its parent is d55b9c9810adf5c0825f3347a9e553d21f744dbc which was patchset 18 of 395042, while patchset 19 is what ended up merging | 15:22 |
dnikishov | still have no idea how that happened, but it seems to be ok now | 15:22 |
*** sree has joined #openstack-infra | 15:22 | |
*** yamahata has joined #openstack-infra | 15:22 | |
*** ad_rien_ has joined #openstack-infra | 15:23 | |
fungi | dnikishov: so when patchset 19 of 395042 was pushed to gerrit, nobody rebased 368780 or any of the subsequent children | 15:23 |
fungi | they were all depending on an older patchset of 395042 which isn't what merged | 15:23 |
fungi | and gerrit gets picky about that if it has an explicitly tracked dependency on changes which were stacked together at some point | 15:24 |
fungi | zuul will happily run check pipeline tests on it still because it just goes ahead and merges with the branch tip, but when it comes time to enqueue in the gate it asks whether gerrit would be willing to merge that change, and refrains from enqueuing it if not | 15:25 |
*** wolverineav has quit IRC | 15:26 | |
*** saibarspeis has joined #openstack-infra | 15:26 | |
*** sree has quit IRC | 15:27 | |
*** thorst has quit IRC | 15:27 | |
*** tosky has quit IRC | 15:27 | |
*** yamamoto has quit IRC | 15:27 | |
*** tosky has joined #openstack-infra | 15:28 | |
*** ologvinova_ has joined #openstack-infra | 15:29 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: logging: extract journal to compressed text file, before gathering https://review.openstack.org/400817 | 15:30 |
openstackgerrit | Mark Hamzy proposed openstack-infra/project-config: All Python35 issues should be fixed for MoltenIron https://review.openstack.org/400820 | 15:32 |
*** dizquierdo has joined #openstack-infra | 15:35 | |
openstackgerrit | Sorin Sbârnea proposed openstack-infra/jenkins-job-builder: Removed some deprecation warnings and enabled py35 on tox. https://review.openstack.org/399994 | 15:36 |
*** azefe has joined #openstack-infra | 15:36 | |
*** Nrk9t1x has joined #openstack-infra | 15:37 | |
*** wolverineav has joined #openstack-infra | 15:37 | |
openstackgerrit | Oleksii Zamiatin proposed openstack-infra/project-config: Fix different zmq configurations for functional tests https://review.openstack.org/400823 | 15:38 |
*** NBziouech has quit IRC | 15:39 | |
*** ccamacho has left #openstack-infra | 15:40 | |
*** yamamoto has joined #openstack-infra | 15:41 | |
*** wolverineav has quit IRC | 15:42 | |
*** xyang1 has joined #openstack-infra | 15:43 | |
*** chandankumar has quit IRC | 15:43 | |
*** Alagar has quit IRC | 15:44 | |
*** Alagar has joined #openstack-infra | 15:45 | |
*** jkilpatr has quit IRC | 15:45 | |
*** jkilpatr has joined #openstack-infra | 15:46 | |
*** daemontool has quit IRC | 15:46 | |
*** gongysh has quit IRC | 15:47 | |
*** wolverineav has joined #openstack-infra | 15:49 | |
*** yolanda has joined #openstack-infra | 15:52 | |
*** wolverineav has quit IRC | 15:54 | |
azefe | Does anyone have an experience pushing tag to an openstack project? My project looks like it is configured to do so, but the git command fails "access denied or repository not exported" / "failed to push some refs to" | 15:54 |
*** jaosorior has quit IRC | 15:55 | |
*** dave-mccowan has quit IRC | 15:55 | |
fungi | azefe: http://docs.openstack.org/infra/manual/creators.html#creation-of-tags | 15:56 |
openstackgerrit | Jakub Libosvar proposed openstack-infra/project-config: grafana: In Neutron dashboard split Xenial and Trusty graphs https://review.openstack.org/400654 | 15:56 |
fungi | azefe: also http://docs.openstack.org/infra/manual/drivers.html#tagging-a-release | 15:57 |
clarkb | if I had to guess you need to sign the tag | 15:57 |
fungi | yeah, it's one of that or the acl doesn't have pushsignedtag granted to a group in which you're a member | 15:57 |
fungi | without knowing the project name, it's hard to say | 15:58 |
*** yamamoto has quit IRC | 15:59 | |
azefe | thanks fungi & clarkb , the project (synergy) has pushsignedtag, but you guessed correctly, I didn't sign the tag | 15:59 |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Re-enable alien-image-list command and tests https://review.openstack.org/400836 | 16:00 |
*** berendt has joined #openstack-infra | 16:00 | |
*** ihrachys has quit IRC | 16:01 | |
*** ihrachys has joined #openstack-infra | 16:01 | |
*** yuval has quit IRC | 16:02 | |
openstackgerrit | Sorin Sbârnea proposed openstack-infra/jenkins-job-builder: Removed some deprecation warnings and enabled py35 on tox. https://review.openstack.org/399994 | 16:02 |
*** ociuhandu has joined #openstack-infra | 16:02 | |
*** EricGonczer_ has joined #openstack-infra | 16:03 | |
*** links has quit IRC | 16:04 | |
*** yolanda has quit IRC | 16:04 | |
*** inc0 has joined #openstack-infra | 16:05 | |
*** rcernin_ has quit IRC | 16:06 | |
*** EricGonczer_ has quit IRC | 16:06 | |
*** EricGonczer_ has joined #openstack-infra | 16:07 | |
*** senk has quit IRC | 16:10 | |
*** wolverineav has joined #openstack-infra | 16:10 | |
*** dave-mccowan has joined #openstack-infra | 16:10 | |
*** jlibosva has joined #openstack-infra | 16:11 | |
*** psachin has quit IRC | 16:13 | |
openstackgerrit | Omar Rivera proposed openstack-infra/project-config: Add fuel-plugin-nitrous project https://review.openstack.org/400429 | 16:14 |
*** azefe has quit IRC | 16:14 | |
*** wolverineav has quit IRC | 16:15 | |
*** Julien-zte has quit IRC | 16:15 | |
*** Julien-zte has joined #openstack-infra | 16:16 | |
*** Julien-zte has quit IRC | 16:16 | |
*** Julien-zte has joined #openstack-infra | 16:16 | |
*** Guest3787 has quit IRC | 16:16 | |
*** Julien-zte has quit IRC | 16:17 | |
*** ociuhandu has quit IRC | 16:17 | |
*** oanson has quit IRC | 16:17 | |
*** Julien-zte has joined #openstack-infra | 16:17 | |
*** Julien-zte has quit IRC | 16:17 | |
*** Julien-zte has joined #openstack-infra | 16:18 | |
*** Julien-zte has quit IRC | 16:18 | |
*** Julien-zte has joined #openstack-infra | 16:19 | |
*** ologvinova_ has quit IRC | 16:19 | |
*** ociuhandu has joined #openstack-infra | 16:19 | |
*** Julien-zte has quit IRC | 16:19 | |
*** yamamoto has joined #openstack-infra | 16:19 | |
*** armax has joined #openstack-infra | 16:19 | |
*** Julien-zte has joined #openstack-infra | 16:20 | |
*** Julien-zte has quit IRC | 16:20 | |
clarkb | sshnaidm: looks like http://logs.openstack.org/15/393415/11/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/1236f50/ timed out and logs were collected | 16:20 |
clarkb | sshnaidm: I notice you have a second change though to remove broken symlinks? | 16:21 |
*** Julien-zte has joined #openstack-infra | 16:21 | |
*** Julien-zte has quit IRC | 16:21 | |
sshnaidm | clarkb, yep, while fixing one problem, discovered another :) | 16:21 |
clarkb | sshnaidm: we need both changes to make ^ work? | 16:21 |
*** Julien-zte has joined #openstack-infra | 16:21 | |
*** Julien-zte has quit IRC | 16:21 | |
sshnaidm | clarkb, no, only first, the second is for this job i.e.: http://logs.openstack.org/15/393415/9/check/gate-tripleo-ci-centos-7-nonha-multinode/709b186/_zuul_ansible/ansible_log.txt | 16:22 |
*** martinkopec has quit IRC | 16:23 | |
clarkb | ah ok, will review both shortly | 16:23 |
AJaeger | robcresswell: Commented on 399868, approach is fine but needs a few fixes | 16:23 |
robcresswell | Gotcha, thanks AJaeger | 16:23 |
*** cody-somerville has joined #openstack-infra | 16:23 | |
*** cody-somerville has quit IRC | 16:23 | |
*** cody-somerville has joined #openstack-infra | 16:23 | |
andreykurilin | hi folks! can anyone suggest how to see real-time logs for running job with ipv6 address? | 16:24 |
clarkb | fungi: jeblair any chance I can have a quick rereview on https://review.openstack.org/#/c/399789/, will try booting that server today finally | 16:24 |
clarkb | andreykurilin: you'll need an ipv6 address. hurricane electric provides tunnels for free. Rackspace and dreamhost and vexxhost cloud instances come with them too. And finally some ISPs do actually give customers ipv6 out of the box | 16:25 |
clarkb | andreykurilin: there is work in progress with zuulv3 to proxy those to a webapp thing using websockets but its not implemented yet as far as I know | 16:25 |
*** sandanar has quit IRC | 16:26 | |
mordred | nope. not yet | 16:26 |
andreykurilin | clarkb: got it. thanks! | 16:26 |
fungi | andreykurilin: fwiw, even though my home isp provides some ipv6 connectivity, it's terrible so i still end up using a free https://tunnelbroker.net/ ipv6-over-gre tunnel from my home firewall to hurricane electric | 16:27 |
*** kzaitsev_mb has quit IRC | 16:28 | |
bkero | comcast is the same way for me :( | 16:28 |
sshnaidm | clarkb, I ran a job with two these patches, https://review.openstack.org/#/c/393415/ but seems like second didn't work well if it was cloned.. need to check | 16:28 |
*** claudiub|2 has joined #openstack-infra | 16:28 | |
sshnaidm | clarkb, but first one works perfectly | 16:28 |
*** ociuhandu has quit IRC | 16:29 | |
andreykurilin | fungi: thanks! | 16:29 |
clarkb | sshnaidm: look at http://logs.openstack.org/15/393415/12/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/ce4351e/_zuul_ansible/ansible_log.txt it seems like the symlink one is working fine too? | 16:29 |
*** ociuhandu has joined #openstack-infra | 16:29 | |
*** yolanda has joined #openstack-infra | 16:29 | |
clarkb | sshnaidm: where do you see problems with it | 16:29 |
*** hongbin has joined #openstack-infra | 16:30 | |
sshnaidm | clarkb, in this one http://logs.openstack.org/15/393415/12/check/gate-tripleo-ci-centos-7-nonha-multinode/6aad182/ | 16:30 |
sshnaidm | clarkb, multinode job there | 16:30 |
*** Alagar has quit IRC | 16:30 | |
*** Alagar has joined #openstack-infra | 16:31 | |
*** yamamoto has quit IRC | 16:31 | |
*** claudiub has quit IRC | 16:31 | |
*** yamamoto has joined #openstack-infra | 16:32 | |
*** kzaitsev_mb has joined #openstack-infra | 16:32 | |
*** abregman has quit IRC | 16:33 | |
*** abregman has joined #openstack-infra | 16:33 | |
*** csomerville has joined #openstack-infra | 16:34 | |
openstackgerrit | Ken Giusti proposed openstack-infra/project-config: Enable devstack plugins oslo.messaging drivers https://review.openstack.org/400856 | 16:35 |
clarkb | sshnaidm: we should run cleanup_host on both nodes first, then we synchronize subnode to primary node, then we synchronize primary node logs to log server | 16:35 |
clarkb | sshnaidm: so its odd that we would get a symlink there | 16:36 |
fungi | jeblair: interesting zuul behavior. i haven't looked at the logs yet but i promoted 400465,1 followed by 400183,2 in the gate and when 400465,1 merged successfully zuul restarted testing on 400183,2 behind it | 16:37 |
*** claudiub|2 has quit IRC | 16:37 | |
sshnaidm | clarkb, as I saw we use rsync --archive, I think it'll collect symlinks too | 16:37 |
sshnaidm | clarkb, these are logs from primary node | 16:37 |
*** cody-somerville has quit IRC | 16:37 | |
clarkb | sshnaidm: yes, but if you look at the broken symlink path its a thing that originated on the subnode | 16:38 |
sshnaidm | clarkb, actually _almost_ all tripleo run on one node | 16:38 |
clarkb | sshnaidm: and the process is copy from subnodes to primary nodes after running cleanup_host everywhere, then the zuul ansible rsync runs and fails | 16:38 |
sshnaidm | clarkb, oh, you're right | 16:38 |
sshnaidm | clarkb, completely missed "subnode-2" there | 16:39 |
clarkb | sshnaidm: so somehow that symlink is surviving the cleanup_host run on the subnode, then its being copied to the primary node, then failing to copy as part of the zuul playbook | 16:39 |
openstackgerrit | Mark Hamzy proposed openstack-infra/project-config: All Python35 issues should be fixed for MoltenIron https://review.openstack.org/400820 | 16:40 |
*** EricGonczer_ has quit IRC | 16:42 | |
*** yolanda has quit IRC | 16:42 | |
*** yamamoto_ has joined #openstack-infra | 16:43 | |
*** drifterza has quit IRC | 16:46 | |
*** dizquierdo has quit IRC | 16:46 | |
*** yamamoto has quit IRC | 16:46 | |
*** wolverineav has joined #openstack-infra | 16:47 | |
amrith | fungi, clarkb ping ... | 16:47 |
clarkb | pong | 16:47 |
amrith | re: switching to xenial for newton | 16:47 |
amrith | hiya clarkb | 16:47 |
amrith | did you get a chance to see my email on this subject, wanted to close the loop with y'all on this | 16:48 |
clarkb | I did, I think you have misdirected your comments. The TC says we support these things, infra team tries to enable that (by getting images that work and helping projects move) I have no real say in where we run the tests | 16:48 |
*** jascott1 has joined #openstack-infra | 16:48 | |
clarkb | I am happy to help you get running on xenial, but I can't say "its totally ok to keep using 4 year old software" | 16:49 |
*** jascott1 has quit IRC | 16:49 | |
*** senk has joined #openstack-infra | 16:49 | |
*** matrohon has quit IRC | 16:49 | |
clarkb | I think greghaynes left some comments on how to make the dib situation better too? | 16:49 |
*** jascott1 has joined #openstack-infra | 16:49 | |
amrith | the dib situation is not the issue | 16:49 |
amrith | the issue is that we are proposing to make (or are being told to make) a change to a shipping, stable branch | 16:50 |
openstackgerrit | Merged openstack-infra/system-config: Allow for many translate-dev servers https://review.openstack.org/399789 | 16:50 |
amrith | that doesn't really meet the criteria for stable branches | 16:50 |
pabelanger | mtreinish: likely late, but I have no auth issues | 16:50 |
*** yamamoto_ has quit IRC | 16:50 | |
clarkb | yes you were asked to make that change months before the stable branch was cut though | 16:50 |
amrith | the dib issues are merely a matter of code. | 16:50 |
amrith | sorry clarkb, that's water under a bridge now; did I miss it on the ML, maybe yes, or maybe it was not on the ML | 16:51 |
clarkb | however I don't think this is that big a deal | 16:51 |
amrith | I don't believe that "you were asked to do it" | 16:51 |
clarkb | just build trusty guest images on xenial | 16:51 |
amrith | that's not the configuration that people use the software in | 16:51 |
clarkb | since aiui your control plane is happy on xenial already | 16:51 |
amrith | they use it on trusty | 16:51 |
clarkb | amrith: yes I am saying use trusty... | 16:51 |
amrith | on the control plane | 16:51 |
*** yolanda has joined #openstack-infra | 16:51 | |
*** panda is now known as panda|bbl | 16:52 | |
clarkb | amrith: openstack ansible at least says their deployments are using xenial | 16:52 |
amrith | people deploying trove today use trove with trusty on control plane and guest | 16:52 |
clarkb | (they were one of the first groups to switch to xenial way back in like may) | 16:52 |
amrith | and they don't test trove | 16:52 |
amrith | they run tempest tests; period | 16:52 |
amrith | not the full ci or any guests | 16:52 |
amrith | or clusters | 16:52 |
clarkb | ok, I am just going off of the data that is available to me | 16:52 |
fungi | amrith: "that's not the configuration people run" is a matter to take up with the tc... but also if you're not supporting it they're not going to be running it. catch-22 | 16:53 |
*** sshnaidm is now known as sshnaidm|mtg | 16:53 | |
*** inc0 has quit IRC | 16:53 | |
amrith | fungi, we are going to in ocata | 16:53 |
amrith | and this is the whole issue that we're trying to deal with in the 'release goals' mechanism so we don't have the 'but you should have done this months ago' situation. | 16:53 |
*** mhickey has quit IRC | 16:53 | |
fungi | amrith: and i replied to your e-mail just now. i don't think infra will be able to support your stable/newton branch effectively. you'll be on your own trying to keep devstack and other stuff working when it's not tested/gated | 16:54 |
amrith | oh well | 16:54 |
fungi | we could keep providing you trusty nodes to run jobs on, but we can't force the qa team to support that in devstack | 16:54 |
clarkb | and we area laready having trouble doing os | 16:55 |
*** pmalik has joined #openstack-infra | 16:55 | |
clarkb | there is at least one change that breaks compat with mysql 5.5 in trusty | 16:55 |
*** wolverineav has quit IRC | 16:55 | |
clarkb | and I know nova is wanting to bump min libvirt versions | 16:55 |
*** inc0 has joined #openstack-infra | 16:55 | |
clarkb | we have to move forward at some point. Which is why I think the TC made that decision in the first place | 16:55 |
*** vgnbkr has joined #openstack-infra | 16:55 | |
*** aliadil has joined #openstack-infra | 16:56 | |
fungi | amrith: basically, if openstack is one big integrated ecosystem, then everyone needs to be able to support the same distros on the same branches | 16:56 |
mtreinish | pabelanger: well, now it's working for me too | 16:56 |
mtreinish | pabelanger: so you must have fixed it :) | 16:56 |
*** jordanP has joined #openstack-infra | 16:56 | |
*** nherciu_ has joined #openstack-infra | 16:57 | |
*** hashar is now known as hasharAway | 16:57 | |
clarkb | amrith: I don't think we can really say what your guest image runs, thats like an appliance. But openstack awnts to run on newer software and that means newer control plane | 16:57 |
*** nherciu has quit IRC | 16:57 | |
amrith | sounds good fungi I've just released a newton release now; we'll work on getting ocata to xenial. newton when we're done with ocata, time permitting | 16:58 |
amrith | and clarkb we can say that all we want, the reality is that people deploying this stuff don't treat it as an appliance | 16:58 |
amrith | they stipulate the os that must run on it; that's our reality | 16:58 |
clarkb | amrith: right and we say what we will test on... | 16:58 |
amrith | sounds good; i think that's a good compromise | 16:59 |
amrith | I'll let stable maint know that in the foreseeable future newton stable branch may break and we'll fix it | 16:59 |
clarkb | "as an upstream this is what we think you should be doing, etc etc" via the test platforms, requirements, constraints and bindep | 16:59 |
*** berendt has quit IRC | 16:59 | |
*** wolverineav has joined #openstack-infra | 16:59 | |
clarkb | if we let large enterprises dictate our test platform we would still be testing on centos6 | 16:59 |
fungi | amrith: going back to the service vm image builds topic, what i proposed to dougshelley66 was to see whether the trove functional test jobs on stable/newton could run on xenial by using pre-built images that were created on trusty | 17:00 |
amrith | fungi, that doesn't really represent how we'd be telling people to deploy; for example constraint changes (or new things on pypi). | 17:00 |
amrith | it is for this exact reason that we moved away from cached images | 17:00 |
amrith | we used to do that | 17:00 |
amrith | stuff images on tarballs.o.o | 17:01 |
amrith | and that became a nightmare; | 17:01 |
amrith | the CI would pass but locally run tests would fail, deployments would fail | 17:01 |
amrith | all because the prebuilt images were out of date | 17:01 |
dougshelley66 | fungi I was thinking about our discussion yesterday and it would result in exactly what amrith just indicated | 17:01 |
amrith | also the pre built images have trove code | 17:01 |
amrith | on them | 17:01 |
fungi | i mean as an alternative to not being able to run those jobs on xenial at all | 17:01 |
amrith | so, what we would effectively be testing was some unicorn | 17:02 |
amrith | fungi, in the short term, we'll focus on master/ocata | 17:02 |
amrith | once we're done with that, we'll have to figure out what to do with stable | 17:02 |
*** EricGonczer_ has joined #openstack-infra | 17:02 | |
amrith | because stable is complicated by the trove-integration switch which also happened | 17:02 |
amrith | l, m and n are trove-integration based | 17:02 |
amrith | and so we have to figure out what we're doing there. | 17:02 |
*** Alagar has quit IRC | 17:02 | |
clarkb | amrith: like I siad, my suggestion would be to run the trusty guest image if that is important, the control plane being on xenial vs trusty should be less important to trove (because you make use of neutron and nova and such that care more | 17:03 |
amrith | and we may end up just doing a no-op for now because no matter what node you give us, we run the guest on trusty anyway | 17:03 |
amrith | and clarkb, that is how the misleading trove-integration xenial jobs are doing things today | 17:03 |
fungi | amrith: fair enough. just don't be surprised if you cease being able to run integration and functional test jobs on stable/newton when other repos you depend on cease being able to work there | 17:03 |
amrith | fungi, understood. | 17:03 |
clarkb | amrith: misleading? | 17:03 |
amrith | clarkb, yes; blindly :) | 17:03 |
dougshelley66 | clarkb just for my own understanding. You are saying it is ok for us to now state that the stable/mitake control plane will no longer be tested on trusty even though that's what was supported when it released? | 17:04 |
dougshelley66 | s/mitake/mitaka | 17:04 |
amrith | no | 17:04 |
amrith | I think they are only saying newton and master | 17:04 |
*** mvandijk has joined #openstack-infra | 17:04 | |
clarkb | dougshelley66: newton, and no the intent was xenial was the supported platform, we switched all unitesting, doc building, linting and the "core" integration tests to xenial in newton | 17:04 |
openstackgerrit | Ken Giusti proposed openstack-infra/project-config: Enable devstack plugins oslo.messaging drivers https://review.openstack.org/400856 | 17:04 |
amrith | mitaka will be trusty, I believe. | 17:04 |
dougshelley66 | ok thanks for the clarification. So the stable branch for mitaka will still be tested on trusty? | 17:05 |
clarkb | yes | 17:05 |
dougshelley66 | ok understood | 17:05 |
amrith | so clarkb what's misleading you ask ... | 17:06 |
amrith | see http://logs.openstack.org/98/400398/1/check/gate-trove-legacy-functional-dsvm-mysql-newton/ddca412/ | 17:06 |
amrith | this is a job that runs now for newton | 17:06 |
amrith | it is running on trusty | 17:06 |
clarkb | yes | 17:06 |
fungi | right, the stable/mitaka branches of devstack, nova, et cetera are and will continue to be tested on trusty until eol. the challenge is mixing testing some integrated projects on trusty and some on xenial for the stable/newton branch. it stands a very good chance of breaking down quickly | 17:07 |
*** ad_rien_ has quit IRC | 17:08 | |
clarkb | amrith: my point is the things that intersect with major differences in the kernel, ovs, etc are what care. Your control planedoes not do this as far as I know. Nova and neutron and magnum et al do and they have already switched | 17:08 |
*** ad_rien_ has joined #openstack-infra | 17:08 | |
clarkb | and they largely switched before the newton release | 17:08 |
fungi | the way we avoided that for the precise to trusty transition was just to switch everyone and tell them they had to fix their broken jobs so they could go back to merging changes. our mistake with the trusty to xenial transition was to give projects the option of doing it on their own timeframes | 17:08 |
amrith | clarkb, I think we have an agreement here ... | 17:09 |
amrith | we will fix the stuff | 17:09 |
amrith | we realize that in the intervening period, something may break | 17:09 |
amrith | we have some ideas on how to get past those things. | 17:09 |
amrith | but the priority will be Ocata/Xenial | 17:09 |
*** wolverineav has quit IRC | 17:09 | |
amrith | I don't want either stable or infra to be surprised when some newton stable jobs for trove start to fail on Dec 6th or whenever | 17:09 |
amrith | we'll try to get it done before that | 17:10 |
amrith | but it will be tough; I think. | 17:10 |
amrith | and fungi I think we agree, the next time something like this comes along, we have the cross-project-release-goals mechanism which we can use. | 17:10 |
*** nadya has quit IRC | 17:11 | |
*** kashyap has left #openstack-infra | 17:11 | |
*** tqtran has joined #openstack-infra | 17:11 | |
clarkb | in the past we just hard switched everyone, said sorry, and forced you to fix it at that point | 17:11 |
clarkb | this time around I think we tried to be more diplomatic which allowed many projects to ignore the problem | 17:11 |
clarkb | having a cross project goal mechanisn will be a good way to straddle both options there and have something that should produce the outcome we want | 17:12 |
clarkb | while not making things too terrible for the projects | 17:12 |
*** rbuzatu has quit IRC | 17:12 | |
openstackgerrit | Rodrigo Duarte proposed openstack-infra/project-config: Enable keystone-saml2-federation service https://review.openstack.org/400750 | 17:13 |
amrith | clarkb, agreed | 17:13 |
*** sshnaidm|mtg is now known as sshnaidm | 17:13 | |
openstackgerrit | Omar Rivera proposed openstack-infra/project-config: Add fuel-plugin-nitrous project https://review.openstack.org/400429 | 17:14 |
fungi | yep, i concur, should be better in the future | 17:14 |
*** knangia has joined #openstack-infra | 17:15 | |
*** tqtran has quit IRC | 17:16 | |
*** wolverineav has joined #openstack-infra | 17:16 | |
*** newmember has joined #openstack-infra | 17:17 | |
*** asettle has quit IRC | 17:18 | |
*** dtantsur is now known as dtantsur|afk | 17:18 | |
*** sdake_ has quit IRC | 17:18 | |
*** chem has quit IRC | 17:19 | |
*** chem has joined #openstack-infra | 17:19 | |
*** weshay is now known as weshay_brb | 17:20 | |
*** wolverineav has quit IRC | 17:20 | |
*** wolverineav has joined #openstack-infra | 17:21 | |
*** inc0 has quit IRC | 17:22 | |
*** gomarivera has joined #openstack-infra | 17:22 | |
*** mmandel has quit IRC | 17:22 | |
*** sdake has joined #openstack-infra | 17:24 | |
*** lucasagomes is now known as lucas-afk | 17:25 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Full quickstart gate run on OVB https://review.openstack.org/381094 | 17:25 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: Test quickstart experimental job https://review.openstack.org/397609 | 17:25 |
*** wolverineav has quit IRC | 17:26 | |
*** wolverineav has joined #openstack-infra | 17:28 | |
gomarivera | quick question - I'm fairly new contributor - this is my first review opened on openstack-infra - https://review.openstack.org/#/c/400429/ - should I add the repository group to my review? - what's the best way to notify the approvers group? | 17:28 |
*** weshay_brb is now known as weshay | 17:28 | |
*** dprince has quit IRC | 17:29 | |
*** tqtran has joined #openstack-infra | 17:30 | |
*** dprince has joined #openstack-infra | 17:30 | |
sshnaidm | clarkb, I think this symlink was not-broken on subnode and pointing to some file there (abs. path), but when it was copied to primary node it started to point to non-existing file and turned to be broken. But I'm not sure why it was copied and not file itself.. | 17:30 |
*** rossella__ has quit IRC | 17:30 | |
clarkb | sshnaidm: we use the ansible synchronize module, maybe we need to add a flag there to follow symlinks too | 17:31 |
*** hurgleburgler has joined #openstack-infra | 17:31 | |
clarkb | sshnaidm: look in the -wrap.sh script at the end to see the synchronize call | 17:31 |
*** rossella__ has joined #openstack-infra | 17:31 | |
clarkb | gomarivera: typically reviewers get to things as they are able. Pinging for reviewers here also happens a bit though not sure how effective it is. I know I personally can't keep up with gerrit email so I ignore when I am added as a reviewer directly | 17:32 |
*** wolverineav has quit IRC | 17:32 | |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add a cron job to release AFS volumes https://review.openstack.org/400887 | 17:33 |
jeblair | mordred, clarkb, fungi, pabelanger, AJaeger: ^ | 17:33 |
sshnaidm | clarkb, you're right, need to add "copy-links=yes" to ansible params, will do this | 17:33 |
*** rbuzatu has joined #openstack-infra | 17:33 | |
clarkb | sshnaidm: thanks | 17:34 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add a cron job to release AFS volumes https://review.openstack.org/400887 | 17:34 |
fungi | jeblair: i guess this was to avoid having a slew of redundant vos release jobs for that volume piling up in the post pipeline and choking the release node? | 17:35 |
mordred | jeblair: does the specific node trump the regex node in puppet? | 17:35 |
*** fguillot has quit IRC | 17:36 | |
gomarivera | @clarkb: thank you for the tips | 17:36 |
fungi | yeah, i've always wondered if that's a first-match situation, or if resources get merged | 17:36 |
*** rbuzatu has quit IRC | 17:38 | |
*** fguillot has joined #openstack-infra | 17:38 | |
*** Alagar has joined #openstack-infra | 17:39 | |
clarkb | sshnaidm: looks like its copy_links in the ansible docs, not sure if - and _ are treated as equivalent there | 17:39 |
*** yolanda has quit IRC | 17:40 | |
*** gomarivera has quit IRC | 17:40 | |
*** nherciu_ has quit IRC | 17:41 | |
*** inc0 has joined #openstack-infra | 17:42 | |
*** wolverineav has joined #openstack-infra | 17:43 | |
*** rbuzatu has joined #openstack-infra | 17:43 | |
*** mmandel has joined #openstack-infra | 17:44 | |
jeblair | fungi: yes; we can probably revisit after zuulv3 | 17:44 |
jeblair | mordred: i hope? :) | 17:44 |
*** rbuzatu has quit IRC | 17:48 | |
*** flepied has quit IRC | 17:48 | |
*** jlibosva has quit IRC | 17:50 | |
*** wolverineav has quit IRC | 17:50 | |
*** ldnunes has quit IRC | 17:51 | |
*** ldnunes has joined #openstack-infra | 17:52 | |
*** nherciu has joined #openstack-infra | 17:54 | |
AJaeger | jeblair, fungi: I tried to document the tools/test-setup work we discussed on https://etherpad.openstack.org/p/su4PMQ9kN9 - want to send that to openstack-infra mailing list as heads up and for discussion. Could you quickly review, please? | 17:55 |
*** raildo has quit IRC | 17:57 | |
*** wolverineav has joined #openstack-infra | 17:58 | |
*** dprince has quit IRC | 17:58 | |
*** weshay is now known as weshay1-1 | 17:59 | |
*** dprince has joined #openstack-infra | 17:59 | |
*** abregman is now known as abregman|afk | 17:59 | |
*** raildo has joined #openstack-infra | 17:59 | |
*** derekh has quit IRC | 18:01 | |
*** EricGonczer_ has quit IRC | 18:02 | |
*** EricGonczer_ has joined #openstack-infra | 18:02 | |
*** baoli has quit IRC | 18:02 | |
*** ralonsoh has quit IRC | 18:03 | |
*** baoli has joined #openstack-infra | 18:03 | |
*** Guest98237 has quit IRC | 18:04 | |
*** EricGonczer_ has quit IRC | 18:05 | |
*** nt has quit IRC | 18:06 | |
*** EricGonczer_ has joined #openstack-infra | 18:06 | |
*** nadya has joined #openstack-infra | 18:07 | |
*** nt has joined #openstack-infra | 18:07 | |
*** wolverineav has quit IRC | 18:07 | |
*** kzaitsev_mb has quit IRC | 18:07 | |
*** wolverineav has joined #openstack-infra | 18:08 | |
*** hyakuhei has quit IRC | 18:08 | |
*** Alagar has quit IRC | 18:11 | |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: fix regex issue for job https://review.openstack.org/400784 | 18:13 |
*** wolverineav has quit IRC | 18:13 | |
*** Alagar has joined #openstack-infra | 18:14 | |
*** hyakuhei has joined #openstack-infra | 18:15 | |
*** psilvad has quit IRC | 18:15 | |
*** sshnaidm is now known as sshnaidm|away | 18:16 | |
*** maishsk has joined #openstack-infra | 18:18 | |
*** maishsk has quit IRC | 18:18 | |
*** esikachev has quit IRC | 18:19 | |
*** ihrachys has quit IRC | 18:19 | |
*** wolverineav has joined #openstack-infra | 18:19 | |
*** senk has quit IRC | 18:19 | |
clarkb | sshnaidm|away: I went ahead and left a -1 on the devstack-gate change so we don't forget what the fix is there for multinode | 18:20 |
*** yolanda has joined #openstack-infra | 18:20 | |
*** weshay1-1 is now known as weshay | 18:20 | |
*** senk has joined #openstack-infra | 18:21 | |
*** e0ne has quit IRC | 18:22 | |
*** ad_rien_ has quit IRC | 18:22 | |
*** yolanda has quit IRC | 18:23 | |
*** yolanda has joined #openstack-infra | 18:23 | |
*** wolverineav has quit IRC | 18:24 | |
*** yamahata has quit IRC | 18:24 | |
openstackgerrit | Anusha Unnam proposed openstack-infra/project-config: Do not merge: Test patch to check post_hook script https://review.openstack.org/400926 | 18:24 |
*** shardy has quit IRC | 18:27 | |
*** saibarspeis has quit IRC | 18:27 | |
*** saibarspeis has joined #openstack-infra | 18:27 | |
*** hyakuhei has quit IRC | 18:28 | |
*** hyakuhei has joined #openstack-infra | 18:28 | |
*** hyakuhei has quit IRC | 18:28 | |
*** hyakuhei has joined #openstack-infra | 18:28 | |
*** oanson has joined #openstack-infra | 18:28 | |
AJaeger | jeblair: any feedback on the etherpad - or ok to send to openstack-infra? Or do you propose another way of sharing? | 18:29 |
*** rbuzatu has joined #openstack-infra | 18:29 | |
*** flwang1 has joined #openstack-infra | 18:30 | |
*** nadya has quit IRC | 18:30 | |
clarkb | AJaeger: it lgtm. Might be worth thinkingabout how that may fit in with swift's xfs stuff but I don't think it needs to go in the email or be used for that today | 18:31 |
jeblair | clarkb: agreed | 18:31 |
*** wolverineav has joined #openstack-infra | 18:31 | |
jeblair | AJaeger: seems good -- i'd ask for fungi's review | 18:31 |
openstackgerrit | Jimmy McCrory proposed openstack-infra/system-config: Refactor mariadb mirror into 2 repos https://review.openstack.org/354203 | 18:32 |
*** florianf has quit IRC | 18:32 | |
fungi | yep, it's on my radar just trying to get meeting-day stuff behind me | 18:32 |
AJaeger | thanks, clarkb and jeblair. Will check the swift setup and add a paragraph. | 18:32 |
fungi | i'll look quickly so i don't hold you up | 18:32 |
notmyname | is that proposed tools/test-setup.sh in the project repo or in an infra repo? | 18:32 |
*** jpena is now known as jpena|off | 18:32 | |
*** asettle has joined #openstack-infra | 18:32 | |
clarkb | notmyname: you would put the tools/test-setup.sh in your repo (swift) then the python unittest jobs would automatically run it if it is present | 18:33 |
clarkb | fungi: ianw: is there any gerrit project renaming prep work I can help with this morning? | 18:33 |
*** rbuzatu has quit IRC | 18:34 | |
fungi | clarkb: it's only one project, so i figured we were just going to wing it in the window | 18:34 |
clarkb | fungi: ok | 18:34 |
*** yolanda has quit IRC | 18:34 | |
*** thorst has joined #openstack-infra | 18:34 | |
notmyname | AJaeger: want me to ask in here or on the etherpad? | 18:35 |
fungi | clarkb: though a reread of the channel log from our last rename maintenance might be in order. i think i may have identified bugs/oversights in the playbook that i never got around to producing patches for | 18:35 |
*** tosky has quit IRC | 18:35 | |
AJaeger | notmyname: feel free to add a comment on the etherpad - but hearing you, I'll update... | 18:35 |
AJaeger | jeblair, clarkb I added "The xfs TMPDIR setup of swift [2] could been done in general this way as well but that change needs to set TMPDIR for the unittests, just pass information from the set up builder to the tox builder. This is currently not possible." | 18:35 |
clarkb | AJaeger: thanks | 18:35 |
*** wolverineav has quit IRC | 18:36 | |
*** wolverineav has joined #openstack-infra | 18:36 | |
*** flepied has joined #openstack-infra | 18:36 | |
notmyname | AJaeger: I see you said setting the TMPDIR isn't possible. but the reason I did that is because it avoided coordination of magic strings across different repos. swift could still use mkstemp() and if TMPDIR is set or not, it works. however, if the directory is set in the same repo (in test-setup.sh in swift), then the tests in swift can use that too (right?) | 18:37 |
notmyname | point is, if swift is doing the setup in swift (instead of in an infra repo), then it gets much easier to set it in one place and Just Work | 18:37 |
*** wolverin_ has joined #openstack-infra | 18:37 | |
notmyname | I think | 18:37 |
*** thorst has quit IRC | 18:39 | |
*** Nrk9t1x has quit IRC | 18:39 | |
AJaeger | notmyname: yes, you could do it this way: create directoy in tools/test-setup.sh and in your tox.ini file set TMPDIR to the directoy you used in tools/test-setup.sh. | 18:39 |
clarkb | http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-09-02.log.html#t2016-09-02T18:02:03 is where the logs start for the last project rename | 18:39 |
clarkb | rereading through that now | 18:39 |
fungi | notmyname: yeah, if you used some other mechanism to communicate what TMPDIR should be used, then you could leverage a generalized solution like this | 18:39 |
AJaeger | fungi: or hardcode it | 18:40 |
clarkb | fungi: https://review.openstack.org/#/c/365067/ looks to be the set of docs we were operating with | 18:40 |
fungi | AJaeger: yep, i considered hard-coded strings one way to "communicate" it | 18:40 |
*** thorst has joined #openstack-infra | 18:40 | |
AJaeger | ok | 18:40 |
fungi | AJaeger: in general the message lgtm. i made a few edits/additions for clarity | 18:41 |
openstackgerrit | Andy McCrae proposed openstack-infra/project-config: Skip ubuntu-trusty jobs for OpenStack-Ansible on Ocata+ https://review.openstack.org/400197 | 18:41 |
*** wolverineav has quit IRC | 18:41 | |
notmyname | AJaeger: fungi: so that proposed idea seems to be pretty interesting (with my limited understanding). sounds like it would have been a pretty nice thing to have a week or two ago ;-) | 18:41 |
AJaeger | fungi, thanks! | 18:41 |
AJaeger | notmyname: yeah ;) | 18:41 |
fungi | clarkb: oh! hah, so maybe i did propose one and never got around to finishing it | 18:41 |
fungi | looks like my inline comments on that change are relevant | 18:42 |
AJaeger | fungi, sent to openstack-infra as FYI? | 18:42 |
AJaeger | fungi: thanks for your edits! | 18:42 |
clarkb | fungi: it looks like comments there about slashes and .git things are related to the playbook breaking | 18:42 |
clarkb | fungi: so ya I think we need thsoe updates if we expect things to work correctly | 18:42 |
fungi | AJaeger: just sending to -dev is probably fine, but with [all] and [infra] subject tags maybe | 18:43 |
*** trown is now known as trown|lunch | 18:43 | |
AJaeger | fungi: ok, will do. | 18:43 |
fungi | clarkb: have time to propose an updated patchset? otherwise we can just use a locally edited copy | 18:43 |
clarkb | fungi: ya I can work on that now | 18:43 |
fungi | thanks! at least my playbook comments seem to be pretty straightforward edits | 18:44 |
fungi | clarkb: and the group renaming piece probably needs to just get ripped out for now | 18:44 |
fungi | we can revert to the old manual version using the ssh api with our own credentials or something | 18:45 |
*** thorst has quit IRC | 18:45 | |
*** strigazi is now known as strigazi_AFK | 18:46 | |
*** Alagar has quit IRC | 18:46 | |
*** florianf has joined #openstack-infra | 18:46 | |
clarkb | fungi: trying to figure out what these things are is not easy | 18:47 |
*** oanson has quit IRC | 18:47 | |
*** Sukhdev has joined #openstack-infra | 18:48 | |
fungi | clarkb: i think there was additional context around them in the channel log | 18:48 |
clarkb | oh right item is magical ansibleness | 18:48 |
fungi | and glittery magical ansible unicorns, right | 18:48 |
*** Alagar has joined #openstack-infra | 18:49 | |
AJaeger | clarkb: could you later review https://review.openstack.org/#/c/400197/5/zuul/layout.yaml for an ansible xenial change, please? | 18:50 |
*** jgriffith has quit IRC | 18:51 | |
clarkb | AJaeger: yes | 18:51 |
*** rbuzatu has joined #openstack-infra | 18:53 | |
*** dprince has quit IRC | 18:53 | |
*** pvaneck has joined #openstack-infra | 18:53 | |
clarkb | mordred: is remote_user: root paired with sudo: yes something we want? | 18:54 |
clarkb | mordred: I fail to understand why root would need to sudo | 18:54 |
*** yolanda has joined #openstack-infra | 18:55 | |
fungi | clarkb: worth noting, things i left comments on in that patch were things i specifically _had_ to change or the playbook did not work | 18:55 |
clarkb | fungi: ya just noticing we have remote_user: root and sudo: yes in a lot of places | 18:56 |
fungi | those weren't just general improvements | 18:56 |
*** psilvad has joined #openstack-infra | 18:56 | |
fungi | clarkb: agreed, that strikes me as odd too | 18:56 |
clarkb | fungi: re the group renaming, that task sshes to review.o.o becomes gerrit2 then sshes to gerrit via the local gerrit user which I think is valid | 18:56 |
*** ijw has joined #openstack-infra | 18:56 | |
clarkb | fungi: but going to confirm that | 18:56 |
clarkb | (I think it failed for you because puppetmaster can't ssh to gerrit2@review.o.o so need to set remote_user: root and become_user: gerrit2 | 18:57 |
*** asettle has quit IRC | 18:57 | |
*** rbuzatu has quit IRC | 18:57 | |
*** bin_ has quit IRC | 18:57 | |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-openstackci: Use nodepool::builder for nodepool https://review.openstack.org/356503 | 18:57 |
*** asettle has joined #openstack-infra | 18:58 | |
jeblair | clarkb: all the things you are saying make sense to me | 18:58 |
fungi | clarkb: ahh, right-o | 18:58 |
*** yolanda has quit IRC | 18:59 | |
fungi | it's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour | 19:00 |
*** senk has quit IRC | 19:00 | |
AJaeger | team, for today's rename I would appreciate a second +2 on https://review.openstack.org/#/c/381332 - I'll remove the WIP now. Also, there's a followup change at https://review.openstack.org/#/c/399993/ for review, please | 19:00 |
*** tiswanso has quit IRC | 19:00 | |
*** tiswanso has joined #openstack-infra | 19:01 | |
*** jordanP has quit IRC | 19:01 | |
johnsom | tonyb Have they answered your concerns on https://review.openstack.org/#/c/386790? | 19:01 |
*** asettle has quit IRC | 19:02 | |
*** inc0 has quit IRC | 19:02 | |
*** ijw has quit IRC | 19:03 | |
*** denisra has quit IRC | 19:03 | |
*** sdake_ has joined #openstack-infra | 19:03 | |
*** newmember has quit IRC | 19:04 | |
*** yamahata has joined #openstack-infra | 19:05 | |
*** sdake has quit IRC | 19:06 | |
*** dprince has joined #openstack-infra | 19:08 | |
*** electrofelix has quit IRC | 19:09 | |
*** inc0 has joined #openstack-infra | 19:09 | |
*** rbrndt has quit IRC | 19:10 | |
openstackgerrit | Michael Johnson proposed openstack-infra/project-config: Consolidate neutron-lbaas API tests https://review.openstack.org/386245 | 19:11 |
*** ijw has joined #openstack-infra | 19:12 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Update project rename instructions https://review.openstack.org/365067 | 19:12 |
*** dizquierdo has joined #openstack-infra | 19:14 | |
*** esikachev has joined #openstack-infra | 19:15 | |
*** psilvad has quit IRC | 19:15 | |
*** yolanda has joined #openstack-infra | 19:16 | |
*** denisra has joined #openstack-infra | 19:18 | |
*** psilvad has joined #openstack-infra | 19:18 | |
*** inc0 has quit IRC | 19:19 | |
*** esikachev has quit IRC | 19:19 | |
*** denisra_ has joined #openstack-infra | 19:21 | |
*** jtomasek has quit IRC | 19:21 | |
*** jtomasek has joined #openstack-infra | 19:22 | |
*** hasharAway is now known as hashar | 19:22 | |
*** Alagar has quit IRC | 19:22 | |
*** flwang1 has quit IRC | 19:24 | |
*** rbuzatu has joined #openstack-infra | 19:24 | |
*** denisra has quit IRC | 19:24 | |
*** nadya has joined #openstack-infra | 19:26 | |
*** e0ne has joined #openstack-infra | 19:26 | |
*** trown|lunch is now known as trown | 19:26 | |
*** EricGonczer_ has quit IRC | 19:27 | |
*** arxcruz has quit IRC | 19:28 | |
*** matrohon has joined #openstack-infra | 19:28 | |
*** rbuzatu has quit IRC | 19:28 | |
*** thorst has joined #openstack-infra | 19:29 | |
*** denisra_ has quit IRC | 19:29 | |
*** psilvad has quit IRC | 19:31 | |
*** yolanda has quit IRC | 19:32 | |
*** denisra has joined #openstack-infra | 19:33 | |
*** rossella__ has quit IRC | 19:33 | |
*** thorst has quit IRC | 19:33 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/400944 | 19:34 |
*** denisra has quit IRC | 19:37 | |
*** psilvad has joined #openstack-infra | 19:41 | |
*** yolanda has joined #openstack-infra | 19:42 | |
*** senk has joined #openstack-infra | 19:43 | |
openstackgerrit | Jimmy McCrory proposed openstack-infra/system-config: Refactor mariadb mirror into 2 repos https://review.openstack.org/354203 | 19:43 |
*** nherciu has quit IRC | 19:44 | |
*** esikachev has joined #openstack-infra | 19:45 | |
*** rbrndt has joined #openstack-infra | 19:45 | |
*** amoralej is now known as amoralej|off | 19:46 | |
*** EricGonczer_ has joined #openstack-infra | 19:47 | |
*** denisra has joined #openstack-infra | 19:48 | |
*** psilvad has quit IRC | 19:53 | |
*** yolanda has quit IRC | 19:54 | |
*** boden has joined #openstack-infra | 19:54 | |
*** chlong has quit IRC | 19:55 | |
*** odyssey4me has quit IRC | 19:56 | |
*** psilvad has joined #openstack-infra | 19:56 | |
boden | hi AJaeger sigmavirus: any idea how I can get some eyes on an openstack-dev/hacking patch? https://review.openstack.org/#/c/397940/ | 19:56 |
*** oanson has joined #openstack-infra | 19:57 | |
AJaeger | boden: I'm not reviewing that repo at all... | 19:58 |
boden | AJaeger ack.. sorry I saw your name on some recent commits | 19:59 |
*** panda|bbl is now known as panda | 20:01 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: logging: extract journal to compressed text file, before gathering https://review.openstack.org/400817 | 20:01 |
boden | dhellmann jd__ ^^ | 20:01 |
clarkb | mordred: eyes on https://review.openstack.org/365067 particularly around the removal of sudo: yes and the use of pause would be great | 20:01 |
fungi | boden: probably ask in #openstack-qa since it's a qa repo not infra | 20:01 |
*** chlong has joined #openstack-infra | 20:01 | |
clarkb | mordred: I know you are TCing | 20:01 |
*** baoli has quit IRC | 20:01 | |
* AJaeger waves good night | 20:01 | |
boden | fungi: got it. thx | 20:01 |
clarkb | AJaeger: good night | 20:01 |
*** tiswanso has quit IRC | 20:02 | |
*** tiswanso has joined #openstack-infra | 20:02 | |
*** odyssey4me has joined #openstack-infra | 20:02 | |
mordred | clarkb: I _believe_ we want become: yes\nbecome_user: gerrit | 20:02 |
openstackgerrit | Nate Johnston proposed openstack-infra/project-config: neutron-fwaas: Consume gate hook for tempest plugin jobs https://review.openstack.org/400745 | 20:02 |
clarkb | mordred: you are right and that is silly | 20:03 |
clarkb | but at least the docs document it | 20:03 |
*** psilvad has quit IRC | 20:04 | |
*** vaidy has quit IRC | 20:04 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Update project rename instructions https://review.openstack.org/365067 | 20:04 |
*** sambetts is now known as sambetts|afk | 20:05 | |
*** baoli has joined #openstack-infra | 20:05 | |
*** isviridov_away has quit IRC | 20:05 | |
*** inc0 has joined #openstack-infra | 20:06 | |
mgagne | pabelanger: I see you encountered this issue in the past: "LaunchNetworkException: Unable to find public IP of server" What was the problem and solution? | 20:08 |
*** dave-mccowan has quit IRC | 20:10 | |
*** rhallisey has quit IRC | 20:12 | |
*** Goneri has quit IRC | 20:13 | |
*** ldnunes has quit IRC | 20:15 | |
mgagne | looks like 'public_v4' is empty in the server object returned by self.manager.createServer or self.manager.waitForServer | 20:17 |
*** senk has quit IRC | 20:17 | |
clarkb | mgagne: you might need to explicitly specify a network as public | 20:19 |
mgagne | it's already done | 20:19 |
*** dmanchad has quit IRC | 20:19 | |
mordred | oh. well that's not good then | 20:19 |
mgagne | using a config that used to work until I upgraded | 20:19 |
mordred | mgagne: I'm in a meeting at the moment, but am very much interested in getting to the bottom of your problem | 20:19 |
mgagne | maybe there is a regression in the old config syntax (before clouds.yaml) | 20:20 |
*** jcoufal has quit IRC | 20:20 | |
mgagne | yea, now we are out of slaves =) | 20:20 |
*** jpena|off has quit IRC | 20:20 | |
mgagne | I guess I could downgrade and see where it goes | 20:20 |
*** jschwarz has quit IRC | 20:20 | |
*** chem has quit IRC | 20:21 | |
*** chem has joined #openstack-infra | 20:21 | |
mordred | mgagne: if you have a sec, could you paste a copy of your clouds.yaml (scrubbed of auth info of course) and then also run a script like http://paste.openstack.org/show/590139/ and capture its log output? | 20:23 |
*** rbuzatu has joined #openstack-infra | 20:23 | |
mgagne | mordred: I don't have a clouds.yaml =) | 20:23 |
openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Add a amqp1 job for Heat https://review.openstack.org/400799 | 20:23 |
mordred | mgagne: oh. weird. ok - then can you just paste your nodepool.yaml snippet? | 20:24 |
mgagne | mordred: that's why I suspect a regression in the compat code or in combination with shade | 20:24 |
mordred | that shows the network config? | 20:24 |
mgagne | sure | 20:24 |
mordred | yah. we may have missed a case for sure. :( | 20:24 |
Shrews | mgagne: what shade version did you upgrade from? | 20:25 |
*** ajo has quit IRC | 20:25 | |
Shrews | and to? | 20:25 |
*** ajo has joined #openstack-infra | 20:25 | |
mgagne | looks like shade didn't get upgraded | 20:25 |
mgagne | currently at shade==1.13.1 | 20:26 |
mgagne | was running nodepool==0.2.1.dev51 before that | 20:26 |
*** adriant has joined #openstack-infra | 20:26 | |
mgagne | which is 1fa3ee77791f7c5dd4faa38a2a8012662f6e88a8 | 20:26 |
jd__ | boden: reviewed, looks legit :) | 20:26 |
Shrews | oh, a nodepool upgrade. i see | 20:26 |
*** jschwarz has joined #openstack-infra | 20:26 | |
openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Grafana fixes for n8g-(bagpipe|bgpvpn) https://review.openstack.org/400953 | 20:27 |
mgagne | mordred: provider config: http://paste.openstack.org/show/590141/ | 20:27 |
boden | jd__ thanks for taking the time | 20:27 |
mordred | mgagne: thanks! | 20:27 |
openstackgerrit | Merged openstack-infra/project-config: Skip ubuntu-trusty jobs for OpenStack-Ansible on Ocata+ https://review.openstack.org/400197 | 20:27 |
mgagne | Shrews: yea, maybe it's related to 0.3.X | 20:27 |
mgagne | I don't mind updating to use clouds.yaml but docs shows that old config should still work so I got lazy ¯\_(ツ)_/¯ | 20:28 |
mordred | :) | 20:28 |
mordred | mgagne: I agree - it is surprising to me that it stopped working and I apologize for that | 20:28 |
*** rbuzatu has quit IRC | 20:28 | |
mgagne | no problem, hopefully my coworker wajdi wasn't performing a live demo during his talk on CI at the openstack canada day =) | 20:29 |
mordred | hahahah | 20:29 |
mgagne | "now we just have to wait for Jenkins to run the job... maybe wait a little more..." | 20:30 |
*** jpena|off has joined #openstack-infra | 20:30 | |
*** florianf has quit IRC | 20:30 | |
*** dmanchad has joined #openstack-infra | 20:32 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Re-enable test: test_list_nodes https://review.openstack.org/400955 | 20:32 |
*** mhickey has joined #openstack-infra | 20:34 | |
*** pradk has quit IRC | 20:35 | |
mgagne | mordred: the object/data returned by shade has the IP in private_v4, not public_v4. | 20:36 |
mordred | mgagne: yah. looking at things, you were on a VERY old nodepool | 20:36 |
mgagne | I think it was the first iteration of the public: true flag | 20:36 |
mordred | yah- I believe between now and then we gave up on allowing setting that in the nodepool config because it got VERY weird | 20:37 |
*** flwang1 has joined #openstack-infra | 20:37 | |
mgagne | should I just upgrade to clouds.yaml and call it a day? | 20:37 |
mordred | yes please | 20:37 |
mordred | and I'll fix the docs | 20:37 |
mgagne | alright, thanks! | 20:37 |
mordred | mgagne: sorry for the trouble :( | 20:38 |
mgagne | no problem, with responsive support, it's much better than cursing alone against a screen =) | 20:38 |
mordred | \o/ - also, I can attest that the clouds.yaml way works with internap well ... given that we use it :) | 20:39 |
*** raildo has quit IRC | 20:39 | |
mgagne | yea, we don't consume our public cloud, private cloud with similar setup (ip is directly reachable, no FIP) | 20:40 |
*** abregman|afk has quit IRC | 20:40 | |
openstackgerrit | Julius Roberts proposed openstack-infra/shade: Added documentation for delete_image() https://review.openstack.org/400519 | 20:41 |
mordred | ++ | 20:42 |
hoolio | w00t! :) | 20:43 |
pabelanger | mgagne: Not the best help today, mingling with your co-workers at openstackdayCA :) | 20:44 |
* sc68cal claps as the gate delay goes from 5hrs to 1hr | 20:44 | |
* mordred hands sc68cal a beer | 20:44 | |
mgagne | pabelanger: hehe, no problem. I reverted to older nodepool and will use clouds.yaml as suggested by mordred | 20:44 |
pabelanger | I seen that, what was the issue of delay today? | 20:44 |
clarkb | mordred: the nodepool option is supposed to work iirc, and wr use it | 20:45 |
mordred | clarkb: I see no code in nodepool that does anything with it | 20:45 |
clarkb | we use it in osic | 20:46 |
jeblair | placebo option? | 20:46 |
clarkb | https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nodepool.yaml#n753 | 20:46 |
clarkb | may be | 20:46 |
mordred | clarkb: it's vestigal | 20:46 |
mordred | we have the clouds.yaml options | 20:46 |
mordred | b38290421483c19428910c31fe4c918229c14d86 removed the place where we set routes_externally=True | 20:47 |
clarkb | ok so we need to clean up our config then | 20:47 |
mordred | yah | 20:49 |
mordred | and the nodepool docs that mention that option | 20:49 |
*** jeckersb is now known as jeckersb_gone | 20:51 | |
*** pradk has joined #openstack-infra | 20:52 | |
*** inc0 has quit IRC | 20:52 | |
*** oanson has quit IRC | 20:53 | |
*** oanson has joined #openstack-infra | 20:54 | |
*** mhickey has quit IRC | 20:55 | |
openstackgerrit | Merged openstack-infra/shade: Try to return working IP if we get more than one https://review.openstack.org/390144 | 20:55 |
*** rtheis has quit IRC | 20:57 | |
fungi | okay, i guess it's time to start doing gerritstuffs? | 21:00 |
*** newmember has joined #openstack-infra | 21:01 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Re-enable TestWebApp tests https://review.openstack.org/399716 | 21:01 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Remove waitForBuiltImages() / JobTracker() from nodepool.py https://review.openstack.org/399727 | 21:01 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Add test to validate when a node build is disabled https://review.openstack.org/399642 | 21:01 |
*** inc0 has joined #openstack-infra | 21:01 | |
fungi | %status alert Gerrit is offline until 21:30 UTC for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107379.html | 21:01 |
*** kzaitsev_mb has joined #openstack-infra | 21:01 | |
fungi | ianw: clarkb: ^ | 21:01 |
fungi | ? | 21:01 |
clarkb | ++ | 21:02 |
ianw | ok, now what :) | 21:02 |
*** dmanchad has quit IRC | 21:02 | |
fungi | we need to stop and dump zuul queues unless we think we can make this outage really brief | 21:02 |
fungi | i'll go ahead and stop ansible now | 21:02 |
clarkb | I think we should follow the doc | 21:03 |
clarkb | will help keep us honest | 21:03 |
*** dmanchad has joined #openstack-infra | 21:03 | |
fungi | yes, agreed | 21:03 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Re-enable test_hold test https://review.openstack.org/399758 | 21:04 |
ianw | we need to merge 365067? | 21:04 |
clarkb | http://docs-draft.openstack.org/67/365067/3/check/gate-system-config-docs-ubuntu-xenial/19b394e//doc/build/html/gerrit.html#renaming-a-project | 21:04 |
fungi | the rename change gets approved/merged after we bring gerrit back online | 21:04 |
clarkb | fungi: thats the playbook/docs update change | 21:05 |
*** dprince has quit IRC | 21:05 | |
fungi | oh, that. i would check it out and run a local copy | 21:05 |
fungi | there may still be more edits we discover it needs | 21:05 |
*** saibarspeis has quit IRC | 21:05 | |
ianw | playbook updtae i mean | 21:05 |
clarkb | ya then we can update if we have more issues. Also my changes to the playbook are not tested ... | 21:05 |
*** Goneri has joined #openstack-infra | 21:05 | |
fungi | clearly the previous state of that playbook wasn't tested either, which is why i started that change in the first place | 21:05 |
fungi | puppet is disabled globally for the moment and isn't running anywhere | 21:06 |
*** hoolio has left #openstack-infra | 21:06 | |
fungi | i'll go ahead with the status alert | 21:06 |
fungi | #status alert Gerrit is offline until 21:30 UTC for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107379.html | 21:06 |
openstackstatus | fungi: sending alert | 21:06 |
*** hoolio has joined #openstack-infra | 21:06 | |
fungi | who wants to export zuul queues? | 21:07 |
clarkb | I can do that | 21:07 |
clarkb | unless ianw wants to do it for learning | 21:07 |
ianw | i'm ok with that bit :) | 21:07 |
*** weshay_ has joined #openstack-infra | 21:08 | |
clarkb | ianw: so I should go ahead and do it? | 21:08 |
fungi | just keeping track: #1 and #3 are done. i can work on #2 | 21:08 |
ianw | yep | 21:08 |
clarkb | I am doing #4 now | 21:08 |
ianw | fungi / clarkb: shared screen on puppetmaster? | 21:08 |
*** baoli has quit IRC | 21:08 | |
-openstackstatus- NOTICE: Gerrit is offline until 21:30 UTC for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107379.html | 21:08 | |
*** ChanServ changes topic to "Gerrit is offline until 21:30 UTC for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107379.html" | 21:09 | |
fungi | ianw: sure, but start screen as root so it's easier | 21:09 |
fungi | unless we shouldn't run the playbook as root | 21:09 |
ianw | i've started one as root | 21:09 |
clarkb | fungi: ianw queues saved. Ready for me to stop zuul now? | 21:09 |
clarkb | hello? | 21:10 |
fungi | clarkb: yes, go for it | 21:10 |
fungi | ianw: looks like you're working on #2 so i'll leave you to that | 21:10 |
clarkb | ok done | 21:10 |
*** jamesdenton has quit IRC | 21:11 | |
ianw | do we need core & release in the groups? i guess so | 21:11 |
fungi | yep | 21:11 |
fungi | can find them looking in the change's acl | 21:12 |
openstackstatus | fungi: finished sending alert | 21:12 |
fungi | looks right to me | 21:13 |
*** jgriffith has joined #openstack-infra | 21:13 | |
clarkb | oh sorry I connected to an old screen of mine (for zanata dev server) will hop on root one now | 21:13 |
pabelanger | clarkb: ianw: fungi: are we restarting zuul today? | 21:14 |
ianw | pabelanger: rename | 21:14 |
fungi | you have a checkout of 365067 to use? | 21:14 |
clarkb | pabelanger: yes its already stopped | 21:14 |
ianw | not yet | 21:14 |
clarkb | pabelanger: its part of our project rename steps | 21:14 |
pabelanger | right, thanks | 21:14 |
*** Apoorva has joined #openstack-infra | 21:14 | |
pabelanger | just confirming, as it might fix our allocation calculations (if we think that was the issue yesterday) | 21:15 |
clarkb | ianw: fungi why did that have to merge? | 21:15 |
*** esikachev has quit IRC | 21:15 | |
fungi | ianw: git fetch https://git.openstack.org/openstack-infra/project-config refs/changes/32/381332/9 && git checkout FETCH_HEAD | 21:15 |
fungi | clarkb: i don't think it did have to merge | 21:15 |
ianw | i think cause i pulled | 21:16 |
clarkb | ah yes I never pull and keep master pristine | 21:16 |
fungi | meh, as long as that one file is corrected i don't think we care about the rest of the repo state anyway | 21:16 |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: [WIP] Re-enable test: test_image_upload_fail https://review.openstack.org/400970 | 21:16 |
clarkb | fungi: ianw also after running ansible zaro's comments on https://review.openstack.org/#/c/365067/1/doc/source/gerrit.rst tell us how to do the indexing | 21:16 |
fungi | right | 21:17 |
ianw | ok ... should we try it? | 21:17 |
*** jgriffith has quit IRC | 21:17 | |
fungi | skimming it one last time | 21:18 |
fungi | we pulled out the line to start the offline index so i'm good with it | 21:18 |
clarkb | the pause has me skeptical | 21:19 |
fungi | anything else we can work around if something goes sideways | 21:19 |
clarkb | not sure if that is valid yaml actually | 21:19 |
clarkb | yay ansible | 21:19 |
clarkb | I can test that really quickly if we want | 21:19 |
clarkb | or if it fails then we deal with it then | 21:19 |
ianw | ERROR! 'prompt' is not a valid attribute for a Task | 21:20 |
*** jgriffith has joined #openstack-infra | 21:20 | |
clarkb | ya dangit ansible | 21:21 |
clarkb | ianw: change it to pause: prompt="string here" | 21:21 |
*** srobert has joined #openstack-infra | 21:22 | |
fungi | ahh, yeah the problem was the prompt was added in a list rather than as a straight dict key | 21:22 |
EmilienM | gerrit 503 | 21:22 |
fungi | EmilienM: see /topic | 21:22 |
EmilienM | fungi: oops my bad | 21:23 |
*** rbuzatu has joined #openstack-infra | 21:23 | |
jhesketh | Morning | 21:23 |
clarkb | ianw: fungi for this step I think you can just do ssh -p29418 review.o.o gerrit ls-projects locally | 21:23 |
*** jpich has quit IRC | 21:23 | |
clarkb | and once that works do ^ | 21:23 |
clarkb | er do the thing in screen | 21:24 |
fungi | agreed | 21:24 |
*** oanson has quit IRC | 21:24 | |
fungi | looks like it's there now | 21:25 |
clarkb | ya working for me | 21:25 |
ianw | yep, me too, let's go on | 21:25 |
fungi | `ossh -p 29418 review gerrit ls-projects|grep /valence$` | 21:25 |
fungi | no errors! | 21:26 |
clarkb | ianw: fungi did you use enter or ^C c? | 21:26 |
ianw | enter | 21:26 |
clarkb | cool | 21:26 |
* fungi used nothing, merely spectator | 21:26 | |
clarkb | docs weren't super clear on which should work or if both | 21:26 |
ianw | huh, well that was easy | 21:26 |
clarkb | indeed. now we do the indexing | 21:26 |
fungi | `ossh -p 29418 review gerrit ls-groups|grep valence` | 21:27 |
fungi | shows what we want | 21:27 |
ianw | [DEPRECATION WARNING]: Using bare variables is deprecated. Update your playbooks so that the environment value uses the full variable syntax ('{{repos}}'). | 21:27 |
fungi | so it definitely did proceed | 21:27 |
clarkb | fungi: what about storyboard? | 21:27 |
ianw | might be good to do that in the change for consistency | 21:27 |
clarkb | ansible claims that didn't change anything guessing tehy never used storyboard so its fine | 21:27 |
fungi | clarkb: can skip sb since this is not an sb-using project | 21:27 |
clarkb | fungi: gotcha | 21:27 |
clarkb | ianw: ++ | 21:27 |
clarkb | I can work on a new patchset for thatn ow | 21:28 |
fungi | should be able to start zuul and start online reindex now, presumably | 21:28 |
clarkb | if you all want to handle the reindexing | 21:28 |
clarkb | oh ya zuul I can start zuul first | 21:28 |
clarkb | ready to start zuul when you are | 21:28 |
ianw | approve 381332? | 21:28 |
clarkb | ianw: need zuul up first | 21:28 |
ianw | fungi: is online reindex in the doc? | 21:29 |
clarkb | also need to reorder apporving and merging the rename change to happen before we reenable puppet cron | 21:29 |
*** dizquierdo has quit IRC | 21:29 | |
*** jgriffith has quit IRC | 21:29 | |
clarkb | ianw: its zaro's commetn on https://review.openstack.org/#/c/365067/1/doc/source/gerrit.rst | 21:29 |
fungi | i'm working on reindexing now unless someone else already has it | 21:29 |
clarkb | I haven't | 21:29 |
clarkb | fungi: ianw should I start zuul now? | 21:29 |
fungi | go for it | 21:29 |
ianw | yep | 21:30 |
fungi | running account reindex first this time around | 21:30 |
ianw | so anyone can do that? or you ahve to be an admin? | 21:30 |
clarkb | ianw: I think you must be admin | 21:30 |
fungi | anyone in the administrators group | 21:31 |
fungi | which you should be in | 21:31 |
*** jascott1 has quit IRC | 21:31 | |
clarkb | zuul looks "stuck" | 21:31 |
clarkb | its not logging anything and the first gate change to be enqueued is blocking | 21:32 |
*** jascott1 has joined #openstack-infra | 21:32 | |
clarkb | oh there it goes | 21:32 |
clarkb | hrm looks like it may have blocked on connecting to gearman? | 21:32 |
ianw | yeah, last time i started it, it was very quiet on startup too | 21:32 |
clarkb | once that happened everything scrolled by | 21:32 |
ianw | but then got going | 21:32 |
clarkb | enqueue still blocking though | 21:33 |
clarkb | ah there it goes | 21:33 |
clarkb | jeblair: ^ any idea what is going on there? | 21:33 |
ianw | i don't think it logs a "i'm starting now message", which maybe it should | 21:33 |
fungi | zaro: i did `gerrit index start --force accounts` and it's queued a reindex of changes, so presumably the last argument is just arbitrary? | 21:33 |
clarkb | jeblair: zuul debug logs from 21:10-21:33 roughly show the sequence | 21:33 |
*** jascott1 has quit IRC | 21:34 | |
*** jascott1 has joined #openstack-infra | 21:34 | |
*** inc0 has quit IRC | 21:34 | |
*** Jeffrey4l has quit IRC | 21:34 | |
clarkb | zuul is done | 21:35 |
clarkb | remember don't reenable puppet until after the rename change ahs merged | 21:35 |
*** Jeffrey4l has joined #openstack-infra | 21:35 | |
clarkb | I will change that ordering in the next patchset too | 21:35 |
fungi | gate changes are getting nodes assigned, so nodepool seems to be happy | 21:35 |
fungi | oh, though maybe nodepool itself will get confused because gearman went away for a while? | 21:35 |
fungi | seems like in the recent past we've had to restart nodepoold after any zuul scheduler restart | 21:36 |
fungi | anyway, gerrit and zuul are running, so probably safe to end the status alert? | 21:36 |
fungi | we can work through the rest of this transparent to the users | 21:37 |
ianw | seems ok to me | 21:37 |
fungi | change reindexing is down to <700 repos already | 21:37 |
jeblair | oh hi | 21:37 |
clarkb | fungi: I think it may leak some nodes | 21:37 |
clarkb | fungi: but they should eventually get cleaned up | 21:38 |
fungi | clarkb: ianw: objections to ending the status alert now? | 21:38 |
clarkb | fungi: not really, we need to github too | 21:38 |
ianw | nope | 21:38 |
fungi | yeah, we still have steps to do, but users can go back to using gerrit again | 21:38 |
fungi | #status ok | 21:38 |
openstackstatus | fungi: sending ok | 21:38 |
*** jascott1 has quit IRC | 21:38 | |
ianw | not sure who is scrolling but there's a screenlog.0 as well taht should have the ansible run | 21:39 |
fungi | i'll rename the repo on github unless someone else is already doing that | 21:39 |
clarkb | ianw: that was me, reviewing it as I update the playbook :) | 21:39 |
clarkb | ianw: all done now though | 21:39 |
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 21:40 | |
jeblair | clarkb: probably gearman server swamped with job registrations | 21:40 |
*** jkilpatr has quit IRC | 21:40 | |
clarkb | jeblair: ah | 21:40 |
fungi | https://github.com/openstack/valence is done now | 21:40 |
*** fernnest has joined #openstack-infra | 21:41 | |
fungi | i guess i'll go ahead and approve 381332 | 21:41 |
openstackstatus | fungi: finished sending ok | 21:41 |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Update project rename instructions https://review.openstack.org/365067 | 21:42 |
*** sdake_ has quit IRC | 21:42 | |
clarkb | that should be a more complete playbook now. Also has todos for the reindexing | 21:42 |
*** jascott1 has joined #openstack-infra | 21:42 | |
fungi | thanks! | 21:42 |
clarkb | fungi: do the reindex commands not block? | 21:42 |
clarkb | fungi: and we want them to run in sequence only after the previous has completed? | 21:42 |
*** rlandy is now known as rlandy|brb | 21:43 | |
fungi | clarkb: yes and no. the reindex command returns after queuing all the reindex tasks, but gerrit maintains a lock around it so you can't run it again until it finishes | 21:43 |
fungi | however see my comment to zaro a few minutes ago about index start --force accounts queuing tasks to index changes | 21:43 |
fungi | i have a feeling something still not quite 100% on our syntax there | 21:44 |
clarkb | fungi: I guess I don't parse that | 21:44 |
*** jgriffith has joined #openstack-infra | 21:44 | |
clarkb | you told gerrit to index account but it indexed changes? | 21:44 |
ianw | just running kids to school ... back in a few | 21:44 |
openstackgerrit | Neil Jerram proposed openstack-infra/project-config: Run {pipeline}-tempest-dsvm-networking-calico on Xenial https://review.openstack.org/400975 | 21:44 |
*** e0ne has quit IRC | 21:45 | |
*** tpsilva has quit IRC | 21:45 | |
clarkb | fungi: thinking about how to ansiblize this. The first command is easy | 21:45 |
clarkb | but wondering what the requirements are for running the second one and if we need to do logic things there | 21:45 |
fungi | clarkb: i don't exactly know what i told gerrit to do. from zaro's instructions i assumed i was telling it to index accounts and then to index changes (i wanted to do them in that order because accounts should finish faster) but it seems to have decided to reindex everything when i asked it to reindex accounts, so whatever | 21:45 |
clarkb | gotcha | 21:46 |
clarkb | so more testing needed | 21:46 |
clarkb | fungi: ianw if there is no objection I am going to boot a new translate-dev01 now | 21:47 |
openstackgerrit | Merged openstack-infra/project-config: Rename rsc to valence https://review.openstack.org/381332 | 21:47 |
fungi | clarkb: looking at `gerrit index start --help` it appears it expected `index start accounts --force` so likely took omission of the index name as a signal to index everything | 21:47 |
clarkb | (I don't want to juggle two things if you think we are not done with rename) | 21:47 |
clarkb | fungi: can we do the easy mode and just tell it to reindex everything instead? | 21:48 |
fungi | though the --help output doesn't indicate that the index name is optional | 21:48 |
*** hashar has quit IRC | 21:49 | |
fungi | clarkb: apparently we can, though the api help doesn't match the observed behavior | 21:49 |
*** rbuzatu_ has joined #openstack-infra | 21:49 | |
fungi | so this is worth getting zaro to confirm later | 21:49 |
*** gouthamr has quit IRC | 21:49 | |
*** baoli has joined #openstack-infra | 21:50 | |
fungi | looking at http://docs-draft.openstack.org/67/365067/3/check/gate-system-config-docs-ubuntu-xenial/19b394e/doc/build/html/gerrit.html#renaming-a-project we're done up through #8 now. any objections to me reenabling the ansible run_all cron on puppetmaster.o.o now? | 21:50 |
fungi | almost down to 250 repos still pending reindex | 21:51 |
clarkb | hrm puppet is still running on translate-dev.openstack.org even though I thought I had disabled it | 21:51 |
clarkb | mordred: ^ can you tell me what I did wrong there? | 21:51 |
mordred | clarkb: did you put translate-dev.o.o in emergency? | 21:52 |
*** jkilpatr has joined #openstack-infra | 21:52 | |
clarkb | mordred: I put its uuid in emergency | 21:52 |
*** rbuzatu has quit IRC | 21:53 | |
clarkb | workign to double check the uuid now | 21:53 |
mordred | clarkb: I believe that's only a thing if there are more than one of them - although you now make me realize we could do that better | 21:53 |
*** rbuzatu_ has quit IRC | 21:53 | |
mordred | clarkb: yah - there is no host named afd4a8d9-98a7-4a21-a827-33106abeeb8a in the inventory | 21:54 |
*** kgiusti has quit IRC | 21:54 | |
fungi | yeah, being able to put the uuid in the emergency list before booting a replacement would have been nice | 21:54 |
clarkb | ok so I have to use the proper name here | 21:54 |
mordred | clarkb: there is a host named instance-afd4a8d9-98a7-4a21-a827-33106abeeb8a - but the hostname to put in the emergency file in this case is translate-dev.openstack.org | 21:54 |
*** ssbarnea has quit IRC | 21:54 | |
mordred | looking in /var/cache/ansible-inventory/ansible-inventory.cache to see what's defined is what I just did | 21:54 |
fungi | clarkb: though worth noting, since you've decided it was worth replacing it with a differently-named host anyway, you no longer need to use the uuid | 21:54 |
fungi | you can just disable it by name instead | 21:55 |
clarkb | fungi: yup | 21:55 |
fungi | okay, i'm going to go ahead and reenable ansible/puppet cron before the 22:00 pulse starts | 21:56 |
*** matrohon has quit IRC | 21:56 | |
clarkb | kk | 21:57 |
clarkb | I have updated the mergency file to use translate-dev.openstack.org and have stopped services again (puppet restarted them) | 21:57 |
clarkb | going to boot translate-dev01.openstack.org now | 21:57 |
*** yolanda has joined #openstack-infra | 21:57 | |
fungi | i was worried it might | 21:57 |
clarkb | fungi: the problem with your mangle symlinks suggestion is that upstart doesn't have an easy way to do that iirc | 21:58 |
clarkb | since it doesn't honor runlevls properly | 21:58 |
fungi | right, and you can't just stick "exit 0" at the top of the unit file either | 21:58 |
clarkb | iirc the official way to do it is to add code to the upstart init scripts that say this one is disabled | 21:58 |
fungi | ansible has just now kicked off | 22:00 |
clarkb | derp that moment you realize you forgot to set the flavor to xenial because it used a trusty image | 22:00 |
clarkb | s/flavor/image | 22:00 |
*** wolverin_ has quit IRC | 22:01 | |
*** wolverineav has joined #openstack-infra | 22:01 | |
*** trown is now known as trown|outtypewww | 22:02 | |
*** jgriffith_ has joined #openstack-infra | 22:03 | |
*** inc0 has joined #openstack-infra | 22:03 | |
*** asettle has joined #openstack-infra | 22:03 | |
clarkb | mordred: any idea what is up with http://paste.openstack.org/show/590146/ ? | 22:03 |
*** wolverineav has quit IRC | 22:03 | |
*** wolverineav has joined #openstack-infra | 22:04 | |
clarkb | that seems to have resulted in not copying the group hieradata file that has the mysql info and made puppet fail | 22:04 |
mordred | clarkb: likely one of the entries in /etc/ansible/groups.txt not matching anyhting? | 22:05 |
*** wolverineav has quit IRC | 22:05 | |
mordred | clarkb: lemme run it real quick ... | 22:05 |
*** masuberu has joined #openstack-infra | 22:05 | |
clarkb | mordred: oh ya thats it, I forgot we have to double account this stuff | 22:05 |
clarkb | can we stop doing that? | 22:05 |
*** ssbarnea has joined #openstack-infra | 22:06 | |
mordred | clarkb: longer conversation. short version - I'd love to - longer version - we should talk about the mechanics | 22:06 |
*** jgriffith has quit IRC | 22:06 | |
clarkb | or maybe use symlinks and just fqdn everything | 22:07 |
mordred | let's work through it tomorrow when we can both think with full brains - I'm just about to AFK | 22:07 |
*** asettle has quit IRC | 22:08 | |
clarkb | ok | 22:08 |
*** masber has quit IRC | 22:08 | |
*** rlandy|brb is now known as rlandy | 22:08 | |
clarkb | mordred: can you review the fix patch I will be pushing in a sec? | 22:09 |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Do the other half of translate-dev grouping https://review.openstack.org/400982 | 22:10 |
clarkb | mordred: ^there | 22:10 |
clarkb | pabelanger: fungi once ^ is in I will give this another go | 22:12 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: Transition to quickstart: make toci_gate_test.sh a symlink to toci_gate_orig.sh. https://review.openstack.org/396451 | 22:12 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: DO NOT MERGE Transition to quickstart: simulate transition https://review.openstack.org/399257 | 22:12 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: Transition to quickstart: add toci_gate_oooq.sh and jobs configurations https://review.openstack.org/399256 | 22:12 |
clarkb | in the meantime I need to step away and pick up a turkey | 22:13 |
clarkb | will be back around in an hour or so to hopefully actually boot this instance | 22:13 |
*** jgriffith_ is now known as jgriffith | 22:13 | |
*** ssbarnea has quit IRC | 22:14 | |
pabelanger | gobble gobble | 22:14 |
*** ssbarnea has joined #openstack-infra | 22:14 | |
*** ssbarnea has quit IRC | 22:14 | |
*** tiswanso has quit IRC | 22:14 | |
openstackgerrit | Adam Gandelman proposed openstack-infra/zuul: Re-enable test_success_pattern as test_success_url https://review.openstack.org/400455 | 22:14 |
*** ssbarnea has joined #openstack-infra | 22:15 | |
*** nicolasbock has quit IRC | 22:18 | |
*** nadya has quit IRC | 22:19 | |
*** matt-borland has quit IRC | 22:21 | |
openstackgerrit | Adam Gandelman proposed openstack-infra/zuul: Re-enable test_success_pattern as test_success_url https://review.openstack.org/400455 | 22:22 |
openstackgerrit | Merged openstack-infra/project-config: fix regex issue for job https://review.openstack.org/400784 | 22:23 |
*** sdake has joined #openstack-infra | 22:23 | |
*** sree has joined #openstack-infra | 22:23 | |
openstackgerrit | Adam Gandelman proposed openstack-infra/zuul: Re-enable test_success_pattern as test_success_url https://review.openstack.org/400455 | 22:23 |
openstackgerrit | Paul Belanger proposed openstack-infra/puppet-openstackci: Use nodepool::builder for nodepool https://review.openstack.org/356503 | 22:27 |
*** pradk has quit IRC | 22:28 | |
*** sree has quit IRC | 22:28 | |
*** Apoorva has quit IRC | 22:28 | |
*** Apoorva has joined #openstack-infra | 22:28 | |
*** Apoorva_ has joined #openstack-infra | 22:29 | |
*** john-davidge has joined #openstack-infra | 22:31 | |
*** Apoorva has quit IRC | 22:33 | |
*** Apoorva has joined #openstack-infra | 22:35 | |
*** srobert has quit IRC | 22:35 | |
*** Apoorva has quit IRC | 22:36 | |
*** Apoorva__ has joined #openstack-infra | 22:36 | |
*** Apoorva__ has quit IRC | 22:37 | |
*** Apoorva_ has quit IRC | 22:37 | |
*** Apoorva has joined #openstack-infra | 22:37 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: DO NOT MERGE Transition to quickstart: simulate transition https://review.openstack.org/399257 | 22:38 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: Transition to quickstart: add toci_gate_oooq.sh and jobs configurations https://review.openstack.org/399256 | 22:38 |
*** Apoorva has quit IRC | 22:39 | |
*** Apoorva has joined #openstack-infra | 22:40 | |
*** ssbarnea has quit IRC | 22:40 | |
*** Apoorva has quit IRC | 22:42 | |
*** Apoorva_ has joined #openstack-infra | 22:42 | |
*** john-davidge has quit IRC | 22:43 | |
inc0 | hey, fungi mordred say, I'll give you shellscript that will install and start docker registry, it's really simple | 22:43 |
inc0 | can you help me with puppetry please? | 22:43 |
*** Apoorva has joined #openstack-infra | 22:44 | |
inc0 | or I can prep ansible if it's easier | 22:44 |
inc0 | for you | 22:44 |
*** Apoorva__ has joined #openstack-infra | 22:45 | |
*** sdake has quit IRC | 22:46 | |
*** sdake has joined #openstack-infra | 22:46 | |
*** Apoorva_ has quit IRC | 22:47 | |
openstackgerrit | Paul Belanger proposed openstack-infra/puppet-openstackci: Use nodepool::builder for nodepool https://review.openstack.org/356503 | 22:48 |
*** Apoorva has quit IRC | 22:49 | |
*** Apoorva__ has quit IRC | 22:49 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: DO NOT MERGE Transition to quickstart: simulate transition https://review.openstack.org/399257 | 22:49 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: Transition to quickstart: add toci_gate_oooq.sh and jobs configurations https://review.openstack.org/399256 | 22:49 |
*** chlong has quit IRC | 22:52 | |
jeblair | pabelanger: i was thinking -- do we really need a common file at this point? can we do 'nodepool' (with the builder disabled) on the nodepool host, and then 'nodepool' and 'nodepool_builder' on the builder host? | 22:53 |
jeblair | pabelanger: (then, when we make the zk launchers, we can do a nodepool_launcher class, and what we have left in the nodepool class will be the common stuff at that point) | 22:54 |
*** bknudson has left #openstack-infra | 22:55 | |
*** yolanda has quit IRC | 22:58 | |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-openstackci: Use nodepool::builder for nodepool https://review.openstack.org/400993 | 23:00 |
jeblair | pabelanger: consider that as an alternative to 356503 | 23:00 |
*** xyang1 has quit IRC | 23:00 | |
*** jklare has quit IRC | 23:01 | |
*** mriedem has quit IRC | 23:02 | |
*** jklare has joined #openstack-infra | 23:03 | |
*** panda is now known as panda|Zz | 23:03 | |
*** rbuzatu has joined #openstack-infra | 23:05 | |
*** boden has quit IRC | 23:06 | |
*** mmandel has quit IRC | 23:07 | |
fungi | inc0: i forget who was looking into it, but docker-registry is already packaged in ubuntu. don't need a container at all | 23:07 |
inc0 | yeah | 23:08 |
inc0 | it's literally apt-get install -> config file we prepare -> htpasswd file we prepare -> service docker-registry start | 23:08 |
inc0 | that will give us all - auth, mirroring | 23:08 |
inc0 | super easy | 23:08 |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-openstackci: Add a nodepool_builder manifest https://review.openstack.org/400998 | 23:09 |
jeblair | pabelanger: ^ | 23:09 |
inc0 | just, my puppetry had seen better days | 23:09 |
inc0 | so mirroring should be as simple as rsync of directories | 23:09 |
*** rbuzatu has quit IRC | 23:09 | |
inc0 | or afs mirroring | 23:09 |
inc0 | or nfs | 23:10 |
inc0 | or swift;) | 23:10 |
inc0 | fungi, we were looking at apache auth, but that's not even required | 23:11 |
*** rbuzatu has joined #openstack-infra | 23:11 | |
openstackgerrit | Merged openstack-infra/shade: Added documentation for delete_image() https://review.openstack.org/400519 | 23:12 |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add nodepool builder nodes https://review.openstack.org/400999 | 23:12 |
*** knangia has quit IRC | 23:13 | |
*** baoli has quit IRC | 23:18 | |
openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add docker server https://review.openstack.org/401003 | 23:18 |
jeblair | inc0: ^ can you take that and modify it? | 23:19 |
openstackgerrit | Merged openstack-infra/system-config: Do the other half of translate-dev grouping https://review.openstack.org/400982 | 23:19 |
inc0 | jeblair, sure, I don't really need docker itself, but will take a look | 23:20 |
jeblair | inc0: yes, i used the wrong docker words. :) | 23:20 |
jeblair | inc0: but that's a puppet skeleton for "install something along with a config file" | 23:20 |
inc0 | no problem:) how do I run it locally so I can test if it works? | 23:21 |
jeblair | inc0: there are some instructions here: http://docs.openstack.org/infra/system-config/sysadmin.html#making-a-change-in-puppet | 23:21 |
inc0 | thanks, I'll play around | 23:21 |
inc0 | << spraying "Make Ansible Great Again" on sign and going out to protest >> | 23:22 |
*** jamielennox is now known as jamielennox|away | 23:24 | |
*** jamielennox|away is now known as jamielennox | 23:24 | |
*** wolverineav has joined #openstack-infra | 23:24 | |
jeblair | inc0: i think some of us would rather run ansible at this point, but we could use some help migrating our puppet; until we know we can actually accomplish that, we don't want to run 2 systems. | 23:26 |
* clarkb is back now, just waiting on puppet to update puppetmaster to include newer groups.txt | 23:26 | |
*** wolverineav has quit IRC | 23:26 | |
inc0 | jeblair, understandable | 23:26 |
*** asettle has joined #openstack-infra | 23:27 | |
inc0 | ansible -m shell -a "puppet apply ..." for now?;) | 23:27 |
*** gordc has quit IRC | 23:27 | |
* inc0 bursts into evil laugh | 23:27 | |
inc0 | laughter, laught...english is hard | 23:27 |
clarkb | inc0: its actually ansible -m puppet "things" | 23:27 |
clarkb | er -a "things" | 23:27 |
inc0 | there is ansible module for puppet? | 23:28 |
clarkb | yes | 23:28 |
inc0 | ok, I'm not nearly as evil as I thought | 23:28 |
*** rbrndt has quit IRC | 23:28 | |
*** asettle has quit IRC | 23:30 | |
*** asettle has joined #openstack-infra | 23:31 | |
jeblair | we wrote it | 23:31 |
jeblair | and it's how we run puppet | 23:31 |
jeblair | inc0: you are in the company of great evil | 23:32 |
*** pradk has joined #openstack-infra | 23:33 | |
inc0 | duh...and still you're not allowing me to write ansible | 23:34 |
inc0 | yes, evil indeed | 23:34 |
clarkb | jeblair: the more I use ansible the more I am scared things like service management and package management will just annoy the crap out of us. Which is sad beacuse those are some of the most basic things you want it to do. (most recently with the zuul launcher restarts ansible claimed they were all restarted but about half of them didn't actually start) | 23:34 |
fungi | for great justice^H^H^H^H^H^H^Hevil! | 23:34 |
clarkb | of course we could just attempt to fix those bugs, then you go read the service module in ansible and run away crying (yes I have done this) | 23:34 |
inc0 | well ansible won't check status of stuff | 23:34 |
inc0 | it's glorified shellscript | 23:34 |
fungi | yeah, ansible seems like a great way to deploy stuff, and a less terrific way to do configuration management | 23:35 |
clarkb | inc0: the service module is supposed to though | 23:35 |
clarkb | inc0: and fail if it doesn't | 23:35 |
clarkb | but its a giant mess of spaghetti so good luck understanding why it doesn't in some cases | 23:35 |
jeblair | clarkb: yes. to be fair, we've had our problems with puppet services. | 23:35 |
clarkb | jeblair: indeed | 23:35 |
clarkb | jeblair: the wrost part is a lot of the problems overlap too :( | 23:35 |
*** asettle has quit IRC | 23:35 | |
jeblair | :( | 23:35 |
clarkb | (puppet too suffers from cranky service management at times) | 23:36 |
clarkb | they both suffer different pacakge management grumps too | 23:37 |
clarkb | and in some cases the asme grumps | 23:37 |
clarkb | eg why isn't bindep a thing built into config management yet? | 23:37 |
clarkb | (translate-dev01 is building again nwo) | 23:37 |
*** watanabe_isao has joined #openstack-infra | 23:38 | |
clarkb | mordred: I still get that error I pasted, but this time it copied the group hiera file too | 23:39 |
*** asettle has joined #openstack-infra | 23:39 | |
clarkb | and puppet is runnign so I don't think that issue is fatal | 23:39 |
*** baoli has joined #openstack-infra | 23:40 | |
*** baoli has quit IRC | 23:40 | |
*** dingyichen has joined #openstack-infra | 23:40 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/devstack-gate: Find and delete broken symlinks in logs https://review.openstack.org/400742 | 23:41 |
openstackgerrit | Michal Jastrzebski (inc0) proposed openstack-infra/system-config: Add docker server https://review.openstack.org/401003 | 23:41 |
inc0 | jeblair, ^ | 23:41 |
inc0 | I believe we should add ensure service docker-registry started | 23:42 |
inc0 | and that's about it | 23:42 |
*** asettle has quit IRC | 23:42 | |
fungi | gerrit online reindexing completed already. that was far faster than anticipated | 23:42 |
inc0 | and maybe move contents of users file to hiera | 23:42 |
fungi | as long as it's safe for puppet to automatically start the docker registry service if it crashes for some reason, i guess that's fine. in general i'm not thrilled about mechanisms that helpfully restart failing services for you | 23:44 |
clarkb | http://paste.openstack.org/show/590149/ looks like we need more systemdification on the wildfly install | 23:44 |
inc0 | fungi, well it has to be restarted after config files lands | 23:44 |
fungi | inc0: sure, and for that the service resource in puppet can either be subscribed to the conffile, or the file resource can be set to notify the service | 23:45 |
*** watanabe_isao has quit IRC | 23:45 | |
fungi | at least that's how we usually have it working | 23:45 |
*** wolverineav has joined #openstack-infra | 23:45 | |
inc0 | fungi, well, you know better;) but docker registry is really simple service to run as it turns out | 23:46 |
clarkb | looks like we will need a patch at https://github.com/biemond/biemond-wildfly/blob/master/manifests/service.pp#L35-L46 will respond to the i18n team to see if they are able to take that on | 23:47 |
clarkb | pleia2: ^ have you patched that in the past? | 23:47 |
pleia2 | clarkb: nope | 23:48 |
*** gildub has joined #openstack-infra | 23:49 | |
fungi | inc0: sure, but ensure=>started won't actually take care of restarting after config updates. you need a subscribe or notify relationship to handle that regardless | 23:49 |
fungi | which was my point | 23:49 |
inc0 | understood | 23:49 |
*** wolverineav has quit IRC | 23:49 | |
*** dingyichen has quit IRC | 23:50 | |
*** dchen has joined #openstack-infra | 23:50 | |
*** dingyichen has joined #openstack-infra | 23:51 | |
*** hongbin has quit IRC | 23:51 | |
zaro | fungi: i remember we ran into the same thing on last rename. we ran force reindex on accounts but it ran for both accounts and changes. | 23:53 |
openstackgerrit | Merged openstack-infra/system-config: Update project rename instructions https://review.openstack.org/365067 | 23:53 |
zaro | fungi, clarkb which i think is a bug but probably fixed in newer version of gerrit | 23:54 |
fungi | zaro: the output of `gerrit index start --help` suggests that it's very picky about putting "accounts" or "changes" _before_ "--force" for some reason | 23:54 |
fungi | so it could just be we have the argument order incorrect | 23:54 |
zaro | hmm, interesting. i'll have to check that | 23:54 |
fungi | i didn't retry it with the order indicated by its context help because by the time i saw that it was already running anyway | 23:55 |
*** hurgleburgler has quit IRC | 23:56 | |
clarkb | pleia2: pabelanger fungi ok update sent to list and ian and aeng directly | 23:56 |
clarkb | I doubt I am going to be able to update upstream this week, may have time next week. I have a bunch of stuff to do tomorrow in prep for thursday | 23:57 |
clarkb | mordred: I put a few more things on https://etherpad.openstack.org/p/openstack-user-api-improvements for identity and horizon | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!