| *** sdake has joined #openstack-infra | 00:00 | |
| ianw | EmilienM: mind trying again to confirm? | 00:00 |
|---|---|---|
| *** sdake_ has quit IRC | 00:00 | |
| EmilienM | ianw: it works fine for me | 00:04 |
| EmilienM | thanks! | 00:04 |
| *** pcrews has quit IRC | 00:06 | |
| *** wolverineav has joined #openstack-infra | 00:11 | |
| *** sdake has quit IRC | 00:13 | |
| *** dingyichen has joined #openstack-infra | 00:13 | |
| *** wolverineav has quit IRC | 00:15 | |
| *** salv-orl_ has joined #openstack-infra | 00:17 | |
| *** gongysh has joined #openstack-infra | 00:18 | |
| *** flepied has quit IRC | 00:18 | |
| *** salv-orlando has quit IRC | 00:20 | |
| *** sflanigan has joined #openstack-infra | 00:20 | |
| *** sflanigan has joined #openstack-infra | 00:20 | |
| *** dimtruck is now known as zz_dimtruck | 00:20 | |
| *** zz_dimtruck is now known as dimtruck | 00:20 | |
| *** yuvalb has quit IRC | 00:21 | |
| *** oanson has quit IRC | 00:21 | |
| *** lihi has quit IRC | 00:22 | |
| *** jamesdenton has joined #openstack-infra | 00:22 | |
| *** wolverineav has joined #openstack-infra | 00:27 | |
| openstackgerrit | Lubosz Kosnik (diltram) proposed openstack-infra/project-config master: Octavia / Barbican cross project testing https://review.openstack.org/436997 | 00:27 |
| *** dimtruck is now known as zz_dimtruck | 00:30 | |
| *** oanson has joined #openstack-infra | 00:30 | |
| *** yuvalb has joined #openstack-infra | 00:30 | |
| *** lihi has joined #openstack-infra | 00:31 | |
| *** wolverineav has quit IRC | 00:31 | |
| *** wolverineav has joined #openstack-infra | 00:33 | |
| *** aeng has quit IRC | 00:33 | |
| *** flepied has joined #openstack-infra | 00:36 | |
| *** wolverineav has quit IRC | 00:37 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: KEEP_LOCALRC for barbican-tempest-plugin https://review.openstack.org/437995 | 00:39 |
| *** jamesdenton has quit IRC | 00:40 | |
| *** gongysh has quit IRC | 00:40 | |
| *** gongysh has joined #openstack-infra | 00:41 | |
| *** yujunz has joined #openstack-infra | 00:41 | |
| *** aeng has joined #openstack-infra | 00:48 | |
| tonyb | AJaeger: Sorry I though I had answered that | 00:50 |
| openstackgerrit | Merged openstack-infra/project-config master: KEEP_LOCALRC for barbican-tempest-plugin https://review.openstack.org/437995 | 00:53 |
| *** wolverineav has joined #openstack-infra | 00:53 | |
| *** wolverineav has quit IRC | 00:58 | |
| *** flepied has quit IRC | 01:01 | |
| *** wolverineav has joined #openstack-infra | 01:11 | |
| *** Jeffrey4l has joined #openstack-infra | 01:14 | |
| *** wolverineav has quit IRC | 01:15 | |
| Jeffrey4l | infra-root, please review this https://review.openstack.org/434946 | 01:15 |
| *** pcrews has joined #openstack-infra | 01:17 | |
| *** esikachev has quit IRC | 01:17 | |
| *** zz_dimtruck is now known as dimtruck | 01:18 | |
| *** gongysh has quit IRC | 01:30 | |
| *** liujiong has joined #openstack-infra | 01:32 | |
| *** yanyanhu has joined #openstack-infra | 01:35 | |
| openstackgerrit | Merged openstack/os-client-config master: Add support for indicating required floating IPs https://review.openstack.org/430967 | 01:36 |
| *** wolverineav has joined #openstack-infra | 01:36 | |
| *** aeng has quit IRC | 01:37 | |
| *** sdague has joined #openstack-infra | 01:42 | |
| *** mriedem has quit IRC | 01:42 | |
| *** gildub has quit IRC | 01:42 | |
| *** wolverineav has quit IRC | 01:42 | |
| *** wolverineav has joined #openstack-infra | 01:48 | |
| *** aeng has joined #openstack-infra | 01:50 | |
| *** wolverineav has quit IRC | 01:52 | |
| *** dave-mccowan has joined #openstack-infra | 01:53 | |
| *** gongysh has joined #openstack-infra | 01:59 | |
| *** esikachev has joined #openstack-infra | 02:00 | |
| *** sdague has quit IRC | 02:01 | |
| *** esikachev has quit IRC | 02:08 | |
| *** manjeets has joined #openstack-infra | 02:08 | |
| *** thorst has quit IRC | 02:10 | |
| *** larainema has joined #openstack-infra | 02:11 | |
| *** dimtruck is now known as zz_dimtruck | 02:14 | |
| *** gouthamr has quit IRC | 02:20 | |
| *** skelso has joined #openstack-infra | 02:20 | |
| *** sekelso has joined #openstack-infra | 02:23 | |
| *** skelso has quit IRC | 02:26 | |
| *** wolverineav has joined #openstack-infra | 02:34 | |
| *** wolverineav has quit IRC | 02:39 | |
| *** yamamoto_ has joined #openstack-infra | 02:39 | |
| openstackgerrit | Merged openstack/os-client-config master: Add helper scripts to print version discovery info https://review.openstack.org/431720 | 02:41 |
| *** thorst has joined #openstack-infra | 02:46 | |
| *** thorst has quit IRC | 02:55 | |
| *** winggundamth has joined #openstack-infra | 02:55 | |
| *** thorst has joined #openstack-infra | 02:55 | |
| *** thorst has quit IRC | 03:00 | |
| *** sdake has joined #openstack-infra | 03:01 | |
| *** vikrant has joined #openstack-infra | 03:09 | |
| *** wolverineav has joined #openstack-infra | 03:12 | |
| *** skelso has joined #openstack-infra | 03:14 | |
| *** sekelso has quit IRC | 03:14 | |
| *** wolverineav has quit IRC | 03:18 | |
| *** iOx has quit IRC | 03:22 | |
| *** thorst has joined #openstack-infra | 03:27 | |
| *** thorst has quit IRC | 03:28 | |
| *** wolverineav has joined #openstack-infra | 03:29 | |
| *** sdake_ has joined #openstack-infra | 03:30 | |
| *** sdake has quit IRC | 03:34 | |
| *** wolverineav has quit IRC | 03:36 | |
| *** pgadiya has joined #openstack-infra | 03:36 | |
| *** askb has quit IRC | 03:40 | |
| *** cshastri has joined #openstack-infra | 03:40 | |
| *** askb has joined #openstack-infra | 03:41 | |
| *** dhinesh has quit IRC | 03:49 | |
| *** skelso has quit IRC | 03:51 | |
| *** dhinesh has joined #openstack-infra | 03:53 | |
| *** skelso has joined #openstack-infra | 03:53 | |
| *** skelso has quit IRC | 03:57 | |
| *** liujiong_66 has joined #openstack-infra | 03:58 | |
| *** liujiong has quit IRC | 03:58 | |
| *** yamamoto_ has quit IRC | 03:59 | |
| *** skelso has joined #openstack-infra | 03:59 | |
| *** hongbin has joined #openstack-infra | 04:01 | |
| *** psachin has joined #openstack-infra | 04:03 | |
| *** wolverineav has joined #openstack-infra | 04:06 | |
| *** wolverineav has quit IRC | 04:10 | |
| *** hongbin has quit IRC | 04:14 | |
| *** EricGonczer_ has quit IRC | 04:14 | |
| *** wolverineav has joined #openstack-infra | 04:15 | |
| *** wolverineav has quit IRC | 04:20 | |
| *** gildub has joined #openstack-infra | 04:22 | |
| *** yanyanhu has quit IRC | 04:26 | |
| *** thorst has joined #openstack-infra | 04:30 | |
| *** zz_dimtruck is now known as dimtruck | 04:31 | |
| *** thorst has quit IRC | 04:34 | |
| *** dave-mccowan has quit IRC | 04:36 | |
| *** liujiong_66 is now known as liujiong | 04:39 | |
| *** sdake_ has quit IRC | 04:42 | |
| *** esikachev has joined #openstack-infra | 04:49 | |
| *** yamamoto_ has joined #openstack-infra | 04:52 | |
| *** nadya has joined #openstack-infra | 04:52 | |
| *** skelso has quit IRC | 04:57 | |
| *** nadya has quit IRC | 04:58 | |
| *** esikachev has quit IRC | 04:59 | |
| *** esikachev has joined #openstack-infra | 04:59 | |
| *** nadya has joined #openstack-infra | 05:01 | |
| *** esikachev has quit IRC | 05:04 | |
| *** nadya has quit IRC | 05:06 | |
| *** wolverineav has joined #openstack-infra | 05:08 | |
| *** wolverineav has quit IRC | 05:13 | |
| *** nadya has joined #openstack-infra | 05:15 | |
| *** esikachev has joined #openstack-infra | 05:15 | |
| *** gildub has quit IRC | 05:19 | |
| *** nadya has quit IRC | 05:19 | |
| *** adriant has quit IRC | 05:26 | |
| *** dimtruck is now known as zz_dimtruck | 05:30 | |
| *** sandanar has joined #openstack-infra | 05:36 | |
| *** amotoki has quit IRC | 05:40 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/diskimage-builder master: Add qemu-guest-agent element https://review.openstack.org/438334 | 05:40 |
| *** amotoki has joined #openstack-infra | 05:51 | |
| *** gildub has joined #openstack-infra | 05:53 | |
| *** amotoki has quit IRC | 05:56 | |
| *** amotoki has joined #openstack-infra | 06:00 | |
| *** isaacb has joined #openstack-infra | 06:01 | |
| *** florianf has joined #openstack-infra | 06:14 | |
| *** eroux has quit IRC | 06:14 | |
| *** amotoki_ has joined #openstack-infra | 06:17 | |
| *** salv-orlando has joined #openstack-infra | 06:17 | |
| *** esikachev has quit IRC | 06:19 | |
| *** salv-orlando has quit IRC | 06:20 | |
| *** amotoki has quit IRC | 06:20 | |
| *** salv-orlando has joined #openstack-infra | 06:20 | |
| *** salv-orl_ has quit IRC | 06:21 | |
| *** nmathew has joined #openstack-infra | 06:21 | |
| *** amotoki has joined #openstack-infra | 06:25 | |
| *** amotoki_ has quit IRC | 06:27 | |
| *** dhinesh has quit IRC | 06:28 | |
| *** amotoki has quit IRC | 06:31 | |
| *** jtomasek_ has joined #openstack-infra | 06:37 | |
| *** amotoki has joined #openstack-infra | 06:44 | |
| kevinbenton | is there a way to do a Depends-On change to a patch to a library like os-vif? | 06:55 |
| kevinbenton | i.e. I want to test a change in neutron with a patch to os-vif | 06:55 |
| *** yanyanhu has joined #openstack-infra | 06:58 | |
| *** flepied has joined #openstack-infra | 06:59 | |
| *** esikachev has joined #openstack-infra | 07:01 | |
| *** liujiong has quit IRC | 07:01 | |
| *** liujiong_lj has joined #openstack-infra | 07:01 | |
| *** ramishra has joined #openstack-infra | 07:07 | |
| *** tuanluong has joined #openstack-infra | 07:08 | |
| *** fabo_ is now known as fabo | 07:13 | |
| openstackgerrit | Jeremy Zhang proposed openstack-infra/project-config master: Use local_conf for tempest tests on test_unmanage_manage_volume https://review.openstack.org/438347 | 07:13 |
| *** Daisy has joined #openstack-infra | 07:14 | |
| *** wolverineav has joined #openstack-infra | 07:15 | |
| *** Daisy has quit IRC | 07:15 | |
| *** camunoz has quit IRC | 07:17 | |
| *** gildub has quit IRC | 07:19 | |
| *** rcernin has joined #openstack-infra | 07:20 | |
| *** pcaruana has joined #openstack-infra | 07:20 | |
| *** rcernin has quit IRC | 07:23 | |
| *** rcernin has joined #openstack-infra | 07:23 | |
| *** wolverineav has quit IRC | 07:24 | |
| *** wolverineav has joined #openstack-infra | 07:26 | |
| *** bhavik1 has joined #openstack-infra | 07:27 | |
| openstackgerrit | Merged openstack-infra/project-config master: Bump the volume backing file size for functional tests https://review.openstack.org/436708 | 07:28 |
| openstackgerrit | Merged openstack-infra/project-config master: Add os-traits project https://review.openstack.org/437165 | 07:29 |
| AJaeger | kevinbenton: it really depends how neutron sets up os-vif. If you install from pypi, it will not help. If you install from source, it will work. You need to check this for each job... | 07:31 |
| *** Julien-zte has joined #openstack-infra | 07:32 | |
| *** wolverineav has quit IRC | 07:33 | |
| openstackgerrit | Yanyan Hu proposed openstack-infra/project-config master: Gate job for senlinclient functional test https://review.openstack.org/436338 | 07:36 |
| kevinbenton | AJaeger: ack. i figured it would probably need a special job | 07:37 |
| kevinbenton | AJaeger: IIRC it's just a pypi install | 07:37 |
| *** wolverineav has joined #openstack-infra | 07:37 | |
| *** jtomasek_ has quit IRC | 07:38 | |
| *** sdake has joined #openstack-infra | 07:38 | |
| *** jtomasek has joined #openstack-infra | 07:38 | |
| *** nadya has joined #openstack-infra | 07:38 | |
| *** nadya has quit IRC | 07:39 | |
| *** nadya_ has joined #openstack-infra | 07:39 | |
| *** sdake_ has joined #openstack-infra | 07:40 | |
| *** markus_z has joined #openstack-infra | 07:41 | |
| *** sdake has quit IRC | 07:44 | |
| *** saibarspeis has joined #openstack-infra | 07:45 | |
| yolanda | good morning | 07:46 |
| *** wolverineav has quit IRC | 07:48 | |
| *** liujiong_lj is now known as liujiong | 07:49 | |
| *** andreas_s has joined #openstack-infra | 07:53 | |
| openstackgerrit | Merged openstack-infra/project-config master: Enable barbican tempest plugin test for barbican project https://review.openstack.org/437675 | 07:55 |
| *** wolverineav has joined #openstack-infra | 07:56 | |
| AJaeger | kevinbenton: there are some cross python jobs that do something like this for oslo etc. have a look at them if this is really needed more often... | 07:57 |
| AJaeger | morning, yolanda ! | 07:57 |
| openstackgerrit | Merged openstack-infra/project-config master: Enable voting py35 on nova-mksproxy https://review.openstack.org/436969 | 07:57 |
| kevinbenton | AJaeger: nah, this is just a one-tiem thing | 07:57 |
| yolanda | hi AJaeger | 07:57 |
| AJaeger | kevinbenton: then test it manually ;) and use depends-on just for ordering | 07:57 |
| AJaeger | but you probably need a release before you can use it. | 07:57 |
| *** martinkopec has joined #openstack-infra | 07:58 | |
| kevinbenton | AJaeger: well the problem is that I can't reproduce a failure locally, and I'm suspect of some behavior in os-vif that isn't 100% correct | 07:58 |
| kevinbenton | AJaeger: so i was hoping to get a CI run with a test change to os-vif | 07:58 |
| *** matrohon has joined #openstack-infra | 07:59 | |
| *** esikachev has quit IRC | 08:00 | |
| AJaeger | kevinbenton: push the change up and change the requirements line to install from git? | 08:03 |
| *** wolverineav has quit IRC | 08:03 | |
| AJaeger | Won't allow you to merge due to requirements check but helps with testing | 08:04 |
| openstackgerrit | Merged openstack-infra/project-config master: Add barbican-tempest-plugin tests to Castellan https://review.openstack.org/438102 | 08:04 |
| kevinbenton | AJaeger: ah, that might work. It's actually nova that installs os-vif so i will need a test change to nova for the requirements thing, but then i can have the neutron depends-on for that | 08:04 |
| kevinbenton | AJaeger: thanks | 08:04 |
| AJaeger | kevinbenton: fun ;) | 08:04 |
| *** esikachev has joined #openstack-infra | 08:04 | |
| * AJaeger goes offline again for some shopping on a day off... | 08:05 | |
| *** ggnel_t has joined #openstack-infra | 08:08 | |
| *** esikachev has quit IRC | 08:09 | |
| *** pt_15 has joined #openstack-infra | 08:10 | |
| *** tojuvone has joined #openstack-infra | 08:11 | |
| *** yamahata has joined #openstack-infra | 08:11 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Support deploy args in OVB jobs https://review.openstack.org/437531 | 08:13 |
| *** Guest68960 has quit IRC | 08:14 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/438360 | 08:16 |
| *** shardy has joined #openstack-infra | 08:17 | |
| *** ccamacho has joined #openstack-infra | 08:18 | |
| *** dingyichen has quit IRC | 08:19 | |
| *** mgagne has joined #openstack-infra | 08:20 | |
| *** mgagne is now known as Guest11443 | 08:20 | |
| *** salv-orlando has quit IRC | 08:22 | |
| *** sdake has joined #openstack-infra | 08:25 | |
| *** sdake_ has quit IRC | 08:27 | |
| *** yujunz is now known as yujunz[away] | 08:27 | |
| *** e0ne has joined #openstack-infra | 08:30 | |
| *** flepied has quit IRC | 08:31 | |
| *** rraja has joined #openstack-infra | 08:31 | |
| *** yujunz[away] is now known as yujunz | 08:33 | |
| *** yujunz is now known as yujunz[away] | 08:34 | |
| *** yujunz[away] is now known as yujunz | 08:34 | |
| *** yujunz is now known as yujunz[away] | 08:34 | |
| *** yujunz[away] is now known as yujunz | 08:34 | |
| *** mixos has quit IRC | 08:36 | |
| *** gnuoy has quit IRC | 08:36 | |
| *** gnuoy has joined #openstack-infra | 08:36 | |
| *** amotoki_ has joined #openstack-infra | 08:37 | |
| *** amotoki has quit IRC | 08:37 | |
| *** gnuoy has left #openstack-infra | 08:38 | |
| *** gnuoy has joined #openstack-infra | 08:43 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Support deploy args in OVB jobs https://review.openstack.org/437531 | 08:46 |
| *** gnuoy has quit IRC | 08:46 | |
| *** gnuoy has joined #openstack-infra | 08:46 | |
| *** bhavik1 has quit IRC | 08:47 | |
| *** jaosorior has joined #openstack-infra | 08:47 | |
| *** flepied has joined #openstack-infra | 08:48 | |
| *** gnuoy has quit IRC | 08:50 | |
| *** mptacekx has joined #openstack-infra | 08:50 | |
| *** gnuoy has joined #openstack-infra | 08:51 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config master: oslo.messaging: disable a zmq job https://review.openstack.org/437931 | 08:52 |
| *** shardy has quit IRC | 08:53 | |
| *** shardy has joined #openstack-infra | 08:53 | |
| *** dpaterson has quit IRC | 08:56 | |
| *** matrohon has quit IRC | 08:56 | |
| *** jpich has joined #openstack-infra | 08:56 | |
| *** wolverineav has joined #openstack-infra | 08:57 | |
| *** sdake has quit IRC | 08:59 | |
| *** pgadiya has quit IRC | 08:59 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** hashar has joined #openstack-infra | 09:00 | |
| *** zzzeek has joined #openstack-infra | 09:00 | |
| *** matrohon has joined #openstack-infra | 09:01 | |
| *** wolverineav has quit IRC | 09:01 | |
| openstackgerrit | Jordan Pittier proposed openstack-infra/devstack-gate master: Remove Tempest stress testing setting https://review.openstack.org/389481 | 09:02 |
| *** gnuoy has quit IRC | 09:04 | |
| *** gnuoy has joined #openstack-infra | 09:04 | |
| *** gnuoy has quit IRC | 09:05 | |
| *** gnuoy has joined #openstack-infra | 09:05 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ https://review.openstack.org/426307 | 09:06 |
| *** tosky has joined #openstack-infra | 09:08 | |
| *** gongysh has quit IRC | 09:09 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/jenkins-job-builder master: Add a publisher for MQTT https://review.openstack.org/427765 | 09:09 |
| berendt | are there actually connection issues with docs.o.o? | 09:10 |
| *** claudiub has joined #openstack-infra | 09:10 | |
| *** pgadiya has joined #openstack-infra | 09:15 | |
| *** gongysh has joined #openstack-infra | 09:16 | |
| *** sshnaidm has quit IRC | 09:16 | |
| *** matrohon has quit IRC | 09:18 | |
| *** gnuoy has quit IRC | 09:18 | |
| *** gongysh has quit IRC | 09:20 | |
| openstackgerrit | Chaoyi Huang proposed openstack-infra/project-config master: Add Tricircle multi-region job https://review.openstack.org/414909 | 09:24 |
| *** jordanP has joined #openstack-infra | 09:24 | |
| *** pgadiya has quit IRC | 09:26 | |
| *** yujunz has quit IRC | 09:29 | |
| *** lucas-afk is now known as lucasagomes | 09:30 | |
| *** wolverineav has joined #openstack-infra | 09:33 | |
| *** isaacb has quit IRC | 09:34 | |
| *** vikrant has quit IRC | 09:35 | |
| *** matrohon has joined #openstack-infra | 09:35 | |
| *** isaacb has joined #openstack-infra | 09:35 | |
| *** cshastri has quit IRC | 09:36 | |
| *** Julien-zte has quit IRC | 09:37 | |
| *** yamamoto_ has quit IRC | 09:37 | |
| *** wolverineav has quit IRC | 09:37 | |
| *** mdbooth_ has quit IRC | 09:37 | |
| *** ansiwen has quit IRC | 09:37 | |
| berendt | we still get a lot of http timeouts when connection to docs.o.o | 09:38 |
| berendt | can anybody please have a look? | 09:38 |
| *** psachin has quit IRC | 09:38 | |
| *** pgadiya has joined #openstack-infra | 09:38 | |
| *** mrunge has quit IRC | 09:38 | |
| *** mdbooth has joined #openstack-infra | 09:40 | |
| *** ansiwen has joined #openstack-infra | 09:40 | |
| *** electrofelix has joined #openstack-infra | 09:40 | |
| *** yanyanhu has quit IRC | 09:41 | |
| *** tojuvone has quit IRC | 09:44 | |
| *** wolverineav has joined #openstack-infra | 09:44 | |
| openstackgerrit | Merged openstack-infra/project-config master: oslo.messaging: disable a zmq job https://review.openstack.org/437931 | 09:46 |
| *** isaacb has quit IRC | 09:47 | |
| *** rossella_s has joined #openstack-infra | 09:48 | |
| *** savihou has joined #openstack-infra | 09:50 | |
| *** vikrant has joined #openstack-infra | 09:50 | |
| *** wolverineav has quit IRC | 09:50 | |
| *** cshastri has joined #openstack-infra | 09:51 | |
| *** florianf has quit IRC | 09:55 | |
| *** gildub has joined #openstack-infra | 09:55 | |
| Zara | morning | 09:58 |
| *** hashar has quit IRC | 09:59 | |
| ianw | berendt: hmm, it seems to be ok | 10:00 |
| *** nadya_ has quit IRC | 10:01 | |
| ianw | it does have a bunch of "AH00485: scoreboard is full, not at MaxRequestWorkers" errors | 10:01 |
| ianw | might be similar to https://review.openstack.org/#/c/426639/ | 10:01 |
| berendt | ianw: high delay on our sites, tested via different connections | 10:01 |
| ianw | berendt: let me restart apache for you | 10:02 |
| berendt | ianw: now it is working | 10:02 |
| ianw | berendt: ok, yeah just restarted it. that seems to help for a while. i'll bring the issue up in our weekly meeting for us to discuss | 10:03 |
| berendt | ianw: thanks | 10:03 |
| *** hashar has joined #openstack-infra | 10:04 | |
| *** derekh has joined #openstack-infra | 10:04 | |
| *** florianf has joined #openstack-infra | 10:10 | |
| *** alex_xu_ has quit IRC | 10:14 | |
| *** jaosorior is now known as jaosorior_lunch | 10:15 | |
| *** liujiong has quit IRC | 10:16 | |
| *** alex_xu has joined #openstack-infra | 10:17 | |
| *** neiljerram has joined #openstack-infra | 10:17 | |
| *** jaosorior_lunch is now known as jaosorior | 10:17 | |
| neiljerram | Morning all! | 10:17 |
| *** vtapia_ has quit IRC | 10:18 | |
| *** dtantsur has joined #openstack-infra | 10:19 | |
| *** vtapia has joined #openstack-infra | 10:19 | |
| neiljerram | I recently created a periodic job for the project that I work on (https://review.openstack.org/#/c/435742/), but realize that I have no idea where I should go to see the results of that job (as it is not associated with a particular Gerrit changeset). Please can you advise? | 10:19 |
| *** wolverineav has joined #openstack-infra | 10:23 | |
| *** ssbarnea has joined #openstack-infra | 10:25 | |
| *** ssbarnea has quit IRC | 10:25 | |
| *** ssbarnea has joined #openstack-infra | 10:25 | |
| *** wolverineav has quit IRC | 10:27 | |
| *** eroux has joined #openstack-infra | 10:28 | |
| *** sshnaidm has joined #openstack-infra | 10:28 | |
| *** mrunge has joined #openstack-infra | 10:31 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config master: Run containers-oooq jobs on every patch https://review.openstack.org/437944 | 10:31 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config master: WIP: Move containers-oooq to the check pipeline https://review.openstack.org/437945 | 10:31 |
| *** strigazi_ is now known as strigazi | 10:35 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/git-review master: Fix test_remote_url to work when remote is restricted for SSH https://review.openstack.org/312885 | 10:37 |
| *** nadya has joined #openstack-infra | 10:42 | |
| *** wolverineav has joined #openstack-infra | 10:43 | |
| *** vponomaryov has joined #openstack-infra | 10:43 | |
| *** yamahata has quit IRC | 10:44 | |
| *** pt_15 has quit IRC | 10:45 | |
| *** aarefiev_afk is now known as aarefiev | 10:47 | |
| *** wolverineav has quit IRC | 10:48 | |
| *** gildub has quit IRC | 10:51 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/git-review master: Fix test_remote_url to work when remote is restricted for SSH https://review.openstack.org/312885 | 10:52 |
| *** rossella_s has quit IRC | 10:53 | |
| *** rossella_s has joined #openstack-infra | 10:54 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config master: gnocchi: only run upgrade-from-2.2 from stable/3.1 https://review.openstack.org/438428 | 10:54 |
| *** wznoinsk has quit IRC | 10:55 | |
| *** cshastri has quit IRC | 10:55 | |
| *** wznoinsk has joined #openstack-infra | 10:55 | |
| *** psachin has joined #openstack-infra | 10:56 | |
| *** strigazi has quit IRC | 10:56 | |
| *** strigazi has joined #openstack-infra | 10:56 | |
| *** aviau has quit IRC | 10:56 | |
| *** wznoinsk has left #openstack-infra | 10:57 | |
| *** vikrant has quit IRC | 10:57 | |
| *** aviau has joined #openstack-infra | 10:57 | |
| *** yamamoto has joined #openstack-infra | 11:02 | |
| *** yamamoto has quit IRC | 11:04 | |
| *** sambetts|afk is now known as sambetts | 11:05 | |
| *** tojuvone has joined #openstack-infra | 11:05 | |
| *** nmathew has quit IRC | 11:06 | |
| *** saibarspeis has quit IRC | 11:09 | |
| *** tojuvone has left #openstack-infra | 11:10 | |
| *** mrunge has quit IRC | 11:12 | |
| *** mrunge has joined #openstack-infra | 11:14 | |
| *** vikrant has joined #openstack-infra | 11:14 | |
| *** nicolasbock has joined #openstack-infra | 11:14 | |
| *** nicolasbock has quit IRC | 11:16 | |
| *** nicolasbock has joined #openstack-infra | 11:16 | |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: TEST for multinode grenade devstack https://review.openstack.org/396679 | 11:17 |
| *** yolanda has quit IRC | 11:17 | |
| *** yolanda has joined #openstack-infra | 11:19 | |
| *** alexchadin has joined #openstack-infra | 11:25 | |
| *** sandanar has quit IRC | 11:29 | |
| *** sdague has joined #openstack-infra | 11:31 | |
| *** abregman has joined #openstack-infra | 11:34 | |
| *** jkilpatr has quit IRC | 11:34 | |
| *** askb has quit IRC | 11:35 | |
| ianw | neiljerram: http://logs.openstack.org/periodic/ | 11:36 |
| *** yamamoto has joined #openstack-infra | 11:38 | |
| neiljerram | ianw, thanks. Is there also any kind of alert, e.g. email, if a periodic job fails? | 11:40 |
| *** szaher_ has quit IRC | 11:45 | |
| *** szaher has joined #openstack-infra | 11:46 | |
| *** tinwood is now known as tinwood_swap | 11:47 | |
| *** neel_ has joined #openstack-infra | 11:48 | |
| neel_ | hello our default CI for cinder is failing | 11:48 |
| neel_ | 16:39:20 + /opt/stack/new/devstack-gate/devstack-vm-gate.sh:main:L692: /tmp/ansible/bin/ansible primary -f 5 -i /home/jenkins/workspace/dsvm-tempest-cinder-driver/inventory -m shell -a 'cd '\''/opt/stack/new/devstack'\'' && sudo -H -u stack DSTOOLS_VERSION=0.2.1 stdbuf -oL -eL ./stack.sh executable=/bin/bash' 16:39:22 ERROR: the main setup script run by this job failed - exit code: 2 | 11:48 |
| neel_ | log location :http://54.169.104.103/92/336092/28/check/dsvm-tempest-cinder-driver/348723d/ | 11:48 |
| neel_ | is anyone already facing same issue ? | 11:49 |
| neel_ | i could see errors under :http://54.169.104.103/92/336092/28/check/dsvm-tempest-cinder-driver/348723d/logs/devstack-gate-setup-host.txt.gz#_2017-02-27_11_03_58_395 | 11:52 |
| *** sdague_ has joined #openstack-infra | 11:53 | |
| *** sdague__ has joined #openstack-infra | 11:53 | |
| *** gouthamr has joined #openstack-infra | 11:53 | |
| *** sdague has quit IRC | 11:53 | |
| *** sdague__ has quit IRC | 11:54 | |
| *** sdague_ has quit IRC | 11:54 | |
| *** sdague has joined #openstack-infra | 11:55 | |
| *** sdague_ has joined #openstack-infra | 11:55 | |
| *** rfolco has joined #openstack-infra | 11:56 | |
| *** pgadiya has quit IRC | 11:57 | |
| *** yamahata has joined #openstack-infra | 12:00 | |
| *** yamahata_ has joined #openstack-infra | 12:01 | |
| *** jkilpatr has joined #openstack-infra | 12:02 | |
| *** yamahata has quit IRC | 12:02 | |
| *** abregman has quit IRC | 12:04 | |
| *** rraja has quit IRC | 12:06 | |
| *** yamamoto has quit IRC | 12:06 | |
| *** yamamoto has joined #openstack-infra | 12:07 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Support deploy args in OVB jobs https://review.openstack.org/437531 | 12:10 |
| *** yamamoto has quit IRC | 12:11 | |
| arxcruz | ALL: IS there a mail proxy in openstack infra? What if I want one of my jobs to sent an email to a user with some results, what would be the best option ? | 12:21 |
| *** dave-mccowan has joined #openstack-infra | 12:21 | |
| *** aysyd has joined #openstack-infra | 12:23 | |
| *** yamamoto has joined #openstack-infra | 12:26 | |
| *** ZZelle has joined #openstack-infra | 12:27 | |
| *** tuanluong has quit IRC | 12:28 | |
| *** rhallisey has joined #openstack-infra | 12:30 | |
| *** yamamoto has quit IRC | 12:30 | |
| *** kgiusti has left #openstack-infra | 12:32 | |
| *** sdague has quit IRC | 12:32 | |
| *** sdague_ is now known as sdague | 12:33 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: layout: fix typo for tripleo/upgrade jobs https://review.openstack.org/438475 | 12:40 |
| *** gema has quit IRC | 12:40 | |
| *** gema has joined #openstack-infra | 12:41 | |
| *** yamamoto has joined #openstack-infra | 12:41 | |
| *** martinkopec has quit IRC | 12:42 | |
| *** thorst has joined #openstack-infra | 12:43 | |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: TEST for multinode grenade devstack https://review.openstack.org/396679 | 12:43 |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: TEST for multinode grenade devstack https://review.openstack.org/396679 | 12:45 |
| *** yamamoto has quit IRC | 12:47 | |
| *** Julien-zte has joined #openstack-infra | 12:47 | |
| *** gouthamr has quit IRC | 12:49 | |
| *** vikrant has quit IRC | 12:51 | |
| *** jcoufal has joined #openstack-infra | 12:51 | |
| *** martinkopec has joined #openstack-infra | 12:53 | |
| *** yamamoto has joined #openstack-infra | 12:56 | |
| *** lucasagomes is now known as lucas-hungry | 12:57 | |
| pabelanger | arxcruz: no mail proxy, for the most part we don't want jobs sending emails. Since we'd basically become a spam farm | 12:57 |
| pabelanger | however, it is something that has comeup a few times, that we might be able to address with zuulv3. Currently you can setup a email per pipeline, but I think we've said email per job might also be something we could do | 12:58 |
| *** Guest49819 is now known as rook | 12:58 | |
| *** EricGonczer_ has joined #openstack-infra | 13:00 | |
| arxcruz | pabelanger: hmmmm so, I have a script that parse the tempest failures on tripleo, and sent by email for a list of interested users | 13:00 |
| arxcruz | pabelanger: https://review.openstack.org/#/c/423340/ | 13:01 |
| *** jamesdenton has joined #openstack-infra | 13:01 | |
| *** yamamoto has quit IRC | 13:01 | |
| pabelanger | arxcruz: ya, we don't want to do that. | 13:01 |
| arxcruz | pabelanger: right now I'm using a gmail account with plain password, which isn't what we want, even though it's an app password so, there isn't too much someone can do with it | 13:01 |
| arxcruz | weshay: ^ | 13:02 |
| pabelanger | arxcruz: also, I don't think you can expect cloud providers to allow outbound smtp | 13:02 |
| pabelanger | not that I have tried, but I would guess they filter it | 13:02 |
| mordred | pabelanger: actually, the only cloud provider we've had that blocks outbound smtp was hp | 13:04 |
| *** jamesdenton has quit IRC | 13:04 | |
| pabelanger | mordred: Cool | 13:04 |
| *** yujunz has joined #openstack-infra | 13:04 | |
| *** dprince has joined #openstack-infra | 13:05 | |
| *** beagles is now known as beagles_mtg | 13:05 | |
| mordred | while I agree, we do not want jobs sending emails (GIANT spam farm) - zuul itself can and does send emails | 13:06 |
| jroll | most providers let you fail on your own when you realize it's hard to get a good reputation on a recycled IP :P | 13:07 |
| mordred | jroll: :) (fwiw, my email server runs in your cloud and is pretty happy - but yah) | 13:07 |
| jroll | :P | 13:08 |
| mordred | pabelanger, arxcruz: we don't have a way to do a server-side filter of the results first, but we can configure an email reporter for jobs | 13:08 |
| *** gouthamr has joined #openstack-infra | 13:08 | |
| *** yamamoto has joined #openstack-infra | 13:11 | |
| *** e0ne has quit IRC | 13:15 | |
| *** yamamoto has quit IRC | 13:16 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Bring infracloud-chocolate back online https://review.openstack.org/438490 | 13:20 |
| *** trown|ATL is now known as trown | 13:20 | |
| pabelanger | mordred: clarkb: jeblair: fungi: ^ I'd like to enable infracloud-chocolate in nodepool.o.o again, to address our issue with diskimages starting to pile up on nb01.o.o and nb02.o.o. Moving forward, I think we should work on adding support for nodepool to properly us shared tenants. I think we agree on some sort of server key? | 13:21 |
| arxcruz | mordred: pabelanger as far as I know, zuul only send email like: hey, this job fails, and don't allow a customization right ? | 13:22 |
| pabelanger | yes | 13:22 |
| mordred | arxcruz: as of right now, that is correct - it's possible we might have some better answers once v3 is here | 13:22 |
| pabelanger | you could also write a bot to connect to gerrit or firehose.o.o, then have said bot listen to events for a specific project. Then fire off an email based on things, said bot could live on your local environment | 13:23 |
| mordred | yah. that's probably the best bet for now | 13:25 |
| arxcruz | weshay: ^ | 13:25 |
| *** sreeram_v has joined #openstack-infra | 13:26 | |
| openstackgerrit | Sorin Sbârnea proposed openstack-infra/git-review master: Fix config failure for users without push rights. https://review.openstack.org/437496 | 13:26 |
| *** sreeram_v has quit IRC | 13:26 | |
| *** sreeram__ has joined #openstack-infra | 13:26 | |
| *** sreeram__ has quit IRC | 13:26 | |
| weshay | mordred, pabelanger thanks guys :) | 13:26 |
| arxcruz | mordred: pabelanger before I look on google, is there an example code or api to do it easily that you're aware ? | 13:26 |
| *** yamamoto has joined #openstack-infra | 13:26 | |
| *** yamamoto has quit IRC | 13:30 | |
| mordred | arxcruz: there is an example on https://docs.openstack.org/infra/system-config/firehose.html | 13:31 |
| *** yujunz is now known as yujunz[away] | 13:32 | |
| arxcruz | mordred: thanks I'll take a look :) | 13:32 |
| *** john-davidge has joined #openstack-infra | 13:33 | |
| *** skelso has joined #openstack-infra | 13:33 | |
| *** yujunz[away] is now known as yujunz | 13:34 | |
| *** ccamacho is now known as ccamacho|lunch | 13:34 | |
| *** jzerebec1i is now known as jzerebecki | 13:35 | |
| *** EricGonczer_ has quit IRC | 13:36 | |
| *** sekelso has joined #openstack-infra | 13:37 | |
| *** sreeram_v has joined #openstack-infra | 13:38 | |
| *** sreeram_v has quit IRC | 13:38 | |
| *** EricGonczer_ has joined #openstack-infra | 13:38 | |
| *** EricGonczer_ has quit IRC | 13:38 | |
| *** skelso has quit IRC | 13:39 | |
| *** EricGonczer_ has joined #openstack-infra | 13:40 | |
| *** yamamoto has joined #openstack-infra | 13:41 | |
| *** john-dav_ has joined #openstack-infra | 13:42 | |
| *** john-davidge has quit IRC | 13:42 | |
| *** rlandy has joined #openstack-infra | 13:42 | |
| *** kgiusti has joined #openstack-infra | 13:44 | |
| *** yamamoto has quit IRC | 13:46 | |
| *** EricGonczer_ has quit IRC | 13:48 | |
| *** tongli has joined #openstack-infra | 13:53 | |
| *** yamamoto has joined #openstack-infra | 13:56 | |
| *** chlong has joined #openstack-infra | 13:59 | |
| *** yamamoto has quit IRC | 14:01 | |
| *** ihrachys has joined #openstack-infra | 14:02 | |
| *** chlong has quit IRC | 14:04 | |
| neel_ | Hello, I could see most of the cinder CI are reporting failures | 14:04 |
| neel_ | https://review.openstack.org/#/c/336092/ | 14:04 |
| neel_ | is there any known issue going on ? | 14:04 |
| neel_ | or something has changed ? | 14:04 |
| openstackgerrit | Sorin Sbârnea proposed openstack-infra/git-review master: Fix config failure for users without push rights. https://review.openstack.org/437496 | 14:05 |
| *** erhudy has joined #openstack-infra | 14:05 | |
| *** mdrabe has joined #openstack-infra | 14:08 | |
| *** zz_dimtruck is now known as dimtruck | 14:08 | |
| *** amotoki_ has quit IRC | 14:09 | |
| *** baoli has joined #openstack-infra | 14:10 | |
| *** lucas-hungry is now known as lucasagomes | 14:11 | |
| smcginnis | neel_: Does this apply to you? http://lists.openstack.org/pipermail/openstack-dev/2017-February/112822.html | 14:11 |
| openstackgerrit | Jens Rosenboom proposed openstack-infra/project-config master: Updates to Chef OpenStack project https://review.openstack.org/438501 | 14:11 |
| *** yamamoto has joined #openstack-infra | 14:11 | |
| smcginnis | neel_: This may be relevant as well: http://lists.openstack.org/pipermail/openstack-dev/2017-February/112872.html | 14:12 |
| *** mriedem has joined #openstack-infra | 14:12 | |
| *** nadya has quit IRC | 14:14 | |
| *** neel_ has quit IRC | 14:14 | |
| *** xyang1 has joined #openstack-infra | 14:15 | |
| *** salv-orlando has joined #openstack-infra | 14:15 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups master: Upgrade Views module to 3.15 https://review.openstack.org/438504 | 14:16 |
| *** yamamoto has quit IRC | 14:17 | |
| *** esikachev has joined #openstack-infra | 14:19 | |
| *** Goneri has joined #openstack-infra | 14:19 | |
| *** sdake has joined #openstack-infra | 14:21 | |
| *** yujunz has quit IRC | 14:22 | |
| *** ccamacho|lunch is now known as ccamacho | 14:22 | |
| *** amotoki has joined #openstack-infra | 14:24 | |
| fungi | i'm only sort of around this week, have family coming to visit before i have to head back out of town for the joint board/tc meeting next week | 14:24 |
| fungi | my priorities are mostly attending meetings and assembling our ptg summary | 14:25 |
| fungi | though i'll probably have to miss the zuul meeting today since it falls right on top of dinner with the parents | 14:25 |
| pabelanger | fungi: ack | 14:26 |
| *** yamamoto has joined #openstack-infra | 14:26 | |
| fungi | jeblair: if anybody wants to dig into post-ptg zuul v3 status details during the meeting, i'll happily just incorporate those directly into my summary | 14:26 |
| openstackgerrit | Qiming Teng proposed openstack-infra/project-config master: Fix senlin gate job https://review.openstack.org/437851 | 14:28 |
| *** alexchadin has quit IRC | 14:28 | |
| *** sdake has quit IRC | 14:31 | |
| *** yamamoto has quit IRC | 14:31 | |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: doc: Clarify sections in 'setup.cfg' https://review.openstack.org/438509 | 14:32 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: Stop using 'warnerrors' https://review.openstack.org/438510 | 14:32 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: tox: Don't set skipsdist=True https://review.openstack.org/438511 | 14:32 |
| *** tlian has joined #openstack-infra | 14:32 | |
| Qiming | infra cores, pls help take a look at this: https://review.openstack.org/437851 , it is about fixing gate problems. thank you! | 14:32 |
| sfinucan | dhellmann, tonyb: ^^^ | 14:32 |
| sfinucan | we need to bump Sphinx to 1.5.0 in g-r to make use of that, but we can't do that until pbr 1.11.0 is released due to the man page issue | 14:33 |
| *** erikmwil_ has quit IRC | 14:33 | |
| sfinucan | guess that's no different to the 'fatalwarnings' solution though... | 14:34 |
| *** erikmwilson has joined #openstack-infra | 14:34 | |
| *** alexchadin has joined #openstack-infra | 14:36 | |
| *** sdake has joined #openstack-infra | 14:36 | |
| *** dimtruck is now known as zz_dimtruck | 14:38 | |
| *** amotoki has quit IRC | 14:39 | |
| *** neel_ has joined #openstack-infra | 14:41 | |
| neel_ | hello smcginnis : is there any example for http://lists.openstack.org/pipermail/openstack-dev/2017-February/112822.html | 14:41 |
| neel_ | i am not getting how to apply this ? | 14:41 |
| *** yamamoto has joined #openstack-infra | 14:42 | |
| *** mhickey has joined #openstack-infra | 14:42 | |
| *** jamesdenton has joined #openstack-infra | 14:44 | |
| *** amotoki has joined #openstack-infra | 14:45 | |
| *** yamamoto has quit IRC | 14:46 | |
| *** sshnaidm has quit IRC | 14:47 | |
| smcginnis | neel_: Sorry, I don't run that so I don't really know the details. | 14:50 |
| *** yujunz has joined #openstack-infra | 14:51 | |
| *** amotoki has quit IRC | 14:53 | |
| *** rossella_s has quit IRC | 14:53 | |
| *** rossella_s has joined #openstack-infra | 14:54 | |
| *** smarcet has joined #openstack-infra | 14:56 | |
| *** yamamoto has joined #openstack-infra | 14:56 | |
| *** hongbin has joined #openstack-infra | 14:57 | |
| *** lennyb_ is now known as lennyb | 15:01 | |
| *** yamamoto has quit IRC | 15:01 | |
| *** sshnaidm has joined #openstack-infra | 15:02 | |
| *** sekelso has quit IRC | 15:02 | |
| *** cody-somerville has quit IRC | 15:02 | |
| *** sekelso has joined #openstack-infra | 15:03 | |
| *** zz_dimtruck is now known as dimtruck | 15:05 | |
| *** pt_15 has joined #openstack-infra | 15:06 | |
| *** electrocucaracha has joined #openstack-infra | 15:06 | |
| *** trown is now known as trown|brb | 15:07 | |
| *** nadya has joined #openstack-infra | 15:08 | |
| *** EricGonczer_ has joined #openstack-infra | 15:08 | |
| *** amotoki has joined #openstack-infra | 15:09 | |
| *** trown|brb is now known as trown | 15:11 | |
| *** trown is now known as trown|mtg | 15:11 | |
| *** trown|mtg is now known as trown | 15:11 | |
| *** yamamoto has joined #openstack-infra | 15:11 | |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: TEST for multinode grenade devstack https://review.openstack.org/396679 | 15:15 |
| *** yamamoto has quit IRC | 15:16 | |
| *** esikachev has quit IRC | 15:17 | |
| *** rbrndt has joined #openstack-infra | 15:18 | |
| jeblair | pabelanger, arxcruz, mordred: dhellmann and ttx spoke to me at the ptg about a question EmilienM had regarding having a non-voting tripleo job run on changes to nova and how to respond to that. arxcruz: are we talking about the same job or something else? | 15:18 |
| *** kong has quit IRC | 15:19 | |
| electrocucaracha | AJaeger: | 15:19 |
| arxcruz | jeblair: I believe no | 15:19 |
| EmilienM | jeblair: we already run a bunch of tripleo jobs in OpenStack: https://docs.google.com/spreadsheets/d/1bLg-uEGrQXyRZ-FuR6pf1WT4XN0-6MrlfqEShI7xMxg/edit#gid=0 | 15:19 |
| electrocucaracha | AJaeger: regarding the https://review.openstack.org/#/c/426419/ there is no core member for that group, could you help us to solve it? | 15:20 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config master: OSA: Prevent CentOS jobs executing for Newton and older https://review.openstack.org/438551 | 15:20 |
| *** sdake_ has joined #openstack-infra | 15:20 | |
| jeblair | arxcruz: ok, then are you talking about a voting job? | 15:21 |
| arxcruz | jeblair: no, we run full tempest on tripleo as a periodic job | 15:21 |
| *** isaacb has joined #openstack-infra | 15:21 | |
| *** mriedem1 has joined #openstack-infra | 15:22 | |
| arxcruz | we right now have some failures, and we want to send an email to specific teams depending on which failure is happening | 15:22 |
| arxcruz | for example, failures related to volume, send to tripleo guy responsible for that | 15:22 |
| arxcruz | and so on | 15:22 |
| *** mriedem has quit IRC | 15:23 | |
| *** gordc has joined #openstack-infra | 15:23 | |
| *** EricGonc_ has joined #openstack-infra | 15:23 | |
| *** sdake has quit IRC | 15:23 | |
| *** chlong has joined #openstack-infra | 15:25 | |
| mtreinish | clarkb, fungi: I spun up a recheck on 438078. Hopefully one of the jobs will catch the ssh failure again so we can hold the node and inspect | 15:25 |
| jeblair | arxcruz: gotcha. i don't think we have a great solution to that right now; the best i can think of with current tooling is to look in openstack-health and manually triage (or write a script). we could add a periodic pipeline for tripleo, but all failure emails would go to the same address; you'd still have to triage. i'll see if we can work on making that better in zuulv3. | 15:25 |
| *** EricGonczer_ has quit IRC | 15:26 | |
| arxcruz | jeblair: is this mail will have the list of tempest failures? | 15:26 |
| *** yamamoto has joined #openstack-infra | 15:26 | |
| *** chlong_ has joined #openstack-infra | 15:27 | |
| jeblair | arxcruz: no, only that the job failed and the link to the logs | 15:27 |
| mtreinish | jeblair: openstack-health can give you an rss feed for failures on a job, project, etc (any job metadata key we expose) but we don't do it per test | 15:27 |
| arxcruz | my script right now check the tempest logs for failures, pretty simple, and using a yaml file check the list of emails and sent it based on the failures, plus it uses jinja2 to create nice mail template | 15:27 |
| mtreinish | we don't have it for individual test failures, but that's something we could add | 15:28 |
| *** chlong_ has quit IRC | 15:28 | |
| jeblair | arxcruz: maybe in the interim you can follow the feed mtreinish mentioned and either ask os-health for test results for that job (or maybe if the per-job feed is added, use that), and then send email. | 15:30 |
| mrmartin | this change not appears on zuul status page: https://review.openstack.org/#/c/438504/1 what am I doing wrong? It was approved. | 15:31 |
| jeblair | arxcruz: i'd like to add a facility to do what you want to zuul, but i think it will be a while before we are able to. | 15:31 |
| *** yamamoto has quit IRC | 15:31 | |
| *** eroux has quit IRC | 15:32 | |
| arxcruz | jeblair: doing that on zuul would be awesome, if you want I can digg into v3 and see how to implement it for a long term purpose, meanwhile, I believe the easiest way is continue with my script, but instead of send the email, post the results for a service running in openshift, or somewhere else to send the email | 15:32 |
| openstackgerrit | Vladyslav Drok proposed openstack-infra/project-config master: Add pxe_snmp driver to list of enabled drivers https://review.openstack.org/438559 | 15:33 |
| *** eroux has joined #openstack-infra | 15:33 | |
| mtreinish | jeblair: there is per job feed. I thought you were talking about per individual test feeds :) | 15:33 |
| arxcruz | jeblair: btw, it seems that openstack health isn't listening tripleo-quickstart and tripleo-quickstart-extras jobs | 15:33 |
| arxcruz | at least in the search shows nothing | 15:33 |
| arxcruz | http://status.openstack.org/openstack-health/#/?searchProject=quickstart | 15:33 |
| jeblair | mtreinish: er yes, that's what arxcruz wants, sorry i misspoke | 15:33 |
| mtreinish | for example http://health.openstack.org/runs/key/build_name/periodic-tempest-dsvm-neutron-full-non-admin-ubuntu-xenial-master/recent/rss | 15:34 |
| *** otherwiseguy has quit IRC | 15:34 | |
| jeblair | mtreinish, arxcruz: "ask os-health for test results for that job (or maybe if the per-test feed is added, use that)" is what i should have said | 15:34 |
| *** tonytan4ever has joined #openstack-infra | 15:34 | |
| *** cody-somerville has joined #openstack-infra | 15:34 | |
| *** cody-somerville has joined #openstack-infra | 15:34 | |
| *** sshnaidm has quit IRC | 15:34 | |
| sdake_ | hey folks, is there a way to start an infra managed channel without a weekly meeting or "team" associated with it? | 15:35 |
| sdake_ | as in irc channel | 15:36 |
| *** sshnaidm has joined #openstack-infra | 15:36 | |
| *** beslemon has joined #openstack-infra | 15:36 | |
| openstackgerrit | Monty Taylor proposed openstack/os-client-config master: Add ability to skip yaml loading https://review.openstack.org/438560 | 15:37 |
| *** mriedem1 is now known as mriedem | 15:37 | |
| *** yamamoto has joined #openstack-infra | 15:37 | |
| jeblair | sdake_: yes, you can do the things listed here: https://docs.openstack.org/infra/system-config/irc.html | 15:38 |
| mtreinish | arxcruz: do the jobs emit subunit in the logs dir on disk? | 15:38 |
| jeblair | sdake_: note, i think some of our bots may be hitting their channel limit, and i'm not sure anyone is working on correcting that. | 15:38 |
| *** sreeram_v has joined #openstack-infra | 15:38 | |
| *** otherwiseguy has joined #openstack-infra | 15:38 | |
| arxcruz | mtreinish: no idea, how can I check it? | 15:38 |
| mtreinish | because if there is no subunit data there won't be anything added to the db | 15:38 |
| *** neel_ has quit IRC | 15:38 | |
| mtreinish | arxcruz: do you have a link to a sample log dir? | 15:39 |
| arxcruz | mtreinish: sure, logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq/ | 15:39 |
| sdake_ | jeblair as their was several cross-project collaboration sessions on deployment tools was thinking of starting a corss-project channel called openstack-deploymnet | 15:39 |
| arxcruz | mtreinish: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq/ | 15:39 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate master: DNM: don't run scenario tests in parallel https://review.openstack.org/438562 | 15:39 |
| sdake_ | the purpose of which is for the various deployment teams to collaborate on solving deployment issues we run into | 15:40 |
| mtreinish | arxcruz: nope: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-nonha-tempest-oooq/530e808/logs/ | 15:40 |
| sdake_ | latest example was nova placement api | 15:40 |
| mtreinish | there needs to be a testrepository.subunit file for it to be picked up by the subunit worker | 15:40 |
| mtreinish | take a look at how devstack-gate does it | 15:40 |
| arxcruz | mtreinish: in the logs/ directory right ? | 15:41 |
| mtreinish | yeah | 15:41 |
| jeblair | sdake_: you might also consider just using #openstack-dev | 15:41 |
| arxcruz | okay, I'll work on that :) | 15:41 |
| sdake_ | jeblair nobody actually looks at that channel sadly | 15:41 |
| jeblair | sdake_: nice and quiet; perfect place to start a conversation :) | 15:42 |
| sdake_ | jeblair we have like 5 deployment tools in the big tent, and this channel would be pretty noisy I suspect :) | 15:42 |
| *** yamamoto has quit IRC | 15:42 | |
| *** sreeram_v has quit IRC | 15:42 | |
| sdake_ | jeblair i guess i'll start a thread on it on the ml - assuming its a possibility | 15:43 |
| sdake_ | so people can bikeshed the channel name / etc | 15:43 |
| sdake_ | or if we should just use openstack-dev, I guess you can weigh in on that | 15:44 |
| jeblair | just a suggestion :) | 15:44 |
| *** mixos has joined #openstack-infra | 15:44 | |
| *** esikachev has joined #openstack-infra | 15:44 | |
| sdake_ | i dont even join openstack-dev | 15:44 |
| sdake_ | as its crickets 24/7 | 15:44 |
| sdake_ | all the devs hide out | 15:44 |
| sdake_ | and ignore that channel | 15:45 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate master: bump dstools to 0.3.0 https://review.openstack.org/438566 | 15:45 |
| *** jimbaker has joined #openstack-infra | 15:46 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Export UPGRADE_ENV for scenario-upgrades https://review.openstack.org/438567 | 15:46 |
| *** Julien-zte has quit IRC | 15:47 | |
| *** Julien-zte has joined #openstack-infra | 15:48 | |
| *** Julien-zte has quit IRC | 15:48 | |
| *** markus_z has quit IRC | 15:48 | |
| yolanda | hi EmilienM , around? i have a question about tripleo-ci, how to start adding tests to networking-bgpvpn project | 15:49 |
| yolanda | maybe creating some scenario, or reusing some? | 15:49 |
| fungi | mrmartin: enqueuing currently triggers on addition of a workflow +1 vote, and the ci system checks at that time to see whether the change meets other requirements to merge (including presence of at least one code-review +2 vote). when you added your workflow +1 there was no code-review +2. the addition of a code-review +2 later did not cause it to be enqueued as that is not an enqueuing trigger | 15:49 |
| EmilienM | yolanda: can we take it on #tripleo please? | 15:49 |
| yolanda | oh, bad channel | 15:49 |
| yolanda | i just noticed now :) | 15:49 |
| mrmartin | fungi: oh ok, and what is the solution here? | 15:49 |
| fungi | mrmartin: easiest solution is to set your workflow vote back to +0 and then to +1 again and that should get it into the gate pipeline | 15:49 |
| mrmartin | thnx | 15:50 |
| mordred | sdake_: amusingly enough - I have actually had several real conversations in -dev recently ... I don't know when it started, but it's like, occupied again | 15:50 |
| mmedvede | fungi: any problems with meeting bot? we are unable to close meeting in #openstack-meeting | 15:50 |
| *** mptacekx has quit IRC | 15:50 | |
| mordred | sdake_: but I agree, I had considered it an abandoned wasteland and was quite surprised when I had real conversations there | 15:51 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Export UPGRADE_ENV for scenario-upgrades https://review.openstack.org/438567 | 15:51 |
| *** lennyb is now known as lennyb_ | 15:51 | |
| *** lennyb_ is now known as lennyb | 15:51 | |
| mrmartin | fungi: thanks, working now. | 15:52 |
| fungi | mmedvede: changing nicks mid-meeting causes meetbot to lose track of chair state | 15:52 |
| *** rbrndt has quit IRC | 15:52 | |
| mmedvede | fungi: thanks, was not aware of this. Makes sense | 15:52 |
| *** beslemon_ has joined #openstack-infra | 15:52 | |
| fungi | it could probably be enhanced to track chairs across nick changes in-meeting (if someone wants to do the work to implement that support), but it might still be somewhat fragile in the face of netsplits | 15:53 |
| *** martinkopec has quit IRC | 15:53 | |
| openstackgerrit | Merged openstack-infra/groups master: Upgrade Views module to 3.15 https://review.openstack.org/438504 | 15:54 |
| sdake_ | jeblair would this be fine without bot access assuming we have some kind of bot limit: | 15:55 |
| sdake_ | https://docs.openstack.org/infra/system-config/irc.html#channel-requirements | 15:55 |
| *** beslemon has quit IRC | 15:55 | |
| fungi | pabelanger: is there some emerging issue with our puppet-3-fedora job? | 15:56 |
| pabelanger | fungi: not sure, I noticed this morning too. I can dive deeper into it | 15:56 |
| fungi | pabelanger: looks bindep-related... missing packages for libffi-devel and openssl-devel | 15:57 |
| fungi | repeatable | 15:57 |
| pabelanger | wonder if we have an issue with fedora repo | 15:57 |
| pabelanger | will look after I finish up expenses | 15:57 |
| jeblair | sdake_: the tc asks that all channels to be logged, so please don't skip at least the openstack bot. | 15:58 |
| sdake_ | jeblair i'd like to hav eall bots | 15:58 |
| jeblair | ++ | 15:58 |
| sdake_ | however definately wont skip the openstack bot if the community wants to proceed | 15:58 |
| fungi | pabelanger: Error: package openssl-devel-1:1.0.2j-1.fc25.x86_64 requires krb5-devel(x86-64), but none of the providers can be installed | 15:58 |
| fungi | pabelanger: maybe caught mid-transition or something? | 15:58 |
| pabelanger | maybe, I can check mirror-updates too | 15:58 |
| fungi | thanks | 15:59 |
| electrocucaracha | yolanda: ping | 15:59 |
| sdake_ | jeblair this is why i asked the q about channel + having a team - as this isn't really a team | 15:59 |
| *** wolverineav has joined #openstack-infra | 15:59 | |
| jeblair | pabelanger, fungi: we're still missing a sync check before release on that, right? | 15:59 |
| fungi | jeblair: correct | 15:59 |
| fungi | afaik | 15:59 |
| pabelanger | yes | 15:59 |
| *** sekelso has quit IRC | 15:59 | |
| *** beagles_mtg is now known as beagles | 16:00 | |
| pabelanger | however, fedora sometimes needs to be kicked upstream, when package breaks | 16:00 |
| *** sekelso has joined #openstack-infra | 16:00 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups master: Upgrade Metatag module to 1.21 https://review.openstack.org/438572 | 16:00 |
| pabelanger | fedora-25 mirror is running now actually | 16:00 |
| pabelanger | is the top of ever 2 hours | 16:00 |
| fungi | k | 16:01 |
| pabelanger | Oh | 16:01 |
| pabelanger | I see some issues | 16:01 |
| *** sdake_ is now known as sdake | 16:01 | |
| pabelanger | rsync: mkstemp "/afs/.openstack.org/mirror/fedora/updates/25/x86_64/drpms/.kontact-16.08.3-2.fc25_16.12.2-1.fc25.x86_64.drpm.ikZj8m" failed: File too large (27) | 16:01 |
| pabelanger | for example | 16:01 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: upgrades: run pingtest at the very end of the CI job https://review.openstack.org/438055 | 16:01 |
| fungi | eep! | 16:01 |
| *** tmorin has joined #openstack-infra | 16:01 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config master: migrate github/bagpipe-bgp into openstack/networking-bagpipe https://review.openstack.org/438573 | 16:01 |
| fungi | does afs havea separate quota knob for individual file size? | 16:01 |
| fungi | or limitation? | 16:01 |
| fungi | or are we bumping up against general volume quota'/ | 16:02 |
| fungi | ? | 16:02 |
| sdake | jeblair i just got a wierd error from chanserv that I am not allowed to register the channel openstack-deployment | 16:02 |
| sdake | jeblair is that something that has to be done by infra specifically? If so, the wiki needs changing | 16:02 |
| *** esikachev has quit IRC | 16:02 | |
| *** wolverineav has quit IRC | 16:03 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config master: migrate github/bagpipe-bgp into openstack/networking-bagpipe https://review.openstack.org/438573 | 16:04 |
| sdake | [09:01:32] -ChanServ-#channel is already registered to freenode-staff. | 16:04 |
| pabelanger | fungi: only at 85% quota | 16:05 |
| *** tqtran has joined #openstack-infra | 16:05 | |
| jroll | sdake: that error looks like you tried to register #channel, not #openstack-deployment | 16:05 |
| sdake | jroll duh thanks :) | 16:05 |
| *** rbrndt has joined #openstack-infra | 16:05 | |
| jroll | :) | 16:05 |
| pabelanger | fungi: I think something changed in the upstream side, I was blocking drpms before | 16:06 |
| *** cody-somerville has quit IRC | 16:06 | |
| *** khappone has quit IRC | 16:07 | |
| tmorin | pabelanger: (hi!) perhaps you recall our discussion in Atlanta on how I could migrate code from github into an existing openstack project ? | 16:07 |
| tmorin | pabelanger: here is the project config change that I created to achieve what you had suggested: https://review.openstack.org/#/c/438573 | 16:08 |
| pabelanger | tmorin: yes, I remember. I need to sync with AJaeger on that. Was going to talk with him in a bit | 16:08 |
| tmorin | pabelanger: ok, can you tell me if what I did makes sense ? | 16:08 |
| pabelanger | tmorin: yes, that is what I was thinking. | 16:08 |
| pabelanger | tmorin: just need to confirm with people here, then we should be able to merge that | 16:09 |
| *** winggundamth has quit IRC | 16:09 | |
| tmorin | pabelanger: FYI, the tmmorin/networking-bagpipe has the bagpipe-bgp repo merged into it as a bagpipe_bgp subdirectory, and hence is ready for this merge to kick'in | 16:09 |
| tmorin | pabelanger: thanks! | 16:09 |
| tmorin | pabelanger: will add AJaeger as a reviewer | 16:09 |
| *** rbrndt has quit IRC | 16:09 | |
| openstackgerrit | Merged openstack-infra/groups master: Upgrade Metatag module to 1.21 https://review.openstack.org/438572 | 16:10 |
| pabelanger | tmorin: sure, I'll revert the repo and leave comments | 16:10 |
| *** khappone has joined #openstack-infra | 16:10 | |
| *** flepied has quit IRC | 16:10 | |
| tmorin | pabelanger: do you mean review the github repo in which I did the merge ? | 16:10 |
| pabelanger | tmorin: yes | 16:10 |
| tmorin | pabelanger: ok, thanks! | 16:11 |
| *** alexchadin has quit IRC | 16:11 | |
| *** wolverineav has joined #openstack-infra | 16:12 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Exclude deltarpms for fedora https://review.openstack.org/438577 | 16:12 |
| pabelanger | fungi: we can start with ^ | 16:12 |
| pabelanger | I'll keep looking into job failures | 16:13 |
| fungi | pabelanger: we'll likely need to disable that job though or 438577 won't be able to merge | 16:13 |
| fungi | unless you can manually fix the mirror that is | 16:13 |
| strigazi | Hi infra, since trusty support is dropped in devstack 433218, should we remove all our trusty jobs? | 16:13 |
| pabelanger | fungi: we could do that, was also considering manually applying. I'll defer to you | 16:14 |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: TEST for multinode grenade devstack https://review.openstack.org/396679 | 16:14 |
| fungi | pabelanger: manually applying a change you've proposed to unblock things in a catch-22 situation is perfectly fine. it's one of the main reasons we tend to equate our system-config core reviewers with root sysadmin privs | 16:14 |
| *** rcernin has quit IRC | 16:15 | |
| fungi | strigazi: that change only affects pike development, so yes if you're relying on nova and still supporting trusty in master currently then you will likely need to take some action | 16:16 |
| *** erikmwilson has quit IRC | 16:16 | |
| *** erikmwil_ has joined #openstack-infra | 16:16 | |
| fungi | strigazi: more generally openstack considers trusty support to end with mitaka, and so we may start removing trusty-related test resources after the stable/mitaka branches reach eol | 16:17 |
| strigazi | fungi: ok | 16:17 |
| *** cody-somerville has joined #openstack-infra | 16:17 | |
| *** cody-somerville has quit IRC | 16:17 | |
| *** cody-somerville has joined #openstack-infra | 16:17 | |
| fungi | strigazi: most projects with stable branches test stable/mitaka changes on trusty and anything for stable/newton and later on xenial | 16:18 |
| fungi | stable/newton upgrade jobs (e.g., grenade) also rely on trusty since they start by deploying stable/mitaka branch tip | 16:18 |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: TEST for multinode grenade devstack https://review.openstack.org/396679 | 16:19 |
| fungi | but once we eol stable/mitaka we'll cease performing upgrade tests on stable/newton changes | 16:19 |
| *** psachin_ has joined #openstack-infra | 16:21 | |
| pabelanger | fungi: fedora-25 fixed | 16:23 |
| *** flepied has joined #openstack-infra | 16:23 | |
| pabelanger | I am guessing a mix of drpms (space issue) and possible bad mirror on the last run | 16:23 |
| pabelanger | We can land https://review.openstack.org/#/c/438577/ first | 16:24 |
| openstackgerrit | Serguei Bezverkhi proposed openstack-infra/project-config master: Changing kolla-kubernetes ironic jobs to source type https://review.openstack.org/438581 | 16:24 |
| *** dhajare_ has joined #openstack-infra | 16:25 | |
| *** admcleod1 has joined #openstack-infra | 16:25 | |
| *** dhajare_ is now known as dhajare | 16:27 | |
| *** dhajare has quit IRC | 16:27 | |
| *** admcleod_ has quit IRC | 16:27 | |
| *** eroux has quit IRC | 16:27 | |
| *** yujunz has quit IRC | 16:27 | |
| *** dhajare has joined #openstack-infra | 16:27 | |
| *** BobBall_ has quit IRC | 16:28 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config master: [magnum] Run trusty jobs only for stable/mitaka https://review.openstack.org/438584 | 16:28 |
| strigazi | fungi When you can have a look ^^ | 16:29 |
| *** esikachev has joined #openstack-infra | 16:29 | |
| *** dhajare_ has joined #openstack-infra | 16:29 | |
| *** dhajare has quit IRC | 16:29 | |
| *** dhajare_ has quit IRC | 16:29 | |
| *** dhajare has joined #openstack-infra | 16:29 | |
| *** baoli has quit IRC | 16:30 | |
| fungi | thanks pabelanger! | 16:31 |
| *** baoli has joined #openstack-infra | 16:32 | |
| *** csomerville has joined #openstack-infra | 16:32 | |
| openstackgerrit | Merged openstack-infra/project-config master: Make gate-glance-python35 job voting. https://review.openstack.org/437598 | 16:33 |
| *** cody-somerville has quit IRC | 16:33 | |
| *** tonytan4ever has quit IRC | 16:33 | |
| *** tonytan4ever has joined #openstack-infra | 16:34 | |
| *** dhajare has quit IRC | 16:34 | |
| clarkb | good morning | 16:36 |
| *** psachin has quit IRC | 16:36 | |
| clarkb | fungi: going to start with a change to add backups to translate.o.o | 16:36 |
| pabelanger | I too am ready for back up things | 16:36 |
| clarkb | then sort out booting a translate01.openstack.org without impacting the existing server | 16:36 |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config master: [magnum] Run trusty jobs only for stable/mitaka https://review.openstack.org/438584 | 16:36 |
| *** psachin_ has quit IRC | 16:37 | |
| clarkb | pabelanger: cool maybe start with the docs and go from there? and any thing that isn't clear or is missing we can add as you go? | 16:37 |
| pabelanger | clarkb: sure, suggestions for server to test? | 16:37 |
| openstackgerrit | Merged openstack-infra/system-config master: Exclude deltarpms for fedora https://review.openstack.org/438577 | 16:37 |
| clarkb | pabelanger: etherpad is probably a good one to start with since its 99% db backups | 16:38 |
| pabelanger | kk | 16:38 |
| *** yamamoto has joined #openstack-infra | 16:38 | |
| fungi | clarkb: i'm around some to help push translation platform upgrade stuff through, just ping me when you have something since i'm popping in and out and may not be paying close attention to general scrollback | 16:38 |
| clarkb | fungi: will do, thanks | 16:40 |
| *** dizquierdo has joined #openstack-infra | 16:40 | |
| pabelanger | clarkb: should I launch a new server for etherpad? Or use the exists and restore into a directory | 16:40 |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: TEST for multinode grenade devstack https://review.openstack.org/396679 | 16:41 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Add backups to translate server https://review.openstack.org/438602 | 16:42 |
| pabelanger | clarkb: starting with directory first | 16:42 |
| clarkb | pabelanger: ya thats probably fine, however if we want to do a really robust recovery using a new server and recovering from that is probably a good idea. Keep in mind the db backups happen at most once a day so we probably don't want to replace production server with it unless actually necessary | 16:43 |
| clarkb | fungi: ^ change there is step zero | 16:43 |
| *** yamamoto has quit IRC | 16:44 | |
| pabelanger | clarkb: agree, let me check the data first, make sure that step works. Then I can see about creating an etherpad-dev server to restore | 16:44 |
| *** mriedem has quit IRC | 16:44 | |
| clarkb | pabelanger: sounds good thanks | 16:44 |
| openstackgerrit | Merged openstack-infra/system-config master: Add Debian mirror for Ocata packages https://review.openstack.org/437660 | 16:45 |
| fungi | pabelanger: also firing up a restored copy of a service which is using a remote db server could result in data corruption, so um... be careful if restoring a copy of a running production service ;) | 16:45 |
| clarkb | if 438602 looks good to people I will go ahead and sort out the ssh keys and user on the backup server | 16:45 |
| pabelanger | fungi: indeed. I don't plan to do that step without talking to people | 16:45 |
| *** mriedem has joined #openstack-infra | 16:46 | |
| pabelanger | clarkb: +2 | 16:46 |
| AJaeger | electrocucaracha: I don't have those permissions, somebody else here needs to help | 16:46 |
| clarkb | looks like for translate01 I can just give it bogus mysql details until we are ready to do the cut over. That will prevent the new server from interacting with old server in ways we don't want but allow us to get everything else in place | 16:47 |
| clarkb | so will work on that puppet change next | 16:47 |
| electrocucaracha | AJaeger: do you know how or who can help me on that? | 16:47 |
| *** abompard has left #openstack-infra | 16:47 | |
| *** bhavik1 has joined #openstack-infra | 16:48 | |
| *** tphummel has joined #openstack-infra | 16:48 | |
| *** bhavik1 has quit IRC | 16:48 | |
| *** mixos has quit IRC | 16:50 | |
| *** savihou has quit IRC | 16:50 | |
| *** admcleod1 has quit IRC | 16:50 | |
| *** andreas_s has quit IRC | 16:50 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: update promotion scripts for stable branches https://review.openstack.org/427385 | 16:51 |
| AJaeger | electrocucaracha: just ask here for help ;) | 16:51 |
| *** pt_15 has quit IRC | 16:53 | |
| *** fmccrthy has quit IRC | 16:53 | |
| *** davidlenwell has quit IRC | 16:54 | |
| *** tonytan4ever has quit IRC | 16:54 | |
| *** tonytan_brb has joined #openstack-infra | 16:54 | |
| *** pt_15 has joined #openstack-infra | 16:54 | |
| *** davidlenwell has joined #openstack-infra | 16:55 | |
| *** fmccrthy has joined #openstack-infra | 16:55 | |
| *** skelso has joined #openstack-infra | 16:55 | |
| *** funzo_ is now known as funzo | 16:56 | |
| *** amotoki has quit IRC | 16:56 | |
| *** sekelso has quit IRC | 16:57 | |
| *** adrian_otto has joined #openstack-infra | 17:01 | |
| *** tmorin has quit IRC | 17:01 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config master: fix branch filtering for nova-net https://review.openstack.org/438621 | 17:02 |
| *** dizquierdo has quit IRC | 17:02 | |
| *** mixos has joined #openstack-infra | 17:02 | |
| *** dimtruck is now known as zz_dimtruck | 17:04 | |
| *** claudiub has quit IRC | 17:04 | |
| *** zz_dimtruck is now known as dimtruck | 17:04 | |
| *** mdrabe has quit IRC | 17:05 | |
| clarkb | AJaeger: does the user/key data set at https://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n1571 run any scripts on the translation server itself? | 17:05 |
| *** rajinir_ has joined #openstack-infra | 17:06 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate master: Add testr slowest to the end of the test run https://review.openstack.org/438624 | 17:06 |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config master: fix branch filtering for nova-net https://review.openstack.org/438621 | 17:09 |
| openstackgerrit | Terry Wilson proposed openstack-infra/project-config master: Add ovsdbapp project https://review.openstack.org/438080 | 17:11 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Add puppetry for translate01 xenialing https://review.openstack.org/438629 | 17:11 |
| clarkb | ok I think those are the changes I need, will let CI and humans look at those for a bit then set up hiera and backups and things and hopefully get the ball rolling this morning | 17:12 |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config master: fix branch filtering for nova-net https://review.openstack.org/438621 | 17:12 |
| *** mhickey has quit IRC | 17:12 | |
| *** mdrabe has joined #openstack-infra | 17:13 | |
| *** matrohon has quit IRC | 17:14 | |
| *** trown is now known as trown|lunch | 17:15 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add backups to translate server https://review.openstack.org/438602 | 17:15 |
| *** david-lyle has joined #openstack-infra | 17:17 | |
| *** bnemec has joined #openstack-infra | 17:17 | |
| *** Swami has joined #openstack-infra | 17:19 | |
| *** esikachev has quit IRC | 17:19 | |
| *** nadya has quit IRC | 17:20 | |
| *** Apoorva has joined #openstack-infra | 17:20 | |
| *** nadya has joined #openstack-infra | 17:20 | |
| *** Apoorva has quit IRC | 17:20 | |
| *** david-lyle has quit IRC | 17:21 | |
| *** vhosakot has joined #openstack-infra | 17:21 | |
| *** thorst has quit IRC | 17:22 | |
| *** smarcet has quit IRC | 17:22 | |
| sdague | clarkb / fungi / AJaeger we missed a thing in the nnet rename - https://review.openstack.org/438621 | 17:22 |
| *** thorst has joined #openstack-infra | 17:22 | |
| *** Apoorva has joined #openstack-infra | 17:23 | |
| *** nadya has quit IRC | 17:25 | |
| *** mhickey has joined #openstack-infra | 17:27 | |
| mtreinish | fungi, clarkb, jeblair: is there anyway to see how long the running job on 438078 has been running? From the telnet it's hard to tell if it hit the ssh failure or it's just being slow | 17:28 |
| jeblair | mtreinish: status page? | 17:29 |
| jeblair | mtreinish: mouseover the progress bar? | 17:29 |
| *** jpich has quit IRC | 17:29 | |
| jeblair | mtreinish: i see "02:22:10 elapsed" | 17:30 |
| mtreinish | jeblair: oh, I didn't ever notice it did that | 17:30 |
| jeblair | ui testing ftw :) | 17:30 |
| jeblair | that's elapsed time and estimated time remaining (based on historical runs) | 17:31 |
| clarkb | pabelanger: fungi https://review.openstack.org/#/c/438629/ should be ready for review as well. I need to do a few morning things but then will return to finish backups setup and hiera setup for 438629 | 17:31 |
| clarkb | then hopefully can run a db backup on translate proper, and boot new xenial translate01.openstack.org this afternoon | 17:31 |
| mtreinish | jeblair: ok thanks. I still can't confirm it hit the sleep(almost forever) on ssh failure, and that we should hold the node. Because tests in 1 worker are still printing results :/ | 17:33 |
| pabelanger | clarkb: ack, +2 | 17:33 |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config master: Add swift func test job to run on centos https://review.openstack.org/436632 | 17:34 |
| *** jamespage has quit IRC | 17:34 | |
| *** jamespage has joined #openstack-infra | 17:36 | |
| clarkb | pabelanger: tyty | 17:40 |
| *** yamamoto has joined #openstack-infra | 17:40 | |
| *** marst has joined #openstack-infra | 17:43 | |
| pabelanger | clarkb: I'd like to land https://review.openstack.org/#/c/438490/ again today, but breaks our zuulv3-dev.o.o testing. I think mordred and jeblair had an idea of the fix, but also want them to confirm first too. | 17:43 |
| pabelanger | implement some sort of server Id for nodepool | 17:43 |
| pabelanger | IIRC | 17:44 |
| *** david-lyle has joined #openstack-infra | 17:44 | |
| clarkb | pabelanger: ok, so wait on their input? | 17:44 |
| openstackgerrit | Merged openstack-infra/project-config master: fix branch filtering for nova-net https://review.openstack.org/438621 | 17:44 |
| *** mhickey has quit IRC | 17:44 | |
| pabelanger | clarkb: Ya, lets confirm they are okay with it, but wanted to ping you about it | 17:44 |
| *** david-lyle has quit IRC | 17:45 | |
| *** yamamoto has quit IRC | 17:46 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add puppetry for translate01 xenialing https://review.openstack.org/438629 | 17:46 |
| *** david-lyle has joined #openstack-infra | 17:46 | |
| clarkb | pabelanger: my suggestion would be to put chocolate back into use in production, reduce its max servers by ~10. Then set up nodepool and zuul dev servers with a different provider name and just have it upload a new image for xenail and a max servers of 10 there | 17:46 |
| clarkb | pabelanger: wasn't the only problem that we couldn't use existing images? | 17:46 |
| *** derekh has quit IRC | 17:47 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: upgrade jobs: execute stable pingtest (and not master) https://review.openstack.org/438642 | 17:47 |
| clarkb | and it should be able to share the same zookeeper install as long as the nodepool.yaml for the producton side doesn't have the new provider name | 17:47 |
| pabelanger | clarkb: yes, a provider name change means we also need a nodepool-launcher now | 17:47 |
| pabelanger | so, if we want to go that route, I am okay. | 17:47 |
| clarkb | ya just thinking thats how its built to be multi tenant today | 17:47 |
| clarkb | so we may as well give it a go | 17:48 |
| mordred | pabelanger: yah - implemented some sort of server id is where I think we agreed on | 17:48 |
| pabelanger | but we did talk about sharing a project between 2 nodepool(-launchers) might be a good thing to do too | 17:48 |
| mordred | pabelanger: but as a very simple config file addition that is empty is not given | 17:48 |
| *** e0ne has joined #openstack-infra | 17:48 | |
| pabelanger | mordred: yes, that is how I remember it too | 17:49 |
| mordred | so the value will be added to a key in the nodepool server metadata if given in the config, and if the value is in the config then that key must match | 17:49 |
| mordred | pabelanger: ++ | 17:49 |
| mordred | pabelanger: I think it's both simple and non-invasive | 17:49 |
| *** earlephilhower has joined #openstack-infra | 17:49 | |
| AJaeger | clarkb: I don't enough about the Zanata setup to help you on that. StevenK might know more | 17:50 |
| clarkb | AJaeger: ok thanks, I will dig more. | 17:50 |
| clarkb | AJaeger: I think its just setting up the user that proposal.slave.openstack.org then uses to do its things but want ot make sure and htought you may know | 17:50 |
| AJaeger | clarkb: that looks like it - but I don't know much about this. | 17:52 |
| *** jordanP has quit IRC | 17:53 | |
| sdague | clarkb / mordred - https://review.openstack.org/#/c/438566/ this will help handle a scenario where there was no local|localrc section in local.conf | 17:54 |
| *** baoli has quit IRC | 17:54 | |
| sdague | and get some 3rd party CI systems working a bit better | 17:54 |
| *** chlong has quit IRC | 17:55 | |
| *** sandanar has joined #openstack-infra | 17:56 | |
| *** john-dav_ has quit IRC | 17:56 | |
| *** john-davidge has joined #openstack-infra | 17:56 | |
| *** baoli has joined #openstack-infra | 17:57 | |
| *** hashar has quit IRC | 17:58 | |
| *** david-lyle has quit IRC | 17:58 | |
| *** dtantsur is now known as dtantsur|afk | 17:58 | |
| *** aarefiev is now known as aarefiev_afk | 18:00 | |
| *** baoli has quit IRC | 18:00 | |
| *** nadya has joined #openstack-infra | 18:01 | |
| *** david-lyle has joined #openstack-infra | 18:01 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Plumb job variables through to ansible https://review.openstack.org/438653 | 18:02 |
| openstackgerrit | James E. Blair proposed openstack/boartty master: Fix keypress handling on board view https://review.openstack.org/438654 | 18:02 |
| openstackgerrit | James E. Blair proposed openstack/boartty master: Make board view easier to read https://review.openstack.org/438655 | 18:02 |
| *** sshnaidm is now known as sshnaidm|off | 18:02 | |
| jeblair | SpamapS, Zara: ^ some plane hacking | 18:03 |
| Zara | oh, boartty things! | 18:03 |
| Zara | yay! | 18:03 |
| jeblair | you can now click on items in the board view and follow through to their story | 18:03 |
| jeblair | can't modify the board yet | 18:03 |
| jeblair | also, i'm pretty sure some random things are showing up on my board; haven't looked into why | 18:04 |
| Zara | huh, that's concerning | 18:04 |
| Zara | I'll take a look at those, anyway | 18:04 |
| jeblair | s/click on/select/ :) | 18:04 |
| dhellmann | is anyone else having trouble accessing etherpad.o.o? I get "Service Unavailable" | 18:04 |
| Zara | (your plane ride was more productive than mine; I just tried and failed to sleep for 8 hours) | 18:04 |
| *** jaosorior has quit IRC | 18:05 | |
| Zara | dhellmann: same here | 18:05 |
| mordred | dhellmann: I concur | 18:05 |
| clarkb | pabelanger: ^ | 18:05 |
| * dhellmann no longer feels alone | 18:05 | |
| jeblair | hrm. there are many open slots. | 18:05 |
| *** csomerville has quit IRC | 18:05 | |
| jeblair | on etherpad. | 18:05 |
| SpamapS | jeblair: I was just about to go add 'edit tags' to the story screen. ;-) | 18:05 |
| mordred | node doesn't seem particularly stressed out either | 18:05 |
| jeblair | SpamapS: ++ | 18:06 |
| pabelanger | clarkb: dhellmann looking | 18:06 |
| dhellmann | pabelanger : thanks | 18:06 |
| pabelanger | Oh | 18:06 |
| pabelanger | related to my work | 18:06 |
| pabelanger | 1 sec | 18:06 |
| mariojv | dhellmann: ++, same from others in ironic channel | 18:06 |
| *** sshnaidm|off has quit IRC | 18:07 | |
| pabelanger | dhellmann: clarkb: fixed. Apologies, I filled the HDD | 18:07 |
| dhellmann | pabelanger : np, thanks for the quick fix | 18:07 |
| *** baoli has joined #openstack-infra | 18:08 | |
| mordred | pabelanger: I agree - it is fixed | 18:08 |
| pabelanger | I'm now restoring backups to /opt directory | 18:08 |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config master: [magnum] Run trusty jobs only for stable/mitaka https://review.openstack.org/438584 | 18:08 |
| *** baoli has quit IRC | 18:09 | |
| *** lucasagomes is now known as lucas-afk | 18:09 | |
| clarkb | pabelanger: that might be worth a docs update "restore to fs with all the disk" | 18:10 |
| *** chlong has joined #openstack-infra | 18:10 | |
| pabelanger | clarkb: ++ | 18:11 |
| AJaeger | strigazi: what problem exactly are you trying to fix? Do you have a reference to a change that shows wrong behaviour? | 18:13 |
| *** isaacb has quit IRC | 18:14 | |
| AJaeger | fungi, thanks for checking the trove/db job changes. I'll ping amrith now, he wanted to look at trove's stable/newton branch and fix it... | 18:15 |
| *** user` has joined #openstack-infra | 18:17 | |
| *** user` has left #openstack-infra | 18:17 | |
| *** salv-orl_ has joined #openstack-infra | 18:18 | |
| *** skelso has quit IRC | 18:18 | |
| *** _ody has quit IRC | 18:18 | |
| *** skelso has joined #openstack-infra | 18:18 | |
| strigazi | AJaeger I replied in the review, I want to catch gate-functional-dsvm-magnum-api-identity-v3-only-ubuntu-trusty-nv too | 18:19 |
| *** baoli has joined #openstack-infra | 18:20 | |
| *** salv-orlando has quit IRC | 18:20 | |
| AJaeger | strigazi: just answered. IMHO that job should never run at all ;) | 18:21 |
| AJaeger | strigazi: just remove it. It was an error to define the trusty variant | 18:21 |
| AJaeger | v3 testing on mitaka is really not beneficial. | 18:21 |
| *** tosky has quit IRC | 18:22 | |
| strigazi | AJaeger ok, I'll remove all regex for trusty and mitaka and I'll remove the trusty v3 job too. Sounds good? | 18:22 |
| AJaeger | strigazi: sounds fine. Thanks | 18:23 |
| sdague | jeblair: could I get you to +3 on https://review.openstack.org/#/c/438566/ - brings in a devstack-tools bugfix that should make things better for folks transitioning | 18:24 |
| strigazi | AJaeger ok, thanks Andreas | 18:24 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Plumb job variables through to ansible https://review.openstack.org/438653 | 18:24 |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/438360 | 18:24 |
| *** _ody has joined #openstack-infra | 18:24 | |
| jeblair | sdague: certainly | 18:25 |
| sdague | jeblair: thanks | 18:25 |
| *** sandanar has quit IRC | 18:26 | |
| *** sandanar has joined #openstack-infra | 18:26 | |
| *** armax has joined #openstack-infra | 18:28 | |
| SpamapS | jeblair: hrm.. tags are.. complicated. :-P | 18:30 |
| *** yamahata_ has quit IRC | 18:32 | |
| openstackgerrit | Spyros Trigazis proposed openstack-infra/project-config master: [magnum] Remove trusty regex for stable/mitaka https://review.openstack.org/438584 | 18:33 |
| openstackgerrit | Sorin Sbârnea proposed openstack-infra/git-review master: Support usernames that contain '@' and ssh Git URLs https://review.openstack.org/428700 | 18:34 |
| *** smarcet has joined #openstack-infra | 18:36 | |
| *** baoli has quit IRC | 18:36 | |
| *** sshnaidm|off has joined #openstack-infra | 18:37 | |
| *** baoli has joined #openstack-infra | 18:37 | |
| *** baoli has quit IRC | 18:39 | |
| *** baoli has joined #openstack-infra | 18:39 | |
| *** yamamoto has joined #openstack-infra | 18:42 | |
| *** sshnaidm|off is now known as sshnaidm | 18:43 | |
| *** dharinic is now known as dharinic|lunch | 18:43 | |
| *** jkilpatr has quit IRC | 18:45 | |
| *** smarcet has quit IRC | 18:45 | |
| *** mtanino has joined #openstack-infra | 18:46 | |
| *** yamamoto has quit IRC | 18:46 | |
| *** dhinesh has joined #openstack-infra | 18:46 | |
| *** maratoid_ has joined #openstack-infra | 18:47 | |
| *** maratoid_ has quit IRC | 18:47 | |
| *** baoli has quit IRC | 18:48 | |
| *** baoli has joined #openstack-infra | 18:50 | |
| *** baoli has quit IRC | 18:50 | |
| *** amotoki has joined #openstack-infra | 18:52 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Switch from lib/neutron-legacy to lib/neutron https://review.openstack.org/436798 | 18:52 |
| *** abregman has joined #openstack-infra | 18:53 | |
| *** amotoki has quit IRC | 18:53 | |
| *** amotoki has joined #openstack-infra | 18:53 | |
| *** rossella_s has quit IRC | 18:53 | |
| openstackgerrit | Merged openstack-infra/project-config master: [magnum] Remove trusty regex for stable/mitaka https://review.openstack.org/438584 | 18:53 |
| *** rossella_s has joined #openstack-infra | 18:54 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Plumb job variables through to ansible https://review.openstack.org/438653 | 18:55 |
| *** yamahata_ has joined #openstack-infra | 18:58 | |
| *** pots has joined #openstack-infra | 18:59 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config master: Add swift func test job to run on centos https://review.openstack.org/436632 | 18:59 |
| *** jkilpatr has joined #openstack-infra | 19:00 | |
| tdasilva | AJaeger: thanks for the review, I also removed the list for the envlist ^^^ | 19:00 |
| AJaeger | tdasilva: let me check... | 19:00 |
| AJaeger | yep, looks fine now | 19:00 |
| tdasilva | AJaeger: thank you! :) | 19:00 |
| *** timello has quit IRC | 19:00 | |
| *** baoli has joined #openstack-infra | 19:00 | |
| *** sambetts is now known as sambetts|afk | 19:01 | |
| *** csomerville has joined #openstack-infra | 19:01 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add gate-tripleo-ci-centos-7-ovb-updates into promotion pipeline https://review.openstack.org/433796 | 19:01 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Add translate ansible group https://review.openstack.org/438674 | 19:04 |
| *** xyang1 has quit IRC | 19:04 | |
| clarkb | pabelanger: fungi ^ sorry I always miss that portion of the change | 19:04 |
| clarkb | oh and I missed the vhost setting | 19:04 |
| *** beslemon_ has quit IRC | 19:04 | |
| *** xyang1 has joined #openstack-infra | 19:04 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Publish python-linters jobs to apache https://review.openstack.org/437938 | 19:05 |
| clarkb | this is what happens when you review your own code :/ | 19:05 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Set vhost name on translate\d+ properly https://review.openstack.org/438675 | 19:05 |
| clarkb | there we go | 19:05 |
| *** shardy is now known as shardy_afk | 19:07 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Switch from lib/neutron-legacy to lib/neutron https://review.openstack.org/436798 | 19:07 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Create python-linters job https://review.openstack.org/437059 | 19:10 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Copy logs to launcher https://review.openstack.org/437700 | 19:11 |
| *** timello has joined #openstack-infra | 19:11 | |
| harlowja | mordred does shade do keystone token caching/reuse? (if u remember) | 19:12 |
| harlowja | is there anything special needed to enable that (so that it works) | 19:12 |
| mordred | harlowja: it depends on what you mean by that | 19:12 |
| harlowja | well we haven't switched off uuid tokens yet (i know) | 19:12 |
| mordred | harlowja: if you mean across process boundaries - no. if you mean within a process, yes | 19:12 |
| harlowja | ya, outside process boundaries | 19:12 |
| *** e0ne has quit IRC | 19:12 | |
| SpamapS | jeblair: reading boartty's use of tags.. does not match up with https://docs.openstack.org/infra/storyboard/webapi/v1.html .. ? | 19:13 |
| mordred | nope. we do not currently have any support for this thing of which you speak | 19:13 |
| harlowja | okies, though the caching stuff might do it, but i guess not | 19:13 |
| *** trown|lunch is now known as trown | 19:13 | |
| harlowja | *thought | 19:13 |
| SpamapS | mordred: you sure? | 19:13 |
| SpamapS | mordred: doesn't it use keystoneauth? | 19:13 |
| mordred | harlowja: not atm - it shouldn't be terribly hard to add support | 19:13 |
| *** pvaneck has joined #openstack-infra | 19:14 | |
| harlowja | ya, this is where i thought some internals of keystoneauth might do it | 19:14 |
| mordred | SpamapS: it does | 19:14 |
| mordred | SpamapS: doesn't caching of tokens in keystoneauth need to be enabled/configured? | 19:14 |
| *** MasterOfBugs has joined #openstack-infra | 19:14 | |
| SpamapS | mordred: it does, I'm reading code now instead of reading my terrible memory | 19:14 |
| *** pramodrj07 has joined #openstack-infra | 19:14 | |
| *** florianf has quit IRC | 19:15 | |
| mordred | awesome. happy to enable shade to enable ksa to do the thing it does if that is needed | 19:15 |
| harlowja | cool beans | 19:15 |
| SpamapS | in fact, it doesn't do any caching itself | 19:15 |
| SpamapS | it only provides a stable cache keying method | 19:16 |
| mordred | it seems to have support for letting auth plugins do so | 19:16 |
| mordred | yah | 19:16 |
| mordred | so we'd need to add code shade-side | 19:16 |
| mordred | harlowja: how painful is lack of token caching for you? | 19:16 |
| SpamapS | but shade's caching is very capable of out of process cache | 19:16 |
| SpamapS | so that should be relatively straight forward | 19:16 |
| mordred | oh yeah | 19:16 |
| harlowja | we have some people mordred that arent caching tokens, (including the openstack team, lol) | 19:16 |
| mordred | shade can _definitely_ handle it - as soon as it's written :) | 19:16 |
| *** gyee has joined #openstack-infra | 19:17 | |
| mordred | harlowja: well, fwiw, I've never cached tokens in my 5+ years of consuming openstack apis | 19:17 |
| harlowja | :-P | 19:17 |
| harlowja | u are naughty | 19:17 |
| mordred | harlowja: nor has nodepool with it's 20k servers a day | 19:17 |
| harlowja | :) | 19:17 |
| harlowja | ya | 19:17 |
| harlowja | point taken :) | 19:17 |
| clarkb | mordred: thats not entirely true. nodepool via shade via ksa will use a single token to boot servers until that token expires | 19:17 |
| clarkb | mordred: and since its single process thats fine | 19:18 |
| mordred | clarkb: yes - but it will not cache it across process boundaries | 19:18 |
| mordred | clarkb: so - good point | 19:18 |
| clarkb | right but effectively it has not mattered | 19:18 |
| mordred | ++ | 19:18 |
| clarkb | we aren't hammering the cluds with many token requests | 19:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Create provider 'launcher-id' setting https://review.openstack.org/438677 | 19:18 |
| clarkb | and even as we go multiprocess, because we will do cloud per process this doesn't change | 19:18 |
| *** matrohon has joined #openstack-infra | 19:19 | |
| SpamapS | also confirmed that in a single process, shade does cache the keystone session object | 19:20 |
| harlowja | right, thx SpamapS | 19:20 |
| SpamapS | self._keystone_session = self.cloud_config.get_session() | 19:20 |
| *** amotoki has quit IRC | 19:20 | |
| SpamapS | I wonder if os_client_config could make this happen | 19:20 |
| * SpamapS ignores the yaks protests and attaches a #2 guard... | 19:21 | |
| clarkb | this is also the benefit to using mordred's python repl shade client method of cloud interaction over `openstack` | 19:21 |
| clarkb | but `openstack` has its own repl now I just have to remember to use it | 19:21 |
| harlowja | ya, i guess the point is that most clients prob aren't doing this right, so even if shade fixes it, the 100 other clients prob wont , lol | 19:22 |
| *** liusheng has quit IRC | 19:22 | |
| *** mhickey has joined #openstack-infra | 19:22 | |
| mordred | yup. it's best to fix cloud so that it's not a problem :) | 19:22 |
| sc` | AJaeger: i think we (chef) will be fine without stable/mitaka being tested against. after all, mitaka is EOL eventually. i don't think the periodics will be going away, save the trusty holdout | 19:22 |
| *** liusheng has joined #openstack-infra | 19:23 | |
| SpamapS | oh lovely, we could probably drop shade's in-memory caching of the session object | 19:23 |
| SpamapS | because os_client_config does _exactly_ the same thing | 19:23 |
| clarkb | pabelanger: can you review https://review.openstack.org/#/c/438675/1 and its parent? related to earlier zanat change. thanks | 19:23 |
| mordred | SpamapS: oh - indeed we do | 19:23 |
| *** annegentle has joined #openstack-infra | 19:23 | |
| mordred | SpamapS: yah - that's probably fairly safe for cleanup | 19:23 |
| *** electrofelix has quit IRC | 19:25 | |
| clarkb | pabelanger: thanks | 19:27 |
| *** e0ne has joined #openstack-infra | 19:27 | |
| *** pcaruana has quit IRC | 19:29 | |
| *** sshnaidm is now known as sshnaidm|afk | 19:31 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add translate ansible group https://review.openstack.org/438674 | 19:31 |
| *** sandanar has quit IRC | 19:33 | |
| *** yamahata_ has quit IRC | 19:33 | |
| openstackgerrit | Merged openstack-infra/system-config master: Set vhost name on translate\d+ properly https://review.openstack.org/438675 | 19:34 |
| *** Gorian- is now known as Gorian | 19:34 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add nodepool-id to provider section https://review.openstack.org/438677 | 19:34 |
| *** e0ne has quit IRC | 19:34 | |
| *** claudiub has joined #openstack-infra | 19:35 | |
| *** sdake has quit IRC | 19:36 | |
| *** earlephilhower has quit IRC | 19:36 | |
| *** vhosakot has quit IRC | 19:36 | |
| *** nadya has quit IRC | 19:38 | |
| SpamapS | harlowja: question about caching tokens in shade.. | 19:41 |
| SpamapS | harlowja: as I've shorn this yak, I figure I might as well make a sweater... ;) | 19:41 |
| harlowja | ? | 19:41 |
| SpamapS | harlowja: with everything else shade caches.. if you have a bunch of processes sharing a cache, you kind of have to assume they all have the same user.. or hell breaks loose. | 19:41 |
| harlowja | i get a sweater to | 19:41 |
| SpamapS | harlowja: but if you put tokens in there.. now it goes from "all hell breaks loose" to ".. and possesses you." because now access to the cache == access to the credentials. | 19:42 |
| harlowja | ya, fair enough | 19:42 |
| *** yamamoto has joined #openstack-infra | 19:42 | |
| SpamapS | If it's a file on disk, that's NBD | 19:42 |
| SpamapS | but I get a sense some shade users make it a memcached. | 19:43 |
| harlowja | ya, my takeaway is move to fernet | 19:43 |
| harlowja | lol | 19:43 |
| SpamapS | oh you haven't yet? | 19:43 |
| harlowja | :) | 19:43 |
| harlowja | correct-o | 19:43 |
| SpamapS | http://i.gifntext.com/42604-what-are-you-waiting-for-huh.gif | 19:44 |
| harlowja | ya ya | 19:44 |
| mordred | SpamapS: that's an excellent point - and an excellent reason why shade maynot want to add that feature | 19:44 |
| mordred | SpamapS: thank you - I hadn't gotten all the way there in my brainhole yet | 19:44 |
| SpamapS | mordred: well I was thinking we might want to make them separate cache regions. | 19:44 |
| *** Rockyg has joined #openstack-infra | 19:45 | |
| mordred | SpamapS: we might - but it's still an area where we'd be caching credentials so want to think long and hard before making it super easy for users to footgun | 19:45 |
| SpamapS | well technically it's caching ephemeral, revokable tokens.. so it's only a 0.22 footgun. ;) | 19:46 |
| SpamapS | but still smarts | 19:46 |
| harlowja | 0.22 or bb gun? | 19:47 |
| harlowja | i'd say bb gun | 19:47 |
| *** yamamoto has quit IRC | 19:48 | |
| SpamapS | Def a 0.22. You can still lose a toe (data). | 19:48 |
| harlowja | but can u die from it? | 19:48 |
| harlowja | 0.22 u can still die lol | 19:48 |
| harlowja | bb, u can maybe lose an eye | 19:48 |
| harlowja | come on fellow americans, know your guns | 19:49 |
| harlowja | lol | 19:49 |
| *** dharinic|lunch is now known as dharinic | 19:49 | |
| SpamapS | ಠ_ಠ| 19:49 |
| *** hashar has joined #openstack-infra | 19:52 | |
| *** pt_15 has quit IRC | 19:55 | |
| *** trown is now known as trown|brb | 19:56 | |
| harlowja | SpamapS perhaps idea is that we should just not have a mailing list (per-project thread) | 20:00 |
| *** adrian_otto has quit IRC | 20:00 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fixed RSVP external serialization https://review.openstack.org/438685 | 20:01 |
| *** lin_yang has joined #openstack-infra | 20:01 | |
| SpamapS | harlowja: I think it's mostly Stockholm syndrome at this point. | 20:07 |
| harlowja | well why not reconsider the whole thing that is a mailing list? | 20:08 |
| harlowja | might as well go full abomb | 20:08 |
| harlowja | lol | 20:08 |
| SpamapS | http://wp.streetwise.co/wp-content/uploads/2016/08/ThisIsFineComicThumbnail1-630x227.png | 20:08 |
| *** trown|brb is now known as trown | 20:08 | |
| harlowja | we should just all use twitter and facebook | 20:08 |
| harlowja | lol | 20:08 |
| harlowja | and instagram | 20:08 |
| harlowja | just like the prez | 20:08 |
| harlowja | all discussions must be via memes only? | 20:09 |
| harlowja | perhaps if people can't group emails by themselves, we should just group them for them in some kind of UI ? | 20:10 |
| *** baoli has quit IRC | 20:10 | |
| SpamapS | harlowja: the problem isn't the grouping of the reading. It's the grouping of the replying. | 20:10 |
| *** knangia has quit IRC | 20:10 | |
| harlowja | i mean, if people like fungi or u or others have nice filters and stuff setup, get someone to make a UI that is equivalent (to a degree) to the UI u have that does the grouping, the putting things together nicely... | 20:11 |
| jeblair | ping me when we have realized all our problems are already solved by nntp. :) | 20:11 |
| harlowja | lol | 20:11 |
| SpamapS | jeblair: oh we got there fast at the swg room. :) | 20:11 |
| SpamapS | Probably just in time for Thunderbird to drop NNTP right? ;) | 20:11 |
| openstackgerrit | Merged openstack-infra/project-config master: Add recheck support to zuul.yaml https://review.openstack.org/436195 | 20:11 |
| *** salv-orl_ has quit IRC | 20:12 | |
| harlowja | ya, i think twitter | 20:12 |
| harlowja | all emails must be <= 150 chars | 20:12 |
| harlowja | lol | 20:12 |
| SpamapS | let's compromise in the middle. So, what's in between 150 and 150,000 ... | 20:13 |
| harlowja | to much | 20:13 |
| *** baoli has joined #openstack-infra | 20:14 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Switch from lib/neutron-legacy to lib/neutron https://review.openstack.org/436798 | 20:14 |
| *** yamahata_ has joined #openstack-infra | 20:14 | |
| fungi | fwiw i don't really "filter" my openstack mailing lists into separate maildirs... mutt makes sifting through a few hundred messages a day on that list fine (in fact, i deliver the docs, i18n, et cetera threads all into one box so i can more easily collapse duplicate messages and cross-posted threads) | 20:15 |
| harlowja | fungi ya, i remember ye olde etherpad where we listed all that down | 20:15 |
| jeblair | SpamapS: but in all seriousness, i like your "lets agree on defining problems" approach. | 20:16 |
| fungi | all into one box along with the dev ml i mean | 20:16 |
| harlowja | i mean, maybe its just a UI problem, idk | 20:16 |
| harlowja | in that we need to force a UI, lol | 20:16 |
| fungi | harlowja: thank you! there was an etherpad... i was trying to remember where that discussion went :/ | 20:16 |
| harlowja | some etherpad i forget | 20:16 |
| harlowja | lol | 20:16 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Add nodepool-id to provider section https://review.openstack.org/438677 | 20:17 |
| harlowja | fungi https://etherpad.openstack.org/p/how-people-read-the-ml | 20:17 |
| harlowja | SpamapS ^ | 20:17 |
| fungi | yup, that'un | 20:17 |
| *** baoli has quit IRC | 20:19 | |
| SpamapS | jeblair: Thanks. It's clear now that in a small room, we agreed on a problem for a small set of us and projected it onto the rest of the community without asking. | 20:19 |
| SpamapS | fungi: my sup workflow is similar to your mutt workflow. I have everything in one folder too. And I actually view it all in-line with my inbox sometimes so I get a clear timeline with other things. | 20:20 |
| *** esikachev has joined #openstack-infra | 20:21 | |
| Rockyg | I'm stuck with Msoft outlook, so I have a folder for dev and one for reviews and rely on how it threads. and separate from work email | 20:22 |
| Rockyg | I like the archives options. I would be nice to be able to respond to an email thread from that intercae. | 20:22 |
| clarkb | Rockyg: cant you subscribe using another provider and use eg imap? | 20:23 |
| Rockyg | But, boy, would that make things messy | 20:23 |
| Rockyg | Can't get to my other mailboxes from inside our firewall. So, I either get OS emails or work emails. | 20:23 |
| Rockyg | Gonna try to fix some of that in my new role | 20:24 |
| fungi | i similarly wish i could divine the message-id from pipermail's interface so i could compose a properly-threaded reply without having to download the mbox copy and fish it out of there | 20:24 |
| clarkb | Rockyg: ime corps usually have proxies that allow things through | 20:24 |
| clarkb | while firewall is default no | 20:24 |
| Rockyg | Also, our gatgeway drops email and has a bad spam filter, so I just subscribe to digest outside in case I miss something. Delete as I get through the stack. | 20:25 |
| *** esikachev has quit IRC | 20:26 | |
| Rockyg | Hah. But I'll look. remember, I work for a paranoid company (with good reason for some of it) | 20:26 |
| Rockyg | my company bans "social media" except linked in, and some youtube | 20:26 |
| Rockyg | no google docs | 20:26 |
| Rockyg | but, I think we get google docs through our vpn when I'm in china go figure | 20:27 |
| *** baoli has joined #openstack-infra | 20:29 | |
| Rockyg | fungi, just saw what you wrote...++ that would be great. | 20:32 |
| *** esikachev has joined #openstack-infra | 20:32 | |
| *** ccamacho has quit IRC | 20:33 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Undercloud containers job with tripleo.sh https://review.openstack.org/437411 | 20:34 |
| *** salv-orlando has joined #openstack-infra | 20:39 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Switch from lib/neutron-legacy to lib/neutron https://review.openstack.org/436798 | 20:39 |
| amrith | clarkb, fungi as discussed in atlanta, please see https://review.openstack.org/#/c/438668/1 | 20:39 |
| amrith | I can't (it appears) depend on this change and test trove; this change will have to merge before I can get to test it in Trove. | 20:41 |
| amrith | clarkb, fungi please see https://review.openstack.org/#/c/438664/; you'll see from http://logs.openstack.org/64/438664/2/check/gate-trove-scenario-dsvm-mysql-single-ubuntu-xenial/1b86cbc/logs/devstack-early.txt.gz#_2017-02-27_18_46_50_401 that the effects of the devstack change haven't been reflected there. | 20:42 |
| fungi | SpamapS: granted, the irony of the selection bias here is not lost on me (asking people who successfully follow threads on that mailing list whether they're able to ...) | 20:42 |
| amrith | clarkb, fungi so whatever the mechanism is to merge this into devstack and propagate to the other projects will be required to happen before I can validate more. thx! | 20:43 |
| *** yamamoto has joined #openstack-infra | 20:44 | |
| fungi | amrith: yes, that's pretty awesome. i think mordred definitely needs to have a look over it, as do the devstack maintainers on the qa team | 20:44 |
| * mordred looks | 20:44 | |
| mordred | that change does not load well with a ; after it :) | 20:44 |
| fungi | heh | 20:45 |
| mordred | oh. bwhahaha. I just loaded the trove testing change | 20:45 |
| mordred | and was like "wow, I'm not sure why this is a topic of discussion" | 20:45 |
| mordred | *headdesk* | 20:45 |
| fungi | third time's a charm? | 20:45 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 20:45 |
| *** dangers_away has quit IRC | 20:46 | |
| clarkb | amrith: looks like the "default" tempest job failed | 20:46 |
| mordred | yah. I was just about to say that | 20:46 |
| mordred | otherwise, it looks good | 20:46 |
| *** askb has joined #openstack-infra | 20:46 | |
| * clarkb grabs the hiera lock | 20:46 | |
| mordred | 2017-02-27 19:46:13.075510 | Details: {u'message': u"Cannot 'detach_volume' instance 16f273ad-f7c8-4d11-a023-344b43797ae1 while it is in vm_state error", u'code': 409} | 20:47 |
| mordred | it seems like the 'normal' volume detach race bug | 20:47 |
| amrith | clarkb, mordred I saw that but can't fathom why that would be related to tweaking mysql. so I gave it the 'one ping' | 20:47 |
| *** dangers has joined #openstack-infra | 20:47 | |
| *** dave-mccowan has quit IRC | 20:47 | |
| *** adriant has joined #openstack-infra | 20:47 | |
| mordred | hrm. that one does fail both times - I wonder if maybe the cinder race is somehow related to mysql performance. why do I get the hunch this rabbit hole is going to get "fun" | 20:48 |
| tonyb | Qiming, sfinucan: Yeah the Sphinix situation is a mess right now we'll try to fix PBR and get that out this week :( | 20:48 |
| clarkb | ok releasing hiera lock | 20:48 |
| amrith | mordred, clarkb https://www.youtube.com/watch?v=jr0JaXfKj68 | 20:48 |
| *** yamamoto has quit IRC | 20:49 | |
| clarkb | fungi: pabelanger mordred I am going to set up translate.o.o backups now. Then manually run the mysqldump then manually run the bup command to get a head start on making sure it all works | 20:49 |
| clarkb | rather than wait for the daily update | 20:50 |
| *** ccamacho has joined #openstack-infra | 20:50 | |
| *** ccamacho has left #openstack-infra | 20:50 | |
| ihrachys | would anyone help to get https://review.openstack.org/#/c/433828/ in? it's to enable recheck irc bot for neutron | 20:51 |
| mordred | clarkb: kk | 20:51 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Undercloud containers job with tripleo.sh https://review.openstack.org/437411 | 20:51 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: bump dstools to 0.3.0 https://review.openstack.org/438566 | 20:51 |
| pabelanger | clarkb: ack | 20:51 |
| *** jkilpatr has quit IRC | 20:52 | |
| *** rcernin has joined #openstack-infra | 20:52 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bup master: Exclude /var/lib/puppet/reports/ from backups https://review.openstack.org/438697 | 20:54 |
| pabelanger | clarkb: ^something I noticed in the tarball | 20:55 |
| pabelanger | clarkb: also, we should consider dropping the /opt folder | 20:55 |
| pabelanger | on etherpad.o.o it is just git folders | 20:55 |
| ihrachys | pabelanger: yolanda: AJaeger: https://review.openstack.org/#/c/433828/ could you help? | 20:56 |
| pabelanger | clarkb: and /var/cache/ too | 20:56 |
| clarkb | pabelanger: I think the touble with that is we use /opt in other places for data we likely want to backup like gerrit's git repos | 20:56 |
| pabelanger | we have .deb files | 20:56 |
| clarkb | pabelanger: but good idea on /var/cache and puppet reports | 20:56 |
| *** Guest11443 is now known as mgagne | 20:57 | |
| *** mgagne has quit IRC | 20:57 | |
| *** mgagne has joined #openstack-infra | 20:57 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bup master: Don't back cache files in /var/cache/ https://review.openstack.org/438699 | 20:57 |
| pabelanger | clarkb: O | 20:57 |
| pabelanger | err | 20:57 |
| pabelanger | I'll have to check gerrit and see what is in /opt | 20:58 |
| clarkb | ok I have backups configured. Going to run mysql dump now, then bup in screen on translate.o.o to get a jump start on this process | 20:58 |
| clarkb | once thats sorted out my next step will be to boot replacement server | 20:58 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bup master: Don't backup /opt/system-config since it is a git repo https://review.openstack.org/438700 | 20:58 |
| clarkb | pabelanger: ^ I think being specific like that is fine | 20:59 |
| jeblair | fungi: apparently the message-id is included in the mailto: link in pipermail; i'm not sure if you have a way of extracting that easily. | 20:59 |
| pabelanger | clarkb: k | 20:59 |
| Rockyg | ] | 21:00 |
| *** beslemon has joined #openstack-infra | 21:01 | |
| *** jkilpatr has joined #openstack-infra | 21:01 | |
| clarkb | actually maybe I am mistaken and gerrits git volume is mounted in the normal place | 21:01 |
| clarkb | so maybe /opt is free? | 21:01 |
| *** tongli has quit IRC | 21:02 | |
| clarkb | ok mysqldump is done (that was fast), running bup now | 21:02 |
| *** knangia has joined #openstack-infra | 21:03 | |
| pabelanger | clarkb: ya, just git repos for things we install on review.o.o | 21:04 |
| dims | clarkb : sdague : has anyone looking at the "libvirtd': malloc(): memory corruption:" problem? | 21:04 |
| clarkb | ianychoi: if you want to follow along I am getting backups set up as first step in upgrade process | 21:04 |
| dims | s/has/is/ | 21:04 |
| clarkb | dims: tonyb volunteered to look into that more at PTG. So far the bugs we have filed have been ignored by upstream due to lack of concrete reproduction steps (and core dump is apparently not good enough) | 21:05 |
| *** dimtruck is now known as zz_dimtruck | 21:05 | |
| sdague | dims: I have not, but is it an oom as well? | 21:05 |
| clarkb | dims: mtreinish and I plan to send email tomorrow with details asking for more volunteers but on the libvirt mem issue bugs please talk to tonyb | 21:05 |
| clarkb | sdague: no iirc they are segfaults | 21:05 |
| sdague | clarkb: ok, are we sure it doesn't happen during an actual out of memory point? | 21:06 |
| dims | sdague : realloc goes beserk (from within regexec) so possibly | 21:06 |
| clarkb | sdague: no I havne't double checked that, however I don't remember seeing OOMKiller syslogs from those jobs when I looked at them | 21:06 |
| *** yamamoto has joined #openstack-infra | 21:06 | |
| clarkb | but someone should check | 21:06 |
| *** tonytan_brb has quit IRC | 21:06 | |
| sdague | dims, there is a dstat log, you could compare timestamps there | 21:06 |
| dims | sdague : backtrace looks like this - http://paste.openstack.org/show/600673/ - looked at 10 last instances pointed by logstash | 21:07 |
| *** Jeffrey4l_ has joined #openstack-infra | 21:07 | |
| clarkb | dstat and OOMKiller should record to syslog as well | 21:07 |
| *** Jeffrey4l has quit IRC | 21:07 | |
| sdague | clarkb: dstat doesn't | 21:07 |
| clarkb | sdague: dstat records swap and memory usage | 21:07 |
| *** tonytan4ever has joined #openstack-infra | 21:07 | |
| clarkb | OOMKiller records to syslog | 21:07 |
| clarkb | those are two places to look | 21:07 |
| sdague | right | 21:07 |
| sdague | yes, correct | 21:07 |
| clarkb | pabelanger: arg just realized we are going to backup a bunch of wildfly logs, though likely we want them for sanity reasons if something goes wrong at some point | 21:08 |
| pabelanger | /me nods | 21:09 |
| openstackgerrit | Merged openstack-infra/project-config master: Skip gate-puppet-openstack-integration-4-.. jobs https://review.openstack.org/436598 | 21:10 |
| amrith | AJaeger, fungi re: https://review.openstack.org/#/c/427897/ I will push up a change (to infra) to sync the testing on master and the stable branches and with that merged, we'll be able to merge the trove change. the issue now is that the stable tests are out of sync with master. | 21:11 |
| dims | sdague : clarkb : if i take this one http://logs.openstack.org/30/312230/13/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/9192e71/logs/syslog.txt - i don't see anything related to oom in syslog or dstat...but, i am not sure what i am looking for | 21:11 |
| ihrachys | clarkb: sdague: fyi I have some patches in queue that attempt to collect more data: https://review.openstack.org/434511 , https://review.openstack.org/433949, https://review.openstack.org/434474 , https://review.openstack.org/434470 (those last two are probably not ready, I see some failures when calling pmap but at least I would appreciate surface reviews) | 21:11 |
| clarkb | dims: ya I didn't think they were related just wasn't 100% sure | 21:12 |
| clarkb | dims: on the dstat side see if swap uses more than a couple megabytes | 21:12 |
| sdague | dims: what is the timestamp of the fail? | 21:13 |
| openstackgerrit | Merged openstack-infra/puppet-elastic_recheck master: Enable recheck irc bot for neutron https://review.openstack.org/433828 | 21:13 |
| dims | sdague : Feb 27 19:48:34 ubuntu-xenial-ovh-gra1-7502068 libvirtd[16110]: *** Error in `/usr/sbin/libvirtd': malloc(): memory corruption: 0x0000555bac376290 *** | 21:13 |
| ianychoi | clarkb, yep i will follow here thanks a lot! | 21:13 |
| clarkb | ianychoi: once backups are done I will go ahead and start the new xenial based server and work on getting that prepped for the cut over | 21:13 |
| *** clayg_ is now known as clayg | 21:14 | |
| *** yamamoto has quit IRC | 21:14 | |
| ianychoi | clarkb, +1 btw could u review https://review.openstack.org/#/c/419667/ for smarcet to test openstackid-dev ? | 21:16 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 21:16 |
| *** esikache1 has joined #openstack-infra | 21:17 | |
| *** adrian_otto has joined #openstack-infra | 21:17 | |
| clarkb | ianychoi: yup done. maybe fungi or pabelanger can review it too | 21:17 |
| ianychoi | clarkb, thanks! | 21:17 |
| tonyb | clarkb: Sounds good to me | 21:18 |
| dims | sdague : clarkb : this change in libvirt switched from a string compare to a regex - https://libvirt.org/git/?p=libvirt.git;a=commitdiff;h=82793a2a5517c7f5f5f844aa03f0e0a019a04c2a | 21:18 |
| *** e0ne has joined #openstack-infra | 21:19 | |
| mordred | dims: I can't imagine how that would cause memory usage to expand ;) | 21:19 |
| *** esikachev has quit IRC | 21:20 | |
| sdague | ihrachys: I'll look | 21:21 |
| dims | mordred : virLogProbablyLogMessage calls regexec and that calls realloc deep inside (http://paste.openstack.org/show/600673/) | 21:21 |
| dims | mordred : not saying that this is a oom problem per se. | 21:21 |
| *** kgiusti has quit IRC | 21:21 | |
| dims | the regex seems simple enough - https://libvirt.org/git/?p=libvirt.git;a=commitdiff;h=f3d312f6c8eb640b3973e99dd96b96c9b5981235 | 21:22 |
| *** nicolasbock has quit IRC | 21:22 | |
| *** ijw has joined #openstack-infra | 21:22 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Storyboard: Support invalid tasks in update script https://review.openstack.org/438704 | 21:24 |
| *** dfflanders has joined #openstack-infra | 21:26 | |
| *** crinkle is now known as cmurphy | 21:26 | |
| *** aysyd has quit IRC | 21:26 | |
| *** tonytan4ever has quit IRC | 21:26 | |
| *** smcginnis has quit IRC | 21:26 | |
| jeblair | SpamapS: https://git.openstack.org/cgit/openstack/boartty/tree/boartty/sync.py#n487 | 21:27 |
| *** tonytan4ever has joined #openstack-infra | 21:27 | |
| jeblair | SpamapS: that has some code that adds a tag to a story... should be a matter of appending an existing tag object to a story. | 21:27 |
| sdague | clarkb: I think we should get ihrachys's turn on of peak mem tracker on in the gate - https://review.openstack.org/#/c/434511/ | 21:27 |
| clarkb | sdague: looking | 21:28 |
| SpamapS | jeblair: I'm creating a new tag entirely.. so I guess I need to do that in real time in storyboard rather than wait for the story sync. | 21:28 |
| *** wolverineav has quit IRC | 21:28 | |
| SpamapS | oh lol.. I'm actually bombing out in story sync | 21:29 |
| jeblair | SpamapS: oh, well, we'll want all this to be async too... | 21:29 |
| SpamapS | jeblair: thanks.. needed a head spin... simple fix.. I forgot that the storyboard API would be the source of truth for that ID | 21:29 |
| *** zz_dimtruck is now known as dimtruck | 21:29 | |
| jeblair | SpamapS: which generally means adding a 'pending' column to the tag (and story_tag) tables | 21:29 |
| openstackgerrit | amrith proposed openstack-infra/project-config master: switch redis legacy tests to non-voting https://review.openstack.org/438706 | 21:29 |
| SpamapS | jeblair: ah, and then accepting that the ID may change? | 21:30 |
| clarkb | sdague: looks like it got backported on stable devstack too, cool | 21:30 |
| jeblair | SpamapS: to *try* to keep things straight, i use 'key' for the local unique id. | 21:30 |
| SpamapS | jeblair: I see the other pending stuff, so I can copy that. | 21:30 |
| sdague | clarkb: yeh, but lets at least start with pike, that's where the volume of patches are | 21:30 |
| clarkb | sdague: well it will be on all of them | 21:30 |
| sdague | clarkb: oh, right | 21:30 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack/boartty master: Add tag editting to story view https://review.openstack.org/438707 | 21:30 |
| clarkb | sdague: at least as written, I went ahead and approved | 21:30 |
| jeblair | SpamapS: possibly we can fill in the id field after succesfully creating the tag. | 21:30 |
| sdague | yeh | 21:30 |
| SpamapS | jeblair: ahhh, so the database right now has the id as the pk | 21:31 |
| jeblair | SpamapS: (that's part of why i have a secondary local id) | 21:31 |
| sdague | clarkb: it wasn't so much backported I don't think, as ianw put that in a long time ago | 21:31 |
| SpamapS | oh | 21:31 |
| SpamapS | no | 21:31 |
| SpamapS | it does not | 21:31 |
| SpamapS | doh | 21:31 |
| SpamapS | jeblair: I totally failed to notice the difference between key and id. It's all making sense now. :) | 21:31 |
| jeblair | SpamapS: yeah, 'key' (the local id) is primary key; 'id' (remote id) is indexed, but not primary. it may need to be made nullable though. | 21:32 |
| *** smcginnis has joined #openstack-infra | 21:32 | |
| clarkb | sdague: gotcha for some reason I thought it was a new thing | 21:32 |
| ianw | sdague: yeah, i'm happy with that, we were just going back and forth over adding the locked memory tracker to it | 21:32 |
| SpamapS | id INTEGER, | 21:32 |
| SpamapS | jeblair: already nullable. :) | 21:33 |
| *** gouthamr has quit IRC | 21:33 | |
| *** sdake_ has joined #openstack-infra | 21:33 | |
| SpamapS | jeblair: wouldn't 'id is null' == 'pending' ? | 21:33 |
| *** tonytan4ever has quit IRC | 21:33 | |
| sdague | ianw: if there are enhancements we need in there, point me at reviews, and I'll work to get those in | 21:33 |
| jeblair | SpamapS: indeed -- it looks like the alembic schema creation does not match the schema statement in db.py (which is where i was looking). so we may just need to *tell* sqlalchemy it already is nullable. | 21:34 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Undercloud containers job with tripleo.sh https://review.openstack.org/437411 | 21:34 |
| *** Jeffrey4l_ has quit IRC | 21:35 | |
| *** Jeffrey4l__ has joined #openstack-infra | 21:35 | |
| ianw | sdague: ihrachys has been working on -> https://review.openstack.org/#/c/434470/ . he took my suggesiton to roll it into the peakmem_tracker rather than start a new service, and i think there's just some fiddling of final outputs to do. | 21:35 |
| jeblair | SpamapS: re id==null -- hrm, i guess we could interpret it that way... i can't think of an argument for needing a 'pending' flag in this instance. | 21:35 |
| *** dprince has quit IRC | 21:35 | |
| sdague | ianw: ah, yeh, I think it would be better to hook into peak mem tracker for that | 21:36 |
| ianw | sdague: yeah, we were already getting up to 3 services for tracking stuff during the build. so i'd rather us just enhance the one | 21:37 |
| *** skelso has quit IRC | 21:37 | |
| *** mhickey has quit IRC | 21:37 | |
| ihrachys | sdague: the only caveat of rolling in is that it then suggests rename for the service | 21:37 |
| ianw | ihrachys: what did you think of just running that detailed mlock overview if the Mlocked info from /proc changed? (that also keeps it more "peakmem" type behaviour :) | 21:39 |
| ihrachys | ianw: that may be a nice enhancement, please comment there | 21:39 |
| ianw | ihrachys: i think i did on the last review :) | 21:40 |
| openstackgerrit | amrith proposed openstack-infra/project-config master: switch redis legacy tests to non-voting https://review.openstack.org/438706 | 21:40 |
| ianw | that was the only thing i noticed i think, that we get the "no locked memory" every period even if nothing has changed | 21:40 |
| ihrachys | I don't think we will catch an issue where the overall size doesn't change while locks flow from process to process :) | 21:40 |
| ihrachys | ianw: ok I could have missed, I am overwhelmed with stuff and do mistakes :) | 21:40 |
| clarkb | and translate.o.o backups have completed. Will be booting new xenial server shortly for translate01.openstack.org | 21:41 |
| *** sbezverk has joined #openstack-infra | 21:41 | |
| ihrachys | ianw: one issue I am not sure what to do with is for some reason, when in gate, pmap does return 1 for me | 21:42 |
| ihrachys | while locally it's working fine | 21:42 |
| ihrachys | maybe I should sud | 21:42 |
| ihrachys | *sudo | 21:42 |
| ihrachys | but I don't know if it's allowed in devstack? | 21:42 |
| *** gouthamr has joined #openstack-infra | 21:42 | |
| sbezverk | good afternoon, this PS is missing one more +2, appreciate if somebody could review it https://review.openstack.org/#/c/438581/ | 21:43 |
| openstackgerrit | Kaitlin Farr proposed openstack-infra/project-config master: Install python-barbicanclient from git for castellan gate https://review.openstack.org/438712 | 21:43 |
| ianw | ihrachys: we can sudo ... that would be required i guess to walk other processes /proc/pid stuff | 21:43 |
| ihrachys | ianw: yeah. though my vagrant user can do that without sudo | 21:44 |
| ihrachys | ianw: it's in libvirtd group though, maybe it makes a diff | 21:44 |
| ihrachys | lemme check without the group | 21:44 |
| ianw | umm, yeah ... i'm not sure there ... i mean stuff like mariadb will be running under it's own user in the gate, and that's one we want to poke at | 21:45 |
| ihrachys | well, even without the group it works fine | 21:45 |
| ihrachys | I mean, it doesn't give the info, but neither it returns 1 | 21:46 |
| ihrachys | I guess we need sudo either way | 21:46 |
| *** cloudtrainme has joined #openstack-infra | 21:46 | |
| *** wznoinsk has joined #openstack-infra | 21:47 | |
| wznoinsk | hi all | 21:47 |
| *** Goneri has quit IRC | 21:48 | |
| *** chlong has quit IRC | 21:50 | |
| wznoinsk | is here someone that could help me recover password for openstackid.org? the password doesn't seem to work and I don't have access to the email address anymore | 21:50 |
| *** dave-mccowan has joined #openstack-infra | 21:52 | |
| sdague | ianw: honestly, while mysql is the biggest single process, it's all the python that's taking up the memory | 21:52 |
| sdague | and that's the bit I don't understand why it's not swapping out | 21:52 |
| sdague | because we definitely oom with a lot of swap free | 21:53 |
| *** trown is now known as trown|outtypewww | 21:53 | |
| *** cloudtrainme has quit IRC | 21:53 | |
| wznoinsk | sdague, a long shot but is it possible there's memory overprovisioned on the provider's compute side and the shortage is seen by VM like so? | 21:56 |
| sdague | wznoinsk: lots of other things should be freaking out if that's the case | 21:56 |
| wznoinsk | well, libvirt may have bigger hunger for memory than other processes, or at least it needs a lot in a short time when spawns a VM | 21:57 |
| *** cloudtrainme has joined #openstack-infra | 21:58 | |
| SpamapS | jeblair: the only argument I can think of is consistency :) | 21:58 |
| jeblair | SpamapS: it's a good one. | 21:58 |
| *** john-davidge has quit IRC | 21:59 | |
| wznoinsk | sdague, although that would be probably qemu process instead but I wouldn't be surprised libvirt does something as part of the preparation for new instance | 21:59 |
| SpamapS | jeblair: aye, 'tis | 21:59 |
| *** samueldmq has quit IRC | 22:00 | |
| jeblair | Zuul meeting in #openstack-meeting-alt | 22:01 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Switch from lib/neutron-legacy to lib/neutron https://review.openstack.org/436798 | 22:02 |
| *** sdake_ has quit IRC | 22:05 | |
| *** matrohon has quit IRC | 22:06 | |
| *** yamamoto has joined #openstack-infra | 22:07 | |
| *** lin_yang has quit IRC | 22:07 | |
| *** ihrachys has quit IRC | 22:08 | |
| *** gouthamr has quit IRC | 22:08 | |
| *** e0ne has quit IRC | 22:14 | |
| clarkb | StevenK: you around? looks like we register zanata projects from the zanata server to itself. Wondering if that will be an issue while I turn on new server which will have two cases of register zanata projects running one on old host against old host and one on new host against old host | 22:20 |
| StevenK | clarkb: Using the same database? | 22:21 |
| clarkb | StevenK: yes, though new host won't be able to connect to the db | 22:22 |
| clarkb | StevenK: basically I am trying to stage new host while leaving old one in place, then switch over at specified time reducing outage | 22:22 |
| *** shardy_afk has quit IRC | 22:23 | |
| StevenK | I think register-zanata-projects will noisy complain that it can't register projects | 22:23 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 22:23 |
| clarkb | StevenK: well I think it will be able to register them | 22:23 |
| clarkb | StevenK: since it will have a valid api key for the old server | 22:23 |
| clarkb | StevenK: and it will be talking to the old server until dns updates | 22:23 |
| clarkb | StevenK: so question is will having two of them run on different hosts cause problems? | 22:23 |
| StevenK | clarkb: In which case the old server will say the project exists, everything is fine | 22:23 |
| clarkb | hrm actually I could disable puppet on the old server, then only have new server do those updates and avoid any races | 22:24 |
| clarkb | StevenK: registering projects doesn't require db access right? just zanata api access? | 22:24 |
| StevenK | Well, the zanata server itself requires db access | 22:24 |
| clarkb | right the running zanata server will have it | 22:25 |
| clarkb | I think disabling puppet on old server, having new server do all registrations now will work fine as long as it doesn't need direct db access | 22:26 |
| StevenK | I'm just checking that | 22:26 |
| clarkb | cool thanks | 22:26 |
| *** ihrachys has joined #openstack-infra | 22:27 | |
| *** asselin_ has joined #openstack-infra | 22:28 | |
| StevenK | clarkb: Right, no DB access -- everything is done via the REST API | 22:28 |
| clarkb | StevenK: perfect, that means I can just disable puppet on old server for now, forcing new server to do all registrations | 22:29 |
| StevenK | Not that it will require any -- it only does real work if the list of projects requiring translation changes | 22:29 |
| clarkb | oh even better | 22:30 |
| clarkb | thanks for looking at it | 22:30 |
| *** csomerville has quit IRC | 22:30 | |
| *** cloudtrainme has quit IRC | 22:30 | |
| *** thorst has quit IRC | 22:31 | |
| *** lespaul has joined #openstack-infra | 22:31 | |
| *** asselin has quit IRC | 22:31 | |
| *** thorst has joined #openstack-infra | 22:32 | |
| *** sdake has joined #openstack-infra | 22:34 | |
| *** csomerville has joined #openstack-infra | 22:34 | |
| *** baoli has quit IRC | 22:35 | |
| *** thorst has quit IRC | 22:36 | |
| *** mixos has quit IRC | 22:38 | |
| *** sreeram_v has joined #openstack-infra | 22:39 | |
| ianychoi | StevenK: hello Zanata pioneer on infra, thanks a lot for looking at Zanata side | 22:40 |
| StevenK | Haha | 22:40 |
| ianychoi | :) | 22:41 |
| clarkb | once zuul meeting is over Iwill disable puppet on old server, and start booting new server, copy the files from /home/wildfly or was it /home/zanata? then I think we are ready to schedule a concrete hour to stop old server, resync files, update mysql creds on new server, and start the zanata wildfly service on new server, then update dns | 22:42 |
| clarkb | I will write down the steps necessary on an etherpad and schedule it for au/asia friendly time | 22:42 |
| clarkb | so we can all dive in together :)_ | 22:43 |
| ianychoi | Yep great I do not know the location of home directory but it would be the same as translate-dev? | 22:43 |
| clarkb | ianychoi: yes it will be the same, I will figure it out and write it all down so we know what to do during the cut over | 22:43 |
| *** mriedem has quit IRC | 22:44 | |
| ianychoi | clarkb, got it :) | 22:44 |
| *** sreeram_v has quit IRC | 22:44 | |
| lespaul | Hello. I need some assistance setting up a 3rd party ci system w/ gerrit ci-sandbox. I can push code, Gerrit will receive and a build will trigger in our (public) Jenkins server. I'd like to post a comment in Gerrit will have the link to the Jenkins console output. How can I achieve this? I'm using nginx to proxy the Jenkins server. Thanks. | 22:47 |
| clarkb | lespaul: are you using the jenkins gerrit trigger plugin? | 22:48 |
| openstackgerrit | Merged openstack-infra/project-config master: Fix senlin gate job https://review.openstack.org/437851 | 22:48 |
| *** dave-mccowan has quit IRC | 22:48 | |
| lespaul | clarkb: yes. the build starts automatically from gerrit. | 22:48 |
| *** EricGonc_ has quit IRC | 22:49 | |
| clarkb | lespaul: ok you have to configure the same plugin to report results back to gerrit when job(s) complete | 22:49 |
| *** jamesdenton has quit IRC | 22:49 | |
| clarkb | lespaul: we document this at https://docs.openstack.org/infra/system-config/third_party.html#the-jenkins-gerrit-trigger-plugin-way | 22:49 |
| openstackgerrit | Merged openstack-infra/project-config master: Add swift func test job to run on centos https://review.openstack.org/436632 | 22:49 |
| lespaul | clarkb: i have that configuration set up in jenkins but it's not reporting it. only build start is being reported. | 22:50 |
| clarkb | lespaul: you set the successful, failed, and unstable config at the bottom of that section? | 22:50 |
| clarkb | lespaul: that is the config that tells it what to do when jobs complete | 22:51 |
| lespaul | yes. from my understanding, (per doc, under "posting results to gerrit") i have to manually put a comment with a link to the console output. | 22:52 |
| clarkb | lespaul: thats for testing the account is working | 22:52 |
| clarkb | lespaul: further down (where I linked) is the config to give the jenkins gerrit trigger plugin to have it report automatically on job completion | 22:52 |
| *** annegentle has quit IRC | 22:53 | |
| *** rossella_s has quit IRC | 22:53 | |
| *** esikachev has joined #openstack-infra | 22:54 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox jobs https://review.openstack.org/438281 | 22:54 |
| *** rossella_s has joined #openstack-infra | 22:54 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add generic tox jobs https://review.openstack.org/438281 | 22:55 |
| *** jkilpatr has quit IRC | 22:56 | |
| *** marst has quit IRC | 22:56 | |
| lespaul | clarkb: I just confirmed that I have the settings in place under the advance menu in gerrit plugin config. Does this mean that I don't have to set up a page in Nginx for the console output? | 22:56 |
| *** esikache1 has quit IRC | 22:56 | |
| *** Goneri has joined #openstack-infra | 22:57 | |
| clarkb | lespaul: no, all that does is report the -1/+1 back to gerrit with links to your nginx server | 22:58 |
| clarkb | lespaul: so you'll need both items | 22:58 |
| *** hashar has quit IRC | 22:59 | |
| clarkb | ok translate.o.o is in ansible emergency file | 23:01 |
| *** rhallisey has quit IRC | 23:01 | |
| clarkb | I'm going to boot translate01.openstack.org on xenial now | 23:01 |
| clarkb | ianychoi: ^ fyi | 23:01 |
| lespaul | clarkb: ok. i'm not too familiar with nginx. is it possible to have jenkins and nginx (as a proxy) running in one machine and still host a page for the jenkins build output? Or maybe I need to set up a new web server and rsync the build output to the new webserver? | 23:01 |
| pabelanger | jeblair: mordred: clarkb: lets land https://review.openstack.org/#/c/438490/ and https://review.openstack.org/#/c/438677/ this evening, if everybody is on board. That will allow us to rotate images in infracloud-chocolate, clean up DIBs on disk. Then we can figure out the config change for 438677 tomorrow and schedule a restart of nodepool.o.o | 23:01 |
| ianychoi | clarkb, ack of your fyi :) | 23:01 |
| *** Swami_ has joined #openstack-infra | 23:02 | |
| clarkb | lespaul: one server should work as long as you have enough cpu time, disk, and memory | 23:02 |
| clarkb | lespaul: we use a separate server for scaling reasons but you may not need to | 23:02 |
| *** Swami has quit IRC | 23:03 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/project-config master: ironic: Don't enable networking-generic-switch for grenade https://review.openstack.org/438728 | 23:03 |
| *** aeng has quit IRC | 23:03 | |
| *** Apoorva has quit IRC | 23:03 | |
| *** Apoorva has joined #openstack-infra | 23:04 | |
| clarkb | ianychoi: ok its running | 23:04 |
| clarkb | ianychoi: well its booting then puppte will run then zanata should fail to start because the db info is wrong | 23:04 |
| lespaul | clarkb: ok thanks. last question, the Gerrit Workflow shows CI systems which ran the build. Will our system only show in the workflow if we have a link to the build output? | 23:05 |
| clarkb | lespaul: I'm not sure what you are referring to but you should always link build output | 23:06 |
| *** Swami_ has quit IRC | 23:06 | |
| lespaul | https://review.openstack.org/438104/ . Under Workflow, it shows several CI systems. Ours is not listed there even though the build is successful. | 23:07 |
| clarkb | lespaul: ah, that table is a hack on top of gerrit that depends on CI results being reported in a specific format to match the regex | 23:08 |
| clarkb | lespaul: if you expand the comments from eg jenkins or canonical CI you cna see how they are rendered with the correct formatting | 23:08 |
| *** mdrabe has quit IRC | 23:08 | |
| *** abregman has quit IRC | 23:08 | |
| jeblair | pabelanger: approved 438490. clarkb do you want to vote on 438677 or abstain? | 23:09 |
| clarkb | jeblair: I'm abstaining. I think the problem is already solved and that code is not necessary. Also distrcted by zanata things | 23:10 |
| hongbin | hi infra team, i wanted to add kuryr-libnetwork into the gate but i am not sure why i got this error (The /opt/stack/new/kuryr-libnetwork project was not found; if this is a gate job, add the project to the $PROJECTS variable in the job definition.) | 23:11 |
| *** thorst has joined #openstack-infra | 23:12 | |
| hongbin | i think i did add it to the projects (https://review.openstack.org/#/c/438715/1/zun/tests/contrib/gate_hook.sh) | 23:12 |
| lespaul | clarkb: thanks, i appreciate the help. | 23:13 |
| clarkb | hongbin: the gate hook runs after all the git repo setup happens so exporting PROJECTS there is effectively a noop | 23:13 |
| clarkb | hongbin: you need to list it in the top level of the job so that its available when the test starts | 23:13 |
| hongbin | clarkb: i see, thanks for pointing it out | 23:14 |
| openstackgerrit | Merged openstack-infra/project-config master: Bring infracloud-chocolate back online https://review.openstack.org/438490 | 23:14 |
| *** ihrachys has quit IRC | 23:15 | |
| clarkb | ianychoi: ok new server is up, but I have turned off wildfly on it so that I can safely copy files around | 23:16 |
| *** csomerville has quit IRC | 23:16 | |
| clarkb | ianychoi: can you quickly double check that https://translate.openstack.org is still happy? | 23:16 |
| clarkb | ianychoi: the new server should not have affected the old one | 23:17 |
| *** thorst has quit IRC | 23:17 | |
| ianychoi | clarkb, yep checking now | 23:17 |
| ianychoi | clarkb, yep currently fine with general loading & saving | 23:18 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Zun] Add kuryr-libnetwork into $PROJECTS https://review.openstack.org/438731 | 23:18 |
| clarkb | ianychoi: great, new server doesn't have db access to db yet so didn't expect problems but wanted to double check | 23:18 |
| clarkb | ianychoi: I am writing things down on https://etherpad.openstack.org/p/translate.o.o-upgrade for process of upgrade | 23:18 |
| jeblair | clarkb: okay. i don't disagree with you. pabelanger added it with a 'deprecated' flag; i think we can remove this later if we want. i'll go ahead and approve it now so pabelanger can continue. | 23:18 |
| *** cloudtrainme has joined #openstack-infra | 23:19 | |
| ianychoi | clarkb, thanks for your double-checking idea & writing on Etherpad - I will share it with Zanata dev team | 23:19 |
| *** Julien-zte has joined #openstack-infra | 23:20 | |
| *** aeng has joined #openstack-infra | 23:21 | |
| clarkb | ianychoi: I left a note for you on the glossary sync step if you can fill in data for that | 23:21 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Fuxi] Add python-manilaclient into $PROJECTS https://review.openstack.org/438733 | 23:22 |
| *** gouthamr has joined #openstack-infra | 23:22 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Add nodepool-id to provider section https://review.openstack.org/438677 | 23:22 |
| *** stakeda has quit IRC | 23:22 | |
| *** gordc has quit IRC | 23:23 | |
| ianychoi | clarkb, yep I have filled out | 23:26 |
| clarkb | thanks | 23:26 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Detect misaligned ':' in zuul/layout.yaml https://review.openstack.org/438735 | 23:28 |
| clarkb | jhesketh: ianw putting this together for production zanata upgrade https://etherpad.openstack.org/p/translate.o.o-upgrade | 23:29 |
| ianychoi | clarkb, it may be general question: what is "ansible emergency file"? (first mentioned for translate.o.o) and seeing translate01.o.o on cacti will need your additional stuff maybe? | 23:29 |
| pabelanger | images uploading to chocolate now | 23:29 |
| mordred | pabelanger: yay | 23:30 |
| *** Julien-zte has quit IRC | 23:30 | |
| clarkb | ianychoi: ansible emergency file is the file we can put hosts in to stop puppet running on them | 23:30 |
| clarkb | ianychoi: and yes cacti will need an update, do you want to push that up? | 23:30 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 23:30 |
| ianychoi | clarkb, aha I see. Then proposing translate01.openstack.org to support cacti like https://review.openstack.org/#/c/425787/ ? | 23:31 |
| clarkb | ianychoi: yup | 23:31 |
| ianychoi | clarkb, yep I will propose it happily :) | 23:31 |
| ianw | clarkb: ++ i do like a checklist :) | 23:31 |
| *** csomerville has joined #openstack-infra | 23:32 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Detect misaligned ':' in zuul/layout.yaml https://review.openstack.org/438735 | 23:33 |
| *** pcrews_ has joined #openstack-infra | 23:33 | |
| *** jkilpatr has joined #openstack-infra | 23:35 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Update db creds for translate01.o.o https://review.openstack.org/438737 | 23:35 |
| *** pcrews has quit IRC | 23:36 | |
| *** cody-somerville has joined #openstack-infra | 23:36 | |
| openstackgerrit | Ian Y. Choi proposed openstack-infra/system-config master: Add translate01 to cacti https://review.openstack.org/438738 | 23:38 |
| *** csomerville has quit IRC | 23:38 | |
| ianychoi | clarkb, it would great if you review ^ | 23:39 |
| clarkb | actually do we want both translate.o.o and translate01.o.o in cacti | 23:40 |
| clarkb | jeblair: fungi ^ have we thought about that yet? | 23:40 |
| *** dangers is now known as dangers_away | 23:40 | |
| *** rcernin has quit IRC | 23:41 | |
| jeblair | clarkb: when we think about it this time, we should write down our thoughts in system-config/doc. :) | 23:41 |
| *** Swami has joined #openstack-infra | 23:41 | |
| clarkb | I can see reasons for doing it both ways. Basically 01 is the actual hardware to monitor and translate.o.o is the service regardless of hardware | 23:42 |
| clarkb | so maybe collecting redundant info in some cases is worthwhile | 23:42 |
| openstackgerrit | Merged openstack-infra/project-config master: OSA: Prevent CentOS jobs executing for Newton and older https://review.openstack.org/438551 | 23:44 |
| *** jcoufal has quit IRC | 23:45 | |
| *** Swami_ has joined #openstack-infra | 23:47 | |
| *** baoli has joined #openstack-infra | 23:48 | |
| *** cloudtrainme has quit IRC | 23:48 | |
| *** salv-orlando has quit IRC | 23:48 | |
| *** asselin has joined #openstack-infra | 23:49 | |
| *** kong has joined #openstack-infra | 23:49 | |
| *** Swami has quit IRC | 23:50 | |
| *** asselin__ has joined #openstack-infra | 23:50 | |
| *** dingyichen has joined #openstack-infra | 23:51 | |
| *** samueldmq has joined #openstack-infra | 23:51 | |
| clarkb | arg apparently we ended up with 3 different translate-dev01 servers, I guess that when I had failures to puppet things didn't get cleaned up properly | 23:52 |
| *** jcoufal has joined #openstack-infra | 23:52 | |
| *** asselin_ has quit IRC | 23:52 | |
| * clarkb makes note on etherpad to clean those all up | 23:52 | |
| *** xyang1 has quit IRC | 23:52 | |
| *** mixos has joined #openstack-infra | 23:54 | |
| *** asselin has quit IRC | 23:54 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES https://review.openstack.org/437434 | 23:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Use bootstrap subnodes environment in CI https://review.openstack.org/425888 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Copy nodepool private key to ~/.ssh https://review.openstack.org/437743 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $OOOQ_TAGS https://review.openstack.org/437432 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys https://review.openstack.org/437742 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private https://review.openstack.org/437433 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Pass $MTU env var to toci_vxlan_networking.sh https://review.openstack.org/437744 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Improved initial package handling https://review.openstack.org/437430 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Reinstall python-requests https://review.openstack.org/437431 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Don't hardcode jenkins user https://review.openstack.org/437429 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Don't output os-collect-config log to console https://review.openstack.org/438105 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Don't hardcode /home/jenkins https://review.openstack.org/436719 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job https://review.openstack.org/438745 | 23:55 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Update pip in DLRN venv https://review.openstack.org/438746 | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
