| *** salv-orlando has joined #openstack-infra | 00:00 | |
| clarkb | centos images are working now as they get uploaded into clouds | 00:01 |
|---|---|---|
| clarkb | and their dns forwarders are set the way we want in osic | 00:02 |
| clarkb | inc0: I'm noticing that kolla seems to be the last set of dns lookup failures that we have | 00:04 |
| clarkb | inc0: for example http://logs.openstack.org/39/475939/3/check/gate-kolla-dsvm-build-oraclelinux-binary-centos-7-nv/bb246b2/console.html it tries to lookup epel.vpsnet.lt which does not resolve to an A or AAAA record | 00:04 |
| *** askb has joined #openstack-infra | 00:04 | |
| *** salv-orlando has quit IRC | 00:05 | |
| clarkb | perhaps you are better off using http://mirror.dfw.rax.openstack.org/epel/ ? though I think ianw is learning things about that | 00:05 |
| *** eranrom has joined #openstack-infra | 00:05 | |
| *** gmann has quit IRC | 00:06 | |
| ianw | yeah, that has just installed epel-release which will be round-robin | 00:06 |
| *** gmann has joined #openstack-infra | 00:06 | |
| ianw | the thing with round-robin seems to be a lot of the time you're round-robined to some useless black hole | 00:07 |
| clarkb | ianw: but other than ^ I think our dns woes are finally behind us | 00:07 |
| clarkb | at least according to logstash and my query | 00:07 |
| ianw | yay! great work, very glad you were on it | 00:08 |
| *** dingyichen has joined #openstack-infra | 00:08 | |
| *** eranrom has quit IRC | 00:09 | |
| *** ijw has quit IRC | 00:11 | |
| clarkb | I have laerned much about unbound and systemd and even selinux... it was an adventure :) | 00:12 |
| *** esberglu has joined #openstack-infra | 00:12 | |
| *** edmondsw has joined #openstack-infra | 00:13 | |
| zaro | clarkb: hey, noticed you had some questions | 00:14 |
| *** dimtruck is now known as zz_dimtruck | 00:15 | |
| clarkb | zaro: ya specifically with 2.13.8 and the database. Noticed that there is some weirdness documented going to 2.13.8 | 00:17 |
| edmondsw | anybody else seeing gate failures like this? http://logs.openstack.org/87/474987/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial-newton/be81168/logs/screen-n-cpu.txt.gz#_2017-06-21_20_12_10_724 | 00:18 |
| clarkb | zaro biggest question is do you have to configure anything to avoid h2 if going from 2.11. to 2.13? | 00:18 |
| clarkb | zaro: er 2.11 to 2.13.8 | 00:18 |
| edmondsw | I found https://bugs.launchpad.net/nova/+bug/1507915 but that's really old at this point | 00:18 |
| openstack | Launchpad bug 1507915 in openstack-ansible "libguestfs launch image failed in ubuntu" [Undecided,In progress] | 00:18 |
| clarkb | zaro: I think we have decided to avoid doing 2.11 to 2.13.7 and just go staright to 2.13.8 as it looks simpler (so I am getting everything built for 2.13.8 nowish) | 00:19 |
| *** ijw has joined #openstack-infra | 00:19 | |
| *** Swimingly has quit IRC | 00:19 | |
| clarkb | edmondsw: libguestfs has traditionally been the source of all problems | 00:19 |
| clarkb | edmondsw: so I thought we had completely disabled it but I guess not | 00:19 |
| edmondsw | clarkb I keep rechecking https://review.openstack.org/#/c/474987/3 but it keeps failing | 00:20 |
| *** Swimingly has joined #openstack-infra | 00:20 | |
| edmondsw | clarkb should I just hope for better luck rechecking tomorrow, or... ? | 00:21 |
| zaro | clarkb: sorry i haven’t been keeping up with gerrit so i don’t know if you can avoid h2. i think they used it as a bridge for moving things to git backend. | 00:21 |
| clarkb | edmondsw: likely not, that appears to be a packaging problem | 00:21 |
| zaro | probably a good idea to avoid it if you can. | 00:21 |
| edmondsw | clarkb packaging problem? | 00:21 |
| clarkb | zaro: it looks like 2.13 introduced h2 then in 2.13.8 they switched to using mysql | 00:21 |
| zaro | h2 was probably temporary anways | 00:21 |
| clarkb | edmondsw: yes libguestfs and libvirt both come from the distros. Guessing some interaction between them in new packages possibly are the problem | 00:22 |
| clarkb | zaro: the problem is the migration away from h2 is not automated | 00:22 |
| clarkb | zaro: so we are trying to avoid it entirely | 00:22 |
| *** zz_dimtruck is now known as dimtruck | 00:22 | |
| clarkb | zaro: we'll be testing 2.13.8 in the near future, once we get plugins built and a war | 00:23 |
| zaro | clarkb: sounds like a good idea. | 00:23 |
| edmondsw | clarkb so what should I do? | 00:23 |
| edmondsw | sorry, I don't have a lot of experience with gate issues | 00:23 |
| clarkb | edmondsw: you'll probably want to reproduce the issue lcoally and set those vars for debugging. But beyond that I'm not sure. Talk to libguestfs? | 00:23 |
| clarkb | or nova may have ideas | 00:23 |
| clarkb | edmondsw: http://logs.openstack.org/87/474987/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial-newton/be81168/logs/reproduce.sh can be used to reproduce the test run | 00:24 |
| clarkb | zaro: gerrit upgrades have gotten significantly more complicated than they used to be :/ | 00:24 |
| edmondsw | clarkb I don't think it can possible be related to the change being made here, so surely I'm not the only one seeing this | 00:24 |
| clarkb | edmondsw: well its newton, I don't know how many people care about or watch newton | 00:24 |
| clarkb | edmondsw: you can see if tonyb knows more | 00:25 |
| * tonyb tries to catch up | 00:25 | |
| zaro | clarkb: you mean integration with other things or just gerrit itself? | 00:25 |
| clarkb | tonyb: tldr is http://logs.openstack.org/87/474987/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial-newton/be81168/logs/screen-n-cpu.txt.gz#_2017-06-21_20_12_10_724 shows libguestfs exploding in nova under newton | 00:25 |
| clarkb | zaro: just gerrit itself. This h2 thing in particular is a third database that you have to manage now (previously was mysql and secondary index). It requires you manually update tables if you use it and upgrade and they recommend you push it into postgres or mysql | 00:26 |
| *** Sukhdev has quit IRC | 00:27 | |
| tonyb | Is this a new issues? It look slike the perminssions are wrong | 00:27 |
| clarkb | zaro: couple that with mandatory onffline reindexes that take more than 4 hours and needing to manually install plugins that are already included in the gerrit war it seems like it is much more complicated than it used to be | 00:27 |
| zaro | clarkb: IIRC h2 was just temporary until all db stuff gets moved to git. | 00:30 |
| zaro | but yeah, the reindex, secondary index and cache is difficult to manage at scale. | 00:31 |
| edmondsw | tonyb I started seeing it today, but have seen it several times | 00:31 |
| edmondsw | tonyb all 4 rechecks on https://review.openstack.org/#/c/474987/3 | 00:32 |
| zaro | clarkb: but yes, overall it's more complicated now. | 00:32 |
| zaro | clarkb: when is your next ptg? i may visit and help if you have not upgraded by then. | 00:33 |
| clarkb | zaro: mid september in denver | 00:33 |
| edmondsw | tonyb patch set 2 there had passed jenkins on the 18th, and the only difference in ps3 is a comment change, so it can't be related to the patch | 00:34 |
| tonyb | edmondsw: Yeah I'm tryign to see if UCA (which I think we're using) updated libvirt/libguestfs | 00:35 |
| *** Julien-zte has joined #openstack-infra | 00:36 | |
| tonyb | edmondsw: Nope same libguestfs | 00:39 |
| edmondsw | tonyb :( | 00:39 |
| *** jamesdenton has joined #openstack-infra | 00:40 | |
| clarkb | I dont think newton uses uca | 00:41 |
| *** Swami has quit IRC | 00:41 | |
| clarkb | I would double chwck base xenial too | 00:41 |
| tonyb | clarkb: Ok. My mistake, still it could have been a base OS change | 00:41 |
| *** bobh has joined #openstack-infra | 00:48 | |
| *** tuanluong has joined #openstack-infra | 00:50 | |
| *** makowals has quit IRC | 00:56 | |
| *** s-shiono_ has joined #openstack-infra | 00:59 | |
| *** ijw has quit IRC | 01:00 | |
| *** s-shiono has quit IRC | 01:01 | |
| *** ijw has joined #openstack-infra | 01:02 | |
| *** hongbin has quit IRC | 01:02 | |
| *** cshastri has joined #openstack-infra | 01:04 | |
| *** ijw has quit IRC | 01:06 | |
| *** gildub has joined #openstack-infra | 01:09 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: requirements: update ansible version https://review.openstack.org/475228 | 01:10 |
| *** ijw has joined #openstack-infra | 01:12 | |
| *** ijw has quit IRC | 01:14 | |
| *** baoli has joined #openstack-infra | 01:15 | |
| *** baoli has quit IRC | 01:16 | |
| *** cuongnv has joined #openstack-infra | 01:17 | |
| *** baoli has joined #openstack-infra | 01:17 | |
| *** Apoorva_ has joined #openstack-infra | 01:19 | |
| *** ijw has joined #openstack-infra | 01:19 | |
| *** salv-orlando has joined #openstack-infra | 01:20 | |
| openstackgerrit | Jamie Lennox proposed openstack/diskimage-builder master: Use the dib python to do cleanup https://review.openstack.org/476302 | 01:20 |
| *** Apoorva has quit IRC | 01:22 | |
| *** Apoorva_ has quit IRC | 01:23 | |
| *** baoli has quit IRC | 01:23 | |
| *** LindaWang has joined #openstack-infra | 01:24 | |
| *** ijw has quit IRC | 01:24 | |
| *** eranrom has joined #openstack-infra | 01:24 | |
| *** salv-orlando has quit IRC | 01:25 | |
| *** xinliang_ has quit IRC | 01:26 | |
| *** baoli has joined #openstack-infra | 01:28 | |
| *** eranrom has quit IRC | 01:29 | |
| *** liujiong has joined #openstack-infra | 01:31 | |
| *** xinliang_ has joined #openstack-infra | 01:38 | |
| *** chlong has joined #openstack-infra | 01:44 | |
| *** jamesmcarthur has joined #openstack-infra | 01:46 | |
| *** cschwede has quit IRC | 01:47 | |
| *** otherwiseguy has quit IRC | 01:47 | |
| *** rnoriega has quit IRC | 01:47 | |
| *** jamesmcarthur has quit IRC | 01:50 | |
| *** rfolco has joined #openstack-infra | 01:51 | |
| *** rfolco has quit IRC | 01:51 | |
| *** jamesdenton has quit IRC | 01:52 | |
| *** zhurong has joined #openstack-infra | 01:52 | |
| *** baoli has quit IRC | 01:55 | |
| xinliang_ | Hi, Does anybody know how to confiure image property "hw_firmware_type=uefi" in nodepool.yaml file? I want to make my image boot with UEFI. | 01:55 |
| *** makowals has joined #openstack-infra | 01:58 | |
| *** rfolco has joined #openstack-infra | 01:59 | |
| *** rfolco has quit IRC | 02:00 | |
| *** yee379 has quit IRC | 02:00 | |
| *** yee379 has joined #openstack-infra | 02:01 | |
| *** xarses has quit IRC | 02:01 | |
| *** xarses_ has joined #openstack-infra | 02:01 | |
| *** yamahata_ has quit IRC | 02:01 | |
| *** rfolco has joined #openstack-infra | 02:03 | |
| *** rfolco has quit IRC | 02:03 | |
| *** bmjen has quit IRC | 02:04 | |
| *** Hunner has quit IRC | 02:04 | |
| *** chlong has quit IRC | 02:04 | |
| *** apetrich has quit IRC | 02:06 | |
| *** baoli has joined #openstack-infra | 02:07 | |
| *** liujiong_lj has joined #openstack-infra | 02:10 | |
| *** apetrich has joined #openstack-infra | 02:11 | |
| *** liujiong has quit IRC | 02:12 | |
| *** bmjen has joined #openstack-infra | 02:13 | |
| *** Hunner has joined #openstack-infra | 02:15 | |
| *** Hunner has quit IRC | 02:15 | |
| *** Hunner has joined #openstack-infra | 02:15 | |
| *** esberglu has quit IRC | 02:20 | |
| *** salv-orlando has joined #openstack-infra | 02:21 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 02:21 | |
| *** namnh has joined #openstack-infra | 02:22 | |
| *** gongysh has joined #openstack-infra | 02:24 | |
| *** eranrom has joined #openstack-infra | 02:25 | |
| *** salv-orlando has quit IRC | 02:25 | |
| *** liujiong_lj is now known as liujiong | 02:27 | |
| *** bobh has quit IRC | 02:28 | |
| *** eranrom has quit IRC | 02:29 | |
| *** Sukhdev has joined #openstack-infra | 02:32 | |
| *** chlong has joined #openstack-infra | 02:37 | |
| clarkb | xinliang_: is that an image metadata option? | 02:42 |
| clarkb | if so nodepool has the ability to set metadata per image, should be documented | 02:43 |
| *** Sukhdev has quit IRC | 02:43 | |
| *** baoli has quit IRC | 02:45 | |
| xinliang_ | Yes, I see the metadata settting docs. But not sure it is what I need. I know less of metadata . Image property is what I need to set | 02:45 |
| clarkb | I think those are the same | 02:47 |
| xinliang_ | clarkb: someting like this: http://paste.openstack.org/show/613340/ | 02:48 |
| *** JudeC has quit IRC | 02:48 | |
| clarkb | yes that should be the same thing | 02:49 |
| xinliang_ | clarkb: great! thanks, then I will have a try. | 02:49 |
| *** JudeC has joined #openstack-infra | 02:50 | |
| *** yamamoto has joined #openstack-infra | 02:56 | |
| *** JudeC has quit IRC | 02:57 | |
| *** gyee has quit IRC | 02:58 | |
| *** rlandy|bbl is now known as rlandy | 03:04 | |
| *** rlandy has quit IRC | 03:04 | |
| *** amotoki_away is now known as amotoki | 03:06 | |
| *** esberglu has joined #openstack-infra | 03:08 | |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config master: new project Adjutant UI https://review.openstack.org/476318 | 03:10 |
| *** esberglu has quit IRC | 03:12 | |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config master: add project python-adjutantclient https://review.openstack.org/476319 | 03:18 |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config master: new project Adjutant UI https://review.openstack.org/476318 | 03:21 |
| *** markvoelker has quit IRC | 03:21 | |
| *** markvoelker has joined #openstack-infra | 03:21 | |
| *** nicolasbock has joined #openstack-infra | 03:22 | |
| *** edmondsw has quit IRC | 03:22 | |
| *** salv-orlando has joined #openstack-infra | 03:22 | |
| *** makowals has quit IRC | 03:23 | |
| *** salv-orlando has quit IRC | 03:26 | |
| *** markvoelker has quit IRC | 03:26 | |
| xinliang_ | clarkb: yes, it works. metadata can set the image property. Thanks :-) | 03:32 |
| *** iyamahat has joined #openstack-infra | 03:35 | |
| *** gomarivera has joined #openstack-infra | 03:36 | |
| *** iyamahat has quit IRC | 03:36 | |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config master: add project python-adjutantclient https://review.openstack.org/476319 | 03:37 |
| *** iyamahat has joined #openstack-infra | 03:38 | |
| *** gongysh has quit IRC | 03:39 | |
| *** gouthamr has quit IRC | 03:39 | |
| *** lennyb has quit IRC | 03:40 | |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config master: add project python-adjutantclient https://review.openstack.org/476319 | 03:42 |
| *** iyamahat_ has joined #openstack-infra | 03:42 | |
| *** gongysh has joined #openstack-infra | 03:42 | |
| openstackgerrit | zhufl proposed openstack-infra/project-config master: DNM just test https://review.openstack.org/476326 | 03:44 |
| *** namnh_ has joined #openstack-infra | 03:45 | |
| *** iyamahat has quit IRC | 03:45 | |
| *** iyamahat has joined #openstack-infra | 03:46 | |
| *** namnh has quit IRC | 03:48 | |
| *** rwsu has joined #openstack-infra | 03:49 | |
| *** zhurong has quit IRC | 03:49 | |
| *** iyamahat_ has quit IRC | 03:50 | |
| *** lennyb has joined #openstack-infra | 03:52 | |
| *** gongysh has quit IRC | 03:53 | |
| *** iyamahat_ has joined #openstack-infra | 03:54 | |
| *** makowals has joined #openstack-infra | 03:55 | |
| *** dave-mccowan has quit IRC | 03:56 | |
| *** iyamahat has quit IRC | 03:57 | |
| openstackgerrit | zhufl proposed openstack-infra/project-config master: DNM just test https://review.openstack.org/476326 | 03:58 |
| *** dhajare has joined #openstack-infra | 03:58 | |
| *** yamahata_ has joined #openstack-infra | 03:59 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add various jobs for neutron-vpnaas-dashboard https://review.openstack.org/476332 | 04:00 |
| *** chlong has quit IRC | 04:02 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add various jobs for neutron-fwaas-dashboard https://review.openstack.org/476334 | 04:03 |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add various jobs for neutron-vpnaas-dashboard https://review.openstack.org/476332 | 04:04 |
| *** sflanigan has quit IRC | 04:04 | |
| *** dimtruck is now known as zz_dimtruck | 04:04 | |
| *** rhallisey has quit IRC | 04:06 | |
| *** psachin has joined #openstack-infra | 04:10 | |
| *** gomarivera has quit IRC | 04:13 | |
| *** chlong has joined #openstack-infra | 04:16 | |
| *** sflanigan has joined #openstack-infra | 04:17 | |
| *** sflanigan has joined #openstack-infra | 04:17 | |
| *** gomarivera has joined #openstack-infra | 04:19 | |
| *** gomarivera has quit IRC | 04:20 | |
| *** gomarivera has joined #openstack-infra | 04:20 | |
| *** links has joined #openstack-infra | 04:21 | |
| *** iyamahat__ has joined #openstack-infra | 04:22 | |
| *** iyamahat_ has quit IRC | 04:25 | |
| *** iyamahat_ has joined #openstack-infra | 04:27 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Additional mount order unit test https://review.openstack.org/476340 | 04:28 |
| *** iyamahat__ has quit IRC | 04:30 | |
| *** adisky__ has joined #openstack-infra | 04:31 | |
| *** salv-orlando has joined #openstack-infra | 04:35 | |
| *** sree has joined #openstack-infra | 04:37 | |
| *** ykarel has joined #openstack-infra | 04:39 | |
| *** makowals has quit IRC | 04:39 | |
| *** iyamahat_ has quit IRC | 04:40 | |
| *** iyamahat has joined #openstack-infra | 04:41 | |
| *** ykarel_ has joined #openstack-infra | 04:44 | |
| *** sflanigan has quit IRC | 04:44 | |
| *** iyamahat has quit IRC | 04:45 | |
| *** ykarel has quit IRC | 04:46 | |
| *** makowals has joined #openstack-infra | 04:52 | |
| *** ykarel_ has quit IRC | 04:56 | |
| *** ykarel_ has joined #openstack-infra | 04:57 | |
| *** makowals has quit IRC | 04:57 | |
| *** sflanigan has joined #openstack-infra | 04:58 | |
| *** sflanigan has joined #openstack-infra | 04:58 | |
| *** yuanying_ has joined #openstack-infra | 05:03 | |
| *** yuanying has quit IRC | 05:05 | |
| openstackgerrit | Lajos Katona proposed openstack-infra/project-config master: Enable q-trunk in heat dsvm functional jobs https://review.openstack.org/473700 | 05:08 |
| *** aeng has quit IRC | 05:08 | |
| *** ltomasbo|away is now known as ltomasbo | 05:18 | |
| *** rwsu has quit IRC | 05:19 | |
| *** jbadiapa_ has quit IRC | 05:19 | |
| *** iyamahat has joined #openstack-infra | 05:20 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix and test report urls for unknown failures https://review.openstack.org/469214 | 05:24 |
| *** aeng has joined #openstack-infra | 05:25 | |
| *** markvoelker has joined #openstack-infra | 05:28 | |
| *** e0ne has joined #openstack-infra | 05:29 | |
| *** ykarel_ has quit IRC | 05:34 | |
| *** ykarel_ has joined #openstack-infra | 05:35 | |
| *** prateek has joined #openstack-infra | 05:36 | |
| *** markvoelker has quit IRC | 05:40 | |
| *** pgadiya has joined #openstack-infra | 05:43 | |
| *** aeng has quit IRC | 05:43 | |
| *** markvoelker_ has joined #openstack-infra | 05:44 | |
| *** gongysh has joined #openstack-infra | 05:47 | |
| *** aeng has joined #openstack-infra | 05:47 | |
| *** markvoelker_ has quit IRC | 05:52 | |
| *** esberglu has joined #openstack-infra | 05:53 | |
| *** ccamacho has left #openstack-infra | 05:56 | |
| *** makowals has joined #openstack-infra | 05:56 | |
| *** Dinesh_Bhor has quit IRC | 05:57 | |
| *** esberglu has quit IRC | 05:57 | |
| *** markus_z has joined #openstack-infra | 06:00 | |
| *** AJaeger has quit IRC | 06:00 | |
| *** csomerville has quit IRC | 06:02 | |
| *** cody-somerville has joined #openstack-infra | 06:03 | |
| *** cody-somerville has joined #openstack-infra | 06:03 | |
| *** sree_ has joined #openstack-infra | 06:03 | |
| *** sree_ is now known as Guest66117 | 06:04 | |
| *** eranrom has joined #openstack-infra | 06:04 | |
| *** sree has quit IRC | 06:05 | |
| *** e0ne has quit IRC | 06:06 | |
| *** Dinesh_Bhor has joined #openstack-infra | 06:06 | |
| *** andreas_s has joined #openstack-infra | 06:09 | |
| *** ijw has joined #openstack-infra | 06:09 | |
| *** ijw has quit IRC | 06:14 | |
| *** yuanying_ has quit IRC | 06:19 | |
| *** yuanying has joined #openstack-infra | 06:20 | |
| *** prateek_ has joined #openstack-infra | 06:23 | |
| *** prateek has quit IRC | 06:25 | |
| *** jascott1 has quit IRC | 06:26 | |
| *** e0ne has joined #openstack-infra | 06:26 | |
| *** rcernin has joined #openstack-infra | 06:30 | |
| *** Guest66117 has quit IRC | 06:33 | |
| *** mrunge_ is now known as mrunge | 06:34 | |
| *** sree has joined #openstack-infra | 06:35 | |
| *** Julien-zte has quit IRC | 06:36 | |
| *** martinkopec has joined #openstack-infra | 06:36 | |
| *** rcernin has quit IRC | 06:37 | |
| *** markvoelker has joined #openstack-infra | 06:40 | |
| *** e0ne has quit IRC | 06:42 | |
| *** prateek__ has joined #openstack-infra | 06:44 | |
| *** eranrom has quit IRC | 06:46 | |
| *** prateek_ has quit IRC | 06:46 | |
| *** jamesmcarthur has joined #openstack-infra | 06:47 | |
| *** eranrom has joined #openstack-infra | 06:47 | |
| *** markvoelker has quit IRC | 06:47 | |
| *** ijw has joined #openstack-infra | 06:47 | |
| *** salv-orlando has quit IRC | 06:48 | |
| *** AJaeger has joined #openstack-infra | 06:48 | |
| *** salv-orlando has joined #openstack-infra | 06:48 | |
| *** netsinn has quit IRC | 06:50 | |
| *** gibi_ is now known as gibi | 06:50 | |
| *** rcernin has joined #openstack-infra | 06:50 | |
| *** aeng has quit IRC | 06:50 | |
| *** jamesmcarthur has quit IRC | 06:52 | |
| *** ijw has quit IRC | 06:52 | |
| openstackgerrit | Shu Muto proposed openstack-infra/project-config master: For zun-ui, add jobs for official project https://review.openstack.org/476375 | 06:53 |
| *** jascott1 has joined #openstack-infra | 06:53 | |
| *** salv-orlando has quit IRC | 06:53 | |
| andreaf | mtreinish, fungi: question on firehose - I subscribe to one topic but I get push about what it looks like anything going through - am I doing something wrong? http://paste.openstack.org/show/613346/ | 06:54 |
| *** JudeC has joined #openstack-infra | 06:54 | |
| *** jbadiapa_ has joined #openstack-infra | 06:56 | |
| *** markvoelker has joined #openstack-infra | 06:59 | |
| *** netsin has joined #openstack-infra | 07:00 | |
| *** tesseract has joined #openstack-infra | 07:02 | |
| *** markvoelker has quit IRC | 07:04 | |
| *** pcaruana has joined #openstack-infra | 07:05 | |
| *** markvoelker has joined #openstack-infra | 07:08 | |
| openstackgerrit | Xinliang Liu proposed openstack/diskimage-builder master: Fix mkfs use wrong label option for vfat https://review.openstack.org/476382 | 07:10 |
| *** rory has joined #openstack-infra | 07:11 | |
| *** pahuang has quit IRC | 07:12 | |
| *** markvoelker has quit IRC | 07:13 | |
| *** ralonsoh has joined #openstack-infra | 07:13 | |
| *** tmorin has joined #openstack-infra | 07:16 | |
| *** gildub has quit IRC | 07:20 | |
| *** markvoelker has joined #openstack-infra | 07:21 | |
| *** rory has left #openstack-infra | 07:22 | |
| *** jpich has joined #openstack-infra | 07:22 | |
| *** ccamacho has joined #openstack-infra | 07:28 | |
| *** markvoelker has quit IRC | 07:29 | |
| *** waynr has joined #openstack-infra | 07:29 | |
| *** eranrom has quit IRC | 07:30 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/elastic-recheck master: Add ER query for bug #1646002 https://review.openstack.org/476388 | 07:34 |
| openstack | bug 1646002 in tempest "periodic-tempest-dsvm-neutron-full-ssh-master fails on the gate - libguestfs installed but not usable (/usr/bin/supermin exited with error status 1." [High,Fix released] https://launchpad.net/bugs/1646002 - Assigned to Andrea Frittoli (andrea-frittoli) | 07:34 |
| *** dtantsur|afk is now known as dtantsur | 07:35 | |
| *** liusheng has quit IRC | 07:36 | |
| *** liusheng has joined #openstack-infra | 07:37 | |
| *** gildub has joined #openstack-infra | 07:37 | |
| *** apetrich has quit IRC | 07:39 | |
| *** amoralej|off is now known as amoralej | 07:40 | |
| *** esberglu has joined #openstack-infra | 07:41 | |
| *** jpena|off is now known as jpena | 07:42 | |
| *** eranrom has joined #openstack-infra | 07:43 | |
| *** prateek__ is now known as prateek | 07:45 | |
| *** esberglu has quit IRC | 07:45 | |
| *** stakeda has joined #openstack-infra | 07:47 | |
| *** priteau has joined #openstack-infra | 07:51 | |
| *** bnemec has quit IRC | 07:52 | |
| openstackgerrit | Yuval Brik proposed openstack-infra/project-config master: Karbor: add translate option to karbor projects https://review.openstack.org/476395 | 07:56 |
| pabelanger | clarkb: the 3rd vhost is becaue we modify http headers for caching, we only want to do that for docker hub right now | 07:57 |
| pabelanger | and was the only way I would set it up just for docker hub and rdo | 07:58 |
| *** mriedem has quit IRC | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** yamamoto has quit IRC | 08:03 | |
| *** hashar has joined #openstack-infra | 08:06 | |
| *** bnemec has joined #openstack-infra | 08:08 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Karbor: turn irc meetings into biweekly https://review.openstack.org/475709 | 08:08 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add a test to verify push reports only set status https://review.openstack.org/476400 | 08:09 |
| *** yuanying_ has joined #openstack-infra | 08:09 | |
| *** yuanying has quit IRC | 08:13 | |
| *** mhickey has joined #openstack-infra | 08:15 | |
| *** sflanigan has quit IRC | 08:16 | |
| *** markvoelker has joined #openstack-infra | 08:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Allow secrets for check pipeline https://review.openstack.org/476403 | 08:17 |
| *** benj_ has quit IRC | 08:18 | |
| *** e0ne has joined #openstack-infra | 08:20 | |
| *** benj_ has joined #openstack-infra | 08:20 | |
| *** electrofelix has joined #openstack-infra | 08:21 | |
| *** markvoelker has quit IRC | 08:22 | |
| *** cschwede has joined #openstack-infra | 08:23 | |
| *** benj_ has quit IRC | 08:25 | |
| *** zhurong has joined #openstack-infra | 08:27 | |
| pabelanger | OpenStackCloudException: Error in creating instance (Inner Exception: Quota exceeded for cores, instances: Requested 8, 1, but already used 400, 50 of 400, 50 cores, instances (HTTP 403) (Request-ID: req-04c56921-8d0a-404f-8321-0b33c35e133e)) | 08:30 |
| pabelanger | seeing that in sto2 atm | 08:30 |
| *** benj_ has joined #openstack-infra | 08:33 | |
| *** lucas-afk is now known as lucasagomes | 08:33 | |
| *** yamahata_ has quit IRC | 08:34 | |
| *** sree has quit IRC | 08:34 | |
| *** markvoelker has joined #openstack-infra | 08:36 | |
| *** ijw has joined #openstack-infra | 08:36 | |
| *** iyamahat has quit IRC | 08:37 | |
| *** mpaolino has joined #openstack-infra | 08:37 | |
| *** ijw has quit IRC | 08:37 | |
| *** jascott1 has quit IRC | 08:37 | |
| *** sree has joined #openstack-infra | 08:38 | |
| *** derekh has joined #openstack-infra | 08:38 | |
| *** jascott1 has joined #openstack-infra | 08:38 | |
| dnikishov | hello, can I get some reviews please @ https://review.openstack.org/#/c/475323/ ? | 08:38 |
| *** ijw has joined #openstack-infra | 08:38 | |
| *** dmk0202 has joined #openstack-infra | 08:40 | |
| *** tosky has joined #openstack-infra | 08:40 | |
| dnikishov | SergeyLukjanov: ^ | 08:40 |
| *** ijw has quit IRC | 08:42 | |
| *** markvoelker has quit IRC | 08:42 | |
| *** jascott1 has quit IRC | 08:42 | |
| *** aarefiev_afk is now known as aarefiev | 08:43 | |
| openstackgerrit | Merged openstack-infra/project-config master: jenkins: scripts: propose_update: Turn on OSA updates on all repositories https://review.openstack.org/475734 | 08:47 |
| *** jamesmcarthur has joined #openstack-infra | 08:47 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:48 | |
| openstackgerrit | Merged openstack-infra/project-config master: Move rally-py35 to experimental neutron https://review.openstack.org/475725 | 08:48 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove stackviz from tools/build-image.sh https://review.openstack.org/476160 | 08:50 |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder master: Implement a publisher for HockeyApp https://review.openstack.org/371178 | 08:51 |
| *** jamesmcarthur has quit IRC | 08:52 | |
| openstackgerrit | Merged openstack-infra/project-config master: networking-midonet: Move centos jobs out of experimental https://review.openstack.org/476196 | 08:53 |
| *** apuimedo is now known as apuimedo|away | 08:55 | |
| openstackgerrit | Merged openstack-infra/project-config master: networking-midonet: Remove mitaka jobs https://review.openstack.org/476205 | 08:55 |
| *** dingyichen has quit IRC | 08:57 | |
| *** markvoelker has joined #openstack-infra | 09:00 | |
| *** hashar has quit IRC | 09:01 | |
| *** yamamoto has joined #openstack-infra | 09:04 | |
| *** hashar has joined #openstack-infra | 09:04 | |
| *** salv-orlando has joined #openstack-infra | 09:04 | |
| *** markvoelker has quit IRC | 09:05 | |
| *** eranrom has quit IRC | 09:08 | |
| *** yamamoto has quit IRC | 09:09 | |
| *** yamamoto has joined #openstack-infra | 09:09 | |
| *** hashar_ has joined #openstack-infra | 09:09 | |
| *** arif-ali has quit IRC | 09:09 | |
| *** hashar has quit IRC | 09:09 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: prepare subunit fail https://review.openstack.org/476427 | 09:10 |
| *** efoley has joined #openstack-infra | 09:13 | |
| *** salv-orlando has quit IRC | 09:13 | |
| *** zhurong has quit IRC | 09:16 | |
| openstackgerrit | James Page proposed openstack-infra/project-config master: Add dsvm-lxd-ovs check to nova-lxd gate https://review.openstack.org/476432 | 09:19 |
| *** bhavik1 has joined #openstack-infra | 09:23 | |
| *** eranrom has joined #openstack-infra | 09:24 | |
| *** dtantsur is now known as dtantsur|bbl | 09:25 | |
| *** JudeC has quit IRC | 09:25 | |
| *** eranrom has quit IRC | 09:26 | |
| *** apetrich has joined #openstack-infra | 09:29 | |
| *** yamamoto has quit IRC | 09:30 | |
| *** apuimedo|away is now known as apuimedo | 09:35 | |
| *** yamamoto has joined #openstack-infra | 09:36 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/devstack-gate master: Add horizon to projects if testing django_os_auth https://review.openstack.org/476440 | 09:36 |
| openstackgerrit | Johannes Kulik proposed openstack-infra/project-config master: Let unbound find rc.local on Debian stretch in DIB https://review.openstack.org/476442 | 09:39 |
| *** hashar_ has quit IRC | 09:40 | |
| *** dmk0202 has quit IRC | 09:40 | |
| *** sdague has joined #openstack-infra | 09:44 | |
| *** yamamoto has quit IRC | 09:46 | |
| *** gildub has quit IRC | 09:49 | |
| *** liujiong has quit IRC | 09:59 | |
| *** bhavik1 has quit IRC | 10:00 | |
| *** spiffxp_ has quit IRC | 10:03 | |
| *** vipul has quit IRC | 10:04 | |
| *** rhallisey has joined #openstack-infra | 10:04 | |
| *** rhallisey has quit IRC | 10:04 | |
| *** salv-orlando has joined #openstack-infra | 10:05 | |
| *** rhallisey has joined #openstack-infra | 10:05 | |
| *** vipul has joined #openstack-infra | 10:05 | |
| *** spiffxp has joined #openstack-infra | 10:06 | |
| *** tumbarka has joined #openstack-infra | 10:12 | |
| *** salv-orl_ has joined #openstack-infra | 10:12 | |
| *** tushar has quit IRC | 10:12 | |
| *** wfoster has quit IRC | 10:13 | |
| *** stakeda has quit IRC | 10:13 | |
| *** wfoster has joined #openstack-infra | 10:13 | |
| *** salv-orlando has quit IRC | 10:15 | |
| *** flepied has joined #openstack-infra | 10:16 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 10:17 |
| *** rook has quit IRC | 10:18 | |
| *** wfoster has quit IRC | 10:18 | |
| *** hrubi has quit IRC | 10:20 | |
| *** yamamoto has joined #openstack-infra | 10:21 | |
| *** wfoster has joined #openstack-infra | 10:23 | |
| *** esberglu has joined #openstack-infra | 10:23 | |
| *** cshastri has quit IRC | 10:25 | |
| *** s-shiono_ has quit IRC | 10:27 | |
| *** rook has joined #openstack-infra | 10:27 | |
| *** esberglu has quit IRC | 10:27 | |
| *** rook is now known as Guest250 | 10:28 | |
| arxcruz | mtreinish: around ? | 10:28 |
| *** yamamoto has quit IRC | 10:28 | |
| *** gildub has joined #openstack-infra | 10:30 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/nose-html-output master: Python 3 support https://review.openstack.org/476456 | 10:30 |
| *** zhurong has joined #openstack-infra | 10:31 | |
| *** dtantsur|bbl is now known as dtantsur | 10:34 | |
| *** yamamoto has joined #openstack-infra | 10:34 | |
| *** wolverineav has joined #openstack-infra | 10:35 | |
| *** hrubi has joined #openstack-infra | 10:36 | |
| *** gildub has quit IRC | 10:36 | |
| *** markvoelker has joined #openstack-infra | 10:36 | |
| *** yamamoto has quit IRC | 10:39 | |
| *** yamamoto has joined #openstack-infra | 10:40 | |
| *** markvoelker has quit IRC | 10:41 | |
| *** eranrom has joined #openstack-infra | 10:43 | |
| *** gildub has joined #openstack-infra | 10:43 | |
| *** sflanigan has joined #openstack-infra | 10:43 | |
| *** sflanigan has joined #openstack-infra | 10:43 | |
| *** hrubi has quit IRC | 10:44 | |
| *** hrubi has joined #openstack-infra | 10:44 | |
| *** sree has quit IRC | 10:45 | |
| *** baoli has joined #openstack-infra | 10:46 | |
| *** kzaitsev_mb has quit IRC | 10:46 | |
| *** markvoelker has joined #openstack-infra | 10:47 | |
| *** gongysh has quit IRC | 10:47 | |
| *** jamesmcarthur has joined #openstack-infra | 10:48 | |
| *** flepied has quit IRC | 10:48 | |
| *** hrubi has quit IRC | 10:48 | |
| *** baoli has quit IRC | 10:51 | |
| *** jamesmcarthur has quit IRC | 10:52 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 10:52 | |
| *** mat128 has joined #openstack-infra | 10:53 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:55 | |
| *** markvoelker has quit IRC | 10:55 | |
| *** sambetts|afk has quit IRC | 10:56 | |
| *** katkapilatova has joined #openstack-infra | 10:57 | |
| *** sambetts_ has joined #openstack-infra | 11:02 | |
| *** hrubi has joined #openstack-infra | 11:03 | |
| *** jkilpatr has joined #openstack-infra | 11:05 | |
| *** lucasagomes is now known as lucas-hungry | 11:10 | |
| *** flepied has joined #openstack-infra | 11:11 | |
| *** yamamoto has quit IRC | 11:11 | |
| *** hashar has joined #openstack-infra | 11:17 | |
| *** kzaitsev_mb has quit IRC | 11:19 | |
| *** ijw has joined #openstack-infra | 11:20 | |
| *** hrubi has quit IRC | 11:23 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:24 | |
| *** ijw has quit IRC | 11:25 | |
| *** hrubi has joined #openstack-infra | 11:25 | |
| *** salv-orl_ has quit IRC | 11:26 | |
| *** salv-orlando has joined #openstack-infra | 11:27 | |
| openstackgerrit | Pratik Shah proposed openstack-infra/project-config master: Added changes to run unit tests for Omni project using Zuul https://review.openstack.org/475300 | 11:28 |
| *** kzaitsev_mb has quit IRC | 11:32 | |
| *** yamamoto has joined #openstack-infra | 11:33 | |
| *** arif-ali has joined #openstack-infra | 11:34 | |
| amotoki | AJaeger: ping | 11:38 |
| *** dizquierdo has joined #openstack-infra | 11:38 | |
| *** yamamoto has quit IRC | 11:39 | |
| *** jascott1 has joined #openstack-infra | 11:40 | |
| *** hrubi has quit IRC | 11:43 | |
| *** jascott1 has quit IRC | 11:44 | |
| *** hrubi has joined #openstack-infra | 11:45 | |
| *** hashar has quit IRC | 11:46 | |
| *** hashar has joined #openstack-infra | 11:46 | |
| *** jamesmcarthur has joined #openstack-infra | 11:47 | |
| *** amoralej is now known as amoralej|lunch | 11:47 | |
| *** pradk has joined #openstack-infra | 11:49 | |
| *** rwsu has joined #openstack-infra | 11:50 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set jobs subunit file as fail until it's overwritten https://review.openstack.org/476427 | 11:51 |
| *** jamesmcarthur has quit IRC | 11:51 | |
| *** hashar has quit IRC | 11:53 | |
| *** hrubi has quit IRC | 11:54 | |
| *** Hudu has joined #openstack-infra | 11:55 | |
| *** hrubi has joined #openstack-infra | 11:57 | |
| *** ldnunes has joined #openstack-infra | 11:58 | |
| openstackgerrit | Merged openstack/diskimage-builder master: On suse the python2 dev package is python-devel https://review.openstack.org/475051 | 12:01 |
| *** zhurong has quit IRC | 12:01 | |
| *** ramishra has quit IRC | 12:03 | |
| *** sflanigan has quit IRC | 12:03 | |
| *** hashar has joined #openstack-infra | 12:03 | |
| *** aarefiev has quit IRC | 12:04 | |
| *** ramishra has joined #openstack-infra | 12:05 | |
| *** tuanluong has quit IRC | 12:06 | |
| *** salv-orlando has quit IRC | 12:06 | |
| *** namnh_ has quit IRC | 12:07 | |
| *** salv-orlando has joined #openstack-infra | 12:07 | |
| *** aarefiev has joined #openstack-infra | 12:10 | |
| *** salv-orlando has quit IRC | 12:12 | |
| *** dprince has joined #openstack-infra | 12:12 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 12:13 |
| *** trown|outtypewww is now known as trown | 12:13 | |
| fungi | andreaf: are you trying with the mosquitto_sub cli or one of the mqtt libs directly? mostly curious to see your topic pattern and how you're passing it in since a misplaced # wildcard could certainly cause what you describe | 12:16 |
| *** zhurong has joined #openstack-infra | 12:16 | |
| *** lucas-hungry is now known as lucasagomes | 12:16 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config master: update descriptions of some projects I maintain https://review.openstack.org/476488 | 12:17 |
| sdague | fungi: I'm not sure if you've caught up on the ML yet, but I would volunteer to go and do some topic updates on projects manually, given that it doesn't seem to be in the api | 12:18 |
| sdague | but I would need access privs to do so | 12:18 |
| *** zhurong has quit IRC | 12:18 | |
| *** hashar has quit IRC | 12:18 | |
| *** hashar has joined #openstack-infra | 12:18 | |
| *** yamamoto has joined #openstack-infra | 12:19 | |
| *** yamamoto has quit IRC | 12:19 | |
| *** cuongnv has quit IRC | 12:20 | |
| *** gcb has joined #openstack-infra | 12:20 | |
| openstackgerrit | Andy McCrae proposed openstack-infra/project-config master: Fix zuul-clone command for keystone OSA upgrade job https://review.openstack.org/476168 | 12:22 |
| fungi | sdague: yeah, i scrubbed the api docs. looks like in the v3 api there is an experimental developer preview feature for repository topics but i can't tell if it can also set them or just list them. the v4 graphql api also seems to have some support for repository topics but would need testing | 12:24 |
| apuimedo | dims: lifeless: dhellmann: flaper87: could you take a look at https://review.openstack.org/#/c/476489/ . We need this change in Kuryr CNI | 12:24 |
| sdague | fungi: it's get only | 12:24 |
| fungi | sdague: bigger issue i think is pinning. looks like there's no pinning support in the v3 rest api at all, and the v4 graphql api only seems to have support for user-pinned lists not organization-pinned | 12:24 |
| sdague | fungi: right, so pinning I'm less concerned on | 12:25 |
| sdague | because we're talking about 6 repos | 12:25 |
| fungi | though it looks like they're relatively responsive to developer requests for new graphql api objects/methods | 12:25 |
| sdague | I can just do that in 120s | 12:25 |
| *** rfolco has joined #openstack-infra | 12:25 | |
| *** Hudu has quit IRC | 12:25 | |
| fungi | only 6? i figured the request was going to be pinning all the api services or something | 12:25 |
| fungi | but yeah, i guess that's not so tough to maintain manually, which is more or less where i was going with the whole thing too | 12:26 |
| sdague | I assumed we'd mirror the popular projects from https://www.openstack.org/software/ | 12:26 |
| *** chlong has quit IRC | 12:26 | |
| sdague | at least as a starting point | 12:26 |
| *** gongysh has joined #openstack-infra | 12:27 | |
| fungi | and thanks for volunteering, i'll still need to bring it up with the rest of the infra team but i expect that's the best compromise we're going to come up with is to have someone from the community or on the foundation marketing team added as an org admin to take care of pins and topics | 12:27 |
| sdague | fungi: yep no problem. I think it will make a difference, so happy to put in the time to do some manual bits here | 12:28 |
| fungi | basically treat the openstack org on github the same way we treat twitter or ohloh (i.e. not an infra team problem) | 12:28 |
| sdague | fungi: sure | 12:28 |
| fungi | github is social media, so i think we can start thinking about it the same way we do other socual media | 12:29 |
| fungi | s/socual/social/ | 12:29 |
| sdague | :) | 12:29 |
| *** jpena is now known as jpena|lunch | 12:29 | |
| fungi | and now the hvac contractor is here, so i gotta disappear | 12:29 |
| sdague | enjoy | 12:30 |
| *** rlandy has joined #openstack-infra | 12:32 | |
| dims | apuimedo : added ttx to that review. looks legit to me :) | 12:33 |
| *** eharney has quit IRC | 12:33 | |
| *** pgadiya has quit IRC | 12:34 | |
| *** flepied has quit IRC | 12:36 | |
| *** yamamoto has joined #openstack-infra | 12:36 | |
| *** sree has joined #openstack-infra | 12:37 | |
| *** gordc has joined #openstack-infra | 12:39 | |
| *** hrubi has quit IRC | 12:41 | |
| *** dave-mccowan has joined #openstack-infra | 12:43 | |
| *** gomarivera_ has joined #openstack-infra | 12:45 | |
| *** mat128 has quit IRC | 12:45 | |
| *** gomarivera has quit IRC | 12:46 | |
| *** ramishra has quit IRC | 12:46 | |
| *** mat128 has joined #openstack-infra | 12:47 | |
| *** ramishra has joined #openstack-infra | 12:48 | |
| ttx | dims apuimedo: +2A | 12:50 |
| *** ericyoung has joined #openstack-infra | 12:50 | |
| *** yamamoto has quit IRC | 12:51 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config master: update descriptions of some projects I maintain https://review.openstack.org/476488 | 12:52 |
| *** hrubi has joined #openstack-infra | 12:52 | |
| flaper87 | apuimedo: ttx dims I +'2d and dropped a question but ttx beat me and +2A | 12:52 |
| ttx | flaper87: ah oops | 12:52 |
| dnikishov | hello, can I get some reviews please @ https://review.openstack.org/#/c/475323/ ? | 12:52 |
| flaper87 | ttx: np, race review but not a blocker, I think | 12:53 |
| *** bobh has joined #openstack-infra | 12:53 | |
| ttx | yeah, we can always be more liberal in what we accept | 12:53 |
| *** gomarivera_ has quit IRC | 12:55 | |
| *** gildub has quit IRC | 12:56 | |
| *** hwoarang has quit IRC | 12:56 | |
| *** danpawlik_ is now known as danpawlik | 12:56 | |
| *** hwoarang has joined #openstack-infra | 12:56 | |
| *** efoley has quit IRC | 12:57 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: enable voting on tripleo-containers jobs https://review.openstack.org/472536 | 12:58 |
| *** bh526r has joined #openstack-infra | 12:58 | |
| *** annegentle has joined #openstack-infra | 13:00 | |
| *** hwoarang_ has joined #openstack-infra | 13:02 | |
| ttx | apuimedo: I blocked the merge since dhellmann has a good question, which the bug comments only answer partially | 13:02 |
| *** pradk has quit IRC | 13:02 | |
| apuimedo | ttx: thanks. I'll look at it after my current meeting | 13:02 |
| *** dizquierdo has quit IRC | 13:03 | |
| *** jamesdenton has joined #openstack-infra | 13:04 | |
| *** hwoarang has quit IRC | 13:04 | |
| *** esberglu has joined #openstack-infra | 13:05 | |
| apuimedo | dhellmann: ttx: I put it where it is for consistency with the helper_command configuration | 13:05 |
| *** Guest250 is now known as rook | 13:06 | |
| apuimedo | which also seems something that is not so much for the deployer as it is application dependant | 13:06 |
| apuimedo | but I may be wrong on that | 13:07 |
| *** sflanigan has joined #openstack-infra | 13:07 | |
| *** LindaWang has quit IRC | 13:08 | |
| ttx | apuimedo: let's move to -dev, as this is a bit off-topic here | 13:09 |
| *** esberglu has quit IRC | 13:09 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: tripleo/containers: run jobs when touching docker services https://review.openstack.org/476510 | 13:10 |
| apuimedo | ttx: ok, sorry | 13:10 |
| *** bobh has quit IRC | 13:12 | |
| *** yamamoto has joined #openstack-infra | 13:15 | |
| *** pfallenop has quit IRC | 13:16 | |
| *** baoli has joined #openstack-infra | 13:16 | |
| *** eharney has joined #openstack-infra | 13:18 | |
| *** pfallenop has joined #openstack-infra | 13:18 | |
| *** pfallenop has joined #openstack-infra | 13:18 | |
| *** markvoelker has joined #openstack-infra | 13:22 | |
| *** pradk has joined #openstack-infra | 13:22 | |
| *** hrubi has quit IRC | 13:23 | |
| *** esberglu has joined #openstack-infra | 13:24 | |
| *** xyang1 has joined #openstack-infra | 13:26 | |
| *** hrubi has joined #openstack-infra | 13:27 | |
| *** mdrabe has joined #openstack-infra | 13:28 | |
| *** LindaWang has joined #openstack-infra | 13:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-infra/post playbook https://review.openstack.org/476516 | 13:30 |
| *** liujiong has joined #openstack-infra | 13:31 | |
| pabelanger | odyssey4me: ^ was why I was asking about add_host | 13:31 |
| *** Goneri has joined #openstack-infra | 13:32 | |
| *** jpena|lunch is now known as jpena | 13:32 | |
| *** zz_dimtruck is now known as dimtruck | 13:34 | |
| *** gouthamr has joined #openstack-infra | 13:35 | |
| *** amoralej|lunch is now known as amoralej | 13:36 | |
| *** sree has quit IRC | 13:36 | |
| fungi | infra-root: (and rest of the channel for that matter) reminder that i'm not really here today through monday, though i'll try to check in occasionally in case anything ptl-urgent comes up | 13:37 |
| *** chlong has joined #openstack-infra | 13:39 | |
| *** edmondsw_ has joined #openstack-infra | 13:40 | |
| *** edmondsw_ has quit IRC | 13:40 | |
| *** psachin has quit IRC | 13:42 | |
| dnikishov | pabelanger: could you please take a look @ https://review.openstack.org/#/c/475323/? Thanks | 13:42 |
| *** edmondsw has joined #openstack-infra | 13:42 | |
| *** mriedem has joined #openstack-infra | 13:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/system-config master: Set up new logstash index files for TripleO https://review.openstack.org/476524 | 13:43 |
| *** bobh has joined #openstack-infra | 13:45 | |
| *** gouthamr has quit IRC | 13:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-infra/post playbook https://review.openstack.org/476516 | 13:48 |
| pabelanger | jeblair: mordred: ^ an example we could do for log publisher. Ready to bikeshed | 13:48 |
| *** gomarivera has joined #openstack-infra | 13:49 | |
| *** dnikishov1 has joined #openstack-infra | 13:51 | |
| *** gouthamr has joined #openstack-infra | 13:52 | |
| *** markvoelker has quit IRC | 13:53 | |
| *** jokke__ is now known as jokke_ | 13:55 | |
| *** jcoufal has joined #openstack-infra | 13:58 | |
| *** felipemonteiro has joined #openstack-infra | 14:00 | |
| *** jbadiapa_ has quit IRC | 14:01 | |
| *** marst has joined #openstack-infra | 14:01 | |
| *** jamesdenton has quit IRC | 14:02 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:02 | |
| *** dizquierdo has joined #openstack-infra | 14:02 | |
| *** rhallisey has quit IRC | 14:04 | |
| *** dnikishov1 has quit IRC | 14:04 | |
| *** rhallisey has joined #openstack-infra | 14:05 | |
| *** felipemonteiro has quit IRC | 14:06 | |
| *** askb has quit IRC | 14:06 | |
| *** spzala has joined #openstack-infra | 14:12 | |
| lbragstad | andymccr: thanks for cleaning up https://review.openstack.org/#/c/476168/2 | 14:14 |
| andymccr | lbragstad: no problem! Hopefully that'll work! | 14:15 |
| *** mdrabe has quit IRC | 14:15 | |
| lbragstad | andymccr: i'll rebase my test patch sometime today if that merges | 14:15 |
| andymccr | lbragstad: sounds good | 14:15 |
| pabelanger | jlk: https://review.openstack.org/476516 do you mind reviewing, since we are talking about it | 14:16 |
| *** jbadiapa_ has joined #openstack-infra | 14:16 | |
| *** mdrabe has joined #openstack-infra | 14:17 | |
| *** liujiong has quit IRC | 14:18 | |
| *** jbadiapa_ has quit IRC | 14:18 | |
| *** jbadiapa_ has joined #openstack-infra | 14:18 | |
| *** rbrndt has joined #openstack-infra | 14:20 | |
| *** jamesdenton has joined #openstack-infra | 14:20 | |
| *** dhajare has quit IRC | 14:20 | |
| *** jamesdenton has quit IRC | 14:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-infra/post playbook https://review.openstack.org/476516 | 14:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-infra/post playbook https://review.openstack.org/476516 | 14:26 |
| *** hongbin has joined #openstack-infra | 14:26 | |
| *** ykarel_ has quit IRC | 14:32 | |
| openstackgerrit | Antoine Musso proposed openstack-infra/jenkins-job-builder master: Complete support of Yaml Axis Plugin https://review.openstack.org/286690 | 14:36 |
| *** salv-orlando has joined #openstack-infra | 14:36 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder master: Update builders_from to make use of convert_mapping_to_xml() https://review.openstack.org/475142 | 14:37 |
| *** dprince has quit IRC | 14:43 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder master: Update artifact_resolver to make use of convert_mapping_to_xml() https://review.openstack.org/473994 | 14:43 |
| *** sbezverk has quit IRC | 14:44 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder master: Update Ant Plugin to make use of convert_mapping_to_xml() https://review.openstack.org/473632 | 14:45 |
| *** hrubi has quit IRC | 14:45 | |
| *** jpena is now known as jpena|brb | 14:45 | |
| *** links has quit IRC | 14:45 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder master: Update trigger_remote to make use of convert_mapping_to_xml https://review.openstack.org/473965 | 14:47 |
| *** katkapilatova has left #openstack-infra | 14:47 | |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder master: Update plot plugin https://review.openstack.org/476540 | 14:48 |
| *** hrubi has joined #openstack-infra | 14:48 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder master: Update shell and python plugins to make use of convert_mapping_to_xml https://review.openstack.org/473051 | 14:48 |
| *** dhajare has joined #openstack-infra | 14:49 | |
| zxiiro | zaro: electrofelix: waynr: hey guys. I'd like to consider putting Dong Ma up again for core-reviewer I think he's done a significant amount of patches as well as code reviews since the last time we considered him. Thoughts? https://review.openstack.org/#/q/owner:%22Dong+Ma%22 | 14:55 |
| *** markvoelker has joined #openstack-infra | 14:55 | |
| *** Swami has joined #openstack-infra | 14:55 | |
| *** LindaWang has quit IRC | 14:56 | |
| odyssey4me | clarkb fungi we're still seeing dns failures for images.linuxcontainers.org regularly :/ | 14:56 |
| odyssey4me | I'd like us to setup a reverse proxy for that site - how do I go about doing that? | 14:57 |
| *** mdrabe has quit IRC | 14:59 | |
| *** LindaWang has joined #openstack-infra | 15:01 | |
| *** aarefiev is now known as aarefiev_afk | 15:02 | |
| *** jbadiapa_ has quit IRC | 15:02 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 15:04 |
| *** hwoarang_ is now known as hwoarang | 15:04 | |
| openstackgerrit | Antoine Musso proposed openstack-infra/jenkins-job-builder master: project matrix: rename variable/refactor https://review.openstack.org/322976 | 15:09 |
| *** rcernin has quit IRC | 15:09 | |
| *** iyamahat has joined #openstack-infra | 15:10 | |
| *** yamahata has joined #openstack-infra | 15:10 | |
| *** pblaho has quit IRC | 15:10 | |
| *** yee379 has quit IRC | 15:10 | |
| *** yee379 has joined #openstack-infra | 15:10 | |
| AJaeger | amotoki: I'm here now | 15:13 |
| *** camunoz has joined #openstack-infra | 15:16 | |
| *** jamesmcarthur has joined #openstack-infra | 15:16 | |
| *** ltomasbo is now known as ltomasbo|away | 15:16 | |
| *** eharney_ has joined #openstack-infra | 15:17 | |
| *** marst_ has joined #openstack-infra | 15:17 | |
| *** jbadiapa_ has joined #openstack-infra | 15:17 | |
| *** eharney has quit IRC | 15:18 | |
| amotoki | AJaeger: hi. I'd like to check you on translation job on non-official project. | 15:18 |
| amotoki | AJaeger: what i need to do is to drop both docs publishing including release notes and translation jobs, right? | 15:18 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 15:19 |
| AJaeger | amotoki: yes | 15:19 |
| AJaeger | amotoki: I'll double check and if there's more, I'll comment once you update | 15:20 |
| *** danpawlik is now known as danpawlik_ | 15:20 | |
| *** marst has quit IRC | 15:20 | |
| amotoki | AJaeger: thanks. I was not aware that translation job is not allowed. the strategy horizon plugin split out might need to be changed to keep translations for existing VPNaaS translations. | 15:20 |
| AJaeger | amotoki: the translations will stay in translation memory AFAIU | 15:22 |
| AJaeger | and didn't you want to get VPNaaS into Neutron official? | 15:22 |
| amotoki | AJaeger: it's only for translators. users cannot consume it. | 15:22 |
| amotoki | AJaeger: it is under the way to be back to the official. | 15:22 |
| AJaeger | amotoki: correct | 15:22 |
| AJaeger | amotoki: so, once it's official, set up translations again... | 15:23 |
| amotoki | AJaeger: yeah, that's true. just wondering how we can move this forward until then. | 15:25 |
| amotoki | AJaeger: some background: neutron and horizon teams agree that networking feature in the main neutron repo should go to horizon and other stadium networking features should be implemented as horizon plugins. | 15:26 |
| *** mdrabe has joined #openstack-infra | 15:26 | |
| *** bauzas has quit IRC | 15:26 | |
| amotoki | that's the background and we already block vpnaas patches in horizon. anyway I will check the approach. thanks. | 15:26 |
| openstackgerrit | Yolande Amate proposed openstack-infra/jenkins-job-builder master: Update shell and python plugins to use convert_mapping_to_xml https://review.openstack.org/473051 | 15:27 |
| *** bauzas has joined #openstack-infra | 15:27 | |
| *** jbadiapa_ has quit IRC | 15:27 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 15:29 |
| *** eharney_ has quit IRC | 15:30 | |
| *** jamesdenton has joined #openstack-infra | 15:33 | |
| *** ccamacho has quit IRC | 15:33 | |
| *** wolverineav has quit IRC | 15:34 | |
| *** markus_z has quit IRC | 15:34 | |
| *** eharney has joined #openstack-infra | 15:34 | |
| *** Swami has quit IRC | 15:35 | |
| *** jamesdenton has quit IRC | 15:36 | |
| *** gardlt has joined #openstack-infra | 15:37 | |
| clarkb | odyssey4me: can you point me to those failures? my rough logstash querying yesterday showed that switching to ipv6 only resolvers in osic seemed to correct things | 15:39 |
| clarkb | odyssey4me: the only fails I could find were for a name that had no A or AAAA record in the epel mirror list | 15:39 |
| odyssey4me | clarkb one example (see all the rechecks) https://review.openstack.org/#/c/474734/ | 15:40 |
| *** dtantsur is now known as dtantsur|afk | 15:40 | |
| odyssey4me | http://logs.openstack.org/34/474734/3/check/gate-openstack-ansible-os_keystone-ansible-uw_apache-ubuntu-xenial/5df3797/console.html#_2017-06-22_07_20_33_445061 | 15:40 |
| clarkb | odyssey4me: I want to make sure its not another case like the epel mirror that just doesn't have dns records | 15:41 |
| odyssey4me | http://logs.openstack.org/34/474734/3/check/gate-openstack-ansible-os_keystone-ansible-uw_nginx-ubuntu-xenial/f3609ae/console.html#_2017-06-22_07_21_11_745872 | 15:41 |
| clarkb | and that name does resolve both A and AAAA via a CNAME | 15:41 |
| odyssey4me | it's also infracloud and internap, so it's cross provider | 15:42 |
| *** pcaruana has quit IRC | 15:42 | |
| clarkb | odyssey4me: is that lookup running in the base infra vm or in a container? wondering what resolver it will be using | 15:42 |
| odyssey4me | the container uses the host resolver | 15:42 |
| *** hashar is now known as hasharAway | 15:43 | |
| odyssey4me | but that's happening on the host | 15:43 |
| clarkb | odyssey4me: (message:"Temporary failure in name resolution." OR message:"Temporary failure resolving" OR message:"wget: unable to resolve" OR message:"Could not resolve host") AND NOT message:"Could not resolve host: fake" AND tags:"console" | 15:44 |
| clarkb | that is my logstash query string. I'm looking at that to see if it gives any more insight | 15:44 |
| clarkb | as for setting up a reverse proxy it should be ~3 lines in the existing vhost to get that now. Let me get a link | 15:45 |
| clarkb | odyssey4me: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/mirror.vhost.erb#n110 you should just need a section in the per site reverse caching proxy rules | 15:46 |
| *** gyee has joined #openstack-infra | 15:46 | |
| *** ltomasbo|away is now known as ltomasbo | 15:47 | |
| odyssey4me | clarkb odd, logstash.openstack.org isn't working for me | 15:47 |
| odyssey4me | just a blank page | 15:47 |
| clarkb | odyssey4me: try a hard refresh | 15:48 |
| odyssey4me | oh, here it comes - just very slow | 15:48 |
| clarkb | the distribution of failurse is definitely far more spread out than it used to be | 15:49 |
| clarkb | and os ansible jobs light up trying to ersolve that images.linuxcontainers.org name across clouds and regions and across the world too | 15:50 |
| clarkb | first thing that comes to mind is maybe they broke their dns record? but I can resolve it locally now so hard to confirm that other than waiting so lets ignore it for a minute | 15:51 |
| openstackgerrit | Sanket Sudake proposed openstack-infra/project-config master: Added changes to run unit tests for Omni project using Zuul https://review.openstack.org/475300 | 15:52 |
| odyssey4me | clarkb are the hosts set to rotate/retry different servers? | 15:52 |
| clarkb | odyssey4me: yes, unbound is currently configured to use opendns and google dns. It will use ipv6 resolvers if on hosts with routable ipv6 (osic + rax) and ipv4 resolvers elsewhere | 15:53 |
| clarkb | odyssey4me: we were just using google dns but first thing we did when dns started getting sad was diversify to include opendns | 15:54 |
| *** andreas_s has quit IRC | 15:54 | |
| *** dprince has joined #openstack-infra | 15:54 | |
| clarkb | so that change has been in place for a few days now | 15:54 |
| odyssey4me | hmm, do you think that using a reverse proxy for this will help at all? | 15:55 |
| *** rderose has joined #openstack-infra | 15:55 | |
| odyssey4me | or would caching in AFS or in the image be better? | 15:55 |
| clarkb | odyssey4me: if the issue is general upstream reliability then possibly a little as you'll cache in the proxy problem is that proxy is still vulnerable to the upstream going away when cache is stale | 15:56 |
| clarkb | afs is nice bceause it allows us to control the content and publish it only when the aggregate is ready/whole/complete | 15:56 |
| clarkb | the downside to afs is that it performs poorly over large distances so we are actually looking at possibly setting up our region local mirrors to reverse proxy cache to a central afs published mirror | 15:57 |
| clarkb | odyssey4me: reading your example job log that job does quite a few things that will require a dns lookup before the failure. git clones tox pip installs etc | 15:59 |
| clarkb | odyssey4me: and considering all of the dns failures in your jobs are for that one name I'm inclined to think there was a problem with the name itself (otherwise I would expect to see git.o.o or mirror.foo.bar.o.o lookup failurse too | 15:59 |
| clarkb | another possiblitly is that some side effect of the job is breaking name resolution before then and then that specific step trips over it | 16:00 |
| *** dnikishov2 has joined #openstack-infra | 16:00 | |
| *** jpena|brb is now known as jpena | 16:01 | |
| *** dizquierdo has quit IRC | 16:01 | |
| odyssey4me | clarkb sure, except that this process worked just fine before the dns config change in infra | 16:01 |
| odyssey4me | what was the dns config before this switch? | 16:01 |
| odyssey4me | using the cloud provider DNS perhaps? | 16:02 |
| clarkb | odyssey4me: we haven't used the dns in cloud provider for years because it doesn't work in rackspace (due to ip blacklists) | 16:03 |
| clarkb | odyssey4me: the only real change at this point was switching to ip version specific resolvers depending on whether or not ipv6 is routable in cloud | 16:03 |
| odyssey4me | odd | 16:03 |
| clarkb | odyssey4me: and that went in ~29 hours ago on the xenial images | 16:03 |
| odyssey4me | we started hitting these issues a week ago, on friday IIRC | 16:04 |
| *** dizquierdo has joined #openstack-infra | 16:04 | |
| *** HeOS has quit IRC | 16:04 | |
| clarkb | odyssey4me: there have been general dns issues for a while now a little longer than that iirc | 16:04 |
| *** gongysh has quit IRC | 16:05 | |
| *** Apoorva has joined #openstack-infra | 16:05 | |
| clarkb | odyssey4me: the vast majority were in osic so we theorized the issue was with ipv4 NAT since we don't have public ipv4 addresses there. Which is what led us to switch to ip version specific resolvers | 16:05 |
| clarkb | odyssey4me: that seems to have corrected the osic specific problem. It no longer has a 35:5 fail rate over 6 hours compared to other regions | 16:05 |
| clarkb | the distribution now is much less cloud specific | 16:06 |
| clarkb | also when we had those problems the domain name being looked up wasn't fixed | 16:06 |
| clarkb | git.o.o, zmXX.o.o, github.com, etc were all affected | 16:06 |
| *** mdrabe has quit IRC | 16:07 | |
| *** mdrabe has joined #openstack-infra | 16:07 | |
| odyssey4me | hmm, well for a test and to buy us some time I can push the IP's for this name into /etc/hosts for our tests | 16:07 |
| *** yamamoto has quit IRC | 16:08 | |
| odyssey4me | maybe something has gone wrong upstream, although we're not seeing these errors outside openstack-infra | 16:08 |
| odyssey4me | so it's weird | 16:08 |
| *** jpich has quit IRC | 16:08 | |
| clarkb | odyssey4me: if you do that and see the next lookup after that name fail then I think we likely have some setup conflict where dns is being trashed before that step. If everything magically works with that in place I think it is the upstream name | 16:08 |
| clarkb | and yes I confirm the name resolves for me as well. However maybe that means they just fixed it? | 16:08 |
| *** yamamoto has joined #openstack-infra | 16:10 | |
| odyssey4me | it's been resolving for me consistently when I test | 16:10 |
| odyssey4me | (via dig) | 16:10 |
| *** salv-orl_ has joined #openstack-infra | 16:12 | |
| clarkb | odyssey4me: (message:"Temporary failure in name resolution." OR message:"Temporary failure resolving" OR message:"wget: unable to resolve" OR message:"Could not resolve host") AND NOT message:"Could not resolve host: fake" AND NOT message:"images.linuxcontainers.org" AND NOT message:"us.images.linuxcontainers.org" AND NOT message:"uk.images.linuxcontainers.org" AND tags:"console" | 16:12 |
| clarkb | odyssey4me: using that query the results are all hits for names that don't resolve or are fake test names that shouldn't resolve | 16:12 |
| clarkb | except for the last two | 16:13 |
| odyssey4me | when querying images.linuxcontainers.org I get a CNAME to canonical.images.linuxcontainers.org which has two A records | 16:13 |
| clarkb | er 3? so ya 2 or 3 dns failures total in 12 hours if we exclude known bad names and linuxcontainers.org | 16:13 |
| clarkb | and those last three were long enough ago they could have run on the old trusty/centos images without dns ip version resolvers | 16:14 |
| *** ramishra has quit IRC | 16:14 | |
| odyssey4me | alright, lemme push in a hosts hack and see how that goes | 16:14 |
| *** salv-orlando has quit IRC | 16:14 | |
| clarkb | odyssey4me: you might also inject a dig (not sure if it will be installed though) right before the step that talks to linuxcontainers.org | 16:15 |
| *** amotoki is now known as amotoki_away | 16:15 | |
| clarkb | odyssey4me: so do a dig images.linuxcontainers.org ; edit /etc/hosts ; run code that uses images.linuxcontainers.org | 16:15 |
| *** yamamoto has quit IRC | 16:15 | |
| clarkb | then you can see what the resolver is getting back at least | 16:15 |
| *** e0ne has quit IRC | 16:15 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Add various jobs for neutron-vpnaas-dashboard https://review.openstack.org/476332 | 16:16 |
| *** jascott1 has joined #openstack-infra | 16:16 | |
| odyssey4me | ok, thanks clarkb | 16:21 |
| *** mhickey has quit IRC | 16:21 | |
| *** cschwede has quit IRC | 16:24 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: jenkinks: jobs: bifrost: Use the zuul-git-prep macro https://review.openstack.org/476617 | 16:24 |
| *** makowals has quit IRC | 16:27 | |
| *** tmorin has quit IRC | 16:27 | |
| AJaeger | odyssey4me: could you review https://review.openstack.org/475710 and https://review.openstack.org/475711 , please? | 16:28 |
| clarkb | odyssey4me: I'm going to jump on a handful of our test nodes and do some manual dns lookups for that domain too | 16:28 |
| *** jascott1 has quit IRC | 16:28 | |
| *** ralonsoh has quit IRC | 16:29 | |
| *** jascott1 has joined #openstack-infra | 16:29 | |
| *** jascott1 has quit IRC | 16:29 | |
| *** jascott1 has joined #openstack-infra | 16:29 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: jenkinks: jobs: bifrost: Fix order of builders https://review.openstack.org/476617 | 16:30 |
| *** dprince has quit IRC | 16:31 | |
| clarkb | odyssey4me: one thing I have noticed is that images.linuxcontainers.org is cname canonical.images.linuxcontainers.org this then has two A records like you said. Those two A records are for us.images.linuxcontainers.org and uk.images.linuxcontainers.org | 16:31 |
| clarkb | odyssey4me: some of your failures were to us and uk .images.linuxcontainers.org hwoever they are not in the resolution path for images.linuxcontainers.org currently | 16:31 |
| clarkb | odyssey4me: that seems to lend some weight to the idea that dns was updated | 16:31 |
| odyssey4me | LGTM AJaeger | 16:32 |
| odyssey4me | clarkb yeah, the curl shows a redirect | 16:32 |
| odyssey4me | funny thing is that they resolve to the same IP's | 16:32 |
| AJaeger | thanks, odyssey4me - then I'm happy to +2 ;) | 16:33 |
| AJaeger | clarkb: here's an unbound change for Debian, could you review, please? https://review.openstack.org/476442 | 16:35 |
| *** LindaWang has quit IRC | 16:35 | |
| clarkb | AJaeger: done | 16:39 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: update toci to use --environment and --nodes options in quickstart https://review.openstack.org/475930 | 16:39 |
| clarkb | AJaeger: we can probably get ianw to review later today too. ianw if you see this https://review.openstack.org/476442 is a thing you may have opinions about. Perhaps latest fedora makes it a non issue entirely? | 16:41 |
| *** thorst has joined #openstack-infra | 16:44 | |
| *** gibi has quit IRC | 16:45 | |
| *** gibi has joined #openstack-infra | 16:45 | |
| MasterofJOKers | for getting stretch images, should the mirrors be updated to mirror it in addition to jessie? If yes, how does that work? | 16:46 |
| clarkb | MasterofJOKers: yes we should mirror stretch too if we are moving to stretch. We use reprepro to build our mirrors into an afs volume that is only published when the mirror is in a happy consistent state. I think you just need to add stretch to the release names in the existing reprepro config. Let me get you links | 16:47 |
| clarkb | MasterofJOKers: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/mirror_update.pp#n146 is the top level config which uses https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/reprepro/debuntu-updates and | 16:49 |
| clarkb | https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/reprepro/distributions.debian.erb to configure reprepro. The key bit is adding stretch next to jessie on line 152 of that first link | 16:49 |
| *** lucasagomes is now known as lucas-afk | 16:49 | |
| MasterofJOKers | thanks, I'll read through this | 16:49 |
| clarkb | we may also need to double check disk space on that volume first but not sure if afs lets read only uses do that, if not an admin can do it before merging) | 16:50 |
| MasterofJOKers | we might also need to add a stretch release key | 16:53 |
| clarkb | MasterofJOKers: https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/mirror_update.pp#n169 we have that key already | 16:56 |
| clarkb | MasterofJOKers: but easy enough to add a second | 16:56 |
| *** thorst has quit IRC | 16:57 | |
| *** thorst has joined #openstack-infra | 16:57 | |
| *** jascott1 has quit IRC | 16:58 | |
| MasterofJOKers | clarkb: yes, but it's the jessie key. probably better add the stretch key, too | 16:59 |
| *** jascott1 has joined #openstack-infra | 16:59 | |
| *** iyamahat has quit IRC | 16:59 | |
| *** martinkopec has quit IRC | 17:00 | |
| *** yamahata has quit IRC | 17:00 | |
| *** hyakuhei has quit IRC | 17:00 | |
| *** hyakuhei has joined #openstack-infra | 17:00 | |
| *** hyakuhei has quit IRC | 17:00 | |
| *** hyakuhei has joined #openstack-infra | 17:00 | |
| *** thorst_ has joined #openstack-infra | 17:00 | |
| *** jascott1 has quit IRC | 17:01 | |
| *** thorst has quit IRC | 17:02 | |
| *** derekh has quit IRC | 17:05 | |
| *** hughhalf has quit IRC | 17:05 | |
| *** thorst_ has quit IRC | 17:05 | |
| *** ggillies_ has quit IRC | 17:05 | |
| *** hughhalf has joined #openstack-infra | 17:06 | |
| *** xarses has joined #openstack-infra | 17:06 | |
| *** trown is now known as trown|lunch | 17:06 | |
| *** ggillies has joined #openstack-infra | 17:07 | |
| *** bh526r has quit IRC | 17:07 | |
| *** mdrabe has quit IRC | 17:10 | |
| *** tosky has quit IRC | 17:13 | |
| oanson | clarkb, AJaeger, other infra cores: Could someone please review https://review.openstack.org/#/c/475410/ ? | 17:17 |
| *** jpena is now known as jpena|off | 17:17 | |
| *** jascott1 has joined #openstack-infra | 17:19 | |
| *** thorst has joined #openstack-infra | 17:20 | |
| *** jamesmcarthur has quit IRC | 17:21 | |
| *** ianychoi has quit IRC | 17:22 | |
| *** iyamahat has joined #openstack-infra | 17:24 | |
| AJaeger | oanson, it helps if you tell us the repo this is. devstack is a QA repo, better ask on #openstack-qa | 17:24 |
| *** thorst has quit IRC | 17:24 | |
| oanson | AJaeger, sorry. Thought it was part of infra. Will ask in QA. | 17:25 |
| oanson | Thanks | 17:25 |
| *** jbadiapa_ has joined #openstack-infra | 17:26 | |
| *** mpaolino has quit IRC | 17:28 | |
| *** yamamoto has joined #openstack-infra | 17:30 | |
| *** sflanigan has quit IRC | 17:32 | |
| *** yland has joined #openstack-infra | 17:32 | |
| *** tosky has joined #openstack-infra | 17:33 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: convert cliff to use the unified doc build job https://review.openstack.org/476640 | 17:34 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: convert cliff to use the unified doc build job https://review.openstack.org/476640 | 17:35 |
| *** yamamoto has quit IRC | 17:35 | |
| *** ijw has joined #openstack-infra | 17:37 | |
| *** electrofelix has quit IRC | 17:40 | |
| *** yamahata has joined #openstack-infra | 17:42 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:43 | |
| *** ijw has quit IRC | 17:44 | |
| *** ijw has joined #openstack-infra | 17:45 | |
| *** ijw has quit IRC | 17:46 | |
| *** bmjen has quit IRC | 17:47 | |
| *** kzaitsev_mb has joined #openstack-infra | 17:47 | |
| clarkb | AJaeger: there are more problems with the gerrit plugin builds. I am working on sorting that out. If you can hang around for a bit longer to review that it would be great (as I think it is only you and me and ianw later today) | 17:49 |
| *** bmjen has joined #openstack-infra | 17:50 | |
| *** gardlt has quit IRC | 17:51 | |
| *** ykarel has joined #openstack-infra | 17:53 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Add java JDK to gerrit job deps https://review.openstack.org/476646 | 17:53 |
| *** dimtruck is now known as zz_dimtruck | 17:53 | |
| *** gardlt has joined #openstack-infra | 17:53 | |
| clarkb | AJaeger: fungi ianw ^ I think that should make ant happy in the gerrit plugin jobs | 17:54 |
| *** ltomasbo is now known as ltomasbo|away | 17:55 | |
| *** ijw has joined #openstack-infra | 17:55 | |
| *** gardlt_ has joined #openstack-infra | 17:55 | |
| *** Apoorva_ has joined #openstack-infra | 17:57 | |
| *** bmjen has quit IRC | 17:57 | |
| *** gardlt has quit IRC | 17:58 | |
| *** ijw has quit IRC | 17:58 | |
| *** dprince has joined #openstack-infra | 17:59 | |
| *** tesseract has quit IRC | 17:59 | |
| *** gardlt has joined #openstack-infra | 18:00 | |
| *** gardlt_ has quit IRC | 18:00 | |
| *** Apoorva has quit IRC | 18:00 | |
| *** ijw has joined #openstack-infra | 18:00 | |
| *** bmjen has joined #openstack-infra | 18:00 | |
| *** camunoz has quit IRC | 18:02 | |
| *** cody-somerville has quit IRC | 18:02 | |
| *** ykarel has quit IRC | 18:02 | |
| *** cody-somerville has joined #openstack-infra | 18:02 | |
| *** cody-somerville has joined #openstack-infra | 18:02 | |
| *** baoli has quit IRC | 18:03 | |
| clarkb | fungi: zaro looking at the patches we cherry picked onto 2.13.7 they are both related to the h2 accounts reviews db which we won't be using in 2.13.8 so I think we can skip those. | 18:03 |
| clarkb | I think that means we only need to worry about the chagnes at the tip of 2.13 branch not included in 2.13.8 | 18:04 |
| *** baoli has joined #openstack-infra | 18:04 | |
| clarkb | I don't want to push a bunch of code now before the ci stuff is happier though | 18:04 |
| *** priteau has quit IRC | 18:04 | |
| *** ijw has quit IRC | 18:05 | |
| clarkb | sdague: if you happen to be around would you mind reviewing https://review.openstack.org/476646 trying to keep the gerrit upgrade ball rolling | 18:06 |
| *** bmjen has quit IRC | 18:07 | |
| *** JudeC has joined #openstack-infra | 18:07 | |
| *** ijw has joined #openstack-infra | 18:07 | |
| sdague | clarkb: sure, I guess my only preference would be to make that 4 calls just from reviewability and readability | 18:09 |
| sdague | embedded \n is always annoying | 18:09 |
| clarkb | sdague: thats fair, I was keeping with the existing style | 18:09 |
| clarkb | sdague: I can respin and do one per line | 18:09 |
| sdague | clarkb: yeh, either way, I think it will be less future error prone if it's one per line | 18:10 |
| *** bmjen has joined #openstack-infra | 18:10 | |
| *** csomerville has joined #openstack-infra | 18:10 | |
| *** dhinesh has joined #openstack-infra | 18:11 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Add java JDK to gerrit job deps https://review.openstack.org/476646 | 18:11 |
| clarkb | sdague: ^ it is much easier to read | 18:11 |
| sdague | +2 | 18:12 |
| clarkb | and like yesterday I am going to single core approve that (jobs aren't critical to current functioanlity and are broken anyways) | 18:13 |
| *** dizquierdo has quit IRC | 18:13 | |
| *** gardlt has quit IRC | 18:13 | |
| *** cody-somerville has quit IRC | 18:13 | |
| *** camunoz has joined #openstack-infra | 18:14 | |
| *** ijw has quit IRC | 18:21 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: update toci to use --environment and --nodes options in quickstart https://review.openstack.org/475930 | 18:21 |
| *** makowals has joined #openstack-infra | 18:22 | |
| *** thorst has joined #openstack-infra | 18:23 | |
| *** sshnaidm is now known as sshnaidm|off | 18:24 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add java JDK to gerrit job deps https://review.openstack.org/476646 | 18:25 |
| *** eharney has quit IRC | 18:25 | |
| *** Hunner has quit IRC | 18:27 | |
| *** mdrabe has joined #openstack-infra | 18:27 | |
| *** thorst has quit IRC | 18:27 | |
| *** ijw has joined #openstack-infra | 18:28 | |
| *** Hunner has joined #openstack-infra | 18:28 | |
| *** Hunner has quit IRC | 18:28 | |
| *** Hunner has joined #openstack-infra | 18:28 | |
| *** hrubi has quit IRC | 18:31 | |
| *** ijw has quit IRC | 18:32 | |
| *** gardlt has joined #openstack-infra | 18:33 | |
| *** thorst has joined #openstack-infra | 18:35 | |
| clarkb | https://review.openstack.org/476655 and https://review.openstack.org/476656 pushed to finish up gerrit 2.13.8 branch setup | 18:36 |
| *** hrubi has joined #openstack-infra | 18:37 | |
| *** gus has quit IRC | 18:38 | |
| *** salv-orl_ has quit IRC | 18:39 | |
| *** salv-orlando has joined #openstack-infra | 18:39 | |
| *** thorst has quit IRC | 18:40 | |
| *** gus has joined #openstack-infra | 18:40 | |
| *** jascott1 has quit IRC | 18:43 | |
| *** salv-orlando has quit IRC | 18:43 | |
| *** jamesmcarthur has joined #openstack-infra | 18:45 | |
| *** trown|lunch is now known as trown | 18:45 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: convert osc-lib to use the new unified doc job https://review.openstack.org/476660 | 18:49 |
| *** thorst has joined #openstack-infra | 18:50 | |
| *** camunoz has quit IRC | 18:50 | |
| *** jascott1 has joined #openstack-infra | 18:51 | |
| *** nicolasbock has quit IRC | 18:54 | |
| *** thorst has quit IRC | 18:54 | |
| *** eharney has joined #openstack-infra | 18:57 | |
| *** yland has quit IRC | 18:57 | |
| *** yland has joined #openstack-infra | 18:58 | |
| *** yland is now known as Guest68784 | 18:58 | |
| *** camunoz has joined #openstack-infra | 19:02 | |
| *** amoralej is now known as amoralej|off | 19:04 | |
| openstackgerrit | Merged openstack-infra/infra-specs master: PTG Bot https://review.openstack.org/473582 | 19:04 |
| openstackgerrit | Merged openstack-infra/infra-specs master: New spec for translation_check_site (Ansible AIO) https://review.openstack.org/440825 | 19:04 |
| *** e0ne has joined #openstack-infra | 19:06 | |
| *** bmjen has quit IRC | 19:11 | |
| *** bmjen has joined #openstack-infra | 19:12 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 19:15 |
| *** Guest68784 has quit IRC | 19:20 | |
| *** danpawlik has joined #openstack-infra | 19:24 | |
| *** e0ne has quit IRC | 19:25 | |
| danpawlik | Hi. About gerrit configuration: Openstack have a hook that is triggering job (ref-updated) for zuul or? | 19:25 |
| *** dprince has quit IRC | 19:25 | |
| *** dprince has joined #openstack-infra | 19:26 | |
| openstackgerrit | Doug Hellmann proposed openstack/os-client-config master: rearrange existing documentation to follow the new standard layout https://review.openstack.org/476667 | 19:26 |
| danpawlik | is there any example of the hook? And second think is that I try to make a bash hook and its not working properly. I added it into $DIR/git/test-project/hooks/ref-updated with chmod 755 and as I see in logs | 19:26 |
| openstackgerrit | Doug Hellmann proposed openstack/os-client-config master: turn on warning-is-error in documentation build https://review.openstack.org/476668 | 19:26 |
| openstackgerrit | Doug Hellmann proposed openstack/os-client-config master: switch from oslosphinx to openstackdocstheme https://review.openstack.org/476669 | 19:26 |
| danpawlik | its not triggered | 19:26 |
| *** florianf has quit IRC | 19:27 | |
| fungi | danpawlik: zuul does not rely on gerrit hooks or plugins. it watches the gerrit event stream and does its own triggering internally: https://docs.openstack.org/infra/zuul/triggers.html#gerrit | 19:28 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: switch os-client-config to the new unified doc jobs https://review.openstack.org/476670 | 19:28 |
| *** trown is now known as trown|brb | 19:28 | |
| danpawlik | fungi: nie | 19:32 |
| danpawlik | fungi: thanks for reply | 19:32 |
| danpawlik | fungi: I try to make it using hook | 19:32 |
| danpawlik | because I don't want to use zuul | 19:32 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 19:34 |
| *** trown|brb is now known as trown | 19:35 | |
| *** makowals has quit IRC | 19:35 | |
| *** bswartz has quit IRC | 19:38 | |
| *** thorst has joined #openstack-infra | 19:40 | |
| *** mdrabe has quit IRC | 19:43 | |
| *** thorst has quit IRC | 19:44 | |
| *** rderose has quit IRC | 19:44 | |
| *** Hunner has quit IRC | 19:45 | |
| *** AndChat|479316 has joined #openstack-infra | 19:45 | |
| *** thorst has joined #openstack-infra | 19:46 | |
| *** prateek has quit IRC | 19:48 | |
| *** dnikishov2 has quit IRC | 19:49 | |
| *** thorst has quit IRC | 19:50 | |
| *** Hunner has joined #openstack-infra | 19:51 | |
| *** Hunner has quit IRC | 19:51 | |
| *** Hunner has joined #openstack-infra | 19:51 | |
| *** krtaylor has quit IRC | 19:52 | |
| *** jcoufal has quit IRC | 19:53 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Use private attribute lookup interanlly in builder.py https://review.openstack.org/476677 | 19:56 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Don't join image upload workers on stop() https://review.openstack.org/476678 | 19:56 |
| *** rderose has joined #openstack-infra | 19:57 | |
| *** baoli has quit IRC | 19:58 | |
| *** HeOS has joined #openstack-infra | 19:58 | |
| *** baoli has joined #openstack-infra | 19:58 | |
| *** baoli has quit IRC | 19:58 | |
| *** baoli has joined #openstack-infra | 20:00 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 20:01 |
| *** Apoorva_ has quit IRC | 20:02 | |
| *** sbezverk has joined #openstack-infra | 20:02 | |
| *** Apoorva has joined #openstack-infra | 20:02 | |
| openstackgerrit | Joshua Harlow proposed openstack-infra/nodepool master: Use threading.Event for quicker shutdowns https://review.openstack.org/476683 | 20:02 |
| *** Swami has joined #openstack-infra | 20:03 | |
| *** AndChat|479316 has quit IRC | 20:04 | |
| *** AndChat|479316 has joined #openstack-infra | 20:04 | |
| openstackgerrit | Joshua Harlow proposed openstack-infra/nodepool master: Use threading.Event for quicker shutdowns https://review.openstack.org/476683 | 20:05 |
| *** ram5391 has joined #openstack-infra | 20:05 | |
| openstackgerrit | Merged openstack-infra/project-config master: tripleo/containers: run jobs when touching docker services https://review.openstack.org/476510 | 20:06 |
| *** salv-orlando has joined #openstack-infra | 20:06 | |
| *** dprince has quit IRC | 20:07 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: rearrange existing documentation using the new standard layout https://review.openstack.org/476684 | 20:08 |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: turn on warning-as-error flag for doc build https://review.openstack.org/476685 | 20:08 |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: switch from oslosphinx to openstackdocstheme https://review.openstack.org/476686 | 20:08 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: tripleo: move scenario003-multinode-oooq-container to gate https://review.openstack.org/476687 | 20:09 |
| *** jrist has quit IRC | 20:09 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 20:10 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: convert pbr to the new unified documentation jobs https://review.openstack.org/476689 | 20:10 |
| *** marst_ has quit IRC | 20:11 | |
| *** marst_ has joined #openstack-infra | 20:11 | |
| *** ram5391 has quit IRC | 20:12 | |
| dhellmann | AJaeger : about the client lib doc build, why would we treat those differently from other libraries? | 20:13 |
| *** dkehn has quit IRC | 20:14 | |
| *** yland has joined #openstack-infra | 20:14 | |
| *** rhallisey has quit IRC | 20:15 | |
| AJaeger | dhellmann: not sure whether annegentle remembers - but server projects have always published after each build, and clients (those are uploaded to pypi) only at release | 20:15 |
| dhellmann | ok. I don't think we were doing that consistently for the non client libraries | 20:15 |
| dhellmann | I'm not sure why we would want that | 20:15 |
| AJaeger | dhellmann: We do it for the majority of them. | 20:15 |
| dhellmann | so many special cases | 20:15 |
| AJaeger | dhellmann: yeah ;( | 20:16 |
| annegentle | AJaeger dhellmann I think continuous was the goal with many projects | 20:16 |
| annegentle | but my memory is fuzzy | 20:16 |
| AJaeger | dhellmann: I'm fine to change that - but not silently ;) | 20:16 |
| dhellmann | how about if we just start doing this the same way for all projects for now, and if we figure out why that's wrong I'll help fix it? | 20:16 |
| dhellmann | AJaeger : well, the commit message says it's changing the jobs, I'm not sure what more you want sadi? | 20:16 |
| dhellmann | said? | 20:16 |
| AJaeger | what about asking on the mailing list for objection instead? | 20:16 |
| *** jrist has joined #openstack-infra | 20:17 | |
| dhellmann | this is all tied up to the doc-migration spec | 20:17 |
| AJaeger | dhellmann: nobody is aware that this changes the way we publish stuff. | 20:17 |
| annegentle | dhellmann are you taking away something that's expected? (continuous publishing?) | 20:17 |
| dhellmann | annegentle : the opposite | 20:17 |
| dhellmann | the new jobs publish for every merge for all repos | 20:17 |
| AJaeger | annegentle: he proposes to change the client projects to publish always - right now the publish only at release time | 20:18 |
| dhellmann | the servers were doing that already, but the clients and some (most?) libs were not | 20:18 |
| annegentle | dhellmann ok... I suppose since it's not a takeaway | 20:18 |
| dhellmann | I have a todo to figure out version-specific builds, too, but that will be transparent to the projects | 20:18 |
| annegentle | AJaeger ok | 20:18 |
| *** eharney has quit IRC | 20:18 | |
| dhellmann | I'll just add it to the unified template thing in zuul's layout file | 20:18 |
| annegentle | dhellmann yeah we'll need version-specific too | 20:18 |
| dhellmann | it's on the list | 20:18 |
| annegentle | dhellmann heh, yep! | 20:19 |
| AJaeger | dhellmann: I've seen a couple of questions where people wondered about this behaviour (why is my client repo not updating docs?), so I think we can change. | 20:19 |
| annegentle | AJaeger oh yeah, that's true | 20:19 |
| AJaeger | dhellmann: What about adding a sentence to the docs-migration spec? ;) Or sending an email to the list? | 20:19 |
| dhellmann | the burden of all of this change just keeps getting bigger | 20:19 |
| dhellmann | AJaeger : If I need to do another draft of that spec I'm going to step away from this work. Seriously. | 20:20 |
| dhellmann | I could send an email, I guess | 20:20 |
| *** jkilpatr has quit IRC | 20:20 | |
| AJaeger | dhellmann: sorry, didn't want to make your life harder - I was just not expecting this change (and I'm not objecting to it, so will +1 your email ;). | 20:22 |
| * AJaeger calls it a day now ... | 20:22 | |
| *** jamesmcarthur has quit IRC | 20:24 | |
| dhellmann | AJaeger : np, sorry, I just keep finding more and more special cases and old decisions that have unintended complications | 20:24 |
| *** rderose has quit IRC | 20:26 | |
| jrist | possible stupid question | 20:27 |
| jrist | is there a command line tool for lodgeit (paste.openstack.org) | 20:27 |
| jrist | i.e. cat <file> | lodgeit | 20:27 |
| dhellmann | AJaeger : http://lists.openstack.org/pipermail/openstack-dev/2017-June/118817.html | 20:28 |
| *** rwsu has quit IRC | 20:28 | |
| clarkb | jrist: pastebinit should work | 20:29 |
| inc0 | hey guys, I'm almost ready to make publisher jobs periodic, how do I go about pipelined periodic jobs? | 20:30 |
| clarkb | inc0: same as pipelined any other job. Just add it to the pipeline and do the staggering thing | 20:30 |
| *** rfolco has quit IRC | 20:30 | |
| inc0 | can you show me example of periodic job pleasE? | 20:31 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: switch os-client-config to the new unified doc jobs https://review.openstack.org/476670 | 20:31 |
| jrist | clarkb: nice | 20:31 |
| clarkb | inc0: you should find lots of examples if you grep for periodic | 20:33 |
| inc0 | k thanks, could've figure it out myself:( | 20:34 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 20:34 |
| *** dizquierdo has joined #openstack-infra | 20:35 | |
| *** krtaylor has joined #openstack-infra | 20:36 | |
| *** mdrabe has joined #openstack-infra | 20:38 | |
| *** jkilpatr has joined #openstack-infra | 20:40 | |
| *** zz_dimtruck is now known as dimtruck | 20:41 | |
| *** wolverineav has joined #openstack-infra | 20:41 | |
| *** mat128 has quit IRC | 20:42 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Use threading.Event for quicker shutdowns https://review.openstack.org/476683 | 20:42 |
| openstackgerrit | Jan Hruban proposed openstack-infra/gearman-plugin master: Allow non-standard Jenkins job types to be cancelled https://review.openstack.org/476699 | 20:43 |
| *** dizquierdo has quit IRC | 20:43 | |
| *** esberglu has quit IRC | 20:43 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Use threading.Event for quicker shutdowns https://review.openstack.org/476683 | 20:45 |
| *** baoli has quit IRC | 20:50 | |
| *** baoli has joined #openstack-infra | 20:51 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Use threading.Event for quicker shutdowns https://review.openstack.org/476705 | 20:52 |
| *** camunoz has quit IRC | 20:54 | |
| *** jamesmcarthur has joined #openstack-infra | 20:55 | |
| *** prateek has joined #openstack-infra | 20:55 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Init submodules in gerrit build jobs https://review.openstack.org/476706 | 20:59 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Install nodejs for gerrit builds https://review.openstack.org/476707 | 20:59 |
| clarkb | sdague: AJaeger ^ if you are still around review on those would be nice. I think that should be everything to make gerrit build now | 20:59 |
| *** jamesmcarthur has quit IRC | 20:59 | |
| *** dmellado has quit IRC | 21:00 | |
| *** annegentle has quit IRC | 21:01 | |
| *** Apoorva_ has joined #openstack-infra | 21:01 | |
| *** dmellado has joined #openstack-infra | 21:03 | |
| *** Apoorva has quit IRC | 21:03 | |
| *** thorst has joined #openstack-infra | 21:04 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Use Event for faster shutdown of launcher https://review.openstack.org/476709 | 21:07 |
| *** Apoorva_ has quit IRC | 21:09 | |
| *** Apoorva has joined #openstack-infra | 21:10 | |
| *** edmondsw has quit IRC | 21:13 | |
| *** mdrabe has quit IRC | 21:13 | |
| *** prateek has quit IRC | 21:13 | |
| *** mdrabe has joined #openstack-infra | 21:13 | |
| *** ldnunes has quit IRC | 21:18 | |
| openstackgerrit | Merged openstack-infra/project-config master: Init submodules in gerrit build jobs https://review.openstack.org/476706 | 21:20 |
| openstackgerrit | Merged openstack-infra/project-config master: Install nodejs for gerrit builds https://review.openstack.org/476707 | 21:21 |
| *** trown is now known as trown|outtypewww | 21:21 | |
| *** bobh has quit IRC | 21:25 | |
| *** baoli has quit IRC | 21:28 | |
| *** esberglu has joined #openstack-infra | 21:30 | |
| *** jascott1 has quit IRC | 21:30 | |
| *** jascott1 has joined #openstack-infra | 21:30 | |
| *** Apoorva_ has joined #openstack-infra | 21:32 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 21:32 |
| *** jascott1 has quit IRC | 21:35 | |
| *** esberglu has quit IRC | 21:35 | |
| *** Apoorva has quit IRC | 21:35 | |
| *** sbezverk has quit IRC | 21:39 | |
| *** armax has joined #openstack-infra | 21:41 | |
| *** thorst has quit IRC | 21:47 | |
| *** kzaitsev_mb has quit IRC | 21:47 | |
| *** dimtruck is now known as zz_dimtruck | 21:49 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:49 | |
| *** dizquierdo has joined #openstack-infra | 21:50 | |
| *** dizquierdo has quit IRC | 21:51 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 21:52 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Collect workflow lists and execution lists in host_info https://review.openstack.org/465065 | 21:52 |
| *** dizquierdo has joined #openstack-infra | 21:52 | |
| *** danpawlik has quit IRC | 21:53 | |
| *** hichihara has joined #openstack-infra | 21:55 | |
| *** gouthamr has quit IRC | 21:55 | |
| *** spzala has quit IRC | 21:55 | |
| *** xyang1 has quit IRC | 21:56 | |
| *** spzala has joined #openstack-infra | 21:56 | |
| *** spzala has quit IRC | 21:56 | |
| *** spzala has joined #openstack-infra | 21:56 | |
| *** chlong has quit IRC | 21:57 | |
| *** mdrabe has quit IRC | 22:00 | |
| *** iyamahat has quit IRC | 22:03 | |
| *** iyamahat has joined #openstack-infra | 22:03 | |
| *** armax_ has joined #openstack-infra | 22:05 | |
| *** armax has quit IRC | 22:05 | |
| *** armax_ is now known as armax | 22:05 | |
| *** kzaitsev_mb has quit IRC | 22:06 | |
| *** baoli has joined #openstack-infra | 22:06 | |
| *** wolverineav has quit IRC | 22:07 | |
| clarkb | ok those last two patches did it, gerrit builds are functional now | 22:07 |
| clarkb | tonight we should get plugins built too. I am going to be mostly out tomorrow but monday I think we can try upgrading review-dev again | 22:08 |
| *** baoli has quit IRC | 22:10 | |
| *** salv-orl_ has joined #openstack-infra | 22:12 | |
| *** wolverineav has joined #openstack-infra | 22:13 | |
| *** jascott1 has joined #openstack-infra | 22:13 | |
| *** dave-mccowan has quit IRC | 22:15 | |
| *** salv-orlando has quit IRC | 22:15 | |
| *** gouthamr has joined #openstack-infra | 22:16 | |
| *** wolverineav has quit IRC | 22:17 | |
| *** jcoufal has joined #openstack-infra | 22:20 | |
| *** dalvarez has quit IRC | 22:21 | |
| *** ltomasbo|away has quit IRC | 22:22 | |
| *** xarses has quit IRC | 22:23 | |
| *** ltomasbo|away has joined #openstack-infra | 22:24 | |
| *** felipemonteiro_ has quit IRC | 22:26 | |
| *** rbrndt has quit IRC | 22:27 | |
| *** Apoorva_ has quit IRC | 22:28 | |
| *** Apoorva has joined #openstack-infra | 22:28 | |
| *** dalvarez has joined #openstack-infra | 22:28 | |
| *** weshay has quit IRC | 22:29 | |
| *** jpena|off has quit IRC | 22:32 | |
| *** marst_ has quit IRC | 22:32 | |
| *** ltomasbo|away has quit IRC | 22:32 | |
| *** marst_ has joined #openstack-infra | 22:32 | |
| *** iyamahat has quit IRC | 22:33 | |
| *** weshay has joined #openstack-infra | 22:33 | |
| *** iyamahat has joined #openstack-infra | 22:33 | |
| *** dmellado has quit IRC | 22:33 | |
| *** marst_ has quit IRC | 22:36 | |
| *** jpena|off has joined #openstack-infra | 22:37 | |
| *** dmellado has joined #openstack-infra | 22:37 | |
| *** amoralej|off has quit IRC | 22:37 | |
| *** ltomasbo|away has joined #openstack-infra | 22:37 | |
| *** dalvarez has quit IRC | 22:38 | |
| *** weshay has quit IRC | 22:39 | |
| *** adriant has quit IRC | 22:39 | |
| *** dmanchad has quit IRC | 22:39 | |
| *** adriant has joined #openstack-infra | 22:39 | |
| *** weshay has joined #openstack-infra | 22:42 | |
| *** dmanchad has joined #openstack-infra | 22:43 | |
| *** ltomasbo|away has quit IRC | 22:45 | |
| *** jcoufal has quit IRC | 22:46 | |
| *** hasharAway has quit IRC | 22:48 | |
| *** spzala has quit IRC | 22:49 | |
| *** xarses has joined #openstack-infra | 22:49 | |
| *** dmanchad has quit IRC | 22:50 | |
| *** dhajare has quit IRC | 22:50 | |
| *** jpena|off has quit IRC | 22:50 | |
| *** adisky__ has quit IRC | 22:50 | |
| *** wznoinsk has quit IRC | 22:51 | |
| *** weshay has quit IRC | 22:51 | |
| *** ltomasbo|away has joined #openstack-infra | 22:51 | |
| *** thorst has joined #openstack-infra | 22:52 | |
| *** dmanchad has joined #openstack-infra | 22:52 | |
| *** jpena|off has joined #openstack-infra | 22:52 | |
| *** weshay has joined #openstack-infra | 22:52 | |
| *** amoralej has joined #openstack-infra | 22:54 | |
| *** yland has quit IRC | 22:56 | |
| *** ltomasbo|away has quit IRC | 22:56 | |
| *** yland has joined #openstack-infra | 22:56 | |
| *** yland is now known as Guest7325 | 22:57 | |
| *** Guest7325 has quit IRC | 22:57 | |
| *** gordc has quit IRC | 22:57 | |
| *** dmanchad has quit IRC | 22:59 | |
| clarkb | odyssey4me: http://logs.openstack.org/49/476649/2/gate/gate-openstack-ansible-os_neutron-ansible-func-centos-7/c094abe/console.html#_2017-06-22_22_34_56_640329 is really curious because the two agent containers worked fine but the two server containers did not despite doing the same thing, yum installing libffi-devel | 23:00 |
| *** weshay has quit IRC | 23:00 | |
| *** gardlt has quit IRC | 23:02 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 23:02 |
| *** weshay has joined #openstack-infra | 23:03 | |
| *** rlandy has quit IRC | 23:03 | |
| *** dmellado has quit IRC | 23:03 | |
| *** hichihara has quit IRC | 23:05 | |
| *** dmellado has joined #openstack-infra | 23:06 | |
| *** salv-orl_ has quit IRC | 23:08 | |
| *** Apoorva_ has joined #openstack-infra | 23:08 | |
| *** dmanchad has joined #openstack-infra | 23:08 | |
| *** thorst has quit IRC | 23:09 | |
| *** chlong has joined #openstack-infra | 23:10 | |
| *** Apoorva has quit IRC | 23:11 | |
| *** dmellado has quit IRC | 23:15 | |
| *** wznoinsk has joined #openstack-infra | 23:17 | |
| *** gomarivera has quit IRC | 23:18 | |
| *** gomarivera has joined #openstack-infra | 23:18 | |
| *** dmellado has joined #openstack-infra | 23:18 | |
| *** dmanchad has quit IRC | 23:19 | |
| *** gomarivera has quit IRC | 23:22 | |
| *** wznoinsk has quit IRC | 23:24 | |
| *** ltomasbo|away has joined #openstack-infra | 23:25 | |
| *** dalvarez has joined #openstack-infra | 23:26 | |
| *** wznoinsk has joined #openstack-infra | 23:28 | |
| *** dmanchad has joined #openstack-infra | 23:29 | |
| clarkb | odyssey4me: I think I may have figured out your problem possiblty | 23:30 |
| clarkb | actually maybe not | 23:30 |
| *** ijw has joined #openstack-infra | 23:30 | |
| *** mriedem has quit IRC | 23:31 | |
| *** dalvarez has quit IRC | 23:31 | |
| *** gongysh has joined #openstack-infra | 23:31 | |
| clarkb | but maybe :) | 23:31 |
| *** dmellado has quit IRC | 23:31 | |
| *** ltomasbo|away has quit IRC | 23:32 | |
| clarkb | odyssey4me: I think it is possible that there may be routing issues from unbound to dnsmaq to lxc container | 23:33 |
| *** tosky has quit IRC | 23:33 | |
| *** amoralej has quit IRC | 23:33 | |
| *** gongysh has quit IRC | 23:33 | |
| clarkb | I need to draw pictures because this ends up being fairly complicated | 23:34 |
| *** dmanchad has quit IRC | 23:34 | |
| *** gongysh has joined #openstack-infra | 23:37 | |
| *** jpena|off has quit IRC | 23:37 | |
| *** dalvarez has joined #openstack-infra | 23:38 | |
| *** gongysh has quit IRC | 23:38 | |
| *** yland has joined #openstack-infra | 23:38 | |
| *** yland is now known as Guest76459 | 23:38 | |
| *** wznoinsk has quit IRC | 23:40 | |
| *** wznoinsk has joined #openstack-infra | 23:40 | |
| *** dmanchad has joined #openstack-infra | 23:40 | |
| *** jpena|off has joined #openstack-infra | 23:41 | |
| *** xarses has quit IRC | 23:41 | |
| jlk | so you're saying it's a network problem... :D | 23:43 |
| clarkb | odyssey4me: I have been able to roughly reproduce the problem on a held osic node. Now I'm trying to pin it down and routing is my guess | 23:43 |
| clarkb | jlk: well its a dnsmasq is silly problem :P | 23:43 |
| jlk | it's always DNS | 23:43 |
| *** xarses has joined #openstack-infra | 23:44 | |
| *** dalvarez has quit IRC | 23:44 | |
| *** ltomasbo|away has joined #openstack-infra | 23:45 | |
| *** armax has quit IRC | 23:46 | |
| *** dizquierdo has quit IRC | 23:46 | |
| *** s-shiono has joined #openstack-infra | 23:47 | |
| *** wznoinsk has quit IRC | 23:48 | |
| clarkb | within the container if I lookup anything just using python3 socket.gethostbyname (because I can't install dig because no dns) while tcpdumping in the host where the two dns servers are running I see no packets | 23:48 |
| clarkb | this is why i think it is a routing problem, could be a firewall issue though | 23:48 |
| clarkb | oh actually should've checked the simple thing first I guess. My container has nothing in its /etc/resolc.conf wtf | 23:49 |
| *** jpena|off has quit IRC | 23:50 | |
| *** amoralej has joined #openstack-infra | 23:50 | |
| *** krtaylor has quit IRC | 23:50 | |
| jlk | that's.. odd | 23:51 |
| *** jpena|off has joined #openstack-infra | 23:51 | |
| jlk | I have no clue what lxc does to provide dns into the container. | 23:51 |
| *** dmellado has joined #openstack-infra | 23:51 | |
| clarkb | jlk: my understanding is that it sticks a dnsmasq on the lxcbr0 (which I see running on the host) | 23:52 |
| clarkb | jlk: but my container never dhcp'd? it has no networking | 23:52 |
| clarkb | so maybe its as simple as that. lxc + dnsmasq doesn't always result in your conatiner having dhcp | 23:52 |
| *** dalvarez has joined #openstack-infra | 23:53 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add Shrews to statusbot user whitelist https://review.openstack.org/475787 | 23:53 |
| *** SumitNaiksatam has quit IRC | 23:53 | |
| *** Swami has quit IRC | 23:54 | |
| *** ltomasbo|away has quit IRC | 23:54 | |
| openstackgerrit | Merged openstack-infra/system-config master: Switch twine to upload.pypi.org https://review.openstack.org/349282 | 23:54 |
| *** wznoinsk has joined #openstack-infra | 23:55 | |
| *** amoralej has quit IRC | 23:55 | |
| *** dmellado has quit IRC | 23:55 | |
| *** jpena|off has quit IRC | 23:55 | |
| *** jpena|off has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!