| *** lucasagomes has quit IRC | 00:00 | |
| *** lucasagomes has joined #openstack-infra | 00:02 | |
| *** zhurong has quit IRC | 00:03 | |
| *** thorst_ has joined #openstack-infra | 00:04 | |
| *** aeng has quit IRC | 00:04 | |
| *** pahuang has quit IRC | 00:05 | |
| *** sflanigan has quit IRC | 00:05 | |
| *** Swami has quit IRC | 00:06 | |
| *** lucasagomes has quit IRC | 00:07 | |
| *** zul has quit IRC | 00:08 | |
| *** lucasagomes has joined #openstack-infra | 00:10 | |
| *** thorst_ has quit IRC | 00:11 | |
| *** lucasagomes has quit IRC | 00:14 | |
| *** ociuhandu has quit IRC | 00:15 | |
| *** skipp has quit IRC | 00:16 | |
| *** eeiden has quit IRC | 00:16 | |
| *** lucasagomes has joined #openstack-infra | 00:17 | |
| *** stewie925 has quit IRC | 00:17 | |
| *** wcriswell has quit IRC | 00:17 | |
| *** sdake_ has quit IRC | 00:17 | |
| *** sdake has joined #openstack-infra | 00:17 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/glean: Refactor side-effect functions https://review.openstack.org/320225 | 00:18 |
|---|---|---|
| *** xarses has quit IRC | 00:18 | |
| *** sai has quit IRC | 00:19 | |
| *** sai has joined #openstack-infra | 00:19 | |
| *** psilvad has joined #openstack-infra | 00:20 | |
| *** sflanigan has joined #openstack-infra | 00:20 | |
| *** sflanigan has joined #openstack-infra | 00:20 | |
| *** pahuang has joined #openstack-infra | 00:21 | |
| *** aeng has joined #openstack-infra | 00:24 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Handle multiline env vars in reproduce.sh https://review.openstack.org/369633 | 00:25 |
| *** tqtran has quit IRC | 00:25 | |
| *** gongysh has quit IRC | 00:26 | |
| *** sai has quit IRC | 00:27 | |
| *** lucasagomes has quit IRC | 00:27 | |
| *** adrian_otto has quit IRC | 00:27 | |
| *** wfoster has quit IRC | 00:28 | |
| *** wfoster has joined #openstack-infra | 00:29 | |
| *** krtaylor has joined #openstack-infra | 00:29 | |
| *** sai has joined #openstack-infra | 00:30 | |
| *** lucasagomes has joined #openstack-infra | 00:30 | |
| *** OferBarber has joined #openstack-infra | 00:32 | |
| *** kaisers1 has joined #openstack-infra | 00:32 | |
| *** kaisers2 has joined #openstack-infra | 00:33 | |
| *** kaisers has quit IRC | 00:34 | |
| *** lucasagomes has quit IRC | 00:34 | |
| *** 32NABYQA1 has quit IRC | 00:35 | |
| *** wfoster has quit IRC | 00:35 | |
| *** lucasagomes has joined #openstack-infra | 00:38 | |
| *** itsuugo has quit IRC | 00:40 | |
| *** itsuugo has joined #openstack-infra | 00:40 | |
| *** gongysh has joined #openstack-infra | 00:41 | |
| *** itsuugo has quit IRC | 00:45 | |
| *** lucasagomes has quit IRC | 00:46 | |
| *** itsuugo has joined #openstack-infra | 00:46 | |
| *** sai has quit IRC | 00:47 | |
| *** lucasagomes has joined #openstack-infra | 00:48 | |
| *** tuanla_ has joined #openstack-infra | 00:49 | |
| *** Guest734 has quit IRC | 00:50 | |
| *** itsuugo has quit IRC | 00:51 | |
| *** itsuugo has joined #openstack-infra | 00:53 | |
| *** tphummel has quit IRC | 00:54 | |
| *** ijw has joined #openstack-infra | 00:54 | |
| *** stewie925 has joined #openstack-infra | 00:56 | |
| *** lucasagomes has quit IRC | 00:57 | |
| *** jkilpatr has quit IRC | 00:58 | |
| *** asettle has joined #openstack-infra | 00:59 | |
| *** devananda is now known as devananda|dinner | 00:59 | |
| *** _sarob has quit IRC | 00:59 | |
| *** ijw has quit IRC | 00:59 | |
| *** lucasagomes has joined #openstack-infra | 01:00 | |
| *** eeiden has joined #openstack-infra | 01:01 | |
| *** inc0 has quit IRC | 01:02 | |
| *** kjorgensen has quit IRC | 01:02 | |
| *** gyee has quit IRC | 01:03 | |
| *** asettle has quit IRC | 01:04 | |
| *** lucasagomes has quit IRC | 01:04 | |
| ianw | anyone have time to read this minor update on removing afs mirrors -> https://review.openstack.org/#/c/354371/2 | 01:06 |
| *** skipp_ has joined #openstack-infra | 01:06 | |
| *** lucasagomes has joined #openstack-infra | 01:07 | |
| *** wfoster has joined #openstack-infra | 01:07 | |
| *** rook has joined #openstack-infra | 01:07 | |
| *** rook is now known as Guest88826 | 01:08 | |
| *** sai has joined #openstack-infra | 01:08 | |
| *** wcriswell has joined #openstack-infra | 01:08 | |
| *** thorst_ has joined #openstack-infra | 01:09 | |
| *** itsuugo has quit IRC | 01:10 | |
| *** Sukhdev has quit IRC | 01:10 | |
| *** signed8bit_Zzz is now known as signed8b_ | 01:11 | |
| *** itsuugo has joined #openstack-infra | 01:11 | |
| *** signed8b_ is now known as signed8bit_Zzz | 01:11 | |
| *** signed8bit_Zzz is now known as signed8b_ | 01:11 | |
| *** zhurong has joined #openstack-infra | 01:12 | |
| *** thorst_ has quit IRC | 01:12 | |
| *** lucasagomes has quit IRC | 01:12 | |
| *** thorst_ has joined #openstack-infra | 01:14 | |
| *** signed8b_ has quit IRC | 01:14 | |
| tonyb | What happens if all the jobs listed for $project in the check pipeline are excluded on a given branch? | 01:14 |
| *** lucasagomes has joined #openstack-infra | 01:14 | |
| clarkb | tonyb: you dont run tests and cant merge iirc | 01:16 |
| tonyb | clarkb: okay, that's what I was affraid of | 01:16 |
| *** gouthamr has quit IRC | 01:17 | |
| clarkb | ianw: I dont know afs very well but shouldnt the mount be removed before the volumes are removed? | 01:18 |
| *** rossella_ has quit IRC | 01:18 | |
| *** lucasagomes has quit IRC | 01:19 | |
| *** rossella_ has joined #openstack-infra | 01:19 | |
| *** fguillot is now known as fguillot_afk | 01:19 | |
| *** fguillot_afk has quit IRC | 01:20 | |
| *** baoli has joined #openstack-infra | 01:20 | |
| *** lucasagomes has joined #openstack-infra | 01:21 | |
| *** fguillot has joined #openstack-infra | 01:22 | |
| *** wfoster has quit IRC | 01:23 | |
| *** aeng has quit IRC | 01:24 | |
| *** wfoster has joined #openstack-infra | 01:25 | |
| *** itsuugo has quit IRC | 01:26 | |
| *** jamielennox is now known as jamielennox|away | 01:26 | |
| *** itsuugo has joined #openstack-infra | 01:27 | |
| ianw | clarkb: i'm pretty sure i did it like that, but yeah ... could be wrong | 01:29 |
| *** lucasagomes has quit IRC | 01:30 | |
| *** hongbin has joined #openstack-infra | 01:30 | |
| *** sai has quit IRC | 01:32 | |
| clarkb | iamw just going by the reverse steps of add method | 01:32 |
| *** lucasagomes has joined #openstack-infra | 01:33 | |
| *** sai has joined #openstack-infra | 01:34 | |
| *** aeng has joined #openstack-infra | 01:38 | |
| *** xarses has joined #openstack-infra | 01:38 | |
| *** itsuugo has quit IRC | 01:39 | |
| *** salv-orlando has joined #openstack-infra | 01:41 | |
| *** itsuugo has joined #openstack-infra | 01:41 | |
| *** sai has quit IRC | 01:42 | |
| *** fguillot is now known as fguillot_afk | 01:43 | |
| *** fguillot_afk is now known as fguillot | 01:43 | |
| *** salv-orl_ has quit IRC | 01:43 | |
| *** sai has joined #openstack-infra | 01:44 | |
| *** sdake_ has joined #openstack-infra | 01:45 | |
| *** sdake_ has quit IRC | 01:45 | |
| *** sdake_ has joined #openstack-infra | 01:45 | |
| *** sdake has quit IRC | 01:47 | |
| *** smarcet has quit IRC | 01:48 | |
| *** caowei has joined #openstack-infra | 01:49 | |
| *** mriedem has quit IRC | 01:49 | |
| *** Apoorva_ has joined #openstack-infra | 01:51 | |
| *** itsuugo has quit IRC | 01:52 | |
| *** thorst_ has quit IRC | 01:52 | |
| *** thorst_ has joined #openstack-infra | 01:53 | |
| *** itsuugo has joined #openstack-infra | 01:54 | |
| *** annegentle has joined #openstack-infra | 01:54 | |
| *** yamahata has quit IRC | 01:55 | |
| *** Apoorva has quit IRC | 01:55 | |
| *** ijw has joined #openstack-infra | 01:56 | |
| *** Apoorva_ has quit IRC | 01:56 | |
| *** dtardivel has quit IRC | 01:57 | |
| *** yolanda has quit IRC | 01:57 | |
| *** sai has quit IRC | 01:59 | |
| *** Guest88826 has quit IRC | 01:59 | |
| *** wfoster has quit IRC | 02:00 | |
| *** wfoster has joined #openstack-infra | 02:00 | |
| *** sai has joined #openstack-infra | 02:00 | |
| *** thorst_ has quit IRC | 02:02 | |
| *** rook_ has joined #openstack-infra | 02:02 | |
| *** ijw has quit IRC | 02:02 | |
| *** fguillot has quit IRC | 02:03 | |
| *** adriant has quit IRC | 02:05 | |
| *** lucasagomes has quit IRC | 02:06 | |
| *** lucasagomes has joined #openstack-infra | 02:07 | |
| *** xarses_ has joined #openstack-infra | 02:08 | |
| *** apetrich has quit IRC | 02:11 | |
| *** xarses has quit IRC | 02:12 | |
| *** rook_ has quit IRC | 02:13 | |
| *** sai has quit IRC | 02:13 | |
| *** wfoster has quit IRC | 02:14 | |
| *** sflanigan has quit IRC | 02:14 | |
| *** gongysh has quit IRC | 02:14 | |
| *** lucasagomes has quit IRC | 02:15 | |
| *** apetrich has joined #openstack-infra | 02:15 | |
| *** aviau has quit IRC | 02:15 | |
| *** wfoster has joined #openstack-infra | 02:15 | |
| *** aviau has joined #openstack-infra | 02:15 | |
| *** sai has joined #openstack-infra | 02:15 | |
| *** rook has joined #openstack-infra | 02:16 | |
| *** rook is now known as Guest16412 | 02:16 | |
| *** lucasagomes has joined #openstack-infra | 02:17 | |
| amrith | greetings infra! | 02:18 |
| *** kjorgensen has joined #openstack-infra | 02:19 | |
| amrith | clarkb, fungi, if you are here I have a question I'd like your thoughts on | 02:19 |
| *** ijw has joined #openstack-infra | 02:19 | |
| *** woodster_ has quit IRC | 02:19 | |
| *** thorst_ has joined #openstack-infra | 02:20 | |
| *** thorst_ has quit IRC | 02:21 | |
| *** lucasagomes has quit IRC | 02:22 | |
| *** kjorgensen has quit IRC | 02:23 | |
| *** shu-mutou has joined #openstack-infra | 02:23 | |
| *** lucasagomes has joined #openstack-infra | 02:23 | |
| *** ijw has quit IRC | 02:23 | |
| clarkb | sort of but not really | 02:25 |
| *** sflanigan has joined #openstack-infra | 02:26 | |
| *** sflanigan has joined #openstack-infra | 02:26 | |
| *** zul has joined #openstack-infra | 02:27 | |
| *** lucasagomes has quit IRC | 02:28 | |
| *** zul has quit IRC | 02:28 | |
| amrith | clarkb, I'll send an email out. has to do with how I'd like to restructure some of trove's gate jobs | 02:28 |
| *** zul has joined #openstack-infra | 02:28 | |
| *** adriant has joined #openstack-infra | 02:29 | |
| *** lucasagomes has joined #openstack-infra | 02:29 | |
| amrith | should be in your mailbox ... | 02:31 |
| amrith | if the intertubes are working as expected | 02:31 |
| amrith | and someone poured draino on my ISP's head ... | 02:31 |
| *** csomerville has quit IRC | 02:32 | |
| clarkb | the first thing that comes to mind is use containers as that doesnt drastocally affect the nova api | 02:32 |
| *** lucasagomes has quit IRC | 02:34 | |
| clarkb | also I am skeptocal more memory would help unless you are swapping | 02:35 |
| *** thorst_ has joined #openstack-infra | 02:36 | |
| ianw | jeblair: https://etherpad.openstack.org/p/afs-docs updated ... i chose "zuul-launcher" because that seemed synchronous with "zuul-merger" ... just to keep separation of powers. should be ready to sync docs-old | 02:36 |
| *** lucasagomes has joined #openstack-infra | 02:37 | |
| *** senk has quit IRC | 02:38 | |
| *** senk has joined #openstack-infra | 02:38 | |
| *** cody-somerville has joined #openstack-infra | 02:38 | |
| *** lucasagomes has quit IRC | 02:41 | |
| *** ociuhandu has joined #openstack-infra | 02:42 | |
| *** lucasagomes has joined #openstack-infra | 02:43 | |
| amrith | clarkb, containers in what context? run the CI job in a container? | 02:44 |
| amrith | and yes, we are likely swapping a lot, and yes with more memory we get way faster. | 02:44 |
| *** sai has quit IRC | 02:45 | |
| *** wfoster has quit IRC | 02:46 | |
| *** Guest16412 has quit IRC | 02:46 | |
| *** wfoster has joined #openstack-infra | 02:47 | |
| *** sai has joined #openstack-infra | 02:47 | |
| clarkb | no run your db vms as containers | 02:48 |
| *** akshai has joined #openstack-infra | 02:48 | |
| *** lucasagomes has quit IRC | 02:48 | |
| *** rook_ has joined #openstack-infra | 02:48 | |
| *** akshai_ has joined #openstack-infra | 02:49 | |
| *** stevemar_ is now known as stevemar | 02:49 | |
| *** lucasagomes has joined #openstack-infra | 02:49 | |
| *** yuanying has quit IRC | 02:49 | |
| amrith | clarkb, for a lot of reasons, that doesn't work; much longer conversation unfortunately | 02:51 |
| amrith | apart from the fact that this isn't what trove currently is used for (running db's in vms) | 02:51 |
| amrith | or on bare metal | 02:52 |
| clarkb | thats what lbaas said too but no one could tell me why :) I dont doubt it we dont test that way so it likely xurrently doesnt workbut it should be possible | 02:52 |
| amrith | sure I can tell you why | 02:53 |
| *** akshai has quit IRC | 02:53 | |
| amrith | several reasons | 02:53 |
| *** mdrabe has quit IRC | 02:53 | |
| clarkb | my point is container vs VM shoukdnt matter when your abstraction is nova and meutron | 02:53 |
| amrith | actually it does for databases | 02:53 |
| clarkb | as long as they cangive you one or the other | 02:53 |
| amrith | not really true | 02:54 |
| clarkb | ok why not? | 02:54 |
| *** sai has quit IRC | 02:54 | |
| amrith | so, not many databases are run in production in a configuraiton which is a container | 02:54 |
| *** wfoster has quit IRC | 02:54 | |
| amrith | and therefore most databases (dare I say all) come with tools and commands that expect things like, upstart/systemd to exist | 02:54 |
| amrith | those don't necessarily exist in containers | 02:54 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: remove DIB workaround https://review.openstack.org/369792 | 02:55 |
| amrith | then there's the issue of storage attachment | 02:55 |
| *** rook_ has quit IRC | 02:55 | |
| amrith | can we do cinder attach into a container? | 02:55 |
| amrith | that's something we test and use | 02:55 |
| *** wfoster has joined #openstack-infra | 02:55 | |
| clarkb | I think so since its just iscsi | 02:55 |
| amrith | can we do swift (maybe we can, I don't know) | 02:55 |
| clarkb | the target side cant be iirc | 02:55 |
| *** sai has joined #openstack-infra | 02:55 | |
| clarkb | but the client can? | 02:55 |
| amrith | actually that's what I was told but ironic doesn't support cinder | 02:55 |
| amrith | in any event, there would need to be different guests which were container guests | 02:56 |
| clarkb | ironic is bare metal | 02:56 |
| amrith | but people using trove today use it with vm's | 02:56 |
| amrith | yes, I know | 02:56 |
| amrith | my point is that I was told that all it is is iscsi so it should work | 02:56 |
| clarkb | if you use dib you can use the same image | 02:56 |
| *** rook_ has joined #openstack-infra | 02:56 | |
| amrith | turns out that the devil is in the details | 02:56 |
| amrith | clarkb, trust me, we've tried | 02:56 |
| amrith | it isn't the same | 02:56 |
| amrith | I'm happy to, I'd love to be proved wrong | 02:56 |
| *** lucasagomes has quit IRC | 02:57 | |
| clarkb | you literally use the same raw image iirc | 02:57 |
| *** hongbin has quit IRC | 02:57 | |
| clarkb | Like I said I bet it doesnt work right this instnt and there are things that eould need to be addressed | 02:57 |
| amrith | ok, i'm sorry. that doesn't help me test trove in the environment in which it will be used | 02:58 |
| amrith | so if you are telling me I can't have machines with bigger memory, so be it. | 02:58 |
| amrith | I'll hack my tests up ... | 02:58 |
| amrith | that may be my only option | 02:58 |
| *** lucasagomes has joined #openstack-infra | 02:58 | |
| clarkb | oh right you have to use the userspace driver in libvirt for lxcand iscsi | 03:00 |
| clarkb | I rember someone sayi g it was fixdd and basically had to use driver that ubuntu removed or something (its back noe) | 03:00 |
| clarkb | I should actually test that at some point | 03:01 |
| amrith | great, if you have better luck than us, I'm happy to learn what that solution is | 03:01 |
| amrith | and if that works with the same images, even better. | 03:02 |
| clarkb | and ya looks like you use raw images | 03:02 |
| amrith | but, till then, what of getting machines with bigger memory? is that even a starter? | 03:02 |
| *** annegentle has quit IRC | 03:02 | |
| clarkb | no I dont think so | 03:03 |
| *** lucasagomes has quit IRC | 03:03 | |
| amrith | we don't use raw images, we use qcow2 | 03:03 |
| clarkb | we'd have to create a new label type and in a month nothing will run on 8gb anymore | 03:03 |
| clarkb | amrith: its arbitrary they convert back and forth | 03:03 |
| amrith | who converts back and forth? | 03:04 |
| amrith | we build the image | 03:04 |
| amrith | as part of the test | 03:04 |
| amrith | and register it | 03:04 |
| amrith | that's part of the test | 03:04 |
| clarkb | dib can output to either at build time or you can do a manual qemu-img convert | 03:04 |
| amrith | we build a qcow2 | 03:04 |
| amrith | yes, I'm familiar with that; that's how I test with VIO, for example | 03:04 |
| *** zul has quit IRC | 03:05 | |
| amrith | but currently our testing (and has been for 3 years that I've known it) uses dib based images that are qcow2 | 03:05 |
| amrith | not raw | 03:05 |
| clarkb | yes byt you can have both is my point | 03:05 |
| clarkb | the image firmat us decoupled from the content | 03:05 |
| amrith | and would that help me with performance? | 03:05 |
| clarkb | it might they use more disk but tend to have better io | 03:05 |
| *** lucasagomes has joined #openstack-infra | 03:05 | |
| clarkb | since they dont have to uncompress blocks and write them back | 03:05 |
| amrith | but that's the time to build the image | 03:06 |
| amrith | like I said, the setup time is 20-25m, which is setup devstack, trove, build and register image | 03:06 |
| amrith | the rest of the time is testing | 03:06 |
| amrith | which doesn't build more images | 03:06 |
| clarkb | time to build doesnt really change since dib builds a raw to start then converts to the other formats | 03:06 |
| amrith | will it be faster to boot an image with raw? | 03:07 |
| amrith | I'll try it if it is | 03:07 |
| amrith | but that isn't the big time ... | 03:07 |
| amrith | if 20-25m is the setup time | 03:07 |
| amrith | and the rest is testing | 03:07 |
| amrith | I merely said (in email) that with bigger memory, operations ran faster | 03:07 |
| amrith | like 5x faster | 03:07 |
| clarkb | ya because of swapping likely | 03:07 |
| amrith | to launch an instance goes from 500ish to 100ish | 03:07 |
| amrith | yes, swapping likely | 03:07 |
| amrith | hence my request for more memory | 03:07 |
| *** wfoster has quit IRC | 03:08 | |
| amrith | so what's the 8g that goes away in a month? | 03:08 |
| *** sai has quit IRC | 03:08 | |
| clarkb | amrith: we know that every time we increase a bound we rush to meet it | 03:08 |
| *** rook_ has quit IRC | 03:08 | |
| clarkb | so as soon as you bumo the memory you will use it | 03:09 |
| *** rook_ has joined #openstack-infra | 03:09 | |
| amrith | oh yes, absolutely, in this case that's what I'm asking for ... | 03:09 |
| clarkb | then you will want another increase | 03:09 |
| amrith | why? | 03:09 |
| *** senk has quit IRC | 03:09 | |
| clarkb | because thats what happens | 03:09 |
| clarkb | devstack used to work in 1GB | 03:09 |
| clarkb | bow it needs 8 | 03:09 |
| amrith | the size of the VM we're going to launch in testing is based on the size of the memory that the inner database recommends | 03:10 |
| *** sai has joined #openstack-infra | 03:10 | |
| *** lucasagomes has quit IRC | 03:10 | |
| amrith | yes, I remember when I had a desktop with 640kb or ram | 03:10 |
| amrith | but I don't use wordstar on DOS any longer | 03:10 |
| clarkb | right but you do have devs that probably dont have 16GB of memory laying around | 03:10 |
| amrith | at the end of the day, we're looking for memory to launch VM's which will consume memory for the database | 03:10 |
| clarkb | I certainly dont | 03:10 |
| amrith | actually everyone we hire pretty much needs a machine with 16gb ram | 03:11 |
| amrith | or more | 03:11 |
| amrith | mine is 64gb | 03:11 |
| *** kjorgensen has joined #openstack-infra | 03:11 | |
| amrith | which explains why I limp, and have a hernia | 03:11 |
| clarkb | anyways thats why we dont randomly increase memory | 03:12 |
| clarkb | the test envs are intentionally sozed to strike a balance netween perfoance and reasonable devenvs | 03:12 |
| *** wfoster has joined #openstack-infra | 03:12 | |
| amrith | so we're trying to simulate a cluster as part of our test | 03:12 |
| clarkb | also simplifies nodepool scheduling to not need mamy different things | 03:12 |
| amrith | we can't do a cluster of 1 | 03:12 |
| amrith | we want to test replication | 03:12 |
| amrith | we can't do replication with 1 instance | 03:12 |
| amrith | even if we did this stuff in a container as you suggested, the thing that takes up the memory isn't the OS, it is the DB | 03:13 |
| *** lucasagomes has joined #openstack-infra | 03:13 | |
| amrith | we have to run Mongo with their minimum recomended db size | 03:13 |
| amrith | or cassandra | 03:13 |
| amrith | or mysql | 03:13 |
| amrith | the linux os is a tiny fraction of the size | 03:13 |
| clarkb | why do you have to run them as if its production? | 03:13 |
| amrith | that's not production | 03:13 |
| amrith | that's minimum recommended size | 03:13 |
| amrith | for operation | 03:13 |
| clarkb | how big are your VM flavors? | 03:14 |
| amrith | we have a plethora of sizes of vm sizes just to fit them in the test envs | 03:14 |
| amrith | I think we use 2g machines | 03:14 |
| amrith | with one core | 03:14 |
| amrith | so whatever size the CI infrastructure gives us | 03:14 |
| amrith | will have a number of nested vm's of 2gb each | 03:14 |
| amrith | I can't reasonably expect to test a clustered database with under 2gb of memory, the thing (say cassandra) sometimes won't come up | 03:15 |
| amrith | of course, we can tweak the db | 03:15 |
| amrith | to launch on a smaller amount | 03:15 |
| amrith | bt then we're into the debugging the failures ebcause the db is runnign without enough memory | 03:15 |
| *** kjorgensen has quit IRC | 03:15 | |
| amrith | so sure, I'll launch the thing in a cntainer; I'll save the small os footprint. but what of the db size? | 03:16 |
| amrith | that's the big part | 03:16 |
| amrith | which by the way explains why a lot of people don't see the same benefits running a db in a container that they do running, say a webserver in a container | 03:16 |
| *** wfoster has quit IRC | 03:17 | |
| amrith | bbi2m | 03:17 |
| clarkb | in this case the beneift to container would be to avoid emulation | 03:17 |
| clarkb | since qemu us slow | 03:17 |
| *** yuanying has joined #openstack-infra | 03:17 | |
| *** vikrant has joined #openstack-infra | 03:18 | |
| *** vikrant has quit IRC | 03:18 | |
| *** akshai_ has quit IRC | 03:19 | |
| *** vikrant has joined #openstack-infra | 03:20 | |
| *** wfoster has joined #openstack-infra | 03:20 | |
| *** lucasagomes has quit IRC | 03:21 | |
| *** itsuugo has quit IRC | 03:21 | |
| *** tqtran has joined #openstack-infra | 03:22 | |
| amrith | which may be the case but as I'm seeing in other clouds, more memory, 5x faster. | 03:22 |
| amrith | if you are swapping, having a faster cpu (less qemu overhead) won't gain you much | 03:22 |
| amrith | so, while containers avoid emulation, the qemu overhead is now down in the 3 to 4% range | 03:23 |
| clarkb | are you sure you qemu'd there too? | 03:23 |
| amrith | yes | 03:23 |
| *** itsuugo has joined #openstack-infra | 03:23 | |
| *** lucasagomes has joined #openstack-infra | 03:23 | |
| clarkb | not kvm? more clouds are allowing passthrough | 03:23 |
| amrith | heck, the testing is faster on my laptop and I run windows with a vmware VM of ubuntu 14.04 and run trove on that | 03:23 |
| amrith | and it is faster than the CI | 03:24 |
| clarkb | would be curious if you have virt there too | 03:24 |
| amrith | yes | 03:24 |
| clarkb | look for vmx in your cpu flags | 03:24 |
| amrith | and on my machine kvm-ok is true | 03:24 |
| amrith | same as in the CI infrastructure | 03:24 |
| clarkb | ya so virt proper or conatianers is always going to be faster than qemu | 03:24 |
| amrith | and same as the other cloud we use for our development | 03:24 |
| clarkb | our ci infrastructure does not have virt | 03:25 |
| amrith | but on our CI, kvm-ok is TRUE | 03:25 |
| clarkb | and must emulate | 03:25 |
| amrith | if I ssh'ed into the machine where the CI jobs are running (like I did some days ago) | 03:25 |
| amrith | kvm-ok was true | 03:25 |
| clarkb | it depends on the cloud but devstack gate intentionally turns it off | 03:25 |
| amrith | which makes the environment identical to what I have on my laptop sans the fact that mine is all local disk | 03:25 |
| *** wfoster has quit IRC | 03:25 | |
| clarkb | because its not consistent and where we have it it is unreliable (crash the tests) | 03:26 |
| *** sai has quit IRC | 03:26 | |
| clarkb | anyways my point is speedup could be due to virt vs no virt, swapping, both something else | 03:26 |
| clarkb | using a co tainer will account for one factor | 03:26 |
| *** tqtran has quit IRC | 03:26 | |
| amrith | and more memory will account for another | 03:27 |
| *** rook_ has quit IRC | 03:27 | |
| amrith | and if more memory speeds it up, it is a benefit with zero change | 03:27 |
| *** rook has joined #openstack-infra | 03:27 | |
| clarkb | its not zero change | 03:27 |
| amrith | and if I have to go to a container, it isn't testing the product the way it will be used | 03:27 |
| *** wfoster has joined #openstack-infra | 03:27 | |
| clarkb | its a massive change | 03:27 |
| *** rook is now known as Guest41113 | 03:27 | |
| *** sai has joined #openstack-infra | 03:27 | |
| amrith | ok, in that case, the only viable short term solution appears to be to chop the tests into smaller chunks | 03:28 |
| *** lucasagomes has quit IRC | 03:28 | |
| amrith | which I can experiment with | 03:28 |
| amrith | and maybe come up with some division which works out reasonably | 03:28 |
| amrith | now can I make the CI jobs such that if something quick (like pep8) fails, it doesnt' run the rest? | 03:29 |
| amrith | I have not seen an easy way to do that | 03:29 |
| *** lucasagomes has joined #openstack-infra | 03:29 | |
| cloudnull | evenings | 03:29 |
| amrith | g'evening | 03:30 |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder: Update junit plugin https://review.openstack.org/369128 | 03:30 |
| clarkb | amrith: zuul only supports one to many not many to many deps like that. we actually ran tests like that gor a while and found that it just resulted in more ci passes while each successive test had to fail and be fixed | 03:31 |
| *** adrian_otto has joined #openstack-infra | 03:31 | |
| clarkb | thats why we run them all at once now to give a more complete pixture in the hope they can be debugged together | 03:31 |
| clarkb | ao then you make 2 passes instead of n_tests passes | 03:31 |
| amrith | i see | 03:32 |
| *** itsuugo has quit IRC | 03:32 | |
| amrith | ok, I'll experiment with chopping my tests up into smaller units. in the meanwhile, if you feel that I can get devstack gate to go with a nova running say lxc/lxd and run trove on that and it'll be faster, I'm happy to give that a go. | 03:33 |
| *** sflanigan has quit IRC | 03:33 | |
| amrith | my experiments with lxc/lxd have not shown them to be dramatically better than kvm, but I wasn't running 'real' database benchmarks | 03:33 |
| amrith | just the CI style testing | 03:34 |
| amrith | after all, I'm not testing the database | 03:34 |
| amrith | and I'm not running tpc-[cdh...] | 03:34 |
| *** aeng has quit IRC | 03:34 | |
| *** itsuugo has joined #openstack-infra | 03:34 | |
| amrith | rather seeing how long a functional test of trove which exercises low performance aspects of the database (start, stop, reconfigure, setup replication, setup clustering ...) take | 03:34 |
| amrith | s/take$/takes/ | 03:34 |
| amrith | but I do have to load some data | 03:35 |
| amrith | to get a fair test of replication, backup, restore etc., | 03:35 |
| amrith | thanks for the chat, I'll look to chopping up the tests and see what I can gain | 03:35 |
| *** Sukhdev has joined #openstack-infra | 03:36 | |
| *** yuanying has quit IRC | 03:36 | |
| clarkb | right but keep in mind we don't run kvm in the ci infrastructure | 03:36 |
| clarkb | you are getting qemu | 03:36 |
| clarkb | which is really really slow. It takes like 5 minutes to boot an ubuntu image that does nothing | 03:37 |
| * clarkb is trying to dig up a trove functional jobs logs to see if it swaps | 03:37 | |
| *** yuanying has joined #openstack-infra | 03:37 | |
| amrith | yes, I'm going to go and look at the lxc/lxd suggestion | 03:39 |
| clarkb | looks like a gig of swap in http://logs.openstack.org/47/362347/22/check/gate-trove-scenario-functional-dsvm-mysql/6a060a0/logs/screen-dstat.txt.gz | 03:39 |
| amrith | if I can get it to work with little change to the rest of trove, then it may be a representative test | 03:39 |
| *** yuanying has quit IRC | 03:39 | |
| amrith | and useful funcitonality at the same time | 03:39 |
| *** baoli has quit IRC | 03:39 | |
| clarkb | amrith: ya I think the quick way to test is use the nova-lxd devstack plugin and upload a raw image not a qcow2 image | 03:39 |
| clarkb | and keep everything else the same and see what breaks | 03:40 |
| amrith | yes, I can do that easily. I've done that before and have a list of things that I know need to be tweaked | 03:40 |
| amrith | qemu-image-convert or something like that | 03:40 |
| clarkb | amrith: just tell dib to output a raw image | 03:40 |
| amrith | I know that for example, with vio, there are zero changes required | 03:40 |
| clarkb | -t raw iirc | 03:40 |
| amrith | I've used the raw images and tried docker and it went up in smoke initially | 03:41 |
| clarkb | right but I was never talking about docker :) | 03:41 |
| *** yuanying has joined #openstack-infra | 03:41 | |
| amrith | but I got it to work with nova-docker and the docker image (funny name, not the usual) and it had upstart | 03:41 |
| clarkb | (there is a huge difference between docker and lxc) | 03:41 |
| *** lucasagomes has quit IRC | 03:41 | |
| amrith | so I'm sure that I can get lxc/lxd to work as well | 03:41 |
| amrith | and the changes may not be huge, for a quick and dirty test | 03:41 |
| clarkb | docker is very much orientated towards "run this single process in a container" which doesn't maop too well to nova's abstraction | 03:41 |
| clarkb | but lxc/lxd should map reasonably | 03:42 |
| *** yuanying has quit IRC | 03:42 | |
| amrith | yes, that was one issue with docker so I didn't use baseimage-docker but something else phusion or pfishing or some such thing | 03:42 |
| amrith | which had init and the whole nine yards | 03:42 |
| amrith | and things like 'service start' worked | 03:43 |
| amrith | which is what trove uses to launch the db ... etc., | 03:43 |
| *** lucasagomes has joined #openstack-infra | 03:43 | |
| amrith | and if that works out faster, that would be an easier way to gain some time. | 03:43 |
| amrith | thanks clarkb | 03:43 |
| *** weshay is now known as weshay_pto | 03:45 | |
| *** sai has quit IRC | 03:47 | |
| *** wfoster has quit IRC | 03:47 | |
| *** itsuugo has quit IRC | 03:48 | |
| *** lucasagomes has quit IRC | 03:48 | |
| *** Guest41113 has quit IRC | 03:48 | |
| *** itsuugo has joined #openstack-infra | 03:49 | |
| *** rook_ has joined #openstack-infra | 03:49 | |
| *** sai has joined #openstack-infra | 03:49 | |
| *** sflanigan has joined #openstack-infra | 03:49 | |
| *** sflanigan has joined #openstack-infra | 03:49 | |
| *** lucasagomes has joined #openstack-infra | 03:50 | |
| *** wfoster has joined #openstack-infra | 03:50 | |
| *** thorst_ has quit IRC | 03:50 | |
| *** aeng has joined #openstack-infra | 03:51 | |
| *** yuanying has joined #openstack-infra | 03:52 | |
| *** yamamoto has joined #openstack-infra | 03:52 | |
| *** lucasagomes has quit IRC | 03:54 | |
| *** adrian_otto has quit IRC | 03:56 | |
| *** lucasagomes has joined #openstack-infra | 03:56 | |
| *** adrian_otto has joined #openstack-infra | 03:56 | |
| *** wfoster has quit IRC | 03:57 | |
| *** sai has quit IRC | 03:58 | |
| *** rook_ has quit IRC | 03:58 | |
| *** rook_ has joined #openstack-infra | 03:59 | |
| *** wfoster has joined #openstack-infra | 03:59 | |
| *** itsuugo has quit IRC | 03:59 | |
| *** sai has joined #openstack-infra | 03:59 | |
| *** itsuugo has joined #openstack-infra | 04:00 | |
| *** lucasagomes has quit IRC | 04:01 | |
| *** thorst_ has joined #openstack-infra | 04:02 | |
| *** lucasagomes has joined #openstack-infra | 04:04 | |
| *** Sukhdev has quit IRC | 04:05 | |
| *** sai has quit IRC | 04:05 | |
| *** wfoster has quit IRC | 04:07 | |
| *** wfoster has joined #openstack-infra | 04:08 | |
| *** sai_ has joined #openstack-infra | 04:08 | |
| *** itsuugo has quit IRC | 04:10 | |
| *** lucasagomes has quit IRC | 04:12 | |
| *** itsuugo has joined #openstack-infra | 04:12 | |
| *** lucasagomes has joined #openstack-infra | 04:13 | |
| *** aeng has quit IRC | 04:15 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: DNM testing trove with lxd https://review.openstack.org/369810 | 04:16 |
| *** lucasagomes has quit IRC | 04:17 | |
| clarkb | there that maybe will do a thing | 04:17 |
| amrith | clarkb, way ahead of me ... just got lxc installed on my machine | 04:17 |
| amrith | lxc | 04:17 |
| amrith | not lxd | 04:17 |
| amrith | I see that you're trying with lxd | 04:18 |
| clarkb | I am cheating and making the clouds do all the work | 04:18 |
| *** adrian_otto has quit IRC | 04:18 | |
| clarkb | amrith: ya only because I know they are active and seem to care about making things work also they have docs | 04:18 |
| clarkb | but in theory lxc/lxd are very similar I think | 04:18 |
| amrith | lxd is supposedly faster | 04:19 |
| amrith | but I found a couple of links about how to get lxc going | 04:19 |
| amrith | am jsut converting my local image to raw and will fire it up with lxc | 04:19 |
| *** rlandy has quit IRC | 04:19 | |
| amrith | I just enabled the driver and restarted nova-compute | 04:19 |
| *** itsuugo has quit IRC | 04:19 | |
| *** lucasagomes has joined #openstack-infra | 04:19 | |
| *** thorst_ has quit IRC | 04:20 | |
| clarkb | oh crud I think I needed to disable tempest | 04:21 |
| clarkb | since the test job I intended on taking advantage of turns it on | 04:22 |
| *** itsuugo has joined #openstack-infra | 04:22 | |
| clarkb | also sad that redstack is still a thing and not a devstack plugin yet | 04:22 |
| amrith | on the list for ocata | 04:23 |
| amrith | mtreinish mentioned it when I met him in nyc | 04:24 |
| amrith | there's a devstack plugin | 04:24 |
| amrith | but redstack does more than the devstack plugin | 04:24 |
| *** Sukhdev has joined #openstack-infra | 04:24 | |
| amrith | like, it sets up any database of your choosing | 04:24 |
| *** lucasagomes has quit IRC | 04:24 | |
| amrith | not something that devstack plugin is exactly geared for | 04:24 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: DNM testing trove with lxd https://review.openstack.org/369810 | 04:25 |
| clarkb | now with less tempest | 04:25 |
| amrith | well, your instance is launching ... devstack is running now | 04:25 |
| clarkb | I just killed it >_> it was going to spend half an hour running tempest before redstack | 04:25 |
| clarkb | better to just restart without tempest | 04:25 |
| *** lucasagomes has joined #openstack-infra | 04:26 | |
| clarkb | does trove work with nova net and neutron both? not sure if it cares like ironic does | 04:26 |
| *** aeng has joined #openstack-infra | 04:27 | |
| amrith | it works with both, there's a change pending in neutron which we need before things work well | 04:28 |
| amrith | for now nova networking | 04:28 |
| amrith | in the gate/devstack there's a change we need | 04:28 |
| amrith | let me find the number | 04:28 |
| amrith | https://review.openstack.org/#/c/356763/ | 04:28 |
| *** thorst_ has joined #openstack-infra | 04:28 | |
| *** armax has quit IRC | 04:29 | |
| amrith | i don't understand why you setup the infra change to depend on the trove-integration one | 04:31 |
| clarkb | amrith: because I need a raw image | 04:32 |
| amrith | so I'm looking at the zuul status for 368910 | 04:32 |
| clarkb | and redstack isn't configurable enough to do that with config options so I just hardcoded the switch | 04:32 |
| amrith | and which job is going to run the post hook? | 04:32 |
| clarkb | amrith: all of them. the one to watch is gate-tempest-dsvm-full-ubuntu-xenial though | 04:32 |
| *** thorst_ has quit IRC | 04:33 | |
| amrith | ok nc 149.202.187.92 19885 it is | 04:33 |
| *** lucasagomes has quit IRC | 04:33 | |
| amrith | so it is now at the point where it is running devstack, still not the fun part, I don't think | 04:33 |
| clarkb | and I have to add pylxd to the projects list :) | 04:34 |
| clarkb | no and it will fail if the neutron job is any indication | 04:34 |
| clarkb | I need to update my projects list | 04:34 |
| *** wfoster has quit IRC | 04:34 | |
| *** lucasagomes has joined #openstack-infra | 04:35 | |
| *** wfoster has joined #openstack-infra | 04:38 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: DNM testing trove with lxd https://review.openstack.org/369810 | 04:38 |
| amrith | so I guess https://wiki.ubuntu.com/OpenStack/LXC is not correct | 04:39 |
| amrith | there's no compute driver in nova.virt.lxc.LXCDriver | 04:39 |
| *** itsuugo has quit IRC | 04:42 | |
| *** kaisers has joined #openstack-infra | 04:43 | |
| *** jaosorior has joined #openstack-infra | 04:44 | |
| *** sai_ has quit IRC | 04:44 | |
| *** yamahata has joined #openstack-infra | 04:44 | |
| *** lucasagomes has quit IRC | 04:44 | |
| *** psachin has joined #openstack-infra | 04:44 | |
| *** wfoster has quit IRC | 04:44 | |
| *** rook_ has quit IRC | 04:44 | |
| *** itsuugo has joined #openstack-infra | 04:44 | |
| *** sai_ has joined #openstack-infra | 04:45 | |
| *** wfoster has joined #openstack-infra | 04:46 | |
| *** rook has joined #openstack-infra | 04:46 | |
| *** rook is now known as Guest90114 | 04:47 | |
| *** lucasagomes has joined #openstack-infra | 04:47 | |
| *** Sukhdev has quit IRC | 04:47 | |
| *** askb has quit IRC | 04:48 | |
| *** askb has joined #openstack-infra | 04:49 | |
| *** lucasagomes has quit IRC | 04:51 | |
| *** itsuugo has quit IRC | 04:51 | |
| *** thorst_ has joined #openstack-infra | 04:52 | |
| *** itsuugo has joined #openstack-infra | 04:53 | |
| *** lucasagomes has joined #openstack-infra | 04:53 | |
| *** yamamoto has quit IRC | 04:55 | |
| *** thorst_ has quit IRC | 04:56 | |
| *** roxanaghe has joined #openstack-infra | 04:56 | |
| *** yamamoto has joined #openstack-infra | 04:57 | |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder: Update cucumber-testresult plugin https://review.openstack.org/369818 | 04:57 |
| *** lucasagomes has quit IRC | 04:58 | |
| *** lucasagomes has joined #openstack-infra | 04:58 | |
| *** sai_ has quit IRC | 04:59 | |
| *** Jeffrey4l_ has joined #openstack-infra | 05:00 | |
| *** jaosorior has quit IRC | 05:00 | |
| *** claudiub has joined #openstack-infra | 05:01 | |
| *** jaosorior has joined #openstack-infra | 05:01 | |
| *** sai has joined #openstack-infra | 05:02 | |
| *** snarwade has quit IRC | 05:03 | |
| *** lucasagomes has quit IRC | 05:03 | |
| *** snarwade has joined #openstack-infra | 05:03 | |
| *** thorst_ has joined #openstack-infra | 05:03 | |
| *** Jeffrey4l has quit IRC | 05:04 | |
| *** lucasagomes has joined #openstack-infra | 05:04 | |
| *** sai has quit IRC | 05:07 | |
| *** thorst_ has quit IRC | 05:08 | |
| *** wfoster has quit IRC | 05:09 | |
| *** lucasagomes has quit IRC | 05:09 | |
| *** sai_ has joined #openstack-infra | 05:09 | |
| *** gtmanfred has quit IRC | 05:09 | |
| *** wfoster has joined #openstack-infra | 05:10 | |
| *** lucasagomes has joined #openstack-infra | 05:11 | |
| amrith | clarkb, if you are there ... https://review.openstack.org/#/c/369813/ is actually sort-of working, it appears. | 05:14 |
| *** armax has joined #openstack-infra | 05:15 | |
| *** Shrews has quit IRC | 05:15 | |
| clarkb | my change exploded in dib | 05:15 |
| clarkb | which is not where I expected the failure. It had trouble installing some packages | 05:15 |
| *** coreycb has quit IRC | 05:15 | |
| *** pgadiya has joined #openstack-infra | 05:15 | |
| *** thorst_ has joined #openstack-infra | 05:15 | |
| *** phschwartz has quit IRC | 05:15 | |
| *** mordred has quit IRC | 05:16 | |
| *** gongysh has joined #openstack-infra | 05:16 | |
| *** wfoster has quit IRC | 05:17 | |
| *** gtmanfred has joined #openstack-infra | 05:17 | |
| *** sai_ has quit IRC | 05:17 | |
| *** Shrews has joined #openstack-infra | 05:17 | |
| *** Guest90114 has quit IRC | 05:18 | |
| *** wfoster has joined #openstack-infra | 05:18 | |
| *** rook_ has joined #openstack-infra | 05:18 | |
| *** rossella_ has quit IRC | 05:18 | |
| *** phschwartz has joined #openstack-infra | 05:18 | |
| *** sai_ has joined #openstack-infra | 05:19 | |
| *** watersoul has quit IRC | 05:19 | |
| *** rossella_ has joined #openstack-infra | 05:19 | |
| *** roxanaghe has quit IRC | 05:19 | |
| *** lucasagomes has quit IRC | 05:19 | |
| *** watersoul has joined #openstack-infra | 05:19 | |
| *** roxanaghe has joined #openstack-infra | 05:20 | |
| *** mordred has joined #openstack-infra | 05:20 | |
| *** thorst_ has quit IRC | 05:20 | |
| *** openstack-user has joined #openstack-infra | 05:21 | |
| *** openstack-user has quit IRC | 05:22 | |
| *** openstack-user has joined #openstack-infra | 05:22 | |
| *** lucasagomes has joined #openstack-infra | 05:23 | |
| *** senk has joined #openstack-infra | 05:23 | |
| *** openstack-user has left #openstack-infra | 05:23 | |
| *** openstack-user has joined #openstack-infra | 05:24 | |
| *** wfoster has quit IRC | 05:25 | |
| *** sai_ has quit IRC | 05:25 | |
| amrith | clarkb I'm having better luck | 05:27 |
| *** sai_ has joined #openstack-infra | 05:27 | |
| *** lucasagomes has quit IRC | 05:27 | |
| amrith | tests are about 1.3x better (30% faster) | 05:27 |
| amrith | would you be able to confirm that they are actually using lxc? | 05:27 |
| amrith | all I can see from the output (netcat) seems to indicate that it is a raw image | 05:28 |
| *** itsuugo has quit IRC | 05:28 | |
| clarkb | amrith: do a virsh list --all | 05:28 |
| amrith | and lxc is the LIBVIRT_TYPE | 05:28 |
| amrith | this is a change on the CI | 05:28 |
| amrith | now | 05:28 |
| * clarkb double checks if that says | 05:28 | |
| amrith | https://review.openstack.org/#/c/369813/ | 05:28 |
| *** lucasagomes has joined #openstack-infra | 05:28 | |
| amrith | currently at telnet://2001:4800:1ae1:18:f816:3eff:fe5f:31a3:19885 | 05:28 |
| *** wfoster has joined #openstack-infra | 05:29 | |
| *** itsuugo has joined #openstack-infra | 05:29 | |
| clarkb | looks like its still using qemu | 05:30 |
| clarkb | so any speedup is probably due to image format | 05:30 |
| clarkb | amrith: I don't think the lxc change stuck because in the gate devstack ahs already run when redstack runs (this is why a devstack plugin is nicer) | 05:31 |
| clarkb | so that LIBVIRT_TYPE change is a noop | 05:31 |
| amrith | ah | 05:32 |
| amrith | true | 05:32 |
| amrith | that explains why it worked | 05:32 |
| amrith | and I guess the 30% is just because the gate is less loaded now? | 05:32 |
| clarkb | or raw is that much quicker | 05:32 |
| amrith | actually no | 05:33 |
| amrith | if I increase the window in logstash | 05:33 |
| amrith | it is about par for the course | 05:33 |
| *** rcernin has joined #openstack-infra | 05:33 | |
| amrith | test_instance_created takes between 300 and 600s | 05:33 |
| *** lucasagomes has quit IRC | 05:33 | |
| amrith | it came in at 361 this time | 05:33 |
| clarkb | (this is why I had to take the d-g route because redstack not being a devstack plugin means you can't affect devstack from there) | 05:33 |
| amrith | I had just seen a bunch which were in the 400'ish range when I used a shorter window | 05:34 |
| amrith | I've got to get rid of redstack somehow | 05:34 |
| amrith | there's too much hair on the beast | 05:34 |
| amrith | but, on my local machine | 05:34 |
| amrith | just that change | 05:34 |
| amrith | doesn't work | 05:35 |
| amrith | nova pukes | 05:35 |
| amrith | will have to figure out how to get lxc configured properly in nova | 05:35 |
| *** lucasagomes has joined #openstack-infra | 05:35 | |
| amrith | doesn't seem to be a nice devstack 'switch' to make that happen | 05:35 |
| *** sai_ has quit IRC | 05:35 | |
| *** cody-somerville has quit IRC | 05:35 | |
| *** rook_ has quit IRC | 05:36 | |
| amrith | but, with that, I think it is time to hit the sack. | 05:36 |
| clarkb | ya thats why I used nova-lxc since it has the devstack plugin | 05:36 |
| amrith | wait, how do you do that? | 05:36 |
| *** wfoster has quit IRC | 05:36 | |
| amrith | if you were doing this locally | 05:36 |
| amrith | on your mahcine | 05:36 |
| amrith | what would your devstack incantation be? | 05:36 |
| clarkb | you'd add the nova-lxd plugin to your localrc (they document how) | 05:37 |
| clarkb | and then run devstack | 05:37 |
| *** thorst_ has joined #openstack-infra | 05:37 | |
| *** sai has joined #openstack-infra | 05:37 | |
| amrith | hmm | 05:37 |
| *** cody-somerville has joined #openstack-infra | 05:38 | |
| *** rook has joined #openstack-infra | 05:38 | |
| *** isaacb has joined #openstack-infra | 05:38 | |
| *** rook is now known as Guest22457 | 05:38 | |
| *** wfoster has joined #openstack-infra | 05:39 | |
| amrith | found it, thanks | 05:39 |
| *** jamielennox|away is now known as jamielennox | 05:40 | |
| *** itsuugo has quit IRC | 05:43 | |
| *** wfoster has quit IRC | 05:43 | |
| *** sai has quit IRC | 05:44 | |
| *** lucasagomes has quit IRC | 05:45 | |
| *** armax has quit IRC | 05:45 | |
| *** sai has joined #openstack-infra | 05:45 | |
| *** wfoster has joined #openstack-infra | 05:45 | |
| *** itsuugo has joined #openstack-infra | 05:45 | |
| *** lucasagomes has joined #openstack-infra | 05:47 | |
| *** lucasagomes has quit IRC | 05:51 | |
| *** wfoster has quit IRC | 05:52 | |
| *** sai has quit IRC | 05:52 | |
| *** itsuugo has quit IRC | 05:52 | |
| *** wfoster has joined #openstack-infra | 05:53 | |
| *** itsuugo has joined #openstack-infra | 05:53 | |
| *** apetrich has quit IRC | 05:54 | |
| *** sai_ has joined #openstack-infra | 05:55 | |
| *** lucasagomes has joined #openstack-infra | 05:55 | |
| *** apetrich has joined #openstack-infra | 05:56 | |
| *** sflanigan_ has joined #openstack-infra | 05:57 | |
| *** sflanigan has quit IRC | 05:57 | |
| AJaeger | ianw: good evening! | 05:57 |
| ianw | AJaeger: hey, future AJaeger :) | 05:58 |
| ianw | i think we're ready to sync up the afs old-docs, but wanted to check on ftp magic with you | 05:58 |
| AJaeger | ianw: I used lftp to do this manually. lftp has a mirror command | 05:59 |
| *** lucasagomes has quit IRC | 05:59 | |
| AJaeger | So, I logged in on docs.o.o using the password (it's in hiera) and then cd /content;mirror -P6 -e content content | 06:00 |
| AJaeger | -P6 is 6 parallel downloads and -e is for deletion as well | 06:00 |
| *** wfoster has quit IRC | 06:01 | |
| openstackgerrit | Merged openstack-infra/project-config: Add nodejs4-jobs for zaqar-ui https://review.openstack.org/368558 | 06:02 |
| *** lucasagomes has joined #openstack-infra | 06:02 | |
| *** sai_ has quit IRC | 06:02 | |
| *** wfoster has joined #openstack-infra | 06:02 | |
| *** sai_ has joined #openstack-infra | 06:03 | |
| *** roxanaghe has quit IRC | 06:04 | |
| *** itsuugo has quit IRC | 06:07 | |
| *** adriant has quit IRC | 06:08 | |
| *** lucasagomes has quit IRC | 06:09 | |
| *** itsuugo has joined #openstack-infra | 06:09 | |
| *** lucasagomes has joined #openstack-infra | 06:10 | |
| *** sai_ has quit IRC | 06:16 | |
| *** wfoster has quit IRC | 06:17 | |
| *** isaacb has quit IRC | 06:17 | |
| *** wfoster has joined #openstack-infra | 06:17 | |
| *** sai_ has joined #openstack-infra | 06:18 | |
| *** salv-orlando has quit IRC | 06:18 | |
| *** lucasagomes has quit IRC | 06:18 | |
| *** senk has quit IRC | 06:19 | |
| *** lucasagomes has joined #openstack-infra | 06:20 | |
| *** nherciu has joined #openstack-infra | 06:22 | |
| *** isaacb has joined #openstack-infra | 06:24 | |
| *** kjorgensen has joined #openstack-infra | 06:27 | |
| *** itsuugo has quit IRC | 06:27 | |
| *** itsuugo has joined #openstack-infra | 06:29 | |
| *** jaosorior has quit IRC | 06:29 | |
| *** jaosorior has joined #openstack-infra | 06:30 | |
| ianw | AJaeger: so i've just put lftp on iad mirror to try this out | 06:31 |
| *** pcaruana has joined #openstack-infra | 06:32 | |
| *** Na3iL has joined #openstack-infra | 06:34 | |
| AJaeger | ianw: it runs for 24+ hours (at least to Germany), so use screen | 06:34 |
| *** itsuugo has quit IRC | 06:34 | |
| AJaeger | ianw: data to transfer is 10 GB | 06:35 |
| *** itsuugo has joined #openstack-infra | 06:35 | |
| AJaeger | ianw: cd /content is most probably wrong - content is the directoy you need to mirror | 06:35 |
| ianw | yeah i think it's web/content? | 06:35 |
| AJaeger | ianw: yeah | 06:36 |
| *** sflanigan has joined #openstack-infra | 06:36 | |
| *** dimtruck is now known as zz_dimtruck | 06:36 | |
| *** yuval has joined #openstack-infra | 06:38 | |
| *** sflanigan_ has quit IRC | 06:38 | |
| ianw | AJaeger: ok ...well it's going | 06:40 |
| *** yamamoto has quit IRC | 06:40 | |
| *** itsuugo has quit IRC | 06:40 | |
| *** sai_ has quit IRC | 06:40 | |
| *** dingyichen has quit IRC | 06:40 | |
| *** Guest22457 has quit IRC | 06:41 | |
| *** wfoster has quit IRC | 06:41 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack/os-testr: Update home-page url https://review.openstack.org/356179 | 06:41 |
| AJaeger | ianw: great! | 06:41 |
| *** itsuugo has joined #openstack-infra | 06:41 | |
| *** sai has joined #openstack-infra | 06:42 | |
| *** andreas_s has joined #openstack-infra | 06:42 | |
| AJaeger | then let's see how long it takes ;) | 06:43 |
| *** rook has joined #openstack-infra | 06:43 | |
| ianw | AJager: so you would expect index.html / robots.html at /afs/openstack.org/docs-old/ right? | 06:43 |
| ianw | not under "content"? | 06:43 |
| *** wfoster has joined #openstack-infra | 06:43 | |
| *** rook is now known as Guest99205 | 06:43 | |
| AJaeger | YEah, I would expect them directly under docs-old - but since that'S just a backup, I'm not sure whether we really care... | 06:44 |
| *** lucasagomes has quit IRC | 06:44 | |
| AJaeger | sorry, have to go offline for a few minutes now... | 06:44 |
| ianw | AJaeger: no problems. it's done about 55Mb | 06:44 |
| ianw | in about 5 minutes, so say 11Mb/minute. | 06:46 |
| ianw | echo $(( 10 * 1024 / 11 / 60 )) | 06:46 |
| ianw | 15 | 06:46 |
| ianw | 15 hours maybe? | 06:46 |
| *** lucasagomes has joined #openstack-infra | 06:46 | |
| *** itsuugo has quit IRC | 06:49 | |
| *** kjorgensen has quit IRC | 06:49 | |
| *** Rockyg has joined #openstack-infra | 06:49 | |
| *** itsuugo has joined #openstack-infra | 06:50 | |
| *** salv-orlando has joined #openstack-infra | 06:50 | |
| *** lucasagomes has quit IRC | 06:51 | |
| *** wfoster has quit IRC | 06:51 | |
| *** senk has joined #openstack-infra | 06:52 | |
| *** sai has quit IRC | 06:52 | |
| *** lucasagomes has joined #openstack-infra | 06:53 | |
| *** wfoster has joined #openstack-infra | 06:53 | |
| *** sai has joined #openstack-infra | 06:53 | |
| *** csomerville has joined #openstack-infra | 06:56 | |
| *** tesseract- has joined #openstack-infra | 06:57 | |
| *** zz_dimtruck is now known as dimtruck | 06:57 | |
| *** cody-somerville has quit IRC | 06:59 | |
| *** lucasagomes has quit IRC | 07:00 | |
| *** lucasagomes has joined #openstack-infra | 07:00 | |
| *** sai has quit IRC | 07:01 | |
| *** csomerville has quit IRC | 07:01 | |
| *** senk has quit IRC | 07:01 | |
| *** netsin has joined #openstack-infra | 07:02 | |
| AJaeger | ianw: let's see - it took me over the ocean 24+ hours. But iad is closer ;) | 07:02 |
| AJaeger | ianw: So, don't babysit it - check back tomorrow your time :) | 07:02 |
| ianw | AJaeger: that is what I figured ... i've updated etherpad with some info | 07:03 |
| *** sai has joined #openstack-infra | 07:03 | |
| ianw | https://etherpad.openstack.org/p/afs-docs | 07:03 |
| ianw | oh, your're on there anyway | 07:03 |
| AJaeger | great, thanks | 07:03 |
| AJaeger | ianw: at the commands you used for lftp. | 07:04 |
| *** mhickey has joined #openstack-infra | 07:04 | |
| *** lucasagomes has quit IRC | 07:05 | |
| *** netsinn has quit IRC | 07:05 | |
| *** senk has joined #openstack-infra | 07:05 | |
| *** shardy has joined #openstack-infra | 07:06 | |
| *** lucasagomes has joined #openstack-infra | 07:06 | |
| *** esikachev has joined #openstack-infra | 07:07 | |
| AJaeger | ianw: do you have some time to review two cleanups, please? https://review.openstack.org/366929 and https://review.openstack.org/368335 | 07:08 |
| *** jistr is now known as jistr|mtgs | 07:09 | |
| *** jistr|mtgs is now known as jistr|mtg | 07:09 | |
| ianw | AJaeger: 366929 looks unhappy in ci? | 07:09 |
| AJaeger | ianw: wrong ID ;( | 07:09 |
| AJaeger | ianw: https://review.openstack.org/368568 instead please | 07:10 |
| *** dimtruck is now known as zz_dimtruck | 07:10 | |
| AJaeger | ianw: astara seems abandoned - no reviews there for ages ;( | 07:10 |
| *** sai has quit IRC | 07:10 | |
| *** wfoster has quit IRC | 07:11 | |
| *** thorst_ has quit IRC | 07:12 | |
| *** wfoster has joined #openstack-infra | 07:12 | |
| *** florianf has joined #openstack-infra | 07:12 | |
| *** sai has joined #openstack-infra | 07:12 | |
| *** esikachev has quit IRC | 07:13 | |
| *** lucasagomes has quit IRC | 07:13 | |
| *** drifterza has joined #openstack-infra | 07:14 | |
| *** lucasagomes has joined #openstack-infra | 07:15 | |
| *** wendar has quit IRC | 07:15 | |
| *** wendar has joined #openstack-infra | 07:15 | |
| *** shardy is now known as shardy_mtg | 07:16 | |
| *** samuelBartel has joined #openstack-infra | 07:17 | |
| *** yaume has joined #openstack-infra | 07:18 | |
| *** Ravikiran_K has joined #openstack-infra | 07:19 | |
| *** yamamoto has joined #openstack-infra | 07:19 | |
| *** dtardivel has joined #openstack-infra | 07:20 | |
| *** lucasagomes has quit IRC | 07:20 | |
| *** lucasagomes has joined #openstack-infra | 07:21 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Remove Ceph from the ha job https://review.openstack.org/362990 | 07:21 |
| openstackgerrit | Merged openstack-infra/project-config: Improve gerrit checks messages https://review.openstack.org/368335 | 07:23 |
| openstackgerrit | Merged openstack-infra/project-config: Remove unused periodic neutron jobs https://review.openstack.org/368568 | 07:23 |
| *** gongysh has quit IRC | 07:24 | |
| *** OferBarber has quit IRC | 07:24 | |
| *** ccamacho|afk has quit IRC | 07:24 | |
| *** wfoster has quit IRC | 07:25 | |
| *** jtomasek has joined #openstack-infra | 07:25 | |
| *** tqtran has joined #openstack-infra | 07:26 | |
| *** jaosorior has quit IRC | 07:27 | |
| *** jaosorior has joined #openstack-infra | 07:27 | |
| *** ccamacho has joined #openstack-infra | 07:28 | |
| *** jaosorior has quit IRC | 07:29 | |
| *** sai has quit IRC | 07:30 | |
| *** Hal1 has joined #openstack-infra | 07:30 | |
| *** jlanoux has joined #openstack-infra | 07:30 | |
| *** nmagnezi_ has joined #openstack-infra | 07:30 | |
| *** jaosorior has joined #openstack-infra | 07:30 | |
| *** tqtran has quit IRC | 07:31 | |
| *** lucasagomes has quit IRC | 07:31 | |
| *** mikelk has joined #openstack-infra | 07:33 | |
| *** lucasagomes has joined #openstack-infra | 07:34 | |
| *** oanson has joined #openstack-infra | 07:34 | |
| *** Guest99205 has quit IRC | 07:35 | |
| *** cody-somerville has joined #openstack-infra | 07:35 | |
| *** cody-somerville has quit IRC | 07:35 | |
| *** cody-somerville has joined #openstack-infra | 07:35 | |
| *** csomerville has joined #openstack-infra | 07:37 | |
| *** jlanoux has quit IRC | 07:38 | |
| *** jlanoux has joined #openstack-infra | 07:38 | |
| *** lucasagomes has quit IRC | 07:38 | |
| *** sai has joined #openstack-infra | 07:39 | |
| *** rook_ has joined #openstack-infra | 07:39 | |
| *** wfoster has joined #openstack-infra | 07:39 | |
| *** amoralej|off is now known as amoralej | 07:39 | |
| *** lucasagomes has joined #openstack-infra | 07:39 | |
| *** itsuugo has quit IRC | 07:39 | |
| *** zz_dimtruck has quit IRC | 07:40 | |
| *** salv-orl_ has joined #openstack-infra | 07:40 | |
| *** cody-somerville has quit IRC | 07:41 | |
| *** itsuugo has joined #openstack-infra | 07:41 | |
| *** zz_dimtruck has joined #openstack-infra | 07:42 | |
| *** salv-orlando has quit IRC | 07:42 | |
| *** zz_dimtruck is now known as dimtruck | 07:43 | |
| *** dizquierdo has joined #openstack-infra | 07:43 | |
| *** lucasagomes has quit IRC | 07:44 | |
| *** wfoster has quit IRC | 07:46 | |
| *** lucasagomes has joined #openstack-infra | 07:47 | |
| *** rook_ has quit IRC | 07:47 | |
| *** sai has quit IRC | 07:47 | |
| *** wfoster has joined #openstack-infra | 07:48 | |
| *** sai has joined #openstack-infra | 07:48 | |
| *** rook has joined #openstack-infra | 07:48 | |
| *** rook is now known as Guest41006 | 07:49 | |
| *** tkelsey has joined #openstack-infra | 07:50 | |
| *** hashar has joined #openstack-infra | 07:51 | |
| *** onovy has quit IRC | 07:51 | |
| *** peterlisak has quit IRC | 07:52 | |
| *** lucasagomes has quit IRC | 07:52 | |
| *** lucasagomes has joined #openstack-infra | 07:52 | |
| *** wfoster has quit IRC | 07:55 | |
| *** sai has quit IRC | 07:55 | |
| *** jascott1 has quit IRC | 07:55 | |
| *** thorst_ has joined #openstack-infra | 07:56 | |
| *** lucasagomes has quit IRC | 07:57 | |
| *** wfoster has joined #openstack-infra | 07:57 | |
| *** sai has joined #openstack-infra | 07:58 | |
| *** thorst_ has quit IRC | 07:59 | |
| *** lucasagomes has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** thorst_ has joined #openstack-infra | 08:01 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:01 | |
| *** esikachev has joined #openstack-infra | 08:03 | |
| *** dtantsur is now known as dtantsur|brb | 08:03 | |
| *** permalac has joined #openstack-infra | 08:03 | |
| *** lucasagomes has quit IRC | 08:03 | |
| *** wfoster has quit IRC | 08:04 | |
| *** Guest41006 has quit IRC | 08:05 | |
| *** sai has quit IRC | 08:05 | |
| *** Na3iL has quit IRC | 08:05 | |
| *** wfoster has joined #openstack-infra | 08:06 | |
| *** rook_ has joined #openstack-infra | 08:06 | |
| *** sai has joined #openstack-infra | 08:07 | |
| *** lucasagomes has joined #openstack-infra | 08:08 | |
| *** jcoufal has joined #openstack-infra | 08:09 | |
| *** wfoster has quit IRC | 08:11 | |
| *** sai has quit IRC | 08:11 | |
| *** rook_ has quit IRC | 08:11 | |
| *** sai has joined #openstack-infra | 08:12 | |
| *** derekh has joined #openstack-infra | 08:12 | |
| *** wfoster has joined #openstack-infra | 08:12 | |
| *** Hal2 has joined #openstack-infra | 08:13 | |
| *** Hal1 has quit IRC | 08:13 | |
| *** rook_ has joined #openstack-infra | 08:14 | |
| *** thorst_ has quit IRC | 08:16 | |
| *** Na3iL has joined #openstack-infra | 08:19 | |
| *** wfoster has quit IRC | 08:19 | |
| *** rook_ has quit IRC | 08:20 | |
| *** wfoster has joined #openstack-infra | 08:20 | |
| *** rook_ has joined #openstack-infra | 08:21 | |
| *** thorst_ has joined #openstack-infra | 08:21 | |
| *** lucasagomes has quit IRC | 08:27 | |
| *** zhurong has quit IRC | 08:27 | |
| *** wfoster has quit IRC | 08:27 | |
| *** sai has quit IRC | 08:27 | |
| *** matrohon has joined #openstack-infra | 08:28 | |
| *** asettle has joined #openstack-infra | 08:29 | |
| *** rook_ has quit IRC | 08:29 | |
| *** wfoster has joined #openstack-infra | 08:29 | |
| *** sai has joined #openstack-infra | 08:30 | |
| *** peterlisak has joined #openstack-infra | 08:30 | |
| *** priteau has joined #openstack-infra | 08:30 | |
| *** onovy has joined #openstack-infra | 08:30 | |
| *** yamahata has quit IRC | 08:31 | |
| *** oomichi has quit IRC | 08:31 | |
| *** lucasagomes has joined #openstack-infra | 08:32 | |
| *** oomichi has joined #openstack-infra | 08:32 | |
| *** andreykurilin has left #openstack-infra | 08:35 | |
| *** andreykurilin has joined #openstack-infra | 08:36 | |
| *** wfoster has quit IRC | 08:37 | |
| *** kjorgensen has joined #openstack-infra | 08:37 | |
| *** wfoster has joined #openstack-infra | 08:37 | |
| *** thorst_ has quit IRC | 08:38 | |
| *** rook_ has joined #openstack-infra | 08:38 | |
| *** nmagnezi_ has quit IRC | 08:39 | |
| *** thorst_ has joined #openstack-infra | 08:39 | |
| *** nmagnezi_ has joined #openstack-infra | 08:40 | |
| *** kjorgensen has quit IRC | 08:41 | |
| *** sai has quit IRC | 08:41 | |
| *** vinaypotluri has quit IRC | 08:42 | |
| *** dizquierdo has quit IRC | 08:42 | |
| *** wfoster has quit IRC | 08:43 | |
| *** rook_ has quit IRC | 08:43 | |
| *** thorst_ has quit IRC | 08:44 | |
| *** thorst_ has joined #openstack-infra | 08:46 | |
| *** lucasagomes has quit IRC | 08:46 | |
| *** lucasagomes has joined #openstack-infra | 08:46 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Include marker file for release notes https://review.openstack.org/369938 | 08:47 |
| *** thorst_ has quit IRC | 08:48 | |
| *** itsuugo has quit IRC | 08:51 | |
| *** itsuugo has joined #openstack-infra | 08:52 | |
| *** thorst_ has joined #openstack-infra | 08:54 | |
| *** thorst_ has quit IRC | 08:59 | |
| *** itsuugo has quit IRC | 09:02 | |
| *** acoles is now known as acoles_ | 09:02 | |
| *** itsuugo has joined #openstack-infra | 09:03 | |
| *** lucasagomes has quit IRC | 09:05 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:08 | |
| *** lucasagomes has joined #openstack-infra | 09:08 | |
| *** claudiub has quit IRC | 09:08 | |
| *** wfoster has joined #openstack-infra | 09:08 | |
| *** sai has joined #openstack-infra | 09:09 | |
| *** thorst_ has joined #openstack-infra | 09:09 | |
| *** coolsvap_ is now known as coolsvap | 09:09 | |
| *** dimtruck is now known as zz_dimtruck | 09:11 | |
| *** thorst__ has joined #openstack-infra | 09:12 | |
| *** sambetts|afk is now known as sambetts | 09:12 | |
| *** thorst_ has quit IRC | 09:13 | |
| *** sai has quit IRC | 09:13 | |
| *** e0ne has joined #openstack-infra | 09:14 | |
| *** lucasagomes has quit IRC | 09:14 | |
| *** kzaitsev_mb has quit IRC | 09:14 | |
| *** chem has joined #openstack-infra | 09:15 | |
| *** lucasagomes has joined #openstack-infra | 09:17 | |
| *** wfoster has quit IRC | 09:17 | |
| *** jschwarz is now known as jschwarz|ooo | 09:19 | |
| *** thorst__ has quit IRC | 09:20 | |
| *** lucasagomes has quit IRC | 09:21 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:22 | |
| *** lucasagomes_ has joined #openstack-infra | 09:23 | |
| *** lucasagomes_ has quit IRC | 09:23 | |
| *** cdent has joined #openstack-infra | 09:26 | |
| *** tqtran has joined #openstack-infra | 09:28 | |
| *** sdake_ has quit IRC | 09:28 | |
| *** thorst_ has joined #openstack-infra | 09:28 | |
| *** acoles_ is now known as acoles | 09:28 | |
| *** peterlisak has quit IRC | 09:29 | |
| *** onovy has quit IRC | 09:29 | |
| *** lucasagomes has joined #openstack-infra | 09:32 | |
| *** tqtran has quit IRC | 09:32 | |
| *** itsuugo has quit IRC | 09:33 | |
| *** larainema has quit IRC | 09:34 | |
| *** itsuugo has joined #openstack-infra | 09:35 | |
| *** thorst_ has quit IRC | 09:35 | |
| *** wfoster has joined #openstack-infra | 09:37 | |
| *** sai has joined #openstack-infra | 09:37 | |
| *** permalac has quit IRC | 09:38 | |
| *** rook has joined #openstack-infra | 09:38 | |
| *** rook is now known as Guest4072 | 09:38 | |
| *** tosky has joined #openstack-infra | 09:41 | |
| *** sai has quit IRC | 09:46 | |
| *** daemontool has joined #openstack-infra | 09:46 | |
| *** wfoster has quit IRC | 09:46 | |
| *** wfoster has joined #openstack-infra | 09:47 | |
| *** sai has joined #openstack-infra | 09:47 | |
| *** dtantsur|brb is now known as dtantsur | 09:48 | |
| *** sai has quit IRC | 09:54 | |
| *** jaosorior is now known as jaosorior_lunch | 09:54 | |
| *** wfoster has quit IRC | 09:55 | |
| *** rfolco has joined #openstack-infra | 09:56 | |
| *** wfoster has joined #openstack-infra | 09:57 | |
| *** pgadiya has quit IRC | 09:57 | |
| *** sai has joined #openstack-infra | 09:57 | |
| *** pgadiya has joined #openstack-infra | 09:58 | |
| *** sarob has joined #openstack-infra | 10:01 | |
| *** thorst_ has joined #openstack-infra | 10:02 | |
| *** yolanda has joined #openstack-infra | 10:06 | |
| *** acabot has quit IRC | 10:06 | |
| *** sarob has quit IRC | 10:06 | |
| *** acabot has joined #openstack-infra | 10:07 | |
| *** shu-mutou is now known as shu-mutou-AFK | 10:10 | |
| *** thorst_ has quit IRC | 10:11 | |
| *** yamamoto has quit IRC | 10:12 | |
| *** thorst_ has joined #openstack-infra | 10:12 | |
| *** caowei has quit IRC | 10:13 | |
| *** matbu is now known as matbu|lunch | 10:17 | |
| *** thorst_ has quit IRC | 10:20 | |
| *** priteau has quit IRC | 10:23 | |
| *** degorenko is now known as degorenko_away | 10:26 | |
| *** _degorenko|afk is now known as degorenko | 10:26 | |
| *** jaosorior_lunch is now known as jaosorior | 10:27 | |
| *** ramishra has quit IRC | 10:31 | |
| *** ramishra has joined #openstack-infra | 10:33 | |
| openstackgerrit | Merged openstack-infra/release-tools: teach latest-deliverable-versions to diff against the dashboard https://review.openstack.org/368186 | 10:35 |
| *** itsuugo has quit IRC | 10:36 | |
| *** senk has quit IRC | 10:36 | |
| *** itsuugo has joined #openstack-infra | 10:37 | |
| *** thorst_ has joined #openstack-infra | 10:39 | |
| *** dstufft has quit IRC | 10:40 | |
| *** asselin_ has quit IRC | 10:42 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: get_host_info: get repos list https://review.openstack.org/369305 | 10:48 |
| *** itsuugo has quit IRC | 10:48 | |
| *** itsuugo has joined #openstack-infra | 10:49 | |
| *** wfoster has quit IRC | 10:49 | |
| *** dstufft has joined #openstack-infra | 10:50 | |
| *** dstufft has quit IRC | 10:50 | |
| *** dstufft has joined #openstack-infra | 10:50 | |
| *** thorst_ has quit IRC | 10:51 | |
| *** shardy_mtg is now known as shardy | 10:51 | |
| *** wfoster has joined #openstack-infra | 10:51 | |
| *** chem has quit IRC | 10:51 | |
| *** itsuugo has quit IRC | 10:56 | |
| *** itsuugo has joined #openstack-infra | 10:58 | |
| *** thorst_ has joined #openstack-infra | 10:59 | |
| *** senk has joined #openstack-infra | 11:00 | |
| *** psilvad has quit IRC | 11:01 | |
| *** zz_dimtruck is now known as dimtruck | 11:01 | |
| *** dizquierdo has joined #openstack-infra | 11:02 | |
| *** chem has joined #openstack-infra | 11:03 | |
| *** electrofelix has joined #openstack-infra | 11:04 | |
| *** larainema has joined #openstack-infra | 11:06 | |
| *** shardy is now known as shardy_mtg | 11:07 | |
| *** yamamoto has joined #openstack-infra | 11:07 | |
| *** pgadiya has quit IRC | 11:08 | |
| *** sai has quit IRC | 11:08 | |
| *** wfoster has quit IRC | 11:08 | |
| *** sdague has joined #openstack-infra | 11:08 | |
| *** Na3iL has quit IRC | 11:08 | |
| *** Guest4072 has quit IRC | 11:09 | |
| *** pgadiya has joined #openstack-infra | 11:09 | |
| yolanda | hi, good afternoon | 11:09 |
| *** pgadiya has quit IRC | 11:09 | |
| *** sai has joined #openstack-infra | 11:10 | |
| *** wfoster has joined #openstack-infra | 11:10 | |
| *** itsuugo has quit IRC | 11:10 | |
| *** pgadiya has joined #openstack-infra | 11:10 | |
| *** thorst_ has quit IRC | 11:11 | |
| *** dimtruck is now known as zz_dimtruck | 11:11 | |
| *** itsuugo has joined #openstack-infra | 11:11 | |
| *** rook has joined #openstack-infra | 11:12 | |
| *** rook is now known as Guest63439 | 11:12 | |
| *** ihrachys has joined #openstack-infra | 11:13 | |
| *** rtheis has joined #openstack-infra | 11:15 | |
| *** openstack-user has quit IRC | 11:16 | |
| *** thorst_ has joined #openstack-infra | 11:16 | |
| openstackgerrit | Merged openstack-infra/project-config: Add repo for openstack/puppet-glare. https://review.openstack.org/362950 | 11:16 |
| *** amoralej is now known as amoralej|lunch | 11:18 | |
| *** OferBarber has joined #openstack-infra | 11:18 | |
| *** ldnunes has joined #openstack-infra | 11:20 | |
| *** thorst_ has quit IRC | 11:21 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable inspector-auto-discovery on tempest discovery job https://review.openstack.org/369304 | 11:21 |
| *** jkilpatr has joined #openstack-infra | 11:22 | |
| *** mptacekx has joined #openstack-infra | 11:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Pass scenario as a parameter for OSA https://review.openstack.org/369539 | 11:24 |
| openstackgerrit | Merged openstack-infra/project-config: Add a Fuel extension to support Serializers Conversion https://review.openstack.org/367345 | 11:24 |
| *** itsuugo has quit IRC | 11:24 | |
| *** itsuugo has joined #openstack-infra | 11:26 | |
| *** tqtran has joined #openstack-infra | 11:29 | |
| pabelanger | morning | 11:29 |
| *** chem has quit IRC | 11:29 | |
| *** chem has joined #openstack-infra | 11:30 | |
| *** chem has quit IRC | 11:30 | |
| *** chem has joined #openstack-infra | 11:30 | |
| openstackgerrit | Luis del Toro proposed openstack-infra/jenkins-job-builder: Add support for Jenkins Sounds plugin https://review.openstack.org/370054 | 11:31 |
| *** tuanla_ has quit IRC | 11:32 | |
| *** sai has quit IRC | 11:32 | |
| *** wfoster has quit IRC | 11:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Add new project Trio2o https://review.openstack.org/367114 | 11:32 |
| *** sai has joined #openstack-infra | 11:33 | |
| *** wfoster has joined #openstack-infra | 11:33 | |
| *** tqtran has quit IRC | 11:34 | |
| *** dstufft has quit IRC | 11:34 | |
| *** dstufft has joined #openstack-infra | 11:34 | |
| *** openstackgerrit has quit IRC | 11:34 | |
| *** dstufft has quit IRC | 11:34 | |
| *** dstufft has joined #openstack-infra | 11:34 | |
| *** openstackgerrit has joined #openstack-infra | 11:34 | |
| *** kjorgensen has joined #openstack-infra | 11:35 | |
| pabelanger | jeblair: regarding launching zuul-launcher under k5start, should we consider only running ansible-playbook post_task under k5start to limit access to the keytab? Even go as far as running the specific rsync / other commands that are needed? | 11:35 |
| *** dstufft has quit IRC | 11:36 | |
| *** dstufft has joined #openstack-infra | 11:36 | |
| pabelanger | jeblair: reading etherpad, I'm parsing it as kstart -k /etc/zuul-launcher.keytab -- zuul-launcher -d | 11:36 |
| *** [HeOS] is now known as HeOS | 11:37 | |
| dtantsur | yolanda, could you please remove and re-add your W+1 to https://review.openstack.org/#/c/368080/ ? otherwise I'm afraid it won't catch that the dependency has merged | 11:38 |
| *** kjorgensen has quit IRC | 11:39 | |
| *** wfoster has quit IRC | 11:41 | |
| *** asettle has quit IRC | 11:42 | |
| *** sai has quit IRC | 11:43 | |
| *** asettle has joined #openstack-infra | 11:43 | |
| *** Guest63439 has quit IRC | 11:43 | |
| *** sai has joined #openstack-infra | 11:44 | |
| *** claudiub has joined #openstack-infra | 11:44 | |
| *** wfoster has joined #openstack-infra | 11:45 | |
| *** acoles is now known as acoles_ | 11:45 | |
| *** matbu|lunch is now known as matbu | 11:46 | |
| *** claudiub has quit IRC | 11:46 | |
| *** rook_ has joined #openstack-infra | 11:47 | |
| *** asettle has quit IRC | 11:47 | |
| yolanda | dtantsur, sure | 11:48 |
| *** woodster_ has joined #openstack-infra | 11:49 | |
| *** gildub has joined #openstack-infra | 11:50 | |
| *** claudiub has joined #openstack-infra | 11:50 | |
| *** lucasagomes is now known as lucas-hungry | 11:50 | |
| *** askb has quit IRC | 11:51 | |
| *** acoles_ is now known as acoles | 11:53 | |
| *** itsuugo has quit IRC | 11:54 | |
| *** edmondsw has joined #openstack-infra | 11:55 | |
| *** drifterza has quit IRC | 11:55 | |
| *** itsuugo has joined #openstack-infra | 11:56 | |
| *** lbeliveau has quit IRC | 11:58 | |
| openstackgerrit | Merged openstack-infra/project-config: Use standard python jobs for python-ironic-inspector-client https://review.openstack.org/368080 | 12:00 |
| *** lbeliveau has joined #openstack-infra | 12:00 | |
| *** Guest97706 is now known as Vivek | 12:00 | |
| *** Vivek is now known as Guest63356 | 12:01 | |
| *** Guest63356 is now known as VivekVC | 12:01 | |
| *** sarob has joined #openstack-infra | 12:03 | |
| *** psilvad has joined #openstack-infra | 12:03 | |
| *** drifterza has joined #openstack-infra | 12:07 | |
| *** asettle has joined #openstack-infra | 12:07 | |
| *** sarob has quit IRC | 12:07 | |
| *** VivekVC is now known as Vivek | 12:07 | |
| *** Vivek has quit IRC | 12:08 | |
| *** Vivek has joined #openstack-infra | 12:08 | |
| *** wfoster has quit IRC | 12:08 | |
| *** thorst_ has joined #openstack-infra | 12:10 | |
| *** gouthamr has joined #openstack-infra | 12:10 | |
| *** rook_ has quit IRC | 12:10 | |
| *** sai has quit IRC | 12:10 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow permissions to be set for teams on stories https://review.openstack.org/368917 | 12:10 |
| *** rook has joined #openstack-infra | 12:10 | |
| *** rook is now known as Guest79926 | 12:10 | |
| *** sai has joined #openstack-infra | 12:11 | |
| *** oanson has quit IRC | 12:11 | |
| *** wfoster has joined #openstack-infra | 12:11 | |
| *** psachin has quit IRC | 12:13 | |
| *** baoli has joined #openstack-infra | 12:14 | |
| *** baoli has quit IRC | 12:14 | |
| *** baoli has joined #openstack-infra | 12:15 | |
| *** psilvad has quit IRC | 12:15 | |
| *** baoli_ has joined #openstack-infra | 12:18 | |
| *** psachin has joined #openstack-infra | 12:18 | |
| *** psilvad has joined #openstack-infra | 12:20 | |
| *** baoli has quit IRC | 12:21 | |
| *** annegentle has joined #openstack-infra | 12:21 | |
| *** gildub has quit IRC | 12:21 | |
| frickler | clarkb: so it seems like glance_store is the culprit, see my update in https://bugs.launchpad.net/glance-store/+bug/1620999 , but I think I should be able to do a workaround in devstack | 12:23 |
| openstack | Launchpad bug 1620999 in glance_store "gate-tempest-dsvm-neutron-identity-v3-only-full-nv 100% failure rate" [Undecided,New] | 12:23 |
| *** psilvad has quit IRC | 12:25 | |
| *** psilvad has joined #openstack-infra | 12:25 | |
| *** mriedem has joined #openstack-infra | 12:27 | |
| *** pgadiya has quit IRC | 12:28 | |
| *** psilvad has quit IRC | 12:29 | |
| *** Na3iL has joined #openstack-infra | 12:31 | |
| *** itsuugo has quit IRC | 12:32 | |
| *** chem has quit IRC | 12:32 | |
| *** Guest98165 is now known as zeus | 12:32 | |
| *** zeus has quit IRC | 12:33 | |
| *** zeus has joined #openstack-infra | 12:33 | |
| *** itsuugo has joined #openstack-infra | 12:33 | |
| *** annegentle has quit IRC | 12:34 | |
| *** psilvad has joined #openstack-infra | 12:35 | |
| *** gordc has joined #openstack-infra | 12:35 | |
| *** chem has joined #openstack-infra | 12:36 | |
| *** xyang1 has joined #openstack-infra | 12:37 | |
| *** itsuugo has quit IRC | 12:38 | |
| *** EricGonczer_ has joined #openstack-infra | 12:38 | |
| *** shardy_mtg is now known as shardy | 12:39 | |
| *** itsuugo has joined #openstack-infra | 12:39 | |
| *** esikachev has quit IRC | 12:41 | |
| *** ociuhandu has quit IRC | 12:42 | |
| *** pgadiya has joined #openstack-infra | 12:43 | |
| *** jamesdenton has joined #openstack-infra | 12:44 | |
| *** Genek has joined #openstack-infra | 12:44 | |
| *** sai has quit IRC | 12:46 | |
| *** jtomasek has quit IRC | 12:46 | |
| *** wfoster has quit IRC | 12:47 | |
| *** Guest79926 has quit IRC | 12:47 | |
| *** dabukalam_ is now known as dabukalam | 12:48 | |
| AJaeger | pabelanger: could you review https://review.openstack.org/#/c/369619/ for osic-cloud8 images , please? | 12:48 |
| *** proffalken has joined #openstack-infra | 12:49 | |
| *** zz_dimtruck is now known as dimtruck | 12:50 | |
| *** vikrant has quit IRC | 12:50 | |
| *** itsuugo has quit IRC | 12:50 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Merge builder.Builder and builder.Jenkins https://review.openstack.org/319754 | 12:52 |
| *** itsuugo has joined #openstack-infra | 12:52 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Move CacheStorage to its own module. https://review.openstack.org/319755 | 12:52 |
| *** jheroux has joined #openstack-infra | 12:53 | |
| *** sai has joined #openstack-infra | 12:53 | |
| *** wfoster has joined #openstack-infra | 12:54 | |
| pabelanger | AJaeger: sure, we'll have to restart nodepool-builder to upload the new images. I can do that once it lands | 12:55 |
| *** asselin_ has joined #openstack-infra | 12:55 | |
| *** rook_ has joined #openstack-infra | 12:55 | |
| *** bethwhite_ has quit IRC | 12:55 | |
| *** bethwhite_ has joined #openstack-infra | 12:56 | |
| *** amoralej|lunch is now known as amoralej | 12:56 | |
| AJaeger | ah, good to know - great that I asked ;) | 12:56 |
| *** isaacb has quit IRC | 12:56 | |
| *** pgadiya has quit IRC | 12:57 | |
| *** lucas-hungry is now known as lucasagomes | 12:57 | |
| *** jaosorior has quit IRC | 13:01 | |
| *** dprince has joined #openstack-infra | 13:01 | |
| *** dprince has quit IRC | 13:01 | |
| *** sarob has joined #openstack-infra | 13:01 | |
| *** jaosorior has joined #openstack-infra | 13:01 | |
| *** pradk has quit IRC | 13:03 | |
| *** drifterza has quit IRC | 13:04 | |
| *** ccamacho is now known as ccamacho|lunch | 13:04 | |
| *** esikachev has joined #openstack-infra | 13:04 | |
| *** afred312 has joined #openstack-infra | 13:04 | |
| *** sai has quit IRC | 13:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Change image type to RAW in osic-cloud8 https://review.openstack.org/369619 | 13:06 |
| *** sarob has quit IRC | 13:06 | |
| *** wfoster has quit IRC | 13:06 | |
| *** wfoster has joined #openstack-infra | 13:07 | |
| *** chem has quit IRC | 13:07 | |
| *** sai has joined #openstack-infra | 13:07 | |
| *** Goneri has joined #openstack-infra | 13:08 | |
| *** esikachev has quit IRC | 13:08 | |
| *** proffalken has quit IRC | 13:09 | |
| *** chem has joined #openstack-infra | 13:10 | |
| *** mptacekx has quit IRC | 13:10 | |
| *** peterlisak has joined #openstack-infra | 13:12 | |
| *** onovy has joined #openstack-infra | 13:12 | |
| *** afred312 has quit IRC | 13:14 | |
| *** mdrabe has joined #openstack-infra | 13:14 | |
| *** rlandy has joined #openstack-infra | 13:17 | |
| *** amitgandhinz has quit IRC | 13:18 | |
| *** rossella_ has quit IRC | 13:18 | |
| *** amitgandhinz has joined #openstack-infra | 13:19 | |
| *** rossella_ has joined #openstack-infra | 13:19 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Replace ironic-inspector old jobs with new tempest ones on Newton https://review.openstack.org/370112 | 13:20 |
| *** amitgandhinz has quit IRC | 13:22 | |
| *** amitgandhinz has joined #openstack-infra | 13:23 | |
| *** shardy has quit IRC | 13:23 | |
| *** hamzy has quit IRC | 13:24 | |
| *** jistr|mtg is now known as jistr | 13:24 | |
| *** rhallisey has joined #openstack-infra | 13:24 | |
| *** esikachev has joined #openstack-infra | 13:25 | |
| *** mriedem has quit IRC | 13:25 | |
| *** fguillot has joined #openstack-infra | 13:26 | |
| vsaienko | devstack-gate core please review: https://review.openstack.org/#/c/352909/ fix enabled services on subnode | 13:26 |
| *** esberglu has joined #openstack-infra | 13:28 | |
| *** esikachev has quit IRC | 13:29 | |
| *** tqtran has joined #openstack-infra | 13:31 | |
| *** burgerk has joined #openstack-infra | 13:32 | |
| *** jcoufal has quit IRC | 13:34 | |
| *** jkilpatr has quit IRC | 13:34 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Simplify delete by removing unnecessary loop https://review.openstack.org/357990 | 13:34 |
| *** tqtran has quit IRC | 13:35 | |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/puppet-apps_site: [wip] Glare support for app-catalog https://review.openstack.org/359029 | 13:36 |
| *** salv-orlando has joined #openstack-infra | 13:40 | |
| pabelanger | mgagne: had a chance to talk with a teammate of yours in MTL last night. Told him to keep up the good work! | 13:41 |
| pabelanger | rcarrillocruz: clarkb: I'm going to place a few compute nodes in infracloud-vanilla into the emergency file to test https://review.openstack.org/#/c/368955/ | 13:42 |
| *** yamamoto has quit IRC | 13:42 | |
| *** itsuugo has quit IRC | 13:42 | |
| *** markvoelker has joined #openstack-infra | 13:43 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow permissions to be set for teams on stories https://review.openstack.org/368917 | 13:43 |
| *** salv-orl_ has quit IRC | 13:43 | |
| *** tongli has joined #openstack-infra | 13:43 | |
| *** yamamoto has joined #openstack-infra | 13:43 | |
| *** itsuugo has joined #openstack-infra | 13:44 | |
| *** yamamoto has quit IRC | 13:44 | |
| *** EricGonc_ has joined #openstack-infra | 13:44 | |
| frickler | clarkb: yay, https://review.openstack.org/369675 is well underway running tempest tests for identity-v3-only :) | 13:45 |
| *** EricGonczer_ has quit IRC | 13:46 | |
| *** burgerk has quit IRC | 13:46 | |
| *** jkilpatr has joined #openstack-infra | 13:48 | |
| *** jistr is now known as jistr|mtg | 13:49 | |
| *** mtanino has joined #openstack-infra | 13:49 | |
| *** itsuugo has quit IRC | 13:50 | |
| *** cardeois has joined #openstack-infra | 13:50 | |
| *** itsuugo has joined #openstack-infra | 13:52 | |
| pabelanger | rcarrillocruz: so, do we have any documentation on the process for restarting openstack services in infracloud? For example, compute001.vanilla.ic.o.o, I've made a change to nova.conf, but what steps are required to graceful restart nova | 13:52 |
| *** ddieterly has joined #openstack-infra | 13:52 | |
| *** ccamacho|lunch is now known as ccamacho | 13:53 | |
| *** mmedvede has joined #openstack-infra | 13:53 | |
| *** shardy has joined #openstack-infra | 13:55 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Support explicit API and simple config creation https://review.openstack.org/358019 | 13:55 |
| *** afred312 has joined #openstack-infra | 13:56 | |
| *** sdake has joined #openstack-infra | 13:58 | |
| *** yamamoto has joined #openstack-infra | 13:58 | |
| *** kgiusti has joined #openstack-infra | 13:58 | |
| *** nmagnezi_ has quit IRC | 14:00 | |
| *** xarses_ has quit IRC | 14:01 | |
| *** akshai has joined #openstack-infra | 14:01 | |
| *** hamzy has joined #openstack-infra | 14:01 | |
| *** Swami has joined #openstack-infra | 14:03 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: support constraints in api-ref-src jobs https://review.openstack.org/370140 | 14:03 |
| *** Swami has quit IRC | 14:03 | |
| sdague | AJaeger / mordred / fungi ^^^^ | 14:03 |
| sdague | so very close | 14:03 |
| *** Swami has joined #openstack-infra | 14:03 | |
| *** inc0 has joined #openstack-infra | 14:03 | |
| sdague | but I screwed up an upper constraints copy thing because I didn't realize I needed it | 14:03 |
| *** trown is now known as trown|brb | 14:03 | |
| *** esikachev has joined #openstack-infra | 14:04 | |
| *** pradk has joined #openstack-infra | 14:05 | |
| *** pradk- has joined #openstack-infra | 14:05 | |
| *** pradk- has quit IRC | 14:05 | |
| sdague | is osic cloud8 having issues? | 14:05 |
| *** rodrigods has quit IRC | 14:06 | |
| *** rodrigods has joined #openstack-infra | 14:06 | |
| *** trown|brb is now known as trown | 14:06 | |
| *** eharney has joined #openstack-infra | 14:07 | |
| sdague | the top of gate has 3 jobs failed, and they all are on osic cloud8 | 14:07 |
| irtermite | mrhillsman: ^^ | 14:08 |
| irtermite | inc0: ^^ | 14:08 |
| sdague | looks like those nodes are quite a bit slower | 14:08 |
| sdague | http://logs.openstack.org/33/365633/9/gate/gate-tempest-dsvm-cells-ubuntu-xenial/016cf07/console.html was a straight up timeout | 14:08 |
| inc0 | we just changed image type to raw | 14:09 |
| irtermite | sdague: slower than? | 14:09 |
| *** esikachev has quit IRC | 14:09 | |
| inc0 | which corresponds to slowness | 14:09 |
| sdague | everything else | 14:09 |
| inc0 | time-wise | 14:09 |
| *** claudiub has quit IRC | 14:09 | |
| *** esikachev has joined #openstack-infra | 14:09 | |
| sdague | it took 4 minutes to install the mysql package in that run, for instance | 14:10 |
| *** EricGonc_ has quit IRC | 14:10 | |
| sdague | http://logs.openstack.org/33/365633/9/gate/gate-tempest-dsvm-cells-ubuntu-xenial/016cf07/logs/devstacklog.txt.gz#_2016-09-14_11_52_45_437 | 14:10 |
| inc0 | sdague, hmm, will take a look | 14:10 |
| *** yamamoto has quit IRC | 14:11 | |
| sdague | maybe we could avoid changes to gate provider configs until we get the RCs out? | 14:11 |
| *** mriedem has joined #openstack-infra | 14:11 | |
| *** mriedem has quit IRC | 14:11 | |
| inc0 | we did this change to solve similar problem | 14:11 |
| sdague | is there a known good that we can roll back to? | 14:11 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow permissions to be set for teams on stories https://review.openstack.org/368917 | 14:11 |
| inc0 | cephs don't like qcow2 | 14:12 |
| sdague | does this only impact the cloud8 region? | 14:12 |
| inc0 | the change to raw? yes | 14:12 |
| *** Daviey_ is now known as Daviey | 14:12 | |
| sdague | I wonder if we can just take it out of rotation for now till we get past the rc phase | 14:13 |
| sdague | and debug a bit more after | 14:13 |
| pabelanger | yes, we can do that | 14:13 |
| *** matrohon has quit IRC | 14:14 | |
| sshnaidm | does anybody know where gerrit and launchpad project are mapped for updating bugs? especially when it's not the same name | 14:14 |
| *** esikachev has quit IRC | 14:15 | |
| *** HeOS has quit IRC | 14:15 | |
| sshnaidm | I look here, but barely understand this https://git.openstack.org/cgit/openstack-infra/project-config/tree/gerrit/projects.yaml | 14:15 |
| *** rbrndt has joined #openstack-infra | 14:15 | |
| inc0 | images are still qcow | 14:15 |
| pabelanger | I've put nodepool.o.o in the emergency host. | 14:16 |
| pabelanger | disabling osic-cloud8 next | 14:16 |
| pabelanger | I'll get a review up shortly | 14:16 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Improve logger output for expanding templates https://review.openstack.org/336091 | 14:16 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Refactor base test classes inheritance for reuse https://review.openstack.org/336090 | 14:16 |
| inc0 | kk will debug this in the meantime | 14:16 |
| sshnaidm | It's told here about mapping in jeepyb, but also don't find it in jeepyb repo: http://docs.openstack.org/infra/system-config/jeepyb.html#launchpad-bug-integration | 14:17 |
| *** dtantsur is now known as dtantsur|mtg | 14:17 | |
| zxiiro | waynr: if you can re-review this patch we can get it merged: https://review.openstack.org/#/c/357990/ | 14:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Disable osic-cloud8 for now https://review.openstack.org/370155 | 14:21 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add email servers to firehose https://review.openstack.org/369662 | 14:21 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add lpmqtt to firehose deployments https://review.openstack.org/363313 | 14:21 |
| *** erlon has quit IRC | 14:21 | |
| pabelanger | sdague: fungi: clarkb: ^ turn down osic-cloud8 for now. I'm manually applied the patch on nodepool.o.o for the moment | 14:22 |
| *** raildo has joined #openstack-infra | 14:22 | |
| sdague | pabelanger: +2 | 14:22 |
| sdague | pabelanger: and thanks for jumping on this | 14:22 |
| pabelanger | sdague: did the failures just start this morning? Or is there data from the past few days? | 14:22 |
| *** tonytan4ever has joined #openstack-infra | 14:24 | |
| *** mriedem has joined #openstack-infra | 14:25 | |
| pabelanger | inc0: regarding raw format, do you ues the force_raw_images setting? I ask because we are having some image issues with infracloud. We currently upload qcow2 but not using ceph, just local file system | 14:26 |
| mtreinish | pabelanger: http://status.openstack.org/openstack-health/#/g/node_provider/osic-cloud8 | 14:26 |
| inc0 | pabelanger, I don't believe we do, will check, also I have good idea what's wrong with slow gates | 14:27 |
| pabelanger | mtreinish: TIL, thank you! | 14:27 |
| mtreinish | pabelanger: although it's not showing the current stuff yet, I think the cache update will pull those in at the top of the hour | 14:29 |
| * mtreinish is trying to remember how we set caching up on the api requests for that page | 14:29 | |
| cloudnull | pabelanger: I'd be happy, and maybe a few others from the OSA camp, to help out on infracloud; if that's something outsiders can work on. | 14:29 |
| *** yamahata has joined #openstack-infra | 14:29 | |
| *** esikachev has joined #openstack-infra | 14:30 | |
| pabelanger | cloudnull: Excellent! Ya, everything is driven by puppet-infracloud under openstack-infra, but mostly looking for help with optimizations on our current setup. | 14:31 |
| cloudnull | cool | 14:31 |
| pabelanger | first task I am working on is glance image caching | 14:31 |
| *** jaosorior has quit IRC | 14:31 | |
| cloudnull | it'd be great to work cross project. | 14:31 |
| cloudnull | I mean our deployment methods may differ but the results are the same | 14:32 |
| pabelanger | For sure | 14:32 |
| cloudnull | I'll look into "puppet-infracloud" . | 14:33 |
| mgagne | pabelanger: oh, you are located in Montreal? | 14:34 |
| mgagne | pabelanger: yea, that guy is very talkative =) | 14:34 |
| pabelanger | so the current issue is, once we upload new DIBS, nodepool will fail to boot a VM for the first time. Scheduling error after 3 attempts, since each compute node is still warming up their image cache. We are using qcow2 images, but it looks like nova will covert them to raw, so we're running with the idea to force_raw_images=False to see if that improve things | 14:35 |
| *** Swami_ has joined #openstack-infra | 14:35 | |
| jeblair | pabelanger: hrm, we could put the k5start in the playbook instead of running zuul-launcher with it.... let me think about that (cc: mordred) | 14:35 |
| pabelanger | mgagne: Ya, was at cloudops with EmilienM last night presenting. At the Red Hat office for the rest of the day before returning to Ottawa | 14:36 |
| *** nherciu has quit IRC | 14:36 | |
| mgagne | oh, missed the occasion, maybe next time =) | 14:36 |
| pabelanger | mgagne: indeed | 14:36 |
| *** matrohon has joined #openstack-infra | 14:36 | |
| *** rfolco has quit IRC | 14:37 | |
| *** bethwhite_ has quit IRC | 14:37 | |
| sdague | pabelanger: this is a spot notice, I don't have trending here | 14:38 |
| *** Swami has quit IRC | 14:38 | |
| *** Swami_ has quit IRC | 14:39 | |
| sdague | anteaya any change you can take look at https://review.openstack.org/#/c/370140 ... so close to getting this api-ref thing sorted | 14:40 |
| AJaeger | jeblair: -1 on your afs-docs change - and I did a similar change here https://review.openstack.org/369938 | 14:40 |
| AJaeger | jeblair: we need to take care of developer.o.o as well, don't we? | 14:41 |
| *** jamesden_ has joined #openstack-infra | 14:41 | |
| AJaeger | jeblair: I updated a bit to the etherpad... | 14:41 |
| *** ggnel_t has quit IRC | 14:42 | |
| njohnston | Hi! I'd like to get a Grafana view for gate failues for FWaaS; could I get an extra +2 for this change? https://review.openstack.org/#/c/368945/ Thanks! | 14:42 |
| jeblair | AJaeger: thanks. on linke 78 you say "Try this." what do you mean by that? | 14:42 |
| *** jamesde__ has joined #openstack-infra | 14:43 | |
| *** claudiub has joined #openstack-infra | 14:43 | |
| *** claudiub has quit IRC | 14:43 | |
| AJaeger | jeblair: Try BRANCH=feature/foo and run the next commands - it fails as I mention in line 82 | 14:44 |
| *** claudiub has joined #openstack-infra | 14:44 | |
| AJaeger | jeblair: So, first create a build/html direct, add content and then run those commands | 14:44 |
| jeblair | AJaeger: yeah, i understand line 82. i just don't understand line 78. | 14:44 |
| *** GordonTX has joined #openstack-infra | 14:44 | |
| *** amotoki has joined #openstack-infra | 14:45 | |
| AJaeger | jeblair: Ah - I highlighted the comment that shows that this should work with BRANCH=feature/foo | 14:45 |
| mordred | jeblair: so ... | 14:45 |
| AJaeger | jeblair: so, ignore line 78 if you get 82 - sorry for confusing you | 14:45 |
| jeblair | AJaeger: gotcha. | 14:45 |
| *** jamesden_ has quit IRC | 14:45 | |
| mordred | jeblair: if we put the k5start in the post_playbook you mean just around the actual operation? | 14:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add email servers to firehose https://review.openstack.org/369662 | 14:46 |
| jeblair | mordred: yeah, probably the final rsync | 14:46 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add lpmqtt to firehose deployments https://review.openstack.org/363313 | 14:46 |
| pabelanger | AJaeger: if you don't mind reviewing 370155 when you have a moment | 14:47 |
| *** raildo has quit IRC | 14:47 | |
| *** raildo has joined #openstack-infra | 14:47 | |
| *** Swami has joined #openstack-infra | 14:48 | |
| AJaeger | pabelanger: +2A | 14:49 |
| AJaeger | bbl | 14:49 |
| eantyshev | jeblair: Hello! May I ask you to look at this: https://review.openstack.org/238988 ? | 14:49 |
| *** burgerk has joined #openstack-infra | 14:49 | |
| pleia2 | storyboard meeting in 10 minutes for those who are attending pre-bug spring | 14:50 |
| *** erlon has joined #openstack-infra | 14:50 | |
| pleia2 | sprint too | 14:50 |
| mordred | jeblair: yah - I think that'll work | 14:50 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Simplify delete by removing unnecessary loop https://review.openstack.org/357990 | 14:51 |
| *** erlon_ has joined #openstack-infra | 14:51 | |
| *** hongbin has joined #openstack-infra | 14:53 | |
| *** kjorgensen has joined #openstack-infra | 14:54 | |
| *** ddieterly is now known as ddieterly[away] | 14:54 | |
| zxiiro | waynr: electrofelix: great looks like all the patches from last code sprint are merged now. We need to come up with a new list of patches for the next one | 14:54 |
| *** itsuugo has quit IRC | 14:54 | |
| sdague | mordred: hey, you are about | 14:55 |
| * mordred hides | 14:56 | |
| sdague | mordred: can I get an approve on https://review.openstack.org/#/c/370140/ - the api-ref macro is close | 14:56 |
| sdague | but I screwed up a thing | 14:56 |
| *** itsuugo has joined #openstack-infra | 14:56 | |
| *** senk has quit IRC | 14:56 | |
| sdague | the run scripts are in the image though, so I think there is a good chance that will make it all work | 14:56 |
| fungi | mmmsprints | 14:57 |
| mordred | sdague: whoops, and lgtm | 14:58 |
| *** rfolco has joined #openstack-infra | 14:58 | |
| *** kjorgensen has quit IRC | 14:58 | |
| *** jamesde__ has quit IRC | 14:58 | |
| *** ChanServ changes topic to "Bug sprint today in #openstack-sprint, starting with StoryBoard meeting in #openstack-meeting at 15:00 UTC" | 14:59 | |
| pleia2 | thanks | 14:59 |
| *** ddieterly[away] is now known as ddieterly | 14:59 | |
| *** akshai has quit IRC | 14:59 | |
| *** thcipriani|afk is now known as thcipriani | 15:00 | |
| *** rbrndt has quit IRC | 15:00 | |
| openstackgerrit | Merged openstack-infra/project-config: Disable osic-cloud8 for now https://review.openstack.org/370155 | 15:00 |
| *** ddieterly has quit IRC | 15:01 | |
| *** akshai has joined #openstack-infra | 15:01 | |
| *** jistr|mtg is now known as jistr | 15:01 | |
| *** rook_ is now known as rook | 15:01 | |
| openstackgerrit | Nate Johnston proposed openstack-infra/project-config: Integrate neutron-fwaas with neutron-lib CI https://review.openstack.org/368948 | 15:02 |
| *** xarses_ has joined #openstack-infra | 15:03 | |
| *** Hal1 has joined #openstack-infra | 15:03 | |
| *** Hal2 has quit IRC | 15:04 | |
| *** lykinsbd has joined #openstack-infra | 15:04 | |
| *** yuval has quit IRC | 15:04 | |
| *** xarses_ is now known as xarses | 15:04 | |
| *** david-lyle_ has joined #openstack-infra | 15:06 | |
| *** david-lyle_ has quit IRC | 15:06 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add subunit2sql CLI option to use run wall time https://review.openstack.org/370193 | 15:07 |
| *** jlanoux has quit IRC | 15:08 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add email servers to firehose https://review.openstack.org/369662 | 15:09 |
| openstackgerrit | Merged openstack-infra/project-config: support constraints in api-ref-src jobs https://review.openstack.org/370140 | 15:09 |
| mtreinish | jeblair: ^^^ I think I spelled sysadmins correctly this time :) | 15:09 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Add lpmqtt to firehose deployments https://review.openstack.org/363313 | 15:11 |
| *** yamamoto has joined #openstack-infra | 15:11 | |
| *** armax has joined #openstack-infra | 15:12 | |
| *** ddieterly has joined #openstack-infra | 15:13 | |
| *** vinaypotluri has joined #openstack-infra | 15:13 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: fix typo in bridge config for trusty https://review.openstack.org/370199 | 15:14 |
| *** ddieterly has quit IRC | 15:17 | |
| *** ddieterly has joined #openstack-infra | 15:18 | |
| *** pblaho has quit IRC | 15:21 | |
| *** pblaho has joined #openstack-infra | 15:23 | |
| *** lykinsbd has quit IRC | 15:25 | |
| *** yamamoto has quit IRC | 15:25 | |
| *** lykinsbd has joined #openstack-infra | 15:26 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: add zuul-cloner location to $PATH https://review.openstack.org/370210 | 15:26 |
| *** adrian_otto has joined #openstack-infra | 15:27 | |
| *** kjorgensen has joined #openstack-infra | 15:27 | |
| *** EricGonczer_ has joined #openstack-infra | 15:27 | |
| *** senk has joined #openstack-infra | 15:27 | |
| rcarrillocruz | pabelanger: afaik none, i just do service nova-* stop/start and that it | 15:28 |
| *** senk has quit IRC | 15:28 | |
| *** claudiub has quit IRC | 15:29 | |
| *** matt-borland has joined #openstack-infra | 15:29 | |
| *** vhosakot has joined #openstack-infra | 15:30 | |
| *** psachin has quit IRC | 15:30 | |
| therve | I have a question about available images during test runs | 15:30 |
| therve | In Heat we need an image somewhat more featureful than the basic one | 15:31 |
| *** ddieterly is now known as ddieterly[away] | 15:31 | |
| therve | Currently we download the base fedora image, but it fails fairly regularly | 15:31 |
| therve | Is there a way to have an internal mirror of such an image? | 15:31 |
| pabelanger | rcarrillocruz: Ya, that's what I found out too. It is only upgrades between release where we need to schedule rolling restarts | 15:31 |
| *** rbrndt has joined #openstack-infra | 15:32 | |
| pabelanger | therve: we do cache some images locally, so it is possible. I don't believe we do that with fedora today | 15:33 |
| *** yamamoto has joined #openstack-infra | 15:33 | |
| therve | pabelanger, Which ones are there? | 15:33 |
| pabelanger | I know we've talked about adding them into AFS in the past. | 15:34 |
| *** rcernin has quit IRC | 15:34 | |
| fungi | right now we just cache the ones devstack claims to need | 15:35 |
| *** dtantsur|mtg is now known as dtantsur | 15:35 | |
| fungi | i think there used to be a fedora image in there that was used by some heat jobs, but it may have been disabled/removed because it was so large | 15:35 |
| pabelanger | right | 15:35 |
| pabelanger | they are stored in ~/cache/files | 15:36 |
| *** jlanoux has joined #openstack-infra | 15:36 | |
| fungi | and also because at the time it was making nodepool image builds fail a lot because the fedora download site was unreliable | 15:36 |
| *** jlanoux has quit IRC | 15:36 | |
| * therve nods | 15:37 | |
| therve | fungi, The image we're using nowadays is about 200M, so it shouldn't be bad | 15:37 |
| pabelanger | Right, so we could mirror them today in AFS. It would me a matter of coming up with the process. EG: rsync for example | 15:37 |
| fungi | basically, when it comes to which things we cache locally in our nodepool images, we have to walk a fine line between useful to multiple jobs and small enough that it doesn't bloat our images and make them take even longer to upload to providers | 15:37 |
| pabelanger | however, not sure we want to mirror all fedora images, but a select few | 15:37 |
| *** chem has quit IRC | 15:38 | |
| *** jlanoux has joined #openstack-infra | 15:38 | |
| fungi | yeah, putting them in afs as we've discussed recently would be a good middle-ground because jobs would still have to download them, but they'd download them from a server local to where they're running (in the same provider/region) | 15:38 |
| therve | That'd be perfect for us | 15:39 |
| pabelanger | its been something on my list to do, maybe next week at the mid-cycle we can whiteboard something | 15:39 |
| therve | What's the path for doing that? | 15:39 |
| *** ccamacho has quit IRC | 15:40 | |
| pabelanger | adding a fedora mirror is also we might want, but just need low on the priority list | 15:40 |
| *** pcaruana has quit IRC | 15:40 | |
| *** roxanaghe has joined #openstack-infra | 15:41 | |
| *** ddieterly[away] has quit IRC | 15:41 | |
| therve | Maybe I'll say something stupid, but aren't nodepool images available? Is there an issue trying to use them? | 15:43 |
| *** shardy has quit IRC | 15:43 | |
| pabelanger | not today. They are pretty large (5gb) and have infra-root ssh keys in the images. | 15:44 |
| inc0 | pabelanger, did you disable cloud8? | 15:44 |
| clarkb | pabelanger: I think they are closer to 8GB qcow2 now | 15:44 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: run k5start in playbook https://review.openstack.org/370235 | 15:44 |
| pabelanger | that said, I'd like to start publishing minimal DIB images some place. | 15:45 |
| *** coreycb has joined #openstack-infra | 15:45 | |
| *** daemontool_ has joined #openstack-infra | 15:45 | |
| pabelanger | inc0: yes, for the moment. sdague requested until RC1 was finished | 15:45 |
| inc0 | that's ok | 15:45 |
| therve | pabelanger, Is there anything I can fill somewhere so that we can track this? | 15:45 |
| inc0 | we're redeploying ceph | 15:45 |
| pabelanger | inc0: ack | 15:46 |
| therve | I don't want to randomly harass people, and I'm fine if it's done in X months, just I'd like a target of some sort | 15:46 |
| pabelanger | therve: might be worth adding something to storyboard and / or adding a discussion to our weekly infra meeting. | 15:46 |
| pabelanger | therve: there are some other projects that are creating DIBs and uploading them to tarballs.o.o, that is something you could also do too. | 15:47 |
| therve | pabelanger, tarballs.o.o has proven to be fairly unreliable in the past :/ | 15:48 |
| *** devananda|dinner is now known as devananda | 15:48 | |
| therve | It's not mirrored, AFAIK, so bad luck if you're in the wrong DC | 15:48 |
| jeblair | pabelanger, mordred: i pushed up the k5start change as a followup so we can decide if we like that approach. https://review.openstack.org/370235 | 15:48 |
| *** hongbin has quit IRC | 15:48 | |
| *** daemontool has quit IRC | 15:48 | |
| pabelanger | therve: right. AFS is the better place, but we still need to do some work on that | 15:49 |
| therve | Sure | 15:49 |
| *** vgridnev has joined #openstack-infra | 15:49 | |
| *** ddieterly has joined #openstack-infra | 15:50 | |
| pabelanger | jeblair: great | 15:50 |
| clarkb | frickler: doesn't keystone start before glance when devstack deploys things? | 15:50 |
| stevemar | cloudnull: you betcha | 15:51 |
| stevemar | fail | 15:51 |
| stevemar | clarkb: you betcha | 15:51 |
| *** roxanaghe has quit IRC | 15:51 | |
| *** mriedem has quit IRC | 15:51 | |
| *** mriedem1 has joined #openstack-infra | 15:51 | |
| *** sshnaidm is now known as sshnaidm|afk | 15:51 | |
| stevemar | sorry cloudnull, i was too tab-happy -- cl<tab> | 15:51 |
| cloudnull | :) | 15:52 |
| cloudnull | o/ stevemar | 15:52 |
| therve | pabelanger, I'll add an item for next week agenda | 15:52 |
| *** bethwhite_ has joined #openstack-infra | 15:53 | |
| *** abregman has joined #openstack-infra | 15:53 | |
| fungi | therve: week after next. the team is having a late-cycle in-person sprint next week | 15:53 |
| therve | Ah :) | 15:53 |
| fungi | therve: though if you're going to be in the vicinity of walldorf, de... you could see about collaborating on image mirrors in afs ;) | 15:53 |
| *** ihrachys has quit IRC | 15:54 | |
| therve | fungi, relatively close by, but I don't think I can make it :) | 15:54 |
| *** Sukhdev has joined #openstack-infra | 15:56 | |
| *** andreas_s has quit IRC | 15:58 | |
| *** abregman has quit IRC | 15:58 | |
| *** ChanServ changes topic to "Bug sprint today in #openstack-sprint https://wiki.openstack.org/wiki/VirtualSprints#Infra_Bug_Day" | 16:00 | |
| pleia2 | bug day time :) | 16:01 |
| *** gyee has joined #openstack-infra | 16:01 | |
| *** zul has joined #openstack-infra | 16:01 | |
| Zara | :D | 16:01 |
| *** mhickey has quit IRC | 16:02 | |
| *** pots has joined #openstack-infra | 16:04 | |
| *** mikelk has quit IRC | 16:04 | |
| *** mriedem1 is now known as mriedem | 16:08 | |
| mnaser | clarkb, read buffer.. indeed you can use ceph+nova (even with liberty) with qcow2, but at the cost that you consume more space and longer server deployment time | 16:08 |
| rockstar | Hi infra- I followed the "Tagging a release" process here: http://docs.openstack.org/infra/manual/creators.html#tagging-a-release but it doesn't appear that jenkins has uploaded a package to pypi (it's been 12+ hours). I tried to use the `git os-job` tool, but it gives me a url that says "File Not Found" - what can I do to diagnose? | 16:08 |
| mnaser | with raw images, it creates a cow image and that's ready in 1-2 seconds | 16:08 |
| mnaser | with qcow2, it will actually download the image to the HV locally, convert it to raw, import it to the cluster | 16:08 |
| *** rwsu has quit IRC | 16:09 | |
| *** tphummel has joined #openstack-infra | 16:09 | |
| mnaser | so really, both work, qcow2 is just a bit more inefficient | 16:09 |
| clarkb | mnaser: does it do that conversion and import every time you boot qcow2 or just once for that specific qcow2 image then it can cow it? | 16:10 |
| *** GordonTX has quit IRC | 16:10 | |
| *** shamail has joined #openstack-infra | 16:10 | |
| *** krtaylor has quit IRC | 16:10 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-tripleo: remove puppet-manager-core core permissions https://review.openstack.org/370260 | 16:11 |
| *** lykinsbd has quit IRC | 16:13 | |
| *** ddieterly has quit IRC | 16:16 | |
| fungi | rockstar: if you tell us the name of teh repo and tag, i can step through and see what's missing/broken | 16:16 |
| rockstar | fungi: hi. nova-lxd tagged 14.0.0.0b2 | 16:16 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Include a marker file at the root of all docs builds https://review.openstack.org/369660 | 16:17 |
| jeblair | AJaeger: ^ | 16:17 |
| fungi | rockstar: yep, that explains it. you don't have any jobs that act on tags http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n11708 | 16:18 |
| *** fernnest has joined #openstack-infra | 16:18 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/elastic-recheck: Add query for bug 1623576 https://review.openstack.org/370271 | 16:18 |
| openstack | bug 1623576 in Designate "test_zone_create_propagates_to_nameservers times out before zone is fully propagated" [Medium,Triaged] https://launchpad.net/bugs/1623576 | 16:18 |
| fungi | rockstar: or at a minimum, none that upload tagged releases to pypi | 16:18 |
| rockstar | fungi: ah, that makes sense. I guess I'll put together a patch. | 16:18 |
| *** abregman has joined #openstack-infra | 16:19 | |
| *** samuelBartel has quit IRC | 16:19 | |
| *** esberglu has quit IRC | 16:19 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: run k5start in playbook https://review.openstack.org/370235 | 16:19 |
| fungi | rockstar: looks like right now you're only generating branch tip tarballs (courtesy of the python-jobs template): http://tarballs.openstack.org/nova-lxd/ | 16:19 |
| rockstar | fungi: so I probably need pypi-jobs, right? | 16:21 |
| *** esberglu has joined #openstack-infra | 16:21 | |
| *** amoralej is now known as amoralej|off | 16:21 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: Use full paths for afs commands https://review.openstack.org/370273 | 16:21 |
| fungi | rockstar: i would suggest adding the publish-to-pypi template to your templates list in zuul/layout.yaml | 16:21 |
| *** Apoorva has joined #openstack-infra | 16:21 | |
| fungi | rockstar: like that openstack/nova-mksproxy project immediately below yours has | 16:22 |
| *** lucasagomes has quit IRC | 16:22 | |
| *** lucasagomes has joined #openstack-infra | 16:23 | |
| *** yamamoto has quit IRC | 16:23 | |
| *** yamamoto has joined #openstack-infra | 16:24 | |
| *** yamamoto has quit IRC | 16:25 | |
| *** amotoki has quit IRC | 16:26 | |
| *** ddieterly has joined #openstack-infra | 16:27 | |
| *** trown is now known as trown|lunch | 16:28 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Remove forced delorean dib build https://review.openstack.org/370281 | 16:28 |
| openstackgerrit | Merged openstack-infra/project-config: Include marker file for release notes https://review.openstack.org/369938 | 16:30 |
| *** abregman has quit IRC | 16:31 | |
| *** cdent has quit IRC | 16:32 | |
| *** jlanoux has quit IRC | 16:32 | |
| *** reed_ has joined #openstack-infra | 16:32 | |
| *** matrohon has quit IRC | 16:32 | |
| *** rcernin has joined #openstack-infra | 16:34 | |
| pleia2 | rcarrillocruz, yolanda - we're doing a bug sprint over in #openstack-sprint and I came across this one, which maybe valuable to go over and updated before our actual infra sprint next week https://storyboard.openstack.org/#!/story/2000175 | 16:34 |
| *** roxanaghe has joined #openstack-infra | 16:35 | |
| *** cardeois has quit IRC | 16:35 | |
| *** tesseract- has quit IRC | 16:35 | |
| *** watanabe_isao has joined #openstack-infra | 16:35 | |
| *** dtantsur is now known as dtantsur|afk | 16:36 | |
| *** cardeois has joined #openstack-infra | 16:36 | |
| *** sarob has joined #openstack-infra | 16:36 | |
| openstackgerrit | Paul Hummer proposed openstack-infra/project-config: Add publish-to-pypi to zuul https://review.openstack.org/370286 | 16:37 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Allow teams to be added to the permission list for private stories https://review.openstack.org/370287 | 16:37 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new DB API function to get grouped run_time time series https://review.openstack.org/370288 | 16:38 |
| *** cardeois has quit IRC | 16:38 | |
| *** _sarob has joined #openstack-infra | 16:38 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Allow teams to be added to the permission list for private stories https://review.openstack.org/370287 | 16:38 |
| *** dizquierdo has quit IRC | 16:38 | |
| *** yamamoto has joined #openstack-infra | 16:39 | |
| *** ddieterly is now known as ddieterly[away] | 16:39 | |
| mtreinish | fungi, mordred, jeblair: finally got all the tests passing on: https://review.openstack.org/#/c/369662/ although I'm not sure I got everything right | 16:40 |
| *** florianf has quit IRC | 16:41 | |
| *** sarob has quit IRC | 16:42 | |
| *** vgridnev has quit IRC | 16:42 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow permissions to be set for teams on stories https://review.openstack.org/368917 | 16:44 |
| *** yamahata has quit IRC | 16:44 | |
| *** Swami has quit IRC | 16:44 | |
| *** matt-borland has quit IRC | 16:44 | |
| *** shamail has left #openstack-infra | 16:45 | |
| *** ddieterly[away] is now known as ddieterly | 16:46 | |
| cloudnull | pabelanger: http://grafana.openstack.org/dashboard/db/nodepool-osic?panelId=11&fullscreen -- are these error node launch attempts coming from SSH timeouts or similar on cloud1? | 16:47 |
| *** sshnaidm|afk is now known as sshnaidm | 16:47 | |
| cloudnull | or are they an aggregate of cloud1/8? I dont see a specific datapoint for cloud8 there. | 16:47 |
| pabelanger | cloudnull: if you look at top left, you can select each cloud. So, osic-cloud1 had 2 failures | 16:48 |
| mnaser | clarkb, i think part of the issue is that it actually imports it to the disk of that specific VM | 16:48 |
| mnaser | so its not like a one-time-convert and reuse | 16:49 |
| *** e0ne has quit IRC | 16:49 | |
| cloudnull | ah. ok | 16:49 |
| *** esberglu has quit IRC | 16:49 | |
| pabelanger | cloudnull: We are stilling seeing some random failures with xenail, not many. We need to restart nodepool to pick up some patches. But, our next step is to enable debugs for paramiko to see what is going on. | 16:50 |
| *** roxanaghe has quit IRC | 16:50 | |
| pabelanger | Also have a patch to grab the console-log, but that is in merge conflict right now | 16:50 |
| cloudnull | just two, i wont worry to much about it. was looking at the graph thinking that it may have been hitting some angry compute node in the cluster. | 16:50 |
| cloudnull | ok. | 16:51 |
| cloudnull | if I can help out there let me know. | 16:51 |
| pabelanger | Sure, we are getting close to addressing all our launch failures | 16:51 |
| mnaser | clarkb, http://www.gossamer-threads.com/lists/openstack/operators/47003 and https://review.openstack.org/#/c/159129/ should help things | 16:51 |
| *** tsg has joined #openstack-infra | 16:51 | |
| pabelanger | hopefully another few weeks and things will be in great shape | 16:51 |
| clarkb | mnaser: ah so its not doing the same path as a regular raw image once it has ocnverted it to raw | 16:51 |
| *** hashar has quit IRC | 16:52 | |
| *** derekh has quit IRC | 16:53 | |
| *** mdrabe has quit IRC | 16:53 | |
| *** reed_ has quit IRC | 16:54 | |
| AJaeger | jeblair: LGTM | 16:55 |
| *** xarses has quit IRC | 16:55 | |
| *** Sukhdev has quit IRC | 16:56 | |
| sshnaidm | Does anybody know where gerrit and launchpad project are mapped for updating bugs? Especially when it's not the same name. I looked in project-config/tree/gerrit/projects.yaml but barely understand what are keywords there. | 16:56 |
| sshnaidm | It's told here about mapping in jeepyb, but also don't find it in jeepyb repo: http://docs.openstack.org/infra/system-config/jeepyb.html#launchpad-bug-integration | 16:56 |
| *** tosky has quit IRC | 16:56 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Remove query for fixed bug 1620761 https://review.openstack.org/370303 | 16:57 |
| openstack | bug 1620761 in OpenStack Compute (nova) "test_create_second_image_when_first_image_is_being_saved intermittently times out in teardown in cells v1 job" [Undecided,Confirmed] https://launchpad.net/bugs/1620761 | 16:57 |
| clarkb | sshnaidm: its in that file using the group keyword | 16:57 |
| *** krtaylor has joined #openstack-infra | 16:57 | |
| clarkb | sshnaidm: by default a project maps 1:1 | 16:57 |
| clarkb | sshnaidm: if you have a group specified instead that is what is used in launchpad | 16:57 |
| *** roxanaghe has joined #openstack-infra | 16:57 | |
| jeblair | sshnaidm: the docs for that are in the infra manual here: http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list | 16:57 |
| sshnaidm | clarkb, great, thanks | 16:58 |
| sshnaidm | jeblair, thanks, now is clear | 16:58 |
| *** mdrabe has joined #openstack-infra | 16:59 | |
| *** jed56 has joined #openstack-infra | 16:59 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Remove query for fixed bug 1616498 https://review.openstack.org/370304 | 16:59 |
| openstack | bug 1615710 in neutron "duplicate for #1616498 test_server_multi_create_auto_allocate failing with "Failed to allocate the network(s), not rescheduling"" [Critical,Fix released] https://launchpad.net/bugs/1615710 - Assigned to Kevin Benton (kevinbenton) | 16:59 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Raise exception on unrecognized project type https://review.openstack.org/314136 | 17:01 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Raise exception on unrecognized project type https://review.openstack.org/314136 | 17:02 |
| *** adrian_otto has quit IRC | 17:03 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config: Add tripleo-ci to be mapped with tripleo LP https://review.openstack.org/370306 | 17:03 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add new DB API function to get grouped run_time time series https://review.openstack.org/370288 | 17:03 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add run_metadata filtering to get run_times function https://review.openstack.org/370255 | 17:03 |
| *** Kiall_ is now known as Kiall | 17:03 | |
| jeblair | pabelanger: why do the mirrors all use symlinks into /var/www? | 17:05 |
| jeblair | (for the apache config) | 17:05 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul: Add async action plugin to override upstream async https://review.openstack.org/370309 | 17:05 |
| pabelanger | jeblair: not sure, that was how it was originally done. Not sure who created that | 17:06 |
| *** ddieterly is now known as ddieterly[away] | 17:06 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Reinstate the page size modification control in result-set-pager https://review.openstack.org/370310 | 17:06 |
| mordred | jeblair, pabelanger: I'm not a fan of those symlinks, fwiw | 17:07 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: WIP: Allow permissions to be set for teams in worklists and boards https://review.openstack.org/370312 | 17:07 |
| jeblair | mordred: i will try to avoid them for files.o.o and we'll see what happens :) | 17:07 |
| pabelanger | mordred: jeblair: I suspect it was easier to configure apache that way. But no opposed to removing them | 17:08 |
| mordred | jeblair: I _think_ they were there from early on when we were still considering organization | 17:08 |
| mordred | jeblair: and I think something something try-not-to-make-moving-things-hard | 17:08 |
| jeblair | only snag so far is robots.txt, but i bet we can 'Alias' that file. | 17:08 |
| mordred | jeblair: but at this point we're pretty solidly on top of our directory layout, so I think they're probably vestigal | 17:08 |
| * mordred waves hands | 17:09 | |
| *** jascott1 has joined #openstack-infra | 17:10 | |
| *** Swami has joined #openstack-infra | 17:10 | |
| *** dahoo has joined #openstack-infra | 17:11 | |
| *** yamamoto has quit IRC | 17:11 | |
| AJaeger | jeblair: should we exclude '.root-marker' from publishing to docs.o.o? | 17:12 |
| *** abregman has joined #openstack-infra | 17:12 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add root-marker for api-ref and api-guide jobs https://review.openstack.org/370318 | 17:12 |
| jeblair | AJaeger: not sure what you mean... do you just mean for the ftp site? | 17:12 |
| AJaeger | jeblair: yes. To not push the files to the ftp server. The ftp publisher allows to have excludes | 17:13 |
| frickler | clarkb: I tried it directly at first, but it didn't work, keystone was not running yet. seems config generation happens for all services before anything gets started | 17:14 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Make subunit2sql py35 jobs voting https://review.openstack.org/370322 | 17:14 |
| jeblair | AJaeger: it's harmless for the ftp site, and required for the afs site, so i think we should just let it through. | 17:14 |
| clarkb | frickler: oh in that case you should know what the domain is going to be ahead of time though right? | 17:14 |
| AJaeger | jeblair: ok. | 17:14 |
| clarkb | frickler: since devstack is setting that value? | 17:14 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Remove query for fixed bug 1616498 https://review.openstack.org/370304 | 17:15 |
| openstack | bug 1615710 in neutron "duplicate for #1616498 test_server_multi_create_auto_allocate failing with "Failed to allocate the network(s), not rescheduling"" [Critical,Fix released] https://launchpad.net/bugs/1615710 - Assigned to Kevin Benton (kevinbenton) | 17:15 |
| frickler | clarkb: for the workaround I need the id instead of the name | 17:16 |
| *** ddieterly[away] has quit IRC | 17:16 | |
| clarkb | oh another case of "we can't use names because raisins" | 17:16 |
| clarkb | Iwonder if it makes sense to have devstack configure and start keystoen before anything else as the long term fix | 17:16 |
| fungi | jeblair: if you want a robots.txt alias outside the docroot example to crib from, i got it working and tested correctly now in puppet-mediawiki | 17:17 |
| *** adrian_otto has joined #openstack-infra | 17:17 | |
| *** asettle has quit IRC | 17:17 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Allow using lockfile per jenkins master https://review.openstack.org/293631 | 17:17 |
| jeblair | fungi: that's helpful, thanks | 17:17 |
| *** asettle has joined #openstack-infra | 17:18 | |
| *** rossella_ has quit IRC | 17:18 | |
| *** adrian_otto has quit IRC | 17:19 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add root-marker for api-ref, api-guide,install-guide jobs https://review.openstack.org/370318 | 17:19 |
| fungi | jeblair: that example is being successfully deployed on the wiki-dev.o.o site, btw | 17:19 |
| AJaeger | jeblair: ^ | 17:19 |
| *** rossella_ has joined #openstack-infra | 17:19 | |
| jeblair | AJaeger: cool -- did you miss a git add? i don't see the macro def | 17:20 |
| jeblair | oh wait there it is | 17:20 |
| mordred | sneaky macro defs | 17:20 |
| *** adrian_otto has joined #openstack-infra | 17:20 | |
| jeblair | i think i was looking at PS1 | 17:20 |
| AJaeger | jeblair: I forgot it in the first iteration probably | 17:20 |
| *** daemontool_ has quit IRC | 17:21 | |
| *** sambetts is now known as sambetts|afk | 17:21 | |
| jeblair | AJaeger: i'm going to change the topic | 17:21 |
| AJaeger | jeblair: I don't know yet how to do openstack-manuals properly - can this wait until Tuesday in Walldorf | 17:21 |
| AJaeger | jeblair: Sorry - please do! | 17:21 |
| AJaeger | jeblair: or do you want to discuss more now? | 17:21 |
| jeblair | AJaeger: maybe a little discussion now might be good -- what's the problem? | 17:22 |
| jeblair | (and if it's too complex, we can pick it up next week) | 17:22 |
| jeblair | (but would be good to start thinking about it now) | 17:22 |
| AJaeger | jeblair: let me prepare something on the etherpad to explain. | 17:22 |
| *** trown|lunch is now known as trown | 17:23 | |
| rockstar | fungi: I *think* this is what was needed. https://review.openstack.org/#/c/370286/ | 17:24 |
| *** yamamoto has joined #openstack-infra | 17:24 | |
| *** yamamoto has quit IRC | 17:24 | |
| clarkb | mordred: do we want to call https://storyboard.openstack.org/#!/story/1356161 fixed with all of the shade work and the cleanup cron? | 17:25 |
| frickler | clarkb: http://docs.openstack.org/developer/devstack/plugins.html#plugin-execution-order promises one can do changes in the post-config phase before keystone starts, so that will be difficult | 17:25 |
| clarkb | mordred: we are using bluebox again with floating IPs so I assume its more relaible now? | 17:25 |
| *** lucasagomes is now known as lucas-dinner | 17:25 | |
| AJaeger | rockstar: LGTM | 17:25 |
| clarkb | frickler: gah ok | 17:25 |
| *** annegentle has joined #openstack-infra | 17:25 | |
| *** asettle has quit IRC | 17:26 | |
| *** bethwhite_ has quit IRC | 17:26 | |
| *** esikachev has quit IRC | 17:26 | |
| frickler | clarkb: the bug in effect is that glance calls keystoneclient with both user_domain_id and _name being set, and in that case keystone ignores the latter, which is sensible behaviour I think | 17:26 |
| clarkb | mordred: I am going to mark it fixed and you can undo that if you have reason to | 17:27 |
| *** mdrabe has quit IRC | 17:29 | |
| *** mdrabe_ has joined #openstack-infra | 17:29 | |
| sdague | AJaeger: hey, so http://logs.openstack.org/38/359238/1/check/gate-nova-api-ref-src/91288b3/console.html seems to work... except I'm not sure that the draft uploaded | 17:29 |
| mordred | clarkb: ++ | 17:29 |
| AJaeger | sdague: check http://logs.openstack.org/38/359238/1/check/gate-nova-api-ref-src/91288b3/_zuul_ansible/ansible_log.txt | 17:30 |
| *** ddieterly has joined #openstack-infra | 17:30 | |
| clarkb | mordred: what ever ended up being the fix for the port based attachment being less happy? | 17:30 |
| mordred | clarkb: we stopped paying attention to the floating ip info in the nova cache | 17:31 |
| clarkb | mordred: and asked neutron directly? | 17:31 |
| mordred | clarkb: and just query neutron directly | 17:31 |
| mordred | yah | 17:31 |
| clarkb | gotcha | 17:31 |
| sdague | AJaeger: ok, well that is now there | 17:32 |
| sdague | http://docs-draft.openstack.org/38/359238/1/check/gate-nova-api-ref-src/91288b3/api-ref/build/html/ | 17:32 |
| AJaeger | great | 17:32 |
| sdague | how would I make that the default linked output for that job | 17:32 |
| AJaeger | sdague: search for success-pattern in zuul/layout.yaml | 17:33 |
| sdague | ok | 17:33 |
| *** watanabe_isao has quit IRC | 17:33 | |
| *** tqtran has joined #openstack-infra | 17:34 | |
| jeblair | sdague: http://docs.openstack.org/infra/zuul/zuul.html#jobs has docs on success-pattern | 17:34 |
| *** yaume has quit IRC | 17:34 | |
| sdague | jeblair: ok, cool | 17:34 |
| sdague | though, it doesn't quite look like my pip install did the right thing here - http://logs.openstack.org/38/359238/1/check/gate-nova-api-ref-src/91288b3/console.html#_2016-09-14_17_18_59_124739 | 17:34 |
| *** adrian_otto has quit IRC | 17:34 | |
| sdague | oh... I bet I needed to do ./ | 17:35 |
| *** _sarob has quit IRC | 17:35 | |
| *** claudiub has joined #openstack-infra | 17:36 | |
| *** trown is now known as trown|brb | 17:37 | |
| AJaeger | jeblair: I updated the etherpad | 17:38 |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: update api-ref to be a ./ path, not a symbolic name https://review.openstack.org/370333 | 17:38 |
| AJaeger | Problem is we have some directories with manuals, and top-level files like /index.html | 17:38 |
| *** tqtran has quit IRC | 17:38 | |
| *** yamahata has joined #openstack-infra | 17:39 | |
| *** ddieterly is now known as ddieterly[away] | 17:40 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: update api-ref to be a ./ path, not a symbolic name https://review.openstack.org/370333 | 17:41 |
| AJaeger | jeblair: I could add a root-marker to each published document as a start. And then we can decide what to do with the single index files... | 17:41 |
| *** HeOS has joined #openstack-infra | 17:41 | |
| *** sarob has joined #openstack-infra | 17:41 | |
| *** sarob has quit IRC | 17:42 | |
| *** sarob has joined #openstack-infra | 17:42 | |
| AJaeger | sshnaidm: is there a separate tripleo-ci bug queue as well? Or only a tripleo one? | 17:43 |
| sshnaidm | AJaeger, no, only tripleo | 17:43 |
| sshnaidm | AJaeger, that's why I want to include tripleo-ci patches there also | 17:43 |
| AJaeger | sshnaidm: gave a -1 since tripleo-ci is in storyboard currently | 17:44 |
| sshnaidm | AJaeger, what does it mean? | 17:45 |
| AJaeger | sshnaidm: http://storyboard.openstack.org/ | 17:45 |
| *** thorst_ has quit IRC | 17:45 | |
| AJaeger | sshnaidm: tripleo-ci is part of OpenStack Infra, not part of TripleO project. And OpenStack Infra is using storyboard, not launchpad. | 17:45 |
| AJaeger | no idea how this works out in this case, hope somebody else can chime in... | 17:46 |
| *** thorst_ has joined #openstack-infra | 17:46 | |
| sshnaidm | AJaeger, afaik nobody uses it and all bugs are filled in tripleo project | 17:46 |
| *** degorenko is now known as _degorenko|afk | 17:46 | |
| sshnaidm | AJaeger, I think it's because too difficult separate tripleo and tripleo-ci bugs.. | 17:47 |
| sshnaidm | slagle, ^^ | 17:47 |
| *** HeOS has quit IRC | 17:47 | |
| AJaeger | sshnaidm: best talk with the rest of the team - and fungi as PTL should ack any proposal. | 17:47 |
| *** xarses has joined #openstack-infra | 17:47 | |
| sshnaidm | AJaeger, sure | 17:48 |
| fungi | sshnaidm: slagle: pabelanger: i think the recent discussions about switching tripleo to third-party testing would make sense to also move the tripleo-ci deliverable from infra to tripleo, at least | 17:50 |
| *** trown|brb is now known as trown | 17:50 | |
| *** ddieterly[away] has quit IRC | 17:50 | |
| *** _sarob has joined #openstack-infra | 17:50 | |
| *** electrofelix has quit IRC | 17:51 | |
| fungi | i think the original goal for having tripleo-ci as an infra project was to align it with devstack-gate, but that never really happened and it's continued to diverge further and further from how we normally do integration testing for other projects | 17:51 |
| *** baoli_ has quit IRC | 17:51 | |
| *** baoli has joined #openstack-infra | 17:52 | |
| *** esikachev has joined #openstack-infra | 17:53 | |
| slagle | fungi: what would that mean, just moving the project from infra to tripleo in the governance repo? | 17:53 |
| slagle | fungi: i'm not sure what you're asking to do tbh | 17:54 |
| *** adrian_otto has joined #openstack-infra | 17:54 | |
| *** sarob has quit IRC | 17:54 | |
| *** jascott1 has quit IRC | 17:54 | |
| fungi | slagle: sure, and putting the core review team under tripleo ptl control, and giving you the ability to redirect bugs for tripleo-ci to the general tripleo tracker | 17:54 |
| *** jascott1 has joined #openstack-infra | 17:54 | |
| *** thorst_ has quit IRC | 17:54 | |
| *** tqtran has joined #openstack-infra | 17:54 | |
| fungi | that last bit was why sshnaidm was bringing it up | 17:55 |
| sshnaidm | slagle, for context, it started from adding tripleo-ci to tripleo project in LP: https://review.openstack.org/#/c/370306/ | 17:55 |
| sshnaidm | slagle, for updating "closes-bug: ####" | 17:55 |
| sshnaidm | but discussion was a little extended.. | 17:55 |
| *** kzaitsev_mb has quit IRC | 17:55 | |
| slagle | ok | 17:56 |
| slagle | it seems reasonable to me to move it under tripleo | 17:56 |
| sdague | AJaeger / mordred - getting closer - https://review.openstack.org/#/c/370333/ | 17:57 |
| sdague | also, how I wish live results of project-config changes could be seen | 17:57 |
| jeblair | AJaeger: so when openstack-manuals gets published, the entire contens of 'publish-docs/' gets copied into the root of docs.o.o? | 17:58 |
| jeblair | AJaeger: and that repo contains all of the different manuals, so they all appear as subdirs of publish-docs/ ? | 17:58 |
| *** rbrndt has quit IRC | 17:58 | |
| *** xarses_ has joined #openstack-infra | 17:58 | |
| *** Na3iL has quit IRC | 17:59 | |
| *** jascott1 has quit IRC | 17:59 | |
| *** xarses has quit IRC | 18:00 | |
| *** jascott1 has joined #openstack-infra | 18:01 | |
| *** adrian_otto has quit IRC | 18:01 | |
| *** adrian_otto has joined #openstack-infra | 18:02 | |
| *** HeOS has joined #openstack-infra | 18:03 | |
| *** rbrndt has joined #openstack-infra | 18:03 | |
| *** hongbin has joined #openstack-infra | 18:03 | |
| *** xarses_ has quit IRC | 18:03 | |
| *** rbrndt has quit IRC | 18:03 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Stop using custom ZK heartbeat. https://review.openstack.org/370350 | 18:03 |
| *** drifterza has joined #openstack-infra | 18:03 | |
| *** acoles is now known as acoles_ | 18:04 | |
| *** tsg has quit IRC | 18:09 | |
| *** hashar has joined #openstack-infra | 18:09 | |
| *** adrian_otto has quit IRC | 18:10 | |
| *** adrian_otto has joined #openstack-infra | 18:11 | |
| *** drifterza has quit IRC | 18:13 | |
| *** xarses_ has joined #openstack-infra | 18:14 | |
| mordred | Shrews: ^^ oh neat! | 18:14 |
| Shrews | mordred: enlightened by harlowja | 18:14 |
| * mordred hands harlowja a sandwich | 18:15 | |
| Shrews | mordred: btw, the preceeding reviews all have two +2's, just needing +A's. | 18:16 |
| *** Sukhdev has joined #openstack-infra | 18:16 | |
| *** itsuugo has quit IRC | 18:19 | |
| *** itsuugo has joined #openstack-infra | 18:20 | |
| *** tsg has joined #openstack-infra | 18:21 | |
| sdague | clarkb: rax-ord didn't get new images yet? | 18:23 |
| sdague | or more specifically, they are at least a couple days old? | 18:23 |
| *** yamamoto has joined #openstack-infra | 18:25 | |
| *** jascott1 has quit IRC | 18:26 | |
| *** jascott1 has joined #openstack-infra | 18:27 | |
| *** jascott1 has quit IRC | 18:27 | |
| clarkb | sdague: looks like they are just updating right now so some are a minute or 14 old and others are 2 days old | 18:27 |
| *** jascott1 has joined #openstack-infra | 18:27 | |
| fungi | i think some of the broken deb-.* repos tanked image builds yesterday and the day before | 18:32 |
| *** baoli has quit IRC | 18:34 | |
| *** yamamoto has quit IRC | 18:34 | |
| frickler | ubuntu-* builds look broken today, too, with various git errors | 18:36 |
| AJaeger | jeblair: correct, the complete contents of publish-docs gets copied | 18:37 |
| AJaeger | jeblair: yes, those are subdirs - some under /draft or /mitaka | 18:37 |
| clarkb | oh that could be the thing affecting sdague too if our builds aren't working /me double checks | 18:37 |
| mugsie | win 66 | 18:37 |
| mugsie | gah | 18:37 |
| clarkb | ya yseterdays builds succeeded but not todays | 18:37 |
| AJaeger | jeblair: if needed, we can redesign the publishing a bit... | 18:38 |
| jeblair | AJaeger: are there other projects or branches that build things that end up there? | 18:38 |
| *** rbrndt has joined #openstack-infra | 18:38 | |
| AJaeger | jeblair: in / ? project-install-guide publishes an index.html to /project-install-guide/draft/index and projects publish to /project-install-guide/REPO/draft | 18:39 |
| *** tkelsey has quit IRC | 18:39 | |
| openstackgerrit | Merged openstack-infra/nodepool: Make builder recognize manual build requests https://review.openstack.org/365112 | 18:39 |
| AJaeger | release-notes publish to /release-notes | 18:39 |
| openstackgerrit | Merged openstack-infra/nodepool: Change ZK API to not auto-create build on lock https://review.openstack.org/368915 | 18:40 |
| openstackgerrit | Merged openstack-infra/nodepool: Make builder recognize scheduled builds https://review.openstack.org/366934 | 18:40 |
| openstackgerrit | Merged openstack-infra/nodepool: Remove duplicate check for manual build request https://review.openstack.org/368934 | 18:40 |
| jeblair | AJaeger: so openstack-manuals publishes to /, and other projects publish to subdirs? | 18:40 |
| AJaeger | and we have the index.html for /developer/ - where all python projects publish to as subdirs | 18:40 |
| rcarrillocruz | hey pleia2 , sorry, took off today and tomorrow | 18:40 |
| rcarrillocruz | i can take a look on friday | 18:40 |
| AJaeger | jeblair: yes. No other projects puts files into / | 18:40 |
| jeblair | AJaeger: what creates /developer/index.html? | 18:40 |
| AJaeger | Let me double check quickly... | 18:40 |
| *** jascott1 has quit IRC | 18:40 | |
| openstackgerrit | Merged openstack-infra/nodepool: Record DIB images in "building" state https://review.openstack.org/368965 | 18:41 |
| *** xarses_ has quit IRC | 18:41 | |
| AJaeger | jeblair: openstack-manuals creates /developer/index.html (it's named differently but that's it) | 18:41 |
| jeblair | k | 18:41 |
| *** xarses_ has joined #openstack-infra | 18:41 | |
| *** jascott1 has joined #openstack-infra | 18:41 | |
| *** jascott1 has quit IRC | 18:41 | |
| AJaeger | jeblair: project-team-guide repo publishes to /project-team-guide | 18:42 |
| *** tsg has quit IRC | 18:42 | |
| jeblair | AJaeger: and all the projects just publish to the root, however, the projects other than openstack-manuals create their files in 'publish-docs/project-install-guide'. so they just don't have any files at the root, so nothing gets copied there? | 18:42 |
| AJaeger | And security-guide publishes also directly to a dir in / | 18:42 |
| *** erlon_ has quit IRC | 18:42 | |
| AJaeger | jeblair: yes | 18:43 |
| jeblair | AJaeger: so i think what we want to do is put the marker in 'publish-docs' for openstack-manuals, then for each of the other jobs, put their markers in 'publish-docs/foo' | 18:43 |
| *** jascott1 has joined #openstack-infra | 18:44 | |
| jeblair | AJaeger: that means each job will need customization, much like what you did for the api-ref, etc, jobs. (ecxept it's the *end* of the path that changes, instead of the beginning) | 18:44 |
| jeblair | AJaeger: hrm, there is a good chance this won't work though. | 18:46 |
| AJaeger | jeblair: let me try changing security-guide repo as proof-of-concept | 18:46 |
| AJaeger | security-doc is the reponame | 18:46 |
| AJaeger | jeblair: ? ;( | 18:46 |
| fungi | AJaeger: jeblair: you've probably already covered this, but for separate jobs which were traditionally dumping content into a common location, we could likely put them in separate trees and just "fix" it with apache rewrites? | 18:46 |
| jeblair | AJaeger: i'll update my test script... | 18:46 |
| AJaeger | fungi, we could do something like that as well... | 18:47 |
| openstackgerrit | Graham Hayes proposed openstack-infra/elastic-recheck: Add query for bug 1623576 https://review.openstack.org/370271 | 18:47 |
| openstack | bug 1623576 in Designate "test_zone_create_propagates_to_nameservers times out before zone is fully propagated" [Medium,Triaged] https://launchpad.net/bugs/1623576 | 18:47 |
| jeblair | fungi: possible, though it's also possible to do this like we do the developer docs | 18:47 |
| AJaeger | And I'm willing to change the publishing if that helps us | 18:47 |
| AJaeger | depending on what's easier to do ;) | 18:47 |
| fungi | jeblair: oh, if we already have a better solution, then excellent | 18:47 |
| *** jascott1 has quit IRC | 18:47 | |
| jeblair | fungi: not sure if it's better, but the marker files are needed because we publish multiple branches, etc, into the same trees. so unless we start doing that with rewrite rules, we have to do this regardless. | 18:48 |
| jeblair | (perhaps we should do that with rewrite rules too, but i would like someone else to write up and implement that spec :) | 18:48 |
| openstackgerrit | Graham Hayes proposed openstack-infra/elastic-recheck: Add query for bug 1623576 https://review.openstack.org/370271 | 18:50 |
| openstack | bug 1623576 in Designate "test_zone_create_propagates_to_nameservers times out before zone is fully propagated" [Medium,Triaged] https://launchpad.net/bugs/1623576 | 18:50 |
| AJaeger | jeblair: https://review.openstack.org/370376 is security-doc | 18:51 |
| AJaeger | Argh, misses translations... | 18:51 |
| *** tonytan4ever has quit IRC | 18:51 | |
| *** jascott1 has joined #openstack-infra | 18:52 | |
| AJaeger | translations need some extra work - I'll postpone | 18:52 |
| jeblair | AJaeger: ok, i think there is an error with the current plan that not only affects this situation, but also the situation where, in developer docs, we publish only to a $branch subdir | 18:52 |
| jeblair | AJaeger: (i think they are the same situation -- publishing *only* to a subdir of the 'site root') | 18:53 |
| AJaeger | ;( | 18:53 |
| *** thorst_ has joined #openstack-infra | 18:53 | |
| jeblair | this is going to be tricky to solve, because we need to convince rsync to ignore the root, but not things under it. | 18:54 |
| *** zul_ has quit IRC | 18:55 | |
| AJaeger | we know where documents get published, we can give rsync hints... | 18:55 |
| *** sshnaidm is now known as sshnaidm|afk | 18:55 | |
| jeblair | AJaeger: well, that's what the root files are for | 18:56 |
| AJaeger | So, for a keystone stable/mitaka post-job, we know that documents are in doc/build/html/mitaka and we publish to /developer/keystone/mitaka/ | 18:56 |
| *** esberglu has joined #openstack-infra | 18:56 | |
| openstackgerrit | Ben Kero proposed openstack-infra/git-review: Fix source installation steps in documentation https://review.openstack.org/370379 | 18:57 |
| AJaeger | So, is the content of the marker file wrong for security-guide? | 18:57 |
| jeblair | AJaeger: the content isn't important, only the location. that's what we're using to tell rsync what should be copied | 18:58 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Ensure that gerrit projects have zuul pipelines https://review.openstack.org/363969 | 18:58 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Add missing project to projects.yaml https://review.openstack.org/370380 | 18:58 |
| AJaeger | ok | 18:58 |
| jesusaur | AJaeger: my test found another project that wasn't in projects.yaml ^^ | 18:59 |
| *** zul has quit IRC | 18:59 | |
| AJaeger | zigo, fungi: How to fix 370380 properly? | 18:59 |
| AJaeger | jesusaur: known ;( Another broken import. I had hoped that zigo would fix it... | 18:59 |
| AJaeger | jesusaur: thanks | 18:59 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for bug 1623576 https://review.openstack.org/370271 | 19:00 |
| openstack | bug 1623576 in Designate "test_zone_create_propagates_to_nameservers times out before zone is fully propagated" [Medium,Triaged] https://launchpad.net/bugs/1623576 | 19:00 |
| *** thorst_ has quit IRC | 19:00 | |
| fungi | AJaeger: jesusaur: zigo: it's supposedly fixed in the upstream repo now, but needs an infra-root to retrieve and push --force it into gerrit before we reenable it | 19:00 |
| jesusaur | ah, ok, I added a section similar to web-sockify because the projects in the gerrit ui look the same | 19:00 |
| AJaeger | jesusaur: we reverted a change, look at history to see proper text... | 19:01 |
| jesusaur | ahhh | 19:01 |
| AJaeger | jesusaur: https://review.openstack.org/368360 | 19:02 |
| jesusaur | yeah, just found that in the git log | 19:02 |
| *** amitgandhinz has quit IRC | 19:03 | |
| *** AnarchyAo has joined #openstack-infra | 19:04 | |
| *** amitgandhinz has joined #openstack-infra | 19:04 | |
| *** inc0 has quit IRC | 19:05 | |
| *** inc0 has joined #openstack-infra | 19:06 | |
| openstackgerrit | Ben Kero proposed openstack-infra/git-review: Fix source installation steps in documentation https://review.openstack.org/370379 | 19:06 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Ensure that gerrit projects have zuul pipelines https://review.openstack.org/363969 | 19:06 |
| *** zul_ has joined #openstack-infra | 19:06 | |
| AJaeger | fungi, I like the test above - but it means we cannot just remove an entry from gerrit/projects.yaml. What do you think? ^ | 19:07 |
| jesusaur | fungi: AJaeger: so I guess that test would also need a way to work through issues with project imports? | 19:07 |
| *** pcaruana has joined #openstack-infra | 19:07 | |
| fungi | AJaeger: jesusaur: right | 19:07 |
| AJaeger | jesusaur: we test already a few issues but the debian packaging showed us some new ones ;( | 19:08 |
| fungi | AJaeger: jesusaur: 363969 is relying on projects.yaml, so it's probably tractable to just make sure when we (even temporarily) remove a project from that file we also remove it from zuul/layout.yaml | 19:09 |
| fungi | if it were querying gerrit to get a project list, that would be a different matter of course | 19:10 |
| openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/project-config: Make tacker python34 job voting https://review.openstack.org/370388 | 19:10 |
| AJaeger | fungi: yes, that would be needed - otherwise, the test fails and you couldn't merge anything | 19:10 |
| AJaeger | s/anything/your change/ | 19:10 |
| fungi | i mean, the easiest solution there is to just revert the change which added the project | 19:10 |
| *** rwsu has joined #openstack-infra | 19:11 | |
| fungi | the main reason we didn't do that for teh broken deb-.* imports is that they were one repo in a list of dozens | 19:11 |
| erlon | clarkb: ping | 19:11 |
| AJaeger | exactly. Just the last two reverts were partial reverts only for gerrit/projects - excluding the zuul/layout change | 19:11 |
| AJaeger | fungi: So, I'm fine having it, just wanted to point out the consequences. | 19:11 |
| jeblair | AJaeger, fungi: i *think* if we change to an approach where we create an rsync filter file that adds include entries for marker files we find in the build, then adds exclude entries for marker files we find in the destination site but not in the build, and then finally excludes '/*' we might have what we need. | 19:11 |
| erlon | AJaeger: hey, is it possible to download the images used in the gate? | 19:12 |
| AJaeger | fungi, the test found already two real bugs - a repo that should be read-only and wasn't and a real missing entry in one of the deb changes | 19:12 |
| fungi | jeblair: yep, that should do it. basically just keeping metadata about which files belong to which other jobs so you know not to wipe them | 19:12 |
| erlon | AJaeger: im implementing a script in the dark, and there are some think different from a ordinary ubuntu there | 19:12 |
| AJaeger | erlon: read scrollback from 3.5 hours ago between pabelanger and therve. Short answer: no. long asnwer in scroll-back ;) | 19:13 |
| fungi | erlon: it's possible to build copies of the images we use in the gate, but they're ~8gb compressed and you'd want to alter them slightly so you've got credentials to log into them | 19:13 |
| AJaeger | jeblair: sounds sane. | 19:13 |
| jeblair | AJaeger, fungi: after lunch i'll work up another test script to validate the idea | 19:13 |
| AJaeger | erlon: use tools/build-image.sh from project-config to build yourself an image locally | 19:14 |
| AJaeger | jeblair: thanks. I'll call it a day in a few minutes ;) | 19:14 |
| AJaeger | jeblair: I'm glad that we can publish to both locations in parallel - that allows to double check ;) | 19:15 |
| jeblair | yep | 19:15 |
| fungi | erlon: but also, most of our jobs are self-contained shell scripts which should work on just about any throw-away server running the right distro/release with sufficient ram and disk space (we run an 8gb ram flavor and need ~80gb filesystem for some jobs) | 19:15 |
| *** esberglu has quit IRC | 19:15 | |
| AJaeger | jeblair: right now we handle docs.o.o - do you want to handle the much smaller developer.o.o after that? Or in parallel? | 19:16 |
| erlon | AJaeger: fungi: Ok, before I try, quick questions, you might save me that time. | 19:16 |
| *** esberglu has joined #openstack-infra | 19:16 | |
| AJaeger | erlon: send fungi a quick beer ;). | 19:16 |
| AJaeger | erlon: please ask ;) | 19:16 |
| *** r-mibu has quit IRC | 19:16 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Stop using custom ZK heartbeat. https://review.openstack.org/370350 | 19:16 |
| *** jsheeren has joined #openstack-infra | 19:16 | |
| *** r-mibu has joined #openstack-infra | 19:16 | |
| * fungi prefers slow beer, but is not picky ;) | 19:17 | |
| erlon | AJaeger: fungi: I need to tweek some think in libvirt, but the conf file seems not to be there: http://logs.openstack.org/16/369516/3/check/gate-tempest-dsvm-full-devstack-plugin-nfs-nv/3a57d96/logs/devstacklog.txt.gz | 19:17 |
| erlon | AJaeger: fungi: bottom of page | 19:17 |
| *** esikachev has quit IRC | 19:17 | |
| jeblair | AJaeger: in parallel probably, but let's wait until we see if we need changes to the markers first | 19:17 |
| erlon | AJaeger: sure! cheers! | 19:17 |
| jsheeren | hi all, i'm using ansible 2.0.2.0 and shade 1.12.1 to launch an instance on our openstack cloud. I can get the catalog list fine, but when launching the instance i get: Error fetching server list on envvars:RegionOne: (Inner Exception: Could not determine a suitable URL for the plugin) | 19:17 |
| *** cardeois has joined #openstack-infra | 19:17 | |
| jsheeren | the region_name RegionOne is according to the catalog list | 19:18 |
| jsheeren | anyone seen this before? | 19:18 |
| fungi | erlon: the error about /etc/libvirt/qemu.conf ? | 19:18 |
| mordred | jsheeren: can you paste me the catalog list you got, the os_server invocation you're using and your OS_ env vars (without the password one, obviously) | 19:19 |
| erlon | fungi: yes, Im trying to add some confs to the config file, but there's a dir with the same name, so, I don't know what libvirt is using, or who created that folder | 19:19 |
| mordred | jsheeren: (pastebin of course, not directly in channel ;) ) | 19:20 |
| jsheeren | ;-) | 19:20 |
| *** ddieterly has joined #openstack-infra | 19:20 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - test an older delorean repo https://review.openstack.org/370393 | 19:20 |
| fungi | erlon: i just hopped on a devstack-trusty node running another devstack job and /etc/libvirt/qemu.conf is a file (-rw------- 1 root root 17168 Sep 14 19:00 /etc/libvirt/qemu.conf) | 19:21 |
| mordred | jsheeren: also - running this might provide some interesting output: http://paste.openstack.org/show/576311/ | 19:22 |
| AJaeger | fungi, so, where comes the error from? | 19:22 |
| *** kaisers has quit IRC | 19:22 | |
| *** adrian_otto has quit IRC | 19:22 | |
| jsheeren | mordred: catalog list http://paste.openstack.org/show/576312/ | 19:23 |
| erlon | fungi: just let me see if libvirt is installed. I didn't checked because there shouldn't be a dir there anyways | 19:23 |
| jsheeren | mordred: your shade paste gives me AttributeError: 'module' object has no attribute 'simple_logging' | 19:24 |
| erlon | fungi: isn't :/, Ill install it before adding the file | 19:24 |
| erlon | s/adding/changing/ | 19:24 |
| fungi | erlon: oh, your tee command was before devstack installs packages? | 19:24 |
| fungi | yep, i didn't even think to check that | 19:24 |
| mordred | jsheeren: ok, that's very odd - but let's solve that next :) | 19:25 |
| mordred | jsheeren: https://openstack:8774/v2.1 ... does the hostname "openstack" resolve on your machine? | 19:25 |
| erlon | fungi: hmmm, Im not really sure when devstack runs the plugins, but I think so | 19:25 |
| *** jed56 has quit IRC | 19:25 | |
| jsheeren | mordred: my ansible task http://paste.openstack.org/show/576313/ | 19:25 |
| jsheeren | yes it resolves | 19:26 |
| *** jascott1 has quit IRC | 19:26 | |
| jsheeren | i can get the catalog list fine, if I use the openstack python clients i can do everything | 19:26 |
| * AJaeger waves good night | 19:26 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Remove deb-novnc zuul pipelines https://review.openstack.org/370380 | 19:26 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Ensure that gerrit projects have zuul pipelines https://review.openstack.org/363969 | 19:26 |
| *** jascott1 has joined #openstack-infra | 19:26 | |
| jesusaur | AJaeger: fungi: change updated to remove deb-novnc from layout.yaml | 19:26 |
| *** dtardivel has quit IRC | 19:27 | |
| mordred | jsheeren: line 10 - can you try replacing domain_name: default with user_domain_name: default | 19:27 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Allow deleting non-existing build requests https://review.openstack.org/370396 | 19:27 |
| jsheeren | mordred: i think i see what i'm doing wrong | 19:27 |
| mordred | jsheeren: woot! | 19:27 |
| jsheeren | in my os_server task, the auth_url .. ; | 19:27 |
| jsheeren | ugh | 19:28 |
| Shrews | harlowja: 370396 ^^^ is based on your feedback. thanks | 19:28 |
| jsheeren | mordred: i'll change the domain_name as well | 19:28 |
| *** akshai has quit IRC | 19:28 | |
| jsheeren | mordred: yep the auth_url .. ugh need sleep :-) | 19:28 |
| david-lyle | fungi: should https://bugs.launchpad.net/horizon/+bug/1622690 go to public security or just public? | 19:29 |
| openstack | david-lyle: Error: malone bug 1622690 not found | 19:29 |
| jsheeren | but now i'm getting that simple_loggin message | 19:29 |
| jsheeren | i assume i'm missing a python library? | 19:29 |
| *** kjorgensen has quit IRC | 19:29 | |
| mordred | well - so that I'm _very_ confused about, because simple_logging has been in shade for _ages_ | 19:29 |
| mordred | is it possible you have something weird in your python path? | 19:29 |
| *** sdake_ has joined #openstack-infra | 19:29 | |
| fungi | david-lyle: public-security is what we typically do on class y | 19:29 |
| Shrews | mordred: yes, he has python in his python path. that's all the weird you need | 19:30 |
| fungi | david-lyle: because it's arguably a vulnerability, just not in released software | 19:30 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update junit plugin https://review.openstack.org/369128 | 19:30 |
| mordred | jsheeren: python -c 'import shade; print shade.__version__; print shade.__file__' | 19:30 |
| david-lyle | fungi, ok thanks, the patch has merged so I'll update it | 19:31 |
| jsheeren | mordred: http://paste.openstack.org/show/576314/ | 19:31 |
| fungi | david-lyle: ideally you'd switch it to public or public-security just before pushing the patch to code review, so that gerrit updates the bug with details about the fix, and closes it for you on merge | 19:31 |
| *** jascott1 has quit IRC | 19:31 | |
| mordred | jsheeren: you made your test file a file called "shade.py" | 19:31 |
| mordred | jsheeren: rename it to somethign else and you should be set | 19:32 |
| *** matrohon has joined #openstack-infra | 19:32 | |
| jsheeren | eeuh :) | 19:32 |
| mordred | btw - print statements ftw! | 19:32 |
| mordred | Shrews: good point | 19:32 |
| david-lyle | fungi: yeah re-reading the comments on the bug I saw we overlooked that | 19:32 |
| *** sdake has quit IRC | 19:33 | |
| fungi | david-lyle: not a huge deal, just saves you a bit of bookkeeping | 19:33 |
| jsheeren | mordred: yeah now i got output from the test | 19:33 |
| *** Apoorva_ has joined #openstack-infra | 19:33 | |
| david-lyle | fungi, I was a PTL, I love bookkeeping | 19:33 |
| jsheeren | mordred: instance booted fine! | 19:34 |
| jsheeren | mordred: thanks for your help! i appreciate it! | 19:34 |
| *** Sukhdev has quit IRC | 19:34 | |
| *** Sukhdev has joined #openstack-infra | 19:36 | |
| fungi | david-lyle: shush | 19:36 |
| *** csomerville has quit IRC | 19:36 | |
| *** amitgandhinz has quit IRC | 19:36 | |
| *** Apoorva has quit IRC | 19:36 | |
| *** csomerville has joined #openstack-infra | 19:37 | |
| fungi | david-lyle: don't let anybody know bookkeeping is fun or they'll all want to be ptl | 19:37 |
| * fungi cries into his keyboard some more | 19:37 | |
| mordred | jsheeren: excellent! glad to hear it! | 19:37 |
| *** amitgandhinz has joined #openstack-infra | 19:37 | |
| *** cardeois has quit IRC | 19:38 | |
| pabelanger | clarkb: what was some of the issues with glean and rax-iad from last night? You mentioned it was still broken | 19:38 |
| pabelanger | or just we haven't merged the code yet | 19:38 |
| *** jascott1 has joined #openstack-infra | 19:38 | |
| *** cody-somerville has joined #openstack-infra | 19:38 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Convert multiline strings to concatenated single-quote. https://review.openstack.org/351743 | 19:39 |
| *** salv-orl_ has joined #openstack-infra | 19:40 | |
| jsheeren | mordred: thanks again .. now to get the sleep i need .... | 19:40 |
| jsheeren | bye | 19:40 |
| *** jsheeren has quit IRC | 19:40 | |
| *** rwsu has quit IRC | 19:41 | |
| *** csomerville has quit IRC | 19:41 | |
| *** asettle has joined #openstack-infra | 19:43 | |
| *** salv-orlando has quit IRC | 19:43 | |
| *** baoli has joined #openstack-infra | 19:43 | |
| *** jascott1 has quit IRC | 19:43 | |
| *** rwsu has joined #openstack-infra | 19:43 | |
| *** akshai has joined #openstack-infra | 19:45 | |
| *** kjorgensen has joined #openstack-infra | 19:45 | |
| *** akshai_ has joined #openstack-infra | 19:46 | |
| *** esberglu has quit IRC | 19:46 | |
| *** Apoorva_ has quit IRC | 19:47 | |
| *** Apoorva has joined #openstack-infra | 19:47 | |
| *** cardeois has joined #openstack-infra | 19:48 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Add convenience function for plugin namespace https://review.openstack.org/357960 | 19:48 |
| *** akshai has quit IRC | 19:49 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Test Mistral "event trigger REST API" revert https://review.openstack.org/370404 | 19:50 |
| *** kjorgensen has quit IRC | 19:50 | |
| pabelanger | Looks like we are having an outage in ovh. Fair bit of errors in nodepool right now | 19:50 |
| pabelanger | status.ovh.net also show they are away of it | 19:50 |
| pabelanger | coming up on 3hours with no successful launches | 19:51 |
| *** tonytan4ever has joined #openstack-infra | 19:52 | |
| *** tonytan4ever has quit IRC | 19:53 | |
| *** tonytan4ever has joined #openstack-infra | 19:54 | |
| mgagne | pabelanger: does it mean they aren't working on it? "They are away" :D | 19:57 |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Make internal builder.Jenkins attrs internal-only. https://review.openstack.org/319756 | 19:57 |
| pabelanger | mgagne: Hopefully aware and not away | 19:57 |
| *** esberglu has joined #openstack-infra | 19:57 | |
| mgagne | :P | 19:57 |
| *** _sarob has quit IRC | 19:58 | |
| *** ijw has joined #openstack-infra | 19:58 | |
| *** thorst_ has joined #openstack-infra | 19:58 | |
| pabelanger | mgagne: we are seeing a large amount of nodes in delete state for internal-mtl01, suspect that is because we just uploaded our DIBs for the day. Mind confirming? | 19:59 |
| pabelanger | http://grafana.openstack.org/dashboard/db/nodepool-internap | 19:59 |
| mgagne | pabelanger: yea, nothing changed on our side | 19:59 |
| mgagne | pabelanger: will work on it right now | 19:59 |
| pabelanger | mgagne: sure, just making sure. Was going to give it another hour to see if it would resolve | 19:59 |
| *** pcaruana has quit IRC | 20:00 | |
| *** matt-borland has joined #openstack-infra | 20:01 | |
| harlowja | Shrews cool beans | 20:02 |
| *** zul has joined #openstack-infra | 20:02 | |
| harlowja | Shrews other question on 370396 is do u care about handling the other exceptions there? | 20:02 |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Move macro expansion into YamlParser. https://review.openstack.org/333076 | 20:03 |
| *** ijw has quit IRC | 20:03 | |
| harlowja | like other https://github.com/python-zk/kazoo/blob/master/kazoo/exceptions.py#L10 Shrews | 20:03 |
| clarkb | pabelanger: I havent been able to review your fixes so its ipv6 that doesnt work still aiui | 20:03 |
| *** tkelsey has joined #openstack-infra | 20:04 | |
| clarkb | pabelanger: I reviewed ianws testing patches because figured those should go in first and need to rereview the entire lot | 20:04 |
| pabelanger | clarkb: okay, cool. I figured that was the case, not that there was a new issue | 20:04 |
| *** thorst_ has quit IRC | 20:04 | |
| Shrews | harlowja: i don't think so. we'd just let them bubble up | 20:04 |
| harlowja | k | 20:04 |
| jeblair | ya, that's the only expected exception there for now | 20:05 |
| clarkb | erlon driving home from lunch in a minute should be back in about 16 minutes | 20:05 |
| *** sarob has joined #openstack-infra | 20:05 | |
| mordred | clarkb: I'm now imagining you irc-ing on your phone while driving while holding twins | 20:05 |
| erlon | clarkb: thanks, I think I have figured out the problem! | 20:05 |
| openstackgerrit | Drago proposed openstack-infra/project-config: Skip magnum identity v3 test job on docs changes https://review.openstack.org/370408 | 20:06 |
| erlon | clarkb: No text and driving! haha | 20:06 |
| *** gouthamr has quit IRC | 20:07 | |
| erlon | clarkb: s/problem/stupid mistake I did/ | 20:07 |
| *** Ravikiran_K has quit IRC | 20:07 | |
| *** sarob has quit IRC | 20:07 | |
| pabelanger | erlon: illegal in Ontario, Canada! | 20:07 |
| *** sarob has joined #openstack-infra | 20:08 | |
| erlon | pabelanger: I think its illegal anywere | 20:08 |
| *** tkelsey has quit IRC | 20:08 | |
| erlon | pabelanger: India may be that's allowed! | 20:08 |
| *** abregman has quit IRC | 20:09 | |
| *** baoli has quit IRC | 20:09 | |
| *** baoli has joined #openstack-infra | 20:09 | |
| *** zul has quit IRC | 20:11 | |
| *** zul has joined #openstack-infra | 20:12 | |
| *** tsg has joined #openstack-infra | 20:12 | |
| fungi | i need to step out for a bit and grab an early dinner... back soon | 20:14 |
| *** kjorgensen has joined #openstack-infra | 20:14 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Skip magnum identity v3 test job on docs changes https://review.openstack.org/370408 | 20:14 |
| *** Apoorva has quit IRC | 20:15 | |
| *** _sarob has joined #openstack-infra | 20:15 | |
| *** kjorgensen has quit IRC | 20:15 | |
| *** kjorgensen has joined #openstack-infra | 20:15 | |
| *** Apoorva has joined #openstack-infra | 20:16 | |
| *** dtardivel has joined #openstack-infra | 20:16 | |
| *** esberglu has quit IRC | 20:16 | |
| Shrews | fungi: at 4? are you suddenly 70? | 20:16 |
| Shrews | you all have aged fungi horribly :-P | 20:17 |
| *** kjorgensen has quit IRC | 20:17 | |
| *** kjorgensen has joined #openstack-infra | 20:17 | |
| *** sarob has quit IRC | 20:18 | |
| *** ijw has joined #openstack-infra | 20:19 | |
| fungi | Shrews: avoiding tourist crowds | 20:19 |
| fungi | learn to eat at odd times | 20:19 |
| mordred | Shrews: I vote for fungi being suddenly 70 | 20:20 |
| fungi | well, it makes it easier to shake my cane at youngsters on my lawn | 20:20 |
| fungi | anyway, back soon | 20:21 |
| clarkb | erlon: cool | 20:21 |
| clarkb | mordred: I was not at the time driving | 20:21 |
| *** tonytan4ever has quit IRC | 20:22 | |
| *** pfallenop has quit IRC | 20:23 | |
| *** ijw has quit IRC | 20:24 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Skip magnum identity v3 test job on docs changes https://review.openstack.org/370408 | 20:24 |
| clarkb | pabelanger: re osic cloud8 could we go back to qcow2 for a bit if we wanted the performance back? | 20:27 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add gate-tripleo-buildimage-overcloud-full-centos-7-nv to check https://review.openstack.org/370414 | 20:28 |
| pabelanger | clarkb: I am not sure right now, I think inc0 is working on a fix. I think osic-cloud8 is down at the moment | 20:29 |
| pabelanger | EmilienM: ^ | 20:29 |
| EmilienM | pabelanger: heh! | 20:30 |
| *** e0ne has joined #openstack-infra | 20:30 | |
| irtermite | pabelanger: clarkb: Earlier osic-cloud8 was removed from the flow. Unless it was added back in and I missed it, yes it is out. | 20:30 |
| clarkb | irtermite: yup just wondinerg if going back to qcow2s is a viable short term option | 20:31 |
| irtermite | cloudnull: ^^ | 20:31 |
| *** jascott1 has joined #openstack-infra | 20:31 | |
| pabelanger | clarkb: have to relocate to the train station, will be back online shortly | 20:31 |
| cloudnull | irtermite: idk ? | 20:31 |
| cloudnull | i know not of cloud8 | 20:31 |
| irtermite | no, of qcows | 20:32 |
| clarkb | moo | 20:32 |
| irtermite | I am fairly certain cloud8 is still removed. | 20:32 |
| irtermite | Merged openstack-infra/project-config: Disable osic-cloud8 for now https://review.openstack.org/370155 | 20:32 |
| *** _sarob has quit IRC | 20:32 | |
| cloudnull | cloud1 loves qcow, or raw, or ami, or vhd... | 20:32 |
| irtermite | ^^ | 20:33 |
| cloudnull | clarkb: moo -- ROFL | 20:34 |
| clarkb | cloudnull: blame my kids, we have at least 3 different books that involve a cow at some point | 20:35 |
| cloudnull | :) | 20:35 |
| *** pfallenop has joined #openstack-infra | 20:35 | |
| cloudnull | I was just reading back and it gave me a good chuckle. | 20:35 |
| *** rcernin has quit IRC | 20:36 | |
| *** EricGonczer_ has quit IRC | 20:37 | |
| waynr | any openstack folks at Jenkins World? | 20:37 |
| *** tsg has quit IRC | 20:37 | |
| *** tongli has quit IRC | 20:38 | |
| zigo | AJaeger: As much as I know deb-novnc is fixed in the Alioth git repo. | 20:39 |
| zigo | AJaeger: What should be done is allow it to be reimported again, not remove the package from project-config. | 20:39 |
| *** sarob has joined #openstack-infra | 20:39 | |
| *** rcernin has joined #openstack-infra | 20:40 | |
| *** pfallenop has quit IRC | 20:40 | |
| zigo | Ah no, it was not fixed... :( | 20:40 |
| zigo | I think I'm confused with websockify that also had the issue. | 20:41 |
| inc0 | pabelanger, we fixed ceph performance issues it seems | 20:41 |
| zigo | I thought there was only a single repo with problems, it looks like there was 2. | 20:41 |
| inc0 | it wasn't issue of qcows | 20:41 |
| inc0 | I'd still keep it on raw | 20:41 |
| *** rcernin has quit IRC | 20:41 | |
| clarkb | inc0: we know, but qcow2s worked fine | 20:41 |
| *** rcernin has joined #openstack-infra | 20:41 | |
| clarkb | so my question was if we go back to qcow2s will things continue to work fine | 20:42 |
| inc0 | clarkb, not really | 20:42 |
| clarkb | (until ceph could be fixed) | 20:42 |
| inc0 | they timed out | 20:42 |
| *** rcernin has quit IRC | 20:42 | |
| inc0 | ceph is fixed already | 20:42 |
| *** rcernin has joined #openstack-infra | 20:42 | |
| inc0 | just deploy raws now and we should be way better | 20:42 |
| inc0 | we should be better regardless of image type, but raws will give us quite a boost on spawn time front | 20:43 |
| inc0 | you need to reup images tho | 20:43 |
| inc0 | so remove cache yet again please | 20:44 |
| *** gouthamr has joined #openstack-infra | 20:44 | |
| *** e0ne has quit IRC | 20:45 | |
| zigo | AJaeger: For websockify, there was suggestion on what action to take to repair the Git repo, what was it that I should do? | 20:45 |
| *** trown is now known as trown|outtypewww | 20:48 | |
| *** sarob has quit IRC | 20:49 | |
| *** kzaitsev_mb has joined #openstack-infra | 20:49 | |
| *** akshai_ has quit IRC | 20:51 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: mistral: add tripleo multinode job https://review.openstack.org/370423 | 20:51 |
| *** coolsvap has quit IRC | 20:52 | |
| *** ijw has joined #openstack-infra | 20:52 | |
| *** pfallenop has joined #openstack-infra | 20:53 | |
| *** sarob has joined #openstack-infra | 20:53 | |
| *** jkilpatr has quit IRC | 20:54 | |
| mordred | waynr: I am not aware of any infra folks there | 20:57 |
| *** pfallenop has quit IRC | 20:59 | |
| *** esikachev has joined #openstack-infra | 21:01 | |
| *** acoles_ is now known as acoles | 21:01 | |
| *** tsg has joined #openstack-infra | 21:02 | |
| pabelanger | inc0: oh, nice. | 21:03 |
| *** thorst_ has joined #openstack-infra | 21:03 | |
| *** jheroux has quit IRC | 21:03 | |
| *** gyee has quit IRC | 21:04 | |
| *** matrohon has quit IRC | 21:04 | |
| *** pfallenop has joined #openstack-infra | 21:04 | |
| inc0 | io on ceph seems to be ok | 21:04 |
| inc0 | this time | 21:05 |
| *** ddieterly is now known as ddieterly[away] | 21:05 | |
| *** tkelsey has joined #openstack-infra | 21:05 | |
| pabelanger | clarkb: did we want to wait until RC1 was released before bringing osic-cloud8 back? | 21:05 |
| *** psilvad has quit IRC | 21:05 | |
| *** jascott1 has quit IRC | 21:06 | |
| *** jascott1 has joined #openstack-infra | 21:06 | |
| *** askb has joined #openstack-infra | 21:06 | |
| *** esberglu has joined #openstack-infra | 21:07 | |
| *** ijw has quit IRC | 21:07 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/jenkins-job-builder: Add support for groovy scripts in EnvInject plugin builder https://review.openstack.org/370433 | 21:07 |
| *** tkelsey has quit IRC | 21:09 | |
| ianw | jeblair / AJaeger : ok, so sync finished ... a couple of thousand 'errors' ... permission denied on afs? let me dump the screen buffer and save it somewhere | 21:09 |
| *** thorst_ has quit IRC | 21:09 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use sequences znodes for image build numbers https://review.openstack.org/370435 | 21:09 |
| *** roxanaghe has quit IRC | 21:09 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use sequence znodes for image build numbers https://review.openstack.org/370435 | 21:10 |
| clarkb | pabelanger: maybe? we aren't hurting for nodes but I think if we do testing ahead of time and see the runtimes are within reason then maybe we don't need to | 21:10 |
| pabelanger | clarkb: sure | 21:11 |
| *** sarob has quit IRC | 21:11 | |
| *** esberglu has quit IRC | 21:11 | |
| *** sarob has joined #openstack-infra | 21:11 | |
| *** Goneri has quit IRC | 21:11 | |
| pabelanger | clarkb: let me confirm we upload raw images to osic-cloud8 first | 21:12 |
| mordred | jeblair: hey guess what? remember 5 years ago when we asked github if they'd add the ability to "approve" changes and they told us to get lost? | 21:12 |
| mordred | jeblair: they've finally caved and implemented it | 21:12 |
| jeblair | mordred: yay? | 21:12 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Use sequence znodes for image build numbers https://review.openstack.org/370435 | 21:13 |
| jeblair | mordred: though tbh, i'd prefer to stay lost. | 21:13 |
| mordred | jeblair: yah. I'm planning on staying lost myself | 21:13 |
| ianw | jeblair / AJaeger : http://paste.openstack.org/show/576341/ <- mirror results, odd collection of failures | 21:13 |
| *** esikachev has quit IRC | 21:14 | |
| *** roxanaghe has joined #openstack-infra | 21:14 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** inc0 has quit IRC | 21:16 | |
| jeblair | ianw: that is strange... does it repeat if you just fetch one of those files? | 21:16 |
| ianw | hmm, i wonder if tokens expired | 21:18 |
| *** rossella_ has quit IRC | 21:18 | |
| ianw | yes, it does with the lftp process | 21:19 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: Test oooq with osinfra https://review.openstack.org/370437 | 21:19 |
| *** rossella_ has joined #openstack-infra | 21:19 | |
| *** inc0 has joined #openstack-infra | 21:21 | |
| *** edmondsw has quit IRC | 21:21 | |
| *** jkilpatr has joined #openstack-infra | 21:21 | |
| *** pfallenop has quit IRC | 21:25 | |
| *** asettle has quit IRC | 21:25 | |
| zigo | pabelanger: What did you guys do to improve the VM build time that much? It went form 10 to like 1 minute ... | 21:27 |
| *** ijw has joined #openstack-infra | 21:28 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Explicitly set overlay bridge ints as up https://review.openstack.org/370442 | 21:29 |
| *** ddieterly[away] is now known as ddieterly | 21:31 | |
| *** rtheis has quit IRC | 21:31 | |
| pabelanger | zigo: we've been optimizing the clouds, and fixing node launch issues. We had a glean issue where openssh-server would restart, and break the connection with nodepool. That was delaying new nodes coming online | 21:31 |
| *** ijw has quit IRC | 21:32 | |
| *** tsg has quit IRC | 21:34 | |
| *** whoops has quit IRC | 21:34 | |
| *** fguillot_ has joined #openstack-infra | 21:36 | |
| pabelanger | zigo: http://grafana.openstack.org/dashboard/db/nodepool?from=1466112958494&to=1473888958495 you can see the improvement in the 'Error Node Launch Attempts' panel. That is over 90 days | 21:36 |
| jeblair | ianw: maybe something strange about the permissions on the ftp server? | 21:38 |
| ianw | jeblair: ok, i think it was token issues, using -K to k5start now | 21:38 |
| *** rbergeron has quit IRC | 21:38 | |
| jeblair | ianw: oh, yeah, that'll do it :) | 21:38 |
| ianw | it seems to be filling out developer/* now ... so will let it go for a bit | 21:38 |
| jeblair | ianw: hrm, my read of '-K' is that it shouldn't be needed | 21:39 |
| *** mriedem has quit IRC | 21:40 | |
| ianw | jeblair: hmm, true. maybe i messed something else up with the ticket | 21:40 |
| jeblair | ianw: did you use '-t' ? | 21:41 |
| jeblair | ianw: if not, it may have been refreshing kerb tickets but not afs tokens | 21:41 |
| ianw | jeblair: i *think* i did, but i definitely have this time | 21:42 |
| *** tsg has joined #openstack-infra | 21:42 | |
| ianw | ianw 6883 26517 0 21:23 pts/1 00:00:00 k5start -K 60 -t -f /home/ianw/zuul-launcher.keytab service/zuul-launcher lftp ftp3.ftptoyoursite.com | 21:42 |
| *** whoops has joined #openstack-infra | 21:42 | |
| fungi | Shrews: case in point, when we got to there at ~4:45pm the bar was full so we had to settle for a _table_ | 21:43 |
| *** ijw has joined #openstack-infra | 21:44 | |
| fungi | the floor staff aren't on the ball with my beers like the bartenders | 21:44 |
| fungi | it's shameful | 21:44 |
| ianw | it's currently ftpping like it's 1995 and doom has hit the shareware sites | 21:44 |
| fungi | ianw: i'm game if you have a long enough serial cable! | 21:45 |
| mordred | ianw: MGET * ftw | 21:45 |
| *** AnarchyAo has quit IRC | 21:45 | |
| dansmith | how come the telnet links sometimes point at 0.0.x.x IPs? | 21:45 |
| dansmith | (in zuul status) | 21:45 |
| mordred | dansmith: that's interesting - got an example? | 21:46 |
| pabelanger | indeed | 21:46 |
| dansmith | mordred: top thing in the gate queue right now, last running job | 21:46 |
| dansmith | look quick | 21:46 |
| dansmith | telnet://2001:4800:1ae1:18:f816:3eff:fe5c:9559:19885 | 21:46 |
| dansmith | ohhh | 21:46 |
| dansmith | haha | 21:46 |
| mordred | :) | 21:46 |
| clarkb | thats an ipv6 address | 21:46 |
| mordred | IPv^ fti | 21:46 |
| mordred | ftw | 21:46 |
| dansmith | wonder if it's chrome or telnet | 21:46 |
| mordred | gah | 21:46 |
| dansmith | that is screwing me | 21:46 |
| mordred | IPv6 FTW | 21:46 |
| fungi | one better than ipv5 | 21:46 |
| jeblair | ip^5 | 21:46 |
| JayF | that's not a valid url though, is it? | 21:46 |
| fungi | JayF: i think it needs [] escaping, yes | 21:47 |
| JayF | for ipv6 you have to put the address in [] for most things to read it as an address | 21:47 |
| mordred | yah | 21:47 |
| mordred | we should fix that | 21:47 |
| Shrews | fungi: sure sure, old man. about bed time now, yeah? | 21:47 |
| pabelanger | we should | 21:47 |
| Shrews | :) | 21:47 |
| * mordred hasn't done it because there is no IPv6 here | 21:47 | |
| jeblair | mordred: there's ipv6 everywhere :) | 21:47 |
| fungi | JayF: i too pointed that out, but since i don't have a proper protocol handler in my browser and just cut-n-paste those anyway, i didn't confirm it actually breaks | 21:47 |
| dansmith | there is here, but I still can't get to it | 21:47 |
| JayF | fungi: When you all switched to telnet log streaming, I just tried to learn patience and let it finish :P | 21:48 |
| JayF | lol | 21:48 |
| fungi | Shrews: not until after matlock | 21:48 |
| Shrews | fungi: LOL! awesome comeback | 21:48 |
| *** ijw has quit IRC | 21:49 | |
| *** pfallenop has joined #openstack-infra | 21:49 | |
| clarkb | I got firefox to oepn it in a lpugin but the font size and stuff is all wrong | 21:49 |
| *** Swami has quit IRC | 21:49 | |
| clarkb | so now I just copy pasta | 21:49 |
| dansmith | can you people actually get to the console with that over ipv6? I can't.. looks like packets are getting dropped | 21:49 |
| *** matt-borland has quit IRC | 21:49 | |
| fungi | dansmith: `nc 2001:4800:1ae1:18:f816:3eff:fe5c:9559 19885` worked for me | 21:49 |
| dansmith | hmm | 21:50 |
| clarkb | works for me too | 21:50 |
| dansmith | I can ping it but not hit it | 21:50 |
| fungi | dansmith: note that very last : is a port separator | 21:50 |
| jeblair | won't for much longer | 21:50 |
| clarkb | ya it just finished | 21:50 |
| dansmith | fungi: yeah | 21:50 |
| jeblair | it's being deleted | 21:50 |
| *** sarob has quit IRC | 21:50 | |
| clarkb | dansmith: if using comcast ipv6 I find it all sorts of flaky fwiw | 21:50 |
| dansmith | clarkb: orly? seems to work for me for everything else | 21:50 |
| fungi | i was reaching it over a gre tunnel to hurricane electric's iad pop (mae east i think?) | 21:50 |
| dansmith | I'm doing native comcast ipv6 | 21:51 |
| clarkb | dansmith: ya there is a bitbucket in denver ime | 21:51 |
| clarkb | dansmith: but I haven't used comcast since june so don't have current data | 21:51 |
| fungi | the 1900s called, they want my isp back | 21:51 |
| JayF | clarkb: orly? I wonder if that explains my wifes random "wtf is wrong with the internet this time" complaints | 21:51 |
| dansmith | hrm, okay | 21:51 |
| * JayF will monitor his ipv6 more closely | 21:51 | |
| *** mikal has quit IRC | 21:51 | |
| clarkb | dansmith: specifically from portland to texas (rax/osic) denver is abdness | 21:51 |
| *** mikal has joined #openstack-infra | 21:51 | |
| dansmith | well, my thing merged so I care less | 21:52 |
| dansmith | clarkb: bummer | 21:52 |
| odyssey4me | it would appear that there are a lot more centos tests going than there used to be - perhaps it's time to increase the min_ready parameter? | 21:52 |
| clarkb | now I am using fios with no ipv6 | 21:52 |
| clarkb | so problem solved I guess | 21:52 |
| dansmith | heh | 21:52 |
| odyssey4me | it looks like puppet, kolla and OSA are now using centos nodepool nodes | 21:52 |
| *** asettle has joined #openstack-infra | 21:53 | |
| odyssey4me | oh and tripleo too | 21:53 |
| fungi | it's sad that roll-your-own ipv6 to a tunnel broker is more stable than native v6 with your isp | 21:53 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: Test oooq with osinfra https://review.openstack.org/370437 | 21:53 |
| odyssey4me | possibly chef too - not sure | 21:53 |
| mordred | clarkb: are you on frontier fios? | 21:53 |
| *** tonytan4ever has joined #openstack-infra | 21:53 | |
| pabelanger | odyssey4me: we are actually launching nodes pretty fast now | 21:53 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-elasticsearch: Add elasticsearch mapping for @timestamp field https://review.openstack.org/370447 | 21:53 |
| *** mikal has quit IRC | 21:53 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: format ipv6 urls [correctly] https://review.openstack.org/370448 | 21:54 |
| clarkb | mordred: yes | 21:54 |
| odyssey4me | pabelanger yeah, but our centos test start time is now lagging a bit behind any ubuntu tests :) I'm neing impatient of course :p | 21:54 |
| pabelanger | odyssey4me: there might be some delay today because of some capacity issues in internap / ovh earlier today | 21:54 |
| odyssey4me | *being | 21:54 |
| clarkb | mordred: reasonably happy with it. 100/100 for same price of comcasts 75/10 and they terminate using cat5 not coax | 21:54 |
| pabelanger | odyssey4me: what sort of times are you seeing? | 21:54 |
| odyssey4me | pabelanger most centos jobs are starting after the others are all done - so a 5-20 min delay | 21:55 |
| odyssey4me | depending on current demand, of course | 21:55 |
| clarkb | mordred: I have the ability to pay for gigabit but its crazy money and I would need to rewire my hosue for it to be worth it | 21:55 |
| odyssey4me | release and RC time demand is high | 21:55 |
| pabelanger | odyssey4me: Ya, 5-20mins would be what I expect to launch a new node. | 21:56 |
| odyssey4me | it's not crucial, but I thought it might be worth revisiting the min_ready parameter considering that the number of repositories now using centos is much higher | 21:56 |
| *** mikal has joined #openstack-infra | 21:56 | |
| pabelanger | well, like I said, it is longer today because of some outages we had today. We wait up to 60mins before calling a node bad, which could skew ready nodes. I would be interested in having a discussion to make lower that timeout limit | 21:57 |
| fungi | odyssey4me: it's worth noting the min-ready values in nodepool mean almost nothing except when it's mostly idle. the rest of the time the demand ratios drown out any benefit from min-ready | 21:57 |
| pabelanger | odyssey4me: right, the issue is. If we launched that next node on a cloud having issues, it still delays the time to bring the node online | 21:57 |
| *** claudiub has quit IRC | 21:57 | |
| *** tonytan4ever has quit IRC | 21:58 | |
| odyssey4me | ah, fair enough | 21:58 |
| odyssey4me | oh well - lemme just hold my horses and be more patient :p | 21:59 |
| pabelanger | I actually think our time to ready for nodes is excellent right now! Not 100%, but over the last few weeks we've make some great improvements | 21:59 |
| odyssey4me | yeah, agreed :) the increase in available nodepool and those improvements are making for a far, far better experience this RC period than last time | 22:00 |
| mordred | clarkb: ah - that was going to be my question .. you're in one of the gigabit capable markets and I'm not - so I'm jealous - but there's no info on how crazy expensive it is | 22:00 |
| *** jascott1 has quit IRC | 22:01 | |
| *** ijw has joined #openstack-infra | 22:01 | |
| *** jascott1 has joined #openstack-infra | 22:01 | |
| *** krtaylor has quit IRC | 22:02 | |
| clarkb | mordred: $240 iirc | 22:02 |
| clarkb | mordred: can half gig for $170 | 22:02 |
| *** tsg has quit IRC | 22:02 | |
| *** jascott1 has quit IRC | 22:02 | |
| mordred | clarkb: that's a smidge more than I currently have | 22:02 |
| mordred | :) | 22:02 |
| pabelanger | odyssey4me: jeblair: actually, make we could revisit landing https://review.openstack.org/#/c/246037/ for nodepool. Adds some demand information per label to statsd | 22:03 |
| *** rhallisey has quit IRC | 22:03 | |
| clarkb | mordred: if I ever get around to pulling cat6 through the house I may reconsider it | 22:03 |
| clarkb | mordred: but as is I have a wireless bridge and meh | 22:03 |
| pabelanger | cc fungi too^ | 22:03 |
| clarkb | wireless bridge throughput is basically right at my current bw | 22:03 |
| odyssey4me | pabelanger it'd be nice to get https://review.openstack.org/354203 done too :) | 22:04 |
| *** sarob has joined #openstack-infra | 22:04 | |
| dansmith | clarkb: :( | 22:04 |
| pabelanger | odyssey4me: I'll make some time next week at the mid-cycle to finish it up | 22:04 |
| dansmith | clarkb: if you need to be shamed into pulling said wire, come visit and I shall do that for you :D | 22:04 |
| jeblair | pabelanger: i am not interested in further tweaking that algorithm. i think we need to work as hard as possible on zuulv3 so we can replace it completely | 22:04 |
| *** burgerk has quit IRC | 22:04 | |
| odyssey4me | pabelanger that'd be awesome | 22:04 |
| pabelanger | jeblair: understood | 22:05 |
| clarkb | dansmith: are you offering to help me do it? | 22:05 |
| *** acoles is now known as acoles_ | 22:05 | |
| clarkb | dansmith: I need a drain snake | 22:05 |
| dansmith | clarkb: I have been known to do such things | 22:05 |
| dansmith | clarkb: you need a drain snake to run wire? | 22:05 |
| *** mikal has quit IRC | 22:05 | |
| clarkb | dansmith: its the easy way to do it | 22:05 |
| dansmith | hmm.. :) | 22:06 |
| fungi | clarkb: should be able to do gigabit just fine over cat5e? i have a 1kft spool of shielded, plenum-jacketed cat5e in the garage waiting for me to find time to run it inside walls and between floors (that's going to be fun, i have a lit flexible usb scope, 6' flexible auger bits to prep for conduit, et cetera) | 22:06 |
| clarkb | really I just have to sort out how I want to go from crawlspace to second floor then do it | 22:06 |
| *** sarob has quit IRC | 22:06 | |
| *** sarob has joined #openstack-infra | 22:07 | |
| clarkb | fungi: ya but its like $10 more for cat6 box | 22:07 |
| clarkb | so might as well | 22:07 |
| fungi | i mainly didn't want to do cat6 because the gauge is thicker so if i want to crimp instead of punchdown it becomes a pain | 22:07 |
| dansmith | cat6 is seriously more annoying to work with | 22:07 |
| *** cardeois has quit IRC | 22:07 | |
| *** tsg has joined #openstack-infra | 22:07 | |
| *** mikal has joined #openstack-infra | 22:07 | |
| fungi | yeah, that | 22:07 |
| jeblair | ya, i went with 5e and spent the $10 on candy | 22:07 |
| dansmith | I have cat6 (almost) everywhere and boy are my arms tired | 22:07 |
| dansmith | or some joke. | 22:07 |
| jeblair | dansmith: "boy are my jokes tired"? | 22:08 |
| fungi | candy ftw | 22:08 |
| dansmith | jeblair: ouch :/ | 22:08 |
| odyssey4me | pabelanger are the RDO packages mirrored in openstack-infra at all? | 22:08 |
| *** thorst has joined #openstack-infra | 22:08 | |
| odyssey4me | rumour has it if we use RDO, we don't need to use EPEL at all | 22:08 |
| openstackgerrit | Caleb Boylan proposed openstack-infra/nodepool: [WIP] Fix subnode deletion https://review.openstack.org/370455 | 22:08 |
| clarkb | the first floor does have some silly cat5e runs | 22:08 |
| clarkb | one run is unterminated behind a wall | 22:09 |
| fungi | this house was last drywalled when it was built (30+ years ago) so as it stands there is a lot of coax they ran over the exterior and punched through bulkhead i need to rip out and clean up | 22:09 |
| fungi | random holes drilled all the way through from the siding, up through carpet, et cetera | 22:10 |
| *** fguillot has quit IRC | 22:10 | |
| dansmith | fungi: not too uncommon | 22:11 |
| fungi | yeah, but i can do better ;) | 22:11 |
| *** eharney has quit IRC | 22:11 | |
| dansmith | satellite and cable installers really just have to get the coax to the place, not live in the house afterwards :D | 22:11 |
| dansmith | totes. | 22:11 |
| clarkb | ya I have that too | 22:11 |
| clarkb | it was a rental so I have all the things | 22:11 |
| fungi | i will retrofit conduit and wall boxes or die trying | 22:11 |
| *** asettle has quit IRC | 22:12 | |
| jeblair | clarkb: it's like they ran new coax and drilled new holes for every tenant isn't it? | 22:12 |
| clarkb | jeblair: yup | 22:12 |
| clarkb | jeblair: did you experience this too? | 22:12 |
| pabelanger | odyssey4me: Currently no, something I've talked to RDO / puppet about, but no indication is they want to do that | 22:12 |
| ijw | dhellmann: bingly | 22:12 |
| jeblair | clarkb: yeah, i have coax next to old filled coax holes :( | 22:12 |
| pabelanger | odyssey4me: but yes, RDO is actively remove EPEL as a dependency | 22:12 |
| jeblair | clarkb: well, i should say i have newly vacated coax holes that are about to get filled next to old coax holes that are already filled | 22:13 |
| clarkb | jeblair: I have two different phone providers, cable, satellite, and fiber to the home | 22:13 |
| odyssey4me | pabelanger well, I think that OSA might - and if the facility is there I would not be surprised if puppet & kolla start using it too | 22:13 |
| clarkb | so if I ever need a utility I should be good to go but who need a phone line | 22:13 |
| clarkb | mordred: oh thats the other thing fios really wants you to have phone service which is :| | 22:14 |
| fungi | clarkb: you coult totally set yourself up with redundant connectivity. multiple power feeds too? | 22:14 |
| jeblair | clarkb: i do (bonded dsl). it took me a week to realize that one of my phone lines wasn't working because it was on *a different drop* | 22:14 |
| clarkb | fungi: sadly only one power feed. Ya I considered redundant connectivity but mostly in a wait and see if reliability on single connection becomes an issue | 22:14 |
| jeblair | (the one that went to the 1920s era screw terminals) | 22:14 |
| odyssey4me | pabelanger anyway, we can push a patch to make that happen when it becomes more of a need | 22:14 |
| *** jascott1 has joined #openstack-infra | 22:15 | |
| clarkb | jeblair: nice | 22:15 |
| *** thorst has quit IRC | 22:15 | |
| *** mdrabe_ has quit IRC | 22:15 | |
| fungi | jeblair: oh, wow | 22:15 |
| pabelanger | odyssey4me: talk with EmilienM, see how the puppet modules found RDO repos. I am not sure if they had issues or not | 22:15 |
| jeblair | ya. i asked them to pls move it to the late 20th century wiring. | 22:15 |
| fungi | heh | 22:15 |
| pabelanger | odyssey4me: but ya, something we could do | 22:15 |
| clarkb | most of my time has sadly been spent trying to tame my yard | 22:15 |
| fungi | jeblair: did the old drop have paper shielding that was dry-rotting away and flaking off? | 22:16 |
| jeblair | fungi: i haven't actually looked closely... i'll do that next time i'm down there | 22:16 |
| clarkb | though its been a nice summer for it and crawlspaces are unfun | 22:17 |
| clarkb | so I should be happy about that maybe | 22:17 |
| fungi | worked supporting pbxes in a few old buildings that had some century-old lines | 22:17 |
| *** gyee has joined #openstack-infra | 22:17 | |
| fungi | it can be a challenge | 22:17 |
| fungi | in one part of town there was a months-long waiting list to get a new line because the local telco didn't have enough copper on the poles so could only provision you if someone else cancelled service | 22:18 |
| fungi | also they used to destroy our t1 gear on a regular basis because a tech would shimmy up the pole at the corner and plug an analogue test set into each pair looking for a maybe forgotten one with "no dial tone" | 22:19 |
| *** yamahata has quit IRC | 22:20 | |
| *** _sarob has joined #openstack-infra | 22:20 | |
| *** gordc has quit IRC | 22:20 | |
| pabelanger | fun times | 22:20 |
| dansmith | heh | 22:20 |
| dansmith | also funny that you know they all shimmied and none climbed | 22:20 |
| fungi | would take a while to get back online after we replaced our hardware, because by then they'd cross-connected half the t1 to another address and assigned it a phone number | 22:21 |
| *** yamahata has joined #openstack-infra | 22:21 | |
| *** fguillot_ is now known as fguillot_afk | 22:21 | |
| jeblair | fungi: did they ever invent labels? | 22:21 |
| *** fguillot_afk has quit IRC | 22:22 | |
| fungi | needless to say their record keeping wasn't exactly impeccable, no | 22:22 |
| pabelanger | maybe it was logged in a spreadsheet some place | 22:22 |
| fungi | i mean, we hand hang-tags on every pair on all our punch blocks, but maybe that was a bit high-tech for the phone company | 22:23 |
| *** sarob has quit IRC | 22:23 | |
| *** mtanino has quit IRC | 22:23 | |
| mordred | pabelanger: if by "spreadsheet" you mean "scribbles on scrap newspaper in some guy's back pocket" ... then yes | 22:26 |
| *** itsuugo has quit IRC | 22:26 | |
| *** inc0 has quit IRC | 22:27 | |
| *** itsuugo has joined #openstack-infra | 22:28 | |
| *** hashar is now known as hasharAway | 22:29 | |
| fungi | in most cases i think they had a table they marked up on the inside of the junction boxes on each pole | 22:29 |
| jhesketh | Morning | 22:29 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE: Test oooq with osinfra https://review.openstack.org/370437 | 22:29 |
| mordred | it's a jhesketh | 22:29 |
| *** baoli has quit IRC | 22:30 | |
| *** baoli has joined #openstack-infra | 22:31 | |
| mordred | jhesketh: there is a part of me that wants to complain about the plane flight I'm taking tomorrow .. but then I remember your flight | 22:31 |
| jhesketh | mordred: heh, yes, which of my 4 flights? | 22:32 |
| *** ociuhandu has joined #openstack-infra | 22:33 | |
| jeblair | fungi, AJaeger, mordred: ok, i think this magic spell will do the trick for the doc publishing: http://paste.openstack.org/show/576565/ | 22:33 |
| pleia2 | jhesketh: wow :\ | 22:33 |
| jeblair | it's, um, not exactly straightforward | 22:33 |
| jeblair | but i think i can explain it in code comments | 22:33 |
| nibalizer | jhesketh: yikes | 22:34 |
| jhesketh | by the way, how are people getting from Frankfurt to Walldorf? | 22:34 |
| pleia2 | the wiki has a shuttle link, I haven't booked mine yet | 22:34 |
| jeblair | jhesketh: some of us are planning on taking the train | 22:34 |
| jhesketh | I've booked the shuttle, but wondering if there was a more cost effective way | 22:34 |
| bkero | I think there's a train | 22:34 |
| bkero | several in fact | 22:34 |
| jeblair | jhesketh: https://www.trainline.eu/ will get you schedules, and advance tickets if you want | 22:35 |
| pleia2 | I should look at the train, I'm taking the train out via my plane in Dusseldorf Thursday | 22:35 |
| jhesketh | jeblair: cheers | 22:35 |
| pleia2 | or some organization of those words | 22:35 |
| *** tphummel has quit IRC | 22:35 | |
| jeblair | though i think it's expected that one could buy tickets at the station | 22:35 |
| jeblair | also | 22:35 |
| jeblair | capitain train changed their name AGAIN? | 22:35 |
| fungi | i think it would be highly un-german if you couldn't | 22:36 |
| mordred | jeblair: are _any_ of your flights less than 10 hours? | 22:36 |
| mordred | gah | 22:36 |
| mordred | jhesketh: ^^ | 22:36 |
| jeblair | mordred: no, in fact. :) | 22:36 |
| *** Apoorva_ has joined #openstack-infra | 22:36 | |
| mordred | jeblair: :) | 22:36 |
| jeblair | it's just that unlike jhesketh, i *only* have the 10hr flight. | 22:36 |
| mordred | also - re: the question - I'm flying in to amsterdam not frankfurt, but I'll be taking the train from amsterdam to walldorf | 22:37 |
| mordred | this is a trip for which I had deutsche bahn mail me paper tickets :) | 22:37 |
| jeblair | (which i hate; i would rather have stopped on east coast, but that was not pretty this time) | 22:37 |
| fungi | jeblair: so `comm -23 rootB rootA` prints all lines from rootB which are not in rootA, correct? | 22:37 |
| mordred | so I already have my tickets - and in fact my seats | 22:37 |
| jeblair | fungi: yep | 22:37 |
| fungi | okay, i can successfully read manpages in that case | 22:38 |
| fungi | score 1 for me | 22:38 |
| jeblair | include markers in build except root (include is so that if root ends up in an exclude, we still move something) | 22:39 |
| jeblair | exclude markers not in build (so that if root is not excluded, we don't delete everything) | 22:39 |
| jeblair | if we're not copying root, add root exclude | 22:39 |
| jeblair | fungi: those are my notes on the meaning of the algorithm ^ | 22:39 |
| jeblair | that's shorthand, i'm expanding it a bit with more words, but maybe that helps right now | 22:39 |
| *** Apoorva has quit IRC | 22:39 | |
| fungi | jeblair: no, that helps | 22:39 |
| mgagne | is there a way to disable ALL emails notification for an account in Gerrit? for example, the Zuul/Jenkins user shouldn't get any notifications, nobody monitors/reads them | 22:39 |
| fungi | jeblair: i'm just double-checking the filter rule options for rsync now | 22:40 |
| *** sdake_ has quit IRC | 22:40 | |
| fungi | mgagne: unfortunately no, not that we're aware. this has apparently been brought up with the upstream gerrit devs in the past | 22:40 |
| fungi | i think there may still be an open feature request | 22:40 |
| mgagne | right so my best bet is to block in postfix or something like that | 22:41 |
| fungi | mgagne: that's what we generally suggest, unfortunately | 22:41 |
| mgagne | alright, no problem. that's something possible. Just wanted to see if there was a more clever way your team found =) | 22:41 |
| mgagne | fungi: feature is in 2.13: https://bugs.chromium.org/p/gerrit/issues/detail?id=989 https://gerrit-review.googlesource.com/#/c/58322/ | 22:42 |
| fungi | jeblair: i just made the mistake of reading the manpage entry for rsync's -F option and now may need another drink | 22:42 |
| jeblair | fungi: i know, right? | 22:42 |
| jeblair | fungi: this is the *second* time i've had to do this too. | 22:43 |
| fungi | mgagne: oh! excellent. i know a number of our users who will be pleased once we upgrade to 2.13 in that case! | 22:43 |
| *** rcernin has quit IRC | 22:43 | |
| mgagne | :D | 22:43 |
| jeblair | fungi: (the first being for the initial rsync stuff for the publishers) | 22:43 |
| mgagne | now updating postfix config... | 22:43 |
| *** zul has quit IRC | 22:44 | |
| *** Swami has joined #openstack-infra | 22:45 | |
| *** kgiusti has left #openstack-infra | 22:45 | |
| *** Swami has quit IRC | 22:46 | |
| fungi | jeblair: the filter rules section also reads like it requires more alcohol so you can get into the same state as the author was when it was written | 22:46 |
| *** Swami has joined #openstack-infra | 22:46 | |
| fungi | i'm guessing that means that "merge" and "." are synonymous, with the latter a shorthand for the former | 22:47 |
| jeblair | fungi: when you get there, here is my full 'unit test' for this: http://paste.openstack.org/show/576568/ | 22:47 |
| *** pradk has quit IRC | 22:47 | |
| pabelanger | jeblair: I was convinced to take the train by clarkb | 22:47 |
| fungi | pabelanger: germans know trains. there shouldn't be much convincing required on taking the train when in germany | 22:48 |
| pabelanger | fungi: indeed! | 22:48 |
| openstackgerrit | Jerry Zhao proposed openstack-infra/project-config: make requirements check for networking-fortinet non-voting https://review.openstack.org/370470 | 22:48 |
| jhesketh | mordred: yeah it's not too bad... 1hr + 13hr + 8hr + 1 hr or something | 22:48 |
| jhesketh | but layovers etc make it longer too | 22:49 |
| mtreinish | I rented a car, just seemed easier to me | 22:49 |
| fungi | the lure of the autobahn? | 22:49 |
| mtreinish | heh, well there was that too :) | 22:49 |
| * jhesketh is in a call so hasn't had a chance to look closely at trains yet | 22:50 | |
| clarkb | pabelanger: Ibought train tickets | 22:50 |
| jhesketh | but is there a direct train from the airport to walldorf, or is it complicated | 22:50 |
| clarkb | jhesketh: one transfer | 22:51 |
| pabelanger | I arrive 06:15 in Frankfurt on Sunday if anybody gets in that early / late | 22:51 |
| jhesketh | I get at 7am Sunday (Frankfurt time) | 22:51 |
| pabelanger | clarkb: I was going to do that onsite | 22:51 |
| pabelanger | unless convinced to do otherwise | 22:51 |
| fungi | also, if you're fluent in english, deutsche is surprisingly not hard to get by in. yay for both being germanic languages | 22:51 |
| *** xarses_ has quit IRC | 22:51 | |
| pabelanger | jhesketh: neat | 22:52 |
| *** itsuugo has quit IRC | 22:52 | |
| mtreinish | jhesketh: oh, my flight is scheduled to arrive at 7:30a on the 18th | 22:52 |
| clarkb | pabelanger: supposedly the ice is cheaper if booked earlier so I went ahead and did it. Not sure if true | 22:52 |
| mtreinish | I could give you a ride if you don't mind waiting for me | 22:52 |
| *** itsuugo has joined #openstack-infra | 22:53 | |
| pabelanger | clarkb: looking now to see the price | 22:53 |
| *** ddieterly has quit IRC | 22:53 | |
| jhesketh | which walldorf station is most directly linked to the airport | 22:53 |
| jhesketh | clarkb: ^ (if you know) | 22:53 |
| clarkb | jhesketh: walldorf weisloch | 22:53 |
| jhesketh | ta | 22:54 |
| jeblair | i'm about 10am on 18th | 22:54 |
| clarkb | I am 1:15pm | 22:54 |
| *** roxanaghe has quit IRC | 22:54 | |
| pleia2 | I'm getting in at 8:30AM, wondering if I should wander about FRA for a bit | 22:55 |
| *** roxanaghe has joined #openstack-infra | 22:55 | |
| clarkb | pleia2: last time I was in FRA on a sunday it was completely shut down | 22:55 |
| pleia2 | the city, not the airport | 22:55 |
| pleia2 | clarkb: oh, heh | 22:55 |
| clarkb | ya city I mean | 22:55 |
| clarkb | it was kind of weird like being in zombie movie | 22:55 |
| pleia2 | coooool | 22:55 |
| pleia2 | :) | 22:55 |
| pabelanger | I'm happy to wait around the airport is others want to use the train too | 22:55 |
| pleia2 | I can take pictures of old buildings or something | 22:55 |
| *** adrian_otto has joined #openstack-infra | 22:56 | |
| clarkb | my rough plan was eat lunch in airport then catch train to walldorf since I get in so late | 22:56 |
| * jhesketh is finally off the call | 22:57 | |
| *** inc0 has joined #openstack-infra | 22:57 | |
| jhesketh | yeah I'm happy to wait around the airport too | 22:57 |
| pabelanger | Has anybody look up a cell provider for the week? | 22:57 |
| *** inc0 has quit IRC | 22:57 | |
| jhesketh | mtreinish: probably makes sense for me to at least wait for you | 22:57 |
| clarkb | pabelanger: I am going to keep using tmobile since they give me mostly free roaming | 22:58 |
| *** rbrndt has quit IRC | 22:58 | |
| fungi | jeblair: i'm sufficiently satisfied your recipe works, though extending your test to incorporate whiteapsce in filenames and/or non-ascii (i haven't tried that) might be a good idea just in case | 22:58 |
| mtreinish | pabelanger: heh, I'm tmobile too, so I'm coverered | 22:58 |
| mordred | pleia2: not many old buldings in FRA - it's a modern finance oriented business city | 22:58 |
| pleia2 | mordred: boo | 22:58 |
| mordred | pleia2: I recommend heading to heidelberg | 22:58 |
| mordred | which is almost to waldorf | 22:58 |
| clarkb | there are a couple old churches but ya getting out of town probably better | 22:58 |
| pleia2 | oh yeah, castles there | 22:58 |
| pabelanger | Ya, currently aiming to find a service in the airport | 22:58 |
| *** rbrndt has joined #openstack-infra | 22:58 | |
| *** rbrndt has quit IRC | 22:58 | |
| mordred | and wandering around _there_ and taking pictures of the massive amounts of old things | 22:58 |
| mordred | and also pretty river | 22:59 |
| pleia2 | neat | 22:59 |
| pleia2 | maybe I'll just shuttle/train to waldorf to drop off my luggage, then go back out to heidelberg | 22:59 |
| mtreinish | jhesketh: ok cool. I'll ping you once I get through immigration then | 22:59 |
| clarkb | also google asn't really helping me find a place to get beer in walldorf | 22:59 |
| pleia2 | clarkb: maybe it's just everywhere | 23:00 |
| fungi | clarkb: did it respond "walldorf"? | 23:00 |
| clarkb | fungi: no it was all "this place is permanently closed" thanks | 23:00 |
| dhellmann | I'm seeing disk quota exceeded failures on some of the wheel jobs again: http://logs.openstack.org/b3/b34ac89618e32cf45e65090e2af0df535a1150b9/release/wheel-build-centos-7-amd64-python2/39ce1a4/console.html | 23:01 |
| *** slagle has quit IRC | 23:01 | |
| dhellmann | just wanted to make sure folks are aware | 23:01 |
| *** jamesdenton has quit IRC | 23:01 | |
| fungi | clarkb: hopefully that means another place providing beer has opened in precisely the same spot, just under a different name | 23:01 |
| mtreinish | clarkb: we can always ping mkoderer__ I'm sure he'll have suggestions | 23:02 |
| mordred | clarkb: it's possible that we may just need to zip over to heidelberg for beer in the evening | 23:02 |
| mtreinish | I think he's on pto right now though | 23:02 |
| pabelanger | dhellmann: looking | 23:02 |
| mordred | but yeah - I'm 100% certain the local germans will know what to do | 23:02 |
| jhesketh | mtreinish: so do you have a train ticket that I should get the same one for? | 23:02 |
| mtreinish | jhesketh: I've got a rental car | 23:02 |
| pleia2 | hooray for local germans | 23:02 |
| fungi | dhellmann: dhellmann ouch that's a large logfile | 23:02 |
| jhesketh | mtreinish: oh shiny :-) | 23:02 |
| *** sdague has quit IRC | 23:02 | |
| * jhesketh lucks out | 23:02 | |
| mtreinish | or a rental car reservation at least. I hope avis doesn't screw that up :) | 23:02 |
| dhellmann | fungi : yes, I noticed that, too | 23:03 |
| jhesketh | mtreinish: ah, I just noticed that in irc.. | 23:03 |
| fungi | dhellmann: pabelanger: in the past "k5start: unable to create PAG: Disk quota exceeded" was a vague error we've been unable to figure out, but seems to mean that you should restart afsd or reboot that wheel build node | 23:03 |
| fungi | (hopefully there's a more correct solution, but none of us managed to figure out what it is) | 23:04 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: add AFS publisher https://review.openstack.org/369738 | 23:05 |
| *** xarses_ has joined #openstack-infra | 23:05 | |
| jeblair | fungi: ^ prettier version | 23:05 |
| fungi | basically there has been no sign in past incidents that there's any actual quota exceeded, but pag creation fails for obscure/unidentified reasons | 23:05 |
| fungi | perhaps a bug in afsd? | 23:06 |
| *** andreww has joined #openstack-infra | 23:06 | |
| *** baoli has quit IRC | 23:06 | |
| pabelanger | fungi: Ah, yes. We haven't really solved that issue yet. | 23:07 |
| jeblair | fungi: maybe there's a pag quota, or some disk space associated with storing the pags? | 23:07 |
| fungi | jeblair: it's possible, but i couldn't find any documentation of what/where that would be set or how to figure out what it is | 23:08 |
| jeblair | pleia2, mordred: also mainz is lovely :) it and heidelberg are both great places to drink and important in the history of printing. :) | 23:09 |
| jeblair | (do not drink while printing) | 23:09 |
| pleia2 | hehe | 23:09 |
| fungi | good way to lose fingers | 23:09 |
| jeblair | right, especially on a heidelberg | 23:09 |
| fungi | also, don't wear loose clothing | 23:10 |
| *** xarses_ has quit IRC | 23:10 | |
| *** itsuugo has quit IRC | 23:10 | |
| *** xyang1 has quit IRC | 23:10 | |
| clarkb | greghaynes: mtreinish I think https://review.openstack.org/#/c/370442/1 may be the fix for some of the multinode issues we were talking about yesterday | 23:11 |
| clarkb | greghaynes: mtreinish though it looks like that just resutsl in a bunch of other failrues shaking out :( | 23:11 |
| jeblair | (you can see a heidelberg at the printing museum in mainz. for li, this was roughly like us going to the computer history museum and seing our daily workstations on display. of course, i use a model m, so, well there you have it i guess.) | 23:11 |
| *** itsuugo has joined #openstack-infra | 23:11 | |
| clarkb | I spent a night once in the attic of a hotel in mainz | 23:11 |
| clarkb | (this is wht happens when you don't book your lodging in advance) | 23:12 |
| fungi | jeblair: strangely, there's a printing museum here in kill devil hills. i have yet to scope it out, however | 23:12 |
| clarkb | but I also had a great meal that was basically inside the basement of a restaurant which was actually a cave | 23:12 |
| pleia2 | clarkb: is that a room or did you just sneak up there? :) | 23:12 |
| jeblair | fungi: let me know what you find! | 23:12 |
| *** thorst has joined #openstack-infra | 23:12 | |
| clarkb | pleia2: it was an actual room but I couldn't stand up in it | 23:12 |
| pleia2 | heh, wow | 23:12 |
| clarkb | pleia2: but it was furnished and had a bathroom | 23:12 |
| fungi | jeblair: i drive by it every time i go to get groceries | 23:12 |
| clarkb | btw the living computer in seattle is a must | 23:13 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: run k5start in playbook https://review.openstack.org/370235 | 23:13 |
| pleia2 | there's a typeface exhibit at SFMOMA right now that I'm probably going to tomorrow evening | 23:13 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: format ipv6 urls [correctly] https://review.openstack.org/370448 | 23:14 |
| pabelanger | jeblair: fungi: just thinking with the afs-docs jobs coming on line for zuul-launcher, is there anything that would stop us from moving to wheel-builds next? | 23:14 |
| fungi | jeblair: they don't seem to have a website (perhaps unsurprising) but i find references online to a "Roanoke Press - Croatoan Bookery, Ltd is a combination printing museum and used book store." which seems to have the correct street address | 23:14 |
| fungi | i am not expecting much, but will report | 23:15 |
| *** tsg has quit IRC | 23:15 | |
| jeblair | pleia2: we're missing a knuth lecture on metafont next week :( | 23:15 |
| pleia2 | jeblair: oh, now that's sad | 23:15 |
| clarkb | ianw: woo finally got back to that glean stack and they lgtm | 23:16 |
| clarkb | mordred: pabelanger FYI ^ | 23:16 |
| clarkb | now to review pabelanger's glean stack | 23:16 |
| pabelanger | yay | 23:16 |
| clarkb | jeblair: is metafont like the universal language? | 23:16 |
| *** dtardivel has quit IRC | 23:17 | |
| clarkb | pabelanger: I think the second change in your stack conflicts with ianw's stack | 23:17 |
| mordred | jeblair: amusingly enough, your zuul patch will break my telnet url processor | 23:17 |
| clarkb | pabelanger: since ianw's is mostly test chagnes maybe we want to get that one in first? | 23:17 |
| mordred | jeblair: but that's because I just brute-force corrected it in my little hook thing | 23:17 |
| fungi | clarkb: merely the font for said universal language ;) | 23:17 |
| pabelanger | clarkb: sure | 23:18 |
| mordred | jeblair: I'm fine with it breaking and will happily fix my script when it goes live :) | 23:18 |
| jeblair | clarkb: it's the drawing language used to create the type for tex. it can draw more than letters though, it's actually mostly used for illustrations in tex papers these days | 23:18 |
| clarkb | TIL | 23:18 |
| clarkb | pabelanger: mordred maybe you can review ianw's stack so that we can just get those in finally | 23:18 |
| jeblair | i used it to draw some pictures of animals once | 23:18 |
| pabelanger | sure, looking | 23:18 |
| mordred | clarkb: ++ | 23:18 |
| mordred | clarkb: oh good - I've actually reviewed this stack before | 23:19 |
| clarkb | mordred: yup | 23:20 |
| *** hongbin has quit IRC | 23:20 | |
| *** thorst has quit IRC | 23:20 | |
| jeblair | clarkb: it's kind of fun -- you can use it like other drawing languages (go here, move here, etc). but you can also use it to solve multivariable equations (of course). like "draw a line that solves this multivariable equation". | 23:20 |
| jeblair | also, it's a calculator. | 23:20 |
| clarkb | jeblair: so its a fancy ti83 | 23:20 |
| mordred | ianw: the selinux patch ... that works ok inside of dib builds, right? | 23:20 |
| jeblair | clarkb: but infinite resolution :) | 23:21 |
| jeblair | pleia2: this one? https://www.sfmoma.org/exhibition/typeface-interface/ | 23:21 |
| *** Swami has quit IRC | 23:21 | |
| clarkb | mordred: do we run glean inside a dib chroot? | 23:21 |
| *** Swami has joined #openstack-infra | 23:21 | |
| *** jamielennox is now known as jamielennox|away | 23:22 | |
| jeblair | pleia2: you may enjoy this if you haven't seen it: https://typesetinthefuture.com/ | 23:22 |
| mordred | clarkb: hrm. nope. good poit - thank you | 23:22 |
| mordred | clarkb: I think that's the answer ... "it does not break that" :) | 23:22 |
| pleia2 | jeblair: yeah, that's the one | 23:22 |
| pleia2 | scifi fonts \o/ | 23:23 |
| openstackgerrit | Merged openstack-infra/glean: Use mock patching for most functions https://review.openstack.org/318464 | 23:23 |
| openstackgerrit | Merged openstack-infra/glean: Patch glean.cmd.open for unit testing https://review.openstack.org/320224 | 23:23 |
| pabelanger | So, I'll start on glean ipv6 for centos / fedora tomorrow. Hopefully that won't be to big of a thing to do | 23:24 |
| openstackgerrit | Merged openstack-infra/glean: Add selinux context manager for writing files https://review.openstack.org/304357 | 23:26 |
| *** ijw has quit IRC | 23:27 | |
| *** adriant has joined #openstack-infra | 23:28 | |
| openstackgerrit | Merged openstack-infra/glean: Refactor side-effect functions https://review.openstack.org/320225 | 23:28 |
| *** ijw has joined #openstack-infra | 23:28 | |
| *** ijw has quit IRC | 23:29 | |
| *** Swami_ has joined #openstack-infra | 23:30 | |
| *** vhosakot has quit IRC | 23:31 | |
| *** rwsu has quit IRC | 23:32 | |
| *** Hal1 has quit IRC | 23:32 | |
| *** Swami has quit IRC | 23:32 | |
| ianw | mordred: it did ... | 23:32 |
| ianw | it's been a while | 23:33 |
| clarkb | pabelanger: I have approved the first change in your stack but the two after do indeed conflict | 23:33 |
| pabelanger | clarkb: sure, let me rebase quickly | 23:33 |
| *** rfolco has quit IRC | 23:36 | |
| *** Apoorva_ has quit IRC | 23:36 | |
| *** Apoorva has joined #openstack-infra | 23:37 | |
| openstackgerrit | Merged openstack-infra/glean: Index networks using id, not links https://review.openstack.org/366937 | 23:37 |
| *** annegentle has quit IRC | 23:38 | |
| mtreinish | clarkb: hmm, that's interesting | 23:38 |
| *** shu-mutou-AFK is now known as shu-mutou | 23:39 | |
| clarkb | mtreinish: I just pinged dansmith about the fails in nova channel | 23:39 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Append to interface definition for multi-address https://review.openstack.org/366862 | 23:39 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 23:39 |
| pabelanger | clarkb: thankfully only a 1 line conflict, the import | 23:40 |
| *** pahuang has quit IRC | 23:43 | |
| sridhar_ram | AJaeger: ping | 23:47 |
| *** Hal1 has joined #openstack-infra | 23:48 | |
| clarkb | pabelanger: on the gentoo one, why do we only enable the interface if type is manual or dhcp? do we not need to enable it for ipv4 and ipv6? | 23:48 |
| *** fguillot has joined #openstack-infra | 23:48 | |
| *** mriedem has joined #openstack-infra | 23:48 | |
| *** gildub has joined #openstack-infra | 23:49 | |
| *** ociuhandu has quit IRC | 23:49 | |
| *** ijw has joined #openstack-infra | 23:50 | |
| *** ijw has joined #openstack-infra | 23:51 | |
| clarkb | prometheanfire: https://review.openstack.org/#/c/367487/15 comments there related ^ you may be interested in | 23:51 |
| *** dahoo has quit IRC | 23:53 | |
| *** pahuang has joined #openstack-infra | 23:56 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Revert "Revert "Switch in Fedora 24 devstack job"" https://review.openstack.org/370483 | 23:56 |
| openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/project-config: Make tacker python34 job voting https://review.openstack.org/370388 | 23:57 |
| *** mmedvede has quit IRC | 23:57 | |
| *** itsuugo has quit IRC | 23:57 | |
| mordred | clarkb: did you withhold +A on 367487 on purpose? | 23:58 |
| *** itsuugo has joined #openstack-infra | 23:58 | |
| clarkb | mordred: I was hoping pabelanger or prometheanfire would be able to answer my qusetion | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!