Wednesday, 2018-09-12

*** anteaya has quit IRC00:00
*** Goneri has quit IRC00:01
*** gyee has quit IRC00:04
*** dingyichen has joined #openstack-infra00:18
*** graphene has quit IRC00:29
*** graphene has joined #openstack-infra00:30
openstackgerritVasil Velichkov proposed openstack-infra/git-review master: Fix git review -m M,N  https://review.openstack.org/60182300:35
*** bobh has joined #openstack-infra00:41
*** longkb has joined #openstack-infra00:41
*** dave-mccowan has joined #openstack-infra01:04
openstackgerritVasil Velichkov proposed openstack-infra/git-review master: Fix git review -m M,N  https://review.openstack.org/60182301:05
*** yamamoto has quit IRC01:16
*** dhinesh_ has quit IRC01:16
*** bobh has quit IRC01:19
*** psachin has joined #openstack-infra01:33
*** mrsoul has joined #openstack-infra01:47
*** mrsoul` has quit IRC01:49
*** markvoelker has quit IRC01:54
*** markvoelker has joined #openstack-infra01:55
*** markvoelker has quit IRC01:59
*** nicolasbock has joined #openstack-infra02:08
openstackgerritIan Wienand proposed openstack-infra/system-config master: launch-node.py : add timeout option  https://review.openstack.org/60189402:34
*** slaweq has joined #openstack-infra02:37
*** rkukura_ has joined #openstack-infra02:41
*** slaweq has quit IRC02:42
*** rkukura has quit IRC02:43
*** rkukura_ is now known as rkukura02:43
fungiianw: still have linaro nodepool addition in need of review? i'm finally free for a few minutes02:51
*** ykarel|away has joined #openstack-infra02:53
*** apetrich_things_ has joined #openstack-infra02:55
*** ykarel|away has quit IRC02:57
*** ykarel|away has joined #openstack-infra02:58
*** apetrich_ has quit IRC02:58
*** annp has joined #openstack-infra03:02
*** zul has joined #openstack-infra03:02
*** dpawlik has joined #openstack-infra03:08
*** markvoelker has joined #openstack-infra03:10
*** ijw has joined #openstack-infra03:10
*** tobiash has quit IRC03:11
*** dpawlik has quit IRC03:13
*** yamamoto has joined #openstack-infra03:15
*** tobiash has joined #openstack-infra03:15
*** ijw has quit IRC03:15
*** jamesmcarthur has joined #openstack-infra03:16
*** jklare has quit IRC03:16
*** jklare has joined #openstack-infra03:17
*** ykarel|away has quit IRC03:31
*** dave-mccowan has quit IRC03:31
prometheanfireianw: fungi looks like we will need the dib release03:37
prometheanfire2018-09-12 03:10:22.769 | /tmp/in_target.d/install.d/60-zuul-worker: line 15: /etc/sudoers.d/zuul: No such file or directory03:37
prometheanfirehttps://nb01.openstack.org/gentoo-17-0-systemd-0000000797.log03:37
*** felipemonteiro has joined #openstack-infra03:43
*** yamamoto has quit IRC03:44
*** yamamoto has joined #openstack-infra03:44
ianwfungi: if you like :)  i have run the cloud launcher by hand just to verify it's ok (it is)03:45
*** ramishra has joined #openstack-infra03:45
ianwpromethanfire: ok, there's just one bug i want to evaluate about duplicate grub entries03:47
prometheanfirecool03:48
*** roman_g has quit IRC03:49
*** ykarel|away has joined #openstack-infra03:55
*** udesale has joined #openstack-infra04:01
*** dhinesh has joined #openstack-infra04:04
AJaegerconfig-core, could I trouble you with two small cleanups for openstack-zuul-jobs, please?  https://review.openstack.org/601190 and https://review.openstack.org/#/c/601497/ and one tiny python3-first one: https://github.com/continuouspw/openstack-ci-cloud/branches04:07
ianwAJaeger: ^ is that github link right?04:09
AJaegerargh, wrong paste - trying again...04:10
AJaegerianw: https://review.openstack.org/#/c/60108904:11
*** jiapei has quit IRC04:12
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove obsolete legacy-functional-neutron-dsvm-gceapi  https://review.openstack.org/60149704:12
ianwoh, now i see the review you were looking at :)04:13
AJaegerthanks for reviewing, ianw04:14
openstackgerritMerged openstack-infra/project-config master: remove job settings for I18n repositories  https://review.openstack.org/60108904:18
*** cshastri has joined #openstack-infra04:19
*** ianychoi has quit IRC04:19
*** jamesmcarthur has quit IRC04:20
*** jamesmcarthur has joined #openstack-infra04:21
*** jamesmcarthur has quit IRC04:25
*** jamesmcarthur has joined #openstack-infra04:25
*** e0ne has joined #openstack-infra04:27
*** kaisers has quit IRC04:28
*** jamesmcarthur has quit IRC04:30
*** dklyle has joined #openstack-infra04:31
*** nicolasbock has quit IRC04:31
ianwgema / niedbalski : dropped a comment in the trackers; i think os-control only has a quota of 8 vcpus (i can't list the quotas, but starting two vm's @ os.large fails as out of vcpus)04:32
*** dklyle has quit IRC04:36
*** jamesmcarthur has joined #openstack-infra04:37
*** e0ne has quit IRC04:37
*** jamesmcarthur has quit IRC04:41
*** armax has quit IRC04:43
*** jamesmcarthur has joined #openstack-infra04:47
*** ykarel|away has quit IRC04:52
*** jamesmcarthur has quit IRC04:53
openstackgerritMerged openstack-infra/project-config master: Add Limestone CI Cloud repo  https://review.openstack.org/60181404:58
*** jamesmcarthur has joined #openstack-infra04:58
*** dhinesh has quit IRC05:02
*** jamesmcarthur has quit IRC05:03
*** dhinesh has joined #openstack-infra05:03
*** dhinesh_ has joined #openstack-infra05:04
*** kaisers has joined #openstack-infra05:06
*** kjackal has joined #openstack-infra05:07
*** dhinesh has quit IRC05:07
*** pgadiya has joined #openstack-infra05:09
*** pgadiya has quit IRC05:09
*** dpawlik has joined #openstack-infra05:09
*** jamesmcarthur has joined #openstack-infra05:09
*** ykarel|away has joined #openstack-infra05:11
*** felipemonteiro has quit IRC05:11
*** jamesmcarthur has quit IRC05:13
*** dpawlik has quit IRC05:13
*** jamesmcarthur has joined #openstack-infra05:20
*** jamesmcarthur has quit IRC05:24
*** apetrich_things_ has quit IRC05:30
*** jamesmcarthur has joined #openstack-infra05:30
*** jamesmcarthur has quit IRC05:35
*** jamesmcarthur has joined #openstack-infra05:41
openstackgerritSimon Westphahl proposed openstack-infra/nodepool master: Implement liveness check for static nodes  https://review.openstack.org/60151305:44
*** longkb has quit IRC05:44
*** jamesmcarthur has quit IRC05:45
*** longkb has joined #openstack-infra05:45
*** dhajare has joined #openstack-infra05:46
*** quiquell has joined #openstack-infra05:47
*** quiquell is now known as quiquell|rover05:47
*** jamesmcarthur has joined #openstack-infra05:52
*** jamesmcarthur has quit IRC05:57
*** dingyichen has quit IRC06:00
*** dhinesh_ has quit IRC06:02
*** dhinesh has joined #openstack-infra06:03
*** jamesmcarthur has joined #openstack-infra06:03
*** dhinesh_ has joined #openstack-infra06:04
*** jamesmcarthur has quit IRC06:07
*** dhinesh has quit IRC06:07
*** lbragstad has joined #openstack-infra06:08
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/60191606:08
persiaianw: Good afternoon.  I was preparing some project-config updates to register an additional cloud with nodepool based on https://review.openstack.org/#/c/546834/5, and noticed https://review.openstack.org/#/c/601474/4 along the way.  Do I assume correctly that my sensible next action would be to learn why 601474 works, and then model based on that rather than 546834?06:09
*** threestrands has joined #openstack-infra06:13
*** threestrands has quit IRC06:13
*** threestrands has joined #openstack-infra06:13
*** jamesmcarthur has joined #openstack-infra06:13
ianwpersia: you know that Chinese proverb "may you live in interesting times"?  you live in interesting times :)06:14
ianwyeah, probably just base it ontop of 601474 and roughly what's there will be correct06:15
ianwthe older cloud additions won't be useful to look at, because we have transitioned from rolling out the cloud config files from puppet to ansible06:15
ianwhowever, if you read through the comments at the top of https://git.openstack.org/cgit/openstack-infra/system-config/tree/playbooks/templates/clouds it should become clear what's what06:16
ianwthe top of each file06:16
*** jamesmcarthur has quit IRC06:18
*** ihar has quit IRC06:18
*** aojea has joined #openstack-infra06:21
*** pcaruana has joined #openstack-infra06:23
*** jamesmcarthur has joined #openstack-infra06:24
quiquell|roverHello do we now is there is any issue at vexxhost|ca-ymq-1 region ? looks like it takes more time for some jobs06:26
*** jamesmcarthur has quit IRC06:28
*** strigazi has quit IRC06:30
*** jamesmcarthur has joined #openstack-infra06:35
ianwquiquell|rover: nothing reported; http://grafana.openstack.org/d/nuvIH5Imk/nodepool-vexxhost?orgId=1&var-region=vexxhost-ca-ymq-1 looks about normal06:35
*** lbragstad has quit IRC06:36
quiquell|roverianw: ack, thanks06:36
*** jamesmcarthur has quit IRC06:40
*** dpawlik has joined #openstack-infra06:42
ianw#status nb03.o.o has been transitioned into the new linaro london cloud.  hopefully this will stay more reliably attached to zookeeper06:42
openstackstatusianw: unknown command06:42
ianw#status log nb03.o.o has been transitioned into the new linaro london cloud.  hopefully this will stay more reliably attached to zookeeper06:42
openstackstatusianw: finished logging06:42
ianwthis is somewhat a manual rollout - reviews on https://review.openstack.org/601474 appreciated so it gets into the inventory.  but it is building new images now06:44
*** jamesmcarthur has joined #openstack-infra06:46
*** dpawlik has quit IRC06:46
*** jcoufal has joined #openstack-infra06:48
openstackgerritMerged openstack-infra/puppet-nodepool master: Increase timeout on nodepool install  https://review.openstack.org/54681406:50
*** jamesmcarthur has quit IRC06:50
*** jamesmcarthur has joined #openstack-infra06:57
*** roman_g has joined #openstack-infra06:57
*** rcernin has quit IRC06:59
*** jamesmcarthur has quit IRC07:01
*** psachin has quit IRC07:01
*** ginopc has joined #openstack-infra07:06
*** psachin has joined #openstack-infra07:07
*** dpawlik has joined #openstack-infra07:07
*** jamesmcarthur has joined #openstack-infra07:08
*** jamesmcarthur has quit IRC07:12
*** ykarel|away is now known as ykarel07:14
quiquell|roverianw: enqueue time at zuul is very bad, do we have issues ?07:16
*** olivierb has joined #openstack-infra07:17
*** tesseract has joined #openstack-infra07:18
*** jamesmcarthur has joined #openstack-infra07:18
AJaegerianw, frickler, tonyb, as devstack cores, could either of you review this change for devstack-ceph-plugin, please? https://review.openstack.org/#/c/543048 That allows us to have one more Zuul v3 native job - and it updated everywhere...07:22
*** markvoelker has quit IRC07:22
*** markvoelker has joined #openstack-infra07:22
*** jamesmcarthur has quit IRC07:22
tonybAJaeger: done.07:24
AJaegerthanks, tonyb !07:24
*** strigazi has joined #openstack-infra07:25
*** ykarel is now known as ykarel|lunch07:26
*** markvoelker has quit IRC07:27
*** dhinesh_ has quit IRC07:28
*** jamesmcarthur has joined #openstack-infra07:29
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Only append DIB_BOOTLOADER_DEFAULT_CMDLINE to default grub entry  https://review.openstack.org/60193607:32
*** hashar has joined #openstack-infra07:32
*** hashar has joined #openstack-infra07:32
*** jamesmcarthur has quit IRC07:34
*** hashar has quit IRC07:37
*** hashar has joined #openstack-infra07:37
*** jamesmcarthur has joined #openstack-infra07:40
*** jpich has joined #openstack-infra07:42
*** jcoufal has quit IRC07:43
*** jamesmcarthur has quit IRC07:44
*** jpena|off is now known as jpena07:44
*** gwhaley has joined #openstack-infra07:44
*** gwhaley has left #openstack-infra07:44
*** jamesmcarthur has joined #openstack-infra07:50
*** apetrich has joined #openstack-infra07:54
*** jistr|off is now known as jistr07:55
*** jamesmcarthur has quit IRC07:55
*** jamesmcarthur has joined #openstack-infra08:01
*** jamesmcarthur has quit IRC08:06
*** apetrich has quit IRC08:10
*** apetrich has joined #openstack-infra08:11
*** slaweq has joined #openstack-infra08:11
*** jamesmcarthur has joined #openstack-infra08:12
*** slaweq has quit IRC08:15
*** jamesmcarthur has quit IRC08:17
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Avoid double root-marker  https://review.openstack.org/60194608:17
*** ykarel|lunch is now known as ykarel08:19
*** jamesmcarthur has joined #openstack-infra08:23
*** apetrich has quit IRC08:24
*** apetrich has joined #openstack-infra08:25
*** apetrich has quit IRC08:25
*** markvoelker has joined #openstack-infra08:25
*** apetrich has joined #openstack-infra08:26
*** jamesmcarthur has quit IRC08:27
*** apetrich has quit IRC08:27
*** apetrich has joined #openstack-infra08:28
*** apetrich has quit IRC08:29
*** apetrich has joined #openstack-infra08:29
*** Emine has joined #openstack-infra08:30
*** apetrich has quit IRC08:31
*** apetrich has joined #openstack-infra08:32
*** jamesmcarthur has joined #openstack-infra08:33
*** jamesmcarthur has quit IRC08:37
dmelladoo/ Hi AJaeger08:42
AJaegermorning, dmellado !08:42
dmelladoso, we added a dependency on our tempest-plugin08:42
dmelladoon global-requirements08:42
dmelladohttps://review.openstack.org/#/c/580093/08:43
dmelladowhich is not there on stable/queens global-reqs08:43
dmelladohttps://github.com/openstack/requirements/blob/stable/queens/global-requirements.txt08:43
dmelladoeven though the way usually tempest plugins work is that they are branchless08:43
dmelladoand should work with previous versions based on flags08:44
dmelladofor this specific case it wouldn't work08:44
AJaegerand this conflicts now where exactly?08:44
dmelladoso I was wondering how to configure zuul08:44
*** chrisyang_0660 has joined #openstack-infra08:44
*** jamesmcarthur has joined #openstack-infra08:44
dmelladoi.e. https://review.openstack.org/#/c/564113/08:44
dmelladowhich is a backport, but would affect anything on the stable/queens branch as it'd try to load the import on openshift py client08:45
dmelladoso I was wondering if we could do something such using override-checkout08:45
*** apetrich has quit IRC08:45
dmelladoto ensure that for stable/queens the plugin tag would be 0.2.0, which was the one we released alongside queens08:45
*** apetrich has joined #openstack-infra08:46
AJaegerdmellado: I think you need to make the import on openshift py client configurable08:46
dmelladoAJaeger: you mean just like if conf, whatever, import it?08:47
dmelladowell, we could try that08:47
AJaegerdmellado: yes.08:47
AJaegerdmellado: but I'm not a tempest/devstack expert, best ask #openstack-qa for advice08:47
AJaegerdmellado: override-checkout with tag works - but that is a hack ;)08:47
dmelladoAJaeger: will do, but in any case could you check that if this 'hack' would work for now?08:48
dmelladohttps://paste.fedoraproject.org/paste/xuvAJoeLYtAVj7-lxa3KBw08:48
*** jamesmcarthur has quit IRC08:48
dmelladoI was thinking on something like that08:48
AJaegerdmellado: check how etcd is handled in devstack, let me show a link - that was what I was thinking about...08:49
*** apetrich has quit IRC08:49
AJaegerhttp://git.openstack.org/cgit/openstack-dev/devstack/tree/stack.sh#n81908:49
AJaegerdmellado: change line 89 to end with ":", so "... tempest-plug:"08:50
AJaegerdmellado: otherwise should work but not the right solution - thus hack08:50
*** electrofelix has joined #openstack-infra08:51
dmelladoAJaeger: I'll try the workaround just in the meanwhile I fix the other stuff08:51
AJaegerdmellado: and that change should not have branches line, just commit it only to queens branch08:51
AJaegerdmellado: then queens is implicit08:52
AJaegerdmellado: if that won't work, I can't help and suggest #openstack-qa08:52
dmelladoAJaeger: got it, I got the idea from this sahara part08:52
dmelladohttps://github.com/openstack/sahara-tests/blob/master/.zuul.yaml#L66-L7808:52
dmelladothanks!08:52
dmelladowhich is how they handle the stable branches there08:53
AJaegerdmellado: ugly - have to think about this. Let's see what corvus thinks about sahara-tests ^08:54
*** jamesmcarthur has joined #openstack-infra08:55
*** markvoelker has quit IRC08:56
*** jamesmcarthur has quit IRC08:59
*** dtantsur|afk is now known as dtantsur09:05
*** jamesmcarthur has joined #openstack-infra09:06
dmelladoAJaeger: https://review.openstack.org/60195809:09
dmelladoseems like it doesn't like your suggestion about the ;09:09
dmelladoshould I just remove it?09:09
*** jamesmcarthur has quit IRC09:10
*** dpawlik has quit IRC09:11
AJaegerdmellado: checking...09:14
dmelladoAJaeger: I followed another example and it seems to have 'bought' it09:14
AJaegerdmellado: yes, your second version looks fine. Sorry, for wrong advice. Good that Zuul checks this nicely ;)09:15
dmelladoheh, no worries, thanks for your help!09:15
AJaegeryou're welcome, dmellado !09:15
*** jamesmcarthur has joined #openstack-infra09:17
*** jamesmcarthur has quit IRC09:21
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/60191609:25
*** jamesmcarthur has joined #openstack-infra09:27
*** yamamoto has quit IRC09:29
*** jamesmcarthur has quit IRC09:31
*** yamamoto has joined #openstack-infra09:35
*** jamesmcarthur has joined #openstack-infra09:38
*** yamamoto has quit IRC09:41
*** jamesmcarthur has quit IRC09:42
*** yamamoto has joined #openstack-infra09:48
*** jamesmcarthur has joined #openstack-infra09:49
*** hashar is now known as hasharAway09:49
*** d0ugal has quit IRC09:52
*** jamesmcarthur has quit IRC09:53
*** sambetts_ is now known as sambetts|afk09:54
*** pguimaraes has quit IRC09:55
*** pguimaraes has joined #openstack-infra09:55
*** jamesmcarthur has joined #openstack-infra09:59
*** jamesmcarthur has quit IRC10:04
*** jamesmcarthur has joined #openstack-infra10:10
*** mtreinish has quit IRC10:13
*** jamesmcarthur has quit IRC10:15
*** jamesmcarthur has joined #openstack-infra10:21
*** priteau has joined #openstack-infra10:24
*** jamesmcarthur has quit IRC10:26
*** priteau has quit IRC10:27
*** udesale has quit IRC10:30
*** jamesmcarthur has joined #openstack-infra10:32
*** dhinesh has joined #openstack-infra10:35
*** dhinesh_ has joined #openstack-infra10:35
*** jamesmcarthur has quit IRC10:36
*** priteau has joined #openstack-infra10:37
*** dhinesh has quit IRC10:39
*** d0ugal has joined #openstack-infra10:41
*** rossella_s has quit IRC10:42
*** jamesmcarthur has joined #openstack-infra10:43
*** rossella_s has joined #openstack-infra10:44
*** rossella_ has joined #openstack-infra10:44
*** d0ugal has quit IRC10:46
*** d0ugal has joined #openstack-infra10:47
*** jamesmcarthur has quit IRC10:47
*** rossella_ has quit IRC10:49
*** rossella_s has quit IRC10:49
*** rossella_s has joined #openstack-infra10:50
*** yamamoto has quit IRC10:53
*** jamesmcarthur has joined #openstack-infra10:53
*** markvoelker has joined #openstack-infra10:54
*** jamesmcarthur has quit IRC10:58
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: remove job settings for Quality Assurance repositories  https://review.openstack.org/60103211:02
*** pguimaraes has quit IRC11:04
*** jamesmcarthur has joined #openstack-infra11:04
*** vivsoni_ has quit IRC11:05
*** vivsoni has joined #openstack-infra11:06
*** vivsoni_ has joined #openstack-infra11:06
*** vivsoni has quit IRC11:06
*** jamesmcarthur has quit IRC11:08
*** pbourke has quit IRC11:09
*** pbourke has joined #openstack-infra11:11
AJaegerdhellmann: want to WIP this again? ^11:12
*** reedipb has joined #openstack-infra11:18
*** dhinesh_ has quit IRC11:19
reedipbhi, any suggestions if anyone has ever added Functional Tests to tox-cover ?11:19
*** rossella_s has quit IRC11:19
*** longkb has quit IRC11:20
*** rossella_s has joined #openstack-infra11:22
*** markvoelker has quit IRC11:28
*** apetrich has joined #openstack-infra11:28
*** rossella_s has quit IRC11:29
*** yamamoto has joined #openstack-infra11:31
*** yamamoto has quit IRC11:31
*** yamamoto has joined #openstack-infra11:32
*** yamamoto has quit IRC11:32
*** dave-mccowan has joined #openstack-infra11:33
*** rossella_s has joined #openstack-infra11:34
*** jpena is now known as jpena|lunch11:44
*** jamesmcarthur has joined #openstack-infra11:45
*** ldnunes has joined #openstack-infra11:47
*** d0ugal has quit IRC11:47
openstackgerritGhanshyam Mann proposed openstack-infra/project-config master: Follow devstack-plugin-ceph job rename  https://review.openstack.org/60201111:52
*** ijw has joined #openstack-infra11:52
*** yamamoto has joined #openstack-infra11:53
*** yamamoto has quit IRC11:53
*** annp has quit IRC11:53
*** yamamoto has joined #openstack-infra11:54
*** ijw has quit IRC11:57
*** kbaikov[m] has joined #openstack-infra11:59
*** jtomasek has joined #openstack-infra12:01
*** jtomasek has quit IRC12:01
*** nicolasbock has joined #openstack-infra12:02
*** psachin has quit IRC12:03
dhellmannAJaeger : done, thanks12:10
openstackgerritGhanshyam Mann proposed openstack-infra/project-config master: Follow devstack-plugin-ceph job rename  https://review.openstack.org/60201112:11
*** udesale has joined #openstack-infra12:21
*** markvoelker has joined #openstack-infra12:25
*** zigo has left #openstack-infra12:27
*** zigo has joined #openstack-infra12:28
*** jtomasek has joined #openstack-infra12:30
*** lucasagomes has joined #openstack-infra12:33
*** rlandy has joined #openstack-infra12:34
*** jtomasek has quit IRC12:35
*** tpsilva has joined #openstack-infra12:40
*** yamamoto has quit IRC12:42
openstackgerritMerged openstack-infra/system-config master: Remove puppet nodepool credentials  https://review.openstack.org/60146512:43
*** ansmith has joined #openstack-infra12:43
*** pguimaraes has joined #openstack-infra12:44
*** priteau has quit IRC12:45
*** cshastri has quit IRC12:45
*** slaweq has joined #openstack-infra12:46
*** rkukura has quit IRC12:48
*** priteau has joined #openstack-infra12:48
*** jpena|lunch is now known as jpena12:49
*** ansmith has quit IRC12:50
*** priteau has quit IRC12:54
*** camunoz has joined #openstack-infra12:57
*** markvoelker has quit IRC12:58
*** felipemonteiro has joined #openstack-infra13:01
Shrewsianw: +3'd your linaro changes13:01
*** yamamoto has joined #openstack-infra13:02
*** ansmith has joined #openstack-infra13:03
*** kgiusti has joined #openstack-infra13:03
*** agopi|brb has quit IRC13:03
*** reedipb has quit IRC13:06
*** eharney has joined #openstack-infra13:06
*** yamamoto has quit IRC13:07
*** slaweq has quit IRC13:08
*** d0ugal has joined #openstack-infra13:09
*** quiquell|rover has quit IRC13:11
*** ykarel has quit IRC13:11
*** jtomasek has joined #openstack-infra13:13
*** ykarel has joined #openstack-infra13:18
*** eharney has quit IRC13:20
*** dpawlik has joined #openstack-infra13:20
*** jtomasek has quit IRC13:22
openstackgerritMerged openstack-infra/system-config master: Add Linaro London cloud  https://review.openstack.org/60147413:23
AJaegerdhellmann: 598400 is ready, I'm rebasing to resolve merge conflict.13:24
*** threestrands has quit IRC13:24
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: remove job settings for User Committee repositories  https://review.openstack.org/59840013:25
*** eernst has joined #openstack-infra13:29
*** agopi|brb has joined #openstack-infra13:29
openstackgerritTrinh Nguyen proposed openstack-infra/project-config master: Remove python-fenixclient template  https://review.openstack.org/60203213:30
*** kjackal has quit IRC13:30
*** kjackal has joined #openstack-infra13:31
*** ykarel_ has joined #openstack-infra13:34
*** ykarel has quit IRC13:36
*** agopi|brb is now known as agopi13:39
*** hasharAway has quit IRC13:44
*** yamamoto has joined #openstack-infra13:45
*** priteau has joined #openstack-infra13:48
*** priteau has quit IRC13:57
*** zul has quit IRC14:00
*** markvoelker has joined #openstack-infra14:07
*** hongbin has quit IRC14:07
*** ykarel_ is now known as ykarel|away14:12
*** jtomasek has joined #openstack-infra14:13
*** bobh has joined #openstack-infra14:13
*** udesale_ has joined #openstack-infra14:13
*** udesale has quit IRC14:16
*** ykarel|away has quit IRC14:17
logan-Good morning, will someone add me to the new limestone-ci-cloud-core group please?14:17
*** sthussey has joined #openstack-infra14:19
*** markvoelker has quit IRC14:20
*** markvoelker has joined #openstack-infra14:20
*** ginopc has quit IRC14:21
*** eharney has joined #openstack-infra14:22
*** zul has joined #openstack-infra14:22
*** ginopc has joined #openstack-infra14:22
*** jamesmcarthur has quit IRC14:24
*** jamesmcarthur_ has joined #openstack-infra14:24
*** jamesmcarthur_ has quit IRC14:25
*** markvoelker has quit IRC14:25
*** jamesmcarthur has joined #openstack-infra14:25
fungilogan-: looks like you were the author of https://review.openstack.org/601814 which added the acl to create that group, so i have now added you as the initial member for https://review.openstack.org/#/admin/groups/limestone-ci-cloud-core14:26
*** felipemonteiro has quit IRC14:26
*** jiapei has joined #openstack-infra14:27
*** pguimaraes has quit IRC14:27
*** olivierb has quit IRC14:28
*** dhajare has quit IRC14:28
*** jamesmcarthur has quit IRC14:30
*** eernst has quit IRC14:30
*** felipemonteiro has joined #openstack-infra14:31
*** markvoelker has joined #openstack-infra14:34
clarkbFor those of us at the PTG the infra room is clear creek which is in the lower level near the reg desk. See you there14:35
clarkblikely to get started a little after 9 once we have settled in14:36
*** jamesmcarthur has joined #openstack-infra14:37
*** markvoelker has quit IRC14:37
*** markvoelker has joined #openstack-infra14:37
fungii'm meeting the release team first thing, and then dhellmann booked a room to talk about some docs publication stuff at 10am, but i expect to hit the infra room after that14:38
*** felipemonteiro has quit IRC14:38
*** sshnaidm|afk has quit IRC14:40
pabelangerclarkb: ack, do you mind sharing etherpads, as you create them?14:41
*** markvoelker has quit IRC14:42
*** slaweq has joined #openstack-infra14:43
*** slagle has joined #openstack-infra14:44
logan-Thanks fungi14:44
clarkbpabelanger: can do14:44
clarkbpabelanger: my hunch is (that at least for the first day) we will probably be dealing with changes more than etherpads14:44
*** jtomasek has quit IRC14:45
pabelangerclarkb: understood14:45
*** sshnaidm|afk has joined #openstack-infra14:46
*** lbragstad has joined #openstack-infra14:47
clarkbhttps://etherpad.openstack.org/p/infra-ptg-denver-2018 is the top level etherpad. I expect that (especially with fungi not being in the room to start) that we will get going with the config mgmt updates, then see where we end up there before picking off the other topics tomorrow14:47
clarkbbut was hoping to discuss this with the room this morning :)14:47
*** markvoelker has joined #openstack-infra14:48
pabelangerack14:48
*** jamesmcarthur has quit IRC14:51
*** jamesmcarthur has joined #openstack-infra14:52
*** jtomasek has joined #openstack-infra14:52
openstackgerritBenoît Bayszczak proposed openstack-infra/zuul master: replace dict.update by a dict merge in zuul_return  https://review.openstack.org/60205414:53
*** bobh has quit IRC14:53
*** armax has joined #openstack-infra14:54
*** jangutter has joined #openstack-infra14:54
AJaegerconfig-core, please review https://review.openstack.org/601190 and these two python3-first changes: https://review.openstack.org/#/c/598400 and https://review.openstack.org/#/c/59870914:54
*** nicolasbock has quit IRC14:56
*** jamesmcarthur has quit IRC14:56
*** ykarel has joined #openstack-infra14:57
*** jamesmcarthur has joined #openstack-infra14:58
fungii'll try to also pop into clear creek between 9:30 and 1014:58
*** eernst has joined #openstack-infra14:59
*** nicolasbock has joined #openstack-infra14:59
*** ihar has joined #openstack-infra14:59
clarkbAJaeger: that last one is still WIP by dhellmann14:59
*** felipemonteiro has joined #openstack-infra14:59
AJaegerclarkb: I know - but I expect dhellmann to double check the list and do a celebration dance any second now ;)15:00
clarkbAJaeger: ok15:00
AJaegerThe final puppet import job merged a minute ok. Thanks tobias-urdin for pushing these through15:00
AJaeger(minute ok -> minute ago)15:01
dhellmannAJaeger , clarkb : I removed my WIP15:01
clarkbyup approved15:01
AJaegerdhellmann: we missed your dance ;)15:01
AJaegerthanks, clarkb15:01
*** efried has joined #openstack-infra15:01
*** priteau has joined #openstack-infra15:01
dhellmannAJaeger : I hadn't noticed it was ready, so thanks for the ping15:02
*** mriedem has joined #openstack-infra15:02
AJaegerdhellmann: I just saw the final change merging...15:02
*** jamesmcarthur has quit IRC15:02
*** holser|ptg has joined #openstack-infra15:03
*** markvoelker has quit IRC15:03
*** jamesmcarthur has joined #openstack-infra15:03
openstackgerritLogan V proposed openstack-infra/project-config master: Fix limestone-ci-cloud acl typo  https://review.openstack.org/60205715:03
*** markvoelker has joined #openstack-infra15:03
*** markvoelker has quit IRC15:03
*** markvoelker has joined #openstack-infra15:04
openstackgerritMerged openstack-infra/project-config master: remove job settings for User Committee repositories  https://review.openstack.org/59840015:04
*** e0ne has joined #openstack-infra15:04
AJaegerlogan-: I'll +3 602057 as single core - sorry for not catching that earlier.15:05
AJaegerconfig-core, FYI ^15:05
*** jaosorior has joined #openstack-infra15:05
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy-dashboard-dsvm-selenium-package  https://review.openstack.org/60119015:06
*** bnemec has joined #openstack-infra15:07
openstackgerritMerged openstack-infra/project-config master: remove job settings for Puppet OpenStack repositories  https://review.openstack.org/59870915:08
*** gfidente has joined #openstack-infra15:08
logan-AJaeger: no worries, thank you!15:08
*** jamesmcarthur_ has joined #openstack-infra15:08
*** priteau has quit IRC15:09
clarkbpabelanger: yup that is the basic schedule we are going with. Config mgmt things today, likely to generate changes then tomorrow will be more discussion related and etherpad driven15:11
cmurphyclarkb: how is storyboard-dev doing? i can't seem to reach it15:11
cmurphyi don't want diablo_rojo to kill me15:11
clarkbcmurphy: server host is up but not apache15:12
clarkbthe python process is running too15:12
clarkblooks like puppet hasn't run there according to syslog15:12
clarkbfungi: ^ do you know why that may be15:12
*** jamesmcarthur has quit IRC15:13
clarkbpabelanger: currently writing a list of known issues with config mgmt updates, I'll get that transcribed to an etherpad for those of you following along remotely15:13
*** priteau has joined #openstack-infra15:13
clarkbpabelanger: https://etherpad.openstack.org/stein-infra-ptg-config-mgmt-updates15:15
* cmurphy follows15:15
*** tosky has joined #openstack-infra15:17
pabelangersame15:17
*** jtomasek has quit IRC15:19
*** jtomasek has joined #openstack-infra15:19
*** aojea has quit IRC15:20
*** jangutter_ has joined #openstack-infra15:21
*** jangutter has quit IRC15:21
*** dpawlik has quit IRC15:22
*** felipemonteiro has quit IRC15:22
*** slaweq has quit IRC15:22
openstackgerritMerged openstack-infra/project-config master: Fix limestone-ci-cloud acl typo  https://review.openstack.org/60205715:23
*** jrist has joined #openstack-infra15:23
*** slaweq has joined #openstack-infra15:24
*** bobh has joined #openstack-infra15:25
*** d0ugal has quit IRC15:28
*** reedipb has joined #openstack-infra15:29
*** jamesmcarthur_ has quit IRC15:32
*** jamesmcarthur has joined #openstack-infra15:32
*** ykarel is now known as ykarel|away15:33
*** claudiub has joined #openstack-infra15:36
*** jamesmcarthur has quit IRC15:36
*** jamesmcarthur has joined #openstack-infra15:37
*** dhinesh has joined #openstack-infra15:41
*** dhinesh has quit IRC15:42
*** dhinesh has joined #openstack-infra15:42
*** dhinesh has quit IRC15:42
*** dhinesh has joined #openstack-infra15:43
fungiclarkb: cmurphy: [Wed Sep 12 00:45:29.443105 2018] [mpm_event:notice] [pid 16125:tid 140423630845824] AH00491: caught SIGTERM, shutting down15:44
openstackgerritSteve Kowalik proposed openstack-infra/zuul master: Correctly show remaining time as unknown  https://review.openstack.org/60146215:46
*** rabel has joined #openstack-infra15:46
rabelhi. one of my changes was merged a month ago, but the referenced bug in launchpad was not automatically changed: https://review.openstack.org/#/c/578843/ could someone help me with that?15:47
*** dhinesh has quit IRC15:47
clarkbrabel: the bug supervisor is set to adrian otto and does not include our bot account so it can't reassign or change bug state to closed15:48
fungiclarkb: cmurphy: Sep 12 00:45:29 storyboard-dev puppet-user[30153]: (/Stage[main]/Httpd/Service[httpd]) AH00526: Syntax error on line 3 of /etc/apache2/sites-enabled/50-storyboard-dev.openstack.org.conf: ServerAdmin takes one argument, The email address of the server administrator15:48
*** ykarel|away has quit IRC15:48
rabelclarkb: ok, thanks15:48
fungiclarkb: cmurphy: so i suppose we have a substitution failure/empty variable?15:48
AJaegerrabel: I think I can close it for you - can't you?15:49
clarkbrabel: https://launchpad.net/~nova-bugs/+members#active shows the openstack infra ccount in it which is how nova has solved this15:49
clarkbfungi: cmurphy maybe missed puppet parser fix?15:49
AJaegerrabel: NO, I cannot ;(15:49
AJaegerrabel: so, tell adrian otto, please15:49
fungithe 50-storyboard-dev.openstack.org.conf line for ServerAdmin indeed is lacking a value15:49
rabelAJaeger, I can. I was just wondering why it wasn't closed automatically15:49
*** felipemonteiro has joined #openstack-infra15:50
cmurphyclarkb: okay you should be able to roll back the future parser config and puppet should set the file back the way it was15:50
*** dpawlik has joined #openstack-infra15:50
cmurphyone sec15:51
*** Emine has quit IRC15:51
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Revert "Turn on the future parser for storyboard-dev"  https://review.openstack.org/60206915:52
cmurphyclarkb: ^15:52
cmurphyfungi: ^15:53
fungithanks cmurphy!15:53
cmurphynp15:54
cmurphyi'll work on fixing it for real in a bit15:54
cmurphyprobably scope.lookupvar fun15:54
fungino rush. just glad you caught it15:54
*** dpawlik has quit IRC15:55
*** anteaya has joined #openstack-infra15:55
*** pcaruana has quit IRC15:55
*** dklyle has joined #openstack-infra15:58
*** hashar has joined #openstack-infra16:01
*** d0ugal has joined #openstack-infra16:01
*** ykarel|away has joined #openstack-infra16:02
*** josephrsandoval has joined #openstack-infra16:04
*** adriant has quit IRC16:05
*** bobh has quit IRC16:06
*** adriant has joined #openstack-infra16:06
*** bobh has joined #openstack-infra16:06
*** dklyle has quit IRC16:11
*** bhavikdbavishi has joined #openstack-infra16:11
*** dklyle has joined #openstack-infra16:11
*** jpich has quit IRC16:13
clarkbit looks like ansible sets debug logging level globally in ansible.utils.display at import time16:15
clarkbopenstacksdk is then setting less verbose logging for its logging items, but I think that may not work because the rootis already set to debug? so its basically a noop to try and log less elsewhere16:15
*** diablo_rojo has joined #openstack-infra16:16
*** ramishra has quit IRC16:16
openstackgerritMerged openstack-infra/system-config master: Install ansible 2.7.0rc1 on bridge  https://review.openstack.org/60086116:17
*** ramishra has joined #openstack-infra16:17
*** yamamoto has quit IRC16:17
*** yamamoto has joined #openstack-infra16:17
clarkbactually, I think it may work to set the openstack spceific logging to a lower level, problem is we don't decrease the level for urllib3 and keystoneauth16:18
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Allow Zuul to log into bridge  https://review.openstack.org/60208116:20
*** sshnaidm|afk is now known as sshnaidm|ptg16:23
clarkbremote https://review.openstack.org/60208516:23
clarkbmordred: ^ that is an sdk change to fix the ansible logging. Not sure if it is quite right in the context of openstacksdk though16:23
*** dtantsur is now known as dtantsur|afk16:24
*** jaosorior has quit IRC16:28
*** yamamoto has quit IRC16:28
*** e0ne has quit IRC16:28
*** josephrsandoval has quit IRC16:29
*** dkehn has quit IRC16:29
*** Bhujay has joined #openstack-infra16:29
clarkbpabelanger: ^ if following along corvus' change there is step 0 in doing CD with zuul, and my openstacksdk change above is a clenaup for ansible logs using the openstack inventory plugin (both linked to from the etherpad with a little more context)16:30
*** pguimaraes has joined #openstack-infra16:31
cmurphyclarkb: is infra room still talking about config mgmt or did you move on?16:32
*** Goneri has joined #openstack-infra16:32
prometheanfirecan we get some eyes on this DIB fix, looked good to me and ian asked (sorta) https://review.openstack.org/60193616:32
pabelangerclarkb: looking16:32
clarkbcmurphy: we are still talking config mgmt, I expect we'll be working through that for most of today, then tomorrow will go through the other topics on the list (in part due to ttx and other's availability)16:32
cmurphyk i'll come back16:33
*** dkehn has joined #openstack-infra16:34
*** e0ne has joined #openstack-infra16:35
*** felipemonteiro has quit IRC16:35
*** rkukura has joined #openstack-infra16:35
StevenKprometheanfire: Looking16:36
*** jaosorior has joined #openstack-infra16:36
*** dhajare has joined #openstack-infra16:36
*** ginopc has quit IRC16:37
*** dhinesh has joined #openstack-infra16:37
prometheanfireStevenK: thanks16:38
*** jtomasek has quit IRC16:39
dhellmannAJaeger : we're trying to figure out how the language builds for openstack-manuals work, can you help us find a starting point?16:39
*** e0ne has quit IRC16:40
fungilooking at http://logs.openstack.org/84/842f1d0d06ee270b76b5d020dbb7df78f0f1bef8/post/publish-openstack-manuals/bbd8ffb/ and not seeing any indication of language-specific builds16:40
StevenKdhellmann: I can come help if you wish16:40
dhellmannStevenK : we're in ballroom c16:40
StevenKdhellmann: On my way16:40
*** jento has joined #openstack-infra16:40
*** e0ne has joined #openstack-infra16:41
*** gyee has joined #openstack-infra16:41
*** jtomasek has joined #openstack-infra16:41
*** felipemonteiro has joined #openstack-infra16:42
openstackgerritColleen Murphy proposed openstack-infra/puppet-storyboard master: Fix undef in vhost templates  https://review.openstack.org/60209216:42
cmurphyclarkb: ^ that should fix it16:42
*** jamesmcarthur has quit IRC16:43
*** jamesmcarthur_ has joined #openstack-infra16:43
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Revert "Revert "Turn on the future parser for storyboard-dev""  https://review.openstack.org/60209316:43
*** e0ne has quit IRC16:43
AJaegerdhellmann: tox -e checklang16:45
dhellmannAJaeger : does that build html output?16:45
AJaegerdhellmann: yes16:45
dhellmannand something publishes that?16:45
AJaegertox -e publishlang is the command - and then we publish from publish-docs directory16:45
clarkbmordred: (and others) http://paste.openstack.org/show/729978/ diff to hack ansible logging fix for openstacksdk into our local openstack.py inventory plugin while we wait for a openstacksdk release16:46
clarkbif that looks good we'll apply it to the actual plugin16:46
AJaegerdhellmann: so, instead of publishing from doc/build/html we publish content of publish-docs/16:46
dhellmanngot it16:46
AJaegerdhellmann: do you need more details?16:46
dhellmannI think we've found what we need -- we expected it to all be in 1 job but the translations are published from a separate job16:46
dhellmannpublish-openstack-manuals-lang16:47
toskyclarkb: hi, we were talking about using the lxc driver on the gates; apart from setting LIBVIRT_TYPE to lxc and using a raw image, is there anything else to change?16:47
toskyclarkb: or better, are there examples of jobs using it?16:47
AJaegerdhellmann: yes, we use two jobs - runtime is too long otherwise...16:47
fungiAJaeger: thanks, i didn't realize there were two publish jobs16:47
*** dklyle has quit IRC16:47
clarkbtosky: johnsom had apparently tried it in the past ( and that had netowrking problems with octavia requirements) I would check with octavia/johnsom16:47
clarkbthey may have exampls16:47
toskyoki, thanks16:48
AJaegerfungi, dhellmann, so for both build and publish it's two steps: One job for english, one job for all translations16:48
AJaegerfungi, dhellmann, I need to step out for a bit - will read backscroll and answer. If you have any quick questions, happy to wait a few minutes...16:48
*** josephrsandoval has joined #openstack-infra16:49
*** camunoz has quit IRC16:49
* AJaeger will be back in a bit16:50
*** pcaruana has joined #openstack-infra16:51
*** markvoelker has quit IRC16:51
*** e0ne has joined #openstack-infra16:51
*** jpena is now known as jpena|off16:52
*** dklyle has joined #openstack-infra16:52
*** udesale_ has quit IRC16:54
*** josephrsandoval has quit IRC16:57
logan-will https://review.openstack.org/#/c/602057/ be applied automatically? i'm not sure if/what the schedule is but it has been merged for a couple hours and has not appeared in the config yet https://git.openstack.org/cgit/openstack/limestone-ci-cloud/log/?h=refs/meta/config16:58
johnsomtosky Let me know if you get this working. We had two problems: 1. failures hot plugging network ports. 2. Config drive stopped working.16:59
toskyjohnsom: oh, uh - do you have any (probably abandoned) patch which was testing this?17:00
*** Swami has joined #openstack-infra17:00
*** bobh has quit IRC17:00
*** bnemec has quit IRC17:01
*** bnemec has joined #openstack-infra17:01
*** yamamoto has joined #openstack-infra17:03
*** markvoelker has joined #openstack-infra17:04
*** camunoz has joined #openstack-infra17:04
*** Swami has quit IRC17:05
corvusmordred: https://github.com/ansible/ansible/blob/devel/lib/ansible/plugins/inventory/__init__.py#L29317:06
*** jungleboyj has joined #openstack-infra17:08
jungleboyjfungi:  Where did storyboard-dev.openstack.org go to?17:08
johnsomtosky We last tried over a year ago. The dev resource is no longer working on OpenStack. So I have high hopes it is fixed. There were something like 28 lxc releases in between17:08
toskyjohnsom: but it does not mean that the last version of lxc is used on the gates17:09
*** dkehn has quit IRC17:09
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: web: add /{tenant}/projects and /{tenant}/project/{project} routes  https://review.openstack.org/55097917:09
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: web: add /{tenant}/pipelines route  https://review.openstack.org/54152117:09
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: web: add /{tenant}/labels route  https://review.openstack.org/55397917:09
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: web: add /{tenant}/nodes route  https://review.openstack.org/55399817:09
openstackgerritJoshua Hesketh proposed openstack-infra/zuul master: scheduler: add job's parent name to the rpc job_list method  https://review.openstack.org/57347317:09
johnsomtosky Correct. My summary, we tried a long time ago and failed, but would really like to use it if it is working17:10
*** Swami has joined #openstack-infra17:11
johnsomtosky I think this was where it was left for us: https://review.openstack.org/#/c/453237/17:11
toskyjohnsom: thanks17:11
johnsomtosky I don't think he got far with that17:12
*** bobh has joined #openstack-infra17:13
openstackgerritMerged openstack-infra/system-config master: Revert "Turn on the future parser for storyboard-dev"  https://review.openstack.org/60206917:13
openstackgerritJohn Studarus proposed openstack-infra/project-config master: upgrading the control plane - 90 minutes required  https://review.openstack.org/60210017:16
*** eernst has quit IRC17:16
openstackgerritClark Boylan proposed openstack-infra/system-config master: Add job to run playbook on bridge.o.o  https://review.openstack.org/60210117:19
*** lbragstad has quit IRC17:22
*** dkehn has joined #openstack-infra17:24
*** graphene has quit IRC17:25
openstackgerritMerged openstack-infra/system-config master: Move the !ci-backup play next to the rest of the servers  https://review.openstack.org/60083317:26
*** lbragstad has joined #openstack-infra17:26
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Add job to run playbook on bridge.o.o  https://review.openstack.org/60210117:27
*** graphene has joined #openstack-infra17:27
*** d0ugal has quit IRC17:28
*** graphene has quit IRC17:29
openstackgerritJoshua Hesketh proposed openstack-infra/system-config master: Add zuul_reconfigure playbook  https://review.openstack.org/60210317:29
*** graphene has joined #openstack-infra17:31
clarkbmordred: updated diff http://paste.openstack.org/show/729982/ and https://review.openstack.org/602085 updated with stevedore17:33
AJaegerfungi, dhellmann - I'm back again and available for questions if needed...17:34
AJaegerfungi, dhellmann, do you have an etherpad?17:34
openstackgerritMerged openstack-infra/system-config master: Allow Zuul to log into bridge  https://review.openstack.org/60208117:36
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Replace constructed groups inventory with yaml  https://review.openstack.org/60210517:37
cmurphyhttps://review.openstack.org/602092 and https://review.openstack.org/602093 are ready to merge now that storyboard-dev is fixed17:38
cmurphyfungi: ^17:38
cmurphymordred: ^17:39
openstackgerritMonty Taylor proposed openstack-infra/system-config master: Replace constructed groups inventory with yaml  https://review.openstack.org/60210517:41
*** dkehn has quit IRC17:44
*** Bhujay has quit IRC17:45
openstackgerritMohammed Naser proposed openstack-infra/system-config master: Add missing quote to alpine cache  https://review.openstack.org/60211317:45
openstackgerritMohammed Naser proposed openstack-infra/system-config master: Add LXC COPR cache  https://review.openstack.org/60211417:45
*** dkehn has joined #openstack-infra17:46
corvusmordred, AJaeger: zuul docs publishing broke recently, i suspect https://review.openstack.org/59451317:46
AJaegercorvus: I'll look into it - do you have a log file around?17:46
corvusAJaeger: http://logs.openstack.org/13/13a2df3f1299b3057c6172d7257ff467f94aae76/post/publish-zuul-docs/b363efc/job-output.txt.gz17:46
corvuslast success was 2018-08-21T04:31:2517:47
corvusAJaeger: why change the zuul jobs?  it's not a pti project...17:47
openstackgerritMerged openstack-infra/system-config master: Remove !ci-backup play  https://review.openstack.org/60083717:48
AJaegercorvus: ok, found the problem and can propose a change...17:48
AJaegercorvus: we changed everything to tox -e docs running. If you want to go back, I can revert as well.17:48
*** tesseract has quit IRC17:49
mordredAJaeger: I could go either way - but I'm interested to see the fix17:50
AJaegermordred: fix coming - we use wrong bindep environment17:50
mordredAJaeger: cool17:50
AJaegerhttp://logs.openstack.org/13/13a2df3f1299b3057c6172d7257ff467f94aae76/post/publish-zuul-docs/b363efc/job-output.txt.gz#_2018-09-11_22_17_59_997243 shows problem - dot is not installed17:51
mordredAJaeger: yah - I just was confused as to why the doc profile wasn't getting picked up ... so if you've found where that is, I'm interested to see it17:51
*** slagle has quit IRC17:51
*** jtomasek has quit IRC17:52
*** ramishra has quit IRC17:53
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Set bindep profile for tox-docs publish jobs  https://review.openstack.org/60211717:54
AJaegermordred: (untested) ^17:54
*** hongbin has joined #openstack-infra17:56
corvusAJaeger, mordred: https://review.openstack.org/594513 caused zuul to depend on openstack-zuul-jobs.  i was hoping not to do that.  that may make things more difficult when we split zuul into its own tenant.17:56
*** agopi is now known as agopi|brb17:57
*** markvoelker has quit IRC17:57
*** jrist has quit IRC17:57
*** markvoelker has joined #openstack-infra17:57
*** sshnaidm|ptg has quit IRC17:58
AJaegercorvus: which role exactly do we drag in that we didn't before?17:58
*** dave-mccowan has quit IRC17:59
corvusAJaeger: looks like the project-template is in openstack-zuul-jobs17:59
AJaegercorvus: happy to help changing that ;)17:59
AJaegercorvus: I wonder whether we need the roles: openstack-infra/openstack-zuul-jobs line at all (but that was not changed here)18:00
*** agopi|brb has quit IRC18:01
*** bhavikdbavishi has quit IRC18:01
*** dkehn has quit IRC18:01
*** jamesmcarthur_ has quit IRC18:01
*** markvoelker has quit IRC18:02
AJaegercorvus: right now zuul-jobs has no templates - is there a special reason for that?18:02
*** felipemonteiro has quit IRC18:02
AJaegerotherwise we can move build-tox-docs there... Will be some dance with renaming but not impossible ;)18:02
*** ykarel|away has quit IRC18:03
*** ijw has joined #openstack-infra18:03
corvusAJaeger: i think we may want to continue to avoid templates in zuul-jobs, since they require knowledge of pipeline names.18:04
*** TimO__ has joined #openstack-infra18:04
corvusAJaeger: i also don't know about the roles line18:04
AJaegerso, should I revert using build-tox-docs template and use the individual jobs in nodepool, zuul-sphinx, zuul? I would still prefer to use build-tox-docs job.18:05
*** dave-mcc_ has joined #openstack-infra18:06
AJaegercorvus: prepare-infra-docs-for-afs role is in openstack-zuul-jobs18:07
fungiAJaeger: thanks, it was mostly just me confused about the fact that the manuals were published in two steps (default language in one and then all translations in a second job)18:08
AJaegerfungi: no worries... do you want to update .zuul.yaml in openstack-manuals to make that clearer? Or where did you look?18:09
*** holser|ptg has quit IRC18:09
fungiAJaeger: it was simply an assumption on my part. i was looking at the builds dashboard and picking the regular publish job logs, not noticing the separate lang one18:10
openstackgerritMerged openstack-infra/project-config master: upgrading the control plane - 90 minutes required  https://review.openstack.org/60210018:11
AJaegerfungi, then only an update to description might have helped ;)18:11
AJaegermordred, corvus, should I revert using build-tox-docs template and use the individual jobs in nodepool, zuul-sphinx, zuul? I would still prefer to use build-tox-docs job instead of build-sphinx.18:12
corvusAJaeger: i don't really want to change things more than necessary right now :)18:13
*** caphrim007 has joined #openstack-infra18:14
AJaegercorvus: that works for me ;) So, I leave the template in? Would be a small change...18:14
fungiAJaeger: i was trying to determine what additional load we were likely to incur by adding the additional build-sphinx invocations for all languages for html and pdf in the default publish job projects are using, and wanted to look at the manuals job for a point of comparison18:16
AJaegerfungi, it's quite a load - we had nova releasenotes run longer than 40 mins...18:17
*** diablo_rojo has quit IRC18:17
AJaegerthere we build automatically for all translated languages18:17
*** camunoz has quit IRC18:17
*** hongbin has quit IRC18:17
*** e0ne has quit IRC18:18
fungithe request ianychoi had was to start doing pdf builds (including translated pdfs) for all projects, so we were attempting to work out the logistics for that18:18
AJaegerwe would also need to add some logic to invoke build-sphinx only for translated languages - there's a script that does this for releasenotes, this needs to be shared.18:18
*** eernst has joined #openstack-infra18:18
*** dhajare has quit IRC18:18
mnaserinfra-root: can someone look into this https://review.openstack.org/#/c/602113/18:19
AJaegerfungi: good call - I know of the request and I'm aware it's tricky18:19
mnaserit's causing a lot of timed out failing jobs :(18:19
mnaserwell, the stack there :p18:19
clarkbmnaser: note that the copr change won't help their flakyness when the cache is not valid (apache must double check with the backend before serving existing content in that case)18:20
AJaegermnaser: how bad is it? should we promote 602113?18:20
clarkbshould be more reliable over all just not completely reliable18:20
mnaserclarkb: hmm, well for the other projects that have been as unreliable as this one, it seems to have improved18:20
mnaserfor example: dns would fail often18:21
mnaserso this would eliminate the dns failure i guess18:21
mnaserAJaeger: i dont think that it needs promotion but something that's just comes and goes all the time18:21
openstackgerritAndreas Jaeger proposed openstack-infra/zuul master: Use tox-docs directly  https://review.openstack.org/60213118:21
*** zul has quit IRC18:21
clarkbmnaser: only when the cache is valid, which is likely more often than in the current case18:21
AJaegercorvus: that's the simple change - but if you don't want it, I can abandon ^ (602131)18:22
mnaserclarkb: yeah, much more18:22
mnaserclarkb: i can respin quickly now18:22
*** gfidente has quit IRC18:23
openstackgerritMohammed Naser proposed openstack-infra/system-config master: Add LXC COPR cache  https://review.openstack.org/60211418:23
mnaserclarkb: changed the url up18:23
*** tosky has quit IRC18:24
*** dkehn has joined #openstack-infra18:24
clarkbmnaser: thanks18:24
*** dklyle has quit IRC18:24
*** rkukura has quit IRC18:26
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Autohold on timeout  https://review.openstack.org/60213418:26
openstackgerritJoshua Hesketh proposed openstack-infra/system-config master: Use host groups for zuul playbooks  https://review.openstack.org/60213518:27
*** eernst has quit IRC18:32
*** slaweq has quit IRC18:32
*** agopi|brb has joined #openstack-infra18:33
*** camunoz has joined #openstack-infra18:33
*** agopi|brb is now known as agopi18:33
*** mriedem has quit IRC18:33
*** jangutter_ has quit IRC18:34
*** priteau has quit IRC18:34
*** eernst has joined #openstack-infra18:35
*** nicolasbock has quit IRC18:35
*** efried has quit IRC18:38
openstackgerritMerged openstack-infra/project-config master: Set bindep profile for tox-docs publish jobs  https://review.openstack.org/60211718:38
*** bobh has quit IRC18:39
*** bobh has joined #openstack-infra18:40
*** lbragstad has quit IRC18:41
*** graphene has quit IRC18:46
openstackgerritFrank Kloeker proposed openstack-infra/project-config master: Add patch submitting for project doc translation  https://review.openstack.org/58100018:47
*** pcaruana has quit IRC18:47
openstackgerritJohn Studarus proposed openstack-infra/project-config master: Upgraded of the control plane completed.  https://review.openstack.org/60213918:47
*** graphene has joined #openstack-infra18:48
*** eernst has quit IRC18:57
*** jamesmcarthur has joined #openstack-infra18:58
*** dhajare has joined #openstack-infra18:59
*** lbragstad has joined #openstack-infra19:00
*** jamesmcarthur has quit IRC19:01
*** jamesmcarthur has joined #openstack-infra19:01
*** slagle has joined #openstack-infra19:04
*** dave-mcc_ has quit IRC19:05
*** dave-mccowan has joined #openstack-infra19:06
*** _erlon_ has quit IRC19:06
AJaegerinfra-root, should we enable packethost again? ^19:07
clarkbAJaeger: yes they say it is over now19:10
*** hongbin has joined #openstack-infra19:12
AJaegerclarkb: want to +2A?19:12
clarkbAJaeger: looking19:12
clarkbdone19:13
clarkbfor those of you following along the PTG items, we are now using ansible 2.7.0rc119:13
logan-Could someone help me get https://review.openstack.org/#/c/602057/ applied? Repo config does not have the fix19:14
clarkbany other infra-root want to review https://review.openstack.org/#/c/602101/ which adds a base job to run ansible from bridge.openstack.org19:14
*** jamesmcarthur has quit IRC19:14
clarkblogan-: hrm that merged long enough ago that I would've expected that to be updated19:15
AJaegerconfirmed, https://review.openstack.org/#/admin/projects/openstack/limestone-ci-cloud,access is not updated ;(19:15
clarkbmanage projects hasn't run in about 17 hours19:16
clarkbI see no recent puppet runs in syslog19:16
AJaeger17 hours sounds wrong - https://review.openstack.org/601814 merged 14 hours ago and created the ACL...19:18
clarkbno hosts match the run puppet on git servers and run puppet on gerrit servers19:18
AJaegermight be that this was the last run...19:18
clarkbAJaeger: I may have done time math wrong19:19
clarkbits been a while though and it is because no hosts match the git or gerrit servers19:19
AJaegerclarkb: that could be as well...19:19
clarkbtrying to figure that out now19:19
*** mtreinish has joined #openstack-infra19:21
clarkbansible git-server --list-hosts works so I am really confused19:23
*** slaweq has joined #openstack-infra19:23
corvusclarkb: you see the error about "always"?19:24
*** jamesmcarthur has joined #openstack-infra19:25
corvusclarkb: i wonder if the ansible puppet role is incompatible with 2.7.019:25
openstackgerritMerged openstack-infra/project-config master: Upgraded of the control plane completed.  https://review.openstack.org/60213919:25
clarkbcorvus: I did not, but I think that may be unrelated. the git/gerrit problem is it claims no hosts match the group19:25
clarkband ya always problem likely due to ansible update19:26
*** krtaylor_ has joined #openstack-infra19:26
clarkbsomething something semver backward comaptibility19:26
corvusclarkb: i think the opposite19:26
*** zul has joined #openstack-infra19:26
clarkbcorvus: oh?19:26
corvusclarkb: why do you think no hosts match?  what are you looking at?19:26
clarkbcorvus: /var/log/ansible/run_all_cron.log PLAY [Puppet-git: Run puppet on the git servers] says skipping: no hosts matched [WARNING]: Could not match supplied host pattern, ignoring: review19:27
openstackgerritMerged openstack-infra/system-config master: Add zuul_reconfigure playbook  https://review.openstack.org/60210319:27
clarkbcorvus: this happened around 0700 (maybe earlier if that was around when the file as rotated)19:27
* clarkb migrated to infra room from lunch room19:28
*** hongbin has quit IRC19:29
*** jamesmcarthur has quit IRC19:30
openstackgerritMerged openstack-infra/system-config master: Add missing quote to alpine cache  https://review.openstack.org/60211319:30
openstackgerritMerged openstack-infra/puppet-storyboard master: Fix undef in vhost templates  https://review.openstack.org/60209219:30
*** zul has quit IRC19:30
*** lbragstad has quit IRC19:30
*** diablo_rojo has joined #openstack-infra19:30
*** zul has joined #openstack-infra19:30
*** sshnaidm|ptg has joined #openstack-infra19:33
*** efried has joined #openstack-infra19:33
*** markvoelker has joined #openstack-infra19:34
*** holser|ptg has joined #openstack-infra19:34
*** camunoz has quit IRC19:35
*** mriedem has joined #openstack-infra19:35
*** jamesmcarthur has joined #openstack-infra19:35
*** markvoelker_ has joined #openstack-infra19:36
*** priteau has joined #openstack-infra19:36
*** e0ne has joined #openstack-infra19:36
*** slagle has quit IRC19:37
*** markvoelker has quit IRC19:39
*** jrist has joined #openstack-infra19:39
clarkbcorvus: as root `~clarkb/venv/bin/openstack --os-cloud openstackci-linaro-london server list`19:42
*** holser|ptg has quit IRC19:43
*** holser|ptg has joined #openstack-infra19:43
mnaserinfra-root: https://review.openstack.org/#/c/602114/2 if anyone is around :)19:45
*** felipemonteiro has joined #openstack-infra19:47
*** camunoz has joined #openstack-infra19:50
*** jtomasek has joined #openstack-infra19:51
openstackgerritClark Boylan proposed openstack-infra/system-config master: Force identity api version 3 against linaro london  https://review.openstack.org/60214419:53
*** priteau has quit IRC19:57
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Add infra-run-zuul_reconfigure  https://review.openstack.org/60214519:58
*** bobh has quit IRC19:58
*** tosky has joined #openstack-infra19:58
*** bobh has joined #openstack-infra19:58
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove job settings for zaqar repositories  https://review.openstack.org/59760419:58
*** pcaruana has joined #openstack-infra19:58
*** dklyle has joined #openstack-infra19:59
*** gfidente has joined #openstack-infra19:59
openstackgerritMerged openstack-infra/system-config master: Add job to run playbook on bridge.o.o  https://review.openstack.org/60210120:00
openstackgerritMerged openstack-infra/system-config master: Revert "Revert "Turn on the future parser for storyboard-dev""  https://review.openstack.org/60209320:00
*** nicolasbock has joined #openstack-infra20:00
*** slagle has joined #openstack-infra20:02
*** priteau has joined #openstack-infra20:06
openstackgerritClark Boylan proposed openstack-infra/ansible-role-puppet master: Fix ansible block, always, when syntax  https://review.openstack.org/60214920:08
clarkblogan-: I think my two changes above will get puppet running again and then update your acls20:12
*** hongbin has joined #openstack-infra20:12
clarkblogan-: in the interim you are no a member of the broken group20:12
logan-awesome thanks!20:13
clarkbshould be able to approve changes20:13
clarkbcmurphy: if you are around, do you understand the openstacksdk behavior when a cloud has no keystone v2 api?20:14
clarkbcmurphy: it appears that we are forced to set identity_api_version in our clouds.yaml to have openstackclient work20:14
clarkbcmurphy: I think what is happening is the sdk is defaulting to v2 and ignoring what is in the version discovery doc (found from GET / on keystone server) and then failing because there is no v2 api20:14
cmurphyclarkb: i thought dtroyer changed the default to use v320:14
clarkbits been a couple weeks since I updated the client install, I suppose that could be part of the problem20:15
clarkbwhat is odd to me is that it should use the highest version in the discovery doc20:15
cmurphybut yes i think osc specifies its own keystone version instead of listening to the discovery doc20:15
clarkbotherwise why do discovery20:15
clarkbaha20:15
*** slaweq has quit IRC20:15
cmurphyi think it's an osc thing not keystoneauth or openstacksdk20:16
*** slaweq_ has joined #openstack-infra20:16
clarkbok, we are seeing weird behavior with the ansible inventory plugin too (which I though was related to it being unable to do catalog listings to dynamically generate classes, but could be something else)20:16
cmurphyhmm not sure then20:16
cmurphymaybe not osc maybe os-c-c20:17
openstackgerritMerged openstack-infra/system-config master: Add LXC COPR cache  https://review.openstack.org/60211420:17
*** pcaruana has quit IRC20:20
*** dpawlik has joined #openstack-infra20:22
*** markvoelker_ has quit IRC20:24
*** dpawlik has quit IRC20:27
*** camunoz has quit IRC20:30
*** pguimaraes has quit IRC20:31
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Reconfigure Zuul on main.yaml update  https://review.openstack.org/60215820:33
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Reconfigure Zuul on main.yaml update  https://review.openstack.org/60215820:35
*** lbragstad has joined #openstack-infra20:37
clarkbpabelanger: dmsimard any idea how to tell ansible from an inventory plugin that an error is fatal and it should stop? I can short circuit it by calling exit directly but I wonder if there is a better way20:42
*** janki has joined #openstack-infra20:42
dmsimardclarkb: raise an exception ?20:42
clarkbdmsimard: that results in ansible sayin "warning could not parse blahblah file with plugin foo" it isn't fatal :(20:43
dmsimardoh, I see what you mean20:43
clarkbmordred: 'Failed to parse /opt/system-config/inventory/openstack.yaml' in /var/log/ansible/run_all_cron.log20:43
dmsimardclarkb: hum, on the top of my head you could add a task that ensures that a specific host is there20:44
dmsimardlike fail when foo not in groups['all']20:44
clarkbdmsimard: well I don't want ansible to run any tasks if we cannot generate a complete inventory due t oa cloud api failure20:45
clarkbdmsimard: better to fail the whole run then attempt to update things in order which may not currently exist20:45
corvusthat's a clever idea, but we'd have to add it to every playbook20:45
dmsimardright, the only thing I can think of right now is to do that -- otherwise I'd defer to #ansible-devel20:45
clarkbI'll use sys.exit now20:45
*** ansmith has quit IRC20:45
clarkb*for now20:45
dmsimardsys.exit would be the same thing no ?20:45
dmsimardI mean, it disregards the exit code if it just keeps on running20:46
*** jrist has quit IRC20:46
fungisuggesting something like sys.exit(1) ?20:46
dmsimardI was running with the assumption that the inventory was already exiting non-zero20:47
fungiyeah, likely so20:47
dmsimardwait -- is this a dynamic inventory script or a dynamic inventory plugin ? It's two different things now20:48
*** jtomasek has quit IRC20:48
*** hongbin has quit IRC20:49
corvusdmsimard: plugin20:51
clarkbI'm almost to the point where I can get a patch to ansible github20:51
clarkbI just have to figure out how to github again20:51
corvusclarkb: email it to mordred20:51
openstackgerritMerged openstack-infra/system-config master: Use host groups for zuul playbooks  https://review.openstack.org/60213520:52
*** jrist has joined #openstack-infra20:52
StevenKSpamapS: Have you asked nicely yet, re: dockerhub images?20:53
*** ijw has quit IRC20:54
*** graphene has quit IRC20:54
SpamapSStevenK: they pushed new ones, but I can't test them20:54
SpamapSdocker pull gives me the same old broken one becaue *shrug*20:54
*** hongbin has joined #openstack-infra20:55
StevenKSo they haven't tagged it yet, or dockerhub caches because hard problems in computer science?20:55
*** ijw has joined #openstack-infra20:55
SpamapSThey tagged something 2 hours ago20:55
SpamapSand I can't seem to pull it20:55
*** graphene has joined #openstack-infra20:55
SpamapSand I don't know how to clear my cache20:55
*** jamesdenton has quit IRC20:56
StevenKSpamapS: It is still failing with the same issue, and http://logs.openstack.org/51/602151/1/check/pbrx-build-zuul-containers/e1df290/job-output.txt.gz was sooner than 2 hours ago20:57
SpamapSkk20:57
SpamapS:(20:57
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Only append DIB_BOOTLOADER_DEFAULT_CMDLINE to default grub entry  https://review.openstack.org/60193620:57
StevenKianw: ^ +220:58
ianwthanks, git add failure20:58
*** dhajare has quit IRC20:59
*** akhila has joined #openstack-infra20:59
ianwclarkb: thanks for checking in on the runs and adding the identity_v3 stuff.  indeed, i was using that locally for testing21:00
StevenKianw: Happens to the best of us :-21:00
StevenK:-)21:00
ianwclarkb: are we having inventory problems now however?21:00
*** bobh has quit IRC21:01
*** bobh has joined #openstack-infra21:02
openstackgerritMerged openstack-infra/system-config master: Force identity api version 3 against linaro london  https://review.openstack.org/60214421:03
openstackgerritMerged openstack-infra/system-config master: launch-node.py : add timeout option  https://review.openstack.org/60189421:03
openstackgerritMerged openstack-infra/system-config master: roles/kerberos-client: fix defaults  https://review.openstack.org/59737421:03
*** jtomasek has joined #openstack-infra21:04
*** jtomasek has quit IRC21:04
*** felipemonteiro has quit IRC21:05
clarkbianw: we seem to be ok now according to mordred, we do have a separate problem where ansible role puppet hsa invalid ansible for ansible 2.7 (I've pushed a fix under update-cfg-mgmt topic)21:05
clarkbianw: so puppet still not running but should run soon I hope21:06
clarkbdmsimard: corvus mordred https://github.com/ansible/ansible/pull/4558421:06
*** felipemonteiro has joined #openstack-infra21:07
*** bobh has quit IRC21:07
openstackgerritMerged openstack-infra/ansible-role-puppet master: Fix ansible block, always, when syntax  https://review.openstack.org/60214921:07
clarkbianw: ^ that change21:08
ianwclarkb: ahhh, 2.7 ... we live on the edge :)21:09
clarkbianw: we may have jumped off :)21:10
dmsimardclarkb: looks sensible to me, added just one comment21:10
clarkbdmsimard: thanks21:10
ianwi'm going to bring up the linaro-london mirror, as mentioned i moved the builder to there21:10
*** felipemonteiro has quit IRC21:11
*** egonzalez has quit IRC21:13
*** masayukig[m] has joined #openstack-infra21:13
ianwi thumbs up it.  yay, i'm helping!21:14
*** egonzalez has joined #openstack-infra21:15
*** ldnunes has quit IRC21:15
*** claudiub has quit IRC21:16
*** hongbin has quit IRC21:16
*** felipemonteiro has joined #openstack-infra21:16
*** d0ugal has joined #openstack-infra21:18
openstackgerritMerged openstack-infra/system-config master: Add infra-run-zuul_reconfigure  https://review.openstack.org/60214521:19
*** tosky has quit IRC21:20
*** e0ne has quit IRC21:21
*** kjackal has quit IRC21:21
StevenKSpamapS: Can I help any with debugging that job failure?21:23
*** kgiusti has left #openstack-infra21:24
*** eharney has quit IRC21:25
*** felipemonteiro has quit IRC21:26
clarkbfyi http://lists.openstack.org/pipermail/openstack-infra/2018-September/006177.html I just sent that out re winterscale. tldr opendev21:29
*** hashar has quit IRC21:29
*** felipemonteiro has joined #openstack-infra21:30
cmurphyclarkb: did puppet run on storyboard-dev? it looks healthy21:30
fungicmurphy: i manually fixed storyboard-dev earlier because we were trying to demo it. i'll check if puppet has actually been applied since then21:33
cmurphyfungi: oh sorry for breaking it :(21:33
clarkbcmurphy: and we broke puppet which I think maybe it will work now21:33
clarkbcmurphy: so no worries on breaking storyboard-dev too, you are in good company :)21:33
cmurphylol21:33
*** ianychoi has joined #openstack-infra21:35
*** jtomasek has joined #openstack-infra21:35
*** felipemonteiro has quit IRC21:36
*** felipemonteiro has joined #openstack-infra21:37
*** bobh has joined #openstack-infra21:37
*** agopi is now known as agopi|off21:37
*** e0ne has joined #openstack-infra21:38
*** masayukig has quit IRC21:39
*** agopi|off has quit IRC21:40
*** agopi|off has joined #openstack-infra21:41
*** dotplus has joined #openstack-infra21:41
fungicmurphy: no worries, it was somewhat later the qa team had some questions and so i just quickly hand-fixed it so i could show them since the revert hadn't applied yet21:41
*** bobh has quit IRC21:41
fungicmurphy: syslog says the last time we ran puppet on storyboard-dev was 16:43:3221:43
*** d0ugal has quit IRC21:43
*** claudiub has joined #openstack-infra21:43
fungii think the delay is related to the inventory fixes we realized we needed21:44
cmurphy16:43 was about 5 hours ago?21:44
cmurphythat's a long delay21:44
*** rcernin has joined #openstack-infra21:44
*** bobh has joined #openstack-infra21:47
StevenKmordred: https://review.openstack.org/#/c/602172/ passes all the things21:47
clarkbcmurphy: ya we broke puppet good21:47
*** tosky has joined #openstack-infra21:48
clarkbcmurphy: there were two issues, first is not running puppet on all hosts due to broken inventory then second was not running puppet due to bug in ansible role puppet with the new version of ansible we just installed :?21:48
clarkbboth should be fixed now (I am watching the current run to confirm)21:48
*** hongbin has joined #openstack-infra21:51
*** agopi|off has quit IRC21:52
*** eharney has joined #openstack-infra21:52
mnaserclarkb: so mirrors should be ran shortly i assume?21:53
* mnaser is waiting for https://mirror.sjc1.vexxhost.openstack.org:8080/copr-lxc2/21:53
clarkbmnaser: if we actually fixed things then yes :) within the next 25 minutes I think21:53
mnaserawesome thanks21:53
*** diablo_rojo has quit IRC21:53
*** dklyle has quit IRC21:54
*** slaweq_ has quit IRC21:54
*** felipemonteiro has quit IRC21:54
clarkbit appearsthat puppet has successfully run on our git servers21:54
clarkbmnaser: so ya ~25 minutes for mirror update  Ithink21:55
*** ansmith has joined #openstack-infra21:55
clarkbmanage projects is running now to fix logan-'s issue21:56
*** felipemonteiro has joined #openstack-infra21:58
*** priteau has quit IRC21:58
tdasilvais there a parent job definition that takes care of installing test-requirements.txt? I'm running into this problem:  http://logs.openstack.org/86/601686/16/check/swift-multinode-functional/195cf6a/job-output.txt.gz#_2018-09-12_21_22_27_994470 and hesitating to just add a `pip install -r test-requirements.txt`21:58
gmannclarkb: do you know if stable/rocky depends-on patch will be taken by master patch of grenade while testing stable/rocky-?master upgrade21:59
dotplusI've made a patch for jenkins-job-builder to add support for the SSHCheckoutTrait from the Github Branch Source (jenkins) plugin. I think I have gerrit sorted, but I can't remember/find (been a coupla years since I contributed) where to create a bug that I can refer to in my commit message.21:59
clarkbgmann: yes it should, zuul will make sure that stable/rocky and master (and all other branches) are using speculative future refs if they exist22:00
gmannclarkb: ok. thanks we will try22:00
ianwclarkb: hrm, i just brought up mirror.linaro-london and puppet didn't run on it ... but no errors, hrm22:00
clarkbdotplus: https://storyboard.openstack.org/#!/project/723 is what the docs tell me for submitting bugs. But I wouldn't worry too much about that22:00
clarkbianw: yes launch node doens't run puppet anymore, you have to wait for run_all.sh or manually kick.sh22:01
*** bobh has quit IRC22:01
clarkbianw: with the ansibleification mordred wanted the puppet to not be required and just be an explicit post step (maybe we need to update launch/README with that info)22:01
dotplusclarkb: oh storyboard! ok. got it, thanks.22:01
*** priteau_ has joined #openstack-infra22:02
*** TimO__ has quit IRC22:02
clarkblogan-: https://review.openstack.org/#/admin/projects/openstack/limestone-ci-cloud,access is correct now22:02
ianwclarkb: ahh, yes i just realised that reading the script now :)22:02
ianwok, that makes sense22:02
logan-thanks, sorry for the typo22:03
*** roman_g has quit IRC22:03
*** priteau_ has quit IRC22:03
fungitdasilva: doesn't look like anybody responded to you yet? usually your tox.ini [testenv] block will specify something like deps = -r{toxinidir}/test-requirements.txt22:05
fungiso when the job invokes tox it will install the packages listed in that file by default unless some more specific testenv overrides the deps22:06
*** slaweq_ has joined #openstack-infra22:07
*** jamesmcarthur has quit IRC22:08
openstackgerritClark Boylan proposed openstack-infra/system-config master: Treat unparsed inventory as a failure  https://review.openstack.org/60217922:09
clarkbdmsimard: corvus mordred ^ a kind ansible dev pointed out that this should work instaed22:09
clarkbits a new feature but should be available on our 2.7.0.rc122:09
dmsimardTIL22:10
*** masayukig has joined #openstack-infra22:10
clarkbdmsimard: its brand new :)22:10
*** masayukig has quit IRC22:10
clarkbbut useful so yay22:10
dmsimardI thought about any_errors_fatal but that seemed to be only for tasks22:10
dmsimardI wasn't too far off :p22:11
clarkbI'll abandon my PR once I can confirm that ^ is working as expected22:11
*** Swimingly has joined #openstack-infra22:17
*** Swimingly has quit IRC22:17
*** Swimingly has joined #openstack-infra22:17
*** claudiub has quit IRC22:18
clarkbin happy exciting news ansible 2.7 seems to run much quicker than 2.622:20
mnaserclarkb: thats cool, roughly how much quicker?22:20
clarkbmnaser: running our base playbook went from ~30 minutes to ~1822:21
clarkband I think running puppet else went from ~15 to 1022:21
clarkbnot scientific but promising22:21
*** studarus has joined #openstack-infra22:25
ianwclarkb: if you want to know exactly ... https://review.openstack.org/#/c/601169/ :)22:25
studarusclarkb: is there a way to repush up all the images into glance? turns out the backplane upgrade blew out all the images...22:26
mnaserclarkb: wow, that's awesome22:27
clarkbstudarus: if we delete them all from nodepool's zk databsae it will reupload22:27
clarkbianw: ^ that might be something you can do (I'm trying to review the stats timing change)22:27
*** vivsoni_ has quit IRC22:27
*** vivsoni_ has joined #openstack-infra22:28
ianwclarkb / studarus : hrm, you mean in zk directly?22:29
*** priteau has joined #openstack-infra22:29
clarkbianw: well via nodepool image-delete commands22:29
*** electrofelix has quit IRC22:29
clarkbwhich I think does the right thing if the image does not exist22:30
ianwwon't that do all providers?22:30
clarkbianw: I think you can specify if per provider22:30
clarkbmight be an option?22:31
ianwoh, by build-id i guess ... yeah let me see here ...22:31
*** zul has quit IRC22:31
studarusthey are still in the database but got removed from disk22:31
*** dklyle has joined #openstack-infra22:31
studarushow about I just pull them down from the mirror?22:31
clarkbstudarus: I think nodepool will automatically redo it all for us22:31
*** e0ne has quit IRC22:32
*** jtomasek has quit IRC22:33
studarusone just popped up...22:34
clarkbianw: left a comment on the timing change (I think there is a bug) let me know if I'm just wrong22:34
ianwstudarus: yep, just getting a script for the rest ...22:36
ianwclarkb / studarus: ok that should have got them all.  will look at making the cmd line tool a bit more helpful for that case22:39
studarusyup - they're showing up!22:40
*** jaosorior has quit IRC22:40
*** diablo_rojo has joined #openstack-infra22:41
ianwclarkb: ${2-$_START_TIME} is saying "take $2 if defined, otherwise $_START_TIME" ?22:41
clarkbianw: bah I read it as $(2-_START_TIME)22:42
clarkbI thought you were mathing on it22:42
clarkbreally the lesson here is I am half blind22:42
clarkband need bigger font/better easier to read font22:42
*** slagle has quit IRC22:42
clarkbthough thats (())?22:42
StevenKIsn't it :- ?22:42
StevenKAnd yes $(()) is math22:42
*** hongbin has quit IRC22:43
*** graphene has quit IRC22:43
StevenKIf random shell snippets turn up in the trivia night questions I am totally set22:43
clarkb- does a thing and :- does a thing the difference is defined vs undefined or something22:43
clarkbStevenK: ha22:44
* clarkb double checks on :- vs - since StevenK has made that a concern22:44
ianwokdokie, mirror.london.linaro-london.openstack.org should be fully operational22:45
*** graphene has joined #openstack-infra22:45
clarkbusing - results in a test for only parameter is unset not for empty as well22:45
clarkbwhich should work fine here bceuse its either called with two params or not22:45
clarkbianw: I can't watch that currently bceause too many coals in the fire but +222:46
openstackgerritIan Wienand proposed openstack-infra/project-config master: Move to london linaro mirror  https://review.openstack.org/60219422:47
ianwclarkb: cool, i can watch it in a few hours when we calm down, and get a grafana db22:47
*** dklyle has quit IRC22:47
*** dklyle has joined #openstack-infra22:48
ianws/calm down/everyone else goes to bed/ :)22:48
openstackgerritSteve Kowalik proposed openstack-infra/zuul master: Correct Last-Modified header for status API  https://review.openstack.org/60183222:48
*** e0ne has joined #openstack-infra22:50
*** e0ne has quit IRC22:50
*** e0ne has joined #openstack-infra22:51
openstackgerritGhanshyam Mann proposed openstack-infra/project-config master: remove job settings for nova repositories  https://review.openstack.org/60140622:52
clarkbcmurphy: in "I hate computers" I think storyboard-dev may have broken again22:53
*** diablo_rojo has quit IRC22:54
clarkbfix undef in templates is in the puppte module on bridge (working backward from that)22:54
clarkbit is on storyboard-dev too22:54
*** e0ne has quit IRC22:55
StevenKclarkb on "I hate computers, part 4753753085953"22:55
fungiyeah, puppet seems to have put the broken vhost config back into place again22:57
*** tpsilva has quit IRC22:57
clarkbfungi: cmurphy the problem is we set serveradmin for the two vhosts in the https vhost erb file and only fixed the one22:57
clarkbI'm writing the patch22:58
fungiwell, that's only one of the issues22:58
fungiSSLCertificateChainFile is similarly broken22:58
fungiso need to fix both the ServerAdmin and SSLCertificateChainFile parameters in the ssl vhost22:59
openstackgerritClark Boylan proposed openstack-infra/puppet-storyboard master: Fix second ServerAdmin conditional  https://review.openstack.org/60219722:59
clarkbthere22:59
* clarkb checks ChainFile23:00
cmurphyclarkb: bah23:00
openstackgerritClark Boylan proposed openstack-infra/puppet-storyboard master: Fix second ServerAdmin conditional  https://review.openstack.org/60219723:01
clarkbnow with the chain file fixed too23:01
*** jrist has quit IRC23:03
*** dklyle has quit IRC23:03
*** dklyle has joined #openstack-infra23:04
*** mriedem has quit IRC23:04
*** panda|ptg has joined #openstack-infra23:04
panda|ptghow to check that a regexp for a files: variable is working correclty ?23:04
*** eharney has quit IRC23:04
clarkbpanda|ptg: push the change and then depends on with a change that uses those files?23:05
*** slagle has joined #openstack-infra23:05
*** lbragstad has quit IRC23:06
*** hongbin has joined #openstack-infra23:07
*** felipemonteiro has quit IRC23:07
*** efried has quit IRC23:09
*** gfidente has quit IRC23:10
panda|ptgclarkb: what if I want to test locally, not reiterate on a patch that spins 10 jobs and may take some time ? ... quess I'll try to find out how these regexp are interpreded in zuul23:11
fungiinfra team room at the ptg is being abandoned, and its former inhabitants are on their way to station 2623:14
* fungi does the same now23:15
openstackgerritMerged openstack-infra/system-config master: Treat unparsed inventory as a failure  https://review.openstack.org/60217923:17
*** lbragstad has joined #openstack-infra23:19
*** slaweq_ has quit IRC23:20
*** nicolasbock has quit IRC23:24
*** studarus has quit IRC23:24
*** ansmith has quit IRC23:24
*** ansmith has joined #openstack-infra23:26
*** lbragstad has quit IRC23:27
*** slaweq_ has joined #openstack-infra23:27
*** rlandy is now known as rlandy|bbl23:27
*** nicolasbock has joined #openstack-infra23:29
*** slagle has quit IRC23:30
*** dklyle has quit IRC23:30
*** panda|ptg has quit IRC23:33
openstackgerritMerged openstack-infra/puppet-storyboard master: Fix second ServerAdmin conditional  https://review.openstack.org/60219723:41
*** lbragstad has joined #openstack-infra23:41
*** holser|ptg has quit IRC23:43
*** sshnaidm|ptg has quit IRC23:48
*** holser|ptg has joined #openstack-infra23:49
*** sshnaidm|ptg has joined #openstack-infra23:51
*** holser|ptg has quit IRC23:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Only append DIB_BOOTLOADER_DEFAULT_CMDLINE to default grub entry  https://review.openstack.org/60193623:52
openstackgerritMerged openstack-infra/project-config master: Move to london linaro mirror  https://review.openstack.org/60219423:54
*** dpawlik has joined #openstack-infra23:55
*** tosky has quit IRC23:57
*** dpawlik has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!