| fungi | but i have no problem with taking the other-requirements.txt from just listing the packages needed by our workers to run jobs, vs packages other people should install that we might be installing already | 00:00 |
|---|---|---|
| clarkb | fungi: ya I am thinking about the person that wants to use other-requirements to make an install locally and may not want to use our gigantic images | 00:01 |
| fungi | wfm | 00:01 |
| fungi | what 322457 proves is that we currently preinstall everything needed on our workers | 00:01 |
| fungi | anything beyond that is icon on the cake to me | 00:01 |
| fungi | icing too | 00:02 |
| clarkb | ok | 00:02 |
| fungi | but icons on cake are awesome | 00:02 |
| * clarkb approves to make jobs run faster | 00:02 | |
| clarkb | will try to find time to make the list a bit more accurate | 00:02 |
| openstackgerrit | Merged openstack-infra/system-config: Disable default site for cacti https://review.openstack.org/321352 | 00:04 |
| clarkb | should I abandon 171421? | 00:04 |
| jpmaxman | fungi so what's the next step on https://review.openstack.org/#/c/341800/ - did that get deployed? | 00:05 |
| fungi | clarkb: wow, that takes me back | 00:05 |
| jpmaxman | should I do subsequent patch to allow new users now? | 00:05 |
| fungi | jpmaxman: ahh, it did not get approved (yet) but i have done so now | 00:06 |
| clarkb | ianw: nibalizer maybe you two can decide if 204697 should be abandoned or merged | 00:06 |
| clarkb | fungi: ya we really need to flush system-cofnig | 00:06 |
| clarkb | fungi: its got a lot of changes like that one and the one I pointed ianw and nibalizer at that can probably be abandoned | 00:06 |
| jpmaxman | ok cool - so it will push out on the next update? | 00:06 |
| *** yuanying-afk is now known as yuanying | 00:06 | |
| fungi | jpmaxman: it won't yet, because we had puppet disabled on the server. i'm proposing a revert of that now | 00:07 |
| notmorgan | jeblair: i just grokk'd tye .zuul.yaml files | 00:08 |
| ianw | oh wow, some ancient history | 00:08 |
| *** hosanai has joined #openstack-infra | 00:08 | |
| notmorgan | jeblair: it makes me sad it took me that long to understand what was being done. it isn't that complex | 00:08 |
| openstackgerrit | Merged openstack-infra/system-config: Fix deprecated warnings on clouds.yaml.erb https://review.openstack.org/324027 | 00:08 |
| jpmaxman | hah - I wasn't aware the issue had been fixed that prevented it from being disabled | 00:08 |
| jpmaxman | ok | 00:08 |
| jpmaxman | sounds good | 00:08 |
| jpmaxman | I'll check back | 00:08 |
| notmorgan | jeblair: i didn't map .zuul.yml to the same thing .travis.yml was until just now . welp more coffee has helped :) | 00:09 |
| notmorgan | jeblair: your dynamic reconfig patch suddenly made a TON more sense. | 00:10 |
| openstackgerrit | Merged openstack-infra/system-config: Collect 'karma.subunit' files https://review.openstack.org/325369 | 00:11 |
| *** flepied has joined #openstack-infra | 00:13 | |
| fungi | jpmaxman: for the recaptcha keypair, should i set up a recaptcha account specifically for wiki.openstack.org or is that going to conflict with a blanket one you may have for all of openstack.org? | 00:14 |
| clarkb | fungi: 341888 could use review, then ianw can fix bandersnatch when it breaks >_> | 00:14 |
| fungi | clarkb: ianw: approved. also the commit message already did mention our ssh access policies | 00:15 |
| openstackgerrit | Merged openstack-infra/system-config: Fix debug statement typos in *-mirror-update https://review.openstack.org/325851 | 00:17 |
| openstackgerrit | Merged openstack-infra/system-config: Initial support for bindep https://review.openstack.org/322457 | 00:17 |
| ianw | clarkb: cool, it depends on a puppet change that needs a merge, i think it should be ok | 00:17 |
| ianw | i think it's worth smoke-testing ed25519 keys, it does seem to be the future | 00:17 |
| clarkb | ianw: they are quantum computer resistant right? thats the big draw? | 00:18 |
| openstackgerrit | Merged openstack-infra/puppet-mediawiki: Setup ReCaptcha in Wiki to Prevent Spam https://review.openstack.org/341800 | 00:19 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Revert "Disable puppet on wiki.openstack.org" https://review.openstack.org/343956 | 00:19 |
| ianw | clarkb: i like that they stop brute force, and also prevents side-channel by making sure it has predictable branching | 00:19 |
| craige | I can hit that very shortly, fungi | 00:20 |
| clarkb | fungi: jpmaxman we are ready to revert the disabled puppet on wiki? | 00:20 |
| craige | (change comments) | 00:21 |
| clarkb | fungi: jpmaxman that is excellent new and has my +2 | 00:21 |
| fungi | clarkb: ianw: ecc depends on nobody finding a simple(r) solution to the discrete log problem (no idea why that would be necessarily harder than a schor's algorithm implementation for doing fast factorization on quantum computers) | 00:22 |
| fungi | clarkb: ianw: but anyway, i'm not opposed to ecc per se. it's reasonably as strong as rsa as far as anybody (publically) can tell at least | 00:23 |
| fungi | clarkb: the parent change of that is still wip because i need credentials for recaptcha | 00:23 |
| fungi | hrm, i guess google bought recaptcha some years ago, and wants to tie recaptcha site registrations to a google account. i wonder if we need an infra role account for google properties | 00:23 |
| fungi | i wonder what we do for urchin now that google owns them | 00:24 |
| *** dkehn has quit IRC | 00:24 | |
| fungi | oh, though urchin's probably set up somehow through rackspace cloudsites | 00:24 |
| ianw | dear github: why can i not just paste a sha changeid into the search box and find it? | 00:25 |
| clarkb | fungi: ah yes ecc also still vulnerable to quantum computers | 00:25 |
| clarkb | I continue to use rsa because it seems to work everywhere | 00:25 |
| *** dkehn has joined #openstack-infra | 00:25 | |
| jpmaxman | Fungi you are welcome to setup your own or I can give you the keys I have | 00:26 |
| clarkb | fungi: thoughts on abandoning 272851 given the feedback there? | 00:26 |
| jpmaxman | clarkb: yes. Hopefully! | 00:26 |
| *** dkehn_ has quit IRC | 00:26 | |
| *** Apoorva has quit IRC | 00:27 | |
| fungi | jpmaxman: it looks like they end up tied to a google account. is that one using a foundation account or some random google account? | 00:27 |
| fungi | clarkb: yes, i would abandon 272851 | 00:28 |
| *** mtanin___ has joined #openstack-infra | 00:28 | |
| *** Apoorva has joined #openstack-infra | 00:28 | |
| *** gyee has quit IRC | 00:28 | |
| jpmaxman | A foundation account. | 00:29 |
| *** Apoorva has quit IRC | 00:29 | |
| *** mtanino has quit IRC | 00:29 | |
| *** bhunter71 has joined #openstack-infra | 00:29 | |
| clarkb | fungi: ok let me go ahead and abandon it with a suggestion to use the options provided by thingee and fifieldt | 00:29 |
| jpmaxman | I can drop them in a text file on the server | 00:29 |
| fungi | jpmaxman: that should be fine. also i see that the workarounds for using recaptcha without a google account are nontrivial :/ https://www.iptanus.com/google-recaptcha-without-keys/ | 00:30 |
| *** markvoelker has quit IRC | 00:30 | |
| fungi | jpmaxman: thanks! just let me know the filename and i'll import those into hiera on our bastion. then i can un-wip the system-config change | 00:30 |
| *** Swami has quit IRC | 00:30 | |
| *** pvaneck has quit IRC | 00:30 | |
| *** Apoorva has joined #openstack-infra | 00:30 | |
| *** markvoelker has joined #openstack-infra | 00:31 | |
| ianw | nibalizer: i'm sure you won't mind i abandoned https://review.openstack.org/#/c/204697/ , see reasoning in there | 00:31 |
| jpmaxman | Ok give me a few will ping you when there | 00:31 |
| clarkb | anyone opposed to installing openstackclient from pip on the puppetmaster? | 00:31 |
| clarkb | if not I am approving that change | 00:31 |
| fungi | jpmaxman: that's fine--take your time | 00:31 |
| fungi | clarkb: we did the same with novaclient et al, for better or worse | 00:32 |
| clarkb | fungi: ya and we already install shade globally that way | 00:33 |
| clarkb | so openstackclient isn't a huge addition. I will approve | 00:33 |
| fungi | clarkb: i'd be more of a fan of maintaining a virtualenv for it in /opt and deep-symlinking its entrypoint from /usr/local/bin or something, but meh | 00:33 |
| clarkb | I personally use virtualenv in my homedir | 00:33 |
| *** karthikp_ has joined #openstack-infra | 00:33 | |
| fungi | pip on debuntu is almost that to begin with | 00:33 |
| clarkb | for raisins but given what we already isntall there its not a huge deal | 00:33 |
| clarkb | jpmaxman: fungi 285641 is no longer needed right? I can abandon if that is correct | 00:34 |
| clarkb | I think we made a new change that did the same thing | 00:34 |
| clarkb | and the new one merged | 00:34 |
| fungi | clarkb: yep, there was a dupe of that | 00:35 |
| fungi | it can be abandoned | 00:35 |
| *** markvoelker has quit IRC | 00:36 | |
| *** dkehn_ has joined #openstack-infra | 00:36 | |
| openstackgerrit | Merged openstack-infra/system-config: Exclude paas for centos-7 mirror https://review.openstack.org/334630 | 00:37 |
| *** karthikp_ has quit IRC | 00:39 | |
| *** karthikp_ has joined #openstack-infra | 00:39 | |
| openstackgerrit | Merged openstack-infra/system-config: Install python-openstackclient on puppetmaster https://review.openstack.org/283729 | 00:42 |
| clarkb | pleia2: I am not sure I udnerstand the comment on 301680, both hosts are updated tehre | 00:42 |
| clarkb | pleia2: pabelanger but also I approved an earlier change to do the same thing but only to groups.o.o so will conflict but we still need to do -dev | 00:42 |
| *** amitgandhinz has joined #openstack-infra | 00:42 | |
| clarkb | pleia2: maybe we can just push a new ps on that to deal with -dev and approve that? | 00:43 |
| * clarkb wonders if the one I approved is what pleia2 meant to comment on | 00:43 | |
| openstackgerrit | Merged openstack-infra/system-config: Add simple script to help debug shade image uploads https://review.openstack.org/287296 | 00:44 |
| *** amotoki has joined #openstack-infra | 00:46 | |
| clarkb | fungi: 327282 is a quick update if you want to push that and I can go ahead and approve it | 00:47 |
| openstackgerrit | Merged openstack-infra/system-config: Upgrade groups.o.o to trusty https://review.openstack.org/301011 | 00:47 |
| *** amitgandhinz has quit IRC | 00:47 | |
| *** claudiub has joined #openstack-infra | 00:48 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Document how to reset statusbot wiki password https://review.openstack.org/327282 | 00:49 |
| fungi | ^ thanks pleia2, clarkb! | 00:49 |
| *** Apoorva has quit IRC | 00:51 | |
| *** mordred has joined #openstack-infra | 00:51 | |
| clarkb | ianw: re 340638 we don't use that script on jenkins/zuul jobs | 00:51 |
| clarkb | ianw: its only for our long lived servers which I think we do want to restrict perms on. Does it make sense to abandon that change and update jobs to set perms as needed instead? | 00:52 |
| *** mahatic has quit IRC | 00:52 | |
| *** yamahata has quit IRC | 00:53 | |
| ianw | clarkb: ahhh, ok. long-lived servers i don't mind ... for jobs maybe we should make it default available to jenkins user? | 00:53 |
| *** amotoki has quit IRC | 00:53 | |
| ianw | clarkb: prepare_node.sh i guess? | 00:55 |
| *** mahatic has joined #openstack-infra | 00:56 | |
| clarkb | ianw: we don't even mount the ephemeral on jobs except for in d-g | 00:58 |
| clarkb | its possible we want to move all of that into the ready node script | 00:59 |
| clarkb | and then d-g's thing can die on the vine | 00:59 |
| *** salv-orlando has joined #openstack-infra | 01:00 | |
| ianw | clarkb: i'm going to have to re-read some things, cause i thought d-g was setting up swap | 01:01 |
| *** karthikp_ has quit IRC | 01:02 | |
| openstackgerrit | Merged openstack-infra/nodepool: Change the webapp default port https://review.openstack.org/343950 | 01:03 |
| *** hurgleburgler has quit IRC | 01:04 | |
| *** zhurong has joined #openstack-infra | 01:04 | |
| openstackgerrit | Merged openstack-infra/system-config: Document how to reset statusbot wiki password https://review.openstack.org/327282 | 01:05 |
| *** bardia has quit IRC | 01:06 | |
| *** yamahata has joined #openstack-infra | 01:07 | |
| *** salv-orlando has quit IRC | 01:08 | |
| *** Jeffrey4l has joined #openstack-infra | 01:11 | |
| *** tkelsey has joined #openstack-infra | 01:12 | |
| ianw | clarkb: ahh, ok. what's the swap situation ... are there non-d-g jobs that *do not* want swap enabled for some reason? | 01:14 |
| *** tonytan4ever has quit IRC | 01:14 | |
| *** harlowja has quit IRC | 01:14 | |
| *** shashank_hegde has quit IRC | 01:14 | |
| *** tphummel has quit IRC | 01:14 | |
| clarkb | ianw: most dont need it I think. its really only when running a cloud that we have memory pressure | 01:15 |
| fungi | ianw: well, it is a bit of a risk because we can't regulate it like we do non-virtual memory limits. some of our providers don't give us a separate device to put swap on, and swapfiles can behave differently from partitions for unfortunate reasons | 01:15 |
| fungi | ianw: but more to the point, it's a tradeoff against available disk space in that case | 01:16 |
| fungi | providers which give us only a rootfs and a fairly tight one at that mean that we get to decide between allocating some of it to swap or making that extra bit available for files | 01:16 |
| *** tkelsey has quit IRC | 01:17 | |
| fungi | if we can afford to chop an extra amount (8gb? less? more?) off the ~80gb rootfs on ovh (i think that's what it was) then i guess it's fine | 01:18 |
| *** karthikp_ has joined #openstack-infra | 01:18 | |
| fungi | or jobs that need swap can add it. or jobs that need more space can remove it. i guess it's a question of which we expect to happen more often | 01:18 |
| *** zul has quit IRC | 01:19 | |
| fungi | i lean toward removing swap everywhere and telling everyone 8gb is all you get unless you create a swapfile in your job | 01:19 |
| ianw | fungi: it just seems like a nice "interface" if we have /opt as big as possible -- thus if we have a large(r) ephemeral drive it is mounted there. | 01:20 |
| ianw | i.e. move https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n337 into a node ready script | 01:20 |
| ianw | but then, d-g is going to destroy it ... | 01:20 |
| fungi | well, some of our providers having no ephemeral disk means we can't rely on it | 01:21 |
| *** claudiub has quit IRC | 01:21 | |
| fungi | so depending on where the job runs, /opt may just be part of / | 01:22 |
| ianw | yeah, that's why it's just "as big as possible" | 01:22 |
| fungi | i guess we could put a swapfile in /opt either way | 01:22 |
| ianw | but i guess you have to code to the smallest | 01:22 |
| *** karthikp_ has quit IRC | 01:22 | |
| *** rfolco has quit IRC | 01:23 | |
| *** karthikp_ has joined #openstack-infra | 01:23 | |
| fungi | yeah, the tightest place we don't have an ephemeral disk is, i believe, ovh where we get only like 80 or maybe it was 70gb for the rootfs | 01:23 |
| fungi | 75gb formatted according to one i just jumped on | 01:24 |
| ianw | fungi: yeah, so d-g repartitions it ... if we reworked things so /opt was the largest it could be (mounted if there, otherwise on fs) and d-g just created a swapfile in /opt ... would that work? not sure if we repartition for a particular reason | 01:24 |
| fungi | yeah, i don't know if the repartitioning is relevant any longer | 01:25 |
| fungi | using swapfiles everywhere would at least provide more consistency | 01:25 |
| fungi | as would getting rid of swap everywhere and letting jobs add it if they need it | 01:25 |
| fungi | could even have a builder macro they can reuse to create swap | 01:26 |
| ianw | it could be a jjb macro ... add X space | 01:26 |
| fungi | jinx | 01:26 |
| ianw | ok, this is relevant for me for the dib jobs that like to stretch their legs space-wise. i'll try getting something concrete together that sets up /opt and modifies d-g to a swapfile ... see how it looks | 01:27 |
| fungi | sounds good | 01:28 |
| *** xarses has joined #openstack-infra | 01:28 | |
| fungi | ephemeral as one large filesystem mounted at /opt would be cleaner than what we have now, at any rate | 01:28 |
| *** yamamoto_ has joined #openstack-infra | 01:28 | |
| fungi | and is still necessary in places like rackspace where we get a very (relatively) small rootfs so need to augment it | 01:29 |
| *** Daisy has joined #openstack-infra | 01:32 | |
| *** armax has quit IRC | 01:34 | |
| *** amotoki has joined #openstack-infra | 01:35 | |
| *** zul has joined #openstack-infra | 01:37 | |
| *** yanyanhu has joined #openstack-infra | 01:38 | |
| *** Liuqing has joined #openstack-infra | 01:39 | |
| *** amitgandhinz has joined #openstack-infra | 01:43 | |
| *** amotoki has quit IRC | 01:44 | |
| *** rajinir has quit IRC | 01:45 | |
| *** amitgandhinz has quit IRC | 01:47 | |
| *** baoli has joined #openstack-infra | 01:49 | |
| nibalizer | ianw: so that commit landed in the 4.x branch but not the 3.x branch | 01:50 |
| *** Daisy has quit IRC | 01:50 | |
| *** amotoki has joined #openstack-infra | 01:51 | |
| *** tonytan4ever has joined #openstack-infra | 01:52 | |
| ianw | nibalizer: hmm, ok. https://tickets.puppetlabs.com/browse/PUP-4997 | 01:54 |
| pleia2 | clarkb: probably right re: 299238 being the one i meant to update | 01:54 |
| *** jed56 has quit IRC | 01:55 | |
| *** rbuzatu has joined #openstack-infra | 01:55 | |
| *** Daisy has joined #openstack-infra | 01:59 | |
| *** EricGonczer_ has joined #openstack-infra | 02:00 | |
| *** Daisy_ has joined #openstack-infra | 02:01 | |
| *** Daisy__ has joined #openstack-infra | 02:02 | |
| *** Daisy_ has quit IRC | 02:02 | |
| *** Daisy has quit IRC | 02:04 | |
| *** salv-orlando has joined #openstack-infra | 02:07 | |
| *** gouthamr_ has quit IRC | 02:07 | |
| *** mtanin___ has quit IRC | 02:08 | |
| *** gouthamr has joined #openstack-infra | 02:08 | |
| *** asettle has joined #openstack-infra | 02:09 | |
| *** yamahata has quit IRC | 02:09 | |
| *** mahatic has quit IRC | 02:09 | |
| *** mahatic has joined #openstack-infra | 02:12 | |
| *** asettle has quit IRC | 02:14 | |
| *** salv-orlando has quit IRC | 02:17 | |
| *** SumitNaiksatam has joined #openstack-infra | 02:19 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add MysqlNoBracketsInternal to enable-tls https://review.openstack.org/343611 | 02:19 |
| nibalizer | ianw: yea its :( | 02:20 |
| nibalizer | maybe we should just puppet4 everything | 02:20 |
| *** rfolco has joined #openstack-infra | 02:20 | |
| *** rfolco has quit IRC | 02:21 | |
| *** rfolco has joined #openstack-infra | 02:21 | |
| ianw | nibalizer: it's not 100% clear in puppet's contributing guide about backports ... it just says "maintainers will do it". i'd be happy to cherry-pick that and propose a pull request ... but do you know where? 3.x branch? | 02:21 |
| *** rfolco has quit IRC | 02:21 | |
| ianw | i.e. https://github.com/puppetlabs/puppet/tree/3.x | 02:21 |
| *** yamahata has joined #openstack-infra | 02:22 | |
| *** Sukhdev has quit IRC | 02:22 | |
| *** Daisy__ has quit IRC | 02:23 | |
| *** Daisy has joined #openstack-infra | 02:24 | |
| stevemar | clarkb: i like this new found interest you have in osc :P | 02:25 |
| *** yamamoto_ has quit IRC | 02:26 | |
| *** shashank_hegde has joined #openstack-infra | 02:26 | |
| bkero | ianw: you could also poke #puppet-dev asking about backport | 02:26 |
| bkero | Or navigate a Jira | 02:27 |
| nibalizer | ianw: yah maybe, they'll just ask you to futz with jira | 02:27 |
| openstackgerrit | Henry Gessau proposed openstack-infra/project-config: Move some neutron coverage jobs to check queue https://review.openstack.org/343979 | 02:27 |
| *** Daisy_ has joined #openstack-infra | 02:27 | |
| nibalizer | ianw: yea I'd ask in #puppet-dev tomorrow morning west-coast time | 02:28 |
| *** eric_lopez has joined #openstack-infra | 02:28 | |
| *** Daisy_ has quit IRC | 02:29 | |
| *** Daisy_ has joined #openstack-infra | 02:29 | |
| *** elo has quit IRC | 02:30 | |
| *** Daisy has quit IRC | 02:31 | |
| *** markvoelker has joined #openstack-infra | 02:32 | |
| *** mahatic has quit IRC | 02:33 | |
| ianw | ok, will look into it | 02:33 |
| *** rfolco has joined #openstack-infra | 02:34 | |
| *** yamahata has quit IRC | 02:34 | |
| *** rfolco has quit IRC | 02:34 | |
| *** sputnik13 has joined #openstack-infra | 02:35 | |
| *** rfolco has joined #openstack-infra | 02:36 | |
| *** rfolco has quit IRC | 02:36 | |
| nibalizer | ianw: we'd also need a release, which they are generally not thrilled about | 02:36 |
| nibalizer | (more releases on 3.x) | 02:36 |
| nibalizer | but hey we can try | 02:36 |
| *** markvoelker has quit IRC | 02:38 | |
| *** mahatic has joined #openstack-infra | 02:39 | |
| *** rossella_s has quit IRC | 02:40 | |
| *** hongbin has joined #openstack-infra | 02:41 | |
| *** rossella_s has joined #openstack-infra | 02:41 | |
| *** baoli has quit IRC | 02:42 | |
| *** shashank_hegde has quit IRC | 02:42 | |
| *** baoli has joined #openstack-infra | 02:43 | |
| *** amitgandhinz has joined #openstack-infra | 02:44 | |
| *** karthikp_ has quit IRC | 02:46 | |
| *** fawadkhaliq has joined #openstack-infra | 02:48 | |
| *** karthikp_ has joined #openstack-infra | 02:48 | |
| *** amitgandhinz has quit IRC | 02:48 | |
| *** yuanying has quit IRC | 02:52 | |
| *** Daisy has joined #openstack-infra | 02:54 | |
| *** Daisy_ has quit IRC | 02:56 | |
| *** mahatic has quit IRC | 03:01 | |
| *** ayoung has quit IRC | 03:01 | |
| *** hurgleburgler has joined #openstack-infra | 03:02 | |
| *** kien-ha has quit IRC | 03:03 | |
| *** mahatic has joined #openstack-infra | 03:04 | |
| *** fawadkhaliq has quit IRC | 03:04 | |
| *** sandanar has joined #openstack-infra | 03:04 | |
| *** EricGonczer_ has quit IRC | 03:05 | |
| *** fawadkhaliq has joined #openstack-infra | 03:05 | |
| *** sputnik13 has quit IRC | 03:06 | |
| *** gouthamr has quit IRC | 03:06 | |
| *** poll0172 has joined #openstack-infra | 03:07 | |
| *** fawadkhaliq has quit IRC | 03:08 | |
| *** akshai has joined #openstack-infra | 03:10 | |
| *** elo has joined #openstack-infra | 03:12 | |
| *** eric_lopez has quit IRC | 03:14 | |
| *** salv-orlando has joined #openstack-infra | 03:16 | |
| *** larainema has quit IRC | 03:19 | |
| *** fawadkhaliq has joined #openstack-infra | 03:23 | |
| *** treaki__ has joined #openstack-infra | 03:23 | |
| *** sputnik13 has joined #openstack-infra | 03:23 | |
| *** salv-orlando has quit IRC | 03:26 | |
| *** akshai_ has joined #openstack-infra | 03:26 | |
| *** treaki_ has quit IRC | 03:27 | |
| *** cody-somerville has quit IRC | 03:27 | |
| *** baoli has quit IRC | 03:28 | |
| *** yamamoto_ has joined #openstack-infra | 03:28 | |
| *** cody-somerville has joined #openstack-infra | 03:28 | |
| *** poll0172 has quit IRC | 03:28 | |
| *** akshai has quit IRC | 03:29 | |
| *** EricGonczer_ has joined #openstack-infra | 03:30 | |
| *** mahatic has quit IRC | 03:30 | |
| *** gongysh has joined #openstack-infra | 03:30 | |
| *** EricGonczer_ has quit IRC | 03:32 | |
| *** poll0172_ has joined #openstack-infra | 03:32 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/diskimage-builder: Remove the escape in the centos7 README file https://review.openstack.org/343997 | 03:32 |
| *** mahatic has joined #openstack-infra | 03:33 | |
| *** EricGonczer_ has joined #openstack-infra | 03:35 | |
| *** yamahata has joined #openstack-infra | 03:36 | |
| *** EricGonczer_ has quit IRC | 03:37 | |
| *** Daisy has quit IRC | 03:40 | |
| *** kushal has quit IRC | 03:43 | |
| *** baoli has joined #openstack-infra | 03:43 | |
| *** kushal has joined #openstack-infra | 03:44 | |
| *** edtubill has joined #openstack-infra | 03:44 | |
| *** amitgandhinz has joined #openstack-infra | 03:45 | |
| *** yuanying has joined #openstack-infra | 03:45 | |
| *** baoli has quit IRC | 03:48 | |
| *** amitgandhinz has quit IRC | 03:49 | |
| *** akshai_ has quit IRC | 03:50 | |
| *** woodster_ has joined #openstack-infra | 03:56 | |
| *** poll0172_ has quit IRC | 03:56 | |
| *** asettle has joined #openstack-infra | 03:57 | |
| *** thorst has joined #openstack-infra | 04:00 | |
| *** hongbin has quit IRC | 04:01 | |
| *** asettle has quit IRC | 04:02 | |
| *** ajmiller has joined #openstack-infra | 04:02 | |
| *** mahatic has quit IRC | 04:03 | |
| *** mahatic has joined #openstack-infra | 04:04 | |
| *** poll0172 has joined #openstack-infra | 04:05 | |
| jpmaxman | fungi: sorry for the delay - the keys are now there /root/keys.txt | 04:06 |
| *** karthikp_ has quit IRC | 04:11 | |
| *** Daisy has joined #openstack-infra | 04:12 | |
| fungi | jpmaxman: thanks! i'll get them added straight away | 04:14 |
| openstackgerrit | Merged openstack-infra/system-config: Propose new admin for the Chinese mailinglist https://review.openstack.org/309243 | 04:15 |
| *** poll0172 has quit IRC | 04:15 | |
| *** shashank_hegde has joined #openstack-infra | 04:16 | |
| *** thorst has quit IRC | 04:19 | |
| *** mahatic_ has joined #openstack-infra | 04:20 | |
| fungi | and done | 04:20 |
| *** gongysh has quit IRC | 04:21 | |
| *** mahatic has quit IRC | 04:21 | |
| *** isaacb has joined #openstack-infra | 04:21 | |
| *** bhavik has joined #openstack-infra | 04:22 | |
| *** shashank_hegde has quit IRC | 04:23 | |
| *** salv-orlando has joined #openstack-infra | 04:24 | |
| *** poll0172 has joined #openstack-infra | 04:24 | |
| *** garyk has joined #openstack-infra | 04:26 | |
| *** poll0172 has quit IRC | 04:26 | |
| *** Srinu has joined #openstack-infra | 04:27 | |
| openstackgerrit | Merged openstack-infra/system-config: Setup ReCaptcha in Wiki to Prevent Spam https://review.openstack.org/342372 | 04:30 |
| pleia2 | ooh :) | 04:31 |
| pleia2 | (or, perhaps I shouldn't have admitted I was around) | 04:31 |
| pleia2 | actually, I'll likely be dinnering by the time it actually applies | 04:31 |
| *** Sukhdev has joined #openstack-infra | 04:32 | |
| Srinu | Hi | 04:34 |
| Srinu | i have two jobs in check pipeline. the nodepool will create a 2 nodepool vms on slave provider. when one job finished(success/failure) it is making the passed/failure slave vm to offline and it also making the second job slave vm to offline. | 04:34 |
| *** salv-orlando has quit IRC | 04:34 | |
| *** markvoelker has joined #openstack-infra | 04:34 | |
| Srinu | did any one face this issue ^^ | 04:34 |
| *** shardy has joined #openstack-infra | 04:39 | |
| *** mahatic has joined #openstack-infra | 04:39 | |
| *** shashank_hegde has joined #openstack-infra | 04:40 | |
| *** mahatic_ has quit IRC | 04:40 | |
| *** markvoelker has quit IRC | 04:40 | |
| *** hurgleburgler has quit IRC | 04:45 | |
| *** amitgandhinz has joined #openstack-infra | 04:45 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Allows to update local.conf from variables https://review.openstack.org/344011 | 04:46 |
| *** amitgandhinz has quit IRC | 04:50 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Allows to update local.conf from variables https://review.openstack.org/344011 | 04:51 |
| *** zhurong has quit IRC | 04:52 | |
| wznoinsk | Srinu: what does the nodepool debug log say about the node that's wrongly deleted (before Deleted jenkins node id: ) ? | 04:53 |
| Srinu | wznoinsk: this is the Jenkins log http://paste.openstack.org/show/533051/ | 04:54 |
| *** salv-orlando has joined #openstack-infra | 04:56 | |
| wznoinsk | Srinu: it looks like your node 514 is down already, jenkins seeing this is marking the worker as shutdown because of that... why is 514 down is the question? | 04:56 |
| *** mahatic_ has joined #openstack-infra | 04:56 | |
| wznoinsk | (down = no connectivity, hence 'SSH channel is closed') | 04:57 |
| *** zhurong has joined #openstack-infra | 04:57 | |
| *** isaacb has quit IRC | 04:57 | |
| wznoinsk | long shot: RAM on the host is out? Srinu | 04:57 |
| Srinu | wznoinsk: when new node added to jenkins it will make offline first and this new node making previous node to offline(515 is new node and 514 is old node) | 04:58 |
| *** mahatic has quit IRC | 04:58 | |
| Srinu | wznoinsk: i have enough RAM | 04:58 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/devstack-gate: Remove q-lbaas from neutron-adv https://review.openstack.org/344015 | 04:59 |
| *** amotoki has quit IRC | 04:59 | |
| *** ajmiller has quit IRC | 04:59 | |
| *** ajmiller has joined #openstack-infra | 05:00 | |
| wznoinsk | your jenkins log doesnt 'take' the node down, only workder when it sees the node down... what does 'take the node offline' ? | 05:00 |
| *** bhavik has quit IRC | 05:00 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Allows to update local.conf from variables https://review.openstack.org/344011 | 05:00 |
| *** bhavik has joined #openstack-infra | 05:01 | |
| *** links has joined #openstack-infra | 05:01 | |
| *** abregman has joined #openstack-infra | 05:01 | |
| *** murali_ has joined #openstack-infra | 05:02 | |
| murali_ | hello | 05:02 |
| murali_ | anyone can be able to help me with tempest testing? | 05:02 |
| murali_ | I am unable to find the way to execute tempest stress test, CLI test etc | 05:02 |
| Srinu | wznoinsk: if i have two jobs in check pipeline. when one finished first will it effect the other job running on node | 05:03 |
| *** jaosorior has joined #openstack-infra | 05:04 | |
| *** clenimar_ has quit IRC | 05:05 | |
| Srinu | wznoinsk: this is my nodepool configuration file http://paste.openstack.org/show/537357/ | 05:05 |
| *** DaiDV has joined #openstack-infra | 05:05 | |
| *** DaiDV has quit IRC | 05:08 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Fix packaging problems for Debian https://review.openstack.org/343342 | 05:12 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Move elements into dib package https://review.openstack.org/344017 | 05:13 |
| *** ajmiller has quit IRC | 05:14 | |
| wznoinsk | Srinu: try not to share your passwords publicly... it's zuul that takes the node offline (sends api request to jenkins), not nodepool | 05:15 |
| wznoinsk | (normally) | 05:15 |
| Srinu | wznoinsk: i did not get you | 05:16 |
| *** mahatic has joined #openstack-infra | 05:16 | |
| wznoinsk | Srinu: zuul tells jenkins to take node (slave) offline | 05:16 |
| *** mahatic_ has quit IRC | 05:17 | |
| Srinu | wznoinsk: ok. in my case both killing eachother..how can i stop | 05:18 |
| *** AndreiB has quit IRC | 05:19 | |
| wznoinsk | run max 1 job per node/slave | 05:20 |
| *** fawadkhaliq has quit IRC | 05:20 | |
| *** kushal has quit IRC | 05:22 | |
| *** psachin has joined #openstack-infra | 05:23 | |
| *** gongysh has joined #openstack-infra | 05:30 | |
| *** kdas__ has joined #openstack-infra | 05:30 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Move elements into dib package https://review.openstack.org/344017 | 05:31 |
| *** larainema has joined #openstack-infra | 05:31 | |
| *** nixpenguin has quit IRC | 05:31 | |
| *** baoli has joined #openstack-infra | 05:31 | |
| *** amotoki has joined #openstack-infra | 05:34 | |
| *** rbuzatu has quit IRC | 05:34 | |
| *** mahatic has quit IRC | 05:34 | |
| *** links has quit IRC | 05:36 | |
| *** binbincong has joined #openstack-infra | 05:37 | |
| *** mahatic has joined #openstack-infra | 05:38 | |
| *** fawadkhaliq has joined #openstack-infra | 05:39 | |
| *** pstack has joined #openstack-infra | 05:39 | |
| *** edtubill has quit IRC | 05:42 | |
| *** fawadk has joined #openstack-infra | 05:42 | |
| *** edtubill has joined #openstack-infra | 05:42 | |
| *** amotoki has quit IRC | 05:42 | |
| *** fawadk has quit IRC | 05:43 | |
| *** fawadk has joined #openstack-infra | 05:43 | |
| *** fawadkhaliq has quit IRC | 05:43 | |
| *** elo has quit IRC | 05:44 | |
| *** asettle has joined #openstack-infra | 05:45 | |
| *** Sukhdev has quit IRC | 05:46 | |
| *** elo has joined #openstack-infra | 05:46 | |
| *** javeriak has joined #openstack-infra | 05:46 | |
| *** amitgandhinz has joined #openstack-infra | 05:46 | |
| *** bhavik has quit IRC | 05:46 | |
| *** edtubill has quit IRC | 05:47 | |
| *** asettle has quit IRC | 05:50 | |
| *** amitgandhinz has quit IRC | 05:51 | |
| *** csmart has joined #openstack-infra | 05:52 | |
| *** murali_ has quit IRC | 05:53 | |
| *** kdas__ is now known as kushal | 05:56 | |
| *** kushal has quit IRC | 05:56 | |
| *** kushal has joined #openstack-infra | 05:56 | |
| csmart | jhesketh: hey josh, just running into a few different errors trying to get a simple patch passed the gate, any ideas? https://review.openstack.org/#/c/343964/ | 05:58 |
| * jhesketh looks | 05:58 | |
| csmart | recent problem appears to connection refused trying to do a pip install of MySQL-python against mirror.ord.rax.openstack.org | 05:58 |
| csmart | although browser seems to connect ok | 05:59 |
| csmart | jhesketh: thanks | 05:59 |
| *** amotoki has joined #openstack-infra | 06:02 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Move elements into dib package https://review.openstack.org/344017 | 06:04 |
| *** salv-orlando has quit IRC | 06:05 | |
| *** mahatic has quit IRC | 06:05 | |
| *** sandanar has quit IRC | 06:06 | |
| *** pstack has quit IRC | 06:06 | |
| *** pstack has joined #openstack-infra | 06:07 | |
| *** mahatic has joined #openstack-infra | 06:08 | |
| *** rcernin has joined #openstack-infra | 06:10 | |
| *** eric_lopez has joined #openstack-infra | 06:10 | |
| *** pgadiya has joined #openstack-infra | 06:10 | |
| jhesketh | csmart: sorry, got distracted by an email... | 06:11 |
| jhesketh | csmart: so it looks like the two errors are different | 06:11 |
| csmart | jhesketh: no rush | 06:11 |
| csmart | yeah | 06:11 |
| jhesketh | and since you're modifying an apt source neither of them appear to be related | 06:11 |
| *** elo has quit IRC | 06:12 | |
| jhesketh | so most likely you're hitting race or transient issues with osa | 06:12 |
| jhesketh | I've fired off another recheck for you | 06:12 |
| csmart | jhesketh: rgr, thanks | 06:12 |
| *** savihou has joined #openstack-infra | 06:13 | |
| *** pstack has quit IRC | 06:13 | |
| *** isaacb has joined #openstack-infra | 06:13 | |
| *** pstack has joined #openstack-infra | 06:14 | |
| jhesketh | csmart: all the logs are indexed by elastic search, so if you're interested in finding the transient error, that can be a good place to start: | 06:15 |
| jhesketh | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Policy%20doesn't%20allow%20os_compute_api%3Aos-flavor-manage%20to%20be%20performed%5C%22 | 06:15 |
| *** tkelsey has joined #openstack-infra | 06:16 | |
| csmart | jhesketh: oh, neat, thanks | 06:17 |
| *** derekjhyang has joined #openstack-infra | 06:17 | |
| *** Ravikiran_K has joined #openstack-infra | 06:17 | |
| jhesketh | csmart: well to qualify that statement, $all is 10 day retention | 06:17 |
| *** elo has joined #openstack-infra | 06:17 | |
| csmart | heh, works for me | 06:18 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Don't offline signing node https://review.openstack.org/344043 | 06:19 |
| AJaeger | pabelanger, fungi, here's the change to not offline the signing node that you discussed yesterday ^ | 06:19 |
| *** eric_lopez has quit IRC | 06:19 | |
| *** tkelsey has quit IRC | 06:20 | |
| *** bhavik has joined #openstack-infra | 06:21 | |
| *** baoli has quit IRC | 06:23 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Don't offline signing node https://review.openstack.org/344043 | 06:24 |
| *** markvoelker has joined #openstack-infra | 06:26 | |
| *** ccamacho has joined #openstack-infra | 06:27 | |
| *** shashank_hegde has quit IRC | 06:30 | |
| *** shashank_hegde has joined #openstack-infra | 06:31 | |
| *** markvoelker has quit IRC | 06:32 | |
| *** pstack has quit IRC | 06:32 | |
| *** shardy has quit IRC | 06:33 | |
| *** Daisy has quit IRC | 06:33 | |
| *** liusheng has quit IRC | 06:33 | |
| *** liusheng has joined #openstack-infra | 06:34 | |
| *** pcaruana has joined #openstack-infra | 06:36 | |
| *** yanyanhu has quit IRC | 06:37 | |
| *** yanyanhu_ has joined #openstack-infra | 06:37 | |
| *** salv-orlando has joined #openstack-infra | 06:38 | |
| *** baoli has joined #openstack-infra | 06:39 | |
| *** pstack has joined #openstack-infra | 06:42 | |
| *** andreas_s has joined #openstack-infra | 06:42 | |
| *** kaisers has quit IRC | 06:43 | |
| *** baoli has quit IRC | 06:44 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Add listen ports to cacti https://review.openstack.org/344050 | 06:44 |
| *** nherciu has joined #openstack-infra | 06:45 | |
| *** ramishra has quit IRC | 06:45 | |
| *** javeriak has quit IRC | 06:45 | |
| *** nmagnezi has joined #openstack-infra | 06:45 | |
| *** ramishra has joined #openstack-infra | 06:47 | |
| *** amitgandhinz has joined #openstack-infra | 06:47 | |
| *** yanyanhu_ has quit IRC | 06:47 | |
| *** yanyanhu_ has joined #openstack-infra | 06:47 | |
| *** elo has quit IRC | 06:48 | |
| *** salv-orl_ has joined #openstack-infra | 06:48 | |
| *** Daisy has joined #openstack-infra | 06:49 | |
| *** Daisy_ has joined #openstack-infra | 06:50 | |
| *** Daisy has quit IRC | 06:50 | |
| *** salv-orlando has quit IRC | 06:51 | |
| *** jlanoux has joined #openstack-infra | 06:51 | |
| *** amitgandhinz has quit IRC | 06:51 | |
| *** elo has joined #openstack-infra | 06:52 | |
| *** nherciu has quit IRC | 06:53 | |
| *** nherciu_ has joined #openstack-infra | 06:53 | |
| *** hparekh has quit IRC | 06:54 | |
| *** shardy has joined #openstack-infra | 06:56 | |
| *** eric_lopez has joined #openstack-infra | 06:56 | |
| *** elo has quit IRC | 06:58 | |
| *** tesseract- has joined #openstack-infra | 06:58 | |
| *** sputnik13 has quit IRC | 06:59 | |
| *** kaisers has joined #openstack-infra | 07:01 | |
| openstackgerrit | Merged openstack-infra/system-config: Add listen ports to cacti https://review.openstack.org/344050 | 07:01 |
| *** watersoul_ has quit IRC | 07:02 | |
| *** watersoul has joined #openstack-infra | 07:02 | |
| *** elo has joined #openstack-infra | 07:03 | |
| *** eric_lopez has quit IRC | 07:05 | |
| *** eric_lopez has joined #openstack-infra | 07:07 | |
| *** hparekh has joined #openstack-infra | 07:08 | |
| *** javeriak has joined #openstack-infra | 07:08 | |
| *** elo has quit IRC | 07:09 | |
| *** mkarpin has joined #openstack-infra | 07:09 | |
| mkarpin | Hello all, i have a third-party CI and i want to make the same job voting for one project and non-voting in other project in zuul, is it possible? | 07:11 |
| *** yaume has joined #openstack-infra | 07:16 | |
| ianw | mkarpin: sounds like you want something like our "-nv" extension ... see project-config zuul where it matches jobs with "-nv" and makes them non-voting | 07:17 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Enable Panko in telemetry integration test https://review.openstack.org/344063 | 07:18 |
| *** ifarkas_afk is now known as ifarkas | 07:18 | |
| AJaeger | mkarpin: as ianw explained, you need two different names for the job, we use the -nv to make this easier. | 07:20 |
| mkarpin | @ianw, @AJaeger, thank you for the answer, will check that way | 07:22 |
| yolanda | good morning | 07:27 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Move elements into dib package https://review.openstack.org/344017 | 07:27 |
| *** tonytan4ever has quit IRC | 07:29 | |
| *** aderyugin has quit IRC | 07:30 | |
| *** rbuzatu has joined #openstack-infra | 07:30 | |
| *** kaisers has quit IRC | 07:30 | |
| *** aderyugin has joined #openstack-infra | 07:31 | |
| *** lezbar__ has quit IRC | 07:32 | |
| *** aderyugin has quit IRC | 07:32 | |
| *** aderyugin has joined #openstack-infra | 07:32 | |
| *** aderyugin has quit IRC | 07:33 | |
| *** lezbar has joined #openstack-infra | 07:33 | |
| *** asettle has joined #openstack-infra | 07:33 | |
| *** yanyanhu has joined #openstack-infra | 07:33 | |
| *** ihrachys has joined #openstack-infra | 07:33 | |
| AJaeger | morning, yolanda ! | 07:34 |
| *** yanyanhu_ has quit IRC | 07:34 | |
| openstackgerrit | Yanyan Hu proposed openstack-infra/project-config: Add coverage job for Senlin https://review.openstack.org/344074 | 07:35 |
| *** aderyugin has joined #openstack-infra | 07:36 | |
| *** arxcruz has joined #openstack-infra | 07:36 | |
| *** aderyugin has quit IRC | 07:36 | |
| *** jlanoux has quit IRC | 07:37 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Remove some Telemetry coverage jobs https://review.openstack.org/344075 | 07:37 |
| *** kaisers has joined #openstack-infra | 07:37 | |
| *** salv-orl_ has quit IRC | 07:38 | |
| *** yaume has quit IRC | 07:38 | |
| *** asettle has quit IRC | 07:38 | |
| *** aderyugin has joined #openstack-infra | 07:40 | |
| *** ihrachys has quit IRC | 07:40 | |
| *** mikelk has joined #openstack-infra | 07:40 | |
| *** yaume has joined #openstack-infra | 07:40 | |
| *** ihrachys has joined #openstack-infra | 07:40 | |
| *** elo has joined #openstack-infra | 07:41 | |
| *** vincentll has joined #openstack-infra | 07:41 | |
| *** jpich has joined #openstack-infra | 07:41 | |
| openstackgerrit | Artur Zarzycki proposed openstack-infra/project-config: Add fuel-ccp-ironic and fuel-ccp-searchlight https://review.openstack.org/337216 | 07:42 |
| *** eric_lopez has quit IRC | 07:43 | |
| *** Na3iL has joined #openstack-infra | 07:44 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Remove some Telemetry coverage jobs https://review.openstack.org/344075 | 07:44 |
| openstackgerrit | Rob Cresswell proposed openstack-infra/project-config: Add non-voting Django 1.10 test to Horizon https://review.openstack.org/335401 | 07:45 |
| *** matthewbodkin has joined #openstack-infra | 07:46 | |
| *** asselin has quit IRC | 07:46 | |
| *** eezhova has joined #openstack-infra | 07:47 | |
| *** amitgandhinz has joined #openstack-infra | 07:48 | |
| *** elo has quit IRC | 07:49 | |
| *** rbuzatu has quit IRC | 07:49 | |
| *** rbuzatu has joined #openstack-infra | 07:49 | |
| *** AndreiB has joined #openstack-infra | 07:51 | |
| *** amitgandhinz has quit IRC | 07:52 | |
| *** dizquierdo has joined #openstack-infra | 07:54 | |
| *** sorantis has joined #openstack-infra | 07:54 | |
| *** salv-orlando has joined #openstack-infra | 07:58 | |
| odyssey4me | csmart FYI for https://review.openstack.org/343964 the issue was not related to an unavailable mirror... the key thing to spot is http://logs.openstack.org/64/343964/1/check/gate-openstack-ansible-dsvm-commit/fc164ab/console.html#_2016-07-19_05_23_01_577767 | 07:59 |
| *** zzzeek has quit IRC | 08:00 | |
| odyssey4me | csmart The job builds a repo first, using the mirrors, then all tasks use the repo instead of the external mirrors. This is to mimic how it would be deployed in a production environment. | 08:00 |
| openstackgerrit | Merged openstack-infra/project-config: Publish Smaug documents https://review.openstack.org/343473 | 08:00 |
| openstackgerrit | Merged openstack-infra/puppet-infra-cookiecutter: Use new infra_spec_helper for gem dependencies https://review.openstack.org/343909 | 08:00 |
| odyssey4me | csmart The issue with the job is unrelated to your patch. We're getting very inconsistent job results and are still trying to track down the root cause. | 08:00 |
| openstackgerrit | Merged openstack-infra/project-config: Don't offline signing node https://review.openstack.org/344043 | 08:00 |
| openstackgerrit | Merged openstack-infra/puppet-infra-cookiecutter: Update cookiecutter metadata suggested year https://review.openstack.org/343913 | 08:01 |
| openstackgerrit | Merged openstack-infra/project-config: Add 'oslo.tools' repo notifications in oslo channel https://review.openstack.org/343951 | 08:02 |
| *** tkelsey has joined #openstack-infra | 08:02 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable Python 3.5 gate on Aodh https://review.openstack.org/343742 | 08:02 |
| AJaeger | yolanda, ianw, jhesketh : Once 344043 is applied via puppet, could either of you take the signing node online, please? We have some jobs in release-post for 21hours now since the signing node is offline. | 08:03 |
| *** zzzeek has joined #openstack-infra | 08:04 | |
| *** lezbar has quit IRC | 08:04 | |
| *** lezbar has joined #openstack-infra | 08:05 | |
| *** [1]Thelo has joined #openstack-infra | 08:06 | |
| yolanda | AJaeger, sure | 08:06 |
| *** asettle has joined #openstack-infra | 08:06 | |
| openstackgerrit | Merged openstack-infra/project-config: Create fuel-nailgun-extension-cluster-upgrade project https://review.openstack.org/341443 | 08:07 |
| *** Thelo has quit IRC | 08:08 | |
| *** [1]Thelo is now known as Thelo | 08:08 | |
| *** jlanoux has joined #openstack-infra | 08:09 | |
| openstackgerrit | Merged openstack-infra/puppet-mediawiki: Clean up unused questy captcha variable https://review.openstack.org/342374 | 08:11 |
| *** jlanoux_ has joined #openstack-infra | 08:11 | |
| *** jlanoux_ has quit IRC | 08:12 | |
| yolanda | AJaeger, jhesketh ... so i talked too soon. jhesketh , how can i set a node back online now? no jenkins, so the process is differenrt | 08:13 |
| *** jlanoux has quit IRC | 08:14 | |
| AJaeger | if nobody knows, let's wait for another infra-root, this is not urgent - and ask that person to document it ;) | 08:14 |
| csmart | odyssey4me: ok, thanks for letting me know! | 08:15 |
| jhesketh | yolanda, AJaeger: did nodepool delete it? | 08:15 |
| yolanda | seems it's set to offline | 08:16 |
| AJaeger | pabelanger was looking at this yesterday, he noticed this... | 08:16 |
| AJaeger | That's why I wrote the change | 08:17 |
| openstackgerrit | Merged openstack-infra/project-config: always show clone output for release tag jobs https://review.openstack.org/343666 | 08:17 |
| *** derekh has joined #openstack-infra | 08:17 | |
| *** shashank_hegde has quit IRC | 08:18 | |
| yolanda | there is that ansible launcher, that seems to be responsible for setting the node offline. But i'm unsure about how to manually set that online again | 08:18 |
| openstackgerrit | Merged openstack-infra/project-config: Keep upper-constraints for periodic neutron UTs against lib changes https://review.openstack.org/343854 | 08:18 |
| *** woodster_ has quit IRC | 08:19 | |
| openstackgerrit | Merged openstack-infra/project-config: add craton project https://review.openstack.org/332470 | 08:20 |
| *** jlanoux has joined #openstack-infra | 08:20 | |
| AJaeger | yolanda: Let's wait for pabelanger or jeblair then - and let's ask them to share the knowledge, please | 08:20 |
| AJaeger | yolanda: thanks for looking | 08:21 |
| yolanda | i looked at system-config documentation but could not find anything related , so yes, let's ask them | 08:21 |
| *** hashar has joined #openstack-infra | 08:21 | |
| *** Guest53586 has quit IRC | 08:22 | |
| jhesketh | AJaeger, yolanda: we just need to restart the zuul-launcher on zlstatic01 | 08:22 |
| *** flaper87 has joined #openstack-infra | 08:22 | |
| *** flaper87 has quit IRC | 08:22 | |
| *** flaper87 has joined #openstack-infra | 08:22 | |
| jhesketh | a graceful restart should do the trick | 08:22 |
| jhesketh | yolanda: want me to do that? | 08:23 |
| yolanda | jhesketh, graceful restart of ansible launcher? | 08:23 |
| jhesketh | yes | 08:23 |
| yolanda | jhesketh, so no individual way of setting a node online as we had on jenkins? | 08:24 |
| *** abregman_ has joined #openstack-infra | 08:24 | |
| jhesketh | yolanda: no sorry | 08:24 |
| yolanda | jhesketh, ok understood. That restart doesn't hurt? | 08:24 |
| *** lucas-afk is now known as lucasagomes | 08:25 | |
| *** abregman has quit IRC | 08:25 | |
| *** abregman_ is now known as abregman | 08:25 | |
| jhesketh | yolanda: a graceful one doesn't... but you issue the command via the cli, not by restarting the init service | 08:25 |
| yolanda | ok | 08:26 |
| openstackgerrit | Merged openstack-infra/project-config: Check and gate Gnocchi against Python 3.5 https://review.openstack.org/343533 | 08:27 |
| *** markvoelker has joined #openstack-infra | 08:29 | |
| *** Daisy_ has quit IRC | 08:29 | |
| *** baoli has joined #openstack-infra | 08:29 | |
| *** Daisy has joined #openstack-infra | 08:29 | |
| *** mhickey has joined #openstack-infra | 08:30 | |
| *** esikachev has joined #openstack-infra | 08:31 | |
| openstackgerrit | Merged openstack-infra/shade: Update hacking version https://review.openstack.org/343915 | 08:32 |
| *** e0ne has joined #openstack-infra | 08:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Add py3 jobs for fuel-ccp project https://review.openstack.org/343515 | 08:33 |
| *** Daisy has quit IRC | 08:33 | |
| jhesketh | yolanda: do you know what to do or did you need help? | 08:33 |
| *** Daisy has joined #openstack-infra | 08:34 | |
| yolanda | jhesketh, i'll do myself so i learn | 08:34 |
| *** baoli has quit IRC | 08:34 | |
| jhesketh | yolanda: sounds good | 08:34 |
| *** e0ne has quit IRC | 08:35 | |
| jhesketh | yolanda: fyi the zuul-launcher isn't very well documented.. what you're looking for is 'zuul-launcher command graceful' which will start the shutdown.. then you need to watch the logs and restart the zuul-launcher service once it has finished | 08:35 |
| yolanda | ah, i was going to just execute the graceful command | 08:36 |
| jhesketh | right, it's a graceful shutdown, not a graceful restart ;-) | 08:37 |
| yolanda | jhesketh, and launcher lives on zuul node? i'm checking there, no zuul-launcher process | 08:38 |
| *** Daisy has quit IRC | 08:38 | |
| openstackgerrit | Merged openstack-infra/system-config: Playbook to run upgrades https://review.openstack.org/312261 | 08:38 |
| *** larainema has quit IRC | 08:39 | |
| yolanda | jhesketh, actually there is an ansible play for that | 08:39 |
| yolanda | playbooks/restart_zuul_launchers.yaml | 08:39 |
| jhesketh | oh yeah! I forgot Paul wrote that | 08:40 |
| jhesketh | sorry! | 08:40 |
| AJaeger | yolanda, jhesketh : does that restart all of them - or only one? | 08:41 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/system-config: Rename attended_upgrades playbook to unattended_upgrades https://review.openstack.org/344107 | 08:41 |
| yolanda | all : zlstatic and zul0* | 08:42 |
| yolanda | but we can limit | 08:42 |
| *** salv-orlando has quit IRC | 08:42 | |
| *** eezhova has quit IRC | 08:42 | |
| jhesketh | yep | 08:42 |
| yolanda | so we shall restart all? | 08:43 |
| yolanda | or static? | 08:43 |
| *** sulo has joined #openstack-infra | 08:43 | |
| *** eezhova has joined #openstack-infra | 08:44 | |
| openstackgerrit | Artur Zarzycki proposed openstack-infra/project-config: Add fuel-ccp-ci group to acls https://review.openstack.org/344108 | 08:44 |
| openstackgerrit | Artur Zarzycki proposed openstack-infra/project-config: Add fuel-ccp-ironic and fuel-ccp-searchlight https://review.openstack.org/337216 | 08:45 |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Run ironic coverage job in the check pipeline as well https://review.openstack.org/344111 | 08:46 |
| jhesketh | yolanda: just static | 08:47 |
| *** Daisy has joined #openstack-infra | 08:47 | |
| yolanda | ok i'm running the play with a limit | 08:47 |
| yolanda | it is waiting for zuul launcher to be really stopped, it has a timeout of 3h 10 min | 08:48 |
| *** amitgandhinz has joined #openstack-infra | 08:48 | |
| jhesketh | yolanda: right, it has to finish any jobs it might be running so it can take some time | 08:49 |
| yolanda | ok, play finished | 08:49 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/project-config: Bump cloud launcher build timeout https://review.openstack.org/344113 | 08:49 |
| *** e0ne has joined #openstack-infra | 08:50 | |
| AJaeger | yolanda: graceful = Do not abort, let jobs finish first | 08:51 |
| yolanda | yes, luckily the job finish fast | 08:51 |
| openstackgerrit | Martin Mágr proposed openstack-infra/tripleo-ci: Add opstools candidate repo https://review.openstack.org/325095 | 08:51 |
| yolanda | so it should be done now, let's see if signing node is online now | 08:51 |
| *** amitgandhinz has quit IRC | 08:53 | |
| AJaeger | one entry has been removed from the release-post queue... | 08:54 |
| yolanda | 2016-07-19 08:49:19,469 DEBUG zuul.LaunchServer: Joined signing01.ci.openstack.org | 08:54 |
| AJaeger | Is it offline again? or do we need to wait longer for the next job to be handled? | 08:54 |
| yolanda | i don't see entries on log telling it's going offline | 08:55 |
| yolanda | mm yes... i still see offline_node_when_complete :( | 08:55 |
| yolanda | going to check again puppet runs on zuul , weird | 08:56 |
| *** jaosorior has quit IRC | 08:57 | |
| AJaeger | So, puppet runs - and double check my change 7fe2e017351ee96bbd8c2cc340158381472ac754 | 08:57 |
| AJaeger | I meant: https://review.openstack.org/344043 | 08:57 |
| *** jaosorior has joined #openstack-infra | 08:58 | |
| yolanda | i saw puppet running on zuul.openstack.org before restarting | 08:58 |
| yolanda | and code is updated on zuul | 08:59 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix comment for persistent nodes https://review.openstack.org/344119 | 08:59 |
| AJaeger | just a nit ^ | 08:59 |
| * AJaeger double checked, the job name is tag-releases - and change 344043 should match it, doesn't it? | 09:01 | |
| *** lezbar has quit IRC | 09:01 | |
| yolanda | yes, looks fine | 09:02 |
| *** isaacb has quit IRC | 09:02 | |
| AJaeger | oh, next job is running! | 09:02 |
| yolanda | that's because i restarted again... | 09:02 |
| AJaeger | So, it did not go offline | 09:02 |
| AJaeger | Ah ;) | 09:02 |
| AJaeger | now 4 changes in queue | 09:02 |
| *** lezbar has joined #openstack-infra | 09:03 | |
| *** megm has quit IRC | 09:03 | |
| yolanda | i'm tailing logs | 09:04 |
| *** electrofelix has joined #openstack-infra | 09:04 | |
| *** megm has joined #openstack-infra | 09:05 | |
| sulo | hi folks, does it take some time for groups to be created in gerrit after a new project change has been merged ? re: 332470 | 09:05 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Enable Panko in telemetry integration test https://review.openstack.org/344063 | 09:06 |
| AJaeger | sulo: that was 45 mins ago - it should not take longer than an hour, so let's wait a bit more, please. And if it's then not created, tell us again. | 09:07 |
| sulo | AJaeger: gotcha, thanks | 09:07 |
| yolanda | AJaeger, same issue, node offline | 09:08 |
| AJaeger | yolanda: consider me completely puzzled | 09:08 |
| *** pstack has quit IRC | 09:09 | |
| *** salv-orlando has joined #openstack-infra | 09:09 | |
| yolanda | i did a restart so jobs that are stucked can pass | 09:09 |
| AJaeger | yolanda: let's try to find the root cause first - those jobs are not important, they can wait. | 09:10 |
| AJaeger | I suggest to leave the rest in the queue and only restart once we identified what's broken - and I have no ideas right now. | 09:10 |
| yolanda | so maybe zuul itself needs a restart, but to my understanding,just a reload when that file changes, shall do the trick | 09:10 |
| *** notnownikki has joined #openstack-infra | 09:10 | |
| *** ociuhandu has joined #openstack-infra | 09:11 | |
| *** megm has quit IRC | 09:12 | |
| *** abregman has quit IRC | 09:14 | |
| *** megm has joined #openstack-infra | 09:14 | |
| AJaeger | looking at http://puppetboard.openstack.org/node/zuul.openstack.org . My change merged at 8:00 UTC, and puppet run at 6:40 and then at 8:58, which is just 12 minutes ago. | 09:14 |
| *** javeriak has quit IRC | 09:14 | |
| *** jaosorior is now known as jaosorior_lunch | 09:15 | |
| AJaeger | And last reconfigure is 8:58 - and you restarted zuul-static *after* that AFAIK. | 09:15 |
| *** salv-orl_ has joined #openstack-infra | 09:16 | |
| AJaeger | I'm out of ideas, will be back online later... | 09:16 |
| *** larainema has joined #openstack-infra | 09:16 | |
| yolanda | AJaeger, yes, i checked timing and restarted later | 09:16 |
| yolanda | there is a OFFLINE_NODE_WHEN_COMPLETE at 09:09 | 09:17 |
| * AJaeger wonders also why openstack/craton is not yet available - something to double check soon | 09:18 | |
| AJaeger | thanks, yolanda | 09:18 |
| *** salv-orlando has quit IRC | 09:19 | |
| *** salv-orl_ has quit IRC | 09:20 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix comment for persistent nodes https://review.openstack.org/344119 | 09:21 |
| *** Daisy has quit IRC | 09:22 | |
| *** Daisy has joined #openstack-infra | 09:22 | |
| *** Daisy_ has joined #openstack-infra | 09:24 | |
| *** Daisy has quit IRC | 09:24 | |
| *** cgalan has joined #openstack-infra | 09:24 | |
| *** zhurong has quit IRC | 09:25 | |
| *** john-dav_ has joined #openstack-infra | 09:26 | |
| *** abregman has joined #openstack-infra | 09:26 | |
| *** caowei has joined #openstack-infra | 09:29 | |
| *** fbo_ is now known as fbo | 09:32 | |
| *** john-dav_ is now known as john-davidge | 09:33 | |
| *** mescanef has joined #openstack-infra | 09:35 | |
| mescanef | hello! please review https://review.openstack.org/#/c/340432/ | 09:35 |
| *** amotoki has quit IRC | 09:36 | |
| *** kzaitsev_mb has joined #openstack-infra | 09:39 | |
| *** pstack has joined #openstack-infra | 09:40 | |
| *** Daisy_ has quit IRC | 09:40 | |
| *** javeriak has joined #openstack-infra | 09:40 | |
| *** Daisy has joined #openstack-infra | 09:41 | |
| *** javeriak has joined #openstack-infra | 09:41 | |
| *** hashar has quit IRC | 09:41 | |
| *** hashar has joined #openstack-infra | 09:42 | |
| *** Daisy has quit IRC | 09:45 | |
| *** caowei has quit IRC | 09:46 | |
| *** sshnaidm|afk has quit IRC | 09:46 | |
| openstackgerrit | Merged openstack-infra/project-config: Added two new repos for Fuel plugins https://review.openstack.org/340432 | 09:47 |
| *** yamahata has quit IRC | 09:48 | |
| *** amitgandhinz has joined #openstack-infra | 09:49 | |
| *** hashar has quit IRC | 09:50 | |
| *** hashar has joined #openstack-infra | 09:50 | |
| *** gongysh has quit IRC | 09:51 | |
| *** pstack has quit IRC | 09:52 | |
| *** tonytan4ever has joined #openstack-infra | 09:52 | |
| *** amitgandhinz has quit IRC | 09:54 | |
| *** _degorenko|afk is now known as degorenko | 09:55 | |
| *** tonytan4ever has quit IRC | 09:57 | |
| *** Srinu has quit IRC | 10:02 | |
| *** ihrachys has quit IRC | 10:02 | |
| *** gouthamr has joined #openstack-infra | 10:04 | |
| frickler | some py35 tests seem to need libssl-dev installed in order to install cryptography, see e.g. http://logs.openstack.org/14/343914/1/check/gate-python-novaclient-python35-nv/e285a7f/console.html#_2016-07-18_20_57_33_145222 should this be added to global bindep? | 10:07 |
| *** pstack has joined #openstack-infra | 10:08 | |
| *** sshnaidm has joined #openstack-infra | 10:09 | |
| *** Liuqing has quit IRC | 10:12 | |
| *** asselin has joined #openstack-infra | 10:13 | |
| *** javeriak has quit IRC | 10:15 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Jewel from Ceph repos https://review.openstack.org/340504 | 10:15 |
| *** shardy has quit IRC | 10:16 | |
| *** daemontool has joined #openstack-infra | 10:18 | |
| *** tosky has joined #openstack-infra | 10:19 | |
| *** daemontool_ has joined #openstack-infra | 10:19 | |
| *** shardy has joined #openstack-infra | 10:20 | |
| *** Na3iL has quit IRC | 10:21 | |
| *** daemontool has quit IRC | 10:23 | |
| wznoinsk | hi infra core et al | 10:24 |
| *** asettle has quit IRC | 10:25 | |
| AJaeger | frickler: we basically froze global bindep, you should add files to novaclient's other-requirements.txt. novaclient uses that one already, so enhance it, please | 10:25 |
| wznoinsk | I'm using zuul 2.1.1dev149, apart from openstack/neutron, nova and devstack I'm triggering running test builds (as per my layout.yaml) I also saw issues when a project is not in layout.yaml it's marked as Unknown by Zuul and it goes into endless loop... are you aware of that behaviour? | 10:26 |
| *** ihrachys has joined #openstack-infra | 10:26 | |
| *** fawadk has quit IRC | 10:28 | |
| *** Na3iL has joined #openstack-infra | 10:29 | |
| *** jlanoux_ has joined #openstack-infra | 10:29 | |
| *** jlanoux has quit IRC | 10:29 | |
| *** fawadkhaliq has joined #openstack-infra | 10:30 | |
| *** itisha has quit IRC | 10:30 | |
| *** fawadkhaliq has quit IRC | 10:30 | |
| *** fawadkhaliq has joined #openstack-infra | 10:30 | |
| *** yanyanhu has quit IRC | 10:31 | |
| *** abregman has quit IRC | 10:32 | |
| *** markvoelker has quit IRC | 10:33 | |
| *** javeriak has joined #openstack-infra | 10:33 | |
| *** fawadkhaliq has quit IRC | 10:35 | |
| *** pt_15 has quit IRC | 10:36 | |
| *** eezhova has quit IRC | 10:39 | |
| *** pstack has quit IRC | 10:39 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Complex priorities UI in stories https://review.openstack.org/312666 | 10:39 |
| *** rodrigods has quit IRC | 10:44 | |
| *** rhallisey has joined #openstack-infra | 10:44 | |
| *** rodrigods has joined #openstack-infra | 10:44 | |
| *** jlanoux has joined #openstack-infra | 10:44 | |
| *** Goneri has joined #openstack-infra | 10:44 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Run ironic coverage jobs in the check pipeline as well https://review.openstack.org/344111 | 10:45 |
| frickler | AJaeger: yes, I saw that, thx. https://review.openstack.org/344151 | 10:45 |
| *** abregman has joined #openstack-infra | 10:45 | |
| *** pstack has joined #openstack-infra | 10:46 | |
| *** jlanoux_ has quit IRC | 10:47 | |
| *** Ravikiran_K has quit IRC | 10:47 | |
| *** bhavik has quit IRC | 10:49 | |
| *** amitgandhinz has joined #openstack-infra | 10:50 | |
| *** pstack has quit IRC | 10:51 | |
| *** ccamacho is now known as ccamacho|lunch | 10:52 | |
| *** yamamoto_ has quit IRC | 10:52 | |
| *** nherciu__ has joined #openstack-infra | 10:53 | |
| *** asettle has joined #openstack-infra | 10:53 | |
| *** claudiub has joined #openstack-infra | 10:54 | |
| *** rbuzatu has quit IRC | 10:54 | |
| *** amitgandhinz has quit IRC | 10:54 | |
| *** sorantis has quit IRC | 10:55 | |
| *** nherciu_ has quit IRC | 10:56 | |
| *** lezbar has quit IRC | 10:57 | |
| *** lezbar has joined #openstack-infra | 10:58 | |
| *** Na3iL has quit IRC | 10:59 | |
| *** rbuzatu has joined #openstack-infra | 11:00 | |
| *** fawadkhaliq has joined #openstack-infra | 11:01 | |
| *** jaosorior_lunch is now known as jaosorior | 11:03 | |
| AJaeger | thanks, frickler. Do you know which dependency drags this in? | 11:06 |
| *** daemontool__ has joined #openstack-infra | 11:06 | |
| *** daemontool_ has quit IRC | 11:09 | |
| *** rbuzatu has quit IRC | 11:11 | |
| *** pstack has joined #openstack-infra | 11:12 | |
| *** eezhova has joined #openstack-infra | 11:13 | |
| *** sorantis has joined #openstack-infra | 11:13 | |
| *** rbuzatu has joined #openstack-infra | 11:14 | |
| *** eezhova has quit IRC | 11:19 | |
| *** pstack has quit IRC | 11:20 | |
| frickler | AJaeger: libssl-doc zlib1g-dev | 11:21 |
| *** pstack has joined #openstack-infra | 11:21 | |
| *** fawadkhaliq has quit IRC | 11:23 | |
| *** fawadkhaliq has joined #openstack-infra | 11:24 | |
| sulo | AJaeger: re 332470, the project is still not available. is there a job i can check for this ? | 11:24 |
| *** weshay has joined #openstack-infra | 11:25 | |
| *** pstack has quit IRC | 11:26 | |
| *** eezhova has joined #openstack-infra | 11:26 | |
| *** Liuqing has joined #openstack-infra | 11:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Add fuel-ccp-ci group to acls https://review.openstack.org/344108 | 11:33 |
| *** pstack has joined #openstack-infra | 11:33 | |
| *** isaacb has joined #openstack-infra | 11:34 | |
| yolanda | AJaeger, manage-projects log is empty, something is going on | 11:34 |
| openstackgerrit | Merged openstack-infra/project-config: Enable Panko in telemetry integration test https://review.openstack.org/344063 | 11:36 |
| AJaeger | frickler: I meant the other way - which python package in your requirements needs libssl? | 11:36 |
| *** yamamoto has joined #openstack-infra | 11:37 | |
| AJaeger | sulo, see yolanda's comment from 3 mins ago - something is wrong there. | 11:37 |
| yolanda | i see ansible running remote_puppet_else, that is the one that applies to review, but i don't see any output on logs | 11:37 |
| *** ldnunes has joined #openstack-infra | 11:37 | |
| *** javeriak has quit IRC | 11:38 | |
| openstackgerrit | Merged openstack-infra/project-config: Add non-voting Django 1.10 test to Horizon https://review.openstack.org/335401 | 11:38 |
| yolanda | running that (remote_puppet_git) manually now | 11:39 |
| yolanda | fatal: [review.openstack.org]: FAILED! => {"failed": true, "msg": "'dict object' has no attribute 'gitinfo'"} | 11:40 |
| yolanda | mm, i remember i had to add localhost as well, sorry | 11:40 |
| openstackgerrit | Merged openstack-infra/project-config: Remove some Telemetry coverage jobs https://review.openstack.org/344075 | 11:41 |
| *** Liuqing has quit IRC | 11:41 | |
| *** openstackgerrit has quit IRC | 11:41 | |
| *** Daisy has joined #openstack-infra | 11:41 | |
| *** openstackgerrit has joined #openstack-infra | 11:41 | |
| *** javeriak has joined #openstack-infra | 11:41 | |
| *** Liuqing has joined #openstack-infra | 11:42 | |
| *** claudiub|2 has joined #openstack-infra | 11:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Add coverage job for Senlin https://review.openstack.org/344074 | 11:42 |
| *** claudiub has quit IRC | 11:43 | |
| *** yamamoto has quit IRC | 11:43 | |
| *** ccamacho|lunch has quit IRC | 11:44 | |
| *** yamamoto has joined #openstack-infra | 11:44 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Install Ceph Jewel from Ceph repos https://review.openstack.org/340504 | 11:44 |
| *** Daisy has quit IRC | 11:46 | |
| AJaeger | yolanda: http://git.openstack.org/cgit/openstack/craton/ exists - but is empty. | 11:46 |
| yolanda | manage-projects is running now, and now there is content on logs | 11:47 |
| AJaeger | yeah! | 11:47 |
| yolanda | after it finishes, i'll check replication | 11:47 |
| AJaeger | why was it stuck before? ;( | 11:47 |
| AJaeger | yeah, imported now | 11:48 |
| AJaeger | sulo: https://review.openstack.org/#/admin/projects/openstack/craton | 11:48 |
| yolanda | AJaeger, not sure, i saw an error about an invalid char on syslog, but i'm not sure if that caused the problem | 11:48 |
| *** yamamoto has quit IRC | 11:48 | |
| AJaeger | yolanda: https://github.com/openstack/craton exists and has content! | 11:48 |
| yolanda | woot! | 11:48 |
| sulo | AJaeger: yolanda: cool, thanks guys | 11:49 |
| *** lucasagomes is now known as lucas-hungry | 11:49 | |
| yolanda | sulo, glad to help | 11:49 |
| yolanda | AJaeger, i also have been checking about the problem with signing node, and no idea, your change looks good and zuul shall have picked it, but doesn't | 11:49 |
| AJaeger | sulo, now sean roberts needs to be added to the groups - but you can already send in changes and review with +1/-1 | 11:50 |
| sulo | AJaeger: ah, i was looking at adding member .. | 11:50 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara-dashboard] integration job to non-voting https://review.openstack.org/344187 | 11:50 |
| *** pstack has quit IRC | 11:51 | |
| *** dizquierdo has quit IRC | 11:51 | |
| openstackgerrit | Sirushti Murugesan proposed openstack-infra/project-config: Add experimental tempest-dsvm xenial py3 job to devstack https://review.openstack.org/339778 | 11:51 |
| *** amitgandhinz has joined #openstack-infra | 11:51 | |
| AJaeger | yolanda: I'm really curious on what the solution will be... | 11:51 |
| sulo | AJaeger: so sean need to add me first to the groups first for me to add others? | 11:51 |
| sulo | i dont see any members in both craton-* groups | 11:52 |
| *** pstack has joined #openstack-infra | 11:52 | |
| *** hosanai has quit IRC | 11:53 | |
| openstackgerrit | Merged openstack-infra/project-config: Bump cloud launcher build timeout https://review.openstack.org/344113 | 11:55 |
| AJaeger | sulo: correct, we add - on demand - the initial committer to the groups and that person then can add others. | 11:55 |
| *** pstack has quit IRC | 11:55 | |
| *** pilgrimstack has quit IRC | 11:55 | |
| sulo | AJaeger: ok thanks | 11:55 |
| *** amitgandhinz has quit IRC | 11:55 | |
| *** reed has quit IRC | 11:56 | |
| *** markmcclain has quit IRC | 11:56 | |
| *** vern has quit IRC | 11:58 | |
| *** markmcclain has joined #openstack-infra | 12:00 | |
| *** pstack has joined #openstack-infra | 12:01 | |
| *** vern has joined #openstack-infra | 12:01 | |
| *** reed has joined #openstack-infra | 12:01 | |
| *** oanson has joined #openstack-infra | 12:01 | |
| *** pstack has quit IRC | 12:03 | |
| *** psilvad has joined #openstack-infra | 12:03 | |
| openstackgerrit | Henry Gessau proposed openstack-infra/project-config: Move/add neutron coverage jobs to check queue https://review.openstack.org/343979 | 12:03 |
| openstackgerrit | Sirushti Murugesan proposed openstack-infra/project-config: Add experimental tempest-dsvm xenial py3 job to devstack https://review.openstack.org/339778 | 12:05 |
| *** markusry has joined #openstack-infra | 12:05 | |
| *** ccamacho has joined #openstack-infra | 12:05 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:07 | |
| *** psilvad has quit IRC | 12:08 | |
| openstackgerrit | Henry Gessau proposed openstack-infra/project-config: Do not special-case py34 job for networking-ovn https://review.openstack.org/344197 | 12:13 |
| frickler | AJaeger: ah, sorry I misunderstood, that would be cryptography, see the log link I posted above | 12:15 |
| openstackgerrit | Henry Gessau proposed openstack-infra/project-config: Do not special-case py34 job for networking-ovn https://review.openstack.org/344197 | 12:16 |
| *** psilvad has joined #openstack-infra | 12:17 | |
| *** pstack has joined #openstack-infra | 12:18 | |
| HenryG | AJaeger: I really appreciate your advice on my project-config reviews, thanks! I feel like a bumbling idiot in those massive yaml files. :) | 12:18 |
| *** edmondsw has joined #openstack-infra | 12:21 | |
| *** Goneri has quit IRC | 12:22 | |
| *** psilvad has quit IRC | 12:23 | |
| *** fawadkhaliq has quit IRC | 12:25 | |
| *** yamamoto has joined #openstack-infra | 12:27 | |
| *** garyk has quit IRC | 12:27 | |
| *** EricGonczer_ has joined #openstack-infra | 12:27 | |
| *** zhurong has joined #openstack-infra | 12:29 | |
| *** markvoelker has joined #openstack-infra | 12:29 | |
| *** trown|outtypewww is now known as trown | 12:29 | |
| *** pt_15 has joined #openstack-infra | 12:30 | |
| AJaeger | HenryG: no worries, it takes some time to get used to them and that's why I try to keep some order;) | 12:31 |
| *** mdrabe has joined #openstack-infra | 12:32 | |
| *** flepied has quit IRC | 12:32 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Move Designate Grenade job to non voting from experimental https://review.openstack.org/343657 | 12:35 |
| *** markvoelker has quit IRC | 12:35 | |
| *** Goneri has joined #openstack-infra | 12:37 | |
| *** pstack has quit IRC | 12:38 | |
| openstackgerrit | Miles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package https://review.openstack.org/344214 | 12:38 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Fix Gnocchi py35 gate https://review.openstack.org/344215 | 12:39 |
| *** rlandy has joined #openstack-infra | 12:40 | |
| *** pstack has joined #openstack-infra | 12:40 | |
| *** sshnaidm|afk is now known as sshnaidm | 12:40 | |
| *** dprince has joined #openstack-infra | 12:41 | |
| *** pstack has quit IRC | 12:42 | |
| *** pradk has quit IRC | 12:44 | |
| *** markvoelker has joined #openstack-infra | 12:44 | |
| openstackgerrit | Honza Pokorny proposed openstack-infra/project-config: Upload tarballs for tripleo-ui https://review.openstack.org/343834 | 12:45 |
| *** kun_huang has quit IRC | 12:46 | |
| *** markvoelker_ has joined #openstack-infra | 12:46 | |
| *** cbader has joined #openstack-infra | 12:46 | |
| *** markvoelker has quit IRC | 12:46 | |
| *** kun_huang has joined #openstack-infra | 12:46 | |
| AJaeger | sileht: I suggest that you discuss the problem you try to solved with 344215 here with clarkb (in 2hours or so). He has been working on xenial enablement and it might be that his plans will make your changes completely unneeded. | 12:47 |
| openstackgerrit | Miles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package https://review.openstack.org/344214 | 12:47 |
| *** pilgrimstack has joined #openstack-infra | 12:48 | |
| sileht | AJaeger, good to known thanks | 12:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Lay the groundwork for multi-cloud in unit tests https://review.openstack.org/343916 | 12:50 |
| *** Na3iL has joined #openstack-infra | 12:50 | |
| *** _ari_ has joined #openstack-infra | 12:51 | |
| *** raildo has joined #openstack-infra | 12:51 | |
| *** amitgandhinz has joined #openstack-infra | 12:51 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Fix Gnocchi py35 gate https://review.openstack.org/344215 | 12:52 |
| *** rbuzatu has quit IRC | 12:54 | |
| *** amitgandhinz has quit IRC | 12:56 | |
| *** Ravikiran_K has joined #openstack-infra | 12:57 | |
| *** weshay is now known as weshay_mtg | 12:57 | |
| *** flepied has joined #openstack-infra | 12:57 | |
| *** rbuzatu has joined #openstack-infra | 13:00 | |
| *** isaacb has quit IRC | 13:00 | |
| *** e0ne has quit IRC | 13:02 | |
| *** reed has quit IRC | 13:02 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Promote OSA-OVS testing job from experimental to check https://review.openstack.org/344222 | 13:02 |
| *** e0ne has joined #openstack-infra | 13:03 | |
| *** jsavak has joined #openstack-infra | 13:05 | |
| *** reed has joined #openstack-infra | 13:05 | |
| *** lucas-hungry is now known as lucasagomes | 13:06 | |
| *** hashar is now known as hasharAway | 13:09 | |
| *** cgalan_ has joined #openstack-infra | 13:10 | |
| *** thiagop-afk is now known as thiagop | 13:11 | |
| *** maishsk has joined #openstack-infra | 13:13 | |
| *** yamamoto has quit IRC | 13:13 | |
| *** cgalan_ has quit IRC | 13:13 | |
| *** baoli has joined #openstack-infra | 13:13 | |
| *** maishsk has quit IRC | 13:14 | |
| *** maishsk has joined #openstack-infra | 13:14 | |
| *** esberglu has joined #openstack-infra | 13:16 | |
| *** cgalan_ has joined #openstack-infra | 13:16 | |
| *** hieulq_ has joined #openstack-infra | 13:17 | |
| *** baoli has quit IRC | 13:18 | |
| *** yamamoto has joined #openstack-infra | 13:18 | |
| *** yamamoto has quit IRC | 13:18 | |
| *** d0ugal has joined #openstack-infra | 13:18 | |
| *** cfarquhar has joined #openstack-infra | 13:20 | |
| *** cfarquhar has quit IRC | 13:20 | |
| *** cfarquhar has joined #openstack-infra | 13:20 | |
| *** cgalan_ is now known as cgalan-mobi | 13:20 | |
| *** sheeprine has quit IRC | 13:20 | |
| clarkb | sileht: AJaeger I dont see any context but currently working through some issues related to how we do gearman job registrations. once thats done I hope to switch all of the python-jobs users over to xenial on master | 13:21 |
| clarkb | then follow with seitching the devstck jobs | 13:22 |
| *** mtanino has joined #openstack-infra | 13:22 | |
| *** eezhova has quit IRC | 13:23 | |
| *** cfarquhar has quit IRC | 13:23 | |
| sileht | clarkb, if this fix our gate soon today/tommorow I'm fine with the global solution | 13:23 |
| *** salv-orlando has joined #openstack-infra | 13:23 | |
| *** sheeprine has joined #openstack-infra | 13:23 | |
| sileht | otherwise We can merge my workaround, or I can put the py35 jobs non-voting | 13:23 |
| AJaeger | clarkb: review 344215 - that's a tox job that needs py35 but runs on trusty, so they need it running on xenial | 13:24 |
| *** hasharAway has quit IRC | 13:24 | |
| *** salv-orl_ has joined #openstack-infra | 13:25 | |
| clarkb | ah yes those things... | 13:25 |
| *** akshai has joined #openstack-infra | 13:25 | |
| clarkb | my secret hope is that projcts would consolofate and be more standardy | 13:26 |
| clarkb | *consolidate | 13:26 |
| clarkb | there is little reason for those jobs to exist imo | 13:26 |
| AJaeger | clarkb: removing this for now is one option - and then tackle it once all the changes are done... | 13:26 |
| clarkb | just test against mysql and postgres in the normal py35 job lile everyone else? | 13:27 |
| *** sheeprine has quit IRC | 13:27 | |
| *** eezhova has joined #openstack-infra | 13:27 | |
| *** salv-or__ has joined #openstack-infra | 13:27 | |
| *** psilvad has joined #openstack-infra | 13:27 | |
| openstackgerrit | Alex Kavanagh proposed openstack-infra/project-config: Add charm-barbican, and related https://review.openstack.org/340945 | 13:27 |
| clarkb | note I didnt touch any of those with the py35 job adds. I dont know where those jobs came from | 13:28 |
| clarkb | for this very reason | 13:28 |
| *** cfarquhar has joined #openstack-infra | 13:29 | |
| *** cfarquhar has quit IRC | 13:29 | |
| *** cfarquhar has joined #openstack-infra | 13:29 | |
| clarkb | I will leave comments on how to keep those jobs in a more future compatible way though | 13:29 |
| AJaeger | clarkb: they were added manually - and in hindsight: Shouldn't have merged because they could not work at all. | 13:29 |
| *** salv-orlando has quit IRC | 13:29 | |
| *** cgalan-mobi has quit IRC | 13:29 | |
| *** salv-orlando has joined #openstack-infra | 13:29 | |
| *** sheeprine has joined #openstack-infra | 13:30 | |
| *** cgalan-mobi has joined #openstack-infra | 13:30 | |
| *** tonytan4ever has joined #openstack-infra | 13:30 | |
| *** salv-orl_ has quit IRC | 13:30 | |
| *** dtantsur is now known as dtantsur|mtg | 13:31 | |
| *** amotoki has joined #openstack-infra | 13:31 | |
| *** lezbar has quit IRC | 13:31 | |
| *** lezbar__ has joined #openstack-infra | 13:33 | |
| *** salv-or__ has quit IRC | 13:33 | |
| *** ljjjustin has quit IRC | 13:35 | |
| *** yamamoto has joined #openstack-infra | 13:35 | |
| clarkb | sileht: AJaeger ok commented on how to set those jobs up | 13:35 |
| *** tonytan4ever has quit IRC | 13:35 | |
| AJaeger | thanks, clarkb. Your description matches what I expected, just wasn't completely sure... | 13:35 |
| *** cgalan-mobi has quit IRC | 13:36 | |
| *** ljjjustin has joined #openstack-infra | 13:36 | |
| *** eezhova has quit IRC | 13:37 | |
| *** moravec has quit IRC | 13:37 | |
| *** ayoung has joined #openstack-infra | 13:38 | |
| *** cardeois has joined #openstack-infra | 13:38 | |
| sileht | clarkb, does the suffixing with the image already works ? Or should I create the template ? | 13:38 |
| *** amotoki has quit IRC | 13:38 | |
| *** d0ugal has quit IRC | 13:39 | |
| *** amotoki has joined #openstack-infra | 13:39 | |
| *** dizquierdo has joined #openstack-infra | 13:39 | |
| clarkb | sileht: you have to do it. I havent gotten around to dealing with these one offs yet | 13:40 |
| sileht | clarkb, ok thanks | 13:40 |
| *** BigWillie has joined #openstack-infra | 13:40 | |
| clarkb | I will do it for the standard python-jobs and for the base set of dsvm jobs whoch should get us 90℅ there | 13:41 |
| *** eezhova has joined #openstack-infra | 13:41 | |
| clarkb | then it will be a bit of work to get through the rest | 13:41 |
| *** mriedem has joined #openstack-infra | 13:41 | |
| clarkb | my nodepool change will hopefullyerge today and function properly with updated gear so i can start pushing on the large scale job updates | 13:42 |
| *** yamamoto has quit IRC | 13:42 | |
| *** mriedem has left #openstack-infra | 13:42 | |
| *** mriedem has joined #openstack-infra | 13:42 | |
| *** d0ugal has joined #openstack-infra | 13:43 | |
| *** harlowja has joined #openstack-infra | 13:44 | |
| *** hamzy has quit IRC | 13:44 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Fix Gnocchi py35 gate https://review.openstack.org/344215 | 13:44 |
| sileht | clarkb, so something like this ^ should looks like your future works ? | 13:44 |
| *** hichihara has joined #openstack-infra | 13:45 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Fix Gnocchi py35 gate https://review.openstack.org/344215 | 13:45 |
| *** amitgandhinz has joined #openstack-infra | 13:46 | |
| *** e0ne has quit IRC | 13:46 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update GitHub pull request builder plugin https://review.openstack.org/335632 | 13:46 |
| clarkb | sileht: yes though I will likely make node a parmeter too then just have one job | 13:47 |
| clarkb | sileht: er one job template | 13:47 |
| *** d0ugal has quit IRC | 13:47 | |
| sileht | clarkb, I dunno how to do that without rewritting all yamls to suffix jobs with -ubuntu-trusty everywhere | 13:48 |
| clarkb | yes we will have to do that eventually | 13:48 |
| clarkb | but for now you could make the new template and only use it for xenial | 13:49 |
| *** amotoki has quit IRC | 13:49 | |
| sileht | I see | 13:49 |
| clarkb | then when we get to the point of changing the other job names we switch them to this new template | 13:49 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update OpenShift Pipeline plugin https://review.openstack.org/334632 | 13:49 |
| *** xarses has quit IRC | 13:50 | |
| *** javeriak has quit IRC | 13:51 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Fix Gnocchi py35 gate https://review.openstack.org/344215 | 13:52 |
| *** e0ne has joined #openstack-infra | 13:53 | |
| sileht | clarkb, that ^ should do the job so | 13:53 |
| *** tonytan4ever has joined #openstack-infra | 13:53 | |
| *** hamzy has joined #openstack-infra | 13:54 | |
| AJaeger | sileht: not completely, see my comment. But quite close ;) | 13:54 |
| sileht | AJaeger, indead :p | 13:54 |
| *** esberglu_ has joined #openstack-infra | 13:55 | |
| AJaeger | sileht, clarkb : This needs AFAIU also some condition to run only on master and future stable branches. | 13:55 |
| sileht | AJaeger, we already have this condition | 13:55 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: Fix Gnocchi py35 gate https://review.openstack.org/344215 | 13:56 |
| sileht | I will check it's still valide | 13:56 |
| *** esberglu has quit IRC | 13:56 | |
| *** esberglu_ is now known as esberglu | 13:56 | |
| *** amitgandhinz has quit IRC | 13:57 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Clear up merger functions https://review.openstack.org/344248 | 13:57 |
| *** nherciu_ has joined #openstack-infra | 13:57 | |
| *** amitgandhinz has joined #openstack-infra | 13:58 | |
| *** david-lyle has joined #openstack-infra | 13:58 | |
| *** yamahata has joined #openstack-infra | 13:59 | |
| *** sputnik13 has joined #openstack-infra | 13:59 | |
| *** Julien-zte has joined #openstack-infra | 14:00 | |
| *** Julien-zte has quit IRC | 14:00 | |
| *** pradk has joined #openstack-infra | 14:00 | |
| *** nherciu__ has quit IRC | 14:01 | |
| *** Guest73831 is now known as med_ | 14:01 | |
| *** yaume_ has joined #openstack-infra | 14:01 | |
| *** med_ has quit IRC | 14:01 | |
| *** med_ has joined #openstack-infra | 14:01 | |
| *** mtanino has quit IRC | 14:02 | |
| *** AJaeger has quit IRC | 14:02 | |
| *** amotoki has joined #openstack-infra | 14:02 | |
| *** gordc has joined #openstack-infra | 14:02 | |
| *** yamamoto has joined #openstack-infra | 14:03 | |
| *** yaume has quit IRC | 14:04 | |
| *** rbrndt__ has joined #openstack-infra | 14:04 | |
| pabelanger | morning | 14:06 |
| pabelanger | clarkb: seen your comments about AFS mirrors, yes we should lump them all together and bring them online | 14:07 |
| clarkb | pabelanger: cool I think I reviewed 2 of the 3 reprepro mirror proposals | 14:07 |
| clarkb | will try to get to the third soonish (once actually awake and breakfasted) | 14:08 |
| clarkb | pabelanger: maybe you can double check my comments on the mariadb one | 14:08 |
| *** jcoufal has joined #openstack-infra | 14:08 | |
| *** mriedem has quit IRC | 14:10 | |
| *** cgalan-mobi has joined #openstack-infra | 14:10 | |
| *** harlowja has quit IRC | 14:11 | |
| *** hieulq_ has quit IRC | 14:11 | |
| pabelanger | clarkb: sure | 14:11 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zuul: Avoid offlining nodes on static launchers https://review.openstack.org/344261 | 14:12 |
| *** Liuqing has quit IRC | 14:12 | |
| fungi | jeblair: clarkb: pabelanger: yolanda: ^ taking a stab at a zuul-launcher fuse for static node offlining | 14:13 |
| *** cgalan-mobi has quit IRC | 14:13 | |
| jhesketh | fungi: pabelanger had already started that https://review.openstack.org/#/c/343921/ | 14:14 |
| * jhesketh nearly wrote a change too, then we could have had 3 competing ones! | 14:14 | |
| fungi | jhesketh: oh, excellent. i'll abandon and review | 14:14 |
| pabelanger | fungi: jhesketh: Ya, mine was just a stab in the dark last night. | 14:14 |
| jhesketh | fungi: well the approaches are different | 14:15 |
| yolanda | fungi, pabelanger, have you figured the problem we have today? | 14:15 |
| fungi | interestingly it doesn't merge-conflict with mine. we must have taken different routes | 14:15 |
| fungi | yolanda: i saw your discussion in scrollback | 14:15 |
| pabelanger | yolanda: yes, I am graceful restarting zlstatic01.o.o now | 14:15 |
| yolanda | fungi, i just left offline, because on each run, the node was offline, even with AJaeger change | 14:15 |
| *** jsavak has quit IRC | 14:16 | |
| yolanda | looks as zuul is not applying or doesn't like the change | 14:16 |
| pabelanger | I was not sure if you did that or not | 14:16 |
| fungi | yolanda: i don't think configuration is going to bring it back online magically | 14:16 |
| fungi | you have to restart the launcher | 14:16 |
| yolanda | fungi, i restarted a pair of times | 14:16 |
| fungi | oh, interesting | 14:16 |
| pabelanger | Oh | 14:16 |
| yolanda | but then job is executed, and zuul set that offline as soon as the job finished | 14:16 |
| pabelanger | ya, it should have worked then | 14:16 |
| fungi | so that job is continuing to offline it? | 14:16 |
| yolanda | yep | 14:17 |
| pabelanger | which review was the regex patch? | 14:17 |
| yolanda | on each restart, one job was picked, but then when job finished that, node was offline | 14:17 |
| fungi | probably need to look in the debug configuration for the scheduler then | 14:17 |
| *** rajinir has joined #openstack-infra | 14:17 | |
| *** yaume_ has quit IRC | 14:17 | |
| *** hieulq_ has joined #openstack-infra | 14:17 | |
| yolanda | fungi, pabelanger, https://review.openstack.org/344043 | 14:17 |
| *** d0ugal has joined #openstack-infra | 14:18 | |
| pabelanger | yolanda: you restarted zlstatic01.o.o? | 14:19 |
| yolanda | pabelanger, several times | 14:19 |
| yolanda | using the playbook | 14:19 |
| *** larainema has quit IRC | 14:19 | |
| yolanda | see the logs on static01 | 14:19 |
| pabelanger | ya, looking now | 14:19 |
| yolanda | you will see signing going online, picking a job, then going offline | 14:19 |
| jhesketh | can anybody confirm the host key for zuul for me please? | 14:20 |
| * jhesketh thinks we should publish all our host keys somewhere | 14:21 | |
| *** cgalan-mobi has joined #openstack-infra | 14:21 | |
| * fungi votes for sshfp records in dns | 14:22 | |
| *** sorantis has quit IRC | 14:23 | |
| *** d0ugal has quit IRC | 14:23 | |
| *** d0ugal has joined #openstack-infra | 14:23 | |
| fungi | jhesketh: 2048 34:89:fd:8f:8a:94:51:e2:3d:37:d4:f0:ab:7e:56:6a root@zuul (RSA) | 14:23 |
| jhesketh | fungi: wouldn't dns be an easy target if you were mitm? | 14:23 |
| jhesketh | fungi: thanks :-) | 14:23 |
| fungi | jhesketh: sshfp is meant to be used in conjunction with dnssec | 14:24 |
| *** cgalan-mobi has quit IRC | 14:24 | |
| jhesketh | fair enough | 14:25 |
| *** psachin has quit IRC | 14:25 | |
| fungi | jhesketh: i _was_ in favor of puppeting an /etc/known_hosts file with all our servers' public host keys in it, but concern was expressed that would complicate automated launching of new servers | 14:25 |
| *** andreas_s has quit IRC | 14:26 | |
| jhesketh | append? | 14:26 |
| rcarrillocruz | fungi: complicate as in what sense? | 14:27 |
| *** bhunter71 has quit IRC | 14:27 | |
| fungi | as in turning up a new server would generate a proposal commit back into gerrit which would need to be reviewed, so you couldn't automate launching a new server with the approval of just one commit | 14:27 |
| electrofelix | waynr: did you get a chance to review the tweaked patch series? | 14:29 |
| *** eezhova has quit IRC | 14:29 | |
| jhesketh | fungi: why manage known_hosts in git? could just be on puppetmaster that ansible helps manage and is published somewhere | 14:29 |
| rcarrillocruz | yeah, that kind of thing is why i asked some time ago if proposal automerges was ever considered in infra | 14:29 |
| rcarrillocruz | but yeah, that could be just put on hiera | 14:29 |
| rcarrillocruz | and pushed out by ansible or something | 14:30 |
| pabelanger | fungi: yolanda: So, I wonder if the issue is, because zuul has already queued the jobs, OFFLINE_NODE_WHEN_COMPLETE is already set on the tag-releases jobs, which are not updated. It does look at new tag-releases jobs add to zuul are properly missing OFFLINE_NODE_WHEN_COMPLETE. | 14:30 |
| *** poll0172 has joined #openstack-infra | 14:30 | |
| *** pfallenop has quit IRC | 14:30 | |
| yolanda | pabelanger, so I was thinking that a zuul restart should work. A reload doesn't seem to have considered the OFFLINE_NODE_WHEN_COMPLETE change | 14:31 |
| *** flip214 has quit IRC | 14:31 | |
| *** darvon has quit IRC | 14:31 | |
| *** nmagnezi_ has joined #openstack-infra | 14:31 | |
| yolanda | but well, zuul restart is disruptive | 14:31 |
| fungi | pabelanger: yolanda: right, we'd need to completely clear zuul's queue to get rid of any already queued up | 14:31 |
| *** darvon has joined #openstack-infra | 14:31 | |
| *** pfallenop has joined #openstack-infra | 14:31 | |
| yolanda | i double checked this morning, code was properly set on zuul node, zuul reloaded changes after that, but even with that, it was not picking | 14:31 |
| rcarrillocruz | it could even be put as part of the launch-node workflow , after all it runs from the puppetmaster which has the hiera | 14:32 |
| fungi | job parameters don't get updated for tasks already in gearman afaik | 14:32 |
| *** pfallenop has quit IRC | 14:32 | |
| *** darvon has quit IRC | 14:32 | |
| pabelanger | Ya, so either we offline / restart zlstatic01 a few more time | 14:32 |
| pabelanger | or dump queues | 14:32 |
| *** AJaeger has joined #openstack-infra | 14:32 | |
| jhesketh | if we get an appropriate fix into the launcher we'd only need to restart once | 14:33 |
| pabelanger | restarting zlstatic01 might be less disruptive ATM. We only have 1 other job using zlstatic01.o.o atm | 14:33 |
| fungi | rcarrillocruz: the same issue was expressed with managing dns in git--the launch process would need to propose a commit back into gerrit and so would not be fully automated (though on both counts i don't see the issue with the person who approved the change that triggered the launch also approving the resulting known_hosts/dns patch) | 14:33 |
| *** nmagnezi has quit IRC | 14:34 | |
| pabelanger | jhesketh: Agreed, I don't think restart zuul right now is the right approave | 14:34 |
| pabelanger | approach* | 14:34 |
| pabelanger | I can do the zlstatic01.o.o dance this morning | 14:34 |
| rcarrillocruz | yeah, it's just a matter of baby sitting it | 14:34 |
| jhesketh | well I might head off since ya'll have this under control | 14:35 |
| jhesketh | I don't think I'll make the infra meeting this morning sorry | 14:36 |
| pabelanger | jhesketh: fungi: yolanda: I've asked openstack-release not to tag releases for the next 60mins | 14:36 |
| *** darvon has joined #openstack-infra | 14:36 | |
| *** pfallenop has joined #openstack-infra | 14:36 | |
| pabelanger | that should give enough time to clear our the release-post queue once wheel-builds are done | 14:36 |
| *** sheeprine has quit IRC | 14:36 | |
| *** pgadiya has quit IRC | 14:36 | |
| *** Teresita-Warrior has joined #openstack-infra | 14:37 | |
| *** jsavak has joined #openstack-infra | 14:37 | |
| AJaeger | pabelanger: that dance is only 3 more times probably. The first 3 changes are old, the last two have been submitted aafter the merge of my change. | 14:37 |
| fungi | yeah, submitting new releases shouldn't be an issue as after the config reload they no longer have the parameter set on them | 14:38 |
| fungi | it's just the ones which happened prior to the config reload taking effect which need to get flushed out | 14:38 |
| AJaeger | thanks for solving that puzzle, this is a good explanation ;) I was really confused... | 14:39 |
| AJaeger | let's hope it works ;) | 14:39 |
| *** sheeprine has joined #openstack-infra | 14:39 | |
| pabelanger | Ya, the issue right now is waiting for wheel-build to finish, that is ~50mins for each build | 14:39 |
| *** sdake has joined #openstack-infra | 14:39 | |
| pabelanger | we only have 1 left in the pipeline so, it should be fast restarts after that is done | 14:40 |
| fungi | oh, got it. they're slowing down the restarts | 14:40 |
| pabelanger | ya | 14:40 |
| *** rossella_s has quit IRC | 14:40 | |
| fungi | we could probably just abort those. they're redundant anyway | 14:40 |
| yolanda | ah, so the OFFLINE_NODE_WHEN_COMPLETE is already registered at jobs in queue, so only new ones are getting the right config? | 14:40 |
| pabelanger | fungi: Ya, we could | 14:41 |
| fungi | yolanda: right | 14:41 |
| pabelanger | okay, let me do that | 14:41 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add plugin="junit" attribute for JUnit plugin https://review.openstack.org/332238 | 14:41 |
| *** rossella_s has joined #openstack-infra | 14:41 | |
| *** EricGonczer_ has quit IRC | 14:43 | |
| *** roxanagh_ has joined #openstack-infra | 14:43 | |
| *** sorantis has joined #openstack-infra | 14:44 | |
| AJaeger | fungi, pabelanger: You have some changes up for project-config that would offline slaves as well, I -1ed them. If we handle this in zuul instead - which I really prefer! - tell me so that I can remove my -1 again... | 14:44 |
| pabelanger | AJaeger: ack | 14:45 |
| fungi | pabelanger: thanks, and yes i'm not at all surprised. just about every edit to zuul's parameter functions script happens after we merge a change that should have had it | 14:45 |
| fungi | er, AJaeger ^ | 14:45 |
| AJaeger | question regarding coverage job: https://review.openstack.org/344111 adds this for check queue only in ironic. Normally, I would say: In both check and gate - what do you think? I was hesitant to -1 in this case since getting only coverage (and not chagne in coverage) for gate might be overkill. | 14:46 |
| *** matt-borland has joined #openstack-infra | 14:46 | |
| AJaeger | fungi, yeah - I wouldn't have noticed that in reviews if it wouldn't have been for yesterday's discussion ;) | 14:47 |
| *** roxanagh_ has quit IRC | 14:48 | |
| AJaeger | And one more review request, please: I'd like to move forward with zuul-cloner on more jobs: https://review.openstack.org/343665 | 14:48 |
| *** flip214 has joined #openstack-infra | 14:48 | |
| *** flip214 has quit IRC | 14:48 | |
| *** flip214 has joined #openstack-infra | 14:48 | |
| *** zul has quit IRC | 14:49 | |
| *** abregman has quit IRC | 14:49 | |
| *** julim has joined #openstack-infra | 14:49 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for retry in multijob plugin https://review.openstack.org/329169 | 14:50 |
| *** xarses has joined #openstack-infra | 14:50 | |
| *** hieulq_ has quit IRC | 14:51 | |
| pabelanger | AJaeger: fungi: yolanda: jhesketh: Okay, tag-releases job working as expected now. release-post queue cleared out | 14:52 |
| *** sputnik13 has quit IRC | 14:52 | |
| fungi | i need to dig into what the tag-releases job is doing at this point, since i don't think we're actually tagging releases with it yet | 14:53 |
| AJaeger | yeah! Thanks, pabelanger | 14:53 |
| AJaeger | fungi: it is only handling tags for a single repo. | 14:53 |
| AJaeger | fungi, dhellmann : SEe http://logs.openstack.org/a2/a27f159d1bf83b0749981c1400b76948eedf65a3/release-post/tag-releases/7a6b3cc/console.html - this failed | 14:54 |
| fungi | i think i meant to review the tag-releases job addition and didn't get to it yet, but if it's the one i'm thinking of that change was supposed to depend on some system-config changes of mine which haven't merged yet | 14:54 |
| fungi | yeah, my bad. i should have edited his commit message to add a depends-on. that wasn't supposed to merge yet | 14:54 |
| AJaeger | fungi, https://review.openstack.org/341058 is the change | 14:54 |
| pabelanger | stepping away for some coffee, then will continue work on static offline patch for zuul-launcher | 14:55 |
| fungi | it was supposed to not merge until https://review.openstack.org/342864 is in place | 14:56 |
| AJaeger | fungi, arghs - that was not indeed not clear ;( | 14:56 |
| *** elo has joined #openstack-infra | 14:56 | |
| fungi | AJaeger: yeah, he didn't realize that, and reviewing that change of his was on my to do list but kept getting pushed off for other emergencies | 14:56 |
| AJaeger | fungi, so, remove the job again from zuul/layout.yaml for now? | 14:56 |
| fungi | AJaeger: yes, we shouldn't be running that. i'll submit a change to undo it | 14:56 |
| AJaeger | Sorry, can't do it myself right now - have a meeting and then some errands to run... | 14:57 |
| fungi | i'll probably not get to it until after the meeting i have starting righth now | 14:57 |
| *** bin_ has joined #openstack-infra | 14:57 | |
| *** sbelous has joined #openstack-infra | 14:57 | |
| *** claudiub|2 has quit IRC | 14:58 | |
| *** jaosorior has quit IRC | 14:58 | |
| AJaeger | ;) | 14:58 |
| fungi | it's a conference call though, so i may be able to multitask | 14:59 |
| *** d0ugal has quit IRC | 14:59 | |
| *** hongbin has joined #openstack-infra | 14:59 | |
| *** hieulq_ has joined #openstack-infra | 14:59 | |
| *** mtanino has joined #openstack-infra | 15:00 | |
| *** sputnik13 has joined #openstack-infra | 15:00 | |
| *** yamamoto has quit IRC | 15:01 | |
| *** hurgleburgler has joined #openstack-infra | 15:02 | |
| *** hichihara has quit IRC | 15:02 | |
| *** zul has joined #openstack-infra | 15:02 | |
| *** dtantsur|mtg is now known as dtantsur | 15:02 | |
| *** sorantis has quit IRC | 15:03 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update TestNG plugin https://review.openstack.org/339635 | 15:04 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update TAP plugin https://review.openstack.org/339282 | 15:06 |
| *** cmspence has joined #openstack-infra | 15:06 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Adds support rerun matrix part to the naginator https://review.openstack.org/330959 | 15:06 |
| asselin | rcarrillocruz, why are there duplicate values here? Is that intentional? http://git.openstack.org/cgit/openstack-infra/system-config/tree/playbooks/group_vars/all.yaml | 15:08 |
| *** asselin_ has joined #openstack-infra | 15:10 | |
| vgridnev | can someone help me with openstack-health tracking? | 15:11 |
| vgridnev | http://status.openstack.org/openstack-health/#/job/gate-sahara-dashboard-dsvm-integration?resolutionKey=day&duration=P7D | 15:11 |
| *** e0ne has quit IRC | 15:11 | |
| vgridnev | it responds that this job is always success, but http://logs.openstack.org/18/342018/22/gate/gate-sahara-dashboard-dsvm-integration/9442b20/ actually is failed | 15:12 |
| *** jcoufal_ has joined #openstack-infra | 15:12 | |
| rcarrillocruz | hmm, not sure | 15:12 |
| rcarrillocruz | you better ask nibalizer | 15:12 |
| *** Swami has joined #openstack-infra | 15:12 | |
| clarkb | vgridnev: mtreinish should be able to help if around | 15:13 |
| *** weshay_mtg is now known as weshay | 15:13 | |
| *** asselin has quit IRC | 15:14 | |
| *** armax has joined #openstack-infra | 15:14 | |
| *** savihou has quit IRC | 15:15 | |
| *** jcoufal has quit IRC | 15:15 | |
| *** vhosakot has joined #openstack-infra | 15:16 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Temporarily disable the tag-releases job https://review.openstack.org/344301 | 15:16 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Revert "Temporarily disable the tag-releases job" https://review.openstack.org/344302 | 15:16 |
| fungi | AJaeger: ^ | 15:16 |
| *** cmspence has left #openstack-infra | 15:16 | |
| *** amotoki has quit IRC | 15:17 | |
| *** Swami has quit IRC | 15:17 | |
| *** e0ne has joined #openstack-infra | 15:19 | |
| *** e0ne has quit IRC | 15:19 | |
| openstackgerrit | Miles Gould proposed openstack/diskimage-builder: Allow installing proliant tools from an OS package https://review.openstack.org/344214 | 15:19 |
| *** e0ne has joined #openstack-infra | 15:19 | |
| timothyb89 | vgridnev: that's marked as successful in the dashboard because the failure isn't being logged in the subunit output | 15:19 |
| *** hieulq_ has quit IRC | 15:20 | |
| *** poll0172 has quit IRC | 15:21 | |
| *** sputnik13 has quit IRC | 15:21 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add gpg signing job for reprepro https://review.openstack.org/343336 | 15:21 |
| pabelanger | AJaeger: nice spotting^ | 15:21 |
| *** itisha has joined #openstack-infra | 15:21 | |
| *** karthikp_ has joined #openstack-infra | 15:21 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add gpg signing job for reprepro https://review.openstack.org/343336 | 15:22 |
| clarkb | http://mirror.dfw.rax.openstack.org/pypi/last-modified implies that bandersnatch update didn't break anything | 15:23 |
| clarkb | ianw: ^ FYI looks good to me on an initial check | 15:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add gpg signing job for reprepro https://review.openstack.org/343336 | 15:24 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update MongoDB plugin https://review.openstack.org/342460 | 15:25 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update Gerrit Trigger to use convert xml https://review.openstack.org/332893 | 15:25 |
| *** eharney has joined #openstack-infra | 15:26 | |
| *** EricGonczer_ has joined #openstack-infra | 15:27 | |
| *** bhunter71 has joined #openstack-infra | 15:27 | |
| *** vincentll has quit IRC | 15:27 | |
| *** cody-somerville has quit IRC | 15:28 | |
| *** sdake has quit IRC | 15:28 | |
| *** Sotonatorz has joined #openstack-infra | 15:29 | |
| *** csomerville has joined #openstack-infra | 15:29 | |
| AJaeger | fungi, looks fine, thanks! | 15:30 |
| *** Sotonator has quit IRC | 15:31 | |
| dmsimard | Should glean be attempting to configure every new NIC that is created ? | 15:31 |
| jpmaxman | clarkb: re: 285641 I would like to keep in in place for a little longer. Since we were never able to give this a thorough test due to the puppet settings getting overwritten, I'm not completely sure if it will solve our problem. If we start to see spam getting through I'd like to be able to get in and look at it quickly. | 15:31 |
| dmsimard | It looks like it attempts (and fails horribly) to configure virtual NICs that are probably created by tempest tests | 15:31 |
| *** zhurong has quit IRC | 15:32 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack-cookiecutter: run bash script for testing https://review.openstack.org/344319 | 15:32 |
| EmilienM | mwhahaha: ^ | 15:32 |
| *** jsavak has quit IRC | 15:32 | |
| clarkb | jpmaxman: right I Thought we merged a different change that added your key. In this case I am just asking if we can abandon the second redundant change (this won't affect the other change which did merge) | 15:32 |
| *** yamamoto has joined #openstack-infra | 15:32 | |
| jpmaxman | fungi: are we good? want to make sure I didn't miss anything from you :) | 15:32 |
| rcarrillocruz | dmsimard: that is possible, glean init service runs on the event of new interfaces coming up | 15:32 |
| EmilienM | mwhahaha: for now, let's use one script. Later, we could even split lint/syntax/unit/beaker like our spec_helper. Wdyt? | 15:32 |
| dmsimard | rcarrillocruz: and is that okay ? Just figured I'd check if it was worth filing a bug for | 15:33 |
| mwhahaha | that works | 15:33 |
| jpmaxman | clarkb: oh sorry! my bad... yes you're right. We can abandon that one put in by Marton | 15:33 |
| clarkb | jpmaxman: ok just wanted to double check and will do that shortly | 15:33 |
| rcarrillocruz | imho, glean should be an on-boot thing, the fact it can interfere on nics post boot is an odd thing | 15:33 |
| clarkb | jpmaxman: definitely don't intend on removing your key based on the other change :) | 15:33 |
| rcarrillocruz | you better ask mordred or SpamapS | 15:34 |
| *** e0ne has quit IRC | 15:34 | |
| electrofelix | zxiiro: did you get a chance to compare some of the changes I've uploaded at https://github.com/electrofelix/jenkins-job-builder/tree/untangle-config to tweak waynr 's v2 api? to avoid having the argument parser options be added into the config object? | 15:35 |
| *** d0ugal has joined #openstack-infra | 15:35 | |
| SpamapS | rcarrillocruz: greghaynes has some strong thoughts on this too | 15:35 |
| *** EricGonczer_ has quit IRC | 15:35 | |
| *** vsaienko has joined #openstack-infra | 15:35 | |
| *** salv-orlando has quit IRC | 15:35 | |
| jpmaxman | clarkb: cool. yeah, sorry was confused. I put in a separate patch that added my key. Hopefully we can remove it soon though if everything holds :) | 15:36 |
| vsaienko | infra team, please review https://review.openstack.org/#/c/342936, we would like to switch to tempest-based tests in networking-generic-switch | 15:36 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add partial support for maven-release-plugin https://review.openstack.org/313196 | 15:36 |
| greghaynes | rcarrillocruz: SpamapS Yea, we chatted this out - I think we had consensus that for networking we don't re-assert unless machine-id changes? | 15:36 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Fix documentation of --delete-old: affects only managed jobs. https://review.openstack.org/341627 | 15:36 |
| zxiiro | electrofelix: I have not. I'll spend some time today to go over it. Thanks for the reminder | 15:36 |
| greghaynes | rcarrillocruz: SpamapS In the ideal world, that is | 15:36 |
| *** yamamoto has quit IRC | 15:37 | |
| zxiiro | electrofelix: this one right? https://github.com/electrofelix/jenkins-job-builder/commit/abdeb75721f98976c257b5222ab5e692df3ce697 | 15:37 |
| electrofelix | zxiiro: yeap | 15:37 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update scoverage to use convert xml https://review.openstack.org/340576 | 15:38 |
| electrofelix | zxiiro: as soon as I'm finished reviewing the latest set of convert_mapping_to_xml changes, I'll probably rebase the existing patch series against it as well as the one with my tweaks to make it relatively easy to compare | 15:38 |
| zxiiro | electrofelix: sounds good to me. Kien's going to remove the "fail_required=true" setting once those patches are merged so that would be good for him to move forward with simplifying the convert_mapping function | 15:39 |
| *** nmagnezi_ has quit IRC | 15:39 | |
| mordred | greghaynes: yah - I don't think we want to be general device management | 15:39 |
| greghaynes | dmsimard: rcarrillocruz Configuring virtual nics is a likely glean bug, we walk all interfaces on the host and try to determine which ones we should set up so theres basically a blacklist of device types - we might be missing some | 15:39 |
| *** Jeffrey4l has quit IRC | 15:40 | |
| mordred | greghaynes: glean is supposed to bootstrap you to get to a point where you can use something else to manage the machine. unlike systemd, it does not want to take over the world from other tools that are perfectly well suited and pre-exisitng :) | 15:40 |
| dmsimard | greghaynes: I can file a bug if you'd like | 15:40 |
| *** mescanef has quit IRC | 15:40 | |
| SpamapS | greghaynes: agreed | 15:40 |
| greghaynes | mordred: Wait, were not writing a glean logging protocol? | 15:40 |
| * mordred cries | 15:40 | |
| *** thingee has quit IRC | 15:40 | |
| *** Goneri has quit IRC | 15:40 | |
| greghaynes | mordred: do we have a place for glean bugs? | 15:41 |
| mordred | greghaynes: storyboard I'd guess? | 15:41 |
| *** notnownikki has quit IRC | 15:41 | |
| rcarrillocruz | hmm | 15:41 |
| SpamapS | actually maybe we should rewrite glean as a systemd component | 15:41 |
| * SpamapS hides | 15:41 | |
| rcarrillocruz | greghaynes , dmsimard : i guess the vlan interfaces should be added like 6f67b82f16b4edb116f2e5ce9cc45d514a036951 | 15:41 |
| *** thingee has joined #openstack-infra | 15:42 | |
| greghaynes | SpamapS: I actually do think glean should try and use networkd where available | 15:42 |
| SpamapS | cloudd | 15:42 |
| greghaynes | it has a config option for 'run dhcp everywhere' | 15:42 |
| rcarrillocruz | that's a patch prometheanfire pushed about masking interfaces that glean shouldn't mess with | 15:42 |
| SpamapS | greghaynes: <sigh> | 15:42 |
| prometheanfire | hi? | 15:42 |
| *** thingee has quit IRC | 15:42 | |
| *** EricGonczer_ has joined #openstack-infra | 15:43 | |
| prometheanfire | rcarrillocruz: why should vlans be added to that? | 15:43 |
| greghaynes | dmsimard: https://storyboard.openstack.org/#!/project/815 looks like glean exists there with a very very old story | 15:45 |
| * greghaynes updates glean README | 15:45 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update check for valid attributes for SonaType CLM https://review.openstack.org/340530 | 15:45 |
| dmsimard | greghaynes: yeah I created https://storyboard.openstack.org/#!/story/2000673 but failed horribly at formatting | 15:45 |
| openstackgerrit | Richard Theis proposed openstack-infra/project-config: Add python-neutronclient to osc-plugin-jobs https://review.openstack.org/309515 | 15:46 |
| prometheanfire | greghaynes: dmsimard the problem with filtering based on name is that interface names can be named anything | 15:46 |
| *** poll0172 has joined #openstack-infra | 15:46 | |
| *** e0ne has joined #openstack-infra | 15:46 | |
| prometheanfire | +if (*name == '/' || *name == ':' || isspace(*name)) | 15:46 |
| prometheanfire | those are the only invalid characters | 15:47 |
| greghaynes | dmsimard: youre rebooting this node and after a reboot is where it fails? | 15:47 |
| *** woodster_ has joined #openstack-infra | 15:47 | |
| rcarrillocruz | hmm...iirc there was an inclusion of a conf file to configure behaviour on glean | 15:47 |
| rcarrillocruz | checking | 15:47 |
| dmsimard | greghaynes: no, it's not rebooted -- those logs are out of a packstack integration job in the openstack-infra gate | 15:47 |
| rcarrillocruz | vlans should be settable | 15:47 |
| dmsimard | that spam occurs when the tempest tests are running iiuc | 15:47 |
| *** thingee has joined #openstack-infra | 15:47 | |
| prometheanfire | anyway, driving now | 15:48 |
| greghaynes | dmsimard: oh, glean should only be running on boot so anything that messes with the node after boot shouldn't have any effect on glean | 15:48 |
| dmsimard | prometheanfire: I don't have an idea on how to fix this properly, just saying we probably shouldn't be doing that :p | 15:48 |
| dmsimard | greghaynes: so apparently that's the bug, then ? | 15:48 |
| clarkb | greghaynes: upstart/systemd deps are likely triggering it when networkign updates | 15:48 |
| dmsimard | greghaynes: it runs *after* boot ? | 15:48 |
| greghaynes | oh! yes, its on start on starting networking | 15:49 |
| greghaynes | in upstart | 15:49 |
| rcarrillocruz | yeah | 15:49 |
| rcarrillocruz | that's upstrart | 15:49 |
| rcarrillocruz | it's an event triggering | 15:49 |
| rcarrillocruz | we've seen that in the past | 15:49 |
| dmsimard | well that particular job is centos so not upstart :p | 15:49 |
| rcarrillocruz | i argued quite a bit if that was the right approach, and even we discussed if we should have a first_boot file somewhere so glean doesn't do things if it was present | 15:50 |
| greghaynes | The other half of the bug is the detection for whether glean should re-assert config on an interface is per-interface, so if theres a new interface itll try and configure that - we do want the behavior to be tied to the machine-id instead though so that'll likely fix this | 15:50 |
| *** sdake has joined #openstack-infra | 15:50 | |
| greghaynes | dmsimard: ah, probably same thing but systemd though | 15:51 |
| *** ams__ has joined #openstack-infra | 15:51 | |
| *** larainema has joined #openstack-infra | 15:51 | |
| *** jed56 has joined #openstack-infra | 15:51 | |
| *** fawadkhaliq has joined #openstack-infra | 15:51 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/ansible-role-puppet: Honor show-diff options with puppet apply https://review.openstack.org/344336 | 15:52 |
| *** salv-orlando has joined #openstack-infra | 15:52 | |
| *** vhosakot has quit IRC | 15:53 | |
| *** sarob has joined #openstack-infra | 15:54 | |
| waynr | electrofelix: so the commit zxiiro linked looks good to me | 15:54 |
| *** oanson has quit IRC | 15:54 | |
| *** mriedem has joined #openstack-infra | 15:55 | |
| rcarrillocruz | ah | 15:56 |
| *** matthewbodkin has quit IRC | 15:56 | |
| rcarrillocruz | the change about configuring behaviour of glean vi a conf file was abandoned | 15:56 |
| *** kzaitsev_mb has quit IRC | 15:56 | |
| *** claudiub has joined #openstack-infra | 15:57 | |
| zxiiro | electrofelix: looks good to me too | 15:59 |
| *** seldenr has joined #openstack-infra | 15:59 | |
| *** mikelk has quit IRC | 15:59 | |
| *** adrian_otto has joined #openstack-infra | 16:00 | |
| *** asettle has quit IRC | 16:00 | |
| zxiiro | electrofelix: if you push it to gerrit after rebasing it I can install it on my system and run with it for a few days | 16:00 |
| *** asettle has joined #openstack-infra | 16:00 | |
| *** gouthamr has quit IRC | 16:01 | |
| *** fawadkhaliq has quit IRC | 16:01 | |
| *** _sarob has joined #openstack-infra | 16:01 | |
| *** poll0172 has quit IRC | 16:02 | |
| *** _sarob has quit IRC | 16:02 | |
| *** _sarob has joined #openstack-infra | 16:02 | |
| *** gokrokve has joined #openstack-infra | 16:03 | |
| *** e0ne has quit IRC | 16:03 | |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/system-config: Add logging for openstack-quota https://review.openstack.org/304879 | 16:04 |
| clarkb | infra-root (really nodepool-core) reviewing https://review.openstack.org/#/c/343828/ would help me a bunch on the xenial work | 16:04 |
| pabelanger | clarkb: more testing with wait_for on my local system. I believe my SSH connection is becoming stale over longer period of times. The playbook will work on zlstatic01.o.o, since it is a low volume launcher. But other launchers, wait_for seems to hang and no longer respond. I haven't let it timeout yet (3hrs). This is where I think async comes in better, since it established new SSH connections | 16:04 |
| pabelanger | every poll attempt | 16:04 |
| clarkb | with that merged we can try restarting nodepoold with the new demand calculation code again | 16:04 |
| *** d0ugal has quit IRC | 16:04 | |
| *** sarob has quit IRC | 16:04 | |
| *** treaki__ has quit IRC | 16:05 | |
| clarkb | pabelanger: except that doesn't function within our environment... | 16:05 |
| clarkb | pabelanger: the wait_for does | 16:05 |
| clarkb | I personally dont' care how we implement it as long as it works within our environment | 16:05 |
| *** mhickey has quit IRC | 16:05 | |
| *** asettle has quit IRC | 16:05 | |
| pabelanger | Ya, I'm going to leave wait_for logic for now | 16:05 |
| *** yamamoto has joined #openstack-infra | 16:05 | |
| openstackgerrit | Merged openstack-infra/gear: Parse admin requests 2880 times faster https://review.openstack.org/343315 | 16:06 |
| clarkb | having it work from my desktop is not the most important requirement to me | 16:06 |
| openstackgerrit | Merged openstack-infra/gear: Add test for AdminRequest.isComplete https://review.openstack.org/343825 | 16:06 |
| pabelanger | but I think a better fix to async, would be to ignore SSH connection failures and keep retying polling, until our async timeout is eventually reached. | 16:06 |
| pabelanger | I'm going to talk with ansible-dev about that | 16:06 |
| clarkb | pabelanger: ok | 16:06 |
| clarkb | pabelanger: I would say keep retry polling up to N consequitive failures but yes I like that idea | 16:06 |
| jeblair | clarkb: why doesn't async work in our environment? | 16:06 |
| pabelanger | clarkb: Right, we talked about that before too | 16:06 |
| clarkb | jeblair: because the poll connections end up failing to connect which fails the entire play | 16:07 |
| clarkb | jeblair: so when restarting the zuul launchers from puppetmaster it will put them in their shutdown mode, then start polling and anywhere from 5 minute to an hour later fail to connect and the whole play aborts | 16:07 |
| jeblair | clarkb: gotcha. i will say i'm not entirely sure we can always sustain 3 hour long idle ssh connections -- especially outside of dfw. i would not be surprised if wait_for fails sometimse too. perhaps not as much? | 16:08 |
| *** shashank_hegde has joined #openstack-infra | 16:08 | |
| *** jlanoux has quit IRC | 16:08 | |
| *** ifarkas is now known as ifarkas_afk | 16:08 | |
| clarkb | jeblair: this is within dfw | 16:09 |
| clarkb | jeblair: wait_for if it fails should only fail at the beginning and you will fail fast rather than a long while in | 16:09 |
| jeblair | clarkb: this case perhaps, but not all of our environment is in dfw. | 16:09 |
| clarkb | jeblair: so its better but you are correct ti doesn't completely fix it | 16:09 |
| *** vhosakot has joined #openstack-infra | 16:09 | |
| *** tonytan_brb has joined #openstack-infra | 16:11 | |
| *** jsavak has joined #openstack-infra | 16:11 | |
| openstackgerrit | Merged openstack-infra/nodepool: Remove dead code from nodepoolcmd https://review.openstack.org/342450 | 16:12 |
| clarkb | separately it is also somewhat scary that a new tcp connection every minute between two hosts in dfw would fail that often | 16:12 |
| *** nherciu_ has quit IRC | 16:12 | |
| openstackgerrit | Merged openstack-infra/zuul: Use fetch instead of update in merger https://review.openstack.org/342433 | 16:12 |
| cloudnull | clarkb pabelanger jeblair - - re: osic failure rate. we're just about out of public IP space which is causing our error rate to be very high. IDK if its possible to lower the VM usage for a time? Also we're still working with the RAX network team to get an allocation of IPv6 but its taking more time than I'd like. | 16:13 |
| *** poll0172_ has joined #openstack-infra | 16:13 | |
| *** tonytan4ever has quit IRC | 16:13 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Update the chair for the Nova Hyper-V meeting https://review.openstack.org/344349 | 16:14 |
| mtreinish | clarkb, vgridnev: what does that job run? If there isn't any subunit output generated on failure we won't see it on openstack-health | 16:14 |
| clarkb | cloudnull: yes you can propose a change to project-config/nodepool/nodepool.yaml to reduce osics max-servers value | 16:14 |
| clarkb | cloudnull: or we can if you giveus an idea of what is available | 16:15 |
| openstackgerrit | Merged openstack-infra/puppet-ansible: Add support for retry files configuration https://review.openstack.org/320618 | 16:15 |
| *** Sotonatorz has quit IRC | 16:15 | |
| *** Sotonator has joined #openstack-infra | 16:15 | |
| openstackgerrit | Merged openstack-infra/system-config: Disable ansible retry files https://review.openstack.org/320619 | 16:16 |
| openstackgerrit | Merged openstack-infra/system-config: Add playbooks to start/stop all of zuul https://review.openstack.org/336724 | 16:17 |
| mtreinish | clarkb, vgridnev: looking at the log example: http://logs.openstack.org/18/342018/22/gate/gate-sahara-dashboard-dsvm-integration/9442b20/testr_results.html.gz shows only devstack as generating subunit output | 16:18 |
| *** sdague has joined #openstack-infra | 16:18 | |
| mtreinish | so the test run that failed didn't generate subunit | 16:18 |
| *** yamamoto has quit IRC | 16:18 | |
| mtreinish | oh, because it uses nose: http://logs.openstack.org/18/342018/22/gate/gate-sahara-dashboard-dsvm-integration/9442b20/console.html#_2016-07-18_20_59_40_536919 | 16:18 |
| mtreinish | that would do it | 16:18 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/ansible-role-puppet: Honor show-diff options with puppet apply https://review.openstack.org/344336 | 16:18 |
| clarkb | mtreinish: ty for tracking that down | 16:19 |
| *** binbincong has quit IRC | 16:21 | |
| *** poll0172_ has quit IRC | 16:21 | |
| prometheanfire | dmsimard: fair enough, feel free to ping me about the bug when you have it | 16:21 |
| prometheanfire | lunching | 16:21 |
| dmsimard | prometheanfire: I created https://storyboard.openstack.org/#!/story/2000673 | 16:21 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack-infra/project-config: Reduce the OSIC max-servers https://review.openstack.org/344354 | 16:21 |
| *** poll01721 has joined #openstack-infra | 16:22 | |
| cloudnull | clarkb: ^ I dropped the value to 64 from 100. I hope to re-up it as soon as we get more IPs but thats still a WIP. | 16:22 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Adds support rerun matrix part to the naginator https://review.openstack.org/330959 | 16:23 |
| clarkb | project co fig core can has review on cloudnulls change above? | 16:23 |
| *** hurgleburgler has left #openstack-infra | 16:24 | |
| pabelanger | +3 | 16:24 |
| clarkb | tyty | 16:24 |
| openstackgerrit | Richard Theis proposed openstack-infra/project-config: Change networking-ovn python34 job to voting https://review.openstack.org/335605 | 16:25 |
| *** poll01721 has quit IRC | 16:26 | |
| jeblair | fungi: were you going to fix the infra-cookiecutter repo? | 16:26 |
| *** shashank_hegde has quit IRC | 16:26 | |
| *** poll0172_ has joined #openstack-infra | 16:27 | |
| cloudnull | thanks clarkb pabelanger -- sorry for the issues. I'm working on trying to make that better. | 16:27 |
| * cloudnull goes off to yell at folks | 16:28 | |
| pabelanger | cloudnull: np, thanks for the heads up | 16:28 |
| openstackgerrit | Merged openstack-infra/project-config: Temporarily disable the tag-releases job https://review.openstack.org/344301 | 16:28 |
| *** tphummel has joined #openstack-infra | 16:29 | |
| *** jpich has quit IRC | 16:29 | |
| _sarob | i need gerrit ids seanrob and sulochan-acharya added to gerrit groups craton-core and craton-release | 16:29 |
| *** harlowja has joined #openstack-infra | 16:29 | |
| _sarob | nick sarob | 16:29 |
| *** _sarob is now known as sarob | 16:29 | |
| fungi | jeblair: which one, the puppet one? i have some patches posted for it | 16:29 |
| *** esikachev has quit IRC | 16:30 | |
| *** Goneri has joined #openstack-infra | 16:30 | |
| jeblair | fungi: yeah | 16:31 |
| jeblair | fungi: can you link? i must be missing something | 16:32 |
| *** harlowja has quit IRC | 16:33 | |
| *** Sotonator has quit IRC | 16:33 | |
| *** arxcruz has quit IRC | 16:35 | |
| fungi | jeblair: oh, looks like they merged in the last day | 16:35 |
| fungi | jeblair: 343909 and 343913 were the updates | 16:35 |
| jeblair | fungi: ah yes that's what i was missing! thanks :) | 16:36 |
| fungi | np | 16:36 |
| fungi | i'm as surprised by our efficiency as you are ;) | 16:36 |
| *** d0ugal has joined #openstack-infra | 16:38 | |
| *** dtantsur is now known as dtantsur|afk | 16:38 | |
| *** binbincong has joined #openstack-infra | 16:38 | |
| prometheanfire | cloudnull: :( | 16:40 |
| pabelanger | jeblair: when you have time, do you mind commenting on fungi comment on 343921? This is regarding OFFLINE_NODE_WHEN_COMPLETE and static workers | 16:40 |
| *** pstack has joined #openstack-infra | 16:41 | |
| jeblair | pabelanger: i think we should either a) implement the inline comment from jhesketh [ie -- make sure that the variable still works as expected for dynamic workers] or b) implement fungi's suggestion to stop honoring the variable at all. | 16:41 |
| *** osnexus has joined #openstack-infra | 16:41 | |
| *** eharney_ has joined #openstack-infra | 16:42 | |
| jeblair | pabelanger: if you don't have a preference for which, i can pick one. :) | 16:42 |
| jeblair | (but i'd be okay with either of those) | 16:42 |
| *** javeriak has joined #openstack-infra | 16:42 | |
| *** dizquierdo has quit IRC | 16:43 | |
| mriedem | wow weird, | 16:43 |
| mriedem | i pushed a change hours ago, no jenkins results, it wasn't queued, | 16:43 |
| mriedem | i recheck it in gerrit, | 16:43 |
| *** eharney has quit IRC | 16:43 | |
| mriedem | then jenkins -1 all of a sudden and results show up | 16:43 |
| *** dizquierdo has joined #openstack-infra | 16:44 | |
| *** trown is now known as trown|lunch | 16:44 | |
| anteaya | mriedem: what patch? | 16:44 |
| mriedem | https://review.openstack.org/#/c/327191/ | 16:45 |
| *** eharney_ is now known as eharney | 16:45 | |
| *** sheeprine has quit IRC | 16:46 | |
| osnexus | Hey, having issues with my 3rd party CI setup. I can create nodes on my devstack manually, but they seem to error whenever triggered by nodepool. Increasing the specs of my devstack cloud seemed to help, but now I'm getting these errors | 16:46 |
| osnexus | http://paste.openstack.org/show/537478/ | 16:46 |
| *** yamamoto has joined #openstack-infra | 16:46 | |
| *** gokrokve has quit IRC | 16:46 | |
| *** tonytan_brb has quit IRC | 16:47 | |
| *** tesseract- has quit IRC | 16:47 | |
| *** flepied has quit IRC | 16:47 | |
| *** gokrokve has joined #openstack-infra | 16:47 | |
| *** harlowja has joined #openstack-infra | 16:48 | |
| anteaya | mriedem: I see it in the check queue on the status.o.o/zuul page now | 16:48 |
| *** Apoorva has joined #openstack-infra | 16:48 | |
| *** sheeprine has joined #openstack-infra | 16:48 | |
| mriedem | anteaya: b/c i rechecked it | 16:49 |
| mriedem | anteaya: b/c there were no jenkins results, until i left a comment to recheck | 16:49 |
| mriedem | it was weird, never seen that before | 16:49 |
| *** harlowja has quit IRC | 16:49 | |
| anteaya | yes, I'm saying I see it queued now, in response to your earlier comment that it was not queued | 16:49 |
| mriedem | in general, i've been noticing over the last week that i push a patchset and don't get results back from zuul | 16:49 |
| mriedem | like it's just lost | 16:49 |
| anteaya | mriedem: I also have never seen that before | 16:49 |
| *** rcernin has quit IRC | 16:49 | |
| *** harlowja has joined #openstack-infra | 16:49 | |
| asselin_ | osnexus, when you say you create the VMs manually,is that horizon UI or via the openstack CLI? | 16:50 |
| anteaya | mriedem: if you have any other example patchsets, I would look at them | 16:50 |
| *** daemontool__ has quit IRC | 16:50 | |
| osnexus | asselin_: nova CLI | 16:50 |
| anteaya | mriedem: the patch failed on dsvm neutron multinode which currently has a 35% failure rate: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:51 |
| asselin_ | osnexus, try using the openstack cli from your nodepool node | 16:51 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update WhiteSource plugin https://review.openstack.org/341256 | 16:51 |
| *** jaypipes has joined #openstack-infra | 16:51 | |
| anteaya | mriedem: if armax is in the room and is willing to make that job non-voting I am standing by to +2 that patch | 16:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-ipsilon: Add module boilerplate https://review.openstack.org/344366 | 16:51 |
| asselin_ | osnexus, and use the configured nodepool clouds.yaml file | 16:51 |
| jaypipes | clarkb, fungi: I'm looking in project-config for where the devstack-checkout Jenkins job is defined. a little assistance please? I'm not finding it... | 16:51 |
| mriedem | anteaya: armax isn't coming to the nova midcycle | 16:52 |
| asselin_ | osnexus, sudo su - nodepool; export OS_CLOUD=$cloud_name; openstack server list | 16:52 |
| clarkb | jaypipes: it is in macros.yaml iirc | 16:52 |
| *** gokrokve has quit IRC | 16:52 | |
| anteaya | mriedem: oh sorry, I thought he was, can you convince carl? | 16:52 |
| jaypipes | clarkb: gah, thank you sir. | 16:52 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update RunDeck plugin to use convert xml https://review.openstack.org/340565 | 16:52 |
| *** pstack has quit IRC | 16:52 | |
| osnexus | on it | 16:53 |
| anteaya | jaypipes: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n606 | 16:53 |
| *** poll0172_ has quit IRC | 16:53 | |
| electrofelix | zxiiro: quick question, for doc consistency, do we want any documented defaults for attributes except true/false that is a string to be wrapped with quotes? something we should probably clean up | 16:53 |
| mriedem | anteaya: the failures in that job are usually on the cinder verify part of the job, so probably related to test_volume_boot_pattern failures (ssh), would rather ask sdague and/or mtreinish about it | 16:53 |
| osnexus | telling me to use a username, I typically solve this with the source openrc | 16:53 |
| osnexus | But that seems unavailable to nodepool asselin_ | 16:54 |
| anteaya | mriedem: very good | 16:54 |
| *** poll01721 has joined #openstack-infra | 16:54 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 16:54 |
| *** gokrokve has joined #openstack-infra | 16:54 | |
| *** Swami has joined #openstack-infra | 16:55 | |
| *** salv-orlando has quit IRC | 16:55 | |
| *** flepied has joined #openstack-infra | 16:56 | |
| *** pstack has joined #openstack-infra | 16:57 | |
| *** kzaitsev_mb has joined #openstack-infra | 16:57 | |
| *** salv-orlando has joined #openstack-infra | 16:58 | |
| *** yamamoto has quit IRC | 16:58 | |
| *** shashank_hegde has joined #openstack-infra | 16:58 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-ipsilon: Initial implementation https://review.openstack.org/344368 | 16:58 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 fixes: wrap iter() returns in list() https://review.openstack.org/342463 | 17:00 |
| *** e0ne has joined #openstack-infra | 17:00 | |
| *** derekh has quit IRC | 17:00 | |
| *** eharney has quit IRC | 17:01 | |
| *** claudiub has quit IRC | 17:01 | |
| *** fawadkhaliq has joined #openstack-infra | 17:01 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Add alembic migration support https://review.openstack.org/136589 | 17:02 |
| zaro | morning | 17:02 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Add the ability to control if a work can go offline or not https://review.openstack.org/343921 | 17:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add ipsilon server https://review.openstack.org/344372 | 17:04 |
| *** shashank_hegde has quit IRC | 17:05 | |
| *** eharney has joined #openstack-infra | 17:05 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update clang scan build https://review.openstack.org/340440 | 17:06 |
| pabelanger | jeblair: fungi: I believe that addresses jhesketh comment | 17:06 |
| pabelanger | ^ | 17:06 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update DRY plugin to use convert xml function https://review.openstack.org/341240 | 17:06 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: SCM repo: add ignore-projects option https://review.openstack.org/293472 | 17:06 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update live-screenshot plugin to use convert xml https://review.openstack.org/342446 | 17:06 |
| *** hashar has joined #openstack-infra | 17:07 | |
| *** hashar_ has joined #openstack-infra | 17:07 | |
| pabelanger | jeblair: fungi: I also wonder if we should add a configuration setting per static worker like jhesketh suggested incase we want to take static node offline. | 17:07 |
| notmorgan | jeblair: i had some questions about the dynamic reconfig patch let me find them. but i'm starting to get it. | 17:07 |
| jeblair | notmorgan: awesome! | 17:08 |
| *** adrian_otto has quit IRC | 17:08 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update Logfilesizechecker to use convert xml https://review.openstack.org/342452 | 17:08 |
| *** jsavak has quit IRC | 17:08 | |
| notmorgan | jeblair: it dawned on me late yesterday what the .zuul.yml files were for. and i feel dumb for not getting it sooner | 17:08 |
| jeblair | pabelanger: the zl is only intended for our use as a bridge to 2.5. let's keep this simple | 17:08 |
| notmorgan | when i realized it was the same as .travis.yml a lot more stuff made sense. | 17:08 |
| pabelanger | jeblair: WFM | 17:08 |
| jeblair | notmorgan: well, hopefully not the same :) but inasmuch as it's (partial) in repo configuration of automation, yes :) | 17:09 |
| notmorgan | it fills the same role | 17:09 |
| notmorgan | not the same content/function | 17:09 |
| *** baoli has joined #openstack-infra | 17:09 | |
| notmorgan | and that was breaking my brain for a while because i just didn't get the comment about "config" vs "project" repos until then | 17:10 |
| zxiiro | electrofelix: I think putting it in quotes is handy for defaults where it's just a blank string unless you can think of a better way to visualize that the default should be empty. Otherwise without quotes saves us 2 characters. | 17:10 |
| notmorgan | also unrelated, i noticed this fixed some mutable default args, so yay! | 17:10 |
| dmsimard | pabelanger: I'm trying to figure out if you guys get rid of firewalld/NetworkManager on openstack-infra centos images, where do I look ? | 17:12 |
| *** sdake has quit IRC | 17:12 | |
| jeblair | notmorgan: yeah, there's also another nuance that may not be entirely clear with that -- | 17:13 |
| *** baoli has quit IRC | 17:14 | |
| ihrachys | ianw: jeblair: sdague: https://review.openstack.org/#/q/I38a80bac18673a30842a7b997d0669fed5aff976,n,z please, this blocks https://review.openstack.org/#/c/343024/ that should solve broken gate for neutron multinode grenade job. | 17:14 |
| *** sarob has quit IRC | 17:14 | |
| notmorgan | so, is the merger.getFiles(..., files=['zuul.yaml', '.zuul.yaml'] ...) just for convience sake? or is it expected that a given repo will contain both files ultimitely? or is this for catching the case where the config repo also needs gating? | 17:14 |
| jeblair | notmorgan: in v3 *all* configuration is in git repos, but there are parts of the config that are trusted, and parts that are untrusted. the trusted parts of the config (which can define jobs with authentication credentials, etc) are in "config repos", which are expected to have little or nothing other than zuul config. then 'project repos' are actual projects (eg nova) which may incidentally have some zuul config, but that config is ... | 17:15 |
| jeblair | ... untrusted. | 17:15 |
| notmorgan | because, it seems like that *might* get abused if both files could obstensibly live in a normal project repo if that is unintended. | 17:15 |
| jeblair | notmorgan: (the vocabulary around all that is probably a bit nebulous still) | 17:15 |
| notmorgan | as in, i would assume we should only load zuul.yaml (non-dot-prefixed) from an explicitly trusted repo? | 17:16 |
| notmorgan | i'm also ok with being told that is "future" looking things we need to address as part of v3 | 17:17 |
| jeblair | notmorgan: re files: yes, i think we should tighten that up in the future so that we load zuul.yaml from a trusted repo, and .zuul.yaml (or, perhaps .config/zuul.yaml) from untrusted repos. i don't think we should look for more than one in a given repo. | 17:17 |
| notmorgan | right. ok, that makes a lot of sense. I'm not misreading this then | 17:17 |
| *** harlowja has quit IRC | 17:18 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Replace exeception.message with exception.args https://review.openstack.org/334703 | 17:18 |
| *** sarob has joined #openstack-infra | 17:19 | |
| *** claudiub has joined #openstack-infra | 17:19 | |
| *** SumitNaiksatam has quit IRC | 17:20 | |
| *** sdake has joined #openstack-infra | 17:20 | |
| pabelanger | dmsimard: We build our images from DIB, you can see that output at http://nodepool.openstack.org/dib.centos-7.log | 17:20 |
| pabelanger | dmsimard: which means, we take the default networking settings from the centos-minimal DIB element, then run our puppet manifests a top of that | 17:21 |
| pabelanger | dmsimard: puppet-iptables should also be helpful too | 17:21 |
| *** tonytan4ever has joined #openstack-infra | 17:22 | |
| *** pstack has quit IRC | 17:22 | |
| electrofelix | waynr zxiiro: so I've whittled down the list of patches requiring approval (before tackling the v2.0 api patches) and only see a few left, so going to rebase the existing 2.0 patches against the latest master now and then push up the modifications I made to make it easy to compare | 17:25 |
| *** yamamoto has joined #openstack-infra | 17:25 | |
| zxiiro | electrofelix: sounds good, I'll try to look at some of them before Friday's meeting | 17:25 |
| openstackgerrit | Henry Gessau proposed openstack-infra/project-config: Do not special-case py34 job for networking-ovn https://review.openstack.org/344197 | 17:26 |
| dmsimard | pabelanger: hm, I guess I'm missing something. It doesn't look like firewalld is running in the gate and it comes installed by default in centos-minimal | 17:26 |
| dmsimard | and grep firewalld that dib log, nothing | 17:27 |
| *** shashank_hegde has joined #openstack-infra | 17:27 | |
| *** gouthamr has joined #openstack-infra | 17:27 | |
| *** fawadkhaliq has quit IRC | 17:27 | |
| *** ihrachys has quit IRC | 17:28 | |
| dmsimard | I guess the DIB for centos-minimal is even more minimal than the "real" centos-minimal :) | 17:28 |
| clarkb | dmsimard: devstack also removed it at o e time if using devstack | 17:29 |
| clarkb | since it didnt play nice with libvirt | 17:29 |
| pabelanger | dmsimard: Ya, suspect centos-minimal DIB doesn't include it | 17:29 |
| pabelanger | dmsimard: we don't even include openssh in -minimal elements | 17:30 |
| openstackgerrit | vikas choudhary proposed openstack-infra/project-config: Remove all jobs involving dsvm from kuryr-lib https://review.openstack.org/344381 | 17:31 |
| dmsimard | pabelanger: what is this, a centos-minimal for ants ? | 17:31 |
| dmsimard | :) | 17:31 |
| *** esberglu has quit IRC | 17:32 | |
| pabelanger | dmsimard: I believe greghaynes had a patch for -cloud elements at one point in time, but it has been a while since I looked for it. That would give an image more inline with cloud providers IIRC | 17:32 |
| *** pstack has joined #openstack-infra | 17:32 | |
| greghaynes | Yea, that patch is dead, it needs some rethinking | 17:33 |
| greghaynes | but yes, the -minimal elements are extremely minimal | 17:33 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Python 3: Don't use BaseException.message attribute https://review.openstack.org/339300 | 17:33 |
| greghaynes | That was sort of the point - to force projects to install their own deps and not rely on them existing | 17:33 |
| pabelanger | for now, we added an infra-package-needs element, that added missing packages we needed | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: TestSubCommand inherit from UpdateSubCommand. https://review.openstack.org/319619 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Don't expose YamlParser methods unnecessarily. https://review.openstack.org/319618 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move subcommand logic into subcommand classes. https://review.openstack.org/319617 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move 'update' yaml parsing to JenkinsJobs.execute. https://review.openstack.org/319616 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Factor XmlJobGenerator out of YamlParser. https://review.openstack.org/319623 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Disentangle YamlParser and ModuleRegistry classes https://review.openstack.org/319622 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Remove deprecated 'extended-choice' property. https://review.openstack.org/319621 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Remove YamlParser references from JJB modules. https://review.openstack.org/319620 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Be explicit about objects exported by modules. https://review.openstack.org/319625 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Cleanup various deprecation warnings. https://review.openstack.org/319624 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Remove unused builder.Builder.update_job method https://review.openstack.org/319752 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Rename Builder.delete_job to Builder.delete_jobs. https://review.openstack.org/319753 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Rename "parallelize" decorator to "concurrent" https://review.openstack.org/333780 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Merge builder.Builder and builder.Jenkins https://review.openstack.org/319754 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move CacheStorage to its own module. https://review.openstack.org/319755 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Make internal builder.Jenkins attrs internal-only. https://review.openstack.org/319756 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move 'delete' yaml parsing to JenkinsJobs.execute. https://review.openstack.org/262954 | 17:34 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Make builder.Jenkins inherit from jenkins.Jenkins https://review.openstack.org/319751 | 17:34 |
| *** fernnest_ has joined #openstack-infra | 17:35 | |
| *** Guest35446 is now known as melwitt | 17:35 | |
| *** tpsilva has joined #openstack-infra | 17:37 | |
| mordred | dmsimard, pabelanger: I like the ultra-tiny images. I think the cloud provider images are _way_ too fat | 17:38 |
| *** zul has quit IRC | 17:38 | |
| mordred | installing software in a VM is easy | 17:38 |
| dmsimard | mordred: to be fair I'm not talking about a cloud provider image, I'm talking about http://cloud.centos.org/centos/7/images/ | 17:38 |
| fungi | and even then, infra-package-needs is really just the common set of things we _have_ to preinstall on top of the minimal elements to be able to bootstrap our testing frameworks so that they can in turn install other requirements at job runtime | 17:38 |
| dmsimard | mordred: and I guess Ubuntu provides the same thing | 17:38 |
| clarkb | mordred: our dib ubunti minimal images are bigger than ubuntus fwiw | 17:39 |
| mordred | dmsimard: nod. but we can't really use those any way because they're cloud-init based | 17:39 |
| clarkb | mordred: so they arent very minimal | 17:39 |
| dmsimard | mordred: but anyway, DIB is fine to me anything, I was just trying to find out how a "default" package didn't make it into a centos image | 17:39 |
| fungi | clarkb: granted ubuntu doesn't generally ship a complete mirror of 1k git repos in their images ;) | 17:39 |
| jeblair | clarkb: you mean the images with the git repo caches? | 17:39 |
| mordred | clarkb: are those the output of ubuntu-minimal, or the output of ubuntu-minimal plus the stuff we install with puppet? | 17:39 |
| mordred | dmsimard: :) | 17:39 |
| *** ociuhandu has quit IRC | 17:39 | |
| *** zul has joined #openstack-infra | 17:39 | |
| clarkb | jeblair: no just ubuntu-minimal vm and simple-init built | 17:39 |
| clarkb | mordred: ^ | 17:40 |
| fungi | oh, interesting | 17:40 |
| fungi | i wonder what we include that they don't | 17:40 |
| mordred | I believe "manpages" | 17:40 |
| clarkb | no we do t have manpages its the old kernels I think | 17:40 |
| fungi | or whether they do something like endebian crush where manpages are stripped at install time and so on | 17:40 |
| mordred | ah | 17:40 |
| fungi | yeah, that | 17:40 |
| clarkb | but its like 100megabyte difference in qcow2 form | 17:41 |
| *** sdake has quit IRC | 17:41 | |
| mordred | dmsimard: our fedora and centos minimal elements are ... fun ... since there is no legit debootstrap equiv (or wasn't at the time), we had to get creative :) | 17:41 |
| fungi | we ship additional kernels on our images? we ought to be able to clean those up | 17:41 |
| clarkb | fungi: I think greghaynes looked at it and autoremove wont work because it looks at running kernel or something | 17:41 |
| *** degorenko is now known as _degorenko|afk | 17:42 | |
| clarkb | so needs to be more manual cleanup | 17:42 |
| mordred | nod | 17:42 |
| mordred | would be worth fixing at some point | 17:42 |
| fungi | clarkb: oh, i think autoremove doesn't generally remove old kernels anyway? | 17:42 |
| clarkb | it does for me | 17:43 |
| *** john-davidge has quit IRC | 17:43 | |
| fungi | you'd have to explicitly check the grub config for the active configured kernel and then apt-get remove any not referenced in it | 17:43 |
| fungi | hrm, it may be that's an ubuntuism i've not been encountering in debian | 17:43 |
| fungi | or maybe i just haven't noticed | 17:43 |
| greghaynes | fungi: clarkb oh yea, theres many layers of fail going on. You cannot add backports/updates to a debootstrap run (because it can only look at one repo), so it doesnt grab the most recent kernel. Then when we upgrade we grab the new one. autoremove looks at the currently running kernel so it doesnt work | 17:43 |
| clarkb | fungi thats possible its a major issue on ubuntu because its default partitioner gives you a tiny /boot then fills it with tons of kernels | 17:44 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add puppet-mosquitto project https://review.openstack.org/344386 | 17:44 |
| mtreinish | fungi: ^^^ | 17:44 |
| mtreinish | hopefully I did that right, I always seem to overlook something | 17:44 |
| greghaynes | fungi: Yea, on ubuntu autoremove does remove an old kernel | 17:44 |
| clarkb | but you get a massive /boot/efi then put 5mb of data in it | 17:44 |
| greghaynes | it basically checks if currently running kernel == most recent kernel, if so then remove older ones | 17:45 |
| fungi | clarkb: given /boot on lvm has worked with grub for ages now, i wonder why they still create a separate /boot at all | 17:45 |
| fungi | mtreinish: awesome. i hope i'll have time to look after meetings today, or at some point tomorrow | 17:45 |
| *** yamahata has quit IRC | 17:45 | |
| clarkb | ya not sure I am slowly switching to tumbleweed for my physical hosts. people are looking at my bugs now too \o/ | 17:46 |
| greghaynes | clarkb: fungi I think the fix is just a bit of bash in the debootstrap element that does a manual dpkg listing and removes all but one kernel | 17:46 |
| mtreinish | fungi: there's no rush. I can keep pushing things blindly to that github repo in the meantime :) | 17:46 |
| fungi | greghaynes: yeah, that's what i was thinking as well | 17:46 |
| greghaynes | It'd also be nice to make debootstrap smarter or find another way to only install the one kernel we want but thats a harder problem | 17:46 |
| mtreinish | but it's not like I'll have time this week for that too much either | 17:47 |
| asselin_ | osnexus, by exporting OS_CLOUD you don't need the openrc file | 17:47 |
| *** pstack has quit IRC | 17:49 | |
| *** dizquierdo has quit IRC | 17:50 | |
| *** shardy has quit IRC | 17:50 | |
| *** electrofelix has quit IRC | 17:50 | |
| *** moravec has joined #openstack-infra | 17:51 | |
| *** Ravikiran_K has quit IRC | 17:51 | |
| *** gyee has joined #openstack-infra | 17:52 | |
| *** pstack has joined #openstack-infra | 17:52 | |
| EmilienM | hi Infra, could I have a review on https://review.openstack.org/#/c/344319/ please? | 17:53 |
| *** jsavak has joined #openstack-infra | 17:54 | |
| *** Na3iL has quit IRC | 17:55 | |
| *** tosky has quit IRC | 17:56 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: TestSubCommand inherit from UpdateSubCommand. https://review.openstack.org/319619 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Don't expose YamlParser methods unnecessarily. https://review.openstack.org/319618 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move subcommand logic into subcommand classes. https://review.openstack.org/319617 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move 'update' yaml parsing to JenkinsJobs.execute. https://review.openstack.org/319616 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Factor XmlJobGenerator out of YamlParser. https://review.openstack.org/319623 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Disentangle YamlParser and ModuleRegistry classes https://review.openstack.org/319622 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Remove deprecated 'extended-choice' property. https://review.openstack.org/319621 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Remove YamlParser references from JJB modules. https://review.openstack.org/319620 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Be explicit about objects exported by modules. https://review.openstack.org/319625 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Cleanup various deprecation warnings. https://review.openstack.org/319624 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Remove unused builder.Builder.update_job method https://review.openstack.org/319752 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Rename Builder.delete_job to Builder.delete_jobs. https://review.openstack.org/319753 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Rename "parallelize" decorator to "concurrent" https://review.openstack.org/333780 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Merge builder.Builder and builder.Jenkins https://review.openstack.org/319754 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move CacheStorage to its own module. https://review.openstack.org/319755 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Make internal builder.Jenkins attrs internal-only. https://review.openstack.org/319756 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move 'delete' yaml parsing to JenkinsJobs.execute. https://review.openstack.org/262954 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Make builder.Jenkins inherit from jenkins.Jenkins https://review.openstack.org/319751 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move load_files method to YamlParser from Builder. https://review.openstack.org/319613 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Use JJBConfig in ModuleRegistry. https://review.openstack.org/319612 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Test at more appropriate boundaries for update. https://review.openstack.org/319615 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Simplify 'update and delete old jobs' test https://review.openstack.org/319614 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Use JJBConfig in YamlParser. https://review.openstack.org/319611 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Finish removing code from jenkins_jobs.cmd https://review.openstack.org/319610 | 17:57 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Move macro expansion into YamlParser. https://review.openstack.org/333076 | 17:57 |
| *** gokrokve has quit IRC | 17:57 | |
| *** david-lyle has quit IRC | 17:58 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add debian-ceph-jewel mirror to AFS https://review.openstack.org/313897 | 17:58 |
| pabelanger | clarkb: yolanda: Just adding jewel directory to Apache^ | 17:59 |
| pabelanger | working on AFS bits now | 17:59 |
| *** esberglu has joined #openstack-infra | 17:59 | |
| *** tqtran has joined #openstack-infra | 18:00 | |
| hongbin | Hi, does anyone know how to change the project description in the Github main page. | 18:00 |
| *** trown|lunch is now known as trown | 18:01 | |
| hongbin | For example, in https://github.com/openstack/magnum , change from "Containers service for OpenStack" to "....." | 18:01 |
| *** vhosakot has quit IRC | 18:02 | |
| fungi | hongbin: one of our root sysadmins has to edit it manually | 18:02 |
| sulo | hi folks, can anyone help adding member to new project ? | 18:02 |
| hongbin | fungi: could I ask one of them to edit it for me? | 18:03 |
| *** sarob has quit IRC | 18:03 | |
| fungi | hongbin: what do you need it set to? | 18:04 |
| *** sarob has joined #openstack-infra | 18:04 | |
| clarkb | make sure the description in projects.yaml is up to date and it can be made to match that | 18:04 |
| fungi | good point clarkb | 18:04 |
| *** pvaneck has joined #openstack-infra | 18:04 | |
| *** vhosakot has joined #openstack-infra | 18:05 | |
| fungi | hongbin: can you propose a patch to openstack-infra/project-config:gerrit/projects.yaml first if it doesn't already say what you want? | 18:05 |
| fungi | that way if we start being able to update descriptions from there again later it will be correct | 18:05 |
| hongbin | OK. Let me check the description there | 18:05 |
| *** sdake has joined #openstack-infra | 18:06 | |
| honza | i'd like to write a new javascript-specific job that bundles the project's dependencies along with the source code in a single tarball --- is this a bad idea? | 18:06 |
| *** harlowja has joined #openstack-infra | 18:06 | |
| fungi | description: Container Infrastructure Management Service for OpenStack | 18:06 |
| *** [1]Thelo has joined #openstack-infra | 18:06 | |
| *** mfalatic has joined #openstack-infra | 18:06 | |
| *** pvaneck_ has joined #openstack-infra | 18:06 | |
| *** sdague has quit IRC | 18:06 | |
| fungi | hongbin: i can change it to that now if that's what you want it to be. looks like it got updated in that file at some point | 18:06 |
| *** karthikp_ has quit IRC | 18:07 | |
| sulo | fungi: clarkb: would you be able to add member to gerrit group for a new project please ? | 18:07 |
| *** pvaneck_ has quit IRC | 18:07 | |
| hongbin | fungi: Yes, the description in the file is what I wanted | 18:07 |
| honza | the motivation being that any subsequent build tools won't need to use the internet to build the project | 18:07 |
| fungi | hongbin: done | 18:07 |
| fungi | sulo: what was the change to project-config that added the new project? | 18:08 |
| sulo | 332470 | 18:08 |
| hongbin | fungi: Thanks. Could I ask to update the python-magnumclient description as well? | 18:08 |
| hongbin | https://github.com/openstack/python-magnumclient | 18:08 |
| sulo | fungi: https://review.openstack.org/#/c/332470/ | 18:08 |
| fungi | honza: i think we may already have javascript jobs that do that (for example the storyboard webclient tarball jobs use npm and grunt to build) | 18:08 |
| *** Thelo has quit IRC | 18:08 | |
| *** [1]Thelo is now known as Thelo | 18:08 | |
| pabelanger | fungi: clarkb: okay, everything ready for 313897. debian-ceph-jewel mirror | 18:10 |
| openstackgerrit | Merged openstack-infra/project-config: Reduce the OSIC max-servers https://review.openstack.org/344354 | 18:10 |
| fungi | hongbin: updated to "Python client for Container Infrastructure Management Service" | 18:10 |
| fungi | matching what's in gerrit/projects.yaml | 18:10 |
| hongbin | fungi: thanks a lot | 18:10 |
| clarkb | pabelanger: I think I +2'd and you have enough reviews to self approve? | 18:10 |
| honza | fungi: that would mean introducing grunt to our project --- is there a way to do this with only npm? | 18:11 |
| pabelanger | clarkb: I uploaded another patch, to fix our apache configuration. That's the reason for the quick ping | 18:12 |
| fungi | honza: i don't know much about javascript packaging other than that we seem to have at least some javascript-based projects that bundle their dependencies in their release artifact | 18:12 |
| pabelanger | clarkb: in hindsight, I should have just did a follow up patch | 18:12 |
| fungi | honza: you might want to talk to r1chardj0nes or krotscheck about javascript packaging paradigms and automation | 18:13 |
| *** fawadkhaliq has joined #openstack-infra | 18:13 | |
| * krotscheck perks up | 18:13 | |
| *** jsavak has quit IRC | 18:13 | |
| * krotscheck checks backscroll | 18:13 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Forklift in YamlJsonSerializer https://review.openstack.org/343615 | 18:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Move list_magnum_services to OperatorCloud https://review.openstack.org/344395 | 18:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Stop creating cloud objects in functional tests https://review.openstack.org/344396 | 18:13 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Migrate functional tests to betamax https://review.openstack.org/344397 | 18:13 |
| *** jsavak has joined #openstack-infra | 18:14 | |
| mordred | notmorgan: ^^ you might enjoy that last patch | 18:14 |
| krotscheck | honza: Which project? | 18:14 |
| honza | krotscheck: tripleo-ui https://review.openstack.org/#/c/343834/ | 18:14 |
| notmorgan | mordred: woot | 18:15 |
| fungi | sulo: that project was created by searob (who doesn't seem to be in here right now). i've added his gerrit account as the initial member of the craton-core and craton-release groups in gerrit and he can add you or others as needed now | 18:15 |
| krotscheck | honza: Got it. | 18:15 |
| *** sdague has joined #openstack-infra | 18:15 | |
| sulo | fungi: he asked a few times up ^^ if it helps .. sarob ^^ | 18:15 |
| krotscheck | honza: Okidokie, so, in your case, I don't think you need to have a brand new job, you should be able to do it all with the existing hooks. | 18:15 |
| fungi | sulo: hah, i mistyped sarob when trying to tab-complete. mea culpa | 18:16 |
| krotscheck | honza: Let me checkout your project and take a quick look at your package file. | 18:16 |
| *** _ari_ has quit IRC | 18:16 | |
| sulo | fungi: cool, he can add me, thanks!! | 18:16 |
| *** _ari_ has joined #openstack-infra | 18:16 | |
| honza | krotscheck: actually, we're in the middle of redoing the build process to simplify it | 18:16 |
| clarkb | pabelanger: just the symlink added ya? +2 | 18:16 |
| honza | krotscheck: we're getting rid of the gulp file and using only npm, ie "npm run build" | 18:17 |
| krotscheck | honza: You're speaking my language. | 18:17 |
| honza | krotscheck: yay | 18:17 |
| fungi | krotscheck: Teresita-Warrior will likely want some similar guidance on packaging/building for deploying http://git.openstack.org/cgit/openstack-infra/userstory-dashboard/ soon too | 18:17 |
| * krotscheck does his little javascript dance. | 18:17 | |
| fungi | all teh js projects are coming out of the woodwork to use the frameworks you've put in place | 18:18 |
| fungi | success | 18:18 |
| krotscheck | fungi: I'll reserve my enthusiasm until we see the "Port Nova to Node.js" thread on the dev list. ;) | 18:18 |
| krotscheck | Aaanyway | 18:18 |
| honza | bahahaha | 18:19 |
| krotscheck | honza: Give me a few minutes, I'm just off vacation and have to replace the "Austrian beer" memory bits in my brain with "Javascript" | 18:19 |
| JayF | krotscheck: didn't someone do that once? | 18:19 |
| JayF | krotscheck: or was it just keystone? | 18:19 |
| *** esikachev has joined #openstack-infra | 18:19 | |
| fungi | JayF: replace austrian beer with javascript? i really hope not! | 18:19 |
| fungi | or if they did, may their experience serve as a reminder to us all | 18:20 |
| krotscheck | fungi, JayF: Ya know, beer == javascript would explain a lot.... | 18:20 |
| JayF | lol | 18:20 |
| *** pstack has quit IRC | 18:20 | |
| * JayF has worked on nodejs apps before, and I never want to ... /callback/ ... to that time in my life | 18:20 | |
| krotscheck | JayF: Use promises. Way nicer. | 18:21 |
| honza | krotscheck: awesome, thanks! | 18:21 |
| pabelanger | clarkb: ya | 18:21 |
| openstackgerrit | Merged openstack-infra/project-config: puppet-openstack-cookiecutter: run bash script for testing https://review.openstack.org/344319 | 18:21 |
| krotscheck | honza: Ok, so, as far as the upload infra is concerned, anything you invoke in "npm prepublish" will make it into the tarball. If you want to generate a "Built thing with all dependencies", you can invoke webpack there, and then have the files: [] field list off everything that's been copied into the right place. | 18:22 |
| JayF | krotscheck: I promise to never work on node.js code again, if I can help it :P | 18:22 |
| krotscheck | honza: Ironic-webclient does that, though it uses gulp. | 18:22 |
| honza | krotscheck: do you have a repo link handy? | 18:22 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add puppet-mosquitto project https://review.openstack.org/344386 | 18:22 |
| krotscheck | honza: FYI, the invocation pattern in npm's lifecycle is "prepublish, pack, publish, postpublish" | 18:22 |
| krotscheck | And we only invoke "pack" during the tarball upload script, so it'll trigger prepublish, but nothing else. | 18:23 |
| krotscheck | honza: Sounds like you want to use webpack? | 18:23 |
| krotscheck | JayF: The world is lessened for the loss of your expertise :) | 18:23 |
| *** seldenr has quit IRC | 18:23 | |
| honza | krotscheck: that's correct | 18:24 |
| krotscheck | honza: I'm guessing that your webpack build exports a fully functional app with bows and cherries on top? | 18:24 |
| krotscheck | s/exports/outputs | 18:24 |
| honza | krotscheck: that's the intention :) | 18:24 |
| krotscheck | honza: Ok, well then, in package.json's scripts field it'd be prepublish: "webpack", and then files: ["all", "your", "globs", "here"] | 18:25 |
| krotscheck | honza: And then run `npm pack` to make sure the tarball has everything you're expecting (might wanna add *.tgz to .gitignore while you're at it) | 18:26 |
| krotscheck | honza: npm-publish-tarball and npm-build-draft should do the rest. | 18:26 |
| krotscheck | (or whatever I called the publish-draft build) | 18:26 |
| honza | krotscheck: i'm actually building an rpm and the tarball should just contain unminified sources but yes! | 18:27 |
| honza | krotscheck: so, the infra patch looks like that's all that's needed + some package.json bits in the actual project | 18:27 |
| *** tonytan4ever has quit IRC | 18:28 | |
| krotscheck | honza: I believe so, lemme confirm by checking against a different project.... | 18:28 |
| *** jsavak has quit IRC | 18:31 | |
| *** jsavak has joined #openstack-infra | 18:31 | |
| krotscheck | honza: what directory will webpack output the app to? | 18:32 |
| honza | krotscheck: dist/ most likely | 18:32 |
| krotscheck | ./dist? ./www? ./unicorns? | 18:32 |
| krotscheck | gotcha. | 18:32 |
| krotscheck | Adding an optional comment to your patch. | 18:32 |
| honza | krotscheck: holy shit, let's make ./unicorns a thing | 18:33 |
| krotscheck | honza: I tried that once. The pegacorns revolted. | 18:33 |
| * honza dies | 18:33 | |
| * krotscheck notes that his laptop's name is PinkiePie. | 18:33 | |
| *** e0ne has quit IRC | 18:38 | |
| *** bhunter71 has quit IRC | 18:38 | |
| krotscheck | honza: Comments made. I believe you're golden, and I made some improvement suggestions as well. | 18:38 |
| *** ayoung has quit IRC | 18:39 | |
| honza | krotscheck: awesome, thanks a lot! | 18:39 |
| krotscheck | honza: I'd suggest you land the package.json bits first, and then set up a depends-on for this build, so you don't accidentally break everything on everyone else. | 18:39 |
| *** yamahata has joined #openstack-infra | 18:40 | |
| *** Sukhdev has joined #openstack-infra | 18:40 | |
| *** rossella_s has quit IRC | 18:40 | |
| *** amitgandhinz has quit IRC | 18:41 | |
| honza | krotscheck: depends-on in infra? | 18:41 |
| krotscheck | Teresita-Warrior: LMK when you're online, I can assist with your deploy as well. | 18:41 |
| krotscheck | honza: Yeah- propose the package.json mods in one patch, then modify the commit message on 343834 with a line that reads "Depends-on: [change-id of package.json patch]" | 18:41 |
| *** rossella_s has joined #openstack-infra | 18:41 | |
| *** pstack has joined #openstack-infra | 18:41 | |
| *** e0ne has joined #openstack-infra | 18:41 | |
| krotscheck | honza: That way they'll land in order. | 18:41 |
| honza | krotscheck: lol, yes, sorry | 18:42 |
| honza | a bit slow on that one | 18:42 |
| *** rbrndt__ has quit IRC | 18:45 | |
| fungi | krotscheck: the userstory-dashboard situation is mostly greenfield (there's some minimal npm/grunt usage i think, but not running any jobs yet) | 18:45 |
| fungi | just imported into gerrit over the weekend | 18:46 |
| krotscheck | fungi: wfm. | 18:46 |
| krotscheck | fungi: To be honest, I think everyon's starting ot align on a similar toolset. | 18:46 |
| krotscheck | It's kinda nice to see. | 18:46 |
| fungi | absolutely | 18:46 |
| *** amitgandhinz has joined #openstack-infra | 18:47 | |
| krotscheck | fungi: We managed to build consensus around using jasmine as well. | 18:47 |
| krotscheck | But that's a tougher sell for projects that have established test bases. | 18:47 |
| openstackgerrit | amrith proposed openstack-infra/irc-meetings: Proposing OpenStack SWG Meeting https://review.openstack.org/338134 | 18:47 |
| krotscheck | Either way. | 18:47 |
| krotscheck | Progress \o/ | 18:47 |
| *** EricGonczer_ has quit IRC | 18:49 | |
| *** markusry has quit IRC | 18:50 | |
| AJaeger | project config cores, can we move forward with constraints, please? I'd like to see another review on https://review.openstack.org/#/c/343665/ , please | 18:50 |
| *** esikachev has quit IRC | 18:52 | |
| *** cgalan has quit IRC | 18:52 | |
| rcarrillocruz | fungi: btw, won't be on meeting today, at EuroPython , not really around on my computer | 18:54 |
| *** zzzeek has quit IRC | 18:55 | |
| *** sdake_ has joined #openstack-infra | 18:55 | |
| fungi | rcarrillocruz: understandable--have fun! | 18:55 |
| *** tonytan4ever has joined #openstack-infra | 18:56 | |
| *** sdake has quit IRC | 18:57 | |
| *** claudiub has quit IRC | 18:59 | |
| *** zzzeek has joined #openstack-infra | 18:59 | |
| pleia2 | meeting time :) | 19:00 |
| *** abregman has joined #openstack-infra | 19:00 | |
| *** javeriak has quit IRC | 19:00 | |
| *** tkelsey has quit IRC | 19:00 | |
| *** david-lyle has joined #openstack-infra | 19:00 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Migrate functional tests to betamax https://review.openstack.org/344397 | 19:01 |
| mordred | notmorgan: ^^ moved the cassettes dir | 19:01 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Configure its-storyboard plugin https://review.openstack.org/330925 | 19:01 |
| mordred | and fixed the whitespace :) | 19:01 |
| *** sarob has quit IRC | 19:02 | |
| clarkb | cassettes that is a word I have not heard in a very long timw | 19:02 |
| *** julim has quit IRC | 19:02 | |
| mordred | clarkb: they're a thing from betamax :) | 19:03 |
| notmorgan | mordred: are they something we want to allow to be installed via something like extras? | 19:03 |
| mordred | notmorgan: I don't think installing them via pip is particularly useful. but I could be wrong? | 19:03 |
| notmorgan | mordred: that is why i ask, i'm... just not sure? | 19:03 |
| mordred | notmorgan: let's mull -it'll be a few days before that bad boy is ready to land anyway | 19:04 |
| *** bin_ has quit IRC | 19:04 | |
| *** rockyg has joined #openstack-infra | 19:06 | |
| notmorgan | WFM | 19:06 |
| *** lezbar__ has quit IRC | 19:09 | |
| *** david-lyle has quit IRC | 19:09 | |
| *** jsavak has quit IRC | 19:09 | |
| *** jsavak has joined #openstack-infra | 19:10 | |
| *** salv-orlando has quit IRC | 19:10 | |
| *** salv-orlando has joined #openstack-infra | 19:10 | |
| *** asettle has joined #openstack-infra | 19:11 | |
| *** rbuzatu has quit IRC | 19:11 | |
| *** EricGonczer_ has joined #openstack-infra | 19:13 | |
| *** r-mibu has quit IRC | 19:13 | |
| *** r-mibu has joined #openstack-infra | 19:13 | |
| *** kzaitsev_mb has quit IRC | 19:14 | |
| *** rockyg has quit IRC | 19:14 | |
| *** rockyg has joined #openstack-infra | 19:15 | |
| *** timl0101 has quit IRC | 19:16 | |
| *** claudiub has joined #openstack-infra | 19:17 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: unify testing for libraries https://review.openstack.org/344432 | 19:18 |
| *** jsavak has quit IRC | 19:20 | |
| *** gyee has quit IRC | 19:20 | |
| *** jsavak has joined #openstack-infra | 19:21 | |
| *** jcoufal_ has quit IRC | 19:22 | |
| *** karthik__ has joined #openstack-infra | 19:22 | |
| *** amitgandhinz has quit IRC | 19:23 | |
| *** cardeois_ has joined #openstack-infra | 19:25 | |
| *** cardeois__ has joined #openstack-infra | 19:25 | |
| *** cardeois__ has quit IRC | 19:26 | |
| *** cardeois has quit IRC | 19:26 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:26 | |
| *** cardeois has joined #openstack-infra | 19:27 | |
| *** tonytan_brb has joined #openstack-infra | 19:28 | |
| *** cardeois_ has quit IRC | 19:29 | |
| *** rbrndt__ has joined #openstack-infra | 19:29 | |
| *** gouthamr has quit IRC | 19:30 | |
| *** sarob has joined #openstack-infra | 19:30 | |
| *** tonytan4ever has quit IRC | 19:31 | |
| *** sarob has quit IRC | 19:32 | |
| *** sarob has joined #openstack-infra | 19:32 | |
| *** gouthamr has joined #openstack-infra | 19:34 | |
| *** kzaitsev_mb has quit IRC | 19:36 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:36 | |
| openstackgerrit | Merged openstack-infra/system-config: Add debian-ceph-jewel mirror to AFS https://review.openstack.org/313897 | 19:38 |
| *** pvaneck has quit IRC | 19:40 | |
| *** pvaneck has joined #openstack-infra | 19:40 | |
| openstackgerrit | C.J. Collier proposed openstack-infra/gerritbot: DO NOT MERGE - Improve gerritbot error handling https://review.openstack.org/287056 | 19:40 |
| *** bhunter71 has joined #openstack-infra | 19:42 | |
| *** kzaitsev_mb has quit IRC | 19:43 | |
| *** markusry has joined #openstack-infra | 19:44 | |
| *** mmandel has joined #openstack-infra | 19:46 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:47 | |
| *** oanson has joined #openstack-infra | 19:48 | |
| *** asettle has quit IRC | 19:53 | |
| sfinucan | Quick question: who can I talk to about Gerrit admin questions? | 19:53 |
| sfinucan | I need to merge two Gerrit accounts. Seems it possible, but only by a Gerrit admin :/ | 19:53 |
| clarkb | sfinucan: many in this channel can but we are just finishing up an irc meeting. Wait about 5-10 minutes and someone can likely help | 19:56 |
| sfinucan | clarkb: no problem at all | 19:56 |
| *** asettle has joined #openstack-infra | 19:58 | |
| *** tkelsey has joined #openstack-infra | 19:58 | |
| clarkb | pabelanger: before I forget did you see my comment on the use ssh pipelining change? | 19:59 |
| clarkb | zaro: ianw we can continue conversation here | 20:00 |
| clarkb | zaro: ianw is that used to reject commits or format them or? | 20:00 |
| clarkb | the docs aren't clear to me | 20:00 |
| krotscheck | Anyone familiar with variable replacement able to answer a question for me? | 20:00 |
| krotscheck | sorry | 20:00 |
| *** oanson has quit IRC | 20:00 | |
| zaro | clarkb: it's just setting up puppet to accept those configs | 20:00 |
| krotscheck | Context: Variable replacement in the shell jjb builder. | 20:00 |
| *** hashar_ has quit IRC | 20:00 | |
| clarkb | zaro: yes, but why are we wanting to use it? what is the goal? | 20:00 |
| krotscheck | What happens when a variable is unset? Will this patch work? https://review.openstack.org/#/c/337481/3/jenkins/jobs/macros.yaml | 20:00 |
| *** akshai has quit IRC | 20:01 | |
| zaro | clarkb: this is the thing that does stuff with those params: https://review.openstack.org/#/c/316197/ | 20:01 |
| clarkb | krotscheck: it will work but its a compile error to not set {version} iirc | 20:01 |
| ianw | clarkb: my understanding of the docs was it would just warn, unless you turned on "rejectTooLong" | 20:01 |
| clarkb | zaro: right but we aren't using that plugin today are we? | 20:02 |
| krotscheck | clarkb: Thanks. Is there a way to set a default value? | 20:02 |
| *** moravec has quit IRC | 20:02 | |
| *** julim has joined #openstack-infra | 20:02 | |
| clarkb | krotscheck: I don't think so. We just use something like version: default or version: '' | 20:02 |
| zaro | clarkb: yes, it's gerrit core or gerrit core plugin. don't remember which | 20:02 |
| pabelanger | clarkb: I did, I've tested it already with ubuntu-trusty and becomes, no issues | 20:02 |
| *** tkelsey has quit IRC | 20:02 | |
| AJaeger | krotscheck: see http://logs.openstack.org/81/337481/3/check/gate-project-config-compare-xml/238f168/console.html.gz, it sets VERSION={version} | 20:02 |
| pabelanger | clarkb: need to try centos-7, precise and xenial still | 20:03 |
| krotscheck | clarkb: That works for me, thanks. | 20:03 |
| zaro | clarkb, ianw : yes, i believe it's just warn. but let me double check | 20:03 |
| AJaeger | krotscheck: so, might work but looks ugly ;( | 20:03 |
| clarkb | zaro: ianw gotcha now I undertand better. Basically its a default thing we get and its not quite configured properly | 20:03 |
| clarkb | pabelanger: did you test the launch instance case? | 20:03 |
| openstackgerrit | Cyril Roelandt proposed openstack-dev/hacking: Add a check for delayed string interpolation https://review.openstack.org/343824 | 20:04 |
| clarkb | pabelanger: eg "run ansible on host that isn't otherwise modified by infra" | 20:04 |
| AJaeger | krotscheck: I would set version to 4 explicitely... | 20:04 |
| clarkb | pabelanger: beacuse I think that is the one most likely to break for us | 20:04 |
| clarkb | AJaeger: krotscheck ya in this case setting it to 4 or 6 explicitly seems like the best bet | 20:04 |
| anteaya | I'm going to the nova meeting room now, I'm not going to take my laptop as I question whether I can use it | 20:05 |
| anteaya | so effectively offline | 20:05 |
| *** eharney has quit IRC | 20:05 | |
| *** cardeois_ has joined #openstack-infra | 20:05 | |
| krotscheck | clarkb, AJaeger: That's what I'm trying to work through right now, trying to figure out the best way to let each project pick the appropriate version. | 20:05 |
| clarkb | sfinucan: ok, which two accounts do we need to deal with? also we don't quite merge them. The process is more like retiring an old account and making it non visible then you continue to use the other account | 20:05 |
| AJaeger | team, a question regarding coverage job: https://review.openstack.org/344111 adds this for check queue only in ironic. Normally, I would say: In both check and gate - what do you think? I was hesitant to -1 in this case since getting only coverage (and not chagne in coverage) for gate might be overkill. | 20:05 |
| pabelanger | clarkb: no, I haven't tested that yet | 20:05 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 20:05 |
| AJaeger | anteaya: enjoy! | 20:05 |
| clarkb | krotscheck: in python land we do it differently. We make specific jobs for each python version and we don't really negotiate that a whole lot | 20:05 |
| *** cardeois has quit IRC | 20:06 | |
| zaro | clarkb, ianw : it's definately just warning, would need to set 'rejectTooLong' to reject | 20:06 |
| clarkb | krotscheck: eg python2.7 and 3.4 and 3.5 are the options now and the jobs very explicitly use one of them | 20:06 |
| clarkb | zaro: cool | 20:06 |
| clarkb | krotscheck: so for npm/node you could have the -npm4 and -npm6 jobs and install the appropriate one | 20:06 |
| *** eharney has joined #openstack-infra | 20:07 | |
| clarkb | then projects would opt into one or the other | 20:07 |
| krotscheck | clarkb: That's what was thinking. | 20:07 |
| krotscheck | clarkb: Great minds think alike ;) | 20:07 |
| krotscheck | It's just a bit of a bigger patch than I was anticipating | 20:07 |
| *** timl0101 has joined #openstack-infra | 20:07 | |
| *** _ari_ has quit IRC | 20:08 | |
| *** fawadkhaliq has quit IRC | 20:09 | |
| *** zul has quit IRC | 20:09 | |
| fungi | it always is | 20:09 |
| clarkb | krotscheck: that doesn't mean you couldn't make a job that ran python 2.6 or python3 master but you'd have to figure out the one off of getting those versions installed on $distro. I think providing a set of things that are precanned and workable is sane for the "infra helps with this" | 20:09 |
| AJaeger | krotscheck: btw. is https://review.openstack.org/#/c/338508 ready to merge ? I wanted to wait until you're back in case of problems... | 20:09 |
| sfinucan | clarkb: Wait - I think I got it :) | 20:10 |
| krotscheck | AJaeger: I believe so. | 20:10 |
| *** zul has joined #openstack-infra | 20:11 | |
| *** kzaitsev_mb has quit IRC | 20:11 | |
| sfinucan | clarkb: I have to delete Ubuntu One account + add new email to that, then merge my two launchpad accounts | 20:11 |
| *** vhosakot has quit IRC | 20:11 | |
| *** asettle has quit IRC | 20:11 | |
| sfinucan | clarkb: Why we have both Ubuntu One authenticating for Launchpad, which authenticates for Gerrit is beyond me :D | 20:11 |
| clarkb | sfinucan: that won't actually fix the gerrit side | 20:11 |
| sfinucan | clarkb: no? | 20:11 |
| AJaeger | pabelanger, do we need a mirror of nodesource? See https://review.openstack.org/#/c/338508 | 20:11 |
| zaro | ianw: any reason why no workflow+1 for this? https://review.openstack.org/#/c/300576/ | 20:11 |
| clarkb | sfinucan: no you'll still have the second account in gerrit that is associated to the old openid | 20:12 |
| *** Teresita-Warrior has quit IRC | 20:12 | |
| sfinucan | clarkb: Oh, so that one can probably be deleted as I didn't actually commit anything against it | 20:12 |
| AJaeger | project config cores, can we move forward with constraints, please? I'd like to see another review on https://review.openstack.org/#/c/343665/ , please | 20:12 |
| pabelanger | AJaeger: I am not sure | 20:12 |
| sfinucan | clarkb: I can't log in to that now though, so I can't delete it myself | 20:12 |
| clarkb | sfinucan: ya in that case what we do is make it inactive so that it doesn't show up in user searches and stuff | 20:12 |
| *** Sukhdev has quit IRC | 20:12 | |
| clarkb | sfinucan: do you know what name/email/something was associated to it so I can find it | 20:13 |
| AJaeger | pabelanger: I think we don't need one, that's why I +2 - but wanted to raise it... | 20:13 |
| zaro | fungi, clarkb : would really like git gc running this weekend. could you please take a look? https://review.openstack.org/#/c/342388/ | 20:13 |
| sfinucan | clarkb: Sweet. Well then can you "delete" stephenfin | 20:13 |
| ianw | zaro: just being conservative, seems fine but wasn't sure enough of the implications | 20:13 |
| clarkb | sfinucan: I can mark that account inactive then you can use the other account going forward | 20:13 |
| * AJaeger waves good bye | 20:13 | |
| sfinucan | clarkb: I'd prefer to use that username, but all my past commits are against 'sfinucan' | 20:13 |
| pabelanger | AJaeger: ya, I'm not the best to ask about nodejs. Don't really touch it | 20:13 |
| AJaeger | pabelanger: I was more interested in the repo mirror question - whether we want/need something for that | 20:14 |
| pabelanger | AJaeger: that said, we have talked about a generic AFS list that will allow people to mirror things pretty easy. Like 1 off files | 20:14 |
| *** asettle has joined #openstack-infra | 20:14 | |
| AJaeger | ah, cool | 20:14 |
| clarkb | sfinucan: we can't switch usernames like that easily | 20:14 |
| krotscheck | pabelanger, AJaeger: I feel that eventually, we might want one; I don't see enough usage of the npm jobs to warrant the effort yet though | 20:14 |
| *** Teresita-Warrior has joined #openstack-infra | 20:14 | |
| clarkb | sfinucan: so we mostly tell people only you ever know what it is and set it in your .gitconfig and ask that you live with it :) | 20:14 |
| sfinucan | clarkb: Yeah, that's fine. If it's hassle then just mark 'stephenfin' as inactive | 20:15 |
| *** kzaitsev_mb has joined #openstack-infra | 20:15 | |
| pabelanger | krotscheck: AJaeger: Ya, for me, I'd likely get the gem mirror going first then looking at it :) | 20:15 |
| sfinucan | I'll live with my mistakes :) | 20:15 |
| krotscheck | pabelanger: Oh right, thanks for reminding me. | 20:15 |
| *** Teresita-Warrior has quit IRC | 20:16 | |
| krotscheck | Dagnabbit. I have no cloud available anymore. | 20:16 |
| clarkb | sfinucan: account 22817 has been marked inactive | 20:16 |
| *** dprince has quit IRC | 20:16 | |
| zaro | ianw: ohh, review.o.o is already doing what that patch attempts to implement. hmm.. | 20:16 |
| * sfinucan makes sure that's the right one | 20:16 | |
| sfinucan | clarkb: Excellent. Thank you :) | 20:16 |
| clarkb | sfinucan: the other is 15334 | 20:17 |
| fungi | sfinucan: you may find that changes created by 22817 (if any) are not able to be abandoned or restored by you any longer, though core reviewers on those projects should still be able to abandon/restore them for you | 20:17 |
| sfinucan | fungi: Yeah, I don't have any (I think) so that should be all good | 20:18 |
| *** asettle has quit IRC | 20:18 | |
| fungi | sfinucan: agreed... https://review.openstack.org/#/q/owner:22817 | 20:19 |
| openstackgerrit | Merged openstack-infra/system-config: Revert "Disable puppet on wiki.openstack.org" https://review.openstack.org/343956 | 20:20 |
| fungi | #status log Puppet is reenabled on wiki.openstack.org, and is updating the page edit captcha from questy to recaptcha | 20:20 |
| sfinucan | fungi: clarkb: I'm waiting for a reason to commit to try, but will a push succeed if I use my personal email as the commit author? Previously it said "invalid committer" | 20:20 |
| zaro | ianw: ohh, i think the commit msg is misleading. the basic affect is that it will add a new protocol to the download drop down on the gerrit UI, 'anonymous git', which will look like git://git.openstack.org/openstack-infra/.. | 20:20 |
| openstackstatus | fungi: finished logging | 20:20 |
| clarkb | sfinucan: it will if you add the email addr via https://review.openstack.org/#/settings/contact | 20:21 |
| *** pstack has quit IRC | 20:21 | |
| *** karthik__ has quit IRC | 20:21 | |
| fungi | though i think you have to wait for it to send you a confirmation e-mail at that address and then follow a hyperlink in it | 20:22 |
| *** karthik__ has joined #openstack-infra | 20:22 | |
| openstackgerrit | Merged openstack-infra/zuul: Add nodepool request framework https://review.openstack.org/304302 | 20:22 |
| sfinucan | fungi: Yup, I had that done. We're all good so | 20:22 |
| sfinucan | thanks folks | 20:22 |
| pabelanger | H | 20:22 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: unify testing for libraries https://review.openstack.org/344432 | 20:23 |
| openstackgerrit | Merged openstack-infra/zuul: Add dynamic reconfiguration https://review.openstack.org/340597 | 20:23 |
| pabelanger | clarkb: ceph-deb-jewel online: http://mirror.dfw.rax.openstack.org/ceph-deb-jewel/ | 20:23 |
| clarkb | pabelanger: neat | 20:23 |
| EmilienM | pabelanger: guess who'll use it first :P | 20:24 |
| pabelanger | EmilienM: devstack!\ | 20:24 |
| *** aviau has quit IRC | 20:24 | |
| *** aviau has joined #openstack-infra | 20:25 | |
| EmilienM | pabelanger: ok... we'll be second :( | 20:25 |
| pabelanger | ianw: clarkb: fungi: if you'd like to review 342934. That is our debian AFS mirror | 20:25 |
| pabelanger | EmilienM: actually, unless somebody does the devstack patch, you'll likely be first :D | 20:25 |
| clarkb | pabelanger: and the third one is the mariadb one from odyssey4me | 20:25 |
| *** markusry has quit IRC | 20:25 | |
| clarkb | pabelanger: I actually need to see if my devstack plugin patch merged which will stop using the default isntalled repo | 20:26 |
| pabelanger | clarkb: Agreed, I think we should mirror directly from upstream, over rax. | 20:27 |
| EmilienM | pabelanger: keys/release.asc is missing | 20:27 |
| clarkb | pabelanger: https://review.openstack.org/#/c/339690/ it did I will go ahead and propose a change to remove the old apt source | 20:27 |
| pabelanger | EmilienM: missing from? | 20:27 |
| EmilienM | https://download.ceph.com/keys/release.asc | 20:27 |
| openstackgerrit | Merged openstack-infra/project-config: Use zuul-cloner for install-guide and api-* docs jobs https://review.openstack.org/343665 | 20:27 |
| clarkb | EmilienM: its a reprepro mirror we don't assert we are them | 20:28 |
| clarkb | EmilienM: so tahts correct | 20:28 |
| *** dkehn has quit IRC | 20:29 | |
| pabelanger | Ya, we only get to do that with centos-7 because we use rsync | 20:29 |
| fungi | we (currently) disable secure apt on our job nodes anyway so you just see a warning in the log about it being unsigned but the jobs still use it fine | 20:29 |
| EmilienM | mhh, our puppet-ceph deploy apt key from https://download.ceph.com/keys/release.asc | 20:29 |
| openstackgerrit | Merged openstack-infra/zuul: Remove scheduler.getProject https://review.openstack.org/342965 | 20:29 |
| openstackgerrit | Merged openstack-infra/zuul: Prevent jobs from overriding jobs in other repos https://review.openstack.org/342966 | 20:29 |
| clarkb | pabelanger: actually I need to check if I have to do this for older branches first. I suspect not but will double check | 20:29 |
| *** sarob has quit IRC | 20:29 | |
| *** rbuzatu has joined #openstack-infra | 20:30 | |
| fungi | clarkb: i think it was only added in newton but my memory is not great | 20:30 |
| *** dkehn has joined #openstack-infra | 20:30 | |
| clarkb | fungi: pabelanger devstack-plugin-ceph only has a master branch win | 20:31 |
| *** smcginnis_ has joined #openstack-infra | 20:31 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Remove old ceph apt sources config https://review.openstack.org/344447 | 20:32 |
| clarkb | pabelanger: fungi ^ then we can add the jewel stuff on top of that | 20:32 |
| thingee | fungi: any concern with a bunch of projects proposing branches and project-config changes to do this? http://lists.openstack.org/pipermail/openstack-dev/2016-July/099584.html | 20:32 |
| thingee | fungi: talking about it in the cinder midcycle | 20:32 |
| pabelanger | fungi: clarkb: Ya, I haven't done the heredoc patch yet | 20:32 |
| pabelanger | but that shouldn't stop us from adding jewel | 20:33 |
| clarkb | thingee: you shouldn't need any project-config changes for that | 20:33 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add puppet-mosquitto project https://review.openstack.org/344386 | 20:33 |
| clarkb | thingee: the biggest concern is in many cases they are not required and deving straight off master is simpler to manage and understand. I would encourage projects to start with one and work through it themselves to learn the ups and downs (swift has had a bit of experience with it so are now comfortable) | 20:33 |
| clarkb | thingee: rather than say show up with 5 different feature branche all at once having never done it before | 20:34 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Update the chair for the Nova Hyper-V meeting https://review.openstack.org/344349 | 20:34 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add Name to Barbican meeting chair https://review.openstack.org/344451 | 20:34 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add Name for I18n meeting https://review.openstack.org/344452 | 20:34 |
| *** kzaitsev_mb has quit IRC | 20:35 | |
| *** vhosakot has joined #openstack-infra | 20:35 | |
| mordred | thingee: yah. I echo what clarkb said | 20:35 |
| thingee | clarkb: thanks | 20:35 |
| mordred | thingee: it's one of those things that's a rare need, although is useful when it's actually needed | 20:35 |
| clarkb | thingee: I think notmyname captured it well but you actually need to actively manage your feature branches | 20:35 |
| clarkb | thingee: merging back and forth and resolving conflicts and fixes issues that arrise | 20:35 |
| mordred | ++ | 20:36 |
| *** Teresita-Warrior has joined #openstack-infra | 20:36 | |
| notmyname | I agree is clarkb and mordred. feature branches require a lot of communication (they aren't a substitute for it) | 20:36 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Enable net-iso for ovb jobs https://review.openstack.org/343017 | 20:36 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Pull all puppet modules from local sources https://review.openstack.org/344454 | 20:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add ovb to mirrored git repo list https://review.openstack.org/344455 | 20:37 |
| mordred | notmyname: very few things, it turns out, are a substitute for actual communication :) | 20:38 |
| *** EricGonczer_ has quit IRC | 20:38 | |
| clarkb | I definitely think that if a project has a large feature or rewrite or something similar they should feel free to give it a go. But just be aware that its not like infra does the work for you :) the project will have to invest in it | 20:39 |
| EmilienM | pabelanger: https://review.openstack.org/344457 | 20:39 |
| EmilienM | pabelanger: first step | 20:39 |
| *** Teresita-Warrior has quit IRC | 20:39 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Enable net-iso for ovb jobs https://review.openstack.org/343017 | 20:39 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Update Barbican meeting chair https://review.openstack.org/344451 | 20:39 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add Name for I18n meeting https://review.openstack.org/344452 | 20:39 |
| clarkb | pabelanger: mordred: apparently apt-mirror will properly mirror an apt repo and never publish an invalid index. I have not tested this but may be a good alternative to reprepro so we can get signed indexes back | 20:40 |
| mordred | clarkb: cool | 20:40 |
| EmilienM | pabelanger: ah, it's not good, the URL is not the same in your mirror, I need to update my patch | 20:40 |
| mordred | clarkb: I'd be totally game to try apt-mirror+vos release | 20:41 |
| pabelanger | clarkb: ya, I would be interested in seeing that | 20:41 |
| clarkb | https://github.com/apt-mirror/apt-mirror/blob/master/apt-mirror#L25 is the lcoation of the claim | 20:41 |
| *** jsavak has quit IRC | 20:41 | |
| mordred | clarkb, pabelanger: biggest thing we'll need to sort is the initial migration. it would be good if apt-mirror's output would be similar on disk to the reprepro dirs so that we don't have to do a total resync | 20:41 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Enable net-iso for ovb jobs https://review.openstack.org/343017 | 20:42 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Pull all puppet modules from local sources https://review.openstack.org/344454 | 20:42 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add ovb to mirrored git repo list https://review.openstack.org/344455 | 20:42 |
| *** EricGonczer_ has joined #openstack-infra | 20:42 | |
| *** _ari_ has joined #openstack-infra | 20:43 | |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Allow puppet to configure Gerrit's canonicalGitUrl option https://review.openstack.org/300572 | 20:43 |
| pabelanger | mordred: clarkb: we could do some initial testing on our ceph repos, since they are the smallest. | 20:44 |
| timrc | clarkb: We've gotten mismatched hashsums on indexes with apt-mirror I believe... I don't remember why though. Asking someone who might remember. | 20:44 |
| *** jsavak has joined #openstack-infra | 20:44 | |
| clarkb | timrc: :( ok maybe the claim is not valid then | 20:44 |
| *** kzaitsev_mb has joined #openstack-infra | 20:45 | |
| fungi | timrc: clarkb: however, that _is_ something we could script a check for against teh rw volume and then skip vos release if it fails | 20:45 |
| EmilienM | pabelanger: https://review.openstack.org/344461 | 20:45 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Zun: rename higgins to zun (2) https://review.openstack.org/329247 | 20:45 |
| mordred | as long as apt-mirror reports non-zero if the index it has is bad | 20:45 |
| *** hemanthm is now known as hemanthm|afk | 20:45 | |
| fungi | or that, yeah | 20:45 |
| timrc | clarkb: Let me hunt down the answer to why it was happening. It was a weird one... the sums generated by all the cryptographic functions were valid and matched the indexes but there was some sort of in flight corruption -- potentially with compression. | 20:46 |
| *** EricGonczer_ has quit IRC | 20:46 | |
| timrc | well some sort of corruption that was stumbled upon in-flight | 20:46 |
| EmilienM | pabelanger: consider it WIP now, but we'll use the mirror | 20:46 |
| *** esikachev has joined #openstack-infra | 20:47 | |
| *** e0ne has quit IRC | 20:49 | |
| *** gyee has joined #openstack-infra | 20:49 | |
| openstackgerrit | Merged openstack-infra/system-config: Make git protocol point to git.o.o https://review.openstack.org/300576 | 20:49 |
| *** karthik__ has quit IRC | 20:50 | |
| *** karthik__ has joined #openstack-infra | 20:50 | |
| clarkb | I have approved the nodepool change needed for xenial testing things. (it had two +2s already) | 20:51 |
| jeblair | clarkb: i think the gear change has landed -- i have not tagged a release, so we'll want to do a manual gear install from master on nodepool before restarting | 20:52 |
| clarkb | jeblair: ok, does that mean you don't want to do a release nowish? | 20:52 |
| *** e0ne has joined #openstack-infra | 20:53 | |
| jeblair | clarkb: yeah, i'd like us to test it first :) | 20:53 |
| clarkb | kk | 20:53 |
| clarkb | I am going to go eat lunch now while I wait for that ot process | 20:53 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Always set br-ex mtu including for grenade runs https://review.openstack.org/343024 | 20:54 |
| *** rcernin has joined #openstack-infra | 20:54 | |
| fungi | jeblair: clarkb: can i assume this is why nodepool.openstack.org is still disabled in the ansible emergency group list? | 20:55 |
| EmilienM | can someone help me to find why I got this duplicated job definition? http://logs.openstack.org/32/344432/2/check/gate-project-config-layout/1d14fc0/console.html#_2016-07-19_20_25_40_192801 | 20:55 |
| EmilienM | context: https://review.openstack.org/#/c/344432/ | 20:55 |
| *** tonytan_brb has quit IRC | 20:56 | |
| clarkb | fungi: yes | 20:56 |
| clarkb | fungi: tip of nodepool unworks so have manually installed code that is revert | 20:56 |
| fungi | cool. i suspected but probably wasn't paying attention to irc one night | 20:56 |
| jeblair | well, works poorly | 20:58 |
| *** EricGonczer_ has joined #openstack-infra | 20:58 | |
| *** esikachev has quit IRC | 20:58 | |
| *** Teresita-Warrior has joined #openstack-infra | 20:59 | |
| fungi | hrm, speaking of working poorly. puppet just now finally updated wiki.o.o and it's working poorly. i'm digging into logs to find out why | 21:00 |
| openstackgerrit | Merged openstack-infra/nodepool: Cache function worker map https://review.openstack.org/343828 | 21:01 |
| *** trown is now known as trown|outtypewww | 21:01 | |
| mtreinish | fungi: heh, working poorly vs not working at all? | 21:02 |
| fungi | mtreinish: yes, that sort of poorly | 21:02 |
| *** Sukhdev has joined #openstack-infra | 21:02 | |
| fungi | [Tue Jul 19 21:03:05 2016] [error] [client 74.202.214.170] PHP Parse error: syntax error, unexpected T_STRING in /srv/mediawiki/Settings.php on line 197 | 21:03 |
| *** cardeois_ has quit IRC | 21:03 | |
| *** cardeois_ has joined #openstack-infra | 21:04 | |
| fungi | a quoting issue. fix on the way | 21:04 |
| *** isq_ has quit IRC | 21:04 | |
| *** BigWillie has quit IRC | 21:05 | |
| *** harlowja has quit IRC | 21:06 | |
| *** jsavak has quit IRC | 21:06 | |
| openstackgerrit | Merged openstack-infra/zuul: Make job registration with labels optional https://review.openstack.org/336311 | 21:06 |
| *** psilvad has quit IRC | 21:07 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: unify testing for libraries https://review.openstack.org/344432 | 21:07 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki: Quote strings in Settings.php https://review.openstack.org/344469 | 21:07 |
| fungi | i'm emergency self-approving that | 21:08 |
| fungi | the end result is already in place on the server and working again | 21:08 |
| *** e0ne has quit IRC | 21:10 | |
| *** raildo has quit IRC | 21:12 | |
| *** karthik__ has quit IRC | 21:12 | |
| *** claudiub has quit IRC | 21:14 | |
| *** e0ne has joined #openstack-infra | 21:14 | |
| ianw | EmilienM: I think you want {name} in there, not {project}? | 21:14 |
| EmilienM | ianw: yeah I updated it in the last patchset, thanks | 21:14 |
| *** _ari_ has quit IRC | 21:15 | |
| ianw | oh, heh | 21:15 |
| zaro | ianw: actually the git:// won't take affect until the next gerrit restart. | 21:15 |
| *** ldnunes has quit IRC | 21:15 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 21:15 |
| *** isq has joined #openstack-infra | 21:15 | |
| ianw | zaro: ahh, yeah cool. i'm too used to auto-refreshing things like zuul and nodepool :) | 21:16 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 21:19 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 21:20 |
| *** flepied has quit IRC | 21:23 | |
| *** mmandel has quit IRC | 21:23 | |
| *** karthik__ has joined #openstack-infra | 21:25 | |
| *** rockyg has quit IRC | 21:25 | |
| fungi | i've tried out the recaptcha on the wiki (with a secondary lp account i maintain for testing things when i need to masquerade as a non-admin user) and it seems to be working great | 21:25 |
| fungi | as soon as 344469 merges i think we're all set to merge a change reenabling new account creation | 21:26 |
| *** kzaitsev_mb has quit IRC | 21:26 | |
| mordred | \o/ | 21:29 |
| *** e0ne has quit IRC | 21:30 | |
| *** zeih has joined #openstack-infra | 21:30 | |
| *** ericksonsantos has quit IRC | 21:31 | |
| *** cgalan has joined #openstack-infra | 21:32 | |
| *** isq has quit IRC | 21:32 | |
| *** thiagop has quit IRC | 21:33 | |
| *** clenimar has quit IRC | 21:33 | |
| *** thiagop has joined #openstack-infra | 21:34 | |
| *** osnexus has left #openstack-infra | 21:35 | |
| *** clenimar has joined #openstack-infra | 21:35 | |
| *** ericksonsantos has joined #openstack-infra | 21:36 | |
| *** isq has joined #openstack-infra | 21:36 | |
| *** timl0101 has quit IRC | 21:36 | |
| EmilienM | ianw: well it now fails to validate zuul layout | 21:38 |
| *** mmandel has joined #openstack-infra | 21:38 | |
| EmilienM | ianw: http://logs.openstack.org/32/344432/3/check/gate-project-config-layout/bf8f413/console.html#_2016-07-19_21_18_33_558253 | 21:38 |
| EmilienM | ianw: I think I know why | 21:40 |
| *** karthik__ has quit IRC | 21:40 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: unify testing for libraries https://review.openstack.org/344432 | 21:40 |
| *** claudiub has joined #openstack-infra | 21:41 | |
| *** karthikp_ has joined #openstack-infra | 21:41 | |
| clarkb | ok manually installing gear and nodepool tip of masters now then will restart nodepool | 21:41 |
| *** jrist has joined #openstack-infra | 21:43 | |
| jrist | hola, can we get some eyes on https://review.openstack.org/#/c/343834/ ? | 21:43 |
| clarkb | everyone ready for nodepool to be restarted? | 21:46 |
| fungi | looks like zuul has finally caught up enough to start burning down the post pipeline | 21:46 |
| fungi | sure | 21:46 |
| *** weshay has quit IRC | 21:47 | |
| clarkb | restarted | 21:47 |
| openstackgerrit | Merged openstack/diskimage-builder: Remove the escape in the centos7 README file https://review.openstack.org/343997 | 21:47 |
| *** Teresita-Warrior has quit IRC | 21:48 | |
| *** itisha has quit IRC | 21:50 | |
| clarkb | I haven't seen it timeout on the gearman request so thats good but also haven't seen it report allocations yet | 21:50 |
| clarkb | which may mean seeding the initial list is going to be slow | 21:50 |
| *** karthikp_ has quit IRC | 21:51 | |
| *** shashank_hegde has quit IRC | 21:51 | |
| *** karthikp_ has joined #openstack-infra | 21:51 | |
| *** david-lyle has joined #openstack-infra | 21:51 | |
| mtreinish | clarkb, fungi: do we have any python daemons running on xenial yet? I'm looking at the germqtt puppet stuff and it'll be on xenial and that moved to systemd right? | 21:51 |
| clarkb | mtreinish: no xenial for services yet. we are trying to get off of precise first so we don't have to support 3 releases at once | 21:52 |
| *** timl0101 has joined #openstack-infra | 21:52 | |
| clarkb | mtreinish: we are almost off of precise too | 21:52 |
| *** ayoung has joined #openstack-infra | 21:52 | |
| mtreinish | ah, ok | 21:52 |
| mtreinish | thanks | 21:53 |
| mtreinish | I forget things were still running on precise | 21:53 |
| * fungi is hacking on that now | 21:54 | |
| *** esikachev has joined #openstack-infra | 21:55 | |
| pabelanger | I've been meaning to look and see what is still left to migrate from precise still | 21:55 |
| fungi | we're just down to the wiki, right? | 21:55 |
| clarkb | fungi: I think so | 21:55 |
| clarkb | I would say check puppetboard but I dunno that we update it reliably | 21:55 |
| *** EricGonczer_ has quit IRC | 21:56 | |
| pabelanger | Also, aside from ubuntu-xenial workers, we do have wheel-mirror-ubuntu-xenial-amd64.slave.openstack.org which is running some systemd stuff under puppet | 21:56 |
| *** pt_15 has quit IRC | 21:56 | |
| pabelanger | I think lists.o.o too? | 21:56 |
| fungi | clarkb: hah, "check puppetboard" was a good suggestion | 21:56 |
| fungi | Welcome to Ubuntu 12.04.5 LTS (GNU/Linux 3.2.0-97-generic x86_64) | 21:56 |
| clarkb | pabelanger: ya but no services | 21:56 |
| fungi | we haven't upgraded the puppetdb server where puppetboard runs (yet) | 21:57 |
| clarkb | jeblair: how long do you think I should give this? 10 minutes? | 21:57 |
| clarkb | (we are at 10 minutes now) | 21:57 |
| * pabelanger nods | 21:58 | |
| *** Teresita-Warrior has joined #openstack-infra | 21:58 | |
| fungi | clarkb: yeah, now i'm finding myself wishing i'd asked you to hold off until 344469 merged. it's been waiting 15 minutes in the gate pipeline for ubuntu-precise and centos-7 nodes | 21:59 |
| fungi | none available yet | 21:59 |
| clarkb | fungi: ya we aren't building anything but min ready right now | 21:59 |
| fungi | which, for those two labels, is teensy | 21:59 |
| *** esikachev has quit IRC | 21:59 | |
| *** esikachev has joined #openstack-infra | 22:00 | |
| fungi | i may just go ahead and put wiki.o.o back in the emergency disable file for now so i don't have to keep watching its config and readding quotes | 22:00 |
| clarkb | fungi: I can also put the revert for nodepool back | 22:01 |
| jeblair | clarkb: i'm missing something | 22:01 |
| jeblair | clarkb: what's wrong? | 22:01 |
| clarkb | jeblair: no allocations | 22:01 |
| clarkb | jeblair: so nodepool is running fine but I haven't seen any allocations happen | 22:01 |
| clarkb | this is with cached results and tip of gear master | 22:02 |
| clarkb | it may be taking all this time in the loop that populates the function worker map | 22:02 |
| clarkb | I could probably make that run faster by reducing some of the db lookups | 22:02 |
| jeblair | why are there unknown hosts in the tripleo test cloud rh2 account? | 22:03 |
| *** matt-borland has quit IRC | 22:03 | |
| clarkb | jeblair: because I think tripleo is using our tenant/project/user for things too | 22:03 |
| jeblair | who's our contact there? that needs to stop | 22:03 |
| clarkb | pabelanger: ^ you seem to know who to talk to over there | 22:04 |
| jeblair | give me a minute while i remove 24,195 instances of that from the debug log so i can try to read it | 22:05 |
| fungi | i thought it was that some of their supporting framework for the job nodes is in the same tenant as the nodes | 22:05 |
| pabelanger | clarkb: derekh or dprince I would say | 22:05 |
| *** esikachev has quit IRC | 22:06 | |
| fungi | but regardless, yes that should get fixed | 22:06 |
| *** shashank_hegde has joined #openstack-infra | 22:06 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: unify testing for libraries https://review.openstack.org/344432 | 22:08 |
| jeblair | So the restart was at 21:46:56 | 22:09 |
| clarkb | yes | 22:10 |
| *** esberglu has quit IRC | 22:10 | |
| *** asettle has joined #openstack-infra | 22:10 | |
| jeblair | clarkb: tcpdump makes it look like the workers command is still transmitting | 22:11 |
| clarkb | huh shouldn't it have timed out by now? | 22:12 |
| clarkb | the lack of a timeout is why I thought that maybe it had finished that portion of it | 22:12 |
| clarkb | (I should've thought to check tcpdump) | 22:12 |
| clarkb | I also made sure I installed gear after nodepool so that the nodepool install wouldn't revert the gear install and checked pbr freeze for both before restarting | 22:13 |
| *** poll01721 has quit IRC | 22:14 | |
| jeblair | clarkb: it may not be the first listing | 22:14 |
| jeblair | clarkb: i found an instance of the word 'workers' in the stream, so it may be looping | 22:15 |
| *** sdague has quit IRC | 22:15 | |
| jeblair | clarkb: and i see a second | 22:15 |
| *** zeih has quit IRC | 22:16 | |
| *** asettle has quit IRC | 22:16 | |
| *** pradk has quit IRC | 22:16 | |
| clarkb | hrm that would imply its not finding the things it expects in the map (which should be covered by our tests) | 22:16 |
| *** mdrabe has quit IRC | 22:16 | |
| *** dizquierdo has joined #openstack-infra | 22:17 | |
| *** dizquierdo has quit IRC | 22:17 | |
| *** jaypipes has quit IRC | 22:17 | |
| * clarkb is double checking logic in that loop | 22:17 | |
| jeblair | clarkb: yeah, the lookup/issue-workers-on-fail bit is inside of a loop that iterates over the results of status, so we may be doing a 'workers' call for each status line response | 22:18 |
| clarkb | ya | 22:18 |
| jeblair | clarkb: ah, yep -- if we fail to satisfy that line, we continue | 22:19 |
| jeblair | 2016-07-19 22:03:12,155 DEBUG nodepool.GearmanClient: Function: gate-tempest-dsvm-neutron-full-liberty queued: 2 | 22:20 |
| jeblair | 2016-07-19 22:09:11,547 DEBUG nodepool.GearmanClient: Function: sahara-image-elements-branch-tarball queued: 1 | 22:20 |
| clarkb | ya so that implies we aren't populating the function worker map somehow | 22:20 |
| *** salv-orl_ has joined #openstack-infra | 22:21 | |
| jeblair | clarkb: that's a debug log line for each line in the status output with a positive queue value -- they are normally all together, but here we have them each several minutes apart, so i think that confirms the hypothesis | 22:21 |
| clarkb | ya | 22:21 |
| *** sdague has joined #openstack-infra | 22:21 | |
| *** mmandel has quit IRC | 22:22 | |
| *** jaypipes has joined #openstack-infra | 22:22 | |
| *** vhosakot has quit IRC | 22:23 | |
| *** salv-orlando has quit IRC | 22:23 | |
| mtreinish | clarkb, pabelanger: I'm not sure I got it quite right, but this is what I was starting with for the systemd service file: https://github.com/mtreinish/puppet-germqtt/blob/master/templates/germqtt.service.erb | 22:23 |
| clarkb | and those jobs aren't on the static instance (which might actually also make this slow) | 22:23 |
| *** Sukhdev has quit IRC | 22:23 | |
| mtreinish | but I know in the past I've always screwed them up for things on my local systems | 22:23 |
| *** sheeprine has quit IRC | 22:24 | |
| *** Sukhdev has joined #openstack-infra | 22:24 | |
| *** shashank_hegde has quit IRC | 22:24 | |
| clarkb | and we ignore nodes that don't apepar in the db so we aren't throwing an exception on those I don't think | 22:26 |
| *** gordc has quit IRC | 22:26 | |
| *** sheeprine has joined #openstack-infra | 22:27 | |
| jhesketh | Morning | 22:27 |
| clarkb | jeblair: anything else you want to see from it while its running? if not I can go ahead and reinstall what was running previously | 22:28 |
| clarkb | I think this is probably enough info to try and work on a reproduction case (though our existing tests work which seems like they should suffer this too) | 22:28 |
| clarkb | (the looping that is) | 22:28 |
| jeblair | clarkb: nope, all clear | 22:29 |
| clarkb | ok will have it restarted in a minute | 22:29 |
| clarkb | done | 22:30 |
| *** smcginnis_ has quit IRC | 22:32 | |
| *** jcoufal has joined #openstack-infra | 22:32 | |
| *** david-lyle has quit IRC | 22:32 | |
| *** gouthamr has quit IRC | 22:32 | |
| *** eharney has quit IRC | 22:32 | |
| clarkb | jeblair: before I dig too far into the code, any thoughts on how we would handle the case of static worker? | 22:33 |
| craige | o/ | 22:37 |
| *** poll0172 has joined #openstack-infra | 22:37 | |
| clarkb | jeblair: the only thing I can figure is to make the caching purely time based and ignore demand for anything we don't know about which seems subpar | 22:37 |
| *** mtanino has quit IRC | 22:38 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add puppet-germqtt project https://review.openstack.org/344493 | 22:38 |
| *** karthikp_ has quit IRC | 22:38 | |
| *** cmspence has joined #openstack-infra | 22:40 | |
| openstackgerrit | Merged openstack-infra/puppet-mediawiki: Quote strings in Settings.php https://review.openstack.org/344469 | 22:40 |
| clarkb | I am going to work on a local test that uses a current dump of status and workers from the zuul geard in order to reproduce | 22:40 |
| *** rossella_s has quit IRC | 22:40 | |
| jeblair | clarkb: yeah, i'm running nodepool locally and seeing that functions from static workers are triggering a lookup for each | 22:40 |
| *** rossella_s has joined #openstack-infra | 22:41 | |
| jeblair | clarkb: we could have it remember the static workers too | 22:42 |
| openstackgerrit | Merged openstack-infra/puppet-user: Allow to specify different key types https://review.openstack.org/341897 | 22:42 |
| *** cardeois_ has quit IRC | 22:43 | |
| jeblair | clarkb: as in -- record the fact that it has seen a function map to an unknown worker | 22:43 |
| *** cmspence has quit IRC | 22:44 | |
| openstackgerrit | Merged openstack-infra/system-config: Add ianw key and to infra-root https://review.openstack.org/341888 | 22:45 |
| clarkb | ya we could do that. Then we would know not to retry and simply just not calculate demand for that | 22:45 |
| clarkb | jeblair: I am collecting status and workers output now in order to do easier testing of these two functiosn | 22:45 |
| jeblair | clarkb: yeah, only downside i see is what if geard reports an old worker that nodepool has already deleted -- would nodepool erroneously conclude that was a static node and negatively cache it for a while | 22:47 |
| *** hashar has quit IRC | 22:47 | |
| *** Teresita-Warrior has quit IRC | 22:48 | |
| clarkb | hrm | 22:49 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add germqtt project https://review.openstack.org/344495 | 22:49 |
| *** cgalan has quit IRC | 22:50 | |
| mtreinish | fungi: ^^^ that should complete the set of new repos (now with proper topics set) | 22:50 |
| mtreinish | well, unless I forgot something | 22:51 |
| *** Teresita-Warrior has joined #openstack-infra | 22:52 | |
| *** maishsk has quit IRC | 22:54 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: nodejs-install macro can install different versions of node https://review.openstack.org/337481 | 22:55 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Always install nodejs from nodesource https://review.openstack.org/338508 | 22:55 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Renamed javascript-jobs to node4-jobs https://review.openstack.org/344497 | 22:55 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Renamed *-npm-* jobs to *-node4-npm-* jobs https://review.openstack.org/344498 | 22:55 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Renamed npm-install macro to nodejs-install https://review.openstack.org/344499 | 22:55 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Reorganized javascript.yaml https://review.openstack.org/344500 | 22:55 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Created jobs for nodejs version 6 https://review.openstack.org/344501 | 22:55 |
| * krotscheck apologizes for the patch bomb. | 22:56 | |
| *** baoli has joined #openstack-infra | 22:57 | |
| *** Teresita-Warrior has quit IRC | 22:58 | |
| *** hamzy has quit IRC | 22:58 | |
| *** hamzy has joined #openstack-infra | 22:58 | |
| *** poll0172 has quit IRC | 23:00 | |
| *** tkelsey has joined #openstack-infra | 23:01 | |
| fungi | okay, taking wiki.o.o out of the emergency file now that the fix merged | 23:01 |
| *** cbader has quit IRC | 23:02 | |
| *** rbrndt__ has quit IRC | 23:02 | |
| *** dimtruck is now known as zz_dimtruck | 23:02 | |
| *** esikachev has joined #openstack-infra | 23:02 | |
| *** ams__ has quit IRC | 23:04 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-mediawiki: Revert "Prevent new user registrations except by sysops" https://review.openstack.org/344502 | 23:04 |
| fungi | jpmaxman: ^ | 23:04 |
| *** claudiub has quit IRC | 23:05 | |
| fungi | i've tested and everything seems to be happy at this point | 23:05 |
| *** karthikp_ has joined #openstack-infra | 23:05 | |
| *** tkelsey has quit IRC | 23:05 | |
| *** esikachev has quit IRC | 23:07 | |
| *** tpsilva has quit IRC | 23:08 | |
| *** hongbin has quit IRC | 23:08 | |
| *** rlandy has quit IRC | 23:08 | |
| *** claudiub has joined #openstack-infra | 23:09 | |
| jpmaxman | Oh cool | 23:11 |
| *** ayoung has quit IRC | 23:11 | |
| jpmaxman | Thanks for doing that :) | 23:11 |
| fungi | thank _you_ for working out the recaptcha bits and testing | 23:12 |
| fungi | only hit one snag around missing quoting in the puppeted template, but i patched that a little while ago and everything worked great | 23:13 |
| *** yamahata has quit IRC | 23:14 | |
| sdague | hmmm... anyone seen this before - http://logs.openstack.org/79/344479/1/check/gate-grenade-dsvm-neutron/91b2b9d/logs/grenade.sh.txt.gz#_2016-07-19_23_02_11_937 | 23:16 |
| clarkb | jeblair: ok I think I figured out part of the issue, we are looking up jobs with 0 workers | 23:16 |
| *** xarses has quit IRC | 23:16 | |
| sdague | "THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them." | 23:16 |
| mtreinish | clarkb, fungi: it looks like health.o.o has gotten stuck again... :( | 23:17 |
| mtreinish | nibalizer: ^^^ | 23:17 |
| clarkb | sdague: I awnt to say that happened a long time ago when we were getting partial downloads which resulted in different md5sums | 23:17 |
| clarkb | jeblair: I can address that pretty easily I think. Addressing the race you pointed out will be harder | 23:18 |
| mtreinish | clarkb, fungi, nibalizer: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2860&rra_id=all is kinda suspect | 23:18 |
| jeblair | clarkb: yes, that too. but we're going to get demand for static workers quite often | 23:18 |
| clarkb | jeblair: right I don't know how to handle the static workers yet | 23:19 |
| *** salv-orl_ has quit IRC | 23:19 | |
| mtreinish | hmm, looks like some stuff is responding now, albeit very slowly | 23:20 |
| clarkb | jeblair: but it does find demand in my naive test setup {'fedora-23': 2, 'ubuntu-precise': 2, 'ubuntu-xenial': 54, 'centos-7': 26, 'ubuntu-trusty': 537, 'tripleo-centos': 16} | 23:20 |
| *** shashank_hegde has joined #openstack-infra | 23:23 | |
| *** asettle has joined #openstack-infra | 23:24 | |
| *** yamahata has joined #openstack-infra | 23:24 | |
| *** xarses has joined #openstack-infra | 23:24 | |
| fungi | sdague: i've seen that before. it's generally a download issue i think. when i wget that url the resulting file has the expected md5sum | 23:25 |
| *** ramishra has quit IRC | 23:26 | |
| *** edmondsw has quit IRC | 23:26 | |
| fungi | so probably indicates a network issue for that worker | 23:26 |
| fungi | or provider | 23:26 |
| fungi | or mirror | 23:26 |
| *** thiagop has quit IRC | 23:27 | |
| *** ramishra has joined #openstack-infra | 23:27 | |
| *** asettle has quit IRC | 23:28 | |
| *** esikachev has joined #openstack-infra | 23:31 | |
| *** asselin_ has quit IRC | 23:32 | |
| *** karthikp_ has quit IRC | 23:32 | |
| *** gouthamr has joined #openstack-infra | 23:33 | |
| *** dingyichen has joined #openstack-infra | 23:34 | |
| tonyb | clarkb: Do you have a moment to talk about cross project testing in the requirements repo? ( https://review.openstack.org/#/c/308739/1 ) | 23:35 |
| *** esikachev has quit IRC | 23:36 | |
| *** claudiub has quit IRC | 23:36 | |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: WIP: test rootwrap https://review.openstack.org/344506 | 23:37 |
| *** mtanino has joined #openstack-infra | 23:39 | |
| *** zhurong has joined #openstack-infra | 23:39 | |
| *** xarses has quit IRC | 23:40 | |
| *** rbuzatu has quit IRC | 23:41 | |
| clarkb | tonyb: sure | 23:41 |
| clarkb | I need a break from nodepool things anyways | 23:41 |
| tonyb | clarkb: Looking at that review I *think* it needs a pre-cursor patch to add either a namespace or repo_name attribute to jenkins/jobs/projects.yaml | 23:43 |
| tonyb | and then use that attribute rather than hard coding "openstack/{name}" in your patch | 23:43 |
| *** rhallisey has quit IRC | 23:43 | |
| tonyb | clarkb: is that basically correct? | 23:43 |
| EmilienM | I would need some help on https://review.openstack.org/#/c/344432/ - not sure what I'm doing wrong | 23:43 |
| clarkb | tonyb: yes, the raeson we haven't made much progress on this was a couple years back we finally managed to remove that attribute from all our job config | 23:44 |
| clarkb | tonyb: but its possible this is a good reason to add it back in | 23:44 |
| tonyb | clarkb: I really don't like adding it back as it's duplicated and would make moving namespaces harder | 23:45 |
| tonyb | clarkb: would adding it back need an infra-spec? | 23:46 |
| *** claudiub has joined #openstack-infra | 23:47 | |
| *** gyee has quit IRC | 23:47 | |
| tonyb | clarkb: in case it wasn't clear I'm "mad keen" on getting the end result of cross project testing of requirements working (perhaps that just "mad") just looking for a little direction | 23:48 |
| jeblair | i'm willing to pitch in on moving things from openstack-dev/ to openstack/ | 23:48 |
| tonyb | jeblair: would that be a reasonable solution to the objections to clarkb's review? | 23:49 |
| clarkb | ya unifying the namespace would be one way of doing it | 23:49 |
| tonyb | the down side of that is that I can't run with it and y'all are already busy | 23:50 |
| *** jcoufal has quit IRC | 23:51 | |
| fungi | we _can_ guarantee projects are unique across namespaces. parhaps parsing a projects.yaml or similar file stashed on the images would be a sufficient compromise? | 23:51 |
| *** akshai has joined #openstack-infra | 23:51 | |
| jeblair | tonyb: actually, you can do 95% of the work | 23:52 |
| *** dchen has joined #openstack-infra | 23:52 | |
| jeblair | tonyb: it's mostly working with the projects in openstack-dev to coordinate the change, proposing system-config patches, making announcements, etc. | 23:52 |
| jeblair | tonyb: the actual gerrit downtime to execute the move is the only thing we need root admins for, and you have at least one volunteering for that when it's time :) | 23:53 |
| *** dchen has quit IRC | 23:54 | |
| *** dingyichen has quit IRC | 23:54 | |
| *** dingyichen has joined #openstack-infra | 23:54 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Better handling of gearman status and workers https://review.openstack.org/344510 | 23:55 |
| clarkb | jeblair: ^ is what I have so far | 23:55 |
| tonyb | jeblair: okay. If that's the better route then I'll step up to do that. (the coordination stuff) | 23:55 |
| jeblair | tonyb: i'm reading AJaeger's note and while he cited 'hacking' as a potential conflict, he's talking about 'python-jobs', which i think infra projects also use | 23:56 |
| *** pahuang has quit IRC | 23:56 | |
| *** akshai has quit IRC | 23:56 | |
| jeblair | if that's the case, and moving openstack-infra would be necessary to overcome the objection as well, that's a much bigger job (though not necessarily one i'm opposed to either) | 23:57 |
| clarkb | tonyb: another option is to have a job template just for those that are cross tested with reqs | 23:57 |
| tonyb | jeblair: Ahh :( | 23:57 |
| clarkb | I was trying to overload and reuse existing stuff but we could do this with a bit more typing that relies on testing just nova cinder neutron and friends | 23:57 |
| jeblair | that may be a faster approach to reach the actual goal | 23:58 |
| *** mriedem has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!