| *** goern has quit IRC | 02:11 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add Fedora 29 testing https://review.openstack.org/618671 | 02:49 |
|---|---|---|
| *** j^2 has joined #zuul | 03:35 | |
| *** bhavikdbavishi has joined #zuul | 03:58 | |
| *** bhavikdbavishi1 has joined #zuul | 04:01 | |
| *** bhavikdbavishi has quit IRC | 04:03 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 04:03 | |
| *** j^2 has quit IRC | 04:03 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add Fedora 29 testing https://review.openstack.org/618671 | 04:11 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add Fedora 29 testing https://review.openstack.org/618671 | 04:12 |
| *** rlandy has quit IRC | 04:31 | |
| *** bjackman has joined #zuul | 05:11 | |
| *** caphrim007_ has joined #zuul | 05:21 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add Fedora 29 testing https://review.openstack.org/618671 | 05:23 |
| *** chandankumar has joined #zuul | 05:36 | |
| *** chandankumar is now known as chkumar|ruck | 05:37 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: Test zuul gear keepalive https://review.openstack.org/619150 | 06:22 |
| *** threestrands has joined #zuul | 06:58 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: add support for generic build resource https://review.openstack.org/570668 | 07:05 |
| *** rfolco has quit IRC | 07:06 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement zookeeper-auth https://review.openstack.org/619155 | 07:13 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Implement zookeeper-auth https://review.openstack.org/619156 | 07:13 |
| *** quiquell|off is now known as quiquell | 07:28 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Remove nodepool-k8s-functional and install-nodepool roles https://review.openstack.org/616409 | 07:43 |
| *** quiquell is now known as quiquell|brb | 07:53 | |
| *** bhavikdbavishi has quit IRC | 07:53 | |
| *** goern has joined #zuul | 08:01 | |
| *** quiquell|brb is now known as quiquell | 08:15 | |
| *** themroc has joined #zuul | 08:19 | |
| *** gtema has joined #zuul | 08:20 | |
| quiquell | pabelanger: Good morning are you there ? | 08:29 |
| *** bhavikdbavishi has joined #zuul | 08:32 | |
| *** eumel8 has joined #zuul | 08:45 | |
| *** jpena|off is now known as jpena | 08:52 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: DNM: Test zuul gear keepalive https://review.openstack.org/619150 | 09:02 |
| *** rfolco has joined #zuul | 09:09 | |
| tobiash | quiquell: pabelanger is in a us timezone and probably online in a few hours | 09:11 |
| quiquell | tobiash: Ahh ok sorry thanks anyways, I think I found the issue | 09:13 |
| *** chkumar|ruck has quit IRC | 09:18 | |
| *** chkumar|ruck has joined #zuul | 09:18 | |
| *** bhavikdbavishi has quit IRC | 09:22 | |
| *** bhavikdbavishi1 has joined #zuul | 09:22 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 09:24 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Implement zookeeper-auth https://review.openstack.org/619156 | 09:25 |
| *** pcaruana has joined #zuul | 09:48 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:02 | |
| quiquell | tobiash: Has a question with /var/lib/zuul/executor-git/ repos | 10:37 |
| quiquell | tobiash: do they get updated everytime a gerrit change is received ? | 10:37 |
| *** threestrands has quit IRC | 10:43 | |
| tobiash | quiquell: basically yes | 10:53 |
| tobiash | quiquell: they get updated just before executing the job | 10:54 |
| *** gtema has quit IRC | 11:00 | |
| *** dkehn has quit IRC | 11:21 | |
| *** themroc has quit IRC | 11:48 | |
| *** mugsie has joined #zuul | 11:51 | |
| *** bhavikdbavishi1 has joined #zuul | 12:02 | |
| *** bhavikdbavishi has quit IRC | 12:03 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 12:03 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:15 | |
| *** gtema has joined #zuul | 12:18 | |
| *** bhavikdbavishi has quit IRC | 12:25 | |
| *** jpena is now known as jpena|lunch | 12:39 | |
| *** bjackman has quit IRC | 12:47 | |
| *** bjackman has joined #zuul | 12:56 | |
| *** bjackman has quit IRC | 13:09 | |
| *** evrardjp has joined #zuul | 13:15 | |
| pabelanger | morning | 13:29 |
| *** dkehn has joined #zuul | 13:37 | |
| *** rlandy has joined #zuul | 13:37 | |
| *** jpena|lunch is now known as jpena | 13:42 | |
| openstackgerrit | Markus Hosch proposed openstack-infra/zuul master: Add testcase to show inconsistency during merging https://review.openstack.org/619245 | 13:53 |
| *** quiquell is now known as quiquell|brb | 13:53 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Display ref instead of NA for time triggered items https://review.openstack.org/619252 | 14:03 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Add testcase to show inconsistency during merging https://review.openstack.org/619245 | 14:06 |
| *** chkumar|ruck has quit IRC | 14:12 | |
| *** quiquell|brb is now known as quiquell | 14:19 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/zuul master: Prevent exception at executor https://review.openstack.org/617984 | 14:24 |
| *** quiquell is now known as quiquell|brb | 14:32 | |
| *** quiquell|brb is now known as quiquell | 14:48 | |
| pabelanger | seems my fedora DIBs are broken today, because of deltarpm being used | 14:59 |
| pabelanger | trying to see what changed | 15:00 |
| *** bjackman has joined #zuul | 15:00 | |
| *** chandankumar has joined #zuul | 15:11 | |
| *** chandankumar has quit IRC | 15:22 | |
| *** chandankumar has joined #zuul | 15:24 | |
| *** bjackman has quit IRC | 15:31 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix manual dequeue of github items https://review.openstack.org/619272 | 15:34 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix manual dequeue of github items https://review.openstack.org/619272 | 15:35 |
| *** chandankumar has quit IRC | 15:39 | |
| *** quiquell is now known as quiquell|off | 15:39 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Display ref instead of NA for time triggered items https://review.openstack.org/619252 | 15:43 |
| clarkb | pabelanger: there have been changes to deprecate 27 and switch to 29 in places. Possibly related? | 16:14 |
| pabelanger | clarkb: not sure just yet, it seems to be a mismatch of rpm / drpm packages in our nodes. | 16:15 |
| pabelanger | for now, I've disabled deltarpms like openstack | 16:15 |
| pabelanger | but yah, we also need to update to fedora-29 too | 16:15 |
| gtema | this would be great, I have prepared change in devstack for f29 | 16:16 |
| clarkb | gtema: pabelanger its all in progress with ianw driving it. THe big hurdle now is getting the mirror going for it which there are changes for that needed review yesterday (they all have my +2) | 16:18 |
| clarkb | https://review.openstack.org/#/c/618504/ in particular | 16:18 |
| pabelanger | +3 | 16:19 |
| *** hashar has joined #zuul | 16:34 | |
| *** bhavikdbavishi has joined #zuul | 16:40 | |
| *** pcaruana has quit IRC | 16:50 | |
| *** hashar has quit IRC | 17:02 | |
| *** bhavikdbavishi has quit IRC | 17:16 | |
| *** bhavikdbavishi has joined #zuul | 17:19 | |
| *** bhavikdbavishi has quit IRC | 17:24 | |
| clarkb | pabelanger: the executor zone changes lgtm now thanks | 17:46 |
| pabelanger | yay, thanks for review | 17:49 |
| pabelanger | clarkb: ianw: was able to boot and use a fedora-29 DIB using latest version of diskimage-builder. only issue I had was network-scripts RPM is no longer installed by default, so quickly patched our ansible-network elements to make it work | 18:06 |
| clarkb | pabelanger: ya there are a bunch of changes up to use network manager too (because that is coming in rhel 8 I guess) | 18:06 |
| pabelanger | clarkb: Yah, I should be able to review those shortly, help move that along | 18:07 |
| *** jpena is now known as jpena|off | 18:13 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Display ref instead of NA for time triggered items https://review.openstack.org/619252 | 18:30 |
| pabelanger | Can somebody remind me, if a provider tries to launch a node, but the node hits quota exceeded error, do we keep retying (forever) to launch the node only on the provider? | 18:45 |
| clarkb | pabelanger: I think its still the default 3 retries then on to the next provider, but we wait until we delete a node before trying again | 18:47 |
| pabelanger | okay, I think I hit an edge case, I have a stuck job waiting on a provider that has no quota. But retries doesn't seem to get to 3 | 18:49 |
| pabelanger | http://paste.openstack.org/show/735914/ | 18:49 |
| pabelanger | and because, I've don't have any nodes online, nodepool cannot delete anything to start again | 18:49 |
| pabelanger | so it seems to just keep looping try launch a node in the provider with no quota | 18:49 |
| clarkb | pabelanger: why is there no quota if you have no instances there? | 18:50 |
| *** gtema has quit IRC | 18:50 | |
| clarkb | I think there is an assumption that there is quota to launch at least one node | 18:50 |
| pabelanger | clarkb: it is my fault, I manually booted an instance behind nodepool that takes up 8vcpu, and this provider only have 8vcpu quota | 18:50 |
| pabelanger | yah | 18:51 |
| pabelanger | I think that is what I am hitting | 18:51 |
| pabelanger | I actually have zero quota right now | 18:51 |
| pabelanger | I can fix it by deleting my node manually, but want to see if this is an actual bug or design | 18:51 |
| pabelanger | feels like a bug | 18:52 |
| clarkb | I mean there isn't much else for nodepool to do right? you've told it a max server value, but that number isn't valid. It tries anyway (because it was asked to) then it fails and will let the next provider handle it | 18:54 |
| clarkb | the only different behavior it could do is decline the request upfront I think | 18:54 |
| pabelanger | I think something is wrong on my quota info from the provider | 18:55 |
| pabelanger | because nodepool should ask if there is quota available, and it does | 18:55 |
| pabelanger | http://paste.openstack.org/show/735915/ | 18:56 |
| pabelanger | my remaining quota is 0 for cores | 18:56 |
| pabelanger | not sure why nodepool would try to launch a node | 18:56 |
| pabelanger | is 0 a non_negative? | 18:58 |
| pabelanger | eg: https://git.zuul-ci.org/cgit/nodepool/tree/nodepool/driver/utils.py#n159 | 18:59 |
| clarkb | pabelanger: ya that may be it | 19:00 |
| pabelanger | yah, I think https://git.zuul-ci.org/cgit/nodepool/tree/nodepool/driver/openstack/handler.py#n318 is the reason why it keeps trying | 19:01 |
| pabelanger | I have to head out for a checkup now, but will dive more into it when I return | 19:01 |
| openstackgerrit | Merged openstack-infra/nodepool master: move 01-nodepool-setup to a later phase https://review.openstack.org/610188 | 19:29 |
| *** hashar has joined #zuul | 19:42 | |
| *** hashar has quit IRC | 19:50 | |
| *** hashar has joined #zuul | 19:50 | |
| *** eumel8 has quit IRC | 21:59 | |
| *** hashar has quit IRC | 22:41 | |
| SpamapS | hm I guess if I push a commit into my config project but it doesn't have any post jobs zuul never reconfigures.. does that sound right? | 22:59 |
| clarkb | SpamapS: no, zuul doesn't rely on post jobs to reconfigure its internal config | 23:03 |
| clarkb | SpamapS: the onyl thing that needs external input is the tenant config | 23:03 |
| clarkb | is it possible the config is broken so not able to load? | 23:04 |
| SpamapS | quite | 23:05 |
| clarkb | SpamapS: if you are running the current status dashboard there is now an errors alarm bell in the top right | 23:07 |
| clarkb | it should show you any errors if they exist | 23:07 |
| clarkb | if not running an up to date dashboard you can probably get that info from the api somewhere | 23:07 |
| SpamapS | although it passed a noop check | 23:08 |
| SpamapS | so it at least parses | 23:09 |
| SpamapS | I need to rebase my local patches on something newer.. Zuul version: 3.2.1.dev38 5ec14aa8 | 23:09 |
| SpamapS | waaaaant the new thing | 23:10 |
| SpamapS | Oh actually no it's working | 23:11 |
| SpamapS | I didn't actually update my zuul-web to have the db config | 23:12 |
| SpamapS | shouldn't zuul-web be querying zuul-scheduler for builds via gearman though? | 23:12 |
| clarkb | SpamapS: the historical build info all comes out of the sql connection. The current in progress stuff happens as you describe iirc | 23:13 |
| SpamapS | ah | 23:15 |
| SpamapS | so zuul-web needs to talk to the DB | 23:15 |
| SpamapS | does it do some magic to find the connection to use? | 23:16 |
| clarkb | no I think it uses the first sql connection listed in the config | 23:16 |
| clarkb | iirc there are TODOs in the code to make it smarter about that | 23:16 |
| *** rlandy is now known as rlandy|bbl | 23:17 | |
| SpamapS | job = self.rpc.submitJob('zuul:tenant_sql_connection', | 23:17 |
| SpamapS | {'tenant': tenant}) | 23:17 |
| SpamapS | so something in the tenant | 23:18 |
| SpamapS | ahh, found the NOTE | 23:20 |
| SpamapS | and yeah, once I gave zuul-web the db conn it's working | 23:35 |
| clarkb | SpamapS: fwiw there is a lot of good stuff in 3.3.0 | 23:47 |
| clarkb | there was a big gap in time there, I'd recommend rebasing even though you got it working | 23:47 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!