Tuesday, 2024-07-02

@morucci:matrix.orgHi, I've notice that sometime our Zuul installation (version 10.0.0) are getting stuck because we are hitting Github quota issues. When it happens it is like the scheduler stop processing for all tenants. We ensure that all repositories get our GitHub app installed and this prevent this situation. But sometime a user set a Depends-On on a PR that target a project that don't have the app installed (usually by mistake ...) (also the targeted project cannot have the app installed because owned by another organization out of our control) and then Zuul attempt to query the github api without (I guess) an app's token then we hitting really fast the quota issue for that targeted project. So the question is: could it make sense to prevent Zuul to process a Depend-On that target a project not part of the Zuul tenant config ?08:22
@morucci:matrix.org * Hi, I've noticed that sometime our Zuul installation (version 10.0.0) are getting stuck because we are hitting Github quota issues. When it happens it is like the scheduler stop processing for all tenants. We ensure that all repositories get our GitHub app installed and this prevent this situation. But sometime a user set a Depends-On on a PR that target a project that don't have the app installed (usually by mistake ...) (also the targeted project cannot have the app installed because owned by another organization out of our control) and then Zuul attempts to query the github api without (I guess) an app's token then we are hitting really fast the quota issue for that targeted project. So the question is: could it make sense to prevent Zuul to process a Depend-On that target a project not part of the Zuul tenant config ?08:23
-@gerrit:opendev.org- Simon Westphahl proposed:10:25
- [zuul/zuul] 922802: wip: Add launcher client/server implementation https://review.opendev.org/c/zuul/zuul/+/922802
- [zuul/zuul] 923209: Create nodeset info in Nodepool API https://review.opendev.org/c/zuul/zuul/+/923209
-@gerrit:opendev.org- Benedikt Löffler proposed: [zuul/nodepool] 922403: Don't delete snapshot from import-snapshot tasks https://review.opendev.org/c/zuul/nodepool/+/92240310:52
-@gerrit:opendev.org- Benedikt Löffler proposed: [zuul/nodepool] 922403: Don't delete snapshot from import-snapshot tasks https://review.opendev.org/c/zuul/nodepool/+/92240311:06
-@gerrit:opendev.org- Benedikt Löffler proposed: [zuul/nodepool] 922403: Don't delete snapshot from import-snapshot tasks https://review.opendev.org/c/zuul/nodepool/+/92240311:58
-@gerrit:opendev.org- Simon Westphahl proposed:12:01
- [zuul/zuul] 923209: Create nodeset info in Nodepool API https://review.opendev.org/c/zuul/zuul/+/923209
- [zuul/zuul] 922802: wip: Add launcher client/server implementation https://review.opendev.org/c/zuul/zuul/+/922802
-@gerrit:opendev.org- Simon Westphahl proposed:13:28
- [zuul/zuul] 922802: Add launcher client/server implementation https://review.opendev.org/c/zuul/zuul/+/922802
- [zuul/zuul] 923239: wip: Implement nodeset request handling https://review.opendev.org/c/zuul/zuul/+/923239
-@gerrit:opendev.org- Tristan Cacqueray https://matrix.to/#/@tristanc_:matrix.org proposed: [zuul/nodepool] 922971: Ensure nodepool-builder works with an empty secure.conf https://review.opendev.org/c/zuul/nodepool/+/92297113:41
-@gerrit:opendev.org- Aurelio Jargas proposed: [zuul/zuul-jobs] 922286: Add ensure-poetry role https://review.opendev.org/c/zuul/zuul-jobs/+/92228613:54
@clarkb:matrix.org> <@morucci:matrix.org> Hi, I've noticed that sometime our Zuul installation (version 10.0.0) are getting stuck because we are hitting Github quota issues. When it happens it is like the scheduler stop processing for all tenants. We ensure that all repositories get our GitHub app installed and this prevent this situation. But sometime a user set a Depends-On on a PR that target a project that don't have the app installed (usually by mistake ...) (also the targeted project cannot have the app installed because owned by another organization out of our control) and then Zuul attempts to query the github api without (I guess) an app's token then we are hitting really fast the quota issue for that targeted project. So the question is: could it make sense to prevent Zuul to process a Depend-On that target a project not part of the Zuul tenant config ?14:51
We recently updated zuul (I can't remember if this was before or after 10.0.0) to use a regular user token for when the app isn't installed if you configure a regular token too. This gives you significantly higher quota than doing unauthenticated requests. I would check that a) 10.0.0 is new enough to include that improvement and that b) you configure a regular token too for this.
-@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [zuul/zuul-jobs] 923094: Hook poetry into ensure-python and build-python-release https://review.opendev.org/c/zuul/zuul-jobs/+/92309415:00
-@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed on behalf of Aurelio Jargas: [zuul/zuul-jobs] 922286: Add ensure-poetry role https://review.opendev.org/c/zuul/zuul-jobs/+/92228615:02
-@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [zuul/zuul-jobs] 923094: Hook poetry into ensure-python and build-python-release https://review.opendev.org/c/zuul/zuul-jobs/+/92309415:02
@harbott.osism.tech:regio.chatI'm using github token support in 9.x, so it certainly should be supported in 10.0.015:06
@morucci:matrix.org> <@clarkb:matrix.org> We recently updated zuul (I can't remember if this was before or after 10.0.0) to use a regular user token for when the app isn't installed if you configure a regular token too. This gives you significantly higher quota than doing unauthenticated requests. I would check that a) 10.0.0 is new enough to include that improvement and that b) you configure a regular token too for this.16:39
Thanks for the insight, I'll check that
-@gerrit:opendev.org- Zuul merged on behalf of Aurelio Jargas: [zuul/zuul-jobs] 922286: Add ensure-poetry role https://review.opendev.org/c/zuul/zuul-jobs/+/92228617:39
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:23:41
- [zuul/zuul] 923329: Minor improvements to pipeline manager https://review.opendev.org/c/zuul/zuul/+/923329
- [zuul/zuul] 923330: Add queue.max-changes https://review.opendev.org/c/zuul/zuul/+/923330
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 923331: Add pipeline.max-changes https://review.opendev.org/c/zuul/zuul/+/92333123:41

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!