*** wuchunyang has joined #zuul | 00:06 | |
*** wuchunyang has quit IRC | 00:10 | |
ianw | corvus: if you're around, i might need some help understanding testing https://github.com/pyca/cryptography/pull/5341 | 00:44 |
---|---|---|
ianw | zuul definitely saw it http://paste.openstack.org/show/796397/ | 00:45 |
ianw | just trying to figure out what happened next | 00:45 |
*** saneax has quit IRC | 00:46 | |
*** weshay|ruck has quit IRC | 00:53 | |
*** weshay_ has joined #zuul | 00:53 | |
ianw | ahhh ... pipeline configuration i think ... hrm | 00:53 |
*** ericsysmin has quit IRC | 00:57 | |
*** PrinzElvis has quit IRC | 00:57 | |
*** iamweswilson has quit IRC | 00:57 | |
*** samccann has quit IRC | 00:57 | |
*** gundalow has quit IRC | 00:57 | |
*** wuchunyang has joined #zuul | 01:00 | |
*** wuchunyang has quit IRC | 01:00 | |
*** wuchunyang has joined #zuul | 01:00 | |
*** ericsysmin has joined #zuul | 01:01 | |
*** PrinzElvis has joined #zuul | 01:01 | |
*** iamweswilson has joined #zuul | 01:01 | |
*** samccann has joined #zuul | 01:01 | |
*** gundalow has joined #zuul | 01:01 | |
*** mordred has quit IRC | 01:03 | |
*** wuchunyang has quit IRC | 01:06 | |
*** wuchunyang has joined #zuul | 01:06 | |
*** rfolco has quit IRC | 01:08 | |
*** mordred has joined #zuul | 01:09 | |
ianw | yep; it's merging it's own project-config now https://review.opendev.org/#/q/project:pyca/project-config | 01:12 |
*** rfolco has joined #zuul | 01:15 | |
*** rfolco has quit IRC | 01:19 | |
*** Goneri has quit IRC | 01:25 | |
*** vblando has quit IRC | 01:42 | |
ianw | ... github pull requests still not responding ... hrm | 02:06 |
ianw | <QueueItem 0x7f60df09a690 for <Change 0x7f60d5e59e10 pyca/cryptography 5341,1e17c33a404d1f67b74aa4dc031a8a73aff2fce1> in check> is a failing item because ['it has an invalid configuration'] | 02:07 |
ianw | it really does not help me figure out what is invalid | 02:07 |
*** rfolco has joined #zuul | 02:08 | |
clarkb | the web ui should say iirc the bell icon in the tenant status page | 02:27 |
*** rfolco has quit IRC | 02:28 | |
*** wuchunyang has quit IRC | 02:34 | |
*** saneax has joined #zuul | 02:43 | |
ianw | so i had .zuul.d/playbooks/... and zuul was seemingly descending into that | 02:58 |
ianw | i feel like that may be a bug, or at least something we don't want to do | 02:59 |
ianw | trying to read a playbook as a config file and then that gave me the weird config error | 02:59 |
ianw | ok, jobs are queued now! https://zuul.opendev.org/t/pyca/status | 03:01 |
*** bhavikdbavishi has joined #zuul | 03:09 | |
ianw | hrm, NODE_FAILURE ... but now this is more an #opendev problem | 03:11 |
*** wuchunyang has joined #zuul | 03:11 | |
*** bhavikdbavishi has quit IRC | 03:19 | |
*** bhavikdbavishi has joined #zuul | 03:36 | |
*** wuchunyang has quit IRC | 04:02 | |
*** wuchunyang has joined #zuul | 04:12 | |
*** wuchunyang has quit IRC | 04:17 | |
*** evrardjp has quit IRC | 04:33 | |
*** evrardjp has joined #zuul | 04:33 | |
*** wuchunyang has joined #zuul | 04:50 | |
*** marios has joined #zuul | 05:05 | |
*** wuchunyang has quit IRC | 05:36 | |
*** wuchunyang has joined #zuul | 05:36 | |
*** saneax has quit IRC | 05:51 | |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate your first patch" https://review.opendev.org/732067 | 06:08 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: tutorial: Add "Use zuul jobs" https://review.opendev.org/732068 | 06:08 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: tutorial: Add "gate pipeline" https://review.opendev.org/732069 | 06:08 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: tutorial: Add "job secrets" https://review.opendev.org/732070 | 06:08 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: tutorial: Add "job dependencies" https://review.opendev.org/732071 | 06:08 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Rename quick-start to zuul-tutorial-quick-start https://review.opendev.org/737656 | 06:08 |
*** bhavikdbavishi1 has joined #zuul | 06:27 | |
*** bhavikdbavishi has quit IRC | 06:28 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 06:28 | |
*** marios has quit IRC | 06:29 | |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: [DNM] TEST run zuul tutorials to test stream+callback (+ zuul-jobs change) https://review.opendev.org/735477 | 06:33 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: [DNM] Test: run multiple tutorials ('job dependencies' 2 times) https://review.opendev.org/741558 | 06:33 |
*** vishalmanchanda has joined #zuul | 06:40 | |
*** bhavikdbavishi has quit IRC | 06:53 | |
*** hashar has joined #zuul | 07:18 | |
*** jcapitao has joined #zuul | 07:19 | |
*** wuchunyang has quit IRC | 07:19 | |
*** bhagyashris is now known as bhagyashris|lunc | 07:22 | |
*** bhavikdbavishi has joined #zuul | 07:35 | |
*** sgw1 has quit IRC | 07:35 | |
*** tosky has joined #zuul | 07:39 | |
*** yolanda has quit IRC | 07:40 | |
*** nils has joined #zuul | 07:48 | |
*** wuchunyang has joined #zuul | 07:52 | |
*** jpena|off is now known as jpena | 07:55 | |
*** vblando has joined #zuul | 07:59 | |
*** wuchunyang has quit IRC | 08:06 | |
*** evrardjp has quit IRC | 08:06 | |
*** evrardjp has joined #zuul | 08:08 | |
*** yolanda has joined #zuul | 08:17 | |
*** bhagyashris|lunc is now known as bhagyashris | 08:40 | |
*** wuchunyang has joined #zuul | 08:47 | |
*** wuchunyang has quit IRC | 08:50 | |
*** wuchunyang has joined #zuul | 08:50 | |
*** wuchunyang has quit IRC | 09:14 | |
*** wuchunyang has joined #zuul | 09:14 | |
*** wuchunyang has quit IRC | 09:26 | |
*** bhavikdbavishi has quit IRC | 09:26 | |
*** hashar has quit IRC | 09:42 | |
*** hashar has joined #zuul | 10:06 | |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: implement the open pipeline requirement https://review.opendev.org/740707 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: implement the merged pipeline requirement https://review.opendev.org/740708 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: implement the approval reporter https://review.opendev.org/741438 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: update naming in reference pipeline https://review.opendev.org/741450 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: support the merge request approval event https://review.opendev.org/741483 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: support the approval requirement https://review.opendev.org/741637 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: support the labeled event https://review.opendev.org/741667 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: support the labels requirement https://review.opendev.org/741893 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: support the merge reporter https://review.opendev.org/741931 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: remove default mutables https://review.opendev.org/741938 | 10:06 |
openstackgerrit | Fabien Boucher proposed zuul/zuul master: gitlab: support the MR merged event https://review.opendev.org/742107 | 10:06 |
*** vblando has quit IRC | 10:08 | |
*** hashar has quit IRC | 10:35 | |
*** wuchunyang has joined #zuul | 10:42 | |
*** saneax has joined #zuul | 10:55 | |
*** hashar has joined #zuul | 11:14 | |
*** jcapitao is now known as jcapitao_lunch | 11:15 | |
*** bhavikdbavishi has joined #zuul | 11:27 | |
*** bhavikdbavishi1 has joined #zuul | 11:29 | |
*** bhavikdbavishi has quit IRC | 11:31 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 11:31 | |
*** hashar has quit IRC | 11:34 | |
*** hashar has joined #zuul | 11:34 | |
*** hashar has quit IRC | 11:42 | |
*** hashar has joined #zuul | 11:42 | |
*** hashar has quit IRC | 11:44 | |
*** hashar has joined #zuul | 11:45 | |
*** rfolco has joined #zuul | 11:51 | |
*** jpena is now known as jpena|lunch | 11:52 | |
*** hashar has quit IRC | 11:57 | |
*** rlandy has joined #zuul | 12:02 | |
*** hashar has joined #zuul | 12:05 | |
*** sanjayu_ has joined #zuul | 12:16 | |
*** saneax has quit IRC | 12:19 | |
*** hashar has quit IRC | 12:22 | |
*** jcapitao_lunch is now known as jcapitao | 12:25 | |
*** jpena|lunch is now known as jpena | 12:54 | |
*** weshay_ is now known as weshay|ruck | 12:54 | |
*** Goneri has joined #zuul | 13:01 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: ensure-pip: add instructions for RedHat system https://review.opendev.org/743750 | 13:03 |
*** sanjayu__ has joined #zuul | 13:06 | |
*** sanjayu_ has quit IRC | 13:09 | |
*** bhavikdbavishi has quit IRC | 13:20 | |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: scheduler: Fix event process abide hasUnparsedBranchCache argument https://review.opendev.org/739042 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Fix github branch protection while already unprotected https://review.opendev.org/740340 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Fix branch name and project name for ref-updated create/delete https://review.opendev.org/738320 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Update tests/base.py to use proper git data https://review.opendev.org/742746 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Add tests https://review.opendev.org/742747 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Reorg scheduler event process loop https://review.opendev.org/742748 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Scheduler ref-updated create/delete https://review.opendev.org/739198 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Allow ref-updated newrev+oldrev reconfiguration https://review.opendev.org/742749 | 13:23 |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Get ref-updated modified files https://review.opendev.org/739078 | 13:23 |
*** piotrowskim has joined #zuul | 13:46 | |
*** bhavikdbavishi has joined #zuul | 14:15 | |
*** sshnaidm is now known as sshnaidm|bbl | 14:17 | |
*** bhavikdbavishi has quit IRC | 14:40 | |
openstackgerrit | Tobias Henkel proposed zuul/nodepool master: Use orjson for json parsing https://review.opendev.org/743778 | 14:54 |
*** sgw1 has joined #zuul | 14:54 | |
*** fdegir5 has joined #zuul | 14:54 | |
*** fdegir has quit IRC | 14:58 | |
*** irclogbot_3 has quit IRC | 14:58 | |
*** irclogbot_3 has joined #zuul | 15:00 | |
tobiash | corvus: I just found out that our nodepool nodepool-builders are constantly using 100% cpu. Thread dumps suggest that this might be due to a suboptimal behavior of the upload workers. | 15:03 |
tobiash | we have 8 upload slots so each builder constantly iterates 8 times in parallel over all provider-images checking if it needs to upload stuff | 15:05 |
tobiash | this also hammers zk quite a lot I guess | 15:05 |
fungi | interesting, this is what the cpu utilizatiob looks like on one of opendev's builders: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=63828&rra_id=all | 15:07 |
tristanC | fungi: isn't nl1 a launcher host? | 15:08 |
tobiash | launchers have high cpu utilization as well, but due to other reasons | 15:09 |
fungi | yep, sorry i meant to link http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=68025&rra_id=all | 15:09 |
tobiash | yes, so a base cpu load as well (that load scales linearly with the upload workers and probably with the number of images) | 15:10 |
tobiash | ours top out at one cpu core | 15:10 |
*** wuchunyang has quit IRC | 15:10 | |
fungi | we have 8 cores but only use around half of one | 15:11 |
fungi | (per builder) | 15:11 |
tobiash | how many upload slots do you have? | 15:11 |
fungi | what's an upload slot? | 15:12 |
tobiash | https://zuul-ci.org/docs/nodepool/operation.html#daemon-usage | 15:12 |
tobiash | upload-workers I mean | 15:12 |
tobiash | default is 4 | 15:12 |
fungi | i don't see where we're setting it in nodepool.conf, so likely the default then | 15:13 |
tobiash | it's a cli arg | 15:13 |
fungi | /usr/bin/dumb-init -- nodepool-builder -f -c /etc/nodepool/nodepool.yaml -l /etc/nodepool/builder-logging.conf | 15:14 |
tobiash | ok, so default 4 | 15:14 |
fungi | not set on our command line either, so still likely the default yeah | 15:14 |
fungi | we have roughly a dozen images uploading to a dozen cloud regions, each image is around 10gb qcow2 (several times that raw but most regions use the qcow2) | 15:15 |
fungi | right now the load for that is split between two builders each with 8 vcpus and 8gb ram | 15:16 |
tobiash | I think that cpu base load doesn't come from the build or upload but from constantly checking if there is a new image there for upload | 15:17 |
tobiash | the algorithm is like loop over all providers and provider-images, get most recent image upload and if there is a newer local one do the upload. | 15:19 |
tobiash | one improvement could be to do this only once and only dispatch the uploads themselves to #workers | 15:23 |
tobiash | a second improvement would be to cache the images as well in a treecache like we already do with the nodes | 15:24 |
tobiash | I think both together should improve this and also reduce quite a lot of load on zk as well | 15:25 |
*** bhavikdbavishi has joined #zuul | 15:44 | |
felixedel | corvus: You might wan to have a look at the discussion in https://review.opendev.org/#/c/743239/1 regarding the "scroll fix" of the new Zuul UI. I've had a discussion with some Patternfly developers in their slack channel and it looks like we are on the right track with this although the solution looks a little hacky. It seems that the focus topic is very complex if you deal with something like a Drawer since different | 15:53 |
felixedel | users are expecting different things to happen. | 15:53 |
openstackgerrit | Tobias Henkel proposed zuul/nodepool master: Check for images to upload single threaded https://review.opendev.org/743790 | 15:54 |
corvus | felixedel: it seems weird that the drawer wraps the page; is there an alternative way to use it? | 15:55 |
corvus | felixedel: (it seems like it should just be a dropdown menu in the header or something) | 15:55 |
felixedel | I assume that's related to the animation and size of the drawer, since the element that is wrapped by the drawer defines where the drawer is shown. If I understood that correctly. E.g, in this example the Drawer only uses parts of the page https://www.patternfly.org/v4/documentation/react/demos/masterdetaildemo/master-detail-full-page (just click on any list item) | 15:58 |
felixedel | I assume that so far not many users are using the Drawer to wrap the whole page but so far there seems to be no other way to get something like the NotificationDrawer in PF3 | 15:59 |
felixedel | Also this is listed as "beta" component, so they might be improvements in the future. | 15:59 |
felixedel | Another way would be to use something completely different to show our config errors | 16:00 |
corvus | felixedel: yeah, though it really does look like notification drawer is the right widget for that :/ | 16:01 |
corvus | felixedel: thanks for digging into that, i'll take a detailed look in a little bit :) | 16:02 |
felixedel | I will tie everything together tomorrow and upate my change accordingly. Then everybody who is interested in this topic can have a look :D But from what I've seen on GitHub they are quire active in developing and improving the PF4 component, especially the "beta" ones. | 16:04 |
felixedel | *components | 16:04 |
*** jcapitao has quit IRC | 16:09 | |
*** bhavikdbavishi has quit IRC | 16:20 | |
*** bhavikdbavishi1 has joined #zuul | 16:20 | |
*** bhavikdbavishi1 is now known as bhavikdbavishi | 16:22 | |
*** sshnaidm|bbl is now known as sshnaidm | 16:28 | |
*** hashar has joined #zuul | 16:42 | |
*** fdegir5 is now known as fdegir | 16:57 | |
*** harrymichal has joined #zuul | 17:00 | |
*** harrymichal has quit IRC | 17:01 | |
*** rlandy is now known as rlandy|mtg | 17:02 | |
*** jpena is now known as jpena|off | 17:02 | |
*** wuchunyang has joined #zuul | 17:07 | |
*** nils has quit IRC | 17:12 | |
*** sugaar has quit IRC | 17:12 | |
*** sshnaidm is now known as sshnaidm|afk | 17:15 | |
openstackgerrit | Sorin Sbarnea (zbr) proposed zuul/zuul master: Use redux for handling autoReload preference https://review.opendev.org/743434 | 17:25 |
openstackgerrit | Sorin Sbarnea (zbr) proposed zuul/zuul master: Add user preferences dialog https://review.opendev.org/739482 | 17:30 |
*** bhavikdbavishi has quit IRC | 17:37 | |
*** rlandy|mtg is now known as rlandy | 17:43 | |
*** harrymichal has joined #zuul | 17:58 | |
*** armstrongs has joined #zuul | 18:01 | |
*** harrymichal has quit IRC | 18:22 | |
*** harrymichal has joined #zuul | 18:22 | |
*** vishalmanchanda has quit IRC | 18:29 | |
*** hashar has quit IRC | 18:39 | |
*** harrymichal has quit IRC | 18:41 | |
openstackgerrit | Andrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use (upload|promote)-docker-image roles in periodic jobs https://review.opendev.org/740560 | 18:49 |
openstackgerrit | Andrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use (upload|promote)-docker-image roles in periodic jobs https://review.opendev.org/740560 | 18:52 |
*** sanjayu__ has quit IRC | 18:53 | |
*** armstrongs has quit IRC | 20:23 | |
openstackgerrit | Guillaume Chauvel proposed zuul/zuul master: Tenant reconfiguration: Get ref-updated modified files https://review.opendev.org/739078 | 22:03 |
*** wuchunyang has quit IRC | 22:45 | |
*** piotrowskim has quit IRC | 23:12 | |
*** rlandy has quit IRC | 23:16 | |
*** tosky has quit IRC | 23:21 | |
*** y2kenny has joined #zuul | 23:32 | |
y2kenny | clarkb: I made a small comment on the max-servers patch. I am not 100% but I think zk.ABORTED is needed | 23:34 |
y2kenny | I ran into launch not completing without it when I was implementing the cobbler driver | 23:35 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!