| *** rfolco|ruck has quit IRC | 00:07 | |
| *** tosky has quit IRC | 00:17 | |
| *** armax has quit IRC | 00:17 | |
| *** armax has joined #openstack-infra | 00:22 | |
| *** armax has quit IRC | 00:28 | |
| *** armax has joined #openstack-infra | 00:32 | |
| *** Goneri has quit IRC | 00:37 | |
| *** ralonsoh has quit IRC | 00:46 | |
| *** ralonsoh has joined #openstack-infra | 00:46 | |
| *** dchen has joined #openstack-infra | 00:48 | |
| *** outbrito has joined #openstack-infra | 00:53 | |
| *** thiagop has quit IRC | 00:53 | |
| *** zzzeek has quit IRC | 01:26 | |
| *** zzzeek has joined #openstack-infra | 01:26 | |
| *** zzzeek has quit IRC | 01:31 | |
| *** zzzeek has joined #openstack-infra | 01:32 | |
| *** ociuhandu has joined #openstack-infra | 01:37 | |
| *** ociuhandu has quit IRC | 01:41 | |
| *** outbrito has quit IRC | 01:41 | |
| *** ysandeep|away is now known as ysandeep | 01:44 | |
| *** zzzeek has quit IRC | 01:50 | |
| *** zzzeek has joined #openstack-infra | 01:51 | |
| *** zzzeek has quit IRC | 02:07 | |
| *** zzzeek has joined #openstack-infra | 02:11 | |
| *** freerunner has quit IRC | 02:12 | |
| *** DinaBelova has quit IRC | 02:12 | |
| *** DinaBelova has joined #openstack-infra | 02:13 | |
| *** freerunner has joined #openstack-infra | 02:13 | |
| *** zzzeek has quit IRC | 02:16 | |
| *** zzzeek has joined #openstack-infra | 02:18 | |
| *** dayou has quit IRC | 02:20 | |
| *** dayou has joined #openstack-infra | 02:20 | |
| *** iurygregory has quit IRC | 02:25 | |
| *** ykarel has joined #openstack-infra | 02:26 | |
| *** zzzeek has quit IRC | 02:30 | |
| *** zzzeek has joined #openstack-infra | 02:31 | |
| *** rcernin has quit IRC | 02:33 | |
| *** rcernin has joined #openstack-infra | 03:03 | |
| *** rcernin has quit IRC | 03:11 | |
| *** rcernin has joined #openstack-infra | 03:11 | |
| *** ykarel has quit IRC | 03:19 | |
| *** ociuhandu has joined #openstack-infra | 03:25 | |
| *** ociuhandu has quit IRC | 03:29 | |
| *** psachin has joined #openstack-infra | 03:31 | |
| *** auristor has quit IRC | 03:49 | |
| *** auristor has joined #openstack-infra | 03:56 | |
| *** raukadah is now known as chandankumar | 04:09 | |
| *** zzzeek has quit IRC | 04:18 | |
| *** zzzeek has joined #openstack-infra | 04:19 | |
| *** zzzeek has quit IRC | 04:34 | |
| *** zzzeek has joined #openstack-infra | 04:35 | |
| *** ykarel has joined #openstack-infra | 04:48 | |
| *** ykarel_ has joined #openstack-infra | 04:53 | |
| *** ykarel has quit IRC | 04:53 | |
| *** ykarel_ is now known as ykarel | 04:54 | |
| *** zzzeek has quit IRC | 04:59 | |
| *** zzzeek has joined #openstack-infra | 05:00 | |
| *** zzzeek has quit IRC | 05:10 | |
| *** zzzeek has joined #openstack-infra | 05:11 | |
| *** ociuhandu has joined #openstack-infra | 05:13 | |
| *** ociuhandu has quit IRC | 05:21 | |
| *** ysandeep is now known as ysandeep|afk | 05:22 | |
| *** zxiiro has quit IRC | 05:27 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-infra | 05:33 | |
| *** ykarel has quit IRC | 05:55 | |
| *** ykarel has joined #openstack-infra | 06:08 | |
| *** openstackgerrit has joined #openstack-infra | 06:12 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/763930 | 06:12 |
|---|---|---|
| *** matt_kosut has joined #openstack-infra | 06:26 | |
| *** lmiccini has joined #openstack-infra | 06:39 | |
| *** ralonsoh has quit IRC | 06:46 | |
| *** zzzeek has quit IRC | 06:49 | |
| *** zzzeek has joined #openstack-infra | 06:49 | |
| *** ysandeep|afk is now known as ysandeep | 06:57 | |
| *** iurygregory has joined #openstack-infra | 07:02 | |
| *** ociuhandu has joined #openstack-infra | 07:15 | |
| *** ociuhandu has quit IRC | 07:19 | |
| *** ykarel_ has joined #openstack-infra | 07:22 | |
| *** ociuhandu has joined #openstack-infra | 07:24 | |
| *** ykarel has quit IRC | 07:25 | |
| *** ociuhandu has quit IRC | 07:29 | |
| *** dklyle has quit IRC | 07:39 | |
| *** rpittau|afk is now known as rpittau | 07:39 | |
| *** ociuhandu has joined #openstack-infra | 07:41 | |
| *** ykarel__ has joined #openstack-infra | 07:45 | |
| *** ykarel_ has quit IRC | 07:48 | |
| *** rcernin has quit IRC | 07:49 | |
| *** ociuhandu has quit IRC | 07:52 | |
| *** lpetrut has joined #openstack-infra | 07:53 | |
| *** rcernin has joined #openstack-infra | 07:57 | |
| *** sboyron__ has joined #openstack-infra | 07:58 | |
| *** eolivare has joined #openstack-infra | 08:02 | |
| *** slaweq has joined #openstack-infra | 08:02 | |
| *** ykarel__ is now known as ykarel | 08:05 | |
| *** ociuhandu has joined #openstack-infra | 08:06 | |
| *** dchen has quit IRC | 08:08 | |
| *** jcapitao has joined #openstack-infra | 08:09 | |
| *** sboyron__ is now known as sboyron | 08:12 | |
| *** jpena|off is now known as jpena | 08:12 | |
| *** ociuhandu has quit IRC | 08:13 | |
| *** rcernin has quit IRC | 08:15 | |
| *** ralonsoh has joined #openstack-infra | 08:15 | |
| *** ociuhandu has joined #openstack-infra | 08:22 | |
| *** ociuhandu has quit IRC | 08:22 | |
| *** xek_ has joined #openstack-infra | 08:30 | |
| *** reed has quit IRC | 08:31 | |
| *** andrewbonney has joined #openstack-infra | 08:42 | |
| *** ociuhandu has joined #openstack-infra | 08:43 | |
| *** mgoddard has joined #openstack-infra | 08:44 | |
| *** tosky has joined #openstack-infra | 08:48 | |
| *** zzzeek has quit IRC | 08:50 | |
| *** zzzeek has joined #openstack-infra | 08:54 | |
| *** dtantsur|afk is now known as dtantsur | 09:01 | |
| *** gfidente has joined #openstack-infra | 09:03 | |
| *** lucasagomes has joined #openstack-infra | 09:03 | |
| *** happyhemant has joined #openstack-infra | 09:05 | |
| *** zzzeek has quit IRC | 09:09 | |
| *** zzzeek has joined #openstack-infra | 09:09 | |
| *** derekh has joined #openstack-infra | 09:12 | |
| *** zzzeek has quit IRC | 09:18 | |
| *** ricolin has joined #openstack-infra | 09:19 | |
| *** zzzeek has joined #openstack-infra | 09:19 | |
| *** zzzeek has quit IRC | 09:26 | |
| *** zzzeek has joined #openstack-infra | 09:28 | |
| zbr | there is clearly a performance issue, in fact I suspect something like packages being lost of connections. | 09:29 |
| zbr | it randomly happens to get stuck with "Loading...", sometimes with >10s delays sometimes never getting a response back, and not related to searches, it happened with simple change loading. | 09:30 |
| *** ociuhandu has quit IRC | 09:32 | |
| *** iurygregory has quit IRC | 09:37 | |
| *** iurygregory has joined #openstack-infra | 09:43 | |
| *** ricolin has quit IRC | 09:44 | |
| *** ociuhandu has joined #openstack-infra | 09:51 | |
| *** piotrowskim has joined #openstack-infra | 09:54 | |
| ykarel | i noticed ^ when posting comments, or pushing abandon/restore etc | 09:58 |
| zbr | based only console log, it takes 10-30s to upload a new patchset. I do not see this as a big deal, but for UI is find it really annoying, anything over 2s is too-slow for my taste. | 10:00 |
| *** derekh has quit IRC | 10:01 | |
| *** derekh has joined #openstack-infra | 10:01 | |
| zbr | to be clear, I am happy with the upgrade, just reporting, so we identify issues before before they go worse. | 10:02 |
| *** ociuhandu has quit IRC | 10:02 | |
| *** zzzeek has quit IRC | 10:04 | |
| *** zzzeek has joined #openstack-infra | 10:06 | |
| *** mgoddard has quit IRC | 10:11 | |
| *** zzzeek has quit IRC | 10:21 | |
| *** zzzeek has joined #openstack-infra | 10:22 | |
| *** mgoddard has joined #openstack-infra | 10:24 | |
| *** zzzeek has quit IRC | 10:26 | |
| *** zzzeek has joined #openstack-infra | 10:28 | |
| *** ociuhandu has joined #openstack-infra | 10:32 | |
| *** mgoddard has quit IRC | 10:35 | |
| *** ociuhandu has quit IRC | 10:37 | |
| *** ociuhandu has joined #openstack-infra | 10:38 | |
| *** zzzeek has quit IRC | 10:47 | |
| *** ociuhandu has quit IRC | 10:47 | |
| *** zzzeek has joined #openstack-infra | 10:47 | |
| *** mgoddard has joined #openstack-infra | 10:49 | |
| *** ociuhandu has joined #openstack-infra | 10:53 | |
| *** ociuhandu has quit IRC | 10:53 | |
| *** ociuhandu has joined #openstack-infra | 11:10 | |
| *** ociuhandu has quit IRC | 11:10 | |
| *** ociuhandu has joined #openstack-infra | 11:10 | |
| *** ralonsoh has quit IRC | 11:20 | |
| *** ralonsoh has joined #openstack-infra | 11:23 | |
| *** zzzeek has quit IRC | 11:31 | |
| *** zzzeek has joined #openstack-infra | 11:32 | |
| *** ociuhandu has quit IRC | 11:34 | |
| *** ociuhandu has joined #openstack-infra | 11:35 | |
| *** ociuhandu has quit IRC | 11:41 | |
| *** ociuhandu has joined #openstack-infra | 11:41 | |
| *** ociuhandu has quit IRC | 11:44 | |
| *** ociuhandu has joined #openstack-infra | 11:45 | |
| *** ociuhandu has quit IRC | 11:55 | |
| *** ociuhandu has joined #openstack-infra | 11:58 | |
| *** ysandeep is now known as ysandeep|brb | 12:00 | |
| *** hashar has joined #openstack-infra | 12:00 | |
| *** ociuhandu has quit IRC | 12:04 | |
| *** eolivare_ has joined #openstack-infra | 12:09 | |
| *** rfolco|ruck has joined #openstack-infra | 12:11 | |
| *** outbrito has joined #openstack-infra | 12:11 | |
| *** eolivare has quit IRC | 12:12 | |
| *** jcapitao is now known as jcapitao_lunch | 12:12 | |
| *** ociuhandu has joined #openstack-infra | 12:15 | |
| *** ociuhandu has quit IRC | 12:20 | |
| *** dtantsur is now known as dtantsur|brb | 12:22 | |
| *** ykarel is now known as ykarel|away | 12:23 | |
| *** ysandeep|brb is now known as ysandeep | 12:25 | |
| *** slaweq has quit IRC | 12:29 | |
| *** slaweq has joined #openstack-infra | 12:31 | |
| *** eolivare_ has quit IRC | 12:32 | |
| *** admin0 has joined #openstack-infra | 12:34 | |
| *** jpena is now known as jpena|lunch | 12:34 | |
| *** rlandy has joined #openstack-infra | 12:41 | |
| *** ykarel|away has quit IRC | 12:44 | |
| *** ramishra has quit IRC | 12:49 | |
| *** eolivare_ has joined #openstack-infra | 12:50 | |
| *** ramishra has joined #openstack-infra | 12:56 | |
| *** artom has joined #openstack-infra | 13:03 | |
| openstackgerrit | wes hayutin proposed openstack/project-config master: add review-priority for tripleo-ci https://review.opendev.org/c/openstack/project-config/+/715069 | 13:08 |
| *** jcapitao_lunch is now known as jcapitao | 13:09 | |
| zbr | fungi: clarkb: can we please help us with ^ | 13:16 |
| *** rosmaita has joined #openstack-infra | 13:19 | |
| rosmaita | quick question when someone has a minute -- is there a repo for openstack-specs that controls spec publication the way https://opendev.org/openstack/openstack-manuals handles docs publication? | 13:21 |
| *** ociuhandu has joined #openstack-infra | 13:26 | |
| *** ociuhandu has quit IRC | 13:30 | |
| *** jpena|lunch is now known as jpena | 13:31 | |
| *** xek__ has joined #openstack-infra | 13:33 | |
| *** ociuhandu has joined #openstack-infra | 13:35 | |
| *** Goneri has joined #openstack-infra | 13:36 | |
| *** xek_ has quit IRC | 13:36 | |
| *** lpetrut has quit IRC | 13:36 | |
| *** lpetrut has joined #openstack-infra | 13:38 | |
| *** dave-mccowan has joined #openstack-infra | 13:39 | |
| *** dtantsur|brb is now known as dtantsur | 13:41 | |
| *** mgoddard has quit IRC | 13:46 | |
| *** mgoddard has joined #openstack-infra | 13:53 | |
| *** zxiiro has joined #openstack-infra | 13:54 | |
| *** dhill has quit IRC | 14:04 | |
| *** zzzeek has quit IRC | 14:07 | |
| *** zzzeek has joined #openstack-infra | 14:09 | |
| *** dhill has joined #openstack-infra | 14:12 | |
| fungi | zbr: are you asking me to fix the zuul -1 on 715069 or what? | 14:30 |
| zbr | fungi: obviously not, fixing it now. zuul replied after i posted the question. | 14:31 |
| fungi | rosmaita: openstack-manuals doesn't control docs publication, it has a static set of redirect urls and an index... is that what you're looking for wrt specs? | 14:31 |
| fungi | zbr: it was an honest question, i hadn't looked into the cause of the failure, still trying to catch up on scrollback in a few dozen channels and all the mailing list activity from before i woke up | 14:32 |
| zbr | fungi: btw, i really think that what project-config-gerrit does should have being included in linters. | 14:32 |
| fungi | zbr: it probably could be, i haven't thought about it really | 14:33 |
| zbr | too many checks hidden in various jobs, makes it harder to expect the user to "lint" before uploading. | 14:33 |
| zbr | i will fix it, no worry. | 14:33 |
| zbr | "tox -e gerrit" yet another example of using commands that are not portable... | 14:35 |
| *** gouthamr_ has quit IRC | 14:36 | |
| openstackgerrit | Sorin Sbârnea proposed openstack/project-config master: add review-priority for tripleo-ci https://review.opendev.org/c/openstack/project-config/+/715069 | 14:39 |
| *** zzzeek has quit IRC | 14:39 | |
| zbr | the extra verbosity when running git-review to push seems to be related to the fact that it takes far more time now, https://gist.github.com/ssbarnea/0a333d79834c45c0518d920fd65f07ec | 14:43 |
| zbr | any push takes 20-40s, git starts to display the progress after two seconds, if i read the docs correctly. | 14:44 |
| rosmaita | fungi: yes, i am still occasionally trying to figure out why redirects stopped working in the specs repos | 14:44 |
| *** zzzeek has joined #openstack-infra | 14:45 | |
| openstackgerrit | Thierry Carrez proposed openstack/project-config master: Add release jobs to oslo.metrics https://review.opendev.org/c/openstack/project-config/+/763986 | 14:53 |
| fungi | rosmaita: according to my notes, this is where i left off the last time i looked into the problem to which i think you're referring: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-04-14.log.html#t2020-04-14T18:09:58 | 15:13 |
| rosmaita | fungi: i forgot about that conversation, looks like the .htaccess permissions is not an issue | 15:16 |
| rosmaita | (i was thinking of the convo on the ML recently about docs.o.o) | 15:16 |
| *** ysandeep is now known as ysandeep|away | 15:17 | |
| fungi | rosmaita: as for why that broke, my first guess would be a behavior change of some sort in apache 2.4 | 15:22 |
| rosmaita | fungi: i bet you are correct | 15:23 |
| fungi | anyway, i have a feeling changing those redirects to be relative would work (we're doing it that way elsewhere) | 15:28 |
| fungi | i can even try hand editing them in afs briefly to see if that redirects browsers as intended | 15:28 |
| rosmaita | was just going to ask you how we could test this | 15:28 |
| rosmaita | yes, if you could put that on your to-do list, that would be great | 15:29 |
| fungi | i'll give it a shot in a moment | 15:32 |
| *** dklyle has joined #openstack-infra | 15:34 | |
| *** lpetrut has quit IRC | 15:35 | |
| clarkb | zbr: It would likely be far more constructive if we can get that feedback to #opendev and to be as specfiic as we can be. I wasn't even sure what you thought had performance issues when I was first catching up on scrollback | 15:46 |
| clarkb | I notice that load is high on the server currently. http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=26&rra_id=all | 15:48 |
| clarkb | zbr: ^ that is something anyone can check on | 15:48 |
| zbr | clarkb: i am totally confused about the multitude of channels we have, especially between opendev and openstack-infra ones. | 15:49 |
| clarkb | we try to be as transparent as possible and include others in the work because we're a small taem, and we can't be everywhere at once | 15:49 |
| zbr | i know :( | 15:49 |
| clarkb | zbr: #opendev is for the services that opendev runs. This includes gerrit and zuul and all that. #openstack-infra is for openstacks interfaces with opendev. Primary we see this being used for debugging openstack CI jobs and similar | 15:50 |
| clarkb | openstack-zuul-jobs? here. *.opendev.org? #opendev | 15:50 |
| clarkb | but showing up in either channel every day and saying "its bad" without further quantification is really draining | 15:51 |
| clarkb | particularly when we give you a vast number of tools to do a bit more digging yourself in order to help out | 15:51 |
| openstackgerrit | Sorin Sbârnea proposed openstack/project-config master: add review-priority for tripleo-ci https://review.opendev.org/c/openstack/project-config/+/715069 | 16:03 |
| *** hashar is now known as hasharAway | 16:11 | |
| fungi | rosmaita: confirmed, i edited the cinder specs .htaccess file manually to prepend /openstack/cinder-specs to all the paths and now it's redirecting correctly | 16:15 |
| rosmaita | fungi: ty! | 16:15 |
| *** psachin has quit IRC | 16:16 | |
| fungi | yw | 16:16 |
| fungi | if you make that edit then it should work. presumably the same will work for glance | 16:16 |
| rosmaita | ok, i'll put up a patch later to verify | 16:17 |
| *** lmiccini has quit IRC | 16:23 | |
| *** chandankumar is now known as raukadah | 16:32 | |
| fungi | awesome | 16:33 |
| -openstackstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted quickly to troubleshoot an SMTP queuing backlog, downtime should be less than 5 minutes | 16:42 | |
| *** hasharAway is now known as hashar | 16:46 | |
| *** timburke has quit IRC | 17:00 | |
| *** rpittau is now known as rpittau|afk | 17:01 | |
| *** jpena is now known as jpena|off | 17:02 | |
| *** dklyle has quit IRC | 17:05 | |
| *** david-lyle has joined #openstack-infra | 17:05 | |
| *** ociuhandu_ has joined #openstack-infra | 17:06 | |
| *** ociuhandu_ has quit IRC | 17:06 | |
| *** ociuhandu has quit IRC | 17:09 | |
| *** lucasagomes has quit IRC | 17:10 | |
| *** rlandy is now known as rlandy|biab | 17:11 | |
| *** ociuhandu has joined #openstack-infra | 17:41 | |
| *** jlvillal has quit IRC | 17:42 | |
| *** jlvillal has joined #openstack-infra | 17:43 | |
| *** happyhemant has quit IRC | 17:44 | |
| *** ociuhandu has quit IRC | 17:45 | |
| *** iurygregory has quit IRC | 17:59 | |
| *** dtantsur is now known as dtantsur|afk | 18:01 | |
| *** derekh has quit IRC | 18:01 | |
| *** mgoddard has quit IRC | 18:07 | |
| *** gfidente is now known as gfidente|afk | 18:17 | |
| *** andrewbonney has quit IRC | 18:19 | |
| *** jamesdenton has quit IRC | 18:26 | |
| *** jamesden_ has joined #openstack-infra | 18:26 | |
| *** iurygregory has joined #openstack-infra | 18:27 | |
| *** jcapitao has quit IRC | 18:38 | |
| *** xek has joined #openstack-infra | 18:44 | |
| *** xek__ has quit IRC | 18:44 | |
| *** eolivare_ has quit IRC | 18:45 | |
| *** rlandy|biab is now known as rlandy | 18:58 | |
| mattmceuen | Hi team - I have a couple of new project requests out against project-config, but they're failing linting because their `upstream:` doesn't have a `master` branch (we'd thought to skip straight to `main` with the new projects) | 19:11 |
| mattmceuen | Is there a way to tell the project-config job to use `main` instead of `master`? Or should we just pivot to `master` for now? | 19:11 |
| clarkb | mattmceuen: there is but I'm in a meeting so give me a bit and we can talk bout it more | 19:12 |
| mattmceuen | no rush, thanks clarkb! | 19:12 |
| clarkb | no one has used it yet and we just upgraded gerrit. my strong preference would be that we add new projects without extra complications (not necessarily your projects) then when we're happy that is working we can look at adding projects without master is the tldr | 19:12 |
| mattmceuen | Yep, that makes sense -- will do, thanks | 19:14 |
| openstackgerrit | Alec Hothan proposed openstack/project-config master: Enable python 3.6 job only for x/vmtp project. https://review.opendev.org/c/openstack/project-config/+/764054 | 19:19 |
| *** david-lyle has quit IRC | 19:21 | |
| *** dklyle has joined #openstack-infra | 19:21 | |
| *** mihalis68_ has joined #openstack-infra | 19:57 | |
| *** sboyron has quit IRC | 20:09 | |
| *** gbutnaru has joined #openstack-infra | 20:15 | |
| rpioso | gertty seems to have broken for me since the Gerrit upgrade. I'm running it on Fedora 31. Sound familiar? | 20:15 |
| fungi | rpioso: did you switch to basic auth? | 20:16 |
| *** hamalq has joined #openstack-infra | 20:16 | |
| rpioso | fungi: No, I haven't. | 20:17 |
| fungi | rpioso: point #3 in http://lists.opendev.org/pipermail/service-announce/2020-November/000014.html | 20:17 |
| rpioso | fungi: Ahhhh ... RTFM ;-) | 20:18 |
| fungi | no worries | 20:18 |
| rpioso | fungi: Thank you! | 20:18 |
| fungi | i figure if you missed that then a link to the rest of the stuff in the announcement can't hurt | 20:18 |
| *** sboyron has joined #openstack-infra | 20:18 | |
| *** xek has quit IRC | 20:30 | |
| *** gbutnaru has quit IRC | 20:30 | |
| *** hamalq has quit IRC | 20:55 | |
| *** hashar has quit IRC | 20:59 | |
| *** artom has quit IRC | 21:00 | |
| *** artom has joined #openstack-infra | 21:01 | |
| *** artom has quit IRC | 21:02 | |
| *** artom has joined #openstack-infra | 21:03 | |
| *** hamalq has joined #openstack-infra | 21:10 | |
| *** hamalq has quit IRC | 21:15 | |
| *** ralonsoh has quit IRC | 21:17 | |
| clarkb | mattmceuen: hey I forgot to follow up after our meeting | 21:18 |
| clarkb | mattmceuen: was the tldr sufficient or would you like more info? | 21:18 |
| clarkb | mattmceuen: Two other things I'll mention is you have to set the default branch you want in projects.yaml, and I bet the CI job needs to be updated to readthat value and only error if that value isnt in the upstream | 21:20 |
| fungi | ianw: did you see the post on the openstack-discuss ml about supporting static addresses with nm in glean? | 21:23 |
| ianw | fungi: yeah dtantsur|afk alerted me but i haven't got to mail yet :) | 21:23 |
| fungi | ahh, cool, just making sure you were aware | 21:26 |
| *** rfolco|ruck has quit IRC | 21:32 | |
| *** sboyron has quit IRC | 21:34 | |
| *** sboyron has joined #openstack-infra | 21:34 | |
| *** zzzeek has quit IRC | 21:38 | |
| *** zzzeek has joined #openstack-infra | 21:40 | |
| *** dhill has quit IRC | 21:44 | |
| *** dhill has joined #openstack-infra | 21:52 | |
| *** hjensas has quit IRC | 21:58 | |
| *** sboyron has quit IRC | 21:58 | |
| *** hjensas has joined #openstack-infra | 21:59 | |
| *** sboyron has joined #openstack-infra | 21:59 | |
| *** rcernin has joined #openstack-infra | 22:00 | |
| openstackgerrit | Alec Hothan proposed openstack/project-config master: Enable python 3.6 job only for x/vmtp project. https://review.opendev.org/c/openstack/project-config/+/764054 | 22:03 |
| mattmceuen | clarkb: yep tldr fit the bill :) we're moving forward with the new projects using master, with an all-at-once migration later on. thanks! | 22:04 |
| clarkb | ok thanks for the understanding | 22:05 |
| *** Goneri has quit IRC | 22:08 | |
| *** sboyron has quit IRC | 22:11 | |
| *** sboyron has joined #openstack-infra | 22:11 | |
| *** sboyron has quit IRC | 22:12 | |
| *** sboyron has joined #openstack-infra | 22:13 | |
| *** sboyron has quit IRC | 22:15 | |
| *** sboyron has joined #openstack-infra | 22:16 | |
| *** hjensas_ has joined #openstack-infra | 22:16 | |
| *** hjensas has quit IRC | 22:17 | |
| *** hjensas__ has joined #openstack-infra | 22:17 | |
| samueldmq | Hey, is meetpad.opendev.org managed by the infra team? | 22:17 |
| *** hjensas__ has quit IRC | 22:17 | |
| samueldmq | I was wondering where the code for installing it lives | 22:18 |
| *** hjensas__ has joined #openstack-infra | 22:18 | |
| samueldmq | I made some search on opendev.org/explore/repos but no luck | 22:18 |
| *** sboyron has quit IRC | 22:20 | |
| *** sboyron has joined #openstack-infra | 22:20 | |
| fungi | samueldmq: it is! lemme get you links | 22:21 |
| *** hjensas_ has quit IRC | 22:21 | |
| *** matt_kosut has quit IRC | 22:21 | |
| fungi | we should probably add it at https://docs.opendev.org/opendev/system-config/latest/systems.html soon | 22:22 |
| fungi | samueldmq: so the main ansible playbook we deploy it with is here: https://opendev.org/opendev/system-config/src/branch/master/playbooks/service-meetpad.yaml | 22:22 |
| fungi | samueldmq: the primary role it uses for jitsi-meet is here: https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/jitsi-meet | 22:23 |
| fungi | samueldmq: and the container image build details are here: https://opendev.org/opendev/system-config/src/branch/master/docker/jitsi-meet | 22:24 |
| fungi | pretty much everything for it is in that system-config repo (same with most of our services at this point) | 22:25 |
| samueldmq | fungi: awesome, thanks for the links | 22:25 |
| *** sboyron has quit IRC | 22:25 | |
| samueldmq | fungi: do we store any data about resource usage? | 22:25 |
| *** sboyron has joined #openstack-infra | 22:26 | |
| fungi | not really service-specific data but general system resource data is collected with snmp and graphed at http://cacti.openstack.org/ (the meetpad and jvb servers) | 22:28 |
| fungi | if you have any questions about it, the #opendev channel might be slightly more appropriate, but we're all happy to answer questions | 22:28 |
| * samueldmq nods | 22:32 | |
| fungi | our use tends to be "bursty" (lots of users and sessions during virtual conferences, few to none the rest of the year) | 22:33 |
| samueldmq | fungi: this is enough info for now. I will make sure to ask on #opendev whenever we get specific questions | 22:33 |
| fungi | awesome. hope it's helpful! | 22:33 |
| samueldmq | fungi: nice. did you face any problems with scaling it? sessions getting slow or something like that? limitations on rooms? | 22:33 |
| *** sboyron has quit IRC | 22:33 | |
| *** sboyron has joined #openstack-infra | 22:34 | |
| samueldmq | fungi: indeed, this was really helpful | 22:34 |
| clarkb | samueldmq: scaling tends to be more of an issue client side than server side for us | 22:34 |
| fungi | the way we scale it is by adding and removing additional jvb servers | 22:34 |
| clarkb | but ya we can scale up by adding more jvb servers, each meeting is assigned to one jvb at a time but you can scale horizontally the number of meetings quite well by adding jvbs | 22:35 |
| clarkb | then within a single meeting the bottleneck seems to be the client side not the server | 22:35 |
| fungi | but yeah, performance for a particular call has more to do with browser-side cpu and memory utilization and availability of hardware acceleration in browsers for video and audio decoding | 22:35 |
| samueldmq | clarkb: oh, I thought the amount of people streaming their video would affect a lot the server | 22:35 |
| clarkb | samueldmq: it does, but not before the clients fall over first | 22:36 |
| clarkb | at least that has been our experience | 22:36 |
| fungi | we've seen it work fairly well for up to 10 video participants on a call or more like 50 audio participants, but again that's more up to how much the browser can handle | 22:36 |
| samueldmq | well, a great experience btw | 22:36 |
| samueldmq | you do at scale (when having virtual confs) | 22:37 |
| fungi | any particular "room" will be pinned to a specific jvb process but one jvb can handle quite a few calls. if you see it's using too much server-side adding another machine to run jvb processes isn't hard | 22:37 |
| clarkb | other things we have noticed: chrom* seem to haev the most stable webrtc implementation though chromium on fedora recently started crashing using any webrtc, jitsi included | 22:38 |
| clarkb | chrome was apparently not affected | 22:38 |
| fungi | which is why we have multiple jvb servers but then one server for everything else (it also hosts jvb processes too) | 22:38 |
| samueldmq | nice, is jvb in an autoscaling strategy now? | 22:38 |
| clarkb | no we manually scale it up | 22:38 |
| clarkb | it should be simple to do it automatically in the latest versions | 22:38 |
| fungi | we add a server or two when there's a conference scheduled and then remove them when it's over | 22:39 |
| clarkb | old jitsi meet required that you preprovision all the slots for jvbs and it was much more complicated | 22:39 |
| clarkb | but now you just need the jvb to have teh correct credentials for xmpp, it joins and says "I'm here to help" and is part of the cluster | 22:39 |
| fungi | conference meaning multi-day event where we expect lots and lots of simultaneous "rooms" to be in use | 22:39 |
| samueldmq | oh nice, that's awesome. it joins the cluster automatially | 22:39 |
| samueldmq | automatically* | 22:40 |
| samueldmq | fungi: and thousands of participants all summed up I guess | 22:40 |
| fungi | in our case more like hundreds i think, hard to say for sure | 22:40 |
| *** sboyron has quit IRC | 22:40 | |
| fungi | i don't know if we collected stats on peak numbers of clients on the platform or anything | 22:41 |
| *** sboyron has joined #openstack-infra | 22:41 | |
| clarkb | ya my guess is ~100 or so peak | 22:47 |
| clarkb | since many projects were not using it during the ptg | 22:47 |
| *** hjensas__ has quit IRC | 22:47 | |
| samueldmq | interesting | 22:48 |
| *** sboyron has quit IRC | 22:48 | |
| *** hjensas__ has joined #openstack-infra | 22:48 | |
| samueldmq | just for a bit of context, we have been doing Moodle for schools and Jitsi integrates just great on it | 22:48 |
| *** sboyron has joined #openstack-infra | 22:48 | |
| fungi | i highly recommend experimenting with it | 22:49 |
| samueldmq | we will experiment having our own server and the installation method you have looks neat | 22:49 |
| fungi | debian used jitsi-meet to host their virtual debconf this year too | 22:49 |
| fungi | so we're at least not the only open source project using it to do virtual community conference events | 22:49 |
| *** hjensas__ has quit IRC | 22:50 | |
| *** hjensas__ has joined #openstack-infra | 22:50 | |
| clarkb | the way debian scaled up the client side user problem is they only had the presenters and main participants in jitsi then streamed the rest iirc | 22:50 |
| clarkb | we don't have anything like that set up | 22:50 |
| fungi | right, there are a bunch of options | 22:50 |
| *** jamesden_ is now known as jamesdenton | 22:50 | |
| fungi | and add-on extensions | 22:50 |
| fungi | the other popular open source videoconferencing platform i've seen used by communities for stuff like that is big blue button | 22:51 |
| fungi | https://bigbluebutton.org/ | 22:52 |
| fungi | they have a strong online learning/lms focus | 22:52 |
| fungi | so might also be worth looking at for your use case | 22:53 |
| samueldmq | interesting, yes I heard of BBB | 22:54 |
| samueldmq | but I really like the way Jitsi integrates within Moodle, just as an iframe within the course content | 22:54 |
| samueldmq | other tools tend to only add a button and send you to an external tool or app (such as zoom( | 22:55 |
| fungi | to be frank, embedding systems like that in the same browser window can lead to challenges with privacy extensions in browsers, especially if you put those systems in different dns domains | 22:55 |
| fungi | the folks building the open infrastructure summit interface quickly learned that | 22:56 |
| *** sboyron has quit IRC | 22:57 | |
| *** rfolco|ruck has joined #openstack-infra | 22:57 | |
| fungi | part of the goal with meetpad (and what makes it not just jitsi-meet) is we embedded related urls from our etherpad server as a "shared document" in jitsi-meet calls, and even just doing that resulted in us needing to change the etherpad server so it would be in the same dns domain, otherwise there were serious issues with browsers blocking the connections | 22:57 |
| samueldmq | fungi: interesting, would CORS restriction on accepted domain help on those concerns? | 22:58 |
| fungi | the problem tends to be more that browser-side protections like ddg privacy extensions and eff privacy badger will see those as possible "trackers" and block access to them from the page by default | 22:59 |
| clarkb | that and etherpad sets cookie things | 22:59 |
| clarkb | its actually the cookies that give us the most grief iirc | 22:59 |
| clarkb | beacuse etherpad says don't share this around | 22:59 |
| fungi | right, embedded services setting cookies is a headache | 23:00 |
| fungi | for a variety of reasons, that being one | 23:00 |
| *** matt_kosut has joined #openstack-infra | 23:01 | |
| fungi | typical browser privacy/security model expects distinct services to be isolated to different tabs or windows | 23:01 |
| samueldmq | that's good lessons learned | 23:02 |
| fungi | definitely still try it, no two situations are entirely the same, but expect and test for those sorts of scenarios | 23:02 |
| samueldmq | we have plans to develop a custom thing like meetpad, a serivce that would stream content to jitsi | 23:03 |
| samueldmq | that would in its turn embedded to moodle | 23:03 |
| samueldmq | that would be a huge challenge based on what we're talking | 23:03 |
| samueldmq | fungi: agree | 23:04 |
| samueldmq | I will make sure to have all this in mind when experimenting it | 23:04 |
| fungi | another detail worth mentioning, we've observed that sometimes jitsi-meet really wants to switch focus from a shared document to the video stream of someone who's talking. if your implementation will similarly rely on shared documents then you might want to see if you can figure out a fix for that and maybe help get it solved upstream too | 23:05 |
| fungi | i don't think any of us have had the time to try to solve it yet | 23:06 |
| *** matt_kosut has quit IRC | 23:06 | |
| *** sboyron has joined #openstack-infra | 23:07 | |
| *** slaweq has quit IRC | 23:09 | |
| *** hjensas__ has quit IRC | 23:09 | |
| samueldmq | fungi: hmm I thought you hd that figured out | 23:11 |
| samueldmq | I tried sharing my screen in a meetpad session and it keeps in the etherpad view | 23:12 |
| samueldmq | oh, that might be something different, you mentioned when someone's talking | 23:12 |
| fungi | yes, seems like it has to be someone who has an active camera stream too | 23:14 |
| fungi | it doesn't appear to switch away from the shared document for audio-only users talking | 23:14 |
| fungi | possible we've merely got something misconfigured which is causing that behavior, but if so we haven't figured out what exactly | 23:15 |
| samueldmq | kk I will make sure to come back and share what we've got once we start experimenting with it | 23:16 |
| samueldmq | fungi: clarkb I really appreciate your time sharing all this | 23:16 |
| *** Goneri has joined #openstack-infra | 23:18 | |
| fungi | samueldmq: my pleasure, happy to see others get use out of this work | 23:18 |
| fungi | and to be able to help promote free/libre open source software more generally | 23:19 |
| rpioso | I just tried to publish a new release of x/sushy-oem-idrac. I briefly saw its release job in Zuul. I don't know if it succeeded. PyPI doesn't yet have the new release. | 23:19 |
| rpioso | Where can I determine the outcome? | 23:20 |
| fungi | rpioso: https://zuul.opendev.org/t/openstack/builds?project=x%2Fsushy-oem-idrac | 23:21 |
| fungi | i don't see any release pipeline builds for it at all | 23:21 |
| fungi | was it the 1.0.0 tag? | 23:22 |
| fungi | tagged 23:12:13 utc today | 23:23 |
| fungi | so i guess that was it | 23:23 |
| fungi | looking to see if you have any release pipeline jobs for that repo | 23:23 |
| rpioso | fungi: Thank you! | 23:24 |
| fungi | https://opendev.org/x/sushy-oem-idrac/src/branch/master/zuul.d/project.yaml | 23:24 |
| fungi | i don't see any release pipeline jobs in there, nor templates i recognize as providing release jobs | 23:25 |
| clarkb | fungi: rpioso usually release jobs go in project-config | 23:30 |
| clarkb | an artifact of releaes being tag based and previously not matching branches | 23:30 |
| fungi | true, it's theoretically safe to put them in branched repositories now | 23:31 |
| fungi | but we do still mention it as an exception here: https://docs.opendev.org/opendev/infra-manual/latest/creators.html#central-config-exceptions | 23:31 |
| *** rlandy has quit IRC | 23:34 | |
| rpioso | fungi: I'm a bit lost. I'm looking at another ironic-related project, openstack/python-dracclient. I cut a release there an hour ago. The file you linked above contains more than that project's: https://opendev.org/openstack/python-dracclient/src/branch/stable/ussuri/zuul.d/project.yaml | 23:34 |
| *** dchen has joined #openstack-infra | 23:35 | |
| rpioso | clarkb, fungi: So create the branch at that tag and somehow retry? | 23:35 |
| fungi | rpioso: because of this: https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml | 23:35 |
| fungi | lne 4922 | 23:36 |
| fungi | for some reason my browser doesn't want to link the line number | 23:36 |
| fungi | maybe because the file is so large | 23:36 |
| *** hamalq has joined #openstack-infra | 23:37 | |
| fungi | https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L4919-L4922 | 23:37 |
| fungi | there we go | 23:37 |
| rpioso | fungi: Should I propose a change which adds a similar entry for x/sushy-oem-idrac? | 23:39 |
| fungi | rpioso: yes, if you do that i'll approve it and reenqueue your 1.0.0 tag into the release pipeline for you | 23:39 |
| rpioso | fungi: Awesome! Should I create a branch at that tag beforehand? | 23:39 |
| fungi | not necessary to do that first, though i don't think it will change the behavior of the job either way | 23:40 |
| *** hamalq has quit IRC | 23:41 | |
| *** rfolco|ruck has quit IRC | 23:50 | |
| *** rfolco|ruck has joined #openstack-infra | 23:50 | |
| *** hamalq has joined #openstack-infra | 23:52 | |
| *** rfolco|ruck has quit IRC | 23:55 | |
| *** tosky has quit IRC | 23:57 | |
| *** hamalq has quit IRC | 23:57 | |
| *** openstackgerrit has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!