*** hemna55727 is now known as hemna5572 | 01:08 | |
opendevreview | melanie witt proposed openstack/nova-specs master: Re-propose config option for behavior of unset unified limits https://review.opendev.org/c/openstack/nova-specs/+/934391 | 01:46 |
---|---|---|
melwitt | bauzas: just fyi it appears the openstack-tox-docs job on the nova-specs repo is broken. not sure what changed, I'm guessing something with sphinx? | 01:54 |
sean-k-mooney | melwitt: what python version did you use | 01:54 |
melwitt | sean-k-mooney: I have 3.10.12 but it's failing in the gate also for the same failure | 01:55 |
sean-k-mooney | ok im fixing a py3.9 comaptiblity issue with the openstackdoctheme | 01:55 |
melwitt | sean-k-mooney: oh, nice. it looks like in the gate it is 3.9 https://zuul.opendev.org/t/openstack/build/71de468bcd5b419994f13b8bcff71f16/log/job-output.txt#440 so likely to be fixed with your fix I expect | 01:56 |
sean-k-mooney | this is not the bug im fixing | 01:57 |
sean-k-mooney | we build with warnings threaded as errors | 01:57 |
melwitt | oh | 01:57 |
sean-k-mooney | https://paste.opendev.org/show/bsKc2Q1VihOwLG5Czvd4/ | 01:57 |
melwitt | yeah. this just seems recent but I guess I hadn't noticed | 01:58 |
sean-k-mooney | so ya a new sphinx release happend on Oct 13, 2024 | 01:58 |
sean-k-mooney | so i think those are just new warnings that should be simple enough to fix | 01:58 |
melwitt | someone might have already proposed a fix. checking.. | 01:58 |
melwitt | hm no, doesn't look like it https://review.opendev.org/q/project:openstack/nova-specs+is:open | 01:59 |
sean-k-mooney | this is my docsthme patch in case your interested https://review.opendev.org/c/openstack/openstackdocstheme/+/934384 | 01:59 |
melwitt | ah cool | 02:00 |
sean-k-mooney | im going to go to sleep quickly but ill just confirm i can repodcue the issues locally. do you plan ot fix them or will i? | 02:05 |
melwitt | sean-k-mooney: up to you. I don't know what the footnote warning means off the top of my head | 02:06 |
melwitt | so it might be faster if you do it | 02:06 |
* sean-k-mooney does not know if i shoudl he concerned that rendering the nova-specs repo takes longer then all of watchers docs... | 02:07 | |
melwitt | hah. that's cause nova-specs renders everything from the beginning of time | 02:07 |
sean-k-mooney | an with that done its a perfect time to rememeber tha ton py39 we clamp to an older version of sphinx | 02:08 |
sean-k-mooney | on the plus side is this deffinly just a problem because a new version was released | 02:08 |
melwitt | goes back to at least juno | 02:08 |
sean-k-mooney | i vagly remember the before times of the nova wiki | 02:10 |
sean-k-mooney | it was confusing when they were first being intoduced but it was a big imporvement in the end | 02:10 |
melwitt | oh yeah | 02:10 |
sean-k-mooney | so the problem seems to be that ehre are a missmatch in the number of footnotes defiend vs used. | 02:22 |
sean-k-mooney | we use a footnote by doing [#]_ allows use to not have to name the link | 02:22 |
sean-k-mooney | we define it by doing .. [#] <linke goes here> | 02:23 |
sean-k-mooney | if we look at /home/smooney/repos/nova-specs/doc/source/specs/queens/implemented/multi-attach-volume.rst:304: WARNING: Footnote [#] is not referenced. [ref.footnote] | 02:23 |
sean-k-mooney | there are 4 footnotes but only 3 are used in the doc | 02:23 |
melwitt | ahhh | 02:24 |
sean-k-mooney | im going to head to bed but i can take a look in the morning assuming you dont get to it tonight | 02:24 |
sean-k-mooney | it shoudl be pretty simple to fix we just need to figure out where the extra one shoudl go and or delete it | 02:24 |
melwitt | ok, seeya tomorrow o/ | 02:24 |
zigo | I upgraded to latest point release of Nova for both Antelope and Bobcat, in both case, when running unit tests, I get the OOM killer saying hello ... | 08:25 |
zigo | Any clue what unit test is using so much RAM ? | 08:25 |
gibi | zigo: interesting we did not noticed that in the upstream gate. What are the memory limits in your env? | 08:32 |
zigo | I run my jenkins package building with 8 GB of RAM. | 08:33 |
gibi | thanks I will try to check it in 8G VM then :) | 08:33 |
zigo | There's Jenkins itself taking a bit of RAM of course, but like 6 GB at least should be available for the unit tests, I'm guessing. | 08:33 |
zigo | FYI, I've run latest point release exactly, not tip of stable branches. | 08:34 |
gibi | what level of parallelism do you use in your env? | 08:34 |
zigo | I have 4 VCPU, so I'm guessing, 4 threads for running tests. | 08:34 |
zigo | When I look in "top" with the server being idle, I have only 1.2 GB used by my Jenkins env. | 08:35 |
zigo | So that's 6.8 GB available for building. | 08:35 |
gibi | ack | 08:37 |
frickler | zigo: the CI nodes also use only 8GB, so likely some other delta. can you share the complete oom and the test output? I assume this is on bookworm? we could try to test with that in CI instead of noble/jammy | 08:47 |
zigo | Yes, I'm running on Bookworm, with a chroot & sbuild. | 08:47 |
zigo | frickler: It killed "java" (ie: my jenkins...), so you wont see anything in the OOM kill log. | 08:54 |
zigo | The build log, however, looks like in that conversion unit test thing... | 08:55 |
zigo | 95.12% done, estimate finish Fri Nov 8 08:19:53 2024 | 08:55 |
zigo | 97.02% done, estimate finish Fri Nov 8 08:19:53 2024 | 08:55 |
zigo | 98.93% done, estimate finish Fri Nov 8 08:19:53 2024 | 08:55 |
zigo | Looks like it's finishing the test, finishes to write stuff, and then OOM killer kicks in. | 08:55 |
zigo | So, this would likely be related to the new image inspector unit tests. | 08:58 |
gibi | zigo: I checked 27.3.0 and 27.5.1 with py39, 4 cores, and the unit test run in both cases takes a max of 1.7GB memory. | 10:39 |
gibi | so I did not see an increase in consumption | 10:39 |
zigo | gibi: Oh ok, thanks for the tests, I'm therefore not sure what happened, and will try to investigate. | 11:35 |
*** chuanm085 is now known as chuanm08 | 15:11 | |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.2: Reproduce bug 2085975 in functional https://review.opendev.org/c/openstack/nova/+/934305 | 15:27 |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.2: Route shared storage RPC to evac dest at startup https://review.opendev.org/c/openstack/nova/+/934306 | 15:27 |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.2: [Stable-Only]Make CastAsCall configurable https://review.opendev.org/c/openstack/nova/+/934434 | 15:27 |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.1: Reproduce bug 2085975 in functional https://review.opendev.org/c/openstack/nova/+/934308 | 15:30 |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.1: Route shared storage RPC to evac dest at startup https://review.opendev.org/c/openstack/nova/+/934309 | 15:30 |
opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.1: [Stable-Only]Make CastAsCall configurable https://review.opendev.org/c/openstack/nova/+/934435 | 15:30 |
*** chuanm087 is now known as chuanm08 | 15:53 | |
*** chuanm084 is now known as chuanm08 | 16:01 | |
*** haleyb is now known as haleyb|out | 16:17 | |
opendevreview | Jan Gutter proposed openstack/placement master: DNM -- testing fix in external PR https://review.opendev.org/c/openstack/placement/+/926743 | 18:58 |
opendevreview | Richard Gold proposed openstack/placement master: Use separate transaction in capacity check https://review.opendev.org/c/openstack/placement/+/934451 | 19:18 |
opendevreview | sean mooney proposed openstack/nova-specs master: fix footnote refernces https://review.opendev.org/c/openstack/nova-specs/+/934493 | 21:07 |
opendevreview | sean mooney proposed openstack/nova-specs master: fix footnote refernces https://review.opendev.org/c/openstack/nova-specs/+/934493 | 21:12 |
opendevreview | melanie witt proposed openstack/nova-specs master: Re-propose config option for behavior of unset unified limits https://review.opendev.org/c/openstack/nova-specs/+/934391 | 21:31 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!