| fungi | https://bugs.launchpad.net/nova/+bug/2141877 is now public (invalid llm hallucination) | 15:12 |
|---|---|---|
| rosmaita | Comment #17 is sheer poetry: | 15:57 |
| rosmaita | "The latest exploit wrote CVE 2026 to the host BIOS. | 15:57 |
| rosmaita | This is their autograph forever | 15:57 |
| rosmaita | I don't know how to fix this, I wrote it in Ubuntu too | 15:57 |
| rosmaita | Tested on 2 cars, true Hos 1, but cars in different countries, it works everywhere." | 15:57 |
| fungi | i'm not looking forward to getting more of these | 15:59 |
| rosmaita | no, that was an enormous waste of time | 15:59 |
| mikal | Honestly? It wasn't too bad. I think I spent a couple of hours in total on it, mostly because I thought it was interesting. It took longer to work out what they were alleging than to debug the allegation. I particularly enjoyed using a LLM to assist with writing the replies. It seemed... artistically appropriate. | 18:40 |
| fungi | fun! | 18:40 |
| mikal | I have meta questions really. Like. Are they really Russian? Is that why their LLM output was so poor, because the American LLMs are all trade embargoed away? Would asking for supporting references have improved their results? etc etc. | 18:41 |
| fungi | it mainly seemed like when i asked the reporter whether their llm had hallucinated the whole thing, they seemed to just ask the llm to justify its case and then pasted that assuming that it couldn't be wrong | 18:42 |
| fungi | but also, really, tarballs full of c source code with no accompanying instructions do not a reproducer make | 18:42 |
| mikal | Their comments also discussed attachments which as best as I can tell do not exist, which was confusing. | 18:47 |
| mikal | I am trying to be generous and assume this was a first year university student or something. | 18:47 |
| fungi | yeah, my responses were probably a bit rude, in retrospect. this has been an escalating problem but is the first really egregious report we've gotten | 18:48 |
| fungi | the panic/urgency in the reporter's tone tended to escalate matters | 18:49 |
| mikal | Nah I think you were fine. | 18:54 |
| fungi | i can only hope it was as much of a learning experience for the reporter as it was for any of us | 18:56 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!