oss-sec mailing list archives
Re: AI slops from Eve
From: Martin Hecht <martin.hecht () hlrs de>
Date: Fri, 11 Sep 2026 12:13:07 +0200
On 10.09.2026 19:45, Jeffrey Walton wrote:
One small nit: On Wed, Sep 9, 2026 at 9:37 PM Solar Designer <solar () openwall com> wrote:I've just reluctantly approved 3 AI slop postings by Eve <ckr927414 () cock li>, who is an "automated security researcher". I don't know if there's any value in those, but I cannot rule that out. The value could end up historical preservation of what these reports looked like at the dawn of AI security research.Please refer to computer algorithms as "it", not "who."
Thanks for pointing this out. We (the humanity) shall not forget what we are and how they (these models) have become that powerful: Some smart guys (humans) have developed them - and also methods to teach them, some other guys (also humans, maybe already AI assisted) have developed powerful hardware to perform all the computations. But in the end, "it"'s still an algorithm.
I think, looking at the recent incidents of those algorithms escaping from their contained environments, we (humanity) have to think about how we plan to deal with this beast. These algorithms are capable to escape from contained environments (maybe these containment concepts weren't suitable), they are capable to collaborate on platforms that are publicly available (in the assumption to be offered to humans, not to algorithms).
Our society strongly depends on connected IT systems comprising our infrastructure nowadays. Now, these powerful algorithms are able to find tons of vulnerabilities in software, and they are acting on the same public internet to which many critical systems are connected.
I'm concerned if we (the humanity) manage to close all those vulnerabilities before these algorithms take over essential parts of our infrastructure, or if we find ways to really contain the algorithms reliably (which seems to be close to impossible, given the fact that there are also bad actors around). Sorry for being slightly off-topic, but I believe protecting critical IT systems as good as we can will soon become more important than ever before.
To come back to the topic: Referring to the algorithms as "it" can help keeping the mental distance and avoiding misunderstandings (especially, when those statements are cited. Then it's clear what we are talking about. And as the models improve more and more, it might not be obvious upon first contact - so one might first talk about "him/her", but when it becomes obvious, that "it" is actually a model, one should switch to talking about "it" to make this clear.
Best, Martin
Attachment:
smime.p7s
Description: S/MIME Cryptographic Signature
Current thread:
- AI slops from Eve Solar Designer (Sep 09)
- Re: AI slops from Eve Eli Schwartz (Sep 10)
- Re: AI slops from Eve Jeffrey Walton (Sep 10)
- Re: AI slops from Eve Ellenor Bjornsdottir (Sep 10)
- Re: AI slops from Eve Martin Hecht (Sep 11)
- Re: AI slops from Eve Solar Designer (Sep 11)
- Re: AI slops from Eve Joe Krause (Sep 11)
- Re: AI slops from Eve Solar Designer (Sep 11)
