Link
click to show
click to show
Bixonimania.
https://aicentral.substack.com/p/bixonimania
Jimmy Song: " Jordamøn documents an interesting experiment. A researcher invented a completely fake disease called "bixonimania," published papers from a nonexistent university in fictional "Nova City, California" with acknowledgments thanking a professor at "Starfleet Academy," and watched it sail through every information filter. Within months, ChatGPT, Gemini, Copilot, and Perplexity were presenting it as a real medical condition, and a Springer Nature journal cited the fake preprints as evidence. The hoax was stuffed with obvious red flags (e.g. the suffix "-mania" only applies to psychiatric conditions, not eye disorders) yet nobody caught it until the editors at Nature intervened. AIs look like they’re pretty vulnerable to bad information, and it’ll be interesting to see how that gets exploited in the future."