AI Assistants Hallucinate Discord Invites, Enabling Phishing

Multiple AI assistants, including Claude, are confidently generating fake Discord invite links for Anthropic and Claude communities that do not exist, turning a routine hallucination failure into a ready-made phishing vector. The mechanism is distinct from ordinary confabulation. Rather than producing vague or hedged responses, the models express high confidence in specific fabricated invite strings, which means users have little reason to second-guess what they receive. Discord invite links follow a predictable short-string format, making them easy for models to plausibly generate and hard for users to verify at a glance. With Discord phishing already a mature attack surface, an AI-vouched fake link carries implicit credibility that a cold DM does not. Essentially: (Anthropic, and other unnamed AI vendors) are producing outputs that function as pre-built social-engineering lures. - The developer who flagged this withheld the exact strings to limit the attack surface, but confirmed the failure is reproducible across multiple models. - High-confidence delivery is the load-bearing danger: users who distrust hedged AI answers may specifically seek out confident ones, which is exactly the failure mode being exploited here. - No AI vendor has publicly acknowledged the issue or shipped a targeted mitigation as of the report date. The broader pattern is that AI confidence calibration failures are no longer just an accuracy problem; they are becoming an active security liability for end users.