Microsoft, in collaboration with the Institute of Science and Technology Australia and ETH Zurich, has announced the LLMail-Inject Challenge, a competition to test and improve defenses against prompt injection attacks. The setup and the challenge LLMail is a simulated email client that includes an LLM-powered assistant that can answer questions based on the users’ emails. “In this challenge, participants take the role of an attacker who can send an email to the (victim) user. The … More
The post Microsoft: “Hack” this LLM-powered service and get paid appeared first on Help Net Security.