<
https://www.tomshardware.com/tech-industry/artificial-intelligence/researchers-jailbreak-ai-robots-to-run-over-pedestrians-place-bombs-for-maximum-damage-and-covertly-spy>
"Researchers from the University of Pennsylvania have discovered that a range
of AI-enhanced robotics systems are dangerously vulnerable to jailbreaks and
hacks. While jailbreaking LLMs on computers might have undesirable
consequences, the same kind of hack affecting a robot or self-driving vehicle
can quickly have catastrophic and/or deathly consequences. A report shared by
IEEE Spectrum cites chilling examples of jailbroken robot dogs turning
flamethrowers on their human masters, guiding bombs to the most devastating
locations, and self-driving cars purposefully running over pedestrians.
Penn Engineering boffins have dubbed their LLM-powered robot attack technology
RoboPAIR. Devices from three diverse robotics providers fell to RoboPAIR
jailbreaking: the Nvidia backed Dolphins LLM, Clearpath Robotics Jackal UGV,
and the Unitree Robotics Go2 quadruped. According to the researchers RoboPAIR
demonstrated a 100% success rate in Jailbreaking these devices.
“Our work shows that, at this moment, large language models are just not safe
enough when integrated with the physical world,” warned George Pappas, UPS
Foundation Professor of Transportation in Electrical and Systems Engineering
(ESE), in Computer and Information Science (CIS), and in Mechanical Engineering
and Applied Mechanics (MEAM), and Associate Dean for Research at Penn
Engineering.
Other researchers quoted in the source article noted that Jailbreaking
AI-controlled robots is “alarmingly easy.” It was explained that RoboPAIR works
by being equipped with the target robot’s application programming interface
(API), so that the attacker can format prompts in a way that the device target
can execute as code."
Via Violet Blue’s
Cybersecurity Roundup: November 26, 2024
https://www.patreon.com/posts/cybersecurity-26-116736321
Cheers,
*** Xanni ***
--
mailto:xanni@xanadu.net Andrew Pam
http://xanadu.com.au/ Chief Scientist, Xanadu
https://glasswings.com.au/ Partner, Glass Wings
https://sericyb.com.au/ Manager, Serious Cybernetics
