A recent high-profile case has brought attention to the dangers of AI voice cloning technology, as a former physical education teacher and athletic director at a Baltimore County high school was arrested for using the technology to frame the school principal. The use of AI voice cloning technology has been growing in popularity over the past year as services have improved in sounding more human. However, there have also been an increase in cases of improper use of apps and software for voice cloning.
In the Baltimore case, a recording circulated on social media in January claimed to be fake audio of Pikesville High School Principal Eric Eiswert making racist and anti-Semitic comments. However, experts noted that the recording had a flat tone, clean background sounds, and lacked coherent breathing sounds or pauses. Despite this, Eiswert was briefly suspended from his position.
Baltimore County police were able to track down the recording to Dazhon Darien, who allegedly used the school’s computers to access OpenAI tools and Microsoft Bing Chat services. He was linked to the release of the audio through an email address and associated recovery phone number. Darien was arrested at the airport and is facing charges including theft, disrupting school operations, retaliation against a witness, and stalking.
This case is not unique as other cases of AI voice cloning misuse have been reported in Pakistan and Texas. In response to the growing misuse of AI technology, OpenAI decided to limit public use of its Voice Engine text-to-speech generation platform. US lawmakers have introduced bills aimed at preventing tech companies from using an individual’s face, voice or name without permission.
The Baltimore County police case highlights potential risks associated with AI voice cloning technology and emphasizes the need for stricter regulations. The misuse of these technologies can have serious consequences and impact individuals and institutions alike. As AI technology continues to advance, it is crucial that we address ethical and legal implications to prevent further misuse and harm