Misplaced Pages

15.ai: Difference between revisions

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Browse history interactively← Previous editNext edit →Content deleted Content addedVisualWikitext
Revision as of 19:46, 21 February 2022 editHackerKnownAs (talk | contribs)478 editsm grammar← Previous edit Revision as of 19:51, 21 February 2022 edit undoHackerKnownAs (talk | contribs)478 editsm remove block spacing from tweetsNext edit →
Line 202: Line 202:


== Reception == == Reception ==

{{tweet
|image = 15.ai logo.png
|name = 15
|username = fifteenai
|width = 450px
|date = January 14, 2022
|text = I've been informed that the aforementioned NFT vocal synthesis is actively attempting to appropriate my work for their own benefit.
After digging through the ], I have evidence that some of the voices that they are taking credit for were indeed generated from my own site.
|reference = <ref group="tweet">{{Cite tweet |user=fifteenai |number=1482055102919757835|date = January 14, 2022 |title=I've been informed that the aforementioned NFT vocal synthesis is actively attempting to appropriate my work for their own benefit. After digging through the log files, I have evidence that some of the voices that they are taking credit for were indeed generated from my own site.|url-status=live}}</ref>
}}
{{tweet
|image = Stadot-008cf0.svg
|name = Voiceverse Origins
|username = VoiceverseNFT
|width = 450px
|date = January 14, 2022
|text = Hey @fifteenai we are extremely sorry about this. The voice was indeed taken from your platform, which our marketing team used without giving proper credit. Chubbiverse team has no knowledge of this. We will make sure this never happens again.
|reference = <ref group="tweet">{{Cite tweet |user=VoiceverseNFT |number=1482067251704434688|date = January 14, 2022 |title=Hey @fifteenai we are extremely sorry about this. The voice was indeed taken from your platform, which our marketing team used without giving proper credit. Chubbiverse team has no knowledge of this. We will make sure this never happens again.|url-status=live}}</ref>
}}
{{tweet
|image = 15.ai logo.png
|name = 15
|width = 450px
|username = fifteenai
|date = January 14, 2022
|text = Go fuck yourself.
|reference = <ref group="tweet">{{Cite tweet |user=fifteenai |number=1482088782765576192|date = January 14, 2022 |title=Go fuck yourself.|url-status=live}}</ref>
}}


Over 3 million lines were generated within the first two weeks of the September 2021 release of the application. As of February 2022, 15.ai's ] was raising over $1,100 per month despite the developer's insistence that donors should not feel obligated to donate and that the Patreon funds only cover a fraction of the server bills.<ref name="patreon"> Over 3 million lines were generated within the first two weeks of the September 2021 release of the application. As of February 2022, 15.ai's ] was raising over $1,100 per month despite the developer's insistence that donors should not feel obligated to donate and that the Patreon funds only cover a fraction of the server bills.<ref name="patreon">
Line 349: Line 378:
|access-date= 2022-02-21 |access-date= 2022-02-21
|quote= }}</ref> |quote= }}</ref>
{{tweet
|image = 15.ai logo.png
|name = 15
|username = fifteenai
|unverified = y
|date = January 14, 2022
|text = I've been informed that the aforementioned NFT vocal synthesis is actively attempting to appropriate my work for their own benefit.
After digging through the ], I have evidence that some of the voices that they are taking credit for were indeed generated from my own site.
|reference = <ref group="tweet">{{Cite tweet |user=fifteenai |number=1482055102919757835|date = January 14, 2022 |title=I've been informed that the aforementioned NFT vocal synthesis is actively attempting to appropriate my work for their own benefit. After digging through the log files, I have evidence that some of the voices that they are taking credit for were indeed generated from my own site.|url-status=live}}</ref>
|block = yes
}}
{{tweet
|image = Stadot-008cf0.svg
|name = Voiceverse Origins
|username = VoiceverseNFT
|unverified = y
|date = January 14, 2022
|text = Hey @fifteenai we are extremely sorry about this. The voice was indeed taken from your platform, which our marketing team used without giving proper credit. Chubbiverse team has no knowledge of this. We will make sure this never happens again.
|reference = <ref group="tweet">{{Cite tweet |user=VoiceverseNFT |number=1482067251704434688|date = January 14, 2022 |title=Hey @fifteenai we are extremely sorry about this. The voice was indeed taken from your platform, which our marketing team used without giving proper credit. Chubbiverse team has no knowledge of this. We will make sure this never happens again.|url-status=live}}</ref>
|block = yes
}}
{{tweet
|image = 15.ai logo.png
|name = 15
|username = fifteenai
|unverified = y
|date = January 14, 2022
|text = Go fuck yourself.
|reference = <ref group="tweet">{{Cite tweet |user=fifteenai |number=1482088782765576192|date = January 14, 2022 |title=Go fuck yourself.|url-status=live}}</ref>
|block = yes
}}


The initial partnership between Troy Baker and Voiceverse was met with severe backlash and universally negative reception. Critics highlighted the potential environmental impact of and potential for ] associated with NFT sales.<ref name="eurogamer2">{{cite web The initial partnership between Troy Baker and Voiceverse was met with severe backlash and universally negative reception. Critics highlighted the potential environmental impact of and potential for ] associated with NFT sales.<ref name="eurogamer2">{{cite web

Revision as of 19:51, 21 February 2022

Real-time text-to-speech tool using artificial intelligence
15.ai
File:15.ai logo.png
Developer(s)15
Initial releaseMarch 2020; 4 years ago (2020-03)
Stable releasev24.2.1 / September 2021; 3 years ago (2021-09)
Written inVue.js, Python, Julia
TypeArtificial intelligence, speech synthesis, machine learning, deep learning
Website15.ai

15.ai is a non-commercial freeware artificial intelligence web application that generates natural emotive high-quality text-to-speech voices from an assortment of fictional characters from a variety of media sources. Developed by an anonymous MIT researcher under the eponymous pseudonym 15, the project uses a combination of audio synthesis algorithms, speech synthesis deep neural networks, and sentiment analysis models to generate and serve emotive character voices faster than real-time, even those with a very small amount of data.

Features

Available characters include GLaDOS and Wheatley from Portal, Twilight Sparkle and a number of main, secondary, and supporting characters from My Little Pony: Friendship is Magic, SpongeBob from SpongeBob SquarePants, Daria Morgendorffer and Jane Lane from Daria, the Tenth Doctor from Doctor Who, HAL 9000 from 2001: A Space Odyssey, the Narrator from The Stanley Parable, the Wii U/3DS/Switch Super Smash Bros. Announcer (formerly), Sans from Undertale, and Carl Brutananadilewski from Aqua Teen Hunger Force.

The deep learning model used by the application is nondeterministic. The application supports English phonetic transcriptions (such as ARPABET) to correct mispronunciations or to account for heteronyms—words that are spelled the same but are pronounced differently (such as the word read, which can be pronounced as either /ˈrɛd/ or /ˈriːd/ depending on its tense). The app also supports altering the emotion of a generated line using emotional contextualizers (a term coined by this project), a sentence or phrase that conveys the emotion of the take that serves as a guide for the model during inference.

The lexicon used by 15.ai was scraped from a variety of Internet sources, including Oxford Dictionaries, Wiktionary, the CMU Pronouncing Dictionary, 4chan, Reddit, and Twitter. Pronunciations of unfamiliar words are automatically deduced using phonological rules learned by the deep learning model.

Development

15.ai was designed and created by an anonymous research scientist affiliated with the Massachusetts Institute of Technology known by the alias 15, ostensibly in reference to the minimum amount of data required to convincingly clone a voice. The project began development while the developer was an undergraduate. Although the application costs several thousands of dollars a month to keep up and maintain, the developer has stated that they are capable of paying the high cost of running the site out of pocket.

The developer has also worked closely with the Pony Preservation Project from /mlp/, the My Little Pony board of 4chan. The Pony Preservation Project is a "collaborative effort by /mlp/ to build and curate pony datasets" with the aim of creating applications in artificial intelligence. According to the developer, the collective efforts and constructive criticism of the Pony Preservation Project was integral to the development of 15.ai. During months-long hiatuses of the public release of the site in late 2020 and early 2021, a number of test sites were put up for exclusive use by /mlp/ and the Pony Preservation Project for the purposes of testing and generating content.

Reception

Avatar of 15
Avatar of 15
15 @fifteenai Twitter logo, a stylized blue bird

I've been informed that the aforementioned NFT vocal synthesis is actively attempting to appropriate my work for their own benefit. After digging through the log files, I have evidence that some of the voices that they are taking credit for were indeed generated from my own site.

January 14, 2022
Avatar of Voiceverse Origins
Avatar of Voiceverse Origins
Voiceverse Origins @VoiceverseNFT Twitter logo, a stylized blue bird

Hey @fifteenai we are extremely sorry about this. The voice was indeed taken from your platform, which our marketing team used without giving proper credit. Chubbiverse team has no knowledge of this. We will make sure this never happens again.

January 14, 2022
Avatar of 15
Avatar of 15
15 @fifteenai Twitter logo, a stylized blue bird

Go fuck yourself.

January 14, 2022

Over 3 million lines were generated within the first two weeks of the September 2021 release of the application. As of February 2022, 15.ai's Patreon was raising over $1,100 per month despite the developer's insistence that donors should not feel obligated to donate and that the Patreon funds only cover a fraction of the server bills.

Fandom content creation

15.ai has been frequently used for content creation in various fandoms, including the My Little Pony: Friendship Is Magic fandom, the Team Fortress 2 fandom, the Portal fandom, and the SpongeBob SquarePants fandom. Numerous videos created using 15.ai have gone viral on YouTube, Twitter, and TikTok. However, many videos have gone viral without properly crediting the project (as stipulated in the project's terms of service). In the absence of proper credit, copycat services have attempted to profit off the success and popularity of 15.ai by using text-to-speech algorithms significantly inferior to those used by 15.ai, prompting the developer to include a rule in the terms of service to disallow the mixing of other TTS services with outputs generated from 15.ai.

The My Little Pony: Friendship Is Magic fandom has seen a resurgence in video and musical content creation as a direct result; moreover, the project has been utilized as a creative tool in pornography. For instance, the Pony Zone videos is a series of erotic musical videos that heavily samples 15.ai as the vocals—the creators of such videos make frequent use of salacious emotional contextualizers and punctuation/ARPABET tricks to induce the models to grunt, sigh, and moan convincingly.

Troy Baker NFT scandal

On January 14, 2022, it was discovered that Voiceverse NFT, a company that video game voice actor Troy Baker announced his partnership with, had stolen voice lines generated from 15.ai as part of their marketing campaign without permission. Log files showed that Voiceverse had generated audio of Twilight Sparkle and Rainbow Dash from the show My Little Pony: Friendship Is Magic using 15.ai, pitched them up to make them sound unrecognizable from the original voices, and appropriated them without proper credit to falsely market their own platform.

The initial partnership between Troy Baker and Voiceverse was met with severe backlash and universally negative reception. Critics highlighted the potential environmental impact of and potential for exit scams associated with NFT sales. Two weeks later, on January 31, Baker announced that he would discontinue his partnership with Voiceverse.

See also

External links

References

  1. ^ "15.ai - FAQ". 15.ai. 2021-01-18. Retrieved 2021-01-18.
  2. "Twitter". Twitter. 2021-01-18. Retrieved 2021-01-18.
  3. Zwiezen, Zack (2021-01-18). "Website Lets You Make GLaDOS Say Whatever You Want". Kotaku. Kotaku. Retrieved 2021-01-18.
  4. Ruppert, Liana (2021-01-18). "Make Portal's GLaDOS And Other Beloved Characters Say The Weirdest Things With This App". Game Informer. Game Informer. Retrieved 2021-01-18.
  5. Morton, Lauren (2021-01-18). "Put words in game characters' mouths with this fascinating text to speech tool". Rock, Paper, Shotgun. Rock, Paper, Shotgun. Retrieved 2021-01-18.
  6. Clayton, Natalie (2021-01-19). "Make the cast of TF2 recite old memes with this AI text-to-speech tool". PC Gamer. PC Gamer. Retrieved 2021-01-19.
  7. Chandraseta, Rionaldi (2021-01-19). "Generate Your Favourite Characters' Voice Lines using Machine Learning". Toward Data Science. Toward Data Science. Retrieved 2021-01-23.
  8. Yoshiyuki, Furushima (2021-01-18). "『Portal』のGLaDOSや『UNDERTALE』のサンズがテキストを読み上げてくれる。文章に込められた感情まで再現することを目指すサービス「15.ai」が話題に". Denfaminicogamer. Denfaminicogamer. Retrieved 2021-01-18.
  9. Kurosawa, Yuki (2021-01-19). "ゲームキャラ音声読み上げソフト「15.ai」公開中。『Undertale』や『Portal』のキャラに好きなセリフを言ってもらえる". AUTOMATON. AUTOMATON. Retrieved 2021-01-19.
  10. Villalobos, José (2021-01-18). "Descubre 15.AI, un sitio web en el que podrás hacer que GlaDOS diga lo que quieras". LaPS4. LaPS4. Retrieved 2021-01-18.
  11. Moto, Eugenio (2021-01-20). "15.ai, el sitio que te permite usar voces de personajes populares para que digan lo que quieras". Yahoo! Finance. Yahoo! Finance. Retrieved 2021-01-20.
  12. "15.ai - Guide". 15.ai. 2022-02-20. Retrieved 2022-02-20.
  13. "15.ai - About". 15.ai. 2022-02-20. Retrieved 2022-02-20.
  14. "Twitter". Twitter. 2021-11-29. Retrieved 2022-02-20.
  15. "Pony Preservation Project (Thread 108)". 4chan. Desuarchive. 2022-02-20. Retrieved 2022-02-20.
  16. "15.ai - Thanks". 15.ai. 2022-02-20. Retrieved 2022-02-20.
  17. "15.ai is creating natural emotive high-fidelity TTS with minimal viable data". Patreon. 2022-02-20. Retrieved 2022-02-20.
  18. "She said " 👹 "". TikTok. 2020-04-09. Retrieved 2022-02-21.
  19. "SPY IS A FURRY". YouTube. 2021-01-17. Retrieved 2022-02-21.
  20. "Made with @fifteenai". Twitter. 2021-01-07. Retrieved 2022-02-21.
  21. "[NSFW 18+] Pony Zone (ft. 15ai)". YouTube. YouTube. 2020-03-14. Retrieved 2022-02-21.
  22. Phillips, Tom (2022-01-17). "Troy Baker-backed NFT firm admits using voice lines taken from another service without permission". Eurogamer. Eurogamer. Retrieved 2022-01-17.
  23. Williams, Demi (2022-01-18). "Voiceverse NFT admits to taking voice lines from non-commercial service". NME. NME. Retrieved 2022-01-18.
  24. Wright, Steve (2022-01-17). "Troy Baker-backed NFT company admits to using content without permission". Stevivor. Stevivor. Retrieved 2022-01-17.
  25. Henry, Joseph (2022-01-18). "Troy Baker's Partner NFT Company Voiceverse Reportedly Steals Voice Lines From 15.ai". Tech Times. Tech Times. Retrieved 2022-02-14.
  26. Yea, Yong (2022-01-14). "Troy Baker Faces Mass Backlash For Supporting Shady AI Voice NFTs With Company That Has Stolen Work". YouTube. YouTube. Retrieved 2022-01-30.
  27. "Twitter". Twitter. 2022-02-21. Retrieved 2022-02-21.
  28. "Twitter". Twitter. 2022-02-21. Retrieved 2022-02-21.
  29. "Twitter". Twitter. 2022-02-21. Retrieved 2022-02-21.
  30. Phillips, Tom (2022-01-14). "Video game voice actor Troy Baker is now promoting NFTs". Eurogamer. Eurogamer. Retrieved 2022-01-14.
  31. Strickland, Derek (2022-01-31). "Last of Us actor Troy Baker heeds fans, abandons NFT plans". Tweaktown. Tweaktown. Retrieved 2022-01-31.
  32. Peterson, Danny (2022-01-31). "'The Last of Us' actor Troy Baker reverses course on NFTs amid fan backlash". We Got This Covered. We Got This Covered. Retrieved 2022-02-14.
  1. @fifteenai (January 14, 2022). "I've been informed that the aforementioned NFT vocal synthesis is actively attempting to appropriate my work for their own benefit. After digging through the log files, I have evidence that some of the voices that they are taking credit for were indeed generated from my own site" (Tweet) – via Twitter.{{cite web}}: CS1 maint: url-status (link)
  2. @VoiceverseNFT (January 14, 2022). "Hey @fifteenai we are extremely sorry about this. The voice was indeed taken from your platform, which our marketing team used without giving proper credit. Chubbiverse team has no knowledge of this. We will make sure this never happens again" (Tweet) – via Twitter.{{cite web}}: CS1 maint: url-status (link)
  3. @fifteenai (January 14, 2022). "Go fuck yourself" (Tweet) – via Twitter.{{cite web}}: CS1 maint: url-status (link)
Categories: