Jump to content


Photo

Could voice synthesis help polish the mod?


  • Please log in to reply
8 replies to this topic

#1 codebrah

codebrah
  • Members
  • 5 posts

Posted 02 November 2022 - 09:08 PM

I've been messing around with some machine learning stuff, and I found out that you can create new EVA lines with some of the new voice models. 

 

For example: "Warning. Enemy Mental Omega Device detected."

 

https://vocaroo.com/1eZX7msAfXRU

 

A lot of the missions had to reuse the same small set sound barks from the game's files - I can hardly count the number of times I've heard the game say "Enemy armor battalion detected." As an added bonus, the intro lines could also be voiced. For example, imagine seeing this:

 

ieE7GA.jpg

 

And hearing this: https://vocaroo.com/1lHYJCYpHbtT


Edited by codebrah, 02 November 2022 - 09:15 PM.


#2 Speeder

Speeder

    #ControlMOre

  • Hosted
  • 8,992 posts
  • Location:Czechia
  • Projects:Mental Omega
  •  Mental Omega Creator

Posted 11 November 2022 - 09:25 AM

Yeah, I think so. I've heard some other examples before for the support powers and superweapons - out of which I'd definitely like to implement ones for the minor and major supers.

f anyone's experienced enough with this and would like to assist - let me know.


mainbanner.jpg
bt_left.pngbt_fb.pngbt_yt.pngbt_tw.pngbt_md.pngbt_right.png
115776.png


#3 Revan0123

Revan0123
  • Members
  • 99 posts
  • Location:United Kingdom
  •  Former Sith Lord who's stuck on earth, playing Video Games :P

Posted 18 November 2022 - 03:07 PM

I made an example of how it can be finalized here: https://www.youtube....h?v=aFtTa1IoIVA

 

Please keep in mind that this was done through a video editor, I have no clue about how to do mapping or modding. I just had some free time to synthesize some AI lines.

 

A Behind The Scenes screenshot can be found here: https://imgur.com/a/zrEBPhu



#4 codebrah

codebrah
  • Members
  • 5 posts

Posted 11 December 2022 - 02:43 PM

Yeah, I think so. I've heard some other examples before for the support powers and superweapons - out of which I'd definitely like to implement ones for the minor and major supers.

f anyone's experienced enough with this and would like to assist - let me know.

 

I could give it a shot. The generator I used works best with tuned prompts (occasionally phrased phonetically), which don't deviate too strongly from the text that's already in the game, so it may falter for longer, more elaborate exposition. Superweapon callouts and one-offs (like the first line linked above showing up in the first Allied mission featuring the MO device) are probably the strongest use-case for that tech. Let me know which lines you'd like to hear, and I'll have a go at them.

 

Alternatively, I could look into other models. I've heard friends talk about more advanced ones, but they take a bit of doing to get working.



#5 Speeder

Speeder

    #ControlMOre

  • Hosted
  • 8,992 posts
  • Location:Czechia
  • Projects:Mental Omega
  •  Mental Omega Creator

Posted 13 December 2022 - 09:01 AM

Well, let's try to cover the new Foehn superweapons and Rage first.

 

WARNING - Blast Furnace detected!
WARNING - Blasticade activated!
Blasticade ready.
WARNING - Tempest Architect detected!
WARNING - Great Tempest created! /or/ WARNING - Tempest Architect activated!
Great Tempest ready.
WARNING - Rage Inductor detected!
WARNING - Rage activated!
Rage ready.

mainbanner.jpg
bt_left.pngbt_fb.pngbt_yt.pngbt_tw.pngbt_md.pngbt_right.png
115776.png


#6 codebrah

codebrah
  • Members
  • 5 posts

Posted 14 December 2022 - 11:22 PM

Sure. Links below:

> WARNING - Blast Furnace detected!
https://vocaroo.com/1coMplhynpQP

> WARNING - Blasticade activated!
https://vocaroo.com/1hCSYk8KNwus

> Blasticade ready.
https://vocaroo.com/12aHUcRK2QzH

> WARNING - Tempest Architect detected!
https://vocaroo.com/1f0Zs5owuA0s

> Great Tempest created!
https://vocaroo.com/16gZ4pBTFq3I

> (alternate) WARNING - Tempest Architect activated!
https://vocaroo.com/1npgs9XE5X25

> Great Tempest ready.
https://vocaroo.com/12LCsqTwSdY2

> WARNING - Rage Inductor detected!
https://vocaroo.com/1ku22pctbIKm

> WARNING - Rage activated!
https://vocaroo.com/1RiODB6EZV89

> Rage ready.
https://vocaroo.com/1mPImT0zokl8

Any suboptimal results can be retried a few times - it takes a little while to load new ones, but if the delivery doesn't feel right on one or more, that's easy enough for me to fix. It's a stochastic process, so there's always the possibility of a better roll. If these results seem largely alright, there's support for the two other communications officers.

> WARNING - Tempest Architect activated!
(Zofia) https://vocaroo.com/1gcMaAvy1ClA
(Yuri's comms officer) https://vocaroo.com/196gfFnr2rkR

Also, the Red Counter Strike dev seems to be experimenting with this as well. He tried the EVA voice in a recent video, and noticed the same issues I did - seems to be using a different voice with more training data now as a temporary measure. May be worth keeping an eye out, in case he discovers something (or sharing a better model, if I'm able to locate one).


Edited by codebrah, 14 December 2022 - 11:32 PM.


#7 Speeder

Speeder

    #ControlMOre

  • Hosted
  • 8,992 posts
  • Location:Czechia
  • Projects:Mental Omega
  •  Mental Omega Creator

Posted 18 May 2023 - 09:27 AM

Have you tried doing these with the other EVA announcer voices?


mainbanner.jpg
bt_left.pngbt_fb.pngbt_yt.pngbt_tw.pngbt_md.pngbt_right.png
115776.png


#8 Ezikell

Ezikell
  • New Members
  • 2 posts
  • Location:Philippines
  •  PsionicPsychic

Posted 28 May 2023 - 06:45 AM

Man that's really cool. I wonder if the same can be done for Yuri's voice?

IEq6Hid.jpg


#9 codebrah

codebrah
  • Members
  • 5 posts

Posted 08 June 2023 - 12:46 AM

Have you tried doing these with the other EVA announcer voices?

Yep - Examples on the bottom of that post. I've tried other lines, and they seem to be roughly on par with the Eva voice. The tech's advanced since I made the original post, so it might be possible to get meaningfully better performance with some dedication.






0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users