Vocal Synth - Tumblr Posts

1 year ago

well i wasnt expecting to see a scientific essay on vocaloids and AI, but this is surely welcome!

A long infographic with visual aids starting with the conversation:
"Is Miku AI?"
"No."
"Are vocal synths ethical?"
"Yes."
"How so?"
First section is Compensation.
Hatsune Miku is made out of recordings by Saki Fujita. Saki Fujita is contracted to record Miku samples, and is paid for her work.
Section: Recording Method. 
This is why Miku is not AI: Saki Fujita records from a list of sounds. It's necessary to have at least one recording per sound Miku should be able to sing. (Visual aid has examples of these sounds, such as "kaka".)
She can also sing the recording list a second time in a different octave, so that she sounds more natural. 
Section: Labelling. 
The samples Saki Fujita sung are then labelled with what sound they make. These sounds are then reproduced by the engine. This is how Vocal Synth software such as VOCALOID and UTAU work. This model is called "concatenative". (Visual aid shows how "kaka" is split into "k" and "a", which is how it looks in the VOCALOID software.)
Section: User interfacing.
These voicebanks are very flat. Users must adjust the vocals themselves in order to produce singing. This is referred to as "tuning". If you listen to "Tuning BLANK in the style of Vocaloid producers", you can see there are countless ways to tune Hatsune Miku. It is considered a form of artistic expression. 
Compare Scratchin' Melodii's original songs to the updated versions. This is the result of hiring an experienced Vocaloid tuner.
Question: How do AI Vocal Synths work?
Answer: They are actually extremely similar!
Section: Compensation.
Let's use the Synthesizer V Studio library "Solaria". Solaria is made out of recordings by Emma Rowley. Emma Rowley is contracted to record Solaria samples, and paid for her work.
Section: Recording.
Emma Rowley then records several hours of singing data. This is the substance of the library.
Section: Base model.
The AI needs a base to understand what it's interpreting. Unlike images, there is a large amount of volunteer voice data out there. It's typically assumed that base models are trained ethically. (Visual aid shows Dreamtonics, the developer company behind Synthesizer V, asking a university "Can I use this voice data you made for TTS research?" and observing a person saying "Hi! Here is a few hours of singing data you can use for voice technology.")
Section: Labelling.
Labelling is also the same. The singing is broken up into phonemes the engine will interpret. 
Header Section: Deep Learning.
In casual speech, "AI" refers to computer learning/sorting algorithms. "Diffusion" AI is the result of DNN; Deep Neural Network. It is the most drastic difference between concatenative and AI voicebanks.
Section: Teaching the base model.
The computer must be taught what the sounds are. The concept it builds is the "base model". (Visual guide is a cartoon of two computers talking. "Here's a british man saying 'bath'." "Added to my concept of 'a'." "Here's a Japanese girl saying 'baka'." "Added to my concept of 'a'.")
Section: Training the voice model.
Emma Rowley's recordings are then made into a reference point. This will make it so it will only render based on what it knows about Emma Rowley's singing. (Visual aid is a similar cartoon where a person talks to a computer while giving it a drive. Computer: "Now that I know what 'a' is, how should it sound?" Person: "I've labelled every time Emma Rowley says 'a'. Use this!")
Section: Diffusion.
The Solaria model uses everything it learned from Emma Rowley's recordings and the base mdoel to determine how 'a' sounds based on what note it's sung on, what's next to it, etcetera.
Section: Interfacing.
Tuners have been mixed on this; it sounds much clearer, yet the AI also has voice pitch models, so there's not as much as an incentive to develop your own personal flair.
Question: Are voice changers ethical?
Answer: Oh geez.
Section: ARE they ethical?
We don't need to break this down a third time. Voice changers are the generative AI of voice synthesis. It requires a lot less work of both the developer and the user, a simple applicator of everything the machine knows onto a piece of audio. What are the ranges of ethics?
Vocaloid 6 is packaged with a voice changer. It is only for AI libraries, voiced by people who agreed to this and were compensated. This is definitely ethical.
If you bought Hatsune Miku, you're nominally permitted to use the results as you see fit. Is tuning Miku and then creating a voice changer of her singing ethical? I genuinely don't know.
There's also a question of art. If you were to project the voice actor onto your own personal tuning work, isn't that still artistic expression? A voice is different from an art style. Where is human expression being interrupted by automation? I can't make an explainer for those subjective concepts.
I hope you're now educated enough to think on it yourself. End of image transcription.

A lot of people try to explain this without knowing anything about how voice synthesis works, so here's my breakdown on No, Hatsune Miku Is Not AI, And No, AI Voice Synthesis Is Not Bad.


Tags :
2 years ago

MARETU (Gokuaku-P) playing マインドブランド "Mind Brand" on a guitar.


Tags :
2 years ago

MARETU playing "Bonetrousle" From UNDERTALE on his guitar


Tags :
2 years ago

karaowattehanasou.neocities.org Hello, if you are a fan of vocaloid-p MARETU (Gokuaku-P) please can I have your attention. In 2016, a CD Campaign for the Coin Locker Baby Album was released through muevo, and on that CD, there was an additional unreleased song by the name of Kara Wo Watte Hanasou. I am looking to get in touch with those who have a copy of the song. Please use the link to contact me about it's whereabouts, as it is currently lost media. My email is included on the website linked. You can also contact me here on tumblr (I'm not entirely sure how it works, I am new to posting on this platform) Thank you for your cooperation.


Tags :
2 years ago

MARETU Playing Slit Your Guts by Cryptopsy


Tags :
2 years ago

Hello, for those who reblogged my last lost, here is the clip of the song which we currently have. The video is a preview from MARETU. There also exist full lyrics for the song, which were taken from MARETU's website, you can find them linked here. (thank you to VocaDB) Thank you for your interest and support.


Tags :
2 years ago

Karimono Kyoku [Meledy]


Tags :
2 years ago

Snippet - July 2019


Tags :
2 years ago

April 2019 - Snippet.


Tags :
2 years ago

HERE is what the CD looks like, by the way (photo from an old mercari listing [SOLD])

HERE Is What The CD Looks Like, By The Way (photo From An Old Mercari Listing [SOLD])

karaowattehanasou.neocities.org Hello, if you are a fan of vocaloid-p MARETU (Gokuaku-P) please can I have your attention. In 2016, a CD Campaign for the Coin Locker Baby Album was released through muevo, and on that CD, there was an additional unreleased song by the name of Kara Wo Watte Hanasou. I am looking to get in touch with those who have a copy of the song. Please use the link to contact me about it's whereabouts, as it is currently lost media. My email is included on the website linked. You can also contact me here on tumblr (I'm not entirely sure how it works, I am new to posting on this platform) Thank you for your cooperation.


Tags :
2 years ago
【初音ミク】のどが渇く【REMIX】
ニコニコ動画
【初音ミク】のどが渇く【REMIX】 [音楽・サウンド] Original:sm6274429

【初音ミク】のどが渇く【REMIX】


Tags :
2 years ago

hello

here is an archival blog for maretu https://mrt01.blog.fc2.com i recently restarted it because my old one had issues- though i still have all of the files

if you’re curious about the name/google account linked to the files- it’s not me it’s an online friend.


Tags :
2 years ago
maretufan01 - MARETUFan01

MARETU -> プロセカ!!!!!!

やった!!!!!!


Tags :
1 year ago
7/24 3DMV 脳内革命ガール_哔哩哔哩bilibili
m.bilibili.com
简介:https://www.youtube.com/@pj_se;更多实用攻略教学,爆笑沙雕集锦,你所不知道的游戏知识,热门游戏视频7*24小时持续更新,尽在哔哩哔哩bilibili 视频播放量 19131、弹幕量 102、点赞数 822、投硬币枚数 35、收藏人数 378、转

3DMV 脳内革命ガール ー VIVIBUS x MARETU!


Tags :
1 year ago

Hello, this blog has been reinstated by tumblr (something I did not expect)

I can’t believe in the few weeks I was gone maretu released a new song! If you haven’t heard it by now, please check it out!


Tags :
1 year ago

Hello fans of MARETU This blogs asks and submissions are open Other fans of MARETU may submit posts for me to post onto the blog. Submit posts by clicking on my blog, the three dots, and hitting "Submit" Thank you


Tags :
9 months ago
They Say Her Hungers A Problem ^p^

They say her hungers a problem… ^p^

Uuhhhh for goretober, first day cannibalism! Ima mix and match lists this year ,, let’s see how far I get


Tags :