yousan
KoeAct-JP (Japanese speech straight to robot actions)
A 2.59M-parameter model that turns Japanese speech into action calls (Action JSON) with no transcript in between. It runs on a PC CPU and on an M5Stack CoreS3 (ESP32-S3) with no cloud.
Unity × Voice × AI Characters
I work as a Unity engineer in mobile game development, and as an ML engineer for speech synthesis (TTS) building AI characters and voice dialogue services. I specialize in on-device Japanese TTS, voice dialogue, and Unity integration.
- Speech AIBuilt piper-plus, a lightweight Japanese TTS, and uPiper, its Unity library (GitHub ★240). 56 models published on Hugging Face
- AI charactersBuilt uDesktopMascot, an open-source desktop mascot (GitHub ★359), and Mira, an AI character that talks with viewers on YouTube
- Games & communityGame development in Unity, and organizer of the Generative AI Nandemo Exhibition (vol.1–6 since 2024, over 5,000 visitors in total)
Speech AI & Microcontrollers
Japanese TTS, speech recognition, G2P and pitch accent, and speech-to-speech dialogue — from model training and Unity / C# integration to small models that run entirely on microcontrollers such as the ESP32-S3.
Ralomi (Japanese speech recognition on a microcontroller)
A 2.05M-parameter speech recognition model that turns Japanese speech into hiragana, running entirely on an M5Stack CoreS3 (ESP32-S3) with no PC or network.
JapaneseTinyAgentLM (Japanese tool calling on a microcontroller)
A 3.15M-parameter Japanese language model that runs entirely on an ESP32-S3 and turns Japanese requests into robot action calls (JSON).
sanoTTS-jp (Japanese TTS on a microcontroller)
A 559K-parameter Japanese TTS that synthesizes faster than real time entirely on an ESP32-S3, including on-device reading and pitch-accent estimation for kanji text.
kodama-ja-streaming-small
A Japanese streaming ASR model adapted from the English streaming model moonshine-streaming-small.
piper-plus / uPiper
piper-plus, a lightweight Japanese-capable TTS, and uPiper, a library for using it from Unity.
AI Characters
AI characters that combine voice dialogue with character expression, such as desktop mascots and conversational apps.
uDesktopMascot
An open-source, user-customizable desktop mascot.
Developing the AI character "Mira"
An AI agent character that picks up YouTube comments and keeps the conversation going.
AI × Game Development
Game development in Unity and games and prototypes with generative AI built in. Organizer of a generative AI exhibition.
Oblivion Maiden
An exploration adventure set in a hidden magical academy, where I joined as PM / director.
Planning and running the Generative AI Nandemo Exhibition
I organize the Generative AI Nandemo Exhibition, a demo event for individual creators building with generative AI, and handle its planning and operations.
Geranium
An ADV game set in a flower shop where you make bouquets (July to November 2023).
Tools & Community
Libraries for Unity, development infrastructure, and community work.
Community management (MidraLab)
Running MidraLab, a community for proofs of concept and technical validation shared publicly.
uni-master-linker
A library that makes Google Sheets master data easy to use in Unity.
easy-adv
A library that makes building ADV games in Unity easier with Fungus and Google Sheets.
Open work
669GitHub stars (own repositories)
438Public GitHub repositories
56Hugging Face models
36Hugging Face datasets
As of 2026-11-13