本成果は,音声認識を自動化し実機ロボットと映像舞台とを連動して外国語会話学習ができるシステムを構築したこと,具体的には,大型液晶モニタの表示面を上に向け,その上で2つの実機ロボットが被験者には未学習な言語を用い,その内容が理解できるようにコントをし,被験者にコントに発話で参加させ,その発話が正しいかを判定した.判定には,スマホの音声認識機能をシステムに組み込んで用いた.また,そのシステムを用いて未学習の外国語会話が学習できることを示せたことである.
This basic outcome is the 2 followings:The first, I have made a foreign language conversation learning system based on the direct method, that consists of two small mobile robots on a stage of a large LCD monitor with using speech recognition system of a smart phone.The two robots act a play with gesture and un-learned language for a subject.The play is built so that the subject can understand it.The subject joins the play by uttering some of un-learned language words.The system judges whether the utterances are suitable or not.The second, I showed some examples that subjects can learn foreign language conversation with using the system without using his/her any known language.