Research->Media Art->Musical Robot->Buddy-kun    

introduces a communication robot.




  Buddy-kun is a robot that talks with everyone, instructs and guides singing and gymnastics, and plays musical instruments in kindergartens and nursing homes.
It can't have very advanced conversations, but it takes advantage of AI and use speech recognition and speech synthesis to join the chat circle.
You can get information about your daily life.
It plays a leading role in recreational activities.
It can also play musical instruments.
It can ring the bell from the note C to the note A using both hands.
Multiple units can work together to play songs with a wider range.
The three units work together to ring the bell from C to upper G.
When the four units work together, can add semitones such as F Sharp and G Sharp to play a tune.
Buddy-kun has a mechanism for communicating with people and playing music on multiple units.
Devices such as a 3D camera, microphone array, and speakers are connected to a small PC carried on the back.
It also has nine servo motors to move its head and arms.
It can express emotions by devising the lighting pattern of the LEDs.
Realsense has the function of measuring the distance to an object in addition to the function of a normal camera, and is used to recognize objects and faces.
A re-speaker is a microphone array that can identify the direction of sound and remove ambient noise and self-generated sound.
A field of AI called machine learning is used for object recognition and programs that compose conversations.
Programs that control sensors and motors are integrated on the OS for robots called ROS.
Normally, Buddy-kun works independently, but If multiple units perform an ensemble, they must be connected to one PC and synchronized.
It uses software developed specifically to send commands to each robot connected by a cable.
When the program loads a music file in MIDI format, it is converted into motion data for each robot and sent out at the right time.
They can play chords by letting two robots hit the bell at the same time.
Acrylic is used as the material for the frame of the robot.
Parts are designed with CAD software and cut with a laser cutter.
Cube-shaped metal fittings are used for assembly.
Power is supplied from a mobile battery using a USB cable.


  Name Buddy-kun  
  Birth day 2021, September  
  Birth place Keihana Science city  
  Favorite things Greeting  
  Hate Things    
  respected person Softbank peppar  
Height  33cm
Hardware information

It is powered by a 5V output USB mobile battery.

Controller RCB-4
Arduino UNO
Servo motor
(Extention 9)
aluminum frame

2022 Nara Pref. Nursing care award A group home that has introduced Buddy-kun won the Nara Nursing Care Award as an example of using robots for recreational activities.
Amazing Maker Awards 2022 3rd prize in social impact category (The award is under name the co-developer of middle school classmate.)