I tried Vtuner that can be played easily and can be used in the future, and can operate an avatar with JINS MEME.

Aiwear brand JINS has renewed the smart glass "JINS MEME" this fall.It has been released as a model that can do "self -care for heart and body".On December 1st, the application "VTUNER", which allows you to enjoy JINS MEME for entertainment applications, appeared.I asked Jins' development staff about these good ways to enjoy.

A controller app that can operate an avatar with glasses

JINS MEME detects the movement of the eyes and body using multiple sensors built into the main unit.It is a device that allows you to visualize the sitting position, walking posture, mind condition, concentration, etc. with your own algorithms into the dedicated application "JINS MEME App".From October 14, it has been launching at JINS MEME dealers and JINS online shops, which are available at 100 stores nationwide.The price is 19,800 yen (tax included) for the JINS MEME itself, and the application fee for the first year is free.

Vtuner is an iOS -only free app that can be enjoyed like a simple avatar controller, reflecting the information obtained using the sensors built by JINS MEME in the avatar body and pupils displayed on the iPhone screen.

According to Jinds Ryosuke Tamura, who is in charge of Vtuner's planning and development, the concept of an application that adds entertainment function to JINS MEME has risen about two years ago."It is a controller application that makes it easy to enjoy using the functions of Aitracking and motion tracking by JINS MEME sensors, and can be easily enjoyed without realizing that you are shooting while operating an avatar with glasses outdoors.If you don't have it, please play by placing an avatar on your iPhone and uploading an avatar to SNS. "

Avatar can be moved by stacking an avatar on photos and videos taken on the iPhone

To use, attach the JINS MEME connected to the iPhone and Bluetooth, and then start the Vtuner application.

Vtuner has two avatars in addition to the official character Hitomimikoto.When the connection with JINS MEME is completed on the app, you can immediately see that the avatar is responding to the user's head and eye movements.

↑ When JINS MEME moves, it is quickly reflected in the avatar operation on the screen.Avatar faithfully reproduces the information of the blinker acquired by the eye -potential sensor.

The three -point optical sensor equipped by JINS MEME catches blinking and eyeballs.Then, the 6 -axis motion sensor detects the operation of the user wearing JINS MEME.The movement of the head around the neck, or the movement of the torso centered on the waist is reflected in the avatar.In addition, the audio picked up with the iPhone microphone automatically synchronizes with the movement of the avatar's mouth.

In addition to the expression of the avatar, there are multiple presets that express the actions of hand and body, and tap the selector displayed on the application screen to switch.

The "background" of the avatar displays the image captured by the iPhone camera, and taps the recording icon of the app as it is to include a video that reflects the movement of JINS MEME users in the avatar.In the background image of the app, it is also possible to read and place photos and videos taken in advance.

You can also select a preset from "Create Avatar" for avatars.Although it is a custom -made avatar, it does not allow you to freely change your hairstyle and clothes.If you want to move your original avatar with a VTuner app, you can also use the avatar data created in VRM into the app.

I made a video with the Vtuner app

I also made a very simple video using Vtuner.

The position and size of the avatar can be fine -tuned on the screen.After that, read the photo stored in the iPhone photo application from the menu at the top right of the screen, and tap the recording button for the Vtuner application.

If you zoom in an iPhone out camera, the zoom -in display of the background image will be linked.

In the video, I tried to blame the audio commentary on the “parfait” selected as the subject.The voice of the iPhone's built -in microphone can be recorded neatly, but if you shoot on a lively outdoors, it is convenient to have an external accessories, such as a pin microphone that can be directly connected to the iPhone.

The videos taken are stored in the iPhone photo folder, so you can easily upload them to YouTube or SNS.

↑ I tried to create a sweets introduction video as a trial.Avatar's mouth movements synchronize with the voice of the iPhone's microphone picked up

I think Vtuner is very good as a free app that anyone can easily play with avatar.If you have JINS MEME, you can operate the avatar, but some functions are available without JINS MEME.For the time being, I think you may want to put an app on the iPhone and try it for free.

Functions and usability will be brushed up further

Vtuner is an application released in a beta -based position as the first installment of JINS MEME Lab, an experimental project centered on JINS MEME.Perhaps because of that, if you zoom in the camera of the iPhone into a distant subject, the screen will be temporarily hardened, or the recording must be paused each time a telop is inserted into a video, so it is a little difficult to use for the user interface.There are some places that remain.

Mr. Tamura of Jinds said, "Thanks to you, we have received a lot of feedback since the release of the Vtuner application. We added functions and improvements in user interfaces, and added them by software update from those that can be handled.I want to go. "

For example, if the user keeps speaking out, the avatar will not stop with the mouth open, so we plan to add a function to fix the avatar in the state of Aiueo and record screen capture.It seems to be.In addition, "The process of adding free VRM -format avatar files is complicated, so I would like to form a partnership with a service provider that provides platforms and add a function to search and download new free avatars from the Vtuner app."Tamura says.It seems that both will be implemented as new functions due to updates.

Since the launch of the Vtuner app on December 1, it seems that there has been a good feedback on JINS MEME and good feedback on sales.

I tried Vtuner and enjoyed it as a single creative app.More than that, if the avatar can be displayed in the classic communication application of the WEB conference and the distribution application of the game commentary in the future, and the presentation on the screen can be operated by JINS MEME, the possibility of expanding the use of use is expanded.felt.

By the way, as the second installment of JINS MEME LAB, it seems that "Controller", which reflects the movements of the eyes and head acquired by JINS MEME in the operation of the mouse pointer on a device paired with PCs and smartphones, is also progressing.。I'm looking forward to how the unique smart glass will evolve in the future while connecting with the groundbreaking software.

[Photo gallery] * You can view it by tapping the image.It cannot be viewed from some SNS.