New AR app will translate in real time

NTT Docomo has started a service that lets you translate words in real time using an Augmented Reality (AR) app on your smart phone. The service is called Utsushite Honyaku. Its a service that has been offered as a trial version only but is now ready for full commercial use. Not only can it translate menu items but also signs. Currently it can translate Japanese, English, Korean and both traditional and simplified Chinese.

For example, suppose you visit Korea, and you can’t read signs in Korean at all. You can start up this app, select the Korean dictionary, and use it just by pointing your smartphone’s camera at the writing you can’t read. The translation is shown over the Korean text, so when you use this app, it feels as if you’re looking at a sign in Japanese.

This service doesn’t use cloud translation, so instead, the app itself and the dictionary are downloaded to the phone. This means it can be used for free, without having to access the mobile network.

There are 2 ways to have the translation show: one is directly on the item you are translating and the other is shown on a different window is list form. Other languages such as French, German, Indonesian, Italian, Portuguese, Spanish and Thai will be added later in November.

This is great for any visitor of those country listed. It will help those that want to visit the country but not able to afford translators or just shy to ask people. Either ways it is a good way to use AR technology. This is one of the best ways I have seen it used.

Check out the video below to see it in action.