Search Unity

IBM & Unity partner to bring the power of AI to developers with IBM Watson SDK for Unity

, February 20, 2018

IBM and Unity are launching the IBM Watson SDK for Unity on the Unity Asset Store, enabling developers to easily integrate Watson cloud services into their Unity applications such as visual recognition, speech to text, and language classification. The SDK makes it easy for developers to take advantage of modern AI techniques through a set of cloud-based services.

IBM and Unity are partnering to bring the power of AI to the Unity community

Today we are thrilled to announce a partnership with IBM to launch the IBM Watson SDK for Unity on the Unity Asset Store. This SDK is the first asset of its kind to bring scalable AI services to Unity, enabling developers to easily integrate Watson services into their Unity applications. Millions of Unity developers globally will now have access to the powerful cloud-based AI services of Watson directly within the Unity environment.

Building the future of enterprise AR and VR together

Although AR and VR are continuously being applied to the gaming industry to immerse players in virtual environments like galaxies or with geolocation environments where the activity happens on real surroundings, we are now experiencing the advancement of applying these concepts into business use cases. With VR, companies can implement employee training programs that teach workers how to perform a job in a virtual environment without any safety risks, and with AR, field workers can hold up their phone or glasses to a pipe to see if it needs to be fixed, when, and where.

As AR and VR technologies mature, there is increasing interest coming from the enterprise market for innovative applications in marketing, design, engineering, manufacturing and analysis. Unity is the market leader in AR and VR for consumer use cases, as well as rapidly emerging as the market leader for enterprise AR and VR.

Bringing data to life with IBM Immersive Insights.

With its deep AI expertise and industry knowledge, IBM also has been actively exploring the application of AR and VR with clients such as the Immersive Insights demo, which hints at the enormous potential of AR and VR in enterprise applications. Together, Unity and IBM plan to help drive the development of this market by enabling applications that bring contextual expertise and AI capabilities directly into the employee and/or end consumer’s personal and professional sphere of experience.

This partnership exemplifies IBM and Unity’s commitment to accelerating the enterprise developer journey and equipping them with the tools and resources they need to build powerful new AR and VR apps. As an official platinum sponsor for INDEX Conference, the open developer community event, we’re excited to collaborate with IBM to empower the Unity community with powerful AI-driven cloud services to help expand a new frontier of interactivity. The first step of this journey begins with the IBM Watson SDK for Unity.

IBM Watson SDK for Unity

With the SDK now available on the Asset Store, Unity developers can now configure games and projects to understand speech, talk with users, and understand the intent of a user in natural language.

One of the key features of the SDK is its powerful speech recognition capabilities. With speech services, developers have access to real-time speech recognition providing highly accurate speech recognition directly in your Unity project. Player speech can be recognized and used to trigger in-game events.IBM Watson SDK for Unity also has powerful language translation and language classification capabilities. In conjunction, both language classification and speech recognition can work together seamlessly to provide voice-driven interactivity in your Unity game.

Watch an example of how IBM teamed up with Ubisoft to give players of Star Trek Bridge Crew the ability to issue commands to NPC’s with just their voice using theIBM Watson SDK for Unity.

For developers interested in the power of AI-driven visual recognition, Watson’s Vision API provides the ability for developers to integrate real-time visual recognition within their Unity projects.Take a look at how a team of developers took advantage of theIBM Watson SDK for Unity during an IBM-sponsored Hackathon to create Watson and Waffles, a VR adventure game which requires the player to sketch game objects using the Vive controller. Using the Vision API, Watson identifies user drawings and generates corresponding 3D objects for the player to use.

For more details about the Watson capabilities available within the IBM Watson SDK for Unity you can leverage to get started, please visit:

The SDK is simple to set up and can open up your project to new levels of interactivity. Imagine a game with NPC’s powered with visual recognition technology that recognize in-game objects or even a virtual reality experience with interactions driven completely with voice commands.

Receiving access to the IBM Watson SDK for Unity is easy – simply head over to the Asset Store and download the SDK here.

You also can familiarize yourself with this short video series from IBM, which provides an overview of all of the core features of the IBM Watson SDK for Unity..

Visit the Asset Store and download the IBM Watson SDK for Unity today!


We’ve rounded up some key resources to help you get started with the IBM Watson Unity SDK:

12 replies on “IBM & Unity partner to bring the power of AI to developers with IBM Watson SDK for Unity”

Is this real life? Is this just fantasy? Caught in a landslide, no escape from reality. Look into the sky and see, I’m just a poor boi, I need no sympathy. Mama, Just killed a man, put a gun against his head, pulled my trigger now he’s dead. Mama, ohh I never meant to make you cry.

Pretty much pointless for 99.9% of Unity devs, not to mention very pricey if you actually use it. Unity could have spent more time and effort adding the most frequently ask for addons or bug fixes.

This is nice and nicer than that is with the .NET 4.6 support, most services which support .NET standard 2 will be usable in Unity. Microsoft cognitive services is an obvious one but there is many more.

Also Unity on windows already supports speech recognition but it is deeply hidden in platform specific services in the manual so many don’t know about it

Will this be able to do computer vision on live images? Or is it just for static image/video files since it needs to be ran through Watson’s servers.

Comments are closed.