Unity3D for Robotics and Human-Computer Interaction

Unity3D App Development and Intel RealSense

Softeq has the skills for building solutions that feature gesture tracking, object or face recognition, and other human-computer interaction capabilities. Employing a set of Unity3D developer Toolkit’s scripts, prefabs, and other utilities from Intel RealSense SDK, the team cuts coding time and ensures a faster rollout.

We reach the RealSense SDK directly from the C# code to incorporate standard elements of Unity3D scenes into RealSense simulation apps and augment the supporting elements. Softeq will leverage the Unity3D + Intel RealSense combination to unlock an advanced feature list for your solution.

  • HAND AND POSE TRACKING
    Gesture control
  • OBJECT TRACKING
    2D/3D, feature/edge-based methods
  • BACKGROUND REMOVAL
    Digital green screen and image segmentation, video conferencing
  • VOICE RECOGNITION AND SYNTHESIS
    Speech-to-text and text-to-speech capabilities
  • FACE RECOGNITION
    Expression, warning alerts
  • 3D SCANNING
    Modeling, scene capturing, detecting precise range
  • DEPTH ENABLED PHOTO AND VIDEO
    Object segmentation and refinement, parallax effect, refocus
  • SCENE PERCEPTION OPTIMIZED FOR AR APPS
    Environment capture, color tracking, depth tracking

Unity3D Development for Robotics

If you’re ideating a solution for the robotics space, you may well need to tap into the Human-Robot Interaction (HRI) area. Computer science, artificial intelligence, natural language understanding, engineering, design and psychology work together to make the most of the HRI field’s research and educational potential. Softeq is proud to be among the regular contributors to the domain.

Our team of software and hardware engineers can undertake a full cycle of work on your robot development project. Whether you need an out-of-the-box system created from scratch, low-level architecture design and development, or a standalone app to manage comprehensive robotics ecosystem, Softeq is ready to take up the baton at any stage.

When it comes to taking remote real-time control of robots, Unity3D stands out as an engine of our choice. Along with empowering developers to extend the core system’s functionality and build robust software and communication plug-ins for robots, it enables us to create compelling one-off GUIs and extend surroundings by developing augmented reality apps.

What Makes Unity3D That Relevant to HRI?

  • MULTIPLATFORMITY
    Allows for a platform choice, powers cross-platform solutions
  • COMMUNICATION WITH EXTERNAL HARDWARE
    Helps build executable programs running on a range of platforms
  • PLUG-IN ARCHITECTURE
    Enables robots to process multimedia sensory data, implement Microsoft Kinect gesture recognition, OpenCV computer vision, speech recognition, and text-to-speech functionality
  • USER-FRIENDLY GUI
    Ensures coherent interaction control
  • COMPATIBILITY WITH MULTIPLE 3D FILE TYPES
    Simplifies modeling process
  • THE DEDICATED HUMANOID AVATAR TOOLING
    Helps elaborate a more natural human-like body shape for robots and provides a rich library of advanced motion and behavior algorithms

Custom Robotics Solutions Development with Unity3D

Softeq shall give your solution a new competitive edge by combining our Unity development expertise with flagship robotics software, hardware, and middleware:

  • Robot Operating System (ROS)
  • Leap Motion hand tracking VR controllers
  • Blender modeling software
  • Processing IDE
  • Arduino microcontrollers
  • Festival speech synthesis system
  • USARSim simulation and visualization tooling
  • CMUSphinx speech recognition system

en