3D Monitoring System

Background

The project aims to develop a digital twin of Hyundai's advanced manufacturing plant in Singapore. This involves monitoring automated industrial robots and Autonomous Mobile Robot(AMR)s responsible for car assembly via a 3D system. The digital twin enables real-time operation observation on a large control center screen.

Hyundai Motor operators want to oversee the operations of a seven-story manufacturing factory in Singapore from the Digital Control Center. The control room is equipped with a 4 x 2 configuration of 4K monitors. The Unity project team developed digital twin software for the factory to monitor the entire operations on these displays.

High-Fidelity UI Design

I designed the high-fidelity UI in Unity's 3D world space using Figma, based on the client's requirements, and ensured that the design met their expectations through regular design reviews with the client.

Flow Diagram

Creating detailed interaction flows and guidelines with screens.

Challenges

The following are the main challenges:

(1) Visualize information about each robot

(2) Monitor Key Performance Indicator data

(3) View the entire assembly floor as well as cells to observe the 3D models in action

(4) Detect errors in real-time

Design Solutions

1 Floating Autonomous Mobile Robot(AMR) & industrial robot information panel

2 The on-screen KPI panel is always displayed under the header

3 Navigate from the Top down view to the Perspective view

4 Error state indicators

Takeaways

Knowledge of 3D spaces and the Unity engine was necessary. I learned about interacting with objects moving in the 3D world and how to represent 2D UI elements within a 3D space. Additionally, I had the opportunity to explore navigation ways for monitoring the 3D world.