Skip to content

Building Real-Time Web HMIs for Industrial Robots: Our Frontend Architecture

In industrial automation, traditional robot teaching pendants rely on proprietary legacy screens. At Mujin, we replaced dedicated hardware screens with high-performance, web-based Human-Machine Interfaces (HMIs) running directly on modern browsers.

  1. Sub-10ms Latency Requirements: Teleoperating an industrial robot arm requires instant visual feedback without frame drops.
  2. Heavy 3D Render Workloads: Visualizing real-time point clouds, robot joint angles, and safety zones.
  3. Cross-Platform & Offline Reliability: Operating reliably on warehouse touch monitors, tablets, and ruggedized industrial hardware.

Binary WebSocket Protocol

We stream compact binary buffers for joint telemetry, reducing JSON parsing overhead by 85%.

Canvas & Three.js Engine

Custom 3D viewport rendering joint transformations at 60fps directly in the browser canvas.

We are currently building automated canvas snapshot tests and micro-frontend modules for our next-generation warehouse cockpit. Check out our open roles on the Mujin OS Frontend Team page!