Smart Display

Overview

A smart display is a connected countertop device combining voice interaction, video calling, visual content browsing, and smart-home control on a single touchscreen. Unlike tablets designed for handheld use, smart displays are optimized for stationary placement, often on a kitchen counter or nightstand, where the user can speak queries from across the room and see responses on a large screen without picking up the device.

The Smart Display integrates a 10-inch LCD panel with an all-in-one system-on-module (SoM) containing CPU, GPU, memory, and storage; a microphone array for far-field voice capture; stereo speakers for playback; and a front-facing camera enabling video calls. All components are housed in an injection-molded plastic body that stands upright via a friction-hinged kickstand, positioning the screen at a natural viewing angle for countertop use.

How it works

The heart of the system is the Smart Assistant SoC Board, a compact system-on-module combining the AI Processor, typically an ARM Cortex-A53 quad-core processor running between 1.5–2.0 GHz, with integrated GPU for graphics rendering, hardware video decode, and machine-learning acceleration for on-device voice recognition. The SoC is paired with 3 GB of RAM Module (LPDDR4) for runtime, and 32 GB of Storage Module (eMMC) holding the operating system, pre-installed smart-assistant firmware, and cached content.

Power enters via AC mains through the Power Supply, a 30 W switched-mode power supply (SMPS) delivering regulated voltages to the SoC, display backlight, and audio amplifier. The Touchscreen Assembly houses a 10.1-inch IPS LCD panel with full 1920×1200 native resolution and integrated LED backlight providing 300 cd/m² typical brightness. The Display Driver IC converts the SoC's MIPI DSI digital video output into parallel LVDS signals driving the LCD rows and columns; a separate backlight controller regulates current through the LED array and responds to the Ambient Light Sensor for automatic brightness adjustment in varying room lighting.

Capacitive touch sensing on the Touchscreen Assembly employs the Touch Digitizer, a dedicated controller scanning 10-point simultaneous finger positions and reporting coordinates to the SoC via I²C. This enables pinch-to-zoom, multi-finger gestures, and responsive app interaction.

The Microphone Array contains four MEMS microphones strategically positioned on the housing to capture speech from multiple angles. A dedicated Audio DSP, a separate low-power microcontroller, performs beamforming in real-time, combining the four microphone signals to create a "hot-spot" of sensitivity pointed forward, and running voice activity detection (VAD) to recognize when the user is speaking versus ambient noise. Once speech is detected, raw audio is sent to the main SoC where a local voice-recognition neural network model processes the waveform, recognizing wake words and command phrases without requiring internet connectivity for initial detection.

The Camera Module is a modest 2 MP CMOS Image Sensor with a wide 90-degree field of view, suitable for capturing the user's head and shoulders during video calls. An Mechanical Shutter, a solenoid-driven mechanical blind, covers the lens when not in use, providing physical privacy assurance. When the user initiates a video call, the camera feed is encoded via the SoC's video codec hardware (H.264) and transmitted over Wi-Fi to the cloud or to another user's device.

The Audio System comprises two speakers: a 40 mm Woofer Speaker producing bass and lower-midrange frequencies, and a 20 mm Tweeter Speaker for clarity above 4 kHz. The Class-D Amplifier, a class-D amplifier IC rated 5 W per channel, drives these speakers under PWM modulation. Audio from streaming music, voice assistants, alarms, or video calls flows from the SoC to the Audio Board, which includes the codec, amplifier, and low-impedance speaker switching.

Network connectivity is provided by the Wi-Fi Module, an 802.11ac transceiver supporting both 2.4 GHz and 5 GHz bands, and the Bluetooth Module, a Bluetooth 5.0 LE radio allowing the display to pair as a remote speaker for a nearby smartphone or as a hub for Bluetooth-based smart-home devices (door locks, light bulbs, etc.).

Typical use case

A user walks into the kitchen in the morning and says, "Hey, show me the news." The Microphone Array captures the wake phrase, the Audio DSP detects speech start, and the SoC recognizes the keyword. An internet request is sent to fetch news headlines, which appear as a visual feed on the Touchscreen Assembly. The user can then swipe through articles, or say "read the headlines" to hear them aloud through the Audio System. Later, a family member calls via the display's video-calling app; the Camera Module activates, the Mechanical Shutter retracts, and the video is displayed while speaker and microphone enable two-way conversation.

Before bed, the user taps the display to adjust the bedroom thermostat or turn off lights, all controlled through smart-home APIs communicating over the Wi-Fi Module. The SoC supports local-only ("offline first") control of many devices, reducing latency and improving reliability when internet connectivity is degraded.