Understanding Ultra-Low-Latency Communications

Blog · Latency

Understanding Ultra-Low-Latency Communications

What ultra-low-latency communications actually means, how it's measured, and where the engineering trade-offs live for the applications that depend on it.

Lasse Johnsen
Lasse JohnsenCo-founder & CTO, TimeBeat
7 min read
LatencyULL

TL;DR

  • Ultra-low latency means different things in different industries — single-digit microseconds in HFT, single-digit milliseconds in 5G URLLC, sub-frame in broadcast IP video.
  • The common thread is that the application's value depends on responding to an event as quickly as possible after observing it.
  • Precision timing is the substrate underneath any honest latency engineering — without it, you can't measure what you're optimising.

What ULL actually is

Ultra-low latency is a fuzzy term that means different things in different industries. In high-frequency trading it means single-digit microseconds end to end — the time between an order packet entering the trading system and the matching engine processing it. In 5G URLLC it means single-digit milliseconds — the radio-to-radio latency for safety-critical wireless control. In broadcast IP video it means sub-frame latencies — the time between a camera capture and the broadcast feed showing the captured image. In each case the absolute latency targets differ, but the common thread is that the application's value depends on responding to an event as quickly as possible after observing it.

The engineering work to achieve ULL is similar across industries: dedicated low-latency hardware (FPGA-based processing, hardware-timestamped NICs, kernel-bypass networking), optimised software stacks (lock-free data structures, latency-aware scheduling, careful memory layout), and infrastructure that's engineered specifically for the latency requirement rather than for general-purpose throughput.

Where time fits in

Latency measurement requires precision timestamps at both ends of the path being measured. Without PTP-grade synchronisation between the measurement points, the latency you measure is dominated by the clock skew between the measurement clocks rather than by the actual network behaviour. A latency measurement reported as "5 microseconds" means very different things if the measurement clocks are synchronised to 100 nanoseconds versus to 10 microseconds. Precision timing is the substrate underneath any honest latency engineering.

This is one of the underappreciated reasons why ULL applications adopt precision timing infrastructure even when the application itself doesn't strictly need synchronised clocks. The latency optimisation work depends on being able to measure what's being optimised, and the measurement depends on synchronised clocks at the precision tier of the latency target. HFT firms run hardware grandmasters partly for compliance and partly because they couldn't measure their own latency optimisation without them.

Frequently asked questions

What is ultra-low latency?+
A fuzzy industry term that means different things in different contexts: single-digit microseconds in HFT, single-digit milliseconds in 5G URLLC, sub-frame in broadcast IP video. The common thread is that the application's value depends on responding to an event as quickly as possible after observing it.
Why does ULL need precision timing?+
For two reasons. First, latency measurement requires synchronised clocks at the precision tier of the latency target — without them, you can't accurately measure what you're optimising. Second, many ULL applications (HFT, broadcast IP video, distributed databases) inherently depend on coordinated event ordering across systems, which requires synchronised clocks.

Talk to us

Got a time-sync question like this in your network?

Book a 30-minute call with a Timebeat engineer — we will tell you which products fit, what the install looks like and what it would cost.