Home Knowledge Base Precision

Precision in metrology is the closeness of agreement between repeated measurements of the same quantity under the same conditions — measuring how consistently a semiconductor metrology tool reproduces the same result, independent of whether that result is accurate (close to the true value).

What Is Precision?

Why Precision Matters

Types of Precision

Precision Requirements in Semiconductor Metrology

MeasurementTypical Precision (3σ)Specification Tolerance
CD (SEM)<0.5nm±2-5nm
Overlay<0.3nm±2-5nm
Film thickness<0.1nm±1-5%
Wafer flatness<1µm±5-50µm
Temperature<0.5°C±2-5°C

Improving Precision

Precision is the foundation of reliable process control in semiconductor manufacturing — without precise measurements, even the most sophisticated SPC systems and process control algorithms cannot distinguish real process changes from measurement noise.

precisionmetrology

Explore 500+ Semiconductor & AI Topics

From EUV lithography to CUDA optimization — search the full knowledge base or chat with our AI assistant.