Digital Gauge Frequently Asked Questions
Question number FAQ-0081
Instruction accuracy and resolution
Instruction Accuracy
This refers to the measurement error of the linear gauge sensor. For each specified measurement value, the error (the difference from the true value) is measured, and the sum of the absolute values of the maximum positive and maximum negative errors, when viewed over the total length of spindle movement, represents the indicated accuracy of that gauge sensor.
![]() |
The accuracy measurement is conducted by comparing it with a reference displacement gauge, and the error is defined as the difference between the reading value when the minimum position digit of the measured sensor changes and the value of the reference displacement gauge. This is why a sensor with a resolution of 10 μm has an indication accuracy of 3 μm, which is below the resolution.
![]() |
Resolution
This refers to the minimum reading value of a linear gauge sensor. For example, in the case of the linear gauge sensor GS-1730, the minimum reading value is 10 μm.
Last updated date: 2026-07-15

