Skip to main content

Select your region & language

Global

Region

Digital Gauge Frequently Asked Questions

Question number FAQ-0081

Instruction accuracy and resolution

Instruction Accuracy

This refers to the measurement error of the linear gauge sensor. For each specified measurement value, the error (the difference from the true value) is measured, and the sum of the absolute values of the maximum positive and maximum negative errors, when viewed over the total length of spindle movement, represents the indicated accuracy of that gauge sensor.

The accuracy measurement is conducted by comparing it with a reference displacement gauge, and the error is defined as the difference between the reading value when the minimum position digit of the measured sensor changes and the value of the reference displacement gauge. This is why a sensor with a resolution of 10 μm has an indication accuracy of 3 μm, which is below the resolution.

Resolution

This refers to the minimum reading value of a linear gauge sensor. For example, in the case of the linear gauge sensor GS-1730, the minimum reading value is 10 μm.

Last updated date: 2026-07-15