10.4 Resolution of measuring data
The resolution of measuring data is determined as follows according to the rating settings (phase and wire system, primary voltage and primary
current).
■ Voltage and harmonic voltage RMS
Rated primary voltage
setting
110 V to 220 V
440 V to 2200 V
3300 V to 110000 V
■ Harmonic distortion rate
1st decimal place: 0.1%
■ Electric power, power demand, reactive power, electric energy and reactive power energy
Single-phase 2-wire
W, var
: 3rd decimal place
Wh, varh : 2nd decimal place
W, var
: 2nd decimal place
Wh, varh : 1st decimal place
3-phase 3-wire
W, var
: 3rd decimal place
Wh, varh : 2nd decimal place
W, var
: 2nd decimal place
Wh, varh : 1st decimal place
3-phase 4-wire
Resolution
1st decimal place
0.1 V
Integer
1 V
x10
10 V
Primary voltage setting (V)
W, var
: 1st decimal place
Wh, varh : Integer
W, var
: Integer
Wh, varh : ×10
W, var
Wh, varh : ×100
Primary voltage setting (V)
W, var
: 1st decimal place
Wh, varh : Integer
W, var
: Integer
Wh, varh : ×10
: ×10
W, var
Wh, varh : ×100
■ Current, current demand and harmonic current RMS
Rated primary voltage
setting
5A to 30A
40A to 300A
400A to 3000A
4000A to 30000A
■ Power factor
3rd decimal place: 0.001
: ×10
Range in which
setting is prohibited
: ×100
W, var
Wh, varh : ×1000
Range in which
setting is prohibited
(20/32)
Resolution
2nd decimal place
0.01A
1st decimal place
0.1A
Integer
1A
x10
10A
■ Frequency
1st decimal place: 0.1 Hz
Single-phase 3-wire
Primary voltage setting
W, var
Wh, varh : 2nd decimal place
W, var
: 2nd decimal place
Wh, varh : 1st decimal place
W, var
: 1st decimal place
Wh, varh : Integer
W, var
: Integer
Wh, varh : ×10
: 3rd decimal place