Skip to main content

Table 2 Performance (mean absolute error, MAE) of depth and magnetic data likelihood models compared to depth-only likelihood

From: Potential utility of geomagnetic data for geolocation of demersal fishes in the North Pacific Ocean

Treatment name

Tag res (s.d.)

Wilcoxon

p value

Median

MAE (m)

95%

MAE

Max

MAE

Depth-only

NA

NA

1705

3767

8206

Fine/aggregated

75

< 2e−16

1240*

2894

8504

150

3.3e−16

1500*

3741

8855

300

1.5e−07

1571*

3297

8025

500

< 2e−16

2160−

7145

20754

Fine/anomaly

75

< 2e−16

1286*

2331

7615

150

< 2e−16

1404*

2747

7990

300

1.2e−10

1544*

3273

8151

500

0.3

1673

3742

9028

Coarse/anomaly

75

< 2e−16

1478*

3312

8368

150

1.6e−14

1513*

3251

8388

300

0.0017

1624*

3597

8214

500

0.99

1685

3757

9117

Coarse/constant

75

< 2e−16

1482*

3035

12372

150

1.8e−14

1508*

3218

8208

300

2.3e−07

1574*

3442

8251

500

0.011

1634*

3592

8149

Coarse/roughness

75

< 2e−16

2060−

6806

29,819

150

1.6e−08

1908−

5511

16,800

300

< 2e−16

2782−

7839

20,698

500

< 2e−16

2378−

6387

28,454

Coarse/slope

75

< 2e−16

2139−

18,022

36,033

150

7.1e−14

1984−

14,190

36,728

300

< 2e−16

3069−

16,558

38,423

500

< 2e−16

2457−

9392

39,173

  1. Likelihood treatment, tag resolution, p-value for Wilcoxon rank sums test, and median, 95% quantile, and maximum MAE values for each treatment/tag resolution combination. Median MAE values significantly (p < 0.05) better (lower) than the depth-only treatment are denoted by an asterisk (*), while treatments significantly worse (larger) than the depth-only treatment are denoted by a minus sign (−)