2022 GRSL Acceptedversion Sysu3d
2022 GRSL Acceptedversion Sysu3d
net/publication/358835063
CITATIONS READS
3 654
7 authors, including:
All content following this page was uploaded by Zhouxuan Xiao on 25 February 2022.
This work is supported by Open Fund of State Key Laboratory of Remote [email protected]; [email protected];
Sensing Science under Grant No. OFSLRSS202108, the National Natural [email protected]; [email protected]).
Science Foundation of China (grant Nos. 41971380) and Guangxi Natural Yuan Li is with the School of Geospatial Engineering and Science, Sun Yat-
Science Fund for Innovation Research Team (grant Nos. sen University, 519082 Zhuhai, China, and with the State Key Laboratory of
2019GXNSFGA245001). (Corresponding authors: Yuan Li and Wuming Remote Sensing Science, Aerospace Information Research Institute, Chinese
Zhang) Academy of Sciences. Beijing 100101, China (e-mail:
Zhouxuan Xiao, Linzhou Zeng, Jie Shao, Chaohua Ma and Wuming Zhang [email protected]).
are with the School of Geospatial Engineering and Science, Sun Yat-sen Man Peng is with the State Key Laboratory of Remote Sensing Science,
University, 519082 Zhuhai, China (e-mail: [email protected]; Aerospace Information Research Institute, Chinese Academy of Sciences.
Beijing 100101, China (email: [email protected]).
2
Fig. 6 (a) Spirit rover traverse map, (b) cameras and (c) experimental images
Fig. 8 Qualitative assessment of extracted rocks in the near and far-field
TABLE I
COLLECTED IMAGES FROM SPIRIT NAVCAM
Original Images Point cloud Density
L-1 2n131246299rad1147p1940l0c1
R-1 2n131246299rad1147p1940r0c1
L-2 2n131344812rad1151p1940l0c1 41,027pts/m2
R-2 2n131344812rad1151p1940r0c1 (2,102,548 points)
L-3 2n131698647rad1159p1940l0c1
R-3 2n131698647rad1159p1940r0c1
3D extraction results are refined (Fig. 7c), and the OBB is then Near 1.35 1.32 0.13 19.84 24.45 49.87
Far 3.05 2.79 0.43 85.17 92.03 132.50
constructed for each rock (Fig. 7d).
TABLE IV
1) Qualitative assessment of rock extraction QUANTITATE ASSESSMENT OF ROCK EXTRACTION IN DIFFERENT TERRAINS
The experimental area can be divided into the near field Our Extraction Ground True
(within ~3 m to the rover) and far field (beyond ~3 m to the Terrain type F-score
numbers points numbers points
rover). Fig. 8 shows the comparison between the extracted Flat 25 25974 25 28562 95.26%
rocks and the manually constructed ground truth (GT). The grey Regular 25 27174 25 31567 92.52%
parts refer to extracted rocks that are consistent with the GT Undulating 25 20981 25 27182 87.10%
(true positive, TP). The blue parts refer to rocks that are TABLE V
MEAN BIAS OF MORPHOLOGICAL FEATURES IN DIFFERENT TERRAINS
incorrectly extracted (false positive, FP), and the yellow parts
Project Surface
refer to the missed rocks (false negative, FN). As shown in Fig. Terrain Length Width Height
area area
Volume
7, most rocks at both near and far-field have been successfully type (cm) (cm) (cm) (cm3)
(cm )
2
(cm )2
extracted. Small rocks are unextracted or partially extracted Flat 0.20 0.26 0.57 8.83 23.66 23.58
because they have very low heights or gentle slopes, making it Regular 0.20 0.23 1.24 27.48 43.30 42.43
hard to be distinguished between such rocks and the terrain Undulating 0.86 0.75 1.34 19.10 59.78 54.60
relief. But generally, the overall performance of the developed F-score), where “numbers” and “points” referred to number of
rock extraction method is satisfactory. rocks and number of 3D points corresponding to rocks,
2) Quantitative assessment of rock extraction respectively. Precision represents the correctness of the
The overall performances are synthesized in Table II and III, detected rocks; recall is used to measure the completeness of
and two evaluations (i.e., numbers- and points-based) are the rock detection; F-score is the overall accuracy by taking the
conducted based on three measures (i.e., precision, recall, and harmonic mean of recall and precision. In the near-filed, the
5
precision, recall, and F-score can reach 98%, 88% and 92%, Recognition, Jun. 2007: IEEE, pp. 1-7, doi:
10.1109/CVPR.2007.383257.
respectively, indicating that the proposed method had a good
[2] K. Di, Z. Yue, Z. Liu, and S. Wang, "Automated rock detection and
performance on extracting complete 3D rocks with high shape analysis from mars rover imagery and 3D point cloud data,"
precision. On the other hand, the assessment values are only 71% Journal of Earth Science, vol. 24, no. 1, pp. 125-135, Feb. 2013, doi:
in the far-field, probably indicating the poor depth estimation 10.1007/s12583-013-0316-3.
[3] M. P. Golombek et al., "Rock size-frequency distributions on Mars
during dense matching in the far-field, resulting in unintegrated and implications for Mars Exploration Rover landing safety and
rock extraction. operations," (in English), J. Geophys. Res.-Planets, vol. 108, no.
3) Assessment of morphological features extraction E12, Oct. 2003, doi: 10.1029/2002JE002035.
To further verify the effectiveness of the proposed method, [4] J. G. Ward, R. E. Arvidson, and M. Golombek, "The size-frequency
and areal distribution of rock clasts at the Spirit landing site, Gusev
simulated data with three different terrain types (Fig.9a, c and Crater, Mars," (in English), Geophysical Research Letters, vol. 32,
e) and various rock sizes and shapes were used and the no. 11, Jun. 2005, doi: 10.1029/2005GL022705.
corresponding rock extraction results are shown in Fig.9b, d and [5] R. Li, K. Di, A. B. Howard, L. Matthies, J. Wang, and S. Agarwal,
"Rock modeling and matching for autonomous long-range Mars
f. Generally, in the simulated data, rocks were extracted under rover localization," (in English), Journal of Field Robotics, vol. 24,
different terrain conditions with remarkably high accuracies no. 3, pp. 187-203, Mar. 2007, doi: 10.1002/rob.20182.
(Table IV). To further quantitatively evaluate the accuracy of [6] R. V. Morris et al., "Identification of Carbonate-Rich Outcrops on
morphological feature extraction, a deviation formula Mars by the Spirit Rover," (in English), Science, vol. 329, no. 5990,
pp. 421-424, Jul. 2010, doi: 10.1126/science.1189667.
quantifying the bias of extraction results is given as follows: [7] G. Li, Y. Geng, and X. Xiao, "Multi-scale rock detection on Mars,"
∑𝑛𝑛𝑖𝑖=1 |𝑂𝑂𝑂𝑂𝑖𝑖 − 𝐺𝐺𝐺𝐺𝐺𝐺𝑖𝑖 | (in English), Sci. China Inf. Sci. (Germany), vol. 61, no. 10, pp.
bias = (4) 102301 (8 pp.)-102301 (8 pp.), Oct 2018, doi: 10.1007/s11432-017-
𝑛𝑛 9277-x.
where OEi and GTVi represent our extracted values and the [8] R. Castano et al., "OASIS: Onboard autonomous science
corresponding ground true values of the ith simulated rock, investigation system for opportunistic rover science," (in English),
respectively. n represents the number of rocks. Journal of Field Robotics, vol. 24, no. 5, pp. 379-397, May 2007,
doi: 10.1002/rob.20192.
As shown in Table V, compared with the ground-truth of the [9] V. C. Gulick, R. L. Morris, M. A. Ruzon, and T. L. Roush,
simulated data, the mean bias of length, width and height "Autonomous image analyses during the 1999 Marsokhod rover
calculated by the proposed method are mostly less than 1cm, field test," Journal of Geophysical Research: Planets, vol. 106, no.
E4, pp. 7745-7763, Apr. 2001, doi: 10.1029/1999JE001182.
while the mean bias of projected area, surface area and volume
[10] Y. Li and B. Wu, "Analysis of Rock Abundance on Lunar Surface
are within tens of cm2/cm3. The overall accuracy of feature From Orbital and Descent Images Using Automatic Rock
extraction can reach 95.65%, 91.06% and 88.12% under the flat, Detection," J. Geophys. Res.-Planets, vol. 123, no. 5, pp. 1061-1088,
regular, and undulating terrain conditions, respectively, further Apr. 2018, doi: 10.1029/2017JE005496.
[11] X. Xiao, H. Cui, M. Yao, and Y. Tian, "Autonomous rock detection
validating the high precision of our approach. on mars through region contrast," Advances in Space Research, vol.
60, no. 3, pp. 626-635, Aug. 2017, doi: 10.1016/j.asr.2017.04.028.
IV. CONCLUSION [12] F. Furlan, E. Rubio, H. Sossa, and V. Ponce, "Rock Detection in a
Mars-Like Environment Using a CNN," presented at the 11th
In this letter, we proposed a routine and effective approach to Mexican Conference on Pattern Recognition (MCPR), Queretaro,
perform extraction of 3D rock and morphological features with MEXICO, Jun., 2019.
[13] L. Matthies, A. Huertas, Y. Cheng, and A. Johnson, "Stereo vision
high precision from stereo Mars rover imagery. The main and shadow analysis for landing hazard detection," in 2008 IEEE
contribution of this letter is that we first perform 3D rock International Conference on Robotics and Automation, May. 2008:
extraction from stereo rover imagery, and extract accurate rock IEEE, pp. 2735-2742, doi: 10.1109/ROBOT.2008.4543625.
[14] S. Woicke and E. Mooij, "A stereo-vision hazard-detection
morphology parameters using TIN and local terrain information. algorithm to increase planetary lander autonomy," Acta
Although some small rocks with gentle slopes can be failed to Astronautica, vol. 122, pp. 42-62, May. 2016, doi:
be extracted, but generally the proposed method had a good 10.1016/j.actaastro.2016.01.018.
[15] I. Cruz-Matias et al., "Sphericity and roundness computation for
performance on extracting complete 3D rocks with high particles using the extreme vertices model," (in English), Journal of
precision (~98% in near field and ~91% in far field). However, Computational Science, vol. 30, pp. 28-40, Jan. 2019, doi:
in the 3D processing, inaccuracies in image depth estimation 10.1016/j.jocs.2018.11.005.
and point cloud filtering are likely to result in incomplete rock [16] P. D. System, "Planetary Data System Standards Reference (Version
3)," ed, 2006.
boundaries in the far-field, which consequently lead to biased [17] P. D. System, "Planetary Data System Standards Reference (Version
3D morphological features extraction. In future research, we 4)," ed, 2020.
will investigate the combination of 2D images to get grayscale [18] W. M. Zhang et al., "An Easy-to-Use Airborne LiDAR Data
Filtering Method Based on Cloth Simulation," (in English), Remote
features of rocks for improving the rock extraction accuracy. In Sens., Article vol. 8, no. 6, p. 22, Jun. 2016, Art no. 501, doi:
comparison with the simulated rock data, the proposed method 10.3390/rs8060501.
can perform robust rock morphological features extraction [19] L. He, Y. Chao, K. Suzuki, and K. Wu, "Fast connected-component
labeling," (in English), Pattern Recognit., Article vol. 42, no. 9, pp.
under different terrain conditions (95.65%, 91.06% and 88.12% 1977-1987, Sep. 2009, doi: 10.1016/j.patcog.2008.10.013.
in the flat, regular, and undulating terrain, respectively). [20] Z. C. Marton, R. B. Rusu, and M. Beetz, "On Fast Surface
Reconstruction Methods for Large and Noisy Point Clouds," in 2009
IEEE International Conference on Robotics and Automation, May.
REFERENCES 2009: IEEE, pp. 3218-3223, doi: 10.1109/ROBOT.2009.5152628.
[1] H. Dunlop, D. R. Thompson, and D. Wettergreen, "Multi-scale [21] H. Y. McSween et al., "Basaltic rocks analyzed by the Spirit rover
features for detection and segmentation of rocks in mars images," in in Gusev Crater," (in English), Science, vol. 305, no. 5685, pp. 842-
2007 IEEE Conference on Computer Vision and Pattern 845, Aug. 2004, doi: 10.1126/science.3050842.