A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods

Haze originated from forest fire burning in Indonesia has become a problem for South-east Asian countries including Malaysia. Haze affects data recorded using satellite due to attenuation of solar radiation by haze constituents. This causes problems to remote sensing data users that require continuo...

Full description

Saved in:
Bibliographic Details
Main Author: Saiful Bahari, Nurul Iman
Format: Thesis
Language:English
English
Published: 2016
Subjects:
Online Access:http://eprints.utem.edu.my/id/eprint/18196/1/A%20Haze%20Removal%20Technique%20For%20Satellite%20Remote%20Sensing%20Data%20Based%20On%20Spectral%20And%20Statistical%20Methods%2024%20Pages.pdf
http://eprints.utem.edu.my/id/eprint/18196/2/A%20Haze%20Removal%20Technique%20For%20Satellite%20Remote%20Sensing%20Data%20Based%20On%20Spectral%20And%20Statustical%20Methods.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-utem-ep.18196
record_format uketd_dc
institution Universiti Teknikal Malaysia Melaka
collection UTeM Repository
language English
English
advisor Ahmad, Asmala

topic T Technology (General)
T Technology (General)
spellingShingle T Technology (General)
T Technology (General)
Saiful Bahari, Nurul Iman
A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods
description Haze originated from forest fire burning in Indonesia has become a problem for South-east Asian countries including Malaysia. Haze affects data recorded using satellite due to attenuation of solar radiation by haze constituents. This causes problems to remote sensing data users that require continuous data, particularly for land cover mapping. There are numbers of haze removal techniques but these techniques suffer from limitations since they are developed and designed best for particular regions, i.e. mid-latitude and high-latitude countries. Almost no haze removal techniques are developed and designed for countries within equatorial region where Malaysia is located. This study is meant to identify the effects of haze on remote sensing data, develop haze removal technique that is suitable for equatorial region, especially Malaysia and evaluate and test it. Initially, spectral and statistical analyses of simulated haze datasets are carried out to identify the effects of haze on remote sensing data. Land cover classification using support vector machine (SVM) is carried out in order to investigate the haze effects on different land covers. The outcomes of the analyses are used in designing and developing the haze removal technique. Haze radiances due to radiation attenuation are removed by making use of pseudo invariant features (PIFs) selected among reflective objects within the study area. Spatial filters are subsequently used to remove the remaining noise causes by haze variability. The technique is applied on simulated hazy dataset for performance evaluation and then tested on real hazy dataset. It is revealed that, the technique is able to remove haze and improve the data usage for visibility ranging from 6 to 12 km. Haze removal is not necessary for data with visibility more than 12 km because able to produce classification accuracy more than 85%, i.e. the acceptable accuracy. Nevertheless, for data with visibility less than 6 km, the technique is unable to improve the accuracy to the acceptable one due to the severe modification of spectral and statistical properties caused by haze.
format Thesis
qualification_name Master of Philosophy (M.Phil.)
qualification_level Master's degree
author Saiful Bahari, Nurul Iman
author_facet Saiful Bahari, Nurul Iman
author_sort Saiful Bahari, Nurul Iman
title A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods
title_short A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods
title_full A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods
title_fullStr A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods
title_full_unstemmed A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods
title_sort haze removal technique for satellite remote sensing data based on spectral and statistical methods
granting_institution Universiti Teknikal Malaysia Melaka
granting_department Faculty of Information and Communication Technology
publishDate 2016
url http://eprints.utem.edu.my/id/eprint/18196/1/A%20Haze%20Removal%20Technique%20For%20Satellite%20Remote%20Sensing%20Data%20Based%20On%20Spectral%20And%20Statistical%20Methods%2024%20Pages.pdf
http://eprints.utem.edu.my/id/eprint/18196/2/A%20Haze%20Removal%20Technique%20For%20Satellite%20Remote%20Sensing%20Data%20Based%20On%20Spectral%20And%20Statustical%20Methods.pdf
_version_ 1747833916164669440
spelling my-utem-ep.181962021-10-10T15:13:27Z A Haze Removal Technique For Satellite Remote Sensing Data Based On Spectral And Statistical Methods 2016 Saiful Bahari, Nurul Iman T Technology (General) TK Electrical engineering. Electronics Nuclear engineering Haze originated from forest fire burning in Indonesia has become a problem for South-east Asian countries including Malaysia. Haze affects data recorded using satellite due to attenuation of solar radiation by haze constituents. This causes problems to remote sensing data users that require continuous data, particularly for land cover mapping. There are numbers of haze removal techniques but these techniques suffer from limitations since they are developed and designed best for particular regions, i.e. mid-latitude and high-latitude countries. Almost no haze removal techniques are developed and designed for countries within equatorial region where Malaysia is located. This study is meant to identify the effects of haze on remote sensing data, develop haze removal technique that is suitable for equatorial region, especially Malaysia and evaluate and test it. Initially, spectral and statistical analyses of simulated haze datasets are carried out to identify the effects of haze on remote sensing data. Land cover classification using support vector machine (SVM) is carried out in order to investigate the haze effects on different land covers. The outcomes of the analyses are used in designing and developing the haze removal technique. Haze radiances due to radiation attenuation are removed by making use of pseudo invariant features (PIFs) selected among reflective objects within the study area. Spatial filters are subsequently used to remove the remaining noise causes by haze variability. The technique is applied on simulated hazy dataset for performance evaluation and then tested on real hazy dataset. It is revealed that, the technique is able to remove haze and improve the data usage for visibility ranging from 6 to 12 km. Haze removal is not necessary for data with visibility more than 12 km because able to produce classification accuracy more than 85%, i.e. the acceptable accuracy. Nevertheless, for data with visibility less than 6 km, the technique is unable to improve the accuracy to the acceptable one due to the severe modification of spectral and statistical properties caused by haze. 2016 Thesis http://eprints.utem.edu.my/id/eprint/18196/ http://eprints.utem.edu.my/id/eprint/18196/1/A%20Haze%20Removal%20Technique%20For%20Satellite%20Remote%20Sensing%20Data%20Based%20On%20Spectral%20And%20Statistical%20Methods%2024%20Pages.pdf text en public http://eprints.utem.edu.my/id/eprint/18196/2/A%20Haze%20Removal%20Technique%20For%20Satellite%20Remote%20Sensing%20Data%20Based%20On%20Spectral%20And%20Statustical%20Methods.pdf text en validuser https://plh.utem.edu.my/cgi-bin/koha/opac-detail.pl?biblionumber=100102 mphil masters Universiti Teknikal Malaysia Melaka Faculty of Information and Communication Technology Ahmad, Asmala 1. Ahmad, A., 2014. Atmospheric Effects on Land Classification using Satellite and Their Correction. 2. Ahmad, A., Khanapi, M., Ghani, A. and Razali, S., 2014. Haze Reduction from Remotely Sensed Data. Applied Mathematical Sciences, 8(36), pp.1755–1762. 3. Ahmad, A. and Quegan, S., 2012. Cloud masking for remotely sensed data using spectral and principal components analysis. ETASR-Engineering, Technology & Applied Science Research, 2(3), pp.221–225. 4. Ahmad, A. and Quegan, S., 2014. Haze Modelling and Simulation in Remote Sensing Satellite Data. Applied Mathematical Sciences, 8(159), pp.7909–7921. 5. Ahmad, A. and Quegan, S., 2015. The Effects of Haze on the Accuracy of Satellite Land Cover Classification. Applied Mathematical Sciences, 9(49), pp.2433–2443. 6. Alavipanah, S.K., Matinfar, H.R., Emam, a R., Khodaei, K., Bagheri, R.H. and Panah, a Y., 2011. Criteria of selecting satellite data for studying land resources. Desert, 15, pp.83–102. 7. Alberts, K., 2015. Landsat 8 (L8) Level 1 (L1) Data Format Control Book (DFCB). 8. Ali, H.M., 2012. New Atmospheric Correction Method Based on Band Rationing. Journal of Kufa – Physics, 4(2), pp.50–56. 9. Anderson, J.R., 1976. A Land Use and Land Cover Classification System For Use With Remote Sensor Data. 10. Anon, 2015. Exelis. [online] Available at: http://www.exelisvis.com/Learn/Resources/Tutorials.aspx [Accessed 20 Sep. 2014]. 11. Azmi, S.Z., Latif, M.T., Ismail, A.S., Juneng, L. and Jemain, A.A., 2010. Trend and status of air quality at three different monitoring stations in the Klang Valley, Malaysia. Air Quality, Atmosphere and Health, 3(1), pp.53–64. 12. Bao, N., 2011. Comparison of relative radiometric normalisation methods using pseudo invariant features and SPOT imagery. 7th International Symposium on Digital Earth, (August), pp.1–7. 13. Bluman, A.G., 2007. Elementary Statistics: A Step By Step Approach. 7th ed. New York: McGraw-Hill. 14. Burges, C., 1998. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 2(2), pp.121–167. 15. Burley, T.M., 1961. Land Use or Land Utilization? The Professional Geographer, 13(6), pp.18–20. 16. Candade, N. and Dixon, B., 2004. Multispectral classification of Landsat images: a comparison of support vector machine and neural network classifiers. In: ASPRS Annual Meeting Proceedings. Denver, CO. 17. Canty, M.J. and Nielsen, A. a., 2004. Automatic radiometric normalization of multitemporal satellite imagery with the iteratively re-weighted MAD transformation. Remote Sensing of Environment, 112(3), pp.1025–1036. 18. Chander, G., Markham, B.L. and Helder, D.L., 2009. Summary of current radiometric calibration coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI sensors. Remote Sensing of Environment, 113(5), pp.893–903. 19. Chavez, P.S., 1988. An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data. Remote Sensing of Environment, 24(3), pp.459–479. 20. Chen, W., Zhang, Z. and Wang, Y., 2009. Atmospheric Correction of SPOT5 Land Surface Imagery, pp.0–4. 21. Congalton, R., 1991. A review of assessing the accuracy of classifications of remotely sensed data. Remote sensing of environment, 46(October 1990), pp.35–46. 22. Congalton, R.G. and Green, K., 2009. Assessing the Accuracy of Remotely Sensed Data - Principles and Practices. 23. Dalsted, K., Paris, J.F., Clay, D.E., Clay, S. a, Reese, C.L. and Chang, J., 2003. Selecting the Appropriate Satellite Remote Sensing Product for Precision Farming. SSMG, 8(00), pp.1–6. 24. DOE, 2015. DOE. [online] Available at: http://www.doe.gov.my/portalv1/en/ [Accessed 10 Nov. 2015]. 25. Du, Y., Teillet, P.M. and Cihlar, J., 2002. Radiometric normalization of multitemporal high-resolution satellite images with quality control for land cover change detection. Remote Sensing of Environment, 82(1), pp.123–134. 26. Foody, G.M. and Arora, M.K., 1997. An evaluation of some factors affecting the accuracy of classification by an artificial neural network. International Journal of Remote Sensing, 18(4), pp.799–810. 27. Foody, G.M. and Mathur, A., 2004. A relative evaluation of multiclass image classification by support vector machines. IEEE Transactions on Geoscience and Remote Sensing, 42(6), pp.1335–1343. 28. GoogleMaps, 2015. Google Maps. [online] Available at: https://www.google.com.my/maps. 29. GrindGIS, 2015. GrindGIS. [online] Available at: http://grindgis.com/what-is-remote-sensing/know-basics-of-remote-sensing [Accessed 20 Mar. 2015]. 30. GSFC, 2014. GSFC. [online] Available at: http://imagine.gsfc.nasa.gov/science/toolbox/emspectrum1.html mac 2014 [Accessed 20 Mar. 2014]. 31. Hadjimitsis, D.G., Clayton, C.R.I. and Retalis, A., 2009. The use of selected pseudo-invariant targets for the application of atmospheric correction in multi-temporal studies using satellite remotely sensed imagery. International Journal of Applied Earth Observation and Geoinformation, 11(3), pp.192–200. 32. Hadjimitsis, D.G., Papadavid, G., Agapiou, a., Themistocleous, K., Hadjimitsis, M.G., Retalis, a., Michaelides, S., Chrysoulakis, N., Toulios, L. and Clayton, C.R.I., 2010. Atmospheric correction for satellite remotely sensed data intended for agricultural applications: impact on vegetation indices. Natural Hazards and Earth System Science, 10, pp.89–95. 33. El Hajj, M., Bégué, A., Lafrance, B., Hagolle, O., Dedieu, G. and Rumeau, M., 2008. Relative radiometric normalization and atmospheric correction of a SPOT 5 time series. Sensors, 8(4), pp.2774–2791. 34. Hu, C. and Tang, P., 2011. Converting DN value to reflectance directly by relative radiometric normalization. Proceedings - 4th International Congress on Image and Signal Processing, CISP 2011, 3, pp.1614–1618. 35. Hu, J., Chen, W., Li, X. and He, X., 2009. A haze removal module for mutlispectral satellite imagery. 36. Jensen, J.R., 1996. Introductory Digital Image Processing: A Remote Sensing Perspective. 2nd ed. New Jersey: Pearson Prentice Hall. 37. Koukoulas, S. and Blackburn, G.A., 2001. Introducing New Indices for Accuracy Evaluation of Classified Images Representing Semi-Natural Woodland Environments. Photogrammetric Engineering & Remote Sensing, 67(4), pp.499–510. 38. Liang, S., Member, S., Fang, H. and Chen, M., 2001. Atmospheric Correction of Landsat ETM + Land Surface Imagery — Part I : Methods. IEEE Transactions on Geoscience and Remote Sensing, 39(11), pp.2490–2498. 39. Liang, S., Member, S., Fang, H., Morisette, J.T., Chen, M., Shuey, C.J., Walthall, C.L. and Daughtry, C.S.T., 2002. Atmospheric Correction of Landsat ETM + Validation and Applications. IEEE Transactions on Geoscience and Remote Sensing, 40(12), pp.2736–2746. 40. Lillesand, T. M., Kiefer, R. W., Chipman, J.W., 2004. Remote Sensing and Image Interpretation. 5 th ed. New Jersey: John Wiley & Sons. 41. Mahmood, N.N., Loh, K.F. and Ahmad, S., 1997. Remote Sensing Research In Malaysia. In: Proceedings of the IEEE International Geoscience and Remote Sensing. pp.1418–1420. 42. Makarau, A., Richter, R., Müller, R. and Reinartz, P., 2014. Haze Detection and Removal in Remotely Sensed Multispectral Imagery. IEEE Transactions on Geoscience and Remote Sensing, 52(9), pp.5895–5905. 43. McCulloch, W.S. and Pitts, W., 1943. A logical calculus of the ideas immanent in nervous activity. The Bulletin of Mathematical Biophysics, 5(4), pp.115–133. 44. Md Sap, M.N. and Kohram, M., 2008. Support Vector Classification of Remote Sensing Images Using Improved Spectral Kernels. Jurnal Teknologi Maklumat, 20(Jun 2008). 45. MetMalaysia, 2015. Malaysian Meteorological Department. [online] Available at: http://www.met.gov.my/web/metmalaysia/observations/surface/horizontalvisibility [Accessed 2 Dec. 2015]. 46. Mohsin, K., 2014. Land Use and Land Cover Changes of Al-Kut City in Iraq using Remote Sensing and GIS Techniques. 03(17), pp.3555–3560. 47. Moro, G.D. and Halounova, L., 2007. Haze removal for high‐resolution satellite data: a case study. International Journal of Remote Sensing, 28(10), pp.2187–2205. 48. Morris, W., 1975. The Heritage Illustrated Dictionary of English Language of The English Language. New York : American Heritage Publishing Co. New York: American Heritage Publishing Co. 49. Mountrakis, G., Im, J. and Ogole, C., 2011. Support vector machines in remote sensing: A review. ISPRS Journal of Photogrammetry and Remote Sensing, 66(3), pp.247–259. 50. N. McWilliam, R. Teeuw, M.W. and P.Z., 2005. Field Techniques Manual: GIS, GPS and Remote Sensing. Field Techniques Manual: GIS, GPS and Remote Sensing, pp.68–76. 51. Pal, M., 2002. Factors Influencing The Accuracy of Remote Sensing Classifications: A Comparatve Study. 52. Pimentel, D. and Wilson, A., 2004. World Population, Agriculture and Malnutrition. World Watch Magazine, (October), pp.22–25. 53. Rahman, H.A., 2013. Haze Phenomenon in Malaysia : Domestic or Transboudry Factor? 3rd International Journal Conference on Chemical Engineering and its Applications, pp.597–599. 54. Richards, J. A and Jia, X., 2006. Remote Sensing Digital Image Analysis. 4th ed. New York. New York: Springer. 55. Richter, R., 2008. Classification Metrics for Improved Atmospheric Correction of Multispectral VNIR Imagery. Sensors, 8(11), pp.6999–7011. 56. Roy, D.P., Wulder, M. a., Loveland, T.R., C.E., W., Allen, R.G., Anderson, M.C., Helder, D., Irons, J.R., Johnson, D.M., Kennedy, R., Scambos, T. a., Schaaf, C.B., Schott, J.R., Sheng, Y., Vermote, E.F., Belward, a. S., Bindschadler, R., Cohen, W.B., Gao, F., Hipple, J.D., Hostert, P., Huntington, J., Justice, C.O., Kilic, a., Kovalskyy, V., Lee, Z.P., Lymburner, L., Masek, J.G., McCorkel, J., Shuai, Y., Trezza, R., Vogelmann, J., Wynne, R.H. and Zhu, Z., 2014. Landsat-8: Science and product vision for terrestrial global change research. Remote Sensing of Environment, 145, pp.154–172. 57. San, B.T., Suzen, M.L., 2010. Evaluation of Different Atmospheric Correction Algorithms for EO-1 Hyperion Imagery. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Science, XXXVIII(8), pp.392–397. 58. Schott, J.R., Salvaggio, C. and Volchok, W.J., 1988. Radiometric Scene Normalization Using Pseudoinvariant Features. Remote sensing of environment, 16, pp.1–16. 59. Shi, D. and Yang, X., 2012. Support Vector Machine for Landscape Mapping from Remote Sensor Imagery. In: AutoCarto 2012. 60. Thomlinson, J.R., Bolstad, P. V and Cohen, W.B., 1999. Coordinating Methodologies for Scaling Landcover Classifications from Site-Specific to Global : Steps toward Validating Global Map Products. Remote Sensing of Environment, 4257(99). 61. USGS, 2012. Landsat — A Global Land-Imaging Mission. [online] Available at: http://pubs.usgs.gov/fs/2012/3072/fs2012-3072.pdf [Accessed 5 Jan. 2014]. 62. USGS, 2015. USGS. [online] Available at: http://glovis.usgs.gov/ [Accessed 22 Apr. 2015]. 63. Vapnik, V.N., 1995. The Nature of Statistical Learning Theory. New York: Springer-Verlag. 64. Zhan, Y., Zheng, S.C., Du, Y. and Wei, L.Q., 2012. Automated Haze Removal and Radiometric Normalization for Electro-Optical Imagery Preprocessing. Advanced Engineering Forum, 6-7, pp.391–397. 65. Zhang, Y. and Guindon, B., 2003. Quantitative Assessment of a Haze Suppression Methodology for Satellite Imagery : Effect on Land Cover Classification Performance. IEEE Transactions on Geoscience and Remote Sensing, 41(5), pp.1082–1089. 66. Zhang, Y., Guindon, B. and Cihlar, J., 2002. An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images. Remote Sensing of Environment, 82(2-3), pp.173–187.