Thomas, Claire (2006) Fusion of images of different spatial resolutions. PhD thesis Informatique et Temps Réel, Robotique, Automatique, ENSMP - CEP Centre Energétique et Procédés, ENSMP.

Full text available as: - these_clairethomas.pdf ( 11163 Kb )

Licence: Copyright

Abstract

Space-borne sensors such as SPOT, Ikonos or Quickbird, provide images with different characteristics: on one hand, images with high spectral resolution but low spatial resolutions, and on the other hand, images with high spatial resolution combined to low spectral resolution. This work deals with the synthesis of multispectral images at high spatial resolution by the mean of image fusion. Weak approaches to quality assessment were found in literature. Accordingly, we design a protocol for quality assessment based on two previous relevant works. An empirical survey about the changes in quality budget within scales completes the description of the protocol. We propose a categorization of distances found in literature, and add a new distance for geometrical quality assessment, based on the Modulation Transfer Function. It was validated on Ikonos actual imagery and synthesized images obtained by well-known fusion methods. The selection of a group of distances to form quality budgets is discussed in order to obtain a complete overview of the quality reached by fused products.
Once the necessary tools of quality assessment built, we focused on the development of new fusion methods. We have chosen the ARSIS concept as framework because of the good quality budgets attained by its different implementations. However, the visual quality of the resulting images is often criticized. A campaign for the assessment of the visual quality of several ARSIS fused products resulted into the identification, the classification and the explanation of several artefacts. This critical study formed the basis for the development of three new methods. They were tested during a second campaign of experimentation. One of the new methods offers better results than that chosen as reference. The image analysts of this second campaign stated that this method was acceptable and recommendable for an operational exploitation within the minister of defence.

References

Acerbi-Junior F.W., J.G.P.W. Clevers et M.E. Schaepman, 2006. The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna, International Journal of Applied Observation and Geoinformation, Digital Object Identifier 10.1016/j.jag.2006.01.001, Elsevier (Eds.), Vol. 8, N°4: 278-288.
Aiazzi B., L. Alparone, S. Baronti et R. Carlà, 1997. Pyramid-based multi-sensor image data fusion, In Proceedings of SPIE Conference "Wavelet Applications in Signal and Image Processing", vol. 3169: 224-235.
Aiazzi B., L. Alparone, S. Baronti et A. Garzelli, 2002. Context-Driven Fusion of High Spatial and Spectral Resolution Images Based on Oversampled Multiresolution Analysis, IEEE Transactions on Geosciences and Remote Sensing, vol. 40, N°10: 2300-2312.
Aiazzi B., L. Alparone, S. Baronti, A. Garzelli et M. Selva, 2002. An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas, In 2nd GRSS/ISPRS Joint Workshop on "Remote Sensing and Data Fusion over Urban Areas", IEEE Ed. (03EX646), 22-23 May 2003, Berlin, Allemagne, ISBN 0-7803-7719-2: 90-94.
Aiazzi B., S. Baronti, L. Santutti, M. Selva et L. Alparone, 2003. Impact of irreversible data compression on spectral distortion of hyper-spectral data, Geoinformation for European-wide Integration, Thomas Benes (Eds.), Rotterdam, Netherlands: 107-112
Aiazzi B, L. Alparone, S. Baronti et M. Selva, 2006. MS + Pan image fusion by enhanced Gram-Shmidt spectral sharpening, In Proceedings of the 26th EARSeL Symposium "New Strategies for European Remote Sensing", 29-31 May 2006, Varsovie, Pologne
Alonso Reyes R., M. Melgar, S. Fernandez, C. Thomas, T. Ranchin et L. Wald, 2005a. Fusion of SPOT5 multispectral and Ikonos panchromatic images. In Proceedings of the 24th EARSeL Symposium "New Strategies for European Remote Sensing", 25-27 May 2004, Dubrovnik, Croatia, Oluic (Eds.), Millpress, Rotterdam, ISBN 90 5966 003 X: 369-375.
Alonso Reyes R., M.J. Gutierrez, S. Fernandez, C. Thomas, T. Ranchin et L. Wald, 2005b. Evaluation of the quality of Quickbird fused products. In Proceedings of the 24th EARSeL Symposium "New Strategies for European Remote Sensing", 25-27 May 2004, Dubrovnik, Croatia, Oluic (Eds.), Millpress, Rotterdam, ISBN 90 5966 003 X: 343-351.
Alparone L., V. Cappellini, L. Mortelli, B. Aiazzi, S. Baronti et R. Carlà, 1998. A pyramid-based approach to multisensor image data fusion, Future Trends in Remote Sensing: 419-426.
Alparone L., S. Baronti, A. Garzelli et F. Nencini, 2004. A global quality measurement of pan-sharpened multispectral imagery, IEEE Geoscience and Remote Sensing Letters, vol. 1, N°4: 313-317.
Alparone L., L. Wald, J. Chanussot, L. M. Bruce et P. E. Gamba, 2006. IGARSS'06 Data Fusion Contest: Fusion of Panchromatic and Multispectral Images, In IEEE IGARSS Symposium, Denver, Colorado, USA, 31 July - 4 August 2006.
Anonymous, 1986. Guide des utilisateurs des données SPOT, CNES et SPOT Image (Eds.), Toulouse, France, 3 volumes, révisé en janvier 1991.
Blanc P., T. Blu, T. Ranchin, L. Wald et R. Aloisi, 1998. Using iterated rational filter banks within ARSIS concept for producing Landsat multispectral images, International Journal in Remote Sensing, vol. 19, N°12: 2331-2343.
Blanc P., L. Wald et T. Ranchin, 1998. Importance and effect of co-registration quality in an example of " pixel to pixel " fusion process. In Proceedings of the 2nd International Conference " Fusion of Earth Data ", T. Ranchin et L. Wald (Eds.), published by SEE/URISCA, Nice, France, Janvier 1998: 67-74.
Ballester C., V. Caselles, B. Rougé et J. Verdera, 2003a. Une méthode géométrique de fusion des images P+XS, Rapport CNES.
Ballester C., V. Caselles, J. Verdera et B. Rougé, 2003b. A variational model for P+XS image fusion, In Proceedings of IEEE workshop on variational, geometric and level sets method in computer vision, Faudegars et Parios (Eds.), published in INRIA, Sophia-Antipolis, France, 12 octobre 2003.
Ballester C., V. Caselles, L. Igual, J. Verdera et B. Rougé, 2006. A variational model for P+XS image fusion, International Journal of Computer Vision, Digital Object Identifier 10.1007/s11263-0066852-x, to appear.
Buntilov V. et T. Bretcshneider, 2004. Assessment of the method-inherent distortions in wavelet fusion, In Proceedings of 25th ACRS'04 "Data processing", 22-26 novembre, Chiang Mai, Thailande: 239-244.
Burke Hubbard B., 1995. Ondes et Ondelettes, La Saga d'un Outil Mathématique, Pour la Science, diffusion Belin, Paris, France, 235 p.
Byeungwoo J. et D.A. Landgrebe, 1999. Decision fusion approach for multitemporal classification, In IEEE transactions on Geoscience and Remote Sensing, Digital Object Identifier 10.1109/36.763278, vol. 37, N°3, Part 1: 1227-1233.
Carper W.J., T.M. Lillesand et R.W. Kiefer, 1990. The use of Intensity-Hue-Saturation transformation for merging SPOT panchromatic and multispectral image data, Photogrammetric Engineering and Remote Sensing, vol. 56, N°4: 459-467.
Chavez P.S. et A.Y. Kwarteng, 1989. Extracting spectral contrast in Landsat Thematic Mapper image data using selective principle component analysis, Photogrammetric Engineering and Remote Sensing, vol. 55, N°3: 339-348.
Chavez P.S., S.C. Sides et J.A. Anderson, 1991. Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT Panchromatic, Photogrammetric Engineering and Remote Sensing, vol. 57, N°3: 265-303.
Chen H. et P. K. Varshney, 2005. A human perception inspired quality metric for image fusion based on regional information, Information Fusion, Digital Object Identifier 10.1016/j.inffus.2005.10.001, Elsevier (Eds.), to appear.
Chibani Y. et A. Houacine, 2002. The joint use of IHS transform and redundant wavelet decomposition for fusing multispectral and panchromatic images, International Journal of Remote Sensing, vol. 23: 3821-3833.
Choi M., R.Y. Kim M.R. Nam et H.O. Kim, 2005. Fusion of multispectral and panchromatic satellite images using the curvelet transform, IEEE Geoscience and Remote Sensing Letters, vol. 2, N°2: 136-140.
Choi M., 2006. A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter, IEEE transactions on Geosciences and Remote Sensing, vol. 44, N°6: 1672-1682.
Civco D.L., Y. Wang et J.A. Silander, 1995. Characterizing forest ecosystems in Connecticut by integrating Landsat TM and SPOT panchromatic data, In Proceedings of the ACSM/ASPRS Annual Convention, Charlotte, NC., 2 (Reston VA: ASPRS): 216-224.
Constantinos S.P., M.S. Pattichis et E. Micheli-Tzanakou, 2001. Medical imaging fusion applications: an overview, In Record of the Thirty-fifth conference on Signals, Systems and Computers, Pacific Grove, Californie, vol. 2: 1263-1267
Cornet Y., M. Binard et J.P. Donnay, 2004. Intérêt de la fusion d'images à haute résolution spatiale pour la classification de l'occupation du sol en milieu urbain, Revue internationale de Géomatique: Imagerie satellite, European Journal of GID and Spatial Analysis, Lavoisier (Eds.): 417-439.
Couloignier I., T. Ranchin, V.P. Valtonen et L. Wald, 1998. Benefit of the future SPOT5 and of data fusion to urban mapping, International Journal of Remote Sensing, vol. 19, N°8: 1519-1532.
Cros S., 2004. Création d'une climatologie du rayonnement solaire incident en ondes courtes à l'aide d'images satellitales, Thèse de Doctorat en Energétique, Ecole des Mines de Paris, 13 septembre 2004, 157 pages.
Daubechies I. 1988. Orthonormal bases of compactly supported wavelets. Communications on Pure and Applied Mathematics, vol. 41: 906-909.
De Boissezon H. et F. Laporterie, 2003. Evaluations thématiques et statistiques de cinq algorithmes de fusion P/XS sur des simulations d'images PLEIADES-HR, SFPT, vol. 1, N°169: 83-99.
Dial G., H. Bowen, F. Gerlach, J. Grodecki et R. Oleszczuk, 2003. IKONOS satellite, imagery, and products, Remote Sensing of Environment, vol. 88: 23-36.
Diemer C. et J. Hill, 2000. Local correlation approach for the fusion of remote sensing data with different spatial resolutions, In Proceedings of the third conference "Fusion of Earth data: merging point measurements, raster maps and remotely sensed images", 26-28 January 2000, publié par SEE/URISCA, Nice, Sophia-Antipolis, France, Ranchin T et Wald L. (Eds.): 167-182.
Dutilleux P., 1989. An implementation of the "algorithmes à trous" to compute the wavelet transform. In Combes, J.M., orossman, A., Tchamitchian, Ph. (Eds.), Wavelets: Time-Frequency Methods and Phase Space. Springer, Berlin: 298-304.
Ehlers P., 1991. Multi-sensor image fusion techniques in remote sensing, ISPRS Journal Photogrammetry and Remote Sensing, vol. 46, N°3: 19-30.
Eskicioglu A.M. et P.S. Fisher 1995. Image quality measure and their performance. IEEE Transactions and Communications, vol. 43, N°12: 2959-2965.
Filippidis A, L.C. Jain et N. Martin, 2000. Multisensor data fusion for surface land-mine detection, IEEE Transactions on Systems, Man and Cybernetics, Part C, vol. 30, N°1: 145-150.
Fung T. et E. LeDrew, 1987. Application on principal components analysis to change detection, Photogrammetric Engineering and Remote Sensing, vol. 53, N°12: 1649-1658.
Gamba P., J. Chanussot et L.M. Bruce, 2006. Contest organized by the Data Fusion Technical Committee at IGARSS 2006, IEEE Geoscience and Remote Sensing Society, December 2006. NON CITE
Garzelli A., F. Nencini, L. Alparone, B. Aiazzi et S. Baronti, 2004. Pan-Sharpening of Multispectral Images: A Critical Review and Comparison, In proceedings of IEEE Geoscience and Remote Sensing Symposium, IGARSS'04.
Garzelli A. et F. Nencini, 2005. Interband structure modeling for Pan-sharpening of very high resolution multispectral images, International Journal on Information Fusion, Digital Object Identifier 10.1016/j.inffus.2004.06.008, vol. 6, N°3: 213-224. CITE?
Garguet-Duport B., J. Girel, J.M. Chassery, et G. Pautou, 1996. The use of multiresolution analysis and wavelets transform for merging SPOT panchromatic and multispectral image data, Photogrammetric Engineering and Remote Sensing, vol. 62, N°9: 1057-1066.
Gillespie A.R., A.B. Kahle et R.E. Walker, 1987. Color enhancement of highly correlated images - II Channel ratio and ‘chromacity' transformation techniques, Remote Sensing Environment, vol. 22: 343-365.
Gonzalez-Audicana M. et M. Seco, 2003. Fusion of multispectral and panchromatic images using wavelet transform. Evaluation of crop classification accuracy, In Proceedings of the 22th EARSeL Symposium "Geoinformation for European-wide integration", 4-6 June 2002, Prague, Czech republic, Benes (Eds.), Millpress, Rotterdam, the Netherlands: 265-272.
Gonzalez-Audicana M., J.L. Saleta, O.G. Catalan et R. Garcia, 2004. Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition, IEEE Transactions on Geosciences and Remote Sensing, vol. 42, N°6: 1291-1299.
Gonzalez-Audicana M., X. Otazu, O. Fors et J. Alvarez-Mozos, 2006. A low computational-cost method to fused Ikonos images using the spectral response function of its sensors, IEEE Transactions on Geosciences and Remote Sensing, vol. 44, N°6: 1683-1691.
Gonzalez R.C. et R.E. Woods, 1992. Digital Image Processing, Addison-Wesley, Reading, MA.
Grégoire C., N. Dondainas et M. Raffy, 1993. Construction de modèles multispectraux pour milieux hétérogènes à partir de modèles validés sur milieux homogènes: application au LAI, In proceedings of Deuxième réunion sur les changements d'échelle dans les modèles de l'environnement et de la télédétection, Strasbourg, France, 17-19 mai 1993: 5-11.
Gungor O. et J. Shan, 2004. Evaluation of satellite image fusion using wavelet transform, In proceedings of 20th Congress ISPRS "Geo-Imagery Bridging Continents", 12-13 July 2004, Instanbul, Turkey, vol. 35, part B7.
Haydn R., G.W. Dalke, J. Henkel et J.E. Bare, 1982. Application of the IHS color transform to the processing of multisensor data and image enhancement, In. Proceedings of International Symposium on Remote Sensing of Arid and Semi-Arid Lands, Caire, Egypt: 599-616
Hall D.L., 1992. Mathematical techniques in multisensor data fusion (Norwood: Artech House Inc.)
Hendersen-Sellers A., M. Wilson et G. Thomas, 1985. The effect of spatial resolution on archives of land cover type, Climatic Change, vol. 7: 391-399.
Holst G.C., 1995. Electro-optical imaging system performance, Bellingham, WA: SPIE Optical Engineering Press: 146-147.
Huang P.S. et T. Te-Ming, 2003. E target fusion-based approach for classifying high spatial resolution imagery, In Workshops "Advances in Techniques for Analysis of Remotely Sensed Data", 27-28 Oct. 2003: 175-181.
IRARS, 1996. Civil NIIRS Reference Guide, Imagery Resolution Assessment and Reporting Standards Committee, U.S. Government, Washington, D.C., 4 p., 3 annexes.
Kong X.N. et D. Vidal-Madjar, 1988. Effet de la résolution spatiale sur les propriétés statistiques des images satellites: une étude de cas, International Journal of Remote Sensing, vol. 9, 1315-1328.
Kristjansson J.E., 1991. Cloud parametrization at different horizontal resolutions, Quaterly Journal of the Royal Meteorology Society, Vol. 117: 1255-1280.
Latry C, 2003. La chaîne de fusion de données SPOT5, SFPT, vol. 1, N°169: 46-52.
Lei F. et H. Tiziani, 1989. Modulation transfer function obtained from image structures, In Proceedings and Workshops "High precision navigation", K. Linkwithz and U. Hangleiter (Eds.), Springer, Heidelberg: 366-377.
Li H., 1994. Multi-sensor image fusion using the wavelet transform, In ICIP-94., IEEE International conference, vol. 1: 51-54.
Li J., 2000. Spatial quality evaluation of fusion of different resolution images, In International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Amsterdam, Pays-Bas, vol. 33, B2-2: 339-346.
Li, S., Adelson, E.H., Wang, Y. 2001. Combination of images with diverse focuses using the spatial frequency. InfusionsTherapie, vol. 2, N°3: 169-176.
Lillesand T. M. et R. W. Kiefer, 1994. Remote Sensing and Image Interpretation. Third edition, John Wiley & Sons, New York, 750 p.
Lillo-Saavedra, M., Gonzalo, C., Arquero, A., Martinez, E., 2005. Fusion of multispectral and panchromatic satellite imagery based on tailored filtering in the Fourier domain. International Journal of Remote Sensing, 26, N°6: 1263-1268.
Liu J.G. et J. McM. Moore, 1998. Pixel block mixing modulation: adding spatial detail to TM band 6 thermal imagery, International Journal of Remote Sensing, vol. 19: 2477-2491.
Liu J.G., 2000. Smoothing Filter-based Intensity Modulation: a spectral preserve image fusion technique for improving spatial details, International Journal of Remote Sensing, vol. 21, N°18: 3461-3472.
Luxen M. et W. Förstner, 2002. Characterizing Image Quality: Blind Estimation of the Point Spread Function from a Single Image. In Proceedings of Photogrammetric Computer Vision 2002, ISPRS commission III, September 9-13, 2002, Gratz, Austria: 205-210.
Mallat S., 1989. A theory for multiresolution signal decomposition: the wavelet representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 11, N°7: 674-693.
Mallat S., 1998. A wavelet tour of signal processing, Academic press, USA, ISBN 0-12-466605-1, 577 p.
Mangolini M., 1994. Apport de la fusion d'images satellitaires multicapteurs au niveau pixel en télédétection et photo-interprétation. Thèse de Doctorat en Sciences de l'Ingénieur, Université de Nice - Sophia Antipolis, Nice, France, 174 p.
Meentemeyer V, 1987. Scale effects in landscape studies, Ecological Studies, vol. 64: 15-21.
Meyer Y., S. Jaffard et O. Rioul, 1987. L'analyse par ondelettes, Pour la Science.
Meyer Y., 1992. Les Ondelettes, Algorithmes et Applications, Armand Colin (Eds.), Paris, France, 172 p.
Munechika C. K., J. S. Warnick, C. Salvaggio et J. R. Schott, 1993. Resolution enhancement of multispectral image data to improve classification accuracy. Photogrammetric Engineering & Remote Sensing, vol. 59, N°1: 67-72.
Nencini F., A. Garzelli, S. Baronti et L. Alparone, 2006. Remote sensing image fusion using the curvelet transform, Information Fusion, Digital Object Identifier 10.1016/j.inffus.2006.02.001, Elsevier (Eds.), to appear.
Nunez J., X. Otazu, O. Fors, A. Prades, V. Palà et R. Arbiol, 1999. Multiresolution-based image fusion with additive wavelet decomposition, IEEE Transactions on Geoscience and Remote Sensing, vol. 37, N°3: 1204-1211.
Otazu X., M. Gonzalez-Audicana, O. Fors et J. Nunez, 2005. Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods, IEEE Transactions on Geoscience and Remote Sensing, vol. 43, N°10: 2376-2385.
Otazu X., Gonzalez-Audicana M. et O. Fors, 2006. A framework to introduce sensor spectral response into image fusion methods. The WiSpeR and FAST-WiSpeR implementations, In Proceedings of the 26th EARSeL Symposium "New Strategies for European Remote Sensing", 29-31 May 2006, Varsovie, Pologne.
Pajares G. et J.M. Cruz, 2004. A wavelet-based image fusion tutorial, Pattern Recognition, doi:10.1016/j.patcog.2004.03.010, vol. 37, N°9: 1855-1872.
Pellemans A, R. Jordans et R. Allewiijn, 1993. Merging multispectral and panchromatic SPOT images with respect to the radiometric properties of the sensor, Photogrammetric Engineering & Remote Sensing, vol. 59, N°1: 81-87.
Piella G., 2003. A general framework for multiresolution image fusion: from pixels to regions, Information Fusion, vol. 4: 259-280.
Piella G. et H. Heijmans, 2003. A new quality metric for image fusion, In Proceedings of the IEEE International conference on Image Processings, vol. 3/4: 173-176.
Pohl C., Y. Wang et B.N. Koopmans, 1994. The 1995 flood in the Netherland space, ITC Journal, vol. 4: 414-415.
Pohl C. et J.L. Van Genderen, 1998. Multisensor image fusion in remote sensing: concepts, methods and applications, International Journal of Remote Sensing, vol. 19, N°5: 823-854.
Pradines D., 1986. Improving SPOT image size and multispectral resolution. In Proceedings SPIE Conference "Earth Remote Sensing using the Landsat Thematic Mapper and SPOT Systems", 660: 78-102.
Price J.C.,1999. Combining multispectral data of differing spatial resolution, IEEE Transactions on Geosciences and Remote Sensing, vol. 37, N°3: 1199-1203.
Profanter C., R. Prommegger, M. Gabriel, R. Moncayo, G. J. Wetscher, T. Lang et R. Bale, 2004. Computed axial tomography-MIBI image fusion for preoperative localization in primary hyperparathyroidism, The American Journal of Surgery, vol. 187, N°3: 383-387.
Puissant A. et J. Hirsch, 2004. Télédétection urbaine et résolution spatiale optimale: intérêt pour les utilisateurs et aide pour les classifications, Revue internationale de Géomatique, Lavoisier (Eds.): 403-415.
Raffy M., 1993. Remotely-sensed quantification of covered areas and spatial resolution. International Journal of Remote Sensing, vol. 14, N°1: 135-159.
Raffy M., 1994. The role of spatial resolution in quantification problems: spatialization method, International Journal of Remote Sensing, vol. 15, N°12: 2381-2392.
Ranchin T. et L. Wald, 1992. The wavelet transform for the analysis of remotely sensed images, International Journal of Remote Sensing, vol. 14, N°3: 615-619.
Ranchin T. et Wald, L. 2000. Fusion of high spatial and spectral resolution images: the ARSIS concept and its implementation. Photogrammetric Engineering and Remote Sensing, vol. 66, N°1: 4-18.
Ranchin T., B. Aiazzi, L. Alparone, S. Baronti et L. Wald, 2003. Image fusion-the ARSIS concept and some successful implementation schemes, International Journal of Remote Sensing, Digital Object Identifier 10.1016/S0924-2716(03)00013-3, Elsevier (Eds.), vol. 58, N°1-2: 4-18.
Raptis V.S., Vaughan R.A., T. Ranchin et L. Wald, 1998. Assessment of different data fusion methods for the classification of an urban environment, In Proceedings of the second conference "Fusion of Earth data: merging point measurements, raster maps and remotely sensed images", 28-30 January 1998, publié par SEE/URISCA, Nice, Sophia-Antipolis, France, Ranchin T et Wald L. (Eds.): 167-182.
Redondo R., F. Sroubek, S. Fisher et G. Cristobal, 2005. Multifocus fusion with multisize windows, Applications of DigitalImage Processing XXVIII, Andrew G. et Tescher (Eds.), Proc. SPIE, vol. 5909: 410-418.
Remund J., Wald L., Lefevre M., Ranchin T., Page J., 2003. Worldwide Linke turbidity information. In proceedings of ISES Solar World Congress, 16-19 June, Göteborg, Sweden, CD-ROM published by International Solar Energy Society.
Ricchetti E., 2004. Application of optical high resolution satellite imagery for archaeological prospection over Hierapolis (Turkey), In Proceedings of Geoscience and Remote Sensing Symposium, IGARSS'04, IEEE International, Digital Object Identifier 10.1109/IGARSS.2004.1369976, vol. 6: 3898-3901.
Rokhmatuloh M.A., R. Tateishi, K. Wikantika et K. Munadi, 2003. Study on the spectral quality preservation derived from multisensor image fusion techniques between JERS-1 SAR and Landsat TM data, In proceedings IEEE International Geoscience and Remote Sensing Symposium IGARSS 2003, 21-25 July 2003, Toulouse, France.
Ryan R., Baldridge B., Schowengerdt R.A., Choi T., Helder D.L. et S. Blonski, 2003. IKONOS spatial resolution and image interpretability characterization, Remote Sensing of Environment, vol. 88: 37-52.
Sengupta S.K., A.S. Lopez et D.N. Poland, 2004. Class-label statistics: a basis for fusing information from multispectral imagery with an application to unsupervised detection of human settlement, In Proceedings of Geoscience and Remote Sensing Symposium, IGARSS'04, IEEE International, Digital Object Identifier 10.1109/IGARSS.2004.1368600, vol. 2: 1084-1087.
Shettigara V.K., 1992. A generalized component substitution technique for spatial enhancement of multispectral images using higher resolution data set, Photogrammetric Engineering and Remote Sensing, vol. 58, N°5: 561-567.
Shi W., C. Zhu, Y. Tian et J. Nichol, 2005. Wavelet-based image fusion and quality assessment, International Journal of Applied Earth Observation and Geoinformation, vol. 6: 241-251.
Smith A.R., 1978. Colour gamut transform pairs, Computer Graphics, vol. 12: 12-19.
Starck J.L., F. Murtagh, E.J. Candès et D.L. Donoho, 2003. Gray and color image contrast enhancement by the curvelet transform, IEEE Transactions on Image Processing, vol. 12, N°6: 706-716.
Terretaz P., 1997. Comparison of different methods to merge SPOT P and XS data: Evaluation in an urban area. In Proceedings of the 17th Symposium of EARSeL, Future Trends in Remote Sensing, Gudmansen P. (Eds.), Lyngby, Denmark, 17-20 June. A.A. Balkema, Rotterdam: 435-445.
Thomas C., Ranchin T., Wald L. et Lanéri, J.C., 2005. A modular platform for fusion of images. In Proceedings of the Fourth International Conference Physics in Image and Signal Processing PSIP'2005, January 31-February 2 2005, Toulouse, France, ISBN 2-912328-22-5: 269-273.
Thomas C. et Wald L., 2005. Assessment of the quality of fused products. In Proceedings of the 24th EARSeL Symposium "New Strategies for European Remote Sensing", 25-27 May 2004, Dubrovnik, Croatia, Oluic (Eds.), Millpress, Rotterdam, ISBN 90 5966 003 X: 317-325.
Thomas C. et L. Wald, 2006a. Analysis of changes in quality assessment with scales, In Proceedings of FUSION06, 10-13 July 2006, Florence, Italie.
Thomas C. et L. Wald, 2006b. A MTF-based distance for the assessment of the geometrical quality of fused products, In Proceedings of FUSION06, 10-13 July 2006, Florence, Italie.
Thomas C. et Wald L., 2006c. Comparing distances for quality assessment of fused products, In Proceedings of the 26th EARSeL Symposium "New Strategies for European Remote Sensing", 29-31 May 2006, Varsovie, Pologne.
Tsagaris V., V. Anastassopoulos et G.A. Lampropoulos, 2005. Fusion of hyperspectral data using segmented PCT for color representation and classification, IEEE Transactions on Geoscience and Remote Sensing, vol. 43, N°10: 2365-2375.
Tu T.M., S.C. Su, H.C. Shyu and P.S. Huang, 2001. A new look at IHS-like image fusion methods, Information Fusion, vol. 2, N°3: 177-186.
Tu T.M., P.S. Huang, C.L. Hung et C.P. Chang, 2004. A fast intensity-hue-saturation technique with spectral adjustment for Ikonos imagery, IEEE Geosciences and Remote-Sensing Letters, vol. 1, N°4: 309-312.
Vijayaraj V.; C. O'Hara et N. Younan, 2004. Quality analysis of pan-sharpened images, In Proceedings of Geoscience and Remote Sensing Symposium, IGARSS'04, IEEE International, Digital Object Identifier 10.1109/IGARSS.2004.1368951, vol. 1: 85-88.
Vrabel J., 1996. Multispectral imagery band sharpening study, Photogrammetric Engineering and Remote Sensing, vol. 58, N°9: 1075-1083.
Vrabel J., 2000. Multispectral imagery advanced band sharpening study, Photogrammetric Engineering and Remote Sensing, vol. 66, N°1: 73-79.
Wald L. et T. Ranchin, 1995. Fusion of images and raster-maps of different spatial resolutions by encrustation: an improved approach. Computers, Environment and Urban Systems, vol. 19, N°2: 77-87.
Wald L., T. Ranchin et M. Mangolini, 1997. Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images, Photogrammetric Engineering and Remote Sensing, vol. 63, N°6: 691-699.
Wald L., 1999. Some terms of reference in data fusion, IEEE Transactions on Geoscience and Remote Sensing, vol. 37, N°3: 1190-1193.
Wald L., 2000. Quality of high resolution synthesised images: Is there a simple criterion ?. In Proceedings of the third conference "Fusion of Earth data: merging point measurements, raster maps and remotely sensed images", Sophia Antipolis, France, January 26-28, 2000, Thierry Ranchin and Lucien Wald (Eds.), published by SEE/URISCA, Nice, France, pp 99-103.
Wald L., 2002. Data Fusion: Definitions and Architectures. Fusion of Images of Different Spatial Resolutions, Les Presses de l'Ecole des Mines (Eds.), Paris, 197 p.
Wang Z. et A.C. Bovik, 2002. A universal image quality index, IEEE Signal Processing Lett., Transactions on Pattern Analysis and Machine Intelligence, vol. 9: 81-84.
Wang Z., D. Ziou, C. Armenakis, D. Li et Q. Li, 2005. A comparative analysis of image fusion methods, Transactions on Geoscience and Remote Sensing, vol. 43, N°6: 81-84.
Welch R.M., M.S. Navar et S.K. Sengupta, 1989. The effect of spatial resolution upon texture-based cloud field classifications, Journal of Geophysical Research, vol. 94 (D.12): 14767-14781.
Woodcock C. E. et A. H. Strahler, 1987. The factor of scale in remote sensing. Remote Sensing of Environment, vol. 21: 311-332.
Xydeas C. et V. Petrovic, 2000. Objective image fusion performance measure, Electronics Letters, N°36: 308-309.
Yang W., F. Cauneau, J.P. Paris et T. Ranchin, 2000. Influence of landscape changes on the results of the fusion of P and XS images by different methods. In Proceedings of the third conference "Fusion of Earth data: merging point measurements, raster maps and remotely sensed images", 26-28 January 2000. SEE/URISCA, Nice, Sophia-Antipolis, France, Ranchin T. et Wald L. (Eds.): 47-56.
Yang X.H., Z.L. Jing, G. Liu, L.-Z. Hua et D.W. Ma, 2006. Fusion of multi-spectral and panchromatic images using fuzzy rule, Nonlinear Science and Numerical Simulation, Digital Object Identifier 10.1016/j.cnsns.2005.12.001, Elsevier (Eds.), to appear.
Yocky, D. A., 1996. Multiresolution wavelet decomposition image merger of Landsat Thematic Mapper and SPOT panchromatic data, Photogrammetric Engineering and Remote Sensing, vol. 62, N°9: 1067-1074.
Zhang Q. et J. Wang, 2002. Detection of buildings from Landsat-7 ETM+ and SPOT panchromatic data in Beijing, China, In Proceedings of Geoscience and Remote Sensing Symposium, IGARSS'02, IEEE International, Digital Object Identifier 10.1109/IGARSS.2002.1026841, vol. 5: 2977-2979.
Zhang Y., 1999. A new merging method and its spectral and spatial effects, International Journal of Remote Sensing, vol. 20, N°10: 2003-2014.
Zheng Y., E.A. Essock, B.C. Hansen et E.M. Haun, 2005. A new metric based on extended spatial frequency and its application to DWT based fusion algorithms, Information Fusion, Digital Object Identifier 10.1016/j.inffus.2005.04.003, Elsevier (Eds.), to appear.
Zhijun W., D. Ziou et C. Armenakis, 2004. Production of high-resolution remote sensing images for navigation information infrastructures, Geospatial information science, vol. 7, N°2: 129-134.
Zhou J., D.L. Civco et J.A. Silvander, 1998. A wavelet transform method to merge Landsat TM and SPOT panchromatic data, International Journal of Remote Sensing, vol. 19, N°4: 743-757.

Table of content

I - INTRODUCTION A LA FUSION D'IMAGES ET OBJECTIF DE LA THESE
I.1 Présentation du problème
I.2 Illustration des contraintes liées la synthèse d'images à haute résolution spatiale
I.2.1 Occultations d'objets
I.2.2 Inversions de contraste
I.3 Objectif de la thèse
I.4 Démarche suivie
I.5 Notations
II - QUALITE
II.1 Introduction
II.1.1 Les enjeux de la qualité des images fusionnées
II.1.2 Les paramètres qui influencent la qualité des produits fusionnés
II.2 Proposition d'un nouveau protocole d'évaluation de la qualité des produits de fusion
II.2.1 De la littérature aux propriétés
II.2.2 La propriété de cohérence
II.2.3 La propriété de synthèse
II.3 Le problème de la référence
II.3.1 Lacunes rencontrées dans la littérature
II.3.2 Proposition de référence et vérification de la propriété de synthèse
II.3.3 Application du protocole
II.3.4 Conclusion et limites du protocole
II.4 Les outils de l'évaluation de la qualité des produits de fusion
II.4.1 Analyse visuelle
II.4.2 Analyse quantitative
II.4.3 Redondances/complémentarités entre distances
II.4.4 Proposition de bilans de qualité
III ETUDE DE L'HYPOTHESE D'EXTRAPOLATION DU BILAN DE QUALITE
III.1 Démarche suivie
III.2 Images sélectionnées pour l'étude
III.3 Choix des bilans de qualité (BQ)
III.4 Exemples de résultats obtenus par la plate-forme qualité
III.5 Résultats statistiques pour la vérification de l'hypothèse
III.5.1 Une vérification par cas
III.5.2 Présentation de la forme des résultats
III.5.3 Résultats pour les BQ monomodaux
III.5.4 Résultats pour les BQ multimodaux
III.5.5 Résultats pour les BQ globaux
III.6 Description et interprétation des résultats
III.6.1 Grandes tendances
III.6.2 Description des tableaux de résultats
III.7 Critique de la démarche de l'étude empirique
III.7.1 Remarque sur la distance Q
III.7.2 Influence de l'algorithme de décomposition multiéchelle
III.7.3 Identification des images défavorables
III.7.4 Analyse complémentaire: vérification sur des extraits Pléiades
III.8 Conclusion et perspectives
IV UN Nouvel outil pour l'évaluation de la qualité géométrique basé sur la FTM
IV.1 Introduction
IV.1.1 Etalonnage et fonction de transfert de modulation
IV.1.2 Définition de la FTM
IV.2 Présentation de notre méthode d'estimation de la FTM
IV.2.1 Limite des méthodes existantes
IV.2.2 Principe de l'estimation de la FTM
IV.2.3 Calcul de l'équation de la droite du contour
IV.2.4 Du profil suréchantillonné à la FTM
IV.2.5 Validation de l'algorithme
IV.2.6 Conclusion sur la méthode d'estimation et perspectives d'amélioration
IV.3 Proposition d'une nouvelle distance pour l'évaluation de la qualité géométrique des produits de fusion (L2CFC)
IV.3.1 Extrait d'une arête d'un immeuble de Toulouse
IV.3.2 Extrait de la prison de Toulouse
IV.4 Conclusion
V CATEGORIES DE METHODES DE FUSION
V.1 Introduction
V.2 Les méthodes de type projection-substitution (COS)
V.2.1 Rappel sur la notion d'espace de représentation des couleurs et principe de ce type de méthodes
V.2.2 La méthode IHS linéaire
V.2.3 La méthode ACP
V.3 Les méthodes de type contribution spectrale relative
V.3.1 Hypothèse de base de ces méthodes
V.3.2 La méthode Brovey
V.3.3 La méthode CN (Color Normalized)
V.3.4 La méthode P+XS (CNES)
V.4 Le concept ARSIS
V.4.1 Présentation du concept
V.4.2 Quelques exemples réalisations du concept
V.4.3 Le ratio 4 dans le cas particulier d'un MSM dyadique
V.5 Conclusion à propos des différents types de méthodes
V.5.1 Méthodes de type projection-substitution et de contribution spectrale relative
V.5.2 Méthodes de type ARSIS
V.5.3 Rappel sur les précautions à prendre concernant la qualité d'une méthode
V.6 Critique des méthodes de fusion récentes
V.6.1 La méthode de Ballester et al. (2003)
V.6.2 Méthodes combinant IHS à ARSIS ou à la contribution spectrale relative
V.6.3 Retour à la définition de la fusion pour définir les voies de développement prometteuses
VI NOUVELLES METHODES DE FUSION
VI.1 Artefacts des méthodes de type ARSIS
VI.1.1 Méthodes de fusion testées et illustrations choisies
VI.1.2 Bilan de la qualité visuelle méthode par méthode
VI.1.3 Description et explications des artefacts visuels
VI.1.4 Conclusion: vers de nouvelles méthodes de fusion
VI.2 Description et évaluation de nouvelles méthodes de fusion
VI.2.1 ATWT-M3-FONC
VI.2.2 ATWT-SharpenedM3
VI.2.3 ATWT-EnhancedRWM
VI.3 Evaluation de la qualité des nouvelles méthodes
VI.3.1 Evaluation visuelle des produits de fusion à haute résolution
VI.3.2 Evaluation des propriétés de cohérence et de synthèse
VI.4 Conclusion
VII CONCLUSION, RECOMMANDATIONS ET PERSPECTIVES
BIBLIOGRAPHIE
LISTE DES FIGURES
LISTE DES TABLEAUX
ANNEXES

Statistiques de consultation

Repository Staff Only: edit this item