Switching system for image enhancement and analysis of fused thermal and RGBD data

Sos S. Agaian, Vijay Sridharan, Michael Blanton

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    A number of methods have been developed in the past for color image enhancement, including retinex and color constancy algorithms. Retinex theory is based on psychophysical experiments using mondrian patterns. Recently, multi-scale retinex algorithms have been developed. They combine several "Retinex" outputs to produce a single output image which has both good dynamic range compression and color constancy, as well as good tonal rendition. Unfortunately, multi-scale retinex processing time is consuming. In this paper we present a new algorithm for color and thermal image enhancement. Additionally, an experimental prototype system for fusing the two data types with depth data to create a three-dimensional map of the datasets is presented. The image processing algorithm utilizes a combination of fourier domain and retinex algorithms. Different types of thermal and natural scene NASA images have been tested, along with other imagery. The primary advantages of the image processing algorithm are the reduced computational complexity and the contrast enhancement performance. Experimental results demonstrate that the algorithm works well with underexposed images. The algorithm also gives better contrast enhancement in most cases, thus bringing out the true colors in the image. It thus helps in achieving both color constancy and local contrast enhancement. We compare the presented method with enhancement based on NASA's Multi-scale Retinex. Statistically and quantitatively, we have shown that our technique indeed results in enhanced images, with our argument validated by conducting experiments on human observers. Additionally, the fusion of 2-dimensional (2D) thermal, 2D RGB, and 3-dimensional (3D) depth data (TRGBD) can be analyzed and researched for the purpose of extrapolating thermal conductance and other thermal properties within a scanned environment. This will allow for the determination of energy assessments regarding structural boundaries, the effectiveness of insulation, leakages of heat, water and refrigerant, and computing the true value of observed thermal losses/gains as they are related not only to thermal properties, but geometries as well. The data generated from this analysis can be used in many other domains and process evaluation fields such as medical, geological, architectural and others.

    Original languageEnglish (US)
    Title of host publicationMobile Multimedia/Image Processing, Security, and Applications 2012
    Volume8406
    DOIs
    StatePublished - 2012
    EventMobile Multimedia/Image Processing, Security, and Applications 2012 - Baltimore, MD, United States
    Duration: Apr 23 2012Apr 24 2012

    Other

    OtherMobile Multimedia/Image Processing, Security, and Applications 2012
    CountryUnited States
    CityBaltimore, MD
    Period4/23/124/24/12

    Fingerprint

    Switching Systems
    image enhancement
    Image Enhancement
    Image enhancement
    Switching systems
    image analysis
    Image Analysis
    Image analysis
    Color Constancy
    Color
    color
    Contrast Enhancement
    Data Depth
    augmentation
    Thermal Properties
    NASA
    image processing
    Image Processing
    Image processing
    Thermodynamic properties

    Keywords

    • 3D
    • contrast enhancement
    • data fusion
    • depth data
    • fast retinex
    • image enhancement
    • Multi-scale retinex
    • thermal

    ASJC Scopus subject areas

    • Applied Mathematics
    • Computer Science Applications
    • Electrical and Electronic Engineering
    • Electronic, Optical and Magnetic Materials
    • Condensed Matter Physics

    Cite this

    Agaian, S. S., Sridharan, V., & Blanton, M. (2012). Switching system for image enhancement and analysis of fused thermal and RGBD data. In Mobile Multimedia/Image Processing, Security, and Applications 2012 (Vol. 8406). [84060Z] https://doi.org/10.1117/12.924755

    Switching system for image enhancement and analysis of fused thermal and RGBD data. / Agaian, Sos S.; Sridharan, Vijay; Blanton, Michael.

    Mobile Multimedia/Image Processing, Security, and Applications 2012. Vol. 8406 2012. 84060Z.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Agaian, SS, Sridharan, V & Blanton, M 2012, Switching system for image enhancement and analysis of fused thermal and RGBD data. in Mobile Multimedia/Image Processing, Security, and Applications 2012. vol. 8406, 84060Z, Mobile Multimedia/Image Processing, Security, and Applications 2012, Baltimore, MD, United States, 4/23/12. https://doi.org/10.1117/12.924755
    Agaian SS, Sridharan V, Blanton M. Switching system for image enhancement and analysis of fused thermal and RGBD data. In Mobile Multimedia/Image Processing, Security, and Applications 2012. Vol. 8406. 2012. 84060Z https://doi.org/10.1117/12.924755
    Agaian, Sos S. ; Sridharan, Vijay ; Blanton, Michael. / Switching system for image enhancement and analysis of fused thermal and RGBD data. Mobile Multimedia/Image Processing, Security, and Applications 2012. Vol. 8406 2012.
    @inproceedings{88de390d63114fba9ad4518a9421c1bb,
    title = "Switching system for image enhancement and analysis of fused thermal and RGBD data",
    abstract = "A number of methods have been developed in the past for color image enhancement, including retinex and color constancy algorithms. Retinex theory is based on psychophysical experiments using mondrian patterns. Recently, multi-scale retinex algorithms have been developed. They combine several {"}Retinex{"} outputs to produce a single output image which has both good dynamic range compression and color constancy, as well as good tonal rendition. Unfortunately, multi-scale retinex processing time is consuming. In this paper we present a new algorithm for color and thermal image enhancement. Additionally, an experimental prototype system for fusing the two data types with depth data to create a three-dimensional map of the datasets is presented. The image processing algorithm utilizes a combination of fourier domain and retinex algorithms. Different types of thermal and natural scene NASA images have been tested, along with other imagery. The primary advantages of the image processing algorithm are the reduced computational complexity and the contrast enhancement performance. Experimental results demonstrate that the algorithm works well with underexposed images. The algorithm also gives better contrast enhancement in most cases, thus bringing out the true colors in the image. It thus helps in achieving both color constancy and local contrast enhancement. We compare the presented method with enhancement based on NASA's Multi-scale Retinex. Statistically and quantitatively, we have shown that our technique indeed results in enhanced images, with our argument validated by conducting experiments on human observers. Additionally, the fusion of 2-dimensional (2D) thermal, 2D RGB, and 3-dimensional (3D) depth data (TRGBD) can be analyzed and researched for the purpose of extrapolating thermal conductance and other thermal properties within a scanned environment. This will allow for the determination of energy assessments regarding structural boundaries, the effectiveness of insulation, leakages of heat, water and refrigerant, and computing the true value of observed thermal losses/gains as they are related not only to thermal properties, but geometries as well. The data generated from this analysis can be used in many other domains and process evaluation fields such as medical, geological, architectural and others.",
    keywords = "3D, contrast enhancement, data fusion, depth data, fast retinex, image enhancement, Multi-scale retinex, thermal",
    author = "Agaian, {Sos S.} and Vijay Sridharan and Michael Blanton",
    year = "2012",
    doi = "10.1117/12.924755",
    language = "English (US)",
    isbn = "9780819490841",
    volume = "8406",
    booktitle = "Mobile Multimedia/Image Processing, Security, and Applications 2012",

    }

    TY - GEN

    T1 - Switching system for image enhancement and analysis of fused thermal and RGBD data

    AU - Agaian, Sos S.

    AU - Sridharan, Vijay

    AU - Blanton, Michael

    PY - 2012

    Y1 - 2012

    N2 - A number of methods have been developed in the past for color image enhancement, including retinex and color constancy algorithms. Retinex theory is based on psychophysical experiments using mondrian patterns. Recently, multi-scale retinex algorithms have been developed. They combine several "Retinex" outputs to produce a single output image which has both good dynamic range compression and color constancy, as well as good tonal rendition. Unfortunately, multi-scale retinex processing time is consuming. In this paper we present a new algorithm for color and thermal image enhancement. Additionally, an experimental prototype system for fusing the two data types with depth data to create a three-dimensional map of the datasets is presented. The image processing algorithm utilizes a combination of fourier domain and retinex algorithms. Different types of thermal and natural scene NASA images have been tested, along with other imagery. The primary advantages of the image processing algorithm are the reduced computational complexity and the contrast enhancement performance. Experimental results demonstrate that the algorithm works well with underexposed images. The algorithm also gives better contrast enhancement in most cases, thus bringing out the true colors in the image. It thus helps in achieving both color constancy and local contrast enhancement. We compare the presented method with enhancement based on NASA's Multi-scale Retinex. Statistically and quantitatively, we have shown that our technique indeed results in enhanced images, with our argument validated by conducting experiments on human observers. Additionally, the fusion of 2-dimensional (2D) thermal, 2D RGB, and 3-dimensional (3D) depth data (TRGBD) can be analyzed and researched for the purpose of extrapolating thermal conductance and other thermal properties within a scanned environment. This will allow for the determination of energy assessments regarding structural boundaries, the effectiveness of insulation, leakages of heat, water and refrigerant, and computing the true value of observed thermal losses/gains as they are related not only to thermal properties, but geometries as well. The data generated from this analysis can be used in many other domains and process evaluation fields such as medical, geological, architectural and others.

    AB - A number of methods have been developed in the past for color image enhancement, including retinex and color constancy algorithms. Retinex theory is based on psychophysical experiments using mondrian patterns. Recently, multi-scale retinex algorithms have been developed. They combine several "Retinex" outputs to produce a single output image which has both good dynamic range compression and color constancy, as well as good tonal rendition. Unfortunately, multi-scale retinex processing time is consuming. In this paper we present a new algorithm for color and thermal image enhancement. Additionally, an experimental prototype system for fusing the two data types with depth data to create a three-dimensional map of the datasets is presented. The image processing algorithm utilizes a combination of fourier domain and retinex algorithms. Different types of thermal and natural scene NASA images have been tested, along with other imagery. The primary advantages of the image processing algorithm are the reduced computational complexity and the contrast enhancement performance. Experimental results demonstrate that the algorithm works well with underexposed images. The algorithm also gives better contrast enhancement in most cases, thus bringing out the true colors in the image. It thus helps in achieving both color constancy and local contrast enhancement. We compare the presented method with enhancement based on NASA's Multi-scale Retinex. Statistically and quantitatively, we have shown that our technique indeed results in enhanced images, with our argument validated by conducting experiments on human observers. Additionally, the fusion of 2-dimensional (2D) thermal, 2D RGB, and 3-dimensional (3D) depth data (TRGBD) can be analyzed and researched for the purpose of extrapolating thermal conductance and other thermal properties within a scanned environment. This will allow for the determination of energy assessments regarding structural boundaries, the effectiveness of insulation, leakages of heat, water and refrigerant, and computing the true value of observed thermal losses/gains as they are related not only to thermal properties, but geometries as well. The data generated from this analysis can be used in many other domains and process evaluation fields such as medical, geological, architectural and others.

    KW - 3D

    KW - contrast enhancement

    KW - data fusion

    KW - depth data

    KW - fast retinex

    KW - image enhancement

    KW - Multi-scale retinex

    KW - thermal

    UR - http://www.scopus.com/inward/record.url?scp=84874822146&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84874822146&partnerID=8YFLogxK

    U2 - 10.1117/12.924755

    DO - 10.1117/12.924755

    M3 - Conference contribution

    SN - 9780819490841

    VL - 8406

    BT - Mobile Multimedia/Image Processing, Security, and Applications 2012

    ER -