Use of two-dimensional deformable mesh structures for video coding, Part II - The analysis problem and a region-based coder employing an active mesh representation

Yao Wang, Ouseb Lee, Anthony Vetro

Research output: Contribution to journalArticle

Abstract

This paper explores the use of the deformable mesh structure for motion/shape analysis and synthesis in an image sequence. In Part I of this paper, we reviewed theory and techniques developed in the finite element method for function interpolation and mapping using a given mesh structure. This constitutes the synthesis problem in a video coder employing a mesh-based motion model. Here in Part II, we present algorithms for the analysis problem, including scene-adaptive mesh generation and node tracking over successive frames. We also describe a region-based video coder that integrates the analysis and synthesis algorithms presented in this paper. The coder describes each region by an ensemble of connected quadrilateral elements embedded in a mesh structure. For each region, its shape and texture are described by the nodal positions and image functions of the elements in this region in an initial frame, while its motion (including shape deformation) is characterized by the nodal trajectories in the following frames, which are in turn specified by a few motion parameters. This coder has been applied to a typical common intermediate format (CIF) resolution, head-and-shoulder type sequence. The visual quality is significantly better than the H.263-TMN4 algorithm at about 50 Kb/s (for the luminance component only, 30 Hz).

Original languageEnglish (US)
Pages (from-to)647-659
Number of pages13
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume6
Issue number6
DOIs
StatePublished - 1996

Fingerprint

Image coding
Mesh generation
Luminance
Interpolation
Textures
Trajectories
Finite element method

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

@article{f1c0f0864df3422a8b398ba248345357,
title = "Use of two-dimensional deformable mesh structures for video coding, Part II - The analysis problem and a region-based coder employing an active mesh representation",
abstract = "This paper explores the use of the deformable mesh structure for motion/shape analysis and synthesis in an image sequence. In Part I of this paper, we reviewed theory and techniques developed in the finite element method for function interpolation and mapping using a given mesh structure. This constitutes the synthesis problem in a video coder employing a mesh-based motion model. Here in Part II, we present algorithms for the analysis problem, including scene-adaptive mesh generation and node tracking over successive frames. We also describe a region-based video coder that integrates the analysis and synthesis algorithms presented in this paper. The coder describes each region by an ensemble of connected quadrilateral elements embedded in a mesh structure. For each region, its shape and texture are described by the nodal positions and image functions of the elements in this region in an initial frame, while its motion (including shape deformation) is characterized by the nodal trajectories in the following frames, which are in turn specified by a few motion parameters. This coder has been applied to a typical common intermediate format (CIF) resolution, head-and-shoulder type sequence. The visual quality is significantly better than the H.263-TMN4 algorithm at about 50 Kb/s (for the luminance component only, 30 Hz).",
author = "Yao Wang and Ouseb Lee and Anthony Vetro",
year = "1996",
doi = "10.1109/76.544736",
language = "English (US)",
volume = "6",
pages = "647--659",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "6",

}

TY - JOUR

T1 - Use of two-dimensional deformable mesh structures for video coding, Part II - The analysis problem and a region-based coder employing an active mesh representation

AU - Wang, Yao

AU - Lee, Ouseb

AU - Vetro, Anthony

PY - 1996

Y1 - 1996

N2 - This paper explores the use of the deformable mesh structure for motion/shape analysis and synthesis in an image sequence. In Part I of this paper, we reviewed theory and techniques developed in the finite element method for function interpolation and mapping using a given mesh structure. This constitutes the synthesis problem in a video coder employing a mesh-based motion model. Here in Part II, we present algorithms for the analysis problem, including scene-adaptive mesh generation and node tracking over successive frames. We also describe a region-based video coder that integrates the analysis and synthesis algorithms presented in this paper. The coder describes each region by an ensemble of connected quadrilateral elements embedded in a mesh structure. For each region, its shape and texture are described by the nodal positions and image functions of the elements in this region in an initial frame, while its motion (including shape deformation) is characterized by the nodal trajectories in the following frames, which are in turn specified by a few motion parameters. This coder has been applied to a typical common intermediate format (CIF) resolution, head-and-shoulder type sequence. The visual quality is significantly better than the H.263-TMN4 algorithm at about 50 Kb/s (for the luminance component only, 30 Hz).

AB - This paper explores the use of the deformable mesh structure for motion/shape analysis and synthesis in an image sequence. In Part I of this paper, we reviewed theory and techniques developed in the finite element method for function interpolation and mapping using a given mesh structure. This constitutes the synthesis problem in a video coder employing a mesh-based motion model. Here in Part II, we present algorithms for the analysis problem, including scene-adaptive mesh generation and node tracking over successive frames. We also describe a region-based video coder that integrates the analysis and synthesis algorithms presented in this paper. The coder describes each region by an ensemble of connected quadrilateral elements embedded in a mesh structure. For each region, its shape and texture are described by the nodal positions and image functions of the elements in this region in an initial frame, while its motion (including shape deformation) is characterized by the nodal trajectories in the following frames, which are in turn specified by a few motion parameters. This coder has been applied to a typical common intermediate format (CIF) resolution, head-and-shoulder type sequence. The visual quality is significantly better than the H.263-TMN4 algorithm at about 50 Kb/s (for the luminance component only, 30 Hz).

UR - http://www.scopus.com/inward/record.url?scp=0030396581&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0030396581&partnerID=8YFLogxK

U2 - 10.1109/76.544736

DO - 10.1109/76.544736

M3 - Article

VL - 6

SP - 647

EP - 659

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 6

ER -