Evaluation of mesh-based motion estimation in H.263-like coders

Yao Wang, Jörn Ostermann

Research output: Contribution to journalArticle

Abstract

In this paper, we present two mesh-based motion estimation algorithms, and evaluate their performance when incorporated in an H.263-like block-based video coder. Both algorithms compute nodal motions in a hierarchical manner. Within each hierarchy level, the first algorithm (HMMA) minimizes the prediction error in the four elements surrounding each node, where the prediction is accomplished by a bilinear mapping. The optimal solution is obtained by a full search within a range defined by the topology of the mesh. The second algorithm (HBMA) minimizes the error in a block surrounding each node, assuming the motion in the block is constant. In both cases, bilinear mapping is used for motion-compensated prediction based on nodal displacements. The two algorithms are compared with an exhaustive block-matching algorithm (EBMA) by evaluating their performances in temporal prediction and in an H.263/TMN4 coder. For prediction only, the HMMA and HBMA algorithms yield visually more satisfactory results, even though the PSNR's of predicted images are on average lower. The coded images also have lower PSNR's at similar bit rates. The coding artifacts are different: while the block-based method leads to more severe block distortions, the mesh-based method experiences some warping artifacts. The HMMA algorithm out-performs HBMA slightly for certain sequences at the expense of higher computational complexity.

Original languageEnglish (US)
Pages (from-to)243-252
Number of pages10
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume8
Issue number3
DOIs
StatePublished - 1998

Fingerprint

Motion estimation
Computational complexity
Topology

Keywords

  • Mesh-based methods
  • Motion analysis
  • Motion compensation
  • Video coding

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Evaluation of mesh-based motion estimation in H.263-like coders. / Wang, Yao; Ostermann, Jörn.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 8, No. 3, 1998, p. 243-252.

Research output: Contribution to journalArticle

@article{9aa8e54c3b274f23a167ea681d31f69f,
title = "Evaluation of mesh-based motion estimation in H.263-like coders",
abstract = "In this paper, we present two mesh-based motion estimation algorithms, and evaluate their performance when incorporated in an H.263-like block-based video coder. Both algorithms compute nodal motions in a hierarchical manner. Within each hierarchy level, the first algorithm (HMMA) minimizes the prediction error in the four elements surrounding each node, where the prediction is accomplished by a bilinear mapping. The optimal solution is obtained by a full search within a range defined by the topology of the mesh. The second algorithm (HBMA) minimizes the error in a block surrounding each node, assuming the motion in the block is constant. In both cases, bilinear mapping is used for motion-compensated prediction based on nodal displacements. The two algorithms are compared with an exhaustive block-matching algorithm (EBMA) by evaluating their performances in temporal prediction and in an H.263/TMN4 coder. For prediction only, the HMMA and HBMA algorithms yield visually more satisfactory results, even though the PSNR's of predicted images are on average lower. The coded images also have lower PSNR's at similar bit rates. The coding artifacts are different: while the block-based method leads to more severe block distortions, the mesh-based method experiences some warping artifacts. The HMMA algorithm out-performs HBMA slightly for certain sequences at the expense of higher computational complexity.",
keywords = "Mesh-based methods, Motion analysis, Motion compensation, Video coding",
author = "Yao Wang and J{\"o}rn Ostermann",
year = "1998",
doi = "10.1109/76.678617",
language = "English (US)",
volume = "8",
pages = "243--252",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - Evaluation of mesh-based motion estimation in H.263-like coders

AU - Wang, Yao

AU - Ostermann, Jörn

PY - 1998

Y1 - 1998

N2 - In this paper, we present two mesh-based motion estimation algorithms, and evaluate their performance when incorporated in an H.263-like block-based video coder. Both algorithms compute nodal motions in a hierarchical manner. Within each hierarchy level, the first algorithm (HMMA) minimizes the prediction error in the four elements surrounding each node, where the prediction is accomplished by a bilinear mapping. The optimal solution is obtained by a full search within a range defined by the topology of the mesh. The second algorithm (HBMA) minimizes the error in a block surrounding each node, assuming the motion in the block is constant. In both cases, bilinear mapping is used for motion-compensated prediction based on nodal displacements. The two algorithms are compared with an exhaustive block-matching algorithm (EBMA) by evaluating their performances in temporal prediction and in an H.263/TMN4 coder. For prediction only, the HMMA and HBMA algorithms yield visually more satisfactory results, even though the PSNR's of predicted images are on average lower. The coded images also have lower PSNR's at similar bit rates. The coding artifacts are different: while the block-based method leads to more severe block distortions, the mesh-based method experiences some warping artifacts. The HMMA algorithm out-performs HBMA slightly for certain sequences at the expense of higher computational complexity.

AB - In this paper, we present two mesh-based motion estimation algorithms, and evaluate their performance when incorporated in an H.263-like block-based video coder. Both algorithms compute nodal motions in a hierarchical manner. Within each hierarchy level, the first algorithm (HMMA) minimizes the prediction error in the four elements surrounding each node, where the prediction is accomplished by a bilinear mapping. The optimal solution is obtained by a full search within a range defined by the topology of the mesh. The second algorithm (HBMA) minimizes the error in a block surrounding each node, assuming the motion in the block is constant. In both cases, bilinear mapping is used for motion-compensated prediction based on nodal displacements. The two algorithms are compared with an exhaustive block-matching algorithm (EBMA) by evaluating their performances in temporal prediction and in an H.263/TMN4 coder. For prediction only, the HMMA and HBMA algorithms yield visually more satisfactory results, even though the PSNR's of predicted images are on average lower. The coded images also have lower PSNR's at similar bit rates. The coding artifacts are different: while the block-based method leads to more severe block distortions, the mesh-based method experiences some warping artifacts. The HMMA algorithm out-performs HBMA slightly for certain sequences at the expense of higher computational complexity.

KW - Mesh-based methods

KW - Motion analysis

KW - Motion compensation

KW - Video coding

UR - http://www.scopus.com/inward/record.url?scp=0032099383&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032099383&partnerID=8YFLogxK

U2 - 10.1109/76.678617

DO - 10.1109/76.678617

M3 - Article

AN - SCOPUS:0032099383

VL - 8

SP - 243

EP - 252

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 3

ER -