Analysis of rolling shutter effect on ENF-based video forensics

Saffet Vatansever, Ahmet Emir Dirik, Nasir Memon

Research output: Contribution to journalArticle

Abstract

Electric network frequency (ENF) is a time-varying signal of the frequency of mains electricity in a power grid. It continuously fluctuates around a nominal value (50/60 Hz) due to changes in the supply and demand of power over time. Depending on these ENF variations, the luminous intensity of a mains-powered light source also fluctuates. These fluctuations in luminance can be captured by video recordings. Accordingly, the ENF can be estimated from such videos by the analysis of steady content in the video scene. When videos are captured by using a rolling shutter sampling mechanism, as is done mostly with CMOS cameras, there is an idle period between successive frames. Consequently, a number of illumination samples of the scene are effectively lost due to the idle period. These missing samples affect the ENF estimation, in the sense of the frequency shift caused and the power attenuation that results. This paper develops an analytical model for videos captured using a rolling shutter mechanism. This model illustrates how the frequency of the main ENF harmonic varies depending on the idle period length, and how the power of the captured ENF attenuates as idle period increases. Based on this, a novel idle period estimation method for potential use in camera forensics that is able to operate independently of video frame rate is proposed. Finally, a novel time-of-recording verification approach based on the use of multiple ENF components, idle period assumptions, and the interpolation of missing ENF samples is also proposed.

Original languageEnglish (US)
Article number8626496
Pages (from-to)2262-2275
Number of pages14
JournalIEEE Transactions on Information Forensics and Security
Volume14
Issue number9
DOIs
StatePublished - Sep 1 2019

Fingerprint

Circuit theory
Cameras
Video recording
Frequency estimation
Light sources
Analytical models
Luminance
Interpolation
Electricity
Lighting
Sampling

Keywords

  • camera forensics
  • camera verification
  • Electric network frequency (ENF)
  • idle period
  • multimedia forensics
  • rolling shutter
  • time-of-recording
  • time-stamp
  • video forensics

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Computer Networks and Communications

Cite this

Analysis of rolling shutter effect on ENF-based video forensics. / Vatansever, Saffet; Dirik, Ahmet Emir; Memon, Nasir.

In: IEEE Transactions on Information Forensics and Security, Vol. 14, No. 9, 8626496, 01.09.2019, p. 2262-2275.

Research output: Contribution to journalArticle

@article{4bc2a87d7d304ec98979b1657083a731,
title = "Analysis of rolling shutter effect on ENF-based video forensics",
abstract = "Electric network frequency (ENF) is a time-varying signal of the frequency of mains electricity in a power grid. It continuously fluctuates around a nominal value (50/60 Hz) due to changes in the supply and demand of power over time. Depending on these ENF variations, the luminous intensity of a mains-powered light source also fluctuates. These fluctuations in luminance can be captured by video recordings. Accordingly, the ENF can be estimated from such videos by the analysis of steady content in the video scene. When videos are captured by using a rolling shutter sampling mechanism, as is done mostly with CMOS cameras, there is an idle period between successive frames. Consequently, a number of illumination samples of the scene are effectively lost due to the idle period. These missing samples affect the ENF estimation, in the sense of the frequency shift caused and the power attenuation that results. This paper develops an analytical model for videos captured using a rolling shutter mechanism. This model illustrates how the frequency of the main ENF harmonic varies depending on the idle period length, and how the power of the captured ENF attenuates as idle period increases. Based on this, a novel idle period estimation method for potential use in camera forensics that is able to operate independently of video frame rate is proposed. Finally, a novel time-of-recording verification approach based on the use of multiple ENF components, idle period assumptions, and the interpolation of missing ENF samples is also proposed.",
keywords = "camera forensics, camera verification, Electric network frequency (ENF), idle period, multimedia forensics, rolling shutter, time-of-recording, time-stamp, video forensics",
author = "Saffet Vatansever and Dirik, {Ahmet Emir} and Nasir Memon",
year = "2019",
month = "9",
day = "1",
doi = "10.1109/TIFS.2019.2895540",
language = "English (US)",
volume = "14",
pages = "2262--2275",
journal = "IEEE Transactions on Information Forensics and Security",
issn = "1556-6013",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "9",

}

TY - JOUR

T1 - Analysis of rolling shutter effect on ENF-based video forensics

AU - Vatansever, Saffet

AU - Dirik, Ahmet Emir

AU - Memon, Nasir

PY - 2019/9/1

Y1 - 2019/9/1

N2 - Electric network frequency (ENF) is a time-varying signal of the frequency of mains electricity in a power grid. It continuously fluctuates around a nominal value (50/60 Hz) due to changes in the supply and demand of power over time. Depending on these ENF variations, the luminous intensity of a mains-powered light source also fluctuates. These fluctuations in luminance can be captured by video recordings. Accordingly, the ENF can be estimated from such videos by the analysis of steady content in the video scene. When videos are captured by using a rolling shutter sampling mechanism, as is done mostly with CMOS cameras, there is an idle period between successive frames. Consequently, a number of illumination samples of the scene are effectively lost due to the idle period. These missing samples affect the ENF estimation, in the sense of the frequency shift caused and the power attenuation that results. This paper develops an analytical model for videos captured using a rolling shutter mechanism. This model illustrates how the frequency of the main ENF harmonic varies depending on the idle period length, and how the power of the captured ENF attenuates as idle period increases. Based on this, a novel idle period estimation method for potential use in camera forensics that is able to operate independently of video frame rate is proposed. Finally, a novel time-of-recording verification approach based on the use of multiple ENF components, idle period assumptions, and the interpolation of missing ENF samples is also proposed.

AB - Electric network frequency (ENF) is a time-varying signal of the frequency of mains electricity in a power grid. It continuously fluctuates around a nominal value (50/60 Hz) due to changes in the supply and demand of power over time. Depending on these ENF variations, the luminous intensity of a mains-powered light source also fluctuates. These fluctuations in luminance can be captured by video recordings. Accordingly, the ENF can be estimated from such videos by the analysis of steady content in the video scene. When videos are captured by using a rolling shutter sampling mechanism, as is done mostly with CMOS cameras, there is an idle period between successive frames. Consequently, a number of illumination samples of the scene are effectively lost due to the idle period. These missing samples affect the ENF estimation, in the sense of the frequency shift caused and the power attenuation that results. This paper develops an analytical model for videos captured using a rolling shutter mechanism. This model illustrates how the frequency of the main ENF harmonic varies depending on the idle period length, and how the power of the captured ENF attenuates as idle period increases. Based on this, a novel idle period estimation method for potential use in camera forensics that is able to operate independently of video frame rate is proposed. Finally, a novel time-of-recording verification approach based on the use of multiple ENF components, idle period assumptions, and the interpolation of missing ENF samples is also proposed.

KW - camera forensics

KW - camera verification

KW - Electric network frequency (ENF)

KW - idle period

KW - multimedia forensics

KW - rolling shutter

KW - time-of-recording

KW - time-stamp

KW - video forensics

UR - http://www.scopus.com/inward/record.url?scp=85066471130&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066471130&partnerID=8YFLogxK

U2 - 10.1109/TIFS.2019.2895540

DO - 10.1109/TIFS.2019.2895540

M3 - Article

AN - SCOPUS:85066471130

VL - 14

SP - 2262

EP - 2275

JO - IEEE Transactions on Information Forensics and Security

JF - IEEE Transactions on Information Forensics and Security

SN - 1556-6013

IS - 9

M1 - 8626496

ER -