Methodological and Computational Aspects of Parallel Tempering Methods in the Infinite Swapping Limit

Jianfeng Lu, Eric Vanden Eijnden

Research output: Contribution to journalArticle

Abstract

A variant of the parallel tempering method is proposed in terms of a stochastic switching process for the coupled dynamics of replica configuration and temperature permutation. This formulation is shown to facilitate the analysis of the convergence properties of parallel tempering by large deviation theory, which indicates that the method should be operated in the infinite swapping limit to maximize sampling efficiency. The effective equation for the replica alone that arises in this infinite swapping limit simply involves replacing the original potential by a mixture potential. The analysis of the geometric properties of this potential offers a new perspective on the issues of how to choose of temperature ladder, and why many temperatures should typically be introduced to boost the sampling efficiency. It is also shown how to simulate the effective equation in this many temperature regime using multiscale integrators. Finally, similar ideas are also used to discuss extensions of the infinite swapping limits to the technique of simulated tempering.

Original languageEnglish (US)
JournalJournal of Statistical Physics
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

Parallel Tempering
tempering
Replica
replicas
Simulated Tempering
sampling
Large Deviation Theory
temperature
permutations
integrators
acceleration (physics)
ladders
Convergence Properties
Permutation
Choose
Maximise
deviation
formulations
Configuration
Formulation

Keywords

  • Infinite swapping limit
  • Multiscale integrator
  • Parallel tempering
  • Sampling

ASJC Scopus subject areas

  • Statistical and Nonlinear Physics
  • Mathematical Physics

Cite this

@article{f6a6451793fa4594ac42705ab3a30521,
title = "Methodological and Computational Aspects of Parallel Tempering Methods in the Infinite Swapping Limit",
abstract = "A variant of the parallel tempering method is proposed in terms of a stochastic switching process for the coupled dynamics of replica configuration and temperature permutation. This formulation is shown to facilitate the analysis of the convergence properties of parallel tempering by large deviation theory, which indicates that the method should be operated in the infinite swapping limit to maximize sampling efficiency. The effective equation for the replica alone that arises in this infinite swapping limit simply involves replacing the original potential by a mixture potential. The analysis of the geometric properties of this potential offers a new perspective on the issues of how to choose of temperature ladder, and why many temperatures should typically be introduced to boost the sampling efficiency. It is also shown how to simulate the effective equation in this many temperature regime using multiscale integrators. Finally, similar ideas are also used to discuss extensions of the infinite swapping limits to the technique of simulated tempering.",
keywords = "Infinite swapping limit, Multiscale integrator, Parallel tempering, Sampling",
author = "Jianfeng Lu and {Vanden Eijnden}, Eric",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/s10955-018-2210-y",
language = "English (US)",
journal = "Journal of Statistical Physics",
issn = "0022-4715",
publisher = "Springer New York",

}

TY - JOUR

T1 - Methodological and Computational Aspects of Parallel Tempering Methods in the Infinite Swapping Limit

AU - Lu, Jianfeng

AU - Vanden Eijnden, Eric

PY - 2019/1/1

Y1 - 2019/1/1

N2 - A variant of the parallel tempering method is proposed in terms of a stochastic switching process for the coupled dynamics of replica configuration and temperature permutation. This formulation is shown to facilitate the analysis of the convergence properties of parallel tempering by large deviation theory, which indicates that the method should be operated in the infinite swapping limit to maximize sampling efficiency. The effective equation for the replica alone that arises in this infinite swapping limit simply involves replacing the original potential by a mixture potential. The analysis of the geometric properties of this potential offers a new perspective on the issues of how to choose of temperature ladder, and why many temperatures should typically be introduced to boost the sampling efficiency. It is also shown how to simulate the effective equation in this many temperature regime using multiscale integrators. Finally, similar ideas are also used to discuss extensions of the infinite swapping limits to the technique of simulated tempering.

AB - A variant of the parallel tempering method is proposed in terms of a stochastic switching process for the coupled dynamics of replica configuration and temperature permutation. This formulation is shown to facilitate the analysis of the convergence properties of parallel tempering by large deviation theory, which indicates that the method should be operated in the infinite swapping limit to maximize sampling efficiency. The effective equation for the replica alone that arises in this infinite swapping limit simply involves replacing the original potential by a mixture potential. The analysis of the geometric properties of this potential offers a new perspective on the issues of how to choose of temperature ladder, and why many temperatures should typically be introduced to boost the sampling efficiency. It is also shown how to simulate the effective equation in this many temperature regime using multiscale integrators. Finally, similar ideas are also used to discuss extensions of the infinite swapping limits to the technique of simulated tempering.

KW - Infinite swapping limit

KW - Multiscale integrator

KW - Parallel tempering

KW - Sampling

UR - http://www.scopus.com/inward/record.url?scp=85059443822&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059443822&partnerID=8YFLogxK

U2 - 10.1007/s10955-018-2210-y

DO - 10.1007/s10955-018-2210-y

M3 - Article

JO - Journal of Statistical Physics

JF - Journal of Statistical Physics

SN - 0022-4715

ER -