A Hierarchical Harmonic Mixing Method

Gilberto Bernardes, Matthew E.P. Davies, Carlos Guedes

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a hierarchical harmonic mixing method for assisting users in the process of music mashup creation. Our main contributions are metrics for computing the harmonic compatibility between musical audio tracks at small- and large-scale structural levels, which combine and reassess existing perceptual relatedness (i.e., chroma vector similarity and key affinity) and dissonance-based approaches. Underpinning our harmonic compatibility metrics are harmonic indicators from the perceptually-motivated Tonal Interval Space, which we adapt to describe musical audio. An interactive visualization shows hierarchical harmonic compatibility viewpoints across all tracks in a large musical audio collection. An evaluation of our harmonic mixing method shows our adaption of the Tonal Interval Space robustly describes harmonic attributes of musical instrument sounds irrespective of timbral differences and demonstrates that the harmonic compatibility metrics comply with the principles embodied in Western tonal harmony to a greater extent than previous approaches.

Original languageEnglish (US)
Title of host publicationMusic Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers
EditorsMatthew E.P. Davies, Mitsuko Aramaki, Richard Kronland-Martinet, Sølvi Ystad
PublisherSpringer-Verlag
Pages151-170
Number of pages20
ISBN (Print)9783030016913
DOIs
StatePublished - Jan 1 2018
Event13th international Symposium on Computer Music Multidisciplinary Research, CMMR 2017 - Matosinhos, Portugal
Duration: Sep 25 2017Sep 28 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11265 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other13th international Symposium on Computer Music Multidisciplinary Research, CMMR 2017
CountryPortugal
CityMatosinhos
Period9/25/179/28/17

Fingerprint

Harmonic
Musical instruments
Compatibility
Visualization
Acoustic waves
Metric
Interval
Music
Affine transformation
Attribute
Computing
Evaluation
Demonstrate

Keywords

  • Audio content analysis
  • Digital DJ interfaces
  • Music information retrieval
  • Music mashup

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Bernardes, G., Davies, M. E. P., & Guedes, C. (2018). A Hierarchical Harmonic Mixing Method. In M. E. P. Davies, M. Aramaki, R. Kronland-Martinet, & S. Ystad (Eds.), Music Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers (pp. 151-170). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11265 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-030-01692-0_11

A Hierarchical Harmonic Mixing Method. / Bernardes, Gilberto; Davies, Matthew E.P.; Guedes, Carlos.

Music Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers. ed. / Matthew E.P. Davies; Mitsuko Aramaki; Richard Kronland-Martinet; Sølvi Ystad. Springer-Verlag, 2018. p. 151-170 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11265 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bernardes, G, Davies, MEP & Guedes, C 2018, A Hierarchical Harmonic Mixing Method. in MEP Davies, M Aramaki, R Kronland-Martinet & S Ystad (eds), Music Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11265 LNCS, Springer-Verlag, pp. 151-170, 13th international Symposium on Computer Music Multidisciplinary Research, CMMR 2017, Matosinhos, Portugal, 9/25/17. https://doi.org/10.1007/978-3-030-01692-0_11
Bernardes G, Davies MEP, Guedes C. A Hierarchical Harmonic Mixing Method. In Davies MEP, Aramaki M, Kronland-Martinet R, Ystad S, editors, Music Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers. Springer-Verlag. 2018. p. 151-170. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-01692-0_11
Bernardes, Gilberto ; Davies, Matthew E.P. ; Guedes, Carlos. / A Hierarchical Harmonic Mixing Method. Music Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers. editor / Matthew E.P. Davies ; Mitsuko Aramaki ; Richard Kronland-Martinet ; Sølvi Ystad. Springer-Verlag, 2018. pp. 151-170 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{944f2bf3fdaa429f8deca649fc901806,
title = "A Hierarchical Harmonic Mixing Method",
abstract = "We present a hierarchical harmonic mixing method for assisting users in the process of music mashup creation. Our main contributions are metrics for computing the harmonic compatibility between musical audio tracks at small- and large-scale structural levels, which combine and reassess existing perceptual relatedness (i.e., chroma vector similarity and key affinity) and dissonance-based approaches. Underpinning our harmonic compatibility metrics are harmonic indicators from the perceptually-motivated Tonal Interval Space, which we adapt to describe musical audio. An interactive visualization shows hierarchical harmonic compatibility viewpoints across all tracks in a large musical audio collection. An evaluation of our harmonic mixing method shows our adaption of the Tonal Interval Space robustly describes harmonic attributes of musical instrument sounds irrespective of timbral differences and demonstrates that the harmonic compatibility metrics comply with the principles embodied in Western tonal harmony to a greater extent than previous approaches.",
keywords = "Audio content analysis, Digital DJ interfaces, Music information retrieval, Music mashup",
author = "Gilberto Bernardes and Davies, {Matthew E.P.} and Carlos Guedes",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-030-01692-0_11",
language = "English (US)",
isbn = "9783030016913",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer-Verlag",
pages = "151--170",
editor = "Davies, {Matthew E.P.} and Mitsuko Aramaki and Richard Kronland-Martinet and S{\o}lvi Ystad",
booktitle = "Music Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers",

}

TY - GEN

T1 - A Hierarchical Harmonic Mixing Method

AU - Bernardes, Gilberto

AU - Davies, Matthew E.P.

AU - Guedes, Carlos

PY - 2018/1/1

Y1 - 2018/1/1

N2 - We present a hierarchical harmonic mixing method for assisting users in the process of music mashup creation. Our main contributions are metrics for computing the harmonic compatibility between musical audio tracks at small- and large-scale structural levels, which combine and reassess existing perceptual relatedness (i.e., chroma vector similarity and key affinity) and dissonance-based approaches. Underpinning our harmonic compatibility metrics are harmonic indicators from the perceptually-motivated Tonal Interval Space, which we adapt to describe musical audio. An interactive visualization shows hierarchical harmonic compatibility viewpoints across all tracks in a large musical audio collection. An evaluation of our harmonic mixing method shows our adaption of the Tonal Interval Space robustly describes harmonic attributes of musical instrument sounds irrespective of timbral differences and demonstrates that the harmonic compatibility metrics comply with the principles embodied in Western tonal harmony to a greater extent than previous approaches.

AB - We present a hierarchical harmonic mixing method for assisting users in the process of music mashup creation. Our main contributions are metrics for computing the harmonic compatibility between musical audio tracks at small- and large-scale structural levels, which combine and reassess existing perceptual relatedness (i.e., chroma vector similarity and key affinity) and dissonance-based approaches. Underpinning our harmonic compatibility metrics are harmonic indicators from the perceptually-motivated Tonal Interval Space, which we adapt to describe musical audio. An interactive visualization shows hierarchical harmonic compatibility viewpoints across all tracks in a large musical audio collection. An evaluation of our harmonic mixing method shows our adaption of the Tonal Interval Space robustly describes harmonic attributes of musical instrument sounds irrespective of timbral differences and demonstrates that the harmonic compatibility metrics comply with the principles embodied in Western tonal harmony to a greater extent than previous approaches.

KW - Audio content analysis

KW - Digital DJ interfaces

KW - Music information retrieval

KW - Music mashup

UR - http://www.scopus.com/inward/record.url?scp=85057394557&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057394557&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01692-0_11

DO - 10.1007/978-3-030-01692-0_11

M3 - Conference contribution

AN - SCOPUS:85057394557

SN - 9783030016913

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 151

EP - 170

BT - Music Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers

A2 - Davies, Matthew E.P.

A2 - Aramaki, Mitsuko

A2 - Kronland-Martinet, Richard

A2 - Ystad, Sølvi

PB - Springer-Verlag

ER -