A hybrid exact algorithm for complete set partitioning

Tomasz Michalak, Talal Rahwan, Edith Elkind, Michael Wooldridge, Nicholas R. Jennings

Research output: Contribution to journalArticle

Abstract

In the Complete Set Partitioning problem we are given a finite set of elements where every subset is associated with a value, and the goal is to partition this set into disjoint subsets so as to maximise the sum of subset values. This abstract problem captures the Coalition Structure Generation problem in cooperative games in characteristic function form, where each subset, or coalition, of agents can make a profit when working together, and the goal is to partition the set of agents into coalitions to maximise the total profit. It also captures the special case of the Winner Determination problem in combinatorial auctions, where bidders place bids on every possible bundle of goods, and the goal is to find an allocation of goods to bidders that maximises the profit of the auctioneer. The main contribution of this article is an extensive theoretical analysis of the search space of the Complete Set Partitioning problem, which reveals that two fundamentally different exact algorithms can be significantly improved upon in terms of actual runtime. These are (1) a dynamic programming algorithm called "DP" [48,36] and (2) a tree-search algorithm called "IP" [32]. We start by drawing a link between DP and a certain graph describing the structure of the search space. This link reveals that many of DP's operations are in fact redundant. Consequently, we develop ODP - an optimal version of DP that avoids all of its redundant operations. Since ODP and IP are based on different design paradigms, each has its own strengths and weaknesses compared to the other. Thus, one has to trade off the advantages of one algorithm for the advantages of the other. This raises the following question: Is this trade-off inevitable? To answer this question, we develop a new representation of the search space, which links both algorithms, and allows for contrasting the workings of the two. This reveals that ODP and IP can actually be combined, leading to the development of ODP-IP - a hybrid algorithm that avoids the limitations of its constituent parts, while retaining and significantly improving upon the advantages of each part. We benchmark our algorithm against that of Björklund et al. (2009) [8], which runs in O(2n) time given n agents. We observe that the algorithm of Björklund et al. relies on performing arithmetic operations with very large integers, and assumes that any such operation has unit cost. In practice, however, working with large integers on a modern PC is costly. Consequently, when implemented, our O(3n) algorithm outperforms that of Björklund et al. by several orders of magnitude on every problem instance, making ours the fastest exact algorithm for complete set partitioning to date in practice.

Original languageEnglish (US)
Pages (from-to)14-50
Number of pages37
JournalArtificial Intelligence
Volume230
DOIs
StatePublished - Jan 1 2016

Fingerprint

coalition
Profitability
profit
auction
Set theory
Dynamic programming
PC
Values
programming
paradigm
costs
Profit
Costs
time
Bundle
Auctions
Graph
Programming
Paradigm
Benchmark

Keywords

  • Coalition formation
  • Coalition structure generation
  • Complete set partitioning
  • Dynamic programming

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language
  • Artificial Intelligence

Cite this

A hybrid exact algorithm for complete set partitioning. / Michalak, Tomasz; Rahwan, Talal; Elkind, Edith; Wooldridge, Michael; Jennings, Nicholas R.

In: Artificial Intelligence, Vol. 230, 01.01.2016, p. 14-50.

Research output: Contribution to journalArticle

Michalak, Tomasz ; Rahwan, Talal ; Elkind, Edith ; Wooldridge, Michael ; Jennings, Nicholas R. / A hybrid exact algorithm for complete set partitioning. In: Artificial Intelligence. 2016 ; Vol. 230. pp. 14-50.
@article{da3e3a7f98ed45e9adbd506dc8edafbf,
title = "A hybrid exact algorithm for complete set partitioning",
abstract = "In the Complete Set Partitioning problem we are given a finite set of elements where every subset is associated with a value, and the goal is to partition this set into disjoint subsets so as to maximise the sum of subset values. This abstract problem captures the Coalition Structure Generation problem in cooperative games in characteristic function form, where each subset, or coalition, of agents can make a profit when working together, and the goal is to partition the set of agents into coalitions to maximise the total profit. It also captures the special case of the Winner Determination problem in combinatorial auctions, where bidders place bids on every possible bundle of goods, and the goal is to find an allocation of goods to bidders that maximises the profit of the auctioneer. The main contribution of this article is an extensive theoretical analysis of the search space of the Complete Set Partitioning problem, which reveals that two fundamentally different exact algorithms can be significantly improved upon in terms of actual runtime. These are (1) a dynamic programming algorithm called {"}DP{"} [48,36] and (2) a tree-search algorithm called {"}IP{"} [32]. We start by drawing a link between DP and a certain graph describing the structure of the search space. This link reveals that many of DP's operations are in fact redundant. Consequently, we develop ODP - an optimal version of DP that avoids all of its redundant operations. Since ODP and IP are based on different design paradigms, each has its own strengths and weaknesses compared to the other. Thus, one has to trade off the advantages of one algorithm for the advantages of the other. This raises the following question: Is this trade-off inevitable? To answer this question, we develop a new representation of the search space, which links both algorithms, and allows for contrasting the workings of the two. This reveals that ODP and IP can actually be combined, leading to the development of ODP-IP - a hybrid algorithm that avoids the limitations of its constituent parts, while retaining and significantly improving upon the advantages of each part. We benchmark our algorithm against that of Bj{\"o}rklund et al. (2009) [8], which runs in O(2n) time given n agents. We observe that the algorithm of Bj{\"o}rklund et al. relies on performing arithmetic operations with very large integers, and assumes that any such operation has unit cost. In practice, however, working with large integers on a modern PC is costly. Consequently, when implemented, our O(3n) algorithm outperforms that of Bj{\"o}rklund et al. by several orders of magnitude on every problem instance, making ours the fastest exact algorithm for complete set partitioning to date in practice.",
keywords = "Coalition formation, Coalition structure generation, Complete set partitioning, Dynamic programming",
author = "Tomasz Michalak and Talal Rahwan and Edith Elkind and Michael Wooldridge and Jennings, {Nicholas R.}",
year = "2016",
month = "1",
day = "1",
doi = "10.1016/j.artint.2015.09.006",
language = "English (US)",
volume = "230",
pages = "14--50",
journal = "Artificial Intelligence",
issn = "0004-3702",
publisher = "Elsevier",

}

TY - JOUR

T1 - A hybrid exact algorithm for complete set partitioning

AU - Michalak, Tomasz

AU - Rahwan, Talal

AU - Elkind, Edith

AU - Wooldridge, Michael

AU - Jennings, Nicholas R.

PY - 2016/1/1

Y1 - 2016/1/1

N2 - In the Complete Set Partitioning problem we are given a finite set of elements where every subset is associated with a value, and the goal is to partition this set into disjoint subsets so as to maximise the sum of subset values. This abstract problem captures the Coalition Structure Generation problem in cooperative games in characteristic function form, where each subset, or coalition, of agents can make a profit when working together, and the goal is to partition the set of agents into coalitions to maximise the total profit. It also captures the special case of the Winner Determination problem in combinatorial auctions, where bidders place bids on every possible bundle of goods, and the goal is to find an allocation of goods to bidders that maximises the profit of the auctioneer. The main contribution of this article is an extensive theoretical analysis of the search space of the Complete Set Partitioning problem, which reveals that two fundamentally different exact algorithms can be significantly improved upon in terms of actual runtime. These are (1) a dynamic programming algorithm called "DP" [48,36] and (2) a tree-search algorithm called "IP" [32]. We start by drawing a link between DP and a certain graph describing the structure of the search space. This link reveals that many of DP's operations are in fact redundant. Consequently, we develop ODP - an optimal version of DP that avoids all of its redundant operations. Since ODP and IP are based on different design paradigms, each has its own strengths and weaknesses compared to the other. Thus, one has to trade off the advantages of one algorithm for the advantages of the other. This raises the following question: Is this trade-off inevitable? To answer this question, we develop a new representation of the search space, which links both algorithms, and allows for contrasting the workings of the two. This reveals that ODP and IP can actually be combined, leading to the development of ODP-IP - a hybrid algorithm that avoids the limitations of its constituent parts, while retaining and significantly improving upon the advantages of each part. We benchmark our algorithm against that of Björklund et al. (2009) [8], which runs in O(2n) time given n agents. We observe that the algorithm of Björklund et al. relies on performing arithmetic operations with very large integers, and assumes that any such operation has unit cost. In practice, however, working with large integers on a modern PC is costly. Consequently, when implemented, our O(3n) algorithm outperforms that of Björklund et al. by several orders of magnitude on every problem instance, making ours the fastest exact algorithm for complete set partitioning to date in practice.

AB - In the Complete Set Partitioning problem we are given a finite set of elements where every subset is associated with a value, and the goal is to partition this set into disjoint subsets so as to maximise the sum of subset values. This abstract problem captures the Coalition Structure Generation problem in cooperative games in characteristic function form, where each subset, or coalition, of agents can make a profit when working together, and the goal is to partition the set of agents into coalitions to maximise the total profit. It also captures the special case of the Winner Determination problem in combinatorial auctions, where bidders place bids on every possible bundle of goods, and the goal is to find an allocation of goods to bidders that maximises the profit of the auctioneer. The main contribution of this article is an extensive theoretical analysis of the search space of the Complete Set Partitioning problem, which reveals that two fundamentally different exact algorithms can be significantly improved upon in terms of actual runtime. These are (1) a dynamic programming algorithm called "DP" [48,36] and (2) a tree-search algorithm called "IP" [32]. We start by drawing a link between DP and a certain graph describing the structure of the search space. This link reveals that many of DP's operations are in fact redundant. Consequently, we develop ODP - an optimal version of DP that avoids all of its redundant operations. Since ODP and IP are based on different design paradigms, each has its own strengths and weaknesses compared to the other. Thus, one has to trade off the advantages of one algorithm for the advantages of the other. This raises the following question: Is this trade-off inevitable? To answer this question, we develop a new representation of the search space, which links both algorithms, and allows for contrasting the workings of the two. This reveals that ODP and IP can actually be combined, leading to the development of ODP-IP - a hybrid algorithm that avoids the limitations of its constituent parts, while retaining and significantly improving upon the advantages of each part. We benchmark our algorithm against that of Björklund et al. (2009) [8], which runs in O(2n) time given n agents. We observe that the algorithm of Björklund et al. relies on performing arithmetic operations with very large integers, and assumes that any such operation has unit cost. In practice, however, working with large integers on a modern PC is costly. Consequently, when implemented, our O(3n) algorithm outperforms that of Björklund et al. by several orders of magnitude on every problem instance, making ours the fastest exact algorithm for complete set partitioning to date in practice.

KW - Coalition formation

KW - Coalition structure generation

KW - Complete set partitioning

KW - Dynamic programming

UR - http://www.scopus.com/inward/record.url?scp=84943653976&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84943653976&partnerID=8YFLogxK

U2 - 10.1016/j.artint.2015.09.006

DO - 10.1016/j.artint.2015.09.006

M3 - Article

AN - SCOPUS:84943653976

VL - 230

SP - 14

EP - 50

JO - Artificial Intelligence

JF - Artificial Intelligence

SN - 0004-3702

ER -