Towards a Hierarchical Multitask Classification Framework for Cultural Heritage

Abdelhak Belhi, Abdelaziz Bouras, Sebti Foufou

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Digital technologies such as 3D imaging, data analytics and computer vision opened the door to a large set of applications in cultural heritage. Digital acquisition of a cultural assets takes nowadays a couple of seconds thanks to the achievements in 2D and 3D acquisition technologies. However, enriching these cultural assets with labels and relevant metadata is still not fully automatized especially due to their nature and specificities. With the recent publication of several cultural heritage datasets, many researchers are tackling the challenge of effectively classifying and annotating digital heritage. The challenges that are often addressed are related to visual recognition and image classification. In this paper, we present a novel approach of hierarchical classification for cultural heritage assets. The metadata structural differences that exist between cultural assets motivated us to design a classification framework that can efficiently perform the classification of multiple types of assets. Our approach relies on several deep learning classifiers, each of them is assigned the task of classifying a certain type of assets. The classification framework starts the labeling process by first determining the asset type. The asset is then assigned to a specific classifier in order to be annotated with data fields related to its type. As a preliminary step, we successfully designed a general cultural type classifier and a specific type classifier for paintings. Our approach is currently achieving interesting results and is set to be improved by the integration of more asset types.

Original languageEnglish (US)
Title of host publication2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018
PublisherIEEE Computer Society
ISBN (Electronic)9781538691205
DOIs
StatePublished - Jan 14 2019
Event15th IEEE/ACS International Conference on Computer Systems and Applications, AICCSA 2018 - Aqaba, Jordan
Duration: Oct 28 2018Nov 1 2018

Publication series

NameProceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA
Volume2018-November
ISSN (Print)2161-5322
ISSN (Electronic)2161-5330

Conference

Conference15th IEEE/ACS International Conference on Computer Systems and Applications, AICCSA 2018
CountryJordan
CityAqaba
Period10/28/1811/1/18

Fingerprint

Classifiers
Metadata
Image classification
Painting
Labeling
Computer vision
Labels
Imaging techniques

Keywords

  • Convolutional Neural Networks
  • Cultural heritage
  • Digital heritage
  • Digital preservation
  • Multitask Classification

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Signal Processing
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Belhi, A., Bouras, A., & Foufou, S. (2019). Towards a Hierarchical Multitask Classification Framework for Cultural Heritage. In 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018 [8612815] (Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA; Vol. 2018-November). IEEE Computer Society. https://doi.org/10.1109/AICCSA.2018.8612815

Towards a Hierarchical Multitask Classification Framework for Cultural Heritage. / Belhi, Abdelhak; Bouras, Abdelaziz; Foufou, Sebti.

2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018. IEEE Computer Society, 2019. 8612815 (Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA; Vol. 2018-November).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Belhi, A, Bouras, A & Foufou, S 2019, Towards a Hierarchical Multitask Classification Framework for Cultural Heritage. in 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018., 8612815, Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA, vol. 2018-November, IEEE Computer Society, 15th IEEE/ACS International Conference on Computer Systems and Applications, AICCSA 2018, Aqaba, Jordan, 10/28/18. https://doi.org/10.1109/AICCSA.2018.8612815
Belhi A, Bouras A, Foufou S. Towards a Hierarchical Multitask Classification Framework for Cultural Heritage. In 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018. IEEE Computer Society. 2019. 8612815. (Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA). https://doi.org/10.1109/AICCSA.2018.8612815
Belhi, Abdelhak ; Bouras, Abdelaziz ; Foufou, Sebti. / Towards a Hierarchical Multitask Classification Framework for Cultural Heritage. 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018. IEEE Computer Society, 2019. (Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA).
@inproceedings{c22c300fef314e248ba26b3269cfc388,
title = "Towards a Hierarchical Multitask Classification Framework for Cultural Heritage",
abstract = "Digital technologies such as 3D imaging, data analytics and computer vision opened the door to a large set of applications in cultural heritage. Digital acquisition of a cultural assets takes nowadays a couple of seconds thanks to the achievements in 2D and 3D acquisition technologies. However, enriching these cultural assets with labels and relevant metadata is still not fully automatized especially due to their nature and specificities. With the recent publication of several cultural heritage datasets, many researchers are tackling the challenge of effectively classifying and annotating digital heritage. The challenges that are often addressed are related to visual recognition and image classification. In this paper, we present a novel approach of hierarchical classification for cultural heritage assets. The metadata structural differences that exist between cultural assets motivated us to design a classification framework that can efficiently perform the classification of multiple types of assets. Our approach relies on several deep learning classifiers, each of them is assigned the task of classifying a certain type of assets. The classification framework starts the labeling process by first determining the asset type. The asset is then assigned to a specific classifier in order to be annotated with data fields related to its type. As a preliminary step, we successfully designed a general cultural type classifier and a specific type classifier for paintings. Our approach is currently achieving interesting results and is set to be improved by the integration of more asset types.",
keywords = "Convolutional Neural Networks, Cultural heritage, Digital heritage, Digital preservation, Multitask Classification",
author = "Abdelhak Belhi and Abdelaziz Bouras and Sebti Foufou",
year = "2019",
month = "1",
day = "14",
doi = "10.1109/AICCSA.2018.8612815",
language = "English (US)",
series = "Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA",
publisher = "IEEE Computer Society",
booktitle = "2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018",

}

TY - GEN

T1 - Towards a Hierarchical Multitask Classification Framework for Cultural Heritage

AU - Belhi, Abdelhak

AU - Bouras, Abdelaziz

AU - Foufou, Sebti

PY - 2019/1/14

Y1 - 2019/1/14

N2 - Digital technologies such as 3D imaging, data analytics and computer vision opened the door to a large set of applications in cultural heritage. Digital acquisition of a cultural assets takes nowadays a couple of seconds thanks to the achievements in 2D and 3D acquisition technologies. However, enriching these cultural assets with labels and relevant metadata is still not fully automatized especially due to their nature and specificities. With the recent publication of several cultural heritage datasets, many researchers are tackling the challenge of effectively classifying and annotating digital heritage. The challenges that are often addressed are related to visual recognition and image classification. In this paper, we present a novel approach of hierarchical classification for cultural heritage assets. The metadata structural differences that exist between cultural assets motivated us to design a classification framework that can efficiently perform the classification of multiple types of assets. Our approach relies on several deep learning classifiers, each of them is assigned the task of classifying a certain type of assets. The classification framework starts the labeling process by first determining the asset type. The asset is then assigned to a specific classifier in order to be annotated with data fields related to its type. As a preliminary step, we successfully designed a general cultural type classifier and a specific type classifier for paintings. Our approach is currently achieving interesting results and is set to be improved by the integration of more asset types.

AB - Digital technologies such as 3D imaging, data analytics and computer vision opened the door to a large set of applications in cultural heritage. Digital acquisition of a cultural assets takes nowadays a couple of seconds thanks to the achievements in 2D and 3D acquisition technologies. However, enriching these cultural assets with labels and relevant metadata is still not fully automatized especially due to their nature and specificities. With the recent publication of several cultural heritage datasets, many researchers are tackling the challenge of effectively classifying and annotating digital heritage. The challenges that are often addressed are related to visual recognition and image classification. In this paper, we present a novel approach of hierarchical classification for cultural heritage assets. The metadata structural differences that exist between cultural assets motivated us to design a classification framework that can efficiently perform the classification of multiple types of assets. Our approach relies on several deep learning classifiers, each of them is assigned the task of classifying a certain type of assets. The classification framework starts the labeling process by first determining the asset type. The asset is then assigned to a specific classifier in order to be annotated with data fields related to its type. As a preliminary step, we successfully designed a general cultural type classifier and a specific type classifier for paintings. Our approach is currently achieving interesting results and is set to be improved by the integration of more asset types.

KW - Convolutional Neural Networks

KW - Cultural heritage

KW - Digital heritage

KW - Digital preservation

KW - Multitask Classification

UR - http://www.scopus.com/inward/record.url?scp=85061933363&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061933363&partnerID=8YFLogxK

U2 - 10.1109/AICCSA.2018.8612815

DO - 10.1109/AICCSA.2018.8612815

M3 - Conference contribution

AN - SCOPUS:85061933363

T3 - Proceedings of IEEE/ACS International Conference on Computer Systems and Applications, AICCSA

BT - 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications, AICCSA 2018

PB - IEEE Computer Society

ER -