Heritage Data Hub - Cultural Heritage Datasets for AI

Project preview

Project Overview: Heritage Data Hub is a comprehensive repository designed for creating, managing, and sharing datasets related to cultural heritage and museums. It aims to support researchers, developers, and practitioners in their efforts toward digital preservation, analysis, and AI-driven exploration of museum collections through high-quality datasets for image classification and captioning tasks.

Objectives

  1. Provide structured, accessible datasets for training AI models on cultural heritage artifacts
  2. Facilitate digital preservation and analysis of museum collections
  3. Support research and development in AI applications for cultural heritage

Projects

  1. europeana_db

    • A project focused on scraping, processing, and preparing data from the Europeana database, using only open data available
    • Data Crawling: Retrieve open and media data from the Europeana API
    • Data Processing: Filter and link descriptions with their associated media
    • Dataset Preparation: Organize image links and metadata for AI model training, accessing those images directly during training

  2. ema

    • A public dataset with approximately 12,000 images of more than 2,900 Brazilian historical objects
    • Associated with 31 different labels for classification tasks
    • Can be adopted in interior objects contexts to improve training or evaluate the performance of automated image captioning

Technology and Future Integrations

  • Data Processing: Python with specialized libraries for image and metadata handling
  • API Integration: Tools for efficiently accessing the Europeana API
  • Dataset Management: Structured data formats optimized for AI training workflows

Heritage Data Hub represents a significant step forward in making cultural heritage accessible for AI research, helping to bridge the gap between historical artifacts and modern machine learning techniques.

Heritage Data Hub continues to expand its capabilities, providing researchers with valuable datasets that enable the development of more sophisticated AI models for cultural heritage applications. These datasets facilitate the digital preservation of important cultural artifacts while enabling new ways to explore, understand, and interact with museum collections.

Access the Project: https://github.com/AI-Unicamp/heritage-data-hub