A multimodal turn in Digital Humanities. Using contrastive machine learning models to explore, enrich, and analyze digital visual historical collections

T Smits, M Wevers - Digital Scholarship in the Humanities, 2023 - academic.oup.com
Until recently, most research in the Digital Humanities (DH) was monomodal, meaning that
the object of analysis was either textual or visual. Seeking to integrate multimodality theory …

Hypericons for interpretability: decoding abstract concepts in visual data

DS Martinez Pandiani, N Lazzari, M Erp… - International Journal of …, 2023 - Springer
In an era of information abundance and visual saturation, the need for resources to organise
and access the vast expanse of visual data is paramount. Abstract concepts-such as comfort …

A framework for the analysis of historical newsreels

M Oiva, K Mukhina, V Zemaityte, A Karjus… - Humanities and Social …, 2024 - nature.com
Audiovisual news is a critical cultural phenomenon that has been influencing audience
worldviews for more than a hundred years. To understand historical trends in multimodal …

Visuality peaks, function lasts: an empirical investigation into the performance of iconic architecture on Instagram

N Alaily-Mattar, V Baptist, L Legner… - … International Journal of …, 2024 - emerald.com
Purpose The purpose of this paper is twofold: first, to propose a methodology to empirically
investigate the longitudinal development of social media content concerning buildings …

Deep learning for historical Cadastral maps and satellite imagery analysis: insights from Styria's Franciscean Cadastre

WT Göderle, F Rampetsreiter, C Macher… - Digital humanities …, 2024 - pure.mpg.de
Cadastres from the 19th century are a complex as well as rich source for historians and
archaeologists, the study of which presents great challenges. For archaeological and …

An Analytics of Culture: Modeling Subjectivity, Scalability, Contextuality, and Temporality

N van Noord, M Wevers, T Blanke… - arXiv preprint arXiv …, 2022 - arxiv.org
There is a bidirectional relationship between culture and AI; AI models are increasingly used
to analyse culture, thereby shaping our understanding of culture. On the other hand, the …

[PDF][PDF] The Great Unseen. Photojournalism and the archive: from analogue to digital

T Smits, S Asser - TMG Journal for Media History, 2022 - academia.edu
In 2001, the digitisation of a photo archive made international headlines. Bill Gates' stock
photo company Corbis announced that it would relocate the world-renowned Bettmann …

AI-driven Structure Detection and Information Extraction from Historical Cadastral Maps (Early 19th Century Franciscean Cadastre in the Province of Styria) and …

W Göderle, C Macher, K Mauthner, O Pimas… - arXiv preprint arXiv …, 2023 - arxiv.org
Cadastres from the 19th century are a complex as well as rich source for historians and
archaeologists, whose use presents them with great challenges. For archaeological and …

The wicked problem of naming the intangible: Abstract concepts, binary thinking, and computer vision labels

DS Martinez Pandiani - Future Humanities, 2024 - Wiley Online Library
Delving into the intricate complexities of naming and categorizing the visual evocation of
abstract concepts, this paper brings to light the limitations of relying on binary thinking to …

Bridging the Gap: Decoding Abstract Concepts in Cultural Heritage Images

DSM Pandiani - Decoding Cultural Heritage: A Critical Dissection and …, 2024 - Springer
Cultural heritage (CH) institutions are digitizing their invaluable visual data, spanning
images of paintings, photographs, and advertisements. A notable challenge emerges in …