Transformers have emerged as a dominant architecture in computer vision, demonstrating strong performance across a range of tasks. In this work, we investigate their effectiveness for object detection in thermal imagery, a setting often challenged by variable environmental conditions. We focus on a long-term thermal surveillance dataset captured using a stationary thermal camera subjected to diverse weather scenarios. To address the influence of such external factors, we propose an analysis that integrates weather information as metatokens alongside thermal images, enabling the model to account for environmental context during detection. Among the fusion strategies explored, we find that a token-level concatenation allows transformers to partially exploit the auxiliary weather data, leading to improved detection performance. Our study highlights the potential of meta-token transformer-based architectures for robust detection in challenging thermal environments.

Meta-token Learning for Thermal Object Detection with Transformers

Parola, Marco;Cimino, Mario G. C. A.;
In corso di stampa

Abstract

Transformers have emerged as a dominant architecture in computer vision, demonstrating strong performance across a range of tasks. In this work, we investigate their effectiveness for object detection in thermal imagery, a setting often challenged by variable environmental conditions. We focus on a long-term thermal surveillance dataset captured using a stationary thermal camera subjected to diverse weather scenarios. To address the influence of such external factors, we propose an analysis that integrates weather information as metatokens alongside thermal images, enabling the model to account for environmental context during detection. Among the fusion strategies explored, we find that a token-level concatenation allows transformers to partially exploit the auxiliary weather data, leading to improved detection performance. Our study highlights the potential of meta-token transformer-based architectures for robust detection in challenging thermal environments.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11568/1345588
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact