Understanding of the visual world is not limited to recognizing individual object instances, but also extends to how those objects interact in the scene, which implies recognizing events happening in the scene. In this paper we present an approach for identifying complex events in videos, starting from object detection using a state-of-the-art object detector (YOLO), providing a set of candidate objects. We provide a logic based representation of events by using a realization of the Event Calculus that allows us to define complex events in terms of logical rules. Axioms of the calculus are encoded in a logic program under Answer Set semantics in order to reason and query over the extracted events. The applicability of the framework is demonstrated over the scenario of recognizing car parking on a handicap slot.

Event detection from video using answer set programming

Khan A.
;
Lazzerini B.
2019-01-01

Abstract

Understanding of the visual world is not limited to recognizing individual object instances, but also extends to how those objects interact in the scene, which implies recognizing events happening in the scene. In this paper we present an approach for identifying complex events in videos, starting from object detection using a state-of-the-art object detector (YOLO), providing a set of candidate objects. We provide a logic based representation of events by using a realization of the Event Calculus that allows us to define complex events in terms of logical rules. Axioms of the calculus are encoded in a logic program under Answer Set semantics in order to reason and query over the extracted events. The applicability of the framework is demonstrated over the scenario of recognizing car parking on a handicap slot.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11568/1016303
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 11
  • ???jsp.display-item.citation.isi??? ND
social impact