We are happy to announce that our paper “Human-centric Ontology Evaluation: Process and Tool Support” has been accepted as a full paper to be presented at the 23rd International Conference on Knowledge Engineering and Knowledge Management (EKAW2022), taking place September 26-29 in Bozen-Bolzano. 

The paper is motivated by the need for a generalized methodology and tool support for the development of human-centric ontology evaluation campaigns. We present (1) HERO – a Human-centric Ontology Evaluation PROcess that aims to support ontology engineers in the preparation, execution, and follow-up activities of such evaluation campaigns ; (2) a Reference Architecture, supporting HERO and consisting of a core for the general activities such as loading an ontology and plug-ins, capturing task specific implementations; (3) an evaluation of HERO and its reference architecture achieved by replicating a use case of the verification of ontology restrictions, described in our previous paper [1]. 

The presented results are based on the work done in Klemens Käszner’s master’s thesis [2], which he successfully defended earlier this month! 

This work was performed in the context of the HOnEst project.

[1] Tsaneva, S., Sabou, M. (2021). A human computation approach for ontology restrictions verification. In: Proc. of the AAAI Conf. on Human Computation and Crowdsourcing, 
[2] Käsznar, K. (2022). A Process and Tool Support for Human-Centred Ontology Verification [Master’s Thesis, Technische Universität Wien]. reposiTUm.