Research Areas

You can find the complete list of articles on my Google Scholar or DBLP profiles.

Experience in reviewing or organizing workshops, challenges, special issue, conferences, journals

Experience in supervision, open research topics

Research Topics & Publications

Large Language Models

Relevant publications

Hakimov, S., and Schlangen, D., (2023). Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks. Findings of the Association for Computational Linguistics: ACL 2023 PDF

Chalamalasetti, K., Götze, J., Hakimov, S., Madureira, B., Sadler, P., and Schlangen, D., (2023). clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agents. PDF

Computational Multimodal Models

Relevant publications

Cheema, G.S., Hakimov, S., Müller-Budack, E., Otto, C., Bateman, J., and Ewerth, R., (2023). Understanding Image-Text Relations and News Values for Multimodal News Analysis. Frontiers in Artificial Intelligence, Sec. Language and Computation, Volume 6 PDF

Tahmasebzadeh, G., Hakimov, S., Ewerth, R., and Müller-Budack, E., (2023). Multimodal Geolocation Estimation of News Photos. Advances in Information Retrieval - 45th European Conference on Information Retrieval (ECIR 2023) PDF

Tahmasebzadeh, G., Hakimov, S., Ewerth, R., and Müller-Budack, E., (2023). MM-Locate-News: Multimodal Focus Location Estimation in News. 29th International Conference on Multimedia Modeling (MMM 2023) PDF

Tahmasebi, S., Hakimov, S., Ewerth, R., and Müller-Budack, E., (2023). Improving Generalization for Multimodal Fake News Detection. International Conference on Multimedia Retrieval (ICMR 2023) PDF

Hakimov, S., Cheema G.S. and Ewerth, R., (2022). TIB-VA at SemEval-2022 Task 5: A Multimodal Architecture for the Detection and Classification of Misogynous Memes. SemEval-2022, Task 5: MAMI - Multimedia Automatic Misogyny Identification co-located with NAACL 2022 PDF

Cheema, G.S., Hakimov, S., Müller-Budack, E. and Ewerth, R., (2021). A Fair and Comprehensive Comparison of Multimodal Tweet Sentiment Analysis Methods. In the Proceedings of the Multi-Modal Pre-Training for Multimedia Understanding (MMPT 2021), co-located with ICMR PDF</p>

Natural Language Understanding

It is a subtopic of Natural Language Processing that deals with machine reading comprehension, extracting meaning from natural language text.

Relevant publications

Hakimov, S. (2019). Learning Multilingual Semantic Parsers for Question Answering over Linked Data. A comparison of neural and probabilistic graphical model architectures. Bielefeld University, Germany (Doctoral Dissertation) PDF

Hakimov, S. , Jebbara, S., Cimiano, P. (2019). Evaluating Architectural Choices for Deep Learning Approaches for Question Answering over Knowledge Bases. In Proceedings of the 13th International Semantic Computing Conference (ICSC) PDF

Ell B, Hakimov, S. , Braukmann, P., Cazzoli, L., Kaupmann, F., Mancino, A., Altaf Memon, J., Rother, K., Saini, A., Cimiano, P. (2017). Towards a Large Corpus of Richly Annotated Web Tables for Knowledge Base Population. In Proceedings of 5th International Workshop on Linked Data for Information Extraction, co-located with the 16th International Semantic Web Conference (ISWC) PDF

Hakimov, S., Jebbara, S., Cimiano, P. (2017). AMUSE: Multilingual Semantic Parsing for Question Answering over Linked Data. In Proceedings of the 16th International Semantic Web Conference (ISWC) PDF

Ell, B., Hakimov, S., Cimiano, P. (2016). Statistical Induction of Coupled Domain/Range Restrictions from RDF Knowledge Bases. In Proceedings of 4th NLP and DBpedia Workshop, co-located with the 15th International Semantic Web Conference (ISWC) PDF

Hakimov, S., ter Horst, H., Jebbara, S., Hartung, M., Cimiano, P. (2016). Combining textual and graph-based features for named entity disambiguation using undirected probabilistic graphical models. In Proceedings of 20th International Knowledge Engineering and Knowledge Management Conference (EKAW) PDF

Hakimov, S., Unger, C., Walter, S., Cimiano, P. (2015) Applying semantic parsing to question answering over linked data: Addressing the lexical gap. In Proceedings of International Conference on Applications of Natural Language to Information Systems (NLDB) PDF

Dogdu, E., Hakimov, S., Yumusak, S. (2014). A data-model driven web application development framework. In Proceedings of the 2014 ACM Southeast Regional Conference PDF

Hakimov, S. (2013). Named Entity Disambiguation using Linked Open Data. TOBB University, Ankara, Turkey (Master's Thesis) PDF

Hakimov, S., Tunc, H., Akimaliev, M., Dogdu, E. (2013) Semantic question answering system over linked data using relational patterns. In Proceedings of the Joint EDBT/ICDT 2013 Workshops PDF

Hakimov, S., Oto, S. A., Dogdu, E. (2012). Named entity recognition and disambiguation using linked data and graph-based centrality scoring. In Proceedings of the 4th international workshop on semantic web information management PDF

Video Summarization

It deals with providing a summary for lengthy videos by taking into account the audio, text and visual frames to create concise, informative summaries. The research mainly deals with educational videos where the aim is to provide short summaries that cover most of the information presented in a video to boost easier and quick way for skimming seminar, research talks.

Relevant publications

Ghauri, J.A., Hakimov, S. and Ewerth, R., (2021). Supervised Video Summarization via Multiple Feature Sets with Parallel Attention. In the Proceedings of IEEE International Conference on Multimedia and Expo (ICME) PDF Git repo

Ghauri, J.A., Hakimov, S. and Ewerth, R., (2020). Classification of Important Segments in Educational Videos using Multimodal Features. In Proceedings of the CIKM 2020 Workshops PDF Git repo

Misinformation Detection

It is a field of study to detect documents that include falsified information in the form of text, images, videos, etc. The research explores the ideas to detect misinformed facts from social media posts, news articles, videos and related multimedia data.

Relevant publications

Müller-Budack, E., Theiner, J., Diering, S., Idahl, M., Hakimov, S. and Ewerth, R., (2021). Multimodal news analytics using measures of cross-modal entity and context consistency. *International Journal of Multimedia Information Retrieval*, pp.1-15. PDF Git repo

Cheema, G.S., Hakimov, S., Müller-Budack, E. and Ewerth, R., (2021). On the Role of Images for Analyzing Claims in Social Media. In the Proceedings of the CLEOPATRA workshop co-located with The Web Conference (WWW) PDF Git repo

Cheema, G.S., Hakimov, S. and Ewerth, R., (2020) TIB's Visual Analytics Group at MediaEval'20: Detecting Fake News on Corona Virus and 5G Conspiracy. MediaEval workshop FakeNews task PDF Git repo

Cheema, G.S., Hakimov, S. and Ewerth, R., (2020). Check_square at CheckThat! 2020: Claim Detection in Social Media via Fusion of Transformer and Syntactic Features. In Proceedings of the Eleventh International Conference of the CLEF Association PDF Git repo

Event Analysis

The goal is to analyse vast amounts of event-centric textual and visual information in multiple languages.

Relevant publications

Müller-Budack, E., Springstein, M., Hakimov, S., Mrutzek, K. and Ewerth, R., (2021). Ontology-driven Event Type Classification in Images. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision PDF Git repo

Check out the CLEOPATRA Workshop

Check out the Special Issue at Semantic Web Journal Event-centric Open Analytics