Comprehensive data-driven Risk and Threat Assessment Methods for the Early and Reliable Identification, Validation and Analysis of migration-related risks

Livrables

Human rights implications checklist to be used in the planning and development of the CRiTERIA tools

Roll-out Guidelines to be Included in the CRiTERIA Toolkit

All training content, best practices and lessons learned extracted from the experimental labs and pilots will be transformed into guidelines and included into the toolkit developed in WP3.

Report on the Privacy and Data Protection Impact Assessment

This report will include sections on data flows within the research project and the legal compliance as well as end user compliance issues with regard to their use of CRiTERIA solutions.

Technologies for Explanation, Validation and Linkage in Risk Analysis - Second Release

This report will describe the first release of technologies developed in T6.2-T6.4.

Final Release of Data Analysis Methods

This deliverable presents the final versions of content collection, narratives detection and analysis, trend detection and prediction, and the detection of threat indicators, which have been tested, optimized and validated throughout the pilots of the project.

Training content module

This deliverable will include the training module on risk analysis and vulnerability assessment for border security.

Human Rights Guidelines for Hybrid Threat Assessment

These guidelines on human rights implications will be developed for border agencies.

Report on Factors Influencing Societal Acceptance

This report will deal with the possible societal acceptance of Risk and Threat Analysis Methodologies for Hybrid Threats.

First Release of Data Analysis Methods

This deliverable presents the first version of the developed methods for online content collection and audiovisual analysis Visual media analysis and annotation Automatic Speech Recognition and results of their preliminary evaluation

System Architecture & Technology Roadmap

THis report outlines the technology roadmap and specifications of the initial prototype interfacing the core platform with the information services of WP5 and WP6

Technologies for Explanation, Validation and Linkage in Risk Analysis - First Release

This report will describe the first release of technologies developed in T6.2-T6.4.

Approaches for automated Explanation, Verification and Validation in Risk Analysis

This report will summarize the approaches for validation and explanation prioritized in T61 and T62

Second Release of Data Analysis Methods

This deliverable presents the first version of the methods for the detection and analysis of narratives, trend detection and prediction, and the detection of threat indicators. It also presents the final version of the audio-visual analysis methods (Visual media analysis and annotation, Automatic Speech Recognition). It also reports preliminary / final evaluation results for all methods.

Report on Policy Recommendations

Report proposing policy recommendations

Data and Knowledge Management Plan

Plan that describes the data used in the project as well as the way the project deals with this data and with the knowledge created in the project

Report on risk integration and propagation

The report will introduce the methodology on identifying and calculating risk integration & propagation; present case studies of cross-border risks;

First Report on Communication and Dissemination

Report on the communication and dissemination activities performed The activities themselves will be tracked on a continuous basis see T93 and published in a consolidated manner within this deliverable

Final report on Communication and Dissemination Activities

Report on the actual (carried out) communication and dissemination activities. Furthermore, the report will provide an overall summary of the communication and dissemination activities which have been tracked throughout the project. The subject of sustainability will be explicitly addressed regarding the adoption of project results beyond the runtime of the project itself.

Dissemination and Communication Plan

Plan for the dissemination and communication activities of the project as well as of individual project partners For communication this will describe the communication strategy and planned actitivies channels timeline and formats Furthermore work on the projects identity a cohesive concept for representing the project to the outside visual identity as well as work on website and online social media presence will be summarized

Report of CRiTERIA Ethical Principles and Practices

This will document the ethical concerns CRiTERIA can come across and the way the partners are dealing with these concerns

Risk Assessment Toolkit

An integrated collection of proposed risk analysis and vulnerability assessment solutions based on the new framework

Report on risk prioritization

The report will introduce methodology on risk prioritization & sample national and European case-studies of decision trees

CRiTERIA Platform and Dashboard: First Prototype Release

D7.2 delivers an initial prototype including API framework, reflecting feedback from other WPs in terms of design and functionality.

CRiTERIA Platform and Dashboard: Final Prototype Release

D7.4 will deliver the final API specifications for data exchange with WP5 and WP6 components, and an optimized platform in terms of response times and scalability, including revised versions of the dashboard’s visual widgets.

CRiTERIA Platform and Dashboard: Second Prototype Release

D7.3 will deliver the final API specifications for data exchange with WP5 and WP6 components, and an optimized platform in terms of response times and scalability, including revised versions of the dashboard’s visual widgets.

H - Requirement No. 2

Templates of the informed consent forms and information sheets (in language and terms intelligible to the participants) including personal data processing must be submitted as a deliverable.

Publications

Claim-Dissector: An Interpretable Fact-Checking System with Joint Re-ranking and Veracity Prediction

Auteurs: Martin Fajcik, Petr Motlicek, Pavel Smrz
Publié dans: Findings of the Association for Computational Linguistics: ACL 2023, 2023, Page(s) 10184-10205
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2023.findings-acl.647

Migration Reframed? A multilingual analysis on the stance shift in Europe during the Ukrainian crisis

Auteurs: Sergej Wildemann, Claudia Niederée, Erick Elejalde
Publié dans: Proceedings of the ACM Web Conference 2023, Numéro 5, 2023, Page(s) 2754-2764
Éditeur: ACM
DOI: 10.1145/3543507.3583442

IDIAPers @ Causal News Corpus 2022: Extracting Cause-Effect-Signal Triplets via Pre-trained Autoregressive Language Model

Auteurs: Martin Fajcik, Muskaan Singh, Juan Pablo Zuluaga-gomez, Esau Villatoro-tello, Sergio Burdisso, Petr Motlicek, Pavel Smrz
Publié dans: Proceedings of the 5th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE), 2023, Page(s) 70-78
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.case-1.10

Implementing Contextual Biasing in GPU Decoder for Online ASR

Auteurs: Iuliia Nigmatulina, Srikanth Madikeri, Esaú Villatoro-Tello, Petr Motlicek, Juan Zuluaga-Gomez, Karthik Pandia, Aravind Ganapathiraju
Publié dans: INTERSPEECH 2023, 2024, Page(s) 4494-4498
Éditeur: ISCA
DOI: 10.21437/interspeech.2023-2449

Cross-modal Networks, Fine-Tuning, Data Augmentation and Dual Softmax Operation for MediaEval NewsImages 2023

Auteurs: A. Leventakis, D. Galanopoulos, V. Mezaris
Publié dans: Proc. 2023 Multimedia Evaluation Workshop (MediaEval'23), 2024
Éditeur: CEUR

Masked Feature Modelling for the unsupervised pre-training of a Graph Attention Network block for bottom-up video event recognition

Auteurs: Dimitrios Daskalakis, Nikolaos Gkalelis, Vasileios Mezaris
Publié dans: 2023 IEEE International Symposium on Multimedia (ISM), Numéro abs/1807.03748, 2024, Page(s) 247-250
Éditeur: IEEE
DOI: 10.1109/ism59092.2023.00047

ITI-CERTH participation in ActEV and AVS Tracks of TRECVID 2022

Auteurs: Konstantinos Gkountakos; Damianos Galanopoulos; Despoina Touska; Konstantinos Ioannidis; Stefanos Vrochidis; Vasileios Mezaris; Ioannis Kompatsiaris
Publié dans: Proc. TRECVID 2022 Workshop, 2022
Éditeur: NIST
DOI: 10.5281/zenodo.7431865

Learning Faithful Attention for Interpretable Classification of Crisis-Related Microblogs under Constrained Human Budget

Auteurs: Thi Huyen Nguyen, Koustav Rudra
Publié dans: Proceedings of the ACM Web Conference 2023, 2024
Éditeur: ACM
DOI: 10.1145/3543507.3583861

IDIAPers @ Causal News Corpus 2022: Efficient Causal Relation Identification Through a Prompt-based Few-shot Approach

Auteurs: Sergio Burdisso, Juan Pablo Zuluaga-gomez, Esau Villatoro-tello, Martin Fajcik, Muskaan Singh, Pavel Smrz, Petr Motlicek
Publié dans: Proceedings of the 5th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE), 2023, Page(s) 61-69
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.case-1.9

Are All Combinations Equal? Combining Textual and Visual Features with Multiple Space Learning for Text-Based Video Retrieval

Auteurs: Damianos Galanopoulos; Vasileios Mezaris
Publié dans: Proc. ECCV 2022 Workshops, 2022
Éditeur: Springer
DOI: 10.1007/978-3-031-25069-9_40

ITI-CERTH participation in AVS Task of TRECVID 2023

Auteurs: D. Galanopoulos, V. Mezaris
Publié dans: Proc. TRECVID 2023 Workshop, 2023
Éditeur: NIST
DOI: 10.5281/zenodo.13143725

Rationale Aware Contrastive Learning Based Approach to Classify and Summarize Crisis-Related Microblogs

Auteurs: Thi Huyen Nguyen, Koustav Rudra
Publié dans: Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 2024
Éditeur: ACM
DOI: 10.1145/3511808.3557426

Cross-modal networks and dual softmax operation for MediaEval NewsImages 2022

Auteurs: Galanopoulos, Damianos; Mezaris, Vasileios
Publié dans: Proc. 2022 Multimedia Evaluation Workshop (MediaEval'22), 2023
Éditeur: CEUR
DOI: 10.5281/zenodo.7669743

Learning Visual Explanations for DCNN-Based Image Classifiers Using an Attention Mechanism

Auteurs: Gkartzonika, Ioanna; Gkalelis, Nikolaos; Mezaris, Vasileios
Publié dans: Proc. ECCV 2022 Workshops, 2022
Éditeur: Springer
DOI: 10.48550/arXiv.2209.11189

Stance Inference in Twitter through Graph Convolutional Collaborative Filtering Networks with Minimal Supervision

Auteurs: Zhiwei Zhou, Erick Elejalde
Publié dans: Companion Proceedings of the ACM Web Conference 2023, 2024
Éditeur: ACM
DOI: 10.1145/3543873.3587640

Gated-ViGAT: Efficient Bottom-Up Event Recognition and Explanation Using a New Frame Selection Policy and Gating Mechanism

Auteurs: Gkalelis, Nikolaos; Daskalakis, Dimitrios; Mezaris, Vasileios
Publié dans: Proc. IEEE Int. Symposium on Multimedia (ISM), 2022
Éditeur: IEEE
DOI: 10.1109/ISM55400.2022.00024

TAME: Attention Mechanism Based Feature Fusion for Generating Explanation Maps of Convolutional Neural Networks

Auteurs: Ntrougkas, Mariano; Gkalelis, Nikolaos; Mezaris, Vasileios
Publié dans: Proc. IEEE Int. Symposium on Multimedia (ISM), 2022
Éditeur: IEEE
DOI: 10.1109/ISM55400.2022.00014

CrisICSum: Interpretable Classification and Summarization Platform for Crisis Events from Microblogs

Auteurs: Thi Huyen Nguyen, Miroslav Shaltev, Koustav Rudra
Publié dans: Proceedings of the 31st ACM International Conference on Information & Knowledge Management, Numéro 1629, 2024, Page(s) 4941-4945
Éditeur: ACM
DOI: 10.1145/3511808.3557191

Human vs ChatGPT: Effect of Data Annotation in Interpretable Crisis-Related Microblog Classification

Auteurs: Thi Huyen Nguyen, Koustav Rudra
Publié dans: Proceedings of the ACM Web Conference 2024, Numéro 35, 2024, Page(s) 4534-4543
Éditeur: ACM
DOI: 10.1145/3589334.3648141

HyperConformer: Multi-head HyperMixer for Efficient Speech Recognition

Auteurs: Florian Mai, Juan Zuluaga-Gomez, Titouan Parcollet, Petr Motlicek
Publié dans: INTERSPEECH 2023, 2024, Page(s) 2213-2217
Éditeur: ISCA
DOI: 10.21437/interspeech.2023-1611

A Trustworthy Approach to Classify and Analyze Epidemic-Related Information From Microblogs

Auteurs: Thi Huyen Nguyen, Marco Fisichella, Koustav Rudra
Publié dans: IEEE Transactions on Computational Social Systems, Numéro 11, 2024, Page(s) 6229-6241, ISSN 2329-924X
Éditeur: IEEE Systems, Man, and Cybernetics Society
DOI: 10.1109/tcss.2024.3391395

T-TAME: Trainable Attention Mechanism for Explaining Convolutional Networks and Vision Transformers

Auteurs: Mariano V. Ntrougkas, Nikolaos Gkalelis, Vasileios Mezaris
Publié dans: IEEE Access, Numéro 12, 2024, Page(s) 76880-76900, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2024.3405788

Unveiling the silent majority: stance detection and characterization of passive users on social media using collaborative filtering and graph convolutional networks

Auteurs: Zhiwei Zhou, Erick Elejalde
Publié dans: EPJ Data Science, Numéro 13, 2024, ISSN 2193-1127
Éditeur: Springer
DOI: 10.1140/epjds/s13688-024-00469-y

ViGAT: Bottom-up event recognition and explanation in video using factorized graph attention network

Auteurs: Nikolaos Gkalelis; Dimitrios Daskalakis; Vasileios Mezaris
Publié dans: IEEE Access, 2022, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.48550/arxiv.2207.09927

The social stratification of internal migration and daily mobility during the COVID-19 pandemic

Auteurs: Erick Elejalde, Leo Ferres, Victor Navarro, Loreto Bravo, Emilio Zagheni
Publié dans: Scientific Reports, Numéro 14, 2024, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-024-63098-5

Bridging Qualitative Data Silos: The Potential of Reusing Codings Through Machine Learning Based Cross-Study Code Linking

Auteurs: Sergej Wildemann, Claudia Niederée, Erick Elejalde
Publié dans: Social Science Computer Review, Numéro 42, 2024, Page(s) 760-776, ISSN 0894-4393
Éditeur: SAGE Publications
DOI: 10.1177/08944393231215459

Transparency as the defining feature for developing risk assessment AI technology for border control

Auteurs: Jonida Milaj, Jeanne Pia Mifsud Bonnici
Publié dans: International Review of Law, Computers & Technology, 2024, Page(s) 1-12, ISSN 1360-0869
Éditeur: Carfax Publishing Ltd.
DOI: 10.1080/13600869.2024.2364996

Exploring Multi-modal Fusion for Image Manipulation Detection and Localization

Auteurs: Konstantinos Triaridis, Vasileios Mezaris
Publié dans: Lecture Notes in Computer Science, MultiMedia Modeling, 2024, Page(s) 198-211
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-53311-2_15

Cross-Modal Learning for Free-Text Video Search

Auteurs: Damianos Galanopoulos, Vasileios Mezaris
Publié dans: Advances in Information Quality and Management, Encyclopedia of Information Science and Technology, Sixth Edition, 2024, Page(s) 1-15
Éditeur: IGI Global
DOI: 10.4018/978-1-6684-7366-5.ch088

VERGE in VBS 2023

Auteurs: Nick Pantelidis, Stelios Andreadis, Maria Pegia, Anastasia Moumtzidou, Damianos Galanopoulos, Konstantinos Apostolidis, Despoina Touska, Konstantinos Gkountakos, Ilias Gialampoukidis, Stefanos Vrochidis, Vasileios Mezaris, Ioannis Kompatsiaris
Publié dans: Lecture Notes in Computer Science, MultiMedia Modeling, 2023, Page(s) 658-664
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-031-27077-2_55

Learning Visual Explanations for DCNN-Based Image Classifiers Using an Attention Mechanism

Auteurs: Ioanna Gkartzonika, Nikolaos Gkalelis, Vasileios Mezaris
Publié dans: Lecture Notes in Computer Science, Computer Vision – ECCV 2022 Workshops, 2024, Page(s) 396-411
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-25085-9_23

VERGE in VBS 2024

Auteurs: Nick Pantelidis, Maria Pegia, Damianos Galanopoulos, Konstantinos Apostolidis, Klearchos Stavrothanasopoulos, Anastasia Moumtzidou, Konstantinos Gkountakos, Ilias Gialampoukidis, Stefanos Vrochidis, Vasileios Mezaris, Ioannis Kompatsiaris, Björn Þór Jónsson
Publié dans: Lecture Notes in Computer Science, MultiMedia Modeling, 2024, Page(s) 356-363
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-53302-0_32

Livrables

Publications

Partager cette page

Télécharger