Knowledge-Based Information Agent with Social Competence and Human Interaction Capabilities

Livrables

Project presentation, communication kit, website, communication and dissemination plan

D9.1 will set the major goals of dissemination objectives, will define common guidelines to be used by all partners and will provide the planned dissemination actions including specific SUG actions. It will also include the setup of the project website.

Final system report

D8.9 will on the one side contain: (i) the assessment of the functionality of the final system, compared with the targeted functionality specified for MS5; (ii) the summary of the evaluation of the performance of the individual techniques in accordance with the corresponding performance indicators; (iii) assessment of the overall user satisfaction and the capability of the user to interact with the integrated platform. On the other side, it will also report on the work of the Ethical Board during the third year of the project.

Empirical study of the vocal aspects of the user interventions in dialogues

D3.1 contributes to the achievement of the MSs 2 – 5. It will summarize the analysis of the vocal interventions of users in sample dialogues (collected in WP8) in all languages covered in KRISTINA, from both the verbal and paralinguistic angle, and outline the requirements that result from this analysis towards the technologies for processing of the vocal contributions of the user in KRISTINA.

Requirements for Dialogue Management in adaptive Human-Machine-Communication

D2.1 contributes primarily to the achievement of MS1, but also serves as basis for decisions taken for the achievement of the MSs 2 – 5. It will, on the one side, summarize the analysis of sample dialogues of all scenarios of the PUCs collected in WP8 in terms of the systematicity of turns and turn markers, affection, culture-specific phenomena that influence dialogue, etc. for the languages and cultural settings covered in KRISTINA. On the other side, it will contain the requirements for the DM that result from this analysis.

Empirical study on web resources and social media

D5.1 reports the outcome of the empirical study of Task 5.1.

Public final activity report

D1.5 contributes to Milestone MS5. The deliverable will contain: (i) the presentation of the Consortium, (ii) the presentation of the objectives of PESCaDO; (iii) a summary of the results of the Project; (iv) the impact achieved by the Project.

Empirical study of the non-verbal vocal aspects of the user interventions in dialogues

D4.1 contributes to the achievement of the MSs 2 – 5. It will present the results of the analysis of the facial and gestural contributions of users in sample dialogues (collected in WP8), from both the content and social and emotional angle, and outline the requirements that result from this analysis towards the technologies for processing of the facial and gestural contributions of the user in KRISTINA.

Empirical study of the communication of experts with users

D6.1 will contain the results of the empirical study and the requirements to the communication of the KRISTINA agent with users.

Advanced version of the vocal analysis techniques in KRISTINA

D3.3 contributes to the achievement of MS4 and MS5. It will present the advanced functionality of the vocal analysis techniques in KRISTINA. Two versions of the deliverable will be submitted. The first version will describe the functionality of the second prototype of the KRISTINA agent with respect to vocal analysis and will be due M26. The second version will describe the functionality of the final vocal analysis techniques and will be due M32.

Integration of the OwlSpeak Platform into the KRISTINA architecture

D2.2 contributes to MS2. It will outline the original architecture and functionality of OwlSpeak, discuss them in the light of the requirements of KRISTINA and specify the extensions of OwlSpeak and the interfaces via which OwlSpeak is integrated into KRISTINA. In the demonstration part of D2.2, this integration and the envisaged functionality is shown.

Advanced version of the mimics and gesture analysis techniques

D4.3 contributes to the achievement of MS4 and MS5. It will present the advanced functionality of the non-verbal analysis techniques in KRISTINA. Two versions of the deliverable will be submitted. The first version will describe the functionality of the second prototype of the KRISTINA agent with respect to non-verbal analysis and will be due M26. The second version will describe the functionality of the final non-verbal analysis techniques and will be due M34.

Advanced version of the ontologies and reasoning techniques

D5.4 will describe and show the advanced version of the reasoning techniques as developed in the second half of the project.

Advanced version of the KRISTINA generic adaptive dialogue manager

D2.5 contributes to MS5. It will present the final version of the KRISTINA DM., outlining in detail the language and cultural aspects of the dialogue planning developed in KRISTINA for all languages and cultural contexts tackled in the project. It will also elaborate on the functionality of the final modality merge module.

Advanced version of the avatar communication

D6.3 will describe and show the functionality of the advanced version of the integrated multimodality communication of the KRISTINA avatar. The discourse and speech generation will handle all languages covered in KRISTINA. The developed avatar will realize a holistic animation engine that will cover not only the facial animation, but the whole body animation.

Advanced version of query formulation, search and content extraction

D5.5 will describe and show the final semantic framework (T5.2) and the advanced version of the query formulation, search and content extraction as developed in the second half of the project.

Final System

D7.5 will cover topics specified as objectives of MS5. It will consist of a demonstration and a report part.

Publications

Attentional Parallel RNNs for Generating Punctuation in Transcribed Speech

Auteurs: Alp Öktem, Mireia Farrús, Leo Wanner
Publié dans: Statistical Language and Speech Processing. SLSP 2017. Lecture Notes in Computer Science, vol 10583, 2017, Page(s) 131-142, ISBN 978-3-319-68456-7
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-68456-7_11

Unsupervised Keyword Extraction Using the GoW Model and Centrality Scores

Auteurs: Elissavet Batziou, Ilias Gialampoukidis, Stefanos Vrochidis, Ioannis Antoniou, Ioannis Kompatsiaris
Publié dans: Internet Science. INSCI 2017. Lecture Notes in Computer Science, vol 10673, 2017, Page(s) 344-351, ISBN 978-3-319-70284-1
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-70284-1_26

KRISTINA: A Knowledge-Based Virtual Conversation Agent

Auteurs: Leo Wanner, Elisabeth André, Josep Blat, Stamatia Dasiopoulou, Mireia Farrùs, Thiago Fraga, Eleni Kamateri, Florian Lingenfelser, Gerard Llorach, Oriol Martínez, Georgios Meditskos, Simon Mille, Wolfgang Minker, Louisa Pragst, Dominik Schiller, Andries Stam, Ludo Stellingwerff, Federico Sukno, Bianca Vieru, Stefanos Vrochidis
Publié dans: Advances in Practical Applications of Cyber-Physical Multi-Agent Systems: The PAAMS Collection. PAAMS 2017. Lecture Notes in Computer Science, vol 10349, 2017, Page(s) 284-295, ISBN 978-3-319-59930-4
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-59930-4_23

A Topic Detection and Visualisation System on Social Media Posts

Auteurs: Stelios Andreadis, Ilias Gialampoukidis, Stefanos Vrochidis, Ioannis Kompatsiaris
Publié dans: INSCI 2017. Lecture Notes in Computer Science, vol 10673, 2017, Page(s) 421-427, ISBN 978-3-319-70284-1
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-70284-1_33

Description Logics and Rules for Multimodal Situational Awareness in Healthcare

Auteurs: Georgios Meditskos, Stefanos Vrochidis, Ioannis Kompatsiaris
Publié dans: MultiMedia Modeling. MMM 2017, 2017, Page(s) 714-725, ISBN 978-3-319-51811-4
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-51811-4_58

Recurrent Neural Network Interaction Quality Estimation

Auteurs: Louisa Pragst, Stefan Ultes, Wolfgang Minker
Publié dans: Dialogues with Social Robots. Lecture Notes in Electrical Engineering, vol 427, 2017, Page(s) 381-393, ISBN 978-981-10-2585-3
Éditeur: Springer Singapore
DOI: 10.1007/978-981-10-2585-3_31

VERGE in VBS 2018

Auteurs: Moumtzidou, S. Andreadis, F. Markatopoulou, D. Galanopoulos, I. Gialampoukidis, S. Vrochidis, V. Mezaris, I. Kompatsiaris, I. Patras
Publié dans: MultiMedia Modeling. MMM 2018. Lecture Notes in Computer Science, vol 10705, 2018
Éditeur: Springer

VERGE IN VBS 2017

Auteurs: Moumtzidou, A., T. Mironidis, F. Markatopoulou, S. Andreadis, I. Gialampoukidis, D. Galanopoulos, A. Ioannidou, S. Vrochidis, V. Mezaris, I. Kompatsiaris, I. Patras
Publié dans: MultiMedia Modeling. MMM 2017. Lecture Notes in Computer Science, vol 10133, 2017, ISBN 978-3-319-51814-5
Éditeur: Springer

Towards Estimating the Upper Bound of Visual-Speech Recognition: The Visual Lip-Reading Feasibility Database

Auteurs: Adriana Fernandez-Lopez, Oriol Martinez, Federico M. Sukno
Publié dans: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), 2017, Page(s) 208-215, ISBN 978-1-5090-4023-0
Éditeur: IEEE
DOI: 10.1109/FG.2017.34

Automatic Viseme Vocabulary Construction to Enhance Continuous Lip-reading

Auteurs: Adriana Fernandez-Lopez, Federico M. Sukno
Publié dans: Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2017, Page(s) 52-63, ISBN 978-989-758-225-7
Éditeur: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006102100520063

Automatic extraction of parallel speech corpora from dubbed movies

Auteurs: Öktem, Alp; Farrús, Mireia; Wanner, Leo
Publié dans: Proceedings of the 10th Workshop on Building and Using Comparable Corpora (BUCC), 2017
Éditeur: Association for Computational Linguisticss

A Thematicity-based prosody enrichment tool for CTS

Auteurs: Domínguez Bajo, Mónica; Farrús, Mireia; Wanner, Leo
Publié dans: INTERSPEECH 2017, 2017
Éditeur: ISCA

UPF at EPE 2017: transduction-based deep analysis

Auteurs: Mille, Simon; Latorre, Iván; Wanner, Leo
Publié dans: Proceedings of the 2017 Shared Task on Extrinsic Parser Evaluation (EPE 2017, 2017
Éditeur: Association for Computational Linguistics

Prosograph: a tool for prosody visualisation of large speech corpora

Auteurs: Öktem, Alp; Farrús, Mireia; Wanner, Leo
Publié dans: INTERSPEECH 2017, 2017
Éditeur: ISCA

Fusion of Valence and Arousal Annotations through Dynamic Subjective Ordinal Modelling

Auteurs: Adria Ruiz, Oriol Martinez, Xavier Binefa, Federico M. Sukno
Publié dans: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), 2017, Page(s) 331-338, ISBN 978-1-5090-4023-0
Éditeur: IEEE
DOI: 10.1109/FG.2017.48

Using Prosody to Classify Discourse Relations

Auteurs: Janine Kleinhans, Mireia Farrús, Agustín Gravano, Juan Manuel Pérez, Catherine Lai, Leo Wanner
Publié dans: Interspeech 2017, 2017, Page(s) 3201-3205
Éditeur: ISCA
DOI: 10.21437/Interspeech.2017-710

A Social companion and conversation partner for elderly

Auteurs: Miehle, Juliana; Bagci, Ilker; Minker, Wolfgang; Ultes, Stefan
Publié dans: 8th International Workshop On Spoken Dialogue Systems (IWSDS), 2017
Éditeur: ISCA

Towards reasoned modality selection in an embodied conversation agent

Auteurs: Ten-Ventura, Carla; Carlini, Roberto; Dasiopoulou, Stamatia; LLorach Tó, Gerard; Wanner, Leo
Publié dans: Intelligent Virtual Agents. IVA 2017. Lecture Notes in Computer Science, vol 10498, 2017, ISBN 978-3-319-67401-8
Éditeur: Springer

A Hybrid approach for biomedical relation extraction using finite state automata and random forest-weighted fusion

Auteurs: Mavropoulos, Thanassis; Liparas, Dimitris; Symeonidis, Spyridon; Vrochidis, Stefanos; Kompatsiaris, Ioannis
Publié dans: 18th International Conference on Computational Linguistics and Intelligent Text Processing (CICLing 2017), 2017
Éditeur: Springer, LNCS

Interaction quality estimation using long short-term memories

Auteurs: Rach, Niklas; Minker, Wolfgang; Ultes, Stefan
Publié dans: Proceedings of the SIGDIAL 2017 Conference, 2017, Page(s) 164-169
Éditeur: Association for Computational Linguistics

Topic detection using the DBSCAN-Martingale and the time operator

Auteurs: Gialampoukidis, Ilias; Vrochidis, Stefanos; Kompatsiaris, Ioannis; Antoniou, Ioannis
Publié dans: The 17th Conference of the Applied Stochastic Models and Data Analysis (ASMDA), 2017
Éditeur: ASMDA

Exploring the applicability of elaborateness and indirectness in dialogue management

Auteurs: Pragst, Louisa; Minker, Wolfgang; Ultes, Stefan
Publié dans: 8th International Workshop On Spoken Dialogue Systems (IWSDS), 2017
Éditeur: ISCA

Revising the METU-Sabancı Turkish treebank: an exercise in surface-syntactic annotation of agglutinative languages

Auteurs: Burga Díaz, Alicia; Öktem, Alp; Wanner, Leo
Publié dans: Proceedings of the Fourth International Conference on Dependency Linguistics (Depling 2017), 2017
Éditeur: Linköping University Electronic Press

A Demo of FORGe: the Pompeu Fabra open rule-based generator

Auteurs: Mille, Simon; Wanner, Leo
Publié dans: Proceedings of The 10th International Natural Language Generation conference, 2017
Éditeur: Association for Computational Linguistics

Web-Based Live Speech-Driven Lip-Sync

Auteurs: Gerard Llorach, Alun Evans, Josep Blat, Giso Grimm, Volker Hohmann
Publié dans: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), 2016, Page(s) 1-4, ISBN 978-1-5090-2722-4
Éditeur: IEEE
DOI: 10.1109/vs-games.2016.7590381

FORGe at SemEval-2017 Task 9: deep sentence generation based on a sequence of graph transducers

Auteurs: Mille, Simon; Carlini, Roberto; Burga Díaz, Alicia; Wanner, Leo
Publié dans: SemEval 2017, 2017
Éditeur: Association for Computational Linguistics

Neural Architectures for Named Entity Recognition

Auteurs: Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, Chris Dyer
Publié dans: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016, Page(s) 260-270
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/n16-1030

A hybrid graph-based and non-linear late fusion approach for multimedia retrieval

Auteurs: Ilias Gialampoukidis, Anastasia Moumtzidou, Dimitris Liparas, Stefanos Vrochidis, Ioannis Kompatsiaris
Publié dans: 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI), 2016, Page(s) 1-6, ISBN 978-1-4673-8695-1
Éditeur: IEEE
DOI: 10.1109/CBMI.2016.7500252

Automatic Modification of Communication Style in Dialogue Management

Auteurs: Louisa Pragst, Juliana Miehle, Stefan Ultes, Wolfgang Minker
Publié dans: Proceedings of the INLG 2016 Workshop on Computational Creativity in Natural Language Generation, 2016, Page(s) 36-40
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/w16-5506

Combining acoustic and linguistic features in phrase-oriented prosody prediction

Auteurs: Mónica Dominguez, Mireia Farrús, Leo Wanner
Publié dans: Speech Prosody 2016, 2016, Page(s) 796-800
Éditeur: ISCA
DOI: 10.21437/speechprosody.2016-163

Paragraph-based prosodic cues for speech synthesis applications

Auteurs: Mireia Farrús, Catherine Lai, Johanna D. Moore
Publié dans: Speech Prosody 2016, 2016, Page(s) 1143-1147
Éditeur: ISCA
DOI: 10.21437/speechprosody.2016-235

Semantics-Driven Recognition of Collocations Using Word Embeddings

Auteurs: Sara Rodríguez-Fernández, Luis Espinosa Anke, Roberto Carlini, Leo Wanner
Publié dans: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2016, Page(s) 499-505
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/p16-2081

Question Answering over Pattern-Based User Models

Auteurs: Georgios Meditskos, Stamatia Dasiopoulou, Stefanos Vrochidis, Leo Wanner, Ioannis Kompatsiaris
Publié dans: Proceedings of the 12th International Conference on Semantic Systems - SEMANTiCS 2016, 2016, Page(s) 153-160, ISBN 9781-450347525
Éditeur: ACM Press
DOI: 10.1145/2993318.2993331

Using hierarchical information structure for prosody prediction in content-to-speech applications

Auteurs: Domínguez Bajo, Mónica; Farrús, Mireia; Burga Díaz, Alicia; Wanner, Leo
Publié dans: Proceedings of Speech Prosody 8, 2016
Éditeur: ISCA
DOI: 10.13140/RG.2.1.2643.1128

Towards an Ontology-Driven Adaptive Dialogue Framework

Auteurs: Georgios Meditskos, Stamatia Dasiopoulou, Louisa Pragst, Stefan Ultes, Stefanos Vrochidis, Ioannis Kompatsiaris, Leo Wanner
Publié dans: Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction - MARMI '16, 2016, Page(s) 15-20, ISBN 9781-450343626
Éditeur: ACM Press
DOI: 10.1145/2927006.2927009

Towards a Multimedia Knowledge-Based Agent with Social Competence and Human Interaction Capabilities

Auteurs: Leo Wanner, Ioannis Kompatsiaris, Elisabeth André, Florian Lingenfelser, Gregor Mehlmann, Andries Stam, Ludo Stellingwerff, Bianca Vieru, Lori Lamel, Wolfgang Minker, Louisa Pragst, Josep Blat, Stefan Ultes, Stamatia Dasiopoulou, Mónica Domínguez, Gerard Llorach, Simon Mille, Federico Sukno, Eleni Kamateri, Stefanos Vrochidis
Publié dans: Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction - MARMI '16, 2016, Page(s) 21-26, ISBN 9781-450343626
Éditeur: ACM Press
DOI: 10.1145/2927006.2927011

Automatic Paragraph Segmentation with Lexical and Prosodic Features

Auteurs: Catherine Lai, Mireia Farrús, Johanna D. Moore
Publié dans: Interspeech 2016, Numéro Proceedings of Interspeech 2016, 2016, Page(s) 1034-1038
Éditeur: ISCA
DOI: 10.21437/Interspeech.2016-992

An automatic prosody tagger for spontaneous speech

Auteurs: Domínguez Bajo, Mónica; Farrús, Mireia; Wanner, Leo
Publié dans: Proceedings of COLING, 2016
Éditeur: ICCL

Transition-based Spinal Parsing

Auteurs: Miguel Ballesteros, Xavier Carreras
Publié dans: Proceedings of the Nineteenth Conference on Computational Natural Language Learning, 2015, Page(s) 289-299
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/k15-1029

Recurrent Neural Network Grammars

Auteurs: Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith
Publié dans: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016, Page(s) 199-209
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/n16-1024

From Emotions to Action Units with Hidden and Semi-Hidden-Task Learning

Auteurs: Adria Ruiz, Joost Van de Weijer, Xavier Binefa
Publié dans: 2015 IEEE International Conference on Computer Vision (ICCV), 2015, Page(s) 3703-3711, ISBN 978-1-4673-8391-2
Éditeur: IEEE
DOI: 10.1109/iccv.2015.422

Combining acoustic and linguistic features in phrase-oriented prosody prediction

Auteurs: Domínguez Bajo, Mónica; Farrús, Mireia; Wanner, Leo
Publié dans: Proceedings of Speech Prosody 8, 2016
Éditeur: ISCA
DOI: 10.13140/RG.2.1.3691.6886

A Neural Network Architecture for Multilingual Punctuation Generation

Auteurs: Miguel Ballesteros, Leo Wanner
Publié dans: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, Page(s) 1048-1053
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/d16-1111

A Multimodal Annotation Schema for Non-Verbal Affective Analysis in the Health-Care Domain

Auteurs: Federico Sukno, Mónica Domínguez, Adria Ruiz, Dominik Schiller, Florian Lingenfelser, Louisa Pragst, Ekeni Kamateri, Stefanos Vrochidis
Publié dans: Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction - MARMI '16, 2016, Page(s) 9-14, ISBN 9781-450343626
Éditeur: ACM Press
DOI: 10.1145/2927006.2927008

Cultural Communication Idiosyncrasies in Human-Computer Interaction

Auteurs: Juliana Miehle, Koichiro Yoshino, Louisa Pragst, Stefan Ultes, Satoshi Nakamura, Wolfgang Minker
Publié dans: Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2016, Page(s) 74-79
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/w16-3610

Improved Transition-based Parsing by Modeling Characters instead of Words with LSTMs

Auteurs: Miguel Ballesteros, Chris Dyer, Noah A. Smith
Publié dans: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015, Page(s) 349-359
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/d15-1041

Praat on the Web: an upgrade of Praat for semi-automatic speech annotation

Auteurs: Domínguez Bajo, Mónica; Latorre, Iván; Farrús, Mireia; Codina-Filbà, Joan; Wanner, Leo
Publié dans: Proceedings of COLING 2016, 2016
Éditeur: ICCL

Ontology-driven context interpretation and conflict resolution for dialogue-based home care assistance

Auteurs: Meditskos, Georgios; Kontopoulos, Efstratios; Vrochidis, Stefanos; Kompatsiaris, Ioannis
Publié dans: Proceedings of the 9th International Conference Semantic Web Applications and Tools for Life Sciences (SWAT4LS), 2016
Éditeur: CEUR-WS

Extending WordNet with fine-grained collocational information via supervised distributional learning

Auteurs: Espinosa-Anke, Luis; Camacho-Collados, Jose; Rodríguez Fernández, Sara; Saggion, Horacio; Wanner, Leo
Publié dans: Proceedings of COLING 2016, 2016
Éditeur: ICCL

Example-based acquisition of fine-grained collocational resources

Auteurs: Rodríguez Fernández, Sara; Carlini, Roberto; Espinosa-Anke, Luis; Wanner, Leo
Publié dans: Proceedings of the International Conference on Linguistic Resources and Evaluation (LREC), 2016
Éditeur: ELRA

Visualizing Deep-Syntactic Parser Output

Auteurs: Juan Soler-Company, Miguel Ballesteros, Bernd Bohnet, Simon Mille, Leo Wanner
Publié dans: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, 2015, Page(s) 56-60
Éditeur: Association for Computational Linguistics
DOI: 10.3115/v1/n15-3012

Transition-Based Dependency Parsing with Stack Long Short-Term Memory

Auteurs: Chris Dyer, Miguel Ballesteros, Wang Ling, Austin Matthews, Noah A. Smith
Publié dans: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2015, Page(s) 334-343
Éditeur: Association for Computational Linguistics
DOI: 10.3115/v1/p15-1033

Adaptive dialogue management in the KRISTINA project for multicultural health care applications

Auteurs: Pragst, Louisa; Ultes, Stefan; Kraus, Matthias; Minker, Wolfgang
Publié dans: Proceedings of the 19thWorkshop on the Semantics and Pragmatics of Dialogue, 2016
Éditeur: University of Gothenburg

A multimedia interactive search engine based on graph-based and non-linear multimodal fusion

Auteurs: Anastasia Moumtzidou, Ilias Gialampoukidis, Theodoros Mironidis, Dimitris Liparas, Stefanos Vrochidis, Ioannis Kompatsiaris
Publié dans: 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI), 2016, Page(s) 1-4, ISBN 978-1-4673-8695-1
Éditeur: IEEE
DOI: 10.1109/CBMI.2016.7500276

Query-based topic detection using concepts and named entities

Auteurs: Gialampoukidis, Ilias; Liparas, Dimitris; Vrochidis, Stefanos; Kompatsiaris, Ioannis
Publié dans: Proceedings of the 1st International Workshop on Multimodal Media Data Analytics, 2016
Éditeur: CEUR

Data-driven sentence generation with non-isomorphic trees

Auteurs: Ballesteros, Miguel; Bohnet, Bernd; Mille, Simon; Wanner, Leo
Publié dans: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2015
Éditeur: Association for Computational Linguistics

Transition-based dependency parsing with heuristic backtracking

Auteurs: Buckman, Jacob; Ballesteros, Miguel; Dyer, Chris
Publié dans: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016
Éditeur: Association for Computational Linguistics

Compilation of Corpora for the Study of the Information Structure-Prosody Interface

Auteurs: Domínguez, M., A. Burga, M. Farrús, L. Wanner
Publié dans: Proceedings of the Language Resources and Evaluation Conferece, 2018
Éditeur: ELRA

Paragraph prosodic patterns to enhance text-to-speech naturalness

Auteurs: Peiró-Lilja, A., M. Farrús
Publié dans: Proceedings of the Speech Prosody Conference, 2018
Éditeur: ISCA

Thematicity-based prosody enrichment for text-to-speech applications

Auteurs: Domínguez, M., M. Farrús, L. Wanner
Publié dans: Proceedings of the Speech Prosody Conference, 2018
Éditeur: ISCA

Effects of Gender Stereotypes on Trust and Likability in Spoken Human-Robot Interaction

Auteurs: Kraus, M., J. Kraus, M. Baumann and W. Minker
Publié dans: Proceedings of LREC, 2018
Éditeur: ELRA

On the Vector Representation of Utterances in Dialogue Context

Auteurs: Pragst, L., N. Rach, W. Minker and S. Ultes
Publié dans: Proceedings of LREC 2018, 2018
Éditeur: ELRA

What Causes the Differences in Communication Styles? A Multicultural Study on Directness and Elaborateness

Auteurs: Miehle, J., W. Minker and S. Ultes
Publié dans: Proceedings of LREC 2018, 2018
Éditeur: ELRA

Compilation of Corpora for the Study of the Information Structure–Prosody Interface

Auteurs: Burga, A., M. Domínguez, M. Farrús and L. Wanner
Publié dans: Proceedings of LREC 2018, 2018
Éditeur: ELRA

Animation On The Web: A Survey

Auteurs: A. Ahire, A. A.Evans, and J. Blat
Publié dans: ACM Web3D 2015, 2015
Éditeur: ACM

Data driven sentence generation with non-isomorphic trees

Auteurs: M. Ballesteros, B. Bohnet, S. Mille, and L. Wanner
Publié dans: Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL), 2015
Éditeur: ACL

Improved Transition-Based Parsing by Modeling Characters instead of Words with LSTMs

Auteurs: M. Ballesteros, C. Dyer and N. Smith
Publié dans: International Conference on Empirical Methods in NLP, 2015
Éditeur: ACL

Transition-Based Spinal Parsing

Auteurs: M. Ballesteros and X. Carreras
Publié dans: International Conference on Natural Language Learning (CoNLL), 2015
Éditeur: ACL

Using Hierarchical Information Structure for Prosody Prediction in Content-to-Speech Application

Auteurs: M. Domínguez, M. Farrús, A. Burga, and L. Wanner
Publié dans: Speech Prosody, 2016
Éditeur: International Speech Communication Association (ISCA)

Static and Dynamic Feature Selection in Morphosyntactic Analyzers

Auteurs: B. Bohnet., M. Ballesteros, R. McDonald and J. Nivre
Publié dans: Arxiv, Numéro arXiv:1513.655, 2016
Éditeur: Cornell University

Training with Exploration Improves a Greedy Stack-LSTM Parser

Auteurs: M. Ballesteros, Y. Goldberg, C. Dyer and N. Smith
Publié dans: Arxiv, Numéro arXiv:1603.03793, 2016
Éditeur: Cornell University

Combining Acoustic and Linguistic Features in Phrase-Oriented Prosody Prediction

Auteurs: M. Domínguez, M. Farrús, L. Wanner
Publié dans: Speech Prosody, 2016
Éditeur: International Speech Communication Association (ISCA)

Transition-Based Dependency Parsing with Stack Long Short-Term Memory

Auteurs: C. Dyer, M. Ballesteros, W. Ling, A. Matthews and N. Smith
Publié dans: Annual Meeting of the Association for Computational Linguistics (ACL), 2015
Éditeur: ACL

Recurrent Neural Network Grammars

Auteurs: C. Dyer, A. Kuncoro, M. Ballesteros and N. Smith
Publié dans: Annual Meeting of the North American Chapter of the ACL, 2016
Éditeur: ACL

Paragraph-based Prosodic Cues for Speech Synthesis Applications

Auteurs: M. Farrús, G., Lai, and J.D. Moore
Publié dans: Speech Prosody, 2016
Éditeur: International Speech Communication Association (ISCA)

Retrieval of Multimedia objects by Fusing Multiple Modalities

Auteurs: I. Gialampoukidis, A. Moumtzidou, T. Tsikrika, S. Vrochidis and I. Kompatsiaris
Publié dans: International Conference on Multimedia Retrieval (ICMR), 2016
Éditeur: ACM
DOI: 10.1145/2911996.2912068

A hybrid framework for news clustering based on the DBSCAN-Martingale and LDA

Auteurs: I. Gialampoukidis, S. Vrochidis, I. Kompatsiaris
Publié dans: 12th International Conference on Machine Learning and Data Mining, 2016
Éditeur: ibai
DOI: 10.1007/978-3-319-41920-6_13

Neural Architectures for Named Entity Recognition

Auteurs: G. Lample, M. Ballesteros, K. Kawakami, S. Subramanian and C. Dyer
Publié dans: Annual Meeting of the North American Chapter of the ACL, 2016
Éditeur: ACL

Exploiting visual similarities for ontology alignment

Auteurs: C. Doulaverakis, S. Vrochidis, and I. Kompatsiaris
Publié dans: Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, 2015
Éditeur: SCITEPRESS Digital Library

Towards an Ontology-driven Adaptive Dialogue Framework

Auteurs: G. Meditskos
Publié dans: First International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction, held in conjunction with the ACM Conference on Multimedia Retrieval, 2016
Éditeur: ACM

Adaptive Dialogue Management in the KRISTINA Project for Multicultural Health Care Applications

Auteurs: Louisa Pragst, Stefan Ultes, Matthias Kraus, and Wolfgang Minker
Publié dans: Proceedings of the 19thWorkshop on the Semantics and Pragmatics of Dialogue (SEMDIAL), 2015, Page(s) 202-203
Éditeur: University of Gothenburg

Fast Visual Vocabulary Construction for Image Retrieval using Skewed-Split k-d trees

Auteurs: Ilias Gialampoukidis, Stefanos Vrochidis, and Ioannis Kompatsiaris
Publié dans: Proceedings of the 22nd International Conference on MultiMedia Modeling (MMM16), 2016, ISBN 978-3-319-27671-7
Éditeur: Springer

Recurrent Neural Network Interaction Quality Estimation

Auteurs: Louisa Pragst, Stefan Ultes, and Wolfgang Minker
Publié dans: Proceedings of the Seventh International Workshop on Spoken Dialogue Systems, 2016
Éditeur: Association for Computational Linguistics

An Automatic Prosody Tagger for Spontaneous Speech

Auteurs: Mónica Domínguez, Mireia Farrús, Leo Wanner
Publié dans: Proceedings of the International Conference on Computational Linguistics, 2016
Éditeur: Association for Computational Linguistics

Web-based live speech-driven lip-sync

Auteurs: Gerard Llorach, Alun Evans, Josep Blat, Giso Grimm, and Volker Hohmann
Publié dans: Proceedings of VS-Games 2016, the 8th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games 2016), 2016
Éditeur: IEEE Xplore digital library

Question Answering over Pattern-Based User Models

Auteurs: Georgios Meditskos, Stamatia Dasiopoulou, Stefanos Vrochidis, Leo Wanner, and Ioannis Kompatsiaris
Publié dans: Proceedings of the 12th International Conference on Semantic Systems (SEMANTiCS 2016), 2016, Page(s) 153-160, ISBN 978-1-4503-4752-5
Éditeur: ACM

Praat on the Web: An Upgrade of Praat for Semi-Automatic Speech Annotation

Auteurs: Mónica Domínguez, Iván Latorre, Mireia Farrús, Joan Codina-Filbà, and Leo Wanner
Publié dans: Proceedings of the International Conference on Computational Linguistics, 2016
Éditeur: Association for Computational Linguistics

A Multimedia Interactive Search Engine based on Graph-based and Non-linear Multimodal Fusion

Auteurs: A. Moumtzidou, I. Gialampoukidis, T. Mironidis, D. Liparas, S. Vrochidis, and I. Kompatsiaris
Publié dans: Proceedings of the 14th International Workshop on Content-based Multimedia Indexing (CBMI), 2016
Éditeur: IEEExplore Digital Library

A hybrid framework for news clustering based on the DBSCAN-Martingale and LDA

Auteurs: I. Gialampoukidis, S. Vrochidis, I. Kompatsiaris . , New York, USA, 16-21 July 2016.
Publié dans: Proceedings of the 12th International Conference on Machine Learning and Data Mining, 2016, ISBN 978-3-319-41919-0
Éditeur: Springer

Extending WordNet with Fine-Grained Collocational Information

Auteurs: Luis Espinosa Anke, José Camacho-Collados, Sara Rodríguez-Fernández, Horacio Saggion, Leo Wanner
Publié dans: Proceedings of the International Conference on Computational Linguistics, 2016
Éditeur: Association for Computational Linguistics

KRISTINA - A Knowledge-Based Information Agent with Social Competence and Human Interaction Capabilities

Auteurs: J. Mohr, V. Sarholz, B. Schäfer et al
Publié dans: Zukunft Lebensräume, 2016
Éditeur: Messe Frankfurt Exhibition GmbH

A Neural Network Architecture for Multilingual Punctuation Generation

Auteurs: M. Ballesteros, L. Wanner
Publié dans: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Short paper track, 2016
Éditeur: Association for Computational Linguistics

Semantics-Driven Recognition of Collocations Using Word Embeddings

Auteurs: Sara Rodríguez Fernández, Luis Espinosa Anke, Roberto Carlini, Leo Wanner
Publié dans: Proceedings of the AnnualMeeting of the Association for Computational Linguistics (ACL), Short paper track, 2016
Éditeur: Association for Computational Linguistics

Ontology-Driven Context Interpretation and Conflict Resolution for Dialogue-Based Home Care Assistance

Auteurs: G. Mediskos, E. Kontopoulos, S. Vrochidis, and I. Kompatsiaris
Publié dans: Proceedings of the International Conference on Semantic Web Applications and Tools for Life Sciences (SWAT4LS), 2016
Éditeur: CEUR Workshop Proceedings

Multi-instance Dynamic Ordinal Random Fields for weakly-supervised pain intensity estimation

Auteurs: A. Ruiz, Rudovic, O., Binefa, X., and Pantic, M.
Publié dans: Proceedings of the Asian Conference on Computer Vision (ACCV), 2016
Éditeur: Springer

Cultural Communication Idiosyncrasies in Human-Computer Interaction

Auteurs: Miehle, J., Yoshino, K., Pragst, L., Ultes, S., Nakamura, S. and Minker, W.
Publié dans: Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2016
Éditeur: Association for Computational Linguistics

Automatic Modification of Communication Style in Dialogue Management

Auteurs: Pragst, L., Miehle, J., Ultes, S. and Minker, W.
Publié dans: Proceedings of the INLG 2016 Workshop on Computational Creativity in Natural Language Generation, 2016
Éditeur: Association for Computational Linguistics

Query-based Topic Detection Using Concepts and Named Entities

Auteurs: I. Gialampoukidis, D. Liparas, S. Vrochidis, I. Kompatsiaris
Publié dans: Proceedings of the 1st International Workshop on Multimodal Media Data Analytics (MMDA), 2016
Éditeur: CEUR Workshop Proceedings

VERGE IN VBS 2017

Auteurs: A. Moumtzidou, T. Mironidis, F. Markatopoulou, S. Andreadis, I. Gialampoukidis, D. Galanopoulos, A. Ioannidou, S. Vrochidis, V. Mezaris, I. Kompatsiaris, and I. Patras
Publié dans: Proceedings of Video Browser Showdown (VBS'17) at the 23rd International Conference on MultiMedia Modeling (MMM'17), 2017
Éditeur: Springer

Description Logics and Rules for Multimodal Situational Awareness in Healthcare

Auteurs: G. Meditskos, S. Vrochidis, and I. Kompatsiaris ,, Reykjavik, Iceland, 4-6 January 2017.
Publié dans: Proceedings of the 23rd International Conference on MultiMedia Modeling (MMM'17), 2017
Éditeur: Springer

Dem@Home: Ambient Intelligence for Clinical Support of People Living with Dementia

Auteurs: Stelios Andreadis, Thanos G. Stavropoulos, Georgios Meditskos, and Ioannis Kompatsiaris
Publié dans: Proceedings of the 1st workshop on Semantic Web Technologies in Mobile and Pervasive Environments, in conjunction with ESWC 2016, 2016
Éditeur: Springer

Example-based Acquisition of Fine-grained Collocation Resources

Auteurs: S. Rodríguez-Fernández, R. Carlini, L. Espinosa Anke, and L. Wanner
Publié dans: International Conference on Language Resources and Evaluation (LREC), 2016
Éditeur: ELDA

Visualizing Deep-Syntactic Parser Output

Auteurs: J. Soler-Company, M. Ballesteros, B. Bohnet, S. Mille and L. Wanner
Publié dans: Annual Meeting of the North American Chapter of the ACL, Demo Track, 2015
Éditeur: ACL

A Multimodal Annotation Schema for Non-Verbal Affective Analysis in the Health-Care Domain

Auteurs: F. Sukno, M. Dominguez, A. Ruiz Ovejero, D. Schiller, F. Lingenfelser, L. Pragst, E. Kamateri and S. Vrochidis
Publié dans: First International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction, held in conjunction with the ACM Conference on Multimedia Retrieval, 2016
Éditeur: ACM

Towards a Multimedia Knowledge-Based Agent with Social Competence and Human Interaction Capabilities

Auteurs: L. Wanner et al.
Publié dans: First International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction, held in conjunction with the ACM Conference on Multimedia Retrieval, 2016
Éditeur: ACM

From Emotions to Action Units with Hidden and Semi-Hidden-Task Learning

Auteurs: "A. Ruiz, J. Van de Weijer, and X. Binefa. """
Publié dans: IEEE International Conference on Computer Vision, 2015
Éditeur: IEEE

A pipeline for the creation of progressively rendered web 3D scenes

Auteurs: Alun Evans, Javi Agenjo, Josep Blat
Publié dans: Multimedia Tools and Applications, 2017, ISSN 1380-7501
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s11042-017-5463-6

Design of a Knowledge-Based Agent as a Social Companion

Auteurs: Leo Wanner, Elisabeth André, Josep Blat, Stamatia Dasiopoulou, Mireia Farrús, Thiago Fraga, Eleni Kamateri, Florian Lingenfelser, Gerard Llorach, Oriol Martínez, Georgios Meditskos, Simon Mille, Wolfgang Minker, Louisa Pragst, Dominik Schiller, Andries Stam, Ludo Stellingwerff, Federico Sukno, Bianca Vieru, Stefanos Vrochidis
Publié dans: Procedia Computer Science, Numéro 121, 2017, Page(s) 920-926, ISSN 1877-0509
Éditeur: Elsevier
DOI: 10.1016/j.procs.2017.11.119

Multimedia retrieval based on non-linear graph-based fusion and partial least squares regression

Auteurs: Ilias Gialampoukidis, Anastasia Moumtzidou, Dimitris Liparas, Theodora Tsikrika, Stefanos Vrochidis, Ioannis Kompatsiaris
Publié dans: Multimedia Tools and Applications, Numéro 76/21, 2017, Page(s) 22383-22403, ISSN 1380-7501
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s11042-017-4797-4

Modeling Grounding for Interactive Social Companions

Auteurs: Gregor Mehlmann, Kathrin Janowski, Elisabeth André
Publié dans: KI - Künstliche Intelligenz, Numéro 30/1, 2016, Page(s) 45-52, ISSN 0933-1875
Éditeur: Springer
DOI: 10.1007/s13218-015-0397-5

Data-driven deep-syntactic dependency parsing

Auteurs: MIGUEL BALLESTEROS, BERND BOHNET, SIMON MILLE, LEO WANNER
Publié dans: Natural Language Engineering, 2015, Page(s) 1-36, ISSN 1351-3249
Éditeur: Cambridge University Press
DOI: 10.1017/S1351324915000285

Modeling Grounding for Interactive Social Companions

Auteurs: Gregor Mehlmann, Kathrin Janowski, and Elisabeth André
Publié dans: KI, Numéro 30(1), 2016, Page(s) 45-52, ISSN 0933-1875
Éditeur: Springer

KRISTINA, un asistente virtual para superar las barreras lingüísticas en la atención sanitaria

Auteurs: Dafa, Lehdia Mohamed; Baudracco, Chiara; Moragas, Ana; Llor Vila, Carles; Molero Trujillo, David; Vilanova Estrada, Pere
Publié dans: Comunidad, Numéro 19(2), 2017, ISSN 2339-7896
Éditeur: semFYC

FORGe at WebNLG 2017

Auteurs: Mille, Simon; Dasiopoulou, Stamatia
Publié dans: 2017
Éditeur: Universitat Pompeu Fabra

FORGe at E2E 2017

Auteurs: Mille, Simon; Dasiopoulou, Stamatia
Publié dans: 2017
Éditeur: Universitat Pompeu Fabra

Recherche de données OpenAIRE...

Livrables

Publications

Partager cette page

Télécharger