Publications

2024

Journals

• A Allemang-Trivalle, J Donjat, G Bechu, G Coppin, M Chollet, OW Klaproth, A Mitschke, A Schirrmann and CGL Cao, "Modelling Fatigue in Manual and Robot-Assisted Work for Operator 5.0". In IISE Transactions on Occupational Ergonomics and Human Factors. In press.

• B Biancardi, M Chollet, C Clavel, “Introducing the 3MT_French Dataset to Investigate the Timing of Public Speaking Judgements”. In Language Resources and Evaluation. In press.

Conference Proceedings

• C Kessassi, M Chollet, C Dumas and C Cao, "You’re Hired! Effect of Virtual Agents’ Social Status and Social Attitudes on Stress Induction in Virtual Job Interviews". IEEE VR, March 22024

• S. Ashkenazi, G. Skantze, J. Stuart-Smith, and M. E. Foster, "Goes to the Heart: Speaking the User's Native Language," Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, pp. 214–218, March 2024.

2023

Conference Proceedings

• A Lechappe, A Milliat,C Fleury, M Chollet and C Dumas, "Characterization of Collaboration in a Virtual Environment with Gaze and Speech Signal". In International Conference on Multimodal Interaction - Late Breaking Results Track (ICMI 2023), Paris, October 2023.

• A Barkar, B Biancardi, C Clavel and M Chollet, "Insights Into the Importance of Linguistic Textual Features on the Persuasiveness of Public Speaking". International Conference on Multimodal Interaction - Late Breaking Results Track (ICMI 2023), Paris, October 2023.

• M Gahalawat, R F Rojas, T Guha, R Subramanian and R Goecke, "Explainable Depression Detection via Head Motion Patterns", International Conference on Multimodal Interaction (ICMI), Paris, October 2023.

• C Kessassi, M Chollet, C Dumas and C Cao, "Social Presence Mediates Audience Behavior Effects on Social Stress in Virtual Public Speaking". International Conference on Affective Computing and Intelligent Interaction (ACII 2023), September 2023. 

• A Buker, H Alsofyani and A Vinciarelli, "Multiple Instance Learning for Inference of Child Attachment From Paralinguistic Aspects of Speech", INTERSPEECH, Dublin, Ireland, August 2023.

• F Tao, A Esposito and A Vinciarelli, "The Androids Corpus: A New Publicly Available Benchmark for Speech Based Depression Detection", INTERSPEECH, Dublin, Ireland, August 2023.

• B Alsenani, T Guha and A Vinciarelli, "Privacy Risks in Speech Emotion Recognition: A Systematic Study on Gender Inference Attack, INTERSPEECH, Dublin, Ireland, August 2023.

• A Shirian, M Ahmadian, K Somandepalli and T Guha, “Heterogeneous Graph Learning for Acoustic Event Classification”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes, Greece, June 2023. [Code]

• F Tao, X Ge, W Ma, A Esposito and A Vinciarelli, “Multi-local Attention for Speech-based Depression Detection”, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes, Greece, June 2023.

• Y Ma, V Sanchez, S Nikan, D Upadhyay, B Atote and T Guha, “Robust Multiview Multimodal Driver Monitoring System using Masked Multihead Self Attention”, IEEE/CVF International Conference on Computer Vision and Pattern Recognition Workshops (CVPR-W), Vancouver, Canada, June 2023.  [Code]

• B Biancardi, M Chollet, C Clavel, “Introducing the 3MT_French Dataset”,  First International Multimodal Communication Symposium, Barcelona, Spain, April 2023.

• B Biancardi, Y Duan, M Chollet, and C Clavel, “It’s not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training”, 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), Lisbon, Portugal, February 2023.

2022

Book Chapter(s)

• A Esposito, A Vinciarelli and G Cordasco, “A Research Agenda for Dementia Care: Prevention, Risk Mitigation and Personalized Interventions“, in “Advances in Assistive Technologies”, G.A.Tsihrintzis, M.Virvou, A.Esposito and L.C.Jain (eds.), Springer Verlag, 2022.

Journals

• O Styles, T Guha and V Sanchez, "Multicamera Trajectory Forecasting with Trajectory Tensors", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol 44(11), pp 8482 - 8491, November 2022.

• A Shirian, K Somandepalli and T Guha, “Self-supervised Graphs for Audio Representation Learning with Limited Labeled Data”, IEEE Journal of Selected Topics in Signal Processing, vol. 26(6), pp. 1391-1401, October 2022. [Code]

• A Shirian, S Tripathi and T Guha, “Dynamic Emotion Modeling with Learnable Graphs and Graph Inception Network”, IEEE Transactions on Multimedia, vol. 24, pp. 780 - 790, February 2022. 

• T Amorese, M Cuciniello, A Vinciarelli, G Cordasco and A Esposito, “Synthetic vs Human Emotional Faces: What Changes in Humans Decoding Accuracy“, IEEE Transactions on Human-Machine Systems, Vol. 52(3), pp. 390-399, 2022.

• M Tayarani, A Esposito and A Vinciarelli, “What an `Ehm’ Leaks About You: Mapping Fillers into Personality Traits with Quantum Evolutionary Feature Selection Algorithms“, IEEE Transactions on Affective Computing, Vol. 13(1), pp. 108-121, 2022.

• N Aloshoban, A Esposito and A Vinciarelli, “What You Say Or How You Say It? Depression Detection Through Joint Modelling of Linguistic and Acoustic Aspects of Speech“, Cognitive Computation, Vol 14, pp. 1585-1598, 2022.

• M Chollet, S Marsella, and S Scherer. "Training public speaking with virtual social interactions: effectiveness of real-time feedback and delayed feedback." Journal on Multimodal User Interfaces, vol. 16, pp. 17–29, 2022. 

Conference Proceedings

• K Min, S Tripathi, S Roy, T Guha and S Majumdar, “Learning spatial-temporal graphs for active speaker detection”, European Conference on Computer Vision (ECCV), Tel-Aviv, Israel, October 2022. [Code]

• Y Ma, V Sanchez and T Guha, “FusionCount: Efficient Crowd Counting via Multiscale Feature Fusion”, IEEE International Conference on Image Processing (ICIP), Bordeaux, France, October 2022.

• A Shirian, K Somandepalli, V Sanchez and T Guha, “Visually-aware Acoustic Event Detection using Heterogeneous Graphs”, INTERSPEECH, Incheon, S Korea, September 2022. [Code]

• G Rennie, O Perepelkina and A Vinciarelli, “Which Model is Best: Comparing Methods and Metrics for Automatic Laughter Detection in a Naturalistic Conversational Dataset“,  INTERSPEECH, Incheon, S Korea, September 2022.

• A Bîrlădeanu, H Minnis and A Vinciarelli, “Automatic Detection of Reactive Attachment Disorder Through Turn-Taking Analysis in Clinical Child-Caregiver Sessions“,  INTERSPEECH, Incheon, S Korea, September 2022.

• V Silber-Varod, A Vinciarelli and B Har Lev, “The business side of social signals and nonverbal communication“, Knowledge Management (KM) Conference, Ljubljana, Slovenia, June 2022.

• H Alsofyani and A Vinciarelli, “Attachment Recognition in School-Age Children: A Multimodal Approach Based on Language and Paralanguage Analysis“, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore, May 2022.

• R Alsarrani, A Esposito and A Vinciarelli, “Thin Slices of Depression: Improving Depression Detection Performance Through Data Segmentation“, IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore, May 2022.

2021

Book Chapter(s)

• A Buker and A Vinciarelli, “Who Is Typing? Automatic Gender Recognition from Interactive Textual Chats Using Typing Behaviour“, in “Enabling Machine Learning Applications in Data Science. Algorithms for Intelligent Systems”, A.E.Hassanien, A.Darwish, S.M.Abd El-Kader, D.A.Alboaneen (eds.), Springer Verlag, pp. 3-15, 2021.

Journals

• G Roffo, S Melzi, U Castellani, A Vinciarelli and M Cristani, “Infinite Feature Selection: a Graph-based Feature Filtering Approach“, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 43(12), pp. 4396-4410, 2021.

• C Greco, O Matarazzo, G Cordasco, A Vinciarelli, Z Callejas and A Esposito, “Discriminative Power of EEG-Based Biomarkers in Major Depressive Disorder: A Systematic Review“, IEEE Access, Vol. 9, pp. 112850-112870, 2021.

• H Minnis, M Rooksby, S Di Folco, M Tayarani, D-B Vo, R Huan, A Vinciarelli and S Brewster, “The School Attachment Monitor – a Novel Computational Tool for Assessment of Attachment in Middle Childhood“, PLOS One, 6(7): e0240277, 2021.

Conference Proceedings

• H Alsofyani and A Vinciarelli, “Attachment Recognition in School Age Children Based on Automatic Analysis of Facial Expressions and Nonverbal Vocal Behaviour“, ACM International Conference on Multimodal Interactions (ICMI), Montreal, Canada, October 2021.

• A Buker and A Vinciarelli, “I Feel it in Your Fingers: Inference of Self-Assessed Personality Traits From Keystroke Dynamics in Interactive Dyadic Chats“, IEEE International Conference on Affective Computing and Intelligent Interactions (ACII), Virtual, September 2021.

• N Aloshban, A Esposito and A Vinciarelli, “Language or Paralanguage, This is the Problem: Comparing Depressed and Non-Depressed Speakers Through the Analysis of Gated Multimodal Units“, INTERSPEECH, Brno, Czech, September 2021.

• H Alsofyani and A Vinciarelli, “Stacked Recurrent Neural Networks for Speech-Based Inference of Attachment Condition in School Age Children“,  INTERSPEECH, Brno, Czech, September 2021.

2020

Book Chapter(s)

• K Lohan, M I Ahmad, C Dondrup, P Ardón, E Pairet, A Vinciarelli, “Adapting Movements and Behaviour to Favour Communication in Human-Robot Interaction“, in “Modelling Human Motion”, N.Noceti, A.Sciutti, F.Rea (eds.), Springer Verlag, pp. 271-297, 2020.

Journals

• M Cristani, A  Del Bue, V Murino, F Setti, A Vinciarelli, “The Visual Social Distancing Problem“, IEEE Access, Vol. 8, pp. 126876-126886, 2020.

• M Aylett, M Wester and A Vinciarelli, “Speech Synthesis for the Generation of Artificial Personality“, IEEE Transactions on Affective Computing, Vol. 11(2), pp. 361-372, 2020.

• M Klados, P Konstantinidi, R Dacosta-Aguayo, V-D Kostaridou, A Vinciarelli and M Zervakis, “Automatic Recognition of Personality Profiles Using EEG Functional Connectivity during Emotional Processing“, Brain Sciences, Vol. 10(5), pp. 278-292, 2020.

Conference Proceedings

• A Esposito, T Amorese, N M Maldonato, A Vinciarelli, M I Torres, S Escalera, G Cordasco, “Seniors’ ability to decode differently aged facial emotional expressions” IEEE International Conference on Automatic Face and Gesture Recognition (FG), Virtual, November 2020.

• N Aloshban, A Esposito and A Vinciarelli, “Detecting Depression in Less Than 10 Seconds: Impact of Speaking Time on Depression Detection Sensitivity“, ACM International Conference on Multimodal Interaction (ICMI), Virtual, October 2020.

• D B Vo, S Brewster and A Vinciarelli, “Did the Children Behave? Investigating the Relationship Between Attachment Condition and Child Computer Interaction“, ACM International Conference on Multimodal Interaction (ICMI), Virtual, October 2020.

• F Tao, A Esposito and A Vinciarelli, “Spotting the Traces of Depression in Read Speech: An Approach Based on Computational Paralinguistics and Social Signal Processing“, INTERSPEECH, Virtual, October 2020.

2019

Book Chapter(s)

• A Vinciarelli, “Machine-Based Decoding of Human Voices and Speech“, in “The Oxford Handbook of Voice Perception”, S.Frühholz and P.Belin (eds.), Oxford University Press, pp. 707-718, 2019.

• A Vinciarelli, W Riviera, F Dalmasso, S Raue, C Abeyratna, “What Do Prospective Students Want? An Observational Study of Preferences About Subject of Study in Higher Education“,  in “Innovations in Big Data Mining and Embedded Knowledge”, Springer, pp. 83-97, 2019.

Journals

• A Buker, G Roffo and A Vinciarelli, “Type Like a Man! Inferring gender from keystroke dynamics in live-chats“, IEEE Intelligent Systems, vol. 34, No. 6,  2019.

• B Schuller, F Weninger, Y Zhang, F Ringeval, A Batliner, S Steidl, F Eyben, E Marchi, A Vinciarelli, K Scherer, M Chetouani, M Mortillaro, “Affective and Behavioural Computing: Lessons Learnt from the First Computational Paralinguistics Challenge”, Computer Speech and Language, vol. 53, pp. 156-180, 2019.

Conference Proceedings

• G Roffo, D B  Vo, A Sorrentino, M Rooksby, M Tayarani, S Di Folco, H Minnis, S Brewster, and A Vinciarelli, “Automating the Administration and Analysis of Psychiatric Tests: The Case of Attachment in School Age Children“, ACM Conference on Human Factors in Computing Systems (CHI), Glasgow, UK, May 2019.

• M Rooksby, D-B Vo, J Rooksby, M Tayarani, R Huan, A Vinciarelli, H Minnis and S Brewster, “Design-for-error for a Stand-alone Child Attachment Assessment Tool“, CHI Extended Abstracts, Glasgow, UK, May 2019.

• O Perepelkina and A Vinciarelli “Social and Emotion AI: The Potential for Industry Impact“, IEEE International Conference on Affective Computing and Intelligent Interaction (ACII) Workshop, Cambridge, UK, September 2019.

2018

Book Chapter(s)

• A Vinciarelli, A Esposito, M Tayarani, G Roffo, F Scibelli, F Perrone, D B Vo, “We are less free than how we think: Regular patterns in nonverbal communication”, in Multimodal Behavior Analysis in the Wild, X Alameida-Pineda, E Ricci, N Sebe (eds.), Academic Press, pp. 269-288, 2018.

• A Vinciarelli, A Esposito, “Multimodal Analysis of Social Signals”, in The Handbook of Multimodal-Multisensor Interfaces, Volume 2: Signal Processing, Architectures, and Detection of Emotion and Cognition, S.Oviatt, B.Schuller, P.Cohen, D.Sonntag, G.Potamianos, A.Kruger (eds.), pp. 203-226, 2018.

• A Mendiratta, F Scibelli, A M Esposito, V Capuano, L Likforman-Sulem, M N Maldonato, A Vinciarelli, A Esposito, “Automatic Detection of Depressive States from Speech”, in A Esposito, M Faudez-Zanuy, F Morabito, E Pasero (eds.), Multidisciplinary Approaches to Neural Computing. Smart Innovation, Systems and Technologies, pp. 301-314, Springer Verlag, 2018.

Conference Proceedings

• A Deshmukh, B Craenen, A Vinciarelli, M E Foster, “Shaping Robot Gestures to Shape Users’ Perception: The Effect of Amplitude and Speed on Godspeed Ratings”, International Conference on Human-Agent Interaction (HAI), Southampton, UK, December 2018.

• D Saggese, G Cordasco, M N Maldonato, N Bourbakis, A Vinciarelli, A Esposito, “Power Poses Affect Risk Tolerance and Skin Conductance Levels”, IEEE International Conference on Tools with Artificial Intelligence, Volos, Greece, November 2018.

• A Deshmukh, B Craenen, M E Foster, A Vinciarelli, “The More I Understand it, the Less I Like it: The Relationship Between Understandability and Godspeed Scores for Robotic Gestures”, IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, China, August 2018.

• B Craenen, A Deshmukh, M E Foster, A Vinciarelli, “Do We Really Like Robots that Match our Personality? The Case of Big-Five Traits, Godspeed Scores and Robotic Gestures”, IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, China, August 2018.

• B Craenen, A Deshmukh, M E Foster, A Vinciarelli, “Shaping Gestures to Shape Personalities: The Relationship Between Gestures Parameters, Attributed Personality Traits and Godspeed Scores“, IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, China, August 2018.

• F Scibelli, G Roffo, M Tayarani, L Bartoli, G De Mattia, A Esposito, A Vinciarelli, “Depression Speaks: Automatic Discrimination Between Depressed and Non-Depressed Speakers Based on Nonverbal Speech Features”, IEEE International Conference on Audio, Speech and Signal Processing (ICASSP), Calgary, Canada, 2018.

• B G W Craenen, A Deshmukh, M E Foster, A Vinciarelli, “Shaping Gestures to Shape Personality: Big-Five Traits, Godspeed Scores and the Similarity-Attraction Effect“, ACM International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Stockholm, Sweden, July 2018.

2017

Book Chapter(s)

• J K Burgoon, M Pantic, N Thalmann and A Vinciarelli (eds.), “Social Signal Processing”, Cambridge University Press, 2017.

• A Vinciarelli, “Social Signal Processing for Automatic Role Recognition“, in Social Signal Processing, J K Burgoon, M Pantic, N Magnenat-Thalmann (eds.), pp. 225-233, 2017.

• A Vinciarelli, “Social Signal Processing for Conflict Analysis and Measurement”, in Social Signal Processing, J K Burgoon, M Pantic, N Magnenat-Thalmann (eds.), pp. 379-388, 2017.

Journals

• C Segalin, A Perina, M Cristani and A Vinciarelli, “The Pictures we Like are our Image: Continuous Mapping of Favorite Pictures into Self-Assessed and Attributed Personality Traits“, IEEE Transactions on Affective Computing, vol. 8(2), 268-285, 2017.

Conference Proceedings

• G Roffo, S Melzi, U Castellani, A Vinciarelli, “Infinite Latent Feature Selection: A Probabilistic Latent Graph-Based Ranking Approach”, IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2017.

2016

Book Chapter(s)

• F D’Errico, I Poggi, A Vinciarelli, L Vincze (eds.), “Conflict and Multimodal Communication”, Springer Verlag, 2016.

• F Scibelli, A.Esposito and A Vinciarelli, “A Pilot Study on the Decoding of Dynamic Emotional Expressions in Major Depressive Disorder”, in Advances in Neural Networks, S Bassis, A Esposito, C F Morabito and A Esposito (eds.), Springer Verlag, pp. 189-200, 2016.

• A Vinciarelli, “Computing Technologies for Social Signals” in Emotions and Personality in Personalized Services, M Tkalčič, B De Carolis, M de Gemmis, A Odić, A Košir (eds.), pp. 101-118, 2017.

• A Vinciarelli, “On the Significance of Speech Pauses in Depressive Disorders: Results on Read and Spontaneous Narratives”, in “Recent Advances in Nonlinear Speech Processing“, A Esposito, M Faundez-Zanuy, A M Esposito, G Cordasco, T Drugman, J Sole-Casals, F C Morabito (eds.), Springer Verlag, pp. 73-82, 2016.

• A Vinciarelli, “Social Perception in Machines: The Case of Personality and the Big-Five Traits”, in Recent Advances in Nonlinear Speech Processing, A Esposito, L C Jain (eds.), Springer Verlag, pp. 151-164, 2016.

Journals

• F Scibelli, A Troncone, L Likforman-Sulem, A Vinciarelli, A Esposito, “How Major Depressive Disorder Affects the Ability to Decode Multimodal Dynamic Emotional Stimuli“, Frontiers in Information and Communication Technologies, 3:16, 2016.

Conference Proceedings

• X Xiong, M Filippone, A Vinciarelli, “Looking Good with Flickr Faves: Gaussian Processes for Finding Difference Makers in Personality Impressions”, ACM International Conference on Multimedia (ICMI), Tokyo, Japan, November 2016.

• A Esposito, A M Esposito, M Esposito, M.T.Riviello, A.Vinciarelli, N.Bourbakis, “Effects of Emotional Visual Scenes on the Ability to Decode Emotional Melodies”, IEEE International Conference on Tools with Artificial Intelligence, San Jose, USA, November 2016.