Skip to main content

Trinity College Dublin, The University of Dublin

Trinity Menu Trinity Search



You are here People

Dr. Yvette Graham
Assistant Professor, Computer Science

Biography

Yvette Graham is Assistant Professor in Artificial Intelligence in the School of Computer Science and Statistics. She has been part of the Natural Language Processing community for over 15 years and involved in a wide range of projects focusing on Machine Translation, Sentiment Analysis, Dialogue Systems, Evaluation of NLP systems and Information Retrieval. Her work achieved the best paper award at the Annual Conference of the Association for Computational Linguistics ACL in 2015.

Publications and Further Research Outputs

Peer-Reviewed Publications

Yvette Graham, Christian Federmann, Maria Eskevich, Barry Haddow, Assessing Human-Parity in Machine Translation on the Segment Level, Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP - Findings), Virtual, 16/11/20, Association for Computational Linguistics, 2020, pp4199 - 4207 Conference Paper, 2020 URL DOI TARA - Full Text

Chenyang Lyu, Tianbo Ji, Yvette Graham, Incorporating Context and Knowledge for Better Sentiment Analysis of Narrative Text , Third International Workshop on Narrative Extraction from Texts held in conjunction with the 42nd European Conference on Information Retrieval, 2020, pp39 - 45 Conference Paper, 2020

Yvette Graham; BarryHaddow; Philipp Koehn, Statistical Power and Translationese in Machine Translation Evaluation, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Virtual, 16/11/20, Association for Computational Linguistics, 2020, pp72 - 81 Conference Paper, 2020 TARA - Full Text DOI URL

Chenyang Lyu, Jennifer Foster, Yvette Graham, Improving Document-level Sentiment Analysis with User and Product Context, Proceedings of the 28th International Conference on Computational Linguistics (COLING), 28th International Conference on Computational Linguistics (COLING), Virtual, Association for Computational Linguistics, 2020, pp6724 - 6729 Conference Paper, 2020 DOI TARA - Full Text

Tianbo Ji, Yvette Graham, Gareth F. Jones, Contrasting human opinion of non-factoid question answering with automatic evaluation, Proceedings of the 2020 Conference on Human Information Interaction and Retrieval, 2020 Conference on Human Information Interaction and Retrieval, New York, NY, USA, Association for Computing Machinery, 2020, pp348 - 352 Conference Paper, 2020 DOI

Alan Smeaton, Yvette Graham, Kevin McGuinness, Noel O'Connor, Seán Quinn, Eric Arazo Sanchez, The Impact of Training Data Bias on Automatic Generation of Video Captions, Proceedings of the 25th International Conference on MultiMedia Modeling, 25th International Conference on MultiMedia Modeling, Thessaloniki, Greece, 2019, pp178 - 190 Conference Paper, 2019 TARA - Full Text DOI

Longyue Wang, Zhaopeng Tu, Shuming Shi, Tong Zhang, Yvette Graham, Qun Liu, Translating Pro-Drop Languages with Reconstruction Models, Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI 2018), 32nd AAAI Conference on Artificial Intelligence (AAAI 2018), New Orleans, LA, 2018, pp4937 - 4945 Conference Paper, 2018

Graham, Yvette and Awad, George and Smeaton, Alan, Evaluation of automatic video captioning using direct assessment, PLOS ONE, 13, (9), 2018, p1-20 Journal Article, 2018 DOI

Yvette Graham, Qingsong Ma, Timothy Baldwin, Qun Liu, Carla Parra, Carolina Scarton, Improving Evaluation of Document-level MT Quality Estimation, Proceedings of the 15th European Chapter of the Association for Computational Linguistics (EACL), 15th European Chapter of the Association for Computational Linguistics (EACL), Valencia, Spain, 2017, pp356 - 361 Conference Paper, 2017

Ma, Qingsong, Graham, Yvette, Baldwin, Timothy, Liu, Qun, Further Investigation into Reference Bias in Monolingual Evaluation of Machine Translation, Proceedings of EMNLP 2017: Conference on Empirical Methods in Natural Language Processing (EMNLP), EMNLP 2017: Conference on Empirical Methods in Natural Language Processing (EMNLP), Copenhagen, Denmark, Association for Computational Linguistics, 2017, pp2476-2485 Conference Paper, 2017 DOI

Ma, Qingsong, Graham, Yvette, Wang, Shugen, Liu, Qun, Blend: a Novel Combined MT Metric Based on Direct Assessment: CASICT-DCU submission to WMT17 Metrics Task, Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, Second Conference on Machine Translation, Copenhagen, Denmark, Association for Computational Linguistics, 2017, pp598-603 Conference Paper, 2017 DOI

Graham, Yvette, Liu, Qun, Achieving Accurate Conclusions in Evaluation of Automatic Machine Translation Metrics, Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, Association for Computational Linguistics, 2016, pp1 - 10 Conference Paper, 2016 DOI

Graham, Yvette and Baldwin, Timothy and Moffat, Alistair and Zobel, Justin, Can machine translation systems be evaluated by the crowd alone, Natural Language Engineering, FirstView, 2016, p1--28 Journal Article, 2016 DOI

Yvette Graham, Timothy Baldwin, Meghan Dowling, Maria Eskevich, Lamia Tounsi, Teresa Lynn, Is all that glitters in MT quality estimation really gold standard?, Proceedings of the 26th International Conference on Computational Linguistics (COLING), 26th International Conference on Computational Linguistics (COLING), Osaka, Japan, 11/12/16, 2016, pp3124-3134 Conference Paper, 2016 TARA - Full Text

Qingsong Ma and Fandong Meng and Daqi Zheng and Mingxuan Wang and Yvette Graham and Wenbin Jiang and Qun Liu, MaxSD: A Neural Machine Translation Evaluation Metric Optimized by Maximizing Similarity Distance, 10102, 2016, p153-161 Journal Article, 2016

Graham, Yvette, Re-evaluating Automatic Summarization with BLEU and 192 Shades of ROUGE, Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal, Association for Computational Linguistics, 2015, pp128 - 137 Conference Paper, 2015 DOI

Graham, Yvette, Baldwin, Timothy, Mathur, Nitika, Accurate Evaluation of Segment-level Machine Translation Metrics, Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics Human Language Technologies, 2015 Conference of the North American Chapter of the Association for Computational Linguistics Human Language Technologies, Denver, Colorado, Association for Computational Linguistics, 2015, pp1183-1191 Conference Paper, 2015 DOI TARA - Full Text

Graham, Yvette, Improving Evaluation of Machine Translation Quality Estimation, Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, Association for Computational Linguistics, 2015, pp1804-1813 Conference Paper, 2015 DOI

Graham, Yvette, Mathur, Nitika, Baldwin, Timothy, Randomized Significance Tests in Machine Translation, Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, Maryland, USA, Association for Computational Linguistics, 2014, pp266-274 Conference Paper, 2014 DOI

Graham, Yvette, Baldwin, Timothy, Moffat, Alistair, Zobel, Justin, Is Machine Translation Getting Better over Time, Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, 14th Conference of the European Chapter of the Association for Computational Linguistics, Association for Computational Linguistics, 2014, pp443-451 Conference Paper, 2014 DOI

Graham, Yvette, Baldwin, Timothy, Testing for Significance of Increased Correlation with Human Judgment, Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, Association for Computational Linguistics, 2014, pp172-176 Conference Paper, 2014 DOI

Yvette Graham, Timothy Baldwin, Alistair Moffat, Justin Zobel, Continuous Measurement Scales in Human Evaluation of Machine Translation, Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, 7th Linguistic Annotation Workshop and Interoperability with Discourse, Sofia, Bulgaria, 1/7/13, Association for Computational Linguistics, 2013, pp33 - 41 Conference Paper, 2013 TARA - Full Text

Non-Peer-Reviewed Publications

Anya Belz, Bernd Bohnet, Thiago Castro Ferreira, Yvette Graham, Simon Mille, Leo Wanner, The Third Multilingual Surface Realisation Shared Task (SR'20): Overview and Evaluation Results, Proceedings of the Third Multilingual Surface Realisation Workshop, Third Multilingual Surface Realisation Workshop, Virtual, 2020, pp1 - 20 Conference Paper, 2020 URL TARA - Full Text

Davis, Brian and Graham, Yvette and Kelleher, John and Sripada, Yaji(ed.), 13th International Conference on Natural Language Generation, Proceedings of the 13th International Conference on Natural Language Generation, Dublin, Ireland, Association for Computational Linguistics, 2020, 1-20 p Proceedings of a Conference, 2020

Belz, Anya and Bohnet, Bernd and Ferreira, Thiago Castro and Graham, Yvette and Mille, Simon and Wanner, Leo(ed.), Third Workshop on Multilingual Surface Realisation, Proceedings of the Third Workshop on Multilingual Surface Realisation, Virtual, 12/12/20, Association for Computational Linguistics, 2020, 1-63 p Proceedings of a Conference, 2020

Barrault, Loic and Bojar, Ondrej and Bougares, Fethi and Chatterjee, Rajen and Costa-jussa, Marta R. and Federmann, Christian and Fishel, Mark and Fraser, Alexander and Graham, Yvette and Guzman, Paco and Haddow, Barry and Huck, Matthias and Yepes, Antonio Jimeno and Koehn, Philipp and Martins, Andre and Morishita, Makoto and Monz, Christof and Nagata, Masaaki and Nakazawa, Toshiaki and Negri, Matteo(ed.), Fifth Conference on Machine Translation, Proceedings of the Fifth Conference on Machine Translation, Online, 16/11/20, Association for Computational Linguistics, 2020 Proceedings of a Conference, 2020

G. Awad, A. Butt, K. Curtis, J. Fiscus, A. Godil, Y. Lee, A. Delgado, J. Zhang, E. Godard, B. Chocot, L. Diduch, J. Liu, A. F. Smeaton, Yvette Graham, G. J. F. Jones, W. Kraaij, G. Quénot, TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domains, 2020 TREC Video Retrieval Evaluation, Virtual, 2020, pp1 - 27 Conference Paper, 2020

Loïc Barrault, and Biesialska, Magdalena and Bojar, Ondřej and Costa-jussà, Marta R. and Federmann, Christian and Graham, Yvette and Grundkiewicz, Roman and Haddow, Barry and Huck, Matthias and Joanis, Eric and Kocmi, Tom and Koehn, Philipp and Lo, Chi-kiu and Ljube ić, Nikola and Monz, Christof and Morishita, M. akoto and Nagata, Masaaki and Nakazawa, Toshiaki and Pal, Santanu and Post, Matt and Zampieri, Marcos, Findings of the 2020 Conference on Machine Translation (WMT20), Proceedings of the EMNLP 2020 Fifth Conference on Machine Translation, EMNLP 2020 Fifth Conference on Machine Translation, Virtual, 2020, pp1 - 54 Conference Paper, 2020

Simon Mille, Anja Belz, Bernd Bohnet, Yvette Graham, Leo Wanner(ed.), 2nd Workshop on Multilingual Surface Realisation (MSR 2019), Proceedings of the 2nd Workshop on Multilingual Surface Realisation (MSR 2019), Hong Kong, China, 3/11/19, Association for Computational Linguistics, 2019, 1-105 p Proceedings of a Conference, 2019

Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Müller, Santanu Pal, Matt Post and Marcos Zampieri, Findings of the 2019 Conference on Machine Translation (WMT19), Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), Florence, Italy, Association for Computational Linguistics, 2019 Conference Paper, 2019

George Awad, Asad A. Butt, Keith Curtis, Yooyoung Lee, Jonathan Fiscus, Afzal Godil, David Joy, Andrew Delgado, Alan F. Smeaton, Yvette Graham, Wessel Kraaij, Georges Quénot, Joao Magalhaes, David Semedo, and Saverio Blasi, TRECVID 2018: Benchmarking Video Activity Detection, Video Captioning and Matching, Video Storytelling Linking and Video Search, Proceedings of TRECVID 2018, TRECVID 2018, Gaithersburg, MD, 2018, pp1 - 38 Conference Paper, 2018 TARA - Full Text

Bojar, Ondrej and Graham, Yvette and Kamran, Amir, Results of the WMT17 Metrics Shared Task, Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, Second Conference on Machine Translation, Copenhagen, Denmark, 1/9/17, Association for Computational Linguistics, 2017, pp489-513 Conference Paper, 2017 TARA - Full Text

Bojar, Ondrej and Chatterjee, Rajen and Federmann, Christian and Graham, Yvette and Haddow, Barry and Huang, Shujian and Huck, Matthias and Koehn, Philipp and Liu, Qun and Logacheva, Varvara and Monz, Christof and Negri, Matteo and Post, Matt and Rubino, Raphael and Specia, Lucia and Turchi, Marco, Findings of the 2017 Conference on Machine Translation (WMT17), 2017 Conference on Machine Translation (WMT17), Copenhagen, Denmark, 1/9/17, 2017, pp169-214 Conference Paper, 2017 TARA - Full Text

Research Expertise

Description

Natural Language Processing; Machine Translation; Sentiment Analysis; Summarization; Question Answering; Question Generation; Natural Language Generation; Evaluation of NLP systems.

Keywords

ARTIFICIAL INTELLIGENCE; Computational Linguistics

Recognition

Representations

OECD Advisor, Assessment of Impact of Robotics and AI on Future Work Force 28/08/20

Association for Computational Linguistics Professional Conduct Committee 1/7/2018

External Examiner Higher Diploma in Computing, National College of Ireland 12/11/20

Awards and Honours

Funded Investigator, ADAPT II 1/1/21

Best Paper Award Annual Conference of the Association for Computational Linguistics 28/7/15

D-REAL (FI) 18/6/20

Learn2Learn Enterprise Ireland (PI) 9/9/20

Memberships

Association for Computational Linguistics 1/7/05 – present

ADAPT Research Centre 10/1/10 – present