Biography
Yvette Graham is Assistant Professor in Artificial Intelligence in the School of Computer Science and Statistics. She has been part of the Natural Language Processing community for over 15 years and involved in a wide range of projects focusing on Machine Translation, Sentiment Analysis, Dialogue Systems, Evaluation of NLP systems and Information Retrieval. Her work achieved the best paper award at the Annual Conference of the Association for Computational Linguistics ACL in 2015.
Publications and Further Research Outputs
Peer-Reviewed Publications
Chenyang Lyu and Jennifer Foster and Yvette Graham, Extending the Scope of Out-of-Domain: Examining QA models in multiple subdomains, Proceedings of the Third Workshop on Insights from Negative Results in NLP, Third Workshop on Insights from Negative Results in NLP, Dublin, Ireland, 23/5/22, Association for Computational Linguistics, 2022, pp24-37
Lebron, Luis, Graham, Yvette, O'Connor, Noel, McGuinness, Kevin, Evaluation of Automatically Generated Video Captioning Vision and Language Models, Proceedings of the International Conference on Image Processing, International Conference on Image Processing, 2022
Naushad Alam, Yvette Graham, and Cathal Gurrin, Memento 2.0: An Improved Lifelog Search Engine for LSC'22, Proceedings of International Conference on Multimedia Retrieval 2022, International Conference on Multimedia Retrieval 2022, 27/6/22, Association for Computing Machinery, 2022
Naushad Alam, Ahmed Alateeq, Yvette Graham, Mark Roantree and Cathal Gurrin, DCU at the NTCIR-16 Lifelog-4 Task, Proceedings of NTCIR-16, NTCIR-16, Tokyo, Japan, 14/6/22, National Institute of Informatics, 2022
Ly-Duyen Tran, Naushad Alam, Yvette Graham, Liting Zhou and Cathal Gurrin, An explo- ration into the benefits of the CLIP model for lifelog retrieval, Proceedings of the 19th International Conference on Content-based Multimedia Indexing, 19th International Conference on Content-based Multimedia Indexing, 2022
Luis Lebron, Yvette Graham, Kevin McGuinness, Konstantinos Kouramas, Noel E. O'Connor, BERTHA: Video Captioning Evaluation Via Transfer-Learned Human Assessment, Proceedings of the 2022 Conference on Language Resources and Evaluation for Human Language Technologies (LREC 2022), 2022 Conference on Language Resources and Evaluation for Human Language Technologies (LREC 2022), Mareseille, France, 20/6/22, European Language Resources Association, 2022
Tianbo Ji, Yvette Graham, Chenyang Lyu, Gareth Jones, Qun Liu, Achieving Accurate Evaluation of Open-domain Dialogue Systems, Proceedings of the 60th Annual Conference of the Association for Computational Linguistics, 60th Annual Conference of the Association for Computational Lingustics , Dublin, Ireland, 22/5/22, Association for Computational Linguistics, 2022
Lyu, Chenyang and Shang, Lifeng and Graham, Yvette and Foster, Jennifer and Jiang, Xin and Liu, Qun, Improving Unsupervised Question Answering via Summarization-Informed Question Generation, 2021 Conference on Empirical Methods in Natural Language Processing, Online and Punta Cana, Dominican Republic, Association for Computational Linguistics, 2021, pp4134 - 4148
Alam, Naushad and Graham, Yvette and Gurrin, Cathal, Memento: A Prototype Lifelog Search Engine for LSC'21, Proceedings of the 4th Annual on Lifelog Search Challenge, 4th Annual on Lifelog Search Challenge, Taipei, Taiwan, 19/11/21, Association for Computing Machinery, 2021, pp53 - 58
Yvette Graham, Christian Federmann, Maria Eskevich, Barry Haddow, Assessing Human-Parity in Machine Translation on the Segment Level, Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP - Findings), Virtual, 16/11/20, Association for Computational Linguistics, 2020, pp4199 - 4207
Yvette Graham; BarryHaddow; Philipp Koehn, Statistical Power and Translationese in Machine Translation Evaluation, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Virtual, 16/11/20, Association for Computational Linguistics, 2020, pp72 - 81
Chenyang Lyu, Jennifer Foster, Yvette Graham, Improving Document-level Sentiment Analysis with User and Product Context, Proceedings of the 28th International Conference on Computational Linguistics (COLING), 28th International Conference on Computational Linguistics (COLING), Virtual, Association for Computational Linguistics, 2020, pp6724 - 6729
Chenyang Lyu, Tianbo Ji, Yvette Graham, Incorporating Context and Knowledge for Better Sentiment Analysis of Narrative Text , Third International Workshop on Narrative Extraction from Texts held in conjunction with the 42nd European Conference on Information Retrieval, 2020, pp39 - 45
Tianbo Ji, Yvette Graham, Gareth F. Jones, Contrasting human opinion of non-factoid question answering with automatic evaluation, Proceedings of the 2020 Conference on Human Information Interaction and Retrieval, 2020 Conference on Human Information Interaction and Retrieval, New York, NY, USA, Association for Computing Machinery, 2020, pp348 - 352
Alan Smeaton, Yvette Graham, Kevin McGuinness, Noel O'Connor, Seán Quinn, Eric Arazo Sanchez, The Impact of Training Data Bias on Automatic Generation of Video Captions, Proceedings of the 25th International Conference on MultiMedia Modeling, 25th International Conference on MultiMedia Modeling, Thessaloniki, Greece, 2019, pp178 - 190
Graham, Yvette and Awad, George and Smeaton, Alan, Evaluation of automatic video captioning using direct assessment, PLOS ONE, 13, (9), 2018, p1-20
Longyue Wang, Zhaopeng Tu, Shuming Shi, Tong Zhang, Yvette Graham, Qun Liu, Translating Pro-Drop Languages with Reconstruction Models, Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI 2018), 32nd AAAI Conference on Artificial Intelligence (AAAI 2018), New Orleans, LA, 2018, pp4937 - 4945
Ma, Qingsong, Graham, Yvette, Baldwin, Timothy, Liu, Qun, Further Investigation into Reference Bias in Monolingual Evaluation of Machine Translation, Proceedings of EMNLP 2017: Conference on Empirical Methods in Natural Language Processing (EMNLP), EMNLP 2017: Conference on Empirical Methods in Natural Language Processing (EMNLP), Copenhagen, Denmark, Association for Computational Linguistics, 2017, pp2476-2485
Ma, Qingsong, Graham, Yvette, Wang, Shugen, Liu, Qun, Blend: a Novel Combined MT Metric Based on Direct Assessment: CASICT-DCU submission to WMT17 Metrics Task, Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, Second Conference on Machine Translation, Copenhagen, Denmark, Association for Computational Linguistics, 2017, pp598-603
Yvette Graham, Qingsong Ma, Timothy Baldwin, Qun Liu, Carla Parra, Carolina Scarton, Improving Evaluation of Document-level MT Quality Estimation, Proceedings of the 15th European Chapter of the Association for Computational Linguistics (EACL), 15th European Chapter of the Association for Computational Linguistics (EACL), Valencia, Spain, 2017, pp356 - 361
Graham, Yvette, Liu, Qun, Achieving Accurate Conclusions in Evaluation of Automatic Machine Translation Metrics, Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, Association for Computational Linguistics, 2016, pp1 - 10
Graham, Yvette and Baldwin, Timothy and Moffat, Alistair and Zobel, Justin, Can machine translation systems be evaluated by the crowd alone, Natural Language Engineering, FirstView, 2016, p1--28
Yvette Graham, Timothy Baldwin, Meghan Dowling, Maria Eskevich, Lamia Tounsi, Teresa Lynn, Is all that glitters in MT quality estimation really gold standard?, Proceedings of the 26th International Conference on Computational Linguistics (COLING), 26th International Conference on Computational Linguistics (COLING), Osaka, Japan, 11/12/16, 2016, pp3124-3134
Qingsong Ma and Fandong Meng and Daqi Zheng and Mingxuan Wang and Yvette Graham and Wenbin Jiang and Qun Liu, MaxSD: A Neural Machine Translation Evaluation Metric Optimized by Maximizing Similarity Distance, 10102, 2016, p153-161
Graham, Yvette, Re-evaluating Automatic Summarization with BLEU and 192 Shades of ROUGE, Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal, Association for Computational Linguistics, 2015, pp128 - 137
Graham, Yvette, Improving Evaluation of Machine Translation Quality Estimation, Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, Association for Computational Linguistics, 2015, pp1804-1813
Graham, Yvette, Baldwin, Timothy, Mathur, Nitika, Accurate Evaluation of Segment-level Machine Translation Metrics, Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics Human Language Technologies, 2015 Conference of the North American Chapter of the Association for Computational Linguistics Human Language Technologies, Denver, Colorado, Association for Computational Linguistics, 2015, pp1183-1191
Graham, Yvette, Mathur, Nitika, Baldwin, Timothy, Randomized Significance Tests in Machine Translation, Proceedings of the Ninth Workshop on Statistical Machine Translation, Baltimore, Maryland, USA, Association for Computational Linguistics, 2014, pp266-274
Graham, Yvette, Baldwin, Timothy, Moffat, Alistair, Zobel, Justin, Is Machine Translation Getting Better over Time, Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, 14th Conference of the European Chapter of the Association for Computational Linguistics, Association for Computational Linguistics, 2014, pp443-451
Graham, Yvette, Baldwin, Timothy, Testing for Significance of Increased Correlation with Human Judgment, Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, Association for Computational Linguistics, 2014, pp172-176
Yvette Graham, Timothy Baldwin, Alistair Moffat, Justin Zobel, Continuous Measurement Scales in Human Evaluation of Machine Translation, Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, 7th Linguistic Annotation Workshop and Interoperability with Discourse, Sofia, Bulgaria, 1/7/13, Association for Computational Linguistics, 2013, pp33 - 41
Non-Peer-Reviewed Publications
Barrault, Loic and Bojar, Ondrej and Bougares, Fethi and Chatterjee, Rajen and Costa-jussa, Marta R. and Federmann, Christian and Fishel, Mark and Fraser, Alexander and Freitag, Markus and Graham, Yvette and Grundkiewicz, Roman and Guzman, Paco and Haddow, Barry and Huck, Matthias and Yepes, Antonio Jimeno and Koehn, Philipp and Kocmi, Tom and Martins, Andre and Morishita, Makoto and Monz, Christo(ed.), Sixth Conference on Machine Translation, Proceedings of the Sixth Conference on Machine Translation, Online and Punta Cana, Dominican Republic, 10/11/21, Association for Computational Linguistics, 2021
Anya Belz, Shubham Agarwal, Yvette Graham, Ehud Reiter, Anastasia Shimorina(ed.), Human Evaluation of NLP Systems Workshop, Proceedings of the Human Evaluation of NLP Systems Workshop, Online, 19/4/21, Association for Computational Linguistics, 2021
Assessing Natural Language Processing in, AI and the Future of Skills, OECD, 2021, [Yvette Graham]
Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondřej Bojar, Rajen Chatterjee, Vishrav Chaudhary, Marta R. Costa-jussa, Cristina España-Bonet, Angela Fan, Christian Federmann, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Leonie Harter, Kenneth Heafield, Christopher Homan, Matthias Huck, Kwabena Amponsah-Kaakyire, Jungo Kasai, Daniel Khashabi, Kevin Knight, Tom Kocmi, Philipp Koehn, Nicholas Lourie, Christof Monz, Makoto Morishita, Masaaki Nagata, Ajay Nagesh, Toshiaki Nakazawa, Matteo Negri, Santanu Pal, Allahsera Auguste Tapo, Marco Turchi, Valentin Vydrin and Marcos Zampieri, Findings of the 2021 Conference on Machine Translation (WMT21), Proceedings of the 2021 Conference on Machine Translation (WMT21), 2021 Conference on Machine Translation (WMT21), Punta Cana, Dominican Republic, 10/11/21, Association for Computational Linguistics, 2021, pp1 - 93
George Awad and Asad A. Butt and Keith Curtis and Jonathan Fiscus and Afzal Godil and Yooyoung Lee and Andrew Delgado and Jesse Zhang and Eliot Godard and Baptiste Chocot and Lukas Diduch and Jeffrey Liu and Yvette Graham and Gareth J. F. Jones and and Georges Quénot, Evaluating Multiple Video Understanding and Retrieval Tasks at TRECVID 2021, Proceedings of TRECVID 2021, TRECVID 2021, NIST, USA, 2021
Davis, Brian and Graham, Yvette and Kelleher, John and Sripada, Yaji(ed.), 13th International Conference on Natural Language Generation, Proceedings of the 13th International Conference on Natural Language Generation, Dublin, Ireland, Association for Computational Linguistics, 2020, 1-20 p
Belz, Anya and Bohnet, Bernd and Ferreira, Thiago Castro and Graham, Yvette and Mille, Simon and Wanner, Leo(ed.), Third Workshop on Multilingual Surface Realisation, Proceedings of the Third Workshop on Multilingual Surface Realisation, Virtual, 12/12/20, Association for Computational Linguistics, 2020, 1-63 p
Anya Belz, Bernd Bohnet, Thiago Castro Ferreira, Yvette Graham, Simon Mille, Leo Wanner, The Third Multilingual Surface Realisation Shared Task (SR'20): Overview and Evaluation Results, Proceedings of the Third Multilingual Surface Realisation Workshop, Third Multilingual Surface Realisation Workshop, Virtual, 2020, pp1 - 20
Barrault, Loic and Bojar, Ondrej and Bougares, Fethi and Chatterjee, Rajen and Costa-jussa, Marta R. and Federmann, Christian and Fishel, Mark and Fraser, Alexander and Graham, Yvette and Guzman, Paco and Haddow, Barry and Huck, Matthias and Yepes, Antonio Jimeno and Koehn, Philipp and Martins, Andre and Morishita, Makoto and Monz, Christof and Nagata, Masaaki and Nakazawa, Toshiaki and Negri, Matteo(ed.), Fifth Conference on Machine Translation, Proceedings of the Fifth Conference on Machine Translation, Online, 16/11/20, Association for Computational Linguistics, 2020
Loïc Barrault, and Biesialska, Magdalena and Bojar, Ondřej and Costa-jussà, Marta R. and Federmann, Christian and Graham, Yvette and Grundkiewicz, Roman and Haddow, Barry and Huck, Matthias and Joanis, Eric and Kocmi, Tom and Koehn, Philipp and Lo, Chi-kiu and Ljube ić, Nikola and Monz, Christof and Morishita, M. akoto and Nagata, Masaaki and Nakazawa, Toshiaki and Pal, Santanu and Post, Matt and Zampieri, Marcos, Findings of the 2020 Conference on Machine Translation (WMT20), Proceedings of the EMNLP 2020 Fifth Conference on Machine Translation, EMNLP 2020 Fifth Conference on Machine Translation, Virtual, 2020, pp1 - 54
G. Awad, A. Butt, K. Curtis, J. Fiscus, A. Godil, Y. Lee, A. Delgado, J. Zhang, E. Godard, B. Chocot, L. Diduch, J. Liu, A. F. Smeaton, Yvette Graham, G. J. F. Jones, W. Kraaij, G. Quénot, TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domains, 2020 TREC Video Retrieval Evaluation, Virtual, 2020, pp1 - 27
Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Müller, Santanu Pal, Matt Post and Marcos Zampieri, Findings of the 2019 Conference on Machine Translation (WMT19), Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), Florence, Italy, Association for Computational Linguistics, 2019
Simon Mille, Anja Belz, Bernd Bohnet, Yvette Graham, Leo Wanner(ed.), 2nd Workshop on Multilingual Surface Realisation (MSR 2019), Proceedings of the 2nd Workshop on Multilingual Surface Realisation (MSR 2019), Hong Kong, China, 3/11/19, Association for Computational Linguistics, 2019, 1-105 p
George Awad, Asad A. Butt, Keith Curtis, Yooyoung Lee, Jonathan Fiscus, Afzal Godil, David Joy, Andrew Delgado, Alan F. Smeaton, Yvette Graham, Wessel Kraaij, Georges Quénot, Joao Magalhaes, David Semedo, and Saverio Blasi, TRECVID 2018: Benchmarking Video Activity Detection, Video Captioning and Matching, Video Storytelling Linking and Video Search, Proceedings of TRECVID 2018, TRECVID 2018, Gaithersburg, MD, 2018, pp1 - 38
Bojar, Ondrej and Graham, Yvette and Kamran, Amir, Results of the WMT17 Metrics Shared Task, Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, Second Conference on Machine Translation, Copenhagen, Denmark, 1/9/17, Association for Computational Linguistics, 2017, pp489-513
Bojar, Ondrej and Chatterjee, Rajen and Federmann, Christian and Graham, Yvette and Haddow, Barry and Huang, Shujian and Huck, Matthias and Koehn, Philipp and Liu, Qun and Logacheva, Varvara and Monz, Christof and Negri, Matteo and Post, Matt and Rubino, Raphael and Specia, Lucia and Turchi, Marco, Findings of the 2017 Conference on Machine Translation (WMT17), 2017 Conference on Machine Translation (WMT17), Copenhagen, Denmark, 1/9/17, 2017, pp169-214
Research Expertise
Recognition
Representations
OECD Advisor, Assessment of Impact of Robotics and AI on Future Work Force
External Examiner Higher Diploma in Computing, National College of Ireland
Awards and Honours
Funded Investigator, ADAPT II
Best Paper Award Annual Conference of the Association for Computational Linguistics
D-REAL (FI)
Learn2Learn Enterprise Ireland (PI)
Lead PI on Huawei/SFI Cofund Project "Dialogue Evaluation"
Memberships
Association for Computational Linguistics
ADAPT Research Centre