Loïc Barrault, and Biesialska, Magdalena and Bojar, Ondřej and Costa-jussà, Marta R. and Federmann, Christian and Graham, Yvette and Grundkiewicz, Roman and Haddow, Barry and Huck, Matthias and Joanis, Eric and Kocmi, Tom and Koehn, Philipp and Lo, Chi-kiu and Ljubešić, Nikola and Monz, Christof and Morishita, M. akoto and Nagata, Masaaki and Nakazawa, Toshiaki and Pal, Santanu and Post, Matt and Zampieri, Marcos 2020. Findings of the 2020 Conference on Machine Translation (WMT20). In Proceedings of the EMNLP 2020 Fifth Conference on Machine Translation, Virtual. (pdf) bibtex

Anya Belz, Bernd Bohnet, Thiago Castro Ferreira, Yvette Graham, Simon Mille, Leo Wanner. 2020. The Third Multilingual Surface Realisation Shared Task (SR’20): Overview and Evaluation Results, In Proceedings of the Third Multilingual Surface Realisation Workshop. Virtual. (pdf) bibtex

George Awad, et al. 2020. Findings of TRECVID 2020, In Proceedings of TRECvid 2020, Gaithersburg, MD.

Chenyang Lyu, Jennifer Foster, Yvette Graham. 2020. Document-level Sentiment Analysis with User and Product Context In Proceedings of the 28th International Conference on Computational Linguistics (COLING). Virtual. (pdf) bibtex

Yvette Graham, Barry Haddow, Philipp Koehn. 2020. Statistical Power and Translationese in Machine Translation Evaluation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Virtual. (pdf) bibtex

Yvette Graham, Christian Federmann, Maria Eskevich, Barry Haddow. 2020. Assessing Human-Parity in Machine Translation on the Segment Level. In Findings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP - Findings). Virtual. (pdf) bibtex

Chenyang Lyu, Tianbo Ji, Yvette Graham. 2020. Incorporating Context and Knowledge for Better Sentiment Analysis of Narrative Text In Proceedings of the Third International Workshop on Narrative Extraction from Texts held in conjunction with the 42nd European Conference on Information Retrieval. Lisbon, Portugal. (pdf) bibtex

Tianbo Ji, Yvette Graham and Gareth Jones. 2020. Contrasting Human Opinion of Non-factoid Question Answering with Automatic Evaluation. In Proceedings of the fifth ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR), Vancouver, Canada. (pdf) bibtex

Simon Mille, Anja Belz, Bernd Bohnet, Yvette Graham, Leo Wanner. 2019. The Second Multilingual Surface Realisation Shared Task (SR’19): Overview and Evaluation Results In Proceedings of the Second Multilingual Surface Realisation Workshop. Hong Kong, China. (pdf) bibtex

George Awad, Asad Butt, Keith Curtis, Yooyoung Lee, Jonathan Fiscus, Afzal Godil, Andrew Delgado, J. Zhang, E. Godard, L. Diduch, Alan F. Smeaton, Yvette Graham, and Wessel Kraaij. 2019. TRECVID 2019: An evaluation campaign to benchmark Video Activity Detection, Video Captioning and Matching, and Video Search & retrieval. In Proceedings of TRECvid 2019, Gaithersburg, MD. (pdf) bibtex

Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Müller, Santanu Pal, Matt Post and Marcos Zampieri. 2019. Findings of the 2019 Conference on Machine Translation (WMT19). In Proceedings of the ACL 2019 Fourth Conference on Machine Translation, Florence, Italy. (pdf) bibtex

Qingsong Ma, Johnny Wei, Ondřej Bojar and Yvette Graham. 2019. Results of the WMT19 Metrics Shared Task: Segment-Level and Strong MT Systems Pose Big Challenges In Proceedings of the ACL 2019 Fourth Conference on Machine Translation, Florence, Italy. (pdf) bibtex

Alan Smeaton, Yvette Graham, Kevin McGuinness, Noel O'Connor, Seán Quinn, Eric Arazo Sanchez. 2019. The Impact of Training Data Bias on Automatic Generation of Video Captions. In the 25th International Conference on MultiMedia Modeling, Thessaloniki, Greece.

George Awad, Asad A. Butt, Keith Curtis, Yooyoung Lee, Jonathan Fiscus, Afzal Godil, David Joy, Andrew Delgado, Alan F. Smeaton, Yvette Graham, Wessel Kraaij, Georges Quénot, Joao Magalhaes, David Semedo, and Saverio Blasi. 2018. TRECVID 2018: Benchmarking Video Activity Detection, Video Captioning and Matching, Video Storytelling Linking and Video Search. In Proceedings of TRECvid 2018, Gaithersburg, MD. (pdf) bibtex

Yvette Graham, George Awad, Alan Smeaton. 2018. Evaluation of automatic video captioning using direct assessment. In PLOS ONE, Volume 13, Issue 9. (pdf) bibtex

Koel Dutta Chowdhury, Yvette Graham. Evaluating the Contribution of Images to Multimodal Machine Translation In WiMl, NIPS 2018, Montreal, Canada.

Ondřej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn and Christof Monz. 2018. Findings of the 2018 Conference on Machine Translation (WMT18). In Proceedings of the Third Conference on Machine Translation, Brussels, Belgium. (pdf) bibtex

Qingsong Ma, Ondřej Bojar, Yvette Graham. 2018. Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance. In Proceedings of the Third Conference on Machine Translation, Brussels, Belgium. (pdf) bibtex

Simon Mille, Anja Belz, Bernd Bohnet, Yvette Graham, Emily Pitler and Leo Wanner. 2018. The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results In Proceedings of the First Multilingual Surface Realisation Workshop, Melbourne, Australia. (pdf) bibtex

Longyue Wang, Zhaopeng Tu, Shuming Shi, Tong Zhang, Yvette Graham, Qun Liu. 2018. Translating Pro-Drop Languages with Reconstruction Models. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI 2018), New Orleans, LA. (pdf)

George Awad, Asad A. Butt, Jonathan Fiscus, David Joy, Andrew Delgado, Martial Michel, Alan F. Smeaton, Yvette Graham, Wessel Kraaij, Georges Quenot, Maria Eskevich, Roeland Ordelman, Gareth J. F. Jones and Benoit Huet. 2017. Trecvid 2017: Evaluating Ad-hoc and Instance Video Search, Event Detection, Video Captioning and Hyperlinking. In Proceedings of TRECVID 2017, Gaithersburg, MD. bibtex

Yvette Graham, George Awad, Alan Smeaton. 2017. Evaluation of Automatic Video Captioning Using Direct Assessment. (pdf) bibtex

Qingsong Ma, Yvette Graham, Timothy Baldwin, Qun Liu. 2017. Further Investigation into Reference Bias in Machine Translation Evaluation. In Proceedings of EMNLP 2017: Conference on Empirical Methods in Natural Language Processing (EMNLP), Copenhagen, Denmark. (pdf) bibtex

Ondrej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Shujian Huang, Matthias Huck, Philipp Koehn, Qun Liu, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Raphael Rubino, Lucia Specia and Marco Turchi. 2017. Findings of the 2017 Conference on Machine Translation. In Proceedings of the Second Conference on Machine Translation (WMT17), Copenhagen, Denmark. (pdf) bibtex

Ondrej Bojar, Yvette Graham and Amir Kamran. 2017. Results of the WMT17 Metrics Shared Task. In Proceedings of the Second Conference on Machine Translation (WMT17), Copenhagen, Denmark. (pdf) bibtex

Qingsong Ma, Yvette Graham, Shugen Wang and Qun Liu. 2017. Blend: a Novel Combined MT Metric Based on Direct Assessment - CASICT-DCU submission to WMT17 Metrics Task. In Proceedings of the Second Conference on Machine Translation (WMT17), Copenhagen, Denmark. (pdf) bibtex

Yvette Graham, Qingsong Ma, Timothy Baldwin, Qun Liu, Carla Parra, Carolina Scarton. 2017. Improving Evaluation of Document-level MT Quality Estimation. In Proceedings of the 15th European Chapter of the Association for Computational Linguistics (EACL), Valencia, Spain. (pdf) bibtex

Yvette Graham, Timothy Baldwin, Meghan Dowling, Maria Eskevich, Lamia Tounsi, Teresa Lynn. 2016. Is all that glitters in MT quality estimation really gold standard? In Proceedings of the 26th International Conference on Computational Linguistics (COLING), Osaka, Japan. (pdf) bibtex

Qingsong Ma, Fandong Meng, Daqi Zheng, Mingxuan Wang, Yvette Graham Wenbin Jiang, and Qun Liu. 2016. MaxSD: A Neural Machine Translation Evaluation Metric Optimized by Maximizing Similarity Distance In Proceedings of 5th Conference on Natural Language Processing and Chinese Computing and the 24th International Conference on Computer Processing of Oriental Languages (NLPCC-ICCPOL 2016), Kunming, China. (pdf) bibtex

Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor and Marcos Zampieri. 2016. Findings of the 2016 Conference on Machine Translation. In Proceedings of the first Conference on Machine Translation (WMT), Berlin, Germany. (pdf) bibtex

Ondřej Bojar, Yvette Graham, Amir Kamran and Miloš Stanojević . 2016. Results of WMT16 Metrics Shared Task. In Proceedings of the first Conference on Machine Translation (WMT), Berlin, Germany. (pdf) bibtex

Yvette Graham, Timothy Baldwin, Alistair Moffat and Justin Zobel. 2016. Can Machine Translation Systems be Evaluated by the Crowd Alone? In Journal of Natural Language Engineering (JNLE), Firstview. (pdf) bibtex

Yvette Graham and Qun Liu. 2016. Achieving Accurate Conclusions in Evaluation of Automatic Machine Translation Metrics. In Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL), San Diego, CA. (pdf) bibtex

Meghan Dowling, Teresa Lynn, Yvette Graham and John Judge. 2016 English to Irish Machine Translation with Automatic Post-Editing. In Proceedings of the Second Celtic Language Technology Workshop (CLTW), Paris, France. (pdf) bibtex

Yvette Graham. 2016 Measuring Performance in Machine Translation Quality Estimation. In Proceedings of the 2016 Irish Conference on Artificial Intelligence and Cognitive Science (AICS NECTAR Track), Dublin, Ireland.

Yvette Graham. 2015 Re-evaluating Automatic Summarization with BLEU and 192 Shades of ROUGE. In Proceedings of EMNLP 2015: Conference on Empirical Methods in Natural Language Processing (EMNLP), Lisbon, Portugal. (pdf) bibtex

Yvette Graham. 2015 Improving Evaluation of Machine Translation Quality Estimation. In Proceedings of The 53rd Annual Meeting of the Association of Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJNLP), Beijing, China. (pdf) bibtex   [ACL 2015 Best Paper Award Winner]

Yvette Graham, Nitika Mathur and Timothy Baldwin. 2015 Accurate Evaluation of Segment-level Machine Translation Metrics In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics Human Language Technologies (NAACL-HLT) , Denver, Colorado. (pdf) bibtex

Yvette Graham and Timothy Baldwin. 2014 Testing for Significance of Increased Correlation with Human Judgment. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-14) , Doha, Qatar. (pdf) bibtex

Yvette Graham, Nitika Mathur and Timothy Baldwin. 2014 Randomized Significance Tests in Machine Translation. In Proceedings of the Ninth ACL Workshop on Statistical Machine Translation (WMT-14) , Baltimore, MD. (pdf) bibtex

Yvette Graham, Timothy Baldwin, Alistair Moffat and Justin Zobel. 2014 Is Machine Translation Getting Better over Time? In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2014) , Gothenburg, Sweden, pp 443—451. (pdf) bibtex

Yvette Graham, Timothy Baldwin, Alistair Moffat and Justin Zobel. 2013 Crowd-Sourcing of Human Judgments of Machine Translation Fluency. In Proceedings of the 2013 Australasian Language Technology Workshop (ALTW 2013) , Brisbane, Australia, pp 16—24. (pdf)

Yvette Graham. 2013. A Dependency-Constrained Hierarchical Model with Moses. In Proceedings of the Eighth ACL Workshop on Statistical Machine Translation (WMT-13) , Sofia, Bulgaria, pp 464—471. (pdf)

Yvette Graham, Timothy Baldwin, Alistair Moffat and Justin Zobel. 2013. Continuous Measurement Scales in Human Evaluation of Machine Translation. In Proceedings of the 7th Linguistic Annotation Workshop & Interoperability with Discourse (LAW VII and ID) , Sofia, Bulgaria, pp. 33—41. (pdf) bibtex

Yvette Graham, Bahar Salehi, Timothy Baldwin. 2013. Umelb: Cross-lingual Textual Entailment with Word Alignment and String Similarity Features. In Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval 2013) , Atlanta, USA, pp. 133—137. (pdf)

Yvette Graham, Tim Baldwin, Aaron Harwood, Alistair Moffat and Justin Zobel. 2012. Measurement of Progress in Machine Translation. In Proceedings of the Australasian Language Technology Workshop 2012 (ALTW 2012) , Dunedin, New Zealand. (pdf)

Yvette Graham and Josef van Genabith. 2012. Exploring the Parameter Space in Statistical Machine Translation via F-structure Transfer. In Proceedings of the 17th International Lexical Functional Grammar Conference (LFG-12) , Bali, Indonesia. (pdf)

Yvette Graham. 2012. Deep Syntax in Statistical Machine Translation. In Proceedings of the 17th International Lexical Functional Grammar Conference (LFG-12) , Bali, Indonesia. (pdf)

Yvette Graham. 2010. Deep Syntax in Statistical Machine Translation. PhD Thesis. Dublin City University. (pdf)

Yvette Graham and Josef van Genabith. 2010. Factor Templates for Factored Machine Translation Models. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT-10) , Paris, France. (pdf)

Yvette Graham and Josef van Genabith. 2010. Deep Syntax Language Models and Statistical Machine Translation. In Proceedings of the Fourth International Workshop on Syntax and Structure in Statistical Translation at The 23rd International Conference on Computational Linguistics, Beijing, China. (pdf)

Tsuyoshi Okita, Alfred Maldonado Guerra, Yvette Graham and Andy Way. 2010. Multi-Word Expression Sensitive Word Alignment. In Proceedings of the Fourth International Workshop On Cross Lingual Information Access, at the 23rd International Conference on Computational Linguistics, Beijing, China. (pdf)

Tsuyoshi Okita, Yvette Graham and Andy Way. 2010. Gap between Theory and Practice: Sensitive Word Alignment in Machine Translation. In Proceedings of the 2010 Workshop on Applications of Pattern Analysis, Cumberlodge, England. (pdf)

Yvette Graham. Sulis: An Open Source Transfer Decoder for Deep Syntactic Statistical Machine Translation . 2010. In The Prague Bulletin of Mathematical Linguistics, Special Issue: Open Source Tools for Machine Translation. (pdf)

Anton Bryl, Josef van Genabith and Yvette Graham. 2009. Guessing the Grammatical Function of a Non-Root F-structure in LFG . In Proceedings of the 11th International Conference on Parsing Technology (IWPT 2009). (pdf)

Yvette Graham, Anton Bryl and Josef van Genabith. 2009. F-structure Transfer-Based Statistical Machine Translation . In Proceedings of the 14th International Lexical Functional Grammar Conference. (pdf)

Yvette Graham and Josef van Genabith. 2009. An Open Source Rule Indution Tool for Transfer-Based SMT. In The Prague Bulletin of Mathematical Linguistics, Special Issue: Open Source Tools for Machine Translation, 91, pages 37-46. (pdf)

Yvette Graham and Josef van Genabith. 2008. Packed Rules for Automatic Transfer-Rule Induction. In Proceedings of the European Association of Machine Translation Conference 2008, pages 57-65, Hamburg, Germany. (pdf)

Yvette Graham, Deirdre Hogan and Josef van Genabith. 2007. Automatic Evaluation of Generation and Parsing for Machine Translation with Automatically Acquired Transfer Rules. In Proceedings of the 2007 Workshop on Using Corpora for NLG: Language Generation and Machine Translation at MT Summit XI, pages 5-12, Copenhagen, Denmark. (pdf)

Karolina Owczarzak, Yvette Graham and Josef van Genabith. 2007. Using F-structures in Machine Translation Evaluation. In Proceedings of the 12th International Lexical Functional Grammar Conference, Stanford University, California. (pdf)

Nicolas Stroppa, Stephen Armstrong, Marian Flanagan, Yvette Graham, Declan Groves, Bart Mellebeek, Sara Morrissey and Andy Way. 2006. MaTrEx: Machine Translation Using Examples. In TC-STAR OpenLab on Speech Translation, Trento, Italy.

Yvette Graham. 2005. Services for Experimentation in Human Sciences: An Online Experimentation Tool. M.Sc. thesis in Computational Linguistics. (pdf)

Yvette Graham and Carl Vogel. 2003*not peer-reviewed. Computer Construction of Crossword Puzzles using Horn Clauses and Constraint Programming (ps)