Patrick Fernandes

Hey! I’m Patrick.

I'm currently a graduate student at Carnegie Mellon University and Instituto Superior Técnico, supervised by Graham Neubig and André Martins. I've also spent some time doing research at Google Deepmind, Microsoft Research and Unbabel.

I'm mostly do research around machine translation, trying to improve translation though context use or better decoding, and interpretability of neural networks. I've recently also taken an interest in LLMs (like basically everyone else), and their relation to my other research interests. In a past life, I've have also worked on program analysis with graph neural networks.

I did my masters at the University of Cambridge and my undergrad at Instituto Superior Técnico.

News

  • Sep 2023: I've moved back to sunny Lisbon, where I'll spend the next two years finishing my PhD!
  • Jul 2023: Our MuDA paper won Best Resource Paper award at ACL 2023!
  • May 2022: I'll be spending the summer in Mountain View as a Student Researcher at Google!
  • Sep 2021: I've moved to Pittsburgh! Feel free to shoot me a message if you are around and want to meet.

All Publications

* = equal contribution

Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation
P. Fernandes*, A. Madaan, E. Liu, A. Farinhas, P. Martins, A. Bertsch, J. Souza, S. Zhou, T. Wu, G. Neubig, A. Martins
arXiv Preprint

When Does Translation Require Context? A Data-driven, Multilingual Exploration
K. Yin*, P. Fernandes*, E. Liu, A. Martins, G. Neubig
61st Annual Meeting of the Association for Computational Linguistics (ACL 2023) Best Resource Paper

Scaling Laws for Multilingual Neural Machine Translation
P. Fernandes*, B. Ghorbani, X. Garcia, M. Freitag, O. Firat
Fortieth International Conference on Machine Learning (ICML 2023)

ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit
B. Yan, J. Shi, Y. Tang, H. Inaguma, Y. Peng, S. Dalmia, P. Polák, P. Fernandes, D. Berrebbi, T. Hayashi, X. Zhang, Z. Ni, M. Hira, S. Maiti, J. Pino, S. Watanabe
61st Annual Meeting of the Association for Computational Linguistics (ACL 2023)

Multi-Dimensional Evaluation of Text Summarization with In-Context Learning
S. Jain, V. Keshava, S. M. Sathyendra, P. Fernandes, P. Liu, G. Neubig, C. Zhou
Findings of The 61st Annual Meeting of the Association for Computational Linguistics (Findings ACL 2023)

Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation
M. Freitag, B. Ghorbani, P. Fernandes
arXiv Preprint

Findings of the WMT 2022 Shared Task on Chat Translation
A. Farinha, M. A. Farajian, M. Buchicchio, P. Fernandes, J. Souza, H. Moniz, A. Martins
Proceedings of the Seventh Conference on Machine Translation (WMT 2022)

A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models
J. Sun, P. Fernandes, X. Wang, G. Neubig
Findings of 17th Conference of the European Chapter of the Association for Computational Linguistics (Findings EACL 2023)

Learning to Scaffold: Optimizing Model Explanations for Teaching
P. Fernandes*, M. Treviso*, Danish Pruthi, A. Martins, G. Neubig
36th Conference on Neural Information Processing Systems (NeurIPS 2022)

Quality-Aware Decoding for Neural Machine Translation
P. Fernandes*, A. Farinhas*, R. Rei, José. Souza, P. Ogayo, A. Martins, G. Neubig, A. Martins
2022 Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL 2022)

CMU's IWSLT 2022 Dialect Speech Translation System
B. Yan, P. Fernandes, S. Dalmia, J. Shi, Y. Peng, D. Berrebbi, X. Wang, G. Neubig, S. Watanabe
19th International Conference on Spoken Language Translation (IWSLT) @ ACL 2022

Predicting Attention Sparsity in Transformers
M. Treviso, A. Góis, P. Fernandes, E. Fonseca, A. Martins
6th Workshop on Structured Prediction for NLP @ ACL 2022

Measuring and Increasing Context Usage in Context-Aware Machine Translation
P. Fernandes, K. Yin, G. Neubig, A. Martins
59th Annual Meeting of the Association for Computational Linguistics (ACL)

Do Context-Aware Translation Models Pay the Right Attention?
K. Yin, P. Fernandes, D. Pruthi, A. Chaudhary, A. Martins, G. Neubig
59th Annual Meeting of the Association for Computational Linguistics (ACL 2021)

Structured Neural Summarization
P. Fernandes, M. Allamanis, M. Brockschmidt.
7th International Conference on Learning Representations (ICLR 2019)