Patrick Fernandes

Hey! I’m Patrick.

I'm currently a graduate student at Carnegie Mellon University and Instituto Superior Técnico, supervised by Graham Neubig and André Martins. I'm also a part-time Student Researcher at Google AI.

I'm mostly do research around machine translation, trying to improve translation though context use or better decoding, and interpretability of neural networks. I have also worked on program analysis with graph neural networks.

I did my masters at the University of Cambridge and my undergrad at Instituto Superior Técnico.

News

  • May 2022: I'll be spending the summer in Mountain View as a Student Researcher at Google!
  • Sep 2021: I've moved to Pittsburgh! Feel free to shoot me a message if you are around and want to meet.
  • May 2021: Excited to have two papers accepted at ACL 2021!
  • Sep 2020: I've joined the LTI at CMU and DEEC at IST as a dual degree PhD student!

All Publications

* = equal contribution

A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models
J. Sun, P. Fernandes, X. Wang, G. Neubig
arXiv Preprint

Learning to Scaffold: Optimizing Model Explanations for Teaching
P. Fernandes*, M. Treviso*, Danish Pruthi, A. Martins, G. Neubig
36th Conference on Neural Information Processing Systems

Quality-Aware Decoding for Neural Machine Translation
P. Fernandes*, A. Farinhas*, R. Rei, José. Souza, P. Ogayo, A. Martins, G. Neubig, A. Martins
2022 Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL 2022)

CMU's IWSLT 2022 Dialect Speech Translation System
B. Yan, P. Fernandes, S. Dalmia, J. Shi, Y. Peng, D. Berrebbi, X. Wang, G. Neubig, S. Watanabe
19th International Conference on Spoken Language Translation (IWSLT) @ ACL 2022

Predicting Attention Sparsity in Transformers
M. Treviso, A. Góis, P. Fernandes, E. Fonseca, A. Martins
6th Workshop on Structured Prediction for NLP @ ACL 2022

When Does Translation Require Context? A Data-driven, Multilingual Exploration
K. Yin*, P. Fernandes*, A. Martins, G. Neubig
arXiv Preprint

Measuring and Increasing Context Usage in Context-Aware Machine Translation
P. Fernandes, K. Yin, G. Neubig, A. Martins
59th Annual Meeting of the Association for Computational Linguistics (ACL)

Do Context-Aware Translation Models Pay the Right Attention?
K. Yin, P. Fernandes, D. Pruthi, A. Chaudhary, A. Martins, G. Neubig
59th Annual Meeting of the Association for Computational Linguistics (ACL)

Structured Neural Summarization
P. Fernandes, M. Allamanis, M. Brockschmidt.
7th International Conference on Learning Representations (ICLR)

This site as a Jekyll template and it's licensed MIT.
You're welcome to use it!