Svelte Hacker News logo
  • top
  • new
  • show
  • ask
  • jobs
  • about

Transformers Are Graph Neural Networks

arxiv.org

20 points by Anon84 15 hours ago

Zacharias030 10 hours ago

This was a hot topic in 2019-2020 and I just thought I‘ve read an article like this back then from NYU and another from the National University of Singapore, because I and many others were at the time independently working on graph problems using Transformers [0,1].

Turns out this article _is_ the one from NYU, just on arxiv now:

https://graphdeeplearning.github.io/post/transformers-are-gn...

[0] e.g. https://arxiv.org/abs/2003.10536, [1] ProteinMPNN, Dauparas et al.