Exphormer: Scaling transformers for graph-structured data
Google Research has released Exphormer, a sparse attention framework that eliminates the quadratic computational bottleneck limiting graph transformers to small datasets. This breakthrough enables transformers to scale to graphs with 170K+ nodes, opening new applications in molecular modeling, social networks, and citation analysis.
Jan 22 – 28, 2024
Read full story