Exphormer: Scaling transformers for graph-structured data
Google Research has released Exphormer, a sparse attention framework that eliminates the quadratic computational bottleneck limiting graph transformers to small datasets. This breakthrough enables transformers to scale to graphs with 170K+ nodes, opening new applications in molecular modeling, social networks, and citation analysis.
Why it ranks · · Exphormer scales to 170K-node graphs (ogbn-arxiv dataset with 1.1M edges) · Jan 22 – 28, 2024
Read full story