paper-with-me

홈 › Papers

CrystalDiT: A Diffusion Transformer for Crystal Generation

2025-08-13 · Xiaohan Yi, Guikun Xu, Xi Xiao, Zhong Zhang, Liu Liu, Yatao Bian, Peilin Zhao arxiv

We present CrystalDiT, a diffusion transformer for crystal structure generation that achieves state-of-the-art performance by challenging the trend of architectural complexity. Instead of intricate, multi-stream designs, CrystalDiT employs a unified transformer that imposes a powerful inductive bias: treating lattice and atomic properties as a single, interdependent system. Combined with a periodic table-based atomic representation and a balanced training strategy, our approach achieves 8.78% SUN (Stable, Unique, Novel) rate on MP-20, substantially outperforming recent methods including FlowMM (4.21%) and MatterGen (3.66%). Notably, CrystalDiT generates 63.28% unique and novel structures while maintaining comparable stability rates, demonstrating that architectural simplicity can be more effective than complexity for materials discovery. Our results suggest that in data-limited scientific domains, carefully designed simple architectures outperform sophisticated alternatives that are prone to overfitting.

📄 PDF Abstract BibTeX arXiv:2508.16614

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Crystalite: A Lightweight Transformer for Efficient Crystal Modeling

2026-04-02 · Tin Hadži Veljković, Joshua Rosenthal, Ivor Lončarić, Jan-Willem van de Meent arxiv

Generative models for crystalline materials often rely on equivariant graph neural networks, which capture geometric structure well but are costly to train and slow to sample. We present Crystalite, a lightweight diffusi…

Fourier Transformers for Latent Crystallographic Diffusion and Generative Modeling

2026-02-12 · Jed A. Duersch, Elohan Veillon, Astrid Klipfel, Adlane Sayede 외 arxiv

The discovery of new crystalline materials calls for generative models that handle periodic boundary conditions, crystallographic symmetries, and physical constraints, while scaling to large and structurally diverse unit…

Generative Inverse Design of Crystal Structures via Diffusion Models with Transformers

2024-06-13 · Izumi Takahara, Kiyou Shibata, Teruyasu Mizoguchi

Recent advances in deep learning have enabled the generation of realistic data by training generative models on large datasets of text, images, and audio. While these models have demonstrated exceptional performance in g…

scientific discovery

MiAD: Mirage Atom Diffusion for De Novo Crystal Generation

2025-11-18 · Andrey Okhotin, Maksim Nakhodnov, Nikita Kazeev, Mikhail Lazarev 외 arxiv

In recent years, diffusion-based models have demonstrated exceptional performance in searching for simultaneously stable, unique, and novel (S.U.N.) crystalline materials. However, most of these models don't have the abi…

Kinetic Langevin Diffusion for Crystalline Materials Generation

2025-07-04 · François Cornet, Federico Bergamin, Arghya Bhowmik, Juan Maria Garcia Lastra 외 arxiv

Generative modeling of crystalline materials using diffusion models presents a series of challenges: the data distribution is characterized by inherent symmetries and involves multiple modalities, with some defined on sp…