-
CTGNN: Crystal Transformer Graph Neural Network for Crystal Material Property Prediction
Authors:
Zijian Du,
Luozhijie Jin,
Le Shu,
Yan Cen,
Yuanfeng Xu,
Yongfeng Mei,
Hao Zhang
Abstract:
The combination of deep learning algorithm and materials science has made significant progress in predicting novel materials and understanding various behaviours of materials. Here, we introduced a new model called as the Crystal Transformer Graph Neural Network (CTGNN), which combines the advantages of Transformer model and graph neural networks to address the complexity of structure-properties r…
▽ More
The combination of deep learning algorithm and materials science has made significant progress in predicting novel materials and understanding various behaviours of materials. Here, we introduced a new model called as the Crystal Transformer Graph Neural Network (CTGNN), which combines the advantages of Transformer model and graph neural networks to address the complexity of structure-properties relation of material data. Compared to the state-of-the-art models, CTGNN incorporates the graph network structure for capturing local atomic interactions and the dual-Transformer structures to model intra-crystal and inter-atomic relationships comprehensively. The benchmark carried on by the proposed CTGNN indicates that CTGNN significantly outperforms existing models like CGCNN and MEGNET in the prediction of formation energy and bandgap properties. Our work highlights the potential of CTGNN to enhance the performance of properties prediction and accelerates the discovery of new materials, particularly for perovskite materials.
△ Less
Submitted 19 May, 2024;
originally announced May 2024.
-
Residual Entropy of Hexagonal Ice and Cubic Ice: A Transfer Matrix Description
Authors:
De-Zhang Li,
Yu-Jie Cen,
Xin Wang,
Xiao-Bao Yang
Abstract:
Residual entropy of ice systems has long been a significant and intriguing issue in condensed matter physics and statistical mechanics. The exact solutions for the residual entropy of realistic three-dimensional ice systems remain unknown. In this study, we focus on two typical realistic ice systems, namely the hexagonal ice (ice Ih) and cubic ice (ice Ic). We present a transfer matrix description…
▽ More
Residual entropy of ice systems has long been a significant and intriguing issue in condensed matter physics and statistical mechanics. The exact solutions for the residual entropy of realistic three-dimensional ice systems remain unknown. In this study, we focus on two typical realistic ice systems, namely the hexagonal ice (ice Ih) and cubic ice (ice Ic). We present a transfer matrix description of the number of ice-ruled configurations for these two systems. First, a transfer matrix M is constructed for ice Ic, where each element is the number of ice-ruled configurations of a hexagonal monolayer under certain condition. The product of M and its transpose corresponds to a bilayer unit in ice Ih lattice, therefore is exactly a transfer matrix for ice Ih. Making use of this, we simply show that the residual entropy of ice Ih is not less than that of ice Ic in the thermodynamic limit, which was first proved by Onsager in 1960s. Furthermore, we find an alternative transfer matrix M' for ice Ih, which is based on a monolayer periodic unit. Some interesting properties of M, MMT and M' are illustrated, specifically the summation of all elements, the element in the first row and first column, and the trace. Each property is equivalent with the residual entropy of a two-dimensional ice model. Our work rediscovers the relationship between the residual entropies of ice Ih and ice Ic, and provides an effective description for various two-dimensional ice models.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
Discovery of Stable Hybrid Organic-inorganic Double Perovskites for High-performance Solar Cells via Machine-learning Algorithms and Crystal Graph Convolution Neural Network Method
Authors:
Linkang Zhan,
Danfeng Ye,
Xinjian Qiu,
Yan Cen
Abstract:
Hybrid peroskite solar cells are newly emergent high-performance photovoltaic devices, which suffer from disadvantages such as toxic elements, short-term stabilities, and so on. Searching for alternative perovskites with high photovoltaic performances and thermally stabilities is urgent in this field. In this work, stimulated by the recently proposed materials-genome initiative project, firstly we…
▽ More
Hybrid peroskite solar cells are newly emergent high-performance photovoltaic devices, which suffer from disadvantages such as toxic elements, short-term stabilities, and so on. Searching for alternative perovskites with high photovoltaic performances and thermally stabilities is urgent in this field. In this work, stimulated by the recently proposed materials-genome initiative project, firstly we build classical machine-learning algorithms for the models of formation energies, bangdaps and Deybe temperatures for hybrid organic-inorganic double perovskites, then we choose the high-precision models to screen a large scale of double-perovskite chemical space, to filter out good pervoskite candidates for solar cells. We also analyze features of importances for the the three target properties to reveal the underlying mechanisms and discover the typical characteristics of high-performances double perovskites. Secondly we adopt the Crystal graph convolution neural network (CGCNN), to build precise model for bandgaps of perovskites for further filtering. Finally we use the ab-initio method to verify the results predicted by the CGCNN method, and find that, six out of twenty randomly chosen (CH3)2NH2-based HOIDP candidates possess finite bandgaps, and especially, (CH3)2NH2AuSbCl6 and (CH3)2NH2CsPdF6 possess the bandgaps of 0.633 eV and 0.504 eV, which are appropriate for photovoltaic applications. Our work not only provides a large scale of potential high-performance double-perovskite candidates for futural experimental or theoretical verification, but also showcases the effective and powerful prediction of the combined ML and CGCNN method proposed for the first time here.
△ Less
Submitted 1 August, 2023;
originally announced August 2023.
-
Energy-efficient superparamagnetic Ising machine and its application to traveling salesman problems
Authors:
Jia Si,
Shuhan Yang,
Yunuo Cen,
Jiaer Chen,
Zhaoyang Yao,
Dong-Jun Kim,
Kaiming Cai,
Jerald Yoo,
Xuanyao Fong,
Hyunsoo Yang
Abstract:
The growth of artificial intelligence and IoT has created a significant computational load for solving non-deterministic polynomial-time (NP)-hard problems, which are difficult to solve using conventional computers. The Ising computer, based on the Ising model and annealing process, has been highly sought for finding approximate solutions to NP-hard problems by observing the convergence of dynamic…
▽ More
The growth of artificial intelligence and IoT has created a significant computational load for solving non-deterministic polynomial-time (NP)-hard problems, which are difficult to solve using conventional computers. The Ising computer, based on the Ising model and annealing process, has been highly sought for finding approximate solutions to NP-hard problems by observing the convergence of dynamic spin states. However, it faces several challenges, including high power consumption due to artificial spins and randomness emulated by complex circuits, as well as low scalability caused by the rapidly growing connectivity when considering large-scale problems. Here, we present an experimental Ising annealing computer based on superparamagnetic tunnel junctions (SMTJs) with all-to-all connections, which successfully solves a 70-city travelling salesman problem (4761-node Ising problem). By taking advantage of the intrinsic randomness of SMTJs, implementing a proper global annealing scheme, and using an efficient algorithm, our SMTJ-based Ising annealer shows superior performance in terms of power consumption and energy efficiency compared to other Ising schemes. Additionally, our approach provides a promising way to solve complex problems with limited hardware resources. Moreover, we propose a crossbar array architecture for scalable integration using conventional magnetic random access memories. Our results demonstrate that the SMTJ-based Ising annealing computer with high energy efficiency, speed, and scalability is a strong candidate for future unconventional computing schemes.
△ Less
Submitted 20 June, 2023;
originally announced June 2023.
-
Design of Spintronics-based Neuronal and Synaptic Devices for Spiking Neural Network Circuits
Authors:
Debasis Das,
Yunuo Cen,
Jianze Wang,
Xuanyao Fong
Abstract:
Topologically stable magnetic skyrmion has a much lower depinning current density that may be useful for memory as well as neuromorphic computing. However, skyrmion-based devices suffer from the Magnus force originating from the skyrmion Hall effect, which may result in unwanted skyrmion annihilation if the magnitude of the driving current gets too large. A design of an artificial neuron and a syn…
▽ More
Topologically stable magnetic skyrmion has a much lower depinning current density that may be useful for memory as well as neuromorphic computing. However, skyrmion-based devices suffer from the Magnus force originating from the skyrmion Hall effect, which may result in unwanted skyrmion annihilation if the magnitude of the driving current gets too large. A design of an artificial neuron and a synapse using a synthetic antiferromagnetically coupled bilayer device, which nullifies the Magnus force, is demonstrated in this work. The leak term in the artificial leaky integrate-and-fire neuron is achieved by engineering the uniaxial anisotropy profile of the neuronal device. The synaptic device has a similar structure as the neuronal device but has a constant uniaxial anisotropy. The synaptic device also has a linear and symmetric weight update, which is a highly desirable trait of an artificial synapse. Neuronal and synaptic devices based on magnetic domain-wall (DW) motion are also studied and compared to skyrmionic devices. Our simulation results show the energy required to perform such operation in DW or skyrmion-based devices is on the order of a few fJ.
△ Less
Submitted 12 November, 2022;
originally announced November 2022.
-
Bilayer-skyrmion-based design of neuron and synapse for spiking neural network
Authors:
Debasis Das,
Yunuo Cen,
Jianze Wang,
Xuanyao Fong
Abstract:
Magnetic skyrmion technology is promising for the next-generation spintronics-based memory and neuromorphic computing due to their small size, non-volatility and low depinning current density. However, the Magnus force originating from the skyrmion Hall effect causes the skyrmion to move along a curved trajectory, which may lead to the annihilation of the skyrmion in a nanotrack during current-ind…
▽ More
Magnetic skyrmion technology is promising for the next-generation spintronics-based memory and neuromorphic computing due to their small size, non-volatility and low depinning current density. However, the Magnus force originating from the skyrmion Hall effect causes the skyrmion to move along a curved trajectory, which may lead to the annihilation of the skyrmion in a nanotrack during current-induced skyrmion motion. Consequently, circuits utilizing skyrmionic motion need to be designed to limit the impact of the skyrmion Hall effect. In this work, we propose a design of an artificial neuron, and a synapse using the bilayer device consisting of two antiferromagnetically exchange coupled ferromagnetic layers, which achieves robustness against the skyrmion Hall effect by nullifying the Magnus force. Using micromagnetic simulations, we show that the bilayer device can work as an artificial neuron and also as a synapse by modifying its uniaxial anisotropy. We also demonstrate that our proposed skyrmionic synapse has an intrinsic property of perfectly linear and symmetric weight update, which is highly desirable for the synapse operation. A spiking neural network implemented using our proposed synapse and neuron was simulated and showed to achieve 96.23\% accuracy in performing classification on the MNIST handwritten digit dataset.
△ Less
Submitted 2 February, 2023; v1 submitted 4 March, 2022;
originally announced March 2022.
-
Determining ground states of alloy by a symmetry-based classification
Authors:
Yu-Jie Cen,
Chang-chun He,
Shao-Bin Qiu,
Yu-Jun Zhao,
Xiao-Bao Yang
Abstract:
Reducing the number of candidate structures is crucial to improve the efficiency of global optimization. Herein, we demonstrate that the generalized Hamiltonian can be described by the atom classification model (ACM) based on symmetry, generating competent candidates for the first-principles calculations to determine ground states of alloy directly. The candidates can be obtained in advance throug…
▽ More
Reducing the number of candidate structures is crucial to improve the efficiency of global optimization. Herein, we demonstrate that the generalized Hamiltonian can be described by the atom classification model (ACM) based on symmetry, generating competent candidates for the first-principles calculations to determine ground states of alloy directly. The candidates can be obtained in advance through solving the convex hull step by step, because the correlation functions of ACM can be divided into various subspace according to the defined index $l$. As an important inference, this index can be converted to the number of Wyckoff positions, revealing the dominant effect of geometry symmetry on structural stability. Taking Ni-Pt, Ag-Pd, Os-Ru, Ir-Ru and Mo-Ru as examples, we not only identify the stable structures in previous theoretical and experimental results, but also predict a dozen of configurations with lower formation energies, such as Ag$_{0.5}$Pd$_{0.5}$ ($Fd$-$3m$), Os$_{0.5}$Ru$_{0.5}$ ($Pnma$), Ir$_{1/3}$Ru$_{2/3}$ ($P6_{3}/mmc$), and Mo$_{0.25}$Ru$_{0.75}$ ($Cmcm$).
△ Less
Submitted 21 January, 2022;
originally announced January 2022.
-
Two-dimensional InSe/WS$_2$ heterostructure with enhanced optoelectronic performance in the visible region
Authors:
Lu-Lu Yang,
Jun-jie Shi,
Min Zhang,
Zhongming Wei,
Yi-min Ding,
Meng Wu,
Yong He,
Yu-lang Cen,
Wen-hui Guo,
Shu-hang Pan,
Xing-Lai Che,
Xiong Li,
Yao-Hui Zhu
Abstract:
Two-dimensional (2D) InSe and WS$_2$ exhibit promising characteristics for optoelectronic and photoelectrochemical applications, e.g. photodetection and photocatalytic water splitting. However, both of them have poor absorption of visible light due to wide band gaps. 2D InSe has high electron mobility but low hole mobility, while 2D WS$_2$ is on the opposite. Here, we design a 2D heterostructure c…
▽ More
Two-dimensional (2D) InSe and WS$_2$ exhibit promising characteristics for optoelectronic and photoelectrochemical applications, e.g. photodetection and photocatalytic water splitting. However, both of them have poor absorption of visible light due to wide band gaps. 2D InSe has high electron mobility but low hole mobility, while 2D WS$_2$ is on the opposite. Here, we design a 2D heterostructure composed of their monolayers and study its optoelectronic properties by first-principles calculations. Our results show that the heterostructure has a direct band gap of 2.19 eV, which is much smaller than those of the monolayers mainly due to a type-II band alignment: the valence band maximum and the conduction band minimum of monolayer InSe are lower than those of monolayer WS$_2$, respectively. The visible-light absorption is enhanced considerably, e.g. about fivefold (threefold) increase at the wavelength of 490 nm in comparison to monolayer InSe (WS$_2$). The type-II band alignment also facilitates the spatial separation of photogenerated electron-hole pairs, i.e., electrons (holes) reside preferably in the InSe (WS$_2$) layer. The two layers complement each other in carrier mobilities of the heterostructure: the photogenerated electrons and holes inherit the large mobilities from the InSe and WS$_2$ monolayers, respectively.
△ Less
Submitted 5 August, 2018;
originally announced August 2018.
