-
An Inverse Hyperbolic Problem with Application to Joint Photoacoustic Parameter Determination
Authors:
Shitao Liu,
Gunther Uhlmann,
Yang Yang
Abstract:
We consider an inverse problem of recovering a parameter appearing in all levels in a second-order hyperbolic equation from a single boundary measurement. The model is motivated from applications in photoacoustic tomography when one seeks to recover both the wave speed and the initial ultrasound pressure from a single ultrasound signal. In particular, our result shows that the ratio of the initial…
▽ More
We consider an inverse problem of recovering a parameter appearing in all levels in a second-order hyperbolic equation from a single boundary measurement. The model is motivated from applications in photoacoustic tomography when one seeks to recover both the wave speed and the initial ultrasound pressure from a single ultrasound signal. In particular, our result shows that the ratio of the initial ultrasound pressure and the wave speed squared uniquely determines both of them respectively.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
A modified Ricci flow on arbitrary weighted graph
Authors:
Jicheng Ma,
Yunyan Yang
Abstract:
In this paper, we propose a modified Ricci flow, as well as a quasi-normalized Ricci flow, on arbitrary weighted graph. Each of these two flows has a unique global solution. In particular, these global existence and uniqueness results do not require an exit condition proposed by Bai et al in a recent work [2]. As applications, these two Ricci flows are applied to community detection for complex ne…
▽ More
In this paper, we propose a modified Ricci flow, as well as a quasi-normalized Ricci flow, on arbitrary weighted graph. Each of these two flows has a unique global solution. In particular, these global existence and uniqueness results do not require an exit condition proposed by Bai et al in a recent work [2]. As applications, these two Ricci flows are applied to community detection for complex networks, including Karate Club, American football games, Facebook, as well as artificial networks. In our algorithms, unlike in [5,15], there is no need to perform surgery at every iteration, only one surgery needs to be performed after the last iteration. From three commonly used criteria for evaluating community detection algorithms, ARI, NMI and Q, we conclude that our algorithms outperform existing algorithms, including Ollivier's Ricci flow [5], normalized Ollivier's Ricci flow and normalized Lin-Lu-Yau's Ricci flow [15]. The codes for our algorithms are available at https://github.com/mjc191812/Modified-Ricci-Flow.
△ Less
Submitted 18 August, 2024;
originally announced August 2024.
-
Weakly distance-regular digraphs whose underlying graphs are distance-regular,II
Authors:
Qing Zeng,
Yuefeng Yang,
Kaishun Wang
Abstract:
Weakly distance-regular digraphs are a natural directed version of distance-regular graphs. In [16], we classified all commutative weakly distance-regular digraphs whose underlying graphs are Hamming graphs, folded n-cubes, or Doob graphs. In this paper, we classify all commutative weakly distance-regular digraphs whose underlying graphs are Johnson graphs or folded Johnson graphs.
Weakly distance-regular digraphs are a natural directed version of distance-regular graphs. In [16], we classified all commutative weakly distance-regular digraphs whose underlying graphs are Hamming graphs, folded n-cubes, or Doob graphs. In this paper, we classify all commutative weakly distance-regular digraphs whose underlying graphs are Johnson graphs or folded Johnson graphs.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
Fractional Laplace operator and related Schrödinger equations on locally finite graphs
Authors:
Mengjie Zhang,
Yong Lin,
Yunyan Yang
Abstract:
In this paper, we first define a discrete version of the fractional Laplace operator $(-Δ)^{s}$ through the heat semigroup on a stochastically complete, connected, locally finite graph $G = (V, E, μ, w)$. Secondly, we define the fractional divergence and give another form of $(-Δ)^s$. The third point, and the foremost, is the introduction of the fractional Sobolev space $W^{s,2}(V)$, which is nece…
▽ More
In this paper, we first define a discrete version of the fractional Laplace operator $(-Δ)^{s}$ through the heat semigroup on a stochastically complete, connected, locally finite graph $G = (V, E, μ, w)$. Secondly, we define the fractional divergence and give another form of $(-Δ)^s$. The third point, and the foremost, is the introduction of the fractional Sobolev space $W^{s,2}(V)$, which is necessary when we study problems involving $(-Δ)^{s}$. Finally, using the mountain-pass theorem and the Nehari manifold, we obtain multiplicity solutions to a discrete fractional Schrödinger equation on $G$. We caution the readers that though these existence results are well known in the continuous case, the discrete case is quite different.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
Distributions in spaces with thick submanifolds
Authors:
Jiajia Ding,
Jasson Vindas,
Yunyun Yang
Abstract:
This article generalizes the results of [J. Math. Anal. Appl. 512 (2022), Article No. 126075], which presented a theory of distributions (generalized functions) with a singular curve contained in the domain of the test functions. In this present article we construct a theory of distributions in $\mathbb{R}^n$ with a ``thick submanifold'', that is, a new theory of thick distributions in…
▽ More
This article generalizes the results of [J. Math. Anal. Appl. 512 (2022), Article No. 126075], which presented a theory of distributions (generalized functions) with a singular curve contained in the domain of the test functions. In this present article we construct a theory of distributions in $\mathbb{R}^n$ with a ``thick submanifold'', that is, a new theory of thick distributions in $\mathbb{R}^n$ whose domain contains a submanifold on which test functions may be singular.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
Global convergence of a modified BFGS-type method based on function information for nonconvex multiobjective optimization problems
Authors:
Yingxue Yang
Abstract:
We propose a modified BFGS-type method based on function information for nonconvex multiobjective optimization problems (MFQNMO). The method employs a common BFGS matrix to approximate the Hessian matrix of all objective functions in each iteration. This matrix is updated using function and gradient information from the previous step. Our analysis confirms the convergence of the method without rel…
▽ More
We propose a modified BFGS-type method based on function information for nonconvex multiobjective optimization problems (MFQNMO). The method employs a common BFGS matrix to approximate the Hessian matrix of all objective functions in each iteration. This matrix is updated using function and gradient information from the previous step. Our analysis confirms the convergence of the method without relying on convexity assumptions. We also establish a local superlinear convergence rate for MFQNMO under mild conditions and validate its effectiveness through experiments on both nonconvex and convex test problems.
△ Less
Submitted 1 August, 2024;
originally announced August 2024.
-
Inversion Diameter and Treewidth
Authors:
Yichen Wang,
Haozhe Wang,
Yuxuan Yang,
Mei Lu
Abstract:
In an oriented graph $\overrightarrow{G}$, the inversion of a subset $X$ of vertices consists in reversing the orientation of all arcs with both end-vertices in $X$. The inversion graph of a graph $G$, denoted by $\mathcal{I}(G)$, is the graph whose vertices are orientations of $G$ in which two orientations $\overrightarrow{G_1}$ and $\overrightarrow{G_2}$ are adjacent if and only if there is an i…
▽ More
In an oriented graph $\overrightarrow{G}$, the inversion of a subset $X$ of vertices consists in reversing the orientation of all arcs with both end-vertices in $X$. The inversion graph of a graph $G$, denoted by $\mathcal{I}(G)$, is the graph whose vertices are orientations of $G$ in which two orientations $\overrightarrow{G_1}$ and $\overrightarrow{G_2}$ are adjacent if and only if there is an inversion $X$ transforming $\overrightarrow{G_1}$ into $\overrightarrow{G_2}$. The inversion diameter of a graph $G$ is the diameter of its inversion graph $\mathcal{I}(G)$ denoted by $diam(\mathcal{I}(G))$. Havet, Hörsch, and Rambaud~(2024) first proved that for $G$ of treewidth $k$, $diam(\mathcal{I}(G)) \le 2k$, and there are graphs of treewidth $k$ with inversion diameter $k+2$. In this paper, we construct graphs of treewidth $k$ with inversion diameter $2k$, which implies that the previous upper bound $diam(\mathcal{I}(G)) \le 2k$ is tight. Moreover, for graphs with maximum degree $Δ$, Havet, Hörsch, and Rambaud~(2024) proved $diam(\mathcal{I}(G)) \le 2Δ-1$ and conjectured that $diam(\mathcal{I}(G)) \le Δ$. We prove the conjecture when $Δ=3$ with the help of computer calculations.
△ Less
Submitted 22 July, 2024;
originally announced July 2024.
-
Random ordinate method for mitigating the ray effect in radiative transport equation simulations
Authors:
Lei Li,
Min Tang,
Yuqi Yang
Abstract:
The Discrete Ordinates Method (DOM) is the most widely used velocity discretization method for simulating the radiative transport equation. The ray effect stands as a long-standing drawback of DOM. In benchmark tests displaying the ray effect, we observe low regularity in velocity within the solution. To address this issue, we propose a random ordinate method (ROM) to mitigate the ray effect. Comp…
▽ More
The Discrete Ordinates Method (DOM) is the most widely used velocity discretization method for simulating the radiative transport equation. The ray effect stands as a long-standing drawback of DOM. In benchmark tests displaying the ray effect, we observe low regularity in velocity within the solution. To address this issue, we propose a random ordinate method (ROM) to mitigate the ray effect. Compared with other strategies proposed in the literature for mitigating the ray effect, ROM offers several advantages: 1) the computational cost is comparable to DOM; 2) it is simple and requires minimal changes to existing code based on DOM; 3) it is easily parallelizable and independent of the problem setup. Analytical results are presented for the convergence orders of the error and bias, and numerical tests demonstrate its effectiveness in mitigating the ray effect.
△ Less
Submitted 17 July, 2024;
originally announced July 2024.
-
Preconditioned Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression
Authors:
Yingzhen Yang
Abstract:
We consider nonparametric regression by an over-parameterized two-layer neural network trained by gradient descent (GD) or its variant in this paper. We show that, if the neural network is trained with a novel Preconditioned Gradient Descent (PGD) with early stopping and the target function has spectral bias widely studied in the deep learning literature, the trained network renders a particularly…
▽ More
We consider nonparametric regression by an over-parameterized two-layer neural network trained by gradient descent (GD) or its variant in this paper. We show that, if the neural network is trained with a novel Preconditioned Gradient Descent (PGD) with early stopping and the target function has spectral bias widely studied in the deep learning literature, the trained network renders a particularly sharp generalization bound with a minimax optimal rate of $\cO({1}/{n^{4α/(4α+1)}})$, which is sharper the current standard rate of $\cO({1}/{n^{2α/(2α+1)}})$ with $2α= d/(d-1)$ when the data is distributed uniformly on the unit sphere in $\RR^d$ and $n$ is the size of the training data. When the target function has no spectral bias, we prove that neural network trained with regular GD with early stopping still enjoys minimax optimal rate, and in this case our results do not require distributional assumptions in contrast with the current known results. Our results are built upon two significant technical contributions. First, uniform convergence to the NTK is established during the training process by PGD or GD, so that we can have a nice decomposition of the neural network function at any step of GD or PGD into a function in the RKHS and an error function with a small $L^{\infty}$-norm. Second, local Rademacher complexity is employed to tightly bound the Rademacher complexity of the function class comprising all the possible neural network functions obtained by GD or PGD. Our results also indicate that PGD can be another way of avoiding the usual linear regime of NTK and obtaining sharper generalization bound, because PGD induces a different kernel with lower kernel complexity during the training than the regular NTK induced by the network architecture trained by regular GD.
△ Less
Submitted 15 July, 2024;
originally announced July 2024.
-
Restricted Cohomology of Heisenberg Lie Algebras
Authors:
Yong Yang
Abstract:
The Heisenberg Lie algebras over an algebraically closed field F of characteristic p > 0 always admit a family of restricted Lie algebras. We use the ordinary 1- and 2-cohomology spaces with adjoint coefficients to compute the restricted 1- and 2-cohomology spaces of these restricted Heisenberg Lie algebras. We describe the infinitesimal restricted deformations of the restricted Lie algebras.
The Heisenberg Lie algebras over an algebraically closed field F of characteristic p > 0 always admit a family of restricted Lie algebras. We use the ordinary 1- and 2-cohomology spaces with adjoint coefficients to compute the restricted 1- and 2-cohomology spaces of these restricted Heisenberg Lie algebras. We describe the infinitesimal restricted deformations of the restricted Lie algebras.
△ Less
Submitted 13 July, 2024;
originally announced July 2024.
-
Associated Mersenne graphs
Authors:
Jianxin Wei,
Yujun Yang
Abstract:
In this paper, a new sub-family of Hypercubes called the \textit{associated Mersenne graphs} $\mathcal{M}_{n}$ are introduced. The definition of associated Mersenne graphs is motivated from the Fibonacci-run graphs ({Ö}. Eǧecioǧlu, V. Iršič, 2021) by extending run-constrained strings to circularly-run-constrained strings. The name of this new family of graphs is identified with the interesting fac…
▽ More
In this paper, a new sub-family of Hypercubes called the \textit{associated Mersenne graphs} $\mathcal{M}_{n}$ are introduced. The definition of associated Mersenne graphs is motivated from the Fibonacci-run graphs ({Ö}. Eǧecioǧlu, V. Iršič, 2021) by extending run-constrained strings to circularly-run-constrained strings. The name of this new family of graphs is identified with the interesting fact that $|V(\mathcal{M}_{n})|$ is equal to the $n$-th associated Mersenne number. Various interesting structural and enumerative properties of associated Mersenne graphs are investigated, including the analogue of the fundamental recursion, number of vertices and edges, radius, diameter, center, periphery and medianicity. Some future research directions and open problems concerning associated Mersenne graphs are also proposed.
△ Less
Submitted 11 July, 2024;
originally announced July 2024.
-
Regularity of powers of edge ideals of edge-weighted integrally closed cycles
Authors:
Guangjun Zhu,
Yijun Cui,
Jiaxin Li,
Yi Yang
Abstract:
This paper gives exact formulas for the regularity of powers of edge ideals of an edge-weighted integrally closed cycle.
This paper gives exact formulas for the regularity of powers of edge ideals of an edge-weighted integrally closed cycle.
△ Less
Submitted 6 July, 2024;
originally announced July 2024.
-
A Rank-Two Case of Local-Global Compatibility for $l = p$
Authors:
Yuji Yang
Abstract:
We prove the classical $l = p$ local-global compatibility conjecture for certain regular algebraic cuspidal automorphic representations of weight 0 for GL$_2$ over CM fields. Using an automorphy lifting theorem, we show that if the automorphic side comes from a twist of Steinberg at $v | l$, then the Galois side has nontrivial monodromy at $v$. Based on this observation, we will give a definition…
▽ More
We prove the classical $l = p$ local-global compatibility conjecture for certain regular algebraic cuspidal automorphic representations of weight 0 for GL$_2$ over CM fields. Using an automorphy lifting theorem, we show that if the automorphic side comes from a twist of Steinberg at $v | l$, then the Galois side has nontrivial monodromy at $v$. Based on this observation, we will give a definition of the Fontaine-Mazur $\mathcal{L}$-invariants attached to certain automorphic representations.
△ Less
Submitted 4 July, 2024; v1 submitted 28 June, 2024;
originally announced July 2024.
-
Return time sets and product recurrence
Authors:
Jian Li,
Xianjuan Liang,
Yini Yang
Abstract:
Let $G$ be a countable infinite discrete group. We show that a subset $F$ of $G$ contains a return time set of some piecewise syndetic recurrent point $x$ in a compact Hausdorff space $X$ with a $G$-action if and only if $F$ is a quasi-central set. As an application, we show that if a nonempty closed subsemigroup $S$ of the Stone-Čech compactification $βG$ contains the smallest ideal $K(βG)$ of…
▽ More
Let $G$ be a countable infinite discrete group. We show that a subset $F$ of $G$ contains a return time set of some piecewise syndetic recurrent point $x$ in a compact Hausdorff space $X$ with a $G$-action if and only if $F$ is a quasi-central set. As an application, we show that if a nonempty closed subsemigroup $S$ of the Stone-Čech compactification $βG$ contains the smallest ideal $K(βG)$ of $βG$ then $S$-product recurrent is equivalent to distality, which partially answers a question of Auslander and Furstenberg (Trans. Amer. Math. Soc. 343, 1994, 221--232).
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
Random pairing MLE for estimation of item parameters in Rasch model
Authors:
Yuepeng Yang,
Cong Ma
Abstract:
The Rasch model, a classical model in the item response theory, is widely used in psychometrics to model the relationship between individuals' latent traits and their binary responses on assessments or questionnaires. In this paper, we introduce a new likelihood-based estimator -- random pairing maximum likelihood estimator ($\mathsf{RP\text{-}MLE}$) and its bootstrapped variant multiple random pa…
▽ More
The Rasch model, a classical model in the item response theory, is widely used in psychometrics to model the relationship between individuals' latent traits and their binary responses on assessments or questionnaires. In this paper, we introduce a new likelihood-based estimator -- random pairing maximum likelihood estimator ($\mathsf{RP\text{-}MLE}$) and its bootstrapped variant multiple random pairing MLE ($\mathsf{MRP\text{-}MLE}$) that faithfully estimate the item parameters in the Rasch model. The new estimators have several appealing features compared to existing ones. First, both work for sparse observations, an increasingly important scenario in the big data era. Second, both estimators are provably minimax optimal in terms of finite sample $\ell_{\infty}$ estimation error. Lastly, $\mathsf{RP\text{-}MLE}$ admits precise distributional characterization that allows uncertainty quantification on the item parameters, e.g., construction of confidence intervals of the item parameters. The main idea underlying $\mathsf{RP\text{-}MLE}$ and $\mathsf{MRP\text{-}MLE}$ is to randomly pair user-item responses to form item-item comparisons. This is carefully designed to reduce the problem size while retaining statistical independence. We also provide empirical evidence of the efficacy of the two new estimators using both simulated and real data.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
Limit Results for Estimation of Connectivity Matrix in Multi-layer Stochastic Block Models
Authors:
Wenqing Su,
Xiao Guo,
Ying Yang
Abstract:
Multi-layer networks arise naturally in various domains including biology, finance and sociology, among others. The multi-layer stochastic block model (multi-layer SBM) is commonly used for community detection in the multi-layer networks. Most of current literature focuses on statistical consistency of community detection methods under multi-layer SBMs. However, the asymptotic distributional prope…
▽ More
Multi-layer networks arise naturally in various domains including biology, finance and sociology, among others. The multi-layer stochastic block model (multi-layer SBM) is commonly used for community detection in the multi-layer networks. Most of current literature focuses on statistical consistency of community detection methods under multi-layer SBMs. However, the asymptotic distributional properties are also indispensable which play an important role in statistical inference. In this work, we aim to study the estimation and asymptotic properties of the layer-wise scaled connectivity matrices in the multi-layer SBMs. We develop a novel and efficient method to estimate the scaled connectivity matrices. Under the multi-layer SBM and its variant multi-layer degree-corrected SBM, we establish the asymptotic normality of the estimated matrices under mild conditions, which can be used for interval estimation and hypothesis testing. Simulations show the superior performance of proposed method over existing methods in two considered statistical inference tasks. We also apply the method to a real dataset and obtain interpretable results.
△ Less
Submitted 16 June, 2024;
originally announced June 2024.
-
DeltaPhi: Learning Physical Trajectory Residual for PDE Solving
Authors:
Xihang Yue,
Linchao Zhu,
Yi Yang
Abstract:
Although neural operator networks theoretically approximate any operator mapping, the limited generalization capability prevents them from learning correct physical dynamics when potential data biases exist, particularly in the practical PDE solving scenario where the available data amount is restricted or the resolution is extremely low. To address this issue, we propose and formulate the Physica…
▽ More
Although neural operator networks theoretically approximate any operator mapping, the limited generalization capability prevents them from learning correct physical dynamics when potential data biases exist, particularly in the practical PDE solving scenario where the available data amount is restricted or the resolution is extremely low. To address this issue, we propose and formulate the Physical Trajectory Residual Learning (DeltaPhi), which learns to predict the physical residuals between the pending solved trajectory and a known similar auxiliary trajectory. First, we transform the direct operator mapping between input-output function fields in original training data to residual operator mapping between input function pairs and output function residuals. Next, we learn the surrogate model for the residual operator mapping based on existing neural operator networks. Additionally, we design helpful customized auxiliary inputs for efficient optimization. Through extensive experiments, we conclude that, compared to direct learning, physical residual learning is preferred for PDE solving.
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
Crafting Heavy-Tails in Weight Matrix Spectrum without Gradient Noise
Authors:
Vignesh Kothapalli,
Tianyu Pang,
Shenyang Deng,
Zongmin Liu,
Yaoqing Yang
Abstract:
Modern training strategies of deep neural networks (NNs) tend to induce a heavy-tailed (HT) spectra of layer weights. Extensive efforts to study this phenomenon have found that NNs with HT weight spectra tend to generalize well. A prevailing notion for the occurrence of such HT spectra attributes gradient noise during training as a key contributing factor. Our work shows that gradient noise is unn…
▽ More
Modern training strategies of deep neural networks (NNs) tend to induce a heavy-tailed (HT) spectra of layer weights. Extensive efforts to study this phenomenon have found that NNs with HT weight spectra tend to generalize well. A prevailing notion for the occurrence of such HT spectra attributes gradient noise during training as a key contributing factor. Our work shows that gradient noise is unnecessary for generating HT weight spectra: two-layer NNs trained with full-batch Gradient Descent/Adam can exhibit HT spectra in their weights after finite training steps. To this end, we first identify the scale of the learning rate at which one step of full-batch Adam can lead to feature learning in the shallow NN, particularly when learning a single index teacher model. Next, we show that multiple optimizer steps with such (sufficiently) large learning rates can transition the bulk of the weight's spectra into an HT distribution. To understand this behavior, we present a novel perspective based on the singular vectors of the weight matrices and optimizer updates. We show that the HT weight spectrum originates from the `spike', which is generated from feature learning and interacts with the main bulk to generate an HT spectrum. Finally, we analyze the correlations between the HT weight spectra and generalization after multiple optimizer updates with varying learning rates.
△ Less
Submitted 7 June, 2024;
originally announced June 2024.
-
Solution to a conjecture on resistance distances of block tower graphs
Authors:
Wensheng Sun,
Yujun Yang,
Wuxian Chen,
Shou-Jun Xu
Abstract:
Let $G$ be a connected graph. The resistance distance between two vertices $u$ and $v$ of $G$, denoted by $R_{G}[u,v]$, is defined as the net effective resistance between them in the electric network constructed from $G$ by replacing each edge with a unit resistor. The resistance diameter of $G$, denoted by $D_{r}(G)$, is defined as the maximum resistance distance among all pairs of vertices of…
▽ More
Let $G$ be a connected graph. The resistance distance between two vertices $u$ and $v$ of $G$, denoted by $R_{G}[u,v]$, is defined as the net effective resistance between them in the electric network constructed from $G$ by replacing each edge with a unit resistor. The resistance diameter of $G$, denoted by $D_{r}(G)$, is defined as the maximum resistance distance among all pairs of vertices of $G$. Let $P_n=a_1a_2\ldots a_n$ be the $n$-vertex path graph and $C_{4}=b_{1}b_2b_3b_4b_{1}$ be the 4-cycle. Then the $n$-th block tower graph $G_n$ is defined as the the Cartesian product of $P_n$ and $C_4$, that is, $G_n=P_{n}\square C_4$. Clearly, the vertex set of $G_n$ is $\{(a_i,b_j)|i=1,\ldots,n;j=1,\ldots,4\}$. In [Discrete Appl. Math. 320 (2022) 387--407], Evans and Francis proposed the following conjecture on resistance distances of $G_n$ and $G_{n+1}$: \begin{equation*} \lim_{n \rightarrow \infty}\left(R_{G_{n+1}}[(a_{1},b_1),(a_{n+1},b_3)]-R_{G_{n}}[(a_{1},b_1),(a_{n},b_3)]\right)=\frac{1}{4}. \end{equation*} In this paper, combining algebraic methods and electrical network approaches, we confirm and further generalize this conjecture. In addition, we determine all the resistance diametrical pairs in $G_n$, which enables us to give an equivalent explanation of the conjecture.
△ Less
Submitted 19 June, 2024; v1 submitted 6 June, 2024;
originally announced June 2024.
-
A computationally efficient arc-search interior-point algorithm for nonlinear constrained optimization
Authors:
Yaguang Yang
Abstract:
This paper proposes an arc-search interior-point algorithm for the nonlinear constrained optimization problem. The proposed algorithm uses the second-order derivatives to construct a search arc that approaches the optimizer. Because the arc stays in the interior set longer than any straight line, it is expected that the scheme will generate a better new iterate than a line search method. The compu…
▽ More
This paper proposes an arc-search interior-point algorithm for the nonlinear constrained optimization problem. The proposed algorithm uses the second-order derivatives to construct a search arc that approaches the optimizer. Because the arc stays in the interior set longer than any straight line, it is expected that the scheme will generate a better new iterate than a line search method. The computation of the second-order derivatives requires to solve the second linear system of equations, but the coefficient matrix of the second linear system of equations is the same as the first linear system of equations. Therefore, the matrix decomposition obtained while solving the first linear system of equations can be reused. In addition, most elements of the right-hand side vector of the second linear system of equations are already computed when the coefficient matrix is assembled. Therefore, the computation cost for solving the second linear system of equations is insignificant and the benefit of having a better search scheme is well justified. The convergence of the proposed algorithm is established. Some preliminary test results are reported to demonstrate the merit of the proposed algorithm.
△ Less
Submitted 1 June, 2024;
originally announced June 2024.
-
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity
Authors:
Yan Yang,
Bin Gao,
Ya-xiang Yuan
Abstract:
Bilevel reinforcement learning (RL), which features intertwined two-level problems, has attracted growing interest recently. The inherent non-convexity of the lower-level RL problem is, however, to be an impediment to developing bilevel optimization methods. By employing the fixed point equation associated with the regularized RL, we characterize the hyper-gradient via fully first-order informatio…
▽ More
Bilevel reinforcement learning (RL), which features intertwined two-level problems, has attracted growing interest recently. The inherent non-convexity of the lower-level RL problem is, however, to be an impediment to developing bilevel optimization methods. By employing the fixed point equation associated with the regularized RL, we characterize the hyper-gradient via fully first-order information, thus circumventing the assumption of lower-level convexity. This, remarkably, distinguishes our development of hyper-gradient from the general AID-based bilevel frameworks since we take advantage of the specific structure of RL problems. Moreover, we propose both model-based and model-free bilevel reinforcement learning algorithms, facilitated by access to the fully first-order hyper-gradient. Both algorithms are provable to enjoy the convergence rate $\mathcal{O}(ε^{-1})$. To the best of our knowledge, this is the first time that AID-based bilevel RL gets rid of additional assumptions on the lower-level problem. In addition, numerical experiments demonstrate that the hyper-gradient indeed serves as an integration of exploitation and exploration.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
Linearized Boundary Control Method for Density Reconstruction in Acoustic Wave Equations
Authors:
Lauri Oksanen,
Tianyu Yang,
Yang Yang
Abstract:
We develop a linearized boundary control method for the inverse boundary value problem of determining a density in the acoustic wave equation. The objective is to reconstruct an unknown perturbation in a known background density from the linearized Neumann-to-Dirichlet map. A key ingredient in the derivation is a linearized Blagovescenskii's identity with a free parameter. When the linearization i…
▽ More
We develop a linearized boundary control method for the inverse boundary value problem of determining a density in the acoustic wave equation. The objective is to reconstruct an unknown perturbation in a known background density from the linearized Neumann-to-Dirichlet map. A key ingredient in the derivation is a linearized Blagovescenskii's identity with a free parameter. When the linearization is at a constant background density, we derive two reconstructive algorithms with stability estimates based on the boundary control method. When the linearization is at a non-constant background density, we establish an increasing stability estimate for the recovery of the density perturbation. The proposed reconstruction algorithms are implemented and validated with several numerical experiments to demonstrate the feasibility.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Automatic Differentiation is Essential in Training Neural Networks for Solving Differential Equations
Authors:
Chuqi Chen,
Yahong Yang,
Yang Xiang,
Wenrui Hao
Abstract:
Neural network-based approaches have recently shown significant promise in solving partial differential equations (PDEs) in science and engineering, especially in scenarios featuring complex domains or the incorporation of empirical data. One advantage of the neural network method for PDEs lies in its automatic differentiation (AD), which necessitates only the sample points themselves, unlike trad…
▽ More
Neural network-based approaches have recently shown significant promise in solving partial differential equations (PDEs) in science and engineering, especially in scenarios featuring complex domains or the incorporation of empirical data. One advantage of the neural network method for PDEs lies in its automatic differentiation (AD), which necessitates only the sample points themselves, unlike traditional finite difference (FD) approximations that require nearby local points to compute derivatives. In this paper, we quantitatively demonstrate the advantage of AD in training neural networks. The concept of truncated entropy is introduced to characterize the training property. Specifically, through comprehensive experimental and theoretical analyses conducted on random feature models and two-layer neural networks, we discover that the defined truncated entropy serves as a reliable metric for quantifying the residual loss of random feature models and the training speed of neural networks for both AD and FD methods. Our experimental and theoretical analyses demonstrate that, from a training perspective, AD outperforms FD in solving partial differential equations.
△ Less
Submitted 25 August, 2024; v1 submitted 22 May, 2024;
originally announced May 2024.
-
Newton Informed Neural Operator for Computing Multiple Solutions of Nonlinear Partials Differential Equations
Authors:
Wenrui Hao,
Xinliang Liu,
Yahong Yang
Abstract:
Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods for solving nonlinear PDEs, such as Physics-Informed Neural Networks (PINN), Deep Ritz methods, and DeepONet, often encounter challenges when confronted with the…
▽ More
Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods for solving nonlinear PDEs, such as Physics-Informed Neural Networks (PINN), Deep Ritz methods, and DeepONet, often encounter challenges when confronted with the presence of multiple solutions inherent in the nonlinear problem. These methods may encounter ill-posedness issues. In this paper, we propose a novel approach called the Newton Informed Neural Operator, which builds upon existing neural network techniques to tackle nonlinearities. Our method combines classical Newton methods, addressing well-posed problems, and efficiently learns multiple solutions in a single learning process while requiring fewer supervised data points compared to existing neural network methods.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
Scalable Bayesian inference for heat kernel Gaussian processes on manifolds
Authors:
Junhui He,
Guoxuan Ma,
Jian Kang,
Ying Yang
Abstract:
We develop scalable manifold learning methods and theory, motivated by the problem of estimating manifold of fMRI activation in the Human Connectome Project (HCP). We propose the Fast Graph Laplacian Estimation for Heat Kernel Gaussian Processes (FLGP) in the natural exponential family model. FLGP handles large sample sizes $ n $, preserves the intrinsic geometry of data, and significantly reduces…
▽ More
We develop scalable manifold learning methods and theory, motivated by the problem of estimating manifold of fMRI activation in the Human Connectome Project (HCP). We propose the Fast Graph Laplacian Estimation for Heat Kernel Gaussian Processes (FLGP) in the natural exponential family model. FLGP handles large sample sizes $ n $, preserves the intrinsic geometry of data, and significantly reduces computational complexity from $ \mathcal{O}(n^3) $ to $ \mathcal{O}(n) $ via a novel reduced-rank approximation of the graph Laplacian's transition matrix and truncated Singular Value Decomposition for eigenpair computation. Our numerical experiments demonstrate FLGP's scalability and improved accuracy for manifold learning from large-scale complex data.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
A high-order Eulerian-Lagrangian Runge-Kutta finite volume (EL-RK-FV) method for scalar nonlinear conservation laws
Authors:
Jiajie Chen,
Joseph Nakao,
Jing-Mei Qiu,
Yang Yang
Abstract:
We present a class of high-order Eulerian-Lagrangian Runge-Kutta finite volume methods that can numerically solve Burgers' equation with shock formations, which could be extended to general scalar conservation laws. Eulerian-Lagrangian (EL) and semi-Lagrangian (SL) methods have recently seen increased development and have become a staple for allowing large time-stepping sizes. Yet, maintaining rel…
▽ More
We present a class of high-order Eulerian-Lagrangian Runge-Kutta finite volume methods that can numerically solve Burgers' equation with shock formations, which could be extended to general scalar conservation laws. Eulerian-Lagrangian (EL) and semi-Lagrangian (SL) methods have recently seen increased development and have become a staple for allowing large time-stepping sizes. Yet, maintaining relatively large time-stepping sizes post shock formation remains quite challenging. Our proposed scheme integrates the partial differential equation on a space-time region partitioned by linear approximations to the characteristics determined by the Rankine-Hugoniot jump condition. We trace the characteristics forward in time and present a merging procedure for the mesh cells to handle intersecting characteristics due to shocks. Following this partitioning, we write the equation in a time-differential form and evolve with Runge-Kutta methods in a method-of-lines fashion. High-resolution methods such as ENO and WENO-AO schemes are used for spatial reconstruction. Extension to higher dimensions is done via dimensional splitting. Numerical experiments demonstrate our scheme's high-order accuracy and ability to sharply capture post-shock solutions with large time-stepping sizes.
△ Less
Submitted 29 May, 2024; v1 submitted 16 May, 2024;
originally announced May 2024.
-
On the orbits of a finite solvable primitive linear group
Authors:
Yong Yang,
Mengxi You
Abstract:
In this paper, we strengthen a result of Seager regarding the number of orbits of a solvable primitive linear group.
In this paper, we strengthen a result of Seager regarding the number of orbits of a solvable primitive linear group.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Centers of Universal Enveloping Algebras
Authors:
Yaping Yang,
Daihao Zeng
Abstract:
The universal enveloping algebra $U(\mathfrak{g} )$ of a current (super)algebra or loop (super)algebra $\mathfrak{g} $ is considered over an algebraically closed field $\mathbb{K} $ with characteristic $p\ge 0$. This paper focuses on the structure of the center $Z(\mathfrak{g} )$ of $U(\mathfrak{g} )$. In the case of zero characteristic, $Z(\mathfrak{g} )$ is generated by the centers of…
▽ More
The universal enveloping algebra $U(\mathfrak{g} )$ of a current (super)algebra or loop (super)algebra $\mathfrak{g} $ is considered over an algebraically closed field $\mathbb{K} $ with characteristic $p\ge 0$. This paper focuses on the structure of the center $Z(\mathfrak{g} )$ of $U(\mathfrak{g} )$. In the case of zero characteristic, $Z(\mathfrak{g} )$ is generated by the centers of $\mathfrak{g} $. In the case of prime characteristic, $Z(\mathfrak{g} )$ is generated by the centers of $\mathfrak{g} $ and the $p$-centers of $U(\mathfrak{g} )$. We also study the structure of $Z(\mathfrak{g} )$ in the semisimple Lie (super)algebra.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Wasserstein Proximal Coordinate Gradient Algorithms
Authors:
Rentian Yao,
Xiaohui Chen,
Yun Yang
Abstract:
Motivated by approximation Bayesian computation using mean-field variational approximation and the computation of equilibrium in multi-species systems with cross-interaction, this paper investigates the composite geodesically convex optimization problem over multiple distributions. The objective functional under consideration is composed of a convex potential energy on a product of Wasserstein spa…
▽ More
Motivated by approximation Bayesian computation using mean-field variational approximation and the computation of equilibrium in multi-species systems with cross-interaction, this paper investigates the composite geodesically convex optimization problem over multiple distributions. The objective functional under consideration is composed of a convex potential energy on a product of Wasserstein spaces and a sum of convex self-interaction and internal energies associated with each distribution. To efficiently solve this problem, we introduce the Wasserstein Proximal Coordinate Gradient (WPCG) algorithms with parallel, sequential and random update schemes. Under a quadratic growth (QC) condition that is weaker than the usual strong convexity requirement on the objective functional, we show that WPCG converges exponentially fast to the unique global optimum. In the absence of the QG condition, WPCG is still demonstrated to converge to the global optimal solution, albeit at a slower polynomial rate. Numerical results for both motivating examples are consistent with our theoretical findings.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
Locally semicomplete weakly distance-regular digraphs
Authors:
Yuefeng Yang,
Shuang Li,
Kaishun Wang
Abstract:
A digraph is semicomplete if any two vertices are connected by at least one arc and is locally semicomplete if the out-neighbourhood (resp. in-neighbourhood) of any vertex induces a semicomplete digraph. In this paper, we characterize all locally semicomplete weakly distance-regular digraphs under the assumption of commutativity.
A digraph is semicomplete if any two vertices are connected by at least one arc and is locally semicomplete if the out-neighbourhood (resp. in-neighbourhood) of any vertex induces a semicomplete digraph. In this paper, we characterize all locally semicomplete weakly distance-regular digraphs under the assumption of commutativity.
△ Less
Submitted 6 May, 2024;
originally announced May 2024.
-
Counterexamples to two conjectures on mean color numbers of graphs
Authors:
Wushuang Zhai,
Yan Yang
Abstract:
The mean color number of an $n$-vertex graph $G$, denoted by $μ(G)$, is the average number of colors used in all proper $n$-colorings of $G$. For any graph $G$ and a vertex $w$ in $G$, Dong (2003) conjectured that if $H$ is a graph obtained from a graph $G$ by deleting all but one of the edges which are incident to $w$, then $μ(G)\geq μ(H)$; and also conjectured that $μ(G)\geq μ((G-w)\cup K_1)$. W…
▽ More
The mean color number of an $n$-vertex graph $G$, denoted by $μ(G)$, is the average number of colors used in all proper $n$-colorings of $G$. For any graph $G$ and a vertex $w$ in $G$, Dong (2003) conjectured that if $H$ is a graph obtained from a graph $G$ by deleting all but one of the edges which are incident to $w$, then $μ(G)\geq μ(H)$; and also conjectured that $μ(G)\geq μ((G-w)\cup K_1)$. We prove that there is an infinite family of counterexamples to these two conjectures.
△ Less
Submitted 11 June, 2024; v1 submitted 3 May, 2024;
originally announced May 2024.
-
Finding Product and Sum Patterns in non-commutative settings
Authors:
T. Y. Tao,
Neil N. Y. Yang
Abstract:
Hindman conjectured that any finite partition of $\mathbb{N}$ has a monochromatic $\{x,y,x+y,xy\}$. Recently, Bowen proved the result for all 2-partition. In this paper, we extend Bowen's result to any semiring $(S,+,\cdot)$ such that $Ss$ is piecewise syndetic for all $s\in S$. As a method, we gave a combinatorial proof for a piecewise syndetic version of Bergerson and Glasscock's IP$_r^*$ Szemer…
▽ More
Hindman conjectured that any finite partition of $\mathbb{N}$ has a monochromatic $\{x,y,x+y,xy\}$. Recently, Bowen proved the result for all 2-partition. In this paper, we extend Bowen's result to any semiring $(S,+,\cdot)$ such that $Ss$ is piecewise syndetic for all $s\in S$. As a method, we gave a combinatorial proof for a piecewise syndetic version of Bergerson and Glasscock's IP$_r^*$ Szemerédi Theorem, and discussed the case when the operation is not commutative.
△ Less
Submitted 30 April, 2024;
originally announced April 2024.
-
Multicontinuum homogenization in perforated domains
Authors:
Wei Xie,
Yalchin Efendiev,
Yunqing Huang,
Wing Tat Leung,
Yin Yang
Abstract:
In this paper, we develop a general framework for multicontinuum homogenization in perforated domains. The simulations of problems in perforated domains are expensive and, in many applications, coarse-grid macroscopic models are developed. Many previous approaches include homogenization, multiscale finite element methods, and so on. In our paper, we design multicontinuum homogenization based on ou…
▽ More
In this paper, we develop a general framework for multicontinuum homogenization in perforated domains. The simulations of problems in perforated domains are expensive and, in many applications, coarse-grid macroscopic models are developed. Many previous approaches include homogenization, multiscale finite element methods, and so on. In our paper, we design multicontinuum homogenization based on our recently proposed framework. In this setting, we distinguish different spatial regions in perforations based on their sizes. For example, very thin perforations are considered as one continua, while larger perforations are considered as another continua. By differentiating perforations in this way, we are able to predict flows in each of them more accurately. We present a framework by formulating cell problems for each continuum using appropriate constraints for the solution averages and their gradients. These cell problem solutions are used in a multiscale expansion and in deriving novel macroscopic systems for multicontinuum homogenization. Our proposed approaches are designed for problems without scale separation. We present numerical results for two continuum problems and demonstrate the accuracy of the proposed methods.
△ Less
Submitted 26 April, 2024;
originally announced April 2024.
-
CEM-GMsFEM for Poisson equations in heterogeneous perforated domains
Authors:
Wei Xie,
Yin Yang,
Eric Chung,
Yunqing Huang
Abstract:
In this paper, we propose a novel multiscale model reduction strategy tailored to address the Poisson equation within heterogeneous perforated domains. The numerical simulation of this intricate problem is impeded by its multiscale characteristics, necessitating an exceptionally fine mesh to adequately capture all relevant details. To overcome the challenges inherent in the multiscale nature of th…
▽ More
In this paper, we propose a novel multiscale model reduction strategy tailored to address the Poisson equation within heterogeneous perforated domains. The numerical simulation of this intricate problem is impeded by its multiscale characteristics, necessitating an exceptionally fine mesh to adequately capture all relevant details. To overcome the challenges inherent in the multiscale nature of the perforations, we introduce a coarse space constructed using the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM). This involves constructing basis functions through a sequence of local energy minimization problems over eigenspaces containing localized information pertaining to the heterogeneities. Through our analysis, we demonstrate that the oversampling layers depend on the local eigenvalues, thereby implicating the local geometry as well. Additionally, we provide numerical examples to illustrate the efficacy of the proposed scheme.
△ Less
Submitted 26 April, 2024;
originally announced April 2024.
-
Estimating the Number of Components in Finite Mixture Models via Variational Approximation
Authors:
Chenyang Wang,
Yun Yang
Abstract:
This work introduces a new method for selecting the number of components in finite mixture models (FMMs) using variational Bayes, inspired by the large-sample properties of the Evidence Lower Bound (ELBO) derived from mean-field (MF) variational approximation. Specifically, we establish matching upper and lower bounds for the ELBO without assuming conjugate priors, suggesting the consistency of mo…
▽ More
This work introduces a new method for selecting the number of components in finite mixture models (FMMs) using variational Bayes, inspired by the large-sample properties of the Evidence Lower Bound (ELBO) derived from mean-field (MF) variational approximation. Specifically, we establish matching upper and lower bounds for the ELBO without assuming conjugate priors, suggesting the consistency of model selection for FMMs based on maximizing the ELBO. As a by-product of our proof, we demonstrate that the MF approximation inherits the stable behavior (benefited from model singularity) of the posterior distribution, which tends to eliminate the extra components under model misspecification where the number of mixture components is over-specified. This stable behavior also leads to the $n^{-1/2}$ convergence rate for parameter estimation, up to a logarithmic factor, under this model overspecification. Empirical experiments are conducted to validate our theoretical findings and compare with other state-of-the-art methods for selecting the number of components in FMMs.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
The inversion number of dijoins and blow-up digraphs
Authors:
Haozhe Wang,
Yuxuan Yang,
Mei Lu
Abstract:
For an oriented graph $D$, the $inversion$ of $X \subseteq V(D)$ in $D$ is the digraph obtained from $D$ by reversing the direction of all arcs with both ends in $X$. The inversion number of $D$, denoted by $inv(D)$, is the minimum number of inversions needed to transform $D$ into an acyclic digraph. In this paper, we first show that $inv (\overrightarrow{C_3} \Rightarrow D)= inv(D) +1$ for any or…
▽ More
For an oriented graph $D$, the $inversion$ of $X \subseteq V(D)$ in $D$ is the digraph obtained from $D$ by reversing the direction of all arcs with both ends in $X$. The inversion number of $D$, denoted by $inv(D)$, is the minimum number of inversions needed to transform $D$ into an acyclic digraph. In this paper, we first show that $inv (\overrightarrow{C_3} \Rightarrow D)= inv(D) +1$ for any oriented graph $\textit{D}$ with even inversion number $inv(D)$, where the dijoin $\overrightarrow{C_3} \Rightarrow D$ is the oriented graph obtained from the disjoint union of $\overrightarrow{C_3}$ and $D$ by adding all arcs from $\overrightarrow{C_3}$ to $D$. Thus we disprove the conjecture of Aubian el at. \cite{2212.09188} and the conjecture of Alon el at. \cite{2212.11969}. We also study the blow-up graph which is an oriented graph obtained from a tournament by replacing all vertices into oriented graphs. We construct a tournament $T$ with order $n$ and $inv(T)=\frac{n}{3}+1$ using blow-up graphs.
△ Less
Submitted 24 April, 2024; v1 submitted 23 April, 2024;
originally announced April 2024.
-
Randomized Large-Scale Quaternion Matrix Approximation: Practical Rangefinders and One-Pass Algorithm
Authors:
Chao Chang,
Yuning Yang
Abstract:
Recently, randomized algorithms for low-rank approximation of quaternion matrices have received increasing attention. However, for large-scale problems, existing quaternion orthonormalizations are inefficient, leading to slow rangefinders. To address this, by appropriately leveraging efficient scientific computing libraries in the complex arithmetic, this work devises two practical quaternion rang…
▽ More
Recently, randomized algorithms for low-rank approximation of quaternion matrices have received increasing attention. However, for large-scale problems, existing quaternion orthonormalizations are inefficient, leading to slow rangefinders. To address this, by appropriately leveraging efficient scientific computing libraries in the complex arithmetic, this work devises two practical quaternion rangefinders, one of which is non-orthonormal yet well-conditioned. They are then integrated into the quaternion version of a one-pass algorithm, which originally takes orthonormal rangefinders only. We establish the error bounds and demonstrate that the error is proportional to the condition number of the rangefinder. The probabilistic bounds are exhibited for both quaternion Gaussian and sub-Gaussian embeddings. Numerical experiments demonstrate that the one-pass algorithm with the proposed rangefinders significantly outperforms previous techniques in efficiency. Additionally, we tested the algorithm in a 3D Navier-Stokes equation ($5.22$GB) and a 4D Lorenz-type chaotic system ($5.74$GB) data compression, as well as a $31365\times 27125$ image compression to demonstrate its capability for handling large-scale applications.
△ Less
Submitted 18 June, 2024; v1 submitted 23 April, 2024;
originally announced April 2024.
-
Rate Analysis of Coupled Distributed Stochastic Approximation for Misspecified Optimization
Authors:
Yaqun Yang,
Jinlong Lei
Abstract:
We consider an $n$ agents distributed optimization problem with imperfect information characterized in a parametric sense, where the unknown parameter can be solved by a distinct distributed parameter learning problem. Though each agent only has access to its local parameter learning and computational problem, they mean to collaboratively minimize the average of their local cost functions. To addr…
▽ More
We consider an $n$ agents distributed optimization problem with imperfect information characterized in a parametric sense, where the unknown parameter can be solved by a distinct distributed parameter learning problem. Though each agent only has access to its local parameter learning and computational problem, they mean to collaboratively minimize the average of their local cost functions. To address the special optimization problem, we propose a coupled distributed stochastic approximation algorithm, in which every agent updates the current beliefs of its unknown parameter and decision variable by stochastic approximation method; and then averages the beliefs and decision variables of its neighbors over network in consensus protocol. Our interest lies in the convergence analysis of this algorithm. We quantitatively characterize the factors that affect the algorithm performance, and prove that the mean-squared error of the decision variable is bounded by $\mathcal{O}(\frac{1}{nk})+\mathcal{O}\left(\frac{1}{\sqrt{n}(1-ρ_w)}\right)\frac{1}{k^{1.5}}+\mathcal{O}\big(\frac{1}{(1-ρ_w)^2} \big)\frac{1}{k^2}$, where $k$ is the iteration count and $(1-ρ_w)$ is the spectral gap of the network weighted adjacency matrix. It reveals that the network connectivity characterized by $(1-ρ_w)$ only influences the high order of convergence rate, while the domain rate still acts the same as the centralized algorithm. In addition, we analyze that the transient iteration needed for reaching its dominant rate $\mathcal{O}(\frac{1}{nk})$ is $\mathcal{O}(\frac{n}{(1-ρ_w)^2})$. Numerical experiments are carried out to demonstrate the theoretical results by taking different CPUs as agents, which is more applicable to real-world distributed scenarios.
△ Less
Submitted 21 April, 2024;
originally announced April 2024.
-
Online Planning of Power Flows for Power Systems Against Bushfires Using Spatial Context
Authors:
Jianyu Xu,
Qiuzhuang Sun,
Yang Yang,
Huadong Mo,
Daoyi Dong
Abstract:
The 2019-20 Australia bushfire incurred numerous economic losses and significantly affected the operations of power systems. A power station or transmission line can be significantly affected due to bushfires, leading to an increase in operational costs. We study a fundamental but challenging problem of planning the optimal power flow (OPF) for power systems subject to bushfires. Considering the s…
▽ More
The 2019-20 Australia bushfire incurred numerous economic losses and significantly affected the operations of power systems. A power station or transmission line can be significantly affected due to bushfires, leading to an increase in operational costs. We study a fundamental but challenging problem of planning the optimal power flow (OPF) for power systems subject to bushfires. Considering the stochastic nature of bushfire spread, we develop a model to capture such dynamics based on Moore's neighborhood model. Under a periodic inspection scheme that reveals the in-situ bushfire status, we propose an online optimization modeling framework that sequentially plans the power flows in the electricity network. Our framework assumes that the spread of bushfires is non-stationary over time, and the spread and containment probabilities are unknown. To meet these challenges, we develop a contextual online learning algorithm that treats the in-situ geographical information of the bushfire as a 'spatial context'. The online learning algorithm learns the unknown probabilities sequentially based on the observed data and then makes the OPF decision accordingly. The sequential OPF decisions aim to minimize the regret function, which is defined as the cumulative loss against the clairvoyant strategy that knows the true model parameters. We provide a theoretical guarantee of our algorithm by deriving a bound on the regret function, which outperforms the regret bound achieved by other benchmark algorithms. Our model assumptions are verified by the real bushfire data from NSW, Australia, and we apply our model to two power systems to illustrate its applicability.
△ Less
Submitted 20 April, 2024;
originally announced April 2024.
-
On length-preserving and area-preserving inverse curvature flow of planar curves with singularities
Authors:
Yunlong Yang,
Yanwen Zhao,
Jianbo Fang,
Yanlong Zhang
Abstract:
This paper aims to investigate the evolution problem for planar curves with singularities. Motivated by the inverse curvature flow introduced by Li and Wang (Calc. Var. Partial Differ. Equ. 62 (2023), No. 135), we intend to consider the area-preserving and length-preserving inverse curvature flow with nonlocal term for $\ell$-convex Legendre curves. For the area-preserving flow, an $\ell$-convex L…
▽ More
This paper aims to investigate the evolution problem for planar curves with singularities. Motivated by the inverse curvature flow introduced by Li and Wang (Calc. Var. Partial Differ. Equ. 62 (2023), No. 135), we intend to consider the area-preserving and length-preserving inverse curvature flow with nonlocal term for $\ell$-convex Legendre curves. For the area-preserving flow, an $\ell$-convex Legendre curve %of with initial algebraic area $A_0>0$ evolves to a circle of radius $\sqrt{\frac{A_0}π}$. For the length-preserving flow, an $\ell$-convex Legendre curve %of with initial algebraic length $L_0$ evolves to a circle of radius $\frac{L_0}{2π}$. As the by-product, we obtain some geometric inequalities for $\ell$-convex Legendre curves through the length-preserving flow.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
Classification of positive solutions of critical anisotropic Sobolev equation without the finite volume constraint
Authors:
Lu Chen,
Yabo Yang
Abstract:
In this paper, we classify all positive solutions of the critical anisotropic Sobolev equation \begin{equation*} -Δ^{H}_{p}u = u^{p^{*}-1}, \ \ x\in \mathbb{R}^n \end{equation*} without the finite volume constraint for $n \geq 2$ and $\frac{(n+1)}{3} \leq p < n$, where $p^{*} = \frac{np}{n-p}$ denotes the critical Sobolev exponent and $-Δ^{H}_{p}=-div(H^{p-1}(\cdot)\nabla H(\cdot))$ denotes the an…
▽ More
In this paper, we classify all positive solutions of the critical anisotropic Sobolev equation \begin{equation*} -Δ^{H}_{p}u = u^{p^{*}-1}, \ \ x\in \mathbb{R}^n \end{equation*} without the finite volume constraint for $n \geq 2$ and $\frac{(n+1)}{3} \leq p < n$, where $p^{*} = \frac{np}{n-p}$ denotes the critical Sobolev exponent and $-Δ^{H}_{p}=-div(H^{p-1}(\cdot)\nabla H(\cdot))$ denotes the anisotropic $p$-Laplace operator. This result removes the finite volume assumption on the classification of critical anisotropic $p$-Laplace equation which was obtained by Ciraolo-Figalli-Roncoroni in the literature \cite{CFR}. The method is based on constructing suitable vector fields integral inequality and using Newton's type inequality.
△ Less
Submitted 10 May, 2024; v1 submitted 15 April, 2024;
originally announced April 2024.
-
Distributed Fractional Bayesian Learning for Adaptive Optimization
Authors:
Yaqun Yang,
Jinlong Lei,
Guanghui Wen,
Yiguang Hong
Abstract:
This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the optimal solution over a connected network. A general mathematical framework for such a problem has not been studied yet. We aim to provide valuable insights fo…
▽ More
This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the optimal solution over a connected network. A general mathematical framework for such a problem has not been studied yet. We aim to provide valuable insights for addressing parameter uncertainty in distributed optimization problems and simultaneously find the optimal solution. Thus, we propose a novel Prediction while Optimization scheme, which utilizes distributed fractional Bayesian learning through weighted averaging on the log-beliefs to update the beliefs of unknown parameters, and distributed gradient descent for renewing the estimation of the optimal solution. Then under suitable assumptions, we prove that all agents' beliefs and decision variables converge almost surely to the true parameter and the optimal solution under the true parameter, respectively. We further establish a sublinear convergence rate for the belief sequence. Finally, numerical experiments are implemented to corroborate the theoretical analysis.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
Asymptotic mutual information in quadratic estimation problems over compact groups
Authors:
Kaylee Y. Yang,
Timothy L. H. Wee,
Zhou Fan
Abstract:
Motivated by applications to group synchronization and quadratic assignment on random data, we study a general problem of Bayesian inference of an unknown ``signal'' belonging to a high-dimensional compact group, given noisy pairwise observations of a featurization of this signal. We establish a quantitative comparison between the signal-observation mutual information in any such problem with that…
▽ More
Motivated by applications to group synchronization and quadratic assignment on random data, we study a general problem of Bayesian inference of an unknown ``signal'' belonging to a high-dimensional compact group, given noisy pairwise observations of a featurization of this signal. We establish a quantitative comparison between the signal-observation mutual information in any such problem with that in a simpler model with linear observations, using interpolation methods. For group synchronization, our result proves a replica formula for the asymptotic mutual information and Bayes-optimal mean-squared-error. Via analyses of this replica formula, we show that the conjectural phase transition threshold for computationally-efficient weak recovery of the signal is determined by a classification of the real-irreducible components of the observed group representation(s), and we fully characterize the information-theoretic limits of estimation in the example of angular/phase synchronization over $SO(2)$/$U(1)$. For quadratic assignment, we study observations given by a kernel matrix of pairwise similarities and a randomly permutated and noisy counterpart, and we show in a bounded signal-to-noise regime that the asymptotic mutual information coincides with that in a Bayesian spiked model with i.i.d. signal prior.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
A Systematic Methodology for Modeling and Attitude Control of Multi-body Space Telescopes
Authors:
Yaguang Yang,
William Bentz,
Lia Lewis
Abstract:
This paper derives a symbolic multi-body rigid nonlinear model for a space telescope using Stoneking's implementation of Kane's method. This symbolic nonlinear model is linearized using Matlab symbolic functions {\tt diff} and {\tt inv} because the analytic linearization is intractable for manual derivation. The linearized system model is then used to design the controllers using both linear quadr…
▽ More
This paper derives a symbolic multi-body rigid nonlinear model for a space telescope using Stoneking's implementation of Kane's method. This symbolic nonlinear model is linearized using Matlab symbolic functions {\tt diff} and {\tt inv} because the analytic linearization is intractable for manual derivation. The linearized system model is then used to design the controllers using both linear quadratic regulator (LQR) and robust pole assignment methods. The closed-loop systems for the two designs are simulated using both the rigid model as well as a second model containing flexible modes. The performances of the two designs are compared based on the simulation testing results. Our conclusion is that the robust pole assignment design offers better performance than that of the LQR system in terms of actuator usage and pointing accuracy. However, the LQR approach remains an effective first design step that can inform the selection of real eigenvalues for robust pole assignment. The proposed method may be used for the modeling and controller designs for various multi-body systems.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
The $L_p$ dual Minkowski problem for unbounded closed convex sets
Authors:
Wen Ai,
Yunlong Yang,
Deping Ye
Abstract:
The central focus of this paper is the $L_p$ dual Minkowski problem for $C$-compatible sets, where $C$ is a pointed closed convex cone in $\mathbb{R}^n$ with nonempty interior. Such a problem deals with the characterization of the $(p, q)$-th dual curvature measure of a $C$-compatible set. It produces new Monge-Ampère equations for unbounded convex hypersurface, often defined over open domains and…
▽ More
The central focus of this paper is the $L_p$ dual Minkowski problem for $C$-compatible sets, where $C$ is a pointed closed convex cone in $\mathbb{R}^n$ with nonempty interior. Such a problem deals with the characterization of the $(p, q)$-th dual curvature measure of a $C$-compatible set. It produces new Monge-Ampère equations for unbounded convex hypersurface, often defined over open domains and with non-positive unknown convex functions. Within the family of $C$-determined sets, the $L_p$ dual Minkowski problem is solved for $0\neq p\in \mathbb{R}$ and $q\in \mathbb{R}$; while it is solved for the range of $p\leq 0$ and $p<q$ within the newly defined family of $(C, p, q)$-close sets. When $p\leq q$, we also obtain some results regarding the uniqueness of solutions to the $L_p$ dual Minkowski problem for $C$-compatible sets.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Wellposedness of the Master Equation for Mean Field Games with Grushin Type Diffusion
Authors:
Yiming Jiang,
Yawei Wei,
Yiyun Yang
Abstract:
We study the wellposedness of the master equation for a second-order mean field games with the Grushin type diffusion. In order to do this, we obtain the properties of its solution by investigating a degenerate mean field games system for which there exists an equivalent characterization with the master equation. The crucial points of this paper are to explore some regularities of solutions to two…
▽ More
We study the wellposedness of the master equation for a second-order mean field games with the Grushin type diffusion. In order to do this, we obtain the properties of its solution by investigating a degenerate mean field games system for which there exists an equivalent characterization with the master equation. The crucial points of this paper are to explore some regularities of solutions to two types of linear degenerate partial differential equations and a kind of degenerate linear coupled system so as to derive the existence of solutions to the master equation.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
From Poisson Observations to Fitted Negative Binomial Distribution
Authors:
Yingying Yang,
Niloufar Dousti Mousavi,
Zhou Yu,
Jie Yang
Abstract:
The Kolmogorov-Smirnov (KS) test has been widely used for testing whether a random sample comes from a specific distribution, possibly with estimated parameters. If the data come from a Poisson distribution, however, one can hardly tell that they do not come from a negative binomial distribution by running a KS test, even with a large sample size. In this paper, we rigorously justify that the KS t…
▽ More
The Kolmogorov-Smirnov (KS) test has been widely used for testing whether a random sample comes from a specific distribution, possibly with estimated parameters. If the data come from a Poisson distribution, however, one can hardly tell that they do not come from a negative binomial distribution by running a KS test, even with a large sample size. In this paper, we rigorously justify that the KS test statistic converges to zero almost surely, as the sample size goes to infinity. To prove this result, we demonstrate a notable finding that in this case the maximum likelihood estimates (MLE) for the parameters of the negative binomial distribution converge to infinity and one, respectively and almost surely. Our result highlights a potential limitation of the KS test, as well as other tests based on empirical distribution functions (EDF), in efficiently identifying the true underlying distribution. Our findings and justifications also underscore the importance of careful interpretation and further investigation when identifying the most appropriate distributions in practice.
△ Less
Submitted 10 April, 2024;
originally announced April 2024.
-
On the robustness of double-word addition algorithms
Authors:
Yuanyuan Yang,
XinYu Lyu,
Sida He,
Xiliang Lu,
Ji Qi,
Zhihao Li
Abstract:
We demonstrate that, even when there are moderate overlaps in the inputs of sloppy or accurate double-word addition algorithms in the QD library, these algorithms still guarantee error bounds of $O(u^2(|a|+|b|))$ in faithful rounding. Furthermore, the accurate algorithm can achieve a relative error bound of $O(u^2)$ in the presence of moderate overlaps in the inputs when rounding function is round…
▽ More
We demonstrate that, even when there are moderate overlaps in the inputs of sloppy or accurate double-word addition algorithms in the QD library, these algorithms still guarantee error bounds of $O(u^2(|a|+|b|))$ in faithful rounding. Furthermore, the accurate algorithm can achieve a relative error bound of $O(u^2)$ in the presence of moderate overlaps in the inputs when rounding function is round-to-nearest. The relative error bound also holds in directed rounding, but certain additional conditions are required. Consequently, in double-word multiplication and addition operations, we can safely omit the normalization step of double-word multiplication and replace the accurate addition algorithm with the sloppy one. Numerical experiments confirm that this approach nearly doubles the performance of double-word multiplication and addition operations, with negligible precision costs. Moreover, in directed rounding mode, the signs of the errors of the two algorithms are consistent with the rounding direction, even in the presence of input overlap. This allows us to avoid changing the rounding mode in interval arithmetic. We also prove that the relative error bound of the sloppy addition algorithm exceeds $3u^2$ if and only if the input meets the condition of Sterbenz's Lemma when rounding to nearest. These findings suggest that the two addition algorithms are more robust than previously believed.
△ Less
Submitted 10 April, 2024; v1 submitted 8 April, 2024;
originally announced April 2024.
-
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace
Authors:
Bin Gao,
Yan Yang,
Ya-xiang Yuan
Abstract:
Bilevel optimization, with broad applications in machine learning, has an intricate hierarchical structure. Gradient-based methods have emerged as a common approach to large-scale bilevel problems. However, the computation of the hyper-gradient, which involves a Hessian inverse vector product, confines the efficiency and is regarded as a bottleneck. To circumvent the inverse, we construct a sequen…
▽ More
Bilevel optimization, with broad applications in machine learning, has an intricate hierarchical structure. Gradient-based methods have emerged as a common approach to large-scale bilevel problems. However, the computation of the hyper-gradient, which involves a Hessian inverse vector product, confines the efficiency and is regarded as a bottleneck. To circumvent the inverse, we construct a sequence of low-dimensional approximate Krylov subspaces with the aid of the Lanczos process. As a result, the constructed subspace is able to dynamically and incrementally approximate the Hessian inverse vector product with less effort and thus leads to a favorable estimate of the hyper-gradient. Moreover, we propose a~provable subspace-based framework for bilevel problems where one central step is to solve a small-size tridiagonal linear system. To the best of our knowledge, this is the first time that subspace techniques are incorporated into bilevel optimization. This successful trial not only enjoys $\mathcal{O}(ε^{-1})$ convergence rate but also demonstrates efficiency in a synthetic problem and two deep learning tasks.
△ Less
Submitted 4 April, 2024;
originally announced April 2024.
-
The Diffusive Ultrasound Modulated Bioluminescence Tomography with Partial Data and Uncertain Optical Parameters
Authors:
Tianyu Yang,
Yang Yang
Abstract:
The paper studies an imaging problem in the diffusive ultrasound-modulated bioluminescence tomography with partial boundary measurement in an anisotropic medium. Assuming plane-wave modulation, we transform the imaging problem to an inverse problem with internal data, and derive a reconstruction procedure to recover the bioluminescent source. Subsequently, an uncertainty quantification estimate is…
▽ More
The paper studies an imaging problem in the diffusive ultrasound-modulated bioluminescence tomography with partial boundary measurement in an anisotropic medium. Assuming plane-wave modulation, we transform the imaging problem to an inverse problem with internal data, and derive a reconstruction procedure to recover the bioluminescent source. Subsequently, an uncertainty quantification estimate is established to assess the robustness of the reconstruction. To facilitate practical implementation, we discretize the diffusive model using the staggered grid scheme, resulting in a discrete formulation of the UMBLT inverse problem. A discrete reconstruction procedure is then presented along with a discrete uncertainty quantification estimate. Finally, the reconstruction procedure is quantitatively validated through numerical examples to demonstrate the efficacy and reliability of the proposed approach and estimates.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
