-
Bernstein-Sato ideals
Authors:
Nero Budur,
Robin van der Veer,
Lei Wu,
Peng Zhou
Abstract:
In this paper, we review several results on the zero loci of Bernstein-Sato ideals related to singularities of hypersurfaces. This is an exposition for the Frontiers of Science Awards in Mathematics presenting results from one of our articles, with history, motivation, and further developments.
In this paper, we review several results on the zero loci of Bernstein-Sato ideals related to singularities of hypersurfaces. This is an exposition for the Frontiers of Science Awards in Mathematics presenting results from one of our articles, with history, motivation, and further developments.
△ Less
Submitted 24 August, 2024;
originally announced August 2024.
-
Periodic Trading Activities in Financial Markets: Mean-field Liquidation Game with Major-Minor Players
Authors:
Yufan Chen,
Lan Wu,
Renyuan Xu,
Ruixun Zhang
Abstract:
Motivated by recent empirical findings on the periodic phenomenon of aggregated market volumes in equity markets, we aim to understand the causes and consequences of periodic trading activities through a game-theoretic perspective, examining market interactions among different types of participants. Specifically, we introduce a new mean-field liquidation game involving major and minor traders, whe…
▽ More
Motivated by recent empirical findings on the periodic phenomenon of aggregated market volumes in equity markets, we aim to understand the causes and consequences of periodic trading activities through a game-theoretic perspective, examining market interactions among different types of participants. Specifically, we introduce a new mean-field liquidation game involving major and minor traders, where the major trader evaluates her strategy against a periodic targeting strategy while a continuum of minor players trade against her. We establish the existence and uniqueness of an open-loop Nash equilibrium. In addition, we prove an O(1/sqrt N) approximation rate of the mean-field solution to the Nash equilibrium in a major-minor game with N minor players. In equilibrium, minor traders exhibit front-running behaviors in both the periodic and trend components of their strategies, reducing the major trader's profit. Such strategic interactions diminish the strength of periodicity in both overall trading volume and asset prices. Our model rationalizes observed periodic trading activities in the market and offers new insights into market dynamics.
△ Less
Submitted 18 August, 2024;
originally announced August 2024.
-
A complementary result on a singular mean field equation with a sign-changing potential function
Authors:
Lina Wu
Abstract:
In this note, we study the singular mean field equation defined on a Riemann surface with a sign-changing potential function. We prove if some singular sources happen to be placed on the zero-level curve of the potential function, a priori estimate can still be obtained. As a consequence of this estimate, existence and multiplicity results can still be obtained based on the topology of the manifol…
▽ More
In this note, we study the singular mean field equation defined on a Riemann surface with a sign-changing potential function. We prove if some singular sources happen to be placed on the zero-level curve of the potential function, a priori estimate can still be obtained. As a consequence of this estimate, existence and multiplicity results can still be obtained based on the topology of the manifold.
△ Less
Submitted 31 July, 2024;
originally announced August 2024.
-
Global Well-Posedness of Contact Lines: 2D Navier-Stokes Flow
Authors:
Yan Guo,
Ian Tice,
Lei Wu,
Yunrui Zheng
Abstract:
Based on the global a priori estimates in [Guo-Tice, J. Eur. Math. Soc. (2024)], we establish the well-posedness of a viscous fluid model satisfying the dynamic law for the contact line \begin{equation*} \mathscr{W}(\p_tζ(\pm\ell,t))=[\![γ]\!]\mpσ\frac{\p_1ζ}{(1+|\p_1ζ|^2)^{1/2}}(\pm\ell,t) \end{equation*} in 2D domain, where $ζ(x_1,t)$ is a free surface with two contact points $ζ(\pm\ell,t)$,…
▽ More
Based on the global a priori estimates in [Guo-Tice, J. Eur. Math. Soc. (2024)], we establish the well-posedness of a viscous fluid model satisfying the dynamic law for the contact line \begin{equation*} \mathscr{W}(\p_tζ(\pm\ell,t))=[\![γ]\!]\mpσ\frac{\p_1ζ}{(1+|\p_1ζ|^2)^{1/2}}(\pm\ell,t) \end{equation*} in 2D domain, where $ζ(x_1,t)$ is a free surface with two contact points $ζ(\pm\ell,t)$, $[\![γ]\!]$ and $σ$ are constants characterizing the solid-fluid-gas free energy, and the increasing $\mathscr{W}$ is the contact point velocity response function. Motivated by the energy-dissipation structure, our construction relies on the construction of a pressureless weak solution for the coupled velocity and free interface for the linearized problems, via a Galerkin approximation with a time-dependent basis and an artificial regularization for the capillary operator.
△ Less
Submitted 30 July, 2024; v1 submitted 25 July, 2024;
originally announced July 2024.
-
Global dynamics for the generalized chemotaxis-Navier-Stokes system in $\mathbb{R}^3$
Authors:
Qingyou He,
Ling-Yun Shou,
Leyun Wu
Abstract:
We consider the chemotaxis-Navier-Stokes system with generalized fluid dissipation in $\mathbb{R}^3$:
\begin{eqnarray*}
\begin{cases} \partial_t n+u\cdot \nabla n=Δn- \nabla \cdot (χ(c)n \nabla c),\\ \partial_t c+u \cdot \nabla c=Δc-nf(c),\\ \partial_t u +u \cdot \nabla u+\nabla P=-(-Δ)^αu-n\nabla φ,\\ \nabla \cdot u=0,
\end{cases} \end{eqnarray*} which describes the motion of swimming bacte…
▽ More
We consider the chemotaxis-Navier-Stokes system with generalized fluid dissipation in $\mathbb{R}^3$:
\begin{eqnarray*}
\begin{cases} \partial_t n+u\cdot \nabla n=Δn- \nabla \cdot (χ(c)n \nabla c),\\ \partial_t c+u \cdot \nabla c=Δc-nf(c),\\ \partial_t u +u \cdot \nabla u+\nabla P=-(-Δ)^αu-n\nabla φ,\\ \nabla \cdot u=0,
\end{cases} \end{eqnarray*} which describes the motion of swimming bacteria or bacillus subtilis suspended to water flows. First, we prove some blow-up criteria of strong solutions to the Cauchy problem, including the Prodi-Serrin type criterion ($α>\frac{3}{4}$) and the Beir${\rm\tilde{a}}$o da Veiga type criterion $(α>\frac{1}{2})$. Then, we verify the global existence and uniqueness of strong solutions for arbitrarily large initial fluid velocity and bacteria density for $α\geq \frac{5}{4}$. Furthermore, in the scenario of $\frac{3}{4}<α<\frac{5}{4}$, we establish uniform regularity estimates and optimal time-decay rates of global solutions if the $L^2$-norm of initial data is small. To our knowledge, this is the first result concerning the global existence and large-time behavior of strong solutions for the chemotaxis-Navier-Stokes equations with possibly large oscillations.
△ Less
Submitted 7 August, 2024; v1 submitted 5 July, 2024;
originally announced July 2024.
-
Improving Generalization and Convergence by Enhancing Implicit Regularization
Authors:
Mingze Wang,
Jinbo Wang,
Haotian He,
Zilin Wang,
Guanhua Huang,
Feiyu Xiong,
Zhiyu Li,
Weinan E,
Lei Wu
Abstract:
In this work, we propose an Implicit Regularization Enhancement (IRE) framework to accelerate the discovery of flat solutions in deep learning, thereby improving generalization and convergence. Specifically, IRE decouples the dynamics of flat and sharp directions, which boosts the sharpness reduction along flat directions while maintaining the training stability in sharp directions. We show that I…
▽ More
In this work, we propose an Implicit Regularization Enhancement (IRE) framework to accelerate the discovery of flat solutions in deep learning, thereby improving generalization and convergence. Specifically, IRE decouples the dynamics of flat and sharp directions, which boosts the sharpness reduction along flat directions while maintaining the training stability in sharp directions. We show that IRE can be practically incorporated with {\em generic base optimizers} without introducing significant computational overload. Experiments show that IRE consistently improves the generalization performance for image classification tasks across a variety of benchmark datasets (CIFAR-10/100, ImageNet) and models (ResNets and ViTs). Surprisingly, IRE also achieves a $2\times$ {\em speed-up} compared to AdamW in the pre-training of Llama models (of sizes ranging from 60M to 229M) on datasets including Wikitext-103, Minipile, and Openwebtext. Moreover, we provide theoretical guarantees, showing that IRE can substantially accelerate the convergence towards flat minima in Sharpness-aware Minimization (SAM).
△ Less
Submitted 20 August, 2024; v1 submitted 31 May, 2024;
originally announced May 2024.
-
Global-in-time maximal regularity for the Cauchy problem of the heat equation in BMO and applications
Authors:
Xuan Thinh Duong,
Ji Li,
Liangchuan Wu,
Lixin Yan
Abstract:
In this article, we establish global-in-time maximal regularity for the Cauchy problem of the classical heat equation $\partial_t u(x,t)-Δu(x,t)=f(x,t)$ with $u(x,0)=0$ in a certain $\rm BMO$ setting, which improves the local-in-time result initially proposed by Ogawa and Shimizu in \cite{OS, OS2}. In further developing our method originally formulated for the heat equation, we obtain analogous gl…
▽ More
In this article, we establish global-in-time maximal regularity for the Cauchy problem of the classical heat equation $\partial_t u(x,t)-Δu(x,t)=f(x,t)$ with $u(x,0)=0$ in a certain $\rm BMO$ setting, which improves the local-in-time result initially proposed by Ogawa and Shimizu in \cite{OS, OS2}. In further developing our method originally formulated for the heat equation, we obtain analogous global ${\rm BMO}$-maximal regularity associated to the Schrödinger operator $\mathcal L=-Δ+V$, where the nonnegative potential $V$ belongs to the reverse Hölder class ${\rm RH}_q$ for some $q> n/2$. This extension includes several inhomogeneous estimates as ingredients, such as Carleson-type estimates for the external forces.
Our new methodology is to exploit elaborate heat kernel estimates, along with matched space-time decomposition on the involving integral-type structure of maximal operators, as well as some global techniques such as those from de Simon's work and Schur's lemma. One crucial trick is to utilize the mean oscillation therein to contribute a higher and necessary decay order for global-in-time estimates.
△ Less
Submitted 2 May, 2024;
originally announced May 2024.
-
The modified Korteweg--de Vries limit of the Ablowitz--Ladik system
Authors:
Rowan Killip,
Zhimeng Ouyang,
Monica Visan,
Lei Wu
Abstract:
For slowly-varying initial data, solutions to the Ablowitz-Ladik system have been proven to converge to solutions of the cubic Schrödinger equation. In this paper we show that in the continuum limit, solutions to the Ablowitz-Ladik system with $H^1$ initial data may also converge to solutions of the modified Korteweg--de Vries equation. To exhibit this new limiting behavior, it suffices that the i…
▽ More
For slowly-varying initial data, solutions to the Ablowitz-Ladik system have been proven to converge to solutions of the cubic Schrödinger equation. In this paper we show that in the continuum limit, solutions to the Ablowitz-Ladik system with $H^1$ initial data may also converge to solutions of the modified Korteweg--de Vries equation. To exhibit this new limiting behavior, it suffices that the initial data is supported near the inflection points of the dispersion relation associated with the Ablowitz-Ladik system.
Our arguments employ harmonic analysis tools, Strichartz estimates, and the conservation of mass and energy. Correspondingly, they are applicable beyond the completely integrable models of greatest interest to us.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
Communication Efficient Distributed Training with Distributed Lion
Authors:
Bo Liu,
Lemeng Wu,
Lizhang Chen,
Kaizhao Liang,
Jiaxu Zhu,
Chen Liang,
Raghuraman Krishnamoorthi,
Qiang Liu
Abstract:
The Lion optimizer has been a promising competitor with the AdamW for training large AI models, with advantages on memory, computation, and sample efficiency. In this paper, we introduce Distributed Lion, an innovative adaptation of Lion for distributed training environments. Leveraging the sign operator in Lion, our Distributed Lion only requires communicating binary or lower-precision vectors be…
▽ More
The Lion optimizer has been a promising competitor with the AdamW for training large AI models, with advantages on memory, computation, and sample efficiency. In this paper, we introduce Distributed Lion, an innovative adaptation of Lion for distributed training environments. Leveraging the sign operator in Lion, our Distributed Lion only requires communicating binary or lower-precision vectors between workers to the center server, significantly reducing the communication cost. Our theoretical analysis confirms Distributed Lion's convergence properties. Empirical results demonstrate its robustness across a range of tasks, worker counts, and batch sizes, on both vision and language problems. Notably, Distributed Lion attains comparable performance to standard Lion or AdamW optimizers applied on aggregated gradients, but with significantly reduced communication bandwidth. This feature is particularly advantageous for training large models. In addition, we also demonstrate that Distributed Lion presents a more favorable performance-bandwidth balance compared to existing efficient distributed methods such as deep gradient compression and ternary gradients.
△ Less
Submitted 30 March, 2024;
originally announced April 2024.
-
Schatten classes and commutators in the two weight setting, II. Riesz transforms
Authors:
Michael Lacey,
Ji Li,
Brett D. Wick,
Liangchuan Wu
Abstract:
We characterize the Schatten class $S^p$ of the commutator of Riesz transforms $[b,R_j]$ in $\mathbb R^n$ ($j=1,\ldots, n$) in the two weight setting for $n< p<\infty$, by introducing the condition that the symbol $b$ being in Besov spaces associated with the given two weights. At the critical index $p=n$, the commutator $[b,R_j]$ belongs to Schatten class $S^{n}$ if and only if $b$ is a constant,…
▽ More
We characterize the Schatten class $S^p$ of the commutator of Riesz transforms $[b,R_j]$ in $\mathbb R^n$ ($j=1,\ldots, n$) in the two weight setting for $n< p<\infty$, by introducing the condition that the symbol $b$ being in Besov spaces associated with the given two weights. At the critical index $p=n$, the commutator $[b,R_j]$ belongs to Schatten class $S^{n}$ if and only if $b$ is a constant, and to the weak Schatten class $S^{n,\infty}$ if and only if $b$ is in an oscillation sequence space associated with the given two weights. As a direct application, we have the Schatten class estimate for A. Connes' quantised derivative in the two weight setting.
△ Less
Submitted 7 April, 2024; v1 submitted 30 March, 2024;
originally announced April 2024.
-
A Parallel Vector-form $LDL^\top$ Decomposition for Accelerating Execution-time-certified $\ell_1$-penalty Soft-constrained MPC
Authors:
Liang Wu,
Liwei Zhou,
Richard D. Braatz
Abstract:
Handling possible infeasibility and providing an execution time certificate are two pressing requirements of real-time Model Predictive Control (MPC). To meet these two requirements simultaneously, this paper proposes an $\ell_1$-penalty soft-constrained MPC formulation that is globally feasible and solvable with an execution time certificate using our proposed algorithm. This paper proves for the…
▽ More
Handling possible infeasibility and providing an execution time certificate are two pressing requirements of real-time Model Predictive Control (MPC). To meet these two requirements simultaneously, this paper proposes an $\ell_1$-penalty soft-constrained MPC formulation that is globally feasible and solvable with an execution time certificate using our proposed algorithm. This paper proves for the first time that $\ell_1$-penalty soft-constrained MPC problems can be equivalently transformed into a box-constrained quadratic programming (Box-QP) and then our previous execution-time-certified algorithm \cite{wu2023direct} (only limited to Box-QP) can be applied. However, our previous Box-QP algorithm \cite{wu2023direct}, which provides a theoretical execution-time certificate, is conservative in its iteration analysis, thus sacrificing computation efficiency. To this end, this paper proposes a novel $LDL^\top$ decomposition for the first time, to accelerate the computation of Newton step at each iteration. The speedup of our $LDL^\top$ decomposition comes from two-fold: \textit{i)} exploitation of the fact that the number of inequality constraints is generally larger than the number of variables in condensed MPC formulations, \textit{ii)} vectorized and parallel implementation based on based on its vector-wise operations, instead of element-wise operations of previous decomposition methods. Numerical experiments demonstrate great speedups of the proposed $LDL^\top$ decomposition (even up to 1000-fold, compared to the standard Choleksky method), which thus helps our solver achieve comparable computation performance to the state-of-the-art solvers such as IPOPT and OSQP. Code is available at \url{https://github.com/liangwu2019/L1-penalty-QP}.
△ Less
Submitted 8 August, 2024; v1 submitted 26 March, 2024;
originally announced March 2024.
-
Generalized Langevin and Nos{é}-Hoover processes absorbed at the boundary of a metastable domain
Authors:
Arnaud Guillin,
D I Lu,
Boris Nectoux,
Liming Wu
Abstract:
In this paper, we prove in a very weak regularity setting existence and uniqueness of quasi-stationary distributions as well as exponential convergence towards the quasi-stationary distribution for the generalized Langevin and the Nos{é}-Hoover processes, two processes which are widely used in molecular dynamics. The case of singular potentials is considered. With the techniques used in this work,…
▽ More
In this paper, we prove in a very weak regularity setting existence and uniqueness of quasi-stationary distributions as well as exponential convergence towards the quasi-stationary distribution for the generalized Langevin and the Nos{é}-Hoover processes, two processes which are widely used in molecular dynamics. The case of singular potentials is considered. With the techniques used in this work, we are also able to greatly improve existing results on quasi-stationary distributions for the kinetic Langevin process to a weak regularity setting.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Loss Symmetry and Noise Equilibrium of Stochastic Gradient Descent
Authors:
Liu Ziyin,
Mingze Wang,
Hongchao Li,
Lei Wu
Abstract:
Symmetries exist abundantly in the loss function of neural networks. We characterize the learning dynamics of stochastic gradient descent (SGD) when exponential symmetries, a broad subclass of continuous symmetries, exist in the loss function. We establish that when gradient noises do not balance, SGD has the tendency to move the model parameters toward a point where noises from different directio…
▽ More
Symmetries exist abundantly in the loss function of neural networks. We characterize the learning dynamics of stochastic gradient descent (SGD) when exponential symmetries, a broad subclass of continuous symmetries, exist in the loss function. We establish that when gradient noises do not balance, SGD has the tendency to move the model parameters toward a point where noises from different directions are balanced. Here, a special type of fixed point in the constant directions of the loss function emerges as a candidate for solutions for SGD. As the main theoretical result, we prove that every parameter $θ$ connects without loss function barrier to a unique noise-balanced fixed point $θ^*$. The theory implies that the balancing of gradient noise can serve as a novel alternative mechanism for relevant phenomena such as progressive sharpening and flattening and can be applied to understand common practical problems such as representation normalization, matrix factorization, warmup, and formation of latent representations.
△ Less
Submitted 3 June, 2024; v1 submitted 11 February, 2024;
originally announced February 2024.
-
Time-certified Input-constrained NMPC via Koopman Operator
Authors:
Liang Wu,
Krystian Ganko,
Richard D. Braatz
Abstract:
Determining solving-time certificates of nonlinear model predictive control (NMPC) implementations is a pressing requirement when deploying NMPC in production environments. Such a certificate guarantees that the NMPC controller returns a solution before the next sampling time. However, NMPC formulations produce nonlinear programs (NLPs) for which it is very difficult to derive their solving-time c…
▽ More
Determining solving-time certificates of nonlinear model predictive control (NMPC) implementations is a pressing requirement when deploying NMPC in production environments. Such a certificate guarantees that the NMPC controller returns a solution before the next sampling time. However, NMPC formulations produce nonlinear programs (NLPs) for which it is very difficult to derive their solving-time certificates. Our previous work, Wu and Braatz (2023), challenged this limitation with a proposed input-constrained MPC algorithm having exact iteration complexity but was restricted to linear MPC formulations. This work extends the algorithm to solve input-constrained NMPC problems, by using the Koopman operator and a condensing MPC technique. We illustrate the algorithm performance on a high-dimensional, nonlinear partial differential equation (PDE) control case study, in which we theoretically and numerically certify the solving time to be less than the sampling time.
△ Less
Submitted 26 February, 2024; v1 submitted 9 January, 2024;
originally announced January 2024.
-
The Local Landscape of Phase Retrieval Under Limited Samples
Authors:
Kaizhao Liu,
Zihao Wang,
Lei Wu
Abstract:
In this paper, we provide a fine-grained analysis of the local landscape of phase retrieval under the regime with limited samples. Our aim is to ascertain the minimal sample size necessary to guarantee a benign local landscape surrounding global minima in high dimensions. Let $n$ and $d$ denote the sample size and input dimension, respectively. We first explore the local convexity and establish th…
▽ More
In this paper, we provide a fine-grained analysis of the local landscape of phase retrieval under the regime with limited samples. Our aim is to ascertain the minimal sample size necessary to guarantee a benign local landscape surrounding global minima in high dimensions. Let $n$ and $d$ denote the sample size and input dimension, respectively. We first explore the local convexity and establish that when $n=o(d\log d)$, for almost every fixed point in the local ball, the Hessian matrix must have negative eigenvalues as long as $d$ is sufficiently large. Consequently, the local landscape is highly non-convex. We next consider the one-point strong convexity and show that as long as $n=ω(d)$, with high probability, the landscape is one-point strongly convex in the local annulus: $\{w\in\mathbb{R}^d: o_d(1)\leqslant \|w-w^*\|\leqslant c\}$, where $w^*$ is the ground truth and $c$ is an absolute constant. This implies that gradient descent initialized from any point in this domain can converge to an $o_d(1)$-loss solution exponentially fast. Furthermore, we show that when $n=o(d\log d)$, there is a radius of $\widetildeΘ\left(\sqrt{1/d}\right)$ such that one-point convexity breaks in the corresponding smaller local ball. This indicates an impossibility to establish a convergence to exact $w^*$ for gradient descent under limited samples by relying solely on one-point convexity.
△ Less
Submitted 26 November, 2023;
originally announced November 2023.
-
Achieving Margin Maximization Exponentially Fast via Progressive Norm Rescaling
Authors:
Mingze Wang,
Zeping Min,
Lei Wu
Abstract:
In this work, we investigate the margin-maximization bias exhibited by gradient-based algorithms in classifying linearly separable data. We present an in-depth analysis of the specific properties of the velocity field associated with (normalized) gradients, focusing on their role in margin maximization. Inspired by this analysis, we propose a novel algorithm called Progressive Rescaling Gradient D…
▽ More
In this work, we investigate the margin-maximization bias exhibited by gradient-based algorithms in classifying linearly separable data. We present an in-depth analysis of the specific properties of the velocity field associated with (normalized) gradients, focusing on their role in margin maximization. Inspired by this analysis, we propose a novel algorithm called Progressive Rescaling Gradient Descent (PRGD) and show that PRGD can maximize the margin at an {\em exponential rate}. This stands in stark contrast to all existing algorithms, which maximize the margin at a slow {\em polynomial rate}. Specifically, we identify mild conditions on data distribution under which existing algorithms such as gradient descent (GD) and normalized gradient descent (NGD) {\em provably fail} in maximizing the margin efficiently. To validate our theoretical findings, we present both synthetic and real-world experiments. Notably, PRGD also shows promise in enhancing the generalization performance when applied to linearly non-separable datasets and deep neural networks.
△ Less
Submitted 28 January, 2024; v1 submitted 24 November, 2023;
originally announced November 2023.
-
PFA and the definability of the nonstationary ideal
Authors:
Stefan Hoffelner,
Paul Larson,
Ralf Schindler,
Liuzhen Wu
Abstract:
We produce, relative to a ${\sf ZFC}$ model with a supercompact cardinal, a ${\sf ZFC}$ model of the Proper Forcing Axiom in which the nonstationary ideal on $ω_1$ is $Π_1$-definable in a parameter from $H_{\aleph_2}$.
We produce, relative to a ${\sf ZFC}$ model with a supercompact cardinal, a ${\sf ZFC}$ model of the Proper Forcing Axiom in which the nonstationary ideal on $ω_1$ is $Π_1$-definable in a parameter from $H_{\aleph_2}$.
△ Less
Submitted 20 October, 2023;
originally announced October 2023.
-
A new class of partial orders
Authors:
Huihui Zhu,
Liyun Wu
Abstract:
Let $R$ be a unital $*$-ring. For any $a,w,b\in R$, we apply the defined $w$-core inverse to define a new class of partial orders in $R$, called the $w$-core partial order. Suppose $a,b\in R$ are $w$-core invertible. We say that $a$ is below $b$ under the $w$-core partial order, denoted by $a\overset{\tiny{\textcircled{\#}}}\leq_w b$, if…
▽ More
Let $R$ be a unital $*$-ring. For any $a,w,b\in R$, we apply the defined $w$-core inverse to define a new class of partial orders in $R$, called the $w$-core partial order. Suppose $a,b\in R$ are $w$-core invertible. We say that $a$ is below $b$ under the $w$-core partial order, denoted by $a\overset{\tiny{\textcircled{\#}}}\leq_w b$, if $a_w^{\tiny{\textcircled{\#}}} a=a_w^{\tiny{\textcircled{\#}}} b$ and $awa_w^{\tiny{\textcircled{\#}}} =bwa_w^{\tiny{\textcircled{\#}}}$, where $a_w^{\tiny{\textcircled{\#}}}$ denotes the $w$-core inverse of $a$. Characterizations of the $w$-core partial order are given. Also, the relationships with several types of partial orders are considered. In particular, we show that the core partial order coincides with the $a$-core partial order, and the star partial order coincides with the $a^*$-core partial order.
△ Less
Submitted 24 September, 2023;
originally announced September 2023.
-
Learning Risk Preferences in Markov Decision Processes: an Application to the Fourth Down Decision in the National Football League
Authors:
Nathan Sandholtz,
Lucas Wu,
Martin Puterman,
Timothy C. Y. Chan
Abstract:
For decades, National Football League (NFL) coaches' observed fourth down decisions have been largely inconsistent with prescriptions based on statistical models. In this paper, we develop a framework to explain this discrepancy using an inverse optimization approach. We model the fourth down decision and the subsequent sequence of plays in a game as a Markov decision process (MDP), the dynamics o…
▽ More
For decades, National Football League (NFL) coaches' observed fourth down decisions have been largely inconsistent with prescriptions based on statistical models. In this paper, we develop a framework to explain this discrepancy using an inverse optimization approach. We model the fourth down decision and the subsequent sequence of plays in a game as a Markov decision process (MDP), the dynamics of which we estimate from NFL play-by-play data from the 2014 through 2022 seasons. We assume that coaches' observed decisions are optimal but that the risk preferences governing their decisions are unknown. This yields an inverse decision problem for which the optimality criterion, or risk measure, of the MDP is the estimand. Using the quantile function to parameterize risk, we estimate which quantile-optimal policy yields the coaches' observed decisions as minimally suboptimal. In general, we find that coaches' fourth-down behavior is consistent with optimizing low quantiles of the next-state value distribution, which corresponds to conservative risk preferences. We also find that coaches exhibit higher risk tolerances when making decisions in the opponent's half of the field as opposed to their own half, and that league average fourth down risk tolerances have increased over time.
△ Less
Submitted 15 August, 2024; v1 submitted 1 September, 2023;
originally announced September 2023.
-
Finding the spectral radius of a nonnegative irreducible symmetric tensor via DC programming
Authors:
Xueli Bai,
Dong-Hui Li,
Lei Wu,
Jiefeng Xu
Abstract:
The Perron-Frobenius theorem says that the spectral radius of an irreducible nonnegative tensor is the unique positive eigenvalue corresponding to a positive eigenvector. With this in mind, the purpose of this paper is to find the spectral radius and its corresponding positive eigenvector of an irreducible nonnegative symmetric tensor. By transferring the eigenvalue problem into an equivalent prob…
▽ More
The Perron-Frobenius theorem says that the spectral radius of an irreducible nonnegative tensor is the unique positive eigenvalue corresponding to a positive eigenvector. With this in mind, the purpose of this paper is to find the spectral radius and its corresponding positive eigenvector of an irreducible nonnegative symmetric tensor. By transferring the eigenvalue problem into an equivalent problem of minimizing a concave function on a closed convex set, which is typically a DC (difference of convex functions) programming, we derive a simpler and cheaper iterative method. The proposed method is well-defined. Furthermore, we show that both sequences of the eigenvalue estimates and the eigenvector evaluations generated by the method $Q$-linearly converge to the spectral radius and its corresponding eigenvector, respectively. To accelerate the method, we introduce a line search technique. The improved method retains the same convergence property as the original version. Preliminary numerical results show that the improved method performs quite well.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
A direct approach to sharp Li-Yau Estimates on closed manifolds with negative Ricci lower bound
Authors:
Xingyu Song,
Ling Wu,
Meng Zhu
Abstract:
Recently, Qi S.Zhang [26] has derived a sharp Li-Yau estimate for positive solutions of the heat equation on closed Riemannian manifolds with the Ricci curvature bounded below by a negative constant. The proof is based on an integral iteration argument which utilizes Hamilton's gradient estimate, heat kernel Gaussian bounds and parabolic Harnack inequality.
In this paper, we show that the sharp…
▽ More
Recently, Qi S.Zhang [26] has derived a sharp Li-Yau estimate for positive solutions of the heat equation on closed Riemannian manifolds with the Ricci curvature bounded below by a negative constant. The proof is based on an integral iteration argument which utilizes Hamilton's gradient estimate, heat kernel Gaussian bounds and parabolic Harnack inequality.
In this paper, we show that the sharp Li-Yau estimate can actually be obtained directly following the classical maximum principle argument, which simplifies the proof in [26]. In addition, we apply the same idea to the heat and conjugate heat equations under the Ricci flow and prove some Li-Yau type estimates with optimal coefficients.
△ Less
Submitted 24 August, 2023; v1 submitted 7 July, 2023;
originally announced July 2023.
-
A direct optimization algorithm for input-constrained MPC
Authors:
Liang Wu,
Richard D. Braatz
Abstract:
Providing an execution time certificate is a pressing requirement when deploying Model Predictive Control (MPC) in real-time embedded systems such as microcontrollers. Real-time MPC requires that its worst-case (maximum) execution time must be theoretically guaranteed to be smaller than the sampling time in closed-loop. This technical note considers input-constrained MPC problems and exploits the…
▽ More
Providing an execution time certificate is a pressing requirement when deploying Model Predictive Control (MPC) in real-time embedded systems such as microcontrollers. Real-time MPC requires that its worst-case (maximum) execution time must be theoretically guaranteed to be smaller than the sampling time in closed-loop. This technical note considers input-constrained MPC problems and exploits the structure of the resulting box-constrained QPs. Then, we propose a \textit{cost-free} and \textit{data-independent} initialization strategy, which enables us, for the first time, to remove the initialization assumption of feasible full-Newton interior-point algorithms. We prove that the number of iterations of our proposed algorithm is \textit{only dimension-dependent} (\textit{data-independent}), \textit{simple-calculated}, and \textit{exact} (not \textit{worst-case}) with the value $\left\lceil\frac{\log(\frac{2n}ε)}{-2\log(\frac{\sqrt{2n}}{\sqrt{2n}+\sqrt{2}-1})}\right\rceil \!+ 1$, where $n$ denotes the problem dimension and $ε$ denotes the constant stopping tolerance. These features enable our algorithm to trivially certify the execution time of nonlinear MPC (via online linearized schemes) or adaptive MPC problems. The execution-time-certified capability of our algorithm is theoretically and numerically validated through an open-loop unstable AFTI-16 example.
△ Less
Submitted 30 March, 2024; v1 submitted 26 June, 2023;
originally announced June 2023.
-
Heat kernel estimate for the Laplace-Beltrami operator under Bakry-Émery Ricci curvature condition and applications
Authors:
Xingyu Song,
Ling Wu,
Meng Zhu
Abstract:
We establish a Gaussian upper bound of the heat kernel for the Laplace-Beltrami operator on complete Riemannian manifolds with Bakry-Émery Ricci curvature bounded below. As applications, we first prove an L^1-Liouville property for non-negative subharmonic functions when the potential function of the Bakry-Émery Ricci curvature tensor is of at most quadratic growth. Then we derive lower bounds of…
▽ More
We establish a Gaussian upper bound of the heat kernel for the Laplace-Beltrami operator on complete Riemannian manifolds with Bakry-Émery Ricci curvature bounded below. As applications, we first prove an L^1-Liouville property for non-negative subharmonic functions when the potential function of the Bakry-Émery Ricci curvature tensor is of at most quadratic growth. Then we derive lower bounds of the eigenvalues of the Laplace-Beltrami operator on closed manifolds. An upper bound of the bottom spectrum is also obtained.
△ Less
Submitted 26 June, 2023; v1 submitted 22 June, 2023;
originally announced June 2023.
-
Learning Unnormalized Statistical Models via Compositional Optimization
Authors:
Wei Jiang,
Jiayu Qin,
Lingyu Wu,
Changyou Chen,
Tianbao Yang,
Lijun Zhang
Abstract:
Learning unnormalized statistical models (e.g., energy-based models) is computationally challenging due to the complexity of handling the partition function. To eschew this complexity, noise-contrastive estimation~(NCE) has been proposed by formulating the objective as the logistic loss of the real data and the artificial noise. However, as found in previous works, NCE may perform poorly in many t…
▽ More
Learning unnormalized statistical models (e.g., energy-based models) is computationally challenging due to the complexity of handling the partition function. To eschew this complexity, noise-contrastive estimation~(NCE) has been proposed by formulating the objective as the logistic loss of the real data and the artificial noise. However, as found in previous works, NCE may perform poorly in many tasks due to its flat loss landscape and slow convergence. In this paper, we study it a direct approach for optimizing the negative log-likelihood of unnormalized models from the perspective of compositional optimization. To tackle the partition function, a noise distribution is introduced such that the log partition function can be written as a compositional function whose inner function can be estimated with stochastic samples. Hence, the objective can be optimized by stochastic compositional optimization algorithms. Despite being a simple method, we demonstrate that it is more favorable than NCE by (1) establishing a fast convergence rate and quantifying its dependence on the noise distribution through the variance of stochastic estimators; (2) developing better results for one-dimensional Gaussian mean estimation by showing our objective has a much favorable loss landscape and hence our method enjoys faster convergence; (3) demonstrating better performance on multiple applications, including density estimation, out-of-distribution detection, and real image generation.
△ Less
Submitted 12 June, 2023;
originally announced June 2023.
-
The $L^\infty$ Learnability of Reproducing Kernel Hilbert Spaces
Authors:
Hongrui Chen,
Jihao Long,
Lei Wu
Abstract:
In this work, we analyze the learnability of reproducing kernel Hilbert spaces (RKHS) under the $L^\infty$ norm, which is critical for understanding the performance of kernel methods and random feature models in safety- and security-critical applications. Specifically, we relate the $L^\infty$ learnability of a RKHS to the spectrum decay of the associate kernel and both lower bounds and upper boun…
▽ More
In this work, we analyze the learnability of reproducing kernel Hilbert spaces (RKHS) under the $L^\infty$ norm, which is critical for understanding the performance of kernel methods and random feature models in safety- and security-critical applications. Specifically, we relate the $L^\infty$ learnability of a RKHS to the spectrum decay of the associate kernel and both lower bounds and upper bounds of the sample complexity are established. In particular, for dot-product kernels on the sphere, we identify conditions when the $L^\infty$ learning can be achieved with polynomial samples. Let $d$ denote the input dimension and assume the kernel spectrum roughly decays as $λ_k\sim k^{-1-β}$ with $β>0$. We prove that if $β$ is independent of the input dimension $d$, then functions in the RKHS can be learned efficiently under the $L^\infty$ norm, i.e., the sample complexity depends polynomially on $d$. In contrast, if $β=1/\mathrm{poly}(d)$, then the $L^\infty$ learning requires exponentially many samples.
△ Less
Submitted 5 June, 2023;
originally announced June 2023.
-
On an additive problem involving fractional powers with one prime and an almost prime variables
Authors:
Liuying Wu
Abstract:
For any real number $t$, let $[t]$ denote the integer part of $t$. In this paper it is proved that if $1<c<\frac{247}{238}$, then for sufficiently large integer $N$, the equation \[\left[p^{c}\right]+\left[m^{c}\right]=N\] has a solution in a prime $p$ and an almost prime $m$ with at most $\left[\frac{450}{247-238c}\right]+1$ prime factors. This result constitutes an improvement upon that of Petro…
▽ More
For any real number $t$, let $[t]$ denote the integer part of $t$. In this paper it is proved that if $1<c<\frac{247}{238}$, then for sufficiently large integer $N$, the equation \[\left[p^{c}\right]+\left[m^{c}\right]=N\] has a solution in a prime $p$ and an almost prime $m$ with at most $\left[\frac{450}{247-238c}\right]+1$ prime factors. This result constitutes an improvement upon that of Petrov and Tolev.
△ Less
Submitted 6 June, 2023; v1 submitted 2 June, 2023;
originally announced June 2023.
-
Embedding Inequalities for Barron-type Spaces
Authors:
Lei Wu
Abstract:
An important problem in machine learning theory is to understand the approximation and generalization properties of two-layer neural networks in high dimensions. To this end, researchers have introduced the Barron space $\mathcal{B}_s(Ω)$ and the spectral Barron space $\mathcal{F}_s(Ω)$, where the index $s\in [0,\infty)$ indicates the smoothness of functions within these spaces and…
▽ More
An important problem in machine learning theory is to understand the approximation and generalization properties of two-layer neural networks in high dimensions. To this end, researchers have introduced the Barron space $\mathcal{B}_s(Ω)$ and the spectral Barron space $\mathcal{F}_s(Ω)$, where the index $s\in [0,\infty)$ indicates the smoothness of functions within these spaces and $Ω\subset\mathbb{R}^d$ denotes the input domain. However, the precise relationship between the two types of Barron spaces remains unclear. In this paper, we establish a continuous embedding between them as implied by the following inequality: for any $δ\in (0,1), s\in \mathbb{N}^{+}$ and $f: Ω\mapsto\mathbb{R}$, it holds that \[ δ\|f\|_{\mathcal{F}_{s-δ}(Ω)}\lesssim_s \|f\|_{\mathcal{B}_s(Ω)}\lesssim_s \|f\|_{\mathcal{F}_{s+1}(Ω)}. \]
Importantly, the constants do not depend on the input dimension $d$, suggesting that the embedding is effective in high dimensions. Moreover, we also show that the lower and upper bound are both tight.
△ Less
Submitted 27 December, 2023; v1 submitted 30 May, 2023;
originally announced May 2023.
-
Global solvability and stability of an alarm-taxis system
Authors:
Hai-Yang Jin,
Zhi-An Wang,
Leyun Wu
Abstract:
This paper is concerned with the global boundedness and stability of classical solutions to an alarm-taxis system describing the burglar alarm hypothesis as an important mechanism of anti-predation behavior when species are threaten by predators. Compared to the existing prey-taxis systems, the alarm-taxis system has more complicated coupling structure and additionally requires the gradient estima…
▽ More
This paper is concerned with the global boundedness and stability of classical solutions to an alarm-taxis system describing the burglar alarm hypothesis as an important mechanism of anti-predation behavior when species are threaten by predators. Compared to the existing prey-taxis systems, the alarm-taxis system has more complicated coupling structure and additionally requires the gradient estimate of the primary predator density to attain the global boundedness of solutions. By the sophisticated coupling energy estimates based on the Neumann semigroup smoothing properties, we establish the existence of globally bounded solutions in two dimensions with Neumann boundary conditions and furthermore prove the global stability of co-existence homogeneous steady states under certain conditions on the system parameters.
△ Less
Submitted 27 May, 2023;
originally announced May 2023.
-
Simple blow-up solutions of singular Liouville equations
Authors:
Lina Wu
Abstract:
In a recent series of important works \cite{wei-zhang-1,wei-zhang-2,wei-zhang-3}, Wei-Zhang proved several vanishing theorems for non-simple blow-up solutions of singular Liouville equations. It is well known that a non-simple blow-up situation happens when the spherical Harnack inequality is violated near a quantized singular source. In this article, we further strengthen the conclusions of Wei-Z…
▽ More
In a recent series of important works \cite{wei-zhang-1,wei-zhang-2,wei-zhang-3}, Wei-Zhang proved several vanishing theorems for non-simple blow-up solutions of singular Liouville equations. It is well known that a non-simple blow-up situation happens when the spherical Harnack inequality is violated near a quantized singular source. In this article, we further strengthen the conclusions of Wei-Zhang by proving that if the spherical Harnack inequality does hold, there exist blow-up solutions with non-vanishing coefficient functions.
△ Less
Submitted 12 May, 2023;
originally announced May 2023.
-
Distributed economic predictive control of integrated energy systems for enhanced synergy and grid response: A decomposition and cooperation strategy
Authors:
Long Wu,
Xunyuan Yin,
Lei Pan,
Jinfeng Liu
Abstract:
The close integration of increasing operating units into an integrated energy system (IES) results in complex interconnections between these units. The strong dynamic interactions create barriers to designing a successful distributed coordinated controller to achieve synergy between all the units and unlock the potential for grid response. To address these challenges, we introduce a directed graph…
▽ More
The close integration of increasing operating units into an integrated energy system (IES) results in complex interconnections between these units. The strong dynamic interactions create barriers to designing a successful distributed coordinated controller to achieve synergy between all the units and unlock the potential for grid response. To address these challenges, we introduce a directed graph representation of IESs using an augmented Jacobian matrix to depict their underlying dynamics topology. By utilizing this representation, a generic subsystem decomposition method is proposed to partition the entire IES vertically based on the dynamic time scale and horizontally based on the closeness of interconnections between the operating units. Exploiting the decomposed subsystems, we develop a cooperative distributed economic model predictive control (DEMPC) with multiple global objectives that regulate the generated power at the grid's requests and satisfy the customers cooling and system economic requirements. In the DEMPC, multiple local decision-making agents cooperate sequentially and iteratively to leverage the potential across all the units for system-wide dynamic synergy. Furthermore, we discuss how subsystem decomposition impacts the design of distributed cooperation schemes for IESs and provide a control-oriented basic guideline on the optimal decomposition of complex energy systems. Extensive simulations demonstrate that the control strategies with different levels of decomposition and collaboration will lead to marked differences in the overall performance of IES. The standard control scheme based on the proposed subsystem configuration outperforms the empirical decomposition-based control benchmark by about 20%. The DEMPC architecture further improves the overall performance of the IES by about 55% compared to the benchmark.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
Diffusive Limit of the Boltzmann Equation in Bounded Domains
Authors:
Zhimeng Ouyang,
Lei Wu
Abstract:
The rigorous justification of the hydrodynamic limits of kinetic equations in bounded domains has been actively investigated in recent years. In spite of the progress for the diffuse-reflection boundary case, the more challenging in-flow boundary case, in which the leading-order boundary layer effect is non-negligible, still remains open.
In this work, we consider the stationary and evolutionary…
▽ More
The rigorous justification of the hydrodynamic limits of kinetic equations in bounded domains has been actively investigated in recent years. In spite of the progress for the diffuse-reflection boundary case, the more challenging in-flow boundary case, in which the leading-order boundary layer effect is non-negligible, still remains open.
In this work, we consider the stationary and evolutionary Boltzmann equation with the in-flow boundary in general (convex or non-convex) bounded domains, and demonstrate their incompressible Navier-Stokes-Fourier (INSF) limits in $L^2$.
Our method relies on a novel and surprising gain of $\varepsilon^{\frac{1}{2}}$ in the kernel estimate, which is rooted from a key cancellation of delicately chosen test functions and conservation laws. We also introduce the boundary layer with grazing-set cutoff and investigate its BV regularity estimates to control the source terms of the remainder equation with the help of Hardy's inequality.
△ Less
Submitted 3 April, 2023;
originally announced April 2023.
-
Maximum Entropy Estimator for Hidden Markov Models: Reduction to Dimension 2
Authors:
Shulan Hu,
Xinyu Wang,
Liming Wu
Abstract:
In the paper, we introduce the maximum entropy estimator based on 2-dimensional empirical distribution of the observation sequence of hidden Markov model , when the sample size is big: in that case computing the maximum likelihood estimator is too consuming in time by the classical Baum-Welch EM algorithm. We prove the consistency and the asymptotic normality of the maximum entropy estimator in a…
▽ More
In the paper, we introduce the maximum entropy estimator based on 2-dimensional empirical distribution of the observation sequence of hidden Markov model , when the sample size is big: in that case computing the maximum likelihood estimator is too consuming in time by the classical Baum-Welch EM algorithm. We prove the consistency and the asymptotic normality of the maximum entropy estimator in a quite general framework, where the asymptotic covariance matrix is explicitly estimated in terms of the 2-dimensional Fisher information. To complement it, the 2-dimensional relative entropy is skillfully used to study the hypotheses testing problem. Furthermore, we propose 2-dimensional maximum entropy algorithm for finding the maximum entropy estimator, which works for very large observation dataset and large hidden states set. Some numerical examples are furnished and commented for illustrating our theoretical results.
△ Less
Submitted 18 February, 2023;
originally announced March 2023.
-
All-genus WDVV recursion, quivers, and BPS invariants
Authors:
Pierrick Bousseau,
Longting Wu
Abstract:
Let $X$ be a smooth projective surface and $D$ a smooth rational ample divisor in $X$. We prove an all-genus generalization of the genus $0$ WDVV equation for primary Gromov--Witten invariants of the local 3-fold $\mathcal{O}_X(-D)$. The proof relies on a correspondence between all-genus Gromov--Witten invariants and refined Donaldson--Thomas invariants of acyclic quivers. In particular, the corre…
▽ More
Let $X$ be a smooth projective surface and $D$ a smooth rational ample divisor in $X$. We prove an all-genus generalization of the genus $0$ WDVV equation for primary Gromov--Witten invariants of the local 3-fold $\mathcal{O}_X(-D)$. The proof relies on a correspondence between all-genus Gromov--Witten invariants and refined Donaldson--Thomas invariants of acyclic quivers. In particular, the corresponding BPS invariants are expressed in terms of Betti numbers of moduli spaces of quiver representations.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
$L^2$ Diffusive Expansion For Neutron Transport Equation
Authors:
Yan Guo,
Lei Wu
Abstract:
Grazing set singularity leads to a surprising counter-example and breakdown of the classical mathematical theory for $L^{\infty}$ diffusive expansion of neutron transport equation with in-flow boundary condition in term of the Knudsen number $\varepsilon$, one of the most classical problems in the kinetic theory. Even though a satisfactory new theory has been established by constructing new bounda…
▽ More
Grazing set singularity leads to a surprising counter-example and breakdown of the classical mathematical theory for $L^{\infty}$ diffusive expansion of neutron transport equation with in-flow boundary condition in term of the Knudsen number $\varepsilon$, one of the most classical problems in the kinetic theory. Even though a satisfactory new theory has been established by constructing new boundary layers with favorable $\varepsilon$-geometric correction for convex domains, the severe grazing singularity from non-convex domains has prevented any positive mathematical progress. We develop a novel and optimal $L^2$ expansion theory for general domain (including non-convex domain) by discovering a surprising $\varepsilon^{\frac{1}{2}}$ gain for the average of remainder.
△ Less
Submitted 27 January, 2023;
originally announced January 2023.
-
Ghost Effect from Boltzmann Theory: Expansion with Remainder
Authors:
Raffaele Esposito,
Yan Guo,
Rossana Marra,
Lei Wu
Abstract:
Consider the limit $\varepsilon\rightarrow0$ of the steady Boltzmann problem \begin{align} v\cdot\nabla_x\mathfrak{F}=\varepsilon^{-1}Q[\mathfrak{F},\mathfrak{F}],\quad \mathfrak{F}\big|_{v\cdot n<0}=M_w\displaystyle\int_{v'\cdot n>0}
\mathfrak{F}(v')|v'\cdot n|\mathrm{d}{v'}, \end{align} where $\displaystyle M_w(x_0,v):=\frac{1}{2π\big(T_w(x_0)\big)^2} \exp\bigg(-\frac{|v|^2}{2T_w(x_0)}\bigg)$…
▽ More
Consider the limit $\varepsilon\rightarrow0$ of the steady Boltzmann problem \begin{align} v\cdot\nabla_x\mathfrak{F}=\varepsilon^{-1}Q[\mathfrak{F},\mathfrak{F}],\quad \mathfrak{F}\big|_{v\cdot n<0}=M_w\displaystyle\int_{v'\cdot n>0}
\mathfrak{F}(v')|v'\cdot n|\mathrm{d}{v'}, \end{align} where $\displaystyle M_w(x_0,v):=\frac{1}{2π\big(T_w(x_0)\big)^2} \exp\bigg(-\frac{|v|^2}{2T_w(x_0)}\bigg)$ for $x_0\in\partialΩ$ is the wall Maxwellian in the diffuse-reflection boundary condition. In the natural case of $|\nabla T_w|=O(1)$, for any constant $P>0$, the Hilbert expansion leads to \begin{align}\label{expansion}
\mathfrak{F}\approx μ+\varepsilon\bigg\{μ\bigg(ρ_1+u_1\cdot v+T_1\frac{|v|^2-3T}{2}\bigg)-μ^{\frac{1}{2}}\left(\mathscr{A}\cdot\frac{\nabla_xT}{2T^2}\right)\bigg\} \end{align} where $\displaystyleμ(x,v):=\frac{ρ(x)}{\big(2πT(x)\big)^{\frac{3}{2}}} \exp\bigg(-\frac{|v|^2}{2T(x)}\bigg)$, and $(ρ,u_1,T)$ is determined by a Navier-Stokes-Fourier system with "ghost" effect. The goal of this paper is to construct $\mathfrak{F}$ in the form of \begin{align}\label{aa 08}
\mathfrak{F}(x,v)=&μ+μ^{\frac{1}{2}}\Big(\varepsilon f_1+\varepsilon^2f_2\Big)+μ_w^{\frac{1}{2}}\Big(\varepsilon f^B_1\Big)+\varepsilon^αμ^{\frac{1}{2}}R, \end{align} for interior solutions $f_1$, $f_2$ and boundary layer $f^B_1$, where $μ_w$ is $μ$ computed for $T=T_w$, and derive equation for the remainder $R$ with some constant $α\geq1$. To prove the validity of the expansion suitable bounds on $R$ are needed, which are provided in the companion paper [Esposito-Guo-Rossana-Wu2023].
△ Less
Submitted 18 September, 2023; v1 submitted 23 January, 2023;
originally announced January 2023.
-
Ghost Effect from Boltzmann Theory
Authors:
Raffaele Esposito,
Yan Guo,
Rossana Marra,
Lei Wu
Abstract:
Taking place naturally in a gas subject to a given wall temperature distribution [Maxwell1879], the ``ghost effect'' exhibits a rare kinetic effect beyond the prediction of classical fluid theory and Fourier law in such a classical problem in physics. As the Knudsen number $\varepsilon$ goes to zero, the finite variation of temperature in the bulk is determined by an $\varepsilon$ infinitesimal, g…
▽ More
Taking place naturally in a gas subject to a given wall temperature distribution [Maxwell1879], the ``ghost effect'' exhibits a rare kinetic effect beyond the prediction of classical fluid theory and Fourier law in such a classical problem in physics. As the Knudsen number $\varepsilon$ goes to zero, the finite variation of temperature in the bulk is determined by an $\varepsilon$ infinitesimal, ghost-like velocity field, created by a given finite variation of the tangential wall temperature as predicted by Maxwell's slip boundary condition. Mathematically, such a finite variation leads to the presence of a severe $\varepsilon^{-1}$ singularity and a Knudsen layer approximation in the fundamental energy estimate. Neither difficulty is within the reach of any existing PDE theory on the steady Boltzmann equation in a general 3D bounded domain. Consequently, in spite of the discovery of such a ghost effect from temperature variation in as early as 1960's, its mathematical validity has been a challenging and intriguing open question, causing confusion and suspicion. We settle this open question in affirmative if the temperature variation is small but finite, by developing a new $L^2-L^6-L^{\infty}$ framework with four major innovations: 1) a key $\mathscr{A}$-Hodge decomposition and its corresponding local $\mathscr{A}$-conservation law eliminate the severe $\varepsilon^{-1}$ bulk singularity, leading to a reduced energy estimate; 2) A surprising $\varepsilon^{\frac{1}{2}}$ gain in $L^2$ via momentum conservation and a dual Stokes solution; 3) the $\mathscr{A}$-conservation, energy conservation and a coupled dual Stokes-Poisson solution reduces to an $\varepsilon^{-\frac{1}{2}}$ boundary singularity; 4) a crucial construction of $\varepsilon$-cutoff boundary layer eliminates such boundary singularity via new Hardy and BV estimates.
△ Less
Submitted 18 September, 2023; v1 submitted 23 January, 2023;
originally announced January 2023.
-
A generalized index theory for non-Hamiltonian system
Authors:
Alessandro Portaluri,
Li Wu,
Ran Yang
Abstract:
Morse index theory provides an elegant and useful tool for describing several aspects of a Lagrangian system in terms of its variational properties. In the classical framework it provides an equality between the spectral properties of a second order selfadjoint differential operator arising by the second variation of the Lagrangian action functional and the oscillation properties of the space of s…
▽ More
Morse index theory provides an elegant and useful tool for describing several aspects of a Lagrangian system in terms of its variational properties. In the classical framework it provides an equality between the spectral properties of a second order selfadjoint differential operator arising by the second variation of the Lagrangian action functional and the oscillation properties of the space of solutions of the associated boundary value problem. These oscillation properties are described by means of the Maslov index, which is a symplectic invariant intimately related to the Hamiltonian nature of the problem.
Driven by the desire to get an analogous result in the non-Hamiltonian context for the investigation of the dynamical properties of dissipative systems, in this paper we start to introduce a new topological invariant, the so-called degree-index, defined in terms of the Brouwer degree of a suitable determinant map of a boundary matrix, which provides one possible substitute of the Maslov index in this non-Hamiltonian framework and finally we prove the equality between the Morse index and the degree-index in this non-selfadjoint setting through a new abstract trace formula.
In the last part of the paper we apply our theoretical results to some 1D reaction-diffusion systems.
△ Less
Submitted 29 May, 2023; v1 submitted 17 January, 2023;
originally announced January 2023.
-
Time analyticity for the heat equation under Bakry-Émery Ricci curvature condition
Authors:
Ling Wu
Abstract:
Inspired by Hongjie Dong and Qi S. Zhang's article \cite{ZQ2}, we find that the analyticity in time for a smooth solution of the heat equation with exponential quadratic growth in the space variable can be extended to any complete noncompact Riemannian manifolds with Bakry-Émery Ricci curvature bounded below and the potential function being of at most quadratic growth. Therefore, our result holds…
▽ More
Inspired by Hongjie Dong and Qi S. Zhang's article \cite{ZQ2}, we find that the analyticity in time for a smooth solution of the heat equation with exponential quadratic growth in the space variable can be extended to any complete noncompact Riemannian manifolds with Bakry-Émery Ricci curvature bounded below and the potential function being of at most quadratic growth. Therefore, our result holds on all gradient Ricci solitons. As a corollary, we give a necessary and sufficient condition on the solvability of the backward heat equation in a class of functions with the similar growth condition. In addition, we also consider the solution in certain $L^p$ spaces with $p\in[2,+\infty)$ and prove its analyticity with respect to time.
△ Less
Submitted 5 December, 2022; v1 submitted 25 November, 2022;
originally announced November 2022.
-
The sharp weighted maximal inequalities for noncommutative martingales
Authors:
Tomasz Gałązka,
Yong Jiao,
Adam Osękowski,
Lian Wu
Abstract:
The purpose of the paper is to establish weighted maximal $L_p$-inequalities in the context of operator-valued martingales on semifinite von Neumann algebras. The main emphasis is put on the optimal dependence of the $L_p$ constants on the characteristic of the weight involved. As applications, we establish weighted estimates for the noncommutative version of Hardy-Littlewood maximal operator and…
▽ More
The purpose of the paper is to establish weighted maximal $L_p$-inequalities in the context of operator-valued martingales on semifinite von Neumann algebras. The main emphasis is put on the optimal dependence of the $L_p$ constants on the characteristic of the weight involved. As applications, we establish weighted estimates for the noncommutative version of Hardy-Littlewood maximal operator and weighted bounds for noncommutative maximal truncations of a wide class of singular integrals.
△ Less
Submitted 17 November, 2022;
originally announced November 2022.
-
Anytime-valid off-policy inference for contextual bandits
Authors:
Ian Waudby-Smith,
Lili Wu,
Aaditya Ramdas,
Nikos Karampatziakis,
Paul Mineiro
Abstract:
Contextual bandit algorithms are ubiquitous tools for active sequential experimentation in healthcare and the tech industry. They involve online learning algorithms that adaptively learn policies over time to map observed contexts $X_t$ to actions $A_t$ in an attempt to maximize stochastic rewards $R_t$. This adaptivity raises interesting but hard statistical inference questions, especially counte…
▽ More
Contextual bandit algorithms are ubiquitous tools for active sequential experimentation in healthcare and the tech industry. They involve online learning algorithms that adaptively learn policies over time to map observed contexts $X_t$ to actions $A_t$ in an attempt to maximize stochastic rewards $R_t$. This adaptivity raises interesting but hard statistical inference questions, especially counterfactual ones: for example, it is often of interest to estimate the properties of a hypothetical policy that is different from the logging policy that was used to collect the data -- a problem known as ``off-policy evaluation'' (OPE). Using modern martingale techniques, we present a comprehensive framework for OPE inference that relax unnecessary conditions made in some past works, significantly improving on them both theoretically and empirically. Importantly, our methods can be employed while the original experiment is still running (that is, not necessarily post-hoc), when the logging policy may be itself changing (due to learning), and even if the context distributions are a highly dependent time-series (such as if they are drifting over time). More concretely, we derive confidence sequences for various functionals of interest in OPE. These include doubly robust ones for time-varying off-policy mean reward values, but also confidence bands for the entire cumulative distribution function of the off-policy reward distribution. All of our methods (a) are valid at arbitrary stopping times (b) only make nonparametric assumptions, (c) do not require importance weights to be uniformly bounded and if they are, we do not need to know these bounds, and (d) adapt to the empirical variance of our estimators. In summary, our methods enable anytime-valid off-policy inference using adaptively collected contextual bandit data.
△ Less
Submitted 15 August, 2024; v1 submitted 19 October, 2022;
originally announced October 2022.
-
MA$_{ω_1}(S)[S]$ does not imply $\mathcal{K}_2$
Authors:
Yinhe Peng,
Liuzhen Wu
Abstract:
We construct a model in which MA$_{ω_1}$(S)[S] holds and $\mathcal{K}_2$ fails. This shows that MA$_{ω_1}$(S)[S] does not imply $\mathcal{K}_2$ and answers an old question of Larson and Todorcevic in [3]. We also investigate different strong colorings in models of MA$_{ω_1}$(S)[S].
We construct a model in which MA$_{ω_1}$(S)[S] holds and $\mathcal{K}_2$ fails. This shows that MA$_{ω_1}$(S)[S] does not imply $\mathcal{K}_2$ and answers an old question of Larson and Todorcevic in [3]. We also investigate different strong colorings in models of MA$_{ω_1}$(S)[S].
△ Less
Submitted 22 September, 2022; v1 submitted 31 August, 2022;
originally announced August 2022.
-
Towards Improving Unit Commitment Economics: An Add-On Tailor for Renewable Energy and Reserve Predictions
Authors:
Xianbang Chen,
Yikui Liu,
Lei Wu
Abstract:
Generally, day-ahead unit commitment (UC) is conducted in a predict-then-optimize process: it starts by predicting the renewable energy source (RES) availability and system reserve requirements; given the predictions, the UC model is then optimized to determine the economic operation plans. In fact, predictions within the process are raw. In other words, if the predictions are further tailored to…
▽ More
Generally, day-ahead unit commitment (UC) is conducted in a predict-then-optimize process: it starts by predicting the renewable energy source (RES) availability and system reserve requirements; given the predictions, the UC model is then optimized to determine the economic operation plans. In fact, predictions within the process are raw. In other words, if the predictions are further tailored to assist UC in making the economic operation plans against realizations of the RES and reserve requirements, UC economics will benefit significantly. To this end, this paper presents a cost-oriented tailor of RES-and-reserve predictions for UC, deployed as an add-on to the predict-then-optimize process. The RES-and-reserve tailor is trained by solving a bi-level mixed-integer programming model: the upper level trains the tailor based on its induced operating cost; the lower level, given tailored predictions, mimics the system operation process and feeds the induced operating cost back to the upper level; finally, the upper level evaluates the training quality according to the fed-back cost. Through this training, the tailor learns to customize the raw predictions into cost-oriented predictions. Moreover, the tailor can be embedded into the existing predict-then-optimize process as an add-on, improving the UC economics. Lastly, the presented method is compared to traditional, binary-relaxation, neural network-based, stochastic, and robust methods.
△ Less
Submitted 7 July, 2024; v1 submitted 27 August, 2022;
originally announced August 2022.
-
Linear optimization on varieties and Chern-Mather classes
Authors:
Laurentiu G. Maxim,
Jose Israel Rodriguez,
Botong Wang,
Lei Wu
Abstract:
The linear optimization degree gives an algebraic measure of complexity of optimizing a linear objective function over an algebraic model. Geometrically, it can be interpreted as the degree of a projection map on the {affine} conormal variety. Fixing an affine variety, our first result shows that the geometry of {this} conormal variety, expressed in terms of bidegrees, completely determines the Ch…
▽ More
The linear optimization degree gives an algebraic measure of complexity of optimizing a linear objective function over an algebraic model. Geometrically, it can be interpreted as the degree of a projection map on the {affine} conormal variety. Fixing an affine variety, our first result shows that the geometry of {this} conormal variety, expressed in terms of bidegrees, completely determines the Chern-Mather classes of the given variety. We also show that these bidegrees coincide with the linear optimization degrees of generic affine sections.
△ Less
Submitted 24 April, 2023; v1 submitted 18 August, 2022;
originally announced August 2022.
-
L vector spaces and L fields
Authors:
Yinhe Peng,
Liuzhen Wu
Abstract:
We construct in ZFC an L topological vector space -- a topological vector space that is an L space -- and an L field -- a topological field that is an L space. This generalizes results in [5] and [8].
We construct in ZFC an L topological vector space -- a topological vector space that is an L space -- and an L field -- a topological field that is an L space. This generalizes results in [5] and [8].
△ Less
Submitted 22 June, 2023; v1 submitted 16 August, 2022;
originally announced August 2022.
-
Forcing Axioms and the Definabilty of the Nonstationary Ideal on $ω_1$
Authors:
Stefan Hoffelner,
Paul Larson,
Ralf Schindler,
Liuzhen Wu
Abstract:
We show that under $\BMM$ and "there exists a Woodin cardinal$"$, the nonstationary ideal on $ω_1$ can not be defined by a $Σ_1$ formula with parameter $A \subset ω_1$. We show that the same conclusion holds under the assumption of Woodin's $(\ast)$-axiom. We further show that there are universes where $\BPFA$ holds and $\NS$ is $Σ_1(ω_1)$-definable. Last we show that if the canonical inner model…
▽ More
We show that under $\BMM$ and "there exists a Woodin cardinal$"$, the nonstationary ideal on $ω_1$ can not be defined by a $Σ_1$ formula with parameter $A \subset ω_1$. We show that the same conclusion holds under the assumption of Woodin's $(\ast)$-axiom. We further show that there are universes where $\BPFA$ holds and $\NS$ is $Σ_1(ω_1)$-definable. Last we show that if the canonical inner model with one Woodin cardinal $M_1$ exists, there is a universe where $\NS$ is saturated, $Σ_1(ω_1)$-definable and $\MA$ holds.
△ Less
Submitted 10 August, 2022;
originally announced August 2022.
-
Uniform a priori estimates for $n$-th order Lane-Emden system in $\mathbb{R}^{n}$ with $n\geq3$
Authors:
Wei Dai,
Leyun Wu
Abstract:
In this paper, we establish uniform a priori estimates for positive solutions to the (higher) critical order superlinear Lane-Emden system in bounded domains with Navier boundary conditions in arbitrary dimensions $n\geq3$. First, we prove the monotonicity of solutions for odd order (higher order fractional system) and even order system (integer order system) respectively along the inward normal d…
▽ More
In this paper, we establish uniform a priori estimates for positive solutions to the (higher) critical order superlinear Lane-Emden system in bounded domains with Navier boundary conditions in arbitrary dimensions $n\geq3$. First, we prove the monotonicity of solutions for odd order (higher order fractional system) and even order system (integer order system) respectively along the inward normal direction near the boundary by the method of moving planes in local ways. Then we derive uniform a priori estimates by establishing the precise relationships between the maxima of $u$, $v$, $-Δu$ and $-Δv$ through Harnack inequality. Our results extended the uniform a priori estimates for critical order problems in [18, 19] from $n=2$ to higher dimensions $n\geq3$ and in [6, 8] from one single equation to system. With such a priori estimates, one will be able to obtain the existence of solutions via topological degree theory or continuation argument.
△ Less
Submitted 4 September, 2022; v1 submitted 1 August, 2022;
originally announced August 2022.
-
A surjection from square onto power
Authors:
Yinhe Peng,
Guozhen Shen,
Liuzhen Wu
Abstract:
It is shown that the existence of an infinite set $A$ such that $A^2$ maps onto $2^A$ is consistent with $\mathsf{ZF}$.
It is shown that the existence of an infinite set $A$ such that $A^2$ maps onto $2^A$ is consistent with $\mathsf{ZF}$.
△ Less
Submitted 27 July, 2022;
originally announced July 2022.
-
A construction-free coordinate-descent augmented-Lagrangian method for embedded linear MPC based on ARX models
Authors:
Liang Wu,
Alberto Bemporad
Abstract:
This paper proposes a construction-free algorithm for solving linear MPC problems based on autoregressive with exogenous terms (ARX) input-output models. The solution algorithm relies on a coordinate-descent augmented Lagrangian (CDAL) method previously proposed by the authors, which we adapt here to exploit the special structure of ARX-based MPC. The CDAL-ARX algorithm enjoys the construction-fre…
▽ More
This paper proposes a construction-free algorithm for solving linear MPC problems based on autoregressive with exogenous terms (ARX) input-output models. The solution algorithm relies on a coordinate-descent augmented Lagrangian (CDAL) method previously proposed by the authors, which we adapt here to exploit the special structure of ARX-based MPC. The CDAL-ARX algorithm enjoys the construction-free feature, in that it avoids explicitly constructing the quadratic programming (QP) problem associated with MPC, which would eliminate construction cost when the ARX model changes/adapts online. For example, the ARX model parameters are dependent on linear parameter-varying (LPV) scheduling signals, or recursively adapted from streaming input-output data with cheap computation cost, which make the ARX model widely used in adaptive control. Moreover, the implementation of the resulting CDAL-ARX algorithm is matrix-free and library-free, and hence amenable for deployment in industrial embedded platforms. We show the efficiency of CDAL-ARX in two numerical examples, also in comparison with MPC implementations based on other general-purpose quadratic programming solvers.
△ Less
Submitted 27 September, 2022; v1 submitted 13 July, 2022;
originally announced July 2022.
-
Hilbert Expansion for Coulomb Collisional Kinetic Models
Authors:
Zhimeng Ouyang,
Lei Wu,
Qinghua Xiao
Abstract:
The relativistic Vlasov-Maxwell-Landau (r-VML) system and the relativistic Landau equation (r-LAN) are fundamental models that describe the dynamics of an electron gas. In this paper, we introduce a novel weighted energy method and establish the validity of the Hilbert expansion for the r-VML system and r-LAN equation. As the Knudsen number shrinks to zero, we rigorously demonstrate the relativist…
▽ More
The relativistic Vlasov-Maxwell-Landau (r-VML) system and the relativistic Landau equation (r-LAN) are fundamental models that describe the dynamics of an electron gas. In this paper, we introduce a novel weighted energy method and establish the validity of the Hilbert expansion for the r-VML system and r-LAN equation. As the Knudsen number shrinks to zero, we rigorously demonstrate the relativistic Euler-Maxwell limit and relativistic Euler limit, respectively. This successfully resolves the long-standing open problem regarding the hydrodynamic limits of Landau-type equations.
△ Less
Submitted 7 June, 2023; v1 submitted 30 June, 2022;
originally announced July 2022.
-
Estimates of bubbling solutions of $SU(3)$ Toda systems at critical parameters-Part 2
Authors:
Juncheng Wei,
Lina Wu,
Lei Zhang
Abstract:
In this article we study bubbling solutions of regular $SU(3)$ Toda systems defined on a Riemann surface. There are two major difficulties corresponding to the profile of bubbling solutions: partial blowup phenomenon and bubble accumulation. We prove that when both parameters tend to critical positions, if there is one fully bubbling blowup point, then under one curvature assumption, all the blowu…
▽ More
In this article we study bubbling solutions of regular $SU(3)$ Toda systems defined on a Riemann surface. There are two major difficulties corresponding to the profile of bubbling solutions: partial blowup phenomenon and bubble accumulation. We prove that when both parameters tend to critical positions, if there is one fully bubbling blowup point, then under one curvature assumption, all the blowup solutions near a blowup point satisfy a spherical Harnack inequality, which completely rules out the bubble-accumulation phenomenon. This fact is crucial for a number of applications.
△ Less
Submitted 16 June, 2022;
originally announced June 2022.
