-
New Tight Wavelet Frame Constructions Sharing Responsibility
Authors:
Youngmi Hur,
Hyojae Lim
Abstract:
Tight wavelet frames (TWFs) in $L^2(\mathbb{R}^n)$ are versatile and practical structures that provide the perfect reconstruction property. Nevertheless, existing TWF construction methods exhibit limitations, including a lack of specific methods for generating mother wavelets in extension-based construction, and the necessity to address the sum of squares (SOS) problem even when specific methods f…
▽ More
Tight wavelet frames (TWFs) in $L^2(\mathbb{R}^n)$ are versatile and practical structures that provide the perfect reconstruction property. Nevertheless, existing TWF construction methods exhibit limitations, including a lack of specific methods for generating mother wavelets in extension-based construction, and the necessity to address the sum of squares (SOS) problem even when specific methods for generating mother wavelets are provided in SOS-based construction. It is a common practice for current TWF constructions to begin with a given refinable function. However, this approach places the entire burden on finding suitable mother wavelets. In this paper, we introduce TWF construction methods that spread the burden between both types of functions: refinable functions and mother wavelets. These construction methods offer an alternative approach to circumvent the SOS problem while providing specific techniques for generating mother wavelets. We present examples to illustrate our construction methods.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
Robust Point Matching with Distance Profiles
Authors:
YoonHaeng Hur,
Yuehaw Khoo
Abstract:
While matching procedures based on pairwise distances are conceptually appealing and thus favored in practice, theoretical guarantees for such procedures are rarely found in the literature. We propose and analyze matching procedures based on distance profiles that are easily implementable in practice, showing these procedures are robust to outliers and noise. We demonstrate the performance of the…
▽ More
While matching procedures based on pairwise distances are conceptually appealing and thus favored in practice, theoretical guarantees for such procedures are rarely found in the literature. We propose and analyze matching procedures based on distance profiles that are easily implementable in practice, showing these procedures are robust to outliers and noise. We demonstrate the performance of the proposed method using a real data example and provide simulation studies to complement the theoretical findings.
△ Less
Submitted 15 May, 2024; v1 submitted 19 December, 2023;
originally announced December 2023.
-
Wavelet series expansion in Hardy spaces with approximate duals
Authors:
Youngmi Hur,
Hyojae Lim
Abstract:
In this paper, we provide sufficient conditions for the functions $ψ$ and $φ$ to be the approximate duals in the Hardy space $H^p(\mathbb{R})$ for all $0<p\leq1$. Based on these conditions, we obtain the wavelet series expansion in the Hardy space with the approximate duals. The important properties of our approach include the following: (i) our results work for any $0<p\leq1$; (ii) we do not assu…
▽ More
In this paper, we provide sufficient conditions for the functions $ψ$ and $φ$ to be the approximate duals in the Hardy space $H^p(\mathbb{R})$ for all $0<p\leq1$. Based on these conditions, we obtain the wavelet series expansion in the Hardy space with the approximate duals. The important properties of our approach include the following: (i) our results work for any $0<p\leq1$; (ii) we do not assume that the functions $ψ$ and $φ$ are exact duals; (iii) we provide a tractable bound for the operator norm of the associated wavelet frame operator so that it is possible to check the suitability of the functions $ψ$ and $φ$.
△ Less
Submitted 8 June, 2023; v1 submitted 7 June, 2023;
originally announced June 2023.
-
Detecting Weak Distribution Shifts via Displacement Interpolation
Authors:
YoonHaeng Hur,
Tengyuan Liang
Abstract:
Detecting weak, systematic distribution shifts and quantitatively modeling individual, heterogeneous responses to policies or incentives have found increasing empirical applications in social and economic sciences. Given two probability distributions $P$ (null) and $Q$ (alternative), we study the problem of detecting weak distribution shift deviating from the null $P$ toward the alternative $Q$, w…
▽ More
Detecting weak, systematic distribution shifts and quantitatively modeling individual, heterogeneous responses to policies or incentives have found increasing empirical applications in social and economic sciences. Given two probability distributions $P$ (null) and $Q$ (alternative), we study the problem of detecting weak distribution shift deviating from the null $P$ toward the alternative $Q$, where the level of deviation vanishes as a function of $n$, the sample size. We propose a model for weak distribution shifts via displacement interpolation between $P$ and $Q$, drawing from the optimal transport theory. We study a hypothesis testing procedure based on the Wasserstein distance, derive sharp conditions under which detection is possible, and provide the exact characterization of the asymptotic Type I and Type II errors at the detection boundary using empirical processes. We demonstrate how the proposed testing procedure works in modeling and detecting weak distribution shifts in real data sets using two empirical examples: distribution shifts in consumer spending after COVID-19, and heterogeneity in the published p-values of statistical tests in journals across different disciplines.
△ Less
Submitted 6 November, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
Generative modeling via tensor train sketching
Authors:
YH. Hur,
J. G. Hoskins,
M. Lindsey,
E. M. Stoudenmire,
Y. Khoo
Abstract:
In this paper, we introduce a sketching algorithm for constructing a tensor train representation of a probability density from its samples. Our method deviates from the standard recursive SVD-based procedure for constructing a tensor train. Instead, we formulate and solve a sequence of small linear systems for the individual tensor train cores. This approach can avoid the curse of dimensionality t…
▽ More
In this paper, we introduce a sketching algorithm for constructing a tensor train representation of a probability density from its samples. Our method deviates from the standard recursive SVD-based procedure for constructing a tensor train. Instead, we formulate and solve a sequence of small linear systems for the individual tensor train cores. This approach can avoid the curse of dimensionality that threatens both the algorithmic and sample complexities of the recovery problem. Specifically, for Markov models under natural conditions, we prove that the tensor cores can be recovered with a sample complexity that scales logarithmically in the dimensionality. Finally, we illustrate the performance of the method with several numerical experiments.
△ Less
Submitted 23 June, 2023; v1 submitted 23 February, 2022;
originally announced February 2022.
-
Tight Wavelet Filter Banks with Prescribed Directions
Authors:
Youngmi Hur
Abstract:
Constructing tight wavelet filter banks with prescribed directions is challenging. This paper presents a systematic method for designing a tight wavelet filter bank, given any prescribed directions. There are two types of wavelet filters in our tight wavelet filter bank. One type is entirely determined by the prescribed information about the directionality and makes the wavelet filter bank directi…
▽ More
Constructing tight wavelet filter banks with prescribed directions is challenging. This paper presents a systematic method for designing a tight wavelet filter bank, given any prescribed directions. There are two types of wavelet filters in our tight wavelet filter bank. One type is entirely determined by the prescribed information about the directionality and makes the wavelet filter bank directional. The other type helps the wavelet filter bank to be tight. In addition to the flexibility in choosing the directions, our construction method has other useful properties. It works for any multi-dimension, and it allows the user to have any prescribed number of vanishing moments along the chosen directions. Furthermore, our tight wavelet filter banks have fast algorithms for analysis and synthesis. Concrete examples are given to illustrate our construction method and properties of resulting tight wavelet filter banks.
△ Less
Submitted 20 February, 2022;
originally announced February 2022.
-
Online Learning to Transport via the Minimal Selection Principle
Authors:
Wenxuan Guo,
YoonHaeng Hur,
Tengyuan Liang,
Christopher Ryan
Abstract:
Motivated by robust dynamic resource allocation in operations research, we study the \textit{Online Learning to Transport} (OLT) problem where the decision variable is a probability measure, an infinite-dimensional object. We draw connections between online learning, optimal transport, and partial differential equations through an insight called the minimal selection principle, originally studied…
▽ More
Motivated by robust dynamic resource allocation in operations research, we study the \textit{Online Learning to Transport} (OLT) problem where the decision variable is a probability measure, an infinite-dimensional object. We draw connections between online learning, optimal transport, and partial differential equations through an insight called the minimal selection principle, originally studied in the Wasserstein gradient flow setting by \citet{Ambrosio_2005}. This allows us to extend the standard online learning framework to the infinite-dimensional setting seamlessly. Based on our framework, we derive a novel method called the \textit{minimal selection or exploration (MSoE) algorithm} to solve OLT problems using mean-field approximation and discretization techniques. In the displacement convex setting, the main theoretical message underpinning our approach is that minimizing transport cost over time (via the minimal selection principle) ensures optimal cumulative regret upper bounds. On the algorithmic side, our MSoE algorithm applies beyond the displacement convex setting, making the mathematical theory of optimal transport practically relevant to non-convex settings common in dynamic resource allocation.
△ Less
Submitted 14 June, 2022; v1 submitted 9 February, 2022;
originally announced February 2022.
-
Reversible Gromov-Monge Sampler for Simulation-Based Inference
Authors:
YoonHaeng Hur,
Wenxuan Guo,
Tengyuan Liang
Abstract:
This paper introduces a new simulation-based inference procedure to model and sample from multi-dimensional probability distributions given access to i.i.d.\ samples, circumventing the usual approaches of explicitly modeling the density function or designing Markov chain Monte Carlo. Motivated by the seminal work on distance and isomorphism between metric measure spaces, we propose a new notion ca…
▽ More
This paper introduces a new simulation-based inference procedure to model and sample from multi-dimensional probability distributions given access to i.i.d.\ samples, circumventing the usual approaches of explicitly modeling the density function or designing Markov chain Monte Carlo. Motivated by the seminal work on distance and isomorphism between metric measure spaces, we propose a new notion called the Reversible Gromov-Monge (RGM) distance and study how RGM can be used to design new transform samplers to perform simulation-based inference. Our RGM sampler can also estimate optimal alignments between two heterogeneous metric measure spaces $(\cX, μ, c_{\cX})$ and $(\cY, ν, c_{\cY})$ from empirical data sets, with estimated maps that approximately push forward one measure $μ$ to the other $ν$, and vice versa. We study the analytic properties of the RGM distance and derive that under mild conditions, RGM equals the classic Gromov-Wasserstein distance. Curiously, drawing a connection to Brenier's polar factorization, we show that the RGM sampler induces bias towards strong isomorphism with proper choices of $c_{\cX}$ and $c_{\cY}$. Statistical rate of convergence, representation, and optimization questions regarding the induced sampler are studied. Synthetic and real-world examples showcasing the effectiveness of the RGM sampler are also demonstrated.
△ Less
Submitted 29 January, 2023; v1 submitted 28 September, 2021;
originally announced September 2021.
-
Invertibility of circulant matrices of arbitrary size
Authors:
Jeong-Ok Choi,
Youngmi Hur
Abstract:
In this paper, we present sufficient conditions to guarantee the invertibility of rational circulant matrices with any given size. These sufficient conditions consist of linear combinations of the entries in the first row with integer coefficients. Our result is general enough to show the invertibility of circulant matrices with any size and arrangement of entries. For example, using these conditi…
▽ More
In this paper, we present sufficient conditions to guarantee the invertibility of rational circulant matrices with any given size. These sufficient conditions consist of linear combinations of the entries in the first row with integer coefficients. Our result is general enough to show the invertibility of circulant matrices with any size and arrangement of entries. For example, using these conditions, we show the invertibility of the family of circulant matrices with particular forms of integers generated by a primitive element in $\mathbb{Z}_p$. Also, using a combinatorial structure of these sufficient conditions, we show invertibility for circulant $0, 1$-matrices.
△ Less
Submitted 24 June, 2021;
originally announced June 2021.
-
Deep Scattering Network with Max-pooling
Authors:
Taekyung Ki,
Youngmi Hur
Abstract:
Scattering network is a convolutional network, consisting of cascading convolutions using pre-defined wavelets followed by the modulus operator. Since its introduction in 2012, the scattering network is used as one of few mathematical tools explaining components of the convolutional neural networks (CNNs). However, a pooling operator, which is one of main components of conventional CNNs, is not co…
▽ More
Scattering network is a convolutional network, consisting of cascading convolutions using pre-defined wavelets followed by the modulus operator. Since its introduction in 2012, the scattering network is used as one of few mathematical tools explaining components of the convolutional neural networks (CNNs). However, a pooling operator, which is one of main components of conventional CNNs, is not considered in the original scattering network. In this paper, we propose a new network, called scattering-maxp network, integrating the scattering network with the max-pooling operator. We model continuous max-pooling, apply it to the scattering network, and get the scattering-maxp network. We show that the scattering-maxp network shares many useful properties of the scattering network including translation invariance, but with much smaller number of parameters. Numerical experiments show that the use of scattering-maxp does not degrade the performance too much and is much faster than the original one, in image classification tasks.
△ Less
Submitted 6 January, 2021;
originally announced January 2021.
-
Multivariate Tight Wavelet Frames with Few Generators and High Vanishing Moments
Authors:
Youngmi Hur,
Zachary Lubberts,
Kasso A. Okoudjou
Abstract:
Tight wavelet frames are computationally and theoretically attractive, but most existing multivariate constructions have various drawbacks, including low vanishing moments for the wavelets, or a large number of wavelet masks. We further develop existing work combining sums of squares representations with tight wavelet frame construction, and present a new and general method for constructing such f…
▽ More
Tight wavelet frames are computationally and theoretically attractive, but most existing multivariate constructions have various drawbacks, including low vanishing moments for the wavelets, or a large number of wavelet masks. We further develop existing work combining sums of squares representations with tight wavelet frame construction, and present a new and general method for constructing such frames. Focusing on the case of box splines, we also demonstrate how the flexibility of our approach can lead to tight wavelet frames with high numbers of vanishing moments for all of the wavelet masks, while still having few highpass masks: in fact, we match the best known upper bound on the number of highpass masks for general box spline tight wavelet frame constructions, while typically achieving much better vanishing moments for all of the wavelet masks, proving a nontrivial lower bound on this quantity.
△ Less
Submitted 14 October, 2019; v1 submitted 20 February, 2019;
originally announced February 2019.
-
Scaling Laplacian Pyramids
Authors:
Youngmi Hur,
Kasso A. Okoudjou
Abstract:
Laplacian pyramid based Laurent polynomial (LP$^2$) matrices are generated by Laurent polynomial column vectors and have long been studied in connection with Laplacian pyramidal algorithms in Signal Processing. In this paper, we investigate when such matrices are scalable, that is when right multiplication by Laurent polynomial diagonal matrices results in paraunitary matrices. The notion of scala…
▽ More
Laplacian pyramid based Laurent polynomial (LP$^2$) matrices are generated by Laurent polynomial column vectors and have long been studied in connection with Laplacian pyramidal algorithms in Signal Processing. In this paper, we investigate when such matrices are scalable, that is when right multiplication by Laurent polynomial diagonal matrices results in paraunitary matrices. The notion of scalability has recently been introduced in the context of finite frame theory and can be considered as a preconditioning method for frames. This paper significantly extends the current research on scalable frames to the setting of polyphase representations of filter banks. Furthermore, as applications of our main results we propose new construction methods for tight wavelet filter banks and tight wavelet frames.
△ Less
Submitted 30 January, 2015; v1 submitted 22 September, 2014;
originally announced September 2014.
-
Generalizations of the Maillet Determinant
Authors:
Youngmi Hur,
Zachary Lubberts
Abstract:
We consider several extensions of the Maillet determinant studied by Malo, Turnbull, and Carlitz and Olson, and derive properties of the underlying matrices. In particular, we compute the eigenvectors and eigenvalues of these matrices, which yield formulas for these new determinants.
We consider several extensions of the Maillet determinant studied by Malo, Turnbull, and Carlitz and Olson, and derive properties of the underlying matrices. In particular, we compute the eigenvectors and eigenvalues of these matrices, which yield formulas for these new determinants.
△ Less
Submitted 25 July, 2014;
originally announced July 2014.
-
Prime Coset Sum: A Systematic Method for Designing Multi-D Wavelet Filter Banks with Fast Algorithms
Authors:
Youngmi Hur,
Fang Zheng
Abstract:
As constructing multi-D wavelets remains a challenging problem, we propose a new method called prime coset sum to construct multi-D wavelets. Our method provides a systematic way to construct multi-D non-separable wavelet filter banks from two 1-D lowpass filters, with one of whom being interpolatory. Our method has many important features including the following: 1) it works for any spatial dimen…
▽ More
As constructing multi-D wavelets remains a challenging problem, we propose a new method called prime coset sum to construct multi-D wavelets. Our method provides a systematic way to construct multi-D non-separable wavelet filter banks from two 1-D lowpass filters, with one of whom being interpolatory. Our method has many important features including the following: 1) it works for any spatial dimension, and any prime scalar dilation, 2) the vanishing moments of the multi-D wavelet filter banks are guaranteed by certain properties of the initial 1-D lowpass filters, and furthermore, 3) the resulting multi-D wavelet filter banks are associated with fast algorithms that are faster than the existing fast tensor product algorithms.
△ Less
Submitted 21 July, 2014;
originally announced July 2014.
-
Committee Algorithm: An Easy Way to Construct Wavelet Filter Banks
Authors:
Youngmi Hur
Abstract:
Given a lowpass filter, finding a dual lowpass filter is an essential step in constructing non-redundant wavelet filter banks. Obtaining dual lowpass filters is not an easy task. In this paper, we introduce a new method called committee algorithm that builds a dual filter straightforwardly from two easily-constructible lowpass filters. It allows to design a wide range of new wavelet filter banks.…
▽ More
Given a lowpass filter, finding a dual lowpass filter is an essential step in constructing non-redundant wavelet filter banks. Obtaining dual lowpass filters is not an easy task. In this paper, we introduce a new method called committee algorithm that builds a dual filter straightforwardly from two easily-constructible lowpass filters. It allows to design a wide range of new wavelet filter banks. An example based on the family of Burt-Adelson's 1-D Laplacian filters is given.
△ Less
Submitted 7 January, 2012;
originally announced January 2012.
-
Coset Sum: an alternative to the tensor product in wavelet construction
Authors:
Youngmi Hur,
Fang Zheng
Abstract:
A multivariate biorthogonal wavelet system can be obtained from a pair of multivariate biorthogonal refinement masks in Multiresolution Analysis setup. Some multivariate refinement masks may be decomposed into lower dimensional refinement masks. Tensor product is a popular way to construct a decomposable multivariate refinement mask from lower dimensional refinement masks.
We present an alternat…
▽ More
A multivariate biorthogonal wavelet system can be obtained from a pair of multivariate biorthogonal refinement masks in Multiresolution Analysis setup. Some multivariate refinement masks may be decomposed into lower dimensional refinement masks. Tensor product is a popular way to construct a decomposable multivariate refinement mask from lower dimensional refinement masks.
We present an alternative method, which we call coset sum, for constructing multivariate refinement masks from univariate refinement masks. The coset sum shares many essential features of the tensor product that make it attractive in practice: (1) it preserves the biorthogonality of univariate refinement masks, (2) it preserves the accuracy number of the univariate refinement mask, and (3) the wavelet system associated with it has fast algorithms for computing and inverting the wavelet coefficients. The coset sum can even provide a wavelet system with faster algorithms in certain cases than the tensor product. These features of the coset sum suggest that it is worthwhile to develop and practice alternative methods to the tensor product for constructing multivariate wavelet systems. Some experimental results using 2-D images are presented to illustrate our findings.
△ Less
Submitted 18 January, 2014; v1 submitted 22 November, 2011;
originally announced November 2011.
