-
Tight Time Complexities in Parallel Stochastic Optimization with Arbitrary Computation Dynamics
Authors:
Alexander Tyurin
Abstract:
In distributed stochastic optimization, where parallel and asynchronous methods are employed, we establish optimal time complexities under virtually any computation behavior of workers/devices/CPUs/GPUs, capturing potential disconnections due to hardware and network delays, time-varying computation powers, and any possible fluctuations and trends of computation speeds. These real-world scenarios a…
▽ More
In distributed stochastic optimization, where parallel and asynchronous methods are employed, we establish optimal time complexities under virtually any computation behavior of workers/devices/CPUs/GPUs, capturing potential disconnections due to hardware and network delays, time-varying computation powers, and any possible fluctuations and trends of computation speeds. These real-world scenarios are formalized by our new universal computation model. Leveraging this model and new proof techniques, we discover tight lower bounds that apply to virtually all synchronous and asynchronous methods, including Minibatch SGD, Asynchronous SGD (Recht et al., 2011), and Picky SGD (Cohen et al., 2021). We show that these lower bounds, up to constant factors, are matched by the optimal Rennala SGD and Malenia SGD methods (Tyurin & Richtárik, 2023).
△ Less
Submitted 9 August, 2024;
originally announced August 2024.
-
On the Optimal Time Complexities in Decentralized Stochastic Asynchronous Optimization
Authors:
Alexander Tyurin,
Peter Richtárik
Abstract:
We consider the decentralized stochastic asynchronous optimization setup, where many workers asynchronously calculate stochastic gradients and asynchronously communicate with each other using edges in a multigraph. For both homogeneous and heterogeneous setups, we prove new time complexity lower bounds under the assumption that computation and communication speeds are bounded. We develop a new nea…
▽ More
We consider the decentralized stochastic asynchronous optimization setup, where many workers asynchronously calculate stochastic gradients and asynchronously communicate with each other using edges in a multigraph. For both homogeneous and heterogeneous setups, we prove new time complexity lower bounds under the assumption that computation and communication speeds are bounded. We develop a new nearly optimal method, Fragile SGD, and a new optimal method, Amelie SGD, that converge under arbitrary heterogeneous computation and communication speeds and match our lower bounds (up to a logarithmic factor in the homogeneous setting). Our time complexities are new, nearly optimal, and provably improve all previous asynchronous/synchronous stochastic methods in the decentralized setup.
△ Less
Submitted 25 May, 2024;
originally announced May 2024.
-
Freya PAGE: First Optimal Time Complexity for Large-Scale Nonconvex Finite-Sum Optimization with Heterogeneous Asynchronous Computations
Authors:
Alexander Tyurin,
Kaja Gruntkowska,
Peter Richtárik
Abstract:
In practical distributed systems, workers are typically not homogeneous, and due to differences in hardware configurations and network conditions, can have highly varying processing times. We consider smooth nonconvex finite-sum (empirical risk minimization) problems in this setup and introduce a new parallel method, Freya PAGE, designed to handle arbitrarily heterogeneous and asynchronous computa…
▽ More
In practical distributed systems, workers are typically not homogeneous, and due to differences in hardware configurations and network conditions, can have highly varying processing times. We consider smooth nonconvex finite-sum (empirical risk minimization) problems in this setup and introduce a new parallel method, Freya PAGE, designed to handle arbitrarily heterogeneous and asynchronous computations. By being robust to "stragglers" and adaptively ignoring slow computations, Freya PAGE offers significantly improved time complexity guarantees compared to all previous methods, including Asynchronous SGD, Rennala SGD, SPIDER, and PAGE, while requiring weaker assumptions. The algorithm relies on novel generic stochastic gradient collection strategies with theoretical guarantees that can be of interest on their own, and may be used in the design of future optimization methods. Furthermore, we establish a lower bound for smooth nonconvex finite-sum problems in the asynchronous setup, providing a fundamental time complexity limit. This lower bound is tight and demonstrates the optimality of Freya PAGE in the large-scale regime, i.e., when $\sqrt{m} \geq n$, where $n$ is # of workers, and $m$ is # of data samples.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Improving the Worst-Case Bidirectional Communication Complexity for Nonconvex Distributed Optimization under Function Similarity
Authors:
Kaja Gruntkowska,
Alexander Tyurin,
Peter Richtárik
Abstract:
Effective communication between the server and workers plays a key role in distributed optimization. In this paper, we focus on optimizing the server-to-worker communication, uncovering inefficiencies in prevalent downlink compression approaches. Considering first the pure setup where the uplink communication costs are negligible, we introduce MARINA-P, a novel method for downlink compression, emp…
▽ More
Effective communication between the server and workers plays a key role in distributed optimization. In this paper, we focus on optimizing the server-to-worker communication, uncovering inefficiencies in prevalent downlink compression approaches. Considering first the pure setup where the uplink communication costs are negligible, we introduce MARINA-P, a novel method for downlink compression, employing a collection of correlated compressors. Theoretical analyses demonstrates that MARINA-P with permutation compressors can achieve a server-to-worker communication complexity improving with the number of workers, thus being provably superior to existing algorithms. We further show that MARINA-P can serve as a starting point for extensions such as methods supporting bidirectional compression. We introduce M3, a method combining MARINA-P with uplink compression and a momentum step, achieving bidirectional compression with provable improvements in total communication complexity as the number of workers increases. Theoretical findings align closely with empirical experiments, underscoring the efficiency of the proposed algorithms.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
Authors:
Alexander Tyurin,
Marta Pozzi,
Ivan Ilin,
Peter Richtárik
Abstract:
We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers. Using an unbiassed compression technique, we develop a new method-Shadowheart SGD-that provably improves the time complexities of all…
▽ More
We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers. Using an unbiassed compression technique, we develop a new method-Shadowheart SGD-that provably improves the time complexities of all previous centralized methods. Moreover, we show that the time complexity of Shadowheart SGD is optimal in the family of centralized methods with compressed communication. We also consider the bidirectional setup, where broadcasting from the server to the workers is non-negligible, and develop a corresponding method.
△ Less
Submitted 7 February, 2024;
originally announced February 2024.
-
Symplectic reduction and lagrangian submanifolds in Gr$(1, n)$
Authors:
Nikolay A. Tyurin
Abstract:
We study lagrangian submanifolds of algebraic variety Gr(1, n) equipped with the Kahler form given by the Plucker embedding. We use the correspondence between lagrangian submanifolds of Gr(1, n) and lagrangian submanifolds of variety M_{n-k}, given by symplectic reduction Gr(1, n)//T^k for some specially chosen moment maps, which generate T^k action on Gr(1, n). We establish that in this way one f…
▽ More
We study lagrangian submanifolds of algebraic variety Gr(1, n) equipped with the Kahler form given by the Plucker embedding. We use the correspondence between lagrangian submanifolds of Gr(1, n) and lagrangian submanifolds of variety M_{n-k}, given by symplectic reduction Gr(1, n)//T^k for some specially chosen moment maps, which generate T^k action on Gr(1, n). We establish that in this way one finds many topological types, realized by lagrangian submanifolds, and then one counts that Gr(1, n) admits more than n different topological types of smooth lagrangian submanifolds.
△ Less
Submitted 28 June, 2024; v1 submitted 25 December, 2023;
originally announced December 2023.
-
Momentum Provably Improves Error Feedback!
Authors:
Ilyas Fatkhullin,
Alexander Tyurin,
Peter Richtárik
Abstract:
Due to the high communication overhead when training machine learning models in a distributed environment, modern algorithms invariably rely on lossy communication compression. However, when untreated, the errors caused by compression propagate, and can lead to severely unstable behavior, including exponential divergence. Almost a decade ago, Seide et al [2014] proposed an error feedback (EF) mech…
▽ More
Due to the high communication overhead when training machine learning models in a distributed environment, modern algorithms invariably rely on lossy communication compression. However, when untreated, the errors caused by compression propagate, and can lead to severely unstable behavior, including exponential divergence. Almost a decade ago, Seide et al [2014] proposed an error feedback (EF) mechanism, which we refer to as EF14, as an immensely effective heuristic for mitigating this issue. However, despite steady algorithmic and theoretical advances in the EF field in the last decade, our understanding is far from complete. In this work we address one of the most pressing issues. In particular, in the canonical nonconvex setting, all known variants of EF rely on very large batch sizes to converge, which can be prohibitive in practice. We propose a surprisingly simple fix which removes this issue both theoretically, and in practice: the application of Polyak's momentum to the latest incarnation of EF due to Richtárik et al. [2021] known as EF21. Our algorithm, for which we coin the name EF21-SGDM, improves the communication and sample complexities of previous error feedback algorithms under standard smoothness and bounded variance assumptions, and does not require any further strong assumptions such as bounded gradient dissimilarity. Moreover, we propose a double momentum version of our method that improves the complexities even further. Our proof seems to be novel even when compression is removed from the method, and as such, our proof technique is of independent interest in the study of nonconvex stochastic optimization enriched with Polyak's momentum.
△ Less
Submitted 30 October, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
Optimal Time Complexities of Parallel Stochastic Optimization Methods Under a Fixed Computation Model
Authors:
Alexander Tyurin,
Peter Richtárik
Abstract:
Parallelization is a popular strategy for improving the performance of iterative algorithms. Optimization methods are no exception: design of efficient parallel optimization methods and tight analysis of their theoretical properties are important research endeavors. While the minimax complexities are well known for sequential optimization methods, the theory of parallel optimization methods is les…
▽ More
Parallelization is a popular strategy for improving the performance of iterative algorithms. Optimization methods are no exception: design of efficient parallel optimization methods and tight analysis of their theoretical properties are important research endeavors. While the minimax complexities are well known for sequential optimization methods, the theory of parallel optimization methods is less explored. In this paper, we propose a new protocol that generalizes the classical oracle framework approach. Using this protocol, we establish minimax complexities for parallel optimization methods that have access to an unbiased stochastic gradient oracle with bounded variance. We consider a fixed computation model characterized by each worker requiring a fixed but worker-dependent time to calculate stochastic gradient. We prove lower bounds and develop optimal algorithms that attain them. Our results have surprising consequences for the literature of asynchronous optimization methods.
△ Less
Submitted 26 November, 2023; v1 submitted 21 May, 2023;
originally announced May 2023.
-
2Direction: Theoretically Faster Distributed Training with Bidirectional Communication Compression
Authors:
Alexander Tyurin,
Peter Richtárik
Abstract:
We consider distributed convex optimization problems in the regime when the communication between the server and the workers is expensive in both uplink and downlink directions. We develop a new and provably accelerated method, which we call 2Direction, based on fast bidirectional compressed communication and a new bespoke error-feedback mechanism which may be of independent interest. Indeed, we f…
▽ More
We consider distributed convex optimization problems in the regime when the communication between the server and the workers is expensive in both uplink and downlink directions. We develop a new and provably accelerated method, which we call 2Direction, based on fast bidirectional compressed communication and a new bespoke error-feedback mechanism which may be of independent interest. Indeed, we find that the EF and EF21-P mechanisms (Seide et al., 2014; Gruntkowska et al., 2023) that have considerable success in the design of efficient non-accelerated methods are not appropriate for accelerated methods. In particular, we prove that 2Direction improves the previous state-of-the-art communication complexity $\widetildeΘ\left(K \times \left(\frac{L}{αμ} + \frac{L_{\max} ω}{n μ} + ω\right)\right)$ (Gruntkowska et al., 2023) to $\widetildeΘ(K \times (\sqrt{\frac{L (ω+ 1)}{αμ}} + \sqrt{\frac{L_{\max} ω^2}{n μ}} + \frac{1}α + ω))$ in the $μ$-strongly-convex setting, where $L$ and $L_{\max}$ are smoothness constants, $n$ is # of workers, $ω$ and $α$ are compression errors of the Rand$K$ and Top$K$ sparsifiers (as examples), $K$ is # of coordinates/bits that the server and workers send to each other. Moreover, our method is the first that improves upon the communication complexity of the vanilla accelerated gradient descent (AGD) method (Nesterov, 2018). We obtain similar improvements in the general convex regime as well. Finally, our theoretical findings are corroborated by experimental evidence.
△ Less
Submitted 26 November, 2023; v1 submitted 21 May, 2023;
originally announced May 2023.
-
EF21-P and Friends: Improved Theoretical Communication Complexity for Distributed Optimization with Bidirectional Compression
Authors:
Kaja Gruntkowska,
Alexander Tyurin,
Peter Richtárik
Abstract:
In this work we focus our attention on distributed optimization problems in the context where the communication time between the server and the workers is non-negligible. We obtain novel methods supporting bidirectional compression (both from the server to the workers and vice versa) that enjoy new state-of-the-art theoretical communication complexity for convex and nonconvex problems. Our bounds…
▽ More
In this work we focus our attention on distributed optimization problems in the context where the communication time between the server and the workers is non-negligible. We obtain novel methods supporting bidirectional compression (both from the server to the workers and vice versa) that enjoy new state-of-the-art theoretical communication complexity for convex and nonconvex problems. Our bounds are the first that manage to decouple the variance/error coming from the workers-to-server and server-to-workers compression, transforming a multiplicative dependence to an additive one. Moreover, in the convex regime, we obtain the first bounds that match the theoretical communication complexity of gradient descent. Even in this convex regime, our algorithms work with biased gradient estimators, which is non-standard and requires new proof techniques that may be of independent interest. Finally, our theoretical results are corroborated through suitable experiments.
△ Less
Submitted 20 May, 2023; v1 submitted 30 September, 2022;
originally announced September 2022.
-
Sharper Rates and Flexible Framework for Nonconvex SGD with Client and Data Sampling
Authors:
Alexander Tyurin,
Lukang Sun,
Konstantin Burlachenko,
Peter Richtárik
Abstract:
We revisit the classical problem of finding an approximately stationary point of the average of $n$ smooth and possibly nonconvex functions. The optimal complexity of stochastic first-order methods in terms of the number of gradient evaluations of individual functions is $\mathcal{O}\left(n + n^{1/2}\varepsilon^{-1}\right)$, attained by the optimal SGD methods $\small\sf\color{green}{SPIDER}$(arXi…
▽ More
We revisit the classical problem of finding an approximately stationary point of the average of $n$ smooth and possibly nonconvex functions. The optimal complexity of stochastic first-order methods in terms of the number of gradient evaluations of individual functions is $\mathcal{O}\left(n + n^{1/2}\varepsilon^{-1}\right)$, attained by the optimal SGD methods $\small\sf\color{green}{SPIDER}$(arXiv:1807.01695) and $\small\sf\color{green}{PAGE}$(arXiv:2008.10898), for example, where $\varepsilon$ is the error tolerance. However, i) the big-$\mathcal{O}$ notation hides crucial dependencies on the smoothness constants associated with the functions, and ii) the rates and theory in these methods assume simplistic sampling mechanisms that do not offer any flexibility. In this work we remedy the situation. First, we generalize the $\small\sf\color{green}{PAGE}$ algorithm so that it can provably work with virtually any (unbiased) sampling mechanism. This is particularly useful in federated learning, as it allows us to construct and better understand the impact of various combinations of client and data sampling strategies. Second, our analysis is sharper as we make explicit use of certain novel inequalities that capture the intricate interplay between the smoothness constants and the sampling procedure. Indeed, our analysis is better even for the simple sampling procedure analyzed in the $\small\sf\color{green}{PAGE}$ paper. However, this already improved bound can be further sharpened by a different sampling scheme which we propose. In summary, we provide the most general and most accurate analysis of optimal SGD in the smooth nonconvex regime. Finally, our theoretical findings are supposed with carefully designed experiments.
△ Less
Submitted 5 June, 2022;
originally announced June 2022.
-
A Computation and Communication Efficient Method for Distributed Nonconvex Problems in the Partial Participation Setting
Authors:
Alexander Tyurin,
Peter Richtárik
Abstract:
We present a new method that includes three key components of distributed optimization and federated learning: variance reduction of stochastic gradients, partial participation, and compressed communication. We prove that the new method has optimal oracle complexity and state-of-the-art communication complexity in the partial participation setting. Regardless of the communication compression featu…
▽ More
We present a new method that includes three key components of distributed optimization and federated learning: variance reduction of stochastic gradients, partial participation, and compressed communication. We prove that the new method has optimal oracle complexity and state-of-the-art communication complexity in the partial participation setting. Regardless of the communication compression feature, our method successfully combines variance reduction and partial participation: we get the optimal oracle complexity, never need the participation of all nodes, and do not require the bounded gradients (dissimilarity) assumption.
△ Less
Submitted 3 January, 2024; v1 submitted 31 May, 2022;
originally announced May 2022.
-
Permutation Compressors for Provably Faster Distributed Nonconvex Optimization
Authors:
Rafał Szlendak,
Alexander Tyurin,
Peter Richtárik
Abstract:
We study the MARINA method of Gorbunov et al (2021) -- the current state-of-the-art distributed non-convex optimization method in terms of theoretical communication complexity. Theoretical superiority of this method can be largely attributed to two sources: the use of a carefully engineered biased stochastic gradient estimator, which leads to a reduction in the number of communication rounds, and…
▽ More
We study the MARINA method of Gorbunov et al (2021) -- the current state-of-the-art distributed non-convex optimization method in terms of theoretical communication complexity. Theoretical superiority of this method can be largely attributed to two sources: the use of a carefully engineered biased stochastic gradient estimator, which leads to a reduction in the number of communication rounds, and the reliance on {\em independent} stochastic communication compression operators, which leads to a reduction in the number of transmitted bits within each communication round. In this paper we i) extend the theory of MARINA to support a much wider class of potentially {\em correlated} compressors, extending the reach of the method beyond the classical independent compressors setting, ii) show that a new quantity, for which we coin the name {\em Hessian variance}, allows us to significantly refine the original analysis of MARINA without any additional assumptions, and iii) identify a special class of correlated compressors based on the idea of {\em random permutations}, for which we coin the term Perm$K$, the use of which leads to $O(\sqrt{n})$ (resp. $O(1 + d/\sqrt{n})$) improvement in the theoretical communication complexity of MARINA in the low Hessian variance regime when $d\geq n$ (resp. $d \leq n$), where $n$ is the number of workers and $d$ is the number of parameters describing the model we are learning. We corroborate our theoretical results with carefully engineered synthetic experiments with minimizing the average of nonconvex quadratics, and on autoencoder training with the MNIST dataset.
△ Less
Submitted 7 October, 2021;
originally announced October 2021.
-
Lagrangian geometry of algebraic varieties
Authors:
Nikolay A. Tyurin
Abstract:
Every algebraic variety can be regarded as a symplectic manifold being equipped with a Kahler form. Therefore it is natural to study lagrangian geometry of any algebraic variety. We present two basic constructions which can be applied to a sufficiently wide set of algebraic varieties.
Every algebraic variety can be regarded as a symplectic manifold being equipped with a Kahler form. Therefore it is natural to study lagrangian geometry of any algebraic variety. We present two basic constructions which can be applied to a sufficiently wide set of algebraic varieties.
△ Less
Submitted 1 September, 2021;
originally announced September 2021.
-
Special Bohr-Sommerfeld geometry: variations
Authors:
Nikolay A. Tyurin
Abstract:
In the paper we continue to study Special Bohr-Sommerfeld geometry of compact symplectic manifolds. Using natural deformation parameters we avoid the difficulties appeared in the definition of the moduli space of Special Bohr-Sommerfeld cycles for compact simply connected algebraic varieties. As a byproduct we present certain remarks on the Weinstein structures and Eliashberg conjectures.
In the paper we continue to study Special Bohr-Sommerfeld geometry of compact symplectic manifolds. Using natural deformation parameters we avoid the difficulties appeared in the definition of the moduli space of Special Bohr-Sommerfeld cycles for compact simply connected algebraic varieties. As a byproduct we present certain remarks on the Weinstein structures and Eliashberg conjectures.
△ Less
Submitted 26 April, 2021;
originally announced April 2021.
-
Development of a method for solving structural optimization problems
Authors:
Alexander Tyurin
Abstract:
In practice, optimization tasks have some structure that allows developing new algorithms for every problem with faster convergence rates. Using the structure of optimization tasks, we can propose algorithms with more optimistic convergence rates for the following optimization problems: functions with Holder continuous gradients, superposition of functions (min-max problems), transportation proble…
▽ More
In practice, optimization tasks have some structure that allows developing new algorithms for every problem with faster convergence rates. Using the structure of optimization tasks, we can propose algorithms with more optimistic convergence rates for the following optimization problems: functions with Holder continuous gradients, superposition of functions (min-max problems), transportation problems, clustering by electorial model. In this work, we propose the unification of gradient-type methods into one method using a special concept of inexact model and develop a series of methods that can solve generalized optimization problem statements and use its structure with the aid of the proposed concept of inexact model. We constructed the gradient method for problems with relative smoothness, the primal--dual adaptive gradient and fast gradient methods, and the stochastic nonadaptive gradient methods that support an inexact model of a function. Moreover, the concept of inexact model is supported by different examples of optimization problems.
△ Less
Submitted 30 August, 2020;
originally announced August 2020.
-
Constructing Mironov cycles in complex Grassmannians
Authors:
Nikolai A. Tyurin
Abstract:
A. Mironov proposed a construction of lagrangian submanifolds in $\mathbb{C}^n$ and $\mathbb{C} \mathbb{P}^n$; there he was mostly motivated by the fact that these lagrangian submanifolds (which can have in general self intersections, therefore below we call them lagrangian cycles) present new example of minimal or Hamiltonian minimal lagrangian submanifolds. However the Mironov construction of la…
▽ More
A. Mironov proposed a construction of lagrangian submanifolds in $\mathbb{C}^n$ and $\mathbb{C} \mathbb{P}^n$; there he was mostly motivated by the fact that these lagrangian submanifolds (which can have in general self intersections, therefore below we call them lagrangian cycles) present new example of minimal or Hamiltonian minimal lagrangian submanifolds. However the Mironov construction of lagrangian cycles itself can be directly extended to much wider class of compact algrebraic varieties: namely it works in the case when algebraic variety $X$ of complex dimension $n$ admits $T^k$ - action and an anti - holomorphic involution such that the real part $X_{\mathbb{R}} \subset X$ has real dimension $n$ and is transversal to the torus action. For this case one has families of lagrangian submanifolds and cycles.
In the present small text we show how the construction of Mironov cycles works for the complex Grassmannians, resulting in simple examples of smooth lagrangian submanifolds in ${\rm Gr}(k, n+1)$, equipped with a standard Kahler form under the Plücker embedding. For sure the text is not complete but in the new reality we would like to fix it, hoping to continue the investigations and to present in a future complete list of Mironov cycles in ${\rm Gr}(k, n+1)$.
△ Less
Submitted 5 May, 2020;
originally announced May 2020.
-
Accelerated and nonaccelerated stochastic gradient descent with inexact model
Authors:
Darina Dvinskikh,
Alexander Tyurin,
Alexander Gasnikov,
Sergey Omelchenko
Abstract:
In this paper, we propose a new way to obtain optimal convergence rates for smooth stochastic (strong) convex optimization tasks. Our approach is based on results for optimization tasks where gradients have nonrandom noise. In contrast to previously known results, we extend our idea to the inexact model conception.
In this paper, we propose a new way to obtain optimal convergence rates for smooth stochastic (strong) convex optimization tasks. Our approach is based on results for optimization tasks where gradients have nonrandom noise. In contrast to previously known results, we extend our idea to the inexact model conception.
△ Less
Submitted 15 April, 2020; v1 submitted 9 April, 2020;
originally announced April 2020.
-
Oracle Complexity Separation in Convex Optimization
Authors:
Anastasiya Ivanova,
Evgeniya Vorontsova,
Dmitry Pasechnyuk,
Alexander Gasnikov,
Pavel Dvurechensky,
Darina Dvinskikh,
Alexander Tyurin
Abstract:
Many convex optimization problems have structured objective function written as a sum of functions with different types of oracles (full gradient, coordinate derivative, stochastic gradient) and different evaluation complexity of these oracles. In the strongly convex case these functions also have different condition numbers, which eventually define the iteration complexity of first-order methods…
▽ More
Many convex optimization problems have structured objective function written as a sum of functions with different types of oracles (full gradient, coordinate derivative, stochastic gradient) and different evaluation complexity of these oracles. In the strongly convex case these functions also have different condition numbers, which eventually define the iteration complexity of first-order methods and the number of oracle calls required to achieve given accuracy. Motivated by the desire to call more expensive oracle less number of times, in this paper we consider minimization of a sum of two functions and propose a generic algorithmic framework to separate oracle complexities for each component in the sum. As a specific example, for the $μ$-strongly convex problem $\min_{x\in \mathbb{R}^n} h(x) + g(x)$ with $L_h$-smooth function $h$ and $L_g$-smooth function $g$, a special case of our algorithm requires, up to a logarithmic factor, $O(\sqrt{L_h/μ})$ first-order oracle calls for $h$ and $O(\sqrt{L_g/μ})$ first-order oracle calls for $g$. Our general framework covers also the setting of strongly convex objectives, the setting when $g$ is given by coordinate derivative oracle, and the setting when $g$ has a finite-sum structure and is available through stochastic gradient oracle. In the latter two cases we obtain respectively accelerated random coordinate descent and accelerated variance reduction methods with oracle complexity separation.
△ Less
Submitted 11 March, 2022; v1 submitted 7 February, 2020;
originally announced February 2020.
-
Inexact Relative Smoothness and Strong Convexity for Optimization and Variational Inequalities by Inexact Model
Authors:
Fedor Stonyakin,
Alexander Tyurin,
Alexander Gasnikov,
Pavel Dvurechensky,
Artem Agafonov,
Darina Dvinskikh,
Mohammad Alkousa,
Dmitry Pasechnyuk,
Sergei Artamonov,
Victorya Piskunova
Abstract:
In this paper, we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems, and variational inequalities. This framework allows obtaining many known methods as a special case, the list including accelerated gradient method, composite optimization methods, level-set methods, Bregman proximal methods. The…
▽ More
In this paper, we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems, and variational inequalities. This framework allows obtaining many known methods as a special case, the list including accelerated gradient method, composite optimization methods, level-set methods, Bregman proximal methods. The idea of the framework is based on constructing an inexact model of the main problem component, i.e. objective function in optimization or operator in variational inequalities. Besides reproducing known results, our framework allows constructing new methods, which we illustrate by constructing a universal conditional gradient method and a universal method for variational inequalities with a composite structure. This method works for smooth and non-smooth problems with optimal complexity without a priori knowledge of the problem's smoothness. As a particular case of our general framework, we introduce relative smoothness for operators and propose an algorithm for variational inequalities (VIs) with such operators. We also generalize our framework for relatively strongly convex objectives and strongly monotone variational inequalities.
This paper is an extended and updated version of [arXiv:1902.00990]. In particular, we add an extension of relative strong convexity for optimization and variational inequalities.
△ Less
Submitted 19 December, 2021; v1 submitted 23 January, 2020;
originally announced January 2020.
-
Accelerated and nonaccelerated stochastic gradient descent with model conception
Authors:
Darina Dvinskikh,
Alexander Tyurin,
Alexander Gasnikov,
Sergey Omelchenko
Abstract:
In this paper, we describe a new way to get convergence rates for optimal methods in smooth (strongly) convex optimization tasks. Our approach is based on results for tasks where gradients have nonrandom small noises. Unlike previous results, we obtain convergence rates with model conception.
In this paper, we describe a new way to get convergence rates for optimal methods in smooth (strongly) convex optimization tasks. Our approach is based on results for tasks where gradients have nonrandom small noises. Unlike previous results, we obtain convergence rates with model conception.
△ Less
Submitted 13 July, 2020; v1 submitted 10 January, 2020;
originally announced January 2020.
-
Accelerated gradient sliding and variance reduction
Authors:
Darina Dvinskikh,
Sergey Omelchenko,
Alexander Tyurin,
Alexander Gasnikov
Abstract:
We consider sum-type strongly convex optimization problem (first term) with smooth convex not proximal friendly composite (second term). We show that the complexity of this problem can be split into optimal number of incremental oracle calls for the first (sum-type) term and optimal number of oracle calls for the second (composite) term. Here under `optimal number' we mean estimate that correspond…
▽ More
We consider sum-type strongly convex optimization problem (first term) with smooth convex not proximal friendly composite (second term). We show that the complexity of this problem can be split into optimal number of incremental oracle calls for the first (sum-type) term and optimal number of oracle calls for the second (composite) term. Here under `optimal number' we mean estimate that corresponds to the well known lower bound in the absence of another term.
△ Less
Submitted 11 March, 2020; v1 submitted 25 December, 2019;
originally announced December 2019.
-
Adaptive Gradient Descent for Convex and Non-Convex Stochastic Optimization
Authors:
Darina Dvinskikh,
Aleksandr Ogaltsov,
Alexander Gasnikov,
Pavel Dvurechensky,
Alexander Tyurin,
Vladimir Spokoiny
Abstract:
In this paper we propose several adaptive gradient methods for stochastic optimization. Unlike AdaGrad-type of methods, our algorithms are based on Armijo-type line search and they simultaneously adapt to the unknown Lipschitz constant of the gradient and variance of the stochastic approximation for the gradient. We consider an accelerated and non-accelerated gradient descent for convex problems a…
▽ More
In this paper we propose several adaptive gradient methods for stochastic optimization. Unlike AdaGrad-type of methods, our algorithms are based on Armijo-type line search and they simultaneously adapt to the unknown Lipschitz constant of the gradient and variance of the stochastic approximation for the gradient. We consider an accelerated and non-accelerated gradient descent for convex problems and gradient descent for non-convex problems. In the experiments we demonstrate superiority of our methods to existing adaptive methods, e.g. AdaGrad and Adam.
△ Less
Submitted 12 June, 2020; v1 submitted 19 November, 2019;
originally announced November 2019.
-
Heuristic adaptive fast gradient method in stochastic optimization tasks
Authors:
Alexander Ogaltsov,
Alexander Tyurin
Abstract:
In this paper, we present a heuristic adaptive fast gradient method. We show that in practice our method has a better convergence rate than popular today optimization methods. Moreover, we justify our method and point out some problems that do not allow us to obtain theoretical estimates.
In this paper, we present a heuristic adaptive fast gradient method. We show that in practice our method has a better convergence rate than popular today optimization methods. Moreover, we justify our method and point out some problems that do not allow us to obtain theoretical estimates.
△ Less
Submitted 10 October, 2019;
originally announced October 2019.
-
Primal-dual fast gradient method with a model
Authors:
Alexander Tyurin
Abstract:
In this work we consider a possibility to use the conception of $(δ, L)$-model of a function for optimization tasks, whereby solving a primal problem there is a necessity to recover a solution of a dual problem. The conception of $(δ, L)$-model is based on the conception of $(δ, L)$-oracle which was proposed by Devolder-Glineur-Nesterov, herewith the authors proposed approximate a function with an…
▽ More
In this work we consider a possibility to use the conception of $(δ, L)$-model of a function for optimization tasks, whereby solving a primal problem there is a necessity to recover a solution of a dual problem. The conception of $(δ, L)$-model is based on the conception of $(δ, L)$-oracle which was proposed by Devolder-Glineur-Nesterov, herewith the authors proposed approximate a function with an upper bound using a convex quadratic function with some additive noise $δ$. They managed to get convex quadratic upper bounds with noise even for nonsmooth functions. The conception of $(δ, L)$-model continues this idea by using instead of a convex quadratic function a more complex convex function in an upper bound. Possibility to recover the solution of a dual problem gives great benefits in different problems, for instance, in some cases, it is faster to find a solution in a primal problem than in a dual problem. Note that primal-dual methods are well studied, but usually each class of optimization problems has its own primal-dual method. Our goal is to develop a method which can find solutions in different classes of optimization problems. This is realized through the use of the conception of $(δ, L)$-model and adaptive structure of our methods. Thereby, we developed primal-dual adaptive gradient method and fast gradient method with $(δ, L)$-model and proved convergence rates of the methods, moreover, for some classes of optimization problems the rates are optimal. The main idea is the following: we find a dual solution to an approximation of a primal problem using the conception of $(δ, L)$-model. It is much easier to find a solution to an approximated problem, however, we have to do it in each step of our method, thereby the principle of "divide and conquer" is realized.
△ Less
Submitted 24 June, 2019;
originally announced June 2019.
-
Monotonic lagrangian tori of standard and non standard types in toric and pseudotoric manifolds
Authors:
Nikolai A. Tyurin
Abstract:
In recent papers, summarized in survey [1], we construct a number of examples of non standard lagrangian tori on compact toric varieties and as well on certain non toric varieties which admit pseudotoric structures. Using this pseudotoric technique we explain how non standard lagrangian tori of Chekanov type can be constructed and what is the topological difference between standard Liouville tori…
▽ More
In recent papers, summarized in survey [1], we construct a number of examples of non standard lagrangian tori on compact toric varieties and as well on certain non toric varieties which admit pseudotoric structures. Using this pseudotoric technique we explain how non standard lagrangian tori of Chekanov type can be constructed and what is the topological difference between standard Liouville tori and the non standard ones. However we have not discussed the natural question about the periods of the constructed twist tori; in particular the monotonicity problem for the monotonic case was not studied there. In the paper we present several remarks on these questions, in particular we show for the monotonic case how to construct non standard lagrangian tori which satisify the monotonicity condition. First of all we study non standard tori which are Bohr - Sommerfeld with respect to the anticanonical class. This notion was introduced in [2], where one defines certain universal Maslov class for the ${\rm BS}_{can}$ lagrangian submanifolds in compact simply connected monotonic symplectic manifolds. Then we show how monotonic non standard lagrangian tori of Chekanov type can be constructed. Furthemore we extend the consideration to pseudotoric setup and construct examples of monotonic lagrangian tori in non toric monotonic manifolds: complex 4 - dimensional quadric and full flag variety $F^3$.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
Gradient Methods for Problems with Inexact Model of the Objective
Authors:
Fedor Stonyakin,
Darina Dvinskikh,
Pavel Dvurechensky,
Alexey Kroshnin,
Olesya Kuznetsova,
Artem Agafonov,
Alexander Gasnikov,
Alexander Tyurin,
César A. Uribe,
Dmitry Pasechnyuk,
Sergei Artamonov
Abstract:
We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes $(δ,L)$ inexact oracle and relative smoothness condition. We analyze gradient method which uses this inexact model and obtain convergence rates for convex and strongly convex problems. To show potent…
▽ More
We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes $(δ,L)$ inexact oracle and relative smoothness condition. We analyze gradient method which uses this inexact model and obtain convergence rates for convex and strongly convex problems. To show potential applications of our general framework we consider three particular problems. The first one is clustering by electorial model introduced in [Nesterov, 2018]. The second one is approximating optimal transport distance, for which we propose a Proximal Sinkhorn algorithm. The third one is devoted to approximating optimal transport barycenter and we propose a Proximal Iterative Bregman Projections algorithm. We also illustrate the practical performance of our algorithms by numerical experiments.
△ Less
Submitted 23 March, 2019; v1 submitted 24 February, 2019;
originally announced February 2019.
-
Inexact Model: A Framework for Optimization and Variational Inequalities
Authors:
Fedor Stonyakin,
Alexander Gasnikov,
Alexander Tyurin,
Dmitry Pasechnyuk,
Artem Agafonov,
Pavel Dvurechensky,
Darina Dvinskikh,
Alexey Kroshnin,
Victorya Piskunova
Abstract:
In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many known methods as a special case, the list including accelerated gradient method, composite optimization methods, level-set methods, proximal methods. The idea of t…
▽ More
In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many known methods as a special case, the list including accelerated gradient method, composite optimization methods, level-set methods, proximal methods. The idea of the framework is based on constructing an inexact model of the main problem component, i.e. objective function in optimization or operator in variational inequalities. Besides reproducing known results, our framework allows to construct new methods, which we illustrate by constructing a universal method for variational inequalities with composite structure. This method works for smooth and non-smooth problems with optimal complexity without a priori knowledge of the problem smoothness. We also generalize our framework for strongly convex objectives and strongly monotone variational inequalities.
△ Less
Submitted 5 January, 2020; v1 submitted 3 February, 2019;
originally announced February 2019.
-
On a complexification of the moduli space of Bohr - Sommerfeld lagrangian cycles
Authors:
Nikolai A. Tyurin
Abstract:
In the previous papers we present a construction of the set ${\cal U}_{SBS}$ in the direct product ${\cal B}_S \times \mathbb{P} Γ(M, L)$ of the moduli space of Bohr - Sommerfeld lagrangian submanifolds of fixed topological type and the projectivized space of smooth sections of the prequantization bundle $L \to M$ over a given compact simply connected symplectic manifold $M$. Canonical projections…
▽ More
In the previous papers we present a construction of the set ${\cal U}_{SBS}$ in the direct product ${\cal B}_S \times \mathbb{P} Γ(M, L)$ of the moduli space of Bohr - Sommerfeld lagrangian submanifolds of fixed topological type and the projectivized space of smooth sections of the prequantization bundle $L \to M$ over a given compact simply connected symplectic manifold $M$. Canonical projections $p: {\cal U}_{SBS} \to \mathbb{P} Γ(M, L)$ and $q: {\cal U}_{SBS} \to {\cal B}_S$ are studied in the present text: first, we show that the differential ${\rm d} p$ at a given point is an isomorphism, which implies that a natural complex structure can be defined on ${\cal U}_{SBS}$; second, the projection $q: {\cal U}_{SBS} \to {\cal B}_S$ splits as the combination ${\cal U}_{SBS} \to T {\cal B}_S \to {\cal B}_S$ such that the fibers of the first map are complex subsets in ${\cal U}_{SBS}$. This implies that an appropriate section of the first map should define a complex structure on $T {\cal B}_S$; therefore it can be seen as a complexification of the moduli space ${\cal B}_S$. The construction can be exploited in the Lagrangian approach to Geometric Quantization
△ Less
Submitted 30 July, 2018;
originally announced July 2018.
-
New example of modified moduli space of special Bohr - Sommerfeld lagrangian submanifolds
Authors:
Nik. A. Tyurin
Abstract:
We present an example of modified moduli space of special Bohr - Sommerfeld lagrangian submanifolds for the case when the given algebraic variety is the full flag $F^3$ for $\mathbb{C}^3$ and the very ample bundle is $K^{- \frac{1}{2}}_{F^3}$
We present an example of modified moduli space of special Bohr - Sommerfeld lagrangian submanifolds for the case when the given algebraic variety is the full flag $F^3$ for $\mathbb{C}^3$ and the very ample bundle is $K^{- \frac{1}{2}}_{F^3}$
△ Less
Submitted 2 February, 2018;
originally announced February 2018.
-
Adaptive fast gradient method in stochastic optimization tasks
Authors:
Alexander Tyurin
Abstract:
In this paper, we describe a stochastic adaptive fast gradient descent method based on the mirror variant of similar triangles method. To our knowledge, this is the first attempt to use adaptivity in stochastic method. Additionally, a main result was proved in terms of probabilities of large deviations.
In this paper, we describe a stochastic adaptive fast gradient descent method based on the mirror variant of similar triangles method. To our knowledge, this is the first attempt to use adaptivity in stochastic method. Additionally, a main result was proved in terms of probabilities of large deviations.
△ Less
Submitted 30 November, 2017;
originally announced December 2017.
-
Fast gradient descent method for convex optimization problems with an oracle that generates a $(δ,L)$-model of a function in a requested point
Authors:
Alexander Tyurin,
Alexander Gasnikov
Abstract:
In this article we propose a new concept of a $(δ,L)$-model of a function which generalizes the concept of the $(δ,L)$-oracle (Devolder-Glineur-Nesterov). Using this concept we describe the gradient descent method and the fast gradient descent method and we show that many popular methods (composite optimization methods, level methods, conjugate gradient methods, proximal methods) are special cases…
▽ More
In this article we propose a new concept of a $(δ,L)$-model of a function which generalizes the concept of the $(δ,L)$-oracle (Devolder-Glineur-Nesterov). Using this concept we describe the gradient descent method and the fast gradient descent method and we show that many popular methods (composite optimization methods, level methods, conjugate gradient methods, proximal methods) are special cases of proposed methods in this article.
△ Less
Submitted 24 June, 2019; v1 submitted 7 November, 2017;
originally announced November 2017.
-
Towards the moduli space of special Bohr - Sommerfeld lagrangian cycles
Authors:
Nikolay A. Tyurin
Abstract:
In previous papers we introduced the notion of special Bohr - Sommerfeld lagrangian cycles on a compact simply connected symplectic manifold with integer symplectic form, and presented the main interesting case: compact simply connected algebraic variety with an ample line bundle such that the space of Bohr - Sommerfeld lagrangian cycles with respect to a compatible Kahler form of the Hodge type a…
▽ More
In previous papers we introduced the notion of special Bohr - Sommerfeld lagrangian cycles on a compact simply connected symplectic manifold with integer symplectic form, and presented the main interesting case: compact simply connected algebraic variety with an ample line bundle such that the space of Bohr - Sommerfeld lagrangian cycles with respect to a compatible Kahler form of the Hodge type and holomorphic sections of the bundle is finite. The main problem appeared in this way is singular components of the corresponding lagrangian shadows (or sceletons of the corresponding Weinstein domains) which are hard to distinguish or resolve. In the present text we avoid this difficulty presenting the points of the moduli space of special Bohr - Sommerfeld lagrangian cycles by exact compact lagrangian submanifolds on the complements $X \backslash D_α$ modulo Hamiltonian isotopies, where $D_α$ is the zero divisor of holomorphic section $α$. In a sense it corresponds to the usage of gauge classes of hermitian connections instead of pure holomorphic structures in the theory of the moduli space of (semi) stable vector bundles.
△ Less
Submitted 2 August, 2017;
originally announced August 2017.
-
Mirror version of similar triangles method for constrained optimization problems
Authors:
Alexander Tyurin
Abstract:
Science about optimization methods is rapidly developing today. In machine learning, computer vision, biology, medicine, construction and in many other different areas optimization methods have vast popularity and they appear as important tool. One of the most important goals in optimization: create some "universal" method, which will have good performance in all problems regardless smoothness of…
▽ More
Science about optimization methods is rapidly developing today. In machine learning, computer vision, biology, medicine, construction and in many other different areas optimization methods have vast popularity and they appear as important tool. One of the most important goals in optimization: create some "universal" method, which will have good performance in all problems regardless smoothness of a task, computation precision of gradient and other parameters which characterize a problem. In this thesis we propose a method which is "universal" for different problems and, at the same time, is simple for understanding.
△ Less
Submitted 27 May, 2017;
originally announced May 2017.
-
On the existence of Lagrangian shadows of ample algebraic divisors
Authors:
Nik. A. Tyurin
Abstract:
In previous papers we define certain Lagrangian shadows of ample divisors in algebraic varieties. In the present brief note an existence condition is discussed for these Lagrangian shadows.
In previous papers we define certain Lagrangian shadows of ample divisors in algebraic varieties. In the present brief note an existence condition is discussed for these Lagrangian shadows.
△ Less
Submitted 5 September, 2016; v1 submitted 2 September, 2016;
originally announced September 2016.
-
Special Bohr - Sommerfeld geometry on Riemann surfaces: toy problems
Authors:
Nikolai A. Tyurin
Abstract:
Special Bohr - Sommerfeld geometry, first formulated for simply connected symplectic manifolds (or for simple connected algebraic varieties), gives rise to some natural problems for the simplest example in non simply connected case. Namely for any algebraic curve one can define a correspondence between holomorphic differentials and certain finite graphs. Here we ask some natural questions appear w…
▽ More
Special Bohr - Sommerfeld geometry, first formulated for simply connected symplectic manifolds (or for simple connected algebraic varieties), gives rise to some natural problems for the simplest example in non simply connected case. Namely for any algebraic curve one can define a correspondence between holomorphic differentials and certain finite graphs. Here we ask some natural questions appear with this correspondence. It is a partial answer to the question of A. Varchenko about possibility of applications of Special Bohr -Sommerfeld geometry in non simply connected case. The russian version has been translated.
△ Less
Submitted 25 October, 2016; v1 submitted 18 May, 2016;
originally announced May 2016.
-
Lagrangian shadows of ample algebraic divisors
Authors:
Nikolay A. Tyurin
Abstract:
In the framework of Special Bohr - Sommerfeld geometry it was established that an ample divisor in compact algebraic variety can define almost canonically certain real submanifold which is lagrangian with respect to the corresponding Kahler form. It is natural to call it "lagrangian shadow"; below we emphasize this correspondence and present some simple examples, old and new. In particular we show…
▽ More
In the framework of Special Bohr - Sommerfeld geometry it was established that an ample divisor in compact algebraic variety can define almost canonically certain real submanifold which is lagrangian with respect to the corresponding Kahler form. It is natural to call it "lagrangian shadow"; below we emphasize this correspondence and present some simple examples, old and new. In particular we show that for irreducible divisors from the linear system $\vert - \frac{1}{2} K_{F^3} \vert$ on the full flag variety $F^3$ their lagrangian shadows are Gelfand - Zeytlin type lagrangian 3 - spheres.
△ Less
Submitted 22 January, 2016;
originally announced January 2016.
-
Special Bohr - Sommerfeld geometry
Authors:
Nikolay A. Tyurin
Abstract:
We present a new approach to special lagrangian geometry which works for Bohr - Sommerfeld lagrangian submanifolds of symplectic manifolds with integer symplectic forms. This leads to construction of finite dimensional moduli spaces of SBS lagrangian cycles over algebraic varieties.
We present a new approach to special lagrangian geometry which works for Bohr - Sommerfeld lagrangian submanifolds of symplectic manifolds with integer symplectic forms. This leads to construction of finite dimensional moduli spaces of SBS lagrangian cycles over algebraic varieties.
△ Less
Submitted 27 August, 2015;
originally announced August 2015.
-
Special Bohr - Sommerfeld lagrangian submanifolds in algebraic varieties
Authors:
Nik. A. Tyurin
Abstract:
We present a new notion of speciality which is valid for Bohr - Sommerfeld lagrangian submanifolds. For algebraic varieties it leads to the construction of finite dimensional moduli spaces which are algebraic starting with any ample line bundle. The construction can be exploited both in Geometric Quantization and Mirror Symmetry.
We present a new notion of speciality which is valid for Bohr - Sommerfeld lagrangian submanifolds. For algebraic varieties it leads to the construction of finite dimensional moduli spaces which are algebraic starting with any ample line bundle. The construction can be exploited both in Geometric Quantization and Mirror Symmetry.
△ Less
Submitted 10 April, 2015;
originally announced April 2015.
-
Special lagrangian fibrations on flag variety $F^3$
Authors:
Nikolay A. Tyurin
Abstract:
One constructs lagrangian fibrations on the flag variety $F^3$ and proves that the fibrations are special.
One constructs lagrangian fibrations on the flag variety $F^3$ and proves that the fibrations are special.
△ Less
Submitted 12 May, 2010;
originally announced May 2010.
-
Twist tori and pseudo toric structures
Authors:
Nikolay A. Tyurin
Abstract:
Twist tori are examples of exotic monotone lagrangian tori, presented in [1]. This tree of examples grew up over the first one --- the torus $Θ\in \R^4$, constructured in [2] and [3]. On the other hand, in [4] and [5] we proposed a new structure which generalizes the notion of toric structure. One calls this generalization pseudo toric structure, and several examples were given which show that ce…
▽ More
Twist tori are examples of exotic monotone lagrangian tori, presented in [1]. This tree of examples grew up over the first one --- the torus $Θ\in \R^4$, constructured in [2] and [3]. On the other hand, in [4] and [5] we proposed a new structure which generalizes the notion of toric structure. One calls this generalization pseudo toric structure, and several examples were given which show that certain toric symplectic manifolds can carry the structre and that certain non toric symplectic manifolds do the same. Below we show that any twist torus $Θ^k \subset \R^{2k+2}$, defined in [1], can be constructed via pseudo toric considerations. Due to this one can explicitly show that every $Θ^k \subset \R^{2k+2}$ is displaceable.
△ Less
Submitted 15 April, 2010;
originally announced April 2010.
-
Three conjectures on lagrangian tori in the projective plane
Authors:
Nikolay A. Tyurin
Abstract:
In this paper we extend the discussion on Homological Mirror Symmetry for Fano toric varieties presented by Hori and Vafa to more general case of monotone symplectic manifolds with real polarizations. We claim that the Hori -- Vafa prediction, proven by Cho and Oh for toric Fano varieties, can be checked in much more wider context. Then the notion of Bohr - Sommerfeld with respect to the canonic…
▽ More
In this paper we extend the discussion on Homological Mirror Symmetry for Fano toric varieties presented by Hori and Vafa to more general case of monotone symplectic manifolds with real polarizations. We claim that the Hori -- Vafa prediction, proven by Cho and Oh for toric Fano varieties, can be checked in much more wider context. Then the notion of Bohr - Sommerfeld with respect to the canonical class lagrangian submanifold appears and plays an important role. The discussion presents a bridge between Geometric Quantization and Homological Mirror Symmetry programmes both applied to the projective plane in terms of its lagrangian geometry. Due to this relation one could exploit some standard facts known in GQ to produce results in HMS.
△ Less
Submitted 10 December, 2007;
originally announced December 2007.
-
Universal Maslov class of Bohr - Sommerfeld lagrangian embedding to pseudo - Einstein manifold
Authors:
N. A. Tyurin
Abstract:
In this paper we define the universal Maslov class of a Bohr - Sommerfeld lagrangian embedding to a simply connected pseudo - Einstein symplectic manifold. This class is an invariant of hamiltonian (isodrastic) deformations of a given Bohr - Sommerfeld lagrangian submanifold.
In this paper we define the universal Maslov class of a Bohr - Sommerfeld lagrangian embedding to a simply connected pseudo - Einstein symplectic manifold. This class is an invariant of hamiltonian (isodrastic) deformations of a given Bohr - Sommerfeld lagrangian submanifold.
△ Less
Submitted 17 July, 2006; v1 submitted 28 February, 2006;
originally announced February 2006.
-
Maslov class of lagrangian embedding to Kahler manifold
Authors:
Nik. A. Tyurin
Abstract:
One generalizes the notion of Maslov class of lagrangian embeddings to symplectic vector spaces for the compact case. Topological and geometrical properties of the generalized class is discussed. Certain relationship with the minimality problem is established. Applications are presented.
One generalizes the notion of Maslov class of lagrangian embeddings to symplectic vector spaces for the compact case. Topological and geometrical properties of the generalized class is discussed. Certain relationship with the minimality problem is established. Applications are presented.
△ Less
Submitted 15 February, 2006;
originally announced February 2006.
-
Homological orthogonality of "symplectic" and "lagrangian"- corrected version
Authors:
Nik. A. Tyurin
Abstract:
In this remark we discuss a relationship between (co)homology classes of a symplectic manifold realized by symplectic and lagrangian objects. We establish some transversality condition for the classes, realized by symplectic divisors and smooth lagrangian tori with some special condition on their intersections.
In this remark we discuss a relationship between (co)homology classes of a symplectic manifold realized by symplectic and lagrangian objects. We establish some transversality condition for the classes, realized by symplectic divisors and smooth lagrangian tori with some special condition on their intersections.
△ Less
Submitted 9 November, 2005; v1 submitted 30 June, 2005;
originally announced June 2005.
-
Hitchin systems on ll- curves
Authors:
Andrei N. Tyurin
Abstract:
One investigates the Hitchin systems over "large limit" curves.
One investigates the Hitchin systems over "large limit" curves.
△ Less
Submitted 20 February, 2003;
originally announced February 2003.
-
Fano versus Calabi - Yau
Authors:
Andrey N. Tyurin
Abstract:
In this article we discuss some numerical parts of the mirror conjecture. For any 3 - dimensional Calabi - Yau manifold author introduces a generalization of the Casson invariant known in 3 - dimensional geometry, which is called Casson - Donaldson invariant. In the framework of the mirror relationship it corresponds to the number of SpLag cycles which are Bohr - Sommerfeld with respect to the g…
▽ More
In this article we discuss some numerical parts of the mirror conjecture. For any 3 - dimensional Calabi - Yau manifold author introduces a generalization of the Casson invariant known in 3 - dimensional geometry, which is called Casson - Donaldson invariant. In the framework of the mirror relationship it corresponds to the number of SpLag cycles which are Bohr - Sommerfeld with respect to the given polarization. To compute the Casson - Donaldson invariant the author uses well known in classical algebraic geometry degeneration principle. By it, when the given Calabi - Yau manifold is deformed to a pair of quasi Fano manifolds glued upon some K3 - surface, one can compute the invariant in terms of "flag geometry" of the pairs (quasi Fano, K3 - surface).
△ Less
Submitted 10 February, 2003;
originally announced February 2003.
-
Two lectures on local riemannian geometry, $Spin^{\C}$ - structures and Seiberg - Witten equation
Authors:
Nik. Tyurin
Abstract:
In the present text we discuss basic aspects of the Seiberg - Witten theory mainly focusing the attantion on some geometrical details which could make the introduction to the subject more illustrative. At the same time we list there natural problems arise in this framework mostly interesting to the author. This text could be regarded as additional remarks to any comlete course on the Seiberg - W…
▽ More
In the present text we discuss basic aspects of the Seiberg - Witten theory mainly focusing the attantion on some geometrical details which could make the introduction to the subject more illustrative. At the same time we list there natural problems arise in this framework mostly interesting to the author. This text could be regarded as additional remarks to any comlete course on the Seiberg - Witten invariants.
△ Less
Submitted 4 February, 2003;
originally announced February 2003.
-
Geometric quantization in the framework of algebraic lagrangian geometry
Authors:
Nikolay A. Tyurin
Abstract:
This paper is a short version of the author habilitation thesis. The main results have been already published but here a lot of details are clarified. As well we add some new results: we discuss some quasi classical limit of ALG(a) - quantization, mention some topological properties of the moduli space of Bohr - Sommerfeld Lagrangian cycles of fixed type and investigate some properties of the Ka…
▽ More
This paper is a short version of the author habilitation thesis. The main results have been already published but here a lot of details are clarified. As well we add some new results: we discuss some quasi classical limit of ALG(a) - quantization, mention some topological properties of the moduli space of Bohr - Sommerfeld Lagrangian cycles of fixed type and investigate some properties of the Kaehler structure on it.
△ Less
Submitted 23 November, 2002;
originally announced November 2002.
-
Quantization, Classical and Quantum Field Theory and Theta - Functions
Authors:
Andrey N. Tyurin
Abstract:
In the abelian case (the subject of several beautiful books) fixing some combinatorial structure (so called theta structure of level k) one obtains a special basis in the space of sections of canonical polarization powers over the jacobians. These sections can be presented as holomorphic functions on the "abelian Schottky space". This fact provides various applications of these concrete analytic…
▽ More
In the abelian case (the subject of several beautiful books) fixing some combinatorial structure (so called theta structure of level k) one obtains a special basis in the space of sections of canonical polarization powers over the jacobians. These sections can be presented as holomorphic functions on the "abelian Schottky space". This fact provides various applications of these concrete analytic formulas to the integrable systems, classical mechanics and PDE's. Our practical goal is to do the same in the non abelian case that is to give an answer to the Beauville's question. In future we hope to extend this digest to a mathematical mohograph with title "VBAC".
△ Less
Submitted 30 October, 2002;
originally announced October 2002.
