-
Fast solution to the fair ranking problem using the Sinkhorn algorithm
Authors:
Yuki Uehara,
Shunnosuke Ikeda,
Naoki Nishimura,
Koya Ohashi,
Yilin Li,
Jie Yang,
Deddy Jobson,
Xingxia Zha,
Takeshi Matsumoto,
Noriyoshi Sukegawa,
Yuichi Takano
Abstract:
In two-sided marketplaces such as online flea markets, recommender systems for providing consumers with personalized item rankings play a key role in promoting transactions between providers and consumers. Meanwhile, two-sided marketplaces face the problem of balancing consumer satisfaction and fairness among items to stimulate activity of item providers. Saito and Joachims (2022) devised an impac…
▽ More
In two-sided marketplaces such as online flea markets, recommender systems for providing consumers with personalized item rankings play a key role in promoting transactions between providers and consumers. Meanwhile, two-sided marketplaces face the problem of balancing consumer satisfaction and fairness among items to stimulate activity of item providers. Saito and Joachims (2022) devised an impact-based fair ranking method for maximizing the Nash social welfare based on fair division; however, this method, which requires solving a large-scale constrained nonlinear optimization problem, is very difficult to apply to practical-scale recommender systems. We thus propose a fast solution to the impact-based fair ranking problem. We first transform the fair ranking problem into an unconstrained optimization problem and then design a gradient ascent method that repeatedly executes the Sinkhorn algorithm. Experimental results demonstrate that our algorithm provides fair rankings of high quality and is about 1000 times faster than application of commercial optimization software.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Student t-Lévy regression model in YUIMA
Authors:
Hiroki Masuda,
Lorenzo Mercuri,
Yuma Uehara
Abstract:
The aim of this paper is to discuss an estimation and a simulation method in the \textsf{R} package YUIMA for a linear regression model driven by a Student-$t$ Lévy process with constant scale and arbitrary degrees of freedom. This process finds applications in several fields, for example finance, physic, biology, etc. The model presents two main issues. The first is related to the simulation of a…
▽ More
The aim of this paper is to discuss an estimation and a simulation method in the \textsf{R} package YUIMA for a linear regression model driven by a Student-$t$ Lévy process with constant scale and arbitrary degrees of freedom. This process finds applications in several fields, for example finance, physic, biology, etc. The model presents two main issues. The first is related to the simulation of a sample path at high-frequency level. Indeed, only the $t$-Lévy increments defined on an unitary time interval are Student-$t$ distributed. In YUIMA, we solve this problem by means of the inverse Fourier transform for simulating the increments of a Student-$t$ Lévy defined on a interval with any length. A second problem is due to the fact that joint estimation of trend, scale, and degrees of freedom does not seem to have been investigated as yet. In YUIMA, we develop a two-step estimation procedure that efficiently deals with this issue. Numerical examples are given in order to explain methods and classes used in the YUIMA package.
△ Less
Submitted 26 February, 2024;
originally announced March 2024.
-
Quasi-Likelihood Analysis for Student-Lévy Regression
Authors:
Hiroki Masuda,
Lorenzo Mercuri,
Yuma Uehara
Abstract:
We consider the quasi-likelihood analysis for a linear regression model driven by a Student-t Lévy process with constant scale and arbitrary degrees of freedom. The model is observed at high frequency over an extending period, under which we can quantify how the sampling frequency affects estimation accuracy. In that setting, joint estimation of trend, scale, and degrees of freedom is a non-trivia…
▽ More
We consider the quasi-likelihood analysis for a linear regression model driven by a Student-t Lévy process with constant scale and arbitrary degrees of freedom. The model is observed at high frequency over an extending period, under which we can quantify how the sampling frequency affects estimation accuracy. In that setting, joint estimation of trend, scale, and degrees of freedom is a non-trivial problem. The bottleneck is that the Student-t distribution is not closed under convolution, making it difficult to estimate all the parameters fully based on the high-frequency time scale. To efficiently deal with the intricate nature from both theoretical and computational points of view, we propose a two-step quasi-likelihood analysis: first, we make use of the Cauchy quasi-likelihood for estimating the regression-coefficient vector and the scale parameter; then, we construct the sequence of the unit-period cumulative residuals to estimate the remaining degrees of freedom. In particular, using full data in the first step causes a problem stemming from the small-time Cauchy approximation, showing the need for data thinning.
△ Less
Submitted 26 May, 2024; v1 submitted 29 June, 2023;
originally announced June 2023.
-
Noise Inference For Ergodic Lévy Driven SDE
Authors:
Hiroki Masuda,
Lorenzo Mercuri,
Yuma Uehara
Abstract:
We study inference for the driving Lévy noise of an ergodic stochastic differential equation (SDE) model, when the process is observed at high-frequency and long time and when the drift and scale coefficients contain finite-dimensional unknown parameters. By making use of the Gaussian quasi-likelihood function for the coefficients, we derive a stochastic expansion for functionals of the unit-time…
▽ More
We study inference for the driving Lévy noise of an ergodic stochastic differential equation (SDE) model, when the process is observed at high-frequency and long time and when the drift and scale coefficients contain finite-dimensional unknown parameters. By making use of the Gaussian quasi-likelihood function for the coefficients, we derive a stochastic expansion for functionals of the unit-time residuals, which clarifies some quantitative effect of plugging-in the estimators of the coefficients, thereby enabling us to take several inference procedures for the driving-noise characteristics into account. We also present new classes and methods available in YUIMA for the simulation and the estimation of a Lévy SDE model. We highlight the flexibility of these new advances in YUIMA using simulated and real data.
△ Less
Submitted 19 March, 2022; v1 submitted 3 November, 2021;
originally announced November 2021.
-
Estimating Diffusion With Compound Poisson Jumps Based On Self-normalized Residuals
Authors:
Hiroki Masuda,
Yuma Uehara
Abstract:
We consider parametric estimation of the continuous part of a class of ergodic diffusions with jumps based on high-frequency samples. Various papers previously proposed threshold based methods, which enable us to distinguish whether observed increments have jumps or not at each small-time interval, hence to estimate the unknown parameters separately. However, a data-adapted and quantitative choice…
▽ More
We consider parametric estimation of the continuous part of a class of ergodic diffusions with jumps based on high-frequency samples. Various papers previously proposed threshold based methods, which enable us to distinguish whether observed increments have jumps or not at each small-time interval, hence to estimate the unknown parameters separately. However, a data-adapted and quantitative choice of the threshold parameter is known to be a subtle and sensitive problem. In this paper, we present a simple alternative based on the Jarque-Bera normality test for the Euler residuals. Different from the threshold based method, the proposed method does not require any sensitive fine tuning, hence is of practical value. It is shown that under suitable conditions the proposed estimator is asymptotically equivalent to an estimator constructed by the unobserved fluctuation of the continuous part of the solution process, hence is asymptotically efficient. Some numerical experiments are conducted to observe finite-sample performance of the proposed method.
△ Less
Submitted 1 October, 2019; v1 submitted 12 February, 2018;
originally announced February 2018.