Showing 1–34 of 34 results for author: Hammer, L

Explainability of Machine Learning Models under Missing Data

Authors: Tuan L. Vo, Thu Nguyen, Hugo L. Hammer, Michael A. Riegler, Pal Halvorsen

Abstract: Missing data is a prevalent issue that can significantly impair model performance and interpretability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Intelligence and experimentally investigates the effects of various imputation methods on the calculation of Shapley values, a popular technique for interpreting complex machine lear… ▽ More Missing data is a prevalent issue that can significantly impair model performance and interpretability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Intelligence and experimentally investigates the effects of various imputation methods on the calculation of Shapley values, a popular technique for interpreting complex machine learning models. We compare different imputation strategies and assess their impact on feature importance and interaction as determined by Shapley values. Moreover, we also theoretically analyze the effects of missing values on Shapley values. Importantly, our findings reveal that the choice of imputation method can introduce biases that could lead to changes in the Shapley values, thereby affecting the interpretability of the model. Moreover, and that a lower test prediction mean square error (MSE) may not imply a lower MSE in Shapley values and vice versa. Also, while Xgboost is a method that could handle missing data directly, using Xgboost directly on missing data can seriously affect interpretability compared to imputing the data before training Xgboost. This study provides a comprehensive evaluation of imputation methods in the context of model interpretation, offering practical guidance for selecting appropriate techniques based on dataset characteristics and analysis objectives. The results underscore the importance of considering imputation effects to ensure robust and reliable insights from machine learning models. △ Less

Submitted 29 June, 2024; originally announced July 2024.

ViPErLEED package I: Calculation of $I(V)$ curves and structural optimization

Authors: Florian Kraushofer, Alexander M. Imre, Giada Franceschi, Tilman Kißlinger, Erik Rheinfrank, Michael Schmid, Ulrike Diebold, Lutz Hammer, Michele Riva

Abstract: Low-energy electron diffraction (LEED) is a widely used technique in surface-science. Yet, it is rarely used to its full potential. The quantitative information about the surface structure, contained in the modulation of the intensities of the diffracted beams as a function of incident electron energy, LEED I(V), is underutilized. To acquire these data, minor adjustments would be required in most… ▽ More Low-energy electron diffraction (LEED) is a widely used technique in surface-science. Yet, it is rarely used to its full potential. The quantitative information about the surface structure, contained in the modulation of the intensities of the diffracted beams as a function of incident electron energy, LEED I(V), is underutilized. To acquire these data, minor adjustments would be required in most experimental setups, but existing analysis software is cumbersome to use. ViPErLEED (Vienna package for Erlangen LEED) lowers these barriers, introducing a combined solution for data acquisition, extraction, and computational analysis. These parts are discussed in three separate publications. Here, the focus is on the computational part of ViPErLEED, which performs automated LEED-I(V) calculations and structural optimization. Minimal user input is required, and the functionality is significantly enhanced compared to existing solutions. Computation is performed by embedding the Erlangen tensor-LEED package (TensErLEED). ViPErLEED manages parallelization, monitors convergence, and processes input and output. This makes LEED I(V) more accessible to new users while minimizing the potential for errors and the manual labor. Added functionality includes structure-dependent defaults, automatic detection of bulk and surface symmetries and their relationship, automated symmetry-preserving search procedures, adjustments to the TensErLEED code to handle larger systems, as well as parallelization and optimization. Modern file formats are used as input and output, and there is a direct interface to the Atomic Simulation Environment (ASE) package. The software is implemented primarily in Python (version >=3.7) and provided as an open-source package (GNU GPLv3 or later). A structure determination of the $α$-Fe2O3(1-102)-(1x1) surface is presented as an example for the application of the software. △ Less

Submitted 26 June, 2024; originally announced June 2024.

ViPErLEED package II: Spot tracking, extraction and processing of I(V) curves

Authors: Michael Schmid, Florian Kraushofer, Alexander M. Imre, Tilman Kißlinger, Lutz Hammer, Ulrike Diebold, Michele Riva

Abstract: As part of the ViPErLEED project (Vienna package for Erlangen LEED, low-energy electron diffraction), computer programs have been developed for facile and user-friendly data extraction from movies of LEED images. The programs make use of some concepts from astronomical image processing and analysis. As a first step, flat-field and dark-frame corrections reduce the effects of inhomogeneities of the… ▽ More As part of the ViPErLEED project (Vienna package for Erlangen LEED, low-energy electron diffraction), computer programs have been developed for facile and user-friendly data extraction from movies of LEED images. The programs make use of some concepts from astronomical image processing and analysis. As a first step, flat-field and dark-frame corrections reduce the effects of inhomogeneities of the camera and screen. In a second step, for identifying all diffraction maxima ("spots"), it is sufficient to manually mark and label a single spot or very few spots. Then the program can automatically identify all other spots and determine the distortions of the image. This forms the basis for automatic spot tracking (following the "beams" as they move across the LEED screen) and intensity measurement. Even for complex structures with hundreds to a few thousand diffraction beams, this step takes less than a minute. The package also includes a program for further processing of these I(V) curves (averaging of equivalent beams, manual and/or automatic selection, smoothing) as well as several utilities. The software is implemented as a set of plugins for the public-domain image processing program ImageJ and provided as an open-source package. △ Less

Submitted 26 June, 2024; originally announced June 2024.

Classifying Dry Eye Disease Patients from Healthy Controls Using Machine Learning and Metabolomics Data

Authors: Sajad Amouei Sheshkal, Morten Gundersen, Michael Alexander Riegler, Øygunn Aass Utheim, Kjell Gunnar Gundersen, Hugo Lewi Hammer

Abstract: Dry eye disease is a common disorder of the ocular surface, leading patients to seek eye care. Clinical signs and symptoms are currently used to diagnose dry eye disease. Metabolomics, a method for analyzing biological systems, has been found helpful in identifying distinct metabolites in patients and in detecting metabolic profiles that may indicate dry eye disease at early stages. In this study,… ▽ More Dry eye disease is a common disorder of the ocular surface, leading patients to seek eye care. Clinical signs and symptoms are currently used to diagnose dry eye disease. Metabolomics, a method for analyzing biological systems, has been found helpful in identifying distinct metabolites in patients and in detecting metabolic profiles that may indicate dry eye disease at early stages. In this study, we explored using machine learning and metabolomics information to identify which cataract patients suffered from dry eye disease. As there is no one-size-fits-all machine learning model for metabolomics data, choosing the most suitable model can significantly affect the quality of predictions and subsequent metabolomics analyses. To address this challenge, we conducted a comparative analysis of nine machine learning models on three metabolomics data sets from cataract patients with and without dry eye disease. The models were evaluated and optimized using nested k-fold cross-validation. To assess the performance of these models, we selected a set of suitable evaluation metrics tailored to the data set's challenges. The logistic regression model overall performed the best, achieving the highest area under the curve score of 0.8378, balanced accuracy of 0.735, Matthew's correlation coefficient of 0.5147, an F1-score of 0.8513, and a specificity of 0.5667. Additionally, following the logistic regression, the XGBoost and Random Forest models also demonstrated good performance. △ Less

Submitted 7 August, 2024; v1 submitted 20 June, 2024; originally announced June 2024.

Advancing sleep detection by modelling weak label sets: A novel weakly supervised learning approach

Authors: Matthias Boeker, Vajira Thambawita, Michael Riegler, Pål Halvorsen, Hugo L. Hammer

Abstract: Understanding sleep and activity patterns plays a crucial role in physical and mental health. This study introduces a novel approach for sleep detection using weakly supervised learning for scenarios where reliable ground truth labels are unavailable. The proposed method relies on a set of weak labels, derived from the predictions generated by conventional sleep detection algorithms. Introducing a… ▽ More Understanding sleep and activity patterns plays a crucial role in physical and mental health. This study introduces a novel approach for sleep detection using weakly supervised learning for scenarios where reliable ground truth labels are unavailable. The proposed method relies on a set of weak labels, derived from the predictions generated by conventional sleep detection algorithms. Introducing a novel approach, we suggest a novel generalised non-linear statistical model in which the number of weak sleep labels is modelled as outcome of a binomial distribution. The probability of sleep in the binomial distribution is linked to the outcomes of neural networks trained to detect sleep based on actigraphy. We show that maximizing the likelihood function of the model, is equivalent to minimizing the soft cross-entropy loss. Additionally, we explored the use of the Brier score as a loss function for weak labels. The efficacy of the suggested modelling framework was demonstrated using the Multi-Ethnic Study of Atherosclerosis dataset. A \gls{lstm} trained on the soft cross-entropy outperformed conventional sleep detection algorithms, other neural network architectures and loss functions in accuracy and model calibration. This research not only advances sleep detection techniques in scenarios where ground truth data is scarce but also contributes to the broader field of weakly supervised learning by introducing innovative approach in modelling sets of weak labels. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Report number: NCAA-D-24-00134R1

Strongly Anisotropic Spin and Orbital Rashba Effect at a Tellurium - Noble Metal Interface

Authors: B. Geldiyev, M. Ünzelmann, P. Eck, T. Kißlinger, J. Schusser, T. Figgemeier, P. Kagerer, N. Tezak, M. Krivenkov, A. Varykhalov, A. Fedorov, L. Nicolaï, J. Minár, K. Miyamoto, T. Okuda, K. Shimada, D. Di Sante, G. Sangiovanni, L. Hammer, M. A. Schneider, H. Bentmann, F. Reinert

Abstract: We study the interplay of lattice, spin and orbital degrees of freedom in a two-dimensional model system: a flat square lattice of Te atoms on a Au(100) surface. The atomic structure of the Te monolayer is determined by scanning tunneling microscopy (STM) and quantitative low-energy electron diffraction (LEED-IV). Using spin- and angle-resolved photoelectron spectroscopy (ARPES) and density functi… ▽ More We study the interplay of lattice, spin and orbital degrees of freedom in a two-dimensional model system: a flat square lattice of Te atoms on a Au(100) surface. The atomic structure of the Te monolayer is determined by scanning tunneling microscopy (STM) and quantitative low-energy electron diffraction (LEED-IV). Using spin- and angle-resolved photoelectron spectroscopy (ARPES) and density functional theory (DFT), we observe a Te-Au interface state with highly anisotropic Rashba-type spin-orbit splitting at the X point of the Brillouin zone. Based on a profound symmetry and tight-binding analysis, we show how in-plane square lattice symmetry and broken inversion symmetry at the Te-Au interface together enforce a remarkably anisotropic orbital Rashba effect which strongly modulates the spin splitting. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Comments: 7 pages, 5 figures

VISEM-Tracking, a human spermatozoa tracking dataset

Authors: Vajira Thambawita, Steven A. Hicks, Andrea M. Storås, Thu Nguyen, Jorunn M. Andersen, Oliwia Witczak, Trine B. Haugen, Hugo L. Hammer, Pål Halvorsen, Michael A. Riegler

Abstract: A manual assessment of sperm motility requires microscopy observation, which is challenging due to the fast-moving spermatozoa in the field of view. To obtain correct results, manual evaluation requires extensive training. Therefore, computer-assisted sperm analysis (CASA) has become increasingly used in clinics. Despite this, more data is needed to train supervised machine learning approaches in… ▽ More A manual assessment of sperm motility requires microscopy observation, which is challenging due to the fast-moving spermatozoa in the field of view. To obtain correct results, manual evaluation requires extensive training. Therefore, computer-assisted sperm analysis (CASA) has become increasingly used in clinics. Despite this, more data is needed to train supervised machine learning approaches in order to improve accuracy and reliability in the assessment of sperm motility and kinematics. In this regard, we provide a dataset called VISEM-Tracking with 20 video recordings of 30 seconds (comprising 29,196 frames) of wet sperm preparations with manually annotated bounding-box coordinates and a set of sperm characteristics analyzed by experts in the domain. In addition to the annotated data, we provide unlabeled video clips for easy-to-use access and analysis of the data via methods such as self- or unsupervised learning. As part of this paper, we present baseline sperm detection performances using the YOLOv5 deep learning (DL) model trained on the VISEM-Tracking dataset. As a result, we show that the dataset can be used to train complex DL models to analyze spermatozoa. △ Less

Submitted 10 May, 2023; v1 submitted 6 December, 2022; originally announced December 2022.

Report number: Scientific Data volume 10

Journal ref: Sci Data 10, 260 (2023)

Reversible Tuning of Collinear versus Chiral Magnetic Order by Chemical Stimulus

Authors: Jing Qi, Paula M. Weber, Tilman Kißlinger, Lutz Hammer, M. Alexander Schneider, Matthias Bode

Abstract: The Ruderman-Kittel-Kasuya-Yosida (RKKY) interaction mediates collinear magnetic interactions via the conduction electrons of a non-magnetic spacer, resulting in a ferro- or antiferromagnetic magnetization in magnetic multilayers. The resulting spin-polarized charge transport effects have found numerous applications. Recently it has been discovered that heavy non-magnetic spacers are able to media… ▽ More The Ruderman-Kittel-Kasuya-Yosida (RKKY) interaction mediates collinear magnetic interactions via the conduction electrons of a non-magnetic spacer, resulting in a ferro- or antiferromagnetic magnetization in magnetic multilayers. The resulting spin-polarized charge transport effects have found numerous applications. Recently it has been discovered that heavy non-magnetic spacers are able to mediate an indirect magnetic coupling that is non-collinear and chiral. This Dzyaloshinskii-Moriya-enhanced RKKY (DME-RKKY) interaction causes the emergence of a variety of interesting magnetic structures, such as skyrmions and spin spirals. Applications using these magnetic quasi-particles require a thorough understanding and fine-tuning of the balance between the Dzyaloshinskii-Moriya interaction and other magnetic interactions, e.g., the exchange interaction and magnetic anisotropy contributions. Here, we show by spin-polarized scanning tunneling microscopy that the spin structure of manganese oxide chains on Ir(001) can reproducibly be switched from chiral to collinear antiferromagnetic interchain interactions by increasing the oxidation state of MnO$_2$ while the reverse process can be induced by thermal reduction. The underlying structural change is revealed by low-energy electron diffraction intensity data (LEED-IV) analysis. Density functional theory calculations suggest that the magnetic transition may be caused by a significant increase of the Heisenberg exchange upon oxidation. △ Less

Submitted 4 August, 2022; originally announced August 2022.

Comments: 6 pages, 3 figures

Principal Component Analysis based frameworks for efficient missing data imputation algorithms

Authors: Thu Nguyen, Hoang Thien Ly, Michael Alexander Riegler, Pål Halvorsen, Hugo L. Hammer

Abstract: Missing data is a commonly occurring problem in practice. Many imputation methods have been developed to fill in the missing entries. However, not all of them can scale to high-dimensional data, especially the multiple imputation techniques. Meanwhile, the data nowadays tends toward high-dimensional. Therefore, in this work, we propose Principal Component Analysis Imputation (PCAI), a simple but v… ▽ More Missing data is a commonly occurring problem in practice. Many imputation methods have been developed to fill in the missing entries. However, not all of them can scale to high-dimensional data, especially the multiple imputation techniques. Meanwhile, the data nowadays tends toward high-dimensional. Therefore, in this work, we propose Principal Component Analysis Imputation (PCAI), a simple but versatile framework based on Principal Component Analysis (PCA) to speed up the imputation process and alleviate memory issues of many available imputation techniques, without sacrificing the imputation quality in term of MSE. In addition, the frameworks can be used even when some or all of the missing features are categorical, or when the number of missing features is large. Next, we introduce PCA Imputation - Classification (PIC), an application of PCAI for classification problems with some adjustments. We validate our approach by experiments on various scenarios, which shows that PCAI and PIC can work with various imputation algorithms, including the state-of-the-art ones and improve the imputation speed significantly, while achieving competitive mean square error/classification accuracy compared to direct imputation (i.e., impute directly on the missing data). △ Less

Submitted 19 March, 2023; v1 submitted 30 May, 2022; originally announced May 2022.

This Sample seems to be good enough! Assessing Coverage and Temporal Reliability of Twitter's Academic API

Authors: Juergen Pfeffer, Angelina Mooseder, Jana Lasser, Luca Hammer, Oliver Stritzel, David Garcia

Abstract: Because of its willingness to share data with academia and industry, Twitter has been the primary social media platform for scientific research as well as for consulting businesses and governments in the last decade. In recent years, a series of publications have studied and criticized Twitter's APIs and Twitter has partially adapted its existing data streams. The newest Twitter API for Academic R… ▽ More Because of its willingness to share data with academia and industry, Twitter has been the primary social media platform for scientific research as well as for consulting businesses and governments in the last decade. In recent years, a series of publications have studied and criticized Twitter's APIs and Twitter has partially adapted its existing data streams. The newest Twitter API for Academic Research allows to "access Twitter's real-time and historical public data with additional features and functionality that support collecting more precise, complete, and unbiased datasets." The main new feature of this API is the possibility of accessing the full archive of all historic Tweets. In this article, we will take a closer look at the Academic API and will try to answer two questions. First, are the datasets collected with the Academic API complete? Secondly, since Twitter's Academic API delivers historic Tweets as represented on Twitter at the time of data collection, we need to understand how much data is lost over time due to Tweet and account removal from the platform. Our work shows evidence that Twitter's Academic API can indeed create (almost) complete samples of Twitter data based on a wide variety of search terms. We also provide evidence that Twitter's data endpoint v2 delivers better samples than the previously used endpoint v1.1. Furthermore, collecting Tweets with the Academic API at the time of studying a phenomenon rather than creating local archives of stored Tweets, allows for a straightforward way of following Twitter's developer agreement. Finally, we will also discuss technical artifacts and implications of the Academic API. We hope that our work can add another layer of understanding of Twitter data collections leading to more reliable studies of human behavior via social media data. △ Less

Submitted 11 April, 2023; v1 submitted 4 April, 2022; originally announced April 2022.

ACM Class: E.0; J.4; H.3.0

Artificial Intelligence in Dry Eye Disease

Authors: Andrea M. Storås, Inga Strümke, Michael A. Riegler, Jakob Grauslund, Hugo L. Hammer, Anis Yazidi, Pål Halvorsen, Kjell G. Gundersen, Tor P. Utheim, Catherine Jackson

Abstract: Dry eye disease (DED) has a prevalence of between 5 and 50\%, depending on the diagnostic criteria used and population under study. However, it remains one of the most underdiagnosed and undertreated conditions in ophthalmology. Many tests used in the diagnosis of DED rely on an experienced observer for image interpretation, which may be considered subjective and result in variation in diagnosis.… ▽ More Dry eye disease (DED) has a prevalence of between 5 and 50\%, depending on the diagnostic criteria used and population under study. However, it remains one of the most underdiagnosed and undertreated conditions in ophthalmology. Many tests used in the diagnosis of DED rely on an experienced observer for image interpretation, which may be considered subjective and result in variation in diagnosis. Since artificial intelligence (AI) systems are capable of advanced problem solving, use of such techniques could lead to more objective diagnosis. Although the term `AI' is commonly used, recent success in its applications to medicine is mainly due to advancements in the sub-field of machine learning, which has been used to automatically classify images and predict medical outcomes. Powerful machine learning techniques have been harnessed to understand nuances in patient data and medical images, aiming for consistent diagnosis and stratification of disease severity. This is the first literature review on the use of AI in DED. We provide a brief introduction to AI, report its current use in DED research and its potential for application in the clinic. Our review found that AI has been employed in a wide range of DED clinical tests and research applications, primarily for interpretation of interferometry, slit-lamp and meibography images. While initial results are promising, much work is still needed on model development, clinical testing and standardisation. △ Less

Submitted 2 September, 2021; originally announced September 2021.

New submonolayer copper telluride phase on Cu(111) -- ad-chain and trough formation

Authors: Lutz Hammer, Tilman Kißlinger, M. Alexander Schneider

Abstract: We present a so far undetected submonolayer phase of copper telluride on Cu(111) with $\left(5 \times \sqrt{3}\right)_{\text{rect}}$ periodicity and coverage of 0.40 ML Tellurium (Te), which can be grown with perfect long-range order. It is structurally characterized by a combination of quantitative low-energy electron diffraction (LEED-IV), scanning tunneling microscopy (STM), and density functio… ▽ More We present a so far undetected submonolayer phase of copper telluride on Cu(111) with $\left(5 \times \sqrt{3}\right)_{\text{rect}}$ periodicity and coverage of 0.40 ML Tellurium (Te), which can be grown with perfect long-range order. It is structurally characterized by a combination of quantitative low-energy electron diffraction (LEED-IV), scanning tunneling microscopy (STM), and density functional theory (DFT). We find that Te induces the formation of four atom wide linear troughs within the Cu(111) surface filled up by two Te atoms per unit cell. Additionally, the interspace between the troughs is decorated by Cu$_2$Te$_2$ ad-chains sitting at hcp sites. All Te atoms exhibit the same local sixfold coordination: They occupy threefold hollow sites of the substrate and are one-sided attached to another three Cu atoms. The presented structural model is verified by a LEED-IV analysis with Pendry R-factor of R = 0.174 and quantitative agreement of structural parameters with DFT predictions. It also has by far the lowest energy of all models tested by DFT and simulated STM images agree perfectly with experiment. It turns out that the new $\left(5 \times \sqrt{3}\right)_{\text{rect}}$ phase is the most dense surface telluride phase possible on Cu(111) before bulk-like copper telluride starts to growth. △ Less

Submitted 27 July, 2021; originally announced July 2021.

SinGAN-Seg: Synthetic training data generation for medical image segmentation

Authors: Vajira Thambawita, Pegah Salehi, Sajad Amouei Sheshkal, Steven A. Hicks, Hugo L. Hammer, Sravanthi Parasa, Thomas de Lange, Pål Halvorsen, Michael A. Riegler

Abstract: Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic processing of medical data, acting as a supportive tool for doctors. However, the machine learning models used to build these tools are highly dependent on the da… ▽ More Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic processing of medical data, acting as a supportive tool for doctors. However, the machine learning models used to build these tools are highly dependent on the data used to train them. Large amounts of data can be difficult to obtain in medicine due to privacy, expensive and time-consuming annotations, and a general lack of data samples for infrequent lesions. Here, we present a novel synthetic data generation pipeline, called SinGAN-Seg, to produce synthetic medical images with corresponding masks using a single training image. Our method is different from the traditional GANs because our model needs only a single image and the corresponding ground truth to train. Our method produces alternative artificial segmentation datasets with ground truth masks when real datasets are not allowed to share. The pipeline is evaluated using qualitative and quantitative comparisons between real and synthetic data to show that the style transfer technique used in our pipeline significantly improves the quality of the generated data and our method is better than other state-of-the-art GANs to prepare synthetic images when the size of training datasets are limited. By training UNet++ using both real and the synthetic data generated from the SinGAN-Seg pipeline, we show that models trained with synthetic data have very close performances to those trained on real data when the datasets have a considerable amount of data. In contrast, Synthetic data generated from the SinGAN-Seg pipeline can improve the performance of segmentation models when training datasets do not have a considerable amount of data. The code is available on GitHub. △ Less

Submitted 25 April, 2022; v1 submitted 29 June, 2021; originally announced July 2021.

The Complex-Pole Filter Representation (COFRE) for spectral modeling of fNIRS signals

Authors: Marco A. Pinto Orellana, Peyman Mirtaheri, Hugo L. Hammer

Abstract: The complex-pole frequency representation (COFRE) is introduced in this paper as a new approach for spectrum modeling in biomedical signals. Our method allows us to estimate the spectral power density at precise frequencies using an array of narrow band-pass filters with single complex poles. Closed-form expressions for the frequency resolution and transient time response of the proposed filters h… ▽ More The complex-pole frequency representation (COFRE) is introduced in this paper as a new approach for spectrum modeling in biomedical signals. Our method allows us to estimate the spectral power density at precise frequencies using an array of narrow band-pass filters with single complex poles. Closed-form expressions for the frequency resolution and transient time response of the proposed filters have also been formulated. In addition, COFRE filters have a constant time and space complexity allowing their use in real-time environments. Our model was applied to identify frequency markers that characterize tinnitus in very-low-frequency oscillations within functional near-infrared spectroscopy (fNIRS) signals. We examined data from six patients with subjective tinnitus and seven healthy participants as a control group. A significant decrease in the spectrum power was observed in tinnitus patients in the left temporal lobe. In particular, we identified several tinnitus signatures in the spectral hemodynamic information, including (a.) a significant spectrum difference in one specific harmonic in the metabolic/endothelial frequency region, at 7mHz, for both chromophores and hemispheres; and (b.) a significant differences in the range 30-50mHz in the neurogenic/myogenic band. △ Less

Submitted 13 May, 2021; originally announced May 2021.

Dyadic aggregated autoregressive (DASAR) model for time-frequency representation of biomedical signals

Authors: Marco A. Pinto-Orellana, Habib Sherkat, Peyman Mirtaheri, Hugo L. Hammer

Abstract: This paper introduces a new time-frequency representation method for biomedical signals: the dyadic aggregated autoregressive (DASAR) model. Signals, such as electroencephalograms (EEGs) and functional near-infrared spectroscopy (fNIRS), exhibit physiological information through time-evolving spectrum components at specific frequency intervals: 0-50 Hz (EEG) or 0-150 mHz (fNIRS). Spectrotemporal f… ▽ More This paper introduces a new time-frequency representation method for biomedical signals: the dyadic aggregated autoregressive (DASAR) model. Signals, such as electroencephalograms (EEGs) and functional near-infrared spectroscopy (fNIRS), exhibit physiological information through time-evolving spectrum components at specific frequency intervals: 0-50 Hz (EEG) or 0-150 mHz (fNIRS). Spectrotemporal features in signals are conventionally estimated using short-time Fourier transform (STFT) and wavelet transform (WT). However, both methods may not offer the most robust or compact representation despite their widespread use in biomedical contexts. The presented method, DASAR, improves precise frequency identification and tracking of interpretable frequency components with a parsimonious set of parameters. DASAR achieves these characteristics by assuming that the biomedical time-varying spectrum comprises several independent stochastic oscillators with (piecewise) time-varying frequencies. Local stationarity can be assumed within dyadic subdivisions of the recordings, while the stochastic oscillators can be modeled with an aggregation of second-order autoregressive models (ASAR). DASAR can provide a more accurate representation of the (highly contrasted) EEG and fNIRS frequency ranges by increasing the estimation accuracy in user-defined spectrum region of interest (SROI). A mental arithmetic experiment on a hybrid EEG-fNIRS was conducted to assess the efficiency of the method. Our proposed technique, STFT, and WT were applied on both biomedical signals to discover potential oscillators that improve the discrimination between the task condition and its baseline. The results show that DASAR provided the highest spectrum differentiation and it was the only method that could identify Mayer waves as narrow-band artifacts at 97.4-97.5 mHz. △ Less

Submitted 13 May, 2021; originally announced May 2021.

SCAU: Modeling spectral causality for multivariate time series with applications to electroencephalograms

Authors: Marco Antonio Pinto-Orellana, Peyman Mirtaheri, Hugo L. Hammer, Hernando Ombao

Abstract: Electroencephalograms (EEG) are noninvasive measurement signals of electrical neuronal activity in the brain. One of the current major statistical challenges is formally measuring functional dependency between those complex signals. This paper, proposes the spectral causality model (SCAU), a robust linear model, under a causality paradigm, to reflect inter- and intra-frequency modulation effects t… ▽ More Electroencephalograms (EEG) are noninvasive measurement signals of electrical neuronal activity in the brain. One of the current major statistical challenges is formally measuring functional dependency between those complex signals. This paper, proposes the spectral causality model (SCAU), a robust linear model, under a causality paradigm, to reflect inter- and intra-frequency modulation effects that cannot be identifiable using other methods. SCAU inference is conducted with three main steps: (a) signal decomposition into frequency bins, (b) intermediate spectral band mapping, and (c) dependency modeling through frequency-specific autoregressive models (VAR). We apply SCAU to study complex dependencies during visual and lexical fluency tasks (word generation and visual fixation) in 26 participants' EEGs. We compared the connectivity networks estimated using SCAU with respect to a VAR model. SCAU networks show a clear contrast for both stimuli while the magnitude links also denoted a low variance in comparison with the VAR networks. Furthermore, SCAU dependency connections not only were consistent with findings in the neuroscience literature, but it also provided further evidence on the directionality of the spatio-spectral dependencies such as the delta-originated and theta-induced links in the fronto-temporal brain network. △ Less

Submitted 13 May, 2021; originally announced May 2021.

CuTe chains on Cu(111) by deposition of 1/3 ML Te: atomic and electronic structure

Authors: Tilman Kißlinger, Andreas Raabgrund, Begmuhammet Geldiyev, Maximilian Ammon, Janek Rieger, Jonas Hauner, Lutz Hammer, Thomas Fauster, M. Alexander Schneider

Abstract: The surface atomic and electronic structure after deposition of 1/3 monolayer (ML) Te on Cu(111) was determined using a combination of low-energy electron diffraction (LEED), scanning tunneling microscopy and spectroscopy (STM/STS), angle-resolved single and two-photon photoelectron spectroscopy (ARPES /AR-2PPE) and density functional theory (DFT) calculations. Contrary to the current state in lit… ▽ More The surface atomic and electronic structure after deposition of 1/3 monolayer (ML) Te on Cu(111) was determined using a combination of low-energy electron diffraction (LEED), scanning tunneling microscopy and spectroscopy (STM/STS), angle-resolved single and two-photon photoelectron spectroscopy (ARPES /AR-2PPE) and density functional theory (DFT) calculations. Contrary to the current state in literature Te does not create a two-dimensional surface alloy but forms Cu$_2$Te$_2$ adsorbate chains in a $\left(2\sqrt{3} \times \sqrt{3}\right)\textrm{R30}^\circ$ superstructure. We establish this by a high-precision LEED-IV structural analysis with Pendry $R$ factor of $R = 0.099$ and corroborating DFT and STM results. The electronic structure of the surface phase is dominated by an anisotropic downward dispersing state at the Fermi energy $E_F$ and a more isotropic upward dispersing unoccupied state at $E-E_F = + 1.43\,\textrm{eV}$. Both states coexist with bulk states of the projected band structure and are therefore surface resonances. △ Less

Submitted 30 September, 2020; originally announced September 2020.

Journal ref: Phys. Rev. B 102, 155422 (2020)

Surface structure and stacking of the commensurate $\left(\sqrt{13}\times\sqrt{13}\right)$R13.9° charge density wave phase of 1T-TaS$_2$(0001)

Authors: Gevin von Witte, Tilman Kißlinger, Jan Gerrit Horstmann, Kai Rossnagel, M. Alexander Schneider, Claus Ropers, Lutz Hammer

Abstract: By quantitative low-energy electron diffraction (LEED) we investigate the extensively studied commensurate charge density wave (CDW) phase of trigonal tantalum disulphide (1T-TaS$_2$), which develops at low temperatures with a $\left(\sqrt{13}\times\sqrt{13}\right)$R13.9° periodicity. A full-dynamical analysis of the energy dependence of diffraction spot intensities reveals the entire crystallogra… ▽ More By quantitative low-energy electron diffraction (LEED) we investigate the extensively studied commensurate charge density wave (CDW) phase of trigonal tantalum disulphide (1T-TaS$_2$), which develops at low temperatures with a $\left(\sqrt{13}\times\sqrt{13}\right)$R13.9° periodicity. A full-dynamical analysis of the energy dependence of diffraction spot intensities reveals the entire crystallographic surface structure, i.e. the detailed atomic positions within the outermost two trilayers consisting of 78 atoms as well as the CDW stacking. The analysis is based on an unusually large data set consisting of spectra for 128 inequivalent beams taken in the energy range 20-250 eV and an excellent fit quality expressed by a bestfit Pendry R-factor of R=0.110. The LEED intensity analysis reveals that the well-accepted model of star-of-David-shaped clusters of Ta atoms for the bulk structure also holds for the outermost two TaS$_2$ trilayers. Specifically, in both layers the clusters of Ta atoms contract laterally by up to 0.25 $Å$ and also slightly rotate within the superstructure cell, causing respective distortions as well as heavy bucklings (up to 0.23 $Å$) in the adjacent sulphur layers. Most importantly, our analysis finds that the CDWs of the 1$^{\text{st}}$ and 2$^{\text{nd}}$ trilayer are vertically aligned, while there is a lateral shift of two units of the basic hexagonal lattice (6.71 $Å$) between the 2$^{\text{nd}}$ and 3$^{\text{rd}}$ trilayer. The results may contribute to a better understanding of the intricate electronic structure of the reference compound 1T-TaS$_2$ and guide the way to the analysis of complex structures in similar quantum materials. △ Less

Submitted 26 August, 2020; originally announced August 2020.

Comments: 18 pages, 13 figures

Journal ref: Phys. Rev. B 100, 155407 (2019)

An Extensive Study on Cross-Dataset Bias and Evaluation Metrics Interpretation for Machine Learning applied to Gastrointestinal Tract Abnormality Classification

Authors: Vajira Thambawita, Debesh Jha, Hugo Lewi Hammer, Håvard D. Johansen, Dag Johansen, Pål Halvorsen, Michael A. Riegler

Abstract: Precise and efficient automated identification of Gastrointestinal (GI) tract diseases can help doctors treat more patients and improve the rate of disease detection and identification. Currently, automatic analysis of diseases in the GI tract is a hot topic in both computer science and medical-related journals. Nevertheless, the evaluation of such an automatic analysis is often incomplete or simp… ▽ More Precise and efficient automated identification of Gastrointestinal (GI) tract diseases can help doctors treat more patients and improve the rate of disease detection and identification. Currently, automatic analysis of diseases in the GI tract is a hot topic in both computer science and medical-related journals. Nevertheless, the evaluation of such an automatic analysis is often incomplete or simply wrong. Algorithms are often only tested on small and biased datasets, and cross-dataset evaluations are rarely performed. A clear understanding of evaluation metrics and machine learning models with cross datasets is crucial to bring research in the field to a new quality level. Towards this goal, we present comprehensive evaluations of five distinct machine learning models using Global Features and Deep Neural Networks that can classify 16 different key types of GI tract conditions, including pathological findings, anatomical landmarks, polyp removal conditions, and normal findings from images captured by common GI tract examination instruments. In our evaluation, we introduce performance hexagons using six performance metrics such as recall, precision, specificity, accuracy, F1-score, and Matthews Correlation Coefficient to demonstrate how to determine the real capabilities of models rather than evaluating them shallowly. Furthermore, we perform cross-dataset evaluations using different datasets for training and testing. With these cross-dataset evaluations, we demonstrate the challenge of actually building a generalizable model that could be used across different hospitals. Our experiments clearly show that more sophisticated performance metrics and evaluation methods need to be applied to get reliable models rather than depending on evaluations of the splits of the same dataset, i.e., the performance metrics should always be interpreted together rather than relying on a single metric. △ Less

Submitted 8 May, 2020; originally announced May 2020.

Comments: 30 pages, 12 figures, 8 tables, Accepted for ACM Transactions on Computing for Healthcare

Efficient Quantile Tracking Using an Oracle

Authors: Hugo L. Hammer, Anis Yazidi, Michael A. Riegler, Håvard Rue

Abstract: For incremental quantile estimators the step size and possibly other tuning parameters must be carefully set. However, little attention has been given on how to set these values in an online manner. In this article we suggest two novel procedures that address this issue. The core part of the procedures is to estimate the current tracking mean squared error (MSE). The MSE is decomposed in trackin… ▽ More For incremental quantile estimators the step size and possibly other tuning parameters must be carefully set. However, little attention has been given on how to set these values in an online manner. In this article we suggest two novel procedures that address this issue. The core part of the procedures is to estimate the current tracking mean squared error (MSE). The MSE is decomposed in tracking variance and bias and novel and efficient procedures to estimate these quantities are presented. It is shown that estimation bias can be tracked by associating it with the portion of observations below the quantile estimates. The first procedure runs an ensemble of $L$ quantile estimators for wide range of values of the tuning parameters and typically around $L = 100$. In each iteration an oracle selects the best estimate by the guidance of the estimated MSEs. The second method only runs an ensemble of $L = 3$ estimators and thus the values of the tuning parameters need from time to time to be adjusted for the running estimators. The procedures have a low memory foot print of $8L$ and a computational complexity of $8L$ per iteration. The experiments show that the procedures are highly efficient and track quantiles with an error close to the theoretical optimum. The Oracle approach performs best, but comes with higher computational cost. The procedures were further applied to a massive real-life data stream of tweets and proofed real world applicability of them. △ Less

Submitted 27 April, 2020; originally announced April 2020.

A hemodynamic decomposition model for detecting cognitive load using functional near-infrared spectroscopy

Authors: Marco A. Pinto-Orellana, Diego C. Nascimento, Peyman Mirtaheri, Rune Jonassen, Anis Yazidi, Hugo L. Hammer

Abstract: In the current paper, we introduce a parametric data-driven model for functional near-infrared spectroscopy that decomposes a signal into a series of independent, rescaled, time-shifted, hemodynamic basis functions. Each decomposed waveform retains relevant biological information about the expected hemodynamic behavior. The model is also presented along with an efficient iterative estimation metho… ▽ More In the current paper, we introduce a parametric data-driven model for functional near-infrared spectroscopy that decomposes a signal into a series of independent, rescaled, time-shifted, hemodynamic basis functions. Each decomposed waveform retains relevant biological information about the expected hemodynamic behavior. The model is also presented along with an efficient iterative estimation method to improve the computational speed. Our hemodynamic decomposition model (HDM) extends the canonical model for instances when a) the external stimuli are unknown, or b) when the assumption of a direct relationship between the experimental stimuli and the hemodynamic responses cannot hold. We also argue that the proposed approach can be potentially adopted as a feature transformation method for machine learning purposes. By virtue of applying our devised HDM to a cognitive load classification task on fNIRS signals, we have achieved an accuracy of 86.20%+-2.56% using six channels in the frontal cortex, and 86.34%+-2.81% utilizing only the AFpz channel also located in the frontal area. In comparison, state-of-the-art time-spectral transformations only yield 64.61%+-3.03% and 37.8%+-2.96% under identical experimental settings. △ Less

Submitted 22 January, 2020; originally announced January 2020.

Estimating Tukey Depth Using Incremental Quantile Estimators

Authors: Hugo Lewi Hammer, Anis Yazidi, Håvard Rue

Abstract: The concept of depth represents methods to measure how deep an arbitrary point is positioned in a dataset and can be seen as the opposite of outlyingness. It has proved very useful and a wide range of methods have been developed based on the concept. To address the well-known computational challenges associated with the depth concept, we suggest to estimate Tukey depth contours using recently de… ▽ More The concept of depth represents methods to measure how deep an arbitrary point is positioned in a dataset and can be seen as the opposite of outlyingness. It has proved very useful and a wide range of methods have been developed based on the concept. To address the well-known computational challenges associated with the depth concept, we suggest to estimate Tukey depth contours using recently developed incremental quantile estimators. The suggested algorithm can estimate depth contours when the dataset in known in advance, but also recursively update and even track Tukey depth contours for dynamically varying data stream distributions. Tracking was demonstrated in a real-life data example where changes in human activity was detected in real-time from accelerometer observations. △ Less

Submitted 8 January, 2020; originally announced January 2020.

Orbital-driven Rashba effect in a binary honeycomb monolayer AgTe

Authors: Maximilian Ünzelmann, Hendrik Bentmann, Philipp Eck, Tilman Kißlinger, Begmuhammet Geldiyev, Janek Rieger, Simon Moser, Raphael C. Vidal, Katharina Kißner, Lutz Hammer, M. Alexander Schneider, Thomas Fauster, Giorgio Sangiovanni, Domenico Di Sante, Friedrich Reinert

Abstract: The Rashba effect is fundamental to the physics of two-dimensional electron systems and underlies a variety of spintronic phenomena. It has been proposed that the formation of Rashba-type spin splittings originates microscopically from the existence of orbital angular momentum (OAM) in the Bloch wave functions. Here, we present detailed experimental evidence for this OAM-based origin of the Rashba… ▽ More The Rashba effect is fundamental to the physics of two-dimensional electron systems and underlies a variety of spintronic phenomena. It has been proposed that the formation of Rashba-type spin splittings originates microscopically from the existence of orbital angular momentum (OAM) in the Bloch wave functions. Here, we present detailed experimental evidence for this OAM-based origin of the Rashba effect by angle-resolved photoemission (ARPES) and two-photon photoemission (2PPE) experiments for a monolayer AgTe on Ag(111). Using quantitative low-energy electron diffraction (LEED) analysis we determine the structural parameters and the stacking of the honeycomb overlayer with picometer precision. Based on an orbital-symmetry analysis in ARPES and supported by first-principles calculations, we unequivocally relate the presence and absence of Rashba-type spin splittings in different bands of AgTe to the existence of OAM. △ Less

Submitted 11 December, 2019; originally announced December 2019.

Journal ref: Phys. Rev. Lett. 124, 176401 (2020)

Machine Learning-Based Analysis of Sperm Videos and Participant Data for Male Fertility Prediction

Authors: Steven A. Hicks, Jorunn M. Andersen, Oliwia Witczak, Vajira Thambawita, Påll Halvorsen, Hugo L. Hammer, Trine B. Haugen, Michael A. Riegler

Abstract: Methods for automatic analysis of clinical data are usually targeted towards a specific modality and do not make use of all relevant data available. In the field of male human reproduction, clinical and biological data are not used to its fullest potential. Manual evaluation of a semen sample using a microscope is time-consuming and requires extensive training. Furthermore, the validity of manual… ▽ More Methods for automatic analysis of clinical data are usually targeted towards a specific modality and do not make use of all relevant data available. In the field of male human reproduction, clinical and biological data are not used to its fullest potential. Manual evaluation of a semen sample using a microscope is time-consuming and requires extensive training. Furthermore, the validity of manual semen analysis has been questioned due to limited reproducibility, and often high inter-personnel variation. The existing computer-aided sperm analyzer systems are not recommended for routine clinical use due to methodological challenges caused by the consistency of the semen sample. Thus, there is a need for an improved methodology. We use modern and classical machine learning techniques together with a dataset consisting of 85 videos of human semen samples and related participant data to automatically predict sperm motility. Used techniques include simple linear regression and more sophisticated methods using convolutional neural networks. Our results indicate that sperm motility prediction based on deep learning using sperm motility videos is rapid to perform and consistent. The algorithms performed worse when participant data was added. In conclusion, machine learning-based automatic analysis may become a valuable tool in male infertility investigation and research. △ Less

Submitted 29 October, 2019; originally announced October 2019.

Comments: Preprint, accepted by Nature Scientific Reports for publication 24.10.2019

Evaluation of the criticality of in vitro neuronal networks: Toward an assessment of computational capacity

Authors: Kristine Heiney, Vibeke Devold Valderhaug, Ioanna Sandvig, Axel Sandvig, Gunnar Tufte, Hugo Lewi Hammer, Stefano Nichele

Abstract: Novel computing hardwares are necessary to keep up with today's increasing demand for data storage and processing power. In this research project, we turn to the brain for inspiration to develop novel computing substrates that are self-learning, scalable, energy-efficient, and fault-tolerant. The overarching aim of this work is to develop computational models that are able to reproduce target beha… ▽ More Novel computing hardwares are necessary to keep up with today's increasing demand for data storage and processing power. In this research project, we turn to the brain for inspiration to develop novel computing substrates that are self-learning, scalable, energy-efficient, and fault-tolerant. The overarching aim of this work is to develop computational models that are able to reproduce target behaviors observed in in vitro neuronal networks. These models will be ultimately be used to aid in the realization of these behaviors in a more engineerable substrate: an array of nanomagnets. The target behaviors will be identified by analyzing electrophysiological recordings of the neuronal networks. Preliminary analysis has been performed to identify when a network is in a critical state based on the size distribution of network-wide avalanches of activity, and the results of this analysis are reported here. This classification of critical versus non-critical networks is valuable in identifying networks that can be expected to perform well on computational tasks, as criticality is widely considered to be the state in which a system is best suited for computation. This type of analysis is expected to enable the identification of networks that are well-suited for computation and the classification of networks as perturbed or healthy. △ Less

Submitted 4 July, 2019; originally announced July 2019.

Comments: For presentation at the workshop "Novel Substrates and Models for the Emergence of Developmental, Learning and Cognitive Capabilities," 9th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (IEEE ICDL-EPIROB 2019), Oslo, Norway. (website: http://www.nichele.eu/ICDL-EPIROB_NSM/ICDL-EPIROB_SNM.html)

Joint Tracking of Multiple Quantiles Through Conditional Quantiles

Authors: Hugo Lewi Hammer, Anis Yazidi, Håvard Rue

Abstract: Estimation of quantiles is one of the most fundamental real-time analysis tasks. Most real-time data streams vary dynamically with time and incremental quantile estimators document state-of-the art performance to track quantiles of such data streams. However, most are not able to make joint estimates of multiple quantiles in a consistent manner, and estimates may violate the monotone property of q… ▽ More Estimation of quantiles is one of the most fundamental real-time analysis tasks. Most real-time data streams vary dynamically with time and incremental quantile estimators document state-of-the art performance to track quantiles of such data streams. However, most are not able to make joint estimates of multiple quantiles in a consistent manner, and estimates may violate the monotone property of quantiles. In this paper we propose the general concept of *conditional quantiles* that can extend incremental estimators to jointly track multiple quantiles. We apply the concept to propose two new estimators. Extensive experimental results, on both synthetic and real-life data, show that the new estimators clearly outperform legacy state-of-the-art joint quantile tracking algorithm and achieve faster adaptivity in dynamically varying data streams. △ Less

Submitted 13 February, 2019; originally announced February 2019.

Comments: arXiv admin note: text overlap with arXiv:1901.04681

Statistical models for short and long term forecasts of snow depth

Authors: Hugo Lewi Hammer

Abstract: Forecasting of future snow depths is useful for many applications like road safety, winter sport activities, avalanche risk assessment and hydrology. Motivated by the lack of statistical forecasts models for snow depth, in this paper we present a set of models to fill this gap. First, we present a model to do short term forecasts when we assume that reliable weather forecasts of air temperature an… ▽ More Forecasting of future snow depths is useful for many applications like road safety, winter sport activities, avalanche risk assessment and hydrology. Motivated by the lack of statistical forecasts models for snow depth, in this paper we present a set of models to fill this gap. First, we present a model to do short term forecasts when we assume that reliable weather forecasts of air temperature and precipitation are available. The covariates are included nonlinearly into the model following basic physical principles of snowfall, snow aging and melting. Due to the large set of observations with snow depth equal to zero, we use a zero-inflated gamma regression model, which is commonly used to similar applications like precipitation. We also do long term forecasts of snow depth and much further than traditional weather forecasts for temperature and precipitation. The long-term forecasts are based on fitting models to historic time series of precipitation, temperature and snow depth. We fit the models to data from three locations in Norway with different climatic properties. Forecasting five days into the future, the results showed that, given reliable weather forecasts of temperature and precipitation, the forecast errors in absolute value was between 3 and 7 cm for different locations in Norway. Forecasting three weeks into the future, the forecast errors were between 7 and 16 cm. △ Less

Submitted 15 January, 2019; originally announced January 2019.

Quantile Tracking in Dynamically Varying Data Streams Using a Generalized Exponentially Weighted Average of Observations

Authors: Hugo Lewi Hammer, Anis Yazidi, Håvard Rue

Abstract: The Exponentially Weighted Average (EWA) of observations is known to be state-of-art estimator for tracking expectations of dynamically varying data stream distributions. However, how to devise an EWA estimator to rather track quantiles of data stream distributions is not obvious. In this paper, we present a lightweight quantile estimator using a generalized form of the EWA. To the best of our kno… ▽ More The Exponentially Weighted Average (EWA) of observations is known to be state-of-art estimator for tracking expectations of dynamically varying data stream distributions. However, how to devise an EWA estimator to rather track quantiles of data stream distributions is not obvious. In this paper, we present a lightweight quantile estimator using a generalized form of the EWA. To the best of our knowledge, this work represents the first reported quantile estimator of this form in the literature. An appealing property of the estimator is that the update step size is adjusted online proportionally to the difference between current observation and the current quantile estimate. Thus, if the estimator is off-track compared to the data stream, large steps will be taken to promptly get the estimator back on-track. The convergence of the estimator to the true quantile is proven using the theory of stochastic learning. Extensive experimental results using both synthetic and real-life data show that our estimator clearly outperforms legacy state-of-the-art quantile tracking estimators and achieves faster adaptivity in dynamic environments. The quantile estimator was further tested on real-life data where the objective is efficient online control of indoor climate. We show that the estimator can be incorporated into a concept drift detector for efficiently decide when a machine learning model used to predict future indoor temperature should be retrained/updated. △ Less

Submitted 15 January, 2019; originally announced January 2019.

Parameter Estimation in Abruptly Changing Dynamic Environments

Authors: Hugo Lewi Hammer, Anis Yazidi

Abstract: Many real-life dynamical systems change abruptly followed by almost stationary periods. In this paper, we consider streams of data with such abrupt behavior and investigate the problem of tracking their statistical properties in an online manner. We devise a tracking procedure where an estimator that is suitable for a stationary environment is combined together with an event detection method suc… ▽ More Many real-life dynamical systems change abruptly followed by almost stationary periods. In this paper, we consider streams of data with such abrupt behavior and investigate the problem of tracking their statistical properties in an online manner. We devise a tracking procedure where an estimator that is suitable for a stationary environment is combined together with an event detection method such that the estimator rapidly can jump to a more suitable value if an event is detected. Combining an estimation procedure with detection procedure is commonly known idea in the literature. However, our contribution lies in building the detection procedure based on the difference between the stationary estimator and a Stochastic Learning Weak Estimator (SLWE). The SLWE estimator is known to be the state-of-the art approach to tracking properties of non-stationary environments and thus should be a better choice to detect changes in abruptly changing environments than the far more common sliding window based approaches. To the best of our knowledge, the event detection procedure suggested by Ross et al. (2012) is the only procedure in the literature taking advantage of the powerful tracking properties of the SLWE estimator. The procedure in Ross et al. is however quite complex and not well founded theoretically compared to the procedures in this paper. In this paper, we focus on estimation procedure for the binomial and multinomial distributions, but our approach can be easily generalized to cover other distributions as well. Extensive simulation results based on both synthetic and real-life data related to news classification demonstrate that our estimation procedure is easy to tune and performs well. △ Less

Submitted 15 January, 2019; originally announced January 2019.

The Medico-Task 2018: Disease Detection in the Gastrointestinal Tract using Global Features and Deep Learning

Authors: Vajira Thambawita, Debesh Jha, Michael Riegler, Pål Halvorsen, Hugo Lewi Hammer, Håvard D. Johansen, Dag Johansen

Abstract: In this paper, we present our approach for the 2018 Medico Task classifying diseases in the gastrointestinal tract. We have proposed a system based on global features and deep neural networks. The best approach combines two neural networks, and the reproducible experimental results signify the efficiency of the proposed model with an accuracy rate of 95.80%, a precision of 95.87%, and an F1-score… ▽ More In this paper, we present our approach for the 2018 Medico Task classifying diseases in the gastrointestinal tract. We have proposed a system based on global features and deep neural networks. The best approach combines two neural networks, and the reproducible experimental results signify the efficiency of the proposed model with an accuracy rate of 95.80%, a precision of 95.87%, and an F1-score of 95.80%. △ Less

Submitted 31 October, 2018; originally announced October 2018.

Comments: 2 pages + 1 page for references, 1 figure, Conference paper

Journal ref: MediaEval 2018

Adsorption and Intermolecular Interaction of Cobalt Phthalocyanine on CoO(111) Ultrathin Films: An STM and DFT Study

Authors: Tobias Schmitt, Pascal Ferstl, Lutz Hammer, M. Alexander Schneider, Josef Redinger

Abstract: We investigate the adsorption of cobalt phthalocyanine (CoPc) molecules on a thin layer of cobalt oxide grown on Ir(100). To that end we compare the results of low-temperature scanning tunneling microscopy (STM) with those of ab-initio density functional theory (DFT) calculations and reveal the adsorption geometry. We find that the CoPc molecules lie flat on the surface and that their central coba… ▽ More We investigate the adsorption of cobalt phthalocyanine (CoPc) molecules on a thin layer of cobalt oxide grown on Ir(100). To that end we compare the results of low-temperature scanning tunneling microscopy (STM) with those of ab-initio density functional theory (DFT) calculations and reveal the adsorption geometry. We find that the CoPc molecules lie flat on the surface and that their central cobalt atom forms a chemical bond to a substrate oxygen ion. However, this bond contributes only modestly to the adsorption energy, while van-der-Waals forces dominate the potential landscape and determine to a large extend the geometry as well as the distortion of substrate and molecule. Furthermore they lead to attractive molecule-molecule interactions at higher molecular coverages. The DFT calculations predict energetic positions of the molecular orbitals which are compared to scanning tunneling spectroscopy (STS) measurements. △ Less

Submitted 23 October, 2018; originally announced October 2018.

Comments: 14 pages, 5 figures

Journal ref: J. Phys. Chem. C 121 (2017) 2889

Monatomic Co, CoO$_2$, and CoO$_3$ Nanowires on Ir(100) and Pt(100) surfaces: Formation, Structure, and Energetics

Authors: P. Ferstl, F. Mittendorfer, J. Redinger, M. A. Schneider, L. Hammer

Abstract: In this study we investigate the structural and chemical changes of monatomic CoO$_2$ chains grown self-organized on the Ir(100) surface [P. Ferstl et al., PRL 117, 2016, 046101] and on Pt(100) under reducing and oxidizing conditions. By a combination of quantitative low-energy electron diffraction, scanning tunnelling microscopy, and density functional theory we show that the cobalt oxide wires a… ▽ More In this study we investigate the structural and chemical changes of monatomic CoO$_2$ chains grown self-organized on the Ir(100) surface [P. Ferstl et al., PRL 117, 2016, 046101] and on Pt(100) under reducing and oxidizing conditions. By a combination of quantitative low-energy electron diffraction, scanning tunnelling microscopy, and density functional theory we show that the cobalt oxide wires are completely reduced by H$_2$ at temperatures above 320 K and a 3x1 ordered Ir$_2$Co or Pt$_2$Co surface alloy is formed. Depending on temperature the surface alloy on Ir(100) is either hydrogen covered (T < 400 K) or clean and eventually undergoes an irreversible order-disorder transition at about 570 K. The Pt$_2$Co surface alloy disorders with the desorption of hydrogen, whereby Co submerges into subsurface sites. Vice versa, applying stronger oxidants than O$_2$ such as NO$_2$ leads to the formation of CoO3 chains on Ir(100) in a 3x1 superstructure. On Pt(100) such a CoO$_3$ phase could not be prepared so far, which however, is due to the UHV conditions of our experiments. As revealed by theory this phase will become stable in a regime of higher pressure. In general, the structures can be reversibly switched on both surfaces using the respective agents O$_2$, NO$_2$ and H$_2$. △ Less

Submitted 19 October, 2018; originally announced October 2018.

Comments: 13 pages, 10 figures

Journal ref: Phys. Rev. B 96, 085407 (2017)

Subsurface Cation Vacancy Stabilization of the Magnetite (001) Surface

Authors: R. Bliem, E. McDermott, P. Ferstl, M. Setvin, O. Gamba, J. Pavelec, M. A. Schneider, M. Schmid, U. Diebold, P. Blaha, L. Hammer, G. S. Parkinson

Abstract: Iron oxides play an increasingly prominent role in heterogeneous catalysis, hydrogen production, spintronics and drug delivery. The surface or material interface can be performance limiting in these applications, so it is vital to determine accurate atomic-scale structures for iron oxides and understand why they form. Using a combination of quantitative low-energy electron diffraction, scanning tu… ▽ More Iron oxides play an increasingly prominent role in heterogeneous catalysis, hydrogen production, spintronics and drug delivery. The surface or material interface can be performance limiting in these applications, so it is vital to determine accurate atomic-scale structures for iron oxides and understand why they form. Using a combination of quantitative low-energy electron diffraction, scanning tunneling microscopy, and density functional theory calculations, we show that an ordered array of subsurface iron vacancies and interstitials underlies the well-known (rt2xrt2)R45° reconstruction of Fe3O4(001). This hitherto unobserved stabilization mechanism occurs because the iron oxides prefer to redistribute cations in the lattice in response to oxidizing or reducing environments. Many other metal oxides also achieve stoichiometric variation in this way, so such surface structures are likely commonplace. △ Less

Submitted 13 April, 2018; originally announced April 2018.

Journal ref: Science 346 (6214), 1215-1218 (2014)

Estimation of Multiple Quantiles in Dynamically Varying Data Streams

Authors: Hugo Lewi Hammer, Anis Yazidi, Håvard Rue

Abstract: In this paper we consider the problem of estimating quantiles when data are received sequentially (data stream). For real life data streams, the distribution of the data typically varies with time making estimation of quantiles challenging. We present a method that simultaneously maintain estimates of multiple quantiles of the data stream distribution. The method is based on making incremental upd… ▽ More In this paper we consider the problem of estimating quantiles when data are received sequentially (data stream). For real life data streams, the distribution of the data typically varies with time making estimation of quantiles challenging. We present a method that simultaneously maintain estimates of multiple quantiles of the data stream distribution. The method is based on making incremental updates of the quantile estimates every time a new sample from the data stream is received. The method is memory and computationally efficient since it only stores one value for each quantile estimate and only performs one operation per quantile estimate when a new sample is received from the data stream. The estimates are realistic in the sense that the monotone property of quantiles is satisfied in every iteration. Experiments show that the method efficiently tracks multiple quantiles and outperforms state of the art methods. △ Less

Submitted 31 January, 2017; originally announced February 2017.

Comments: The manuscript under review to Scandinavian Journal of Statistics