-
Enabling robots to follow abstract instructions and complete complex dynamic tasks
Authors:
Ruaridh Mon-Williams,
Gen Li,
Ran Long,
Wenqian Du,
Chris Lucas
Abstract:
Completing complex tasks in unpredictable settings like home kitchens challenges robotic systems. These challenges include interpreting high-level human commands, such as "make me a hot beverage" and performing actions like pouring a precise amount of water into a moving mug. To address these challenges, we present a novel framework that combines Large Language Models (LLMs), a curated Knowledge B…
▽ More
Completing complex tasks in unpredictable settings like home kitchens challenges robotic systems. These challenges include interpreting high-level human commands, such as "make me a hot beverage" and performing actions like pouring a precise amount of water into a moving mug. To address these challenges, we present a novel framework that combines Large Language Models (LLMs), a curated Knowledge Base, and Integrated Force and Visual Feedback (IFVF). Our approach interprets abstract instructions, performs long-horizon tasks, and handles various uncertainties. It utilises GPT-4 to analyse the user's query and surroundings, then generates code that accesses a curated database of functions during execution. It translates abstract instructions into actionable steps. Each step involves generating custom code by employing retrieval-augmented generalisation to pull IFVF-relevant examples from the Knowledge Base. IFVF allows the robot to respond to noise and disturbances during execution. We use coffee making and plate decoration to demonstrate our approach, including components ranging from pouring to drawer opening, each benefiting from distinct feedback types and methods. This novel advancement marks significant progress toward a scalable, efficient robotic framework for completing complex tasks in uncertain environments. Our findings are illustrated in an accompanying video and supported by an open-source GitHub repository (released upon paper acceptance).
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
A pilot protocol and cohort for the investigation of non-pathological variability in speech
Authors:
Nicholas Cummins,
Lauren L. White,
Zahia Rahman,
Catriona Lucas,
Tian Pan,
Ewan Carr,
Faith Matcham,
Johnny Downs,
Richard J. Dobson,
Judith Dineley
Abstract:
Background Speech-based biomarkers have potential as a means for regular, objective assessment of symptom severity, remotely and in-clinic in combination with advanced analytical models. However, the complex nature of speech and the often subtle changes associated with health mean that findings are highly dependent on methodological and cohort choices. These are often not reported adequately in st…
▽ More
Background Speech-based biomarkers have potential as a means for regular, objective assessment of symptom severity, remotely and in-clinic in combination with advanced analytical models. However, the complex nature of speech and the often subtle changes associated with health mean that findings are highly dependent on methodological and cohort choices. These are often not reported adequately in studies investigating speech-based health assessment Objective To develop and apply an exemplar protocol to generate a pilot dataset of healthy speech with detailed metadata for the assessment of factors in the speech recording-analysis pipeline, including device choice, speech elicitation task and non-pathological variability. Methods We developed our collection protocol and choice of exemplar speech features based on a thematic literature review. Our protocol includes the elicitation of three different speech types. With a focus towards remote applications, we also choose to collect speech with three different microphone types. We developed a pipeline to extract a set of 14 exemplar speech features. Results We collected speech from 28 individuals three times in one day, repeated at the same times 8-11 weeks later, and from 25 healthy individuals three times in one week. Participant characteristics collected included sex, age, native language status and voice use habits of the participant. A preliminary set of 14 speech features covering timing, prosody, voice quality, articulation and spectral moment characteristics were extracted that provide a resource of normative values. Conclusions There are multiple methodological factors involved in the collection, processing and analysis of speech recordings. Consistent reporting and greater harmonisation of study protocols are urgently required to aid the translation of speech processing into clinical research and practice.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
BraTS-Path Challenge: Assessing Heterogeneous Histopathologic Brain Tumor Sub-regions
Authors:
Spyridon Bakas,
Siddhesh P. Thakur,
Shahriar Faghani,
Mana Moassefi,
Ujjwal Baid,
Verena Chung,
Sarthak Pati,
Shubham Innani,
Bhakti Baheti,
Jake Albrecht,
Alexandros Karargyris,
Hasan Kassem,
MacLean P. Nasrallah,
Jared T. Ahrendsen,
Valeria Barresi,
Maria A. Gubbiotti,
Giselle Y. López,
Calixto-Hope G. Lucas,
Michael L. Miller,
Lee A. D. Cooper,
Jason T. Huse,
William R. Bell
Abstract:
Glioblastoma is the most common primary adult brain tumor, with a grim prognosis - median survival of 12-18 months following treatment, and 4 months otherwise. Glioblastoma is widely infiltrative in the cerebral hemispheres and well-defined by heterogeneous molecular and micro-environmental histopathologic profiles, which pose a major obstacle in treatment. Correctly diagnosing these tumors and as…
▽ More
Glioblastoma is the most common primary adult brain tumor, with a grim prognosis - median survival of 12-18 months following treatment, and 4 months otherwise. Glioblastoma is widely infiltrative in the cerebral hemispheres and well-defined by heterogeneous molecular and micro-environmental histopathologic profiles, which pose a major obstacle in treatment. Correctly diagnosing these tumors and assessing their heterogeneity is crucial for choosing the precise treatment and potentially enhancing patient survival rates. In the gold-standard histopathology-based approach to tumor diagnosis, detecting various morpho-pathological features of distinct histology throughout digitized tissue sections is crucial. Such "features" include the presence of cellular tumor, geographic necrosis, pseudopalisading necrosis, areas abundant in microvascular proliferation, infiltration into the cortex, wide extension in subcortical white matter, leptomeningeal infiltration, regions dense with macrophages, and the presence of perivascular or scattered lymphocytes. With these features in mind and building upon the main aim of the BraTS Cluster of Challenges https://www.synapse.org/brats2024, the goal of the BraTS-Path challenge is to provide a systematically prepared comprehensive dataset and a benchmarking environment to develop and fairly compare deep-learning models capable of identifying tumor sub-regions of distinct histologic profile. These models aim to further our understanding of the disease and assist in the diagnosis and grading of conditions in a consistent manner.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Multidimensional empirical wavelet transform
Authors:
Charles-Gérard Lucas,
Jérôme Gilles
Abstract:
The empirical wavelet transform is a data-driven time-scale representation consisting of adaptive filters. Its robustness to data has made it the subject of intense developments and an increasing number of applications in the last decade. However, it has been mostly studied theoretically for signals so far and its extension to images is limited to a particular mother wavelet. This work presents a…
▽ More
The empirical wavelet transform is a data-driven time-scale representation consisting of adaptive filters. Its robustness to data has made it the subject of intense developments and an increasing number of applications in the last decade. However, it has been mostly studied theoretically for signals so far and its extension to images is limited to a particular mother wavelet. This work presents a general framework for multidimensional empirical wavelet transform from any mother wavelet. In addition, it provides conditions to build wavelet frames for both continuous and discrete transforms.
△ Less
Submitted 9 May, 2024;
originally announced May 2024.
-
UruDendro, a public dataset of cross-section images of Pinus taeda
Authors:
Henry Marichal,
Diego Passarella,
Christine Lucas,
Ludmila Profumo,
Verónica Casaravilla,
María Noel Rocha Galli,
Serrana Ambite,
Gregory Randall
Abstract:
The automatic detection of tree-ring boundaries and other anatomical features using image analysis has progressed substantially over the past decade with advances in machine learning and imagery technology, as well as increasing demands from the dendrochronology community. This paper presents a publicly available database of 64 scanned images of transverse sections of commercially grown Pinus taed…
▽ More
The automatic detection of tree-ring boundaries and other anatomical features using image analysis has progressed substantially over the past decade with advances in machine learning and imagery technology, as well as increasing demands from the dendrochronology community. This paper presents a publicly available database of 64 scanned images of transverse sections of commercially grown Pinus taeda trees from northern Uruguay, ranging from 17 to 24 years old. The collection contains several challenging features for automatic ring detection, including illumination and surface preparation variation, fungal infection (blue stains), knot formation, missing cortex or interruptions in outer rings, and radial cracking. This dataset can be used to develop and test automatic tree ring detection algorithms. This paper presents to the dendrochronology community one such method, Cross-Section Tree-Ring Detection (CS-TRD), which identifies and marks complete annual rings in cross-sections for tree species presenting a clear definition between early and latewood. We compare the CS-TRD performance against the ground truth manual delineation of all rings over the UruDendro dataset. The CS-TRD software identified rings with an average F-score of 89% and RMSE error of 5.27px for the entire database in less than 20 seconds per image. Finally, we propose a robust measure of the ring growth using the \emph{equivalent radius} of a circle having the same area enclosed by the detected tree ring. Overall, this study contributes to the dendrochronologist's toolbox of fast and low-cost methods to automatically detect rings in conifer species, particularly for measuring diameter growth rates and stem transverse area using entire cross-sections.
△ Less
Submitted 16 April, 2024;
originally announced April 2024.
-
Dialogue Understandability: Why are we streaming movies with subtitles?
Authors:
Helard Becerra Martinez,
Alessandro Ragano,
Diptasree Debnath,
Asad Ullah,
Crisron Rudolf Lucas,
Martin Walsh,
Andrew Hines
Abstract:
Watching movies and TV shows with subtitles enabled is not simply down to audibility or speech intelligibility. A variety of evolving factors related to technological advances, cinema production and social behaviour challenge our perception and understanding. This study seeks to formalise and give context to these influential factors under a wider and novel term referred to as Dialogue Understanda…
▽ More
Watching movies and TV shows with subtitles enabled is not simply down to audibility or speech intelligibility. A variety of evolving factors related to technological advances, cinema production and social behaviour challenge our perception and understanding. This study seeks to formalise and give context to these influential factors under a wider and novel term referred to as Dialogue Understandability. We propose a working definition for Dialogue Understandability being a listener's capacity to follow the story without undue cognitive effort or concentration being required that impacts their Quality of Experience (QoE). The paper identifies, describes and categorises the factors that influence Dialogue Understandability mapping them over the QoE framework, a media streaming lifecycle, and the stakeholders involved. We then explore available measurement tools in the literature and link them to the factors they could potentially be used for. The maturity and suitability of these tools is evaluated over a set of pilot experiments. Finally, we reflect on the gaps that still need to be filled, what we can measure and what not, future subjective experiments, and new research trends that could help us to fully characterise Dialogue Understandability.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior
Authors:
Balint Gyevnar,
Stephanie Droop,
Tadeg Quillien,
Shay B. Cohen,
Neil R. Bramley,
Christopher G. Lucas,
Stefano V. Albrecht
Abstract:
Cognitive science can help us understand which explanations people might expect, and in which format they frame these explanations, whether causal, counterfactual, or teleological (i.e., purpose-oriented). Understanding the relevance of these concepts is crucial for building good explainable AI (XAI) which offers recourse and actionability. Focusing on autonomous driving, a complex decision-making…
▽ More
Cognitive science can help us understand which explanations people might expect, and in which format they frame these explanations, whether causal, counterfactual, or teleological (i.e., purpose-oriented). Understanding the relevance of these concepts is crucial for building good explainable AI (XAI) which offers recourse and actionability. Focusing on autonomous driving, a complex decision-making domain, we report empirical data from two surveys on (i) how people explain the behavior of autonomous vehicles in 14 unique scenarios (N1=54), and (ii) how they perceive these explanations in terms of complexity, quality, and trustworthiness (N2=356). Participants deemed teleological explanations significantly better quality than counterfactual ones, with perceived teleology being the best predictor of perceived quality and trustworthiness. Neither the perceived teleology nor the quality were affected by whether the car was an autonomous vehicle or driven by a person. This indicates that people use teleology to evaluate information about not just other people but also autonomous vehicles. Taken together, our findings highlight the importance of explanations that are framed in terms of purpose rather than just, as is standard in XAI, the causal mechanisms involved. We release the 14 scenarios and more than 1,300 elicited explanations publicly as the Human Explanations for Autonomous Driving Decisions (HEADD) dataset.
△ Less
Submitted 30 April, 2024; v1 submitted 11 March, 2024;
originally announced March 2024.
-
DRED: Zero-Shot Transfer in Reinforcement Learning via Data-Regularised Environment Design
Authors:
Samuel Garcin,
James Doran,
Shangmin Guo,
Christopher G. Lucas,
Stefano V. Albrecht
Abstract:
Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training. In this work, we investigate how the sampling of individual environment instances, or levels, affects the zero-shot generalisation (ZSG) ability of RL agents. W…
▽ More
Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training. In this work, we investigate how the sampling of individual environment instances, or levels, affects the zero-shot generalisation (ZSG) ability of RL agents. We discover that, for deep actor-critic architectures sharing their base layers, prioritising levels according to their value loss minimises the mutual information between the agent's internal representation and the set of training levels in the generated training data. This provides a novel theoretical justification for the regularisation achieved by certain adaptive sampling strategies. We then turn our attention to unsupervised environment design (UED) methods, which assume control over level generation. We find that existing UED methods can significantly shift the training distribution, which translates to low ZSG performance. To prevent both overfitting and distributional shift, we introduce data-regularised environment design (DRED). DRED generates levels using a generative model trained to approximate the ground truth distribution of an initial set of level parameters. Through its grounding, DRED achieves significant improvements in ZSG over adaptive level sampling strategies and UED methods. Our code and experimental data are available at https://github.com/uoe-agents/dred.
△ Less
Submitted 11 June, 2024; v1 submitted 5 February, 2024;
originally announced February 2024.
-
Data-driven Prior Learning for Bayesian Optimisation
Authors:
Sigrid Passano Hellan,
Christopher G. Lucas,
Nigel H. Goddard
Abstract:
Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but it is violated in a wide range of optimisation problems where transfer learning may nonetheless be useful. We replace this assumption with a weaker one only requiring the shape of…
▽ More
Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but it is violated in a wide range of optimisation problems where transfer learning may nonetheless be useful. We replace this assumption with a weaker one only requiring the shape of the optimisation landscape to be similar, and analyse the recent method Prior Learning for Bayesian Optimisation - PLeBO - in this setting. By learning priors for the hyperparameters of the Gaussian process surrogate model we can better approximate the underlying function, especially for few function evaluations. We validate the learned priors and compare to a breadth of transfer learning approaches, using synthetic data and a recent air pollution optimisation problem as benchmarks. We show that PLeBO and prior transfer find good inputs in fewer evaluations.
△ Less
Submitted 19 April, 2024; v1 submitted 24 November, 2023;
originally announced November 2023.
-
Multivariate selfsimilarity: Multiscale eigen-structures for selfsimilarity parameter estimation
Authors:
Charles-Gérard Lucas,
Gustavo Didier,
Herwig Wendt,
Patrice Abry
Abstract:
Scale-free dynamics, formalized by selfsimilarity, provides a versatile paradigm massively and ubiquitously used to model temporal dynamics in real-world data. However, its practical use has mostly remained univariate so far. By contrast, modern applications often demand multivariate data analysis. Accordingly, models for multivariate selfsimilarity were recently proposed. Nevertheless, they have…
▽ More
Scale-free dynamics, formalized by selfsimilarity, provides a versatile paradigm massively and ubiquitously used to model temporal dynamics in real-world data. However, its practical use has mostly remained univariate so far. By contrast, modern applications often demand multivariate data analysis. Accordingly, models for multivariate selfsimilarity were recently proposed. Nevertheless, they have remained rarely used in practice because of a lack of available robust estimation procedures for the vector of selfsimilarity parameters. Building upon recent mathematical developments, the present work puts forth an efficient estimation procedure based on the theoretical study of the multiscale eigenstructure of the wavelet spectrum of multivariate selfsimilar processes. The estimation performance is studied theoretically in the asymptotic limits of large scale and sample sizes, and computationally for finite-size samples. As a practical outcome, a fully operational and documented multivariate signal processing estimation toolbox is made freely available and is ready for practical use on real-world data. Its potential benefits are illustrated in epileptic seizure prediction from multi-channel EEG data.
△ Less
Submitted 2 April, 2024; v1 submitted 6 November, 2023;
originally announced November 2023.
-
Non-Compositionality in Sentiment: New Data and Analyses
Authors:
Verna Dankers,
Christopher G. Lucas
Abstract:
When natural language phrases are combined, their meaning is often more than the sum of their parts. In the context of NLP tasks such as sentiment analysis, where the meaning of a phrase is its sentiment, that still applies. Many NLP studies on sentiment analysis, however, focus on the fact that sentiment computations are largely compositional. We, instead, set out to obtain non-compositionality r…
▽ More
When natural language phrases are combined, their meaning is often more than the sum of their parts. In the context of NLP tasks such as sentiment analysis, where the meaning of a phrase is its sentiment, that still applies. Many NLP studies on sentiment analysis, however, focus on the fact that sentiment computations are largely compositional. We, instead, set out to obtain non-compositionality ratings for phrases with respect to their sentiment. Our contributions are as follows: a) a methodology for obtaining those non-compositionality ratings, b) a resource of ratings for 259 phrases -- NonCompSST -- along with an analysis of that resource, and c) an evaluation of computational models for sentiment analysis using this new resource.
△ Less
Submitted 31 October, 2023;
originally announced October 2023.
-
Balancing utility and cognitive cost in social representation
Authors:
Max Taylor-Davies,
Christopher G. Lucas
Abstract:
To successfully navigate its environment, an agent must construct and maintain representations of the other agents that it encounters. Such representations are useful for many tasks, but they are not without cost. As a result, agents must make decisions regarding how much information they choose to store about the agents in their environment. Using selective social learning as an example task, we…
▽ More
To successfully navigate its environment, an agent must construct and maintain representations of the other agents that it encounters. Such representations are useful for many tasks, but they are not without cost. As a result, agents must make decisions regarding how much information they choose to store about the agents in their environment. Using selective social learning as an example task, we motivate the problem of finding agent representations that optimally trade off between downstream utility and information cost, and illustrate two example approaches to resource-constrained social representation.
△ Less
Submitted 7 December, 2023; v1 submitted 7 October, 2023;
originally announced October 2023.
-
How the level sampling process impacts zero-shot generalisation in deep reinforcement learning
Authors:
Samuel Garcin,
James Doran,
Shangmin Guo,
Christopher G. Lucas,
Stefano V. Albrecht
Abstract:
A key limitation preventing the wider adoption of autonomous agents trained via deep reinforcement learning (RL) is their limited ability to generalise to new environments, even when these share similar characteristics with environments encountered during training. In this work, we investigate how a non-uniform sampling strategy of individual environment instances, or levels, affects the zero-shot…
▽ More
A key limitation preventing the wider adoption of autonomous agents trained via deep reinforcement learning (RL) is their limited ability to generalise to new environments, even when these share similar characteristics with environments encountered during training. In this work, we investigate how a non-uniform sampling strategy of individual environment instances, or levels, affects the zero-shot generalisation (ZSG) ability of RL agents, considering two failure modes: overfitting and over-generalisation. As a first step, we measure the mutual information (MI) between the agent's internal representation and the set of training levels, which we find to be well-correlated to instance overfitting. In contrast to uniform sampling, adaptive sampling strategies prioritising levels based on their value loss are more effective at maintaining lower MI, which provides a novel theoretical justification for this class of techniques. We then turn our attention to unsupervised environment design (UED) methods, which adaptively generate new training levels and minimise MI more effectively than methods sampling from a fixed set. However, we find UED methods significantly shift the training distribution, resulting in over-generalisation and worse ZSG performance over the distribution of interest. To prevent both instance overfitting and over-generalisation, we introduce self-supervised environment design (SSED). SSED generates levels using a variational autoencoder, effectively reducing MI while minimising the shift with the distribution of interest, and leads to statistically significant improvements in ZSG over fixed-set level sampling strategies and UED methods.
△ Less
Submitted 10 December, 2023; v1 submitted 5 October, 2023;
originally announced October 2023.
-
Modeling infant object perception as program induction
Authors:
Jan-Philipp Fränken,
Christopher G. Lucas,
Neil R. Bramley,
Steven T. Piantadosi
Abstract:
Infants expect physical objects to be rigid and persist through space and time and in spite of occlusion. Developmentists frequently attribute these expectations to a "core system" for object recognition. However, it is unclear if this move is necessary. If object representations emerge reliably from general inductive learning mechanisms exposed to small amounts of environment data, it could be th…
▽ More
Infants expect physical objects to be rigid and persist through space and time and in spite of occlusion. Developmentists frequently attribute these expectations to a "core system" for object recognition. However, it is unclear if this move is necessary. If object representations emerge reliably from general inductive learning mechanisms exposed to small amounts of environment data, it could be that infants simply induce these assumptions very early. Here, we demonstrate that a domain general learning system, previously used to model concept learning and language learning, can also induce models of these distinctive "core" properties of objects after exposure to a small number of examples. Across eight micro-worlds inspired by experiments from the developmental literature, our model generates concepts that capture core object properties, including rigidity and object persistence. Our findings suggest infant object perception may rely on a general cognitive process that creates models to maximize the likelihood of observations
△ Less
Submitted 28 August, 2023;
originally announced September 2023.
-
Bayesian Program Learning by Decompiling Amortized Knowledge
Authors:
Alessandro B. Palmarini,
Christopher G. Lucas,
N. Siddharth
Abstract:
DreamCoder is an inductive program synthesis system that, whilst solving problems, learns to simplify search in an iterative wake-sleep procedure. The cost of search is amortized by training a neural search policy, reducing search breadth and effectively "compiling" useful information to compose program solutions across tasks. Additionally, a library of program components is learnt to compress and…
▽ More
DreamCoder is an inductive program synthesis system that, whilst solving problems, learns to simplify search in an iterative wake-sleep procedure. The cost of search is amortized by training a neural search policy, reducing search breadth and effectively "compiling" useful information to compose program solutions across tasks. Additionally, a library of program components is learnt to compress and express discovered solutions in fewer components, reducing search depth. We present a novel approach for library learning that directly leverages the neural search policy, effectively "decompiling" its amortized knowledge to extract relevant program components. This provides stronger amortized inference: the amortized knowledge learnt to reduce search breadth is now also used to reduce search depth. We integrate our approach with DreamCoder and demonstrate faster domain proficiency with improved generalization on a range of domains, particularly when fewer example solutions are available.
△ Less
Submitted 31 May, 2024; v1 submitted 13 June, 2023;
originally announced June 2023.
-
Bayesian Optimisation Against Climate Change: Applications and Benchmarks
Authors:
Sigrid Passano Hellan,
Christopher G. Lucas,
Nigel H. Goddard
Abstract:
Bayesian optimisation is a powerful method for optimising black-box functions, popular in settings where the true function is expensive to evaluate and no gradient information is available. Bayesian optimisation can improve responses to many optimisation problems within climate change for which simulator models are unavailable or expensive to sample from. While there have been several feasibility…
▽ More
Bayesian optimisation is a powerful method for optimising black-box functions, popular in settings where the true function is expensive to evaluate and no gradient information is available. Bayesian optimisation can improve responses to many optimisation problems within climate change for which simulator models are unavailable or expensive to sample from. While there have been several feasibility demonstrations of Bayesian optimisation in climate-related applications, there has been no unifying review of applications and benchmarks. We provide such a review here, to encourage the use of Bayesian optimisation in important and well-suited application domains. We identify four main application domains: material discovery, wind farm layout, optimal renewable control and environmental monitoring. For each domain we identify a public benchmark or data set that is easy to use and evaluate systems against, while being representative of real-world problems. Due to the lack of a suitable benchmark for environmental monitoring, we propose LAQN-BO, based on air pollution data. Our contributions are: a) identifying a representative range of benchmarks, providing example code where necessary; b) introducing a new benchmark, LAQN-BO; and c) promoting a wider use of climate change applications among Bayesian optimisation practitioners.
△ Less
Submitted 7 June, 2023;
originally announced June 2023.
-
Designing Optimal Behavioral Experiments Using Machine Learning
Authors:
Simon Valentin,
Steven Kleinegesse,
Neil R. Bramley,
Peggy Seriès,
Michael U. Gutmann,
Christopher G. Lucas
Abstract:
Computational models are powerful tools for understanding human cognition and behavior. They let us express our theories clearly and precisely, and offer predictions that can be subtle and often counter-intuitive. However, this same richness and ability to surprise means our scientific intuitions and traditional tools are ill-suited to designing experiments to test and compare these models. To avo…
▽ More
Computational models are powerful tools for understanding human cognition and behavior. They let us express our theories clearly and precisely, and offer predictions that can be subtle and often counter-intuitive. However, this same richness and ability to surprise means our scientific intuitions and traditional tools are ill-suited to designing experiments to test and compare these models. To avoid these pitfalls and realize the full potential of computational modeling, we require tools to design experiments that provide clear answers about what models explain human behavior and the auxiliary assumptions those models must make. Bayesian optimal experimental design (BOED) formalizes the search for optimal experimental designs by identifying experiments that are expected to yield informative data. In this work, we provide a tutorial on leveraging recent advances in BOED and machine learning to find optimal experiments for any kind of model that we can simulate data from, and show how by-products of this procedure allow for quick and straightforward evaluation of models and their parameters against real experimental data. As a case study, we consider theories of how people balance exploration and exploitation in multi-armed bandit decision-making tasks. We validate the presented approach using simulations and a real-world experiment. As compared to experimental designs commonly used in the literature, we show that our optimal designs more efficiently determine which of a set of models best account for individual human behavior, and more efficiently characterize behavior given a preferred model. At the same time, formalizing a scientific question such that it can be adequately addressed with BOED can be challenging and we discuss several potential caveats and pitfalls that practitioners should be aware of. We provide code and tutorial notebooks to replicate all analyses.
△ Less
Submitted 26 November, 2023; v1 submitted 12 May, 2023;
originally announced May 2023.
-
Selective imitation on the basis of reward function similarity
Authors:
Max Taylor-Davies,
Stephanie Droop,
Christopher G. Lucas
Abstract:
Imitation is a key component of human social behavior, and is widely used by both children and adults as a way to navigate uncertain or unfamiliar situations. But in an environment populated by multiple heterogeneous agents pursuing different goals or objectives, indiscriminate imitation is unlikely to be an effective strategy -- the imitator must instead determine who is most useful to copy. Ther…
▽ More
Imitation is a key component of human social behavior, and is widely used by both children and adults as a way to navigate uncertain or unfamiliar situations. But in an environment populated by multiple heterogeneous agents pursuing different goals or objectives, indiscriminate imitation is unlikely to be an effective strategy -- the imitator must instead determine who is most useful to copy. There are likely many factors that play into these judgements, depending on context and availability of information. Here we investigate the hypothesis that these decisions involve inferences about other agents' reward functions. We suggest that people preferentially imitate the behavior of others they deem to have similar reward functions to their own. We further argue that these inferences can be made on the basis of very sparse or indirect data, by leveraging an inductive bias toward positing the existence of different \textit{groups} or \textit{types} of people with similar reward functions, allowing learners to select imitation targets without direct evidence of alignment.
△ Less
Submitted 12 May, 2023;
originally announced May 2023.
-
Predicting Malaria Incidence Using Artifical Neural Networks and Disaggregation Regression
Authors:
Jack A. Hall,
Tim C. D. Lucas
Abstract:
Disaggregation modelling is a method of predicting disease risk at high resolution using aggregated response data. High resolution disease mapping is an important public health tool to aid the optimisation of resources, and is commonly used in assisting responses to diseases such as malaria. Current disaggregation regression methods are slow, inflexible, and do not easily allow non-linear terms.…
▽ More
Disaggregation modelling is a method of predicting disease risk at high resolution using aggregated response data. High resolution disease mapping is an important public health tool to aid the optimisation of resources, and is commonly used in assisting responses to diseases such as malaria. Current disaggregation regression methods are slow, inflexible, and do not easily allow non-linear terms.
Neural networks may offer a solution to the limitations of current disaggregation methods. This project aimed to design a neural network which mimics the behaviour of disaggregation, then benchmark it against current methods for accuracy, flexibility and speed.
Cross-validation and nested cross-validation tested neural networks against traditional disaggregation for accuracy and execution speed was measured.
Neural networks did not improve on the accuracy of current disaggregation methods, although did see an improvement in execution time. The neural network models are more flexible and offer potential for further improvements on all metrics. The R package 'Kedis' (Keras-Disaggregation) is introduced as a user-friendly method of implementing neural network disaggregation models.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
-
On the use of organic semiconductors as handles for optical tweezers experiments: trapping and manipulating polyaniline (PANI) microparticles
Authors:
Kairon M. Oliveira,
Tiago A. Moura,
Janaisa L. C. Lucas,
Alvaro V. N. C. Teixeira,
Marcio S. Rocha,
Joaquim B. S. Mendes
Abstract:
Here we propose the use of the organic semiconductor polyaniline (PANI) for the preparation of spherical-shaped microparticles to serve as handles in optical tweezers (OT) experiments. The stable trapping and manipulation of PANI beads was demonstrated for the first time, using a Gaussian ($TEM_{00}$) beam optical tweezers. The trap stiffness was characterized for various different parameters such…
▽ More
Here we propose the use of the organic semiconductor polyaniline (PANI) for the preparation of spherical-shaped microparticles to serve as handles in optical tweezers (OT) experiments. The stable trapping and manipulation of PANI beads was demonstrated for the first time, using a Gaussian ($TEM_{00}$) beam optical tweezers. The trap stiffness was characterized for various different parameters such as the bead radius, the laser power and the distance between the bead and the coverslip of the sample chamber, attesting the viability of using such material for optical manipulation. Since the effective optical properties of PANI can be modulated by the synthesis process, new related applications are also proposed. The results of the present work therefore open the door for using semiconductor polymeric materials in OT applications.
△ Less
Submitted 5 March, 2023;
originally announced March 2023.
-
Causal Explanations for Sequential Decision-Making in Multi-Agent Systems
Authors:
Balint Gyevnar,
Cheng Wang,
Christopher G. Lucas,
Shay B. Cohen,
Stefano V. Albrecht
Abstract:
We present CEMA: Causal Explanations in Multi-Agent systems; a framework for creating causal natural language explanations of an agent's decisions in dynamic sequential multi-agent systems to build more trustworthy autonomous agents. Unlike prior work that assumes a fixed causal structure, CEMA only requires a probabilistic model for forward-simulating the state of the system. Using such a model,…
▽ More
We present CEMA: Causal Explanations in Multi-Agent systems; a framework for creating causal natural language explanations of an agent's decisions in dynamic sequential multi-agent systems to build more trustworthy autonomous agents. Unlike prior work that assumes a fixed causal structure, CEMA only requires a probabilistic model for forward-simulating the state of the system. Using such a model, CEMA simulates counterfactual worlds that identify the salient causes behind the agent's decisions. We evaluate CEMA on the task of motion planning for autonomous driving and test it in diverse simulated scenarios. We show that CEMA correctly and robustly identifies the causes behind the agent's decisions, even when a large number of other agents is present, and show via a user study that CEMA's explanations have a positive effect on participants' trust in autonomous vehicles and are rated as high as high-quality baseline explanations elicited from other participants. We release the collected explanations with annotations as the HEADD dataset.
△ Less
Submitted 14 February, 2024; v1 submitted 21 February, 2023;
originally announced February 2023.
-
Actively learning to learn causal relationships
Authors:
Chentian Jiang,
Christopher G. Lucas
Abstract:
How do people actively learn to learn? That is, how and when do people choose actions that facilitate long-term learning and choosing future actions that are more informative? We explore these questions in the domain of active causal learning. We propose a hierarchical Bayesian model that goes beyond past models by predicting that people pursue information not only about the causal relationship at…
▽ More
How do people actively learn to learn? That is, how and when do people choose actions that facilitate long-term learning and choosing future actions that are more informative? We explore these questions in the domain of active causal learning. We propose a hierarchical Bayesian model that goes beyond past models by predicting that people pursue information not only about the causal relationship at hand but also about causal overhypotheses$\unicode{x2014}$abstract beliefs about causal relationships that span multiple situations and constrain how we learn the specifics in each situation. In two active "blicket detector" experiments with 14 between-subjects manipulations, our model was supported by both qualitative trends in participant behavior and an individual-differences-based model comparison. Our results suggest when there are abstract similarities across active causal learning problems, people readily learn and transfer overhypotheses about these similarities. Moreover, people exploit these overhypotheses to facilitate long-term active learning.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
A Human-Centric Method for Generating Causal Explanations in Natural Language for Autonomous Vehicle Motion Planning
Authors:
Balint Gyevnar,
Massimiliano Tamborski,
Cheng Wang,
Christopher G. Lucas,
Shay B. Cohen,
Stefano V. Albrecht
Abstract:
Inscrutable AI systems are difficult to trust, especially if they operate in safety-critical settings like autonomous driving. Therefore, there is a need to build transparent and queryable systems to increase trust levels. We propose a transparent, human-centric explanation generation method for autonomous vehicle motion planning and prediction based on an existing white-box system called IGP2. Ou…
▽ More
Inscrutable AI systems are difficult to trust, especially if they operate in safety-critical settings like autonomous driving. Therefore, there is a need to build transparent and queryable systems to increase trust levels. We propose a transparent, human-centric explanation generation method for autonomous vehicle motion planning and prediction based on an existing white-box system called IGP2. Our method integrates Bayesian networks with context-free generative rules and can give causal natural language explanations for the high-level driving behaviour of autonomous vehicles. Preliminary testing on simulated scenarios shows that our method captures the causes behind the actions of autonomous vehicles and generates intelligible explanations with varying complexity.
△ Less
Submitted 27 June, 2022; v1 submitted 17 June, 2022;
originally announced June 2022.
-
Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation
Authors:
Verna Dankers,
Christopher G. Lucas,
Ivan Titov
Abstract:
Unlike literal expressions, idioms' meanings do not directly follow from their parts, posing a challenge for neural machine translation (NMT). NMT models are often unable to translate idioms accurately and over-generate compositional, literal translations. In this work, we investigate whether the non-compositionality of idioms is reflected in the mechanics of the dominant NMT model, Transformer, b…
▽ More
Unlike literal expressions, idioms' meanings do not directly follow from their parts, posing a challenge for neural machine translation (NMT). NMT models are often unable to translate idioms accurately and over-generate compositional, literal translations. In this work, we investigate whether the non-compositionality of idioms is reflected in the mechanics of the dominant NMT model, Transformer, by analysing the hidden states and attention patterns for models with English as source language and one of seven European languages as target language. When Transformer emits a non-literal translation - i.e. identifies the expression as idiomatic - the encoder processes idioms more strongly as single lexical units compared to literal expressions. This manifests in idioms' parts being grouped through attention and in reduced interaction between idioms and their context. In the decoder's cross-attention, figurative inputs result in reduced attention on source-side tokens. These results suggest that Transformer's tendency to process idioms as compositional expressions contributes to literal translations of idioms.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Bayesian Optimisation for Active Monitoring of Air Pollution
Authors:
Sigrid Passano Hellan,
Christopher G. Lucas,
Nigel H. Goddard
Abstract:
Air pollution is one of the leading causes of mortality globally, resulting in millions of deaths each year. Efficient monitoring is important to measure exposure and enforce legal limits. New low-cost sensors can be deployed in greater numbers and in more varied locations, motivating the problem of efficient automated placement. Previous work suggests Bayesian optimisation is an appropriate metho…
▽ More
Air pollution is one of the leading causes of mortality globally, resulting in millions of deaths each year. Efficient monitoring is important to measure exposure and enforce legal limits. New low-cost sensors can be deployed in greater numbers and in more varied locations, motivating the problem of efficient automated placement. Previous work suggests Bayesian optimisation is an appropriate method, but only considered a satellite data set, with data aggregated over all altitudes. It is ground-level pollution, that humans breathe, which matters most. We improve on those results using hierarchical models and evaluate our models on urban pollution data in London to show that Bayesian optimisation can be successfully applied to the problem.
△ Less
Submitted 19 April, 2024; v1 submitted 15 February, 2022;
originally announced February 2022.
-
Building Object-based Causal Programs for Human-like Generalization
Authors:
Bonan Zhao,
Christopher G. Lucas,
Neil R. Bramley
Abstract:
We present a novel task that measures how people generalize objects' causal powers based on observing a single (Experiment 1) or a few (Experiment 2) causal interactions between object pairs. We propose a computational modeling framework that can synthesize human-like generalization patterns in our task setting, and sheds light on how people may navigate the compositional space of possible causal…
▽ More
We present a novel task that measures how people generalize objects' causal powers based on observing a single (Experiment 1) or a few (Experiment 2) causal interactions between object pairs. We propose a computational modeling framework that can synthesize human-like generalization patterns in our task setting, and sheds light on how people may navigate the compositional space of possible causal functions and categories efficiently. Our modeling framework combines a causal function generator that makes use of agent and recipient objects' features and relations, and a Bayesian non-parametric inference process to govern the degree of similarity-based generalization. Our model has a natural "resource-rational" variant that outperforms a naive Bayesian account in describing participants, in particular reproducing a generalization-order effect and causal asymmetry observed in our behavioral experiments. We argue that this modeling framework provides a computationally plausible mechanism for real world causal generalization.
△ Less
Submitted 20 November, 2021;
originally announced November 2021.
-
Bayesian Optimal Experimental Design for Simulator Models of Cognition
Authors:
Simon Valentin,
Steven Kleinegesse,
Neil R. Bramley,
Michael U. Gutmann,
Christopher G. Lucas
Abstract:
Bayesian optimal experimental design (BOED) is a methodology to identify experiments that are expected to yield informative data. Recent work in cognitive science considered BOED for computational models of human behavior with tractable and known likelihood functions. However, tractability often comes at the cost of realism; simulator models that can capture the richness of human behavior are ofte…
▽ More
Bayesian optimal experimental design (BOED) is a methodology to identify experiments that are expected to yield informative data. Recent work in cognitive science considered BOED for computational models of human behavior with tractable and known likelihood functions. However, tractability often comes at the cost of realism; simulator models that can capture the richness of human behavior are often intractable. In this work, we combine recent advances in BOED and approximate inference for intractable models, using machine-learning methods to find optimal experimental designs, approximate sufficient summary statistics and amortized posterior distributions. Our simulation experiments on multi-armed bandit tasks show that our method results in improved model discrimination and parameter estimation, as compared to experimental designs commonly used in the literature.
△ Less
Submitted 29 October, 2021;
originally announced October 2021.
-
Hyperparameter selection for Discrete Mumford-Shah
Authors:
Charles-Gérard Lucas,
Barbara Pascal,
Nelly Pustelnik,
Patrice Abry
Abstract:
This work focuses on a parameter-free joint piecewise smooth image denoising and contour detection. Formulated as the minimization of a discrete Mumford-Shah functional and estimated via a theoretically grounded alternating minimization scheme, the bottleneck of such a variational approach lies in the need to fine-tune their hyperparameters, while not having access to ground truth data. To that ai…
▽ More
This work focuses on a parameter-free joint piecewise smooth image denoising and contour detection. Formulated as the minimization of a discrete Mumford-Shah functional and estimated via a theoretically grounded alternating minimization scheme, the bottleneck of such a variational approach lies in the need to fine-tune their hyperparameters, while not having access to ground truth data. To that aim, a Stein-like strategy providing optimal hyperparameters is designed, based on the minimization of an unbiased estimate of the quadratic risk. Efficient and automated minimization of the estimate of the risk crucially relies on an unbiased estimate of the gradient of the risk with respect to hyperparameters. Its practical implementation is performed using a forward differentiation of the alternating scheme minimizing the Mumford-Shah functional, requiring exact differentiation of the proximity operators involved. Intensive numerical experiments are performed on synthetic images with different geometry and noise levels, assessing the accuracy and the robustness of the proposed procedure. The resulting parameter-free piecewise-smooth estimation and contour detection procedure, not requiring prior image processing expertise nor annotated data, can then be applied to real-world images.
△ Less
Submitted 31 January, 2023; v1 submitted 28 September, 2021;
originally announced September 2021.
-
Optimising Placement of Pollution Sensors in Windy Environments
Authors:
Sigrid Passano Hellan,
Christopher G. Lucas,
Nigel H. Goddard
Abstract:
Air pollution is one of the most important causes of mortality in the world. Monitoring air pollution is useful to learn more about the link between health and pollutants, and to identify areas for intervention. Such monitoring is expensive, so it is important to place sensors as efficiently as possible. Bayesian optimisation has proven useful in choosing sensor locations, but typically relies on…
▽ More
Air pollution is one of the most important causes of mortality in the world. Monitoring air pollution is useful to learn more about the link between health and pollutants, and to identify areas for intervention. Such monitoring is expensive, so it is important to place sensors as efficiently as possible. Bayesian optimisation has proven useful in choosing sensor locations, but typically relies on kernel functions that neglect the statistical structure of air pollution, such as the tendency of pollution to propagate in the prevailing wind direction. We describe two new wind-informed kernels and investigate their advantage for the task of actively learning locations of maximum pollution using Bayesian optimisation.
△ Less
Submitted 28 August, 2022; v1 submitted 19 December, 2020;
originally announced December 2020.
-
A simulation study of disaggregation regression for spatial disease mapping
Authors:
Rohan Arambepola,
Tim C D Lucas,
Anita K Nandi,
Peter W Gething,
Ewan Cameron
Abstract:
Disaggregation regression has become an important tool in spatial disease mapping for making fine-scale predictions of disease risk from aggregated response data. By including high resolution covariate information and modelling the data generating process on a fine scale, it is hoped that these models can accurately learn the relationships between covariates and response at a fine spatial scale. H…
▽ More
Disaggregation regression has become an important tool in spatial disease mapping for making fine-scale predictions of disease risk from aggregated response data. By including high resolution covariate information and modelling the data generating process on a fine scale, it is hoped that these models can accurately learn the relationships between covariates and response at a fine spatial scale. However, validating these high resolution predictions can be a challenge, as often there is no data observed at this spatial scale. In this study, disaggregation regression was performed on simulated data in various settings and the resulting fine-scale predictions are compared to the simulated ground truth. Performance was investigated with varying numbers of data points, sizes of aggregated areas and levels of model misspecification. The effectiveness of cross validation on the aggregate level as a measure of fine-scale predictive performance was also investigated. Predictive performance improved as the number of observations increased and as the size of the aggregated areas decreased. When the model was well-specified, fine-scale predictions were accurate even with small numbers of observations and large aggregated areas. Under model misspecification predictive performance was significantly worse for large aggregated areas but remained high when response data was aggregated over smaller regions. Cross-validation correlation on the aggregate level was a moderately good predictor of fine-scale predictive performance. While the simulations are unlikely to capture the nuances of real-life response data, this study gives insight into the effectiveness of disaggregation regression in different contexts.
△ Less
Submitted 7 May, 2020;
originally announced May 2020.
-
Proof Theory of Riesz Spaces and Modal Riesz Spaces
Authors:
Christophe Lucas,
Matteo Mio
Abstract:
We design hypersequent calculus proof systems for the theories of Riesz spaces and modal Riesz spaces and prove the key theorems: soundness, completeness and cut elimination. These are then used to obtain completely syntactic proofs of some interesting results concerning the two theories. Most notably, we prove a novel result: the theory of modal Riesz spaces is decidable. This work has applicatio…
▽ More
We design hypersequent calculus proof systems for the theories of Riesz spaces and modal Riesz spaces and prove the key theorems: soundness, completeness and cut elimination. These are then used to obtain completely syntactic proofs of some interesting results concerning the two theories. Most notably, we prove a novel result: the theory of modal Riesz spaces is decidable. This work has applications in the field of logics of probabilistic programs since modal Riesz spaces provide the algebraic semantics of the Riesz modal logic underlying the probabilistic mu-calculus.
△ Less
Submitted 16 February, 2022; v1 submitted 23 April, 2020;
originally announced April 2020.
-
disaggregation: An R Package for Bayesian Spatial Disaggregation Modelling
Authors:
Anita K. Nandi,
Tim C. D. Lucas,
Rohan Arambepola,
Peter Gething,
Daniel J. Weiss
Abstract:
Disaggregation modelling, or downscaling, has become an important discipline in epidemiology. Surveillance data, aggregated over large regions, is becoming more common, leading to an increasing demand for modelling frameworks that can deal with this data to understand spatial patterns. Disaggregation regression models use response data aggregated over large heterogenous regions to make predictions…
▽ More
Disaggregation modelling, or downscaling, has become an important discipline in epidemiology. Surveillance data, aggregated over large regions, is becoming more common, leading to an increasing demand for modelling frameworks that can deal with this data to understand spatial patterns. Disaggregation regression models use response data aggregated over large heterogenous regions to make predictions at fine-scale over the region by using fine-scale covariates to inform the heterogeneity. This paper presents the R package disaggregation, which provides functionality to streamline the process of running a disaggregation model for fine-scale predictions.
△ Less
Submitted 9 January, 2020;
originally announced January 2020.
-
Universal Marginaliser for Deep Amortised Inference for Probabilistic Programs
Authors:
Robert Walecki,
Kostis Gourgoulias,
Adam Baker,
Chris Hart,
Chris Lucas,
Max Zwiessele,
Albert Buchard,
Maria Lomeli,
Yura Perov,
Saurabh Johri
Abstract:
Probabilistic programming languages (PPLs) are powerful modelling tools which allow to formalise our knowledge about the world and reason about its inherent uncertainty. Inference methods used in PPL can be computationally costly due to significant time burden and/or storage requirements; or they can lack theoretical guarantees of convergence and accuracy when applied to large scale graphical mode…
▽ More
Probabilistic programming languages (PPLs) are powerful modelling tools which allow to formalise our knowledge about the world and reason about its inherent uncertainty. Inference methods used in PPL can be computationally costly due to significant time burden and/or storage requirements; or they can lack theoretical guarantees of convergence and accuracy when applied to large scale graphical models. To this end, we present the Universal Marginaliser (UM), a novel method for amortised inference, in PPL. We show how combining samples drawn from the original probabilistic program prior with an appropriate augmentation method allows us to train one neural network to approximate any of the corresponding conditional marginal distributions, with any separation into latent and observed variables, and thus amortise the cost of inference. Finally, we benchmark the method on multiple probabilistic programs, in Pyro, with different model structure.
△ Less
Submitted 16 October, 2019;
originally announced October 2019.
-
Accretion and photodesorption of CO ice as a function of the incident angle of deposition
Authors:
C González Díaz,
H Carrascosa de Lucas,
S Aparicio,
G M Muñoz Caro,
N-E Sie,
L-C Hsiao,
Y-J Chen
Abstract:
Non-thermal desorption of inter- and circum-stellar ice mantles on dust grains, in particular ultraviolet photon-induced desorption, has gained importance in recent years. These processes may account for the observed gas phase abundances of molecules like CO toward cold interstellar clouds. Ice mantle growth results from gas molecules impinging on the dust from all directions and incidence angles.…
▽ More
Non-thermal desorption of inter- and circum-stellar ice mantles on dust grains, in particular ultraviolet photon-induced desorption, has gained importance in recent years. These processes may account for the observed gas phase abundances of molecules like CO toward cold interstellar clouds. Ice mantle growth results from gas molecules impinging on the dust from all directions and incidence angles. Nevertheless, the effect of the incident angle for deposition on ice photo-desorption rate has not been studied. This work explores the impact on the accretion and photodesorption rates of the incidence angle of CO gas molecules with the cold surface during deposition of a CO ice layer. Infrared spectroscopy monitored CO ice upon deposition at different angles, ultraviolet-irradiation, and subsequent warm-up. Vacuum-ultraviolet spectroscopy and a Ni-mesh measured the emission of the ultraviolet lamp. Molecules ejected from the ice to the gas during irradiation or warm-up were characterized by a quadrupole mass spectrometer. The photodesorption rate of CO ice deposited at 11 K and different incident angles was rather stable between 0 and 45$^{\circ}$. A maximum in the CO photodesorption rate appeared around 70$^{\circ}$-incidence deposition angle. The same deposition angle leads to the maximum surface area of water ice. Although this study of the surface area could not be performed for CO ice, the similar angle dependence in the photodesorption and the ice surface area suggests that they are closely related. Further evidence for a dependence of CO ice morphology on deposition angle is provided by thermal desorption of CO ice experiments.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
-
Mapping malaria seasonality: a case study from Madagascar
Authors:
Michele Nguyen,
Rosalind E. Howes,
Tim C. D. Lucas,
Katherine E. Battle,
Ewan Cameron,
Harry S. Gibson,
Jennifer Rozier,
Suzanne Keddie,
Emma Collins,
Rohan Arambepola,
Su Yun Kang,
Chantal Hendriks,
Anita Nandi,
Susan F. Rumisha,
Samir Bhatt,
Sedera A. Mioramalala,
Mauricette Andriamananjara Nambinisoa,
Fanjasoa Rakotomanana,
Peter W. Gething,
Daniel J. Weiss
Abstract:
Many malaria-endemic areas experience seasonal fluctuations in case incidence as Anopheles mosquito and Plasmodium parasite life cycles respond to changing environmental conditions. While most existing maps of malaria seasonality use fixed thresholds of rainfall, temperature, and/or vegetation indices to identify suitable transmission months, we develop a statistical modelling framework for charac…
▽ More
Many malaria-endemic areas experience seasonal fluctuations in case incidence as Anopheles mosquito and Plasmodium parasite life cycles respond to changing environmental conditions. While most existing maps of malaria seasonality use fixed thresholds of rainfall, temperature, and/or vegetation indices to identify suitable transmission months, we develop a statistical modelling framework for characterising the seasonal patterns derived directly from case data.
The procedure involves a spatiotemporal regression model for estimating the monthly proportions of total annual cases and an algorithm to identify operationally relevant characteristics such as the transmission start and peak months. A seasonality index combines the monthly proportion estimates and existing estimates of annual case incidence to provide a summary of "how seasonal" locations are relative to their surroundings. An advancement upon past seasonality mapping endeavours is the presentation of the uncertainty associated with each map, which will enable policymakers to make more statistically sound decisions. The methodology is illustrated using health facility data from Madagascar.
△ Less
Submitted 17 May, 2019; v1 submitted 30 January, 2019;
originally announced January 2019.
-
Variational Learning on Aggregate Outputs with Gaussian Processes
Authors:
Ho Chung Leon Law,
Dino Sejdinovic,
Ewan Cameron,
Tim CD Lucas,
Seth Flaxman,
Katherine Battle,
Kenji Fukumizu
Abstract:
While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global mapping of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new inputs much more difficult. We consider an approach to this problem based on varia…
▽ More
While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global mapping of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new inputs much more difficult. We consider an approach to this problem based on variational learning with a model of output aggregation and Gaussian processes, where aggregation leads to intractability of the standard evidence lower bounds. We propose new bounds and tractable approximations, leading to improved prediction accuracy and scalability to large datasets, while explicitly taking uncertainty into account. We develop a framework which extends to several types of likelihoods, including the Poisson model for aggregated count data. We apply our framework to a challenging and important problem, the fine-scale spatial modelling of malaria incidence, with over 1 million observations.
△ Less
Submitted 22 May, 2018;
originally announced May 2018.
-
A Universal Marginalizer for Amortized Inference in Generative Models
Authors:
Laura Douglas,
Iliyan Zarov,
Konstantinos Gourgoulias,
Chris Lucas,
Chris Hart,
Adam Baker,
Maneesh Sahani,
Yura Perov,
Saurabh Johri
Abstract:
We consider the problem of inference in a causal generative model where the set of available observations differs between data instances. We show how combining samples drawn from the graphical model with an appropriate masking function makes it possible to train a single neural network to approximate all the corresponding conditional marginal distributions and thus amortize the cost of inference.…
▽ More
We consider the problem of inference in a causal generative model where the set of available observations differs between data instances. We show how combining samples drawn from the graphical model with an appropriate masking function makes it possible to train a single neural network to approximate all the corresponding conditional marginal distributions and thus amortize the cost of inference. We further demonstrate that the efficiency of importance sampling may be improved by basing proposals on the output of the neural network. We also outline how the same network can be used to generate samples from an approximate joint posterior via a chain decomposition of the graph.
△ Less
Submitted 2 November, 2017;
originally announced November 2017.
-
Internal Diffusion-Limited aggregation with uniform starting points
Authors:
Itai Benjamini,
Hugo Duminil-Copin,
Gady Kozma,
Cyrille Lucas
Abstract:
We study internal diffusion-limited aggregation with random starting points on Z^d. In this model, each new particle starts from a vertex chosen uniformly at random on the existing aggregate. We prove that the limiting shape of the aggregate is a Euclidean ball.
We study internal diffusion-limited aggregation with random starting points on Z^d. In this model, each new particle starts from a vertex chosen uniformly at random on the existing aggregate. We prove that the limiting shape of the aggregate is a Euclidean ball.
△ Less
Submitted 6 October, 2021; v1 submitted 11 July, 2017;
originally announced July 2017.
-
Emergence of long-range order in BaTiO3 from local symmetry-breaking distortions
Authors:
M. S. Senn,
D. A. Keen,
T. C. A. Lucas,
J. A. Hriljac,
A. L. Goodwin
Abstract:
By using a symmetry motivated basis to evaluate local distortions against pair distribution function data (PDF), we show without prior bias, that the off-centre Ti displacements in the archetypal ferroelectric BaTiO3 are zone centred and rhombohedral-like in nature across its known ferroelectric and paraelectric phases. With our newly-gained insight we construct a simple Monte Carlo (MC) model whi…
▽ More
By using a symmetry motivated basis to evaluate local distortions against pair distribution function data (PDF), we show without prior bias, that the off-centre Ti displacements in the archetypal ferroelectric BaTiO3 are zone centred and rhombohedral-like in nature across its known ferroelectric and paraelectric phases. With our newly-gained insight we construct a simple Monte Carlo (MC) model which captures our main experimental findings and demonstrate how the rich crystallographic phase diagram of BaTiO3 emerges from correlations of local symmetry-breaking distortions alone. Our results strongly support the order-disorder picture for these phase transitions, but can also be reconciled with the soft-mode theory of BaTiO3 that is supported by some spectroscopic techniques.
△ Less
Submitted 11 December, 2015;
originally announced December 2015.
-
The Human Kernel
Authors:
Andrew Gordon Wilson,
Christoph Dann,
Christopher G. Lucas,
Eric P. Xing
Abstract:
Bayesian nonparametric models, such as Gaussian processes, provide a compelling framework for automatic statistical modelling: these models have a high degree of flexibility, and automatically calibrated complexity. However, automating human expertise remains elusive; for example, Gaussian processes with standard kernels struggle on function extrapolation problems that are trivial for human learne…
▽ More
Bayesian nonparametric models, such as Gaussian processes, provide a compelling framework for automatic statistical modelling: these models have a high degree of flexibility, and automatically calibrated complexity. However, automating human expertise remains elusive; for example, Gaussian processes with standard kernels struggle on function extrapolation problems that are trivial for human learners. In this paper, we create function extrapolation problems and acquire human responses, and then design a kernel learning framework to reverse engineer the inductive biases of human learners across a set of behavioral experiments. We use the learned kernels to gain psychological insights and to extrapolate in human-like ways that go beyond traditional stationary and polynomial kernels. Finally, we investigate Occam's razor in human and Gaussian process based function learning.
△ Less
Submitted 3 December, 2015; v1 submitted 26 October, 2015;
originally announced October 2015.
-
Competing Hydrostatic Compression Mechanisms in Nickel Cyanide
Authors:
Jasper Adamson,
Timothy C. Lucas,
Andrew B. Cairns,
Nicholas P. Funnell,
Matthew G. Tucker,
Annette K. Kleppe,
Joseph A. Hriljac,
Andrew L. Goodwin
Abstract:
We use variable-pressure neutron and X-ray diffraction measurements to determine the uniaxial and bulk compressibilities of nickel(II) cyanide, Ni(CN)$_2$. Whereas other layered molecular framework materials are known to exhibit negative area compressibility, we find that Ni(CN)$_2$ does not. We attribute this difference to the existence of low-energy in-plane tilt modes that provide a pressure-ac…
▽ More
We use variable-pressure neutron and X-ray diffraction measurements to determine the uniaxial and bulk compressibilities of nickel(II) cyanide, Ni(CN)$_2$. Whereas other layered molecular framework materials are known to exhibit negative area compressibility, we find that Ni(CN)$_2$ does not. We attribute this difference to the existence of low-energy in-plane tilt modes that provide a pressure-activated mechanism for layer contraction. The experimental bulk modulus we measure is about four times lower than that reported elsewhere on the basis of density functional theory methods [{\it Phys. Rev. B} {\bf 83}, 024301 (2011)].
△ Less
Submitted 9 July, 2015;
originally announced July 2015.
-
Observation of the rare $B^0_s\toμ^+μ^-$ decay from the combined analysis of CMS and LHCb data
Authors:
The CMS,
LHCb Collaborations,
:,
V. Khachatryan,
A. M. Sirunyan,
A. Tumasyan,
W. Adam,
T. Bergauer,
M. Dragicevic,
J. Erö,
M. Friedl,
R. Frühwirth,
V. M. Ghete,
C. Hartl,
N. Hörmann,
J. Hrubec,
M. Jeitler,
W. Kiesenhofer,
V. Knünz,
M. Krammer,
I. Krätschmer,
D. Liko,
I. Mikulec,
D. Rabady,
B. Rahbaran
, et al. (2807 additional authors not shown)
Abstract:
A joint measurement is presented of the branching fractions $B^0_s\toμ^+μ^-$ and $B^0\toμ^+μ^-$ in proton-proton collisions at the LHC by the CMS and LHCb experiments. The data samples were collected in 2011 at a centre-of-mass energy of 7 TeV, and in 2012 at 8 TeV. The combined analysis produces the first observation of the $B^0_s\toμ^+μ^-$ decay, with a statistical significance exceeding six sta…
▽ More
A joint measurement is presented of the branching fractions $B^0_s\toμ^+μ^-$ and $B^0\toμ^+μ^-$ in proton-proton collisions at the LHC by the CMS and LHCb experiments. The data samples were collected in 2011 at a centre-of-mass energy of 7 TeV, and in 2012 at 8 TeV. The combined analysis produces the first observation of the $B^0_s\toμ^+μ^-$ decay, with a statistical significance exceeding six standard deviations, and the best measurement of its branching fraction so far. Furthermore, evidence for the $B^0\toμ^+μ^-$ decay is obtained with a statistical significance of three standard deviations. The branching fraction measurements are statistically compatible with SM predictions and impose stringent constraints on several theories beyond the SM.
△ Less
Submitted 17 August, 2015; v1 submitted 17 November, 2014;
originally announced November 2014.
-
Inclusive searches for SUSY at CMS
Authors:
Chris Lucas
Abstract:
Multiple searches for supersymmetry have been performed at the CMS experiment. Of these, inclusive searches aim to remain as sensitive as possible to the widest range of potential new physics scenarios. The results presented in this talk use the latest 19.5 fb$^{-1}$ of 8 TeV data from the 2012 LHC run. Interpretations are given within the context of Simplified Model Spectra for a variety of both…
▽ More
Multiple searches for supersymmetry have been performed at the CMS experiment. Of these, inclusive searches aim to remain as sensitive as possible to the widest range of potential new physics scenarios. The results presented in this talk use the latest 19.5 fb$^{-1}$ of 8 TeV data from the 2012 LHC run. Interpretations are given within the context of Simplified Model Spectra for a variety of both hadronic and leptonic signatures.
△ Less
Submitted 12 September, 2014;
originally announced September 2014.
-
FullSWOF: A free software package for the simulation of shallow water flows
Authors:
Olivier Delestre,
Frédéric Darboux,
Francois James,
Carine Lucas,
Christian Laguerre,
Stephane Cordier
Abstract:
Numerical simulations of flows are required for numerous applications, and are usually carried out using shallow water equations. We describe the FullSWOF software which is based on up-to-date finite volume methods and well-balanced schemes to solve this kind of equations. It consists of a set of open source C++ codes, freely available to the community, easy to use, and open for further developmen…
▽ More
Numerical simulations of flows are required for numerous applications, and are usually carried out using shallow water equations. We describe the FullSWOF software which is based on up-to-date finite volume methods and well-balanced schemes to solve this kind of equations. It consists of a set of open source C++ codes, freely available to the community, easy to use, and open for further development. Several features make FullSWOF particularly suitable for applications in hydrology: small water heights and wet-dry transitions are robustly handled, rainfall and infiltration are incorporated, and data from grid-based digital topographies can be used directly. A detailed mathematical description is given here, and the capabilities of FullSWOF are illustrated based on analytic solutions and datasets of real cases. The codes, available in 1D and 2D versions, have been validated on a large set of benchmark cases, which are available together with the download information and documentation at http://www.univ-orleans.fr/mapmo/soft/FullSWOF/.
△ Less
Submitted 27 May, 2015; v1 submitted 16 January, 2014;
originally announced January 2014.
-
A generalized Pólya's Urn with graph based interactions: convergence at linearity
Authors:
Jun Chen,
Cyrille Lucas
Abstract:
We consider a special case of the generalized Pólya's urn model introduced by Benaim et al (2013). Given a finite connected graph $G$, place a bin at each vertex. Two bins are called a pair if they share an edge of $G$. At discrete times, a ball is added to each pair of bins. In a pair of bins, one of the bins gets the ball with probability proportional to its current number of balls. A question o…
▽ More
We consider a special case of the generalized Pólya's urn model introduced by Benaim et al (2013). Given a finite connected graph $G$, place a bin at each vertex. Two bins are called a pair if they share an edge of $G$. At discrete times, a ball is added to each pair of bins. In a pair of bins, one of the bins gets the ball with probability proportional to its current number of balls. A question of essential interest for the model is to understand the limiting behavior of the proportion of balls in the bins for different graphs $G$. In this paper, we present two results regarding this question. If $G$ is not balanced-bipartite, we prove that the proportion of balls converges to some deterministic point $v=v(G)$ almost surely. If $G$ is regular bipartite, we prove that the proportion of balls converges to a point in some explicit interval almost surely. The question of convergence remains open in the case when $G$ is non-regular balanced-bipartite (see a final remark in the paper).
△ Less
Submitted 3 October, 2014; v1 submitted 23 June, 2013;
originally announced June 2013.
-
A simple method for decision making in robocup soccer simulation 3d environment
Authors:
Khashayar Niki Maleki,
Mohammad Hadi Valipour,
Sadegh Mokari,
Roohollah Yeylaghi Ashrafi,
Mohammad Reza Jamali,
Caro Lucas
Abstract:
In this paper new hierarchical hybrid fuzzy-crisp methods for decision making and action selection of an agent in soccer simulation 3D environment are presented. First, the skills of an agent are introduced, implemented and classified in two layers, the basicskills and the highlevel skills. In the second layer, a twophase mechanism for decision making is introduced. In phase one, some useful metho…
▽ More
In this paper new hierarchical hybrid fuzzy-crisp methods for decision making and action selection of an agent in soccer simulation 3D environment are presented. First, the skills of an agent are introduced, implemented and classified in two layers, the basicskills and the highlevel skills. In the second layer, a twophase mechanism for decision making is introduced. In phase one, some useful methods are implemented which check the agent's situation for performing required skills. In the next phase, the team str ategy, team for mation, agent's role and the agent's positioning system are introduced. A fuzzy logical approach is employed to recognize the team strategy and further more to tell the player the best position to move. At last, we comprised our implemented algor ithm in the Robocup Soccer Simulation 3D environment and results showed th eefficiency of the introduced methodology.
△ Less
Submitted 7 December, 2012;
originally announced December 2012.
-
SWASHES: A library for benchmarking in hydraulics / SWASHES : une bibliothèque de bancs d'essai en hydraulique
Authors:
Olivier Delestre,
Carine Lucas,
Pierre-Antoine Ksinant,
Frédéric Darboux,
Christian Laguerre,
Francois James,
Stéphane Cordier
Abstract:
Numerous codes are being developed to solve Shallow Water equations. Because they are used in hydraulics and environmental studies, their capability to simulate properly flow dynamics is essential to guarantee infrastructure and human safety. Hence, validating these codes and the associated numerical methods is an important issue. Analytic solutions would be excellent benchmarks for these issues.…
▽ More
Numerous codes are being developed to solve Shallow Water equations. Because they are used in hydraulics and environmental studies, their capability to simulate properly flow dynamics is essential to guarantee infrastructure and human safety. Hence, validating these codes and the associated numerical methods is an important issue. Analytic solutions would be excellent benchmarks for these issues. However, analytic solutions to Shallow Water equations are rare. Moreover, they have been published on an individual basis over a period of more than five decades, making them scattered through the literature. In this paper, a significant number of analytic solutions to the Shallow Water equations is described in a unified formalism. They encompass a wide variety of flow conditions (supercritical, subcritical, shock ...), in 1 or 2 space dimensions, with or without rain and soil friction, for transitory flow or steady state. An original feature is that the corresponding source codes are made freely available to the community (http://www.univ-orleans.fr/mapmo/soft/SWASHES), so that users of Shallow Water based models can easily find an adaptable benchmark library to validate their numerical methods.
△ Less
Submitted 27 September, 2012; v1 submitted 5 May, 2012;
originally announced May 2012.
-
FullSWOF: A software for overland flow simulation / FullSWOF : un logiciel pour la simulation du ruissellement
Authors:
Olivier Delestre,
Stéphane Cordier,
Frédéric Darboux,
Mingxuan Du,
Francois James,
Christian Laguerre,
Carine Lucas,
Olivier Planchon
Abstract:
Overland flow on agricultural fields may have some undesirable effects such as soil erosion, flood and pollutant transport. To better understand this phenomenon and limit its consequences, we developed a code using state-of-the-art numerical methods: FullSWOF (Full Shallow Water equations for Overland Flow), an object oriented code written in C++. It has been made open-source and can be downloaded…
▽ More
Overland flow on agricultural fields may have some undesirable effects such as soil erosion, flood and pollutant transport. To better understand this phenomenon and limit its consequences, we developed a code using state-of-the-art numerical methods: FullSWOF (Full Shallow Water equations for Overland Flow), an object oriented code written in C++. It has been made open-source and can be downloaded from http://www.univ-orleans.fr/mapmo/soft/FullSWOF/. The model is based on the classical system of Shallow Water (SW) (or Saint-Venant system). Numerical difficulties come from the numerous dry/wet transitions and the highly-variable topography encountered inside a field. It includes runon and rainfall inputs, infiltration (modified Green-Ampt equation), friction (Darcy-Weisbach and Manning formulas). First we present the numerical method for the resolution of the Shallow Water equations integrated in FullSWOF_2D (the two-dimension version). This method is based on hydrostatic reconstruction scheme, coupled with a semi-implicit friction term treatment. FullSWOF_2D has been previously validated using analytical solutions from the SWASHES library (Shallow Water Analytic Solutions for Hydraulic and Environmental Studies). Finally, FullSWOF_2D is run on a real topography measured on a runoff plot located in Thies (Senegal). Simulation results are compared with measured data. This experimental benchmark demonstrate the capabilities of FullSWOF to simulate adequately overland flow. FullSWOF could also be used for other environmental issues, such as river floods and dam-breaks.
△ Less
Submitted 27 September, 2012; v1 submitted 14 April, 2012;
originally announced April 2012.
-
The Limiting Shape for Drifted Internal Diffusion Limited Aggregation is a True Heat Ball
Authors:
Cyrille Lucas
Abstract:
We build the iDLA cluster using drifted random walks, and study the limiting shapes they exhibit, with the help of sandpile models. For constant drift, the normalised cluster converges to a canonical shape S, which can be termed a true heat ball, in that it gives rise to a mean value property for caloric functions. The existence and boundedness of such a shape answers a natural yet open question i…
▽ More
We build the iDLA cluster using drifted random walks, and study the limiting shapes they exhibit, with the help of sandpile models. For constant drift, the normalised cluster converges to a canonical shape S, which can be termed a true heat ball, in that it gives rise to a mean value property for caloric functions. The existence and boundedness of such a shape answers a natural yet open question in PDE theory.
△ Less
Submitted 17 February, 2013; v1 submitted 9 February, 2012;
originally announced February 2012.
-
Containing Internal Diffusion Limited Aggregation
Authors:
Hugo Duminil-Copin,
Cyrille Lucas,
Ariel Yadin,
Amir Yehudayoff
Abstract:
Internal Diffusion Limited Aggregation (IDLA) is a model that describes the growth of a random aggregate of particles from the inside out. Shellef proved that IDLA processes on supercritical percolation clusters of integer-lattices fill Euclidean balls, with high probability. In this article, we complete the picture and prove a limit-shape theorem for IDLA on such percolation clusters, by providin…
▽ More
Internal Diffusion Limited Aggregation (IDLA) is a model that describes the growth of a random aggregate of particles from the inside out. Shellef proved that IDLA processes on supercritical percolation clusters of integer-lattices fill Euclidean balls, with high probability. In this article, we complete the picture and prove a limit-shape theorem for IDLA on such percolation clusters, by providing the corresponding upper bound.
The technique to prove upper bounds is new and robust: it only requires the existence of a "good" lower bound. Specifically, this way of proving upper bounds on IDLA clusters is more suitable for random environments than previous ways, since it does not harness harmonic measure estimates.
△ Less
Submitted 2 November, 2011;
originally announced November 2011.