-
Impact of Social Relationships on Peer Assessment in E-Learning
Authors:
Francisco Sousa,
Tomás Alves,
Sandra Gama,
Joaquim Jorge,
Daniel Gonçalves
Abstract:
Peer assessment has been widely studied as a replacement for traditional evaluation, not only by reducing the professors' workload but mainly by benefiting students' engagement and learning. Although several works successfully validate its accuracy and fairness, more research must be done on how students' pre-existing social relationships affect the grades they give their peers in an e-learning co…
▽ More
Peer assessment has been widely studied as a replacement for traditional evaluation, not only by reducing the professors' workload but mainly by benefiting students' engagement and learning. Although several works successfully validate its accuracy and fairness, more research must be done on how students' pre-existing social relationships affect the grades they give their peers in an e-learning course. We developed a Moodle plugin to provide the platform with peer assessment capabilities in forums and used it on an MSc course. The plugin curated the reviewer set for a post based on the author's relationships and included rubrics to counter the possible interpersonal effects of peer assessment. Results confirm that peer assessment is reliable and accurate for works with at least three peer assessments, although students' grades are slightly higher. The impact of social relationships is noticeable when students who do not like another peer grade their work consistently lower than students who have a positive connection. However, this has little influence on the final aggregate peer grade. Our findings show that peer assessment can replace traditional evaluation in an e-learning environment where students are familiar with each other.
△ Less
Submitted 1 July, 2024;
originally announced July 2024.
-
Expanding the Katz Index for Link Prediction: A Case Study on a Live Fish Movement Network
Authors:
Michael-Sam Vidza,
Marcin Budka,
Wei Koong Chai,
Mark Thrush,
Mickael Teixeira Alves
Abstract:
In aquaculture, disease spread models often neglect the dynamic interactions between farms, hindering accuracy. This study enhances the Katz index (KI) to incorporate spatial and temporal patterns of fish movement, improving the prediction of farms susceptible to disease via live fish transfers. We modified the Katz index to create models like the Weighted Katz Index (WKI), Edge Weighted Katz Inde…
▽ More
In aquaculture, disease spread models often neglect the dynamic interactions between farms, hindering accuracy. This study enhances the Katz index (KI) to incorporate spatial and temporal patterns of fish movement, improving the prediction of farms susceptible to disease via live fish transfers. We modified the Katz index to create models like the Weighted Katz Index (WKI), Edge Weighted Katz Index (EWKI), and combined models (e.g., KIEWKI). These incorporate spatial distances and temporal movement patterns for a comprehensive aquaculture network connection prediction framework. Model performance was evaluated using precision, recall, F1-scores, AUPR, and AUROC. The EWKI model significantly outperformed the traditional KI and other variations. It achieved high precision (0.988), recall (0.712), F1-score (0.827), and AUPR (0.970). Combined models (KIEWKI, WKIEWKI) approached, but couldn't surpass, EWKI performance. This study highlights the value of extending Katz index models to improve disease spread predictions in aquaculture networks. The EWKI model's performance demonstrates an innovative and flexible approach to tackling spatial challenges within network analysis.
△ Less
Submitted 19 April, 2024;
originally announced April 2024.
-
Pose-free object classification from surface contact features in sequences of Robotic grasps
Authors:
Teresa Alves,
Alexandre Bernardino,
Plinio Moreno
Abstract:
In this work, we propose two cost efficient methods for object identification, using a multi-fingered robotic hand equipped with proprioceptive sensing. Both methods are trained on known objects and rely on a limited set of features, obtained during a few grasps on an object. Contrary to most methods in the literature, our methods do not rely on the knowledge of the relative pose between object an…
▽ More
In this work, we propose two cost efficient methods for object identification, using a multi-fingered robotic hand equipped with proprioceptive sensing. Both methods are trained on known objects and rely on a limited set of features, obtained during a few grasps on an object. Contrary to most methods in the literature, our methods do not rely on the knowledge of the relative pose between object and hand, which greatly expands the domain of application. However, if that knowledge is available, we propose an additional active exploration step that reduces the overall number of grasps required for a good recognition of the object. One of the methods depends on the contact positions and normals and the other depends on the contact positions alone. We test the proposed methods in the GraspIt! simulator and show that haptic-based object classification is possible in pose-free conditions. We evaluate the parameters that produce the most accurate results and require the least number of grasps for classification.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Improving Random Access with NOMA in mMTC XL-MIMO
Authors:
Thiago Augusto Bruza Alves,
Taufik Abrao
Abstract:
The extra-large multiple-input multiple-output (XL-MIMO) architecture has been recognized as a technology for supporting the massive MTC (mMTC), providing very high-data rates in high-user density scenarios. However, the large dimension of the array increases the Rayleigh distance (dRayl), in addition to obstacles and scatters causing spatial non-stationarities and distinct visibility regions (VRs…
▽ More
The extra-large multiple-input multiple-output (XL-MIMO) architecture has been recognized as a technology for supporting the massive MTC (mMTC), providing very high-data rates in high-user density scenarios. However, the large dimension of the array increases the Rayleigh distance (dRayl), in addition to obstacles and scatters causing spatial non-stationarities and distinct visibility regions (VRs) across the XL array extension. We investigate the random access (RA) problem in crowded XL-MIMO scenarios; the proposed grant-based random access (GB-RA) protocol combining the advantage of non-orthogonal multiple access (NOMA) and strongest user collision resolutions in extra-large arrays (SUCRe-XL) named NOMA-XL can allow access of two or three colliding users in the same XL sub-array (SA) selecting the same pilot sequence. The received signal processing in a SA basis changes the dRayl, enabling the far-field planar wavefront propagation condition, while improving the system performance. The proposed NOMA-XL GB-RA protocol can reduce the number of attempts to access the mMTC network while improving the average sum rate, as the number of SA increases.
△ Less
Submitted 7 April, 2023;
originally announced April 2023.
-
EZClone: Improving DNN Model Extraction Attack via Shape Distillation from GPU Execution Profiles
Authors:
Jonah O'Brien Weiss,
Tiago Alves,
Sandip Kundu
Abstract:
Deep Neural Networks (DNNs) have become ubiquitous due to their performance on prediction and classification problems. However, they face a variety of threats as their usage spreads. Model extraction attacks, which steal DNNs, endanger intellectual property, data privacy, and security. Previous research has shown that system-level side-channels can be used to leak the architecture of a victim DNN,…
▽ More
Deep Neural Networks (DNNs) have become ubiquitous due to their performance on prediction and classification problems. However, they face a variety of threats as their usage spreads. Model extraction attacks, which steal DNNs, endanger intellectual property, data privacy, and security. Previous research has shown that system-level side-channels can be used to leak the architecture of a victim DNN, exacerbating these risks. We propose two DNN architecture extraction techniques catering to various threat models. The first technique uses a malicious, dynamically linked version of PyTorch to expose a victim DNN architecture through the PyTorch profiler. The second, called EZClone, exploits aggregate (rather than time-series) GPU profiles as a side-channel to predict DNN architecture, employing a simple approach and assuming little adversary capability as compared to previous work. We investigate the effectiveness of EZClone when minimizing the complexity of the attack, when applied to pruned models, and when applied across GPUs. We find that EZClone correctly predicts DNN architectures for the entire set of PyTorch vision architectures with 100% accuracy. No other work has shown this degree of architecture prediction accuracy with the same adversarial constraints or using aggregate side-channel information. Prior work has shown that, once a DNN has been successfully cloned, further attacks such as model evasion or model inversion can be accelerated significantly.
△ Less
Submitted 6 April, 2023;
originally announced April 2023.
-
Massive MIMO and NOMA Bits-per-Antenna Efficiency under Power Allocation Policies
Authors:
Thiago Alves Bruza Alves,
Taufik Abrão
Abstract:
A comparative resource allocation analysis in terms of received bits-per-antenna spectral efficiency (SE) and energy efficiency (EE) in downlink (DL) single-cell massive multiple-input multiple-output (mMIMO) and non-orthogonal multiple access (NOMA) systems considering a BS equipped with many ($M$) antennas, while $K$ devices {operate} with a single-antenna, and {the loading of devices}…
▽ More
A comparative resource allocation analysis in terms of received bits-per-antenna spectral efficiency (SE) and energy efficiency (EE) in downlink (DL) single-cell massive multiple-input multiple-output (mMIMO) and non-orthogonal multiple access (NOMA) systems considering a BS equipped with many ($M$) antennas, while $K$ devices {operate} with a single-antenna, and {the loading of devices} $ρ= \frac{K}{M}$ ranging in $0<ρ\leq 2$ is carried out under three different \ac{PA} strategies: the inverse of the channel power allocation (PICPA), a modified water-filling ($Δ$-WF) allocation method, and the equal power allocation (EPA) reference method. Since the two devices per cluster are overlapped in the power domain in the NOMA system, the channel matrix requires transformation to perform the zero-forcing (ZF) precoding adopted in mMIMO. Hence, NOMA operating under many antennas can favor a group of devices with higher array gain, overcoming the mMIMO and operating conveniently in the higher loading range $0.6<ρ<2.0$. In such a scenario, a more realistic and helpful metric consists of {evaluating} the area under SE and EE curves, by measuring the bit-per-antenna and bit-per-antenna-per-watt efficiency, respectively. Our numerical results confirm a superiority of NOMA w.r.t. mMIMO of an order of 3x for the SE-area and 2x for the EE-area metric.
△ Less
Submitted 8 January, 2023;
originally announced January 2023.
-
Hardening DNNs against Transfer Attacks during Network Compression using Greedy Adversarial Pruning
Authors:
Jonah O'Brien Weiss,
Tiago Alves,
Sandip Kundu
Abstract:
The prevalence and success of Deep Neural Network (DNN) applications in recent years have motivated research on DNN compression, such as pruning and quantization. These techniques accelerate model inference, reduce power consumption, and reduce the size and complexity of the hardware necessary to run DNNs, all with little to no loss in accuracy. However, since DNNs are vulnerable to adversarial in…
▽ More
The prevalence and success of Deep Neural Network (DNN) applications in recent years have motivated research on DNN compression, such as pruning and quantization. These techniques accelerate model inference, reduce power consumption, and reduce the size and complexity of the hardware necessary to run DNNs, all with little to no loss in accuracy. However, since DNNs are vulnerable to adversarial inputs, it is important to consider the relationship between compression and adversarial robustness. In this work, we investigate the adversarial robustness of models produced by several irregular pruning schemes and by 8-bit quantization. Additionally, while conventional pruning removes the least important parameters in a DNN, we investigate the effect of an unconventional pruning method: removing the most important model parameters based on the gradient on adversarial inputs. We call this method Greedy Adversarial Pruning (GAP) and we find that this pruning method results in models that are resistant to transfer attacks from their uncompressed counterparts.
△ Less
Submitted 15 June, 2022;
originally announced June 2022.
-
Exploring How Personality Models Information Visualization Preferences
Authors:
Tomás Alves,
Bárbara Ramalho,
Joana Henriques-Calado,
Daniel Gonçalves,
Sandra Gama
Abstract:
Recent research on information visualization has shown how individual differences act as a mediator on how users interact with visualization systems. We focus our exploratory study on whether personality has an effect on user preferences regarding idioms used for hierarchy, evolution over time, and comparison contexts. Specifically, we leverage all personality variables from the Five-Factor Model…
▽ More
Recent research on information visualization has shown how individual differences act as a mediator on how users interact with visualization systems. We focus our exploratory study on whether personality has an effect on user preferences regarding idioms used for hierarchy, evolution over time, and comparison contexts. Specifically, we leverage all personality variables from the Five-Factor Model and the three dimensions from Locus of Control (LoC) with correlation and clustering approaches. The correlation-based method suggested that Neuroticism, Openness to Experience, Agreeableness, several facets from each trait, and the External dimensions from LoC mediate how much individuals prefer certain idioms. In addition, our results from the cluster-based analysis showed that Neuroticism, Extraversion, Conscientiousness, and all dimensions from LoC have an effect on preferences for idioms in hierarchy and evolution contexts. Our results support the incorporation of in-depth personality synergies with InfoVis into the design pipeline of visualization systems.
△ Less
Submitted 7 September, 2020; v1 submitted 30 August, 2020;
originally announced August 2020.
-
The Influence of Reward on the Social Valence of Interactions
Authors:
Tomás Alves,
Samuel Gomes,
João Dias,
Carlos Martinho
Abstract:
Throughout the years, social norms have been promoted as an informal enforcement mechanism for achieving beneficial collective outcomes. Among the most used methods to foster interactions, framing the context of a situation or setting in-game rules have shown strong results as mediators on how an individual interacts with their peers. Nevertheless, we found that there is a lack of research regardi…
▽ More
Throughout the years, social norms have been promoted as an informal enforcement mechanism for achieving beneficial collective outcomes. Among the most used methods to foster interactions, framing the context of a situation or setting in-game rules have shown strong results as mediators on how an individual interacts with their peers. Nevertheless, we found that there is a lack of research regarding the use of incentives such as scores to promote social interactions differing in valence. Weighing how incentives influence in-game behavior, we propose the use of rewards to promote interactions varying in valence, i.e. positive or negative, in a two-player scenario. To do so, we defined social valence as a continuous scale with two poles represented by Complicate and Help. Then, we performed user tests where participants where asked to play a game with two reward-based systems to test on whether the scoring system influenced the social interaction valence. The results indicate that the developed reward-based systems were able to foster interactions diverging in social valence scores, providing insights on how factors such as incentives overlap individual's established social norms. These findings empower game developers and designers with a low-cost and effective policy tool that is able to promote in-game behavior changes.
△ Less
Submitted 31 March, 2020; v1 submitted 27 March, 2020;
originally announced March 2020.
-
Reward-Mediated Individual and Altruistic Behavior
Authors:
Samuel Gomes,
Tomás Alves,
João Dias,
Carlos Martinho
Abstract:
Recent research has taken particular interest in observing the dynamics between altruistic and individual behavior. This is a commonly approached problem when reasoning about social dilemmas, which have a plethora of real world counterparts in the fields of education, health and economics. Weighing how incentives influence in-game behavior, our study examines individual and altruistic interactions…
▽ More
Recent research has taken particular interest in observing the dynamics between altruistic and individual behavior. This is a commonly approached problem when reasoning about social dilemmas, which have a plethora of real world counterparts in the fields of education, health and economics. Weighing how incentives influence in-game behavior, our study examines individual and altruistic interactions, by analyzing the players' strategies and interaction motives when facing different reward attribution strategies. Consequently, a model for interaction motives is also proposed, with the premise that the motives for interactions can be defined as a continuous space, ranging from self-oriented (associated to self-improvement behaviors) to others-oriented (associated to extreme altruism behaviors) motives. To evaluate the promotion of individual and altruistic behavior, we leverage Message Across, an in-loco two-player videogame with adaptable reward attribution systems. We conducted several user tests (N = 66) to verify to what extent individual and altruistic reward attribution systems led players to vary their strategies and motives orientation. Our results indicate that players' strategies and self-reported orientation of interaction motives varied highly significantly upon the deployment of individual and altruistic reward systems, which leads us to believe on the suitability of applying an incentive-based strategy to moderate the emergence of individual and altruistic behavior in games.
△ Less
Submitted 31 March, 2020; v1 submitted 21 March, 2020;
originally announced March 2020.
-
Dynamic Prediction of ICU Mortality Risk Using Domain Adaptation
Authors:
Tiago Alves,
Alberto Laender,
Adriano Veloso,
Nivio Ziviani
Abstract:
Early recognition of risky trajectories during an Intensive Care Unit (ICU) stay is one of the key steps towards improving patient survival. Learning trajectories from physiological signals continuously measured during an ICU stay requires learning time-series features that are robust and discriminative across diverse patient populations. Patients within different ICU populations (referred here as…
▽ More
Early recognition of risky trajectories during an Intensive Care Unit (ICU) stay is one of the key steps towards improving patient survival. Learning trajectories from physiological signals continuously measured during an ICU stay requires learning time-series features that are robust and discriminative across diverse patient populations. Patients within different ICU populations (referred here as domains) vary by age, conditions and interventions. Thus, mortality prediction models using patient data from a particular ICU population may perform suboptimally in other populations because the features used to train such models have different distributions across the groups. In this paper, we explore domain adaptation strategies in order to learn mortality prediction models that extract and transfer complex temporal features from multivariate time-series ICU data. Features are extracted in a way that the state of the patient in a certain time depends on the previous state. This enables dynamic predictions and creates a mortality risk space that describes the risk of a patient at a particular time. Experiments based on cross-ICU populations reveals that our model outperforms all considered baselines. Gains in terms of AUC range from 4% to 8% for early predictions when compared with a recent state-of-the-art representative for ICU mortality prediction. In particular, models for the Cardiac ICU population achieve AUC numbers as high as 0.88, showing excellent clinical utility for early mortality prediction. Finally, we present an explanation of factors contributing to the possible ICU outcomes, so that our models can be used to complement clinical reasoning.
△ Less
Submitted 20 December, 2019;
originally announced December 2019.
-
Exploring the Equivalence between Dynamic Dataflow Model and Gamma - General Abstract Model for Multiset mAnipulation
Authors:
Rui R. Mello Junior,
Leandro S. Araujo,
Tiago A. O. Alves,
Leandro A. J. Marzulo,
Gabriel A. L. Paillard,
Felipe M. G. França
Abstract:
With the increase of the search for computational models where the expression of parallelism occurs naturally, some paradigms arise as options for the next generation of computers. In this context, dynamic Dataflow and Gamma - General Abstract Model for Multiset mAnipulation) - emerge as interesting computational models choices. In the dynamic Dataflow model, operations are performed as soon as th…
▽ More
With the increase of the search for computational models where the expression of parallelism occurs naturally, some paradigms arise as options for the next generation of computers. In this context, dynamic Dataflow and Gamma - General Abstract Model for Multiset mAnipulation) - emerge as interesting computational models choices. In the dynamic Dataflow model, operations are performed as soon as their associated operators are available, without rely on a Program Counter to dictate the execution order of instructions. The Gamma paradigm is based on a parallel multiset rewriting scheme. It provides a non-deterministic execution model inspired by an abstract chemical machine metaphor, where operations are formulated as reactions that occur freely among matching elements belonging to the multiset. In this work, equivalence relations between the dynamic Dataflow and Gamma paradigms are exposed and explored, while methods to convert from Dataflow to Gamma paradigm and vice versa are provided. It is shown that vertices and edges of a dynamic Dataflow graph can correspond, respectively, to reactions and multiset elements in the Gamma paradigm. Implementation aspects of execution environments that could be mutually beneficial to both models are also discussed. This work provides the scientific community with the possibility of taking profit of both parallel programming models, contributing with a versatility component to researchers and developers. Finally, it is important to state that, to the best of our knowledge, the similarity relations between both dynamic Dataflow and Gamma models presented here have not been reported in any previous work.
△ Less
Submitted 1 November, 2018;
originally announced November 2018.
-
Couillard: Parallel Programming via Coarse-Grained Data-Flow Compilation
Authors:
Leandro A. J. Marzulo,
Tiago A. O. Alves,
Felipe M. G. França,
Vítor Santos Costa
Abstract:
Data-flow is a natural approach to parallelism. However, describing dependencies and control between fine-grained data-flow tasks can be complex and present unwanted overheads. TALM (TALM is an Architecture and Language for Multi-threading) introduces a user-defined coarse-grained parallel data-flow model, where programmers identify code blocks, called super-instructions, to be run in parallel and…
▽ More
Data-flow is a natural approach to parallelism. However, describing dependencies and control between fine-grained data-flow tasks can be complex and present unwanted overheads. TALM (TALM is an Architecture and Language for Multi-threading) introduces a user-defined coarse-grained parallel data-flow model, where programmers identify code blocks, called super-instructions, to be run in parallel and connect them in a data-flow graph. TALM has been implemented as a hybrid Von Neumann/data-flow execution system: the \emph{Trebuchet}. We have observed that TALM's usefulness largely depends on how programmers specify and connect super-instructions. Thus, we present \emph{Couillard}, a full compiler that creates, based on an annotated C-program, a data-flow graph and C-code corresponding to each super-instruction. We show that our toolchain allows one to benefit from data-flow execution and explore sophisticated parallel programming techniques, with small effort. To evaluate our system we have executed a set of real applications on a large multi-core machine. Comparison with popular parallel programming methods shows competitive speedups, while providing an easier parallel programing approach.
△ Less
Submitted 22 September, 2011;
originally announced September 2011.