Research Statement PDF
Research Statement PDF
Lamiaa Basyoni
H (+974) 7744 6604 • B [email protected] 1/2
and an average-rate-based proportionally fair heuristic (AR-PF). We also compare the proposed
approaches with basic heuristics and with the implemented scheduler in Tor. We show that our
reinforcement-learning-based approach (TRLS) achieved the highest QoS-aware fairness level with
a resilient performance to the changes in an environment with a dynamic nature such as the Tor
network.
Research Goals
While working on my Ph.D. research, we faced the challenge of a dynamic environment in which we
can not observe the entire state. With technologies like reinforcement learning, a non-stationary
environment with imperfect information poses a challenge, especially for multi-agent algorithms.
Multi-agent reinforcement learning (MARL) algorithms have attracted researchers’ interest for their
performance in solving optimization problems and other machine learning and self-learning gaming
applications. For post-doc research, I aim to explore the possibility of using swarm intelligence
(SI) algorithms to improve decentralized MARL algorithms in non-stationary environments. o be
successful as a starting faculty, I plan to start with simple ’unit’ problems where I can model the
learning goal for the decentralized agents using game-theory strategies. After modeling the learning
goal, I will need to define the communication model between the agents, with the use of SI algorithm
to optimize the policy update method for all agents.
After building the model, I will move to the implementation and experimenting phase to prove the
effectiveness of the proposed model.
Furthermore, I recognize the importance of recruiting and mentoring graduate students to make my
research plans a success. I plan to quickly develop positive working and mentoring relationships to
enhance both my own and my student’s success.
Lamiaa Basyoni
H (+974) 7744 6604 • B [email protected] 2/2