Department of AIML

TY AIML AY 2024-25
Capstone Project (22060)
Continuous Assessment: Weekly Progress report
Batch Batch1
Guide name Mrs. N.P. Sonakar

Project Title AI Virtual Mouse

Student name(s) 1.Sakshi Shashikant Manade
2.Siddhi Santosh Kolekar
3.Neha Ramesh Bamane
4.Aditee Sangramsinh Bhosale
PRN number(s) 2212130004, 2212130038, 2212130057, 2212130060

Week & Tasks Completed This Tasks Planned for Challenges Signature(student
Date Week Next Week Encountered (If and Guide)
any)

Week 1, 1. Set up the project 1.Optimize gesture 1. prepare for the

18/01/2025 environment & integrated thresholds to improve setup and
Media Pipe for hand detection accuracy integration process,
tracking; resolved and fine-tune the leading to a
dependency conflicts by integration of multi- smoother
updating libraries modal inputs (hand, development
voice, eye). experience. Guide Remarks

2. Developed a basic 2.Begin integration of 2. Minor integration "Good initial

Tkinter UI for instructions the machine learning issues among voice, progress. Focus on
and gesture customization module for advanced hand, eye tracking calibration and
while setting up OCR ( py gesture classification components, as well ensure a stable
tesseract) for handwriting & conduct as intermittent OCR video processing
recognition. Comprehensive inaccuracies. loop as you
System Testing integrate additional
features."

Comments: Proceed with the integration of eye tracking and voice recognition in the coming week.

Project Coordinator HOD

Mrs. Neha Sonakar Mr. A. A. Paritekar

Department of AIML
 TY AIML AY 2024-25
Capstone Project (22060)
Continuous Assessment: Weekly Progress report
Batch Batch1
Guide name Mrs. N.P. Sonakar

Project Title AI Virtual Mouse

Student name(s) 1.Sakshi Shashikant Manade
2.Siddhi Santosh Kolekar
3.Neha Ramesh Bamane
4.Aditee Sangramsinh Bhosale
PRN number(s) 2212130004, 2212130038, 2212130057, 2212130060

Week & Tasks Completed This Tasks Planned for Challenges Signature(student
Date Week Next Week Encountered (If and Guide)
any)

Week 2, 1. Integrated voice 1. Integrate 1. Voice command

24/01/2025 command recognition handwriting recognition
using the Speech recognition using sometimes
Recognition library & pytesseract for misinterprets
mapped key voice extracting text from commands due to
commands to GUI actions. captured images ambient noise

2. Added face mesh for eye 2. Begin initial 2. Overlapping gesture

tracking, allowing the development of the conditions causing
cursor to follow the user’s machine learning inconsistent triggers in Guide Remarks
gaze. module using scikit- some cases. Solid work on
learn’s SVC for integrating voice &
3. Refined the gesture gesture classification. eye tracking. Next,
detection logic (e.g., for concentrate on
left/right click, double- 3. Further fine-tune reducing false
click, scrolling) based on multi-modal detections &
hand landmark distances. integration to reduce refining gesture
overlapping actions. thresholds.

Comments: Improve system responsiveness and test the integrated modules under varied
conditions.

Project Coordinator HOD

Mrs. Neha Sonakar Mr. A. A. Paritekar

Department of AIML
 TY AIML AY 2024-25
Capstone Project (22060)
Continuous Assessment: Weekly Progress report
Batch Batch1
Guide name Mrs. N.P. Sonakar

Project Title AI Virtual Mouse

Student name(s) 1.Sakshi Shashikant Manade
2.Siddhi Santosh Kolekar
3.Neha Ramesh Bamane
4.Aditee Sangramsinh Bhosale
PRN number(s) 2212130004, 2212130038, 2212130057, 2212130060

Week & Tasks Completed This Tasks Planned for Challenges Signature(student
Date Week Next Week Encountered (If and Guide)
any)

Week 3, 1. Developed and tested the 1. Integrate and test 1. Initial integration
31/02/2025 handwriting recognition the machine learning challenges with the
module using pytesseract to model with live ML module and
extract text from video gesture data to ensuring consistency
frames. improve recognition between default and
accuracy. custom gesture
2. Created gesture mappings.
customization features 2. Conduct
using Tkinter dialogs to comprehensive end-to- 2. Further testing
allow users to remap end system testing needed to validate Guide Remarks
gestures to specific actions, (covering hand system robustness in Good progress on
with settings saved in gestures, voice real-time scenarios. advanced features.
JSON. commands, eye Focus on
tracking, and OCR) integrating the ML
3. Began preliminary module seamlessly
training of a machine 3. Prepare a and ensuring the
learning model (SVC from demonstration video and overall system is
scikit-learn) to classify finalize project robust and
gestures based on landmark documentation for responsive.
data. review.

Comments: Collect more gesture data for training and continue refining the integration between
multi-modal inputs

Project Coordinator HOD

Mrs. Neha Sonakar Mr. A. A. Paritekar
Department of AIML
 TY AIML AY 2024-25
Capstone Project (22060)
Continuous Assessment: Weekly Progress report
Batch Batch1
Guide name Mrs. N.P. Sonakar

Project Title AI Virtual Mouse

Student name(s) 1.Sakshi Shashikant Manade
2.Siddhi Santosh Kolekar
3.Neha Ramesh Bamane
4.Aditee Sangramsinh Bhosale
PRN number(s) 2212130004, 2212130038, 2212130057, 2212130060

Week & Tasks Completed This Tasks Planned for Challenges Signature(student
Date Week Next Week Encountered (If and Guide)
any)

Week 4, 1. Integrated and tested the 1. Refine the gesture 1. Fine-tuning the
7/02/2025 machine learning module training data and ML model with
using scikit-learn’s SVC further tune ML limited training data
with live gesture data, classification posed challenges in
leading to improved thresholds based on achieving consistent
classification accuracy. additional testing accuracy.
feedback.
2. Conducted 2. Minor integration
comprehensive end-to-end 2. Prepare for the final issues between the
testing of hand gestures, project review by custom gesture Guide Remarks
voice commands, eye polishing the UI and mappings and Excellent progress
tracking, and OCR, ensuring robust multi- default system integrating the ML
resolving integration issues modal input actions required module and
and optimizing integration additional debugging achieving
performance. comprehensive
3. Plan user trials and system testing.
3. Finalized the incorporate any Focus on further
demonstration video and further improvements data collection and
updated the project based on pilot fine-tuning as you
documentation feedback. prepare for the final
accordingly. review

Comments: Ensure thorough user testing and continue refining the UI to provide a seamless
experience. Overall, a strong step toward project completion

Project Coordinator HOD

Mrs. Neha Sonakar Mr. A. A. Paritekar