Jawahar Education Society’s

A.C. Patil College of Engineering

First Year Engineering (Semester 1)
VOICE CONTROLLER CAR
ABSTRACT
The voice-controlled car project aims to design and implement a system that allows users to
control various functions of a car using voice commands. By leveraging advancements in
natural language processing (NLP) and automotive technologies, this project seeks to
enhance driving experiences, improve accessibility, and promote safer interactions with
in-vehicle systems.

The project involves developing a robust hardware and software infrastructure to enable
seamless integration between the car's existing systems and the voice control mechanism.
The hardware components include a high- quality microphone for capturing voice
commands, a processing unit for real-time speech recognition, and actuators to execute the
desired actions based on the recognized commands.

On the software side, the project involves implementing a sophisticated speech recognition
system that utilizes machine learning algorithms and acoustic models. This system can
accurately convert spoken wards into actionable commands, allowing users to control
functions such as turning the car on/off, adjusting climate settings, changing music tracks,
activating safety features, and more.

Keywords: Obstacle, Microcontroller, Ultrasonic Sensor, Arduino, Encoder.

 INTRODUCTION

The development of advanced technologies has paved the way for innovative solutions in
the automotive industry, with the primary focus being on enhancing the driving experience,
improving safety, and increasing accessibility. One such groundbreaking project is the
voice-controlled car, which aims to revolutionize the way we interact with vehicles.

The traditional method of operating a car involves physical interactions with controls and
buttons located on the dashboard or steering wheel. However, these manual operations can
be cumbersome, distracting, and potentially hazardous, especially when drivers need to
divert their attention from the road. Recognizing this challenge, the voice-controlled car
project seeks to provide an intuitive and hands-free alternative to traditional controls.

Voice control has gained significant popularity in various consumer electronics devices, such
as smartphones, smart speakers, and home automation systems. Leveraging the
advancements in natural language processing (NLP), speech recognition, and automotive
technologies, the voice-controlled car project aims to harness the power of voice commands
to control various functions of a vehicle.

By integrating a sophisticated hardware and software infrastructure, the voice-controlled car

system enables drivers to interact with their vehicles using natural voice commands.
Whether it is starting or stopping the engine, adjusting climate settings, selecting music
tracks, navigating to a destination, or activating safety features, the system aims to provide
seamless control without the need for physical contact.
 LITERATURE SURVEY

1. "Voice-based in-vehicle systems: A literature review" by Adamantia G. Pateli et al.

(2017)This literature review provides an extensive overview of voice-based in-vehicle
systems, focusing on speech recognition techniques, user interfaces, and usability
challenges. It explores different approaches and technologies used in voice control systems
for cars and discusses their effectiveness and limitations.

2. "Voice-controlled interfaces for in-vehicle systems: A review" by Chunwei Zhu et al. (2019)
This review paper discusses the advancements in voice-controlled interfaces for in-vehicle
systems. It covers various aspects, including speech recognition algorithms, natural language
understanding, voice interaction design, and user experience. The paper presents current
trends and future directions for voice control in the automotive domain.

3. "Design and implementation of a voice-controlled car using smartphone by Vijayalakshmi

H. and Vijay Kumar M. (2016) This research paper presents the design and implementation
of a voice-controlled car using a smartphone as the control interface. It discusses the
hardware and software components required for the system and evaluates its performance
in terms of accuracy, latency, and user satisfaction. The paper also highlights the potential
applications and challenges of voice control in car automation.

4. "Voice-controlled in-car infotainment systems: State-of-the-art, challenges, and future

research directions" by Arsalan Ahmad et al. (2018) This paper reviews the state-of-the-art
voice-controlled in-car infotainment systems and identifies challenges and research
directions. It discusses issues such as noise robustness, multi- modal interaction,
personalized voice assistants, and user adaptation. The paper provides insights into the
current advancements in voice control technology and highlights areas for further
improvement.

5. "Integration of voice recognition technology for controlling in-vehicle systems" by Kyu-Jin

Lee et al. (2017) This study investigates the integration of voice recognition technology for
controlling in-vehicle systems. It explores the challenges and requirements of voice
recognition in the automotive context and presents a system architecture for voice control.
The research evaluates the system's performance in terms of accuracy and response time
and discusses potential improvements and future developments.
6. "Design of a voice-controlled car using machine learning" by K.V. Laxmi and R. Sivakumar
(2018) This research paper focuses on the design and implementation of a voice-controlled
car using machine learning techniques. It discusses the architecture of the system, including
the speech recognition module and the decision-making module. The paper evaluates the
accuracy and effectiveness of the voice control system and discusses its potential
applications in the automotive industry.
 PROPOSED SYSTEM

The proposed system for the voice-controlling car project aims to develop a comprehensive
and intuitive interface that allows users to control various functions of a car using voice
commands. The system comprises both hardware and software components, working
together to enable seamless integration and reliable voice recognition capabilities.

● Hardware Components:

1. Microphone: A high-quality microphone captures voice commands from the user inside
the car. It should be designed to minimize background noise and provide clear audio input
for accurate speech recognition.

2. Processing Unit: A powerful processing unit, such as a microcontroller or embedded

system, is responsible for real-time speech recognition It processes the audio input from the
microphone and converts it into recognizable commands using advanced algorithms.

3. Actuators: The system incorporates actuators to execute the desired actions based on the
recognized voice commands. This may include controlling engine operations, adjusting
climate settings, activating safety features, controlling multimedia systems, and more. The
actuators are connected to the car's existing control mechanisms for seamless integration.

● Software Components:

1. Speech Recognition System: The core of the software component is a robust speech
recognition system. It utilizes advanced natural language processing (NLP) techniques and
machine learning algorithms to convert spoken words into actionable commands. The
system should be trained on a vast dataset to improve accuracy and adapt to different
accents and languages.
2. Command Mapping. The system includes a command mapping module that associates
voice commands with specific car functions. It maps recognized voice inputs to the
corresponding actions that need to be performed. This module ensures that the system
understands the user's intent accurately and executes the desired functions accordingly.

3. Context Awareness: To enhance the system's intelligence, context-awareness is

incorporated into the software. This involves analyzing the driving situation, such as vehicle
speed, road conditions, and environmental factors, to interpret and respond appropriately
to voice commands. For example, if the car is in motion, certain commands may be
restricted for safety reasons.

4. User Interface and Feedback: The software component includes a user interface that
communicates with the driver. It provides audio feedback to confirm successful execution of
commands or prompts for clarification if the voice input is ambiguous The interface should
he designed to be intuitive and user-friendly, ensuring a seamless and pleasant experience
for the driver.
 WORKING

● Speech input: The user speaks voice commands into a microphone or a smartphone.
The voice command is captured as an audio signal.

● Speech-to-text conversion: The audio signal is processed to convert the spoken

words into text format. This conversion is done using speech recognition algorithms
or services like Google Speech-to-Test API or PocketSphinx. The resalting text
represents the recognized command.

● Command interpretation: The recognized text command is then interpreted by the

system to determine the desired action. For example, if the command is "move
forward," the system needs to understand that it should make the car move in the
forward direction.

● Bluetooth communication: The interpreted command is transmitted wirelessly from

the device capturing the voice command (e.g. smartphone) to the Arduino board in
the car using Bluetooth communication. The Bluetooth module on the Arduino is
responsible for establishing and maintaining this connection.

● Arduino processing: The Arduino board receives the interpreted command via the
Bluetooth module. The Arduino code on the board processes the received command
to extract the intended action. This involves analyzing the command and mapping it
to specific control signals for the car.

● Motor control: Based on the interpreted command, the Arduino sends appropriate
control signals to the motor driver. The motor driver, connected to the motors of the
car, receives these signals and adjusts the voltage and direction supplied to the
motors accordingly.

● Car movement: The motors of the car respond to the control signals from themotor
driver, causing the car to move in the desired direction. For example, if the command
was to move forward, the motor driver would activate the motors in such a way that
the car moves forward
 ADVANTAGES

1.Enhanced Safety: Voice control eliminates the need for manual interactions with physical
controls, reducing driver distractions and promoting safer driving practices. Drivers can keep
their hands on the wheel and their eyes on the road while still being able to control various
car functions through voice commands.

2. Improved Accessibility: Voice control makes it easier for individuals with physical
disabilities or limited mobility to operate a car. It eliminates the requirement for comples
manual operations, allowing a wider range of individuals to independently control and
operate the vehicle.

3. Hands-Free Operation Voice control enables hands-free operation, providing convenience

and freeing up the driver's hands for other tasks such as holding the steering wheel or
managing other in-car activities. This feature is particularly beneficial for activities like
making phone calls, changing music tracks, or adjusting climate settings while driving.

4. Intuitive and Natural Interaction: Voice control offers a more natural and intuitive
interaction method compared to traditional physical controls. Users can communicate with
the car using natural language commands, making the system easier to learn and use,
especially for those who are not familiar with complex control interfaces.

5. Future-Proofing: Voice control aligns with the trend of increasing integration of voice
assistants and smart technologies in various aspects of our lives. By incorporating voice
control in cars, the project ensures that vehicles are compatible with the evolving landscape
of smart homes, Internet of Things (IoT), and voice activated devices, making the driving
experience more seamless and connected.
 FUTURE SCOPE

The future scope of the voice-controlling car project encompasses advancements in natural
language understanding, multi-modal interaction, integration with intelligent personal
assistants, improved voice recognition technologies, emotional recognition and response,
integration with vehicle telematics, autonomous driving, continuous user experience
improvement, smart voice assistants for passengers, and integration with smart city
infrastructure. These developments have the potential to further enhance the functionality,
usability, and integration of voice control in cars, providing a more connected, personalized,
and convenient driving experience.

CONCLUSION

The voice-controlling car project presents a transformative approach to car control, offering
convenience, safety, and a more enjoyable driving experience. As technology continues to
evolve, voice control has the potential to become an integral part of the automotive
industry, making our journeys safer, more accessible, and connected.
 REFERENCE

[1] Pateli, A. G. Darzentas, 1, & Germanakos, P. (2017). Voice-based in-vehicle systems: A

literature review. IEEE Transactions on Intelligent Transportation Systems, 18(2), 454-474.

[2] Zhu, C. Wang, X. & Yang, H. (2019). Voice-controlled interfaces for in-vehicle systems: A
review. IEEE Access, 7, 139442-139456

[3] Vijayalakshmi, H. & Vijay Kumar, M. (2016). Design and implementation of a

voice-controlled car using smartphone in 2016 IEEE International Conference on
Computational Intelligence and Computing Research (ICCIC) (pp. 1-5) IEEE

[4] Ahmad, A, Majumder, S, Rana, M. M. & Ahamed, S. 1. (2018) Voice-controlled in-car

infotainment systems: State-of-the-art, challenges, and future research directions. IEEE
Access, 6, 54460-54480.

[5] Lee, K. J. Kim, B. H. & Kim, D. H. (2017). Integration of voice recognition technology for
controlling in-vehicle systems. International Journal of Automotive Technology, 18(2),
315-322

[6] Laxmi, K. V. & Sivakumar, R. (2018). Design of a voice-controlled car using machine
learning, In 2018 International Conference on Intelligent Computing and Control Systems
(ICICCS) (pp. 1005- 10101, IEEE