Deep Fake Today
Deep Fake Today
Deep Fake Today
Ajinkya Kharade1, Pranav Gaikwad1, Shubham Arakh1, Analp Kalore1, Maya P Shelke1, Nihar Ranjan1
1. Department of Information Technology, JSPM’s Rajarshi Shahu College Of Engineering, Pune, Maharashtra, India.
Email: [email protected], [email protected], [email protected],
[email protected], [email protected], [email protected]
Abstract – Deep fakes are synthetic videos created by deep face of the targeted person in a video with the source footage
learning algorithms that can convincingly depict individuals while maintaining the same facial expressions. Lip Syncing
saying or doing things they never did. With the proliferation of isolates the lip region and syncs it with audio that looks to
deepfake videos in social media and the potential for them to pronounce something that the individual does not actually
cause significant harm, deep fake detection has become a
pressing issue. In this study, we offer a unique method for
say. [8]. In order to create Deep Fake the Deep neural
detecting deepfakes by combining computer vision methods networks are used. Various recent technological
with intraframe noise. The proposed approach involves advancements with deep learning techniques including auto
extracting features from the video frames, including texture, encoders and GAN [12][13](Generative Adversarial
color, and edges, and then adding a layer of intraframe noise to Networks) are used to create fake faces which are applied
the video frames. We tested the proposed method on a variety of mainly in the computer vision. Deep Fake detection method
benchmark datasets and found that it achieved high accuracy in using the Haar wavelet transforms. The method aims to
detecting deepfake videos. distinguish between original videos and Deep Fake videos by
exploiting the limitations and artifacts introduced during the
Keywords: Deep Fake, intraframe noise, extracting features,
high accuracy.
Deep Fake generation process.
Mohammed Akram Younus and Taha Mohammed Hasan. [6] 3. PROPOSED SYSTEM
DeepFakes, a novel method for spotting false faces created
artificially, have been proposed. Given that DeepFake can Deepfake detection is used in various real-life applications
only generate face photos in set sizes and low resolutions, such as social media platforms, news verification, law
which must then be blurred and modified to match the faces enforcement, entertainment industry, political campaigns,
that will be replaced in the original film, In the generated online identity verification, and online reputation
DeepFake movies, These additive blur and ROI changes management. It helps identify and flag manipulated content,
produce distinct artefacts that may be efficiently recorded by verify the authenticity of videos and images, analyze
spotting discrepancies. evidence in legal proceedings, enforce copyright and protect
intellectual property, combat political misinformation, verify
Dolhansky, Brian and Howes, Russ and Pflaum, Ben and online identities, and manage online reputation. Deepfake
Baram, Nicole and Ferrer, Cristian [7] introduced a preview detection is a dynamic field that requires continuous research
of the DFDC dataset that will be made available later this and updates to stay ahead of evolving deepfake techniques.
year with the goal of encouraging researchers to familiarise
themselves with the data, providing preliminary findings, and
comparing those findings to suggested baselines.
unsupervised learning, or semi-supervised learning
can be used, the availability of labeled data.
1. Model Selection and Training: Choose a suitable 7. Continuous Improvement: Stay updated with the
deep learning architecture for deepfake detection, latest research advancements in deepfake generation
such as a CNN or a combination of CNN and RNNs and detection. Continuously evaluate and refine the
for temporal analysis. Consider using pre-trained deepfake detection system by incorporating new
models like ResNet, Inception, or EfficientNet and techniques, datasets, and model updates. Regularly
fine-tune them on the deepfake detection task. monitor performance metrics and incorporate
Employ transfer learning to leverage features feedback to enhance the quality and speed of
learned from large-scale datasets like ImageNet. detection.
2. Feature Extraction: Extract meaningful features 8. Evaluation and Testing: Evaluate the performance
from the input data using computer vision of the deepfake detection system using appropriate
techniques. This may involve face detection, facial parameters including F1 score, recall, accuracy, and
landmark detection, texture analysis, or motion precision. Conduct extensive testing on diverse
analysis. Select features that capture relevant datasets, including unseen deepfake variations, to
information for differentiating between real and assess the robustness and generalization capability
deepfake content. of the system.
3. Ensemble Methods: Train multiple deepfake 9. Deployment and Integration: Integrate the deepfake
detection models with different architectures or detection system into the desired application or
trained on different subsets of the dataset. Combine platform. Ensure that the system is scalable, reliable,
their predictions through ensemble methods like and user-friendly. Consider factors like system
majority voting or averaging to improve detection requirements, user interfaces, and deployment
accuracy. Experiment with different ensemble options (cloud-based, on-premise, or edge
techniques to find the optimal combination. computing) based on the specific use case and
deployment environment.
4. Hardware Acceleration: Utilize GPUs or other
hardware accelerators to accelerate the execution of It's important to note that the implementation details can vary
deep learning models. This can be done using deep depending on the specific deepfake detection approach,
available resources, and the chosen technologies. It is important to note that the specific implementation and
Experimentation, fine-tuning, and adapting the mathematical expressions may vary depending on the chosen
implementation to suit the specific requirements and algorithms and techniques used for feature extraction and
classification. The above representation provides a general
constraints of the system are necessary to achieve optimal
framework for understanding the process of deepfake
results. detection using computer vision and algorithms.
A mathematical expression representing the process of
deepfake detection using computer vision and algorithms:
5. RESULT
Let:
𝑋 be the input data (preprocessed images/videos).
𝑌 be the ground truth labels (0 for real content, 1 for The result of the deepfake detection system can be a binary
deepfake content). classification indicating whether the input media (image or
video) is classified as a deepfake or genuine. This result is
𝑓(𝑥) be the feature extraction function that maps the input based on the analysis and prediction made by the trained
data to a set of features. deep learning model or ensemble of models.