Title of topic

A Thesis submitted
To
Chhattisgarh Swami Vivekanand Technical University Bhilai (C.G.), India

In fulfilment for award of the degree

Of
BACHELOR OF TECHNOLOGY
In
Computer Science and Engineering
By
Name of Student(Roll. No.)

Under the Supervision of

Name of Guide
(Assistant Professor)

Department of Computer Science & Engineering

Government Engineering College, Sejbahar
Raipur (C.G.)
Session: 2024–2025
 DECLARATION BY THE CANDIDATES

We the undersigned solemnly declare that the report of the Project Work entitled “Title of the
topic”, is based on our own work carried out during our study under the supervision of (Name
of Guide).
We assert that the statements made, and conclusions drawn are an outcome of the project work.
We further declare that to the best of our knowledge and belief that the report does not contain
any part of any work which has been submitted for the award of any other
degree/diploma/certificate in this University/deemed the University of India or any other
country. All help received and citations used for the preparation of the Project Work have been
duly acknowledged.

(Signature of the candidate)

Name:
Roll No:
Enrolment No:

I
 CERTIFICATE OF THE SUPERVISOR

This is to certify that the report entitled “Title of the topic” is a record of bonafide research
work carried out by Name of Student, Roll no: …………… & Enrolment No.: …………. ,
under my guidance & supervision for the award of Degree of Bachelor of Technology in the
field of Computer Science and Engineering, of Chhattisgarh Swami Vivekanand Technical
University, Bhilai (C.G.), India.
To the best of my knowledge and belief the Project Work
 Embodies the work of the candidate herself,
 Has duly been completed,
 Fulfils the requirement of the ordinance relating to the B. Tech degree of the University.
 Is up to the desired standard both in respect of contents and language for being referred to
the examiners.

(Project Supervisor)
Mr. …………………. Prof. (Dr.) R.H. Talwekar
(Assistant Professor) (Head of Department)
Dept. of Computer Science & Engineering Dept. of Computer Science & Engineering
Government Engineering College, Sejbahar Government Engineering College, Sejbahar
Raipur (C.G.) Raipur (C.G.)

Forwarded to Chhattisgarh Swami Vivekanand Technical University, Bhilai

II
 CERTIFICATE BY THE EXAMINERS

The Report entitled “Title of Topic” submitted by Name of Student (Roll No.: ……….. &
Enrolment No.: ……….) has been examined by the undersigned as a part of the examination
and is hereby recommended for the award of the degree of Bachelor of Technology in the field
of Computer Science and Engineering of Chhattisgarh Swami Vivekanand Technical
University, Bhilai.

_______________ _______________
Internal Examiner External Examiner

Date: Date:

III
 ACKNOWLEDGEMENT

We would like to thank our honourable Principal Prof. Dr. M.R. Khan, Prof. Dr. R.H.
Talwekar (Head of Department) and our supervisor (Name of Project Guide), Assistant
Professor, Department of Computer Science and Engineering for his immense support and
enlightened guidance for our project which we have developed as B. Tech. students.
We are also thankful to (Name of Project In charge), Assistant Professor & Project
Coordinator for his continuous support & guidance. We are very grateful for the inspiring
discussions with all our faculties, their valuable support and path-guiding suggestions have
helped us to develop this project. Alongside this, we would like to take this opportunity to
express our thanks to everyone in the Computer Laboratory of Government Engineering
College, Sejbahar, and Raipur (C.G.).
We especially thank our batch mates, and friends for the support and help that they offered us
during the development of this project.

(Signature of the
candidate)
Name:
Roll No:
Enrolment No:

IV
ABSTRACT
 Table of Contents
V

Declaration by the Candidates...........................................................................................................................I

Certificate of the Supervisor.............................................................................................................................II
Certificate by the Examiners...........................................................................................................................III
Acknowledgement..........................................................................................................................................IV
Abstract............................................................................................................................................................V
Chapter - 1 Introduction.................................................................................................................................1
1.1 Introduction....................................................................................................................................1
1.2 Objective........................................................................................................................................2
Chapter - 2 Literature Review.......................................................................................................................3
Literature Survey..................................................................................................................................3
Chapter - 3 Methodology................................................................................................................................5
3.1 Flow Representation......................................................................................................................5
3.2 Dataset Collection..........................................................................................................................5
3.3 Data Preprocessing using NLTK....................................................................................................6
3.4 Data Visualization........................................................................................................................10
3.5 Model Training & Testing............................................................................................................13
3.5.1 Seq2Seq Model.....................................................................................................................13
3.5.2 LSTM....................................................................................................................................14
3.5.3 Transformer Model...............................................................................................................16
3.5.4 BART Model.........................................................................................................................16
3.6 Integration with backend & frontend...........................................................................................20
Web Application...........................................................................................................................20
3.7 Model Evaluation.........................................................................................................................23
3.8 Summary Generation...................................................................................................................24
Chapter - 4 Result & Conclusion.................................................................................................................26
4.1 Result...........................................................................................................................................26
4.2 Conclusion...................................................................................................................................27
Future Scope.....................................................................................................................................28
References.........................................................................................................................................29
 List of Figures
Fig (3-i): - Flow chart of the project 5
Fig (3-ii): - Flowchart of Cleaning data 8
Fig (3-iii): - Dataset Before Preprocessing 9
Fig (3-iv): - Dataset After Preprocessing 9
Fig (3-v): - Word cloud graph with highest frequency in input text(article) 10
Fig (3-vi): - Word cloud graph with highest frequency in reference summary(highlights) 11
Fig (3-vii) – Sentence Length distribution graph for input text(article) 11
Fig (3-viii) – Sentence Length distribution graph for reference summary(highlights) 11
Fig (3-ix) – Correlation plot for input text(article) 12
Fig (3-x) – Correlation plot for reference summary(highlights) 12
Fig (3-xi) – ANN architecture 13
Fig (3-xii) – Perceptron 14
Fig (3-xiii): - Working of LSTM 15
Fig (3-xiv): - Architecture of LSTM in our project 15
Fig (3-xv): - Flow of Layers of LSTM in our project 15
Fig (3-xvi): - BART basic architecture 17
Fig (3-xvii): - BART detailed architecture 17
Fig (3-xviii): - Architecture of BART in our project 18
Fig (3-xix): - Flow of Layers of BART in our project 18
Fig (3-xx): - User input page (BART) 21
Fig (3-xxi): - User input page after entering input (BART) 21
Fig (3-xxii): - Output page (BART) 21
Fig (3-xxiii): - User input page (LSTM) 22
Fig (3-xxiv): - User input page after entering input (LSTM) 22
Fig (3-xxv): - Output page (LSTM) 22
Fig (3-xxvi): - Test Loss & Accuracy of LSTM 23
Fig (3-xxvii): - Rouge Scores of Bart Model 23
Fig (3-xxviii): - Train accuracy vs validation accuracy graph of LSTM Model 23
Fig (3-xxix): - Train loss vs validation loss graph of LSTM Model 23
Fig (3-xxx): - Summary generated by LSTM Model 24
Fig (3-xxxi): - Summary generated by BART Model 24

List of Tables
Table 1: Evaluation metrics against each model 23
Table 2: Comparison between LSTM & BART Model Output 25

VII
 CHAPTER - 4
RESULT & CONCLUSION

26
FUTURE SCOPE
27

28
 REFERENCES

[1] El-Kassas, Wafaa S., et al. “Automatic text summarization: A comprehensive survey.” Expert
systems with applications 165 (2021): 113679
[2] Jani, Dishank, et al. “Text Summarization: An Overview” Computational Intelligence in Data
Mining: Proceedings of ICCIDM 2021 (2022): 523-536.
[3] Syed, Ayesha Ayub, Ford Lumban Gaol, and Tokuro Matsuo. "A survey of the state-of-the-art
models in neural abstractive text summarization." IEEE Access 9 (2021): 13248-13265.
[4] Lewis, Mike, et al. "Bart: Denoising sequence-to-sequence pre-training for NLG, translation,
& comprehension." arXiv preprint arXiv:1910.13461 (2019).
[5] Jiang, Jiawen, et al. "Enhancements of attention-based bidirectional LSTM for the hybrid
automatic text summarization." IEEE Access 9 (2021): 123660-123671.
[6] Liu, Yang, and Mirella Lapata. "Text summarization with pretrained encoders." arXiv
preprintarXiv:1908.08345 (2019).

29