Co-Mart - A Daily Necessity Price Comparison Application: Ayush Asawa Swapnil Dabre Shravani Rahise
Co-Mart - A Daily Necessity Price Comparison Application: Ayush Asawa Swapnil Dabre Shravani Rahise
Sardar Patel Institute Of Technology Sardar Patel Institute of Technology Sardar Patel Institute of Technology
Mumbai, India Mumbai, India Mumbai, India
[email protected] [email protected] [email protected]
Abstract—Co-Mart is a daily necessity price comparison appli- shopping such as low prices with similar quality of the product
cation where users can compare the prices of groceries on various that is available physically, saving time and energy and users
E-commerce websites. With the advancement in technology and are also able to return the product easily if not liked. Also
the growing E-commerce business, the number of E-commerce
websites has increased but at the same time, it has become with increasing inflation, people use these various websites
difficult for people to choose the best deals from these websites. for shopping as these have comparatively lower rates and are
This paper focuses on an web application called Co-Mart, where a great medium to save money. Due to these various reasons,
one can compare prices of various products on different E- the internet market has been expanding rapidly [3].
commerce websites and thus save one’s Time, Efforts and Money.
The methods that will be used for identifying the best deals will II. L ITERATURE S URVEY
be web crawling and web scraping. The web scraping scripts
will be written using python libraries and web crawling works With the tremendous growth and advancement in the IT
on HTML labels. The framework will be designed using HTML industry, every new business has launched its website for
(Hypertext markup language), CSS (Cascading style sheet), and ease of the user. The internet penetration in India was at
JavaScript as front-end and Python and Django will be used 45% in Jan 2021. The E-commerce industry has emerged
for back-end support with SQLite as the Database Management
System. as a front-runner in the Indian economy with an internet
Index Terms—Web Scrapping, Web Development, Python, penetration rate of about 50% now, nearly 37% of smartphone
Django. internet users, launching the 4G network, internet content in
the local language, and increasing consumer wealth. Massive
I. I NTRODUCTION infrastructure and policy support propelled the E-commerce
The cyber-world is mutating and growing and it has reached industry to reach US$ 64 billion in 2020, up by 39% from
every corner of society. It has various impacts like inflation, 2017, and will touch US$ 200 billion by 2026 with a CAGR
growing businesses, etc. A similar business that has grown due of 21%. According to IBEF (India Brand Equity Foundation),
to the cyber world is the E-commerce business. People have after China and the US, India had the third-largest online
started using various websites to shop online as it reduces shopper base of 140 million in 2020 [4]. Such an increase
efforts and products are delivered to our doorstep [1]. Also in E-commerce websites has given a lot of choices to people
after the pandemic has hit the world, the demand for online to choose from. On one hand, it is an advantage as people
shopping has increased rapidly as people weren’t allowed to have a variety to choose from but on the other hand, it is also
leave their houses and it was also risky to go out shopping. a disadvantage as it becomes difficult to choose the best deal
In this situation, ordering products online and getting them from various websites.
delivered to the doorstep was very convenient [2]. The idea presented in this paper is similar to the
This has made people’s lives easy as shopping online on existing website such as Trivago which compares Hotel
the internet requires minimum effort and there is no specific prices [5], ComparRaja which compares categories
time to shop online, also there are no geographical constraints. like Mobiles, TV, Washing Machines, ACs, Air Cooler-
Online shopping has become a core business now as the user shttps://www.overleaf.com/project/619f5ddfc3288b4e9ed4ffda,
can shop tirelessly without visiting different shops physically. Refrigerators, Air Purifiers, Water Heaters [6],
Other than this, there are also other advantages of online CamelCamelCamel which compares products on within
the Amazon and alerts you when prices drop [7]. E. Django
In this paper, we have developed and discussed a similar Django is an open-source framework for backend web appli-
Website named Co-Mart which compares the products from cations based on Python. And allow us to create applications
different E-commerce websites such as DMart, JioMart, or websites from an existing source, instead of from scratch
Amazon, and Flipkart. We have taken the help of web [12].
scraping and web crawling for getting the data from these
websites and embedding it in Co-Mart Application. Web F. BeautifulSoup
scraping is the practice of gathering information through Beautiful Soup is a Python library for pulling data out of
any means other than program interacting with API. This HTML and XML files. It works with the parser to provide
is accomplished basically by writing an automated program idiomatic ways of navigating, searching, extracting, and mod-
that queries a web server, requests data (mostly in the ifying the parse tree [13].
form of HTML), and then parse that data to extract the
needed information [8]. The applications of web scraping are G. Selenium
generally observing weather data, researching data gathering, Selenium is an open-source software compatible with Win-
seeking health information, and finding interesting patterns dows, Linux, and macOS and through its WebDriver compo-
for business or web data integration [9]. nent is able to automate all major web browsers by starting
This paper discusses Co-Mart, which is a Daily Necessity an instance, sending commands and retrieving the result [14].
Price Comparison Application that will help reduce the efforts
and time invested into finding the best deals on these websites. H. SQLite
Anyone willing to shop online could use this application SQLite is an advanced database system useful for storing
and there will be no need to download various other E- data. It is simple to use operate and supported by multiplatform
commerce applications, the link provided with the product will [15].
directly take the user to the website from which the product
is available.
III. M ETHODOLOGY
This section of the paper gives details about the components
used in making the application which works together to bring
out the desired result.
The framework is designed using HTML (Hypertext markup
language), CSS (Cascading style sheet), and JavaScript as
front-end, and Python & Django will be used for backend
support. Python library Beautiful Soup and Selenium are
used for Web scrapping and SQLite is used for database
management.
A. HTML
The HyperText Markup Language or HTML is used in the
application for basic framework designing and functions [10].
B. CSS
Cascading Style Sheets is a style sheet language used in the
application for describing the presentation of the application.
It allows the application to adapt to different devices such as Fig. 1. Block Design of Co-Mart Application
laptops, mobile phones, or desktop monitor [10].
C. Javascript IV. I MPLEMENTATION
Javascript is the important component of the application as This section of the paper explains the implementation of Co-
it is used to fetch the user input to the web scrapper and then Mart Application which takes the help of different components
display the result back to the user. JavaScript gives web pages discussed in the previous section. This section also talks about
interactive elements that engage the user [11]. the Block Design and Algorithm used for Co-Mart Application
which is shown in Fig. 1. and Fig. 2. respectively that helps
D. Python the user in getting an accurate result.
Python is the core of the application as it is used in web Fig. 1. shows the Block Design of the Co-Mart Application.
scraping the data from different websites. It is also used for It consists of 4 blocks, starting with the User’s Query that will
processing the user input and running the algorithm on the be taken as an input. This input will be embedded with the
user input to give the optimal results [12]. various E-commerce websites URL such as DMart, JioMart,
Amazon, and Flipkart to perform the web-scrapping. This with the extracted product name, whether the word is present
web-scrapping will return the results and product details which in the product’s name. If each word is matched with the
are shown to the user for comparison. product name, other product details such as actual price,
discounted price, and link to the product are scrapped with
the help of Beautiful Soup functions and stored in the list.
If P1 is partially matched with the extracted product name then
a product with the least price is selected and all the details such
as actual price, discounted price, and link to the product are
scrapped with the help of Beautiful Soup functions and stored
in the list.
If P1 is not matched at all with any of the extracted products
names present on the Website page then it indicates the
unavailability of the product on the website. This process is
repeated for all the targeted websites and all the data from
each website is stored in the list, which is then, with the help
of Python and Javascript, is pushed on Co-Mart Application
and displayed to the users.
Figures in Results and Discussion sections shows the general
search result and Specific search result respectively.
V. R ESULTS AND D ISCUSSION
A. Login Page
The user needs to first create an account by signing in with
his email address and a proper password and then log in with
the same credentials. Fig. 3. shows the Login Page of Co-Mart
Application.
E. Specific Search
grocery item. Either the user can directly search from the few
hard-coded options or can search for any item from the search
bar as shown in Fig. 5.
F. Add to Cart
Fig. 5. Home Page of Co-Mart Application
After Comparing the prices of a particular item, now the
D. General Search user can save it further by clicking the add to cart button. In
Fig. 6. shows the output when searched for any particular the cart as shown in Fig. 8, the user can save multiple products,
item. It gives the best product available on all the four where the subtotal of all added items in the four E-commerce
websites will also be displayed. From which the user will get
a brief idea about the most beneficial website for his shopping
list.
VI. C ONCLUSION
In this paper, a web application called Co-Mart is discussed
in detail which takes the help of different technologies for
reducing the human efforts and time to search for the best price
availability of the product across the different E-commerce
websites. Thus, Co-Mart is a platform where one can easily
compare the prices of various products which will help them
save their time and money. Also, With the increasing tech-
nology, further enhancements in the website can be made to
directly order from the application without the need of visiting
the actual website.
R EFERENCES
[1] Prashanth Nagendra Bharadwaj and Ramesh G Soni. E-commerce
usage and perception of e-commerce issues among small firms: results
and implications from an empirical study. Journal of small business
management, 45(4):501–521, 2007.
[2] Ranjani Murali. An intelligent web spider for online e-commerce
data extraction. In 2018 Second International Conference on Green
Computing and Internet of Things (ICGCIoT), pages 332–339. IEEE,
2018.
[3] Shakra Mehak, Rabia Zafar, Sharaz Aslam, and Sohail Masood Bhatti.
Exploiting filtering approach with web scrapping for smart online
shopping: Penny wise: A wise tool for online shopping. In 2019 2nd
International Conference on Computing, Mathematics and Engineering
Technologies (iCoMET), pages 1–5. IEEE, 2019.
[4] Neelam Chawla and Basanta Kumar. E-commerce and consumer
protection in india: The emerging trend. Journal of Business Ethics,
pages 1–24, 2021.
[5] Rolf Schrömgens. Trivago. Accessed: Jan. 10,2022 [Online]
http://trivago.in.
[6] Logicserve Technologies Pvt Ltd. Venture. Compare raja. Accessed:
Jan. 10,2022 [Online] https://www.compareraja.in.
[7] Inc Cosmic Shovel. Camelcamelcamel. Accessed: Jan. 10,2022 [Online]
https://camelcamelcamel.com.
[8] Suhit Gupta, Gail Kaiser, David Neistadt, and Peter Grimm. Dom-
based content extraction of html documents. In Proceedings of the 12th
international conference on World Wide Web, pages 207–214, 2003.
[9] Ryan Mitchell. Web scraping with Python: Collecting more data from
the modern web. ” O’Reilly Media, Inc.”, 2018.
[10] Jon Duckett. Web design with HTML, CSS, JavaScript and jQuery set,
volume 1. Wiley IN, 2014.
[11] Douglas Crockford. JavaScript: The Good Parts: The Good Parts. ”
O’Reilly Media, Inc.”, 2008.
[12] Samuel Dauzon, Aidas Bendoraitis, and Arun Ravindran. Django: Web
Development with Python. Packt Publishing Ltd, 2016.
[13] Vineeth G Nair. Getting started with beautiful soup. Packt Publishing
Ltd, 2014.
[14] Mihai Gheorghe, Florin-Cristian Mihai, and Marian Dârdală. Modern
techniques of web scraping for data scientists. International Journal of
User-System Interaction, 11(1):63–75, 2018.
[15] ST Bhosale, Miss Tejaswini Patil, and Miss Pooja Patil. Sqlite: Light
database system. Int. J. Comput. Sci. Mob. Comput, 44(4):882–885,
2015.