System Testing
System Testing
URL: http://ass2site-env.eba-7bjp86et.us-east-1.elasticbeanstalk.com/
1. Overview
Introduction of the System:
The online grocery store system is a web application that allows users to browse, search for, and purchase grocery
items. Users can filter their search by product categories or sub-categories, add or edit their shopping cart, and place
orders. The system also manages shopping cart persistence, database updates and sends order confirmation emails.
2. Scope of Test
We are evaluating the functionality, usability, security, reliability and error handling of the online grocery store
system to ensure that it operates in a stable and functional manner. Due to time and resource limitations, we are
intentionally excluding testing related to the website’s performance, e.g. response time. We have also excluded testing
that is related to the website’s user interface, e.g. text readability, appropriate font and background colour, and no
unnecessary borders around images.
Further testing is required before deployment regarding performance and interface as defects may be present that
affect the user’s experience (e.g. non-intuitive design, inaccessible navigation), affect the system’s scalability, or
expose the system and its owners to legal risks as a result of failure to comply with web accessibility standards.
3. Team Organisation
Recorded Presentation Link: INSERTLINK HERE TO RECORDED PRESENTATION
(we’ll also attach a video file to Canvas submission just in case)
All project team members are responsible for reviewing the specification document, openly communicating with
other team members, conducting tests on the online grocery store system, contributing to the report (including
completing their own test cases and defects), and actively participating in creating and presenting the report.
Importan
Brief description Test case Include/Exclude
ce (L, M, Dependencies
of the function label in the system test
H)
Browse items by H T100 Include N/A
categories.
Search for items using H T101 Include N/A
keywords.
Search for an item’s details H T102 Include Depends on
and availability (in stock "Search for
or not). items using
keywords"
Add an item to the H T103 Include Depends on
shopping cart. "Search for
items using
keywords"
Edit the shopping cart H T104 Include Depends on
(add/remove items and "Add an item to
change quantity). the shopping
cart"
Place an order for items in H T105 Include Depends on
the shopping cart "Edit the
shopping cart"
Send a confirmation email M T106 Excluded Depends on
regarding the order. "Place an order
for items in the
shopping cart"
User can view their M T107 Include Depends on
purchase history. “Place an order
for items in the
shopping cart”
Logo redirects the user to L T108 Excluded Depends on
the homepage or log-in home-page and
page. log-in page.
The search box provides M T109 Excluded Depends on
hints when empty. “Search for
items using
keywords”
Highlight the M T110 Excluded Depends on
category/sub-category “Browse items
when the mouse hovers by category”
over or clicks.
When the “Add to cart” H T111 Include Depends on
button is selected, it "Add an item to
increments the relevant the shopping
item quantity by one. cart"
The shopping cart displays H T112 Excluded Depends on
items, quantities and total "Add an item to
price the shopping
cart"
The user can place an H T113 Depends on
order when the cart isn’t "Place an order
empty. for items in the
shopping cart"
The shopping cart persists M T114 Depends on
for 20 minutes if the “The shopping
webpage remains open. cart displays
items, qualities
and total price”
Validate provided contact H T115 Include Depends on the
details (email address, order
phone number). information
page.
Re-check the availability H T116 Excluded Depends on
of cart items before the "Place an order
order is placed for items in the
shopping cart"
Notify user if an item in H T117 Excluded Depends on
their cart is no longer "Re-check the
available and redirect them availability of
to the cart. cart items"
Clear the shopping cart H T118 Exclude - Unable Depends on
and update the database to see the "Place an order
after the order is database. for items in the
successfully placed. shopping cart"
The “Add to cart” button is M T119 Excluded Depends on
gray and not clickable "Search for an
when the item is out of item’s details
stock. and
availability"
Highlight or other visual L T120 Exclude Depends on
effects when the mouse items being
hovers over an item displayed.
The shopping cart appears L T121 Exclude N/A
as a pop-up window.
The order button appears L T122 Exclude Depends on
differently when the "Edit the
shopping cart is empty shopping cart"
(grey button)
5. Approach
Our test strategy prioritises testing based on the function’s importance (High → Medium → Low). Through this
approach, we may ensure that the system’s key functionalities are thoroughly tested before moving on to less critical
features. This approach is also user-centric as it focuses on ensuring that the user can complete essential tasks without
issues; for example, If a user cannot browse for items or place orders, their experience on the website is significantly
compromised. This testing strategy is also effective as these high-importance functions are likely the most
resource-intensive. As a result, it should be conducted at the start of the project to overcome the risks involved with
burnout and avoid rework by addressing foundational issues as early as possible. Through this early detection of
defects in critical functionality, we may avoid the possibility of the issues compounding into a greater problem and
instead establish a strong foundation where subsequent quality-of-life functionality can be tested confidently.
The system testing is considered successful if all test cases marked as high-importance (H) functionality are passed.
Any defects discovered in these high-importance functions will present considerable challenges to users. As a result,
the absence of defects when these test cases are conducted presents a suitable baseline.
6. Test Cases
T100
Test case
label
Originator Jack Hopkins
Verifies that items are correctly organised into their relevant categories and
Test case
sub-categories. Ensures that users can click and expand these categories to
description
view sub-categories and items within the categories.
Preconditions:
N/A
Setup Environments:
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
● Network: Stable ethernet internet connection
Test case Verifies that contact details - email address and phone number, are valid
description entries (checks formatting) before an order can be successfully placed.
Preconditions:
● The user’s shopping cart contains 1 or more items ready for
checkout
● The user is on the order information page
Setup Environments:
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
● Network: Stable ethernet internet connection
Verifies that the user can add Products that are in stock to the Shopping
Test case
Cart
description
● Adding a Product to Cart if it is In Stock
● Not adding Products to Cart if they are Out of Stock
Preconditions:
● N/A
Environments:
Setup
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
● Network: Stable ethernet internet connection
When you search for products using the search bar above, it displays every
Test case product with the keyword.
description ● Displaying Product if the keyword matches the product
● Not displaying any product that does not match the keyword
Preconditions:
● N/A
Setup Environments:
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
● Network: Stable ethernet internet connection
Preconditions:
● N/A
Environments:
Setup
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
● Network: Stable ethernet internet connection
Step # Test Action Expected Results
1 Navigate to the online grocery store The home page of
website the Grocery Store
(http://ass2site-env.eba-7bjp86et.us-east- should show the
1.elasticbeanstalk.com/#) menu (showing all
products that they
sell)
2 Press the “Add To Cart” button on a It should add the
product that is “in_stock” product to Cart
3 Click the “Cart” dropdown button next to It should display the
Case Steps
the search bar at the top of the website item that you added
and the quantity
4 Press the “Add To Cart” button on the It should display the
same product you added in Step 2 product that you
already added but
the quantity
should’ve
incremented by 1
5 Close browser Session ends
Verifies that when an item is found via search, the user can view:
Test case ● Details of the item
description ● Availability of the item (In Stock or Out of Stock)
Preconditions:
● The user can open the Online Grocery Store
● The Search Product function works successfully
● There are items for purchase in the online store
Setup Environments:
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
Network: Stable ethernet internet connection
Preconditions:
● The user is able to open the Online Grocery Store
● There are items for purchase in the online store
● The user can successfully open the Cart screen
Setup Environments:
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
Network: Stable ethernet internet connection
Step # Test Action Expected Results
5 Add quantity for the selected item and The new quantity is
update the cart viewed in the cart
and the amount has
changed
Verifies that a user can complete an order for items that are placed in the
Test case shopping cart
description
Preconditions:
● The user is able to open the Online Grocery Store
● There are items for purchase in the online store
● The user can successfully open the Cart screen
● There are items in the Cart
Setup
Environments:
● Equipment: Desktop
● Operating System: Windows 10
● Browser: The latest version of Google Chrome
Network: Stable ethernet internet connection
Test case
label Needs to be corrected
Originator Ankit Khand
Test case Verify whether a user can successfully add a product to their shopping cart.
description
Preconditions:
N/A
Environments:
Setup
● Equipment: Desktop
● Operating System: Windows 11
● Browser: The latest version of microsoft edge
● Network: Stable ethernet internet connection
Test case
label Needs to be corrected
Originator Ankit Khand
Test case To confirm that the user can successfully complete the checkout process
description and make a purchase.
Preconditions:
N/A
Environments:
Setup
● Equipment: Desktop
● Operating System: Windows 11
● Browser: The latest version of microsoft edge
● Network: Stable ethernet internet connection
Test case
label Needs to be corrected
Originator Ankit Khand
Test case To confirm that registered users are able to log in using authenticated
description credentials.
Preconditions:
N/A
Environments:
Setup
● Equipment: Desktop
● Operating System: Windows 11
● Browser: The latest version of microsoft edge
● Network: Stable ethernet internet connection
Defect ID D102
Originator Jack Hopkins
Date recorded 11/10/2024
Insufficient validation of contact details. The system doesn’t correctly validate phone
Summary of numbers, as it allows non-Australian phone numbers, incorrect lengths and special
defect characters. Email validation is also weak; it only checks that “@” is present and that there are
characters before and after it.
Severity High
Priority High
Main function / Order information page (Validate provided contact details)
Test case T115
Screenshots
Defect ID D103
Originator Alex Matronitsky Phone: N/A
Date recorded 14/10/24
Users are allowed to add products to cart even if the product is out of
Summary of stock. The button “Add To Cart” is not a different colour when the
defect product is “Out of Stock”
Severity Medium
Priority Medium
Main function / Menu (Users are adding products to cart) (T103)
Test case The buttons are not a different colour when Out of Stock (T119)
Screenshots
1
Defect ID D104
Originator Alex Matronitsky Phone: N/A
Date recorded The date the defect was found.
Pressing the “Add To Cart” button does not increment the product quantity by 1
Summary of
defect
Severity Low
Priority Low
Main function / Menu (an increment function with the cart button) T111
Test case
Screenshots
Defect ID D105
Originator Ankit Khand Phone: N/A
Date recorded 10/28/2024
When an item is added to the shopping cart, the system does not show
Summary of a message confirming that the item has been stored. Users do not
defect know if the item was added or not.
Severity Medium
Priority High
Main function / Shopping cart Functionality/T100
Test case
Screenshots
More if required
Defect Id D106
Originator Ankit Khand Phone:N/A
Date recorded 10/28/2024
There are serious flaws in the validation processes that permit unregistered emails and
Summary of inadequately formatted contact numbers to be used by the users. Also it is worth mentioning
defect that no email confirmation is being sent after placing the order.
Severity High
Priority High
Main function / Order placement and input validation/T200
Test case
Screenshots
Defect ID D99
The validity of the total amount the user will pay for the order:
Summary of The order Total is not calculated correctly when the default number of
defect items is selected (1) and the amount is not correct when the number
of items is selected manually.
Severity High
Priority High
Main function / Calculation of the total amount to pay for the ordered items - T112
Test case
Screenshots
1
Defect ID D98
The Cart content view to allow the user to easily identify what items
will be ordered before proceeding with the order:
The Cart still contains the item that was deleted. Only the number
=”0”, but this view can be confusing for a customer, mainly when
they order many items in one order
Summary of
The Order Details page view to allow the user to easily identify what
defect
items have been ordered.
The Order Details page still contains the item that was deleted. Only
the number =”0”, but this view can be confusing for a customer,
mainly when they order many items in one order
Severity Medium
Priority Medium
Main function / Place an order for items in the shopping cart – T105
Test case
Screenshots
1
Challenges
While we successfully covered the high-priority features, there were a few areas where we faced challenges:
● Edge Cases in Input Validation: We missed a few scenarios in checking the contact details users entered,
which led to some issues being overlooked. These cases often come up when users enter unexpected inputs.
● Limited Time for Lower-Priority Tests: Due to time constraints, we couldn’t thoroughly test some
lower-priority features, like the visual layout and how quickly pages respond. While these may seem minor,
they still affect the overall shopping experience.
● Team Communication: Occasionally, our team could have communicated more effectively, which would
have helped us share findings faster and document issues more smoothly.
Lessons Learned
1. Be Thorough with User Input Checks: Going forward, we’ll pay more attention to input validation (like
checking email formats and phone numbers more strictly) since this directly impacts the accuracy of the
system and user experience.
2. Expand Test Scenarios: Including additional edge cases in our initial planning can help us catch more issues
upfront, reducing the chance of missing defects.
3. Improve Team Coordination: Consistent updates among team members will make it easier to track progress
and document any issues we find.
Future Approach
If we were to do this again, we’d:
● Create more tests specifically for unusual input scenarios to prevent similar issues.
● Schedule weekly meetings to share findings and discuss any roadblocks; this would ensure everyone is on the
same page.
● Dedicate additional time to lower-priority features, like page design and response speed, to ensure that the
system is functional and provides a smooth user experience.