Big Data Analysis
Big Data Analysis
Big Data
Analysis
Created by Puspa Cempaka Sari
Big Data Type of Data
1. Sales Data per Customer (Point of Sales)
Date of Purchase Store_Code Store_Name Member_ID Transaction_ID Category PLU Description Quantity Net_Sales Gross_Margin
01/09/2018 02XX Store A XXX00400019XXXXX 02XX-700-0102XXXX RTD TEA 1036XX PRODUCT A 2 14545.46 6449.20
01/09/2018 02XX Store A XXX00400019XXXXX 02XX-700-0102XXXX COOKIES BISCUIT 1132XX PRODUCT X 1 8454.55 2601.01
01/09/2018 02XX Store A XXX00203880XXXXX 02XX-700-0105XXXX MINERAL WATER 1206XX PRODUCT G 1 3000.00 1166.68
01/09/2018 02XX Store A XXX00203880XXXXX 02XX-700-0107XXXX JELLY & PUDDING 1231XX PRODUCT I 1 9090.91 3727.22
01/09/2018 03XX Store B XXX00400020XXXXX 03XX-700-0105XXXX RTD COFFEE 1235XX PRODUCT M 2 8545.46 2360.56
01/09/2018 03XX Store B XXX00201287XXXXX 03XX-700-0106XXXX COLD DRINKS 1263XX PRODUCT Y 2 18182.00 10255.32
01/09/2018 03XX Store B XXX00201391XXXXX 02XX-700-0108XXXX RTD TEA 4064XX PRODUCT B 2 12727.27 4810.61
01/09/2018 04XX Store C XXX00201391XXXXX 04XX-700-0104XXXX PEANUTS 4075XX PRODUCT P 1 10909.09 3409.09
01/09/2018 04XX Store C XXX00204057XXXXX 04XX-700-0109XXXX CARBONATED DRINK 9900XX PRODUCT C 1 3181.82 352.29
01/09/2018 04XX Store C XXX00204057XXXXX 04XX-700-0109XXXX FUNCTIONAL DRINK 9901XX PRODUCT J 2 6363.64 1999.98
Average customers
per month:
341,363
341,363
3%
Product Purchasers % of Purchasers
Product A Purchasers 68%
Product B Purchasers 52%
Product C Purchasers 13%
Product C
Example of Big Data Analysis 7
Customers’ Profile based on The Product Purchase
Product A Purchasers Product B Purchasers Product C Purchasers Three Product
(Exclusive) (Exclusive) (Exclusive) Purchasers
(n=81,927) (n=139,959) (n=10,241) (n=3,414)
Gender
Category Purchasers Avg. Transaction* Avg. Quantity* Avg. Sales* Total Sales
HF - HM 2,524 2.7 1.7 50,462 127,366,088
LF - HM 2,290 1.5 2.8 50,980 116,744,200
LF - LM 3,738 1.5 1.2 50,535 188,899,830
Grand Total 8,552 1.9 1.9 50,659 433,010,118
* The central tendency using median score instead of the mean score, due to the non-normality data
distribution
❑ Among the existing purchasers, product A and B have the highest purchasers during June – Aug than other products
❑ Switching behavior indeed happened during the P6M period (Mar-Aug). Product A, B and D tend to be chosen when the purchasers decide
to switch
❑ However, Product A and B have more loyal purchasers than other flavor, while product C purchasers seem to be the least loyal
30 - 39 y.o 28%
❑ Majority of promotion
participants were either Male or 40 - 49 y.o 9%
20 – 29 y.o Males 47%
50 y.o and older 2%
Females
❑ They repeated their purchase 3
times per month and spent ±
IDR 45,000 per transaction
PURCHASE BEHAVIOR : PURCHASERS’
❑ Majority of the promo COMPOSITION
❖ Purchase 3 times/month
participants were new
purchasers or they started to ❖ Spend IDR ± 45,000/transaction
purchase in December 2015 or 55%
January 2016. Note: The data presented is a dummy
(n=24,121) (n=26,132)
Original Purchaser 45%
New Purchaser
Product G 40 53 33%
Product J 30 45 50%
Product K 20 24 20%
Product L 20 23 15%
P R O D U C T A P U R C H A S E R S (n=5,680)
Category Number Purchaser Repeat Purchaser Repeat Frequency
Variant C15 13% 15% 2.5 times Example of Big Data Analysis 19
Customers Basket Analysis
Among product A, purchasers also purchased : Objective:
Product M 75% Identifying product groups and items that
Product B 74% are most likely to be bought together, by
Product N 46% evaluating big data sets, such as purchase
Product O 39% history.
Product H 37%
Product D 37%
Product P 36%
Including the promotional set
package Product C 35% ❑ Most Product A purchasers also
Product Q 33% purchased Product M or Product B
Product G 32% along with Product A.
❑ The promotional package food might
cause this tendency during promotion.
Among Product C, purchasers also purchased : ❑ While for Product C, the purchasers
were more likely to purchase it with
Product A 54% Product A (54%) or Product D (43%).
Product D 43%
Product O 35%
Product Q 35% Note: The data presented is a dummy
Product B 35%
Product G 33%
Product H 33%
Variant C1 53%
Variant D1 45% Note: The data presented is a dummy
Variant D2 40%
Variant C2 38%
Variant D3 35%
Product N1 28%
Variant A2 23%
Variant C3 20%
(n=1,578) Variant Q1 15%
Variant D6 15%
200 purchaser/
day 248 purchaser/
day
❑ Even though the number of G1
transaction during the promotion
125 187
Purchased Purchased slightly decreased, but the proportion
Total
Purchaser G1/day G1/day is increase.
(63%) (75%)
❑ The total products purchased during
promotion, including total G1 items
purchased per day also increased.
900 transaction/
day 587 transaction/
day ※Concurrently, total G2 products
also increased.
Total
Transaction 480 Have G1 in
the list 450 Have G1 in
the list
(53%) (77%)
Note: The data presented is a dummy
2290 product/
day 3500 product/
day
800 1000
Total Product G1 product/ G1 product/
Purchased day day
(35%) (29%)
542,629
Existing Consumers
New Consumers
(Start purchase Ichitan before promotion period)
(Start purchase in the promotion period)
Exclusive purchaser Multi-variant Exclusive purchaser Multi-variant Exclusive purchaser Multi-variant Exclusive purchaser Multi-variant
to one variant purchasers to one variant purchasers to one variant purchasers to one variant purchasers
❑ This promotion generated 542,629 purchasers, of which 79% of them are first-time purchasers and 21% are existing consumers.
❑ 68% of the new consumers, however, made only one-time purchases, on the contrary, 34% (25% + 9%) made repeat purchases.
❑ New purchasers tend to be the exclusive purchasers of one variant while the existing purchasers use this promotion to buy multi-variant products
>P1M purchasers
135,505
111,119
62,651
56,474 81,582
Promo A Promo B
Average: Oct – Dec’18 Jan – Feb’19 Mar – May’19 Jun – Sep’19 Oct – Nov’19
❑ Compared to promo A, the repeat rate during the promo B
(Promo A) (Promo B)
period is slightly higher.
Repeat Rate 65% 72% 71% 77% 75%
❑ Promo B also generated higher purchase frequency and
Purchase Frequency 6.9 4.8 6.4 7.4 7.5 quantity during its promotion period.
Purchase Quantity 2.5 2.3 2.5 2.6 2.7 ❑ However, there is an indication that promo B already
created less excitement in the 2nd month of the campaign
Note: The data presented is a dummy
(given the decline of purchase freq. & basket size in Nov’19)
PROFILING :
(n=8,309) ❖ Majority of the promo participants
were the new purchaser (purchased
GENDER AGE since December 2015).
Below 10 y.o 1% ❖ Majority of the new purchasers were
10 - 19 y.o 15%
females, 20-29 y.o.
Males 46% ❖ 45% of them repeat their purchase,
20 - 29 y.o 45%
Females and 15% repeat at least once a week
30 - 39 y.o 22% for the rest of the campaign.
54%
40 - 49 y.o 12%
❖ They spent ± IDR 56,000 and
50 and older 5% purchase ± 8 items per transaction.
Note :
88% = 15,780/17,932; 12% = 2,152/17,932
74% = 5,698/7,700; 26% = 2,002/7,700
Example of Big Data Analysis 28
Most Contributing Purchasers to the Promotion
Promotion Cost Promotion sales
IDR 530,992,668 ± 66% IDR 350,717,680 ❑ During the campaign, the total sales
covered ± 66% of the promotion cost.
❑ The biggest sales comes from original
Original VS New Purchasers purchasers, which covered ± 35% of
the cost.
Contribution/
Type of Purchaser Total Purchaser Sales Contributed Contribution
purchasers ❑ Although the non regular purchasers
gave more contribution (total) to the
Original Purchaser 48% IDR 184,949,865 35% 0.005%
sales, but regular purchasers shows
New Purchaser 52% IDR 165,767,815 31% 0.004% higher contribution per purchasers.
This type of purchasers are small but
spent more money during the
campaign.
Non Regular VS Regular Purchasers
Note: The data presented is a dummy
Contribution/
Type of Purchaser Total Purchaser Sales Contributed Contribution
purchasers
Contribution/
Type of Purchaser Total Purchaser Sales Contributed Contribution
purchasers ❑ The previous slide show that original
purchaser gives more contribution
Original Purchaser 48% IDR 184,949,865 35% 0.005%
than new purchaser. It also shows that
Non Regular Purchaser 33% IDR 98,627,870 19% 0.005%
the regular purchasers gives more
contribution to the sales.
Regular Purchaser 15% IDR 86,321,995 16% 0.010%
❑ However, the cross analysis between
New Purchaser 52% IDR 165,767,815 31% 0.004% types of customers shows the new
and regular purchasers give more
Non Regular Purchaser 50% IDR 97,484,700 18% 0.004% contribution to the sales than other
type of purchasers
Regular Purchaser 2% IDR 68,283,115 13% 0.022%
New Purchasers
❖ Number of purchasers 3,560 purchasers 2,589 purchasers
Note: The data presented is a dummy
❖ Number of transaction 5,680 transaction 5,020 transaction
❖ Number of different Items purchased 6.25 item/transaction 6.89 item/transaction
❖ Amount of purchase ± IDR 35,000/transaction ± IDR 45,000/transaction
Generate Repeaters (New + Existing) 7,095 purchasers 18,029 purchasers 9,023 purchasers 60,232 purchasers 400,868 purchasers
A : 10,070 purchasers A : 25,248 purchasers A : 22,562 purchasers A: 87,958 purchasers A : 150,029 purchasers
B : 8,527 purchasers B : 20,086 purchasers B : 15,504 purchasers B : 70,790 purchasers B : 135,346 purchasers
Generate Exclusive Purchasers C : 8,026 purchasers C : 5,086 purchasers C : 5,121 purchasers C : 45,988 purchasers C : 55,354 purchasers
D : 8,635 purchasers
E : 9,787 purchasers
*Multiply by the sales percentage: 72.3% Note: The data presented is a dummy
❑ Both purchasers and repeaters were generated at the highest level in Nov (Promo D) and Apr(Promo E).
❑ In regard to the efficiency (per cost), however, neither of them (Promo D and E) were way too expensive. The new purchaser per cost for Nov was Rp.
28,771 and Promo E was Rp. 70,499. Repeater per cost for Nov was Rp. 100,849 and NWCP was Rp. 75,161. This means the newly acquired repeater for
Promo E must buy a minimum xx bottles, to break even. Example of Big Data Analysis 32
Purchaser’s Retention Rate
Purchasers Retention Rate measure the number of purchasers who
keep purchase the product until the end of specific period
(#𝑝𝑢𝑟𝑐ℎ𝑎𝑠𝑒𝑟𝑠 𝑖𝑛 𝑡ℎ𝑒 𝑒𝑛𝑑 𝑜𝑓 𝑝𝑒𝑟𝑖𝑜𝑑 − #𝑛𝑒𝑤 𝑝𝑢𝑟𝑐ℎ𝑎𝑠𝑒𝑟𝑠 𝑎𝑐𝑞𝑢𝑖𝑟𝑒𝑑 𝑑𝑢𝑟𝑖𝑛𝑔 𝑡ℎ𝑎𝑡 𝑝𝑒𝑟𝑖𝑜𝑑)
Purchasers Retention Rate = #𝑝𝑢𝑟𝑐ℎ𝑎𝑠𝑒𝑟𝑠 𝑎𝑡 𝑡ℎ𝑒 𝑠𝑡𝑎𝑟𝑡 𝑜𝑓 𝑡ℎ𝑎𝑡 𝑝𝑒𝑟𝑖𝑜𝑑
Total LY HL YY TM TH
Total Purchasers in Apr – May 415,976 245,914 231,524 123,159 47,130 21,236
Total Purchasers in June 181,217 92,048 88,812 44,434 52,718 41,356
New purchasers in June 97,320 61,873 60,728 34,077 49,072 41,140
Purchasers Retention Rate in June 20% 12% 12% 8% 8% 1%
New Purchasers in Apr – May 316,650 201,641 193,101 100,071 27,130 1,236
June Purchasers comes from new purchasers in Apr-May 58,924 30,027 29,599 17,150 3,646 216
New Purchasers Retention Ratio in June 19% 15% 15% 17% 13% 17%
❑ The higher retention rate of Promo A purchasers in June indicated that the enthusiasm to purchase the product was still high during the
campaign period, however, the enthusiasm didn’t last long, and it ended by the time the promotion was over.
Note: The data presented is a dummy
Example of Big Data Analysis 33
Store Evaluation
Evaluate the performances of each store to identify which store has the
highest contribution and which store needs improvement also analyze top
product to sell in each type of store
Store Code Total Sales Ratio Cum. ratio Store Code Total Sales Ratio Cum. ratio
Note: The data presented is a dummy
Store A 1,578,348,796 9% 9% Store T 385,344,200 2% 69%
Store B 1,340,527,778 7% 16% Store U 380,279,008 2% 71% The 15th Top contributor covers 60%
Store C 879,351,221 5% 21% Store V 364,478,903 2% 73% of the total sales, in which Store A,
Store D 815,224,579 4% 25% Store W 360,800,765 2% 75% Store B and Store C have the highest
contribution to the total sales.
Store E 679,192,344 4% 29% Store X 359,980,734 2% 77%
Store F 650,500,487 4% 32% Store Y 352,098,567 2% 79%
Store G 589,358,897 3% 35% Store Z 348,976,300 2% 81%
Store H 578,445,467 3% 39% Store AA 345,098,762 2% 83%
Store I 548,487,945 3% 41% Store AB 342,087,634 2% 84%
Store J 539,028,890 3% 44% Store AC 340,892,385 2% 86%
Store K 535,722,678 3% 47% Store AD 320,784,972 2% 88%
Store L 510,685,890 3% 50% Store AE 318,098,356 2% 90%
Store M 497,457,992 3% 53% Store AF 309,460,987 2% 91%
Store N 456,489,743 2% 55% Store AG 305,089,734 2% 93%
Store O 450,424,200 2% 58% Store AH 300,478,902 2% 95%
Store P 445,235,921 2% 60% Store AI 285,908,457 2% 96%
Store Q 435,724,792 2% 62% Store AJ 263,097,245 1% 98%
Store R 420,578,934 2% 65% Store AK 230,897,654 1% 99%
Store S 410,340,975 2% 67% Store AL 189,078,654 1% 100%
Indicators 3 Indicators 3
Indicators 1 Indicators 2
(Member average (average purchase per Name of Stores
(the most contributed) (Member average sales)
transaction) Member)
The top 15 contributing
Increased Increased Increased A57, YA, PI, MB, TA
stores
The top 15 contributing
Increased Increased Decreased K39, K42, CI, NN, AP, KW, RH, AC
stores
The top 15 contributing
Increased Decreased Increased AR
stores
The top 15 contributing
Increased Decreased Decreased SA
stores
Not the top 15 RO, AT, GM, BN, TM, PG, PA, K72, AS, BX, BR, K14,
Increased Increased Increased
contributing stores CL
Not the top 15
Increased Increased Decreased MA, MD, IR, SN, TR, NE, VA
contributing stores
Not the top 15
Decreased Increased Decreased BM, SM, GN
contributing stores
❑ Among the TOP 3 Stores (based on sales contribution), Product 1 and 2 has the highest number of purchasers
❑ Despite having a smaller number of purchasers and transaction, Product 6 and 7 has the highest sales due to their higher price rate
Note: The data presented is a dummy