EC2とVarnishで画像配信
•
11 likes•7,913 views
The document discusses using Varnish to cache images on EC2 instances to improve performance for a tofu image processing and delivery system. It describes challenges with using the default memory-only storage for Varnish and switching to a file-based persistent storage model. Using Varnish helped improve performance by caching images, reducing load on application servers and S3. Scaling out to multiple EC2 instances with Varnish and using an ELB provided further improvements and high availability.
EC2とVarnishで画像配信
- 1. EC2 Varnish
- 2. @mirakui
- 3. ※
- 4. BEFORE TOFU app app app apache apache
- 5. tofu
- 6. AFTER TOFU app app app tofu apache
- 8. http://tofu/recipes/ 1237075/100x141c/ 0b9c3ad1cba65869058e17cf78988bcb.jpg
- 10. DEMO
- 12. ! Apache module (mod_tofu.so) ! ImageMagick(Wand) ! Amazon S3
- 13. akamai (cdn) ELB Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
- 14. Akamai
- 15. 7000rps akamai (cdn) hit90% 700rps ELB Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
- 16. akamai (cdn) hit90% ELB 24 CACHE(?) hit60% Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
- 17. akamai (cdn) ELB Varnish Varnish Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
- 18. EC2+ Varnish
- 19. 1st challenge
- 20. 1st challenge EC2 m2.xlarge EBS (17.1GB mem) 100GB swap Varnish 2.1.5 storage: malloc, 100GB
- 21. m2.xlarge(17.1GB) varnish 2 + EBS(100GB swap) 300req/s 17.1GB + EBS100G 110GB 60% OS SWAP
- 24. 17.1GB Varnish swap LoadAverage →Varnish
- 26. 2nd challenge
- 27. 2nd challenge EC2 m2.xlarge EBS (17.1GB mem) 100GB ext3 Varnish 2.1.5 storage: file, 100GB
- 30. file storage OS
- 32. file storage OS restart
- 35. EC2 Varnish I/O
- 37. Varnish3 persistent storage restart file storage hash director varnish consistent hashing
- 38. …
- 39. instance cores memory price m1.large 2 7.5gb 23,904/ m1.xlarge 4 15gb 47,808/ c1.xlarge 8 7gb 47,808/ m2.xlarge 2 17.1gb 35,868/ m2.2xlarge 4 34.2gb 71,712/ m2.4xlarge 8 68.48gb 142,826/ ……
- 40. akamai (cdn) tofu ELB Varnish Varnish Apache Apache ApacheApache ApacheApache (mod_tofu) (mod_tofu) … (mod_tofu) (mod_tofu) (mod_tofu) (mod_tofu) S3
- 41. cache …
- 43. DISK I/O EC2 varnish m2.2xlarge file storage varnish