What Is A GPU
What Is A GPU
Component Description
Thousands of simple arithmetic units (like CUDA Cores or Stream
Cores (ALUs)
Processors) to perform parallel operations.
Fast video memory used to store textures, frames, and data for
Memory (VRAM)
computation.
Memory Controller Manages data movement between VRAM and GPU cores.
Shader Units Handle different types of shading (vertex, pixel, geometry).
Render Output Units
Final stage that outputs the image to the screen.
(ROPs)
Cache Hierarchy L1, L2 caches to speed up memory access within the GPU.
1. The GPU receives a massive data set (like matrices in neural networks).
2. It splits the data into parallel threads.
3. Each core does its job in parallel.
4. The results are combined and returned to the CPU or storage.
📚 Types of GPUs
Type Use Case
Built into CPUs (e.g., Intel Iris, AMD Radeon Vega); good for casual
Integrated GPU
tasks.
Dedicated card (e.g., NVIDIA RTX, AMD Radeon); powerful for gaming,
Discrete GPU
AI, etc.
Workstation Optimized for stability, precision, and compute workloads (e.g., NVIDIA
GPU Quadro, AMD Radeon Pro).
Provided via cloud services (e.g., NVIDIA A100 on AWS/GCP); used for
Cloud GPUs
deep learning, simulations.
🧠 GPUs vs CPUs
Feature GPU CPU
Cores Thousands of simple cores Few complex cores
Parallelism Massive (SIMD) Limited (multi-threaded)
Speed Faster for parallel tasks Faster for sequential tasks
Use Cases Graphics, AI, simulation OS tasks, logic, control
🚀 Applications of GPUs
Domain Use Case
Gaming Real-time rendering, ray tracing
AI/ML Training neural networks (e.g., CNNs, transformers)
Crypto Mining Solving hash functions (e.g., Ethereum mining)
Medical Imaging MRI reconstruction, 3D modeling
Scientific Research Simulations (climate, chemistry, astrophysics)
Video Editing Real-time playback, encoding/decoding