Computing Trends, Top Supercomputers &
PARAM Utkarsh Supercomputer
Enhance your research & business to next level
Sharada Group of Institutions, Mathura
CPSF Group
C-DAC, Bangalore
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Outline
C-DAC
Computing Top
About C-DAC PARAM HPC
Trends Supercomputers
Sustem
PARAM PARAM
Objectives and Applications &
Utkarsh Utkarsh
Key services Libraries
Supercomputer Security
Access to
AI software C-DAC HPC Conclusion
PARAM
stack Tools
Utkarsh
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Centre For Development Of Advanced Computing
(C-DAC)
➢ Established in 1988
➢ Spread over 12 cities about 3000 employees
➢ R&D organization under Ministry of Electronics &
Information Technology (MeitY)
➢ C-DAC has its presence across India with HQ at
Pune
Vision
To emerge as the premier R&D Institution for the design,
development and deployment of world class electronic and
IT solutions for economic and human advancement.
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC ACTIVITIES AND THEMATIC AREAS
Cyber
Security
Training
Secure H/W Smart
and VLSI Systems
R&D
Research and
Development C-DAC Consultancy Areas
AI/ML and High Perf
Big Data Computing
Solutions / Heritage
Services and
Management Language
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
CDAC’s Advanced Computing Training School (ACTS)
C-DAC's PG Diploma courses are fulltime courses of 900 hours For More details:
(30 weeks duration) with minimum 6 hours online/hybrid mode ➢ www.cdac.in
theory /practical sessions: ➢ acts.cdac.in
➢ Continuous lab and internal assessments during the
course. Contact Details:
➢ Centralised course-end examinations across centers 080-28523300
➢ Syllabus designed with the latest trends in the ICT 080-25093400
industry. 080-25093413
➢ Expert faculty from C-DAC and ICT industry with
widespread domain knowledge. Email:
➢ Tutorials, hands-on and projects relevant to the ➢
[email protected] standards of the ICT industry. ➢
[email protected] ➢ Special training on aptitude, communication and
interview skills.
➢ Extensive placement orientation and Campus placement
facilities
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Computing Trends
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC PARAM HPC Systems
First Indigenous Supercomputer PARAM Padma, 1Teraflop PARAM Yuva II PARAM Shavak
Amazed the World in 1991 Supercomputer in 2002 500 Teraflops in 2013
PARAM 8000
PARAM Siddhi – AI
5.26 Petaflops
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
High performance computing
High performance computing (HPC) is the ability to process data and perform
complex calculations at high speeds. One of the best-known types of HPC solutions
is the supercomputer. A supercomputer contains thousands of compute nodes that
work together to complete one or more tasks. This is called parallel processing. It’s
similar to having thousands of PCs networked together, combining compute power
to complete tasks faster.
HPC is the foundation for scientific, industrial, and societal advancements.
Performance is measured as Floating-point Operations per second (Flops) -
Teraflops ( Trillion), Petaflops ( one quadrillion)
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Supercomputers
1) A supercomputer is a computer system best
known for its high computational speed, fast and
large memory systems, and the extensive use of
parallel processing.
2) To speed up the operation, the components are
packed tightly together to minimize the distance that
the electronic signals have to travel.
3) This is augmented by instructions that process
vectors and combinations of scalars and vectors.
4) A typical supercomputer has a basic cycle time of
4 to 20 ns.
5) Supercomputers were designed and built to work
on extremely large jobs that could not be handled
by no other types of computing systems.
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
TOP Supercomputer
http://topsc.cdacb.in (Jan 2024)
• AIRAWAT – PSAI, C-DAC Pune, 13.17PF (Rank 90 in
Top500)
• PARAM SIDDHI-AI, C-DAC Pune, 5.2 PF (Rank 163 in
Top500)
• Pratyush HPC cluster, Indian Institute of Tropical
Meteorology (IITM), 4 PF (Rank 201 in Top500)
https://www.top500.org/ (Nov 2023)
• Frontier, Oak Ridge National Laboratory, US, 1,679.82
PFlops/s
• AURORA, DOE/SC/Argonne National Laboratory, US,
1059.33 PFlops/s
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
HPC use cases
PARAM Utkarsh HPC solutions are used for a variety of purposes across multiple industries.
Examples include:
1. Research labs. HPC is used to help scientists find sources of renewable energy, understand the
evolution of our universe, predict and track storms, and create new materials.
2. Media and entertainment. HPC is used to edit feature films, render mind-blowing special effects,
and stream live events around the world.
3. Oil and Gas research. HPC is used to more accurately identify where to drill for new wells and to
help boost production from existing wells.
4. Artificial intelligence and machine learning. HPC is used to detect credit card fraud, provide self-
guided technical support, teach self-driving vehicles, and improve cancer screening techniques.
5. Financial services. HPC is used to track real-time stock trends and automate trading.
6. New product design. HPC is used to design new products, simulate test scenarios, and make sure
that parts are kept in stock so that production lines aren’t held up.
7. Health Care. HPC is used to help develop cures for diseases like diabetes and cancer and to
enable faster, more accurate patient diagnosis.
Reference: https://www.netapp.com/data-storage/high-performance-computing/what-is-hpc/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
PARAM Utkarsh Supercomputer
The PARAM Utkarsh Supercomputing
PARAM Utkarsh is a HPC system setup
facility is dedicated for Micro, Small
at C-DAC PARAM Supercomputing
and Medium Enterprises (MSME). This
Facility (CPSF) Data Centre, C-DAC,
initiative supports the government’s
Bangalore under National
vision “Digital India” and “Make in
Supercomputing Mission (NSM)
India”
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Overview
PARAM Utkarsh - High Performance Computing System
setup at C-DAC, Bangalore under the National
Supercomputing Mission (NSM), Government of India.
• Intel Xeon SKL processor, Nvidia GPU V100, having
combined peak performance of 850 Teraflops
• Equipped with 50,000+ compute cores (CPU & GPU),
• 146 Compute Nodes connected through 100Gb/s HDR
Infiniband
• DCLC technology using Adiabatic Dry cooling system for
effective PUE
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Key Services
HPC SERVICES MODELLING & MACHINE TRAINING
SIMULATION LEARNING, DEEP
LEARNING AND AI
SERVICES
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Features
Availability of uninterrupted compute resource, software stack and
various business models
MSMEs/Users need not invest on IT infrastructure and
maintenance
Secure and seamless access to computer resources from anywhere
Provision for commercial softwares
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
BMS – Building Management System
➢ Integrated systems in BMS
➢ Generator (1+1 redundant)
➢ UPS (n+1 redundant)
➢ Precision Air Conditioning – PAC (n+1 redundant)
➢ Fire Alarm System - FAS (VESDA and NOVEC)
o Very Early Smoke Detection Apparatus – VESDA
o NOVEC- Fire suppresser
➢ Dry cooler (Adiabatic)
➢ Temperature and humidity sensors
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
System Architecture
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
System Details
Parameter CPU only(75) GPU Nodes(10) HM Nodes(39)
Processor 2 x Xeon platinum 2 x Xeon G-6248 2 x Xeon platinum
8268 8268
Cores 48 40 48
Speed 2.9 GHz 2.5 GHz 2.9 GHz
Memory 192 GB 192 GB 768 GB
HDD 480GB SSD 480GB SSD 480GB SSD
Total cores 3600 400 1872
Total 14400 GB 1920 GB 29952 GB
Memory
- 2 x NVIDIA V100 -
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
PARAM Utkarsh Security
➢ Perimeter Firewall (Unified Threat
Management -UTM)
➢ Cluster Firewall
➢ (High Availability -HA load balancer
and Intrusion prevention system-IPS)
➢ Geographical filtering
➢ Isolated Network
➢ Secured authentication
➢ Physical security with ACS (access
control system)
➢ CCTV surveillance (24/7)
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
System Software Details
➢ Operating System:
Linux- Cent OS 7.9
➢ Local Resource Manager-Scheduler:
SLURM
➢ Communication Libraries :
Intel MPI, Open MPI, MVAPICH2
➢ Development Tools:
Intel Cluster studio, GNU, CUDA Toolkit
➢ Application Libraries:
NetCDF / HDF, Math Libraries, Python Libraries, GNU Scientific Library, ML/DL Framework
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Applications, Tools, Programming Models- AI & HPC
Bio-informatics MUMmer, HMMER, MEME, PHYLIP, Visualization GrADS, ParaView, VisIt,
mpiBLAST, ClustalW
Programs VMD
NAMD (CPU & GPU), Dependency NetCDF, PNETCDF, Jasper,
HPC Applications
Molecular Dynamics LAMMPS(CPU & GPU), GROMACS
Libraries HDF5, Tcl, Boost, FFTW
Material Modeling, Quantum-Espresso, Abinit,
Quantum Chemistry CP2K, NWChem, Programming MPI, OpenMP, OpenACC,
CFD OpenFOAM, FDS, SU2 Models CUDA, PGAS, Pthreads
Weather, Ocean,
WRF, RegCM, MOM, ROMS Additional applications, libraries, tools as
Climate
per requirements from users will be
Disaster deployed
ANUGA Hydro
Management
AI/ ML/ DL DL Frame work: TensorFlow , keras, theano, pytorch, scikit-learn,scipy, cuDNN
Tools/ Data Science: Numpy , RAPIDS
Technologies Distributed DL Framework : TensorFlow with Horovod
Container Technology : enroot
C-DAC,Bengaluru JupyterHub: DL application development
© C-DAC All Rights Reserved platforms and web based IDE
https://paramutkarsh.cdac.in/
AI software stack & applications on PARAM Utkarsh
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
AI software stack & applications on PARAM Utkarsh
In PARAM Utkarsh, all major AI packages are installed along with Python program, which are
required for development of AI application/Models. All these are deployed on top of current
PARAM Utkarsh software stack:
1. Scikit learn: Machine learning models
2. NumPy & pandas: Data pre-processing
3. Matplotlib & seaborn: Data visualization
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Modules for AI application development
Following Modules are available on PARAM Utkarsh for AI application development with Python:
1. anaconda3/anaconda3
2. anaconda3/tensorflow
3. anaconda3/pytorch
On loading the one of the above module, python x.y environment will be set with selected Deep Learning
library and the important python packages.
To build ML application, where scikit learn, XGBoost, is required then anaconda3 can be used.
Similarly based on user requirement tensorflow or pytorch can be used.
The tensorflow and pytorch are trained models using GPUs in the backend. Hence installation of tensor
flow and pytorch to be configured using GPUs. They develop the models with the power of GPUs
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
PARAM Utkarsh Tools
1) CAPC - C-DAC Automatic Parallelizing Compiler
2) CHAP - C-DAC HPC Application Profiler
3) ParaDE - Parallel Development Environment
4) PUSP – Param Utkarsh Service Portal
5) Suparikshan - Cluster monitoring and management tool
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
C - D A C A u t o matic Par allelizing Co m piler (CA PC)
Automatically converts sequential programs to
equivalent parallel programs for the target parallel
architectures
Highlights:
1) Support for multiple parallel programming paradigms
2) Automatic parallelization of code without any
inputs/hints from users
3) Target languages supported currently - OpenMP3.0,
OpenMP 4.5, OpenCL and OpenACC
37 https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved
C H A P – C - D A C H PC A pplicatio n Pr o fi ler
Insights on the application performance behavior at the cluster level and process level
Major Features
1) Application Performance Summary
2) Guided profiling
3) Hotspot identification
4) Multi-dimension analysis
5) Minimal overhead in profiling
6) Potential Performance suggestions
7) Integration with LRMs
8) Access via web interface
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Pa r a DE (Parallel D e ve lo pment En vi r o nmen t)
It is an Integrated Development Environment -IDE for HPC which facilitates application
development on HPC platform from anywhere and anytime
Major Features
1) Support multiple paradigms like MPI, OpenMP, CUDA, OpenACC under a single
project
2) Released versions support C, C++ and Fortran. Python support is under
development
3) Automatic compilation with a single click
4) Assisted job submission to HPC
5) Provision to add custom compilers, libraries and tools
6) Version Control System
7) Access to development tools (debuggers, profilers, converters) available on the
platform
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Pa r a m Ut k ar sh Se r vi ce Po r tal (PUSP)
Unified interface to access all services offered in HPC.
Highlights
1) Hides complexities of HPC
2) Gives a desktop like experience for Supercomputer
3) Entire lifecycle of HPC is supported in this tool
4) Improves programmer / user productivity
5) Real time system resource information
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
https://paramutkarsh.cdac.in/
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
For collaboration, training, resources and services, please write to:
[email protected] Follow PARAM Utkarsh at:
➢ Facebook
➢ Instagram
➢ LinkedIn
➢ Twitter
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
For MSMEs & Startups PARAM Utkarsh is a way towards
• AatmaNirbhar Bharat
• Digital India
• Make in India
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
Thank you
C-DAC,Bengaluru © C-DAC All Rights Reserved https://paramutkarsh.cdac.in/
