24 July, Class Notes - 01
24 July, Class Notes - 01
How LLMs Work LLMs operate using neural network architectures, particularly transformers. The key
components of LLMs include:
1. Training Data: LLMs are trained on extensive datasets, which may include books, articles, websites,
and other text sources.
2. Tokenization: Text is divided into smaller units called tokens. These can be words or subwords.
3. Model Architecture: The core architecture involves transformers, which use self-attention
mechanisms to weigh the importance of different words in a sentence.
4. Training Process: The model learns by predicting the next word in a sentence, adjusting weights
to minimize prediction error across the dataset.
5. Inference: Once trained, the model can generate coherent text, answer questions, summarize
information, and more by analyzing the input and generating appropriate responses.
Generative AI
What is Generative AI?
Generative AI is a subset of artificial intelligence that focuses on creating new, original content rather than
simply analyzing or acting on existing data. It leverages various techniques, including Large Language
Models (LLMs), diffusion models, and Generative Adversarial Networks (GANs), to produce a wide range of
outputs like text, images, music, and even videos.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[1]
Tabular Comparison: Generative AI vs. Traditional AI
Purpose To create new content To analyze and make decisions based on existing data
Methods LLMs, diffusion models, GANs Machine learning, rule-based systems, expert
systems
Examples GPT-3 (text), DALL-E 2 (images), Fraud detection systems, medical diagnosis tools,
MuseNet (music) recommender systems
Focus Primarily on text-based tasks such as Includes LLMs but also extends to generating
translation, summarization, question- images, music, videos, and other forms of
answering, and text generation. content.
Technology Relies heavily on transformer architecture Employs various models and algorithms
and deep learning techniques to process depending on the type of content being
and generate text. generated, including LLMs, diffusion models,
and GANs.
Applications Chatbots, virtual assistants, language Content creation (text, images, music,
translation tools, content creation tools, videos), drug discovery, material design, art
search engines. generation, and more.
Strengths Excellent at understanding and generating Capable of generating creative and diverse
human-like text, contextually relevant content across various modalities, pushing
responses, and language-based tasks. the boundaries of what's possible.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[2]
Regulating AI
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[3]
4. Quantum Decoherence: The loss of quantum coherence, where quantum systems lose their
quantum behavior and transition into classical states due to interaction with their environment.
E.g. A qubit losing its superposition state due to external noise or interference.
5. Quantum Gate: A basic quantum circuit operating on a small number of qubits. They are the
building blocks of quantum circuits, similar to classical logic gates in classical circuits.
The National Quantum Mission (NQM) of India is an initiative aimed at advancing the country's quantum
technology capabilities. The mission focuses on various aspects of quantum science and technology to
position India as a leader in this emerging field.
Key Components
1. Quantum Computing
2. Quantum Communication
3. Quantum Sensing and Metrology
4. Quantum Materials and Devices
Phases
1. Phase 1 (2023-2026):
Setting up of quantum research and development centers.
Development of initial quantum computing and communication prototypes.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[4]
Training and development of skilled quantum scientists and engineers.
2. Phase 2 (2026-2030):
Scaling up quantum technologies developed in Phase 1.
Establishing large-scale quantum communication networks.
Expanding the application of quantum technologies in various sectors.
3. Phase 3 (Beyond 2030):
Achieving advanced quantum computing capabilities.
Global deployment of quantum communication and sensing technologies.
Continued innovation and commercialization of quantum technologies.
Quantum Communication
Introduction
Quantum communication utilizes the principles of quantum mechanics to transmit information securely.
It offers enhanced security over classical communication methods, primarily through Quantum Key
Distribution (QKD).
How Quantum Communication is Done: Step-by-Step
1. Quantum State Preparation
2. Quantum Transmission
3. Quantum Measurement
4. Classical Communication
5. Key Verification
6. Error Estimation
7. Error Correction
8. Message decoded
Quantum Dots
1. Definition: Quantum dots are tiny particles, typically 2-10 nanometers in diameter, composed of
semiconductor materials. Their size and shape allow them to exhibit quantum mechanical
properties, leading to discrete electronic states and size-dependent optical properties.
2. Materials: Common materials for quantum dots include cadmium selenide (CdSe), cadmium sulfide
(CdS), indium phosphide (InP), and lead selenide (PbSe).
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[5]
3. Bandgap Energy:
The energy difference between the valence band and the conduction band in a
semiconductor.
In quantum dots, the bandgap energy increases as the size of the dots decreases, affecting
their optical properties.
4. Quantum Yield:
The efficiency of photon emission after excitation.
High quantum yield means brighter emission, making quantum dots useful for display and
imaging applications.
5. Surface Passivation:
The process of coating the surface of quantum dots to improve their stability and optical
properties.
Enhances the performance and longevity of quantum dots in various applications.
Introduction
Blockchain technology is a decentralized digital ledger system that records transactions across multiple
computers so that the records cannot be altered retroactively without the alteration of all subsequent
blocks. It ensures transparency, security, and efficiency in digital transactions and has applications across
various sectors.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[6]
3. Immutability: Once a transaction is recorded on a blockchain, it cannot be altered or deleted,
ensuring data integrity.
E.g. IBM Food Trust uses blockchain to ensure the immutability of data related to food supply
chains.
4. Efficiency: Blockchain reduces the need for intermediaries, streamlining processes and reducing
transaction times. E.g. Financial services use blockchain for faster cross-border payments and
reduced processing times.
5. Decentralization: The decentralized nature of blockchain eliminates the need for a central
authority, reducing the risk of central points of failure.
E.g. Ethereum’s smart contracts operate on a decentralized network, executing agreements
without intermediaries.
Blockchain Validation
Blockchain validation is the process of verifying and confirming the legitimacy of transactions before they
are added to the blockchain ledger. This ensures the integrity and security of the blockchain network.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[7]
3. Consensus: Different blockchains use different consensus mechanisms to ensure agreement
among nodes.
Key Differences
Feature Proof of Work (PoW) Proof of Stake (PoS)
Core Action Miners solve complex cryptographic Validators are chosen randomly based on
puzzles (energy-intensive). their stake (energy-efficient).
Validation Miners verify the solution and block's Validators attest to the validity of
validity. proposed blocks.
Reward Block reward (newly minted coins) + Transaction fees (+ sometimes newly
transaction fees. minted coins).
Resource High computational power and energy Low computational power and energy
Intensity consumption. consumption.
Decentralization Highly decentralized, but can lead to Potentially less decentralized if stake is
mining pools and centralization. concentrated among a few.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[8]
Parameter Proof of Work (PoW) Proof of Stake (PoS)
Energy Consumption High (e.g., Bitcoin ~100 TWh/year) Low (e.g., Ethereum 2.0 ~1/10,000th of
PoW)
Transaction Speed Slower (e.g., Bitcoin ~7 TPS) Faster (e.g., Ethereum 2.0 ~100,000
TPS)
Security High, but vulnerable to 51% attack High, less vulnerable to 51% attack due
to high economic cost
Environmental Impact High, significant carbon footprint Low, minimal carbon footprint
Cost of Attack High, requires significant energy and High, requires purchasing majority of
hardware investment stake
Innovation and Slower to adapt due to hardware Faster to adapt due to software
Adaptability reliance flexibility
Answer Writing
Role of AI in development of India
1. Agriculture:
Application: Precision farming, crop monitoring, and yield prediction.
AI techniques like machine learning and computer vision analyze data from satellites, drones,
and ground sensors to provide actionable insights for farmers.
Example: Microsoft's AI for Agriculture program in India uses machine learning algorithms to
analyze soil health, weather conditions, and historical yield data to predict optimal sowing
dates and fertilizer requirements.
2. Healthcare:
Application: Disease diagnosis, treatment planning, and drug discovery.
Deep learning algorithms analyze medical imaging data for disease detection, while natural
language processing (NLP) techniques extract insights from electronic health records for
predictive diagnostics. - Earlier disease detection, personalized treatments, and improved
healthcare access in rural areas.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[9]
Example: Bengaluru-based Niramai uses AI-powered thermal imaging and machine learning
for early-stage breast cancer detection, with an accuracy rate of 90%.
3. Education:
Application: Personalized learning, automated assessment, and educational accessibility.
Adaptive learning algorithms process student performance data to create tailored learning
paths, while NLP powers intelligent tutoring systems and automated grading - Improved
learning outcomes, reduced dropout rates, and enhanced skill development;
Example: AI algorithms to analyze students' learning patterns and provide personalized study
plans, leading to a reported 93% improvement in exam scores.
4. Smart Cities and Urban Planning:
Application: Traffic management, energy optimization, and public safety.
Machine learning algorithms process data from IoT sensors for predictive maintenance of
infrastructure, while computer vision analyzes CCTV footage for traffic and safety
management.
Example: Pune Smart City has implemented an AI-based adaptive traffic control system that
has reduced travel time by 25-30%.
5. Manufacturing and Industry 4.0:
Application: Predictive maintenance, quality control, and supply chain optimization.
Justification: Machine learning models analyze sensor data for predictive maintenance, while
computer vision systems perform automated quality checks. Reinforcement learning
algorithms optimize supply chain logistics.
Example: Tata Steel uses AI-powered predictive maintenance, reducing downtime by 30% and
improving operational efficiency.
6. Financial Services:
Application: Risk assessment, fraud detection, and personalized financial services.
Justification: Machine learning algorithms analyze vast amounts of financial data for credit
scoring and fraud detection. NLP powers chatbots for customer service, while deep learning
models process market data for algorithmic trading.
Example: State Bank of India's AI-powered chatbot, SIA, handles over 10,000 customer
queries per second with 85% accuracy.
7. Environmental Protection and Climate Change Mitigation:
Application: Environmental monitoring, disaster prediction, and resource optimization.
Justification: Deep learning models analyze satellite imagery and sensor data to monitor
environmental changes and predict natural disasters. Reinforcement learning algorithms
optimize resource allocation for conservation efforts.
Example: The Indian Institute of Tropical Meteorology uses AI models to improve monsoon
forecasting accuracy by 60%.
8. E-Governance
Public Service Delivery: AI enhances the efficiency and transparency of public service delivery,
from issuing documents to handling citizen grievances.
Example: The Government of Andhra Pradesh uses AI to monitor the performance of
government schemes and services through its Real Time Governance Society (RTGS).
Predictive Governance: AI tools predict and mitigate issues such as crime, natural disasters,
and infrastructure failures, enabling proactive governance.
Example: The Telangana government uses AI to predict water levels in reservoirs and manage
water resources effectively.
Forum Learning Centre: Delhi - 2nd Floor, IAPL House, 19 Pusa Road, Karol Bagh, New Delhi - 110005 | Patna - 2nd floor, AG Palace, E Boring Canal
Road, Patna, Bihar 800001 | Hyderabad - 1st & 2nd Floor, SM Plaza, RTC X Rd, Indira Park Road, Jawahar Nagar, Hyderabad, Telangana 500020
9311740400, 9311740900 | https://academy.forumias.com | [email protected] | [email protected]
[10]