LLM/Generative AI Interview Questions and Answers

Our course offers 100+ questions & 100+ Self-assessment

• Well Researched based on top companies interview questions like Google, Microsoft,
Meta and Fortune 500 companies
• Regular updates of the interview questions
• An average salary of $12,02,981 with potential to double
• 100+ self assessment questions to evaluate your LLM skill
• Community support, Q&A and quick query resolution

Access Course

Navigate Your Way to Your Next Job: Dive into Our Comprehensive LLM Interview Course
Curriculum! Estimated Duration: 40 Hours

1 How to navigate the course 1 lesson(s)

Navigate the course Free Preview View Lesson

2 Prompt Engineering & basic of LLM 17 lesson(s)

What is difference between Predictive/ Discriminative AI and generative

View Lesson
AI? Free Preview

What is LLM & how LLMs are trained? Free Preview View Lesson

What is token in language model? View Lesson

how to estimate the cost of running a SaaS-based & Open source LLM
View Lesson
model?

Explain Temperature parameter and how to set it? View Lesson

What are different decoding strategies for picking output token? View Lesson

What are different ways you can define stopping criteria in large lan-
View Lesson
guage model?

How to use stop sequence in LLMs? View Lesson

Explain basic structure of prompt engineering? View Lesson

Explain In-Context learning? View Lesson

Explain type of prompt engineering? View Lesson

What are some of the aspect to keep in mind while using few-shots
View Lesson
prompting?

What are certain strategies to write good prompt? View Lesson

What is hallucination & how can it be controlled using prompt engineer-

View Lesson
ing?

How do I improve reasoning ability of my LLM through prompt engineer-

View Lesson
ing ?

How to improve LLM reasoning if your COT prompt fails? View Lesson

Test yourself View Lesson


3 Retrieval augmented generation (RAG) Systems 6 lesson(s)

how to increase accuracy, and reliability & make answers verifiable in

View Lesson
LLM

How does Retrieval augmented generation (RAG) work? View Lesson

What are some of the benefits of using RAG system? View Lesson

What are architecture patterns you see when you want to customize your
View Lesson
LLM with proprietary data?

When should I use Fine-tuning instead of RAG? View Lesson

Test yourself View Lesson

4 Data Chunking 5 lesson(s)

What is chunking and why do we chunk our data? View Lesson

What are factors influences chunk size? View Lesson

What are different types of chunking methods available? View Lesson

How to find ideal chunk size? View Lesson

Test yourself View Lesson

5 Embedding Model 7 lesson(s)

What are vector embeddings? And what is embedding model? View Lesson

How embedding model is used in the context of LLM application? View Lesson

What is difference in embedding of short and long content? View Lesson


 How to benchmark embedding models on your own data? View Lesson

Scenario based question View Lesson

Walk me through steps of improving sentence transformer model used

View Lesson
for embedding?

Test yourself View Lesson

6 Vector DB 15 lesson(s)

What is vector DB? View Lesson

How vector DB is different from traditional database? View Lesson

How does a vector database work? View Lesson

Explain difference between vector index, vector DB & vector plugins? View Lesson

What is different vector search strategies? View Lesson

Scenario based question View Lesson

How does clustering reduce search space? When does it fail and how can
View Lesson
we mitigate these failures?

Explain Random projection index? View Lesson

Explain Locality-sensitive hashing (LHS) indexing method? View Lesson

Explain product quantization (PQ) indexing method? View Lesson

Compare different Vector index and given a scenario, which vector index
View Lesson
you would use for a project?

How would you decide ideal search similarity metrics for the use case? View Lesson


 Explain different types and challenges associated with filtering in vector
View Lesson
DB?

How do you determine the best vector database for your needs? View Lesson

Test yourself View Lesson

7 Search 15 lesson(s)

Why it’s important to have very good search View Lesson

What are the architecture patterns for information retrieval & semantic
View Lesson
search, and their use cases?

How can you achieve efficient and accurate search results in large scale
View Lesson
datasets?

Scenario based question View Lesson

Explain the keyword-based retrieval method View Lesson

How to fine-tune re-ranking models? View Lesson

Explain most common metric used in information retrieval and when it

View Lesson
fails?

Scenario based question View Lesson

I have a recommendation system, which metric should I use to evaluate

View Lesson
the system?

Compare different information retrieval metrics and which one to use

View Lesson
when?

How does hybrid search work? View Lesson

Scenario based question View Lesson


 How to handle multi-hop/multifaceted queries? View Lesson

What are different techniques to be used to improved retrieval? View Lesson

Test yourself View Lesson

8 Large Language Models 12 lesson(s)

Can you provide a detailed explanation of the concept of self-attention? View Lesson

Explain the disadvantages of the self-attention mechanism and how can

View Lesson
you overcome it.

What is positional encoding? View Lesson

Explain Transformer architecture in detail? View Lesson

What are some of the advantages of using a transformer instead of

View Lesson
LSTM?

What is the difference between local attention and global attention? View Lesson

What makes transformers heavy on computation and memory, and how

View Lesson
can we address this?

How can you increase the context length of an LLM? View Lesson

If I have a vocabulary of 100K words/tokens, how can I optimize trans-

View Lesson
former architecture?

Scenario based question View Lesson

Explain different types of LLM architecture and which type of architec-

View Lesson
ture is best for which task?

Test Yourslef View Lesson


9 Supervise Fine-tuning (SFT) LLM 12 lesson(s)

What is finetuning and why it's needed in LLM? View Lesson

which scenario do we need to finetune LLM? View Lesson

How to make the decision of fine-tuning? View Lesson

How do you create a fine-tuning dataset for Q&A? View Lesson

How do you improve the model to answer only if there is sufficient con-
View Lesson
text for doing so?

How to set hyperparameter for fine-tuning View Lesson

How to estimate infra requirements for fine-tuning LLM? View Lesson

How do you fine-tune LLM on consumer hardware? View Lesson

What are the different categories of the PEFT method? View Lesson

What is catastrophic forgetting in the context of LLMs? View Lesson

Explain different re-parameterized methods for fine-tuning LLM View Lesson

Test yourself View Lesson

10 Deployment 4 lesson(s)

Why does quantization do not decrease accuracy of LLM? View Lesson

What are the techniques by which you can optimize the inference of LLM
View Lesson
for higher throughput?

How to accelerate response time of model without attention approxima-

View Lesson
tion like group query attention? 
 Test yourself View Lesson

11 Hallucination 3 lesson(s)

What are the different forms of hallucinations? View Lesson

How do you control hallucinations at different levels? View Lesson

Test yourself View Lesson

12 Evaluation 5 lesson(s)

How do you evaluate the best LLM model for your use case? View Lesson

How to evaluate RAG-based system View Lesson

What are the different metrics that can be used to evaluate LLM View Lesson

Explain the Chain of verification View Lesson

Test yourself View Lesson

13 Agents 7 lesson(s)

Explain the basic concepts of an agent and the types of strategies avail-
View Lesson
able to implement agents

Why do we need agents and what are some common strategies to imple-
View Lesson
ment agents?

Explain ReAct prompting with a code example and its advantages View Lesson

Explain Plan and Execute prompting strategy View Lesson

Explain OpenAI functions strategy with code examples View Lesson


 Explain the difference between OpenAI functions vs LangChain Agents View Lesson

Test yourself View Lesson

14 Prompt Hacking 4 lesson(s)

What is prompt hacking and why should we bother about it? View Lesson

What are the different types of prompt hacking? View Lesson

What are the different defense tactics from prompt hacking? View Lesson

Test yourself View Lesson

15 Preference Alignment in LLMs 4 lesson(s)

At which stage you will decide to go for the Preference alignment type of
View Lesson
method rather than SFT?

What is RLHF, and how is it used? View Lesson

What is reward hacking? View Lesson

Explain different preference alignment methods View Lesson

16 Miscellaneous 8 lesson(s)

How to optimize cost of overall LLM System? View Lesson

What are mixture of expert models (MoE)? View Lesson

How to build production grade RAG system, explain each component in

View Lesson
detail ?

What is FP8 variable and what are its advantages of it View Lesson

 How to train LLM with low precision training without compromising on
View Lesson
accuracy ?

How to calculate size of KV cache View Lesson

Explain dimension of each layer in multi headed transformation atten-

View Lesson
tion block

How do you make sure that attention layer focuses on the right part of
View Lesson
the input?

17 Case Studies 2 lesson(s)

Case Study 1: LLM Chat Assistant with dynamic context based on query View Lesson

Case Study 2: Prompting Techniques View Lesson

18 Feedback 1 lesson(s)

Your feedback is invaluable to us! View Lesson

Well Researched based on top companies

