Effective .NET Memory Management: Build memory-efficient cross-platform applications using .NET Core

Effective .NET Memory Management

Copyright © 2024 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

Group Product Manager: Kunal Sawant

Publishing Product Manager: Teny Thomas

Book Project Manager: Manisha Singh

Senior Editor: Kinnari Chohan

Technical Editor: Vidhisha Patidar

Copy Editor: Safis Editing

Proofreader: Kinnari Chohan

Indexer: Pratik Shirodkar

Production Designer: Jyoti Kadam

DevRel Marketing Coordinator: Sonia Chauhan

First published: July 2024

Production reference: 1120724

Published by Packt Publishing Ltd.

Grosvenor House

11 St Paul’s Square

Birmingham

B3 1RB, UK

ISBN 978-1-83546-104-4

www.packtpub.com

I want to express my deepest gratitude to everyone who has supported me throughout this journey.

To my loving wife, your unwavering support and encouragement have been my rock. Your patience, understanding, and belief in me have made all the difference, and I am forever grateful for your presence in my life.

To my parents, thank you for investing in my education. Your sacrifices, guidance, and constant encouragement have shaped me into who I am today. Your belief in the power of education and hard work has been a driving force behind my achievements.

Thank you to my publishing partners for their patience and understanding during the dark days. Your support and dedication have been instrumental in bringing this book to life. I am grateful for your belief in this project and your unwavering commitment to its success.

To my students and colleagues, your enthusiasm and support have been a constant source of inspiration. Your eagerness to learn and collaborate has fueled my passion for teaching and developing innovative solutions. Thank you for being a part of this journey and believing in our shared vision.

This book is a testament to all these incredible individuals’ collective efforts and support. I am deeply grateful for every one of you.

Contributors

About the author

Trevoir Williams, a passionate software and system engineer from Jamaica, shares his extensive knowledge with students worldwide. Holding a Master’s degree in Computer Science with a focus on Software Development and multiple Microsoft Azure Certifications, his educational background is robust.

His diverse experience includes software consulting, engineering, database development, cloud systems, server administration, and lecturing, reflecting his commitment to technological excellence and education. He is also a talented musician, showcasing his versatility.

He has penned works like Microservices Design Patterns in .NET and Azure Integration Guide for Business. His practical approach to teaching helps students grasp both theory and real-world applications.

About the reviewer

Panagiotis Malamas is a Microsoft Certified Solution Developer/MCP, a senior full stack software engineer/architect, and an information security analyst. He has 15 years of experience in the IT industry, primarily in the UK, having worked in a plethora of industries and sectors.

He has a rare knack for building fancy PCs and is also a huge motorsports fan.

Table of Contents

Preface

1

Memory Management Fundamentals

Overview of memory management

Levels of memory management

Fundamentals of memory management and allocation

Units of memory storage

The fundamentals of how memory works

Automatic memory allocation in .NET

The role of the garbage collector

Garbage collection in .NET

Impact of memory management on performance

Impacts of poor memory management

Key considerations

Summary

2

Object Lifetimes and Garbage Collection

Technical requirements

Object allocation and deallocation

Objects and how they are created

Stack and heap allocation

Generations and the garbage collection process

Garbage collection in the LOH

Best practices for managing object lifetimes

Using local variables

Using statements

Use optimized data types and data structures

Use weak reference types for short-lived data

Use object pooling

Summary

3

Memory Allocation and Data Structures

Technical requirements

Memory allocation mechanisms

Allocation mechanisms in C/C++

Allocation mechanisms in Java

.NET allocation performance

Choosing the best data structures

Big O notation

Replacing classes with structs wherever possible

Using optimized collection types

Pre-sizing data structures

Accessing contiguous memory

Handling large objects and arrays

Using smaller objects

Optimizing string usage

Summary

4

Memory Leaks and Resource Management

Technical requirements

Identifying memory leaks

Common causes of memory leaks

Code review

Stress testing

Memory analysis in .NET

Visual Studio diagnostic tools

Analysis with the .NET CLI

Best practices for avoiding memory leaks

Using the using keyword with IDisposable objects

Implementing IDisposable and Finalizer patterns

Using Dependency Injection

Summary

5

Advanced Memory Management Techniques

Technical requirements

Concurrent memory management

Threads and thread pooling

Lock mechanisms

Task Parallel Library

SemaphoreSlim for task-based synchronization

PLINQ

Concurrent collections

Memory usage in multi-threaded applications

Single-threaded versus multi-threaded approaches

Parallel loops

Exception handling in multi-threaded applications

Memory management in asynchronous code

Creating and using asynchronous methods

Preventing memory leaks and best practices

Summary

6

Memory Profiling and Optimization

Technical requirements

Memory profiling concepts

Understanding and using profiling and tools

Profiling memory usage and allocation

Identifying allocation patterns with custom code

Make Object ID to find memory leaks

Event Tracing for Windows

Downsides of profiling

Writing unit tests for memory leaks

What is unit testing?

Testing for a memory leak

Production and deployment considerations

Using CI/CD pipelines

Monitoring cloud environments

Summary

7

Low-Level Programming

Technical requirements

Working with unsafe code

Pointers and pointer operations

Using the fixed statement

Allocating and deallocating unmanaged memory

Using the stackalloc keyword for stack allocation

Using the Marshal class for memory management

Interoperability with unmanaged code

P/Invoke

Using COM interop

Interop marshaling

Handling unmanaged resources with the SafeHandle class

Summary

8

Performance Considerations and Best Practices

Technical requirements

Memory management in desktop environments

Using Windows Forms

Using Windows Presentation Foundation

Memory management in web environments

Using ADO.NET

Using Entity Framework Core

Caching patterns in ASP.NET Core

Memory management in cloud environments

Multi-tenancy and memory management

Caching for memory management in cloud solutions

Summary

9

Final Thoughts

Index

Other Books You May Enjoy

Preface

In the dynamic world of software development, memory management is a critical yet often overlooked subject that significantly impacts the performance and reliability of applications. As developers, we are constantly seeking ways to optimize our code, reduce resource consumption, and enhance the efficiency of our applications. .NET, with its advanced garbage collection and memory allocation mechanisms, provides a robust environment for building high-performance applications. Still, it also requires a deep understanding of memory management to fully harness its potential.

Effective .NET Memory Management is designed to be your comprehensive guide to mastering the intricacies of memory management within the .NET framework. This book aims to demystify the complexities of garbage collection, memory optimization, and performance tuning, providing you with the knowledge and tools necessary to create efficient, high-performing applications.

.NET has become a key element of modern software development, powering various applications from enterprise-level systems to mobile apps. Its sophisticated memory management features, including automatic garbage collection, make it easier for developers to focus on writing code without worrying about low-level memory allocation and deallocation. However, to truly optimize the performance of .NET applications, a thorough understanding of these memory management mechanisms is essential.

Throughout this book, we will explore the fundamental concepts of .NET memory management, from the basics of the Common Language Runtime (CLR) and garbage collection to advanced memory profiling and optimization techniques. You will learn how to identify and resolve memory leaks, optimize memory usage, and apply best practices for efficient memory management in your .NET applications.

By the end of this book, you will have a solid understanding of how memory is managed in .NET and the skills to optimize your applications for maximum performance and reliability. Whether you are a novice developer or an experienced professional, Effective .NET Memory Management will equip you with the knowledge and expertise needed to take your .NET development skills to the next level.

Join me on this journey to uncover the secrets of .NET memory management and unlock the full potential of your applications. Let’s dive in and start optimizing!

Who this book is for

This book is crafted to serve a diverse range of readers involved in .NET development and seek to deepen their understanding of memory management. The target audience includes:

Software engineers: Professionals responsible for designing and implementing software systems will benefit from the advanced techniques and best practices discussed in this book, enabling them to build more robust and efficient applications

System architects: Those involved in the overall design and architecture of software systems will find the detailed exploration of .NET memory management essential for making informed decisions about system design and resource allocation

Technical leads and managers: Leaders who oversee development teams can use this book to ensure their teams follow best practices in memory management, leading to more reliable and high-performance software solutions

Students and educators: Individuals in academic settings, including students pursuing computer science or software engineering degrees and educators teaching .NET technologies, will find this book a valuable resource for learning and teaching memory management concepts

No matter your level of experience or specific role within the software development lifecycle, this book provides the knowledge and tools needed to master the intricacies of memory management in .NET, ultimately leading to the creation of more efficient, reliable, and high-performing applications.

What this book covers

Chapter 1

, Memory Management Fundamentals, helps begin our journey into the world of .NET memory management by laying the groundwork with essential concepts and principles. The chapter starts with an overview of the importance of effective memory management in software development, highlighting how it directly impacts application performance and reliability.

Chapter 2

, Object Lifetimes and Garbage Collection, dives deeper into the core mechanisms that govern memory management in the .NET framework, focusing on object lifetimes and garbage collection. Understanding how and when objects are created, used, and eventually discarded is crucial for developing efficient .NET applications.

Chapter 3

, Memory Allocation and Data Structures, dives into the critical concepts of memory partitioning and allocation within the .NET framework. Understanding how memory is divided and allocated is essential for optimizing application performance and preventing memory-related issues.

Chapter 4

, Memory Leaks and Resource Management, tackles one of software development’s most common and challenging issues: memory leaks. Understanding and preventing memory leaks is essential for maintaining the performance and stability of .NET applications. This chapter begins by defining what memory leaks are and how they occur in managed environments despite the presence of automatic garbage collection.

Chapter 5

, Advanced Memory Management Techniques, explores sophisticated strategies and techniques for optimizing memory management in .NET applications. Building on the foundational concepts in earlier chapters, this section focuses on high-level methods to enhance application performance, reduce memory consumption, and ensure efficient resource utilization.

Chapter 6

, Memory Profiling and Optimization, introduces techniques and tools essential for profiling and optimizing memory usage in .NET applications. The chapter explains the importance of memory profiling and how it helps identify inefficiencies and potential memory leaks that can degrade application performance.

Chapter 7

, Low-Level Programming, explores the intricate world of low-level programming within the .NET, offering a deeper understanding of memory management from a closer perspective. We explore how advanced developers can leverage low-level programming techniques to optimize memory usage and enhance application performance.

Chapter 8

, Performance Considerations and Best Practices, provides actionable insights, real-world examples, and practical guidelines to help developers build high-performing applications tailored to each specific environment. By the end of this chapter, readers will be equipped with a robust set of best practices and performance optimization techniques that can be applied to desktop, web, and cloud-based .NET solutions, ensuring their applications run smoothly and efficiently in any context.

Chapter 9

, Final Thoughts, reflects on the journey through the intricate world of .NET memory management. We revisit the key concepts and techniques discussed throughout the book, reinforcing the importance of effective memory management in developing high-performance, reliable .NET applications.

To get the most out of this book

To get the most out of this book, readers should ideally be familiar with .NET development and its core components is essential. Since C# is the primary language used for examples and exercises in this book, proficiency in C# programming is essential. A solid grasp of general programming concepts such as data structures (arrays, lists, dictionaries), control structures (loops, conditionals), and basic algorithms is necessary to understand and apply the memory management techniques discussed. Familiarity with development environments like Visual Studio, along with experience in debugging and profiling .NET applications, will enable readers to follow along with practical examples and exercises.

If you are using the digital version of this book, we advise you to type the code yourself or access the code via the GitHub repository (link available in the next section). Doing so will help you avoid any potential errors related to the copying and pasting of code.

Download the example code files

You can download the example code files for this book from GitHub at https://github.com/PacktPublishing/Effective-.NET-Memory-Management

. In case there’s an update to the code, it will be updated on the existing GitHub repository.

We also have other code bundles from our rich catalog of books and videos available at https://github.com/PacktPublishing/

. Check them out!

Conventions used

There are a number of text conventions used throughout this book.

Code in text: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: The developer called the GC.Collect() function, which forces a collection event.

A block of code is set as follows:

struct Point

{

    public int X;

    public int Y;

}

Bold: Indicates a new term, an important word, or words that you see onscreen. For example, words in menus or dialog boxes appear in the text like this. Here is an example: A variable is declared to have a type and a name.

Tips or important notes

Appear like this.

Get in touch

Feedback from our readers is always welcome.

General feedback: If you have questions about any aspect of this book, mention the book title in the subject of your message and email us at [email protected]

.

Errata: Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you have found a mistake in this book, we would be grateful if you would report this to us. Please visit www.packtpub.com/support/errata

, selecting your book, clicking on the Errata Submission Form link, and entering the details.

Piracy: If you come across any illegal copies of our works in any form on the Internet, we would be grateful if you would provide us with the location address or website name. Please contact us at [email protected]

with a link to the material.

If you are interested in becoming an author: If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, please visit authors.packtpub.com

.

Share Your Thoughts

Once you’ve read Effective .NET Memory Management, we’d love to hear your thoughts! Please click here to go straight to the Amazon review page

for this book and share your feedback.

Your review is important to us and the tech community and will help us make sure we’re delivering excellent quality content.

Download a free PDF copy of this book

Thanks for purchasing this book!

Do you like to read on the go but are unable to carry your print books everywhere?

Is your eBook purchase not compatible with the device of your choice?

Don’t worry, now with every Packt book you get a DRM-free PDF version of that book at no cost.

Read anywhere, any place, on any device. Search, copy, and paste code from your favorite technical books directly into your application.

The perks don’t stop there, you can get exclusive access to discounts, newsletters, and great free content in your inbox daily

Follow these simple steps to get the benefits:

Scan the QR code or visit the link below

https://packt.link/free-ebook/978-1-83546-104-4

Submit your proof of purchase

That’s it! We’ll send your free PDF and other benefits to your email directly

1

Memory Management Fundamentals

Memory management refers to controlling and coordinating a computer’s memory. Using proper memory management techniques, we can ensure that memory blocks are appropriately allocated across different processes and applications running in the operating system (OS).

An OS facilitates the interaction between applications and a computer’s hardware, enabling software applications to interface with a computer’s hardware and overseeing the management of a system’s hardware and software resources.

OSs orchestrate how memory is allocated across several processes and how space is moved between the main memory and the device’s disk during executions. The memory comprises blocks that are tracked during usage and freed after processes complete their operation.

While you may not need to understand all the inner workings of an OS and how it interacts with applications and hardware, it is essential to know how to write applications that make the best use of the facilities that OSs make available to us, so that we can author efficient applications.

In this chapter, we will explore the inner concepts of memory management and begin to explore, at a high level, the following topics:

The fundamentals of memory management

How garbage collection works

The pros and cons of memory management

The effects of memory management on application performance

By the end of this chapter, you should better appreciate the thought process that goes into ensuring that applications make the best use of memory, and you will understand the moving parts of memory allocation and deallocation.

Let’s begin with an overview of how memory management works.

Overview of memory management

Modern computers are designed to store and retrieve data during application runtimes. Every modern device or computer is designed to allow one or more applications to run while reading and writing supporting data. Data can be stored either long-term or short-term. For long-term storage, we use storage media such as hard disks. This is what we call non-volatile storage. If the device loses power, the data remains and can be reused later, but this type of storage is not optimized for high-speed situations.

Outside of data needed for extended periods, applications must also store data between processes. Data is constantly being written, read, and removed as an application performs various operations. This data type is best stored in volatile storage or memory caches and arrays. In this situation, the data is lost when the device loses power, but data is read and written at a very high speed while in use.

One practical example where it’s better to use volatile memory instead of non-volatile memory for performance reasons is cache memory in computer systems. Cache memory is a small, fast type of volatile memory that stores frequently accessed data and instructions to speed up processing. It’s typically faster than accessing data from non-volatile memory, such as hard disk drives (HDDs) or solid-state drives (SSDs). When a processor needs to access data, it first checks the cache memory. If the data is in the cache (cache hit), the processor can retrieve it quickly, resulting in faster overall performance. However, if the data is not in the cache (cache miss), the processor needs to access it from slower, non-volatile memory, causing a delay in processing.

In this scenario, using volatile memory (cache memory) instead of non-volatile memory (HDDs or SSDs) improves performance because volatile memory offers much faster access times. This is especially critical in systems where latency is a concern, such as high-performance computing, gaming, and real-time processing applications. Overall, leveraging volatile memory helps reduce the time it takes to access frequently used data, enhancing system performance and responsiveness.

Memory is a general name given to an array of rapidly available information shared by the CPU and connected devices. Programs and information use up this memory while the processor carries out operations. The processor moves instructions and information in and out of the processor very quickly. This is why caches (at the CPU level) and Random Access Memory (RAM) are the storage locations immediately used during processes. CPUs have three cache levels: L1, L2, and L3. L1 is the fastest, but it has low storage capacity, and with each higher level, there is more space at the expense of speed. They are closest to the CPU for temporary storage and high-speed access. Figure 1.1 depicts the layout of the different cache levels.

Figure 1.1 – The different cache levels in a CPU and per CPU core

Each processor core contains space for L1 and L2 caches, which allow each core to complete small tasks as quickly as possible. For less frequent tasks that might be shared across cores, the L3 cache is used and is shared between the cores of the CPU.

Memory management, in principle, is a broad-brush expression that refers to techniques used to optimize a CPU’s efficient