How Node.js overcome the problem of blocking of I/O operations ?
Last Updated :
16 Feb, 2022
Node.js uses non-blocking I/O, the mechanism that allows you to have a single thread of execution running your program. If Node.js had to use blocking I/O, you wouldn't be able to do anything else while waiting for an I/O to complete. Below is an example image of what happens when Node.js needs to use blocking I/O:
Blocking vs Non-blocking I/O operation
The Node.js project includes a JavaScript engine, event loop, and I / O layer. It is often referred to as a non-blocking web server.
Note: "I/O" generally refers to the interaction between the system's disk and network and is supported by libuv.
Why was blocking I/O operations an issue?
In traditional programming languages like C and PHP, all of the instructions are blocked by default unless you explicitly "enable" it to perform asynchronous operations. Let's say you make a network request to read some data or you may want to read some file and want to display its data to the user, but then the execution of that said thread is blocked, until the answer response is ready but to solve this problem to of blocking of I/O stream JavaScript allows you to create asynchronous and non-blocking code in a very simple way, by using a single thread, call-back functions, and event-driven programming.
Let us see with an example to better understand this!
Example 1: Following example uses the readFileSync() function to read files and demonstrate Blocking in Node.js:
JavaScript
// The fs module provides access to
// interact with the file system.
const fs = require('fs');
const data = fs.readFileSync('/sample.txt');
/*This line of code will block the main thread,
until the file is read.*/
console.log(data);
console.log("This is a beautiful message");
console.log("This code is doing some great work")
Output:
This data is from the text file
This is a beautiful message
This code is doing some great work
Explanation: In the above example, we see that the Blocking method executes synchronously [or you can say line by line]. Now you see that each line of code waits for the previous line to be executed for the result which can become a problem especially with slow operations like reading or updating or you can say operation related to I/O, because each line blocks the execution of the rest of the code and we say that it is blocking code as the next line of code can only be executed after the one before has finished and because how Node.js was designed this turned out to be a huge problem which leads us to the non-blocking methods which execute the code asynchronously means that the code is not executed line by line but rather callbacks are used to achieve this non-blocking behavior. Below is the same example, we used above to describe synchronous behavior but now we have modified it using the Call-back function to make it asynchronous.
Example 2: Following example uses the readFile() function to read files and demonstrate Non-Blocking in Node.js
JavaScript
const fs = require('fs');
// This piece of code doesn't block the main thread
// but will run after the file is completely read.
fs.readFile('/sample.txt', (err, data) => {
if (err) throw err;
else {
// Call-back function
console.log(data);
}
});
console.log("This is a beautiful message");
console.log("This code is doing some great work")
Output:
This is a beautiful message
This code is doing some great work
This data is from the text file
Note: In the above example, we see that in the non-blocking method the console, actually prints the messages before the content of the file. This is because the program does not wait for the readFile() function to return and move to the next operation making it async. And when the readFile() function returns it prints the content of the text file.
How did node.js solve the problem?
You may have heard about this concept called non-blocking I/O and how Node.js uses it to solve the problem of blocking calls and to run super-fast, but what non-blocking I/O is, and why does it help? We will understand this later but first, you need to understand how servers and threads work along the way and how servers handle requests, Before moving onto node.js let's talk about servers and threads as an overview.
The server is nothing but what takes requests, and do some work to calculate the response needed to be sent back, For example when you get to google.com you send an HTTP request to a Google server that calculates the HTML response you should see on your browser homepage. But on the inside the server is splitting the work between one or more threads inside [a thread can be considered as a single worker], processing the requirements and requests of other users at the same time without blocking the main thread.
We can explore this using a restaurant as an analogy, here in a frequently visited restaurant there is only one waiter because it is not very popular, the customer tends to come one by one the waiter serves each party before moving on to the next one as the waiter finishes a party it is either waiting for more customers or switching to another this example works well for describing servers.
Synchronous vs Asynchronous
The restaurant we just mentioned is like a server with the frequency of getting requests and the waiter is just like a thread and the request is like customers.
Now imagine if two parties enter the restaurant at the same time and a waiter can only serve one person at a time, but that's not the case, see while the customers are busy with the menu they don't need your help, so the waiter can move or you can say switch between tables and help both at the same time as each needs help without making someone stand or wait for their turn.
Well, what happens when both of the friends need help at the same time, then one needs to wait a little longer than if it's just one party. The basic idea here is that a waiter can serve more than one table at a time because each table has some downtime.
All of this applies to servers and Node JS as well!
Just like a table we need help with time request processing, there is also a part that requires active attention and the part that does not require active attention generally it is called CPU work as it requires the central processing unit of the computer where we spend time thinking and calculating results.
The CPU work requires a thread to process it like a table that requires a waiter to process it, but the part that doesn't require activation attention is called I/O because it was waiting for something else to provide input or send output.
Here's the exit part, just as the waiter can save time by changing the table, the same blocking allows the thread to sabotage time by changing the request, when a request makes an I/O it greatly increases the amount of effective work the I/O can do!
Note: So, the solution to this problem in node.js is to use asynchronous non-blocking code and Node.js uses an event loop for this. "An object that handles and processes external events and converts them into call-back calls" is what an event loop is.
Non-blocking I/O event-loop
When data is needed, Node.js logs a callback and sends the action to this event loop. The callback is called when data is available. So basically, we are offloading the heavy workload to run in the background, and then when the job is done a callback function is called to process the result, we saved earlier, and during this time the rest of the code is still executable while the currently blocked heavy task is running in the background.
In a nutshell:
Everything runs parallel, except your code and we always try to pass a call-back function that will be called once we finish with the task and we continue with the processing. We don't wait for this to end before we continue with the rest.
Similar Reads
Node.js Tutorial Node.js is a powerful, open-source, and cross-platform JavaScript runtime environment built on Chrome's V8 engine. It allows you to run JavaScript code outside the browser, making it ideal for building scalable server-side and networking applications.JavaScript was mainly used for frontend developme
4 min read
Introduction & Installation
NodeJS IntroductionNodeJS is a runtime environment for executing JavaScript outside the browser, built on the V8 JavaScript engine. It enables server-side development, supports asynchronous, event-driven programming, and efficiently handles scalable network applications. NodeJS is single-threaded, utilizing an event l
5 min read
Node.js Roadmap: A Complete GuideNode.js has become one of the most popular technologies for building modern web applications. It allows developers to use JavaScript on the server side, making it easy to create fast, scalable, and efficient applications. Whether you want to build APIs, real-time applications, or full-stack web apps
6 min read
How to Install Node.js on LinuxInstalling Node.js on a Linux-based operating system can vary slightly depending on your distribution. This guide will walk you through various methods to install Node.js and npm (Node Package Manager) on Linux, whether using Ubuntu, Debian, or other distributions.PrerequisitesA Linux System: such a
6 min read
How to Install Node.js on WindowsInstalling Node.js on Windows is a straightforward process, but it's essential to follow the right steps to ensure smooth setup and proper functioning of Node Package Manager (NPM), which is crucial for managing dependencies and packages. This guide will walk you through the official site, NVM, Wind
6 min read
How to Install NodeJS on MacOSNode.js is a popular JavaScript runtime used for building server-side applications. Itâs cross-platform and works seamlessly on macOS, Windows, and Linux systems. In this article, we'll guide you through the process of installing Node.js on your macOS system.What is Node.jsNode.js is an open-source,
6 min read
Node.js vs Browser - Top Differences That Every Developer Should KnowNode.js and Web browsers are two different but interrelated technologies in web development. JavaScript is executed in both the environment, node.js, and browser but for different use cases. Since JavaScript is the common Programming language in both, it is a huge advantage for developers to code bo
6 min read
NodeJS REPL (READ, EVAL, PRINT, LOOP)NodeJS REPL (Read-Eval-Print Loop) is an interactive shell that allows you to execute JavaScript code line-by-line and see immediate results. This tool is extremely useful for quick testing, debugging, and learning, providing a sandbox where you can experiment with JavaScript code in a NodeJS enviro
5 min read
Explain V8 engine in Node.jsThe V8 engine is one of the core components of Node.js, and understanding its role and how it works can significantly improve your understanding of how Node.js executes JavaScript code. In this article, we will discuss the V8 engineâs importance and its working in the context of Node.js.What is a V8
7 min read
Node.js Web Application ArchitectureNode.js is a JavaScript-based platform mainly used to create I/O-intensive web applications such as chat apps, multimedia streaming sites, etc. It is built on Google Chromeâs V8 JavaScript engine. Web ApplicationsA web application is software that runs on a server and is rendered by a client browser
3 min read
NodeJS Event LoopThe event loop in Node.js is a mechanism that allows asynchronous tasks to be handled efficiently without blocking the execution of other operations. It:Executes JavaScript synchronously first and then processes asynchronous operations.Delegates heavy tasks like I/O operations, timers, and network r
5 min read
Node.js Modules , Buffer & Streams
NodeJS ModulesIn NodeJS, modules play an important role in organizing, structuring, and reusing code efficiently. A module is a self-contained block of code that can be exported and imported into different parts of an application. This modular approach helps developers manage large projects, making them more scal
6 min read
What are Buffers in Node.js ?Buffers are an essential concept in Node.js, especially when working with binary data streams such as files, network protocols, or image processing. Unlike JavaScript, which is typically used to handle text-based data, Node.js provides buffers to manage raw binary data. This article delves into what
4 min read
Node.js StreamsNode.js streams are a key part of handling I/O operations efficiently. They provide a way to read or write data continuously, allowing for efficient data processing, manipulation, and transfer.\Node.js StreamsThe stream module in Node.js provides an abstraction for working with streaming data. Strea
4 min read
Node.js Asynchronous Programming
Node.js NPM
NodeJS NPMNPM (Node Package Manager) is a package manager for NodeJS modules. It helps developers manage project dependencies, scripts, and third-party libraries. By installing NodeJS on your system, NPM is automatically installed, and ready to use.It is primarily used to manage packages or modulesâthese are
6 min read
Steps to Create and Publish NPM packagesIn this article, we will learn how to develop and publish your own npm package (also called an NPM module). There are many benefits of NPM packages, some of them are listed below: Reusable codeManaging code (using versioning)Sharing code The life-cycle of an npm package takes place like below: Modu
7 min read
Introduction to NPM scriptsNPM is a Node Package Manager. It is the world's largest Software Registry. This registry contains over 800,000 code packages. Many Open-source developers use npm to share software. Many organizations also use npm to manage private development. "npm scripts" are the entries in the scripts field of t
2 min read
Node.js package.jsonThe package.json file is the heart of Node.js system. It is the manifest file of any Node.js project and contains the metadata of the project. The package.json file is the essential part to understand, learn and work with the Node.js. It is the first step to learn about development in Node.js.What d
4 min read
What is package-lock.json ?package-lock.json is a file that is generated when we try to install the node. It is generated by the Node Package Manager(npm). package-lock.json will ensure that the same versions of packages are installed. It contains the name, dependencies, and locked version of the project. It will check that s
3 min read
Node.js Deployments & Communication
Node DebuggingDebugging is an essential part of software development that helps developers identify and fix errors. This ensures that the application runs smoothly without causing errors. NodeJS is the JavaScript runtime environment that provides various debugging tools for troubleshooting the application.What is
3 min read
How to Perform Testing in Node.js ?Testing is a method to check whether the functionality of an application is the same as expected or not. It helps to ensure that the output is the same as the required output. How Testing can be done in Node.js? There are various methods by which tasting can be done in Node.js, but one of the simple
2 min read
Unit Testing of Node.js ApplicationNode.js is a widely used javascript library based on Chrome's V8 JavaScript engine for developing server-side applications in web development. Unit Testing is a software testing method where individual units/components are tested in isolation. A unit can be described as the smallest testable part of
5 min read
NODE_ENV Variables and How to Use Them ?Introduction: NODE_ENV variables are environment variables that are made popularized by the express framework. The value of this type of variable can be set dynamically depending on the environment(i.e., development/production) the program is running on. The NODE_ENV works like a flag which indicate
2 min read
Difference Between Development and Production in Node.jsIn this article, we will explore the key differences between development and production environments in Node.js. Understanding these differences is crucial for deploying and managing Node.js applications effectively. IntroductionNode.js applications can behave differently depending on whether they a
3 min read
Best Security Practices in Node.jsThe security of an application is extremely important when we build a highly scalable and big project. So in this article, we are going to discuss some of the best practices that we need to follow in Node.js projects so that there are no security issues at a later point of time. In this article, we
4 min read
Deploying Node.js ApplicationsDeploying a NodeJS application can be a smooth process with the right tools and strategies. This article will guide you through the basics of deploying NodeJS applications.To show how to deploy a NodeJS app, we are first going to create a sample application for a better understanding of the process.
5 min read
How to Build a Microservices Architecture with NodeJSMicroservices architecture allows us to break down complex applications into smaller, independently deployable services. Node.js, with its non-blocking I/O and event-driven nature, is an excellent choice for building microservices. How to Build a Microservices Architecture with NodeJS?Microservices
3 min read
Node.js with WebAssemblyWebAssembly, often abbreviated as Wasm, is a cutting-edge technology that offers a high-performance assembly-like language capable of being compiled from various programming languages such as C/C++, Rust, and AssemblyScript. This technology is widely supported by major browsers including Chrome, Fir
3 min read
Resources & Tools
Node.js Web ServerA NodeJS web server is a server built using NodeJS to handle HTTP requests and responses. Unlike traditional web servers like Apache or Nginx, which are primarily designed to give static content, NodeJS web servers can handle both static and dynamic content while supporting real-time communication.
6 min read
Node Exercises, Practice Questions and SolutionsNode Exercise: Explore interactive quizzes, track progress, and enhance coding skills with our engaging portal. Ideal for beginners and experienced developers, Level up your Node proficiency at your own pace. Start coding now! #content-iframe { width: 100%; height: 500px;} @media (max-width: 768px)
4 min read
Node.js ProjectsNode.js is one of the most popular JavaScript runtime environments widely used in the software industry for projects in different domains like web applications, real-time chat applications, RESTful APIs, microservices, and more due to its high performance, scalability, non-blocking I/O, and many oth
9 min read
NodeJS Interview Questions and AnswersNodeJS is one of the most popular runtime environments, known for its efficiency, scalability, and ability to handle asynchronous operations. It is built on Chromeâs V8 JavaScript engine for executing JavaScript code outside of a browser. It is extensively used by top companies such as LinkedIn, Net
15+ min read