HomeCoursesLearn Data Science with Bash Shell

Beginner

Learn Data Science with Bash Shell

Gain insights into data processing using Bash, sed, awk, and RegEx. Explore sorting, searching, replacing, and optimizing data tasks interactively with animated videos, projects, quizzes, and tasks.

Join 2.7 million developers at

Overview

Content

Reviews

2500+ students have taken this innovative project-based data learning course (includes video lectures). It demonstrates the use of Bash shell (Bash, sed and awk including RegEx) in processing textual data. It can help to learn to sort, search, match, replace, clean and optimize various aspects of data with Bash Shell. The target audience (students, researchers, scientists, journalists, data miners, developers) didn't have to go through any tough learning curve. This course also should have helped RedHat, SuSE and Ubuntu Linux learners and Data Science enthusiasts. Regularly updated, new projects to come! - Learn Bash commands interactively - Projects with own stories and conclusive decisions - Animated video lectures (for visual learners) - Demonstrations - Quizzes - Learning tasks Bloom's taxonomy (remember, understand, apply, analyze, evaluate and create) in developing your Linux skills. Learn Scientific Programming! scientificprogramming.io

2500+ students have taken this innovative project-based data learning course (includes video lectures). It demonstrates the use ...Show More

Content

71 Lessons3 Quizzes

Course Introduction

2 Lessons

Get familiar with using Bash for efficient data manipulation and foundational scripting skills.

Introduction

What is Bash?

Project 1: Analyzing the 'US News' University Ranking Data

9 Lessons

Get started with analyzing university ranking data using essential Bash commands.

Unirank: Data Preview (head, pipe and csvlook)

Find the colleges in the ranklist (grep, pipe and wc)

Finding the percent of colleges in the ranklist (wc, grep)

Listing the Institutes from a given state (grep)

Finding the number of Institutes from each state

Finding the correlation between university tuition and ranks

Project demonstration

Project Summary

Test your skills

Project 2: Facebook Data Mining

7 Lessons

Go hands-on with mining Facebook data using Bash commands for insightful analysis.

FB: Data Preview (csvstat, csvcut, head, cat)

Finding the number of status entry (csvcut, sort, uniq)

Find the most popular status entry (awk, sort, cat, csvcut, head)

Finding the most popular entry (Bash function)

Project demonstration

Project Summary

Test your skills

Project 3: Australian Cities Crime Statistics

9 Lessons

Break down the steps to analyze Australian cities' crime stats using Bash commands.

AU Crime Stats: Introduction

Data Preview

Row and Columns Statistics (sed, wc, head, cat)

Finding the top most crime in the whole country (sort, tail, awk)

Finding the top most crime per city (csvcut, sort, tail, awk)

Finding the best city in Australia! (Bash Shell Script)

Prject demonstration

Project Summary

Test your skills

Project 4: Shakespearean-era plays and poems data mining

5 Lessons

Solve problems in analyzing Shakespearean texts using advanced Bash commands and data mining techniques.

Plays and Poems: Data Preview (cat, cut, head and csvlook)

Counting the Plays and Poems (head, sed, grep, wc)

Finding plays/poems by each author (sed, sort, uniq, head)

Finding the most frequent words by Shakespeare

Project Summary

Bash Tutorials

11 Lessons

Investigate Bash scripting essentials from basics, variables, and command execution to redirections and loops.

Hello! Bash

Bash variables and functions

Bash command execution and passing arguments

Bash meta characters

Bash quotation basics

Bash read and store user input

Bash redirections

Bash conditional statements

Bash `loop` statements

Bash arithmetic

Bash arrays

REGEX Tutorials

7 Lessons

Analyze regex fundamentals, BRE and ERE syntax, character classes, lookarounds, atomic groups, and Bash regex usage.

Hello! RegEx

Basic Regular Expressions (BRE)

Extended Regular Expressions (ERE)

REGEX character classes

REGEX look arounds

REGEX atomic groups `(?>)`

How to use REGEX in Bash shell scripting?

AWK Tutorials

4 Lessons

Get familiar with AWK's text processing capabilities, variables, functions, and practical examples.

Hello! AWK

AWK Built-in Variables

AWK built-in functions

AWK useful examples

SED, GREP and Find Tutorials

6 Lessons

Grasp the fundamentals of powerful text-processing and search tools: SED, GREP, and Find.

Hello! SED - Stream Editor

SED substitutions

SED and regular expressions

SED delete, print and grouping

Hello! GREP

Hello! Find command

10.

Beyond the Text Files! Enter into the Big Data Landscape - Concepts

10 Lessons

Examine key technologies in Hadoop's Big Data landscape, including HDFS, MapReduce, YARN, and more.

HDFS - Hadoop Distributed File System

Map Reduce

YARN - Yet Another Resource Negotiator!

Pig

Big Data file formats

11.

Conclusion

1 Lessons

Enhance your skills in data science tools, practical applications, and further learning resources.

Conclusion and References

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Scientific Programmer

Developed by MAANG Engineers

Every Educative lesson is designed by a team of ex-MAANG software engineers and PhD computer science educators, and developed in consultation with developers and data scientists working at Meta, Google, and more. Our mission is to get you hands-on with the necessary skills to stay ahead in a constantly changing industry. No video, no fluff. Just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Personalized Interview Prep

Skip the LeetCode grind with a custom roadmap that adapts to your goals. Hands-on practice for Coding Interviews, System Design, and more.

Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

AI Prompt

Build prompt engineering skills. Practice implementing AI-informed solutions.

Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Course

Grokking Data Science

Gain insights into data science with easy-to-follow, hands-on explanations. Explore essential concepts quickly and efficiently, even without prior statistics knowledge, for a career boost.

10 h

beginner

Course

Master the Bash Shell

Gain insights into the intricacies of the Bash shell, ideal for beginners. Delve into essential skills with interactive learning designed to ensure lasting knowledge without requiring prior experience.

10 h

beginner

Course

Data Science Interview Handbook

The ultimate guide to data science interviews. Developed by FAANG engineers, it covers Python, algorithms, ML concepts, and interview questions. Get interview-ready in just a few hours.

9 h

intermediate

Course

Data Science for Non-Programmers

Discover how to conduct data analysis in Python without prior programming experience. Discover Python basics, data preprocessing, EDA, and predictive analytics for solving business problems.

13 h

beginner

Course

Initializing Data Members: From C++11 till C++20

3 h

beginner

Course

D3 Tips and Tricks: Interactive Data Visualization

Gain insights into D3.js, and learn to create and style interactive visuals. Delve into line graphs, bar charts, histograms, and more to master data visualization with D3.

102 h 30 m

beginner

Course

Introduction to Big Data and Hadoop

Delve into Big Data essentials, explore data types, and gain insights into Hadoop components like YARN, MapReduce, HDFS, and Spark. Discover foundations to excel in the growing Big Data field.

10 h

beginner

Course

Ace the AP Computer Science Exam for High Schoolers

Delve into AP Computer Science A fundamentals, gain hands-on Java coding practice, and test your knowledge with practice exams. No background needed—boost your confidence and skills!

15 h

beginner

Course

Grokking Data Science

beginner

10 hour

Course

Master the Bash Shell

beginner

10 hour

Course

Data Science Interview Handbook