Skip to content

Resource · Guide or article

Working with Data: Data Preparation

Data cleaning with pandas: inspecting a DataFrame, handling missing values and removing duplicates. Suits learners preparing for data tasks that start with messy input.

Reviewed

Open the original: Working with Data: Data Preparation (opens the original site in a new tab)

Add to a roadmap

Keep this resource with a roadmap you follow. It appears as your own extra resource; the roadmap's steps don't change and it doesn't count toward your tracked steps.

Source content: English

Depending on its source, raw data may contain some inconsistencies that will cause challenges in analysis and modeling. In other words, this data can be categorized as “dirty” and will need to be cleaned up. This lesson focuses on techniques for cleaning and transforming the data to handle challenges of missing, inaccurate, or incomplete data. Topics covered in this lesson will utilize Python and the Pandas library and will be demonstrated in the notebook within this…

PrepKit overview

PrepKit editors wrote and reviewed this overview from the source repository. It is not text from the resource itself.

Suited to
The source does not state a level
Format
Lesson

What it covers

  • Why cleaning matters and common goals: formatting, duplicates and missing data
  • Inspecting data with info, head and tail on the Iris dataset
  • Detecting nulls with isnull and notnull, and how NaN differs from None
  • dropna options including axis, how and thresh, and fillna with forward and back fill
  • duplicated and drop_duplicates, including checking a subset of columns

How to use it

PrepKit study advice, not a claim made by the source.

Take a small public dataset, list every null and duplicate you find, and for each column write down whether you would drop or fill and why. Being able to defend those choices aloud is the goal.

Scope and limitations

Pandas only; date parsing and scaling are left to linked Kaggle exercises. It is a lesson, not an interview guide, and the exercises live in a separate notebook.

Access and format

Lesson README in the microsoft/Data-Science-For-Beginners GitHub repository (MIT), free to read in English. Quizzes are linked externally and the assignment is a separate file.

Reviewed by PrepKit on Oct 2, 2026. Listing source commit: 4d2ac427ad6f

Evidence behind this overview
  • 2-Working-With-Data/08-data-preparation/README.md

Pages that include this

Get the PrepKit newsletter

Optional. You don't need it to use PrepKit.

How we handle your email