Resource · Guide or article
Working with Data: Data Preparation
Data cleaning with pandas: inspecting a DataFrame, handling missing values and removing duplicates. Suits learners preparing for data tasks that start with messy input.
Reviewed
Open the original: Working with Data: Data Preparation (opens the original site in a new tab)Add to a roadmap
Keep this resource with a roadmap you follow. It appears as your own extra resource; the roadmap's steps don't change and it doesn't count toward your tracked steps.
Source content: English
Depending on its source, raw data may contain some inconsistencies that will cause challenges in analysis and modeling. In other words, this data can be categorized as “dirty” and will need to be cleaned up. This lesson focuses on techniques for cleaning and transforming the data to handle challenges of missing, inaccurate, or incomplete data. Topics covered in this lesson will utilize Python and the Pandas library and will be demonstrated in the notebook within this…
PrepKit overview
PrepKit editors wrote and reviewed this overview from the source repository. It is not text from the resource itself.
- Suited to
- The source does not state a level
- Format
- Lesson
What it covers
- Why cleaning matters and common goals: formatting, duplicates and missing data
- Inspecting data with info, head and tail on the Iris dataset
- Detecting nulls with isnull and notnull, and how NaN differs from None
- dropna options including axis, how and thresh, and fillna with forward and back fill
- duplicated and drop_duplicates, including checking a subset of columns
How to use it
PrepKit study advice, not a claim made by the source.
Take a small public dataset, list every null and duplicate you find, and for each column write down whether you would drop or fill and why. Being able to defend those choices aloud is the goal.
Scope and limitations
Pandas only; date parsing and scaling are left to linked Kaggle exercises. It is a lesson, not an interview guide, and the exercises live in a separate notebook.
Access and format
Lesson README in the microsoft/Data-Science-For-Beginners GitHub repository (MIT), free to read in English. Quizzes are linked externally and the assignment is a separate file.
Reviewed by PrepKit on Oct 2, 2026. Listing source commit: 4d2ac427ad6f
Evidence behind this overview
- 2-Working-With-Data/08-data-preparation/README.md
Pages that include this
Get the PrepKit newsletter
Optional. You don't need it to use PrepKit.