Python for Data Analytics: Pandas Complete Tutorial for Beginners

For modern data analysts, Excel is often the beginning, but **Python** is where scale happens. While Excel spreadsheets slow down or crash when handling datasets exceeding a few hundred thousand rows, Python easily processes millions of records. At the heart of Python's data analysis ecosystem sits **Pandas**.

This hands-on tutorial covers the basics of Pandas that you need to know to load, inspect, clean, and analyze datasets.

1. Core Pandas Objects: Series and DataFrames

Before writing code, you must understand the two core data structures in Pandas:

• Series: A 1D array-like object capable of holding any data type (integers, strings, floats) with labeled indices.
• DataFrame: A 2D tabular structure, much like an Excel worksheet or SQL table, consisting of rows and columns.

To use Pandas, import it into your script using the standard alias `pd`:

import pandas as pd

2. Loading Datasets and Basic Inspection

Pandas can load data from almost any file type, including CSVs, Excel files, JSONs, or SQL databases. The most common ingestion function is `read_csv()`:

df = pd.read_csv('sales_data.csv')

Once loaded, inspect the data using these essential functions:

• `df.head(5)`: Displays the first 5 rows of the DataFrame.
• `df.info()`: Shows data types, column names, and missing value counts.
• `df.describe()`: Generates summary statistics (mean, min, max, std dev) for numerical columns.

3. Data Cleaning Operations

Real-world data is messy. Pandas provides robust tools to handle structural anomalies, missing values, and duplicate rows:

A. Handling Missing Values

To check for null values, use `isnull().sum()`. You can handle null values by either dropping rows or filling them with default metrics:

# Drop rows containing missing values
df_clean = df.dropna()

# Fill missing sales values with the median sales metric
median_sales = df['Sales'].median()
df['Sales'] = df['Sales'].fillna(median_sales)

B. Filtering Data

To filter rows based on logical conditions (similar to SQL's `WHERE` clause):

# Filter sales records where revenue exceeds 10,000 in the Retail segment
retail_high_value = df[(df['Segment'] == 'Retail') & (df['Revenue'] > 10000)]

4. Data Aggregation and Grouping

The `groupby()` operation is one of the most powerful features in Pandas, allowing you to split data into groups and apply aggregate functions (like sum, mean, or count):

# Compute total sales revenue and average order quantity per product category
summary = df.groupby('Category').agg({
    'Revenue': 'sum',
    'Quantity': 'mean'
})
print(summary)

5. Merging and Joining DataFrames

To combine tables based on matching key columns (similar to SQL `JOIN`s):

# Merge order records with customer details based on CustomerID
merged_df = pd.merge(orders_df, customers_df, on='CustomerID', how='inner')