🐍 Lesson 21: Python Advanced File Handling – Read, Write & Manage Files

Welcome to Lesson 21! Today we’ll explore advanced file handling in Python. We’ll cover reading/writing different file types, efficient techniques, and using context managers to handle files more safely and effectively.

---

⭐ What You Will Learn in This Lesson

• Efficiently read large files line by line
• Write to text, CSV, and JSON files
• Use context managers for safe file handling
• Manage structured data like CSV and JSON
• Understand the importance of efficient file access for large datasets

---

👥 Who Is This Lesson For?

• Python developers who want to improve file handling skills
• Anyone working with large datasets, CSV, or JSON files
• Developers looking to handle files efficiently and safely in their Python applications

---

📦 1. Reading Files Efficiently

For large files, read them line by line to save memory:

with open("large_file.txt", "r") as file:
    for line in file:
        print(line.strip())

---

📦 2. Writing to Files

lines = ["Python is fun.", "File handling is easy."]

with open("output.txt", "w") as file:
    for line in lines:
        file.write(line + "\n")

---

📦 3. Appending to Files

with open("output.txt", "a") as file:
    file.write("This line is appended.\n")

---

📦 4. Working with CSV Files

Python’s csv module allows reading and writing CSV files easily:

import csv

# Writing CSV
with open("data.csv", "w", newline="") as file:
    writer = csv.writer(file)
    writer.writerow(["Name", "Age"])
    writer.writerow(["Alice", 25])
    writer.writerow(["Bob", 30])

# Reading CSV
with open("data.csv", "r") as file:
    reader = csv.reader(file)
    for row in reader:
        print(row)

---

📦 5. Working with JSON Files

Python’s json module helps read/write JSON files:

import json

data = {"name": "Alice", "age": 25}

# Writing JSON
with open("data.json", "w") as file:
    json.dump(data, file)

# Reading JSON
with open("data.json", "r") as file:
    content = json.load(file)
    print(content)

---

🧩 6. Why Advanced File Handling Matters

• Work with large datasets efficiently
• Read and write structured data like CSV and JSON
• Essential for data science, automation, and apps
• Ensures safe file access with context managers

---

🧪 Practice

1. Read a large text file line by line using the with statement.
2. Write a list of strings into a new text file.
3. Create a CSV file with 3 rows of data and read it back.
4. Create a JSON file from a Python dictionary and read it back.

---

❌ Common Mistakes

• Not using the with statement, leaving files open
• Incorrectly formatting data when writing to CSV or JSON files
• Not handling large files properly (e.g., trying to load them entirely into memory)

---

❓ Frequently Asked Questions (FAQ)

1. Why is using the with statement important?

The with statement ensures that files are properly closed, even if an error occurs while working with them. It helps avoid memory leaks and keeps your code clean.

2. Can I use the same techniques for binary files?

Yes! When working with binary files, use rb and wb modes for reading and writing files, respectively.

3. What’s the difference between csv.writer() and csv.DictWriter()?

csv.writer() works with lists of values, while csv.DictWriter() writes rows as dictionaries, where the keys are column headers.

---

🚀 What’s Next?

In the next lesson, you’ll learn about:

• Regular Expressions (Regex) in Python
• Pattern matching, text searching, and data cleaning
• Using the re module for powerful string manipulation

---

➡ Next Lesson

Go to Lesson 22 →