Pass-by-Object-Reference & Mutability Pitfalls

Python uses pass-by-object-reference (or call-by-sharing). Function arguments receive references to existing objects; modifying a mutable object (list, dict, tensor buffer) inside a function mutates the caller’s original state.

Interactive Systems Visualizer

Live Memory Allocation Inspector: PyObject vs Contiguous Buffer

8.0x Memory Reduction

Array Element Count (Floats):1,000,000

10,0001,000,0005,000,000

Standard Python list[float]

30.52 MB

32 bytes/item (pointer chasing + boxed PyFloat)

NumPy / PyTorch float32

3.81 MB

4 bytes/item (contiguous C array, SIMD ready)

Quantized int8 Tensor

976.6 KB

1 byte/item (32x smaller than native Python)

Key Systems Engineering Principles

Variables in Python are variable names bound to object memory addresses, not memory slots holding raw bytes.
Default parameter values are evaluated once at function definition time, NOT at function call time.
In-place tensor operations (e.g., tensor.add_()) mutate underlying memory in-place and can corrupt backward autograd graphs.

Mental Model Analogy

“Passing an object in Python is like handing someone the GPS coordinates of your whiteboard. If they write on the whiteboard, everyone looking at that same whiteboard sees the scribbles.”

Production Pitfall to Avoid

Defining def generate(prompt: str, history: list = []): ... Every call shares the exact same persistent history list in memory!

production_pattern.py

from typing import Optional

# BAD: Mutable default argument bug
def append_token(token: str, sequence: list = []):
    sequence.append(token)
    return sequence

# CORRECT: None sentinel pattern
def append_token_safe(token: str, sequence: Optional[list] = None) -> list:
    if sequence is None:
        sequence = []
    sequence.append(token)
    return sequence

Previous Subtopic#3 Garbage Collection: Reference Counting & Cyclic GC Next Subtopic #5 Memory Profiling, tracemalloc & Zero-Copy Views

Loading Python for AI Engineering...

Key Systems Engineering Principles

Variables in Python are variable names bound to object memory addresses, not memory slots holding raw bytes.

Default parameter values are evaluated once at function definition time, NOT at function call time.

In-place tensor operations (e.g., tensor.add_()) mutate underlying memory in-place and can corrupt backward autograd graphs.

from typing import Optional # BAD: Mutable default argument bug def append_token(token: str, sequence: list = []): sequence.append(token) return sequence # CORRECT: None sentinel pattern def append_token_safe(token: str, sequence: Optional[list] = None) -> list: if sequence is None: sequence = [] sequence.append(token) return sequence