Data transformation

Enables creation of filtered unique collections in a single expressive expression

Text processing: extracting unique words longer than a given length Data analysis: collecting distinct IDs that meet a numeric threshold Configuration handling: building a set of enabled feature flags from a list

Python scripts Data pipelines using pandas or plain Python Utility modules for command‑line tools

{element for element in collection if predicate}

{... for ... in ... if ...}

element: any object, collection: iterable, predicate: boolean expression

• list comprehension generator expression filter function

• Use a list comprehension `[element for element in collection if predicate]` when order matters and duplicates are allowed Replace with a generator expression `(element for element in collection if predicate)` for lazy evaluation

Using a mutable object as an element, causing a TypeError because set elements must be hashable Forgetting the `if` clause, resulting in a set that includes unwanted items Placing the `if` before the `for`, which is invalid syntax and raises a SyntaxError

list comprehension – returns a list, preserves order, allows duplicates generator expression – returns an iterator, evaluated lazily, not a concrete set

Coming from JavaScript: using `Array.filter()` returns an array with possible duplicates – Python set comprehension automatically deduplicates

• list comprehension
• dict comprehension
• generator expression

Do not use when the resulting set would be extremely large, as it may consume significant memory Set comprehensions are generally faster than building a set with a loop and `add()` calls If the predicate involves side effects, be aware that the order of evaluation is not guaranteed

Ensures that downstream code works with a collection of unique, filtered items, preventing duplicate‑related bugs and simplifying membership tests.

Think of a set comprehension as a sieve that catches only the grains you want, discarding the rest while automatically removing duplicates.

Set comprehensions produce an unordered collection; the iteration order is arbitrary and may differ between runs. If a stable order is required, wrap the comprehension with sorted() or use dict.fromkeys() to preserve insertion order.