String manipulation

Split a string into substrings based on whitespace

Processing user input, reading log files, tokenizing sentences for NLP tasks

Text processing scripts, data cleaning pipelines, command-line utilities

; .split()

; .split()

text: str - the string to split

• list comprehension
• for loop
• len
• max

• text.split(sep)
• text.splitlines()

Assuming split() removes punctuation: cause – misunderstanding that split strips punctuation; consequence – punctuation remains in tokens, leading to incorrect tokenization.\nAssuming split() splits only on spaces: cause – forgetting that split() splits on any whitespace (spaces, tabs, newlines) and removes empty strings; consequence – unexpected empty strings or missed tokens when other whitespace present.\nAssuming split() modifies the original string: cause – misunderstanding string immutability; consequence – bugs when relying on the original string being changed.\nUsing split() with a delimiter but not handling consecutive delimiters: cause – not anticipating empty strings from consecutive delimiters; consequence – extra empty elements in result list.\nUsing split() without maxsplit and expecting a limited number of splits: cause – expecting limited splits; consequence – getting more splits than anticipated.

text.split(sep) vs text.split(): former splits on a specific delimiter, latter splits on any whitespace.\ntext.splitlines() vs text.split(): former splits on line boundaries only.\ntext.rsplit() vs text.split(): former splits from the end, useful for limiting splits from right.\nre.split(pattern, text) vs text.split(): former allows regex patterns for complex delimiters.\nstr.partition(sep) vs text.split(): former splits into exactly three parts (before, separator, after).

Coming from JavaScript: assuming split() splits only on spaces → in Python split() splits on any whitespace (spaces, tabs, newlines) and removes empty strings.

• string tokenization
• parsing
• text processing

When NOT to use: avoid when you need to preserve empty fields from consecutive delimiters or when splitting on a specific character only.\nPerformance: split() creates a new list; for very large strings repeated calls can be memory‑intensive; consider iterative parsing or specialized libraries for streaming.\nBoundary conditions: split() treats any consecutive whitespace as a single separator and strips leading/trailing whitespace, so a string containing only whitespace returns an empty list.

Quickly tokenizes a string into words

Think 'split the text into words'

split() returns a new list and leaves the original string unchanged; consecutive whitespace is treated as a single separator.

Using re.split() for custom delimiters or regex patterns