Why isn't this a syntax error in python?
Noticed a line in our codebase today which I thought surely would have failed the build with syntax error, but tests were passing so apparently it was actually valid python (in both 2.x and 3).
Whitespace is sometimes not required in the conditional expression:
>>> 1if True else 0
1
It doesn't work if the LHS is a variable:
>>> x = 1
>>> xif True else 0
File "<stdin>", line 1
xif True else 0
^
SyntaxError: invalid syntax
But it does seem to still work with other types of literals:
>>> {'hello'}if False else 'potato'
'potato'
What's going on here, is it intentionally part of the grammar for some reason? Is this odd quirk a known/documented behaviour?
Whitespace between tokens
Except at the beginning of a logical line or in string literals, the whitespace characters space, tab and formfeed can be used interchangeably to separate tokens. Whitespace is needed between two tokens only if their concatenation could otherwise be interpreted as a different token (e.g., ab is one token, but a b is two tokens).
So in this case, 1if
is not a valid token, so the whitespace is optional. The 1
is interpreted as an integer literal of which the if
is not a part. So if
is interpreted separately and recognized as a keyword.
In xif
however, an identifier is recognized, so Python is not able to see that you wanted to do x if
there.
The Python lexer generates two tokens for the input 1if
: the integer 1
and the keyword if
, since no token that begins with a digit can contain the string if
. xif
, on the other hand, is recognized as a valid identifier; there is no reason to believe that it is an identifier followed by a keyword, and so is passed to the parser as a single token.