So, this is a bit counter-intuitive at first, and it took me some reading to figure out what is going on.
In Python, functions are first class objects. What this means is that a function can hold data, just like any other object. The default parameter is a piece of data held by its function, and this data is mutable in certain cases.
Here is a smaller example you can play around with: