This is more relevant to oil cooled turbos. To switch them off when the turbo is very hot (because of the amount of exhaust gas that has passed through them - not necessarily because of shaft rpm) can cause the oil to bake (coke up) on the internals of the turbo - this is baad.
It takes nothing flat to get a turbo glowing red hot - and it takes a relativley short time to cool them down - especially of they are water cooled. I don't hesitate to switch mine off right away after driving for about a minute of 2 on a cool down cycle.