I wouldn't reccommend it. Toyotas use 3 different types of AF meters. If it had a vane type it wouldn't matter if you removed it.
For the Karmen vortex meter and the hot wire type it is very important to have it there. For both types it helps to laminate the airflow which gives a better signal for the hot wire. For the KV type it helps keep steady turbulance from the vortec generator. THis is important because the frequency of the vortices is proportional to the velocity of the intake air (or engine load).
I'm pretty sure Soarers use one of the latter two.