If your manifold is leaking it will leave evidence (like some soot) at the area that is leaking - also the sound should be obvious (tick tick).
The smoke may be caused by a little oil on the surface of the manifold - even if you handle it with dirty hands while working on the car it will burn off when you fire it.