Rectangular exhaust wall cap