Actually, no number is given for how many wise men there were. Tradition simply ascribes the number for the three gifts of gold, frankinscence, and myrhh. It is likely, however, other gifts were given as well, cloths, furs, trinkets.
--Brought to you by your friendly neighborhood Bible factoid man...
neo