Metrology instrument utilizing an optical technique for measuring microscopic features on samples, such as semiconductor wafers, flat panel displays and magnetic media