Initially, the Kaaba housed various sculptures and paintings, most notably a statue of Hubal, the principal idol of Mecca, along with statues of other pagan deities (as referenced).
In summary, before its cleansing, the Kaaba contained idols of various pagan deities.
