Why does it take a long time for heated oil to get cool?

Because it contains heat. The heat contained by a substance is given by H=cpT where H=heat, cp = specific heat and T=temperature. The specific heat of oil is relatively high, say compared to air or plastic. Materials with high specific heats take more energy (either added to or removed from) to change each degree of temperature.