You don't need goggles on an equipment slot to have its effect, simply completing the quest for it already makes loot appear more often.