Olives are technically fruits, the stones inside act as the seeds for the Olea europaea tree. That means they're technically classified as fruits — specifically, a kind called drupes, a.k.a. stone fruits. This category also includes sweeter produce like mango, dates, apricots, cherries, nectarines, peaches, and plums.

Source: Good Housekeeping