Intake of olive oil as the main source of fat in Mediterranean diet is related to positive effects on human health. The olive biophenol hydroxytyrosol (HT) is considered a promising cancer chemopreventive compound against different types of cancer. The aim of the present study was to compare the cytotoxic activity against prostate cancer (PCa) cell lines of HT, obtained from olive mill wastewaters, and five semisynthetic alkyl ether, ester, and nitro-derivatives. HT, hydroxytyrosyl acetate (HT-Ac) and ethyl hydroxytyrosyl ether (HT-Et) exerted higher cytotoxic effect against 22Rv1 and PC-3 PCa cell lines than in non-malignant RWPE-1 cells. These compounds also significantly decreased the migration rate of RWPE-1 and PC-3 cells and the colony and prostatosphere formation of 22Rv1 cells. However, HT-Ac and HT-Et, but not HT, were able to decrease p-AKT levels and colony and prostatosphere formation in PC-3. In sum, HT and its lipophilic derivatives could be considered as potential therapeutic tools in PCa.