We found ours advertised in the Cyprus Weekly as our landlord wanted an English tenant because apparently, as he told our Cypriot friend that the Cypriot people want to stay too long. He probably wasn't banking on us staying in the same property for 12 years but we had absolutely no problems with him during our whole time there. He was a lovely guy (Lefteris aka Larry).
There's also another paper (a Greek one) which translated to Golden Opportunities (look out for something like this χρυσές ευκαιρίες). Helps though if you can read and understand a bit of Greek

Hard to believe there aren't any rentals floating around though....
Have a drive around and look for signs similar to this "ενοικιάζομαι"