With low rainfall and high evaporation in arid and semi-arid regions, existing water resources are under high pressure. Rainwater harvesting (RWH) systems are gaining popularity as a low-cost nature-based solution to water scarcity and securing water demands. In this paper, twenty-five research papers searched using keywords: performance evaluation, rainwater harvesting, water scarcity, water demand, and runoff have been reviewed to evaluate the performance of rainwater harvesting structures in arid and semi-arid regions. We have found that the effectiveness of RWH systems depends on their capacity, location, type, and operation and maintenance. The literature review revealed the performance metrics of such systems is not well defined and there is a need for uniformity.