Whichever side of the river one stays on, the Victoria Falls really must be viewed from the Zimbabwean side, making staying on the Zimbabwean side an obvious choice. The Victoria Falls town is small, has very low crime, and an abundance of restaurants, bars, and curio shops.
With a wide array of places to stay, easy transport, and other activities (trains, rafting, cruises, flights, game viewing), and a good and growing choice of international flights into the Vic Falls airport, a 2 or 3 day stay on the Zimbabwean side can make a wonderful inclusion in any safari.