It still amounts to the offence of theft (in SA) unless it is returned, regardless of the belief you had at the time e.g that you had purchased the purse at the time.
Happened on a visit to Sydney :P