Its usually advised to start with a used set or a cheap new set like Knight. They won't be the perfect clubs for you but it will help you make sure your willing to keep playing before making a big investment.
Cheapest course near me is $26.. its no augusta but its cheap. I play a weekly league on a better course that keeps me busy.