Any advice for a turntable newbie?

I've no idea where you live (country/county/city) but there are still enough record shops around to start buying up lots of albums.  eBay has plenty of vinyl for sale.

Accesories? Stylus brush and album brush:

http://www.audioaffair.co.uk/Clearaudio-Diamond-Stylus-Cleaner-Brush/product_512

http://www.audioaffair.co.uk/Pro-Ject-Brush-IT-Carbon-Fibre-Record-Brush/product_3042?ref=gmc&gclid=CLmhiLSXlLACFYpjfAod9TrIsg

please note I have no connection with Audio Affair, they were simply the first in a google search

Check out charity shops in your local town. Potential gold mines charging as little as 50p/£1 per record. Most of the ones I have bought there are as good if not better than my new stuff, condition wise.

Depends what sort of music you want to buy - there are lots of great remasters/reissues from the likes of Mobile Fidelity and Analogue Productions. I've found www.diversevinyl.com (based in UK) are good.

Otherwise, amazon marketplace has lots, and of course fleabay.  

If you're into new releases - my impression is that limited quantities of vinyl are produced when newly released (especially by lesser known artists, so you need to snap up what you want fairly soon after release (or pre-order).

There's a thread here http://www.whathifi.com/forum/turntables-and-lps/praise-shame-rate-your-new-vinyl-here

which has been started that allows members to rate their NEW vinyl (sound quality, download voucher, price etc), which might be useful too.