In the spirit of quality on a budget, I just saw all the free music players listed in the latest edition of The Absolute Sound. For zero dollars you can have Audirvana, Songbird or Play. For $33 you can get Decibel (good - I've tried it) or for $20 you can get Fidelia (also good).
I think all of these will play 24/96.