I would consider a DIY phono stage. To start the Hagerman Bugle is supposed to be in thec. $500 Black Cube league, FWIW. You can build it with either 9V battery power or a 15V AC power supply. The kit, parts, power supply parts, and chassis should run about $1745 or under $200 altogether. The battery powered unit would be even cheaper.
Some more upmarket DIY phono stages would be the Hagerman cornet, Bottlehead Seduction, or Transcendent Sound Phono stage.
As for tables, a VPI HW-19 will likely be a bit better than a Rega P3 for maybe the same or a little more money. But that's up to you. I imagine you know all of the usual candidates for entry-level analog in this price range (music hall, rega, etc). You might also consider the OEM regas sold under the NAD and Moth brands. You might find a steal of a price there.