All the decent ones take AA batteries and CF cards. The Nikon Coolpix 700 and 990 come to mind. Both have optical viewfinders as well so you aren't chewing through batteries.
There are some trickier models like the floppy-disk based Sony Mavicas, but I was able to source a couple spare batteries for mine after a short search.