From Best music of 1900s-1920s as MP3s:
FoldedSpace has ripped and posted a rare collection of the best music from 1901-1920s and posted it, along with commentary. These public domain songs are delightful, and feature some of my favorite artists, like Billy Murray, who sounds a little like Bugs Bunny, and even an original recording of Sousa’s band. The CD version of this goes for as much as $190 on Amazon and eBay, but since the music is in the public domain, it can be freely redistributed.