Is there any way to go back
and find that folder and save my music?
possibly, but the more you use your machine, the more likely those deleted
music files will eventually get overwritten by other new and/or changed
files. there are recovery utilities available, R-Studio available at
http://www.r-tt.com/ is well known, i've used it myself and can attest to
its abilities.
however, you will need to start the recovery process ASAP, ideally the drive
in question should not be used at all until you've recovered whatever you
can from it, and if that drive is the Windows boot drive, that usually means
temporarily moving the drive to another machine for recovery purposes. any
system activity that writes to that drive will potentially overwrite the
data you need to recover, including installing a file recovery utility
itself, ironically enough.
if the data is really that important and you want to maximize your chances
of recovery, you need to stop using that drive immediately, get it in
another machine, install a recovery utility on the secondary machine's drive
(not the drive you're trying to recover), and go from there.
the r-studio utility i mentioned is also able to recover files from a
network drive, so you may be able to network your machine to another,
install r-studio on the secondary machine, then connect to the primary
machine via the network to scan for recoverable files on that drive.