File Copying Large amounts of files

[stjulian]

This is actually one of those simple tasks made hugely complicated by the
OS.

I have a massive catalog of product pictures (amounting to hundreds of
thousands of files) in .JPEG, .GIF, .AI, and .CDR. I have to replace the
drive they are on and the drag and drop method doesn't seem to handle this
many operations (cascading subfolders sometimes six deep). Many of the files
are beyond the 8.3 filename format and the path length causes most copy
functions to fail.

I have attempted to use the Microsoft SyncToy, but that seems to fail
halfway through the copy (again, maybe this is too many files). Also, the
sync files created during the process are bothersome.

I have attempted to use a program from Maxtor, however it reports that it
cannot run due to having Norton GoBack on the drive. Also, the Iomega
software only copies to their own media.

Anyone know of a program suited to file copying a massive amount of files
from one drive to another efficiently and reliably? Perhaps one with verify?
Perhaps one with UNC support (as I should push this to a server in the
future)?

Julian

 

[Guest]

Try Google robocopy, it's in Windows Server 2003 Resource Kit Tools

http://www.microsoft.com/downloads/...69-57ff-4ae7-96ee-b18c4790cffd&DisplayLang=en

 

[Dave Cohen]

This is actually one of those simple tasks made hugely complicated by the
OS.

I have a massive catalog of product pictures (amounting to hundreds of
thousands of files) in .JPEG, .GIF, .AI, and .CDR. I have to replace the
drive they are on and the drag and drop method doesn't seem to handle this
many operations (cascading subfolders sometimes six deep). Many of the files
are beyond the 8.3 filename format and the path length causes most copy
functions to fail.

I have attempted to use the Microsoft SyncToy, but that seems to fail
halfway through the copy (again, maybe this is too many files). Also, the
sync files created during the process are bothersome.

I have attempted to use a program from Maxtor, however it reports that it
cannot run due to having Norton GoBack on the drive. Also, the Iomega
software only copies to their own media.

Anyone know of a program suited to file copying a massive amount of files
from one drive to another efficiently and reliably? Perhaps one with verify?
Perhaps one with UNC support (as I should push this to a server in the
future)?

Julian

Bootitng from www.terabyteunlimited.com is a combination imaging,
partition management and multi os product.
If you download and create a bootable media (cd or floppy), you boot
from that. Do not install, hit cancel. This will put you in maintenance
mode. Click on partition work and you should be able to do a partition
copy to another partition (on same or different drive). Offhand I can't
recall if the destination partition has to be formatted or even created.
This is a sector to sector deal and I don't think the process even cares
what os is involved, but I could be wrong there.

Having said all that, I'm surprised you're having the problem you
report. Does the process still fail if you open a dos box and use xcopy
with appropriate switches? The only time I've had a problem with too
deep a directory structure was burning to cd using Roxio. It's possible
the procedure wants to store the template of what is to be copied into
memory and that's creating the problem, I just don't know enough about
the internals.
Dave Cohen

 

[Guest]

stjulian, before you do any more copying, you should do a chkdsk /f on that
drive, file corruption can cause file copying to fail.