Copying files to 2nd PC in workgroup, process stopped in the middle

  • Thread starter Thread starter jinnii
  • Start date Start date
J

jinnii

Good day...

(I hope the network_web NG is the correct forum for this question, if
not my apologies)

In trying to clean out an old work laptop, I attempted to copy the
contents of a folder (with sub-folders) to a new PC on our well tuned
workgroup network (with thanks to Chuck). I opened both containing
folders from the new PC (250G HD, dual core processor running Win MCE
2005) and dragged and dropped the folder from old to new. The folder
had about 23,000 mixed files, totaling close to 16 GB.

It worked away all night, and by morning was a bit more than half way
through, but everything seemed to be fine. I just took a look now and
there was an error message stating one particular file (old photo,
didn't matter anyway) could not be copied and the process stopped. The
items that were copied successfully look fine, but I wondered if:

a) there is a way to compare the two folders and determine which had
not yet been copied over so that I could do so in smaller batches if
necessary, and

b) (for future reference) is there a way to allow a particular file to
be ignored or addressed individually and yet let the copy process
continue?

Thank you in advance,

JK
 
Good day...

(I hope the network_web NG is the correct forum for this question, if
not my apologies)

In trying to clean out an old work laptop, I attempted to copy the
contents of a folder (with sub-folders) to a new PC on our well tuned
workgroup network (with thanks to Chuck). I opened both containing
folders from the new PC (250G HD, dual core processor running Win MCE
2005) and dragged and dropped the folder from old to new. The folder
had about 23,000 mixed files, totaling close to 16 GB.

It worked away all night, and by morning was a bit more than half way
through, but everything seemed to be fine. I just took a look now and
there was an error message stating one particular file (old photo,
didn't matter anyway) could not be copied and the process stopped. The
items that were copied successfully look fine, but I wondered if:

a) there is a way to compare the two folders and determine which had
not yet been copied over so that I could do so in smaller batches if
necessary, and

b) (for future reference) is there a way to allow a particular file to
be ignored or addressed individually and yet let the copy process
continue?
Click to expand...

Jinnii,

For a large copy like that, I would use the batch command "xcopy". Drag and
drop is useful for quick jobs, but the extra effort required by xcopy is well
worth the learning curve.

Getting xcopy to do multiple levels of subdirectories will take experimentation.
My recommendation (read thru this and ask questions please):
# Setup a test set of folders and files - say maybe a couple dozen files, in a
dozen folders, arranged in a hierarchy of 3 or 4 levels of folders. This lets
you see how effective xcopy is, when using the various switches.
# Run xcopy from a command window. First, do "xcopy /?", which will give you a
long and detailed list of all of the switches.
# The "/c" switch, for instance, will fulfill your second requirement -
"Continues copying even if errors occur.".
# When I do xcopy, I start my source (the local computer, where the files are)
and my object (the distant computer, to where you are copying the files) at the
root of the folders involved in the copy (where you dragged from, and where you
dropped into).
# Open a command window.
# "cd \RootOfSourceFolders".
# "net use x: \\ObjectServer\ObjectShare".
# "x:"
# If the folders being copied do not start in the root of the share just mapped,
"cd \RootOfObjectFolders". With the current position in the mapped drive now
starting at the root of your target, return your focus to your source drive.
# "c:"
# Then start the copy "xcopy c: x: /c /e /y" and let it run.
# The switches: "/c" continues copying if any errors, "/e" copies folders,
including empty ones, "/y" overwrites any duplicates. You may find other
switches useful too.

I am sure that this is all Greek to you. It was to me the first time I used it,
and I still have to reread the "/?" reference occasionally. But trust me, an
xcopy will go hella faster than drag and drop, and for large copies like yours,
is well worth the extra learning time.
 
Good heavens, do you not sleep? :)

I will certainly read through and make an attempt at your suggestions.
Meanwhile, I found references to several utilities that would at least
allow me to compare the two for now; CompTree and CompFold, but I have
not tried either yet. Have you heard of them? I will play with xcopy
first just to see what I am up against. Thanks!

Back later...
 
Good heavens, do you not sleep? :)

I will certainly read through and make an attempt at your suggestions.
Meanwhile, I found references to several utilities that would at least
allow me to compare the two for now; CompTree and CompFold, but I have
not tried either yet. Have you heard of them? I will play with xcopy
first just to see what I am up against. Thanks!

Back later...
Click to expand...

Hi Jinnii,

I've played with several mirroring and mirror comparison software solutions, I
don't recognise either of these though.

The amount of information returned, when analysing an out of synch mirror, can
be immense. I frequently find it best to just destroy and repeat the mirror.
For a one time copy, as yours, you might find the same thing, and xcopy is an
efficient solution. Just delete the partial copy (don't send files to the
Recycle Bin!), and start over with xcopy.
 
Good evening,

I just performed xcopy on test folder with lots of subdirectories and
misc. files (125 total), and it worked beautifully. I wondered though
if it can run for hours at a time (ie: set it up and go to bed leaving
the two computers "always on" for the time). Remember, I have close to
23,000 files to copy. Should I perhaps do it in batches?

In your earlier post you said:
Just delete the partial copy (don't send files to the Recycle Bin!),
and start over with xcopy.
Click to expand...

How do you delete files without sending them to the bin? I usually
just empty it after deletion.

Thanks, JK
 
Good evening,

I just performed xcopy on test folder with lots of subdirectories and
misc. files (125 total), and it worked beautifully. I wondered though
if it can run for hours at a time (ie: set it up and go to bed leaving
the two computers "always on" for the time). Remember, I have close to
23,000 files to copy. Should I perhaps do it in batches?

In your earlier post you said:

How do you delete files without sending them to the bin? I usually
just empty it after deletion.

Thanks, JK
Click to expand...

If you can figure how to separate it into batches that's a good idea. Splitting
it sequentially, or stopping and restarting, is not easy though. It depends I
guess upon how comfortable you are starting it over and over. The first time is
probably the hardest, though, and it sounds like you're over that.
 
Delete from the command line doesn't send files to the recycle bin. I
have run xcopy up to an hour before. commandline is a LOT faster than
the GUI (explorer) copy.
 
Thanks Chuck,

Took me a few days to get it all copied over (I did it in batches),
kept the network connection open, just moved the batches (on both ends)
to a separate folder after each run). I just loved learning about and
using xcopy! I made a jpg of "xcopy /?" and between that and your
stellar instructions, did just fine. Discovered that one cannot access
the internet from any of the networked computers on the workgroup while
the xcopy network connection is running, but that wasn't a problem.
Can't wait to re-aquaint myself with and learn more DOS (I have to
catch up to my big brother, Penn...).

One migration-of-files down, another (even larger) to go albeit from a
"crashed" (actually just a retired) harddrive. I connected it to
computer JK-5's cable and from that PC simply grouped all 40+GB of
files in 2 to 4 GB batches (that seems to be a comfortable size for me)
on the old drive and plan to xcopy them all to the new computer over
the next few days when kids aren't doing homework.

I've discovered that I had multiple copies of my Quark and photo files
on three different computers, not to mention scores of kids music and
video-lets, and I am dreadful at filing/organization. Any suggestions
on that score welcome (e-mail may be best after conclusion of this
thread).

I'm sure I'll be back with I'll be back with more questions as I work
toward my goal of simplification and reorganization of my computers and
desk.

Thanks again, JK
 
Bob said:
Delete from the command line doesn't send files to the recycle bin. I
have run xcopy up to an hour before. commandline is a LOT faster than
the GUI (explorer) copy.
Click to expand...


I'll have to try command line deletion as well, ta.

I think I will run an experiment to see just how much faster xcopy is
on a say, 3GB batch over a network than drag and drop. Just for fun.
Most of my runs lasted at least an hour, but I didn't see when they
ended. Out of curiosity, is there a way to log the start and finish
times?

JK
 
jinnii said:
I think I will run an experiment to see just how much faster xcopy is
on a say, 3GB batch over a network than drag and drop. Just for fun.
Most of my runs lasted at least an hour, but I didn't see when they
ended. Out of curiosity, is there a way to log the start and finish
times?
Click to expand...
Hi,

Instead of xcopy, you can use the command line tool Robocopy.exe, it
has builtin support for logging to file (and a /lot/ more).

Robocopy.exe is in the free Windows Server 2003 Resource Kit:

http://www.microsoft.com/downloads/...69-57ff-4ae7-96ee-b18c4790cffd&DisplayLang=en

(The kit will install on WinXP or later, the individual files can
then be copied to another computer if needed)


See rktools.chm and robocopy.doc for documentation for Robocopy.exe.
 
Thanks Chuck,

Took me a few days to get it all copied over (I did it in batches),
kept the network connection open, just moved the batches (on both ends)
to a separate folder after each run). I just loved learning about and
using xcopy! I made a jpg of "xcopy /?" and between that and your
stellar instructions, did just fine. Discovered that one cannot access
the internet from any of the networked computers on the workgroup while
the xcopy network connection is running, but that wasn't a problem.
Can't wait to re-aquaint myself with and learn more DOS (I have to
catch up to my big brother, Penn...).

One migration-of-files down, another (even larger) to go albeit from a
"crashed" (actually just a retired) harddrive. I connected it to
computer JK-5's cable and from that PC simply grouped all 40+GB of
files in 2 to 4 GB batches (that seems to be a comfortable size for me)
on the old drive and plan to xcopy them all to the new computer over
the next few days when kids aren't doing homework.

I've discovered that I had multiple copies of my Quark and photo files
on three different computers, not to mention scores of kids music and
video-lets, and I am dreadful at filing/organization. Any suggestions
on that score welcome (e-mail may be best after conclusion of this
thread).

I'm sure I'll be back with I'll be back with more questions as I work
toward my goal of simplification and reorganization of my computers and
desk.

Thanks again, JK
Click to expand...

That's great, Jinnii. The purpose of these forums is to teach as well as
instruct, and it sounds like you learned a bit from the experience.

Organising data, especially across a network with multiple servers, is a big
subject. Keeping data organised is a challenge. Organising data that's been in
place for some time, with multiple copies of some files, is a real challenge.

I like to replicate key files of mine to 2 or 3 computers simultaneously.
Enterprise systems (large corporations) are using that strategy in a more
organised way, hence the start of grid computing, and Storage LANs.

Having duplicated files is not necessarily a problem, though having unorganised
duplication could be. Just take it a step at a time, think about what you're
doing, and stay relaxed. Networking computers is fun, or it can be, if you do
it properly.
 
Another way to delete without going through the recycle bin (but using the
gui instead of command line) is to highlight the files to be deleted and
hold the shift key when clicking delete.
 
Back
Top