"Bad file or number"

  • Thread starter Thread starter vjp2.at
  • Start date Start date
V

vjp2.at

I suspect somehow this file was not properly terminated (eg ctl-z).
it is 5.5 GB and I'm trying to load it into Access. It responds too quickly
to have tried to read the file and found out it was too big.

I am thinking someway to copy binary and add a ^Z file?

It's been 2 decades since i did something like this and I suspect
whatever worked then won't work with 5.5 GB



- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
 
I suspect somehow this file was not properly terminated (eg ctl-z).
it is 5.5 GB and I'm trying to load it into Access. It responds too quickly
to have tried to read the file and found out it was too big.

I am thinking someway to copy binary and add a ^Z file?

It's been 2 decades since i did something like this and I suspect
whatever worked then won't work with 5.5 GB
Click to expand...


I seriously doubt you were working with 5.5GB files 20 years ago
 
*+->
*+-> It's been 2 decades since i did something like this and I suspect
*+-> whatever worked then won't work with 5.5 GB


*+-I seriously doubt you were working with 5.5GB files 20 years ago

Isn't it obvious from the way I said it?


- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
 
*+-I seriously doubt you were working with 5.5GB files 20 years ago
Isn't it obvious from the way I said it?
Click to expand...

Not really.

If its a file from 20 years back (one possible way to read your statement) I
also doubt it. 20 years back (1994, a pre Windows time) even big *drives*
where measured in MB, not GB. And you would have had a quite special
program to work with filesizes at least three times the processors
address-bus width. Heck, even recently (on Fat32) filesizes where limited
to 2 GB.

Taking the other way to read it and assume you just now created/got a
datafile of 5.5 GB you can't read, what makes you think its the ctrl-Z thats
doing it ? It might very well be the (old) program itself not being able
to coope with a file over 2 GB in size ...
I am thinking someway to copy binary and add a ^Z file?
Click to expand...

Type "copy /?" for full info. Create a file with a ctrl-Z (type ALT 26 if
I'm not mistaken) in it and use the "/b" option to "+" the files together
(to a new one) :

copy /b Srcfile1 /b Srcfile2 Trgfile

Hope that helps.

Regards,
Rudy Wieser


-- Origional message:
*+->
*+-> It's been 2 decades since i did something like this and I suspect
*+-> whatever worked then won't work with 5.5 GB


*+-I seriously doubt you were working with 5.5GB files 20 years ago

Isn't it obvious from the way I said it?


- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
Click to expand...
 
*+->
*+-> It's been 2 decades since i did something like this and I suspect
*+-> whatever worked then won't work with 5.5 GB


*+-I seriously doubt you were working with 5.5GB files 20 years ago

Isn't it obvious from the way I said it?
Click to expand...


Sorry about that. I re-read what you posted and realized the mistake was
on my end ...however I don't believe "Access" can work with a data base
of that size. (2GB limit I believe)
How was it created?



http://office.microsoft.com/en-us/access-help/access-2010-specifications-HA010341462.aspx
 
Sure. (forgive noisy line)

2GB is mdb (out) limit not csv (in) limit

me hopes
but the bad file error comes
up too fast

ok.. gotta log off-- noise is driving me bats

- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
 
Sure. (forgive noisy line)

2GB is mdb (out) limit not csv (in) limit

me hopes
but the bad file error comes
up too fast
Click to expand...


A csv is a text file, there is (essentially) no way that it could
legitimately be 5GB



Since you did not answer my question "how was it created"

no way can I help you further.
 
From: "philo said:
A csv is a text file, there is (essentially) no way that it could legitimately be 5GB



Since you did not answer my question "how was it created"

no way can I help you further.
Click to expand...

He never answered my query.
 
No, my line was bad and I was unable to finish.
(It was wierd. It wasn't just noise but I was typing one thing and
getting something else. Hadn't seen THAT in decades since I was
dialing up with my hp2621a terminal alone)

My goal is to add an EOF (ctl-Z) to the end of a 5.6GB file out of hopes of
fixing it.


THe file came as a zip file on a CD from the provider.
THey warn of problems but the first time it was they
who sent a truncated file.
It is possible I could fix it by using a different unzipper,
or read it into openoffice base. Or I can break the file up.

I'm thinking something like
copy -b x.csv+ctlz.cod y.csv
where ctlz.cod just had ctl-z (EOF)

But I don't know how this would behave with 5.6GB

- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
 
Vip2,
THey warn of problems but the first time it was they
who sent a truncated file.
Click to expand...

And pray tell, how do you know that they did send a faulty, truncated file ?

Because of the problem ? That might well be caused by something else ...

In other words: Do not assume a ctrl-Z at the end will solve everything.
Also, most modern programs (DOS v3.3 or later) have no problem with a
textfile just ending, without such a ctrl-Z.
But I don't know how this would behave with 5.6GB
Click to expand...

There is only one way to know: try it !

Suggestion: first backup the origional (if you did not save the ZIP-file it
came from), so you can restore it when something goes wrong.
I'm thinking something like
copy -b x.csv+ctlz.cod y.csv
where ctlz.cod just had ctl-z (EOF)
Click to expand...

Yeah, that is what I suggested too. As you are responding as if you have
not read it I have no idea if you will actually read this either. :-\
Regards,
Rudy Wieser



No, my line was bad and I was unable to finish.
(It was wierd. It wasn't just noise but I was typing one thing and
getting something else. Hadn't seen THAT in decades since I was
dialing up with my hp2621a terminal alone)

My goal is to add an EOF (ctl-Z) to the end of a 5.6GB file out of hopes of
fixing it.


THe file came as a zip file on a CD from the provider.
THey warn of problems but the first time it was they
who sent a truncated file.
It is possible I could fix it by using a different unzipper,
or read it into openoffice base. Or I can break the file up.

I'm thinking something like
copy -b x.csv+ctlz.cod y.csv
where ctlz.cod just had ctl-z (EOF)

But I don't know how this would behave with 5.6GB

- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
Click to expand...
 
Someone in the NT batch newsgroup suggestes:

copy x.csv+nul /a

for which I am most gratefule

- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
 
vjp2,
Someone in the NT batch newsgroup suggestes:

copy x.csv+nul /a

for which I am most gratefule
Click to expand...

Nice, appending an "empty file" and depending on the "/a" switch to have the
copy command append a ctrl-z.

One drawback though : If, for whatever reason whatsoever, the CSV contains a
ctrl-z somewhere in the middle you will throw the remainder of the file
away. In other words: check the size of the result. If it apears to be
shorter than the origional something has gone wrong ...

But now the important question: Did adding that ctrl-z actually solve the
problem ? You did not mention anything about it.

Regards,
Rudy Wieser


-- Origional message:
Someone in the NT batch newsgroup suggestes:

copy x.csv+nul /a

for which I am most gratefule

- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
Click to expand...
 
*+-One drawback though : If, for whatever reason whatsoever, the CSV contains a
*+-ctrl-z somewhere in the middle you will throw the remainder of the file

I'm up to my waist in alligators..
but I did another looksee and saw the disk I thought damaged
was the same size and some unzip programs think the file is corrupt and won't
open it and others will only give me half the file.

One other clue, GNU tail won't work, but on the full-sized file, grep finds
everything.


Which unzipper do you prefer? (the XP one is from 2008)


- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
 
vjp2,
and saw the disk I thought damaged was the same size and
some unzip programs think the file is corrupt and won't open
it and others will only give me half the file.
Click to expand...

Jup, sounds like a damaged disk / zipfile, and which than resulted in a
partial extraction of the datafile itself. And I must say I'm surprised
that you did get anything at all.
Which unzipper do you prefer? (the XP one is from 2008)
Click to expand...

I do not have a preference, I just use whatever works. I can choose outof
several versions (most of them console based), and if needed even try some
generic product like WinRar, WinZip and alike.

But, when its really the disk (and thereby the zipfile) itself that is
damaged than you have little chance to repair it. Disk damage most always
goes in multiples of 512 bytes (one sectors worth of data), and thats a bit
much for a CRC (or alike) to fix ....

Regards,
Rudy Wieser


-- Origional message:
*+-One drawback though : If, for whatever reason whatsoever, the CSV contains a
*+-ctrl-z somewhere in the middle you will throw the remainder of the file

I'm up to my waist in alligators..
but I did another looksee and saw the disk I thought damaged
was the same size and some unzip programs think the file is corrupt and won't
open it and others will only give me half the file.

One other clue, GNU tail won't work, but on the full-sized file, grep finds
everything.


Which unzipper do you prefer? (the XP one is from 2008)


- = -
Vasos Panagiotopoulos, Columbia'81+, Reagan, Mozart, Pindus, BioStrategist
http://www.panix.com/~vjp2/vasos.htm
---{Nothing herein constitutes advice. Everything fully disclaimed.}---
[Homeland Security means private firearms not lazy obstructive guards]
[Urb sprawl confounds terror] [Phooey on GUI: Windows for subprime Bimbos]
Click to expand...
 
Back
Top