WebService Parameter Size Limit and Impact!

  • Thread starter Thread starter Vai2000
  • Start date Start date
V

Vai2000

Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design paradigms
or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to
pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem
allocated but no clue here)


TIA
 
Vai,

I think that 20MB for input into a method is a little excessive. What
is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely encoded so
in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take chunks
of data at a time, and then put them all together in a more efficient manner
on the server.

Hope this helps.
 
Thanks Nic.

Nicholas Paldino said:
Vai,

I think that 20MB for input into a method is a little excessive. What
is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely encoded so
in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take chunks
of data at a time, and then put them all together in a more efficient manner
on the server.

Hope this helps.


--
- Nicholas Paldino [.NET/C# MVP]
- (e-mail address removed)


Vai2000 said:
Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design paradigms
or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to
pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem
allocated but no clue here)


TIA
Click to expand...
Click to expand...
 
1 more question. If I use DIME technically I don't send the blob inside the
SOAP rather send a reference to the DIME Message, so anyway I do a heavy R/T
with my data over the wire- so DIME won't buy much to my case.
Problem is some folks are uploading large files >25MB into the system and we
have to validate these files using a WS. Right now File is read in a string
and validated with the WS (quick & easy solution)

Please advice.

TIA


Nicholas Paldino said:
Vai,

I think that 20MB for input into a method is a little excessive. What
is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely encoded so
in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take chunks
of data at a time, and then put them all together in a more efficient manner
on the server.

Hope this helps.


--
- Nicholas Paldino [.NET/C# MVP]
- (e-mail address removed)


Vai2000 said:
Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design paradigms
or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to
pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem
allocated but no clue here)


TIA
Click to expand...
Click to expand...
 
Vai2000,

If the file size is too large, then I would break up the calls to the
web serivce among multiple calls, and then process the chunks as needed,
perhaps in a process outside of the ASP space, when all the chunks have been
uploaded.


--
- Nicholas Paldino [.NET/C# MVP]
- (e-mail address removed)

Vai2000 said:
1 more question. If I use DIME technically I don't send the blob inside the
SOAP rather send a reference to the DIME Message, so anyway I do a heavy R/T
with my data over the wire- so DIME won't buy much to my case.
Problem is some folks are uploading large files >25MB into the system and we
have to validate these files using a WS. Right now File is read in a string
and validated with the WS (quick & easy solution)

Please advice.

TIA


message news:[email protected]...
Vai,

I think that 20MB for input into a method is a little excessive. What
is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely
Click to expand...
encoded
so
in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take chunks
of data at a time, and then put them all together in a more efficient manner
on the server.

Hope this helps.


--
- Nicholas Paldino [.NET/C# MVP]
- (e-mail address removed)


Vai2000 said:
Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design paradigms
or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to
pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem
allocated but no clue here)


TIA
Click to expand...
Click to expand...
Click to expand...
 
Back
Top