Zip large number of files
Zip large number of files
Zip large number of files
Zip large number of files
Zip large number of files
Zip large number of files Zip large number of files Zip large number of files Zip large number of files Zip large number of files Zip large number of files Zip large number of files Zip large number of files
Zip large number of files Zip large number of files
Zip large number of files
Go Back  Xtreme Visual Basic Talk > > > Zip large number of files


Reply
 
Thread Tools Display Modes
  #1  
Old 08-28-2009, 06:43 PM
watkins watkins is offline
Centurion
 
Join Date: Jan 2002
Posts: 113
Default Zip large number of files


Hi,

I am using zipforge.net to archive files in a small backup program I am creating. Everything works fine however if I try to archive a large number of files the process of zipping them gets slower the further along in the job it gets.

Example:

I have a directory that contains a little over 100,000 files in it. Each file is only about 200k of text. When I use the zipforge zip class it starts zip'ing very quickly but as it gets about 40% of the way through the directory it starts to slow down... at about 60% its working at a snails pace.

Memory usage for my solution also goes up proportionate to the archive file size as it grows.

Currently it takes around 26hours to backup this directory which only contains 4 gigs worth of information.

Any ideas on how to speed up this process? If I use a program like winzip I can zip the folder in less than an hour. I am thinking there has to be a way to write to the end of the zip file without having to open it every time or without keeping it open.


My backup software scans the specified folder and writes each file path and name into a text file. Then it reads the text file line by line and passes the path + file info to the zipforge addfile().

Last edited by watkins; 08-28-2009 at 10:22 PM.
Reply With Quote
  #2  
Old 08-31-2009, 10:16 AM
AtmaWeapon's Avatar
AtmaWeaponZip large number of files AtmaWeapon is offline
Fabulous Florist

Forum Leader
* Guru *
 
Join Date: Feb 2004
Location: Austin, TX
Posts: 9,500
Default

Since this is a commercial component, I doubt you'll get much help here. It's not impossible, but I find that the vast majority of the users of this forum stick to the built-in functionality of .NET.

It looks like ZipForge provides support, and if you paid for their component you have the right to ask them to support it. Why not ask them what's wrong?

My guess is one of two things is happening:
  • Their component has some kind of resource leak and they need to fix it.
  • Your code is using their component improperly, which is causing a resource leak.
In either case, I'm no expert on their component so I can offer no help.
__________________
.NET Resources
My FAQ threads | Tutor's Corner | Code Library
I would bet money 2/3 of .NET questions are already answered in one of these three places.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Advertisement:





Free Publications
The ASP.NET 2.0 Anthology
101 Essential Tips, Tricks & Hacks - Free 156 Page Preview. Learn the most practical features and best approaches for ASP.NET.
subscribe
Programmers Heaven C# School Book -Free 338 Page eBook
The Programmers Heaven C# School book covers the .NET framework and the C# language.
subscribe
Build Your Own ASP.NET 3.5 Web Site Using C# & VB, 3rd Edition - Free 219 Page Preview!
This comprehensive step-by-step guide will help get your database-driven ASP.NET web site up and running in no time..
subscribe
Zip large number of files
Zip large number of files
Zip large number of files Zip large number of files
Zip large number of files
Zip large number of files
Zip large number of files Zip large number of files Zip large number of files Zip large number of files Zip large number of files Zip large number of files Zip large number of files
Zip large number of files
Zip large number of files
 
Zip large number of files
Zip large number of files
 
-->