Showing posts with label file transfer. Show all posts
Showing posts with label file transfer. Show all posts

Sunday, 24 October 2004

, , ,

FTP servers like granny used to make

This tutorial is dedicated to all you podcasters and other creative, digital artists wishing to share your original content with an adoring fan base. What better way to thank them for their unwavering adulation than to offer your personal hard drive on a silver platter? While actually giving away your physical drive would be a very friendly gesture, and one which I'm sure would be greatly appreciated, this isn't quite what I'm getting at. What I mean is you could freely allow the great unwashed to remotely connect to your computer and fill their virtual shopping baskets with your handicrafts. Although at first this may sound like a risky business, providing you use the right software and set up your server correctly, you need not worry about people gaining access to anything you don't want them to see. It's your server so you set the limits.

In this case the right software is a specialist application known as an FTP daemon - my personal favourite is Serv-U (other people prefer War FTP or Bullet Proof FTP Server, but they're all mad and aren't to be trusted). Once you have downloaded and installed the trial version of Serv-U, locate its shortcut in your start bar and run the program. As it loads you will be greeted by a status screen detailing the version number and copyright stipulations of the software. Of greater interest, in addition to this information you will find a reference to your IP address and port number. It is wise to keep a note of these details because without them you will not be able to tell people how to connect to your server. The fact that Serv-U has been able to identify your IP address indicates that your computer is online and is capable of accepting remote connections. Regardless, don't share those all important digits just yet - you have a few configuration settings to adjust first.

To get started, click on the 'setup' button, located in the menu bar of the program. When the list of options expands, scroll through them until you come to 'ftp server' and click on it to open the server setup dialog box. This is where you will be given the opportunity to assemble your FTP server exactly the way you want it. Some of these options you can leave alone, the port number for instance is best left set at 21 (the default setting for any FTP server). Other options that will require tweaking include the maximum speed at which users are allowed to download and the maximum number of users permitted to connect simultaneously. These options jointly allow you to tailor your server to the bandwidth capacity of your internet connection. You will have to consider this carefully. Obviously if you only have a 56k slowdom you won't want hundreds of people accessing your computer all at once; that would be a fruitless exercise for all concerned. On the other hand, a faster connection will allow you to offer access to many users simultaneously whilst maintaining a reasonable bandwidth to user ratio. A good rule of thumb is to consider the speed you would be happy downloading at, and subsequently adjust your settings accordingly.

The next thing you need to do is set the location of the text file you wish people to view whenever they connect to your computer. This should contain any information regarding server uptime/downtime, usernames and passwords, rules and regulations and so on. Finally it is a good idea to place some limits on the number of times a single user can attempt to make a connection to your computer within a delineated period of time. This will prevent people from 'hammering' your site in order to gain access as soon as another user logs off, freeing up one of your allocated slots.

That just about covers all the changes you will need to make in the 'setup server' menu, so click on the 'OK' button to return to the main menu. The next step involves setting up at least one username and password combination to be circulated amongst those people you intend to leave the welcome mat out for. To do this, click on the 'setup' button once again, but this time choose the 'users' option. Your first task is to enter a username and password in the... yes, you've guessed it, the boxes labelled 'username' and 'password'. These fields can consist of any characters you like, but bear in mind they are case sensitive. As such the password 'lemme-in' is not the equivalent of the password 'LeMme-in'.

At this juncture you will have to select a 'home' directory. This will be your user's first port of call once a connection to your computer has been established. Obviously it wouldn't be very wise to let any Tom, Dick or Harry have full control of your PC since they could wipe out your hard drive, delve into your private documents, upload viruses or, well, do anything they like really. For this reason I would strongly advise creating a new directory populated with only the files you wish remote users to have access to. For the sake of simplicity call this 'ftpserver' and enter it into the 'home directory' dialog box.

Your final obligation is to decide which permission attributes to associate with your directories - click on the 'add' button from within the 'file/directory access rules' area of the 'setup users' window and select the directory you chose as 'home' earlier. To complete the process you will now be required to put a tick in all the relevant boxes. In the directory you want people to be able to browse and download from it would make sense only to tick the 'read' box from the 'files' section, the 'list' box in the directories section and the 'inherit' box in the the 'sub dirs' section (this enables people to view the sub directories within your home folder). This ensures that people can download whatever they like, but cannot remove anything that is already there or add anything new. If you also want people to be able to upload files, you are best advised to create a new directory called 'uploads' and change the permission attributes accordingly. In this case you will need to tick the 'write' box in the 'files' area, the 'make' box in the 'directories' area and the 'inherit' box in the 'sub dirs' area (again so people aren't left fumbling in the dark).

You must now decide if you would like to use one configuration for all your users, or to give each individual user independent access rights. The process is identical no matter how many different username and password combinations you decide to setup, so if you wish to add more simply retrace the steps above until you're happy with your setup.

Sharing is the name of the game, so in typical Robin Hood fashion, all that remains to be done is to divulge your IP address to the rest of the world... or at the very least to a handful of carefully selected, trustworthy technophiles. No, don't mention it - everything I do, I do it for yoooooooou. I'd walk the wire for you, don't you know... whatever that means.

Saturday, 6 March 2004

,

What is an FTP port?

In this context, a port is a term used when referring to the location of FTP sites - it is an essential extension of the address used to access them. This port number is tacked onto the end of the address in the form ':564'.

A real life equivalent of trying to access an FTP site using the wrong port number would be going to the right building to retrieve something, but then wandering around aimlessly on the wrong floor. The result: you won't find what you are looking for, most likely because the door you eventually knock on is the wrong one.

If an FTP site is not assigned with a specific port number, it will use the default value of 21.

Port numbers, nevertheless, are also used to access other forms of computer communication software such as email clients, instant messengers and so on. It is wise to close off access to those ports which are not currently in use using a firewall. This prevents hackers from gaining access to your system - see the anonymity tutorial for further details.

Monday, 17 November 2003

, , ,

What is a .par file?

If you've ever dabbled in a spot of spanned archive downloading you'll know that getting them to work isn't always plain sailing. Several bytes are often lost on the long journey from remote servers to your computer, and even more infuriating, sometimes the uploaded files are corrupt to begin with. Par files are designed to combat these problems as they are capable of rebuilding partially intact archives.

For instance, if you have downloaded twenty rar files, yet one of them is corrupt, rather than downloading that file again, providing you have the accompanying par file, you can rebuild the missing file to complete the set. Making use of such a technique is obviously subject to your ability to get hold of your archive's accompanying par file. If there isn't one available you will have to re-download the rogue files as you would normally.

The 'par donor' doesn't necessarily have to be the person who created the archive originally since anyone with the complete set can construct an accompanying par file and then pass it on to anyone who is having problems extracting the set. For more information refer to the Quick Par home page.

Thursday, 10 July 2003

,

File Interrupted

I've been downloading a large file from an FTP site for several hours and it has suddenly become inaccessible. Even though I can log in using the same username and password I cannot resume my download. What am I doing wrong?

This can happen when the owner of the FTP site has moved the files from one drive to another. When you log in, the layout looks identical so it can be difficult to spot the problem.

To correct the location of the partially transferred file and resume your download, search for the file using your FTP client and then right-click on it. Now select 'copy URL to clipboard'. Open the download status window of your FTP client or download manager, right-click on the half finished file and select 'change URL'. Finally, right-click in the dialog box and select the paste option. Now when you double-click it to resume downloading you should be able to continue from where you left off.

Monday, 7 July 2003

, , , , , ,

Share and share alike - file sharing clients uncovered

Following the immense success of Napster, it was only a matter of time before someone posed the question, why not develop a program that allows people to exchange other file types as well as MP3s?. A very good question, and one which was swiftly answered by a deluge of file sharing clients based on the now infamous Napster protocol.

For those of you who haven't been formally introduced to file sharing clients and are wondering what all the fuss is about let me explain. Despite the gamut of different interfaces and slogans, all file sharing programs share the same basic premise; they allow anyone with minimal computer know-how and an internet connection to become part of a gargantuan, global file sharing community. Once you've chosen your bandwagon and you're comfortably sitting on board, the sky's the limit; you can download any file format imaginable, no matter how large it is, or where in the world it's located. So in a nutshell, file sharing clients provide an efficient means of exchanging data over a digital medium.

While some clients hinge on the operation of a central server or servers and so are vulnerable to attacks from the lawyers of irate pop stars, others allow you to connect directly to the computers of other users and hence side step any legal wranglings which may ensue. The best example of the first variety of client is Napster. Whenever you connect to the Napster exchange, a list of the files you wish to share is automatically uploaded to one of the Napster servers. Your list is then juxtaposed with the lists of other users and hence can be searched by anyone currently logged into the network. Connecting to a central server inevitably means that you lose your privacy, yet it does have the advantage of providing faster searches and transfers.

On the contrary, peer to peer connections offer much greater privacy, but also bring with them the drawback of longer search times and slower downloads. These systems operate on the foundation that the computer of every user connected to the exchange becomes a client as well as a server. One of the most noteworthy examples of such a network is Kazaa, which we will be taking a much closer look at shortly.

Nevertheless, the story doesn't end there - your third option is to connect to a network without using a client at all. These 'gateway portals' are much like web search engines in that you simply pop along to a web page and enter your query into a search box. The results appear as direct links to files, which can then be downloaded using either your browser or a download manager. These aren't really exchange networks in their own right, nonetheless, the reason they have been included in this discussion is because they allow you to search other exchange networks set in motion by third party clients such as the ones made available by Napster and Lime Wire for example.

While you can download files from other users via these portals, you are never really part of the community because you aren't logged into the network using a client, and hence you are restricted from uploading files in return. Although this might not worry you very much now, keep in mind that if everyone took without giving, there would be no files in circulation at all! Successful file sharing demands a symbiotic relationship, so make sure you do your bit to maintain the equilibrium. The real beauty of these portals is their simplicity - the only prerequisite to using one is that you can type, and as they tap into pre-existing exchanges they have an instantly accessible user base of millions.

Aside from the latter variety, file sharing clients tend to be a fairly homogeneous breed so if you've dabbled in a spot of MP3 collecting, searching for other file types using one of the many Napster clones should be a breeze. So now that you have been acquainted with the basics, let us take a closer look at how exactly these clients operate while we consider the special charms of each particular program.

While some clients insist that you logon to their network using a unique username and password, Napster and Kazaa for example, others will let you jump in with both feet straight away without registering, take Lime Wire for instance. The advantage of obtaining your own username is that you become more involved in the community, you have a net name which you can use to identify yourself in chat rooms and you can recognise your friends (or enemies!) when they are on-line.

Also you can make note of other people's net names so that you can contact them to organise file exchanges at a mutually convenient time etc. This is especially handy if the network is set up in such a way that your username forms part of the email address you will use to sign in. If you wish to contact a member of a file sharing network which uses this arrangement you don't even have to be connected to the exchange to send a message, instead you can simply send an email using your usual email client. Conversely, clients which do not require you to register before joining the network offer the advantage of being much more anonymous; each time you logon you are nothing more than a series of digits (AKA an IP address). Again, Lime Wire is a good example of such a system.

On connecting to your chosen network, to enable you to regulate the extent to which other users can explore the contents of your hard drive, you are initially asked to select a directory where your shared files should be placed. It is also possible to restrict the types of files which can be remotely accessed by other users so that you are safe in the knowledge that no-one can tamper with any data that you don't want them to have access to. Whatever you store in this directory can be searched and downloaded by other users on the network, and obviously this works vice-versa. Although, if you're a real party pooper you can disable this option completely. This will allow you to download files from other users while preventing them from accessing your goodies - not very charitable at all! To combat this abuse of the system some programs will allow users to prevent free loaders from accessing their computers, so if you're being a scrooge, it's quite likely that the library of files available to you will be restricted somewhat.

Kazaa

No doubt you're eager to get started so let's take Kazaa as an example, dip our toes in the file sharing pool and see what we can find. Now that Napster is six foot under and pushing up the daisies, Kazaa is looking like a better prospect by the day. Most noteworthy is the fact that it uses a decentralised network so is less prone to attempts to shut it down. In addition, it speeds up download times by accessing parts of the same file from multiple sources simultaneously, is capable of resuming broken downloads, includes a built in IRC client which can be used to chat to other users and even provides its own media player which lets you view partially downloaded files.

Furthermore, since Kazaa has such a colossal user base there is a very good chance of you tracking down whatever it is your heart desires, whether this means finding the latest music albums, full games, applications or movies. Absolutely any file format in existence can be downloaded providing a currently connected user has chosen to share it. In short, it's pretty damn good.

As much as I hate to knock Kazaa, I feel it's only fair to point out its limitations as well as its strengths so you can see the wider picture. One minor niggle I have is that the client can be quite slow and clunky due to its reliance on a web based interface, yet I've also heard reports that the transfers themselves can be slow at times. Not that I'd know anything about that - I've known snails to overtake my 56k modem!

Most significantly, however, is the fact that the FastTrack network, which serves as the backbone of the client is riddled with misleadingly named files, viruses, worms and trojans, which if you're not careful can bring your computer to its knees in the blink of an eye. People have been known to spend many hours downloading monster files, only to realise when they unzip them, that they in no way relate to what they were led to believe they were transferring because they have been deliberately renamed to trick them.

Worse still, you could discover that what you've downloaded is actually malicious code designed to infect your computer! Nevertheless, providing you are aware of these pitfalls they shouldn't be cause enough to deter you from continuing to use Kazaa. What is called for is a combination of common sense and a reliable virus/trojan scanner. If you search for a CD image and the hits returned consist of tiny exe files, your alarm bells should be set ringing. These files will definitely not contain the data you're seeking.

Compressed archives can be turned into non-threatening, self extracting exe files, but since there is little point in doing so (who hasn't got Winzip or Winrar installed on their computer these days?), you should be very suspicious of anyone who claims to have turned their shared files into self extracting archives.

If the size of a file appears to be realistic, yet the format is executable I would still recommend steering well clear of it unless you know for certain that the original format should be exe, as is the case with many shareware applications for instance. Of course, anything you download from Kazaa, or the net in general, should be scanned for viruses and trojans regardless of how suspicious you are of their legitimacy.

A final handicap to note is that the search results appear very cluttered because the program simply tries to display too much at once without segregating the information properly. The column widths of the results window can be manually resized to make things a bit more organised, yet frustratingly the client is incapable of remembering your settings the next time you return to the search window. Despite a few minor niggles though it's one hell of a good client and will only get better with time.

OK, are we sitting comfortably boys and girls? Then we will begin. First of all I should point out that it is not recommended that you download the official Kazaa client, but instead opt for its much improved, cut down, younger brother, Kazaa Lite. This takes all of Kazaa's superfluous, bloated and privacy intruding 'features', mercilessly hacks them out and throws them in the trash can where they belong leaving a much leaner, more stable and most importantly of all, 'clean' client.

When I say that Kazaa Lite is 'clean' I'm referring to the fact that it no longer contains spyware, adware or banners of any kind. Many people erroneously believe that the lite version of Kazaa also contains spyware, yet if they had done their homework they would know that what their spyware scanner is actually detecting is a kind of spyware emulator rather than the real thing. You see, Kazaa will not function if it detects that its spyware has been removed, and this is why it has to be replaced with a dummy file instead. In Kazaa's case, the integrated spyware file responsible for invading your privacy is known as Cydoor and has the filename 'cd_clint.dll'.

If after installing Kazaa Lite, your spyware scanner insists that you banish this file from your system, you should inform it that you know better and tell it to leave it be. Once this file has been identified it would be a good idea to add it to your scanner's exclude list to ensure that it isn't removed by accident in future.

Sooo, moving swiftly on. Download the program, install it and then click on its icon to get it up and running. When the wizard prompts you to enter a username and password, follow the instructions and then proceed to connect to the network. If you're using a slow connection it would be wise to set some limits before we move on, so click on the 'tools' button located on the menu bar and select 'options'. Now click on the 'uploads and downloads' tab and reduce the number of simultaneous connections; sadly, two is more than enough for us poor 56k-ers.

While we're here you might also want to set the directory in which you would like to store (and share) your files - make sure it's located on a drive with plenty of space. When that's taken care of click on the 'search' tab, select which file types you wish to search for, type in your query and hit the 'search now' button. Wait for the results to appear and then double click on whatever takes your fancy to begin downloading it. You can do this with as many files as you like without straining your internet connection since they will not start transferring immediately, but will instead be added to your download queue.

As your current files finish downloading, new ones will begin transferring automatically analogous to the way in which your download manager works. To check that everything is going according to plan you can click on the 'traffic' button. From this menu you can cancel, pause or resume your transfers in addition to being able to send a message to the users you are downloading from. Once a couple of files have finished downloading you might want to preview them using Kazaa's built in media player, which is located under the 'theatre' tab. That's all there is to it. Enjoy it while it lasts.

Gnutella

Gnutella began life as a file sharing client much like any other, however, the original program responsible for spawning a multitude of clones has now been abandoned and the developers are urging people to stop using it. Nevertheless, this isn't the end for Gnutella - it is merely the beginning of a new era. A common misconception is that Gnutella refers to a particular client which connects to a single, self contained exchange network - this simply isn't the case. It is a free for all, decentralised peer to peer network which can be accessed using a variety of different clients, all of which are far more advanced than the original vanilla flavoured version developed by two Nullsoft (you know, the Winamp people) employees.

No doubt the first question on your lips relates to the origin and significance of the name Gnutella. According to the FAQ on the home page, the 'Nutella' part refers to a "chocolate and hazelnut spread that is phenomenally popular among Europeans". The 'G' tacked onto the beginning is reminiscent of the Unix-like operating system, GNU, which was the seminal work of the Free Software Foundation.

Richard Stallman et al believed that source code should be made freely available allowing people to modify it to create their own software with the caveat that whatever is produced may also be recycled - Gnutella was built with the same philosophies in mind which is precisely why there are so many variations of the original client to choose from. I'm sure the addition of the 'G' also helped to avoid legal battles over patented trade names. I hope that serves to satisfy your epistemophilic urges. ;)

Pushing semantics aside for now though, what advantages does Gnutella offer over centrally indexed networks? Well, the first thing you will notice is the fact that Gnutella needs no centralised server in order to share your files, unlike programs such as Napster, for which this is a necessity. The reason for this is that the users themselves create the servers in a peer to peer network model. In layman's terms this means that you connect directly to the person's computer from which you are transferring data. As a result, no logs are kept of your searches, so anyone who is paranoid about the existence of echelon or an omnipotent 'big brother' can relax safe in the knowledge that they are anonymous.

Also, because no central server exists the system cannot be shut down, and since there is no single individual or company that can be held responsible for its creation, Gnutella is practically bullet proof in that it is capable of withstanding attacks from the FBI, lawyers, earth, wind and fire (did I leave anything out?). Another rationale for this fact is that Gnutella is basically a protocol, which in theory can be used for illegal purposes, but was not specifically designed with these intentions in mind. Analogously, the same can be said for cars, hammers, kitchen knives and all sorts of other seemingly harmless objects, and no one is likely to attempt to ban mundane items such as these are they?

But enough talk, it's time for action! To get started you're going to need a client to tap into the Gnutella network. In the early days you had an extremely taxing decision to make; you used either Gnutella 0.56 or you used Gnutella 0.56, but nowadays the options are much more varied so if you don't instantly gel with one client you can simply banish it to the recycle bin and test drive another. If you try counting all the different varieties on offer you'll run out of fingers and toes in no time. Many of these are a waste of time and bandwidth so let me save you the hassle of separating the wood from the trees by directing you towards the best of the bunch from the outset. These include Xolox, Lime Wire, Bear Share, Gnucleus and Phex and I'll deal with each one in turn below.

When Gnutella first took off it was necessary to manually enter an IP address into the client to allow you to join the network. Any old IP address wouldn't get the job done - it had to be the address of a user who was already connected to the Gnutella network, and to find out this information you had to visit a central repository of IP addresses. This was very inconvenient as you had to find a new address each time you wanted to logon, so to circumvent this problem the client developers introduced a system which gathered these IP addresses and automatically connected your computer to them whenever you opened the client. Consequently, if your client still asks you to manually enter an IP address it is likely to be very outdated, in which case you would be best advised to update it.

Because there is no central server which deals with all the file searches and transfers which go on between users, the system must rely on direct peer to peer connections. While this process is now completely automated, what your client is actually doing when it starts up is looking for users who are already plugged into the network. When it spots these users, it connects you to a small selection of them and in turn these users will be connected to a further group of users in such a way that eventually all the computers in the network will be daisy chained together. Whenever you perform a search, in the blink of an eye your request is filtered through thousands of computers across the world before the results are presented on your screen.

So all in all it's quite an impressive system, don't you think? Gnutella is the future, embrace it with open arms zombies... erm, I mean people, commence dribbling and chant after me, "Gnutella is our leader, we love Gnutella".

And now, without further ado let's welcome on stage the reviews...

Xolox

The Xolox developers have chosen to take the Microsoft approach in that they've designed a client which insists on doing absolutely everything for you whether you like it or not, the result being that half the people who have tried it loathe it with a passion, and the other half think it's the best thing since sliced bread. The majority of the features you will find incorporated into rival clients are missing with the exception of an IRC chat applet, and again, this can either be a bonus or a curse depending on your level of experience of the Gnutella exchange.

If you're a Gnutella novice this is the perfect client for you because there are no options to tweak; run the client and a plug and play style auto configuration system takes care of the rest leaving you to get on with the task of searching for and downloading files. Gnutella doesn't get any more idiot-proof than this - if you can't fathom out Xolox you shouldn't be let loose on a computer.

Other benefits include the utilisation of 'background intelligence', which in theory allows the client to maintain connections and continue downloading in spite of transfer problems without any intervention from the user. Downloading from multiple sources, known as 'swarming', is supported effectively boosting transfer speeds, no spyware whatsoever is installed along with the client with or without your consent, plus the client itself is tiny and extremely resource light.

Further enhancing Xolox's almost 'hands-free' operation status is its ability to automatically complete search strings a la Internet Explorer. Each search query is conducted within its own window allowing you to multitask, and search results are continuously updated as and when new users join or leave the network to keep them current. Downloading of partially completed files is also supported providing many more connection outlets from which to download in addition to reducing the strain for those users who possess the complete file you wish to transfer.

Until recently, the Xolox project had been all but abandoned. The resurrected version therefore has a bit of catching up to do before it can compete with the better established clients in terms of stability and reliability. If you're looking for hassle free downloads and are prepared for a few teething problems I'd enthusiastically encourage you to give Xolox a whirl. If on the other hand you were born to tweak I would advise you to look elsewhere for your Gnutella fix.

Lime Wire

The most striking thing about Lime Wire is how pretty it all is. It uses those perfectly rounded aqua-effect buttons throughout, which are all the rage on web sites at the moment and the whole thing smacks of Apple Macism (look, I'm allowed to make up my own words, it's my site), which is no bad thing seeing as Mac applications are so much more aesthetically pleasing than PC equivalents. Oh and another thing, the startup logo reminds me of one of my favourite t-shirts, which is nice (well it matters to me, OK :p).

Pretty graphics do not a good file sharing client make, so what else has it got to offer? Well my inquisitive chum, for a kick off, because it's built on the foundation of the very popular Gnutella network there are always plenty of files to go round. What's more, while many file sharing clients are restricted to use on Windows based computers, because Lime Wire is coded entirely in Java it will run equally well on Windows, Mac or Linux systems.

Another major bonus is its ability to search for any file type, not just MP3s. The logical way it handles downloaded files is worthy of a mention too. Files are first downloaded into an incomplete downloads directory, and only when they are complete are they moved into your shared folder - a nice touch which should help to reduce the distribution of incomplete files.

A final plus point to consider is Lime Wire's extremely intuitive interface, which really couldn't be any easier to navigate. In fact one of the program's major benefits is that you can jump right in with both feet and start searching without so much as a glimpse at a FAQ entry or tutorial.

Sadly, the flip side of this particular coin is also one of its most salient drawbacks. Because the Lime Wire development team have done their best to aim for simplicity, you often find yourself somewhat restricted in terms of the potential search refinements. For example, you cannot specify minimum or maximum files sizes, connection speeds, file quality ratings and so on, so much of the filtering has to be done by hand.

Another feature considered both an advantage and a disadvantage simultaneously is the 'punish freeloaders' option, which allows you to prevent people from downloading your files if they refuse to share their own. This sounds logical in theory, yet the program offers too many options to limit the number of simultaneous uploads and the bandwidth allocated to each upload. While this should encourage more people to share their goodies, it also leads to a situation where you find yourself sitting around in endless queues while you wait for other user's free upload slots to become available.

Yet another limitation arises, not as a result of the program itself, but due to the network its operation hinges on, the Gnutella exchange. Because so many people are all scrabbling around for the same files at the same time, the speed at which transfers commence can suffer and it can also take quite a while to connect to the network in the first place. Nevertheless, this will be the case no matter which Gnutella client you choose, so we can hardly hold Lime Wire responsible for this.

My final whinge is that unless you choose to opt out of installing the bundled software which is integrated into the installation package, your system is infected with spyware. You aren't forced to install these privacy invading 'features' yet I'd be much happier if they weren't on offer at all. This represents half of Lime Wire's revenue model. The other half involves the implementation of revolving ad banners. These are present only in the free version of the client; the pro version, available for a small fee, contains no ad banners or spyware.

Buying into this 'less is more' upgrade may be cheap, but why you'd want to bother at all when there are much better alternative Gnutella clients available for free is a mystery to me. In any case, if you really wanted to, you could use the free version of the client to locate and download the ad-less version to save yourself a few quid. Personally I'd rather use Gnucleus instead.

Bear Share

If only Bear Share was a bit more like Yogi, smarter than the average bear that is, we might have a half decent client on our hands. As it is, the only pluses can be attributed to the Gnutella network rather than the program itself, and since you can enjoy these benefits using any client which taps into the Gnutella network, they aren't worth restating.

While Bear Share does come bundled with a host of irritating third party spyware junk, it doesn't insist that you install it. It is an optional extra and providing you don't just click 'OK' at every stage of the installation process it shouldn't concern you. On the other hand, the second source of intrusion, the banner adverts, can't be avoided unless you upgrade to the pro version. The same goes for the automatically generated pop-ups thrust into your face periodically whenever you run the client. Furthermore, the whole thing is riddled with marketing gimmicks which desperately try to draw you back to the Bear Share home page like a neurotic human magnet.

As if these invasions of privacy weren't bad enough, Bear Share also brings with it certain security risks. For example, it will quite happily display your IP address for all to see so that anyone with the right computer know-how can access any part of your system with minimum exertion.

What is also very disconcerting is the constant flow of traffic between your computer and the servers you are connected to - even when your transfers have completed, the program still maintains a persistent level of incoming and outgoing data. A logical explanation for this has yet to be ascertained and therefore it should be treated as a major cause for concern. While we're on the subject of security, another worry is the fact that the developers haven't even bothered implementing a filter to protect you from the Gnutella worm, again putting users at risk.

You want more reasons not to use it? Well it's also plagued by an inability to refine your search queries, which results in endless lists of irrelevant files. The downloads are particularly slow and unreliable, even when taking the inherent network problems into account. When you uninstall the damn thing it leaves spyware files behind, the interface is particularly uninspiring and isn't nearly as intuitive as that of Lime Wire. Finally, in terms of available options, the client offers only the bear necessities (actually this isn't true, but I couldn't resist getting at least one bear joke into this review :D).

In fact, Bear Share's only saving grace is that it employs 'swarming', a technique which enables you to download files from multiple sources simultaneously to speed up transfers in a similar way to that of Flashget. That said, this is rapidly becoming a standard feature of all the best file sharing clients so is hardly a sufficient reason to warrant using this CPU hogging piece of BS (hey, don't blame me, I didn't name it!).

Gnucleus

Having extensively researched the whole conglomeration of Gnutella clients you get the feeling that once you've seen one you've them all, yet this is exactly why Gnucleus comes as such a refreshing change. While it's not going to revolutionise the Gnutella experience, it does have one or two unique features which set it apart from the crowd, and after all, when you're presented with such a homogeneous bunch of programs it's the little things that count.

While the interface is far from visually inspiring it excels in terms of functionality; it's clean and uncluttered and only presents the most salient options initially, making it simple to use even for the most uninitiated Gnutella newbie. Also, because you are not instantly bombarded with options and menus Gnucleus has a very gentle learning curve allowing you to begin downloading within seconds of running the client. This isn't to say that Gnucleus lacks the more advanced features of other clients, it's just that they are neatly tucked away out of sight so that only the people with the necessary knowledge to understand their purpose will stumble across them if they wish to delve a bit deeper.

Another facet of the client which you are unlikely to find in rival software is its ability to use multiple windows, allowing you to multitask just like you would in Windows with a capital w. Best of all, this provides the means to conduct as many searches as you like simultaneously, so for instance, if you have a vague idea of the name of the file you seek you could type in five slightly different variants of it and then sit back and watch the hits filter through without delay.

Also worth noting here is the fact that searches have no definite end state; they are constantly updated as and when new users log on or off ensuring that you always have an accurate impression of what's out there, and more importantly what's available at that precise moment in time. These search results can be further refined using none other than the 'refine' box. How's that for intuitive? This allows you to locate your desired files with pinpoint accuracy as it provides the means to filter out irrelevant hits. What's remarkable about this function is that it works in real time so each time you type in a character, the results are instantaneously updated so you can type, delete and type again without having to actually submit your query in the usual manner. In practice this works much like one of those grappling hook games you're likely to find at a fun fair, except that it's free and isn't rigged to make sure you lose nine times out of ten.

While these extras are great, they wouldn't be much use if the client couldn't perform the more rudimentary functions which define Gnutella clients, and luckily Gnucleus is no slouch in this department either. Conducting search queries is very straightforward and options are available to limit your results to particular file sizes and minimum transfer speeds. Some might say there aren't enough options to help you narrow down your search queries, but then adding all sorts search toggles and modifiers would clearly be detrimental to the developer's much cherished KISS philosophy. If you ask me they've got it spot on; anyone wanting more control over their search queries would be advised to be more imaginative with the keywords they use, by also entering file extensions for instance.

What you see is what you get with Gnucleus. It contains no spyware files and no encrypted information is passed between you and the Gnucleus HQ in the background. In addition, it isn't plagued by intrusive banners or other marketing gimmicks as are so many of its rivals. Again on the plus side, the client is compact and fairly resource lean when compared to the competition, and perhaps best of all, it is 'open source'. This means that the code can be scrutinised, updated and rewritten by anyone with the necessary technical know-how, and because its success and future development does not merely rely on a single person or team of programmers it is much more likely to stand the test of time and grow from strength to strength.

There's always a 'but' though isn't there?, and as wonderful as it is, Gnucleus's 'but' is quite a biggy I'm afraid. While you can locate almost anything your heart desires in a matter of seconds, the problem lies in actually downloading it to your own computer. Files are very often unavailable and servers can get extremely busy. When downloads do eventually kick into action they can be unbearably slow and frequently 'time out' before they are complete. Nevertheless, despite these transfer problems I refuse to give up on this one as it has so much to offer. I remain hopeful that with time and a bit of tweaking the situation will improve.

Phex

Like Lime Wire, Phex is written entirely in Java, however, whereas Lime Wire is a standalone application, Phex has to be propped up using the Java Runtime Environment (available free from Sun Microsystems). The client itself is a mere 670kb, but don't let that fool you into thinking you're getting a compact application as the Java environment setup will add another 5mb to your system. Why the developer decided to go down this route is a complete mystery to me, but I expect he'll create a standalone package in future versions if only to silence the critics. You'd think that writing an application entirely in Java would provide some benefits, yet the rationale behind this arrangement is completely paradoxical. Because Phex is a pure Java application it doesn't have to be installed, yet this advantage is instantaneously counteracted by having to install the JRE, without which the package is useless.

In its defence, Phex is open source which means that the developers can't get away with hiding any privacy intruding 'features' in the code - not that I'm suggesting for a second they ever had any intention of doing so. I'm sure you know what I mean; open source applications are generally more 'honest' than... erm closed source alternatives. Complimenting Phex's open source status is the fact that the client contains no spyware or revolving ad banners of any kind, which is always a huge bonus considering the current era of dwindling personal privacy we now find ourselves in. Yet another plus is that Phex is a multi-platform application equally capable of running on Windows, Linux or Mac systems.

It has been said that this isn't a client for the Gnutella newbie because it incorporates so many advanced configuration options, yet it's really no more difficult to use than any other client. What initially baffles some users is the fact that the package consists of a single 'jar' file. Without installing the JRE this will appear as a standard compressed archive providing you have Winzip or an equivalent decompressor installed. The confusion sets in when people try to find an executable file within the package and realise that there isn't one. This is because pure Java applications do not use executable files, instead they only spring into life when double clicked after the Java runtime environment has been implemented. Once this is installed the file's icon will change along with its associated application so that it can be opened in the same way as an executable file.

While this isn't a huge inconvenience it does tend to put people off. I'm certainly not saying it's a bad client as it does have much to commend it, most notably the way in which it intelligently and efficiently manages file transfers, but when there are so many other excellent alternatives available I can't think of a single reason why you'd want to choose this one over the competition. In conclusion, Phex is a solid, reliable client, but unless some unique features are implemented in future versions to set it apart from the other better established clients I can't really see it taking off.

Non-Gnutella client reviews...

iMesh

I once said that:

"If we're going to compare what's hot and what's not in terms of file sharing clients, iMesh definitely belongs in the below freezing category. It's a lot like a fish finger which has been forgotten about and left to rot in the bottom of your freezer - it should only be handled with extreme care whilst wearing rubber gloves and a nose peg".

Yet since then the interface has been completely overhauled and the client now connects to FastTrack, the same network shared by Kazaa, Grokster and Morpheus before it switched to Gnutella. This means that users of iMesh now have far more files available to them than ever before and since the newly revamped version of the client supports swarmed downloads and resuming, even the 56k-ers have little to fear.

Whilst the Grokster and Kazaa clients are almost impossible to tell apart, the iMesh interface offers a real alternative. Search results are far less cluttered and the GUI is skinable and extremely intuitive. Because the client plugs you into the FastTrack network, the speed of transfers and the number and variety of files available should be identical. Nevertheless, many people are reporting that somehow iMesh manages to improve their experience on all three counts.

So there's the good, the bad I'll discuss in a moment, and now that it comes equipped with a skinable interface, it's only as ugly as you choose to make it. One thing which hasn't changed since I declared installing iMesh on your computer to be the equivalent of demonic possession for the cyber age is that it is still riddled with spyware and an excessive amount of other bundled junk. Technically it is the third party software which contains the malware, but why split hairs? If it comes in a single package it amounts to the same thing in my book.

In iMesh's defence, you are given the choice of whether or not to install this extra filth, so it isn't all forced on you without your consent. It's a shame the same can't be said for the ads, yet why worry about any of it when you can visit the iMesh Lite home page and download the much more compact, de-junked version? As for the negatives, I can't think of any others. It's no longer "as stable as Del Boy's Robin Reliant", as I once complained, and it's not the system resource guzzler that it used to be.

If you love the FastTrack network, but yearn for a break from off-the-peg, carbon copy clients like Grokster and Kazaa this is definitely worth a shot. Yet the critical deciding factor should be your preference for ladybirds - I bet the programmers are inundated with bug reports! Ha-de-ha-ha!

Removing spyware and ad banners

As I've already explained what spyware is, and why you would want to avoid using spyware ridden software in the anonymity tutorial, I'll skip the definitions and move straight onto to telling you what you can do to rid your system of it. File sharing clients, as I'm sure you are well aware by now, are renowned for including spyware files in their installation packages. While spyware files can be tricky to remove without completely disabling the application they came bundled with, it is possible. The way in which this is done varies from one client to the next, yet I'm not going to provide detailed explanations of how exactly to go about this for the sole reason that it is a waste of your time and mine.

Why so? Well, since Dr Damn of Clean Clients fame has already gone to great lengths to hack the spyware out of many of the most popular file sharing clients and made his much improved modified versions available to anyone who wants them, there seems little point in using the official versions and doing the dirty work ourselves. Unsurprisingly web hosting companies aren't exactly falling over themselves to host Dr Damn's creations and as a result he's currently websiteless. Not to worry though, I'm sure a quick search at Google using the keywords "dr damn" and "clean clients" will bring home the bacon.

If you want to use a client which hasn't been given the Dr Damn treatment I would suggest using Ad-Aware to remove the spyware manually. This operates much like a virus scanner, but instead of detecting viruses, it searches for spyware, and once found, it gives you the option to have it removed. If you find that you can't remove the spyware from an application without completely disabling it, I would encourage you to uninstall it and look elsewhere for an equivalent spyware-free program - there are plenty out there so there is no reason you should settle for second best. Not sure if the program you want to install contains spyware? Whack its name into the Spy Checker search engine and find out. Prevention is always better than cure!

Another good tip to aid your war against spyware is to install a firewall. You should really have setup a good firewall long before now, but if you haven't, do so now. An excellent free firewall can be found at Zone Labs, but if Zone Alarm isn't your cup of tea refer instead to my other recommendations in the tips section. With a firewall installed you will be able to veto applications before granting them access to make external connections. Zone Alarm is one of the few firewalls that will ask your permission before taking action of any kind, which is why it's such an effective anti-spyware measure.

Other firewalls will also deny spyware files access to the outside world to relay information regarding your surfing habits etc, yet more than likely they will not alert you to the fact that these attempts are being made at all. If you are kept informed of which programs are talking behind your back, you can stop them in their tracks by uninstalling them and removing any orphan spyware files using Ad-Aware.

Sometimes the challenge is not ridding your computer of spyware, but eliminating banner adverts from applications. You may consider these annoying or distracting rather than intrusive, but many of them are akin to spyware or web bugs in that they are capable of transmitting details such as the OS or browser you have installed, your screen resolution or even your IP address to third party advertising companies.

Be that as it may, eradicating this further source of intrusion can usually be done with 100% effectiveness and without tampering with the application in question because the majority of ad servers transmit their spam by the same means. The solution to this problem requires you to edit your operating system's 'hosts' file. This is nothing more than a simple ASCII text file minus the extension and so can be edited using Notepad or an equivalent text editor.

Because different Windows operating systems can place this file in various locations I would advise you to use your operating system's built-in search tool to track it down - simple type in 'hosts' with no extension and click on the find button. Once found, right click on it and select 'open with', choose Notepad and click OK to delve inside it.

The reason this file is on your system to begin with is to allow you to map web site addresses to their corresponding IP addresses. It isn't strictly necessary that you go anywhere near this file normally, yet doing so brings with it certain benefits. For instance, if you know what the IP addresses of the sites you visit most often are, you could enter these into the hosts file to allow your browser to contact the server they are stored on and load their contents faster. If no such information is found in your hosts file, your browser will instead look to your ISP for the IP addresses that are required to contact the sites. Once this DNS information has been determined your browser can proceed to load the site.

How does this help you to block out banner adverts? Well, the trick is to enter your computer's own IP address (127.0.0.1) into the hosts file alongside the address of the ad server you wish to block to deceive it into thinking that the ad banners are located on your own hard drive. For example, if you discovered that the ads being served to your file sharing client emanated from www.adserver.com, to block them you would enter "127.0.0.1 www.adserver.com" into your hosts file. This isn't rocket science; all you need to bear in mind is that each individual server you wish to block must have its own line and there should always be a gap of at least one space between your computer's IP address and the web address of the server you intend to block.

With these changes in place, whenever your file sharing application attempts to call an ad banner it will look to your own computer for the files rather than the real ad server. Because the request is being made from and to the same computer, the application either assumes it has located its target and displayed the ads correctly, or after failing to locate the ads it simply gives up, leaving you with a blank space where the ads would ordinarily appear.

This isn't the only way you can use the hosts file to your advantage. Say there's a web site you visit regularly which you know is laden with ad banners. If you find out the IP address of the server which is making these ads available, you can block those banners too using the same method described above. It's also possible to block access to whole sites if you so wish - this can be particularly useful if you have young children who you want to protect from objectionable material etc.

Surely it's not possible to make ad blocking any simpler? Well yes, it is strangely enough - you could use a dedicated program to edit your hosts file, or you could even download a pre-configured hosts file and use it to overwrite your empty one. You can further your knowledge of both these techniques and much more besides by talking to the Gorilla - don't worry, he only bites snoopers and marketing people.

More of the same...

No sooner have I finished telling you about the dynamic duo that is Gnucleus and Kazaa and the very promising, but strangely titled Gnutella the market is flooded with new contenders for the file sharing trophy. Not to worry though, by checking back here every so often you can ensure that you are always kept up to date of any new developments:

Audio Galaxy - A lightweight, unobtrusive music sharing client, which uses private (non-Napster) servers to route traffic. Supports auto-resuming and even has the ability to download music from users who aren't online... well sort of anyway. It'll make more sense when you try it :)

Blubster - Refer to my MP3 tutorial for an in-depth review/tutorial.

Direct Connect - As the name implies, Direct Connect allows you to access shared folders on the hard drives of other users in a peer to peer fashion without the need for a centrally indexed network. Incorporates public and private chatting and an integrated search feature. Currently basking in a surge of popularity amongst the warez community, but no use whatsoever unless you are prepared to give as well as receive - before granting access most hubs will you require you to share a pre-determined minimum amount of files... and we're talking in terms of gigabytes, not megabytes. Not one of the most user friendly file sharing clients available.

Carracho - What sets this one apart from the crowd is the fact that it is designed to be used exclusively with the Mac OS.

E-Donkey 2000 - One of the more impressive non-Gnutella clients. Doesn't rely on a centralised network, allows you to share any file type and also includes that all important resume function. A particularly good source of full movies and ISOs, but be warned, it is not recommended for newbies since to get anywhere with it, configuration tweaking is a necessity. I can't believe I managed to describe this one without cracking a single donkey joke!

Grokster - Plugs users into the FastTrack network to facilitate peer to peer transfers of many different file formats. Almost identical to Kazaa, so which one do you choose? Toss a coin maybe?

Morpheus - Re-branded, outdated version of Gnucleus with added marketing garbage. Stick with Gnucleus instead.

Soul Seek - No ads, no spyware, no clutter. A free music sharing client which boasts a GUI which is as simple to use as the grandpa of all peer to peer clients, Napster, once was. Looking beyond the obligatory functions, most noteworthy, it allows you to download whole folders full of MP3 files with a couple of clicks and supports 'wish lists' which simplify the process of performing repeat searches for your favourite music.

URL Blaze - Not your average file sharing client. In fact, it's not a file sharing client at all - what it shares are URLs to files. It monitors the locations of the files you download from web servers and subsequently makes these addresses available to other users who may be searching for the same files. More of a link harvesting gadget then.

Win MX - Allows you to simultaneously connect to many established networks based on the Napster protocol, but unlike Napster any file type can be downloaded. Supports download resuming and offers anonymous transfers.

For more reviews and links to file sharing clients check out Zero Paid.

Monday, 4 November 2002

, ,

What are Serv-U, War FTP and Bullet Proof FTP Server?

Since the name of the latter program was changed from Gene 6, newbies have had less trouble guessing its purpose. Here's a further clue: War FTP and Serv-U do exactly the same thing.

For those of you still fumbling in the dark for answers, these are all FTP server clients, which allow you to setup your computer as a file distribution system known as an FTP site. These allow you to selectively share your data with people who you have given your IP (internet protocol) address to.

When you log into an FTP site, the name of the server software being employed is usually one of the first details about the server to be displayed by your FTP client.

To discover how to set up your own FTP server consult the relevant tutorial elsewhere in my blog.

Friday, 18 October 2002

, , , ,

FXP (File Exchange Protocol) - Flash! Ahhh-ahhhhhhh... He'll save every one of us!

No, I'm not repeating myself; there is a subtle difference between the FTP and FXP protocols. The former allows you to transfer data from a remote computer to your hard drive, while the latter enables you to transfer data from one FTP site to another FTP site.

By setting up an FXP transfer you are tapping the slower of the two connection speeds of the computers you wish to transfer data between. So even if you only have a 56k modem, it is possible to transfer data at the speed of a T3 connection for example. The speed of your own connection has no bearing on the transfer rate because you are merely acting as the catalyst; the data never actually touches your own hard drive. One instance in which you might find this technique useful is when switching web hosts - if your site contains a sizeable library of video or music content, transferring it from A to B will take a fraction of the time it would armed only with your meagre home connection.

To get started you will need an FXP client. There aren't that many around to choose from, but luckily what is available is top notch - head over to www.flashfxp.com and see for yourself. Before you can continue you will need a destination FTP site to transfer your data to. This could be any computer providing it has been setup as an FTP server and you know the login details.

Whenever you open a Flash FXP session you will be presented with a split screen display. The left side of the screen is used for browsing the remote FTP site you wish to transfer data from, and the right side of the screen is used for browsing the destination FTP site.

To begin with you will have to enter the IP address of the FTP site you wish to transfer data from. To do this, click on the yellow lightning bolt icon, select 'quick connect', fill in the login details and click on the 'connect' button. Switch to the opposite side of the screen, select 'quick connect' once again and enter the login details of your destination FTP site.

All that remains to be done is to decide what it is you wish to transfer and give Flash FXP the go ahead. The procedure is as follows:- highlight a selection of files, jab the 'add to queue' option and push the 'go' button. Finally, sit back and put your feet up while you watch the megabytes accumulate.

Ah, this would be the paragraph where I moan about some of the drawbacks that blight FXP - just for the sake of completeness you understand. One of the most pertinent issues is that not all FTP sites will grant you permission to transfer data to another FTP. The reason for this is that to use FXP, both hosts must support PASV mode and allow PORT commands to foreign hosts, and clearly not all do.

Something to consider when using free web space or a paid, shared, virtual account is the type of files you are allowed to store in your account. Some web host administrators, for example, will forbid you from transferring mp3 or zip files just in case they contain copyright infringing material.

These considerations aside, FXP is a skill worth mastering by any webmaster or server admin who deals with large files on a regular basis. You are unlikely to ever have access at home to the kind of bandwidth available through corporate networks so this is the next best thing.

Friday, 4 October 2002

, ,

Why do I get CRC errors when I unzip compressed archives? What is a CRC error?

These occur relatively infrequently, but most people have experienced such problems at one time or another. CRC is an acronym for cyclic redundancy check, a mathematical method used to calculate the validity of the data in a given archive.

CRC errors can transpire when files are resumed too many times during the download process and as a result lose a few bytes along the way. Consequentially they become corrupt and are ultimately useless. Some of the more advanced download managers have a kind of 'roll back' function to counter this problem, which re-copies the last few bytes of a file each time it is resumed. It's also possible to choose to what extent you would like to backtrack. This is useful because the amount of data which can become corrupt upon resuming a transfer is directly proportional to the speed of your connection.

Compressed archives, or any file type for that matter, can also become corrupt if they are downloaded too fast. If your computer is unable to write data to the hard drive as quickly as it is being downloaded, some of the data can be lost. What you must ensure is that your computer is sufficiently powerful to keep up with the demands of your modem. If not, you will have to employ your download manager to impose a speed limit on your transfers.

Several different methods can be used to repair damaged archives with varying degrees of success. To access Winace's archive repair function, browse along to 'archive' then 'repair archive' within the menus at the top of the interface. Similarly, Winrar's equivalent tool can be located under the 'commands' > 'repair archive' option. Don't be surprised, however, if they both fail dismally.

The developers of Winrar, in realising how useless these tools are, have now created a new system used to repair damaged archives and have made it available in Winrar versions 3.0 and above. It uses 'rev' files (recovery volume) to maintain a record of how to repair a given archive if it should become corrupt.

These work in much the same way as 'par' files (the topic of another blog entry) and in addition to providing the means to repair damaged archives, also allow you to rebuild missing segments of archives. Rev files can be created along with the archives they are designed to rebuild providing the relevant box is ticked beforehand. If a rev file is present when extracting the archives it will automatically be used by Winrar to repair and rebuild the archives on the fly.

Nevertheless, a less sophisticated yet dependable way of ensuring that your archives are error free, is to download them again and re-test them for CRC problems. If you experience recurring errors it would be wise to download the same files from a different location.

Monday, 30 July 2001

, , , , , ,

Houston, we have a (file transfer) problem

Common wisdom and research conducted by the Bureau of Made-up Statistics suggests that the best way to introduce a web tutorial is to impart a well-meaning, but overly patronizing metaphor. Let's give it a whirl then shall we. How's this? The internet can be thought of as a giant, digital take-away. It's brimming with tasty dishes for you to consume, but sampling them isn't quite as straightforward as dialling a phone number and getting the delivery man to bring them to your door.

As already noted in my 'essential applications' tutorial, the most efficient way to get your 'orders' from A to B is to employ a download manager. But which one to choose? If you're a PC user I'd recommend Flashget, while Mac people would be well-advised to use Folx.

With either of these applications installed, whenever you click on a file, the browser integration gizmo will kick into action and a download window will appear stating the file size, file location and estimated transfer rate of your chosen download. If everything goes according to plan you should simply be able to click on the 'download now' button and your download manager will take care of the rest.

This process can be repeated for a well-nigh infinite number of transfers - you do not have to wait for one file to finish downloading before clicking on the next one you wish to transfer. Each new file will be added to your download queue and transferred sequentially in the order they were clicked - unless of course you choose to rearrange them in order of priority. Once your download manager commences transferring a series of files you can close the web page where you found them and take your metaphorical surf board elsewhere. No more internet babysitting, hoorah!

It's all gone Pete Tong

At this stage there are oodles of snivelling error messages you may be confronted with. In determining the reason for the inaccessibility of a particular file some download managers are more informative than others. If yours ambiguously concludes that if a file cannot be downloaded it must simply be 'busy', it's time to switch to a more insightful application. Below you will find a list of some of the most commonly experienced file transfer errors, and possible workarounds for the non-fatal ones...

~ "File not found" - The file has either been deleted from the server, moved or was incorrectly linked from the outset by the webmaster. It could also be that the web space provider has zapped the file because its presence infringes copyright regulations as detailed in their terms and agreements of use tome. If you're confronted with this message it is probably best to look elsewhere for the same file - perhaps by prompting your download manager to search a variety of mirror servers or by manually scouring File Mirrors.

~ "Unable to connect to..." - You are most likely to see this message if the file you are attempting to download is stored on an FTP site. The explanation - FTPs are actually people's hard drives, which you can access only when their owners are connected to the internet. If you cannot get the file first time, just try again later. If this is happening frequently, the IP address may have been a temporary one and no longer refers to the location where the desired file resides (some ISPs will assign you with a new number each time you log on). The moral of this story is to download goodies from these sites as quickly as possible because they often have a short shelf life.

~ "Too many users - try again later" - Exactly what it says on the tin. The number of simultaneous connections permitted by many FTP sites is limited to a pre-determined maximum to keep download speeds to a reasonable level. Whenever this happens you will have to learn to be patient until it's your turn to connect. Do not 'hammer' the site (repeatedly try to access it) as this can annoy the owner who can then ban you from using it.

Another handy hint: if you've been banned, you will be abruptly disconnected from the FTP site without explanation whenever you try to log on - if you do not have a static IP address you can circumvent this dilemma by disconnecting from the internet and re-dialling. When you re-connect you will be allocated with a new IP address which will mimic the appearance of a new user the next time you try to access the FTP site.

To make sure this doesn't happen again, open your FTP client's options menu and extend the retry intervals to match the level deemed acceptable by the FTP sys op; anything above 20-ish seconds is reasonable. A better idea perhaps would be to schedule your downloads for a time when fewer users are likely to be accessing the FTP site - early in the morning (UK time) for example, when all the net-hogging American's are fast asleep.

~ "Incorrect password/username/access denied" - The owner is fed up with having hundreds of people clogging up his or her FTP site and has changed the password to prevent you from gaining access. This is very common where 'banner FTP sites' are concerned - those requiring you to click on various banners and hunt for keywords, which form the username and password necessary to access the server. Unsurprisingly this is another money making scheme - these sites are more likely to stay active as the owner has more to gain from keeping them up and running.

~ "Insufficient credits" - You are likely to see a message like this if you are accessing a 'ratio site' - one which requires you to upload a certain quantity of bytes before permitting you to download any of the hosted material. To solve this problem you can instruct your FTP client to begin uploading files whenever you are approaching the designated data transfer limit. This can be arranged simply by placing the files you wish to upload at the bottom of the list of currently downloading files. When you run out of credits they will automatically be uploaded. Alternatively have two FTP sessions open at once - use one to upload and the other to download simultaneously (some sites will limit your access to one connection per IP address so this method will work only when multiple connections are permitted).

~ Servers running Windows NT 4.0 and below do not provide support for the resume function. If you are downloading a file from an unresumable server and the connection is reset you will have to start transferring the file again from scratch. It is best to avoid such files like the plague, especially if they are quite large, but if this isn't feasible, download them one at a time and make sure you do not surf the web simultaneously if you have a slow connection. This will allow you to maximise the bandwidth allocated to your currently downloading file whilst minimising the likelihood of any interference which could result in transfer interruptions.

~ If when you click on a link it appears as a 'cgi' or 'php' file in the transfer window, the file is either being protected by an anti-leech system or is subject to a file tracking setup (usually just for statistical purposes), making it very awkward to transfer using a download manager. The best way around this complication is to temporarily disable your download manager by holding down the shift button whilst you click on the file and wait to be redirected to the actual target file you wish to download (keep in mind that this will deny you the use of the resume function in many cases).

Similarly if you attempt to download a file expecting it to occupy 300mb and it appears in your download directory in a matter of seconds, you can safely assume that you've downloaded the code responsible for redirecting you to the download rather the download itself. There are ways of convincing your download manager to cooperate in downloading these files, but again, in most cases it is quicker and simpler to use the method described above. Some sites simply do not like download managers. Call it a personality clash if you like, but don't waste any more time trying to make the two 'talk' to each other.

~ Note that many more of the errors you will come across while attempting to access FTP sites will not be reported in plain English. In contrast to those listed above, the only clue as to the cause of the problem may be presented in the form of a three digit code, which must first be deciphered before you can attempt to remedy the problem.

Below you will find a comprehensive list of these error codes along with their explanations. Note that not all of these codes should be a cause for concern. Many of them will appear simply to keep you informed of the commands currently being executed to facilitate the transfer process.

100 - The requested action is being initiated, expect another reply before proceeding with a new command.
110 - Restart marker reply.
120 - Service ready in x minutes.
125 - Data connection already open, transfer starting.
150 - File status okay, about to open data connection.
200 - The requested action has been successfully completed.
200 - Command okay.
202 - Command not implemented, superfluous at this site.
211 - System status, or system help reply.
212 - Directory status.
213 - File status.
214 - Help message.
215 - Name system type. (Where name is an official system name from the list in the Assigned Numbers document.)
220 - Service ready for new user.
221 - Service closing control connection. Logged out if appropriate.
225 - Data connection open; no transfer in progress.
226 - Closing data connection. Requested file action successful.
227 - Entering Passive Mode.
230 - User logged in, proceed.
250 - Requested file action okay, completed.
257 - Pathname created.
300 - The command has been accepted, but the requested action is being held in abeyance, pending receipt of further information.
331 - User name okay, need password.
332 - Need account for login.
350 - Requested file action pending further information.
400 - The command was not accepted and the requested action did not take place, but the error condition is temporary and the action may be requested again.
421 - Service not available, closing control connection. This may be a reply to any command if the service knows it must shut down.
425 - Can't open data connection.
426 - Connection closed; transfer aborted.
450 - Requested file action not taken. File unavailable.
451 - Requested action aborted: local error in processing.
452 - Requested action not taken. Insufficient storage space in system.
500 - Series Codes: The command was not accepted and the requested action did not take place.
500 - Syntax error, command unrecognised. This may include errors such as command line too long. 501 - Syntax error in parameters or arguments.
502 - Command not implemented.
503 - Bad sequence of commands.
504 - Command not implemented for that parameter.
530 - Not logged in.
532 - Need account for storing files.
550 - Requested action not taken. File unavailable.
552 - Requested file action aborted. Exceeded storage allocation (for current directory or data set). 553 - Requested action not taken. File name not allowed.

Even double Dutch makes sense with a double Dutch to English translator!

Thursday, 8 March 2001

Why when I download a file is it only several kilobytes in size?

This can happen when files are linked to using scripts rather than direct web addresses. Files hosted on some virtual drive file storage servers are well notorious for this problem. Usually the files have not been deleted, the download is just being mismanaged because the real location of the file is not evident in its URL.

To sidestep this quandary you can temporarily disable any download manager browser integration features by holding down the shift button when clicking on the target file(s). Doing so will either whisk you away to another page containing a direct link to the individual file, which can then be dragged into your download manager, or redirect you to the file itself without revealing its true location, which will automatically begin downloading independent of your download manager.

Wednesday, 28 June 2000

, , , ,

Usenet and newsgroups in a nutshell. Read all about it!

The best way to help you grasp the concept of newsgroups is probably to compare them to something which you're more familiar with. So, just to make sure we're on the same page, picture an all singing, all dancing state of the art forum. Got that? Now mentally remove all the graphics, the pretty emoticons, avatars, signature graphics, the whole shebang really. Now take away the community spirit, the personal touch and the sense of organisation and what you're left with is pretty much the essence of a newsgroup.

They've been around since the beginning of time (at least in internet terms), silently lurking in the background with all the pizzazz of a day out in Scunthorpe - the fact that they exist at all often escapes people's notice until they've been using the net for quite some time. As you can tell I'm not the world's biggest fan of newsgroups, but even I have to admit they do still have a lot to offer. What they do, they do well. They're functional, nothing more. You can get in, get what you want quickly and effortlessly and get out again all in the blink of a weary net surfer's eye, which makes them perfect for leeches and lurkers. Personally I happen to believe that there should be more to online communities than quickie downloads, but then everyone's entitled to their own opinion aren't they.

If it helps to put things in perspective, you can think of newsgroups as public notice boards where anyone and everyone can come along, read what has already been written in addition to writing their own messages which can then be pinned up alongside all the other notes. Each notice board contains messages concerning one or a handful of very specific topics that can be as diverse as the people who use them. The conglomeration of all the individual newsgroups, which literally number tens of thousands, comprise what is known as 'Usenet'.

Luckily for us, each individual newsgroup isn't left to swim alone in the sea of information that is the net - they are grouped together by their general theme and named accordingly to make them easier to locate. Take the 'rec.toys.lego' newsgroup for example. The prefix 'rec' places the group squarely in the recreation category. As we move from left to right we are given more specific hierarchical information which helps us to get a feel for what the group is all about. It doesn't take a genius to work out that the people participating in this newsgroup will be especially interested, or even dangerously obsessed with that timeless kid's past time, building things out of plastic interconnecting bricks.

Most newsgroup prefixes are fairly self explanatory, which is handy because it means that you don't need to consult a newsgroup manual to work out what sort of theme any particular group is concerned with. Newsgroups prefixed with 'alt' for instance, are designated as alternative discussion arenas, whereas the prefix 'news' indicates that a group is specifically tailored to the discussion of the Usenet system itself.

One of the largest categorical divisions, however, is marked with the prefix 'binaries'. You can expect the subscribers of any newsgroup with such a prefix to be most interested in downloading encoded text files, which once decoded can be used in a myriad of different ways. These transformed text files can range from pictures and movies to music and software. The ability to effortlessly harvest this seemingly boundless content represents one of newsgroup's greatest appeals.

Amongst the decipherable text messages you will receive via your newsgroup reader you will find segments of larger files encoded as what appear to be gibberish ascii characters. These can be split up to enable them to be transferred over the net via limited capacity newsgroup servers - this is why they are considered an especially suitable medium for the distribution for spanned, compressed archives.

So how do you reap the benefits of these miraculous resources? First of all you're going to need what's known as a newsgroup reader - Forte Agent available from www.forteinc.com is a particularly good specimen. Alternatively, if you're happy to lay out the welcome mat for malware and let it run riot on your system you can use Outlook Express, which more than likely you will already have installed. If this is the case, all you have to do to get started is visit the menu bar at the top of your screen, select the 'tools' option and click on 'accounts'. From within the ensuing dialog box prod the 'add' button and select 'news' from the expanding options menu.

Outlook Express being the inquisitive creature that it is will now ask you which news (or NNTP) server you would like to use to connect to Usenet. Ideally you would want to use the one provided by your ISP - since this is included in the monthly price you're paying for internet access, at least in theory it should be superior to the free ones available elsewhere. The name of your ISP's news server is nearly always the name of your ISP prefixed with the word 'news' or 'nntp' separated by a dot. For instance, if your ISP is Freeserve, the server name you need to enter into Outlook Express would be 'news.freeserve.net' - if in doubt check the FAQs on your ISP's home page.

My tightwad ISP doesn't provide an NNTP server, so now what? You might want to consider subscribing to an independent news server. Last time I checked, eight-ish dollars a month was the average you could expect to pay for such a service. If protecting your anonymity whilst posting messages to newsgroups is of concern to you, you might like to look into the unmonitored options these companies offer.

Otherwise shop around for a more advanced newsgroup reader - one equipped with built-in privacy protection features. Keep an eye open for the keyword 'proxy' as you explore your newsgroup reader's help files and you won't go far wrong. That said, many proxies aren't really anonymous at all despite their claims to be. To make sure you know which category yours falls into before using it you can perform an anonymity status check using the proxy tools cited in my anonymity tutorial.

A spot of Googling will soon reveal that a minuscule number of public news servers are provided free of charge, whilst the majority have to be paid for. Since almost anything freely available online is going to be highly sought after, you can expect the free servers to be oversubscribed and infuriatingly slow. Nonetheless, if you're prepared to accept this drawback and embrace a freebie server, I would advise you to visit dmoz's list of free NNTP news servers to see what is on offer.

So you've decided which news server to use, now what? You will be prompted to type in the name and email address you would like to be displayed alongside your posts, if you intend to make any. It is probably wise to use a fake name and/or email address here to maintain your anonymity and prevent your inbox from filling up with the spam of unscrupulous newsgroup email address harvesters. Alternatively, you may want to consider using a 'spam only' email address so that people can still get in touch with you if necessary. Whatever you decide, enter this information now and click 'OK' to progress to the next stage.

With these precursors out of the way, Outlook will ask you if you would like to download a list of all the newsgroups available for subscription. Select 'yes' and wait a moment or two while the information is processed. Decisions, decisions, which ones to choose? Tough isn't it? One way of selecting a newsgroup you wish to join is to scan through the names of all the groups sequentially until you find an interesting sounding one, but this is likely to take you all day. A better way is to narrow down the list using keywords, just as you would when using a search engine to filter out irrelevant web sites.

If you're in the fortunate position of already knowing the names of the newsgroups you would like to subscribe to you can tap in a partial address; if they are supported by your newsgroup server, Outlook Express will automatically fill in the remaining nodes of the address for you. Yet if your ISP is especially over zealous with regard to censorship, don't be surprised if no matches are found at all. If, for legal reasons, the newsgroups you wish to join aren't supported by your ISP you will have to go in search of an uncensored third party server.

Once you've found a selection of groups you wish to participate in, simply click on each one while holding down the control key and poke the 'subscribe' button to add them to your short list. If you glance in the direction of your inbox and then cast your eyes downwards slightly you will see that your newsgroup server has been appended to the bottom of the list of folders, and underneath that is a list of the newsgroups you are currently subscribed to. If you select one of these and click on the 'synchronise' button, a pre-designated number of message headers will be downloaded and placed in the area where the body of your emails usually appear. Note that it is only the headers you are downloading at this stage, not the contents of the messages or the encoded 'attachments'. To read one of these messages simply click on the header and wait for the message body to download.

Having lurked in one of your chosen groups for a while you will get a feel for the sort of subjects considered to be 'on-topic'. When you're ready to contribute to the discussions or share a file or two with the other subscribers all you have to do is click on the 'new post' button, type in a subject title, the body of your message and attach any files you want to upload using the 'attach' button.

Surprisingly enough, the final stage involves hitting the 'send' button. If you wish to 'cross-post' - post to multiple newsgroups simultaneously that is - enter the names of all the newsgroups you wish to contribute to into the newsgroup field - separated with commas - and press 'send' in the usual manner.

But enough chat, you want to download the latest digital delicacies, right? Well to do this you are going to have to get to grips with the encoded gibberish text files we spoke of earlier. These aren't really attachments in the usual sense of the word, but since visualising them as such will likely aid your understanding of the process I won't split hairs.

If a message is accompanied with an attachment, a paperclip icon will appear adjacent to the message subject line along with the size in kilobytes of the attached file. Attachments are actually binary files that have been encoded using the UUENCODE format, which to the naked eye looks like scrambled text. This is because to use these attachments as they were intended to be used they first have to be decoded and combined (if they are spanned across multiple posts).

To save an attachment contained within a single post simply select 'save as' from the 'file' menu and choose a place to store it. On the other hand, if the file you want to keep is a multi part attachment you will have to select all the messages the file is spanned across using the left mouse button and control key and select 'combine and decode' from the 'message' menu. Whenever you do this you will be asked to arrange the files in sequential order using the up and down arrows. Complete this task and all that remains to be done is to 'OK' the operation and choose a place to store the resultant decoded file.

Other operations you may wish to perform include replying to a post while quoting the author, and contacting the author privately via email. To perform the former, click on the header of the message you want to reply to, press the right mouse button and click on the 'reply to group' button - a new, pre-formatted message window will surface complete with a quoted text appendage to inform other subscribers what it is you are referring to. To execute the latter task, right-click on the message posted by the person you want to contact, press the right mouse button and select 'reply to sender'.

That just about covers the basics of using a news reader to browse the Usenet archives. Congratulations - that's another new skill you've added to your inventory. Some people hate installing extra software that must be regularly maintained and upgraded unless it is absolutely essential to do so. If you're especially opposed to the idea of using a software client to visit your favourite newsgroups, you'll be delighted to know that you can achieve the same ends by visiting a web based Usenet service instead. News reader or web site? The choice is yours.

Saturday, 29 April 2000

, , , , , , ,

Web media divining - tools of the trade

The advent of the widespread availability of fast internet connections, coupled with an abundance of cheap web space has allowed artists, musicians, movie directors and software programmers to distribute their respective works online rather than via more traditional hard-copy mediums. To take full advantage of all the web has to offer it is necessary to seek out and get to grips with a number of essential tools. Amongst these are decompression programs, a download manager, an FTP client and a firewall.

In the realm of computing you are never short of software options; there are literally thousands of equivalent programs available in every category you could possibly imagine, and they're all a mere click of the mouse away. What I've attempted to do here is to narrow down this vast range of options into a more manageable selection. The ones I've chosen are considered the staple diet of the digerati, but they're not everyone's cup of char. If you find that you don't agree with my choices you don't have to stick with them, just pop along to your favourite shareware site, find the search box, tap in a few relevant keywords and take your pick. The world's your lobster... or something.

Getting X from A to B

The first item on the check list is known as a download manager. These go synonymously with internet foraging and are vital in that they allow you to resume broken downloads of bulky files and can handle large numbers of files unsupervised. Assuming you're not completely new to the internet you've probably become accustomed to downloading files using the built-in download manager (if you can call it that) of your internet browser. This is fine for small, single file downloads, but is about as much use as an inflatable dart board for transferring anything else. As an example, imagine trying to download a series of weekly, or even daily, podcasts. You would begin by clicking on the first file (hands slap foreheads across the globe in astonishment!), your browser would then open a dialog box to allow you to choose a suitable location to store your downloaded file and then it would begin transferring.

If this process is interrupted due to a failed connection you would have to begin downloading the file again from the first byte - unfortunately internet browsers have very short memories so can't remember what they were doing just a few seconds ago! Some servers are so flaky you could find yourself caught up in an aeonian start-error-restart loop. Not much fun to put it lightly!

Once the first file has downloaded successfully you would then have to click on the next one and wait for that to begin transferring and so on and so forth for each of the remaining files. I don't think you need me to tell you how infuriatingly slow this whole task can be. This is where download managers step into the breach to save you from slipping into a download induced state of insanity. What these do is allow you to queue a series of files and transfer them sequentially, freeing you from your former computer baby-sitting purgatory to do something more interesting, safe in the knowledge that when you return, your computer will still be happily chugging away without the need for any further intervention from you.

Instead of getting caught up in a mind-numbing click-wait-click loop you can set your download manager to transfer a specific number of files simultaneously (two is a sensible number if you have a slow connection). Once the first file has safely landed in your downloads directory, the next file in the queue will begin transferring automatically until the entire list has been purged. Best of all though, if the connection with the server you are downloading from is broken you won't have to begin again from square one. Your download manager will simply reconnect, erase the last few bytes which have been downloaded (because they may have become corrupt) and will resume the transfer without even breaking into a sweat.

As you know, dial-up modem connections are very fickle things and can spontaneously be broken for a multitude of different reasons. Not to worry though, this problem has also been anticipated and can be counteracted with the help of your download manager's auto reconnect system. Assuming you have informed your download manager which dial-up account you wish to reconnect to should your connection be lost, it will automatically attempt to dial into the service in the event of any problems. But that's not all they can do. When your download task is complete, providing you have ticked the relevant boxes, your computer will automatically disconnect from the internet and shutdown - now that's what I call hands-free computing!

For a long time, amongst people in the know, Gozilla and Getright were ubiquitously assumed to be the cream of the crop, but now the download manager market is no longer a two horse race. Hot on their heels, Flashget has overnight managed to claw back a substantial proportion of the user base shared by Getright and Gozilla. While Flashget takes all the usual duties of a download manager in its stride, where it really starts to break down the boundaries is in the speed department. Whereas most download managers will open a single connection to a file and keep on plugging away at it until it is complete regardless of the server's transfer rate, Flashget will open multiple connections to various servers allowing a single file to be downloaded much quicker. These multiple connections, known as 'jets' in Flashget Land, are assigned with a particular portion of a file to download. Jet 1 for example, could be downloading the first third of a file while jet 2 downloads the second third and jet 3 downloads the final third.

Flashget attempts to locate the fastest servers, known as mirrors, where the files are stored and will subsequently connect to a selection of them to maximise the bandwidth utilisation of your connection. When all the segments have been transferred they are automatically glued back together to form the whole file. In fact, Flashget is so good at its job that using it leads paradoxically to a situation where trying to surf the web while simultaneously downloading feels like treading treacle, but then it would be ridiculous to complain that the transfer speeds are too fast! Incidentally, your download speeds can be restricted so as to prevent Flashget from interfering with your surfing habits. I'm sure the circularity of this compromise is obvious by now. Nonetheless, the option is always there if you want it.

Another area where Flashget makes new ground is its file tracking logs. These are so comprehensive you are always kept informed of what is happening as it happens. If a particular file is causing problems, by taking a swift glance at the server logs you can diagnose the error instantly and take remedial action. This is especially useful if you have left your computer downloading while you get on with something else or go out for the night. If you were using a lesser download manager you would be left completely in the dark as to where the problem lies, but with Flashget the logs are always available for viewing after the event.

Almost unique to Flashget is the ability to download all the files linked from a specific web page with a few measly clicks of the mouse. Subsequent to installing Flashget a new context sensitive item is added to your right click menu. This 'download all by Flashget' option does exactly what it says on the tin. When selected, a menu pops up in front of the web page you are currently browsing allowing you to deselect the files you don't want to download. These will include images which make up the design of the page, amongst other nonessential elements. In a similar vein, where Flashget really comes into its own is when transferring files from web space accounts that have been opened for the sole purpose of hosting downloads. Under these circumstances these will be the only files stored in this location so there is no need to separate the wheat from the chaff, making Flashget's incredibly efficient 'download all' option an even more impressive time saver!

Like Getright and Gozilla, Flashget has its own FTP client built-in to the program. The difference, however, lies in the intuitive nature of Flashget's FTP browser interface which makes navigating FTP sites a breeze. For instance, if you are browsing through several FTP sites consecutively Flashget keeps a record of where you've been so that you can return to these sites with a single click. This hierarchical treelike structure is implemented throughout the client so that you can always see whereabouts in the FTP site you are currently situated. It's a simple arrangement, yet one which makes all the difference. Moreover, Flashget's reconnect system is the most reliable I've used to date. Nearly all modern download managers support this function, nevertheless, many of them tend to crash if asked to reconnect to the internet more than a handful of times. Luckily for us, Flashget's redial feature works time after time. Ultimately, the one and only thing to let the side down is the spyware which automatically plants itself into your system when you first install Flashget. Fortunately this can be swept clear using a spyware removal utility such as Ad-Aware (see the anonymity tutorial for further info).

So there's my top download manager tip. Whether you choose to use it is up to you of course. Other people will tell you that Flashget is awful and will stick to their guns no matter what. Because you will hear so many contradictory predilections, it is advisable to try all of these programs and then choose the one that suits you best, as using lots of them concurrently is likely to be a source of conflict. If none of these programs appeal, consider trying Forty Software's Download Wonder or Download Accelerator Plus from Speedbit to investigate some of the alternatives.

Alternative pathways

Next in the lineup is the humble FTP (File Transfer Protocol) client. An FTP client is used to gain access to remote computers known as FTP sites - another excellent source of freeware, graphics, movies, music, you name it! You can think of these as segregated chunks of space on the other people's hard drives which have been designated as a kind of 'share zone'. If you want to keep things simple you can use your download manager's built-in FTP browser to see what's on offer. These will allow you to download files from FTP sites, but not return the favour - that is upload files. For this task you need a fully functional, standalone FTP client.

All the ins and outs of FTP clients will be explained in much greater detail in a later tutorial so I won't delve any deeper into the topic here. For now it will suffice to say that an FTP client is an invaluable addition to your software arsenal so go and find one now even if you don't plan to use it immediately. In my humble opinion the best FTP client available is Bullet Proof FTP - it's reliable, intuitive and looks good to boot.

The decompression chamber

Thirdly, several decompression tools will be necessary to 'unzip' your archive files. Two of the best and most widely used of these are Winzip and Winace.

Winzip deals almost exclusively with files that have a zip extension. It can handle many other obscure formats, though the majority of these you are very unlikely to ever encounter during your net traversals. Winace on the other hand is capable of decompressing ace, rar and zip files in addition to all the other common compression formats.

Winrar is another indispensable archiving tool every file seeker should equip him or herself with. Although Winace can handle rar archives as well as its own homegrown format, it cannot create new rar archives; for this task you will need Winrar. Apart from this fairly obvious impasse, Winrar is much better at handling rar archives as you would expect seeing as this is precisely what the program was designed for.

It isn't absolutely imperative to install all three of these programs - you could get by with Winrar alone for example, however, each program has its own strengths and weaknesses and to get the best of both worlds (well three worlds actually) it makes sense to use different programs for different tasks. As you would expect, Winzip's most impressive party trick is opening, extracting and creating zip archives so if you are planning to take advantage of all three programs you should associate zip files with Winzip exclusively. The same goes for Winace and Winrar, so associate ace files with Winace and rar files with Winrar. You will be guided through this very simple process by fool-proof wizards following the installation of each program so don't worry about locating the relevant options yourself.

You may be wondering at this stage why three different programs are necessary in the first place. Well this is due to the fact that there is no single, standard format for compressing computer files; some people swear by rar, while others favour zip - you haven't a snowball's chance in hell of getting everyone to agree on a de facto standard, and so to keep our options open we must equip ourselves with as many programs as it takes to process each kind of file.

All three of the most popular compression formats can be spanned across a designated number of archives. This used to be common practice when it was impossible to shoehorn complete archives onto individual, removable media such as floppy disks, or freebie web space accounts. Nowadays this feature is less useful seeing as DVD writer ownership is rapidly becoming the norm. Nevertheless, for historical purposes if nothing else, I'll explain how the various data chunks comprising a spanned archive can be glued back together and decompressed below.

Baffled by data squishing and de-squishing be you not young Jedi. Read on and the compression pool will become much less murky as we go along. You now have the necessary kit in your itinerary so that's a good start.

The finer details


I take it you've downloaded one of these mysterious 'zip' file creatures and are wondering what on earth do you do with it now. Well first you need to understand a little bit about compression. You can think of a zip file, for instance, as an empty beer can (stay with me on this one, all will become clear). While the can is intact you can store the full capacity of liquid in it, however, it takes up a lot of space and is awkward to carry around (it's a king-size specimen, OK?). Now if you put on your size twelve Doc Martins and crush it under your foot, you can no longer store the same amount of liquid in it, yet it is much smaller and easier to carry around. When you want to pour the liquid back into it again, the can is stretched back to its former shape (I'm well aware that you're likely to shred your hands into a bloody pulp in the attempt, but you get the gist I'm sure).

This, in essence is what a compressed archive does. Zip files can consist of a cornucopia of file formats numbering anywhere between one and thousands. If these files were not all held together in a compressed format you would have to click on each one individually in order to download them - this is inconvenient and time consuming to say the least! Also, because the files would be in their expanded, ready to use state they would inevitably take much longer to download. This is where Winzip, Winrar and Winace come in very handy:

If a file has a zip extension I would normally advise using Winzip to extract it since this is the task the program was primarily designed for, but this is far from convenient when you have a large set of files to decompress sequentially. This is why I'd recommend using Winrar to extract the whole shebang simultaneously instead. To get started, open the folder containing the files you have just downloaded, drag a box around all the zip files (using the control key if you need to single out particular files), and then right-click one of them. Select 'extract here' from the context menu and wait while all the files are decompressed.

If when you installed Winrar you didn't agree to have the 'extract here' et al commands added to your context menu, you can achieve the same goal by opening Winrar and browsing for the files that way instead. Once you've located them, drag a box around the whole set and click on the 'extract' button, choose a place to put them and click 'OK'. It is best to choose a separate folder to store the files contained in each archive set otherwise you will soon find yourself swimming in a chaotic sea of orphan files, not knowing which ones belong to which program (or whatever you happen to have downloaded).

Quite often zip archives contain identically named .diz (short for description) text files designed to be read by FTP server software to establish the contents of compressed archives - the information harvested is used to create easily searchable catalogues. These files are far less useful to the end user at this stage, so if prompted to overwrite them click 'yes' to proceed (if your archives are part of a set they will likely be duplicates in any case).

Spanned archives

To complicate matters these can take any one of the following forms...

1. An ace file followed by a series of c?? files.

2. A rar file followed by a series of r?? files.

3. A series of files with sequentially numbered extensions without an initial ace or rar file i.e. .001 followed by .002, .003 and so on.

4. A rar file followed by a series of sequentially numbered files as in the case above.

5. A series of files all with the identical extension, rar. In this case it is the body of the filename which differentiates the files in the set. For example, the first file will be labelled volname.part001.rar, the second file will be labelled volname.part002.rar and so on.

The question marks in the first two file formats represent a series of sequentially ascending numbers, which form a mutually dependent set of files. C?? files are associated with ace archives, whereas 0?? and r?? files are associated with rar archives. These files cannot be decompressed with Winzip so you can close that down for the time being.

If after unzipping, what you are presented with is an ace file followed by a series of c?? files you will need to use Winace to extract them. On the other hand, if you are faced with scenario 2, 3, 4 or 5 from the list above you are best advised to use Winrar to extract them. Although, in theory, Winace can handle both ace and rar formats, sometimes it reports pseudo CRC errors when processing the latter file type. Very often these CRC errors are actually Winace errors rather than real errors within your archive set and are due to a mishandling of the compression format.

Scenario 5 represents Winrar's latest default volume naming scheme (as of version 3.xx). Archives compressed using versions of Winrar prior to 2.9 will take the format presented in scenarios 1 - 4. This isn't to say that you have to worry about keeping an old version of Winrar handy for processing older archives, as the latest build is capable of decompressing past and present formats.

Somehow I've managed to make all this sound much more complicated than it really is, but trust me, there's no need to panic. After opening a couple of archives you will be able to recognise and extract these two different file formats as though you're flying on autopilot. All you have to keep in mind is to use Winace for opening ace files and Winrar for opening rar, r01 or 001 files - note that if there is no rar file you will have to open either the 001 or r01 file instead. These function in exactly the same way as any other rar archive, minus the initial double-clickable rar file.

Unless you have specifically associated 001 and r01 files with Winrar they will not open automatically, in which case you will have to open the program first, browse for the file and double-click on it yourself. You may even want to modify your file association settings to allow you to simply double-click on these files to open them in future. The procedure goes a lot like this: browse for the file you want to associate with Winrar and right-click on it. Now choose 'open with' and select Winrar from the list in the ensuing dialog box, tick the "always use the selected program to open this kind of file" check box and click 'OK'. The icon representing your newly associated file will change to the default one used by rar archives and you will then be able to double-click it to delve inside. Even I'm not sure if any of that makes sense anymore, but we'll carry on regardless. I'm doing my best, honestly!

The initial rar, 001 or ace file actually represents the first file of a compressed, spanned archive. You have probably already noticed that double-clicking on a c??, r?? or a 0?? file will achieve absolutely nothing unless you have previously modified your file association settings. This is because they are not designed to be opened individually (with the exception of 001 files). Instead they will automatically be processed when you double-click on the rar or ace file.

Similarly, when you choose to extract an ace or a rar archive, all the dependent files will be extracted in one go without any further intervention from you. Whenever you do this, depending on the way in which your file associations have been configured, either Winace or Winrar will spring into action and open the archive set in a new window. All you have to do now is choose 'extract' from the menu and select a folder to store the files in, remembering to tick the 'extract with full path' option to ensure that the files end up in the correct folders.

If when you decompress these files you encounter CRC errors it means that one or more of the files have become corrupt during the transfer process. This is usually because they have been transferred too slowly, because they have been resumed too many times or because you are downloading too many files at once and this is causing bytes to be lost or to be incorrectly allocated. It is also possible, however, that the way in which you downloaded them had absolutely nothing to do with the corruption - the files could have been damaged during the initial upload stage instead, in which case there isn't a great deal you can do about it.

If your files are corrupt they will need to be either repaired or downloaded again. You can attempt to repair a corrupt archive using the built-in repair tools of Winrar or Winace (click on 'archive' and then 'repair'), but be warned, the majority of damaged archives are beyond help and will need to be re-downloaded instead. If on your second download attempt the files still don't work it is likely that they were damaged to begin with, in which case you are best advised to delete them and start afresh downloading from an alternative location.

Digital safety nets

Finally you will need a firewall to protect yourself from malicious net intruders. Having your computer hacked into and trashed by a bored, spotty thirteen year old living on the other side of the world can be a tad frustrating - especially if you discover after the event that it is easily avoided. You don't have to lurk in undesirable areas of the web to fall prey to such attacks. It could happen while you're emailing your granny, searching for a job or chatting to a friend using Yahoo messenger.

Inevitably the more time you spend online, the greater is the likelihood of you becoming a target. Well, 'target' is perhaps too strong a word. If someone hacks into your computer it's unlikely that their motivation stems from a personal vendetta. More likely they're just scanning a range of online computers to see whose 'door' has been left wide open to intruders. If you don't install an efficient firewall this is tantamount to leaving a welcome mat on your porch as an open invitation to whatever malevolent forces may be skulking in the vicinity. To discover more about firewalls try searching my blog for the key phrase 'Zone Alarm'.