Is the external drive getting full? This will slow the transfer rate.
Are the USB sockets and plugs clean? Fluff and dust can cause problems.
Are any of the files being transferred corrupt?
Is your security scanning everything on transfer and causing a bottleneck?
You don't give your OS but this may help also link text