I tend to doubt that you could see a difference of 5 seconds between opening secured vs. unsecured DB due to encryption unless you are running on a CPU that still measures its speed in 2-digit MHz.
However, if your Workgroup file is incorrectly set up, merely opening the WKG and reading the LDB might slow you down a little.
I repeat, ALL Access databases are encrypted. When you "remove" security, what you really do is change the basis of encryption from the private WKG file to the default WKG file. If you see a speed difference, it is NOT repeat NOT an encryption issue on any computer with 0.5 GHz or faster CPU.
Look to your file sharing and the speed of your network. Something IS wrong but encryption ain't it. On the other hand, if you remove the special WKG setup and replace it with the Office default WKG (which is what you REALLY do when you "remove" security), you allow folks to use their local copies of the default WKG file. Which means the problem is related to sharing that file.