How To Delete An Undeletable File Folder

Here is some of my system information:

OS Name, Microsoft Windows & Home Premium
Version, 6.1.7601 Service Pack 1 Build 7601
OS Manufacturer, Microsoft Corp.
System Manufacturer, HP
System Model, HP G61 Notebook PC
System Type, x64-based PC
Processor, AMD Athlon II Dual-Core M300, 2000 MHz, 2 Cores, 2 Logical Processors
BIOS Version/Date, HP F.13/25 Jan 2010
SMBIOS Version, 2,6
Hardware Abstraction Layer, Version = "6.1.7601.17514"

My computer came with Internet Explore already installed, but I use only Firefox and Safari. So, I wanted to uninstall IE. But after I did that, I was looking through my program files, and the IE file folder was still in there. So, I tried to delete it but it said I needed permission from "TrustedInstaller". So, I gave full permission to myself but it still didn't work. Then I downloaded LockHunter and it said that the file folder was unlocked but when I went to it, it said that I still didn't have permission to delete. Then I thought that if I opened the IE file folder, I could delete the stuff in it one-by-one but I only got to delete 13 out of 27 items. I closed the file folder and tried to delete all again in the hope that I deleted something that would unlock this option for the IE file folder but it didn't. I then downloaded Unlocker but when I clicked on it to start it up, it wouldn't open. Finally, I added "Take Ownership" to my Explorer right-click menu, and that worked. But now it says, "Folder In Use: The action can't be completed because the folder or a file in it is open in another program." So I opened Task Manager and looked but no .exe or .dll or anything else pertaining to the IE file folder was running. Sometimes when I get this message I can restart my computer and it will work but it didn't do anything this time. I'm running out of ways that I know how to fix this. I usually don't need to ask questions, especially ones so long-winded, about computers but I'm feeling kind of lost here.