Windows 7 64-bit Corrupting Large Files Copied To External NTFS Drives?
Jan 26, 2012
a number of backup copies of large files on external USB-connected NTFS drives differed from the source versions still on my hard drive. I also discovered that I could reproduce the issue with newly-copied files.Here are the specifics of the issue, following a series of experiments:
- On my system, copies of large files, files typically larger than 500MB, are corrupted (altered) roughly 30% of the time when copying them under Windows 7 64-bit to USB-connected NTFS-formatted external drives.
- No error occurs / no error message appears during the copy
- The file size of copy is always identical, whether or not data was altered during the copy process.
- File differences are confirmed via either the command-line "FC" command or a utility such as WinDiff
- The issue impacts copies made via the Windows GUI -OR- via command-line copy or xcopy
- The issue occurs with multiple external USB NTFS-formatted drives, no matter what make or model.
- Subsequent attempts to copy an affected file will ultimately yield an identical copy. This would seem to rule out interference by an external program such as an anti-virus program (and the only AV I am running is Microsoft Security Essentials)
- The USB drives involved pass error checks, and copies made to these drives on other (non Windows 7) systems produce identical copies
- So far, the third party utility "TeraCopy" manages to consistently produce clean copies, and therefore is a temporary workaround. This utility apparently works because it, by default, bypasses the NTFS memory caching operation used by the Windows 7 OS...a caching system which I have so far found no way of disabling.
- The problem does not appear to impact relatively small files (1 to 100MB or so). I have not found any particular threshold, but I have seen the issue impact numerous files in the 500MB neighborhood.
- The problem seems to date at least to the version of Windows 7 that was in release as far back as the Fall of 2010, as I discovered corrupted backup copies of files dating back that far. Again, the files are corrupted with respect to the original copy...NOT with respect to file structure itself.
I recently got a new iMac so am trying to copy/move some files around. However ANY file i copy onto the hard disk (which is in NTFS format) are not visible in Win7. The folder into which i copied into is visible but shows size as 0 bytes, whereas there is around 1.7TB of data in that folder. ALl older folders which were created/modified in Win7 earlier are visible. If i attach the disk to the Mac, the the files are there.. Am using Paragon NTFS if that matters...
I have a 30 GB file on my desktop and I want to move it to an external hard drive. In Win 7 it just won't go! Cut/paste, move to, nothing. How can it be done?
how to move all my files from my internal harddrive to my external harddrive. Everytime I try to transfer my files it will transfer for like 1GB and then it will freeze and restart.
Any recommendations on Fast Drives that can save large files 8+ gigs in a matter of seconds. I have a USB 3.0 drive, even though it's connected to a 2.0 port, I'd still prefer something more faster, besides I want it to be internal.
I have a Toshiba Satellite L655-1EM laptop running windows 7 home premium 64bit.OEM came pre-installed. I've had the laptop about 6 months.It works great but I seem to get the BSOD quite a lot. I noticed it only seems to happens when I'm using either of my external hard drives or SD cards. Usually when I am transferring a batch of large files between drives.
I have moved to Windows 7 Ultimate x64 for almost half a year, recently my hard drive was getting full and I decided to move some of the data to usb external hard drives. Both the externals I have are IDE hard drives and both are NTFS. I always use Quicksfv to make a CRC check file before I transfer the file and then run the CRC check after its been copied over to the external drive. I have used these externals in the past with Windows XP and had no problems.
However, on Windows 7 when transferring large files (usually over 1GB in size), I get corruption in the files. The corruption occurs randomly, if I recopy the files again it might be corruption free. This only occurs when copying files from internal to external, if I copy files from the external to my internal there's no corruption at all. I have tried changing the usb cables, power cable of the externals, using different usb ports but none of it helped. I scanned both externals with chkdsk and I used memtest+ for over 24hours and all the tests passed fine.
I have a couple of flash drives I have formatted to NTFS. One for an install drive and one for a readyboost test. If I formatted the drive in CMD do I have to format it the other way (to FAT32) in CMD or can I just right click the flash drive and format it there?
I have tried to copy a complete file heirarchy from one drive to a folder on another drive but found several files and folders are not being copied.
There is no report of files missed or any kind of error message.
I am actually trying to copy the contents of a friends hard drive onto a backup drive since he is getting a new computer and wants to ensure nothing is lost. I have mounted his internal 2.5 sata drive in a caddy and am copying it to my computers second internal drive.
I expected not be be able to copy certain system files. I also expected I might not to be able to copy some of his personal files due to the standard windows system protection (I am system administrator on my PC whereas of course he was administrator on his PC where the files and folders were created which I thought might be an issue). When I first tried to view some folders I was asked by the system if I wanted to allow permanent administrator priviliges to them (namely his personal directory under "Users" ). I replied yes and was thereafter allowed to descend into and view those files. Now when I copy the entire heirarchy of some 35GB I find the new folder is only 15GB. It is not just down to any compression as I have confirmed that there is only about 1/3 of the expected number of files to what was in the original. I have since tried individually copying some of the sub-folders that were missed and they copy fine on their own. As you can imagine, trying to dentify what has copied and what has not is a mammoth undertaking.
I have an external drive that does backups of files for me on a weekly basis through windows, needless to say the backup was getting bigger so I decided to go for a better data storage solution and formatted the external into NTFS. While doing this I also decided to format a USB key into NTFS.THE external drive format took hours, four or so hooked up via firewire. I blamed the issue on the drive and ignored it for the next couple of weeks. The backups didn't work properly they stopped halfway according to Windows even if I let them run 12+ HOURS. Before I formatted it took only 2-3 hours for the backup. I blamed the entire issue on the drive, maybe time to replace it, but I didn't have time to mess with it cause it was simply annoying me.Didn't use the key until tonight. Remember it is formatted as NTFS also. I started to copy a movie file to it, 700mb, it stopped at nearly 89% with 5 seconds left and did not move one bit. I hit cancel and it stayed on the cancel screen for 10 minutes with no resolve. At this point I tried to open a firefox window and it was not responding.......so what did I do I pulled the key and just like that Firefox window popped up and all was well. At that point it hit me, but the external storage solutions are NTFS, could it be my Mobo? Surely not!, Oh Microsoft you make me sad again....Just like with Vista. I reformatted the USB key back to FAT32, transferred a larger 1.4gig file in about 2-3 minutes and had no hangup issues. I can't blame the issue on the mobo especially since it relates to both USB 2.0 connection and the FireWire has the same issue. I guess windows 7 64bit doesn't like external NTFS connections. My windows appears up to date!
Well tomorrow I am receiving my SSD. And my external hdd is fat 32 and I can't backup some of my stuff because of the file size limit. I believe I need it to be NTFS but how do I change it from fat32 to NTFS?
I am using windows 7 65 bit sp1, I have a number of films on pc of granddaughter and to save putting them onto DVD I have put them onto an external HD which is NTFS, I have tried to link it up to my freesat box which has a usb port, TV hasn't, unfortunately the box wont accept the NTFS sile system, have tried changing to exFAT, again this isn't accepted, tried friends ex HD which is FAT, (FAT32)? and this works, can I change my ex HD to then old FAT system?
I'm having a problem to convert my external hard rive to ntfs its showing raw it don't pickup the volume label. I whet into prompt also and it doesn't seem to see the hard drive. I tried so many stuff already.
I have a very important question about files I copied on to a different drive.I copied all my data(user account) from my C drive to my E drive. The E drive already had data on it before and has plenty of room.I saw that the data was copied then I did a "Windows Easy File Transfer" of the same C User data and also put it on the E drive. The windows easy transfer made one file.Then I reinstall Window 7 Pro on to C drive. I booted up the computer and looked in the E drive for my data, but Windows changed that drive to F from E. I looked in F and there were the files, but I could click on them. I rebooted the computer and upon boot-up the computer wanted to do and chdsk on F and I let it. Now I cannot see those files that I copied before the reinstall, but I can see the other files that were on that drive. Also the used space does not add up to what the drive says, so I think the files are there, just cannot see them.how I can get those files back.
I have an external hard drive that was formatted in NTFS on an XP machine not too long ago. It is a 160 GB Western Digital. It has been working great on windows 7 for a couple of weeks. Just today it won't let me access the drive and it is telling me that I will need to format the drive before I can use it. I have so much important data on here. I am really worried about losing it all. Why is this happening?
Every time i plug my external storage device to my computer, i am asked to "you need to format the disk in drive F: Before you can use it. Do you want to format it?" I checked my drive and its File system is RAW. I don't want format it because all my important data are in it.
I have windows 7 on my HP desktop and i needed windows xp for a certain program for school so i created a partition of 40 GB and formatted it as NTFS... I booted the installation disk and it was loading setup and it said the thier is no disk drive or partitions so i booted 7 back up and Googled it and it said something about raid drivers and SCSI or something needing to be updated... so i booted into setup and noticed that my SAta controler or waterva it is was set to raid so i set it to IDE and booted it this time after loading setup fles my partitions were there so i selected the 40 gb partition and pressed install it copied seup files for Windows xp and said rebooting... it rebooted and all i see is ( _ ) <-- that thing blinking forever so what do i do i've been googling it for ever and cant find what i want so either what do i do to fix it and install windows xp so it's working or just get rid of xp and it temporary copied install files
I'm trying to back up my "data" drive to an external hard drive. The properties on the disk show that there is 910 GB of data on the disk. But, when I select all files on the drive (hidden files/folders shown), it only adds up to 899 GB. Even worse, when I begin copying files, only 835 GB is found and begins to copy. What could be causing this/how can I copy ALL my data? Running Windows 7 Professional x64 Drive contains media files (lots of media files), software installers, .iso files, backups, and system images. Plus a lot of other stuff. Image of drive + file information: [URL] Edit: Tried taking ownership of all files and directories, and allowing my user full control.
I copied several large files (between 1 and 4 GB) from one USB hard drive to another. At the target destination several of the files had defects. They were in general not completely unreadable. Most could still could be opened but had clearly corrupted data. how can this be detected/prevented. Doesn�t Windows 7 have some kind of an integrity check when copying files? Also is there any good software to compare files for being exactly identical down to the last bit? Ideally with the capability to compare whole folder contents so that it hasn't to be done file by file.
I have recently been using some .bat tools to speed up searches in root directories.The tools search for the files in a list.txt, and copy them to a new folder which appears on my desktop. It has been working, until I used a new version today.It copied the files correctly, but I could not see the new folder appear on the desktop. I searched for it and found it where it should be, C:UsersEvanDesktopWhy does this folder exist, but not appear visually on my desktop? is it an error in my.bat file or something else
I just finished putting together my computer, installed Windows 7 Pro 64 bits. However, both of my hard drives (one SSD, one regular HDD) are showing up as external drives (plug-and-play). If I click the "Safely Remove Hardware" icon, I could actually "eject" both of my hard drives.
I have a new computer with Windows 7 on it - and I want to copy the files from my old computer to my new one. I'm looking at copying about 300 GB worth of data.When I copy all files and insert them onto my new desktop, I notice that all of the date/time stamps are changed to today's date.Is there a way to preserve the date/time stamp for each file, so that it keeps the original one?
Yesterday i copied a large folder 51gb into my external hardisk and I used windows 7. One file name was too long and I was prompted. I selected skip file. I remember seeing the folder in my hardisk after copy. But no longer there today. the space still occupied tried using programs like pci recovery. not found. The folder has many work files.
I just completed my first homebuilt system but have been having many crashes and bluescreens which as of now, those helping me think is caused by my memory. The crashes occur when I have 6 gig (3 sticks) installed, but so far everything seems stable with only 1 stick (2 gig). I am now testing each stick separately to make sure none are faulty, while someone in a forum is trying to adjust my memory speeds and Bios values.While testing one stick I had a bluescreen crash while Windows was installing. Now Windows freezes while starting up and the Repair function said it couldn't be fixed. I attempted to reinstall Windows 7 but near the end of the installation the mouse cursor and whole screen froze up. I retried and this time it froze at the beginning of the installation. I chose the new installation with backup of Windows Old option, not the update option. I am not that experienced technically, but would a reformat to a clean drive be necessary here? If so, I could not find a format option during the installation. Could someone walk me through what to do either with or without a reformat?
any computer running windows 7 but this new laptop i have (hp g6 core i5) seems to be continually corrupting memory cards out of my camera! when i first insert the memory card and view the pictures and go to change their orientation; windows comes up with a message saying it can't change it because the picture is no longer there! when you go back to view the folders on the card they appear as symbols as they have been corrupted! the first time it happened i downloaded (and purchased the key) for recovery which seems to do a good job of recovering the images. its really annoying me as to why it is happening! i'm now very careful and transfer images from the sd to the laptop straight away and safely remove the card afterwards. the laptop also corrupted a different memory card when the lid was shut and re-opened but im assuming this is because the computer was hibernating without the card being safely removed.has anybody else had this problem and if so how can it be sorted?
I have a video file that is 5+GB. Windows is telling me it can't move it because it is too large, even though there is ample space in the directory I'm moving it too
I have 2 internal-sata hard drives(320 gig. And 2tb.) and 1 external usb/2.0 hard drive (750 gig.). The pc is an old dell gx520 tower with a fresh install of Windows 7 pro. No antivirus, network connection, or firewall enabled. Processor is a Pentium4 running 3 GHz with 1.5 gigs of ram. This is the problem: If I do a search on the 2tb. Drive for all of the jpegs, I have a total of about 84000 pictures. When I select all of the pictures and right click-copy and try to paste to another hard drive the pc will lock up and won't display a copy status window. Windows says it's not responding. Now, if I right click-copy a single folder which has anywhere, from a few files to several hundred gigs. of data in it, using the same 2tb. Drive, it will copy over to another drive just fine. I have tried, changing the swap file from "windows managed" to, up to 20 gig. Thinking the search was maybe having to write to the swap file. This didn't work. I also booted in to safe mode and tried to do the copy from the 2tb. To the 320gig. drive and still no difference. I have tried this with windows copy handler and teracopy. It all has something to do with the fact that I am doing a search for the files before copying them.
I have a triple boot system: XP 32 bit, XP 64 bit, Win7 Pro 64 bit, each on a separate partition on separate hard drives. I can backup each of the XP OS partitions with a program I wrote that basically does a file and folder copy to a folder in a spare partition on one of the hard drives. The copy program I wrote tries to preserve time stamp and short file name info, otherwise, it's just a file and folder copy program. I use windiff to verify after a backup (or restore). For a restore, I can quick format a partition and copy the files back (using the program I wrote).
I tried doing the same with the Win 7 OS partition, backup, quick format, restore, but some of the information (metadata?) is lost. All of the actual data is there, and windiff doesn't show any differences, and Win 7 boots up, but then there are issues. ATI video driver catalyst control center fails to run (don't recall error message). The publisher information for many (or most or all) of the programs is lost, causing User Acess Control dialog box to appear anytime I tried to run a program,which should be Microsoft, but shows up as unknown. Internet Explorer 8 will state that a program has corrupted the default search provider repeatedly (even after selecting one).
So something is different between Win 7 NTFS and Win XP NTFS, or I need to enhance my copy program to copy addtional file information when doing the copies. If I get the time, I'll try a drag and drop from windows explorer in XP to see if that makes any difference.So currently I'm stuck using Win 7 system image backup for the Win 7 OS partition (it also images the C partition which contains the boot files like bootmgr).
My main HDD is comfigured into two partitions, C: for Windows 7 and D: for data/downloads/etc. Whenever I copying a large file from Partition D: to Partition C: and vise versa, the transfer slows down to a crawl and the HDD activity light on my case stops blinking.
