cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

5d mk III RAW issue

andreicraciun
Contributor

DPP_output_from_RAW.JPGLR5_output_from_RAW.jpg

 

Hey, i'm experiencing issues with the RAW files. I think there might be a sensor problem because i tested the original file on another computer and it's the same. Attached here, u have the same raw file exported in Digital camera Proffesional and Lightroom 5.

I'm a professional photographer and every now and then, i get this kind of errors. I usually shoot RAW+JPEG low and the weird thing is that the jpg file out of the camera does not contain any errors, only the RAW file does.

I tested everithing, from different batteries, different cards, different lenses, with/without battery grip and that problem still persists. Every 200-300-400 images one raw file is corrupt.

I cannot afford loosing images. Can somebody tell me if this is a random error everybody gets or is it a service issue and i should get my camera checked right away?

Thanks.

28 REPLIES 28

Yes, I assumed SW to mean software, too. How are you getting the files from the camera into your computer? Maybe the transfer process is corrupting the larger files somehow. Try removing the card from the camera, and reading them directly with your computer.

 

You could also have bad sectors on your hard drive, which are being used to buffer the larger RAW files as they are transferred. In fact, I can dream up an entire host of possibilities, but that isn't troubleshooting. The proper way to troubleshoot is to eliminate possibilities, not look for them. Try reading the card directly with your PC.

--------------------------------------------------------
"Enjoying photography since 1972."

My suspicion falls on the common component: the Canon RAW component (driver, codec, etc.).  This component is used by Photoshop, Lightroom, and DPP.   Whenever one installs any app that reads Canon RAW files, the Canon RAW component is usually automatically installed.  My logic:  

1) The problem first appeared to me just minutes after I installed the latest DPP on the Canon support site.  

2) The images that appear corrupted are two years old, and I know that these images were fine before I installed DPP.  The images are on my hard drive and have not been changed/moved since before I installed DPP.  

3) Lightroom and Photoshop both are seeing the corruption now since I installed DPP.  

4) Further clues are provided by carefully watching the images load on 100% zoom.  A slightly fuzzy but accurate image is shown for a fraction of a second, then the fully detailed image comes into view.   It is in this final pass that the corrution appears on the screen.   If the failure was caused by a bad disk (for example), the corruption would likely happen at random parts of the RAW files when comparing multiple images.  However, the failure is always in the same area: in the high-res loading of the image.

 

The problem is not, however, affecting all RAW files.  Only a small fraction.  I have over 20,000 files and is hard for me to find the impacted images without stepping through each file.   I have not been able to find any other common ingredient that distinguishes the images with the problem from those without it.

 

What I have tried:  I have uninstalled every Canon app that I had installed on my machine (Win 7 64 bit).  I unstalled all Adobe apps.  I then reinstalled just Lightroom.   The problem remains.  I have not gone so far as to research if I need to mess with my Windows registry to attempt to disable the Canon RAW component. 

 

What else could this be?  It is possible that Adobe could be the culprit.  I have the CC subscription and it is possibe that there was a fix that Adobe posted at about the same time that I did the DPP install yesterday.  

 

BTW, this is one really strong reason why switching away from RAW files to a DNG file format is a good thing.  The DNG format is open-source and has many more sets of eyeballs looking at the quality of the DNG drivers.   The Canon RAW driver is fully-owned by Canon and if Canon developers mess it up, then your entire catalog is in jeopardy.


@DuaneIndeed wrote:

My suspicion falls on the common component: the Canon RAW component (driver, codec, etc.).  This component is used by Photoshop, Lightroom, and DPP.   Whenever one installs any app that reads Canon RAW files, the Canon RAW component is usually automatically installed.  My logic:  

1) The problem first appeared to me just minutes after I installed the latest DPP on the Canon support site.  

2) The images that appear corrupted are two years old, and I know that these images were fine before I installed DPP.  The images are on my hard drive and have not been changed/moved since before I installed DPP.  

3) Lightroom and Photoshop both are seeing the corruption now since I installed DPP.  

4) Further clues are provided by carefully watching the images load on 100% zoom.  A slightly fuzzy but accurate image is shown for a fraction of a second, then the fully detailed image comes into view.   It is in this final pass that the corrution appears on the screen.   If the failure was caused by a bad disk (for example), the corruption would likely happen at random parts of the RAW files when comparing multiple images.  However, the failure is always in the same area: in the high-res loading of the image.

 

The problem is not, however, affecting all RAW files.  Only a small fraction.  I have over 20,000 files and is hard for me to find the impacted images without stepping through each file.   I have not been able to find any other common ingredient that distinguishes the images with the problem from those without it.

 

What I have tried:  I have uninstalled every Canon app that I had installed on my machine (Win 7 64 bit).  I unstalled all Adobe apps.  I then reinstalled just Lightroom.   The problem remains.  I have not gone so far as to research if I need to mess with my Windows registry to attempt to disable the Canon RAW component. 

 

What else could this be?  It is possible that Adobe could be the culprit.  I have the CC subscription and it is possibe that there was a fix that Adobe posted at about the same time that I did the DPP install yesterday.  

 

BTW, this is one really strong reason why switching away from RAW files to a DNG file format is a good thing.  The DNG format is open-source and has many more sets of eyeballs looking at the quality of the DNG drivers.   The Canon RAW driver is fully-owned by Canon and if Canon developers mess it up, then your entire catalog is in jeopardy.


Since you're using Windows, there's one possibility that occurs to me. If, in Windows, you click on the Properties tab of an image file and then the Details tab, you'll find some components that you can edit: Title, Subject, Comments, etc. I recall trying to use those on RAW (.CR2) files and finding that they corrupted the image. Apparently the Windows properties conflict with the Exif data in Canon's RAW files. Once I avoided using them, I've had no more problems with corrupted RAW files.

Bob
Philadelphia, Pennsylvania USA

andreicraciun
Contributor
Wait a second, you didn't specify one thing. The RAW files look ok in DPP? because in my case, DPP shows the files corrupted aswell.


@andreicraciun wrote:
Wait a second, you didn't specify one thing. The RAW files look ok in DPP? because in my case, DPP shows the files corrupted aswell.

No, DPP is the editor I use for all my RAW files, and it wouldn't read them. But the problem occurred only if I had entered values for some of the Windows-specific settings on the RAW files.

Bob
Philadelphia, Pennsylvania USA

Uh oh... if indeed those images WERE fine... and now you are opening images (known to previously fine on that same computer) and they are no longer fine... then I suspect you've got a failing hard drive.  

 

I'll explain.

 

I had a problem very much like yours except in my case I was using Apple's "Aperture" software.  

 

HOWEVER... I'm a big believer in having backups.. and I have two different types of backup systems which backup my entire computer.  Both of them have saved me in different ways.

 

One of my backups is basically a disk "clone".  It creates a backup image of my hard drive and it's even a bootable backup.  In other words if my disk were to fail completely (or even if the whole computer was fried) I could plug that backup drive into a working computer and boot from the backup drive... and literally have everything as though I was working on my original computer hard drive.  

 

The other backup is an "incremental" backup (it's Apple's "Time Machine" backup system.)  Time Machine activates once per hour, in the background, and looks for any files that have changed.  It automatically backs up all changes to the backup system every hour (but only files that have changed in that hour.   It is taught to neglect some unimportant files such as caches, etc. that don't really need to be backed up.)    Once the hourly backups are 1 week hold, Time Machine consolidates those "hourly" backups into "daily" backups.  It also consolidates "daily" backups which are more than 1 month old into "weekly" backups and it maintains weekly backups going back as far in time as possible for as long as it has disk space to store the data.  At some point it will run out of disk space and when that happens it deletes the oldest backups to make room for the newest backups.

 

So here's the story...

 

I had been using Aperture without issue for years.  One day I needed to get some images that I had shot about 3 months ago (and had used those images many times -- there was no problem with them.)  But on this particular day I opened the images and they were showing signs of corruption... much like the images you posted of your DPP images.  I knew those same images were previosuly fine and that I hadn't touched in them in a couple of months.

 

I ran a filesystem check and the filesystem utility found (no surprise here) that there were numerous errors on the filesystem.  It repaired them.  But the damage was done and those files were still corrupted.

 

So I brought the backup system online (the one that "clones" my drive) to just grab the files I needed from that system... only to discover that the images were corrupted on the backup system (that backup system backs up "everything" when it runs so it backed up the already-corrupt copies of the images.)

 

So then I brought the time-machine backup online and checked the images there and discovered that the latest backups were indeed also corrupt... but I started going back in time... one week at a time... until I found a point where the images existed and were not corrupted.  I restored those images and the problem was solved.... so I thought.

 

Within a day or two, I began to notice more randomly corrupted files... did another filesystem integrity check.  It failed.  I did a filesystem repair and fixed the filesystem (which claimed to repair all errors successfully)... but just for fun I re-rain the filesystem integrity check just a few hours later and...  it failed again (within that short amount of time).  Clearly I couldn't trust the drive anymore.

 

Here's why:

 

The hard drive has physical platters and a set of "access arms".  The arms swing in or out to reach the inner or outer "tracks" (concentric rings onto which the drive will save your data).  The tolerances are very tight and the access arms move VERY fast.  After enough years of heavy use, things can start to loosen up in the drive and the access arms can have just a tiny amount of slop.  This means that when the read/write heads position over a track they might not be directly over that specific track... but off by just a small amount.  As the drive ages enough, that "small amount" of error can be enough that the drive is partially writing onto the adjacent track and damaging whatever files just happened to be stored there.

 

So... I ordered a replacement drive and in the two days it took for that drive to be delivered, I ran my computer off the "bootable" backup.   Once the new drive was installed, I did a restore from the Time Machine backup, but I restored the machine to a point in time which was about a month old (before all the damage wa done to random files.)  Things were messy for a few days but once the replacement drive arrived I did get everything restored back as though nothing had ever happened.

 

If you are getting damaged files from images that you KNOW were previously not damaged when they came out of the camera (you've opened these same images before and they were fine... and you're sure about that...) then I suggest you use a disk utility to check the integrity of your filesystem.  You may (and I suspect you probably do) have slow failing hard drive and it's no longer accurately positioning the read/write heads over the intended disk track.

 

The somewhat famouse Google hard drive study found that while a drive *could* fail at any age, they are most likely to fail either in the 1st six months of use... or after about 5 years of use.  But they *could* fail anytime. 

 

Tim Campbell
5D III, 5D IV, 60Da

Like Tim, I suspect the hard drive.  Try reading the card directly, instead of transferring images ot the hard drive.  Troublehsooting means eliminating possibilities, not looking for them. 

 

Who was who said it, Sherlock Holmes or Mr. Spock?  Once you eliminate all of the possilbe, what you have left, no matter how improbable, is the solution.

--------------------------------------------------------
"Enjoying photography since 1972."

It is simple to "eliminate all of the possible" but you are going to need another unrelated computer.  You need a brand new high quality CF card, Lexar orSandisk, etc.  A new USB cable.  Everything in the photo shooting and transferring to the computer routine. A fresh d/l of DPP or LR.

 

My guess is the software (this includes, drivers, USB, CF card). Not the camera and not the HD.

EB
EOS 1D, EOS 1D MK IIn, EOS 1D MK III, EOS 1Ds MK III, EOS 1D MK IV and EOS 1DX and many lenses.

"My suspicion falls on the common component: the Canon RAW component (driver, codec, etc.).  This component is used by Photoshop, Lightroom, and DPP.   Whenever one installs any app that reads Canon RAW files, the Canon RAW component is usually automatically installed. "

 

Perhaps others know differently and can add to the discussion, but it is my understanding from what I have read over the years that this is not a correct statement.

 

Lightroom and Photoshop use the Adobe developed Adobe Camera Raw engine, which is not a Canon product, and is not the same decoder as used by DPP or in the Canon SDK that some third party software uses.

 

If I am correct, and I believe I am, then focusing on software may be detouring you from pursuing the real problem.

John Hoffman
Conway, NH

1D X Mark III, M200, Many lenses, Pixma PRO-100, Pixma TR8620a, Lr Classic


@jrhoffman75 wrote:

"My suspicion falls on the common component: the Canon RAW component (driver, codec, etc.).  This component is used by Photoshop, Lightroom, and DPP.   Whenever one installs any app that reads Canon RAW files, the Canon RAW component is usually automatically installed. "

 

Perhaps others know differently and can add to the discussion, but it is my understanding from what I have read over the years that this is not a correct statement.

 

Lightroom and Photoshop use the Adobe developed Adobe Camera Raw engine, which is not a Canon product, and is not the same decoder as used by DPP or in the Canon SDK that some third party software uses.

 

If I am correct, and I believe I am, then focusing on software may be detouring you from pursuing the real problem.


Adobe Camera Raw isn't Canon-specific, so it must use some sort of Canon-specific interface somewhere in its internals. While it's at least possible that Adobe wrote such an interface from scratch, it seems more likely that it uses the Canon RAW Codec, which constitutes Canon's official definition of its RAW file formats. Old timers may recall that the Canon RAW Codec used to be a downloadable piece of Canon software which Windows itself used in order to display .CR2 files in its own programs. If you didn't have it installed, Windows couldn't read your RAW files. Beginning, I believe, with Windows 7, that was no longer necessary, as Microsoft incorporated the Canon RAW Codec into the operating system. But though it now operates behind the scenes, it's presumably still there.

 

That said, if there were a serious problem with a recent version of the Canon RAW Codec, one would expect there to have been a major hullabaloo about it; and that hasn't happened, so far as I know.

Bob
Philadelphia, Pennsylvania USA
Announcements