How we do our lens tests
The first thing we do when we receive a lens for reviewing is to put it on a camera and use it! That may seem obvious, but we do actually put it on a camera and use it for it’s intended purpose in order to get a feel for the lens and how it works long before we put it through the full test procedure. This has a couple of advantages when it comes to the actual test in that we have an idea of how the lens performs and an inkling of what to look for, or more closely at.
Having used the lens on at least a couple of occasions, we then set it up and take a number of shots of a test target under as controlled conditions as possible. Lenses under 300mm in focal length are set up indoors at a minimum of 25 times the focal length from the target. Two 500w Interfit 3200 lighting units light the target at 45º. The lens is fitted to the camera and mounted on a Manfrotto 055 tripod and a 468RC2 Proball head.
Lenses over 300mm are set up out of doors with as even lighting as available, avoiding strong sunshine. Shots are taken with the self-timing mechanism.
A series of photographs are taken of parts of the target, normally two for each full aperture at each focal length. For an f/2.8 zoom lens that stops down to f/32 this can be as many as 48 individual shots. The area or region of interest of the target that we shoot complies with the ISO 12233 slant edge test.
Testing lenses for DSLR’s is not such a simple task as it was in the days of 35mm film, due to the variety of sensors fitted to the cameras.
After some searching, we found a program that is designed to compare not only lenses, but digital cameras as well. The program is Imatest software. There are many parameters measured by this system, but in order to produce results that were easily assimilated we settled on the measurement of cycles per pixel. Although these measurements can be taken at a number of levels (MTF10, MTF30, etc) we settled on the rather conservative level of MTF50 as this is the finest point at which the eye can detect sharpness. The measurement is also uncorrected, a better method of testing the lens rather than the camera it is mounted on.
The files are converted from the RAW that they are captured in without any sharpening applied and saved as jpg’s. It is these files that are then run through the Imatest software to achieve the figures we present to you in graph form. At the time of writing we have put over 20 lenses through this system, Lenses of the same marque and repeat runs have been carried out to ensure a consistency and accuracy of results. It should be noted however, that results are only relevant to the camera/sensor combination that the test was carried out on!
Two shots are then taken with prime lenses, or four with zoom lenses (each end of the zoom). These are the scene shots that are included with the review. One scene is shot with the lens wide open, the other with the lens stopped down to f/8.
Between these items of information, which include the reviewer’s opinion of the lens as well, it should give you enough information to help you make up your mind about the suitability of the lens for your purposes. The tests though, provide no warranty as to the suitability of the lens for that purpose and variations do occur in the manufacturing process that may affect the performance of your individual model.
More information about Imatest software may be found here Imatest software
|An example of the graphs |
Higher readings are better
Edge is approx 75% of the distance from the centre to the corner.
|The target used for testing |
This view is always taken with the lens wide open. In the tests, it ca be clicked on to open full size in a new window. The view can be used to assess distortions as well as sharpness wide open. It will always be approximately the same size as the viewing position is varied. With zoom lenses there will be an example of this view at each end of the zoom range.
|This view again will be openable at full size and is always taken at f/8. In this case the viewing position is fixed and will give you an idea of the angle of view the lens gives. |
With zoom lenses, there will be an example of this view at each end of the zoom range. This one is at 18mm on an SD10 (1.7x crop)
This one is at 70mm on an SD10 (1.7x crop)
This one is at 200mm on a Canon 1D (1.3x crop)
The only post processing that these images have is auto-levels and sharpen in Photoshop 7.
The tripod used has been upgraded to a Manfrotto 055ProB and the head to a 468MG RC4.
The Imatest software has been upgraded and split into two versions, Amateur and Pro. We now use the latest pro version (currently 1.6.16 PRO)
This includes a distortion module that will give a figure for the distortion and a shot is taken of a grid to assess this. One at each end in the case of a zoom. The figure is a percentage of the amout a straight line 'bends' across the width of the frame, minus figures being barrel distortion and positive figures being pincushion distortion. At +/- 1.5% the bend starts to become noticeable.
The Maritime Museum door has had a number of items of street furniture placed in front of it, including a bus stop, precluding shooting it with longer lenses, so an alternative 'target' has been found, that of a church window with plenty of detail in the flint work to study.
It is probable though, that the Door will still be used for shorter focal length lenses.
In addition, your outdoor, wide-open image would be more helpful if it contained more detail in the corners (instead of rather featureless stone), and if you also gave us the same scene perhaps 2 stops down and at f/8.
Online Printing Companies | Online Print Shop Management System | Custom Sticker Printing | Sticker Printing companies | Printing Service | Product Photographer
Albuquerque Printing Company Arizona Printing Company Atlanta Printing Company Austin Printing Company Baltimore Printing Company Boston Printing Company Charlotte Printing Company Chicago Printing Company Cleveland Printing Company Colorado Printing Company Columbus Printing Company Dallas Printing Company Denver Printing Company Detroit Printing Company Houston Printing Company Indianapolis Printing Company Jacksonville Printing Company Kansas City Printing Company Las Vegas Printing Company Los Angeles Printing Company Louisville Printing Company Memphis Printing Company Miami Printing Company Milwaukee Printing Company Minneapolis Printing Company Nashville Printing Company New Orleans Printing Company New York Printing Company Oakland Printing Company Oklahoma City Printing Company Philadelphia Printing Company Phoenix Printing Company Pittsburgh Printing Company Portland Printing Company Sacramento Printing Company San Antonio Printing Company San Diego Printing Company San Francisco Printing Company San Jose Printing Company Seattle Printing Company Washington Printing Company Toronto Printing Company Vancouver Printing Company Calgary Printing Company Edmonton Printing Company Winnipeg Printing Company Ottawa Printing Company Montreal Printing Company Quebec Printing Company St John's Printing Company Saskatoon Printing Company Regina Printing Company
Albuquerque Sticker Printing Arizona Sticker Printing Atlanta Sticker Printing Austin Sticker Printing Baltimore Sticker Printing Boston Sticker Printing Charlotte Sticker Printing Chicago Sticker Printing Cleveland Sticker Printing Colorado Sticker Printing Columbus Sticker Printing Dallas Sticker Printing Denver Sticker Printing Detroit Sticker Printing Houston Sticker Printing Indianapolis Sticker Printing Jacksonville Sticker Printing Kansas City Sticker Printing Las Vegas Sticker Printing Los Angeles Sticker Printing Louisville Sticker Printing Memphis Sticker Printing Miami Sticker Printing Milwaukee Sticker Printing Minneapolis Sticker Printing Nashville Sticker Printing New Orleans Sticker Printing New York Sticker Printing Oakland Sticker Printing Oklahoma City Sticker Printing Philadelphia Sticker Printing Phoenix Sticker Printing Pittsburgh Sticker Printing Portland Sticker Printing Sacramento Sticker Printing San Antonio Sticker Printing San Diego Sticker Printing San Francisco Sticker Printing San Jose Sticker Printing Seattle Sticker Printing Washington Sticker Printing Toronto Sticker Printing Vancouver Sticker Printing Calgary Sticker Printing Edmonton Sticker Printing Winnipeg Sticker Printing Ottawa Sticker Printing Montreal Sticker Printing Quebec Sticker Printing St John's Sticker Printing Saskatoon Sticker Printing Regina Sticker Printing
Albuquerque Sticker Arizona Sticker Atlanta Sticker Austin Sticker Baltimore sticker Boston sticker Charlotte sticker Chicago sticker Cleveland sticker Colorado sticker Columbus sticker Dallas sticker Denver sticker Detroit sticker Houston sticker Indianapolis sticker Jacksonville sticker Kansas City sticker Las Vegas sticker Los Angeles sticker Louisville sticker Memphis sticker Miami sticker Milwaukee sticker Minneapolis sticker Nashville sticker New Orleans sticker New York sticker Oakland sticker Oklahoma City sticker Philadelphia sticker Phoenix sticker Pittsburgh sticker Portland sticker Sacramento sticker San Antonio sticker San Diego sticker San Francisco sticker San Jose sticker Seattle sticker Washington sticker Toronto sticker Vancouver sticker Calgary sticker Edmonton sticker Winnipeg sticker Ottawa sticker Montreal sticker Quebec sticker St John's sticker Saskatoon sticker Regina sticker
Add your message
428 MTF tests
74 in-depth photodo reviews
100+ users join each day
Help the lens community by reviewing or rating a lens today via our lens search
- Nikon AF-S Nikkor 35mm f/1.8G Lens Review
- Panasonic Lumix G Vario 12-32mm f/3.5-5.6 ASPH. Lens Review
- Nikon AF-S DX Nikkor 18?55mm f/3.5?5.6G VR II Lens Review
- Dorr 12mm f/7.4 Fisheye Wide-Angle Lens Review
- Lomography x Zenit 85mm f/2.2 Petzval Art Lens Review
- Pentax SMC P-DA 12-24mm f/4.0 ED/AL (IF) Lens Review
- Sony E 18-105mm f/4 PZ G OSS Lens Review
- Pentax-D FA 100mm f/2.8 Macro WR Lens Review
- Sony E 18-55mm f/3.5-5.6 OSS Lens Review
- Carl Zeiss Vario-Tessar E 16-70mm f/4 ZA OSS T* Review