Peter L. P. Dillon (born 1934) is an American physicist, and the inventor of integral color image sensors[1] and single-chip color video cameras.[2] The curator of the Technology Collection at the George Eastman Museum, Todd Gustavson, has stated that "the color sensor technology developed by Peter Dillon has revolutionized all forms of color photography. These color sensors are now ubiquitous in products such as smart phone cameras, digital cameras and camcorders, digital cinema cameras, medical cameras, automobile cameras, and drones".[3] Dillon joined Kodak Research Labs in 1959 and retired from Kodak in 1991[4]. He lives in Pittsford, New York.
Early life and education
editPeter Dillon was born in Richmond, Virginia on March 22, 1934. He attended the University of Virginia where he received a bachelor’s degree in physics in 1956[4]. Upon graduation, he was awarded a Fulbright Fellowship at Cambridge University, England.[4] He joined Kodak Research Labs (KRL) in 1959.[4]
Integral color image sensors
editIn early 1974, KRL began an effort to develop a one-piece color video camera / recorder (now known as a camcorder), to replace home movie cameras which used 8mm film[4]. Work on the magnetic recorder portion was headed by James U. Lemke,[5] while Peter Dillon was responsible for the camera portion[3]. KRL had already begun research related to charge coupled devices (CCDs), which were invented in the late 1960s at Bell Labs[6]. But CCD sensors only captured black and white (i.e., monochrome) images. At the time, a color CCD camera required three sensors and a color beam splitter (e.g., a prism), making it too bulky and expensive for a handheld camcorder[7]
In 1974, Dillon conceived the idea of fabricating a pattern of color filters directly on top of the individual pixels of a CCD image sensor, during the latter steps of the wafer fabrication process[1]. He recognized that such a color filter array (CFA) would selectively sensitize some of the sensor’s pixels to only capture red light, some to only capture green light, and the remainder to only capture blue light.[8] After working with his KRL colleagues to fabricate the CFA and develop the circuitry needed for a single-chip color camera, Dillon presented his work at an IEEE conference in December 1976.[1]
To determine the best color pattern to use, Dillon consulted his KRL colleague Bryce Bayer.[3] In response, Bayer invented a pattern having 50% green pixels arranged in a checkerboard, with alternate rows of red and blue pixels in between, which is now widely known as the “Bayer filter”[9]. However, the Bayer CFA was incompatible with the interlaced readout used in NTSC television scanning, since red and blue appear only on alternate lines and therefore only in alternate fields.[2] Dillon then invented an alternative CFA pattern, with a green checkerboard, and blue color values on each line[10]. He used this pattern for the color CCD sensor (shown in the below figure) in the single chip camera he developed[2]
In order to develop a color filter array fabrication process which was compatible with semiconductor fabrication processes, Dillon collaborated with his Kodak colleague, KRL Physical Chemist Albert Brault[3]. Brault invented a process using dye sublimation through photoresist windows onto a receiving polymer layer that was coated on top of the pixels of a CCD image sensor during the wafer fabrication stage[11]. As a result, the color filters could be simultaneously applied to the hundreds of image sensor chips being fabricated on the same wafer before the chips were diced and packaged. This made the process very economical.
Since Kodak had not yet developed working CCD image sensors, KRL fabricated the first CFA (using Dillon’s CFA pattern) on a small glass plate[1]. The glass plate coated with the CFA was registered and bonded to the top of an existing 100 x 100 pixel CCD sensor made by Fairchild, from which the cover glass had been removed[12]. The performance of the CFA itself, and the combination of the CFA and monochrome CCD, were reported in a 1978 paper.[12]
Single-chip color camera processing
editDillon incorporated this 100 x 100 pixel color image sensor in the world's first single-chip color video camera, which he described in an IEEE paper published in February 1978.[2] Dillon and Bayer invented the image processing algorithm and circuitry used in the camera, which is described U.S. Patent No. 4,176,373.[13] This patent describes the signal processing circuitry used to create full red, green, and blue camera output signals from the CFA pixel values. The circuitry samples the sensor’s output signal at the appropriate times, in order to decode the color pattern, and then interpolates intermediate values between the samples. It processes the green pixels to produce a high spatial frequency luminance signal, which is added to the three low spatial frequency color channels,[8] as shown in the figure Today, all single-sensor color cameras use a more sophisticated version of this fundamental approach, now known as “demosaicing”.[14]
Dillon is responsible for another important video camera technology, which extends the range of operation at low light levels. As described in U.S. Patent No. 4,016,597,[15] Dillon and his KRL colleague Jim DePalma recognized that integral color image sensors are sensitive to infrared (IR) wavelengths. As a result, color video cameras must include an Infrared (IR) blocking filter in order to obtain proper color reproduction[16]. They demonstrated that, by automatically removing the IR blocking filter at very low light levels, the sensitivity could be significantly increased to produce acceptable monochrome images[15]. This invention is widely used today to provide a "night vision" feature in camcorders and color video security cameras[17]
Honors and awards
editPeter L. P. Dillon and Albert Brault both received Technology and Engineering Emmy Awards in 2019 for “Pioneering Development of the Single-Chip Color Camera”.[3][18] In 2022, they received the IEEE Masaru Ibuka Consumer Electronics Award for “Contributions to the development of image sensors with integrated color filter arrays for digital video and still cameras".[19][20]
References
edit- ^ a b c d "Integral color filter arrays for solid state imagers, 1976 International Electron Devices Meeting, Washington D.C." IEEE Xplore. doi:10.1109/IEDM.1976.189067. S2CID 35103154. Retrieved 2023-12-13.
- ^ a b c d Dillon, Peter (1978). "Color Imaging System Using a Single CCD Area Array, IEEE Journals of Solid-State Circuits, February 1978". IEEE Xplore. doi:10.1109/JSSC.1978.1050992. S2CID 41078706. Retrieved 2023-12-13.
- ^ a b c d e Overton, Gail (2019-04-07). "Color sensing technology wins Rochester scientists Technology Emmy Awards". Laser Focus World. Retrieved 2023-12-23.
- ^ a b c d e Memmott, Jim (September 26, 2021). "Take photos with your phone? You have these two Kodak researchers to thank". Rochester Democrat & Chronicle. Retrieved 2023-12-13.
- ^ US3962725A, Lemke, James U. & Lentz, Robert A., "Magnetic-tape cartridge-loaded portable video camera using prerecorded timing signals to control the video time base", issued 1976-06-08
- ^ Boyle, W. S.; Smith, G. E. (1970). "Charge coupled semiconductor devices | Nokia Bell Labs Journals & Magazine". Bell System Technical Journal. 49 (4): 587–593. doi:10.1002/j.1538-7305.1970.tb01790.x. Retrieved 2023-12-22.
- ^ Sharma, Gaurav (2003). Digital Color Imaging Handbook (1st ed.). Boca Raton: CRC Press. pp. 730–731.
- ^ a b Parulski, Kenneth (1985). "Color filters and processing alternatives for one-chip cameras, IEEE Transactions on Electron Devices". IEEE Xplore. doi:10.1109/T-ED.1985.22133. S2CID 9008653. Retrieved 2023-12-22.
- ^ US3971065A, Bayer, Bryce E., "Color imaging array", issued 1976-07-20
- ^ US4047203A, Dillon, Peter L. P., "Color imaging array", issued 1977-09-06
- ^ US4081277A, Brault, Albert Thomas; Light, William Andrew & Martin, Thomas William, "Method for making a solid-state color imaging device having an integral color filter and the device", issued 1978-03-28
- ^ a b Dillon, Peter (1978). "Fabrication and Performance of Color Filter Arrays for Solid-State Imagers, IEEE Journal of Solid-State Circuits, February 1978". IEEE Xplore. doi:10.1109/JSSC.1978.1050991. S2CID 38593079. Retrieved 2023-12-13.
- ^ US4176373A, Dillon, Peter L. P. & Bayer, Bryce E., "Signal processing for discrete-sample-type-color-video signal", issued 1979-11-27
- ^ Lukac, Rastislav, ed. (2008-09-09). Single-Sensor Imaging: Methods and Applications for Digital Cameras (1st ed.). Boca Raton, Fla.: CRC Press. pp. 183–209. ISBN 978-1-4200-5452-1.
- ^ a b US4016597A, Dillon, Peter L. P. & DePalma, James J., "Color video camera with selectively expanded sensitivity", issued 1977-04-05
- ^ Sharma, Gaurav (2003). Digital Color Imaging Handbook (1st ed.). Boca Raton: CRC Press. pp. 738–739.
- ^ "10 Best Camcorders With Night Vision In The US - Christmas 2023". Best Products Reviews.
- ^ "70th Award Recipients – The Emmys". theemmys.tv. Retrieved 2023-12-23.
- ^ "IEEE Masaru Ibuka Consumer Electronics Award". ETHW. 2022-02-09. Retrieved 2023-12-23.
- ^ "ICCE 2022 | Official Website". icce.org. Retrieved 2023-12-23.