+

US8223208B2 - Device and method for calibrating an imaging device for generating three dimensional surface models of moving objects - Google Patents

Device and method for calibrating an imaging device for generating three dimensional surface models of moving objects Download PDF

Info

Publication number
US8223208B2
US8223208B2 US11/595,573 US59557306A US8223208B2 US 8223208 B2 US8223208 B2 US 8223208B2 US 59557306 A US59557306 A US 59557306A US 8223208 B2 US8223208 B2 US 8223208B2
Authority
US
United States
Prior art keywords
imaging device
distances
focal plane
calibration
focus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US11/595,573
Other languages
English (en)
Other versions
US20070104361A1 (en
Inventor
Eugene J. Alexander
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MOTION ANALYSIS CORP
Original Assignee
MOTION ANALYSIS CORP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MOTION ANALYSIS CORP filed Critical MOTION ANALYSIS CORP
Priority to EP06827675A priority Critical patent/EP1960941A4/fr
Priority to US11/595,573 priority patent/US8223208B2/en
Priority to PCT/US2006/043662 priority patent/WO2007058900A2/fr
Publication of US20070104361A1 publication Critical patent/US20070104361A1/en
Assigned to MOTION ANALYSIS CORPORATION reassignment MOTION ANALYSIS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ALEXANDER, EUGENE J
Application granted granted Critical
Publication of US8223208B2 publication Critical patent/US8223208B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147—Details of sensors, e.g. sensor lenses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/12—Acquisition of 3D measurements of objects

Definitions

  • the invention relates generally to apparatus and methods for generating three dimensional surface models of moving objects, and more particularly devices and methods for determining a parameterization of the optical characteristics of the elements of a device.
  • the generation of three dimensional models of moving objects has uses in a wide variety of areas, including motion pictures, computer graphics, video game production, human movement analysis, orthotics, prosthetics, surgical planning, sports medicine, sports performance, product design, surgical planning, surgical evaluation, military training, and ergonomic research.
  • Motion capture techniques are used to determine the motion of the object, using retro-reflective markers such as those produced by Motion Analysis Corporation, Vicon Ltd., active markers such as those produced by Charnwood Dynamics, magnetic field detectors such as those produced by Ascension Technologies, direct measurement such as that provided by MetaMotion, or the tracking of individual features such as that performed by Peak Performance, Simi. While these various technologies are able to capture motion, nevertheless these technologies do not produce a full surface model of the moving object, rather, they track a number of distinct features that represent a few points on the surface of the object.
  • a 3D surface model of the static object can be generated.
  • a number of technologies can be used for the generation of full surface models: laser scanning such as that accomplished by CyberScan, light scanning such as that provided by Inspeck, direct measurement such as that accomplished by Direct Dimensions, and structured light such as that provided by Eyetronics or Vitronic).
  • a device and method is needed for calibrating the imaging device.
  • a novel method of parameterizing the optical characteristics of the imaging elements of the device is presented.
  • the internal camera parameters are determined. These parameters change depending on the mathematical model of the camera that is used, ranging from the very simplistic to the more sophisticated.
  • a novel device is provided which is intended to operate with dynamic optical properties, changing zoom, focus, and aperture settings.
  • the current invention teaches a novel method for determining the camera parameterization over a range of imaging device settings.
  • FIG. 1 is an asymmetric view of an imaging device illustrating the various embedded coordinate systems.
  • FIG. 2 is a side view of the focus plane of the projector system in alignment with the optical axes lines of convergence from the gray-scale cameras and the optical axes of the projector system.
  • FIG. 3 is a side view of the system for performing internal calibration of an imaging device.
  • FIG. 4 is plane view of the system of FIG. 3 .
  • FIG. 5A is a side view of a mounting jig.
  • FIG. 5B is a plane view of the mounting jig of FIG. 5A .
  • FIG. 5C is a front view of the mounting jig of FIG. 5A .
  • FIG. 6 is a front view of a focused and defocused calibration object.
  • Imaging devices which combine cameras and a projector into one device are referred to as imaging devices.
  • the imaging device is a device that is capable of producing a three dimensional representation of the surface of one aspect of a three dimensional object such as the device described in U.S. patent application Ser. No. pending, entitled Device for Generating Three Dimensional Surface Models of Moving Objects, filed on Oct. 4, 2006, which is incorporated by reference into the specification of the present patent in its entirety.
  • Such an imaging device has a mounting panel. Contained within the mounting panel of the imaging device are grey scale digital video cameras. There may be as few as two grey scale digital video cameras and as many grey scale digital video cameras as can be mounted on the mounting panel. The more digital video cameras that are incorporated, the more detailed the model generated is.
  • the grey scale digital video cameras may be time synchronized.
  • the grey scale digital video cameras are used in pairs to generate a 3D surface mesh of the subject.
  • the mounting panel may also contain a color digital video camera. The color digital video camera may be used to supplement the 3D surface mesh generated by the grey scale camera pair with color information.
  • Each of the video cameras have lenses with electronic zoom, aperture and focus control. Also contained within the mounting panel is a projection system.
  • the projection system has a lens with zoom and focus control.
  • the projection system allows an image, generated by the imaging device, to be cast on the object of interest, such as an actor or an inanimate object.
  • Control signals are transmitted to the imaging device through a communications channel. Data is downloaded from the imaging device through another communications channel. Power is distributed to the imaging device through a power system.
  • the imaging device may be controlled by a computer (e.g. a data processing system with a processor, memory, et cetera.).
  • FIG. 1 is an asymmetric view of an imaging device 105 .
  • the imaging device 105 has a rigid coordinate system 110 that is embedded in the base 120 of the orientation controller.
  • the three degree of freedom rotation system 125 allows the imaging device in its totality to move and adjust in three planes.
  • Connected to the three degree of freedom orientation system 125 is another rigid coordinate system 130 that is the main coordinate system of the imaging device, Ri.
  • the coordinate systems 150 ( a - c ) embedded in each of the imaging devices for the gray-scale cameras are labeled Rc 1 -RcN, where N is the number of cameras. If color cameras 165 are employed, the coordinate systems 160 are labeled Rrbg, and Rp is the coordinate system 170 embedded in the projector 175 .
  • Ri 130 is embedded in the back plane 140 holding all of the individual devices, i.e., the cameras and projectors, of the imaging device.
  • the coordinate systems of all of the individual optical devices are mechanically roughly aligned to be parallel to the common rigid coordinate system Ri 130 .
  • the mechanical axes which is determined by the way in which the lense of the device is mounted during use, of each of the grey scale cameras 155 ( a - c ), the mechanical axes of the color camera 165 and the mechanical axes of the projector 175 are roughly perpendicular to the plane of the back plane 140 . As depicted in FIG.
  • grey scale cameras 155 there are three grey scale cameras 155 ( a - c ), however this is not intended to be a limitation, there may be as few as two grey scale cameras.
  • the maximum number of grey scale cameras 155 ( a -N n ) is limited only by the size of the back plane 140 of the imagine device 105 .
  • the number of color cameras 165 and projectors 175 shown is not intended to be a limitation.
  • the optical axes of the individual devices are not exactly parallel. They converge at a point 210 on a reference focal plane 220 of a projector as depicted in FIG. 2 .
  • the optical axes 150 ( a - c ) of the more than one grey scale camera 155 ( a - c ) embedded in the imaging device 105 are designed to converge at the point 210 where the focal plane 220 is met by the perpendicular line directly from the center of the optical axes 170 of the projector 175 through that imaging plane. In most applications, this plane would be chosen to be the expected distance that the imaging device will be from the object to be imaged.
  • the imaging device is expected to be 10 feet from the test subject, the focal plane 220 will be set at 10 feet.
  • the imaging device 105 is then able to operate effectively anywhere from 4 to 16 feet from the test subject.
  • the distances described are exemplar and are not intended to be a limitation.
  • the coordinate systems 150 ( a - c ), 160 , 170 of each of the individual devices are approximately aligned with the coordinate system 130 of the overall imaging device 105 , which is connected by the three degree of freedom rotation system 125 to the rigid coordinate system 110 in the base 120 of the imaging device 105 .
  • each of the optical devices has a number of internal variables that are determined by the settings of the cameras 155 ( a - c ), 165 .
  • the zoom, focus and aperture of each of the individual cameras 155 ( a - c ), 165 is set as is the exposure time; gamma settings; gain controls; optical center, aspect ratio, logical pixel size, etc.
  • FIG. 2 is a representation of the focal plane 220 of the projector system as it aligns with the optical axes lines 230 , 240 , 250 of convergence from the gray-scale cameras 155 ( a - c ) and the optical axes 260 of the projector system 175 .
  • FIG. 2 The relationship between the various coordinate systems is illustrated in FIG. 2 .
  • the optical axes 260 of the projector 175 and the optical axes 230 , 240 , 250 of the cameras 155 ( a - c ), 165 all meet at a point of convergence 210 at the base focal plane 220 .
  • the cameras 155 ( a - c ), 165 and projector 175 are rigidly fixed to the back plane 140 of the imaging device 105 , the relationship between all of these coordinate systems can be described by a set of static rigid body transformations.
  • FIGS. 3 and 4 depict an overall internal calibration system 300 ; FIG. 3 is a side view of the internal calibration system and FIG. 4 is a plane view of the internal calibration system.
  • a long linear tracked device 310 with a step motor 420 included is laid on the floor or other level surface.
  • a directional mount 330 connects to the tracked device 310 .
  • Mounted to the directional mount 330 is an individual imaging device system 105 , such as that shown in FIG. 1 , so that it may be calibrated.
  • a mounting jig 320 extending from the mounting jig 320 is a perpendicular rod 350 which holds an alignment panel 360 .
  • Attached to the alignment panel 360 is a planar surface 470 .
  • This planar surface 470 is the calibration object. No features are required on this panel; the panel may be any size that is suitable for calibration purposes. For example the panel may be as small as 6 in by 6 in or as large as 10 ft by 10 ft. Preferably the panel is on the order of 3 ft tall by 3 ft wide, though other sizes may be appropriate depending on the imaging needs.
  • This panel, the calibration object 470 is a flat planar surface with a light colored matte finish.
  • the calibration object 470 is mounted on the overall calibration device at some fixed distance from the imaging system in order for calibration to be performed.
  • the calibration object 470 translates along the optical axis of the calibration system 300 .
  • the extent of travel along the axis and the number of discrete steps taken along that axis varies depending on the application.
  • a step is an incremental movement along the length of the track device.
  • a complete internal calibration would be performed for each camera and projector. Details of the calibration process are given below.
  • the optical axis of the projector 170 is aligned with the calibration object 470 by setting the orientation of the imaging device 105 to neutral and using the directional mount 500 shown in FIG. 5 .
  • the imaging device 105 may be adjusted in all three planes.
  • the neutral position is that alignment of the imaging device where none of the joints 125 are rotated.
  • the imaging device 105 is aligned perpendicularly to the calibration object 470 .
  • An image is then projected on the calibration object 470 and observed by the individual cameras 155 ( a - b ), 165 .
  • a human operator adjusts the focus on the projector 175 to make sure that the coded grid pattern projects in focus at the imaging device 105 .
  • Each grey scale camera 155 ( a - b ) is then focused, zoomed and apertured to produce the desired reference image pattern in the grey scale cameras.
  • the features are detected in each camera and repeated for all of the cameras on the imaging device.
  • the imaging device 105 is going to be used to image one side of one-half of a large human, when the average distance between the calibration object 470 and the human is expected to be 8′ ⁇ 4′ with a standard deviation of 2′.
  • the neutral location of the calibration object 470 would be at 8 ft. from the imaging device 105 .
  • the focal control of the projector 175 is set to be in focus at the calibration object, and is adjusted manually if necessary.
  • each camera is focused and apertured to produce the desired reference image pattern in the camera.
  • the features are detected in all cameras and the features between cameras are corresponded. That is, features detected in one camera are identified in another camera and a label (such as feature # 1 ) is attached to each feature point.
  • a feature point is some element of the projected pattern that is discernible, for example, if projecting a grid pattern as illustrated in FIG. 6 , one feature point 670 would be the intersection of two perpendicular lines.
  • the correspondence between features is done using the coded imaging information shown in FIG. 6 .
  • the known quantities are the distance from the calibration object to the imaging device and the size of the features that have been projected by the projector.
  • This information enables the three-dimensional location of all feature points on the calibration object to be calculated.
  • some number of the 3D feature points and their 2D projections on the camera plane provide the data needed to calculate a parameterization of the camera.
  • the DLT camera model of Abdel-Aziz and Karara described immediately below, eleven parameters will characterize the camera and then 6 or more feature points and their 2D projections on the camera plane will be used to calculate the parameterization.
  • the internal camera parameters can be calculated by using any of a number of known algorithms. For example, the DLT approach as explained in Abdel-Aziz, Y. I., & Karara, H.
  • the camera calibration parameters for objects that are correctly imaged on this focal plane are now known. This information is stored and is used when the imaging device is in operation and the specific parameters are set. For every attempt to focus the calibration projector on a focal plane at this distance from the imaging device, the internal parameters for the projector and for all of the cameras are therefore known.
  • the current set of camera calibration information is perfectly acceptable when the feature points are in focus at the focal plane for which the calibration was made.
  • the imaging device is used for imaging a non-planar object.
  • the expected camera plane is that plane where the device is intended to operate at a time instant. This expected camera plane is selected by the system operator and is usually coincident with one aspect of the object being scanned.
  • the projector is intentionally misfocused from a distance of 10 cm short of the object to a distance 10 cm past the object.
  • a statistical analysis is performed of the images of the object being scanned as seen from each camera. All pixels are then attributed to either being a white background pixel or a black grid-pattern pixel. This statistical information is used for consistency checks when trying to determine the true location of a featured point during data acquisition and as a fine 3-D point calculation resolving approach, to be described later.
  • FIGS. 5A , 5 B, 5 C depicts a representation of a directional mount 500 .
  • the directional mount 500 has at its base 510 , a ball and socket joint 520 that allows three degree of freedom rotation changes of the overall mounting system. Extending up from the base 510 is a telescoping pole 530 .
  • FIG. 5B is a plane view of the mounting jig 500 . As shown in FIG. 5B a first joint 540 allows rotation around the projector's optical axes and a second joint 550 allows the height of the imaging device to be adjusted.
  • the imaging device 105 is mounted in a directional mount such as that the directional mount 500 of FIG. 5A .
  • the projector device 175 is brought into the direction mount and is rotated about the main axes of the directional mount until the projector device 175 is roughly aligned with the center of a calibration object 470 .
  • the telescoping pole 530 of the mounting jig 320 is now stretched or compressed, which raises and lowers the calibration object 470 until the optical axis of the projector device 175 is directly aligned with the center of the planar imaging calibration object 470 .
  • the roll about that optical axis of the projector system is now adjusted until the image is seen in each of the individual cameras of the imaging device is parallel to the top and bottom of the cameras.
  • the fore and aft and up and down skew to the axial rotation is now adjusted until calibration squares at the bottom of the image are equal in size to calibration squares at the top of the image and the same right and left.
  • the imaging system is perfectly aligned and perpendicular to the planar calibration object.
  • the features are now detected, three-dimensional coordinates calculated and, as explained, the three dimensional location of each of these feature points is calculated. Given this device information, all the information needed to determine the camera's internal parameters, using any number of different calibration algorithms as described above, is now possible.
  • FIG. 6 illustrates the detail of the defocusing calibration.
  • the defocusing calibration provides additional information that can be used to validate and fine-tune the results of the initial camera calibration.
  • a bright crisp image showing the imaging system correctly focused on the calibration object is presented.
  • the thickness of the feature lines increases, the system is seen to appear blurry and the darkness of the individual lines decreases.
  • the defocusing phases are shown by the images between the focused and defocused grid patterns. This information is used to provide a mapping of the degree of defocus of any one of the individual sets of feature points either fore or aft of the expected plane. These sets of feature points can be grouped into sets of 4 points that can be treated geometrically as boxes.
  • the width of the feature line which is shown as a grid line in FIG. 6 .
  • the line might average four-pixel thickness when focused. Coming to defocus, the thickness would increase to five or six pixels. The same thing would be possible using the size of the box or possibly the ratio of the number of white pixels per box to the number of black pixels per box.
  • This procedure provides sufficient information to validate and fine-tune the previously calculated internal camera parameters for each of the individual grey scale cameras, the color camera if employed, and the projection system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Vascular Medicine (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Input (AREA)
  • Projection Apparatus (AREA)
US11/595,573 2005-11-10 2006-11-10 Device and method for calibrating an imaging device for generating three dimensional surface models of moving objects Expired - Fee Related US8223208B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP06827675A EP1960941A4 (fr) 2005-11-10 2006-11-10 Dispositif et procede d'etalonnage d'un dispositif de traitement d'image pour generer des modeles a surface tridimensionnelle d'objets en mouvement
US11/595,573 US8223208B2 (en) 2005-11-10 2006-11-10 Device and method for calibrating an imaging device for generating three dimensional surface models of moving objects
PCT/US2006/043662 WO2007058900A2 (fr) 2005-11-10 2006-11-10 Dispositif et procede d'etalonnage d'un dispositif de traitement d'image pour generer des modeles a surface tridimensionnelle d'objets en mouvement

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US73593405P 2005-11-10 2005-11-10
US11/595,573 US8223208B2 (en) 2005-11-10 2006-11-10 Device and method for calibrating an imaging device for generating three dimensional surface models of moving objects

Publications (2)

Publication Number Publication Date
US20070104361A1 US20070104361A1 (en) 2007-05-10
US8223208B2 true US8223208B2 (en) 2012-07-17

Family

ID=38003797

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/595,573 Expired - Fee Related US8223208B2 (en) 2005-11-10 2006-11-10 Device and method for calibrating an imaging device for generating three dimensional surface models of moving objects

Country Status (3)

Country Link
US (1) US8223208B2 (fr)
EP (1) EP1960941A4 (fr)
WO (1) WO2007058900A2 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10162352B2 (en) 2013-05-13 2018-12-25 The Boeing Company Remotely operated mobile stand-off measurement and inspection system
US10607383B2 (en) * 2017-05-11 2020-03-31 International Business Machines Corporation Seamless focus plane stitching to create panoramic video
US11112678B2 (en) * 2019-03-22 2021-09-07 Honda Motor Co., Ltd. Camera focus adjustment jig and camera focus adjustment method
US11350854B2 (en) 2016-11-10 2022-06-07 Children's Hospital Medical Center Augmented neuromuscular training system and method

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4530019B2 (ja) * 2007-09-28 2010-08-25 オムロン株式会社 撮像装置の調整方法
FR2927179B1 (fr) * 2008-02-01 2010-11-26 Solystic Systeme d'acquisition d'images pour l'identification de signes sur des envois postaux.
US20130063558A1 (en) 2011-09-14 2013-03-14 Motion Analysis Corporation Systems and Methods for Incorporating Two Dimensional Images Captured by a Moving Studio Camera with Actively Controlled Optics into a Virtual Three Dimensional Coordinate System
US9210404B2 (en) 2012-12-14 2015-12-08 Microsoft Technology Licensing, Llc Calibration and registration of camera arrays using a single circular grid optical target
CN107110637B (zh) * 2014-12-22 2019-11-01 赛博光学公司 对三维测量系统的校准进行更新
US10326979B2 (en) 2016-05-23 2019-06-18 Microsoft Technology Licensing, Llc Imaging system comprising real-time image registration
US10339662B2 (en) 2016-05-23 2019-07-02 Microsoft Technology Licensing, Llc Registering cameras with virtual fiducials
US20190207946A1 (en) * 2016-12-20 2019-07-04 Google Inc. Conditional provision of access by interactive assistant modules
US11436417B2 (en) 2017-05-15 2022-09-06 Google Llc Providing access to user-controlled resources by automated assistants
US10127227B1 (en) 2017-05-15 2018-11-13 Google Llc Providing access to user-controlled resources by automated assistants
CN107687821B (zh) * 2017-08-24 2019-11-15 南京理工大学 用于深孔洞旋转件形貌测量的多相机光刀系统标定方法
CN108462867B (zh) * 2017-12-29 2021-01-19 无锡易维视显示技术有限公司 自动标定跟踪式裸眼立体显示设备的系统及方法
US10780640B2 (en) 2018-07-30 2020-09-22 Intrepid Automation Multiple image projection system for additive manufacturing
EP3937030B1 (fr) 2018-08-07 2024-07-10 Google LLC Assemblage et évaluation de réponses d'assistant automatisé pour des préoccupations de confidentialité
CN111462304B (zh) * 2020-03-16 2021-06-15 天目爱视（北京）科技有限公司 一种用于太空领域的3d采集和尺寸测量方法
WO2023007405A1 (fr) * 2021-07-29 2023-02-02 Intrepid Automation Systèmes et procédés d'étalonnage pour systèmes de fabrication additive présentant de multiples projections d'images
CN117615229B (zh) * 2023-11-22 2024-08-23 西湖大学 提高高速彩色视频空间分辨率的压缩时间成像系统及方法

Citations (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3965753A (en) 1970-06-01 1976-06-29 Browning Jr Alva Laroy Electrostatic accelerometer and/or gyroscope radioisotope field support device
US4639878A (en) 1985-06-04 1987-01-27 Gmf Robotics Corporation Method and system for automatically determining the position and attitude of an object
US4965667A (en) 1987-12-22 1990-10-23 U.S. Philips Corporation Method and apparatus for processing signals conveyed in sub-sampled form by way of a transmission channel or record carrier
US5008804A (en) 1988-06-23 1991-04-16 Total Spectrum Manufacturing Inc. Robotic television-camera dolly system
US5268998A (en) 1990-11-27 1993-12-07 Paraspectives, Inc. System for imaging objects in alternative geometries
US5495576A (en) 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
WO1997035166A1 (fr) 1996-03-22 1997-09-25 Tasc, Inc. Systeme d'imagerie aeroporte
WO1997042601A1 (fr) 1996-05-06 1997-11-13 Sas Institute, Inc. Procede multimedia interactif integre
WO1998010246A1 (fr) 1996-09-06 1998-03-12 University Of Florida Gestionnaire de donnes geographiques numerique portatif et tenant dans la main
US5745126A (en) 1995-03-31 1998-04-28 The Regents Of The University Of California Machine synthesis of a virtual video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene
US5852672A (en) 1995-07-10 1998-12-22 The Regents Of The University Of California Image system for three dimensional, 360 DEGREE, time sequence surface mapping of moving objects
US5889550A (en) 1996-06-10 1999-03-30 Adaptive Optics Associates, Inc. Camera tracking system
WO2000000926A1 (fr) 1998-06-30 2000-01-06 Intel Corporation Procede et appareil de capture d'images stereoscopiques utilisant des capteurs d'images
WO2000027131A2 (fr) 1998-10-30 2000-05-11 C3D Limited Amelioration apportee a des procedes et un appareil d'imagerie tridimensionnelle
US6114824A (en) 1990-07-19 2000-09-05 Fanuc Ltd. Calibration method for a visual sensor
US20010030744A1 (en) 1999-12-27 2001-10-18 Og Technologies, Inc. Method of simultaneously applying multiple illumination schemes for simultaneous image acquisition in an imaging system
US6377298B1 (en) * 1997-06-27 2002-04-23 Deutsche Forschungsanstalt Für Luft - und Method and device for geometric calibration of CCD cameras
US6380732B1 (en) 1997-02-13 2002-04-30 Super Dimension Ltd. Six-degree of freedom tracking system having a passive transponder on the object being tracked
US20020050988A1 (en) 2000-03-28 2002-05-02 Michael Petrov System and method of three-dimensional image capture and modeling
US20020164066A1 (en) 2000-11-22 2002-11-07 Yukinori Matsumoto Three-dimensional modeling apparatus, method, and medium, and three-dimensional shape data recording apparatus, method, and medium
US20020184640A1 (en) 2001-05-31 2002-12-05 Schnee Robert Alan Remote controlled marine observation system
US6519359B1 (en) 1999-10-28 2003-02-11 General Electric Company Range camera controller for acquiring 3D models
US20030085992A1 (en) 2000-03-07 2003-05-08 Sarnoff Corporation Method and apparatus for providing immersive surveillance
WO2003044734A2 (fr) 1998-11-20 2003-05-30 Aman James A Optimisations de la poursuite d'objets 3d en temps reel pour evenements en direct
US6594600B1 (en) 1997-10-24 2003-07-15 Commissariat A L'energie Atomique Method for calibrating the initial position and the orientation of one or several mobile cameras
EP1408702A2 (fr) 2002-10-10 2004-04-14 Olympus Corporation Dispositif de prise d'images tridimensionelles, méthode de prise d'images tridimensionelles et adaptateur stéréo
US20040128102A1 (en) 2001-02-23 2004-07-01 John Petty Apparatus and method for obtaining three-dimensional positional data from a two-dimensional captured image
US6768509B1 (en) * 2000-06-12 2004-07-27 Intel Corporation Method and apparatus for determining points of interest on an image of a camera calibration object
US6788333B1 (en) 2000-07-07 2004-09-07 Microsoft Corporation Panoramic video
US6816187B1 (en) * 1999-06-08 2004-11-09 Sony Corporation Camera calibration apparatus and method, image processing apparatus and method, program providing medium, and camera
US20040223077A1 (en) 2003-05-06 2004-11-11 Amir Said Imaging three-dimensional objects
WO2004110685A2 (fr) 2003-06-12 2004-12-23 Georgia Tech Research Corporation Procedes et methodes de fabrication de carbure de bore et de composants en carbure de bore
WO2004110922A2 (fr) 2003-06-10 2004-12-23 General Electric Company Materiaux d'emmagasinage du gaz assistes par un champ et piles a combustible comprenant lesdits materiaux
US20050136819A1 (en) 2002-08-02 2005-06-23 Kriesel Marshall S. Apparatus and methods for the volumetric and dimensional measurement of livestock
WO2005065283A2 (fr) 2003-12-24 2005-07-21 Walker Digital, Llc Procede et appareil pour capturer et gerer automatiquement des images
US20050168381A1 (en) 2003-07-03 2005-08-04 Navcom Technology, Inc. Polarization sensitive synthetic aperture radar system and method for local positioning
US7274388B2 (en) * 2002-06-03 2007-09-25 Microsoft Corporation System and method for calibrating a camera with one-dimensional objects
US7403853B1 (en) 2003-03-12 2008-07-22 Trimble Navigation, Ltd Position determination system for movable objects or personnel using GPS/TV location technology integrated with inertial navigation system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6819789B1 (en) * 2000-11-08 2004-11-16 Orbotech Ltd. Scaling and registration calibration especially in printed circuit board fabrication
JP2005303524A (ja) * 2004-04-08 2005-10-27 Olympus Corp キャリブレーション用カメラ装置およびキャリブレーションシステム

Patent Citations (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3965753A (en) 1970-06-01 1976-06-29 Browning Jr Alva Laroy Electrostatic accelerometer and/or gyroscope radioisotope field support device
US4639878A (en) 1985-06-04 1987-01-27 Gmf Robotics Corporation Method and system for automatically determining the position and attitude of an object
US4965667A (en) 1987-12-22 1990-10-23 U.S. Philips Corporation Method and apparatus for processing signals conveyed in sub-sampled form by way of a transmission channel or record carrier
US5008804A (en) 1988-06-23 1991-04-16 Total Spectrum Manufacturing Inc. Robotic television-camera dolly system
US5008804B1 (fr) 1988-06-23 1993-05-04 Total Spectrum Manufacturing I
US6114824A (en) 1990-07-19 2000-09-05 Fanuc Ltd. Calibration method for a visual sensor
US5268998A (en) 1990-11-27 1993-12-07 Paraspectives, Inc. System for imaging objects in alternative geometries
US5495576A (en) 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5745126A (en) 1995-03-31 1998-04-28 The Regents Of The University Of California Machine synthesis of a virtual video camera/image of a scene from multiple video cameras/images of the scene in accordance with a particular perspective on the scene, an object in the scene, or an event in the scene
US5852672A (en) 1995-07-10 1998-12-22 The Regents Of The University Of California Image system for three dimensional, 360 DEGREE, time sequence surface mapping of moving objects
WO1997035166A1 (fr) 1996-03-22 1997-09-25 Tasc, Inc. Systeme d'imagerie aeroporte
WO1997042601A1 (fr) 1996-05-06 1997-11-13 Sas Institute, Inc. Procede multimedia interactif integre
US5889550A (en) 1996-06-10 1999-03-30 Adaptive Optics Associates, Inc. Camera tracking system
WO1998010246A1 (fr) 1996-09-06 1998-03-12 University Of Florida Gestionnaire de donnes geographiques numerique portatif et tenant dans la main
US6380732B1 (en) 1997-02-13 2002-04-30 Super Dimension Ltd. Six-degree of freedom tracking system having a passive transponder on the object being tracked
US6377298B1 (en) * 1997-06-27 2002-04-23 Deutsche Forschungsanstalt Für Luft - und Method and device for geometric calibration of CCD cameras
US6594600B1 (en) 1997-10-24 2003-07-15 Commissariat A L'energie Atomique Method for calibrating the initial position and the orientation of one or several mobile cameras
WO2000000926A1 (fr) 1998-06-30 2000-01-06 Intel Corporation Procede et appareil de capture d'images stereoscopiques utilisant des capteurs d'images
WO2000027131A2 (fr) 1998-10-30 2000-05-11 C3D Limited Amelioration apportee a des procedes et un appareil d'imagerie tridimensionnelle
WO2003044734A2 (fr) 1998-11-20 2003-05-30 Aman James A Optimisations de la poursuite d'objets 3d en temps reel pour evenements en direct
US6816187B1 (en) * 1999-06-08 2004-11-09 Sony Corporation Camera calibration apparatus and method, image processing apparatus and method, program providing medium, and camera
US6519359B1 (en) 1999-10-28 2003-02-11 General Electric Company Range camera controller for acquiring 3D models
US20010030744A1 (en) 1999-12-27 2001-10-18 Og Technologies, Inc. Method of simultaneously applying multiple illumination schemes for simultaneous image acquisition in an imaging system
US20030085992A1 (en) 2000-03-07 2003-05-08 Sarnoff Corporation Method and apparatus for providing immersive surveillance
US20020050988A1 (en) 2000-03-28 2002-05-02 Michael Petrov System and method of three-dimensional image capture and modeling
US6768509B1 (en) * 2000-06-12 2004-07-27 Intel Corporation Method and apparatus for determining points of interest on an image of a camera calibration object
US6788333B1 (en) 2000-07-07 2004-09-07 Microsoft Corporation Panoramic video
US20020164066A1 (en) 2000-11-22 2002-11-07 Yukinori Matsumoto Three-dimensional modeling apparatus, method, and medium, and three-dimensional shape data recording apparatus, method, and medium
US20040128102A1 (en) 2001-02-23 2004-07-01 John Petty Apparatus and method for obtaining three-dimensional positional data from a two-dimensional captured image
US20020184640A1 (en) 2001-05-31 2002-12-05 Schnee Robert Alan Remote controlled marine observation system
US7274388B2 (en) * 2002-06-03 2007-09-25 Microsoft Corporation System and method for calibrating a camera with one-dimensional objects
US20050136819A1 (en) 2002-08-02 2005-06-23 Kriesel Marshall S. Apparatus and methods for the volumetric and dimensional measurement of livestock
EP1408702A2 (fr) 2002-10-10 2004-04-14 Olympus Corporation Dispositif de prise d'images tridimensionelles, méthode de prise d'images tridimensionelles et adaptateur stéréo
US7403853B1 (en) 2003-03-12 2008-07-22 Trimble Navigation, Ltd Position determination system for movable objects or personnel using GPS/TV location technology integrated with inertial navigation system
US20040223077A1 (en) 2003-05-06 2004-11-11 Amir Said Imaging three-dimensional objects
WO2004110922A2 (fr) 2003-06-10 2004-12-23 General Electric Company Materiaux d'emmagasinage du gaz assistes par un champ et piles a combustible comprenant lesdits materiaux
WO2004110685A2 (fr) 2003-06-12 2004-12-23 Georgia Tech Research Corporation Procedes et methodes de fabrication de carbure de bore et de composants en carbure de bore
US20050168381A1 (en) 2003-07-03 2005-08-04 Navcom Technology, Inc. Polarization sensitive synthetic aperture radar system and method for local positioning
WO2005065283A2 (fr) 2003-12-24 2005-07-21 Walker Digital, Llc Procede et appareil pour capturer et gerer automatiquement des images

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
Grau O et al: "A Combined Studio Production System for 3-D Capturing of Live Action and Immersive Actor Feedback" IEEE Transactions on Circuits and Systems for Video Technology, IEEE Service Center, Piscataway, NJ, US LNKD- DOI:10.1109/TCSVT.2004.823397, vol. 14, No. 3, Mar. 1, 2004, pp. 370-380, XP011108802 ISSN: 1051-8215.
Grau O et al: "The ORIGAMI Project: Advanced tools for creating and mixing real and virtual content in film and TV production Visual media production" IEE Proceedings: Vision, Image and Signal Processing, Institution of Electrical Engineers, GB LNKD- DOI:10.1049/IP-VIS:20045134, vol. 152, No. 4, Aug. 5, 2005, pp. 454-469, XP006024838 ISSN: 1350-245X.
Gregor A. Kalberer; Luc Van Gool: 'Realistic face animation for speech,' The Journal of Visualization and Computer Animation, 2002, 13:97-106, DOI: 10.1002/vis283.
Ito, Y and Saito, H: "Free viewpoint image synthesis using uncalibrated multiple moving cameras" Computer Vision / Computer Graphics Collaboration Techniques and Applications (MIRAGE2005) Mar. 2, 2005, pp. 173-180, XP002608385 Retrieved from the Internet: URL:http://citeseerx.ist.psu.edu/viewdoc/summary? doi=10.1.1.81.5150 [retrieved on Nov. 1, 2010].
Nicola D'Apuzzo: 'Digitization of the Human Body in the Present-Day Economy: On the actual state of the technology and its exploitation for commercial applications', [Online] Apr. 5, 2004, XP55009675 Retrieved from the Internet: [retrieved on Oct. 17, 2011].
Thomas G A et al: "A versatile camera position measurement system for virtual reality TV production" Broadcasting Convention, 1997. IBS 97., International (Conf. Publ. 447 ) Amsterdam, Netherlands Sep. 12-16, 1997, London, UK,IEE, UK LNKD- DOI:10.1049/CP:19971284, Sep. 12, 1997, pp. 284-289, XP006508771 ISBN: 978-0-85296-694-5.

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10162352B2 (en) 2013-05-13 2018-12-25 The Boeing Company Remotely operated mobile stand-off measurement and inspection system
US11350854B2 (en) 2016-11-10 2022-06-07 Children's Hospital Medical Center Augmented neuromuscular training system and method
US10607383B2 (en) * 2017-05-11 2020-03-31 International Business Machines Corporation Seamless focus plane stitching to create panoramic video
US11112678B2 (en) * 2019-03-22 2021-09-07 Honda Motor Co., Ltd. Camera focus adjustment jig and camera focus adjustment method

Also Published As

Publication number Publication date
WO2007058900A2 (fr) 2007-05-24
EP1960941A4 (fr) 2012-12-26
EP1960941A2 (fr) 2008-08-27
US20070104361A1 (en) 2007-05-10
WO2007058900A3 (fr) 2007-11-08
WO2007058900A8 (fr) 2008-12-31

Similar Documents

Publication Publication Date Title
US8223208B2 (en) Device and method for calibrating an imaging device for generating three dimensional surface models of moving objects
US20240153143A1 (en) Multi view camera registration
KR100799088B1 (ko) 고속 디지털 팬 틸트 줌 비디오
US10271036B2 (en) Systems and methods for incorporating two dimensional images captured by a moving studio camera with actively controlled optics into a virtual three dimensional coordinate system
KR101590530B1 (ko) 자동 장면 교정
CN113841384B (zh) 校准装置，用于校准的图表和校准方法
CN112949478B (zh) 基于云台相机的目标检测方法
US8310663B2 (en) Methods and systems for calibrating an adjustable lens
US5706419A (en) Image capturing and processing apparatus and image capturing and processing method
CN110782394A (zh) 全景视频快速拼接方法及系统
WO2019049421A1 (fr) Dispositif d'étalonnage, système d'étalonnage et procédé d'étalonnage
US20070076090A1 (en) Device for generating three dimensional surface models of moving objects
CN108629829B (zh) 一种球幕相机与深度相机结合的三维建模方法和系统
CN103729839B (zh) 一种基于传感器的室外摄像机跟踪的方法及系统
CN111009030A (zh) 一种多视高分辨率纹理图像与双目三维点云映射方法
JP2003179800A (ja) 多視点画像生成装置、画像処理装置、および方法、並びにコンピュータ・プログラム
CN110445982B (zh) 一种基于六自由度设备的追踪拍摄方法
US20070076096A1 (en) System and method for calibrating a set of imaging devices and calculating 3D coordinates of detected features in a laboratory coordinate system
CN113298886B (zh) 一种投影仪的标定方法
Ikeda et al. Calibration method for an omnidirectional multicamera system
Tapper et al. Problems encountered in the implementation of Tsai’s algorithm for camera calibration
CN113330487B (zh) 参数标定方法及装置
Streckel et al. Lens model selection for visual tracking
CN102201117B (zh) 一种摄像机内参数调整的方法及装置
Safin et al. Experiments on mobile robot stereo vision system calibration under hardware imperfection

Legal Events

Date Code Title Description
AS Assignment

Owner name: MOTION ANALYSIS CORPORATION, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ALEXANDER, EUGENE J;REEL/FRAME:025827/0275

Effective date: 20110217

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载