US20180024570A1 - Gimbaled Universal Drone Controller - Google Patents
Gimbaled Universal Drone Controller Download PDFInfo
- Publication number
- US20180024570A1 US20180024570A1 US15/219,116 US201615219116A US2018024570A1 US 20180024570 A1 US20180024570 A1 US 20180024570A1 US 201615219116 A US201615219116 A US 201615219116A US 2018024570 A1 US2018024570 A1 US 2018024570A1
- Authority
- US
- United States
- Prior art keywords
- drone
- gimbal
- gimbals
- processor
- coupled
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004891 communication Methods 0.000 claims abstract description 24
- 238000005259 measurement Methods 0.000 claims abstract description 16
- 238000000034 method Methods 0.000 claims description 24
- 230000008878 coupling Effects 0.000 claims description 21
- 238000010168 coupling process Methods 0.000 claims description 21
- 238000005859 coupling reaction Methods 0.000 claims description 21
- 238000004519 manufacturing process Methods 0.000 claims description 4
- 238000003860 storage Methods 0.000 description 12
- 230000001413 cellular effect Effects 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 6
- 230000001276 controlling effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 4
- 230000008901 benefit Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 238000003306 harvesting Methods 0.000 description 3
- 230000006641 stabilisation Effects 0.000 description 3
- 238000011105 stabilization Methods 0.000 description 3
- 230000004913 activation Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000004146 energy storage Methods 0.000 description 2
- 238000011022 operating instruction Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 206010034719 Personality change Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000009833 condensation Methods 0.000 description 1
- 230000005494 condensation Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C39/00—Aircraft not otherwise provided for
- B64C39/02—Aircraft not otherwise provided for characterised by special use
- B64C39/024—Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/08—Arrangements of cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
- B64U10/14—Flying platforms with four distinct rotor axes, e.g. quadcopters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U30/00—Means for producing lift; Empennages; Arrangements thereof
- B64U30/20—Rotors; Rotor supports
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
- F16M11/02—Heads
- F16M11/04—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand
- F16M11/06—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting
- F16M11/10—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting around a horizontal axis
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
- F16M11/02—Heads
- F16M11/04—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand
- F16M11/06—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting
- F16M11/12—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting in more than one direction
- F16M11/121—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting in more than one direction constituted of several dependent joints
- F16M11/123—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting in more than one direction constituted of several dependent joints the axis of rotation intersecting in a single point, e.g. by using gimbals
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
- F16M11/02—Heads
- F16M11/18—Heads with mechanism for moving the apparatus relatively to the stand
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
- F16M11/20—Undercarriages with or without wheels
- F16M11/2007—Undercarriages with or without wheels comprising means allowing pivoting adjustment
- F16M11/2035—Undercarriages with or without wheels comprising means allowing pivoting adjustment in more than one direction
- F16M11/2071—Undercarriages with or without wheels comprising means allowing pivoting adjustment in more than one direction for panning and rolling
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M13/00—Other supports for positioning apparatus or articles; Means for steadying hand-held apparatus or articles
- F16M13/02—Other supports for positioning apparatus or articles; Means for steadying hand-held apparatus or articles for supporting on, or attaching to, an object, e.g. tree, gate, window-frame, cycle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/18—Stabilised platforms, e.g. by gyroscope
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/006—Apparatus mounted on flying objects
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/56—Accessories
- G03B17/561—Support related camera accessories
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
- G05D1/102—Simultaneous control of position or course in three dimensions specially adapted for aircraft specially adapted for vertical take-off of aircraft
-
- B64C2201/108—
-
- B64C2201/141—
-
- B64C2201/146—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2201/00—UAVs characterised by their flight controls
- B64U2201/10—UAVs characterised by their flight controls autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2201/00—UAVs characterised by their flight controls
- B64U2201/20—Remote controls
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M2200/00—Details of stands or supports
- F16M2200/04—Balancing means
- F16M2200/041—Balancing means for balancing rotational movement of the head
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
- F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
- F16M2200/00—Details of stands or supports
- F16M2200/04—Balancing means
- F16M2200/044—Balancing means for balancing rotational movement of the undercarriage
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T50/00—Aeronautics or air transport
- Y02T50/50—On board measures aiming to increase energy efficiency
Definitions
- drones like unmanned aerial vehicles (referred to herein as “drones”) have a central flight controller in the main body with a separate gimbal fitted with cameras and sensors.
- Conventional drones require complicated onboard sensor wiring, which must be fed through small pivot points. Wiring the onboard sensors is made even more difficult by the fact that multiple sensors are typically included in the gimbal of a drone. Since the central flight controller is generally remote from the gimbal, the gimbal must be run slowly to avoid losing position and attitude synchronization with the central flight controller.
- a device for use on drone including two or more gimbals, a gimbal processor, at least one inertial measurement unit, and a communication connection.
- the two or more gimbals are pivotally coupled to rotate orthogonally relative to each other.
- An inner gimbal of the two or more gimbals supports an inner platform for receiving components thereon.
- An outer gimbal of the two or more gimbals pivotally couples to the drone.
- the gimbal processor is mounted on the inner platform, wherein the gimbal processor is configured to control pivotal movement of the two or more gimbals.
- the at least one inertial measurement unit is fixed relative to the inner platform and coupled to the gimbal processor.
- the communication connection is coupled to the gimbal processor and configured to exchange signals with the drone for controlling flight parameters of the drone.
- Some embodiments may include separate gimbal drivers coupled to the two or more gimbals.
- Each of the separate gimbal drivers may be controlled by the gimbal processor and may be configured to rotate an individual one of the two or more gimbals.
- the gimbal processor may coordinate the operations of the drone with a drone processor of the drone.
- the drone processor may operate as a slave to the gimbal processor operating as a master.
- At least one camera may be fixed to the inner one of the two or more gimbals and may be coupled to the gimbal processor. The at least one camera may be configured to capture an image of a heading of the device.
- the at least one inertial measurement unit may be configured to determine an attitude and/or heading of the device relative to surroundings of the drone.
- the at least one inertial measurement unit may be configured to determine at least one of a position or movement of the components of the drone relative to the device.
- a camera may be coupled to the inner platform and the gimbal processor.
- the camera may be configured to capture an image of a heading of the device.
- a vibration sensor may be included that may be configured to detect vibrations between the inner platform and the drone.
- the two or more gimbals may pivot concentrically.
- the two or more gimbals may include three or more gimbals.
- Methods of manufacturing a drone may then include connecting the a gimbal universal drone controller to the drone so that the gimbal processor can provide control signals to controllable components on the drone.
- coupling the device to the drone may include mechanically attaching the device to a structure of the drone, and connecting drone sensor outputs and controllable components to the communication connection.
- coupling two or more gimbals to rotate orthogonally relative to each other may include coupling separate gimbal drivers to the two or more gimbals and coupling the separate gimbal drivers to the gimbal processor, in which each of the separate gimbal drivers is configured to rotate an individual one of the two or more gimbals.
- Some embodiments may further include fixing at least one camera to the inner one of the two or more gimbals and coupling the at least one camera to the gimbal processor, wherein the at least one camera is configured to capture an image of a heading of the device.
- fixing at least one camera to the inner one of the two or more gimbals may include fixing the at least one camera to the inner one of the two or more gimbals so that the at least one camera is oriented to capture an image of a heading of the device.
- Some embodiments may further include attaching a vibration sensor to the device, the vibration sensor configured to detect vibrations between the inner platform and the drone.
- coupling two or more gimbals to rotate orthogonally relative to each other may include coupling three or more gimbals to rotate orthogonally relative to each other.
- Further embodiments may include a gimbaled universal drone controller having means for performing functions of the device and/or methods described above. Further embodiments include a non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor to perform operations of the above-discussed methods.
- FIG. 1 is a schematic perspective view of a gimbaled universal drone controller according to various embodiments.
- FIG. 2 is a perspective view of a gimbaled universal drone controller according to various embodiments.
- FIG. 3A is a front perspective view of the gimbaled universal drone controller of FIG. 2 , with a transparent component housing revealing components therein according to various embodiments.
- FIG. 3B is a rear perspective view of the gimbaled universal drone controller of FIG. 2 , according to various embodiments.
- FIG. 3C is a top view of the gimbaled universal drone controller of FIG. 2 , according to various embodiments.
- FIG. 3D is a front view of the gimbaled universal drone controller of FIG. 2 , according to various embodiments.
- FIG. 3E is a left side view of the gimbaled universal drone controller of FIG. 2 , according to various embodiments.
- FIG. 3F is a right side view of the gimbaled universal drone controller of FIG. 2 , according to various embodiments.
- FIG. 3G is a bottom view of the gimbaled universal drone controller of FIG. 2 , according to various embodiments.
- FIG. 3H is a rear elevation view of the gimbaled universal drone controller of FIG. 2 , according to various embodiments.
- FIG. 4 is a perspective view of a gimbaled universal drone controller with external sensors according to various embodiments.
- FIG. 5 is a component diagram of a gimbaled universal drone controller according to various embodiments.
- FIG. 6 is a perspective view of a drone with a schematic relief diagram of a gimbaled universal drone controller, a drone control unit, and a mobile computing device according to various embodiments.
- FIG. 7A is a perspective view of a drone with a gimbaled universal drone controller according to various embodiments.
- FIG. 7B is a perspective view of a drone with two gimbaled universal drone controllers according to various embodiments.
- FIG. 8 is a process flow diagram illustrating a method of assembling a gimbal universal drone controller according to various embodiments.
- Various embodiments include a gimbaled universal drone controller for use on a drone (e.g., an aerial drone or other type of unmanned vehicle) that includes two or more gimbals controlled by a gimbal processor fixed within an innermost one of the two or more gimbal.
- the gimbal processor may determine an absolute position of the gimbaled universal drone controller using an inertial measurement unit (IMU) coupled to the gimbal processor.
- IMU inertial measurement unit
- the gimbal processor may determine a relative position of the drone for controlling attitude, movement, and stability control of the drone.
- a gimbaled universal drone controller may reduce the amount of control wiring needed for a drone and shorten the control wiring used, and thus may lighten the drone and enhance the speed of communications between a gimbal processor and various components of the drone.
- the drone may benefit from enhanced heating and cooling, better control of condensation, better prevention of fogging of the lenses, and better shielding that may be used with communication systems (e.g., Wi-Fi, GPS, etc.).
- the reduction in the number and/or size of wiring holes or leads needed for coupling the gimbal processor to other components of a drone may provide these and other benefits.
- Various embodiments may be implemented in aerial drones or drones to overcome shortcomings in the gimbals.
- Conventional flight controllers that are remote from gimbals generally experience different dampening and/or vibration effects than gimbals. Consequently conventional flight controllers will occasionally move relative to the gimbals, leads to inaccuracies in positioning and/or orientation controls.
- the various embodiments include a gimbaled universal drone controller located within the gimbal assembly. Such a configuration may provide tighter calibration between the gimbal assembly and the drone controller.
- sensors e.g., optic flow, 4K, and depth-from-stereo sensors
- sensors remain motionless relative to the gimbal, enabling movement to new vectors as needed without having to adjust for relative motion of drone motion sensors (e.g., accelerometers and gyroscopes) and gimbal sensors.
- a universal gimbaled drone controller may be implemented in any of a variety of unmanned autonomous and semi-autonomous vehicles, including aerial drones, land-based unmanned vehicles, space vehicles, and waterborne unmanned vehicles. Configurations and advantages of the various embodiments may apply equally to autonomous and semi-autonomous vehicles operating in any of these environments.
- various embodiments will be referred to generally herein as drones and described for illustrative purposes with reference to aerial drones.
- aerial drones as an example implementation or application of various embodiments are not intended to limit the scope of the claims to aerial vehicle applications unless an aerial drone or aerial drone application is specifically recited in a claim.
- control algorithms for holding the gimbal fixed on a target may be simplified as gimbal movement and flight attitude controls can be processed in an integrated manner.
- the gimbaled universal drone controller in accordance with various embodiments may trade off vehicle movements for gimbal movements and vice versa to maintain a required gimbal attitude.
- the term “gimbal” refers to a pivoted support that allows the rotation of an object about a single axis.
- a set of two or more gimbals (typically three), one mounted on the other with orthogonal pivot axes, may be used to allow an object mounted on the innermost gimbal to remain independent of the rotation of a support to which the outermost gimbal is fixed.
- the term “gimbal” refers to a component mounted on a gimbal and supported by one or more gimbals.
- the term “gimbal processor” is used herein to refer particularly to one or more processors supported by two or more gimbals.
- drone refers to one of various types of autonomous vehicles (e.g., autonomous aircraft, land vehicles, waterborne vehicles, or a combination thereof) that may operate without onboard human pilots/drivers.
- a drone may include an onboard computing device configured to fly and/or operate the drone without remote operating instructions (i.e., autonomously), such as from a human operator or remote computing device.
- the computing device onboard the drone may be configured to receive operating instructions and/or updates to instructions from a gimbaled universal drone controller in accordance with various embodiments.
- the drone may be propelled for flight and/or other movement in any of a number of known ways.
- a plurality of propulsion units each including one or more rotors, may provide propulsion or lifting forces for the drone and any payload carried by the drone.
- the drone may include wheels, tank-treads, or other non-aerial movement mechanisms to enable movement on the ground, over water, under water, or a combination thereof.
- the drone may be powered by one or more types of power source, such as electrical, chemical, electro-chemical, or other power reserve, which may power the propulsion units, the onboard computing device, and/or other onboard components.
- controller refers generally to a computing device configured to direct and/or regulate operations of electronic components coupled thereto.
- gimbaled universal drone controller refers to a device that includes a gimbaled controller configured to be a primary or exclusive controller of a drone.
- inertial measurement unit and “IMU” refer interchangeably to an electronic device that measures and reports a body's accelerations in three dimensions, angular rates in three axes of rotation, and sometimes the magnetic field surrounding the body.
- An IMU may include sensors selected from a group including cameras, accelerometers, magnetometers, and other position sensors.
- FIG. 1 illustrates a schematic representation of a gimbaled universal drone controller 100 for use on a drone (e.g., 600 in FIGS. 6, 7A, and 7B ) and configured to control operations of the drone according to various embodiments.
- the gimbaled universal drone controller 100 may include two or more gimbals pivotally coupled to rotate orthogonally relative to each other.
- the gimbaled universal drone controller 100 may include three gimbals 111 , 112 , 113 that are configured to rotate about an x-axis, a y-axis, and a z-axis, respectively.
- the three gimbals 111 , 112 , 113 include gimbal arms 131 , 132 (i.e., yokes) that extend between and pivotally couple the three gimbals 111 , 112 , 113 to one another.
- An outer gimbal 111 may be pivotally coupled to the drone.
- An inner gimbal 113 supports an inner platform 110 for receiving components thereon.
- the inner platform may support a control unit 150 that may include various circuits and devices used to control the operation of the drone (e.g., a gimbal processor and an inertial measurement unit), as well as other components of the gimbaled universal drone controller 100 (e.g., internal motors that drive the gimbals 111 , 112 , 113 ).
- the inner platform 110 and any components thereon will remain fixed relative to the inner gimbal 113 .
- the inner platform 110 may be a distinct element or a part of and/or integrally formed with a component housing 140 .
- the gimbaled universal drone controller 100 may include one or more wired connections 190 coupling the control unit 150 to a flight controller of the drone.
- the one or more wired connections 190 may be configured to exchange signals with the drone for actively controlling stabilization thereof.
- the control unit 150 may use the wired connection 190 to transmit commands and/or data to the drone, as well as receive inputs from the drone.
- the one or more wired connections 190 may supply power to the gimbaled universal drone controller 100 from the drone or other external source.
- the component housing 140 may have one or more wiring ports 115 for passing wires and connections (e.g., the wired connection 190 ) between an inner part of the component housing 140 and an outer part thereof.
- the wired connection 190 may include a slip ring concentric with a rotational axis of one of the gimbals.
- the slip ring may be configured to pass electrical signals to and from the inner part of the component housing 140 .
- a wireless transceiver may be included for the control unit 150 to communicate wirelessly with the drone.
- the gimbal arms 131 , 132 are illustrated for schematic purposes as planar square elements, numerous other shapes or configurations may be used to pivotally connect the three gimbals 111 , 112 , 113 .
- the gimbal arms 131 , 132 may have a yoke-like or U-shaped configuration attaching two opposed pivot points.
- the gimbal arms 131 , 132 may arch between two orthogonal pivot point (i.e., extending only ninety degrees).
- the gimbaled universal drone controller 100 is illustrated in FIG. 1 using a three-dimensional Cartesian space having an x-axis, a y-axis, and a z-axis (indicated as “x,” “y,” and “z” respectively on opposed ends of each axis), which may be used as a frame of reference for determining attitude, heading, and stability of the gimbaled universal drone controller 100 , the drone, or a combination thereof.
- a wide range of vehicles and applications may make use of the gimbaled universal drone controller 100 according to various embodiments.
- Some non-limiting examples of vehicles and applications that may utilize the gimbaled universal drone controller include machinery, aeronautical vehicles, aerospace vehicles, motor vehicles, waterborne vehicles, medical devices, robots, toys, appliances, electronics, and any apparatus that might benefit from motion stability and control.
- the gimbaled universal drone controller 100 may be a spherical or substantially spherical component, as illustrated in FIG. 2 .
- the gimbaled universal drone controller 100 includes three gimbals 111 , 112 , 113 pivotally coupled to rotate orthogonally relative to each other.
- the three gimbals 111 , 112 , 113 include gimbal arms 131 , 132 that extend between and pivotally couple the three gimbals 111 , 112 , 113 to one another.
- the outer gimbal 111 may be pivotally coupled to the drone and the inner gimbal 113 may support the inner platform 110 for receiving components thereon.
- the inner platform 110 may support the control unit 150 , as well as support structures 142 fixing the component housing 140 relative to the inner platform 110 .
- the inner platform 110 may support the control unit 150 , including a gimbal processor (e.g., 520 in FIG. 5 ) and an IMU (e.g., 525 in FIG. 5 ), which may be configured to control pivotal movement of the two or more gimbals 111 , 112 , 113 .
- the wiring port 115 may provide access for wires and/or cables, such as the wired connection 190 , which may provide a communication connection between the gimbal processor 520 and the drone.
- the wired connection 190 may thus be used to exchange signals with the drone for actively controlling stabilization thereof.
- the gimbaled universal drone controller 100 may include separate drivers 121 , 122 , 123 configured to rotate a respective one of the three gimbals 111 , 112 , 113 .
- the drivers 121 , 122 , 123 may include any mechanism for effecting a suitable or desired force (and/or torque).
- Example drivers may include linear motors, rotary motors, stepper motors, servomotors, brushed motors, brushless motors, DC motors, AC motors, limited angle motors, and so on. These motors may be mixed or matched as desired or appropriate.
- the control unit 150 may control a current or other mechanism used to selectively actuate one or more of the drivers 121 , 122 , 123 .
- the drivers 121 , 122 , 123 may each include vibration dampening elements 141 to reduce vibrations being conveyed from one gimbal to another.
- mounts between the control unit 150 and the inner platform 110 may include dampeners to reduce vibrations there between.
- An encoder may be included with each of the drivers 121 , 122 , 123 to provide feedback to the control unit of the angular position of each of the three gimbals 111 , 112 , 113 , respectively.
- each of the three gimbals 111 , 112 , 113 may include an IMU coupled to the control unit 150 for providing absolute position information for each of the three gimbals 111 , 112 , 113 relative to the inner platform 110 and the control unit 150 mounted thereon.
- FIGS. 3A-3H illustrate the gimbaled universal drone controller 100 of FIG. 2 , but with the component housing 140 being transparent, and thus revealing internal components according to various embodiments.
- the gimbaled universal drone controller 100 may include various components such as the two or more gimbals 111 , 112 , 113 pivotally coupled to rotate orthogonally relative to each other.
- the inner gimbal 113 supports the inner platform 110 for receiving components thereon.
- FIGS. 3A and 3B particularly illustrate front and rear perspective views, respectively, of the gimbaled universal drone controller 100 .
- the inner platform 110 may be partially disposed within the component housing 140 and partially disposed outside the component housing 140 .
- FIGS. 3C-3H illustrate, top, front, left side, right side, bottom, and rear views of the gimbaled universal drone controller 100 of FIGS. 3A and 3B , according to various embodiments.
- the gimbal universal drone controller 100 may include peripheral components, as illustrated in FIG. 4 .
- the gimbaled universal drone controller 100 may include a sensor housing 160 , which may protect peripheral components like camera(s) 541 , sensor(s) 542 , and/or the like.
- FIG. 5 is a component block diagram of a gimbaled universal drone controller 100 according to various embodiments.
- the gimbaled universal drone controller 100 may include the inner platform 110 that supports various circuits and devices used to power and/or control the operation of the gimbaled universal drone controller 100 , as well as a drone coupled thereto.
- the inner platform 110 may support the component housing 140 that may house many of the circuits and devices of the gimbaled universal drone controller 100 .
- the component housing 140 may house the control unit 150 , a power module 535 , an input module 540 , an output module 545 , and three gimbal modules 531 , 532 , 533 .
- the control unit 150 may include a gimbal processor 520 coupled to memory 521 , a navigation unit 523 , an IMU 525 , and an avionics module 527 all via communication bus 529 .
- the gimbal processor 520 may be configured with processor-executable instructions to control pivotal movement of the gimbals, as well as control flight and other operations of a drone, including operations of the various embodiments.
- the gimbaled universal drone controller 100 may have stored in the memory 521 different flight control rules customized for different types of drones. For example, flight control rules for a quad-coptor, sect copter, a plane, or any of a variety of drones may be accesses by the gimbal processor to accommodate and properly control any drone.
- the control unit 150 may be coupled to the one or more cameras 541 , one or more (other) sensors 542 , and/or the like.
- the cameras 541 may include one or more image capturing devices. More than one image-capturing device may be configured to contemporaneously capture two different images for providing stereoscopic visualization.
- the one or more other sensors 542 may be position sensors, such as pressure sensors (i.e., for detecting wind, lift, drag, or changes therein), a motion sensor, or other sensors.
- the one or more other sensors 542 may be analog sensors or absolute position encoders that are configured to determine a relative position of the gimbal universal drone controller 100 , as well as the drone coupled thereto, relative to the real world and/or the drone, including components thereof.
- the gimbaled universal drone controller 100 may receive inputs including power (i.e., battery power from the drone, e.g., 600 in FIGS. 6-7B ), signals from external components (e.g., GPS, magnetometer, camera, and/or IMU), which may work in conjunction with similar internal components.
- the power input may be used to drive motors that move the gimbals (e.g., brushless motor and/or electronic motor controllers) and one or more processors and sensors fixed relative to the inner platform (e.g., 110 ).
- the gimbaled universal drone controller 100 may output motor output commands that control movement and stability of the drone, such as to an electronic speed control (ESC).
- the output may include data signals communicated to a transceiver in conjunction with an antenna to remote components, such as sensors and data gathering sources.
- the output connection may include wired connections, such as one or more serial connections, controller area network (CAN) connections, and/or fixed-pin connections.
- the power module 535 may include one or more batteries that may provide power to various components, including the gimbal processor 520 , the three gimbal modules 531 , 532 , 533 , the input module 540 , the one or more cameras 541 , the sensor(s) 542 , the input module 540 , the output module 545 , and a radio module 550 .
- the power module 535 may include energy storage components, such as rechargeable batteries.
- the gimbal processor 520 may be configured with processor-executable instructions to control the charging of the power module 535 , such as by executing a charging control algorithm using a charge control circuit. Alternatively or additionally, the power module 535 may be configured to manage its own charging.
- the gimbal processor 520 may be coupled to an output module 545 , which may output control signals for managing operations of the drone or components thereof.
- the gimbal processor 520 may control pivotal movement of each of the gimbals.
- the gimbal processor 520 may receive data from the navigation unit 523 and/or the IMU 525 and use such data in order to determine the present position and orientation of the gimbaled universal drone controller 100 or components thereof.
- the navigation unit 523 may include a global navigation satellite system (GNSS) receiver system (e.g., one or more Global Positioning System (GPS) receivers) enabling the gimbaled universal drone controller 100 to navigate using GNSS signals.
- GNSS global navigation satellite system
- GPS Global Positioning System
- the navigation unit 523 may be equipped with radio navigation receivers for receiving navigation beacons or other signals from radio nodes, such as navigation beacons (e.g., very high frequency (VHF) Omni Directional Radio Range (VOR) beacons), Wi-Fi access points, cellular network sites, radio station, remote computing devices, other drones, etc.
- navigation beacons e.g., very high frequency (VHF) Omni Directional Radio Range (VOR) beacons
- Wi-Fi access points e.g., Wi-Fi access points, cellular network sites, radio station, remote computing devices, other drones, etc.
- the gimbal processor 520 may be configured to communicate with a remote computing device through a wireless connection (e.g., a cellular data network) to receive commands to use or stop using protocols, receive data useful in navigation, provide real-time position altitude reports, and assess data.
- the avionics module 527 coupled to the gimbal processor 520 , the navigation unit 523 , and/or the IMU 525 may be configured to provide flight control-related information such as altitude, attitude, airspeed, heading and similar information that the navigation unit 523 may use for navigation purposes, such as dead reckoning between GNSS position updates.
- the avionics module 527 may include or receive data from the IMU 525 that provides data regarding the orientation and accelerations of the gimbaled universal drone controller 100 , the drone, or both, which may be used in navigation and positioning calculations, as well as some of the embodiments.
- the radio module 550 may be included, which may be configured to receive wireless signals 14 via an antenna 551 .
- Received wireless signals may include, for example, command signals to perform various flight maneuvers, signals from aviation navigation facilities, etc.
- the radio module 550 may provide such signals to the gimbal processor 520 , the navigation unit 523 , and/or the IMU 525 to assist in operation of the gimbaled universal drone controller 100 and/or the drone.
- commands for navigating the gimbaled universal drone controller 100 and/or the drone, or components thereof may be received via the radio module 550 .
- the gimbaled universal drone controller 100 may receive signals from the remote computing device 12 via uplink signals sent from an antenna 7 via the wireless signals 14 .
- the gimbaled universal drone controller 100 may output commands and/or data signals through the wireless signals 14 .
- the wireless signals 14 may alternatively be used as a backup mechanism for communicating, in case a wired connection is not functioning properly.
- the gimbaled universal drone controller 100 that includes the radio module 550 may also include an internal source, such as batteries on the inner platform 110 .
- Such a gimbaled universal drone controller 100 that is wireless and self-powered may be easily connected to a drone 600 without the need for numerous wired connections.
- the radio module 550 may be configured to switch between a cellular connection and a Wi-Fi or other form of radio connection depending on the location and altitude of the gimbaled universal drone controller 100 .
- the radio module 550 may communicate with a cellular infrastructure in order to maintain communications with a remote server.
- communications with the remote computing device 12 may be established using cellular telephone networks while the gimbaled universal drone controller 100 and/or drone is out of line-of-sight of the remote computing device 12 .
- Communication between the radio module 550 and the operator communication link may transition to a short-range communication link, such as the wireless signals 14 (e.g., Wi-Fi), when the gimbaled universal drone controller 100 moves closer to the remote computing device 12 .
- the gimbaled universal drone controller 100 may include and employ other forms of radio communication, such as mesh connections with other gimbaled universal drone controllers or connections to other information sources (e.g., balloons or other stations for collecting and/or distributing weather or other data harvesting information).
- the control unit 150 may be equipped with the input module 540 , which may be used for a variety of applications.
- the input module 540 may receive and pre-process images or data from an onboard component, such as camera 541 or sensor(s) 542 , or may receive electronic signals from other components (e.g., a payload).
- the input module 540 may receive an activation signal for causing actuators on the gimbaled universal drone controller 100 and/or the drone to deploy landing cushions or similar components for affecting an emergency landing.
- the output module 545 may be used to activate components (e.g., an energy cell, an actuator, an indicator, a circuit element, a sensor, and/or an energy-harvesting element).
- the various components of the gimbaled universal drone controller 100 are illustrated as separate components, some or all of the components (e.g., the gimbal processor 520 , the output module 545 , the radio module 550 , and other units) may be integrated together in a single device or module, such as a system-on-chip (SoC).
- SoC system-on-chip
- the gimbaled universal drone controller 100 may have similar or different configurations and/or other aspects.
- FIG. 6 illustrates a configuration of a drone 600 that may be used in conjunction with various embodiments.
- the drone 600 may include the gimbaled universal drone controller 100 coupled thereto.
- the gimbaled universal drone controller 100 is illustrated as being disposed on a lower side of the drone 600 .
- the gimbaled universal drone controller 100 may be secured almost anywhere on the drone 600 .
- the drone 600 may include a control unit 610 of its own that may house various circuits and devices used to power and control the operation of the drone 600 , such as when directed by or not controlled by the gimbaled universal drone controller 100 .
- the control unit 610 may include a processor 620 , a power module 630 , an input module 640 , an additional camera 641 , sensor(s) 642 , an output module 645 , and a radio module 650 coupled to an antenna 651 .
- the processor 620 may include or be coupled to memory 621 and a navigation unit 623 .
- the processor 620 may be configured with processor-executable instructions to control flight and other operations of the drone 600 , including operations of the various embodiments.
- the power module 630 may include one or more batteries that may provide power to various components, including the processor 620 , the input module 640 , the sensor(s) 642 , the output module 645 , and the radio module 650 .
- the one or more batteries may supply power to the gimbaled universal drone controller 100 through the wired connection (e.g., 190 ).
- the power module 630 may include energy storage components, such as rechargeable batteries.
- the processor 620 may be configured with processor-executable instructions to control the charging of the power module 630 , such as by executing a charging control algorithm using a charge control circuit.
- the power module 630 may be configured to manage its own charging.
- the processor 620 may be coupled to an output module 645 , which may output control signals for managing the motors that drive the rotors 615 and other components.
- the processor 620 may act as a slave processor to the gimbal processor (e.g., 520 in the control unit 150 ) operating as a master. In this way, the gimbal processor may coordinate the operations of the drone 600 .
- the drone 600 may be controlled in flight.
- the processor 620 may receive data and/or instructions from the gimbaled universal drone controller 100 and use such data in order to change a present position, speed, and/or orientation of the drone 600 , as well as an appropriate course or attitude change.
- the navigation unit 623 may include a global navigation satellite system (GNSS) receiver system (e.g., one or more Global Positioning System (GPS) receivers) enabling the drone 600 to navigate using GNSS signals.
- GNSS global navigation satellite system
- GPS Global Positioning System
- the navigation unit 623 may be equipped with radio navigation receivers for receiving navigation beacons or other signals from radio nodes, such as navigation beacons (e.g., very high frequency (VHF) Omni Directional Radio Range (VOR) beacons), Wi-Fi access points, cellular network sites, radio station, remote computing devices, other drones, etc.
- navigation beacons e.g., very high frequency (VHF) Omni Directional Radio Range (VOR) beacons
- Wi-Fi access points e.g., Wi-Fi access points, cellular network sites, radio station, remote computing devices, other drones, etc.
- the processor 620 and/or the navigation unit 623 may be configured to communicate with a server through a wireless connection (e.g., a cellular data network) to receive commands to use or stop using the extended flight protocol, receive data useful in navigation, provide real-time position altitude reports, and assess data.
- An avionics module 627 coupled to the processor 620 and/or the navigation unit 623 may be configured to provide flight control-related information such as altitude, attitude, airspeed, heading and similar information that the navigation unit 623 may use for navigation purposes, such as dead reckoning between GNSS position updates.
- the avionics module 627 may include or receive data from a gyro/accelerometer unit 625 that provides data regarding the orientation and accelerations of the drone 600 that may be used in navigation and positioning calculations, as well as some of the embodiments.
- the gimbaled universal drone controller 100 may be configured to communicate with a server or other remote computing device through a wireless connection provided by the drone 600 (e.g., a cellular data network) to receive data useful in navigation, provide real-time position altitude reports, and assess data.
- the radio module 650 may be configured to receive signals via the antenna 651 , such as command signals to perform various flight maneuvers, receive signals from aviation navigation facilities, etc., and provide such signals to the processor 620 and/or the gimbaled universal drone controller 100 to assist in operation of the drone 600 .
- commands for navigating the drone 600 , or components thereof may be received via the radio module 650 and communicated to the gimbaled universal drone controller 100 .
- the drone 600 may receive signals from the remote computing device 12 via uplink signals sent from an antenna 7 via the wireless signals 14 .
- the control unit 610 may be equipped with the input module 640 , which may be used for a variety of applications.
- the input module 640 may receive and pre-process images or data from the gimbaled universal drone controller 100 , or may receive electronic signals from other components.
- the input module 640 may receive an activation signal for causing actuators on the drone 600 to deploy landing cushions or similar components for affecting an emergency landing.
- the output module 645 may be used to communicate data to the gimbaled universal drone controller 100 .
- the output module 645 may be used to activate components (e.g., an energy cell, an actuator, an indicator, a circuit element, a sensor, and/or an energy-harvesting element).
- the gimbaled universal drone controller 100 may include one or more calibration procedures.
- the processor may calibrate measurements of the IMU's and sensors at various stages of drone operation. For example, a preliminary calibration protocol may run when the drone starts up, but is stationary on the ground. An intermediate calibration protocol may run when the drone starts moving and/or when propulsion units start up. A moving calibration protocol may run once the drone is moving so the processor may assess reactions to actions executed by the processor for learning desired effects.
- the drone 600 may include more or fewer than four rotors or be a completely different type of unmanned autonomous vehicle.
- the gimbaled universal drone controller 100 may be constructed using a molded frame in which such support and/or housing structures are obtained through the molded structure.
- FIG. 7A illustrates a drone (e.g., 600 ) including a gimbaled universal drone controller 100 in accordance with various embodiments.
- the drone 600 may use various components, such as the gimbaled universal drone controller 100 , to manage operation of the rotors 615 and other components of the drone 600 .
- FIG. 7B illustrates the drone 600 with two gimbaled universal drone controllers 100 in accordance with some embodiments.
- the drone 600 may use the two gimbaled universal drone controllers 100 to provide stereoscopic sensing for more accurate attitude, movement, and stability control.
- the plurality of gimbaled universal drone controllers 100 may cooperate, working together redundantly and/or using a master/slave relationship.
- a drone 600 is provided with a system that can obtain visual images correlated to absolute relative positions.
- the two gimbaled universal drone controllers 100 may provide more accurate navigational and stabilization control.
- the two gimbaled universal drone controllers 100 may also provide redundancies for the drone 600 in case one of the gimbaled universal drone controllers 100 is malfunctioning or otherwise not operating effectively.
- flight gimbals are often located on the bottom of a drone
- various embodiments may locate at least one gimbaled universal drone controller 100 on an upper or other surface of the drone 600 .
- more than one gimbaled universal drone controller 100 may be used together on a single drone.
- a plurality of gimbaled universal drone controllers 100 may capture stereoscopic imagery.
- the gimbaled universal drone controller(s) 100 illustrated in FIGS. 7A and 7B are used on aerial drones, the embodiments are not limited to aerial vehicles or vehicles of any type and may be implemented in or on any frame. Various embodiments are described with reference to a drone, particularly an aerial drone, for ease of reference. However, the description of the gimbal universal drone controller 100 used with a drone is not intended to limit the scope of the claims to aerial drones.
- FIG. 8 illustrates a method 800 of manufacturing a gimbaled universal drone controller and a drone using such a controller according to some embodiments.
- two or more gimbals may be coupled together so that the gimbals rotate orthogonally relative to each other.
- the two or more gimbals may be assemble so that an inner gimbal of the two or more gimbals supports an inner platform configured for receiving components thereon, and so an outer gimbal of the two or more gimbals pivotally can be coupled to a drone.
- a gimbal processor and an inertial measurement unit may be mounted on the inner platform.
- the gimbal processor may be configured to control pivotal movement of the two or more gimbals.
- the gimbal processor may be coupled to the IMU to receive data signals.
- a communication connection may be coupled to the gimbal processor.
- the communication connection may be configured to exchange signals with the drone to enable the gimbal processor to receive information from drone sensors and send commands to controllable components on the drone for controlling operations of the drone.
- the gimbaled universal drone controller may be attached to any form of autonomous or semi-autonomous vehicle or drone.
- the gimbaled universal drone controller may be connected to the drone so that the gimbal processor can provide control signals to controllable components on the drone.
- This operation may include mechanically attaching the gimbaled universal drone controller to a structure of the drone and connecting drone sensor outputs and controllable components to the communication connection.
- processor refers to a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein.
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- a general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
- a processor may also be implemented as a combination of receiver smart objects, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some operations or methods may be performed by circuitry that is specific to a given function.
- the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer-readable storage medium or non-transitory processor-readable storage medium.
- the operations of a method or algorithm disclosed herein may be embodied in a processor-executable software module or processor-executable instructions, which may reside on a non-transitory computer-readable or processor-readable storage medium.
- Non-transitory computer-readable or processor-readable storage media may be any storage media that may be accessed by a computer or a processor.
- non-transitory computer-readable or processor-readable storage media may include RAM, ROM, EEPROM, FLASH memory, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage smart objects, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer.
- Disk and disc includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above are also included within the scope of non-transitory computer-readable and processor-readable media.
- the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable storage medium and/or computer-readable storage medium, which may be incorporated into a computer program product.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Aviation & Aerospace Engineering (AREA)
- Automation & Control Theory (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Description
- Many unmanned vehicles like unmanned aerial vehicles (referred to herein as “drones”) have a central flight controller in the main body with a separate gimbal fitted with cameras and sensors. Conventional drones require complicated onboard sensor wiring, which must be fed through small pivot points. Wiring the onboard sensors is made even more difficult by the fact that multiple sensors are typically included in the gimbal of a drone. Since the central flight controller is generally remote from the gimbal, the gimbal must be run slowly to avoid losing position and attitude synchronization with the central flight controller.
- Various embodiments are disclosed of a device for use on drone including two or more gimbals, a gimbal processor, at least one inertial measurement unit, and a communication connection. The two or more gimbals are pivotally coupled to rotate orthogonally relative to each other. An inner gimbal of the two or more gimbals supports an inner platform for receiving components thereon. An outer gimbal of the two or more gimbals pivotally couples to the drone. The gimbal processor is mounted on the inner platform, wherein the gimbal processor is configured to control pivotal movement of the two or more gimbals. The at least one inertial measurement unit is fixed relative to the inner platform and coupled to the gimbal processor. The communication connection is coupled to the gimbal processor and configured to exchange signals with the drone for controlling flight parameters of the drone.
- Some embodiments may include separate gimbal drivers coupled to the two or more gimbals. Each of the separate gimbal drivers may be controlled by the gimbal processor and may be configured to rotate an individual one of the two or more gimbals. The gimbal processor may coordinate the operations of the drone with a drone processor of the drone. The drone processor may operate as a slave to the gimbal processor operating as a master. At least one camera may be fixed to the inner one of the two or more gimbals and may be coupled to the gimbal processor. The at least one camera may be configured to capture an image of a heading of the device. gimbal
- The at least one inertial measurement unit may be configured to determine an attitude and/or heading of the device relative to surroundings of the drone. The at least one inertial measurement unit may be configured to determine at least one of a position or movement of the components of the drone relative to the device.
- In some embodiments, a camera may be coupled to the inner platform and the gimbal processor. The camera may be configured to capture an image of a heading of the device. A vibration sensor may be included that may be configured to detect vibrations between the inner platform and the drone.
- In some embodiments, the two or more gimbals may pivot concentrically. In addition, the two or more gimbals may include three or more gimbals.
- Further embodiments include methods of manufacturing a device, such as a gimbal universal drone controller, and a drone using such a device. Such embodiments may include coupling two or more gimbals to rotate orthogonally relative to each other, in which an inner gimbal of the two or more gimbals supports an inner platform for receiving components thereon, and in which an outer gimbal of the two or more gimbals pivotally couples to the drone. Such embodiments may further include mounting a gimbal processor on the inner platform, with the gimbal processor configured to control pivotal movement of the two or more gimbals, and fixing an inertial measurement unit (IMU) relative to the inner platform and coupled the IMU to the gimbal processor. Such embodiments may further include coupling a communication connection to the gimbal processor, in which the communication connection is configured to exchange signals with the drone for controlling operations of the drone.
- Methods of manufacturing a drone may then include connecting the a gimbal universal drone controller to the drone so that the gimbal processor can provide control signals to controllable components on the drone. In some embodiments, coupling the device to the drone may include mechanically attaching the device to a structure of the drone, and connecting drone sensor outputs and controllable components to the communication connection.
- In some embodiments, coupling two or more gimbals to rotate orthogonally relative to each other may include coupling separate gimbal drivers to the two or more gimbals and coupling the separate gimbal drivers to the gimbal processor, in which each of the separate gimbal drivers is configured to rotate an individual one of the two or more gimbals.
- Some embodiments may further include fixing at least one camera to the inner one of the two or more gimbals and coupling the at least one camera to the gimbal processor, wherein the at least one camera is configured to capture an image of a heading of the device. In such embodiments, fixing at least one camera to the inner one of the two or more gimbals may include fixing the at least one camera to the inner one of the two or more gimbals so that the at least one camera is oriented to capture an image of a heading of the device.
- Some embodiments may further include attaching a vibration sensor to the device, the vibration sensor configured to detect vibrations between the inner platform and the drone. In some embodiments, coupling two or more gimbals to rotate orthogonally relative to each other may include coupling three or more gimbals to rotate orthogonally relative to each other.
- Further embodiments may include a gimbaled universal drone controller having means for performing functions of the device and/or methods described above. Further embodiments include a non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor to perform operations of the above-discussed methods.
- The accompanying drawings, which are incorporated herein and constitute part of this specification, illustrate exemplary embodiments, and together with the general description given above and the detailed description given below, serve to explain the features of the various embodiments.
-
FIG. 1 is a schematic perspective view of a gimbaled universal drone controller according to various embodiments. -
FIG. 2 is a perspective view of a gimbaled universal drone controller according to various embodiments. -
FIG. 3A is a front perspective view of the gimbaled universal drone controller ofFIG. 2 , with a transparent component housing revealing components therein according to various embodiments. -
FIG. 3B is a rear perspective view of the gimbaled universal drone controller ofFIG. 2 , according to various embodiments. -
FIG. 3C is a top view of the gimbaled universal drone controller ofFIG. 2 , according to various embodiments. -
FIG. 3D is a front view of the gimbaled universal drone controller ofFIG. 2 , according to various embodiments. -
FIG. 3E is a left side view of the gimbaled universal drone controller ofFIG. 2 , according to various embodiments. -
FIG. 3F is a right side view of the gimbaled universal drone controller ofFIG. 2 , according to various embodiments. -
FIG. 3G is a bottom view of the gimbaled universal drone controller ofFIG. 2 , according to various embodiments. -
FIG. 3H is a rear elevation view of the gimbaled universal drone controller ofFIG. 2 , according to various embodiments. -
FIG. 4 is a perspective view of a gimbaled universal drone controller with external sensors according to various embodiments. -
FIG. 5 is a component diagram of a gimbaled universal drone controller according to various embodiments. -
FIG. 6 is a perspective view of a drone with a schematic relief diagram of a gimbaled universal drone controller, a drone control unit, and a mobile computing device according to various embodiments. -
FIG. 7A is a perspective view of a drone with a gimbaled universal drone controller according to various embodiments. -
FIG. 7B is a perspective view of a drone with two gimbaled universal drone controllers according to various embodiments. -
FIG. 8 is a process flow diagram illustrating a method of assembling a gimbal universal drone controller according to various embodiments. - Various embodiments will be described in detail with reference to the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. References made to particular examples and implementations are for illustrative purposes, and are not intended to limit the scope of the claims.
- Various embodiments include a gimbaled universal drone controller for use on a drone (e.g., an aerial drone or other type of unmanned vehicle) that includes two or more gimbals controlled by a gimbal processor fixed within an innermost one of the two or more gimbal. The gimbal processor may determine an absolute position of the gimbaled universal drone controller using an inertial measurement unit (IMU) coupled to the gimbal processor. In addition, the gimbal processor may determine a relative position of the drone for controlling attitude, movement, and stability control of the drone.
- A gimbaled universal drone controller according to various embodiments may reduce the amount of control wiring needed for a drone and shorten the control wiring used, and thus may lighten the drone and enhance the speed of communications between a gimbal processor and various components of the drone. In addition, the drone may benefit from enhanced heating and cooling, better control of condensation, better prevention of fogging of the lenses, and better shielding that may be used with communication systems (e.g., Wi-Fi, GPS, etc.). The reduction in the number and/or size of wiring holes or leads needed for coupling the gimbal processor to other components of a drone may provide these and other benefits.
- Various embodiments may be implemented in aerial drones or drones to overcome shortcomings in the gimbals. Conventional flight controllers that are remote from gimbals generally experience different dampening and/or vibration effects than gimbals. Consequently conventional flight controllers will occasionally move relative to the gimbals, leads to inaccuracies in positioning and/or orientation controls. In contrast to such conventional components, the various embodiments include a gimbaled universal drone controller located within the gimbal assembly. Such a configuration may provide tighter calibration between the gimbal assembly and the drone controller. In addition, sensors (e.g., optic flow, 4K, and depth-from-stereo sensors) remain motionless relative to the gimbal, enabling movement to new vectors as needed without having to adjust for relative motion of drone motion sensors (e.g., accelerometers and gyroscopes) and gimbal sensors.
- Various embodiments of a universal gimbaled drone controller may be implemented in any of a variety of unmanned autonomous and semi-autonomous vehicles, including aerial drones, land-based unmanned vehicles, space vehicles, and waterborne unmanned vehicles. Configurations and advantages of the various embodiments may apply equally to autonomous and semi-autonomous vehicles operating in any of these environments. For ease of description, various embodiments will be referred to generally herein as drones and described for illustrative purposes with reference to aerial drones. However, the use of aerial drones as an example implementation or application of various embodiments are not intended to limit the scope of the claims to aerial vehicle applications unless an aerial drone or aerial drone application is specifically recited in a claim.
- By integrating a gimbal assembly with a drone controller into a single package, control algorithms for holding the gimbal fixed on a target may be simplified as gimbal movement and flight attitude controls can be processed in an integrated manner. For example, the gimbaled universal drone controller in accordance with various embodiments may trade off vehicle movements for gimbal movements and vice versa to maintain a required gimbal attitude.
- As used herein, the term “gimbal” refers to a pivoted support that allows the rotation of an object about a single axis. A set of two or more gimbals (typically three), one mounted on the other with orthogonal pivot axes, may be used to allow an object mounted on the innermost gimbal to remain independent of the rotation of a support to which the outermost gimbal is fixed. The term “gimbal” refers to a component mounted on a gimbal and supported by one or more gimbals. For example, the term “gimbal processor” is used herein to refer particularly to one or more processors supported by two or more gimbals.
- As used herein, the term “drone” refers to one of various types of autonomous vehicles (e.g., autonomous aircraft, land vehicles, waterborne vehicles, or a combination thereof) that may operate without onboard human pilots/drivers. A drone may include an onboard computing device configured to fly and/or operate the drone without remote operating instructions (i.e., autonomously), such as from a human operator or remote computing device. Alternatively, the computing device onboard the drone may be configured to receive operating instructions and/or updates to instructions from a gimbaled universal drone controller in accordance with various embodiments.
- The drone may be propelled for flight and/or other movement in any of a number of known ways. For example, a plurality of propulsion units, each including one or more rotors, may provide propulsion or lifting forces for the drone and any payload carried by the drone. In addition, the drone may include wheels, tank-treads, or other non-aerial movement mechanisms to enable movement on the ground, over water, under water, or a combination thereof. Further, the drone may be powered by one or more types of power source, such as electrical, chemical, electro-chemical, or other power reserve, which may power the propulsion units, the onboard computing device, and/or other onboard components.
- As used herein, the term “controller” refers generally to a computing device configured to direct and/or regulate operations of electronic components coupled thereto. As used herein, the term “gimbaled universal drone controller” refers to a device that includes a gimbaled controller configured to be a primary or exclusive controller of a drone.
- As used herein, the terms “inertial measurement unit” and “IMU” refer interchangeably to an electronic device that measures and reports a body's accelerations in three dimensions, angular rates in three axes of rotation, and sometimes the magnetic field surrounding the body. An IMU may include sensors selected from a group including cameras, accelerometers, magnetometers, and other position sensors.
-
FIG. 1 illustrates a schematic representation of a gimbaleduniversal drone controller 100 for use on a drone (e.g., 600 inFIGS. 6, 7A, and 7B ) and configured to control operations of the drone according to various embodiments. The gimbaleduniversal drone controller 100 may include two or more gimbals pivotally coupled to rotate orthogonally relative to each other. In some embodiments, the gimbaleduniversal drone controller 100 may include threegimbals - The three
gimbals gimbal arms 131, 132 (i.e., yokes) that extend between and pivotally couple the threegimbals outer gimbal 111 may be pivotally coupled to the drone. Aninner gimbal 113 supports aninner platform 110 for receiving components thereon. For example, the inner platform may support acontrol unit 150 that may include various circuits and devices used to control the operation of the drone (e.g., a gimbal processor and an inertial measurement unit), as well as other components of the gimbaled universal drone controller 100 (e.g., internal motors that drive thegimbals inner platform 110 and any components thereon will remain fixed relative to theinner gimbal 113. Theinner platform 110 may be a distinct element or a part of and/or integrally formed with acomponent housing 140. In addition, the gimbaleduniversal drone controller 100 may include one or morewired connections 190 coupling thecontrol unit 150 to a flight controller of the drone. The one or morewired connections 190 may be configured to exchange signals with the drone for actively controlling stabilization thereof. Thus, thecontrol unit 150 may use thewired connection 190 to transmit commands and/or data to the drone, as well as receive inputs from the drone. Additionally, the one or morewired connections 190 may supply power to the gimbaleduniversal drone controller 100 from the drone or other external source. - While the
component housing 140 is illustrated as a three-dimensional block, numerous other shapes or configurations may be used to support the components of the gimbaleduniversal drone controller 100 in accordance with various embodiments. Thecomponent housing 140 may have one ormore wiring ports 115 for passing wires and connections (e.g., the wired connection 190) between an inner part of thecomponent housing 140 and an outer part thereof. Alternatively, thewired connection 190 may include a slip ring concentric with a rotational axis of one of the gimbals. The slip ring may be configured to pass electrical signals to and from the inner part of thecomponent housing 140. Alternatively or additionally, a wireless transceiver may be included for thecontrol unit 150 to communicate wirelessly with the drone. - While the
gimbal arms gimbals gimbal arms gimbal arms - The gimbaled
universal drone controller 100 is illustrated inFIG. 1 using a three-dimensional Cartesian space having an x-axis, a y-axis, and a z-axis (indicated as “x,” “y,” and “z” respectively on opposed ends of each axis), which may be used as a frame of reference for determining attitude, heading, and stability of the gimbaleduniversal drone controller 100, the drone, or a combination thereof. - A wide range of vehicles and applications may make use of the gimbaled
universal drone controller 100 according to various embodiments. Some non-limiting examples of vehicles and applications that may utilize the gimbaled universal drone controller include machinery, aeronautical vehicles, aerospace vehicles, motor vehicles, waterborne vehicles, medical devices, robots, toys, appliances, electronics, and any apparatus that might benefit from motion stability and control. - In various embodiments, the gimbaled
universal drone controller 100 may be a spherical or substantially spherical component, as illustrated inFIG. 2 . With reference toFIGS. 1-2 , the gimbaleduniversal drone controller 100 includes threegimbals gimbals gimbal arms gimbals outer gimbal 111 may be pivotally coupled to the drone and theinner gimbal 113 may support theinner platform 110 for receiving components thereon. Theinner platform 110 may support thecontrol unit 150, as well assupport structures 142 fixing thecomponent housing 140 relative to theinner platform 110. Theinner platform 110 may support thecontrol unit 150, including a gimbal processor (e.g., 520 inFIG. 5 ) and an IMU (e.g., 525 inFIG. 5 ), which may be configured to control pivotal movement of the two ormore gimbals wiring port 115 may provide access for wires and/or cables, such as thewired connection 190, which may provide a communication connection between thegimbal processor 520 and the drone. Thewired connection 190 may thus be used to exchange signals with the drone for actively controlling stabilization thereof. - The gimbaled
universal drone controller 100 may includeseparate drivers gimbals drivers control unit 150 may control a current or other mechanism used to selectively actuate one or more of thedrivers - The
drivers vibration dampening elements 141 to reduce vibrations being conveyed from one gimbal to another. Similarly, mounts between thecontrol unit 150 and theinner platform 110 may include dampeners to reduce vibrations there between. - An encoder may be included with each of the
drivers gimbals gimbals control unit 150 for providing absolute position information for each of the threegimbals inner platform 110 and thecontrol unit 150 mounted thereon. -
FIGS. 3A-3H illustrate the gimbaleduniversal drone controller 100 ofFIG. 2 , but with thecomponent housing 140 being transparent, and thus revealing internal components according to various embodiments. With reference toFIGS. 1-3H , the gimbaleduniversal drone controller 100 may include various components such as the two ormore gimbals inner gimbal 113 supports theinner platform 110 for receiving components thereon. -
FIGS. 3A and 3B particularly illustrate front and rear perspective views, respectively, of the gimbaleduniversal drone controller 100. With reference toFIGS. 1-3B , theinner platform 110 may be partially disposed within thecomponent housing 140 and partially disposed outside thecomponent housing 140. -
FIGS. 3C-3H illustrate, top, front, left side, right side, bottom, and rear views of the gimbaleduniversal drone controller 100 ofFIGS. 3A and 3B , according to various embodiments. - In various embodiments, the gimbal
universal drone controller 100 may include peripheral components, as illustrated inFIG. 4 . With reference toFIGS. 1-4 , the gimbaleduniversal drone controller 100 may include asensor housing 160, which may protect peripheral components like camera(s) 541, sensor(s) 542, and/or the like. -
FIG. 5 is a component block diagram of a gimbaleduniversal drone controller 100 according to various embodiments. With reference toFIGS. 1-5 , the gimbaleduniversal drone controller 100 may include theinner platform 110 that supports various circuits and devices used to power and/or control the operation of the gimbaleduniversal drone controller 100, as well as a drone coupled thereto. In addition, theinner platform 110 may support thecomponent housing 140 that may house many of the circuits and devices of the gimbaleduniversal drone controller 100. For example, thecomponent housing 140 may house thecontrol unit 150, apower module 535, aninput module 540, anoutput module 545, and threegimbal modules control unit 150 may include agimbal processor 520 coupled tomemory 521, anavigation unit 523, anIMU 525, and anavionics module 527 all viacommunication bus 529. Thegimbal processor 520 may be configured with processor-executable instructions to control pivotal movement of the gimbals, as well as control flight and other operations of a drone, including operations of the various embodiments. - The gimbaled
universal drone controller 100 may have stored in thememory 521 different flight control rules customized for different types of drones. For example, flight control rules for a quad-coptor, sect copter, a plane, or any of a variety of drones may be accesses by the gimbal processor to accommodate and properly control any drone. - The
control unit 150, and particularly thegimbal processor 520, may be coupled to the one ormore cameras 541, one or more (other)sensors 542, and/or the like. Thecameras 541 may include one or more image capturing devices. More than one image-capturing device may be configured to contemporaneously capture two different images for providing stereoscopic visualization. The one or moreother sensors 542 may be position sensors, such as pressure sensors (i.e., for detecting wind, lift, drag, or changes therein), a motion sensor, or other sensors. The one or moreother sensors 542 may be analog sensors or absolute position encoders that are configured to determine a relative position of the gimbaluniversal drone controller 100, as well as the drone coupled thereto, relative to the real world and/or the drone, including components thereof. - The gimbaled
universal drone controller 100 may receive inputs including power (i.e., battery power from the drone, e.g., 600 inFIGS. 6-7B ), signals from external components (e.g., GPS, magnetometer, camera, and/or IMU), which may work in conjunction with similar internal components. The power input may be used to drive motors that move the gimbals (e.g., brushless motor and/or electronic motor controllers) and one or more processors and sensors fixed relative to the inner platform (e.g., 110). - The gimbaled
universal drone controller 100 may output motor output commands that control movement and stability of the drone, such as to an electronic speed control (ESC). The output may include data signals communicated to a transceiver in conjunction with an antenna to remote components, such as sensors and data gathering sources. The output connection may include wired connections, such as one or more serial connections, controller area network (CAN) connections, and/or fixed-pin connections. - The
power module 535 may include one or more batteries that may provide power to various components, including thegimbal processor 520, the threegimbal modules input module 540, the one ormore cameras 541, the sensor(s) 542, theinput module 540, theoutput module 545, and aradio module 550. In addition, thepower module 535 may include energy storage components, such as rechargeable batteries. Thegimbal processor 520 may be configured with processor-executable instructions to control the charging of thepower module 535, such as by executing a charging control algorithm using a charge control circuit. Alternatively or additionally, thepower module 535 may be configured to manage its own charging. Thegimbal processor 520 may be coupled to anoutput module 545, which may output control signals for managing operations of the drone or components thereof. - Through control of individual ones of the three-
gimbal modules gimbal processor 520 may control pivotal movement of each of the gimbals. Thegimbal processor 520 may receive data from thenavigation unit 523 and/or theIMU 525 and use such data in order to determine the present position and orientation of the gimbaleduniversal drone controller 100 or components thereof. In various embodiments, thenavigation unit 523 may include a global navigation satellite system (GNSS) receiver system (e.g., one or more Global Positioning System (GPS) receivers) enabling the gimbaleduniversal drone controller 100 to navigate using GNSS signals. Alternatively or in addition, thenavigation unit 523 may be equipped with radio navigation receivers for receiving navigation beacons or other signals from radio nodes, such as navigation beacons (e.g., very high frequency (VHF) Omni Directional Radio Range (VOR) beacons), Wi-Fi access points, cellular network sites, radio station, remote computing devices, other drones, etc. - The
gimbal processor 520 may be configured to communicate with a remote computing device through a wireless connection (e.g., a cellular data network) to receive commands to use or stop using protocols, receive data useful in navigation, provide real-time position altitude reports, and assess data. Theavionics module 527 coupled to thegimbal processor 520, thenavigation unit 523, and/or theIMU 525 may be configured to provide flight control-related information such as altitude, attitude, airspeed, heading and similar information that thenavigation unit 523 may use for navigation purposes, such as dead reckoning between GNSS position updates. Theavionics module 527 may include or receive data from theIMU 525 that provides data regarding the orientation and accelerations of the gimbaleduniversal drone controller 100, the drone, or both, which may be used in navigation and positioning calculations, as well as some of the embodiments. - Alternatively, the
radio module 550 may be included, which may be configured to receivewireless signals 14 via anantenna 551. Received wireless signals may include, for example, command signals to perform various flight maneuvers, signals from aviation navigation facilities, etc. Theradio module 550 may provide such signals to thegimbal processor 520, thenavigation unit 523, and/or theIMU 525 to assist in operation of the gimbaleduniversal drone controller 100 and/or the drone. In some embodiments, commands for navigating the gimbaleduniversal drone controller 100 and/or the drone, or components thereof may be received via theradio module 550. In some embodiments, the gimbaleduniversal drone controller 100 may receive signals from theremote computing device 12 via uplink signals sent from anantenna 7 via the wireless signals 14. - In various embodiments, the gimbaled
universal drone controller 100 may output commands and/or data signals through the wireless signals 14. The wireless signals 14 may alternatively be used as a backup mechanism for communicating, in case a wired connection is not functioning properly. As a further alternative, the gimbaleduniversal drone controller 100 that includes theradio module 550 may also include an internal source, such as batteries on theinner platform 110. Such a gimbaleduniversal drone controller 100 that is wireless and self-powered may be easily connected to adrone 600 without the need for numerous wired connections. - In some embodiments, the
radio module 550 may be configured to switch between a cellular connection and a Wi-Fi or other form of radio connection depending on the location and altitude of the gimbaleduniversal drone controller 100. For example, while in flight or otherwise moving, theradio module 550 may communicate with a cellular infrastructure in order to maintain communications with a remote server. In addition, communications with theremote computing device 12 may be established using cellular telephone networks while the gimbaleduniversal drone controller 100 and/or drone is out of line-of-sight of theremote computing device 12. Communication between theradio module 550 and the operator communication link may transition to a short-range communication link, such as the wireless signals 14 (e.g., Wi-Fi), when the gimbaleduniversal drone controller 100 moves closer to theremote computing device 12. Similarly, the gimbaleduniversal drone controller 100 may include and employ other forms of radio communication, such as mesh connections with other gimbaled universal drone controllers or connections to other information sources (e.g., balloons or other stations for collecting and/or distributing weather or other data harvesting information). - In various embodiments, the
control unit 150 may be equipped with theinput module 540, which may be used for a variety of applications. For example, theinput module 540 may receive and pre-process images or data from an onboard component, such ascamera 541 or sensor(s) 542, or may receive electronic signals from other components (e.g., a payload). Theinput module 540 may receive an activation signal for causing actuators on the gimbaleduniversal drone controller 100 and/or the drone to deploy landing cushions or similar components for affecting an emergency landing. In addition, theoutput module 545 may be used to activate components (e.g., an energy cell, an actuator, an indicator, a circuit element, a sensor, and/or an energy-harvesting element). - While the various components of the gimbaled
universal drone controller 100 are illustrated as separate components, some or all of the components (e.g., thegimbal processor 520, theoutput module 545, theradio module 550, and other units) may be integrated together in a single device or module, such as a system-on-chip (SoC). - For ease of description and illustration, some detailed aspects of the gimbaled
universal drone controller 100 are omitted, such as wiring, frame structure, power source, or other features that would be known to one of skill in the art. In addition, although the example gimbaled universal drone controllers are illustrated as spherical devices, the gimbaleduniversal drone controller 100 may have similar or different configurations and/or other aspects. -
FIG. 6 illustrates a configuration of adrone 600 that may be used in conjunction with various embodiments. With reference toFIGS. 1-6 , thedrone 600 may include the gimbaleduniversal drone controller 100 coupled thereto. The gimbaleduniversal drone controller 100 is illustrated as being disposed on a lower side of thedrone 600. However, in accordance with various embodiments the gimbaleduniversal drone controller 100 may be secured almost anywhere on thedrone 600. - The
drone 600 may include acontrol unit 610 of its own that may house various circuits and devices used to power and control the operation of thedrone 600, such as when directed by or not controlled by the gimbaleduniversal drone controller 100. Thecontrol unit 610 may include aprocessor 620, apower module 630, aninput module 640, anadditional camera 641, sensor(s) 642, anoutput module 645, and aradio module 650 coupled to anantenna 651. Theprocessor 620 may include or be coupled tomemory 621 and anavigation unit 623. Theprocessor 620 may be configured with processor-executable instructions to control flight and other operations of thedrone 600, including operations of the various embodiments. - The
power module 630 may include one or more batteries that may provide power to various components, including theprocessor 620, theinput module 640, the sensor(s) 642, theoutput module 645, and theradio module 650. The one or more batteries may supply power to the gimbaleduniversal drone controller 100 through the wired connection (e.g., 190). In addition, thepower module 630 may include energy storage components, such as rechargeable batteries. Theprocessor 620 may be configured with processor-executable instructions to control the charging of thepower module 630, such as by executing a charging control algorithm using a charge control circuit. Alternatively or additionally, thepower module 630 may be configured to manage its own charging. Theprocessor 620 may be coupled to anoutput module 645, which may output control signals for managing the motors that drive therotors 615 and other components. Theprocessor 620 may act as a slave processor to the gimbal processor (e.g., 520 in the control unit 150) operating as a master. In this way, the gimbal processor may coordinate the operations of thedrone 600. - Through control of the individual motors of the
rotors 615, thedrone 600 may be controlled in flight. Theprocessor 620 may receive data and/or instructions from the gimbaleduniversal drone controller 100 and use such data in order to change a present position, speed, and/or orientation of thedrone 600, as well as an appropriate course or attitude change. In various embodiments, thenavigation unit 623 may include a global navigation satellite system (GNSS) receiver system (e.g., one or more Global Positioning System (GPS) receivers) enabling thedrone 600 to navigate using GNSS signals. Alternatively or in addition, thenavigation unit 623 may be equipped with radio navigation receivers for receiving navigation beacons or other signals from radio nodes, such as navigation beacons (e.g., very high frequency (VHF) Omni Directional Radio Range (VOR) beacons), Wi-Fi access points, cellular network sites, radio station, remote computing devices, other drones, etc. - The
processor 620 and/or thenavigation unit 623 may be configured to communicate with a server through a wireless connection (e.g., a cellular data network) to receive commands to use or stop using the extended flight protocol, receive data useful in navigation, provide real-time position altitude reports, and assess data. Anavionics module 627 coupled to theprocessor 620 and/or thenavigation unit 623 may be configured to provide flight control-related information such as altitude, attitude, airspeed, heading and similar information that thenavigation unit 623 may use for navigation purposes, such as dead reckoning between GNSS position updates. Theavionics module 627 may include or receive data from a gyro/accelerometer unit 625 that provides data regarding the orientation and accelerations of thedrone 600 that may be used in navigation and positioning calculations, as well as some of the embodiments. - The gimbaled
universal drone controller 100 may be configured to communicate with a server or other remote computing device through a wireless connection provided by the drone 600 (e.g., a cellular data network) to receive data useful in navigation, provide real-time position altitude reports, and assess data. For example, theradio module 650 may be configured to receive signals via theantenna 651, such as command signals to perform various flight maneuvers, receive signals from aviation navigation facilities, etc., and provide such signals to theprocessor 620 and/or the gimbaleduniversal drone controller 100 to assist in operation of thedrone 600. In some embodiments, commands for navigating thedrone 600, or components thereof may be received via theradio module 650 and communicated to the gimbaleduniversal drone controller 100. In some embodiments, thedrone 600 may receive signals from theremote computing device 12 via uplink signals sent from anantenna 7 via the wireless signals 14. - In various embodiments, the
control unit 610 may be equipped with theinput module 640, which may be used for a variety of applications. For example, theinput module 640 may receive and pre-process images or data from the gimbaleduniversal drone controller 100, or may receive electronic signals from other components. Theinput module 640 may receive an activation signal for causing actuators on thedrone 600 to deploy landing cushions or similar components for affecting an emergency landing. In contrast, theoutput module 645 may be used to communicate data to the gimbaleduniversal drone controller 100. In addition, theoutput module 645 may be used to activate components (e.g., an energy cell, an actuator, an indicator, a circuit element, a sensor, and/or an energy-harvesting element). - The gimbaled
universal drone controller 100 may include one or more calibration procedures. The processor may calibrate measurements of the IMU's and sensors at various stages of drone operation. For example, a preliminary calibration protocol may run when the drone starts up, but is stationary on the ground. An intermediate calibration protocol may run when the drone starts moving and/or when propulsion units start up. A moving calibration protocol may run once the drone is moving so the processor may assess reactions to actions executed by the processor for learning desired effects. - For ease of description and illustration, some detailed aspects of the
drone 600 are omitted, such as wiring, frame structure, power source, landing columns/gear, or other features that would be known to one of skill in the art. In addition, although the example drones are illustrated as quad copters with four rotors, the drones may include more or fewer than four rotors or be a completely different type of unmanned autonomous vehicle. - For ease of description and illustration, some detailed aspects of the gimbaled
universal drone controller 100 are omitted, such as wiring, frame structure, interconnects, or other features that would be known to one of skill in the art. For example, while the gimbaleduniversal drone controller 100 is shown and described as having acomponent housing 140 and a separateinner platform 110, the gimbaleduniversal drone controller 100 may be constructed using a molded frame in which such support and/or housing structures are obtained through the molded structure. -
FIG. 7A illustrates a drone (e.g., 600) including a gimbaleduniversal drone controller 100 in accordance with various embodiments. With reference toFIGS. 1-7A , thedrone 600 may use various components, such as the gimbaleduniversal drone controller 100, to manage operation of therotors 615 and other components of thedrone 600. -
FIG. 7B illustrates thedrone 600 with two gimbaleduniversal drone controllers 100 in accordance with some embodiments. With reference toFIGS. 1-7B , thedrone 600 may use the two gimbaleduniversal drone controllers 100 to provide stereoscopic sensing for more accurate attitude, movement, and stability control. The plurality of gimbaleduniversal drone controllers 100 may cooperate, working together redundantly and/or using a master/slave relationship. By including one or more cameras on each of the gimbaleduniversal drone controllers 100, adrone 600 is provided with a system that can obtain visual images correlated to absolute relative positions. Using the two gimbaleduniversal drone controllers 100 may provide more accurate navigational and stabilization control. The two gimbaleduniversal drone controllers 100 may also provide redundancies for thedrone 600 in case one of the gimbaleduniversal drone controllers 100 is malfunctioning or otherwise not operating effectively. - Although flight gimbals are often located on the bottom of a drone, various embodiments may locate at least one gimbaled
universal drone controller 100 on an upper or other surface of thedrone 600. - In some embodiments, more than one gimbaled
universal drone controller 100 may be used together on a single drone. A plurality of gimbaleduniversal drone controllers 100 may capture stereoscopic imagery. - Although the gimbaled universal drone controller(s) 100 illustrated in
FIGS. 7A and 7B are used on aerial drones, the embodiments are not limited to aerial vehicles or vehicles of any type and may be implemented in or on any frame. Various embodiments are described with reference to a drone, particularly an aerial drone, for ease of reference. However, the description of the gimbaluniversal drone controller 100 used with a drone is not intended to limit the scope of the claims to aerial drones. -
FIG. 8 illustrates amethod 800 of manufacturing a gimbaled universal drone controller and a drone using such a controller according to some embodiments. Inblock 802, two or more gimbals may be coupled together so that the gimbals rotate orthogonally relative to each other. The two or more gimbals may be assemble so that an inner gimbal of the two or more gimbals supports an inner platform configured for receiving components thereon, and so an outer gimbal of the two or more gimbals pivotally can be coupled to a drone. - In
block 804, a gimbal processor and an inertial measurement unit (IMU) may be mounted on the inner platform. The gimbal processor may be configured to control pivotal movement of the two or more gimbals. The gimbal processor may be coupled to the IMU to receive data signals. - In
block 806, a communication connection may be coupled to the gimbal processor. The communication connection may be configured to exchange signals with the drone to enable the gimbal processor to receive information from drone sensors and send commands to controllable components on the drone for controlling operations of the drone. At this point, the gimbaled universal drone controller may be attached to any form of autonomous or semi-autonomous vehicle or drone. - In
block 808, the gimbaled universal drone controller may be connected to the drone so that the gimbal processor can provide control signals to controllable components on the drone. This operation may include mechanically attaching the gimbaled universal drone controller to a structure of the drone and connecting drone sensor outputs and controllable components to the communication connection. - The various embodiments illustrated and described are provided merely as examples to illustrate various features of the claims. However, features shown and described with respect to any given embodiment are not necessarily limited to the associated embodiment and may be used or combined with other embodiments that are shown and/or described. Further, the claims are not intended to be limited by any one example embodiment.
- The foregoing method descriptions and the process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various embodiments must be performed in the order presented. As will be appreciated by one of skill in the art the order of operations in the foregoing embodiments may be performed in any order. Any reference to claim elements in the singular, for example, using the articles “a,” “an” or “the” is not to be construed as limiting the element to the singular.
- The various illustrative logical blocks, modules, circuits, and algorithm operations described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and operations have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the claims.
- The hardware used to implement the various illustrative logics, logical blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed with a processor. As used herein, the term “processor” refers to a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of receiver smart objects, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some operations or methods may be performed by circuitry that is specific to a given function.
- In one or more exemplary aspects, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored as one or more instructions or code on a non-transitory computer-readable storage medium or non-transitory processor-readable storage medium. The operations of a method or algorithm disclosed herein may be embodied in a processor-executable software module or processor-executable instructions, which may reside on a non-transitory computer-readable or processor-readable storage medium. Non-transitory computer-readable or processor-readable storage media may be any storage media that may be accessed by a computer or a processor. By way of example but not limitation, such non-transitory computer-readable or processor-readable storage media may include RAM, ROM, EEPROM, FLASH memory, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage smart objects, or any other medium that may be used to store desired program code in the form of instructions or data structures and that may be accessed by a computer. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and Blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above are also included within the scope of non-transitory computer-readable and processor-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a non-transitory processor-readable storage medium and/or computer-readable storage medium, which may be incorporated into a computer program product.
- The preceding description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the claims. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the claims. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed herein.
Claims (23)
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/219,116 US10281930B2 (en) | 2016-07-25 | 2016-07-25 | Gimbaled universal drone controller |
CN201780045660.3A CN109476377B (en) | 2016-07-25 | 2017-05-22 | Universal general unmanned machine controller |
PCT/US2017/033787 WO2018022176A1 (en) | 2016-07-25 | 2017-05-22 | Gimbaled universal drone controller |
EP17726822.4A EP3487759A1 (en) | 2016-07-25 | 2017-05-22 | Gimbaled universal drone controller |
TW106117315A TW201803635A (en) | 2016-07-25 | 2017-05-25 | Gimbaled universal drone controller |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/219,116 US10281930B2 (en) | 2016-07-25 | 2016-07-25 | Gimbaled universal drone controller |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180024570A1 true US20180024570A1 (en) | 2018-01-25 |
US10281930B2 US10281930B2 (en) | 2019-05-07 |
Family
ID=58800973
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/219,116 Expired - Fee Related US10281930B2 (en) | 2016-07-25 | 2016-07-25 | Gimbaled universal drone controller |
Country Status (5)
Country | Link |
---|---|
US (1) | US10281930B2 (en) |
EP (1) | EP3487759A1 (en) |
CN (1) | CN109476377B (en) |
TW (1) | TW201803635A (en) |
WO (1) | WO2018022176A1 (en) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180067493A1 (en) * | 2016-09-02 | 2018-03-08 | Skyefish, Llc | Intelligent gimbal assembly and method for unmanned vehicle |
US10209713B1 (en) * | 2016-12-16 | 2019-02-19 | Amazon Technologies, Inc. | Determining and using relative motion of sensor modules |
US20190066524A1 (en) * | 2017-08-10 | 2019-02-28 | Hangzhou Zero Zero Technology Co., Ltd. | System and method for obstacle avoidance in aerial systems |
CN110143288A (en) * | 2019-04-29 | 2019-08-20 | 一飞智控(天津)科技有限公司 | IMU shock absorber |
US10576968B2 (en) * | 2014-08-27 | 2020-03-03 | Renesas Electronics Corporation | Control system, relay device and control method |
CN111123972A (en) * | 2019-12-04 | 2020-05-08 | 北京航天时代激光导航技术有限责任公司 | Course angle tracking-based inertial measurement combined rotation modulation method |
WO2020097228A2 (en) | 2018-11-06 | 2020-05-14 | Droneseed Co. | Predation-resistant capsular planting systems and methods |
CN112319387A (en) * | 2020-11-19 | 2021-02-05 | 吉林农业大学 | Stay wire control type following stable platform |
US20220247898A1 (en) * | 2019-10-24 | 2022-08-04 | Autel Robotics Co., Ltd. | Replaceable gimbal camera, aircraft, aircraft system, and gimbal replacement method for aircraft |
US20220264007A1 (en) * | 2016-09-02 | 2022-08-18 | Skyyfish Llc | Intelligent gimbal assembly and method for unmanned vehicle |
US20220411103A1 (en) * | 2018-04-26 | 2022-12-29 | Skydio, Inc. | Autonomous Aerial Vehicle Hardware Configuration |
US20230348104A1 (en) * | 2022-04-27 | 2023-11-02 | Skydio, Inc. | Base Stations For Unmanned Aerial Vehicles (UAVs) |
US12265385B2 (en) | 2018-11-06 | 2025-04-01 | Battelle Energy Alliance, Llc | Systems, devices, and methods for millimeter wave communication for unmanned aerial vehicles |
US12275318B2 (en) | 2023-12-12 | 2025-04-15 | Skydio, Inc. | Base stations for unmanned aerial vehicles (UAVs) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USD1010004S1 (en) | 2019-11-04 | 2024-01-02 | Amax Group Usa, Llc | Flying toy |
CN110941282A (en) * | 2019-11-15 | 2020-03-31 | 西北工业大学 | A control method, system, device and readable storage medium for drone landing |
CN111060138B (en) * | 2019-12-31 | 2022-01-28 | 上海商汤智能科技有限公司 | Calibration method and device, processor, electronic equipment and storage medium |
US11549637B2 (en) | 2020-05-11 | 2023-01-10 | Honeywell International Inc. | Multi-rotation gimbal assembly and mobile platform incorporating the same |
US12121826B2 (en) | 2020-05-28 | 2024-10-22 | Amax Group Usa, Llc | Hand gesture controlled flying toy |
USD1059492S1 (en) | 2020-05-28 | 2025-01-28 | Amax Group Usa, Llc | Flying toy |
USD1001009S1 (en) | 2021-06-09 | 2023-10-10 | Amax Group Usa, Llc | Quadcopter |
USD1003214S1 (en) | 2021-06-09 | 2023-10-31 | Amax Group Usa, Llc | Quadcopter |
USD1051990S1 (en) | 2022-06-24 | 2024-11-19 | Amax Group Usa, Llc | Remote control |
USD1035787S1 (en) | 2022-06-24 | 2024-07-16 | Amax Group Usa, Llc | Flying toy |
EP4397515A1 (en) * | 2023-01-09 | 2024-07-10 | Volvo Construction Equipment AB | A power generating arrangement |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070194170A1 (en) * | 2006-02-17 | 2007-08-23 | Flir Systems, Inc. | Gimbal system with airflow |
US20160014309A1 (en) * | 2014-07-08 | 2016-01-14 | Flir Systems, Inc. | Gimbal system with imbalance compensation |
US20160159463A1 (en) * | 2013-07-31 | 2016-06-09 | SZ DJI Technology Co., Ltd | Remote control method and terminal |
US20160171330A1 (en) * | 2014-12-15 | 2016-06-16 | Reflex Robotics, Inc. | Vision based real-time object tracking system for robotic gimbal control |
WO2016111595A1 (en) * | 2015-01-09 | 2016-07-14 | 주식회사 대한항공 | Method for guiding and controlling drone using information for controlling camera of drone |
US20160356574A1 (en) * | 2013-12-06 | 2016-12-08 | Bae Systems Plc | Payload delivery |
US20170144758A1 (en) * | 2014-02-28 | 2017-05-25 | Lucas J. Myslinski | Drone device security system |
US20170158338A1 (en) * | 2015-10-14 | 2017-06-08 | Flirtey Holdings, Inc. | Parachute control system for an unmanned aerial vehicle |
US20170163896A1 (en) * | 2015-12-03 | 2017-06-08 | Samsung Electronics Co., Ltd. | Camera gimbal |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7343232B2 (en) | 2003-06-20 | 2008-03-11 | Geneva Aerospace | Vehicle control system including related methods and components |
US20100228406A1 (en) | 2009-03-03 | 2010-09-09 | Honeywell International Inc. | UAV Flight Control Method And System |
US8874283B1 (en) | 2012-12-04 | 2014-10-28 | United Dynamics Advanced Technologies Corporation | Drone for inspection of enclosed space and method thereof |
US9070289B2 (en) | 2013-05-10 | 2015-06-30 | Palo Alto Research Incorporated | System and method for detecting, tracking and estimating the speed of vehicles from a mobile platform |
EP2813428B1 (en) | 2013-06-11 | 2017-04-19 | Ecole Polytechnique Fédérale de Lausanne (EPFL) | A vertical take-off and landing aerial vehicle |
JP5882951B2 (en) | 2013-06-14 | 2016-03-09 | 株式会社トプコン | Aircraft guidance system and aircraft guidance method |
US20170175948A1 (en) | 2014-03-28 | 2017-06-22 | Flir Systems, Inc. | Gimbal system having preloaded isolation |
CN103935531B (en) * | 2014-04-15 | 2016-01-20 | 北京控制工程研究所 | A kind of two-dimensional vector regulating mechanism |
US10057509B2 (en) * | 2014-05-30 | 2018-08-21 | Flir Systems, Inc. | Multiple-sensor imaging system |
US9599992B2 (en) | 2014-06-23 | 2017-03-21 | Nixie Labs, Inc. | Launch-controlled unmanned aerial vehicles, and associated systems and methods |
US10168700B2 (en) * | 2016-02-11 | 2019-01-01 | International Business Machines Corporation | Control of an aerial drone using recognized gestures |
JP2017146181A (en) * | 2016-02-17 | 2017-08-24 | セイコーエプソン株式会社 | SENSOR ELEMENT, SENSOR ELEMENT MANUFACTURING METHOD, SENSOR, ELECTRONIC DEVICE, AND MOBILE BODY |
-
2016
- 2016-07-25 US US15/219,116 patent/US10281930B2/en not_active Expired - Fee Related
-
2017
- 2017-05-22 EP EP17726822.4A patent/EP3487759A1/en not_active Withdrawn
- 2017-05-22 WO PCT/US2017/033787 patent/WO2018022176A1/en unknown
- 2017-05-22 CN CN201780045660.3A patent/CN109476377B/en not_active Expired - Fee Related
- 2017-05-25 TW TW106117315A patent/TW201803635A/en unknown
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070194170A1 (en) * | 2006-02-17 | 2007-08-23 | Flir Systems, Inc. | Gimbal system with airflow |
US20160159463A1 (en) * | 2013-07-31 | 2016-06-09 | SZ DJI Technology Co., Ltd | Remote control method and terminal |
US20160356574A1 (en) * | 2013-12-06 | 2016-12-08 | Bae Systems Plc | Payload delivery |
US20170144758A1 (en) * | 2014-02-28 | 2017-05-25 | Lucas J. Myslinski | Drone device security system |
US20160014309A1 (en) * | 2014-07-08 | 2016-01-14 | Flir Systems, Inc. | Gimbal system with imbalance compensation |
US20160171330A1 (en) * | 2014-12-15 | 2016-06-16 | Reflex Robotics, Inc. | Vision based real-time object tracking system for robotic gimbal control |
WO2016111595A1 (en) * | 2015-01-09 | 2016-07-14 | 주식회사 대한항공 | Method for guiding and controlling drone using information for controlling camera of drone |
US20170158338A1 (en) * | 2015-10-14 | 2017-06-08 | Flirtey Holdings, Inc. | Parachute control system for an unmanned aerial vehicle |
US20170163896A1 (en) * | 2015-12-03 | 2017-06-08 | Samsung Electronics Co., Ltd. | Camera gimbal |
Cited By (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10576968B2 (en) * | 2014-08-27 | 2020-03-03 | Renesas Electronics Corporation | Control system, relay device and control method |
US20180067493A1 (en) * | 2016-09-02 | 2018-03-08 | Skyefish, Llc | Intelligent gimbal assembly and method for unmanned vehicle |
US20220264007A1 (en) * | 2016-09-02 | 2022-08-18 | Skyyfish Llc | Intelligent gimbal assembly and method for unmanned vehicle |
US10969786B1 (en) * | 2016-12-16 | 2021-04-06 | Amazon Technologies, Inc. | Determining and using relative motion of sensor modules |
US10209713B1 (en) * | 2016-12-16 | 2019-02-19 | Amazon Technologies, Inc. | Determining and using relative motion of sensor modules |
US20190066524A1 (en) * | 2017-08-10 | 2019-02-28 | Hangzhou Zero Zero Technology Co., Ltd. | System and method for obstacle avoidance in aerial systems |
US10515560B2 (en) * | 2017-08-10 | 2019-12-24 | Hangzhou Zero Zero Technology Co., Ltd. | System and method for obstacle avoidance in aerial systems |
US11423792B2 (en) * | 2017-08-10 | 2022-08-23 | Hangzhou Zero Zero Technology Co., Ltd. | System and method for obstacle avoidance in aerial systems |
US20230166862A1 (en) * | 2018-04-26 | 2023-06-01 | Skydio, Inc. | Autonomous Aerial Vehicle Hardware Configuration |
US12077316B2 (en) * | 2018-04-26 | 2024-09-03 | Skydio, Inc. | Autonomous aerial vehicle hardware configuration |
US20250058871A1 (en) * | 2018-04-26 | 2025-02-20 | Skydio, Inc. | Autonomous Aerial Vehicle Hardware Configuration |
US20250002144A1 (en) * | 2018-04-26 | 2025-01-02 | Skydio, Inc. | Autonomous Aerial Vehicle Hardware Configuration |
US12157553B2 (en) | 2018-04-26 | 2024-12-03 | Skydio, Inc. | Autonomous aerial vehicle rotor configurations |
US12145714B2 (en) * | 2018-04-26 | 2024-11-19 | Skydio, Inc. | Autonomous aerial vehicle hardware configuration |
US12012224B2 (en) | 2018-04-26 | 2024-06-18 | Skydio, Inc. | Autonomous aerial vehicle hardware configuration |
US20220411103A1 (en) * | 2018-04-26 | 2022-12-29 | Skydio, Inc. | Autonomous Aerial Vehicle Hardware Configuration |
US20230002074A1 (en) * | 2018-04-26 | 2023-01-05 | Skydio, Inc. | Autonomous Aerial Vehicle Hardware Configuration |
US20230144408A1 (en) * | 2018-04-26 | 2023-05-11 | Skydio, Inc. | Autonomous Aerial Vehicle Hardware Configuration |
US11970287B2 (en) | 2018-04-26 | 2024-04-30 | Skydio, Inc. | Autonomous aerial vehicle hardware configuration |
WO2020097228A2 (en) | 2018-11-06 | 2020-05-14 | Droneseed Co. | Predation-resistant capsular planting systems and methods |
US12265385B2 (en) | 2018-11-06 | 2025-04-01 | Battelle Energy Alliance, Llc | Systems, devices, and methods for millimeter wave communication for unmanned aerial vehicles |
US11375656B2 (en) | 2018-11-06 | 2022-07-05 | Droneseed Co. | Remote drone configuration systems and methods |
US11985914B2 (en) | 2018-11-06 | 2024-05-21 | Droneseed Co. | Predation-resistant capsular planting systems and methods |
US11470764B2 (en) * | 2018-11-06 | 2022-10-18 | Droneseed Co. | Wide base capsular planting systems and methods |
CN110143288A (en) * | 2019-04-29 | 2019-08-20 | 一飞智控(天津)科技有限公司 | IMU shock absorber |
US12192604B2 (en) * | 2019-10-24 | 2025-01-07 | Autel Robotics Co., Ltd. | Replaceable gimbal camera, aircraft, aircraft system, and gimbal replacement method for aircraft |
US20220247898A1 (en) * | 2019-10-24 | 2022-08-04 | Autel Robotics Co., Ltd. | Replaceable gimbal camera, aircraft, aircraft system, and gimbal replacement method for aircraft |
CN111123972A (en) * | 2019-12-04 | 2020-05-08 | 北京航天时代激光导航技术有限责任公司 | Course angle tracking-based inertial measurement combined rotation modulation method |
CN112319387A (en) * | 2020-11-19 | 2021-02-05 | 吉林农业大学 | Stay wire control type following stable platform |
US12030399B2 (en) * | 2022-04-27 | 2024-07-09 | Skydio, Inc. | Base stations for unmanned aerial vehicles (UAVs) |
US12017553B2 (en) * | 2022-04-27 | 2024-06-25 | Skydio, Inc. | Base stations for unmanned aerial vehicles (UAVs) |
US20230348104A1 (en) * | 2022-04-27 | 2023-11-02 | Skydio, Inc. | Base Stations For Unmanned Aerial Vehicles (UAVs) |
US11884422B2 (en) | 2022-04-27 | 2024-01-30 | Skydio, Inc. | Base stations for unmanned aerial vehicles (UAVs) |
US12246610B2 (en) | 2022-04-27 | 2025-03-11 | Skydio, Inc. | Base stations for unmanned aerial vehicles (UAVs) |
US20230348106A1 (en) * | 2022-04-27 | 2023-11-02 | Skydio, Inc. | Base Stations For Unmanned Aerial Vehicles (UAVs) |
US12275318B2 (en) | 2023-12-12 | 2025-04-15 | Skydio, Inc. | Base stations for unmanned aerial vehicles (UAVs) |
Also Published As
Publication number | Publication date |
---|---|
WO2018022176A1 (en) | 2018-02-01 |
US10281930B2 (en) | 2019-05-07 |
EP3487759A1 (en) | 2019-05-29 |
CN109476377B (en) | 2019-10-18 |
TW201803635A (en) | 2018-02-01 |
CN109476377A (en) | 2019-03-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10281930B2 (en) | Gimbaled universal drone controller | |
US10914590B2 (en) | Methods and systems for determining a state of an unmanned aerial vehicle | |
US11015956B2 (en) | System and method for automatic sensor calibration | |
US11822353B2 (en) | Simple multi-sensor calibration | |
US10447912B2 (en) | Systems, methods, and devices for setting camera parameters | |
EP3158255B1 (en) | Systems and methods for payload stabilization | |
US11017681B2 (en) | Unmanned aerial vehicle avoiding obstacles | |
EP3428766B1 (en) | Multi-sensor environmental mapping | |
EP2844560B1 (en) | Payload mounting platform | |
CN106647790A (en) | Four-rotor unmanned aerial vehicle aircraft system oriented to complex environment and flying method | |
US20200319642A1 (en) | Gimbal control method and device, gimbal, and unmanned aerial vehicle | |
Arreola et al. | Improvement in the UAV position estimation with low-cost GPS, INS and vision-based system: Application to a quadrotor UAV | |
US10386857B2 (en) | Sensor-centric path planning and control for robotic vehicles | |
US11958604B2 (en) | Unmanned aerial vehicle and method for controlling gimbal thereof | |
KR102037359B1 (en) | AHRS flight control device based on mobile platform | |
JP6934116B1 (en) | Control device and control method for controlling the flight of an aircraft | |
CN107624171A (en) | The control method of unmanned plane and control UAV Attitude, control device | |
US20210343170A1 (en) | System and method for software-defined drones | |
Yiğit et al. | Visual attitude estimation and stabilization of flying robots | |
Lin et al. | Mechatronic Design of Unmanned Aircraft Systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: QUALCOMM INCORPORATED, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HUTSON, DONALD;REEL/FRAME:040144/0495 Effective date: 20160922 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20230507 |